2023-11-04T01:10:15.850 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-04T01:10:15.851 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --name pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} --archive /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916 --verbose -- /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916/orig.config.yaml 2023-11-04T01:10:15.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:10:15.972 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916 branch: main description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} email: pdonnell@redhat.com first_in_suite: false job_id: '7445916' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - RECENT_CRASH sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: dry_run: true install: ceph: flavor: default sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231103.180916 sha1: 702f9e6492477037e018f68dfdf636a30c24f329 owner: scheduled_pdonnell@teuthology priority: 50 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7192 sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-batrick-testing-20231103.180916 suite_path: /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 702f9e6492477037e018f68dfdf636a30c24f329 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEP33QRKjqYt3rrNPaSn8R1Cq5DyKr+PhsocEzo4pZCAFLmg81RuMKOIgR7Q8+Ly7GV2/8n/Jo8rX3wsPso1O5I= smithi204.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHbhy4KKYMDYVBb7sgkkvLdo1Ohw4vrv9EjCqGxg3XekYNRc70VsELiS7DRbS8pG7vm7tnfJQ5TqKesrAH4rWUM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - exec: mon.a: - ceph config set mgr mgr/crash/warn_recent_interval 0 - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_snapshots teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-03_18:12:33 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822 2023-11-04T01:10:15.973 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa; will attempt to use it 2023-11-04T01:10:15.973 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks 2023-11-04T01:10:15.973 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-04T01:10:15.975 INFO:teuthology.task.internal:Checking packages... 2023-11-04T01:10:15.996 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4' 2023-11-04T01:10:15.996 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-04T01:10:15.996 INFO:teuthology.packaging:ref: None 2023-11-04T01:10:15.997 INFO:teuthology.packaging:tag: None 2023-11-04T01:10:15.997 INFO:teuthology.packaging:branch: main 2023-11-04T01:10:15.997 INFO:teuthology.packaging:sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:10:15.997 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2023-11-04T01:10:16.217 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7052.g7188d8cd 2023-11-04T01:10:16.217 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-04T01:10:16.224 INFO:teuthology.task.internal:no buildpackages task found 2023-11-04T01:10:16.225 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-04T01:10:16.256 INFO:teuthology.task.internal:Saving configuration 2023-11-04T01:10:16.271 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-04T01:10:16.277 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:10:16.303 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:34.676279', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEP33QRKjqYt3rrNPaSn8R1Cq5DyKr+PhsocEzo4pZCAFLmg81RuMKOIgR7Q8+Ly7GV2/8n/Jo8rX3wsPso1O5I='} 2023-11-04T01:10:16.325 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:34.677984', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHbhy4KKYMDYVBb7sgkkvLdo1Ohw4vrv9EjCqGxg3XekYNRc70VsELiS7DRbS8pG7vm7tnfJQ5TqKesrAH4rWUM='} 2023-11-04T01:10:16.325 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-04T01:10:16.331 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-04T01:10:16.331 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-04T01:10:16.331 INFO:teuthology.run_tasks:Running task console_log... 2023-11-04T01:10:16.403 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa9011ecee0>, signals=[15]) 2023-11-04T01:10:16.404 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-04T01:10:16.410 INFO:teuthology.task.internal:Opening connections... 2023-11-04T01:10:16.410 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:10:16.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:10:16.508 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:10:16.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:10:16.589 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-04T01:10:16.595 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2023-11-04T01:10:16.614 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2023-11-04T01:10:16.614 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2023-11-04T01:10:16.671 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2023-11-04T01:10:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2023-11-04T01:10:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2023-11-04T01:10:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:10:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2023-11-04T01:10:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:10:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:10:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2023-11-04T01:10:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:10:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:10:16.672 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:10:16.673 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:10:16.673 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:10:16.673 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:10:16.673 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2023-11-04T01:10:16.698 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2023-11-04T01:10:16.715 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2023-11-04T01:10:16.715 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-11-04T01:10:16.772 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2023-11-04T01:10:16.772 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2023-11-04T01:10:16.772 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2023-11-04T01:10:16.772 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:10:16.772 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2023-11-04T01:10:16.772 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:10:16.772 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:10:16.773 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2023-11-04T01:10:16.773 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:10:16.773 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:10:16.773 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:10:16.773 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:10:16.773 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:10:16.773 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:10:16.773 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-11-04T01:10:16.798 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-04T01:10:16.807 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-04T01:10:16.813 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-04T01:10:16.813 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2023-11-04T01:10:16.816 DEBUG:teuthology.orchestra.run.smithi204:> test '!' -e /home/ubuntu/cephtest 2023-11-04T01:10:16.831 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-04T01:10:16.836 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-04T01:10:16.837 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2023-11-04T01:10:16.873 DEBUG:teuthology.orchestra.run.smithi204:> test -z $(ls -A /var/lib/ceph) 2023-11-04T01:10:16.969 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-04T01:10:17.023 INFO:teuthology.run_tasks:Running task kernel... 2023-11-04T01:10:17.037 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-04T01:10:17.037 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-04T01:10:17.038 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-04T01:10:17.038 DEBUG:teuthology.orchestra.run.smithi204:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-04T01:10:17.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:10:17.054 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2023-11-04T01:10:17.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:10:17.056 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2023-11-04T01:10:17.110 INFO:teuthology.orchestra.run.smithi204.stdout:5.14.0-361.el9.x86_64 2023-11-04T01:10:17.111 INFO:teuthology.task.kernel:Running kernel on smithi204: 5.14.0-361.el9.x86_64 2023-11-04T01:10:17.111 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum install -y kernel 2023-11-04T01:10:17.113 INFO:teuthology.orchestra.run.smithi044.stdout:5.14.0-361.el9.x86_64 2023-11-04T01:10:17.113 INFO:teuthology.task.kernel:Running kernel on smithi044: 5.14.0-361.el9.x86_64 2023-11-04T01:10:17.113 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum install -y kernel 2023-11-04T01:10:19.105 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - AppStream 16 MB/s | 6.3 MB 00:00 2023-11-04T01:10:19.170 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - AppStream 16 MB/s | 6.3 MB 00:00 2023-11-04T01:10:20.469 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2023-11-04T01:10:20.470 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - BaseOS 7.3 MB/s | 2.0 MB 00:00 2023-11-04T01:10:22.455 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 7.9 MB 00:01 2023-11-04T01:10:24.351 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 7.9 MB 00:03 2023-11-04T01:10:24.471 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 20 MB/s | 18 MB 00:00 2023-11-04T01:10:27.195 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 10 MB/s | 18 MB 00:01 2023-11-04T01:10:29.630 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 5.8 MB 00:01 2023-11-04T01:10:31.312 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 5.8 MB 00:00 2023-11-04T01:10:31.480 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 15 kB 00:00 2023-11-04T01:10:32.663 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 15 kB 00:00 2023-11-04T01:10:33.799 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 8.8 MB/s | 19 MB 00:02 2023-11-04T01:10:36.192 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 5.7 MB/s | 19 MB 00:03 2023-11-04T01:10:38.465 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 6.1 kB/s | 1.7 kB 00:00 2023-11-04T01:10:40.555 INFO:teuthology.orchestra.run.smithi204.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-04T01:10:40.555 INFO:teuthology.orchestra.run.smithi204.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-04T01:10:40.643 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2023-11-04T01:10:40.653 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2023-11-04T01:10:40.653 INFO:teuthology.orchestra.run.smithi204.stdout: Package Architecture Version Repository Size 2023-11-04T01:10:40.653 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2023-11-04T01:10:40.653 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2023-11-04T01:10:40.653 INFO:teuthology.orchestra.run.smithi204.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-04T01:10:40.653 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2023-11-04T01:10:40.653 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-04T01:10:40.653 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-04T01:10:40.653 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-04T01:10:40.654 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:10:40.654 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2023-11-04T01:10:40.654 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2023-11-04T01:10:40.654 INFO:teuthology.orchestra.run.smithi204.stdout:Install 4 Packages 2023-11-04T01:10:40.654 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:10:40.654 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 95 M 2023-11-04T01:10:40.655 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 120 M 2023-11-04T01:10:40.655 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2023-11-04T01:10:40.930 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2023-11-04T01:10:41.350 INFO:teuthology.orchestra.run.smithi204.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 8.4 MB/s | 5.3 MB 00:00 2023-11-04T01:10:41.584 INFO:teuthology.orchestra.run.smithi204.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 23 MB/s | 20 MB 00:00 2023-11-04T01:10:42.117 INFO:teuthology.orchestra.run.smithi204.stdout:(3/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 27 MB/s | 38 MB 00:01 2023-11-04T01:10:42.809 INFO:teuthology.orchestra.run.smithi204.stdout:(4/4): kernel-modules-core-5.14.0-378.el9.x86_6 22 MB/s | 32 MB 00:01 2023-11-04T01:10:42.809 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:10:42.809 INFO:teuthology.orchestra.run.smithi204.stdout:Total 44 MB/s | 95 MB 00:02 2023-11-04T01:10:43.112 INFO:teuthology.orchestra.run.smithi044.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-04T01:10:43.112 INFO:teuthology.orchestra.run.smithi044.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-04T01:10:43.195 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2023-11-04T01:10:43.203 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2023-11-04T01:10:43.203 INFO:teuthology.orchestra.run.smithi044.stdout: Package Architecture Version Repository Size 2023-11-04T01:10:43.204 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2023-11-04T01:10:43.204 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2023-11-04T01:10:43.204 INFO:teuthology.orchestra.run.smithi044.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-04T01:10:43.204 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2023-11-04T01:10:43.204 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-04T01:10:43.204 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-04T01:10:43.204 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-04T01:10:43.204 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:10:43.204 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2023-11-04T01:10:43.204 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2023-11-04T01:10:43.204 INFO:teuthology.orchestra.run.smithi044.stdout:Install 4 Packages 2023-11-04T01:10:43.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:10:43.205 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 95 M 2023-11-04T01:10:43.205 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 120 M 2023-11-04T01:10:43.205 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2023-11-04T01:10:43.658 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2023-11-04T01:10:44.012 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2023-11-04T01:10:44.012 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2023-11-04T01:10:45.296 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2023-11-04T01:10:45.296 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2023-11-04T01:10:48.173 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2023-11-04T01:10:48.248 INFO:teuthology.orchestra.run.smithi044.stdout:(1/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 7.5 MB/s | 38 MB 00:04 2023-11-04T01:10:48.818 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:10:48.960 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:10:49.290 INFO:teuthology.orchestra.run.smithi044.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 3.3 MB/s | 20 MB 00:06 2023-11-04T01:10:49.365 INFO:teuthology.orchestra.run.smithi044.stdout:(3/4): kernel-5.14.0-378.el9.x86_64.rpm 894 kB/s | 5.3 MB 00:06 2023-11-04T01:10:51.720 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:10:51.898 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:10:54.273 INFO:teuthology.orchestra.run.smithi044.stdout:(4/4): kernel-modules-core-5.14.0-378.el9.x86_6 5.3 MB/s | 32 MB 00:06 2023-11-04T01:10:54.274 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:10:54.274 INFO:teuthology.orchestra.run.smithi044.stdout:Total 8.6 MB/s | 95 MB 00:11 2023-11-04T01:10:55.153 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2023-11-04T01:10:55.570 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2023-11-04T01:10:55.570 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2023-11-04T01:10:56.494 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:10:56.605 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:10:56.908 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2023-11-04T01:10:56.908 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2023-11-04T01:10:59.663 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2023-11-04T01:11:00.306 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:11:00.440 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:11:01.229 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:11:03.553 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:11:08.530 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:11:08.644 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:13.655 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:29.886 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:29.929 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:30.342 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:30.343 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:11:30.343 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:11:30.343 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:11:30.742 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:30.742 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:11:30.743 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2023-11-04T01:11:30.743 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-04T01:11:30.743 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-04T01:11:30.743 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-04T01:11:30.743 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-04T01:11:30.743 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:11:30.743 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2023-11-04T01:11:31.241 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:11:31.380 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:11:31.381 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:11:31.381 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-04T01:11:31.381 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-04T01:11:31.381 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-04T01:11:31.381 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-04T01:11:31.381 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi204.front.sepia.ceph.com, path=None, version=distro) 2023-11-04T01:11:31.381 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:11:31.498 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:11:31.498 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:11:31.499 DEBUG:teuthology.orchestra.run.smithi204:> sudo rpm -qi grub2-tools 2023-11-04T01:11:31.539 INFO:teuthology.orchestra.run.smithi204.stdout:Name : grub2-tools 2023-11-04T01:11:31.539 INFO:teuthology.orchestra.run.smithi204.stdout:Epoch : 1 2023-11-04T01:11:31.540 INFO:teuthology.orchestra.run.smithi204.stdout:Version : 2.06 2023-11-04T01:11:31.540 INFO:teuthology.orchestra.run.smithi204.stdout:Release : 68.el9 2023-11-04T01:11:31.540 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: x86_64 2023-11-04T01:11:31.540 INFO:teuthology.orchestra.run.smithi204.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-04T01:11:31.540 INFO:teuthology.orchestra.run.smithi204.stdout:Group : Unspecified 2023-11-04T01:11:31.540 INFO:teuthology.orchestra.run.smithi204.stdout:Size : 8264254 2023-11-04T01:11:31.540 INFO:teuthology.orchestra.run.smithi204.stdout:License : GPLv3+ 2023-11-04T01:11:31.540 INFO:teuthology.orchestra.run.smithi204.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-04T01:11:31.540 INFO:teuthology.orchestra.run.smithi204.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-04T01:11:31.540 INFO:teuthology.orchestra.run.smithi204.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-04T01:11:31.540 INFO:teuthology.orchestra.run.smithi204.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-04T01:11:31.540 INFO:teuthology.orchestra.run.smithi204.stdout:Packager : builder@centos.org 2023-11-04T01:11:31.541 INFO:teuthology.orchestra.run.smithi204.stdout:Vendor : CentOS 2023-11-04T01:11:31.541 INFO:teuthology.orchestra.run.smithi204.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-04T01:11:31.541 INFO:teuthology.orchestra.run.smithi204.stdout:Summary : Support tools for GRUB. 2023-11-04T01:11:31.541 INFO:teuthology.orchestra.run.smithi204.stdout:Description : 2023-11-04T01:11:31.541 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:11:31.541 INFO:teuthology.orchestra.run.smithi204.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-04T01:11:31.541 INFO:teuthology.orchestra.run.smithi204.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-04T01:11:31.541 INFO:teuthology.orchestra.run.smithi204.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-04T01:11:31.541 INFO:teuthology.orchestra.run.smithi204.stdout:hardware devices. 2023-11-04T01:11:31.541 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:11:31.541 INFO:teuthology.orchestra.run.smithi204.stdout:This subpackage provides tools for support of all platforms. 2023-11-04T01:11:31.542 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-04T01:11:31.542 INFO:teuthology.task.kernel:Updating grub on smithi204 to boot 5.14.0-378.el9.x86_64 2023-11-04T01:11:31.542 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-04T01:11:32.178 INFO:teuthology.orchestra.run.smithi204.stderr:Generating grub configuration file ... 2023-11-04T01:11:33.489 INFO:teuthology.orchestra.run.smithi204.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-04T01:11:33.543 INFO:teuthology.orchestra.run.smithi204.stderr:done 2023-11-04T01:11:33.546 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2023-11-04T01:11:33.562 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.NcUh0Lgp3X 2023-11-04T01:11:33.562 DEBUG:teuthology.orchestra.run.smithi204:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NcUh0Lgp3X 2023-11-04T01:11:33.631 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.NcUh0Lgp3X 2023-11-04T01:11:33.765 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.NcUh0Lgp3X is 6KB 2023-11-04T01:11:33.813 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.NcUh0Lgp3X 2023-11-04T01:11:33.827 DEBUG:teuthology.orchestra.run.smithi204:> sudo /bin/ls /boot/loader/entries || true 2023-11-04T01:11:33.892 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-04T01:11:33.892 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-04T01:11:33.892 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-04T01:11:33.893 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-04T01:11:33.894 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-04T01:11:34.032 DEBUG:teuthology.orchestra.run.smithi204:> sudo shutdown -r now 2023-11-04T01:11:44.183 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:22:49.621 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-04T01:22:49.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-11-04T01:22:49.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:22:49.634 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:22:49.635 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:22:49.635 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:22:49.635 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:22:49.635 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:22:49.635 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:22:49.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:22:49.635 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2023-11-04T01:22:49.635 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-04T01:22:49.635 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-04T01:22:49.636 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-04T01:22:49.636 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-04T01:22:49.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:22:49.636 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2023-11-04T01:22:49.637 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:22:49.848 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:22:49.848 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:22:49.849 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-04T01:22:49.849 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-04T01:22:49.849 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-04T01:22:49.849 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-04T01:22:49.849 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi044.front.sepia.ceph.com, path=None, version=distro) 2023-11-04T01:22:49.849 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:22:49.972 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:22:49.972 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:22:49.972 DEBUG:teuthology.orchestra.run.smithi044:> sudo rpm -qi grub2-tools 2023-11-04T01:22:49.982 DEBUG:teuthology.orchestra.run.smithi204:> true 2023-11-04T01:22:50.010 INFO:teuthology.orchestra.run.smithi044.stdout:Name : grub2-tools 2023-11-04T01:22:50.010 INFO:teuthology.orchestra.run.smithi044.stdout:Epoch : 1 2023-11-04T01:22:50.010 INFO:teuthology.orchestra.run.smithi044.stdout:Version : 2.06 2023-11-04T01:22:50.010 INFO:teuthology.orchestra.run.smithi044.stdout:Release : 68.el9 2023-11-04T01:22:50.010 INFO:teuthology.orchestra.run.smithi044.stdout:Architecture: x86_64 2023-11-04T01:22:50.011 INFO:teuthology.orchestra.run.smithi044.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-04T01:22:50.011 INFO:teuthology.orchestra.run.smithi044.stdout:Group : Unspecified 2023-11-04T01:22:50.011 INFO:teuthology.orchestra.run.smithi044.stdout:Size : 8264254 2023-11-04T01:22:50.011 INFO:teuthology.orchestra.run.smithi044.stdout:License : GPLv3+ 2023-11-04T01:22:50.011 INFO:teuthology.orchestra.run.smithi044.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-04T01:22:50.011 INFO:teuthology.orchestra.run.smithi044.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-04T01:22:50.011 INFO:teuthology.orchestra.run.smithi044.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-04T01:22:50.011 INFO:teuthology.orchestra.run.smithi044.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-04T01:22:50.011 INFO:teuthology.orchestra.run.smithi044.stdout:Packager : builder@centos.org 2023-11-04T01:22:50.011 INFO:teuthology.orchestra.run.smithi044.stdout:Vendor : CentOS 2023-11-04T01:22:50.011 INFO:teuthology.orchestra.run.smithi044.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-04T01:22:50.011 INFO:teuthology.orchestra.run.smithi044.stdout:Summary : Support tools for GRUB. 2023-11-04T01:22:50.011 INFO:teuthology.orchestra.run.smithi044.stdout:Description : 2023-11-04T01:22:50.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:22:50.012 INFO:teuthology.orchestra.run.smithi044.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-04T01:22:50.012 INFO:teuthology.orchestra.run.smithi044.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-04T01:22:50.012 INFO:teuthology.orchestra.run.smithi044.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-04T01:22:50.012 INFO:teuthology.orchestra.run.smithi044.stdout:hardware devices. 2023-11-04T01:22:50.012 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:22:50.012 INFO:teuthology.orchestra.run.smithi044.stdout:This subpackage provides tools for support of all platforms. 2023-11-04T01:22:50.013 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-04T01:22:50.013 INFO:teuthology.task.kernel:Updating grub on smithi044 to boot 5.14.0-378.el9.x86_64 2023-11-04T01:22:50.013 DEBUG:teuthology.orchestra.run.smithi044:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-04T01:22:50.360 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-11-04T01:22:50.360 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-378.el9.x86_64"... 2023-11-04T01:22:50.360 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2023-11-04T01:22:50.375 INFO:teuthology.orchestra.run.smithi204.stdout:5.14.0-378.el9.x86_64 2023-11-04T01:22:50.375 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-04T01:22:50.375 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-04T01:22:50.375 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-04T01:22:50.551 INFO:teuthology.orchestra.run.smithi044.stderr:Generating grub configuration file ... 2023-11-04T01:22:51.376 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-04T01:22:51.376 DEBUG:teuthology.orchestra.run.smithi204:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-04T01:22:51.447 INFO:teuthology.orchestra.run.smithi204.stdout:ttyS1 2023-11-04T01:22:51.491 DEBUG:teuthology.parallel:result is None 2023-11-04T01:22:51.984 INFO:teuthology.orchestra.run.smithi044.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-04T01:22:52.011 INFO:teuthology.orchestra.run.smithi044.stderr:done 2023-11-04T01:22:52.013 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2023-11-04T01:22:52.027 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.pBgj9GwVKH 2023-11-04T01:22:52.028 DEBUG:teuthology.orchestra.run.smithi044:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pBgj9GwVKH 2023-11-04T01:22:52.100 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.pBgj9GwVKH 2023-11-04T01:22:52.248 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.pBgj9GwVKH is 6KB 2023-11-04T01:22:52.297 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.pBgj9GwVKH 2023-11-04T01:22:52.311 DEBUG:teuthology.orchestra.run.smithi044:> sudo /bin/ls /boot/loader/entries || true 2023-11-04T01:22:52.380 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-04T01:22:52.381 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-04T01:22:52.381 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-04T01:22:52.381 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-04T01:22:52.382 DEBUG:teuthology.orchestra.run.smithi044:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-04T01:22:52.528 DEBUG:teuthology.orchestra.run.smithi044:> sudo shutdown -r now 2023-11-04T01:23:22.530 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-04T01:23:22.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-11-04T01:23:22.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:24:22.534 DEBUG:teuthology.orchestra.remote:timed out 2023-11-04T01:24:31.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-11-04T01:24:31.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:24:32.032 DEBUG:teuthology.orchestra.run.smithi044:> true 2023-11-04T01:24:32.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-11-04T01:24:32.423 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-378.el9.x86_64"... 2023-11-04T01:24:32.423 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2023-11-04T01:24:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:5.14.0-378.el9.x86_64 2023-11-04T01:24:32.438 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-04T01:24:32.438 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-04T01:24:32.438 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-04T01:24:33.439 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-04T01:24:33.439 DEBUG:teuthology.orchestra.run.smithi044:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-04T01:24:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ttyS1 2023-11-04T01:24:33.553 DEBUG:teuthology.parallel:result is None 2023-11-04T01:24:33.553 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-04T01:24:33.562 INFO:teuthology.task.internal:Creating test directory... 2023-11-04T01:24:33.562 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-04T01:24:33.564 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-04T01:24:33.582 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-04T01:24:33.593 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-04T01:24:33.606 INFO:teuthology.task.internal:Creating archive directory... 2023-11-04T01:24:33.607 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-04T01:24:33.620 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-04T01:24:33.699 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-04T01:24:33.709 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-04T01:24:33.710 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-04T01:24:33.712 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-04T01:24:33.750 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:33.756 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:33.767 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:33.770 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:33.772 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-04T01:24:33.783 INFO:teuthology.task.internal:Configuring sudo... 2023-11-04T01:24:33.783 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-04T01:24:33.812 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-04T01:24:33.842 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-04T01:24:33.855 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-04T01:24:33.856 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-04T01:24:33.883 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-04T01:24:33.899 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:24:33.979 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:24:34.030 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:24:34.112 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:24:34.159 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:24:34.159 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-04T01:24:34.231 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:24:34.276 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:24:34.324 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:24:34.408 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:24:34.453 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:24:34.454 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-04T01:24:34.523 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2023-11-04T01:24:34.525 DEBUG:teuthology.orchestra.run.smithi204:> sudo service rsyslog restart 2023-11-04T01:24:34.571 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:24:34.657 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:24:35.102 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-04T01:24:35.111 INFO:teuthology.task.internal:Starting timer... 2023-11-04T01:24:35.111 INFO:teuthology.run_tasks:Running task pcp... 2023-11-04T01:24:35.127 INFO:teuthology.run_tasks:Running task selinux... 2023-11-04T01:24:35.141 DEBUG:teuthology.orchestra.run.smithi044:> sudo service auditd rotate 2023-11-04T01:24:35.214 INFO:teuthology.orchestra.run.smithi044.stdout:Rotating logs: 2023-11-04T01:24:35.216 DEBUG:teuthology.orchestra.run.smithi204:> sudo service auditd rotate 2023-11-04T01:24:35.273 INFO:teuthology.orchestra.run.smithi204.stdout:Rotating logs: 2023-11-04T01:24:35.273 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-04T01:24:35.273 DEBUG:teuthology.orchestra.run.smithi044:> /usr/sbin/getenforce 2023-11-04T01:24:35.292 INFO:teuthology.orchestra.run.smithi044.stdout:Permissive 2023-11-04T01:24:35.292 DEBUG:teuthology.orchestra.run.smithi204:> /usr/sbin/getenforce 2023-11-04T01:24:35.318 INFO:teuthology.orchestra.run.smithi204.stdout:Permissive 2023-11-04T01:24:35.318 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi044.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi204.front.sepia.ceph.com': 'permissive'} 2023-11-04T01:24:35.318 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:24:35.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:24:35.365 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:24:35.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:24:35.395 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-04T01:24:35.396 DEBUG:teuthology.orchestra.run.smithi044:> sudo /usr/sbin/setenforce permissive 2023-11-04T01:24:35.502 DEBUG:teuthology.orchestra.run.smithi204:> sudo /usr/sbin/setenforce permissive 2023-11-04T01:24:35.536 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-04T01:24:35.547 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-04T01:24:35.547 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-04T01:24:35.565 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-04T01:24:35.566 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi044.front.sepia.ceph.com,smithi204.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-04T01:33:11.462 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi204.front.sepia.ceph.com')] 2023-11-04T01:33:11.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-11-04T01:33:11.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:33:11.566 DEBUG:teuthology.orchestra.run.smithi044:> true 2023-11-04T01:33:11.639 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-11-04T01:33:11.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-11-04T01:33:11.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:33:11.725 DEBUG:teuthology.orchestra.run.smithi204:> true 2023-11-04T01:33:11.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-11-04T01:33:11.794 INFO:teuthology.run_tasks:Running task clock... 2023-11-04T01:33:11.812 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-04T01:33:11.812 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-04T01:33:11.812 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:33:11.815 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-04T01:33:11.815 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:33:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-04T01:33:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-04T01:33:11.876 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-04T01:33:11.895 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-04T01:33:11.909 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: ntpd: command not found 2023-11-04T01:33:11.927 INFO:teuthology.orchestra.run.smithi044.stdout:506 Cannot talk to daemon 2023-11-04T01:33:11.927 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: ntpd: command not found 2023-11-04T01:33:11.938 INFO:teuthology.orchestra.run.smithi204.stdout:506 Cannot talk to daemon 2023-11-04T01:33:11.947 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-04T01:33:11.954 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-04T01:33:11.970 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-04T01:33:11.971 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-04T01:33:12.013 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:33:12.014 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:33:12.020 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:33:12.020 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2023-11-04T01:33:12.020 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:12.020 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:12.021 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:12.021 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:12.021 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:33:12.021 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2023-11-04T01:33:12.021 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:12.021 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:12.021 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:12.021 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:12.021 INFO:teuthology.run_tasks:Running task install... 2023-11-04T01:33:12.039 DEBUG:teuthology.task.install:project ceph 2023-11-04T01:33:12.042 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}} 2023-11-04T01:33:12.042 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'} 2023-11-04T01:33:12.043 INFO:teuthology.task.install:Using flavor: default 2023-11-04T01:33:12.103 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-04T01:33:12.103 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-04T01:33:12.104 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'tag': None, 'wait_for_package': False} 2023-11-04T01:33:12.105 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:33:12.108 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'tag': None, 'wait_for_package': False} 2023-11-04T01:33:12.123 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:33:12.318 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/ 2023-11-04T01:33:12.318 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7035.g7532011a 2023-11-04T01:33:12.388 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/ 2023-11-04T01:33:12.388 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7035.g7532011a 2023-11-04T01:33:12.509 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-04T01:33:12.509 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:33:12.509 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-04T01:33:12.540 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-04T01:33:12.540 DEBUG:teuthology.orchestra.run.smithi204:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-04T01:33:12.586 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-04T01:33:12.587 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:33:12.587 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-04T01:33:12.608 DEBUG:teuthology.orchestra.run.smithi204:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-04T01:33:12.621 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-04T01:33:12.621 DEBUG:teuthology.orchestra.run.smithi044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-04T01:33:12.689 DEBUG:teuthology.orchestra.run.smithi204:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-04T01:33:12.699 DEBUG:teuthology.orchestra.run.smithi044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-04T01:33:12.756 INFO:teuthology.orchestra.run.smithi204.stdout:check_obsoletes = 1 2023-11-04T01:33:12.757 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum clean all 2023-11-04T01:33:12.789 DEBUG:teuthology.orchestra.run.smithi044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-04T01:33:12.819 INFO:teuthology.orchestra.run.smithi044.stdout:check_obsoletes = 1 2023-11-04T01:33:12.821 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum clean all 2023-11-04T01:33:13.013 INFO:teuthology.orchestra.run.smithi204.stdout:72 files removed 2023-11-04T01:33:13.040 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-04T01:33:13.075 INFO:teuthology.orchestra.run.smithi044.stdout:72 files removed 2023-11-04T01:33:13.103 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-04T01:33:13.772 INFO:teuthology.orchestra.run.smithi204.stdout:ceph packages for x86_64 189 kB/s | 78 kB 00:00 2023-11-04T01:33:13.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph packages for x86_64 210 kB/s | 78 kB 00:00 2023-11-04T01:33:14.165 INFO:teuthology.orchestra.run.smithi204.stdout:ceph noarch packages 27 kB/s | 9.4 kB 00:00 2023-11-04T01:33:14.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-11-04T01:33:14.575 INFO:teuthology.orchestra.run.smithi204.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2023-11-04T01:33:14.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2023-11-04T01:33:14.968 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - AppStream 18 MB/s | 6.3 MB 00:00 2023-11-04T01:33:15.026 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - AppStream 17 MB/s | 6.3 MB 00:00 2023-11-04T01:33:16.293 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2023-11-04T01:33:16.385 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.0 MB 00:00 2023-11-04T01:33:17.134 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 7.9 MB 00:00 2023-11-04T01:33:18.452 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 7.9 MB 00:01 2023-11-04T01:33:20.728 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 7.0 MB/s | 18 MB 00:02 2023-11-04T01:33:23.443 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 18 MB 00:03 2023-11-04T01:33:26.713 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 5.8 MB 00:02 2023-11-04T01:33:28.656 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 15 kB 00:00 2023-11-04T01:33:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 5.8 MB 00:02 2023-11-04T01:33:29.793 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 19 MB/s | 19 MB 00:01 2023-11-04T01:33:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 84 kB/s | 15 kB 00:00 2023-11-04T01:33:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 14 MB/s | 19 MB 00:01 2023-11-04T01:33:34.316 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-11-04T01:33:36.655 INFO:teuthology.orchestra.run.smithi204.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:33:36.656 INFO:teuthology.orchestra.run.smithi204.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:33:36.669 INFO:teuthology.orchestra.run.smithi204.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-04T01:33:36.670 INFO:teuthology.orchestra.run.smithi204.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-04T01:33:36.670 INFO:teuthology.orchestra.run.smithi204.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-04T01:33:36.670 INFO:teuthology.orchestra.run.smithi204.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-04T01:33:36.671 INFO:teuthology.orchestra.run.smithi204.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-04T01:33:36.673 INFO:teuthology.orchestra.run.smithi204.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-04T01:33:36.674 INFO:teuthology.orchestra.run.smithi204.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-04T01:33:36.743 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2023-11-04T01:33:36.761 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================================ 2023-11-04T01:33:36.761 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2023-11-04T01:33:36.761 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================================ 2023-11-04T01:33:36.761 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2023-11-04T01:33:36.761 INFO:teuthology.orchestra.run.smithi204.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-04T01:33:36.762 INFO:teuthology.orchestra.run.smithi204.stdout: ceph x86_64 2:18.0.0-7035.g7532011a.el9 ceph 6.5 k 2023-11-04T01:33:36.762 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base x86_64 2:18.0.0-7035.g7532011a.el9 ceph 5.2 M 2023-11-04T01:33:36.762 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 859 k 2023-11-04T01:33:36.762 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7035.g7532011a.el9 ceph 140 k 2023-11-04T01:33:36.762 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr x86_64 2:18.0.0-7035.g7532011a.el9 ceph 1.5 M 2023-11-04T01:33:36.762 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 132 k 2023-11-04T01:33:36.762 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 1.8 M 2023-11-04T01:33:36.762 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 7.4 M 2023-11-04T01:33:36.762 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 48 k 2023-11-04T01:33:36.762 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 8.7 M 2023-11-04T01:33:36.762 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test x86_64 2:18.0.0-7035.g7532011a.el9 ceph 41 M 2023-11-04T01:33:36.762 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 262 k 2023-11-04T01:33:36.763 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 270 k 2023-11-04T01:33:36.763 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 217 k 2023-11-04T01:33:36.763 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-top noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 18 k 2023-11-04T01:33:36.763 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-11-04T01:33:36.763 INFO:teuthology.orchestra.run.smithi204.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-04T01:33:36.763 INFO:teuthology.orchestra.run.smithi204.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-04T01:33:36.763 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 31 k 2023-11-04T01:33:36.763 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 718 k 2023-11-04T01:33:36.763 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 126 k 2023-11-04T01:33:36.763 INFO:teuthology.orchestra.run.smithi204.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-04T01:33:36.763 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-11-04T01:33:36.763 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-11-04T01:33:36.763 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-04T01:33:36.764 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-04T01:33:36.764 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-04T01:33:36.764 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs x86_64 2:18.0.0-7035.g7532011a.el9 ceph 162 k 2023-11-04T01:33:36.764 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados x86_64 2:18.0.0-7035.g7532011a.el9 ceph 320 k 2023-11-04T01:33:36.764 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 299 k 2023-11-04T01:33:36.764 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 99 k 2023-11-04T01:33:36.764 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 84 k 2023-11-04T01:33:36.764 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:33:36.764 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 169 k 2023-11-04T01:33:36.764 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-11-04T01:33:36.764 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrading: 2023-11-04T01:33:36.764 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager x86_64 1:1.45.5-1.el9 CentOS-BaseOS 2.2 M 2023-11-04T01:33:36.764 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-libnm x86_64 1:1.45.5-1.el9 CentOS-BaseOS 1.8 M 2023-11-04T01:33:36.764 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-team x86_64 1:1.45.5-1.el9 CentOS-BaseOS 42 k 2023-11-04T01:33:36.765 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-tui x86_64 1:1.45.5-1.el9 CentOS-BaseOS 245 k 2023-11-04T01:33:36.765 INFO:teuthology.orchestra.run.smithi204.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-04T01:33:36.765 INFO:teuthology.orchestra.run.smithi204.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-04T01:33:36.765 INFO:teuthology.orchestra.run.smithi204.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-04T01:33:36.765 INFO:teuthology.orchestra.run.smithi204.stdout: librados2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.3 M 2023-11-04T01:33:36.765 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:33:36.765 INFO:teuthology.orchestra.run.smithi204.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-04T01:33:36.765 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2023-11-04T01:33:36.765 INFO:teuthology.orchestra.run.smithi204.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-11-04T01:33:36.765 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-04T01:33:36.765 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 19 M 2023-11-04T01:33:36.765 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 23 k 2023-11-04T01:33:36.766 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds x86_64 2:18.0.0-7035.g7532011a.el9 ceph 2.1 M 2023-11-04T01:33:36.766 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 243 k 2023-11-04T01:33:36.766 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.4 M 2023-11-04T01:33:36.766 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 18 M 2023-11-04T01:33:36.766 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 15 k 2023-11-04T01:33:36.766 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux x86_64 2:18.0.0-7035.g7532011a.el9 ceph 24 k 2023-11-04T01:33:36.766 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-04T01:33:36.766 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-04T01:33:36.766 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-04T01:33:36.766 INFO:teuthology.orchestra.run.smithi204.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-04T01:33:36.766 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-04T01:33:36.766 INFO:teuthology.orchestra.run.smithi204.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-04T01:33:36.766 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-04T01:33:36.767 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-04T01:33:36.767 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite x86_64 2:18.0.0-7035.g7532011a.el9 ceph 163 k 2023-11-04T01:33:36.767 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-04T01:33:36.767 INFO:teuthology.orchestra.run.smithi204.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-04T01:33:36.767 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-04T01:33:36.767 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-04T01:33:36.767 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-04T01:33:36.767 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 476 k 2023-11-04T01:33:36.767 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-04T01:33:36.767 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.8 M 2023-11-04T01:33:36.767 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-04T01:33:36.767 INFO:teuthology.orchestra.run.smithi204.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-04T01:33:36.767 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-04T01:33:36.767 INFO:teuthology.orchestra.run.smithi204.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-04T01:33:36.768 INFO:teuthology.orchestra.run.smithi204.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-04T01:33:36.768 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-04T01:33:36.768 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-04T01:33:36.768 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-04T01:33:36.768 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-04T01:33:36.768 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-04T01:33:36.768 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-04T01:33:36.768 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-04T01:33:36.768 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 45 k 2023-11-04T01:33:36.768 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 127 k 2023-11-04T01:33:36.768 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-04T01:33:36.768 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-04T01:33:36.768 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-04T01:33:36.769 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-04T01:33:36.769 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-04T01:33:36.769 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-04T01:33:36.769 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-04T01:33:36.769 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-04T01:33:36.769 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-04T01:33:36.769 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-04T01:33:36.769 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-04T01:33:36.769 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-04T01:33:36.769 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-04T01:33:36.769 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-04T01:33:36.769 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-04T01:33:36.769 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-04T01:33:36.769 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-04T01:33:36.770 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-04T01:33:36.770 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-04T01:33:36.770 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-04T01:33:36.770 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-04T01:33:36.770 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-04T01:33:36.770 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-04T01:33:36.770 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-04T01:33:36.770 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-04T01:33:36.770 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-04T01:33:36.770 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-04T01:33:36.770 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-04T01:33:36.770 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-04T01:33:36.771 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-04T01:33:36.771 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-04T01:33:36.771 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-04T01:33:36.771 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-04T01:33:36.771 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-04T01:33:36.771 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-04T01:33:36.771 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-04T01:33:36.771 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-04T01:33:36.771 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-04T01:33:36.771 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-04T01:33:36.772 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-04T01:33:36.772 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-04T01:33:36.772 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-04T01:33:36.772 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-04T01:33:36.772 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-04T01:33:36.772 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-04T01:33:36.772 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-04T01:33:36.772 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-04T01:33:36.772 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-04T01:33:36.772 INFO:teuthology.orchestra.run.smithi204.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-04T01:33:36.772 INFO:teuthology.orchestra.run.smithi204.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-04T01:33:36.772 INFO:teuthology.orchestra.run.smithi204.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-04T01:33:36.772 INFO:teuthology.orchestra.run.smithi204.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-04T01:33:36.773 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-04T01:33:36.773 INFO:teuthology.orchestra.run.smithi204.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-11-04T01:33:36.773 INFO:teuthology.orchestra.run.smithi204.stdout:Installing weak dependencies: 2023-11-04T01:33:36.773 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-04T01:33:36.773 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:33:36.773 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2023-11-04T01:33:36.773 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================================ 2023-11-04T01:33:36.773 INFO:teuthology.orchestra.run.smithi204.stdout:Install 132 Packages 2023-11-04T01:33:36.773 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrade 10 Packages 2023-11-04T01:33:36.773 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:33:36.774 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 200 M 2023-11-04T01:33:36.774 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2023-11-04T01:33:37.105 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2023-11-04T01:33:37.117 INFO:teuthology.orchestra.run.smithi204.stdout:(1/142): ceph-18.0.0-7035.g7532011a.el9.x86_64. 41 kB/s | 6.5 kB 00:00 2023-11-04T01:33:37.267 INFO:teuthology.orchestra.run.smithi204.stdout:(2/142): ceph-fuse-18.0.0-7035.g7532011a.el9.x8 5.6 MB/s | 859 kB 00:00 2023-11-04T01:33:37.317 INFO:teuthology.orchestra.run.smithi204.stdout:(3/142): ceph-immutable-object-cache-18.0.0-703 2.8 MB/s | 140 kB 00:00 2023-11-04T01:33:37.551 INFO:teuthology.orchestra.run.smithi204.stdout:(4/142): ceph-mds-18.0.0-7035.g7532011a.el9.x86 9.0 MB/s | 2.1 MB 00:00 2023-11-04T01:33:37.795 INFO:teuthology.orchestra.run.smithi204.stdout:(5/142): ceph-mgr-18.0.0-7035.g7532011a.el9.x86 6.1 MB/s | 1.5 MB 00:00 2023-11-04T01:33:38.010 INFO:teuthology.orchestra.run.smithi204.stdout:(6/142): ceph-base-18.0.0-7035.g7532011a.el9.x8 5.0 MB/s | 5.2 MB 00:01 2023-11-04T01:33:38.219 INFO:teuthology.orchestra.run.smithi204.stdout:(7/142): ceph-mon-18.0.0-7035.g7532011a.el9.x86 10 MB/s | 4.4 MB 00:00 2023-11-04T01:33:39.011 INFO:teuthology.orchestra.run.smithi204.stdout:(8/142): ceph-common-18.0.0-7035.g7532011a.el9. 9.3 MB/s | 19 MB 00:02 2023-11-04T01:33:39.111 INFO:teuthology.orchestra.run.smithi204.stdout:(9/142): ceph-radosgw-18.0.0-7035.g7532011a.el9 9.8 MB/s | 8.7 MB 00:00 2023-11-04T01:33:39.136 INFO:teuthology.orchestra.run.smithi204.stdout:(10/142): ceph-selinux-18.0.0-7035.g7532011a.el 192 kB/s | 24 kB 00:00 2023-11-04T01:33:39.228 INFO:teuthology.orchestra.run.smithi204.stdout:(11/142): cephfs-mirror-18.0.0-7035.g7532011a.e 2.3 MB/s | 217 kB 00:00 2023-11-04T01:33:39.296 INFO:teuthology.orchestra.run.smithi204.stdout:(12/142): libcephfs-devel-18.0.0-7035.g7532011a 467 kB/s | 31 kB 00:00 2023-11-04T01:33:39.420 INFO:teuthology.orchestra.run.smithi204.stdout:(13/142): libcephfs2-18.0.0-7035.g7532011a.el9. 5.6 MB/s | 718 kB 00:00 2023-11-04T01:33:39.512 INFO:teuthology.orchestra.run.smithi204.stdout:(14/142): libcephsqlite-18.0.0-7035.g7532011a.e 1.7 MB/s | 163 kB 00:00 2023-11-04T01:33:39.588 INFO:teuthology.orchestra.run.smithi044.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:33:39.589 INFO:teuthology.orchestra.run.smithi044.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:33:39.602 INFO:teuthology.orchestra.run.smithi044.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-04T01:33:39.603 INFO:teuthology.orchestra.run.smithi044.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-04T01:33:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-04T01:33:39.604 INFO:teuthology.orchestra.run.smithi204.stdout:(15/142): librados-devel-18.0.0-7035.g7532011a. 1.3 MB/s | 126 kB 00:00 2023-11-04T01:33:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-04T01:33:39.607 INFO:teuthology.orchestra.run.smithi044.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-04T01:33:39.610 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-04T01:33:39.611 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-04T01:33:39.688 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2023-11-04T01:33:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================================ 2023-11-04T01:33:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2023-11-04T01:33:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================================ 2023-11-04T01:33:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2023-11-04T01:33:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-04T01:33:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: ceph x86_64 2:18.0.0-7035.g7532011a.el9 ceph 6.5 k 2023-11-04T01:33:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base x86_64 2:18.0.0-7035.g7532011a.el9 ceph 5.2 M 2023-11-04T01:33:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 859 k 2023-11-04T01:33:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7035.g7532011a.el9 ceph 140 k 2023-11-04T01:33:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr x86_64 2:18.0.0-7035.g7532011a.el9 ceph 1.5 M 2023-11-04T01:33:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 132 k 2023-11-04T01:33:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 1.8 M 2023-11-04T01:33:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 7.4 M 2023-11-04T01:33:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 48 k 2023-11-04T01:33:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 8.7 M 2023-11-04T01:33:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test x86_64 2:18.0.0-7035.g7532011a.el9 ceph 41 M 2023-11-04T01:33:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 262 k 2023-11-04T01:33:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 270 k 2023-11-04T01:33:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 217 k 2023-11-04T01:33:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 18 k 2023-11-04T01:33:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-11-04T01:33:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-04T01:33:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-04T01:33:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 31 k 2023-11-04T01:33:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 718 k 2023-11-04T01:33:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 126 k 2023-11-04T01:33:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-04T01:33:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-11-04T01:33:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-11-04T01:33:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-04T01:33:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-04T01:33:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-04T01:33:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs x86_64 2:18.0.0-7035.g7532011a.el9 ceph 162 k 2023-11-04T01:33:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados x86_64 2:18.0.0-7035.g7532011a.el9 ceph 320 k 2023-11-04T01:33:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 299 k 2023-11-04T01:33:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 99 k 2023-11-04T01:33:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 84 k 2023-11-04T01:33:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:33:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 169 k 2023-11-04T01:33:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-11-04T01:33:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2023-11-04T01:33:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager x86_64 1:1.45.5-1.el9 CentOS-BaseOS 2.2 M 2023-11-04T01:33:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-libnm x86_64 1:1.45.5-1.el9 CentOS-BaseOS 1.8 M 2023-11-04T01:33:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-team x86_64 1:1.45.5-1.el9 CentOS-BaseOS 42 k 2023-11-04T01:33:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-tui x86_64 1:1.45.5-1.el9 CentOS-BaseOS 245 k 2023-11-04T01:33:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-04T01:33:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-04T01:33:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-04T01:33:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: librados2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.3 M 2023-11-04T01:33:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:33:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-04T01:33:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2023-11-04T01:33:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-11-04T01:33:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-04T01:33:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 19 M 2023-11-04T01:33:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 23 k 2023-11-04T01:33:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds x86_64 2:18.0.0-7035.g7532011a.el9 ceph 2.1 M 2023-11-04T01:33:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 243 k 2023-11-04T01:33:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.4 M 2023-11-04T01:33:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 18 M 2023-11-04T01:33:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 15 k 2023-11-04T01:33:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux x86_64 2:18.0.0-7035.g7532011a.el9 ceph 24 k 2023-11-04T01:33:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-04T01:33:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-04T01:33:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-04T01:33:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-04T01:33:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-04T01:33:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-04T01:33:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-04T01:33:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-04T01:33:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite x86_64 2:18.0.0-7035.g7532011a.el9 ceph 163 k 2023-11-04T01:33:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-04T01:33:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-04T01:33:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-04T01:33:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-04T01:33:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-04T01:33:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 476 k 2023-11-04T01:33:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-04T01:33:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.8 M 2023-11-04T01:33:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-04T01:33:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-04T01:33:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-04T01:33:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-04T01:33:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-04T01:33:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-04T01:33:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-04T01:33:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-04T01:33:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-04T01:33:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-04T01:33:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-04T01:33:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-04T01:33:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 45 k 2023-11-04T01:33:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 127 k 2023-11-04T01:33:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-04T01:33:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-04T01:33:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-04T01:33:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-04T01:33:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-04T01:33:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-04T01:33:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-04T01:33:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-04T01:33:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-04T01:33:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-04T01:33:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-04T01:33:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-04T01:33:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-04T01:33:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-04T01:33:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-04T01:33:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-04T01:33:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-04T01:33:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-04T01:33:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-04T01:33:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-04T01:33:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-04T01:33:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-04T01:33:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-04T01:33:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-04T01:33:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-04T01:33:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-04T01:33:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-04T01:33:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-04T01:33:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-04T01:33:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-04T01:33:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-04T01:33:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-04T01:33:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-04T01:33:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-04T01:33:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-04T01:33:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-04T01:33:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-04T01:33:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-04T01:33:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-04T01:33:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-04T01:33:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-04T01:33:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-04T01:33:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-04T01:33:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-04T01:33:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-04T01:33:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-04T01:33:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-04T01:33:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-04T01:33:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-04T01:33:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-04T01:33:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-04T01:33:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-04T01:33:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-04T01:33:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-11-04T01:33:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:Installing weak dependencies: 2023-11-04T01:33:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-04T01:33:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:33:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2023-11-04T01:33:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================================ 2023-11-04T01:33:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:Install 132 Packages 2023-11-04T01:33:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 10 Packages 2023-11-04T01:33:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:33:39.717 INFO:teuthology.orchestra.run.smithi204.stdout:(16/142): libradosstriper1-18.0.0-7035.g7532011 4.6 MB/s | 476 kB 00:00 2023-11-04T01:33:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 200 M 2023-11-04T01:33:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2023-11-04T01:33:40.213 INFO:teuthology.orchestra.run.smithi204.stdout:(17/142): librgw2-18.0.0-7035.g7532011a.el9.x86 9.4 MB/s | 4.8 MB 00:00 2023-11-04T01:33:40.288 INFO:teuthology.orchestra.run.smithi204.stdout:(18/142): python3-ceph-argparse-18.0.0-7035.g75 603 kB/s | 45 kB 00:00 2023-11-04T01:33:40.380 INFO:teuthology.orchestra.run.smithi204.stdout:(19/142): python3-ceph-common-18.0.0-7035.g7532 1.3 MB/s | 127 kB 00:00 2023-11-04T01:33:40.392 INFO:teuthology.orchestra.run.smithi044.stdout:(1/142): ceph-18.0.0-7035.g7532011a.el9.x86_64. 21 kB/s | 6.5 kB 00:00 2023-11-04T01:33:40.481 INFO:teuthology.orchestra.run.smithi204.stdout:(20/142): python3-cephfs-18.0.0-7035.g7532011a. 1.6 MB/s | 162 kB 00:00 2023-11-04T01:33:40.656 INFO:teuthology.orchestra.run.smithi204.stdout:(21/142): ceph-osd-18.0.0-7035.g7532011a.el9.x8 6.7 MB/s | 18 MB 00:02 2023-11-04T01:33:40.681 INFO:teuthology.orchestra.run.smithi204.stdout:(22/142): python3-rados-18.0.0-7035.g7532011a.e 1.6 MB/s | 320 kB 00:00 2023-11-04T01:33:40.740 INFO:teuthology.orchestra.run.smithi204.stdout:(23/142): python3-rbd-18.0.0-7035.g7532011a.el9 3.5 MB/s | 299 kB 00:00 2023-11-04T01:33:40.766 INFO:teuthology.orchestra.run.smithi204.stdout:(24/142): python3-rgw-18.0.0-7035.g7532011a.el9 1.2 MB/s | 99 kB 00:00 2023-11-04T01:33:40.874 INFO:teuthology.orchestra.run.smithi204.stdout:(25/142): rbd-fuse-18.0.0-7035.g7532011a.el9.x8 631 kB/s | 84 kB 00:00 2023-11-04T01:33:40.940 INFO:teuthology.orchestra.run.smithi044.stdout:(2/142): ceph-fuse-18.0.0-7035.g7532011a.el9.x8 1.5 MB/s | 859 kB 00:00 2023-11-04T01:33:40.991 INFO:teuthology.orchestra.run.smithi204.stdout:(26/142): rbd-nbd-18.0.0-7035.g7532011a.el9.x86 1.4 MB/s | 169 kB 00:00 2023-11-04T01:33:41.057 INFO:teuthology.orchestra.run.smithi044.stdout:(3/142): ceph-immutable-object-cache-18.0.0-703 1.2 MB/s | 140 kB 00:00 2023-11-04T01:33:41.111 INFO:teuthology.orchestra.run.smithi204.stdout:(27/142): ceph-grafana-dashboards-18.0.0-7035.g 193 kB/s | 23 kB 00:00 2023-11-04T01:33:41.186 INFO:teuthology.orchestra.run.smithi204.stdout:(28/142): rbd-mirror-18.0.0-7035.g7532011a.el9. 7.2 MB/s | 3.0 MB 00:00 2023-11-04T01:33:41.212 INFO:teuthology.orchestra.run.smithi204.stdout:(29/142): ceph-mgr-cephadm-18.0.0-7035.g7532011 1.3 MB/s | 132 kB 00:00 2023-11-04T01:33:41.523 INFO:teuthology.orchestra.run.smithi204.stdout:(30/142): ceph-mgr-dashboard-18.0.0-7035.g75320 5.3 MB/s | 1.8 MB 00:00 2023-11-04T01:33:41.637 INFO:teuthology.orchestra.run.smithi204.stdout:(31/142): ceph-mgr-modules-core-18.0.0-7035.g75 2.0 MB/s | 243 kB 00:00 2023-11-04T01:33:41.747 INFO:teuthology.orchestra.run.smithi204.stdout:(32/142): ceph-mgr-rook-18.0.0-7035.g7532011a.e 441 kB/s | 48 kB 00:00 2023-11-04T01:33:41.846 INFO:teuthology.orchestra.run.smithi204.stdout:(33/142): ceph-prometheus-alerts-18.0.0-7035.g7 151 kB/s | 15 kB 00:00 2023-11-04T01:33:41.955 INFO:teuthology.orchestra.run.smithi204.stdout:(34/142): ceph-volume-18.0.0-7035.g7532011a.el9 2.4 MB/s | 262 kB 00:00 2023-11-04T01:33:42.063 INFO:teuthology.orchestra.run.smithi204.stdout:(35/142): cephadm-18.0.0-7035.g7532011a.el9.noa 2.4 MB/s | 270 kB 00:00 2023-11-04T01:33:42.157 INFO:teuthology.orchestra.run.smithi204.stdout:(36/142): cephfs-top-18.0.0-7035.g7532011a.el9. 194 kB/s | 18 kB 00:00 2023-11-04T01:33:42.286 INFO:teuthology.orchestra.run.smithi204.stdout:(37/142): bison-3.7.4-5.el9.x86_64.rpm 7.2 MB/s | 920 kB 00:00 2023-11-04T01:33:42.316 INFO:teuthology.orchestra.run.smithi204.stdout:(38/142): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-11-04T01:33:42.358 INFO:teuthology.orchestra.run.smithi204.stdout:(39/142): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2023-11-04T01:33:42.374 INFO:teuthology.orchestra.run.smithi044.stdout:(4/142): ceph-mds-18.0.0-7035.g7532011a.el9.x86 1.6 MB/s | 2.1 MB 00:01 2023-11-04T01:33:42.392 INFO:teuthology.orchestra.run.smithi204.stdout:(40/142): flexiblas-3.0.4-8.el9.x86_64.rpm 948 kB/s | 32 kB 00:00 2023-11-04T01:33:42.468 INFO:teuthology.orchestra.run.smithi204.stdout:(41/142): flexiblas-netlib-3.0.4-8.el9.x86_64.r 40 MB/s | 3.0 MB 00:00 2023-11-04T01:33:42.483 INFO:teuthology.orchestra.run.smithi044.stdout:(5/142): ceph-base-18.0.0-7035.g7532011a.el9.x8 2.2 MB/s | 5.2 MB 00:02 2023-11-04T01:33:42.834 INFO:teuthology.orchestra.run.smithi204.stdout:(42/142): ceph-test-18.0.0-7035.g7532011a.el9.x 11 MB/s | 41 MB 00:03 2023-11-04T01:33:42.860 INFO:teuthology.orchestra.run.smithi204.stdout:(43/142): flexiblas-openblas-openmp-3.0.4-8.el9 44 kB/s | 17 kB 00:00 2023-11-04T01:33:42.885 INFO:teuthology.orchestra.run.smithi204.stdout:(44/142): libaio-devel-0.3.111-13.el9.x86_64.rp 202 kB/s | 10 kB 00:00 2023-11-04T01:33:42.912 INFO:teuthology.orchestra.run.smithi204.stdout:(45/142): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-11-04T01:33:42.937 INFO:teuthology.orchestra.run.smithi204.stdout:(46/142): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-11-04T01:33:42.941 INFO:teuthology.orchestra.run.smithi044.stdout:(6/142): ceph-mgr-18.0.0-7035.g7532011a.el9.x86 2.6 MB/s | 1.5 MB 00:00 2023-11-04T01:33:42.962 INFO:teuthology.orchestra.run.smithi204.stdout:(47/142): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 578 kB 00:00 2023-11-04T01:33:42.987 INFO:teuthology.orchestra.run.smithi204.stdout:(48/142): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 46 kB 00:00 2023-11-04T01:33:43.011 INFO:teuthology.orchestra.run.smithi204.stdout:(49/142): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-11-04T01:33:43.038 INFO:teuthology.orchestra.run.smithi204.stdout:(50/142): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2023-11-04T01:33:43.062 INFO:teuthology.orchestra.run.smithi204.stdout:(51/142): openblas-0.3.21-2.el9.x86_64.rpm 685 kB/s | 34 kB 00:00 2023-11-04T01:33:43.145 INFO:teuthology.orchestra.run.smithi204.stdout:(52/142): openblas-openmp-0.3.21-2.el9.x86_64.r 44 MB/s | 4.7 MB 00:00 2023-11-04T01:33:43.187 INFO:teuthology.orchestra.run.smithi204.stdout:(53/142): postgresql-13.11-1.el9.x86_64.rpm 12 MB/s | 1.5 MB 00:00 2023-11-04T01:33:43.229 INFO:teuthology.orchestra.run.smithi204.stdout:(54/142): postgresql-contrib-13.11-1.el9.x86_64 9.8 MB/s | 811 kB 00:00 2023-11-04T01:33:43.257 INFO:teuthology.orchestra.run.smithi204.stdout:(55/142): postgresql-private-libs-13.11-1.el9.x 2.0 MB/s | 134 kB 00:00 2023-11-04T01:33:43.347 INFO:teuthology.orchestra.run.smithi204.stdout:(56/142): postgresql-server-13.11-1.el9.x86_64. 49 MB/s | 5.7 MB 00:00 2023-11-04T01:33:43.427 INFO:teuthology.orchestra.run.smithi044.stdout:(7/142): ceph-mon-18.0.0-7035.g7532011a.el9.x86 4.6 MB/s | 4.4 MB 00:00 2023-11-04T01:33:43.439 INFO:teuthology.orchestra.run.smithi204.stdout:(57/142): python3-babel-2.9.1-2.el9.noarch.rpm 32 MB/s | 5.8 MB 00:00 2023-11-04T01:33:43.466 INFO:teuthology.orchestra.run.smithi204.stdout:(58/142): python3-devel-3.9.17-2.el9.x86_64.rpm 1.8 MB/s | 205 kB 00:00 2023-11-04T01:33:43.556 INFO:teuthology.orchestra.run.smithi204.stdout:(59/142): ceph-mgr-diskprediction-local-18.0.0- 3.2 MB/s | 7.4 MB 00:02 2023-11-04T01:33:43.583 INFO:teuthology.orchestra.run.smithi204.stdout:(60/142): python3-jsonpatch-1.21-16.el9.noarch. 209 kB/s | 24 kB 00:00 2023-11-04T01:33:43.607 INFO:teuthology.orchestra.run.smithi204.stdout:(61/142): python3-jinja2-2.11.3-4.el9.noarch.rp 1.6 MB/s | 228 kB 00:00 2023-11-04T01:33:43.623 INFO:teuthology.orchestra.run.smithi204.stdout:(62/142): python3-jsonpointer-2.0-4.el9.noarch. 271 kB/s | 18 kB 00:00 2023-11-04T01:33:43.650 INFO:teuthology.orchestra.run.smithi204.stdout:(63/142): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2023-11-04T01:33:43.674 INFO:teuthology.orchestra.run.smithi204.stdout:(64/142): python3-markupsafe-1.1.1-12.el9.x86_6 635 kB/s | 32 kB 00:00 2023-11-04T01:33:43.745 INFO:teuthology.orchestra.run.smithi204.stdout:(65/142): python3-numpy-1.20.1-5.el9.x86_64.rpm 41 MB/s | 4.8 MB 00:00 2023-11-04T01:33:43.766 INFO:teuthology.orchestra.run.smithi204.stdout:(66/142): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 217 kB 00:00 2023-11-04T01:33:43.775 INFO:teuthology.orchestra.run.smithi044.stdout:(8/142): ceph-common-18.0.0-7035.g7532011a.el9. 5.1 MB/s | 19 MB 00:03 2023-11-04T01:33:43.794 INFO:teuthology.orchestra.run.smithi204.stdout:(67/142): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 174 kB 00:00 2023-11-04T01:33:43.808 INFO:teuthology.orchestra.run.smithi204.stdout:(68/142): python3-prettytable-0.7.2-27.el9.noar 621 kB/s | 41 kB 00:00 2023-11-04T01:33:43.825 INFO:teuthology.orchestra.run.smithi044.stdout:(9/142): ceph-selinux-18.0.0-7035.g7532011a.el9 484 kB/s | 24 kB 00:00 2023-11-04T01:33:43.833 INFO:teuthology.orchestra.run.smithi204.stdout:(69/142): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2023-11-04T01:33:43.859 INFO:teuthology.orchestra.run.smithi204.stdout:(70/142): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2023-11-04T01:33:43.884 INFO:teuthology.orchestra.run.smithi204.stdout:(71/142): python3-requests-oauthlib-1.3.0-12.el 568 kB/s | 43 kB 00:00 2023-11-04T01:33:43.909 INFO:teuthology.orchestra.run.smithi204.stdout:(72/142): python3-toml-0.10.2-6.el9.noarch.rpm 775 kB/s | 39 kB 00:00 2023-11-04T01:33:44.126 INFO:teuthology.orchestra.run.smithi204.stdout:(73/142): python3-scipy-1.6.2-8.el9.x86_64.rpm 59 MB/s | 16 MB 00:00 2023-11-04T01:33:44.152 INFO:teuthology.orchestra.run.smithi204.stdout:(74/142): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 300 kB 00:00 2023-11-04T01:33:44.176 INFO:teuthology.orchestra.run.smithi204.stdout:(75/142): uuid-1.6.2-55.el9.x86_64.rpm 213 kB/s | 56 kB 00:00 2023-11-04T01:33:44.202 INFO:teuthology.orchestra.run.smithi204.stdout:(76/142): xmlstarlet-1.6.1-20.el9.x86_64.rpm 840 kB/s | 63 kB 00:00 2023-11-04T01:33:44.239 INFO:teuthology.orchestra.run.smithi204.stdout:(77/142): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-11-04T01:33:44.271 INFO:teuthology.orchestra.run.smithi204.stdout:(78/142): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.5 MB/s | 803 kB 00:00 2023-11-04T01:33:44.319 INFO:teuthology.orchestra.run.smithi204.stdout:(79/142): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2023-11-04T01:33:44.344 INFO:teuthology.orchestra.run.smithi204.stdout:(80/142): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2023-11-04T01:33:44.371 INFO:teuthology.orchestra.run.smithi204.stdout:(81/142): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.4 MB/s | 241 kB 00:00 2023-11-04T01:33:44.395 INFO:teuthology.orchestra.run.smithi204.stdout:(82/142): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2023-11-04T01:33:44.420 INFO:teuthology.orchestra.run.smithi204.stdout:(83/142): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-11-04T01:33:44.446 INFO:teuthology.orchestra.run.smithi204.stdout:(84/142): python3-urllib3-1.26.5-4.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-11-04T01:33:44.729 INFO:teuthology.orchestra.run.smithi204.stdout:(85/142): elfutils-libelf-devel-0.189-3.el9.x86 79 kB/s | 22 kB 00:00 2023-11-04T01:33:44.764 INFO:teuthology.orchestra.run.smithi204.stdout:(86/142): python3-cryptography-36.0.1-4.el9.x86 3.3 MB/s | 1.2 MB 00:00 2023-11-04T01:33:45.055 INFO:teuthology.orchestra.run.smithi204.stdout:(87/142): jq-1.6-15.el9.x86_64.rpm 575 kB/s | 187 kB 00:00 2023-11-04T01:33:45.163 INFO:teuthology.orchestra.run.smithi204.stdout:(88/142): libuuid-devel-2.37.4-15.el9.x86_64.rp 236 kB/s | 26 kB 00:00 2023-11-04T01:33:45.189 INFO:teuthology.orchestra.run.smithi204.stdout:(89/142): librabbitmq-0.11.0-7.el9.x86_64.rpm 106 kB/s | 45 kB 00:00 2023-11-04T01:33:45.231 INFO:teuthology.orchestra.run.smithi204.stdout:(90/142): automake-1.16.2-8.el9.noarch.rpm 851 kB/s | 689 kB 00:00 2023-11-04T01:33:45.317 INFO:teuthology.orchestra.run.smithi204.stdout:(91/142): python3-pytz-2021.1-5.el9.noarch.rpm 407 kB/s | 51 kB 00:00 2023-11-04T01:33:45.373 INFO:teuthology.orchestra.run.smithi204.stdout:(92/142): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 608 kB/s | 86 kB 00:00 2023-11-04T01:33:45.456 INFO:teuthology.orchestra.run.smithi204.stdout:(93/142): zlib-devel-1.2.11-40.el9.x86_64.rpm 318 kB/s | 45 kB 00:00 2023-11-04T01:33:45.684 INFO:teuthology.orchestra.run.smithi044.stdout:(10/142): ceph-radosgw-18.0.0-7035.g7532011a.el 3.9 MB/s | 8.7 MB 00:02 2023-11-04T01:33:45.835 INFO:teuthology.orchestra.run.smithi044.stdout:(11/142): cephfs-mirror-18.0.0-7035.g7532011a.e 1.4 MB/s | 217 kB 00:00 2023-11-04T01:33:45.918 INFO:teuthology.orchestra.run.smithi044.stdout:(12/142): libcephfs-devel-18.0.0-7035.g7532011a 373 kB/s | 31 kB 00:00 2023-11-04T01:33:45.948 INFO:teuthology.orchestra.run.smithi204.stdout:(94/142): gperftools-libs-2.9.1-2.el9.x86_64.rp 537 kB/s | 309 kB 00:00 2023-11-04T01:33:46.049 INFO:teuthology.orchestra.run.smithi204.stdout:(95/142): libarrow-doc-9.0.0-9.el9.noarch.rpm 243 kB/s | 24 kB 00:00 2023-11-04T01:33:46.107 INFO:teuthology.orchestra.run.smithi204.stdout:(96/142): openssl-devel-3.0.7-24.el9.x86_64.rpm 4.4 MB/s | 4.1 MB 00:00 2023-11-04T01:33:46.150 INFO:teuthology.orchestra.run.smithi204.stdout:(97/142): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2023-11-04T01:33:46.159 INFO:teuthology.orchestra.run.smithi044.stdout:(13/142): libcephfs2-18.0.0-7035.g7532011a.el9. 2.9 MB/s | 718 kB 00:00 2023-11-04T01:33:46.218 INFO:teuthology.orchestra.run.smithi044.stdout:(14/142): libcephsqlite-18.0.0-7035.g7532011a.e 2.7 MB/s | 163 kB 00:00 2023-11-04T01:33:46.276 INFO:teuthology.orchestra.run.smithi044.stdout:(15/142): librados-devel-18.0.0-7035.g7532011a. 2.1 MB/s | 126 kB 00:00 2023-11-04T01:33:46.324 INFO:teuthology.orchestra.run.smithi204.stdout:(98/142): libarrow-9.0.0-9.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2023-11-04T01:33:46.400 INFO:teuthology.orchestra.run.smithi204.stdout:(99/142): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.3 MB/s | 837 kB 00:00 2023-11-04T01:33:46.402 INFO:teuthology.orchestra.run.smithi044.stdout:(16/142): libradosstriper1-18.0.0-7035.g7532011 3.7 MB/s | 476 kB 00:00 2023-11-04T01:33:46.433 INFO:teuthology.orchestra.run.smithi204.stdout:(100/142): python3-asyncssh-2.13.2-3.el9.noarch 4.9 MB/s | 548 kB 00:00 2023-11-04T01:33:46.467 INFO:teuthology.orchestra.run.smithi204.stdout:(101/142): libunwind-1.6.2-1.el9.x86_64.rpm 187 kB/s | 67 kB 00:00 2023-11-04T01:33:46.500 INFO:teuthology.orchestra.run.smithi204.stdout:(102/142): python3-bcrypt-3.2.2-1.el9.x86_64.rp 432 kB/s | 43 kB 00:00 2023-11-04T01:33:46.534 INFO:teuthology.orchestra.run.smithi204.stdout:(103/142): python3-cachetools-4.2.4-1.el9.noarc 321 kB/s | 32 kB 00:00 2023-11-04T01:33:46.576 INFO:teuthology.orchestra.run.smithi204.stdout:(104/142): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2023-11-04T01:33:46.610 INFO:teuthology.orchestra.run.smithi204.stdout:(105/142): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2023-11-04T01:33:46.643 INFO:teuthology.orchestra.run.smithi204.stdout:(106/142): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2023-11-04T01:33:46.702 INFO:teuthology.orchestra.run.smithi204.stdout:(107/142): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2023-11-04T01:33:46.736 INFO:teuthology.orchestra.run.smithi204.stdout:(108/142): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2023-11-04T01:33:46.794 INFO:teuthology.orchestra.run.smithi204.stdout:(109/142): python3-jaraco-collections-3.0.0-8.e 252 kB/s | 23 kB 00:00 2023-11-04T01:33:46.828 INFO:teuthology.orchestra.run.smithi204.stdout:(110/142): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2023-11-04T01:33:46.853 INFO:teuthology.orchestra.run.smithi204.stdout:(111/142): python3-google-auth-2.23.3-1.el9.noa 712 kB/s | 197 kB 00:00 2023-11-04T01:33:46.887 INFO:teuthology.orchestra.run.smithi204.stdout:(112/142): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2023-11-04T01:33:46.920 INFO:teuthology.orchestra.run.smithi204.stdout:(113/142): python3-jwt+crypto-2.4.0-1.el9.noarc 98 kB/s | 9.0 kB 00:00 2023-11-04T01:33:46.962 INFO:teuthology.orchestra.run.smithi204.stdout:(114/142): python3-jwt-2.4.0-1.el9.noarch.rpm 376 kB/s | 41 kB 00:00 2023-11-04T01:33:47.071 INFO:teuthology.orchestra.run.smithi204.stdout:(115/142): python3-logutils-0.3.5-21.el9.noarch 308 kB/s | 46 kB 00:00 2023-11-04T01:33:47.096 INFO:teuthology.orchestra.run.smithi204.stdout:(116/142): python3-more-itertools-8.12.0-2.el9. 589 kB/s | 79 kB 00:00 2023-11-04T01:33:47.130 INFO:teuthology.orchestra.run.smithi204.stdout:(117/142): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2023-11-04T01:33:47.172 INFO:teuthology.orchestra.run.smithi204.stdout:(118/142): python3-natsort-7.1.1-5.el9.noarch.r 576 kB/s | 58 kB 00:00 2023-11-04T01:33:47.232 INFO:teuthology.orchestra.run.smithi204.stdout:(119/142): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2023-11-04T01:33:47.267 INFO:teuthology.orchestra.run.smithi204.stdout:(120/142): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2023-11-04T01:33:47.289 INFO:teuthology.orchestra.run.smithi204.stdout:(121/142): python3-pyOpenSSL-21.0.0-1.el9.noarc 767 kB/s | 90 kB 00:00 2023-11-04T01:33:47.331 INFO:teuthology.orchestra.run.smithi204.stdout:(122/142): python3-repoze-lru-0.7-16.el9.noarch 305 kB/s | 31 kB 00:00 2023-11-04T01:33:47.344 INFO:teuthology.orchestra.run.smithi044.stdout:(17/142): librgw2-18.0.0-7035.g7532011a.el9.x86 5.1 MB/s | 4.8 MB 00:00 2023-11-04T01:33:47.382 INFO:teuthology.orchestra.run.smithi204.stdout:(123/142): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2023-11-04T01:33:47.407 INFO:teuthology.orchestra.run.smithi204.stdout:(124/142): python3-rsa-4.9-2.el9.noarch.rpm 504 kB/s | 59 kB 00:00 2023-11-04T01:33:47.410 INFO:teuthology.orchestra.run.smithi044.stdout:(18/142): python3-ceph-argparse-18.0.0-7035.g75 680 kB/s | 45 kB 00:00 2023-11-04T01:33:47.449 INFO:teuthology.orchestra.run.smithi204.stdout:(125/142): python3-tempora-5.0.0-2.el9.noarch.r 304 kB/s | 36 kB 00:00 2023-11-04T01:33:47.483 INFO:teuthology.orchestra.run.smithi204.stdout:(126/142): python3-typing-extensions-4.4.0-2.el 506 kB/s | 51 kB 00:00 2023-11-04T01:33:47.495 INFO:teuthology.orchestra.run.smithi044.stdout:(19/142): python3-ceph-common-18.0.0-7035.g7532 1.5 MB/s | 127 kB 00:00 2023-11-04T01:33:47.510 INFO:teuthology.orchestra.run.smithi204.stdout:(127/142): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2023-11-04T01:33:47.550 INFO:teuthology.orchestra.run.smithi204.stdout:(128/142): python3-websocket-client-1.2.3-2.el9 893 kB/s | 90 kB 00:00 2023-11-04T01:33:47.578 INFO:teuthology.orchestra.run.smithi044.stdout:(20/142): python3-cephfs-18.0.0-7035.g7532011a. 1.9 MB/s | 162 kB 00:00 2023-11-04T01:33:47.609 INFO:teuthology.orchestra.run.smithi204.stdout:(129/142): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2023-11-04T01:33:47.634 INFO:teuthology.orchestra.run.smithi204.stdout:(130/142): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2023-11-04T01:33:47.659 INFO:teuthology.orchestra.run.smithi204.stdout:(131/142): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2023-11-04T01:33:47.734 INFO:teuthology.orchestra.run.smithi204.stdout:(132/142): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2023-11-04T01:33:47.737 INFO:teuthology.orchestra.run.smithi044.stdout:(21/142): python3-rados-18.0.0-7035.g7532011a.e 2.0 MB/s | 320 kB 00:00 2023-11-04T01:33:47.768 INFO:teuthology.orchestra.run.smithi204.stdout:(133/142): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-11-04T01:33:47.826 INFO:teuthology.orchestra.run.smithi204.stdout:(134/142): NetworkManager-1.45.5-1.el9.x86_64.r 39 MB/s | 2.2 MB 00:00 2023-11-04T01:33:47.854 INFO:teuthology.orchestra.run.smithi044.stdout:(22/142): python3-rbd-18.0.0-7035.g7532011a.el9 2.5 MB/s | 299 kB 00:00 2023-11-04T01:33:47.877 INFO:teuthology.orchestra.run.smithi204.stdout:(135/142): NetworkManager-libnm-1.45.5-1.el9.x8 36 MB/s | 1.8 MB 00:00 2023-11-04T01:33:47.910 INFO:teuthology.orchestra.run.smithi204.stdout:(136/142): NetworkManager-team-1.45.5-1.el9.x86 1.2 MB/s | 42 kB 00:00 2023-11-04T01:33:47.921 INFO:teuthology.orchestra.run.smithi044.stdout:(23/142): python3-rgw-18.0.0-7035.g7532011a.el9 1.5 MB/s | 99 kB 00:00 2023-11-04T01:33:47.944 INFO:teuthology.orchestra.run.smithi204.stdout:(137/142): NetworkManager-tui-1.45.5-1.el9.x86_ 7.2 MB/s | 245 kB 00:00 2023-11-04T01:33:47.978 INFO:teuthology.orchestra.run.smithi204.stdout:(138/142): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-11-04T01:33:48.003 INFO:teuthology.orchestra.run.smithi204.stdout:(139/142): libacl-2.3.1-4.el9.x86_64.rpm 883 kB/s | 22 kB 00:00 2023-11-04T01:33:48.004 INFO:teuthology.orchestra.run.smithi044.stdout:(24/142): rbd-fuse-18.0.0-7035.g7532011a.el9.x8 1.0 MB/s | 84 kB 00:00 2023-11-04T01:33:48.045 INFO:teuthology.orchestra.run.smithi204.stdout:(140/142): xfsdump-3.1.12-4.el9.x86_64.rpm 7.5 MB/s | 321 kB 00:00 2023-11-04T01:33:48.429 INFO:teuthology.orchestra.run.smithi204.stdout:(141/142): librados2-18.0.0-7035.g7532011a.el9. 4.2 MB/s | 3.3 MB 00:00 2023-11-04T01:33:48.595 INFO:teuthology.orchestra.run.smithi204.stdout:(142/142): librbd1-18.0.0-7035.g7532011a.el9.x8 3.2 MB/s | 3.0 MB 00:00 2023-11-04T01:33:48.599 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:33:48.599 INFO:teuthology.orchestra.run.smithi204.stdout:Total 17 MB/s | 200 MB 00:11 2023-11-04T01:33:48.743 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2023-11-04T01:33:48.870 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2023-11-04T01:33:48.870 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2023-11-04T01:33:49.080 INFO:teuthology.orchestra.run.smithi044.stdout:(25/142): rbd-mirror-18.0.0-7035.g7532011a.el9. 2.8 MB/s | 3.0 MB 00:01 2023-11-04T01:33:49.147 INFO:teuthology.orchestra.run.smithi044.stdout:(26/142): rbd-nbd-18.0.0-7035.g7532011a.el9.x86 2.5 MB/s | 169 kB 00:00 2023-11-04T01:33:49.217 INFO:teuthology.orchestra.run.smithi044.stdout:(27/142): ceph-grafana-dashboards-18.0.0-7035.g 348 kB/s | 23 kB 00:00 2023-11-04T01:33:49.331 INFO:teuthology.orchestra.run.smithi044.stdout:(28/142): ceph-mgr-cephadm-18.0.0-7035.g7532011 1.1 MB/s | 132 kB 00:00 2023-11-04T01:33:49.994 INFO:teuthology.orchestra.run.smithi044.stdout:(29/142): ceph-mgr-dashboard-18.0.0-7035.g75320 2.7 MB/s | 1.8 MB 00:00 2023-11-04T01:33:50.398 INFO:teuthology.orchestra.run.smithi044.stdout:(30/142): ceph-test-18.0.0-7035.g7532011a.el9.x 6.3 MB/s | 41 MB 00:06 2023-11-04T01:33:50.465 INFO:teuthology.orchestra.run.smithi044.stdout:(31/142): ceph-mgr-modules-core-18.0.0-7035.g75 3.6 MB/s | 243 kB 00:00 2023-11-04T01:33:50.506 INFO:teuthology.orchestra.run.smithi044.stdout:(32/142): ceph-mgr-rook-18.0.0-7035.g7532011a.e 1.1 MB/s | 48 kB 00:00 2023-11-04T01:33:50.557 INFO:teuthology.orchestra.run.smithi044.stdout:(33/142): ceph-prometheus-alerts-18.0.0-7035.g7 302 kB/s | 15 kB 00:00 2023-11-04T01:33:50.624 INFO:teuthology.orchestra.run.smithi044.stdout:(34/142): ceph-volume-18.0.0-7035.g7532011a.el9 3.9 MB/s | 262 kB 00:00 2023-11-04T01:33:50.665 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2023-11-04T01:33:50.665 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2023-11-04T01:33:50.691 INFO:teuthology.orchestra.run.smithi044.stdout:(35/142): cephadm-18.0.0-7035.g7532011a.el9.noa 4.0 MB/s | 270 kB 00:00 2023-11-04T01:33:50.733 INFO:teuthology.orchestra.run.smithi044.stdout:(36/142): cephfs-top-18.0.0-7035.g7532011a.el9. 438 kB/s | 18 kB 00:00 2023-11-04T01:33:50.858 INFO:teuthology.orchestra.run.smithi044.stdout:(37/142): bison-3.7.4-5.el9.x86_64.rpm 7.2 MB/s | 920 kB 00:00 2023-11-04T01:33:50.892 INFO:teuthology.orchestra.run.smithi044.stdout:(38/142): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-11-04T01:33:51.067 INFO:teuthology.orchestra.run.smithi044.stdout:(39/142): ceph-osd-18.0.0-7035.g7532011a.el9.x8 2.2 MB/s | 18 MB 00:08 2023-11-04T01:33:51.092 INFO:teuthology.orchestra.run.smithi044.stdout:(40/142): flex-2.6.4-9.el9.x86_64.rpm 1.5 MB/s | 307 kB 00:00 2023-11-04T01:33:51.118 INFO:teuthology.orchestra.run.smithi044.stdout:(41/142): flexiblas-3.0.4-8.el9.x86_64.rpm 641 kB/s | 32 kB 00:00 2023-11-04T01:33:51.185 INFO:teuthology.orchestra.run.smithi044.stdout:(42/142): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2023-11-04T01:33:51.211 INFO:teuthology.orchestra.run.smithi044.stdout:(43/142): flexiblas-openblas-openmp-3.0.4-8.el9 192 kB/s | 17 kB 00:00 2023-11-04T01:33:51.244 INFO:teuthology.orchestra.run.smithi044.stdout:(44/142): libaio-devel-0.3.111-13.el9.x86_64.rp 304 kB/s | 10 kB 00:00 2023-11-04T01:33:51.269 INFO:teuthology.orchestra.run.smithi044.stdout:(45/142): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2023-11-04T01:33:51.303 INFO:teuthology.orchestra.run.smithi044.stdout:(46/142): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-11-04T01:33:51.328 INFO:teuthology.orchestra.run.smithi044.stdout:(47/142): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2023-11-04T01:33:51.353 INFO:teuthology.orchestra.run.smithi044.stdout:(48/142): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 46 kB 00:00 2023-11-04T01:33:51.381 INFO:teuthology.orchestra.run.smithi044.stdout:(49/142): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-11-04T01:33:51.404 INFO:teuthology.orchestra.run.smithi044.stdout:(50/142): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2023-11-04T01:33:51.429 INFO:teuthology.orchestra.run.smithi044.stdout:(51/142): openblas-0.3.21-2.el9.x86_64.rpm 685 kB/s | 34 kB 00:00 2023-11-04T01:33:51.513 INFO:teuthology.orchestra.run.smithi044.stdout:(52/142): openblas-openmp-0.3.21-2.el9.x86_64.r 44 MB/s | 4.7 MB 00:00 2023-11-04T01:33:51.555 INFO:teuthology.orchestra.run.smithi044.stdout:(53/142): postgresql-13.11-1.el9.x86_64.rpm 12 MB/s | 1.5 MB 00:00 2023-11-04T01:33:51.588 INFO:teuthology.orchestra.run.smithi044.stdout:(54/142): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2023-11-04T01:33:51.606 INFO:teuthology.orchestra.run.smithi044.stdout:(55/142): postgresql-private-libs-13.11-1.el9.x 2.7 MB/s | 134 kB 00:00 2023-11-04T01:33:51.706 INFO:teuthology.orchestra.run.smithi044.stdout:(56/142): postgresql-server-13.11-1.el9.x86_64. 49 MB/s | 5.7 MB 00:00 2023-11-04T01:33:51.798 INFO:teuthology.orchestra.run.smithi044.stdout:(57/142): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 5.8 MB 00:00 2023-11-04T01:33:51.823 INFO:teuthology.orchestra.run.smithi044.stdout:(58/142): python3-devel-3.9.17-2.el9.x86_64.rpm 1.8 MB/s | 205 kB 00:00 2023-11-04T01:33:51.856 INFO:teuthology.orchestra.run.smithi044.stdout:(59/142): python3-jinja2-2.11.3-4.el9.noarch.rp 6.7 MB/s | 228 kB 00:00 2023-11-04T01:33:51.874 INFO:teuthology.orchestra.run.smithi044.stdout:(60/142): python3-jsonpatch-1.21-16.el9.noarch. 489 kB/s | 24 kB 00:00 2023-11-04T01:33:51.898 INFO:teuthology.orchestra.run.smithi044.stdout:(61/142): python3-jsonpointer-2.0-4.el9.noarch. 730 kB/s | 18 kB 00:00 2023-11-04T01:33:51.924 INFO:teuthology.orchestra.run.smithi044.stdout:(62/142): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2023-11-04T01:33:51.949 INFO:teuthology.orchestra.run.smithi044.stdout:(63/142): python3-markupsafe-1.1.1-12.el9.x86_6 632 kB/s | 32 kB 00:00 2023-11-04T01:33:52.033 INFO:teuthology.orchestra.run.smithi044.stdout:(64/142): python3-numpy-1.20.1-5.el9.x86_64.rpm 44 MB/s | 4.8 MB 00:00 2023-11-04T01:33:52.060 INFO:teuthology.orchestra.run.smithi044.stdout:(65/142): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 217 kB 00:00 2023-11-04T01:33:52.085 INFO:teuthology.orchestra.run.smithi044.stdout:(66/142): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 174 kB 00:00 2023-11-04T01:33:52.110 INFO:teuthology.orchestra.run.smithi044.stdout:(67/142): python3-prettytable-0.7.2-27.el9.noar 830 kB/s | 41 kB 00:00 2023-11-04T01:33:52.136 INFO:teuthology.orchestra.run.smithi044.stdout:(68/142): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-11-04T01:33:52.170 INFO:teuthology.orchestra.run.smithi044.stdout:(69/142): python3-pyasn1-modules-0.4.8-6.el9.no 3.5 MB/s | 211 kB 00:00 2023-11-04T01:33:52.195 INFO:teuthology.orchestra.run.smithi044.stdout:(70/142): python3-requests-oauthlib-1.3.0-12.el 732 kB/s | 43 kB 00:00 2023-11-04T01:33:52.279 INFO:teuthology.orchestra.run.smithi044.stdout:(71/142): python3-toml-0.10.2-6.el9.noarch.rpm 481 kB/s | 39 kB 00:00 2023-11-04T01:33:52.454 INFO:teuthology.orchestra.run.smithi044.stdout:(72/142): python3-scipy-1.6.2-8.el9.x86_64.rpm 55 MB/s | 16 MB 00:00 2023-11-04T01:33:52.480 INFO:teuthology.orchestra.run.smithi044.stdout:(73/142): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 300 kB 00:00 2023-11-04T01:33:52.505 INFO:teuthology.orchestra.run.smithi044.stdout:(74/142): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2023-11-04T01:33:52.530 INFO:teuthology.orchestra.run.smithi044.stdout:(75/142): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-11-04T01:33:52.555 INFO:teuthology.orchestra.run.smithi044.stdout:(76/142): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-11-04T01:33:52.592 INFO:teuthology.orchestra.run.smithi044.stdout:(77/142): libgfortran-11.4.1-2.3.el9.x86_64.rpm 13 MB/s | 803 kB 00:00 2023-11-04T01:33:52.616 INFO:teuthology.orchestra.run.smithi044.stdout:(78/142): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2023-11-04T01:33:52.640 INFO:teuthology.orchestra.run.smithi044.stdout:(79/142): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-11-04T01:33:52.665 INFO:teuthology.orchestra.run.smithi044.stdout:(80/142): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2023-11-04T01:33:52.690 INFO:teuthology.orchestra.run.smithi044.stdout:(81/142): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2023-11-04T01:33:52.716 INFO:teuthology.orchestra.run.smithi044.stdout:(82/142): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-11-04T01:33:52.741 INFO:teuthology.orchestra.run.smithi044.stdout:(83/142): python3-urllib3-1.26.5-4.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-11-04T01:33:52.825 INFO:teuthology.orchestra.run.smithi044.stdout:(84/142): ceph-mgr-diskprediction-local-18.0.0- 2.6 MB/s | 7.4 MB 00:02 2023-11-04T01:33:52.933 INFO:teuthology.orchestra.run.smithi044.stdout:(85/142): elfutils-libelf-devel-0.189-3.el9.x86 206 kB/s | 22 kB 00:00 2023-11-04T01:33:52.983 INFO:teuthology.orchestra.run.smithi044.stdout:(86/142): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2023-11-04T01:33:53.026 INFO:teuthology.orchestra.run.smithi044.stdout:(87/142): jq-1.6-15.el9.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2023-11-04T01:33:53.092 INFO:teuthology.orchestra.run.smithi044.stdout:(88/142): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2023-11-04T01:33:53.130 INFO:teuthology.orchestra.run.smithi044.stdout:(89/142): libuuid-devel-2.37.4-15.el9.x86_64.rp 255 kB/s | 26 kB 00:00 2023-11-04T01:33:53.245 INFO:teuthology.orchestra.run.smithi044.stdout:(90/142): python3-pytz-2021.1-5.el9.noarch.rpm 438 kB/s | 51 kB 00:00 2023-11-04T01:33:53.352 INFO:teuthology.orchestra.run.smithi044.stdout:(91/142): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 795 kB/s | 86 kB 00:00 2023-11-04T01:33:53.460 INFO:teuthology.orchestra.run.smithi044.stdout:(92/142): zlib-devel-1.2.11-40.el9.x86_64.rpm 418 kB/s | 45 kB 00:00 2023-11-04T01:33:53.527 INFO:teuthology.orchestra.run.smithi044.stdout:(93/142): python3-cryptography-36.0.1-4.el9.x86 1.5 MB/s | 1.2 MB 00:00 2023-11-04T01:33:53.657 INFO:teuthology.orchestra.run.smithi044.stdout:(94/142): openssl-devel-3.0.7-24.el9.x86_64.rpm 7.4 MB/s | 4.1 MB 00:00 2023-11-04T01:33:54.211 INFO:teuthology.orchestra.run.smithi044.stdout:(95/142): libarrow-doc-9.0.0-9.el9.noarch.rpm 46 kB/s | 24 kB 00:00 2023-11-04T01:33:54.336 INFO:teuthology.orchestra.run.smithi044.stdout:(96/142): gperftools-libs-2.9.1-2.el9.x86_64.rp 353 kB/s | 309 kB 00:00 2023-11-04T01:33:54.395 INFO:teuthology.orchestra.run.smithi044.stdout:(97/142): liboath-2.6.7-2.el9.x86_64.rpm 265 kB/s | 49 kB 00:00 2023-11-04T01:33:54.445 INFO:teuthology.orchestra.run.smithi044.stdout:(98/142): libunwind-1.6.2-1.el9.x86_64.rpm 620 kB/s | 67 kB 00:00 2023-11-04T01:33:55.204 INFO:teuthology.orchestra.run.smithi044.stdout:(99/142): python3-asyncssh-2.13.2-3.el9.noarch. 722 kB/s | 548 kB 00:00 2023-11-04T01:33:55.246 INFO:teuthology.orchestra.run.smithi044.stdout:(100/142): parquet-libs-9.0.0-9.el9.x86_64.rpm 984 kB/s | 837 kB 00:00 2023-11-04T01:33:55.321 INFO:teuthology.orchestra.run.smithi044.stdout:(101/142): python3-bcrypt-3.2.2-1.el9.x86_64.rp 371 kB/s | 43 kB 00:00 2023-11-04T01:33:55.355 INFO:teuthology.orchestra.run.smithi044.stdout:(102/142): python3-cachetools-4.2.4-1.el9.noarc 296 kB/s | 32 kB 00:00 2023-11-04T01:33:55.430 INFO:teuthology.orchestra.run.smithi044.stdout:(103/142): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2023-11-04T01:33:55.480 INFO:teuthology.orchestra.run.smithi044.stdout:(104/142): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2023-11-04T01:33:55.614 INFO:teuthology.orchestra.run.smithi044.stdout:(105/142): python3-google-auth-2.23.3-1.el9.noa 1.4 MB/s | 197 kB 00:00 2023-11-04T01:33:55.722 INFO:teuthology.orchestra.run.smithi044.stdout:(106/142): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2023-11-04T01:33:55.839 INFO:teuthology.orchestra.run.smithi044.stdout:(107/142): python3-jaraco-classes-3.2.1-5.el9.n 151 kB/s | 18 kB 00:00 2023-11-04T01:33:55.956 INFO:teuthology.orchestra.run.smithi044.stdout:(108/142): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2023-11-04T01:33:55.983 INFO:teuthology.orchestra.run.smithi044.stdout:(109/142): python3-cherrypy-18.6.1-2.el9.noarch 650 kB/s | 358 kB 00:00 2023-11-04T01:33:56.067 INFO:teuthology.orchestra.run.smithi044.stdout:(110/142): python3-jaraco-functools-3.5.0-2.el9 179 kB/s | 19 kB 00:00 2023-11-04T01:33:56.091 INFO:teuthology.orchestra.run.smithi044.stdout:(111/142): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2023-11-04T01:33:56.183 INFO:teuthology.orchestra.run.smithi044.stdout:(112/142): python3-jwt+crypto-2.4.0-1.el9.noarc 77 kB/s | 9.0 kB 00:00 2023-11-04T01:33:56.208 INFO:teuthology.orchestra.run.smithi044.stdout:(113/142): python3-jwt-2.4.0-1.el9.noarch.rpm 350 kB/s | 41 kB 00:00 2023-11-04T01:33:56.350 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2023-11-04T01:33:56.406 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2023-11-04T01:33:56.431 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2023-11-04T01:33:56.458 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2023-11-04T01:33:56.509 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/152 2023-11-04T01:33:56.835 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/152 2023-11-04T01:33:56.908 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:33:56.925 INFO:teuthology.orchestra.run.smithi044.stdout:(114/142): python3-logutils-0.3.5-21.el9.noarch 65 kB/s | 46 kB 00:00 2023-11-04T01:33:57.027 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:33:57.034 INFO:teuthology.orchestra.run.smithi044.stdout:(115/142): python3-more-itertools-8.12.0-2.el9. 728 kB/s | 79 kB 00:00 2023-11-04T01:33:57.050 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:33:57.142 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:33:57.150 INFO:teuthology.orchestra.run.smithi044.stdout:(116/142): python3-natsort-7.1.1-5.el9.noarch.r 495 kB/s | 58 kB 00:00 2023-11-04T01:33:57.192 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:33:57.263 INFO:teuthology.orchestra.run.smithi044.stdout:(117/142): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2023-11-04T01:33:57.273 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/152 2023-11-04T01:33:57.378 INFO:teuthology.orchestra.run.smithi044.stdout:(118/142): python3-portend-3.1.0-2.el9.noarch.r 152 kB/s | 16 kB 00:00 2023-11-04T01:33:57.488 INFO:teuthology.orchestra.run.smithi044.stdout:(119/142): python3-pyOpenSSL-21.0.0-1.el9.noarc 771 kB/s | 90 kB 00:00 2023-11-04T01:33:57.583 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/152 2023-11-04T01:33:57.596 INFO:teuthology.orchestra.run.smithi044.stdout:(120/142): python3-repoze-lru-0.7-16.el9.noarch 283 kB/s | 31 kB 00:00 2023-11-04T01:33:57.633 INFO:teuthology.orchestra.run.smithi044.stdout:(121/142): python3-kubernetes-26.1.0-2.el9.noar 722 kB/s | 1.0 MB 00:01 2023-11-04T01:33:57.638 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/152 2023-11-04T01:33:57.667 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:33:57.714 INFO:teuthology.orchestra.run.smithi044.stdout:(122/142): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2023-11-04T01:33:57.749 INFO:teuthology.orchestra.run.smithi044.stdout:(123/142): python3-rsa-4.9-2.el9.noarch.rpm 505 kB/s | 59 kB 00:00 2023-11-04T01:33:57.767 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:33:57.798 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:33:57.831 INFO:teuthology.orchestra.run.smithi044.stdout:(124/142): python3-tempora-5.0.0-2.el9.noarch.r 305 kB/s | 36 kB 00:00 2023-11-04T01:33:57.856 INFO:teuthology.orchestra.run.smithi044.stdout:(125/142): python3-typing-extensions-4.4.0-2.el 470 kB/s | 51 kB 00:00 2023-11-04T01:33:57.869 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:33:57.948 INFO:teuthology.orchestra.run.smithi044.stdout:(126/142): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2023-11-04T01:33:58.051 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/152 2023-11-04T01:33:58.051 INFO:teuthology.orchestra.run.smithi044.stdout:(127/142): python3-websocket-client-1.2.3-2.el9 467 kB/s | 90 kB 00:00 2023-11-04T01:33:58.157 INFO:teuthology.orchestra.run.smithi044.stdout:(128/142): python3-werkzeug-2.0.3-3.el9.1.noarc 2.0 MB/s | 427 kB 00:00 2023-11-04T01:33:58.161 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:33:58.183 INFO:teuthology.orchestra.run.smithi044.stdout:(129/142): python3-zc-lockfile-2.0-10.el9.noarc 149 kB/s | 20 kB 00:00 2023-11-04T01:33:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:33:58.283 INFO:teuthology.orchestra.run.smithi044.stdout:(130/142): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2023-11-04T01:33:58.335 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:33:58.382 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:33:58.656 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:33:58.693 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/152 2023-11-04T01:33:58.729 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2023-11-04T01:33:58.798 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2023-11-04T01:33:58.852 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 20/152 2023-11-04T01:33:58.881 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/152 2023-11-04T01:33:58.917 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/152 2023-11-04T01:33:58.995 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/152 2023-11-04T01:33:59.039 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/152 2023-11-04T01:33:59.066 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/152 2023-11-04T01:33:59.137 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2023-11-04T01:33:59.171 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 27/152 2023-11-04T01:33:59.215 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 28/152 2023-11-04T01:33:59.289 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 29/152 2023-11-04T01:33:59.428 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/152 2023-11-04T01:33:59.475 INFO:teuthology.orchestra.run.smithi044.stdout:(131/142): librados2-18.0.0-7035.g7532011a.el9. 2.8 MB/s | 3.3 MB 00:01 2023-11-04T01:33:59.484 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/152 2023-11-04T01:33:59.892 INFO:teuthology.orchestra.run.smithi044.stdout:(132/142): libarrow-9.0.0-9.el9.x86_64.rpm 711 kB/s | 4.4 MB 00:06 2023-11-04T01:33:59.925 INFO:teuthology.orchestra.run.smithi044.stdout:(133/142): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-11-04T01:33:59.984 INFO:teuthology.orchestra.run.smithi044.stdout:(134/142): NetworkManager-1.45.5-1.el9.x86_64.r 39 MB/s | 2.2 MB 00:00 2023-11-04T01:34:00.034 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/152 2023-11-04T01:34:00.034 INFO:teuthology.orchestra.run.smithi044.stdout:(135/142): NetworkManager-libnm-1.45.5-1.el9.x8 35 MB/s | 1.8 MB 00:00 2023-11-04T01:34:00.070 INFO:teuthology.orchestra.run.smithi044.stdout:(136/142): NetworkManager-team-1.45.5-1.el9.x86 1.2 MB/s | 42 kB 00:00 2023-11-04T01:34:00.102 INFO:teuthology.orchestra.run.smithi044.stdout:(137/142): NetworkManager-tui-1.45.5-1.el9.x86_ 7.2 MB/s | 245 kB 00:00 2023-11-04T01:34:00.112 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/152 2023-11-04T01:34:00.128 INFO:teuthology.orchestra.run.smithi044.stdout:(138/142): acl-2.3.1-4.el9.x86_64.rpm 2.7 MB/s | 69 kB 00:00 2023-11-04T01:34:00.151 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/152 2023-11-04T01:34:00.160 INFO:teuthology.orchestra.run.smithi044.stdout:(139/142): libacl-2.3.1-4.el9.x86_64.rpm 661 kB/s | 22 kB 00:00 2023-11-04T01:34:00.187 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 35/152 2023-11-04T01:34:00.194 INFO:teuthology.orchestra.run.smithi044.stdout:(140/142): xfsdump-3.1.12-4.el9.x86_64.rpm 9.4 MB/s | 321 kB 00:00 2023-11-04T01:34:00.218 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/152 2023-11-04T01:34:00.317 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/152 2023-11-04T01:34:00.353 INFO:teuthology.orchestra.run.smithi044.stdout:(141/142): librbd1-18.0.0-7035.g7532011a.el9.x8 3.4 MB/s | 3.0 MB 00:00 2023-11-04T01:34:00.355 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/152 2023-11-04T01:34:00.395 INFO:teuthology.orchestra.run.smithi044.stdout:(142/142): thrift-0.15.0-2.el9.x86_64.rpm 732 kB/s | 1.6 MB 00:02 2023-11-04T01:34:00.401 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:34:00.401 INFO:teuthology.orchestra.run.smithi044.stdout:Total 9.7 MB/s | 200 MB 00:20 2023-11-04T01:34:00.411 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/152 2023-11-04T01:34:00.501 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/152 2023-11-04T01:34:00.532 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/152 2023-11-04T01:34:00.541 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2023-11-04T01:34:00.567 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/152 2023-11-04T01:34:00.615 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/152 2023-11-04T01:34:00.659 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/152 2023-11-04T01:34:00.682 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2023-11-04T01:34:00.682 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2023-11-04T01:34:00.702 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/152 2023-11-04T01:34:00.837 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/152 2023-11-04T01:34:00.878 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/152 2023-11-04T01:34:00.920 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/152 2023-11-04T01:34:01.015 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/152 2023-11-04T01:34:01.079 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 50/152 2023-11-04T01:34:01.121 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/152 2023-11-04T01:34:01.152 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/152 2023-11-04T01:34:01.179 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/152 2023-11-04T01:34:01.207 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 54/152 2023-11-04T01:34:01.302 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 55/152 2023-11-04T01:34:01.340 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : automake-1.16.2-8.el9.noarch 56/152 2023-11-04T01:34:01.397 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/152 2023-11-04T01:34:01.462 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/152 2023-11-04T01:34:01.657 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/152 2023-11-04T01:34:01.703 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/152 2023-11-04T01:34:01.845 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/152 2023-11-04T01:34:01.942 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/152 2023-11-04T01:34:01.974 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/152 2023-11-04T01:34:02.005 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/152 2023-11-04T01:34:02.038 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/152 2023-11-04T01:34:02.070 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/152 2023-11-04T01:34:02.105 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/152 2023-11-04T01:34:02.153 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/152 2023-11-04T01:34:02.184 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 69/152 2023-11-04T01:34:02.214 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 70/152 2023-11-04T01:34:02.291 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 71/152 2023-11-04T01:34:02.324 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 72/152 2023-11-04T01:34:02.366 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/152 2023-11-04T01:34:02.409 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/152 2023-11-04T01:34:02.442 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/152 2023-11-04T01:34:02.532 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/152 2023-11-04T01:34:02.539 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2023-11-04T01:34:02.540 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2023-11-04T01:34:02.578 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/152 2023-11-04T01:34:02.682 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 78/152 2023-11-04T01:34:02.729 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2023-11-04T01:34:03.479 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2023-11-04T01:34:03.526 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2023-11-04T01:34:03.560 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2023-11-04T01:34:03.660 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2023-11-04T01:34:03.694 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 84/152 2023-11-04T01:34:03.872 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/152 2023-11-04T01:34:03.900 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/152 2023-11-04T01:34:03.986 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/152 2023-11-04T01:34:04.646 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/152 2023-11-04T01:34:04.758 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/152 2023-11-04T01:34:06.036 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/152 2023-11-04T01:34:06.117 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/152 2023-11-04T01:34:06.154 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/152 2023-11-04T01:34:06.188 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jq-1.6-15.el9.x86_64 93/152 2023-11-04T01:34:06.216 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2023-11-04T01:34:06.533 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 95/152 2023-11-04T01:34:06.562 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:34:06.653 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:34:06.683 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 97/152 2023-11-04T01:34:06.720 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 98/152 2023-11-04T01:34:07.148 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 99/152 2023-11-04T01:34:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:34:07.228 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:34:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 101/152 2023-11-04T01:34:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2023-11-04T01:34:08.558 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2023-11-04T01:34:08.581 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2023-11-04T01:34:08.607 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2023-11-04T01:34:08.657 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/152 2023-11-04T01:34:09.008 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/152 2023-11-04T01:34:09.059 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:34:09.181 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:34:09.210 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:34:09.311 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:34:09.357 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:34:09.379 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:09.413 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:09.534 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/152 2023-11-04T01:34:09.703 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/152 2023-11-04T01:34:09.764 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/152 2023-11-04T01:34:09.789 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:34:09.876 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:34:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:34:09.944 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:34:09.971 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:10.016 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:34:10.101 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/152 2023-11-04T01:34:10.107 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:34:10.107 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-04T01:34:10.107 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-04T01:34:10.107 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:10.135 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:34:10.233 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:34:10.288 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:34:10.388 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:34:10.440 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:34:10.718 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:34:10.760 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/152 2023-11-04T01:34:10.796 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2023-11-04T01:34:10.885 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2023-11-04T01:34:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 20/152 2023-11-04T01:34:10.990 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/152 2023-11-04T01:34:11.034 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/152 2023-11-04T01:34:11.108 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/152 2023-11-04T01:34:11.166 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/152 2023-11-04T01:34:11.191 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/152 2023-11-04T01:34:11.264 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2023-11-04T01:34:11.296 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 27/152 2023-11-04T01:34:11.340 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 28/152 2023-11-04T01:34:11.419 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 29/152 2023-11-04T01:34:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/152 2023-11-04T01:34:11.618 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/152 2023-11-04T01:34:12.196 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/152 2023-11-04T01:34:12.281 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/152 2023-11-04T01:34:12.326 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/152 2023-11-04T01:34:12.363 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 35/152 2023-11-04T01:34:12.393 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/152 2023-11-04T01:34:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/152 2023-11-04T01:34:12.539 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/152 2023-11-04T01:34:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/152 2023-11-04T01:34:12.670 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/152 2023-11-04T01:34:12.706 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/152 2023-11-04T01:34:12.743 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/152 2023-11-04T01:34:12.791 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/152 2023-11-04T01:34:12.836 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/152 2023-11-04T01:34:12.878 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/152 2023-11-04T01:34:13.023 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/152 2023-11-04T01:34:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/152 2023-11-04T01:34:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/152 2023-11-04T01:34:13.212 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/152 2023-11-04T01:34:13.245 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 50/152 2023-11-04T01:34:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/152 2023-11-04T01:34:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/152 2023-11-04T01:34:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/152 2023-11-04T01:34:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 54/152 2023-11-04T01:34:13.467 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 55/152 2023-11-04T01:34:13.515 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : automake-1.16.2-8.el9.noarch 56/152 2023-11-04T01:34:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/152 2023-11-04T01:34:13.638 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/152 2023-11-04T01:34:13.849 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/152 2023-11-04T01:34:13.903 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/152 2023-11-04T01:34:14.048 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/152 2023-11-04T01:34:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/152 2023-11-04T01:34:14.117 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/152 2023-11-04T01:34:14.154 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/152 2023-11-04T01:34:14.183 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/152 2023-11-04T01:34:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/152 2023-11-04T01:34:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/152 2023-11-04T01:34:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/152 2023-11-04T01:34:14.332 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 69/152 2023-11-04T01:34:14.362 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 70/152 2023-11-04T01:34:14.440 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 71/152 2023-11-04T01:34:14.529 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 72/152 2023-11-04T01:34:14.620 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/152 2023-11-04T01:34:14.665 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/152 2023-11-04T01:34:14.705 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/152 2023-11-04T01:34:14.800 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/152 2023-11-04T01:34:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/152 2023-11-04T01:34:14.954 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 78/152 2023-11-04T01:34:15.014 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2023-11-04T01:34:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2023-11-04T01:34:15.847 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2023-11-04T01:34:15.880 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2023-11-04T01:34:15.988 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2023-11-04T01:34:16.030 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 84/152 2023-11-04T01:34:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/152 2023-11-04T01:34:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/152 2023-11-04T01:34:16.336 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/152 2023-11-04T01:34:17.046 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/152 2023-11-04T01:34:17.165 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/152 2023-11-04T01:34:18.508 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/152 2023-11-04T01:34:18.596 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/152 2023-11-04T01:34:18.627 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/152 2023-11-04T01:34:18.658 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : jq-1.6-15.el9.x86_64 93/152 2023-11-04T01:34:18.685 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2023-11-04T01:34:19.002 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 95/152 2023-11-04T01:34:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:34:19.133 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:34:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 97/152 2023-11-04T01:34:19.198 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 98/152 2023-11-04T01:34:19.650 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 99/152 2023-11-04T01:34:19.684 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:34:19.755 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:34:19.786 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 101/152 2023-11-04T01:34:21.642 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:34:21.642 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /sys 2023-11-04T01:34:21.642 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /proc 2023-11-04T01:34:21.642 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /mnt 2023-11-04T01:34:21.642 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /var/tmp 2023-11-04T01:34:21.642 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /home 2023-11-04T01:34:21.642 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /root 2023-11-04T01:34:21.642 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /tmp 2023-11-04T01:34:21.642 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:21.806 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:34:21.831 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:34:21.831 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:21.831 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-04T01:34:21.831 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:22.008 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:22.040 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:22.643 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:34:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:34:22.729 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-04T01:34:22.729 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-04T01:34:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:34:23.393 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:34:23.418 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:34:23.418 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:23.419 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-04T01:34:23.419 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:34:23.419 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:34:23.419 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:23.627 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:34:23.650 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:34:23.650 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:23.650 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-04T01:34:23.651 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:34:23.651 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:34:23.651 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:24.104 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:34:24.125 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:34:24.125 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:24.125 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-04T01:34:24.125 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:34:24.125 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:34:24.125 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:24.552 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:34:24.593 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:34:24.622 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 110/152 2023-11-04T01:34:24.684 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 111/152 2023-11-04T01:34:24.709 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:34:24.930 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:34:24.967 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:34:25.934 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:34:25.959 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:34:26.062 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:34:26.216 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 115/152 2023-11-04T01:34:26.245 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:34:26.268 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:34:26.268 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:26.268 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-04T01:34:26.268 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:34:26.268 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:34:26.268 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:26.312 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:34:26.323 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:34:27.100 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 118/152 2023-11-04T01:34:27.130 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:34:27.152 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:34:27.152 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:27.152 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-04T01:34:27.152 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:34:27.153 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:34:27.153 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:27.189 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:34:27.211 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:34:27.211 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:27.211 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-04T01:34:27.211 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:27.265 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:34:27.287 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:34:27.287 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:27.287 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-04T01:34:27.287 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:34:27.287 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:34:27.287 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:27.582 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:34:27.604 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:34:27.605 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:27.605 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-04T01:34:27.605 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:34:27.605 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:34:27.605 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:31.426 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 123/152 2023-11-04T01:34:31.489 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 124/152 2023-11-04T01:34:31.534 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 125/152 2023-11-04T01:34:31.719 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 126/152 2023-11-04T01:34:31.838 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 127/152 2023-11-04T01:34:31.897 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 128/152 2023-11-04T01:34:31.934 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/152 2023-11-04T01:34:31.967 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 130/152 2023-11-04T01:34:31.990 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 131/152 2023-11-04T01:34:32.019 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-team-1:1.45.5-1.el9.x86_64 132/152 2023-11-04T01:34:32.092 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-tui-1:1.45.5-1.el9.x86_64 133/152 2023-11-04T01:34:32.144 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 134/152 2023-11-04T01:34:32.177 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 135/152 2023-11-04T01:34:32.825 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:34:32.867 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:34:32.887 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:34:32.936 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 137/152 2023-11-04T01:34:33.775 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 138/152 2023-11-04T01:34:33.857 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 139/152 2023-11-04T01:34:33.897 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 140/152 2023-11-04T01:34:33.991 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flex-2.6.4-9.el9.x86_64 141/152 2023-11-04T01:34:34.027 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : bison-3.7.4-5.el9.x86_64 142/152 2023-11-04T01:34:34.061 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 143/152 2023-11-04T01:34:34.061 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:34:34.145 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:34:34.170 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 145/152 2023-11-04T01:34:34.195 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 146/152 2023-11-04T01:34:34.220 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 147/152 2023-11-04T01:34:34.228 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:34:34.228 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:34:34.407 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:34:34.407 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:34:34.506 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:34:34.532 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:34:34.532 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:34:34.641 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:34:34.716 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:34:34.798 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:34:34.798 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /sys 2023-11-04T01:34:34.799 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /proc 2023-11-04T01:34:34.799 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /mnt 2023-11-04T01:34:34.799 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /var/tmp 2023-11-04T01:34:34.799 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /home 2023-11-04T01:34:34.799 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /root 2023-11-04T01:34:34.799 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /tmp 2023-11-04T01:34:34.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:34.964 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:34:34.980 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:34:34.980 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:34.980 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-04T01:34:34.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:36.592 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:34:36.619 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:34:36.619 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:36.619 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-04T01:34:36.619 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:34:36.619 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:34:36.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:34:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:34:36.858 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:36.858 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-04T01:34:36.858 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:34:36.858 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:34:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:37.318 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:34:37.346 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:34:37.346 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:37.346 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-04T01:34:37.346 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:34:37.346 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:34:37.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:37.796 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:34:37.835 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:34:37.863 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 110/152 2023-11-04T01:34:37.928 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 111/152 2023-11-04T01:34:37.964 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:34:38.193 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:34:38.233 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:34:39.253 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:34:39.276 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:34:39.280 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:34:39.280 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 1/152 2023-11-04T01:34:39.280 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2/152 2023-11-04T01:34:39.280 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 3/152 2023-11-04T01:34:39.280 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 4/152 2023-11-04T01:34:39.281 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7035.g75320 5/152 2023-11-04T01:34:39.281 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:34:39.281 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:34:39.281 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:34:39.281 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 9/152 2023-11-04T01:34:39.281 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 10/152 2023-11-04T01:34:39.281 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 11/152 2023-11-04T01:34:39.281 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:34:39.281 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 13/152 2023-11-04T01:34:39.281 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 14/152 2023-11-04T01:34:39.281 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 15/152 2023-11-04T01:34:39.281 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 16/152 2023-11-04T01:34:39.281 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 17/152 2023-11-04T01:34:39.282 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 18/152 2023-11-04T01:34:39.282 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 19/152 2023-11-04T01:34:39.282 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 20/152 2023-11-04T01:34:39.282 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 21/152 2023-11-04T01:34:39.291 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 22/152 2023-11-04T01:34:39.291 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 23/152 2023-11-04T01:34:39.291 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 24/152 2023-11-04T01:34:39.291 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 25/152 2023-11-04T01:34:39.291 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 26/152 2023-11-04T01:34:39.291 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 27/152 2023-11-04T01:34:39.291 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 28/152 2023-11-04T01:34:39.291 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 29/152 2023-11-04T01:34:39.291 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 30/152 2023-11-04T01:34:39.291 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 31/152 2023-11-04T01:34:39.291 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 32/152 2023-11-04T01:34:39.292 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 33/152 2023-11-04T01:34:39.292 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 34/152 2023-11-04T01:34:39.292 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 35/152 2023-11-04T01:34:39.292 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 36/152 2023-11-04T01:34:39.292 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 37/152 2023-11-04T01:34:39.292 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 38/152 2023-11-04T01:34:39.292 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/152 2023-11-04T01:34:39.292 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/152 2023-11-04T01:34:39.292 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/152 2023-11-04T01:34:39.292 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/152 2023-11-04T01:34:39.293 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/152 2023-11-04T01:34:39.293 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/152 2023-11-04T01:34:39.293 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/152 2023-11-04T01:34:39.293 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/152 2023-11-04T01:34:39.293 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/152 2023-11-04T01:34:39.293 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/152 2023-11-04T01:34:39.293 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/152 2023-11-04T01:34:39.293 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/152 2023-11-04T01:34:39.293 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/152 2023-11-04T01:34:39.294 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/152 2023-11-04T01:34:39.294 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/152 2023-11-04T01:34:39.294 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/152 2023-11-04T01:34:39.294 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/152 2023-11-04T01:34:39.294 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/152 2023-11-04T01:34:39.294 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/152 2023-11-04T01:34:39.294 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/152 2023-11-04T01:34:39.294 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/152 2023-11-04T01:34:39.295 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/152 2023-11-04T01:34:39.295 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/152 2023-11-04T01:34:39.295 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/152 2023-11-04T01:34:39.295 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/152 2023-11-04T01:34:39.295 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/152 2023-11-04T01:34:39.295 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/152 2023-11-04T01:34:39.295 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/152 2023-11-04T01:34:39.295 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/152 2023-11-04T01:34:39.295 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/152 2023-11-04T01:34:39.295 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/152 2023-11-04T01:34:39.295 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/152 2023-11-04T01:34:39.295 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/152 2023-11-04T01:34:39.295 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/152 2023-11-04T01:34:39.296 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/152 2023-11-04T01:34:39.296 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/152 2023-11-04T01:34:39.296 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/152 2023-11-04T01:34:39.296 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/152 2023-11-04T01:34:39.296 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/152 2023-11-04T01:34:39.296 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/152 2023-11-04T01:34:39.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/152 2023-11-04T01:34:39.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/152 2023-11-04T01:34:39.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/152 2023-11-04T01:34:39.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/152 2023-11-04T01:34:39.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/152 2023-11-04T01:34:39.336 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 84/152 2023-11-04T01:34:39.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/152 2023-11-04T01:34:39.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/152 2023-11-04T01:34:39.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/152 2023-11-04T01:34:39.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jq-1.6-15.el9.x86_64 88/152 2023-11-04T01:34:39.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/152 2023-11-04T01:34:39.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/152 2023-11-04T01:34:39.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/152 2023-11-04T01:34:39.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/152 2023-11-04T01:34:39.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/152 2023-11-04T01:34:39.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/152 2023-11-04T01:34:39.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/152 2023-11-04T01:34:39.337 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/152 2023-11-04T01:34:39.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/152 2023-11-04T01:34:39.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/152 2023-11-04T01:34:39.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/152 2023-11-04T01:34:39.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/152 2023-11-04T01:34:39.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/152 2023-11-04T01:34:39.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/152 2023-11-04T01:34:39.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/152 2023-11-04T01:34:39.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/152 2023-11-04T01:34:39.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/152 2023-11-04T01:34:39.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/152 2023-11-04T01:34:39.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 107/152 2023-11-04T01:34:39.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/152 2023-11-04T01:34:39.338 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/152 2023-11-04T01:34:39.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/152 2023-11-04T01:34:39.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/152 2023-11-04T01:34:39.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/152 2023-11-04T01:34:39.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/152 2023-11-04T01:34:39.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/152 2023-11-04T01:34:39.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/152 2023-11-04T01:34:39.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/152 2023-11-04T01:34:39.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/152 2023-11-04T01:34:39.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/152 2023-11-04T01:34:39.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/152 2023-11-04T01:34:39.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/152 2023-11-04T01:34:39.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/152 2023-11-04T01:34:39.339 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/152 2023-11-04T01:34:39.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/152 2023-11-04T01:34:39.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/152 2023-11-04T01:34:39.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/152 2023-11-04T01:34:39.340 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/152 2023-11-04T01:34:39.351 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/152 2023-11-04T01:34:39.351 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/152 2023-11-04T01:34:39.351 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/152 2023-11-04T01:34:39.351 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/152 2023-11-04T01:34:39.351 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/152 2023-11-04T01:34:39.351 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/152 2023-11-04T01:34:39.351 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 133/152 2023-11-04T01:34:39.351 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/152 2023-11-04T01:34:39.351 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 135/152 2023-11-04T01:34:39.351 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/152 2023-11-04T01:34:39.352 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/152 2023-11-04T01:34:39.352 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/152 2023-11-04T01:34:39.352 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-1:1.45.5-1.el9.x86_64 139/152 2023-11-04T01:34:39.352 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/152 2023-11-04T01:34:39.352 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 141/152 2023-11-04T01:34:39.352 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/152 2023-11-04T01:34:39.352 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-team-1:1.45.5-1.el9.x86_64 143/152 2023-11-04T01:34:39.352 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/152 2023-11-04T01:34:39.352 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-tui-1:1.45.5-1.el9.x86_64 145/152 2023-11-04T01:34:39.352 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/152 2023-11-04T01:34:39.352 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/152 2023-11-04T01:34:39.352 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/152 2023-11-04T01:34:39.352 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/152 2023-11-04T01:34:39.353 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:34:39.353 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/152 2023-11-04T01:34:39.382 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:34:39.547 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 115/152 2023-11-04T01:34:39.610 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:34:39.639 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:34:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-04T01:34:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:34:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:34:39.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:39.678 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:34:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:34:40.507 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 118/152 2023-11-04T01:34:40.537 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:34:40.560 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:34:40.561 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:40.561 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-04T01:34:40.561 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:34:40.561 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:34:40.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:40.608 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:34:40.627 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:34:40.627 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:40.627 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-04T01:34:40.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:34:40.703 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:34:40.703 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:40.703 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-04T01:34:40.703 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:34:40.703 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:34:40.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:41.014 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:34:41.038 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:34:41.038 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:41.038 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-04T01:34:41.038 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:34:41.038 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:34:41.039 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:42.030 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:34:42.030 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:42.031 INFO:teuthology.orchestra.run.smithi204.stdout:Upgraded: 2023-11-04T01:34:42.031 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:42.031 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:42.031 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-team-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:42.031 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-tui-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:42.031 INFO:teuthology.orchestra.run.smithi204.stdout: acl-2.3.1-4.el9.x86_64 2023-11-04T01:34:42.031 INFO:teuthology.orchestra.run.smithi204.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-04T01:34:42.031 INFO:teuthology.orchestra.run.smithi204.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-04T01:34:42.031 INFO:teuthology.orchestra.run.smithi204.stdout: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.031 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.031 INFO:teuthology.orchestra.run.smithi204.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-04T01:34:42.031 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2023-11-04T01:34:42.031 INFO:teuthology.orchestra.run.smithi204.stdout: automake-1.16.2-8.el9.noarch 2023-11-04T01:34:42.032 INFO:teuthology.orchestra.run.smithi204.stdout: bison-3.7.4-5.el9.x86_64 2023-11-04T01:34:42.032 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-04T01:34:42.032 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.032 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.032 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.032 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.032 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:42.032 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.032 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.032 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.032 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:42.032 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:42.032 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:42.033 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:42.033 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:42.033 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.033 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.033 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:42.033 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.033 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.033 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.033 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:42.033 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:42.033 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.033 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:42.034 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-11-04T01:34:42.034 INFO:teuthology.orchestra.run.smithi204.stdout: flex-2.6.4-9.el9.x86_64 2023-11-04T01:34:42.034 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-04T01:34:42.034 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-04T01:34:42.034 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-04T01:34:42.034 INFO:teuthology.orchestra.run.smithi204.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-04T01:34:42.035 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-04T01:34:42.035 INFO:teuthology.orchestra.run.smithi204.stdout: jq-1.6-15.el9.x86_64 2023-11-04T01:34:42.035 INFO:teuthology.orchestra.run.smithi204.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-04T01:34:42.035 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-04T01:34:42.036 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-04T01:34:42.036 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.036 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.036 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.036 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-04T01:34:42.038 INFO:teuthology.orchestra.run.smithi204.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-04T01:34:42.038 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-04T01:34:42.038 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-04T01:34:42.038 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-04T01:34:42.038 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.038 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.038 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-04T01:34:42.038 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.038 INFO:teuthology.orchestra.run.smithi204.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-04T01:34:42.039 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-04T01:34:42.039 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-04T01:34:42.039 INFO:teuthology.orchestra.run.smithi204.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-04T01:34:42.039 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-04T01:34:42.039 INFO:teuthology.orchestra.run.smithi204.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-04T01:34:42.039 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-04T01:34:42.039 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-04T01:34:42.039 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-04T01:34:42.039 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-04T01:34:42.039 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-13.11-1.el9.x86_64 2023-11-04T01:34:42.039 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-04T01:34:42.039 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-04T01:34:42.039 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-04T01:34:42.040 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-04T01:34:42.040 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-04T01:34:42.040 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-04T01:34:42.040 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-04T01:34:42.040 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.040 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.040 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.040 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-04T01:34:42.040 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-04T01:34:42.040 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-04T01:34:42.040 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-04T01:34:42.040 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-04T01:34:42.040 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-04T01:34:42.040 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-04T01:34:42.041 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-04T01:34:42.041 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-04T01:34:42.041 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-04T01:34:42.041 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-04T01:34:42.041 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-04T01:34:42.041 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-04T01:34:42.041 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-04T01:34:42.041 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-04T01:34:42.041 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-04T01:34:42.041 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-04T01:34:42.041 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-04T01:34:42.041 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-04T01:34:42.041 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-04T01:34:42.042 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-04T01:34:42.042 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-04T01:34:42.042 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-04T01:34:42.042 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-04T01:34:42.042 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-04T01:34:42.042 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-04T01:34:42.042 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-04T01:34:42.042 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply-3.11-14.el9.noarch 2023-11-04T01:34:42.042 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-04T01:34:42.072 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-04T01:34:42.072 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-04T01:34:42.072 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-04T01:34:42.072 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-04T01:34:42.072 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-04T01:34:42.072 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-04T01:34:42.072 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.072 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.073 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-04T01:34:42.073 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-04T01:34:42.073 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-04T01:34:42.073 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.073 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-04T01:34:42.073 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-04T01:34:42.073 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-04T01:34:42.073 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-04T01:34:42.073 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-04T01:34:42.073 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-04T01:34:42.073 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-04T01:34:42.073 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-04T01:34:42.074 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-04T01:34:42.074 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-04T01:34:42.074 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-04T01:34:42.074 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.074 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.074 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:42.074 INFO:teuthology.orchestra.run.smithi204.stdout: re2-1:20211101-3.el9.x86_64 2023-11-04T01:34:42.074 INFO:teuthology.orchestra.run.smithi204.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-04T01:34:42.074 INFO:teuthology.orchestra.run.smithi204.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-04T01:34:42.074 INFO:teuthology.orchestra.run.smithi204.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-04T01:34:42.074 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-04T01:34:42.074 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-04T01:34:42.075 INFO:teuthology.orchestra.run.smithi204.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-04T01:34:42.075 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:42.075 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2023-11-04T01:34:42.415 DEBUG:teuthology.parallel:result is None 2023-11-04T01:34:45.070 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 123/152 2023-11-04T01:34:45.117 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 124/152 2023-11-04T01:34:45.148 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 125/152 2023-11-04T01:34:45.344 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 126/152 2023-11-04T01:34:45.458 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 127/152 2023-11-04T01:34:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 128/152 2023-11-04T01:34:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/152 2023-11-04T01:34:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 130/152 2023-11-04T01:34:45.620 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 131/152 2023-11-04T01:34:45.650 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-team-1:1.45.5-1.el9.x86_64 132/152 2023-11-04T01:34:45.733 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-tui-1:1.45.5-1.el9.x86_64 133/152 2023-11-04T01:34:45.803 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 134/152 2023-11-04T01:34:45.839 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 135/152 2023-11-04T01:34:46.473 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:34:46.514 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:34:46.534 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:34:46.588 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 137/152 2023-11-04T01:34:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 138/152 2023-11-04T01:34:47.585 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 139/152 2023-11-04T01:34:47.627 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 140/152 2023-11-04T01:34:47.718 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flex-2.6.4-9.el9.x86_64 141/152 2023-11-04T01:34:47.746 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : bison-3.7.4-5.el9.x86_64 142/152 2023-11-04T01:34:47.773 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 143/152 2023-11-04T01:34:47.774 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:34:47.840 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:34:47.865 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 145/152 2023-11-04T01:34:47.890 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 146/152 2023-11-04T01:34:47.915 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 147/152 2023-11-04T01:34:47.928 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:34:47.928 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:34:48.110 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:34:48.110 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:34:48.201 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:34:48.226 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:34:48.226 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:34:48.311 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:34:48.380 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:34:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:34:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 1/152 2023-11-04T01:34:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2/152 2023-11-04T01:34:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 3/152 2023-11-04T01:34:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 4/152 2023-11-04T01:34:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7035.g75320 5/152 2023-11-04T01:34:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:34:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:34:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:34:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 9/152 2023-11-04T01:34:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 10/152 2023-11-04T01:34:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 11/152 2023-11-04T01:34:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:34:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 13/152 2023-11-04T01:34:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 14/152 2023-11-04T01:34:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 15/152 2023-11-04T01:34:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 16/152 2023-11-04T01:34:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 17/152 2023-11-04T01:34:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 18/152 2023-11-04T01:34:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 19/152 2023-11-04T01:34:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 20/152 2023-11-04T01:34:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 21/152 2023-11-04T01:34:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 22/152 2023-11-04T01:34:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 23/152 2023-11-04T01:34:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 24/152 2023-11-04T01:34:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 25/152 2023-11-04T01:34:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 26/152 2023-11-04T01:34:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 27/152 2023-11-04T01:34:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 28/152 2023-11-04T01:34:52.873 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 29/152 2023-11-04T01:34:52.873 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 30/152 2023-11-04T01:34:52.873 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 31/152 2023-11-04T01:34:52.873 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 32/152 2023-11-04T01:34:52.874 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 33/152 2023-11-04T01:34:52.874 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 34/152 2023-11-04T01:34:52.874 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 35/152 2023-11-04T01:34:52.881 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 36/152 2023-11-04T01:34:52.881 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 37/152 2023-11-04T01:34:52.881 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 38/152 2023-11-04T01:34:52.881 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/152 2023-11-04T01:34:52.881 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/152 2023-11-04T01:34:52.881 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/152 2023-11-04T01:34:52.881 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/152 2023-11-04T01:34:52.881 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/152 2023-11-04T01:34:52.881 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/152 2023-11-04T01:34:52.881 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/152 2023-11-04T01:34:52.881 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/152 2023-11-04T01:34:52.881 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/152 2023-11-04T01:34:52.881 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/152 2023-11-04T01:34:52.882 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/152 2023-11-04T01:34:52.882 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/152 2023-11-04T01:34:52.882 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/152 2023-11-04T01:34:52.882 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/152 2023-11-04T01:34:52.882 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/152 2023-11-04T01:34:52.882 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/152 2023-11-04T01:34:52.882 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/152 2023-11-04T01:34:52.882 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/152 2023-11-04T01:34:52.882 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/152 2023-11-04T01:34:52.882 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/152 2023-11-04T01:34:52.882 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/152 2023-11-04T01:34:52.882 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/152 2023-11-04T01:34:52.883 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/152 2023-11-04T01:34:52.883 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/152 2023-11-04T01:34:52.883 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/152 2023-11-04T01:34:52.883 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/152 2023-11-04T01:34:52.883 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/152 2023-11-04T01:34:52.883 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/152 2023-11-04T01:34:52.883 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/152 2023-11-04T01:34:52.883 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/152 2023-11-04T01:34:52.883 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/152 2023-11-04T01:34:52.883 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/152 2023-11-04T01:34:52.883 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/152 2023-11-04T01:34:52.883 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/152 2023-11-04T01:34:52.884 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/152 2023-11-04T01:34:52.884 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/152 2023-11-04T01:34:52.884 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/152 2023-11-04T01:34:52.884 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/152 2023-11-04T01:34:52.884 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/152 2023-11-04T01:34:52.884 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/152 2023-11-04T01:34:52.884 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/152 2023-11-04T01:34:52.884 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/152 2023-11-04T01:34:52.885 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/152 2023-11-04T01:34:52.885 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/152 2023-11-04T01:34:52.885 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/152 2023-11-04T01:34:52.885 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 84/152 2023-11-04T01:34:52.885 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/152 2023-11-04T01:34:52.886 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/152 2023-11-04T01:34:52.886 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/152 2023-11-04T01:34:52.886 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : jq-1.6-15.el9.x86_64 88/152 2023-11-04T01:34:52.886 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/152 2023-11-04T01:34:52.886 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/152 2023-11-04T01:34:52.887 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/152 2023-11-04T01:34:52.887 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/152 2023-11-04T01:34:52.887 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/152 2023-11-04T01:34:52.892 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/152 2023-11-04T01:34:52.892 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/152 2023-11-04T01:34:52.892 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/152 2023-11-04T01:34:52.893 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/152 2023-11-04T01:34:52.893 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/152 2023-11-04T01:34:52.893 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/152 2023-11-04T01:34:52.893 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/152 2023-11-04T01:34:52.893 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/152 2023-11-04T01:34:52.893 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/152 2023-11-04T01:34:52.893 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/152 2023-11-04T01:34:52.893 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/152 2023-11-04T01:34:52.893 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/152 2023-11-04T01:34:52.893 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/152 2023-11-04T01:34:52.894 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 107/152 2023-11-04T01:34:52.894 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/152 2023-11-04T01:34:52.894 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/152 2023-11-04T01:34:52.894 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/152 2023-11-04T01:34:52.894 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/152 2023-11-04T01:34:52.894 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/152 2023-11-04T01:34:52.894 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/152 2023-11-04T01:34:52.894 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/152 2023-11-04T01:34:52.894 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/152 2023-11-04T01:34:52.894 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/152 2023-11-04T01:34:52.894 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/152 2023-11-04T01:34:52.894 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/152 2023-11-04T01:34:52.895 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/152 2023-11-04T01:34:52.895 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/152 2023-11-04T01:34:52.895 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/152 2023-11-04T01:34:52.895 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/152 2023-11-04T01:34:52.896 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/152 2023-11-04T01:34:52.896 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/152 2023-11-04T01:34:52.896 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/152 2023-11-04T01:34:52.897 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/152 2023-11-04T01:34:52.897 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/152 2023-11-04T01:34:52.897 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/152 2023-11-04T01:34:52.897 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/152 2023-11-04T01:34:52.897 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/152 2023-11-04T01:34:52.897 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/152 2023-11-04T01:34:52.897 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/152 2023-11-04T01:34:52.898 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 133/152 2023-11-04T01:34:52.898 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/152 2023-11-04T01:34:52.898 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 135/152 2023-11-04T01:34:52.898 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/152 2023-11-04T01:34:52.898 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/152 2023-11-04T01:34:52.898 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/152 2023-11-04T01:34:52.898 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-1:1.45.5-1.el9.x86_64 139/152 2023-11-04T01:34:52.898 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/152 2023-11-04T01:34:52.899 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 141/152 2023-11-04T01:34:52.899 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/152 2023-11-04T01:34:52.899 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-team-1:1.45.5-1.el9.x86_64 143/152 2023-11-04T01:34:52.900 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/152 2023-11-04T01:34:52.904 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-tui-1:1.45.5-1.el9.x86_64 145/152 2023-11-04T01:34:52.904 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/152 2023-11-04T01:34:52.904 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/152 2023-11-04T01:34:52.904 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/152 2023-11-04T01:34:52.904 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/152 2023-11-04T01:34:52.904 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:34:52.904 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/152 2023-11-04T01:34:55.354 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:34:55.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:55.354 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2023-11-04T01:34:55.354 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:55.354 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:55.354 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-team-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:55.354 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-tui-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:55.354 INFO:teuthology.orchestra.run.smithi044.stdout: acl-2.3.1-4.el9.x86_64 2023-11-04T01:34:55.354 INFO:teuthology.orchestra.run.smithi044.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-04T01:34:55.354 INFO:teuthology.orchestra.run.smithi044.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-04T01:34:55.355 INFO:teuthology.orchestra.run.smithi044.stdout: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.355 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.355 INFO:teuthology.orchestra.run.smithi044.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-04T01:34:55.355 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2023-11-04T01:34:55.355 INFO:teuthology.orchestra.run.smithi044.stdout: automake-1.16.2-8.el9.noarch 2023-11-04T01:34:55.355 INFO:teuthology.orchestra.run.smithi044.stdout: bison-3.7.4-5.el9.x86_64 2023-11-04T01:34:55.355 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-04T01:34:55.355 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.355 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.355 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.355 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.355 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:55.355 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.356 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.356 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.356 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:55.356 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:55.356 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:55.356 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:55.356 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:55.356 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.356 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.356 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:55.356 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.356 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.357 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.357 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:55.357 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:55.357 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.357 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:55.357 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-11-04T01:34:55.357 INFO:teuthology.orchestra.run.smithi044.stdout: flex-2.6.4-9.el9.x86_64 2023-11-04T01:34:55.357 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-04T01:34:55.357 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-04T01:34:55.357 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-04T01:34:55.357 INFO:teuthology.orchestra.run.smithi044.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-04T01:34:55.358 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-04T01:34:55.359 INFO:teuthology.orchestra.run.smithi044.stdout: jq-1.6-15.el9.x86_64 2023-11-04T01:34:55.359 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-04T01:34:55.359 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-04T01:34:55.359 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-04T01:34:55.359 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.359 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.359 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.359 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-04T01:34:55.359 INFO:teuthology.orchestra.run.smithi044.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-04T01:34:55.359 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-04T01:34:55.359 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-04T01:34:55.359 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-04T01:34:55.360 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.360 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.360 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-04T01:34:55.360 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.360 INFO:teuthology.orchestra.run.smithi044.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-04T01:34:55.360 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-04T01:34:55.360 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-04T01:34:55.360 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-04T01:34:55.360 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-04T01:34:55.360 INFO:teuthology.orchestra.run.smithi044.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-04T01:34:55.360 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-04T01:34:55.360 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-04T01:34:55.360 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-04T01:34:55.361 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-04T01:34:55.361 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-13.11-1.el9.x86_64 2023-11-04T01:34:55.361 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-04T01:34:55.361 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-04T01:34:55.361 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-04T01:34:55.361 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-04T01:34:55.361 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-04T01:34:55.361 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-04T01:34:55.361 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-04T01:34:55.361 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.361 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.361 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.361 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-04T01:34:55.362 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-04T01:34:55.362 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-04T01:34:55.362 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-04T01:34:55.362 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-04T01:34:55.362 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-04T01:34:55.362 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-04T01:34:55.362 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-04T01:34:55.362 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-04T01:34:55.362 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-04T01:34:55.362 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-04T01:34:55.362 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-04T01:34:55.362 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-04T01:34:55.362 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-04T01:34:55.363 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-04T01:34:55.363 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-04T01:34:55.363 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-04T01:34:55.363 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-04T01:34:55.363 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-04T01:34:55.363 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-04T01:34:55.363 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-04T01:34:55.363 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-04T01:34:55.363 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-04T01:34:55.364 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-04T01:34:55.364 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-04T01:34:55.364 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-04T01:34:55.364 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-04T01:34:55.364 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply-3.11-14.el9.noarch 2023-11-04T01:34:55.364 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-04T01:34:55.364 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-04T01:34:55.364 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-04T01:34:55.364 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-04T01:34:55.364 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-04T01:34:55.364 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-04T01:34:55.364 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-04T01:34:55.364 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.365 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.365 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-04T01:34:55.365 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-04T01:34:55.365 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-04T01:34:55.365 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.365 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-04T01:34:55.365 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-04T01:34:55.365 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-04T01:34:55.365 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-04T01:34:55.365 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-04T01:34:55.365 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-04T01:34:55.365 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-04T01:34:55.365 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-04T01:34:55.366 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-04T01:34:55.366 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-04T01:34:55.366 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-04T01:34:55.366 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.366 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.366 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:55.366 INFO:teuthology.orchestra.run.smithi044.stdout: re2-1:20211101-3.el9.x86_64 2023-11-04T01:34:55.366 INFO:teuthology.orchestra.run.smithi044.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-04T01:34:55.366 INFO:teuthology.orchestra.run.smithi044.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-04T01:34:55.366 INFO:teuthology.orchestra.run.smithi044.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-04T01:34:55.366 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-04T01:34:55.366 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-04T01:34:55.366 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-04T01:34:55.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:55.367 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2023-11-04T01:34:55.765 DEBUG:teuthology.parallel:result is None 2023-11-04T01:34:55.766 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:34:55.920 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-04T01:34:55.942 INFO:teuthology.orchestra.run.smithi044.stdout:18.0.0-7035.g7532011a.el9 2023-11-04T01:34:55.942 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7035.g7532011a.el9 2023-11-04T01:34:55.942 INFO:teuthology.task.install:The correct ceph version 18.0.0-7035.g7532011a is installed. 2023-11-04T01:34:55.943 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:34:56.094 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-04T01:34:56.122 INFO:teuthology.orchestra.run.smithi204.stdout:18.0.0-7035.g7532011a.el9 2023-11-04T01:34:56.123 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7035.g7532011a.el9 2023-11-04T01:34:56.123 INFO:teuthology.task.install:The correct ceph version 18.0.0-7035.g7532011a is installed. 2023-11-04T01:34:56.123 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-04T01:34:56.123 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:34:56.123 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-04T01:34:56.157 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:34:56.157 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-04T01:34:56.198 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-04T01:34:56.198 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:34:56.198 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2023-11-04T01:34:56.228 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-04T01:34:56.299 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:34:56.299 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/daemon-helper 2023-11-04T01:34:56.331 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-04T01:34:56.402 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-04T01:34:56.402 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:34:56.402 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-04T01:34:56.433 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-04T01:34:56.506 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:34:56.506 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-04T01:34:56.539 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-04T01:34:56.609 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-04T01:34:56.609 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:34:56.609 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2023-11-04T01:34:56.640 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-04T01:34:56.710 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:34:56.710 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/stdin-killer 2023-11-04T01:34:56.743 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-04T01:34:56.812 INFO:teuthology.run_tasks:Running task ceph... 2023-11-04T01:34:57.007 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-04T01:34:57.008 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /var/log/ceph 2023-11-04T01:34:57.017 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 777 /var/log/ceph 2023-11-04T01:34:57.047 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-04T01:34:57.047 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-04T01:34:57.087 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-04T01:34:57.118 INFO:tasks.ceph:Creating extra log directories... 2023-11-04T01:34:57.118 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-04T01:34:57.163 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-04T01:34:57.198 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-04T01:34:57.198 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-04T01:34:57.198 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-04T01:34:57.198 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:34:57.199 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-04T01:34:57.247 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-04T01:34:57.378 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-04T01:34:57.408 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:34:57.408 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-04T01:34:57.423 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-04T01:34:57.544 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-04T01:34:57.579 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-04T01:34:57.579 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-04T01:34:57.579 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916', 'branch': 'main', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7445916', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'dry_run': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20231103.180916', 'sha1': '702f9e6492477037e018f68dfdf636a30c24f329'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 50, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7192, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-batrick-testing-20231103.180916', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '702f9e6492477037e018f68dfdf636a30c24f329', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi044.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEP33QRKjqYt3rrNPaSn8R1Cq5DyKr+PhsocEzo4pZCAFLmg81RuMKOIgR7Q8+Ly7GV2/8n/Jo8rX3wsPso1O5I=', 'smithi204.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHbhy4KKYMDYVBb7sgkkvLdo1Ohw4vrv9EjCqGxg3XekYNRc70VsELiS7DRbS8pG7vm7tnfJQ5TqKesrAH4rWUM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'exec': {'mon.a': ['ceph config set mgr mgr/crash/warn_recent_interval 0']}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_snapshots']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-03_18:12:33', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822'} 2023-11-04T01:34:57.580 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-04T01:34:57.582 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-04T01:34:57.633 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/run/ceph 2023-11-04T01:34:57.639 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/run/ceph 2023-11-04T01:34:57.707 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:34:57.707 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2023-11-04T01:34:57.729 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-04T01:34:57.729 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2023-11-04T01:34:57.784 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-04T01:34:57.784 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:57.784 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 664 Links: 1 2023-11-04T01:34:57.784 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:57.784 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:57.784 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2023-11-04 01:34:48.713595373 +0000 2023-11-04T01:34:57.784 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2023-11-04 01:32:16.208114253 +0000 2023-11-04T01:34:57.784 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2023-11-04 01:32:16.208114253 +0000 2023-11-04T01:34:57.785 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2023-11-04 01:32:16.208114253 +0000 2023-11-04T01:34:57.785 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-04T01:34:57.853 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2023-11-04T01:34:57.853 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2023-11-04T01:34:57.853 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.0002642 s, 1.9 MB/s 2023-11-04T01:34:57.854 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-04T01:34:57.911 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2023-11-04T01:34:57.967 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-04T01:34:57.967 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:57.967 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-11-04T01:34:57.967 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:57.968 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:57.968 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2023-11-04 01:34:48.713595373 +0000 2023-11-04T01:34:57.968 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2023-11-04 01:32:17.415097155 +0000 2023-11-04T01:34:57.968 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2023-11-04 01:32:17.415097155 +0000 2023-11-04T01:34:57.968 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2023-11-04 01:32:17.415097155 +0000 2023-11-04T01:34:57.968 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-04T01:34:58.043 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2023-11-04T01:34:58.043 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2023-11-04T01:34:58.043 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000178567 s, 2.9 MB/s 2023-11-04T01:34:58.043 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-04T01:34:58.102 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2023-11-04T01:34:58.157 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-04T01:34:58.157 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:58.157 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 701 Links: 1 2023-11-04T01:34:58.157 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:58.157 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:58.158 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2023-11-04 01:34:48.713595373 +0000 2023-11-04T01:34:58.158 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2023-11-04 01:32:18.575080727 +0000 2023-11-04T01:34:58.158 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2023-11-04 01:32:18.575080727 +0000 2023-11-04T01:34:58.158 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2023-11-04 01:32:18.575080727 +0000 2023-11-04T01:34:58.158 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-04T01:34:58.229 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2023-11-04T01:34:58.229 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2023-11-04T01:34:58.229 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.00020089 s, 2.5 MB/s 2023-11-04T01:34:58.229 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-04T01:34:58.286 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2023-11-04T01:34:58.346 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-04T01:34:58.346 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:58.346 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 720 Links: 1 2023-11-04T01:34:58.347 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:58.347 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:58.347 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2023-11-04 01:34:48.714595359 +0000 2023-11-04T01:34:58.347 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2023-11-04 01:32:19.682065049 +0000 2023-11-04T01:34:58.347 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2023-11-04 01:32:19.682065049 +0000 2023-11-04T01:34:58.347 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2023-11-04 01:32:19.682065049 +0000 2023-11-04T01:34:58.347 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-04T01:34:58.417 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2023-11-04T01:34:58.417 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2023-11-04T01:34:58.418 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000217704 s, 2.4 MB/s 2023-11-04T01:34:58.418 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-04T01:34:58.478 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:34:58.478 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:34:58.478 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/scratch_devs of=/dev/stdout 2023-11-04T01:34:58.495 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-04T01:34:58.495 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_1 2023-11-04T01:34:58.554 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-04T01:34:58.554 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:58.554 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-11-04T01:34:58.555 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:58.555 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:58.555 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2023-11-04 01:34:35.020556678 +0000 2023-11-04T01:34:58.555 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2023-11-04 01:32:06.437725151 +0000 2023-11-04T01:34:58.555 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2023-11-04 01:32:06.437725151 +0000 2023-11-04T01:34:58.555 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2023-11-04 01:32:06.437725151 +0000 2023-11-04T01:34:58.555 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-04T01:34:58.622 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2023-11-04T01:34:58.622 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2023-11-04T01:34:58.622 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.00019854 s, 2.6 MB/s 2023-11-04T01:34:58.623 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-04T01:34:58.680 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_2 2023-11-04T01:34:58.736 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-04T01:34:58.736 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:58.736 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-11-04T01:34:58.736 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:58.736 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:58.736 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2023-11-04 01:34:35.021556665 +0000 2023-11-04T01:34:58.736 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2023-11-04 01:32:07.437712070 +0000 2023-11-04T01:34:58.736 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2023-11-04 01:32:07.437712070 +0000 2023-11-04T01:34:58.737 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2023-11-04 01:32:07.437712070 +0000 2023-11-04T01:34:58.737 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-04T01:34:58.802 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2023-11-04T01:34:58.802 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2023-11-04T01:34:58.802 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000192057 s, 2.7 MB/s 2023-11-04T01:34:58.803 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-04T01:34:58.859 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_3 2023-11-04T01:34:58.916 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-04T01:34:58.917 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:58.917 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-11-04T01:34:58.917 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:58.917 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:58.917 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2023-11-04 01:34:35.021556665 +0000 2023-11-04T01:34:58.917 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2023-11-04 01:32:08.690695686 +0000 2023-11-04T01:34:58.917 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2023-11-04 01:32:08.690695686 +0000 2023-11-04T01:34:58.917 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2023-11-04 01:32:08.690695686 +0000 2023-11-04T01:34:58.917 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-04T01:34:58.992 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2023-11-04T01:34:58.992 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2023-11-04T01:34:58.992 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000181086 s, 2.8 MB/s 2023-11-04T01:34:58.992 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-04T01:34:59.047 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_4 2023-11-04T01:34:59.103 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-04T01:34:59.103 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:59.103 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-11-04T01:34:59.103 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:59.103 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:59.103 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2023-11-04 01:34:35.022556652 +0000 2023-11-04T01:34:59.103 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2023-11-04 01:32:09.832680744 +0000 2023-11-04T01:34:59.103 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2023-11-04 01:32:09.832680744 +0000 2023-11-04T01:34:59.104 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2023-11-04 01:32:09.832680744 +0000 2023-11-04T01:34:59.104 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-04T01:34:59.171 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2023-11-04T01:34:59.172 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2023-11-04T01:34:59.172 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000217996 s, 2.3 MB/s 2023-11-04T01:34:59.173 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-04T01:34:59.229 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:34:59.229 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-04T01:34:59.229 INFO:tasks.ceph:Generating config... 2023-11-04T01:34:59.230 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-04T01:34:59.230 INFO:tasks.ceph:[client] debug client = 20 2023-11-04T01:34:59.230 INFO:tasks.ceph:[client] debug ms = 1 2023-11-04T01:34:59.230 INFO:tasks.ceph:[client] pid file = 2023-11-04T01:34:59.231 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-04T01:34:59.231 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-04T01:34:59.231 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-04T01:34:59.231 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-04T01:34:59.231 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-04T01:34:59.231 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-04T01:34:59.231 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-04T01:34:59.231 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-04T01:34:59.231 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-04T01:34:59.231 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-04T01:34:59.231 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-04T01:34:59.231 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-04T01:34:59.231 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-04T01:34:59.232 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-04T01:34:59.232 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-04T01:34:59.232 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-04T01:34:59.232 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-04T01:34:59.232 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-04T01:34:59.232 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-04T01:34:59.232 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-04T01:34:59.232 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-04T01:34:59.232 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-04T01:34:59.232 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-04T01:34:59.232 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-04T01:34:59.232 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-04T01:34:59.232 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-04T01:34:59.233 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-04T01:34:59.233 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-04T01:34:59.233 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-04T01:34:59.233 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-04T01:34:59.233 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-04T01:34:59.233 INFO:tasks.ceph:Setting up mon.a... 2023-11-04T01:34:59.233 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-04T01:34:59.295 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.keyring 2023-11-04T01:34:59.298 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-04T01:34:59.349 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:34:59.424 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.44'), ('mon.b', '172.21.15.204'), ('mon.c', '[v2:172.21.15.204:3301,v1:172.21.15.204:6790]')] 2023-11-04T01:34:59.424 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.44,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-04T01:34:59.425 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:34:59.425 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-04T01:34:59.480 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.44 --add b 172.21.15.204 --addv c '[v2:172.21.15.204:3301,v1:172.21.15.204:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:34:59.569 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:34:59.569 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: generated fsid 2b7a45c6-da06-445f-a890-41d4c08fab63 2023-11-04T01:34:59.569 INFO:teuthology.orchestra.run.smithi044.stdout:setting min_mon_release = pacific 2023-11-04T01:34:59.569 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 0 2023-11-04T01:34:59.569 INFO:teuthology.orchestra.run.smithi044.stdout:fsid 2b7a45c6-da06-445f-a890-41d4c08fab63 2023-11-04T01:34:59.569 INFO:teuthology.orchestra.run.smithi044.stdout:last_changed 2023-11-04T01:34:59.568307+0000 2023-11-04T01:34:59.569 INFO:teuthology.orchestra.run.smithi044.stdout:created 2023-11-04T01:34:59.568307+0000 2023-11-04T01:34:59.569 INFO:teuthology.orchestra.run.smithi044.stdout:min_mon_release 16 (pacific) 2023-11-04T01:34:59.570 INFO:teuthology.orchestra.run.smithi044.stdout:election_strategy: 1 2023-11-04T01:34:59.570 INFO:teuthology.orchestra.run.smithi044.stdout:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2023-11-04T01:34:59.570 INFO:teuthology.orchestra.run.smithi044.stdout:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2023-11-04T01:34:59.570 INFO:teuthology.orchestra.run.smithi044.stdout:2: [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] mon.c 2023-11-04T01:34:59.570 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-04T01:34:59.571 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-04T01:34:59.595 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2b7a45c6-da06-445f-a890-41d4c08fab63... 2023-11-04T01:34:59.596 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:34:59.639 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:34:59.691 INFO:teuthology.orchestra.run.smithi204.stdout:[global] 2023-11-04T01:34:59.691 INFO:teuthology.orchestra.run.smithi204.stdout: chdir = "" 2023-11-04T01:34:59.691 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:34:59.691 INFO:teuthology.orchestra.run.smithi204.stdout: auth supported = cephx 2023-11-04T01:34:59.692 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.692 INFO:teuthology.orchestra.run.smithi204.stdout: filestore xattr use omap = true 2023-11-04T01:34:59.692 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.692 INFO:teuthology.orchestra.run.smithi204.stdout: mon clock drift allowed = 1.000 2023-11-04T01:34:59.692 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.692 INFO:teuthology.orchestra.run.smithi204.stdout: osd crush chooseleaf type = 0 2023-11-04T01:34:59.692 INFO:teuthology.orchestra.run.smithi204.stdout: auth debug = true 2023-11-04T01:34:59.692 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.692 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on old message = true 2023-11-04T01:34:59.692 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on bug = true 2023-11-04T01:34:59.692 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.693 INFO:teuthology.orchestra.run.smithi204.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:34:59.693 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn max object skew = 0 2023-11-04T01:34:59.693 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.693 INFO:teuthology.orchestra.run.smithi204.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:34:59.693 INFO:teuthology.orchestra.run.smithi204.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:34:59.693 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.693 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default size = 2 2023-11-04T01:34:59.693 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.693 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow primary affinity = true 2023-11-04T01:34:59.693 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow pg remap = true 2023-11-04T01:34:59.693 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:34:59.693 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:34:59.694 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on no sortbitwise = false 2023-11-04T01:34:59.694 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:34:59.694 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on too few osds = false 2023-11-04T01:34:59.694 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:34:59.694 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:34:59.694 INFO:teuthology.orchestra.run.smithi204.stdout: mon_allow_pool_size_one = true 2023-11-04T01:34:59.694 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.694 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:34:59.694 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.694 INFO:teuthology.orchestra.run.smithi204.stdout: osd default data pool replay window = 5 2023-11-04T01:34:59.694 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.694 INFO:teuthology.orchestra.run.smithi204.stdout: mon allow pool delete = true 2023-11-04T01:34:59.695 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.695 INFO:teuthology.orchestra.run.smithi204.stdout: mon cluster log file level = debug 2023-11-04T01:34:59.695 INFO:teuthology.orchestra.run.smithi204.stdout: debug asserts on shutdown = true 2023-11-04T01:34:59.695 INFO:teuthology.orchestra.run.smithi204.stdout: mon health detail to clog = false 2023-11-04T01:34:59.695 INFO:teuthology.orchestra.run.smithi204.stdout: mon host = "172.21.15.44,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]" 2023-11-04T01:34:59.695 INFO:teuthology.orchestra.run.smithi204.stdout: fsid = 2b7a45c6-da06-445f-a890-41d4c08fab63 2023-11-04T01:34:59.695 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.695 INFO:teuthology.orchestra.run.smithi204.stdout:[osd] 2023-11-04T01:34:59.695 INFO:teuthology.orchestra.run.smithi204.stdout: osd journal size = 100 2023-11-04T01:34:59.695 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.695 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub load threshold = 5.0 2023-11-04T01:34:59.695 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub max interval = 600 2023-11-04T01:34:59.695 INFO:teuthology.orchestra.run.smithi204.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:34:59.696 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.696 INFO:teuthology.orchestra.run.smithi204.stdout: osd recover clone overlap = true 2023-11-04T01:34:59.696 INFO:teuthology.orchestra.run.smithi204.stdout: osd recovery max chunk = 1048576 2023-11-04T01:34:59.696 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.696 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug shutdown = true 2023-11-04T01:34:59.696 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug op order = true 2023-11-04T01:34:59.696 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify stray on activate = true 2023-11-04T01:34:59.696 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug trim objects = true 2023-11-04T01:34:59.696 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.696 INFO:teuthology.orchestra.run.smithi204.stdout: osd open classes on start = true 2023-11-04T01:34:59.696 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug pg log writeout = true 2023-11-04T01:34:59.696 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.697 INFO:teuthology.orchestra.run.smithi204.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:34:59.697 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.697 INFO:teuthology.orchestra.run.smithi204.stdout: osd map max advance = 10 2023-11-04T01:34:59.697 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.697 INFO:teuthology.orchestra.run.smithi204.stdout: journal zero on create = true 2023-11-04T01:34:59.697 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.697 INFO:teuthology.orchestra.run.smithi204.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:34:59.697 INFO:teuthology.orchestra.run.smithi204.stdout: filestore apply finisher threads = 3 2023-11-04T01:34:59.697 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.697 INFO:teuthology.orchestra.run.smithi204.stdout: bdev debug aio = true 2023-11-04T01:34:59.697 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug misdirected ops = true 2023-11-04T01:34:59.698 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore block size = 96636764160 2023-11-04T01:34:59.698 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore fsck on mount = True 2023-11-04T01:34:59.698 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluefs = 20 2023-11-04T01:34:59.698 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluestore = 20 2023-11-04T01:34:59.703 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2023-11-04T01:34:59.703 INFO:teuthology.orchestra.run.smithi204.stdout: debug osd = 20 2023-11-04T01:34:59.704 INFO:teuthology.orchestra.run.smithi204.stdout: debug rocksdb = 10 2023-11-04T01:34:59.704 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:34:59.704 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd full ratio = 0.9 2023-11-04T01:34:59.704 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:34:59.704 INFO:teuthology.orchestra.run.smithi204.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:34:59.704 INFO:teuthology.orchestra.run.smithi204.stdout: osd objectstore = bluestore 2023-11-04T01:34:59.704 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2023-11-04T01:34:59.704 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.705 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr] 2023-11-04T01:34:59.705 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2023-11-04T01:34:59.712 INFO:teuthology.orchestra.run.smithi204.stdout: debug mgr = 20 2023-11-04T01:34:59.712 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2023-11-04T01:34:59.713 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2023-11-04T01:34:59.713 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:34:59.713 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:34:59.713 INFO:teuthology.orchestra.run.smithi204.stdout: mgr/telemetry/nag = false 2023-11-04T01:34:59.713 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.713 INFO:teuthology.orchestra.run.smithi204.stdout:[mon] 2023-11-04T01:34:59.713 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2023-11-04T01:34:59.714 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2023-11-04T01:34:59.714 INFO:teuthology.orchestra.run.smithi204.stdout: debug paxos = 20 2023-11-04T01:34:59.714 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2023-11-04T01:34:59.714 INFO:teuthology.orchestra.run.smithi204.stdout: mon data avail warn = 5 2023-11-04T01:34:59.714 INFO:teuthology.orchestra.run.smithi204.stdout: mon mgr mkfs grace = 240 2023-11-04T01:34:59.714 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:34:59.714 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd reporter subtree level = osd 2023-11-04T01:34:59.714 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd prime pg temp = true 2023-11-04T01:34:59.714 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:34:59.714 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.715 INFO:teuthology.orchestra.run.smithi204.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:34:59.715 INFO:teuthology.orchestra.run.smithi204.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:34:59.715 INFO:teuthology.orchestra.run.smithi204.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:34:59.715 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.715 INFO:teuthology.orchestra.run.smithi204.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:34:59.715 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:34:59.715 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:34:59.715 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.715 INFO:teuthology.orchestra.run.smithi204.stdout: # 1m isn't quite enough 2023-11-04T01:34:59.715 INFO:teuthology.orchestra.run.smithi204.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:34:59.715 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.715 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:34:59.715 INFO:teuthology.orchestra.run.smithi204.stdout: mon op complaint time = 120 2023-11-04T01:34:59.716 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:34:59.716 INFO:teuthology.orchestra.run.smithi204.stdout:[client] 2023-11-04T01:34:59.716 INFO:teuthology.orchestra.run.smithi204.stdout: rgw cache enabled = true 2023-11-04T01:34:59.716 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable ops log = true 2023-11-04T01:34:59.716 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable usage log = true 2023-11-04T01:34:59.716 INFO:teuthology.orchestra.run.smithi204.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:34:59.716 INFO:teuthology.orchestra.run.smithi204.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:34:59.716 INFO:teuthology.orchestra.run.smithi204.stdout: client mount timeout = 600 2023-11-04T01:34:59.716 INFO:teuthology.orchestra.run.smithi204.stdout: debug client = 20 2023-11-04T01:34:59.716 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2023-11-04T01:34:59.716 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = "" 2023-11-04T01:34:59.716 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2023-11-04T01:34:59.717 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2023-11-04T01:34:59.717 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.a] 2023-11-04T01:34:59.717 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.b] 2023-11-04T01:34:59.717 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.c] 2023-11-04T01:34:59.717 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2023-11-04T01:34:59.717 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2023-11-04T01:34:59.717 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2023-11-04T01:34:59.717 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.d] 2023-11-04T01:34:59.718 INFO:teuthology.orchestra.run.smithi204.stdout:[mds] 2023-11-04T01:34:59.718 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds = 20 2023-11-04T01:34:59.718 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds balancer = 20 2023-11-04T01:34:59.718 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2023-11-04T01:34:59.718 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug frag = True 2023-11-04T01:34:59.718 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug scatterstat = True 2023-11-04T01:34:59.718 INFO:teuthology.orchestra.run.smithi204.stdout: mds op complaint time = 180 2023-11-04T01:34:59.718 INFO:teuthology.orchestra.run.smithi204.stdout: mds verify scatter = True 2023-11-04T01:34:59.718 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2023-11-04T01:34:59.718 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2023-11-04T01:34:59.718 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2023-11-04T01:34:59.720 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2023-11-04T01:34:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2023-11-04T01:34:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:34:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2023-11-04T01:34:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2023-11-04T01:34:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2023-11-04T01:34:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2023-11-04T01:34:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2023-11-04T01:34:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2023-11-04T01:34:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2023-11-04T01:34:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:34:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2023-11-04T01:34:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:34:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:34:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2023-11-04T01:34:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2023-11-04T01:34:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2023-11-04T01:34:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:34:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:34:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2023-11-04T01:34:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:34:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2023-11-04T01:34:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:34:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:34:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2023-11-04T01:34:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:34:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2023-11-04T01:34:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2023-11-04T01:34:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2023-11-04T01:34:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2023-11-04T01:34:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2023-11-04T01:34:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.44,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]" 2023-11-04T01:34:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 2b7a45c6-da06-445f-a890-41d4c08fab63 2023-11-04T01:34:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.724 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2023-11-04T01:34:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2023-11-04T01:34:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2023-11-04T01:34:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2023-11-04T01:34:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:34:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2023-11-04T01:34:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2023-11-04T01:34:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2023-11-04T01:34:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2023-11-04T01:34:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2023-11-04T01:34:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug trim objects = true 2023-11-04T01:34:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2023-11-04T01:34:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2023-11-04T01:34:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:34:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2023-11-04T01:34:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2023-11-04T01:34:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:34:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2023-11-04T01:34:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2023-11-04T01:34:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2023-11-04T01:34:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2023-11-04T01:34:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2023-11-04T01:34:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 20 2023-11-04T01:34:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 20 2023-11-04T01:34:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-11-04T01:34:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2023-11-04T01:34:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 10 2023-11-04T01:34:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:34:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2023-11-04T01:34:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:34:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:34:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2023-11-04T01:34:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: osd op complaint time = 180 2023-11-04T01:34:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.729 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2023-11-04T01:34:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-11-04T01:34:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2023-11-04T01:34:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2023-11-04T01:34:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2023-11-04T01:34:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:34:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:34:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2023-11-04T01:34:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.730 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2023-11-04T01:34:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-11-04T01:34:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2023-11-04T01:34:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2023-11-04T01:34:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2023-11-04T01:34:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2023-11-04T01:34:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2023-11-04T01:34:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:34:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2023-11-04T01:34:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2023-11-04T01:34:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:34:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:34:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:34:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:34:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:34:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:34:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:34:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2023-11-04T01:34:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:34:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:34:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: mon op complaint time = 120 2023-11-04T01:34:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:34:59.732 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2023-11-04T01:34:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2023-11-04T01:34:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2023-11-04T01:34:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2023-11-04T01:34:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:34:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:34:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: client mount timeout = 600 2023-11-04T01:34:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: debug client = 20 2023-11-04T01:34:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-11-04T01:34:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = "" 2023-11-04T01:34:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: rados mon op timeout = 900 2023-11-04T01:34:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: rados osd op timeout = 900 2023-11-04T01:34:59.733 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2023-11-04T01:34:59.733 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2023-11-04T01:34:59.734 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2023-11-04T01:34:59.734 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2023-11-04T01:34:59.734 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2023-11-04T01:34:59.734 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2023-11-04T01:34:59.734 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2023-11-04T01:34:59.734 INFO:teuthology.orchestra.run.smithi044.stdout:[mds] 2023-11-04T01:34:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: debug mds = 20 2023-11-04T01:34:59.744 INFO:teuthology.orchestra.run.smithi044.stdout: debug mds balancer = 20 2023-11-04T01:34:59.744 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-11-04T01:34:59.744 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug frag = True 2023-11-04T01:34:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug scatterstat = True 2023-11-04T01:34:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: mds op complaint time = 180 2023-11-04T01:34:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: mds verify scatter = True 2023-11-04T01:34:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: osd op complaint time = 180 2023-11-04T01:34:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: rados mon op timeout = 900 2023-11-04T01:34:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: rados osd op timeout = 900 2023-11-04T01:34:59.745 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-04T01:34:59.745 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-04T01:34:59.813 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-04T01:34:59.813 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:34:59.813 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-04T01:34:59.828 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:34:59.828 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-04T01:34:59.883 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:34:59.883 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:34:59.883 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-04T01:34:59.883 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:34:59.970 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:34:59.970 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:00.028 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:35:00.028 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:35:00.028 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-04T01:35:00.028 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:35:00.067 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:35:00.068 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:00.123 INFO:tasks.ceph:Setting up mon nodes... 2023-11-04T01:35:00.123 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-04T01:35:00.123 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-04T01:35:00.187 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-04T01:35:00.194 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-04T01:35:00.257 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-04T01:35:00.260 INFO:tasks.ceph:Setting up mds nodes... 2023-11-04T01:35:00.260 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-04T01:35:00.323 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-04T01:35:00.325 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-04T01:35:00.355 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-04T01:35:00.461 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-04T01:35:00.462 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-04T01:35:00.500 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-04T01:35:00.556 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-04T01:35:00.559 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-04T01:35:00.585 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-04T01:35:00.684 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-04T01:35:00.684 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-04T01:35:00.712 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-04T01:35:00.712 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-04T01:35:00.758 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-04T01:35:00.777 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-04T01:35:00.822 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-04T01:35:00.840 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-04T01:35:00.882 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-04T01:35:00.897 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-04T01:35:00.979 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-04T01:35:00.993 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-04T01:35:00.993 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-04T01:35:00.993 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-04T01:35:01.027 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:01.027 INFO:tasks.ceph:role: osd.0 2023-11-04T01:35:01.027 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:35:01.027 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-04T01:35:01.106 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:01.106 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:01.107 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:01.107 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:01.107 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:01.607 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2023-11-04T01:35:01.609 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2023-11-04T01:35:01.609 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-04T01:35:01.765 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-04T01:35:01.803 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-04T01:35:01.875 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:01.876 INFO:tasks.ceph:role: osd.1 2023-11-04T01:35:01.876 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:35:01.876 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-04T01:35:01.953 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:01.954 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:01.954 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:01.954 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:01.954 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:01.954 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:01.954 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:01.954 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:01.954 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:01.954 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:02.405 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2023-11-04T01:35:02.409 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2023-11-04T01:35:02.409 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-04T01:35:02.523 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-04T01:35:02.559 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-04T01:35:02.635 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:02.635 INFO:tasks.ceph:role: osd.2 2023-11-04T01:35:02.635 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:35:02.636 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-04T01:35:02.716 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:02.716 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:02.716 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:02.716 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:02.716 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:03.212 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2023-11-04T01:35:03.213 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2023-11-04T01:35:03.213 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-04T01:35:03.385 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-04T01:35:03.430 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-04T01:35:03.503 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:03.503 INFO:tasks.ceph:role: osd.3 2023-11-04T01:35:03.504 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:35:03.504 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-04T01:35:03.584 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:03.584 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:03.584 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:03.584 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:03.584 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:03.584 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:03.584 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:03.584 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:03.584 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:03.585 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:04.092 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2023-11-04T01:35:04.093 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2023-11-04T01:35:04.093 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-04T01:35:04.187 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-04T01:35:04.225 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:04.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:04.325+0000 7fa27e405500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-04T01:35:04.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:04.325+0000 7fa27e405500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-04T01:35:04.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:04.325+0000 7fa27e405500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:35:04.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:04.325+0000 7fa27e405500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:35:04.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:04.325+0000 7fa27e405500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:35:04.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:04.326+0000 7fa27e405500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-04T01:35:07.203 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-04T01:35:07.240 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:07.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:07.332+0000 7fadb9a23500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-04T01:35:07.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:07.332+0000 7fadb9a23500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-04T01:35:07.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:07.332+0000 7fadb9a23500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:35:07.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:07.332+0000 7fadb9a23500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:35:07.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:07.332+0000 7fadb9a23500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:35:07.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:07.333+0000 7fadb9a23500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-04T01:35:10.183 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-04T01:35:10.219 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:10.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:10.313+0000 7fd27e812500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-04T01:35:10.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:10.313+0000 7fd27e812500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-04T01:35:10.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:10.313+0000 7fd27e812500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:35:10.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:10.313+0000 7fd27e812500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:35:10.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:10.313+0000 7fd27e812500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:35:10.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:10.314+0000 7fd27e812500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-04T01:35:13.174 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-04T01:35:13.215 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:13.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:13.312+0000 7fd586c14500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-04T01:35:13.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:13.313+0000 7fd586c14500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-04T01:35:13.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:13.313+0000 7fd586c14500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:35:13.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:13.313+0000 7fd586c14500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:35:13.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:13.313+0000 7fd586c14500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:35:13.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:13.313+0000 7fd586c14500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-04T01:35:16.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-04T01:35:16.213 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-04T01:35:16.246 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:16.246 INFO:tasks.ceph:role: osd.4 2023-11-04T01:35:16.246 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:35:16.246 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-04T01:35:16.324 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:16.324 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:16.324 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:16.324 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:16.324 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:16.325 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:16.325 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:16.325 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:16.325 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:16.325 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:16.834 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2023-11-04T01:35:16.836 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2023-11-04T01:35:16.836 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-04T01:35:16.964 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-04T01:35:17.002 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-04T01:35:17.072 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:17.072 INFO:tasks.ceph:role: osd.5 2023-11-04T01:35:17.072 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:35:17.072 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-04T01:35:17.148 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:17.148 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:17.149 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:17.149 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:17.149 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:17.149 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:17.149 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:17.149 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:17.149 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:17.149 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:17.592 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2023-11-04T01:35:17.594 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2023-11-04T01:35:17.594 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-04T01:35:17.685 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-04T01:35:17.718 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-04T01:35:17.786 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:17.787 INFO:tasks.ceph:role: osd.6 2023-11-04T01:35:17.787 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:35:17.787 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-04T01:35:17.865 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:17.865 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:17.865 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:17.865 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:17.865 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:17.865 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:17.865 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:17.865 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:17.866 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:17.866 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:18.349 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2023-11-04T01:35:18.352 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2023-11-04T01:35:18.352 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-04T01:35:18.496 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-04T01:35:18.529 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-04T01:35:18.599 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:18.600 INFO:tasks.ceph:role: osd.7 2023-11-04T01:35:18.600 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:35:18.600 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-04T01:35:18.673 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:18.673 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:18.674 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:18.674 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:18.674 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:18.674 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:18.674 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:18.674 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:18.674 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:18.674 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:19.189 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2023-11-04T01:35:19.192 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2023-11-04T01:35:19.192 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-04T01:35:19.323 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-04T01:35:19.358 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:19.459 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:19.452+0000 7fa855069500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-04T01:35:19.463 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:19.453+0000 7fa855069500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-04T01:35:19.463 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:19.453+0000 7fa855069500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:35:19.463 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:19.453+0000 7fa855069500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:35:19.463 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:19.453+0000 7fa855069500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:35:19.463 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:19.453+0000 7fa855069500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-04T01:35:22.314 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-04T01:35:22.345 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:22.436 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:22.434+0000 7fe3621e2500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-04T01:35:22.437 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:22.434+0000 7fe3621e2500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-04T01:35:22.437 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:22.434+0000 7fe3621e2500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:35:22.437 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:22.434+0000 7fe3621e2500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:35:22.437 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:22.434+0000 7fe3621e2500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:35:22.437 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:22.435+0000 7fe3621e2500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-04T01:35:25.282 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-04T01:35:25.314 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:25.410 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:25.406+0000 7fccd78ab500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-04T01:35:25.410 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:25.406+0000 7fccd78ab500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-04T01:35:25.410 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:25.406+0000 7fccd78ab500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:35:25.410 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:25.406+0000 7fccd78ab500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:35:25.410 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:25.406+0000 7fccd78ab500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:35:25.410 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:25.407+0000 7fccd78ab500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-04T01:35:27.581 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:35:27.589 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:35:28.267 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-04T01:35:28.299 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:28.391 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:28.389+0000 7fde1981d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-04T01:35:28.392 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:28.389+0000 7fde1981d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-04T01:35:28.392 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:28.389+0000 7fde1981d500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:35:28.392 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:28.389+0000 7fde1981d500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:35:28.392 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:28.389+0000 7fde1981d500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:35:28.392 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:28.390+0000 7fde1981d500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-04T01:35:31.242 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-04T01:35:31.273 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-04T01:35:31.274 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:35:31.274 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-04T01:35:31.310 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:35:31.310 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-04T01:35:31.383 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:35:31.384 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-04T01:35:31.456 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:35:31.456 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-04T01:35:31.529 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:35:31.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-04T01:35:31.600 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:35:31.600 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-04T01:35:31.670 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:35:31.670 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-04T01:35:31.743 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:35:31.743 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-04T01:35:31.775 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:35:31.775 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-04T01:35:31.845 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:35:31.845 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-04T01:35:31.914 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:35:31.915 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-04T01:35:31.984 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:35:31.984 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-04T01:35:32.053 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:35:32.054 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-04T01:35:32.123 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:35:32.123 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-04T01:35:32.191 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:35:32.191 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-04T01:35:32.207 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:35:32.208 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-04T01:35:32.264 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:35:32.264 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-04T01:35:32.279 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:35:32.280 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-04T01:35:32.335 INFO:tasks.ceph:Adding keys to all mons... 2023-11-04T01:35:32.335 DEBUG:teuthology.orchestra.run.smithi044:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-04T01:35:32.343 DEBUG:teuthology.orchestra.run.smithi204:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-04T01:35:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.y] 2023-11-04T01:35:32.378 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDEn0VlX+8eCxAAuBbLfpXHKHIIDc4zo9Insw== 2023-11-04T01:35:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2023-11-04T01:35:32.378 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDEn0Vldrw2ExAA5cS9IfcK2l8SXaZdWm4f8g== 2023-11-04T01:35:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2023-11-04T01:35:32.379 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDEn0VlDPc/GxAA32BghmM85xfJ14TjYFtNRw== 2023-11-04T01:35:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.0] 2023-11-04T01:35:32.379 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDIn0VlTfR3ExAAt6S9NmZfuM9CoPfVNGkhmA== 2023-11-04T01:35:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.1] 2023-11-04T01:35:32.379 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDLn0VlqkLfExAABN3cHR+cDXm0tN4tpWR+0w== 2023-11-04T01:35:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.2] 2023-11-04T01:35:32.379 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDOn0Vl9JO/EhAAuC0w9vFxOiRs7Tm3UZHVXg== 2023-11-04T01:35:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.3] 2023-11-04T01:35:32.379 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDRn0VlKSy2EhAAerLDC/nZsTK5KdG+Q1Ycow== 2023-11-04T01:35:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.x] 2023-11-04T01:35:32.379 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDEn0VlSeFMDxAAwW0lbfxAbIKPgPCkJD1FMg== 2023-11-04T01:35:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2023-11-04T01:35:32.380 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDEn0VlOogfIRAAYEw/sXZBXk/GJOrnBTA7xg== 2023-11-04T01:35:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2023-11-04T01:35:32.380 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDEn0VlYpOSKBAAVivyMFmzkREyWWFObAwKHw== 2023-11-04T01:35:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.4] 2023-11-04T01:35:32.380 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDXn0Vl9FINGxAA5lLkwH709SJ00yfxB6MCaw== 2023-11-04T01:35:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.5] 2023-11-04T01:35:32.380 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDan0Vlo5v3GRAA/ZGOqGFMxQuGirRMadC+9Q== 2023-11-04T01:35:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.6] 2023-11-04T01:35:32.380 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDdn0Vl+q9GGBAA7obGN4GMa7glnpuDSQKV2g== 2023-11-04T01:35:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.7] 2023-11-04T01:35:32.380 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDgn0VlbLVCFxAANjcDDYPfWCNGQF1twWc35w== 2023-11-04T01:35:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2023-11-04T01:35:32.381 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDEn0VlmqcrLRAAFCsu/sJUUh45gPboIgq6Dw== 2023-11-04T01:35:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:[client.2] 2023-11-04T01:35:32.381 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDEn0Vlcp71MBAAkYQz0CUf7LY9WIvX0mXzKg== 2023-11-04T01:35:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:[client.1] 2023-11-04T01:35:32.381 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDEn0VlSFWINBAAAvkXSoHilQ3GXBE61Tvx2w== 2023-11-04T01:35:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:[client.3] 2023-11-04T01:35:32.381 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDEn0Vl08lCOhAAQxQts3txc7gsu8txLGzouA== 2023-11-04T01:35:32.400 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.y] 2023-11-04T01:35:32.401 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDEn0VlX+8eCxAAuBbLfpXHKHIIDc4zo9Insw== 2023-11-04T01:35:32.401 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2023-11-04T01:35:32.401 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDEn0Vldrw2ExAA5cS9IfcK2l8SXaZdWm4f8g== 2023-11-04T01:35:32.401 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2023-11-04T01:35:32.401 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDEn0VlDPc/GxAA32BghmM85xfJ14TjYFtNRw== 2023-11-04T01:35:32.401 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.0] 2023-11-04T01:35:32.401 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDIn0VlTfR3ExAAt6S9NmZfuM9CoPfVNGkhmA== 2023-11-04T01:35:32.401 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.1] 2023-11-04T01:35:32.401 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDLn0VlqkLfExAABN3cHR+cDXm0tN4tpWR+0w== 2023-11-04T01:35:32.401 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.2] 2023-11-04T01:35:32.401 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDOn0Vl9JO/EhAAuC0w9vFxOiRs7Tm3UZHVXg== 2023-11-04T01:35:32.401 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.3] 2023-11-04T01:35:32.401 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDRn0VlKSy2EhAAerLDC/nZsTK5KdG+Q1Ycow== 2023-11-04T01:35:32.402 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.x] 2023-11-04T01:35:32.402 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDEn0VlSeFMDxAAwW0lbfxAbIKPgPCkJD1FMg== 2023-11-04T01:35:32.402 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2023-11-04T01:35:32.402 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDEn0VlOogfIRAAYEw/sXZBXk/GJOrnBTA7xg== 2023-11-04T01:35:32.402 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.d] 2023-11-04T01:35:32.402 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDEn0VlYpOSKBAAVivyMFmzkREyWWFObAwKHw== 2023-11-04T01:35:32.402 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.4] 2023-11-04T01:35:32.402 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDXn0Vl9FINGxAA5lLkwH709SJ00yfxB6MCaw== 2023-11-04T01:35:32.402 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.5] 2023-11-04T01:35:32.402 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDan0Vlo5v3GRAA/ZGOqGFMxQuGirRMadC+9Q== 2023-11-04T01:35:32.402 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.6] 2023-11-04T01:35:32.402 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDdn0Vl+q9GGBAA7obGN4GMa7glnpuDSQKV2g== 2023-11-04T01:35:32.403 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.7] 2023-11-04T01:35:32.403 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDgn0VlbLVCFxAANjcDDYPfWCNGQF1twWc35w== 2023-11-04T01:35:32.403 INFO:teuthology.orchestra.run.smithi204.stdout:[client.0] 2023-11-04T01:35:32.403 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDEn0VlmqcrLRAAFCsu/sJUUh45gPboIgq6Dw== 2023-11-04T01:35:32.403 INFO:teuthology.orchestra.run.smithi204.stdout:[client.2] 2023-11-04T01:35:32.403 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDEn0Vlcp71MBAAkYQz0CUf7LY9WIvX0mXzKg== 2023-11-04T01:35:32.403 INFO:teuthology.orchestra.run.smithi204.stdout:[client.1] 2023-11-04T01:35:32.403 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDEn0VlSFWINBAAAvkXSoHilQ3GXBE61Tvx2w== 2023-11-04T01:35:32.403 INFO:teuthology.orchestra.run.smithi204.stdout:[client.3] 2023-11-04T01:35:32.403 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDEn0Vl08lCOhAAQxQts3txc7gsu8txLGzouA== 2023-11-04T01:35:32.404 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:35:32.431 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:35:32.499 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:32.508 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:32.566 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:32.569 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:32.628 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:32.630 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:32.683 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:32.686 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:32.741 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:32.743 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:32.796 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:32.798 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:32.852 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:35:32.854 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:35:32.910 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:32.913 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:32.969 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:32.977 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:33.031 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:33.033 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:33.086 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:33.089 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:33.144 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:33.146 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:33.203 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:33.205 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:33.259 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:33.267 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:33.321 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:33.323 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:33.380 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:33.384 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:33.441 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:33.443 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:33.499 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-04T01:35:33.500 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-04T01:35:33.537 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:35:33.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-04T01:35:33.670 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-04T01:35:33.697 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:35:33.793 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-04T01:35:33.820 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-04T01:35:33.887 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:35:33.984 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-04T01:35:34.010 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:34.012 DEBUG:teuthology.orchestra.run.smithi204:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:34.064 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-04T01:35:34.065 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-04T01:35:34.065 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-04T01:35:34.068 INFO:tasks.ceph.mon.a:Started 2023-11-04T01:35:34.068 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-04T01:35:34.068 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-04T01:35:34.107 INFO:tasks.ceph.mon.b:Started 2023-11-04T01:35:34.107 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-04T01:35:34.107 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-04T01:35:34.109 INFO:tasks.ceph.mon.c:Started 2023-11-04T01:35:34.109 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-04T01:35:34.110 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-04T01:35:34.110 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-04T01:35:34.112 INFO:tasks.ceph.mgr.y:Started 2023-11-04T01:35:34.112 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-04T01:35:34.112 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-04T01:35:34.114 INFO:tasks.ceph.mgr.x:Started 2023-11-04T01:35:34.114 INFO:tasks.ceph:Setting crush tunables to default 2023-11-04T01:35:34.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd crush tunables default 2023-11-04T01:35:34.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.219+0000 7fa13b6ec640 1 Processor -- start 2023-11-04T01:35:34.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.220+0000 7fa13b6ec640 1 -- start start 2023-11-04T01:35:34.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.220+0000 7fa13b6ec640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa13415af20 0x7fa1340b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:34.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.220+0000 7fa13b6ec640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa1340b64c0 0x7fa1340cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:34.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.220+0000 7fa13b6ec640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1340d01f0 con 0x7fa1340cd3b0 2023-11-04T01:35:34.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.220+0000 7fa13b6ec640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1340b6a40 con 0x7fa1340b64c0 2023-11-04T01:35:34.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.220+0000 7fa13b6ec640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1340d04b0 con 0x7fa13415af20 2023-11-04T01:35:34.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.220+0000 7fa138c87640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa1340b64c0 0x7fa1340cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:34.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.220+0000 7fa138c87640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa1340b64c0 0x7fa1340cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46942/0 (socket says 172.21.15.44:46942) 2023-11-04T01:35:34.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.220+0000 7fa138c87640 1 -- 172.21.15.44:0/1470226139 learned_addr learned my addr 172.21.15.44:0/1470226139 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:34.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.221+0000 7fa138c87640 1 -- 172.21.15.44:0/1470226139 >> v2:172.21.15.44:3300/0 conn(0x7fa1340b64c0 msgr2=0x7fa1340cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:35:34.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.221+0000 7fa138c87640 1 -- 172.21.15.44:0/1470226139 >> v2:172.21.15.44:3300/0 conn(0x7fa1340b64c0 msgr2=0x7fa1340cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:35:34.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.221+0000 7fa138c87640 1 --2- 172.21.15.44:0/1470226139 >> v2:172.21.15.44:3300/0 conn(0x7fa1340b64c0 0x7fa1340cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:35:34.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.221+0000 7fa138c87640 1 --2- 172.21.15.44:0/1470226139 >> v2:172.21.15.44:3300/0 conn(0x7fa1340b64c0 0x7fa1340cbc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:35:34.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.221+0000 7fa139488640 1 --2- 172.21.15.44:0/1470226139 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa13415af20 0x7fa1340b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:34.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.221+0000 7fa139488640 1 -- 172.21.15.44:0/1470226139 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa13415af20 msgr2=0x7fa1340b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:35:34.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.221+0000 7fa139488640 1 -- 172.21.15.44:0/1470226139 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa13415af20 msgr2=0x7fa1340b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:35:34.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.221+0000 7fa139488640 1 --2- 172.21.15.44:0/1470226139 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa13415af20 0x7fa1340b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:35:34.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.221+0000 7fa139488640 1 --2- 172.21.15.44:0/1470226139 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa13415af20 0x7fa1340b3cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:35:34.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.422+0000 7fa138c87640 1 --2- 172.21.15.44:0/1470226139 >> v2:172.21.15.44:3300/0 conn(0x7fa1340b64c0 0x7fa1340cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:34.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.422+0000 7fa139488640 1 --2- 172.21.15.44:0/1470226139 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa13415af20 0x7fa1340b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:34.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.422+0000 7fa127fff640 1 -- 172.21.15.44:0/1470226139 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232108461 0 0) 0x7fa1340d01f0 con 0x7fa1340cd3b0 2023-11-04T01:35:34.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.422+0000 7fa127fff640 1 -- 172.21.15.44:0/1470226139 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa120003520 con 0x7fa1340cd3b0 2023-11-04T01:35:34.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.422+0000 7fa138c87640 1 -- 172.21.15.44:0/1470226139 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa13415af20 msgr2=0x7fa1340b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:34.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.422+0000 7fa138c87640 1 --2- 172.21.15.44:0/1470226139 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa13415af20 0x7fa1340b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:34.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.422+0000 7fa138c87640 1 -- 172.21.15.44:0/1470226139 >> v1:172.21.15.204:6789/0 conn(0x7fa1340cd3b0 legacy=0x7fa1340b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:34.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.422+0000 7fa138c87640 1 -- 172.21.15.44:0/1470226139 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1340d0790 con 0x7fa1340b64c0 2023-11-04T01:35:34.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.423+0000 7fa138c87640 1 --2- 172.21.15.44:0/1470226139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1340b64c0 0x7fa1340cbc70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa130009100 tx=0x7fa13002bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc44fa7fb823bde7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:34.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.425+0000 7fa127fff640 1 -- 172.21.15.44:0/1470226139 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13002ca90 con 0x7fa1340b64c0 2023-11-04T01:35:34.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.425+0000 7fa127fff640 1 -- 172.21.15.44:0/1470226139 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13002cbf0 con 0x7fa1340b64c0 2023-11-04T01:35:34.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.425+0000 7fa127fff640 1 -- 172.21.15.44:0/1470226139 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130034440 con 0x7fa1340b64c0 2023-11-04T01:35:34.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.425+0000 7fa13b6ec640 1 -- 172.21.15.44:0/1470226139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1340b64c0 msgr2=0x7fa1340cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:34.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.425+0000 7fa13b6ec640 1 --2- 172.21.15.44:0/1470226139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1340b64c0 0x7fa1340cbc70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa130009100 tx=0x7fa13002bce0 comp rx=0 tx=0).stop 2023-11-04T01:35:34.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.426+0000 7fa13b6ec640 1 -- 172.21.15.44:0/1470226139 shutdown_connections 2023-11-04T01:35:34.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.426+0000 7fa13b6ec640 1 --2- 172.21.15.44:0/1470226139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1340b64c0 0x7fa1340cbc70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:34.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.426+0000 7fa13b6ec640 1 --2- 172.21.15.44:0/1470226139 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa13415af20 0x7fa1340b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:34.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.426+0000 7fa13b6ec640 1 -- 172.21.15.44:0/1470226139 >> 172.21.15.44:0/1470226139 conn(0x7fa13406ea20 msgr2=0x7fa13406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:34.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.426+0000 7fa13b6ec640 1 -- 172.21.15.44:0/1470226139 shutdown_connections 2023-11-04T01:35:34.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.426+0000 7fa13b6ec640 1 -- 172.21.15.44:0/1470226139 wait complete. 2023-11-04T01:35:34.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.427+0000 7fa13b6ec640 1 Processor -- start 2023-11-04T01:35:34.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.427+0000 7fa13b6ec640 1 -- start start 2023-11-04T01:35:34.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.428+0000 7fa13b6ec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1340b64c0 0x7fa1341eda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:34.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.428+0000 7fa13b6ec640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1340cd3b0 0x7fa1341f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:34.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.428+0000 7fa13b6ec640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa13415af20 0x7fa1341f04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:34.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.428+0000 7fa13b6ec640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1341f14c0 con 0x7fa1340b64c0 2023-11-04T01:35:34.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.428+0000 7fa13b6ec640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1341f49c0 con 0x7fa13415af20 2023-11-04T01:35:34.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.428+0000 7fa139488640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1340b64c0 0x7fa1341eda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:34.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.428+0000 7fa13b6ec640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1341f0f00 con 0x7fa1340cd3b0 2023-11-04T01:35:34.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.428+0000 7fa139488640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1340b64c0 0x7fa1341eda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46982/0 (socket says 172.21.15.44:46982) 2023-11-04T01:35:34.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.428+0000 7fa139488640 1 -- 172.21.15.44:0/2415006162 learned_addr learned my addr 172.21.15.44:0/2415006162 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:34.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.428+0000 7fa138c87640 1 --2- 172.21.15.44:0/2415006162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1340cd3b0 0x7fa1341f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:34.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.428+0000 7fa139c89640 1 --2- 172.21.15.44:0/2415006162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa13415af20 0x7fa1341f04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:34.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.429+0000 7fa139488640 1 -- 172.21.15.44:0/2415006162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1340cd3b0 msgr2=0x7fa1341f4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:34.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.429+0000 7fa139488640 1 --2- 172.21.15.44:0/2415006162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1340cd3b0 0x7fa1341f4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:34.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.429+0000 7fa139488640 1 -- 172.21.15.44:0/2415006162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa13415af20 msgr2=0x7fa1341f04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:34.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.429+0000 7fa139488640 1 --2- 172.21.15.44:0/2415006162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa13415af20 0x7fa1341f04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:34.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.429+0000 7fa139488640 1 -- 172.21.15.44:0/2415006162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1300095b0 con 0x7fa1340b64c0 2023-11-04T01:35:34.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.429+0000 7fa138c87640 1 --2- 172.21.15.44:0/2415006162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1340cd3b0 0x7fa1341f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:34.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.429+0000 7fa139488640 1 --2- 172.21.15.44:0/2415006162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1340b64c0 0x7fa1341eda40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa12800b6b0 tx=0x7fa12800bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:34.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.429+0000 7fa125ffb640 1 -- 172.21.15.44:0/2415006162 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128010830 con 0x7fa1340b64c0 2023-11-04T01:35:34.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.429+0000 7fa125ffb640 1 -- 172.21.15.44:0/2415006162 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa128010990 con 0x7fa1340b64c0 2023-11-04T01:35:34.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.429+0000 7fa125ffb640 1 -- 172.21.15.44:0/2415006162 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128010d40 con 0x7fa1340b64c0 2023-11-04T01:35:34.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.429+0000 7fa13b6ec640 1 -- 172.21.15.44:0/2415006162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1341f11e0 con 0x7fa1340b64c0 2023-11-04T01:35:34.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.429+0000 7fa13b6ec640 1 -- 172.21.15.44:0/2415006162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1341f3f60 con 0x7fa1340b64c0 2023-11-04T01:35:34.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.430+0000 7fa125ffb640 1 -- 172.21.15.44:0/2415006162 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa12801d750 con 0x7fa1340b64c0 2023-11-04T01:35:34.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.430+0000 7fa125ffb640 1 -- 172.21.15.44:0/2415006162 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa128014b00 con 0x7fa1340b64c0 2023-11-04T01:35:34.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.431+0000 7fa13b6ec640 1 -- 172.21.15.44:0/2415006162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa134158db0 con 0x7fa1340b64c0 2023-11-04T01:35:34.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.433+0000 7fa125ffb640 1 -- 172.21.15.44:0/2415006162 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa128022060 con 0x7fa1340b64c0 2023-11-04T01:35:34.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.499+0000 7fa13b6ec640 1 -- 172.21.15.44:0/2415006162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa13415e660 con 0x7fa1340b64c0 2023-11-04T01:35:34.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.500+0000 7fa125ffb640 1 -- 172.21.15.44:0/2415006162 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa12802c090 con 0x7fa1340b64c0 2023-11-04T01:35:34.502 INFO:teuthology.orchestra.run.smithi044.stderr:adjusted tunables profile to default 2023-11-04T01:35:34.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.501+0000 7fa13b6ec640 1 -- 172.21.15.44:0/2415006162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1340b64c0 msgr2=0x7fa1341eda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:34.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.501+0000 7fa13b6ec640 1 --2- 172.21.15.44:0/2415006162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1340b64c0 0x7fa1341eda40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa12800b6b0 tx=0x7fa12800bb70 comp rx=0 tx=0).stop 2023-11-04T01:35:34.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.501+0000 7fa13b6ec640 1 -- 172.21.15.44:0/2415006162 shutdown_connections 2023-11-04T01:35:34.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.501+0000 7fa13b6ec640 1 --2- 172.21.15.44:0/2415006162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa13415af20 0x7fa1341f04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:34.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.501+0000 7fa13b6ec640 1 --2- 172.21.15.44:0/2415006162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1340cd3b0 0x7fa1341f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:34.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.501+0000 7fa13b6ec640 1 --2- 172.21.15.44:0/2415006162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1340b64c0 0x7fa1341eda40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:34.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.501+0000 7fa13b6ec640 1 -- 172.21.15.44:0/2415006162 >> 172.21.15.44:0/2415006162 conn(0x7fa13406ea20 msgr2=0x7fa1340cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:34.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.501+0000 7fa13b6ec640 1 -- 172.21.15.44:0/2415006162 shutdown_connections 2023-11-04T01:35:34.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:34.501+0000 7fa13b6ec640 1 -- 172.21.15.44:0/2415006162 wait complete. 2023-11-04T01:35:34.514 INFO:tasks.ceph:check_enable_crimson: False 2023-11-04T01:35:34.514 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-04T01:35:34.514 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:35:34.514 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-04T01:35:34.545 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:35:34.545 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-04T01:35:34.615 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:35:34.615 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-04T01:35:34.685 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:35:34.685 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-04T01:35:34.756 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:35:34.757 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-04T01:35:34.785 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:35:34.785 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-04T01:35:34.852 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:35:34.853 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-04T01:35:34.905 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:34.903+0000 7effc5a1e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-04T01:35:34.912 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:34.908+0000 7f53da412040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-04T01:35:34.920 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:35:34.921 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-04T01:35:34.960 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:34.957+0000 7effc5a1e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-04T01:35:34.967 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:34.962+0000 7f53da412040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-04T01:35:34.989 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new b7c4ed99-d914-4974-ab13-976c53a2abac 0 2023-11-04T01:35:35.130 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.128+0000 7fd0c96a2640 1 Processor -- start 2023-11-04T01:35:35.130 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.128+0000 7fd0c96a2640 1 -- start start 2023-11-04T01:35:35.139 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.129+0000 7fd0c96a2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd0c406a830 0x7fd0c40b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.139 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.129+0000 7fd0c96a2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c40cdf80 con 0x7fd0c40722a0 2023-11-04T01:35:35.139 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.129+0000 7fd0c96a2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c4072710 con 0x7fd0c41603d0 2023-11-04T01:35:35.139 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.129+0000 7fd0c96a2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c40b19d0 con 0x7fd0c406a830 2023-11-04T01:35:35.139 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.129+0000 7fd0c2ffd640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fd0c41603d0 0x7fd0c406a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:46904/0 (socket says 172.21.15.204:46904) 2023-11-04T01:35:35.139 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.129+0000 7fd0c2ffd640 1 -- 172.21.15.204:0/3574607026 learned_addr learned my addr 172.21.15.204:0/3574607026 (peer_addr_for_me v1:172.21.15.204:0/0) 2023-11-04T01:35:35.139 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.129+0000 7fd0c27fc640 1 --2- 172.21.15.204:0/3574607026 >> v2:172.21.15.44:3300/0 conn(0x7fd0c406a830 0x7fd0c40b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.140 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.129+0000 7fd0c1ffb640 1 -- 172.21.15.204:0/3574607026 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84656681 0 0) 0x7fd0c4072710 con 0x7fd0c41603d0 2023-11-04T01:35:35.140 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.129+0000 7fd0c1ffb640 1 -- 172.21.15.204:0/3574607026 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0ac003520 con 0x7fd0c41603d0 2023-11-04T01:35:35.140 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.129+0000 7fd0c1ffb640 1 -- 172.21.15.204:0/3574607026 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2951886857 0 0) 0x7fd0ac003520 con 0x7fd0c41603d0 2023-11-04T01:35:35.140 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.129+0000 7fd0c27fc640 1 -- 172.21.15.204:0/3574607026 >> v1:172.21.15.204:6789/0 conn(0x7fd0c41603d0 legacy=0x7fd0c406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.140 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.129+0000 7fd0c27fc640 1 -- 172.21.15.204:0/3574607026 >> v1:172.21.15.44:6789/0 conn(0x7fd0c40722a0 legacy=0x7fd0c40ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.140 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.129+0000 7fd0c27fc640 1 -- 172.21.15.204:0/3574607026 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c40ce6f0 con 0x7fd0c406a830 2023-11-04T01:35:35.140 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.131+0000 7fd0c27fc640 1 --2- 172.21.15.204:0/3574607026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0c406a830 0x7fd0c40b1490 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40097a0 tx=0x7fd0b402b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6d5a87acf335e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:35.140 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.131+0000 7fd0c1ffb640 1 -- 172.21.15.204:0/3574607026 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8001670 con 0x7fd0c406a830 2023-11-04T01:35:35.140 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.131+0000 7fd0c1ffb640 1 -- 172.21.15.204:0/3574607026 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b402e050 con 0x7fd0c406a830 2023-11-04T01:35:35.140 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.131+0000 7fd0c1ffb640 1 -- 172.21.15.204:0/3574607026 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4030510 con 0x7fd0c406a830 2023-11-04T01:35:35.140 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.131+0000 7fd0c96a2640 1 -- 172.21.15.204:0/3574607026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0c406a830 msgr2=0x7fd0c40b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.140 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.131+0000 7fd0c96a2640 1 --2- 172.21.15.204:0/3574607026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0c406a830 0x7fd0c40b1490 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40097a0 tx=0x7fd0b402b600 comp rx=0 tx=0).stop 2023-11-04T01:35:35.141 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.131+0000 7fd0c96a2640 1 -- 172.21.15.204:0/3574607026 shutdown_connections 2023-11-04T01:35:35.141 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.131+0000 7fd0c96a2640 1 --2- 172.21.15.204:0/3574607026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0c406a830 0x7fd0c40b1490 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.141 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.131+0000 7fd0c96a2640 1 -- 172.21.15.204:0/3574607026 >> 172.21.15.204:0/3574607026 conn(0x7fd0c406d800 msgr2=0x7fd0c406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:35.141 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.132+0000 7fd0c96a2640 1 -- 172.21.15.204:0/3574607026 shutdown_connections 2023-11-04T01:35:35.141 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.132+0000 7fd0c96a2640 1 -- 172.21.15.204:0/3574607026 wait complete. 2023-11-04T01:35:35.142 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.133+0000 7fd0c96a2640 1 Processor -- start 2023-11-04T01:35:35.142 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.133+0000 7fd0c96a2640 1 -- start start 2023-11-04T01:35:35.143 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c96a2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0c406a830 0x7fd0c40b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.143 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c96a2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0c40722a0 0x7fd0c40c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.143 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c96a2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0c41603d0 0x7fd0c414ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.144 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c96a2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40b3a40 con 0x7fd0c406a830 2023-11-04T01:35:35.144 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c96a2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40b2ec0 con 0x7fd0c41603d0 2023-11-04T01:35:35.144 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c96a2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40b31a0 con 0x7fd0c40722a0 2023-11-04T01:35:35.144 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c37fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0c41603d0 0x7fd0c414ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.144 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c37fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0c41603d0 0x7fd0c414ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:36208/0 (socket says 172.21.15.204:36208) 2023-11-04T01:35:35.144 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c27fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0c40722a0 0x7fd0c40c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.144 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c37fe640 1 -- 172.21.15.204:0/670277464 learned_addr learned my addr 172.21.15.204:0/670277464 (peer_addr_for_me v2:172.21.15.204:0/0) 2023-11-04T01:35:35.144 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c2ffd640 1 --2- 172.21.15.204:0/670277464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0c406a830 0x7fd0c40b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.144 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c37fe640 1 -- 172.21.15.204:0/670277464 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0c40722a0 msgr2=0x7fd0c40c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.144 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c37fe640 1 --2- 172.21.15.204:0/670277464 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0c40722a0 0x7fd0c40c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.144 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c37fe640 1 -- 172.21.15.204:0/670277464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0c406a830 msgr2=0x7fd0c40b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.144 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c37fe640 1 --2- 172.21.15.204:0/670277464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0c406a830 0x7fd0c40b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.145 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c37fe640 1 -- 172.21.15.204:0/670277464 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b4009400 con 0x7fd0c41603d0 2023-11-04T01:35:35.145 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c37fe640 1 --2- 172.21.15.204:0/670277464 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0c41603d0 0x7fd0c414ba20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00c8c0 tx=0x7fd0bc00cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:35.145 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0ab7fe640 1 -- 172.21.15.204:0/670277464 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc003da0 con 0x7fd0c41603d0 2023-11-04T01:35:35.145 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0ab7fe640 1 -- 172.21.15.204:0/670277464 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0bc005070 con 0x7fd0c41603d0 2023-11-04T01:35:35.145 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0ab7fe640 1 -- 172.21.15.204:0/670277464 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc005400 con 0x7fd0c41603d0 2023-11-04T01:35:35.145 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.134+0000 7fd0c96a2640 1 -- 172.21.15.204:0/670277464 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c40b3480 con 0x7fd0c41603d0 2023-11-04T01:35:35.145 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.135+0000 7fd0c96a2640 1 -- 172.21.15.204:0/670277464 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c40b2ab0 con 0x7fd0c41603d0 2023-11-04T01:35:35.145 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.135+0000 7fd0ab7fe640 1 -- 172.21.15.204:0/670277464 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd0bc00a640 con 0x7fd0c41603d0 2023-11-04T01:35:35.145 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.135+0000 7fd0ab7fe640 1 -- 172.21.15.204:0/670277464 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd0bc01ca20 con 0x7fd0c41603d0 2023-11-04T01:35:35.145 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.135+0000 7fd0c96a2640 1 -- 172.21.15.204:0/670277464 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c40b5990 con 0x7fd0c41603d0 2023-11-04T01:35:35.146 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.138+0000 7fd0ab7fe640 1 -- 172.21.15.204:0/670277464 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fd0bc017070 con 0x7fd0c41603d0 2023-11-04T01:35:35.212 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.208+0000 7fd0c96a2640 1 -- 172.21.15.204:0/670277464 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b7c4ed99-d914-4974-ab13-976c53a2abac", "id": 0} v 0) v1 -- 0x7fd0c40cefd0 con 0x7fd0c41603d0 2023-11-04T01:35:35.213 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.211+0000 7fd0ab7fe640 1 -- 172.21.15.204:0/670277464 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b7c4ed99-d914-4974-ab13-976c53a2abac", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd0bc01cbe0 con 0x7fd0c41603d0 2023-11-04T01:35:35.213 INFO:teuthology.orchestra.run.smithi204.stdout:0 2023-11-04T01:35:35.214 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.212+0000 7fd0c96a2640 1 -- 172.21.15.204:0/670277464 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0c41603d0 msgr2=0x7fd0c414ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.214 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.212+0000 7fd0c96a2640 1 --2- 172.21.15.204:0/670277464 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0c41603d0 0x7fd0c414ba20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00c8c0 tx=0x7fd0bc00cd80 comp rx=0 tx=0).stop 2023-11-04T01:35:35.215 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.212+0000 7fd0c96a2640 1 -- 172.21.15.204:0/670277464 shutdown_connections 2023-11-04T01:35:35.215 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.212+0000 7fd0c96a2640 1 --2- 172.21.15.204:0/670277464 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0c41603d0 0x7fd0c414ba20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.215 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.212+0000 7fd0c96a2640 1 --2- 172.21.15.204:0/670277464 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0c40722a0 0x7fd0c40c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.215 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.212+0000 7fd0c96a2640 1 --2- 172.21.15.204:0/670277464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0c406a830 0x7fd0c40b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.215 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.212+0000 7fd0c96a2640 1 -- 172.21.15.204:0/670277464 >> 172.21.15.204:0/670277464 conn(0x7fd0c406d800 msgr2=0x7fd0c415f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:35.215 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.212+0000 7fd0c96a2640 1 -- 172.21.15.204:0/670277464 shutdown_connections 2023-11-04T01:35:35.215 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.212+0000 7fd0c96a2640 1 -- 172.21.15.204:0/670277464 wait complete. 2023-11-04T01:35:35.224 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 96f60c83-df87-430c-b3e8-d66930e4226a 1 2023-11-04T01:35:35.327 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.323+0000 7f72c4978640 1 Processor -- start 2023-11-04T01:35:35.327 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.323+0000 7f72c4978640 1 -- start start 2023-11-04T01:35:35.328 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72c4978640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c0071f90 0x7f72c00b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.328 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72c4978640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f72c015add0 0x7f72c00cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.328 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72c4978640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f72c0072370 0x7f72c00cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.328 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72c4978640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c00b1fa0 con 0x7f72c0072370 2023-11-04T01:35:35.328 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72c4978640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c015a0e0 con 0x7f72c015add0 2023-11-04T01:35:35.328 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72c4978640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00b1cc0 con 0x7f72c0071f90 2023-11-04T01:35:35.328 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72be59c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c0071f90 0x7f72c00b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.328 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72bdd9b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f72c015add0 0x7f72c00cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.328 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72be59c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c0071f90 0x7f72c00b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:46130/0 (socket says 172.21.15.204:46130) 2023-11-04T01:35:35.328 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72be59c640 1 -- 172.21.15.204:0/295805525 learned_addr learned my addr 172.21.15.204:0/295805525 (peer_addr_for_me v2:172.21.15.204:0/0) 2023-11-04T01:35:35.328 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72bed9d640 1 --2- 172.21.15.204:0/295805525 >> v2:172.21.15.44:3300/0 conn(0x7f72c0072370 0x7f72c00cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.329 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72bdd9b640 1 -- 172.21.15.204:0/295805525 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c0071f90 msgr2=0x7f72c00b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:35.329 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72bdd9b640 1 --2- 172.21.15.204:0/295805525 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c0071f90 0x7f72c00b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.329 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72bdd9b640 1 -- 172.21.15.204:0/295805525 >> v2:172.21.15.44:3300/0 conn(0x7f72c0072370 msgr2=0x7f72c00cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:35.329 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72bdd9b640 1 --2- 172.21.15.204:0/295805525 >> v2:172.21.15.44:3300/0 conn(0x7f72c0072370 0x7f72c00cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.329 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72bdd9b640 1 -- 172.21.15.204:0/295805525 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c015a2f0 con 0x7f72c015add0 2023-11-04T01:35:35.329 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72be59c640 1 --2- 172.21.15.204:0/295805525 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c0071f90 0x7f72c00b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:35.329 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.324+0000 7f72bed9d640 1 --2- 172.21.15.204:0/295805525 >> v2:172.21.15.44:3300/0 conn(0x7f72c0072370 0x7f72c00cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:35:35.329 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.325+0000 7f72bdd9b640 1 --2- 172.21.15.204:0/295805525 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72c015add0 0x7f72c00cecc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72c006cb60 tx=0x7f72b402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1292fddc9693316 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:35.329 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.325+0000 7f72bd59a640 1 -- 172.21.15.204:0/295805525 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b402e070 con 0x7f72c015add0 2023-11-04T01:35:35.330 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.325+0000 7f72bd59a640 1 -- 172.21.15.204:0/295805525 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b40315a0 con 0x7f72c015add0 2023-11-04T01:35:35.338 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.325+0000 7f72bd59a640 1 -- 172.21.15.204:0/295805525 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4031930 con 0x7f72c015add0 2023-11-04T01:35:35.343 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.326+0000 7f72c4978640 1 -- 172.21.15.204:0/295805525 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72c015add0 msgr2=0x7f72c00cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.343 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.326+0000 7f72c4978640 1 --2- 172.21.15.204:0/295805525 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72c015add0 0x7f72c00cecc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72c006cb60 tx=0x7f72b402b840 comp rx=0 tx=0).stop 2023-11-04T01:35:35.343 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.326+0000 7f72c4978640 1 -- 172.21.15.204:0/295805525 shutdown_connections 2023-11-04T01:35:35.343 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.326+0000 7f72c4978640 1 --2- 172.21.15.204:0/295805525 >> v2:172.21.15.44:3300/0 conn(0x7f72c0072370 0x7f72c00cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.343 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.326+0000 7f72c4978640 1 --2- 172.21.15.204:0/295805525 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72c015add0 0x7f72c00cecc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.343 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.326+0000 7f72c4978640 1 --2- 172.21.15.204:0/295805525 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c0071f90 0x7f72c00b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.344 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.326+0000 7f72c4978640 1 -- 172.21.15.204:0/295805525 >> 172.21.15.204:0/295805525 conn(0x7f72c006d800 msgr2=0x7f72c006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:35.344 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.326+0000 7f72c4978640 1 -- 172.21.15.204:0/295805525 shutdown_connections 2023-11-04T01:35:35.344 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.326+0000 7f72c4978640 1 -- 172.21.15.204:0/295805525 wait complete. 2023-11-04T01:35:35.344 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.327+0000 7f72c4978640 1 Processor -- start 2023-11-04T01:35:35.344 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.327+0000 7f72c4978640 1 -- start start 2023-11-04T01:35:35.344 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72c4978640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72c0071f90 0x7f72c0144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.344 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72c4978640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72c0072370 0x7f72c01f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.344 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72c4978640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c015add0 0x7f72c006a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.344 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72c4978640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00c5670 con 0x7f72c0072370 2023-11-04T01:35:35.344 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72c4978640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00c5950 con 0x7f72c0071f90 2023-11-04T01:35:35.344 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72c4978640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00c5c30 con 0x7f72c015add0 2023-11-04T01:35:35.345 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72be59c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72c0071f90 0x7f72c0144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.345 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72bed9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c015add0 0x7f72c006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.345 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72be59c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72c0071f90 0x7f72c0144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:36230/0 (socket says 172.21.15.204:36230) 2023-11-04T01:35:35.345 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72be59c640 1 -- 172.21.15.204:0/1054551970 learned_addr learned my addr 172.21.15.204:0/1054551970 (peer_addr_for_me v2:172.21.15.204:0/0) 2023-11-04T01:35:35.345 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72bed9d640 1 -- 172.21.15.204:0/1054551970 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72c0071f90 msgr2=0x7f72c0144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.345 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72bdd9b640 1 --2- 172.21.15.204:0/1054551970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72c0072370 0x7f72c01f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.345 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72bed9d640 1 --2- 172.21.15.204:0/1054551970 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72c0071f90 0x7f72c0144e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.345 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72bed9d640 1 -- 172.21.15.204:0/1054551970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72c0072370 msgr2=0x7f72c01f05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.345 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72bed9d640 1 --2- 172.21.15.204:0/1054551970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72c0072370 0x7f72c01f05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.345 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.328+0000 7f72bed9d640 1 -- 172.21.15.204:0/1054551970 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00094d0 con 0x7f72c015add0 2023-11-04T01:35:35.345 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.329+0000 7f72bed9d640 1 --2- 172.21.15.204:0/1054551970 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c015add0 0x7f72c006a120 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f72b800cdf0 tx=0x7f72b800a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:35.345 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.329+0000 7f72aeffd640 1 -- 172.21.15.204:0/1054551970 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b800d840 con 0x7f72c015add0 2023-11-04T01:35:35.346 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.329+0000 7f72aeffd640 1 -- 172.21.15.204:0/1054551970 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b800d9a0 con 0x7f72c015add0 2023-11-04T01:35:35.346 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.329+0000 7f72aeffd640 1 -- 172.21.15.204:0/1054551970 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b800dd90 con 0x7f72c015add0 2023-11-04T01:35:35.346 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.329+0000 7f72c4978640 1 -- 172.21.15.204:0/1054551970 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b4009400 con 0x7f72c015add0 2023-11-04T01:35:35.346 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.329+0000 7f72c4978640 1 -- 172.21.15.204:0/1054551970 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c00c61f0 con 0x7f72c015add0 2023-11-04T01:35:35.346 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.329+0000 7f72aeffd640 1 -- 172.21.15.204:0/1054551970 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f72b801f740 con 0x7f72c015add0 2023-11-04T01:35:35.346 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.329+0000 7f72aeffd640 1 -- 172.21.15.204:0/1054551970 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f72b8015a50 con 0x7f72c015add0 2023-11-04T01:35:35.346 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.330+0000 7f72c4978640 1 -- 172.21.15.204:0/1054551970 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c00c63e0 con 0x7f72c015add0 2023-11-04T01:35:35.346 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.332+0000 7f72aeffd640 1 -- 172.21.15.204:0/1054551970 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f72b801a070 con 0x7f72c015add0 2023-11-04T01:35:35.405 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.403+0000 7f72c4978640 1 -- 172.21.15.204:0/1054551970 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "96f60c83-df87-430c-b3e8-d66930e4226a", "id": 1} v 0) v1 -- 0x7f72c00718d0 con 0x7f72c015add0 2023-11-04T01:35:35.408 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.407+0000 7f72aeffd640 1 -- 172.21.15.204:0/1054551970 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96f60c83-df87-430c-b3e8-d66930e4226a", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72b8015c10 con 0x7f72c015add0 2023-11-04T01:35:35.409 INFO:teuthology.orchestra.run.smithi204.stdout:1 2023-11-04T01:35:35.410 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.408+0000 7f72c4978640 1 -- 172.21.15.204:0/1054551970 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c015add0 msgr2=0x7f72c006a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.410 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.408+0000 7f72c4978640 1 --2- 172.21.15.204:0/1054551970 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c015add0 0x7f72c006a120 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f72b800cdf0 tx=0x7f72b800a710 comp rx=0 tx=0).stop 2023-11-04T01:35:35.410 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.408+0000 7f72c4978640 1 -- 172.21.15.204:0/1054551970 shutdown_connections 2023-11-04T01:35:35.410 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.408+0000 7f72c4978640 1 --2- 172.21.15.204:0/1054551970 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c015add0 0x7f72c006a120 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.410 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.408+0000 7f72c4978640 1 --2- 172.21.15.204:0/1054551970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72c0072370 0x7f72c01f05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.410 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.408+0000 7f72c4978640 1 --2- 172.21.15.204:0/1054551970 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72c0071f90 0x7f72c0144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.411 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.408+0000 7f72c4978640 1 -- 172.21.15.204:0/1054551970 >> 172.21.15.204:0/1054551970 conn(0x7f72c006d800 msgr2=0x7f72c00cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:35.411 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.408+0000 7f72c4978640 1 -- 172.21.15.204:0/1054551970 shutdown_connections 2023-11-04T01:35:35.411 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.408+0000 7f72c4978640 1 -- 172.21.15.204:0/1054551970 wait complete. 2023-11-04T01:35:35.422 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 987bc08b-dd93-41d4-8312-c9e84b85601a 2 2023-11-04T01:35:35.520 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:35.518+0000 7effc5a1e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-04T01:35:35.524 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:35.520+0000 7f53da412040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-04T01:35:35.527 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.520+0000 7f218e505640 1 Processor -- start 2023-11-04T01:35:35.527 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.520+0000 7f218e505640 1 -- start start 2023-11-04T01:35:35.527 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.521+0000 7f218e505640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2188071f90 0x7f21880b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.527 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.521+0000 7f218e505640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f218815add0 0x7f21880cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.527 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.521+0000 7f218e505640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21880b1cc0 con 0x7f2188072370 2023-11-04T01:35:35.527 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.521+0000 7f218e505640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21880b1fa0 con 0x7f2188071f90 2023-11-04T01:35:35.527 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.521+0000 7f218e505640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218815a0e0 con 0x7f218815add0 2023-11-04T01:35:35.527 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.521+0000 7f21877fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f218815add0 0x7f21880cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.527 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.521+0000 7f218caa2640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f2188072370 0x7f21880cf200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:46918/0 (socket says 172.21.15.204:46918) 2023-11-04T01:35:35.527 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.521+0000 7f218caa2640 1 -- 172.21.15.204:0/2497285967 learned_addr learned my addr 172.21.15.204:0/2497285967 (peer_addr_for_me v1:172.21.15.204:0/0) 2023-11-04T01:35:35.528 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.521+0000 7f2187fff640 1 --2- 172.21.15.204:0/2497285967 >> v2:172.21.15.44:3300/0 conn(0x7f2188071f90 0x7f21880b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.528 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.522+0000 7f21877fe640 1 -- 172.21.15.204:0/2497285967 >> v2:172.21.15.44:3300/0 conn(0x7f2188071f90 msgr2=0x7f21880b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:35.528 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.522+0000 7f21877fe640 1 --2- 172.21.15.204:0/2497285967 >> v2:172.21.15.44:3300/0 conn(0x7f2188071f90 0x7f21880b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.528 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.522+0000 7f21877fe640 1 -- 172.21.15.204:0/2497285967 >> v1:172.21.15.204:6789/0 conn(0x7f2188072370 legacy=0x7f21880cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.528 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.522+0000 7f2186ffd640 1 -- 172.21.15.204:0/2497285967 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332881352 0 0) 0x7f21880b1cc0 con 0x7f2188072370 2023-11-04T01:35:35.528 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.522+0000 7f21877fe640 1 -- 172.21.15.204:0/2497285967 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218815a2f0 con 0x7f218815add0 2023-11-04T01:35:35.528 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.522+0000 7f21877fe640 1 --2- 172.21.15.204:0/2497285967 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f218815add0 0x7f21880cecc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2188067490 tx=0x7f217802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5c32758a78f14d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:35.528 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.522+0000 7f2186ffd640 1 -- 172.21.15.204:0/2497285967 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2178031830 con 0x7f218815add0 2023-11-04T01:35:35.528 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.523+0000 7f2186ffd640 1 -- 172.21.15.204:0/2497285967 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2178031990 con 0x7f218815add0 2023-11-04T01:35:35.528 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.523+0000 7f2186ffd640 1 -- 172.21.15.204:0/2497285967 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2178031d20 con 0x7f218815add0 2023-11-04T01:35:35.528 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.523+0000 7f218e505640 1 -- 172.21.15.204:0/2497285967 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f218815add0 msgr2=0x7f21880cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.528 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.523+0000 7f218e505640 1 --2- 172.21.15.204:0/2497285967 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f218815add0 0x7f21880cecc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2188067490 tx=0x7f217802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.529 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.523+0000 7f218e505640 1 -- 172.21.15.204:0/2497285967 shutdown_connections 2023-11-04T01:35:35.529 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.523+0000 7f218e505640 1 --2- 172.21.15.204:0/2497285967 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f218815add0 0x7f21880cecc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.529 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.523+0000 7f218e505640 1 --2- 172.21.15.204:0/2497285967 >> v2:172.21.15.44:3300/0 conn(0x7f2188071f90 0x7f21880b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.529 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.523+0000 7f218e505640 1 -- 172.21.15.204:0/2497285967 >> 172.21.15.204:0/2497285967 conn(0x7f218806d800 msgr2=0x7f218806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:35.529 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.523+0000 7f218e505640 1 -- 172.21.15.204:0/2497285967 shutdown_connections 2023-11-04T01:35:35.529 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.524+0000 7f218e505640 1 -- 172.21.15.204:0/2497285967 wait complete. 2023-11-04T01:35:35.529 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.525+0000 7f218e505640 1 Processor -- start 2023-11-04T01:35:35.529 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.525+0000 7f218e505640 1 -- start start 2023-11-04T01:35:35.536 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.525+0000 7f218e505640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2188071f90 0x7f2188152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.536 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f218e505640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2188072370 0x7f21880c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.536 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f218e505640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f218815add0 0x7f21880c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.536 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f218e505640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21881e34f0 con 0x7f2188072370 2023-11-04T01:35:35.537 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f218e505640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21880c7a00 con 0x7f218815add0 2023-11-04T01:35:35.537 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f218e505640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21880c7c60 con 0x7f2188071f90 2023-11-04T01:35:35.537 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f2187fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2188071f90 0x7f2188152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.537 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f2187fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2188071f90 0x7f2188152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:46146/0 (socket says 172.21.15.204:46146) 2023-11-04T01:35:35.537 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f218caa2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f218815add0 0x7f21880c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.537 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f2187fff640 1 -- 172.21.15.204:0/278519200 learned_addr learned my addr 172.21.15.204:0/278519200 (peer_addr_for_me v2:172.21.15.204:0/0) 2023-11-04T01:35:35.537 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f21877fe640 1 --2- 172.21.15.204:0/278519200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2188072370 0x7f21880c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.537 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f218caa2640 1 -- 172.21.15.204:0/278519200 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2188071f90 msgr2=0x7f2188152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.537 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f218caa2640 1 --2- 172.21.15.204:0/278519200 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2188071f90 0x7f2188152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.537 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f218caa2640 1 -- 172.21.15.204:0/278519200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2188072370 msgr2=0x7f21880c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.537 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f218caa2640 1 --2- 172.21.15.204:0/278519200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2188072370 0x7f21880c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.537 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f218caa2640 1 -- 172.21.15.204:0/278519200 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2178009400 con 0x7f218815add0 2023-11-04T01:35:35.537 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f2187fff640 1 --2- 172.21.15.204:0/278519200 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2188071f90 0x7f2188152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:35.538 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f21877fe640 1 --2- 172.21.15.204:0/278519200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2188072370 0x7f21880c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:35.538 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f218caa2640 1 --2- 172.21.15.204:0/278519200 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f218815add0 0x7f21880c45f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2180001560 tx=0x7f218000cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:35.538 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f2184ff9640 1 -- 172.21.15.204:0/278519200 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218000ce30 con 0x7f218815add0 2023-11-04T01:35:35.538 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f2184ff9640 1 -- 172.21.15.204:0/278519200 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218000a640 con 0x7f218815add0 2023-11-04T01:35:35.538 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f218e505640 1 -- 172.21.15.204:0/278519200 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21880c7f40 con 0x7f218815add0 2023-11-04T01:35:35.538 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f2184ff9640 1 -- 172.21.15.204:0/278519200 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218000aa10 con 0x7f218815add0 2023-11-04T01:35:35.538 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.526+0000 7f218e505640 1 -- 172.21.15.204:0/278519200 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21880c8500 con 0x7f218815add0 2023-11-04T01:35:35.538 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.527+0000 7f2184ff9640 1 -- 172.21.15.204:0/278519200 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f21800070d0 con 0x7f218815add0 2023-11-04T01:35:35.539 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.527+0000 7f2184ff9640 1 -- 172.21.15.204:0/278519200 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f21800077a0 con 0x7f218815add0 2023-11-04T01:35:35.542 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.527+0000 7f218e505640 1 -- 172.21.15.204:0/278519200 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21880718d0 con 0x7f218815add0 2023-11-04T01:35:35.542 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.530+0000 7f2184ff9640 1 -- 172.21.15.204:0/278519200 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2180018070 con 0x7f218815add0 2023-11-04T01:35:35.584 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:35.575+0000 7f53da412040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-04T01:35:35.584 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:35.574+0000 7effc5a1e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-04T01:35:35.603 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.601+0000 7f218e505640 1 -- 172.21.15.204:0/278519200 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "987bc08b-dd93-41d4-8312-c9e84b85601a", "id": 2} v 0) v1 -- 0x7f21880cf230 con 0x7f218815add0 2023-11-04T01:35:35.609 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.606+0000 7f2184ff9640 1 -- 172.21.15.204:0/278519200 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "987bc08b-dd93-41d4-8312-c9e84b85601a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2180007380 con 0x7f218815add0 2023-11-04T01:35:35.609 INFO:teuthology.orchestra.run.smithi204.stdout:2 2023-11-04T01:35:35.610 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.607+0000 7f218e505640 1 -- 172.21.15.204:0/278519200 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f218815add0 msgr2=0x7f21880c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.610 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.607+0000 7f218e505640 1 --2- 172.21.15.204:0/278519200 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f218815add0 0x7f21880c45f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2180001560 tx=0x7f218000cbe0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.610 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.607+0000 7f218e505640 1 -- 172.21.15.204:0/278519200 shutdown_connections 2023-11-04T01:35:35.611 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.607+0000 7f218e505640 1 --2- 172.21.15.204:0/278519200 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f218815add0 0x7f21880c45f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.611 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.607+0000 7f218e505640 1 --2- 172.21.15.204:0/278519200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2188072370 0x7f21880c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.611 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.607+0000 7f218e505640 1 --2- 172.21.15.204:0/278519200 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2188071f90 0x7f2188152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.611 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.607+0000 7f218e505640 1 -- 172.21.15.204:0/278519200 >> 172.21.15.204:0/278519200 conn(0x7f218806d800 msgr2=0x7f21880b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:35.611 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.607+0000 7f218e505640 1 -- 172.21.15.204:0/278519200 shutdown_connections 2023-11-04T01:35:35.611 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.607+0000 7f218e505640 1 -- 172.21.15.204:0/278519200 wait complete. 2023-11-04T01:35:35.621 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 8462d2a1-5469-43ca-bb61-91f1b8bab927 3 2023-11-04T01:35:35.624 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:35.622+0000 7effc5a1e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-04T01:35:35.635 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:35.623+0000 7f53da412040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-04T01:35:35.681 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:35.679+0000 7effc5a1e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-04T01:35:35.682 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:35.679+0000 7f53da412040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-04T01:35:35.724 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.721+0000 7f79e9fb7640 1 Processor -- start 2023-11-04T01:35:35.724 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.722+0000 7f79e9fb7640 1 -- start start 2023-11-04T01:35:35.725 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.722+0000 7f79e9fb7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79e41603d0 0x7f79e40b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.725 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.722+0000 7f79e9fb7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79e406a830 0x7f79e40ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.726 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.722+0000 7f79e9fb7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e40cdf80 con 0x7f79e40722a0 2023-11-04T01:35:35.726 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.722+0000 7f79e9fb7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e40b19d0 con 0x7f79e41603d0 2023-11-04T01:35:35.726 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.722+0000 7f79e9fb7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e40ce6f0 con 0x7f79e406a830 2023-11-04T01:35:35.726 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.722+0000 7f79e3fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79e406a830 0x7f79e40ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.726 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.723+0000 7f79e3fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79e406a830 0x7f79e40ca380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:36264/0 (socket says 172.21.15.204:36264) 2023-11-04T01:35:35.726 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.723+0000 7f79e3fff640 1 -- 172.21.15.204:0/673649320 learned_addr learned my addr 172.21.15.204:0/673649320 (peer_addr_for_me v2:172.21.15.204:0/0) 2023-11-04T01:35:35.726 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.723+0000 7f79e37fe640 1 --2- 172.21.15.204:0/673649320 >> v2:172.21.15.44:3300/0 conn(0x7f79e41603d0 0x7f79e40b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.726 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.723+0000 7f79e3fff640 1 -- 172.21.15.204:0/673649320 >> v2:172.21.15.44:3300/0 conn(0x7f79e41603d0 msgr2=0x7f79e40b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:35.726 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.723+0000 7f79e3fff640 1 --2- 172.21.15.204:0/673649320 >> v2:172.21.15.44:3300/0 conn(0x7f79e41603d0 0x7f79e40b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.726 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.723+0000 7f79e3fff640 1 -- 172.21.15.204:0/673649320 >> v1:172.21.15.44:6789/0 conn(0x7f79e40722a0 legacy=0x7f79e406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.727 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.723+0000 7f79e3fff640 1 -- 172.21.15.204:0/673649320 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e4072700 con 0x7f79e406a830 2023-11-04T01:35:35.727 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:35.723+0000 7f53da412040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-04T01:35:35.728 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.724+0000 7f79e3fff640 1 --2- 172.21.15.204:0/673649320 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79e406a830 0x7f79e40ca380 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f79e40cf4f0 tx=0x7f79dc02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20f08ee21ea7986a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:35.728 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.724+0000 7f79e27fc640 1 -- 172.21.15.204:0/673649320 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc02ca80 con 0x7f79e406a830 2023-11-04T01:35:35.728 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.724+0000 7f79e27fc640 1 -- 172.21.15.204:0/673649320 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc02cbe0 con 0x7f79e406a830 2023-11-04T01:35:35.728 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.724+0000 7f79e27fc640 1 -- 172.21.15.204:0/673649320 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc0343f0 con 0x7f79e406a830 2023-11-04T01:35:35.728 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:35.724+0000 7effc5a1e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-04T01:35:35.738 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.725+0000 7f79e9fb7640 1 -- 172.21.15.204:0/673649320 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79e406a830 msgr2=0x7f79e40ca380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.738 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.725+0000 7f79e9fb7640 1 --2- 172.21.15.204:0/673649320 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79e406a830 0x7f79e40ca380 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f79e40cf4f0 tx=0x7f79dc02bee0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.739 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.725+0000 7f79e9fb7640 1 -- 172.21.15.204:0/673649320 shutdown_connections 2023-11-04T01:35:35.739 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.725+0000 7f79e9fb7640 1 --2- 172.21.15.204:0/673649320 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79e406a830 0x7f79e40ca380 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.739 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.725+0000 7f79e9fb7640 1 --2- 172.21.15.204:0/673649320 >> v2:172.21.15.44:3300/0 conn(0x7f79e41603d0 0x7f79e40b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.739 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.725+0000 7f79e9fb7640 1 -- 172.21.15.204:0/673649320 >> 172.21.15.204:0/673649320 conn(0x7f79e406d800 msgr2=0x7f79e406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:35.739 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.725+0000 7f79e9fb7640 1 -- 172.21.15.204:0/673649320 shutdown_connections 2023-11-04T01:35:35.739 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.725+0000 7f79e9fb7640 1 -- 172.21.15.204:0/673649320 wait complete. 2023-11-04T01:35:35.739 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.726+0000 7f79e9fb7640 1 Processor -- start 2023-11-04T01:35:35.739 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.726+0000 7f79e9fb7640 1 -- start start 2023-11-04T01:35:35.739 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e9fb7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e406a830 0x7f79e40b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.739 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e9fb7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79e40722a0 0x7f79e415f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.739 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e9fb7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79e41603d0 0x7f79e4148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.739 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e9fb7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40b41e0 con 0x7f79e406a830 2023-11-04T01:35:35.740 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e9fb7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40b44c0 con 0x7f79e41603d0 2023-11-04T01:35:35.740 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e9fb7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40b47a0 con 0x7f79e40722a0 2023-11-04T01:35:35.740 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e3fff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79e41603d0 0x7f79e4148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.740 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e2ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79e40722a0 0x7f79e415f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.740 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e3fff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79e41603d0 0x7f79e4148d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:36274/0 (socket says 172.21.15.204:36274) 2023-11-04T01:35:35.740 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e3fff640 1 -- 172.21.15.204:0/3617687765 learned_addr learned my addr 172.21.15.204:0/3617687765 (peer_addr_for_me v2:172.21.15.204:0/0) 2023-11-04T01:35:35.740 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e37fe640 1 --2- 172.21.15.204:0/3617687765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e406a830 0x7f79e40b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.740 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e3fff640 1 -- 172.21.15.204:0/3617687765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79e40722a0 msgr2=0x7f79e415f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.740 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e3fff640 1 --2- 172.21.15.204:0/3617687765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79e40722a0 0x7f79e415f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.740 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e3fff640 1 -- 172.21.15.204:0/3617687765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e406a830 msgr2=0x7f79e40b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.741 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e3fff640 1 --2- 172.21.15.204:0/3617687765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e406a830 0x7f79e40b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.741 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e3fff640 1 -- 172.21.15.204:0/3617687765 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc009b30 con 0x7f79e41603d0 2023-11-04T01:35:35.741 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.727+0000 7f79e37fe640 1 --2- 172.21.15.204:0/3617687765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e406a830 0x7f79e40b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:35.741 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.728+0000 7f79e3fff640 1 --2- 172.21.15.204:0/3617687765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79e41603d0 0x7f79e4148d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f79dc036040 tx=0x7f79dc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:35.741 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.728+0000 7f79cbfff640 1 -- 172.21.15.204:0/3617687765 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc009510 con 0x7f79e41603d0 2023-11-04T01:35:35.741 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.728+0000 7f79cbfff640 1 -- 172.21.15.204:0/3617687765 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc03e450 con 0x7f79e41603d0 2023-11-04T01:35:35.741 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.728+0000 7f79cbfff640 1 -- 172.21.15.204:0/3617687765 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc03e800 con 0x7f79e41603d0 2023-11-04T01:35:35.741 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.728+0000 7f79e9fb7640 1 -- 172.21.15.204:0/3617687765 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e40b4a80 con 0x7f79e41603d0 2023-11-04T01:35:35.741 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.728+0000 7f79e9fb7640 1 -- 172.21.15.204:0/3617687765 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e40b3dd0 con 0x7f79e41603d0 2023-11-04T01:35:35.741 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.728+0000 7f79cbfff640 1 -- 172.21.15.204:0/3617687765 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f79dc02cd50 con 0x7f79e41603d0 2023-11-04T01:35:35.741 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.728+0000 7f79cbfff640 1 -- 172.21.15.204:0/3617687765 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f79dc048c50 con 0x7f79e41603d0 2023-11-04T01:35:35.741 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.729+0000 7f79e9fb7640 1 -- 172.21.15.204:0/3617687765 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e40b3f60 con 0x7f79e41603d0 2023-11-04T01:35:35.742 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.731+0000 7f79cbfff640 1 -- 172.21.15.204:0/3617687765 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f79dc066b40 con 0x7f79e41603d0 2023-11-04T01:35:35.804 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.803+0000 7f79e9fb7640 1 -- 172.21.15.204:0/3617687765 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8462d2a1-5469-43ca-bb61-91f1b8bab927", "id": 3} v 0) v1 -- 0x7f79e40b4f40 con 0x7f79e41603d0 2023-11-04T01:35:35.810 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.808+0000 7f79cbfff640 1 -- 172.21.15.204:0/3617687765 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8462d2a1-5469-43ca-bb61-91f1b8bab927", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f79dc055030 con 0x7f79e41603d0 2023-11-04T01:35:35.811 INFO:teuthology.orchestra.run.smithi204.stdout:3 2023-11-04T01:35:35.811 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.809+0000 7f79e9fb7640 1 -- 172.21.15.204:0/3617687765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79e41603d0 msgr2=0x7f79e4148d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.812 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.809+0000 7f79e9fb7640 1 --2- 172.21.15.204:0/3617687765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79e41603d0 0x7f79e4148d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f79dc036040 tx=0x7f79dc004a40 comp rx=0 tx=0).stop 2023-11-04T01:35:35.812 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.809+0000 7f79e9fb7640 1 -- 172.21.15.204:0/3617687765 shutdown_connections 2023-11-04T01:35:35.812 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.809+0000 7f79e9fb7640 1 --2- 172.21.15.204:0/3617687765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79e41603d0 0x7f79e4148d80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.812 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.809+0000 7f79e9fb7640 1 --2- 172.21.15.204:0/3617687765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79e40722a0 0x7f79e415f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.812 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.809+0000 7f79e9fb7640 1 --2- 172.21.15.204:0/3617687765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e406a830 0x7f79e40b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.812 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.809+0000 7f79e9fb7640 1 -- 172.21.15.204:0/3617687765 >> 172.21.15.204:0/3617687765 conn(0x7f79e406d800 msgr2=0x7f79e4071700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:35.812 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.809+0000 7f79e9fb7640 1 -- 172.21.15.204:0/3617687765 shutdown_connections 2023-11-04T01:35:35.812 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.809+0000 7f79e9fb7640 1 -- 172.21.15.204:0/3617687765 wait complete. 2023-11-04T01:35:35.821 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new a07eebf6-3f57-423f-9c66-8ba81f589518 4 2023-11-04T01:35:35.832 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:35.830+0000 7f53da412040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-04T01:35:35.833 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:35.831+0000 7effc5a1e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-04T01:35:35.905 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:35.903+0000 7f53da412040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-04T01:35:35.907 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:35.905+0000 7effc5a1e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-04T01:35:35.921 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.919+0000 7f7e339f5640 1 Processor -- start 2023-11-04T01:35:35.921 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.919+0000 7f7e339f5640 1 -- start start 2023-11-04T01:35:35.923 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.920+0000 7f7e339f5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7e2c15af20 0x7f7e2c0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.923 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.920+0000 7f7e339f5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2c0d01f0 con 0x7f7e2c0b64c0 2023-11-04T01:35:35.923 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.920+0000 7f7e339f5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2c0b6a40 con 0x7f7e2c0cd3b0 2023-11-04T01:35:35.923 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.920+0000 7f7e339f5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0cc380 con 0x7f7e2c15af20 2023-11-04T01:35:35.923 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.920+0000 7f7e31791640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7e2c15af20 0x7f7e2c0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.923 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.920+0000 7f7e31f92640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f7e2c0cd3b0 0x7f7e2c0cec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:46926/0 (socket says 172.21.15.204:46926) 2023-11-04T01:35:35.923 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.920+0000 7f7e31f92640 1 -- 172.21.15.204:0/565358409 learned_addr learned my addr 172.21.15.204:0/565358409 (peer_addr_for_me v1:172.21.15.204:0/0) 2023-11-04T01:35:35.923 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.920+0000 7f7e31791640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7e2c15af20 0x7f7e2c0b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:36290/0 (socket says 172.21.15.204:36290) 2023-11-04T01:35:35.923 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.921+0000 7f7e31791640 1 -- 172.21.15.204:0/565358409 >> v1:172.21.15.204:6789/0 conn(0x7f7e2c0cd3b0 legacy=0x7f7e2c0cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.924 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.921+0000 7f7e31791640 1 -- 172.21.15.204:0/565358409 >> v1:172.21.15.44:6789/0 conn(0x7f7e2c0b64c0 legacy=0x7f7e2c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.924 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.921+0000 7f7e31791640 1 -- 172.21.15.204:0/565358409 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0d04b0 con 0x7f7e2c15af20 2023-11-04T01:35:35.925 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.921+0000 7f7e31791640 1 --2- 172.21.15.204:0/565358409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e2c15af20 0x7f7e2c0b3cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7e280097a0 tx=0x7f7e2802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fffc32700d04e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:35.925 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.922+0000 7f7e23fff640 1 -- 172.21.15.204:0/565358409 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28030610 con 0x7f7e2c15af20 2023-11-04T01:35:35.925 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.922+0000 7f7e23fff640 1 -- 172.21.15.204:0/565358409 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e28030770 con 0x7f7e2c15af20 2023-11-04T01:35:35.925 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.922+0000 7f7e23fff640 1 -- 172.21.15.204:0/565358409 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28030b00 con 0x7f7e2c15af20 2023-11-04T01:35:35.926 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.922+0000 7f7e339f5640 1 -- 172.21.15.204:0/565358409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e2c15af20 msgr2=0x7f7e2c0b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.926 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.922+0000 7f7e339f5640 1 --2- 172.21.15.204:0/565358409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e2c15af20 0x7f7e2c0b3cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7e280097a0 tx=0x7f7e2802b960 comp rx=0 tx=0).stop 2023-11-04T01:35:35.926 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.922+0000 7f7e339f5640 1 -- 172.21.15.204:0/565358409 shutdown_connections 2023-11-04T01:35:35.926 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.922+0000 7f7e339f5640 1 --2- 172.21.15.204:0/565358409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e2c15af20 0x7f7e2c0b3cd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.926 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.922+0000 7f7e339f5640 1 -- 172.21.15.204:0/565358409 >> 172.21.15.204:0/565358409 conn(0x7f7e2c06ea20 msgr2=0x7f7e2c06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:35.926 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.922+0000 7f7e339f5640 1 -- 172.21.15.204:0/565358409 shutdown_connections 2023-11-04T01:35:35.926 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.922+0000 7f7e339f5640 1 -- 172.21.15.204:0/565358409 wait complete. 2023-11-04T01:35:35.929 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.923+0000 7f7e339f5640 1 Processor -- start 2023-11-04T01:35:35.929 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.923+0000 7f7e339f5640 1 -- start start 2023-11-04T01:35:35.929 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.924+0000 7f7e339f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e2c0b64c0 0x7f7e2c14f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.929 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.924+0000 7f7e339f5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e2c0cd3b0 0x7f7e2c0c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.929 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.924+0000 7f7e339f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e2c15af20 0x7f7e2c0c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:35.929 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.924+0000 7f7e339f5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0b1320 con 0x7f7e2c0b64c0 2023-11-04T01:35:35.929 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.924+0000 7f7e339f5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0c5b80 con 0x7f7e2c0cd3b0 2023-11-04T01:35:35.930 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.924+0000 7f7e339f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0b06a0 con 0x7f7e2c15af20 2023-11-04T01:35:35.930 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.924+0000 7f7e30f90640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e2c0cd3b0 0x7f7e2c0c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.930 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.924+0000 7f7e30f90640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e2c0cd3b0 0x7f7e2c0c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:36300/0 (socket says 172.21.15.204:36300) 2023-11-04T01:35:35.930 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.924+0000 7f7e30f90640 1 -- 172.21.15.204:0/3218818397 learned_addr learned my addr 172.21.15.204:0/3218818397 (peer_addr_for_me v2:172.21.15.204:0/0) 2023-11-04T01:35:35.930 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.924+0000 7f7e31f92640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e2c15af20 0x7f7e2c0c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.930 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.924+0000 7f7e31791640 1 --2- 172.21.15.204:0/3218818397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e2c0b64c0 0x7f7e2c14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:35.930 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.925+0000 7f7e30f90640 1 -- 172.21.15.204:0/3218818397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e2c15af20 msgr2=0x7f7e2c0c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.930 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.925+0000 7f7e30f90640 1 --2- 172.21.15.204:0/3218818397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e2c15af20 0x7f7e2c0c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.930 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.925+0000 7f7e30f90640 1 -- 172.21.15.204:0/3218818397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e2c0b64c0 msgr2=0x7f7e2c14f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:35.930 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.925+0000 7f7e30f90640 1 --2- 172.21.15.204:0/3218818397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e2c0b64c0 0x7f7e2c14f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:35.930 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.925+0000 7f7e30f90640 1 -- 172.21.15.204:0/3218818397 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e28009400 con 0x7f7e2c0cd3b0 2023-11-04T01:35:35.931 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.925+0000 7f7e30f90640 1 --2- 172.21.15.204:0/3218818397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e2c0cd3b0 0x7f7e2c0c7030 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c480 tx=0x7f7e1c00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:35.931 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.925+0000 7f7e21ffb640 1 -- 172.21.15.204:0/3218818397 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0052d0 con 0x7f7e2c0cd3b0 2023-11-04T01:35:35.931 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.925+0000 7f7e21ffb640 1 -- 172.21.15.204:0/3218818397 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c005430 con 0x7f7e2c0cd3b0 2023-11-04T01:35:35.931 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.925+0000 7f7e339f5640 1 -- 172.21.15.204:0/3218818397 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c0b0980 con 0x7f7e2c0cd3b0 2023-11-04T01:35:35.931 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.925+0000 7f7e21ffb640 1 -- 172.21.15.204:0/3218818397 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c012870 con 0x7f7e2c0cd3b0 2023-11-04T01:35:35.931 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.925+0000 7f7e21ffb640 1 -- 172.21.15.204:0/3218818397 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7e1c012cd0 con 0x7f7e2c0cd3b0 2023-11-04T01:35:35.931 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.925+0000 7f7e339f5640 1 -- 172.21.15.204:0/3218818397 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c0b0f40 con 0x7f7e2c0cd3b0 2023-11-04T01:35:35.931 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.925+0000 7f7e21ffb640 1 -- 172.21.15.204:0/3218818397 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f7e1c003b00 con 0x7f7e2c0cd3b0 2023-11-04T01:35:35.931 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.926+0000 7f7e339f5640 1 -- 172.21.15.204:0/3218818397 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c14f5d0 con 0x7f7e2c0cd3b0 2023-11-04T01:35:35.932 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:35.928+0000 7f7e21ffb640 1 -- 172.21.15.204:0/3218818397 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7e1c0035f0 con 0x7f7e2c0cd3b0 2023-11-04T01:35:35.954 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:35.951+0000 7f53da412040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-04T01:35:35.960 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:35.954+0000 7effc5a1e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-04T01:35:36.005 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.000+0000 7f7e339f5640 1 -- 172.21.15.204:0/3218818397 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a07eebf6-3f57-423f-9c66-8ba81f589518", "id": 4} v 0) v1 -- 0x7f7e2c0674e0 con 0x7f7e2c0cd3b0 2023-11-04T01:35:36.009 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:36.006+0000 7f53da412040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-04T01:35:36.009 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.005+0000 7f7e21ffb640 1 -- 172.21.15.204:0/3218818397 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a07eebf6-3f57-423f-9c66-8ba81f589518", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7e1c02b0b0 con 0x7f7e2c0cd3b0 2023-11-04T01:35:36.009 INFO:teuthology.orchestra.run.smithi204.stdout:4 2023-11-04T01:35:36.014 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.006+0000 7f7e339f5640 1 -- 172.21.15.204:0/3218818397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e2c0cd3b0 msgr2=0x7f7e2c0c7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.015 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.006+0000 7f7e339f5640 1 --2- 172.21.15.204:0/3218818397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e2c0cd3b0 0x7f7e2c0c7030 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c480 tx=0x7f7e1c00c940 comp rx=0 tx=0).stop 2023-11-04T01:35:36.015 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.006+0000 7f7e339f5640 1 -- 172.21.15.204:0/3218818397 shutdown_connections 2023-11-04T01:35:36.015 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.006+0000 7f7e339f5640 1 --2- 172.21.15.204:0/3218818397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e2c15af20 0x7f7e2c0c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.015 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.006+0000 7f7e339f5640 1 --2- 172.21.15.204:0/3218818397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e2c0cd3b0 0x7f7e2c0c7030 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.015 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.006+0000 7f7e339f5640 1 --2- 172.21.15.204:0/3218818397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e2c0b64c0 0x7f7e2c14f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.015 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.006+0000 7f7e339f5640 1 -- 172.21.15.204:0/3218818397 >> 172.21.15.204:0/3218818397 conn(0x7f7e2c06ea20 msgr2=0x7f7e2c0cb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:36.015 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.006+0000 7f7e339f5640 1 -- 172.21.15.204:0/3218818397 shutdown_connections 2023-11-04T01:35:36.015 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.007+0000 7f7e339f5640 1 -- 172.21.15.204:0/3218818397 wait complete. 2023-11-04T01:35:36.015 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:36.008+0000 7effc5a1e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-04T01:35:36.024 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 7a765025-8353-458f-8701-7586a08cda40 5 2023-11-04T01:35:36.057 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:36.056+0000 7f53da412040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-04T01:35:36.059 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:36.057+0000 7effc5a1e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-04T01:35:36.158 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.156+0000 7ffaba6af640 1 Processor -- start 2023-11-04T01:35:36.159 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.157+0000 7ffaba6af640 1 -- start start 2023-11-04T01:35:36.160 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.157+0000 7ffaba6af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffab415af20 0x7ffab40b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.160 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.157+0000 7ffaba6af640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffab40b64c0 0x7ffab40cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.160 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.157+0000 7ffaba6af640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ffab40cd3b0 0x7ffab40cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.160 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.157+0000 7ffaba6af640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab40cdd80 con 0x7ffab40b64c0 2023-11-04T01:35:36.160 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.157+0000 7ffaba6af640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab40d01f0 con 0x7ffab40cd3b0 2023-11-04T01:35:36.160 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.157+0000 7ffaba6af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab40b6a40 con 0x7ffab415af20 2023-11-04T01:35:36.160 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.157+0000 7ffab3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffab415af20 0x7ffab40b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.160 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.157+0000 7ffab8c4c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ffab40cd3b0 0x7ffab40cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.161 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.157+0000 7ffab3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffab415af20 0x7ffab40b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:46176/0 (socket says 172.21.15.204:46176) 2023-11-04T01:35:36.161 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.157+0000 7ffab8c4c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ffab40cd3b0 0x7ffab40cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:36304/0 (socket says 172.21.15.204:36304) 2023-11-04T01:35:36.161 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.157+0000 7ffab3fff640 1 -- 172.21.15.204:0/3971599982 learned_addr learned my addr 172.21.15.204:0/3971599982 (peer_addr_for_me v2:172.21.15.204:0/0) 2023-11-04T01:35:36.161 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.158+0000 7ffab37fe640 1 --2- 172.21.15.204:0/3971599982 >> v2:172.21.15.44:3300/0 conn(0x7ffab40b64c0 0x7ffab40cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.161 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.158+0000 7ffab3fff640 1 -- 172.21.15.204:0/3971599982 >> v2:172.21.15.204:3300/0 conn(0x7ffab40cd3b0 msgr2=0x7ffab40cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:36.161 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.158+0000 7ffab3fff640 1 --2- 172.21.15.204:0/3971599982 >> v2:172.21.15.204:3300/0 conn(0x7ffab40cd3b0 0x7ffab40cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.161 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.158+0000 7ffab3fff640 1 -- 172.21.15.204:0/3971599982 >> v2:172.21.15.44:3300/0 conn(0x7ffab40b64c0 msgr2=0x7ffab40cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:36.161 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.158+0000 7ffab3fff640 1 --2- 172.21.15.204:0/3971599982 >> v2:172.21.15.44:3300/0 conn(0x7ffab40b64c0 0x7ffab40cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.161 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.158+0000 7ffab3fff640 1 -- 172.21.15.204:0/3971599982 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab40d04b0 con 0x7ffab415af20 2023-11-04T01:35:36.161 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.158+0000 7ffab8c4c640 1 --2- 172.21.15.204:0/3971599982 >> v2:172.21.15.204:3300/0 conn(0x7ffab40cd3b0 0x7ffab40cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:36.165 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.158+0000 7ffab3fff640 1 --2- 172.21.15.204:0/3971599982 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffab415af20 0x7ffab40b3cd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffab40c7b70 tx=0x7ffaa802b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=639cc4e50413c79e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:36.165 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.159+0000 7ffab2ffd640 1 -- 172.21.15.204:0/3971599982 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8031870 con 0x7ffab415af20 2023-11-04T01:35:36.165 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.159+0000 7ffab2ffd640 1 -- 172.21.15.204:0/3971599982 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa80319d0 con 0x7ffab415af20 2023-11-04T01:35:36.165 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.159+0000 7ffab2ffd640 1 -- 172.21.15.204:0/3971599982 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8031d60 con 0x7ffab415af20 2023-11-04T01:35:36.165 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.159+0000 7ffaba6af640 1 -- 172.21.15.204:0/3971599982 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffab415af20 msgr2=0x7ffab40b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.165 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.159+0000 7ffaba6af640 1 --2- 172.21.15.204:0/3971599982 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffab415af20 0x7ffab40b3cd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffab40c7b70 tx=0x7ffaa802b910 comp rx=0 tx=0).stop 2023-11-04T01:35:36.166 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.159+0000 7ffaba6af640 1 -- 172.21.15.204:0/3971599982 shutdown_connections 2023-11-04T01:35:36.166 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.159+0000 7ffaba6af640 1 --2- 172.21.15.204:0/3971599982 >> v2:172.21.15.204:3300/0 conn(0x7ffab40cd3b0 0x7ffab40cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.166 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.159+0000 7ffaba6af640 1 --2- 172.21.15.204:0/3971599982 >> v2:172.21.15.44:3300/0 conn(0x7ffab40b64c0 0x7ffab40cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.166 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.159+0000 7ffaba6af640 1 --2- 172.21.15.204:0/3971599982 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffab415af20 0x7ffab40b3cd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.166 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.159+0000 7ffaba6af640 1 -- 172.21.15.204:0/3971599982 >> 172.21.15.204:0/3971599982 conn(0x7ffab406ea20 msgr2=0x7ffab406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:36.166 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.159+0000 7ffaba6af640 1 -- 172.21.15.204:0/3971599982 shutdown_connections 2023-11-04T01:35:36.166 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.159+0000 7ffaba6af640 1 -- 172.21.15.204:0/3971599982 wait complete. 2023-11-04T01:35:36.166 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.160+0000 7ffaba6af640 1 Processor -- start 2023-11-04T01:35:36.166 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.161+0000 7ffaba6af640 1 -- start start 2023-11-04T01:35:36.166 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.161+0000 7ffaba6af640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffab40b64c0 0x7ffab41f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.167 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.161+0000 7ffaba6af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab40cd3b0 0x7ffab40c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.167 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.161+0000 7ffaba6af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffab415af20 0x7ffab40c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.167 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.161+0000 7ffaba6af640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab40c6870 con 0x7ffab40cd3b0 2023-11-04T01:35:36.167 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.161+0000 7ffaba6af640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab40c6b50 con 0x7ffab40b64c0 2023-11-04T01:35:36.167 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.161+0000 7ffaba6af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab40c6e30 con 0x7ffab415af20 2023-11-04T01:35:36.167 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.161+0000 7ffab3fff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffab40b64c0 0x7ffab41f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.167 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffab3fff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffab40b64c0 0x7ffab41f2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:36308/0 (socket says 172.21.15.204:36308) 2023-11-04T01:35:36.167 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffab8c4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffab415af20 0x7ffab40c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.168 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffab3fff640 1 -- 172.21.15.204:0/3639594665 learned_addr learned my addr 172.21.15.204:0/3639594665 (peer_addr_for_me v2:172.21.15.204:0/0) 2023-11-04T01:35:36.168 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffab37fe640 1 --2- 172.21.15.204:0/3639594665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab40cd3b0 0x7ffab40c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.168 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffab3fff640 1 -- 172.21.15.204:0/3639594665 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffab415af20 msgr2=0x7ffab40c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.168 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffab3fff640 1 --2- 172.21.15.204:0/3639594665 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffab415af20 0x7ffab40c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.168 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffab3fff640 1 -- 172.21.15.204:0/3639594665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab40cd3b0 msgr2=0x7ffab40c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.168 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffab3fff640 1 --2- 172.21.15.204:0/3639594665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab40cd3b0 0x7ffab40c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.168 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffab3fff640 1 -- 172.21.15.204:0/3639594665 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac009a70 con 0x7ffab40b64c0 2023-11-04T01:35:36.168 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffab3fff640 1 --2- 172.21.15.204:0/3639594665 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffab40b64c0 0x7ffab41f2520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffaa802b950 tx=0x7ffaa80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:36.168 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffab0ff9640 1 -- 172.21.15.204:0/3639594665 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa803abe0 con 0x7ffab40b64c0 2023-11-04T01:35:36.168 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffab0ff9640 1 -- 172.21.15.204:0/3639594665 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa803ad40 con 0x7ffab40b64c0 2023-11-04T01:35:36.168 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffaba6af640 1 -- 172.21.15.204:0/3639594665 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa80094d0 con 0x7ffab40b64c0 2023-11-04T01:35:36.169 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffab0ff9640 1 -- 172.21.15.204:0/3639594665 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8044630 con 0x7ffab40b64c0 2023-11-04T01:35:36.169 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffaba6af640 1 -- 172.21.15.204:0/3639594665 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab40c73f0 con 0x7ffab40b64c0 2023-11-04T01:35:36.169 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffab0ff9640 1 -- 172.21.15.204:0/3639594665 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffaa8044a90 con 0x7ffab40b64c0 2023-11-04T01:35:36.169 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.162+0000 7ffab0ff9640 1 -- 172.21.15.204:0/3639594665 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7ffaa802d040 con 0x7ffab40b64c0 2023-11-04T01:35:36.169 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.163+0000 7ffaba6af640 1 -- 172.21.15.204:0/3639594665 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab40cc190 con 0x7ffab40b64c0 2023-11-04T01:35:36.169 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.165+0000 7ffab0ff9640 1 -- 172.21.15.204:0/3639594665 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ffab40cc190 con 0x7ffab40b64c0 2023-11-04T01:35:36.237 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.235+0000 7ffaba6af640 1 -- 172.21.15.204:0/3639594665 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7a765025-8353-458f-8701-7586a08cda40", "id": 5} v 0) v1 -- 0x7ffab40674e0 con 0x7ffab40b64c0 2023-11-04T01:35:36.242 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.240+0000 7ffab0ff9640 1 -- 172.21.15.204:0/3639594665 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7a765025-8353-458f-8701-7586a08cda40", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffaa8035020 con 0x7ffab40b64c0 2023-11-04T01:35:36.242 INFO:teuthology.orchestra.run.smithi204.stdout:5 2023-11-04T01:35:36.243 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.241+0000 7ffaba6af640 1 -- 172.21.15.204:0/3639594665 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffab40b64c0 msgr2=0x7ffab41f2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.243 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.241+0000 7ffaba6af640 1 --2- 172.21.15.204:0/3639594665 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffab40b64c0 0x7ffab41f2520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffaa802b950 tx=0x7ffaa80046c0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.243 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.241+0000 7ffaba6af640 1 -- 172.21.15.204:0/3639594665 shutdown_connections 2023-11-04T01:35:36.243 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.241+0000 7ffaba6af640 1 --2- 172.21.15.204:0/3639594665 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffab415af20 0x7ffab40c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.243 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.241+0000 7ffaba6af640 1 --2- 172.21.15.204:0/3639594665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab40cd3b0 0x7ffab40c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.243 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.241+0000 7ffaba6af640 1 --2- 172.21.15.204:0/3639594665 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffab40b64c0 0x7ffab41f2520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.244 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.241+0000 7ffaba6af640 1 -- 172.21.15.204:0/3639594665 >> 172.21.15.204:0/3639594665 conn(0x7ffab406ea20 msgr2=0x7ffab4158a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:36.244 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.241+0000 7ffaba6af640 1 -- 172.21.15.204:0/3639594665 shutdown_connections 2023-11-04T01:35:36.244 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.241+0000 7ffaba6af640 1 -- 172.21.15.204:0/3639594665 wait complete. 2023-11-04T01:35:36.253 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 362f45a3-c13d-4841-99a0-53061c1f6f19 6 2023-11-04T01:35:36.362 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.351+0000 7f551cd39640 1 Processor -- start 2023-11-04T01:35:36.362 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.351+0000 7f551cd39640 1 -- start start 2023-11-04T01:35:36.362 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.352+0000 7f551cd39640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f551815add0 0x7f55180cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.362 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.352+0000 7f551cd39640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55180b1cc0 con 0x7f5518071f90 2023-11-04T01:35:36.362 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.352+0000 7f551cd39640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551815a2f0 con 0x7f5518072370 2023-11-04T01:35:36.363 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.352+0000 7f551cd39640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55180b1fa0 con 0x7f551815add0 2023-11-04T01:35:36.363 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.352+0000 7f550ffff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f551815add0 0x7f55180cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.363 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.352+0000 7f5516d9d640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f5518072370 0x7f55180cf200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:46934/0 (socket says 172.21.15.204:46934) 2023-11-04T01:35:36.363 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.352+0000 7f5516d9d640 1 -- 172.21.15.204:0/3922615187 learned_addr learned my addr 172.21.15.204:0/3922615187 (peer_addr_for_me v1:172.21.15.204:0/0) 2023-11-04T01:35:36.363 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.353+0000 7f550ffff640 1 -- 172.21.15.204:0/3922615187 >> v1:172.21.15.204:6789/0 conn(0x7f5518072370 legacy=0x7f55180cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.363 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.353+0000 7f550ffff640 1 -- 172.21.15.204:0/3922615187 >> v1:172.21.15.44:6789/0 conn(0x7f5518071f90 legacy=0x7f55180b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.363 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.353+0000 7f550ffff640 1 -- 172.21.15.204:0/3922615187 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551815a5d0 con 0x7f551815add0 2023-11-04T01:35:36.363 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.353+0000 7f550ffff640 1 --2- 172.21.15.204:0/3922615187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551815add0 0x7f55180cecc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f55000097a0 tx=0x7f550002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b01457554e94c105 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:36.363 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.354+0000 7f5515d9b640 1 -- 172.21.15.204:0/3922615187 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500030610 con 0x7f551815add0 2023-11-04T01:35:36.363 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.354+0000 7f5515d9b640 1 -- 172.21.15.204:0/3922615187 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5500030770 con 0x7f551815add0 2023-11-04T01:35:36.363 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.354+0000 7f5515d9b640 1 -- 172.21.15.204:0/3922615187 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500030b00 con 0x7f551815add0 2023-11-04T01:35:36.363 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.354+0000 7f551cd39640 1 -- 172.21.15.204:0/3922615187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551815add0 msgr2=0x7f55180cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.363 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.354+0000 7f551cd39640 1 --2- 172.21.15.204:0/3922615187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551815add0 0x7f55180cecc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f55000097a0 tx=0x7f550002b960 comp rx=0 tx=0).stop 2023-11-04T01:35:36.364 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.354+0000 7f551cd39640 1 -- 172.21.15.204:0/3922615187 shutdown_connections 2023-11-04T01:35:36.364 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.354+0000 7f551cd39640 1 --2- 172.21.15.204:0/3922615187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551815add0 0x7f55180cecc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.364 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.354+0000 7f551cd39640 1 -- 172.21.15.204:0/3922615187 >> 172.21.15.204:0/3922615187 conn(0x7f551806d800 msgr2=0x7f551806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:36.364 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.354+0000 7f551cd39640 1 -- 172.21.15.204:0/3922615187 shutdown_connections 2023-11-04T01:35:36.364 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.354+0000 7f551cd39640 1 -- 172.21.15.204:0/3922615187 wait complete. 2023-11-04T01:35:36.364 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.356+0000 7f551cd39640 1 Processor -- start 2023-11-04T01:35:36.364 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.356+0000 7f551cd39640 1 -- start start 2023-11-04T01:35:36.364 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.356+0000 7f551cd39640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5518071f90 0x7f55180b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.364 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.356+0000 7f551cd39640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5518072370 0x7f55181ef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.364 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.356+0000 7f551cd39640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551815add0 0x7f551814df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.364 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.356+0000 7f551cd39640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55181f0790 con 0x7f5518072370 2023-11-04T01:35:36.364 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.356+0000 7f551cd39640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55180b1240 con 0x7f551815add0 2023-11-04T01:35:36.364 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.356+0000 7f551cd39640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55181efef0 con 0x7f5518071f90 2023-11-04T01:35:36.364 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.356+0000 7f5516d9d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551815add0 0x7f551814df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.365 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.356+0000 7f551659c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5518071f90 0x7f55180b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.365 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.356+0000 7f5516d9d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551815add0 0x7f551814df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:36326/0 (socket says 172.21.15.204:36326) 2023-11-04T01:35:36.365 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f5516d9d640 1 -- 172.21.15.204:0/3173853309 learned_addr learned my addr 172.21.15.204:0/3173853309 (peer_addr_for_me v2:172.21.15.204:0/0) 2023-11-04T01:35:36.365 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f550ffff640 1 --2- 172.21.15.204:0/3173853309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5518072370 0x7f55181ef7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.365 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f5516d9d640 1 -- 172.21.15.204:0/3173853309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5518071f90 msgr2=0x7f55180b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.365 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f5516d9d640 1 --2- 172.21.15.204:0/3173853309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5518071f90 0x7f55180b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.365 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f5516d9d640 1 -- 172.21.15.204:0/3173853309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5518072370 msgr2=0x7f55181ef7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.365 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f5516d9d640 1 --2- 172.21.15.204:0/3173853309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5518072370 0x7f55181ef7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.365 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f5516d9d640 1 -- 172.21.15.204:0/3173853309 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5500009400 con 0x7f551815add0 2023-11-04T01:35:36.365 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f551659c640 1 --2- 172.21.15.204:0/3173853309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5518071f90 0x7f55180b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:36.365 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f5516d9d640 1 --2- 172.21.15.204:0/3173853309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551815add0 0x7f551814df20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f551000ee60 tx=0x7f551000c640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:36.365 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f550effd640 1 -- 172.21.15.204:0/3173853309 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5510011880 con 0x7f551815add0 2023-11-04T01:35:36.365 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f550effd640 1 -- 172.21.15.204:0/3173853309 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55100119e0 con 0x7f551815add0 2023-11-04T01:35:36.366 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f550effd640 1 -- 172.21.15.204:0/3173853309 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5510011d50 con 0x7f551815add0 2023-11-04T01:35:36.366 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f551cd39640 1 -- 172.21.15.204:0/3173853309 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55181f01d0 con 0x7f551815add0 2023-11-04T01:35:36.366 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f551cd39640 1 -- 172.21.15.204:0/3173853309 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55180c6c80 con 0x7f551815add0 2023-11-04T01:35:36.366 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f550effd640 1 -- 172.21.15.204:0/3173853309 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f551001a750 con 0x7f551815add0 2023-11-04T01:35:36.366 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.357+0000 7f550effd640 1 -- 172.21.15.204:0/3173853309 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f55100077a0 con 0x7f551815add0 2023-11-04T01:35:36.366 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.358+0000 7f551cd39640 1 -- 172.21.15.204:0/3173853309 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55180c6ae0 con 0x7f551815add0 2023-11-04T01:35:36.366 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.360+0000 7f550effd640 1 -- 172.21.15.204:0/3173853309 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f55180c6ae0 con 0x7f551815add0 2023-11-04T01:35:36.434 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.432+0000 7f551cd39640 1 -- 172.21.15.204:0/3173853309 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "362f45a3-c13d-4841-99a0-53061c1f6f19", "id": 6} v 0) v1 -- 0x7f55180c6ea0 con 0x7f551815add0 2023-11-04T01:35:36.439 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.437+0000 7f550effd640 1 -- 172.21.15.204:0/3173853309 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "362f45a3-c13d-4841-99a0-53061c1f6f19", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f551001f060 con 0x7f551815add0 2023-11-04T01:35:36.439 INFO:teuthology.orchestra.run.smithi204.stdout:6 2023-11-04T01:35:36.440 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.438+0000 7f551cd39640 1 -- 172.21.15.204:0/3173853309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551815add0 msgr2=0x7f551814df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.440 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.438+0000 7f551cd39640 1 --2- 172.21.15.204:0/3173853309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551815add0 0x7f551814df20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f551000ee60 tx=0x7f551000c640 comp rx=0 tx=0).stop 2023-11-04T01:35:36.440 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.438+0000 7f551cd39640 1 -- 172.21.15.204:0/3173853309 shutdown_connections 2023-11-04T01:35:36.440 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.438+0000 7f551cd39640 1 --2- 172.21.15.204:0/3173853309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551815add0 0x7f551814df20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.440 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.438+0000 7f551cd39640 1 --2- 172.21.15.204:0/3173853309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5518072370 0x7f55181ef7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.440 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.438+0000 7f551cd39640 1 --2- 172.21.15.204:0/3173853309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5518071f90 0x7f55180b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.440 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.438+0000 7f551cd39640 1 -- 172.21.15.204:0/3173853309 >> 172.21.15.204:0/3173853309 conn(0x7f551806d800 msgr2=0x7f55180cc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:36.441 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.438+0000 7f551cd39640 1 -- 172.21.15.204:0/3173853309 shutdown_connections 2023-11-04T01:35:36.441 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.438+0000 7f551cd39640 1 -- 172.21.15.204:0/3173853309 wait complete. 2023-11-04T01:35:36.450 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 92b3dafa-ee64-4400-a716-a8818f4b1da3 7 2023-11-04T01:35:36.462 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:36.458+0000 7f53da412040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-04T01:35:36.464 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:36.462+0000 7effc5a1e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-04T01:35:36.550 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.548+0000 7f7b22965640 1 Processor -- start 2023-11-04T01:35:36.550 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.548+0000 7f7b22965640 1 -- start start 2023-11-04T01:35:36.551 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.549+0000 7f7b22965640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7b1c071f90 0x7f7b1c0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.551 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.549+0000 7f7b22965640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7b1c072370 0x7f7b1c0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.552 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.549+0000 7f7b22965640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1c0b1cc0 con 0x7f7b1c15add0 2023-11-04T01:35:36.552 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.549+0000 7f7b22965640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c0b1fa0 con 0x7f7b1c071f90 2023-11-04T01:35:36.552 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.549+0000 7f7b22965640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c15a0e0 con 0x7f7b1c072370 2023-11-04T01:35:36.552 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.549+0000 7f7b20f02640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7b1c072370 0x7f7b1c0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.552 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.549+0000 7f7b20f02640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7b1c072370 0x7f7b1c0cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:36336/0 (socket says 172.21.15.204:36336) 2023-11-04T01:35:36.552 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.549+0000 7f7b20f02640 1 -- 172.21.15.204:0/1331177643 learned_addr learned my addr 172.21.15.204:0/1331177643 (peer_addr_for_me v2:172.21.15.204:0/0) 2023-11-04T01:35:36.552 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.549+0000 7f7b1bfff640 1 --2- 172.21.15.204:0/1331177643 >> v2:172.21.15.44:3300/0 conn(0x7f7b1c071f90 0x7f7b1c0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.552 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.549+0000 7f7b20f02640 1 -- 172.21.15.204:0/1331177643 >> v2:172.21.15.44:3300/0 conn(0x7f7b1c071f90 msgr2=0x7f7b1c0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:36.552 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.549+0000 7f7b20f02640 1 --2- 172.21.15.204:0/1331177643 >> v2:172.21.15.44:3300/0 conn(0x7f7b1c071f90 0x7f7b1c0b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.552 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.549+0000 7f7b20f02640 1 -- 172.21.15.204:0/1331177643 >> v1:172.21.15.44:6789/0 conn(0x7f7b1c15add0 legacy=0x7f7b1c0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.552 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.549+0000 7f7b1affd640 1 -- 172.21.15.204:0/1331177643 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147802943 0 0) 0x7f7b1c0b1cc0 con 0x7f7b1c15add0 2023-11-04T01:35:36.552 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.549+0000 7f7b20f02640 1 -- 172.21.15.204:0/1331177643 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c15a2f0 con 0x7f7b1c072370 2023-11-04T01:35:36.554 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.550+0000 7f7b20f02640 1 --2- 172.21.15.204:0/1331177643 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b1c072370 0x7f7b1c0cf3d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0ca200 tx=0x7f7b1402bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=867161f6e1e9ca33 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:36.554 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.550+0000 7f7b1affd640 1 -- 172.21.15.204:0/1331177643 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1402cb20 con 0x7f7b1c072370 2023-11-04T01:35:36.554 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.551+0000 7f7b1affd640 1 -- 172.21.15.204:0/1331177643 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1402cc80 con 0x7f7b1c072370 2023-11-04T01:35:36.554 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.551+0000 7f7b1affd640 1 -- 172.21.15.204:0/1331177643 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b140343f0 con 0x7f7b1c072370 2023-11-04T01:35:36.555 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.551+0000 7f7b22965640 1 -- 172.21.15.204:0/1331177643 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b1c072370 msgr2=0x7f7b1c0cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.555 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.551+0000 7f7b22965640 1 --2- 172.21.15.204:0/1331177643 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b1c072370 0x7f7b1c0cf3d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0ca200 tx=0x7f7b1402bf80 comp rx=0 tx=0).stop 2023-11-04T01:35:36.556 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.551+0000 7f7b22965640 1 -- 172.21.15.204:0/1331177643 shutdown_connections 2023-11-04T01:35:36.556 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.551+0000 7f7b22965640 1 --2- 172.21.15.204:0/1331177643 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b1c072370 0x7f7b1c0cf3d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.556 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.551+0000 7f7b22965640 1 --2- 172.21.15.204:0/1331177643 >> v2:172.21.15.44:3300/0 conn(0x7f7b1c071f90 0x7f7b1c0b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.556 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.551+0000 7f7b22965640 1 -- 172.21.15.204:0/1331177643 >> 172.21.15.204:0/1331177643 conn(0x7f7b1c06d800 msgr2=0x7f7b1c06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:36.556 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.551+0000 7f7b22965640 1 -- 172.21.15.204:0/1331177643 shutdown_connections 2023-11-04T01:35:36.556 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.551+0000 7f7b22965640 1 -- 172.21.15.204:0/1331177643 wait complete. 2023-11-04T01:35:36.563 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.552+0000 7f7b22965640 1 Processor -- start 2023-11-04T01:35:36.563 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.552+0000 7f7b22965640 1 -- start start 2023-11-04T01:35:36.563 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.553+0000 7f7b22965640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b1c071f90 0x7f7b1c14bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.564 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.553+0000 7f7b22965640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b1c072370 0x7f7b1c14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.564 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.553+0000 7f7b22965640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1c15add0 0x7f7b1c0b3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.564 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.553+0000 7f7b22965640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0c6ae0 con 0x7f7b1c15add0 2023-11-04T01:35:36.564 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.553+0000 7f7b22965640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0c4450 con 0x7f7b1c071f90 2023-11-04T01:35:36.564 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.553+0000 7f7b22965640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c14cab0 con 0x7f7b1c072370 2023-11-04T01:35:36.564 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.553+0000 7f7b1bfff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b1c071f90 0x7f7b1c14bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.564 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.553+0000 7f7b1bfff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b1c071f90 0x7f7b1c14bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:36344/0 (socket says 172.21.15.204:36344) 2023-11-04T01:35:36.564 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.553+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b1c072370 0x7f7b1c14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.564 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.553+0000 7f7b1bfff640 1 -- 172.21.15.204:0/2848914673 learned_addr learned my addr 172.21.15.204:0/2848914673 (peer_addr_for_me v2:172.21.15.204:0/0) 2023-11-04T01:35:36.564 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.553+0000 7f7b20f02640 1 --2- 172.21.15.204:0/2848914673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1c15add0 0x7f7b1c0b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.565 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.554+0000 7f7b1bfff640 1 -- 172.21.15.204:0/2848914673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b1c072370 msgr2=0x7f7b1c14c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.565 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.554+0000 7f7b1bfff640 1 --2- 172.21.15.204:0/2848914673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b1c072370 0x7f7b1c14c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.565 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.554+0000 7f7b1bfff640 1 -- 172.21.15.204:0/2848914673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1c15add0 msgr2=0x7f7b1c0b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.565 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.554+0000 7f7b1bfff640 1 --2- 172.21.15.204:0/2848914673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1c15add0 0x7f7b1c0b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.567 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.554+0000 7f7b1bfff640 1 -- 172.21.15.204:0/2848914673 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14009b30 con 0x7f7b1c071f90 2023-11-04T01:35:36.567 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.554+0000 7f7b1bfff640 1 --2- 172.21.15.204:0/2848914673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b1c071f90 0x7f7b1c14bc40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000e9b0 tx=0x7f7b1000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:36.567 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.554+0000 7f7b18ff9640 1 -- 172.21.15.204:0/2848914673 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b10009670 con 0x7f7b1c071f90 2023-11-04T01:35:36.567 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.554+0000 7f7b18ff9640 1 -- 172.21.15.204:0/2848914673 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1000c9a0 con 0x7f7b1c071f90 2023-11-04T01:35:36.567 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.554+0000 7f7b18ff9640 1 -- 172.21.15.204:0/2848914673 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1000cd50 con 0x7f7b1c071f90 2023-11-04T01:35:36.567 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.554+0000 7f7b22965640 1 -- 172.21.15.204:0/2848914673 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1c14cd90 con 0x7f7b1c071f90 2023-11-04T01:35:36.567 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.554+0000 7f7b22965640 1 -- 172.21.15.204:0/2848914673 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c14d350 con 0x7f7b1c071f90 2023-11-04T01:35:36.567 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.554+0000 7f7b18ff9640 1 -- 172.21.15.204:0/2848914673 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7b10005c90 con 0x7f7b1c071f90 2023-11-04T01:35:36.567 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.554+0000 7f7b18ff9640 1 -- 172.21.15.204:0/2848914673 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f7b10013ad0 con 0x7f7b1c071f90 2023-11-04T01:35:36.567 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.555+0000 7f7b22965640 1 -- 172.21.15.204:0/2848914673 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1c0c45c0 con 0x7f7b1c071f90 2023-11-04T01:35:36.567 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.559+0000 7f7b18ff9640 1 -- 172.21.15.204:0/2848914673 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7b1c0c45c0 con 0x7f7b1c071f90 2023-11-04T01:35:36.602 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:36.601+0000 7f53da412040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-04T01:35:36.607 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:36.605+0000 7effc5a1e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-04T01:35:36.632 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.630+0000 7f7b22965640 1 -- 172.21.15.204:0/2848914673 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "92b3dafa-ee64-4400-a716-a8818f4b1da3", "id": 7} v 0) v1 -- 0x7f7b1c0c5ab0 con 0x7f7b1c071f90 2023-11-04T01:35:36.640 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.638+0000 7f7b18ff9640 1 -- 172.21.15.204:0/2848914673 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "92b3dafa-ee64-4400-a716-a8818f4b1da3", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7b1c0c5ab0 con 0x7f7b1c071f90 2023-11-04T01:35:36.640 INFO:teuthology.orchestra.run.smithi204.stdout:7 2023-11-04T01:35:36.641 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.639+0000 7f7b22965640 1 -- 172.21.15.204:0/2848914673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b1c071f90 msgr2=0x7f7b1c14bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.641 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.639+0000 7f7b22965640 1 --2- 172.21.15.204:0/2848914673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b1c071f90 0x7f7b1c14bc40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000e9b0 tx=0x7f7b1000ee70 comp rx=0 tx=0).stop 2023-11-04T01:35:36.641 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.639+0000 7f7b22965640 1 -- 172.21.15.204:0/2848914673 shutdown_connections 2023-11-04T01:35:36.641 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.639+0000 7f7b22965640 1 --2- 172.21.15.204:0/2848914673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1c15add0 0x7f7b1c0b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.641 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.639+0000 7f7b22965640 1 --2- 172.21.15.204:0/2848914673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b1c072370 0x7f7b1c14c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.642 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.639+0000 7f7b22965640 1 --2- 172.21.15.204:0/2848914673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b1c071f90 0x7f7b1c14bc40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.642 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.639+0000 7f7b22965640 1 -- 172.21.15.204:0/2848914673 >> 172.21.15.204:0/2848914673 conn(0x7f7b1c06d800 msgr2=0x7f7b1c0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:36.642 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.639+0000 7f7b22965640 1 -- 172.21.15.204:0/2848914673 shutdown_connections 2023-11-04T01:35:36.642 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:35:36.639+0000 7f7b22965640 1 -- 172.21.15.204:0/2848914673 wait complete. 2023-11-04T01:35:36.651 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-04T01:35:36.651 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-04T01:35:36.654 INFO:tasks.ceph.osd.0:Started 2023-11-04T01:35:36.654 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-04T01:35:36.654 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-04T01:35:36.663 INFO:tasks.ceph.osd.1:Started 2023-11-04T01:35:36.664 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-04T01:35:36.664 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-04T01:35:36.667 INFO:tasks.ceph.osd.2:Started 2023-11-04T01:35:36.667 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-04T01:35:36.668 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-04T01:35:36.677 INFO:tasks.ceph.osd.3:Started 2023-11-04T01:35:36.677 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-04T01:35:36.677 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-04T01:35:36.696 INFO:tasks.ceph.osd.4:Started 2023-11-04T01:35:36.697 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-04T01:35:36.697 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-04T01:35:36.699 INFO:tasks.ceph.osd.5:Started 2023-11-04T01:35:36.699 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-04T01:35:36.699 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-04T01:35:36.703 INFO:tasks.ceph.osd.6:Started 2023-11-04T01:35:36.703 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-04T01:35:36.704 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-04T01:35:36.713 INFO:tasks.ceph.osd.7:Started 2023-11-04T01:35:36.713 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:35:36.745 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:36.741+0000 7effc5a1e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-04T01:35:36.755 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:36.753+0000 7f53da412040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-04T01:35:36.807 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:36.804+0000 7f53da412040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-04T01:35:36.807 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:36.802+0000 7effc5a1e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-04T01:35:36.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.832+0000 7feb0ce1a640 1 Processor -- start 2023-11-04T01:35:36.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.832+0000 7feb0ce1a640 1 -- start start 2023-11-04T01:35:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.832+0000 7feb0ce1a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb0815ceb0 0x7feb080cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.832+0000 7feb0ce1a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feb080cf610 0x7feb0806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.832+0000 7feb0ce1a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0806b880 con 0x7feb0806ce60 2023-11-04T01:35:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.832+0000 7feb0ce1a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0806c500 con 0x7feb080cf610 2023-11-04T01:35:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.832+0000 7feb0ce1a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb08161ae0 con 0x7feb0815ceb0 2023-11-04T01:35:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.833+0000 7feafdd9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feb080cf610 0x7feb0806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.833+0000 7feafdd9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feb080cf610 0x7feb0806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47028/0 (socket says 172.21.15.44:47028) 2023-11-04T01:35:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.833+0000 7feafdd9b640 1 -- 172.21.15.44:0/421478580 learned_addr learned my addr 172.21.15.44:0/421478580 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.833+0000 7feb0659c640 1 --2- 172.21.15.44:0/421478580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb0815ceb0 0x7feb080cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.833+0000 7feafdd9b640 1 -- 172.21.15.44:0/421478580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb0815ceb0 msgr2=0x7feb080cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.833+0000 7feafdd9b640 1 --2- 172.21.15.44:0/421478580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb0815ceb0 0x7feb080cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.833+0000 7feafdd9b640 1 -- 172.21.15.44:0/421478580 >> v1:172.21.15.204:6789/0 conn(0x7feb0806ce60 legacy=0x7feb080cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.833+0000 7feafdd9b640 1 -- 172.21.15.44:0/421478580 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0806bb60 con 0x7feb080cf610 2023-11-04T01:35:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.834+0000 7feafdd9b640 1 --2- 172.21.15.44:0/421478580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb080cf610 0x7feb0806c920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009870 tx=0x7feaf002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98844b05c8cf805 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.834+0000 7feb05d9b640 1 -- 172.21.15.44:0/421478580 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0030840 con 0x7feb080cf610 2023-11-04T01:35:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.834+0000 7feb05d9b640 1 -- 172.21.15.44:0/421478580 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf00309a0 con 0x7feb080cf610 2023-11-04T01:35:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.834+0000 7feb05d9b640 1 -- 172.21.15.44:0/421478580 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0030d30 con 0x7feb080cf610 2023-11-04T01:35:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.834+0000 7feb0ce1a640 1 -- 172.21.15.44:0/421478580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb080cf610 msgr2=0x7feb0806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.834+0000 7feb0ce1a640 1 --2- 172.21.15.44:0/421478580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb080cf610 0x7feb0806c920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009870 tx=0x7feaf002b980 comp rx=0 tx=0).stop 2023-11-04T01:35:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.834+0000 7feb0ce1a640 1 -- 172.21.15.44:0/421478580 shutdown_connections 2023-11-04T01:35:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.834+0000 7feb0ce1a640 1 --2- 172.21.15.44:0/421478580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb080cf610 0x7feb0806c920 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.834+0000 7feb0ce1a640 1 --2- 172.21.15.44:0/421478580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb0815ceb0 0x7feb080cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.834+0000 7feb0ce1a640 1 -- 172.21.15.44:0/421478580 >> 172.21.15.44:0/421478580 conn(0x7feb080cd600 msgr2=0x7feb080cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.834+0000 7feb0ce1a640 1 -- 172.21.15.44:0/421478580 shutdown_connections 2023-11-04T01:35:36.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.834+0000 7feb0ce1a640 1 -- 172.21.15.44:0/421478580 wait complete. 2023-11-04T01:35:36.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.836+0000 7feb0ce1a640 1 Processor -- start 2023-11-04T01:35:36.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.836+0000 7feb0ce1a640 1 -- start start 2023-11-04T01:35:36.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feb0ce1a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb0806ce60 0x7feb080b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feb0ce1a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb080cf610 0x7feb080c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feb0ce1a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb0815ceb0 0x7feb080c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:36.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feb0ce1a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb081f69d0 con 0x7feb080cf610 2023-11-04T01:35:36.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feb0ce1a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb081f5d50 con 0x7feb0806ce60 2023-11-04T01:35:36.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feb0ce1a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb081f6030 con 0x7feb0815ceb0 2023-11-04T01:35:36.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feafdd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb080cf610 0x7feb080c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feafdd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb080cf610 0x7feb080c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47042/0 (socket says 172.21.15.44:47042) 2023-11-04T01:35:36.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feafdd9b640 1 -- 172.21.15.44:0/1563356164 learned_addr learned my addr 172.21.15.44:0/1563356164 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:36.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feb0659c640 1 --2- 172.21.15.44:0/1563356164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb0806ce60 0x7feb080b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feb06d9d640 1 --2- 172.21.15.44:0/1563356164 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb0815ceb0 0x7feb080c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:36.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feafdd9b640 1 -- 172.21.15.44:0/1563356164 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb0815ceb0 msgr2=0x7feb080c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feafdd9b640 1 --2- 172.21.15.44:0/1563356164 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb0815ceb0 0x7feb080c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feafdd9b640 1 -- 172.21.15.44:0/1563356164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb0806ce60 msgr2=0x7feb080b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feafdd9b640 1 --2- 172.21.15.44:0/1563356164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb0806ce60 0x7feb080b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feafdd9b640 1 -- 172.21.15.44:0/1563356164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf00094d0 con 0x7feb080cf610 2023-11-04T01:35:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feafdd9b640 1 --2- 172.21.15.44:0/1563356164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb080cf610 0x7feb080c63e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feaf0000c00 tx=0x7feaf0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.837+0000 7feaff7fe640 1 -- 172.21.15.44:0/1563356164 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0039c90 con 0x7feb080cf610 2023-11-04T01:35:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.838+0000 7feaff7fe640 1 -- 172.21.15.44:0/1563356164 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf0039df0 con 0x7feb080cf610 2023-11-04T01:35:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.838+0000 7feb0ce1a640 1 -- 172.21.15.44:0/1563356164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb081f6310 con 0x7feb080cf610 2023-11-04T01:35:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.838+0000 7feaff7fe640 1 -- 172.21.15.44:0/1563356164 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0043640 con 0x7feb080cf610 2023-11-04T01:35:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.838+0000 7feb0ce1a640 1 -- 172.21.15.44:0/1563356164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb080b2b50 con 0x7feb080cf610 2023-11-04T01:35:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.838+0000 7feaff7fe640 1 -- 172.21.15.44:0/1563356164 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feaf0043aa0 con 0x7feb080cf610 2023-11-04T01:35:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.838+0000 7feaff7fe640 1 -- 172.21.15.44:0/1563356164 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7feaf003e070 con 0x7feb080cf610 2023-11-04T01:35:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.838+0000 7feb0ce1a640 1 -- 172.21.15.44:0/1563356164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb080b2da0 con 0x7feb080cf610 2023-11-04T01:35:36.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.841+0000 7feaff7fe640 1 -- 172.21.15.44:0/1563356164 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7feaf0034070 con 0x7feb080cf610 2023-11-04T01:35:36.901 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:36.899+0000 7effc5a1e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:35:36.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.902+0000 7feb0ce1a640 1 -- 172.21.15.44:0/1563356164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb081f6b10 con 0x7feb080cf610 2023-11-04T01:35:36.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.903+0000 7feaff7fe640 1 -- 172.21.15.44:0/1563356164 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7feb081f6b10 con 0x7feb080cf610 2023-11-04T01:35:36.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:35:36.905 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":10,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:35:36.632212+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:35:36.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.903+0000 7feb0ce1a640 1 -- 172.21.15.44:0/1563356164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb080cf610 msgr2=0x7feb080c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:36.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.903+0000 7feb0ce1a640 1 --2- 172.21.15.44:0/1563356164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb080cf610 0x7feb080c63e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feaf0000c00 tx=0x7feaf0004730 comp rx=0 tx=0).stop 2023-11-04T01:35:36.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.903+0000 7feb0ce1a640 1 -- 172.21.15.44:0/1563356164 shutdown_connections 2023-11-04T01:35:36.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.904+0000 7feb0ce1a640 1 --2- 172.21.15.44:0/1563356164 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb0815ceb0 0x7feb080c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.904+0000 7feb0ce1a640 1 --2- 172.21.15.44:0/1563356164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb080cf610 0x7feb080c63e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.904+0000 7feb0ce1a640 1 --2- 172.21.15.44:0/1563356164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb0806ce60 0x7feb080b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:36.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.904+0000 7feb0ce1a640 1 -- 172.21.15.44:0/1563356164 >> 172.21.15.44:0/1563356164 conn(0x7feb080cd600 msgr2=0x7feb0815f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:36.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.904+0000 7feb0ce1a640 1 -- 172.21.15.44:0/1563356164 shutdown_connections 2023-11-04T01:35:36.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:36.904+0000 7feb0ce1a640 1 -- 172.21.15.44:0/1563356164 wait complete. 2023-11-04T01:35:36.914 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:36.909+0000 7f53da412040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:35:36.920 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-04T01:35:36.920 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-04T01:35:36.994 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:36.992+0000 7effc5a1e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-04T01:35:37.011 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:37.009+0000 7f53da412040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-04T01:35:37.135 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:37.133+0000 7effc5a1e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:35:37.158 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:37.155+0000 7f53da412040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:35:37.176 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:37.174+0000 7effc5a1e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-04T01:35:37.201 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:37.199+0000 7f53da412040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-04T01:35:37.280 INFO:tasks.ceph.osd.2.smithi044.stderr:2023-11-04T01:35:37.277+0000 7f760b40e500 -1 Falling back to public interface 2023-11-04T01:35:37.287 INFO:tasks.ceph.osd.0.smithi044.stderr:2023-11-04T01:35:37.285+0000 7f8b71c07500 -1 Falling back to public interface 2023-11-04T01:35:37.288 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-11-04T01:35:37.287+0000 7fc5c4c1f500 -1 Falling back to public interface 2023-11-04T01:35:37.290 INFO:tasks.ceph.osd.3.smithi044.stderr:2023-11-04T01:35:37.288+0000 7fd9e60c5500 -1 Falling back to public interface 2023-11-04T01:35:37.302 INFO:tasks.ceph.osd.6.smithi204.stderr:2023-11-04T01:35:37.300+0000 7fd2ff40e500 -1 Falling back to public interface 2023-11-04T01:35:37.313 INFO:tasks.ceph.osd.4.smithi204.stderr:2023-11-04T01:35:37.308+0000 7f76e4a0f500 -1 Falling back to public interface 2023-11-04T01:35:37.315 INFO:tasks.ceph.osd.7.smithi204.stderr:2023-11-04T01:35:37.313+0000 7f2b2bf94500 -1 Falling back to public interface 2023-11-04T01:35:37.315 INFO:tasks.ceph.osd.5.smithi204.stderr:2023-11-04T01:35:37.314+0000 7f4b57a0e500 -1 Falling back to public interface 2023-11-04T01:35:37.319 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:37.317+0000 7effc5a1e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-04T01:35:37.349 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:37.347+0000 7f53da412040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-04T01:35:37.736 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:35:37.828 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.825+0000 7fc5de318640 1 Processor -- start 2023-11-04T01:35:37.828 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.825+0000 7fc5de318640 1 -- start start 2023-11-04T01:35:37.829 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.826+0000 7fc5de318640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5d815ade0 0x7fc5d80cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:37.829 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.826+0000 7fc5de318640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5d80cda70 0x7fc5d80b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:37.829 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.826+0000 7fc5de318640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d80b63e0 con 0x7fc5d80cd600 2023-11-04T01:35:37.829 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.826+0000 7fc5de318640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d80cb240 con 0x7fc5d815ade0 2023-11-04T01:35:37.829 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.826+0000 7fc5de318640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d80cb520 con 0x7fc5d80cda70 2023-11-04T01:35:37.829 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.826+0000 7fc5d7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5d815ade0 0x7fc5d80cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:37.829 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.826+0000 7fc5d77fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc5d80cd600 0x7fc5d80b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50366/0 (socket says 172.21.15.44:50366) 2023-11-04T01:35:37.829 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.826+0000 7fc5d77fe640 1 -- 172.21.15.44:0/1725969820 learned_addr learned my addr 172.21.15.44:0/1725969820 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:35:37.829 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.827+0000 7fc5dc8b5640 1 --2- 172.21.15.44:0/1725969820 >> v2:172.21.15.204:3300/0 conn(0x7fc5d80cda70 0x7fc5d80b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:37.830 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.827+0000 7fc5d7fff640 1 -- 172.21.15.44:0/1725969820 >> v2:172.21.15.204:3300/0 conn(0x7fc5d80cda70 msgr2=0x7fc5d80b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:37.830 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.827+0000 7fc5d7fff640 1 --2- 172.21.15.44:0/1725969820 >> v2:172.21.15.204:3300/0 conn(0x7fc5d80cda70 0x7fc5d80b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.830 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.827+0000 7fc5d7fff640 1 -- 172.21.15.44:0/1725969820 >> v1:172.21.15.44:6789/0 conn(0x7fc5d80cd600 legacy=0x7fc5d80b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:37.830 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.827+0000 7fc5d6ffd640 1 -- 172.21.15.44:0/1725969820 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080942519 0 0) 0x7fc5d80b63e0 con 0x7fc5d80cd600 2023-11-04T01:35:37.830 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.827+0000 7fc5d7fff640 1 -- 172.21.15.44:0/1725969820 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d80cb800 con 0x7fc5d815ade0 2023-11-04T01:35:37.831 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.827+0000 7fc5d7fff640 1 --2- 172.21.15.44:0/1725969820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5d815ade0 0x7fc5d80cbbe0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80ce700 tx=0x7fc5c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbdc1f45f1cfbf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:37.831 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.828+0000 7fc5d6ffd640 1 -- 172.21.15.44:0/1725969820 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8031830 con 0x7fc5d815ade0 2023-11-04T01:35:37.831 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.828+0000 7fc5d6ffd640 1 -- 172.21.15.44:0/1725969820 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c8031990 con 0x7fc5d815ade0 2023-11-04T01:35:37.831 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.828+0000 7fc5d6ffd640 1 -- 172.21.15.44:0/1725969820 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8031d20 con 0x7fc5d815ade0 2023-11-04T01:35:37.831 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.828+0000 7fc5de318640 1 -- 172.21.15.44:0/1725969820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5d815ade0 msgr2=0x7fc5d80cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.828+0000 7fc5de318640 1 --2- 172.21.15.44:0/1725969820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5d815ade0 0x7fc5d80cbbe0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80ce700 tx=0x7fc5c802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.828+0000 7fc5de318640 1 -- 172.21.15.44:0/1725969820 shutdown_connections 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.828+0000 7fc5de318640 1 --2- 172.21.15.44:0/1725969820 >> v2:172.21.15.204:3300/0 conn(0x7fc5d80cda70 0x7fc5d80b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.828+0000 7fc5de318640 1 --2- 172.21.15.44:0/1725969820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5d815ade0 0x7fc5d80cbbe0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.828+0000 7fc5de318640 1 -- 172.21.15.44:0/1725969820 >> 172.21.15.44:0/1725969820 conn(0x7fc5d806ea40 msgr2=0x7fc5d806ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.828+0000 7fc5de318640 1 -- 172.21.15.44:0/1725969820 shutdown_connections 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.828+0000 7fc5de318640 1 -- 172.21.15.44:0/1725969820 wait complete. 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.829+0000 7fc5de318640 1 Processor -- start 2023-11-04T01:35:37.835 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.830+0000 7fc5de318640 1 -- start start 2023-11-04T01:35:37.835 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.830+0000 7fc5de318640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5d80cd600 0x7fc5d815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:37.835 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.830+0000 7fc5de318640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5d80cda70 0x7fc5d815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:37.836 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.830+0000 7fc5de318640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d815ade0 0x7fc5d81f1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:37.836 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.830+0000 7fc5de318640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d815b700 con 0x7fc5d80cda70 2023-11-04T01:35:37.836 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.830+0000 7fc5de318640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d80b1e20 con 0x7fc5d80cd600 2023-11-04T01:35:37.836 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.830+0000 7fc5de318640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d80b14f0 con 0x7fc5d815ade0 2023-11-04T01:35:37.836 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.830+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5d80cda70 0x7fc5d815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:37.837 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.830+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5d80cda70 0x7fc5d815b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47052/0 (socket says 172.21.15.44:47052) 2023-11-04T01:35:37.838 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.831+0000 7fc5d77fe640 1 -- 172.21.15.44:0/2972010609 learned_addr learned my addr 172.21.15.44:0/2972010609 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:37.838 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.831+0000 7fc5d7fff640 1 --2- 172.21.15.44:0/2972010609 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5d80cd600 0x7fc5d815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:37.838 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.831+0000 7fc5dc8b5640 1 --2- 172.21.15.44:0/2972010609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d815ade0 0x7fc5d81f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:37.838 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.831+0000 7fc5d77fe640 1 -- 172.21.15.44:0/2972010609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d815ade0 msgr2=0x7fc5d81f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:37.838 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.831+0000 7fc5d77fe640 1 --2- 172.21.15.44:0/2972010609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d815ade0 0x7fc5d81f1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.838 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.831+0000 7fc5d77fe640 1 -- 172.21.15.44:0/2972010609 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5d80cd600 msgr2=0x7fc5d815dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:37.838 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.831+0000 7fc5d77fe640 1 --2- 172.21.15.44:0/2972010609 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5d80cd600 0x7fc5d815dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.838 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.831+0000 7fc5d77fe640 1 -- 172.21.15.44:0/2972010609 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c8009400 con 0x7fc5d80cda70 2023-11-04T01:35:37.838 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.831+0000 7fc5d77fe640 1 --2- 172.21.15.44:0/2972010609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5d80cda70 0x7fc5d815b1c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000c4d0 tx=0x7fc5c000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:37.838 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.831+0000 7fc5d4ff9640 1 -- 172.21.15.44:0/2972010609 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00074e0 con 0x7fc5d80cda70 2023-11-04T01:35:37.838 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.831+0000 7fc5d4ff9640 1 -- 172.21.15.44:0/2972010609 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c0007660 con 0x7fc5d80cda70 2023-11-04T01:35:37.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.831+0000 7fc5de318640 1 -- 172.21.15.44:0/2972010609 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d80b17d0 con 0x7fc5d80cda70 2023-11-04T01:35:37.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.831+0000 7fc5d4ff9640 1 -- 172.21.15.44:0/2972010609 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0004a20 con 0x7fc5d80cda70 2023-11-04T01:35:37.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.831+0000 7fc5de318640 1 -- 172.21.15.44:0/2972010609 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d81f1b60 con 0x7fc5d80cda70 2023-11-04T01:35:37.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.831+0000 7fc5d4ff9640 1 -- 172.21.15.44:0/2972010609 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc5c001d440 con 0x7fc5d80cda70 2023-11-04T01:35:37.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.832+0000 7fc5d4ff9640 1 -- 172.21.15.44:0/2972010609 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc5c0012ad0 con 0x7fc5d80cda70 2023-11-04T01:35:37.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.832+0000 7fc5ce7fc640 1 -- 172.21.15.44:0/2972010609 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b0005250 con 0x7fc5d80cda70 2023-11-04T01:35:37.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.834+0000 7fc5d4ff9640 1 -- 172.21.15.44:0/2972010609 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc5c0018070 con 0x7fc5d80cda70 2023-11-04T01:35:37.897 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.895+0000 7fc5ce7fc640 1 -- 172.21.15.44:0/2972010609 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5b00057d0 con 0x7fc5d80cda70 2023-11-04T01:35:37.897 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.895+0000 7fc5d4ff9640 1 -- 172.21.15.44:0/2972010609 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc5c0012460 con 0x7fc5d80cda70 2023-11-04T01:35:37.897 INFO:teuthology.misc.health.smithi044.stdout: 2023-11-04T01:35:37.897 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":10,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:35:36.632212+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:35:37.898 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.896+0000 7fc5ce7fc640 1 -- 172.21.15.44:0/2972010609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5d80cda70 msgr2=0x7fc5d815b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:37.898 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.896+0000 7fc5ce7fc640 1 --2- 172.21.15.44:0/2972010609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5d80cda70 0x7fc5d815b1c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000c4d0 tx=0x7fc5c000c990 comp rx=0 tx=0).stop 2023-11-04T01:35:37.899 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.896+0000 7fc5ce7fc640 1 -- 172.21.15.44:0/2972010609 shutdown_connections 2023-11-04T01:35:37.899 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.896+0000 7fc5ce7fc640 1 --2- 172.21.15.44:0/2972010609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d815ade0 0x7fc5d81f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.899 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.896+0000 7fc5ce7fc640 1 --2- 172.21.15.44:0/2972010609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5d80cda70 0x7fc5d815b1c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.899 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.896+0000 7fc5ce7fc640 1 --2- 172.21.15.44:0/2972010609 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5d80cd600 0x7fc5d815dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.899 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.896+0000 7fc5ce7fc640 1 -- 172.21.15.44:0/2972010609 >> 172.21.15.44:0/2972010609 conn(0x7fc5d806ea40 msgr2=0x7fc5d80d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:37.899 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.896+0000 7fc5ce7fc640 1 -- 172.21.15.44:0/2972010609 shutdown_connections 2023-11-04T01:35:37.901 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:37.896+0000 7fc5ce7fc640 1 -- 172.21.15.44:0/2972010609 wait complete. 2023-11-04T01:35:37.907 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-04T01:35:38.123 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:38.122+0000 7effc5a1e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-04T01:35:38.225 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:38.223+0000 7f53da412040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-04T01:35:38.395 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:38.393+0000 7effc5a1e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-04T01:35:38.449 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:38.447+0000 7effc5a1e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-04T01:35:38.516 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:38.510+0000 7f53da412040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-04T01:35:38.549 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:38.547+0000 7effc5a1e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-04T01:35:38.566 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:38.564+0000 7f53da412040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-04T01:35:38.674 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-04T01:35:38.672+0000 7f53da412040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-04T01:35:39.577 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:39.575+0000 7eff6699c640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-04T01:35:39.577 INFO:tasks.ceph.mgr.x.smithi204.stderr:2023-11-04T01:35:39.575+0000 7eff6699c640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-04T01:35:40.755 INFO:tasks.ceph.osd.6.smithi204.stderr:2023-11-04T01:35:40.753+0000 7fd2ff40e500 -1 osd.6 0 log_to_monitors true 2023-11-04T01:35:40.807 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-11-04T01:35:40.805+0000 7fc5c4c1f500 -1 osd.1 0 log_to_monitors true 2023-11-04T01:35:40.807 INFO:tasks.ceph.osd.0.smithi044.stderr:2023-11-04T01:35:40.805+0000 7f8b71c07500 -1 osd.0 0 log_to_monitors true 2023-11-04T01:35:40.809 INFO:tasks.ceph.osd.5.smithi204.stderr:2023-11-04T01:35:40.808+0000 7f4b57a0e500 -1 osd.5 0 log_to_monitors true 2023-11-04T01:35:40.810 INFO:tasks.ceph.osd.2.smithi044.stderr:2023-11-04T01:35:40.808+0000 7f760b40e500 -1 osd.2 0 log_to_monitors true 2023-11-04T01:35:40.813 INFO:tasks.ceph.osd.3.smithi044.stderr:2023-11-04T01:35:40.811+0000 7fd9e60c5500 -1 osd.3 0 log_to_monitors true 2023-11-04T01:35:40.817 INFO:tasks.ceph.osd.4.smithi204.stderr:2023-11-04T01:35:40.815+0000 7f76e4a0f500 -1 osd.4 0 log_to_monitors true 2023-11-04T01:35:40.842 INFO:tasks.ceph.osd.7.smithi204.stderr:2023-11-04T01:35:40.841+0000 7f2b2bf94500 -1 osd.7 0 log_to_monitors true 2023-11-04T01:35:44.600 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-11-04T01:35:44.596+0000 7fc5c060c640 -1 osd.1 0 waiting for initial osdmap 2023-11-04T01:35:44.600 INFO:tasks.ceph.osd.4.smithi204.stderr:2023-11-04T01:35:44.598+0000 7f76e03de640 -1 osd.4 0 waiting for initial osdmap 2023-11-04T01:35:44.613 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-11-04T01:35:44.611+0000 7fc5b8433640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:44.619 INFO:tasks.ceph.osd.4.smithi204.stderr:2023-11-04T01:35:44.617+0000 7f76d8205640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:44.640 INFO:tasks.ceph.osd.0.smithi044.stderr:2023-11-04T01:35:44.635+0000 7f8b6db95640 -1 osd.0 0 waiting for initial osdmap 2023-11-04T01:35:44.644 INFO:tasks.ceph.osd.6.smithi204.stderr:2023-11-04T01:35:44.642+0000 7fd2fada9640 -1 osd.6 0 waiting for initial osdmap 2023-11-04T01:35:44.654 INFO:tasks.ceph.osd.0.smithi044.stderr:2023-11-04T01:35:44.652+0000 7f8b659bc640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:44.661 INFO:tasks.ceph.osd.6.smithi204.stderr:2023-11-04T01:35:44.659+0000 7fd2f2bd0640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:44.704 INFO:tasks.ceph.osd.5.smithi204.stderr:2023-11-04T01:35:44.702+0000 7f4b53342640 -1 osd.5 0 waiting for initial osdmap 2023-11-04T01:35:44.716 INFO:tasks.ceph.osd.5.smithi204.stderr:2023-11-04T01:35:44.713+0000 7f4b4b169640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:44.717 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:35:44.718 INFO:tasks.ceph.osd.7.smithi204.stderr:2023-11-04T01:35:44.716+0000 7f2b27f24640 -1 osd.7 0 waiting for initial osdmap 2023-11-04T01:35:44.731 INFO:tasks.ceph.osd.7.smithi204.stderr:2023-11-04T01:35:44.729+0000 7f2b1fd4b640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:44.744 INFO:tasks.ceph.osd.3.smithi044.stderr:2023-11-04T01:35:44.741+0000 7fd9e2053640 -1 osd.3 0 waiting for initial osdmap 2023-11-04T01:35:44.758 INFO:tasks.ceph.osd.3.smithi044.stderr:2023-11-04T01:35:44.756+0000 7fd9d9e7a640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:44.833 INFO:tasks.ceph.osd.2.smithi044.stderr:2023-11-04T01:35:44.831+0000 7f7606d34640 -1 osd.2 0 waiting for initial osdmap 2023-11-04T01:35:44.837 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.835+0000 7f4037834640 1 Processor -- start 2023-11-04T01:35:44.837 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.835+0000 7f4037834640 1 -- start start 2023-11-04T01:35:44.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.836+0000 7f4037834640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40300abef0 0x7f40300b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:44.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.836+0000 7f4037834640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403006ae20 con 0x7f40300c28c0 2023-11-04T01:35:44.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.836+0000 7f4037834640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403006d5a0 con 0x7f403015d030 2023-11-04T01:35:44.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.836+0000 7f4037834640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403006a2a0 con 0x7f40300abef0 2023-11-04T01:35:44.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.836+0000 7f4035dd1640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f40300c28c0 0x7f403006da80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43058/0 (socket says 172.21.15.44:43058) 2023-11-04T01:35:44.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.836+0000 7f4035dd1640 1 -- 172.21.15.44:0/2240544367 learned_addr learned my addr 172.21.15.44:0/2240544367 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:35:44.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.836+0000 7f4034dcf640 1 --2- 172.21.15.44:0/2240544367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40300abef0 0x7f40300b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:44.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.837+0000 7f4027fff640 1 -- 172.21.15.44:0/2240544367 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507321932 0 0) 0x7f403006ae20 con 0x7f40300c28c0 2023-11-04T01:35:44.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.837+0000 7f4027fff640 1 -- 172.21.15.44:0/2240544367 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f401c003520 con 0x7f40300c28c0 2023-11-04T01:35:44.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.837+0000 7f4034dcf640 1 -- 172.21.15.44:0/2240544367 >> v1:172.21.15.204:6789/0 conn(0x7f403015d030 legacy=0x7f4030071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:44.839 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.837+0000 7f4027fff640 1 -- 172.21.15.44:0/2240544367 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914185329 0 0) 0x7f403006d5a0 con 0x7f403015d030 2023-11-04T01:35:44.840 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.837+0000 7f4034dcf640 1 -- 172.21.15.44:0/2240544367 >> v1:172.21.15.44:6789/0 conn(0x7f40300c28c0 legacy=0x7f403006da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:44.840 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.837+0000 7f4034dcf640 1 -- 172.21.15.44:0/2240544367 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403006a580 con 0x7f40300abef0 2023-11-04T01:35:44.841 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.837+0000 7f4034dcf640 1 --2- 172.21.15.44:0/2240544367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40300abef0 0x7f40300b0c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f40200097c0 tx=0x7f402002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abd62856c28ea9f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:44.841 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.838+0000 7f4027fff640 1 -- 172.21.15.44:0/2240544367 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4020031890 con 0x7f40300abef0 2023-11-04T01:35:44.841 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.838+0000 7f4027fff640 1 -- 172.21.15.44:0/2240544367 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40200319f0 con 0x7f40300abef0 2023-11-04T01:35:44.841 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.838+0000 7f4027fff640 1 -- 172.21.15.44:0/2240544367 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4020031d80 con 0x7f40300abef0 2023-11-04T01:35:44.841 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.838+0000 7f4037834640 1 -- 172.21.15.44:0/2240544367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40300abef0 msgr2=0x7f40300b0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:44.841 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.838+0000 7f4037834640 1 --2- 172.21.15.44:0/2240544367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40300abef0 0x7f40300b0c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f40200097c0 tx=0x7f402002b930 comp rx=0 tx=0).stop 2023-11-04T01:35:44.841 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.838+0000 7f4037834640 1 -- 172.21.15.44:0/2240544367 shutdown_connections 2023-11-04T01:35:44.841 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.838+0000 7f4037834640 1 --2- 172.21.15.44:0/2240544367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40300abef0 0x7f40300b0c40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:44.841 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.838+0000 7f4037834640 1 -- 172.21.15.44:0/2240544367 >> 172.21.15.44:0/2240544367 conn(0x7f40300cbc40 msgr2=0x7f40300cc050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:44.841 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.838+0000 7f4037834640 1 -- 172.21.15.44:0/2240544367 shutdown_connections 2023-11-04T01:35:44.842 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.838+0000 7f4037834640 1 -- 172.21.15.44:0/2240544367 wait complete. 2023-11-04T01:35:44.845 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.839+0000 7f4037834640 1 Processor -- start 2023-11-04T01:35:44.845 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.839+0000 7f4037834640 1 -- start start 2023-11-04T01:35:44.846 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.840+0000 7f4037834640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40300abef0 0x7f40301f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:44.846 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.840+0000 7f4037834640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40300c28c0 0x7f40301568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:44.846 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.840+0000 7f4037834640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f403015d030 0x7f40300c3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:44.846 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.840+0000 7f4037834640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40300cd840 con 0x7f40300c28c0 2023-11-04T01:35:44.847 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.840+0000 7f4037834640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40301572c0 con 0x7f403015d030 2023-11-04T01:35:44.847 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.840+0000 7f4037834640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40300ccea0 con 0x7f40300abef0 2023-11-04T01:35:44.847 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.840+0000 7f4034dcf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40300c28c0 0x7f40301568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:44.847 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.840+0000 7f4034dcf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40300c28c0 0x7f40301568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52710/0 (socket says 172.21.15.44:52710) 2023-11-04T01:35:44.847 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.840+0000 7f4034dcf640 1 -- 172.21.15.44:0/3786547440 learned_addr learned my addr 172.21.15.44:0/3786547440 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:44.847 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.840+0000 7f40355d0640 1 --2- 172.21.15.44:0/3786547440 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40300abef0 0x7f40301f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:44.848 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.840+0000 7f4035dd1640 1 --2- 172.21.15.44:0/3786547440 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f403015d030 0x7f40300c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:44.848 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.841+0000 7f4034dcf640 1 -- 172.21.15.44:0/3786547440 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40300abef0 msgr2=0x7f40301f20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:44.848 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.841+0000 7f4034dcf640 1 --2- 172.21.15.44:0/3786547440 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40300abef0 0x7f40301f20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:44.848 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.841+0000 7f4034dcf640 1 -- 172.21.15.44:0/3786547440 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f403015d030 msgr2=0x7f40300c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:44.848 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.841+0000 7f4034dcf640 1 --2- 172.21.15.44:0/3786547440 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f403015d030 0x7f40300c3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:44.848 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.841+0000 7f4034dcf640 1 -- 172.21.15.44:0/3786547440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40200093a0 con 0x7f40300c28c0 2023-11-04T01:35:44.848 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.841+0000 7f40355d0640 1 --2- 172.21.15.44:0/3786547440 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40300abef0 0x7f40301f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:44.848 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.841+0000 7f4034dcf640 1 --2- 172.21.15.44:0/3786547440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40300c28c0 0x7f40301568e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4020009710 tx=0x7f40200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:44.848 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.841+0000 7f4025ffb640 1 -- 172.21.15.44:0/3786547440 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4020005da0 con 0x7f40300c28c0 2023-11-04T01:35:44.848 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.841+0000 7f4025ffb640 1 -- 172.21.15.44:0/3786547440 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402003b860 con 0x7f40300c28c0 2023-11-04T01:35:44.848 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.841+0000 7f4025ffb640 1 -- 172.21.15.44:0/3786547440 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402003bbf0 con 0x7f40300c28c0 2023-11-04T01:35:44.848 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.841+0000 7f4037834640 1 -- 172.21.15.44:0/3786547440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40300cd180 con 0x7f40300c28c0 2023-11-04T01:35:44.848 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.841+0000 7f4037834640 1 -- 172.21.15.44:0/3786547440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40301f2620 con 0x7f40300c28c0 2023-11-04T01:35:44.849 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.842+0000 7f4037834640 1 -- 172.21.15.44:0/3786547440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40300b4030 con 0x7f40300c28c0 2023-11-04T01:35:44.849 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.843+0000 7f4025ffb640 1 -- 172.21.15.44:0/3786547440 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f402003bd50 con 0x7f40300c28c0 2023-11-04T01:35:44.849 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.843+0000 7f4025ffb640 1 --2- 172.21.15.44:0/3786547440 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f401406ade0 0x7f401406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:44.849 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.843+0000 7f4025ffb640 1 -- 172.21.15.44:0/3786547440 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f40200aad50 con 0x7f40300c28c0 2023-11-04T01:35:44.849 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.843+0000 7f40355d0640 1 --2- 172.21.15.44:0/3786547440 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f401406ade0 0x7f401406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:44.849 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.844+0000 7f40355d0640 1 --2- 172.21.15.44:0/3786547440 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f401406ade0 0x7f401406d2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f402c007fd0 tx=0x7f402c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:44.850 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:44.847+0000 7f4025ffb640 1 -- 172.21.15.44:0/3786547440 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4020076d30 con 0x7f40300c28c0 2023-11-04T01:35:44.850 INFO:tasks.ceph.osd.2.smithi044.stderr:2023-11-04T01:35:44.848+0000 7f75feb5b640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:45.029 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:45.026+0000 7f4037834640 1 -- 172.21.15.44:0/3786547440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f403004e490 con 0x7f40300c28c0 2023-11-04T01:35:45.030 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:45.026+0000 7f4025ffb640 1 -- 172.21.15.44:0/3786547440 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4020035020 con 0x7f40300c28c0 2023-11-04T01:35:45.030 INFO:teuthology.misc.health.smithi044.stdout: 2023-11-04T01:35:45.030 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":12,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:35:42.581127+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:35:45.031 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:45.028+0000 7f4037834640 1 -- 172.21.15.44:0/3786547440 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f401406ade0 msgr2=0x7f401406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.031 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:45.028+0000 7f4037834640 1 --2- 172.21.15.44:0/3786547440 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f401406ade0 0x7f401406d2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f402c007fd0 tx=0x7f402c009040 comp rx=0 tx=0).stop 2023-11-04T01:35:45.031 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:45.028+0000 7f4037834640 1 -- 172.21.15.44:0/3786547440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40300c28c0 msgr2=0x7f40301568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.031 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:45.028+0000 7f4037834640 1 --2- 172.21.15.44:0/3786547440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40300c28c0 0x7f40301568e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4020009710 tx=0x7f40200046c0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.031 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:45.028+0000 7f4037834640 1 -- 172.21.15.44:0/3786547440 shutdown_connections 2023-11-04T01:35:45.031 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:45.028+0000 7f4037834640 1 --2- 172.21.15.44:0/3786547440 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f401406ade0 0x7f401406d2a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.031 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:45.028+0000 7f4037834640 1 --2- 172.21.15.44:0/3786547440 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f403015d030 0x7f40300c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.032 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:45.028+0000 7f4037834640 1 --2- 172.21.15.44:0/3786547440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40300c28c0 0x7f40301568e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.032 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:45.028+0000 7f4037834640 1 --2- 172.21.15.44:0/3786547440 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40300abef0 0x7f40301f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.032 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:45.028+0000 7f4037834640 1 -- 172.21.15.44:0/3786547440 >> 172.21.15.44:0/3786547440 conn(0x7f40300cbc40 msgr2=0x7f4030157540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:45.032 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:45.028+0000 7f4037834640 1 -- 172.21.15.44:0/3786547440 shutdown_connections 2023-11-04T01:35:45.032 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:45.028+0000 7f4037834640 1 -- 172.21.15.44:0/3786547440 wait complete. 2023-11-04T01:35:45.040 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-04T01:35:51.854 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:35:51.956 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.954+0000 7f7d72bf5640 1 Processor -- start 2023-11-04T01:35:51.957 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.954+0000 7f7d72bf5640 1 -- start start 2023-11-04T01:35:51.958 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.955+0000 7f7d72bf5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7d6c15cd70 0x7f7d6c0ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:51.958 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.955+0000 7f7d72bf5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7d6c15d150 0x7f7d6c0b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:51.958 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.955+0000 7f7d72bf5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d6c06bc40 con 0x7f7d6c0cf1d0 2023-11-04T01:35:51.958 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.955+0000 7f7d72bf5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6c0ced70 con 0x7f7d6c15cd70 2023-11-04T01:35:51.958 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.955+0000 7f7d72bf5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6c0cf790 con 0x7f7d6c15d150 2023-11-04T01:35:51.959 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.955+0000 7f7d70991640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7d6c15cd70 0x7f7d6c0ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:51.959 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.955+0000 7f7d71192640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7d6c0cf1d0 0x7f7d6c160b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43072/0 (socket says 172.21.15.44:43072) 2023-11-04T01:35:51.959 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.955+0000 7f7d71192640 1 -- 172.21.15.44:0/1055952909 learned_addr learned my addr 172.21.15.44:0/1055952909 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:35:51.959 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.956+0000 7f7d6bfff640 1 --2- 172.21.15.44:0/1055952909 >> v2:172.21.15.204:3300/0 conn(0x7f7d6c15d150 0x7f7d6c0b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:51.959 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.956+0000 7f7d70991640 1 -- 172.21.15.44:0/1055952909 >> v2:172.21.15.204:3300/0 conn(0x7f7d6c15d150 msgr2=0x7f7d6c0b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:51.959 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.956+0000 7f7d70991640 1 --2- 172.21.15.44:0/1055952909 >> v2:172.21.15.204:3300/0 conn(0x7f7d6c15d150 0x7f7d6c0b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.959 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.956+0000 7f7d70991640 1 -- 172.21.15.44:0/1055952909 >> v1:172.21.15.44:6789/0 conn(0x7f7d6c0cf1d0 legacy=0x7f7d6c160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:51.959 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.956+0000 7f7d70991640 1 -- 172.21.15.44:0/1055952909 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c06be90 con 0x7f7d6c15cd70 2023-11-04T01:35:51.959 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.956+0000 7f7d6b7fe640 1 -- 172.21.15.44:0/1055952909 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150325125 0 0) 0x7f7d6c06bc40 con 0x7f7d6c0cf1d0 2023-11-04T01:35:51.959 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.956+0000 7f7d6bfff640 1 --2- 172.21.15.44:0/1055952909 >> v2:172.21.15.204:3300/0 conn(0x7f7d6c15d150 0x7f7d6c0b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:51.963 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.957+0000 7f7d70991640 1 --2- 172.21.15.44:0/1055952909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d6c15cd70 0x7f7d6c0ce830 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c06fb00 tx=0x7f7d6002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b0c99ec8470b39 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:51.963 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.957+0000 7f7d6b7fe640 1 -- 172.21.15.44:0/1055952909 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6002e070 con 0x7f7d6c15cd70 2023-11-04T01:35:51.963 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.957+0000 7f7d6b7fe640 1 -- 172.21.15.44:0/1055952909 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d600315a0 con 0x7f7d6c15cd70 2023-11-04T01:35:51.963 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.957+0000 7f7d6b7fe640 1 -- 172.21.15.44:0/1055952909 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60031930 con 0x7f7d6c15cd70 2023-11-04T01:35:51.963 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.957+0000 7f7d72bf5640 1 -- 172.21.15.44:0/1055952909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d6c15cd70 msgr2=0x7f7d6c0ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:51.963 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.957+0000 7f7d72bf5640 1 --2- 172.21.15.44:0/1055952909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d6c15cd70 0x7f7d6c0ce830 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c06fb00 tx=0x7f7d6002b840 comp rx=0 tx=0).stop 2023-11-04T01:35:51.964 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.957+0000 7f7d72bf5640 1 -- 172.21.15.44:0/1055952909 shutdown_connections 2023-11-04T01:35:51.964 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.957+0000 7f7d72bf5640 1 --2- 172.21.15.44:0/1055952909 >> v2:172.21.15.204:3300/0 conn(0x7f7d6c15d150 0x7f7d6c0b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.964 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.957+0000 7f7d72bf5640 1 --2- 172.21.15.44:0/1055952909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d6c15cd70 0x7f7d6c0ce830 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.964 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.957+0000 7f7d72bf5640 1 -- 172.21.15.44:0/1055952909 >> 172.21.15.44:0/1055952909 conn(0x7f7d6c06ea40 msgr2=0x7f7d6c06ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:51.964 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.957+0000 7f7d72bf5640 1 -- 172.21.15.44:0/1055952909 shutdown_connections 2023-11-04T01:35:51.964 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.957+0000 7f7d72bf5640 1 -- 172.21.15.44:0/1055952909 wait complete. 2023-11-04T01:35:51.964 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.959+0000 7f7d72bf5640 1 Processor -- start 2023-11-04T01:35:51.964 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.959+0000 7f7d72bf5640 1 -- start start 2023-11-04T01:35:51.964 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.959+0000 7f7d72bf5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d6c0cf1d0 0x7f7d6c159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:51.964 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.959+0000 7f7d72bf5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d6c15cd70 0x7f7d6c15f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:51.964 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.959+0000 7f7d72bf5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7d6c15d150 0x7f7d6c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:51.965 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.959+0000 7f7d72bf5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c15a120 con 0x7f7d6c0cf1d0 2023-11-04T01:35:51.965 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d72bf5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0b4800 con 0x7f7d6c15cd70 2023-11-04T01:35:51.965 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d72bf5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0b6630 con 0x7f7d6c15d150 2023-11-04T01:35:51.965 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d70991640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d6c0cf1d0 0x7f7d6c159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:51.989 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d70991640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d6c0cf1d0 0x7f7d6c159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52726/0 (socket says 172.21.15.44:52726) 2023-11-04T01:35:51.989 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d70991640 1 -- 172.21.15.44:0/1489597242 learned_addr learned my addr 172.21.15.44:0/1489597242 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:51.989 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d6bfff640 1 --2- 172.21.15.44:0/1489597242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d6c15cd70 0x7f7d6c15f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:51.990 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d70991640 1 -- 172.21.15.44:0/1489597242 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7d6c15d150 msgr2=0x7f7d6c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:51.990 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d70991640 1 --2- 172.21.15.44:0/1489597242 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7d6c15d150 0x7f7d6c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.990 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d70991640 1 -- 172.21.15.44:0/1489597242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d6c15cd70 msgr2=0x7f7d6c15f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:51.990 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d70991640 1 --2- 172.21.15.44:0/1489597242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d6c15cd70 0x7f7d6c15f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.990 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d70991640 1 -- 172.21.15.44:0/1489597242 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d60009400 con 0x7f7d6c0cf1d0 2023-11-04T01:35:51.990 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d70991640 1 --2- 172.21.15.44:0/1489597242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d6c0cf1d0 0x7f7d6c159780 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7d60034040 tx=0x7f7d600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:51.990 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d697fa640 1 -- 172.21.15.44:0/1489597242 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60004230 con 0x7f7d6c0cf1d0 2023-11-04T01:35:51.990 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d697fa640 1 -- 172.21.15.44:0/1489597242 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d60031f00 con 0x7f7d6c0cf1d0 2023-11-04T01:35:51.990 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d72bf5640 1 -- 172.21.15.44:0/1489597242 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6c0b4ac0 con 0x7f7d6c0cf1d0 2023-11-04T01:35:51.990 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d697fa640 1 -- 172.21.15.44:0/1489597242 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60032640 con 0x7f7d6c0cf1d0 2023-11-04T01:35:51.990 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.960+0000 7f7d72bf5640 1 -- 172.21.15.44:0/1489597242 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6c0b5080 con 0x7f7d6c0cf1d0 2023-11-04T01:35:51.992 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.962+0000 7f7d72bf5640 1 -- 172.21.15.44:0/1489597242 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6c04e490 con 0x7f7d6c0cf1d0 2023-11-04T01:35:51.992 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.962+0000 7f7d697fa640 1 -- 172.21.15.44:0/1489597242 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d600327a0 con 0x7f7d6c0cf1d0 2023-11-04T01:35:51.992 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.962+0000 7f7d697fa640 1 --2- 172.21.15.44:0/1489597242 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7d5006ae70 0x7f7d5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:51.992 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.963+0000 7f7d697fa640 1 -- 172.21.15.44:0/1489597242 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7d600ab380 con 0x7f7d6c0cf1d0 2023-11-04T01:35:51.992 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.963+0000 7f7d6bfff640 1 --2- 172.21.15.44:0/1489597242 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7d5006ae70 0x7f7d5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:51.992 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.963+0000 7f7d6bfff640 1 --2- 172.21.15.44:0/1489597242 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7d5006ae70 0x7f7d5006d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c159540 tx=0x7f7d58008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:51.992 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:51.967+0000 7f7d697fa640 1 -- 172.21.15.44:0/1489597242 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7d60076780 con 0x7f7d6c0cf1d0 2023-11-04T01:35:52.146 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:52.143+0000 7f7d72bf5640 1 -- 172.21.15.44:0/1489597242 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d6c0c7800 con 0x7f7d6c0cf1d0 2023-11-04T01:35:52.147 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:52.144+0000 7f7d697fa640 1 -- 172.21.15.44:0/1489597242 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f7d60079da0 con 0x7f7d6c0cf1d0 2023-11-04T01:35:52.147 INFO:teuthology.misc.health.smithi044.stdout: 2023-11-04T01:35:52.147 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":16,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:35:48.637693+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:35:52.148 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:52.146+0000 7f7d72bf5640 1 -- 172.21.15.44:0/1489597242 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7d5006ae70 msgr2=0x7f7d5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.149 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:52.146+0000 7f7d72bf5640 1 --2- 172.21.15.44:0/1489597242 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7d5006ae70 0x7f7d5006d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c159540 tx=0x7f7d58008040 comp rx=0 tx=0).stop 2023-11-04T01:35:52.149 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:52.146+0000 7f7d72bf5640 1 -- 172.21.15.44:0/1489597242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d6c0cf1d0 msgr2=0x7f7d6c159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.149 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:52.146+0000 7f7d72bf5640 1 --2- 172.21.15.44:0/1489597242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d6c0cf1d0 0x7f7d6c159780 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7d60034040 tx=0x7f7d600046c0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.149 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:52.146+0000 7f7d72bf5640 1 -- 172.21.15.44:0/1489597242 shutdown_connections 2023-11-04T01:35:52.149 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:52.146+0000 7f7d72bf5640 1 --2- 172.21.15.44:0/1489597242 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7d5006ae70 0x7f7d5006d330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.149 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:52.146+0000 7f7d72bf5640 1 --2- 172.21.15.44:0/1489597242 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7d6c15d150 0x7f7d6c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.149 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:52.146+0000 7f7d72bf5640 1 --2- 172.21.15.44:0/1489597242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d6c15cd70 0x7f7d6c15f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.149 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:52.146+0000 7f7d72bf5640 1 --2- 172.21.15.44:0/1489597242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d6c0cf1d0 0x7f7d6c159780 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.149 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:52.146+0000 7f7d72bf5640 1 -- 172.21.15.44:0/1489597242 >> 172.21.15.44:0/1489597242 conn(0x7f7d6c06ea40 msgr2=0x7f7d6c15c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:52.149 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:52.146+0000 7f7d72bf5640 1 -- 172.21.15.44:0/1489597242 shutdown_connections 2023-11-04T01:35:52.150 INFO:teuthology.misc.health.smithi044.stderr:2023-11-04T01:35:52.146+0000 7f7d72bf5640 1 -- 172.21.15.44:0/1489597242 wait complete. 2023-11-04T01:35:52.159 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-04T01:35:52.159 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-04T01:35:52.160 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:35:52.160 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:35:52.162 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:35:52.163 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:35:52.163 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:35:52.170 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:35:52.170 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:35:52.170 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:35:52.175 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:35:52.175 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:35:52.175 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:35:52.182 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:35:52.182 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-04T01:35:52.182 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:35:52.241 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2023-11-04T01:35:52.246 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2023-11-04T01:35:52.264 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2023-11-04T01:35:52.264 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2023-11-04T01:35:52.265 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:35:52.263+0000 7f99fca41640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-11-04T01:35:52.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.296+0000 7fc77ee7c640 1 Processor -- start 2023-11-04T01:35:52.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.296+0000 7fc77ee7c640 1 -- start start 2023-11-04T01:35:52.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc77ee7c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc7780cde60 0x7fc77815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc77ee7c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc77815daa0 0x7fc778157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc77ee7c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7780ce240 0x7fc778157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc77ee7c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77815e5c0 con 0x7fc77815daa0 2023-11-04T01:35:52.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc77ee7c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc778157a80 con 0x7fc7780cde60 2023-11-04T01:35:52.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc77ee7c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77815e000 con 0x7fc7780ce240 2023-11-04T01:35:52.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc777fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc77815daa0 0x7fc778157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc777fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc77815daa0 0x7fc778157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52760/0 (socket says 172.21.15.44:52760) 2023-11-04T01:35:52.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc777fff640 1 -- 172.21.15.44:0/2273684686 learned_addr learned my addr 172.21.15.44:0/2273684686 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:52.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc77d419640 1 --2- 172.21.15.44:0/2273684686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7780ce240 0x7fc778157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc77cc18640 1 --2- 172.21.15.44:0/2273684686 >> v2:172.21.15.204:3300/0 conn(0x7fc7780cde60 0x7fc77815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc777fff640 1 -- 172.21.15.44:0/2273684686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7780ce240 msgr2=0x7fc778157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:52.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc777fff640 1 --2- 172.21.15.44:0/2273684686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7780ce240 0x7fc778157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc777fff640 1 -- 172.21.15.44:0/2273684686 >> v2:172.21.15.204:3300/0 conn(0x7fc7780cde60 msgr2=0x7fc77815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:52.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc777fff640 1 --2- 172.21.15.44:0/2273684686 >> v2:172.21.15.204:3300/0 conn(0x7fc7780cde60 0x7fc77815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc777fff640 1 -- 172.21.15.44:0/2273684686 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77815e2e0 con 0x7fc77815daa0 2023-11-04T01:35:52.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.297+0000 7fc77cc18640 1 --2- 172.21.15.44:0/2273684686 >> v2:172.21.15.204:3300/0 conn(0x7fc7780cde60 0x7fc77815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:35:52.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.298+0000 7fc777fff640 1 --2- 172.21.15.44:0/2273684686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77815daa0 0x7fc778157000 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc7780b5550 tx=0x7fc76c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85325c7745e1f391 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:52.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.298+0000 7fc7777fe640 1 -- 172.21.15.44:0/2273684686 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c031870 con 0x7fc77815daa0 2023-11-04T01:35:52.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.298+0000 7fc7777fe640 1 -- 172.21.15.44:0/2273684686 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c0319d0 con 0x7fc77815daa0 2023-11-04T01:35:52.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.298+0000 7fc7777fe640 1 -- 172.21.15.44:0/2273684686 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c031d60 con 0x7fc77815daa0 2023-11-04T01:35:52.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.299+0000 7fc77ee7c640 1 -- 172.21.15.44:0/2273684686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77815daa0 msgr2=0x7fc778157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.299+0000 7fc77ee7c640 1 --2- 172.21.15.44:0/2273684686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77815daa0 0x7fc778157000 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc7780b5550 tx=0x7fc76c02b910 comp rx=0 tx=0).stop 2023-11-04T01:35:52.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.299+0000 7fc77ee7c640 1 -- 172.21.15.44:0/2273684686 shutdown_connections 2023-11-04T01:35:52.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.299+0000 7fc77ee7c640 1 --2- 172.21.15.44:0/2273684686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7780ce240 0x7fc778157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.299+0000 7fc77ee7c640 1 --2- 172.21.15.44:0/2273684686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77815daa0 0x7fc778157000 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.299+0000 7fc77ee7c640 1 --2- 172.21.15.44:0/2273684686 >> v2:172.21.15.204:3300/0 conn(0x7fc7780cde60 0x7fc77815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.299+0000 7fc77ee7c640 1 -- 172.21.15.44:0/2273684686 >> 172.21.15.44:0/2273684686 conn(0x7fc778071f30 msgr2=0x7fc7780cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:52.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.299+0000 7fc77ee7c640 1 -- 172.21.15.44:0/2273684686 shutdown_connections 2023-11-04T01:35:52.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.299+0000 7fc77ee7c640 1 -- 172.21.15.44:0/2273684686 wait complete. 2023-11-04T01:35:52.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.300+0000 7fc77ee7c640 1 Processor -- start 2023-11-04T01:35:52.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.300+0000 7fc77ee7c640 1 -- start start 2023-11-04T01:35:52.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77ee7c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7780cde60 0x7fc778152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77ee7c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7780ce240 0x7fc77815a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77ee7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77815daa0 0x7fc77815ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77ee7c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780cc900 con 0x7fc77815daa0 2023-11-04T01:35:52.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77ee7c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780cbcf0 con 0x7fc7780cde60 2023-11-04T01:35:52.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77ee7c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780cbfd0 con 0x7fc7780ce240 2023-11-04T01:35:52.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77d419640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77815daa0 0x7fc77815ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77d419640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77815daa0 0x7fc77815ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52774/0 (socket says 172.21.15.44:52774) 2023-11-04T01:35:52.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77d419640 1 -- 172.21.15.44:0/957145701 learned_addr learned my addr 172.21.15.44:0/957145701 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:52.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc777fff640 1 --2- 172.21.15.44:0/957145701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7780ce240 0x7fc77815a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77cc18640 1 --2- 172.21.15.44:0/957145701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7780cde60 0x7fc778152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77d419640 1 -- 172.21.15.44:0/957145701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7780ce240 msgr2=0x7fc77815a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77d419640 1 --2- 172.21.15.44:0/957145701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7780ce240 0x7fc77815a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77d419640 1 -- 172.21.15.44:0/957145701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7780cde60 msgr2=0x7fc778152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77d419640 1 --2- 172.21.15.44:0/957145701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7780cde60 0x7fc778152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77d419640 1 -- 172.21.15.44:0/957145701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c0094d0 con 0x7fc77815daa0 2023-11-04T01:35:52.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc777fff640 1 --2- 172.21.15.44:0/957145701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7780ce240 0x7fc77815a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:52.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.301+0000 7fc77d419640 1 --2- 172.21.15.44:0/957145701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77815daa0 0x7fc77815ae80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc770007e30 tx=0x7fc77000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:52.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.302+0000 7fc7757fa640 1 -- 172.21.15.44:0/957145701 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770014620 con 0x7fc77815daa0 2023-11-04T01:35:52.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.302+0000 7fc7757fa640 1 -- 172.21.15.44:0/957145701 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77000ee90 con 0x7fc77815daa0 2023-11-04T01:35:52.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.302+0000 7fc77ee7c640 1 -- 172.21.15.44:0/957145701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7780cc2b0 con 0x7fc77815daa0 2023-11-04T01:35:52.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.302+0000 7fc7757fa640 1 -- 172.21.15.44:0/957145701 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7700149c0 con 0x7fc77815daa0 2023-11-04T01:35:52.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.302+0000 7fc77ee7c640 1 -- 172.21.15.44:0/957145701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc778152cb0 con 0x7fc77815daa0 2023-11-04T01:35:52.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.303+0000 7fc77ee7c640 1 -- 172.21.15.44:0/957145701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7780cca70 con 0x7fc77815daa0 2023-11-04T01:35:52.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.303+0000 7fc7757fa640 1 -- 172.21.15.44:0/957145701 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc770014b20 con 0x7fc77815daa0 2023-11-04T01:35:52.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.303+0000 7fc7757fa640 1 --2- 172.21.15.44:0/957145701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc76406ae70 0x7fc76406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.303+0000 7fc7757fa640 1 -- 172.21.15.44:0/957145701 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc770089d00 con 0x7fc77815daa0 2023-11-04T01:35:52.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.304+0000 7fc77cc18640 1 --2- 172.21.15.44:0/957145701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc76406ae70 0x7fc76406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.304+0000 7fc77cc18640 1 --2- 172.21.15.44:0/957145701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc76406ae70 0x7fc76406d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc768006b10 tx=0x7fc768008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:52.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.308+0000 7fc7757fa640 1 -- 172.21.15.44:0/957145701 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc770055100 con 0x7fc77815daa0 2023-11-04T01:35:52.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.485+0000 7fc77ee7c640 1 -- 172.21.15.44:0/957145701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc778074290 con 0x7fc77815daa0 2023-11-04T01:35:52.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.486+0000 7fc7757fa640 1 -- 172.21.15.44:0/957145701 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7fc770058720 con 0x7fc77815daa0 2023-11-04T01:35:52.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:35:52.489 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":16,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:35:48.637693+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:35:52.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.488+0000 7fc77ee7c640 1 -- 172.21.15.44:0/957145701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc76406ae70 msgr2=0x7fc76406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.488+0000 7fc77ee7c640 1 --2- 172.21.15.44:0/957145701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc76406ae70 0x7fc76406d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc768006b10 tx=0x7fc768008040 comp rx=0 tx=0).stop 2023-11-04T01:35:52.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.488+0000 7fc77ee7c640 1 -- 172.21.15.44:0/957145701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77815daa0 msgr2=0x7fc77815ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.488+0000 7fc77ee7c640 1 --2- 172.21.15.44:0/957145701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77815daa0 0x7fc77815ae80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc770007e30 tx=0x7fc77000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.488+0000 7fc77ee7c640 1 -- 172.21.15.44:0/957145701 shutdown_connections 2023-11-04T01:35:52.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.488+0000 7fc77ee7c640 1 --2- 172.21.15.44:0/957145701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc76406ae70 0x7fc76406d330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.488+0000 7fc77ee7c640 1 --2- 172.21.15.44:0/957145701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77815daa0 0x7fc77815ae80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.488+0000 7fc77ee7c640 1 --2- 172.21.15.44:0/957145701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7780ce240 0x7fc77815a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.488+0000 7fc77ee7c640 1 --2- 172.21.15.44:0/957145701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7780cde60 0x7fc778152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.488+0000 7fc77ee7c640 1 -- 172.21.15.44:0/957145701 >> 172.21.15.44:0/957145701 conn(0x7fc778071f30 msgr2=0x7fc7780d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:52.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.488+0000 7fc77ee7c640 1 -- 172.21.15.44:0/957145701 shutdown_connections 2023-11-04T01:35:52.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.488+0000 7fc77ee7c640 1 -- 172.21.15.44:0/957145701 wait complete. 2023-11-04T01:35:52.501 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:35:52.501 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:35:52.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.609+0000 7f119244f640 1 Processor -- start 2023-11-04T01:35:52.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.610+0000 7f119244f640 1 -- start start 2023-11-04T01:35:52.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.610+0000 7f119244f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f118c15e1b0 0x7f118c0ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.610+0000 7f119244f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f118c15e590 0x7f118c0722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.610+0000 7f119244f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c0ca620 con 0x7f118c0b21f0 2023-11-04T01:35:52.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.610+0000 7f119244f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c06e7e0 con 0x7f118c15e1b0 2023-11-04T01:35:52.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.610+0000 7f119244f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0cb060 con 0x7f118c15e590 2023-11-04T01:35:52.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.611+0000 7f11909ec640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f118c0b21f0 0x7f118c06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45308/0 (socket says 172.21.15.44:45308) 2023-11-04T01:35:52.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.611+0000 7f11909ec640 1 -- 172.21.15.44:0/785483195 learned_addr learned my addr 172.21.15.44:0/785483195 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:35:52.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.611+0000 7f118bfff640 1 --2- 172.21.15.44:0/785483195 >> v2:172.21.15.204:3300/0 conn(0x7f118c15e1b0 0x7f118c0ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.611+0000 7f118b7fe640 1 --2- 172.21.15.44:0/785483195 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f118c15e590 0x7f118c0722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.611+0000 7f118affd640 1 -- 172.21.15.44:0/785483195 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391386279 0 0) 0x7f118c0ca620 con 0x7f118c0b21f0 2023-11-04T01:35:52.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.611+0000 7f118affd640 1 -- 172.21.15.44:0/785483195 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1174003520 con 0x7f118c0b21f0 2023-11-04T01:35:52.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.611+0000 7f118b7fe640 1 -- 172.21.15.44:0/785483195 >> v2:172.21.15.204:3300/0 conn(0x7f118c15e1b0 msgr2=0x7f118c0ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:52.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.611+0000 7f118b7fe640 1 --2- 172.21.15.44:0/785483195 >> v2:172.21.15.204:3300/0 conn(0x7f118c15e1b0 0x7f118c0ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.611+0000 7f118b7fe640 1 -- 172.21.15.44:0/785483195 >> v1:172.21.15.44:6789/0 conn(0x7f118c0b21f0 legacy=0x7f118c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.611+0000 7f118b7fe640 1 -- 172.21.15.44:0/785483195 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c0ca060 con 0x7f118c15e590 2023-11-04T01:35:52.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.611+0000 7f118bfff640 1 --2- 172.21.15.44:0/785483195 >> v2:172.21.15.204:3300/0 conn(0x7f118c15e1b0 0x7f118c0ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:52.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.612+0000 7f118b7fe640 1 --2- 172.21.15.44:0/785483195 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f118c15e590 0x7f118c0722d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f117c0097a0 tx=0x7f117c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e953b31346dd1d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:52.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.612+0000 7f118affd640 1 -- 172.21.15.44:0/785483195 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c02e070 con 0x7f118c15e590 2023-11-04T01:35:52.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.612+0000 7f118affd640 1 -- 172.21.15.44:0/785483195 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c0315a0 con 0x7f118c15e590 2023-11-04T01:35:52.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.612+0000 7f118affd640 1 -- 172.21.15.44:0/785483195 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c031910 con 0x7f118c15e590 2023-11-04T01:35:52.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.612+0000 7f119244f640 1 -- 172.21.15.44:0/785483195 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f118c15e590 msgr2=0x7f118c0722d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.612+0000 7f119244f640 1 --2- 172.21.15.44:0/785483195 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f118c15e590 0x7f118c0722d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f117c0097a0 tx=0x7f117c02b840 comp rx=0 tx=0).stop 2023-11-04T01:35:52.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.612+0000 7f119244f640 1 -- 172.21.15.44:0/785483195 shutdown_connections 2023-11-04T01:35:52.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.612+0000 7f119244f640 1 --2- 172.21.15.44:0/785483195 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f118c15e590 0x7f118c0722d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.612+0000 7f119244f640 1 --2- 172.21.15.44:0/785483195 >> v2:172.21.15.204:3300/0 conn(0x7f118c15e1b0 0x7f118c0ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.612+0000 7f119244f640 1 -- 172.21.15.44:0/785483195 >> 172.21.15.44:0/785483195 conn(0x7f118c06d800 msgr2=0x7f118c06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:52.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.613+0000 7f119244f640 1 -- 172.21.15.44:0/785483195 shutdown_connections 2023-11-04T01:35:52.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.613+0000 7f119244f640 1 -- 172.21.15.44:0/785483195 wait complete. 2023-11-04T01:35:52.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.614+0000 7f119244f640 1 Processor -- start 2023-11-04T01:35:52.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.614+0000 7f119244f640 1 -- start start 2023-11-04T01:35:52.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f119244f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f118c0b21f0 0x7f118c151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f119244f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f118c15e1b0 0x7f118c1f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f119244f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f118c15e590 0x7f118c1e4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f119244f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c1f0440 con 0x7f118c0b21f0 2023-11-04T01:35:52.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f119244f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c1f0700 con 0x7f118c15e590 2023-11-04T01:35:52.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f119244f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c1f09e0 con 0x7f118c15e1b0 2023-11-04T01:35:52.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f118bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f118c0b21f0 0x7f118c151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f118bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f118c0b21f0 0x7f118c151a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39724/0 (socket says 172.21.15.44:39724) 2023-11-04T01:35:52.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f118bfff640 1 -- 172.21.15.44:0/3943448307 learned_addr learned my addr 172.21.15.44:0/3943448307 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:52.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f118b7fe640 1 --2- 172.21.15.44:0/3943448307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f118c15e1b0 0x7f118c1f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f118bfff640 1 -- 172.21.15.44:0/3943448307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f118c15e1b0 msgr2=0x7f118c1f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f118bfff640 1 --2- 172.21.15.44:0/3943448307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f118c15e1b0 0x7f118c1f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f118bfff640 1 -- 172.21.15.44:0/3943448307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f118c15e590 msgr2=0x7f118c1e4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f11909ec640 1 --2- 172.21.15.44:0/3943448307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f118c15e590 0x7f118c1e4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f118bfff640 1 --2- 172.21.15.44:0/3943448307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f118c15e590 0x7f118c1e4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f118bfff640 1 -- 172.21.15.44:0/3943448307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1180009400 con 0x7f118c0b21f0 2023-11-04T01:35:52.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f11909ec640 1 --2- 172.21.15.44:0/3943448307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f118c15e590 0x7f118c1e4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:35:52.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f118bfff640 1 --2- 172.21.15.44:0/3943448307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f118c0b21f0 0x7f118c151a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f118000ebe0 tx=0x7f118000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:52.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f1188ff9640 1 -- 172.21.15.44:0/3943448307 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180009760 con 0x7f118c0b21f0 2023-11-04T01:35:52.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f1188ff9640 1 -- 172.21.15.44:0/3943448307 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118000cc30 con 0x7f118c0b21f0 2023-11-04T01:35:52.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f1188ff9640 1 -- 172.21.15.44:0/3943448307 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118000eee0 con 0x7f118c0b21f0 2023-11-04T01:35:52.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f119244f640 1 -- 172.21.15.44:0/3943448307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117c009400 con 0x7f118c0b21f0 2023-11-04T01:35:52.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.615+0000 7f119244f640 1 -- 172.21.15.44:0/3943448307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c1f0fa0 con 0x7f118c0b21f0 2023-11-04T01:35:52.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.616+0000 7f119244f640 1 -- 172.21.15.44:0/3943448307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c06ddf0 con 0x7f118c0b21f0 2023-11-04T01:35:52.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.617+0000 7f1188ff9640 1 -- 172.21.15.44:0/3943448307 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1180013470 con 0x7f118c0b21f0 2023-11-04T01:35:52.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.617+0000 7f1188ff9640 1 --2- 172.21.15.44:0/3943448307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f117806ae70 0x7f117806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.617+0000 7f1188ff9640 1 -- 172.21.15.44:0/3943448307 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f11800895b0 con 0x7f118c0b21f0 2023-11-04T01:35:52.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.617+0000 7f118b7fe640 1 --2- 172.21.15.44:0/3943448307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f117806ae70 0x7f117806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.618+0000 7f118b7fe640 1 --2- 172.21.15.44:0/3943448307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f117806ae70 0x7f117806d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f117c036000 tx=0x7f117c03d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:52.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.621+0000 7f1188ff9640 1 -- 172.21.15.44:0/3943448307 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f11800549b0 con 0x7f118c0b21f0 2023-11-04T01:35:52.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.797+0000 7f119244f640 1 -- 172.21.15.44:0/3943448307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f118c15cf10 con 0x7f118c0b21f0 2023-11-04T01:35:52.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.797+0000 7f1188ff9640 1 -- 172.21.15.44:0/3943448307 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1180057fd0 con 0x7f118c0b21f0 2023-11-04T01:35:52.800 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:35:52.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.799+0000 7f119244f640 1 -- 172.21.15.44:0/3943448307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f117806ae70 msgr2=0x7f117806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.799+0000 7f119244f640 1 --2- 172.21.15.44:0/3943448307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f117806ae70 0x7f117806d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f117c036000 tx=0x7f117c03d040 comp rx=0 tx=0).stop 2023-11-04T01:35:52.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.799+0000 7f119244f640 1 -- 172.21.15.44:0/3943448307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f118c0b21f0 msgr2=0x7f118c151a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.799+0000 7f119244f640 1 --2- 172.21.15.44:0/3943448307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f118c0b21f0 0x7f118c151a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f118000ebe0 tx=0x7f118000c520 comp rx=0 tx=0).stop 2023-11-04T01:35:52.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.799+0000 7f119244f640 1 -- 172.21.15.44:0/3943448307 shutdown_connections 2023-11-04T01:35:52.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.799+0000 7f119244f640 1 --2- 172.21.15.44:0/3943448307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f117806ae70 0x7f117806d330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.799+0000 7f119244f640 1 --2- 172.21.15.44:0/3943448307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f118c15e590 0x7f118c1e4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.799+0000 7f119244f640 1 --2- 172.21.15.44:0/3943448307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f118c15e1b0 0x7f118c1f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.799+0000 7f119244f640 1 --2- 172.21.15.44:0/3943448307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f118c0b21f0 0x7f118c151a80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.799+0000 7f119244f640 1 -- 172.21.15.44:0/3943448307 >> 172.21.15.44:0/3943448307 conn(0x7f118c06d800 msgr2=0x7f118c0b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:52.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.799+0000 7f119244f640 1 -- 172.21.15.44:0/3943448307 shutdown_connections 2023-11-04T01:35:52.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.799+0000 7f119244f640 1 -- 172.21.15.44:0/3943448307 wait complete. 2023-11-04T01:35:52.818 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:35:52.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.925+0000 7f81e61e7640 1 Processor -- start 2023-11-04T01:35:52.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.925+0000 7f81e61e7640 1 -- start start 2023-11-04T01:35:52.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.926+0000 7f81e61e7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f81e015ad80 0x7f81e006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.926+0000 7f81e61e7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81e00c9e10 0x7f81e00b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.926+0000 7f81e61e7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e006cd00 con 0x7f81e00b42c0 2023-11-04T01:35:52.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.926+0000 7f81e61e7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e006cfa0 con 0x7f81e015ad80 2023-11-04T01:35:52.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.926+0000 7f81e61e7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e006d280 con 0x7f81e00c9e10 2023-11-04T01:35:52.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.926+0000 7f81df7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f81e015ad80 0x7f81e006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.926+0000 7f81deffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f81e00b42c0 0x7f81e00c9700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45320/0 (socket says 172.21.15.44:45320) 2023-11-04T01:35:52.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.926+0000 7f81df7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f81e015ad80 0x7f81e006c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39732/0 (socket says 172.21.15.44:39732) 2023-11-04T01:35:52.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.926+0000 7f81deffd640 1 -- 172.21.15.44:0/4077298757 learned_addr learned my addr 172.21.15.44:0/4077298757 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:35:52.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.927+0000 7f81dffff640 1 --2- 172.21.15.44:0/4077298757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81e00c9e10 0x7f81e00b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.927+0000 7f81df7fe640 1 -- 172.21.15.44:0/4077298757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81e00c9e10 msgr2=0x7f81e00b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:52.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.927+0000 7f81df7fe640 1 --2- 172.21.15.44:0/4077298757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81e00c9e10 0x7f81e00b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.927+0000 7f81df7fe640 1 -- 172.21.15.44:0/4077298757 >> v1:172.21.15.44:6789/0 conn(0x7f81e00b42c0 legacy=0x7f81e00c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.927+0000 7f81df7fe640 1 -- 172.21.15.44:0/4077298757 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e006d560 con 0x7f81e015ad80 2023-11-04T01:35:52.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.927+0000 7f81de7fc640 1 -- 172.21.15.44:0/4077298757 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976268638 0 0) 0x7f81e006cd00 con 0x7f81e00b42c0 2023-11-04T01:35:52.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.927+0000 7f81df7fe640 1 --2- 172.21.15.44:0/4077298757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81e015ad80 0x7f81e006c7c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81d00097a0 tx=0x7f81d002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9798aa4af14801b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:52.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.927+0000 7f81de7fc640 1 -- 172.21.15.44:0/4077298757 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0030610 con 0x7f81e015ad80 2023-11-04T01:35:52.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.928+0000 7f81de7fc640 1 -- 172.21.15.44:0/4077298757 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d0030770 con 0x7f81e015ad80 2023-11-04T01:35:52.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.928+0000 7f81de7fc640 1 -- 172.21.15.44:0/4077298757 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0030b00 con 0x7f81e015ad80 2023-11-04T01:35:52.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.928+0000 7f81e61e7640 1 -- 172.21.15.44:0/4077298757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81e015ad80 msgr2=0x7f81e006c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.928+0000 7f81e61e7640 1 --2- 172.21.15.44:0/4077298757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81e015ad80 0x7f81e006c7c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81d00097a0 tx=0x7f81d002b960 comp rx=0 tx=0).stop 2023-11-04T01:35:52.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.928+0000 7f81e61e7640 1 -- 172.21.15.44:0/4077298757 shutdown_connections 2023-11-04T01:35:52.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.928+0000 7f81e61e7640 1 --2- 172.21.15.44:0/4077298757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81e00c9e10 0x7f81e00b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.928+0000 7f81e61e7640 1 --2- 172.21.15.44:0/4077298757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81e015ad80 0x7f81e006c7c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.928+0000 7f81e61e7640 1 -- 172.21.15.44:0/4077298757 >> 172.21.15.44:0/4077298757 conn(0x7f81e00ce950 msgr2=0x7f81e00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:52.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.928+0000 7f81e61e7640 1 -- 172.21.15.44:0/4077298757 shutdown_connections 2023-11-04T01:35:52.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.928+0000 7f81e61e7640 1 -- 172.21.15.44:0/4077298757 wait complete. 2023-11-04T01:35:52.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.929+0000 7f81e61e7640 1 Processor -- start 2023-11-04T01:35:52.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.929+0000 7f81e61e7640 1 -- start start 2023-11-04T01:35:52.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81e61e7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81e00b42c0 0x7f81e0151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81e61e7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81e00c9e10 0x7f81e015c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81e61e7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81e015ad80 0x7f81e0152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81e61e7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e015d2d0 con 0x7f81e00b42c0 2023-11-04T01:35:52.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81e61e7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e015d5b0 con 0x7f81e00c9e10 2023-11-04T01:35:52.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81e61e7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e015d890 con 0x7f81e015ad80 2023-11-04T01:35:52.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81df7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81e00b42c0 0x7f81e0151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81df7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81e00b42c0 0x7f81e0151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39738/0 (socket says 172.21.15.44:39738) 2023-11-04T01:35:52.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81df7fe640 1 -- 172.21.15.44:0/2451547576 learned_addr learned my addr 172.21.15.44:0/2451547576 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:52.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81dffff640 1 --2- 172.21.15.44:0/2451547576 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81e015ad80 0x7f81e0152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81deffd640 1 --2- 172.21.15.44:0/2451547576 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81e00c9e10 0x7f81e015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81df7fe640 1 -- 172.21.15.44:0/2451547576 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81e015ad80 msgr2=0x7f81e0152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81df7fe640 1 --2- 172.21.15.44:0/2451547576 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81e015ad80 0x7f81e0152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81df7fe640 1 -- 172.21.15.44:0/2451547576 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81e00c9e10 msgr2=0x7f81e015c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81df7fe640 1 --2- 172.21.15.44:0/2451547576 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81e00c9e10 0x7f81e015c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.930+0000 7f81df7fe640 1 -- 172.21.15.44:0/2451547576 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d0009400 con 0x7f81e00b42c0 2023-11-04T01:35:52.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.931+0000 7f81df7fe640 1 --2- 172.21.15.44:0/2451547576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81e00b42c0 0x7f81e0151fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f81d0000c00 tx=0x7f81d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:52.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.931+0000 7f81c7fff640 1 -- 172.21.15.44:0/2451547576 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d003f070 con 0x7f81e00b42c0 2023-11-04T01:35:52.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.931+0000 7f81c7fff640 1 -- 172.21.15.44:0/2451547576 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d0006e10 con 0x7f81e00b42c0 2023-11-04T01:35:52.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.931+0000 7f81c7fff640 1 -- 172.21.15.44:0/2451547576 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0004250 con 0x7f81e00b42c0 2023-11-04T01:35:52.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.931+0000 7f81e61e7640 1 -- 172.21.15.44:0/2451547576 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e015db70 con 0x7f81e00b42c0 2023-11-04T01:35:52.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.931+0000 7f81e61e7640 1 -- 172.21.15.44:0/2451547576 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e0152510 con 0x7f81e00b42c0 2023-11-04T01:35:52.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.932+0000 7f81e61e7640 1 -- 172.21.15.44:0/2451547576 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e015e090 con 0x7f81e00b42c0 2023-11-04T01:35:52.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.932+0000 7f81c7fff640 1 -- 172.21.15.44:0/2451547576 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81d0043070 con 0x7f81e00b42c0 2023-11-04T01:35:52.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.933+0000 7f81c7fff640 1 --2- 172.21.15.44:0/2451547576 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f81cc06ae70 0x7f81cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.933+0000 7f81c7fff640 1 -- 172.21.15.44:0/2451547576 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f81d00ab080 con 0x7f81e00b42c0 2023-11-04T01:35:52.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.933+0000 7f81deffd640 1 --2- 172.21.15.44:0/2451547576 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f81cc06ae70 0x7f81cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.933+0000 7f81deffd640 1 --2- 172.21.15.44:0/2451547576 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f81cc06ae70 0x7f81cc06d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f81e00c74c0 tx=0x7f81d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:52.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:52.937+0000 7f81c7fff640 1 -- 172.21.15.44:0/2451547576 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81e015e090 con 0x7f81e00b42c0 2023-11-04T01:35:53.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:53.149+0000 7f81e61e7640 1 -- 172.21.15.44:0/2451547576 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81e015e090 con 0x7f81e00b42c0 2023-11-04T01:35:53.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:53.150+0000 7f81c7fff640 1 -- 172.21.15.44:0/2451547576 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f81d0034540 con 0x7f81e00b42c0 2023-11-04T01:35:53.152 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:35:53.152 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3427243577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3427243577},{"type":"v1","addr":"172.21.15.44:6833","nonce":3427243577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-04T01:35:53.152 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 2 2023-11-04T01:35:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:53.151+0000 7f81e61e7640 1 -- 172.21.15.44:0/2451547576 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f81cc06ae70 msgr2=0x7f81cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:53.151+0000 7f81e61e7640 1 --2- 172.21.15.44:0/2451547576 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f81cc06ae70 0x7f81cc06d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f81e00c74c0 tx=0x7f81d4009040 comp rx=0 tx=0).stop 2023-11-04T01:35:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:53.151+0000 7f81e61e7640 1 -- 172.21.15.44:0/2451547576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81e00b42c0 msgr2=0x7f81e0151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:53.151+0000 7f81e61e7640 1 --2- 172.21.15.44:0/2451547576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81e00b42c0 0x7f81e0151fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f81d0000c00 tx=0x7f81d00046c0 comp rx=0 tx=0).stop 2023-11-04T01:35:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:53.151+0000 7f81e61e7640 1 -- 172.21.15.44:0/2451547576 shutdown_connections 2023-11-04T01:35:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:53.151+0000 7f81e61e7640 1 --2- 172.21.15.44:0/2451547576 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f81cc06ae70 0x7f81cc06d330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:53.152+0000 7f81e61e7640 1 --2- 172.21.15.44:0/2451547576 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81e015ad80 0x7f81e0152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:53.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:53.152+0000 7f81e61e7640 1 --2- 172.21.15.44:0/2451547576 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81e00c9e10 0x7f81e015c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:53.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:53.152+0000 7f81e61e7640 1 --2- 172.21.15.44:0/2451547576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81e00b42c0 0x7f81e0151fd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:53.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:53.152+0000 7f81e61e7640 1 -- 172.21.15.44:0/2451547576 >> 172.21.15.44:0/2451547576 conn(0x7f81e00ce950 msgr2=0x7f81e00b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:53.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:53.152+0000 7f81e61e7640 1 -- 172.21.15.44:0/2451547576 shutdown_connections 2023-11-04T01:35:53.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:53.152+0000 7f81e61e7640 1 -- 172.21.15.44:0/2451547576 wait complete. 2023-11-04T01:35:55.165 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:35:55.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.280+0000 7f9143b55640 1 Processor -- start 2023-11-04T01:35:55.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.280+0000 7f9143b55640 1 -- start start 2023-11-04T01:35:55.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.281+0000 7f9143b55640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f913c0ce240 0x7f913c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.281+0000 7f9143b55640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f913c157540 0x7f913c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.281+0000 7f9143b55640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913c15e000 con 0x7f913c0cde60 2023-11-04T01:35:55.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.281+0000 7f9143b55640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913c15e5c0 con 0x7f913c157540 2023-11-04T01:35:55.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.281+0000 7f9143b55640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c15e2e0 con 0x7f913c0ce240 2023-11-04T01:35:55.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.281+0000 7f91420f2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f913c157540 0x7f913c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.281+0000 7f91420f2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f913c157540 0x7f913c0d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39750/0 (socket says 172.21.15.44:39750) 2023-11-04T01:35:55.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.281+0000 7f91420f2640 1 -- 172.21.15.44:0/4121296387 learned_addr learned my addr 172.21.15.44:0/4121296387 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:55.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.282+0000 7f91410f0640 1 --2- 172.21.15.44:0/4121296387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f913c0ce240 0x7f913c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.282+0000 7f91420f2640 1 -- 172.21.15.44:0/4121296387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f913c0ce240 msgr2=0x7f913c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:55.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.282+0000 7f91420f2640 1 --2- 172.21.15.44:0/4121296387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f913c0ce240 0x7f913c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.282+0000 7f91420f2640 1 -- 172.21.15.44:0/4121296387 >> v1:172.21.15.204:6789/0 conn(0x7f913c0cde60 legacy=0x7f913c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.282+0000 7f91420f2640 1 -- 172.21.15.44:0/4121296387 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c0d1120 con 0x7f913c157540 2023-11-04T01:35:55.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.283+0000 7f91420f2640 1 --2- 172.21.15.44:0/4121296387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f913c157540 0x7f913c0d1920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f912c009e50 tx=0x7f912c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85cd4af6baea73e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:55.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.283+0000 7f91408ef640 1 -- 172.21.15.44:0/4121296387 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c02cb00 con 0x7f913c157540 2023-11-04T01:35:55.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.283+0000 7f91408ef640 1 -- 172.21.15.44:0/4121296387 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c02cc60 con 0x7f913c157540 2023-11-04T01:35:55.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.283+0000 7f91408ef640 1 -- 172.21.15.44:0/4121296387 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c0343f0 con 0x7f913c157540 2023-11-04T01:35:55.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.283+0000 7f9143b55640 1 -- 172.21.15.44:0/4121296387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f913c157540 msgr2=0x7f913c0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.283+0000 7f9143b55640 1 --2- 172.21.15.44:0/4121296387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f913c157540 0x7f913c0d1920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f912c009e50 tx=0x7f912c02bf60 comp rx=0 tx=0).stop 2023-11-04T01:35:55.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.283+0000 7f9143b55640 1 -- 172.21.15.44:0/4121296387 shutdown_connections 2023-11-04T01:35:55.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.283+0000 7f9143b55640 1 --2- 172.21.15.44:0/4121296387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f913c157540 0x7f913c0d1920 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.283+0000 7f9143b55640 1 --2- 172.21.15.44:0/4121296387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f913c0ce240 0x7f913c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.283+0000 7f9143b55640 1 -- 172.21.15.44:0/4121296387 >> 172.21.15.44:0/4121296387 conn(0x7f913c071f30 msgr2=0x7f913c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.283+0000 7f9143b55640 1 -- 172.21.15.44:0/4121296387 shutdown_connections 2023-11-04T01:35:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.283+0000 7f9143b55640 1 -- 172.21.15.44:0/4121296387 wait complete. 2023-11-04T01:35:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.285+0000 7f9143b55640 1 Processor -- start 2023-11-04T01:35:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.285+0000 7f9143b55640 1 -- start start 2023-11-04T01:35:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.285+0000 7f9143b55640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f913c0cde60 0x7f913c1532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.285+0000 7f9143b55640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f913c0ce240 0x7f913c15b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.285+0000 7f9143b55640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f913c157540 0x7f913c15b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.285+0000 7f9143b55640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c153830 con 0x7f913c0ce240 2023-11-04T01:35:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.285+0000 7f9143b55640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c15c6b0 con 0x7f913c0cde60 2023-11-04T01:35:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.285+0000 7f9143b55640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c15be10 con 0x7f913c157540 2023-11-04T01:35:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.285+0000 7f91410f0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f913c0ce240 0x7f913c15b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f91410f0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f913c0ce240 0x7f913c15b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39766/0 (socket says 172.21.15.44:39766) 2023-11-04T01:35:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f91410f0640 1 -- 172.21.15.44:0/288768785 learned_addr learned my addr 172.21.15.44:0/288768785 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f91418f1640 1 --2- 172.21.15.44:0/288768785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f913c0cde60 0x7f913c1532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f91420f2640 1 --2- 172.21.15.44:0/288768785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f913c157540 0x7f913c15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f91410f0640 1 -- 172.21.15.44:0/288768785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f913c157540 msgr2=0x7f913c15b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f91410f0640 1 --2- 172.21.15.44:0/288768785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f913c157540 0x7f913c15b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f91410f0640 1 -- 172.21.15.44:0/288768785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f913c0cde60 msgr2=0x7f913c1532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f91410f0640 1 --2- 172.21.15.44:0/288768785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f913c0cde60 0x7f913c1532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f91410f0640 1 -- 172.21.15.44:0/288768785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c009b30 con 0x7f913c0ce240 2023-11-04T01:35:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f91418f1640 1 --2- 172.21.15.44:0/288768785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f913c0cde60 0x7f913c1532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f91410f0640 1 --2- 172.21.15.44:0/288768785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f913c0ce240 0x7f913c15b250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f913000e9b0 tx=0x7f913000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f913a7fc640 1 -- 172.21.15.44:0/288768785 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130009670 con 0x7f913c0ce240 2023-11-04T01:35:55.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f913a7fc640 1 -- 172.21.15.44:0/288768785 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913000c9a0 con 0x7f913c0ce240 2023-11-04T01:35:55.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f9143b55640 1 -- 172.21.15.44:0/288768785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c15c0f0 con 0x7f913c0ce240 2023-11-04T01:35:55.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f913a7fc640 1 -- 172.21.15.44:0/288768785 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913000cd50 con 0x7f913c0ce240 2023-11-04T01:35:55.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.286+0000 7f9143b55640 1 -- 172.21.15.44:0/288768785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c0ca020 con 0x7f913c0ce240 2023-11-04T01:35:55.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.287+0000 7f9143b55640 1 -- 172.21.15.44:0/288768785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913c074290 con 0x7f913c0ce240 2023-11-04T01:35:55.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.288+0000 7f913a7fc640 1 -- 172.21.15.44:0/288768785 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9130013470 con 0x7f913c0ce240 2023-11-04T01:35:55.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.288+0000 7f913a7fc640 1 --2- 172.21.15.44:0/288768785 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f912806ae70 0x7f912806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.288+0000 7f913a7fc640 1 -- 172.21.15.44:0/288768785 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9130089820 con 0x7f913c0ce240 2023-11-04T01:35:55.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.288+0000 7f91418f1640 1 --2- 172.21.15.44:0/288768785 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f912806ae70 0x7f912806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.289+0000 7f91418f1640 1 --2- 172.21.15.44:0/288768785 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f912806ae70 0x7f912806d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9134007fd0 tx=0x7f9134009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:55.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.292+0000 7f913a7fc640 1 -- 172.21.15.44:0/288768785 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9130054cb0 con 0x7f913c0ce240 2023-11-04T01:35:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.509+0000 7f9143b55640 1 -- 172.21.15.44:0/288768785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f913c0d0e10 con 0x7f913c0ce240 2023-11-04T01:35:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.509+0000 7f913a7fc640 1 -- 172.21.15.44:0/288768785 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f9130017090 con 0x7f913c0ce240 2023-11-04T01:35:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:35:55.512 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2760874964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2760874964},{"type":"v1","addr":"172.21.15.204:6836","nonce":2760874964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3427243577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3427243577},{"type":"v1","addr":"172.21.15.44:6833","nonce":3427243577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/178191500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":178191500},{"type":"v1","addr":"172.21.15.204:6837","nonce":178191500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/240936603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":240936603},{"type":"v1","addr":"172.21.15.44:6835","nonce":240936603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-04T01:35:55.512 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 3 2023-11-04T01:35:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.511+0000 7f9143b55640 1 -- 172.21.15.44:0/288768785 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f912806ae70 msgr2=0x7f912806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.511+0000 7f9143b55640 1 --2- 172.21.15.44:0/288768785 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f912806ae70 0x7f912806d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9134007fd0 tx=0x7f9134009040 comp rx=0 tx=0).stop 2023-11-04T01:35:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.511+0000 7f9143b55640 1 -- 172.21.15.44:0/288768785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f913c0ce240 msgr2=0x7f913c15b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.511+0000 7f9143b55640 1 --2- 172.21.15.44:0/288768785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f913c0ce240 0x7f913c15b250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f913000e9b0 tx=0x7f913000ee70 comp rx=0 tx=0).stop 2023-11-04T01:35:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.511+0000 7f9143b55640 1 -- 172.21.15.44:0/288768785 shutdown_connections 2023-11-04T01:35:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.511+0000 7f9143b55640 1 --2- 172.21.15.44:0/288768785 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f912806ae70 0x7f912806d330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.511+0000 7f9143b55640 1 --2- 172.21.15.44:0/288768785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f913c157540 0x7f913c15b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.511+0000 7f9143b55640 1 --2- 172.21.15.44:0/288768785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f913c0ce240 0x7f913c15b250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.511+0000 7f9143b55640 1 --2- 172.21.15.44:0/288768785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f913c0cde60 0x7f913c1532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.511+0000 7f9143b55640 1 -- 172.21.15.44:0/288768785 >> 172.21.15.44:0/288768785 conn(0x7f913c071f30 msgr2=0x7f913c0d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.511+0000 7f9143b55640 1 -- 172.21.15.44:0/288768785 shutdown_connections 2023-11-04T01:35:55.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.511+0000 7f9143b55640 1 -- 172.21.15.44:0/288768785 wait complete. 2023-11-04T01:35:55.535 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:35:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.642+0000 7f09c69b0640 1 Processor -- start 2023-11-04T01:35:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.642+0000 7f09c69b0640 1 -- start start 2023-11-04T01:35:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.643+0000 7f09c69b0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09c0160b10 0x7f09c0160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.643+0000 7f09c69b0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f09c00cf160 0x7f09c00cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.643+0000 7f09c69b0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c006bf00 con 0x7f09c015ce60 2023-11-04T01:35:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.643+0000 7f09c69b0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c00cbde0 con 0x7f09c00cf160 2023-11-04T01:35:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.643+0000 7f09c69b0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00cfb30 con 0x7f09c0160b10 2023-11-04T01:35:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.643+0000 7f09bffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f09c015ce60 0x7f09c006b7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45336/0 (socket says 172.21.15.44:45336) 2023-11-04T01:35:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.643+0000 7f09bffff640 1 -- 172.21.15.44:0/4018061690 learned_addr learned my addr 172.21.15.44:0/4018061690 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:35:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.643+0000 7f09bf7fe640 1 --2- 172.21.15.44:0/4018061690 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09c0160b10 0x7f09c0160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.643+0000 7f09beffd640 1 -- 172.21.15.44:0/4018061690 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616476915 0 0) 0x7f09c006bf00 con 0x7f09c015ce60 2023-11-04T01:35:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.644+0000 7f09c4f4d640 1 --2- 172.21.15.44:0/4018061690 >> v2:172.21.15.204:3300/0 conn(0x7f09c00cf160 0x7f09c00cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.644+0000 7f09beffd640 1 -- 172.21.15.44:0/4018061690 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09a8003520 con 0x7f09c015ce60 2023-11-04T01:35:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.644+0000 7f09bf7fe640 1 -- 172.21.15.44:0/4018061690 >> v2:172.21.15.204:3300/0 conn(0x7f09c00cf160 msgr2=0x7f09c00cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.644+0000 7f09bf7fe640 1 --2- 172.21.15.44:0/4018061690 >> v2:172.21.15.204:3300/0 conn(0x7f09c00cf160 0x7f09c00cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.644+0000 7f09beffd640 1 -- 172.21.15.44:0/4018061690 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 662450285 0 0) 0x7f09a8003520 con 0x7f09c015ce60 2023-11-04T01:35:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.644+0000 7f09bf7fe640 1 -- 172.21.15.44:0/4018061690 >> v1:172.21.15.44:6789/0 conn(0x7f09c015ce60 legacy=0x7f09c006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.644+0000 7f09bf7fe640 1 -- 172.21.15.44:0/4018061690 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c01615d0 con 0x7f09c0160b10 2023-11-04T01:35:55.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.645+0000 7f09bf7fe640 1 --2- 172.21.15.44:0/4018061690 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09c0160b10 0x7f09c0160f90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f09b00097a0 tx=0x7f09b002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27399342cd004441 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:55.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.645+0000 7f09beffd640 1 -- 172.21.15.44:0/4018061690 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4001670 con 0x7f09c0160b10 2023-11-04T01:35:55.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.645+0000 7f09beffd640 1 -- 172.21.15.44:0/4018061690 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b002e050 con 0x7f09c0160b10 2023-11-04T01:35:55.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.645+0000 7f09beffd640 1 -- 172.21.15.44:0/4018061690 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0030710 con 0x7f09c0160b10 2023-11-04T01:35:55.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.645+0000 7f09c69b0640 1 -- 172.21.15.44:0/4018061690 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09c0160b10 msgr2=0x7f09c0160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.645+0000 7f09c69b0640 1 --2- 172.21.15.44:0/4018061690 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09c0160b10 0x7f09c0160f90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f09b00097a0 tx=0x7f09b002b790 comp rx=0 tx=0).stop 2023-11-04T01:35:55.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.645+0000 7f09c69b0640 1 -- 172.21.15.44:0/4018061690 shutdown_connections 2023-11-04T01:35:55.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.645+0000 7f09c69b0640 1 --2- 172.21.15.44:0/4018061690 >> v2:172.21.15.204:3300/0 conn(0x7f09c00cf160 0x7f09c00cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.645+0000 7f09c69b0640 1 --2- 172.21.15.44:0/4018061690 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09c0160b10 0x7f09c0160f90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.645+0000 7f09c69b0640 1 -- 172.21.15.44:0/4018061690 >> 172.21.15.44:0/4018061690 conn(0x7f09c006ea90 msgr2=0x7f09c006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:55.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.645+0000 7f09c69b0640 1 -- 172.21.15.44:0/4018061690 shutdown_connections 2023-11-04T01:35:55.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.645+0000 7f09c69b0640 1 -- 172.21.15.44:0/4018061690 wait complete. 2023-11-04T01:35:55.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.646+0000 7f09c69b0640 1 Processor -- start 2023-11-04T01:35:55.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.647+0000 7f09c69b0640 1 -- start start 2023-11-04T01:35:55.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.647+0000 7f09c69b0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09c00cf160 0x7f09c0151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.647+0000 7f09c69b0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015ce60 0x7f09c01525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.647+0000 7f09c69b0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09c0160b10 0x7f09c00c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.647+0000 7f09c69b0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c015fd40 con 0x7f09c015ce60 2023-11-04T01:35:55.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.647+0000 7f09c69b0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00c92d0 con 0x7f09c0160b10 2023-11-04T01:35:55.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.647+0000 7f09c69b0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c0151580 con 0x7f09c00cf160 2023-11-04T01:35:55.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.647+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015ce60 0x7f09c01525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015ce60 0x7f09c01525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39780/0 (socket says 172.21.15.44:39780) 2023-11-04T01:35:55.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09bf7fe640 1 -- 172.21.15.44:0/1299557788 learned_addr learned my addr 172.21.15.44:0/1299557788 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:55.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09bffff640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09c00cf160 0x7f09c0151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09c4f4d640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09c0160b10 0x7f09c00c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09bf7fe640 1 -- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09c00cf160 msgr2=0x7f09c0151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09bf7fe640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09c00cf160 0x7f09c0151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09bf7fe640 1 -- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09c0160b10 msgr2=0x7f09c00c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09bf7fe640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09c0160b10 0x7f09c00c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09bf7fe640 1 -- 172.21.15.44:0/1299557788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b0009400 con 0x7f09c015ce60 2023-11-04T01:35:55.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09bffff640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09c00cf160 0x7f09c0151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:55.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09c4f4d640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09c0160b10 0x7f09c00c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:55.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09bf7fe640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015ce60 0x7f09c01525d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f09b00098c0 tx=0x7f09b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:55.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09bcff9640 1 -- 172.21.15.44:0/1299557788 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b003d830 con 0x7f09c015ce60 2023-11-04T01:35:55.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09bcff9640 1 -- 172.21.15.44:0/1299557788 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b003d9b0 con 0x7f09c015ce60 2023-11-04T01:35:55.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09c69b0640 1 -- 172.21.15.44:0/1299557788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c015d3e0 con 0x7f09c015ce60 2023-11-04T01:35:55.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09bcff9640 1 -- 172.21.15.44:0/1299557788 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b003dd60 con 0x7f09c015ce60 2023-11-04T01:35:55.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.648+0000 7f09c69b0640 1 -- 172.21.15.44:0/1299557788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c015d680 con 0x7f09c015ce60 2023-11-04T01:35:55.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.649+0000 7f09c69b0640 1 -- 172.21.15.44:0/1299557788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c0074290 con 0x7f09c015ce60 2023-11-04T01:35:55.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.650+0000 7f09bcff9640 1 -- 172.21.15.44:0/1299557788 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09b0032400 con 0x7f09c015ce60 2023-11-04T01:35:55.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.650+0000 7f09bcff9640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f09ac06ae70 0x7f09ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.650+0000 7f09bcff9640 1 -- 172.21.15.44:0/1299557788 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f09b00ab2d0 con 0x7f09c015ce60 2023-11-04T01:35:55.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.650+0000 7f09bffff640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f09ac06ae70 0x7f09ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.651+0000 7f09bffff640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f09ac06ae70 0x7f09ac06d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f09b40011e0 tx=0x7f09b4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:55.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.654+0000 7f09bcff9640 1 -- 172.21.15.44:0/1299557788 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f09b00766d0 con 0x7f09c015ce60 2023-11-04T01:35:55.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.831+0000 7f09c69b0640 1 -- 172.21.15.44:0/1299557788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09c006b3e0 con 0x7f09c015ce60 2023-11-04T01:35:55.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.832+0000 7f09bcff9640 1 -- 172.21.15.44:0/1299557788 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f09b0079cf0 con 0x7f09c015ce60 2023-11-04T01:35:55.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:35:55.838 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":16,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:35:48.637693+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:35:55.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.834+0000 7f09c69b0640 1 -- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f09ac06ae70 msgr2=0x7f09ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.834+0000 7f09c69b0640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f09ac06ae70 0x7f09ac06d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f09b40011e0 tx=0x7f09b4009040 comp rx=0 tx=0).stop 2023-11-04T01:35:55.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.834+0000 7f09c69b0640 1 -- 172.21.15.44:0/1299557788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015ce60 msgr2=0x7f09c01525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.834+0000 7f09c69b0640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015ce60 0x7f09c01525d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f09b00098c0 tx=0x7f09b00046c0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.834+0000 7f09c69b0640 1 -- 172.21.15.44:0/1299557788 shutdown_connections 2023-11-04T01:35:55.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.834+0000 7f09c69b0640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f09ac06ae70 0x7f09ac06d330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.834+0000 7f09c69b0640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09c0160b10 0x7f09c00c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.834+0000 7f09c69b0640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015ce60 0x7f09c01525d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.834+0000 7f09c69b0640 1 --2- 172.21.15.44:0/1299557788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09c00cf160 0x7f09c0151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.834+0000 7f09c69b0640 1 -- 172.21.15.44:0/1299557788 >> 172.21.15.44:0/1299557788 conn(0x7f09c006ea90 msgr2=0x7f09c006b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:55.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.834+0000 7f09c69b0640 1 -- 172.21.15.44:0/1299557788 shutdown_connections 2023-11-04T01:35:55.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.834+0000 7f09c69b0640 1 -- 172.21.15.44:0/1299557788 wait complete. 2023-11-04T01:35:55.847 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:35:55.848 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:35:55.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.954+0000 7fb3df790640 1 Processor -- start 2023-11-04T01:35:55.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.954+0000 7fb3df790640 1 -- start start 2023-11-04T01:35:55.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.955+0000 7fb3df790640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb3d80b4880 0x7fb3d80b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.955+0000 7fb3df790640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d80cde60 con 0x7fb3d80cd6d0 2023-11-04T01:35:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.955+0000 7fb3df790640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d8160f90 con 0x7fb3d8153e60 2023-11-04T01:35:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.955+0000 7fb3df790640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d80b5200 con 0x7fb3d80b4880 2023-11-04T01:35:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.955+0000 7fb3ddd2d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb3d80b4880 0x7fb3d80b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.955+0000 7fb3ddd2d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb3d80b4880 0x7fb3d80b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39786/0 (socket says 172.21.15.44:39786) 2023-11-04T01:35:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.955+0000 7fb3ddd2d640 1 -- 172.21.15.44:0/3093868742 learned_addr learned my addr 172.21.15.44:0/3093868742 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.955+0000 7fb3dcd2b640 1 --1- 172.21.15.44:0/3093868742 >> v1:172.21.15.44:6789/0 conn(0x7fb3d80cd6d0 0x7fb3d8161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45342/0 (socket says 172.21.15.44:45342) 2023-11-04T01:35:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.955+0000 7fb3ddd2d640 1 -- 172.21.15.44:0/3093868742 >> v1:172.21.15.204:6789/0 conn(0x7fb3d8153e60 legacy=0x7fb3d815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.955+0000 7fb3ddd2d640 1 -- 172.21.15.44:0/3093868742 >> v1:172.21.15.44:6789/0 conn(0x7fb3d80cd6d0 legacy=0x7fb3d8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.956+0000 7fb3ddd2d640 1 -- 172.21.15.44:0/3093868742 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d80ce090 con 0x7fb3d80b4880 2023-11-04T01:35:55.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.956+0000 7fb3ddd2d640 1 --2- 172.21.15.44:0/3093868742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3d80b4880 0x7fb3d80b4cc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009870 tx=0x7fb3d002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e378512dd2557b1d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:55.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.956+0000 7fb3d7fff640 1 -- 172.21.15.44:0/3093868742 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0030860 con 0x7fb3d80b4880 2023-11-04T01:35:55.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.956+0000 7fb3d7fff640 1 -- 172.21.15.44:0/3093868742 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d00309c0 con 0x7fb3d80b4880 2023-11-04T01:35:55.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.956+0000 7fb3d7fff640 1 -- 172.21.15.44:0/3093868742 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0030d50 con 0x7fb3d80b4880 2023-11-04T01:35:55.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.957+0000 7fb3df790640 1 -- 172.21.15.44:0/3093868742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3d80b4880 msgr2=0x7fb3d80b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.957+0000 7fb3df790640 1 --2- 172.21.15.44:0/3093868742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3d80b4880 0x7fb3d80b4cc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009870 tx=0x7fb3d002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.957+0000 7fb3df790640 1 -- 172.21.15.44:0/3093868742 shutdown_connections 2023-11-04T01:35:55.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.957+0000 7fb3df790640 1 --2- 172.21.15.44:0/3093868742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3d80b4880 0x7fb3d80b4cc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.957+0000 7fb3df790640 1 -- 172.21.15.44:0/3093868742 >> 172.21.15.44:0/3093868742 conn(0x7fb3d80cf880 msgr2=0x7fb3d80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:55.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.957+0000 7fb3df790640 1 -- 172.21.15.44:0/3093868742 shutdown_connections 2023-11-04T01:35:55.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.957+0000 7fb3df790640 1 -- 172.21.15.44:0/3093868742 wait complete. 2023-11-04T01:35:55.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.958+0000 7fb3df790640 1 Processor -- start 2023-11-04T01:35:55.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.958+0000 7fb3df790640 1 -- start start 2023-11-04T01:35:55.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3df790640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3d80b4880 0x7fb3d8152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3df790640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3d80cd6d0 0x7fb3d8157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3df790640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3d8153e60 0x7fb3d81580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3df790640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d80c8ff0 con 0x7fb3d8153e60 2023-11-04T01:35:55.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3df790640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d8152990 con 0x7fb3d80b4880 2023-11-04T01:35:55.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3df790640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d815aae0 con 0x7fb3d80cd6d0 2023-11-04T01:35:55.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3ddd2d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3d8153e60 0x7fb3d81580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3ddd2d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3d8153e60 0x7fb3d81580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39798/0 (socket says 172.21.15.44:39798) 2023-11-04T01:35:55.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3ddd2d640 1 -- 172.21.15.44:0/2398398832 learned_addr learned my addr 172.21.15.44:0/2398398832 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:55.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3dcd2b640 1 --2- 172.21.15.44:0/2398398832 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3d80cd6d0 0x7fb3d8157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3dd52c640 1 --2- 172.21.15.44:0/2398398832 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3d80b4880 0x7fb3d8152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3ddd2d640 1 -- 172.21.15.44:0/2398398832 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3d80cd6d0 msgr2=0x7fb3d8157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3ddd2d640 1 --2- 172.21.15.44:0/2398398832 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3d80cd6d0 0x7fb3d8157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3ddd2d640 1 -- 172.21.15.44:0/2398398832 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3d80b4880 msgr2=0x7fb3d8152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3ddd2d640 1 --2- 172.21.15.44:0/2398398832 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3d80b4880 0x7fb3d8152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3ddd2d640 1 -- 172.21.15.44:0/2398398832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d00094d0 con 0x7fb3d8153e60 2023-11-04T01:35:55.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.959+0000 7fb3dd52c640 1 --2- 172.21.15.44:0/2398398832 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3d80b4880 0x7fb3d8152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:35:55.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.960+0000 7fb3ddd2d640 1 --2- 172.21.15.44:0/2398398832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3d8153e60 0x7fb3d81580b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb3d002b9e0 tx=0x7fb3d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:55.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.960+0000 7fb3d5ffb640 1 -- 172.21.15.44:0/2398398832 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0043400 con 0x7fb3d8153e60 2023-11-04T01:35:55.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.960+0000 7fb3d5ffb640 1 -- 172.21.15.44:0/2398398832 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d0043580 con 0x7fb3d8153e60 2023-11-04T01:35:55.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.960+0000 7fb3df790640 1 -- 172.21.15.44:0/2398398832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d8152060 con 0x7fb3d8153e60 2023-11-04T01:35:55.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.960+0000 7fb3d5ffb640 1 -- 172.21.15.44:0/2398398832 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0043930 con 0x7fb3d8153e60 2023-11-04T01:35:55.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.960+0000 7fb3df790640 1 -- 172.21.15.44:0/2398398832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d8152620 con 0x7fb3d8153e60 2023-11-04T01:35:55.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.961+0000 7fb3df790640 1 -- 172.21.15.44:0/2398398832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d8152b00 con 0x7fb3d8153e60 2023-11-04T01:35:55.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.961+0000 7fb3d5ffb640 1 -- 172.21.15.44:0/2398398832 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb3d0043a90 con 0x7fb3d8153e60 2023-11-04T01:35:55.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.962+0000 7fb3d5ffb640 1 --2- 172.21.15.44:0/2398398832 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb3c406ae70 0x7fb3c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.962+0000 7fb3d5ffb640 1 -- 172.21.15.44:0/2398398832 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb3d003e070 con 0x7fb3d8153e60 2023-11-04T01:35:55.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.962+0000 7fb3dd52c640 1 --2- 172.21.15.44:0/2398398832 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb3c406ae70 0x7fb3c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.962+0000 7fb3dd52c640 1 --2- 172.21.15.44:0/2398398832 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb3c406ae70 0x7fb3c406d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8143050 tx=0x7fb3c80073c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:55.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:55.966+0000 7fb3d5ffb640 1 -- 172.21.15.44:0/2398398832 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb3d0077a10 con 0x7fb3d8153e60 2023-11-04T01:35:56.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.140+0000 7fb3df790640 1 -- 172.21.15.44:0/2398398832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3d80ce340 con 0x7fb3d8153e60 2023-11-04T01:35:56.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.140+0000 7fb3d5ffb640 1 -- 172.21.15.44:0/2398398832 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3d0043d40 con 0x7fb3d8153e60 2023-11-04T01:35:56.143 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:35:56.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.142+0000 7fb3df790640 1 -- 172.21.15.44:0/2398398832 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb3c406ae70 msgr2=0x7fb3c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.142+0000 7fb3df790640 1 --2- 172.21.15.44:0/2398398832 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb3c406ae70 0x7fb3c406d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8143050 tx=0x7fb3c80073c0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.142+0000 7fb3df790640 1 -- 172.21.15.44:0/2398398832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3d8153e60 msgr2=0x7fb3d81580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.142+0000 7fb3df790640 1 --2- 172.21.15.44:0/2398398832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3d8153e60 0x7fb3d81580b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb3d002b9e0 tx=0x7fb3d0004730 comp rx=0 tx=0).stop 2023-11-04T01:35:56.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.142+0000 7fb3df790640 1 -- 172.21.15.44:0/2398398832 shutdown_connections 2023-11-04T01:35:56.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.142+0000 7fb3df790640 1 --2- 172.21.15.44:0/2398398832 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb3c406ae70 0x7fb3c406d330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.142+0000 7fb3df790640 1 --2- 172.21.15.44:0/2398398832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3d8153e60 0x7fb3d81580b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.142+0000 7fb3df790640 1 --2- 172.21.15.44:0/2398398832 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3d80cd6d0 0x7fb3d8157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.142+0000 7fb3df790640 1 --2- 172.21.15.44:0/2398398832 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3d80b4880 0x7fb3d8152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.142+0000 7fb3df790640 1 -- 172.21.15.44:0/2398398832 >> 172.21.15.44:0/2398398832 conn(0x7fb3d80cf880 msgr2=0x7fb3d8161420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:56.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.142+0000 7fb3df790640 1 -- 172.21.15.44:0/2398398832 shutdown_connections 2023-11-04T01:35:56.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.142+0000 7fb3df790640 1 -- 172.21.15.44:0/2398398832 wait complete. 2023-11-04T01:35:56.164 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:35:56.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.271+0000 7f750ff33640 1 Processor -- start 2023-11-04T01:35:56.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.271+0000 7f750ff33640 1 -- start start 2023-11-04T01:35:56.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.272+0000 7f750ff33640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f75080cde60 0x7f750815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.272+0000 7f750ff33640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f75080ce240 0x7f75080d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.272+0000 7f750ff33640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750815e000 con 0x7f750815daa0 2023-11-04T01:35:56.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.272+0000 7f750ff33640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750815e5c0 con 0x7f75080cde60 2023-11-04T01:35:56.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.272+0000 7f750ff33640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750815e2e0 con 0x7f75080ce240 2023-11-04T01:35:56.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.272+0000 7f750dccf640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f75080cde60 0x7f750815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.272+0000 7f750dccf640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f75080cde60 0x7f750815d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39808/0 (socket says 172.21.15.44:39808) 2023-11-04T01:35:56.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.272+0000 7f750dccf640 1 -- 172.21.15.44:0/918879348 learned_addr learned my addr 172.21.15.44:0/918879348 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:56.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.272+0000 7f750dccf640 1 -- 172.21.15.44:0/918879348 >> v2:172.21.15.204:3300/0 conn(0x7f75080ce240 msgr2=0x7f75080d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:56.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.272+0000 7f750dccf640 1 --2- 172.21.15.44:0/918879348 >> v2:172.21.15.204:3300/0 conn(0x7f75080ce240 0x7f75080d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.272+0000 7f750dccf640 1 -- 172.21.15.44:0/918879348 >> v1:172.21.15.204:6789/0 conn(0x7f750815daa0 legacy=0x7f7508157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:56.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.272+0000 7f750dccf640 1 -- 172.21.15.44:0/918879348 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75080d1120 con 0x7f75080cde60 2023-11-04T01:35:56.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.273+0000 7f750dccf640 1 --2- 172.21.15.44:0/918879348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75080cde60 0x7f750815d560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f75080cf2e0 tx=0x7f750002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860e17b1763502dc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:56.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.273+0000 7f750cccd640 1 -- 172.21.15.44:0/918879348 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7500031870 con 0x7f75080cde60 2023-11-04T01:35:56.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.273+0000 7f750cccd640 1 -- 172.21.15.44:0/918879348 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75000319d0 con 0x7f75080cde60 2023-11-04T01:35:56.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.273+0000 7f750cccd640 1 -- 172.21.15.44:0/918879348 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7500031d60 con 0x7f75080cde60 2023-11-04T01:35:56.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.274+0000 7f750ff33640 1 -- 172.21.15.44:0/918879348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75080cde60 msgr2=0x7f750815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.274+0000 7f750ff33640 1 --2- 172.21.15.44:0/918879348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75080cde60 0x7f750815d560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f75080cf2e0 tx=0x7f750002b910 comp rx=0 tx=0).stop 2023-11-04T01:35:56.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.274+0000 7f750ff33640 1 -- 172.21.15.44:0/918879348 shutdown_connections 2023-11-04T01:35:56.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.274+0000 7f750ff33640 1 --2- 172.21.15.44:0/918879348 >> v2:172.21.15.204:3300/0 conn(0x7f75080ce240 0x7f75080d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.274+0000 7f750ff33640 1 --2- 172.21.15.44:0/918879348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75080cde60 0x7f750815d560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.274+0000 7f750ff33640 1 -- 172.21.15.44:0/918879348 >> 172.21.15.44:0/918879348 conn(0x7f7508071f30 msgr2=0x7f75080cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:56.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.274+0000 7f750ff33640 1 -- 172.21.15.44:0/918879348 shutdown_connections 2023-11-04T01:35:56.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.274+0000 7f750ff33640 1 -- 172.21.15.44:0/918879348 wait complete. 2023-11-04T01:35:56.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.275+0000 7f750ff33640 1 Processor -- start 2023-11-04T01:35:56.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.275+0000 7f750ff33640 1 -- start start 2023-11-04T01:35:56.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750ff33640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cde60 0x7f750814f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750ff33640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75080ce240 0x7f75080c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750ff33640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f750815daa0 0x7f75080cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750ff33640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750814f930 con 0x7f75080ce240 2023-11-04T01:35:56.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750ff33640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75080cb4c0 con 0x7f750815daa0 2023-11-04T01:35:56.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750ff33640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75080cb950 con 0x7f75080cde60 2023-11-04T01:35:56.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750d4ce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75080ce240 0x7f75080c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750d4ce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75080ce240 0x7f75080c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39822/0 (socket says 172.21.15.44:39822) 2023-11-04T01:35:56.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750d4ce640 1 -- 172.21.15.44:0/2776033691 learned_addr learned my addr 172.21.15.44:0/2776033691 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:56.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750e4d0640 1 --2- 172.21.15.44:0/2776033691 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f750815daa0 0x7f75080cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750dccf640 1 --2- 172.21.15.44:0/2776033691 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cde60 0x7f750814f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750d4ce640 1 -- 172.21.15.44:0/2776033691 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cde60 msgr2=0x7f750814f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750d4ce640 1 --2- 172.21.15.44:0/2776033691 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cde60 0x7f750814f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750d4ce640 1 -- 172.21.15.44:0/2776033691 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f750815daa0 msgr2=0x7f75080cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750d4ce640 1 --2- 172.21.15.44:0/2776033691 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f750815daa0 0x7f75080cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750d4ce640 1 -- 172.21.15.44:0/2776033691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75000094d0 con 0x7f75080ce240 2023-11-04T01:35:56.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.276+0000 7f750dccf640 1 --2- 172.21.15.44:0/2776033691 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cde60 0x7f750814f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:35:56.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.277+0000 7f750d4ce640 1 --2- 172.21.15.44:0/2776033691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75080ce240 0x7f75080c9ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00b3c0 tx=0x7f74fc00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:56.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.277+0000 7f75067fc640 1 -- 172.21.15.44:0/2776033691 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc011830 con 0x7f75080ce240 2023-11-04T01:35:56.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.277+0000 7f75067fc640 1 -- 172.21.15.44:0/2776033691 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc011990 con 0x7f75080ce240 2023-11-04T01:35:56.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.277+0000 7f750ff33640 1 -- 172.21.15.44:0/2776033691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75080ca8b0 con 0x7f75080ce240 2023-11-04T01:35:56.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.277+0000 7f75067fc640 1 -- 172.21.15.44:0/2776033691 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc011d60 con 0x7f75080ce240 2023-11-04T01:35:56.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.277+0000 7f750ff33640 1 -- 172.21.15.44:0/2776033691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75080cae70 con 0x7f75080ce240 2023-11-04T01:35:56.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.278+0000 7f750ff33640 1 -- 172.21.15.44:0/2776033691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75080cb630 con 0x7f75080ce240 2023-11-04T01:35:56.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.278+0000 7f75067fc640 1 -- 172.21.15.44:0/2776033691 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f74fc01b460 con 0x7f75080ce240 2023-11-04T01:35:56.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.278+0000 7f75067fc640 1 --2- 172.21.15.44:0/2776033691 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f74f406ae70 0x7f74f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.279+0000 7f75067fc640 1 -- 172.21.15.44:0/2776033691 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f74fc089010 con 0x7f75080ce240 2023-11-04T01:35:56.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.279+0000 7f750dccf640 1 --2- 172.21.15.44:0/2776033691 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f74f406ae70 0x7f74f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.279+0000 7f750dccf640 1 --2- 172.21.15.44:0/2776033691 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f74f406ae70 0x7f74f406d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7500036000 tx=0x7f750003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:56.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.283+0000 7f75067fc640 1 -- 172.21.15.44:0/2776033691 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74fc054410 con 0x7f75080ce240 2023-11-04T01:35:56.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.459+0000 7f750ff33640 1 -- 172.21.15.44:0/2776033691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7508074290 con 0x7f75080ce240 2023-11-04T01:35:56.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.460+0000 7f75067fc640 1 -- 172.21.15.44:0/2776033691 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f74fc057a30 con 0x7f75080ce240 2023-11-04T01:35:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:35:56.462 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2023-11-04T01:35:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:35:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2023-11-04T01:35:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2023-11-04T01:35:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:35:56.463 INFO:teuthology.orchestra.run.smithi044.stdout:] 2023-11-04T01:35:56.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.461+0000 7f750ff33640 1 -- 172.21.15.44:0/2776033691 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f74f406ae70 msgr2=0x7f74f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.461+0000 7f750ff33640 1 --2- 172.21.15.44:0/2776033691 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f74f406ae70 0x7f74f406d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7500036000 tx=0x7f750003c040 comp rx=0 tx=0).stop 2023-11-04T01:35:56.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.461+0000 7f750ff33640 1 -- 172.21.15.44:0/2776033691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75080ce240 msgr2=0x7f75080c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.461+0000 7f750ff33640 1 --2- 172.21.15.44:0/2776033691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75080ce240 0x7f75080c9ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00b3c0 tx=0x7f74fc00b880 comp rx=0 tx=0).stop 2023-11-04T01:35:56.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.461+0000 7f750ff33640 1 -- 172.21.15.44:0/2776033691 shutdown_connections 2023-11-04T01:35:56.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.461+0000 7f750ff33640 1 --2- 172.21.15.44:0/2776033691 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f74f406ae70 0x7f74f406d330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.461+0000 7f750ff33640 1 --2- 172.21.15.44:0/2776033691 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f750815daa0 0x7f75080cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.461+0000 7f750ff33640 1 --2- 172.21.15.44:0/2776033691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75080ce240 0x7f75080c9ef0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.461+0000 7f750ff33640 1 --2- 172.21.15.44:0/2776033691 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cde60 0x7f750814f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.461+0000 7f750ff33640 1 -- 172.21.15.44:0/2776033691 >> 172.21.15.44:0/2776033691 conn(0x7f7508071f30 msgr2=0x7f75080b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:56.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.462+0000 7f750ff33640 1 -- 172.21.15.44:0/2776033691 shutdown_connections 2023-11-04T01:35:56.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.462+0000 7f750ff33640 1 -- 172.21.15.44:0/2776033691 wait complete. 2023-11-04T01:35:56.475 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:35:56.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:35:56.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.583+0000 7f1ecaab4640 1 Processor -- start 2023-11-04T01:35:56.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.583+0000 7f1ecaab4640 1 -- start start 2023-11-04T01:35:56.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.583+0000 7f1ecaab4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1ec40cb680 0x7f1ec40cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.583+0000 7f1ecaab4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec40cded0 con 0x7f1ec415d1b0 2023-11-04T01:35:56.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.583+0000 7f1ecaab4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec4161870 con 0x7f1ec40cda80 2023-11-04T01:35:56.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.583+0000 7f1ecaab4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec4160c60 con 0x7f1ec40cb680 2023-11-04T01:35:56.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.584+0000 7f1ec3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1ec40cb680 0x7f1ec40cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.584+0000 7f1ec8850640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1ec415d1b0 0x7f1ec40ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45358/0 (socket says 172.21.15.44:45358) 2023-11-04T01:35:56.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.584+0000 7f1ec8850640 1 -- 172.21.15.44:0/449147943 learned_addr learned my addr 172.21.15.44:0/449147943 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:35:56.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.584+0000 7f1ec3fff640 1 -- 172.21.15.44:0/449147943 >> v1:172.21.15.204:6789/0 conn(0x7f1ec40cda80 legacy=0x7f1ec415d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.584+0000 7f1ec3fff640 1 -- 172.21.15.44:0/449147943 >> v1:172.21.15.44:6789/0 conn(0x7f1ec415d1b0 legacy=0x7f1ec40ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.584+0000 7f1ec3fff640 1 -- 172.21.15.44:0/449147943 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec4160f40 con 0x7f1ec40cb680 2023-11-04T01:35:56.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.584+0000 7f1ec37fe640 1 -- 172.21.15.44:0/449147943 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159542419 0 0) 0x7f1ebc001490 con 0x7f1ec415d1b0 2023-11-04T01:35:56.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.585+0000 7f1ec3fff640 1 --2- 172.21.15.44:0/449147943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec40cb680 0x7f1ec40cd540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80097a0 tx=0x7f1eb802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c29af9df8ec02ce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:56.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.585+0000 7f1ec37fe640 1 -- 172.21.15.44:0/449147943 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8030610 con 0x7f1ec40cb680 2023-11-04T01:35:56.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.585+0000 7f1ec37fe640 1 -- 172.21.15.44:0/449147943 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb8030770 con 0x7f1ec40cb680 2023-11-04T01:35:56.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.585+0000 7f1ec37fe640 1 -- 172.21.15.44:0/449147943 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8030b00 con 0x7f1ec40cb680 2023-11-04T01:35:56.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.585+0000 7f1ecaab4640 1 -- 172.21.15.44:0/449147943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec40cb680 msgr2=0x7f1ec40cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.585+0000 7f1ecaab4640 1 --2- 172.21.15.44:0/449147943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec40cb680 0x7f1ec40cd540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80097a0 tx=0x7f1eb802b960 comp rx=0 tx=0).stop 2023-11-04T01:35:56.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.585+0000 7f1ecaab4640 1 -- 172.21.15.44:0/449147943 shutdown_connections 2023-11-04T01:35:56.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.585+0000 7f1ecaab4640 1 --2- 172.21.15.44:0/449147943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec40cb680 0x7f1ec40cd540 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.585+0000 7f1ecaab4640 1 -- 172.21.15.44:0/449147943 >> 172.21.15.44:0/449147943 conn(0x7f1ec406ea20 msgr2=0x7f1ec406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:56.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.585+0000 7f1ecaab4640 1 -- 172.21.15.44:0/449147943 shutdown_connections 2023-11-04T01:35:56.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.585+0000 7f1ecaab4640 1 -- 172.21.15.44:0/449147943 wait complete. 2023-11-04T01:35:56.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.587+0000 7f1ecaab4640 1 Processor -- start 2023-11-04T01:35:56.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.587+0000 7f1ecaab4640 1 -- start start 2023-11-04T01:35:56.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.587+0000 7f1ecaab4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec40cb680 0x7f1ec40c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.587+0000 7f1ecaab4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ec40cda80 0x7f1ec40b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.587+0000 7f1ecaab4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ec415d1b0 0x7f1ec40c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.587+0000 7f1ecaab4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec40b3540 con 0x7f1ec40cb680 2023-11-04T01:35:56.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.587+0000 7f1ecaab4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec40c4cf0 con 0x7f1ec40cda80 2023-11-04T01:35:56.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.587+0000 7f1ecaab4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec40b2240 con 0x7f1ec415d1b0 2023-11-04T01:35:56.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ec8850640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec40cb680 0x7f1ec40c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ec8850640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec40cb680 0x7f1ec40c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39846/0 (socket says 172.21.15.44:39846) 2023-11-04T01:35:56.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ec8850640 1 -- 172.21.15.44:0/871287392 learned_addr learned my addr 172.21.15.44:0/871287392 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:56.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ec9051640 1 --2- 172.21.15.44:0/871287392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ec415d1b0 0x7f1ec40c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ec3fff640 1 --2- 172.21.15.44:0/871287392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ec40cda80 0x7f1ec40b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ec8850640 1 -- 172.21.15.44:0/871287392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ec415d1b0 msgr2=0x7f1ec40c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ec8850640 1 --2- 172.21.15.44:0/871287392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ec415d1b0 0x7f1ec40c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ec8850640 1 -- 172.21.15.44:0/871287392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ec40cda80 msgr2=0x7f1ec40b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ec8850640 1 --2- 172.21.15.44:0/871287392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ec40cda80 0x7f1ec40b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ec8850640 1 -- 172.21.15.44:0/871287392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb8009400 con 0x7f1ec40cb680 2023-11-04T01:35:56.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ec8850640 1 --2- 172.21.15.44:0/871287392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec40cb680 0x7f1ec40c4710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c780 tx=0x7f1ebc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:56.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ec17fa640 1 -- 172.21.15.44:0/871287392 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00ce90 con 0x7f1ec40cb680 2023-11-04T01:35:56.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ec17fa640 1 -- 172.21.15.44:0/871287392 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc00a640 con 0x7f1ec40cb680 2023-11-04T01:35:56.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ecaab4640 1 -- 172.21.15.44:0/871287392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec40b2520 con 0x7f1ec40cb680 2023-11-04T01:35:56.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ec17fa640 1 -- 172.21.15.44:0/871287392 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00aa70 con 0x7f1ec40cb680 2023-11-04T01:35:56.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.588+0000 7f1ecaab4640 1 -- 172.21.15.44:0/871287392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec40b2ae0 con 0x7f1ec40cb680 2023-11-04T01:35:56.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.589+0000 7f1ecaab4640 1 -- 172.21.15.44:0/871287392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec40d1480 con 0x7f1ec40cb680 2023-11-04T01:35:56.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.590+0000 7f1ec17fa640 1 -- 172.21.15.44:0/871287392 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ebc00abd0 con 0x7f1ec40cb680 2023-11-04T01:35:56.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.590+0000 7f1ec17fa640 1 --2- 172.21.15.44:0/871287392 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1eb006ae70 0x7f1eb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.590+0000 7f1ec17fa640 1 -- 172.21.15.44:0/871287392 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1ebc0888d0 con 0x7f1ec40cb680 2023-11-04T01:35:56.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.590+0000 7f1ec3fff640 1 --2- 172.21.15.44:0/871287392 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1eb006ae70 0x7f1eb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.591+0000 7f1ec3fff640 1 --2- 172.21.15.44:0/871287392 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1eb006ae70 0x7f1eb006d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8036000 tx=0x7f1eb8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:56.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.594+0000 7f1ec17fa640 1 -- 172.21.15.44:0/871287392 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ebc053d80 con 0x7f1ec40cb680 2023-11-04T01:35:56.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:56.770+0000 7f1ecaab4640 1 -- 172.21.15.44:0/871287392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1ec40cded0 con 0x7f1ec40cb680 2023-11-04T01:35:57.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.169+0000 7f1ec17fa640 1 -- 172.21.15.44:0/871287392 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1ec40cded0 con 0x7f1ec40cb680 2023-11-04T01:35:57.175 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2023-11-04T01:35:57.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.171+0000 7f1ecaab4640 1 -- 172.21.15.44:0/871287392 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1eb006ae70 msgr2=0x7f1eb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.171+0000 7f1ecaab4640 1 --2- 172.21.15.44:0/871287392 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1eb006ae70 0x7f1eb006d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8036000 tx=0x7f1eb8008030 comp rx=0 tx=0).stop 2023-11-04T01:35:57.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.171+0000 7f1ecaab4640 1 -- 172.21.15.44:0/871287392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec40cb680 msgr2=0x7f1ec40c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.171+0000 7f1ecaab4640 1 --2- 172.21.15.44:0/871287392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec40cb680 0x7f1ec40c4710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c780 tx=0x7f1ebc00cc40 comp rx=0 tx=0).stop 2023-11-04T01:35:57.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.171+0000 7f1ecaab4640 1 -- 172.21.15.44:0/871287392 shutdown_connections 2023-11-04T01:35:57.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.171+0000 7f1ecaab4640 1 --2- 172.21.15.44:0/871287392 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1eb006ae70 0x7f1eb006d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.171+0000 7f1ecaab4640 1 --2- 172.21.15.44:0/871287392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ec415d1b0 0x7f1ec40c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.171+0000 7f1ecaab4640 1 --2- 172.21.15.44:0/871287392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ec40cda80 0x7f1ec40b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.171+0000 7f1ecaab4640 1 --2- 172.21.15.44:0/871287392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec40cb680 0x7f1ec40c4710 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.171+0000 7f1ecaab4640 1 -- 172.21.15.44:0/871287392 >> 172.21.15.44:0/871287392 conn(0x7f1ec406ea20 msgr2=0x7f1ec40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:57.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.172+0000 7f1ecaab4640 1 -- 172.21.15.44:0/871287392 shutdown_connections 2023-11-04T01:35:57.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.172+0000 7f1ecaab4640 1 -- 172.21.15.44:0/871287392 wait complete. 2023-11-04T01:35:57.189 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-04T01:35:57.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.303+0000 7fd41892c640 1 Processor -- start 2023-11-04T01:35:57.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.303+0000 7fd41892c640 1 -- start start 2023-11-04T01:35:57.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.303+0000 7fd41892c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd41415cdd0 0x7fd41406cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.303+0000 7fd41892c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd41415d1b0 0x7fd4140cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.303+0000 7fd41892c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41406ba00 con 0x7fd41406b330 2023-11-04T01:35:57.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.303+0000 7fd41892c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41406c950 con 0x7fd41415d1b0 2023-11-04T01:35:57.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.303+0000 7fd41892c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41406bcd0 con 0x7fd41415cdd0 2023-11-04T01:35:57.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd40bfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd41406b330 0x7fd4141614d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45360/0 (socket says 172.21.15.44:45360) 2023-11-04T01:35:57.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd40bfff640 1 -- 172.21.15.44:0/487250658 learned_addr learned my addr 172.21.15.44:0/487250658 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:35:57.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd41259c640 1 --2- 172.21.15.44:0/487250658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd41415cdd0 0x7fd41406cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd412d9d640 1 --2- 172.21.15.44:0/487250658 >> v2:172.21.15.204:3300/0 conn(0x7fd41415d1b0 0x7fd4140cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 -- 172.21.15.44:0/487250658 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250086896 0 0) 0x7fd41406ba00 con 0x7fd41406b330 2023-11-04T01:35:57.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 -- 172.21.15.44:0/487250658 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd400003520 con 0x7fd41406b330 2023-11-04T01:35:57.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 -- 172.21.15.44:0/487250658 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 909474747 0 0) 0x7fd400003520 con 0x7fd41406b330 2023-11-04T01:35:57.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 -- 172.21.15.44:0/487250658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd41415cdd0 msgr2=0x7fd41406cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 --2- 172.21.15.44:0/487250658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd41415cdd0 0x7fd41406cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 -- 172.21.15.44:0/487250658 >> v2:172.21.15.204:3300/0 conn(0x7fd41415d1b0 msgr2=0x7fd4140cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 --2- 172.21.15.44:0/487250658 >> v2:172.21.15.204:3300/0 conn(0x7fd41415d1b0 0x7fd4140cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 -- 172.21.15.44:0/487250658 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41406bfb0 con 0x7fd41406b330 2023-11-04T01:35:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 -- 172.21.15.44:0/487250658 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fd3fc001670 con 0x7fd41406b330 2023-11-04T01:35:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 -- 172.21.15.44:0/487250658 >> v1:172.21.15.44:6789/0 conn(0x7fd41406b330 legacy=0x7fd4141614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 --2- 172.21.15.44:0/487250658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd400003970 0x7fd400003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 --2- 172.21.15.44:0/487250658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4000047c0 0x7fd400004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 --2- 172.21.15.44:0/487250658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd41415cdd0 0x7fd400005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 -- 172.21.15.44:0/487250658 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41406c950 con 0x7fd4000047c0 2023-11-04T01:35:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 -- 172.21.15.44:0/487250658 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41406bcd0 con 0x7fd400003970 2023-11-04T01:35:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd411d9b640 1 -- 172.21.15.44:0/487250658 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40000b980 con 0x7fd41415cdd0 2023-11-04T01:35:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd40bfff640 1 --2- 172.21.15.44:0/487250658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4000047c0 0x7fd400004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.304+0000 7fd41259c640 1 --2- 172.21.15.44:0/487250658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd400003970 0x7fd400003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.305+0000 7fd412d9d640 1 --2- 172.21.15.44:0/487250658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd41415cdd0 0x7fd400005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.305+0000 7fd41259c640 1 -- 172.21.15.44:0/487250658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd41415cdd0 msgr2=0x7fd400005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:57.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.305+0000 7fd41259c640 1 --2- 172.21.15.44:0/487250658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd41415cdd0 0x7fd400005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.305+0000 7fd41259c640 1 -- 172.21.15.44:0/487250658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4000047c0 msgr2=0x7fd400004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:57.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.305+0000 7fd41259c640 1 --2- 172.21.15.44:0/487250658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4000047c0 0x7fd400004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.305+0000 7fd41259c640 1 -- 172.21.15.44:0/487250658 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400003520 con 0x7fd400003970 2023-11-04T01:35:57.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.306+0000 7fd41259c640 1 --2- 172.21.15.44:0/487250658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd400003970 0x7fd400003d90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd404009ac0 tx=0x7fd4000057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d70f40d8789af52b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:57.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.306+0000 7fd411d9b640 1 -- 172.21.15.44:0/487250658 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40402c6b0 con 0x7fd400003970 2023-11-04T01:35:57.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.306+0000 7fd411d9b640 1 -- 172.21.15.44:0/487250658 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40402c810 con 0x7fd400003970 2023-11-04T01:35:57.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.306+0000 7fd411d9b640 1 -- 172.21.15.44:0/487250658 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40402cba0 con 0x7fd400003970 2023-11-04T01:35:57.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.306+0000 7fd41892c640 1 -- 172.21.15.44:0/487250658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd400003970 msgr2=0x7fd400003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.306+0000 7fd41892c640 1 --2- 172.21.15.44:0/487250658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd400003970 0x7fd400003d90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd404009ac0 tx=0x7fd4000057f0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.306+0000 7fd412d9d640 1 -- 172.21.15.44:0/487250658 reap_dead start 2023-11-04T01:35:57.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.306+0000 7fd41892c640 1 -- 172.21.15.44:0/487250658 shutdown_connections 2023-11-04T01:35:57.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.306+0000 7fd41892c640 1 -- 172.21.15.44:0/487250658 >> 172.21.15.44:0/487250658 conn(0x7fd41406a510 msgr2=0x7fd41406a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:57.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.306+0000 7fd41892c640 1 -- 172.21.15.44:0/487250658 shutdown_connections 2023-11-04T01:35:57.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.306+0000 7fd41892c640 1 -- 172.21.15.44:0/487250658 wait complete. 2023-11-04T01:35:57.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.308+0000 7fd41892c640 1 Processor -- start 2023-11-04T01:35:57.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.308+0000 7fd41892c640 1 -- start start 2023-11-04T01:35:57.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.308+0000 7fd41892c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd400003970 0x7fd41414c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.308+0000 7fd41892c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41415dff0 0x7fd4140c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.308+0000 7fd41892c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4140ca1c0 0x7fd4140b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.308+0000 7fd41892c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41414c5c0 con 0x7fd41415dff0 2023-11-04T01:35:57.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.308+0000 7fd41892c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd414159710 con 0x7fd4140ca1c0 2023-11-04T01:35:57.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.308+0000 7fd41892c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140ca640 con 0x7fd400003970 2023-11-04T01:35:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.308+0000 7fd40bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41415dff0 0x7fd4140c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.308+0000 7fd40bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41415dff0 0x7fd4140c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39858/0 (socket says 172.21.15.44:39858) 2023-11-04T01:35:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.308+0000 7fd40bfff640 1 -- 172.21.15.44:0/4115912911 learned_addr learned my addr 172.21.15.44:0/4115912911 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.309+0000 7fd41259c640 1 --2- 172.21.15.44:0/4115912911 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd400003970 0x7fd41414c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.309+0000 7fd412d9d640 1 --2- 172.21.15.44:0/4115912911 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4140ca1c0 0x7fd4140b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.309+0000 7fd40bfff640 1 -- 172.21.15.44:0/4115912911 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd400003970 msgr2=0x7fd41414c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.309+0000 7fd40bfff640 1 --2- 172.21.15.44:0/4115912911 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd400003970 0x7fd41414c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.309+0000 7fd40bfff640 1 -- 172.21.15.44:0/4115912911 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4140ca1c0 msgr2=0x7fd4140b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.309+0000 7fd40bfff640 1 --2- 172.21.15.44:0/4115912911 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4140ca1c0 0x7fd4140b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.309+0000 7fd40bfff640 1 -- 172.21.15.44:0/4115912911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4140ab950 con 0x7fd41415dff0 2023-11-04T01:35:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.309+0000 7fd40bfff640 1 --2- 172.21.15.44:0/4115912911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41415dff0 0x7fd4140c9c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc004f20 tx=0x7fd3fc0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.309+0000 7fd40affd640 1 -- 172.21.15.44:0/4115912911 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc00f750 con 0x7fd41415dff0 2023-11-04T01:35:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.309+0000 7fd40affd640 1 -- 172.21.15.44:0/4115912911 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc00f8f0 con 0x7fd41415dff0 2023-11-04T01:35:57.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.309+0000 7fd41892c640 1 -- 172.21.15.44:0/4115912911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd41415d5a0 con 0x7fd41415dff0 2023-11-04T01:35:57.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.309+0000 7fd40affd640 1 -- 172.21.15.44:0/4115912911 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc00fca0 con 0x7fd41415dff0 2023-11-04T01:35:57.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.309+0000 7fd41892c640 1 -- 172.21.15.44:0/4115912911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd41415db60 con 0x7fd41415dff0 2023-11-04T01:35:57.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.310+0000 7fd41892c640 1 -- 172.21.15.44:0/4115912911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41415dcf0 con 0x7fd41415dff0 2023-11-04T01:35:57.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.311+0000 7fd40affd640 1 -- 172.21.15.44:0/4115912911 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3fc01d460 con 0x7fd41415dff0 2023-11-04T01:35:57.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.311+0000 7fd40affd640 1 --2- 172.21.15.44:0/4115912911 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3f406ae70 0x7fd3f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.311+0000 7fd40affd640 1 -- 172.21.15.44:0/4115912911 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd3fc089540 con 0x7fd41415dff0 2023-11-04T01:35:57.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.311+0000 7fd41259c640 1 --2- 172.21.15.44:0/4115912911 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3f406ae70 0x7fd3f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.312+0000 7fd41259c640 1 --2- 172.21.15.44:0/4115912911 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3f406ae70 0x7fd3f406d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd404009ac0 tx=0x7fd404030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:57.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.316+0000 7fd40affd640 1 -- 172.21.15.44:0/4115912911 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd3fc054740 con 0x7fd41415dff0 2023-11-04T01:35:57.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:57.492+0000 7fd41892c640 1 -- 172.21.15.44:0/4115912911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fd4140ce030 con 0x7fd41415dff0 2023-11-04T01:35:57.667 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:35:57.673 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:35:58.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.175+0000 7fd40affd640 1 -- 172.21.15.44:0/4115912911 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7fd3fc057d60 con 0x7fd41415dff0 2023-11-04T01:35:58.182 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2023-11-04T01:35:58.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.178+0000 7fd41892c640 1 -- 172.21.15.44:0/4115912911 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3f406ae70 msgr2=0x7fd3f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.178+0000 7fd41892c640 1 --2- 172.21.15.44:0/4115912911 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3f406ae70 0x7fd3f406d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd404009ac0 tx=0x7fd404030000 comp rx=0 tx=0).stop 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.178+0000 7fd41892c640 1 -- 172.21.15.44:0/4115912911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41415dff0 msgr2=0x7fd4140c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.178+0000 7fd41892c640 1 --2- 172.21.15.44:0/4115912911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41415dff0 0x7fd4140c9c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc004f20 tx=0x7fd3fc0074f0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.178+0000 7fd41892c640 1 -- 172.21.15.44:0/4115912911 shutdown_connections 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.178+0000 7fd41892c640 1 --2- 172.21.15.44:0/4115912911 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3f406ae70 0x7fd3f406d330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.178+0000 7fd41892c640 1 --2- 172.21.15.44:0/4115912911 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4140ca1c0 0x7fd4140b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.178+0000 7fd41892c640 1 --2- 172.21.15.44:0/4115912911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41415dff0 0x7fd4140c9c80 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc004f20 tx=0x7fd3fc0074f0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.178+0000 7fd41892c640 1 --2- 172.21.15.44:0/4115912911 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd400003970 0x7fd41414c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.178+0000 7fd41892c640 1 -- 172.21.15.44:0/4115912911 >> 172.21.15.44:0/4115912911 conn(0x7fd41406a510 msgr2=0x7fd4140ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.179+0000 7fd41892c640 1 -- 172.21.15.44:0/4115912911 shutdown_connections 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.179+0000 7fd41892c640 1 -- 172.21.15.44:0/4115912911 wait complete. 2023-11-04T01:35:58.208 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:35:58.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.325+0000 7fb3169a5640 1 Processor -- start 2023-11-04T01:35:58.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.325+0000 7fb3169a5640 1 -- start start 2023-11-04T01:35:58.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.326+0000 7fb3169a5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3100cd6d0 0x7fb310161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.326+0000 7fb3169a5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3100cde60 con 0x7fb3100b4880 2023-11-04T01:35:58.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.326+0000 7fb3169a5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb310160f90 con 0x7fb310153e60 2023-11-04T01:35:58.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.326+0000 7fb3169a5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb310161960 con 0x7fb3100cd6d0 2023-11-04T01:35:58.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.326+0000 7fb314f42640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb3100b4880 0x7fb3100b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45364/0 (socket says 172.21.15.44:45364) 2023-11-04T01:35:58.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.326+0000 7fb314f42640 1 -- 172.21.15.44:0/3618987410 learned_addr learned my addr 172.21.15.44:0/3618987410 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:35:58.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.326+0000 7fb30f7fe640 1 --2- 172.21.15.44:0/3618987410 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3100cd6d0 0x7fb310161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.326+0000 7fb30effd640 1 -- 172.21.15.44:0/3618987410 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3181943280 0 0) 0x7fb3100cde60 con 0x7fb3100b4880 2023-11-04T01:35:58.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.326+0000 7fb30effd640 1 -- 172.21.15.44:0/3618987410 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2fc003520 con 0x7fb3100b4880 2023-11-04T01:35:58.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.326+0000 7fb30effd640 1 -- 172.21.15.44:0/3618987410 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3002903689 0 0) 0x7fb2fc003520 con 0x7fb3100b4880 2023-11-04T01:35:58.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb30effd640 1 -- 172.21.15.44:0/3618987410 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3100cd6d0 msgr2=0x7fb310161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:58.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb30effd640 1 --2- 172.21.15.44:0/3618987410 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3100cd6d0 0x7fb310161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb30effd640 1 -- 172.21.15.44:0/3618987410 >> v1:172.21.15.204:6789/0 conn(0x7fb310153e60 legacy=0x7fb31015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb30effd640 1 -- 172.21.15.44:0/3618987410 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3100ce090 con 0x7fb3100b4880 2023-11-04T01:35:58.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb30effd640 1 -- 172.21.15.44:0/3618987410 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fb3080019f0 con 0x7fb3100b4880 2023-11-04T01:35:58.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb30effd640 1 -- 172.21.15.44:0/3618987410 >> v1:172.21.15.44:6789/0 conn(0x7fb3100b4880 legacy=0x7fb3100b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb30effd640 1 --2- 172.21.15.44:0/3618987410 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2fc0039a0 0x7fb2fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb30effd640 1 --2- 172.21.15.44:0/3618987410 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3100cd6d0 0x7fb2fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb30effd640 1 --2- 172.21.15.44:0/3618987410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2fc004d00 0x7fb2fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb30effd640 1 -- 172.21.15.44:0/3618987410 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb310161960 con 0x7fb2fc004d00 2023-11-04T01:35:58.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb30effd640 1 -- 172.21.15.44:0/3618987410 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc00ba60 con 0x7fb2fc0039a0 2023-11-04T01:35:58.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb30effd640 1 -- 172.21.15.44:0/3618987410 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc00bc20 con 0x7fb3100cd6d0 2023-11-04T01:35:58.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb314f42640 1 --2- 172.21.15.44:0/3618987410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2fc004d00 0x7fb2fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb30f7fe640 1 --2- 172.21.15.44:0/3618987410 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3100cd6d0 0x7fb2fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb30ffff640 1 --2- 172.21.15.44:0/3618987410 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2fc0039a0 0x7fb2fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb314f42640 1 -- 172.21.15.44:0/3618987410 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3100cd6d0 msgr2=0x7fb2fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb314f42640 1 --2- 172.21.15.44:0/3618987410 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3100cd6d0 0x7fb2fc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb314f42640 1 -- 172.21.15.44:0/3618987410 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2fc0039a0 msgr2=0x7fb2fc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb314f42640 1 --2- 172.21.15.44:0/3618987410 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2fc0039a0 0x7fb2fc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.327+0000 7fb314f42640 1 -- 172.21.15.44:0/3618987410 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc003520 con 0x7fb2fc004d00 2023-11-04T01:35:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.328+0000 7fb314f42640 1 --2- 172.21.15.44:0/3618987410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2fc004d00 0x7fb2fc005180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb30800a7f0 tx=0x7fb2fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10698ceec1d9025 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.328+0000 7fb30effd640 1 -- 172.21.15.44:0/3618987410 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3080072d0 con 0x7fb2fc004d00 2023-11-04T01:35:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.328+0000 7fb30effd640 1 -- 172.21.15.44:0/3618987410 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30802f070 con 0x7fb2fc004d00 2023-11-04T01:35:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.328+0000 7fb30effd640 1 -- 172.21.15.44:0/3618987410 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3080076b0 con 0x7fb2fc004d00 2023-11-04T01:35:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.328+0000 7fb3169a5640 1 -- 172.21.15.44:0/3618987410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2fc004d00 msgr2=0x7fb2fc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.328+0000 7fb3169a5640 1 --2- 172.21.15.44:0/3618987410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2fc004d00 0x7fb2fc005180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb30800a7f0 tx=0x7fb2fc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.328+0000 7fb314f42640 1 -- 172.21.15.44:0/3618987410 reap_dead start 2023-11-04T01:35:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.328+0000 7fb3169a5640 1 -- 172.21.15.44:0/3618987410 shutdown_connections 2023-11-04T01:35:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.328+0000 7fb3169a5640 1 -- 172.21.15.44:0/3618987410 >> 172.21.15.44:0/3618987410 conn(0x7fb3100cf880 msgr2=0x7fb3100cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.329+0000 7fb3169a5640 1 -- 172.21.15.44:0/3618987410 shutdown_connections 2023-11-04T01:35:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.329+0000 7fb3169a5640 1 -- 172.21.15.44:0/3618987410 wait complete. 2023-11-04T01:35:58.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.330+0000 7fb3169a5640 1 Processor -- start 2023-11-04T01:35:58.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.330+0000 7fb3169a5640 1 -- start start 2023-11-04T01:35:58.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb3169a5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2fc004d00 0x7fb3101481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb3169a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3100b7060 0x7fb3100b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb3169a5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb310154ef0 0x7fb310155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb3169a5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3100b7a20 con 0x7fb3100b7060 2023-11-04T01:35:58.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb3169a5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3101f3aa0 con 0x7fb2fc004d00 2023-11-04T01:35:58.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb3169a5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3101f3d80 con 0x7fb310154ef0 2023-11-04T01:35:58.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb30f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3100b7060 0x7fb3100b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb30f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3100b7060 0x7fb3100b74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39886/0 (socket says 172.21.15.44:39886) 2023-11-04T01:35:58.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb30f7fe640 1 -- 172.21.15.44:0/1998013481 learned_addr learned my addr 172.21.15.44:0/1998013481 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:58.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb30ffff640 1 --2- 172.21.15.44:0/1998013481 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2fc004d00 0x7fb3101481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb314f42640 1 --2- 172.21.15.44:0/1998013481 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb310154ef0 0x7fb310155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb30f7fe640 1 -- 172.21.15.44:0/1998013481 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb310154ef0 msgr2=0x7fb310155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb30f7fe640 1 --2- 172.21.15.44:0/1998013481 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb310154ef0 0x7fb310155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb30f7fe640 1 -- 172.21.15.44:0/1998013481 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2fc004d00 msgr2=0x7fb3101481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb30f7fe640 1 --2- 172.21.15.44:0/1998013481 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2fc004d00 0x7fb3101481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb30f7fe640 1 -- 172.21.15.44:0/1998013481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3101f4060 con 0x7fb3100b7060 2023-11-04T01:35:58.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb30ffff640 1 --2- 172.21.15.44:0/1998013481 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2fc004d00 0x7fb3101481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:58.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb30f7fe640 1 --2- 172.21.15.44:0/1998013481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3100b7060 0x7fb3100b74e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80119a0 tx=0x7fb2f8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:58.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb30cff9640 1 -- 172.21.15.44:0/1998013481 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800faf0 con 0x7fb3100b7060 2023-11-04T01:35:58.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb30cff9640 1 -- 172.21.15.44:0/1998013481 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f800fc50 con 0x7fb3100b7060 2023-11-04T01:35:58.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb3169a5640 1 -- 172.21.15.44:0/1998013481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3101f4340 con 0x7fb3100b7060 2023-11-04T01:35:58.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb30cff9640 1 -- 172.21.15.44:0/1998013481 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8014440 con 0x7fb3100b7060 2023-11-04T01:35:58.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.331+0000 7fb3169a5640 1 -- 172.21.15.44:0/1998013481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb310148710 con 0x7fb3100b7060 2023-11-04T01:35:58.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.332+0000 7fb3169a5640 1 -- 172.21.15.44:0/1998013481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb310074290 con 0x7fb3100b7060 2023-11-04T01:35:58.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.333+0000 7fb30cff9640 1 -- 172.21.15.44:0/1998013481 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb2f80145a0 con 0x7fb3100b7060 2023-11-04T01:35:58.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.333+0000 7fb30cff9640 1 --2- 172.21.15.44:0/1998013481 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb2f006ae70 0x7fb2f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.333+0000 7fb30cff9640 1 -- 172.21.15.44:0/1998013481 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb2f8089f20 con 0x7fb3100b7060 2023-11-04T01:35:58.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.334+0000 7fb30ffff640 1 --2- 172.21.15.44:0/1998013481 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb2f006ae70 0x7fb2f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.334+0000 7fb30ffff640 1 --2- 172.21.15.44:0/1998013481 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb2f006ae70 0x7fb2f006d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb3000036b0 tx=0x7fb300009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:58.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.338+0000 7fb30cff9640 1 -- 172.21.15.44:0/1998013481 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2f8054f90 con 0x7fb3100b7060 2023-11-04T01:35:58.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:58.554+0000 7fb3169a5640 1 -- 172.21.15.44:0/1998013481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb3100d0b80 con 0x7fb3100b7060 2023-11-04T01:35:59.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.186+0000 7fb30cff9640 1 -- 172.21.15.44:0/1998013481 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb2f80585b0 con 0x7fb3100b7060 2023-11-04T01:35:59.189 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 2 and data pool 3 2023-11-04T01:35:59.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.190+0000 7fb3169a5640 1 -- 172.21.15.44:0/1998013481 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb2f006ae70 msgr2=0x7fb2f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.190+0000 7fb3169a5640 1 --2- 172.21.15.44:0/1998013481 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb2f006ae70 0x7fb2f006d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb3000036b0 tx=0x7fb300009040 comp rx=0 tx=0).stop 2023-11-04T01:35:59.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.190+0000 7fb3169a5640 1 -- 172.21.15.44:0/1998013481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3100b7060 msgr2=0x7fb3100b74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.190+0000 7fb3169a5640 1 --2- 172.21.15.44:0/1998013481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3100b7060 0x7fb3100b74e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80119a0 tx=0x7fb2f8011e60 comp rx=0 tx=0).stop 2023-11-04T01:35:59.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.190+0000 7fb3169a5640 1 -- 172.21.15.44:0/1998013481 shutdown_connections 2023-11-04T01:35:59.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.190+0000 7fb3169a5640 1 --2- 172.21.15.44:0/1998013481 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb2f006ae70 0x7fb2f006d330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.190+0000 7fb3169a5640 1 --2- 172.21.15.44:0/1998013481 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb310154ef0 0x7fb310155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.190+0000 7fb3169a5640 1 --2- 172.21.15.44:0/1998013481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3100b7060 0x7fb3100b74e0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80119a0 tx=0x7fb2f8011e60 comp rx=0 tx=0).stop 2023-11-04T01:35:59.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.190+0000 7fb3169a5640 1 --2- 172.21.15.44:0/1998013481 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2fc004d00 0x7fb3101481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.190+0000 7fb3169a5640 1 -- 172.21.15.44:0/1998013481 >> 172.21.15.44:0/1998013481 conn(0x7fb3100cf880 msgr2=0x7fb3100cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:59.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.191+0000 7fb3169a5640 1 -- 172.21.15.44:0/1998013481 shutdown_connections 2023-11-04T01:35:59.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.191+0000 7fb3169a5640 1 -- 172.21.15.44:0/1998013481 wait complete. 2023-11-04T01:35:59.211 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-04T01:35:59.212 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-04T01:35:59.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.325+0000 7f2cfef2c640 1 Processor -- start 2023-11-04T01:35:59.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.325+0000 7f2cfef2c640 1 -- start start 2023-11-04T01:35:59.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.326+0000 7f2cfef2c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2cf80cd9f0 0x7f2cf80cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.326+0000 7f2cfef2c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cf80d27c0 0x7f2cf815d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.326+0000 7f2cfef2c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf80d1320 con 0x7f2cf815d4b0 2023-11-04T01:35:59.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.326+0000 7f2cfef2c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf815e4d0 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.326+0000 7f2cfef2c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf80ce310 con 0x7f2cf80d27c0 2023-11-04T01:35:59.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.326+0000 7f2cfccc8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2cf80cd9f0 0x7f2cf80cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.326+0000 7f2cf7fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2cf815d4b0 0x7f2cf80b47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45380/0 (socket says 172.21.15.44:45380) 2023-11-04T01:35:59.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.326+0000 7f2cf7fff640 1 -- 172.21.15.44:0/1958397430 learned_addr learned my addr 172.21.15.44:0/1958397430 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:35:59.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.326+0000 7f2cfd4c9640 1 --2- 172.21.15.44:0/1958397430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cf80d27c0 0x7f2cf815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.327+0000 7f2cfccc8640 1 -- 172.21.15.44:0/1958397430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cf80d27c0 msgr2=0x7f2cf815d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:59.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.327+0000 7f2cfccc8640 1 --2- 172.21.15.44:0/1958397430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cf80d27c0 0x7f2cf815d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.327+0000 7f2cfccc8640 1 -- 172.21.15.44:0/1958397430 >> v1:172.21.15.44:6789/0 conn(0x7f2cf815d4b0 legacy=0x7f2cf80b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.327+0000 7f2cfccc8640 1 -- 172.21.15.44:0/1958397430 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf815df10 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.327+0000 7f2cf77fe640 1 -- 172.21.15.44:0/1958397430 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098011431 0 0) 0x7f2cf80d1320 con 0x7f2cf815d4b0 2023-11-04T01:35:59.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.327+0000 7f2cfccc8640 1 --2- 172.21.15.44:0/1958397430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cf80cd9f0 0x7f2cf80cddd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80097a0 tx=0x7f2ce802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdb140cf299e5ca server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.328+0000 7f2cf77fe640 1 -- 172.21.15.44:0/1958397430 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8030610 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.328+0000 7f2cf77fe640 1 -- 172.21.15.44:0/1958397430 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce8030770 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.328+0000 7f2cf77fe640 1 -- 172.21.15.44:0/1958397430 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8030b00 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.328+0000 7f2cfef2c640 1 -- 172.21.15.44:0/1958397430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cf80cd9f0 msgr2=0x7f2cf80cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.328+0000 7f2cfef2c640 1 --2- 172.21.15.44:0/1958397430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cf80cd9f0 0x7f2cf80cddd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80097a0 tx=0x7f2ce802b960 comp rx=0 tx=0).stop 2023-11-04T01:35:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.328+0000 7f2cfef2c640 1 -- 172.21.15.44:0/1958397430 shutdown_connections 2023-11-04T01:35:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.328+0000 7f2cfef2c640 1 --2- 172.21.15.44:0/1958397430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cf80d27c0 0x7f2cf815d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.328+0000 7f2cfef2c640 1 --2- 172.21.15.44:0/1958397430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cf80cd9f0 0x7f2cf80cddd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.328+0000 7f2cfef2c640 1 -- 172.21.15.44:0/1958397430 >> 172.21.15.44:0/1958397430 conn(0x7f2cf8071c40 msgr2=0x7f2cf8072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.328+0000 7f2cfef2c640 1 -- 172.21.15.44:0/1958397430 shutdown_connections 2023-11-04T01:35:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.328+0000 7f2cfef2c640 1 -- 172.21.15.44:0/1958397430 wait complete. 2023-11-04T01:35:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.329+0000 7f2cfef2c640 1 Processor -- start 2023-11-04T01:35:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.329+0000 7f2cfef2c640 1 -- start start 2023-11-04T01:35:59.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.330+0000 7f2cfef2c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cf80cd9f0 0x7f2cf814afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.330+0000 7f2cfef2c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2cf80d27c0 0x7f2cf80b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.330+0000 7f2cfef2c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cf815d4b0 0x7f2cf815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.330+0000 7f2cfef2c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf80ccdb0 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.330+0000 7f2cfef2c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf80cc1a0 con 0x7f2cf80d27c0 2023-11-04T01:35:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.330+0000 7f2cfef2c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf80cc480 con 0x7f2cf815d4b0 2023-11-04T01:35:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.330+0000 7f2cfccc8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cf80cd9f0 0x7f2cf814afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.330+0000 7f2cfccc8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cf80cd9f0 0x7f2cf814afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39904/0 (socket says 172.21.15.44:39904) 2023-11-04T01:35:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.330+0000 7f2cfccc8640 1 -- 172.21.15.44:0/698940878 learned_addr learned my addr 172.21.15.44:0/698940878 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:35:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.330+0000 7f2cfd4c9640 1 --2- 172.21.15.44:0/698940878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cf815d4b0 0x7f2cf815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.330+0000 7f2cf7fff640 1 --2- 172.21.15.44:0/698940878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2cf80d27c0 0x7f2cf80b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.331+0000 7f2cfccc8640 1 -- 172.21.15.44:0/698940878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cf815d4b0 msgr2=0x7f2cf815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.331+0000 7f2cfccc8640 1 --2- 172.21.15.44:0/698940878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cf815d4b0 0x7f2cf815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.331+0000 7f2cfccc8640 1 -- 172.21.15.44:0/698940878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2cf80d27c0 msgr2=0x7f2cf80b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.331+0000 7f2cfccc8640 1 --2- 172.21.15.44:0/698940878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2cf80d27c0 0x7f2cf80b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.331+0000 7f2cfccc8640 1 -- 172.21.15.44:0/698940878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce8009400 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.331+0000 7f2cf7fff640 1 --2- 172.21.15.44:0/698940878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2cf80d27c0 0x7f2cf80b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:59.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.331+0000 7f2cfccc8640 1 --2- 172.21.15.44:0/698940878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cf80cd9f0 0x7f2cf814afe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2ce802bf70 tx=0x7f2ce80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:59.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.331+0000 7f2cf57fa640 1 -- 172.21.15.44:0/698940878 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce803e070 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.331+0000 7f2cf57fa640 1 -- 172.21.15.44:0/698940878 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce8030e10 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.331+0000 7f2cfef2c640 1 -- 172.21.15.44:0/698940878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf80cc760 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.331+0000 7f2cf57fa640 1 -- 172.21.15.44:0/698940878 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8039c30 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.331+0000 7f2cfef2c640 1 -- 172.21.15.44:0/698940878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf814b520 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.332+0000 7f2cfef2c640 1 -- 172.21.15.44:0/698940878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf804e490 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.332+0000 7f2cf57fa640 1 -- 172.21.15.44:0/698940878 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ce80423f0 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.333+0000 7f2cf57fa640 1 --2- 172.21.15.44:0/698940878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2ce406aea0 0x7f2ce406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.333+0000 7f2cf57fa640 1 -- 172.21.15.44:0/698940878 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ce80ab030 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.333+0000 7f2cf7fff640 1 --2- 172.21.15.44:0/698940878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2ce406aea0 0x7f2ce406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.334+0000 7f2cf7fff640 1 --2- 172.21.15.44:0/698940878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2ce406aea0 0x7f2ce406d360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80d01d0 tx=0x7f2cec007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:59.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.338+0000 7f2cf57fa640 1 -- 172.21.15.44:0/698940878 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ce8076190 con 0x7f2cf80cd9f0 2023-11-04T01:35:59.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:35:59.522+0000 7f2cfef2c640 1 -- 172.21.15.44:0/698940878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f2cf815b0f0 con 0x7f2cf80cd9f0 2023-11-04T01:36:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.162+0000 7f2cf57fa640 1 -- 172.21.15.44:0/698940878 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f2ce80797b0 con 0x7f2cf80cd9f0 2023-11-04T01:36:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.165+0000 7f2cfef2c640 1 -- 172.21.15.44:0/698940878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2ce406aea0 msgr2=0x7f2ce406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.165+0000 7f2cfef2c640 1 --2- 172.21.15.44:0/698940878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2ce406aea0 0x7f2ce406d360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80d01d0 tx=0x7f2cec007ca0 comp rx=0 tx=0).stop 2023-11-04T01:36:00.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.165+0000 7f2cfef2c640 1 -- 172.21.15.44:0/698940878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cf80cd9f0 msgr2=0x7f2cf814afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:00.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.165+0000 7f2cfef2c640 1 --2- 172.21.15.44:0/698940878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cf80cd9f0 0x7f2cf814afe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2ce802bf70 tx=0x7f2ce80046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:00.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.165+0000 7f2cfef2c640 1 -- 172.21.15.44:0/698940878 shutdown_connections 2023-11-04T01:36:00.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.165+0000 7f2cfef2c640 1 --2- 172.21.15.44:0/698940878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2ce406aea0 0x7f2ce406d360 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:00.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.165+0000 7f2cfef2c640 1 --2- 172.21.15.44:0/698940878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2cf815d4b0 0x7f2cf815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:00.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.165+0000 7f2cfef2c640 1 --2- 172.21.15.44:0/698940878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2cf80d27c0 0x7f2cf80b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:00.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.165+0000 7f2cfef2c640 1 --2- 172.21.15.44:0/698940878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cf80cd9f0 0x7f2cf814afe0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:00.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.165+0000 7f2cfef2c640 1 -- 172.21.15.44:0/698940878 >> 172.21.15.44:0/698940878 conn(0x7f2cf8071c40 msgr2=0x7f2cf815fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:00.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.165+0000 7f2cfef2c640 1 -- 172.21.15.44:0/698940878 shutdown_connections 2023-11-04T01:36:00.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.165+0000 7f2cfef2c640 1 -- 172.21.15.44:0/698940878 wait complete. 2023-11-04T01:36:00.181 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:36:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.300+0000 7f083359e640 1 Processor -- start 2023-11-04T01:36:00.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.300+0000 7f083359e640 1 -- start start 2023-11-04T01:36:00.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.301+0000 7f083359e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f082c15ad20 0x7f082c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:00.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.301+0000 7f083359e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c06ffe0 con 0x7f082c0ca030 2023-11-04T01:36:00.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.301+0000 7f083359e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c0ca5a0 con 0x7f082c071e40 2023-11-04T01:36:00.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.301+0000 7f083359e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f082c0ca880 con 0x7f082c15ad20 2023-11-04T01:36:00.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.301+0000 7f0831d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f082c0ca030 0x7f082c0b2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45382/0 (socket says 172.21.15.44:45382) 2023-11-04T01:36:00.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.301+0000 7f0831d9b640 1 -- 172.21.15.44:0/1003604108 learned_addr learned my addr 172.21.15.44:0/1003604108 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:00.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083259c640 1 --2- 172.21.15.44:0/1003604108 >> v2:172.21.15.204:3300/0 conn(0x7f082c15ad20 0x7f082c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:00.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083159a640 1 -- 172.21.15.44:0/1003604108 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851058099 0 0) 0x7f081c001110 con 0x7f082c0ca030 2023-11-04T01:36:00.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083159a640 1 -- 172.21.15.44:0/1003604108 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0818003520 con 0x7f082c0ca030 2023-11-04T01:36:00.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083159a640 1 -- 172.21.15.44:0/1003604108 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2560773116 0 0) 0x7f0818003520 con 0x7f082c0ca030 2023-11-04T01:36:00.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083159a640 1 -- 172.21.15.44:0/1003604108 >> v2:172.21.15.204:3300/0 conn(0x7f082c15ad20 msgr2=0x7f082c06faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:00.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083159a640 1 --2- 172.21.15.44:0/1003604108 >> v2:172.21.15.204:3300/0 conn(0x7f082c15ad20 0x7f082c06faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:00.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083159a640 1 -- 172.21.15.44:0/1003604108 >> v1:172.21.15.204:6789/0 conn(0x7f082c071e40 legacy=0x7f082c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:00.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083159a640 1 -- 172.21.15.44:0/1003604108 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082c0cab60 con 0x7f082c0ca030 2023-11-04T01:36:00.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083159a640 1 -- 172.21.15.44:0/1003604108 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f081c001800 con 0x7f082c0ca030 2023-11-04T01:36:00.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083159a640 1 -- 172.21.15.44:0/1003604108 >> v1:172.21.15.44:6789/0 conn(0x7f082c0ca030 legacy=0x7f082c0b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:00.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083159a640 1 --2- 172.21.15.44:0/1003604108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0818003970 0x7f0818003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:00.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083159a640 1 --2- 172.21.15.44:0/1003604108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08180047c0 0x7f0818004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:00.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083159a640 1 --2- 172.21.15.44:0/1003604108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0818005180 0x7f081800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:00.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083159a640 1 -- 172.21.15.44:0/1003604108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c0ca880 con 0x7f0818005180 2023-11-04T01:36:00.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083159a640 1 -- 172.21.15.44:0/1003604108 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081800c120 con 0x7f0818003970 2023-11-04T01:36:00.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083159a640 1 -- 172.21.15.44:0/1003604108 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081800c2e0 con 0x7f08180047c0 2023-11-04T01:36:00.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f0832d9d640 1 --2- 172.21.15.44:0/1003604108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0818005180 0x7f081800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:00.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f083259c640 1 --2- 172.21.15.44:0/1003604108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0818003970 0x7f0818003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:00.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f0831d9b640 1 --2- 172.21.15.44:0/1003604108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08180047c0 0x7f0818004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:00.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f0832d9d640 1 -- 172.21.15.44:0/1003604108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08180047c0 msgr2=0x7f0818004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f0832d9d640 1 --2- 172.21.15.44:0/1003604108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08180047c0 0x7f0818004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f0832d9d640 1 -- 172.21.15.44:0/1003604108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0818003970 msgr2=0x7f0818003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.302+0000 7f0832d9d640 1 --2- 172.21.15.44:0/1003604108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0818003970 0x7f0818003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.303+0000 7f0832d9d640 1 -- 172.21.15.44:0/1003604108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0818003520 con 0x7f0818005180 2023-11-04T01:36:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.303+0000 7f0832d9d640 1 -- 172.21.15.44:0/1003604108 reap_dead start 2023-11-04T01:36:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.303+0000 7f0832d9d640 1 --2- 172.21.15.44:0/1003604108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0818005180 0x7f081800b980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0824001e50 tx=0x7f08180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c140eb1816b693 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.303+0000 7f083159a640 1 -- 172.21.15.44:0/1003604108 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0824003b70 con 0x7f0818005180 2023-11-04T01:36:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.303+0000 7f083159a640 1 -- 172.21.15.44:0/1003604108 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0824003d10 con 0x7f0818005180 2023-11-04T01:36:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.303+0000 7f083159a640 1 -- 172.21.15.44:0/1003604108 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0824005310 con 0x7f0818005180 2023-11-04T01:36:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.304+0000 7f083359e640 1 -- 172.21.15.44:0/1003604108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0818005180 msgr2=0x7f081800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.304+0000 7f083359e640 1 --2- 172.21.15.44:0/1003604108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0818005180 0x7f081800b980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0824001e50 tx=0x7f08180057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.304+0000 7f083359e640 1 -- 172.21.15.44:0/1003604108 shutdown_connections 2023-11-04T01:36:00.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.304+0000 7f083359e640 1 --2- 172.21.15.44:0/1003604108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0818005180 0x7f081800b980 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:00.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.304+0000 7f083359e640 1 -- 172.21.15.44:0/1003604108 >> 172.21.15.44:0/1003604108 conn(0x7f082c0cc250 msgr2=0x7f082c0cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:00.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.304+0000 7f083359e640 1 -- 172.21.15.44:0/1003604108 shutdown_connections 2023-11-04T01:36:00.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.304+0000 7f083359e640 1 -- 172.21.15.44:0/1003604108 wait complete. 2023-11-04T01:36:00.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.305+0000 7f083359e640 1 Processor -- start 2023-11-04T01:36:00.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.305+0000 7f083359e640 1 -- start start 2023-11-04T01:36:00.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.306+0000 7f083359e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0818005180 0x7f082c0cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:00.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.306+0000 7f083359e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f082c158b70 0x7f082c151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:00.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.306+0000 7f083359e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f082c0c7800 0x7f082c0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:00.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.306+0000 7f083359e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c0c81d0 con 0x7f0818005180 2023-11-04T01:36:00.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.306+0000 7f083359e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c0ac2f0 con 0x7f082c158b70 2023-11-04T01:36:00.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.306+0000 7f083359e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082c1f6c60 con 0x7f082c0c7800 2023-11-04T01:36:00.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.306+0000 7f083259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0818005180 0x7f082c0cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:00.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.306+0000 7f083259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0818005180 0x7f082c0cd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39928/0 (socket says 172.21.15.44:39928) 2023-11-04T01:36:00.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.306+0000 7f083259c640 1 -- 172.21.15.44:0/1820995259 learned_addr learned my addr 172.21.15.44:0/1820995259 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:00.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.306+0000 7f0832d9d640 1 --2- 172.21.15.44:0/1820995259 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f082c0c7800 0x7f082c0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:00.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.306+0000 7f0831d9b640 1 --2- 172.21.15.44:0/1820995259 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f082c158b70 0x7f082c151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:00.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.307+0000 7f083259c640 1 -- 172.21.15.44:0/1820995259 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f082c0c7800 msgr2=0x7f082c0c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:00.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.307+0000 7f083259c640 1 --2- 172.21.15.44:0/1820995259 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f082c0c7800 0x7f082c0c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.307+0000 7f083259c640 1 -- 172.21.15.44:0/1820995259 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f082c158b70 msgr2=0x7f082c151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.307+0000 7f083259c640 1 --2- 172.21.15.44:0/1820995259 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f082c158b70 0x7f082c151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.307+0000 7f083259c640 1 -- 172.21.15.44:0/1820995259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082c0ac590 con 0x7f0818005180 2023-11-04T01:36:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.307+0000 7f0831d9b640 1 --2- 172.21.15.44:0/1820995259 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f082c158b70 0x7f082c151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.307+0000 7f083259c640 1 --2- 172.21.15.44:0/1820995259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0818005180 0x7f082c0cd3a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f08280118e0 tx=0x7f0828011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.307+0000 7f0822ffd640 1 -- 172.21.15.44:0/1820995259 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082800faf0 con 0x7f0818005180 2023-11-04T01:36:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.307+0000 7f0822ffd640 1 -- 172.21.15.44:0/1820995259 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082800fc50 con 0x7f0818005180 2023-11-04T01:36:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.307+0000 7f083359e640 1 -- 172.21.15.44:0/1820995259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082c0adf80 con 0x7f0818005180 2023-11-04T01:36:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.307+0000 7f0822ffd640 1 -- 172.21.15.44:0/1820995259 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828014440 con 0x7f0818005180 2023-11-04T01:36:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.307+0000 7f083359e640 1 -- 172.21.15.44:0/1820995259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082c0ae4a0 con 0x7f0818005180 2023-11-04T01:36:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.308+0000 7f083359e640 1 -- 172.21.15.44:0/1820995259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082c0cb5b0 con 0x7f0818005180 2023-11-04T01:36:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.308+0000 7f0822ffd640 1 -- 172.21.15.44:0/1820995259 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08280145a0 con 0x7f0818005180 2023-11-04T01:36:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.309+0000 7f0822ffd640 1 --2- 172.21.15.44:0/1820995259 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f081006aea0 0x7f081006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:00.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.309+0000 7f0822ffd640 1 -- 172.21.15.44:0/1820995259 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f0828089ea0 con 0x7f0818005180 2023-11-04T01:36:00.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.309+0000 7f0831d9b640 1 --2- 172.21.15.44:0/1820995259 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f081006aea0 0x7f081006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:00.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.309+0000 7f0831d9b640 1 --2- 172.21.15.44:0/1820995259 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f081006aea0 0x7f081006d360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f081c001270 tx=0x7f081c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:00.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.313+0000 7f0822ffd640 1 -- 172.21.15.44:0/1820995259 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0828054e70 con 0x7f0818005180 2023-11-04T01:36:00.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:00.489+0000 7f083359e640 1 -- 172.21.15.44:0/1820995259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f082c0adde0 con 0x7f0818005180 2023-11-04T01:36:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.209+0000 7f0822ffd640 1 -- 172.21.15.44:0/1820995259 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f082c0adde0 con 0x7f0818005180 2023-11-04T01:36:02.212 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data_ec' created 2023-11-04T01:36:02.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.213+0000 7f083359e640 1 -- 172.21.15.44:0/1820995259 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f081006aea0 msgr2=0x7f081006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:02.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.213+0000 7f083359e640 1 --2- 172.21.15.44:0/1820995259 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f081006aea0 0x7f081006d360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f081c001270 tx=0x7f081c009040 comp rx=0 tx=0).stop 2023-11-04T01:36:02.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.213+0000 7f083359e640 1 -- 172.21.15.44:0/1820995259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0818005180 msgr2=0x7f082c0cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:02.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.213+0000 7f083359e640 1 --2- 172.21.15.44:0/1820995259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0818005180 0x7f082c0cd3a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f08280118e0 tx=0x7f0828011da0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.213+0000 7f083359e640 1 -- 172.21.15.44:0/1820995259 shutdown_connections 2023-11-04T01:36:02.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.213+0000 7f083359e640 1 --2- 172.21.15.44:0/1820995259 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f081006aea0 0x7f081006d360 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.213+0000 7f083359e640 1 --2- 172.21.15.44:0/1820995259 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f082c0c7800 0x7f082c0c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.213+0000 7f083359e640 1 --2- 172.21.15.44:0/1820995259 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f082c158b70 0x7f082c151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.213+0000 7f083359e640 1 --2- 172.21.15.44:0/1820995259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0818005180 0x7f082c0cd3a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.213+0000 7f083359e640 1 -- 172.21.15.44:0/1820995259 >> 172.21.15.44:0/1820995259 conn(0x7f082c0cc250 msgr2=0x7f082c159f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:02.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.213+0000 7f083359e640 1 -- 172.21.15.44:0/1820995259 shutdown_connections 2023-11-04T01:36:02.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.213+0000 7f083359e640 1 -- 172.21.15.44:0/1820995259 wait complete. 2023-11-04T01:36:02.234 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-04T01:36:02.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.352+0000 7f59caabb640 1 Processor -- start 2023-11-04T01:36:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.352+0000 7f59caabb640 1 -- start start 2023-11-04T01:36:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.353+0000 7f59caabb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59c415d4b0 0x7f59c415d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.353+0000 7f59caabb640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f59c40d17b0 0x7f59c40d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.353+0000 7f59caabb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c40d1320 con 0x7f59c40cd9f0 2023-11-04T01:36:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.353+0000 7f59caabb640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c415e4d0 con 0x7f59c40d17b0 2023-11-04T01:36:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.353+0000 7f59caabb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c415df10 con 0x7f59c415d4b0 2023-11-04T01:36:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.354+0000 7f59c9058640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f59c40d17b0 0x7f59c40d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.354+0000 7f59c3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59c415d4b0 0x7f59c415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.354+0000 7f59c8857640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f59c40cd9f0 0x7f59c40cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:33932/0 (socket says 172.21.15.44:33932) 2023-11-04T01:36:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.354+0000 7f59c9058640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f59c40d17b0 0x7f59c40d1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:59640/0 (socket says 172.21.15.44:59640) 2023-11-04T01:36:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.354+0000 7f59c8857640 1 -- 172.21.15.44:0/1287424450 learned_addr learned my addr 172.21.15.44:0/1287424450 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.354+0000 7f59c9058640 1 -- 172.21.15.44:0/1287424450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59c415d4b0 msgr2=0x7f59c415d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.354+0000 7f59c9058640 1 --2- 172.21.15.44:0/1287424450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59c415d4b0 0x7f59c415d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.354+0000 7f59c9058640 1 -- 172.21.15.44:0/1287424450 >> v1:172.21.15.204:6789/0 conn(0x7f59c40cd9f0 legacy=0x7f59c40cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.354+0000 7f59c37fe640 1 -- 172.21.15.44:0/1287424450 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926675909 0 0) 0x7f59c40d1320 con 0x7f59c40cd9f0 2023-11-04T01:36:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.354+0000 7f59c9058640 1 -- 172.21.15.44:0/1287424450 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c415e1f0 con 0x7f59c40d17b0 2023-11-04T01:36:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.355+0000 7f59c9058640 1 --2- 172.21.15.44:0/1287424450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c40d17b0 0x7f59c40d1c30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f59b40097a0 tx=0x7f59b402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=514bf87ce01f251f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.355+0000 7f59c37fe640 1 -- 172.21.15.44:0/1287424450 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4030610 con 0x7f59c40d17b0 2023-11-04T01:36:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.355+0000 7f59c37fe640 1 -- 172.21.15.44:0/1287424450 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b4030770 con 0x7f59c40d17b0 2023-11-04T01:36:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.355+0000 7f59c37fe640 1 -- 172.21.15.44:0/1287424450 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4030b00 con 0x7f59c40d17b0 2023-11-04T01:36:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.356+0000 7f59caabb640 1 -- 172.21.15.44:0/1287424450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c40d17b0 msgr2=0x7f59c40d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.356+0000 7f59caabb640 1 --2- 172.21.15.44:0/1287424450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c40d17b0 0x7f59c40d1c30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f59b40097a0 tx=0x7f59b402b960 comp rx=0 tx=0).stop 2023-11-04T01:36:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.356+0000 7f59caabb640 1 -- 172.21.15.44:0/1287424450 shutdown_connections 2023-11-04T01:36:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.356+0000 7f59caabb640 1 --2- 172.21.15.44:0/1287424450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c40d17b0 0x7f59c40d1c30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.356+0000 7f59caabb640 1 --2- 172.21.15.44:0/1287424450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59c415d4b0 0x7f59c415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.356+0000 7f59caabb640 1 -- 172.21.15.44:0/1287424450 >> 172.21.15.44:0/1287424450 conn(0x7f59c4071c40 msgr2=0x7f59c4072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.356+0000 7f59caabb640 1 -- 172.21.15.44:0/1287424450 shutdown_connections 2023-11-04T01:36:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.356+0000 7f59caabb640 1 -- 172.21.15.44:0/1287424450 wait complete. 2023-11-04T01:36:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.357+0000 7f59caabb640 1 Processor -- start 2023-11-04T01:36:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.357+0000 7f59caabb640 1 -- start start 2023-11-04T01:36:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59caabb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59c40cd9f0 0x7f59c414d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59caabb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c40d17b0 0x7f59c40b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59caabb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59c415d4b0 0x7f59c40b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59caabb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4154f40 con 0x7f59c40cd9f0 2023-11-04T01:36:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59caabb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4155190 con 0x7f59c40d17b0 2023-11-04T01:36:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59caabb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4155470 con 0x7f59c415d4b0 2023-11-04T01:36:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59c8857640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59c40cd9f0 0x7f59c414d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59c8857640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59c40cd9f0 0x7f59c414d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39934/0 (socket says 172.21.15.44:39934) 2023-11-04T01:36:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59c8857640 1 -- 172.21.15.44:0/2178111142 learned_addr learned my addr 172.21.15.44:0/2178111142 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59c9058640 1 --2- 172.21.15.44:0/2178111142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59c415d4b0 0x7f59c40b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59c3fff640 1 --2- 172.21.15.44:0/2178111142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c40d17b0 0x7f59c40b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59c8857640 1 -- 172.21.15.44:0/2178111142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59c415d4b0 msgr2=0x7f59c40b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59c8857640 1 --2- 172.21.15.44:0/2178111142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59c415d4b0 0x7f59c40b6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59c8857640 1 -- 172.21.15.44:0/2178111142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c40d17b0 msgr2=0x7f59c40b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59c8857640 1 --2- 172.21.15.44:0/2178111142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c40d17b0 0x7f59c40b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59c8857640 1 -- 172.21.15.44:0/2178111142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b4009400 con 0x7f59c40cd9f0 2023-11-04T01:36:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59c3fff640 1 --2- 172.21.15.44:0/2178111142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c40d17b0 0x7f59c40b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.358+0000 7f59c8857640 1 --2- 172.21.15.44:0/2178111142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59c40cd9f0 0x7f59c414d110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00c890 tx=0x7f59bc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.359+0000 7f59c17fa640 1 -- 172.21.15.44:0/2178111142 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00a640 con 0x7f59c40cd9f0 2023-11-04T01:36:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.359+0000 7f59c17fa640 1 -- 172.21.15.44:0/2178111142 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc00a7c0 con 0x7f59c40cd9f0 2023-11-04T01:36:02.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.359+0000 7f59caabb640 1 -- 172.21.15.44:0/2178111142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c4155750 con 0x7f59c40cd9f0 2023-11-04T01:36:02.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.359+0000 7f59c17fa640 1 -- 172.21.15.44:0/2178111142 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00ab70 con 0x7f59c40cd9f0 2023-11-04T01:36:02.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.359+0000 7f59caabb640 1 -- 172.21.15.44:0/2178111142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c4155d10 con 0x7f59c40cd9f0 2023-11-04T01:36:02.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.360+0000 7f59caabb640 1 -- 172.21.15.44:0/2178111142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c4155f30 con 0x7f59c40cd9f0 2023-11-04T01:36:02.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.360+0000 7f59c17fa640 1 -- 172.21.15.44:0/2178111142 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f59bc00acd0 con 0x7f59c40cd9f0 2023-11-04T01:36:02.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.360+0000 7f59c17fa640 1 --2- 172.21.15.44:0/2178111142 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f59b006ae70 0x7f59b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:02.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.361+0000 7f59c17fa640 1 -- 172.21.15.44:0/2178111142 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f59bc0891b0 con 0x7f59c40cd9f0 2023-11-04T01:36:02.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.361+0000 7f59c3fff640 1 --2- 172.21.15.44:0/2178111142 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f59b006ae70 0x7f59b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.361+0000 7f59c3fff640 1 --2- 172.21.15.44:0/2178111142 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f59b006ae70 0x7f59b006d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f59c40b7ba0 tx=0x7f59b8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:02.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.365+0000 7f59c17fa640 1 -- 172.21.15.44:0/2178111142 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f59bc053f90 con 0x7f59c40cd9f0 2023-11-04T01:36:02.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:02.544+0000 7f59caabb640 1 -- 172.21.15.44:0/2178111142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f59c404e490 con 0x7f59c40cd9f0 2023-11-04T01:36:03.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.214+0000 7f59c17fa640 1 -- 172.21.15.44:0/2178111142 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f59bc0575b0 con 0x7f59c40cd9f0 2023-11-04T01:36:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:set pool 4 allow_ec_overwrites to true 2023-11-04T01:36:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.217+0000 7f59caabb640 1 -- 172.21.15.44:0/2178111142 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f59b006ae70 msgr2=0x7f59b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.217+0000 7f59caabb640 1 --2- 172.21.15.44:0/2178111142 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f59b006ae70 0x7f59b006d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f59c40b7ba0 tx=0x7f59b8008040 comp rx=0 tx=0).stop 2023-11-04T01:36:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.217+0000 7f59caabb640 1 -- 172.21.15.44:0/2178111142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59c40cd9f0 msgr2=0x7f59c414d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.217+0000 7f59caabb640 1 --2- 172.21.15.44:0/2178111142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59c40cd9f0 0x7f59c414d110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00c890 tx=0x7f59bc00cd50 comp rx=0 tx=0).stop 2023-11-04T01:36:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.217+0000 7f59caabb640 1 -- 172.21.15.44:0/2178111142 shutdown_connections 2023-11-04T01:36:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.217+0000 7f59caabb640 1 --2- 172.21.15.44:0/2178111142 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f59b006ae70 0x7f59b006d330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.217+0000 7f59caabb640 1 --2- 172.21.15.44:0/2178111142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59c415d4b0 0x7f59c40b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.217+0000 7f59caabb640 1 --2- 172.21.15.44:0/2178111142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c40d17b0 0x7f59c40b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.217+0000 7f59caabb640 1 --2- 172.21.15.44:0/2178111142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59c40cd9f0 0x7f59c414d110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.217+0000 7f59caabb640 1 -- 172.21.15.44:0/2178111142 >> 172.21.15.44:0/2178111142 conn(0x7f59c4071c40 msgr2=0x7f59c414d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.217+0000 7f59caabb640 1 -- 172.21.15.44:0/2178111142 shutdown_connections 2023-11-04T01:36:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.217+0000 7f59caabb640 1 -- 172.21.15.44:0/2178111142 wait complete. 2023-11-04T01:36:03.247 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-04T01:36:03.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.357+0000 7f9f222e0640 1 Processor -- start 2023-11-04T01:36:03.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.357+0000 7f9f222e0640 1 -- start start 2023-11-04T01:36:03.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.358+0000 7f9f222e0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9f1c0b2d30 0x7f9f1c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.358+0000 7f9f222e0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f1c06c1d0 0x7f9f1c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.358+0000 7f9f222e0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1c06ca40 con 0x7f9f1c160430 2023-11-04T01:36:03.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.358+0000 7f9f222e0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f1c0cb580 con 0x7f9f1c0b2d30 2023-11-04T01:36:03.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.358+0000 7f9f222e0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c06cd20 con 0x7f9f1c06c1d0 2023-11-04T01:36:03.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.358+0000 7f9f1bfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9f1c160430 0x7f9f1c0b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57688/0 (socket says 172.21.15.44:57688) 2023-11-04T01:36:03.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.358+0000 7f9f1bfff640 1 -- 172.21.15.44:0/1984544787 learned_addr learned my addr 172.21.15.44:0/1984544787 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:03.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.358+0000 7f9f1b7fe640 1 --2- 172.21.15.44:0/1984544787 >> v2:172.21.15.204:3300/0 conn(0x7f9f1c0b2d30 0x7f9f1c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.358+0000 7f9f2087d640 1 --2- 172.21.15.44:0/1984544787 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f1c06c1d0 0x7f9f1c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.358+0000 7f9f1affd640 1 -- 172.21.15.44:0/1984544787 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270321253 0 0) 0x7f9f1c06ca40 con 0x7f9f1c160430 2023-11-04T01:36:03.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.358+0000 7f9f1affd640 1 -- 172.21.15.44:0/1984544787 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f04003520 con 0x7f9f1c160430 2023-11-04T01:36:03.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1affd640 1 -- 172.21.15.44:0/1984544787 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2796297029 0 0) 0x7f9f04003520 con 0x7f9f1c160430 2023-11-04T01:36:03.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1affd640 1 -- 172.21.15.44:0/1984544787 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f1c06c1d0 msgr2=0x7f9f1c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:03.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1affd640 1 --2- 172.21.15.44:0/1984544787 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f1c06c1d0 0x7f9f1c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1affd640 1 -- 172.21.15.44:0/1984544787 >> v2:172.21.15.204:3300/0 conn(0x7f9f1c0b2d30 msgr2=0x7f9f1c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:03.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1affd640 1 --2- 172.21.15.44:0/1984544787 >> v2:172.21.15.204:3300/0 conn(0x7f9f1c0b2d30 0x7f9f1c06bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1affd640 1 -- 172.21.15.44:0/1984544787 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c06d000 con 0x7f9f1c160430 2023-11-04T01:36:03.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1affd640 1 -- 172.21.15.44:0/1984544787 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f9f10001670 con 0x7f9f1c160430 2023-11-04T01:36:03.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1affd640 1 -- 172.21.15.44:0/1984544787 >> v1:172.21.15.44:6789/0 conn(0x7f9f1c160430 legacy=0x7f9f1c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1affd640 1 --2- 172.21.15.44:0/1984544787 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f1c06c1d0 0x7f9f04003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1affd640 1 --2- 172.21.15.44:0/1984544787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f04003ef0 0x7f9f040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1affd640 1 --2- 172.21.15.44:0/1984544787 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f04004d00 0x7f9f04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1affd640 1 -- 172.21.15.44:0/1984544787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c0cb580 con 0x7f9f04003ef0 2023-11-04T01:36:03.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1affd640 1 -- 172.21.15.44:0/1984544787 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c06cd20 con 0x7f9f04004d00 2023-11-04T01:36:03.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1affd640 1 -- 172.21.15.44:0/1984544787 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0400b980 con 0x7f9f1c06c1d0 2023-11-04T01:36:03.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1b7fe640 1 --2- 172.21.15.44:0/1984544787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f04003ef0 0x7f9f040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1bfff640 1 --2- 172.21.15.44:0/1984544787 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f1c06c1d0 0x7f9f04003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f2087d640 1 --2- 172.21.15.44:0/1984544787 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f04004d00 0x7f9f04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1b7fe640 1 -- 172.21.15.44:0/1984544787 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f1c06c1d0 msgr2=0x7f9f04003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:03.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1b7fe640 1 --2- 172.21.15.44:0/1984544787 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f1c06c1d0 0x7f9f04003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1b7fe640 1 -- 172.21.15.44:0/1984544787 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f04004d00 msgr2=0x7f9f04005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:03.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1b7fe640 1 --2- 172.21.15.44:0/1984544787 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f04004d00 0x7f9f04005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.359+0000 7f9f1b7fe640 1 -- 172.21.15.44:0/1984544787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f04003520 con 0x7f9f04003ef0 2023-11-04T01:36:03.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.360+0000 7f9f1b7fe640 1 --2- 172.21.15.44:0/1984544787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f04003ef0 0x7f9f040047c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c009ac0 tx=0x7f9f040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdabd7d4433b9d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:03.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.360+0000 7f9f1affd640 1 -- 172.21.15.44:0/1984544787 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c02c6d0 con 0x7f9f04003ef0 2023-11-04T01:36:03.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.360+0000 7f9f1affd640 1 -- 172.21.15.44:0/1984544787 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c02c830 con 0x7f9f04003ef0 2023-11-04T01:36:03.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.360+0000 7f9f1affd640 1 -- 172.21.15.44:0/1984544787 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c02cbc0 con 0x7f9f04003ef0 2023-11-04T01:36:03.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.361+0000 7f9f222e0640 1 -- 172.21.15.44:0/1984544787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f04003ef0 msgr2=0x7f9f040047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.361+0000 7f9f222e0640 1 --2- 172.21.15.44:0/1984544787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f04003ef0 0x7f9f040047c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c009ac0 tx=0x7f9f040057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.361+0000 7f9f2087d640 1 -- 172.21.15.44:0/1984544787 reap_dead start 2023-11-04T01:36:03.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.361+0000 7f9f222e0640 1 -- 172.21.15.44:0/1984544787 shutdown_connections 2023-11-04T01:36:03.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.361+0000 7f9f222e0640 1 -- 172.21.15.44:0/1984544787 >> 172.21.15.44:0/1984544787 conn(0x7f9f1c06ea20 msgr2=0x7f9f1c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.361+0000 7f9f222e0640 1 -- 172.21.15.44:0/1984544787 shutdown_connections 2023-11-04T01:36:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.361+0000 7f9f222e0640 1 -- 172.21.15.44:0/1984544787 wait complete. 2023-11-04T01:36:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.362+0000 7f9f222e0640 1 Processor -- start 2023-11-04T01:36:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.362+0000 7f9f222e0640 1 -- start start 2023-11-04T01:36:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f222e0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f04003ef0 0x7f9f1c154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f222e0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f1c158280 0x7f9f1c0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f222e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f1c1562d0 0x7f9f1c156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f222e0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c153bb0 con 0x7f9f1c1562d0 2023-11-04T01:36:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f222e0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c152d50 con 0x7f9f04003ef0 2023-11-04T01:36:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f222e0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c152fa0 con 0x7f9f1c158280 2023-11-04T01:36:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f2087d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f1c1562d0 0x7f9f1c156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f2087d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f1c1562d0 0x7f9f1c156750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50144/0 (socket says 172.21.15.44:50144) 2023-11-04T01:36:03.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f2087d640 1 -- 172.21.15.44:0/4133460682 learned_addr learned my addr 172.21.15.44:0/4133460682 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:03.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f1b7fe640 1 --2- 172.21.15.44:0/4133460682 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f1c158280 0x7f9f1c0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f1bfff640 1 --2- 172.21.15.44:0/4133460682 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f04003ef0 0x7f9f1c154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f2087d640 1 -- 172.21.15.44:0/4133460682 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f1c158280 msgr2=0x7f9f1c0b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f2087d640 1 --2- 172.21.15.44:0/4133460682 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f1c158280 0x7f9f1c0b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f2087d640 1 -- 172.21.15.44:0/4133460682 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f04003ef0 msgr2=0x7f9f1c154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f2087d640 1 --2- 172.21.15.44:0/4133460682 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f04003ef0 0x7f9f1c154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f2087d640 1 -- 172.21.15.44:0/4133460682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c153280 con 0x7f9f1c1562d0 2023-11-04T01:36:03.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.363+0000 7f9f1bfff640 1 --2- 172.21.15.44:0/4133460682 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f04003ef0 0x7f9f1c154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:03.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.364+0000 7f9f2087d640 1 --2- 172.21.15.44:0/4133460682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f1c1562d0 0x7f9f1c156750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0723c0 tx=0x7f9f140115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:03.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.364+0000 7f9f18ff9640 1 -- 172.21.15.44:0/4133460682 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1400e070 con 0x7f9f1c1562d0 2023-11-04T01:36:03.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.364+0000 7f9f18ff9640 1 -- 172.21.15.44:0/4133460682 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f14011e10 con 0x7f9f1c1562d0 2023-11-04T01:36:03.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.364+0000 7f9f222e0640 1 -- 172.21.15.44:0/4133460682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1c153560 con 0x7f9f1c1562d0 2023-11-04T01:36:03.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.364+0000 7f9f18ff9640 1 -- 172.21.15.44:0/4133460682 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14003990 con 0x7f9f1c1562d0 2023-11-04T01:36:03.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.364+0000 7f9f222e0640 1 -- 172.21.15.44:0/4133460682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1c1586e0 con 0x7f9f1c1562d0 2023-11-04T01:36:03.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.365+0000 7f9f222e0640 1 -- 172.21.15.44:0/4133460682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1c06d400 con 0x7f9f1c1562d0 2023-11-04T01:36:03.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.365+0000 7f9f18ff9640 1 -- 172.21.15.44:0/4133460682 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f14003af0 con 0x7f9f1c1562d0 2023-11-04T01:36:03.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.366+0000 7f9f18ff9640 1 --2- 172.21.15.44:0/4133460682 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9f0806aea0 0x7f9f0806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.366+0000 7f9f18ff9640 1 -- 172.21.15.44:0/4133460682 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f9f1408a020 con 0x7f9f1c1562d0 2023-11-04T01:36:03.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.366+0000 7f9f1bfff640 1 --2- 172.21.15.44:0/4133460682 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9f0806aea0 0x7f9f0806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.366+0000 7f9f1bfff640 1 --2- 172.21.15.44:0/4133460682 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9f0806aea0 0x7f9f0806d360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9f10007fd0 tx=0x7f9f10009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:03.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.370+0000 7f9f18ff9640 1 -- 172.21.15.44:0/4133460682 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9f14054d70 con 0x7f9f1c1562d0 2023-11-04T01:36:03.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:03.587+0000 7f9f222e0640 1 -- 172.21.15.44:0/4133460682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f9f1c06f9b0 con 0x7f9f1c1562d0 2023-11-04T01:36:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.215+0000 7f9f18ff9640 1 -- 172.21.15.44:0/4133460682 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f9f14058390 con 0x7f9f1c1562d0 2023-11-04T01:36:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:added data pool 4 to fsmap 2023-11-04T01:36:04.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.218+0000 7f9f222e0640 1 -- 172.21.15.44:0/4133460682 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9f0806aea0 msgr2=0x7f9f0806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.218+0000 7f9f222e0640 1 --2- 172.21.15.44:0/4133460682 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9f0806aea0 0x7f9f0806d360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9f10007fd0 tx=0x7f9f10009040 comp rx=0 tx=0).stop 2023-11-04T01:36:04.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.218+0000 7f9f222e0640 1 -- 172.21.15.44:0/4133460682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f1c1562d0 msgr2=0x7f9f1c156750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.218+0000 7f9f222e0640 1 --2- 172.21.15.44:0/4133460682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f1c1562d0 0x7f9f1c156750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0723c0 tx=0x7f9f140115a0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.218+0000 7f9f222e0640 1 -- 172.21.15.44:0/4133460682 shutdown_connections 2023-11-04T01:36:04.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.218+0000 7f9f222e0640 1 --2- 172.21.15.44:0/4133460682 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9f0806aea0 0x7f9f0806d360 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.218+0000 7f9f222e0640 1 --2- 172.21.15.44:0/4133460682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f1c1562d0 0x7f9f1c156750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.218+0000 7f9f222e0640 1 --2- 172.21.15.44:0/4133460682 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f1c158280 0x7f9f1c0b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.218+0000 7f9f222e0640 1 --2- 172.21.15.44:0/4133460682 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f04003ef0 0x7f9f1c154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.218+0000 7f9f222e0640 1 -- 172.21.15.44:0/4133460682 >> 172.21.15.44:0/4133460682 conn(0x7f9f1c06ea20 msgr2=0x7f9f1c0cc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:04.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.219+0000 7f9f222e0640 1 -- 172.21.15.44:0/4133460682 shutdown_connections 2023-11-04T01:36:04.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.219+0000 7f9f222e0640 1 -- 172.21.15.44:0/4133460682 wait complete. 2023-11-04T01:36:04.234 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:04.270 INFO:tasks.ceph.mds.c.smithi044.stderr:2023-11-04T01:36:04.268+0000 7f47b029c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:36:04.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.345+0000 7fadc852c640 1 Processor -- start 2023-11-04T01:36:04.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.345+0000 7fadc852c640 1 -- start start 2023-11-04T01:36:04.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.346+0000 7fadc852c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fadc015ad80 0x7fadc006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.346+0000 7fadc852c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc006cd00 con 0x7fadc00c9e10 2023-11-04T01:36:04.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.346+0000 7fadc852c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc006cfa0 con 0x7fadc00b42c0 2023-11-04T01:36:04.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.346+0000 7fadc852c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc006d280 con 0x7fadc015ad80 2023-11-04T01:36:04.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.346+0000 7fadc6ac9640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fadc00c9e10 0x7fadc00b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57690/0 (socket says 172.21.15.44:57690) 2023-11-04T01:36:04.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.346+0000 7fadc6ac9640 1 -- 172.21.15.44:0/469355804 learned_addr learned my addr 172.21.15.44:0/469355804 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:04.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.346+0000 7fadc62c8640 1 --2- 172.21.15.44:0/469355804 >> v2:172.21.15.204:3300/0 conn(0x7fadc015ad80 0x7fadc006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.346+0000 7fadc52c6640 1 -- 172.21.15.44:0/469355804 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947442262 0 0) 0x7fadc006cd00 con 0x7fadc00c9e10 2023-11-04T01:36:04.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.346+0000 7fadc52c6640 1 -- 172.21.15.44:0/469355804 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadac003520 con 0x7fadc00c9e10 2023-11-04T01:36:04.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.347+0000 7fadc62c8640 1 -- 172.21.15.44:0/469355804 >> v1:172.21.15.204:6789/0 conn(0x7fadc00b42c0 legacy=0x7fadc00c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.347+0000 7fadc62c8640 1 -- 172.21.15.44:0/469355804 >> v1:172.21.15.44:6789/0 conn(0x7fadc00c9e10 legacy=0x7fadc00b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.347+0000 7fadc52c6640 1 -- 172.21.15.44:0/469355804 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1655941105 0 0) 0x7fadac003520 con 0x7fadc00c9e10 2023-11-04T01:36:04.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.347+0000 7fadc62c8640 1 -- 172.21.15.44:0/469355804 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc006d560 con 0x7fadc015ad80 2023-11-04T01:36:04.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.347+0000 7fadc62c8640 1 --2- 172.21.15.44:0/469355804 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadc015ad80 0x7fadc006c7c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0097a0 tx=0x7fadbc02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c75eca1922d49338 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:04.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.348+0000 7fadc52c6640 1 -- 172.21.15.44:0/469355804 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb80019f0 con 0x7fadc015ad80 2023-11-04T01:36:04.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.348+0000 7fadc52c6640 1 -- 172.21.15.44:0/469355804 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc031590 con 0x7fadc015ad80 2023-11-04T01:36:04.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.348+0000 7fadc52c6640 1 -- 172.21.15.44:0/469355804 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc031920 con 0x7fadc015ad80 2023-11-04T01:36:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.348+0000 7fadc852c640 1 -- 172.21.15.44:0/469355804 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadc015ad80 msgr2=0x7fadc006c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.348+0000 7fadc852c640 1 --2- 172.21.15.44:0/469355804 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadc015ad80 0x7fadc006c7c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0097a0 tx=0x7fadbc02b8b0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.348+0000 7fadc852c640 1 -- 172.21.15.44:0/469355804 shutdown_connections 2023-11-04T01:36:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.348+0000 7fadc852c640 1 --2- 172.21.15.44:0/469355804 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadc015ad80 0x7fadc006c7c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.348+0000 7fadc852c640 1 -- 172.21.15.44:0/469355804 >> 172.21.15.44:0/469355804 conn(0x7fadc00ce950 msgr2=0x7fadc00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.348+0000 7fadc852c640 1 -- 172.21.15.44:0/469355804 shutdown_connections 2023-11-04T01:36:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.348+0000 7fadc852c640 1 -- 172.21.15.44:0/469355804 wait complete. 2023-11-04T01:36:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.349+0000 7fadc852c640 1 Processor -- start 2023-11-04T01:36:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.349+0000 7fadc852c640 1 -- start start 2023-11-04T01:36:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.350+0000 7fadc852c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadc00b42c0 0x7fadc015de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.350+0000 7fadc852c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadc00c9e10 0x7fadc015b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.350+0000 7fadc852c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadc015ad80 0x7fadc00c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.350+0000 7fadc852c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc01546f0 con 0x7fadc00b42c0 2023-11-04T01:36:04.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.350+0000 7fadc852c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00c6690 con 0x7fadc015ad80 2023-11-04T01:36:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.350+0000 7fadc852c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc015c090 con 0x7fadc00c9e10 2023-11-04T01:36:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.350+0000 7fadc62c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadc00b42c0 0x7fadc015de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.350+0000 7fadc62c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadc00b42c0 0x7fadc015de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50150/0 (socket says 172.21.15.44:50150) 2023-11-04T01:36:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.350+0000 7fadc62c8640 1 -- 172.21.15.44:0/1466000498 learned_addr learned my addr 172.21.15.44:0/1466000498 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.351+0000 7fadc6ac9640 1 --2- 172.21.15.44:0/1466000498 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadc015ad80 0x7fadc00c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.351+0000 7fadc5ac7640 1 --2- 172.21.15.44:0/1466000498 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadc00c9e10 0x7fadc015b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.351+0000 7fadc62c8640 1 -- 172.21.15.44:0/1466000498 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadc00c9e10 msgr2=0x7fadc015b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.351+0000 7fadc62c8640 1 --2- 172.21.15.44:0/1466000498 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadc00c9e10 0x7fadc015b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.351+0000 7fadc62c8640 1 -- 172.21.15.44:0/1466000498 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadc015ad80 msgr2=0x7fadc00c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.351+0000 7fadc62c8640 1 --2- 172.21.15.44:0/1466000498 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadc015ad80 0x7fadc00c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.351+0000 7fadc62c8640 1 -- 172.21.15.44:0/1466000498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc009400 con 0x7fadc00b42c0 2023-11-04T01:36:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.351+0000 7fadc6ac9640 1 --2- 172.21.15.44:0/1466000498 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadc015ad80 0x7fadc00c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.351+0000 7fadc62c8640 1 --2- 172.21.15.44:0/1466000498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadc00b42c0 0x7fadc015de80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fadbc034040 tx=0x7fadbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.351+0000 7fadb6ffd640 1 -- 172.21.15.44:0/1466000498 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc045420 con 0x7fadc00b42c0 2023-11-04T01:36:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.351+0000 7fadb6ffd640 1 -- 172.21.15.44:0/1466000498 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc045580 con 0x7fadc00b42c0 2023-11-04T01:36:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.351+0000 7fadc852c640 1 -- 172.21.15.44:0/1466000498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc015bad0 con 0x7fadc00b42c0 2023-11-04T01:36:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.351+0000 7fadb6ffd640 1 -- 172.21.15.44:0/1466000498 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc045910 con 0x7fadc00b42c0 2023-11-04T01:36:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.351+0000 7fadc852c640 1 -- 172.21.15.44:0/1466000498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc00c6320 con 0x7fadc00b42c0 2023-11-04T01:36:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.352+0000 7fadc852c640 1 -- 172.21.15.44:0/1466000498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc0074290 con 0x7fadc00b42c0 2023-11-04T01:36:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.352+0000 7fadb6ffd640 1 -- 172.21.15.44:0/1466000498 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fadbc043070 con 0x7fadc00b42c0 2023-11-04T01:36:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.353+0000 7fadb6ffd640 1 --2- 172.21.15.44:0/1466000498 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fada406aea0 0x7fada406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.353+0000 7fadb6ffd640 1 -- 172.21.15.44:0/1466000498 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fadbc0ab310 con 0x7fadc00b42c0 2023-11-04T01:36:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.353+0000 7fadc5ac7640 1 --2- 172.21.15.44:0/1466000498 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fada406aea0 0x7fada406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.353+0000 7fadc5ac7640 1 --2- 172.21.15.44:0/1466000498 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fada406aea0 0x7fada406d360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fadc01f47a0 tx=0x7fadb0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:04.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.357+0000 7fadb6ffd640 1 -- 172.21.15.44:0/1466000498 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fadbc0761f0 con 0x7fadc00b42c0 2023-11-04T01:36:04.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.571+0000 7fadc852c640 1 -- 172.21.15.44:0/1466000498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadc00b4880 con 0x7fadc00b42c0 2023-11-04T01:36:04.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.571+0000 7fadb6ffd640 1 -- 172.21.15.44:0/1466000498 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fadbc079810 con 0x7fadc00b42c0 2023-11-04T01:36:04.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:04.574 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2760874964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2760874964},{"type":"v1","addr":"172.21.15.204:6836","nonce":2760874964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3427243577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3427243577},{"type":"v1","addr":"172.21.15.44:6833","nonce":3427243577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/178191500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":178191500},{"type":"v1","addr":"172.21.15.204:6837","nonce":178191500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:58.556492+0000","modified":"2023-11-04T01:36:03.589555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/240936603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":240936603},{"type":"v1","addr":"172.21.15.44:6835","nonce":240936603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-04T01:36:04.574 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2023-11-04T01:36:04.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.573+0000 7fadc852c640 1 -- 172.21.15.44:0/1466000498 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fada406aea0 msgr2=0x7fada406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.573+0000 7fadc852c640 1 --2- 172.21.15.44:0/1466000498 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fada406aea0 0x7fada406d360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fadc01f47a0 tx=0x7fadb0009040 comp rx=0 tx=0).stop 2023-11-04T01:36:04.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.573+0000 7fadc852c640 1 -- 172.21.15.44:0/1466000498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadc00b42c0 msgr2=0x7fadc015de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.573+0000 7fadc852c640 1 --2- 172.21.15.44:0/1466000498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadc00b42c0 0x7fadc015de80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fadbc034040 tx=0x7fadbc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.573+0000 7fadc852c640 1 -- 172.21.15.44:0/1466000498 shutdown_connections 2023-11-04T01:36:04.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.573+0000 7fadc852c640 1 --2- 172.21.15.44:0/1466000498 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fada406aea0 0x7fada406d360 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.573+0000 7fadc852c640 1 --2- 172.21.15.44:0/1466000498 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadc015ad80 0x7fadc00c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.573+0000 7fadc852c640 1 --2- 172.21.15.44:0/1466000498 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadc00c9e10 0x7fadc015b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.573+0000 7fadc852c640 1 --2- 172.21.15.44:0/1466000498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadc00b42c0 0x7fadc015de80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.573+0000 7fadc852c640 1 -- 172.21.15.44:0/1466000498 >> 172.21.15.44:0/1466000498 conn(0x7fadc00ce950 msgr2=0x7fadc00b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:04.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.573+0000 7fadc852c640 1 -- 172.21.15.44:0/1466000498 shutdown_connections 2023-11-04T01:36:04.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.573+0000 7fadc852c640 1 -- 172.21.15.44:0/1466000498 wait complete. 2023-11-04T01:36:04.587 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:04.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.731+0000 7fa8b3561640 1 Processor -- start 2023-11-04T01:36:04.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.731+0000 7fa8b3561640 1 -- start start 2023-11-04T01:36:04.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.732+0000 7fa8b3561640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8ac160b10 0x7fa8ac160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.732+0000 7fa8b3561640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa8ac0cf160 0x7fa8ac0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.732+0000 7fa8b3561640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ac06bf00 con 0x7fa8ac15ce60 2023-11-04T01:36:04.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.732+0000 7fa8b3561640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ac0cbde0 con 0x7fa8ac0cf160 2023-11-04T01:36:04.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.732+0000 7fa8b3561640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0cfb30 con 0x7fa8ac160b10 2023-11-04T01:36:04.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.732+0000 7fa8b1afe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa8ac0cf160 0x7fa8ac0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.732+0000 7fa8b0afc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8ac160b10 0x7fa8ac160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.732+0000 7fa8b1afe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa8ac0cf160 0x7fa8ac0cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:50518/0 (socket says 172.21.15.44:50518) 2023-11-04T01:36:04.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.732+0000 7fa8b1afe640 1 -- 172.21.15.44:0/629400847 learned_addr learned my addr 172.21.15.44:0/629400847 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:04.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.732+0000 7fa8b12fd640 1 --1- 172.21.15.44:0/629400847 >> v1:172.21.15.204:6789/0 conn(0x7fa8ac15ce60 0x7fa8ac06b7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:40380/0 (socket says 172.21.15.44:40380) 2023-11-04T01:36:04.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.732+0000 7fa8b0afc640 1 -- 172.21.15.44:0/629400847 >> v2:172.21.15.204:3300/0 conn(0x7fa8ac0cf160 msgr2=0x7fa8ac0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:04.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.732+0000 7fa8b0afc640 1 --2- 172.21.15.44:0/629400847 >> v2:172.21.15.204:3300/0 conn(0x7fa8ac0cf160 0x7fa8ac0cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.732+0000 7fa8b0afc640 1 -- 172.21.15.44:0/629400847 >> v1:172.21.15.204:6789/0 conn(0x7fa8ac15ce60 legacy=0x7fa8ac06b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.732+0000 7fa8b0afc640 1 -- 172.21.15.44:0/629400847 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac1615d0 con 0x7fa8ac160b10 2023-11-04T01:36:04.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.732+0000 7fa8b1afe640 1 --2- 172.21.15.44:0/629400847 >> v2:172.21.15.204:3300/0 conn(0x7fa8ac0cf160 0x7fa8ac0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:04.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.733+0000 7fa8b0afc640 1 --2- 172.21.15.44:0/629400847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8ac160b10 0x7fa8ac160f90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0097a0 tx=0x7fa89c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=208da5c2e4c51669 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:04.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.733+0000 7fa8a3fff640 1 -- 172.21.15.44:0/629400847 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c031830 con 0x7fa8ac160b10 2023-11-04T01:36:04.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.733+0000 7fa8a3fff640 1 -- 172.21.15.44:0/629400847 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c031990 con 0x7fa8ac160b10 2023-11-04T01:36:04.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.733+0000 7fa8a3fff640 1 -- 172.21.15.44:0/629400847 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c031d20 con 0x7fa8ac160b10 2023-11-04T01:36:04.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.734+0000 7fa8b3561640 1 -- 172.21.15.44:0/629400847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8ac160b10 msgr2=0x7fa8ac160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.734+0000 7fa8b3561640 1 --2- 172.21.15.44:0/629400847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8ac160b10 0x7fa8ac160f90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0097a0 tx=0x7fa89c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.734+0000 7fa8b3561640 1 -- 172.21.15.44:0/629400847 shutdown_connections 2023-11-04T01:36:04.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.734+0000 7fa8b3561640 1 --2- 172.21.15.44:0/629400847 >> v2:172.21.15.204:3300/0 conn(0x7fa8ac0cf160 0x7fa8ac0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.734+0000 7fa8b3561640 1 --2- 172.21.15.44:0/629400847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8ac160b10 0x7fa8ac160f90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.734+0000 7fa8b3561640 1 -- 172.21.15.44:0/629400847 >> 172.21.15.44:0/629400847 conn(0x7fa8ac06ea90 msgr2=0x7fa8ac06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:04.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.734+0000 7fa8b3561640 1 -- 172.21.15.44:0/629400847 shutdown_connections 2023-11-04T01:36:04.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.734+0000 7fa8b3561640 1 -- 172.21.15.44:0/629400847 wait complete. 2023-11-04T01:36:04.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.735+0000 7fa8b3561640 1 Processor -- start 2023-11-04T01:36:04.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.735+0000 7fa8b3561640 1 -- start start 2023-11-04T01:36:04.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b3561640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8ac0cf160 0x7fa8ac0c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b3561640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8ac15ce60 0x7fa8ac0ac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b3561640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8ac160b10 0x7fa8ac14ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b3561640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0caea0 con 0x7fa8ac0cf160 2023-11-04T01:36:04.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b3561640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0ace50 con 0x7fa8ac15ce60 2023-11-04T01:36:04.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b3561640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0ca220 con 0x7fa8ac160b10 2023-11-04T01:36:04.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b12fd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8ac0cf160 0x7fa8ac0c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b12fd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8ac0cf160 0x7fa8ac0c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50166/0 (socket says 172.21.15.44:50166) 2023-11-04T01:36:04.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b12fd640 1 -- 172.21.15.44:0/19832449 learned_addr learned my addr 172.21.15.44:0/19832449 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:04.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b1afe640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8ac160b10 0x7fa8ac14ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b0afc640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8ac15ce60 0x7fa8ac0ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b12fd640 1 -- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8ac160b10 msgr2=0x7fa8ac14ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b12fd640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8ac160b10 0x7fa8ac14ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b12fd640 1 -- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8ac15ce60 msgr2=0x7fa8ac0ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b12fd640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8ac15ce60 0x7fa8ac0ac910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b12fd640 1 -- 172.21.15.44:0/19832449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a4009b30 con 0x7fa8ac0cf160 2023-11-04T01:36:04.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b1afe640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8ac160b10 0x7fa8ac14ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:04.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.736+0000 7fa8b0afc640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8ac15ce60 0x7fa8ac0ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:04.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.737+0000 7fa8b12fd640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8ac0cf160 0x7fa8ac0c9b60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800c3f0 tx=0x7fa8a800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:04.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.737+0000 7fa8a1ffb640 1 -- 172.21.15.44:0/19832449 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80074e0 con 0x7fa8ac0cf160 2023-11-04T01:36:04.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.737+0000 7fa8a1ffb640 1 -- 172.21.15.44:0/19832449 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a8007640 con 0x7fa8ac0cf160 2023-11-04T01:36:04.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.737+0000 7fa8b3561640 1 -- 172.21.15.44:0/19832449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89c009400 con 0x7fa8ac0cf160 2023-11-04T01:36:04.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.737+0000 7fa8a1ffb640 1 -- 172.21.15.44:0/19832449 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8004a00 con 0x7fa8ac0cf160 2023-11-04T01:36:04.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.737+0000 7fa8b3561640 1 -- 172.21.15.44:0/19832449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac0ca7e0 con 0x7fa8ac0cf160 2023-11-04T01:36:04.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.738+0000 7fa8b3561640 1 -- 172.21.15.44:0/19832449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ac1f2d50 con 0x7fa8ac0cf160 2023-11-04T01:36:04.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.738+0000 7fa8a1ffb640 1 -- 172.21.15.44:0/19832449 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa8a8004b60 con 0x7fa8ac0cf160 2023-11-04T01:36:04.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.739+0000 7fa8a1ffb640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa89006ae70 0x7fa89006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.739+0000 7fa8a1ffb640 1 -- 172.21.15.44:0/19832449 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8a8089210 con 0x7fa8ac0cf160 2023-11-04T01:36:04.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.739+0000 7fa8b0afc640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa89006ae70 0x7fa89006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.739+0000 7fa8b0afc640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa89006ae70 0x7fa89006d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa89c036000 tx=0x7fa89c03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:04.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.743+0000 7fa8a1ffb640 1 -- 172.21.15.44:0/19832449 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8a8054110 con 0x7fa8ac0cf160 2023-11-04T01:36:04.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.919+0000 7fa8b3561640 1 -- 172.21.15.44:0/19832449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8ac074290 con 0x7fa8ac0cf160 2023-11-04T01:36:04.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.920+0000 7fa8a1ffb640 1 -- 172.21.15.44:0/19832449 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fa8a8057730 con 0x7fa8ac0cf160 2023-11-04T01:36:04.922 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:04.923 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:03.589395+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:04.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.922+0000 7fa8b3561640 1 -- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa89006ae70 msgr2=0x7fa89006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.922+0000 7fa8b3561640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa89006ae70 0x7fa89006d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa89c036000 tx=0x7fa89c03c040 comp rx=0 tx=0).stop 2023-11-04T01:36:04.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.922+0000 7fa8b3561640 1 -- 172.21.15.44:0/19832449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8ac0cf160 msgr2=0x7fa8ac0c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.922+0000 7fa8b3561640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8ac0cf160 0x7fa8ac0c9b60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800c3f0 tx=0x7fa8a800c8b0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.922+0000 7fa8b3561640 1 -- 172.21.15.44:0/19832449 shutdown_connections 2023-11-04T01:36:04.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.922+0000 7fa8b3561640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa89006ae70 0x7fa89006d330 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.922+0000 7fa8b3561640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8ac160b10 0x7fa8ac14ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.922+0000 7fa8b3561640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8ac15ce60 0x7fa8ac0ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.922+0000 7fa8b3561640 1 --2- 172.21.15.44:0/19832449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8ac0cf160 0x7fa8ac0c9b60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.922+0000 7fa8b3561640 1 -- 172.21.15.44:0/19832449 >> 172.21.15.44:0/19832449 conn(0x7fa8ac06ea90 msgr2=0x7fa8ac072c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:04.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.922+0000 7fa8b3561640 1 -- 172.21.15.44:0/19832449 shutdown_connections 2023-11-04T01:36:04.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:04.922+0000 7fa8b3561640 1 -- 172.21.15.44:0/19832449 wait complete. 2023-11-04T01:36:04.935 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:05.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.039+0000 7f9916b05640 1 Processor -- start 2023-11-04T01:36:05.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.039+0000 7f9916b05640 1 -- start start 2023-11-04T01:36:05.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f9916b05640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f991015ce60 0x7f991006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f9916b05640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f991006bd30 0x7f9910160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f9916b05640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9910161050 0x7f99100cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f9916b05640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99100cbde0 con 0x7f991006bd30 2023-11-04T01:36:05.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f9916b05640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99101615d0 con 0x7f9910161050 2023-11-04T01:36:05.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f9916b05640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99101618b0 con 0x7f991015ce60 2023-11-04T01:36:05.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f990ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f991006bd30 0x7f9910160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f990ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f991006bd30 0x7f9910160b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50176/0 (socket says 172.21.15.44:50176) 2023-11-04T01:36:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f990ffff640 1 -- 172.21.15.44:0/3336969670 learned_addr learned my addr 172.21.15.44:0/3336969670 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f99148a1640 1 --2- 172.21.15.44:0/3336969670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f991015ce60 0x7f991006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f99150a2640 1 --2- 172.21.15.44:0/3336969670 >> v2:172.21.15.204:3300/0 conn(0x7f9910161050 0x7f99100cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f990ffff640 1 -- 172.21.15.44:0/3336969670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f991015ce60 msgr2=0x7f991006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f990ffff640 1 --2- 172.21.15.44:0/3336969670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f991015ce60 0x7f991006b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f990ffff640 1 -- 172.21.15.44:0/3336969670 >> v2:172.21.15.204:3300/0 conn(0x7f9910161050 msgr2=0x7f99100cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f990ffff640 1 --2- 172.21.15.44:0/3336969670 >> v2:172.21.15.204:3300/0 conn(0x7f9910161050 0x7f99100cf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f990ffff640 1 -- 172.21.15.44:0/3336969670 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99100cba00 con 0x7f991006bd30 2023-11-04T01:36:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.040+0000 7f99148a1640 1 --2- 172.21.15.44:0/3336969670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f991015ce60 0x7f991006b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.041+0000 7f990ffff640 1 --2- 172.21.15.44:0/3336969670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991006bd30 0x7f9910160b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f99100b05d0 tx=0x7f98fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950233cb33267fb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.041+0000 7f990f7fe640 1 -- 172.21.15.44:0/3336969670 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc031870 con 0x7f991006bd30 2023-11-04T01:36:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.041+0000 7f990f7fe640 1 -- 172.21.15.44:0/3336969670 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc0319d0 con 0x7f991006bd30 2023-11-04T01:36:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.041+0000 7f990f7fe640 1 -- 172.21.15.44:0/3336969670 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc031d60 con 0x7f991006bd30 2023-11-04T01:36:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.041+0000 7f9916b05640 1 -- 172.21.15.44:0/3336969670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991006bd30 msgr2=0x7f9910160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.041+0000 7f9916b05640 1 --2- 172.21.15.44:0/3336969670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991006bd30 0x7f9910160b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f99100b05d0 tx=0x7f98fc02b910 comp rx=0 tx=0).stop 2023-11-04T01:36:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.042+0000 7f9916b05640 1 -- 172.21.15.44:0/3336969670 shutdown_connections 2023-11-04T01:36:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.042+0000 7f9916b05640 1 --2- 172.21.15.44:0/3336969670 >> v2:172.21.15.204:3300/0 conn(0x7f9910161050 0x7f99100cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.042+0000 7f9916b05640 1 --2- 172.21.15.44:0/3336969670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991006bd30 0x7f9910160b10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.042+0000 7f9916b05640 1 --2- 172.21.15.44:0/3336969670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f991015ce60 0x7f991006b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.042+0000 7f9916b05640 1 -- 172.21.15.44:0/3336969670 >> 172.21.15.44:0/3336969670 conn(0x7f991006ea90 msgr2=0x7f991006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.042+0000 7f9916b05640 1 -- 172.21.15.44:0/3336969670 shutdown_connections 2023-11-04T01:36:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.042+0000 7f9916b05640 1 -- 172.21.15.44:0/3336969670 wait complete. 2023-11-04T01:36:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.043+0000 7f9916b05640 1 Processor -- start 2023-11-04T01:36:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.043+0000 7f9916b05640 1 -- start start 2023-11-04T01:36:05.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f9916b05640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f991015ce60 0x7f99100b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f9916b05640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9910161050 0x7f99101f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f9916b05640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9910148fa0 0x7f99100cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f9916b05640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99100b4770 con 0x7f9910161050 2023-11-04T01:36:05.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f9916b05640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99101f6a70 con 0x7f991015ce60 2023-11-04T01:36:05.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f9916b05640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99100b3b60 con 0x7f9910148fa0 2023-11-04T01:36:05.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f990ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9910161050 0x7f99101f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f990ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9910161050 0x7f99101f6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50178/0 (socket says 172.21.15.44:50178) 2023-11-04T01:36:05.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f990ffff640 1 -- 172.21.15.44:0/2837521419 learned_addr learned my addr 172.21.15.44:0/2837521419 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:05.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f99150a2640 1 --2- 172.21.15.44:0/2837521419 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9910148fa0 0x7f99100cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f99148a1640 1 --2- 172.21.15.44:0/2837521419 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f991015ce60 0x7f99100b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f990ffff640 1 -- 172.21.15.44:0/2837521419 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9910148fa0 msgr2=0x7f99100cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f990ffff640 1 --2- 172.21.15.44:0/2837521419 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9910148fa0 0x7f99100cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f990ffff640 1 -- 172.21.15.44:0/2837521419 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f991015ce60 msgr2=0x7f99100b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f990ffff640 1 --2- 172.21.15.44:0/2837521419 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f991015ce60 0x7f99100b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f990ffff640 1 -- 172.21.15.44:0/2837521419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc0094d0 con 0x7f9910161050 2023-11-04T01:36:05.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f990ffff640 1 --2- 172.21.15.44:0/2837521419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9910161050 0x7f99101f6530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f98fc02b950 tx=0x7f98fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.044+0000 7f990d7fa640 1 -- 172.21.15.44:0/2837521419 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc031860 con 0x7f9910161050 2023-11-04T01:36:05.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.045+0000 7f990d7fa640 1 -- 172.21.15.44:0/2837521419 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc0443f0 con 0x7f9910161050 2023-11-04T01:36:05.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.045+0000 7f9916b05640 1 -- 172.21.15.44:0/2837521419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99100b3e40 con 0x7f9910161050 2023-11-04T01:36:05.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.045+0000 7f990d7fa640 1 -- 172.21.15.44:0/2837521419 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0447a0 con 0x7f9910161050 2023-11-04T01:36:05.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.045+0000 7f9916b05640 1 -- 172.21.15.44:0/2837521419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99100b4400 con 0x7f9910161050 2023-11-04T01:36:05.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.046+0000 7f9916b05640 1 -- 172.21.15.44:0/2837521419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99100b4900 con 0x7f9910161050 2023-11-04T01:36:05.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.046+0000 7f990d7fa640 1 -- 172.21.15.44:0/2837521419 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f98fc04d450 con 0x7f9910161050 2023-11-04T01:36:05.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.046+0000 7f990d7fa640 1 --2- 172.21.15.44:0/2837521419 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f98f406ae70 0x7f98f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.046+0000 7f990d7fa640 1 -- 172.21.15.44:0/2837521419 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f98fc02d040 con 0x7f9910161050 2023-11-04T01:36:05.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.047+0000 7f99148a1640 1 --2- 172.21.15.44:0/2837521419 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f98f406ae70 0x7f98f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.047+0000 7f99148a1640 1 --2- 172.21.15.44:0/2837521419 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f98f406ae70 0x7f98f406d330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9904006b10 tx=0x7f9904008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.051+0000 7f990d7fa640 1 -- 172.21.15.44:0/2837521419 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f98fc076da0 con 0x7f9910161050 2023-11-04T01:36:05.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.228+0000 7f9916b05640 1 -- 172.21.15.44:0/2837521419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9910074290 con 0x7f9910161050 2023-11-04T01:36:05.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.229+0000 7f990d7fa640 1 -- 172.21.15.44:0/2837521419 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f98fc035070 con 0x7f9910161050 2023-11-04T01:36:05.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:05.231 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:03.589395+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:05.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.231+0000 7f9916b05640 1 -- 172.21.15.44:0/2837521419 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f98f406ae70 msgr2=0x7f98f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.231+0000 7f9916b05640 1 --2- 172.21.15.44:0/2837521419 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f98f406ae70 0x7f98f406d330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9904006b10 tx=0x7f9904008040 comp rx=0 tx=0).stop 2023-11-04T01:36:05.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.231+0000 7f9916b05640 1 -- 172.21.15.44:0/2837521419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9910161050 msgr2=0x7f99101f6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.231+0000 7f9916b05640 1 --2- 172.21.15.44:0/2837521419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9910161050 0x7f99101f6530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f98fc02b950 tx=0x7f98fc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.231+0000 7f9916b05640 1 -- 172.21.15.44:0/2837521419 shutdown_connections 2023-11-04T01:36:05.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.231+0000 7f9916b05640 1 --2- 172.21.15.44:0/2837521419 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f98f406ae70 0x7f98f406d330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.231+0000 7f9916b05640 1 --2- 172.21.15.44:0/2837521419 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9910148fa0 0x7f99100cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.231+0000 7f9916b05640 1 --2- 172.21.15.44:0/2837521419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9910161050 0x7f99101f6530 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.231+0000 7f9916b05640 1 --2- 172.21.15.44:0/2837521419 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f991015ce60 0x7f99100b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.231+0000 7f9916b05640 1 -- 172.21.15.44:0/2837521419 >> 172.21.15.44:0/2837521419 conn(0x7f991006ea90 msgr2=0x7f99100cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:05.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.231+0000 7f9916b05640 1 -- 172.21.15.44:0/2837521419 shutdown_connections 2023-11-04T01:36:05.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.231+0000 7f9916b05640 1 -- 172.21.15.44:0/2837521419 wait complete. 2023-11-04T01:36:05.278 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:05.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.383+0000 7fab0b294640 1 Processor -- start 2023-11-04T01:36:05.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.383+0000 7fab0b294640 1 -- start start 2023-11-04T01:36:05.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.384+0000 7fab0b294640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fab040cde60 0x7fab0415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.384+0000 7fab0b294640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab0415daa0 0x7fab04157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.384+0000 7fab0b294640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fab040ce240 0x7fab04157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.384+0000 7fab0b294640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0415e5c0 con 0x7fab040ce240 2023-11-04T01:36:05.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.384+0000 7fab0b294640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab04157a80 con 0x7fab040cde60 2023-11-04T01:36:05.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.384+0000 7fab0b294640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0415e000 con 0x7fab0415daa0 2023-11-04T01:36:05.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.384+0000 7fab09831640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fab040ce240 0x7fab04157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.384+0000 7fab09831640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fab040ce240 0x7fab04157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50190/0 (socket says 172.21.15.44:50190) 2023-11-04T01:36:05.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.384+0000 7fab09831640 1 -- 172.21.15.44:0/2650872693 learned_addr learned my addr 172.21.15.44:0/2650872693 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:05.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.385+0000 7fab09030640 1 --2- 172.21.15.44:0/2650872693 >> v2:172.21.15.204:3300/0 conn(0x7fab040cde60 0x7fab0415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.385+0000 7fab0882f640 1 --2- 172.21.15.44:0/2650872693 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab0415daa0 0x7fab04157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.385+0000 7fab09831640 1 -- 172.21.15.44:0/2650872693 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab0415daa0 msgr2=0x7fab04157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:05.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.385+0000 7fab09831640 1 --2- 172.21.15.44:0/2650872693 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab0415daa0 0x7fab04157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.385+0000 7fab09831640 1 -- 172.21.15.44:0/2650872693 >> v2:172.21.15.204:3300/0 conn(0x7fab040cde60 msgr2=0x7fab0415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:05.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.385+0000 7fab09831640 1 --2- 172.21.15.44:0/2650872693 >> v2:172.21.15.204:3300/0 conn(0x7fab040cde60 0x7fab0415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.385+0000 7fab09831640 1 -- 172.21.15.44:0/2650872693 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0415e2e0 con 0x7fab040ce240 2023-11-04T01:36:05.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.385+0000 7fab09831640 1 --2- 172.21.15.44:0/2650872693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab040ce240 0x7fab04157540 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fab040b5550 tx=0x7faaf402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35792cd076f65feb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.385+0000 7fab03fff640 1 -- 172.21.15.44:0/2650872693 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf402ca70 con 0x7fab040ce240 2023-11-04T01:36:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.386+0000 7fab03fff640 1 -- 172.21.15.44:0/2650872693 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf402cbd0 con 0x7fab040ce240 2023-11-04T01:36:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.386+0000 7fab03fff640 1 -- 172.21.15.44:0/2650872693 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf40343f0 con 0x7fab040ce240 2023-11-04T01:36:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.386+0000 7fab0b294640 1 -- 172.21.15.44:0/2650872693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab040ce240 msgr2=0x7fab04157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.386+0000 7fab0b294640 1 --2- 172.21.15.44:0/2650872693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab040ce240 0x7fab04157540 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fab040b5550 tx=0x7faaf402bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.386+0000 7fab0b294640 1 -- 172.21.15.44:0/2650872693 shutdown_connections 2023-11-04T01:36:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.386+0000 7fab0b294640 1 --2- 172.21.15.44:0/2650872693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab040ce240 0x7fab04157540 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.386+0000 7fab0b294640 1 --2- 172.21.15.44:0/2650872693 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab0415daa0 0x7fab04157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.386+0000 7fab0b294640 1 --2- 172.21.15.44:0/2650872693 >> v2:172.21.15.204:3300/0 conn(0x7fab040cde60 0x7fab0415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.386+0000 7fab0b294640 1 -- 172.21.15.44:0/2650872693 >> 172.21.15.44:0/2650872693 conn(0x7fab04071f30 msgr2=0x7fab040cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.386+0000 7fab0b294640 1 -- 172.21.15.44:0/2650872693 shutdown_connections 2023-11-04T01:36:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.386+0000 7fab0b294640 1 -- 172.21.15.44:0/2650872693 wait complete. 2023-11-04T01:36:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.387+0000 7fab0b294640 1 Processor -- start 2023-11-04T01:36:05.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.387+0000 7fab0b294640 1 -- start start 2023-11-04T01:36:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab0b294640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab040cde60 0x7fab041542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab0b294640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab040ce240 0x7fab040ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab0b294640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab0415daa0 0x7fab04157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab0b294640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab040ca1f0 con 0x7fab0415daa0 2023-11-04T01:36:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab0b294640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab040ca460 con 0x7fab040cde60 2023-11-04T01:36:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab0b294640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab040ca740 con 0x7fab040ce240 2023-11-04T01:36:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab09831640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab0415daa0 0x7fab04157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab09831640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab0415daa0 0x7fab04157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50198/0 (socket says 172.21.15.44:50198) 2023-11-04T01:36:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab09831640 1 -- 172.21.15.44:0/3680370138 learned_addr learned my addr 172.21.15.44:0/3680370138 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab09030640 1 --2- 172.21.15.44:0/3680370138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab040cde60 0x7fab041542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab0882f640 1 --2- 172.21.15.44:0/3680370138 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab040ce240 0x7fab040ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab09831640 1 -- 172.21.15.44:0/3680370138 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab040ce240 msgr2=0x7fab040ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab09831640 1 --2- 172.21.15.44:0/3680370138 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab040ce240 0x7fab040ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab09831640 1 -- 172.21.15.44:0/3680370138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab040cde60 msgr2=0x7fab041542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab09831640 1 --2- 172.21.15.44:0/3680370138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab040cde60 0x7fab041542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.388+0000 7fab09831640 1 -- 172.21.15.44:0/3680370138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf4009b30 con 0x7fab0415daa0 2023-11-04T01:36:05.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.389+0000 7fab09831640 1 --2- 172.21.15.44:0/3680370138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab0415daa0 0x7fab04157c20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faaf4036040 tx=0x7faaf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.389+0000 7fab01ffb640 1 -- 172.21.15.44:0/3680370138 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4009510 con 0x7fab0415daa0 2023-11-04T01:36:05.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.389+0000 7fab01ffb640 1 -- 172.21.15.44:0/3680370138 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf403e450 con 0x7fab0415daa0 2023-11-04T01:36:05.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.389+0000 7fab0b294640 1 -- 172.21.15.44:0/3680370138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab040caa20 con 0x7fab0415daa0 2023-11-04T01:36:05.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.389+0000 7fab01ffb640 1 -- 172.21.15.44:0/3680370138 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf403e800 con 0x7fab0415daa0 2023-11-04T01:36:05.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.389+0000 7fab0b294640 1 -- 172.21.15.44:0/3680370138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab04154810 con 0x7fab0415daa0 2023-11-04T01:36:05.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.390+0000 7fab0b294640 1 -- 172.21.15.44:0/3680370138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab040caf40 con 0x7fab0415daa0 2023-11-04T01:36:05.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.390+0000 7fab01ffb640 1 -- 172.21.15.44:0/3680370138 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faaf403e960 con 0x7fab0415daa0 2023-11-04T01:36:05.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.391+0000 7fab01ffb640 1 --2- 172.21.15.44:0/3680370138 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faaf006ae70 0x7faaf006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.391+0000 7fab01ffb640 1 -- 172.21.15.44:0/3680370138 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faaf40ac6d0 con 0x7fab0415daa0 2023-11-04T01:36:05.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.391+0000 7fab09030640 1 --2- 172.21.15.44:0/3680370138 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faaf006ae70 0x7faaf006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.391+0000 7fab09030640 1 --2- 172.21.15.44:0/3680370138 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faaf006ae70 0x7faaf006d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faafc006fd0 tx=0x7faafc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.395+0000 7fab01ffb640 1 -- 172.21.15.44:0/3680370138 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fab040caf40 con 0x7fab0415daa0 2023-11-04T01:36:05.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.607+0000 7fab0b294640 1 -- 172.21.15.44:0/3680370138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab040caf40 con 0x7fab0415daa0 2023-11-04T01:36:05.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.607+0000 7fab01ffb640 1 -- 172.21.15.44:0/3680370138 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fab040caf40 con 0x7fab0415daa0 2023-11-04T01:36:05.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:05.610 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2760874964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2760874964},{"type":"v1","addr":"172.21.15.204:6836","nonce":2760874964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3427243577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3427243577},{"type":"v1","addr":"172.21.15.44:6833","nonce":3427243577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/178191500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":178191500},{"type":"v1","addr":"172.21.15.204:6837","nonce":178191500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:58.556492+0000","modified":"2023-11-04T01:36:03.589555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/240936603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":240936603},{"type":"v1","addr":"172.21.15.44:6835","nonce":240936603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-04T01:36:05.610 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2023-11-04T01:36:05.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.609+0000 7fab0b294640 1 -- 172.21.15.44:0/3680370138 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faaf006ae70 msgr2=0x7faaf006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.609+0000 7fab0b294640 1 --2- 172.21.15.44:0/3680370138 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faaf006ae70 0x7faaf006d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faafc006fd0 tx=0x7faafc008040 comp rx=0 tx=0).stop 2023-11-04T01:36:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.609+0000 7fab0b294640 1 -- 172.21.15.44:0/3680370138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab0415daa0 msgr2=0x7fab04157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.609+0000 7fab0b294640 1 --2- 172.21.15.44:0/3680370138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab0415daa0 0x7fab04157c20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faaf4036040 tx=0x7faaf4004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.609+0000 7fab0b294640 1 -- 172.21.15.44:0/3680370138 shutdown_connections 2023-11-04T01:36:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.609+0000 7fab0b294640 1 --2- 172.21.15.44:0/3680370138 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faaf006ae70 0x7faaf006d330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.609+0000 7fab0b294640 1 --2- 172.21.15.44:0/3680370138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab0415daa0 0x7fab04157c20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.609+0000 7fab0b294640 1 --2- 172.21.15.44:0/3680370138 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab040ce240 0x7fab040ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.609+0000 7fab0b294640 1 --2- 172.21.15.44:0/3680370138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab040cde60 0x7fab041542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.609+0000 7fab0b294640 1 -- 172.21.15.44:0/3680370138 >> 172.21.15.44:0/3680370138 conn(0x7fab04071f30 msgr2=0x7fab040d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.609+0000 7fab0b294640 1 -- 172.21.15.44:0/3680370138 shutdown_connections 2023-11-04T01:36:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.609+0000 7fab0b294640 1 -- 172.21.15.44:0/3680370138 wait complete. 2023-11-04T01:36:05.625 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:05.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.728+0000 7f83a5064640 1 Processor -- start 2023-11-04T01:36:05.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.728+0000 7f83a5064640 1 -- start start 2023-11-04T01:36:05.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.729+0000 7f83a5064640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83a015ab70 0x7f83a00cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.729+0000 7f83a5064640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a006d310 con 0x7f83a006eba0 2023-11-04T01:36:05.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.729+0000 7f83a5064640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a015d860 con 0x7f83a006a830 2023-11-04T01:36:05.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.729+0000 7f83a5064640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00cba70 con 0x7f83a015ab70 2023-11-04T01:36:05.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.729+0000 7f8397fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f83a006eba0 0x7f83a006a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57696/0 (socket says 172.21.15.44:57696) 2023-11-04T01:36:05.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.729+0000 7f8397fff640 1 -- 172.21.15.44:0/4197605622 learned_addr learned my addr 172.21.15.44:0/4197605622 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:05.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.729+0000 7f839ed9d640 1 --2- 172.21.15.44:0/4197605622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83a015ab70 0x7f83a00cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.730+0000 7f839e59c640 1 -- 172.21.15.44:0/4197605622 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340505401 0 0) 0x7f83a006d310 con 0x7f83a006eba0 2023-11-04T01:36:05.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.730+0000 7f839e59c640 1 -- 172.21.15.44:0/4197605622 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f838c003520 con 0x7f83a006eba0 2023-11-04T01:36:05.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.730+0000 7f839e59c640 1 -- 172.21.15.44:0/4197605622 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280070209 0 0) 0x7f83a015d860 con 0x7f83a006a830 2023-11-04T01:36:05.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.730+0000 7f839e59c640 1 -- 172.21.15.44:0/4197605622 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a006d310 con 0x7f83a006a830 2023-11-04T01:36:05.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.730+0000 7f839ed9d640 1 -- 172.21.15.44:0/4197605622 >> v1:172.21.15.204:6789/0 conn(0x7f83a006a830 legacy=0x7f83a00ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.730+0000 7f839ed9d640 1 -- 172.21.15.44:0/4197605622 >> v1:172.21.15.44:6789/0 conn(0x7f83a006eba0 legacy=0x7f83a006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.730+0000 7f839ed9d640 1 -- 172.21.15.44:0/4197605622 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a015db40 con 0x7f83a015ab70 2023-11-04T01:36:05.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.731+0000 7f839ed9d640 1 --2- 172.21.15.44:0/4197605622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83a015ab70 0x7f83a00cbea0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f83900097c0 tx=0x7f839002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e46061b955e78cd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.731+0000 7f839e59c640 1 -- 172.21.15.44:0/4197605622 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390031800 con 0x7f83a015ab70 2023-11-04T01:36:05.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.731+0000 7f839e59c640 1 -- 172.21.15.44:0/4197605622 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8390031960 con 0x7f83a015ab70 2023-11-04T01:36:05.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.731+0000 7f839e59c640 1 -- 172.21.15.44:0/4197605622 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390031cd0 con 0x7f83a015ab70 2023-11-04T01:36:05.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.731+0000 7f83a5064640 1 -- 172.21.15.44:0/4197605622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83a015ab70 msgr2=0x7f83a00cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.731+0000 7f83a5064640 1 --2- 172.21.15.44:0/4197605622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83a015ab70 0x7f83a00cbea0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f83900097c0 tx=0x7f839002b8a0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.731+0000 7f83a5064640 1 -- 172.21.15.44:0/4197605622 shutdown_connections 2023-11-04T01:36:05.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.731+0000 7f83a5064640 1 --2- 172.21.15.44:0/4197605622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83a015ab70 0x7f83a00cbea0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.731+0000 7f83a5064640 1 -- 172.21.15.44:0/4197605622 >> 172.21.15.44:0/4197605622 conn(0x7f83a0098d40 msgr2=0x7f83a00cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:05.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.731+0000 7f83a5064640 1 -- 172.21.15.44:0/4197605622 shutdown_connections 2023-11-04T01:36:05.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.731+0000 7f83a5064640 1 -- 172.21.15.44:0/4197605622 wait complete. 2023-11-04T01:36:05.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.733+0000 7f83a5064640 1 Processor -- start 2023-11-04T01:36:05.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.733+0000 7f83a5064640 1 -- start start 2023-11-04T01:36:05.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.733+0000 7f83a5064640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83a006a830 0x7f83a015b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.733+0000 7f83a5064640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a006eba0 0x7f83a0099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.733+0000 7f83a5064640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83a015ab70 0x7f83a009b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.733+0000 7f83a5064640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a0161c50 con 0x7f83a006eba0 2023-11-04T01:36:05.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.733+0000 7f83a5064640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00c3e00 con 0x7f83a006a830 2023-11-04T01:36:05.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.733+0000 7f83a5064640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a0099f90 con 0x7f83a015ab70 2023-11-04T01:36:05.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f8397fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a006eba0 0x7f83a0099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f8397fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a006eba0 0x7f83a0099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50208/0 (socket says 172.21.15.44:50208) 2023-11-04T01:36:05.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f8397fff640 1 -- 172.21.15.44:0/3085013957 learned_addr learned my addr 172.21.15.44:0/3085013957 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:05.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f839ed9d640 1 --2- 172.21.15.44:0/3085013957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83a006a830 0x7f83a015b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f839f59e640 1 --2- 172.21.15.44:0/3085013957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83a015ab70 0x7f83a009b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f8397fff640 1 -- 172.21.15.44:0/3085013957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83a015ab70 msgr2=0x7f83a009b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f8397fff640 1 --2- 172.21.15.44:0/3085013957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83a015ab70 0x7f83a009b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f8397fff640 1 -- 172.21.15.44:0/3085013957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83a006a830 msgr2=0x7f83a015b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f8397fff640 1 --2- 172.21.15.44:0/3085013957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83a006a830 0x7f83a015b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f8397fff640 1 -- 172.21.15.44:0/3085013957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83900093a0 con 0x7f83a006eba0 2023-11-04T01:36:05.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f8397fff640 1 --2- 172.21.15.44:0/3085013957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a006eba0 0x7f83a0099a50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f838800c4d0 tx=0x7f838800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f83977fe640 1 -- 172.21.15.44:0/3085013957 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388005da0 con 0x7f83a006eba0 2023-11-04T01:36:05.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f83977fe640 1 -- 172.21.15.44:0/3085013957 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8388007070 con 0x7f83a006eba0 2023-11-04T01:36:05.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f83977fe640 1 -- 172.21.15.44:0/3085013957 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388007400 con 0x7f83a006eba0 2023-11-04T01:36:05.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f83a5064640 1 -- 172.21.15.44:0/3085013957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a015bf40 con 0x7f83a006eba0 2023-11-04T01:36:05.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.734+0000 7f83a5064640 1 -- 172.21.15.44:0/3085013957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a015c500 con 0x7f83a006eba0 2023-11-04T01:36:05.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.735+0000 7f83a5064640 1 -- 172.21.15.44:0/3085013957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a0074290 con 0x7f83a006eba0 2023-11-04T01:36:05.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.736+0000 7f83977fe640 1 -- 172.21.15.44:0/3085013957 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8388007560 con 0x7f83a006eba0 2023-11-04T01:36:05.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.736+0000 7f83977fe640 1 --2- 172.21.15.44:0/3085013957 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f838006aea0 0x7f838006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.736+0000 7f83977fe640 1 -- 172.21.15.44:0/3085013957 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8388089340 con 0x7f83a006eba0 2023-11-04T01:36:05.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.736+0000 7f839ed9d640 1 --2- 172.21.15.44:0/3085013957 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f838006aea0 0x7f838006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.737+0000 7f839ed9d640 1 --2- 172.21.15.44:0/3085013957 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f838006aea0 0x7f838006d360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8390036000 tx=0x7f839003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.740+0000 7f83977fe640 1 -- 172.21.15.44:0/3085013957 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f83880541a0 con 0x7f83a006eba0 2023-11-04T01:36:05.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.918+0000 7f83a5064640 1 -- 172.21.15.44:0/3085013957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83a006ae70 con 0x7f83a006eba0 2023-11-04T01:36:05.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.919+0000 7f83977fe640 1 -- 172.21.15.44:0/3085013957 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f83880577c0 con 0x7f83a006eba0 2023-11-04T01:36:05.922 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:05.922 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:03.589395+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:05.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.921+0000 7f83a5064640 1 -- 172.21.15.44:0/3085013957 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f838006aea0 msgr2=0x7f838006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.921+0000 7f83a5064640 1 --2- 172.21.15.44:0/3085013957 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f838006aea0 0x7f838006d360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8390036000 tx=0x7f839003c040 comp rx=0 tx=0).stop 2023-11-04T01:36:05.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.921+0000 7f83a5064640 1 -- 172.21.15.44:0/3085013957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a006eba0 msgr2=0x7f83a0099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.921+0000 7f83a5064640 1 --2- 172.21.15.44:0/3085013957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a006eba0 0x7f83a0099a50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f838800c4d0 tx=0x7f838800c990 comp rx=0 tx=0).stop 2023-11-04T01:36:05.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.921+0000 7f83a5064640 1 -- 172.21.15.44:0/3085013957 shutdown_connections 2023-11-04T01:36:05.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.921+0000 7f83a5064640 1 --2- 172.21.15.44:0/3085013957 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f838006aea0 0x7f838006d360 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.921+0000 7f83a5064640 1 --2- 172.21.15.44:0/3085013957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83a015ab70 0x7f83a009b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.921+0000 7f83a5064640 1 --2- 172.21.15.44:0/3085013957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a006eba0 0x7f83a0099a50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.921+0000 7f83a5064640 1 --2- 172.21.15.44:0/3085013957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83a006a830 0x7f83a015b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.922+0000 7f83a5064640 1 -- 172.21.15.44:0/3085013957 >> 172.21.15.44:0/3085013957 conn(0x7f83a0098d40 msgr2=0x7f83a015f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:05.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.922+0000 7f83a5064640 1 -- 172.21.15.44:0/3085013957 shutdown_connections 2023-11-04T01:36:05.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:05.922+0000 7f83a5064640 1 -- 172.21.15.44:0/3085013957 wait complete. 2023-11-04T01:36:06.337 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:35:58.556492+0000', 'modified': '2023-11-04T01:36:03.589555+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/240936603', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 240936603}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 240936603}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-04T01:36:06.338 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:36:06.338 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:36:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.445+0000 7f0ca4f89640 1 Processor -- start 2023-11-04T01:36:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.445+0000 7f0ca4f89640 1 -- start start 2023-11-04T01:36:06.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.446+0000 7f0ca4f89640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0ca00cd6d0 0x7f0ca0161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.446+0000 7f0ca4f89640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0ca00b4880 0x7f0ca00b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.446+0000 7f0ca4f89640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca00cde60 con 0x7f0ca0153e60 2023-11-04T01:36:06.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.446+0000 7f0ca4f89640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca0160f90 con 0x7f0ca00b4880 2023-11-04T01:36:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.446+0000 7f0ca4f89640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca0161960 con 0x7f0ca00cd6d0 2023-11-04T01:36:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.446+0000 7f0c9ed9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0ca00b4880 0x7f0ca00b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.446+0000 7f0c9e59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0ca0153e60 0x7f0ca015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57708/0 (socket says 172.21.15.44:57708) 2023-11-04T01:36:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.446+0000 7f0c9ed9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0ca00b4880 0x7f0ca00b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50210/0 (socket says 172.21.15.44:50210) 2023-11-04T01:36:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.446+0000 7f0c9e59c640 1 -- 172.21.15.44:0/3203698489 learned_addr learned my addr 172.21.15.44:0/3203698489 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.446+0000 7f0c9dd9b640 1 --2- 172.21.15.44:0/3203698489 >> v2:172.21.15.204:3300/0 conn(0x7f0ca00cd6d0 0x7f0ca0161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.447+0000 7f0c9ed9d640 1 -- 172.21.15.44:0/3203698489 >> v2:172.21.15.204:3300/0 conn(0x7f0ca00cd6d0 msgr2=0x7f0ca0161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.447+0000 7f0c9ed9d640 1 --2- 172.21.15.44:0/3203698489 >> v2:172.21.15.204:3300/0 conn(0x7f0ca00cd6d0 0x7f0ca0161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.447+0000 7f0c9ed9d640 1 -- 172.21.15.44:0/3203698489 >> v1:172.21.15.44:6789/0 conn(0x7f0ca0153e60 legacy=0x7f0ca015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.447+0000 7f0c9ed9d640 1 -- 172.21.15.44:0/3203698489 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca00b5220 con 0x7f0ca00b4880 2023-11-04T01:36:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.447+0000 7f0c9ed9d640 1 --2- 172.21.15.44:0/3203698489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca00b4880 0x7f0ca00b4ce0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00c9e80 tx=0x7f0c9002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425570006503aaa3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.447+0000 7f0c9d59a640 1 -- 172.21.15.44:0/3203698489 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9002cc80 con 0x7f0ca00b4880 2023-11-04T01:36:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.448+0000 7f0c9d59a640 1 -- 172.21.15.44:0/3203698489 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9002cde0 con 0x7f0ca00b4880 2023-11-04T01:36:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.448+0000 7f0c9d59a640 1 -- 172.21.15.44:0/3203698489 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c90034660 con 0x7f0ca00b4880 2023-11-04T01:36:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.448+0000 7f0ca4f89640 1 -- 172.21.15.44:0/3203698489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca00b4880 msgr2=0x7f0ca00b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.448+0000 7f0ca4f89640 1 --2- 172.21.15.44:0/3203698489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca00b4880 0x7f0ca00b4ce0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00c9e80 tx=0x7f0c9002bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.448+0000 7f0ca4f89640 1 -- 172.21.15.44:0/3203698489 shutdown_connections 2023-11-04T01:36:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.448+0000 7f0ca4f89640 1 --2- 172.21.15.44:0/3203698489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca00b4880 0x7f0ca00b4ce0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.448+0000 7f0ca4f89640 1 --2- 172.21.15.44:0/3203698489 >> v2:172.21.15.204:3300/0 conn(0x7f0ca00cd6d0 0x7f0ca0161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.448+0000 7f0ca4f89640 1 -- 172.21.15.44:0/3203698489 >> 172.21.15.44:0/3203698489 conn(0x7f0ca00cf880 msgr2=0x7f0ca00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.448+0000 7f0ca4f89640 1 -- 172.21.15.44:0/3203698489 shutdown_connections 2023-11-04T01:36:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.448+0000 7f0ca4f89640 1 -- 172.21.15.44:0/3203698489 wait complete. 2023-11-04T01:36:06.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.449+0000 7f0ca4f89640 1 Processor -- start 2023-11-04T01:36:06.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.449+0000 7f0ca4f89640 1 -- start start 2023-11-04T01:36:06.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.450+0000 7f0ca4f89640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ca00b4880 0x7f0ca0152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.450+0000 7f0ca4f89640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca00cd6d0 0x7f0ca01f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.450+0000 7f0ca4f89640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ca0153e60 0x7f0ca01f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.450+0000 7f0ca4f89640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00cb0a0 con 0x7f0ca00cd6d0 2023-11-04T01:36:06.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.450+0000 7f0ca4f89640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00ca490 con 0x7f0ca0153e60 2023-11-04T01:36:06.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.450+0000 7f0ca4f89640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00ca770 con 0x7f0ca00b4880 2023-11-04T01:36:06.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.450+0000 7f0c9dd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca00cd6d0 0x7f0ca01f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.450+0000 7f0c9dd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca00cd6d0 0x7f0ca01f5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50218/0 (socket says 172.21.15.44:50218) 2023-11-04T01:36:06.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.450+0000 7f0c9dd9b640 1 -- 172.21.15.44:0/3714653107 learned_addr learned my addr 172.21.15.44:0/3714653107 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:06.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.450+0000 7f0c9ed9d640 1 --2- 172.21.15.44:0/3714653107 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ca0153e60 0x7f0ca01f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.450+0000 7f0c9e59c640 1 --2- 172.21.15.44:0/3714653107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ca00b4880 0x7f0ca0152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.451+0000 7f0c9dd9b640 1 -- 172.21.15.44:0/3714653107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ca00b4880 msgr2=0x7f0ca0152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.451+0000 7f0c9dd9b640 1 --2- 172.21.15.44:0/3714653107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ca00b4880 0x7f0ca0152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.451+0000 7f0c9dd9b640 1 -- 172.21.15.44:0/3714653107 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ca0153e60 msgr2=0x7f0ca01f5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.451+0000 7f0c9dd9b640 1 --2- 172.21.15.44:0/3714653107 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ca0153e60 0x7f0ca01f5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.451+0000 7f0c9dd9b640 1 -- 172.21.15.44:0/3714653107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c90009a70 con 0x7f0ca00cd6d0 2023-11-04T01:36:06.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.451+0000 7f0c9dd9b640 1 --2- 172.21.15.44:0/3714653107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca00cd6d0 0x7f0ca01f5920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800d800 tx=0x7f0c8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.451+0000 7f0c96ffd640 1 -- 172.21.15.44:0/3714653107 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8800b6c0 con 0x7f0ca00cd6d0 2023-11-04T01:36:06.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.451+0000 7f0c96ffd640 1 -- 172.21.15.44:0/3714653107 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8800b820 con 0x7f0ca00cd6d0 2023-11-04T01:36:06.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.451+0000 7f0ca4f89640 1 -- 172.21.15.44:0/3714653107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca00caa50 con 0x7f0ca00cd6d0 2023-11-04T01:36:06.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.451+0000 7f0c96ffd640 1 -- 172.21.15.44:0/3714653107 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8800bbb0 con 0x7f0ca00cd6d0 2023-11-04T01:36:06.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.451+0000 7f0ca4f89640 1 -- 172.21.15.44:0/3714653107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca00cb530 con 0x7f0ca00cd6d0 2023-11-04T01:36:06.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.452+0000 7f0c96ffd640 1 -- 172.21.15.44:0/3714653107 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c8800bd10 con 0x7f0ca00cd6d0 2023-11-04T01:36:06.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.453+0000 7f0c96ffd640 1 --2- 172.21.15.44:0/3714653107 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0c8006aea0 0x7f0c8006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.453+0000 7f0c96ffd640 1 -- 172.21.15.44:0/3714653107 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0c88089c30 con 0x7f0ca00cd6d0 2023-11-04T01:36:06.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.453+0000 7f0c9e59c640 1 --2- 172.21.15.44:0/3714653107 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0c8006aea0 0x7f0c8006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.454+0000 7f0c9e59c640 1 --2- 172.21.15.44:0/3714653107 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0c8006aea0 0x7f0c8006d360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c98005880 tx=0x7f0c98009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.454+0000 7f0ca7bf8740 1 Processor -- start 2023-11-04T01:36:06.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.454+0000 7f0ca7bf8740 1 -- start start 2023-11-04T01:36:06.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0ca7bf8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44f98a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0ca7bf8740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 0x55a44f9ba5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0ca7bf8740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f98ac90 0x55a44f9bab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0ca7bf8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a44f89b740 con 0x55a44f9b7850 2023-11-04T01:36:06.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0ca7bf8740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a44f8fd8d0 con 0x55a44f9b7c30 2023-11-04T01:36:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0ca7bf8740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a44f8fafc0 con 0x55a44f98ac90 2023-11-04T01:36:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0c9e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44f98a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0c9e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44f98a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50228/0 (socket says 172.21.15.44:50228) 2023-11-04T01:36:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0c9e59c640 1 -- 172.21.15.44:0/3625211764 learned_addr learned my addr 172.21.15.44:0/3625211764 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0c9dd9b640 1 --2- 172.21.15.44:0/3625211764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 0x55a44f9ba5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0c9ed9d640 1 --2- 172.21.15.44:0/3625211764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f98ac90 0x55a44f9bab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0c9e59c640 1 -- 172.21.15.44:0/3625211764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f98ac90 msgr2=0x55a44f9bab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0c9e59c640 1 --2- 172.21.15.44:0/3625211764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f98ac90 0x55a44f9bab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0c9e59c640 1 -- 172.21.15.44:0/3625211764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 msgr2=0x55a44f9ba5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0c9e59c640 1 --2- 172.21.15.44:0/3625211764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 0x55a44f9ba5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0c9e59c640 1 -- 172.21.15.44:0/3625211764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a44f8b9ca0 con 0x55a44f9b7850 2023-11-04T01:36:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0c9e59c640 1 --2- 172.21.15.44:0/3625211764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44f98a750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800f880 tx=0x7f0c98012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fb33d11224b9d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0c7ffff640 1 -- 172.21.15.44:0/3625211764 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c980149d0 con 0x55a44f9b7850 2023-11-04T01:36:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0c7ffff640 1 -- 172.21.15.44:0/3625211764 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c98014b30 con 0x55a44f9b7850 2023-11-04T01:36:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.455+0000 7f0c7ffff640 1 -- 172.21.15.44:0/3625211764 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98014ea0 con 0x55a44f9b7850 2023-11-04T01:36:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.456+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3625211764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 msgr2=0x55a44f98a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.456+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/3625211764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44f98a750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800f880 tx=0x7f0c98012000 comp rx=0 tx=0).stop 2023-11-04T01:36:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.456+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3625211764 shutdown_connections 2023-11-04T01:36:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.456+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/3625211764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f98ac90 0x55a44f9bab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.456+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/3625211764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 0x55a44f9ba5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.456+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/3625211764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44f98a750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.456+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3625211764 >> 172.21.15.44:0/3625211764 conn(0x55a44f98ca60 msgr2=0x55a44f9d55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.456+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3625211764 shutdown_connections 2023-11-04T01:36:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.456+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3625211764 wait complete. 2023-11-04T01:36:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.457+0000 7f0ca7bf8740 1 -- start start 2023-11-04T01:36:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.457+0000 7f0ca7bf8740 1 Processor -- start 2023-11-04T01:36:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0ca7bf8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44f9d5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0ca7bf8740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f9b7c30 0x55a44f9d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0ca7bf8740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9bd030 0x55a44f9d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0ca7bf8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a44f8f68b0 con 0x55a44f9b7850 2023-11-04T01:36:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0ca7bf8740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a44f8b0c80 con 0x55a44f9bd030 2023-11-04T01:36:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0ca7bf8740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a44f8b0920 con 0x55a44f9b7c30 2023-11-04T01:36:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0c9e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44f9d5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0ca7bf8740 10 client.0 _ll_register_callbacks cb 0x55a44f608ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:36:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0c9e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44f9d5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50234/0 (socket says 172.21.15.44:50234) 2023-11-04T01:36:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0c9e59c640 1 -- 172.21.15.44:0/1922386331 learned_addr learned my addr 172.21.15.44:0/1922386331 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0c9dd9b640 1 --2- 172.21.15.44:0/1922386331 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f9b7c30 0x55a44f9d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0c9ed9d640 1 --2- 172.21.15.44:0/1922386331 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9bd030 0x55a44f9d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0c9e59c640 1 -- 172.21.15.44:0/1922386331 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f9b7c30 msgr2=0x55a44f9d2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0c9e59c640 1 --2- 172.21.15.44:0/1922386331 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f9b7c30 0x55a44f9d2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0c9e59c640 1 -- 172.21.15.44:0/1922386331 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9bd030 msgr2=0x55a44f9d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0c9e59c640 1 --2- 172.21.15.44:0/1922386331 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9bd030 0x55a44f9d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0c9e59c640 1 -- 172.21.15.44:0/1922386331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca00cde60 con 0x55a44f9b7850 2023-11-04T01:36:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0c9e59c640 1 --2- 172.21.15.44:0/1922386331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44f9d5910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0c98001eb0 tx=0x7f0c980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e541dbfcf8c4773 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0c7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:36:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0c7d7fa640 1 -- 172.21.15.44:0/1922386331 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c980149d0 con 0x55a44f9b7850 2023-11-04T01:36:06.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0c7d7fa640 1 -- 172.21.15.44:0/1922386331 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0c9801c040 con 0x55a44f9b7850 2023-11-04T01:36:06.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.458+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/1922386331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a44f8a2bf0 con 0x55a44f9b7850 2023-11-04T01:36:06.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.459+0000 7f0c7d7fa640 1 -- 172.21.15.44:0/1922386331 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c98020c50 con 0x55a44f9b7850 2023-11-04T01:36:06.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.459+0000 7f0ca7bf8740 10 client.4434 fetch_fsmap learned FSMap version 7 2023-11-04T01:36:06.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.459+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/1922386331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a44f8f4f30 con 0x55a44f9b7850 2023-11-04T01:36:06.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.459+0000 7f0c7d7fa640 1 -- 172.21.15.44:0/1922386331 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a44f8a2bf0 con 0x55a44f9b7850 2023-11-04T01:36:06.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.459+0000 7f0c7d7fa640 1 -- 172.21.15.44:0/1922386331 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f0c98012070 con 0x55a44f9b7850 2023-11-04T01:36:06.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.459+0000 7f0ca7bf8740 10 client.4434 fetch_fsmap finished waiting for FSMap version 7 2023-11-04T01:36:06.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.459+0000 7f0ca7bf8740 10 client.4434 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:36:06.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.459+0000 7f0ca7bf8740 20 client.4434 populate_metadata read hostname 'smithi044' 2023-11-04T01:36:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.459+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/1922386331 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x55a44f9f10f0 0x55a44f9f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.459+0000 7f0ca7bf8740 4 client.4434 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:36:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.459+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/1922386331 --> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a44f8ef890 con 0x55a44f9f10f0 2023-11-04T01:36:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.459+0000 7f0c9dd9b640 1 --2- 172.21.15.44:0/1922386331 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x55a44f9f10f0 0x55a44f9f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.459+0000 7f0c7d7fa640 10 client.4434 ms_handle_connect on v2:172.21.15.44:6834/240936603 2023-11-04T01:36:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.459+0000 7f0c9dd9b640 1 --2- 172.21.15.44:0/1922386331 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x55a44f9f10f0 0x55a44f9f34e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8ba08d898512959 server_cookie=92731cf33d19de0 in_seq=0 out_seq=0 2023-11-04T01:36:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.460+0000 7f0c7d7fa640 1 -- 172.21.15.44:0/1922386331 <== mds.0 v2:172.21.15.44:6834/240936603 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a44f8ef890 con 0x55a44f9f10f0 2023-11-04T01:36:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.460+0000 7f0c7d7fa640 10 client.4434 handle_command_reply: tid=0 2023-11-04T01:36:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.460+0000 7f0ca7bf8740 1 client.4434 shutdown 2023-11-04T01:36:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.460+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/1922386331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 msgr2=0x55a44f9d5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.460+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/1922386331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44f9d5910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0c98001eb0 tx=0x7f0c980057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.460+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/1922386331 shutdown_connections 2023-11-04T01:36:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.460+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/1922386331 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x55a44f9f10f0 0x55a44f9f34e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.460+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/1922386331 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9bd030 0x55a44f9d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.460+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/1922386331 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f9b7c30 0x55a44f9d2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.460+0000 7f0c7d7fa640 0 client.4434 ms_handle_reset on v2:172.21.15.44:6834/240936603 2023-11-04T01:36:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.460+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/1922386331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44f9d5910 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.460+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/1922386331 >> 172.21.15.44:0/1922386331 conn(0x55a44f98ac90 msgr2=0x55a44f98e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.460+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/1922386331 shutdown_connections 2023-11-04T01:36:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.460+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/1922386331 wait complete. 2023-11-04T01:36:06.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.460+0000 7f0ca7bf8740 20 client.4434 trim_cache size 0 max 16384 2023-11-04T01:36:06.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.476+0000 7f0ca7bf8740 1 Processor -- start 2023-11-04T01:36:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.476+0000 7f0ca7bf8740 1 -- start start 2023-11-04T01:36:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0ca7bf8740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f9b7850 0x55a44f9cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0ca7bf8740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 0x55a44fa37820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0ca7bf8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9bd030 0x55a44f98e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0ca7bf8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a44f876280 con 0x55a44f9bd030 2023-11-04T01:36:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0ca7bf8740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a44f9f8280 con 0x55a44f9b7c30 2023-11-04T01:36:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0ca7bf8740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a44f9f8070 con 0x55a44f9b7850 2023-11-04T01:36:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0c9ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9bd030 0x55a44f98e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0c9ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9bd030 0x55a44f98e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50246/0 (socket says 172.21.15.44:50246) 2023-11-04T01:36:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0c9ed9d640 1 -- 172.21.15.44:0/3188907701 learned_addr learned my addr 172.21.15.44:0/3188907701 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0c9dd9b640 1 --2- 172.21.15.44:0/3188907701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 0x55a44fa37820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0c9e59c640 1 --2- 172.21.15.44:0/3188907701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f9b7850 0x55a44f9cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0c9ed9d640 1 -- 172.21.15.44:0/3188907701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f9b7850 msgr2=0x55a44f9cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0c9ed9d640 1 --2- 172.21.15.44:0/3188907701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f9b7850 0x55a44f9cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0c9ed9d640 1 -- 172.21.15.44:0/3188907701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 msgr2=0x55a44fa37820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0c9ed9d640 1 --2- 172.21.15.44:0/3188907701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 0x55a44fa37820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0c9ed9d640 1 -- 172.21.15.44:0/3188907701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a44f892d10 con 0x55a44f9bd030 2023-11-04T01:36:06.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0c9dd9b640 1 --2- 172.21.15.44:0/3188907701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 0x55a44fa37820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:06.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0c9ed9d640 1 --2- 172.21.15.44:0/3188907701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9bd030 0x55a44f98e350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009e80 tx=0x7f0c9002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f296fbe764fc25 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0c94ff9640 1 -- 172.21.15.44:0/3188907701 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c90045070 con 0x55a44f9bd030 2023-11-04T01:36:06.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0c94ff9640 1 -- 172.21.15.44:0/3188907701 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c90034580 con 0x55a44f9bd030 2023-11-04T01:36:06.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.477+0000 7f0c94ff9640 1 -- 172.21.15.44:0/3188907701 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c90034910 con 0x55a44f9bd030 2023-11-04T01:36:06.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.478+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3188907701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9bd030 msgr2=0x55a44f98e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.478+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/3188907701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9bd030 0x55a44f98e350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009e80 tx=0x7f0c9002e000 comp rx=0 tx=0).stop 2023-11-04T01:36:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.478+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3188907701 shutdown_connections 2023-11-04T01:36:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.478+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/3188907701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9bd030 0x55a44f98e350 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.478+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/3188907701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 0x55a44fa37820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.478+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/3188907701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f9b7850 0x55a44f9cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.478+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3188907701 >> 172.21.15.44:0/3188907701 conn(0x55a44f98ac90 msgr2=0x55a44f9d3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.478+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3188907701 shutdown_connections 2023-11-04T01:36:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.478+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3188907701 wait complete. 2023-11-04T01:36:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.478+0000 7f0ca7bf8740 1 -- start start 2023-11-04T01:36:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.479+0000 7f0ca7bf8740 1 Processor -- start 2023-11-04T01:36:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.479+0000 7f0ca7bf8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44fa20360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.479+0000 7f0ca7bf8740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 0x55a44fa22c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.479+0000 7f0ca7bf8740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f9bd030 0x55a44f98e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.479+0000 7f0ca7bf8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a44fa34fd0 con 0x55a44f9b7850 2023-11-04T01:36:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.479+0000 7f0ca7bf8740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a44fa23710 con 0x55a44f9b7c30 2023-11-04T01:36:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.479+0000 7f0ca7bf8740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a44f9d6ea0 con 0x55a44f9bd030 2023-11-04T01:36:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.479+0000 7f0ca7bf8740 10 client.0 _ll_register_callbacks cb 0x7f0c98017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:36:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c9e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44fa20360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c9e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44fa20360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50250/0 (socket says 172.21.15.44:50250) 2023-11-04T01:36:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c9e59c640 1 -- 172.21.15.44:0/3286182235 learned_addr learned my addr 172.21.15.44:0/3286182235 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c9dd9b640 1 --2- 172.21.15.44:0/3286182235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 0x55a44fa22c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c9ed9d640 1 --2- 172.21.15.44:0/3286182235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f9bd030 0x55a44f98e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c9e59c640 1 -- 172.21.15.44:0/3286182235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f9bd030 msgr2=0x55a44f98e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c9e59c640 1 --2- 172.21.15.44:0/3286182235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f9bd030 0x55a44f98e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c9e59c640 1 -- 172.21.15.44:0/3286182235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 msgr2=0x55a44fa22c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c9e59c640 1 --2- 172.21.15.44:0/3286182235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 0x55a44fa22c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c9e59c640 1 -- 172.21.15.44:0/3286182235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca00b5220 con 0x55a44f9b7850 2023-11-04T01:36:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c9e59c640 1 --2- 172.21.15.44:0/3286182235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44fa20360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0c98001550 tx=0x7f0c9800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4deba4c61ba1865 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:36:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c7d7fa640 1 -- 172.21.15.44:0/3286182235 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98033710 con 0x55a44f9b7850 2023-11-04T01:36:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c7d7fa640 1 -- 172.21.15.44:0/3286182235 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0c9803dd90 con 0x55a44f9b7850 2023-11-04T01:36:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3286182235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c98014b30 con 0x55a44f9b7850 2023-11-04T01:36:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c7d7fa640 1 -- 172.21.15.44:0/3286182235 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c98033870 con 0x55a44f9b7850 2023-11-04T01:36:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0ca7bf8740 10 client.4440 fetch_fsmap learned FSMap version 7 2023-11-04T01:36:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3286182235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a44f8b8500 con 0x55a44f9b7850 2023-11-04T01:36:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.480+0000 7f0c7d7fa640 1 -- 172.21.15.44:0/3286182235 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c98014b30 con 0x55a44f9b7850 2023-11-04T01:36:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0c7d7fa640 1 -- 172.21.15.44:0/3286182235 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f0c98012070 con 0x55a44f9b7850 2023-11-04T01:36:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 10 client.4440 fetch_fsmap finished waiting for FSMap version 7 2023-11-04T01:36:06.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 10 client.4440 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:36:06.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 20 client.4440 populate_metadata read hostname 'smithi044' 2023-11-04T01:36:06.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/3286182235 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x55a44fa341f0 0x55a44fa345d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 4 client.4440 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:36:06.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3286182235 --> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a44f8ef5b0 con 0x55a44fa341f0 2023-11-04T01:36:06.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0c9dd9b640 1 --2- 172.21.15.44:0/3286182235 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x55a44fa341f0 0x55a44fa345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0c7d7fa640 10 client.4440 ms_handle_connect on v2:172.21.15.44:6834/240936603 2023-11-04T01:36:06.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0c9dd9b640 1 --2- 172.21.15.44:0/3286182235 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x55a44fa341f0 0x55a44fa345d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39d0a33f79d96d75 server_cookie=89efaaa003998b48 in_seq=0 out_seq=0 2023-11-04T01:36:06.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0c7d7fa640 1 -- 172.21.15.44:0/3286182235 <== mds.0 v2:172.21.15.44:6834/240936603 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55a44f8ef5b0 con 0x55a44fa341f0 2023-11-04T01:36:06.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0c7d7fa640 10 client.4440 handle_command_reply: tid=0 2023-11-04T01:36:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 1 client.4440 shutdown 2023-11-04T01:36:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3286182235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 msgr2=0x55a44fa20360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/3286182235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44fa20360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0c98001550 tx=0x7f0c9800a000 comp rx=0 tx=0).stop 2023-11-04T01:36:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3286182235 shutdown_connections 2023-11-04T01:36:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/3286182235 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x55a44fa341f0 0x55a44fa345d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/3286182235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a44f9bd030 0x55a44f98e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/3286182235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a44f9b7c30 0x55a44fa22c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 1 --2- 172.21.15.44:0/3286182235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a44f9b7850 0x55a44fa20360 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0c7d7fa640 0 client.4440 ms_handle_reset on v2:172.21.15.44:6834/240936603 2023-11-04T01:36:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3286182235 >> 172.21.15.44:0/3286182235 conn(0x55a44f98ac90 msgr2=0x55a44f9bc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3286182235 shutdown_connections 2023-11-04T01:36:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.481+0000 7f0ca7bf8740 1 -- 172.21.15.44:0/3286182235 wait complete. 2023-11-04T01:36:06.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.482+0000 7f0ca7bf8740 20 client.4440 trim_cache size 0 max 16384 2023-11-04T01:36:06.565 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:36:06.565 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:36:06.565 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2023-11-04T01:36:06.565 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4290, 2023-11-04T01:36:06.565 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:36:06.565 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:36:06.565 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:36:06.565 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 7.2941298259999998, 2023-11-04T01:36:06.566 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 7, 2023-11-04T01:36:06.566 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 24, 2023-11-04T01:36:06.566 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 24, 2023-11-04T01:36:06.566 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 14.235785503000001 2023-11-04T01:36:06.566 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:36:06.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.482+0000 7f0ca4f89640 1 -- 172.21.15.44:0/3714653107 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0c8006aea0 msgr2=0x7f0c8006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.482+0000 7f0ca4f89640 1 --2- 172.21.15.44:0/3714653107 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0c8006aea0 0x7f0c8006d360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c98005880 tx=0x7f0c98009040 comp rx=0 tx=0).stop 2023-11-04T01:36:06.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.482+0000 7f0ca4f89640 1 -- 172.21.15.44:0/3714653107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca00cd6d0 msgr2=0x7f0ca01f5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.482+0000 7f0ca4f89640 1 --2- 172.21.15.44:0/3714653107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca00cd6d0 0x7f0ca01f5920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800d800 tx=0x7f0c8800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.482+0000 7f0ca4f89640 1 -- 172.21.15.44:0/3714653107 shutdown_connections 2023-11-04T01:36:06.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.482+0000 7f0ca4f89640 1 --2- 172.21.15.44:0/3714653107 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0c8006aea0 0x7f0c8006d360 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.482+0000 7f0ca4f89640 1 --2- 172.21.15.44:0/3714653107 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ca0153e60 0x7f0ca01f5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.482+0000 7f0ca4f89640 1 --2- 172.21.15.44:0/3714653107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca00cd6d0 0x7f0ca01f5920 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.482+0000 7f0ca4f89640 1 --2- 172.21.15.44:0/3714653107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ca00b4880 0x7f0ca0152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.482+0000 7f0ca4f89640 1 -- 172.21.15.44:0/3714653107 >> 172.21.15.44:0/3714653107 conn(0x7f0ca00cf880 msgr2=0x7f0ca015c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.482+0000 7f0ca4f89640 1 -- 172.21.15.44:0/3714653107 shutdown_connections 2023-11-04T01:36:06.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.482+0000 7f0ca4f89640 1 -- 172.21.15.44:0/3714653107 wait complete. 2023-11-04T01:36:06.568 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:36:06.568 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:06.569 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:36:06.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.692+0000 7f5ceba21640 1 Processor -- start 2023-11-04T01:36:06.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.692+0000 7f5ceba21640 1 -- start start 2023-11-04T01:36:06.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.692+0000 7f5ceba21640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5ce40cf870 0x7f5ce4160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.693+0000 7f5ceba21640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce406bf00 con 0x7f5ce415ce60 2023-11-04T01:36:06.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.693+0000 7f5ceba21640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce41615d0 con 0x7f5ce4160b10 2023-11-04T01:36:06.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.693+0000 7f5ceba21640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce40cbde0 con 0x7f5ce40cf870 2023-11-04T01:36:06.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.693+0000 7f5ce9fbe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5ce40cf870 0x7f5ce4160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.693+0000 7f5ce97bd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5ce415ce60 0x7f5ce406b7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57720/0 (socket says 172.21.15.44:57720) 2023-11-04T01:36:06.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.693+0000 7f5ce97bd640 1 -- 172.21.15.44:0/435766810 learned_addr learned my addr 172.21.15.44:0/435766810 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:06.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.693+0000 7f5ce9fbe640 1 -- 172.21.15.44:0/435766810 >> v1:172.21.15.204:6789/0 conn(0x7f5ce4160b10 legacy=0x7f5ce40cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.693+0000 7f5ce9fbe640 1 -- 172.21.15.44:0/435766810 >> v1:172.21.15.44:6789/0 conn(0x7f5ce415ce60 legacy=0x7f5ce406b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.693+0000 7f5ce3fff640 1 -- 172.21.15.44:0/435766810 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676776225 0 0) 0x7f5ce406bf00 con 0x7f5ce415ce60 2023-11-04T01:36:06.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.693+0000 7f5ce9fbe640 1 -- 172.21.15.44:0/435766810 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce41618b0 con 0x7f5ce40cf870 2023-11-04T01:36:06.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.694+0000 7f5ce9fbe640 1 --2- 172.21.15.44:0/435766810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ce40cf870 0x7f5ce4160f90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009d90 tx=0x7f5cd402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa8f8b19e1b5b95 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.694+0000 7f5ce3fff640 1 -- 172.21.15.44:0/435766810 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd402cc60 con 0x7f5ce40cf870 2023-11-04T01:36:06.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.694+0000 7f5ce3fff640 1 -- 172.21.15.44:0/435766810 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd402cdc0 con 0x7f5ce40cf870 2023-11-04T01:36:06.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.694+0000 7f5ce3fff640 1 -- 172.21.15.44:0/435766810 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4034660 con 0x7f5ce40cf870 2023-11-04T01:36:06.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.694+0000 7f5ceba21640 1 -- 172.21.15.44:0/435766810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ce40cf870 msgr2=0x7f5ce4160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.694+0000 7f5ceba21640 1 --2- 172.21.15.44:0/435766810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ce40cf870 0x7f5ce4160f90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009d90 tx=0x7f5cd402beb0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.694+0000 7f5ceba21640 1 -- 172.21.15.44:0/435766810 shutdown_connections 2023-11-04T01:36:06.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.694+0000 7f5ceba21640 1 --2- 172.21.15.44:0/435766810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ce40cf870 0x7f5ce4160f90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.694+0000 7f5ceba21640 1 -- 172.21.15.44:0/435766810 >> 172.21.15.44:0/435766810 conn(0x7f5ce406ea90 msgr2=0x7f5ce406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.695+0000 7f5ceba21640 1 -- 172.21.15.44:0/435766810 shutdown_connections 2023-11-04T01:36:06.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.695+0000 7f5ceba21640 1 -- 172.21.15.44:0/435766810 wait complete. 2023-11-04T01:36:06.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.696+0000 7f5ceba21640 1 Processor -- start 2023-11-04T01:36:06.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.696+0000 7f5ceba21640 1 -- start start 2023-11-04T01:36:06.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.696+0000 7f5ceba21640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ce40cf870 0x7f5ce40b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.696+0000 7f5ceba21640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ce415ce60 0x7f5ce4159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.696+0000 7f5ceba21640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ce4160b10 0x7f5ce40d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.696+0000 7f5ceba21640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce415e3c0 con 0x7f5ce40cf870 2023-11-04T01:36:06.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.696+0000 7f5ceba21640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce415e5d0 con 0x7f5ce4160b10 2023-11-04T01:36:06.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.696+0000 7f5ceba21640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce415e8b0 con 0x7f5ce415ce60 2023-11-04T01:36:06.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.696+0000 7f5ce97bd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ce40cf870 0x7f5ce40b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ce97bd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ce40cf870 0x7f5ce40b61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50264/0 (socket says 172.21.15.44:50264) 2023-11-04T01:36:06.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ce97bd640 1 -- 172.21.15.44:0/3703783313 learned_addr learned my addr 172.21.15.44:0/3703783313 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:06.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ce9fbe640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ce4160b10 0x7f5ce40d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ce8fbc640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ce415ce60 0x7f5ce4159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ce97bd640 1 -- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ce415ce60 msgr2=0x7f5ce4159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ce97bd640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ce415ce60 0x7f5ce4159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ce97bd640 1 -- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ce4160b10 msgr2=0x7f5ce40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ce97bd640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ce4160b10 0x7f5ce40d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ce97bd640 1 -- 172.21.15.44:0/3703783313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd4009a70 con 0x7f5ce40cf870 2023-11-04T01:36:06.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ce9fbe640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ce4160b10 0x7f5ce40d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:06.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ce8fbc640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ce415ce60 0x7f5ce4159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:06.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ce97bd640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ce40cf870 0x7f5ce40b61f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c430 tx=0x7f5cdc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ce1ffb640 1 -- 172.21.15.44:0/3703783313 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0074e0 con 0x7f5ce40cf870 2023-11-04T01:36:06.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ce1ffb640 1 -- 172.21.15.44:0/3703783313 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc007660 con 0x7f5ce40cf870 2023-11-04T01:36:06.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ceba21640 1 -- 172.21.15.44:0/3703783313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce415eb90 con 0x7f5ce40cf870 2023-11-04T01:36:06.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ce1ffb640 1 -- 172.21.15.44:0/3703783313 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc004a20 con 0x7f5ce40cf870 2023-11-04T01:36:06.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.697+0000 7f5ceba21640 1 -- 172.21.15.44:0/3703783313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce40b6730 con 0x7f5ce40cf870 2023-11-04T01:36:06.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.698+0000 7f5ceba21640 1 -- 172.21.15.44:0/3703783313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce4074290 con 0x7f5ce40cf870 2023-11-04T01:36:06.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.698+0000 7f5ce1ffb640 1 -- 172.21.15.44:0/3703783313 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5cdc004b80 con 0x7f5ce40cf870 2023-11-04T01:36:06.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.699+0000 7f5ce1ffb640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5cd006ae70 0x7f5cd006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.699+0000 7f5ce1ffb640 1 -- 172.21.15.44:0/3703783313 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5cdc089730 con 0x7f5ce40cf870 2023-11-04T01:36:06.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.699+0000 7f5ce8fbc640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5cd006ae70 0x7f5cd006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.700+0000 7f5ce8fbc640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5cd006ae70 0x7f5cd006d330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40d1cc0 tx=0x7f5cd8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.703+0000 7f5ce1ffb640 1 -- 172.21.15.44:0/3703783313 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5cdc0544f0 con 0x7f5ce40cf870 2023-11-04T01:36:06.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.916+0000 7f5ceba21640 1 -- 172.21.15.44:0/3703783313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5ce406b3e0 con 0x7f5ce40cf870 2023-11-04T01:36:06.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.917+0000 7f5ce1ffb640 1 -- 172.21.15.44:0/3703783313 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5cdc057b10 con 0x7f5ce40cf870 2023-11-04T01:36:06.919 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:36:06.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.919+0000 7f5ceba21640 1 -- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5cd006ae70 msgr2=0x7f5cd006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.919+0000 7f5ceba21640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5cd006ae70 0x7f5cd006d330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40d1cc0 tx=0x7f5cd8008040 comp rx=0 tx=0).stop 2023-11-04T01:36:06.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.919+0000 7f5ceba21640 1 -- 172.21.15.44:0/3703783313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ce40cf870 msgr2=0x7f5ce40b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.919+0000 7f5ceba21640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ce40cf870 0x7f5ce40b61f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c430 tx=0x7f5cdc00c8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.919+0000 7f5ceba21640 1 -- 172.21.15.44:0/3703783313 shutdown_connections 2023-11-04T01:36:06.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.919+0000 7f5ceba21640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5cd006ae70 0x7f5cd006d330 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.919+0000 7f5ceba21640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ce4160b10 0x7f5ce40d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.919+0000 7f5ceba21640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ce415ce60 0x7f5ce4159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.919+0000 7f5ceba21640 1 --2- 172.21.15.44:0/3703783313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ce40cf870 0x7f5ce40b61f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.919+0000 7f5ceba21640 1 -- 172.21.15.44:0/3703783313 >> 172.21.15.44:0/3703783313 conn(0x7f5ce406ea90 msgr2=0x7f5ce40cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.919+0000 7f5ceba21640 1 -- 172.21.15.44:0/3703783313 shutdown_connections 2023-11-04T01:36:06.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:06.919+0000 7f5ceba21640 1 -- 172.21.15.44:0/3703783313 wait complete. 2023-11-04T01:36:06.931 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-04T01:36:06.931 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:36:06.932 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2023-11-04T01:36:06.932 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-04T01:36:06.932 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:06.932 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-04T01:36:06.932 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:36:06.932 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:36:06.932 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-04T01:36:06.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:06.932 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2023-11-04T01:36:06.948 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:06.949 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2023-11-04T01:36:06.949 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2023-11-04T01:36:06.949 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:36:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2023-11-04T01:36:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-04T01:36:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42503sec preferred_lft 42503sec 2023-11-04T01:36:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2023-11-04T01:36:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:06.950 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2023-11-04T01:36:06.951 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:36:06.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:06.951 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:36:06.951 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:36:06.952 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:36:06.952 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr flush dev ceph-brx 2023-11-04T01:36:06.952 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set ceph-brx up 2023-11-04T01:36:06.952 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:36:06.952 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:36:07.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:07.137 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:36:07.170 INFO:teuthology.orchestra.run.smithi044.stdout:1 2023-11-04T01:36:07.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:07.171 DEBUG:teuthology.orchestra.run.smithi044:> route 2023-11-04T01:36:07.235 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2023-11-04T01:36:07.235 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:36:07.235 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-04T01:36:07.236 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-04T01:36:07.236 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:36:07.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:07.236 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:36:07.236 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:36:07.236 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:36:07.236 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:36:07.236 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:36:07.237 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:36:07.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:07.505 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2023-11-04T01:36:07.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:07.524 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2023-11-04T01:36:07.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:07.580 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:36:07.580 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:36:07.581 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:07.581 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-04T01:36:07.581 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:36:07.672 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-04T01:36:07.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:07.673 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:36:07.673 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:36:07.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-04T01:36:07.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:36:07.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-04T01:36:07.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-04T01:36:07.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-04T01:36:07.674 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:36:07.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:07.790 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:36:07.790 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:36:07.790 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2023-11-04T01:36:07.790 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:36:07.791 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:36:07.840 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-04T01:36:07.840 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:07.841 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:07.858 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-04T01:36:07.858 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:07.858 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:07.913 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:07.969 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:36:07.969 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:36:07.969 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:36:07.969 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:36:07.969 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:36:07.969 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:36:07.969 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:36:07.969 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:36:07.970 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:36:07.970 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:36:07.970 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:36:07.970 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:36:07.970 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:07.970 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:36:07.970 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:36:07.970 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:36:07.970 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:36:07.970 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:07.970 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:36:07.970 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:07.971 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:07.971 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:07.971 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:07.971 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:36:07.971 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:36:07.971 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:07.971 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:07.971 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:07.971 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:07.971 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:36:07.971 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:07.971 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:07.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:07.972 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:36:08.027 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:36:08.027 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-11-04T01:36:08.070 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:08.089 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:36:08.089 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:36:08.090 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:36:08.090 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:36:08.090 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:36:08.090 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:36:08.090 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:36:08.090 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:36:08.090 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:36:08.090 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:36:08.090 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:36:08.090 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:36:08.090 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:08.091 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:36:08.091 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:36:08.091 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:36:08.091 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:36:08.091 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:08.091 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:36:08.091 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:08.091 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:08.091 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:08.091 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:08.091 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:36:08.092 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:36:08.092 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:08.092 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:08.092 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:08.092 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:08.092 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:36:08.092 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:08.092 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:08.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:08.093 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:36:08.195 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:2023-11-04T01:36:08.188+0000 7f44c343c480 -1 init, newargv = 0x5617a0745780 newargc=15 2023-11-04T01:36:08.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[94813]: starting ceph client 2023-11-04T01:36:08.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[94813]: starting fuse 2023-11-04T01:36:09.249 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:09.270 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:36:09.270 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:36:09.271 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:36:09.271 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:36:09.271 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:36:09.271 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:36:09.271 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:36:09.271 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:36:09.271 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:36:09.271 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:36:09.271 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:36:09.271 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:36:09.271 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:09.272 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:36:09.272 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:36:09.272 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:36:09.272 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:36:09.272 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:09.272 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:36:09.272 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:09.272 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:09.272 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:09.272 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:09.272 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:36:09.272 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:36:09.272 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:09.273 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:09.273 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:09.273 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:09.273 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:36:09.273 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:09.273 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:09.273 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:09.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:09.273 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:36:09.330 INFO:teuthology.orchestra.run.smithi044.stdout:41 2023-11-04T01:36:09.330 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:36:09.330 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:36:09.330 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2023-11-04T01:36:09.330 DEBUG:teuthology.orchestra.run.smithi044:> import re 2023-11-04T01:36:09.330 DEBUG:teuthology.orchestra.run.smithi044:> import os 2023-11-04T01:36:09.330 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2023-11-04T01:36:09.330 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:36:09.331 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2023-11-04T01:36:09.331 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-04T01:36:09.331 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2023-11-04T01:36:09.331 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-04T01:36:09.331 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:36:09.331 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2023-11-04T01:36:09.331 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2023-11-04T01:36:09.331 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2023-11-04T01:36:09.331 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2023-11-04T01:36:09.331 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:36:09.331 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2023-11-04T01:36:09.331 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:36:09.331 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:36:09.331 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:36:09.332 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2023-11-04T01:36:09.332 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2023-11-04T01:36:09.332 DEBUG:teuthology.orchestra.run.smithi044:> return f 2023-11-04T01:36:09.332 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:36:09.332 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:36:09.332 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.admin")) 2023-11-04T01:36:09.332 DEBUG:teuthology.orchestra.run.smithi044:> ' 2023-11-04T01:36:09.465 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.admin.94813.asok 2023-11-04T01:36:09.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:09.476 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.94813.asok 2023-11-04T01:36:09.477 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:09.477 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.admin.94813.asok status 2023-11-04T01:36:09.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:09.659 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:36:09.659 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2023-11-04T01:36:09.659 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:36:09.659 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:36:09.659 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "admin", 2023-11-04T01:36:09.659 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2023-11-04T01:36:09.659 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-04T01:36:09.659 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "94813", 2023-11-04T01:36:09.660 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2023-11-04T01:36:09.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:36:09.660 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2023-11-04T01:36:09.660 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2023-11-04T01:36:09.660 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4458, 2023-11-04T01:36:09.660 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2023-11-04T01:36:09.660 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2023-11-04T01:36:09.660 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2023-11-04T01:36:09.660 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4458 2023-11-04T01:36:09.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:36:09.660 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:36:09.660 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:36:09.660 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:36:09.661 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1605018424 2023-11-04T01:36:09.661 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:36:09.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:36:09.661 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:36:09.661 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:36:09.661 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:36:09.661 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1605018424 2023-11-04T01:36:09.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:36:09.661 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.4458 192.168.0.1:0/1605018424", 2023-11-04T01:36:09.661 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/1605018424", 2023-11-04T01:36:09.661 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2023-11-04T01:36:09.661 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 7, 2023-11-04T01:36:09.661 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 24, 2023-11-04T01:36:09.662 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:36:09.662 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2023-11-04T01:36:09.662 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2023-11-04T01:36:09.662 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:09.676 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:09.676 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:36:09.677 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:09.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:09.740 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2023-11-04T01:36:09.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:09.747 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:09.747 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:09.747 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:09.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:09.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:09.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:09.818 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-04T01:36:10.020 INFO:teuthology.orchestra.run.smithi044.stdout:# file: . 2023-11-04T01:36:10.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-04T01:36:10.021 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:10.021 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:36:10.021 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:10.038 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:10.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.182+0000 7f18bd925640 1 Processor -- start 2023-11-04T01:36:10.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.182+0000 7f18bd925640 1 -- start start 2023-11-04T01:36:10.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.183+0000 7f18bd925640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f18b80b42c0 0x7f18b80c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.183+0000 7f18bd925640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f18b80c9c40 0x7f18b80b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.183+0000 7f18bd925640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b80ca090 con 0x7f18b815ad80 2023-11-04T01:36:10.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.183+0000 7f18bd925640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b806cfa0 con 0x7f18b80c9c40 2023-11-04T01:36:10.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.183+0000 7f18bd925640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b806d280 con 0x7f18b80b42c0 2023-11-04T01:36:10.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.183+0000 7f18b6ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f18b815ad80 0x7f18b806c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57722/0 (socket says 172.21.15.44:57722) 2023-11-04T01:36:10.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.183+0000 7f18b6ffd640 1 -- 172.21.15.44:0/2173579635 learned_addr learned my addr 172.21.15.44:0/2173579635 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:10.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.183+0000 7f18b77fe640 1 --2- 172.21.15.44:0/2173579635 >> v2:172.21.15.204:3300/0 conn(0x7f18b80c9c40 0x7f18b80b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.183+0000 7f18b67fc640 1 --2- 172.21.15.44:0/2173579635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f18b80b42c0 0x7f18b80c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.183+0000 7f18b5ffb640 1 -- 172.21.15.44:0/2173579635 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962695803 0 0) 0x7f18a8001490 con 0x7f18b815ad80 2023-11-04T01:36:10.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.183+0000 7f18b5ffb640 1 -- 172.21.15.44:0/2173579635 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a4003520 con 0x7f18b815ad80 2023-11-04T01:36:10.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b5ffb640 1 -- 172.21.15.44:0/2173579635 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1998628798 0 0) 0x7f18a4003520 con 0x7f18b815ad80 2023-11-04T01:36:10.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b5ffb640 1 -- 172.21.15.44:0/2173579635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f18b80b42c0 msgr2=0x7f18b80c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:10.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b5ffb640 1 --2- 172.21.15.44:0/2173579635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f18b80b42c0 0x7f18b80c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b5ffb640 1 -- 172.21.15.44:0/2173579635 >> v2:172.21.15.204:3300/0 conn(0x7f18b80c9c40 msgr2=0x7f18b80b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:10.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b5ffb640 1 --2- 172.21.15.44:0/2173579635 >> v2:172.21.15.204:3300/0 conn(0x7f18b80c9c40 0x7f18b80b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b5ffb640 1 -- 172.21.15.44:0/2173579635 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b806d560 con 0x7f18b815ad80 2023-11-04T01:36:10.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b5ffb640 1 -- 172.21.15.44:0/2173579635 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f18a8001b80 con 0x7f18b815ad80 2023-11-04T01:36:10.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b5ffb640 1 -- 172.21.15.44:0/2173579635 >> v1:172.21.15.44:6789/0 conn(0x7f18b815ad80 legacy=0x7f18b806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b5ffb640 1 --2- 172.21.15.44:0/2173579635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18a4003970 0x7f18a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b5ffb640 1 --2- 172.21.15.44:0/2173579635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f18a40047c0 0x7f18a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b5ffb640 1 --2- 172.21.15.44:0/2173579635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f18b80b42c0 0x7f18a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b5ffb640 1 -- 172.21.15.44:0/2173579635 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b806cfa0 con 0x7f18a4003970 2023-11-04T01:36:10.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b5ffb640 1 -- 172.21.15.44:0/2173579635 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b806d280 con 0x7f18a40047c0 2023-11-04T01:36:10.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b5ffb640 1 -- 172.21.15.44:0/2173579635 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a400b980 con 0x7f18b80b42c0 2023-11-04T01:36:10.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b77fe640 1 --2- 172.21.15.44:0/2173579635 >> v2:172.21.15.204:3300/0 conn(0x7f18b80c9c40 0x7f18b80b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:10.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b6ffd640 1 --2- 172.21.15.44:0/2173579635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18a4003970 0x7f18a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b67fc640 1 --2- 172.21.15.44:0/2173579635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f18a40047c0 0x7f18a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b77fe640 1 --2- 172.21.15.44:0/2173579635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f18b80b42c0 0x7f18a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b6ffd640 1 -- 172.21.15.44:0/2173579635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f18b80b42c0 msgr2=0x7f18a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:10.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b6ffd640 1 --2- 172.21.15.44:0/2173579635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f18b80b42c0 0x7f18a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b6ffd640 1 -- 172.21.15.44:0/2173579635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f18a40047c0 msgr2=0x7f18a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:10.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b6ffd640 1 --2- 172.21.15.44:0/2173579635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f18a40047c0 0x7f18a4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b6ffd640 1 -- 172.21.15.44:0/2173579635 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a4003520 con 0x7f18a4003970 2023-11-04T01:36:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.184+0000 7f18b67fc640 1 --2- 172.21.15.44:0/2173579635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f18a40047c0 0x7f18a4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.185+0000 7f18b6ffd640 1 --2- 172.21.15.44:0/2173579635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18a4003970 0x7f18a4003d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18a800a860 tx=0x7f18a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0e873ca1686093 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.185+0000 7f18b5ffb640 1 -- 172.21.15.44:0/2173579635 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8034630 con 0x7f18a4003970 2023-11-04T01:36:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.185+0000 7f18b5ffb640 1 -- 172.21.15.44:0/2173579635 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a802f070 con 0x7f18a4003970 2023-11-04T01:36:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.185+0000 7f18b5ffb640 1 -- 172.21.15.44:0/2173579635 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80349f0 con 0x7f18a4003970 2023-11-04T01:36:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.185+0000 7f18bd925640 1 -- 172.21.15.44:0/2173579635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18a4003970 msgr2=0x7f18a4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.185+0000 7f18bd925640 1 --2- 172.21.15.44:0/2173579635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18a4003970 0x7f18a4003d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18a800a860 tx=0x7f18a40057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.185+0000 7f18b77fe640 1 -- 172.21.15.44:0/2173579635 reap_dead start 2023-11-04T01:36:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.186+0000 7f18bd925640 1 -- 172.21.15.44:0/2173579635 shutdown_connections 2023-11-04T01:36:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.186+0000 7f18bd925640 1 -- 172.21.15.44:0/2173579635 >> 172.21.15.44:0/2173579635 conn(0x7f18b80ce950 msgr2=0x7f18b80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.186+0000 7f18bd925640 1 -- 172.21.15.44:0/2173579635 shutdown_connections 2023-11-04T01:36:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.186+0000 7f18bd925640 1 -- 172.21.15.44:0/2173579635 wait complete. 2023-11-04T01:36:10.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.187+0000 7f18bd925640 1 Processor -- start 2023-11-04T01:36:10.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.187+0000 7f18bd925640 1 -- start start 2023-11-04T01:36:10.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18bd925640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18a4003970 0x7f18b80c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18bd925640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f18b8158050 0x7f18b80c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18bd925640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f18b80ab8e0 0x7f18b80abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18bd925640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b81f2730 con 0x7f18a4003970 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18bd925640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80c6880 con 0x7f18b80ab8e0 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18bd925640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b81f29f0 con 0x7f18b8158050 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18b6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18a4003970 0x7f18b80c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18b6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18a4003970 0x7f18b80c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50276/0 (socket says 172.21.15.44:50276) 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18b6ffd640 1 -- 172.21.15.44:0/282395114 learned_addr learned my addr 172.21.15.44:0/282395114 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18b67fc640 1 --2- 172.21.15.44:0/282395114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f18b8158050 0x7f18b80c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18b77fe640 1 --2- 172.21.15.44:0/282395114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f18b80ab8e0 0x7f18b80abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18b6ffd640 1 -- 172.21.15.44:0/282395114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f18b8158050 msgr2=0x7f18b80c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18b6ffd640 1 --2- 172.21.15.44:0/282395114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f18b8158050 0x7f18b80c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18b6ffd640 1 -- 172.21.15.44:0/282395114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f18b80ab8e0 msgr2=0x7f18b80abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18b6ffd640 1 --2- 172.21.15.44:0/282395114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f18b80ab8e0 0x7f18b80abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18b6ffd640 1 -- 172.21.15.44:0/282395114 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b81f2cd0 con 0x7f18a4003970 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.188+0000 7f18b6ffd640 1 --2- 172.21.15.44:0/282395114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18a4003970 0x7f18b80c5f80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f18a802cba0 tx=0x7f18a8001f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.189+0000 7f18affff640 1 -- 172.21.15.44:0/282395114 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8034840 con 0x7f18a4003970 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.189+0000 7f18affff640 1 -- 172.21.15.44:0/282395114 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a80349c0 con 0x7f18a4003970 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.189+0000 7f18bd925640 1 -- 172.21.15.44:0/282395114 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b81f2fb0 con 0x7f18a4003970 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.189+0000 7f18affff640 1 -- 172.21.15.44:0/282395114 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8034d70 con 0x7f18a4003970 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.189+0000 7f18bd925640 1 -- 172.21.15.44:0/282395114 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b81f34d0 con 0x7f18a4003970 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.190+0000 7f18bd925640 1 -- 172.21.15.44:0/282395114 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b8074290 con 0x7f18a4003970 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.190+0000 7f18affff640 1 -- 172.21.15.44:0/282395114 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f18a8031030 con 0x7f18a4003970 2023-11-04T01:36:10.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.190+0000 7f18affff640 1 --2- 172.21.15.44:0/282395114 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f189806ae70 0x7f189806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.190+0000 7f18affff640 1 -- 172.21.15.44:0/282395114 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f18a80abc00 con 0x7f18a4003970 2023-11-04T01:36:10.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.191+0000 7f18b67fc640 1 --2- 172.21.15.44:0/282395114 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f189806ae70 0x7f189806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.191+0000 7f18b67fc640 1 --2- 172.21.15.44:0/282395114 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f189806ae70 0x7f189806d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18b80b4260 tx=0x7f18a0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.195+0000 7f18affff640 1 -- 172.21.15.44:0/282395114 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f18a80b2080 con 0x7f18a4003970 2023-11-04T01:36:10.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.371+0000 7f18bd925640 1 -- 172.21.15.44:0/282395114 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18b80ca090 con 0x7f18a4003970 2023-11-04T01:36:10.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.372+0000 7f18affff640 1 -- 172.21.15.44:0/282395114 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f18b80ca090 con 0x7f18a4003970 2023-11-04T01:36:10.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:10.375 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:03.589395+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.374+0000 7f18bd925640 1 -- 172.21.15.44:0/282395114 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f189806ae70 msgr2=0x7f189806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.374+0000 7f18bd925640 1 --2- 172.21.15.44:0/282395114 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f189806ae70 0x7f189806d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18b80b4260 tx=0x7f18a0008040 comp rx=0 tx=0).stop 2023-11-04T01:36:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.374+0000 7f18bd925640 1 -- 172.21.15.44:0/282395114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18a4003970 msgr2=0x7f18b80c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.374+0000 7f18bd925640 1 --2- 172.21.15.44:0/282395114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18a4003970 0x7f18b80c5f80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f18a802cba0 tx=0x7f18a8001f10 comp rx=0 tx=0).stop 2023-11-04T01:36:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.374+0000 7f18bd925640 1 -- 172.21.15.44:0/282395114 shutdown_connections 2023-11-04T01:36:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.374+0000 7f18bd925640 1 --2- 172.21.15.44:0/282395114 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f189806ae70 0x7f189806d330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.374+0000 7f18bd925640 1 --2- 172.21.15.44:0/282395114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f18b80ab8e0 0x7f18b80abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.374+0000 7f18bd925640 1 --2- 172.21.15.44:0/282395114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f18b8158050 0x7f18b80c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.374+0000 7f18bd925640 1 --2- 172.21.15.44:0/282395114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18a4003970 0x7f18b80c5f80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.374+0000 7f18bd925640 1 -- 172.21.15.44:0/282395114 >> 172.21.15.44:0/282395114 conn(0x7f18b80ce950 msgr2=0x7f18b80ae340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.374+0000 7f18bd925640 1 -- 172.21.15.44:0/282395114 shutdown_connections 2023-11-04T01:36:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.374+0000 7f18bd925640 1 -- 172.21.15.44:0/282395114 wait complete. 2023-11-04T01:36:10.390 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:10.390 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:10.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.497+0000 7f00f5bbb640 1 Processor -- start 2023-11-04T01:36:10.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.498+0000 7f00f5bbb640 1 -- start start 2023-11-04T01:36:10.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.498+0000 7f00f5bbb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00f0153e60 0x7f00f015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.498+0000 7f00f5bbb640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f00cde60 con 0x7f00f00b4880 2023-11-04T01:36:10.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.498+0000 7f00f5bbb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f0160f90 con 0x7f00f00cd6d0 2023-11-04T01:36:10.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.498+0000 7f00f5bbb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f015e400 con 0x7f00f0153e60 2023-11-04T01:36:10.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.498+0000 7f00effff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f00f00b4880 0x7f00f00d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57738/0 (socket says 172.21.15.44:57738) 2023-11-04T01:36:10.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.498+0000 7f00effff640 1 -- 172.21.15.44:0/2357323373 learned_addr learned my addr 172.21.15.44:0/2357323373 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:10.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ef7fe640 1 --2- 172.21.15.44:0/2357323373 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00f0153e60 0x7f00f015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ee7fc640 1 -- 172.21.15.44:0/2357323373 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663800339 0 0) 0x7f00f00cde60 con 0x7f00f00b4880 2023-11-04T01:36:10.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ee7fc640 1 -- 172.21.15.44:0/2357323373 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d8003520 con 0x7f00f00b4880 2023-11-04T01:36:10.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ee7fc640 1 -- 172.21.15.44:0/2357323373 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2768798934 0 0) 0x7f00d8003520 con 0x7f00f00b4880 2023-11-04T01:36:10.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ee7fc640 1 -- 172.21.15.44:0/2357323373 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00f0153e60 msgr2=0x7f00f015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:10.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ee7fc640 1 --2- 172.21.15.44:0/2357323373 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00f0153e60 0x7f00f015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ee7fc640 1 -- 172.21.15.44:0/2357323373 >> v1:172.21.15.204:6789/0 conn(0x7f00f00cd6d0 legacy=0x7f00f0161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ee7fc640 1 -- 172.21.15.44:0/2357323373 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f00ce090 con 0x7f00f00b4880 2023-11-04T01:36:10.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ee7fc640 1 -- 172.21.15.44:0/2357323373 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f00e80019f0 con 0x7f00f00b4880 2023-11-04T01:36:10.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ee7fc640 1 -- 172.21.15.44:0/2357323373 >> v1:172.21.15.44:6789/0 conn(0x7f00f00b4880 legacy=0x7f00f00d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ee7fc640 1 --2- 172.21.15.44:0/2357323373 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00d80039a0 0x7f00d8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ee7fc640 1 --2- 172.21.15.44:0/2357323373 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00f0153e60 0x7f00d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ee7fc640 1 --2- 172.21.15.44:0/2357323373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00d8004d00 0x7f00d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ee7fc640 1 -- 172.21.15.44:0/2357323373 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f015e400 con 0x7f00d8004d00 2023-11-04T01:36:10.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ee7fc640 1 -- 172.21.15.44:0/2357323373 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d800ba30 con 0x7f00d80039a0 2023-11-04T01:36:10.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ee7fc640 1 -- 172.21.15.44:0/2357323373 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d800bbf0 con 0x7f00f0153e60 2023-11-04T01:36:10.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00effff640 1 --2- 172.21.15.44:0/2357323373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00d8004d00 0x7f00d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00ef7fe640 1 --2- 172.21.15.44:0/2357323373 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00d80039a0 0x7f00d8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.499+0000 7f00eeffd640 1 --2- 172.21.15.44:0/2357323373 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00f0153e60 0x7f00d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.500+0000 7f00ef7fe640 1 -- 172.21.15.44:0/2357323373 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00f0153e60 msgr2=0x7f00d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:10.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.500+0000 7f00ef7fe640 1 --2- 172.21.15.44:0/2357323373 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00f0153e60 0x7f00d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.500+0000 7f00ef7fe640 1 -- 172.21.15.44:0/2357323373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00d8004d00 msgr2=0x7f00d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:10.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.500+0000 7f00ef7fe640 1 --2- 172.21.15.44:0/2357323373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00d8004d00 0x7f00d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.500+0000 7f00ef7fe640 1 -- 172.21.15.44:0/2357323373 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d8003520 con 0x7f00d80039a0 2023-11-04T01:36:10.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.500+0000 7f00effff640 1 --2- 172.21.15.44:0/2357323373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00d8004d00 0x7f00d8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:10.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.500+0000 7f00ef7fe640 1 --2- 172.21.15.44:0/2357323373 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00d80039a0 0x7f00d8003dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009a90 tx=0x7f00d80057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34678aaea1e61afe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.501+0000 7f00ee7fc640 1 -- 172.21.15.44:0/2357323373 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e002c680 con 0x7f00d80039a0 2023-11-04T01:36:10.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.501+0000 7f00ee7fc640 1 -- 172.21.15.44:0/2357323373 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e002c7e0 con 0x7f00d80039a0 2023-11-04T01:36:10.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.501+0000 7f00ee7fc640 1 -- 172.21.15.44:0/2357323373 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e002cb70 con 0x7f00d80039a0 2023-11-04T01:36:10.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.501+0000 7f00f5bbb640 1 -- 172.21.15.44:0/2357323373 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00d80039a0 msgr2=0x7f00d8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.501+0000 7f00f5bbb640 1 --2- 172.21.15.44:0/2357323373 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00d80039a0 0x7f00d8003dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009a90 tx=0x7f00d80057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.501+0000 7f00effff640 1 -- 172.21.15.44:0/2357323373 reap_dead start 2023-11-04T01:36:10.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.501+0000 7f00f5bbb640 1 -- 172.21.15.44:0/2357323373 shutdown_connections 2023-11-04T01:36:10.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.501+0000 7f00f5bbb640 1 -- 172.21.15.44:0/2357323373 >> 172.21.15.44:0/2357323373 conn(0x7f00f00cf880 msgr2=0x7f00f00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:10.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.501+0000 7f00f5bbb640 1 -- 172.21.15.44:0/2357323373 shutdown_connections 2023-11-04T01:36:10.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.501+0000 7f00f5bbb640 1 -- 172.21.15.44:0/2357323373 wait complete. 2023-11-04T01:36:10.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.502+0000 7f00f5bbb640 1 Processor -- start 2023-11-04T01:36:10.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.502+0000 7f00f5bbb640 1 -- start start 2023-11-04T01:36:10.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.503+0000 7f00f5bbb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00d80039a0 0x7f00f00cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.503+0000 7f00f5bbb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f006c400 0x7f00f00c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.503+0000 7f00f5bbb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f0147db0 0x7f00f00c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.503+0000 7f00f5bbb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f01f6cc0 con 0x7f00f0147db0 2023-11-04T01:36:10.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.503+0000 7f00f5bbb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f00ccfb0 con 0x7f00f006c400 2023-11-04T01:36:10.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.503+0000 7f00f5bbb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f01f60b0 con 0x7f00d80039a0 2023-11-04T01:36:10.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.503+0000 7f00effff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f0147db0 0x7f00f00c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.503+0000 7f00effff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f0147db0 0x7f00f00c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50288/0 (socket says 172.21.15.44:50288) 2023-11-04T01:36:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.503+0000 7f00effff640 1 -- 172.21.15.44:0/2987097959 learned_addr learned my addr 172.21.15.44:0/2987097959 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.504+0000 7f00effff640 1 -- 172.21.15.44:0/2987097959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00d80039a0 msgr2=0x7f00f00cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.504+0000 7f00ef7fe640 1 --2- 172.21.15.44:0/2987097959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00d80039a0 0x7f00f00cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.504+0000 7f00eeffd640 1 --2- 172.21.15.44:0/2987097959 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f006c400 0x7f00f00c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.504+0000 7f00effff640 1 --2- 172.21.15.44:0/2987097959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00d80039a0 0x7f00f00cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.504+0000 7f00effff640 1 -- 172.21.15.44:0/2987097959 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f006c400 msgr2=0x7f00f00c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.504+0000 7f00effff640 1 --2- 172.21.15.44:0/2987097959 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f006c400 0x7f00f00c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.504+0000 7f00effff640 1 -- 172.21.15.44:0/2987097959 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f01f6390 con 0x7f00f0147db0 2023-11-04T01:36:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.504+0000 7f00eeffd640 1 --2- 172.21.15.44:0/2987097959 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f006c400 0x7f00f00c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.504+0000 7f00effff640 1 --2- 172.21.15.44:0/2987097959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f0147db0 0x7f00f00c9040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f00f00d3e70 tx=0x7f00e8007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.504+0000 7f00d7fff640 1 -- 172.21.15.44:0/2987097959 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800ae60 con 0x7f00f0147db0 2023-11-04T01:36:10.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.504+0000 7f00d7fff640 1 -- 172.21.15.44:0/2987097959 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e80133f0 con 0x7f00f0147db0 2023-11-04T01:36:10.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.504+0000 7f00f5bbb640 1 -- 172.21.15.44:0/2987097959 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f01f6670 con 0x7f00f0147db0 2023-11-04T01:36:10.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.504+0000 7f00d7fff640 1 -- 172.21.15.44:0/2987097959 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e80137c0 con 0x7f00f0147db0 2023-11-04T01:36:10.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.504+0000 7f00f5bbb640 1 -- 172.21.15.44:0/2987097959 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f01f5cf0 con 0x7f00f0147db0 2023-11-04T01:36:10.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.505+0000 7f00f5bbb640 1 -- 172.21.15.44:0/2987097959 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f01f5e80 con 0x7f00f0147db0 2023-11-04T01:36:10.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.505+0000 7f00d7fff640 1 -- 172.21.15.44:0/2987097959 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f00e8013920 con 0x7f00f0147db0 2023-11-04T01:36:10.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.506+0000 7f00d7fff640 1 --2- 172.21.15.44:0/2987097959 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00dc06aea0 0x7f00dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.506+0000 7f00d7fff640 1 -- 172.21.15.44:0/2987097959 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f00e808a370 con 0x7f00f0147db0 2023-11-04T01:36:10.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.506+0000 7f00ef7fe640 1 --2- 172.21.15.44:0/2987097959 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00dc06aea0 0x7f00dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.507+0000 7f00ef7fe640 1 --2- 172.21.15.44:0/2987097959 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00dc06aea0 0x7f00dc06d360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00e0036000 tx=0x7f00e0030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.510+0000 7f00d7fff640 1 -- 172.21.15.44:0/2987097959 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00e8055120 con 0x7f00f0147db0 2023-11-04T01:36:10.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.686+0000 7f00f5bbb640 1 -- 172.21.15.44:0/2987097959 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00f00b8880 con 0x7f00f0147db0 2023-11-04T01:36:10.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.686+0000 7f00d7fff640 1 -- 172.21.15.44:0/2987097959 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00e8058740 con 0x7f00f0147db0 2023-11-04T01:36:10.688 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:36:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.688+0000 7f00f5bbb640 1 -- 172.21.15.44:0/2987097959 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00dc06aea0 msgr2=0x7f00dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.688+0000 7f00f5bbb640 1 --2- 172.21.15.44:0/2987097959 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00dc06aea0 0x7f00dc06d360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00e0036000 tx=0x7f00e0030000 comp rx=0 tx=0).stop 2023-11-04T01:36:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.688+0000 7f00f5bbb640 1 -- 172.21.15.44:0/2987097959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f0147db0 msgr2=0x7f00f00c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.688+0000 7f00f5bbb640 1 --2- 172.21.15.44:0/2987097959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f0147db0 0x7f00f00c9040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f00f00d3e70 tx=0x7f00e8007430 comp rx=0 tx=0).stop 2023-11-04T01:36:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.688+0000 7f00f5bbb640 1 -- 172.21.15.44:0/2987097959 shutdown_connections 2023-11-04T01:36:10.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.688+0000 7f00f5bbb640 1 --2- 172.21.15.44:0/2987097959 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00dc06aea0 0x7f00dc06d360 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.688+0000 7f00f5bbb640 1 --2- 172.21.15.44:0/2987097959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f0147db0 0x7f00f00c9040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.688+0000 7f00f5bbb640 1 --2- 172.21.15.44:0/2987097959 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f006c400 0x7f00f00c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.688+0000 7f00f5bbb640 1 --2- 172.21.15.44:0/2987097959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00d80039a0 0x7f00f00cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.688+0000 7f00f5bbb640 1 -- 172.21.15.44:0/2987097959 >> 172.21.15.44:0/2987097959 conn(0x7f00f00cf880 msgr2=0x7f00f00d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:10.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.688+0000 7f00f5bbb640 1 -- 172.21.15.44:0/2987097959 shutdown_connections 2023-11-04T01:36:10.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.688+0000 7f00f5bbb640 1 -- 172.21.15.44:0/2987097959 wait complete. 2023-11-04T01:36:10.701 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:10.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.807+0000 7f6ef8bbb640 1 Processor -- start 2023-11-04T01:36:10.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.807+0000 7f6ef8bbb640 1 -- start start 2023-11-04T01:36:10.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.808+0000 7f6ef8bbb640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ef415af20 0x7f6ef40b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.808+0000 7f6ef8bbb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ef40b64c0 0x7f6ef40cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.808+0000 7f6ef8bbb640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef40d01f0 con 0x7f6ef40cd3b0 2023-11-04T01:36:10.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.808+0000 7f6ef8bbb640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef40b6a40 con 0x7f6ef415af20 2023-11-04T01:36:10.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.808+0000 7f6ef8bbb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef40d04b0 con 0x7f6ef40b64c0 2023-11-04T01:36:10.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.809+0000 7f6ef259c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ef415af20 0x7f6ef40b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.809+0000 7f6ef2d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6ef40cd3b0 0x7f6ef40b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57740/0 (socket says 172.21.15.44:57740) 2023-11-04T01:36:10.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.809+0000 7f6ef2d9d640 1 -- 172.21.15.44:0/1545500449 learned_addr learned my addr 172.21.15.44:0/1545500449 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:10.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.809+0000 7f6ef1d9b640 1 --2- 172.21.15.44:0/1545500449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ef40b64c0 0x7f6ef40cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.809+0000 7f6ef259c640 1 -- 172.21.15.44:0/1545500449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ef40b64c0 msgr2=0x7f6ef40cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:10.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.809+0000 7f6ef259c640 1 --2- 172.21.15.44:0/1545500449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ef40b64c0 0x7f6ef40cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.809+0000 7f6ef259c640 1 -- 172.21.15.44:0/1545500449 >> v1:172.21.15.44:6789/0 conn(0x7f6ef40cd3b0 legacy=0x7f6ef40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.809+0000 7f6ef259c640 1 -- 172.21.15.44:0/1545500449 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef40d0790 con 0x7f6ef415af20 2023-11-04T01:36:10.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.809+0000 7f6ef159a640 1 -- 172.21.15.44:0/1545500449 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320407677 0 0) 0x7f6ef40d01f0 con 0x7f6ef40cd3b0 2023-11-04T01:36:10.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.810+0000 7f6ef259c640 1 --2- 172.21.15.44:0/1545500449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ef415af20 0x7f6ef40b3cd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0097a0 tx=0x7f6eec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c962d425c92de2b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.810+0000 7f6ef159a640 1 -- 172.21.15.44:0/1545500449 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec031830 con 0x7f6ef415af20 2023-11-04T01:36:10.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.810+0000 7f6ef159a640 1 -- 172.21.15.44:0/1545500449 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec031990 con 0x7f6ef415af20 2023-11-04T01:36:10.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.810+0000 7f6ef159a640 1 -- 172.21.15.44:0/1545500449 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec031d20 con 0x7f6ef415af20 2023-11-04T01:36:10.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.810+0000 7f6ef8bbb640 1 -- 172.21.15.44:0/1545500449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ef415af20 msgr2=0x7f6ef40b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.810+0000 7f6ef8bbb640 1 --2- 172.21.15.44:0/1545500449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ef415af20 0x7f6ef40b3cd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0097a0 tx=0x7f6eec02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.810+0000 7f6ef8bbb640 1 -- 172.21.15.44:0/1545500449 shutdown_connections 2023-11-04T01:36:10.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.810+0000 7f6ef8bbb640 1 --2- 172.21.15.44:0/1545500449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ef40b64c0 0x7f6ef40cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.810+0000 7f6ef8bbb640 1 --2- 172.21.15.44:0/1545500449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ef415af20 0x7f6ef40b3cd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.810+0000 7f6ef8bbb640 1 -- 172.21.15.44:0/1545500449 >> 172.21.15.44:0/1545500449 conn(0x7f6ef406ea20 msgr2=0x7f6ef406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:10.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.811+0000 7f6ef8bbb640 1 -- 172.21.15.44:0/1545500449 shutdown_connections 2023-11-04T01:36:10.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.811+0000 7f6ef8bbb640 1 -- 172.21.15.44:0/1545500449 wait complete. 2023-11-04T01:36:10.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.812+0000 7f6ef8bbb640 1 Processor -- start 2023-11-04T01:36:10.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.812+0000 7f6ef8bbb640 1 -- start start 2023-11-04T01:36:10.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef8bbb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ef40b64c0 0x7f6ef40b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef8bbb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ef40cd3b0 0x7f6ef41f0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef8bbb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ef415af20 0x7f6ef41f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef8bbb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef40b3470 con 0x7f6ef40cd3b0 2023-11-04T01:36:10.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef8bbb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef415c6d0 con 0x7f6ef40b64c0 2023-11-04T01:36:10.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef8bbb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef415d6e0 con 0x7f6ef415af20 2023-11-04T01:36:10.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ef40cd3b0 0x7f6ef41f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ef40cd3b0 0x7f6ef41f0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50312/0 (socket says 172.21.15.44:50312) 2023-11-04T01:36:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef1d9b640 1 -- 172.21.15.44:0/2497867730 learned_addr learned my addr 172.21.15.44:0/2497867730 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef2d9d640 1 --2- 172.21.15.44:0/2497867730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ef415af20 0x7f6ef41f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef259c640 1 --2- 172.21.15.44:0/2497867730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ef40b64c0 0x7f6ef40b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef1d9b640 1 -- 172.21.15.44:0/2497867730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ef415af20 msgr2=0x7f6ef41f0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef1d9b640 1 --2- 172.21.15.44:0/2497867730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ef415af20 0x7f6ef41f0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef1d9b640 1 -- 172.21.15.44:0/2497867730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ef40b64c0 msgr2=0x7f6ef40b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef1d9b640 1 --2- 172.21.15.44:0/2497867730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ef40b64c0 0x7f6ef40b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef1d9b640 1 -- 172.21.15.44:0/2497867730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec009400 con 0x7f6ef40cd3b0 2023-11-04T01:36:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef1d9b640 1 --2- 172.21.15.44:0/2497867730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ef40cd3b0 0x7f6ef41f0660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00d800 tx=0x7f6edc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6eeaffd640 1 -- 172.21.15.44:0/2497867730 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc00b6c0 con 0x7f6ef40cd3b0 2023-11-04T01:36:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6eeaffd640 1 -- 172.21.15.44:0/2497867730 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc00b820 con 0x7f6ef40cd3b0 2023-11-04T01:36:10.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6ef8bbb640 1 -- 172.21.15.44:0/2497867730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef415d980 con 0x7f6ef40cd3b0 2023-11-04T01:36:10.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.813+0000 7f6eeaffd640 1 -- 172.21.15.44:0/2497867730 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc00bbb0 con 0x7f6ef40cd3b0 2023-11-04T01:36:10.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.814+0000 7f6ef8bbb640 1 -- 172.21.15.44:0/2497867730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef415df40 con 0x7f6ef40cd3b0 2023-11-04T01:36:10.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.814+0000 7f6ef8bbb640 1 -- 172.21.15.44:0/2497867730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef41509d0 con 0x7f6ef40cd3b0 2023-11-04T01:36:10.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.815+0000 7f6eeaffd640 1 -- 172.21.15.44:0/2497867730 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6edc00bd10 con 0x7f6ef40cd3b0 2023-11-04T01:36:10.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.815+0000 7f6eeaffd640 1 --2- 172.21.15.44:0/2497867730 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ed406ae70 0x7f6ed406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.815+0000 7f6eeaffd640 1 -- 172.21.15.44:0/2497867730 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6edc089e40 con 0x7f6ef40cd3b0 2023-11-04T01:36:10.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.815+0000 7f6ef259c640 1 --2- 172.21.15.44:0/2497867730 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ed406ae70 0x7f6ed406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.816+0000 7f6ef259c640 1 --2- 172.21.15.44:0/2497867730 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ed406ae70 0x7f6ed406d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6eec036000 tx=0x7f6eec03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.820+0000 7f6eeaffd640 1 -- 172.21.15.44:0/2497867730 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6edc054c00 con 0x7f6ef40cd3b0 2023-11-04T01:36:10.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.993+0000 7f6ef8bbb640 1 -- 172.21.15.44:0/2497867730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ef406f210 con 0x7f6ef40cd3b0 2023-11-04T01:36:10.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.994+0000 7f6eeaffd640 1 -- 172.21.15.44:0/2497867730 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6edc058220 con 0x7f6ef40cd3b0 2023-11-04T01:36:10.997 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.995+0000 7f6ef8bbb640 1 -- 172.21.15.44:0/2497867730 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ed406ae70 msgr2=0x7f6ed406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.995+0000 7f6ef8bbb640 1 --2- 172.21.15.44:0/2497867730 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ed406ae70 0x7f6ed406d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6eec036000 tx=0x7f6eec03c040 comp rx=0 tx=0).stop 2023-11-04T01:36:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.996+0000 7f6ef8bbb640 1 -- 172.21.15.44:0/2497867730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ef40cd3b0 msgr2=0x7f6ef41f0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.996+0000 7f6ef8bbb640 1 --2- 172.21.15.44:0/2497867730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ef40cd3b0 0x7f6ef41f0660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00d800 tx=0x7f6edc00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.996+0000 7f6ef8bbb640 1 -- 172.21.15.44:0/2497867730 shutdown_connections 2023-11-04T01:36:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.996+0000 7f6ef8bbb640 1 --2- 172.21.15.44:0/2497867730 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ed406ae70 0x7f6ed406d330 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.996+0000 7f6ef8bbb640 1 --2- 172.21.15.44:0/2497867730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ef415af20 0x7f6ef41f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.996+0000 7f6ef8bbb640 1 --2- 172.21.15.44:0/2497867730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ef40cd3b0 0x7f6ef41f0660 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.996+0000 7f6ef8bbb640 1 --2- 172.21.15.44:0/2497867730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ef40b64c0 0x7f6ef40b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.996+0000 7f6ef8bbb640 1 -- 172.21.15.44:0/2497867730 >> 172.21.15.44:0/2497867730 conn(0x7f6ef406ea20 msgr2=0x7f6ef4158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.996+0000 7f6ef8bbb640 1 -- 172.21.15.44:0/2497867730 shutdown_connections 2023-11-04T01:36:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:10.996+0000 7f6ef8bbb640 1 -- 172.21.15.44:0/2497867730 wait complete. 2023-11-04T01:36:11.009 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:11.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.115+0000 7fca0fd97640 1 Processor -- start 2023-11-04T01:36:11.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.116+0000 7fca0fd97640 1 -- start start 2023-11-04T01:36:11.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.116+0000 7fca0fd97640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fca08160430 0x7fca080b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.116+0000 7fca0fd97640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca080b2b60 0x7fca0806bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.116+0000 7fca0fd97640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca080b2fc0 con 0x7fca0806c1d0 2023-11-04T01:36:11.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.116+0000 7fca0fd97640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca080cb580 con 0x7fca08160430 2023-11-04T01:36:11.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.116+0000 7fca0fd97640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0806ca40 con 0x7fca080b2b60 2023-11-04T01:36:11.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.117+0000 7fca0db33640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fca08160430 0x7fca080b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.117+0000 7fca0e334640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fca0806c1d0 0x7fca08160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57746/0 (socket says 172.21.15.44:57746) 2023-11-04T01:36:11.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.117+0000 7fca0e334640 1 -- 172.21.15.44:0/2441900825 learned_addr learned my addr 172.21.15.44:0/2441900825 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:11.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.117+0000 7fca0d332640 1 --2- 172.21.15.44:0/2441900825 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca080b2b60 0x7fca0806bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.117+0000 7fca0db33640 1 -- 172.21.15.44:0/2441900825 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca080b2b60 msgr2=0x7fca0806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.117+0000 7fca0db33640 1 --2- 172.21.15.44:0/2441900825 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca080b2b60 0x7fca0806bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.117+0000 7fca0db33640 1 -- 172.21.15.44:0/2441900825 >> v1:172.21.15.44:6789/0 conn(0x7fca0806c1d0 legacy=0x7fca08160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.117+0000 7fca0db33640 1 -- 172.21.15.44:0/2441900825 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0806cd20 con 0x7fca08160430 2023-11-04T01:36:11.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.117+0000 7fca0d332640 1 --2- 172.21.15.44:0/2441900825 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca080b2b60 0x7fca0806bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:11.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.118+0000 7fca0db33640 1 --2- 172.21.15.44:0/2441900825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca08160430 0x7fca080b2620 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca000097a0 tx=0x7fca0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd57366afc49432 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.118+0000 7fca0cb31640 1 -- 172.21.15.44:0/2441900825 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca00031830 con 0x7fca08160430 2023-11-04T01:36:11.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.118+0000 7fca0cb31640 1 -- 172.21.15.44:0/2441900825 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca00031990 con 0x7fca08160430 2023-11-04T01:36:11.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.118+0000 7fca0cb31640 1 -- 172.21.15.44:0/2441900825 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca00031d20 con 0x7fca08160430 2023-11-04T01:36:11.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.118+0000 7fca0fd97640 1 -- 172.21.15.44:0/2441900825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca08160430 msgr2=0x7fca080b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.118+0000 7fca0fd97640 1 --2- 172.21.15.44:0/2441900825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca08160430 0x7fca080b2620 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca000097a0 tx=0x7fca0002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.118+0000 7fca0fd97640 1 -- 172.21.15.44:0/2441900825 shutdown_connections 2023-11-04T01:36:11.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.118+0000 7fca0fd97640 1 --2- 172.21.15.44:0/2441900825 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca080b2b60 0x7fca0806bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.118+0000 7fca0fd97640 1 --2- 172.21.15.44:0/2441900825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca08160430 0x7fca080b2620 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.118+0000 7fca0fd97640 1 -- 172.21.15.44:0/2441900825 >> 172.21.15.44:0/2441900825 conn(0x7fca0806ea20 msgr2=0x7fca0806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.118+0000 7fca0fd97640 1 -- 172.21.15.44:0/2441900825 shutdown_connections 2023-11-04T01:36:11.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.119+0000 7fca0fd97640 1 -- 172.21.15.44:0/2441900825 wait complete. 2023-11-04T01:36:11.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.120+0000 7fca0fd97640 1 Processor -- start 2023-11-04T01:36:11.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.120+0000 7fca0fd97640 1 -- start start 2023-11-04T01:36:11.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.120+0000 7fca0fd97640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca0806c1d0 0x7fca081f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.120+0000 7fca0fd97640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca080b2b60 0x7fca080c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.120+0000 7fca0fd97640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca08160430 0x7fca080c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.120+0000 7fca0fd97640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca080c6520 con 0x7fca0806c1d0 2023-11-04T01:36:11.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.120+0000 7fca0fd97640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca080c4630 con 0x7fca08160430 2023-11-04T01:36:11.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.120+0000 7fca0fd97640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca080c4910 con 0x7fca080b2b60 2023-11-04T01:36:11.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.120+0000 7fca0db33640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca0806c1d0 0x7fca081f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.120+0000 7fca0db33640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca0806c1d0 0x7fca081f01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50326/0 (socket says 172.21.15.44:50326) 2023-11-04T01:36:11.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.120+0000 7fca0db33640 1 -- 172.21.15.44:0/758502391 learned_addr learned my addr 172.21.15.44:0/758502391 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:11.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.121+0000 7fca0d332640 1 --2- 172.21.15.44:0/758502391 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca080b2b60 0x7fca080c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.121+0000 7fca0e334640 1 --2- 172.21.15.44:0/758502391 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca08160430 0x7fca080c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.121+0000 7fca0db33640 1 -- 172.21.15.44:0/758502391 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca080b2b60 msgr2=0x7fca080c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.121+0000 7fca0db33640 1 --2- 172.21.15.44:0/758502391 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca080b2b60 0x7fca080c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.121+0000 7fca0db33640 1 -- 172.21.15.44:0/758502391 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca08160430 msgr2=0x7fca080c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.121+0000 7fca0db33640 1 --2- 172.21.15.44:0/758502391 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca08160430 0x7fca080c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.121+0000 7fca0db33640 1 -- 172.21.15.44:0/758502391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca00009400 con 0x7fca0806c1d0 2023-11-04T01:36:11.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.121+0000 7fca0e334640 1 --2- 172.21.15.44:0/758502391 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca08160430 0x7fca080c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:11.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.121+0000 7fca0db33640 1 --2- 172.21.15.44:0/758502391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca0806c1d0 0x7fca081f01c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fca00034040 tx=0x7fca000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.121+0000 7fca067fc640 1 -- 172.21.15.44:0/758502391 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0003aa60 con 0x7fca0806c1d0 2023-11-04T01:36:11.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.121+0000 7fca067fc640 1 -- 172.21.15.44:0/758502391 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0003abe0 con 0x7fca0806c1d0 2023-11-04T01:36:11.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.121+0000 7fca0fd97640 1 -- 172.21.15.44:0/758502391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca080c4bf0 con 0x7fca0806c1d0 2023-11-04T01:36:11.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.121+0000 7fca067fc640 1 -- 172.21.15.44:0/758502391 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca00044400 con 0x7fca0806c1d0 2023-11-04T01:36:11.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.121+0000 7fca0fd97640 1 -- 172.21.15.44:0/758502391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0815f2f0 con 0x7fca0806c1d0 2023-11-04T01:36:11.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.122+0000 7fca0fd97640 1 -- 172.21.15.44:0/758502391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca080c5110 con 0x7fca0806c1d0 2023-11-04T01:36:11.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.123+0000 7fca067fc640 1 -- 172.21.15.44:0/758502391 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca0004d440 con 0x7fca0806c1d0 2023-11-04T01:36:11.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.123+0000 7fca067fc640 1 --2- 172.21.15.44:0/758502391 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc9f406aea0 0x7fc9f406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.123+0000 7fca067fc640 1 -- 172.21.15.44:0/758502391 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca000abb80 con 0x7fca0806c1d0 2023-11-04T01:36:11.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.123+0000 7fca0d332640 1 --2- 172.21.15.44:0/758502391 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc9f406aea0 0x7fc9f406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.124+0000 7fca0d332640 1 --2- 172.21.15.44:0/758502391 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc9f406aea0 0x7fc9f406d360 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fca080caab0 tx=0x7fc9fc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.127+0000 7fca067fc640 1 -- 172.21.15.44:0/758502391 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fca00076930 con 0x7fca0806c1d0 2023-11-04T01:36:11.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.307+0000 7fca0fd97640 1 -- 172.21.15.44:0/758502391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fca08074290 con 0x7fca0806c1d0 2023-11-04T01:36:11.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.308+0000 7fca067fc640 1 -- 172.21.15.44:0/758502391 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fca000350a0 con 0x7fca0806c1d0 2023-11-04T01:36:11.310 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:36:11.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.310+0000 7fca0fd97640 1 -- 172.21.15.44:0/758502391 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc9f406aea0 msgr2=0x7fc9f406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.310+0000 7fca0fd97640 1 --2- 172.21.15.44:0/758502391 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc9f406aea0 0x7fc9f406d360 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fca080caab0 tx=0x7fc9fc008040 comp rx=0 tx=0).stop 2023-11-04T01:36:11.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.310+0000 7fca0fd97640 1 -- 172.21.15.44:0/758502391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca0806c1d0 msgr2=0x7fca081f01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.310+0000 7fca0fd97640 1 --2- 172.21.15.44:0/758502391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca0806c1d0 0x7fca081f01c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fca00034040 tx=0x7fca000046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.310+0000 7fca0fd97640 1 -- 172.21.15.44:0/758502391 shutdown_connections 2023-11-04T01:36:11.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.310+0000 7fca0fd97640 1 --2- 172.21.15.44:0/758502391 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc9f406aea0 0x7fc9f406d360 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.310+0000 7fca0fd97640 1 --2- 172.21.15.44:0/758502391 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca08160430 0x7fca080c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.310+0000 7fca0fd97640 1 --2- 172.21.15.44:0/758502391 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca080b2b60 0x7fca080c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.310+0000 7fca0fd97640 1 --2- 172.21.15.44:0/758502391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca0806c1d0 0x7fca081f01c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.310+0000 7fca0fd97640 1 -- 172.21.15.44:0/758502391 >> 172.21.15.44:0/758502391 conn(0x7fca0806ea20 msgr2=0x7fca080cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.310+0000 7fca0fd97640 1 -- 172.21.15.44:0/758502391 shutdown_connections 2023-11-04T01:36:11.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.310+0000 7fca0fd97640 1 -- 172.21.15.44:0/758502391 wait complete. 2023-11-04T01:36:11.325 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.433+0000 7fa835924640 1 Processor -- start 2023-11-04T01:36:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.433+0000 7fa835924640 1 -- start start 2023-11-04T01:36:11.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.434+0000 7fa835924640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa8300b4fb0 0x7fa8300cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.434+0000 7fa835924640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa83015d0a0 0x7fa8300cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.434+0000 7fa835924640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa830160df0 con 0x7fa83015ccc0 2023-11-04T01:36:11.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.434+0000 7fa835924640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8300ce260 con 0x7fa8300b4fb0 2023-11-04T01:36:11.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.434+0000 7fa835924640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8300ce540 con 0x7fa83015d0a0 2023-11-04T01:36:11.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.434+0000 7fa82effd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa83015ccc0 0x7fa8300b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57762/0 (socket says 172.21.15.44:57762) 2023-11-04T01:36:11.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.434+0000 7fa82effd640 1 -- 172.21.15.44:0/3852272210 learned_addr learned my addr 172.21.15.44:0/3852272210 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:11.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.434+0000 7fa827fff640 1 --2- 172.21.15.44:0/3852272210 >> v2:172.21.15.44:3300/0 conn(0x7fa8300b4fb0 0x7fa8300cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.434+0000 7fa82f7fe640 1 --2- 172.21.15.44:0/3852272210 >> v2:172.21.15.204:3300/0 conn(0x7fa83015d0a0 0x7fa8300cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.434+0000 7fa82e7fc640 1 -- 172.21.15.44:0/3852272210 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014296299 0 0) 0x7fa820001110 con 0x7fa83015ccc0 2023-11-04T01:36:11.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.434+0000 7fa82e7fc640 1 -- 172.21.15.44:0/3852272210 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa81c003520 con 0x7fa83015ccc0 2023-11-04T01:36:11.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.434+0000 7fa827fff640 1 -- 172.21.15.44:0/3852272210 >> v2:172.21.15.204:3300/0 conn(0x7fa83015d0a0 msgr2=0x7fa8300cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.434+0000 7fa827fff640 1 --2- 172.21.15.44:0/3852272210 >> v2:172.21.15.204:3300/0 conn(0x7fa83015d0a0 0x7fa8300cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.434+0000 7fa827fff640 1 -- 172.21.15.44:0/3852272210 >> v1:172.21.15.44:6789/0 conn(0x7fa83015ccc0 legacy=0x7fa8300b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.434+0000 7fa827fff640 1 -- 172.21.15.44:0/3852272210 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8300d1050 con 0x7fa8300b4fb0 2023-11-04T01:36:11.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.435+0000 7fa827fff640 1 --2- 172.21.15.44:0/3852272210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8300b4fb0 0x7fa8300cd680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa8300cf350 tx=0x7fa81802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c797ff497995c4f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.435+0000 7fa82e7fc640 1 -- 172.21.15.44:0/3852272210 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818031830 con 0x7fa8300b4fb0 2023-11-04T01:36:11.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.435+0000 7fa82e7fc640 1 -- 172.21.15.44:0/3852272210 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa818031990 con 0x7fa8300b4fb0 2023-11-04T01:36:11.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.435+0000 7fa82e7fc640 1 -- 172.21.15.44:0/3852272210 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818031d00 con 0x7fa8300b4fb0 2023-11-04T01:36:11.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.436+0000 7fa835924640 1 -- 172.21.15.44:0/3852272210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8300b4fb0 msgr2=0x7fa8300cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.436+0000 7fa835924640 1 --2- 172.21.15.44:0/3852272210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8300b4fb0 0x7fa8300cd680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa8300cf350 tx=0x7fa81802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.436+0000 7fa835924640 1 -- 172.21.15.44:0/3852272210 shutdown_connections 2023-11-04T01:36:11.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.436+0000 7fa835924640 1 --2- 172.21.15.44:0/3852272210 >> v2:172.21.15.204:3300/0 conn(0x7fa83015d0a0 0x7fa8300cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.436+0000 7fa835924640 1 --2- 172.21.15.44:0/3852272210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8300b4fb0 0x7fa8300cd680 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.436+0000 7fa835924640 1 -- 172.21.15.44:0/3852272210 >> 172.21.15.44:0/3852272210 conn(0x7fa8300cf8a0 msgr2=0x7fa8300cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.436+0000 7fa835924640 1 -- 172.21.15.44:0/3852272210 shutdown_connections 2023-11-04T01:36:11.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.436+0000 7fa835924640 1 -- 172.21.15.44:0/3852272210 wait complete. 2023-11-04T01:36:11.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.437+0000 7fa835924640 1 Processor -- start 2023-11-04T01:36:11.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.437+0000 7fa835924640 1 -- start start 2023-11-04T01:36:11.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa835924640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8300b4fb0 0x7fa830152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa835924640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa83015ccc0 0x7fa8300c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa835924640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa83015d0a0 0x7fa8300cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa835924640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8300c7f80 con 0x7fa83015d0a0 2023-11-04T01:36:11.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa835924640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8300c7370 con 0x7fa83015ccc0 2023-11-04T01:36:11.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa835924640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8300c7650 con 0x7fa8300b4fb0 2023-11-04T01:36:11.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa82f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa83015d0a0 0x7fa8300cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa82f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa83015d0a0 0x7fa8300cbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50338/0 (socket says 172.21.15.44:50338) 2023-11-04T01:36:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa82f7fe640 1 -- 172.21.15.44:0/755916706 learned_addr learned my addr 172.21.15.44:0/755916706 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa82effd640 1 --2- 172.21.15.44:0/755916706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8300b4fb0 0x7fa830152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa827fff640 1 --2- 172.21.15.44:0/755916706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa83015ccc0 0x7fa8300c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa82f7fe640 1 -- 172.21.15.44:0/755916706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8300b4fb0 msgr2=0x7fa830152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa82f7fe640 1 --2- 172.21.15.44:0/755916706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8300b4fb0 0x7fa830152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa82f7fe640 1 -- 172.21.15.44:0/755916706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa83015ccc0 msgr2=0x7fa8300c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa82f7fe640 1 --2- 172.21.15.44:0/755916706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa83015ccc0 0x7fa8300c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa82f7fe640 1 -- 172.21.15.44:0/755916706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa818009400 con 0x7fa83015d0a0 2023-11-04T01:36:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.438+0000 7fa82f7fe640 1 --2- 172.21.15.44:0/755916706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa83015d0a0 0x7fa8300cbbf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa828007e60 tx=0x7fa82800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.439+0000 7fa82cff9640 1 -- 172.21.15.44:0/755916706 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828014420 con 0x7fa83015d0a0 2023-11-04T01:36:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.439+0000 7fa82cff9640 1 -- 172.21.15.44:0/755916706 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8280145a0 con 0x7fa83015d0a0 2023-11-04T01:36:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.439+0000 7fa835924640 1 -- 172.21.15.44:0/755916706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8300c7930 con 0x7fa83015d0a0 2023-11-04T01:36:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.439+0000 7fa82cff9640 1 -- 172.21.15.44:0/755916706 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828014950 con 0x7fa83015d0a0 2023-11-04T01:36:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.439+0000 7fa835924640 1 -- 172.21.15.44:0/755916706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8300c6e00 con 0x7fa83015d0a0 2023-11-04T01:36:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.440+0000 7fa835924640 1 -- 172.21.15.44:0/755916706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8300c7050 con 0x7fa83015d0a0 2023-11-04T01:36:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.440+0000 7fa82cff9640 1 -- 172.21.15.44:0/755916706 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa828014ab0 con 0x7fa83015d0a0 2023-11-04T01:36:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.441+0000 7fa82cff9640 1 --2- 172.21.15.44:0/755916706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa81006aea0 0x7fa81006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.441+0000 7fa82cff9640 1 -- 172.21.15.44:0/755916706 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa82808a190 con 0x7fa83015d0a0 2023-11-04T01:36:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.441+0000 7fa82effd640 1 --2- 172.21.15.44:0/755916706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa81006aea0 0x7fa81006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.441+0000 7fa82effd640 1 --2- 172.21.15.44:0/755916706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa81006aea0 0x7fa81006d360 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa820005880 tx=0x7fa820009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.445+0000 7fa82cff9640 1 -- 172.21.15.44:0/755916706 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa828054f50 con 0x7fa83015d0a0 2023-11-04T01:36:11.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.620+0000 7fa835924640 1 -- 172.21.15.44:0/755916706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa8300674e0 con 0x7fa83015d0a0 2023-11-04T01:36:11.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.621+0000 7fa82cff9640 1 -- 172.21.15.44:0/755916706 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa828058570 con 0x7fa83015d0a0 2023-11-04T01:36:11.623 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:11.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.623+0000 7fa835924640 1 -- 172.21.15.44:0/755916706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa81006aea0 msgr2=0x7fa81006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.623+0000 7fa835924640 1 --2- 172.21.15.44:0/755916706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa81006aea0 0x7fa81006d360 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa820005880 tx=0x7fa820009040 comp rx=0 tx=0).stop 2023-11-04T01:36:11.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.623+0000 7fa835924640 1 -- 172.21.15.44:0/755916706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa83015d0a0 msgr2=0x7fa8300cbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.623+0000 7fa835924640 1 --2- 172.21.15.44:0/755916706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa83015d0a0 0x7fa8300cbbf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa828007e60 tx=0x7fa82800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.623+0000 7fa835924640 1 -- 172.21.15.44:0/755916706 shutdown_connections 2023-11-04T01:36:11.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.623+0000 7fa835924640 1 --2- 172.21.15.44:0/755916706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa81006aea0 0x7fa81006d360 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.623+0000 7fa835924640 1 --2- 172.21.15.44:0/755916706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa83015d0a0 0x7fa8300cbbf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.623+0000 7fa835924640 1 --2- 172.21.15.44:0/755916706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa83015ccc0 0x7fa8300c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.623+0000 7fa835924640 1 --2- 172.21.15.44:0/755916706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8300b4fb0 0x7fa830152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.623+0000 7fa835924640 1 -- 172.21.15.44:0/755916706 >> 172.21.15.44:0/755916706 conn(0x7fa8300cf8a0 msgr2=0x7fa8300d2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.623+0000 7fa835924640 1 -- 172.21.15.44:0/755916706 shutdown_connections 2023-11-04T01:36:11.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.623+0000 7fa835924640 1 -- 172.21.15.44:0/755916706 wait complete. 2023-11-04T01:36:11.636 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:11.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.741+0000 7eff7907c640 1 Processor -- start 2023-11-04T01:36:11.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.741+0000 7eff7907c640 1 -- start start 2023-11-04T01:36:11.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.742+0000 7eff7907c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7eff74153e60 0x7eff7415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.742+0000 7eff7907c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7eff740b4880 0x7eff740b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.742+0000 7eff7907c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff740cde60 con 0x7eff740cd6d0 2023-11-04T01:36:11.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.742+0000 7eff7907c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff74160f90 con 0x7eff740b4880 2023-11-04T01:36:11.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.742+0000 7eff7907c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff740b5200 con 0x7eff74153e60 2023-11-04T01:36:11.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.742+0000 7eff7359e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7eff740b4880 0x7eff740b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.742+0000 7eff7359e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7eff740b4880 0x7eff740b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50352/0 (socket says 172.21.15.44:50352) 2023-11-04T01:36:11.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.742+0000 7eff7359e640 1 -- 172.21.15.44:0/3232429959 learned_addr learned my addr 172.21.15.44:0/3232429959 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:11.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.742+0000 7eff72d9d640 1 --2- 172.21.15.44:0/3232429959 >> v2:172.21.15.204:3300/0 conn(0x7eff74153e60 0x7eff7415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.742+0000 7eff7359e640 1 -- 172.21.15.44:0/3232429959 >> v2:172.21.15.204:3300/0 conn(0x7eff74153e60 msgr2=0x7eff7415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.742+0000 7eff7359e640 1 --2- 172.21.15.44:0/3232429959 >> v2:172.21.15.204:3300/0 conn(0x7eff74153e60 0x7eff7415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.742+0000 7eff7359e640 1 -- 172.21.15.44:0/3232429959 >> v1:172.21.15.204:6789/0 conn(0x7eff740cd6d0 legacy=0x7eff74161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.742+0000 7eff7359e640 1 -- 172.21.15.44:0/3232429959 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7415e400 con 0x7eff740b4880 2023-11-04T01:36:11.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.742+0000 7eff72d9d640 1 --2- 172.21.15.44:0/3232429959 >> v2:172.21.15.204:3300/0 conn(0x7eff74153e60 0x7eff7415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.743+0000 7eff7359e640 1 --2- 172.21.15.44:0/3232429959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff740b4880 0x7eff740b4cc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff7408abe0 tx=0x7eff6c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd73bf159e43722 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.743+0000 7eff71d9b640 1 -- 172.21.15.44:0/3232429959 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c030860 con 0x7eff740b4880 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.743+0000 7eff71d9b640 1 -- 172.21.15.44:0/3232429959 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c0309c0 con 0x7eff740b4880 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.743+0000 7eff71d9b640 1 -- 172.21.15.44:0/3232429959 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c030d50 con 0x7eff740b4880 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.744+0000 7eff7907c640 1 -- 172.21.15.44:0/3232429959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff740b4880 msgr2=0x7eff740b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.744+0000 7eff7907c640 1 --2- 172.21.15.44:0/3232429959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff740b4880 0x7eff740b4cc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff7408abe0 tx=0x7eff6c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.744+0000 7eff7907c640 1 -- 172.21.15.44:0/3232429959 shutdown_connections 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.744+0000 7eff7907c640 1 --2- 172.21.15.44:0/3232429959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff740b4880 0x7eff740b4cc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.744+0000 7eff7907c640 1 --2- 172.21.15.44:0/3232429959 >> v2:172.21.15.204:3300/0 conn(0x7eff74153e60 0x7eff7415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.744+0000 7eff7907c640 1 -- 172.21.15.44:0/3232429959 >> 172.21.15.44:0/3232429959 conn(0x7eff740cf880 msgr2=0x7eff740cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.744+0000 7eff7907c640 1 -- 172.21.15.44:0/3232429959 shutdown_connections 2023-11-04T01:36:11.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.744+0000 7eff7907c640 1 -- 172.21.15.44:0/3232429959 wait complete. 2023-11-04T01:36:11.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.745+0000 7eff7907c640 1 Processor -- start 2023-11-04T01:36:11.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.745+0000 7eff7907c640 1 -- start start 2023-11-04T01:36:11.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.746+0000 7eff7907c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff740b4880 0x7eff74159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.746+0000 7eff7907c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff740cd6d0 0x7eff74142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.746+0000 7eff7907c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff74153e60 0x7eff74143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.746+0000 7eff7907c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff74159870 con 0x7eff740b4880 2023-11-04T01:36:11.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.746+0000 7eff7907c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff74158c60 con 0x7eff74153e60 2023-11-04T01:36:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.746+0000 7eff7907c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff74158f40 con 0x7eff740cd6d0 2023-11-04T01:36:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.746+0000 7eff72d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff740b4880 0x7eff74159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.746+0000 7eff72d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff740b4880 0x7eff74159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50366/0 (socket says 172.21.15.44:50366) 2023-11-04T01:36:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.746+0000 7eff72d9d640 1 -- 172.21.15.44:0/759856573 learned_addr learned my addr 172.21.15.44:0/759856573 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.746+0000 7eff7359e640 1 --2- 172.21.15.44:0/759856573 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff74153e60 0x7eff74143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.746+0000 7eff7259c640 1 --2- 172.21.15.44:0/759856573 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff740cd6d0 0x7eff74142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.747+0000 7eff72d9d640 1 -- 172.21.15.44:0/759856573 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff740cd6d0 msgr2=0x7eff74142fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.747+0000 7eff72d9d640 1 --2- 172.21.15.44:0/759856573 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff740cd6d0 0x7eff74142fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.747+0000 7eff72d9d640 1 -- 172.21.15.44:0/759856573 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff74153e60 msgr2=0x7eff74143520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.747+0000 7eff72d9d640 1 --2- 172.21.15.44:0/759856573 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff74153e60 0x7eff74143520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.747+0000 7eff72d9d640 1 -- 172.21.15.44:0/759856573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c0094d0 con 0x7eff740b4880 2023-11-04T01:36:11.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.747+0000 7eff72d9d640 1 --2- 172.21.15.44:0/759856573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff740b4880 0x7eff74159d00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7eff64007ef0 tx=0x7eff6400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.747+0000 7eff5b7fe640 1 -- 172.21.15.44:0/759856573 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64003b90 con 0x7eff740b4880 2023-11-04T01:36:11.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.747+0000 7eff5b7fe640 1 -- 172.21.15.44:0/759856573 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6400f040 con 0x7eff740b4880 2023-11-04T01:36:11.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.747+0000 7eff7907c640 1 -- 172.21.15.44:0/759856573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff74159220 con 0x7eff740b4880 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.747+0000 7eff5b7fe640 1 -- 172.21.15.44:0/759856573 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6400de80 con 0x7eff740b4880 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.747+0000 7eff7907c640 1 -- 172.21.15.44:0/759856573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff74153380 con 0x7eff740b4880 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.748+0000 7eff7907c640 1 -- 172.21.15.44:0/759856573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff740d2150 con 0x7eff740b4880 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.748+0000 7eff5b7fe640 1 -- 172.21.15.44:0/759856573 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff64004030 con 0x7eff740b4880 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.749+0000 7eff5b7fe640 1 --2- 172.21.15.44:0/759856573 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff6006ae70 0x7eff6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.749+0000 7eff5b7fe640 1 -- 172.21.15.44:0/759856573 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff64089ad0 con 0x7eff740b4880 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.749+0000 7eff7259c640 1 --2- 172.21.15.44:0/759856573 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff6006ae70 0x7eff6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.750+0000 7eff7259c640 1 --2- 172.21.15.44:0/759856573 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff6006ae70 0x7eff6006d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff741609c0 tx=0x7eff68009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.753+0000 7eff5b7fe640 1 -- 172.21.15.44:0/759856573 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7eff64054940 con 0x7eff740b4880 2023-11-04T01:36:11.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.940+0000 7eff7907c640 1 -- 172.21.15.44:0/759856573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7eff740d06e0 con 0x7eff740b4880 2023-11-04T01:36:11.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.940+0000 7eff5b7fe640 1 -- 172.21.15.44:0/759856573 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7eff6401a080 con 0x7eff740b4880 2023-11-04T01:36:11.943 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2023-11-04T01:36:11.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.942+0000 7eff7907c640 1 -- 172.21.15.44:0/759856573 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff6006ae70 msgr2=0x7eff6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.942+0000 7eff7907c640 1 --2- 172.21.15.44:0/759856573 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff6006ae70 0x7eff6006d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff741609c0 tx=0x7eff68009040 comp rx=0 tx=0).stop 2023-11-04T01:36:11.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.942+0000 7eff7907c640 1 -- 172.21.15.44:0/759856573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff740b4880 msgr2=0x7eff74159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.942+0000 7eff7907c640 1 --2- 172.21.15.44:0/759856573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff740b4880 0x7eff74159d00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7eff64007ef0 tx=0x7eff6400d4a0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.942+0000 7eff7907c640 1 -- 172.21.15.44:0/759856573 shutdown_connections 2023-11-04T01:36:11.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.942+0000 7eff7907c640 1 --2- 172.21.15.44:0/759856573 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff6006ae70 0x7eff6006d330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.942+0000 7eff7907c640 1 --2- 172.21.15.44:0/759856573 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff74153e60 0x7eff74143520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.942+0000 7eff7907c640 1 --2- 172.21.15.44:0/759856573 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff740cd6d0 0x7eff74142fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.942+0000 7eff7907c640 1 --2- 172.21.15.44:0/759856573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff740b4880 0x7eff74159d00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.942+0000 7eff7907c640 1 -- 172.21.15.44:0/759856573 >> 172.21.15.44:0/759856573 conn(0x7eff740cf880 msgr2=0x7eff740d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.942+0000 7eff7907c640 1 -- 172.21.15.44:0/759856573 shutdown_connections 2023-11-04T01:36:11.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:11.942+0000 7eff7907c640 1 -- 172.21.15.44:0/759856573 wait complete. 2023-11-04T01:36:11.956 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:36:11.956 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:11.971 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:12.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.115+0000 7f65fa32c640 1 Processor -- start 2023-11-04T01:36:12.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.115+0000 7f65fa32c640 1 -- start start 2023-11-04T01:36:12.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.116+0000 7f65fa32c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65f415ad80 0x7f65f406c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.116+0000 7f65fa32c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65f40c9e10 0x7f65f40b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.116+0000 7f65fa32c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f406cd00 con 0x7f65f40b42c0 2023-11-04T01:36:12.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.116+0000 7f65fa32c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f406cfa0 con 0x7f65f40c9e10 2023-11-04T01:36:12.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.116+0000 7f65fa32c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f406d280 con 0x7f65f415ad80 2023-11-04T01:36:12.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.116+0000 7f65f88c9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65f40c9e10 0x7f65f40b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.116+0000 7f65f88c9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65f40c9e10 0x7f65f40b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50376/0 (socket says 172.21.15.44:50376) 2023-11-04T01:36:12.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.116+0000 7f65f88c9640 1 -- 172.21.15.44:0/1063583723 learned_addr learned my addr 172.21.15.44:0/1063583723 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:12.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.116+0000 7f65f3fff640 1 --2- 172.21.15.44:0/1063583723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65f415ad80 0x7f65f406c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.116+0000 7f65f88c9640 1 -- 172.21.15.44:0/1063583723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65f415ad80 msgr2=0x7f65f406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:12.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.116+0000 7f65f88c9640 1 --2- 172.21.15.44:0/1063583723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65f415ad80 0x7f65f406c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.116+0000 7f65f88c9640 1 -- 172.21.15.44:0/1063583723 >> v1:172.21.15.204:6789/0 conn(0x7f65f40b42c0 legacy=0x7f65f40c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:12.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.116+0000 7f65f88c9640 1 -- 172.21.15.44:0/1063583723 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f406d560 con 0x7f65f40c9e10 2023-11-04T01:36:12.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.117+0000 7f65f88c9640 1 --2- 172.21.15.44:0/1063583723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f40c9e10 0x7f65f40b1a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65f40ae320 tx=0x7f65ec02bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedd9919716a1506 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.117+0000 7f65f2ffd640 1 -- 172.21.15.44:0/1063583723 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec02cac0 con 0x7f65f40c9e10 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.117+0000 7f65f2ffd640 1 -- 172.21.15.44:0/1063583723 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec02cc20 con 0x7f65f40c9e10 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.117+0000 7f65f2ffd640 1 -- 172.21.15.44:0/1063583723 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec0343f0 con 0x7f65f40c9e10 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.118+0000 7f65fa32c640 1 -- 172.21.15.44:0/1063583723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f40c9e10 msgr2=0x7f65f40b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.118+0000 7f65fa32c640 1 --2- 172.21.15.44:0/1063583723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f40c9e10 0x7f65f40b1a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65f40ae320 tx=0x7f65ec02bf20 comp rx=0 tx=0).stop 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.118+0000 7f65fa32c640 1 -- 172.21.15.44:0/1063583723 shutdown_connections 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.118+0000 7f65fa32c640 1 --2- 172.21.15.44:0/1063583723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f40c9e10 0x7f65f40b1a40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.118+0000 7f65fa32c640 1 --2- 172.21.15.44:0/1063583723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65f415ad80 0x7f65f406c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.118+0000 7f65fa32c640 1 -- 172.21.15.44:0/1063583723 >> 172.21.15.44:0/1063583723 conn(0x7f65f40ce950 msgr2=0x7f65f40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.118+0000 7f65fa32c640 1 -- 172.21.15.44:0/1063583723 shutdown_connections 2023-11-04T01:36:12.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.118+0000 7f65fa32c640 1 -- 172.21.15.44:0/1063583723 wait complete. 2023-11-04T01:36:12.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.119+0000 7f65fa32c640 1 Processor -- start 2023-11-04T01:36:12.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.119+0000 7f65fa32c640 1 -- start start 2023-11-04T01:36:12.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65fa32c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65f40b42c0 0x7f65f415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65fa32c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f40c9e10 0x7f65f40c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65fa32c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65f415ad80 0x7f65f41594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65fa32c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f40c5a30 con 0x7f65f40c9e10 2023-11-04T01:36:12.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65fa32c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f40c5d10 con 0x7f65f415ad80 2023-11-04T01:36:12.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65fa32c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f40c5ff0 con 0x7f65f40b42c0 2023-11-04T01:36:12.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65f37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f40c9e10 0x7f65f40c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65f37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f40c9e10 0x7f65f40c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50384/0 (socket says 172.21.15.44:50384) 2023-11-04T01:36:12.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65f37fe640 1 -- 172.21.15.44:0/860106947 learned_addr learned my addr 172.21.15.44:0/860106947 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:12.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65f88c9640 1 --2- 172.21.15.44:0/860106947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65f415ad80 0x7f65f41594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65f3fff640 1 --2- 172.21.15.44:0/860106947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65f40b42c0 0x7f65f415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65f37fe640 1 -- 172.21.15.44:0/860106947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65f40b42c0 msgr2=0x7f65f415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65f37fe640 1 --2- 172.21.15.44:0/860106947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65f40b42c0 0x7f65f415dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65f37fe640 1 -- 172.21.15.44:0/860106947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65f415ad80 msgr2=0x7f65f41594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65f37fe640 1 --2- 172.21.15.44:0/860106947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65f415ad80 0x7f65f41594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65f37fe640 1 -- 172.21.15.44:0/860106947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec009b30 con 0x7f65f40c9e10 2023-11-04T01:36:12.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65f37fe640 1 --2- 172.21.15.44:0/860106947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f40c9e10 0x7f65f40c8220 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f65e400b3f0 tx=0x7f65e400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.120+0000 7f65f0ff9640 1 -- 172.21.15.44:0/860106947 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4011830 con 0x7f65f40c9e10 2023-11-04T01:36:12.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.121+0000 7f65f0ff9640 1 -- 172.21.15.44:0/860106947 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e4011990 con 0x7f65f40c9e10 2023-11-04T01:36:12.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.121+0000 7f65fa32c640 1 -- 172.21.15.44:0/860106947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f40c62d0 con 0x7f65f40c9e10 2023-11-04T01:36:12.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.121+0000 7f65f0ff9640 1 -- 172.21.15.44:0/860106947 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4011d40 con 0x7f65f40c9e10 2023-11-04T01:36:12.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.121+0000 7f65fa32c640 1 -- 172.21.15.44:0/860106947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f40c8760 con 0x7f65f40c9e10 2023-11-04T01:36:12.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.122+0000 7f65fa32c640 1 -- 172.21.15.44:0/860106947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f40c67f0 con 0x7f65f40c9e10 2023-11-04T01:36:12.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.122+0000 7f65f0ff9640 1 -- 172.21.15.44:0/860106947 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f65e401a400 con 0x7f65f40c9e10 2023-11-04T01:36:12.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.122+0000 7f65f0ff9640 1 --2- 172.21.15.44:0/860106947 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65e006ae70 0x7f65e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.123+0000 7f65f0ff9640 1 -- 172.21.15.44:0/860106947 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f65e4089a70 con 0x7f65f40c9e10 2023-11-04T01:36:12.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.123+0000 7f65f3fff640 1 --2- 172.21.15.44:0/860106947 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65e006ae70 0x7f65e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.123+0000 7f65f3fff640 1 --2- 172.21.15.44:0/860106947 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65e006ae70 0x7f65e006d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f65e8006fd0 tx=0x7f65e8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.127+0000 7f65f0ff9640 1 -- 172.21.15.44:0/860106947 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f65f40c67f0 con 0x7f65f40c9e10 2023-11-04T01:36:12.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.306+0000 7f65fa32c640 1 -- 172.21.15.44:0/860106947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65f40c67f0 con 0x7f65f40c9e10 2023-11-04T01:36:12.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.308+0000 7f65f0ff9640 1 -- 172.21.15.44:0/860106947 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f65f40c67f0 con 0x7f65f40c9e10 2023-11-04T01:36:12.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:12.311 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:03.589395+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:12.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.310+0000 7f65fa32c640 1 -- 172.21.15.44:0/860106947 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65e006ae70 msgr2=0x7f65e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.310+0000 7f65fa32c640 1 --2- 172.21.15.44:0/860106947 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65e006ae70 0x7f65e006d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f65e8006fd0 tx=0x7f65e8008040 comp rx=0 tx=0).stop 2023-11-04T01:36:12.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.310+0000 7f65fa32c640 1 -- 172.21.15.44:0/860106947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f40c9e10 msgr2=0x7f65f40c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.310+0000 7f65fa32c640 1 --2- 172.21.15.44:0/860106947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f40c9e10 0x7f65f40c8220 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f65e400b3f0 tx=0x7f65e400b8b0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.310+0000 7f65fa32c640 1 -- 172.21.15.44:0/860106947 shutdown_connections 2023-11-04T01:36:12.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.310+0000 7f65fa32c640 1 --2- 172.21.15.44:0/860106947 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65e006ae70 0x7f65e006d330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.310+0000 7f65fa32c640 1 --2- 172.21.15.44:0/860106947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65f415ad80 0x7f65f41594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.310+0000 7f65fa32c640 1 --2- 172.21.15.44:0/860106947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f40c9e10 0x7f65f40c8220 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.310+0000 7f65fa32c640 1 --2- 172.21.15.44:0/860106947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65f40b42c0 0x7f65f415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.310+0000 7f65fa32c640 1 -- 172.21.15.44:0/860106947 >> 172.21.15.44:0/860106947 conn(0x7f65f40ce950 msgr2=0x7f65f40cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.310+0000 7f65fa32c640 1 -- 172.21.15.44:0/860106947 shutdown_connections 2023-11-04T01:36:12.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.310+0000 7f65fa32c640 1 -- 172.21.15.44:0/860106947 wait complete. 2023-11-04T01:36:12.323 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:12.323 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:12.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.430+0000 7ff709f68640 1 Processor -- start 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.430+0000 7ff709f68640 1 -- start start 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.431+0000 7ff709f68640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff70415af20 0x7ff7040b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.431+0000 7ff709f68640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff7040cd3b0 0x7ff7040cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.431+0000 7ff709f68640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7040cdd40 con 0x7ff7040b64c0 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.431+0000 7ff709f68640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7040cc380 con 0x7ff70415af20 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.431+0000 7ff709f68640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7040d01f0 con 0x7ff7040cd3b0 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.431+0000 7ff7037fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff70415af20 0x7ff7040b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.431+0000 7ff7037fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff70415af20 0x7ff7040b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50388/0 (socket says 172.21.15.44:50388) 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.431+0000 7ff702ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff7040b64c0 0x7ff7040cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57776/0 (socket says 172.21.15.44:57776) 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.431+0000 7ff7037fe640 1 -- 172.21.15.44:0/1586542993 learned_addr learned my addr 172.21.15.44:0/1586542993 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.432+0000 7ff703fff640 1 --2- 172.21.15.44:0/1586542993 >> v2:172.21.15.204:3300/0 conn(0x7ff7040cd3b0 0x7ff7040cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.432+0000 7ff7037fe640 1 -- 172.21.15.44:0/1586542993 >> v2:172.21.15.204:3300/0 conn(0x7ff7040cd3b0 msgr2=0x7ff7040cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.432+0000 7ff7037fe640 1 --2- 172.21.15.44:0/1586542993 >> v2:172.21.15.204:3300/0 conn(0x7ff7040cd3b0 0x7ff7040cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.432+0000 7ff7037fe640 1 -- 172.21.15.44:0/1586542993 >> v1:172.21.15.44:6789/0 conn(0x7ff7040b64c0 legacy=0x7ff7040cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.432+0000 7ff7027fc640 1 -- 172.21.15.44:0/1586542993 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729731574 0 0) 0x7ff7040cdd40 con 0x7ff7040b64c0 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.432+0000 7ff7037fe640 1 -- 172.21.15.44:0/1586542993 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7040b6a40 con 0x7ff70415af20 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.432+0000 7ff7037fe640 1 --2- 172.21.15.44:0/1586542993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff70415af20 0x7ff7040b3cd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff7040b6950 tx=0x7ff6f402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b7521860009d89 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.433+0000 7ff7027fc640 1 -- 172.21.15.44:0/1586542993 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4030860 con 0x7ff70415af20 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.433+0000 7ff7027fc640 1 -- 172.21.15.44:0/1586542993 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f40309c0 con 0x7ff70415af20 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.433+0000 7ff7027fc640 1 -- 172.21.15.44:0/1586542993 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4030d50 con 0x7ff70415af20 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.433+0000 7ff709f68640 1 -- 172.21.15.44:0/1586542993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff70415af20 msgr2=0x7ff7040b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.433+0000 7ff709f68640 1 --2- 172.21.15.44:0/1586542993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff70415af20 0x7ff7040b3cd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff7040b6950 tx=0x7ff6f402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.433+0000 7ff709f68640 1 -- 172.21.15.44:0/1586542993 shutdown_connections 2023-11-04T01:36:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.433+0000 7ff709f68640 1 --2- 172.21.15.44:0/1586542993 >> v2:172.21.15.204:3300/0 conn(0x7ff7040cd3b0 0x7ff7040cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.433+0000 7ff709f68640 1 --2- 172.21.15.44:0/1586542993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff70415af20 0x7ff7040b3cd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.433+0000 7ff709f68640 1 -- 172.21.15.44:0/1586542993 >> 172.21.15.44:0/1586542993 conn(0x7ff70406ea20 msgr2=0x7ff70406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.433+0000 7ff709f68640 1 -- 172.21.15.44:0/1586542993 shutdown_connections 2023-11-04T01:36:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.433+0000 7ff709f68640 1 -- 172.21.15.44:0/1586542993 wait complete. 2023-11-04T01:36:12.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.434+0000 7ff709f68640 1 Processor -- start 2023-11-04T01:36:12.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.435+0000 7ff709f68640 1 -- start start 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.435+0000 7ff709f68640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7040b64c0 0x7ff7041e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.435+0000 7ff709f68640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7040cd3b0 0x7ff70414c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.435+0000 7ff709f68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff70415af20 0x7ff7040b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.435+0000 7ff709f68640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70414f4c0 con 0x7ff70415af20 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.435+0000 7ff709f68640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7041e57b0 con 0x7ff7040cd3b0 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.435+0000 7ff709f68640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7041e4580 con 0x7ff7040b64c0 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff703fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff70415af20 0x7ff7040b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff703fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff70415af20 0x7ff7040b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50402/0 (socket says 172.21.15.44:50402) 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff703fff640 1 -- 172.21.15.44:0/1913035785 learned_addr learned my addr 172.21.15.44:0/1913035785 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff7037fe640 1 --2- 172.21.15.44:0/1913035785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7040b64c0 0x7ff7041e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff702ffd640 1 --2- 172.21.15.44:0/1913035785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7040cd3b0 0x7ff70414c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff703fff640 1 -- 172.21.15.44:0/1913035785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7040b64c0 msgr2=0x7ff7041e3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff703fff640 1 --2- 172.21.15.44:0/1913035785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7040b64c0 0x7ff7041e3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff703fff640 1 -- 172.21.15.44:0/1913035785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7040cd3b0 msgr2=0x7ff70414c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff703fff640 1 --2- 172.21.15.44:0/1913035785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7040cd3b0 0x7ff70414c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff703fff640 1 -- 172.21.15.44:0/1913035785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f40094d0 con 0x7ff70415af20 2023-11-04T01:36:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff7037fe640 1 --2- 172.21.15.44:0/1913035785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7040b64c0 0x7ff7041e3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff703fff640 1 --2- 172.21.15.44:0/1913035785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff70415af20 0x7ff7040b0600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00efc0 tx=0x7ff6fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff6ebfff640 1 -- 172.21.15.44:0/1913035785 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc014480 con 0x7ff70415af20 2023-11-04T01:36:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff6ebfff640 1 -- 172.21.15.44:0/1913035785 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc00f040 con 0x7ff70415af20 2023-11-04T01:36:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff709f68640 1 -- 172.21.15.44:0/1913035785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7040b0b40 con 0x7ff70415af20 2023-11-04T01:36:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff6ebfff640 1 -- 172.21.15.44:0/1913035785 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc014820 con 0x7ff70415af20 2023-11-04T01:36:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.436+0000 7ff709f68640 1 -- 172.21.15.44:0/1913035785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7041e54d0 con 0x7ff70415af20 2023-11-04T01:36:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.437+0000 7ff709f68640 1 -- 172.21.15.44:0/1913035785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70414f630 con 0x7ff70415af20 2023-11-04T01:36:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.438+0000 7ff6ebfff640 1 -- 172.21.15.44:0/1913035785 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6fc014980 con 0x7ff70415af20 2023-11-04T01:36:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.438+0000 7ff6ebfff640 1 --2- 172.21.15.44:0/1913035785 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6f006ae70 0x7ff6f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.438+0000 7ff6ebfff640 1 -- 172.21.15.44:0/1913035785 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff6fc08a750 con 0x7ff70415af20 2023-11-04T01:36:12.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.438+0000 7ff7037fe640 1 --2- 172.21.15.44:0/1913035785 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6f006ae70 0x7ff6f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.439+0000 7ff7037fe640 1 --2- 172.21.15.44:0/1913035785 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6f006ae70 0x7ff6f006d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4036000 tx=0x7ff6f403b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.442+0000 7ff6ebfff640 1 -- 172.21.15.44:0/1913035785 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff70414f630 con 0x7ff70415af20 2023-11-04T01:36:12.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.620+0000 7ff709f68640 1 -- 172.21.15.44:0/1913035785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff70414f600 con 0x7ff70415af20 2023-11-04T01:36:12.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.620+0000 7ff6ebfff640 1 -- 172.21.15.44:0/1913035785 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6fc018020 con 0x7ff70415af20 2023-11-04T01:36:12.623 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:36:12.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.622+0000 7ff709f68640 1 -- 172.21.15.44:0/1913035785 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6f006ae70 msgr2=0x7ff6f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.622+0000 7ff709f68640 1 --2- 172.21.15.44:0/1913035785 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6f006ae70 0x7ff6f006d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4036000 tx=0x7ff6f403b040 comp rx=0 tx=0).stop 2023-11-04T01:36:12.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.622+0000 7ff709f68640 1 -- 172.21.15.44:0/1913035785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff70415af20 msgr2=0x7ff7040b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.622+0000 7ff709f68640 1 --2- 172.21.15.44:0/1913035785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff70415af20 0x7ff7040b0600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00efc0 tx=0x7ff6fc00c490 comp rx=0 tx=0).stop 2023-11-04T01:36:12.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.622+0000 7ff709f68640 1 -- 172.21.15.44:0/1913035785 shutdown_connections 2023-11-04T01:36:12.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.623+0000 7ff709f68640 1 --2- 172.21.15.44:0/1913035785 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6f006ae70 0x7ff6f006d330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.623+0000 7ff709f68640 1 --2- 172.21.15.44:0/1913035785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff70415af20 0x7ff7040b0600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.623+0000 7ff709f68640 1 --2- 172.21.15.44:0/1913035785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7040cd3b0 0x7ff70414c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.623+0000 7ff709f68640 1 --2- 172.21.15.44:0/1913035785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7040b64c0 0x7ff7041e3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.623+0000 7ff709f68640 1 -- 172.21.15.44:0/1913035785 >> 172.21.15.44:0/1913035785 conn(0x7ff70406ea20 msgr2=0x7ff70415a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.623+0000 7ff709f68640 1 -- 172.21.15.44:0/1913035785 shutdown_connections 2023-11-04T01:36:12.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.623+0000 7ff709f68640 1 -- 172.21.15.44:0/1913035785 wait complete. 2023-11-04T01:36:12.636 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:12.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.743+0000 7fbf61275640 1 Processor -- start 2023-11-04T01:36:12.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.743+0000 7fbf61275640 1 -- start start 2023-11-04T01:36:12.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.744+0000 7fbf61275640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf5c070e20 0x7fbf5c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.744+0000 7fbf61275640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbf5c0ad730 0x7fbf5c15e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.744+0000 7fbf61275640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5c0c3900 con 0x7fbf5c15ad30 2023-11-04T01:36:12.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.744+0000 7fbf61275640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf5c0ae260 con 0x7fbf5c0ad730 2023-11-04T01:36:12.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.744+0000 7fbf61275640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0c3be0 con 0x7fbf5c070e20 2023-11-04T01:36:12.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.744+0000 7fbf5a7fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf5c070e20 0x7fbf5c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.744+0000 7fbf5a7fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf5c070e20 0x7fbf5c0adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:60046/0 (socket says 172.21.15.44:60046) 2023-11-04T01:36:12.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.744+0000 7fbf5b7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbf5c0ad730 0x7fbf5c15e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.744+0000 7fbf5a7fc640 1 -- 172.21.15.44:0/3177057653 learned_addr learned my addr 172.21.15.44:0/3177057653 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.745+0000 7fbf5a7fc640 1 -- 172.21.15.44:0/3177057653 >> v2:172.21.15.204:3300/0 conn(0x7fbf5c0ad730 msgr2=0x7fbf5c15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.745+0000 7fbf5a7fc640 1 --2- 172.21.15.44:0/3177057653 >> v2:172.21.15.204:3300/0 conn(0x7fbf5c0ad730 0x7fbf5c15e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.745+0000 7fbf5a7fc640 1 -- 172.21.15.44:0/3177057653 >> v1:172.21.15.204:6789/0 conn(0x7fbf5c15ad30 legacy=0x7fbf5c070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.745+0000 7fbf5a7fc640 1 -- 172.21.15.44:0/3177057653 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c0c3ec0 con 0x7fbf5c070e20 2023-11-04T01:36:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.745+0000 7fbf5a7fc640 1 --2- 172.21.15.44:0/3177057653 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf5c070e20 0x7fbf5c0adc80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009870 tx=0x7fbf5002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e91615692d5aac93 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.746+0000 7fbf59ffb640 1 -- 172.21.15.44:0/3177057653 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50031640 con 0x7fbf5c070e20 2023-11-04T01:36:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.746+0000 7fbf59ffb640 1 -- 172.21.15.44:0/3177057653 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf500317a0 con 0x7fbf5c070e20 2023-11-04T01:36:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.746+0000 7fbf59ffb640 1 -- 172.21.15.44:0/3177057653 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50031b30 con 0x7fbf5c070e20 2023-11-04T01:36:12.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.746+0000 7fbf61275640 1 -- 172.21.15.44:0/3177057653 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf5c070e20 msgr2=0x7fbf5c0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.746+0000 7fbf61275640 1 --2- 172.21.15.44:0/3177057653 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf5c070e20 0x7fbf5c0adc80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009870 tx=0x7fbf5002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.746+0000 7fbf61275640 1 -- 172.21.15.44:0/3177057653 shutdown_connections 2023-11-04T01:36:12.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.746+0000 7fbf61275640 1 --2- 172.21.15.44:0/3177057653 >> v2:172.21.15.204:3300/0 conn(0x7fbf5c0ad730 0x7fbf5c15e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.746+0000 7fbf61275640 1 --2- 172.21.15.44:0/3177057653 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf5c070e20 0x7fbf5c0adc80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.746+0000 7fbf61275640 1 -- 172.21.15.44:0/3177057653 >> 172.21.15.44:0/3177057653 conn(0x7fbf5c0ce950 msgr2=0x7fbf5c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.746+0000 7fbf61275640 1 -- 172.21.15.44:0/3177057653 shutdown_connections 2023-11-04T01:36:12.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.746+0000 7fbf61275640 1 -- 172.21.15.44:0/3177057653 wait complete. 2023-11-04T01:36:12.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.748+0000 7fbf61275640 1 Processor -- start 2023-11-04T01:36:12.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.748+0000 7fbf61275640 1 -- start start 2023-11-04T01:36:12.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.748+0000 7fbf61275640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf5c070e20 0x7fbf5c1542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.748+0000 7fbf61275640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf5c0ad730 0x7fbf5c15cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.748+0000 7fbf61275640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf5c15ad30 0x7fbf5c15d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.748+0000 7fbf61275640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0b12b0 con 0x7fbf5c070e20 2023-11-04T01:36:12.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.748+0000 7fbf61275640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0b14c0 con 0x7fbf5c15ad30 2023-11-04T01:36:12.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.748+0000 7fbf61275640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0b17a0 con 0x7fbf5c0ad730 2023-11-04T01:36:12.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.748+0000 7fbf5affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf5c070e20 0x7fbf5c1542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.748+0000 7fbf5affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf5c070e20 0x7fbf5c1542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48622/0 (socket says 172.21.15.44:48622) 2023-11-04T01:36:12.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.748+0000 7fbf5affd640 1 -- 172.21.15.44:0/340654210 learned_addr learned my addr 172.21.15.44:0/340654210 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:12.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.749+0000 7fbf5a7fc640 1 --2- 172.21.15.44:0/340654210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf5c0ad730 0x7fbf5c15cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.749+0000 7fbf5b7fe640 1 --2- 172.21.15.44:0/340654210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf5c15ad30 0x7fbf5c15d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.749+0000 7fbf5affd640 1 -- 172.21.15.44:0/340654210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf5c0ad730 msgr2=0x7fbf5c15cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.749+0000 7fbf5affd640 1 --2- 172.21.15.44:0/340654210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf5c0ad730 0x7fbf5c15cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.749+0000 7fbf5affd640 1 -- 172.21.15.44:0/340654210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf5c15ad30 msgr2=0x7fbf5c15d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.749+0000 7fbf5affd640 1 --2- 172.21.15.44:0/340654210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf5c15ad30 0x7fbf5c15d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.749+0000 7fbf5affd640 1 -- 172.21.15.44:0/340654210 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf500094d0 con 0x7fbf5c070e20 2023-11-04T01:36:12.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.749+0000 7fbf5affd640 1 --2- 172.21.15.44:0/340654210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf5c070e20 0x7fbf5c1542f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400c400 tx=0x7fbf5400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.749+0000 7fbf437fe640 1 -- 172.21.15.44:0/340654210 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf540052d0 con 0x7fbf5c070e20 2023-11-04T01:36:12.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.749+0000 7fbf437fe640 1 -- 172.21.15.44:0/340654210 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf54005430 con 0x7fbf5c070e20 2023-11-04T01:36:12.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.749+0000 7fbf61275640 1 -- 172.21.15.44:0/340654210 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5c0b1a80 con 0x7fbf5c070e20 2023-11-04T01:36:12.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.749+0000 7fbf437fe640 1 -- 172.21.15.44:0/340654210 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54003830 con 0x7fbf5c070e20 2023-11-04T01:36:12.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.749+0000 7fbf61275640 1 -- 172.21.15.44:0/340654210 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5c0b2040 con 0x7fbf5c070e20 2023-11-04T01:36:12.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.750+0000 7fbf61275640 1 -- 172.21.15.44:0/340654210 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5c0b2230 con 0x7fbf5c070e20 2023-11-04T01:36:12.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.751+0000 7fbf437fe640 1 -- 172.21.15.44:0/340654210 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf54003990 con 0x7fbf5c070e20 2023-11-04T01:36:12.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.751+0000 7fbf437fe640 1 --2- 172.21.15.44:0/340654210 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf4806ae70 0x7fbf4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.751+0000 7fbf437fe640 1 -- 172.21.15.44:0/340654210 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbf54088df0 con 0x7fbf5c070e20 2023-11-04T01:36:12.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.751+0000 7fbf5a7fc640 1 --2- 172.21.15.44:0/340654210 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf4806ae70 0x7fbf4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.752+0000 7fbf5a7fc640 1 --2- 172.21.15.44:0/340654210 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf4806ae70 0x7fbf4806d330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbf50036000 tx=0x7fbf5003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.755+0000 7fbf437fe640 1 -- 172.21.15.44:0/340654210 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbf54053c40 con 0x7fbf5c070e20 2023-11-04T01:36:12.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.930+0000 7fbf61275640 1 -- 172.21.15.44:0/340654210 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf5c074290 con 0x7fbf5c070e20 2023-11-04T01:36:12.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.930+0000 7fbf437fe640 1 -- 172.21.15.44:0/340654210 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf54017020 con 0x7fbf5c070e20 2023-11-04T01:36:12.932 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:12.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.932+0000 7fbf61275640 1 -- 172.21.15.44:0/340654210 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf4806ae70 msgr2=0x7fbf4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.932+0000 7fbf61275640 1 --2- 172.21.15.44:0/340654210 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf4806ae70 0x7fbf4806d330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbf50036000 tx=0x7fbf5003c040 comp rx=0 tx=0).stop 2023-11-04T01:36:12.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.932+0000 7fbf61275640 1 -- 172.21.15.44:0/340654210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf5c070e20 msgr2=0x7fbf5c1542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.932+0000 7fbf61275640 1 --2- 172.21.15.44:0/340654210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf5c070e20 0x7fbf5c1542f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400c400 tx=0x7fbf5400c8c0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.932+0000 7fbf61275640 1 -- 172.21.15.44:0/340654210 shutdown_connections 2023-11-04T01:36:12.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.932+0000 7fbf61275640 1 --2- 172.21.15.44:0/340654210 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf4806ae70 0x7fbf4806d330 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.932+0000 7fbf61275640 1 --2- 172.21.15.44:0/340654210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf5c15ad30 0x7fbf5c15d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.932+0000 7fbf61275640 1 --2- 172.21.15.44:0/340654210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf5c0ad730 0x7fbf5c15cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.932+0000 7fbf61275640 1 --2- 172.21.15.44:0/340654210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf5c070e20 0x7fbf5c1542f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.932+0000 7fbf61275640 1 -- 172.21.15.44:0/340654210 >> 172.21.15.44:0/340654210 conn(0x7fbf5c0ce950 msgr2=0x7fbf5c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.932+0000 7fbf61275640 1 -- 172.21.15.44:0/340654210 shutdown_connections 2023-11-04T01:36:12.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:12.932+0000 7fbf61275640 1 -- 172.21.15.44:0/340654210 wait complete. 2023-11-04T01:36:12.945 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:13.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.051+0000 7fcb87da5640 1 Processor -- start 2023-11-04T01:36:13.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.052+0000 7fcb87da5640 1 -- start start 2023-11-04T01:36:13.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.052+0000 7fcb87da5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcb8015d060 0x7fcb800b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.052+0000 7fcb87da5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcb800b7160 0x7fcb800cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.052+0000 7fcb87da5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb800ce4c0 con 0x7fcb800cdb20 2023-11-04T01:36:13.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.052+0000 7fcb87da5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8015d440 con 0x7fcb800b7160 2023-11-04T01:36:13.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.052+0000 7fcb87da5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb800d1930 con 0x7fcb8015d060 2023-11-04T01:36:13.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.052+0000 7fcb86342640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcb800b7160 0x7fcb800cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.053+0000 7fcb86342640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcb800b7160 0x7fcb800cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48626/0 (socket says 172.21.15.44:48626) 2023-11-04T01:36:13.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.053+0000 7fcb86342640 1 -- 172.21.15.44:0/4220163106 learned_addr learned my addr 172.21.15.44:0/4220163106 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:13.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.053+0000 7fcb85b41640 1 --2- 172.21.15.44:0/4220163106 >> v2:172.21.15.204:3300/0 conn(0x7fcb8015d060 0x7fcb800b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.053+0000 7fcb86342640 1 -- 172.21.15.44:0/4220163106 >> v2:172.21.15.204:3300/0 conn(0x7fcb8015d060 msgr2=0x7fcb800b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:13.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.053+0000 7fcb86342640 1 --2- 172.21.15.44:0/4220163106 >> v2:172.21.15.204:3300/0 conn(0x7fcb8015d060 0x7fcb800b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.053+0000 7fcb86342640 1 -- 172.21.15.44:0/4220163106 >> v1:172.21.15.204:6789/0 conn(0x7fcb800cdb20 legacy=0x7fcb8006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:13.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.053+0000 7fcb86342640 1 -- 172.21.15.44:0/4220163106 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb800d0d20 con 0x7fcb800b7160 2023-11-04T01:36:13.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.054+0000 7fcb86342640 1 --2- 172.21.15.44:0/4220163106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb800b7160 0x7fcb800cdf80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcb8008bda0 tx=0x7fcb7802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b4261737948253 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.054+0000 7fcb84b3f640 1 -- 172.21.15.44:0/4220163106 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7802ca80 con 0x7fcb800b7160 2023-11-04T01:36:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.054+0000 7fcb84b3f640 1 -- 172.21.15.44:0/4220163106 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7802cbe0 con 0x7fcb800b7160 2023-11-04T01:36:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.054+0000 7fcb84b3f640 1 -- 172.21.15.44:0/4220163106 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb780343f0 con 0x7fcb800b7160 2023-11-04T01:36:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.054+0000 7fcb87da5640 1 -- 172.21.15.44:0/4220163106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb800b7160 msgr2=0x7fcb800cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.054+0000 7fcb87da5640 1 --2- 172.21.15.44:0/4220163106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb800b7160 0x7fcb800cdf80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcb8008bda0 tx=0x7fcb7802bee0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.054+0000 7fcb87da5640 1 -- 172.21.15.44:0/4220163106 shutdown_connections 2023-11-04T01:36:13.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.054+0000 7fcb87da5640 1 --2- 172.21.15.44:0/4220163106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb800b7160 0x7fcb800cdf80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.054+0000 7fcb87da5640 1 --2- 172.21.15.44:0/4220163106 >> v2:172.21.15.204:3300/0 conn(0x7fcb8015d060 0x7fcb800b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.054+0000 7fcb87da5640 1 -- 172.21.15.44:0/4220163106 >> 172.21.15.44:0/4220163106 conn(0x7fcb800cf760 msgr2=0x7fcb800cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.054+0000 7fcb87da5640 1 -- 172.21.15.44:0/4220163106 shutdown_connections 2023-11-04T01:36:13.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.054+0000 7fcb87da5640 1 -- 172.21.15.44:0/4220163106 wait complete. 2023-11-04T01:36:13.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.056+0000 7fcb87da5640 1 Processor -- start 2023-11-04T01:36:13.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.056+0000 7fcb87da5640 1 -- start start 2023-11-04T01:36:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.056+0000 7fcb87da5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb800b7160 0x7fcb80157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.056+0000 7fcb87da5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb800cdb20 0x7fcb800a9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.056+0000 7fcb87da5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb8015d060 0x7fcb800a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.056+0000 7fcb87da5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8015e7d0 con 0x7fcb8015d060 2023-11-04T01:36:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.056+0000 7fcb87da5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800b4030 con 0x7fcb800b7160 2023-11-04T01:36:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.056+0000 7fcb87da5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8015db70 con 0x7fcb800cdb20 2023-11-04T01:36:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.056+0000 7fcb86342640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb8015d060 0x7fcb800a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.056+0000 7fcb86342640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb8015d060 0x7fcb800a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48636/0 (socket says 172.21.15.44:48636) 2023-11-04T01:36:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.056+0000 7fcb86342640 1 -- 172.21.15.44:0/4054671752 learned_addr learned my addr 172.21.15.44:0/4054671752 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:13.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.057+0000 7fcb85b41640 1 --2- 172.21.15.44:0/4054671752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb800b7160 0x7fcb80157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.057+0000 7fcb85340640 1 --2- 172.21.15.44:0/4054671752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb800cdb20 0x7fcb800a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.057+0000 7fcb86342640 1 -- 172.21.15.44:0/4054671752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb800cdb20 msgr2=0x7fcb800a9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.057+0000 7fcb86342640 1 --2- 172.21.15.44:0/4054671752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb800cdb20 0x7fcb800a9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.057+0000 7fcb86342640 1 -- 172.21.15.44:0/4054671752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb800b7160 msgr2=0x7fcb80157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.057+0000 7fcb86342640 1 --2- 172.21.15.44:0/4054671752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb800b7160 0x7fcb80157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.057+0000 7fcb86342640 1 -- 172.21.15.44:0/4054671752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb78009b30 con 0x7fcb8015d060 2023-11-04T01:36:13.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.057+0000 7fcb86342640 1 --2- 172.21.15.44:0/4054671752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb8015d060 0x7fcb800a9b60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcb78036040 tx=0x7fcb78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.057+0000 7fcb767fc640 1 -- 172.21.15.44:0/4054671752 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb78009510 con 0x7fcb8015d060 2023-11-04T01:36:13.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.057+0000 7fcb767fc640 1 -- 172.21.15.44:0/4054671752 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7803e450 con 0x7fcb8015d060 2023-11-04T01:36:13.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.057+0000 7fcb87da5640 1 -- 172.21.15.44:0/4054671752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8015de30 con 0x7fcb8015d060 2023-11-04T01:36:13.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.057+0000 7fcb767fc640 1 -- 172.21.15.44:0/4054671752 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7803e7e0 con 0x7fcb8015d060 2023-11-04T01:36:13.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.057+0000 7fcb87da5640 1 -- 172.21.15.44:0/4054671752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8015e3f0 con 0x7fcb8015d060 2023-11-04T01:36:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.058+0000 7fcb87da5640 1 -- 172.21.15.44:0/4054671752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8015e910 con 0x7fcb8015d060 2023-11-04T01:36:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.058+0000 7fcb767fc640 1 -- 172.21.15.44:0/4054671752 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb7802cd50 con 0x7fcb8015d060 2023-11-04T01:36:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.059+0000 7fcb767fc640 1 --2- 172.21.15.44:0/4054671752 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcb6406ae70 0x7fcb6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.059+0000 7fcb767fc640 1 -- 172.21.15.44:0/4054671752 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcb780ac700 con 0x7fcb8015d060 2023-11-04T01:36:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.059+0000 7fcb85b41640 1 --2- 172.21.15.44:0/4054671752 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcb6406ae70 0x7fcb6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.060+0000 7fcb85b41640 1 --2- 172.21.15.44:0/4054671752 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcb6406ae70 0x7fcb6406d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c006fd0 tx=0x7fcb7c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.063+0000 7fcb767fc640 1 -- 172.21.15.44:0/4054671752 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcb78077550 con 0x7fcb8015d060 2023-11-04T01:36:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.240+0000 7fcb87da5640 1 -- 172.21.15.44:0/4054671752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb80074290 con 0x7fcb8015d060 2023-11-04T01:36:13.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.241+0000 7fcb767fc640 1 -- 172.21.15.44:0/4054671752 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb7807ab70 con 0x7fcb8015d060 2023-11-04T01:36:13.243 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:36:13.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.243+0000 7fcb87da5640 1 -- 172.21.15.44:0/4054671752 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcb6406ae70 msgr2=0x7fcb6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.243+0000 7fcb87da5640 1 --2- 172.21.15.44:0/4054671752 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcb6406ae70 0x7fcb6406d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c006fd0 tx=0x7fcb7c008040 comp rx=0 tx=0).stop 2023-11-04T01:36:13.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.243+0000 7fcb87da5640 1 -- 172.21.15.44:0/4054671752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb8015d060 msgr2=0x7fcb800a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.243+0000 7fcb87da5640 1 --2- 172.21.15.44:0/4054671752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb8015d060 0x7fcb800a9b60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcb78036040 tx=0x7fcb78004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:13.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.243+0000 7fcb87da5640 1 -- 172.21.15.44:0/4054671752 shutdown_connections 2023-11-04T01:36:13.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.243+0000 7fcb87da5640 1 --2- 172.21.15.44:0/4054671752 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcb6406ae70 0x7fcb6406d330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.243+0000 7fcb87da5640 1 --2- 172.21.15.44:0/4054671752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb8015d060 0x7fcb800a9b60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.243+0000 7fcb87da5640 1 --2- 172.21.15.44:0/4054671752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb800cdb20 0x7fcb800a9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.243+0000 7fcb87da5640 1 --2- 172.21.15.44:0/4054671752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb800b7160 0x7fcb80157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.243+0000 7fcb87da5640 1 -- 172.21.15.44:0/4054671752 >> 172.21.15.44:0/4054671752 conn(0x7fcb800cf760 msgr2=0x7fcb8006b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.243+0000 7fcb87da5640 1 -- 172.21.15.44:0/4054671752 shutdown_connections 2023-11-04T01:36:13.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.243+0000 7fcb87da5640 1 -- 172.21.15.44:0/4054671752 wait complete. 2023-11-04T01:36:13.255 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:13.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.363+0000 7fe77f251640 1 Processor -- start 2023-11-04T01:36:13.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.363+0000 7fe77f251640 1 -- start start 2023-11-04T01:36:13.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.363+0000 7fe77f251640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe778153e60 0x7fe77815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.363+0000 7fe77f251640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7780b4880 0x7fe7780b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.363+0000 7fe77f251640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7780cde60 con 0x7fe7780cd6d0 2023-11-04T01:36:13.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.363+0000 7fe77f251640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe778160f90 con 0x7fe778153e60 2023-11-04T01:36:13.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.363+0000 7fe77f251640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7780b5200 con 0x7fe7780b4880 2023-11-04T01:36:13.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.364+0000 7fe77cfed640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe778153e60 0x7fe77815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.364+0000 7fe777fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe7780cd6d0 0x7fe778161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36294/0 (socket says 172.21.15.44:36294) 2023-11-04T01:36:13.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.364+0000 7fe777fff640 1 -- 172.21.15.44:0/1156651931 learned_addr learned my addr 172.21.15.44:0/1156651931 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:13.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.364+0000 7fe77d7ee640 1 --2- 172.21.15.44:0/1156651931 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7780b4880 0x7fe7780b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.364+0000 7fe77cfed640 1 -- 172.21.15.44:0/1156651931 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7780b4880 msgr2=0x7fe7780b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:13.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.364+0000 7fe77cfed640 1 --2- 172.21.15.44:0/1156651931 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7780b4880 0x7fe7780b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.364+0000 7fe77cfed640 1 -- 172.21.15.44:0/1156651931 >> v1:172.21.15.44:6789/0 conn(0x7fe7780cd6d0 legacy=0x7fe778161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.364+0000 7fe77cfed640 1 -- 172.21.15.44:0/1156651931 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77815e400 con 0x7fe778153e60 2023-11-04T01:36:13.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.364+0000 7fe7777fe640 1 -- 172.21.15.44:0/1156651931 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755630270 0 0) 0x7fe7780cde60 con 0x7fe7780cd6d0 2023-11-04T01:36:13.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.365+0000 7fe77cfed640 1 --2- 172.21.15.44:0/1156651931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe778153e60 0x7fe77815dec0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe770009d90 tx=0x7fe77002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83b9a8dc1542137 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.365+0000 7fe7777fe640 1 -- 172.21.15.44:0/1156651931 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77002cc50 con 0x7fe778153e60 2023-11-04T01:36:13.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.365+0000 7fe7777fe640 1 -- 172.21.15.44:0/1156651931 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77002cdb0 con 0x7fe778153e60 2023-11-04T01:36:13.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.365+0000 7fe7777fe640 1 -- 172.21.15.44:0/1156651931 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe770034660 con 0x7fe778153e60 2023-11-04T01:36:13.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.365+0000 7fe77f251640 1 -- 172.21.15.44:0/1156651931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe778153e60 msgr2=0x7fe77815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.365+0000 7fe77f251640 1 --2- 172.21.15.44:0/1156651931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe778153e60 0x7fe77815dec0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe770009d90 tx=0x7fe77002bea0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.365+0000 7fe77f251640 1 -- 172.21.15.44:0/1156651931 shutdown_connections 2023-11-04T01:36:13.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.365+0000 7fe77f251640 1 --2- 172.21.15.44:0/1156651931 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7780b4880 0x7fe7780b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.365+0000 7fe77f251640 1 --2- 172.21.15.44:0/1156651931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe778153e60 0x7fe77815dec0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.365+0000 7fe77f251640 1 -- 172.21.15.44:0/1156651931 >> 172.21.15.44:0/1156651931 conn(0x7fe7780cf880 msgr2=0x7fe7780cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.365+0000 7fe77f251640 1 -- 172.21.15.44:0/1156651931 shutdown_connections 2023-11-04T01:36:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.365+0000 7fe77f251640 1 -- 172.21.15.44:0/1156651931 wait complete. 2023-11-04T01:36:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.367+0000 7fe77f251640 1 Processor -- start 2023-11-04T01:36:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.367+0000 7fe77f251640 1 -- start start 2023-11-04T01:36:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.367+0000 7fe77f251640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7780b4880 0x7fe778152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.367+0000 7fe77f251640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7780cd6d0 0x7fe7781589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.367+0000 7fe77f251640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe778153e60 0x7fe778158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.367+0000 7fe77f251640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7781575d0 con 0x7fe778153e60 2023-11-04T01:36:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.367+0000 7fe77f251640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe778156a50 con 0x7fe7780cd6d0 2023-11-04T01:36:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.367+0000 7fe77f251640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe778156d30 con 0x7fe7780b4880 2023-11-04T01:36:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe77d7ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe778153e60 0x7fe778158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe77d7ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe778153e60 0x7fe778158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48654/0 (socket says 172.21.15.44:48654) 2023-11-04T01:36:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe77d7ee640 1 -- 172.21.15.44:0/360547800 learned_addr learned my addr 172.21.15.44:0/360547800 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe77cfed640 1 --2- 172.21.15.44:0/360547800 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7780b4880 0x7fe778152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe777fff640 1 --2- 172.21.15.44:0/360547800 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7780cd6d0 0x7fe7781589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe77d7ee640 1 -- 172.21.15.44:0/360547800 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7780b4880 msgr2=0x7fe778152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe77d7ee640 1 --2- 172.21.15.44:0/360547800 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7780b4880 0x7fe778152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe77d7ee640 1 -- 172.21.15.44:0/360547800 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7780cd6d0 msgr2=0x7fe7781589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe77d7ee640 1 --2- 172.21.15.44:0/360547800 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7780cd6d0 0x7fe7781589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe77d7ee640 1 -- 172.21.15.44:0/360547800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe770009a70 con 0x7fe778153e60 2023-11-04T01:36:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe77d7ee640 1 --2- 172.21.15.44:0/360547800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe778153e60 0x7fe778158f00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe76800e930 tx=0x7fe76800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe7757fa640 1 -- 172.21.15.44:0/360547800 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe768009690 con 0x7fe778153e60 2023-11-04T01:36:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe7757fa640 1 -- 172.21.15.44:0/360547800 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76800c980 con 0x7fe778153e60 2023-11-04T01:36:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe77f251640 1 -- 172.21.15.44:0/360547800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe778157010 con 0x7fe778153e60 2023-11-04T01:36:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe7757fa640 1 -- 172.21.15.44:0/360547800 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76800cd30 con 0x7fe778153e60 2023-11-04T01:36:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.368+0000 7fe77f251640 1 -- 172.21.15.44:0/360547800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe778156670 con 0x7fe778153e60 2023-11-04T01:36:13.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.369+0000 7fe77f251640 1 -- 172.21.15.44:0/360547800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe778161400 con 0x7fe778153e60 2023-11-04T01:36:13.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.370+0000 7fe7757fa640 1 -- 172.21.15.44:0/360547800 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe768013470 con 0x7fe778153e60 2023-11-04T01:36:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.370+0000 7fe7757fa640 1 --2- 172.21.15.44:0/360547800 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe75806ae70 0x7fe75806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.370+0000 7fe7757fa640 1 -- 172.21.15.44:0/360547800 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe768089a90 con 0x7fe778153e60 2023-11-04T01:36:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.370+0000 7fe77cfed640 1 --2- 172.21.15.44:0/360547800 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe75806ae70 0x7fe75806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.371+0000 7fe77cfed640 1 --2- 172.21.15.44:0/360547800 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe75806ae70 0x7fe75806d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe770036000 tx=0x7fe770030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.374+0000 7fe7757fa640 1 -- 172.21.15.44:0/360547800 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe768054a50 con 0x7fe778153e60 2023-11-04T01:36:13.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.552+0000 7fe77f251640 1 -- 172.21.15.44:0/360547800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe778074290 con 0x7fe778153e60 2023-11-04T01:36:13.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.552+0000 7fe7757fa640 1 -- 172.21.15.44:0/360547800 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe7680170a0 con 0x7fe778153e60 2023-11-04T01:36:13.555 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:13.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.555+0000 7fe77f251640 1 -- 172.21.15.44:0/360547800 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe75806ae70 msgr2=0x7fe75806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.555+0000 7fe77f251640 1 --2- 172.21.15.44:0/360547800 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe75806ae70 0x7fe75806d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe770036000 tx=0x7fe770030000 comp rx=0 tx=0).stop 2023-11-04T01:36:13.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.555+0000 7fe77f251640 1 -- 172.21.15.44:0/360547800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe778153e60 msgr2=0x7fe778158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.555+0000 7fe77f251640 1 --2- 172.21.15.44:0/360547800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe778153e60 0x7fe778158f00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe76800e930 tx=0x7fe76800edf0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.555+0000 7fe77f251640 1 -- 172.21.15.44:0/360547800 shutdown_connections 2023-11-04T01:36:13.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.555+0000 7fe77f251640 1 --2- 172.21.15.44:0/360547800 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe75806ae70 0x7fe75806d330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.555+0000 7fe77f251640 1 --2- 172.21.15.44:0/360547800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe778153e60 0x7fe778158f00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.555+0000 7fe77f251640 1 --2- 172.21.15.44:0/360547800 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7780cd6d0 0x7fe7781589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.555+0000 7fe77f251640 1 --2- 172.21.15.44:0/360547800 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7780b4880 0x7fe778152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.555+0000 7fe77f251640 1 -- 172.21.15.44:0/360547800 >> 172.21.15.44:0/360547800 conn(0x7fe7780cf880 msgr2=0x7fe7780d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.555+0000 7fe77f251640 1 -- 172.21.15.44:0/360547800 shutdown_connections 2023-11-04T01:36:13.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.555+0000 7fe77f251640 1 -- 172.21.15.44:0/360547800 wait complete. 2023-11-04T01:36:13.569 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:13.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.673+0000 7ff7cc516640 1 Processor -- start 2023-11-04T01:36:13.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.673+0000 7ff7cc516640 1 -- start start 2023-11-04T01:36:13.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.674+0000 7ff7cc516640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7c40cd6d0 0x7ff7c4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.674+0000 7ff7cc516640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff7c40b4880 0x7ff7c40b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.674+0000 7ff7cc516640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c40cde60 con 0x7ff7c4153e60 2023-11-04T01:36:13.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.674+0000 7ff7cc516640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c4160f90 con 0x7ff7c40b4880 2023-11-04T01:36:13.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.674+0000 7ff7cc516640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40b51e0 con 0x7ff7c40cd6d0 2023-11-04T01:36:13.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.674+0000 7ff7caab3640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff7c40b4880 0x7ff7c40b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.674+0000 7ff7ca2b2640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff7c4153e60 0x7ff7c415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36300/0 (socket says 172.21.15.44:36300) 2023-11-04T01:36:13.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.674+0000 7ff7ca2b2640 1 -- 172.21.15.44:0/1754743517 learned_addr learned my addr 172.21.15.44:0/1754743517 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:13.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.675+0000 7ff7c9ab1640 1 --2- 172.21.15.44:0/1754743517 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7c40cd6d0 0x7ff7c4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.675+0000 7ff7caab3640 1 -- 172.21.15.44:0/1754743517 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7c40cd6d0 msgr2=0x7ff7c4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:13.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.675+0000 7ff7caab3640 1 --2- 172.21.15.44:0/1754743517 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7c40cd6d0 0x7ff7c4161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.675+0000 7ff7caab3640 1 -- 172.21.15.44:0/1754743517 >> v1:172.21.15.44:6789/0 conn(0x7ff7c4153e60 legacy=0x7ff7c415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.675+0000 7ff7c92b0640 1 -- 172.21.15.44:0/1754743517 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550431995 0 0) 0x7ff7c40cde60 con 0x7ff7c4153e60 2023-11-04T01:36:13.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.675+0000 7ff7caab3640 1 -- 172.21.15.44:0/1754743517 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4161960 con 0x7ff7c40b4880 2023-11-04T01:36:13.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.676+0000 7ff7caab3640 1 --2- 172.21.15.44:0/1754743517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7c40b4880 0x7ff7c40b4ca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009d90 tx=0x7ff7bc02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e856f6dfa97b7b90 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.676+0000 7ff7c92b0640 1 -- 172.21.15.44:0/1754743517 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc02cc50 con 0x7ff7c40b4880 2023-11-04T01:36:13.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.676+0000 7ff7c92b0640 1 -- 172.21.15.44:0/1754743517 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc02cdb0 con 0x7ff7c40b4880 2023-11-04T01:36:13.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.676+0000 7ff7c92b0640 1 -- 172.21.15.44:0/1754743517 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc034660 con 0x7ff7c40b4880 2023-11-04T01:36:13.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.676+0000 7ff7cc516640 1 -- 172.21.15.44:0/1754743517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7c40b4880 msgr2=0x7ff7c40b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.676+0000 7ff7cc516640 1 --2- 172.21.15.44:0/1754743517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7c40b4880 0x7ff7c40b4ca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009d90 tx=0x7ff7bc02bea0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.676+0000 7ff7cc516640 1 -- 172.21.15.44:0/1754743517 shutdown_connections 2023-11-04T01:36:13.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.676+0000 7ff7cc516640 1 --2- 172.21.15.44:0/1754743517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7c40b4880 0x7ff7c40b4ca0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.676+0000 7ff7cc516640 1 --2- 172.21.15.44:0/1754743517 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7c40cd6d0 0x7ff7c4161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.676+0000 7ff7cc516640 1 -- 172.21.15.44:0/1754743517 >> 172.21.15.44:0/1754743517 conn(0x7ff7c40cf880 msgr2=0x7ff7c40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.676+0000 7ff7cc516640 1 -- 172.21.15.44:0/1754743517 shutdown_connections 2023-11-04T01:36:13.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.676+0000 7ff7cc516640 1 -- 172.21.15.44:0/1754743517 wait complete. 2023-11-04T01:36:13.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.678+0000 7ff7cc516640 1 Processor -- start 2023-11-04T01:36:13.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.678+0000 7ff7cc516640 1 -- start start 2023-11-04T01:36:13.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.678+0000 7ff7cc516640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7c40b4880 0x7ff7c41f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.678+0000 7ff7cc516640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7c40cd6d0 0x7ff7c41532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.678+0000 7ff7cc516640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7c4153e60 0x7ff7c40ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.678+0000 7ff7cc516640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40c68f0 con 0x7ff7c4153e60 2023-11-04T01:36:13.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.678+0000 7ff7cc516640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4159df0 con 0x7ff7c40b4880 2023-11-04T01:36:13.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.678+0000 7ff7cc516640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40c6b40 con 0x7ff7c40cd6d0 2023-11-04T01:36:13.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7caab3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7c4153e60 0x7ff7c40ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7caab3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7c4153e60 0x7ff7c40ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48666/0 (socket says 172.21.15.44:48666) 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7caab3640 1 -- 172.21.15.44:0/4196089111 learned_addr learned my addr 172.21.15.44:0/4196089111 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7c9ab1640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7c40cd6d0 0x7ff7c41532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7ca2b2640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7c40b4880 0x7ff7c41f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7caab3640 1 -- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7c40cd6d0 msgr2=0x7ff7c41532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7caab3640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7c40cd6d0 0x7ff7c41532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7caab3640 1 -- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7c40b4880 msgr2=0x7ff7c41f66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7caab3640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7c40b4880 0x7ff7c41f66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7caab3640 1 -- 172.21.15.44:0/4196089111 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc009a70 con 0x7ff7c4153e60 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7c9ab1640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7c40cd6d0 0x7ff7c41532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7ca2b2640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7c40b4880 0x7ff7c41f66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7caab3640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7c4153e60 0x7ff7c40ca290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009d90 tx=0x7ff7bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7baffd640 1 -- 172.21.15.44:0/4196089111 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc003b90 con 0x7ff7c4153e60 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7baffd640 1 -- 172.21.15.44:0/4196089111 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc003d10 con 0x7ff7c4153e60 2023-11-04T01:36:13.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7cc516640 1 -- 172.21.15.44:0/4196089111 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c40c6e20 con 0x7ff7c4153e60 2023-11-04T01:36:13.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7baffd640 1 -- 172.21.15.44:0/4196089111 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc004270 con 0x7ff7c4153e60 2023-11-04T01:36:13.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.679+0000 7ff7cc516640 1 -- 172.21.15.44:0/4196089111 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c40c73e0 con 0x7ff7c4153e60 2023-11-04T01:36:13.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.680+0000 7ff7cc516640 1 -- 172.21.15.44:0/4196089111 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c415fd00 con 0x7ff7c4153e60 2023-11-04T01:36:13.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.681+0000 7ff7baffd640 1 -- 172.21.15.44:0/4196089111 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff7bc03b050 con 0x7ff7c4153e60 2023-11-04T01:36:13.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.681+0000 7ff7baffd640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff7a806ae70 0x7ff7a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.681+0000 7ff7baffd640 1 -- 172.21.15.44:0/4196089111 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff7bc0abcf0 con 0x7ff7c4153e60 2023-11-04T01:36:13.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.682+0000 7ff7ca2b2640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff7a806ae70 0x7ff7a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.682+0000 7ff7ca2b2640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff7a806ae70 0x7ff7a806d330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0000f60 tx=0x7ff7c0007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.686+0000 7ff7baffd640 1 -- 172.21.15.44:0/4196089111 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff7bc0b0070 con 0x7ff7c4153e60 2023-11-04T01:36:13.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.873+0000 7ff7cc516640 1 -- 172.21.15.44:0/4196089111 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff7c4074290 con 0x7ff7c4153e60 2023-11-04T01:36:13.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.874+0000 7ff7baffd640 1 -- 172.21.15.44:0/4196089111 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff7bc039080 con 0x7ff7c4153e60 2023-11-04T01:36:13.876 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2023-11-04T01:36:13.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.876+0000 7ff7cc516640 1 -- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff7a806ae70 msgr2=0x7ff7a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.876+0000 7ff7cc516640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff7a806ae70 0x7ff7a806d330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0000f60 tx=0x7ff7c0007ca0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.876+0000 7ff7cc516640 1 -- 172.21.15.44:0/4196089111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7c4153e60 msgr2=0x7ff7c40ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.876+0000 7ff7cc516640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7c4153e60 0x7ff7c40ca290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009d90 tx=0x7ff7bc004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:13.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.876+0000 7ff7cc516640 1 -- 172.21.15.44:0/4196089111 shutdown_connections 2023-11-04T01:36:13.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.876+0000 7ff7cc516640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff7a806ae70 0x7ff7a806d330 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.876+0000 7ff7cc516640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7c4153e60 0x7ff7c40ca290 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.876+0000 7ff7cc516640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7c40cd6d0 0x7ff7c41532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.876+0000 7ff7cc516640 1 --2- 172.21.15.44:0/4196089111 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7c40b4880 0x7ff7c41f66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.876+0000 7ff7cc516640 1 -- 172.21.15.44:0/4196089111 >> 172.21.15.44:0/4196089111 conn(0x7ff7c40cf880 msgr2=0x7ff7c415a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.876+0000 7ff7cc516640 1 -- 172.21.15.44:0/4196089111 shutdown_connections 2023-11-04T01:36:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13.876+0000 7ff7cc516640 1 -- 172.21.15.44:0/4196089111 wait complete. 2023-11-04T01:36:13.890 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2023-11-04T01:36:13.890 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:13.890 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:13.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:13.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[94813]: fuse finished with error 0 and tester_r 0 2023-11-04T01:36:13.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:13.959 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:2023-11-04T01:36:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:13.962 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:36:13.968 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:36:13.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:13.969 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-04T01:36:14.034 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:14.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.179+0000 7fd0873b6640 1 Processor -- start 2023-11-04T01:36:14.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.179+0000 7fd0873b6640 1 -- start start 2023-11-04T01:36:14.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.180+0000 7fd0873b6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd0800cde60 0x7fd08015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.180+0000 7fd0873b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd08015daa0 0x7fd080157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.180+0000 7fd0873b6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08015e000 con 0x7fd0800ce240 2023-11-04T01:36:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.180+0000 7fd0873b6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08015e5c0 con 0x7fd0800cde60 2023-11-04T01:36:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.180+0000 7fd0873b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08015e2e0 con 0x7fd08015daa0 2023-11-04T01:36:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.180+0000 7fd085953640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd0800ce240 0x7fd08006b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36312/0 (socket says 172.21.15.44:36312) 2023-11-04T01:36:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.180+0000 7fd085152640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd0800cde60 0x7fd08015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.180+0000 7fd085953640 1 -- 172.21.15.44:0/3794514146 learned_addr learned my addr 172.21.15.44:0/3794514146 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.180+0000 7fd084951640 1 --2- 172.21.15.44:0/3794514146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd08015daa0 0x7fd080157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.180+0000 7fd085152640 1 -- 172.21.15.44:0/3794514146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd08015daa0 msgr2=0x7fd080157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.180+0000 7fd085152640 1 --2- 172.21.15.44:0/3794514146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd08015daa0 0x7fd080157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.180+0000 7fd085152640 1 -- 172.21.15.44:0/3794514146 >> v1:172.21.15.44:6789/0 conn(0x7fd0800ce240 legacy=0x7fd08006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.180+0000 7fd085152640 1 -- 172.21.15.44:0/3794514146 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0800d1120 con 0x7fd0800cde60 2023-11-04T01:36:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.180+0000 7fd077fff640 1 -- 172.21.15.44:0/3794514146 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491347949 0 0) 0x7fd08015e000 con 0x7fd0800ce240 2023-11-04T01:36:14.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.181+0000 7fd085152640 1 --2- 172.21.15.44:0/3794514146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0800cde60 0x7fd08015d560 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0097a0 tx=0x7fd07c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9dc5542197c488 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.181+0000 7fd077fff640 1 -- 172.21.15.44:0/3794514146 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c031830 con 0x7fd0800cde60 2023-11-04T01:36:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.181+0000 7fd077fff640 1 -- 172.21.15.44:0/3794514146 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07c031990 con 0x7fd0800cde60 2023-11-04T01:36:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.181+0000 7fd077fff640 1 -- 172.21.15.44:0/3794514146 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c031d20 con 0x7fd0800cde60 2023-11-04T01:36:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.182+0000 7fd0873b6640 1 -- 172.21.15.44:0/3794514146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0800cde60 msgr2=0x7fd08015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.182+0000 7fd0873b6640 1 --2- 172.21.15.44:0/3794514146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0800cde60 0x7fd08015d560 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0097a0 tx=0x7fd07c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.182+0000 7fd0873b6640 1 -- 172.21.15.44:0/3794514146 shutdown_connections 2023-11-04T01:36:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.182+0000 7fd0873b6640 1 --2- 172.21.15.44:0/3794514146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd08015daa0 0x7fd080157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.182+0000 7fd0873b6640 1 --2- 172.21.15.44:0/3794514146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0800cde60 0x7fd08015d560 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.182+0000 7fd0873b6640 1 -- 172.21.15.44:0/3794514146 >> 172.21.15.44:0/3794514146 conn(0x7fd080071f30 msgr2=0x7fd0800cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.182+0000 7fd0873b6640 1 -- 172.21.15.44:0/3794514146 shutdown_connections 2023-11-04T01:36:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.182+0000 7fd0873b6640 1 -- 172.21.15.44:0/3794514146 wait complete. 2023-11-04T01:36:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.183+0000 7fd0873b6640 1 Processor -- start 2023-11-04T01:36:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.183+0000 7fd0873b6640 1 -- start start 2023-11-04T01:36:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd0873b6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0800cde60 0x7fd080149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd0873b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0800ce240 0x7fd0801f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd0873b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd08015daa0 0x7fd08015ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd0873b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd080147490 con 0x7fd08015daa0 2023-11-04T01:36:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd0873b6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0801f5da0 con 0x7fd0800cde60 2023-11-04T01:36:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd0873b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd080148b60 con 0x7fd0800ce240 2023-11-04T01:36:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd085953640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd08015daa0 0x7fd08015ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd085953640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd08015daa0 0x7fd08015ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48678/0 (socket says 172.21.15.44:48678) 2023-11-04T01:36:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd085953640 1 -- 172.21.15.44:0/3425505690 learned_addr learned my addr 172.21.15.44:0/3425505690 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd084951640 1 --2- 172.21.15.44:0/3425505690 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0800ce240 0x7fd0801f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd085152640 1 --2- 172.21.15.44:0/3425505690 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0800cde60 0x7fd080149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd085953640 1 -- 172.21.15.44:0/3425505690 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0800ce240 msgr2=0x7fd0801f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd085953640 1 --2- 172.21.15.44:0/3425505690 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0800ce240 0x7fd0801f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd085953640 1 -- 172.21.15.44:0/3425505690 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0800cde60 msgr2=0x7fd080149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd085953640 1 --2- 172.21.15.44:0/3425505690 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0800cde60 0x7fd080149390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd085953640 1 -- 172.21.15.44:0/3425505690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07c009400 con 0x7fd08015daa0 2023-11-04T01:36:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.184+0000 7fd085953640 1 --2- 172.21.15.44:0/3425505690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd08015daa0 0x7fd08015ca10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd07800c7e0 tx=0x7fd07800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.185+0000 7fd075ffb640 1 -- 172.21.15.44:0/3425505690 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07800a640 con 0x7fd08015daa0 2023-11-04T01:36:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.185+0000 7fd075ffb640 1 -- 172.21.15.44:0/3425505690 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07800a7c0 con 0x7fd08015daa0 2023-11-04T01:36:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.185+0000 7fd0873b6640 1 -- 172.21.15.44:0/3425505690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0801499d0 con 0x7fd08015daa0 2023-11-04T01:36:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.185+0000 7fd075ffb640 1 -- 172.21.15.44:0/3425505690 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07800ab70 con 0x7fd08015daa0 2023-11-04T01:36:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.185+0000 7fd0873b6640 1 -- 172.21.15.44:0/3425505690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd080149f90 con 0x7fd08015daa0 2023-11-04T01:36:14.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.186+0000 7fd0873b6640 1 -- 172.21.15.44:0/3425505690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0801475d0 con 0x7fd08015daa0 2023-11-04T01:36:14.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.186+0000 7fd075ffb640 1 -- 172.21.15.44:0/3425505690 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd07800acd0 con 0x7fd08015daa0 2023-11-04T01:36:14.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.186+0000 7fd075ffb640 1 --2- 172.21.15.44:0/3425505690 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd06406ae70 0x7fd06406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.186+0000 7fd075ffb640 1 -- 172.21.15.44:0/3425505690 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd078088ee0 con 0x7fd08015daa0 2023-11-04T01:36:14.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.187+0000 7fd085152640 1 --2- 172.21.15.44:0/3425505690 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd06406ae70 0x7fd06406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.187+0000 7fd085152640 1 --2- 172.21.15.44:0/3425505690 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd06406ae70 0x7fd06406d330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd07c036000 tx=0x7fd07c03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:14.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.191+0000 7fd075ffb640 1 -- 172.21.15.44:0/3425505690 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd078053ca0 con 0x7fd08015daa0 2023-11-04T01:36:14.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.368+0000 7fd0873b6640 1 -- 172.21.15.44:0/3425505690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd080074290 con 0x7fd08015daa0 2023-11-04T01:36:14.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.370+0000 7fd075ffb640 1 -- 172.21.15.44:0/3425505690 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fd078018070 con 0x7fd08015daa0 2023-11-04T01:36:14.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:14.372 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:03.589395+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.372+0000 7fd0873b6640 1 -- 172.21.15.44:0/3425505690 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd06406ae70 msgr2=0x7fd06406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.372+0000 7fd0873b6640 1 --2- 172.21.15.44:0/3425505690 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd06406ae70 0x7fd06406d330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd07c036000 tx=0x7fd07c03c040 comp rx=0 tx=0).stop 2023-11-04T01:36:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.372+0000 7fd0873b6640 1 -- 172.21.15.44:0/3425505690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd08015daa0 msgr2=0x7fd08015ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.372+0000 7fd0873b6640 1 --2- 172.21.15.44:0/3425505690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd08015daa0 0x7fd08015ca10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd07800c7e0 tx=0x7fd07800cca0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.372+0000 7fd0873b6640 1 -- 172.21.15.44:0/3425505690 shutdown_connections 2023-11-04T01:36:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.372+0000 7fd0873b6640 1 --2- 172.21.15.44:0/3425505690 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd06406ae70 0x7fd06406d330 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.372+0000 7fd0873b6640 1 --2- 172.21.15.44:0/3425505690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd08015daa0 0x7fd08015ca10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.372+0000 7fd0873b6640 1 --2- 172.21.15.44:0/3425505690 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0800ce240 0x7fd0801f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.372+0000 7fd0873b6640 1 --2- 172.21.15.44:0/3425505690 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0800cde60 0x7fd080149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.372+0000 7fd0873b6640 1 -- 172.21.15.44:0/3425505690 >> 172.21.15.44:0/3425505690 conn(0x7fd080071f30 msgr2=0x7fd080156530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:14.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.372+0000 7fd0873b6640 1 -- 172.21.15.44:0/3425505690 shutdown_connections 2023-11-04T01:36:14.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.372+0000 7fd0873b6640 1 -- 172.21.15.44:0/3425505690 wait complete. 2023-11-04T01:36:14.385 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.489+0000 7f40e374c640 1 Processor -- start 2023-11-04T01:36:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.489+0000 7f40e374c640 1 -- start start 2023-11-04T01:36:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40e374c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f40dc0ce240 0x7f40dc157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40e374c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40dc15e000 con 0x7f40dc0cde60 2023-11-04T01:36:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40e374c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40dc15e2e0 con 0x7f40dc157540 2023-11-04T01:36:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40e374c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40dc15e5c0 con 0x7f40dc0ce240 2023-11-04T01:36:14.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40e14e8640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f40dc0cde60 0x7f40dc15d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36320/0 (socket says 172.21.15.44:36320) 2023-11-04T01:36:14.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40e14e8640 1 -- 172.21.15.44:0/1268223457 learned_addr learned my addr 172.21.15.44:0/1268223457 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:14.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40e0ce7640 1 --2- 172.21.15.44:0/1268223457 >> v2:172.21.15.204:3300/0 conn(0x7f40dc0ce240 0x7f40dc157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40d3fff640 1 -- 172.21.15.44:0/1268223457 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015854109 0 0) 0x7f40dc15e000 con 0x7f40dc0cde60 2023-11-04T01:36:14.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40d3fff640 1 -- 172.21.15.44:0/1268223457 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40c8003520 con 0x7f40dc0cde60 2023-11-04T01:36:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40d3fff640 1 -- 172.21.15.44:0/1268223457 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1661022907 0 0) 0x7f40c8003520 con 0x7f40dc0cde60 2023-11-04T01:36:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40d3fff640 1 -- 172.21.15.44:0/1268223457 >> v2:172.21.15.204:3300/0 conn(0x7f40dc0ce240 msgr2=0x7f40dc157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40d3fff640 1 --2- 172.21.15.44:0/1268223457 >> v2:172.21.15.204:3300/0 conn(0x7f40dc0ce240 0x7f40dc157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40d3fff640 1 -- 172.21.15.44:0/1268223457 >> v1:172.21.15.204:6789/0 conn(0x7f40dc157540 legacy=0x7f40dc0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40d3fff640 1 -- 172.21.15.44:0/1268223457 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc0d1120 con 0x7f40dc0cde60 2023-11-04T01:36:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40d3fff640 1 -- 172.21.15.44:0/1268223457 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f40d8001670 con 0x7f40dc0cde60 2023-11-04T01:36:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40d3fff640 1 -- 172.21.15.44:0/1268223457 >> v1:172.21.15.44:6789/0 conn(0x7f40dc0cde60 legacy=0x7f40dc15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.490+0000 7f40d3fff640 1 --2- 172.21.15.44:0/1268223457 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40c8003970 0x7f40c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.491+0000 7f40d3fff640 1 --2- 172.21.15.44:0/1268223457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c80047c0 0x7f40c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.491+0000 7f40d3fff640 1 --2- 172.21.15.44:0/1268223457 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40c8005180 0x7f40c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.491+0000 7f40d3fff640 1 -- 172.21.15.44:0/1268223457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc15e5c0 con 0x7f40c80047c0 2023-11-04T01:36:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.491+0000 7f40d3fff640 1 -- 172.21.15.44:0/1268223457 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c800c020 con 0x7f40c8005180 2023-11-04T01:36:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.491+0000 7f40d3fff640 1 -- 172.21.15.44:0/1268223457 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c800c1e0 con 0x7f40c8003970 2023-11-04T01:36:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.491+0000 7f40e0ce7640 1 --2- 172.21.15.44:0/1268223457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c80047c0 0x7f40c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.491+0000 7f40e14e8640 1 --2- 172.21.15.44:0/1268223457 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40c8003970 0x7f40c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.491+0000 7f40e1ce9640 1 --2- 172.21.15.44:0/1268223457 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40c8005180 0x7f40c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.491+0000 7f40e0ce7640 1 -- 172.21.15.44:0/1268223457 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40c8003970 msgr2=0x7f40c8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.491+0000 7f40e0ce7640 1 --2- 172.21.15.44:0/1268223457 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40c8003970 0x7f40c8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.491+0000 7f40e0ce7640 1 -- 172.21.15.44:0/1268223457 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40c8005180 msgr2=0x7f40c800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:14.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.491+0000 7f40e0ce7640 1 --2- 172.21.15.44:0/1268223457 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40c8005180 0x7f40c800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.491+0000 7f40e1ce9640 1 -- 172.21.15.44:0/1268223457 reap_dead start 2023-11-04T01:36:14.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.491+0000 7f40e0ce7640 1 -- 172.21.15.44:0/1268223457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8003520 con 0x7f40c80047c0 2023-11-04T01:36:14.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.491+0000 7f40e14e8640 1 --2- 172.21.15.44:0/1268223457 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40c8003970 0x7f40c8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:14.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.492+0000 7f40e0ce7640 1 --2- 172.21.15.44:0/1268223457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c80047c0 0x7f40c8004c40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009ac0 tx=0x7f40c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4744074969660772 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:14.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.492+0000 7f40d3fff640 1 -- 172.21.15.44:0/1268223457 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc02c6b0 con 0x7f40c80047c0 2023-11-04T01:36:14.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.492+0000 7f40d3fff640 1 -- 172.21.15.44:0/1268223457 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc02c810 con 0x7f40c80047c0 2023-11-04T01:36:14.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.492+0000 7f40d3fff640 1 -- 172.21.15.44:0/1268223457 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc02cba0 con 0x7f40c80047c0 2023-11-04T01:36:14.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.492+0000 7f40e374c640 1 -- 172.21.15.44:0/1268223457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c80047c0 msgr2=0x7f40c8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.492+0000 7f40e374c640 1 --2- 172.21.15.44:0/1268223457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c80047c0 0x7f40c8004c40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009ac0 tx=0x7f40c80057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.492+0000 7f40e374c640 1 -- 172.21.15.44:0/1268223457 shutdown_connections 2023-11-04T01:36:14.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.492+0000 7f40e374c640 1 --2- 172.21.15.44:0/1268223457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c80047c0 0x7f40c8004c40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.492+0000 7f40e374c640 1 -- 172.21.15.44:0/1268223457 >> 172.21.15.44:0/1268223457 conn(0x7f40dc071f30 msgr2=0x7f40dc0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.492+0000 7f40e374c640 1 -- 172.21.15.44:0/1268223457 shutdown_connections 2023-11-04T01:36:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.492+0000 7f40e374c640 1 -- 172.21.15.44:0/1268223457 wait complete. 2023-11-04T01:36:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.494+0000 7f40e374c640 1 Processor -- start 2023-11-04T01:36:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.494+0000 7f40e374c640 1 -- start start 2023-11-04T01:36:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.494+0000 7f40e374c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40c80047c0 0x7f40dc1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.494+0000 7f40e374c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40dc15cdc0 0x7f40dc159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.494+0000 7f40e374c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40dc1f59b0 0x7f40dc1f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.494+0000 7f40e374c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc1f63a0 con 0x7f40dc15cdc0 2023-11-04T01:36:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.494+0000 7f40e374c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc15b280 con 0x7f40c80047c0 2023-11-04T01:36:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.494+0000 7f40e374c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc15a670 con 0x7f40dc1f59b0 2023-11-04T01:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.494+0000 7f40e0ce7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40dc15cdc0 0x7f40dc159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.495+0000 7f40e0ce7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40dc15cdc0 0x7f40dc159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48710/0 (socket says 172.21.15.44:48710) 2023-11-04T01:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.495+0000 7f40e0ce7640 1 -- 172.21.15.44:0/2809234898 learned_addr learned my addr 172.21.15.44:0/2809234898 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.495+0000 7f40e14e8640 1 --2- 172.21.15.44:0/2809234898 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40c80047c0 0x7f40dc1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.495+0000 7f40e1ce9640 1 --2- 172.21.15.44:0/2809234898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40dc1f59b0 0x7f40dc1f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.495+0000 7f40e0ce7640 1 -- 172.21.15.44:0/2809234898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40dc1f59b0 msgr2=0x7f40dc1f5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.495+0000 7f40e0ce7640 1 --2- 172.21.15.44:0/2809234898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40dc1f59b0 0x7f40dc1f5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.495+0000 7f40e0ce7640 1 -- 172.21.15.44:0/2809234898 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40c80047c0 msgr2=0x7f40dc1561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.495+0000 7f40e0ce7640 1 --2- 172.21.15.44:0/2809234898 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40c80047c0 0x7f40dc1561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.495+0000 7f40e0ce7640 1 -- 172.21.15.44:0/2809234898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc15a950 con 0x7f40dc15cdc0 2023-11-04T01:36:14.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.495+0000 7f40e0ce7640 1 --2- 172.21.15.44:0/2809234898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40dc15cdc0 0x7f40dc159d40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009ac0 tx=0x7f40cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:14.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.495+0000 7f40d1ffb640 1 -- 172.21.15.44:0/2809234898 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc003810 con 0x7f40dc15cdc0 2023-11-04T01:36:14.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.495+0000 7f40d1ffb640 1 -- 172.21.15.44:0/2809234898 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc003970 con 0x7f40dc15cdc0 2023-11-04T01:36:14.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.495+0000 7f40e374c640 1 -- 172.21.15.44:0/2809234898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40dc15ac30 con 0x7f40dc15cdc0 2023-11-04T01:36:14.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.495+0000 7f40d1ffb640 1 -- 172.21.15.44:0/2809234898 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc003d00 con 0x7f40dc15cdc0 2023-11-04T01:36:14.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.495+0000 7f40e374c640 1 -- 172.21.15.44:0/2809234898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40dc156700 con 0x7f40dc15cdc0 2023-11-04T01:36:14.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.496+0000 7f40e374c640 1 -- 172.21.15.44:0/2809234898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40dc15b430 con 0x7f40dc15cdc0 2023-11-04T01:36:14.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.497+0000 7f40d1ffb640 1 -- 172.21.15.44:0/2809234898 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f40cc040450 con 0x7f40dc15cdc0 2023-11-04T01:36:14.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.497+0000 7f40d1ffb640 1 --2- 172.21.15.44:0/2809234898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f40c006ae70 0x7f40c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.497+0000 7f40d1ffb640 1 -- 172.21.15.44:0/2809234898 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f40cc0ab8c0 con 0x7f40dc15cdc0 2023-11-04T01:36:14.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.497+0000 7f40e14e8640 1 --2- 172.21.15.44:0/2809234898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f40c006ae70 0x7f40c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.498+0000 7f40e14e8640 1 --2- 172.21.15.44:0/2809234898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f40c006ae70 0x7f40c006d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f40d8000fb0 tx=0x7f40d8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:14.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.501+0000 7f40d1ffb640 1 -- 172.21.15.44:0/2809234898 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40dc15b430 con 0x7f40dc15cdc0 2023-11-04T01:36:14.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.679+0000 7f40e374c640 1 -- 172.21.15.44:0/2809234898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40dc15b430 con 0x7f40dc15cdc0 2023-11-04T01:36:14.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.681+0000 7f40d1ffb640 1 -- 172.21.15.44:0/2809234898 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f40dc15b430 con 0x7f40dc15cdc0 2023-11-04T01:36:14.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:14.683 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:03.589395+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:14.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.683+0000 7f40e374c640 1 -- 172.21.15.44:0/2809234898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f40c006ae70 msgr2=0x7f40c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.683+0000 7f40e374c640 1 --2- 172.21.15.44:0/2809234898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f40c006ae70 0x7f40c006d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f40d8000fb0 tx=0x7f40d8009040 comp rx=0 tx=0).stop 2023-11-04T01:36:14.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.683+0000 7f40e374c640 1 -- 172.21.15.44:0/2809234898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40dc15cdc0 msgr2=0x7f40dc159d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.683+0000 7f40e374c640 1 --2- 172.21.15.44:0/2809234898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40dc15cdc0 0x7f40dc159d40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009ac0 tx=0x7f40cc004730 comp rx=0 tx=0).stop 2023-11-04T01:36:14.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.683+0000 7f40e374c640 1 -- 172.21.15.44:0/2809234898 shutdown_connections 2023-11-04T01:36:14.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.683+0000 7f40e374c640 1 --2- 172.21.15.44:0/2809234898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f40c006ae70 0x7f40c006d330 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.683+0000 7f40e374c640 1 --2- 172.21.15.44:0/2809234898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40dc1f59b0 0x7f40dc1f5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.683+0000 7f40e374c640 1 --2- 172.21.15.44:0/2809234898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40dc15cdc0 0x7f40dc159d40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.683+0000 7f40e374c640 1 --2- 172.21.15.44:0/2809234898 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40c80047c0 0x7f40dc1561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.683+0000 7f40e374c640 1 -- 172.21.15.44:0/2809234898 >> 172.21.15.44:0/2809234898 conn(0x7f40dc071f30 msgr2=0x7f40dc0d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:14.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.683+0000 7f40e374c640 1 -- 172.21.15.44:0/2809234898 shutdown_connections 2023-11-04T01:36:14.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.683+0000 7f40e374c640 1 -- 172.21.15.44:0/2809234898 wait complete. 2023-11-04T01:36:14.696 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:36:14.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.803+0000 7fe07e51d640 1 Processor -- start 2023-11-04T01:36:14.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.803+0000 7fe07e51d640 1 -- start start 2023-11-04T01:36:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe07e51d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe078153e60 0x7fe07815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe07e51d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe0780cd6d0 0x7fe078161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe07e51d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe0780b4880 0x7fe0780b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe07e51d640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0780cde60 con 0x7fe0780cd6d0 2023-11-04T01:36:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe07e51d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe078160f90 con 0x7fe0780b4880 2023-11-04T01:36:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe07e51d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780b5200 con 0x7fe078153e60 2023-11-04T01:36:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe0777fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe0780cd6d0 0x7fe078161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe0777fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe0780cd6d0 0x7fe078161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48714/0 (socket says 172.21.15.44:48714) 2023-11-04T01:36:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe0777fe640 1 -- 172.21.15.44:0/1531043991 learned_addr learned my addr 172.21.15.44:0/1531043991 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe07caba640 1 --2- 172.21.15.44:0/1531043991 >> v2:172.21.15.204:3300/0 conn(0x7fe0780b4880 0x7fe0780b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe077fff640 1 --2- 172.21.15.44:0/1531043991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe078153e60 0x7fe07815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe0777fe640 1 -- 172.21.15.44:0/1531043991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe078153e60 msgr2=0x7fe07815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe0777fe640 1 --2- 172.21.15.44:0/1531043991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe078153e60 0x7fe07815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe0777fe640 1 -- 172.21.15.44:0/1531043991 >> v2:172.21.15.204:3300/0 conn(0x7fe0780b4880 msgr2=0x7fe0780b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe0777fe640 1 --2- 172.21.15.44:0/1531043991 >> v2:172.21.15.204:3300/0 conn(0x7fe0780b4880 0x7fe0780b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe0777fe640 1 -- 172.21.15.44:0/1531043991 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07815e400 con 0x7fe0780cd6d0 2023-11-04T01:36:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe07caba640 1 --2- 172.21.15.44:0/1531043991 >> v2:172.21.15.204:3300/0 conn(0x7fe0780b4880 0x7fe0780b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.804+0000 7fe077fff640 1 --2- 172.21.15.44:0/1531043991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe078153e60 0x7fe07815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.805+0000 7fe0777fe640 1 --2- 172.21.15.44:0/1531043991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0780cd6d0 0x7fe078161420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe0780c9e50 tx=0x7fe06802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd883cf8c0d0e96 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:14.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.805+0000 7fe076ffd640 1 -- 172.21.15.44:0/1531043991 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068031870 con 0x7fe0780cd6d0 2023-11-04T01:36:14.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.805+0000 7fe076ffd640 1 -- 172.21.15.44:0/1531043991 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0680319d0 con 0x7fe0780cd6d0 2023-11-04T01:36:14.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.805+0000 7fe076ffd640 1 -- 172.21.15.44:0/1531043991 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068031d60 con 0x7fe0780cd6d0 2023-11-04T01:36:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.806+0000 7fe07e51d640 1 -- 172.21.15.44:0/1531043991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0780cd6d0 msgr2=0x7fe078161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.806+0000 7fe07e51d640 1 --2- 172.21.15.44:0/1531043991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0780cd6d0 0x7fe078161420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe0780c9e50 tx=0x7fe06802b910 comp rx=0 tx=0).stop 2023-11-04T01:36:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.806+0000 7fe07e51d640 1 -- 172.21.15.44:0/1531043991 shutdown_connections 2023-11-04T01:36:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.806+0000 7fe07e51d640 1 --2- 172.21.15.44:0/1531043991 >> v2:172.21.15.204:3300/0 conn(0x7fe0780b4880 0x7fe0780b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.806+0000 7fe07e51d640 1 --2- 172.21.15.44:0/1531043991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0780cd6d0 0x7fe078161420 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.806+0000 7fe07e51d640 1 --2- 172.21.15.44:0/1531043991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe078153e60 0x7fe07815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.806+0000 7fe07e51d640 1 -- 172.21.15.44:0/1531043991 >> 172.21.15.44:0/1531043991 conn(0x7fe0780cf880 msgr2=0x7fe0780cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.806+0000 7fe07e51d640 1 -- 172.21.15.44:0/1531043991 shutdown_connections 2023-11-04T01:36:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.806+0000 7fe07e51d640 1 -- 172.21.15.44:0/1531043991 wait complete. 2023-11-04T01:36:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.807+0000 7fe07e51d640 1 Processor -- start 2023-11-04T01:36:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.807+0000 7fe07e51d640 1 -- start start 2023-11-04T01:36:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe07e51d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0780b4880 0x7fe0781f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe07e51d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0780cd6d0 0x7fe0780c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe07e51d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe078153e60 0x7fe0781f59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe07e51d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe078150e00 con 0x7fe078153e60 2023-11-04T01:36:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe07e51d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07815a070 con 0x7fe0780b4880 2023-11-04T01:36:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe07e51d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07815a350 con 0x7fe0780cd6d0 2023-11-04T01:36:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe07caba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe078153e60 0x7fe0781f59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe07caba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe078153e60 0x7fe0781f59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48718/0 (socket says 172.21.15.44:48718) 2023-11-04T01:36:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe07caba640 1 -- 172.21.15.44:0/3442660916 learned_addr learned my addr 172.21.15.44:0/3442660916 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe0777fe640 1 --2- 172.21.15.44:0/3442660916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0780cd6d0 0x7fe0780c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe077fff640 1 --2- 172.21.15.44:0/3442660916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0780b4880 0x7fe0781f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe07caba640 1 -- 172.21.15.44:0/3442660916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0780cd6d0 msgr2=0x7fe0780c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe07caba640 1 --2- 172.21.15.44:0/3442660916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0780cd6d0 0x7fe0780c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe07caba640 1 -- 172.21.15.44:0/3442660916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0780b4880 msgr2=0x7fe0781f1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe07caba640 1 --2- 172.21.15.44:0/3442660916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0780b4880 0x7fe0781f1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe07caba640 1 -- 172.21.15.44:0/3442660916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0680094d0 con 0x7fe078153e60 2023-11-04T01:36:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe07caba640 1 --2- 172.21.15.44:0/3442660916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe078153e60 0x7fe0781f59c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe07000cef0 tx=0x7fe07000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.808+0000 7fe074ff9640 1 -- 172.21.15.44:0/3442660916 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07000d840 con 0x7fe078153e60 2023-11-04T01:36:14.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.809+0000 7fe074ff9640 1 -- 172.21.15.44:0/3442660916 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07000d9a0 con 0x7fe078153e60 2023-11-04T01:36:14.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.809+0000 7fe07e51d640 1 -- 172.21.15.44:0/3442660916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07815a630 con 0x7fe078153e60 2023-11-04T01:36:14.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.809+0000 7fe074ff9640 1 -- 172.21.15.44:0/3442660916 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07000dd50 con 0x7fe078153e60 2023-11-04T01:36:14.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.809+0000 7fe07e51d640 1 -- 172.21.15.44:0/3442660916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0781f2260 con 0x7fe078153e60 2023-11-04T01:36:14.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.809+0000 7fe07e51d640 1 -- 172.21.15.44:0/3442660916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe078150f70 con 0x7fe078153e60 2023-11-04T01:36:14.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.810+0000 7fe074ff9640 1 -- 172.21.15.44:0/3442660916 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe07001e3b0 con 0x7fe078153e60 2023-11-04T01:36:14.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.810+0000 7fe074ff9640 1 --2- 172.21.15.44:0/3442660916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe06406ae70 0x7fe06406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:14.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.810+0000 7fe074ff9640 1 -- 172.21.15.44:0/3442660916 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe07008a350 con 0x7fe078153e60 2023-11-04T01:36:14.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.811+0000 7fe077fff640 1 --2- 172.21.15.44:0/3442660916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe06406ae70 0x7fe06406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:14.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.811+0000 7fe077fff640 1 --2- 172.21.15.44:0/3442660916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe06406ae70 0x7fe06406d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe078152d40 tx=0x7fe06c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:14.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:14.814+0000 7fe074ff9640 1 -- 172.21.15.44:0/3442660916 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe078150f70 con 0x7fe078153e60 2023-11-04T01:36:15.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.030+0000 7fe07e51d640 1 -- 172.21.15.44:0/3442660916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe078150f40 con 0x7fe078153e60 2023-11-04T01:36:15.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.243+0000 7fe074ff9640 1 -- 172.21.15.44:0/3442660916 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe070055110 con 0x7fe078153e60 2023-11-04T01:36:15.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.245+0000 7fe07e51d640 1 -- 172.21.15.44:0/3442660916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe06406ae70 msgr2=0x7fe06406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.245+0000 7fe07e51d640 1 --2- 172.21.15.44:0/3442660916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe06406ae70 0x7fe06406d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe078152d40 tx=0x7fe06c008040 comp rx=0 tx=0).stop 2023-11-04T01:36:15.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.245+0000 7fe07e51d640 1 -- 172.21.15.44:0/3442660916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe078153e60 msgr2=0x7fe0781f59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.245+0000 7fe07e51d640 1 --2- 172.21.15.44:0/3442660916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe078153e60 0x7fe0781f59c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe07000cef0 tx=0x7fe07000a710 comp rx=0 tx=0).stop 2023-11-04T01:36:15.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.245+0000 7fe07e51d640 1 -- 172.21.15.44:0/3442660916 shutdown_connections 2023-11-04T01:36:15.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.245+0000 7fe07e51d640 1 --2- 172.21.15.44:0/3442660916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe06406ae70 0x7fe06406d330 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.245+0000 7fe07e51d640 1 --2- 172.21.15.44:0/3442660916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe078153e60 0x7fe0781f59c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.245+0000 7fe07e51d640 1 --2- 172.21.15.44:0/3442660916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0780cd6d0 0x7fe0780c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.245+0000 7fe07e51d640 1 --2- 172.21.15.44:0/3442660916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0780b4880 0x7fe0781f1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.245+0000 7fe07e51d640 1 -- 172.21.15.44:0/3442660916 >> 172.21.15.44:0/3442660916 conn(0x7fe0780cf880 msgr2=0x7fe0780d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.245+0000 7fe07e51d640 1 -- 172.21.15.44:0/3442660916 shutdown_connections 2023-11-04T01:36:15.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.245+0000 7fe07e51d640 1 -- 172.21.15.44:0/3442660916 wait complete. 2023-11-04T01:36:15.259 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-11-04T01:36:15.259 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:36:15.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.367+0000 7fb3fed2c640 1 Processor -- start 2023-11-04T01:36:15.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.367+0000 7fb3fed2c640 1 -- start start 2023-11-04T01:36:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.368+0000 7fb3fed2c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb3f8153850 0x7fb3f815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.368+0000 7fb3fed2c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3f80cc520 0x7fb3f8070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.368+0000 7fb3fed2c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f80c3860 con 0x7fb3f80cc9a0 2023-11-04T01:36:15.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.368+0000 7fb3fed2c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f80c9250 con 0x7fb3f8153850 2023-11-04T01:36:15.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.368+0000 7fb3fed2c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f8153c30 con 0x7fb3f80cc520 2023-11-04T01:36:15.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.368+0000 7fb3f7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3f80cc520 0x7fb3f8070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.368+0000 7fb3fcac8640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb3f8153850 0x7fb3f815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.368+0000 7fb3f7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3f80cc520 0x7fb3f8070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:60194/0 (socket says 172.21.15.44:60194) 2023-11-04T01:36:15.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.368+0000 7fb3f7fff640 1 -- 172.21.15.44:0/4069557235 learned_addr learned my addr 172.21.15.44:0/4069557235 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:15.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.368+0000 7fb3fcac8640 1 -- 172.21.15.44:0/4069557235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3f80cc520 msgr2=0x7fb3f8070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:15.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.368+0000 7fb3fcac8640 1 --2- 172.21.15.44:0/4069557235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3f80cc520 0x7fb3f8070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.368+0000 7fb3fcac8640 1 -- 172.21.15.44:0/4069557235 >> v1:172.21.15.204:6789/0 conn(0x7fb3f80cc9a0 legacy=0x7fb3f80c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.368+0000 7fb3fcac8640 1 -- 172.21.15.44:0/4069557235 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f815a700 con 0x7fb3f8153850 2023-11-04T01:36:15.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.368+0000 7fb3f7fff640 1 --2- 172.21.15.44:0/4069557235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3f80cc520 0x7fb3f8070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.369+0000 7fb3fcac8640 1 --2- 172.21.15.44:0/4069557235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3f8153850 0x7fb3f815a1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009d90 tx=0x7fb3f002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6122389316d93f5f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.369+0000 7fb3f77fe640 1 -- 172.21.15.44:0/4069557235 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f002cc50 con 0x7fb3f8153850 2023-11-04T01:36:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.369+0000 7fb3f77fe640 1 -- 172.21.15.44:0/4069557235 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f002cdb0 con 0x7fb3f8153850 2023-11-04T01:36:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.369+0000 7fb3f77fe640 1 -- 172.21.15.44:0/4069557235 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0034660 con 0x7fb3f8153850 2023-11-04T01:36:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.370+0000 7fb3fed2c640 1 -- 172.21.15.44:0/4069557235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3f8153850 msgr2=0x7fb3f815a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.370+0000 7fb3fed2c640 1 --2- 172.21.15.44:0/4069557235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3f8153850 0x7fb3f815a1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009d90 tx=0x7fb3f002bea0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.370+0000 7fb3fed2c640 1 -- 172.21.15.44:0/4069557235 shutdown_connections 2023-11-04T01:36:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.370+0000 7fb3fed2c640 1 --2- 172.21.15.44:0/4069557235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3f80cc520 0x7fb3f8070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.370+0000 7fb3fed2c640 1 --2- 172.21.15.44:0/4069557235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3f8153850 0x7fb3f815a1c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.370+0000 7fb3fed2c640 1 -- 172.21.15.44:0/4069557235 >> 172.21.15.44:0/4069557235 conn(0x7fb3f80ce950 msgr2=0x7fb3f80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.370+0000 7fb3fed2c640 1 -- 172.21.15.44:0/4069557235 shutdown_connections 2023-11-04T01:36:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.370+0000 7fb3fed2c640 1 -- 172.21.15.44:0/4069557235 wait complete. 2023-11-04T01:36:15.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.371+0000 7fb3fed2c640 1 Processor -- start 2023-11-04T01:36:15.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.371+0000 7fb3fed2c640 1 -- start start 2023-11-04T01:36:15.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.372+0000 7fb3fed2c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3f80cc520 0x7fb3f80b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.372+0000 7fb3fed2c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f80cc9a0 0x7fb3f8152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.372+0000 7fb3fed2c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3f8153850 0x7fb3f815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.372+0000 7fb3fed2c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f80b24f0 con 0x7fb3f80cc9a0 2023-11-04T01:36:15.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.372+0000 7fb3fed2c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f80b3620 con 0x7fb3f8153850 2023-11-04T01:36:15.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.372+0000 7fb3fed2c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f80b3900 con 0x7fb3f80cc520 2023-11-04T01:36:15.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.372+0000 7fb3f7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f80cc9a0 0x7fb3f8152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.372+0000 7fb3f7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f80cc9a0 0x7fb3f8152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48730/0 (socket says 172.21.15.44:48730) 2023-11-04T01:36:15.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.372+0000 7fb3f7fff640 1 -- 172.21.15.44:0/3026284905 learned_addr learned my addr 172.21.15.44:0/3026284905 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:15.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.372+0000 7fb3fcac8640 1 --2- 172.21.15.44:0/3026284905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3f80cc520 0x7fb3f80b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.372+0000 7fb3fd2c9640 1 --2- 172.21.15.44:0/3026284905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3f8153850 0x7fb3f815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.372+0000 7fb3f7fff640 1 -- 172.21.15.44:0/3026284905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3f80cc520 msgr2=0x7fb3f80b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.372+0000 7fb3f7fff640 1 --2- 172.21.15.44:0/3026284905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3f80cc520 0x7fb3f80b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.373+0000 7fb3f7fff640 1 -- 172.21.15.44:0/3026284905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3f8153850 msgr2=0x7fb3f815ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.373+0000 7fb3f7fff640 1 --2- 172.21.15.44:0/3026284905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3f8153850 0x7fb3f815ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.373+0000 7fb3f7fff640 1 -- 172.21.15.44:0/3026284905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec00b760 con 0x7fb3f80cc9a0 2023-11-04T01:36:15.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.373+0000 7fb3f7fff640 1 --2- 172.21.15.44:0/3026284905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f80cc9a0 0x7fb3f8152700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00dd20 tx=0x7fb3ec0094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.373+0000 7fb3f57fa640 1 -- 172.21.15.44:0/3026284905 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec00de10 con 0x7fb3f80cc9a0 2023-11-04T01:36:15.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.373+0000 7fb3f57fa640 1 -- 172.21.15.44:0/3026284905 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec009e10 con 0x7fb3f80cc9a0 2023-11-04T01:36:15.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.373+0000 7fb3fed2c640 1 -- 172.21.15.44:0/3026284905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f0009a70 con 0x7fb3f80cc9a0 2023-11-04T01:36:15.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.373+0000 7fb3f57fa640 1 -- 172.21.15.44:0/3026284905 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec017610 con 0x7fb3f80cc9a0 2023-11-04T01:36:15.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.373+0000 7fb3fed2c640 1 -- 172.21.15.44:0/3026284905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f80b41a0 con 0x7fb3f80cc9a0 2023-11-04T01:36:15.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.374+0000 7fb3fed2c640 1 -- 172.21.15.44:0/3026284905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f8074290 con 0x7fb3f80cc9a0 2023-11-04T01:36:15.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.374+0000 7fb3f57fa640 1 -- 172.21.15.44:0/3026284905 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb3ec017770 con 0x7fb3f80cc9a0 2023-11-04T01:36:15.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.375+0000 7fb3f57fa640 1 --2- 172.21.15.44:0/3026284905 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb3e406aea0 0x7fb3e406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.375+0000 7fb3f57fa640 1 -- 172.21.15.44:0/3026284905 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb3ec00b050 con 0x7fb3f80cc9a0 2023-11-04T01:36:15.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.375+0000 7fb3fcac8640 1 --2- 172.21.15.44:0/3026284905 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb3e406aea0 0x7fb3e406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.376+0000 7fb3fcac8640 1 --2- 172.21.15.44:0/3026284905 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb3e406aea0 0x7fb3e406d360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0036000 tx=0x7fb3f0030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.379+0000 7fb3f57fa640 1 -- 172.21.15.44:0/3026284905 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb3ec054830 con 0x7fb3f80cc9a0 2023-11-04T01:36:15.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:15.590+0000 7fb3fed2c640 1 -- 172.21.15.44:0/3026284905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb3f80c5010 con 0x7fb3f80cc9a0 2023-11-04T01:36:16.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.248+0000 7fb3f57fa640 1 -- 172.21.15.44:0/3026284905 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb3ec057e50 con 0x7fb3f80cc9a0 2023-11-04T01:36:16.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.251+0000 7fb3fed2c640 1 -- 172.21.15.44:0/3026284905 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb3e406aea0 msgr2=0x7fb3e406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.251+0000 7fb3fed2c640 1 --2- 172.21.15.44:0/3026284905 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb3e406aea0 0x7fb3e406d360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0036000 tx=0x7fb3f0030000 comp rx=0 tx=0).stop 2023-11-04T01:36:16.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.251+0000 7fb3fed2c640 1 -- 172.21.15.44:0/3026284905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f80cc9a0 msgr2=0x7fb3f8152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.251+0000 7fb3fed2c640 1 --2- 172.21.15.44:0/3026284905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f80cc9a0 0x7fb3f8152700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00dd20 tx=0x7fb3ec0094f0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.251+0000 7fb3fed2c640 1 -- 172.21.15.44:0/3026284905 shutdown_connections 2023-11-04T01:36:16.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.251+0000 7fb3fed2c640 1 --2- 172.21.15.44:0/3026284905 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb3e406aea0 0x7fb3e406d360 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.251+0000 7fb3fed2c640 1 --2- 172.21.15.44:0/3026284905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3f8153850 0x7fb3f815ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.251+0000 7fb3fed2c640 1 --2- 172.21.15.44:0/3026284905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f80cc9a0 0x7fb3f8152700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.251+0000 7fb3fed2c640 1 --2- 172.21.15.44:0/3026284905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3f80cc520 0x7fb3f80b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.251+0000 7fb3fed2c640 1 -- 172.21.15.44:0/3026284905 >> 172.21.15.44:0/3026284905 conn(0x7fb3f80ce950 msgr2=0x7fb3f806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:16.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.251+0000 7fb3fed2c640 1 -- 172.21.15.44:0/3026284905 shutdown_connections 2023-11-04T01:36:16.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.251+0000 7fb3fed2c640 1 -- 172.21.15.44:0/3026284905 wait complete. 2023-11-04T01:36:16.266 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:36:16.266 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:16.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.377+0000 7fdad911d640 1 Processor -- start 2023-11-04T01:36:16.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.377+0000 7fdad911d640 1 -- start start 2023-11-04T01:36:16.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.378+0000 7fdad911d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdad415ae40 0x7fdad415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.378+0000 7fdad911d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad40cda30 0x7fdad40ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.378+0000 7fdad911d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad40cc450 con 0x7fdad40cbc00 2023-11-04T01:36:16.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.378+0000 7fdad911d640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad415f400 con 0x7fdad415ae40 2023-11-04T01:36:16.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.378+0000 7fdad911d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad415b220 con 0x7fdad40cda30 2023-11-04T01:36:16.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.378+0000 7fdad2d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdad415ae40 0x7fdad415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.378+0000 7fdad2d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdad415ae40 0x7fdad415bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48744/0 (socket says 172.21.15.44:48744) 2023-11-04T01:36:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.378+0000 7fdad2d9d640 1 -- 172.21.15.44:0/591920965 learned_addr learned my addr 172.21.15.44:0/591920965 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.378+0000 7fdad359e640 1 --2- 172.21.15.44:0/591920965 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad40cda30 0x7fdad40ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.378+0000 7fdad2d9d640 1 -- 172.21.15.44:0/591920965 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad40cda30 msgr2=0x7fdad40ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.378+0000 7fdad2d9d640 1 --2- 172.21.15.44:0/591920965 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad40cda30 0x7fdad40ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.378+0000 7fdad2d9d640 1 -- 172.21.15.44:0/591920965 >> v1:172.21.15.204:6789/0 conn(0x7fdad40cbc00 legacy=0x7fdad40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.378+0000 7fdad2d9d640 1 -- 172.21.15.44:0/591920965 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad415f890 con 0x7fdad415ae40 2023-11-04T01:36:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.379+0000 7fdad2d9d640 1 --2- 172.21.15.44:0/591920965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad415ae40 0x7fdad415bfb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009870 tx=0x7fdac402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5059eab33d18c9c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.379+0000 7fdad259c640 1 -- 172.21.15.44:0/591920965 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4031640 con 0x7fdad415ae40 2023-11-04T01:36:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.379+0000 7fdad259c640 1 -- 172.21.15.44:0/591920965 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac40317a0 con 0x7fdad415ae40 2023-11-04T01:36:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.379+0000 7fdad259c640 1 -- 172.21.15.44:0/591920965 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4031b30 con 0x7fdad415ae40 2023-11-04T01:36:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.380+0000 7fdad911d640 1 -- 172.21.15.44:0/591920965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad415ae40 msgr2=0x7fdad415bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.380+0000 7fdad911d640 1 --2- 172.21.15.44:0/591920965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad415ae40 0x7fdad415bfb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009870 tx=0x7fdac402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.380+0000 7fdad911d640 1 -- 172.21.15.44:0/591920965 shutdown_connections 2023-11-04T01:36:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.380+0000 7fdad911d640 1 --2- 172.21.15.44:0/591920965 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad40cda30 0x7fdad40ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.380+0000 7fdad911d640 1 --2- 172.21.15.44:0/591920965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad415ae40 0x7fdad415bfb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.380+0000 7fdad911d640 1 -- 172.21.15.44:0/591920965 >> 172.21.15.44:0/591920965 conn(0x7fdad406ea90 msgr2=0x7fdad406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.380+0000 7fdad911d640 1 -- 172.21.15.44:0/591920965 shutdown_connections 2023-11-04T01:36:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.380+0000 7fdad911d640 1 -- 172.21.15.44:0/591920965 wait complete. 2023-11-04T01:36:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.381+0000 7fdad911d640 1 Processor -- start 2023-11-04T01:36:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.381+0000 7fdad911d640 1 -- start start 2023-11-04T01:36:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdad911d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad40cbc00 0x7fdad40b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdad911d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad40cda30 0x7fdad4157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdad911d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdad415ae40 0x7fdad4157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdad911d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40c6840 con 0x7fdad40cbc00 2023-11-04T01:36:16.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdad911d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad414f960 con 0x7fdad415ae40 2023-11-04T01:36:16.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdad911d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40c63b0 con 0x7fdad40cda30 2023-11-04T01:36:16.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdad2d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad40cbc00 0x7fdad40b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdad2d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad40cbc00 0x7fdad40b2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48758/0 (socket says 172.21.15.44:48758) 2023-11-04T01:36:16.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdad2d9d640 1 -- 172.21.15.44:0/4212523999 learned_addr learned my addr 172.21.15.44:0/4212523999 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:16.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdacbfff640 1 --2- 172.21.15.44:0/4212523999 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad40cda30 0x7fdad4157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdad2d9d640 1 -- 172.21.15.44:0/4212523999 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad40cda30 msgr2=0x7fdad4157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdad359e640 1 --2- 172.21.15.44:0/4212523999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdad415ae40 0x7fdad4157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdad2d9d640 1 --2- 172.21.15.44:0/4212523999 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad40cda30 0x7fdad4157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdad2d9d640 1 -- 172.21.15.44:0/4212523999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdad415ae40 msgr2=0x7fdad4157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdad2d9d640 1 --2- 172.21.15.44:0/4212523999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdad415ae40 0x7fdad4157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.382+0000 7fdad2d9d640 1 -- 172.21.15.44:0/4212523999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac40094d0 con 0x7fdad40cbc00 2023-11-04T01:36:16.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.383+0000 7fdad2d9d640 1 --2- 172.21.15.44:0/4212523999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad40cbc00 0x7fdad40b2ed0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009870 tx=0x7fdac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.383+0000 7fdacb7fe640 1 -- 172.21.15.44:0/4212523999 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac403ac60 con 0x7fdad40cbc00 2023-11-04T01:36:16.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.383+0000 7fdacb7fe640 1 -- 172.21.15.44:0/4212523999 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac403adc0 con 0x7fdad40cbc00 2023-11-04T01:36:16.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.383+0000 7fdad911d640 1 -- 172.21.15.44:0/4212523999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad40c57a0 con 0x7fdad40cbc00 2023-11-04T01:36:16.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.383+0000 7fdacb7fe640 1 -- 172.21.15.44:0/4212523999 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4044630 con 0x7fdad40cbc00 2023-11-04T01:36:16.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.383+0000 7fdad911d640 1 -- 172.21.15.44:0/4212523999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad40c5d60 con 0x7fdad40cbc00 2023-11-04T01:36:16.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.384+0000 7fdad911d640 1 -- 172.21.15.44:0/4212523999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad40ce2d0 con 0x7fdad40cbc00 2023-11-04T01:36:16.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.384+0000 7fdacb7fe640 1 -- 172.21.15.44:0/4212523999 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdac402f050 con 0x7fdad40cbc00 2023-11-04T01:36:16.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.385+0000 7fdacb7fe640 1 --2- 172.21.15.44:0/4212523999 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdab406ae70 0x7fdab406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.385+0000 7fdacb7fe640 1 -- 172.21.15.44:0/4212523999 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdac40ab700 con 0x7fdad40cbc00 2023-11-04T01:36:16.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.385+0000 7fdacbfff640 1 --2- 172.21.15.44:0/4212523999 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdab406ae70 0x7fdab406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.386+0000 7fdacbfff640 1 --2- 172.21.15.44:0/4212523999 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdab406ae70 0x7fdab406d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdad40cfe50 tx=0x7fdabc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.389+0000 7fdacb7fe640 1 -- 172.21.15.44:0/4212523999 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdac40764b0 con 0x7fdad40cbc00 2023-11-04T01:36:16.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.604+0000 7fdad911d640 1 -- 172.21.15.44:0/4212523999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdad40cc450 con 0x7fdad40cbc00 2023-11-04T01:36:16.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.605+0000 7fdacb7fe640 1 -- 172.21.15.44:0/4212523999 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fdad40cc450 con 0x7fdad40cbc00 2023-11-04T01:36:16.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:16.608 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2760874964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2760874964},{"type":"v1","addr":"172.21.15.204:6836","nonce":2760874964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3427243577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3427243577},{"type":"v1","addr":"172.21.15.44:6833","nonce":3427243577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/178191500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":178191500},{"type":"v1","addr":"172.21.15.204:6837","nonce":178191500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:58.556492+0000","modified":"2023-11-04T01:36:15.592459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/240936603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":240936603},{"type":"v1","addr":"172.21.15.44:6835","nonce":240936603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:36:16.608 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2023-11-04T01:36:16.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.607+0000 7fdad911d640 1 -- 172.21.15.44:0/4212523999 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdab406ae70 msgr2=0x7fdab406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.607+0000 7fdad911d640 1 --2- 172.21.15.44:0/4212523999 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdab406ae70 0x7fdab406d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdad40cfe50 tx=0x7fdabc009040 comp rx=0 tx=0).stop 2023-11-04T01:36:16.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.607+0000 7fdad911d640 1 -- 172.21.15.44:0/4212523999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad40cbc00 msgr2=0x7fdad40b2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.607+0000 7fdad911d640 1 --2- 172.21.15.44:0/4212523999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad40cbc00 0x7fdad40b2ed0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009870 tx=0x7fdac40046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.607+0000 7fdad911d640 1 -- 172.21.15.44:0/4212523999 shutdown_connections 2023-11-04T01:36:16.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.607+0000 7fdad911d640 1 --2- 172.21.15.44:0/4212523999 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdab406ae70 0x7fdab406d330 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.607+0000 7fdad911d640 1 --2- 172.21.15.44:0/4212523999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdad415ae40 0x7fdad4157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.607+0000 7fdad911d640 1 --2- 172.21.15.44:0/4212523999 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad40cda30 0x7fdad4157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.607+0000 7fdad911d640 1 --2- 172.21.15.44:0/4212523999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad40cbc00 0x7fdad40b2ed0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.607+0000 7fdad911d640 1 -- 172.21.15.44:0/4212523999 >> 172.21.15.44:0/4212523999 conn(0x7fdad406ea90 msgr2=0x7fdad40b6340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:16.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.607+0000 7fdad911d640 1 -- 172.21.15.44:0/4212523999 shutdown_connections 2023-11-04T01:36:16.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.607+0000 7fdad911d640 1 -- 172.21.15.44:0/4212523999 wait complete. 2023-11-04T01:36:16.620 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:16.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.723+0000 7fddf83ce640 1 Processor -- start 2023-11-04T01:36:16.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.723+0000 7fddf83ce640 1 -- start start 2023-11-04T01:36:16.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.724+0000 7fddf83ce640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fddf00ce240 0x7fddf0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.724+0000 7fddf83ce640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf015e000 con 0x7fddf00cde60 2023-11-04T01:36:16.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.724+0000 7fddf83ce640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf015e2e0 con 0x7fddf0157540 2023-11-04T01:36:16.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.724+0000 7fddf83ce640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf015e5c0 con 0x7fddf00ce240 2023-11-04T01:36:16.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.724+0000 7fddf616a640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fddf00cde60 0x7fddf015d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36324/0 (socket says 172.21.15.44:36324) 2023-11-04T01:36:16.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.724+0000 7fddf616a640 1 -- 172.21.15.44:0/4107035318 learned_addr learned my addr 172.21.15.44:0/4107035318 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:16.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.725+0000 7fddf5969640 1 --2- 172.21.15.44:0/4107035318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fddf00ce240 0x7fddf0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.725+0000 7fddf5168640 1 -- 172.21.15.44:0/4107035318 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777885305 0 0) 0x7fddf015e000 con 0x7fddf00cde60 2023-11-04T01:36:16.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.725+0000 7fddf5168640 1 -- 172.21.15.44:0/4107035318 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdddc003520 con 0x7fddf00cde60 2023-11-04T01:36:16.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.725+0000 7fddf5168640 1 -- 172.21.15.44:0/4107035318 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267557484 0 0) 0x7fddf015e2e0 con 0x7fddf0157540 2023-11-04T01:36:16.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.725+0000 7fddf5168640 1 -- 172.21.15.44:0/4107035318 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf015e000 con 0x7fddf0157540 2023-11-04T01:36:16.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.725+0000 7fddf5168640 1 -- 172.21.15.44:0/4107035318 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2457613123 0 0) 0x7fdddc003520 con 0x7fddf00cde60 2023-11-04T01:36:16.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.725+0000 7fddf5969640 1 -- 172.21.15.44:0/4107035318 >> v1:172.21.15.204:6789/0 conn(0x7fddf0157540 legacy=0x7fddf00d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.725+0000 7fddf5969640 1 -- 172.21.15.44:0/4107035318 >> v1:172.21.15.44:6789/0 conn(0x7fddf00cde60 legacy=0x7fddf015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.725+0000 7fddf5969640 1 -- 172.21.15.44:0/4107035318 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf00d1120 con 0x7fddf00ce240 2023-11-04T01:36:16.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.726+0000 7fddf5969640 1 --2- 172.21.15.44:0/4107035318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fddf00ce240 0x7fddf0157000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdde00097d0 tx=0x7fdde002b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12c93d2368752baf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.726+0000 7fddf5168640 1 -- 172.21.15.44:0/4107035318 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8001670 con 0x7fddf00ce240 2023-11-04T01:36:16.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.726+0000 7fddf5168640 1 -- 172.21.15.44:0/4107035318 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde002e050 con 0x7fddf00ce240 2023-11-04T01:36:16.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.726+0000 7fddf5168640 1 -- 172.21.15.44:0/4107035318 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0030710 con 0x7fddf00ce240 2023-11-04T01:36:16.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.727+0000 7fddf83ce640 1 -- 172.21.15.44:0/4107035318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fddf00ce240 msgr2=0x7fddf0157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.727+0000 7fddf83ce640 1 --2- 172.21.15.44:0/4107035318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fddf00ce240 0x7fddf0157000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdde00097d0 tx=0x7fdde002b800 comp rx=0 tx=0).stop 2023-11-04T01:36:16.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.727+0000 7fddf83ce640 1 -- 172.21.15.44:0/4107035318 shutdown_connections 2023-11-04T01:36:16.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.727+0000 7fddf83ce640 1 --2- 172.21.15.44:0/4107035318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fddf00ce240 0x7fddf0157000 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.727+0000 7fddf83ce640 1 -- 172.21.15.44:0/4107035318 >> 172.21.15.44:0/4107035318 conn(0x7fddf0071f30 msgr2=0x7fddf00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:16.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.727+0000 7fddf83ce640 1 -- 172.21.15.44:0/4107035318 shutdown_connections 2023-11-04T01:36:16.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.727+0000 7fddf83ce640 1 -- 172.21.15.44:0/4107035318 wait complete. 2023-11-04T01:36:16.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.728+0000 7fddf83ce640 1 Processor -- start 2023-11-04T01:36:16.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.728+0000 7fddf83ce640 1 -- start start 2023-11-04T01:36:16.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf83ce640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fddf00cde60 0x7fddf00ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf83ce640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fddf00ce240 0x7fddf00cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf83ce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddf0157540 0x7fddf01f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf83ce640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf01f30d0 con 0x7fddf0157540 2023-11-04T01:36:16.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf83ce640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf01f33b0 con 0x7fddf00ce240 2023-11-04T01:36:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf83ce640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf00ca090 con 0x7fddf00cde60 2023-11-04T01:36:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf696b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddf0157540 0x7fddf01f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf696b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddf0157540 0x7fddf01f26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48762/0 (socket says 172.21.15.44:48762) 2023-11-04T01:36:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf696b640 1 -- 172.21.15.44:0/3080637223 learned_addr learned my addr 172.21.15.44:0/3080637223 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf616a640 1 --2- 172.21.15.44:0/3080637223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fddf00cde60 0x7fddf00ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf5969640 1 --2- 172.21.15.44:0/3080637223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fddf00ce240 0x7fddf00cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf696b640 1 -- 172.21.15.44:0/3080637223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fddf00cde60 msgr2=0x7fddf00ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf696b640 1 --2- 172.21.15.44:0/3080637223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fddf00cde60 0x7fddf00ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf696b640 1 -- 172.21.15.44:0/3080637223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fddf00ce240 msgr2=0x7fddf00cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf696b640 1 --2- 172.21.15.44:0/3080637223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fddf00ce240 0x7fddf00cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf696b640 1 -- 172.21.15.44:0/3080637223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde0009400 con 0x7fddf0157540 2023-11-04T01:36:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf696b640 1 --2- 172.21.15.44:0/3080637223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddf0157540 0x7fddf01f26a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fddec00c6e0 tx=0x7fddec00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fdde6ffd640 1 -- 172.21.15.44:0/3080637223 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec003b70 con 0x7fddf0157540 2023-11-04T01:36:16.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fdde6ffd640 1 -- 172.21.15.44:0/3080637223 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec003cd0 con 0x7fddf0157540 2023-11-04T01:36:16.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fdde6ffd640 1 -- 172.21.15.44:0/3080637223 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0052d0 con 0x7fddf0157540 2023-11-04T01:36:16.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf83ce640 1 -- 172.21.15.44:0/3080637223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf00ca370 con 0x7fddf0157540 2023-11-04T01:36:16.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.729+0000 7fddf83ce640 1 -- 172.21.15.44:0/3080637223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf00ccdb0 con 0x7fddf0157540 2023-11-04T01:36:16.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.730+0000 7fddf83ce640 1 -- 172.21.15.44:0/3080637223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf00c9ef0 con 0x7fddf0157540 2023-11-04T01:36:16.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.731+0000 7fdde6ffd640 1 -- 172.21.15.44:0/3080637223 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fddec005430 con 0x7fddf0157540 2023-11-04T01:36:16.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.731+0000 7fdde6ffd640 1 --2- 172.21.15.44:0/3080637223 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fddd406ae70 0x7fddd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.731+0000 7fdde6ffd640 1 -- 172.21.15.44:0/3080637223 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fddec0896f0 con 0x7fddf0157540 2023-11-04T01:36:16.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.732+0000 7fddf616a640 1 --2- 172.21.15.44:0/3080637223 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fddd406ae70 0x7fddd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.732+0000 7fddf616a640 1 --2- 172.21.15.44:0/3080637223 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fddd406ae70 0x7fddd406d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdde80011e0 tx=0x7fdde8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.736+0000 7fdde6ffd640 1 -- 172.21.15.44:0/3080637223 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fddf00c9ef0 con 0x7fddf0157540 2023-11-04T01:36:16.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.913+0000 7fddf83ce640 1 -- 172.21.15.44:0/3080637223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddf00c9ef0 con 0x7fddf0157540 2023-11-04T01:36:16.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.914+0000 7fdde6ffd640 1 -- 172.21.15.44:0/3080637223 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fddf00c9ef0 con 0x7fddf0157540 2023-11-04T01:36:16.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:16.917 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:03.589395+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:16.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.916+0000 7fddf83ce640 1 -- 172.21.15.44:0/3080637223 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fddd406ae70 msgr2=0x7fddd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.916+0000 7fddf83ce640 1 --2- 172.21.15.44:0/3080637223 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fddd406ae70 0x7fddd406d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdde80011e0 tx=0x7fdde8009040 comp rx=0 tx=0).stop 2023-11-04T01:36:16.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.916+0000 7fddf83ce640 1 -- 172.21.15.44:0/3080637223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddf0157540 msgr2=0x7fddf01f26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.916+0000 7fddf83ce640 1 --2- 172.21.15.44:0/3080637223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddf0157540 0x7fddf01f26a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fddec00c6e0 tx=0x7fddec00cba0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.916+0000 7fddf83ce640 1 -- 172.21.15.44:0/3080637223 shutdown_connections 2023-11-04T01:36:16.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.916+0000 7fddf83ce640 1 --2- 172.21.15.44:0/3080637223 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fddd406ae70 0x7fddd406d330 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.916+0000 7fddf83ce640 1 --2- 172.21.15.44:0/3080637223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddf0157540 0x7fddf01f26a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.916+0000 7fddf83ce640 1 --2- 172.21.15.44:0/3080637223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fddf00ce240 0x7fddf00cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.916+0000 7fddf83ce640 1 --2- 172.21.15.44:0/3080637223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fddf00cde60 0x7fddf00ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.916+0000 7fddf83ce640 1 -- 172.21.15.44:0/3080637223 >> 172.21.15.44:0/3080637223 conn(0x7fddf0071f30 msgr2=0x7fddf00cf660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:16.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.916+0000 7fddf83ce640 1 -- 172.21.15.44:0/3080637223 shutdown_connections 2023-11-04T01:36:16.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:16.916+0000 7fddf83ce640 1 -- 172.21.15.44:0/3080637223 wait complete. 2023-11-04T01:36:16.929 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:36:16.929 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:36:17.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.033+0000 7f8c69f89640 1 Processor -- start 2023-11-04T01:36:17.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.033+0000 7f8c69f89640 1 -- start start 2023-11-04T01:36:17.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.034+0000 7f8c69f89640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8c640ce240 0x7f8c64157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.034+0000 7f8c69f89640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c64157540 0x7f8c640d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.034+0000 7f8c69f89640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6415e000 con 0x7f8c640cde60 2023-11-04T01:36:17.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.034+0000 7f8c69f89640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6415e5c0 con 0x7f8c640ce240 2023-11-04T01:36:17.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.034+0000 7f8c69f89640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6415e2e0 con 0x7f8c64157540 2023-11-04T01:36:17.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.034+0000 7f8c62ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8c640ce240 0x7f8c64157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.034+0000 7f8c62ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8c640ce240 0x7f8c64157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48774/0 (socket says 172.21.15.44:48774) 2023-11-04T01:36:17.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.034+0000 7f8c62ffd640 1 -- 172.21.15.44:0/3172419581 learned_addr learned my addr 172.21.15.44:0/3172419581 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:17.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.034+0000 7f8c63fff640 1 --2- 172.21.15.44:0/3172419581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c64157540 0x7f8c640d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.035+0000 7f8c62ffd640 1 -- 172.21.15.44:0/3172419581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c64157540 msgr2=0x7f8c640d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:17.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.035+0000 7f8c62ffd640 1 --2- 172.21.15.44:0/3172419581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c64157540 0x7f8c640d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.035+0000 7f8c62ffd640 1 -- 172.21.15.44:0/3172419581 >> v1:172.21.15.204:6789/0 conn(0x7f8c640cde60 legacy=0x7f8c6415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.035+0000 7f8c62ffd640 1 -- 172.21.15.44:0/3172419581 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c640d1120 con 0x7f8c640ce240 2023-11-04T01:36:17.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.035+0000 7f8c62ffd640 1 --2- 172.21.15.44:0/3172419581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c640ce240 0x7f8c64157000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009870 tx=0x7f8c5802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a954a90b4755d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.035+0000 7f8c627fc640 1 -- 172.21.15.44:0/3172419581 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58030840 con 0x7f8c640ce240 2023-11-04T01:36:17.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.035+0000 7f8c627fc640 1 -- 172.21.15.44:0/3172419581 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c580309a0 con 0x7f8c640ce240 2023-11-04T01:36:17.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.036+0000 7f8c627fc640 1 -- 172.21.15.44:0/3172419581 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58030d30 con 0x7f8c640ce240 2023-11-04T01:36:17.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.036+0000 7f8c69f89640 1 -- 172.21.15.44:0/3172419581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c640ce240 msgr2=0x7f8c64157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.036+0000 7f8c69f89640 1 --2- 172.21.15.44:0/3172419581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c640ce240 0x7f8c64157000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009870 tx=0x7f8c5802b980 comp rx=0 tx=0).stop 2023-11-04T01:36:17.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.036+0000 7f8c69f89640 1 -- 172.21.15.44:0/3172419581 shutdown_connections 2023-11-04T01:36:17.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.036+0000 7f8c69f89640 1 --2- 172.21.15.44:0/3172419581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c64157540 0x7f8c640d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.036+0000 7f8c69f89640 1 --2- 172.21.15.44:0/3172419581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c640ce240 0x7f8c64157000 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.036+0000 7f8c69f89640 1 -- 172.21.15.44:0/3172419581 >> 172.21.15.44:0/3172419581 conn(0x7f8c64071f30 msgr2=0x7f8c640cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:17.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.036+0000 7f8c69f89640 1 -- 172.21.15.44:0/3172419581 shutdown_connections 2023-11-04T01:36:17.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.036+0000 7f8c69f89640 1 -- 172.21.15.44:0/3172419581 wait complete. 2023-11-04T01:36:17.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.037+0000 7f8c69f89640 1 Processor -- start 2023-11-04T01:36:17.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.037+0000 7f8c69f89640 1 -- start start 2023-11-04T01:36:17.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.038+0000 7f8c69f89640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c640cde60 0x7f8c641f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.038+0000 7f8c69f89640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c640ce240 0x7f8c64153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.038+0000 7f8c69f89640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c64157540 0x7f8c64159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.038+0000 7f8c69f89640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c64158b90 con 0x7f8c640ce240 2023-11-04T01:36:17.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.038+0000 7f8c69f89640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c64157f80 con 0x7f8c640cde60 2023-11-04T01:36:17.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.038+0000 7f8c69f89640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c64158260 con 0x7f8c64157540 2023-11-04T01:36:17.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.038+0000 7f8c62ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c640ce240 0x7f8c64153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.038+0000 7f8c62ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c640ce240 0x7f8c64153350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48790/0 (socket says 172.21.15.44:48790) 2023-11-04T01:36:17.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.038+0000 7f8c62ffd640 1 -- 172.21.15.44:0/130701874 learned_addr learned my addr 172.21.15.44:0/130701874 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:17.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.039+0000 7f8c637fe640 1 --2- 172.21.15.44:0/130701874 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c640cde60 0x7f8c641f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.039+0000 7f8c63fff640 1 --2- 172.21.15.44:0/130701874 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c64157540 0x7f8c64159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.039+0000 7f8c62ffd640 1 -- 172.21.15.44:0/130701874 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c64157540 msgr2=0x7f8c64159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.039+0000 7f8c62ffd640 1 --2- 172.21.15.44:0/130701874 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c64157540 0x7f8c64159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.039+0000 7f8c62ffd640 1 -- 172.21.15.44:0/130701874 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c640cde60 msgr2=0x7f8c641f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.039+0000 7f8c62ffd640 1 --2- 172.21.15.44:0/130701874 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c640cde60 0x7f8c641f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.039+0000 7f8c62ffd640 1 -- 172.21.15.44:0/130701874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c580094d0 con 0x7f8c640ce240 2023-11-04T01:36:17.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.039+0000 7f8c62ffd640 1 --2- 172.21.15.44:0/130701874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c640ce240 0x7f8c64153350 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8c58000c00 tx=0x7f8c58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.039+0000 7f8c4bfff640 1 -- 172.21.15.44:0/130701874 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58039c90 con 0x7f8c640ce240 2023-11-04T01:36:17.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.039+0000 7f8c4bfff640 1 -- 172.21.15.44:0/130701874 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c58039df0 con 0x7f8c640ce240 2023-11-04T01:36:17.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.039+0000 7f8c69f89640 1 -- 172.21.15.44:0/130701874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c64158540 con 0x7f8c640ce240 2023-11-04T01:36:17.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.039+0000 7f8c4bfff640 1 -- 172.21.15.44:0/130701874 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58043640 con 0x7f8c640ce240 2023-11-04T01:36:17.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.039+0000 7f8c69f89640 1 -- 172.21.15.44:0/130701874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c640cc6f0 con 0x7f8c640ce240 2023-11-04T01:36:17.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.040+0000 7f8c69f89640 1 -- 172.21.15.44:0/130701874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6415b190 con 0x7f8c640ce240 2023-11-04T01:36:17.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.040+0000 7f8c4bfff640 1 -- 172.21.15.44:0/130701874 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c580437a0 con 0x7f8c640ce240 2023-11-04T01:36:17.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.041+0000 7f8c4bfff640 1 --2- 172.21.15.44:0/130701874 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8c5006ae40 0x7f8c5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.041+0000 7f8c4bfff640 1 -- 172.21.15.44:0/130701874 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c5803e070 con 0x7f8c640ce240 2023-11-04T01:36:17.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.041+0000 7f8c637fe640 1 --2- 172.21.15.44:0/130701874 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8c5006ae40 0x7f8c5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.042+0000 7f8c637fe640 1 --2- 172.21.15.44:0/130701874 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8c5006ae40 0x7f8c5006d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8c54000f60 tx=0x7f8c54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.045+0000 7f8c4bfff640 1 -- 172.21.15.44:0/130701874 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8c580776f0 con 0x7f8c640ce240 2023-11-04T01:36:17.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.217+0000 7f8c69f89640 1 -- 172.21.15.44:0/130701874 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c640d1400 con 0x7f8c5006ae40 2023-11-04T01:36:17.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.227+0000 7f8c4bfff640 1 -- 172.21.15.44:0/130701874 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345286 (secure 0 0 0) 0x7f8c540014a0 con 0x7f8c5006ae40 2023-11-04T01:36:17.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:36:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.230+0000 7f8c69f89640 1 -- 172.21.15.44:0/130701874 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8c5006ae40 msgr2=0x7f8c5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.230+0000 7f8c69f89640 1 --2- 172.21.15.44:0/130701874 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8c5006ae40 0x7f8c5006d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8c54000f60 tx=0x7f8c54009040 comp rx=0 tx=0).stop 2023-11-04T01:36:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.230+0000 7f8c69f89640 1 -- 172.21.15.44:0/130701874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c640ce240 msgr2=0x7f8c64153350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.230+0000 7f8c69f89640 1 --2- 172.21.15.44:0/130701874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c640ce240 0x7f8c64153350 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8c58000c00 tx=0x7f8c58004730 comp rx=0 tx=0).stop 2023-11-04T01:36:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.230+0000 7f8c69f89640 1 -- 172.21.15.44:0/130701874 shutdown_connections 2023-11-04T01:36:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.230+0000 7f8c69f89640 1 --2- 172.21.15.44:0/130701874 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8c5006ae40 0x7f8c5006d300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.230+0000 7f8c69f89640 1 --2- 172.21.15.44:0/130701874 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c64157540 0x7f8c64159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.230+0000 7f8c69f89640 1 --2- 172.21.15.44:0/130701874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c640ce240 0x7f8c64153350 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.230+0000 7f8c69f89640 1 --2- 172.21.15.44:0/130701874 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c640cde60 0x7f8c641f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.230+0000 7f8c69f89640 1 -- 172.21.15.44:0/130701874 >> 172.21.15.44:0/130701874 conn(0x7f8c64071f30 msgr2=0x7f8c64072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.231+0000 7f8c69f89640 1 -- 172.21.15.44:0/130701874 shutdown_connections 2023-11-04T01:36:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.231+0000 7f8c69f89640 1 -- 172.21.15.44:0/130701874 wait complete. 2023-11-04T01:36:17.243 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-11-04T01:36:16.576139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594866,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3280896,"data_stored":1987049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2088,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003094"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233378+0000","last_change":"2023-11-04T01:35:58.195271+0000","last_active":"2023-11-04T01:36:03.233378+0000","last_peered":"2023-11-04T01:36:03.233378+0000","last_clean":"2023-11-04T01:36:03.233378+0000","last_became_active":"2023-11-04T01:35:58.194946+0000","last_became_peered":"2023-11-04T01:35:58.194946+0000","last_unstale":"2023-11-04T01:36:03.233378+0000","last_undegraded":"2023-11-04T01:36:03.233378+0000","last_fullsized":"2023-11-04T01:36:03.233378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:46.133808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220450+0000","last_change":"2023-11-04T01:35:59.179018+0000","last_active":"2023-11-04T01:36:03.220450+0000","last_peered":"2023-11-04T01:36:03.220450+0000","last_clean":"2023-11-04T01:36:03.220450+0000","last_became_active":"2023-11-04T01:35:59.178607+0000","last_became_peered":"2023-11-04T01:35:59.178607+0000","last_unstale":"2023-11-04T01:36:03.220450+0000","last_undegraded":"2023-11-04T01:36:03.220450+0000","last_fullsized":"2023-11-04T01:36:03.220450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164443+0000","last_change":"2023-11-04T01:36:03.421566+0000","last_active":"2023-11-04T01:36:04.164443+0000","last_peered":"2023-11-04T01:36:04.164443+0000","last_clean":"2023-11-04T01:36:04.164443+0000","last_became_active":"2023-11-04T01:36:03.420841+0000","last_became_peered":"2023-11-04T01:36:03.420841+0000","last_unstale":"2023-11-04T01:36:04.164443+0000","last_undegraded":"2023-11-04T01:36:04.164443+0000","last_fullsized":"2023-11-04T01:36:04.164443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:09.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220481+0000","last_change":"2023-11-04T01:35:58.192868+0000","last_active":"2023-11-04T01:36:03.220481+0000","last_peered":"2023-11-04T01:36:03.220481+0000","last_clean":"2023-11-04T01:36:03.220481+0000","last_became_active":"2023-11-04T01:35:58.192539+0000","last_became_peered":"2023-11-04T01:35:58.192539+0000","last_unstale":"2023-11-04T01:36:03.220481+0000","last_undegraded":"2023-11-04T01:36:03.220481+0000","last_fullsized":"2023-11-04T01:36:03.220481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:56.079264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231660+0000","last_change":"2023-11-04T01:35:59.188981+0000","last_active":"2023-11-04T01:36:03.231660+0000","last_peered":"2023-11-04T01:36:03.231660+0000","last_clean":"2023-11-04T01:36:03.231660+0000","last_became_active":"2023-11-04T01:35:59.188652+0000","last_became_peered":"2023-11-04T01:35:59.188652+0000","last_unstale":"2023-11-04T01:36:03.231660+0000","last_undegraded":"2023-11-04T01:36:03.231660+0000","last_fullsized":"2023-11-04T01:36:03.231660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165630+0000","last_change":"2023-11-04T01:36:03.236391+0000","last_active":"2023-11-04T01:36:04.165630+0000","last_peered":"2023-11-04T01:36:04.165630+0000","last_clean":"2023-11-04T01:36:04.165630+0000","last_became_active":"2023-11-04T01:36:03.235906+0000","last_became_peered":"2023-11-04T01:36:03.235906+0000","last_unstale":"2023-11-04T01:36:04.165630+0000","last_undegraded":"2023-11-04T01:36:04.165630+0000","last_fullsized":"2023-11-04T01:36:04.165630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:35.196927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418151+0000","last_change":"2023-11-04T01:35:58.197184+0000","last_active":"2023-11-04T01:36:03.418151+0000","last_peered":"2023-11-04T01:36:03.418151+0000","last_clean":"2023-11-04T01:36:03.418151+0000","last_became_active":"2023-11-04T01:35:58.196766+0000","last_became_peered":"2023-11-04T01:35:58.196766+0000","last_unstale":"2023-11-04T01:36:03.418151+0000","last_undegraded":"2023-11-04T01:36:03.418151+0000","last_fullsized":"2023-11-04T01:36:03.418151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:04.765423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228152+0000","last_change":"2023-11-04T01:35:59.189310+0000","last_active":"2023-11-04T01:36:03.228152+0000","last_peered":"2023-11-04T01:36:03.228152+0000","last_clean":"2023-11-04T01:36:03.228152+0000","last_became_active":"2023-11-04T01:35:59.189034+0000","last_became_peered":"2023-11-04T01:35:59.189034+0000","last_unstale":"2023-11-04T01:36:03.228152+0000","last_undegraded":"2023-11-04T01:36:03.228152+0000","last_fullsized":"2023-11-04T01:36:03.228152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:31.045884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165630+0000","last_change":"2023-11-04T01:36:03.237859+0000","last_active":"2023-11-04T01:36:04.165630+0000","last_peered":"2023-11-04T01:36:04.165630+0000","last_clean":"2023-11-04T01:36:04.165630+0000","last_became_active":"2023-11-04T01:36:03.237472+0000","last_became_peered":"2023-11-04T01:36:03.237472+0000","last_unstale":"2023-11-04T01:36:04.165630+0000","last_undegraded":"2023-11-04T01:36:04.165630+0000","last_fullsized":"2023-11-04T01:36:04.165630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:47.574623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417583+0000","last_change":"2023-11-04T01:35:58.196082+0000","last_active":"2023-11-04T01:36:03.417583+0000","last_peered":"2023-11-04T01:36:03.417583+0000","last_clean":"2023-11-04T01:36:03.417583+0000","last_became_active":"2023-11-04T01:35:58.195823+0000","last_became_peered":"2023-11-04T01:35:58.195823+0000","last_unstale":"2023-11-04T01:36:03.417583+0000","last_undegraded":"2023-11-04T01:36:03.417583+0000","last_fullsized":"2023-11-04T01:36:03.417583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227869+0000","last_change":"2023-11-04T01:35:59.182650+0000","last_active":"2023-11-04T01:36:03.227869+0000","last_peered":"2023-11-04T01:36:03.227869+0000","last_clean":"2023-11-04T01:36:03.227869+0000","last_became_active":"2023-11-04T01:35:59.182397+0000","last_became_peered":"2023-11-04T01:35:59.182397+0000","last_unstale":"2023-11-04T01:36:03.227869+0000","last_undegraded":"2023-11-04T01:36:03.227869+0000","last_fullsized":"2023-11-04T01:36:03.227869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165302+0000","last_change":"2023-11-04T01:36:03.238226+0000","last_active":"2023-11-04T01:36:04.165302+0000","last_peered":"2023-11-04T01:36:04.165302+0000","last_clean":"2023-11-04T01:36:04.165302+0000","last_became_active":"2023-11-04T01:36:03.237796+0000","last_became_peered":"2023-11-04T01:36:03.237796+0000","last_unstale":"2023-11-04T01:36:04.165302+0000","last_undegraded":"2023-11-04T01:36:04.165302+0000","last_fullsized":"2023-11-04T01:36:04.165302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:56.134800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223628+0000","last_change":"2023-11-04T01:35:59.175182+0000","last_active":"2023-11-04T01:36:03.223628+0000","last_peered":"2023-11-04T01:36:03.223628+0000","last_clean":"2023-11-04T01:36:03.223628+0000","last_became_active":"2023-11-04T01:35:59.174889+0000","last_became_peered":"2023-11-04T01:35:59.174889+0000","last_unstale":"2023-11-04T01:36:03.223628+0000","last_undegraded":"2023-11-04T01:36:03.223628+0000","last_fullsized":"2023-11-04T01:36:03.223628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417641+0000","last_change":"2023-11-04T01:35:58.191418+0000","last_active":"2023-11-04T01:36:03.417641+0000","last_peered":"2023-11-04T01:36:03.417641+0000","last_clean":"2023-11-04T01:36:03.417641+0000","last_became_active":"2023-11-04T01:35:58.191164+0000","last_became_peered":"2023-11-04T01:35:58.191164+0000","last_unstale":"2023-11-04T01:36:03.417641+0000","last_undegraded":"2023-11-04T01:36:03.417641+0000","last_fullsized":"2023-11-04T01:36:03.417641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:56.366802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.166438+0000","last_change":"2023-11-04T01:36:03.238741+0000","last_active":"2023-11-04T01:36:04.166438+0000","last_peered":"2023-11-04T01:36:04.166438+0000","last_clean":"2023-11-04T01:36:04.166438+0000","last_became_active":"2023-11-04T01:36:03.238130+0000","last_became_peered":"2023-11-04T01:36:03.238130+0000","last_unstale":"2023-11-04T01:36:04.166438+0000","last_undegraded":"2023-11-04T01:36:04.166438+0000","last_fullsized":"2023-11-04T01:36:04.166438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:51.792275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219755+0000","last_change":"2023-11-04T01:35:59.181378+0000","last_active":"2023-11-04T01:36:03.219755+0000","last_peered":"2023-11-04T01:36:03.219755+0000","last_clean":"2023-11-04T01:36:03.219755+0000","last_became_active":"2023-11-04T01:35:59.180852+0000","last_became_peered":"2023-11-04T01:35:59.180852+0000","last_unstale":"2023-11-04T01:36:03.219755+0000","last_undegraded":"2023-11-04T01:36:03.219755+0000","last_fullsized":"2023-11-04T01:36:03.219755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.235667+0000","last_change":"2023-11-04T01:35:58.192955+0000","last_active":"2023-11-04T01:36:03.235667+0000","last_peered":"2023-11-04T01:36:03.235667+0000","last_clean":"2023-11-04T01:36:03.235667+0000","last_became_active":"2023-11-04T01:35:58.192609+0000","last_became_peered":"2023-11-04T01:35:58.192609+0000","last_unstale":"2023-11-04T01:36:03.235667+0000","last_undegraded":"2023-11-04T01:36:03.235667+0000","last_fullsized":"2023-11-04T01:36:03.235667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165731+0000","last_change":"2023-11-04T01:36:03.239699+0000","last_active":"2023-11-04T01:36:04.165731+0000","last_peered":"2023-11-04T01:36:04.165731+0000","last_clean":"2023-11-04T01:36:04.165731+0000","last_became_active":"2023-11-04T01:36:03.239146+0000","last_became_peered":"2023-11-04T01:36:03.239146+0000","last_unstale":"2023-11-04T01:36:04.165731+0000","last_undegraded":"2023-11-04T01:36:04.165731+0000","last_fullsized":"2023-11-04T01:36:04.165731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:50.421408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220829+0000","last_change":"2023-11-04T01:35:59.179889+0000","last_active":"2023-11-04T01:36:03.220829+0000","last_peered":"2023-11-04T01:36:03.220829+0000","last_clean":"2023-11-04T01:36:03.220829+0000","last_became_active":"2023-11-04T01:35:59.178416+0000","last_became_peered":"2023-11-04T01:35:59.178416+0000","last_unstale":"2023-11-04T01:36:03.220829+0000","last_undegraded":"2023-11-04T01:36:03.220829+0000","last_fullsized":"2023-11-04T01:36:03.220829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234302+0000","last_change":"2023-11-04T01:35:58.193758+0000","last_active":"2023-11-04T01:36:03.234302+0000","last_peered":"2023-11-04T01:36:03.234302+0000","last_clean":"2023-11-04T01:36:03.234302+0000","last_became_active":"2023-11-04T01:35:58.191341+0000","last_became_peered":"2023-11-04T01:35:58.191341+0000","last_unstale":"2023-11-04T01:36:03.234302+0000","last_undegraded":"2023-11-04T01:36:03.234302+0000","last_fullsized":"2023-11-04T01:36:03.234302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:46.133808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360658+0000","last_change":"2023-11-04T01:36:03.419927+0000","last_active":"2023-11-04T01:36:05.360658+0000","last_peered":"2023-11-04T01:36:05.360658+0000","last_clean":"2023-11-04T01:36:05.360658+0000","last_became_active":"2023-11-04T01:36:03.419458+0000","last_became_peered":"2023-11-04T01:36:03.419458+0000","last_unstale":"2023-11-04T01:36:05.360658+0000","last_undegraded":"2023-11-04T01:36:05.360658+0000","last_fullsized":"2023-11-04T01:36:05.360658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:55.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.222904+0000","last_change":"2023-11-04T01:35:59.178344+0000","last_active":"2023-11-04T01:36:03.222904+0000","last_peered":"2023-11-04T01:36:03.222904+0000","last_clean":"2023-11-04T01:36:03.222904+0000","last_became_active":"2023-11-04T01:35:59.178069+0000","last_became_peered":"2023-11-04T01:35:59.178069+0000","last_unstale":"2023-11-04T01:36:03.222904+0000","last_undegraded":"2023-11-04T01:36:03.222904+0000","last_fullsized":"2023-11-04T01:36:03.222904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:17:14.967316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417197+0000","last_change":"2023-11-04T01:35:58.198451+0000","last_active":"2023-11-04T01:36:03.417197+0000","last_peered":"2023-11-04T01:36:03.417197+0000","last_clean":"2023-11-04T01:36:03.417197+0000","last_became_active":"2023-11-04T01:35:58.198191+0000","last_became_peered":"2023-11-04T01:35:58.198191+0000","last_unstale":"2023-11-04T01:36:03.417197+0000","last_undegraded":"2023-11-04T01:36:03.417197+0000","last_fullsized":"2023-11-04T01:36:03.417197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:17:13.959681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.166193+0000","last_change":"2023-11-04T01:36:03.239679+0000","last_active":"2023-11-04T01:36:04.166193+0000","last_peered":"2023-11-04T01:36:04.166193+0000","last_clean":"2023-11-04T01:36:04.166193+0000","last_became_active":"2023-11-04T01:36:03.239148+0000","last_became_peered":"2023-11-04T01:36:03.239148+0000","last_unstale":"2023-11-04T01:36:04.166193+0000","last_undegraded":"2023-11-04T01:36:04.166193+0000","last_fullsized":"2023-11-04T01:36:04.166193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:35.083514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233606+0000","last_change":"2023-11-04T01:35:59.179921+0000","last_active":"2023-11-04T01:36:03.233606+0000","last_peered":"2023-11-04T01:36:03.233606+0000","last_clean":"2023-11-04T01:36:03.233606+0000","last_became_active":"2023-11-04T01:35:59.179555+0000","last_became_peered":"2023-11-04T01:35:59.179555+0000","last_unstale":"2023-11-04T01:36:03.233606+0000","last_undegraded":"2023-11-04T01:36:03.233606+0000","last_fullsized":"2023-11-04T01:36:03.233606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224666+0000","last_change":"2023-11-04T01:35:58.194520+0000","last_active":"2023-11-04T01:36:03.224666+0000","last_peered":"2023-11-04T01:36:03.224666+0000","last_clean":"2023-11-04T01:36:03.224666+0000","last_became_active":"2023-11-04T01:35:58.193227+0000","last_became_peered":"2023-11-04T01:35:58.193227+0000","last_unstale":"2023-11-04T01:36:03.224666+0000","last_undegraded":"2023-11-04T01:36:03.224666+0000","last_fullsized":"2023-11-04T01:36:03.224666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:56.079264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165353+0000","last_change":"2023-11-04T01:36:03.422666+0000","last_active":"2023-11-04T01:36:04.165353+0000","last_peered":"2023-11-04T01:36:04.165353+0000","last_clean":"2023-11-04T01:36:04.165353+0000","last_became_active":"2023-11-04T01:36:03.422271+0000","last_became_peered":"2023-11-04T01:36:03.422271+0000","last_unstale":"2023-11-04T01:36:04.165353+0000","last_undegraded":"2023-11-04T01:36:04.165353+0000","last_fullsized":"2023-11-04T01:36:04.165353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:00.309557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219727+0000","last_change":"2023-11-04T01:35:59.183456+0000","last_active":"2023-11-04T01:36:03.219727+0000","last_peered":"2023-11-04T01:36:03.219727+0000","last_clean":"2023-11-04T01:36:03.219727+0000","last_became_active":"2023-11-04T01:35:59.182344+0000","last_became_peered":"2023-11-04T01:35:59.182344+0000","last_unstale":"2023-11-04T01:36:03.219727+0000","last_undegraded":"2023-11-04T01:36:03.219727+0000","last_fullsized":"2023-11-04T01:36:03.219727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.237645+0000","last_change":"2023-11-04T01:35:58.193617+0000","last_active":"2023-11-04T01:36:03.237645+0000","last_peered":"2023-11-04T01:36:03.237645+0000","last_clean":"2023-11-04T01:36:03.237645+0000","last_became_active":"2023-11-04T01:35:58.193111+0000","last_became_peered":"2023-11-04T01:35:58.193111+0000","last_unstale":"2023-11-04T01:36:03.237645+0000","last_undegraded":"2023-11-04T01:36:03.237645+0000","last_fullsized":"2023-11-04T01:36:03.237645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:56.079264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164341+0000","last_change":"2023-11-04T01:36:03.418076+0000","last_active":"2023-11-04T01:36:04.164341+0000","last_peered":"2023-11-04T01:36:04.164341+0000","last_clean":"2023-11-04T01:36:04.164341+0000","last_became_active":"2023-11-04T01:36:03.417662+0000","last_became_peered":"2023-11-04T01:36:03.417662+0000","last_unstale":"2023-11-04T01:36:04.164341+0000","last_undegraded":"2023-11-04T01:36:04.164341+0000","last_fullsized":"2023-11-04T01:36:04.164341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:55.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234516+0000","last_change":"2023-11-04T01:35:59.177457+0000","last_active":"2023-11-04T01:36:03.234516+0000","last_peered":"2023-11-04T01:36:03.234516+0000","last_clean":"2023-11-04T01:36:03.234516+0000","last_became_active":"2023-11-04T01:35:59.177119+0000","last_became_peered":"2023-11-04T01:35:59.177119+0000","last_unstale":"2023-11-04T01:36:03.234516+0000","last_undegraded":"2023-11-04T01:36:03.234516+0000","last_fullsized":"2023-11-04T01:36:03.234516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418829+0000","last_change":"2023-11-04T01:35:58.198460+0000","last_active":"2023-11-04T01:36:03.418829+0000","last_peered":"2023-11-04T01:36:03.418829+0000","last_clean":"2023-11-04T01:36:03.418829+0000","last_became_active":"2023-11-04T01:35:58.198149+0000","last_became_peered":"2023-11-04T01:35:58.198149+0000","last_unstale":"2023-11-04T01:36:03.418829+0000","last_undegraded":"2023-11-04T01:36:03.418829+0000","last_fullsized":"2023-11-04T01:36:03.418829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:37.379069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.113926+0000","last_change":"2023-11-04T01:36:03.418067+0000","last_active":"2023-11-04T01:36:05.113926+0000","last_peered":"2023-11-04T01:36:05.113926+0000","last_clean":"2023-11-04T01:36:05.113926+0000","last_became_active":"2023-11-04T01:36:03.417580+0000","last_became_peered":"2023-11-04T01:36:03.417580+0000","last_unstale":"2023-11-04T01:36:05.113926+0000","last_undegraded":"2023-11-04T01:36:05.113926+0000","last_fullsized":"2023-11-04T01:36:05.113926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:02.636600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228055+0000","last_change":"2023-11-04T01:35:59.181672+0000","last_active":"2023-11-04T01:36:03.228055+0000","last_peered":"2023-11-04T01:36:03.228055+0000","last_clean":"2023-11-04T01:36:03.228055+0000","last_became_active":"2023-11-04T01:35:59.181366+0000","last_became_peered":"2023-11-04T01:35:59.181366+0000","last_unstale":"2023-11-04T01:36:03.228055+0000","last_undegraded":"2023-11-04T01:36:03.228055+0000","last_fullsized":"2023-11-04T01:36:03.228055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:41.888526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234512+0000","last_change":"2023-11-04T01:35:58.198371+0000","last_active":"2023-11-04T01:36:03.234512+0000","last_peered":"2023-11-04T01:36:03.234512+0000","last_clean":"2023-11-04T01:36:03.234512+0000","last_became_active":"2023-11-04T01:35:58.197948+0000","last_became_peered":"2023-11-04T01:35:58.197948+0000","last_unstale":"2023-11-04T01:36:03.234512+0000","last_undegraded":"2023-11-04T01:36:03.234512+0000","last_fullsized":"2023-11-04T01:36:03.234512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:37.960678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360112+0000","last_change":"2023-11-04T01:36:03.242811+0000","last_active":"2023-11-04T01:36:05.360112+0000","last_peered":"2023-11-04T01:36:05.360112+0000","last_clean":"2023-11-04T01:36:05.360112+0000","last_became_active":"2023-11-04T01:36:03.242415+0000","last_became_peered":"2023-11-04T01:36:03.242415+0000","last_unstale":"2023-11-04T01:36:05.360112+0000","last_undegraded":"2023-11-04T01:36:05.360112+0000","last_fullsized":"2023-11-04T01:36:05.360112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:26.435962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224250+0000","last_change":"2023-11-04T01:35:59.172529+0000","last_active":"2023-11-04T01:36:03.224250+0000","last_peered":"2023-11-04T01:36:03.224250+0000","last_clean":"2023-11-04T01:36:03.224250+0000","last_became_active":"2023-11-04T01:35:59.172235+0000","last_became_peered":"2023-11-04T01:35:59.172235+0000","last_unstale":"2023-11-04T01:36:03.224250+0000","last_undegraded":"2023-11-04T01:36:03.224250+0000","last_fullsized":"2023-11-04T01:36:03.224250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:48.565872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228657+0000","last_change":"2023-11-04T01:35:58.192742+0000","last_active":"2023-11-04T01:36:03.228657+0000","last_peered":"2023-11-04T01:36:03.228657+0000","last_clean":"2023-11-04T01:36:03.228657+0000","last_became_active":"2023-11-04T01:35:58.192399+0000","last_became_peered":"2023-11-04T01:35:58.192399+0000","last_unstale":"2023-11-04T01:36:03.228657+0000","last_undegraded":"2023-11-04T01:36:03.228657+0000","last_fullsized":"2023-11-04T01:36:03.228657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:42.026489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360489+0000","last_change":"2023-11-04T01:36:03.244294+0000","last_active":"2023-11-04T01:36:05.360489+0000","last_peered":"2023-11-04T01:36:05.360489+0000","last_clean":"2023-11-04T01:36:05.360489+0000","last_became_active":"2023-11-04T01:36:03.243799+0000","last_became_peered":"2023-11-04T01:36:03.243799+0000","last_unstale":"2023-11-04T01:36:05.360489+0000","last_undegraded":"2023-11-04T01:36:05.360489+0000","last_fullsized":"2023-11-04T01:36:05.360489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:32.058795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234087+0000","last_change":"2023-11-04T01:35:59.181498+0000","last_active":"2023-11-04T01:36:03.234087+0000","last_peered":"2023-11-04T01:36:03.234087+0000","last_clean":"2023-11-04T01:36:03.234087+0000","last_became_active":"2023-11-04T01:35:59.181162+0000","last_became_peered":"2023-11-04T01:35:59.181162+0000","last_unstale":"2023-11-04T01:36:03.234087+0000","last_undegraded":"2023-11-04T01:36:03.234087+0000","last_fullsized":"2023-11-04T01:36:03.234087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225409+0000","last_change":"2023-11-04T01:35:58.194393+0000","last_active":"2023-11-04T01:36:03.225409+0000","last_peered":"2023-11-04T01:36:03.225409+0000","last_clean":"2023-11-04T01:36:03.225409+0000","last_became_active":"2023-11-04T01:35:58.194066+0000","last_became_peered":"2023-11-04T01:35:58.194066+0000","last_unstale":"2023-11-04T01:36:03.225409+0000","last_undegraded":"2023-11-04T01:36:03.225409+0000","last_fullsized":"2023-11-04T01:36:03.225409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:24.246113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360736+0000","last_change":"2023-11-04T01:36:03.241689+0000","last_active":"2023-11-04T01:36:05.360736+0000","last_peered":"2023-11-04T01:36:05.360736+0000","last_clean":"2023-11-04T01:36:05.360736+0000","last_became_active":"2023-11-04T01:36:03.241310+0000","last_became_peered":"2023-11-04T01:36:03.241310+0000","last_unstale":"2023-11-04T01:36:05.360736+0000","last_undegraded":"2023-11-04T01:36:05.360736+0000","last_fullsized":"2023-11-04T01:36:05.360736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:09.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231312+0000","last_change":"2023-11-04T01:35:59.168220+0000","last_active":"2023-11-04T01:36:03.231312+0000","last_peered":"2023-11-04T01:36:03.231312+0000","last_clean":"2023-11-04T01:36:03.231312+0000","last_became_active":"2023-11-04T01:35:59.167947+0000","last_became_peered":"2023-11-04T01:35:59.167947+0000","last_unstale":"2023-11-04T01:36:03.231312+0000","last_undegraded":"2023-11-04T01:36:03.231312+0000","last_fullsized":"2023-11-04T01:36:03.231312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:38.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417210+0000","last_change":"2023-11-04T01:35:58.194356+0000","last_active":"2023-11-04T01:36:03.417210+0000","last_peered":"2023-11-04T01:36:03.417210+0000","last_clean":"2023-11-04T01:36:03.417210+0000","last_became_active":"2023-11-04T01:35:58.194084+0000","last_became_peered":"2023-11-04T01:35:58.194084+0000","last_unstale":"2023-11-04T01:36:03.417210+0000","last_undegraded":"2023-11-04T01:36:03.417210+0000","last_fullsized":"2023-11-04T01:36:03.417210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:47.558236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.114218+0000","last_change":"2023-11-04T01:36:03.419657+0000","last_active":"2023-11-04T01:36:05.114218+0000","last_peered":"2023-11-04T01:36:05.114218+0000","last_clean":"2023-11-04T01:36:05.114218+0000","last_became_active":"2023-11-04T01:36:03.419283+0000","last_became_peered":"2023-11-04T01:36:03.419283+0000","last_unstale":"2023-11-04T01:36:05.114218+0000","last_undegraded":"2023-11-04T01:36:05.114218+0000","last_fullsized":"2023-11-04T01:36:05.114218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:49.330726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219822+0000","last_change":"2023-11-04T01:35:59.183758+0000","last_active":"2023-11-04T01:36:03.219822+0000","last_peered":"2023-11-04T01:36:03.219822+0000","last_clean":"2023-11-04T01:36:03.219822+0000","last_became_active":"2023-11-04T01:35:59.183457+0000","last_became_peered":"2023-11-04T01:35:59.183457+0000","last_unstale":"2023-11-04T01:36:03.219822+0000","last_undegraded":"2023-11-04T01:36:03.219822+0000","last_fullsized":"2023-11-04T01:36:03.219822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227709+0000","last_change":"2023-11-04T01:35:58.193549+0000","last_active":"2023-11-04T01:36:03.227709+0000","last_peered":"2023-11-04T01:36:03.227709+0000","last_clean":"2023-11-04T01:36:03.227709+0000","last_became_active":"2023-11-04T01:35:58.193066+0000","last_became_peered":"2023-11-04T01:35:58.193066+0000","last_unstale":"2023-11-04T01:36:03.227709+0000","last_undegraded":"2023-11-04T01:36:03.227709+0000","last_fullsized":"2023-11-04T01:36:03.227709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:30.570768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417292+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:36:03.417292+0000","last_peered":"2023-11-04T01:36:03.417292+0000","last_clean":"2023-11-04T01:36:03.417292+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:36:03.417292+0000","last_undegraded":"2023-11-04T01:36:03.417292+0000","last_fullsized":"2023-11-04T01:36:03.417292+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165356+0000","last_change":"2023-11-04T01:36:03.420650+0000","last_active":"2023-11-04T01:36:04.165356+0000","last_peered":"2023-11-04T01:36:04.165356+0000","last_clean":"2023-11-04T01:36:04.165356+0000","last_became_active":"2023-11-04T01:36:03.420227+0000","last_became_peered":"2023-11-04T01:36:03.420227+0000","last_unstale":"2023-11-04T01:36:04.165356+0000","last_undegraded":"2023-11-04T01:36:04.165356+0000","last_fullsized":"2023-11-04T01:36:04.165356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:41.965687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418146+0000","last_change":"2023-11-04T01:35:59.188596+0000","last_active":"2023-11-04T01:36:03.418146+0000","last_peered":"2023-11-04T01:36:03.418146+0000","last_clean":"2023-11-04T01:36:03.418146+0000","last_became_active":"2023-11-04T01:35:59.188308+0000","last_became_peered":"2023-11-04T01:35:59.188308+0000","last_unstale":"2023-11-04T01:36:03.418146+0000","last_undegraded":"2023-11-04T01:36:03.418146+0000","last_fullsized":"2023-11-04T01:36:03.418146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:41.888526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.226336+0000","last_change":"2023-11-04T01:35:58.196283+0000","last_active":"2023-11-04T01:36:03.226336+0000","last_peered":"2023-11-04T01:36:03.226336+0000","last_clean":"2023-11-04T01:36:03.226336+0000","last_became_active":"2023-11-04T01:35:58.195971+0000","last_became_peered":"2023-11-04T01:35:58.195971+0000","last_unstale":"2023-11-04T01:36:03.226336+0000","last_undegraded":"2023-11-04T01:36:03.226336+0000","last_fullsized":"2023-11-04T01:36:03.226336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:47.558236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165453+0000","last_change":"2023-11-04T01:36:03.418712+0000","last_active":"2023-11-04T01:36:04.165453+0000","last_peered":"2023-11-04T01:36:04.165453+0000","last_clean":"2023-11-04T01:36:04.165453+0000","last_became_active":"2023-11-04T01:36:03.417693+0000","last_became_peered":"2023-11-04T01:36:03.417693+0000","last_unstale":"2023-11-04T01:36:04.165453+0000","last_undegraded":"2023-11-04T01:36:04.165453+0000","last_fullsized":"2023-11-04T01:36:04.165453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:35.083514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228228+0000","last_change":"2023-11-04T01:35:59.187963+0000","last_active":"2023-11-04T01:36:03.228228+0000","last_peered":"2023-11-04T01:36:03.228228+0000","last_clean":"2023-11-04T01:36:03.228228+0000","last_became_active":"2023-11-04T01:35:59.187711+0000","last_became_peered":"2023-11-04T01:35:59.187711+0000","last_unstale":"2023-11-04T01:36:03.228228+0000","last_undegraded":"2023-11-04T01:36:03.228228+0000","last_fullsized":"2023-11-04T01:36:03.228228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:39.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236382+0000","last_change":"2023-11-04T01:35:58.190482+0000","last_active":"2023-11-04T01:36:03.236382+0000","last_peered":"2023-11-04T01:36:03.236382+0000","last_clean":"2023-11-04T01:36:03.236382+0000","last_became_active":"2023-11-04T01:35:58.190198+0000","last_became_peered":"2023-11-04T01:35:58.190198+0000","last_unstale":"2023-11-04T01:36:03.236382+0000","last_undegraded":"2023-11-04T01:36:03.236382+0000","last_fullsized":"2023-11-04T01:36:03.236382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:37.379069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.113987+0000","last_change":"2023-11-04T01:36:03.236376+0000","last_active":"2023-11-04T01:36:05.113987+0000","last_peered":"2023-11-04T01:36:05.113987+0000","last_clean":"2023-11-04T01:36:05.113987+0000","last_became_active":"2023-11-04T01:36:03.235968+0000","last_became_peered":"2023-11-04T01:36:03.235968+0000","last_unstale":"2023-11-04T01:36:05.113987+0000","last_undegraded":"2023-11-04T01:36:05.113987+0000","last_fullsized":"2023-11-04T01:36:05.113987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:32.058795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418889+0000","last_change":"2023-11-04T01:35:59.188577+0000","last_active":"2023-11-04T01:36:03.418889+0000","last_peered":"2023-11-04T01:36:03.418889+0000","last_clean":"2023-11-04T01:36:03.418889+0000","last_became_active":"2023-11-04T01:35:59.188287+0000","last_became_peered":"2023-11-04T01:35:59.188287+0000","last_unstale":"2023-11-04T01:36:03.418889+0000","last_undegraded":"2023-11-04T01:36:03.418889+0000","last_fullsized":"2023-11-04T01:36:03.418889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:28.021164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225705+0000","last_change":"2023-11-04T01:35:58.194717+0000","last_active":"2023-11-04T01:36:03.225705+0000","last_peered":"2023-11-04T01:36:03.225705+0000","last_clean":"2023-11-04T01:36:03.225705+0000","last_became_active":"2023-11-04T01:35:58.194401+0000","last_became_peered":"2023-11-04T01:35:58.194401+0000","last_unstale":"2023-11-04T01:36:03.225705+0000","last_undegraded":"2023-11-04T01:36:03.225705+0000","last_fullsized":"2023-11-04T01:36:03.225705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:30.570768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360201+0000","last_change":"2023-11-04T01:36:03.422674+0000","last_active":"2023-11-04T01:36:05.360201+0000","last_peered":"2023-11-04T01:36:05.360201+0000","last_clean":"2023-11-04T01:36:05.360201+0000","last_became_active":"2023-11-04T01:36:03.422257+0000","last_became_peered":"2023-11-04T01:36:03.422257+0000","last_unstale":"2023-11-04T01:36:05.360201+0000","last_undegraded":"2023-11-04T01:36:05.360201+0000","last_fullsized":"2023-11-04T01:36:05.360201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:49.330726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418123+0000","last_change":"2023-11-04T01:35:59.179250+0000","last_active":"2023-11-04T01:36:03.418123+0000","last_peered":"2023-11-04T01:36:03.418123+0000","last_clean":"2023-11-04T01:36:03.418123+0000","last_became_active":"2023-11-04T01:35:59.178986+0000","last_became_peered":"2023-11-04T01:35:59.178986+0000","last_unstale":"2023-11-04T01:36:03.418123+0000","last_undegraded":"2023-11-04T01:36:03.418123+0000","last_fullsized":"2023-11-04T01:36:03.418123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223002+0000","last_change":"2023-11-04T01:35:58.190516+0000","last_active":"2023-11-04T01:36:03.223002+0000","last_peered":"2023-11-04T01:36:03.223002+0000","last_clean":"2023-11-04T01:36:03.223002+0000","last_became_active":"2023-11-04T01:35:58.190211+0000","last_became_peered":"2023-11-04T01:35:58.190211+0000","last_unstale":"2023-11-04T01:36:03.223002+0000","last_undegraded":"2023-11-04T01:36:03.223002+0000","last_fullsized":"2023-11-04T01:36:03.223002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:04.019377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165115+0000","last_change":"2023-11-04T01:36:03.239656+0000","last_active":"2023-11-04T01:36:04.165115+0000","last_peered":"2023-11-04T01:36:04.165115+0000","last_clean":"2023-11-04T01:36:04.165115+0000","last_became_active":"2023-11-04T01:36:03.239212+0000","last_became_peered":"2023-11-04T01:36:03.239212+0000","last_unstale":"2023-11-04T01:36:04.165115+0000","last_undegraded":"2023-11-04T01:36:04.165115+0000","last_fullsized":"2023-11-04T01:36:04.165115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:01.412068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417453+0000","last_change":"2023-11-04T01:35:59.179105+0000","last_active":"2023-11-04T01:36:03.417453+0000","last_peered":"2023-11-04T01:36:03.417453+0000","last_clean":"2023-11-04T01:36:03.417453+0000","last_became_active":"2023-11-04T01:35:59.178837+0000","last_became_peered":"2023-11-04T01:35:59.178837+0000","last_unstale":"2023-11-04T01:36:03.417453+0000","last_undegraded":"2023-11-04T01:36:03.417453+0000","last_fullsized":"2023-11-04T01:36:03.417453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225915+0000","last_change":"2023-11-04T01:35:58.195859+0000","last_active":"2023-11-04T01:36:03.225915+0000","last_peered":"2023-11-04T01:36:03.225915+0000","last_clean":"2023-11-04T01:36:03.225915+0000","last_became_active":"2023-11-04T01:35:58.195566+0000","last_became_peered":"2023-11-04T01:35:58.195566+0000","last_unstale":"2023-11-04T01:36:03.225915+0000","last_undegraded":"2023-11-04T01:36:03.225915+0000","last_fullsized":"2023-11-04T01:36:03.225915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:17:13.959681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.114145+0000","last_change":"2023-11-04T01:36:03.239374+0000","last_active":"2023-11-04T01:36:05.114145+0000","last_peered":"2023-11-04T01:36:05.114145+0000","last_clean":"2023-11-04T01:36:05.114145+0000","last_became_active":"2023-11-04T01:36:03.238617+0000","last_became_peered":"2023-11-04T01:36:03.238617+0000","last_unstale":"2023-11-04T01:36:05.114145+0000","last_undegraded":"2023-11-04T01:36:05.114145+0000","last_fullsized":"2023-11-04T01:36:05.114145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:09.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223514+0000","last_change":"2023-11-04T01:35:59.180350+0000","last_active":"2023-11-04T01:36:03.223514+0000","last_peered":"2023-11-04T01:36:03.223514+0000","last_clean":"2023-11-04T01:36:03.223514+0000","last_became_active":"2023-11-04T01:35:59.180086+0000","last_became_peered":"2023-11-04T01:35:59.180086+0000","last_unstale":"2023-11-04T01:36:03.223514+0000","last_undegraded":"2023-11-04T01:36:03.223514+0000","last_fullsized":"2023-11-04T01:36:03.223514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.222870+0000","last_change":"2023-11-04T01:35:58.186031+0000","last_active":"2023-11-04T01:36:03.222870+0000","last_peered":"2023-11-04T01:36:03.222870+0000","last_clean":"2023-11-04T01:36:03.222870+0000","last_became_active":"2023-11-04T01:35:58.185722+0000","last_became_peered":"2023-11-04T01:35:58.185722+0000","last_unstale":"2023-11-04T01:36:03.222870+0000","last_undegraded":"2023-11-04T01:36:03.222870+0000","last_fullsized":"2023-11-04T01:36:03.222870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165503+0000","last_change":"2023-11-04T01:36:03.420681+0000","last_active":"2023-11-04T01:36:04.165503+0000","last_peered":"2023-11-04T01:36:04.165503+0000","last_clean":"2023-11-04T01:36:04.165503+0000","last_became_active":"2023-11-04T01:36:03.420258+0000","last_became_peered":"2023-11-04T01:36:03.420258+0000","last_unstale":"2023-11-04T01:36:04.165503+0000","last_undegraded":"2023-11-04T01:36:04.165503+0000","last_fullsized":"2023-11-04T01:36:04.165503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:50:39.481734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417519+0000","last_change":"2023-11-04T01:35:59.188442+0000","last_active":"2023-11-04T01:36:03.417519+0000","last_peered":"2023-11-04T01:36:03.417519+0000","last_clean":"2023-11-04T01:36:03.417519+0000","last_became_active":"2023-11-04T01:35:59.188173+0000","last_became_peered":"2023-11-04T01:35:59.188173+0000","last_unstale":"2023-11-04T01:36:03.417519+0000","last_undegraded":"2023-11-04T01:36:03.417519+0000","last_fullsized":"2023-11-04T01:36:03.417519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:31.045884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228572+0000","last_change":"2023-11-04T01:35:58.197982+0000","last_active":"2023-11-04T01:36:03.228572+0000","last_peered":"2023-11-04T01:36:03.228572+0000","last_clean":"2023-11-04T01:36:03.228572+0000","last_became_active":"2023-11-04T01:35:58.197647+0000","last_became_peered":"2023-11-04T01:35:58.197647+0000","last_unstale":"2023-11-04T01:36:03.228572+0000","last_undegraded":"2023-11-04T01:36:03.228572+0000","last_fullsized":"2023-11-04T01:36:03.228572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:35.379197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165046+0000","last_change":"2023-11-04T01:36:03.419606+0000","last_active":"2023-11-04T01:36:04.165046+0000","last_peered":"2023-11-04T01:36:04.165046+0000","last_clean":"2023-11-04T01:36:04.165046+0000","last_became_active":"2023-11-04T01:36:03.419169+0000","last_became_peered":"2023-11-04T01:36:03.419169+0000","last_unstale":"2023-11-04T01:36:04.165046+0000","last_undegraded":"2023-11-04T01:36:04.165046+0000","last_fullsized":"2023-11-04T01:36:04.165046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:59.887821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233077+0000","last_change":"2023-11-04T01:35:59.175192+0000","last_active":"2023-11-04T01:36:03.233077+0000","last_peered":"2023-11-04T01:36:03.233077+0000","last_clean":"2023-11-04T01:36:03.233077+0000","last_became_active":"2023-11-04T01:35:59.174877+0000","last_became_peered":"2023-11-04T01:35:59.174877+0000","last_unstale":"2023-11-04T01:36:03.233077+0000","last_undegraded":"2023-11-04T01:36:03.233077+0000","last_fullsized":"2023-11-04T01:36:03.233077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.232115+0000","last_change":"2023-11-04T01:35:58.194353+0000","last_active":"2023-11-04T01:36:03.232115+0000","last_peered":"2023-11-04T01:36:03.232115+0000","last_clean":"2023-11-04T01:36:03.232115+0000","last_became_active":"2023-11-04T01:35:58.193311+0000","last_became_peered":"2023-11-04T01:35:58.193311+0000","last_unstale":"2023-11-04T01:36:03.232115+0000","last_undegraded":"2023-11-04T01:36:03.232115+0000","last_fullsized":"2023-11-04T01:36:03.232115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:24.246113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360678+0000","last_change":"2023-11-04T01:36:03.420683+0000","last_active":"2023-11-04T01:36:05.360678+0000","last_peered":"2023-11-04T01:36:05.360678+0000","last_clean":"2023-11-04T01:36:05.360678+0000","last_became_active":"2023-11-04T01:36:03.420294+0000","last_became_peered":"2023-11-04T01:36:03.420294+0000","last_unstale":"2023-11-04T01:36:05.360678+0000","last_undegraded":"2023-11-04T01:36:05.360678+0000","last_fullsized":"2023-11-04T01:36:05.360678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:12.398818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417775+0000","last_change":"2023-11-04T01:35:59.184924+0000","last_active":"2023-11-04T01:36:03.417775+0000","last_peered":"2023-11-04T01:36:03.417775+0000","last_clean":"2023-11-04T01:36:03.417775+0000","last_became_active":"2023-11-04T01:35:59.183229+0000","last_became_peered":"2023-11-04T01:35:59.183229+0000","last_unstale":"2023-11-04T01:36:03.417775+0000","last_undegraded":"2023-11-04T01:36:03.417775+0000","last_fullsized":"2023-11-04T01:36:03.417775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:47.754644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:08.194692+0000","last_change":"2023-11-04T01:35:58.193586+0000","last_active":"2023-11-04T01:36:08.194692+0000","last_peered":"2023-11-04T01:36:08.194692+0000","last_clean":"2023-11-04T01:36:08.194692+0000","last_became_active":"2023-11-04T01:35:58.193282+0000","last_became_peered":"2023-11-04T01:35:58.193282+0000","last_unstale":"2023-11-04T01:36:08.194692+0000","last_undegraded":"2023-11-04T01:36:08.194692+0000","last_fullsized":"2023-11-04T01:36:08.194692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:46.133808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360370+0000","last_change":"2023-11-04T01:36:03.242995+0000","last_active":"2023-11-04T01:36:05.360370+0000","last_peered":"2023-11-04T01:36:05.360370+0000","last_clean":"2023-11-04T01:36:05.360370+0000","last_became_active":"2023-11-04T01:36:03.242623+0000","last_became_peered":"2023-11-04T01:36:03.242623+0000","last_unstale":"2023-11-04T01:36:05.360370+0000","last_undegraded":"2023-11-04T01:36:05.360370+0000","last_fullsized":"2023-11-04T01:36:05.360370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:02.636600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224883+0000","last_change":"2023-11-04T01:35:59.179661+0000","last_active":"2023-11-04T01:36:03.224883+0000","last_peered":"2023-11-04T01:36:03.224883+0000","last_clean":"2023-11-04T01:36:03.224883+0000","last_became_active":"2023-11-04T01:35:59.178791+0000","last_became_peered":"2023-11-04T01:35:59.178791+0000","last_unstale":"2023-11-04T01:36:03.224883+0000","last_undegraded":"2023-11-04T01:36:03.224883+0000","last_fullsized":"2023-11-04T01:36:03.224883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:31.578404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236138+0000","last_change":"2023-11-04T01:35:58.194817+0000","last_active":"2023-11-04T01:36:03.236138+0000","last_peered":"2023-11-04T01:36:03.236138+0000","last_clean":"2023-11-04T01:36:03.236138+0000","last_became_active":"2023-11-04T01:35:58.194521+0000","last_became_peered":"2023-11-04T01:35:58.194521+0000","last_unstale":"2023-11-04T01:36:03.236138+0000","last_undegraded":"2023-11-04T01:36:03.236138+0000","last_fullsized":"2023-11-04T01:36:03.236138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:04.765423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165862+0000","last_change":"2023-11-04T01:36:03.234265+0000","last_active":"2023-11-04T01:36:04.165862+0000","last_peered":"2023-11-04T01:36:04.165862+0000","last_clean":"2023-11-04T01:36:04.165862+0000","last_became_active":"2023-11-04T01:36:03.233858+0000","last_became_peered":"2023-11-04T01:36:03.233858+0000","last_unstale":"2023-11-04T01:36:04.165862+0000","last_undegraded":"2023-11-04T01:36:04.165862+0000","last_fullsized":"2023-11-04T01:36:04.165862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:41.965687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231787+0000","last_change":"2023-11-04T01:35:59.183367+0000","last_active":"2023-11-04T01:36:03.231787+0000","last_peered":"2023-11-04T01:36:03.231787+0000","last_clean":"2023-11-04T01:36:03.231787+0000","last_became_active":"2023-11-04T01:35:59.183053+0000","last_became_peered":"2023-11-04T01:35:59.183053+0000","last_unstale":"2023-11-04T01:36:03.231787+0000","last_undegraded":"2023-11-04T01:36:03.231787+0000","last_fullsized":"2023-11-04T01:36:03.231787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227594+0000","last_change":"2023-11-04T01:35:58.191935+0000","last_active":"2023-11-04T01:36:03.227594+0000","last_peered":"2023-11-04T01:36:03.227594+0000","last_clean":"2023-11-04T01:36:03.227594+0000","last_became_active":"2023-11-04T01:35:58.191638+0000","last_became_peered":"2023-11-04T01:35:58.191638+0000","last_unstale":"2023-11-04T01:36:03.227594+0000","last_undegraded":"2023-11-04T01:36:03.227594+0000","last_fullsized":"2023-11-04T01:36:03.227594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:04.765423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164714+0000","last_change":"2023-11-04T01:36:03.238955+0000","last_active":"2023-11-04T01:36:04.164714+0000","last_peered":"2023-11-04T01:36:04.164714+0000","last_clean":"2023-11-04T01:36:04.164714+0000","last_became_active":"2023-11-04T01:36:03.238489+0000","last_became_peered":"2023-11-04T01:36:03.238489+0000","last_unstale":"2023-11-04T01:36:04.164714+0000","last_undegraded":"2023-11-04T01:36:04.164714+0000","last_fullsized":"2023-11-04T01:36:04.164714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:12.398818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227482+0000","last_change":"2023-11-04T01:35:59.189242+0000","last_active":"2023-11-04T01:36:03.227482+0000","last_peered":"2023-11-04T01:36:03.227482+0000","last_clean":"2023-11-04T01:36:03.227482+0000","last_became_active":"2023-11-04T01:35:59.188965+0000","last_became_peered":"2023-11-04T01:35:59.188965+0000","last_unstale":"2023-11-04T01:36:03.227482+0000","last_undegraded":"2023-11-04T01:36:03.227482+0000","last_fullsized":"2023-11-04T01:36:03.227482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224557+0000","last_change":"2023-11-04T01:35:58.194320+0000","last_active":"2023-11-04T01:36:03.224557+0000","last_peered":"2023-11-04T01:36:03.224557+0000","last_clean":"2023-11-04T01:36:03.224557+0000","last_became_active":"2023-11-04T01:35:58.193983+0000","last_became_peered":"2023-11-04T01:35:58.193983+0000","last_unstale":"2023-11-04T01:36:03.224557+0000","last_undegraded":"2023-11-04T01:36:03.224557+0000","last_fullsized":"2023-11-04T01:36:03.224557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:45.043819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164544+0000","last_change":"2023-11-04T01:36:03.419109+0000","last_active":"2023-11-04T01:36:04.164544+0000","last_peered":"2023-11-04T01:36:04.164544+0000","last_clean":"2023-11-04T01:36:04.164544+0000","last_became_active":"2023-11-04T01:36:03.418605+0000","last_became_peered":"2023-11-04T01:36:03.418605+0000","last_unstale":"2023-11-04T01:36:04.164544+0000","last_undegraded":"2023-11-04T01:36:04.164544+0000","last_fullsized":"2023-11-04T01:36:04.164544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:49.330726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.114053+0000","last_change":"2023-11-04T01:36:03.421492+0000","last_active":"2023-11-04T01:36:05.114053+0000","last_peered":"2023-11-04T01:36:05.114053+0000","last_clean":"2023-11-04T01:36:05.114053+0000","last_became_active":"2023-11-04T01:36:03.421133+0000","last_became_peered":"2023-11-04T01:36:03.421133+0000","last_unstale":"2023-11-04T01:36:05.114053+0000","last_undegraded":"2023-11-04T01:36:05.114053+0000","last_fullsized":"2023-11-04T01:36:05.114053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:55.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233628+0000","last_change":"2023-11-04T01:35:59.180080+0000","last_active":"2023-11-04T01:36:03.233628+0000","last_peered":"2023-11-04T01:36:03.233628+0000","last_clean":"2023-11-04T01:36:03.233628+0000","last_became_active":"2023-11-04T01:35:59.179750+0000","last_became_peered":"2023-11-04T01:35:59.179750+0000","last_unstale":"2023-11-04T01:36:03.233628+0000","last_undegraded":"2023-11-04T01:36:03.233628+0000","last_fullsized":"2023-11-04T01:36:03.233628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227976+0000","last_change":"2023-11-04T01:35:58.196231+0000","last_active":"2023-11-04T01:36:03.227976+0000","last_peered":"2023-11-04T01:36:03.227976+0000","last_clean":"2023-11-04T01:36:03.227976+0000","last_became_active":"2023-11-04T01:35:58.195948+0000","last_became_peered":"2023-11-04T01:35:58.195948+0000","last_unstale":"2023-11-04T01:36:03.227976+0000","last_undegraded":"2023-11-04T01:36:03.227976+0000","last_fullsized":"2023-11-04T01:36:03.227976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:24.246113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165703+0000","last_change":"2023-11-04T01:36:03.241495+0000","last_active":"2023-11-04T01:36:04.165703+0000","last_peered":"2023-11-04T01:36:04.165703+0000","last_clean":"2023-11-04T01:36:04.165703+0000","last_became_active":"2023-11-04T01:36:03.241086+0000","last_became_peered":"2023-11-04T01:36:03.241086+0000","last_unstale":"2023-11-04T01:36:04.165703+0000","last_undegraded":"2023-11-04T01:36:04.165703+0000","last_fullsized":"2023-11-04T01:36:04.165703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:51.792275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220744+0000","last_change":"2023-11-04T01:35:59.180953+0000","last_active":"2023-11-04T01:36:03.220744+0000","last_peered":"2023-11-04T01:36:03.220744+0000","last_clean":"2023-11-04T01:36:03.220744+0000","last_became_active":"2023-11-04T01:35:59.180652+0000","last_became_peered":"2023-11-04T01:35:59.180652+0000","last_unstale":"2023-11-04T01:36:03.220744+0000","last_undegraded":"2023-11-04T01:36:03.220744+0000","last_fullsized":"2023-11-04T01:36:03.220744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220671+0000","last_change":"2023-11-04T01:35:58.190294+0000","last_active":"2023-11-04T01:36:03.220671+0000","last_peered":"2023-11-04T01:36:03.220671+0000","last_clean":"2023-11-04T01:36:03.220671+0000","last_became_active":"2023-11-04T01:35:58.189965+0000","last_became_peered":"2023-11-04T01:35:58.189965+0000","last_unstale":"2023-11-04T01:36:03.220671+0000","last_undegraded":"2023-11-04T01:36:03.220671+0000","last_fullsized":"2023-11-04T01:36:03.220671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:47.558236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223731+0000","last_change":"2023-11-04T01:35:58.193526+0000","last_active":"2023-11-04T01:36:03.223731+0000","last_peered":"2023-11-04T01:36:03.223731+0000","last_clean":"2023-11-04T01:36:03.223731+0000","last_became_active":"2023-11-04T01:35:58.193186+0000","last_became_peered":"2023-11-04T01:35:58.193186+0000","last_unstale":"2023-11-04T01:36:03.223731+0000","last_undegraded":"2023-11-04T01:36:03.223731+0000","last_fullsized":"2023-11-04T01:36:03.223731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:37.960678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.232019+0000","last_change":"2023-11-04T01:35:59.169544+0000","last_active":"2023-11-04T01:36:03.232019+0000","last_peered":"2023-11-04T01:36:03.232019+0000","last_clean":"2023-11-04T01:36:03.232019+0000","last_became_active":"2023-11-04T01:35:59.169198+0000","last_became_peered":"2023-11-04T01:35:59.169198+0000","last_unstale":"2023-11-04T01:36:03.232019+0000","last_undegraded":"2023-11-04T01:36:03.232019+0000","last_fullsized":"2023-11-04T01:36:03.232019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.615595+0000","last_change":"2023-11-04T01:36:03.241169+0000","last_active":"2023-11-04T01:36:04.615595+0000","last_peered":"2023-11-04T01:36:04.615595+0000","last_clean":"2023-11-04T01:36:04.615595+0000","last_became_active":"2023-11-04T01:36:03.240462+0000","last_became_peered":"2023-11-04T01:36:03.240462+0000","last_unstale":"2023-11-04T01:36:04.615595+0000","last_undegraded":"2023-11-04T01:36:04.615595+0000","last_fullsized":"2023-11-04T01:36:04.615595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:09.810689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220136+0000","last_change":"2023-11-04T01:35:58.192293+0000","last_active":"2023-11-04T01:36:03.220136+0000","last_peered":"2023-11-04T01:36:03.220136+0000","last_clean":"2023-11-04T01:36:03.220136+0000","last_became_active":"2023-11-04T01:35:58.191972+0000","last_became_peered":"2023-11-04T01:35:58.191972+0000","last_unstale":"2023-11-04T01:36:03.220136+0000","last_undegraded":"2023-11-04T01:36:03.220136+0000","last_fullsized":"2023-11-04T01:36:03.220136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.221974+0000","last_change":"2023-11-04T01:35:59.179878+0000","last_active":"2023-11-04T01:36:03.221974+0000","last_peered":"2023-11-04T01:36:03.221974+0000","last_clean":"2023-11-04T01:36:03.221974+0000","last_became_active":"2023-11-04T01:35:59.177460+0000","last_became_peered":"2023-11-04T01:35:59.177460+0000","last_unstale":"2023-11-04T01:36:03.221974+0000","last_undegraded":"2023-11-04T01:36:03.221974+0000","last_fullsized":"2023-11-04T01:36:03.221974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:01:15.442742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165166+0000","last_change":"2023-11-04T01:36:03.240379+0000","last_active":"2023-11-04T01:36:04.165166+0000","last_peered":"2023-11-04T01:36:04.165166+0000","last_clean":"2023-11-04T01:36:04.165166+0000","last_became_active":"2023-11-04T01:36:03.239985+0000","last_became_peered":"2023-11-04T01:36:03.239985+0000","last_unstale":"2023-11-04T01:36:04.165166+0000","last_undegraded":"2023-11-04T01:36:04.165166+0000","last_fullsized":"2023-11-04T01:36:04.165166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:22.738298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223423+0000","last_change":"2023-11-04T01:35:59.180546+0000","last_active":"2023-11-04T01:36:03.223423+0000","last_peered":"2023-11-04T01:36:03.223423+0000","last_clean":"2023-11-04T01:36:03.223423+0000","last_became_active":"2023-11-04T01:35:59.180121+0000","last_became_peered":"2023-11-04T01:35:59.180121+0000","last_unstale":"2023-11-04T01:36:03.223423+0000","last_undegraded":"2023-11-04T01:36:03.223423+0000","last_fullsized":"2023-11-04T01:36:03.223423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:38.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225745+0000","last_change":"2023-11-04T01:35:59.182981+0000","last_active":"2023-11-04T01:36:03.225745+0000","last_peered":"2023-11-04T01:36:03.225745+0000","last_clean":"2023-11-04T01:36:03.225745+0000","last_became_active":"2023-11-04T01:35:59.182612+0000","last_became_peered":"2023-11-04T01:35:59.182612+0000","last_unstale":"2023-11-04T01:36:03.225745+0000","last_undegraded":"2023-11-04T01:36:03.225745+0000","last_fullsized":"2023-11-04T01:36:03.225745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:38.968313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228484+0000","last_change":"2023-11-04T01:35:59.185499+0000","last_active":"2023-11-04T01:36:03.228484+0000","last_peered":"2023-11-04T01:36:03.228484+0000","last_clean":"2023-11-04T01:36:03.228484+0000","last_became_active":"2023-11-04T01:35:59.185133+0000","last_became_peered":"2023-11-04T01:35:59.185133+0000","last_unstale":"2023-11-04T01:36:03.228484+0000","last_undegraded":"2023-11-04T01:36:03.228484+0000","last_fullsized":"2023-11-04T01:36:03.228484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:22.398332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231928+0000","last_change":"2023-11-04T01:35:59.183534+0000","last_active":"2023-11-04T01:36:03.231928+0000","last_peered":"2023-11-04T01:36:03.231928+0000","last_clean":"2023-11-04T01:36:03.231928+0000","last_became_active":"2023-11-04T01:35:59.180664+0000","last_became_peered":"2023-11-04T01:35:59.180664+0000","last_unstale":"2023-11-04T01:36:03.231928+0000","last_undegraded":"2023-11-04T01:36:03.231928+0000","last_fullsized":"2023-11-04T01:36:03.231928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220081+0000","last_change":"2023-11-04T01:35:59.182124+0000","last_active":"2023-11-04T01:36:03.220081+0000","last_peered":"2023-11-04T01:36:03.220081+0000","last_clean":"2023-11-04T01:36:03.220081+0000","last_became_active":"2023-11-04T01:35:59.181762+0000","last_became_peered":"2023-11-04T01:35:59.181762+0000","last_unstale":"2023-11-04T01:36:03.220081+0000","last_undegraded":"2023-11-04T01:36:03.220081+0000","last_fullsized":"2023-11-04T01:36:03.220081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236021+0000","last_change":"2023-11-04T01:35:59.184661+0000","last_active":"2023-11-04T01:36:03.236021+0000","last_peered":"2023-11-04T01:36:03.236021+0000","last_clean":"2023-11-04T01:36:03.236021+0000","last_became_active":"2023-11-04T01:35:59.184382+0000","last_became_peered":"2023-11-04T01:35:59.184382+0000","last_unstale":"2023-11-04T01:36:03.236021+0000","last_undegraded":"2023-11-04T01:36:03.236021+0000","last_fullsized":"2023-11-04T01:36:03.236021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224222+0000","last_change":"2023-11-04T01:35:59.177565+0000","last_active":"2023-11-04T01:36:03.224222+0000","last_peered":"2023-11-04T01:36:03.224222+0000","last_clean":"2023-11-04T01:36:03.224222+0000","last_became_active":"2023-11-04T01:35:59.177205+0000","last_became_peered":"2023-11-04T01:35:59.177205+0000","last_unstale":"2023-11-04T01:36:03.224222+0000","last_undegraded":"2023-11-04T01:36:03.224222+0000","last_fullsized":"2023-11-04T01:36:03.224222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219630+0000","last_change":"2023-11-04T01:35:59.183379+0000","last_active":"2023-11-04T01:36:03.219630+0000","last_peered":"2023-11-04T01:36:03.219630+0000","last_clean":"2023-11-04T01:36:03.219630+0000","last_became_active":"2023-11-04T01:35:59.182959+0000","last_became_peered":"2023-11-04T01:35:59.182959+0000","last_unstale":"2023-11-04T01:36:03.219630+0000","last_undegraded":"2023-11-04T01:36:03.219630+0000","last_fullsized":"2023-11-04T01:36:03.219630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:37.928056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227777+0000","last_change":"2023-11-04T01:35:59.180959+0000","last_active":"2023-11-04T01:36:03.227777+0000","last_peered":"2023-11-04T01:36:03.227777+0000","last_clean":"2023-11-04T01:36:03.227777+0000","last_became_active":"2023-11-04T01:35:59.180709+0000","last_became_peered":"2023-11-04T01:35:59.180709+0000","last_unstale":"2023-11-04T01:36:03.227777+0000","last_undegraded":"2023-11-04T01:36:03.227777+0000","last_fullsized":"2023-11-04T01:36:03.227777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220572+0000","last_change":"2023-11-04T01:35:59.178115+0000","last_active":"2023-11-04T01:36:03.220572+0000","last_peered":"2023-11-04T01:36:03.220572+0000","last_clean":"2023-11-04T01:36:03.220572+0000","last_became_active":"2023-11-04T01:35:59.177595+0000","last_became_peered":"2023-11-04T01:35:59.177595+0000","last_unstale":"2023-11-04T01:36:03.220572+0000","last_undegraded":"2023-11-04T01:36:03.220572+0000","last_fullsized":"2023-11-04T01:36:03.220572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228396+0000","last_change":"2023-11-04T01:35:59.181853+0000","last_active":"2023-11-04T01:36:03.228396+0000","last_peered":"2023-11-04T01:36:03.228396+0000","last_clean":"2023-11-04T01:36:03.228396+0000","last_became_active":"2023-11-04T01:35:59.181499+0000","last_became_peered":"2023-11-04T01:35:59.181499+0000","last_unstale":"2023-11-04T01:36:03.228396+0000","last_undegraded":"2023-11-04T01:36:03.228396+0000","last_fullsized":"2023-11-04T01:36:03.228396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:59:58.598970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231812+0000","last_change":"2023-11-04T01:35:59.177527+0000","last_active":"2023-11-04T01:36:03.231812+0000","last_peered":"2023-11-04T01:36:03.231812+0000","last_clean":"2023-11-04T01:36:03.231812+0000","last_became_active":"2023-11-04T01:35:59.177047+0000","last_became_peered":"2023-11-04T01:35:59.177047+0000","last_unstale":"2023-11-04T01:36:03.231812+0000","last_undegraded":"2023-11-04T01:36:03.231812+0000","last_fullsized":"2023-11-04T01:36:03.231812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223687+0000","last_change":"2023-11-04T01:35:59.174531+0000","last_active":"2023-11-04T01:36:03.223687+0000","last_peered":"2023-11-04T01:36:03.223687+0000","last_clean":"2023-11-04T01:36:03.223687+0000","last_became_active":"2023-11-04T01:35:59.174277+0000","last_became_peered":"2023-11-04T01:35:59.174277+0000","last_unstale":"2023-11-04T01:36:03.223687+0000","last_undegraded":"2023-11-04T01:36:03.223687+0000","last_fullsized":"2023-11-04T01:36:03.223687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418785+0000","last_change":"2023-11-04T01:35:59.181809+0000","last_active":"2023-11-04T01:36:03.418785+0000","last_peered":"2023-11-04T01:36:03.418785+0000","last_clean":"2023-11-04T01:36:03.418785+0000","last_became_active":"2023-11-04T01:35:59.181546+0000","last_became_peered":"2023-11-04T01:35:59.181546+0000","last_unstale":"2023-11-04T01:36:03.418785+0000","last_undegraded":"2023-11-04T01:36:03.418785+0000","last_fullsized":"2023-11-04T01:36:03.418785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:22.398332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225612+0000","last_change":"2023-11-04T01:35:59.172821+0000","last_active":"2023-11-04T01:36:03.225612+0000","last_peered":"2023-11-04T01:36:03.225612+0000","last_clean":"2023-11-04T01:36:03.225612+0000","last_became_active":"2023-11-04T01:35:59.172439+0000","last_became_peered":"2023-11-04T01:35:59.172439+0000","last_unstale":"2023-11-04T01:36:03.225612+0000","last_undegraded":"2023-11-04T01:36:03.225612+0000","last_fullsized":"2023-11-04T01:36:03.225612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:47.141443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227832+0000","last_change":"2023-11-04T01:35:59.182521+0000","last_active":"2023-11-04T01:36:03.227832+0000","last_peered":"2023-11-04T01:36:03.227832+0000","last_clean":"2023-11-04T01:36:03.227832+0000","last_became_active":"2023-11-04T01:35:59.182229+0000","last_became_peered":"2023-11-04T01:35:59.182229+0000","last_unstale":"2023-11-04T01:36:03.227832+0000","last_undegraded":"2023-11-04T01:36:03.227832+0000","last_fullsized":"2023-11-04T01:36:03.227832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:37.928056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227738+0000","last_change":"2023-11-04T01:35:59.178581+0000","last_active":"2023-11-04T01:36:03.227738+0000","last_peered":"2023-11-04T01:36:03.227738+0000","last_clean":"2023-11-04T01:36:03.227738+0000","last_became_active":"2023-11-04T01:35:59.178317+0000","last_became_peered":"2023-11-04T01:35:59.178317+0000","last_unstale":"2023-11-04T01:36:03.227738+0000","last_undegraded":"2023-11-04T01:36:03.227738+0000","last_fullsized":"2023-11-04T01:36:03.227738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233726+0000","last_change":"2023-11-04T01:35:59.177319+0000","last_active":"2023-11-04T01:36:03.233726+0000","last_peered":"2023-11-04T01:36:03.233726+0000","last_clean":"2023-11-04T01:36:03.233726+0000","last_became_active":"2023-11-04T01:35:59.176999+0000","last_became_peered":"2023-11-04T01:35:59.176999+0000","last_unstale":"2023-11-04T01:36:03.233726+0000","last_undegraded":"2023-11-04T01:36:03.233726+0000","last_fullsized":"2023-11-04T01:36:03.233726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.232947+0000","last_change":"2023-11-04T01:35:59.180087+0000","last_active":"2023-11-04T01:36:03.232947+0000","last_peered":"2023-11-04T01:36:03.232947+0000","last_clean":"2023-11-04T01:36:03.232947+0000","last_became_active":"2023-11-04T01:35:59.179661+0000","last_became_peered":"2023-11-04T01:35:59.179661+0000","last_unstale":"2023-11-04T01:36:03.232947+0000","last_undegraded":"2023-11-04T01:36:03.232947+0000","last_fullsized":"2023-11-04T01:36:03.232947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219636+0000","last_change":"2023-11-04T01:35:59.181134+0000","last_active":"2023-11-04T01:36:03.219636+0000","last_peered":"2023-11-04T01:36:03.219636+0000","last_clean":"2023-11-04T01:36:03.219636+0000","last_became_active":"2023-11-04T01:35:59.180479+0000","last_became_peered":"2023-11-04T01:35:59.180479+0000","last_unstale":"2023-11-04T01:36:03.219636+0000","last_undegraded":"2023-11-04T01:36:03.219636+0000","last_fullsized":"2023-11-04T01:36:03.219636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224801+0000","last_change":"2023-11-04T01:35:59.172767+0000","last_active":"2023-11-04T01:36:03.224801+0000","last_peered":"2023-11-04T01:36:03.224801+0000","last_clean":"2023-11-04T01:36:03.224801+0000","last_became_active":"2023-11-04T01:35:59.172514+0000","last_became_peered":"2023-11-04T01:35:59.172514+0000","last_unstale":"2023-11-04T01:36:03.224801+0000","last_undegraded":"2023-11-04T01:36:03.224801+0000","last_fullsized":"2023-11-04T01:36:03.224801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:25.253748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223496+0000","last_change":"2023-11-04T01:35:59.188111+0000","last_active":"2023-11-04T01:36:03.223496+0000","last_peered":"2023-11-04T01:36:03.223496+0000","last_clean":"2023-11-04T01:36:03.223496+0000","last_became_active":"2023-11-04T01:35:59.187822+0000","last_became_peered":"2023-11-04T01:35:59.187822+0000","last_unstale":"2023-11-04T01:36:03.223496+0000","last_undegraded":"2023-11-04T01:36:03.223496+0000","last_fullsized":"2023-11-04T01:36:03.223496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224145+0000","last_change":"2023-11-04T01:35:59.179070+0000","last_active":"2023-11-04T01:36:03.224145+0000","last_peered":"2023-11-04T01:36:03.224145+0000","last_clean":"2023-11-04T01:36:03.224145+0000","last_became_active":"2023-11-04T01:35:59.178798+0000","last_became_peered":"2023-11-04T01:35:59.178798+0000","last_unstale":"2023-11-04T01:36:03.224145+0000","last_undegraded":"2023-11-04T01:36:03.224145+0000","last_fullsized":"2023-11-04T01:36:03.224145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418662+0000","last_change":"2023-11-04T01:35:59.189991+0000","last_active":"2023-11-04T01:36:03.418662+0000","last_peered":"2023-11-04T01:36:03.418662+0000","last_clean":"2023-11-04T01:36:03.418662+0000","last_became_active":"2023-11-04T01:35:59.189686+0000","last_became_peered":"2023-11-04T01:35:59.189686+0000","last_unstale":"2023-11-04T01:36:03.418662+0000","last_undegraded":"2023-11-04T01:36:03.418662+0000","last_fullsized":"2023-11-04T01:36:03.418662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:59:58.598970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219400+0000","last_change":"2023-11-04T01:35:59.189839+0000","last_active":"2023-11-04T01:36:03.219400+0000","last_peered":"2023-11-04T01:36:03.219400+0000","last_clean":"2023-11-04T01:36:03.219400+0000","last_became_active":"2023-11-04T01:35:59.189525+0000","last_became_peered":"2023-11-04T01:35:59.189525+0000","last_unstale":"2023-11-04T01:36:03.219400+0000","last_undegraded":"2023-11-04T01:36:03.219400+0000","last_fullsized":"2023-11-04T01:36:03.219400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:38.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417496+0000","last_change":"2023-11-04T01:35:59.182733+0000","last_active":"2023-11-04T01:36:03.417496+0000","last_peered":"2023-11-04T01:36:03.417496+0000","last_clean":"2023-11-04T01:36:03.417496+0000","last_became_active":"2023-11-04T01:35:59.180260+0000","last_became_peered":"2023-11-04T01:35:59.180260+0000","last_unstale":"2023-11-04T01:36:03.417496+0000","last_undegraded":"2023-11-04T01:36:03.417496+0000","last_fullsized":"2023-11-04T01:36:03.417496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228312+0000","last_change":"2023-11-04T01:35:59.184451+0000","last_active":"2023-11-04T01:36:03.228312+0000","last_peered":"2023-11-04T01:36:03.228312+0000","last_clean":"2023-11-04T01:36:03.228312+0000","last_became_active":"2023-11-04T01:35:59.184197+0000","last_became_peered":"2023-11-04T01:35:59.184197+0000","last_unstale":"2023-11-04T01:36:03.228312+0000","last_undegraded":"2023-11-04T01:36:03.228312+0000","last_fullsized":"2023-11-04T01:36:03.228312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:47.754644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417459+0000","last_change":"2023-11-04T01:35:59.185251+0000","last_active":"2023-11-04T01:36:03.417459+0000","last_peered":"2023-11-04T01:36:03.417459+0000","last_clean":"2023-11-04T01:36:03.417459+0000","last_became_active":"2023-11-04T01:35:59.184960+0000","last_became_peered":"2023-11-04T01:35:59.184960+0000","last_unstale":"2023-11-04T01:36:03.417459+0000","last_undegraded":"2023-11-04T01:36:03.417459+0000","last_fullsized":"2023-11-04T01:36:03.417459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:37.928056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228072+0000","last_change":"2023-11-04T01:35:59.185741+0000","last_active":"2023-11-04T01:36:03.228072+0000","last_peered":"2023-11-04T01:36:03.228072+0000","last_clean":"2023-11-04T01:36:03.228072+0000","last_became_active":"2023-11-04T01:35:59.185417+0000","last_became_peered":"2023-11-04T01:35:59.185417+0000","last_unstale":"2023-11-04T01:36:03.228072+0000","last_undegraded":"2023-11-04T01:36:03.228072+0000","last_fullsized":"2023-11-04T01:36:03.228072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231859+0000","last_change":"2023-11-04T01:35:59.173981+0000","last_active":"2023-11-04T01:36:03.231859+0000","last_peered":"2023-11-04T01:36:03.231859+0000","last_clean":"2023-11-04T01:36:03.231859+0000","last_became_active":"2023-11-04T01:35:59.173709+0000","last_became_peered":"2023-11-04T01:35:59.173709+0000","last_unstale":"2023-11-04T01:36:03.231859+0000","last_undegraded":"2023-11-04T01:36:03.231859+0000","last_fullsized":"2023-11-04T01:36:03.231859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236893+0000","last_change":"2023-11-04T01:35:59.178744+0000","last_active":"2023-11-04T01:36:03.236893+0000","last_peered":"2023-11-04T01:36:03.236893+0000","last_clean":"2023-11-04T01:36:03.236893+0000","last_became_active":"2023-11-04T01:35:59.178420+0000","last_became_peered":"2023-11-04T01:35:59.178420+0000","last_unstale":"2023-11-04T01:36:03.236893+0000","last_undegraded":"2023-11-04T01:36:03.236893+0000","last_fullsized":"2023-11-04T01:36:03.236893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417999+0000","last_change":"2023-11-04T01:35:59.182583+0000","last_active":"2023-11-04T01:36:03.417999+0000","last_peered":"2023-11-04T01:36:03.417999+0000","last_clean":"2023-11-04T01:36:03.417999+0000","last_became_active":"2023-11-04T01:35:59.179785+0000","last_became_peered":"2023-11-04T01:35:59.179785+0000","last_unstale":"2023-11-04T01:36:03.417999+0000","last_undegraded":"2023-11-04T01:36:03.417999+0000","last_fullsized":"2023-11-04T01:36:03.417999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:39.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4498,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:36:17.251 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:36:17.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.388+0000 7fb9f2fd7640 1 Processor -- start 2023-11-04T01:36:17.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.388+0000 7fb9f2fd7640 1 -- start start 2023-11-04T01:36:17.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.389+0000 7fb9f2fd7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb9ec15ae40 0x7fb9ec15bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.389+0000 7fb9f2fd7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb9ec0cda30 0x7fb9ec0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.389+0000 7fb9f2fd7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ec0cc450 con 0x7fb9ec0cbc00 2023-11-04T01:36:17.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.389+0000 7fb9f2fd7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ec15f400 con 0x7fb9ec0cda30 2023-11-04T01:36:17.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.389+0000 7fb9f2fd7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ec15b220 con 0x7fb9ec15ae40 2023-11-04T01:36:17.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.389+0000 7fb9f1574640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb9ec0cda30 0x7fb9ec0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.389+0000 7fb9f1574640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb9ec0cda30 0x7fb9ec0ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48800/0 (socket says 172.21.15.44:48800) 2023-11-04T01:36:17.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.389+0000 7fb9f1574640 1 -- 172.21.15.44:0/2962238573 learned_addr learned my addr 172.21.15.44:0/2962238573 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:17.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.389+0000 7fb9f0d73640 1 --2- 172.21.15.44:0/2962238573 >> v2:172.21.15.204:3300/0 conn(0x7fb9ec15ae40 0x7fb9ec15bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.389+0000 7fb9f1574640 1 -- 172.21.15.44:0/2962238573 >> v2:172.21.15.204:3300/0 conn(0x7fb9ec15ae40 msgr2=0x7fb9ec15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:17.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.389+0000 7fb9f1574640 1 --2- 172.21.15.44:0/2962238573 >> v2:172.21.15.204:3300/0 conn(0x7fb9ec15ae40 0x7fb9ec15bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.389+0000 7fb9f1574640 1 -- 172.21.15.44:0/2962238573 >> v1:172.21.15.204:6789/0 conn(0x7fb9ec0cbc00 legacy=0x7fb9ec0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.390+0000 7fb9f1574640 1 -- 172.21.15.44:0/2962238573 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec15f890 con 0x7fb9ec0cda30 2023-11-04T01:36:17.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.390+0000 7fb9f1574640 1 --2- 172.21.15.44:0/2962238573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9ec0cda30 0x7fb9ec0ced70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec06e580 tx=0x7fb9e402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc733acc106d62e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.390+0000 7fb9eb7fe640 1 -- 172.21.15.44:0/2962238573 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e402cb20 con 0x7fb9ec0cda30 2023-11-04T01:36:17.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.391+0000 7fb9eb7fe640 1 -- 172.21.15.44:0/2962238573 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e402cc80 con 0x7fb9ec0cda30 2023-11-04T01:36:17.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.391+0000 7fb9eb7fe640 1 -- 172.21.15.44:0/2962238573 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e40343f0 con 0x7fb9ec0cda30 2023-11-04T01:36:17.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.391+0000 7fb9f2fd7640 1 -- 172.21.15.44:0/2962238573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9ec0cda30 msgr2=0x7fb9ec0ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.391+0000 7fb9f2fd7640 1 --2- 172.21.15.44:0/2962238573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9ec0cda30 0x7fb9ec0ced70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec06e580 tx=0x7fb9e402bf80 comp rx=0 tx=0).stop 2023-11-04T01:36:17.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.391+0000 7fb9f2fd7640 1 -- 172.21.15.44:0/2962238573 shutdown_connections 2023-11-04T01:36:17.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.391+0000 7fb9f2fd7640 1 --2- 172.21.15.44:0/2962238573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9ec0cda30 0x7fb9ec0ced70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.391+0000 7fb9f2fd7640 1 --2- 172.21.15.44:0/2962238573 >> v2:172.21.15.204:3300/0 conn(0x7fb9ec15ae40 0x7fb9ec15bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.391+0000 7fb9f2fd7640 1 -- 172.21.15.44:0/2962238573 >> 172.21.15.44:0/2962238573 conn(0x7fb9ec06ea90 msgr2=0x7fb9ec06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:17.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.391+0000 7fb9f2fd7640 1 -- 172.21.15.44:0/2962238573 shutdown_connections 2023-11-04T01:36:17.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.391+0000 7fb9f2fd7640 1 -- 172.21.15.44:0/2962238573 wait complete. 2023-11-04T01:36:17.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.392+0000 7fb9f2fd7640 1 Processor -- start 2023-11-04T01:36:17.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.392+0000 7fb9f2fd7640 1 -- start start 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.393+0000 7fb9f2fd7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9ec0cbc00 0x7fb9ec0c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.393+0000 7fb9f2fd7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9ec0cda30 0x7fb9ec14fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.393+0000 7fb9f2fd7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9ec15ae40 0x7fb9ec14ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.393+0000 7fb9f2fd7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec140070 con 0x7fb9ec0cda30 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.393+0000 7fb9f2fd7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec1504d0 con 0x7fb9ec0cbc00 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.393+0000 7fb9f2fd7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec0c5cc0 con 0x7fb9ec15ae40 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.393+0000 7fb9ebfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9ec0cda30 0x7fb9ec14fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.393+0000 7fb9ebfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9ec0cda30 0x7fb9ec14fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48810/0 (socket says 172.21.15.44:48810) 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.393+0000 7fb9ebfff640 1 -- 172.21.15.44:0/1420341822 learned_addr learned my addr 172.21.15.44:0/1420341822 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.393+0000 7fb9f0d73640 1 --2- 172.21.15.44:0/1420341822 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9ec0cbc00 0x7fb9ec0c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.394+0000 7fb9f1574640 1 --2- 172.21.15.44:0/1420341822 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9ec15ae40 0x7fb9ec14ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.394+0000 7fb9ebfff640 1 -- 172.21.15.44:0/1420341822 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9ec15ae40 msgr2=0x7fb9ec14ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.394+0000 7fb9ebfff640 1 --2- 172.21.15.44:0/1420341822 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9ec15ae40 0x7fb9ec14ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.394+0000 7fb9ebfff640 1 -- 172.21.15.44:0/1420341822 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9ec0cbc00 msgr2=0x7fb9ec0c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.394+0000 7fb9ebfff640 1 --2- 172.21.15.44:0/1420341822 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9ec0cbc00 0x7fb9ec0c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.394+0000 7fb9ebfff640 1 -- 172.21.15.44:0/1420341822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e4009b30 con 0x7fb9ec0cda30 2023-11-04T01:36:17.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.394+0000 7fb9ebfff640 1 --2- 172.21.15.44:0/1420341822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9ec0cda30 0x7fb9ec14fa50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000c450 tx=0x7fb9e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.394+0000 7fb9e97fa640 1 -- 172.21.15.44:0/1420341822 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00052d0 con 0x7fb9ec0cda30 2023-11-04T01:36:17.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.394+0000 7fb9e97fa640 1 -- 172.21.15.44:0/1420341822 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e0005430 con 0x7fb9ec0cda30 2023-11-04T01:36:17.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.394+0000 7fb9f2fd7640 1 -- 172.21.15.44:0/1420341822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ec0c5fa0 con 0x7fb9ec0cda30 2023-11-04T01:36:17.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.394+0000 7fb9e97fa640 1 -- 172.21.15.44:0/1420341822 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0012870 con 0x7fb9ec0cda30 2023-11-04T01:36:17.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.394+0000 7fb9f2fd7640 1 -- 172.21.15.44:0/1420341822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ec0c6560 con 0x7fb9ec0cda30 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.395+0000 7fb9f2fd7640 1 -- 172.21.15.44:0/1420341822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ec0ce2d0 con 0x7fb9ec0cda30 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.395+0000 7fb9e97fa640 1 -- 172.21.15.44:0/1420341822 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb9e00129d0 con 0x7fb9ec0cda30 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.396+0000 7fb9e97fa640 1 --2- 172.21.15.44:0/1420341822 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb9d806aea0 0x7fb9d806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.396+0000 7fb9e97fa640 1 -- 172.21.15.44:0/1420341822 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb9e0089040 con 0x7fb9ec0cda30 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.396+0000 7fb9f0d73640 1 --2- 172.21.15.44:0/1420341822 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb9d806aea0 0x7fb9d806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.397+0000 7fb9f0d73640 1 --2- 172.21.15.44:0/1420341822 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb9d806aea0 0x7fb9d806d360 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0c6b20 tx=0x7fb9dc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.400+0000 7fb9e97fa640 1 -- 172.21.15.44:0/1420341822 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb9e0053f40 con 0x7fb9ec0cda30 2023-11-04T01:36:17.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.576+0000 7fb9f2fd7640 1 -- 172.21.15.44:0/1420341822 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9ec15edb0 con 0x7fb9d806aea0 2023-11-04T01:36:17.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.585+0000 7fb9e97fa640 1 -- 172.21.15.44:0/1420341822 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345286 (secure 0 0 0) 0x7fb9dc0108a0 con 0x7fb9d806aea0 2023-11-04T01:36:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:17.593 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:36:17.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.588+0000 7fb9f2fd7640 1 -- 172.21.15.44:0/1420341822 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb9d806aea0 msgr2=0x7fb9d806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.588+0000 7fb9f2fd7640 1 --2- 172.21.15.44:0/1420341822 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb9d806aea0 0x7fb9d806d360 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0c6b20 tx=0x7fb9dc008040 comp rx=0 tx=0).stop 2023-11-04T01:36:17.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.588+0000 7fb9f2fd7640 1 -- 172.21.15.44:0/1420341822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9ec0cda30 msgr2=0x7fb9ec14fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.588+0000 7fb9f2fd7640 1 --2- 172.21.15.44:0/1420341822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9ec0cda30 0x7fb9ec14fa50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000c450 tx=0x7fb9e000c910 comp rx=0 tx=0).stop 2023-11-04T01:36:17.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.588+0000 7fb9f2fd7640 1 -- 172.21.15.44:0/1420341822 shutdown_connections 2023-11-04T01:36:17.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.588+0000 7fb9f2fd7640 1 --2- 172.21.15.44:0/1420341822 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb9d806aea0 0x7fb9d806d360 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.588+0000 7fb9f2fd7640 1 --2- 172.21.15.44:0/1420341822 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9ec15ae40 0x7fb9ec14ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.588+0000 7fb9f2fd7640 1 --2- 172.21.15.44:0/1420341822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9ec0cda30 0x7fb9ec14fa50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.588+0000 7fb9f2fd7640 1 --2- 172.21.15.44:0/1420341822 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9ec0cbc00 0x7fb9ec0c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.589+0000 7fb9f2fd7640 1 -- 172.21.15.44:0/1420341822 >> 172.21.15.44:0/1420341822 conn(0x7fb9ec06ea90 msgr2=0x7fb9ec15d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:17.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.589+0000 7fb9f2fd7640 1 -- 172.21.15.44:0/1420341822 shutdown_connections 2023-11-04T01:36:17.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.589+0000 7fb9f2fd7640 1 -- 172.21.15.44:0/1420341822 wait complete. 2023-11-04T01:36:17.603 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-11-04T01:36:16.576139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594866,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3280896,"data_stored":1987049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2088,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003094"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233378+0000","last_change":"2023-11-04T01:35:58.195271+0000","last_active":"2023-11-04T01:36:03.233378+0000","last_peered":"2023-11-04T01:36:03.233378+0000","last_clean":"2023-11-04T01:36:03.233378+0000","last_became_active":"2023-11-04T01:35:58.194946+0000","last_became_peered":"2023-11-04T01:35:58.194946+0000","last_unstale":"2023-11-04T01:36:03.233378+0000","last_undegraded":"2023-11-04T01:36:03.233378+0000","last_fullsized":"2023-11-04T01:36:03.233378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:46.133808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220450+0000","last_change":"2023-11-04T01:35:59.179018+0000","last_active":"2023-11-04T01:36:03.220450+0000","last_peered":"2023-11-04T01:36:03.220450+0000","last_clean":"2023-11-04T01:36:03.220450+0000","last_became_active":"2023-11-04T01:35:59.178607+0000","last_became_peered":"2023-11-04T01:35:59.178607+0000","last_unstale":"2023-11-04T01:36:03.220450+0000","last_undegraded":"2023-11-04T01:36:03.220450+0000","last_fullsized":"2023-11-04T01:36:03.220450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164443+0000","last_change":"2023-11-04T01:36:03.421566+0000","last_active":"2023-11-04T01:36:04.164443+0000","last_peered":"2023-11-04T01:36:04.164443+0000","last_clean":"2023-11-04T01:36:04.164443+0000","last_became_active":"2023-11-04T01:36:03.420841+0000","last_became_peered":"2023-11-04T01:36:03.420841+0000","last_unstale":"2023-11-04T01:36:04.164443+0000","last_undegraded":"2023-11-04T01:36:04.164443+0000","last_fullsized":"2023-11-04T01:36:04.164443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:09.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220481+0000","last_change":"2023-11-04T01:35:58.192868+0000","last_active":"2023-11-04T01:36:03.220481+0000","last_peered":"2023-11-04T01:36:03.220481+0000","last_clean":"2023-11-04T01:36:03.220481+0000","last_became_active":"2023-11-04T01:35:58.192539+0000","last_became_peered":"2023-11-04T01:35:58.192539+0000","last_unstale":"2023-11-04T01:36:03.220481+0000","last_undegraded":"2023-11-04T01:36:03.220481+0000","last_fullsized":"2023-11-04T01:36:03.220481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:56.079264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231660+0000","last_change":"2023-11-04T01:35:59.188981+0000","last_active":"2023-11-04T01:36:03.231660+0000","last_peered":"2023-11-04T01:36:03.231660+0000","last_clean":"2023-11-04T01:36:03.231660+0000","last_became_active":"2023-11-04T01:35:59.188652+0000","last_became_peered":"2023-11-04T01:35:59.188652+0000","last_unstale":"2023-11-04T01:36:03.231660+0000","last_undegraded":"2023-11-04T01:36:03.231660+0000","last_fullsized":"2023-11-04T01:36:03.231660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165630+0000","last_change":"2023-11-04T01:36:03.236391+0000","last_active":"2023-11-04T01:36:04.165630+0000","last_peered":"2023-11-04T01:36:04.165630+0000","last_clean":"2023-11-04T01:36:04.165630+0000","last_became_active":"2023-11-04T01:36:03.235906+0000","last_became_peered":"2023-11-04T01:36:03.235906+0000","last_unstale":"2023-11-04T01:36:04.165630+0000","last_undegraded":"2023-11-04T01:36:04.165630+0000","last_fullsized":"2023-11-04T01:36:04.165630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:35.196927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418151+0000","last_change":"2023-11-04T01:35:58.197184+0000","last_active":"2023-11-04T01:36:03.418151+0000","last_peered":"2023-11-04T01:36:03.418151+0000","last_clean":"2023-11-04T01:36:03.418151+0000","last_became_active":"2023-11-04T01:35:58.196766+0000","last_became_peered":"2023-11-04T01:35:58.196766+0000","last_unstale":"2023-11-04T01:36:03.418151+0000","last_undegraded":"2023-11-04T01:36:03.418151+0000","last_fullsized":"2023-11-04T01:36:03.418151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:04.765423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228152+0000","last_change":"2023-11-04T01:35:59.189310+0000","last_active":"2023-11-04T01:36:03.228152+0000","last_peered":"2023-11-04T01:36:03.228152+0000","last_clean":"2023-11-04T01:36:03.228152+0000","last_became_active":"2023-11-04T01:35:59.189034+0000","last_became_peered":"2023-11-04T01:35:59.189034+0000","last_unstale":"2023-11-04T01:36:03.228152+0000","last_undegraded":"2023-11-04T01:36:03.228152+0000","last_fullsized":"2023-11-04T01:36:03.228152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:31.045884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165630+0000","last_change":"2023-11-04T01:36:03.237859+0000","last_active":"2023-11-04T01:36:04.165630+0000","last_peered":"2023-11-04T01:36:04.165630+0000","last_clean":"2023-11-04T01:36:04.165630+0000","last_became_active":"2023-11-04T01:36:03.237472+0000","last_became_peered":"2023-11-04T01:36:03.237472+0000","last_unstale":"2023-11-04T01:36:04.165630+0000","last_undegraded":"2023-11-04T01:36:04.165630+0000","last_fullsized":"2023-11-04T01:36:04.165630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:47.574623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417583+0000","last_change":"2023-11-04T01:35:58.196082+0000","last_active":"2023-11-04T01:36:03.417583+0000","last_peered":"2023-11-04T01:36:03.417583+0000","last_clean":"2023-11-04T01:36:03.417583+0000","last_became_active":"2023-11-04T01:35:58.195823+0000","last_became_peered":"2023-11-04T01:35:58.195823+0000","last_unstale":"2023-11-04T01:36:03.417583+0000","last_undegraded":"2023-11-04T01:36:03.417583+0000","last_fullsized":"2023-11-04T01:36:03.417583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227869+0000","last_change":"2023-11-04T01:35:59.182650+0000","last_active":"2023-11-04T01:36:03.227869+0000","last_peered":"2023-11-04T01:36:03.227869+0000","last_clean":"2023-11-04T01:36:03.227869+0000","last_became_active":"2023-11-04T01:35:59.182397+0000","last_became_peered":"2023-11-04T01:35:59.182397+0000","last_unstale":"2023-11-04T01:36:03.227869+0000","last_undegraded":"2023-11-04T01:36:03.227869+0000","last_fullsized":"2023-11-04T01:36:03.227869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165302+0000","last_change":"2023-11-04T01:36:03.238226+0000","last_active":"2023-11-04T01:36:04.165302+0000","last_peered":"2023-11-04T01:36:04.165302+0000","last_clean":"2023-11-04T01:36:04.165302+0000","last_became_active":"2023-11-04T01:36:03.237796+0000","last_became_peered":"2023-11-04T01:36:03.237796+0000","last_unstale":"2023-11-04T01:36:04.165302+0000","last_undegraded":"2023-11-04T01:36:04.165302+0000","last_fullsized":"2023-11-04T01:36:04.165302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:56.134800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223628+0000","last_change":"2023-11-04T01:35:59.175182+0000","last_active":"2023-11-04T01:36:03.223628+0000","last_peered":"2023-11-04T01:36:03.223628+0000","last_clean":"2023-11-04T01:36:03.223628+0000","last_became_active":"2023-11-04T01:35:59.174889+0000","last_became_peered":"2023-11-04T01:35:59.174889+0000","last_unstale":"2023-11-04T01:36:03.223628+0000","last_undegraded":"2023-11-04T01:36:03.223628+0000","last_fullsized":"2023-11-04T01:36:03.223628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417641+0000","last_change":"2023-11-04T01:35:58.191418+0000","last_active":"2023-11-04T01:36:03.417641+0000","last_peered":"2023-11-04T01:36:03.417641+0000","last_clean":"2023-11-04T01:36:03.417641+0000","last_became_active":"2023-11-04T01:35:58.191164+0000","last_became_peered":"2023-11-04T01:35:58.191164+0000","last_unstale":"2023-11-04T01:36:03.417641+0000","last_undegraded":"2023-11-04T01:36:03.417641+0000","last_fullsized":"2023-11-04T01:36:03.417641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:56.366802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.166438+0000","last_change":"2023-11-04T01:36:03.238741+0000","last_active":"2023-11-04T01:36:04.166438+0000","last_peered":"2023-11-04T01:36:04.166438+0000","last_clean":"2023-11-04T01:36:04.166438+0000","last_became_active":"2023-11-04T01:36:03.238130+0000","last_became_peered":"2023-11-04T01:36:03.238130+0000","last_unstale":"2023-11-04T01:36:04.166438+0000","last_undegraded":"2023-11-04T01:36:04.166438+0000","last_fullsized":"2023-11-04T01:36:04.166438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:51.792275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219755+0000","last_change":"2023-11-04T01:35:59.181378+0000","last_active":"2023-11-04T01:36:03.219755+0000","last_peered":"2023-11-04T01:36:03.219755+0000","last_clean":"2023-11-04T01:36:03.219755+0000","last_became_active":"2023-11-04T01:35:59.180852+0000","last_became_peered":"2023-11-04T01:35:59.180852+0000","last_unstale":"2023-11-04T01:36:03.219755+0000","last_undegraded":"2023-11-04T01:36:03.219755+0000","last_fullsized":"2023-11-04T01:36:03.219755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.235667+0000","last_change":"2023-11-04T01:35:58.192955+0000","last_active":"2023-11-04T01:36:03.235667+0000","last_peered":"2023-11-04T01:36:03.235667+0000","last_clean":"2023-11-04T01:36:03.235667+0000","last_became_active":"2023-11-04T01:35:58.192609+0000","last_became_peered":"2023-11-04T01:35:58.192609+0000","last_unstale":"2023-11-04T01:36:03.235667+0000","last_undegraded":"2023-11-04T01:36:03.235667+0000","last_fullsized":"2023-11-04T01:36:03.235667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165731+0000","last_change":"2023-11-04T01:36:03.239699+0000","last_active":"2023-11-04T01:36:04.165731+0000","last_peered":"2023-11-04T01:36:04.165731+0000","last_clean":"2023-11-04T01:36:04.165731+0000","last_became_active":"2023-11-04T01:36:03.239146+0000","last_became_peered":"2023-11-04T01:36:03.239146+0000","last_unstale":"2023-11-04T01:36:04.165731+0000","last_undegraded":"2023-11-04T01:36:04.165731+0000","last_fullsized":"2023-11-04T01:36:04.165731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:50.421408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220829+0000","last_change":"2023-11-04T01:35:59.179889+0000","last_active":"2023-11-04T01:36:03.220829+0000","last_peered":"2023-11-04T01:36:03.220829+0000","last_clean":"2023-11-04T01:36:03.220829+0000","last_became_active":"2023-11-04T01:35:59.178416+0000","last_became_peered":"2023-11-04T01:35:59.178416+0000","last_unstale":"2023-11-04T01:36:03.220829+0000","last_undegraded":"2023-11-04T01:36:03.220829+0000","last_fullsized":"2023-11-04T01:36:03.220829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234302+0000","last_change":"2023-11-04T01:35:58.193758+0000","last_active":"2023-11-04T01:36:03.234302+0000","last_peered":"2023-11-04T01:36:03.234302+0000","last_clean":"2023-11-04T01:36:03.234302+0000","last_became_active":"2023-11-04T01:35:58.191341+0000","last_became_peered":"2023-11-04T01:35:58.191341+0000","last_unstale":"2023-11-04T01:36:03.234302+0000","last_undegraded":"2023-11-04T01:36:03.234302+0000","last_fullsized":"2023-11-04T01:36:03.234302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:46.133808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360658+0000","last_change":"2023-11-04T01:36:03.419927+0000","last_active":"2023-11-04T01:36:05.360658+0000","last_peered":"2023-11-04T01:36:05.360658+0000","last_clean":"2023-11-04T01:36:05.360658+0000","last_became_active":"2023-11-04T01:36:03.419458+0000","last_became_peered":"2023-11-04T01:36:03.419458+0000","last_unstale":"2023-11-04T01:36:05.360658+0000","last_undegraded":"2023-11-04T01:36:05.360658+0000","last_fullsized":"2023-11-04T01:36:05.360658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:55.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.222904+0000","last_change":"2023-11-04T01:35:59.178344+0000","last_active":"2023-11-04T01:36:03.222904+0000","last_peered":"2023-11-04T01:36:03.222904+0000","last_clean":"2023-11-04T01:36:03.222904+0000","last_became_active":"2023-11-04T01:35:59.178069+0000","last_became_peered":"2023-11-04T01:35:59.178069+0000","last_unstale":"2023-11-04T01:36:03.222904+0000","last_undegraded":"2023-11-04T01:36:03.222904+0000","last_fullsized":"2023-11-04T01:36:03.222904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:17:14.967316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417197+0000","last_change":"2023-11-04T01:35:58.198451+0000","last_active":"2023-11-04T01:36:03.417197+0000","last_peered":"2023-11-04T01:36:03.417197+0000","last_clean":"2023-11-04T01:36:03.417197+0000","last_became_active":"2023-11-04T01:35:58.198191+0000","last_became_peered":"2023-11-04T01:35:58.198191+0000","last_unstale":"2023-11-04T01:36:03.417197+0000","last_undegraded":"2023-11-04T01:36:03.417197+0000","last_fullsized":"2023-11-04T01:36:03.417197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:17:13.959681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.166193+0000","last_change":"2023-11-04T01:36:03.239679+0000","last_active":"2023-11-04T01:36:04.166193+0000","last_peered":"2023-11-04T01:36:04.166193+0000","last_clean":"2023-11-04T01:36:04.166193+0000","last_became_active":"2023-11-04T01:36:03.239148+0000","last_became_peered":"2023-11-04T01:36:03.239148+0000","last_unstale":"2023-11-04T01:36:04.166193+0000","last_undegraded":"2023-11-04T01:36:04.166193+0000","last_fullsized":"2023-11-04T01:36:04.166193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:35.083514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233606+0000","last_change":"2023-11-04T01:35:59.179921+0000","last_active":"2023-11-04T01:36:03.233606+0000","last_peered":"2023-11-04T01:36:03.233606+0000","last_clean":"2023-11-04T01:36:03.233606+0000","last_became_active":"2023-11-04T01:35:59.179555+0000","last_became_peered":"2023-11-04T01:35:59.179555+0000","last_unstale":"2023-11-04T01:36:03.233606+0000","last_undegraded":"2023-11-04T01:36:03.233606+0000","last_fullsized":"2023-11-04T01:36:03.233606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224666+0000","last_change":"2023-11-04T01:35:58.194520+0000","last_active":"2023-11-04T01:36:03.224666+0000","last_peered":"2023-11-04T01:36:03.224666+0000","last_clean":"2023-11-04T01:36:03.224666+0000","last_became_active":"2023-11-04T01:35:58.193227+0000","last_became_peered":"2023-11-04T01:35:58.193227+0000","last_unstale":"2023-11-04T01:36:03.224666+0000","last_undegraded":"2023-11-04T01:36:03.224666+0000","last_fullsized":"2023-11-04T01:36:03.224666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:56.079264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165353+0000","last_change":"2023-11-04T01:36:03.422666+0000","last_active":"2023-11-04T01:36:04.165353+0000","last_peered":"2023-11-04T01:36:04.165353+0000","last_clean":"2023-11-04T01:36:04.165353+0000","last_became_active":"2023-11-04T01:36:03.422271+0000","last_became_peered":"2023-11-04T01:36:03.422271+0000","last_unstale":"2023-11-04T01:36:04.165353+0000","last_undegraded":"2023-11-04T01:36:04.165353+0000","last_fullsized":"2023-11-04T01:36:04.165353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:00.309557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219727+0000","last_change":"2023-11-04T01:35:59.183456+0000","last_active":"2023-11-04T01:36:03.219727+0000","last_peered":"2023-11-04T01:36:03.219727+0000","last_clean":"2023-11-04T01:36:03.219727+0000","last_became_active":"2023-11-04T01:35:59.182344+0000","last_became_peered":"2023-11-04T01:35:59.182344+0000","last_unstale":"2023-11-04T01:36:03.219727+0000","last_undegraded":"2023-11-04T01:36:03.219727+0000","last_fullsized":"2023-11-04T01:36:03.219727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.237645+0000","last_change":"2023-11-04T01:35:58.193617+0000","last_active":"2023-11-04T01:36:03.237645+0000","last_peered":"2023-11-04T01:36:03.237645+0000","last_clean":"2023-11-04T01:36:03.237645+0000","last_became_active":"2023-11-04T01:35:58.193111+0000","last_became_peered":"2023-11-04T01:35:58.193111+0000","last_unstale":"2023-11-04T01:36:03.237645+0000","last_undegraded":"2023-11-04T01:36:03.237645+0000","last_fullsized":"2023-11-04T01:36:03.237645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:56.079264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164341+0000","last_change":"2023-11-04T01:36:03.418076+0000","last_active":"2023-11-04T01:36:04.164341+0000","last_peered":"2023-11-04T01:36:04.164341+0000","last_clean":"2023-11-04T01:36:04.164341+0000","last_became_active":"2023-11-04T01:36:03.417662+0000","last_became_peered":"2023-11-04T01:36:03.417662+0000","last_unstale":"2023-11-04T01:36:04.164341+0000","last_undegraded":"2023-11-04T01:36:04.164341+0000","last_fullsized":"2023-11-04T01:36:04.164341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:55.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234516+0000","last_change":"2023-11-04T01:35:59.177457+0000","last_active":"2023-11-04T01:36:03.234516+0000","last_peered":"2023-11-04T01:36:03.234516+0000","last_clean":"2023-11-04T01:36:03.234516+0000","last_became_active":"2023-11-04T01:35:59.177119+0000","last_became_peered":"2023-11-04T01:35:59.177119+0000","last_unstale":"2023-11-04T01:36:03.234516+0000","last_undegraded":"2023-11-04T01:36:03.234516+0000","last_fullsized":"2023-11-04T01:36:03.234516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418829+0000","last_change":"2023-11-04T01:35:58.198460+0000","last_active":"2023-11-04T01:36:03.418829+0000","last_peered":"2023-11-04T01:36:03.418829+0000","last_clean":"2023-11-04T01:36:03.418829+0000","last_became_active":"2023-11-04T01:35:58.198149+0000","last_became_peered":"2023-11-04T01:35:58.198149+0000","last_unstale":"2023-11-04T01:36:03.418829+0000","last_undegraded":"2023-11-04T01:36:03.418829+0000","last_fullsized":"2023-11-04T01:36:03.418829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:37.379069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.113926+0000","last_change":"2023-11-04T01:36:03.418067+0000","last_active":"2023-11-04T01:36:05.113926+0000","last_peered":"2023-11-04T01:36:05.113926+0000","last_clean":"2023-11-04T01:36:05.113926+0000","last_became_active":"2023-11-04T01:36:03.417580+0000","last_became_peered":"2023-11-04T01:36:03.417580+0000","last_unstale":"2023-11-04T01:36:05.113926+0000","last_undegraded":"2023-11-04T01:36:05.113926+0000","last_fullsized":"2023-11-04T01:36:05.113926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:02.636600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228055+0000","last_change":"2023-11-04T01:35:59.181672+0000","last_active":"2023-11-04T01:36:03.228055+0000","last_peered":"2023-11-04T01:36:03.228055+0000","last_clean":"2023-11-04T01:36:03.228055+0000","last_became_active":"2023-11-04T01:35:59.181366+0000","last_became_peered":"2023-11-04T01:35:59.181366+0000","last_unstale":"2023-11-04T01:36:03.228055+0000","last_undegraded":"2023-11-04T01:36:03.228055+0000","last_fullsized":"2023-11-04T01:36:03.228055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:41.888526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234512+0000","last_change":"2023-11-04T01:35:58.198371+0000","last_active":"2023-11-04T01:36:03.234512+0000","last_peered":"2023-11-04T01:36:03.234512+0000","last_clean":"2023-11-04T01:36:03.234512+0000","last_became_active":"2023-11-04T01:35:58.197948+0000","last_became_peered":"2023-11-04T01:35:58.197948+0000","last_unstale":"2023-11-04T01:36:03.234512+0000","last_undegraded":"2023-11-04T01:36:03.234512+0000","last_fullsized":"2023-11-04T01:36:03.234512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:37.960678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360112+0000","last_change":"2023-11-04T01:36:03.242811+0000","last_active":"2023-11-04T01:36:05.360112+0000","last_peered":"2023-11-04T01:36:05.360112+0000","last_clean":"2023-11-04T01:36:05.360112+0000","last_became_active":"2023-11-04T01:36:03.242415+0000","last_became_peered":"2023-11-04T01:36:03.242415+0000","last_unstale":"2023-11-04T01:36:05.360112+0000","last_undegraded":"2023-11-04T01:36:05.360112+0000","last_fullsized":"2023-11-04T01:36:05.360112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:26.435962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224250+0000","last_change":"2023-11-04T01:35:59.172529+0000","last_active":"2023-11-04T01:36:03.224250+0000","last_peered":"2023-11-04T01:36:03.224250+0000","last_clean":"2023-11-04T01:36:03.224250+0000","last_became_active":"2023-11-04T01:35:59.172235+0000","last_became_peered":"2023-11-04T01:35:59.172235+0000","last_unstale":"2023-11-04T01:36:03.224250+0000","last_undegraded":"2023-11-04T01:36:03.224250+0000","last_fullsized":"2023-11-04T01:36:03.224250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:48.565872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228657+0000","last_change":"2023-11-04T01:35:58.192742+0000","last_active":"2023-11-04T01:36:03.228657+0000","last_peered":"2023-11-04T01:36:03.228657+0000","last_clean":"2023-11-04T01:36:03.228657+0000","last_became_active":"2023-11-04T01:35:58.192399+0000","last_became_peered":"2023-11-04T01:35:58.192399+0000","last_unstale":"2023-11-04T01:36:03.228657+0000","last_undegraded":"2023-11-04T01:36:03.228657+0000","last_fullsized":"2023-11-04T01:36:03.228657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:42.026489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360489+0000","last_change":"2023-11-04T01:36:03.244294+0000","last_active":"2023-11-04T01:36:05.360489+0000","last_peered":"2023-11-04T01:36:05.360489+0000","last_clean":"2023-11-04T01:36:05.360489+0000","last_became_active":"2023-11-04T01:36:03.243799+0000","last_became_peered":"2023-11-04T01:36:03.243799+0000","last_unstale":"2023-11-04T01:36:05.360489+0000","last_undegraded":"2023-11-04T01:36:05.360489+0000","last_fullsized":"2023-11-04T01:36:05.360489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:32.058795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234087+0000","last_change":"2023-11-04T01:35:59.181498+0000","last_active":"2023-11-04T01:36:03.234087+0000","last_peered":"2023-11-04T01:36:03.234087+0000","last_clean":"2023-11-04T01:36:03.234087+0000","last_became_active":"2023-11-04T01:35:59.181162+0000","last_became_peered":"2023-11-04T01:35:59.181162+0000","last_unstale":"2023-11-04T01:36:03.234087+0000","last_undegraded":"2023-11-04T01:36:03.234087+0000","last_fullsized":"2023-11-04T01:36:03.234087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225409+0000","last_change":"2023-11-04T01:35:58.194393+0000","last_active":"2023-11-04T01:36:03.225409+0000","last_peered":"2023-11-04T01:36:03.225409+0000","last_clean":"2023-11-04T01:36:03.225409+0000","last_became_active":"2023-11-04T01:35:58.194066+0000","last_became_peered":"2023-11-04T01:35:58.194066+0000","last_unstale":"2023-11-04T01:36:03.225409+0000","last_undegraded":"2023-11-04T01:36:03.225409+0000","last_fullsized":"2023-11-04T01:36:03.225409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:24.246113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360736+0000","last_change":"2023-11-04T01:36:03.241689+0000","last_active":"2023-11-04T01:36:05.360736+0000","last_peered":"2023-11-04T01:36:05.360736+0000","last_clean":"2023-11-04T01:36:05.360736+0000","last_became_active":"2023-11-04T01:36:03.241310+0000","last_became_peered":"2023-11-04T01:36:03.241310+0000","last_unstale":"2023-11-04T01:36:05.360736+0000","last_undegraded":"2023-11-04T01:36:05.360736+0000","last_fullsized":"2023-11-04T01:36:05.360736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:09.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231312+0000","last_change":"2023-11-04T01:35:59.168220+0000","last_active":"2023-11-04T01:36:03.231312+0000","last_peered":"2023-11-04T01:36:03.231312+0000","last_clean":"2023-11-04T01:36:03.231312+0000","last_became_active":"2023-11-04T01:35:59.167947+0000","last_became_peered":"2023-11-04T01:35:59.167947+0000","last_unstale":"2023-11-04T01:36:03.231312+0000","last_undegraded":"2023-11-04T01:36:03.231312+0000","last_fullsized":"2023-11-04T01:36:03.231312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:38.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417210+0000","last_change":"2023-11-04T01:35:58.194356+0000","last_active":"2023-11-04T01:36:03.417210+0000","last_peered":"2023-11-04T01:36:03.417210+0000","last_clean":"2023-11-04T01:36:03.417210+0000","last_became_active":"2023-11-04T01:35:58.194084+0000","last_became_peered":"2023-11-04T01:35:58.194084+0000","last_unstale":"2023-11-04T01:36:03.417210+0000","last_undegraded":"2023-11-04T01:36:03.417210+0000","last_fullsized":"2023-11-04T01:36:03.417210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:47.558236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.114218+0000","last_change":"2023-11-04T01:36:03.419657+0000","last_active":"2023-11-04T01:36:05.114218+0000","last_peered":"2023-11-04T01:36:05.114218+0000","last_clean":"2023-11-04T01:36:05.114218+0000","last_became_active":"2023-11-04T01:36:03.419283+0000","last_became_peered":"2023-11-04T01:36:03.419283+0000","last_unstale":"2023-11-04T01:36:05.114218+0000","last_undegraded":"2023-11-04T01:36:05.114218+0000","last_fullsized":"2023-11-04T01:36:05.114218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:49.330726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219822+0000","last_change":"2023-11-04T01:35:59.183758+0000","last_active":"2023-11-04T01:36:03.219822+0000","last_peered":"2023-11-04T01:36:03.219822+0000","last_clean":"2023-11-04T01:36:03.219822+0000","last_became_active":"2023-11-04T01:35:59.183457+0000","last_became_peered":"2023-11-04T01:35:59.183457+0000","last_unstale":"2023-11-04T01:36:03.219822+0000","last_undegraded":"2023-11-04T01:36:03.219822+0000","last_fullsized":"2023-11-04T01:36:03.219822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227709+0000","last_change":"2023-11-04T01:35:58.193549+0000","last_active":"2023-11-04T01:36:03.227709+0000","last_peered":"2023-11-04T01:36:03.227709+0000","last_clean":"2023-11-04T01:36:03.227709+0000","last_became_active":"2023-11-04T01:35:58.193066+0000","last_became_peered":"2023-11-04T01:35:58.193066+0000","last_unstale":"2023-11-04T01:36:03.227709+0000","last_undegraded":"2023-11-04T01:36:03.227709+0000","last_fullsized":"2023-11-04T01:36:03.227709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:30.570768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417292+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:36:03.417292+0000","last_peered":"2023-11-04T01:36:03.417292+0000","last_clean":"2023-11-04T01:36:03.417292+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:36:03.417292+0000","last_undegraded":"2023-11-04T01:36:03.417292+0000","last_fullsized":"2023-11-04T01:36:03.417292+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165356+0000","last_change":"2023-11-04T01:36:03.420650+0000","last_active":"2023-11-04T01:36:04.165356+0000","last_peered":"2023-11-04T01:36:04.165356+0000","last_clean":"2023-11-04T01:36:04.165356+0000","last_became_active":"2023-11-04T01:36:03.420227+0000","last_became_peered":"2023-11-04T01:36:03.420227+0000","last_unstale":"2023-11-04T01:36:04.165356+0000","last_undegraded":"2023-11-04T01:36:04.165356+0000","last_fullsized":"2023-11-04T01:36:04.165356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:41.965687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418146+0000","last_change":"2023-11-04T01:35:59.188596+0000","last_active":"2023-11-04T01:36:03.418146+0000","last_peered":"2023-11-04T01:36:03.418146+0000","last_clean":"2023-11-04T01:36:03.418146+0000","last_became_active":"2023-11-04T01:35:59.188308+0000","last_became_peered":"2023-11-04T01:35:59.188308+0000","last_unstale":"2023-11-04T01:36:03.418146+0000","last_undegraded":"2023-11-04T01:36:03.418146+0000","last_fullsized":"2023-11-04T01:36:03.418146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:41.888526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.226336+0000","last_change":"2023-11-04T01:35:58.196283+0000","last_active":"2023-11-04T01:36:03.226336+0000","last_peered":"2023-11-04T01:36:03.226336+0000","last_clean":"2023-11-04T01:36:03.226336+0000","last_became_active":"2023-11-04T01:35:58.195971+0000","last_became_peered":"2023-11-04T01:35:58.195971+0000","last_unstale":"2023-11-04T01:36:03.226336+0000","last_undegraded":"2023-11-04T01:36:03.226336+0000","last_fullsized":"2023-11-04T01:36:03.226336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:47.558236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165453+0000","last_change":"2023-11-04T01:36:03.418712+0000","last_active":"2023-11-04T01:36:04.165453+0000","last_peered":"2023-11-04T01:36:04.165453+0000","last_clean":"2023-11-04T01:36:04.165453+0000","last_became_active":"2023-11-04T01:36:03.417693+0000","last_became_peered":"2023-11-04T01:36:03.417693+0000","last_unstale":"2023-11-04T01:36:04.165453+0000","last_undegraded":"2023-11-04T01:36:04.165453+0000","last_fullsized":"2023-11-04T01:36:04.165453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:35.083514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228228+0000","last_change":"2023-11-04T01:35:59.187963+0000","last_active":"2023-11-04T01:36:03.228228+0000","last_peered":"2023-11-04T01:36:03.228228+0000","last_clean":"2023-11-04T01:36:03.228228+0000","last_became_active":"2023-11-04T01:35:59.187711+0000","last_became_peered":"2023-11-04T01:35:59.187711+0000","last_unstale":"2023-11-04T01:36:03.228228+0000","last_undegraded":"2023-11-04T01:36:03.228228+0000","last_fullsized":"2023-11-04T01:36:03.228228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:39.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236382+0000","last_change":"2023-11-04T01:35:58.190482+0000","last_active":"2023-11-04T01:36:03.236382+0000","last_peered":"2023-11-04T01:36:03.236382+0000","last_clean":"2023-11-04T01:36:03.236382+0000","last_became_active":"2023-11-04T01:35:58.190198+0000","last_became_peered":"2023-11-04T01:35:58.190198+0000","last_unstale":"2023-11-04T01:36:03.236382+0000","last_undegraded":"2023-11-04T01:36:03.236382+0000","last_fullsized":"2023-11-04T01:36:03.236382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:37.379069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.113987+0000","last_change":"2023-11-04T01:36:03.236376+0000","last_active":"2023-11-04T01:36:05.113987+0000","last_peered":"2023-11-04T01:36:05.113987+0000","last_clean":"2023-11-04T01:36:05.113987+0000","last_became_active":"2023-11-04T01:36:03.235968+0000","last_became_peered":"2023-11-04T01:36:03.235968+0000","last_unstale":"2023-11-04T01:36:05.113987+0000","last_undegraded":"2023-11-04T01:36:05.113987+0000","last_fullsized":"2023-11-04T01:36:05.113987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:32.058795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418889+0000","last_change":"2023-11-04T01:35:59.188577+0000","last_active":"2023-11-04T01:36:03.418889+0000","last_peered":"2023-11-04T01:36:03.418889+0000","last_clean":"2023-11-04T01:36:03.418889+0000","last_became_active":"2023-11-04T01:35:59.188287+0000","last_became_peered":"2023-11-04T01:35:59.188287+0000","last_unstale":"2023-11-04T01:36:03.418889+0000","last_undegraded":"2023-11-04T01:36:03.418889+0000","last_fullsized":"2023-11-04T01:36:03.418889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:28.021164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225705+0000","last_change":"2023-11-04T01:35:58.194717+0000","last_active":"2023-11-04T01:36:03.225705+0000","last_peered":"2023-11-04T01:36:03.225705+0000","last_clean":"2023-11-04T01:36:03.225705+0000","last_became_active":"2023-11-04T01:35:58.194401+0000","last_became_peered":"2023-11-04T01:35:58.194401+0000","last_unstale":"2023-11-04T01:36:03.225705+0000","last_undegraded":"2023-11-04T01:36:03.225705+0000","last_fullsized":"2023-11-04T01:36:03.225705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:30.570768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360201+0000","last_change":"2023-11-04T01:36:03.422674+0000","last_active":"2023-11-04T01:36:05.360201+0000","last_peered":"2023-11-04T01:36:05.360201+0000","last_clean":"2023-11-04T01:36:05.360201+0000","last_became_active":"2023-11-04T01:36:03.422257+0000","last_became_peered":"2023-11-04T01:36:03.422257+0000","last_unstale":"2023-11-04T01:36:05.360201+0000","last_undegraded":"2023-11-04T01:36:05.360201+0000","last_fullsized":"2023-11-04T01:36:05.360201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:49.330726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418123+0000","last_change":"2023-11-04T01:35:59.179250+0000","last_active":"2023-11-04T01:36:03.418123+0000","last_peered":"2023-11-04T01:36:03.418123+0000","last_clean":"2023-11-04T01:36:03.418123+0000","last_became_active":"2023-11-04T01:35:59.178986+0000","last_became_peered":"2023-11-04T01:35:59.178986+0000","last_unstale":"2023-11-04T01:36:03.418123+0000","last_undegraded":"2023-11-04T01:36:03.418123+0000","last_fullsized":"2023-11-04T01:36:03.418123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223002+0000","last_change":"2023-11-04T01:35:58.190516+0000","last_active":"2023-11-04T01:36:03.223002+0000","last_peered":"2023-11-04T01:36:03.223002+0000","last_clean":"2023-11-04T01:36:03.223002+0000","last_became_active":"2023-11-04T01:35:58.190211+0000","last_became_peered":"2023-11-04T01:35:58.190211+0000","last_unstale":"2023-11-04T01:36:03.223002+0000","last_undegraded":"2023-11-04T01:36:03.223002+0000","last_fullsized":"2023-11-04T01:36:03.223002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:04.019377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165115+0000","last_change":"2023-11-04T01:36:03.239656+0000","last_active":"2023-11-04T01:36:04.165115+0000","last_peered":"2023-11-04T01:36:04.165115+0000","last_clean":"2023-11-04T01:36:04.165115+0000","last_became_active":"2023-11-04T01:36:03.239212+0000","last_became_peered":"2023-11-04T01:36:03.239212+0000","last_unstale":"2023-11-04T01:36:04.165115+0000","last_undegraded":"2023-11-04T01:36:04.165115+0000","last_fullsized":"2023-11-04T01:36:04.165115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:01.412068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417453+0000","last_change":"2023-11-04T01:35:59.179105+0000","last_active":"2023-11-04T01:36:03.417453+0000","last_peered":"2023-11-04T01:36:03.417453+0000","last_clean":"2023-11-04T01:36:03.417453+0000","last_became_active":"2023-11-04T01:35:59.178837+0000","last_became_peered":"2023-11-04T01:35:59.178837+0000","last_unstale":"2023-11-04T01:36:03.417453+0000","last_undegraded":"2023-11-04T01:36:03.417453+0000","last_fullsized":"2023-11-04T01:36:03.417453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225915+0000","last_change":"2023-11-04T01:35:58.195859+0000","last_active":"2023-11-04T01:36:03.225915+0000","last_peered":"2023-11-04T01:36:03.225915+0000","last_clean":"2023-11-04T01:36:03.225915+0000","last_became_active":"2023-11-04T01:35:58.195566+0000","last_became_peered":"2023-11-04T01:35:58.195566+0000","last_unstale":"2023-11-04T01:36:03.225915+0000","last_undegraded":"2023-11-04T01:36:03.225915+0000","last_fullsized":"2023-11-04T01:36:03.225915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:17:13.959681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.114145+0000","last_change":"2023-11-04T01:36:03.239374+0000","last_active":"2023-11-04T01:36:05.114145+0000","last_peered":"2023-11-04T01:36:05.114145+0000","last_clean":"2023-11-04T01:36:05.114145+0000","last_became_active":"2023-11-04T01:36:03.238617+0000","last_became_peered":"2023-11-04T01:36:03.238617+0000","last_unstale":"2023-11-04T01:36:05.114145+0000","last_undegraded":"2023-11-04T01:36:05.114145+0000","last_fullsized":"2023-11-04T01:36:05.114145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:09.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223514+0000","last_change":"2023-11-04T01:35:59.180350+0000","last_active":"2023-11-04T01:36:03.223514+0000","last_peered":"2023-11-04T01:36:03.223514+0000","last_clean":"2023-11-04T01:36:03.223514+0000","last_became_active":"2023-11-04T01:35:59.180086+0000","last_became_peered":"2023-11-04T01:35:59.180086+0000","last_unstale":"2023-11-04T01:36:03.223514+0000","last_undegraded":"2023-11-04T01:36:03.223514+0000","last_fullsized":"2023-11-04T01:36:03.223514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.222870+0000","last_change":"2023-11-04T01:35:58.186031+0000","last_active":"2023-11-04T01:36:03.222870+0000","last_peered":"2023-11-04T01:36:03.222870+0000","last_clean":"2023-11-04T01:36:03.222870+0000","last_became_active":"2023-11-04T01:35:58.185722+0000","last_became_peered":"2023-11-04T01:35:58.185722+0000","last_unstale":"2023-11-04T01:36:03.222870+0000","last_undegraded":"2023-11-04T01:36:03.222870+0000","last_fullsized":"2023-11-04T01:36:03.222870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165503+0000","last_change":"2023-11-04T01:36:03.420681+0000","last_active":"2023-11-04T01:36:04.165503+0000","last_peered":"2023-11-04T01:36:04.165503+0000","last_clean":"2023-11-04T01:36:04.165503+0000","last_became_active":"2023-11-04T01:36:03.420258+0000","last_became_peered":"2023-11-04T01:36:03.420258+0000","last_unstale":"2023-11-04T01:36:04.165503+0000","last_undegraded":"2023-11-04T01:36:04.165503+0000","last_fullsized":"2023-11-04T01:36:04.165503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:50:39.481734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417519+0000","last_change":"2023-11-04T01:35:59.188442+0000","last_active":"2023-11-04T01:36:03.417519+0000","last_peered":"2023-11-04T01:36:03.417519+0000","last_clean":"2023-11-04T01:36:03.417519+0000","last_became_active":"2023-11-04T01:35:59.188173+0000","last_became_peered":"2023-11-04T01:35:59.188173+0000","last_unstale":"2023-11-04T01:36:03.417519+0000","last_undegraded":"2023-11-04T01:36:03.417519+0000","last_fullsized":"2023-11-04T01:36:03.417519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:31.045884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228572+0000","last_change":"2023-11-04T01:35:58.197982+0000","last_active":"2023-11-04T01:36:03.228572+0000","last_peered":"2023-11-04T01:36:03.228572+0000","last_clean":"2023-11-04T01:36:03.228572+0000","last_became_active":"2023-11-04T01:35:58.197647+0000","last_became_peered":"2023-11-04T01:35:58.197647+0000","last_unstale":"2023-11-04T01:36:03.228572+0000","last_undegraded":"2023-11-04T01:36:03.228572+0000","last_fullsized":"2023-11-04T01:36:03.228572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:35.379197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165046+0000","last_change":"2023-11-04T01:36:03.419606+0000","last_active":"2023-11-04T01:36:04.165046+0000","last_peered":"2023-11-04T01:36:04.165046+0000","last_clean":"2023-11-04T01:36:04.165046+0000","last_became_active":"2023-11-04T01:36:03.419169+0000","last_became_peered":"2023-11-04T01:36:03.419169+0000","last_unstale":"2023-11-04T01:36:04.165046+0000","last_undegraded":"2023-11-04T01:36:04.165046+0000","last_fullsized":"2023-11-04T01:36:04.165046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:59.887821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233077+0000","last_change":"2023-11-04T01:35:59.175192+0000","last_active":"2023-11-04T01:36:03.233077+0000","last_peered":"2023-11-04T01:36:03.233077+0000","last_clean":"2023-11-04T01:36:03.233077+0000","last_became_active":"2023-11-04T01:35:59.174877+0000","last_became_peered":"2023-11-04T01:35:59.174877+0000","last_unstale":"2023-11-04T01:36:03.233077+0000","last_undegraded":"2023-11-04T01:36:03.233077+0000","last_fullsized":"2023-11-04T01:36:03.233077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.232115+0000","last_change":"2023-11-04T01:35:58.194353+0000","last_active":"2023-11-04T01:36:03.232115+0000","last_peered":"2023-11-04T01:36:03.232115+0000","last_clean":"2023-11-04T01:36:03.232115+0000","last_became_active":"2023-11-04T01:35:58.193311+0000","last_became_peered":"2023-11-04T01:35:58.193311+0000","last_unstale":"2023-11-04T01:36:03.232115+0000","last_undegraded":"2023-11-04T01:36:03.232115+0000","last_fullsized":"2023-11-04T01:36:03.232115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:24.246113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360678+0000","last_change":"2023-11-04T01:36:03.420683+0000","last_active":"2023-11-04T01:36:05.360678+0000","last_peered":"2023-11-04T01:36:05.360678+0000","last_clean":"2023-11-04T01:36:05.360678+0000","last_became_active":"2023-11-04T01:36:03.420294+0000","last_became_peered":"2023-11-04T01:36:03.420294+0000","last_unstale":"2023-11-04T01:36:05.360678+0000","last_undegraded":"2023-11-04T01:36:05.360678+0000","last_fullsized":"2023-11-04T01:36:05.360678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:12.398818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417775+0000","last_change":"2023-11-04T01:35:59.184924+0000","last_active":"2023-11-04T01:36:03.417775+0000","last_peered":"2023-11-04T01:36:03.417775+0000","last_clean":"2023-11-04T01:36:03.417775+0000","last_became_active":"2023-11-04T01:35:59.183229+0000","last_became_peered":"2023-11-04T01:35:59.183229+0000","last_unstale":"2023-11-04T01:36:03.417775+0000","last_undegraded":"2023-11-04T01:36:03.417775+0000","last_fullsized":"2023-11-04T01:36:03.417775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:47.754644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:08.194692+0000","last_change":"2023-11-04T01:35:58.193586+0000","last_active":"2023-11-04T01:36:08.194692+0000","last_peered":"2023-11-04T01:36:08.194692+0000","last_clean":"2023-11-04T01:36:08.194692+0000","last_became_active":"2023-11-04T01:35:58.193282+0000","last_became_peered":"2023-11-04T01:35:58.193282+0000","last_unstale":"2023-11-04T01:36:08.194692+0000","last_undegraded":"2023-11-04T01:36:08.194692+0000","last_fullsized":"2023-11-04T01:36:08.194692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:46.133808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360370+0000","last_change":"2023-11-04T01:36:03.242995+0000","last_active":"2023-11-04T01:36:05.360370+0000","last_peered":"2023-11-04T01:36:05.360370+0000","last_clean":"2023-11-04T01:36:05.360370+0000","last_became_active":"2023-11-04T01:36:03.242623+0000","last_became_peered":"2023-11-04T01:36:03.242623+0000","last_unstale":"2023-11-04T01:36:05.360370+0000","last_undegraded":"2023-11-04T01:36:05.360370+0000","last_fullsized":"2023-11-04T01:36:05.360370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:02.636600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224883+0000","last_change":"2023-11-04T01:35:59.179661+0000","last_active":"2023-11-04T01:36:03.224883+0000","last_peered":"2023-11-04T01:36:03.224883+0000","last_clean":"2023-11-04T01:36:03.224883+0000","last_became_active":"2023-11-04T01:35:59.178791+0000","last_became_peered":"2023-11-04T01:35:59.178791+0000","last_unstale":"2023-11-04T01:36:03.224883+0000","last_undegraded":"2023-11-04T01:36:03.224883+0000","last_fullsized":"2023-11-04T01:36:03.224883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:31.578404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236138+0000","last_change":"2023-11-04T01:35:58.194817+0000","last_active":"2023-11-04T01:36:03.236138+0000","last_peered":"2023-11-04T01:36:03.236138+0000","last_clean":"2023-11-04T01:36:03.236138+0000","last_became_active":"2023-11-04T01:35:58.194521+0000","last_became_peered":"2023-11-04T01:35:58.194521+0000","last_unstale":"2023-11-04T01:36:03.236138+0000","last_undegraded":"2023-11-04T01:36:03.236138+0000","last_fullsized":"2023-11-04T01:36:03.236138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:04.765423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165862+0000","last_change":"2023-11-04T01:36:03.234265+0000","last_active":"2023-11-04T01:36:04.165862+0000","last_peered":"2023-11-04T01:36:04.165862+0000","last_clean":"2023-11-04T01:36:04.165862+0000","last_became_active":"2023-11-04T01:36:03.233858+0000","last_became_peered":"2023-11-04T01:36:03.233858+0000","last_unstale":"2023-11-04T01:36:04.165862+0000","last_undegraded":"2023-11-04T01:36:04.165862+0000","last_fullsized":"2023-11-04T01:36:04.165862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:41.965687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231787+0000","last_change":"2023-11-04T01:35:59.183367+0000","last_active":"2023-11-04T01:36:03.231787+0000","last_peered":"2023-11-04T01:36:03.231787+0000","last_clean":"2023-11-04T01:36:03.231787+0000","last_became_active":"2023-11-04T01:35:59.183053+0000","last_became_peered":"2023-11-04T01:35:59.183053+0000","last_unstale":"2023-11-04T01:36:03.231787+0000","last_undegraded":"2023-11-04T01:36:03.231787+0000","last_fullsized":"2023-11-04T01:36:03.231787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227594+0000","last_change":"2023-11-04T01:35:58.191935+0000","last_active":"2023-11-04T01:36:03.227594+0000","last_peered":"2023-11-04T01:36:03.227594+0000","last_clean":"2023-11-04T01:36:03.227594+0000","last_became_active":"2023-11-04T01:35:58.191638+0000","last_became_peered":"2023-11-04T01:35:58.191638+0000","last_unstale":"2023-11-04T01:36:03.227594+0000","last_undegraded":"2023-11-04T01:36:03.227594+0000","last_fullsized":"2023-11-04T01:36:03.227594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:04.765423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164714+0000","last_change":"2023-11-04T01:36:03.238955+0000","last_active":"2023-11-04T01:36:04.164714+0000","last_peered":"2023-11-04T01:36:04.164714+0000","last_clean":"2023-11-04T01:36:04.164714+0000","last_became_active":"2023-11-04T01:36:03.238489+0000","last_became_peered":"2023-11-04T01:36:03.238489+0000","last_unstale":"2023-11-04T01:36:04.164714+0000","last_undegraded":"2023-11-04T01:36:04.164714+0000","last_fullsized":"2023-11-04T01:36:04.164714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:12.398818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227482+0000","last_change":"2023-11-04T01:35:59.189242+0000","last_active":"2023-11-04T01:36:03.227482+0000","last_peered":"2023-11-04T01:36:03.227482+0000","last_clean":"2023-11-04T01:36:03.227482+0000","last_became_active":"2023-11-04T01:35:59.188965+0000","last_became_peered":"2023-11-04T01:35:59.188965+0000","last_unstale":"2023-11-04T01:36:03.227482+0000","last_undegraded":"2023-11-04T01:36:03.227482+0000","last_fullsized":"2023-11-04T01:36:03.227482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224557+0000","last_change":"2023-11-04T01:35:58.194320+0000","last_active":"2023-11-04T01:36:03.224557+0000","last_peered":"2023-11-04T01:36:03.224557+0000","last_clean":"2023-11-04T01:36:03.224557+0000","last_became_active":"2023-11-04T01:35:58.193983+0000","last_became_peered":"2023-11-04T01:35:58.193983+0000","last_unstale":"2023-11-04T01:36:03.224557+0000","last_undegraded":"2023-11-04T01:36:03.224557+0000","last_fullsized":"2023-11-04T01:36:03.224557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:45.043819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164544+0000","last_change":"2023-11-04T01:36:03.419109+0000","last_active":"2023-11-04T01:36:04.164544+0000","last_peered":"2023-11-04T01:36:04.164544+0000","last_clean":"2023-11-04T01:36:04.164544+0000","last_became_active":"2023-11-04T01:36:03.418605+0000","last_became_peered":"2023-11-04T01:36:03.418605+0000","last_unstale":"2023-11-04T01:36:04.164544+0000","last_undegraded":"2023-11-04T01:36:04.164544+0000","last_fullsized":"2023-11-04T01:36:04.164544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:49.330726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.114053+0000","last_change":"2023-11-04T01:36:03.421492+0000","last_active":"2023-11-04T01:36:05.114053+0000","last_peered":"2023-11-04T01:36:05.114053+0000","last_clean":"2023-11-04T01:36:05.114053+0000","last_became_active":"2023-11-04T01:36:03.421133+0000","last_became_peered":"2023-11-04T01:36:03.421133+0000","last_unstale":"2023-11-04T01:36:05.114053+0000","last_undegraded":"2023-11-04T01:36:05.114053+0000","last_fullsized":"2023-11-04T01:36:05.114053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:55.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233628+0000","last_change":"2023-11-04T01:35:59.180080+0000","last_active":"2023-11-04T01:36:03.233628+0000","last_peered":"2023-11-04T01:36:03.233628+0000","last_clean":"2023-11-04T01:36:03.233628+0000","last_became_active":"2023-11-04T01:35:59.179750+0000","last_became_peered":"2023-11-04T01:35:59.179750+0000","last_unstale":"2023-11-04T01:36:03.233628+0000","last_undegraded":"2023-11-04T01:36:03.233628+0000","last_fullsized":"2023-11-04T01:36:03.233628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227976+0000","last_change":"2023-11-04T01:35:58.196231+0000","last_active":"2023-11-04T01:36:03.227976+0000","last_peered":"2023-11-04T01:36:03.227976+0000","last_clean":"2023-11-04T01:36:03.227976+0000","last_became_active":"2023-11-04T01:35:58.195948+0000","last_became_peered":"2023-11-04T01:35:58.195948+0000","last_unstale":"2023-11-04T01:36:03.227976+0000","last_undegraded":"2023-11-04T01:36:03.227976+0000","last_fullsized":"2023-11-04T01:36:03.227976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:24.246113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165703+0000","last_change":"2023-11-04T01:36:03.241495+0000","last_active":"2023-11-04T01:36:04.165703+0000","last_peered":"2023-11-04T01:36:04.165703+0000","last_clean":"2023-11-04T01:36:04.165703+0000","last_became_active":"2023-11-04T01:36:03.241086+0000","last_became_peered":"2023-11-04T01:36:03.241086+0000","last_unstale":"2023-11-04T01:36:04.165703+0000","last_undegraded":"2023-11-04T01:36:04.165703+0000","last_fullsized":"2023-11-04T01:36:04.165703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:51.792275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220744+0000","last_change":"2023-11-04T01:35:59.180953+0000","last_active":"2023-11-04T01:36:03.220744+0000","last_peered":"2023-11-04T01:36:03.220744+0000","last_clean":"2023-11-04T01:36:03.220744+0000","last_became_active":"2023-11-04T01:35:59.180652+0000","last_became_peered":"2023-11-04T01:35:59.180652+0000","last_unstale":"2023-11-04T01:36:03.220744+0000","last_undegraded":"2023-11-04T01:36:03.220744+0000","last_fullsized":"2023-11-04T01:36:03.220744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220671+0000","last_change":"2023-11-04T01:35:58.190294+0000","last_active":"2023-11-04T01:36:03.220671+0000","last_peered":"2023-11-04T01:36:03.220671+0000","last_clean":"2023-11-04T01:36:03.220671+0000","last_became_active":"2023-11-04T01:35:58.189965+0000","last_became_peered":"2023-11-04T01:35:58.189965+0000","last_unstale":"2023-11-04T01:36:03.220671+0000","last_undegraded":"2023-11-04T01:36:03.220671+0000","last_fullsized":"2023-11-04T01:36:03.220671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:47.558236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223731+0000","last_change":"2023-11-04T01:35:58.193526+0000","last_active":"2023-11-04T01:36:03.223731+0000","last_peered":"2023-11-04T01:36:03.223731+0000","last_clean":"2023-11-04T01:36:03.223731+0000","last_became_active":"2023-11-04T01:35:58.193186+0000","last_became_peered":"2023-11-04T01:35:58.193186+0000","last_unstale":"2023-11-04T01:36:03.223731+0000","last_undegraded":"2023-11-04T01:36:03.223731+0000","last_fullsized":"2023-11-04T01:36:03.223731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:37.960678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.232019+0000","last_change":"2023-11-04T01:35:59.169544+0000","last_active":"2023-11-04T01:36:03.232019+0000","last_peered":"2023-11-04T01:36:03.232019+0000","last_clean":"2023-11-04T01:36:03.232019+0000","last_became_active":"2023-11-04T01:35:59.169198+0000","last_became_peered":"2023-11-04T01:35:59.169198+0000","last_unstale":"2023-11-04T01:36:03.232019+0000","last_undegraded":"2023-11-04T01:36:03.232019+0000","last_fullsized":"2023-11-04T01:36:03.232019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.615595+0000","last_change":"2023-11-04T01:36:03.241169+0000","last_active":"2023-11-04T01:36:04.615595+0000","last_peered":"2023-11-04T01:36:04.615595+0000","last_clean":"2023-11-04T01:36:04.615595+0000","last_became_active":"2023-11-04T01:36:03.240462+0000","last_became_peered":"2023-11-04T01:36:03.240462+0000","last_unstale":"2023-11-04T01:36:04.615595+0000","last_undegraded":"2023-11-04T01:36:04.615595+0000","last_fullsized":"2023-11-04T01:36:04.615595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:09.810689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220136+0000","last_change":"2023-11-04T01:35:58.192293+0000","last_active":"2023-11-04T01:36:03.220136+0000","last_peered":"2023-11-04T01:36:03.220136+0000","last_clean":"2023-11-04T01:36:03.220136+0000","last_became_active":"2023-11-04T01:35:58.191972+0000","last_became_peered":"2023-11-04T01:35:58.191972+0000","last_unstale":"2023-11-04T01:36:03.220136+0000","last_undegraded":"2023-11-04T01:36:03.220136+0000","last_fullsized":"2023-11-04T01:36:03.220136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.221974+0000","last_change":"2023-11-04T01:35:59.179878+0000","last_active":"2023-11-04T01:36:03.221974+0000","last_peered":"2023-11-04T01:36:03.221974+0000","last_clean":"2023-11-04T01:36:03.221974+0000","last_became_active":"2023-11-04T01:35:59.177460+0000","last_became_peered":"2023-11-04T01:35:59.177460+0000","last_unstale":"2023-11-04T01:36:03.221974+0000","last_undegraded":"2023-11-04T01:36:03.221974+0000","last_fullsized":"2023-11-04T01:36:03.221974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:01:15.442742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165166+0000","last_change":"2023-11-04T01:36:03.240379+0000","last_active":"2023-11-04T01:36:04.165166+0000","last_peered":"2023-11-04T01:36:04.165166+0000","last_clean":"2023-11-04T01:36:04.165166+0000","last_became_active":"2023-11-04T01:36:03.239985+0000","last_became_peered":"2023-11-04T01:36:03.239985+0000","last_unstale":"2023-11-04T01:36:04.165166+0000","last_undegraded":"2023-11-04T01:36:04.165166+0000","last_fullsized":"2023-11-04T01:36:04.165166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:22.738298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223423+0000","last_change":"2023-11-04T01:35:59.180546+0000","last_active":"2023-11-04T01:36:03.223423+0000","last_peered":"2023-11-04T01:36:03.223423+0000","last_clean":"2023-11-04T01:36:03.223423+0000","last_became_active":"2023-11-04T01:35:59.180121+0000","last_became_peered":"2023-11-04T01:35:59.180121+0000","last_unstale":"2023-11-04T01:36:03.223423+0000","last_undegraded":"2023-11-04T01:36:03.223423+0000","last_fullsized":"2023-11-04T01:36:03.223423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:38.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225745+0000","last_change":"2023-11-04T01:35:59.182981+0000","last_active":"2023-11-04T01:36:03.225745+0000","last_peered":"2023-11-04T01:36:03.225745+0000","last_clean":"2023-11-04T01:36:03.225745+0000","last_became_active":"2023-11-04T01:35:59.182612+0000","last_became_peered":"2023-11-04T01:35:59.182612+0000","last_unstale":"2023-11-04T01:36:03.225745+0000","last_undegraded":"2023-11-04T01:36:03.225745+0000","last_fullsized":"2023-11-04T01:36:03.225745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:38.968313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228484+0000","last_change":"2023-11-04T01:35:59.185499+0000","last_active":"2023-11-04T01:36:03.228484+0000","last_peered":"2023-11-04T01:36:03.228484+0000","last_clean":"2023-11-04T01:36:03.228484+0000","last_became_active":"2023-11-04T01:35:59.185133+0000","last_became_peered":"2023-11-04T01:35:59.185133+0000","last_unstale":"2023-11-04T01:36:03.228484+0000","last_undegraded":"2023-11-04T01:36:03.228484+0000","last_fullsized":"2023-11-04T01:36:03.228484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:22.398332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231928+0000","last_change":"2023-11-04T01:35:59.183534+0000","last_active":"2023-11-04T01:36:03.231928+0000","last_peered":"2023-11-04T01:36:03.231928+0000","last_clean":"2023-11-04T01:36:03.231928+0000","last_became_active":"2023-11-04T01:35:59.180664+0000","last_became_peered":"2023-11-04T01:35:59.180664+0000","last_unstale":"2023-11-04T01:36:03.231928+0000","last_undegraded":"2023-11-04T01:36:03.231928+0000","last_fullsized":"2023-11-04T01:36:03.231928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220081+0000","last_change":"2023-11-04T01:35:59.182124+0000","last_active":"2023-11-04T01:36:03.220081+0000","last_peered":"2023-11-04T01:36:03.220081+0000","last_clean":"2023-11-04T01:36:03.220081+0000","last_became_active":"2023-11-04T01:35:59.181762+0000","last_became_peered":"2023-11-04T01:35:59.181762+0000","last_unstale":"2023-11-04T01:36:03.220081+0000","last_undegraded":"2023-11-04T01:36:03.220081+0000","last_fullsized":"2023-11-04T01:36:03.220081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236021+0000","last_change":"2023-11-04T01:35:59.184661+0000","last_active":"2023-11-04T01:36:03.236021+0000","last_peered":"2023-11-04T01:36:03.236021+0000","last_clean":"2023-11-04T01:36:03.236021+0000","last_became_active":"2023-11-04T01:35:59.184382+0000","last_became_peered":"2023-11-04T01:35:59.184382+0000","last_unstale":"2023-11-04T01:36:03.236021+0000","last_undegraded":"2023-11-04T01:36:03.236021+0000","last_fullsized":"2023-11-04T01:36:03.236021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224222+0000","last_change":"2023-11-04T01:35:59.177565+0000","last_active":"2023-11-04T01:36:03.224222+0000","last_peered":"2023-11-04T01:36:03.224222+0000","last_clean":"2023-11-04T01:36:03.224222+0000","last_became_active":"2023-11-04T01:35:59.177205+0000","last_became_peered":"2023-11-04T01:35:59.177205+0000","last_unstale":"2023-11-04T01:36:03.224222+0000","last_undegraded":"2023-11-04T01:36:03.224222+0000","last_fullsized":"2023-11-04T01:36:03.224222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219630+0000","last_change":"2023-11-04T01:35:59.183379+0000","last_active":"2023-11-04T01:36:03.219630+0000","last_peered":"2023-11-04T01:36:03.219630+0000","last_clean":"2023-11-04T01:36:03.219630+0000","last_became_active":"2023-11-04T01:35:59.182959+0000","last_became_peered":"2023-11-04T01:35:59.182959+0000","last_unstale":"2023-11-04T01:36:03.219630+0000","last_undegraded":"2023-11-04T01:36:03.219630+0000","last_fullsized":"2023-11-04T01:36:03.219630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:37.928056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227777+0000","last_change":"2023-11-04T01:35:59.180959+0000","last_active":"2023-11-04T01:36:03.227777+0000","last_peered":"2023-11-04T01:36:03.227777+0000","last_clean":"2023-11-04T01:36:03.227777+0000","last_became_active":"2023-11-04T01:35:59.180709+0000","last_became_peered":"2023-11-04T01:35:59.180709+0000","last_unstale":"2023-11-04T01:36:03.227777+0000","last_undegraded":"2023-11-04T01:36:03.227777+0000","last_fullsized":"2023-11-04T01:36:03.227777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220572+0000","last_change":"2023-11-04T01:35:59.178115+0000","last_active":"2023-11-04T01:36:03.220572+0000","last_peered":"2023-11-04T01:36:03.220572+0000","last_clean":"2023-11-04T01:36:03.220572+0000","last_became_active":"2023-11-04T01:35:59.177595+0000","last_became_peered":"2023-11-04T01:35:59.177595+0000","last_unstale":"2023-11-04T01:36:03.220572+0000","last_undegraded":"2023-11-04T01:36:03.220572+0000","last_fullsized":"2023-11-04T01:36:03.220572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228396+0000","last_change":"2023-11-04T01:35:59.181853+0000","last_active":"2023-11-04T01:36:03.228396+0000","last_peered":"2023-11-04T01:36:03.228396+0000","last_clean":"2023-11-04T01:36:03.228396+0000","last_became_active":"2023-11-04T01:35:59.181499+0000","last_became_peered":"2023-11-04T01:35:59.181499+0000","last_unstale":"2023-11-04T01:36:03.228396+0000","last_undegraded":"2023-11-04T01:36:03.228396+0000","last_fullsized":"2023-11-04T01:36:03.228396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:59:58.598970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231812+0000","last_change":"2023-11-04T01:35:59.177527+0000","last_active":"2023-11-04T01:36:03.231812+0000","last_peered":"2023-11-04T01:36:03.231812+0000","last_clean":"2023-11-04T01:36:03.231812+0000","last_became_active":"2023-11-04T01:35:59.177047+0000","last_became_peered":"2023-11-04T01:35:59.177047+0000","last_unstale":"2023-11-04T01:36:03.231812+0000","last_undegraded":"2023-11-04T01:36:03.231812+0000","last_fullsized":"2023-11-04T01:36:03.231812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223687+0000","last_change":"2023-11-04T01:35:59.174531+0000","last_active":"2023-11-04T01:36:03.223687+0000","last_peered":"2023-11-04T01:36:03.223687+0000","last_clean":"2023-11-04T01:36:03.223687+0000","last_became_active":"2023-11-04T01:35:59.174277+0000","last_became_peered":"2023-11-04T01:35:59.174277+0000","last_unstale":"2023-11-04T01:36:03.223687+0000","last_undegraded":"2023-11-04T01:36:03.223687+0000","last_fullsized":"2023-11-04T01:36:03.223687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418785+0000","last_change":"2023-11-04T01:35:59.181809+0000","last_active":"2023-11-04T01:36:03.418785+0000","last_peered":"2023-11-04T01:36:03.418785+0000","last_clean":"2023-11-04T01:36:03.418785+0000","last_became_active":"2023-11-04T01:35:59.181546+0000","last_became_peered":"2023-11-04T01:35:59.181546+0000","last_unstale":"2023-11-04T01:36:03.418785+0000","last_undegraded":"2023-11-04T01:36:03.418785+0000","last_fullsized":"2023-11-04T01:36:03.418785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:22.398332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225612+0000","last_change":"2023-11-04T01:35:59.172821+0000","last_active":"2023-11-04T01:36:03.225612+0000","last_peered":"2023-11-04T01:36:03.225612+0000","last_clean":"2023-11-04T01:36:03.225612+0000","last_became_active":"2023-11-04T01:35:59.172439+0000","last_became_peered":"2023-11-04T01:35:59.172439+0000","last_unstale":"2023-11-04T01:36:03.225612+0000","last_undegraded":"2023-11-04T01:36:03.225612+0000","last_fullsized":"2023-11-04T01:36:03.225612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:47.141443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227832+0000","last_change":"2023-11-04T01:35:59.182521+0000","last_active":"2023-11-04T01:36:03.227832+0000","last_peered":"2023-11-04T01:36:03.227832+0000","last_clean":"2023-11-04T01:36:03.227832+0000","last_became_active":"2023-11-04T01:35:59.182229+0000","last_became_peered":"2023-11-04T01:35:59.182229+0000","last_unstale":"2023-11-04T01:36:03.227832+0000","last_undegraded":"2023-11-04T01:36:03.227832+0000","last_fullsized":"2023-11-04T01:36:03.227832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:37.928056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227738+0000","last_change":"2023-11-04T01:35:59.178581+0000","last_active":"2023-11-04T01:36:03.227738+0000","last_peered":"2023-11-04T01:36:03.227738+0000","last_clean":"2023-11-04T01:36:03.227738+0000","last_became_active":"2023-11-04T01:35:59.178317+0000","last_became_peered":"2023-11-04T01:35:59.178317+0000","last_unstale":"2023-11-04T01:36:03.227738+0000","last_undegraded":"2023-11-04T01:36:03.227738+0000","last_fullsized":"2023-11-04T01:36:03.227738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233726+0000","last_change":"2023-11-04T01:35:59.177319+0000","last_active":"2023-11-04T01:36:03.233726+0000","last_peered":"2023-11-04T01:36:03.233726+0000","last_clean":"2023-11-04T01:36:03.233726+0000","last_became_active":"2023-11-04T01:35:59.176999+0000","last_became_peered":"2023-11-04T01:35:59.176999+0000","last_unstale":"2023-11-04T01:36:03.233726+0000","last_undegraded":"2023-11-04T01:36:03.233726+0000","last_fullsized":"2023-11-04T01:36:03.233726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.232947+0000","last_change":"2023-11-04T01:35:59.180087+0000","last_active":"2023-11-04T01:36:03.232947+0000","last_peered":"2023-11-04T01:36:03.232947+0000","last_clean":"2023-11-04T01:36:03.232947+0000","last_became_active":"2023-11-04T01:35:59.179661+0000","last_became_peered":"2023-11-04T01:35:59.179661+0000","last_unstale":"2023-11-04T01:36:03.232947+0000","last_undegraded":"2023-11-04T01:36:03.232947+0000","last_fullsized":"2023-11-04T01:36:03.232947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219636+0000","last_change":"2023-11-04T01:35:59.181134+0000","last_active":"2023-11-04T01:36:03.219636+0000","last_peered":"2023-11-04T01:36:03.219636+0000","last_clean":"2023-11-04T01:36:03.219636+0000","last_became_active":"2023-11-04T01:35:59.180479+0000","last_became_peered":"2023-11-04T01:35:59.180479+0000","last_unstale":"2023-11-04T01:36:03.219636+0000","last_undegraded":"2023-11-04T01:36:03.219636+0000","last_fullsized":"2023-11-04T01:36:03.219636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224801+0000","last_change":"2023-11-04T01:35:59.172767+0000","last_active":"2023-11-04T01:36:03.224801+0000","last_peered":"2023-11-04T01:36:03.224801+0000","last_clean":"2023-11-04T01:36:03.224801+0000","last_became_active":"2023-11-04T01:35:59.172514+0000","last_became_peered":"2023-11-04T01:35:59.172514+0000","last_unstale":"2023-11-04T01:36:03.224801+0000","last_undegraded":"2023-11-04T01:36:03.224801+0000","last_fullsized":"2023-11-04T01:36:03.224801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:25.253748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223496+0000","last_change":"2023-11-04T01:35:59.188111+0000","last_active":"2023-11-04T01:36:03.223496+0000","last_peered":"2023-11-04T01:36:03.223496+0000","last_clean":"2023-11-04T01:36:03.223496+0000","last_became_active":"2023-11-04T01:35:59.187822+0000","last_became_peered":"2023-11-04T01:35:59.187822+0000","last_unstale":"2023-11-04T01:36:03.223496+0000","last_undegraded":"2023-11-04T01:36:03.223496+0000","last_fullsized":"2023-11-04T01:36:03.223496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224145+0000","last_change":"2023-11-04T01:35:59.179070+0000","last_active":"2023-11-04T01:36:03.224145+0000","last_peered":"2023-11-04T01:36:03.224145+0000","last_clean":"2023-11-04T01:36:03.224145+0000","last_became_active":"2023-11-04T01:35:59.178798+0000","last_became_peered":"2023-11-04T01:35:59.178798+0000","last_unstale":"2023-11-04T01:36:03.224145+0000","last_undegraded":"2023-11-04T01:36:03.224145+0000","last_fullsized":"2023-11-04T01:36:03.224145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418662+0000","last_change":"2023-11-04T01:35:59.189991+0000","last_active":"2023-11-04T01:36:03.418662+0000","last_peered":"2023-11-04T01:36:03.418662+0000","last_clean":"2023-11-04T01:36:03.418662+0000","last_became_active":"2023-11-04T01:35:59.189686+0000","last_became_peered":"2023-11-04T01:35:59.189686+0000","last_unstale":"2023-11-04T01:36:03.418662+0000","last_undegraded":"2023-11-04T01:36:03.418662+0000","last_fullsized":"2023-11-04T01:36:03.418662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:59:58.598970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219400+0000","last_change":"2023-11-04T01:35:59.189839+0000","last_active":"2023-11-04T01:36:03.219400+0000","last_peered":"2023-11-04T01:36:03.219400+0000","last_clean":"2023-11-04T01:36:03.219400+0000","last_became_active":"2023-11-04T01:35:59.189525+0000","last_became_peered":"2023-11-04T01:35:59.189525+0000","last_unstale":"2023-11-04T01:36:03.219400+0000","last_undegraded":"2023-11-04T01:36:03.219400+0000","last_fullsized":"2023-11-04T01:36:03.219400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:38.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417496+0000","last_change":"2023-11-04T01:35:59.182733+0000","last_active":"2023-11-04T01:36:03.417496+0000","last_peered":"2023-11-04T01:36:03.417496+0000","last_clean":"2023-11-04T01:36:03.417496+0000","last_became_active":"2023-11-04T01:35:59.180260+0000","last_became_peered":"2023-11-04T01:35:59.180260+0000","last_unstale":"2023-11-04T01:36:03.417496+0000","last_undegraded":"2023-11-04T01:36:03.417496+0000","last_fullsized":"2023-11-04T01:36:03.417496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228312+0000","last_change":"2023-11-04T01:35:59.184451+0000","last_active":"2023-11-04T01:36:03.228312+0000","last_peered":"2023-11-04T01:36:03.228312+0000","last_clean":"2023-11-04T01:36:03.228312+0000","last_became_active":"2023-11-04T01:35:59.184197+0000","last_became_peered":"2023-11-04T01:35:59.184197+0000","last_unstale":"2023-11-04T01:36:03.228312+0000","last_undegraded":"2023-11-04T01:36:03.228312+0000","last_fullsized":"2023-11-04T01:36:03.228312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:47.754644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417459+0000","last_change":"2023-11-04T01:35:59.185251+0000","last_active":"2023-11-04T01:36:03.417459+0000","last_peered":"2023-11-04T01:36:03.417459+0000","last_clean":"2023-11-04T01:36:03.417459+0000","last_became_active":"2023-11-04T01:35:59.184960+0000","last_became_peered":"2023-11-04T01:35:59.184960+0000","last_unstale":"2023-11-04T01:36:03.417459+0000","last_undegraded":"2023-11-04T01:36:03.417459+0000","last_fullsized":"2023-11-04T01:36:03.417459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:37.928056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228072+0000","last_change":"2023-11-04T01:35:59.185741+0000","last_active":"2023-11-04T01:36:03.228072+0000","last_peered":"2023-11-04T01:36:03.228072+0000","last_clean":"2023-11-04T01:36:03.228072+0000","last_became_active":"2023-11-04T01:35:59.185417+0000","last_became_peered":"2023-11-04T01:35:59.185417+0000","last_unstale":"2023-11-04T01:36:03.228072+0000","last_undegraded":"2023-11-04T01:36:03.228072+0000","last_fullsized":"2023-11-04T01:36:03.228072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231859+0000","last_change":"2023-11-04T01:35:59.173981+0000","last_active":"2023-11-04T01:36:03.231859+0000","last_peered":"2023-11-04T01:36:03.231859+0000","last_clean":"2023-11-04T01:36:03.231859+0000","last_became_active":"2023-11-04T01:35:59.173709+0000","last_became_peered":"2023-11-04T01:35:59.173709+0000","last_unstale":"2023-11-04T01:36:03.231859+0000","last_undegraded":"2023-11-04T01:36:03.231859+0000","last_fullsized":"2023-11-04T01:36:03.231859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236893+0000","last_change":"2023-11-04T01:35:59.178744+0000","last_active":"2023-11-04T01:36:03.236893+0000","last_peered":"2023-11-04T01:36:03.236893+0000","last_clean":"2023-11-04T01:36:03.236893+0000","last_became_active":"2023-11-04T01:35:59.178420+0000","last_became_peered":"2023-11-04T01:35:59.178420+0000","last_unstale":"2023-11-04T01:36:03.236893+0000","last_undegraded":"2023-11-04T01:36:03.236893+0000","last_fullsized":"2023-11-04T01:36:03.236893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417999+0000","last_change":"2023-11-04T01:35:59.182583+0000","last_active":"2023-11-04T01:36:03.417999+0000","last_peered":"2023-11-04T01:36:03.417999+0000","last_clean":"2023-11-04T01:36:03.417999+0000","last_became_active":"2023-11-04T01:35:59.179785+0000","last_became_peered":"2023-11-04T01:35:59.179785+0000","last_unstale":"2023-11-04T01:36:03.417999+0000","last_undegraded":"2023-11-04T01:36:03.417999+0000","last_fullsized":"2023-11-04T01:36:03.417999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:39.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4498,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:36:17.614 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:36:17.614 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-04T01:36:17.614 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-04T01:36:17.615 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-04T01:36:17.615 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-04T01:36:17.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.750+0000 7fc436b89640 1 Processor -- start 2023-11-04T01:36:17.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.750+0000 7fc436b89640 1 -- start start 2023-11-04T01:36:17.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.750+0000 7fc436b89640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc43015ad80 0x7fc43006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.751+0000 7fc436b89640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4300c9e10 0x7fc4300b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.751+0000 7fc436b89640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43006cd00 con 0x7fc4300b42c0 2023-11-04T01:36:17.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.751+0000 7fc436b89640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43006cfa0 con 0x7fc43015ad80 2023-11-04T01:36:17.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.751+0000 7fc436b89640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43006d280 con 0x7fc4300c9e10 2023-11-04T01:36:17.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.751+0000 7fc434925640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc43015ad80 0x7fc43006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.751+0000 7fc42ffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc4300b42c0 0x7fc4300c9700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36338/0 (socket says 172.21.15.44:36338) 2023-11-04T01:36:17.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.751+0000 7fc42ffff640 1 -- 172.21.15.44:0/1853598816 learned_addr learned my addr 172.21.15.44:0/1853598816 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:17.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.751+0000 7fc435126640 1 --2- 172.21.15.44:0/1853598816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4300c9e10 0x7fc4300b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.751+0000 7fc434925640 1 -- 172.21.15.44:0/1853598816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4300c9e10 msgr2=0x7fc4300b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:17.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.751+0000 7fc434925640 1 --2- 172.21.15.44:0/1853598816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4300c9e10 0x7fc4300b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.751+0000 7fc434925640 1 -- 172.21.15.44:0/1853598816 >> v1:172.21.15.44:6789/0 conn(0x7fc4300b42c0 legacy=0x7fc4300c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.751+0000 7fc434925640 1 -- 172.21.15.44:0/1853598816 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43006d560 con 0x7fc43015ad80 2023-11-04T01:36:17.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.751+0000 7fc42f7fe640 1 -- 172.21.15.44:0/1853598816 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588562690 0 0) 0x7fc43006cd00 con 0x7fc4300b42c0 2023-11-04T01:36:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.752+0000 7fc434925640 1 --2- 172.21.15.44:0/1853598816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc43015ad80 0x7fc43006c7c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc428009d90 tx=0x7fc42802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226da4cd8f077284 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.752+0000 7fc42f7fe640 1 -- 172.21.15.44:0/1853598816 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42802cce0 con 0x7fc43015ad80 2023-11-04T01:36:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.752+0000 7fc42f7fe640 1 -- 172.21.15.44:0/1853598816 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42802ce40 con 0x7fc43015ad80 2023-11-04T01:36:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.752+0000 7fc42f7fe640 1 -- 172.21.15.44:0/1853598816 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc428034660 con 0x7fc43015ad80 2023-11-04T01:36:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.752+0000 7fc436b89640 1 -- 172.21.15.44:0/1853598816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc43015ad80 msgr2=0x7fc43006c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.752+0000 7fc436b89640 1 --2- 172.21.15.44:0/1853598816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc43015ad80 0x7fc43006c7c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc428009d90 tx=0x7fc42802bf30 comp rx=0 tx=0).stop 2023-11-04T01:36:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.752+0000 7fc436b89640 1 -- 172.21.15.44:0/1853598816 shutdown_connections 2023-11-04T01:36:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.752+0000 7fc436b89640 1 --2- 172.21.15.44:0/1853598816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4300c9e10 0x7fc4300b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.752+0000 7fc436b89640 1 --2- 172.21.15.44:0/1853598816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc43015ad80 0x7fc43006c7c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.752+0000 7fc436b89640 1 -- 172.21.15.44:0/1853598816 >> 172.21.15.44:0/1853598816 conn(0x7fc4300ce950 msgr2=0x7fc4300ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.753+0000 7fc436b89640 1 -- 172.21.15.44:0/1853598816 shutdown_connections 2023-11-04T01:36:17.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.753+0000 7fc436b89640 1 -- 172.21.15.44:0/1853598816 wait complete. 2023-11-04T01:36:17.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.754+0000 7fc436b89640 1 Processor -- start 2023-11-04T01:36:17.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.754+0000 7fc436b89640 1 -- start start 2023-11-04T01:36:17.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.754+0000 7fc436b89640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4300b42c0 0x7fc4300c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc436b89640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4300c9e10 0x7fc4301f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc436b89640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc43015ad80 0x7fc4301f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc436b89640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4301f6e40 con 0x7fc4300b42c0 2023-11-04T01:36:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc436b89640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43015c780 con 0x7fc4300c9e10 2023-11-04T01:36:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc436b89640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43015c1a0 con 0x7fc43015ad80 2023-11-04T01:36:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc434925640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4300b42c0 0x7fc4300c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc434925640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4300b42c0 0x7fc4300c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48822/0 (socket says 172.21.15.44:48822) 2023-11-04T01:36:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc434925640 1 -- 172.21.15.44:0/2684209130 learned_addr learned my addr 172.21.15.44:0/2684209130 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc435126640 1 --2- 172.21.15.44:0/2684209130 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc43015ad80 0x7fc4301f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc42ffff640 1 --2- 172.21.15.44:0/2684209130 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4300c9e10 0x7fc4301f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc434925640 1 -- 172.21.15.44:0/2684209130 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc43015ad80 msgr2=0x7fc4301f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc434925640 1 --2- 172.21.15.44:0/2684209130 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc43015ad80 0x7fc4301f6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc434925640 1 -- 172.21.15.44:0/2684209130 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4300c9e10 msgr2=0x7fc4301f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc434925640 1 --2- 172.21.15.44:0/2684209130 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4300c9e10 0x7fc4301f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc434925640 1 -- 172.21.15.44:0/2684209130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc428009a70 con 0x7fc4300b42c0 2023-11-04T01:36:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc434925640 1 --2- 172.21.15.44:0/2684209130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4300b42c0 0x7fc4300c70b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc428009d90 tx=0x7fc428004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc42d7fa640 1 -- 172.21.15.44:0/2684209130 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42803d600 con 0x7fc4300b42c0 2023-11-04T01:36:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc42d7fa640 1 -- 172.21.15.44:0/2684209130 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42803d760 con 0x7fc4300b42c0 2023-11-04T01:36:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc42d7fa640 1 -- 172.21.15.44:0/2684209130 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42803db10 con 0x7fc4300b42c0 2023-11-04T01:36:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc436b89640 1 -- 172.21.15.44:0/2684209130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4300ace90 con 0x7fc4300b42c0 2023-11-04T01:36:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.755+0000 7fc436b89640 1 -- 172.21.15.44:0/2684209130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4300ad170 con 0x7fc4300b42c0 2023-11-04T01:36:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.757+0000 7fc436b89640 1 -- 172.21.15.44:0/2684209130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43015c000 con 0x7fc4300b42c0 2023-11-04T01:36:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.757+0000 7fc42d7fa640 1 -- 172.21.15.44:0/2684209130 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc42803b040 con 0x7fc4300b42c0 2023-11-04T01:36:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.757+0000 7fc42d7fa640 1 --2- 172.21.15.44:0/2684209130 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc41006aea0 0x7fc41006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.757+0000 7fc42d7fa640 1 -- 172.21.15.44:0/2684209130 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc4280ab8c0 con 0x7fc4300b42c0 2023-11-04T01:36:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.758+0000 7fc42ffff640 1 --2- 172.21.15.44:0/2684209130 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc41006aea0 0x7fc41006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.758+0000 7fc42ffff640 1 --2- 172.21.15.44:0/2684209130 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc41006aea0 0x7fc41006d360 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc4300b1840 tx=0x7fc418009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.762+0000 7fc42d7fa640 1 -- 172.21.15.44:0/2684209130 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc43015c000 con 0x7fc4300b42c0 2023-11-04T01:36:17.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.985+0000 7fc436b89640 1 -- 172.21.15.44:0/2684209130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc43015c000 con 0x7fc4300b42c0 2023-11-04T01:36:17.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.988+0000 7fc42d7fa640 1 -- 172.21.15.44:0/2684209130 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171038 (secure 0 0 0) 0x7fc43015c000 con 0x7fc4300b42c0 2023-11-04T01:36:17.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.991+0000 7fc436b89640 1 -- 172.21.15.44:0/2684209130 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc41006aea0 msgr2=0x7fc41006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.991+0000 7fc436b89640 1 --2- 172.21.15.44:0/2684209130 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc41006aea0 0x7fc41006d360 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc4300b1840 tx=0x7fc418009040 comp rx=0 tx=0).stop 2023-11-04T01:36:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.991+0000 7fc436b89640 1 -- 172.21.15.44:0/2684209130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4300b42c0 msgr2=0x7fc4300c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.991+0000 7fc436b89640 1 --2- 172.21.15.44:0/2684209130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4300b42c0 0x7fc4300c70b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc428009d90 tx=0x7fc428004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.991+0000 7fc436b89640 1 -- 172.21.15.44:0/2684209130 shutdown_connections 2023-11-04T01:36:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.991+0000 7fc436b89640 1 --2- 172.21.15.44:0/2684209130 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc41006aea0 0x7fc41006d360 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.991+0000 7fc436b89640 1 --2- 172.21.15.44:0/2684209130 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc43015ad80 0x7fc4301f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.991+0000 7fc436b89640 1 --2- 172.21.15.44:0/2684209130 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4300c9e10 0x7fc4301f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.991+0000 7fc436b89640 1 --2- 172.21.15.44:0/2684209130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4300b42c0 0x7fc4300c70b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.991+0000 7fc436b89640 1 -- 172.21.15.44:0/2684209130 >> 172.21.15.44:0/2684209130 conn(0x7fc4300ce950 msgr2=0x7fc430070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.991+0000 7fc436b89640 1 -- 172.21.15.44:0/2684209130 shutdown_connections 2023-11-04T01:36:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:17.991+0000 7fc436b89640 1 -- 172.21.15.44:0/2684209130 wait complete. 2023-11-04T01:36:18.005 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":2251630012},{"type":"v1","addr":"172.21.15.204:6833","nonce":2251630012}]},"active_addr":"172.21.15.204:6833/2251630012","active_change":"2023-11-04T01:35:38.561629+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":911355732}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":2643252100}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":3470879082}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":2576960644}]}]} 2023-11-04T01:36:18.009 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-04T01:36:18.009 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-04T01:36:18.010 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:18.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.114+0000 7f7605590640 1 Processor -- start 2023-11-04T01:36:18.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.114+0000 7f7605590640 1 -- start start 2023-11-04T01:36:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.115+0000 7f7605590640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f76000cde60 0x7f760015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.115+0000 7f7605590640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f760015daa0 0x7f7600157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.115+0000 7f7605590640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760015e000 con 0x7f76000ce240 2023-11-04T01:36:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.115+0000 7f7605590640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760015e5c0 con 0x7f76000cde60 2023-11-04T01:36:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.115+0000 7f7605590640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760015e2e0 con 0x7f760015daa0 2023-11-04T01:36:18.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.115+0000 7f75f7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f760015daa0 0x7f7600157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.115+0000 7f75feffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f76000cde60 0x7f760015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.116+0000 7f75ff7fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f76000ce240 0x7f760006b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:46786/0 (socket says 172.21.15.44:46786) 2023-11-04T01:36:18.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.116+0000 7f75ff7fe640 1 -- 172.21.15.44:0/383190374 learned_addr learned my addr 172.21.15.44:0/383190374 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:18.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.116+0000 7f75feffd640 1 -- 172.21.15.44:0/383190374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f760015daa0 msgr2=0x7f7600157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.116+0000 7f75feffd640 1 --2- 172.21.15.44:0/383190374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f760015daa0 0x7f7600157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.116+0000 7f75feffd640 1 -- 172.21.15.44:0/383190374 >> v1:172.21.15.204:6789/0 conn(0x7f76000ce240 legacy=0x7f760006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.116+0000 7f75feffd640 1 -- 172.21.15.44:0/383190374 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76000d1120 con 0x7f76000cde60 2023-11-04T01:36:18.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.117+0000 7f75feffd640 1 --2- 172.21.15.44:0/383190374 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76000cde60 0x7f760015d560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f75f00097a0 tx=0x7f75f002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0d3ea316e1c7dea server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.117+0000 7f75fe7fc640 1 -- 172.21.15.44:0/383190374 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0031830 con 0x7f76000cde60 2023-11-04T01:36:18.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.117+0000 7f75fe7fc640 1 -- 172.21.15.44:0/383190374 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f0031990 con 0x7f76000cde60 2023-11-04T01:36:18.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.117+0000 7f75fe7fc640 1 -- 172.21.15.44:0/383190374 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0031d20 con 0x7f76000cde60 2023-11-04T01:36:18.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.117+0000 7f7605590640 1 -- 172.21.15.44:0/383190374 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76000cde60 msgr2=0x7f760015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.117+0000 7f7605590640 1 --2- 172.21.15.44:0/383190374 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76000cde60 0x7f760015d560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f75f00097a0 tx=0x7f75f002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.117+0000 7f7605590640 1 -- 172.21.15.44:0/383190374 shutdown_connections 2023-11-04T01:36:18.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.117+0000 7f7605590640 1 --2- 172.21.15.44:0/383190374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f760015daa0 0x7f7600157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.117+0000 7f7605590640 1 --2- 172.21.15.44:0/383190374 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76000cde60 0x7f760015d560 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.117+0000 7f7605590640 1 -- 172.21.15.44:0/383190374 >> 172.21.15.44:0/383190374 conn(0x7f7600071f30 msgr2=0x7f76000cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.117+0000 7f7605590640 1 -- 172.21.15.44:0/383190374 shutdown_connections 2023-11-04T01:36:18.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.118+0000 7f7605590640 1 -- 172.21.15.44:0/383190374 wait complete. 2023-11-04T01:36:18.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.119+0000 7f7605590640 1 Processor -- start 2023-11-04T01:36:18.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.119+0000 7f7605590640 1 -- start start 2023-11-04T01:36:18.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.119+0000 7f7605590640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76000cde60 0x7f76001552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.119+0000 7f7605590640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76000ce240 0x7f76000c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.119+0000 7f7605590640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f760015daa0 0x7f76000c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.119+0000 7f7605590640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7600159e10 con 0x7f760015daa0 2023-11-04T01:36:18.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.119+0000 7f7605590640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7600159290 con 0x7f76000cde60 2023-11-04T01:36:18.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.119+0000 7f7605590640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7600159570 con 0x7f76000ce240 2023-11-04T01:36:18.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f75feffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76000cde60 0x7f76001552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f75ff7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f760015daa0 0x7f76000c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f75feffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76000cde60 0x7f76001552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44126/0 (socket says 172.21.15.44:44126) 2023-11-04T01:36:18.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f75feffd640 1 -- 172.21.15.44:0/398220984 learned_addr learned my addr 172.21.15.44:0/398220984 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:18.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f75f7fff640 1 --2- 172.21.15.44:0/398220984 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76000ce240 0x7f76000c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f75ff7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f760015daa0 0x7f76000c6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48826/0 (socket says 172.21.15.44:48826) 2023-11-04T01:36:18.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f75feffd640 1 -- 172.21.15.44:0/398220984 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76000ce240 msgr2=0x7f76000c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f75feffd640 1 --2- 172.21.15.44:0/398220984 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76000ce240 0x7f76000c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f75feffd640 1 -- 172.21.15.44:0/398220984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f760015daa0 msgr2=0x7f76000c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f75feffd640 1 --2- 172.21.15.44:0/398220984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f760015daa0 0x7f76000c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f75feffd640 1 -- 172.21.15.44:0/398220984 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f0009400 con 0x7f76000cde60 2023-11-04T01:36:18.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f75feffd640 1 --2- 172.21.15.44:0/398220984 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76000cde60 0x7f76001552c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75f00098c0 tx=0x7f75f00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f75f77fe640 1 -- 172.21.15.44:0/398220984 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f003a6f0 con 0x7f76000cde60 2023-11-04T01:36:18.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f75f77fe640 1 -- 172.21.15.44:0/398220984 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f003a870 con 0x7f76000cde60 2023-11-04T01:36:18.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f7605590640 1 -- 172.21.15.44:0/398220984 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7600159850 con 0x7f76000cde60 2023-11-04T01:36:18.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f75f77fe640 1 -- 172.21.15.44:0/398220984 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f003ac20 con 0x7f76000cde60 2023-11-04T01:36:18.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.120+0000 7f7605590640 1 -- 172.21.15.44:0/398220984 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7600155800 con 0x7f76000cde60 2023-11-04T01:36:18.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.121+0000 7f7605590640 1 -- 172.21.15.44:0/398220984 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7600074290 con 0x7f76000cde60 2023-11-04T01:36:18.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.122+0000 7f75f77fe640 1 -- 172.21.15.44:0/398220984 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f75f004c3b0 con 0x7f76000cde60 2023-11-04T01:36:18.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.122+0000 7f75f77fe640 1 --2- 172.21.15.44:0/398220984 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f75e006ae70 0x7f75e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.122+0000 7f75f77fe640 1 -- 172.21.15.44:0/398220984 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75f00ab3e0 con 0x7f76000cde60 2023-11-04T01:36:18.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.123+0000 7f75f7fff640 1 --2- 172.21.15.44:0/398220984 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f75e006ae70 0x7f75e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.123+0000 7f75f7fff640 1 --2- 172.21.15.44:0/398220984 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f75e006ae70 0x7f75e006d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76000c7630 tx=0x7f75e8009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.127+0000 7f75f77fe640 1 -- 172.21.15.44:0/398220984 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f75f00762e0 con 0x7f76000cde60 2023-11-04T01:36:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.304+0000 7f7605590640 1 -- 172.21.15.44:0/398220984 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76001f3700 con 0x7f76000cde60 2023-11-04T01:36:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.306+0000 7f75f77fe640 1 -- 172.21.15.44:0/398220984 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f75f0079900 con 0x7f76000cde60 2023-11-04T01:36:18.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:18.308 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:03.589395+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.307+0000 7f7605590640 1 -- 172.21.15.44:0/398220984 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f75e006ae70 msgr2=0x7f75e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.307+0000 7f7605590640 1 --2- 172.21.15.44:0/398220984 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f75e006ae70 0x7f75e006d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76000c7630 tx=0x7f75e8009190 comp rx=0 tx=0).stop 2023-11-04T01:36:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.307+0000 7f7605590640 1 -- 172.21.15.44:0/398220984 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76000cde60 msgr2=0x7f76001552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.307+0000 7f7605590640 1 --2- 172.21.15.44:0/398220984 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76000cde60 0x7f76001552c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75f00098c0 tx=0x7f75f00046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.308+0000 7f7605590640 1 -- 172.21.15.44:0/398220984 shutdown_connections 2023-11-04T01:36:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.308+0000 7f7605590640 1 --2- 172.21.15.44:0/398220984 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f75e006ae70 0x7f75e006d330 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.308+0000 7f7605590640 1 --2- 172.21.15.44:0/398220984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f760015daa0 0x7f76000c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.308+0000 7f7605590640 1 --2- 172.21.15.44:0/398220984 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76000ce240 0x7f76000c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.308+0000 7f7605590640 1 --2- 172.21.15.44:0/398220984 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76000cde60 0x7f76001552c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.308+0000 7f7605590640 1 -- 172.21.15.44:0/398220984 >> 172.21.15.44:0/398220984 conn(0x7f7600071f30 msgr2=0x7f76000c7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.308+0000 7f7605590640 1 -- 172.21.15.44:0/398220984 shutdown_connections 2023-11-04T01:36:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.308+0000 7f7605590640 1 -- 172.21.15.44:0/398220984 wait complete. 2023-11-04T01:36:18.321 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-04T01:36:18.321 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:18.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.430+0000 7f1db07c5640 1 Processor -- start 2023-11-04T01:36:18.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.430+0000 7f1db07c5640 1 -- start start 2023-11-04T01:36:18.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.431+0000 7f1db07c5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1da80b42c0 0x7f1da80c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.431+0000 7f1db07c5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1da80c9c40 0x7f1da80b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.431+0000 7f1db07c5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da80ca050 con 0x7f1da815ad80 2023-11-04T01:36:18.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.431+0000 7f1db07c5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da806cfa0 con 0x7f1da80b42c0 2023-11-04T01:36:18.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.431+0000 7f1db07c5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da806d280 con 0x7f1da80c9c40 2023-11-04T01:36:18.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.431+0000 7f1dadd60640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1da80b42c0 0x7f1da80c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.431+0000 7f1dadd60640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1da80b42c0 0x7f1da80c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48834/0 (socket says 172.21.15.44:48834) 2023-11-04T01:36:18.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.431+0000 7f1dadd60640 1 -- 172.21.15.44:0/3894799827 learned_addr learned my addr 172.21.15.44:0/3894799827 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:18.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.431+0000 7f1daed62640 1 --2- 172.21.15.44:0/3894799827 >> v2:172.21.15.204:3300/0 conn(0x7f1da80c9c40 0x7f1da80b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.431+0000 7f1dadd60640 1 -- 172.21.15.44:0/3894799827 >> v2:172.21.15.204:3300/0 conn(0x7f1da80c9c40 msgr2=0x7f1da80b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.431+0000 7f1dadd60640 1 --2- 172.21.15.44:0/3894799827 >> v2:172.21.15.204:3300/0 conn(0x7f1da80c9c40 0x7f1da80b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.431+0000 7f1dadd60640 1 -- 172.21.15.44:0/3894799827 >> v1:172.21.15.204:6789/0 conn(0x7f1da815ad80 legacy=0x7f1da806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.431+0000 7f1dadd60640 1 -- 172.21.15.44:0/3894799827 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da806d560 con 0x7f1da80b42c0 2023-11-04T01:36:18.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.431+0000 7f1daed62640 1 --2- 172.21.15.44:0/3894799827 >> v2:172.21.15.204:3300/0 conn(0x7f1da80c9c40 0x7f1da80b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:18.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.432+0000 7f1dadd60640 1 --2- 172.21.15.44:0/3894799827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1da80b42c0 0x7f1da80c9700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1da80c8e50 tx=0x7f1d9802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d582085941dfa1de server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.432+0000 7f1dad55f640 1 -- 172.21.15.44:0/3894799827 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98030860 con 0x7f1da80b42c0 2023-11-04T01:36:18.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.432+0000 7f1dad55f640 1 -- 172.21.15.44:0/3894799827 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d980309c0 con 0x7f1da80b42c0 2023-11-04T01:36:18.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.432+0000 7f1dad55f640 1 -- 172.21.15.44:0/3894799827 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98030d50 con 0x7f1da80b42c0 2023-11-04T01:36:18.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.433+0000 7f1db07c5640 1 -- 172.21.15.44:0/3894799827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1da80b42c0 msgr2=0x7f1da80c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.433+0000 7f1db07c5640 1 --2- 172.21.15.44:0/3894799827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1da80b42c0 0x7f1da80c9700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1da80c8e50 tx=0x7f1d9802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.433+0000 7f1db07c5640 1 -- 172.21.15.44:0/3894799827 shutdown_connections 2023-11-04T01:36:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.433+0000 7f1db07c5640 1 --2- 172.21.15.44:0/3894799827 >> v2:172.21.15.204:3300/0 conn(0x7f1da80c9c40 0x7f1da80b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.433+0000 7f1db07c5640 1 --2- 172.21.15.44:0/3894799827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1da80b42c0 0x7f1da80c9700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.433+0000 7f1db07c5640 1 -- 172.21.15.44:0/3894799827 >> 172.21.15.44:0/3894799827 conn(0x7f1da80ce950 msgr2=0x7f1da80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.433+0000 7f1db07c5640 1 -- 172.21.15.44:0/3894799827 shutdown_connections 2023-11-04T01:36:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.433+0000 7f1db07c5640 1 -- 172.21.15.44:0/3894799827 wait complete. 2023-11-04T01:36:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.434+0000 7f1db07c5640 1 Processor -- start 2023-11-04T01:36:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.434+0000 7f1db07c5640 1 -- start start 2023-11-04T01:36:18.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1db07c5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1da80b42c0 0x7f1da80acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1db07c5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1da80c9c40 0x7f1da81f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1db07c5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1da815ad80 0x7f1da81f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1db07c5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80aba60 con 0x7f1da80c9c40 2023-11-04T01:36:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1db07c5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80abd40 con 0x7f1da80b42c0 2023-11-04T01:36:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1db07c5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80ac020 con 0x7f1da815ad80 2023-11-04T01:36:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1dadd60640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1da80c9c40 0x7f1da81f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1dadd60640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1da80c9c40 0x7f1da81f5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48838/0 (socket says 172.21.15.44:48838) 2023-11-04T01:36:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1dadd60640 1 -- 172.21.15.44:0/3932933425 learned_addr learned my addr 172.21.15.44:0/3932933425 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1dae561640 1 --2- 172.21.15.44:0/3932933425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1da80b42c0 0x7f1da80acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1daed62640 1 --2- 172.21.15.44:0/3932933425 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1da815ad80 0x7f1da81f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1dadd60640 1 -- 172.21.15.44:0/3932933425 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1da815ad80 msgr2=0x7f1da81f6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1dadd60640 1 --2- 172.21.15.44:0/3932933425 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1da815ad80 0x7f1da81f6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1dadd60640 1 -- 172.21.15.44:0/3932933425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1da80b42c0 msgr2=0x7f1da80acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1dadd60640 1 --2- 172.21.15.44:0/3932933425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1da80b42c0 0x7f1da80acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1dadd60640 1 -- 172.21.15.44:0/3932933425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d980094d0 con 0x7f1da80c9c40 2023-11-04T01:36:18.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1dadd60640 1 --2- 172.21.15.44:0/3932933425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1da80c9c40 0x7f1da81f5af0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1d98000c00 tx=0x7f1d98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.435+0000 7f1d9effd640 1 -- 172.21.15.44:0/3932933425 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98030830 con 0x7f1da80c9c40 2023-11-04T01:36:18.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.436+0000 7f1d9effd640 1 -- 172.21.15.44:0/3932933425 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d98039d90 con 0x7f1da80c9c40 2023-11-04T01:36:18.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.436+0000 7f1d9effd640 1 -- 172.21.15.44:0/3932933425 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98043630 con 0x7f1da80c9c40 2023-11-04T01:36:18.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.436+0000 7f1db07c5640 1 -- 172.21.15.44:0/3932933425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da80ac300 con 0x7f1da80c9c40 2023-11-04T01:36:18.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.436+0000 7f1db07c5640 1 -- 172.21.15.44:0/3932933425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da80ad040 con 0x7f1da80c9c40 2023-11-04T01:36:18.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.437+0000 7f1db07c5640 1 -- 172.21.15.44:0/3932933425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da8074290 con 0x7f1da80c9c40 2023-11-04T01:36:18.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.437+0000 7f1d9effd640 1 -- 172.21.15.44:0/3932933425 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d9802f3b0 con 0x7f1da80c9c40 2023-11-04T01:36:18.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.437+0000 7f1d9effd640 1 --2- 172.21.15.44:0/3932933425 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1d8c06ae70 0x7f1d8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.437+0000 7f1d9effd640 1 -- 172.21.15.44:0/3932933425 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1d980abc60 con 0x7f1da80c9c40 2023-11-04T01:36:18.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.438+0000 7f1dae561640 1 --2- 172.21.15.44:0/3932933425 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1d8c06ae70 0x7f1d8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.438+0000 7f1dae561640 1 --2- 172.21.15.44:0/3932933425 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1d8c06ae70 0x7f1d8c06d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1da4004f60 tx=0x7f1da4007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.442+0000 7f1d9effd640 1 -- 172.21.15.44:0/3932933425 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d98076b60 con 0x7f1da80c9c40 2023-11-04T01:36:18.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.618+0000 7f1db07c5640 1 -- 172.21.15.44:0/3932933425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1da80b4880 con 0x7f1da80c9c40 2023-11-04T01:36:18.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.619+0000 7f1d9effd640 1 -- 172.21.15.44:0/3932933425 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f1d98034090 con 0x7f1da80c9c40 2023-11-04T01:36:18.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:18.622 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:03.589395+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:18.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.621+0000 7f1db07c5640 1 -- 172.21.15.44:0/3932933425 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1d8c06ae70 msgr2=0x7f1d8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.621+0000 7f1db07c5640 1 --2- 172.21.15.44:0/3932933425 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1d8c06ae70 0x7f1d8c06d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1da4004f60 tx=0x7f1da4007e30 comp rx=0 tx=0).stop 2023-11-04T01:36:18.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.621+0000 7f1db07c5640 1 -- 172.21.15.44:0/3932933425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1da80c9c40 msgr2=0x7f1da81f5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.621+0000 7f1db07c5640 1 --2- 172.21.15.44:0/3932933425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1da80c9c40 0x7f1da81f5af0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1d98000c00 tx=0x7f1d98004730 comp rx=0 tx=0).stop 2023-11-04T01:36:18.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.621+0000 7f1db07c5640 1 -- 172.21.15.44:0/3932933425 shutdown_connections 2023-11-04T01:36:18.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.621+0000 7f1db07c5640 1 --2- 172.21.15.44:0/3932933425 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1d8c06ae70 0x7f1d8c06d330 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.621+0000 7f1db07c5640 1 --2- 172.21.15.44:0/3932933425 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1da815ad80 0x7f1da81f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.621+0000 7f1db07c5640 1 --2- 172.21.15.44:0/3932933425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1da80c9c40 0x7f1da81f5af0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.621+0000 7f1db07c5640 1 --2- 172.21.15.44:0/3932933425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1da80b42c0 0x7f1da80acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.621+0000 7f1db07c5640 1 -- 172.21.15.44:0/3932933425 >> 172.21.15.44:0/3932933425 conn(0x7f1da80ce950 msgr2=0x7f1da80aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.621+0000 7f1db07c5640 1 -- 172.21.15.44:0/3932933425 shutdown_connections 2023-11-04T01:36:18.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.621+0000 7f1db07c5640 1 -- 172.21.15.44:0/3932933425 wait complete. 2023-11-04T01:36:18.635 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-04T01:36:18.635 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-04T01:36:18.635 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-04T01:36:18.636 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-04T01:36:18.636 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-04T01:36:18.637 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-04T01:36:18.637 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-04T01:36:18.637 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-04T01:36:18.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.817+0000 7fc95fae0640 1 Processor -- start 2023-11-04T01:36:18.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.816+0000 7f5db9b78640 1 Processor -- start 2023-11-04T01:36:18.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.818+0000 7f581d7f5640 1 Processor -- start 2023-11-04T01:36:18.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.818+0000 7f581d7f5640 1 -- start start 2023-11-04T01:36:18.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.816+0000 7f5db9b78640 1 -- start start 2023-11-04T01:36:18.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.818+0000 7f5db9b78640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5db40add70 0x7f5db4070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.818+0000 7f5db3fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5db406d440 0x7f5db40ca190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36352/0 (socket says 172.21.15.44:36352) 2023-11-04T01:36:18.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.818+0000 7f5db2ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5db40add70 0x7f5db4070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.817+0000 7fc95fae0640 1 -- start start 2023-11-04T01:36:18.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.818+0000 7f5db2ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5db40add70 0x7f5db4070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44146/0 (socket says 172.21.15.44:44146) 2023-11-04T01:36:18.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.818+0000 7f5db37fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f5db40ae4e0 0x7f5db416e120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:46808/0 (socket says 172.21.15.44:46808) 2023-11-04T01:36:18.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.818+0000 7fc95fae0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc958153e60 0x7fc95815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.818+0000 7fc95fae0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9580cde60 con 0x7fc9580b4880 2023-11-04T01:36:18.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.818+0000 7fc95fae0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc958160f90 con 0x7fc9580cd6d0 2023-11-04T01:36:18.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.818+0000 7fc95fae0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95815e400 con 0x7fc958153e60 2023-11-04T01:36:18.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7fc95e07d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc9580b4880 0x7fc9580d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36356/0 (socket says 172.21.15.44:36356) 2023-11-04T01:36:18.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7fc95e07d640 1 -- 172.21.15.44:0/625440669 learned_addr learned my addr 172.21.15.44:0/625440669 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:18.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7fc95d87c640 1 --2- 172.21.15.44:0/625440669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc958153e60 0x7fc95815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7f5db3fff640 1 -- 172.21.15.44:0/2172532295 learned_addr learned my addr 172.21.15.44:0/2172532295 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:18.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7f581d7f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58180cb360 0x7f58180cb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7f581d7f5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f58180cd740 0x7f58180cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7f581d7f5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5818164d60 con 0x7f58180cc590 2023-11-04T01:36:18.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7f581d7f5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5818071570 con 0x7f58180cd740 2023-11-04T01:36:18.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7f581d7f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58180710e0 con 0x7f58180cb360 2023-11-04T01:36:18.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7f5db9b78640 1 -- 172.21.15.44:0/2172532295 --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db40715d0 con 0x7f5db406d440 2023-11-04T01:36:18.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7f58167fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f58180cc590 0x7f58180cc9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36360/0 (socket says 172.21.15.44:36360) 2023-11-04T01:36:18.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7f5db9b78640 1 -- 172.21.15.44:0/2172532295 --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db40712f0 con 0x7f5db40ae4e0 2023-11-04T01:36:18.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7f5db9b78640 1 -- 172.21.15.44:0/2172532295 --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db416d920 con 0x7f5db40add70 2023-11-04T01:36:18.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7f58167fc640 1 -- 172.21.15.44:0/3799545375 learned_addr learned my addr 172.21.15.44:0/3799545375 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:18.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7fc95d87c640 1 -- 172.21.15.44:0/625440669 >> v1:172.21.15.204:6789/0 conn(0x7fc9580cd6d0 legacy=0x7fc958161420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:36:18.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7fc95d87c640 1 -- 172.21.15.44:0/625440669 >> v1:172.21.15.44:6789/0 conn(0x7fc9580b4880 legacy=0x7fc9580d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7fc95c87a640 1 -- 172.21.15.44:0/625440669 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083523730 0 0) 0x7fc9580cde60 con 0x7fc9580b4880 2023-11-04T01:36:18.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7f5db27fc640 1 -- 172.21.15.44:0/2172532295 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276797862 0 0) 0x7f5db40712f0 con 0x7f5db40ae4e0 2023-11-04T01:36:18.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7f5db27fc640 1 -- 172.21.15.44:0/2172532295 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d9c003520 con 0x7f5db40ae4e0 2023-11-04T01:36:18.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7fc95d87c640 1 -- 172.21.15.44:0/625440669 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580ce090 con 0x7fc958153e60 2023-11-04T01:36:18.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.820+0000 7f58177fe640 1 --2- 172.21.15.44:0/3799545375 >> v2:172.21.15.44:3300/0 conn(0x7f58180cd740 0x7f58180cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.820+0000 7f5816ffd640 1 --2- 172.21.15.44:0/3799545375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58180cb360 0x7f58180cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.820+0000 7f5815ffb640 1 -- 172.21.15.44:0/3799545375 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581544473 0 0) 0x7f5818164d60 con 0x7f58180cc590 2023-11-04T01:36:18.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.820+0000 7f5815ffb640 1 -- 172.21.15.44:0/3799545375 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5800003520 con 0x7f58180cc590 2023-11-04T01:36:18.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.820+0000 7f5815ffb640 1 -- 172.21.15.44:0/3799545375 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3853224395 0 0) 0x7f5800003520 con 0x7f58180cc590 2023-11-04T01:36:18.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5815ffb640 1 -- 172.21.15.44:0/3799545375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58180cb360 msgr2=0x7f58180cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5815ffb640 1 --2- 172.21.15.44:0/3799545375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58180cb360 0x7f58180cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5815ffb640 1 -- 172.21.15.44:0/3799545375 >> v2:172.21.15.44:3300/0 conn(0x7f58180cd740 msgr2=0x7f58180cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5815ffb640 1 --2- 172.21.15.44:0/3799545375 >> v2:172.21.15.44:3300/0 conn(0x7f58180cd740 0x7f58180cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5815ffb640 1 -- 172.21.15.44:0/3799545375 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58181615d0 con 0x7f58180cc590 2023-11-04T01:36:18.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.820+0000 7ff48cbd7640 1 Processor -- start 2023-11-04T01:36:18.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.820+0000 7f5db2ffd640 1 -- 172.21.15.44:0/2172532295 >> v1:172.21.15.204:6789/0 conn(0x7f5db40ae4e0 legacy=0x7f5db416e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.820+0000 7f5db2ffd640 1 -- 172.21.15.44:0/2172532295 >> v1:172.21.15.44:6789/0 conn(0x7f5db406d440 legacy=0x7f5db40ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.820+0000 7f5db2ffd640 1 -- 172.21.15.44:0/2172532295 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db416dc00 con 0x7f5db40add70 2023-11-04T01:36:18.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.819+0000 7fb939c10640 1 Processor -- start 2023-11-04T01:36:18.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7fb939c10640 1 -- start start 2023-11-04T01:36:18.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5815ffb640 1 -- 172.21.15.44:0/3799545375 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f58100019f0 con 0x7f58180cc590 2023-11-04T01:36:18.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5815ffb640 1 -- 172.21.15.44:0/3799545375 >> v1:172.21.15.44:6789/0 conn(0x7f58180cc590 legacy=0x7f58180cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5815ffb640 1 --2- 172.21.15.44:0/3799545375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5800003970 0x7f5800003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5815ffb640 1 --2- 172.21.15.44:0/3799545375 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58000047c0 0x7f5800004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5815ffb640 1 --2- 172.21.15.44:0/3799545375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5800005180 0x7f580000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5815ffb640 1 -- 172.21.15.44:0/3799545375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5818071570 con 0x7f5800003970 2023-11-04T01:36:18.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5815ffb640 1 -- 172.21.15.44:0/3799545375 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58180710e0 con 0x7f58000047c0 2023-11-04T01:36:18.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5815ffb640 1 -- 172.21.15.44:0/3799545375 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580000bf70 con 0x7f5800005180 2023-11-04T01:36:18.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5816ffd640 1 --2- 172.21.15.44:0/3799545375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58180cb360 0x7f58180cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:18.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.820+0000 7ff48cbd7640 1 -- start start 2023-11-04T01:36:18.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7fc95d87c640 1 --2- 172.21.15.44:0/625440669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc958153e60 0x7fc95815dec0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc950009dc0 tx=0x7fc95002be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1074f9931d86b006 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5816ffd640 1 --2- 172.21.15.44:0/3799545375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5800003970 0x7f5800003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f58177fe640 1 --2- 172.21.15.44:0/3799545375 >> v2:172.21.15.44:3300/0 conn(0x7f58180cd740 0x7f58180cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:18.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f58167fc640 1 --2- 172.21.15.44:0/3799545375 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58000047c0 0x7f5800004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7f5816ffd640 1 -- 172.21.15.44:0/3799545375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5800005180 msgr2=0x7f580000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7f58177fe640 1 --2- 172.21.15.44:0/3799545375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5800005180 0x7f580000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7f5816ffd640 1 --2- 172.21.15.44:0/3799545375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5800005180 0x7f580000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7f5816ffd640 1 -- 172.21.15.44:0/3799545375 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58000047c0 msgr2=0x7f5800004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7f5816ffd640 1 --2- 172.21.15.44:0/3799545375 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58000047c0 0x7f5800004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7f5816ffd640 1 -- 172.21.15.44:0/3799545375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5800003520 con 0x7f5800003970 2023-11-04T01:36:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7f58167fc640 1 --2- 172.21.15.44:0/3799545375 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58000047c0 0x7f5800004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7f58177fe640 1 --2- 172.21.15.44:0/3799545375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5800005180 0x7f580000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7ff48cbd7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff4880ce4c0 0x7ff488163d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7ff48cbd7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4880cb1e0 con 0x7ff488159060 2023-11-04T01:36:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7ff48cbd7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4881595d0 con 0x7ff488158c80 2023-11-04T01:36:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7ff48cbd7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4880cad00 con 0x7ff4880ce4c0 2023-11-04T01:36:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7ff48659c640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7ff488158c80 0x7ff4880ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:46820/0 (socket says 172.21.15.44:46820) 2023-11-04T01:36:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7ff485d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff488159060 0x7ff4880cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36364/0 (socket says 172.21.15.44:36364) 2023-11-04T01:36:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7ff485d9b640 1 -- 172.21.15.44:0/574327309 learned_addr learned my addr 172.21.15.44:0/574327309 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5db2ffd640 1 --2- 172.21.15.44:0/2172532295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5db40add70 0x7f5db4070710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5da40097d0 tx=0x7f5da402ba00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd2ad383b8a0d173 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f5db27fc640 1 -- 172.21.15.44:0/2172532295 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da402f820 con 0x7f5db40add70 2023-11-04T01:36:18.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7f5db27fc640 1 -- 172.21.15.44:0/2172532295 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da402f980 con 0x7f5db40add70 2023-11-04T01:36:18.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7f5db27fc640 1 -- 172.21.15.44:0/2172532295 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da402fd10 con 0x7f5db40add70 2023-11-04T01:36:18.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f03739e2640 1 Processor -- start 2023-11-04T01:36:18.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.821+0000 7f03739e2640 1 -- start start 2023-11-04T01:36:18.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7fb939c10640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb934158c80 0x7fb9340ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7fb939c10640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb934159060 0x7fb9340cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7fc95c87a640 1 -- 172.21.15.44:0/625440669 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95002cc40 con 0x7fc958153e60 2023-11-04T01:36:18.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7fc95c87a640 1 -- 172.21.15.44:0/625440669 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95002cda0 con 0x7fc958153e60 2023-11-04T01:36:18.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7fb9337fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb934158c80 0x7fb9340ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7fb9337fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb934158c80 0x7fb9340ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44158/0 (socket says 172.21.15.44:44158) 2023-11-04T01:36:18.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7fb9337fe640 1 -- 172.21.15.44:0/2143449786 learned_addr learned my addr 172.21.15.44:0/2143449786 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:18.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7fc95c87a640 1 -- 172.21.15.44:0/625440669 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95002cc40 con 0x7fc958153e60 2023-11-04T01:36:18.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7fb932ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb934159060 0x7fb9340cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7ff48559a640 1 -- 172.21.15.44:0/574327309 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085853012 0 0) 0x7ff4880cb1e0 con 0x7ff488159060 2023-11-04T01:36:18.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.822+0000 7fb939c10640 1 -- 172.21.15.44:0/2143449786 --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9340cb1e0 con 0x7fb93415a070 2023-11-04T01:36:18.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb939c10640 1 -- 172.21.15.44:0/2143449786 --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9341595d0 con 0x7fb934158c80 2023-11-04T01:36:18.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7ff48559a640 1 -- 172.21.15.44:0/574327309 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff470003520 con 0x7ff488159060 2023-11-04T01:36:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb939c10640 1 -- 172.21.15.44:0/2143449786 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340caf00 con 0x7fb934159060 2023-11-04T01:36:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 -- 172.21.15.44:0/2143449786 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583405866 0 0) 0x7fb9340cb1e0 con 0x7fb93415a070 2023-11-04T01:36:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 -- 172.21.15.44:0/2143449786 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb91c003520 con 0x7fb93415a070 2023-11-04T01:36:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7ff486d9d640 1 --2- 172.21.15.44:0/574327309 >> v2:172.21.15.204:3300/0 conn(0x7ff4880ce4c0 0x7ff488163d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7ff48559a640 1 -- 172.21.15.44:0/574327309 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2762367818 0 0) 0x7ff470003520 con 0x7ff488159060 2023-11-04T01:36:18.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7f03739e2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f036c0c95b0 0x7f036c0cb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7f03739e2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036c0c93e0 con 0x7f036c0c8bd0 2023-11-04T01:36:18.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7f03739e2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036c1598f0 con 0x7f036c159d80 2023-11-04T01:36:18.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7f03739e2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036c0c9100 con 0x7f036c0c95b0 2023-11-04T01:36:18.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7f0371f7f640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f036c159d80 0x7f036c15c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:46836/0 (socket says 172.21.15.44:46836) 2023-11-04T01:36:18.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7ff48559a640 1 -- 172.21.15.44:0/574327309 >> v2:172.21.15.204:3300/0 conn(0x7ff4880ce4c0 msgr2=0x7ff488163d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7ff48559a640 1 --2- 172.21.15.44:0/574327309 >> v2:172.21.15.204:3300/0 conn(0x7ff4880ce4c0 0x7ff488163d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7f0371f7f640 1 -- 172.21.15.44:0/2119621827 learned_addr learned my addr 172.21.15.44:0/2119621827 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:18.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7f037177e640 1 --2- 172.21.15.44:0/2119621827 >> v2:172.21.15.204:3300/0 conn(0x7f036c0c95b0 0x7f036c0cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7f5db9b78640 1 -- 172.21.15.44:0/2172532295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5db40add70 msgr2=0x7f5db4070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7ff48559a640 1 -- 172.21.15.44:0/574327309 >> v1:172.21.15.204:6789/0 conn(0x7ff488158c80 legacy=0x7ff4880ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 -- 172.21.15.44:0/2143449786 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2792328566 0 0) 0x7fb91c003520 con 0x7fb93415a070 2023-11-04T01:36:18.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 -- 172.21.15.44:0/2143449786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb934159060 msgr2=0x7fb9340cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 --2- 172.21.15.44:0/2143449786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb934159060 0x7fb9340cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 -- 172.21.15.44:0/2143449786 >> v2:172.21.15.204:3300/0 conn(0x7fb934158c80 msgr2=0x7fb9340ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 --2- 172.21.15.44:0/2143449786 >> v2:172.21.15.204:3300/0 conn(0x7fb934158c80 0x7fb9340ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 -- 172.21.15.44:0/2143449786 --> v1:172.21.15.204:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb934159870 con 0x7fb93415a070 2023-11-04T01:36:18.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 -- 172.21.15.44:0/2143449786 <== mon.1 v1:172.21.15.204:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fb924001670 con 0x7fb93415a070 2023-11-04T01:36:18.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7f73819ed640 1 Processor -- start 2023-11-04T01:36:18.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7f73819ed640 1 -- start start 2023-11-04T01:36:18.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fc95fae0640 1 -- 172.21.15.44:0/625440669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc958153e60 msgr2=0x7fc95815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fc95fae0640 1 --2- 172.21.15.44:0/625440669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc958153e60 0x7fc95815dec0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc950009dc0 tx=0x7fc95002be90 comp rx=0 tx=0).stop 2023-11-04T01:36:18.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7fc95fae0640 1 -- 172.21.15.44:0/625440669 shutdown_connections 2023-11-04T01:36:18.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7fc95fae0640 1 --2- 172.21.15.44:0/625440669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc958153e60 0x7fc95815dec0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7fc95fae0640 1 -- 172.21.15.44:0/625440669 >> 172.21.15.44:0/625440669 conn(0x7fc9580cf880 msgr2=0x7fc9580cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7f5816ffd640 1 --2- 172.21.15.44:0/3799545375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5800003970 0x7f5800003d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5808006fd0 tx=0x7f58000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4042ca42c2523c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7f5815ffb640 1 -- 172.21.15.44:0/3799545375 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808033600 con 0x7f5800003970 2023-11-04T01:36:18.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7f5815ffb640 1 -- 172.21.15.44:0/3799545375 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580802f050 con 0x7f5800003970 2023-11-04T01:36:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7ff48559a640 1 -- 172.21.15.44:0/574327309 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880caf00 con 0x7ff488159060 2023-11-04T01:36:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7f5db9b78640 1 --2- 172.21.15.44:0/2172532295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5db40add70 0x7f5db4070710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5da40097d0 tx=0x7f5da402ba00 comp rx=0 tx=0).stop 2023-11-04T01:36:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7f5db9b78640 1 -- 172.21.15.44:0/2172532295 shutdown_connections 2023-11-04T01:36:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7f5db9b78640 1 --2- 172.21.15.44:0/2172532295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5db40add70 0x7f5db4070710 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7f5db9b78640 1 -- 172.21.15.44:0/2172532295 >> 172.21.15.44:0/2172532295 conn(0x7f5db406a120 msgr2=0x7f5db406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7f2346bff640 1 Processor -- start 2023-11-04T01:36:18.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 -- 172.21.15.44:0/2143449786 >> v1:172.21.15.204:6789/0 conn(0x7fb93415a070 legacy=0x7fb934070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 --2- 172.21.15.44:0/2143449786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb91c003970 0x7fb91c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 --2- 172.21.15.44:0/2143449786 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb91c0047c0 0x7fb91c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 --2- 172.21.15.44:0/2143449786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb91c0052a0 0x7fb91c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 -- 172.21.15.44:0/2143449786 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9341595d0 con 0x7fb91c0052a0 2023-11-04T01:36:18.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 -- 172.21.15.44:0/2143449786 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340caf00 con 0x7fb91c0047c0 2023-11-04T01:36:18.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9327fc640 1 -- 172.21.15.44:0/2143449786 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c00e3e0 con 0x7fb91c003970 2023-11-04T01:36:18.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.823+0000 7fb9337fe640 1 --2- 172.21.15.44:0/2143449786 >> v2:172.21.15.204:3300/0 conn(0x7fb934158c80 0x7fb9340ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:18.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7fb932ffd640 1 --2- 172.21.15.44:0/2143449786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb934159060 0x7fb9340cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:18.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7f037177e640 1 -- 172.21.15.44:0/2119621827 >> v1:172.21.15.204:6789/0 conn(0x7f036c159d80 legacy=0x7f036c15c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7f037177e640 1 -- 172.21.15.44:0/2119621827 >> v1:172.21.15.44:6789/0 conn(0x7f036c0c8bd0 legacy=0x7f036c0c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7f037177e640 1 -- 172.21.15.44:0/2119621827 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c1592a0 con 0x7f036c0c95b0 2023-11-04T01:36:18.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7fb9337fe640 1 --2- 172.21.15.44:0/2143449786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb91c003970 0x7fb91c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7f5db9b78640 1 -- 172.21.15.44:0/2172532295 shutdown_connections 2023-11-04T01:36:18.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7fc95fae0640 1 -- 172.21.15.44:0/625440669 shutdown_connections 2023-11-04T01:36:18.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7fb933fff640 1 --2- 172.21.15.44:0/2143449786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb91c0052a0 0x7fb91c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7fb932ffd640 1 --2- 172.21.15.44:0/2143449786 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb91c0047c0 0x7fb91c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7fc95fae0640 1 -- 172.21.15.44:0/625440669 wait complete. 2023-11-04T01:36:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7ff48559a640 1 -- 172.21.15.44:0/574327309 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7ff4800019f0 con 0x7ff488159060 2023-11-04T01:36:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7ff48559a640 1 -- 172.21.15.44:0/574327309 >> v1:172.21.15.44:6789/0 conn(0x7ff488159060 legacy=0x7ff4880cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7ff48559a640 1 --2- 172.21.15.44:0/574327309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff470003970 0x7ff470003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7ff48559a640 1 --2- 172.21.15.44:0/574327309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff470004290 0x7ff4700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7ff48559a640 1 --2- 172.21.15.44:0/574327309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff470004f00 0x7ff47000ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7ff48559a640 1 -- 172.21.15.44:0/574327309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880cad00 con 0x7ff470004f00 2023-11-04T01:36:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7ff48559a640 1 -- 172.21.15.44:0/574327309 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff470007b60 con 0x7ff470004290 2023-11-04T01:36:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7ff48559a640 1 -- 172.21.15.44:0/574327309 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff470007d20 con 0x7ff470003970 2023-11-04T01:36:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7ff48659c640 1 --2- 172.21.15.44:0/574327309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff470003970 0x7ff470003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7f581d7f5640 1 -- 172.21.15.44:0/3799545375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5800003970 msgr2=0x7f5800003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7f581d7f5640 1 --2- 172.21.15.44:0/3799545375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5800003970 0x7f5800003d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5808006fd0 tx=0x7f58000057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7f5db9b78640 1 -- 172.21.15.44:0/2172532295 wait complete. 2023-11-04T01:36:18.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7f58177fe640 1 -- 172.21.15.44:0/3799545375 reap_dead start 2023-11-04T01:36:18.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7f73819ed640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f737c06e610 0x7f737c0ae260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7f581d7f5640 1 -- 172.21.15.44:0/3799545375 shutdown_connections 2023-11-04T01:36:18.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7f581d7f5640 1 -- 172.21.15.44:0/3799545375 >> 172.21.15.44:0/3799545375 conn(0x7f581806a120 msgr2=0x7f581806a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7ff48659c640 1 -- 172.21.15.44:0/574327309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff470004290 msgr2=0x7ff4700047c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:36:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7f581d7f5640 1 -- 172.21.15.44:0/3799545375 shutdown_connections 2023-11-04T01:36:18.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7f73819ed640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f737c0adc80 0x7f737c0ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7f73819ed640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737c071390 con 0x7f737c1611c0 2023-11-04T01:36:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7ff48659c640 1 --2- 172.21.15.44:0/574327309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff470004290 0x7ff4700047c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7ff48659c640 1 -- 172.21.15.44:0/574327309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff470004f00 msgr2=0x7ff47000ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7ff48659c640 1 --2- 172.21.15.44:0/574327309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff470004f00 0x7ff47000ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7ff48659c640 1 -- 172.21.15.44:0/574327309 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff470003520 con 0x7ff470003970 2023-11-04T01:36:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7ff486d9d640 1 -- 172.21.15.44:0/574327309 reap_dead start 2023-11-04T01:36:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7f73819ed640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c1615a0 con 0x7f737c06e610 2023-11-04T01:36:18.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7f73819ed640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c0704a0 con 0x7f737c0adc80 2023-11-04T01:36:18.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7f73811ec640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f737c0adc80 0x7f737c0ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.824+0000 7f2346bff640 1 -- start start 2023-11-04T01:36:18.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7f2346bff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23400b8780 0x7f23400cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7f2346bff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f23400cddc0 0x7f23400d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7f73811ec640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f737c0adc80 0x7f737c0ae7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44212/0 (socket says 172.21.15.44:44212) 2023-11-04T01:36:18.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7f2346bff640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234015d0f0 con 0x7f234015cd10 2023-11-04T01:36:18.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7f73811ec640 1 -- 172.21.15.44:0/980972114 learned_addr learned my addr 172.21.15.44:0/980972114 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:18.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7f23453fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23400b8780 0x7f23400cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7f737bfff640 1 --2- 172.21.15.44:0/980972114 >> v2:172.21.15.44:3300/0 conn(0x7f737c06e610 0x7f737c0ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7f2345bfd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f234015cd10 0x7f23401607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36394/0 (socket says 172.21.15.44:36394) 2023-11-04T01:36:18.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7f2345bfd640 1 -- 172.21.15.44:0/2577130823 learned_addr learned my addr 172.21.15.44:0/2577130823 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:18.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7fc95fae0640 1 Processor -- start 2023-11-04T01:36:18.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7f2346bff640 1 -- 172.21.15.44:0/2577130823 --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23400b8be0 con 0x7f23400cddc0 2023-11-04T01:36:18.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7f2346bff640 1 -- 172.21.15.44:0/2577130823 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23400d1220 con 0x7f23400b8780 2023-11-04T01:36:18.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7fb9337fe640 1 -- 172.21.15.44:0/2143449786 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb91c0047c0 msgr2=0x7fb91c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7fb9337fe640 1 --2- 172.21.15.44:0/2143449786 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb91c0047c0 0x7fb91c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7fb9337fe640 1 -- 172.21.15.44:0/2143449786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb91c0052a0 msgr2=0x7fb91c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7fb9337fe640 1 --2- 172.21.15.44:0/2143449786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb91c0052a0 0x7fb91c00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7fb9337fe640 1 -- 172.21.15.44:0/2143449786 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c003520 con 0x7fb91c003970 2023-11-04T01:36:18.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7f037177e640 1 --2- 172.21.15.44:0/2119621827 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f036c0c95b0 0x7f036c0cb760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0364009cf0 tx=0x7f036402d1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b563bb5077c875 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7ff48659c640 1 --2- 172.21.15.44:0/574327309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff470003970 0x7ff470003d50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff4780018c0 tx=0x7ff4700057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd607b05bcdac33e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.825+0000 7f581d7f5640 1 -- 172.21.15.44:0/3799545375 wait complete. 2023-11-04T01:36:18.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7f0363fff640 1 -- 172.21.15.44:0/2119621827 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0364035440 con 0x7f036c0c95b0 2023-11-04T01:36:18.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7f5db9b78640 1 Processor -- start 2023-11-04T01:36:18.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7f0363fff640 1 -- 172.21.15.44:0/2119621827 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03640355a0 con 0x7f036c0c95b0 2023-11-04T01:36:18.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7f0363fff640 1 -- 172.21.15.44:0/2119621827 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0364035930 con 0x7f036c0c95b0 2023-11-04T01:36:18.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7f581d7f5640 1 Processor -- start 2023-11-04T01:36:18.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7ff48559a640 1 -- 172.21.15.44:0/574327309 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478007270 con 0x7ff470003970 2023-11-04T01:36:18.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7ff48559a640 1 -- 172.21.15.44:0/574327309 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4780073f0 con 0x7ff470003970 2023-11-04T01:36:18.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7f03739e2640 1 -- 172.21.15.44:0/2119621827 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f036c0c95b0 msgr2=0x7f036c0cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7f03739e2640 1 --2- 172.21.15.44:0/2119621827 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f036c0c95b0 0x7f036c0cb760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0364009cf0 tx=0x7f036402d1c0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7f23453fc640 1 -- 172.21.15.44:0/2577130823 >> v2:172.21.15.44:3300/0 conn(0x7f23400cddc0 msgr2=0x7f23400d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7f23453fc640 1 --2- 172.21.15.44:0/2577130823 >> v2:172.21.15.44:3300/0 conn(0x7f23400cddc0 0x7f23400d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7f23453fc640 1 -- 172.21.15.44:0/2577130823 >> v1:172.21.15.44:6789/0 conn(0x7f234015cd10 legacy=0x7f23401607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7f23453fc640 1 -- 172.21.15.44:0/2577130823 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23400ce220 con 0x7f23400b8780 2023-11-04T01:36:18.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7fb9337fe640 1 --2- 172.21.15.44:0/2143449786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb91c003970 0x7fb91c003d90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00c160 tx=0x7fb91c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea05e1aca832438c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7fb9327fc640 1 -- 172.21.15.44:0/2143449786 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c02ca50 con 0x7fb91c003970 2023-11-04T01:36:18.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7fb9327fc640 1 -- 172.21.15.44:0/2143449786 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c02cbb0 con 0x7fb91c003970 2023-11-04T01:36:18.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7fb9327fc640 1 -- 172.21.15.44:0/2143449786 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c034440 con 0x7fb91c003970 2023-11-04T01:36:18.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7fb932ffd640 1 --2- 172.21.15.44:0/2143449786 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb91c0047c0 0x7fb91c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:18.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7f5db9b78640 1 -- start start 2023-11-04T01:36:18.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.826+0000 7fc95fae0640 1 -- start start 2023-11-04T01:36:18.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7ff48559a640 1 -- 172.21.15.44:0/574327309 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478005810 con 0x7ff470003970 2023-11-04T01:36:18.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.827+0000 7f581d7f5640 1 -- start start 2023-11-04T01:36:18.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7ff48cbd7640 1 -- 172.21.15.44:0/574327309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff470003970 msgr2=0x7ff470003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7ff48cbd7640 1 --2- 172.21.15.44:0/574327309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff470003970 0x7ff470003d50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff4780018c0 tx=0x7ff4700057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f03739e2640 1 -- 172.21.15.44:0/2119621827 shutdown_connections 2023-11-04T01:36:18.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f03739e2640 1 --2- 172.21.15.44:0/2119621827 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f036c0c95b0 0x7f036c0cb760 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f03739e2640 1 -- 172.21.15.44:0/2119621827 >> 172.21.15.44:0/2119621827 conn(0x7f036c06c4c0 msgr2=0x7f036c06c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7fc95fae0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9580b4880 0x7fc9580c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7fc95fae0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9580cd6d0 0x7fc958203480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7fc95fae0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc958153e60 0x7fc9580b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7fc95fae0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc958157350 con 0x7fc9580cd6d0 2023-11-04T01:36:18.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7ff48cbd7640 1 -- 172.21.15.44:0/574327309 shutdown_connections 2023-11-04T01:36:18.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7ff48cbd7640 1 --2- 172.21.15.44:0/574327309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff470003970 0x7ff470003d50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7ff48cbd7640 1 -- 172.21.15.44:0/574327309 >> 172.21.15.44:0/574327309 conn(0x7ff48806a120 msgr2=0x7ff48806a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7fc95fae0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9582039c0 con 0x7fc9580b4880 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7fc95fae0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9581f3e10 con 0x7fc958153e60 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f5db9b78640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5db406d440 0x7f5db420f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f03739e2640 1 -- 172.21.15.44:0/2119621827 shutdown_connections 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f737bfff640 1 -- 172.21.15.44:0/980972114 >> v2:172.21.15.204:3300/0 conn(0x7f737c0adc80 msgr2=0x7f737c0ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f737bfff640 1 --2- 172.21.15.44:0/980972114 >> v2:172.21.15.204:3300/0 conn(0x7f737c0adc80 0x7f737c0ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f737bfff640 1 -- 172.21.15.44:0/980972114 >> v1:172.21.15.204:6789/0 conn(0x7f737c1611c0 legacy=0x7f737c06df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f737bfff640 1 -- 172.21.15.44:0/980972114 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c070780 con 0x7f737c06e610 2023-11-04T01:36:18.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f5db9b78640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5db40add70 0x7f5db40b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f23453fc640 1 --2- 172.21.15.44:0/2577130823 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23400b8780 0x7f23400cd880 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f23300097a0 tx=0x7f233002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29c5dbd7d2b180f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f5db9b78640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5db40ae4e0 0x7f5db40af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f5db9b78640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40c6d50 con 0x7f5db40add70 2023-11-04T01:36:18.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f5db9b78640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db420fe80 con 0x7f5db406d440 2023-11-04T01:36:18.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f5db9b78640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40b3d40 con 0x7f5db40ae4e0 2023-11-04T01:36:18.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f03739e2640 1 -- 172.21.15.44:0/2119621827 wait complete. 2023-11-04T01:36:18.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f5db37fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5db406d440 0x7f5db420f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f5db2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5db40add70 0x7f5db40b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f2344bfb640 1 -- 172.21.15.44:0/2577130823 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233002d040 con 0x7f23400b8780 2023-11-04T01:36:18.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7fb939c10640 1 -- 172.21.15.44:0/2143449786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb91c003970 msgr2=0x7fb91c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f5db37fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5db406d440 0x7f5db420f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44234/0 (socket says 172.21.15.44:44234) 2023-11-04T01:36:18.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.828+0000 7f5db37fe640 1 -- 172.21.15.44:0/2596217634 learned_addr learned my addr 172.21.15.44:0/2596217634 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f5db3fff640 1 --2- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5db40ae4e0 0x7f5db40af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7fb939c10640 1 --2- 172.21.15.44:0/2143449786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb91c003970 0x7fb91c003d90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00c160 tx=0x7fb91c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7fb933fff640 1 -- 172.21.15.44:0/2143449786 reap_dead start 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7fc95d87c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9580b4880 0x7fc9580c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7fc95d87c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9580b4880 0x7fc9580c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44224/0 (socket says 172.21.15.44:44224) 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7fc95d87c640 1 -- 172.21.15.44:0/1244277429 learned_addr learned my addr 172.21.15.44:0/1244277429 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:18.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f581d7f5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58181fee20 0x7f5818163670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f581d7f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58181ff200 0x7f581815e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f581d7f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5818163e30 0x7f581815ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f581d7f5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5818164f40 con 0x7f5818163e30 2023-11-04T01:36:18.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f581d7f5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5818164330 con 0x7f58181fee20 2023-11-04T01:36:18.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f581d7f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5818164610 con 0x7f58181ff200 2023-11-04T01:36:18.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7ff48cbd7640 1 -- 172.21.15.44:0/574327309 shutdown_connections 2023-11-04T01:36:18.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f2344bfb640 1 -- 172.21.15.44:0/2577130823 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2330031810 con 0x7f23400b8780 2023-11-04T01:36:18.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7fb939c10640 1 -- 172.21.15.44:0/2143449786 shutdown_connections 2023-11-04T01:36:18.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7fb939c10640 1 -- 172.21.15.44:0/2143449786 >> 172.21.15.44:0/2143449786 conn(0x7fb93406a120 msgr2=0x7fb93406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f58167fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58181ff200 0x7f581815e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f58167fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58181ff200 0x7f581815e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:60404/0 (socket says 172.21.15.44:60404) 2023-11-04T01:36:18.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f58167fc640 1 -- 172.21.15.44:0/1632759104 learned_addr learned my addr 172.21.15.44:0/1632759104 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:18.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7ff48cbd7640 1 -- 172.21.15.44:0/574327309 wait complete. 2023-11-04T01:36:18.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7fb939c10640 1 -- 172.21.15.44:0/2143449786 shutdown_connections 2023-11-04T01:36:18.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7fb939c10640 1 -- 172.21.15.44:0/2143449786 wait complete. 2023-11-04T01:36:18.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f5816ffd640 1 --2- 172.21.15.44:0/1632759104 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58181fee20 0x7f5818163670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f58177fe640 1 --2- 172.21.15.44:0/1632759104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5818163e30 0x7f581815ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7fc95d07b640 1 --2- 172.21.15.44:0/1244277429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9580cd6d0 0x7fc958203480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7fc95e07d640 1 --2- 172.21.15.44:0/1244277429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc958153e60 0x7fc9580b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7fc95d87c640 1 -- 172.21.15.44:0/1244277429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc958153e60 msgr2=0x7fc9580b7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7fc95d87c640 1 --2- 172.21.15.44:0/1244277429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc958153e60 0x7fc9580b7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7fc95d87c640 1 -- 172.21.15.44:0/1244277429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9580cd6d0 msgr2=0x7fc958203480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7fc95d87c640 1 --2- 172.21.15.44:0/1244277429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9580cd6d0 0x7fc958203480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f58167fc640 1 -- 172.21.15.44:0/1632759104 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58181fee20 msgr2=0x7f5818163670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f58167fc640 1 --2- 172.21.15.44:0/1632759104 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58181fee20 0x7f5818163670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f58167fc640 1 -- 172.21.15.44:0/1632759104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5818163e30 msgr2=0x7f581815ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f58167fc640 1 --2- 172.21.15.44:0/1632759104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5818163e30 0x7f581815ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f58167fc640 1 -- 172.21.15.44:0/1632759104 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58181648f0 con 0x7f58181ff200 2023-11-04T01:36:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7fc95d87c640 1 -- 172.21.15.44:0/1244277429 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc950009a70 con 0x7fc9580b4880 2023-11-04T01:36:18.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f58177fe640 1 --2- 172.21.15.44:0/1632759104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5818163e30 0x7f581815ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:18.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f2344bfb640 1 -- 172.21.15.44:0/2577130823 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233002d040 con 0x7f23400b8780 2023-11-04T01:36:18.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7fc95e07d640 1 --2- 172.21.15.44:0/1244277429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc958153e60 0x7fc9580b7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:18.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f2346bff640 1 -- 172.21.15.44:0/2577130823 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23400b8780 msgr2=0x7f23400cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f58167fc640 1 --2- 172.21.15.44:0/1632759104 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58181ff200 0x7f581815e730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f581000e1e0 tx=0x7f581000e2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f2346bff640 1 --2- 172.21.15.44:0/2577130823 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23400b8780 0x7f23400cd880 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f23300097a0 tx=0x7f233002b8b0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f737bfff640 1 --2- 172.21.15.44:0/980972114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f737c06e610 0x7f737c0ae260 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f737c06dbf0 tx=0x7f737002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31807e1b0fe044a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f57ff7fe640 1 -- 172.21.15.44:0/1632759104 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581000ed10 con 0x7f58181ff200 2023-11-04T01:36:18.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f5db37fe640 1 -- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5db40ae4e0 msgr2=0x7f5db40af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f5db37fe640 1 --2- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5db40ae4e0 0x7f5db40af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.829+0000 7f5db37fe640 1 -- 172.21.15.44:0/2596217634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5db40add70 msgr2=0x7f5db40b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f5db37fe640 1 --2- 172.21.15.44:0/2596217634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5db40add70 0x7f5db40b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f5db37fe640 1 -- 172.21.15.44:0/2596217634 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da4009400 con 0x7f5db406d440 2023-11-04T01:36:18.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f5db2ffd640 1 --2- 172.21.15.44:0/2596217634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5db40add70 0x7f5db40b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:18.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7fc95d87c640 1 --2- 172.21.15.44:0/1244277429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9580b4880 0x7fc9580c5500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc95002c4a0 tx=0x7fc950004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f581d7f5640 1 -- 172.21.15.44:0/1632759104 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5818164bd0 con 0x7f58181ff200 2023-11-04T01:36:18.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f2346bff640 1 -- 172.21.15.44:0/2577130823 shutdown_connections 2023-11-04T01:36:18.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f03739e2640 1 Processor -- start 2023-11-04T01:36:18.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f581d7f5640 1 -- 172.21.15.44:0/1632759104 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5818202b40 con 0x7f58181ff200 2023-11-04T01:36:18.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f03739e2640 1 -- start start 2023-11-04T01:36:18.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f57ff7fe640 1 -- 172.21.15.44:0/1632759104 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581000ee70 con 0x7f58181ff200 2023-11-04T01:36:18.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f5db37fe640 1 --2- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5db406d440 0x7f5db420f940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5da800c400 tx=0x7f5da800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7fc94e7fc640 1 -- 172.21.15.44:0/1244277429 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95002cc40 con 0x7fc9580b4880 2023-11-04T01:36:18.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.831+0000 7fc94e7fc640 1 -- 172.21.15.44:0/1244277429 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95003f630 con 0x7fc9580b4880 2023-11-04T01:36:18.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.831+0000 7fc95fae0640 1 -- 172.21.15.44:0/1244277429 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc958156ba0 con 0x7fc9580b4880 2023-11-04T01:36:18.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.831+0000 7fc95fae0640 1 -- 172.21.15.44:0/1244277429 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9581f37c0 con 0x7fc9580b4880 2023-11-04T01:36:18.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.831+0000 7f5d9bfff640 1 -- 172.21.15.44:0/2596217634 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da80074e0 con 0x7f5db406d440 2023-11-04T01:36:18.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f737b7fe640 1 -- 172.21.15.44:0/980972114 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370031830 con 0x7f737c06e610 2023-11-04T01:36:18.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f737b7fe640 1 -- 172.21.15.44:0/980972114 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7370031990 con 0x7f737c06e610 2023-11-04T01:36:18.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f737b7fe640 1 -- 172.21.15.44:0/980972114 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370031d20 con 0x7f737c06e610 2023-11-04T01:36:18.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.831+0000 7fc94e7fc640 1 -- 172.21.15.44:0/1244277429 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95003f7a0 con 0x7fc9580b4880 2023-11-04T01:36:18.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.831+0000 7f57ff7fe640 1 -- 172.21.15.44:0/1632759104 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810013620 con 0x7f58181ff200 2023-11-04T01:36:18.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f581d7f5640 1 -- 172.21.15.44:0/1632759104 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57f8000fc0 con 0x7f58181ff200 2023-11-04T01:36:18.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.831+0000 7ff48cbd7640 1 Processor -- start 2023-11-04T01:36:18.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.831+0000 7ff48cbd7640 1 -- start start 2023-11-04T01:36:18.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.831+0000 7f5d9bfff640 1 -- 172.21.15.44:0/2596217634 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da8007640 con 0x7f5db406d440 2023-11-04T01:36:18.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f5d9bfff640 1 -- 172.21.15.44:0/2596217634 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da80074e0 con 0x7f5db406d440 2023-11-04T01:36:18.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f5db9b78640 1 -- 172.21.15.44:0/2596217634 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db40c61d0 con 0x7f5db406d440 2023-11-04T01:36:18.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.830+0000 7f2346bff640 1 --2- 172.21.15.44:0/2577130823 >> v2:172.21.15.44:3300/0 conn(0x7f23400cddc0 0x7f23400d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f2346bff640 1 --2- 172.21.15.44:0/2577130823 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23400b8780 0x7f23400cd880 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f2346bff640 1 -- 172.21.15.44:0/2577130823 >> 172.21.15.44:0/2577130823 conn(0x7f234006b4a0 msgr2=0x7f234006b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.831+0000 7fb939c10640 1 Processor -- start 2023-11-04T01:36:18.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.831+0000 7fb939c10640 1 -- start start 2023-11-04T01:36:18.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f03739e2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f036c0c8bd0 0x7f036c14bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f03739e2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f036c0c95b0 0x7f036c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f03739e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f036c159d80 0x7f036c0b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f03739e2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c14c1b0 con 0x7f036c159d80 2023-11-04T01:36:18.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f03739e2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c15b270 con 0x7f036c0c95b0 2023-11-04T01:36:18.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f03739e2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036c15a1f0 con 0x7f036c0c8bd0 2023-11-04T01:36:18.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7fc95fae0640 1 -- 172.21.15.44:0/1244277429 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc940000fc0 con 0x7fc9580b4880 2023-11-04T01:36:18.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7ff48cbd7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff470003970 0x7ff488148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7ff48cbd7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4880c72d0 0x7ff48815b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7ff48cbd7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4880c7750 0x7ff48815b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7ff48cbd7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880c5b50 con 0x7ff4880c72d0 2023-11-04T01:36:18.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7ff48cbd7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880c7cb0 con 0x7ff4880c7750 2023-11-04T01:36:18.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7ff48cbd7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880c7f90 con 0x7ff470003970 2023-11-04T01:36:18.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f0370f7d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f036c0c95b0 0x7f036c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f037177e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f036c0c8bd0 0x7f036c14bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f0370f7d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f036c0c95b0 0x7f036c0b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44264/0 (socket says 172.21.15.44:44264) 2023-11-04T01:36:18.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f0370f7d640 1 -- 172.21.15.44:0/2550953200 learned_addr learned my addr 172.21.15.44:0/2550953200 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:18.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f73819ed640 1 -- 172.21.15.44:0/980972114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f737c06e610 msgr2=0x7f737c0ae260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f73819ed640 1 --2- 172.21.15.44:0/980972114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f737c06e610 0x7f737c0ae260 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f737c06dbf0 tx=0x7f737002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7f73819ed640 1 -- 172.21.15.44:0/980972114 shutdown_connections 2023-11-04T01:36:18.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7f73819ed640 1 --2- 172.21.15.44:0/980972114 >> v2:172.21.15.204:3300/0 conn(0x7f737c0adc80 0x7f737c0ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7f73819ed640 1 --2- 172.21.15.44:0/980972114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f737c06e610 0x7f737c0ae260 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7f73819ed640 1 -- 172.21.15.44:0/980972114 >> 172.21.15.44:0/980972114 conn(0x7f737c06c780 msgr2=0x7f737c06cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f2346bff640 1 -- 172.21.15.44:0/2577130823 shutdown_connections 2023-11-04T01:36:18.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7ff48659c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff470003970 0x7ff488148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7ff486d9d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4880c7750 0x7ff48815b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7ff486d9d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4880c7750 0x7ff48815b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44268/0 (socket says 172.21.15.44:44268) 2023-11-04T01:36:18.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7ff486d9d640 1 -- 172.21.15.44:0/2304495098 learned_addr learned my addr 172.21.15.44:0/2304495098 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:18.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7f73819ed640 1 -- 172.21.15.44:0/980972114 shutdown_connections 2023-11-04T01:36:18.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7fb939c10640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb91c003970 0x7fb93413dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7f73819ed640 1 -- 172.21.15.44:0/980972114 wait complete. 2023-11-04T01:36:18.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7f0370f7d640 1 -- 172.21.15.44:0/2550953200 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f036c0c8bd0 msgr2=0x7f036c14bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7f0370f7d640 1 --2- 172.21.15.44:0/2550953200 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f036c0c8bd0 0x7f036c14bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7f0370f7d640 1 -- 172.21.15.44:0/2550953200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f036c159d80 msgr2=0x7f036c0b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7f0370f7d640 1 --2- 172.21.15.44:0/2550953200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f036c159d80 0x7f036c0b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7f0370f7d640 1 -- 172.21.15.44:0/2550953200 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0364009950 con 0x7f036c0c95b0 2023-11-04T01:36:18.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7fb939c10640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9340b15f0 0x7fb9340b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.832+0000 7f5db9b78640 1 -- 172.21.15.44:0/2596217634 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db40c6790 con 0x7f5db406d440 2023-11-04T01:36:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7fb9337fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb91c003970 0x7fb93413dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7fb9337fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb91c003970 0x7fb93413dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:60436/0 (socket says 172.21.15.44:60436) 2023-11-04T01:36:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7ff48659c640 1 -- 172.21.15.44:0/2304495098 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4880c7750 msgr2=0x7ff48815b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7ff48659c640 1 --2- 172.21.15.44:0/2304495098 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4880c7750 0x7ff48815b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7ff48659c640 1 -- 172.21.15.44:0/2304495098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4880c72d0 msgr2=0x7ff48815b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7ff48659c640 1 --2- 172.21.15.44:0/2304495098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4880c72d0 0x7ff48815b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7ff48659c640 1 -- 172.21.15.44:0/2304495098 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880c8270 con 0x7ff470003970 2023-11-04T01:36:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7f57ff7fe640 1 -- 172.21.15.44:0/1632759104 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5810013800 con 0x7f58181ff200 2023-11-04T01:36:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7fb932ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9340b15f0 0x7fb9340b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7fb932ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9340b15f0 0x7fb9340b30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48942/0 (socket says 172.21.15.44:48942) 2023-11-04T01:36:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7fb9337fe640 1 -- 172.21.15.44:0/4064304056 learned_addr learned my addr 172.21.15.44:0/4064304056 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:18.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7f0370f7d640 1 --2- 172.21.15.44:0/2550953200 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f036c0c95b0 0x7f036c0b0350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f036800c410 tx=0x7f036800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7fb939c10640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9340b3620 0x7fb934150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7f5d99ffb640 1 -- 172.21.15.44:0/2596217634 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5db4169f10 con 0x7f5db406d440 2023-11-04T01:36:18.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7fb939c10640 1 -- 172.21.15.44:0/4064304056 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340c5b40 con 0x7fb9340b15f0 2023-11-04T01:36:18.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7fb933fff640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9340b3620 0x7fb934150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7fb939c10640 1 -- 172.21.15.44:0/4064304056 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93413e240 con 0x7fb9340b3620 2023-11-04T01:36:18.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7fb939c10640 1 -- 172.21.15.44:0/4064304056 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340b3ff0 con 0x7fb91c003970 2023-11-04T01:36:18.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7ff48659c640 1 --2- 172.21.15.44:0/2304495098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff470003970 0x7ff488148610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff478031000 tx=0x7ff478001230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7f57ff7fe640 1 --2- 172.21.15.44:0/1632759104 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f580406ae70 0x7f580406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7f57ff7fe640 1 -- 172.21.15.44:0/1632759104 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f581008a040 con 0x7f58181ff200 2023-11-04T01:36:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7f57ff7fe640 1 --2- 172.21.15.44:0/1632759104 >> [v2:172.21.15.44:6800/1729035934,v1:172.21.15.44:6801/1729035934] conn(0x7f5804074340 0x7f5804076780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7f57ff7fe640 1 -- 172.21.15.44:0/1632759104 --> [v2:172.21.15.44:6800/1729035934,v1:172.21.15.44:6801/1729035934] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5804076e50 con 0x7f5804074340 2023-11-04T01:36:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7f57ff7fe640 1 -- 172.21.15.44:0/1632759104 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f581008c600 con 0x7f58181ff200 2023-11-04T01:36:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.833+0000 7f2346bff640 1 -- 172.21.15.44:0/2577130823 wait complete. 2023-11-04T01:36:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7f2346bff640 1 Processor -- start 2023-11-04T01:36:18.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7fc94e7fc640 1 -- 172.21.15.44:0/1244277429 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc95003f900 con 0x7fc9580b4880 2023-11-04T01:36:18.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7f58177fe640 1 --2- 172.21.15.44:0/1632759104 >> [v2:172.21.15.44:6800/1729035934,v1:172.21.15.44:6801/1729035934] conn(0x7f5804074340 0x7f5804076780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7f5816ffd640 1 --2- 172.21.15.44:0/1632759104 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f580406ae70 0x7f580406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7f0361ffb640 1 -- 172.21.15.44:0/2550953200 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03680035f0 con 0x7f036c0c95b0 2023-11-04T01:36:18.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7f03739e2640 1 -- 172.21.15.44:0/2550953200 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036c15a4b0 con 0x7f036c0c95b0 2023-11-04T01:36:18.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7f03739e2640 1 -- 172.21.15.44:0/2550953200 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036c15aa70 con 0x7f036c0c95b0 2023-11-04T01:36:18.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7f0361ffb640 1 -- 172.21.15.44:0/2550953200 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0368003750 con 0x7f036c0c95b0 2023-11-04T01:36:18.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7f0361ffb640 1 -- 172.21.15.44:0/2550953200 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368003b40 con 0x7f036c0c95b0 2023-11-04T01:36:18.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7fb9337fe640 1 -- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9340b3620 msgr2=0x7fb934150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7fb9337fe640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9340b3620 0x7fb934150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7fb9337fe640 1 -- 172.21.15.44:0/4064304056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9340b15f0 msgr2=0x7fb9340b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7f03739e2640 1 -- 172.21.15.44:0/2550953200 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f036c0cc950 con 0x7f036c0c95b0 2023-11-04T01:36:18.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7f73819ed640 1 Processor -- start 2023-11-04T01:36:18.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7f73819ed640 1 -- start start 2023-11-04T01:36:18.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7f2346bff640 1 -- start start 2023-11-04T01:36:18.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7fb9337fe640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9340b15f0 0x7fb9340b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7fb9337fe640 1 -- 172.21.15.44:0/4064304056 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9340b42d0 con 0x7fb91c003970 2023-11-04T01:36:18.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7fb932ffd640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9340b15f0 0x7fb9340b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:18.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7fc94e7fc640 1 --2- 172.21.15.44:0/1244277429 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc93c06ae70 0x7fc93c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7fc94e7fc640 1 -- 172.21.15.44:0/1244277429 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc9500acb70 con 0x7fc9580b4880 2023-11-04T01:36:18.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7fc94e7fc640 1 --2- 172.21.15.44:0/1244277429 >> [v2:172.21.15.44:6813/552281303,v1:172.21.15.44:6815/552281303] conn(0x7fc93c0744b0 0x7fc93c0768f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7f58177fe640 1 --2- 172.21.15.44:0/1632759104 >> [v2:172.21.15.44:6800/1729035934,v1:172.21.15.44:6801/1729035934] conn(0x7f5804074340 0x7f5804076780 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7ff476ffd640 1 -- 172.21.15.44:0/2304495098 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47803f680 con 0x7ff470003970 2023-11-04T01:36:18.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7ff476ffd640 1 -- 172.21.15.44:0/2304495098 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff478007280 con 0x7ff470003970 2023-11-04T01:36:18.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7fb9337fe640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb91c003970 0x7fb93413dd00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb92c007210 tx=0x7fb92c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7fb933fff640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9340b3620 0x7fb934150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:18.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7fb91bfff640 1 -- 172.21.15.44:0/4064304056 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c03e610 con 0x7fb91c003970 2023-11-04T01:36:18.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7fb91bfff640 1 -- 172.21.15.44:0/4064304056 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c007e60 con 0x7fb91c003970 2023-11-04T01:36:18.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7f2346bff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23400b8780 0x7f23401514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7fb939c10640 1 -- 172.21.15.44:0/4064304056 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9340c5d90 con 0x7fb91c003970 2023-11-04T01:36:18.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7fc94e7fc640 1 -- 172.21.15.44:0/1244277429 --> [v2:172.21.15.44:6813/552281303,v1:172.21.15.44:6815/552281303] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc93c076fc0 con 0x7fc93c0744b0 2023-11-04T01:36:18.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7fc94e7fc640 1 -- 172.21.15.44:0/1244277429 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9500acf20 con 0x7fc9580b4880 2023-11-04T01:36:18.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7f2346bff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23400cddc0 0x7f23400d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7fb939c10640 1 -- 172.21.15.44:0/4064304056 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93413e660 con 0x7fb91c003970 2023-11-04T01:36:18.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7ff476ffd640 1 -- 172.21.15.44:0/2304495098 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47803f9e0 con 0x7ff470003970 2023-11-04T01:36:18.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7f2346bff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f234015cd10 0x7f23400d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7f2345bfd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23400b8780 0x7f23401514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7f2345bfd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23400b8780 0x7f23401514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48958/0 (socket says 172.21.15.44:48958) 2023-11-04T01:36:18.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f5816ffd640 1 --2- 172.21.15.44:0/1632759104 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f580406ae70 0x7f580406d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5808036000 tx=0x7f5808031000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7f2345bfd640 1 -- 172.21.15.44:0/586674579 learned_addr learned my addr 172.21.15.44:0/586674579 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7fc95e07d640 1 --2- 172.21.15.44:0/1244277429 >> [v2:172.21.15.44:6813/552281303,v1:172.21.15.44:6815/552281303] conn(0x7fc93c0744b0 0x7fc93c0768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f57ff7fe640 1 -- 172.21.15.44:0/1632759104 <== osd.2 v2:172.21.15.44:6800/1729035934 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f5804076e50 con 0x7f5804074340 2023-11-04T01:36:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f73819ed640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f737c06e610 0x7f737c162910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f0361ffb640 1 -- 172.21.15.44:0/2550953200 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0368003ca0 con 0x7f036c0c95b0 2023-11-04T01:36:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7f2346bff640 1 -- 172.21.15.44:0/586674579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23401532a0 con 0x7f23400b8780 2023-11-04T01:36:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7f2346bff640 1 -- 172.21.15.44:0/586674579 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23400c87b0 con 0x7f23400cddc0 2023-11-04T01:36:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7f2346bff640 1 -- 172.21.15.44:0/586674579 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23401534b0 con 0x7f234015cd10 2023-11-04T01:36:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7f23463fe640 1 --2- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f234015cd10 0x7f23400d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f23453fc640 1 --2- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23400cddc0 0x7f23400d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7ff48cbd7640 1 -- 172.21.15.44:0/2304495098 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4880c8550 con 0x7ff470003970 2023-11-04T01:36:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7ff48cbd7640 1 -- 172.21.15.44:0/2304495098 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48814d2c0 con 0x7ff470003970 2023-11-04T01:36:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f73819ed640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f737c0adc80 0x7f737c164020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f73809eb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f737c06e610 0x7f737c162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.834+0000 7f5d9bfff640 1 -- 172.21.15.44:0/2596217634 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5da80047e0 con 0x7f5db406d440 2023-11-04T01:36:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.835+0000 7f5d9bfff640 1 --2- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5da006af30 0x7f5da006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7f5db2ffd640 1 --2- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5da006af30 0x7f5da006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7f5d9bfff640 1 -- 172.21.15.44:0/2596217634 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5da8057630 con 0x7f5db406d440 2023-11-04T01:36:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7f5d9bfff640 1 --2- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:6808/3863721351,v1:172.21.15.204:6809/3863721351] conn(0x7f5da00743f0 0x7f5da0076830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.836+0000 7f5d9bfff640 1 -- 172.21.15.44:0/2596217634 --> [v2:172.21.15.204:6808/3863721351,v1:172.21.15.204:6809/3863721351] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5da0076f00 con 0x7f5da00743f0 2023-11-04T01:36:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f5db3fff640 1 --2- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:6808/3863721351,v1:172.21.15.204:6809/3863721351] conn(0x7f5da00743f0 0x7f5da0076830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f5d9bfff640 1 -- 172.21.15.44:0/2596217634 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5da80074e0 con 0x7f5db406d440 2023-11-04T01:36:18.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f0361ffb640 1 --2- 172.21.15.44:0/2550953200 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0350073750 0x7f0350075c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f73809eb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f737c06e610 0x7f737c162910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44284/0 (socket says 172.21.15.44:44284) 2023-11-04T01:36:18.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f73809eb640 1 -- 172.21.15.44:0/3059702219 learned_addr learned my addr 172.21.15.44:0/3059702219 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:18.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f037177e640 1 --2- 172.21.15.44:0/2550953200 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0350073750 0x7f0350075c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7fc95d07b640 1 --2- 172.21.15.44:0/1244277429 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc93c06ae70 0x7fc93c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f737bfff640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f737c0adc80 0x7f737c164020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f73819ed640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f737c1611c0 0x7f737c154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7fb91bfff640 1 -- 172.21.15.44:0/4064304056 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c03e970 con 0x7fb91c003970 2023-11-04T01:36:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f0361ffb640 1 -- 172.21.15.44:0/2550953200 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0368089290 con 0x7f036c0c95b0 2023-11-04T01:36:18.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f73811ec640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f737c1611c0 0x7f737c154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7fc95e07d640 1 --2- 172.21.15.44:0/1244277429 >> [v2:172.21.15.44:6813/552281303,v1:172.21.15.44:6815/552281303] conn(0x7fc93c0744b0 0x7fc93c0768f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f73819ed640 1 -- 172.21.15.44:0/3059702219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c160260 con 0x7f737c1611c0 2023-11-04T01:36:18.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f5db3fff640 1 --2- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:6808/3863721351,v1:172.21.15.204:6809/3863721351] conn(0x7f5da00743f0 0x7f5da0076830 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f5db2ffd640 1 --2- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5da006af30 0x7f5da006d3f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5da4036000 tx=0x7f5da4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f037177e640 1 --2- 172.21.15.44:0/2550953200 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0350073750 0x7f0350075c10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0364037000 tx=0x7f0364031000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f73819ed640 1 -- 172.21.15.44:0/3059702219 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c155bf0 con 0x7f737c06e610 2023-11-04T01:36:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f73819ed640 1 -- 172.21.15.44:0/3059702219 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c1563c0 con 0x7f737c0adc80 2023-11-04T01:36:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f0361ffb640 1 --2- 172.21.15.44:0/2550953200 >> [v2:172.21.15.204:6818/2748716086,v1:172.21.15.204:6820/2748716086] conn(0x7f035007cd90 0x7f035007f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f0361ffb640 1 -- 172.21.15.44:0/2550953200 --> [v2:172.21.15.204:6818/2748716086,v1:172.21.15.204:6820/2748716086] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f035007f8a0 con 0x7f035007cd90 2023-11-04T01:36:18.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.839+0000 7ff48cbd7640 1 -- 172.21.15.44:0/2304495098 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff488159b50 con 0x7ff470003970 2023-11-04T01:36:18.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.839+0000 7f0371f7f640 1 --2- 172.21.15.44:0/2550953200 >> [v2:172.21.15.204:6818/2748716086,v1:172.21.15.204:6820/2748716086] conn(0x7f035007cd90 0x7f035007f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.839+0000 7f0361ffb640 1 -- 172.21.15.44:0/2550953200 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0368089640 con 0x7f036c0c95b0 2023-11-04T01:36:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.839+0000 7fb939c10640 1 -- 172.21.15.44:0/4064304056 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb934159b50 con 0x7fb91c003970 2023-11-04T01:36:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.839+0000 7f73811ec640 1 -- 172.21.15.44:0/3059702219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f737c0adc80 msgr2=0x7f737c164020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.839+0000 7f73811ec640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f737c0adc80 0x7f737c164020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.839+0000 7f73811ec640 1 -- 172.21.15.44:0/3059702219 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f737c06e610 msgr2=0x7f737c162910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.839+0000 7f73811ec640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f737c06e610 0x7f737c162910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.839+0000 7f73811ec640 1 -- 172.21.15.44:0/3059702219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7370009400 con 0x7f737c1611c0 2023-11-04T01:36:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.839+0000 7f5d9bfff640 1 -- 172.21.15.44:0/2596217634 <== osd.4 v2:172.21.15.204:6808/3863721351 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f5da0076f00 con 0x7f5da00743f0 2023-11-04T01:36:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.839+0000 7fb91bfff640 1 -- 172.21.15.44:0/4064304056 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb92c03b050 con 0x7fb91c003970 2023-11-04T01:36:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.839+0000 7fc95d07b640 1 --2- 172.21.15.44:0/1244277429 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc93c06ae70 0x7fc93c06d330 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc958071820 tx=0x7fc9480090e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.980 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.839+0000 7fc94e7fc640 1 -- 172.21.15.44:0/1244277429 <== osd.1 v2:172.21.15.44:6813/552281303 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fc93c076fc0 con 0x7fc93c0744b0 2023-11-04T01:36:18.980 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.839+0000 7f0371f7f640 1 --2- 172.21.15.44:0/2550953200 >> [v2:172.21.15.204:6818/2748716086,v1:172.21.15.204:6820/2748716086] conn(0x7f035007cd90 0x7f035007f1d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.839+0000 7f73811ec640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f737c1611c0 0x7f737c154a40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7374009f60 tx=0x7f7374009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f2345bfd640 1 -- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f234015cd10 msgr2=0x7f23400d1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f2345bfd640 1 --2- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f234015cd10 0x7f23400d1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f2345bfd640 1 -- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23400cddc0 msgr2=0x7f23400d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7f737bfff640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f737c0adc80 0x7f737c164020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:18.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f2345bfd640 1 --2- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23400cddc0 0x7f23400d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f2345bfd640 1 -- 172.21.15.44:0/586674579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2330009400 con 0x7f23400b8780 2023-11-04T01:36:18.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f23463fe640 1 --2- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f234015cd10 0x7f23400d1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:18.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.837+0000 7f2345bfd640 1 --2- 172.21.15.44:0/586674579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23400b8780 0x7f23401514f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f233c00c4d0 tx=0x7f233c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f23367fc640 1 -- 172.21.15.44:0/586674579 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c005ce0 con 0x7f23400b8780 2023-11-04T01:36:18.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f23367fc640 1 -- 172.21.15.44:0/586674579 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c005e40 con 0x7f23400b8780 2023-11-04T01:36:18.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.838+0000 7f23367fc640 1 -- 172.21.15.44:0/586674579 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c007270 con 0x7f23400b8780 2023-11-04T01:36:18.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7ff476ffd640 1 -- 172.21.15.44:0/2304495098 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff47803fb40 con 0x7ff470003970 2023-11-04T01:36:18.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7f73797fa640 1 -- 172.21.15.44:0/3059702219 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737400cc30 con 0x7f737c1611c0 2023-11-04T01:36:18.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7f2346bff640 1 -- 172.21.15.44:0/586674579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2340153790 con 0x7f23400b8780 2023-11-04T01:36:18.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7f73797fa640 1 -- 172.21.15.44:0/3059702219 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737400f040 con 0x7f737c1611c0 2023-11-04T01:36:18.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7fb91bfff640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb92006af40 0x7fb92006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7f73819ed640 1 -- 172.21.15.44:0/3059702219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c155760 con 0x7f737c1611c0 2023-11-04T01:36:18.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7fb91bfff640 1 -- 172.21.15.44:0/4064304056 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb92c0abb50 con 0x7fb91c003970 2023-11-04T01:36:18.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7f73819ed640 1 -- 172.21.15.44:0/3059702219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737c1560e0 con 0x7f737c1611c0 2023-11-04T01:36:18.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7fb932ffd640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb92006af40 0x7fb92006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7ff476ffd640 1 --2- 172.21.15.44:0/2304495098 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff46806aef0 0x7ff46806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7ff476ffd640 1 -- 172.21.15.44:0/2304495098 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff4780ab3b0 con 0x7ff470003970 2023-11-04T01:36:18.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7fb91bfff640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:6816/1835235423,v1:172.21.15.204:6817/1835235423] conn(0x7fb920074580 0x7fb9200769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7f0361ffb640 1 -- 172.21.15.44:0/2550953200 <== osd.5 v2:172.21.15.204:6818/2748716086 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f035007f8a0 con 0x7f035007cd90 2023-11-04T01:36:18.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.841+0000 7ff476ffd640 1 --2- 172.21.15.44:0/2304495098 >> [v2:172.21.15.44:6821/1819620447,v1:172.21.15.44:6823/1819620447] conn(0x7ff4680743c0 0x7ff468076800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.841+0000 7ff485d9b640 1 --2- 172.21.15.44:0/2304495098 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff46806aef0 0x7ff46806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.841+0000 7ff486d9d640 1 --2- 172.21.15.44:0/2304495098 >> [v2:172.21.15.44:6821/1819620447,v1:172.21.15.44:6823/1819620447] conn(0x7ff4680743c0 0x7ff468076800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7f2346bff640 1 -- 172.21.15.44:0/586674579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2340153d50 con 0x7f23400b8780 2023-11-04T01:36:18.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7fb91bfff640 1 -- 172.21.15.44:0/4064304056 --> [v2:172.21.15.204:6816/1835235423,v1:172.21.15.204:6817/1835235423] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb920077090 con 0x7fb920074580 2023-11-04T01:36:18.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.840+0000 7fb91bfff640 1 -- 172.21.15.44:0/4064304056 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb92c0b02a0 con 0x7fb91c003970 2023-11-04T01:36:18.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.841+0000 7fb933fff640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:6816/1835235423,v1:172.21.15.204:6817/1835235423] conn(0x7fb920074580 0x7fb9200769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.842+0000 7ff486d9d640 1 --2- 172.21.15.44:0/2304495098 >> [v2:172.21.15.44:6821/1819620447,v1:172.21.15.44:6823/1819620447] conn(0x7ff4680743c0 0x7ff468076800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.842+0000 7ff476ffd640 1 -- 172.21.15.44:0/2304495098 --> [v2:172.21.15.44:6821/1819620447,v1:172.21.15.44:6823/1819620447] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff468076ed0 con 0x7ff4680743c0 2023-11-04T01:36:18.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.842+0000 7ff476ffd640 1 -- 172.21.15.44:0/2304495098 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4780adac0 con 0x7ff470003970 2023-11-04T01:36:18.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.842+0000 7f23367fc640 1 -- 172.21.15.44:0/586674579 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f233c0073d0 con 0x7f23400b8780 2023-11-04T01:36:18.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.842+0000 7f2346bff640 1 -- 172.21.15.44:0/586674579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f23401612f0 con 0x7f23400b8780 2023-11-04T01:36:18.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.842+0000 7f23367fc640 1 --2- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f232406af40 0x7f232406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.843+0000 7f23367fc640 1 -- 172.21.15.44:0/586674579 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f233c088e30 con 0x7f23400b8780 2023-11-04T01:36:18.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.843+0000 7f23367fc640 1 --2- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:6800/1041839871,v1:172.21.15.204:6801/1041839871] conn(0x7f2324074580 0x7f23240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.843+0000 7f23367fc640 1 -- 172.21.15.44:0/586674579 --> [v2:172.21.15.204:6800/1041839871,v1:172.21.15.204:6801/1041839871] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2324077090 con 0x7f2324074580 2023-11-04T01:36:18.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.843+0000 7f23367fc640 1 -- 172.21.15.44:0/586674579 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f233c08e3e0 con 0x7f23400b8780 2023-11-04T01:36:18.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.843+0000 7f23453fc640 1 --2- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f232406af40 0x7f232406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.843+0000 7ff476ffd640 1 -- 172.21.15.44:0/2304495098 <== osd.3 v2:172.21.15.44:6821/1819620447 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7ff468076ed0 con 0x7ff4680743c0 2023-11-04T01:36:18.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.843+0000 7f23463fe640 1 --2- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:6800/1041839871,v1:172.21.15.204:6801/1041839871] conn(0x7f2324074580 0x7f23240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.842+0000 7fb933fff640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:6816/1835235423,v1:172.21.15.204:6817/1835235423] conn(0x7fb920074580 0x7fb9200769c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.843+0000 7fb91bfff640 1 -- 172.21.15.44:0/4064304056 <== osd.7 v2:172.21.15.204:6816/1835235423 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fb920077090 con 0x7fb920074580 2023-11-04T01:36:18.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.843+0000 7fb932ffd640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb92006af40 0x7fb92006d400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb9340c7cb0 tx=0x7fb928008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.844+0000 7f23453fc640 1 --2- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f232406af40 0x7f232406d400 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2330036000 tx=0x7f233003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.844+0000 7ff485d9b640 1 --2- 172.21.15.44:0/2304495098 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff46806aef0 0x7ff46806d3b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff480007fd0 tx=0x7ff4800018a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.844+0000 7f73797fa640 1 -- 172.21.15.44:0/3059702219 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7374003990 con 0x7f737c1611c0 2023-11-04T01:36:18.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.844+0000 7f73797fa640 1 -- 172.21.15.44:0/3059702219 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7374003bb0 con 0x7f737c1611c0 2023-11-04T01:36:18.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.844+0000 7f23463fe640 1 --2- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:6800/1041839871,v1:172.21.15.204:6801/1041839871] conn(0x7f2324074580 0x7f23240769c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.845+0000 7f73797fa640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f736806afc0 0x7f736806d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.845+0000 7f73819ed640 1 -- 172.21.15.44:0/3059702219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f735c000fc0 con 0x7f737c1611c0 2023-11-04T01:36:18.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.845+0000 7f23367fc640 1 -- 172.21.15.44:0/586674579 <== osd.6 v2:172.21.15.204:6800/1041839871 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f2324077090 con 0x7f2324074580 2023-11-04T01:36:18.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.845+0000 7f73809eb640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f736806afc0 0x7f736806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.846+0000 7f73797fa640 1 -- 172.21.15.44:0/3059702219 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7374089f50 con 0x7f737c1611c0 2023-11-04T01:36:18.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.846+0000 7f73809eb640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f736806afc0 0x7f736806d480 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f736c001700 tx=0x7f736c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.846+0000 7f73797fa640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.44:6808/1954602164,v1:172.21.15.44:6809/1954602164] conn(0x7f7368074490 0x7f73680768d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.846+0000 7f73797fa640 1 -- 172.21.15.44:0/3059702219 --> [v2:172.21.15.44:6808/1954602164,v1:172.21.15.44:6809/1954602164] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7368076fa0 con 0x7f7368074490 2023-11-04T01:36:18.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.846+0000 7f73797fa640 1 -- 172.21.15.44:0/3059702219 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f737408f430 con 0x7f737c1611c0 2023-11-04T01:36:18.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.847+0000 7f737bfff640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.44:6808/1954602164,v1:172.21.15.44:6809/1954602164] conn(0x7f7368074490 0x7f73680768d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.847+0000 7f737bfff640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.44:6808/1954602164,v1:172.21.15.44:6809/1954602164] conn(0x7f7368074490 0x7f73680768d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.849+0000 7f73797fa640 1 -- 172.21.15.44:0/3059702219 <== osd.0 v2:172.21.15.44:6808/1954602164 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f7368076fa0 con 0x7f7368074490 2023-11-04T01:36:18.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.872+0000 7f5d99ffb640 1 -- 172.21.15.44:0/2596217634 --> [v2:172.21.15.204:6808/3863721351,v1:172.21.15.204:6809/3863721351] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5db4074290 con 0x7f5da00743f0 2023-11-04T01:36:18.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.873+0000 7f5d9bfff640 1 -- 172.21.15.44:0/2596217634 <== osd.4 v2:172.21.15.204:6808/3863721351 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5db4074290 con 0x7f5da00743f0 2023-11-04T01:36:18.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.873+0000 7fc95fae0640 1 -- 172.21.15.44:0/1244277429 --> [v2:172.21.15.44:6813/552281303,v1:172.21.15.44:6815/552281303] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc940002cb0 con 0x7fc93c0744b0 2023-11-04T01:36:18.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.873+0000 7f5db9b78640 1 -- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:6808/3863721351,v1:172.21.15.204:6809/3863721351] conn(0x7f5da00743f0 msgr2=0x7f5da0076830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.873+0000 7f5db9b78640 1 --2- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:6808/3863721351,v1:172.21.15.204:6809/3863721351] conn(0x7f5da00743f0 0x7f5da0076830 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.873+0000 7f5db9b78640 1 -- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5da006af30 msgr2=0x7f5da006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.873+0000 7f5db9b78640 1 --2- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5da006af30 0x7f5da006d3f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5da4036000 tx=0x7f5da4008030 comp rx=0 tx=0).stop 2023-11-04T01:36:19.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.873+0000 7f5db9b78640 1 -- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5db406d440 msgr2=0x7f5db420f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.873+0000 7f5db9b78640 1 --2- 172.21.15.44:0/2596217634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5db406d440 0x7f5db420f940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5da800c400 tx=0x7f5da800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.874+0000 7f5db3fff640 1 -- 172.21.15.44:0/2596217634 reap_dead start 2023-11-04T01:36:19.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.874+0000 7f5db9b78640 1 -- 172.21.15.44:0/2596217634 shutdown_connections 2023-11-04T01:36:19.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.874+0000 7f5db9b78640 1 -- 172.21.15.44:0/2596217634 >> 172.21.15.44:0/2596217634 conn(0x7f5db406a120 msgr2=0x7f5db40cb450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.874+0000 7fc94e7fc640 1 -- 172.21.15.44:0/1244277429 <== osd.1 v2:172.21.15.44:6813/552281303 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc940002cb0 con 0x7fc93c0744b0 2023-11-04T01:36:19.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.874+0000 7f581d7f5640 1 -- 172.21.15.44:0/1632759104 --> [v2:172.21.15.44:6800/1729035934,v1:172.21.15.44:6801/1729035934] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f57f8002cb0 con 0x7f5804074340 2023-11-04T01:36:19.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.874+0000 7f03739e2640 1 -- 172.21.15.44:0/2550953200 --> [v2:172.21.15.204:6818/2748716086,v1:172.21.15.204:6820/2748716086] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f036c159580 con 0x7f035007cd90 2023-11-04T01:36:19.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.874+0000 7f5db9b78640 1 -- 172.21.15.44:0/2596217634 shutdown_connections 2023-11-04T01:36:19.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.874+0000 7f5db9b78640 1 -- 172.21.15.44:0/2596217634 wait complete. 2023-11-04T01:36:19.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.874+0000 7f57ff7fe640 1 -- 172.21.15.44:0/1632759104 <== osd.2 v2:172.21.15.44:6800/1729035934 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f57f8002cb0 con 0x7f5804074340 2023-11-04T01:36:19.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.875+0000 7fc93bfff640 1 -- 172.21.15.44:0/1244277429 >> [v2:172.21.15.44:6813/552281303,v1:172.21.15.44:6815/552281303] conn(0x7fc93c0744b0 msgr2=0x7fc93c0768f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.875+0000 7fc93bfff640 1 --2- 172.21.15.44:0/1244277429 >> [v2:172.21.15.44:6813/552281303,v1:172.21.15.44:6815/552281303] conn(0x7fc93c0744b0 0x7fc93c0768f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.875+0000 7fc93bfff640 1 -- 172.21.15.44:0/1244277429 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc93c06ae70 msgr2=0x7fc93c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.875+0000 7fc93bfff640 1 --2- 172.21.15.44:0/1244277429 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc93c06ae70 0x7fc93c06d330 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc958071820 tx=0x7fc9480090e0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.875+0000 7f0361ffb640 1 -- 172.21.15.44:0/2550953200 <== osd.5 v2:172.21.15.204:6818/2748716086 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f035c00d6d0 con 0x7f035007cd90 2023-11-04T01:36:19.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.875+0000 7fc93bfff640 1 -- 172.21.15.44:0/1244277429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9580b4880 msgr2=0x7fc9580c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.875+0000 7fc93bfff640 1 --2- 172.21.15.44:0/1244277429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9580b4880 0x7fc9580c5500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc95002c4a0 tx=0x7fc950004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:19.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.875+0000 7fc95e07d640 1 -- 172.21.15.44:0/1244277429 reap_dead start 2023-11-04T01:36:19.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.875+0000 7fc93bfff640 1 -- 172.21.15.44:0/1244277429 shutdown_connections 2023-11-04T01:36:19.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.875+0000 7fc93bfff640 1 -- 172.21.15.44:0/1244277429 >> 172.21.15.44:0/1244277429 conn(0x7fc9580cf880 msgr2=0x7fc9580d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.875+0000 7f03739e2640 1 -- 172.21.15.44:0/2550953200 >> [v2:172.21.15.204:6818/2748716086,v1:172.21.15.204:6820/2748716086] conn(0x7f035007cd90 msgr2=0x7f035007f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.875+0000 7fc93bfff640 1 -- 172.21.15.44:0/1244277429 shutdown_connections 2023-11-04T01:36:19.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.875+0000 7f03739e2640 1 --2- 172.21.15.44:0/2550953200 >> [v2:172.21.15.204:6818/2748716086,v1:172.21.15.204:6820/2748716086] conn(0x7f035007cd90 0x7f035007f1d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7fc93bfff640 1 -- 172.21.15.44:0/1244277429 wait complete. 2023-11-04T01:36:19.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f581d7f5640 1 -- 172.21.15.44:0/1632759104 >> [v2:172.21.15.44:6800/1729035934,v1:172.21.15.44:6801/1729035934] conn(0x7f5804074340 msgr2=0x7f5804076780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f581d7f5640 1 --2- 172.21.15.44:0/1632759104 >> [v2:172.21.15.44:6800/1729035934,v1:172.21.15.44:6801/1729035934] conn(0x7f5804074340 0x7f5804076780 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f581d7f5640 1 -- 172.21.15.44:0/1632759104 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f580406ae70 msgr2=0x7f580406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f581d7f5640 1 --2- 172.21.15.44:0/1632759104 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f580406ae70 0x7f580406d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5808036000 tx=0x7f5808031000 comp rx=0 tx=0).stop 2023-11-04T01:36:19.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f581d7f5640 1 -- 172.21.15.44:0/1632759104 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58181ff200 msgr2=0x7f581815e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f581d7f5640 1 --2- 172.21.15.44:0/1632759104 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58181ff200 0x7f581815e730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f581000e1e0 tx=0x7f581000e2d0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f03739e2640 1 -- 172.21.15.44:0/2550953200 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0350073750 msgr2=0x7f0350075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7ff48cbd7640 1 -- 172.21.15.44:0/2304495098 --> [v2:172.21.15.44:6821/1819620447,v1:172.21.15.44:6823/1819620447] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff488159870 con 0x7ff4680743c0 2023-11-04T01:36:19.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f58177fe640 1 -- 172.21.15.44:0/1632759104 reap_dead start 2023-11-04T01:36:19.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f03739e2640 1 --2- 172.21.15.44:0/2550953200 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0350073750 0x7f0350075c10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0364037000 tx=0x7f0364031000 comp rx=0 tx=0).stop 2023-11-04T01:36:19.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f03739e2640 1 -- 172.21.15.44:0/2550953200 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f036c0c95b0 msgr2=0x7f036c0b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f03739e2640 1 --2- 172.21.15.44:0/2550953200 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f036c0c95b0 0x7f036c0b0350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f036800c410 tx=0x7f036800c8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f0371f7f640 1 -- 172.21.15.44:0/2550953200 reap_dead start 2023-11-04T01:36:19.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f03739e2640 1 -- 172.21.15.44:0/2550953200 shutdown_connections 2023-11-04T01:36:19.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f03739e2640 1 -- 172.21.15.44:0/2550953200 >> 172.21.15.44:0/2550953200 conn(0x7f036c06c4c0 msgr2=0x7f036c0af770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f03739e2640 1 -- 172.21.15.44:0/2550953200 shutdown_connections 2023-11-04T01:36:19.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f03739e2640 1 -- 172.21.15.44:0/2550953200 wait complete. 2023-11-04T01:36:19.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f581d7f5640 1 -- 172.21.15.44:0/1632759104 shutdown_connections 2023-11-04T01:36:19.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.876+0000 7f581d7f5640 1 -- 172.21.15.44:0/1632759104 >> 172.21.15.44:0/1632759104 conn(0x7f581806a120 msgr2=0x7f581806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.877+0000 7f581d7f5640 1 -- 172.21.15.44:0/1632759104 shutdown_connections 2023-11-04T01:36:19.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.877+0000 7ff476ffd640 1 -- 172.21.15.44:0/2304495098 <== osd.3 v2:172.21.15.44:6821/1819620447 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff47c012040 con 0x7ff4680743c0 2023-11-04T01:36:19.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.877+0000 7f581d7f5640 1 -- 172.21.15.44:0/1632759104 wait complete. 2023-11-04T01:36:19.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.877+0000 7fb939c10640 1 -- 172.21.15.44:0/4064304056 --> [v2:172.21.15.204:6816/1835235423,v1:172.21.15.204:6817/1835235423] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb9340c62b0 con 0x7fb920074580 2023-11-04T01:36:19.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.877+0000 7ff48cbd7640 1 -- 172.21.15.44:0/2304495098 >> [v2:172.21.15.44:6821/1819620447,v1:172.21.15.44:6823/1819620447] conn(0x7ff4680743c0 msgr2=0x7ff468076800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.878+0000 7fb91bfff640 1 -- 172.21.15.44:0/4064304056 <== osd.7 v2:172.21.15.204:6816/1835235423 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb9340c62b0 con 0x7fb920074580 2023-11-04T01:36:19.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.877+0000 7ff48cbd7640 1 --2- 172.21.15.44:0/2304495098 >> [v2:172.21.15.44:6821/1819620447,v1:172.21.15.44:6823/1819620447] conn(0x7ff4680743c0 0x7ff468076800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.878+0000 7ff48cbd7640 1 -- 172.21.15.44:0/2304495098 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff46806aef0 msgr2=0x7ff46806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.878+0000 7ff48cbd7640 1 --2- 172.21.15.44:0/2304495098 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff46806aef0 0x7ff46806d3b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff480007fd0 tx=0x7ff4800018a0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.878+0000 7ff48cbd7640 1 -- 172.21.15.44:0/2304495098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff470003970 msgr2=0x7ff488148610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.878+0000 7f2346bff640 1 -- 172.21.15.44:0/586674579 --> [v2:172.21.15.204:6800/1041839871,v1:172.21.15.204:6801/1041839871] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2340153620 con 0x7f2324074580 2023-11-04T01:36:19.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.878+0000 7ff48cbd7640 1 --2- 172.21.15.44:0/2304495098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff470003970 0x7ff488148610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff478031000 tx=0x7ff478001230 comp rx=0 tx=0).stop 2023-11-04T01:36:19.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.878+0000 7ff486d9d640 1 -- 172.21.15.44:0/2304495098 reap_dead start 2023-11-04T01:36:19.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.878+0000 7ff48cbd7640 1 -- 172.21.15.44:0/2304495098 shutdown_connections 2023-11-04T01:36:19.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.878+0000 7ff48cbd7640 1 -- 172.21.15.44:0/2304495098 >> 172.21.15.44:0/2304495098 conn(0x7ff48806a120 msgr2=0x7ff48806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.878+0000 7fb939c10640 1 -- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:6816/1835235423,v1:172.21.15.204:6817/1835235423] conn(0x7fb920074580 msgr2=0x7fb9200769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.878+0000 7fb939c10640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:6816/1835235423,v1:172.21.15.204:6817/1835235423] conn(0x7fb920074580 0x7fb9200769c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.878+0000 7f23367fc640 1 -- 172.21.15.44:0/586674579 <== osd.6 v2:172.21.15.204:6800/1041839871 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2340153620 con 0x7f2324074580 2023-11-04T01:36:19.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.878+0000 7fb939c10640 1 -- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb92006af40 msgr2=0x7fb92006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7fb939c10640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb92006af40 0x7fb92006d400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb9340c7cb0 tx=0x7fb928008040 comp rx=0 tx=0).stop 2023-11-04T01:36:19.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.878+0000 7ff48cbd7640 1 -- 172.21.15.44:0/2304495098 shutdown_connections 2023-11-04T01:36:19.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7fb939c10640 1 -- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb91c003970 msgr2=0x7fb93413dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7fb939c10640 1 --2- 172.21.15.44:0/4064304056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb91c003970 0x7fb93413dd00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb92c007210 tx=0x7fb92c004ab0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7fb933fff640 1 -- 172.21.15.44:0/4064304056 reap_dead start 2023-11-04T01:36:19.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7fb939c10640 1 -- 172.21.15.44:0/4064304056 shutdown_connections 2023-11-04T01:36:19.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7fb939c10640 1 -- 172.21.15.44:0/4064304056 >> 172.21.15.44:0/4064304056 conn(0x7fb93406a120 msgr2=0x7fb934070610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7fb939c10640 1 -- 172.21.15.44:0/4064304056 shutdown_connections 2023-11-04T01:36:19.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7fb939c10640 1 -- 172.21.15.44:0/4064304056 wait complete. 2023-11-04T01:36:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7ff48cbd7640 1 -- 172.21.15.44:0/2304495098 wait complete. 2023-11-04T01:36:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7f2346bff640 1 -- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:6800/1041839871,v1:172.21.15.204:6801/1041839871] conn(0x7f2324074580 msgr2=0x7f23240769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7f2346bff640 1 --2- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:6800/1041839871,v1:172.21.15.204:6801/1041839871] conn(0x7f2324074580 0x7f23240769c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7f2346bff640 1 -- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f232406af40 msgr2=0x7f232406d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7f2346bff640 1 --2- 172.21.15.44:0/586674579 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f232406af40 0x7f232406d400 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2330036000 tx=0x7f233003c040 comp rx=0 tx=0).stop 2023-11-04T01:36:19.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7f2346bff640 1 -- 172.21.15.44:0/586674579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23400b8780 msgr2=0x7f23401514f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7f2346bff640 1 --2- 172.21.15.44:0/586674579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23400b8780 0x7f23401514f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f233c00c4d0 tx=0x7f233c00c990 comp rx=0 tx=0).stop 2023-11-04T01:36:19.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.879+0000 7f23463fe640 1 -- 172.21.15.44:0/586674579 reap_dead start 2023-11-04T01:36:19.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.880+0000 7f2346bff640 1 -- 172.21.15.44:0/586674579 shutdown_connections 2023-11-04T01:36:19.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.880+0000 7f2346bff640 1 -- 172.21.15.44:0/586674579 >> 172.21.15.44:0/586674579 conn(0x7f234006b4a0 msgr2=0x7f234015e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.880+0000 7f2346bff640 1 -- 172.21.15.44:0/586674579 shutdown_connections 2023-11-04T01:36:19.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.880+0000 7f2346bff640 1 -- 172.21.15.44:0/586674579 wait complete. 2023-11-04T01:36:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.880+0000 7f73819ed640 1 -- 172.21.15.44:0/3059702219 --> [v2:172.21.15.44:6808/1954602164,v1:172.21.15.44:6809/1954602164] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f735c002cb0 con 0x7f7368074490 2023-11-04T01:36:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.881+0000 7f73797fa640 1 -- 172.21.15.44:0/3059702219 <== osd.0 v2:172.21.15.44:6808/1954602164 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f735c002cb0 con 0x7f7368074490 2023-11-04T01:36:19.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.882+0000 7f73819ed640 1 -- 172.21.15.44:0/3059702219 >> [v2:172.21.15.44:6808/1954602164,v1:172.21.15.44:6809/1954602164] conn(0x7f7368074490 msgr2=0x7f73680768d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.882+0000 7f73819ed640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.44:6808/1954602164,v1:172.21.15.44:6809/1954602164] conn(0x7f7368074490 0x7f73680768d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.883+0000 7f73819ed640 1 -- 172.21.15.44:0/3059702219 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f736806afc0 msgr2=0x7f736806d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.883+0000 7f73819ed640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f736806afc0 0x7f736806d480 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f736c001700 tx=0x7f736c009040 comp rx=0 tx=0).stop 2023-11-04T01:36:19.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.883+0000 7f73819ed640 1 -- 172.21.15.44:0/3059702219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f737c1611c0 msgr2=0x7f737c154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.883+0000 7f73819ed640 1 --2- 172.21.15.44:0/3059702219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f737c1611c0 0x7f737c154a40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7374009f60 tx=0x7f7374009f90 comp rx=0 tx=0).stop 2023-11-04T01:36:19.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.883+0000 7f73811ec640 1 -- 172.21.15.44:0/3059702219 reap_dead start 2023-11-04T01:36:19.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.884+0000 7f73819ed640 1 -- 172.21.15.44:0/3059702219 shutdown_connections 2023-11-04T01:36:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.884+0000 7f73819ed640 1 -- 172.21.15.44:0/3059702219 >> 172.21.15.44:0/3059702219 conn(0x7f737c06c780 msgr2=0x7f737c0aea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.884+0000 7f73819ed640 1 -- 172.21.15.44:0/3059702219 shutdown_connections 2023-11-04T01:36:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:18.884+0000 7f73819ed640 1 -- 172.21.15.44:0/3059702219 wait complete. 2023-11-04T01:36:19.039 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2023-11-04T01:36:19.040 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-04T01:36:19.041 INFO:teuthology.orchestra.run.smithi044.stdout:55834574857 2023-11-04T01:36:19.042 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T01:36:19.042 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2023-11-04T01:36:19.043 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2023-11-04T01:36:19.043 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-04T01:36:19.043 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T01:36:19.044 INFO:teuthology.orchestra.run.smithi044.stdout:55834574857 2023-11-04T01:36:19.045 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-04T01:36:19.046 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2023-11-04T01:36:19.047 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-04T01:36:19.047 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2023-11-04T01:36:19.048 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T01:36:19.048 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2023-11-04T01:36:19.049 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T01:36:19.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.265+0000 7f26a1d3c640 1 Processor -- start 2023-11-04T01:36:19.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.265+0000 7f26a1d3c640 1 -- start start 2023-11-04T01:36:19.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.266+0000 7fa081947640 1 Processor -- start 2023-11-04T01:36:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.266+0000 7f26a1d3c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26940564f0 0x7f26940543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.266+0000 7f26a1d3c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f26940e4b00 0x7f26940388a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.266+0000 7f26a1d3c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2694056b60 con 0x7f26940e4720 2023-11-04T01:36:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.266+0000 7f26a1d3c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26940362b0 con 0x7f26940e4b00 2023-11-04T01:36:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.266+0000 7f26a1d3c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2694036550 con 0x7f26940564f0 2023-11-04T01:36:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.266+0000 7f1a8a49e640 1 Processor -- start 2023-11-04T01:36:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.266+0000 7f1a8a49e640 1 -- start start 2023-11-04T01:36:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7f26a153b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f26940e4b00 0x7f26940388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7f26a153b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f26940e4b00 0x7f26940388a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44298/0 (socket says 172.21.15.44:44298) 2023-11-04T01:36:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7f26a153b640 1 -- 172.21.15.44:0/1847337794 learned_addr learned my addr 172.21.15.44:0/1847337794 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7f269bfff640 1 --2- 172.21.15.44:0/1847337794 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26940564f0 0x7f26940543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.266+0000 7fa081947640 1 -- start start 2023-11-04T01:36:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7fa081947640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa07c0cedd0 0x7fa07c0c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7fa081947640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c15d3c0 con 0x7fa07c158eb0 2023-11-04T01:36:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7fa081947640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c15d6a0 con 0x7fa07c158ad0 2023-11-04T01:36:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7fa081947640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07c0c90b0 con 0x7fa07c0cedd0 2023-11-04T01:36:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7fa07bfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa07c158eb0 0x7fa07c0ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36410/0 (socket says 172.21.15.44:36410) 2023-11-04T01:36:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7fa07bfff640 1 -- 172.21.15.44:0/3463257470 learned_addr learned my addr 172.21.15.44:0/3463257470 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7fa07b7fe640 1 -- 172.21.15.44:0/3463257470 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904701307 0 0) 0x7fa07c15d3c0 con 0x7fa07c158eb0 2023-11-04T01:36:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7f26a153b640 1 -- 172.21.15.44:0/1847337794 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26940564f0 msgr2=0x7f26940543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7f26a153b640 1 --2- 172.21.15.44:0/1847337794 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26940564f0 0x7f26940543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7f26a153b640 1 -- 172.21.15.44:0/1847337794 >> v1:172.21.15.204:6789/0 conn(0x7f26940e4720 legacy=0x7f2694055de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7f26a153b640 1 -- 172.21.15.44:0/1847337794 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269403c7b0 con 0x7f26940e4b00 2023-11-04T01:36:19.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7fa07b7fe640 1 -- 172.21.15.44:0/3463257470 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa064003db0 con 0x7fa07c158eb0 2023-11-04T01:36:19.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7fa07b7fe640 1 -- 172.21.15.44:0/3463257470 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 149024536 0 0) 0x7fa064003db0 con 0x7fa07c158eb0 2023-11-04T01:36:19.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7fa081146640 1 --2- 172.21.15.44:0/3463257470 >> v2:172.21.15.204:3300/0 conn(0x7fa07c0cedd0 0x7fa07c0c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7fa07b7fe640 1 -- 172.21.15.44:0/3463257470 >> v2:172.21.15.204:3300/0 conn(0x7fa07c0cedd0 msgr2=0x7fa07c0c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7fa07b7fe640 1 --2- 172.21.15.44:0/3463257470 >> v2:172.21.15.204:3300/0 conn(0x7fa07c0cedd0 0x7fa07c0c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7fa07b7fe640 1 -- 172.21.15.44:0/3463257470 >> v1:172.21.15.204:6789/0 conn(0x7fa07c158ad0 legacy=0x7fa07c15c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7f26a153b640 1 --2- 172.21.15.44:0/1847337794 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26940e4b00 0x7f26940388a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f26940513f0 tx=0x7f269002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e6827a29666cf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7fa07b7fe640 1 -- 172.21.15.44:0/3463257470 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c0c92c0 con 0x7fa07c158eb0 2023-11-04T01:36:19.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7fa07b7fe640 1 -- 172.21.15.44:0/3463257470 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fa0740019f0 con 0x7fa07c158eb0 2023-11-04T01:36:19.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7f269b7fe640 1 -- 172.21.15.44:0/1847337794 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26900317c0 con 0x7f26940e4b00 2023-11-04T01:36:19.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7fa07b7fe640 1 -- 172.21.15.44:0/3463257470 >> v1:172.21.15.44:6789/0 conn(0x7fa07c158eb0 legacy=0x7fa07c0ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7f1a8a49e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1a840af760 0x7f1a840b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7f1a8a49e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1a840ade70 0x7f1a841696d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7f1a8a49e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a840b21c0 0x7f1a8406df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7f1a8a49e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a840b0490 con 0x7f1a840af760 2023-11-04T01:36:19.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7f1a8a49e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a840afed0 con 0x7f1a840ade70 2023-11-04T01:36:19.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7f269b7fe640 1 -- 172.21.15.44:0/1847337794 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2690031920 con 0x7f26940e4b00 2023-11-04T01:36:19.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7f269b7fe640 1 -- 172.21.15.44:0/1847337794 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690031cf0 con 0x7f26940e4b00 2023-11-04T01:36:19.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7fa07b7fe640 1 --2- 172.21.15.44:0/3463257470 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa064004200 0x7fa0640045e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7fa07b7fe640 1 --2- 172.21.15.44:0/3463257470 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa064005050 0x7fa0640054d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7fa07b7fe640 1 --2- 172.21.15.44:0/3463257470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa064005a60 0x7fa06400c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.270+0000 7f9d198e0640 1 Processor -- start 2023-11-04T01:36:19.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.270+0000 7fa07bfff640 1 --2- 172.21.15.44:0/3463257470 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa064005050 0x7fa0640054d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.267+0000 7f1a8a49e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840b01b0 con 0x7f1a840b21c0 2023-11-04T01:36:19.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.270+0000 7fa081146640 1 --2- 172.21.15.44:0/3463257470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa064005a60 0x7fa06400c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.270+0000 7fa07b7fe640 1 -- 172.21.15.44:0/3463257470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0c90b0 con 0x7fa064005a60 2023-11-04T01:36:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7f1a88c9b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1a840ade70 0x7f1a841696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7f1a88c9b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1a840ade70 0x7f1a841696d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44304/0 (socket says 172.21.15.44:44304) 2023-11-04T01:36:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7f1a88c9b640 1 -- 172.21.15.44:0/3985291916 learned_addr learned my addr 172.21.15.44:0/3985291916 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7f1a8949c640 1 --2- 172.21.15.44:0/3985291916 >> v2:172.21.15.44:3300/0 conn(0x7f1a840af760 0x7f1a840b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7f1a88c9b640 1 -- 172.21.15.44:0/3985291916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a840b21c0 msgr2=0x7f1a8406df00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7f1a88c9b640 1 --2- 172.21.15.44:0/3985291916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a840b21c0 0x7f1a8406df00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7f1a88c9b640 1 -- 172.21.15.44:0/3985291916 >> v2:172.21.15.44:3300/0 conn(0x7f1a840af760 msgr2=0x7f1a840b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7f1a88c9b640 1 --2- 172.21.15.44:0/3985291916 >> v2:172.21.15.44:3300/0 conn(0x7f1a840af760 0x7f1a840b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.268+0000 7f1a88c9b640 1 -- 172.21.15.44:0/3985291916 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a84070640 con 0x7f1a840ade70 2023-11-04T01:36:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7f1a8949c640 1 --2- 172.21.15.44:0/3985291916 >> v2:172.21.15.44:3300/0 conn(0x7f1a840af760 0x7f1a840b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.269+0000 7f1a88c9b640 1 --2- 172.21.15.44:0/3985291916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a840ade70 0x7f1a841696d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a840afe00 tx=0x7f1a7c02bfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c54406cf55293fab server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.270+0000 7f1a7bfff640 1 -- 172.21.15.44:0/3985291916 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c02cb40 con 0x7f1a840ade70 2023-11-04T01:36:19.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.270+0000 7fa07b7fe640 1 -- 172.21.15.44:0/3463257470 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06400c990 con 0x7fa064004200 2023-11-04T01:36:19.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.270+0000 7fa07b7fe640 1 -- 172.21.15.44:0/3463257470 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06400cb50 con 0x7fa064005050 2023-11-04T01:36:19.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.270+0000 7f1a7bfff640 1 -- 172.21.15.44:0/3985291916 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c02cca0 con 0x7f1a840ade70 2023-11-04T01:36:19.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.270+0000 7f26a1d3c640 1 -- 172.21.15.44:0/1847337794 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26940e4b00 msgr2=0x7f26940388a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.270+0000 7f26a1d3c640 1 --2- 172.21.15.44:0/1847337794 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26940e4b00 0x7f26940388a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f26940513f0 tx=0x7f269002b860 comp rx=0 tx=0).stop 2023-11-04T01:36:19.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f26a1d3c640 1 -- 172.21.15.44:0/1847337794 shutdown_connections 2023-11-04T01:36:19.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f26a1d3c640 1 --2- 172.21.15.44:0/1847337794 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26940e4b00 0x7f26940388a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7fa080945640 1 --2- 172.21.15.44:0/3463257470 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa064004200 0x7fa0640045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f26a1d3c640 1 --2- 172.21.15.44:0/1847337794 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26940564f0 0x7f26940543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7fa081146640 1 -- 172.21.15.44:0/3463257470 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa064005050 msgr2=0x7fa0640054d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7fa081146640 1 --2- 172.21.15.44:0/3463257470 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa064005050 0x7fa0640054d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f26a1d3c640 1 -- 172.21.15.44:0/1847337794 >> 172.21.15.44:0/1847337794 conn(0x7f26940538a0 msgr2=0x7f2694053cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f3d64bd5640 1 Processor -- start 2023-11-04T01:36:19.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7fa081146640 1 -- 172.21.15.44:0/3463257470 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa064004200 msgr2=0x7fa0640045e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f26a1d3c640 1 -- 172.21.15.44:0/1847337794 shutdown_connections 2023-11-04T01:36:19.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7fa081146640 1 --2- 172.21.15.44:0/3463257470 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa064004200 0x7fa0640045e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7fa081146640 1 -- 172.21.15.44:0/3463257470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa064003db0 con 0x7fa064005a60 2023-11-04T01:36:19.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f1a7bfff640 1 -- 172.21.15.44:0/3985291916 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c034610 con 0x7f1a840ade70 2023-11-04T01:36:19.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.270+0000 7f9d198e0640 1 -- start start 2023-11-04T01:36:19.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f3d64bd5640 1 -- start start 2023-11-04T01:36:19.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f9d198e0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9d14158c50 0x7f9d140ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7fa080945640 1 --2- 172.21.15.44:0/3463257470 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa064004200 0x7fa0640045e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:19.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f9c9681a640 1 Processor -- start 2023-11-04T01:36:19.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f9d198e0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d1406d290 0x7f9d140ade00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f9d198e0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d140b13f0 con 0x7f9d140b0380 2023-11-04T01:36:19.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f9d198e0640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d140b0870 con 0x7f9d14158c50 2023-11-04T01:36:19.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f9d198e0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140b0b50 con 0x7f9d1406d290 2023-11-04T01:36:19.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f9d12ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9d14158c50 0x7f9d140ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f9d12ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9d14158c50 0x7f9d140ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48994/0 (socket says 172.21.15.44:48994) 2023-11-04T01:36:19.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f9d12ffd640 1 -- 172.21.15.44:0/1451558695 learned_addr learned my addr 172.21.15.44:0/1451558695 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:19.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.272+0000 7f9d127fc640 1 --2- 172.21.15.44:0/1451558695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d1406d290 0x7f9d140ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.272+0000 7f1a8a49e640 1 -- 172.21.15.44:0/3985291916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a840ade70 msgr2=0x7f1a841696d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.272+0000 7f1a8a49e640 1 --2- 172.21.15.44:0/3985291916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a840ade70 0x7f1a841696d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a840afe00 tx=0x7f1a7c02bfa0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.272+0000 7f9d127fc640 1 -- 172.21.15.44:0/1451558695 >> v2:172.21.15.44:3300/0 conn(0x7f9d14158c50 msgr2=0x7f9d140ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.272+0000 7f9d127fc640 1 --2- 172.21.15.44:0/1451558695 >> v2:172.21.15.44:3300/0 conn(0x7f9d14158c50 0x7f9d140ad8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.272+0000 7f9d127fc640 1 -- 172.21.15.44:0/1451558695 >> v1:172.21.15.44:6789/0 conn(0x7f9d140b0380 legacy=0x7f9d140cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.272+0000 7f9d127fc640 1 -- 172.21.15.44:0/1451558695 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d140b0e30 con 0x7f9d1406d290 2023-11-04T01:36:19.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.272+0000 7f9d11ffb640 1 -- 172.21.15.44:0/1451558695 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592370247 0 0) 0x7f9d140b13f0 con 0x7f9d140b0380 2023-11-04T01:36:19.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.272+0000 7fa081146640 1 --2- 172.21.15.44:0/3463257470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa064005a60 0x7fa06400c210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa07000ba30 tx=0x7fa064006080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6dcf953cfb58d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.272+0000 7fa081146640 1 -- 172.21.15.44:0/3463257470 reap_dead start 2023-11-04T01:36:19.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7f1e0ad1d640 1 Processor -- start 2023-11-04T01:36:19.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7f1e0ad1d640 1 -- start start 2023-11-04T01:36:19.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7fa07b7fe640 1 -- 172.21.15.44:0/3463257470 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070030680 con 0x7fa064005a60 2023-11-04T01:36:19.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7f3d64bd5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3d58054420 0x7f3d58056d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7f9c9681a640 1 -- start start 2023-11-04T01:36:19.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7fa07b7fe640 1 -- 172.21.15.44:0/3463257470 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0700307e0 con 0x7fa064005a60 2023-11-04T01:36:19.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7f3d64bd5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d58057260 0x7f3d5803c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.271+0000 7f26a1d3c640 1 -- 172.21.15.44:0/1847337794 wait complete. 2023-11-04T01:36:19.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7f3d64bd5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d580548b0 con 0x7f3d580e34d0 2023-11-04T01:36:19.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7f26a1d3c640 1 Processor -- start 2023-11-04T01:36:19.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7f3d5e59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3d580e34d0 0x7f3d580582f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36422/0 (socket says 172.21.15.44:36422) 2023-11-04T01:36:19.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7f3d5e59c640 1 -- 172.21.15.44:0/4049479486 learned_addr learned my addr 172.21.15.44:0/4049479486 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:19.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7f3d5ed9d640 1 --2- 172.21.15.44:0/4049479486 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d58057260 0x7f3d5803c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7f9d127fc640 1 --2- 172.21.15.44:0/1451558695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d1406d290 0x7f9d140ade00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009dc0 tx=0x7f9d0c02be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa90b1df58db8541 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7f3d64bd5640 1 -- 172.21.15.44:0/4049479486 --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d58058e00 con 0x7f3d58054420 2023-11-04T01:36:19.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f3d64bd5640 1 -- 172.21.15.44:0/4049479486 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d58057bc0 con 0x7f3d58057260 2023-11-04T01:36:19.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7fa07b7fe640 1 -- 172.21.15.44:0/3463257470 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070030b90 con 0x7fa064005a60 2023-11-04T01:36:19.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7fa081947640 1 -- 172.21.15.44:0/3463257470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa064005a60 msgr2=0x7fa06400c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7fa081947640 1 --2- 172.21.15.44:0/3463257470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa064005a60 0x7fa06400c210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa07000ba30 tx=0x7fa064006080 comp rx=0 tx=0).stop 2023-11-04T01:36:19.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f1e0ad1d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1e041603d0 0x7f1e040b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7fa081947640 1 -- 172.21.15.44:0/3463257470 shutdown_connections 2023-11-04T01:36:19.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7fa081947640 1 --2- 172.21.15.44:0/3463257470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa064005a60 0x7fa06400c210 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7fa081947640 1 -- 172.21.15.44:0/3463257470 >> 172.21.15.44:0/3463257470 conn(0x7fa07c06a120 msgr2=0x7fa07c06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f1e0ad1d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e040cdf80 con 0x7f1e040722a0 2023-11-04T01:36:19.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f1e0ad1d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e040ce6f0 con 0x7f1e0406a830 2023-11-04T01:36:19.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f3d5d59a640 1 -- 172.21.15.44:0/4049479486 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486437755 0 0) 0x7f3d580548b0 con 0x7f3d580e34d0 2023-11-04T01:36:19.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f1e0ad1d640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e040b19d0 con 0x7f1e041603d0 2023-11-04T01:36:19.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f3d5d59a640 1 -- 172.21.15.44:0/4049479486 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d48003520 con 0x7f3d580e34d0 2023-11-04T01:36:19.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f9d11ffb640 1 -- 172.21.15.44:0/1451558695 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c02cbb0 con 0x7f9d1406d290 2023-11-04T01:36:19.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f9d11ffb640 1 -- 172.21.15.44:0/1451558695 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c02cd10 con 0x7f9d1406d290 2023-11-04T01:36:19.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f9d11ffb640 1 -- 172.21.15.44:0/1451558695 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c034660 con 0x7f9d1406d290 2023-11-04T01:36:19.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.273+0000 7f26a1d3c640 1 -- start start 2023-11-04T01:36:19.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f9c9681a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c90153e60 0x7f9c9015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f1a8a49e640 1 -- 172.21.15.44:0/3985291916 shutdown_connections 2023-11-04T01:36:19.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f1a8a49e640 1 --2- 172.21.15.44:0/3985291916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a840b21c0 0x7f1a8406df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f1a8a49e640 1 --2- 172.21.15.44:0/3985291916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a840ade70 0x7f1a841696d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f1a8a49e640 1 --2- 172.21.15.44:0/3985291916 >> v2:172.21.15.44:3300/0 conn(0x7f1a840af760 0x7f1a840b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f1a8a49e640 1 -- 172.21.15.44:0/3985291916 >> 172.21.15.44:0/3985291916 conn(0x7f1a8406c780 msgr2=0x7f1a8406cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f3d5dd9b640 1 --2- 172.21.15.44:0/4049479486 >> v2:172.21.15.44:3300/0 conn(0x7f3d58054420 0x7f3d58056d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f3d5ed9d640 1 -- 172.21.15.44:0/4049479486 >> v2:172.21.15.44:3300/0 conn(0x7f3d58054420 msgr2=0x7f3d58056d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f3d5ed9d640 1 --2- 172.21.15.44:0/4049479486 >> v2:172.21.15.44:3300/0 conn(0x7f3d58054420 0x7f3d58056d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f3d5ed9d640 1 -- 172.21.15.44:0/4049479486 >> v1:172.21.15.44:6789/0 conn(0x7f3d580e34d0 legacy=0x7f3d580582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f3d5ed9d640 1 -- 172.21.15.44:0/4049479486 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d58057ea0 con 0x7f3d58057260 2023-11-04T01:36:19.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f26a1d3c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26940564f0 0x7f26940d6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f1e092ba640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f1e0406a830 0x7f1e040ca380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:46874/0 (socket says 172.21.15.44:46874) 2023-11-04T01:36:19.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f1e092ba640 1 -- 172.21.15.44:0/3572330367 learned_addr learned my addr 172.21.15.44:0/3572330367 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:19.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f1e08ab9640 1 --2- 172.21.15.44:0/3572330367 >> v2:172.21.15.44:3300/0 conn(0x7f1e041603d0 0x7f1e040b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7fa081947640 1 -- 172.21.15.44:0/3463257470 shutdown_connections 2023-11-04T01:36:19.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f9c9681a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9c900cd6d0 0x7f9c90161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f9c9681a640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c900cde60 con 0x7f9c900b4880 2023-11-04T01:36:19.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f9c9681a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c90160f90 con 0x7f9c900cd6d0 2023-11-04T01:36:19.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7fa081947640 1 -- 172.21.15.44:0/3463257470 wait complete. 2023-11-04T01:36:19.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f9c9681a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9015e400 con 0x7f9c90153e60 2023-11-04T01:36:19.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f9c8ffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c90153e60 0x7f9c9015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f9c94db7640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9c900b4880 0x7f9c9006b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36436/0 (socket says 172.21.15.44:36436) 2023-11-04T01:36:19.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.274+0000 7f9c94db7640 1 -- 172.21.15.44:0/496934471 learned_addr learned my addr 172.21.15.44:0/496934471 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:19.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f9c8f7fe640 1 --2- 172.21.15.44:0/496934471 >> v2:172.21.15.204:3300/0 conn(0x7f9c900cd6d0 0x7f9c90161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f26a1d3c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26940e4720 0x7f26940502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281824672 0 0) 0x7f1e040ce6f0 con 0x7f1e0406a830 2023-11-04T01:36:19.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df0003520 con 0x7f1e0406a830 2023-11-04T01:36:19.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f1a8a49e640 1 -- 172.21.15.44:0/3985291916 shutdown_connections 2023-11-04T01:36:19.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f26a0d3a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26940564f0 0x7f26940d6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f049dd4c640 1 Processor -- start 2023-11-04T01:36:19.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f26a0d3a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26940564f0 0x7f26940d6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:60512/0 (socket says 172.21.15.44:60512) 2023-11-04T01:36:19.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f26a0d3a640 1 -- 172.21.15.44:0/511066805 learned_addr learned my addr 172.21.15.44:0/511066805 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:19.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735320394 0 0) 0x7f1e040cdf80 con 0x7f1e040722a0 2023-11-04T01:36:19.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df0003840 con 0x7f1e040722a0 2023-11-04T01:36:19.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3327473276 0 0) 0x7f1df0003520 con 0x7f1e0406a830 2023-11-04T01:36:19.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f9c8effd640 1 -- 172.21.15.44:0/496934471 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402395002 0 0) 0x7f9c900cde60 con 0x7f9c900b4880 2023-11-04T01:36:19.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f9c8effd640 1 -- 172.21.15.44:0/496934471 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c7c003520 con 0x7f9c900b4880 2023-11-04T01:36:19.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f9c8ffff640 1 -- 172.21.15.44:0/496934471 >> v2:172.21.15.204:3300/0 conn(0x7f9c900cd6d0 msgr2=0x7f9c90161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f9c8ffff640 1 --2- 172.21.15.44:0/496934471 >> v2:172.21.15.204:3300/0 conn(0x7f9c900cd6d0 0x7f9c90161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f9c8ffff640 1 -- 172.21.15.44:0/496934471 >> v1:172.21.15.44:6789/0 conn(0x7f9c900b4880 legacy=0x7f9c9006b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 >> v2:172.21.15.44:3300/0 conn(0x7f1e041603d0 msgr2=0x7f1e040b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f1e037fe640 1 --2- 172.21.15.44:0/3572330367 >> v2:172.21.15.44:3300/0 conn(0x7f1e041603d0 0x7f1e040b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 >> v1:172.21.15.44:6789/0 conn(0x7f1e040722a0 legacy=0x7f1e0406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f9c8ffff640 1 -- 172.21.15.44:0/496934471 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c90161960 con 0x7f9c90153e60 2023-11-04T01:36:19.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f9d198e0640 1 -- 172.21.15.44:0/1451558695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d1406d290 msgr2=0x7f9d140ade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f9d198e0640 1 --2- 172.21.15.44:0/1451558695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d1406d290 0x7f9d140ade00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009dc0 tx=0x7f9d0c02be00 comp rx=0 tx=0).stop 2023-11-04T01:36:19.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f9d198e0640 1 -- 172.21.15.44:0/1451558695 shutdown_connections 2023-11-04T01:36:19.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f9d198e0640 1 --2- 172.21.15.44:0/1451558695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d1406d290 0x7f9d140ade00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f049dd4c640 1 -- start start 2023-11-04T01:36:19.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f269bfff640 1 --2- 172.21.15.44:0/511066805 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26940e4720 0x7f26940502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f9d198e0640 1 --2- 172.21.15.44:0/1451558695 >> v2:172.21.15.44:3300/0 conn(0x7f9d14158c50 0x7f9d140ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f9d198e0640 1 -- 172.21.15.44:0/1451558695 >> 172.21.15.44:0/1451558695 conn(0x7f9d1406c7a0 msgr2=0x7f9d1406cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.275+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 --> v1:172.21.15.204:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e04072700 con 0x7f1e0406a830 2023-11-04T01:36:19.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 <== mon.1 v1:172.21.15.204:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f1df40019d0 con 0x7f1e0406a830 2023-11-04T01:36:19.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 >> v1:172.21.15.204:6789/0 conn(0x7f1e0406a830 legacy=0x7f1e040ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f1e037fe640 1 --2- 172.21.15.44:0/3572330367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1df0003cb0 0x7f1df00040f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f1e037fe640 1 --2- 172.21.15.44:0/3572330367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1df00047c0 0x7f1df0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f1e037fe640 1 --2- 172.21.15.44:0/3572330367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1df0005300 0x7f1df0014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df0014a20 con 0x7f1df0005300 2023-11-04T01:36:19.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df0014b90 con 0x7f1df0003cb0 2023-11-04T01:36:19.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df0014d50 con 0x7f1df00047c0 2023-11-04T01:36:19.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f1a8a49e640 1 -- 172.21.15.44:0/3985291916 wait complete. 2023-11-04T01:36:19.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f26a1d3c640 1 --2- 172.21.15.44:0/511066805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26940e4b00 0x7f26940f69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f9d198e0640 1 -- 172.21.15.44:0/1451558695 shutdown_connections 2023-11-04T01:36:19.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f9d198e0640 1 -- 172.21.15.44:0/1451558695 wait complete. 2023-11-04T01:36:19.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f1e03fff640 1 --2- 172.21.15.44:0/3572330367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1df00047c0 0x7f1df0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f26a1d3c640 1 -- 172.21.15.44:0/511066805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26940d7520 con 0x7f26940e4b00 2023-11-04T01:36:19.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f26a1d3c640 1 -- 172.21.15.44:0/511066805 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269404d4a0 con 0x7f26940e4720 2023-11-04T01:36:19.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f26a1d3c640 1 -- 172.21.15.44:0/511066805 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269404cee0 con 0x7f26940564f0 2023-11-04T01:36:19.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f26a153b640 1 --2- 172.21.15.44:0/511066805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26940e4b00 0x7f26940f69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f1e03fff640 1 -- 172.21.15.44:0/3572330367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1df0003cb0 msgr2=0x7f1df00040f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:19.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f1e03fff640 1 --2- 172.21.15.44:0/3572330367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1df0003cb0 0x7f1df00040f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f1e03fff640 1 -- 172.21.15.44:0/3572330367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1df0005300 msgr2=0x7f1df0014190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:19.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f1e03fff640 1 --2- 172.21.15.44:0/3572330367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1df0005300 0x7f1df0014190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f1e03fff640 1 -- 172.21.15.44:0/3572330367 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e04072700 con 0x7f1df00047c0 2023-11-04T01:36:19.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f049dd4c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f04900e3300 0x7f049003e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f049dd4c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04900e7400 0x7f0490057b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f049dd4c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04900573a0 con 0x7f049003ed20 2023-11-04T01:36:19.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f049dd4c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049003bff0 con 0x7f04900e7400 2023-11-04T01:36:19.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f049dd4c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0490057680 con 0x7f04900e3300 2023-11-04T01:36:19.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f26a153b640 1 -- 172.21.15.44:0/511066805 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26940564f0 msgr2=0x7f26940d6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f26a153b640 1 --2- 172.21.15.44:0/511066805 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26940564f0 0x7f26940d6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f26a153b640 1 -- 172.21.15.44:0/511066805 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26940e4720 msgr2=0x7f26940502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f26a153b640 1 --2- 172.21.15.44:0/511066805 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26940e4720 0x7f26940502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.276+0000 7f26a153b640 1 -- 172.21.15.44:0/511066805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26900094d0 con 0x7f26940e4b00 2023-11-04T01:36:19.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7fa081947640 1 Processor -- start 2023-11-04T01:36:19.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f1e092ba640 1 -- 172.21.15.44:0/3572330367 reap_dead start 2023-11-04T01:36:19.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f1e08ab9640 1 --2- 172.21.15.44:0/3572330367 >> v2:172.21.15.44:3300/0 conn(0x7f1e041603d0 0x7f1e040b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f04977fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f04900e3300 0x7f049003e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f04977fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f04900e3300 0x7f049003e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44336/0 (socket says 172.21.15.44:44336) 2023-11-04T01:36:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f04977fe640 1 -- 172.21.15.44:0/3936296034 learned_addr learned my addr 172.21.15.44:0/3936296034 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f0496ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f049003ed20 0x7f04900e6cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36440/0 (socket says 172.21.15.44:36440) 2023-11-04T01:36:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f0497fff640 1 --2- 172.21.15.44:0/3936296034 >> v2:172.21.15.44:3300/0 conn(0x7f04900e7400 0x7f0490057b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f04977fe640 1 -- 172.21.15.44:0/3936296034 >> v2:172.21.15.44:3300/0 conn(0x7f04900e7400 msgr2=0x7f0490057b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f04977fe640 1 --2- 172.21.15.44:0/3936296034 >> v2:172.21.15.44:3300/0 conn(0x7f04900e7400 0x7f0490057b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f04977fe640 1 -- 172.21.15.44:0/3936296034 >> v1:172.21.15.44:6789/0 conn(0x7f049003ed20 legacy=0x7f04900e6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f04977fe640 1 -- 172.21.15.44:0/3936296034 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04900073b0 con 0x7f04900e3300 2023-11-04T01:36:19.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f1a8a49e640 1 Processor -- start 2023-11-04T01:36:19.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f26a153b640 1 --2- 172.21.15.44:0/511066805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26940e4b00 0x7f26940f69f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2690033000 tx=0x7f26900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7f1a8a49e640 1 -- start start 2023-11-04T01:36:19.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7f3d5ed9d640 1 --2- 172.21.15.44:0/4049479486 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d58057260 0x7f3d5803c2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3d60064180 tx=0x7f3d600a6050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c2f00d1f3037a54 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.277+0000 7fa081947640 1 -- start start 2023-11-04T01:36:19.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7f9d198e0640 1 Processor -- start 2023-11-04T01:36:19.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7f26997fa640 1 -- 172.21.15.44:0/511066805 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690032650 con 0x7f26940e4b00 2023-11-04T01:36:19.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7f26997fa640 1 -- 172.21.15.44:0/511066805 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26900327b0 con 0x7f26940e4b00 2023-11-04T01:36:19.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7f26997fa640 1 -- 172.21.15.44:0/511066805 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690032b60 con 0x7f26940e4b00 2023-11-04T01:36:19.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7f26a1d3c640 1 -- 172.21.15.44:0/511066805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269404d1c0 con 0x7f26940e4b00 2023-11-04T01:36:19.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7f9c8ffff640 1 --2- 172.21.15.44:0/496934471 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c90153e60 0x7f9c9015dec0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009d90 tx=0x7f9c8802bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa3dac4cc501af6d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7f9d198e0640 1 -- start start 2023-11-04T01:36:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7f9c8effd640 1 -- 172.21.15.44:0/496934471 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8802cc90 con 0x7f9c90153e60 2023-11-04T01:36:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7f9c8effd640 1 -- 172.21.15.44:0/496934471 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8802cdf0 con 0x7f9c90153e60 2023-11-04T01:36:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7fa081947640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa064005a60 0x7fa07c0a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7f9c8effd640 1 -- 172.21.15.44:0/496934471 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8802cc90 con 0x7f9c90153e60 2023-11-04T01:36:19.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7f1e03fff640 1 --2- 172.21.15.44:0/3572330367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1df00047c0 0x7f1df0004c40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0018f0 tx=0x7f1df00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28db73bf1baadf6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7f3d5d59a640 1 -- 172.21.15.44:0/4049479486 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600a6cb0 con 0x7f3d58057260 2023-11-04T01:36:19.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7f3d5d59a640 1 -- 172.21.15.44:0/4049479486 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d600a6e50 con 0x7f3d58057260 2023-11-04T01:36:19.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7f3d5d59a640 1 -- 172.21.15.44:0/4049479486 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600ae640 con 0x7f3d58057260 2023-11-04T01:36:19.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.278+0000 7fa081947640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa07c0c5800 0x7fa07c2031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7fa081947640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa07c1feda0 0x7fa07c1ff220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7fa081947640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0a94a0 con 0x7fa064005a60 2023-11-04T01:36:19.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7fa080945640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa064005a60 0x7fa07c0a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7fa080945640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa064005a60 0x7fa07c0a8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49026/0 (socket says 172.21.15.44:49026) 2023-11-04T01:36:19.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7fa080945640 1 -- 172.21.15.44:0/422817319 learned_addr learned my addr 172.21.15.44:0/422817319 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:19.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7fa081947640 1 -- 172.21.15.44:0/422817319 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0c6b80 con 0x7fa07c1feda0 2023-11-04T01:36:19.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7fa081947640 1 -- 172.21.15.44:0/422817319 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0c5f70 con 0x7fa07c0c5800 2023-11-04T01:36:19.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f04977fe640 1 --2- 172.21.15.44:0/3936296034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04900e3300 0x7f049003e7e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f049000f890 tx=0x7f048c02ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b96a294d6bd56448 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f1a8a49e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a840ade70 0x7f1a8416b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f1a8a49e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a840b21c0 0x7f1a84160e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f1a8a49e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a841663c0 0x7f1a841f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f1a8a49e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8416d070 con 0x7f1a841663c0 2023-11-04T01:36:19.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f1a8a49e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a84161750 con 0x7f1a840ade70 2023-11-04T01:36:19.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f1a8a49e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8416b710 con 0x7f1a840b21c0 2023-11-04T01:36:19.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec02e070 con 0x7f1df00047c0 2023-11-04T01:36:19.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec0050d0 con 0x7f1df00047c0 2023-11-04T01:36:19.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f1e037fe640 1 -- 172.21.15.44:0/3572330367 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec0035f0 con 0x7f1df00047c0 2023-11-04T01:36:19.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f1a8949c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a840ade70 0x7f1a8416b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7fa081146640 1 --2- 172.21.15.44:0/422817319 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa07c1feda0 0x7fa07c1ff220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f9c9681a640 1 -- 172.21.15.44:0/496934471 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c90153e60 msgr2=0x7f9c9015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f9c9681a640 1 --2- 172.21.15.44:0/496934471 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c90153e60 0x7f9c9015dec0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009d90 tx=0x7f9c8802bee0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f1a88c9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a840b21c0 0x7f1a84160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f9d198e0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d1406d290 0x7f9d1413ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f9d198e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d140b0380 0x7f9d14154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f9c9681a640 1 -- 172.21.15.44:0/496934471 shutdown_connections 2023-11-04T01:36:19.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f9c9681a640 1 --2- 172.21.15.44:0/496934471 >> v2:172.21.15.204:3300/0 conn(0x7f9c900cd6d0 0x7f9c90161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f9c9681a640 1 --2- 172.21.15.44:0/496934471 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c90153e60 0x7f9c9015dec0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f9c9681a640 1 -- 172.21.15.44:0/496934471 >> 172.21.15.44:0/496934471 conn(0x7f9c900cf880 msgr2=0x7f9c900cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f9d12ffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d1406d290 0x7f9d1413ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f9d12ffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d1406d290 0x7f9d1413ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44378/0 (socket says 172.21.15.44:44378) 2023-11-04T01:36:19.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f9d12ffd640 1 -- 172.21.15.44:0/1808186515 learned_addr learned my addr 172.21.15.44:0/1808186515 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:19.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7fa081146640 1 -- 172.21.15.44:0/422817319 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa07c0c5800 msgr2=0x7fa07c2031b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-04T01:36:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7fa081146640 1 --2- 172.21.15.44:0/422817319 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa07c0c5800 0x7fa07c2031b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7fa081146640 1 -- 172.21.15.44:0/422817319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa064005a60 msgr2=0x7fa07c0a8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7fa081146640 1 --2- 172.21.15.44:0/422817319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa064005a60 0x7fa07c0a8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7fa081146640 1 -- 172.21.15.44:0/422817319 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c0c6250 con 0x7fa07c1feda0 2023-11-04T01:36:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f9d198e0640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d14158c50 0x7f9d14147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f9d198e0640 1 -- 172.21.15.44:0/1808186515 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d141495a0 con 0x7f9d140b0380 2023-11-04T01:36:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f9d198e0640 1 -- 172.21.15.44:0/1808186515 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140c95b0 con 0x7f9d1406d290 2023-11-04T01:36:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f9d198e0640 1 -- 172.21.15.44:0/1808186515 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140cc190 con 0x7f9d14158c50 2023-11-04T01:36:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f9d127fc640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d140b0380 0x7f9d14154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f1a8949c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a840ade70 0x7f1a8416b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44364/0 (socket says 172.21.15.44:44364) 2023-11-04T01:36:19.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f1a8949c640 1 -- 172.21.15.44:0/3238257473 learned_addr learned my addr 172.21.15.44:0/3238257473 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:19.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f9c9681a640 1 -- 172.21.15.44:0/496934471 shutdown_connections 2023-11-04T01:36:19.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3572330367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1df00047c0 msgr2=0x7f1df0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7fa081146640 1 --2- 172.21.15.44:0/422817319 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa07c1feda0 0x7fa07c1ff220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0caad0 tx=0x7fa070004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f9c9681a640 1 -- 172.21.15.44:0/496934471 wait complete. 2023-11-04T01:36:19.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f9d137fe640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d14158c50 0x7f9d14147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f1e0ad1d640 1 --2- 172.21.15.44:0/3572330367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1df00047c0 0x7f1df0004c40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0018f0 tx=0x7f1df00057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3572330367 shutdown_connections 2023-11-04T01:36:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f3d64bd5640 1 -- 172.21.15.44:0/4049479486 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d58057260 msgr2=0x7f3d5803c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f3d64bd5640 1 --2- 172.21.15.44:0/4049479486 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d58057260 0x7f3d5803c2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3d60064180 tx=0x7f3d600a6050 comp rx=0 tx=0).stop 2023-11-04T01:36:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f3d64bd5640 1 -- 172.21.15.44:0/4049479486 shutdown_connections 2023-11-04T01:36:19.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f3d64bd5640 1 --2- 172.21.15.44:0/4049479486 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d58057260 0x7f3d5803c2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f3d64bd5640 1 --2- 172.21.15.44:0/4049479486 >> v2:172.21.15.44:3300/0 conn(0x7f3d58054420 0x7f3d58056d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f3d64bd5640 1 -- 172.21.15.44:0/4049479486 >> 172.21.15.44:0/4049479486 conn(0x7f3d58059150 msgr2=0x7f3d58059560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f3d64bd5640 1 -- 172.21.15.44:0/4049479486 shutdown_connections 2023-11-04T01:36:19.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f3d64bd5640 1 -- 172.21.15.44:0/4049479486 wait complete. 2023-11-04T01:36:19.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f1e0ad1d640 1 --2- 172.21.15.44:0/3572330367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1df00047c0 0x7f1df0004c40 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0018f0 tx=0x7f1df00057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3572330367 >> 172.21.15.44:0/3572330367 conn(0x7f1e0406d800 msgr2=0x7f1e0406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.279+0000 7f26a1d3c640 1 -- 172.21.15.44:0/511066805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269404fdd0 con 0x7f26940e4b00 2023-11-04T01:36:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f26997fa640 1 -- 172.21.15.44:0/511066805 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2690043070 con 0x7f26940e4b00 2023-11-04T01:36:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f1a89c9d640 1 --2- 172.21.15.44:0/3238257473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a841663c0 0x7f1a841f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f1a88c9b640 1 -- 172.21.15.44:0/3238257473 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a840ade70 msgr2=0x7f1a8416b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f1a88c9b640 1 --2- 172.21.15.44:0/3238257473 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a840ade70 0x7f1a8416b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f1a88c9b640 1 -- 172.21.15.44:0/3238257473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a841663c0 msgr2=0x7f1a841f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f1a88c9b640 1 --2- 172.21.15.44:0/3238257473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a841663c0 0x7f1a841f3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f1a88c9b640 1 -- 172.21.15.44:0/3238257473 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c009b30 con 0x7f1a840b21c0 2023-11-04T01:36:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f04967fc640 1 -- 172.21.15.44:0/3936296034 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c02f850 con 0x7f04900e3300 2023-11-04T01:36:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f04967fc640 1 -- 172.21.15.44:0/3936296034 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048c02f9b0 con 0x7f04900e3300 2023-11-04T01:36:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.280+0000 7f04967fc640 1 -- 172.21.15.44:0/3936296034 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c02fd40 con 0x7f04900e3300 2023-11-04T01:36:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3572330367 shutdown_connections 2023-11-04T01:36:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f1a88c9b640 1 --2- 172.21.15.44:0/3238257473 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a840b21c0 0x7f1a84160e20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c032000 tx=0x7f1a7c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f1a79ffb640 1 -- 172.21.15.44:0/3238257473 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c03e450 con 0x7f1a840b21c0 2023-11-04T01:36:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f1a79ffb640 1 -- 172.21.15.44:0/3238257473 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c03e5b0 con 0x7f1a840b21c0 2023-11-04T01:36:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f1a8a49e640 1 -- 172.21.15.44:0/3238257473 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a84202f20 con 0x7f1a840b21c0 2023-11-04T01:36:19.346 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f26997fa640 1 --2- 172.21.15.44:0/511066805 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f268006ae70 0x7f268006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.346 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f26997fa640 1 -- 172.21.15.44:0/511066805 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f26900ab250 con 0x7f26940e4b00 2023-11-04T01:36:19.346 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f26a0d3a640 1 --2- 172.21.15.44:0/511066805 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f268006ae70 0x7f268006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.346 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f2686ffd640 1 -- 172.21.15.44:0/511066805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269404f930 con 0x7f26940e4b00 2023-11-04T01:36:19.346 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f1a79ffb640 1 -- 172.21.15.44:0/3238257473 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c03e960 con 0x7f1a840b21c0 2023-11-04T01:36:19.346 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f1a8a49e640 1 -- 172.21.15.44:0/3238257473 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a842034e0 con 0x7f1a840b21c0 2023-11-04T01:36:19.347 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f049dd4c640 1 -- 172.21.15.44:0/3936296034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04900e3300 msgr2=0x7f049003e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.347 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f049dd4c640 1 --2- 172.21.15.44:0/3936296034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04900e3300 0x7f049003e7e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f049000f890 tx=0x7f048c02ba30 comp rx=0 tx=0).stop 2023-11-04T01:36:19.347 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.282+0000 7f049dd4c640 1 -- 172.21.15.44:0/3936296034 shutdown_connections 2023-11-04T01:36:19.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.282+0000 7f049dd4c640 1 --2- 172.21.15.44:0/3936296034 >> v2:172.21.15.44:3300/0 conn(0x7f04900e7400 0x7f0490057b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.282+0000 7f049dd4c640 1 --2- 172.21.15.44:0/3936296034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04900e3300 0x7f049003e7e0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f049000f890 tx=0x7f048c02ba30 comp rx=0 tx=0).stop 2023-11-04T01:36:19.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.282+0000 7f049dd4c640 1 -- 172.21.15.44:0/3936296034 >> 172.21.15.44:0/3936296034 conn(0x7f049003aa70 msgr2=0x7f049003ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f9d137fe640 1 -- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d1406d290 msgr2=0x7f9d1413ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f9d137fe640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d1406d290 0x7f9d1413ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.282+0000 7f9c9681a640 1 Processor -- start 2023-11-04T01:36:19.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f9d137fe640 1 -- 172.21.15.44:0/1808186515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d140b0380 msgr2=0x7f9d14154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f9d137fe640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d140b0380 0x7f9d14154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f9d137fe640 1 -- 172.21.15.44:0/1808186515 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c009a70 con 0x7f9d14158c50 2023-11-04T01:36:19.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.282+0000 7fa0797fa640 1 -- 172.21.15.44:0/422817319 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07003f070 con 0x7fa07c1feda0 2023-11-04T01:36:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.282+0000 7f9d127fc640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d140b0380 0x7f9d14154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.282+0000 7f9d12ffd640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d1406d290 0x7f9d1413ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.282+0000 7fa0797fa640 1 -- 172.21.15.44:0/422817319 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa070030cc0 con 0x7fa07c1feda0 2023-11-04T01:36:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.282+0000 7fa081947640 1 -- 172.21.15.44:0/422817319 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07c0c6530 con 0x7fa07c1feda0 2023-11-04T01:36:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.282+0000 7f3d64bd5640 1 Processor -- start 2023-11-04T01:36:19.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.282+0000 7f9c9681a640 1 -- start start 2023-11-04T01:36:19.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.283+0000 7fa081947640 1 -- 172.21.15.44:0/422817319 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07c0c5c80 con 0x7fa07c1feda0 2023-11-04T01:36:19.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.283+0000 7fa0797fa640 1 -- 172.21.15.44:0/422817319 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07003a650 con 0x7fa07c1feda0 2023-11-04T01:36:19.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.283+0000 7f9c9681a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c900b4880 0x7f9c90150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.283+0000 7f9c9681a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c900cd6d0 0x7f9c900d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.283+0000 7f9c9681a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c90153e60 0x7f9c900d3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.283+0000 7f9c9681a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c900cbc40 con 0x7f9c900b4880 2023-11-04T01:36:19.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.283+0000 7f9c9681a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90150a60 con 0x7f9c900cd6d0 2023-11-04T01:36:19.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.283+0000 7f9c9681a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c900cafc0 con 0x7f9c90153e60 2023-11-04T01:36:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.282+0000 7f3d64bd5640 1 -- start start 2023-11-04T01:36:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.283+0000 7f3d64bd5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d58054420 0x7f3d580d7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9c94db7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c90153e60 0x7f9c900d3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9c94db7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c90153e60 0x7f9c900d3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:60564/0 (socket says 172.21.15.44:60564) 2023-11-04T01:36:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9c94db7640 1 -- 172.21.15.44:0/2774005107 learned_addr learned my addr 172.21.15.44:0/2774005107 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:19.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f049dd4c640 1 -- 172.21.15.44:0/3936296034 shutdown_connections 2023-11-04T01:36:19.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9c8f7fe640 1 --2- 172.21.15.44:0/2774005107 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c900cd6d0 0x7f9c900d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9d137fe640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d14158c50 0x7f9d14147cf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800c3e0 tx=0x7f9d0800c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7fa0797fa640 1 -- 172.21.15.44:0/422817319 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa070043070 con 0x7fa07c1feda0 2023-11-04T01:36:19.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f1a6f7fe640 1 -- 172.21.15.44:0/3238257473 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a84161920 con 0x7f1a840b21c0 2023-11-04T01:36:19.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9c8ffff640 1 --2- 172.21.15.44:0/2774005107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c900b4880 0x7f9c90150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f3d5e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d58054420 0x7f3d580d7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9c8f7fe640 1 -- 172.21.15.44:0/2774005107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c90153e60 msgr2=0x7f9c900d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9c8f7fe640 1 --2- 172.21.15.44:0/2774005107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c90153e60 0x7f9c900d3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9c8f7fe640 1 -- 172.21.15.44:0/2774005107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c900b4880 msgr2=0x7f9c90150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9c8f7fe640 1 --2- 172.21.15.44:0/2774005107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c900b4880 0x7f9c90150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9c8f7fe640 1 -- 172.21.15.44:0/2774005107 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c88009a70 con 0x7f9c900cd6d0 2023-11-04T01:36:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7f3d5e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d58054420 0x7f3d580d7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49054/0 (socket says 172.21.15.44:49054) 2023-11-04T01:36:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f1a79ffb640 1 -- 172.21.15.44:0/3238257473 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a7c03eac0 con 0x7f1a840b21c0 2023-11-04T01:36:19.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7f3d5e59c640 1 -- 172.21.15.44:0/2835245650 learned_addr learned my addr 172.21.15.44:0/2835245650 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:19.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7f3d64bd5640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d58057260 0x7f3d580e4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7f3d64bd5640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d580e34d0 0x7f3d580e5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7f1a79ffb640 1 --2- 172.21.15.44:0/3238257473 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a6806af40 0x7f1a6806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7f3d5dd9b640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d58057260 0x7f3d580e4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7fa081947640 1 -- 172.21.15.44:0/422817319 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07c04ece0 con 0x7fa07c1feda0 2023-11-04T01:36:19.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7fa0797fa640 1 --2- 172.21.15.44:0/422817319 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa06806aeb0 0x7fa06806d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7fa0797fa640 1 -- 172.21.15.44:0/422817319 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa0700ab3c0 con 0x7fa07c1feda0 2023-11-04T01:36:19.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7f9c8f7fe640 1 --2- 172.21.15.44:0/2774005107 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c900cd6d0 0x7f9c900d2de0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000e820 tx=0x7f9c8000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9cfbfff640 1 -- 172.21.15.44:0/1808186515 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d080035f0 con 0x7f9d14158c50 2023-11-04T01:36:19.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7f1a79ffb640 1 -- 172.21.15.44:0/3238257473 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a7c0ac590 con 0x7f1a840b21c0 2023-11-04T01:36:19.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7f3d64bd5640 1 -- 172.21.15.44:0/2835245650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580e4c50 con 0x7f3d58054420 2023-11-04T01:36:19.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7f3d64bd5640 1 -- 172.21.15.44:0/2835245650 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580e3950 con 0x7f3d58057260 2023-11-04T01:36:19.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7fa080945640 1 --2- 172.21.15.44:0/422817319 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa06806aeb0 0x7fa06806d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7f1a8949c640 1 --2- 172.21.15.44:0/3238257473 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a6806af40 0x7f1a6806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f049dd4c640 1 -- 172.21.15.44:0/3936296034 wait complete. 2023-11-04T01:36:19.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7f3d64bd5640 1 -- 172.21.15.44:0/2835245650 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580e3c30 con 0x7f3d580e34d0 2023-11-04T01:36:19.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9cfbfff640 1 -- 172.21.15.44:0/1808186515 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d08003770 con 0x7f9d14158c50 2023-11-04T01:36:19.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9cfbfff640 1 -- 172.21.15.44:0/1808186515 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08003b20 con 0x7f9d14158c50 2023-11-04T01:36:19.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9d198e0640 1 -- 172.21.15.44:0/1808186515 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d14148d00 con 0x7f9d14158c50 2023-11-04T01:36:19.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.284+0000 7f9d198e0640 1 -- 172.21.15.44:0/1808186515 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d141492c0 con 0x7f9d14158c50 2023-11-04T01:36:19.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.281+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3572330367 wait complete. 2023-11-04T01:36:19.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.283+0000 7f1e0ad1d640 1 Processor -- start 2023-11-04T01:36:19.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.283+0000 7f1e0ad1d640 1 -- start start 2023-11-04T01:36:19.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.285+0000 7f3d5ed9d640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d580e34d0 0x7f3d580e5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f9c8cff9640 1 -- 172.21.15.44:0/2774005107 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8000c940 con 0x7f9c900cd6d0 2023-11-04T01:36:19.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f9c8cff9640 1 -- 172.21.15.44:0/2774005107 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8000caa0 con 0x7f9c900cd6d0 2023-11-04T01:36:19.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f9c8cff9640 1 -- 172.21.15.44:0/2774005107 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8000ce30 con 0x7f9c900cd6d0 2023-11-04T01:36:19.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f9c9681a640 1 -- 172.21.15.44:0/2774005107 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c900cb2a0 con 0x7f9c900cd6d0 2023-11-04T01:36:19.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f9c9681a640 1 -- 172.21.15.44:0/2774005107 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c900cb860 con 0x7f9c900cd6d0 2023-11-04T01:36:19.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f9d198e0640 1 -- 172.21.15.44:0/1808186515 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d140c9740 con 0x7f9d14158c50 2023-11-04T01:36:19.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f049dd4c640 1 Processor -- start 2023-11-04T01:36:19.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f049dd4c640 1 -- start start 2023-11-04T01:36:19.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7fa080945640 1 --2- 172.21.15.44:0/422817319 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa06806aeb0 0x7fa06806d370 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa06c005570 tx=0x7fa06c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f3d5e59c640 1 -- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d580e34d0 msgr2=0x7f3d580e5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f3d5e59c640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d580e34d0 0x7f3d580e5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f3d5e59c640 1 -- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d58057260 msgr2=0x7f3d580e4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f3d5e59c640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d58057260 0x7f3d580e4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f3d5e59c640 1 -- 172.21.15.44:0/2835245650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6004f380 con 0x7f3d58054420 2023-11-04T01:36:19.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f3d5e59c640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d58054420 0x7f3d580d7b20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400c430 tx=0x7f3d5400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f1e0ad1d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e041553b0 0x7f1e0415b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.286+0000 7f3d5dd9b640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d58057260 0x7f3d580e4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:19.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f26a0d3a640 1 --2- 172.21.15.44:0/511066805 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f268006ae70 0x7f268006d330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2688009990 tx=0x7f2688009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f1a8949c640 1 --2- 172.21.15.44:0/3238257473 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a6806af40 0x7f1a6806d400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a80006d40 tx=0x7f1a800182f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f1e08ab9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e041553b0 0x7f1e0415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f1e08ab9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e041553b0 0x7f1e0415b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49074/0 (socket says 172.21.15.44:49074) 2023-11-04T01:36:19.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f1e08ab9640 1 -- 172.21.15.44:0/3982403510 learned_addr learned my addr 172.21.15.44:0/3982403510 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:19.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f1e0ad1d640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e04152d60 0x7f1e040899f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f1e0ad1d640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e04155790 0x7f1e04149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f3d5ed9d640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d580e34d0 0x7f3d580e5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:19.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f049dd4c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f049003ed20 0x7f04900e6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f049dd4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04900e7400 0x7f0490051d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f049dd4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0490052290 0x7f049018a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f049dd4c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049004da70 con 0x7f04900e7400 2023-11-04T01:36:19.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f049dd4c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900e6aa0 con 0x7f049003ed20 2023-11-04T01:36:19.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f049dd4c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04900528b0 con 0x7f0490052290 2023-11-04T01:36:19.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f0496ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04900e7400 0x7f0490051d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f0496ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04900e7400 0x7f0490051d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49078/0 (socket says 172.21.15.44:49078) 2023-11-04T01:36:19.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f9c9681a640 1 -- 172.21.15.44:0/2774005107 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c900cbd80 con 0x7f9c900cd6d0 2023-11-04T01:36:19.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3982403510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0414fe50 con 0x7f1e041553b0 2023-11-04T01:36:19.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3982403510 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0415b5c0 con 0x7f1e04152d60 2023-11-04T01:36:19.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3982403510 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0415c370 con 0x7f1e04155790 2023-11-04T01:36:19.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f1e03fff640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e04152d60 0x7f1e040899f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f0496ffd640 1 -- 172.21.15.44:0/3887414673 learned_addr learned my addr 172.21.15.44:0/3887414673 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:19.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f04977fe640 1 --2- 172.21.15.44:0/3887414673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f049003ed20 0x7f04900e6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.287+0000 7f0497fff640 1 --2- 172.21.15.44:0/3887414673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0490052290 0x7f049018a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.288+0000 7f1e092ba640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e04155790 0x7f1e04149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.288+0000 7f1e08ab9640 1 -- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e04155790 msgr2=0x7f1e04149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.288+0000 7f0496ffd640 1 -- 172.21.15.44:0/3887414673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0490052290 msgr2=0x7f049018a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.288+0000 7f0496ffd640 1 --2- 172.21.15.44:0/3887414673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0490052290 0x7f049018a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.288+0000 7f0496ffd640 1 -- 172.21.15.44:0/3887414673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f049003ed20 msgr2=0x7f04900e6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.288+0000 7f0496ffd640 1 --2- 172.21.15.44:0/3887414673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f049003ed20 0x7f04900e6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.288+0000 7f0496ffd640 1 -- 172.21.15.44:0/3887414673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048c0094d0 con 0x7f04900e7400 2023-11-04T01:36:19.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.288+0000 7f0497fff640 1 --2- 172.21.15.44:0/3887414673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0490052290 0x7f049018a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:19.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.288+0000 7f1e08ab9640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e04155790 0x7f1e04149c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.288+0000 7f1e08ab9640 1 -- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e04152d60 msgr2=0x7f1e040899f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.288+0000 7f1e08ab9640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e04152d60 0x7f1e040899f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.288+0000 7f1e08ab9640 1 -- 172.21.15.44:0/3982403510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0415b7f0 con 0x7f1e041553b0 2023-11-04T01:36:19.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.288+0000 7f0496ffd640 1 --2- 172.21.15.44:0/3887414673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04900e7400 0x7f0490051d50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f048400c4d0 tx=0x7f048400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.288+0000 7f1e03fff640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e04152d60 0x7f1e040899f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:19.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.288+0000 7f1e08ab9640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e041553b0 0x7f1e0415b080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00eb30 tx=0x7f1dfc009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.289+0000 7f3d4effd640 1 -- 172.21.15.44:0/2835245650 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54005ce0 con 0x7f3d58054420 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.289+0000 7f1e017fa640 1 -- 172.21.15.44:0/3982403510 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc00c810 con 0x7f1e041553b0 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.289+0000 7f3d64bd5640 1 -- 172.21.15.44:0/2835245650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d580e3f10 con 0x7f3d58054420 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.289+0000 7f3d4effd640 1 -- 172.21.15.44:0/2835245650 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d54005e40 con 0x7f3d58054420 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.289+0000 7f3d64bd5640 1 -- 172.21.15.44:0/2835245650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5817dfe0 con 0x7f3d58054420 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.289+0000 7f3d4effd640 1 -- 172.21.15.44:0/2835245650 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d540072d0 con 0x7f3d58054420 2023-11-04T01:36:19.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.289+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3982403510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0415bad0 con 0x7f1e041553b0 2023-11-04T01:36:19.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.289+0000 7f1e017fa640 1 -- 172.21.15.44:0/3982403510 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc00c970 con 0x7f1e041553b0 2023-11-04T01:36:19.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.289+0000 7f1e017fa640 1 -- 172.21.15.44:0/3982403510 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc00cce0 con 0x7f1e041553b0 2023-11-04T01:36:19.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.289+0000 7f26997fa640 1 -- 172.21.15.44:0/511066805 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f26900762b0 con 0x7f26940e4b00 2023-11-04T01:36:19.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.289+0000 7f0483fff640 1 -- 172.21.15.44:0/3887414673 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484007480 con 0x7f04900e7400 2023-11-04T01:36:19.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.289+0000 7f049dd4c640 1 -- 172.21.15.44:0/3887414673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0490052b90 con 0x7f04900e7400 2023-11-04T01:36:19.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.289+0000 7f049dd4c640 1 -- 172.21.15.44:0/3887414673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0490053150 con 0x7f04900e7400 2023-11-04T01:36:19.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.291+0000 7fa0797fa640 1 -- 172.21.15.44:0/422817319 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa0700761d0 con 0x7fa07c1feda0 2023-11-04T01:36:19.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.291+0000 7f1a79ffb640 1 -- 172.21.15.44:0/3238257473 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a84161920 con 0x7f1a840b21c0 2023-11-04T01:36:19.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.291+0000 7f3d64bd5640 1 -- 172.21.15.44:0/2835245650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d58005910 con 0x7f3d58054420 2023-11-04T01:36:19.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.291+0000 7f0483fff640 1 -- 172.21.15.44:0/3887414673 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04840075e0 con 0x7f04900e7400 2023-11-04T01:36:19.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.291+0000 7f0483fff640 1 -- 172.21.15.44:0/3887414673 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04840049e0 con 0x7f04900e7400 2023-11-04T01:36:19.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.291+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3982403510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0415c090 con 0x7f1e041553b0 2023-11-04T01:36:19.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.292+0000 7f049dd4c640 1 -- 172.21.15.44:0/3887414673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0478005250 con 0x7f04900e7400 2023-11-04T01:36:19.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.292+0000 7f1e017fa640 1 -- 172.21.15.44:0/3982403510 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1dfc013470 con 0x7f1e041553b0 2023-11-04T01:36:19.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.292+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3982403510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0414ffc0 con 0x7f1e041553b0 2023-11-04T01:36:19.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.292+0000 7f1e017fa640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1de406aea0 0x7f1de406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.293+0000 7f1e017fa640 1 -- 172.21.15.44:0/3982403510 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1dfc089130 con 0x7f1e041553b0 2023-11-04T01:36:19.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.293+0000 7f1e03fff640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1de406aea0 0x7f1de406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.292+0000 7f3d4effd640 1 -- 172.21.15.44:0/2835245650 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d54007430 con 0x7f3d58054420 2023-11-04T01:36:19.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.293+0000 7f3d4effd640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d4006ae70 0x7f3d4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.293+0000 7f3d4effd640 1 -- 172.21.15.44:0/2835245650 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3d540890a0 con 0x7f3d58054420 2023-11-04T01:36:19.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.293+0000 7f0483fff640 1 -- 172.21.15.44:0/3887414673 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0484004b40 con 0x7f04900e7400 2023-11-04T01:36:19.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.293+0000 7f0483fff640 1 --2- 172.21.15.44:0/3887414673 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f047c06aea0 0x7f047c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.294+0000 7f0483fff640 1 -- 172.21.15.44:0/3887414673 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0484088ce0 con 0x7f04900e7400 2023-11-04T01:36:19.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.293+0000 7f9cfbfff640 1 -- 172.21.15.44:0/1808186515 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d08003c80 con 0x7f9d14158c50 2023-11-04T01:36:19.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.294+0000 7f9cfbfff640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d0006af40 0x7f9d0006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.294+0000 7f9cfbfff640 1 -- 172.21.15.44:0/1808186515 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d08089230 con 0x7f9d14158c50 2023-11-04T01:36:19.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.294+0000 7f3d5dd9b640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d4006ae70 0x7f3d4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.294+0000 7f04977fe640 1 --2- 172.21.15.44:0/3887414673 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f047c06aea0 0x7f047c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.294+0000 7f9d12ffd640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d0006af40 0x7f9d0006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.294+0000 7f9c8cff9640 1 -- 172.21.15.44:0/2774005107 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c80013470 con 0x7f9c900cd6d0 2023-11-04T01:36:19.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.295+0000 7f3d5dd9b640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d4006ae70 0x7f3d4006d330 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3d50006fd0 tx=0x7f3d50008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.295+0000 7f1e03fff640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1de406aea0 0x7f1de406d360 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0018c0 tx=0x7f1dec009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.295+0000 7f04977fe640 1 --2- 172.21.15.44:0/3887414673 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f047c06aea0 0x7f047c06d360 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f048c036000 tx=0x7f048c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.295+0000 7f9d12ffd640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d0006af40 0x7f9d0006d400 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9d04006f40 tx=0x7f9d04009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.295+0000 7f9c8cff9640 1 --2- 172.21.15.44:0/2774005107 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c7006af40 0x7f9c7006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.295+0000 7f9cfbfff640 1 -- 172.21.15.44:0/1808186515 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9d08054080 con 0x7f9d14158c50 2023-11-04T01:36:19.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.295+0000 7f9c8ffff640 1 --2- 172.21.15.44:0/2774005107 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c7006af40 0x7f9c7006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.296+0000 7f9c8cff9640 1 -- 172.21.15.44:0/2774005107 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c8008a170 con 0x7f9c900cd6d0 2023-11-04T01:36:19.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.296+0000 7f9c8ffff640 1 --2- 172.21.15.44:0/2774005107 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c7006af40 0x7f9c7006d400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9c88036000 tx=0x7f9c88030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.296+0000 7f9c8cff9640 1 -- 172.21.15.44:0/2774005107 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c80055050 con 0x7f9c900cd6d0 2023-11-04T01:36:19.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.302+0000 7f1e017fa640 1 -- 172.21.15.44:0/3982403510 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1dfc08e060 con 0x7f1e041553b0 2023-11-04T01:36:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.311+0000 7f3d4effd640 1 -- 172.21.15.44:0/2835245650 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d540577d0 con 0x7f3d58054420 2023-11-04T01:36:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.320+0000 7f0483fff640 1 -- 172.21.15.44:0/3887414673 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0484053ab0 con 0x7f04900e7400 2023-11-04T01:36:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.688+0000 7f1a6f7fe640 1 -- 172.21.15.44:0/3238257473 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1a84161920 con 0x7f1a840b21c0 2023-11-04T01:36:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.688+0000 7f1a79ffb640 1 -- 172.21.15.44:0/3238257473 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a84161920 con 0x7f1a840b21c0 2023-11-04T01:36:19.690 INFO:teuthology.orchestra.run.smithi044.stdout:55834574857 2023-11-04T01:36:19.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.691+0000 7f1a8a49e640 1 -- 172.21.15.44:0/3238257473 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a6806af40 msgr2=0x7f1a6806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.692+0000 7f1a8a49e640 1 --2- 172.21.15.44:0/3238257473 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a6806af40 0x7f1a6806d400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a80006d40 tx=0x7f1a800182f0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.692+0000 7f1a8a49e640 1 -- 172.21.15.44:0/3238257473 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a840b21c0 msgr2=0x7f1a84160e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.692+0000 7f1a8a49e640 1 --2- 172.21.15.44:0/3238257473 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a840b21c0 0x7f1a84160e20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c032000 tx=0x7f1a7c004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.692+0000 7f1a8a49e640 1 -- 172.21.15.44:0/3238257473 shutdown_connections 2023-11-04T01:36:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.692+0000 7f1a8a49e640 1 --2- 172.21.15.44:0/3238257473 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a6806af40 0x7f1a6806d400 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.692+0000 7f1a8a49e640 1 --2- 172.21.15.44:0/3238257473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a841663c0 0x7f1a841f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.692+0000 7f1a8a49e640 1 --2- 172.21.15.44:0/3238257473 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a840b21c0 0x7f1a84160e20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.692+0000 7f1a8a49e640 1 --2- 172.21.15.44:0/3238257473 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a840ade70 0x7f1a8416b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.692+0000 7f1a8a49e640 1 -- 172.21.15.44:0/3238257473 >> 172.21.15.44:0/3238257473 conn(0x7f1a8406c780 msgr2=0x7f1a840ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.693+0000 7f1a8a49e640 1 -- 172.21.15.44:0/3238257473 shutdown_connections 2023-11-04T01:36:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.693+0000 7f1a8a49e640 1 -- 172.21.15.44:0/3238257473 wait complete. 2023-11-04T01:36:19.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.695+0000 7fa081947640 1 -- 172.21.15.44:0/422817319 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa07c070e80 con 0x7fa07c1feda0 2023-11-04T01:36:19.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.695+0000 7fa0797fa640 1 -- 172.21.15.44:0/422817319 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa07004a020 con 0x7fa07c1feda0 2023-11-04T01:36:19.698 INFO:teuthology.orchestra.run.smithi044.stdout:55834574857 2023-11-04T01:36:19.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.699+0000 7fa062ffd640 1 -- 172.21.15.44:0/422817319 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa06806aeb0 msgr2=0x7fa06806d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.699+0000 7fa062ffd640 1 --2- 172.21.15.44:0/422817319 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa06806aeb0 0x7fa06806d370 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa06c005570 tx=0x7fa06c009040 comp rx=0 tx=0).stop 2023-11-04T01:36:19.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.699+0000 7fa062ffd640 1 -- 172.21.15.44:0/422817319 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa07c1feda0 msgr2=0x7fa07c1ff220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.699+0000 7fa062ffd640 1 --2- 172.21.15.44:0/422817319 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa07c1feda0 0x7fa07c1ff220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0caad0 tx=0x7fa070004730 comp rx=0 tx=0).stop 2023-11-04T01:36:19.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.699+0000 7fa062ffd640 1 -- 172.21.15.44:0/422817319 shutdown_connections 2023-11-04T01:36:19.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.699+0000 7fa062ffd640 1 --2- 172.21.15.44:0/422817319 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa06806aeb0 0x7fa06806d370 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.700+0000 7fa062ffd640 1 --2- 172.21.15.44:0/422817319 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa07c1feda0 0x7fa07c1ff220 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.700+0000 7fa062ffd640 1 --2- 172.21.15.44:0/422817319 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa07c0c5800 0x7fa07c2031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.700+0000 7fa062ffd640 1 --2- 172.21.15.44:0/422817319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa064005a60 0x7fa07c0a8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.700+0000 7fa062ffd640 1 -- 172.21.15.44:0/422817319 >> 172.21.15.44:0/422817319 conn(0x7fa07c06a120 msgr2=0x7fa07c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.700+0000 7fa062ffd640 1 -- 172.21.15.44:0/422817319 shutdown_connections 2023-11-04T01:36:19.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.700+0000 7fa062ffd640 1 -- 172.21.15.44:0/422817319 wait complete. 2023-11-04T01:36:19.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.704+0000 7f2686ffd640 1 -- 172.21.15.44:0/511066805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2694054650 con 0x7f26940e4b00 2023-11-04T01:36:19.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.705+0000 7f26997fa640 1 -- 172.21.15.44:0/511066805 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f269004a020 con 0x7f26940e4b00 2023-11-04T01:36:19.707 INFO:teuthology.orchestra.run.smithi044.stdout:55834574856 2023-11-04T01:36:19.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.706+0000 7f9d198e0640 1 -- 172.21.15.44:0/1808186515 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9d1404ece0 con 0x7f9d14158c50 2023-11-04T01:36:19.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.707+0000 7f9cfbfff640 1 -- 172.21.15.44:0/1808186515 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d080576a0 con 0x7f9d14158c50 2023-11-04T01:36:19.709 INFO:teuthology.orchestra.run.smithi044.stdout:55834574857 2023-11-04T01:36:19.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.708+0000 7f2686ffd640 1 -- 172.21.15.44:0/511066805 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f268006ae70 msgr2=0x7f268006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.708+0000 7f2686ffd640 1 --2- 172.21.15.44:0/511066805 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f268006ae70 0x7f268006d330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2688009990 tx=0x7f2688009110 comp rx=0 tx=0).stop 2023-11-04T01:36:19.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.708+0000 7f2686ffd640 1 -- 172.21.15.44:0/511066805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26940e4b00 msgr2=0x7f26940f69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.708+0000 7f2686ffd640 1 --2- 172.21.15.44:0/511066805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26940e4b00 0x7f26940f69f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2690033000 tx=0x7f26900046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.708+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3982403510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1e040b5990 con 0x7f1e041553b0 2023-11-04T01:36:19.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.709+0000 7f2686ffd640 1 -- 172.21.15.44:0/511066805 shutdown_connections 2023-11-04T01:36:19.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.709+0000 7f2686ffd640 1 --2- 172.21.15.44:0/511066805 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f268006ae70 0x7f268006d330 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.709+0000 7f2686ffd640 1 --2- 172.21.15.44:0/511066805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26940e4b00 0x7f26940f69f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.709+0000 7f2686ffd640 1 --2- 172.21.15.44:0/511066805 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26940e4720 0x7f26940502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.709+0000 7f2686ffd640 1 --2- 172.21.15.44:0/511066805 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26940564f0 0x7f26940d6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.709+0000 7f2686ffd640 1 -- 172.21.15.44:0/511066805 >> 172.21.15.44:0/511066805 conn(0x7f26940538a0 msgr2=0x7f2694008920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.717 INFO:teuthology.orchestra.run.smithi044.stdout:55834574857 2023-11-04T01:36:19.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.709+0000 7f1e017fa640 1 -- 172.21.15.44:0/3982403510 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1dfc053f10 con 0x7f1e041553b0 2023-11-04T01:36:19.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.709+0000 7f2686ffd640 1 -- 172.21.15.44:0/511066805 shutdown_connections 2023-11-04T01:36:19.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.710+0000 7f2686ffd640 1 -- 172.21.15.44:0/511066805 wait complete. 2023-11-04T01:36:19.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.710+0000 7f9d198e0640 1 -- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d0006af40 msgr2=0x7f9d0006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.710+0000 7f9d198e0640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d0006af40 0x7f9d0006d400 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9d04006f40 tx=0x7f9d04009240 comp rx=0 tx=0).stop 2023-11-04T01:36:19.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.711+0000 7f9d198e0640 1 -- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d14158c50 msgr2=0x7f9d14147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.711+0000 7f9d198e0640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d14158c50 0x7f9d14147cf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800c3e0 tx=0x7f9d0800c8a0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.711+0000 7f9d198e0640 1 -- 172.21.15.44:0/1808186515 shutdown_connections 2023-11-04T01:36:19.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.711+0000 7f9d198e0640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d0006af40 0x7f9d0006d400 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.711+0000 7f9d198e0640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d14158c50 0x7f9d14147cf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.711+0000 7f9d198e0640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d140b0380 0x7f9d14154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.711+0000 7f9d198e0640 1 --2- 172.21.15.44:0/1808186515 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d1406d290 0x7f9d1413ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.711+0000 7f9d198e0640 1 -- 172.21.15.44:0/1808186515 >> 172.21.15.44:0/1808186515 conn(0x7f9d1406c7a0 msgr2=0x7f9d14157df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2023-11-04T01:36:19.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.711+0000 7f9d198e0640 1 -- 172.21.15.44:0/1808186515 shutdown_connections 2023-11-04T01:36:19.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.711+0000 7f9d198e0640 1 -- 172.21.15.44:0/1808186515 wait complete. 2023-11-04T01:36:19.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.713+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1de406aea0 msgr2=0x7f1de406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.713+0000 7f1e0ad1d640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1de406aea0 0x7f1de406d360 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0018c0 tx=0x7f1dec009030 comp rx=0 tx=0).stop 2023-11-04T01:36:19.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.713+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3982403510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e041553b0 msgr2=0x7f1e0415b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.713+0000 7f1e0ad1d640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e041553b0 0x7f1e0415b080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00eb30 tx=0x7f1dfc009f10 comp rx=0 tx=0).stop 2023-11-04T01:36:19.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.713+0000 7f9c9681a640 1 -- 172.21.15.44:0/2774005107 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9c90074290 con 0x7f9c900cd6d0 2023-11-04T01:36:19.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.713+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3982403510 shutdown_connections 2023-11-04T01:36:19.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.713+0000 7f1e0ad1d640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1de406aea0 0x7f1de406d360 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.713+0000 7f1e0ad1d640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e04155790 0x7f1e04149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.713+0000 7f1e0ad1d640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e04152d60 0x7f1e040899f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.713+0000 7f1e0ad1d640 1 --2- 172.21.15.44:0/3982403510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e041553b0 0x7f1e0415b080 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.713+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3982403510 >> 172.21.15.44:0/3982403510 conn(0x7f1e0406d800 msgr2=0x7f1e040717e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.714+0000 7f9c8cff9640 1 -- 172.21.15.44:0/2774005107 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c80058670 con 0x7f9c900cd6d0 2023-11-04T01:36:19.725 INFO:teuthology.orchestra.run.smithi044.stdout:55834574856 2023-11-04T01:36:19.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.714+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3982403510 shutdown_connections 2023-11-04T01:36:19.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.714+0000 7f1e0ad1d640 1 -- 172.21.15.44:0/3982403510 wait complete. 2023-11-04T01:36:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.717+0000 7f9c9681a640 1 -- 172.21.15.44:0/2774005107 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c7006af40 msgr2=0x7f9c7006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.717+0000 7f9c9681a640 1 --2- 172.21.15.44:0/2774005107 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c7006af40 0x7f9c7006d400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9c88036000 tx=0x7f9c88030000 comp rx=0 tx=0).stop 2023-11-04T01:36:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.717+0000 7f9c9681a640 1 -- 172.21.15.44:0/2774005107 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c900cd6d0 msgr2=0x7f9c900d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.717+0000 7f9c9681a640 1 --2- 172.21.15.44:0/2774005107 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c900cd6d0 0x7f9c900d2de0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000e820 tx=0x7f9c8000ece0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.717+0000 7f9c9681a640 1 -- 172.21.15.44:0/2774005107 shutdown_connections 2023-11-04T01:36:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.717+0000 7f9c9681a640 1 --2- 172.21.15.44:0/2774005107 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c7006af40 0x7f9c7006d400 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9c88036000 tx=0x7f9c88030000 comp rx=0 tx=0).stop 2023-11-04T01:36:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.717+0000 7f9c9681a640 1 --2- 172.21.15.44:0/2774005107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c90153e60 0x7f9c900d3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.717+0000 7f9c9681a640 1 --2- 172.21.15.44:0/2774005107 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c900cd6d0 0x7f9c900d2de0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000e820 tx=0x7f9c8000ece0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.717+0000 7f9c9681a640 1 --2- 172.21.15.44:0/2774005107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c900b4880 0x7f9c90150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.717+0000 7f9c9681a640 1 -- 172.21.15.44:0/2774005107 >> 172.21.15.44:0/2774005107 conn(0x7f9c900cf880 msgr2=0x7f9c900d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2023-11-04T01:36:19.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.717+0000 7f9c9681a640 1 -- 172.21.15.44:0/2774005107 shutdown_connections 2023-11-04T01:36:19.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.717+0000 7f9c9681a640 1 -- 172.21.15.44:0/2774005107 wait complete. 2023-11-04T01:36:19.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.719+0000 7f3d64bd5640 1 -- 172.21.15.44:0/2835245650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3d580073d0 con 0x7f3d58054420 2023-11-04T01:36:19.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.720+0000 7f3d4effd640 1 -- 172.21.15.44:0/2835245650 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d54057360 con 0x7f3d58054420 2023-11-04T01:36:19.733 INFO:teuthology.orchestra.run.smithi044.stdout:55834574857 2023-11-04T01:36:19.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.722+0000 7f3d64bd5640 1 -- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d4006ae70 msgr2=0x7f3d4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.722+0000 7f3d64bd5640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d4006ae70 0x7f3d4006d330 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3d50006fd0 tx=0x7f3d50008040 comp rx=0 tx=0).stop 2023-11-04T01:36:19.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.722+0000 7f3d64bd5640 1 -- 172.21.15.44:0/2835245650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d58054420 msgr2=0x7f3d580d7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.722+0000 7f3d64bd5640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d58054420 0x7f3d580d7b20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400c430 tx=0x7f3d5400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.723+0000 7f3d64bd5640 1 -- 172.21.15.44:0/2835245650 shutdown_connections 2023-11-04T01:36:19.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.723+0000 7f3d64bd5640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d4006ae70 0x7f3d4006d330 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.723+0000 7f3d64bd5640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d580e34d0 0x7f3d580e5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.723+0000 7f3d64bd5640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d58057260 0x7f3d580e4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.723+0000 7f3d64bd5640 1 --2- 172.21.15.44:0/2835245650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d58054420 0x7f3d580d7b20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.723+0000 7f3d64bd5640 1 -- 172.21.15.44:0/2835245650 >> 172.21.15.44:0/2835245650 conn(0x7f3d58059150 msgr2=0x7f3d580065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.723+0000 7f3d64bd5640 1 -- 172.21.15.44:0/2835245650 shutdown_connections 2023-11-04T01:36:19.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.723+0000 7f3d64bd5640 1 -- 172.21.15.44:0/2835245650 wait complete. 2023-11-04T01:36:19.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.727+0000 7f049dd4c640 1 -- 172.21.15.44:0/3887414673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0478005500 con 0x7f04900e7400 2023-11-04T01:36:19.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.727+0000 7f0483fff640 1 -- 172.21.15.44:0/3887414673 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0484018070 con 0x7f04900e7400 2023-11-04T01:36:19.739 INFO:teuthology.orchestra.run.smithi044.stdout:55834574857 2023-11-04T01:36:19.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.730+0000 7f049dd4c640 1 -- 172.21.15.44:0/3887414673 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f047c06aea0 msgr2=0x7f047c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.730+0000 7f049dd4c640 1 --2- 172.21.15.44:0/3887414673 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f047c06aea0 0x7f047c06d360 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f048c036000 tx=0x7f048c008030 comp rx=0 tx=0).stop 2023-11-04T01:36:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.730+0000 7f049dd4c640 1 -- 172.21.15.44:0/3887414673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04900e7400 msgr2=0x7f0490051d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.730+0000 7f049dd4c640 1 --2- 172.21.15.44:0/3887414673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04900e7400 0x7f0490051d50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f048400c4d0 tx=0x7f048400c990 comp rx=0 tx=0).stop 2023-11-04T01:36:19.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2023-11-04T01:36:19.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.730+0000 7f049dd4c640 1 -- 172.21.15.44:0/3887414673 shutdown_connections 2023-11-04T01:36:19.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.730+0000 7f049dd4c640 1 --2- 172.21.15.44:0/3887414673 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f047c06aea0 0x7f047c06d360 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.730+0000 7f049dd4c640 1 --2- 172.21.15.44:0/3887414673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0490052290 0x7f049018a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.730+0000 7f049dd4c640 1 --2- 172.21.15.44:0/3887414673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04900e7400 0x7f0490051d50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.730+0000 7f049dd4c640 1 --2- 172.21.15.44:0/3887414673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f049003ed20 0x7f04900e6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.730+0000 7f049dd4c640 1 -- 172.21.15.44:0/3887414673 >> 172.21.15.44:0/3887414673 conn(0x7f049003aa70 msgr2=0x7f0490053970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.730+0000 7f049dd4c640 1 -- 172.21.15.44:0/3887414673 shutdown_connections 2023-11-04T01:36:19.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:19.730+0000 7f049dd4c640 1 -- 172.21.15.44:0/3887414673 wait complete. 2023-11-04T01:36:19.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-11-04T01:36:19.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2023-11-04T01:36:19.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2023-11-04T01:36:19.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2023-11-04T01:36:19.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2023-11-04T01:36:20.722 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T01:36:20.733 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-04T01:36:20.744 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T01:36:20.747 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-04T01:36:20.748 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T01:36:20.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-04T01:36:20.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-04T01:36:20.751 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T01:36:20.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.899+0000 7fa49211d640 1 Processor -- start 2023-11-04T01:36:20.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.899+0000 7fa49211d640 1 -- start start 2023-11-04T01:36:20.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.900+0000 7fa49211d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa48403b9c0 0x7fa4840dff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.900+0000 7fa49211d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa484008b00 0x7fa484008f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.900+0000 7fa49211d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4840543d0 con 0x7fa484055740 2023-11-04T01:36:20.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.900+0000 7fa49211d640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa484055320 con 0x7fa48403b9c0 2023-11-04T01:36:20.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.901+0000 7fa49211d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4840546a0 con 0x7fa484008b00 2023-11-04T01:36:20.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.901+0000 7fa48affd640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fa484055740 0x7fa484053cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:46886/0 (socket says 172.21.15.44:46886) 2023-11-04T01:36:20.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.901+0000 7fa48affd640 1 -- 172.21.15.44:0/1752428120 learned_addr learned my addr 172.21.15.44:0/1752428120 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:20.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.902+0000 7fa48b7fe640 1 --2- 172.21.15.44:0/1752428120 >> v2:172.21.15.44:3300/0 conn(0x7fa48403b9c0 0x7fa4840dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.902+0000 7fa48a7fc640 1 -- 172.21.15.44:0/1752428120 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912840022 0 0) 0x7fa4840543d0 con 0x7fa484055740 2023-11-04T01:36:20.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.902+0000 7fa48a7fc640 1 -- 172.21.15.44:0/1752428120 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa47c003520 con 0x7fa484055740 2023-11-04T01:36:20.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.902+0000 7fa48bfff640 1 --2- 172.21.15.44:0/1752428120 >> v2:172.21.15.204:3300/0 conn(0x7fa484008b00 0x7fa484008f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.902+0000 7fa48a7fc640 1 -- 172.21.15.44:0/1752428120 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 917603642 0 0) 0x7fa47c003520 con 0x7fa484055740 2023-11-04T01:36:20.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.902+0000 7fa48a7fc640 1 -- 172.21.15.44:0/1752428120 >> v2:172.21.15.204:3300/0 conn(0x7fa484008b00 msgr2=0x7fa484008f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:20.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.902+0000 7fa48a7fc640 1 --2- 172.21.15.44:0/1752428120 >> v2:172.21.15.204:3300/0 conn(0x7fa484008b00 0x7fa484008f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.902+0000 7fa48a7fc640 1 -- 172.21.15.44:0/1752428120 >> v2:172.21.15.44:3300/0 conn(0x7fa48403b9c0 msgr2=0x7fa4840dff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:20.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.902+0000 7fa48a7fc640 1 --2- 172.21.15.44:0/1752428120 >> v2:172.21.15.44:3300/0 conn(0x7fa48403b9c0 0x7fa4840dff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.902+0000 7fa48a7fc640 1 -- 172.21.15.44:0/1752428120 --> v1:172.21.15.204:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa484054980 con 0x7fa484055740 2023-11-04T01:36:20.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.902+0000 7fa48a7fc640 1 -- 172.21.15.44:0/1752428120 <== mon.1 v1:172.21.15.204:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fa48c073cb0 con 0x7fa484055740 2023-11-04T01:36:20.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.902+0000 7fa48a7fc640 1 -- 172.21.15.44:0/1752428120 >> v1:172.21.15.204:6789/0 conn(0x7fa484055740 legacy=0x7fa484053cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.902+0000 7fa48a7fc640 1 --2- 172.21.15.44:0/1752428120 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa47c003970 0x7fa47c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.902+0000 7fa48a7fc640 1 --2- 172.21.15.44:0/1752428120 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa47c004310 0x7fa47c0047e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.902+0000 7fa48a7fc640 1 --2- 172.21.15.44:0/1752428120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa47c004f00 0x7fa47c00b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.903+0000 7fa48a7fc640 1 -- 172.21.15.44:0/1752428120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa484055320 con 0x7fa47c004f00 2023-11-04T01:36:20.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.903+0000 7fa48a7fc640 1 -- 172.21.15.44:0/1752428120 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840546a0 con 0x7fa47c003970 2023-11-04T01:36:20.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.903+0000 7fa48a7fc640 1 -- 172.21.15.44:0/1752428120 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c00bee0 con 0x7fa47c004310 2023-11-04T01:36:20.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.903+0000 7fa48bfff640 1 --2- 172.21.15.44:0/1752428120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa47c004f00 0x7fa47c00b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.903+0000 7fa48b7fe640 1 --2- 172.21.15.44:0/1752428120 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa47c003970 0x7fa47c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.904+0000 7fa48affd640 1 --2- 172.21.15.44:0/1752428120 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa47c004310 0x7fa47c0047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.904+0000 7fa48bfff640 1 -- 172.21.15.44:0/1752428120 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa47c004310 msgr2=0x7fa47c0047e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:20.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.904+0000 7fa48bfff640 1 --2- 172.21.15.44:0/1752428120 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa47c004310 0x7fa47c0047e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.904+0000 7fa48bfff640 1 -- 172.21.15.44:0/1752428120 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa47c003970 msgr2=0x7fa47c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:20.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.904+0000 7fa48bfff640 1 --2- 172.21.15.44:0/1752428120 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa47c003970 0x7fa47c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.904+0000 7fa48bfff640 1 -- 172.21.15.44:0/1752428120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c003520 con 0x7fa47c004f00 2023-11-04T01:36:20.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.906+0000 7fa48bfff640 1 --2- 172.21.15.44:0/1752428120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa47c004f00 0x7fa47c00b970 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa478009aa0 tx=0x7fa47c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8377dee757b8f62b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:20.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.906+0000 7fa48bfff640 1 -- 172.21.15.44:0/1752428120 reap_dead start 2023-11-04T01:36:20.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.906+0000 7fa48a7fc640 1 -- 172.21.15.44:0/1752428120 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47802c710 con 0x7fa47c004f00 2023-11-04T01:36:20.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.907+0000 7fa48a7fc640 1 -- 172.21.15.44:0/1752428120 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47802c870 con 0x7fa47c004f00 2023-11-04T01:36:20.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.908+0000 7fa49211d640 1 -- 172.21.15.44:0/1752428120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa47c004f00 msgr2=0x7fa47c00b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.908+0000 7fa49211d640 1 --2- 172.21.15.44:0/1752428120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa47c004f00 0x7fa47c00b970 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa478009aa0 tx=0x7fa47c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.908+0000 7fa49211d640 1 -- 172.21.15.44:0/1752428120 shutdown_connections 2023-11-04T01:36:20.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.908+0000 7fa49211d640 1 --2- 172.21.15.44:0/1752428120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa47c004f00 0x7fa47c00b970 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.908+0000 7fa49211d640 1 -- 172.21.15.44:0/1752428120 >> 172.21.15.44:0/1752428120 conn(0x7fa484055c10 msgr2=0x7fa484056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:20.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.908+0000 7fa49211d640 1 -- 172.21.15.44:0/1752428120 shutdown_connections 2023-11-04T01:36:20.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.909+0000 7fa49211d640 1 -- 172.21.15.44:0/1752428120 wait complete. 2023-11-04T01:36:20.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.910+0000 7fa49211d640 1 Processor -- start 2023-11-04T01:36:20.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.911+0000 7fa49211d640 1 -- start start 2023-11-04T01:36:20.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.912+0000 7fa49211d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa47c004f00 0x7fa4840d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.912+0000 7fa49211d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4840cebf0 0x7fa4840cf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.913+0000 7fa48affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4840cebf0 0x7fa4840cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.913+0000 7fa48affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4840cebf0 0x7fa4840cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49104/0 (socket says 172.21.15.44:49104) 2023-11-04T01:36:20.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.913+0000 7fa48affd640 1 -- 172.21.15.44:0/2033665080 learned_addr learned my addr 172.21.15.44:0/2033665080 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:20.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.913+0000 7fa49211d640 1 --2- 172.21.15.44:0/2033665080 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4840debb0 0x7fa4840df010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.913+0000 7fa49211d640 1 -- 172.21.15.44:0/2033665080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48404fb00 con 0x7fa4840cebf0 2023-11-04T01:36:20.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.913+0000 7fa49211d640 1 -- 172.21.15.44:0/2033665080 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840e1eb0 con 0x7fa47c004f00 2023-11-04T01:36:20.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.913+0000 7fa49211d640 1 -- 172.21.15.44:0/2033665080 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840e2190 con 0x7fa4840debb0 2023-11-04T01:36:20.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.914+0000 7fa48affd640 1 -- 172.21.15.44:0/2033665080 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4840debb0 msgr2=0x7fa4840df010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:36:20.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.914+0000 7fa48affd640 1 --2- 172.21.15.44:0/2033665080 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4840debb0 0x7fa4840df010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.914+0000 7fa48affd640 1 -- 172.21.15.44:0/2033665080 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa47c004f00 msgr2=0x7fa4840d22e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-04T01:36:20.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.914+0000 7fa48affd640 1 --2- 172.21.15.44:0/2033665080 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa47c004f00 0x7fa4840d22e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.914+0000 7fa48affd640 1 -- 172.21.15.44:0/2033665080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840e2470 con 0x7fa4840cebf0 2023-11-04T01:36:20.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.915+0000 7fa48affd640 1 --2- 172.21.15.44:0/2033665080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4840cebf0 0x7fa4840cf070 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa48c069740 tx=0x7fa48c072e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:20.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.916+0000 7fa477fff640 1 -- 172.21.15.44:0/2033665080 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c067580 con 0x7fa4840cebf0 2023-11-04T01:36:20.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.916+0000 7fa49211d640 1 -- 172.21.15.44:0/2033665080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4840e2750 con 0x7fa4840cebf0 2023-11-04T01:36:20.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.916+0000 7fa49211d640 1 -- 172.21.15.44:0/2033665080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4840e2f50 con 0x7fa4840cebf0 2023-11-04T01:36:20.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.919+0000 7fa477fff640 1 -- 172.21.15.44:0/2033665080 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c08e070 con 0x7fa4840cebf0 2023-11-04T01:36:20.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.919+0000 7fa477fff640 1 -- 172.21.15.44:0/2033665080 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c092620 con 0x7fa4840cebf0 2023-11-04T01:36:20.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.919+0000 7fa477fff640 1 -- 172.21.15.44:0/2033665080 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa48c090070 con 0x7fa4840cebf0 2023-11-04T01:36:20.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.920+0000 7fa477fff640 1 --2- 172.21.15.44:0/2033665080 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa47006afc0 0x7fa47006d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.920+0000 7fa477fff640 1 -- 172.21.15.44:0/2033665080 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa48c104080 con 0x7fa4840cebf0 2023-11-04T01:36:20.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.920+0000 7fa48b7fe640 1 --2- 172.21.15.44:0/2033665080 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa47006afc0 0x7fa47006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.923+0000 7fa48b7fe640 1 --2- 172.21.15.44:0/2033665080 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa47006afc0 0x7fa47006d480 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa484003f30 tx=0x7fa480008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:20.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.923+0000 7fa49211d640 1 -- 172.21.15.44:0/2033665080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa484006900 con 0x7fa4840cebf0 2023-11-04T01:36:20.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.934+0000 7fa477fff640 1 -- 172.21.15.44:0/2033665080 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa48c097080 con 0x7fa4840cebf0 2023-11-04T01:36:20.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.953+0000 7f643bed4640 1 Processor -- start 2023-11-04T01:36:20.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.953+0000 7f643bed4640 1 -- start start 2023-11-04T01:36:20.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.954+0000 7f643bed4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f643415cbf0 0x7f64340c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.954+0000 7f643bed4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643406a830 0x7f643406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.954+0000 7f6dd3fff640 1 Processor -- start 2023-11-04T01:36:20.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.954+0000 7f643bed4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643415cfd0 con 0x7f643406f280 2023-11-04T01:36:20.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.955+0000 7f643bed4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64340b1f20 con 0x7f643415cbf0 2023-11-04T01:36:20.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.955+0000 7f643bed4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64340ca2c0 con 0x7f643406a830 2023-11-04T01:36:20.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.955+0000 7f643a471640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643406a830 0x7f643406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.955+0000 7f643a471640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643406a830 0x7f643406f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:60606/0 (socket says 172.21.15.44:60606) 2023-11-04T01:36:20.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.955+0000 7f643a471640 1 -- 172.21.15.44:0/2865334626 learned_addr learned my addr 172.21.15.44:0/2865334626 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:20.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.955+0000 7f6439c70640 1 --2- 172.21.15.44:0/2865334626 >> v2:172.21.15.204:3300/0 conn(0x7f643415cbf0 0x7f64340c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.955+0000 7f1dcc99e640 1 Processor -- start 2023-11-04T01:36:20.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.955+0000 7f1dcc99e640 1 -- start start 2023-11-04T01:36:20.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.955+0000 7f6dd3fff640 1 -- start start 2023-11-04T01:36:20.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.955+0000 7f6438c6e640 1 -- 172.21.15.44:0/2865334626 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833321090 0 0) 0x7f643415cfd0 con 0x7f643406f280 2023-11-04T01:36:20.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.955+0000 7f6438c6e640 1 -- 172.21.15.44:0/2865334626 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6420003520 con 0x7f643406f280 2023-11-04T01:36:20.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.955+0000 7f6439c70640 1 -- 172.21.15.44:0/2865334626 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643406a830 msgr2=0x7f643406f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:20.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.955+0000 7f6439c70640 1 --2- 172.21.15.44:0/2865334626 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643406a830 0x7f643406f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.955+0000 7f6439c70640 1 -- 172.21.15.44:0/2865334626 >> v1:172.21.15.204:6789/0 conn(0x7f643406f280 legacy=0x7f643406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.956+0000 7f6439c70640 1 -- 172.21.15.44:0/2865334626 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64340b12a0 con 0x7f643415cbf0 2023-11-04T01:36:20.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f6439c70640 1 --2- 172.21.15.44:0/2865334626 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f643415cbf0 0x7f64340c9d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f64300097a0 tx=0x7f643002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ca604d33c770545 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:20.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f6438c6e640 1 -- 172.21.15.44:0/2865334626 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643002d040 con 0x7f643415cbf0 2023-11-04T01:36:20.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f6438c6e640 1 -- 172.21.15.44:0/2865334626 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6430031810 con 0x7f643415cbf0 2023-11-04T01:36:20.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f6438c6e640 1 -- 172.21.15.44:0/2865334626 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6430031ba0 con 0x7f643415cbf0 2023-11-04T01:36:20.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.956+0000 7f373f1d2640 1 Processor -- start 2023-11-04T01:36:20.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.956+0000 7f373f1d2640 1 -- start start 2023-11-04T01:36:20.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f6dd3fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6dd40cde60 0x7f6dd40ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f6dd3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6dd40ca520 0x7f6dd40ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f6dd27fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6dd40cde60 0x7f6dd40ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f6dd27fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6dd40cde60 0x7f6dd40ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44462/0 (socket says 172.21.15.44:44462) 2023-11-04T01:36:20.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.956+0000 7f938a947640 1 Processor -- start 2023-11-04T01:36:20.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.956+0000 7f938a947640 1 -- start start 2023-11-04T01:36:20.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f6dd37fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6dd40ca520 0x7f6dd40ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f6dd37fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6dd40ca520 0x7f6dd40ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49110/0 (socket says 172.21.15.44:49110) 2023-11-04T01:36:20.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f1dcc99e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1dc8153e60 0x7f1dc815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f1dcc99e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1dc80cd6d0 0x7f1dc8161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f1dcc99e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc80cde60 con 0x7f1dc80b4880 2023-11-04T01:36:20.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f1dcc99e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc8160f90 con 0x7f1dc80cd6d0 2023-11-04T01:36:20.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f1dcc99e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc815e400 con 0x7f1dc8153e60 2023-11-04T01:36:20.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f1dc6d9d640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f1dc80b4880 0x7f1dc806b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:46896/0 (socket says 172.21.15.44:46896) 2023-11-04T01:36:20.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f1dc6d9d640 1 -- 172.21.15.44:0/1851633332 learned_addr learned my addr 172.21.15.44:0/1851633332 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:20.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f1dc5d9b640 1 --2- 172.21.15.44:0/1851633332 >> v2:172.21.15.44:3300/0 conn(0x7f1dc80cd6d0 0x7f1dc8161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f1dc659c640 1 --2- 172.21.15.44:0/1851633332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1dc8153e60 0x7f1dc815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f6dd3fff640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd40d0430 con 0x7f6dd40ccf00 2023-11-04T01:36:20.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f6dd3fff640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd40cd2e0 con 0x7f6dd40ca520 2023-11-04T01:36:20.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f6dd3fff640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd40ce830 con 0x7f6dd40cde60 2023-11-04T01:36:20.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f373f1d2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37300e78b0 0x7f373004f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f938a947640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9384158a40 0x7f9384158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f938a947640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93840c9f50 con 0x7f93840c9ac0 2023-11-04T01:36:20.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f938a947640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938415d3c0 con 0x7f938406ac10 2023-11-04T01:36:20.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f938a947640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93840c90b0 con 0x7f9384158a40 2023-11-04T01:36:20.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f9389144640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f938406ac10 0x7f938415c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:46900/0 (socket says 172.21.15.44:46900) 2023-11-04T01:36:20.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f9389144640 1 -- 172.21.15.44:0/4073509416 learned_addr learned my addr 172.21.15.44:0/4073509416 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:20.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f643bed4640 1 -- 172.21.15.44:0/2865334626 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f643415cbf0 msgr2=0x7f64340c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f373f1d2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f37300eb2c0 0x7f37300eb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f643bed4640 1 --2- 172.21.15.44:0/2865334626 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f643415cbf0 0x7f64340c9d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f64300097a0 tx=0x7f643002b8b0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f373f1d2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3730052fe0 0x7f3730053470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f9389945640 1 --2- 172.21.15.44:0/4073509416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9384158a40 0x7f9384158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.957+0000 7f6dd27fc640 1 -- 172.21.15.44:0/4145576737 learned_addr learned my addr 172.21.15.44:0/4145576737 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:20.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f643bed4640 1 -- 172.21.15.44:0/2865334626 shutdown_connections 2023-11-04T01:36:20.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f643bed4640 1 --2- 172.21.15.44:0/2865334626 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643406a830 0x7f643406f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f643bed4640 1 --2- 172.21.15.44:0/2865334626 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f643415cbf0 0x7f64340c9d80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f373f1d2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3730050340 con 0x7f3730052fe0 2023-11-04T01:36:20.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f373f1d2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3730006480 con 0x7f37300eb2c0 2023-11-04T01:36:20.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f373f1d2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37300ebc40 con 0x7f37300e78b0 2023-11-04T01:36:20.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f643bed4640 1 -- 172.21.15.44:0/2865334626 >> 172.21.15.44:0/2865334626 conn(0x7f64340cc100 msgr2=0x7f64340cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:20.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f6178a9a640 1 Processor -- start 2023-11-04T01:36:20.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f9388943640 1 -- 172.21.15.44:0/4073509416 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935941787 0 0) 0x7f938415d3c0 con 0x7f938406ac10 2023-11-04T01:36:20.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f9388943640 1 -- 172.21.15.44:0/4073509416 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9370003520 con 0x7f938406ac10 2023-11-04T01:36:20.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f643bed4640 1 -- 172.21.15.44:0/2865334626 shutdown_connections 2023-11-04T01:36:20.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f643bed4640 1 -- 172.21.15.44:0/2865334626 wait complete. 2023-11-04T01:36:20.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f6178a9a640 1 -- start start 2023-11-04T01:36:20.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f1dc659c640 1 -- 172.21.15.44:0/1851633332 >> v2:172.21.15.44:3300/0 conn(0x7f1dc80cd6d0 msgr2=0x7f1dc8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:20.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f1dc659c640 1 --2- 172.21.15.44:0/1851633332 >> v2:172.21.15.44:3300/0 conn(0x7f1dc80cd6d0 0x7f1dc8161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f1dc659c640 1 -- 172.21.15.44:0/1851633332 >> v1:172.21.15.204:6789/0 conn(0x7f1dc80b4880 legacy=0x7f1dc806b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.958+0000 7f1dc659c640 1 -- 172.21.15.44:0/1851633332 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc8161960 con 0x7f1dc8153e60 2023-11-04T01:36:21.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f9388943640 1 -- 172.21.15.44:0/4073509416 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3725919926 0 0) 0x7f9370003520 con 0x7f938406ac10 2023-11-04T01:36:21.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f9388943640 1 -- 172.21.15.44:0/4073509416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9384158a40 msgr2=0x7f9384158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f9388943640 1 --2- 172.21.15.44:0/4073509416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9384158a40 0x7f9384158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f9388943640 1 -- 172.21.15.44:0/4073509416 >> v1:172.21.15.44:6789/0 conn(0x7f93840c9ac0 legacy=0x7f93840ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f9388943640 1 -- 172.21.15.44:0/4073509416 --> v1:172.21.15.204:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938415d6a0 con 0x7f938406ac10 2023-11-04T01:36:21.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f9388943640 1 -- 172.21.15.44:0/4073509416 <== mon.1 v1:172.21.15.204:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f9374001650 con 0x7f938406ac10 2023-11-04T01:36:21.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f9388943640 1 -- 172.21.15.44:0/4073509416 >> v1:172.21.15.204:6789/0 conn(0x7f938406ac10 legacy=0x7f938415c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f9388943640 1 --2- 172.21.15.44:0/4073509416 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93700039d0 0x7f9370003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f9388943640 1 --2- 172.21.15.44:0/4073509416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93700047c0 0x7f9370004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f9388943640 1 --2- 172.21.15.44:0/4073509416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9370005180 0x7f937000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f9388943640 1 -- 172.21.15.44:0/4073509416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93840c90b0 con 0x7f93700047c0 2023-11-04T01:36:21.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f9388943640 1 -- 172.21.15.44:0/4073509416 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937000c090 con 0x7f93700039d0 2023-11-04T01:36:21.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f9388943640 1 -- 172.21.15.44:0/4073509416 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937000c250 con 0x7f9370005180 2023-11-04T01:36:21.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f373d9cf640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f37300eb2c0 0x7f37300eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f9389945640 1 --2- 172.21.15.44:0/4073509416 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93700039d0 0x7f9370003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f938a146640 1 --2- 172.21.15.44:0/4073509416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9370005180 0x7f937000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f1dc659c640 1 --2- 172.21.15.44:0/1851633332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1dc8153e60 0x7f1dc815dec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1db80097a0 tx=0x7f1db802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2fdaf5e2e1523ac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f1dc559a640 1 -- 172.21.15.44:0/1851633332 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db8031830 con 0x7f1dc8153e60 2023-11-04T01:36:21.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f9389945640 1 -- 172.21.15.44:0/4073509416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9370005180 msgr2=0x7f937000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f9389945640 1 --2- 172.21.15.44:0/4073509416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9370005180 0x7f937000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f9389945640 1 -- 172.21.15.44:0/4073509416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93700047c0 msgr2=0x7f9370004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f9389945640 1 --2- 172.21.15.44:0/4073509416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93700047c0 0x7f9370004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f9389945640 1 -- 172.21.15.44:0/4073509416 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938415d6a0 con 0x7f93700039d0 2023-11-04T01:36:21.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f373d9cf640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f37300eb2c0 0x7f37300eb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44472/0 (socket says 172.21.15.44:44472) 2023-11-04T01:36:21.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f6178a9a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f616c0e77a0 0x7f616c04f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f6178a9a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f616c0eb1b0 0x7f616c0eb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f373d9cf640 1 -- 172.21.15.44:0/883751016 learned_addr learned my addr 172.21.15.44:0/883751016 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:21.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f373e1d0640 1 --2- 172.21.15.44:0/883751016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37300e78b0 0x7f373004f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f6178a9a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c050230 con 0x7f616c052ed0 2023-11-04T01:36:21.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f6172ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f616c0eb1b0 0x7f616c0eb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.959+0000 7f373e9d1640 1 --2- 172.21.15.44:0/883751016 >> v2:172.21.15.44:3300/0 conn(0x7f3730052fe0 0x7f3730053470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f6172ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f616c0eb1b0 0x7f616c0eb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49138/0 (socket says 172.21.15.44:49138) 2023-11-04T01:36:21.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f6178a9a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c006370 con 0x7f616c0eb1b0 2023-11-04T01:36:21.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f6172ffd640 1 -- 172.21.15.44:0/4020442353 learned_addr learned my addr 172.21.15.44:0/4020442353 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:21.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f6178a9a640 1 -- 172.21.15.44:0/4020442353 --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c0ebb30 con 0x7f616c0e77a0 2023-11-04T01:36:21.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f373e1d0640 1 -- 172.21.15.44:0/883751016 >> v2:172.21.15.204:3300/0 conn(0x7f37300eb2c0 msgr2=0x7f37300eb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f373e1d0640 1 --2- 172.21.15.44:0/883751016 >> v2:172.21.15.204:3300/0 conn(0x7f37300eb2c0 0x7f37300eb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f373e1d0640 1 -- 172.21.15.44:0/883751016 >> v2:172.21.15.44:3300/0 conn(0x7f3730052fe0 msgr2=0x7f3730053470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f373e1d0640 1 --2- 172.21.15.44:0/883751016 >> v2:172.21.15.44:3300/0 conn(0x7f3730052fe0 0x7f3730053470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f373e1d0640 1 -- 172.21.15.44:0/883751016 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373004fd80 con 0x7f37300e78b0 2023-11-04T01:36:21.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f373d9cf640 1 --2- 172.21.15.44:0/883751016 >> v2:172.21.15.204:3300/0 conn(0x7f37300eb2c0 0x7f37300eb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:21.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.960+0000 7f1dc559a640 1 -- 172.21.15.44:0/1851633332 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db8031990 con 0x7f1dc8153e60 2023-11-04T01:36:21.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f1dcc99e640 1 -- 172.21.15.44:0/1851633332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1dc8153e60 msgr2=0x7f1dc815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f9389945640 1 --2- 172.21.15.44:0/4073509416 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93700039d0 0x7f9370003e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9384071dd0 tx=0x7f93700057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5b2949fe7af9dd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f1dcc99e640 1 --2- 172.21.15.44:0/1851633332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1dc8153e60 0x7f1dc815dec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1db80097a0 tx=0x7f1db802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f643bed4640 1 Processor -- start 2023-11-04T01:36:21.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f643bed4640 1 -- start start 2023-11-04T01:36:21.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f1dcc99e640 1 -- 172.21.15.44:0/1851633332 shutdown_connections 2023-11-04T01:36:21.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f1dcc99e640 1 --2- 172.21.15.44:0/1851633332 >> v2:172.21.15.44:3300/0 conn(0x7f1dc80cd6d0 0x7f1dc8161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f1dcc99e640 1 --2- 172.21.15.44:0/1851633332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1dc8153e60 0x7f1dc815dec0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f61737fe640 1 --2- 172.21.15.44:0/4020442353 >> v2:172.21.15.204:3300/0 conn(0x7f616c0e77a0 0x7f616c04f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f61727fc640 1 -- 172.21.15.44:0/4020442353 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041490534 0 0) 0x7f616c050230 con 0x7f616c052ed0 2023-11-04T01:36:21.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f61727fc640 1 -- 172.21.15.44:0/4020442353 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6164003520 con 0x7f616c052ed0 2023-11-04T01:36:21.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f1dcc99e640 1 -- 172.21.15.44:0/1851633332 >> 172.21.15.44:0/1851633332 conn(0x7f1dc80cf880 msgr2=0x7f1dc80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.962+0000 7f1dcc99e640 1 -- 172.21.15.44:0/1851633332 shutdown_connections 2023-11-04T01:36:21.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.962+0000 7f373e1d0640 1 --2- 172.21.15.44:0/883751016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37300e78b0 0x7f373004f260 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f373000dc10 tx=0x7f373402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c54d8342b2965398 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.962+0000 7f1dcc99e640 1 -- 172.21.15.44:0/1851633332 wait complete. 2023-11-04T01:36:21.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.962+0000 7f6172ffd640 1 -- 172.21.15.44:0/4020442353 >> v2:172.21.15.204:3300/0 conn(0x7f616c0e77a0 msgr2=0x7f616c04f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.962+0000 7f6172ffd640 1 --2- 172.21.15.44:0/4020442353 >> v2:172.21.15.204:3300/0 conn(0x7f616c0e77a0 0x7f616c04f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.962+0000 7f6172ffd640 1 -- 172.21.15.44:0/4020442353 >> v1:172.21.15.204:6789/0 conn(0x7f616c052ed0 legacy=0x7f616c053360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.962+0000 7f6172ffd640 1 -- 172.21.15.44:0/4020442353 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c007810 con 0x7f616c0eb1b0 2023-11-04T01:36:21.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.962+0000 7f373d1ce640 1 -- 172.21.15.44:0/883751016 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373402f050 con 0x7f37300e78b0 2023-11-04T01:36:21.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.962+0000 7f373d1ce640 1 -- 172.21.15.44:0/883751016 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3734031700 con 0x7f37300e78b0 2023-11-04T01:36:21.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.962+0000 7f373d1ce640 1 -- 172.21.15.44:0/883751016 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734031a90 con 0x7f37300e78b0 2023-11-04T01:36:21.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f6dd27fc640 1 -- 172.21.15.44:0/4145576737 >> v2:172.21.15.44:3300/0 conn(0x7f6dd40ca520 msgr2=0x7f6dd40ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f6dd27fc640 1 --2- 172.21.15.44:0/4145576737 >> v2:172.21.15.44:3300/0 conn(0x7f6dd40ca520 0x7f6dd40ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f6dd27fc640 1 -- 172.21.15.44:0/4145576737 >> v1:172.21.15.44:6789/0 conn(0x7f6dd40ccf00 legacy=0x7f6dd406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f6dd27fc640 1 -- 172.21.15.44:0/4145576737 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd40cf820 con 0x7f6dd40cde60 2023-11-04T01:36:21.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f9388943640 1 -- 172.21.15.44:0/4073509416 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c02cb90 con 0x7f93700039d0 2023-11-04T01:36:21.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.961+0000 7f9388943640 1 -- 172.21.15.44:0/4073509416 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c02ccf0 con 0x7f93700039d0 2023-11-04T01:36:21.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.962+0000 7f938a947640 1 -- 172.21.15.44:0/4073509416 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93700039d0 msgr2=0x7f9370003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.962+0000 7f938a947640 1 --2- 172.21.15.44:0/4073509416 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93700039d0 0x7f9370003e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9384071dd0 tx=0x7f93700057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.962+0000 7eff7b256640 1 Processor -- start 2023-11-04T01:36:21.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.962+0000 7eff7b256640 1 -- start start 2023-11-04T01:36:21.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f938a146640 1 -- 172.21.15.44:0/4073509416 reap_dead start 2023-11-04T01:36:21.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f938a947640 1 -- 172.21.15.44:0/4073509416 shutdown_connections 2023-11-04T01:36:21.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f938a947640 1 -- 172.21.15.44:0/4073509416 >> 172.21.15.44:0/4073509416 conn(0x7f938406a120 msgr2=0x7f938406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f6dd27fc640 1 --2- 172.21.15.44:0/4145576737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6dd40cde60 0x7f6dd40ce2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40ceec0 tx=0x7f6dc802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1449f729b6dc469b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f643bed4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f643406a830 0x7f643415f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7eff7b256640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7eff6c033f60 0x7eff6c0df8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7eff7b256640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6c054420 con 0x7eff6c00c220 2023-11-04T01:36:21.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7eff7b256640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6c0343d0 con 0x7eff6c053180 2023-11-04T01:36:21.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7eff7b256640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c053600 con 0x7eff6c033f60 2023-11-04T01:36:21.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f643bed4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f643406f280 0x7f6434151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f643bed4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643415cbf0 0x7f64340c3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f643bed4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64340c46a0 con 0x7f643406f280 2023-11-04T01:36:21.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f643bed4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64341520d0 con 0x7f643406a830 2023-11-04T01:36:21.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f643bed4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64340c3a90 con 0x7f643415cbf0 2023-11-04T01:36:21.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f6dd1ffb640 1 -- 172.21.15.44:0/4145576737 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8031870 con 0x7f6dd40cde60 2023-11-04T01:36:21.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7eff78ff2640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7eff6c00c220 0x7eff6c050260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36462/0 (socket says 172.21.15.44:36462) 2023-11-04T01:36:21.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7eff78ff2640 1 -- 172.21.15.44:0/914997004 learned_addr learned my addr 172.21.15.44:0/914997004 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:21.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f6dd1ffb640 1 -- 172.21.15.44:0/4145576737 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc80319d0 con 0x7f6dd40cde60 2023-11-04T01:36:21.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f6dd1ffb640 1 -- 172.21.15.44:0/4145576737 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8031d60 con 0x7f6dd40cde60 2023-11-04T01:36:21.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f373f1d2640 1 -- 172.21.15.44:0/883751016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37300e78b0 msgr2=0x7f373004f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f373f1d2640 1 --2- 172.21.15.44:0/883751016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37300e78b0 0x7f373004f260 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f373000dc10 tx=0x7f373402b7a0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f6439c70640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f643406a830 0x7f643415f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f6439c70640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f643406a830 0x7f643415f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44492/0 (socket says 172.21.15.44:44492) 2023-11-04T01:36:21.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f6439c70640 1 -- 172.21.15.44:0/4265069548 learned_addr learned my addr 172.21.15.44:0/4265069548 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:21.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f938a947640 1 -- 172.21.15.44:0/4073509416 shutdown_connections 2023-11-04T01:36:21.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.963+0000 7f938a947640 1 -- 172.21.15.44:0/4073509416 wait complete. 2023-11-04T01:36:21.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7f643a471640 1 --2- 172.21.15.44:0/4265069548 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643415cbf0 0x7f64340c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7f6439c70640 1 -- 172.21.15.44:0/4265069548 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643415cbf0 msgr2=0x7f64340c3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7f6439c70640 1 --2- 172.21.15.44:0/4265069548 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643415cbf0 0x7f64340c3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7f6439c70640 1 -- 172.21.15.44:0/4265069548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f643406f280 msgr2=0x7f6434151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7f6439c70640 1 --2- 172.21.15.44:0/4265069548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f643406f280 0x7f6434151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7f6439c70640 1 -- 172.21.15.44:0/4265069548 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6430009400 con 0x7f643406a830 2023-11-04T01:36:21.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7eff797f3640 1 --2- 172.21.15.44:0/914997004 >> v2:172.21.15.204:3300/0 conn(0x7eff6c033f60 0x7eff6c0df8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634678668 0 0) 0x7eff6c054420 con 0x7eff6c00c220 2023-11-04T01:36:21.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff64003520 con 0x7eff6c00c220 2023-11-04T01:36:21.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7f1dcc99e640 1 Processor -- start 2023-11-04T01:36:21.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7f1dcc99e640 1 -- start start 2023-11-04T01:36:21.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7f6172ffd640 1 --2- 172.21.15.44:0/4020442353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c0eb1b0 0x7f616c0eb5f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f616c00bc60 tx=0x7f616002b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379eda8fddc399fa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7f6439c70640 1 --2- 172.21.15.44:0/4265069548 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f643406a830 0x7f643415f4e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6430000c00 tx=0x7f64300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7f6dd3fff640 1 -- 172.21.15.44:0/4145576737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6dd40cde60 msgr2=0x7f6dd40ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7f6dd3fff640 1 --2- 172.21.15.44:0/4145576737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6dd40cde60 0x7f6dd40ce2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40ceec0 tx=0x7f6dc802b910 comp rx=0 tx=0).stop 2023-11-04T01:36:21.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f6dd3fff640 1 -- 172.21.15.44:0/4145576737 shutdown_connections 2023-11-04T01:36:21.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f6dd3fff640 1 --2- 172.21.15.44:0/4145576737 >> v2:172.21.15.44:3300/0 conn(0x7f6dd40ca520 0x7f6dd40ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f6dd3fff640 1 --2- 172.21.15.44:0/4145576737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6dd40cde60 0x7f6dd40ce2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f6dd3fff640 1 -- 172.21.15.44:0/4145576737 >> 172.21.15.44:0/4145576737 conn(0x7f6dd406f2e0 msgr2=0x7f6dd406f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361176306 0 0) 0x7eff6c0343d0 con 0x7eff6c053180 2023-11-04T01:36:21.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.964+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff64003840 con 0x7eff6c053180 2023-11-04T01:36:21.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4198212800 0 0) 0x7eff64003840 con 0x7eff6c053180 2023-11-04T01:36:21.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 >> v2:172.21.15.204:3300/0 conn(0x7eff6c033f60 msgr2=0x7eff6c0df8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7eff737fe640 1 --2- 172.21.15.44:0/914997004 >> v2:172.21.15.204:3300/0 conn(0x7eff6c033f60 0x7eff6c0df8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 >> v1:172.21.15.44:6789/0 conn(0x7eff6c00c220 legacy=0x7eff6c050260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 --> v1:172.21.15.204:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c053810 con 0x7eff6c053180 2023-11-04T01:36:21.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f642a7fc640 1 -- 172.21.15.44:0/4265069548 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643003ad60 con 0x7f643406a830 2023-11-04T01:36:21.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f642a7fc640 1 -- 172.21.15.44:0/4265069548 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64300443f0 con 0x7f643406a830 2023-11-04T01:36:21.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 <== mon.1 v1:172.21.15.204:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7eff68001650 con 0x7eff6c053180 2023-11-04T01:36:21.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 >> v1:172.21.15.204:6789/0 conn(0x7eff6c053180 legacy=0x7eff6c0061c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7eff737fe640 1 --2- 172.21.15.44:0/914997004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff64003d10 0x7eff64004150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7eff737fe640 1 --2- 172.21.15.44:0/914997004 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff640047c0 0x7eff64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7eff737fe640 1 --2- 172.21.15.44:0/914997004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff64005280 0x7eff6400b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c053600 con 0x7eff64005280 2023-11-04T01:36:21.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff640149b0 con 0x7eff640047c0 2023-11-04T01:36:21.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff64014b70 con 0x7eff64003d10 2023-11-04T01:36:21.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f642a7fc640 1 -- 172.21.15.44:0/4265069548 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64300445a0 con 0x7f643406a830 2023-11-04T01:36:21.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f1dcc99e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1dc80b4880 0x7f1dc80b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f1dcc99e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1dc80cd6d0 0x7f1dc80b7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f1dcc99e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dc8153e60 0x7f1dc80cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f1dcc99e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc813c3d0 con 0x7f1dc8153e60 2023-11-04T01:36:21.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f1dcc99e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80c9820 con 0x7f1dc80b4880 2023-11-04T01:36:21.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f1dcc99e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc813c7f0 con 0x7f1dc80cd6d0 2023-11-04T01:36:21.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f1dc5d9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1dc80cd6d0 0x7f1dc80b7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f1dc6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dc8153e60 0x7f1dc80cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f643bed4640 1 -- 172.21.15.44:0/4265069548 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64340c3d70 con 0x7f643406a830 2023-11-04T01:36:21.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f1dc5d9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1dc80cd6d0 0x7f1dc80b7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:60672/0 (socket says 172.21.15.44:60672) 2023-11-04T01:36:21.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f643bed4640 1 -- 172.21.15.44:0/4265069548 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64340c4330 con 0x7f643406a830 2023-11-04T01:36:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f61727fc640 1 -- 172.21.15.44:0/4020442353 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160031890 con 0x7f616c0eb1b0 2023-11-04T01:36:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f61727fc640 1 -- 172.21.15.44:0/4020442353 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61600319f0 con 0x7f616c0eb1b0 2023-11-04T01:36:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f61727fc640 1 -- 172.21.15.44:0/4020442353 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160031dc0 con 0x7f616c0eb1b0 2023-11-04T01:36:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f1dc5d9b640 1 -- 172.21.15.44:0/1140718901 learned_addr learned my addr 172.21.15.44:0/1140718901 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7eff73fff640 1 --2- 172.21.15.44:0/914997004 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff640047c0 0x7eff64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f6dd3fff640 1 -- 172.21.15.44:0/4145576737 shutdown_connections 2023-11-04T01:36:21.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f6dd3fff640 1 -- 172.21.15.44:0/4145576737 wait complete. 2023-11-04T01:36:21.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7eff78ff2640 1 --2- 172.21.15.44:0/914997004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff64003d10 0x7eff64004150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f1dc5d9b640 1 -- 172.21.15.44:0/1140718901 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1dc80b4880 msgr2=0x7f1dc80b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f1dc5d9b640 1 --2- 172.21.15.44:0/1140718901 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1dc80b4880 0x7f1dc80b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f1dc5d9b640 1 -- 172.21.15.44:0/1140718901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dc8153e60 msgr2=0x7f1dc80cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f1dc5d9b640 1 --2- 172.21.15.44:0/1140718901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dc8153e60 0x7f1dc80cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f938a947640 1 Processor -- start 2023-11-04T01:36:21.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7eff797f3640 1 --2- 172.21.15.44:0/914997004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff64005280 0x7eff6400b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f1dc5d9b640 1 -- 172.21.15.44:0/1140718901 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db8009400 con 0x7f1dc80cd6d0 2023-11-04T01:36:21.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f1dc6d9d640 1 --2- 172.21.15.44:0/1140718901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dc8153e60 0x7f1dc80cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:21.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f1dc5d9b640 1 --2- 172.21.15.44:0/1140718901 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1dc80cd6d0 0x7f1dc80b7690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00e860 tx=0x7f1dbc00ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.965+0000 7f938a947640 1 -- start start 2023-11-04T01:36:21.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f938a947640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93840c5800 0x7f9384158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f938a947640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93840c7420 0x7f93840c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f938a947640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93841ffa40 0x7f93840c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f938a947640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938415a330 con 0x7f93840c7420 2023-11-04T01:36:21.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f938a947640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93840c6660 con 0x7f93840c5800 2023-11-04T01:36:21.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.966+0000 7f938a947640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9384159720 con 0x7f93841ffa40 2023-11-04T01:36:21.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f6dd3fff640 1 Processor -- start 2023-11-04T01:36:21.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f938a146640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93841ffa40 0x7f93840c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f1db6ffd640 1 -- 172.21.15.44:0/1140718901 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0095f0 con 0x7f1dc80cd6d0 2023-11-04T01:36:21.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f1db6ffd640 1 -- 172.21.15.44:0/1140718901 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc00c940 con 0x7f1dc80cd6d0 2023-11-04T01:36:21.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f1db6ffd640 1 -- 172.21.15.44:0/1140718901 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc00ccd0 con 0x7f1dc80cd6d0 2023-11-04T01:36:21.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f1dcc99e640 1 -- 172.21.15.44:0/1140718901 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc813ba30 con 0x7f1dc80cd6d0 2023-11-04T01:36:21.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f9389945640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93840c5800 0x7f9384158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f9389945640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93840c5800 0x7f9384158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44518/0 (socket says 172.21.15.44:44518) 2023-11-04T01:36:21.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f9389945640 1 -- 172.21.15.44:0/970543189 learned_addr learned my addr 172.21.15.44:0/970543189 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:21.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f6178a9a640 1 -- 172.21.15.44:0/4020442353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c0eb1b0 msgr2=0x7f616c0eb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f6178a9a640 1 --2- 172.21.15.44:0/4020442353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c0eb1b0 0x7f616c0eb5f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f616c00bc60 tx=0x7f616002b930 comp rx=0 tx=0).stop 2023-11-04T01:36:21.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f6dd3fff640 1 -- start start 2023-11-04T01:36:21.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f9389144640 1 --2- 172.21.15.44:0/970543189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93840c7420 0x7f93840c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f643bed4640 1 -- 172.21.15.44:0/4265069548 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643404ece0 con 0x7f643406a830 2023-11-04T01:36:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f6178a9a640 1 -- 172.21.15.44:0/4020442353 shutdown_connections 2023-11-04T01:36:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f6178a9a640 1 --2- 172.21.15.44:0/4020442353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c0eb1b0 0x7f616c0eb5f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f6178a9a640 1 --2- 172.21.15.44:0/4020442353 >> v2:172.21.15.204:3300/0 conn(0x7f616c0e77a0 0x7f616c04f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f6178a9a640 1 -- 172.21.15.44:0/4020442353 >> 172.21.15.44:0/4020442353 conn(0x7f616c054b00 msgr2=0x7f616c054ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f6178a9a640 1 -- 172.21.15.44:0/4020442353 shutdown_connections 2023-11-04T01:36:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f373f1d2640 1 -- 172.21.15.44:0/883751016 shutdown_connections 2023-11-04T01:36:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f373f1d2640 1 --2- 172.21.15.44:0/883751016 >> v2:172.21.15.44:3300/0 conn(0x7f3730052fe0 0x7f3730053470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f373f1d2640 1 --2- 172.21.15.44:0/883751016 >> v2:172.21.15.204:3300/0 conn(0x7f37300eb2c0 0x7f37300eb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f373f1d2640 1 --2- 172.21.15.44:0/883751016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37300e78b0 0x7f373004f260 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f373f1d2640 1 -- 172.21.15.44:0/883751016 >> 172.21.15.44:0/883751016 conn(0x7f3730054c10 msgr2=0x7f3730054ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f9389945640 1 -- 172.21.15.44:0/970543189 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93841ffa40 msgr2=0x7f93840c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f9389945640 1 --2- 172.21.15.44:0/970543189 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93841ffa40 0x7f93840c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f9389945640 1 -- 172.21.15.44:0/970543189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93840c7420 msgr2=0x7f93840c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f9389945640 1 --2- 172.21.15.44:0/970543189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93840c7420 0x7f93840c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f9389945640 1 -- 172.21.15.44:0/970543189 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9384159a00 con 0x7f93840c5800 2023-11-04T01:36:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f6dd3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6dd40ca520 0x7f6dd4152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7eff78ff2640 1 -- 172.21.15.44:0/914997004 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff640047c0 msgr2=0x7eff64004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7eff78ff2640 1 --2- 172.21.15.44:0/914997004 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff640047c0 0x7eff64004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7eff78ff2640 1 -- 172.21.15.44:0/914997004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff64005280 msgr2=0x7eff6400b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7eff78ff2640 1 --2- 172.21.15.44:0/914997004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff64005280 0x7eff6400b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7eff78ff2640 1 -- 172.21.15.44:0/914997004 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c053810 con 0x7eff64003d10 2023-11-04T01:36:21.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7eff797f3640 1 -- 172.21.15.44:0/914997004 reap_dead start 2023-11-04T01:36:21.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f6dd3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6dd40ccf00 0x7f6dd41530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f1dcc99e640 1 -- 172.21.15.44:0/1140718901 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc813bff0 con 0x7f1dc80cd6d0 2023-11-04T01:36:21.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f373f1d2640 1 -- 172.21.15.44:0/883751016 shutdown_connections 2023-11-04T01:36:21.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f9389945640 1 --2- 172.21.15.44:0/970543189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93840c5800 0x7f9384158e20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f937c02c600 tx=0x7f937c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f937a7fc640 1 -- 172.21.15.44:0/970543189 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c03e610 con 0x7f93840c5800 2023-11-04T01:36:21.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f6dd2ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6dd40ca520 0x7f6dd4152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f6dd2ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6dd40ca520 0x7f6dd4152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:60682/0 (socket says 172.21.15.44:60682) 2023-11-04T01:36:21.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f6dd2ffd640 1 -- 172.21.15.44:0/3674429759 learned_addr learned my addr 172.21.15.44:0/3674429759 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:21.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f6dd3fff640 1 --2- 172.21.15.44:0/3674429759 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6dd40cde60 0x7f6dd40b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f937a7fc640 1 -- 172.21.15.44:0/970543189 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c03e790 con 0x7f93840c5800 2023-11-04T01:36:21.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f937a7fc640 1 -- 172.21.15.44:0/970543189 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c03eb40 con 0x7f93840c5800 2023-11-04T01:36:21.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f642a7fc640 1 -- 172.21.15.44:0/4265069548 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f643004d450 con 0x7f643406a830 2023-11-04T01:36:21.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f6dd3fff640 1 -- 172.21.15.44:0/3674429759 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4153630 con 0x7f6dd40ccf00 2023-11-04T01:36:21.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f6dd3fff640 1 -- 172.21.15.44:0/3674429759 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4150be0 con 0x7f6dd40cde60 2023-11-04T01:36:21.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f6dd3fff640 1 -- 172.21.15.44:0/3674429759 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd41511a0 con 0x7f6dd40ca520 2023-11-04T01:36:21.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7eff78ff2640 1 --2- 172.21.15.44:0/914997004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff64003d10 0x7eff64004150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff74074540 tx=0x7eff640057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0d110e7f8180b90 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f6dd37fe640 1 --2- 172.21.15.44:0/3674429759 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6dd40cde60 0x7f6dd40b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.969+0000 7f6dd27fc640 1 --2- 172.21.15.44:0/3674429759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6dd40ccf00 0x7f6dd41530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.969+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff740a6cc0 con 0x7eff64003d10 2023-11-04T01:36:21.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.969+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff740a6e60 con 0x7eff64003d10 2023-11-04T01:36:21.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.969+0000 7eff737fe640 1 -- 172.21.15.44:0/914997004 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff740a6cc0 con 0x7eff64003d10 2023-11-04T01:36:21.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.969+0000 7f642a7fc640 1 --2- 172.21.15.44:0/4265069548 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f641806af40 0x7f641806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.969+0000 7f6dd37fe640 1 -- 172.21.15.44:0/3674429759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6dd40ca520 msgr2=0x7f6dd4152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.968+0000 7f373f1d2640 1 -- 172.21.15.44:0/883751016 wait complete. 2023-11-04T01:36:21.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.969+0000 7f6dd37fe640 1 --2- 172.21.15.44:0/3674429759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6dd40ca520 0x7f6dd4152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.969+0000 7f6dd37fe640 1 -- 172.21.15.44:0/3674429759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6dd40ccf00 msgr2=0x7f6dd41530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.969+0000 7f6dd37fe640 1 --2- 172.21.15.44:0/3674429759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6dd40ccf00 0x7f6dd41530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.969+0000 7f6dd37fe640 1 -- 172.21.15.44:0/3674429759 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc80094d0 con 0x7f6dd40cde60 2023-11-04T01:36:21.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.969+0000 7f6dd37fe640 1 --2- 172.21.15.44:0/3674429759 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6dd40cde60 0x7f6dd40b2f60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009d90 tx=0x7f6dcc00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.967+0000 7f6178a9a640 1 -- 172.21.15.44:0/4020442353 wait complete. 2023-11-04T01:36:21.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7f1dcc99e640 1 -- 172.21.15.44:0/1140718901 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc813c510 con 0x7f1dc80cd6d0 2023-11-04T01:36:21.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7f938a947640 1 -- 172.21.15.44:0/970543189 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93840c6660 con 0x7f93840c5800 2023-11-04T01:36:21.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7f6178a9a640 1 Processor -- start 2023-11-04T01:36:21.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7f642a7fc640 1 -- 172.21.15.44:0/4265069548 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f64300abac0 con 0x7f643406a830 2023-11-04T01:36:21.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7f373f1d2640 1 Processor -- start 2023-11-04T01:36:21.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7f643946f640 1 --2- 172.21.15.44:0/4265069548 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f641806af40 0x7f641806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7eff7b256640 1 -- 172.21.15.44:0/914997004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff64003d10 msgr2=0x7eff64004150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7eff7b256640 1 --2- 172.21.15.44:0/914997004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff64003d10 0x7eff64004150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff74074540 tx=0x7eff640057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7f938a947640 1 -- 172.21.15.44:0/970543189 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9384159fc0 con 0x7f93840c5800 2023-11-04T01:36:21.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7f6178a9a640 1 -- start start 2023-11-04T01:36:21.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7eff7b256640 1 -- 172.21.15.44:0/914997004 shutdown_connections 2023-11-04T01:36:21.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7eff7b256640 1 --2- 172.21.15.44:0/914997004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff64003d10 0x7eff64004150 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7eff7b256640 1 -- 172.21.15.44:0/914997004 >> 172.21.15.44:0/914997004 conn(0x7eff6c054c40 msgr2=0x7eff6c055020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7f373f1d2640 1 -- start start 2023-11-04T01:36:21.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7eff7b256640 1 -- 172.21.15.44:0/914997004 shutdown_connections 2023-11-04T01:36:21.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.970+0000 7f1db6ffd640 1 -- 172.21.15.44:0/1140718901 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1dbc013470 con 0x7f1dc80cd6d0 2023-11-04T01:36:21.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7eff7b256640 1 -- 172.21.15.44:0/914997004 wait complete. 2023-11-04T01:36:21.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f643946f640 1 --2- 172.21.15.44:0/4265069548 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f641806af40 0x7f641806d400 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f642c002360 tx=0x7f642c001530 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f1db6ffd640 1 --2- 172.21.15.44:0/1140718901 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1da806aec0 0x7f1da806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f938a947640 1 -- 172.21.15.44:0/970543189 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938404ece0 con 0x7f93840c5800 2023-11-04T01:36:21.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f1db6ffd640 1 -- 172.21.15.44:0/1140718901 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1dbc089230 con 0x7f1dc80cd6d0 2023-11-04T01:36:21.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f373f1d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3730052fe0 0x7f37300cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f1dc659c640 1 --2- 172.21.15.44:0/1140718901 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1da806aec0 0x7f1da806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f6178a9a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f616c052ed0 0x7f616c0dd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f373f1d2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37300e78b0 0x7f373004a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f373f1d2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37300eb2c0 0x7f373004ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f6178a9a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c0e77a0 0x7f616c04a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f6178a9a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f616c0eb1b0 0x7f616c0d2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f373f1d2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37300e3680 con 0x7f3730052fe0 2023-11-04T01:36:21.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f373f1d2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3730049790 con 0x7f37300e78b0 2023-11-04T01:36:21.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f373f1d2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3730049a30 con 0x7f37300eb2c0 2023-11-04T01:36:21.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f6178a9a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0dd150 con 0x7f616c0e77a0 2023-11-04T01:36:21.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f6178a9a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c04b030 con 0x7f616c0eb1b0 2023-11-04T01:36:21.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.971+0000 7f6178a9a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0d3390 con 0x7f616c052ed0 2023-11-04T01:36:21.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f61737fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f616c052ed0 0x7f616c0dd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f61737fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f616c052ed0 0x7f616c0dd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:60696/0 (socket says 172.21.15.44:60696) 2023-11-04T01:36:21.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f61737fe640 1 -- 172.21.15.44:0/3698507245 learned_addr learned my addr 172.21.15.44:0/3698507245 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:21.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f373e1d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3730052fe0 0x7f37300cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f373e1d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3730052fe0 0x7f37300cfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49210/0 (socket says 172.21.15.44:49210) 2023-11-04T01:36:21.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f6173fff640 1 --2- 172.21.15.44:0/3698507245 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f616c0eb1b0 0x7f616c0d2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f373e1d0640 1 -- 172.21.15.44:0/3021168816 learned_addr learned my addr 172.21.15.44:0/3021168816 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:21.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f373e9d1640 1 --2- 172.21.15.44:0/3021168816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37300eb2c0 0x7f373004ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f373d9cf640 1 --2- 172.21.15.44:0/3021168816 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37300e78b0 0x7f373004a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f6172ffd640 1 --2- 172.21.15.44:0/3698507245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c0e77a0 0x7f616c04a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f61737fe640 1 -- 172.21.15.44:0/3698507245 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f616c0eb1b0 msgr2=0x7f616c0d2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f61737fe640 1 --2- 172.21.15.44:0/3698507245 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f616c0eb1b0 0x7f616c0d2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f373e9d1640 1 -- 172.21.15.44:0/3021168816 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37300e78b0 msgr2=0x7f373004a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f373e9d1640 1 --2- 172.21.15.44:0/3021168816 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37300e78b0 0x7f373004a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f373e9d1640 1 -- 172.21.15.44:0/3021168816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3730052fe0 msgr2=0x7f37300cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f373e9d1640 1 --2- 172.21.15.44:0/3021168816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3730052fe0 0x7f37300cfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f373e9d1640 1 -- 172.21.15.44:0/3021168816 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37280094d0 con 0x7f37300eb2c0 2023-11-04T01:36:21.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f61737fe640 1 -- 172.21.15.44:0/3698507245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c0e77a0 msgr2=0x7f616c04a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f61737fe640 1 --2- 172.21.15.44:0/3698507245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c0e77a0 0x7f616c04a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f1dc659c640 1 --2- 172.21.15.44:0/1140718901 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1da806aec0 0x7f1da806d380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1db8036000 tx=0x7f1db8030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f61737fe640 1 -- 172.21.15.44:0/3698507245 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61600094d0 con 0x7f616c052ed0 2023-11-04T01:36:21.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f373e1d0640 1 --2- 172.21.15.44:0/3021168816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3730052fe0 0x7f37300cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:21.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f61737fe640 1 --2- 172.21.15.44:0/3698507245 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f616c052ed0 0x7f616c0dd350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f616800e8a0 tx=0x7f616800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.972+0000 7f373e9d1640 1 --2- 172.21.15.44:0/3021168816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37300eb2c0 0x7f373004ad30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3738064180 tx=0x7f3738067460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.973+0000 7eff7b256640 1 Processor -- start 2023-11-04T01:36:21.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.973+0000 7eff7b256640 1 -- start start 2023-11-04T01:36:21.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.973+0000 7f6dbb7fe640 1 -- 172.21.15.44:0/3674429759 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc014480 con 0x7f6dd40cde60 2023-11-04T01:36:21.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.974+0000 7f6dd3fff640 1 -- 172.21.15.44:0/3674429759 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd41f4540 con 0x7f6dd40cde60 2023-11-04T01:36:21.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.974+0000 7f6dd3fff640 1 -- 172.21.15.44:0/3674429759 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd40b3fc0 con 0x7f6dd40cde60 2023-11-04T01:36:21.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.974+0000 7f642a7fc640 1 -- 172.21.15.44:0/4265069548 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f64300ade60 con 0x7f643406a830 2023-11-04T01:36:21.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.974+0000 7f6dbb7fe640 1 -- 172.21.15.44:0/3674429759 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc00f040 con 0x7f6dd40cde60 2023-11-04T01:36:21.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.974+0000 7f6dbb7fe640 1 -- 172.21.15.44:0/3674429759 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc0147e0 con 0x7f6dd40cde60 2023-11-04T01:36:21.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.974+0000 7eff7b256640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff64003d10 0x7eff6c0d4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.974+0000 7eff7b256640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff6c0db270 0x7eff6c034d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.974+0000 7eff7b256640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff6c035270 0x7eff6c0368d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.974+0000 7eff7b256640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c035720 con 0x7eff6c035270 2023-11-04T01:36:21.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.974+0000 7eff7b256640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c0da1d0 con 0x7eff6c0db270 2023-11-04T01:36:21.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.974+0000 7eff7b256640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c0da4b0 con 0x7eff64003d10 2023-11-04T01:36:21.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.974+0000 7eff73fff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff6c0db270 0x7eff6c034d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.974+0000 7eff73fff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff6c0db270 0x7eff6c034d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:44562/0 (socket says 172.21.15.44:44562) 2023-11-04T01:36:21.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.974+0000 7eff73fff640 1 -- 172.21.15.44:0/985387667 learned_addr learned my addr 172.21.15.44:0/985387667 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:21.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.974+0000 7eff78ff2640 1 --2- 172.21.15.44:0/985387667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff64003d10 0x7eff6c0d4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.975+0000 7eff73fff640 1 -- 172.21.15.44:0/985387667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff64003d10 msgr2=0x7eff6c0d4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.975+0000 7eff73fff640 1 --2- 172.21.15.44:0/985387667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff64003d10 0x7eff6c0d4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.975+0000 7eff73fff640 1 -- 172.21.15.44:0/985387667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff6c035270 msgr2=0x7eff6c0368d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:36:21.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.975+0000 7eff797f3640 1 --2- 172.21.15.44:0/985387667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff6c035270 0x7eff6c0368d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.975+0000 7eff73fff640 1 --2- 172.21.15.44:0/985387667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff6c035270 0x7eff6c0368d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.975+0000 7eff73fff640 1 -- 172.21.15.44:0/985387667 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c0da790 con 0x7eff6c0db270 2023-11-04T01:36:21.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.975+0000 7eff797f3640 1 --2- 172.21.15.44:0/985387667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff6c035270 0x7eff6c0368d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:21.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.975+0000 7f6dd3fff640 1 -- 172.21.15.44:0/3674429759 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db4005250 con 0x7f6dd40cde60 2023-11-04T01:36:21.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.975+0000 7eff73fff640 1 --2- 172.21.15.44:0/985387667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff6c0db270 0x7eff6c034d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff6800f7e0 tx=0x7eff6800fca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.975+0000 7f937a7fc640 1 -- 172.21.15.44:0/970543189 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f937c03b050 con 0x7f93840c5800 2023-11-04T01:36:21.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.976+0000 7f6dbb7fe640 1 -- 172.21.15.44:0/3674429759 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6dcc014940 con 0x7f6dd40cde60 2023-11-04T01:36:21.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.976+0000 7f937a7fc640 1 --2- 172.21.15.44:0/970543189 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f936806aef0 0x7f936806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.976+0000 7f615ffff640 1 -- 172.21.15.44:0/3698507245 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61680094f0 con 0x7f616c052ed0 2023-11-04T01:36:21.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.976+0000 7f615ffff640 1 -- 172.21.15.44:0/3698507245 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616800c940 con 0x7f616c052ed0 2023-11-04T01:36:21.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.976+0000 7f615ffff640 1 -- 172.21.15.44:0/3698507245 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616800ccf0 con 0x7f616c052ed0 2023-11-04T01:36:21.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.976+0000 7f372effd640 1 -- 172.21.15.44:0/3021168816 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3738073210 con 0x7f37300eb2c0 2023-11-04T01:36:21.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.976+0000 7f372effd640 1 -- 172.21.15.44:0/3021168816 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3738093430 con 0x7f37300eb2c0 2023-11-04T01:36:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.976+0000 7f1db6ffd640 1 -- 172.21.15.44:0/1140718901 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1dc813c510 con 0x7f1dc80cd6d0 2023-11-04T01:36:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.976+0000 7f372effd640 1 -- 172.21.15.44:0/3021168816 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3738093800 con 0x7f37300eb2c0 2023-11-04T01:36:21.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.976+0000 7f937a7fc640 1 -- 172.21.15.44:0/970543189 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f937c0ac140 con 0x7f93840c5800 2023-11-04T01:36:21.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.976+0000 7f9389144640 1 --2- 172.21.15.44:0/970543189 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f936806aef0 0x7f936806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.976+0000 7f6dbb7fe640 1 --2- 172.21.15.44:0/3674429759 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6dc006ae70 0x7f6dc006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.976+0000 7f373f1d2640 1 -- 172.21.15.44:0/3021168816 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3734009400 con 0x7f37300eb2c0 2023-11-04T01:36:21.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.976+0000 7f6178a9a640 1 -- 172.21.15.44:0/3698507245 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c04a790 con 0x7f616c052ed0 2023-11-04T01:36:21.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.976+0000 7f373f1d2640 1 -- 172.21.15.44:0/3021168816 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3730049ff0 con 0x7f37300eb2c0 2023-11-04T01:36:21.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.977+0000 7f6dd2ffd640 1 --2- 172.21.15.44:0/3674429759 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6dc006ae70 0x7f6dc006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.977+0000 7f6178a9a640 1 -- 172.21.15.44:0/3698507245 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616c04ad50 con 0x7f616c052ed0 2023-11-04T01:36:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.977+0000 7f9389144640 1 --2- 172.21.15.44:0/970543189 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f936806aef0 0x7f936806d3b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9374001780 tx=0x7f9374001590 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.978+0000 7f373f1d2640 1 -- 172.21.15.44:0/3021168816 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3730005490 con 0x7f37300eb2c0 2023-11-04T01:36:21.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.978+0000 7f6178a9a640 1 -- 172.21.15.44:0/3698507245 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616c005340 con 0x7f616c052ed0 2023-11-04T01:36:21.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.978+0000 7f6dd2ffd640 1 --2- 172.21.15.44:0/3674429759 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6dc006ae70 0x7f6dc006d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4005020 tx=0x7f6dc4007ef0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.978+0000 7f615ffff640 1 -- 172.21.15.44:0/3698507245 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6168013470 con 0x7f616c052ed0 2023-11-04T01:36:21.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.979+0000 7f372effd640 1 -- 172.21.15.44:0/3021168816 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3738093960 con 0x7f37300eb2c0 2023-11-04T01:36:21.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.979+0000 7f372effd640 1 --2- 172.21.15.44:0/3021168816 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f371c06ae70 0x7f371c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.979+0000 7f615ffff640 1 --2- 172.21.15.44:0/3698507245 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f615806aec0 0x7f615806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.979+0000 7f6dbb7fe640 1 -- 172.21.15.44:0/3674429759 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6dcc0598f0 con 0x7f6dd40cde60 2023-11-04T01:36:21.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.979+0000 7eff717fa640 1 -- 172.21.15.44:0/985387667 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff680052e0 con 0x7eff6c0db270 2023-11-04T01:36:21.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.979+0000 7f6172ffd640 1 --2- 172.21.15.44:0/3698507245 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f615806aec0 0x7f615806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.979+0000 7f372effd640 1 -- 172.21.15.44:0/3021168816 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3738103ed0 con 0x7f37300eb2c0 2023-11-04T01:36:21.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.979+0000 7f937a7fc640 1 -- 172.21.15.44:0/970543189 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f937c077020 con 0x7f93840c5800 2023-11-04T01:36:21.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.979+0000 7eff7b256640 1 -- 172.21.15.44:0/985387667 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6c0daa70 con 0x7eff6c0db270 2023-11-04T01:36:21.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.980+0000 7f615ffff640 1 -- 172.21.15.44:0/3698507245 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f61680897e0 con 0x7f616c052ed0 2023-11-04T01:36:21.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.980+0000 7eff7b256640 1 -- 172.21.15.44:0/985387667 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6c0d4680 con 0x7eff6c0db270 2023-11-04T01:36:21.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.980+0000 7f373e1d0640 1 --2- 172.21.15.44:0/3021168816 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f371c06ae70 0x7f371c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.980+0000 7f6172ffd640 1 --2- 172.21.15.44:0/3698507245 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f615806aec0 0x7f615806d380 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6160036000 tx=0x7f616003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.980+0000 7f373e1d0640 1 --2- 172.21.15.44:0/3021168816 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f371c06ae70 0x7f371c06d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3734000c00 tx=0x7f3734008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.981+0000 7eff7b256640 1 -- 172.21.15.44:0/985387667 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6c0daf90 con 0x7eff6c0db270 2023-11-04T01:36:21.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.984+0000 7f372effd640 1 -- 172.21.15.44:0/3021168816 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f37380ced30 con 0x7f37300eb2c0 2023-11-04T01:36:21.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.984+0000 7eff717fa640 1 -- 172.21.15.44:0/985387667 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff68005440 con 0x7eff6c0db270 2023-11-04T01:36:21.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.984+0000 7eff717fa640 1 -- 172.21.15.44:0/985387667 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6800d8d0 con 0x7eff6c0db270 2023-11-04T01:36:21.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.984+0000 7f6dbb7fe640 1 -- 172.21.15.44:0/3674429759 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6dcc055530 con 0x7f6dd40cde60 2023-11-04T01:36:21.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.986+0000 7eff717fa640 1 -- 172.21.15.44:0/985387667 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff6800da30 con 0x7eff6c0db270 2023-11-04T01:36:21.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.987+0000 7eff717fa640 1 --2- 172.21.15.44:0/985387667 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff5806aea0 0x7eff5806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.987+0000 7eff717fa640 1 -- 172.21.15.44:0/985387667 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff6808a210 con 0x7eff6c0db270 2023-11-04T01:36:21.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.987+0000 7eff78ff2640 1 --2- 172.21.15.44:0/985387667 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff5806aea0 0x7eff5806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.988+0000 7eff78ff2640 1 --2- 172.21.15.44:0/985387667 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff5806aea0 0x7eff5806d360 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7eff64014d00 tx=0x7eff740a9000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.988+0000 7f615ffff640 1 -- 172.21.15.44:0/3698507245 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f61680547c0 con 0x7f616c052ed0 2023-11-04T01:36:21.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:20.988+0000 7eff717fa640 1 -- 172.21.15.44:0/985387667 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7eff68054fb0 con 0x7eff6c0db270 2023-11-04T01:36:21.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.342+0000 7fa49211d640 1 -- 172.21.15.44:0/2033665080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa4840e2c70 con 0x7fa4840cebf0 2023-11-04T01:36:21.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.343+0000 7fa477fff640 1 -- 172.21.15.44:0/2033665080 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4840e2c70 con 0x7fa4840cebf0 2023-11-04T01:36:21.345 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2023-11-04T01:36:21.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.346+0000 7fa475ffb640 1 -- 172.21.15.44:0/2033665080 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa47006afc0 msgr2=0x7fa47006d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.346+0000 7fa475ffb640 1 --2- 172.21.15.44:0/2033665080 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa47006afc0 0x7fa47006d480 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa484003f30 tx=0x7fa480008040 comp rx=0 tx=0).stop 2023-11-04T01:36:21.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.346+0000 7fa475ffb640 1 -- 172.21.15.44:0/2033665080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4840cebf0 msgr2=0x7fa4840cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.346+0000 7fa475ffb640 1 --2- 172.21.15.44:0/2033665080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4840cebf0 0x7fa4840cf070 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa48c069740 tx=0x7fa48c072e90 comp rx=0 tx=0).stop 2023-11-04T01:36:21.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.347+0000 7fa475ffb640 1 -- 172.21.15.44:0/2033665080 shutdown_connections 2023-11-04T01:36:21.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.347+0000 7fa475ffb640 1 --2- 172.21.15.44:0/2033665080 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa47006afc0 0x7fa47006d480 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.347+0000 7fa475ffb640 1 --2- 172.21.15.44:0/2033665080 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4840debb0 0x7fa4840df010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.347+0000 7fa475ffb640 1 --2- 172.21.15.44:0/2033665080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4840cebf0 0x7fa4840cf070 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.347+0000 7fa475ffb640 1 --2- 172.21.15.44:0/2033665080 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa47c004f00 0x7fa4840d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.347+0000 7fa475ffb640 1 -- 172.21.15.44:0/2033665080 >> 172.21.15.44:0/2033665080 conn(0x7fa484055c10 msgr2=0x7fa484053900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.347+0000 7fa475ffb640 1 -- 172.21.15.44:0/2033665080 shutdown_connections 2023-11-04T01:36:21.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.347+0000 7fa475ffb640 1 -- 172.21.15.44:0/2033665080 wait complete. 2023-11-04T01:36:21.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2023-11-04T01:36:21.366 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:21.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.374+0000 7f938a947640 1 -- 172.21.15.44:0/970543189 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f93840cbd40 con 0x7f93840c5800 2023-11-04T01:36:21.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.375+0000 7f937a7fc640 1 -- 172.21.15.44:0/970543189 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f937c039020 con 0x7f93840c5800 2023-11-04T01:36:21.380 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2023-11-04T01:36:21.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.377+0000 7f938a947640 1 -- 172.21.15.44:0/970543189 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f936806aef0 msgr2=0x7f936806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.377+0000 7f938a947640 1 --2- 172.21.15.44:0/970543189 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f936806aef0 0x7f936806d3b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9374001780 tx=0x7f9374001590 comp rx=0 tx=0).stop 2023-11-04T01:36:21.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.377+0000 7f938a947640 1 -- 172.21.15.44:0/970543189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93840c5800 msgr2=0x7f9384158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.377+0000 7f938a947640 1 --2- 172.21.15.44:0/970543189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93840c5800 0x7f9384158e20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f937c02c600 tx=0x7f937c004ab0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.377+0000 7f938a947640 1 -- 172.21.15.44:0/970543189 shutdown_connections 2023-11-04T01:36:21.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.377+0000 7f938a947640 1 --2- 172.21.15.44:0/970543189 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f936806aef0 0x7f936806d3b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.377+0000 7f938a947640 1 --2- 172.21.15.44:0/970543189 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93841ffa40 0x7f93840c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.377+0000 7f938a947640 1 --2- 172.21.15.44:0/970543189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93840c7420 0x7f93840c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.377+0000 7f938a947640 1 --2- 172.21.15.44:0/970543189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93840c5800 0x7f9384158e20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.377+0000 7f938a947640 1 -- 172.21.15.44:0/970543189 >> 172.21.15.44:0/970543189 conn(0x7f938406a120 msgr2=0x7f938414f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.377+0000 7f938a947640 1 -- 172.21.15.44:0/970543189 shutdown_connections 2023-11-04T01:36:21.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.377+0000 7f938a947640 1 -- 172.21.15.44:0/970543189 wait complete. 2023-11-04T01:36:21.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.381+0000 7f1dcc99e640 1 -- 172.21.15.44:0/1140718901 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1dc813c510 con 0x7f1dc80cd6d0 2023-11-04T01:36:21.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.382+0000 7f1db6ffd640 1 -- 172.21.15.44:0/1140718901 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1dc813c510 con 0x7f1dc80cd6d0 2023-11-04T01:36:21.384 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2023-11-04T01:36:21.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.384+0000 7f643bed4640 1 -- 172.21.15.44:0/4265069548 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6434067180 con 0x7f643406a830 2023-11-04T01:36:21.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.384+0000 7f642a7fc640 1 -- 172.21.15.44:0/4265069548 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6430035020 con 0x7f643406a830 2023-11-04T01:36:21.387 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2023-11-04T01:36:21.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.386+0000 7f1dcc99e640 1 -- 172.21.15.44:0/1140718901 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1da806aec0 msgr2=0x7f1da806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.386+0000 7f1dcc99e640 1 --2- 172.21.15.44:0/1140718901 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1da806aec0 0x7f1da806d380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1db8036000 tx=0x7f1db8030000 comp rx=0 tx=0).stop 2023-11-04T01:36:21.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.386+0000 7f1dcc99e640 1 -- 172.21.15.44:0/1140718901 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1dc80cd6d0 msgr2=0x7f1dc80b7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.386+0000 7f1dcc99e640 1 --2- 172.21.15.44:0/1140718901 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1dc80cd6d0 0x7f1dc80b7690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00e860 tx=0x7f1dbc00ed20 comp rx=0 tx=0).stop 2023-11-04T01:36:21.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.386+0000 7f1dcc99e640 1 -- 172.21.15.44:0/1140718901 shutdown_connections 2023-11-04T01:36:21.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.386+0000 7f1dcc99e640 1 --2- 172.21.15.44:0/1140718901 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1da806aec0 0x7f1da806d380 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.386+0000 7f1dcc99e640 1 --2- 172.21.15.44:0/1140718901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dc8153e60 0x7f1dc80cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.386+0000 7f1dcc99e640 1 --2- 172.21.15.44:0/1140718901 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1dc80cd6d0 0x7f1dc80b7690 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.386+0000 7f1dcc99e640 1 --2- 172.21.15.44:0/1140718901 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1dc80b4880 0x7f1dc80b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.386+0000 7f1dcc99e640 1 -- 172.21.15.44:0/1140718901 >> 172.21.15.44:0/1140718901 conn(0x7f1dc80cf880 msgr2=0x7f1dc815e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.386+0000 7f1dcc99e640 1 -- 172.21.15.44:0/1140718901 shutdown_connections 2023-11-04T01:36:21.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.386+0000 7f1dcc99e640 1 -- 172.21.15.44:0/1140718901 wait complete. 2023-11-04T01:36:21.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.387+0000 7f643bed4640 1 -- 172.21.15.44:0/4265069548 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f641806af40 msgr2=0x7f641806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.387+0000 7f643bed4640 1 --2- 172.21.15.44:0/4265069548 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f641806af40 0x7f641806d400 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f642c002360 tx=0x7f642c001530 comp rx=0 tx=0).stop 2023-11-04T01:36:21.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.388+0000 7f643bed4640 1 -- 172.21.15.44:0/4265069548 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f643406a830 msgr2=0x7f643415f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.388+0000 7f643bed4640 1 --2- 172.21.15.44:0/4265069548 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f643406a830 0x7f643415f4e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6430000c00 tx=0x7f64300046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.388+0000 7f643bed4640 1 -- 172.21.15.44:0/4265069548 shutdown_connections 2023-11-04T01:36:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.388+0000 7f643bed4640 1 --2- 172.21.15.44:0/4265069548 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f641806af40 0x7f641806d400 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.388+0000 7f643bed4640 1 --2- 172.21.15.44:0/4265069548 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643415cbf0 0x7f64340c3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.388+0000 7f643bed4640 1 --2- 172.21.15.44:0/4265069548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f643406f280 0x7f6434151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.388+0000 7f643bed4640 1 --2- 172.21.15.44:0/4265069548 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f643406a830 0x7f643415f4e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.388+0000 7f643bed4640 1 -- 172.21.15.44:0/4265069548 >> 172.21.15.44:0/4265069548 conn(0x7f64340cc100 msgr2=0x7f643415acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.388+0000 7f643bed4640 1 -- 172.21.15.44:0/4265069548 shutdown_connections 2023-11-04T01:36:21.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.388+0000 7f643bed4640 1 -- 172.21.15.44:0/4265069548 wait complete. 2023-11-04T01:36:21.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-11-04T01:36:21.395 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:21.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.395+0000 7f6dd3fff640 1 -- 172.21.15.44:0/3674429759 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6db4005500 con 0x7f6dd40cde60 2023-11-04T01:36:21.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.395+0000 7eff7b256640 1 -- 172.21.15.44:0/985387667 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7eff6c0daf90 con 0x7eff6c0db270 2023-11-04T01:36:21.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.396+0000 7f6dbb7fe640 1 -- 172.21.15.44:0/3674429759 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6dcc018090 con 0x7f6dd40cde60 2023-11-04T01:36:21.399 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2023-11-04T01:36:21.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.396+0000 7eff717fa640 1 -- 172.21.15.44:0/985387667 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff6c0daf90 con 0x7eff6c0db270 2023-11-04T01:36:21.400 INFO:teuthology.orchestra.run.smithi044.stdout:55834574857 2023-11-04T01:36:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.398+0000 7eff7b256640 1 -- 172.21.15.44:0/985387667 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff5806aea0 msgr2=0x7eff5806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.398+0000 7f373f1d2640 1 -- 172.21.15.44:0/3021168816 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f373003a6e0 con 0x7f37300eb2c0 2023-11-04T01:36:21.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.398+0000 7eff7b256640 1 --2- 172.21.15.44:0/985387667 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff5806aea0 0x7eff5806d360 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7eff64014d00 tx=0x7eff740a9000 comp rx=0 tx=0).stop 2023-11-04T01:36:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.398+0000 7eff7b256640 1 -- 172.21.15.44:0/985387667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff6c0db270 msgr2=0x7eff6c034d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.398+0000 7eff7b256640 1 --2- 172.21.15.44:0/985387667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff6c0db270 0x7eff6c034d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff6800f7e0 tx=0x7eff6800fca0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7eff7b256640 1 -- 172.21.15.44:0/985387667 shutdown_connections 2023-11-04T01:36:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7eff7b256640 1 --2- 172.21.15.44:0/985387667 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff5806aea0 0x7eff5806d360 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7eff7b256640 1 --2- 172.21.15.44:0/985387667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff6c035270 0x7eff6c0368d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7eff7b256640 1 --2- 172.21.15.44:0/985387667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff6c0db270 0x7eff6c034d30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7eff7b256640 1 --2- 172.21.15.44:0/985387667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff64003d10 0x7eff6c0d4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7eff7b256640 1 -- 172.21.15.44:0/985387667 >> 172.21.15.44:0/985387667 conn(0x7eff6c054c40 msgr2=0x7eff6c0def20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7eff7b256640 1 -- 172.21.15.44:0/985387667 shutdown_connections 2023-11-04T01:36:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7eff7b256640 1 -- 172.21.15.44:0/985387667 wait complete. 2023-11-04T01:36:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7f372effd640 1 -- 172.21.15.44:0/3021168816 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37380d2350 con 0x7f37300eb2c0 2023-11-04T01:36:21.404 INFO:teuthology.orchestra.run.smithi044.stdout:55834574857 2023-11-04T01:36:21.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7f6dd3fff640 1 -- 172.21.15.44:0/3674429759 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6dc006ae70 msgr2=0x7f6dc006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7f6dd3fff640 1 --2- 172.21.15.44:0/3674429759 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6dc006ae70 0x7f6dc006d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4005020 tx=0x7f6dc4007ef0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7f6dd3fff640 1 -- 172.21.15.44:0/3674429759 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6dd40cde60 msgr2=0x7f6dd40b2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7f6dd3fff640 1 --2- 172.21.15.44:0/3674429759 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6dd40cde60 0x7f6dd40b2f60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009d90 tx=0x7f6dcc00c490 comp rx=0 tx=0).stop 2023-11-04T01:36:21.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7f6dd3fff640 1 -- 172.21.15.44:0/3674429759 shutdown_connections 2023-11-04T01:36:21.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7f6dd3fff640 1 --2- 172.21.15.44:0/3674429759 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6dc006ae70 0x7f6dc006d330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7f6dd3fff640 1 --2- 172.21.15.44:0/3674429759 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6dd40cde60 0x7f6dd40b2f60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7f6dd3fff640 1 --2- 172.21.15.44:0/3674429759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6dd40ccf00 0x7f6dd41530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7f6dd3fff640 1 --2- 172.21.15.44:0/3674429759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6dd40ca520 0x7f6dd4152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.399+0000 7f6dd3fff640 1 -- 172.21.15.44:0/3674429759 >> 172.21.15.44:0/3674429759 conn(0x7f6dd406f2e0 msgr2=0x7f6dd406f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.400+0000 7f6dd3fff640 1 -- 172.21.15.44:0/3674429759 shutdown_connections 2023-11-04T01:36:21.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.400+0000 7f6dd3fff640 1 -- 172.21.15.44:0/3674429759 wait complete. 2023-11-04T01:36:21.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2023-11-04T01:36:21.410 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:21.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.401+0000 7f373f1d2640 1 -- 172.21.15.44:0/3021168816 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f371c06ae70 msgr2=0x7f371c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.401+0000 7f373f1d2640 1 --2- 172.21.15.44:0/3021168816 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f371c06ae70 0x7f371c06d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3734000c00 tx=0x7f3734008030 comp rx=0 tx=0).stop 2023-11-04T01:36:21.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.401+0000 7f373f1d2640 1 -- 172.21.15.44:0/3021168816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37300eb2c0 msgr2=0x7f373004ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.401+0000 7f373f1d2640 1 --2- 172.21.15.44:0/3021168816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37300eb2c0 0x7f373004ad30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3738064180 tx=0x7f3738067460 comp rx=0 tx=0).stop 2023-11-04T01:36:21.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.401+0000 7f373f1d2640 1 -- 172.21.15.44:0/3021168816 shutdown_connections 2023-11-04T01:36:21.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.401+0000 7f373f1d2640 1 --2- 172.21.15.44:0/3021168816 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f371c06ae70 0x7f371c06d330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.401+0000 7f373f1d2640 1 --2- 172.21.15.44:0/3021168816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37300eb2c0 0x7f373004ad30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.401+0000 7f373f1d2640 1 --2- 172.21.15.44:0/3021168816 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37300e78b0 0x7f373004a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.401+0000 7f373f1d2640 1 --2- 172.21.15.44:0/3021168816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3730052fe0 0x7f37300cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.401+0000 7f373f1d2640 1 -- 172.21.15.44:0/3021168816 >> 172.21.15.44:0/3021168816 conn(0x7f3730054c10 msgr2=0x7f3730053450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.402+0000 7f373f1d2640 1 -- 172.21.15.44:0/3021168816 shutdown_connections 2023-11-04T01:36:21.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.402+0000 7f373f1d2640 1 -- 172.21.15.44:0/3021168816 wait complete. 2023-11-04T01:36:21.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.402+0000 7f6178a9a640 1 -- 172.21.15.44:0/3698507245 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f616c03a5d0 con 0x7f616c052ed0 2023-11-04T01:36:21.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.403+0000 7f615ffff640 1 -- 172.21.15.44:0/3698507245 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6168057de0 con 0x7f616c052ed0 2023-11-04T01:36:21.418 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2023-11-04T01:36:21.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-11-04T01:36:21.420 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:21.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.406+0000 7f6178a9a640 1 -- 172.21.15.44:0/3698507245 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f615806aec0 msgr2=0x7f615806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.406+0000 7f6178a9a640 1 --2- 172.21.15.44:0/3698507245 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f615806aec0 0x7f615806d380 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6160036000 tx=0x7f616003c040 comp rx=0 tx=0).stop 2023-11-04T01:36:21.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.406+0000 7f6178a9a640 1 -- 172.21.15.44:0/3698507245 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f616c052ed0 msgr2=0x7f616c0dd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.406+0000 7f6178a9a640 1 --2- 172.21.15.44:0/3698507245 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f616c052ed0 0x7f616c0dd350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f616800e8a0 tx=0x7f616800ed60 comp rx=0 tx=0).stop 2023-11-04T01:36:21.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.406+0000 7f6178a9a640 1 -- 172.21.15.44:0/3698507245 shutdown_connections 2023-11-04T01:36:21.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.406+0000 7f6178a9a640 1 --2- 172.21.15.44:0/3698507245 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f615806aec0 0x7f615806d380 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.406+0000 7f6178a9a640 1 --2- 172.21.15.44:0/3698507245 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f616c0eb1b0 0x7f616c0d2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.406+0000 7f6178a9a640 1 --2- 172.21.15.44:0/3698507245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c0e77a0 0x7f616c04a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.406+0000 7f6178a9a640 1 --2- 172.21.15.44:0/3698507245 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f616c052ed0 0x7f616c0dd350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.406+0000 7f6178a9a640 1 -- 172.21.15.44:0/3698507245 >> 172.21.15.44:0/3698507245 conn(0x7f616c054b00 msgr2=0x7f616c053bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.406+0000 7f6178a9a640 1 -- 172.21.15.44:0/3698507245 shutdown_connections 2023-11-04T01:36:21.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.406+0000 7f6178a9a640 1 -- 172.21.15.44:0/3698507245 wait complete. 2023-11-04T01:36:21.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2023-11-04T01:36:21.423 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:21.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-11-04T01:36:21.428 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:21.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2023-11-04T01:36:21.429 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:21.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2023-11-04T01:36:21.429 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:21.429 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-04T01:36:21.430 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:36:21.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.569+0000 7feca635a640 1 Processor -- start 2023-11-04T01:36:21.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.569+0000 7feca635a640 1 -- start start 2023-11-04T01:36:21.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.570+0000 7feca635a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feca00cde60 0x7feca015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.570+0000 7feca635a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7feca015daa0 0x7feca0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.570+0000 7feca635a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca015e000 con 0x7feca00ce240 2023-11-04T01:36:21.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.570+0000 7feca635a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca015e5c0 con 0x7feca015daa0 2023-11-04T01:36:21.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.570+0000 7feca635a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca015e2e0 con 0x7feca00cde60 2023-11-04T01:36:21.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.570+0000 7fec9ffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feca00cde60 0x7feca015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.570+0000 7fec9f7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7feca015daa0 0x7feca0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.570+0000 7feca48f7640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7feca00ce240 0x7feca006b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:46928/0 (socket says 172.21.15.44:46928) 2023-11-04T01:36:21.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.570+0000 7feca48f7640 1 -- 172.21.15.44:0/1408060300 learned_addr learned my addr 172.21.15.44:0/1408060300 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:21.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.570+0000 7fec9ffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feca00cde60 0x7feca015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:60722/0 (socket says 172.21.15.44:60722) 2023-11-04T01:36:21.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.571+0000 7fec9ffff640 1 -- 172.21.15.44:0/1408060300 >> v2:172.21.15.204:3300/0 conn(0x7feca015daa0 msgr2=0x7feca0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.571+0000 7fec9ffff640 1 --2- 172.21.15.44:0/1408060300 >> v2:172.21.15.204:3300/0 conn(0x7feca015daa0 0x7feca0157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.571+0000 7fec9ffff640 1 -- 172.21.15.44:0/1408060300 >> v1:172.21.15.204:6789/0 conn(0x7feca00ce240 legacy=0x7feca006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.571+0000 7fec9ffff640 1 -- 172.21.15.44:0/1408060300 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca00d1120 con 0x7feca00cde60 2023-11-04T01:36:21.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.571+0000 7fec9f7fe640 1 --2- 172.21.15.44:0/1408060300 >> v2:172.21.15.204:3300/0 conn(0x7feca015daa0 0x7feca0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:21.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.572+0000 7fec9ffff640 1 --2- 172.21.15.44:0/1408060300 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feca00cde60 0x7feca015d560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fec880097a0 tx=0x7fec8802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef72eb9005c68f60 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.572+0000 7fec9effd640 1 -- 172.21.15.44:0/1408060300 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec88031830 con 0x7feca00cde60 2023-11-04T01:36:21.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.572+0000 7fec9effd640 1 -- 172.21.15.44:0/1408060300 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec88031990 con 0x7feca00cde60 2023-11-04T01:36:21.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.572+0000 7fec9effd640 1 -- 172.21.15.44:0/1408060300 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec88031d20 con 0x7feca00cde60 2023-11-04T01:36:21.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.572+0000 7feca635a640 1 -- 172.21.15.44:0/1408060300 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feca00cde60 msgr2=0x7feca015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.572+0000 7feca635a640 1 --2- 172.21.15.44:0/1408060300 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feca00cde60 0x7feca015d560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fec880097a0 tx=0x7fec8802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.572+0000 7feca635a640 1 -- 172.21.15.44:0/1408060300 shutdown_connections 2023-11-04T01:36:21.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.572+0000 7feca635a640 1 --2- 172.21.15.44:0/1408060300 >> v2:172.21.15.204:3300/0 conn(0x7feca015daa0 0x7feca0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.572+0000 7feca635a640 1 --2- 172.21.15.44:0/1408060300 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feca00cde60 0x7feca015d560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.572+0000 7feca635a640 1 -- 172.21.15.44:0/1408060300 >> 172.21.15.44:0/1408060300 conn(0x7feca0071f30 msgr2=0x7feca00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.572+0000 7feca635a640 1 -- 172.21.15.44:0/1408060300 shutdown_connections 2023-11-04T01:36:21.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.572+0000 7feca635a640 1 -- 172.21.15.44:0/1408060300 wait complete. 2023-11-04T01:36:21.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.574+0000 7feca635a640 1 Processor -- start 2023-11-04T01:36:21.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.574+0000 7feca635a640 1 -- start start 2023-11-04T01:36:21.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.574+0000 7feca635a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feca00cde60 0x7feca00b7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.574+0000 7feca635a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feca00ce240 0x7feca01f3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.574+0000 7feca635a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feca015daa0 0x7feca0151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.574+0000 7feca635a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca0159550 con 0x7feca015daa0 2023-11-04T01:36:21.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.574+0000 7feca635a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca00cb2b0 con 0x7feca00cde60 2023-11-04T01:36:21.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.574+0000 7feca635a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca00cb590 con 0x7feca00ce240 2023-11-04T01:36:21.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7feca48f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feca015daa0 0x7feca0151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7feca48f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feca015daa0 0x7feca0151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49232/0 (socket says 172.21.15.44:49232) 2023-11-04T01:36:21.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7feca48f7640 1 -- 172.21.15.44:0/461228229 learned_addr learned my addr 172.21.15.44:0/461228229 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:21.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7fec9ffff640 1 --2- 172.21.15.44:0/461228229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feca00cde60 0x7feca00b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7fec9f7fe640 1 --2- 172.21.15.44:0/461228229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feca00ce240 0x7feca01f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7feca48f7640 1 -- 172.21.15.44:0/461228229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feca00ce240 msgr2=0x7feca01f3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7feca48f7640 1 --2- 172.21.15.44:0/461228229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feca00ce240 0x7feca01f3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7feca48f7640 1 -- 172.21.15.44:0/461228229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feca00cde60 msgr2=0x7feca00b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7feca48f7640 1 --2- 172.21.15.44:0/461228229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feca00cde60 0x7feca00b7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7feca48f7640 1 -- 172.21.15.44:0/461228229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec90009400 con 0x7feca015daa0 2023-11-04T01:36:21.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7feca48f7640 1 --2- 172.21.15.44:0/461228229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feca015daa0 0x7feca0151330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fec9800cbc0 tx=0x7fec9800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7fec9cff9640 1 -- 172.21.15.44:0/461228229 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9800ace0 con 0x7feca015daa0 2023-11-04T01:36:21.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7fec9cff9640 1 -- 172.21.15.44:0/461228229 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9800ae40 con 0x7feca015daa0 2023-11-04T01:36:21.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7feca635a640 1 -- 172.21.15.44:0/461228229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec88009400 con 0x7feca015daa0 2023-11-04T01:36:21.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7fec9cff9640 1 -- 172.21.15.44:0/461228229 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98012600 con 0x7feca015daa0 2023-11-04T01:36:21.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.575+0000 7feca635a640 1 -- 172.21.15.44:0/461228229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca00cbe30 con 0x7feca015daa0 2023-11-04T01:36:21.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.576+0000 7feca635a640 1 -- 172.21.15.44:0/461228229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca0074290 con 0x7feca015daa0 2023-11-04T01:36:21.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.577+0000 7fec9cff9640 1 -- 172.21.15.44:0/461228229 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fec98007070 con 0x7feca015daa0 2023-11-04T01:36:21.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.577+0000 7fec9cff9640 1 --2- 172.21.15.44:0/461228229 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fec8006ae70 0x7fec8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.577+0000 7fec9cff9640 1 -- 172.21.15.44:0/461228229 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fec98089650 con 0x7feca015daa0 2023-11-04T01:36:21.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.578+0000 7fec9ffff640 1 --2- 172.21.15.44:0/461228229 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fec8006ae70 0x7fec8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.578+0000 7fec9ffff640 1 --2- 172.21.15.44:0/461228229 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fec8006ae70 0x7fec8006d330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec88036000 tx=0x7fec8803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.582+0000 7fec9cff9640 1 -- 172.21.15.44:0/461228229 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fec98054550 con 0x7feca015daa0 2023-11-04T01:36:21.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.754+0000 7feca635a640 1 -- 172.21.15.44:0/461228229 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feca00d1400 con 0x7fec8006ae70 2023-11-04T01:36:21.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.764+0000 7fec9cff9640 1 -- 172.21.15.44:0/461228229 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345241 (secure 0 0 0) 0x7fec8803a420 con 0x7fec8006ae70 2023-11-04T01:36:21.770 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:21.772 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:36:21.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.767+0000 7feca635a640 1 -- 172.21.15.44:0/461228229 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fec8006ae70 msgr2=0x7fec8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.767+0000 7feca635a640 1 --2- 172.21.15.44:0/461228229 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fec8006ae70 0x7fec8006d330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec88036000 tx=0x7fec8803c040 comp rx=0 tx=0).stop 2023-11-04T01:36:21.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.767+0000 7feca635a640 1 -- 172.21.15.44:0/461228229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feca015daa0 msgr2=0x7feca0151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.767+0000 7feca635a640 1 --2- 172.21.15.44:0/461228229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feca015daa0 0x7feca0151330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fec9800cbc0 tx=0x7fec9800a430 comp rx=0 tx=0).stop 2023-11-04T01:36:21.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.767+0000 7feca635a640 1 -- 172.21.15.44:0/461228229 shutdown_connections 2023-11-04T01:36:21.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.767+0000 7feca635a640 1 --2- 172.21.15.44:0/461228229 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fec8006ae70 0x7fec8006d330 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.767+0000 7feca635a640 1 --2- 172.21.15.44:0/461228229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feca015daa0 0x7feca0151330 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.767+0000 7feca635a640 1 --2- 172.21.15.44:0/461228229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feca00ce240 0x7feca01f3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.767+0000 7feca635a640 1 --2- 172.21.15.44:0/461228229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feca00cde60 0x7feca00b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.767+0000 7feca635a640 1 -- 172.21.15.44:0/461228229 >> 172.21.15.44:0/461228229 conn(0x7feca0071f30 msgr2=0x7feca00d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.767+0000 7feca635a640 1 -- 172.21.15.44:0/461228229 shutdown_connections 2023-11-04T01:36:21.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.767+0000 7feca635a640 1 -- 172.21.15.44:0/461228229 wait complete. 2023-11-04T01:36:21.793 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-11-04T01:36:20.577360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3280896,"data_stored":1987331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003298"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233378+0000","last_change":"2023-11-04T01:35:58.195271+0000","last_active":"2023-11-04T01:36:03.233378+0000","last_peered":"2023-11-04T01:36:03.233378+0000","last_clean":"2023-11-04T01:36:03.233378+0000","last_became_active":"2023-11-04T01:35:58.194946+0000","last_became_peered":"2023-11-04T01:35:58.194946+0000","last_unstale":"2023-11-04T01:36:03.233378+0000","last_undegraded":"2023-11-04T01:36:03.233378+0000","last_fullsized":"2023-11-04T01:36:03.233378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:46.133808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220450+0000","last_change":"2023-11-04T01:35:59.179018+0000","last_active":"2023-11-04T01:36:03.220450+0000","last_peered":"2023-11-04T01:36:03.220450+0000","last_clean":"2023-11-04T01:36:03.220450+0000","last_became_active":"2023-11-04T01:35:59.178607+0000","last_became_peered":"2023-11-04T01:35:59.178607+0000","last_unstale":"2023-11-04T01:36:03.220450+0000","last_undegraded":"2023-11-04T01:36:03.220450+0000","last_fullsized":"2023-11-04T01:36:03.220450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164443+0000","last_change":"2023-11-04T01:36:03.421566+0000","last_active":"2023-11-04T01:36:04.164443+0000","last_peered":"2023-11-04T01:36:04.164443+0000","last_clean":"2023-11-04T01:36:04.164443+0000","last_became_active":"2023-11-04T01:36:03.420841+0000","last_became_peered":"2023-11-04T01:36:03.420841+0000","last_unstale":"2023-11-04T01:36:04.164443+0000","last_undegraded":"2023-11-04T01:36:04.164443+0000","last_fullsized":"2023-11-04T01:36:04.164443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:09.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220481+0000","last_change":"2023-11-04T01:35:58.192868+0000","last_active":"2023-11-04T01:36:03.220481+0000","last_peered":"2023-11-04T01:36:03.220481+0000","last_clean":"2023-11-04T01:36:03.220481+0000","last_became_active":"2023-11-04T01:35:58.192539+0000","last_became_peered":"2023-11-04T01:35:58.192539+0000","last_unstale":"2023-11-04T01:36:03.220481+0000","last_undegraded":"2023-11-04T01:36:03.220481+0000","last_fullsized":"2023-11-04T01:36:03.220481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:56.079264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231660+0000","last_change":"2023-11-04T01:35:59.188981+0000","last_active":"2023-11-04T01:36:03.231660+0000","last_peered":"2023-11-04T01:36:03.231660+0000","last_clean":"2023-11-04T01:36:03.231660+0000","last_became_active":"2023-11-04T01:35:59.188652+0000","last_became_peered":"2023-11-04T01:35:59.188652+0000","last_unstale":"2023-11-04T01:36:03.231660+0000","last_undegraded":"2023-11-04T01:36:03.231660+0000","last_fullsized":"2023-11-04T01:36:03.231660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165630+0000","last_change":"2023-11-04T01:36:03.236391+0000","last_active":"2023-11-04T01:36:04.165630+0000","last_peered":"2023-11-04T01:36:04.165630+0000","last_clean":"2023-11-04T01:36:04.165630+0000","last_became_active":"2023-11-04T01:36:03.235906+0000","last_became_peered":"2023-11-04T01:36:03.235906+0000","last_unstale":"2023-11-04T01:36:04.165630+0000","last_undegraded":"2023-11-04T01:36:04.165630+0000","last_fullsized":"2023-11-04T01:36:04.165630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:35.196927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418151+0000","last_change":"2023-11-04T01:35:58.197184+0000","last_active":"2023-11-04T01:36:03.418151+0000","last_peered":"2023-11-04T01:36:03.418151+0000","last_clean":"2023-11-04T01:36:03.418151+0000","last_became_active":"2023-11-04T01:35:58.196766+0000","last_became_peered":"2023-11-04T01:35:58.196766+0000","last_unstale":"2023-11-04T01:36:03.418151+0000","last_undegraded":"2023-11-04T01:36:03.418151+0000","last_fullsized":"2023-11-04T01:36:03.418151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:04.765423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228152+0000","last_change":"2023-11-04T01:35:59.189310+0000","last_active":"2023-11-04T01:36:03.228152+0000","last_peered":"2023-11-04T01:36:03.228152+0000","last_clean":"2023-11-04T01:36:03.228152+0000","last_became_active":"2023-11-04T01:35:59.189034+0000","last_became_peered":"2023-11-04T01:35:59.189034+0000","last_unstale":"2023-11-04T01:36:03.228152+0000","last_undegraded":"2023-11-04T01:36:03.228152+0000","last_fullsized":"2023-11-04T01:36:03.228152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:31.045884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165630+0000","last_change":"2023-11-04T01:36:03.237859+0000","last_active":"2023-11-04T01:36:04.165630+0000","last_peered":"2023-11-04T01:36:04.165630+0000","last_clean":"2023-11-04T01:36:04.165630+0000","last_became_active":"2023-11-04T01:36:03.237472+0000","last_became_peered":"2023-11-04T01:36:03.237472+0000","last_unstale":"2023-11-04T01:36:04.165630+0000","last_undegraded":"2023-11-04T01:36:04.165630+0000","last_fullsized":"2023-11-04T01:36:04.165630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:47.574623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417583+0000","last_change":"2023-11-04T01:35:58.196082+0000","last_active":"2023-11-04T01:36:03.417583+0000","last_peered":"2023-11-04T01:36:03.417583+0000","last_clean":"2023-11-04T01:36:03.417583+0000","last_became_active":"2023-11-04T01:35:58.195823+0000","last_became_peered":"2023-11-04T01:35:58.195823+0000","last_unstale":"2023-11-04T01:36:03.417583+0000","last_undegraded":"2023-11-04T01:36:03.417583+0000","last_fullsized":"2023-11-04T01:36:03.417583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227869+0000","last_change":"2023-11-04T01:35:59.182650+0000","last_active":"2023-11-04T01:36:03.227869+0000","last_peered":"2023-11-04T01:36:03.227869+0000","last_clean":"2023-11-04T01:36:03.227869+0000","last_became_active":"2023-11-04T01:35:59.182397+0000","last_became_peered":"2023-11-04T01:35:59.182397+0000","last_unstale":"2023-11-04T01:36:03.227869+0000","last_undegraded":"2023-11-04T01:36:03.227869+0000","last_fullsized":"2023-11-04T01:36:03.227869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165302+0000","last_change":"2023-11-04T01:36:03.238226+0000","last_active":"2023-11-04T01:36:04.165302+0000","last_peered":"2023-11-04T01:36:04.165302+0000","last_clean":"2023-11-04T01:36:04.165302+0000","last_became_active":"2023-11-04T01:36:03.237796+0000","last_became_peered":"2023-11-04T01:36:03.237796+0000","last_unstale":"2023-11-04T01:36:04.165302+0000","last_undegraded":"2023-11-04T01:36:04.165302+0000","last_fullsized":"2023-11-04T01:36:04.165302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:56.134800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223628+0000","last_change":"2023-11-04T01:35:59.175182+0000","last_active":"2023-11-04T01:36:03.223628+0000","last_peered":"2023-11-04T01:36:03.223628+0000","last_clean":"2023-11-04T01:36:03.223628+0000","last_became_active":"2023-11-04T01:35:59.174889+0000","last_became_peered":"2023-11-04T01:35:59.174889+0000","last_unstale":"2023-11-04T01:36:03.223628+0000","last_undegraded":"2023-11-04T01:36:03.223628+0000","last_fullsized":"2023-11-04T01:36:03.223628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417641+0000","last_change":"2023-11-04T01:35:58.191418+0000","last_active":"2023-11-04T01:36:03.417641+0000","last_peered":"2023-11-04T01:36:03.417641+0000","last_clean":"2023-11-04T01:36:03.417641+0000","last_became_active":"2023-11-04T01:35:58.191164+0000","last_became_peered":"2023-11-04T01:35:58.191164+0000","last_unstale":"2023-11-04T01:36:03.417641+0000","last_undegraded":"2023-11-04T01:36:03.417641+0000","last_fullsized":"2023-11-04T01:36:03.417641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:56.366802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.166438+0000","last_change":"2023-11-04T01:36:03.238741+0000","last_active":"2023-11-04T01:36:04.166438+0000","last_peered":"2023-11-04T01:36:04.166438+0000","last_clean":"2023-11-04T01:36:04.166438+0000","last_became_active":"2023-11-04T01:36:03.238130+0000","last_became_peered":"2023-11-04T01:36:03.238130+0000","last_unstale":"2023-11-04T01:36:04.166438+0000","last_undegraded":"2023-11-04T01:36:04.166438+0000","last_fullsized":"2023-11-04T01:36:04.166438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:51.792275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219755+0000","last_change":"2023-11-04T01:35:59.181378+0000","last_active":"2023-11-04T01:36:03.219755+0000","last_peered":"2023-11-04T01:36:03.219755+0000","last_clean":"2023-11-04T01:36:03.219755+0000","last_became_active":"2023-11-04T01:35:59.180852+0000","last_became_peered":"2023-11-04T01:35:59.180852+0000","last_unstale":"2023-11-04T01:36:03.219755+0000","last_undegraded":"2023-11-04T01:36:03.219755+0000","last_fullsized":"2023-11-04T01:36:03.219755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.235667+0000","last_change":"2023-11-04T01:35:58.192955+0000","last_active":"2023-11-04T01:36:03.235667+0000","last_peered":"2023-11-04T01:36:03.235667+0000","last_clean":"2023-11-04T01:36:03.235667+0000","last_became_active":"2023-11-04T01:35:58.192609+0000","last_became_peered":"2023-11-04T01:35:58.192609+0000","last_unstale":"2023-11-04T01:36:03.235667+0000","last_undegraded":"2023-11-04T01:36:03.235667+0000","last_fullsized":"2023-11-04T01:36:03.235667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165731+0000","last_change":"2023-11-04T01:36:03.239699+0000","last_active":"2023-11-04T01:36:04.165731+0000","last_peered":"2023-11-04T01:36:04.165731+0000","last_clean":"2023-11-04T01:36:04.165731+0000","last_became_active":"2023-11-04T01:36:03.239146+0000","last_became_peered":"2023-11-04T01:36:03.239146+0000","last_unstale":"2023-11-04T01:36:04.165731+0000","last_undegraded":"2023-11-04T01:36:04.165731+0000","last_fullsized":"2023-11-04T01:36:04.165731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:50.421408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220829+0000","last_change":"2023-11-04T01:35:59.179889+0000","last_active":"2023-11-04T01:36:03.220829+0000","last_peered":"2023-11-04T01:36:03.220829+0000","last_clean":"2023-11-04T01:36:03.220829+0000","last_became_active":"2023-11-04T01:35:59.178416+0000","last_became_peered":"2023-11-04T01:35:59.178416+0000","last_unstale":"2023-11-04T01:36:03.220829+0000","last_undegraded":"2023-11-04T01:36:03.220829+0000","last_fullsized":"2023-11-04T01:36:03.220829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234302+0000","last_change":"2023-11-04T01:35:58.193758+0000","last_active":"2023-11-04T01:36:03.234302+0000","last_peered":"2023-11-04T01:36:03.234302+0000","last_clean":"2023-11-04T01:36:03.234302+0000","last_became_active":"2023-11-04T01:35:58.191341+0000","last_became_peered":"2023-11-04T01:35:58.191341+0000","last_unstale":"2023-11-04T01:36:03.234302+0000","last_undegraded":"2023-11-04T01:36:03.234302+0000","last_fullsized":"2023-11-04T01:36:03.234302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:46.133808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360658+0000","last_change":"2023-11-04T01:36:03.419927+0000","last_active":"2023-11-04T01:36:05.360658+0000","last_peered":"2023-11-04T01:36:05.360658+0000","last_clean":"2023-11-04T01:36:05.360658+0000","last_became_active":"2023-11-04T01:36:03.419458+0000","last_became_peered":"2023-11-04T01:36:03.419458+0000","last_unstale":"2023-11-04T01:36:05.360658+0000","last_undegraded":"2023-11-04T01:36:05.360658+0000","last_fullsized":"2023-11-04T01:36:05.360658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:55.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.222904+0000","last_change":"2023-11-04T01:35:59.178344+0000","last_active":"2023-11-04T01:36:03.222904+0000","last_peered":"2023-11-04T01:36:03.222904+0000","last_clean":"2023-11-04T01:36:03.222904+0000","last_became_active":"2023-11-04T01:35:59.178069+0000","last_became_peered":"2023-11-04T01:35:59.178069+0000","last_unstale":"2023-11-04T01:36:03.222904+0000","last_undegraded":"2023-11-04T01:36:03.222904+0000","last_fullsized":"2023-11-04T01:36:03.222904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:17:14.967316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417197+0000","last_change":"2023-11-04T01:35:58.198451+0000","last_active":"2023-11-04T01:36:03.417197+0000","last_peered":"2023-11-04T01:36:03.417197+0000","last_clean":"2023-11-04T01:36:03.417197+0000","last_became_active":"2023-11-04T01:35:58.198191+0000","last_became_peered":"2023-11-04T01:35:58.198191+0000","last_unstale":"2023-11-04T01:36:03.417197+0000","last_undegraded":"2023-11-04T01:36:03.417197+0000","last_fullsized":"2023-11-04T01:36:03.417197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:17:13.959681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.166193+0000","last_change":"2023-11-04T01:36:03.239679+0000","last_active":"2023-11-04T01:36:04.166193+0000","last_peered":"2023-11-04T01:36:04.166193+0000","last_clean":"2023-11-04T01:36:04.166193+0000","last_became_active":"2023-11-04T01:36:03.239148+0000","last_became_peered":"2023-11-04T01:36:03.239148+0000","last_unstale":"2023-11-04T01:36:04.166193+0000","last_undegraded":"2023-11-04T01:36:04.166193+0000","last_fullsized":"2023-11-04T01:36:04.166193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:35.083514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233606+0000","last_change":"2023-11-04T01:35:59.179921+0000","last_active":"2023-11-04T01:36:03.233606+0000","last_peered":"2023-11-04T01:36:03.233606+0000","last_clean":"2023-11-04T01:36:03.233606+0000","last_became_active":"2023-11-04T01:35:59.179555+0000","last_became_peered":"2023-11-04T01:35:59.179555+0000","last_unstale":"2023-11-04T01:36:03.233606+0000","last_undegraded":"2023-11-04T01:36:03.233606+0000","last_fullsized":"2023-11-04T01:36:03.233606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224666+0000","last_change":"2023-11-04T01:35:58.194520+0000","last_active":"2023-11-04T01:36:03.224666+0000","last_peered":"2023-11-04T01:36:03.224666+0000","last_clean":"2023-11-04T01:36:03.224666+0000","last_became_active":"2023-11-04T01:35:58.193227+0000","last_became_peered":"2023-11-04T01:35:58.193227+0000","last_unstale":"2023-11-04T01:36:03.224666+0000","last_undegraded":"2023-11-04T01:36:03.224666+0000","last_fullsized":"2023-11-04T01:36:03.224666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:56.079264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165353+0000","last_change":"2023-11-04T01:36:03.422666+0000","last_active":"2023-11-04T01:36:04.165353+0000","last_peered":"2023-11-04T01:36:04.165353+0000","last_clean":"2023-11-04T01:36:04.165353+0000","last_became_active":"2023-11-04T01:36:03.422271+0000","last_became_peered":"2023-11-04T01:36:03.422271+0000","last_unstale":"2023-11-04T01:36:04.165353+0000","last_undegraded":"2023-11-04T01:36:04.165353+0000","last_fullsized":"2023-11-04T01:36:04.165353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:00.309557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219727+0000","last_change":"2023-11-04T01:35:59.183456+0000","last_active":"2023-11-04T01:36:03.219727+0000","last_peered":"2023-11-04T01:36:03.219727+0000","last_clean":"2023-11-04T01:36:03.219727+0000","last_became_active":"2023-11-04T01:35:59.182344+0000","last_became_peered":"2023-11-04T01:35:59.182344+0000","last_unstale":"2023-11-04T01:36:03.219727+0000","last_undegraded":"2023-11-04T01:36:03.219727+0000","last_fullsized":"2023-11-04T01:36:03.219727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.237645+0000","last_change":"2023-11-04T01:35:58.193617+0000","last_active":"2023-11-04T01:36:03.237645+0000","last_peered":"2023-11-04T01:36:03.237645+0000","last_clean":"2023-11-04T01:36:03.237645+0000","last_became_active":"2023-11-04T01:35:58.193111+0000","last_became_peered":"2023-11-04T01:35:58.193111+0000","last_unstale":"2023-11-04T01:36:03.237645+0000","last_undegraded":"2023-11-04T01:36:03.237645+0000","last_fullsized":"2023-11-04T01:36:03.237645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:56.079264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164341+0000","last_change":"2023-11-04T01:36:03.418076+0000","last_active":"2023-11-04T01:36:04.164341+0000","last_peered":"2023-11-04T01:36:04.164341+0000","last_clean":"2023-11-04T01:36:04.164341+0000","last_became_active":"2023-11-04T01:36:03.417662+0000","last_became_peered":"2023-11-04T01:36:03.417662+0000","last_unstale":"2023-11-04T01:36:04.164341+0000","last_undegraded":"2023-11-04T01:36:04.164341+0000","last_fullsized":"2023-11-04T01:36:04.164341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:55.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234516+0000","last_change":"2023-11-04T01:35:59.177457+0000","last_active":"2023-11-04T01:36:03.234516+0000","last_peered":"2023-11-04T01:36:03.234516+0000","last_clean":"2023-11-04T01:36:03.234516+0000","last_became_active":"2023-11-04T01:35:59.177119+0000","last_became_peered":"2023-11-04T01:35:59.177119+0000","last_unstale":"2023-11-04T01:36:03.234516+0000","last_undegraded":"2023-11-04T01:36:03.234516+0000","last_fullsized":"2023-11-04T01:36:03.234516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418829+0000","last_change":"2023-11-04T01:35:58.198460+0000","last_active":"2023-11-04T01:36:03.418829+0000","last_peered":"2023-11-04T01:36:03.418829+0000","last_clean":"2023-11-04T01:36:03.418829+0000","last_became_active":"2023-11-04T01:35:58.198149+0000","last_became_peered":"2023-11-04T01:35:58.198149+0000","last_unstale":"2023-11-04T01:36:03.418829+0000","last_undegraded":"2023-11-04T01:36:03.418829+0000","last_fullsized":"2023-11-04T01:36:03.418829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:37.379069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.113926+0000","last_change":"2023-11-04T01:36:03.418067+0000","last_active":"2023-11-04T01:36:05.113926+0000","last_peered":"2023-11-04T01:36:05.113926+0000","last_clean":"2023-11-04T01:36:05.113926+0000","last_became_active":"2023-11-04T01:36:03.417580+0000","last_became_peered":"2023-11-04T01:36:03.417580+0000","last_unstale":"2023-11-04T01:36:05.113926+0000","last_undegraded":"2023-11-04T01:36:05.113926+0000","last_fullsized":"2023-11-04T01:36:05.113926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:02.636600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228055+0000","last_change":"2023-11-04T01:35:59.181672+0000","last_active":"2023-11-04T01:36:03.228055+0000","last_peered":"2023-11-04T01:36:03.228055+0000","last_clean":"2023-11-04T01:36:03.228055+0000","last_became_active":"2023-11-04T01:35:59.181366+0000","last_became_peered":"2023-11-04T01:35:59.181366+0000","last_unstale":"2023-11-04T01:36:03.228055+0000","last_undegraded":"2023-11-04T01:36:03.228055+0000","last_fullsized":"2023-11-04T01:36:03.228055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:41.888526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234512+0000","last_change":"2023-11-04T01:35:58.198371+0000","last_active":"2023-11-04T01:36:03.234512+0000","last_peered":"2023-11-04T01:36:03.234512+0000","last_clean":"2023-11-04T01:36:03.234512+0000","last_became_active":"2023-11-04T01:35:58.197948+0000","last_became_peered":"2023-11-04T01:35:58.197948+0000","last_unstale":"2023-11-04T01:36:03.234512+0000","last_undegraded":"2023-11-04T01:36:03.234512+0000","last_fullsized":"2023-11-04T01:36:03.234512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:37.960678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360112+0000","last_change":"2023-11-04T01:36:03.242811+0000","last_active":"2023-11-04T01:36:05.360112+0000","last_peered":"2023-11-04T01:36:05.360112+0000","last_clean":"2023-11-04T01:36:05.360112+0000","last_became_active":"2023-11-04T01:36:03.242415+0000","last_became_peered":"2023-11-04T01:36:03.242415+0000","last_unstale":"2023-11-04T01:36:05.360112+0000","last_undegraded":"2023-11-04T01:36:05.360112+0000","last_fullsized":"2023-11-04T01:36:05.360112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:26.435962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224250+0000","last_change":"2023-11-04T01:35:59.172529+0000","last_active":"2023-11-04T01:36:03.224250+0000","last_peered":"2023-11-04T01:36:03.224250+0000","last_clean":"2023-11-04T01:36:03.224250+0000","last_became_active":"2023-11-04T01:35:59.172235+0000","last_became_peered":"2023-11-04T01:35:59.172235+0000","last_unstale":"2023-11-04T01:36:03.224250+0000","last_undegraded":"2023-11-04T01:36:03.224250+0000","last_fullsized":"2023-11-04T01:36:03.224250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:48.565872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228657+0000","last_change":"2023-11-04T01:35:58.192742+0000","last_active":"2023-11-04T01:36:03.228657+0000","last_peered":"2023-11-04T01:36:03.228657+0000","last_clean":"2023-11-04T01:36:03.228657+0000","last_became_active":"2023-11-04T01:35:58.192399+0000","last_became_peered":"2023-11-04T01:35:58.192399+0000","last_unstale":"2023-11-04T01:36:03.228657+0000","last_undegraded":"2023-11-04T01:36:03.228657+0000","last_fullsized":"2023-11-04T01:36:03.228657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:42.026489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360489+0000","last_change":"2023-11-04T01:36:03.244294+0000","last_active":"2023-11-04T01:36:05.360489+0000","last_peered":"2023-11-04T01:36:05.360489+0000","last_clean":"2023-11-04T01:36:05.360489+0000","last_became_active":"2023-11-04T01:36:03.243799+0000","last_became_peered":"2023-11-04T01:36:03.243799+0000","last_unstale":"2023-11-04T01:36:05.360489+0000","last_undegraded":"2023-11-04T01:36:05.360489+0000","last_fullsized":"2023-11-04T01:36:05.360489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:32.058795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234087+0000","last_change":"2023-11-04T01:35:59.181498+0000","last_active":"2023-11-04T01:36:03.234087+0000","last_peered":"2023-11-04T01:36:03.234087+0000","last_clean":"2023-11-04T01:36:03.234087+0000","last_became_active":"2023-11-04T01:35:59.181162+0000","last_became_peered":"2023-11-04T01:35:59.181162+0000","last_unstale":"2023-11-04T01:36:03.234087+0000","last_undegraded":"2023-11-04T01:36:03.234087+0000","last_fullsized":"2023-11-04T01:36:03.234087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225409+0000","last_change":"2023-11-04T01:35:58.194393+0000","last_active":"2023-11-04T01:36:03.225409+0000","last_peered":"2023-11-04T01:36:03.225409+0000","last_clean":"2023-11-04T01:36:03.225409+0000","last_became_active":"2023-11-04T01:35:58.194066+0000","last_became_peered":"2023-11-04T01:35:58.194066+0000","last_unstale":"2023-11-04T01:36:03.225409+0000","last_undegraded":"2023-11-04T01:36:03.225409+0000","last_fullsized":"2023-11-04T01:36:03.225409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:24.246113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360736+0000","last_change":"2023-11-04T01:36:03.241689+0000","last_active":"2023-11-04T01:36:05.360736+0000","last_peered":"2023-11-04T01:36:05.360736+0000","last_clean":"2023-11-04T01:36:05.360736+0000","last_became_active":"2023-11-04T01:36:03.241310+0000","last_became_peered":"2023-11-04T01:36:03.241310+0000","last_unstale":"2023-11-04T01:36:05.360736+0000","last_undegraded":"2023-11-04T01:36:05.360736+0000","last_fullsized":"2023-11-04T01:36:05.360736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:09.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231312+0000","last_change":"2023-11-04T01:35:59.168220+0000","last_active":"2023-11-04T01:36:03.231312+0000","last_peered":"2023-11-04T01:36:03.231312+0000","last_clean":"2023-11-04T01:36:03.231312+0000","last_became_active":"2023-11-04T01:35:59.167947+0000","last_became_peered":"2023-11-04T01:35:59.167947+0000","last_unstale":"2023-11-04T01:36:03.231312+0000","last_undegraded":"2023-11-04T01:36:03.231312+0000","last_fullsized":"2023-11-04T01:36:03.231312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:38.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417210+0000","last_change":"2023-11-04T01:35:58.194356+0000","last_active":"2023-11-04T01:36:03.417210+0000","last_peered":"2023-11-04T01:36:03.417210+0000","last_clean":"2023-11-04T01:36:03.417210+0000","last_became_active":"2023-11-04T01:35:58.194084+0000","last_became_peered":"2023-11-04T01:35:58.194084+0000","last_unstale":"2023-11-04T01:36:03.417210+0000","last_undegraded":"2023-11-04T01:36:03.417210+0000","last_fullsized":"2023-11-04T01:36:03.417210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:47.558236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.114218+0000","last_change":"2023-11-04T01:36:03.419657+0000","last_active":"2023-11-04T01:36:05.114218+0000","last_peered":"2023-11-04T01:36:05.114218+0000","last_clean":"2023-11-04T01:36:05.114218+0000","last_became_active":"2023-11-04T01:36:03.419283+0000","last_became_peered":"2023-11-04T01:36:03.419283+0000","last_unstale":"2023-11-04T01:36:05.114218+0000","last_undegraded":"2023-11-04T01:36:05.114218+0000","last_fullsized":"2023-11-04T01:36:05.114218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:49.330726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219822+0000","last_change":"2023-11-04T01:35:59.183758+0000","last_active":"2023-11-04T01:36:03.219822+0000","last_peered":"2023-11-04T01:36:03.219822+0000","last_clean":"2023-11-04T01:36:03.219822+0000","last_became_active":"2023-11-04T01:35:59.183457+0000","last_became_peered":"2023-11-04T01:35:59.183457+0000","last_unstale":"2023-11-04T01:36:03.219822+0000","last_undegraded":"2023-11-04T01:36:03.219822+0000","last_fullsized":"2023-11-04T01:36:03.219822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227709+0000","last_change":"2023-11-04T01:35:58.193549+0000","last_active":"2023-11-04T01:36:03.227709+0000","last_peered":"2023-11-04T01:36:03.227709+0000","last_clean":"2023-11-04T01:36:03.227709+0000","last_became_active":"2023-11-04T01:35:58.193066+0000","last_became_peered":"2023-11-04T01:35:58.193066+0000","last_unstale":"2023-11-04T01:36:03.227709+0000","last_undegraded":"2023-11-04T01:36:03.227709+0000","last_fullsized":"2023-11-04T01:36:03.227709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:30.570768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417292+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:36:03.417292+0000","last_peered":"2023-11-04T01:36:03.417292+0000","last_clean":"2023-11-04T01:36:03.417292+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:36:03.417292+0000","last_undegraded":"2023-11-04T01:36:03.417292+0000","last_fullsized":"2023-11-04T01:36:03.417292+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165356+0000","last_change":"2023-11-04T01:36:03.420650+0000","last_active":"2023-11-04T01:36:04.165356+0000","last_peered":"2023-11-04T01:36:04.165356+0000","last_clean":"2023-11-04T01:36:04.165356+0000","last_became_active":"2023-11-04T01:36:03.420227+0000","last_became_peered":"2023-11-04T01:36:03.420227+0000","last_unstale":"2023-11-04T01:36:04.165356+0000","last_undegraded":"2023-11-04T01:36:04.165356+0000","last_fullsized":"2023-11-04T01:36:04.165356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:41.965687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418146+0000","last_change":"2023-11-04T01:35:59.188596+0000","last_active":"2023-11-04T01:36:03.418146+0000","last_peered":"2023-11-04T01:36:03.418146+0000","last_clean":"2023-11-04T01:36:03.418146+0000","last_became_active":"2023-11-04T01:35:59.188308+0000","last_became_peered":"2023-11-04T01:35:59.188308+0000","last_unstale":"2023-11-04T01:36:03.418146+0000","last_undegraded":"2023-11-04T01:36:03.418146+0000","last_fullsized":"2023-11-04T01:36:03.418146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:41.888526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.226336+0000","last_change":"2023-11-04T01:35:58.196283+0000","last_active":"2023-11-04T01:36:03.226336+0000","last_peered":"2023-11-04T01:36:03.226336+0000","last_clean":"2023-11-04T01:36:03.226336+0000","last_became_active":"2023-11-04T01:35:58.195971+0000","last_became_peered":"2023-11-04T01:35:58.195971+0000","last_unstale":"2023-11-04T01:36:03.226336+0000","last_undegraded":"2023-11-04T01:36:03.226336+0000","last_fullsized":"2023-11-04T01:36:03.226336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:47.558236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165453+0000","last_change":"2023-11-04T01:36:03.418712+0000","last_active":"2023-11-04T01:36:04.165453+0000","last_peered":"2023-11-04T01:36:04.165453+0000","last_clean":"2023-11-04T01:36:04.165453+0000","last_became_active":"2023-11-04T01:36:03.417693+0000","last_became_peered":"2023-11-04T01:36:03.417693+0000","last_unstale":"2023-11-04T01:36:04.165453+0000","last_undegraded":"2023-11-04T01:36:04.165453+0000","last_fullsized":"2023-11-04T01:36:04.165453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:35.083514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228228+0000","last_change":"2023-11-04T01:35:59.187963+0000","last_active":"2023-11-04T01:36:03.228228+0000","last_peered":"2023-11-04T01:36:03.228228+0000","last_clean":"2023-11-04T01:36:03.228228+0000","last_became_active":"2023-11-04T01:35:59.187711+0000","last_became_peered":"2023-11-04T01:35:59.187711+0000","last_unstale":"2023-11-04T01:36:03.228228+0000","last_undegraded":"2023-11-04T01:36:03.228228+0000","last_fullsized":"2023-11-04T01:36:03.228228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:39.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236382+0000","last_change":"2023-11-04T01:35:58.190482+0000","last_active":"2023-11-04T01:36:03.236382+0000","last_peered":"2023-11-04T01:36:03.236382+0000","last_clean":"2023-11-04T01:36:03.236382+0000","last_became_active":"2023-11-04T01:35:58.190198+0000","last_became_peered":"2023-11-04T01:35:58.190198+0000","last_unstale":"2023-11-04T01:36:03.236382+0000","last_undegraded":"2023-11-04T01:36:03.236382+0000","last_fullsized":"2023-11-04T01:36:03.236382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:37.379069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.113987+0000","last_change":"2023-11-04T01:36:03.236376+0000","last_active":"2023-11-04T01:36:05.113987+0000","last_peered":"2023-11-04T01:36:05.113987+0000","last_clean":"2023-11-04T01:36:05.113987+0000","last_became_active":"2023-11-04T01:36:03.235968+0000","last_became_peered":"2023-11-04T01:36:03.235968+0000","last_unstale":"2023-11-04T01:36:05.113987+0000","last_undegraded":"2023-11-04T01:36:05.113987+0000","last_fullsized":"2023-11-04T01:36:05.113987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:32.058795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418889+0000","last_change":"2023-11-04T01:35:59.188577+0000","last_active":"2023-11-04T01:36:03.418889+0000","last_peered":"2023-11-04T01:36:03.418889+0000","last_clean":"2023-11-04T01:36:03.418889+0000","last_became_active":"2023-11-04T01:35:59.188287+0000","last_became_peered":"2023-11-04T01:35:59.188287+0000","last_unstale":"2023-11-04T01:36:03.418889+0000","last_undegraded":"2023-11-04T01:36:03.418889+0000","last_fullsized":"2023-11-04T01:36:03.418889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:28.021164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225705+0000","last_change":"2023-11-04T01:35:58.194717+0000","last_active":"2023-11-04T01:36:03.225705+0000","last_peered":"2023-11-04T01:36:03.225705+0000","last_clean":"2023-11-04T01:36:03.225705+0000","last_became_active":"2023-11-04T01:35:58.194401+0000","last_became_peered":"2023-11-04T01:35:58.194401+0000","last_unstale":"2023-11-04T01:36:03.225705+0000","last_undegraded":"2023-11-04T01:36:03.225705+0000","last_fullsized":"2023-11-04T01:36:03.225705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:30.570768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360201+0000","last_change":"2023-11-04T01:36:03.422674+0000","last_active":"2023-11-04T01:36:05.360201+0000","last_peered":"2023-11-04T01:36:05.360201+0000","last_clean":"2023-11-04T01:36:05.360201+0000","last_became_active":"2023-11-04T01:36:03.422257+0000","last_became_peered":"2023-11-04T01:36:03.422257+0000","last_unstale":"2023-11-04T01:36:05.360201+0000","last_undegraded":"2023-11-04T01:36:05.360201+0000","last_fullsized":"2023-11-04T01:36:05.360201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:49.330726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418123+0000","last_change":"2023-11-04T01:35:59.179250+0000","last_active":"2023-11-04T01:36:03.418123+0000","last_peered":"2023-11-04T01:36:03.418123+0000","last_clean":"2023-11-04T01:36:03.418123+0000","last_became_active":"2023-11-04T01:35:59.178986+0000","last_became_peered":"2023-11-04T01:35:59.178986+0000","last_unstale":"2023-11-04T01:36:03.418123+0000","last_undegraded":"2023-11-04T01:36:03.418123+0000","last_fullsized":"2023-11-04T01:36:03.418123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223002+0000","last_change":"2023-11-04T01:35:58.190516+0000","last_active":"2023-11-04T01:36:03.223002+0000","last_peered":"2023-11-04T01:36:03.223002+0000","last_clean":"2023-11-04T01:36:03.223002+0000","last_became_active":"2023-11-04T01:35:58.190211+0000","last_became_peered":"2023-11-04T01:35:58.190211+0000","last_unstale":"2023-11-04T01:36:03.223002+0000","last_undegraded":"2023-11-04T01:36:03.223002+0000","last_fullsized":"2023-11-04T01:36:03.223002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:04.019377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165115+0000","last_change":"2023-11-04T01:36:03.239656+0000","last_active":"2023-11-04T01:36:04.165115+0000","last_peered":"2023-11-04T01:36:04.165115+0000","last_clean":"2023-11-04T01:36:04.165115+0000","last_became_active":"2023-11-04T01:36:03.239212+0000","last_became_peered":"2023-11-04T01:36:03.239212+0000","last_unstale":"2023-11-04T01:36:04.165115+0000","last_undegraded":"2023-11-04T01:36:04.165115+0000","last_fullsized":"2023-11-04T01:36:04.165115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:01.412068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417453+0000","last_change":"2023-11-04T01:35:59.179105+0000","last_active":"2023-11-04T01:36:03.417453+0000","last_peered":"2023-11-04T01:36:03.417453+0000","last_clean":"2023-11-04T01:36:03.417453+0000","last_became_active":"2023-11-04T01:35:59.178837+0000","last_became_peered":"2023-11-04T01:35:59.178837+0000","last_unstale":"2023-11-04T01:36:03.417453+0000","last_undegraded":"2023-11-04T01:36:03.417453+0000","last_fullsized":"2023-11-04T01:36:03.417453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225915+0000","last_change":"2023-11-04T01:35:58.195859+0000","last_active":"2023-11-04T01:36:03.225915+0000","last_peered":"2023-11-04T01:36:03.225915+0000","last_clean":"2023-11-04T01:36:03.225915+0000","last_became_active":"2023-11-04T01:35:58.195566+0000","last_became_peered":"2023-11-04T01:35:58.195566+0000","last_unstale":"2023-11-04T01:36:03.225915+0000","last_undegraded":"2023-11-04T01:36:03.225915+0000","last_fullsized":"2023-11-04T01:36:03.225915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:17:13.959681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.114145+0000","last_change":"2023-11-04T01:36:03.239374+0000","last_active":"2023-11-04T01:36:05.114145+0000","last_peered":"2023-11-04T01:36:05.114145+0000","last_clean":"2023-11-04T01:36:05.114145+0000","last_became_active":"2023-11-04T01:36:03.238617+0000","last_became_peered":"2023-11-04T01:36:03.238617+0000","last_unstale":"2023-11-04T01:36:05.114145+0000","last_undegraded":"2023-11-04T01:36:05.114145+0000","last_fullsized":"2023-11-04T01:36:05.114145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:09.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223514+0000","last_change":"2023-11-04T01:35:59.180350+0000","last_active":"2023-11-04T01:36:03.223514+0000","last_peered":"2023-11-04T01:36:03.223514+0000","last_clean":"2023-11-04T01:36:03.223514+0000","last_became_active":"2023-11-04T01:35:59.180086+0000","last_became_peered":"2023-11-04T01:35:59.180086+0000","last_unstale":"2023-11-04T01:36:03.223514+0000","last_undegraded":"2023-11-04T01:36:03.223514+0000","last_fullsized":"2023-11-04T01:36:03.223514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.222870+0000","last_change":"2023-11-04T01:35:58.186031+0000","last_active":"2023-11-04T01:36:03.222870+0000","last_peered":"2023-11-04T01:36:03.222870+0000","last_clean":"2023-11-04T01:36:03.222870+0000","last_became_active":"2023-11-04T01:35:58.185722+0000","last_became_peered":"2023-11-04T01:35:58.185722+0000","last_unstale":"2023-11-04T01:36:03.222870+0000","last_undegraded":"2023-11-04T01:36:03.222870+0000","last_fullsized":"2023-11-04T01:36:03.222870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165503+0000","last_change":"2023-11-04T01:36:03.420681+0000","last_active":"2023-11-04T01:36:04.165503+0000","last_peered":"2023-11-04T01:36:04.165503+0000","last_clean":"2023-11-04T01:36:04.165503+0000","last_became_active":"2023-11-04T01:36:03.420258+0000","last_became_peered":"2023-11-04T01:36:03.420258+0000","last_unstale":"2023-11-04T01:36:04.165503+0000","last_undegraded":"2023-11-04T01:36:04.165503+0000","last_fullsized":"2023-11-04T01:36:04.165503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:50:39.481734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417519+0000","last_change":"2023-11-04T01:35:59.188442+0000","last_active":"2023-11-04T01:36:03.417519+0000","last_peered":"2023-11-04T01:36:03.417519+0000","last_clean":"2023-11-04T01:36:03.417519+0000","last_became_active":"2023-11-04T01:35:59.188173+0000","last_became_peered":"2023-11-04T01:35:59.188173+0000","last_unstale":"2023-11-04T01:36:03.417519+0000","last_undegraded":"2023-11-04T01:36:03.417519+0000","last_fullsized":"2023-11-04T01:36:03.417519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:31.045884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228572+0000","last_change":"2023-11-04T01:35:58.197982+0000","last_active":"2023-11-04T01:36:03.228572+0000","last_peered":"2023-11-04T01:36:03.228572+0000","last_clean":"2023-11-04T01:36:03.228572+0000","last_became_active":"2023-11-04T01:35:58.197647+0000","last_became_peered":"2023-11-04T01:35:58.197647+0000","last_unstale":"2023-11-04T01:36:03.228572+0000","last_undegraded":"2023-11-04T01:36:03.228572+0000","last_fullsized":"2023-11-04T01:36:03.228572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:35.379197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165046+0000","last_change":"2023-11-04T01:36:03.419606+0000","last_active":"2023-11-04T01:36:04.165046+0000","last_peered":"2023-11-04T01:36:04.165046+0000","last_clean":"2023-11-04T01:36:04.165046+0000","last_became_active":"2023-11-04T01:36:03.419169+0000","last_became_peered":"2023-11-04T01:36:03.419169+0000","last_unstale":"2023-11-04T01:36:04.165046+0000","last_undegraded":"2023-11-04T01:36:04.165046+0000","last_fullsized":"2023-11-04T01:36:04.165046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:59.887821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233077+0000","last_change":"2023-11-04T01:35:59.175192+0000","last_active":"2023-11-04T01:36:03.233077+0000","last_peered":"2023-11-04T01:36:03.233077+0000","last_clean":"2023-11-04T01:36:03.233077+0000","last_became_active":"2023-11-04T01:35:59.174877+0000","last_became_peered":"2023-11-04T01:35:59.174877+0000","last_unstale":"2023-11-04T01:36:03.233077+0000","last_undegraded":"2023-11-04T01:36:03.233077+0000","last_fullsized":"2023-11-04T01:36:03.233077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.232115+0000","last_change":"2023-11-04T01:35:58.194353+0000","last_active":"2023-11-04T01:36:03.232115+0000","last_peered":"2023-11-04T01:36:03.232115+0000","last_clean":"2023-11-04T01:36:03.232115+0000","last_became_active":"2023-11-04T01:35:58.193311+0000","last_became_peered":"2023-11-04T01:35:58.193311+0000","last_unstale":"2023-11-04T01:36:03.232115+0000","last_undegraded":"2023-11-04T01:36:03.232115+0000","last_fullsized":"2023-11-04T01:36:03.232115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:24.246113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360678+0000","last_change":"2023-11-04T01:36:03.420683+0000","last_active":"2023-11-04T01:36:05.360678+0000","last_peered":"2023-11-04T01:36:05.360678+0000","last_clean":"2023-11-04T01:36:05.360678+0000","last_became_active":"2023-11-04T01:36:03.420294+0000","last_became_peered":"2023-11-04T01:36:03.420294+0000","last_unstale":"2023-11-04T01:36:05.360678+0000","last_undegraded":"2023-11-04T01:36:05.360678+0000","last_fullsized":"2023-11-04T01:36:05.360678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:12.398818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417775+0000","last_change":"2023-11-04T01:35:59.184924+0000","last_active":"2023-11-04T01:36:03.417775+0000","last_peered":"2023-11-04T01:36:03.417775+0000","last_clean":"2023-11-04T01:36:03.417775+0000","last_became_active":"2023-11-04T01:35:59.183229+0000","last_became_peered":"2023-11-04T01:35:59.183229+0000","last_unstale":"2023-11-04T01:36:03.417775+0000","last_undegraded":"2023-11-04T01:36:03.417775+0000","last_fullsized":"2023-11-04T01:36:03.417775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:47.754644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:10.017212+0000","last_change":"2023-11-04T01:35:58.193586+0000","last_active":"2023-11-04T01:36:10.017212+0000","last_peered":"2023-11-04T01:36:10.017212+0000","last_clean":"2023-11-04T01:36:10.017212+0000","last_became_active":"2023-11-04T01:35:58.193282+0000","last_became_peered":"2023-11-04T01:35:58.193282+0000","last_unstale":"2023-11-04T01:36:10.017212+0000","last_undegraded":"2023-11-04T01:36:10.017212+0000","last_fullsized":"2023-11-04T01:36:10.017212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:46.133808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360370+0000","last_change":"2023-11-04T01:36:03.242995+0000","last_active":"2023-11-04T01:36:05.360370+0000","last_peered":"2023-11-04T01:36:05.360370+0000","last_clean":"2023-11-04T01:36:05.360370+0000","last_became_active":"2023-11-04T01:36:03.242623+0000","last_became_peered":"2023-11-04T01:36:03.242623+0000","last_unstale":"2023-11-04T01:36:05.360370+0000","last_undegraded":"2023-11-04T01:36:05.360370+0000","last_fullsized":"2023-11-04T01:36:05.360370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:02.636600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224883+0000","last_change":"2023-11-04T01:35:59.179661+0000","last_active":"2023-11-04T01:36:03.224883+0000","last_peered":"2023-11-04T01:36:03.224883+0000","last_clean":"2023-11-04T01:36:03.224883+0000","last_became_active":"2023-11-04T01:35:59.178791+0000","last_became_peered":"2023-11-04T01:35:59.178791+0000","last_unstale":"2023-11-04T01:36:03.224883+0000","last_undegraded":"2023-11-04T01:36:03.224883+0000","last_fullsized":"2023-11-04T01:36:03.224883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:31.578404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236138+0000","last_change":"2023-11-04T01:35:58.194817+0000","last_active":"2023-11-04T01:36:03.236138+0000","last_peered":"2023-11-04T01:36:03.236138+0000","last_clean":"2023-11-04T01:36:03.236138+0000","last_became_active":"2023-11-04T01:35:58.194521+0000","last_became_peered":"2023-11-04T01:35:58.194521+0000","last_unstale":"2023-11-04T01:36:03.236138+0000","last_undegraded":"2023-11-04T01:36:03.236138+0000","last_fullsized":"2023-11-04T01:36:03.236138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:04.765423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165862+0000","last_change":"2023-11-04T01:36:03.234265+0000","last_active":"2023-11-04T01:36:04.165862+0000","last_peered":"2023-11-04T01:36:04.165862+0000","last_clean":"2023-11-04T01:36:04.165862+0000","last_became_active":"2023-11-04T01:36:03.233858+0000","last_became_peered":"2023-11-04T01:36:03.233858+0000","last_unstale":"2023-11-04T01:36:04.165862+0000","last_undegraded":"2023-11-04T01:36:04.165862+0000","last_fullsized":"2023-11-04T01:36:04.165862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:41.965687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231787+0000","last_change":"2023-11-04T01:35:59.183367+0000","last_active":"2023-11-04T01:36:03.231787+0000","last_peered":"2023-11-04T01:36:03.231787+0000","last_clean":"2023-11-04T01:36:03.231787+0000","last_became_active":"2023-11-04T01:35:59.183053+0000","last_became_peered":"2023-11-04T01:35:59.183053+0000","last_unstale":"2023-11-04T01:36:03.231787+0000","last_undegraded":"2023-11-04T01:36:03.231787+0000","last_fullsized":"2023-11-04T01:36:03.231787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227594+0000","last_change":"2023-11-04T01:35:58.191935+0000","last_active":"2023-11-04T01:36:03.227594+0000","last_peered":"2023-11-04T01:36:03.227594+0000","last_clean":"2023-11-04T01:36:03.227594+0000","last_became_active":"2023-11-04T01:35:58.191638+0000","last_became_peered":"2023-11-04T01:35:58.191638+0000","last_unstale":"2023-11-04T01:36:03.227594+0000","last_undegraded":"2023-11-04T01:36:03.227594+0000","last_fullsized":"2023-11-04T01:36:03.227594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:04.765423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164714+0000","last_change":"2023-11-04T01:36:03.238955+0000","last_active":"2023-11-04T01:36:04.164714+0000","last_peered":"2023-11-04T01:36:04.164714+0000","last_clean":"2023-11-04T01:36:04.164714+0000","last_became_active":"2023-11-04T01:36:03.238489+0000","last_became_peered":"2023-11-04T01:36:03.238489+0000","last_unstale":"2023-11-04T01:36:04.164714+0000","last_undegraded":"2023-11-04T01:36:04.164714+0000","last_fullsized":"2023-11-04T01:36:04.164714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:12.398818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227482+0000","last_change":"2023-11-04T01:35:59.189242+0000","last_active":"2023-11-04T01:36:03.227482+0000","last_peered":"2023-11-04T01:36:03.227482+0000","last_clean":"2023-11-04T01:36:03.227482+0000","last_became_active":"2023-11-04T01:35:59.188965+0000","last_became_peered":"2023-11-04T01:35:59.188965+0000","last_unstale":"2023-11-04T01:36:03.227482+0000","last_undegraded":"2023-11-04T01:36:03.227482+0000","last_fullsized":"2023-11-04T01:36:03.227482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224557+0000","last_change":"2023-11-04T01:35:58.194320+0000","last_active":"2023-11-04T01:36:03.224557+0000","last_peered":"2023-11-04T01:36:03.224557+0000","last_clean":"2023-11-04T01:36:03.224557+0000","last_became_active":"2023-11-04T01:35:58.193983+0000","last_became_peered":"2023-11-04T01:35:58.193983+0000","last_unstale":"2023-11-04T01:36:03.224557+0000","last_undegraded":"2023-11-04T01:36:03.224557+0000","last_fullsized":"2023-11-04T01:36:03.224557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:45.043819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164544+0000","last_change":"2023-11-04T01:36:03.419109+0000","last_active":"2023-11-04T01:36:04.164544+0000","last_peered":"2023-11-04T01:36:04.164544+0000","last_clean":"2023-11-04T01:36:04.164544+0000","last_became_active":"2023-11-04T01:36:03.418605+0000","last_became_peered":"2023-11-04T01:36:03.418605+0000","last_unstale":"2023-11-04T01:36:04.164544+0000","last_undegraded":"2023-11-04T01:36:04.164544+0000","last_fullsized":"2023-11-04T01:36:04.164544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:49.330726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.114053+0000","last_change":"2023-11-04T01:36:03.421492+0000","last_active":"2023-11-04T01:36:05.114053+0000","last_peered":"2023-11-04T01:36:05.114053+0000","last_clean":"2023-11-04T01:36:05.114053+0000","last_became_active":"2023-11-04T01:36:03.421133+0000","last_became_peered":"2023-11-04T01:36:03.421133+0000","last_unstale":"2023-11-04T01:36:05.114053+0000","last_undegraded":"2023-11-04T01:36:05.114053+0000","last_fullsized":"2023-11-04T01:36:05.114053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:55.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233628+0000","last_change":"2023-11-04T01:35:59.180080+0000","last_active":"2023-11-04T01:36:03.233628+0000","last_peered":"2023-11-04T01:36:03.233628+0000","last_clean":"2023-11-04T01:36:03.233628+0000","last_became_active":"2023-11-04T01:35:59.179750+0000","last_became_peered":"2023-11-04T01:35:59.179750+0000","last_unstale":"2023-11-04T01:36:03.233628+0000","last_undegraded":"2023-11-04T01:36:03.233628+0000","last_fullsized":"2023-11-04T01:36:03.233628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227976+0000","last_change":"2023-11-04T01:35:58.196231+0000","last_active":"2023-11-04T01:36:03.227976+0000","last_peered":"2023-11-04T01:36:03.227976+0000","last_clean":"2023-11-04T01:36:03.227976+0000","last_became_active":"2023-11-04T01:35:58.195948+0000","last_became_peered":"2023-11-04T01:35:58.195948+0000","last_unstale":"2023-11-04T01:36:03.227976+0000","last_undegraded":"2023-11-04T01:36:03.227976+0000","last_fullsized":"2023-11-04T01:36:03.227976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:24.246113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165703+0000","last_change":"2023-11-04T01:36:03.241495+0000","last_active":"2023-11-04T01:36:04.165703+0000","last_peered":"2023-11-04T01:36:04.165703+0000","last_clean":"2023-11-04T01:36:04.165703+0000","last_became_active":"2023-11-04T01:36:03.241086+0000","last_became_peered":"2023-11-04T01:36:03.241086+0000","last_unstale":"2023-11-04T01:36:04.165703+0000","last_undegraded":"2023-11-04T01:36:04.165703+0000","last_fullsized":"2023-11-04T01:36:04.165703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:51.792275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220744+0000","last_change":"2023-11-04T01:35:59.180953+0000","last_active":"2023-11-04T01:36:03.220744+0000","last_peered":"2023-11-04T01:36:03.220744+0000","last_clean":"2023-11-04T01:36:03.220744+0000","last_became_active":"2023-11-04T01:35:59.180652+0000","last_became_peered":"2023-11-04T01:35:59.180652+0000","last_unstale":"2023-11-04T01:36:03.220744+0000","last_undegraded":"2023-11-04T01:36:03.220744+0000","last_fullsized":"2023-11-04T01:36:03.220744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220671+0000","last_change":"2023-11-04T01:35:58.190294+0000","last_active":"2023-11-04T01:36:03.220671+0000","last_peered":"2023-11-04T01:36:03.220671+0000","last_clean":"2023-11-04T01:36:03.220671+0000","last_became_active":"2023-11-04T01:35:58.189965+0000","last_became_peered":"2023-11-04T01:35:58.189965+0000","last_unstale":"2023-11-04T01:36:03.220671+0000","last_undegraded":"2023-11-04T01:36:03.220671+0000","last_fullsized":"2023-11-04T01:36:03.220671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:47.558236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223731+0000","last_change":"2023-11-04T01:35:58.193526+0000","last_active":"2023-11-04T01:36:03.223731+0000","last_peered":"2023-11-04T01:36:03.223731+0000","last_clean":"2023-11-04T01:36:03.223731+0000","last_became_active":"2023-11-04T01:35:58.193186+0000","last_became_peered":"2023-11-04T01:35:58.193186+0000","last_unstale":"2023-11-04T01:36:03.223731+0000","last_undegraded":"2023-11-04T01:36:03.223731+0000","last_fullsized":"2023-11-04T01:36:03.223731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:37.960678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.232019+0000","last_change":"2023-11-04T01:35:59.169544+0000","last_active":"2023-11-04T01:36:03.232019+0000","last_peered":"2023-11-04T01:36:03.232019+0000","last_clean":"2023-11-04T01:36:03.232019+0000","last_became_active":"2023-11-04T01:35:59.169198+0000","last_became_peered":"2023-11-04T01:35:59.169198+0000","last_unstale":"2023-11-04T01:36:03.232019+0000","last_undegraded":"2023-11-04T01:36:03.232019+0000","last_fullsized":"2023-11-04T01:36:03.232019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.615595+0000","last_change":"2023-11-04T01:36:03.241169+0000","last_active":"2023-11-04T01:36:04.615595+0000","last_peered":"2023-11-04T01:36:04.615595+0000","last_clean":"2023-11-04T01:36:04.615595+0000","last_became_active":"2023-11-04T01:36:03.240462+0000","last_became_peered":"2023-11-04T01:36:03.240462+0000","last_unstale":"2023-11-04T01:36:04.615595+0000","last_undegraded":"2023-11-04T01:36:04.615595+0000","last_fullsized":"2023-11-04T01:36:04.615595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:09.810689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220136+0000","last_change":"2023-11-04T01:35:58.192293+0000","last_active":"2023-11-04T01:36:03.220136+0000","last_peered":"2023-11-04T01:36:03.220136+0000","last_clean":"2023-11-04T01:36:03.220136+0000","last_became_active":"2023-11-04T01:35:58.191972+0000","last_became_peered":"2023-11-04T01:35:58.191972+0000","last_unstale":"2023-11-04T01:36:03.220136+0000","last_undegraded":"2023-11-04T01:36:03.220136+0000","last_fullsized":"2023-11-04T01:36:03.220136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.221974+0000","last_change":"2023-11-04T01:35:59.179878+0000","last_active":"2023-11-04T01:36:03.221974+0000","last_peered":"2023-11-04T01:36:03.221974+0000","last_clean":"2023-11-04T01:36:03.221974+0000","last_became_active":"2023-11-04T01:35:59.177460+0000","last_became_peered":"2023-11-04T01:35:59.177460+0000","last_unstale":"2023-11-04T01:36:03.221974+0000","last_undegraded":"2023-11-04T01:36:03.221974+0000","last_fullsized":"2023-11-04T01:36:03.221974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:01:15.442742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165166+0000","last_change":"2023-11-04T01:36:03.240379+0000","last_active":"2023-11-04T01:36:04.165166+0000","last_peered":"2023-11-04T01:36:04.165166+0000","last_clean":"2023-11-04T01:36:04.165166+0000","last_became_active":"2023-11-04T01:36:03.239985+0000","last_became_peered":"2023-11-04T01:36:03.239985+0000","last_unstale":"2023-11-04T01:36:04.165166+0000","last_undegraded":"2023-11-04T01:36:04.165166+0000","last_fullsized":"2023-11-04T01:36:04.165166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:22.738298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223423+0000","last_change":"2023-11-04T01:35:59.180546+0000","last_active":"2023-11-04T01:36:03.223423+0000","last_peered":"2023-11-04T01:36:03.223423+0000","last_clean":"2023-11-04T01:36:03.223423+0000","last_became_active":"2023-11-04T01:35:59.180121+0000","last_became_peered":"2023-11-04T01:35:59.180121+0000","last_unstale":"2023-11-04T01:36:03.223423+0000","last_undegraded":"2023-11-04T01:36:03.223423+0000","last_fullsized":"2023-11-04T01:36:03.223423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:38.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225745+0000","last_change":"2023-11-04T01:35:59.182981+0000","last_active":"2023-11-04T01:36:03.225745+0000","last_peered":"2023-11-04T01:36:03.225745+0000","last_clean":"2023-11-04T01:36:03.225745+0000","last_became_active":"2023-11-04T01:35:59.182612+0000","last_became_peered":"2023-11-04T01:35:59.182612+0000","last_unstale":"2023-11-04T01:36:03.225745+0000","last_undegraded":"2023-11-04T01:36:03.225745+0000","last_fullsized":"2023-11-04T01:36:03.225745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:38.968313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228484+0000","last_change":"2023-11-04T01:35:59.185499+0000","last_active":"2023-11-04T01:36:03.228484+0000","last_peered":"2023-11-04T01:36:03.228484+0000","last_clean":"2023-11-04T01:36:03.228484+0000","last_became_active":"2023-11-04T01:35:59.185133+0000","last_became_peered":"2023-11-04T01:35:59.185133+0000","last_unstale":"2023-11-04T01:36:03.228484+0000","last_undegraded":"2023-11-04T01:36:03.228484+0000","last_fullsized":"2023-11-04T01:36:03.228484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:22.398332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231928+0000","last_change":"2023-11-04T01:35:59.183534+0000","last_active":"2023-11-04T01:36:03.231928+0000","last_peered":"2023-11-04T01:36:03.231928+0000","last_clean":"2023-11-04T01:36:03.231928+0000","last_became_active":"2023-11-04T01:35:59.180664+0000","last_became_peered":"2023-11-04T01:35:59.180664+0000","last_unstale":"2023-11-04T01:36:03.231928+0000","last_undegraded":"2023-11-04T01:36:03.231928+0000","last_fullsized":"2023-11-04T01:36:03.231928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220081+0000","last_change":"2023-11-04T01:35:59.182124+0000","last_active":"2023-11-04T01:36:03.220081+0000","last_peered":"2023-11-04T01:36:03.220081+0000","last_clean":"2023-11-04T01:36:03.220081+0000","last_became_active":"2023-11-04T01:35:59.181762+0000","last_became_peered":"2023-11-04T01:35:59.181762+0000","last_unstale":"2023-11-04T01:36:03.220081+0000","last_undegraded":"2023-11-04T01:36:03.220081+0000","last_fullsized":"2023-11-04T01:36:03.220081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236021+0000","last_change":"2023-11-04T01:35:59.184661+0000","last_active":"2023-11-04T01:36:03.236021+0000","last_peered":"2023-11-04T01:36:03.236021+0000","last_clean":"2023-11-04T01:36:03.236021+0000","last_became_active":"2023-11-04T01:35:59.184382+0000","last_became_peered":"2023-11-04T01:35:59.184382+0000","last_unstale":"2023-11-04T01:36:03.236021+0000","last_undegraded":"2023-11-04T01:36:03.236021+0000","last_fullsized":"2023-11-04T01:36:03.236021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224222+0000","last_change":"2023-11-04T01:35:59.177565+0000","last_active":"2023-11-04T01:36:03.224222+0000","last_peered":"2023-11-04T01:36:03.224222+0000","last_clean":"2023-11-04T01:36:03.224222+0000","last_became_active":"2023-11-04T01:35:59.177205+0000","last_became_peered":"2023-11-04T01:35:59.177205+0000","last_unstale":"2023-11-04T01:36:03.224222+0000","last_undegraded":"2023-11-04T01:36:03.224222+0000","last_fullsized":"2023-11-04T01:36:03.224222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219630+0000","last_change":"2023-11-04T01:35:59.183379+0000","last_active":"2023-11-04T01:36:03.219630+0000","last_peered":"2023-11-04T01:36:03.219630+0000","last_clean":"2023-11-04T01:36:03.219630+0000","last_became_active":"2023-11-04T01:35:59.182959+0000","last_became_peered":"2023-11-04T01:35:59.182959+0000","last_unstale":"2023-11-04T01:36:03.219630+0000","last_undegraded":"2023-11-04T01:36:03.219630+0000","last_fullsized":"2023-11-04T01:36:03.219630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:37.928056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227777+0000","last_change":"2023-11-04T01:35:59.180959+0000","last_active":"2023-11-04T01:36:03.227777+0000","last_peered":"2023-11-04T01:36:03.227777+0000","last_clean":"2023-11-04T01:36:03.227777+0000","last_became_active":"2023-11-04T01:35:59.180709+0000","last_became_peered":"2023-11-04T01:35:59.180709+0000","last_unstale":"2023-11-04T01:36:03.227777+0000","last_undegraded":"2023-11-04T01:36:03.227777+0000","last_fullsized":"2023-11-04T01:36:03.227777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220572+0000","last_change":"2023-11-04T01:35:59.178115+0000","last_active":"2023-11-04T01:36:03.220572+0000","last_peered":"2023-11-04T01:36:03.220572+0000","last_clean":"2023-11-04T01:36:03.220572+0000","last_became_active":"2023-11-04T01:35:59.177595+0000","last_became_peered":"2023-11-04T01:35:59.177595+0000","last_unstale":"2023-11-04T01:36:03.220572+0000","last_undegraded":"2023-11-04T01:36:03.220572+0000","last_fullsized":"2023-11-04T01:36:03.220572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228396+0000","last_change":"2023-11-04T01:35:59.181853+0000","last_active":"2023-11-04T01:36:03.228396+0000","last_peered":"2023-11-04T01:36:03.228396+0000","last_clean":"2023-11-04T01:36:03.228396+0000","last_became_active":"2023-11-04T01:35:59.181499+0000","last_became_peered":"2023-11-04T01:35:59.181499+0000","last_unstale":"2023-11-04T01:36:03.228396+0000","last_undegraded":"2023-11-04T01:36:03.228396+0000","last_fullsized":"2023-11-04T01:36:03.228396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:59:58.598970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231812+0000","last_change":"2023-11-04T01:35:59.177527+0000","last_active":"2023-11-04T01:36:03.231812+0000","last_peered":"2023-11-04T01:36:03.231812+0000","last_clean":"2023-11-04T01:36:03.231812+0000","last_became_active":"2023-11-04T01:35:59.177047+0000","last_became_peered":"2023-11-04T01:35:59.177047+0000","last_unstale":"2023-11-04T01:36:03.231812+0000","last_undegraded":"2023-11-04T01:36:03.231812+0000","last_fullsized":"2023-11-04T01:36:03.231812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223687+0000","last_change":"2023-11-04T01:35:59.174531+0000","last_active":"2023-11-04T01:36:03.223687+0000","last_peered":"2023-11-04T01:36:03.223687+0000","last_clean":"2023-11-04T01:36:03.223687+0000","last_became_active":"2023-11-04T01:35:59.174277+0000","last_became_peered":"2023-11-04T01:35:59.174277+0000","last_unstale":"2023-11-04T01:36:03.223687+0000","last_undegraded":"2023-11-04T01:36:03.223687+0000","last_fullsized":"2023-11-04T01:36:03.223687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418785+0000","last_change":"2023-11-04T01:35:59.181809+0000","last_active":"2023-11-04T01:36:03.418785+0000","last_peered":"2023-11-04T01:36:03.418785+0000","last_clean":"2023-11-04T01:36:03.418785+0000","last_became_active":"2023-11-04T01:35:59.181546+0000","last_became_peered":"2023-11-04T01:35:59.181546+0000","last_unstale":"2023-11-04T01:36:03.418785+0000","last_undegraded":"2023-11-04T01:36:03.418785+0000","last_fullsized":"2023-11-04T01:36:03.418785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:22.398332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225612+0000","last_change":"2023-11-04T01:35:59.172821+0000","last_active":"2023-11-04T01:36:03.225612+0000","last_peered":"2023-11-04T01:36:03.225612+0000","last_clean":"2023-11-04T01:36:03.225612+0000","last_became_active":"2023-11-04T01:35:59.172439+0000","last_became_peered":"2023-11-04T01:35:59.172439+0000","last_unstale":"2023-11-04T01:36:03.225612+0000","last_undegraded":"2023-11-04T01:36:03.225612+0000","last_fullsized":"2023-11-04T01:36:03.225612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:47.141443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227832+0000","last_change":"2023-11-04T01:35:59.182521+0000","last_active":"2023-11-04T01:36:03.227832+0000","last_peered":"2023-11-04T01:36:03.227832+0000","last_clean":"2023-11-04T01:36:03.227832+0000","last_became_active":"2023-11-04T01:35:59.182229+0000","last_became_peered":"2023-11-04T01:35:59.182229+0000","last_unstale":"2023-11-04T01:36:03.227832+0000","last_undegraded":"2023-11-04T01:36:03.227832+0000","last_fullsized":"2023-11-04T01:36:03.227832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:37.928056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227738+0000","last_change":"2023-11-04T01:35:59.178581+0000","last_active":"2023-11-04T01:36:03.227738+0000","last_peered":"2023-11-04T01:36:03.227738+0000","last_clean":"2023-11-04T01:36:03.227738+0000","last_became_active":"2023-11-04T01:35:59.178317+0000","last_became_peered":"2023-11-04T01:35:59.178317+0000","last_unstale":"2023-11-04T01:36:03.227738+0000","last_undegraded":"2023-11-04T01:36:03.227738+0000","last_fullsized":"2023-11-04T01:36:03.227738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233726+0000","last_change":"2023-11-04T01:35:59.177319+0000","last_active":"2023-11-04T01:36:03.233726+0000","last_peered":"2023-11-04T01:36:03.233726+0000","last_clean":"2023-11-04T01:36:03.233726+0000","last_became_active":"2023-11-04T01:35:59.176999+0000","last_became_peered":"2023-11-04T01:35:59.176999+0000","last_unstale":"2023-11-04T01:36:03.233726+0000","last_undegraded":"2023-11-04T01:36:03.233726+0000","last_fullsized":"2023-11-04T01:36:03.233726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.232947+0000","last_change":"2023-11-04T01:35:59.180087+0000","last_active":"2023-11-04T01:36:03.232947+0000","last_peered":"2023-11-04T01:36:03.232947+0000","last_clean":"2023-11-04T01:36:03.232947+0000","last_became_active":"2023-11-04T01:35:59.179661+0000","last_became_peered":"2023-11-04T01:35:59.179661+0000","last_unstale":"2023-11-04T01:36:03.232947+0000","last_undegraded":"2023-11-04T01:36:03.232947+0000","last_fullsized":"2023-11-04T01:36:03.232947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219636+0000","last_change":"2023-11-04T01:35:59.181134+0000","last_active":"2023-11-04T01:36:03.219636+0000","last_peered":"2023-11-04T01:36:03.219636+0000","last_clean":"2023-11-04T01:36:03.219636+0000","last_became_active":"2023-11-04T01:35:59.180479+0000","last_became_peered":"2023-11-04T01:35:59.180479+0000","last_unstale":"2023-11-04T01:36:03.219636+0000","last_undegraded":"2023-11-04T01:36:03.219636+0000","last_fullsized":"2023-11-04T01:36:03.219636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224801+0000","last_change":"2023-11-04T01:35:59.172767+0000","last_active":"2023-11-04T01:36:03.224801+0000","last_peered":"2023-11-04T01:36:03.224801+0000","last_clean":"2023-11-04T01:36:03.224801+0000","last_became_active":"2023-11-04T01:35:59.172514+0000","last_became_peered":"2023-11-04T01:35:59.172514+0000","last_unstale":"2023-11-04T01:36:03.224801+0000","last_undegraded":"2023-11-04T01:36:03.224801+0000","last_fullsized":"2023-11-04T01:36:03.224801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:25.253748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223496+0000","last_change":"2023-11-04T01:35:59.188111+0000","last_active":"2023-11-04T01:36:03.223496+0000","last_peered":"2023-11-04T01:36:03.223496+0000","last_clean":"2023-11-04T01:36:03.223496+0000","last_became_active":"2023-11-04T01:35:59.187822+0000","last_became_peered":"2023-11-04T01:35:59.187822+0000","last_unstale":"2023-11-04T01:36:03.223496+0000","last_undegraded":"2023-11-04T01:36:03.223496+0000","last_fullsized":"2023-11-04T01:36:03.223496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224145+0000","last_change":"2023-11-04T01:35:59.179070+0000","last_active":"2023-11-04T01:36:03.224145+0000","last_peered":"2023-11-04T01:36:03.224145+0000","last_clean":"2023-11-04T01:36:03.224145+0000","last_became_active":"2023-11-04T01:35:59.178798+0000","last_became_peered":"2023-11-04T01:35:59.178798+0000","last_unstale":"2023-11-04T01:36:03.224145+0000","last_undegraded":"2023-11-04T01:36:03.224145+0000","last_fullsized":"2023-11-04T01:36:03.224145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418662+0000","last_change":"2023-11-04T01:35:59.189991+0000","last_active":"2023-11-04T01:36:03.418662+0000","last_peered":"2023-11-04T01:36:03.418662+0000","last_clean":"2023-11-04T01:36:03.418662+0000","last_became_active":"2023-11-04T01:35:59.189686+0000","last_became_peered":"2023-11-04T01:35:59.189686+0000","last_unstale":"2023-11-04T01:36:03.418662+0000","last_undegraded":"2023-11-04T01:36:03.418662+0000","last_fullsized":"2023-11-04T01:36:03.418662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:59:58.598970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219400+0000","last_change":"2023-11-04T01:35:59.189839+0000","last_active":"2023-11-04T01:36:03.219400+0000","last_peered":"2023-11-04T01:36:03.219400+0000","last_clean":"2023-11-04T01:36:03.219400+0000","last_became_active":"2023-11-04T01:35:59.189525+0000","last_became_peered":"2023-11-04T01:35:59.189525+0000","last_unstale":"2023-11-04T01:36:03.219400+0000","last_undegraded":"2023-11-04T01:36:03.219400+0000","last_fullsized":"2023-11-04T01:36:03.219400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:38.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417496+0000","last_change":"2023-11-04T01:35:59.182733+0000","last_active":"2023-11-04T01:36:03.417496+0000","last_peered":"2023-11-04T01:36:03.417496+0000","last_clean":"2023-11-04T01:36:03.417496+0000","last_became_active":"2023-11-04T01:35:59.180260+0000","last_became_peered":"2023-11-04T01:35:59.180260+0000","last_unstale":"2023-11-04T01:36:03.417496+0000","last_undegraded":"2023-11-04T01:36:03.417496+0000","last_fullsized":"2023-11-04T01:36:03.417496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228312+0000","last_change":"2023-11-04T01:35:59.184451+0000","last_active":"2023-11-04T01:36:03.228312+0000","last_peered":"2023-11-04T01:36:03.228312+0000","last_clean":"2023-11-04T01:36:03.228312+0000","last_became_active":"2023-11-04T01:35:59.184197+0000","last_became_peered":"2023-11-04T01:35:59.184197+0000","last_unstale":"2023-11-04T01:36:03.228312+0000","last_undegraded":"2023-11-04T01:36:03.228312+0000","last_fullsized":"2023-11-04T01:36:03.228312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:47.754644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417459+0000","last_change":"2023-11-04T01:35:59.185251+0000","last_active":"2023-11-04T01:36:03.417459+0000","last_peered":"2023-11-04T01:36:03.417459+0000","last_clean":"2023-11-04T01:36:03.417459+0000","last_became_active":"2023-11-04T01:35:59.184960+0000","last_became_peered":"2023-11-04T01:35:59.184960+0000","last_unstale":"2023-11-04T01:36:03.417459+0000","last_undegraded":"2023-11-04T01:36:03.417459+0000","last_fullsized":"2023-11-04T01:36:03.417459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:37.928056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228072+0000","last_change":"2023-11-04T01:35:59.185741+0000","last_active":"2023-11-04T01:36:03.228072+0000","last_peered":"2023-11-04T01:36:03.228072+0000","last_clean":"2023-11-04T01:36:03.228072+0000","last_became_active":"2023-11-04T01:35:59.185417+0000","last_became_peered":"2023-11-04T01:35:59.185417+0000","last_unstale":"2023-11-04T01:36:03.228072+0000","last_undegraded":"2023-11-04T01:36:03.228072+0000","last_fullsized":"2023-11-04T01:36:03.228072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231859+0000","last_change":"2023-11-04T01:35:59.173981+0000","last_active":"2023-11-04T01:36:03.231859+0000","last_peered":"2023-11-04T01:36:03.231859+0000","last_clean":"2023-11-04T01:36:03.231859+0000","last_became_active":"2023-11-04T01:35:59.173709+0000","last_became_peered":"2023-11-04T01:35:59.173709+0000","last_unstale":"2023-11-04T01:36:03.231859+0000","last_undegraded":"2023-11-04T01:36:03.231859+0000","last_fullsized":"2023-11-04T01:36:03.231859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236893+0000","last_change":"2023-11-04T01:35:59.178744+0000","last_active":"2023-11-04T01:36:03.236893+0000","last_peered":"2023-11-04T01:36:03.236893+0000","last_clean":"2023-11-04T01:36:03.236893+0000","last_became_active":"2023-11-04T01:35:59.178420+0000","last_became_peered":"2023-11-04T01:35:59.178420+0000","last_unstale":"2023-11-04T01:36:03.236893+0000","last_undegraded":"2023-11-04T01:36:03.236893+0000","last_fullsized":"2023-11-04T01:36:03.236893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417999+0000","last_change":"2023-11-04T01:35:59.182583+0000","last_active":"2023-11-04T01:36:03.417999+0000","last_peered":"2023-11-04T01:36:03.417999+0000","last_clean":"2023-11-04T01:36:03.417999+0000","last_became_active":"2023-11-04T01:35:59.179785+0000","last_became_peered":"2023-11-04T01:35:59.179785+0000","last_unstale":"2023-11-04T01:36:03.417999+0000","last_undegraded":"2023-11-04T01:36:03.417999+0000","last_fullsized":"2023-11-04T01:36:03.417999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:39.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:36:21.812 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:36:21.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.938+0000 7fa9a25a9640 1 Processor -- start 2023-11-04T01:36:21.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.938+0000 7fa9a25a9640 1 -- start start 2023-11-04T01:36:21.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.939+0000 7fa9a25a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa99c15bfb0 0x7fa99c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.939+0000 7fa9a25a9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa99c0cd860 0x7fa99c0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.939+0000 7fa9a25a9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c0cc450 con 0x7fa99c15ae40 2023-11-04T01:36:21.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.939+0000 7fa9a25a9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c15f400 con 0x7fa99c15bfb0 2023-11-04T01:36:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.939+0000 7fa9a25a9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c15b220 con 0x7fa99c0cd860 2023-11-04T01:36:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.939+0000 7fa99b7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa99c15bfb0 0x7fa99c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.939+0000 7fa99b7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa99c15bfb0 0x7fa99c0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49246/0 (socket says 172.21.15.44:49246) 2023-11-04T01:36:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.939+0000 7fa99b7fe640 1 -- 172.21.15.44:0/2798572541 learned_addr learned my addr 172.21.15.44:0/2798572541 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.939+0000 7fa9a0b46640 1 --2- 172.21.15.44:0/2798572541 >> v2:172.21.15.204:3300/0 conn(0x7fa99c0cd860 0x7fa99c0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.939+0000 7fa99b7fe640 1 -- 172.21.15.44:0/2798572541 >> v2:172.21.15.204:3300/0 conn(0x7fa99c0cd860 msgr2=0x7fa99c0ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.939+0000 7fa99b7fe640 1 --2- 172.21.15.44:0/2798572541 >> v2:172.21.15.204:3300/0 conn(0x7fa99c0cd860 0x7fa99c0ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.939+0000 7fa99b7fe640 1 -- 172.21.15.44:0/2798572541 >> v1:172.21.15.204:6789/0 conn(0x7fa99c15ae40 legacy=0x7fa99c0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.939+0000 7fa99b7fe640 1 -- 172.21.15.44:0/2798572541 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c15f890 con 0x7fa99c15bfb0 2023-11-04T01:36:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.940+0000 7fa99b7fe640 1 --2- 172.21.15.44:0/2798572541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa99c15bfb0 0x7fa99c0cd320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0ce5c0 tx=0x7fa98c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0258a5b60b01ce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.940+0000 7fa99affd640 1 -- 172.21.15.44:0/2798572541 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c030860 con 0x7fa99c15bfb0 2023-11-04T01:36:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.940+0000 7fa99affd640 1 -- 172.21.15.44:0/2798572541 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c0309c0 con 0x7fa99c15bfb0 2023-11-04T01:36:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.940+0000 7fa99affd640 1 -- 172.21.15.44:0/2798572541 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c030d50 con 0x7fa99c15bfb0 2023-11-04T01:36:21.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.941+0000 7fa9a25a9640 1 -- 172.21.15.44:0/2798572541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa99c15bfb0 msgr2=0x7fa99c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.941+0000 7fa9a25a9640 1 --2- 172.21.15.44:0/2798572541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa99c15bfb0 0x7fa99c0cd320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0ce5c0 tx=0x7fa98c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.941+0000 7fa9a25a9640 1 -- 172.21.15.44:0/2798572541 shutdown_connections 2023-11-04T01:36:21.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.941+0000 7fa9a25a9640 1 --2- 172.21.15.44:0/2798572541 >> v2:172.21.15.204:3300/0 conn(0x7fa99c0cd860 0x7fa99c0ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.941+0000 7fa9a25a9640 1 --2- 172.21.15.44:0/2798572541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa99c15bfb0 0x7fa99c0cd320 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.941+0000 7fa9a25a9640 1 -- 172.21.15.44:0/2798572541 >> 172.21.15.44:0/2798572541 conn(0x7fa99c06ea90 msgr2=0x7fa99c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.941+0000 7fa9a25a9640 1 -- 172.21.15.44:0/2798572541 shutdown_connections 2023-11-04T01:36:21.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.941+0000 7fa9a25a9640 1 -- 172.21.15.44:0/2798572541 wait complete. 2023-11-04T01:36:21.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.942+0000 7fa9a25a9640 1 Processor -- start 2023-11-04T01:36:21.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.942+0000 7fa9a25a9640 1 -- start start 2023-11-04T01:36:21.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa9a25a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa99c0cd860 0x7fa99c0c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa9a25a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa99c15ae40 0x7fa99c0c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa9a25a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa99c15bfb0 0x7fa99c0cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa9a25a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c8860 con 0x7fa99c15bfb0 2023-11-04T01:36:21.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa9a25a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c3dc0 con 0x7fa99c15ae40 2023-11-04T01:36:21.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa9a25a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c7c70 con 0x7fa99c0cd860 2023-11-04T01:36:21.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa9a0b46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa99c15bfb0 0x7fa99c0cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa9a0b46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa99c15bfb0 0x7fa99c0cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49258/0 (socket says 172.21.15.44:49258) 2023-11-04T01:36:21.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa9a0b46640 1 -- 172.21.15.44:0/3233434077 learned_addr learned my addr 172.21.15.44:0/3233434077 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:21.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa99b7fe640 1 --2- 172.21.15.44:0/3233434077 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa99c15ae40 0x7fa99c0c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa99bfff640 1 --2- 172.21.15.44:0/3233434077 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa99c0cd860 0x7fa99c0c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa9a0b46640 1 -- 172.21.15.44:0/3233434077 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa99c0cd860 msgr2=0x7fa99c0c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa9a0b46640 1 --2- 172.21.15.44:0/3233434077 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa99c0cd860 0x7fa99c0c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa9a0b46640 1 -- 172.21.15.44:0/3233434077 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa99c15ae40 msgr2=0x7fa99c0c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa9a0b46640 1 --2- 172.21.15.44:0/3233434077 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa99c15ae40 0x7fa99c0c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.943+0000 7fa9a0b46640 1 -- 172.21.15.44:0/3233434077 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c0094d0 con 0x7fa99c15bfb0 2023-11-04T01:36:21.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.944+0000 7fa9a0b46640 1 --2- 172.21.15.44:0/3233434077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa99c15bfb0 0x7fa99c0cfcc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa994007e40 tx=0x7fa99400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.944+0000 7fa998ff9640 1 -- 172.21.15.44:0/3233434077 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994014620 con 0x7fa99c15bfb0 2023-11-04T01:36:21.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.944+0000 7fa998ff9640 1 -- 172.21.15.44:0/3233434077 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99400ee90 con 0x7fa99c15bfb0 2023-11-04T01:36:21.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.944+0000 7fa998ff9640 1 -- 172.21.15.44:0/3233434077 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9940149e0 con 0x7fa99c15bfb0 2023-11-04T01:36:21.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.944+0000 7fa9a25a9640 1 -- 172.21.15.44:0/3233434077 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99c0c7ec0 con 0x7fa99c15bfb0 2023-11-04T01:36:21.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.944+0000 7fa9a25a9640 1 -- 172.21.15.44:0/3233434077 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c0c8480 con 0x7fa99c15bfb0 2023-11-04T01:36:21.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.945+0000 7fa9a25a9640 1 -- 172.21.15.44:0/3233434077 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99c0ce2d0 con 0x7fa99c15bfb0 2023-11-04T01:36:21.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.945+0000 7fa998ff9640 1 -- 172.21.15.44:0/3233434077 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa994014b40 con 0x7fa99c15bfb0 2023-11-04T01:36:21.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.946+0000 7fa998ff9640 1 --2- 172.21.15.44:0/3233434077 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa98806aea0 0x7fa98806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.946+0000 7fa998ff9640 1 -- 172.21.15.44:0/3233434077 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa99408a0d0 con 0x7fa99c15bfb0 2023-11-04T01:36:21.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.946+0000 7fa99bfff640 1 --2- 172.21.15.44:0/3233434077 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa98806aea0 0x7fa98806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.946+0000 7fa99bfff640 1 --2- 172.21.15.44:0/3233434077 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa98806aea0 0x7fa98806d360 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa990000f60 tx=0x7fa990009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:21.950+0000 7fa998ff9640 1 -- 172.21.15.44:0/3233434077 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa994054fd0 con 0x7fa99c15bfb0 2023-11-04T01:36:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.121+0000 7fa9a25a9640 1 -- 172.21.15.44:0/3233434077 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa99c15edb0 con 0x7fa98806aea0 2023-11-04T01:36:22.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.130+0000 7fa998ff9640 1 -- 172.21.15.44:0/3233434077 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345241 (secure 0 0 0) 0x7fa9900014a0 con 0x7fa98806aea0 2023-11-04T01:36:22.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:36:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.133+0000 7fa9a25a9640 1 -- 172.21.15.44:0/3233434077 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa98806aea0 msgr2=0x7fa98806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.133+0000 7fa9a25a9640 1 --2- 172.21.15.44:0/3233434077 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa98806aea0 0x7fa98806d360 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa990000f60 tx=0x7fa990009040 comp rx=0 tx=0).stop 2023-11-04T01:36:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.133+0000 7fa9a25a9640 1 -- 172.21.15.44:0/3233434077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa99c15bfb0 msgr2=0x7fa99c0cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.133+0000 7fa9a25a9640 1 --2- 172.21.15.44:0/3233434077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa99c15bfb0 0x7fa99c0cfcc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa994007e40 tx=0x7fa99400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.133+0000 7fa9a25a9640 1 -- 172.21.15.44:0/3233434077 shutdown_connections 2023-11-04T01:36:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.133+0000 7fa9a25a9640 1 --2- 172.21.15.44:0/3233434077 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa98806aea0 0x7fa98806d360 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.133+0000 7fa9a25a9640 1 --2- 172.21.15.44:0/3233434077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa99c15bfb0 0x7fa99c0cfcc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.133+0000 7fa9a25a9640 1 --2- 172.21.15.44:0/3233434077 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa99c15ae40 0x7fa99c0c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.133+0000 7fa9a25a9640 1 --2- 172.21.15.44:0/3233434077 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa99c0cd860 0x7fa99c0c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.133+0000 7fa9a25a9640 1 -- 172.21.15.44:0/3233434077 >> 172.21.15.44:0/3233434077 conn(0x7fa99c06ea90 msgr2=0x7fa99c158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:22.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.133+0000 7fa9a25a9640 1 -- 172.21.15.44:0/3233434077 shutdown_connections 2023-11-04T01:36:22.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.133+0000 7fa9a25a9640 1 -- 172.21.15.44:0/3233434077 wait complete. 2023-11-04T01:36:22.155 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-11-04T01:36:20.577360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3280896,"data_stored":1987331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003298"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233378+0000","last_change":"2023-11-04T01:35:58.195271+0000","last_active":"2023-11-04T01:36:03.233378+0000","last_peered":"2023-11-04T01:36:03.233378+0000","last_clean":"2023-11-04T01:36:03.233378+0000","last_became_active":"2023-11-04T01:35:58.194946+0000","last_became_peered":"2023-11-04T01:35:58.194946+0000","last_unstale":"2023-11-04T01:36:03.233378+0000","last_undegraded":"2023-11-04T01:36:03.233378+0000","last_fullsized":"2023-11-04T01:36:03.233378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:46.133808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220450+0000","last_change":"2023-11-04T01:35:59.179018+0000","last_active":"2023-11-04T01:36:03.220450+0000","last_peered":"2023-11-04T01:36:03.220450+0000","last_clean":"2023-11-04T01:36:03.220450+0000","last_became_active":"2023-11-04T01:35:59.178607+0000","last_became_peered":"2023-11-04T01:35:59.178607+0000","last_unstale":"2023-11-04T01:36:03.220450+0000","last_undegraded":"2023-11-04T01:36:03.220450+0000","last_fullsized":"2023-11-04T01:36:03.220450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164443+0000","last_change":"2023-11-04T01:36:03.421566+0000","last_active":"2023-11-04T01:36:04.164443+0000","last_peered":"2023-11-04T01:36:04.164443+0000","last_clean":"2023-11-04T01:36:04.164443+0000","last_became_active":"2023-11-04T01:36:03.420841+0000","last_became_peered":"2023-11-04T01:36:03.420841+0000","last_unstale":"2023-11-04T01:36:04.164443+0000","last_undegraded":"2023-11-04T01:36:04.164443+0000","last_fullsized":"2023-11-04T01:36:04.164443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:09.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220481+0000","last_change":"2023-11-04T01:35:58.192868+0000","last_active":"2023-11-04T01:36:03.220481+0000","last_peered":"2023-11-04T01:36:03.220481+0000","last_clean":"2023-11-04T01:36:03.220481+0000","last_became_active":"2023-11-04T01:35:58.192539+0000","last_became_peered":"2023-11-04T01:35:58.192539+0000","last_unstale":"2023-11-04T01:36:03.220481+0000","last_undegraded":"2023-11-04T01:36:03.220481+0000","last_fullsized":"2023-11-04T01:36:03.220481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:56.079264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231660+0000","last_change":"2023-11-04T01:35:59.188981+0000","last_active":"2023-11-04T01:36:03.231660+0000","last_peered":"2023-11-04T01:36:03.231660+0000","last_clean":"2023-11-04T01:36:03.231660+0000","last_became_active":"2023-11-04T01:35:59.188652+0000","last_became_peered":"2023-11-04T01:35:59.188652+0000","last_unstale":"2023-11-04T01:36:03.231660+0000","last_undegraded":"2023-11-04T01:36:03.231660+0000","last_fullsized":"2023-11-04T01:36:03.231660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165630+0000","last_change":"2023-11-04T01:36:03.236391+0000","last_active":"2023-11-04T01:36:04.165630+0000","last_peered":"2023-11-04T01:36:04.165630+0000","last_clean":"2023-11-04T01:36:04.165630+0000","last_became_active":"2023-11-04T01:36:03.235906+0000","last_became_peered":"2023-11-04T01:36:03.235906+0000","last_unstale":"2023-11-04T01:36:04.165630+0000","last_undegraded":"2023-11-04T01:36:04.165630+0000","last_fullsized":"2023-11-04T01:36:04.165630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:35.196927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418151+0000","last_change":"2023-11-04T01:35:58.197184+0000","last_active":"2023-11-04T01:36:03.418151+0000","last_peered":"2023-11-04T01:36:03.418151+0000","last_clean":"2023-11-04T01:36:03.418151+0000","last_became_active":"2023-11-04T01:35:58.196766+0000","last_became_peered":"2023-11-04T01:35:58.196766+0000","last_unstale":"2023-11-04T01:36:03.418151+0000","last_undegraded":"2023-11-04T01:36:03.418151+0000","last_fullsized":"2023-11-04T01:36:03.418151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:04.765423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228152+0000","last_change":"2023-11-04T01:35:59.189310+0000","last_active":"2023-11-04T01:36:03.228152+0000","last_peered":"2023-11-04T01:36:03.228152+0000","last_clean":"2023-11-04T01:36:03.228152+0000","last_became_active":"2023-11-04T01:35:59.189034+0000","last_became_peered":"2023-11-04T01:35:59.189034+0000","last_unstale":"2023-11-04T01:36:03.228152+0000","last_undegraded":"2023-11-04T01:36:03.228152+0000","last_fullsized":"2023-11-04T01:36:03.228152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:31.045884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165630+0000","last_change":"2023-11-04T01:36:03.237859+0000","last_active":"2023-11-04T01:36:04.165630+0000","last_peered":"2023-11-04T01:36:04.165630+0000","last_clean":"2023-11-04T01:36:04.165630+0000","last_became_active":"2023-11-04T01:36:03.237472+0000","last_became_peered":"2023-11-04T01:36:03.237472+0000","last_unstale":"2023-11-04T01:36:04.165630+0000","last_undegraded":"2023-11-04T01:36:04.165630+0000","last_fullsized":"2023-11-04T01:36:04.165630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:47.574623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417583+0000","last_change":"2023-11-04T01:35:58.196082+0000","last_active":"2023-11-04T01:36:03.417583+0000","last_peered":"2023-11-04T01:36:03.417583+0000","last_clean":"2023-11-04T01:36:03.417583+0000","last_became_active":"2023-11-04T01:35:58.195823+0000","last_became_peered":"2023-11-04T01:35:58.195823+0000","last_unstale":"2023-11-04T01:36:03.417583+0000","last_undegraded":"2023-11-04T01:36:03.417583+0000","last_fullsized":"2023-11-04T01:36:03.417583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227869+0000","last_change":"2023-11-04T01:35:59.182650+0000","last_active":"2023-11-04T01:36:03.227869+0000","last_peered":"2023-11-04T01:36:03.227869+0000","last_clean":"2023-11-04T01:36:03.227869+0000","last_became_active":"2023-11-04T01:35:59.182397+0000","last_became_peered":"2023-11-04T01:35:59.182397+0000","last_unstale":"2023-11-04T01:36:03.227869+0000","last_undegraded":"2023-11-04T01:36:03.227869+0000","last_fullsized":"2023-11-04T01:36:03.227869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165302+0000","last_change":"2023-11-04T01:36:03.238226+0000","last_active":"2023-11-04T01:36:04.165302+0000","last_peered":"2023-11-04T01:36:04.165302+0000","last_clean":"2023-11-04T01:36:04.165302+0000","last_became_active":"2023-11-04T01:36:03.237796+0000","last_became_peered":"2023-11-04T01:36:03.237796+0000","last_unstale":"2023-11-04T01:36:04.165302+0000","last_undegraded":"2023-11-04T01:36:04.165302+0000","last_fullsized":"2023-11-04T01:36:04.165302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:56.134800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223628+0000","last_change":"2023-11-04T01:35:59.175182+0000","last_active":"2023-11-04T01:36:03.223628+0000","last_peered":"2023-11-04T01:36:03.223628+0000","last_clean":"2023-11-04T01:36:03.223628+0000","last_became_active":"2023-11-04T01:35:59.174889+0000","last_became_peered":"2023-11-04T01:35:59.174889+0000","last_unstale":"2023-11-04T01:36:03.223628+0000","last_undegraded":"2023-11-04T01:36:03.223628+0000","last_fullsized":"2023-11-04T01:36:03.223628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417641+0000","last_change":"2023-11-04T01:35:58.191418+0000","last_active":"2023-11-04T01:36:03.417641+0000","last_peered":"2023-11-04T01:36:03.417641+0000","last_clean":"2023-11-04T01:36:03.417641+0000","last_became_active":"2023-11-04T01:35:58.191164+0000","last_became_peered":"2023-11-04T01:35:58.191164+0000","last_unstale":"2023-11-04T01:36:03.417641+0000","last_undegraded":"2023-11-04T01:36:03.417641+0000","last_fullsized":"2023-11-04T01:36:03.417641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:56.366802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.166438+0000","last_change":"2023-11-04T01:36:03.238741+0000","last_active":"2023-11-04T01:36:04.166438+0000","last_peered":"2023-11-04T01:36:04.166438+0000","last_clean":"2023-11-04T01:36:04.166438+0000","last_became_active":"2023-11-04T01:36:03.238130+0000","last_became_peered":"2023-11-04T01:36:03.238130+0000","last_unstale":"2023-11-04T01:36:04.166438+0000","last_undegraded":"2023-11-04T01:36:04.166438+0000","last_fullsized":"2023-11-04T01:36:04.166438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:51.792275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219755+0000","last_change":"2023-11-04T01:35:59.181378+0000","last_active":"2023-11-04T01:36:03.219755+0000","last_peered":"2023-11-04T01:36:03.219755+0000","last_clean":"2023-11-04T01:36:03.219755+0000","last_became_active":"2023-11-04T01:35:59.180852+0000","last_became_peered":"2023-11-04T01:35:59.180852+0000","last_unstale":"2023-11-04T01:36:03.219755+0000","last_undegraded":"2023-11-04T01:36:03.219755+0000","last_fullsized":"2023-11-04T01:36:03.219755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.235667+0000","last_change":"2023-11-04T01:35:58.192955+0000","last_active":"2023-11-04T01:36:03.235667+0000","last_peered":"2023-11-04T01:36:03.235667+0000","last_clean":"2023-11-04T01:36:03.235667+0000","last_became_active":"2023-11-04T01:35:58.192609+0000","last_became_peered":"2023-11-04T01:35:58.192609+0000","last_unstale":"2023-11-04T01:36:03.235667+0000","last_undegraded":"2023-11-04T01:36:03.235667+0000","last_fullsized":"2023-11-04T01:36:03.235667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165731+0000","last_change":"2023-11-04T01:36:03.239699+0000","last_active":"2023-11-04T01:36:04.165731+0000","last_peered":"2023-11-04T01:36:04.165731+0000","last_clean":"2023-11-04T01:36:04.165731+0000","last_became_active":"2023-11-04T01:36:03.239146+0000","last_became_peered":"2023-11-04T01:36:03.239146+0000","last_unstale":"2023-11-04T01:36:04.165731+0000","last_undegraded":"2023-11-04T01:36:04.165731+0000","last_fullsized":"2023-11-04T01:36:04.165731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:50.421408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220829+0000","last_change":"2023-11-04T01:35:59.179889+0000","last_active":"2023-11-04T01:36:03.220829+0000","last_peered":"2023-11-04T01:36:03.220829+0000","last_clean":"2023-11-04T01:36:03.220829+0000","last_became_active":"2023-11-04T01:35:59.178416+0000","last_became_peered":"2023-11-04T01:35:59.178416+0000","last_unstale":"2023-11-04T01:36:03.220829+0000","last_undegraded":"2023-11-04T01:36:03.220829+0000","last_fullsized":"2023-11-04T01:36:03.220829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234302+0000","last_change":"2023-11-04T01:35:58.193758+0000","last_active":"2023-11-04T01:36:03.234302+0000","last_peered":"2023-11-04T01:36:03.234302+0000","last_clean":"2023-11-04T01:36:03.234302+0000","last_became_active":"2023-11-04T01:35:58.191341+0000","last_became_peered":"2023-11-04T01:35:58.191341+0000","last_unstale":"2023-11-04T01:36:03.234302+0000","last_undegraded":"2023-11-04T01:36:03.234302+0000","last_fullsized":"2023-11-04T01:36:03.234302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:46.133808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360658+0000","last_change":"2023-11-04T01:36:03.419927+0000","last_active":"2023-11-04T01:36:05.360658+0000","last_peered":"2023-11-04T01:36:05.360658+0000","last_clean":"2023-11-04T01:36:05.360658+0000","last_became_active":"2023-11-04T01:36:03.419458+0000","last_became_peered":"2023-11-04T01:36:03.419458+0000","last_unstale":"2023-11-04T01:36:05.360658+0000","last_undegraded":"2023-11-04T01:36:05.360658+0000","last_fullsized":"2023-11-04T01:36:05.360658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:55.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.222904+0000","last_change":"2023-11-04T01:35:59.178344+0000","last_active":"2023-11-04T01:36:03.222904+0000","last_peered":"2023-11-04T01:36:03.222904+0000","last_clean":"2023-11-04T01:36:03.222904+0000","last_became_active":"2023-11-04T01:35:59.178069+0000","last_became_peered":"2023-11-04T01:35:59.178069+0000","last_unstale":"2023-11-04T01:36:03.222904+0000","last_undegraded":"2023-11-04T01:36:03.222904+0000","last_fullsized":"2023-11-04T01:36:03.222904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:17:14.967316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417197+0000","last_change":"2023-11-04T01:35:58.198451+0000","last_active":"2023-11-04T01:36:03.417197+0000","last_peered":"2023-11-04T01:36:03.417197+0000","last_clean":"2023-11-04T01:36:03.417197+0000","last_became_active":"2023-11-04T01:35:58.198191+0000","last_became_peered":"2023-11-04T01:35:58.198191+0000","last_unstale":"2023-11-04T01:36:03.417197+0000","last_undegraded":"2023-11-04T01:36:03.417197+0000","last_fullsized":"2023-11-04T01:36:03.417197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:17:13.959681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.166193+0000","last_change":"2023-11-04T01:36:03.239679+0000","last_active":"2023-11-04T01:36:04.166193+0000","last_peered":"2023-11-04T01:36:04.166193+0000","last_clean":"2023-11-04T01:36:04.166193+0000","last_became_active":"2023-11-04T01:36:03.239148+0000","last_became_peered":"2023-11-04T01:36:03.239148+0000","last_unstale":"2023-11-04T01:36:04.166193+0000","last_undegraded":"2023-11-04T01:36:04.166193+0000","last_fullsized":"2023-11-04T01:36:04.166193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:35.083514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233606+0000","last_change":"2023-11-04T01:35:59.179921+0000","last_active":"2023-11-04T01:36:03.233606+0000","last_peered":"2023-11-04T01:36:03.233606+0000","last_clean":"2023-11-04T01:36:03.233606+0000","last_became_active":"2023-11-04T01:35:59.179555+0000","last_became_peered":"2023-11-04T01:35:59.179555+0000","last_unstale":"2023-11-04T01:36:03.233606+0000","last_undegraded":"2023-11-04T01:36:03.233606+0000","last_fullsized":"2023-11-04T01:36:03.233606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224666+0000","last_change":"2023-11-04T01:35:58.194520+0000","last_active":"2023-11-04T01:36:03.224666+0000","last_peered":"2023-11-04T01:36:03.224666+0000","last_clean":"2023-11-04T01:36:03.224666+0000","last_became_active":"2023-11-04T01:35:58.193227+0000","last_became_peered":"2023-11-04T01:35:58.193227+0000","last_unstale":"2023-11-04T01:36:03.224666+0000","last_undegraded":"2023-11-04T01:36:03.224666+0000","last_fullsized":"2023-11-04T01:36:03.224666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:56.079264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165353+0000","last_change":"2023-11-04T01:36:03.422666+0000","last_active":"2023-11-04T01:36:04.165353+0000","last_peered":"2023-11-04T01:36:04.165353+0000","last_clean":"2023-11-04T01:36:04.165353+0000","last_became_active":"2023-11-04T01:36:03.422271+0000","last_became_peered":"2023-11-04T01:36:03.422271+0000","last_unstale":"2023-11-04T01:36:04.165353+0000","last_undegraded":"2023-11-04T01:36:04.165353+0000","last_fullsized":"2023-11-04T01:36:04.165353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:00.309557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219727+0000","last_change":"2023-11-04T01:35:59.183456+0000","last_active":"2023-11-04T01:36:03.219727+0000","last_peered":"2023-11-04T01:36:03.219727+0000","last_clean":"2023-11-04T01:36:03.219727+0000","last_became_active":"2023-11-04T01:35:59.182344+0000","last_became_peered":"2023-11-04T01:35:59.182344+0000","last_unstale":"2023-11-04T01:36:03.219727+0000","last_undegraded":"2023-11-04T01:36:03.219727+0000","last_fullsized":"2023-11-04T01:36:03.219727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.237645+0000","last_change":"2023-11-04T01:35:58.193617+0000","last_active":"2023-11-04T01:36:03.237645+0000","last_peered":"2023-11-04T01:36:03.237645+0000","last_clean":"2023-11-04T01:36:03.237645+0000","last_became_active":"2023-11-04T01:35:58.193111+0000","last_became_peered":"2023-11-04T01:35:58.193111+0000","last_unstale":"2023-11-04T01:36:03.237645+0000","last_undegraded":"2023-11-04T01:36:03.237645+0000","last_fullsized":"2023-11-04T01:36:03.237645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:56.079264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164341+0000","last_change":"2023-11-04T01:36:03.418076+0000","last_active":"2023-11-04T01:36:04.164341+0000","last_peered":"2023-11-04T01:36:04.164341+0000","last_clean":"2023-11-04T01:36:04.164341+0000","last_became_active":"2023-11-04T01:36:03.417662+0000","last_became_peered":"2023-11-04T01:36:03.417662+0000","last_unstale":"2023-11-04T01:36:04.164341+0000","last_undegraded":"2023-11-04T01:36:04.164341+0000","last_fullsized":"2023-11-04T01:36:04.164341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:55.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234516+0000","last_change":"2023-11-04T01:35:59.177457+0000","last_active":"2023-11-04T01:36:03.234516+0000","last_peered":"2023-11-04T01:36:03.234516+0000","last_clean":"2023-11-04T01:36:03.234516+0000","last_became_active":"2023-11-04T01:35:59.177119+0000","last_became_peered":"2023-11-04T01:35:59.177119+0000","last_unstale":"2023-11-04T01:36:03.234516+0000","last_undegraded":"2023-11-04T01:36:03.234516+0000","last_fullsized":"2023-11-04T01:36:03.234516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418829+0000","last_change":"2023-11-04T01:35:58.198460+0000","last_active":"2023-11-04T01:36:03.418829+0000","last_peered":"2023-11-04T01:36:03.418829+0000","last_clean":"2023-11-04T01:36:03.418829+0000","last_became_active":"2023-11-04T01:35:58.198149+0000","last_became_peered":"2023-11-04T01:35:58.198149+0000","last_unstale":"2023-11-04T01:36:03.418829+0000","last_undegraded":"2023-11-04T01:36:03.418829+0000","last_fullsized":"2023-11-04T01:36:03.418829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:37.379069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.113926+0000","last_change":"2023-11-04T01:36:03.418067+0000","last_active":"2023-11-04T01:36:05.113926+0000","last_peered":"2023-11-04T01:36:05.113926+0000","last_clean":"2023-11-04T01:36:05.113926+0000","last_became_active":"2023-11-04T01:36:03.417580+0000","last_became_peered":"2023-11-04T01:36:03.417580+0000","last_unstale":"2023-11-04T01:36:05.113926+0000","last_undegraded":"2023-11-04T01:36:05.113926+0000","last_fullsized":"2023-11-04T01:36:05.113926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:02.636600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228055+0000","last_change":"2023-11-04T01:35:59.181672+0000","last_active":"2023-11-04T01:36:03.228055+0000","last_peered":"2023-11-04T01:36:03.228055+0000","last_clean":"2023-11-04T01:36:03.228055+0000","last_became_active":"2023-11-04T01:35:59.181366+0000","last_became_peered":"2023-11-04T01:35:59.181366+0000","last_unstale":"2023-11-04T01:36:03.228055+0000","last_undegraded":"2023-11-04T01:36:03.228055+0000","last_fullsized":"2023-11-04T01:36:03.228055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:41.888526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234512+0000","last_change":"2023-11-04T01:35:58.198371+0000","last_active":"2023-11-04T01:36:03.234512+0000","last_peered":"2023-11-04T01:36:03.234512+0000","last_clean":"2023-11-04T01:36:03.234512+0000","last_became_active":"2023-11-04T01:35:58.197948+0000","last_became_peered":"2023-11-04T01:35:58.197948+0000","last_unstale":"2023-11-04T01:36:03.234512+0000","last_undegraded":"2023-11-04T01:36:03.234512+0000","last_fullsized":"2023-11-04T01:36:03.234512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:37.960678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360112+0000","last_change":"2023-11-04T01:36:03.242811+0000","last_active":"2023-11-04T01:36:05.360112+0000","last_peered":"2023-11-04T01:36:05.360112+0000","last_clean":"2023-11-04T01:36:05.360112+0000","last_became_active":"2023-11-04T01:36:03.242415+0000","last_became_peered":"2023-11-04T01:36:03.242415+0000","last_unstale":"2023-11-04T01:36:05.360112+0000","last_undegraded":"2023-11-04T01:36:05.360112+0000","last_fullsized":"2023-11-04T01:36:05.360112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:26.435962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224250+0000","last_change":"2023-11-04T01:35:59.172529+0000","last_active":"2023-11-04T01:36:03.224250+0000","last_peered":"2023-11-04T01:36:03.224250+0000","last_clean":"2023-11-04T01:36:03.224250+0000","last_became_active":"2023-11-04T01:35:59.172235+0000","last_became_peered":"2023-11-04T01:35:59.172235+0000","last_unstale":"2023-11-04T01:36:03.224250+0000","last_undegraded":"2023-11-04T01:36:03.224250+0000","last_fullsized":"2023-11-04T01:36:03.224250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:48.565872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228657+0000","last_change":"2023-11-04T01:35:58.192742+0000","last_active":"2023-11-04T01:36:03.228657+0000","last_peered":"2023-11-04T01:36:03.228657+0000","last_clean":"2023-11-04T01:36:03.228657+0000","last_became_active":"2023-11-04T01:35:58.192399+0000","last_became_peered":"2023-11-04T01:35:58.192399+0000","last_unstale":"2023-11-04T01:36:03.228657+0000","last_undegraded":"2023-11-04T01:36:03.228657+0000","last_fullsized":"2023-11-04T01:36:03.228657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:42.026489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360489+0000","last_change":"2023-11-04T01:36:03.244294+0000","last_active":"2023-11-04T01:36:05.360489+0000","last_peered":"2023-11-04T01:36:05.360489+0000","last_clean":"2023-11-04T01:36:05.360489+0000","last_became_active":"2023-11-04T01:36:03.243799+0000","last_became_peered":"2023-11-04T01:36:03.243799+0000","last_unstale":"2023-11-04T01:36:05.360489+0000","last_undegraded":"2023-11-04T01:36:05.360489+0000","last_fullsized":"2023-11-04T01:36:05.360489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:32.058795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.234087+0000","last_change":"2023-11-04T01:35:59.181498+0000","last_active":"2023-11-04T01:36:03.234087+0000","last_peered":"2023-11-04T01:36:03.234087+0000","last_clean":"2023-11-04T01:36:03.234087+0000","last_became_active":"2023-11-04T01:35:59.181162+0000","last_became_peered":"2023-11-04T01:35:59.181162+0000","last_unstale":"2023-11-04T01:36:03.234087+0000","last_undegraded":"2023-11-04T01:36:03.234087+0000","last_fullsized":"2023-11-04T01:36:03.234087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225409+0000","last_change":"2023-11-04T01:35:58.194393+0000","last_active":"2023-11-04T01:36:03.225409+0000","last_peered":"2023-11-04T01:36:03.225409+0000","last_clean":"2023-11-04T01:36:03.225409+0000","last_became_active":"2023-11-04T01:35:58.194066+0000","last_became_peered":"2023-11-04T01:35:58.194066+0000","last_unstale":"2023-11-04T01:36:03.225409+0000","last_undegraded":"2023-11-04T01:36:03.225409+0000","last_fullsized":"2023-11-04T01:36:03.225409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:24.246113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360736+0000","last_change":"2023-11-04T01:36:03.241689+0000","last_active":"2023-11-04T01:36:05.360736+0000","last_peered":"2023-11-04T01:36:05.360736+0000","last_clean":"2023-11-04T01:36:05.360736+0000","last_became_active":"2023-11-04T01:36:03.241310+0000","last_became_peered":"2023-11-04T01:36:03.241310+0000","last_unstale":"2023-11-04T01:36:05.360736+0000","last_undegraded":"2023-11-04T01:36:05.360736+0000","last_fullsized":"2023-11-04T01:36:05.360736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:09.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231312+0000","last_change":"2023-11-04T01:35:59.168220+0000","last_active":"2023-11-04T01:36:03.231312+0000","last_peered":"2023-11-04T01:36:03.231312+0000","last_clean":"2023-11-04T01:36:03.231312+0000","last_became_active":"2023-11-04T01:35:59.167947+0000","last_became_peered":"2023-11-04T01:35:59.167947+0000","last_unstale":"2023-11-04T01:36:03.231312+0000","last_undegraded":"2023-11-04T01:36:03.231312+0000","last_fullsized":"2023-11-04T01:36:03.231312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:38.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417210+0000","last_change":"2023-11-04T01:35:58.194356+0000","last_active":"2023-11-04T01:36:03.417210+0000","last_peered":"2023-11-04T01:36:03.417210+0000","last_clean":"2023-11-04T01:36:03.417210+0000","last_became_active":"2023-11-04T01:35:58.194084+0000","last_became_peered":"2023-11-04T01:35:58.194084+0000","last_unstale":"2023-11-04T01:36:03.417210+0000","last_undegraded":"2023-11-04T01:36:03.417210+0000","last_fullsized":"2023-11-04T01:36:03.417210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:47.558236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.114218+0000","last_change":"2023-11-04T01:36:03.419657+0000","last_active":"2023-11-04T01:36:05.114218+0000","last_peered":"2023-11-04T01:36:05.114218+0000","last_clean":"2023-11-04T01:36:05.114218+0000","last_became_active":"2023-11-04T01:36:03.419283+0000","last_became_peered":"2023-11-04T01:36:03.419283+0000","last_unstale":"2023-11-04T01:36:05.114218+0000","last_undegraded":"2023-11-04T01:36:05.114218+0000","last_fullsized":"2023-11-04T01:36:05.114218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:49.330726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219822+0000","last_change":"2023-11-04T01:35:59.183758+0000","last_active":"2023-11-04T01:36:03.219822+0000","last_peered":"2023-11-04T01:36:03.219822+0000","last_clean":"2023-11-04T01:36:03.219822+0000","last_became_active":"2023-11-04T01:35:59.183457+0000","last_became_peered":"2023-11-04T01:35:59.183457+0000","last_unstale":"2023-11-04T01:36:03.219822+0000","last_undegraded":"2023-11-04T01:36:03.219822+0000","last_fullsized":"2023-11-04T01:36:03.219822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227709+0000","last_change":"2023-11-04T01:35:58.193549+0000","last_active":"2023-11-04T01:36:03.227709+0000","last_peered":"2023-11-04T01:36:03.227709+0000","last_clean":"2023-11-04T01:36:03.227709+0000","last_became_active":"2023-11-04T01:35:58.193066+0000","last_became_peered":"2023-11-04T01:35:58.193066+0000","last_unstale":"2023-11-04T01:36:03.227709+0000","last_undegraded":"2023-11-04T01:36:03.227709+0000","last_fullsized":"2023-11-04T01:36:03.227709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:30.570768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417292+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:36:03.417292+0000","last_peered":"2023-11-04T01:36:03.417292+0000","last_clean":"2023-11-04T01:36:03.417292+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:36:03.417292+0000","last_undegraded":"2023-11-04T01:36:03.417292+0000","last_fullsized":"2023-11-04T01:36:03.417292+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165356+0000","last_change":"2023-11-04T01:36:03.420650+0000","last_active":"2023-11-04T01:36:04.165356+0000","last_peered":"2023-11-04T01:36:04.165356+0000","last_clean":"2023-11-04T01:36:04.165356+0000","last_became_active":"2023-11-04T01:36:03.420227+0000","last_became_peered":"2023-11-04T01:36:03.420227+0000","last_unstale":"2023-11-04T01:36:04.165356+0000","last_undegraded":"2023-11-04T01:36:04.165356+0000","last_fullsized":"2023-11-04T01:36:04.165356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:41.965687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418146+0000","last_change":"2023-11-04T01:35:59.188596+0000","last_active":"2023-11-04T01:36:03.418146+0000","last_peered":"2023-11-04T01:36:03.418146+0000","last_clean":"2023-11-04T01:36:03.418146+0000","last_became_active":"2023-11-04T01:35:59.188308+0000","last_became_peered":"2023-11-04T01:35:59.188308+0000","last_unstale":"2023-11-04T01:36:03.418146+0000","last_undegraded":"2023-11-04T01:36:03.418146+0000","last_fullsized":"2023-11-04T01:36:03.418146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:41.888526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.226336+0000","last_change":"2023-11-04T01:35:58.196283+0000","last_active":"2023-11-04T01:36:03.226336+0000","last_peered":"2023-11-04T01:36:03.226336+0000","last_clean":"2023-11-04T01:36:03.226336+0000","last_became_active":"2023-11-04T01:35:58.195971+0000","last_became_peered":"2023-11-04T01:35:58.195971+0000","last_unstale":"2023-11-04T01:36:03.226336+0000","last_undegraded":"2023-11-04T01:36:03.226336+0000","last_fullsized":"2023-11-04T01:36:03.226336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:47.558236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165453+0000","last_change":"2023-11-04T01:36:03.418712+0000","last_active":"2023-11-04T01:36:04.165453+0000","last_peered":"2023-11-04T01:36:04.165453+0000","last_clean":"2023-11-04T01:36:04.165453+0000","last_became_active":"2023-11-04T01:36:03.417693+0000","last_became_peered":"2023-11-04T01:36:03.417693+0000","last_unstale":"2023-11-04T01:36:04.165453+0000","last_undegraded":"2023-11-04T01:36:04.165453+0000","last_fullsized":"2023-11-04T01:36:04.165453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:35.083514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228228+0000","last_change":"2023-11-04T01:35:59.187963+0000","last_active":"2023-11-04T01:36:03.228228+0000","last_peered":"2023-11-04T01:36:03.228228+0000","last_clean":"2023-11-04T01:36:03.228228+0000","last_became_active":"2023-11-04T01:35:59.187711+0000","last_became_peered":"2023-11-04T01:35:59.187711+0000","last_unstale":"2023-11-04T01:36:03.228228+0000","last_undegraded":"2023-11-04T01:36:03.228228+0000","last_fullsized":"2023-11-04T01:36:03.228228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:39.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236382+0000","last_change":"2023-11-04T01:35:58.190482+0000","last_active":"2023-11-04T01:36:03.236382+0000","last_peered":"2023-11-04T01:36:03.236382+0000","last_clean":"2023-11-04T01:36:03.236382+0000","last_became_active":"2023-11-04T01:35:58.190198+0000","last_became_peered":"2023-11-04T01:35:58.190198+0000","last_unstale":"2023-11-04T01:36:03.236382+0000","last_undegraded":"2023-11-04T01:36:03.236382+0000","last_fullsized":"2023-11-04T01:36:03.236382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:37.379069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.113987+0000","last_change":"2023-11-04T01:36:03.236376+0000","last_active":"2023-11-04T01:36:05.113987+0000","last_peered":"2023-11-04T01:36:05.113987+0000","last_clean":"2023-11-04T01:36:05.113987+0000","last_became_active":"2023-11-04T01:36:03.235968+0000","last_became_peered":"2023-11-04T01:36:03.235968+0000","last_unstale":"2023-11-04T01:36:05.113987+0000","last_undegraded":"2023-11-04T01:36:05.113987+0000","last_fullsized":"2023-11-04T01:36:05.113987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:32.058795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418889+0000","last_change":"2023-11-04T01:35:59.188577+0000","last_active":"2023-11-04T01:36:03.418889+0000","last_peered":"2023-11-04T01:36:03.418889+0000","last_clean":"2023-11-04T01:36:03.418889+0000","last_became_active":"2023-11-04T01:35:59.188287+0000","last_became_peered":"2023-11-04T01:35:59.188287+0000","last_unstale":"2023-11-04T01:36:03.418889+0000","last_undegraded":"2023-11-04T01:36:03.418889+0000","last_fullsized":"2023-11-04T01:36:03.418889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:28.021164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225705+0000","last_change":"2023-11-04T01:35:58.194717+0000","last_active":"2023-11-04T01:36:03.225705+0000","last_peered":"2023-11-04T01:36:03.225705+0000","last_clean":"2023-11-04T01:36:03.225705+0000","last_became_active":"2023-11-04T01:35:58.194401+0000","last_became_peered":"2023-11-04T01:35:58.194401+0000","last_unstale":"2023-11-04T01:36:03.225705+0000","last_undegraded":"2023-11-04T01:36:03.225705+0000","last_fullsized":"2023-11-04T01:36:03.225705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:30.570768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360201+0000","last_change":"2023-11-04T01:36:03.422674+0000","last_active":"2023-11-04T01:36:05.360201+0000","last_peered":"2023-11-04T01:36:05.360201+0000","last_clean":"2023-11-04T01:36:05.360201+0000","last_became_active":"2023-11-04T01:36:03.422257+0000","last_became_peered":"2023-11-04T01:36:03.422257+0000","last_unstale":"2023-11-04T01:36:05.360201+0000","last_undegraded":"2023-11-04T01:36:05.360201+0000","last_fullsized":"2023-11-04T01:36:05.360201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:49.330726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418123+0000","last_change":"2023-11-04T01:35:59.179250+0000","last_active":"2023-11-04T01:36:03.418123+0000","last_peered":"2023-11-04T01:36:03.418123+0000","last_clean":"2023-11-04T01:36:03.418123+0000","last_became_active":"2023-11-04T01:35:59.178986+0000","last_became_peered":"2023-11-04T01:35:59.178986+0000","last_unstale":"2023-11-04T01:36:03.418123+0000","last_undegraded":"2023-11-04T01:36:03.418123+0000","last_fullsized":"2023-11-04T01:36:03.418123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223002+0000","last_change":"2023-11-04T01:35:58.190516+0000","last_active":"2023-11-04T01:36:03.223002+0000","last_peered":"2023-11-04T01:36:03.223002+0000","last_clean":"2023-11-04T01:36:03.223002+0000","last_became_active":"2023-11-04T01:35:58.190211+0000","last_became_peered":"2023-11-04T01:35:58.190211+0000","last_unstale":"2023-11-04T01:36:03.223002+0000","last_undegraded":"2023-11-04T01:36:03.223002+0000","last_fullsized":"2023-11-04T01:36:03.223002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:04.019377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165115+0000","last_change":"2023-11-04T01:36:03.239656+0000","last_active":"2023-11-04T01:36:04.165115+0000","last_peered":"2023-11-04T01:36:04.165115+0000","last_clean":"2023-11-04T01:36:04.165115+0000","last_became_active":"2023-11-04T01:36:03.239212+0000","last_became_peered":"2023-11-04T01:36:03.239212+0000","last_unstale":"2023-11-04T01:36:04.165115+0000","last_undegraded":"2023-11-04T01:36:04.165115+0000","last_fullsized":"2023-11-04T01:36:04.165115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:01.412068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417453+0000","last_change":"2023-11-04T01:35:59.179105+0000","last_active":"2023-11-04T01:36:03.417453+0000","last_peered":"2023-11-04T01:36:03.417453+0000","last_clean":"2023-11-04T01:36:03.417453+0000","last_became_active":"2023-11-04T01:35:59.178837+0000","last_became_peered":"2023-11-04T01:35:59.178837+0000","last_unstale":"2023-11-04T01:36:03.417453+0000","last_undegraded":"2023-11-04T01:36:03.417453+0000","last_fullsized":"2023-11-04T01:36:03.417453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225915+0000","last_change":"2023-11-04T01:35:58.195859+0000","last_active":"2023-11-04T01:36:03.225915+0000","last_peered":"2023-11-04T01:36:03.225915+0000","last_clean":"2023-11-04T01:36:03.225915+0000","last_became_active":"2023-11-04T01:35:58.195566+0000","last_became_peered":"2023-11-04T01:35:58.195566+0000","last_unstale":"2023-11-04T01:36:03.225915+0000","last_undegraded":"2023-11-04T01:36:03.225915+0000","last_fullsized":"2023-11-04T01:36:03.225915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:17:13.959681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.114145+0000","last_change":"2023-11-04T01:36:03.239374+0000","last_active":"2023-11-04T01:36:05.114145+0000","last_peered":"2023-11-04T01:36:05.114145+0000","last_clean":"2023-11-04T01:36:05.114145+0000","last_became_active":"2023-11-04T01:36:03.238617+0000","last_became_peered":"2023-11-04T01:36:03.238617+0000","last_unstale":"2023-11-04T01:36:05.114145+0000","last_undegraded":"2023-11-04T01:36:05.114145+0000","last_fullsized":"2023-11-04T01:36:05.114145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:09.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223514+0000","last_change":"2023-11-04T01:35:59.180350+0000","last_active":"2023-11-04T01:36:03.223514+0000","last_peered":"2023-11-04T01:36:03.223514+0000","last_clean":"2023-11-04T01:36:03.223514+0000","last_became_active":"2023-11-04T01:35:59.180086+0000","last_became_peered":"2023-11-04T01:35:59.180086+0000","last_unstale":"2023-11-04T01:36:03.223514+0000","last_undegraded":"2023-11-04T01:36:03.223514+0000","last_fullsized":"2023-11-04T01:36:03.223514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.222870+0000","last_change":"2023-11-04T01:35:58.186031+0000","last_active":"2023-11-04T01:36:03.222870+0000","last_peered":"2023-11-04T01:36:03.222870+0000","last_clean":"2023-11-04T01:36:03.222870+0000","last_became_active":"2023-11-04T01:35:58.185722+0000","last_became_peered":"2023-11-04T01:35:58.185722+0000","last_unstale":"2023-11-04T01:36:03.222870+0000","last_undegraded":"2023-11-04T01:36:03.222870+0000","last_fullsized":"2023-11-04T01:36:03.222870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165503+0000","last_change":"2023-11-04T01:36:03.420681+0000","last_active":"2023-11-04T01:36:04.165503+0000","last_peered":"2023-11-04T01:36:04.165503+0000","last_clean":"2023-11-04T01:36:04.165503+0000","last_became_active":"2023-11-04T01:36:03.420258+0000","last_became_peered":"2023-11-04T01:36:03.420258+0000","last_unstale":"2023-11-04T01:36:04.165503+0000","last_undegraded":"2023-11-04T01:36:04.165503+0000","last_fullsized":"2023-11-04T01:36:04.165503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:50:39.481734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417519+0000","last_change":"2023-11-04T01:35:59.188442+0000","last_active":"2023-11-04T01:36:03.417519+0000","last_peered":"2023-11-04T01:36:03.417519+0000","last_clean":"2023-11-04T01:36:03.417519+0000","last_became_active":"2023-11-04T01:35:59.188173+0000","last_became_peered":"2023-11-04T01:35:59.188173+0000","last_unstale":"2023-11-04T01:36:03.417519+0000","last_undegraded":"2023-11-04T01:36:03.417519+0000","last_fullsized":"2023-11-04T01:36:03.417519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:31.045884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228572+0000","last_change":"2023-11-04T01:35:58.197982+0000","last_active":"2023-11-04T01:36:03.228572+0000","last_peered":"2023-11-04T01:36:03.228572+0000","last_clean":"2023-11-04T01:36:03.228572+0000","last_became_active":"2023-11-04T01:35:58.197647+0000","last_became_peered":"2023-11-04T01:35:58.197647+0000","last_unstale":"2023-11-04T01:36:03.228572+0000","last_undegraded":"2023-11-04T01:36:03.228572+0000","last_fullsized":"2023-11-04T01:36:03.228572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:35.379197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165046+0000","last_change":"2023-11-04T01:36:03.419606+0000","last_active":"2023-11-04T01:36:04.165046+0000","last_peered":"2023-11-04T01:36:04.165046+0000","last_clean":"2023-11-04T01:36:04.165046+0000","last_became_active":"2023-11-04T01:36:03.419169+0000","last_became_peered":"2023-11-04T01:36:03.419169+0000","last_unstale":"2023-11-04T01:36:04.165046+0000","last_undegraded":"2023-11-04T01:36:04.165046+0000","last_fullsized":"2023-11-04T01:36:04.165046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:59.887821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233077+0000","last_change":"2023-11-04T01:35:59.175192+0000","last_active":"2023-11-04T01:36:03.233077+0000","last_peered":"2023-11-04T01:36:03.233077+0000","last_clean":"2023-11-04T01:36:03.233077+0000","last_became_active":"2023-11-04T01:35:59.174877+0000","last_became_peered":"2023-11-04T01:35:59.174877+0000","last_unstale":"2023-11-04T01:36:03.233077+0000","last_undegraded":"2023-11-04T01:36:03.233077+0000","last_fullsized":"2023-11-04T01:36:03.233077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.232115+0000","last_change":"2023-11-04T01:35:58.194353+0000","last_active":"2023-11-04T01:36:03.232115+0000","last_peered":"2023-11-04T01:36:03.232115+0000","last_clean":"2023-11-04T01:36:03.232115+0000","last_became_active":"2023-11-04T01:35:58.193311+0000","last_became_peered":"2023-11-04T01:35:58.193311+0000","last_unstale":"2023-11-04T01:36:03.232115+0000","last_undegraded":"2023-11-04T01:36:03.232115+0000","last_fullsized":"2023-11-04T01:36:03.232115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:24.246113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360678+0000","last_change":"2023-11-04T01:36:03.420683+0000","last_active":"2023-11-04T01:36:05.360678+0000","last_peered":"2023-11-04T01:36:05.360678+0000","last_clean":"2023-11-04T01:36:05.360678+0000","last_became_active":"2023-11-04T01:36:03.420294+0000","last_became_peered":"2023-11-04T01:36:03.420294+0000","last_unstale":"2023-11-04T01:36:05.360678+0000","last_undegraded":"2023-11-04T01:36:05.360678+0000","last_fullsized":"2023-11-04T01:36:05.360678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:12.398818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417775+0000","last_change":"2023-11-04T01:35:59.184924+0000","last_active":"2023-11-04T01:36:03.417775+0000","last_peered":"2023-11-04T01:36:03.417775+0000","last_clean":"2023-11-04T01:36:03.417775+0000","last_became_active":"2023-11-04T01:35:59.183229+0000","last_became_peered":"2023-11-04T01:35:59.183229+0000","last_unstale":"2023-11-04T01:36:03.417775+0000","last_undegraded":"2023-11-04T01:36:03.417775+0000","last_fullsized":"2023-11-04T01:36:03.417775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:47.754644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:10.017212+0000","last_change":"2023-11-04T01:35:58.193586+0000","last_active":"2023-11-04T01:36:10.017212+0000","last_peered":"2023-11-04T01:36:10.017212+0000","last_clean":"2023-11-04T01:36:10.017212+0000","last_became_active":"2023-11-04T01:35:58.193282+0000","last_became_peered":"2023-11-04T01:35:58.193282+0000","last_unstale":"2023-11-04T01:36:10.017212+0000","last_undegraded":"2023-11-04T01:36:10.017212+0000","last_fullsized":"2023-11-04T01:36:10.017212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:46.133808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.360370+0000","last_change":"2023-11-04T01:36:03.242995+0000","last_active":"2023-11-04T01:36:05.360370+0000","last_peered":"2023-11-04T01:36:05.360370+0000","last_clean":"2023-11-04T01:36:05.360370+0000","last_became_active":"2023-11-04T01:36:03.242623+0000","last_became_peered":"2023-11-04T01:36:03.242623+0000","last_unstale":"2023-11-04T01:36:05.360370+0000","last_undegraded":"2023-11-04T01:36:05.360370+0000","last_fullsized":"2023-11-04T01:36:05.360370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:02.636600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224883+0000","last_change":"2023-11-04T01:35:59.179661+0000","last_active":"2023-11-04T01:36:03.224883+0000","last_peered":"2023-11-04T01:36:03.224883+0000","last_clean":"2023-11-04T01:36:03.224883+0000","last_became_active":"2023-11-04T01:35:59.178791+0000","last_became_peered":"2023-11-04T01:35:59.178791+0000","last_unstale":"2023-11-04T01:36:03.224883+0000","last_undegraded":"2023-11-04T01:36:03.224883+0000","last_fullsized":"2023-11-04T01:36:03.224883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:31.578404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236138+0000","last_change":"2023-11-04T01:35:58.194817+0000","last_active":"2023-11-04T01:36:03.236138+0000","last_peered":"2023-11-04T01:36:03.236138+0000","last_clean":"2023-11-04T01:36:03.236138+0000","last_became_active":"2023-11-04T01:35:58.194521+0000","last_became_peered":"2023-11-04T01:35:58.194521+0000","last_unstale":"2023-11-04T01:36:03.236138+0000","last_undegraded":"2023-11-04T01:36:03.236138+0000","last_fullsized":"2023-11-04T01:36:03.236138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:04.765423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165862+0000","last_change":"2023-11-04T01:36:03.234265+0000","last_active":"2023-11-04T01:36:04.165862+0000","last_peered":"2023-11-04T01:36:04.165862+0000","last_clean":"2023-11-04T01:36:04.165862+0000","last_became_active":"2023-11-04T01:36:03.233858+0000","last_became_peered":"2023-11-04T01:36:03.233858+0000","last_unstale":"2023-11-04T01:36:04.165862+0000","last_undegraded":"2023-11-04T01:36:04.165862+0000","last_fullsized":"2023-11-04T01:36:04.165862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:41.965687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231787+0000","last_change":"2023-11-04T01:35:59.183367+0000","last_active":"2023-11-04T01:36:03.231787+0000","last_peered":"2023-11-04T01:36:03.231787+0000","last_clean":"2023-11-04T01:36:03.231787+0000","last_became_active":"2023-11-04T01:35:59.183053+0000","last_became_peered":"2023-11-04T01:35:59.183053+0000","last_unstale":"2023-11-04T01:36:03.231787+0000","last_undegraded":"2023-11-04T01:36:03.231787+0000","last_fullsized":"2023-11-04T01:36:03.231787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227594+0000","last_change":"2023-11-04T01:35:58.191935+0000","last_active":"2023-11-04T01:36:03.227594+0000","last_peered":"2023-11-04T01:36:03.227594+0000","last_clean":"2023-11-04T01:36:03.227594+0000","last_became_active":"2023-11-04T01:35:58.191638+0000","last_became_peered":"2023-11-04T01:35:58.191638+0000","last_unstale":"2023-11-04T01:36:03.227594+0000","last_undegraded":"2023-11-04T01:36:03.227594+0000","last_fullsized":"2023-11-04T01:36:03.227594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:04.765423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164714+0000","last_change":"2023-11-04T01:36:03.238955+0000","last_active":"2023-11-04T01:36:04.164714+0000","last_peered":"2023-11-04T01:36:04.164714+0000","last_clean":"2023-11-04T01:36:04.164714+0000","last_became_active":"2023-11-04T01:36:03.238489+0000","last_became_peered":"2023-11-04T01:36:03.238489+0000","last_unstale":"2023-11-04T01:36:04.164714+0000","last_undegraded":"2023-11-04T01:36:04.164714+0000","last_fullsized":"2023-11-04T01:36:04.164714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:12.398818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227482+0000","last_change":"2023-11-04T01:35:59.189242+0000","last_active":"2023-11-04T01:36:03.227482+0000","last_peered":"2023-11-04T01:36:03.227482+0000","last_clean":"2023-11-04T01:36:03.227482+0000","last_became_active":"2023-11-04T01:35:59.188965+0000","last_became_peered":"2023-11-04T01:35:59.188965+0000","last_unstale":"2023-11-04T01:36:03.227482+0000","last_undegraded":"2023-11-04T01:36:03.227482+0000","last_fullsized":"2023-11-04T01:36:03.227482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224557+0000","last_change":"2023-11-04T01:35:58.194320+0000","last_active":"2023-11-04T01:36:03.224557+0000","last_peered":"2023-11-04T01:36:03.224557+0000","last_clean":"2023-11-04T01:36:03.224557+0000","last_became_active":"2023-11-04T01:35:58.193983+0000","last_became_peered":"2023-11-04T01:35:58.193983+0000","last_unstale":"2023-11-04T01:36:03.224557+0000","last_undegraded":"2023-11-04T01:36:03.224557+0000","last_fullsized":"2023-11-04T01:36:03.224557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:45.043819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.164544+0000","last_change":"2023-11-04T01:36:03.419109+0000","last_active":"2023-11-04T01:36:04.164544+0000","last_peered":"2023-11-04T01:36:04.164544+0000","last_clean":"2023-11-04T01:36:04.164544+0000","last_became_active":"2023-11-04T01:36:03.418605+0000","last_became_peered":"2023-11-04T01:36:03.418605+0000","last_unstale":"2023-11-04T01:36:04.164544+0000","last_undegraded":"2023-11-04T01:36:04.164544+0000","last_fullsized":"2023-11-04T01:36:04.164544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:49.330726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:05.114053+0000","last_change":"2023-11-04T01:36:03.421492+0000","last_active":"2023-11-04T01:36:05.114053+0000","last_peered":"2023-11-04T01:36:05.114053+0000","last_clean":"2023-11-04T01:36:05.114053+0000","last_became_active":"2023-11-04T01:36:03.421133+0000","last_became_peered":"2023-11-04T01:36:03.421133+0000","last_unstale":"2023-11-04T01:36:05.114053+0000","last_undegraded":"2023-11-04T01:36:05.114053+0000","last_fullsized":"2023-11-04T01:36:05.114053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:55.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233628+0000","last_change":"2023-11-04T01:35:59.180080+0000","last_active":"2023-11-04T01:36:03.233628+0000","last_peered":"2023-11-04T01:36:03.233628+0000","last_clean":"2023-11-04T01:36:03.233628+0000","last_became_active":"2023-11-04T01:35:59.179750+0000","last_became_peered":"2023-11-04T01:35:59.179750+0000","last_unstale":"2023-11-04T01:36:03.233628+0000","last_undegraded":"2023-11-04T01:36:03.233628+0000","last_fullsized":"2023-11-04T01:36:03.233628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227976+0000","last_change":"2023-11-04T01:35:58.196231+0000","last_active":"2023-11-04T01:36:03.227976+0000","last_peered":"2023-11-04T01:36:03.227976+0000","last_clean":"2023-11-04T01:36:03.227976+0000","last_became_active":"2023-11-04T01:35:58.195948+0000","last_became_peered":"2023-11-04T01:35:58.195948+0000","last_unstale":"2023-11-04T01:36:03.227976+0000","last_undegraded":"2023-11-04T01:36:03.227976+0000","last_fullsized":"2023-11-04T01:36:03.227976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:24.246113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165703+0000","last_change":"2023-11-04T01:36:03.241495+0000","last_active":"2023-11-04T01:36:04.165703+0000","last_peered":"2023-11-04T01:36:04.165703+0000","last_clean":"2023-11-04T01:36:04.165703+0000","last_became_active":"2023-11-04T01:36:03.241086+0000","last_became_peered":"2023-11-04T01:36:03.241086+0000","last_unstale":"2023-11-04T01:36:04.165703+0000","last_undegraded":"2023-11-04T01:36:04.165703+0000","last_fullsized":"2023-11-04T01:36:04.165703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:51.792275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220744+0000","last_change":"2023-11-04T01:35:59.180953+0000","last_active":"2023-11-04T01:36:03.220744+0000","last_peered":"2023-11-04T01:36:03.220744+0000","last_clean":"2023-11-04T01:36:03.220744+0000","last_became_active":"2023-11-04T01:35:59.180652+0000","last_became_peered":"2023-11-04T01:35:59.180652+0000","last_unstale":"2023-11-04T01:36:03.220744+0000","last_undegraded":"2023-11-04T01:36:03.220744+0000","last_fullsized":"2023-11-04T01:36:03.220744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220671+0000","last_change":"2023-11-04T01:35:58.190294+0000","last_active":"2023-11-04T01:36:03.220671+0000","last_peered":"2023-11-04T01:36:03.220671+0000","last_clean":"2023-11-04T01:36:03.220671+0000","last_became_active":"2023-11-04T01:35:58.189965+0000","last_became_peered":"2023-11-04T01:35:58.189965+0000","last_unstale":"2023-11-04T01:36:03.220671+0000","last_undegraded":"2023-11-04T01:36:03.220671+0000","last_fullsized":"2023-11-04T01:36:03.220671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:47.558236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223731+0000","last_change":"2023-11-04T01:35:58.193526+0000","last_active":"2023-11-04T01:36:03.223731+0000","last_peered":"2023-11-04T01:36:03.223731+0000","last_clean":"2023-11-04T01:36:03.223731+0000","last_became_active":"2023-11-04T01:35:58.193186+0000","last_became_peered":"2023-11-04T01:35:58.193186+0000","last_unstale":"2023-11-04T01:36:03.223731+0000","last_undegraded":"2023-11-04T01:36:03.223731+0000","last_fullsized":"2023-11-04T01:36:03.223731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:37.960678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.232019+0000","last_change":"2023-11-04T01:35:59.169544+0000","last_active":"2023-11-04T01:36:03.232019+0000","last_peered":"2023-11-04T01:36:03.232019+0000","last_clean":"2023-11-04T01:36:03.232019+0000","last_became_active":"2023-11-04T01:35:59.169198+0000","last_became_peered":"2023-11-04T01:35:59.169198+0000","last_unstale":"2023-11-04T01:36:03.232019+0000","last_undegraded":"2023-11-04T01:36:03.232019+0000","last_fullsized":"2023-11-04T01:36:03.232019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:43.536992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.615595+0000","last_change":"2023-11-04T01:36:03.241169+0000","last_active":"2023-11-04T01:36:04.615595+0000","last_peered":"2023-11-04T01:36:04.615595+0000","last_clean":"2023-11-04T01:36:04.615595+0000","last_became_active":"2023-11-04T01:36:03.240462+0000","last_became_peered":"2023-11-04T01:36:03.240462+0000","last_unstale":"2023-11-04T01:36:04.615595+0000","last_undegraded":"2023-11-04T01:36:04.615595+0000","last_fullsized":"2023-11-04T01:36:04.615595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:09.810689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220136+0000","last_change":"2023-11-04T01:35:58.192293+0000","last_active":"2023-11-04T01:36:03.220136+0000","last_peered":"2023-11-04T01:36:03.220136+0000","last_clean":"2023-11-04T01:36:03.220136+0000","last_became_active":"2023-11-04T01:35:58.191972+0000","last_became_peered":"2023-11-04T01:35:58.191972+0000","last_unstale":"2023-11-04T01:36:03.220136+0000","last_undegraded":"2023-11-04T01:36:03.220136+0000","last_fullsized":"2023-11-04T01:36:03.220136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:57.163196+0000","last_clean_scrub_stamp":"2023-11-04T01:35:57.163196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:51.827509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.221974+0000","last_change":"2023-11-04T01:35:59.179878+0000","last_active":"2023-11-04T01:36:03.221974+0000","last_peered":"2023-11-04T01:36:03.221974+0000","last_clean":"2023-11-04T01:36:03.221974+0000","last_became_active":"2023-11-04T01:35:59.177460+0000","last_became_peered":"2023-11-04T01:35:59.177460+0000","last_unstale":"2023-11-04T01:36:03.221974+0000","last_undegraded":"2023-11-04T01:36:03.221974+0000","last_fullsized":"2023-11-04T01:36:03.221974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:01:15.442742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:04.165166+0000","last_change":"2023-11-04T01:36:03.240379+0000","last_active":"2023-11-04T01:36:04.165166+0000","last_peered":"2023-11-04T01:36:04.165166+0000","last_clean":"2023-11-04T01:36:04.165166+0000","last_became_active":"2023-11-04T01:36:03.239985+0000","last_became_peered":"2023-11-04T01:36:03.239985+0000","last_unstale":"2023-11-04T01:36:04.165166+0000","last_undegraded":"2023-11-04T01:36:04.165166+0000","last_fullsized":"2023-11-04T01:36:04.165166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:02.208462+0000","last_clean_scrub_stamp":"2023-11-04T01:36:02.208462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:22.738298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223423+0000","last_change":"2023-11-04T01:35:59.180546+0000","last_active":"2023-11-04T01:36:03.223423+0000","last_peered":"2023-11-04T01:36:03.223423+0000","last_clean":"2023-11-04T01:36:03.223423+0000","last_became_active":"2023-11-04T01:35:59.180121+0000","last_became_peered":"2023-11-04T01:35:59.180121+0000","last_unstale":"2023-11-04T01:36:03.223423+0000","last_undegraded":"2023-11-04T01:36:03.223423+0000","last_fullsized":"2023-11-04T01:36:03.223423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:38.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225745+0000","last_change":"2023-11-04T01:35:59.182981+0000","last_active":"2023-11-04T01:36:03.225745+0000","last_peered":"2023-11-04T01:36:03.225745+0000","last_clean":"2023-11-04T01:36:03.225745+0000","last_became_active":"2023-11-04T01:35:59.182612+0000","last_became_peered":"2023-11-04T01:35:59.182612+0000","last_unstale":"2023-11-04T01:36:03.225745+0000","last_undegraded":"2023-11-04T01:36:03.225745+0000","last_fullsized":"2023-11-04T01:36:03.225745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:38.968313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228484+0000","last_change":"2023-11-04T01:35:59.185499+0000","last_active":"2023-11-04T01:36:03.228484+0000","last_peered":"2023-11-04T01:36:03.228484+0000","last_clean":"2023-11-04T01:36:03.228484+0000","last_became_active":"2023-11-04T01:35:59.185133+0000","last_became_peered":"2023-11-04T01:35:59.185133+0000","last_unstale":"2023-11-04T01:36:03.228484+0000","last_undegraded":"2023-11-04T01:36:03.228484+0000","last_fullsized":"2023-11-04T01:36:03.228484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:22.398332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231928+0000","last_change":"2023-11-04T01:35:59.183534+0000","last_active":"2023-11-04T01:36:03.231928+0000","last_peered":"2023-11-04T01:36:03.231928+0000","last_clean":"2023-11-04T01:36:03.231928+0000","last_became_active":"2023-11-04T01:35:59.180664+0000","last_became_peered":"2023-11-04T01:35:59.180664+0000","last_unstale":"2023-11-04T01:36:03.231928+0000","last_undegraded":"2023-11-04T01:36:03.231928+0000","last_fullsized":"2023-11-04T01:36:03.231928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220081+0000","last_change":"2023-11-04T01:35:59.182124+0000","last_active":"2023-11-04T01:36:03.220081+0000","last_peered":"2023-11-04T01:36:03.220081+0000","last_clean":"2023-11-04T01:36:03.220081+0000","last_became_active":"2023-11-04T01:35:59.181762+0000","last_became_peered":"2023-11-04T01:35:59.181762+0000","last_unstale":"2023-11-04T01:36:03.220081+0000","last_undegraded":"2023-11-04T01:36:03.220081+0000","last_fullsized":"2023-11-04T01:36:03.220081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236021+0000","last_change":"2023-11-04T01:35:59.184661+0000","last_active":"2023-11-04T01:36:03.236021+0000","last_peered":"2023-11-04T01:36:03.236021+0000","last_clean":"2023-11-04T01:36:03.236021+0000","last_became_active":"2023-11-04T01:35:59.184382+0000","last_became_peered":"2023-11-04T01:35:59.184382+0000","last_unstale":"2023-11-04T01:36:03.236021+0000","last_undegraded":"2023-11-04T01:36:03.236021+0000","last_fullsized":"2023-11-04T01:36:03.236021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224222+0000","last_change":"2023-11-04T01:35:59.177565+0000","last_active":"2023-11-04T01:36:03.224222+0000","last_peered":"2023-11-04T01:36:03.224222+0000","last_clean":"2023-11-04T01:36:03.224222+0000","last_became_active":"2023-11-04T01:35:59.177205+0000","last_became_peered":"2023-11-04T01:35:59.177205+0000","last_unstale":"2023-11-04T01:36:03.224222+0000","last_undegraded":"2023-11-04T01:36:03.224222+0000","last_fullsized":"2023-11-04T01:36:03.224222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219630+0000","last_change":"2023-11-04T01:35:59.183379+0000","last_active":"2023-11-04T01:36:03.219630+0000","last_peered":"2023-11-04T01:36:03.219630+0000","last_clean":"2023-11-04T01:36:03.219630+0000","last_became_active":"2023-11-04T01:35:59.182959+0000","last_became_peered":"2023-11-04T01:35:59.182959+0000","last_unstale":"2023-11-04T01:36:03.219630+0000","last_undegraded":"2023-11-04T01:36:03.219630+0000","last_fullsized":"2023-11-04T01:36:03.219630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:37.928056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227777+0000","last_change":"2023-11-04T01:35:59.180959+0000","last_active":"2023-11-04T01:36:03.227777+0000","last_peered":"2023-11-04T01:36:03.227777+0000","last_clean":"2023-11-04T01:36:03.227777+0000","last_became_active":"2023-11-04T01:35:59.180709+0000","last_became_peered":"2023-11-04T01:35:59.180709+0000","last_unstale":"2023-11-04T01:36:03.227777+0000","last_undegraded":"2023-11-04T01:36:03.227777+0000","last_fullsized":"2023-11-04T01:36:03.227777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.220572+0000","last_change":"2023-11-04T01:35:59.178115+0000","last_active":"2023-11-04T01:36:03.220572+0000","last_peered":"2023-11-04T01:36:03.220572+0000","last_clean":"2023-11-04T01:36:03.220572+0000","last_became_active":"2023-11-04T01:35:59.177595+0000","last_became_peered":"2023-11-04T01:35:59.177595+0000","last_unstale":"2023-11-04T01:36:03.220572+0000","last_undegraded":"2023-11-04T01:36:03.220572+0000","last_fullsized":"2023-11-04T01:36:03.220572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228396+0000","last_change":"2023-11-04T01:35:59.181853+0000","last_active":"2023-11-04T01:36:03.228396+0000","last_peered":"2023-11-04T01:36:03.228396+0000","last_clean":"2023-11-04T01:36:03.228396+0000","last_became_active":"2023-11-04T01:35:59.181499+0000","last_became_peered":"2023-11-04T01:35:59.181499+0000","last_unstale":"2023-11-04T01:36:03.228396+0000","last_undegraded":"2023-11-04T01:36:03.228396+0000","last_fullsized":"2023-11-04T01:36:03.228396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:59:58.598970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231812+0000","last_change":"2023-11-04T01:35:59.177527+0000","last_active":"2023-11-04T01:36:03.231812+0000","last_peered":"2023-11-04T01:36:03.231812+0000","last_clean":"2023-11-04T01:36:03.231812+0000","last_became_active":"2023-11-04T01:35:59.177047+0000","last_became_peered":"2023-11-04T01:35:59.177047+0000","last_unstale":"2023-11-04T01:36:03.231812+0000","last_undegraded":"2023-11-04T01:36:03.231812+0000","last_fullsized":"2023-11-04T01:36:03.231812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223687+0000","last_change":"2023-11-04T01:35:59.174531+0000","last_active":"2023-11-04T01:36:03.223687+0000","last_peered":"2023-11-04T01:36:03.223687+0000","last_clean":"2023-11-04T01:36:03.223687+0000","last_became_active":"2023-11-04T01:35:59.174277+0000","last_became_peered":"2023-11-04T01:35:59.174277+0000","last_unstale":"2023-11-04T01:36:03.223687+0000","last_undegraded":"2023-11-04T01:36:03.223687+0000","last_fullsized":"2023-11-04T01:36:03.223687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:43.034124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418785+0000","last_change":"2023-11-04T01:35:59.181809+0000","last_active":"2023-11-04T01:36:03.418785+0000","last_peered":"2023-11-04T01:36:03.418785+0000","last_clean":"2023-11-04T01:36:03.418785+0000","last_became_active":"2023-11-04T01:35:59.181546+0000","last_became_peered":"2023-11-04T01:35:59.181546+0000","last_unstale":"2023-11-04T01:36:03.418785+0000","last_undegraded":"2023-11-04T01:36:03.418785+0000","last_fullsized":"2023-11-04T01:36:03.418785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:22.398332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.225612+0000","last_change":"2023-11-04T01:35:59.172821+0000","last_active":"2023-11-04T01:36:03.225612+0000","last_peered":"2023-11-04T01:36:03.225612+0000","last_clean":"2023-11-04T01:36:03.225612+0000","last_became_active":"2023-11-04T01:35:59.172439+0000","last_became_peered":"2023-11-04T01:35:59.172439+0000","last_unstale":"2023-11-04T01:36:03.225612+0000","last_undegraded":"2023-11-04T01:36:03.225612+0000","last_fullsized":"2023-11-04T01:36:03.225612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:47.141443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227832+0000","last_change":"2023-11-04T01:35:59.182521+0000","last_active":"2023-11-04T01:36:03.227832+0000","last_peered":"2023-11-04T01:36:03.227832+0000","last_clean":"2023-11-04T01:36:03.227832+0000","last_became_active":"2023-11-04T01:35:59.182229+0000","last_became_peered":"2023-11-04T01:35:59.182229+0000","last_unstale":"2023-11-04T01:36:03.227832+0000","last_undegraded":"2023-11-04T01:36:03.227832+0000","last_fullsized":"2023-11-04T01:36:03.227832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:37.928056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.227738+0000","last_change":"2023-11-04T01:35:59.178581+0000","last_active":"2023-11-04T01:36:03.227738+0000","last_peered":"2023-11-04T01:36:03.227738+0000","last_clean":"2023-11-04T01:36:03.227738+0000","last_became_active":"2023-11-04T01:35:59.178317+0000","last_became_peered":"2023-11-04T01:35:59.178317+0000","last_unstale":"2023-11-04T01:36:03.227738+0000","last_undegraded":"2023-11-04T01:36:03.227738+0000","last_fullsized":"2023-11-04T01:36:03.227738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.233726+0000","last_change":"2023-11-04T01:35:59.177319+0000","last_active":"2023-11-04T01:36:03.233726+0000","last_peered":"2023-11-04T01:36:03.233726+0000","last_clean":"2023-11-04T01:36:03.233726+0000","last_became_active":"2023-11-04T01:35:59.176999+0000","last_became_peered":"2023-11-04T01:35:59.176999+0000","last_unstale":"2023-11-04T01:36:03.233726+0000","last_undegraded":"2023-11-04T01:36:03.233726+0000","last_fullsized":"2023-11-04T01:36:03.233726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:36.386833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.232947+0000","last_change":"2023-11-04T01:35:59.180087+0000","last_active":"2023-11-04T01:36:03.232947+0000","last_peered":"2023-11-04T01:36:03.232947+0000","last_clean":"2023-11-04T01:36:03.232947+0000","last_became_active":"2023-11-04T01:35:59.179661+0000","last_became_peered":"2023-11-04T01:35:59.179661+0000","last_unstale":"2023-11-04T01:36:03.232947+0000","last_undegraded":"2023-11-04T01:36:03.232947+0000","last_fullsized":"2023-11-04T01:36:03.232947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:26.534320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219636+0000","last_change":"2023-11-04T01:35:59.181134+0000","last_active":"2023-11-04T01:36:03.219636+0000","last_peered":"2023-11-04T01:36:03.219636+0000","last_clean":"2023-11-04T01:36:03.219636+0000","last_became_active":"2023-11-04T01:35:59.180479+0000","last_became_peered":"2023-11-04T01:35:59.180479+0000","last_unstale":"2023-11-04T01:36:03.219636+0000","last_undegraded":"2023-11-04T01:36:03.219636+0000","last_fullsized":"2023-11-04T01:36:03.219636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224801+0000","last_change":"2023-11-04T01:35:59.172767+0000","last_active":"2023-11-04T01:36:03.224801+0000","last_peered":"2023-11-04T01:36:03.224801+0000","last_clean":"2023-11-04T01:36:03.224801+0000","last_became_active":"2023-11-04T01:35:59.172514+0000","last_became_peered":"2023-11-04T01:35:59.172514+0000","last_unstale":"2023-11-04T01:36:03.224801+0000","last_undegraded":"2023-11-04T01:36:03.224801+0000","last_fullsized":"2023-11-04T01:36:03.224801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:25.253748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.223496+0000","last_change":"2023-11-04T01:35:59.188111+0000","last_active":"2023-11-04T01:36:03.223496+0000","last_peered":"2023-11-04T01:36:03.223496+0000","last_clean":"2023-11-04T01:36:03.223496+0000","last_became_active":"2023-11-04T01:35:59.187822+0000","last_became_peered":"2023-11-04T01:35:59.187822+0000","last_unstale":"2023-11-04T01:36:03.223496+0000","last_undegraded":"2023-11-04T01:36:03.223496+0000","last_fullsized":"2023-11-04T01:36:03.223496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.224145+0000","last_change":"2023-11-04T01:35:59.179070+0000","last_active":"2023-11-04T01:36:03.224145+0000","last_peered":"2023-11-04T01:36:03.224145+0000","last_clean":"2023-11-04T01:36:03.224145+0000","last_became_active":"2023-11-04T01:35:59.178798+0000","last_became_peered":"2023-11-04T01:35:59.178798+0000","last_unstale":"2023-11-04T01:36:03.224145+0000","last_undegraded":"2023-11-04T01:36:03.224145+0000","last_fullsized":"2023-11-04T01:36:03.224145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:52.097170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.418662+0000","last_change":"2023-11-04T01:35:59.189991+0000","last_active":"2023-11-04T01:36:03.418662+0000","last_peered":"2023-11-04T01:36:03.418662+0000","last_clean":"2023-11-04T01:36:03.418662+0000","last_became_active":"2023-11-04T01:35:59.189686+0000","last_became_peered":"2023-11-04T01:35:59.189686+0000","last_unstale":"2023-11-04T01:36:03.418662+0000","last_undegraded":"2023-11-04T01:36:03.418662+0000","last_fullsized":"2023-11-04T01:36:03.418662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:59:58.598970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.219400+0000","last_change":"2023-11-04T01:35:59.189839+0000","last_active":"2023-11-04T01:36:03.219400+0000","last_peered":"2023-11-04T01:36:03.219400+0000","last_clean":"2023-11-04T01:36:03.219400+0000","last_became_active":"2023-11-04T01:35:59.189525+0000","last_became_peered":"2023-11-04T01:35:59.189525+0000","last_unstale":"2023-11-04T01:36:03.219400+0000","last_undegraded":"2023-11-04T01:36:03.219400+0000","last_fullsized":"2023-11-04T01:36:03.219400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:38.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417496+0000","last_change":"2023-11-04T01:35:59.182733+0000","last_active":"2023-11-04T01:36:03.417496+0000","last_peered":"2023-11-04T01:36:03.417496+0000","last_clean":"2023-11-04T01:36:03.417496+0000","last_became_active":"2023-11-04T01:35:59.180260+0000","last_became_peered":"2023-11-04T01:35:59.180260+0000","last_unstale":"2023-11-04T01:36:03.417496+0000","last_undegraded":"2023-11-04T01:36:03.417496+0000","last_fullsized":"2023-11-04T01:36:03.417496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:31.159296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228312+0000","last_change":"2023-11-04T01:35:59.184451+0000","last_active":"2023-11-04T01:36:03.228312+0000","last_peered":"2023-11-04T01:36:03.228312+0000","last_clean":"2023-11-04T01:36:03.228312+0000","last_became_active":"2023-11-04T01:35:59.184197+0000","last_became_peered":"2023-11-04T01:35:59.184197+0000","last_unstale":"2023-11-04T01:36:03.228312+0000","last_undegraded":"2023-11-04T01:36:03.228312+0000","last_fullsized":"2023-11-04T01:36:03.228312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:47.754644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417459+0000","last_change":"2023-11-04T01:35:59.185251+0000","last_active":"2023-11-04T01:36:03.417459+0000","last_peered":"2023-11-04T01:36:03.417459+0000","last_clean":"2023-11-04T01:36:03.417459+0000","last_became_active":"2023-11-04T01:35:59.184960+0000","last_became_peered":"2023-11-04T01:35:59.184960+0000","last_unstale":"2023-11-04T01:36:03.417459+0000","last_undegraded":"2023-11-04T01:36:03.417459+0000","last_fullsized":"2023-11-04T01:36:03.417459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:37.928056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.228072+0000","last_change":"2023-11-04T01:35:59.185741+0000","last_active":"2023-11-04T01:36:03.228072+0000","last_peered":"2023-11-04T01:36:03.228072+0000","last_clean":"2023-11-04T01:36:03.228072+0000","last_became_active":"2023-11-04T01:35:59.185417+0000","last_became_peered":"2023-11-04T01:35:59.185417+0000","last_unstale":"2023-11-04T01:36:03.228072+0000","last_undegraded":"2023-11-04T01:36:03.228072+0000","last_fullsized":"2023-11-04T01:36:03.228072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:46.383777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.231859+0000","last_change":"2023-11-04T01:35:59.173981+0000","last_active":"2023-11-04T01:36:03.231859+0000","last_peered":"2023-11-04T01:36:03.231859+0000","last_clean":"2023-11-04T01:36:03.231859+0000","last_became_active":"2023-11-04T01:35:59.173709+0000","last_became_peered":"2023-11-04T01:35:59.173709+0000","last_unstale":"2023-11-04T01:36:03.231859+0000","last_undegraded":"2023-11-04T01:36:03.231859+0000","last_fullsized":"2023-11-04T01:36:03.231859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:57.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.236893+0000","last_change":"2023-11-04T01:35:59.178744+0000","last_active":"2023-11-04T01:36:03.236893+0000","last_peered":"2023-11-04T01:36:03.236893+0000","last_clean":"2023-11-04T01:36:03.236893+0000","last_became_active":"2023-11-04T01:35:59.178420+0000","last_became_peered":"2023-11-04T01:35:59.178420+0000","last_unstale":"2023-11-04T01:36:03.236893+0000","last_undegraded":"2023-11-04T01:36:03.236893+0000","last_fullsized":"2023-11-04T01:36:03.236893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:56.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:03.417999+0000","last_change":"2023-11-04T01:35:59.182583+0000","last_active":"2023-11-04T01:36:03.417999+0000","last_peered":"2023-11-04T01:36:03.417999+0000","last_clean":"2023-11-04T01:36:03.417999+0000","last_became_active":"2023-11-04T01:35:59.179785+0000","last_became_peered":"2023-11-04T01:35:59.179785+0000","last_unstale":"2023-11-04T01:36:03.417999+0000","last_undegraded":"2023-11-04T01:36:03.417999+0000","last_fullsized":"2023-11-04T01:36:03.417999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:58.170832+0000","last_clean_scrub_stamp":"2023-11-04T01:35:58.170832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:39.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:36:22.162 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-04T01:36:22.163 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-04T01:36:22.163 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-04T01:36:22.163 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-04T01:36:22.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.297+0000 7fdb480b4640 1 Processor -- start 2023-11-04T01:36:22.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.297+0000 7fdb480b4640 1 -- start start 2023-11-04T01:36:22.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.298+0000 7fdb480b4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdb40157710 0x7fdb40167b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.298+0000 7fdb480b4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4015e000 con 0x7fdb400cde60 2023-11-04T01:36:22.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.298+0000 7fdb480b4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4015e2e0 con 0x7fdb400ce240 2023-11-04T01:36:22.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.298+0000 7fdb480b4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4015e5c0 con 0x7fdb40157710 2023-11-04T01:36:22.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.298+0000 7fdb46651640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdb40157710 0x7fdb40167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.298+0000 7fdb45e50640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdb400cde60 0x7fdb4015d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36472/0 (socket says 172.21.15.44:36472) 2023-11-04T01:36:22.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.298+0000 7fdb45e50640 1 -- 172.21.15.44:0/2894793603 learned_addr learned my addr 172.21.15.44:0/2894793603 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:22.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.299+0000 7fdb46651640 1 -- 172.21.15.44:0/2894793603 >> v1:172.21.15.204:6789/0 conn(0x7fdb400ce240 legacy=0x7fdb40157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:22.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.299+0000 7fdb46651640 1 -- 172.21.15.44:0/2894793603 >> v1:172.21.15.44:6789/0 conn(0x7fdb400cde60 legacy=0x7fdb4015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.299+0000 7fdb46651640 1 -- 172.21.15.44:0/2894793603 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb400d1120 con 0x7fdb40157710 2023-11-04T01:36:22.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.299+0000 7fdb44e4e640 1 -- 172.21.15.44:0/2894793603 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121141323 0 0) 0x7fdb4015e000 con 0x7fdb400cde60 2023-11-04T01:36:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.299+0000 7fdb46651640 1 --2- 172.21.15.44:0/2894793603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb40157710 0x7fdb40167b90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009d90 tx=0x7fdb3802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da8ab7d028441dc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.300+0000 7fdb44e4e640 1 -- 172.21.15.44:0/2894793603 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3802cc60 con 0x7fdb40157710 2023-11-04T01:36:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.300+0000 7fdb44e4e640 1 -- 172.21.15.44:0/2894793603 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3802cdc0 con 0x7fdb40157710 2023-11-04T01:36:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.300+0000 7fdb44e4e640 1 -- 172.21.15.44:0/2894793603 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38034660 con 0x7fdb40157710 2023-11-04T01:36:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.300+0000 7fdb480b4640 1 -- 172.21.15.44:0/2894793603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb40157710 msgr2=0x7fdb40167b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.300+0000 7fdb480b4640 1 --2- 172.21.15.44:0/2894793603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb40157710 0x7fdb40167b90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009d90 tx=0x7fdb3802beb0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.300+0000 7fdb480b4640 1 -- 172.21.15.44:0/2894793603 shutdown_connections 2023-11-04T01:36:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.300+0000 7fdb480b4640 1 --2- 172.21.15.44:0/2894793603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb40157710 0x7fdb40167b90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.300+0000 7fdb480b4640 1 -- 172.21.15.44:0/2894793603 >> 172.21.15.44:0/2894793603 conn(0x7fdb40071f30 msgr2=0x7fdb400cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.300+0000 7fdb480b4640 1 -- 172.21.15.44:0/2894793603 shutdown_connections 2023-11-04T01:36:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.300+0000 7fdb480b4640 1 -- 172.21.15.44:0/2894793603 wait complete. 2023-11-04T01:36:22.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.301+0000 7fdb480b4640 1 Processor -- start 2023-11-04T01:36:22.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.301+0000 7fdb480b4640 1 -- start start 2023-11-04T01:36:22.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb480b4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdb400cde60 0x7fdb400c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb480b4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb400ce240 0x7fdb400cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb480b4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdb40157710 0x7fdb401f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb480b4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400c90c0 con 0x7fdb400ce240 2023-11-04T01:36:22.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb480b4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400c93a0 con 0x7fdb40157710 2023-11-04T01:36:22.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb480b4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400c9680 con 0x7fdb400cde60 2023-11-04T01:36:22.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb4564f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb400ce240 0x7fdb400cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb4564f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb400ce240 0x7fdb400cc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49278/0 (socket says 172.21.15.44:49278) 2023-11-04T01:36:22.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb4564f640 1 -- 172.21.15.44:0/1704455313 learned_addr learned my addr 172.21.15.44:0/1704455313 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:22.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb45e50640 1 --2- 172.21.15.44:0/1704455313 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdb400cde60 0x7fdb400c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb46651640 1 --2- 172.21.15.44:0/1704455313 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdb40157710 0x7fdb401f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb4564f640 1 -- 172.21.15.44:0/1704455313 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdb400cde60 msgr2=0x7fdb400c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb4564f640 1 --2- 172.21.15.44:0/1704455313 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdb400cde60 0x7fdb400c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb4564f640 1 -- 172.21.15.44:0/1704455313 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdb40157710 msgr2=0x7fdb401f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb4564f640 1 --2- 172.21.15.44:0/1704455313 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdb40157710 0x7fdb401f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.302+0000 7fdb4564f640 1 -- 172.21.15.44:0/1704455313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb38009a70 con 0x7fdb400ce240 2023-11-04T01:36:22.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.303+0000 7fdb46651640 1 --2- 172.21.15.44:0/1704455313 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdb40157710 0x7fdb401f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:22.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.303+0000 7fdb4564f640 1 --2- 172.21.15.44:0/1704455313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb400ce240 0x7fdb400cc8e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000c430 tx=0x7fdb3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:22.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.303+0000 7fdb367fc640 1 -- 172.21.15.44:0/1704455313 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30011790 con 0x7fdb400ce240 2023-11-04T01:36:22.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.303+0000 7fdb367fc640 1 -- 172.21.15.44:0/1704455313 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb300118f0 con 0x7fdb400ce240 2023-11-04T01:36:22.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.303+0000 7fdb480b4640 1 -- 172.21.15.44:0/1704455313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb400ca8c0 con 0x7fdb400ce240 2023-11-04T01:36:22.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.303+0000 7fdb367fc640 1 -- 172.21.15.44:0/1704455313 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30011ce0 con 0x7fdb400ce240 2023-11-04T01:36:22.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.303+0000 7fdb480b4640 1 -- 172.21.15.44:0/1704455313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb400ca430 con 0x7fdb400ce240 2023-11-04T01:36:22.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.304+0000 7fdb480b4640 1 -- 172.21.15.44:0/1704455313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb40074290 con 0x7fdb400ce240 2023-11-04T01:36:22.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.304+0000 7fdb367fc640 1 -- 172.21.15.44:0/1704455313 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb3001c460 con 0x7fdb400ce240 2023-11-04T01:36:22.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.305+0000 7fdb367fc640 1 --2- 172.21.15.44:0/1704455313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdb2406ae70 0x7fdb2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.305+0000 7fdb367fc640 1 -- 172.21.15.44:0/1704455313 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdb30089860 con 0x7fdb400ce240 2023-11-04T01:36:22.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.305+0000 7fdb45e50640 1 --2- 172.21.15.44:0/1704455313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdb2406ae70 0x7fdb2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.305+0000 7fdb45e50640 1 --2- 172.21.15.44:0/1704455313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdb2406ae70 0x7fdb2406d330 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c000f60 tx=0x7fdb3c007b50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:22.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.309+0000 7fdb367fc640 1 -- 172.21.15.44:0/1704455313 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdb30054620 con 0x7fdb400ce240 2023-11-04T01:36:22.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.524+0000 7fdb480b4640 1 -- 172.21.15.44:0/1704455313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdb400b85d0 con 0x7fdb400ce240 2023-11-04T01:36:22.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.524+0000 7fdb367fc640 1 -- 172.21.15.44:0/1704455313 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fdb3005e030 con 0x7fdb400ce240 2023-11-04T01:36:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:22.527 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-04T01:36:22.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.526+0000 7fdb480b4640 1 -- 172.21.15.44:0/1704455313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdb2406ae70 msgr2=0x7fdb2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.526+0000 7fdb480b4640 1 --2- 172.21.15.44:0/1704455313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdb2406ae70 0x7fdb2406d330 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c000f60 tx=0x7fdb3c007b50 comp rx=0 tx=0).stop 2023-11-04T01:36:22.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.526+0000 7fdb480b4640 1 -- 172.21.15.44:0/1704455313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb400ce240 msgr2=0x7fdb400cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.526+0000 7fdb480b4640 1 --2- 172.21.15.44:0/1704455313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb400ce240 0x7fdb400cc8e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000c430 tx=0x7fdb3000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.526+0000 7fdb480b4640 1 -- 172.21.15.44:0/1704455313 shutdown_connections 2023-11-04T01:36:22.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.526+0000 7fdb480b4640 1 --2- 172.21.15.44:0/1704455313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdb2406ae70 0x7fdb2406d330 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.526+0000 7fdb480b4640 1 --2- 172.21.15.44:0/1704455313 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdb40157710 0x7fdb401f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.526+0000 7fdb480b4640 1 --2- 172.21.15.44:0/1704455313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb400ce240 0x7fdb400cc8e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.526+0000 7fdb480b4640 1 --2- 172.21.15.44:0/1704455313 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdb400cde60 0x7fdb400c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.526+0000 7fdb480b4640 1 -- 172.21.15.44:0/1704455313 >> 172.21.15.44:0/1704455313 conn(0x7fdb40071f30 msgr2=0x7fdb400d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:22.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.526+0000 7fdb480b4640 1 -- 172.21.15.44:0/1704455313 shutdown_connections 2023-11-04T01:36:22.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.526+0000 7fdb480b4640 1 -- 172.21.15.44:0/1704455313 wait complete. 2023-11-04T01:36:22.539 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-04T01:36:22.539 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:22.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.644+0000 7f0508f90640 1 Processor -- start 2023-11-04T01:36:22.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.644+0000 7f0508f90640 1 -- start start 2023-11-04T01:36:22.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f0508f90640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0504159c70 0x7f05040ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f0508f90640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f050406db20 0x7f05040b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f0508f90640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05040b0910 0x7f050415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f0508f90640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05040b49b0 con 0x7f0504159c70 2023-11-04T01:36:22.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f0508f90640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05040b0da0 con 0x7f050406db20 2023-11-04T01:36:22.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f0508f90640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05040b4110 con 0x7f05040b0910 2023-11-04T01:36:22.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f050259c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0504159c70 0x7f05040ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f050259c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0504159c70 0x7f05040ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38486/0 (socket says 172.21.15.44:38486) 2023-11-04T01:36:22.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f050259c640 1 -- 172.21.15.44:0/2670003870 learned_addr learned my addr 172.21.15.44:0/2670003870 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:22.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f0502d9d640 1 --2- 172.21.15.44:0/2670003870 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05040b0910 0x7f050415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f04fbfff640 1 --2- 172.21.15.44:0/2670003870 >> v2:172.21.15.204:3300/0 conn(0x7f050406db20 0x7f05040b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f050259c640 1 -- 172.21.15.44:0/2670003870 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05040b0910 msgr2=0x7f050415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:22.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f050259c640 1 --2- 172.21.15.44:0/2670003870 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05040b0910 0x7f050415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f050259c640 1 -- 172.21.15.44:0/2670003870 >> v2:172.21.15.204:3300/0 conn(0x7f050406db20 msgr2=0x7f05040b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:22.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f050259c640 1 --2- 172.21.15.44:0/2670003870 >> v2:172.21.15.204:3300/0 conn(0x7f050406db20 0x7f05040b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.645+0000 7f050259c640 1 -- 172.21.15.44:0/2670003870 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05040b43f0 con 0x7f0504159c70 2023-11-04T01:36:22.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.646+0000 7f050259c640 1 --2- 172.21.15.44:0/2670003870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0504159c70 0x7f05040ce370 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f05040cf800 tx=0x7f04f402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a0d3d22ae3b654 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:22.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.646+0000 7f0501d9b640 1 -- 172.21.15.44:0/2670003870 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f402ee90 con 0x7f0504159c70 2023-11-04T01:36:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.646+0000 7f0501d9b640 1 -- 172.21.15.44:0/2670003870 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f4036440 con 0x7f0504159c70 2023-11-04T01:36:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.646+0000 7f0501d9b640 1 -- 172.21.15.44:0/2670003870 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f40367d0 con 0x7f0504159c70 2023-11-04T01:36:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.646+0000 7f0508f90640 1 -- 172.21.15.44:0/2670003870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0504159c70 msgr2=0x7f05040ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.646+0000 7f0508f90640 1 --2- 172.21.15.44:0/2670003870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0504159c70 0x7f05040ce370 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f05040cf800 tx=0x7f04f402e0e0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.647+0000 7f0508f90640 1 -- 172.21.15.44:0/2670003870 shutdown_connections 2023-11-04T01:36:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.647+0000 7f0508f90640 1 --2- 172.21.15.44:0/2670003870 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05040b0910 0x7f050415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.647+0000 7f0508f90640 1 --2- 172.21.15.44:0/2670003870 >> v2:172.21.15.204:3300/0 conn(0x7f050406db20 0x7f05040b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.647+0000 7f0508f90640 1 --2- 172.21.15.44:0/2670003870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0504159c70 0x7f05040ce370 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.647+0000 7f0508f90640 1 -- 172.21.15.44:0/2670003870 >> 172.21.15.44:0/2670003870 conn(0x7f05040ce950 msgr2=0x7f05040ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.647+0000 7f0508f90640 1 -- 172.21.15.44:0/2670003870 shutdown_connections 2023-11-04T01:36:22.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.647+0000 7f0508f90640 1 -- 172.21.15.44:0/2670003870 wait complete. 2023-11-04T01:36:22.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.648+0000 7f0508f90640 1 Processor -- start 2023-11-04T01:36:22.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.648+0000 7f0508f90640 1 -- start start 2023-11-04T01:36:22.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0508f90640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f050406db20 0x7f0504146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0508f90640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05040b0910 0x7f05040c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0508f90640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0504159c70 0x7f050415b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0508f90640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05041473b0 con 0x7f0504159c70 2023-11-04T01:36:22.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0508f90640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05040c90a0 con 0x7f050406db20 2023-11-04T01:36:22.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0508f90640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05040c6910 con 0x7f05040b0910 2023-11-04T01:36:22.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0502d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0504159c70 0x7f050415b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0502d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0504159c70 0x7f050415b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38488/0 (socket says 172.21.15.44:38488) 2023-11-04T01:36:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0502d9d640 1 -- 172.21.15.44:0/2451732839 learned_addr learned my addr 172.21.15.44:0/2451732839 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f04fbfff640 1 --2- 172.21.15.44:0/2451732839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05040b0910 0x7f05040c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f050259c640 1 --2- 172.21.15.44:0/2451732839 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f050406db20 0x7f0504146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0502d9d640 1 -- 172.21.15.44:0/2451732839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05040b0910 msgr2=0x7f05040c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0502d9d640 1 --2- 172.21.15.44:0/2451732839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05040b0910 0x7f05040c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0502d9d640 1 -- 172.21.15.44:0/2451732839 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f050406db20 msgr2=0x7f0504146e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0502d9d640 1 --2- 172.21.15.44:0/2451732839 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f050406db20 0x7f0504146e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0502d9d640 1 -- 172.21.15.44:0/2451732839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f400b770 con 0x7f0504159c70 2023-11-04T01:36:22.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0502d9d640 1 --2- 172.21.15.44:0/2451732839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0504159c70 0x7f050415b380 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f04fc007e40 tx=0x7f04fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:22.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f04faffd640 1 -- 172.21.15.44:0/2451732839 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc014620 con 0x7f0504159c70 2023-11-04T01:36:22.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f04faffd640 1 -- 172.21.15.44:0/2451732839 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc00ee90 con 0x7f0504159c70 2023-11-04T01:36:22.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f0508f90640 1 -- 172.21.15.44:0/2451732839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05041526d0 con 0x7f0504159c70 2023-11-04T01:36:22.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.649+0000 7f04faffd640 1 -- 172.21.15.44:0/2451732839 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc0149e0 con 0x7f0504159c70 2023-11-04T01:36:22.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.650+0000 7f0508f90640 1 -- 172.21.15.44:0/2451732839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0504152c50 con 0x7f0504159c70 2023-11-04T01:36:22.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.650+0000 7f0508f90640 1 -- 172.21.15.44:0/2451732839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0504074290 con 0x7f0504159c70 2023-11-04T01:36:22.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.651+0000 7f04faffd640 1 -- 172.21.15.44:0/2451732839 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04fc014b40 con 0x7f0504159c70 2023-11-04T01:36:22.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.651+0000 7f04faffd640 1 --2- 172.21.15.44:0/2451732839 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f04e406aea0 0x7f04e406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.651+0000 7f04faffd640 1 -- 172.21.15.44:0/2451732839 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f04fc08a150 con 0x7f0504159c70 2023-11-04T01:36:22.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.652+0000 7f050259c640 1 --2- 172.21.15.44:0/2451732839 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f04e406aea0 0x7f04e406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.652+0000 7f050259c640 1 --2- 172.21.15.44:0/2451732839 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f04e406aea0 0x7f04e406d360 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04f4038000 tx=0x7f04f4032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:22.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.655+0000 7f04faffd640 1 -- 172.21.15.44:0/2451732839 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04fc054fc0 con 0x7f0504159c70 2023-11-04T01:36:22.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.831+0000 7f0508f90640 1 -- 172.21.15.44:0/2451732839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05040b06f0 con 0x7f0504159c70 2023-11-04T01:36:22.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.832+0000 7f04faffd640 1 -- 172.21.15.44:0/2451732839 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f04fc0585e0 con 0x7f0504159c70 2023-11-04T01:36:22.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:22.835 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:03.589395+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:22.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.834+0000 7f0508f90640 1 -- 172.21.15.44:0/2451732839 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f04e406aea0 msgr2=0x7f04e406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.834+0000 7f0508f90640 1 --2- 172.21.15.44:0/2451732839 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f04e406aea0 0x7f04e406d360 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04f4038000 tx=0x7f04f4032000 comp rx=0 tx=0).stop 2023-11-04T01:36:22.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.834+0000 7f0508f90640 1 -- 172.21.15.44:0/2451732839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0504159c70 msgr2=0x7f050415b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.834+0000 7f0508f90640 1 --2- 172.21.15.44:0/2451732839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0504159c70 0x7f050415b380 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f04fc007e40 tx=0x7f04fc00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.834+0000 7f0508f90640 1 -- 172.21.15.44:0/2451732839 shutdown_connections 2023-11-04T01:36:22.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.834+0000 7f0508f90640 1 --2- 172.21.15.44:0/2451732839 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f04e406aea0 0x7f04e406d360 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.834+0000 7f0508f90640 1 --2- 172.21.15.44:0/2451732839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0504159c70 0x7f050415b380 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.834+0000 7f0508f90640 1 --2- 172.21.15.44:0/2451732839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05040b0910 0x7f05040c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.834+0000 7f0508f90640 1 --2- 172.21.15.44:0/2451732839 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f050406db20 0x7f0504146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.834+0000 7f0508f90640 1 -- 172.21.15.44:0/2451732839 >> 172.21.15.44:0/2451732839 conn(0x7f05040ce950 msgr2=0x7f0504070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:22.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.834+0000 7f0508f90640 1 -- 172.21.15.44:0/2451732839 shutdown_connections 2023-11-04T01:36:22.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.834+0000 7f0508f90640 1 -- 172.21.15.44:0/2451732839 wait complete. 2023-11-04T01:36:22.847 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:22.848 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.955+0000 7f58a370f640 1 Processor -- start 2023-11-04T01:36:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.955+0000 7f58a370f640 1 -- start start 2023-11-04T01:36:22.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.956+0000 7f58a370f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f589c159c00 0x7f589c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.956+0000 7f58a370f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f589c0c48e0 0x7f589c0c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.956+0000 7f58a370f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589c15aff0 con 0x7f589c0adac0 2023-11-04T01:36:22.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.956+0000 7f58a370f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589c0c52a0 con 0x7f589c0c48e0 2023-11-04T01:36:22.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.956+0000 7f58a370f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589c15a3e0 con 0x7f589c159c00 2023-11-04T01:36:22.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.956+0000 7f58a1cac640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f589c0adac0 0x7f589c0adef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47426/0 (socket says 172.21.15.44:47426) 2023-11-04T01:36:22.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.956+0000 7f58a1cac640 1 -- 172.21.15.44:0/3296732192 learned_addr learned my addr 172.21.15.44:0/3296732192 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:22.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.956+0000 7f58a14ab640 1 --2- 172.21.15.44:0/3296732192 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f589c159c00 0x7f589c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.956+0000 7f58a0caa640 1 --2- 172.21.15.44:0/3296732192 >> v2:172.21.15.204:3300/0 conn(0x7f589c0c48e0 0x7f589c0c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.956+0000 7f589bfff640 1 -- 172.21.15.44:0/3296732192 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828488185 0 0) 0x7f589c15aff0 con 0x7f589c0adac0 2023-11-04T01:36:22.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.956+0000 7f589bfff640 1 -- 172.21.15.44:0/3296732192 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5884003520 con 0x7f589c0adac0 2023-11-04T01:36:22.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.957+0000 7f589bfff640 1 -- 172.21.15.44:0/3296732192 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 939954364 0 0) 0x7f5884003520 con 0x7f589c0adac0 2023-11-04T01:36:22.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.957+0000 7f58a0caa640 1 -- 172.21.15.44:0/3296732192 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f589c159c00 msgr2=0x7f589c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:22.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.957+0000 7f58a0caa640 1 --2- 172.21.15.44:0/3296732192 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f589c159c00 0x7f589c0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.957+0000 7f58a0caa640 1 -- 172.21.15.44:0/3296732192 >> v1:172.21.15.44:6789/0 conn(0x7f589c0adac0 legacy=0x7f589c0adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.957+0000 7f58a0caa640 1 -- 172.21.15.44:0/3296732192 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c15a6c0 con 0x7f589c0c48e0 2023-11-04T01:36:22.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.958+0000 7f58a0caa640 1 --2- 172.21.15.44:0/3296732192 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f589c0c48e0 0x7f589c0c4d60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f58900097a0 tx=0x7f589002d9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beb4093d40c7f515 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:22.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.958+0000 7f589bfff640 1 -- 172.21.15.44:0/3296732192 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c0019f0 con 0x7f589c0c48e0 2023-11-04T01:36:22.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.958+0000 7f589bfff640 1 -- 172.21.15.44:0/3296732192 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5890033680 con 0x7f589c0c48e0 2023-11-04T01:36:22.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.958+0000 7f589bfff640 1 -- 172.21.15.44:0/3296732192 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890033a10 con 0x7f589c0c48e0 2023-11-04T01:36:22.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.958+0000 7f58a370f640 1 -- 172.21.15.44:0/3296732192 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f589c0c48e0 msgr2=0x7f589c0c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.958+0000 7f58a370f640 1 --2- 172.21.15.44:0/3296732192 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f589c0c48e0 0x7f589c0c4d60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f58900097a0 tx=0x7f589002d9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.958+0000 7f58a370f640 1 -- 172.21.15.44:0/3296732192 shutdown_connections 2023-11-04T01:36:22.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.958+0000 7f58a370f640 1 --2- 172.21.15.44:0/3296732192 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f589c0c48e0 0x7f589c0c4d60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.958+0000 7f58a370f640 1 --2- 172.21.15.44:0/3296732192 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f589c159c00 0x7f589c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.958+0000 7f58a370f640 1 -- 172.21.15.44:0/3296732192 >> 172.21.15.44:0/3296732192 conn(0x7f589c0ce950 msgr2=0x7f589c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.958+0000 7f58a370f640 1 -- 172.21.15.44:0/3296732192 shutdown_connections 2023-11-04T01:36:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.958+0000 7f58a370f640 1 -- 172.21.15.44:0/3296732192 wait complete. 2023-11-04T01:36:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.959+0000 7f58a370f640 1 Processor -- start 2023-11-04T01:36:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.960+0000 7f58a370f640 1 -- start start 2023-11-04T01:36:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.960+0000 7f58a370f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f589c0adac0 0x7f589c14a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.960+0000 7f58a370f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f589c0c48e0 0x7f589c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.960+0000 7f58a370f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f589c159c00 0x7f589c154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.960+0000 7f58a370f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c1eee60 con 0x7f589c0c48e0 2023-11-04T01:36:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.960+0000 7f58a370f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c1edf70 con 0x7f589c159c00 2023-11-04T01:36:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.960+0000 7f58a370f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589c1ee1e0 con 0x7f589c0adac0 2023-11-04T01:36:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.960+0000 7f58a0caa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f589c0c48e0 0x7f589c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.960+0000 7f58a0caa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f589c0c48e0 0x7f589c0ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38504/0 (socket says 172.21.15.44:38504) 2023-11-04T01:36:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.960+0000 7f58a0caa640 1 -- 172.21.15.44:0/1798863068 learned_addr learned my addr 172.21.15.44:0/1798863068 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.961+0000 7f58a1cac640 1 --2- 172.21.15.44:0/1798863068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f589c159c00 0x7f589c154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.961+0000 7f58a14ab640 1 --2- 172.21.15.44:0/1798863068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f589c0adac0 0x7f589c14a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.961+0000 7f58a0caa640 1 -- 172.21.15.44:0/1798863068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f589c0adac0 msgr2=0x7f589c14a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.961+0000 7f58a0caa640 1 --2- 172.21.15.44:0/1798863068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f589c0adac0 0x7f589c14a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.961+0000 7f58a0caa640 1 -- 172.21.15.44:0/1798863068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f589c159c00 msgr2=0x7f589c154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.961+0000 7f58a0caa640 1 --2- 172.21.15.44:0/1798863068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f589c159c00 0x7f589c154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.961+0000 7f58a0caa640 1 -- 172.21.15.44:0/1798863068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890009400 con 0x7f589c0c48e0 2023-11-04T01:36:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.961+0000 7f58a1cac640 1 --2- 172.21.15.44:0/1798863068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f589c159c00 0x7f589c154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.961+0000 7f58a0caa640 1 --2- 172.21.15.44:0/1798863068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f589c0c48e0 0x7f589c0ccfd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58900098c0 tx=0x7f58900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.961+0000 7f5899ffb640 1 -- 172.21.15.44:0/1798863068 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589003dc70 con 0x7f589c0c48e0 2023-11-04T01:36:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.961+0000 7f5899ffb640 1 -- 172.21.15.44:0/1798863068 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589003ddf0 con 0x7f589c0c48e0 2023-11-04T01:36:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.961+0000 7f58a370f640 1 -- 172.21.15.44:0/1798863068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589c1ee4c0 con 0x7f589c0c48e0 2023-11-04T01:36:22.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.961+0000 7f5899ffb640 1 -- 172.21.15.44:0/1798863068 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890047630 con 0x7f589c0c48e0 2023-11-04T01:36:22.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.961+0000 7f58a370f640 1 -- 172.21.15.44:0/1798863068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589c1eea80 con 0x7f589c0c48e0 2023-11-04T01:36:22.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.962+0000 7f58a370f640 1 -- 172.21.15.44:0/1798863068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589c14b130 con 0x7f589c0c48e0 2023-11-04T01:36:22.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.963+0000 7f5899ffb640 1 -- 172.21.15.44:0/1798863068 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5890050450 con 0x7f589c0c48e0 2023-11-04T01:36:22.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.963+0000 7f5899ffb640 1 --2- 172.21.15.44:0/1798863068 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f588806ae70 0x7f588806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:22.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.963+0000 7f5899ffb640 1 -- 172.21.15.44:0/1798863068 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f58900ade50 con 0x7f589c0c48e0 2023-11-04T01:36:22.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.964+0000 7f58a14ab640 1 --2- 172.21.15.44:0/1798863068 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f588806ae70 0x7f588806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:22.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.964+0000 7f58a14ab640 1 --2- 172.21.15.44:0/1798863068 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f588806ae70 0x7f588806d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5894009ad0 tx=0x7f5894008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:22.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:22.967+0000 7f5899ffb640 1 -- 172.21.15.44:0/1798863068 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5890078ca0 con 0x7f589c0c48e0 2023-11-04T01:36:23.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.143+0000 7f58a370f640 1 -- 172.21.15.44:0/1798863068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f589c072620 con 0x7f589c0c48e0 2023-11-04T01:36:23.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.144+0000 7f5899ffb640 1 -- 172.21.15.44:0/1798863068 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5890037020 con 0x7f589c0c48e0 2023-11-04T01:36:23.146 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:36:23.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.146+0000 7f58a370f640 1 -- 172.21.15.44:0/1798863068 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f588806ae70 msgr2=0x7f588806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.146+0000 7f58a370f640 1 --2- 172.21.15.44:0/1798863068 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f588806ae70 0x7f588806d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5894009ad0 tx=0x7f5894008040 comp rx=0 tx=0).stop 2023-11-04T01:36:23.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.146+0000 7f58a370f640 1 -- 172.21.15.44:0/1798863068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f589c0c48e0 msgr2=0x7f589c0ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.146+0000 7f58a370f640 1 --2- 172.21.15.44:0/1798863068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f589c0c48e0 0x7f589c0ccfd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58900098c0 tx=0x7f58900046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.146+0000 7f58a370f640 1 -- 172.21.15.44:0/1798863068 shutdown_connections 2023-11-04T01:36:23.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.146+0000 7f58a370f640 1 --2- 172.21.15.44:0/1798863068 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f588806ae70 0x7f588806d330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.146+0000 7f58a370f640 1 --2- 172.21.15.44:0/1798863068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f589c159c00 0x7f589c154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.146+0000 7f58a370f640 1 --2- 172.21.15.44:0/1798863068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f589c0c48e0 0x7f589c0ccfd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.146+0000 7f58a370f640 1 --2- 172.21.15.44:0/1798863068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f589c0adac0 0x7f589c14a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.146+0000 7f58a370f640 1 -- 172.21.15.44:0/1798863068 >> 172.21.15.44:0/1798863068 conn(0x7f589c0ce950 msgr2=0x7f589c06d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:23.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.146+0000 7f58a370f640 1 -- 172.21.15.44:0/1798863068 shutdown_connections 2023-11-04T01:36:23.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.146+0000 7f58a370f640 1 -- 172.21.15.44:0/1798863068 wait complete. 2023-11-04T01:36:23.159 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:23.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.267+0000 7fe52970f640 1 Processor -- start 2023-11-04T01:36:23.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.267+0000 7fe52970f640 1 -- start start 2023-11-04T01:36:23.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe52970f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe524070ff0 0x7fe5240cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe52970f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe52415d1b0 0x7fe5240713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe52970f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe524066000 0x7fe524160af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe52970f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5240c9bf0 con 0x7fe524070ff0 2023-11-04T01:36:23.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe52970f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5240cd890 con 0x7fe52415d1b0 2023-11-04T01:36:23.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe52970f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe524071910 con 0x7fe524066000 2023-11-04T01:36:23.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe522ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe524070ff0 0x7fe5240cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe522ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe524070ff0 0x7fe5240cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38518/0 (socket says 172.21.15.44:38518) 2023-11-04T01:36:23.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe522ffd640 1 -- 172.21.15.44:0/976788994 learned_addr learned my addr 172.21.15.44:0/976788994 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:23.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe5227fc640 1 --2- 172.21.15.44:0/976788994 >> v2:172.21.15.204:3300/0 conn(0x7fe52415d1b0 0x7fe5240713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe5237fe640 1 --2- 172.21.15.44:0/976788994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe524066000 0x7fe524160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe522ffd640 1 -- 172.21.15.44:0/976788994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe524066000 msgr2=0x7fe524160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:23.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe522ffd640 1 --2- 172.21.15.44:0/976788994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe524066000 0x7fe524160af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe522ffd640 1 -- 172.21.15.44:0/976788994 >> v2:172.21.15.204:3300/0 conn(0x7fe52415d1b0 msgr2=0x7fe5240713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:23.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe522ffd640 1 --2- 172.21.15.44:0/976788994 >> v2:172.21.15.204:3300/0 conn(0x7fe52415d1b0 0x7fe5240713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.268+0000 7fe522ffd640 1 -- 172.21.15.44:0/976788994 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5240cdb30 con 0x7fe524070ff0 2023-11-04T01:36:23.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.269+0000 7fe522ffd640 1 --2- 172.21.15.44:0/976788994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe524070ff0 0x7fe5240cb4e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe524161b90 tx=0x7fe51402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a0fcadc9d87d6d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.270+0000 7fe521ffb640 1 -- 172.21.15.44:0/976788994 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51402ca70 con 0x7fe524070ff0 2023-11-04T01:36:23.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.270+0000 7fe521ffb640 1 -- 172.21.15.44:0/976788994 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51402cbd0 con 0x7fe524070ff0 2023-11-04T01:36:23.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.270+0000 7fe521ffb640 1 -- 172.21.15.44:0/976788994 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5140343f0 con 0x7fe524070ff0 2023-11-04T01:36:23.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.270+0000 7fe52970f640 1 -- 172.21.15.44:0/976788994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe524070ff0 msgr2=0x7fe5240cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.270+0000 7fe52970f640 1 --2- 172.21.15.44:0/976788994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe524070ff0 0x7fe5240cb4e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe524161b90 tx=0x7fe51402bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.270+0000 7fe52970f640 1 -- 172.21.15.44:0/976788994 shutdown_connections 2023-11-04T01:36:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.270+0000 7fe52970f640 1 --2- 172.21.15.44:0/976788994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe524066000 0x7fe524160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.270+0000 7fe52970f640 1 --2- 172.21.15.44:0/976788994 >> v2:172.21.15.204:3300/0 conn(0x7fe52415d1b0 0x7fe5240713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.270+0000 7fe52970f640 1 --2- 172.21.15.44:0/976788994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe524070ff0 0x7fe5240cb4e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.270+0000 7fe52970f640 1 -- 172.21.15.44:0/976788994 >> 172.21.15.44:0/976788994 conn(0x7fe5240cbc90 msgr2=0x7fe5240cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.270+0000 7fe52970f640 1 -- 172.21.15.44:0/976788994 shutdown_connections 2023-11-04T01:36:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.270+0000 7fe52970f640 1 -- 172.21.15.44:0/976788994 wait complete. 2023-11-04T01:36:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.272+0000 7fe52970f640 1 Processor -- start 2023-11-04T01:36:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.272+0000 7fe52970f640 1 -- start start 2023-11-04T01:36:23.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.272+0000 7fe52970f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe524066000 0x7fe5240c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.272+0000 7fe52970f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe524070ff0 0x7fe52415c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.272+0000 7fe52970f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe52415d1b0 0x7fe5240b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.272+0000 7fe52970f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52415c090 con 0x7fe52415d1b0 2023-11-04T01:36:23.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.272+0000 7fe52970f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5241f3880 con 0x7fe524070ff0 2023-11-04T01:36:23.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.272+0000 7fe52970f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5241f2d00 con 0x7fe524066000 2023-11-04T01:36:23.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe5237fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe52415d1b0 0x7fe5240b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe5237fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe52415d1b0 0x7fe5240b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38532/0 (socket says 172.21.15.44:38532) 2023-11-04T01:36:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe5237fe640 1 -- 172.21.15.44:0/3757894033 learned_addr learned my addr 172.21.15.44:0/3757894033 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe522ffd640 1 --2- 172.21.15.44:0/3757894033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe524066000 0x7fe5240c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe5227fc640 1 --2- 172.21.15.44:0/3757894033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe524070ff0 0x7fe52415c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe5237fe640 1 -- 172.21.15.44:0/3757894033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe524066000 msgr2=0x7fe5240c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe5237fe640 1 --2- 172.21.15.44:0/3757894033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe524066000 0x7fe5240c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe5237fe640 1 -- 172.21.15.44:0/3757894033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe524070ff0 msgr2=0x7fe52415c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe5237fe640 1 --2- 172.21.15.44:0/3757894033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe524070ff0 0x7fe52415c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe5237fe640 1 -- 172.21.15.44:0/3757894033 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe514009b30 con 0x7fe52415d1b0 2023-11-04T01:36:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe5237fe640 1 --2- 172.21.15.44:0/3757894033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe52415d1b0 0x7fe5240b4270 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00e930 tx=0x7fe51c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe50b7fe640 1 -- 172.21.15.44:0/3757894033 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c009690 con 0x7fe52415d1b0 2023-11-04T01:36:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe50b7fe640 1 -- 172.21.15.44:0/3757894033 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c00c920 con 0x7fe52415d1b0 2023-11-04T01:36:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe52970f640 1 -- 172.21.15.44:0/3757894033 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5241f2fe0 con 0x7fe52415d1b0 2023-11-04T01:36:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe50b7fe640 1 -- 172.21.15.44:0/3757894033 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c00ccd0 con 0x7fe52415d1b0 2023-11-04T01:36:23.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.273+0000 7fe52970f640 1 -- 172.21.15.44:0/3757894033 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5241f35a0 con 0x7fe52415d1b0 2023-11-04T01:36:23.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.274+0000 7fe52970f640 1 -- 172.21.15.44:0/3757894033 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe524074290 con 0x7fe52415d1b0 2023-11-04T01:36:23.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.275+0000 7fe50b7fe640 1 -- 172.21.15.44:0/3757894033 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe51c013470 con 0x7fe52415d1b0 2023-11-04T01:36:23.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.275+0000 7fe50b7fe640 1 --2- 172.21.15.44:0/3757894033 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe51006ae70 0x7fe51006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.275+0000 7fe50b7fe640 1 -- 172.21.15.44:0/3757894033 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe51c0899c0 con 0x7fe52415d1b0 2023-11-04T01:36:23.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.275+0000 7fe522ffd640 1 --2- 172.21.15.44:0/3757894033 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe51006ae70 0x7fe51006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.276+0000 7fe522ffd640 1 --2- 172.21.15.44:0/3757894033 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe51006ae70 0x7fe51006d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe514035000 tx=0x7fe514030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.279+0000 7fe50b7fe640 1 -- 172.21.15.44:0/3757894033 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe51c054980 con 0x7fe52415d1b0 2023-11-04T01:36:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.451+0000 7fe52970f640 1 -- 172.21.15.44:0/3757894033 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe5240c62e0 con 0x7fe52415d1b0 2023-11-04T01:36:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.452+0000 7fe50b7fe640 1 -- 172.21.15.44:0/3757894033 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe51c021020 con 0x7fe52415d1b0 2023-11-04T01:36:23.456 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.454+0000 7fe52970f640 1 -- 172.21.15.44:0/3757894033 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe51006ae70 msgr2=0x7fe51006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.454+0000 7fe52970f640 1 --2- 172.21.15.44:0/3757894033 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe51006ae70 0x7fe51006d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe514035000 tx=0x7fe514030000 comp rx=0 tx=0).stop 2023-11-04T01:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.454+0000 7fe52970f640 1 -- 172.21.15.44:0/3757894033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe52415d1b0 msgr2=0x7fe5240b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.454+0000 7fe52970f640 1 --2- 172.21.15.44:0/3757894033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe52415d1b0 0x7fe5240b4270 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00e930 tx=0x7fe51c00edf0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.454+0000 7fe52970f640 1 -- 172.21.15.44:0/3757894033 shutdown_connections 2023-11-04T01:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.454+0000 7fe52970f640 1 --2- 172.21.15.44:0/3757894033 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe51006ae70 0x7fe51006d330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.454+0000 7fe52970f640 1 --2- 172.21.15.44:0/3757894033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe52415d1b0 0x7fe5240b4270 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.454+0000 7fe52970f640 1 --2- 172.21.15.44:0/3757894033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe524070ff0 0x7fe52415c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.454+0000 7fe52970f640 1 --2- 172.21.15.44:0/3757894033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe524066000 0x7fe5240c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.454+0000 7fe52970f640 1 -- 172.21.15.44:0/3757894033 >> 172.21.15.44:0/3757894033 conn(0x7fe5240cbc90 msgr2=0x7fe52415e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.454+0000 7fe52970f640 1 -- 172.21.15.44:0/3757894033 shutdown_connections 2023-11-04T01:36:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.454+0000 7fe52970f640 1 -- 172.21.15.44:0/3757894033 wait complete. 2023-11-04T01:36:23.467 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:23.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.577+0000 7fb24218a640 1 Processor -- start 2023-11-04T01:36:23.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.577+0000 7fb24218a640 1 -- start start 2023-11-04T01:36:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.577+0000 7fb24218a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb23c15af20 0x7fb23c0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.577+0000 7fb24218a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb23c0b64c0 0x7fb23c0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.577+0000 7fb24218a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb23c0cd3b0 0x7fb23c0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.577+0000 7fb24218a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23c0cdd80 con 0x7fb23c0b64c0 2023-11-04T01:36:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.577+0000 7fb24218a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23c0d01f0 con 0x7fb23c15af20 2023-11-04T01:36:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.577+0000 7fb24218a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0b6a40 con 0x7fb23c0cd3b0 2023-11-04T01:36:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.578+0000 7fb23affd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb23c0b64c0 0x7fb23c0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.578+0000 7fb23affd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb23c0b64c0 0x7fb23c0cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38534/0 (socket says 172.21.15.44:38534) 2023-11-04T01:36:23.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.578+0000 7fb23affd640 1 -- 172.21.15.44:0/1319696935 learned_addr learned my addr 172.21.15.44:0/1319696935 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:23.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.578+0000 7fb23b7fe640 1 --2- 172.21.15.44:0/1319696935 >> v2:172.21.15.204:3300/0 conn(0x7fb23c15af20 0x7fb23c0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.578+0000 7fb23bfff640 1 --2- 172.21.15.44:0/1319696935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb23c0cd3b0 0x7fb23c0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.578+0000 7fb23affd640 1 -- 172.21.15.44:0/1319696935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb23c0cd3b0 msgr2=0x7fb23c0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:23.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.578+0000 7fb23affd640 1 --2- 172.21.15.44:0/1319696935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb23c0cd3b0 0x7fb23c0cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.578+0000 7fb23affd640 1 -- 172.21.15.44:0/1319696935 >> v2:172.21.15.204:3300/0 conn(0x7fb23c15af20 msgr2=0x7fb23c0b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:23.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.578+0000 7fb23affd640 1 --2- 172.21.15.44:0/1319696935 >> v2:172.21.15.204:3300/0 conn(0x7fb23c15af20 0x7fb23c0b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.578+0000 7fb23affd640 1 -- 172.21.15.44:0/1319696935 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c0d04b0 con 0x7fb23c0b64c0 2023-11-04T01:36:23.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.579+0000 7fb23affd640 1 --2- 172.21.15.44:0/1319696935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23c0b64c0 0x7fb23c0cbc70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0b3760 tx=0x7fb22402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8d690b67a19fca server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.579+0000 7fb23a7fc640 1 -- 172.21.15.44:0/1319696935 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224031870 con 0x7fb23c0b64c0 2023-11-04T01:36:23.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.579+0000 7fb23a7fc640 1 -- 172.21.15.44:0/1319696935 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2240319d0 con 0x7fb23c0b64c0 2023-11-04T01:36:23.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.579+0000 7fb23a7fc640 1 -- 172.21.15.44:0/1319696935 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224031d60 con 0x7fb23c0b64c0 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.579+0000 7fb24218a640 1 -- 172.21.15.44:0/1319696935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23c0b64c0 msgr2=0x7fb23c0cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.579+0000 7fb24218a640 1 --2- 172.21.15.44:0/1319696935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23c0b64c0 0x7fb23c0cbc70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0b3760 tx=0x7fb22402b910 comp rx=0 tx=0).stop 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.579+0000 7fb24218a640 1 -- 172.21.15.44:0/1319696935 shutdown_connections 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.579+0000 7fb24218a640 1 --2- 172.21.15.44:0/1319696935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb23c0cd3b0 0x7fb23c0cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.579+0000 7fb24218a640 1 --2- 172.21.15.44:0/1319696935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23c0b64c0 0x7fb23c0cbc70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.579+0000 7fb24218a640 1 --2- 172.21.15.44:0/1319696935 >> v2:172.21.15.204:3300/0 conn(0x7fb23c15af20 0x7fb23c0b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.579+0000 7fb24218a640 1 -- 172.21.15.44:0/1319696935 >> 172.21.15.44:0/1319696935 conn(0x7fb23c06ea20 msgr2=0x7fb23c06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.579+0000 7fb24218a640 1 -- 172.21.15.44:0/1319696935 shutdown_connections 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.579+0000 7fb24218a640 1 -- 172.21.15.44:0/1319696935 wait complete. 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.581+0000 7fb24218a640 1 Processor -- start 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.581+0000 7fb24218a640 1 -- start start 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.581+0000 7fb24218a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb23c0b64c0 0x7fb23c0aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.581+0000 7fb24218a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23c0cd3b0 0x7fb23c0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.581+0000 7fb24218a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb23c15af20 0x7fb23c0c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.581+0000 7fb24218a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c159ec0 con 0x7fb23c0cd3b0 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.581+0000 7fb24218a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c159590 con 0x7fb23c0b64c0 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.581+0000 7fb24218a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c159870 con 0x7fb23c15af20 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb23affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23c0cd3b0 0x7fb23c0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb23affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23c0cd3b0 0x7fb23c0c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38550/0 (socket says 172.21.15.44:38550) 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb23affd640 1 -- 172.21.15.44:0/2607946248 learned_addr learned my addr 172.21.15.44:0/2607946248 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb23b7fe640 1 --2- 172.21.15.44:0/2607946248 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb23c0b64c0 0x7fb23c0aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb23bfff640 1 --2- 172.21.15.44:0/2607946248 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb23c15af20 0x7fb23c0c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb23affd640 1 -- 172.21.15.44:0/2607946248 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb23c15af20 msgr2=0x7fb23c0c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb23affd640 1 --2- 172.21.15.44:0/2607946248 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb23c15af20 0x7fb23c0c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb23affd640 1 -- 172.21.15.44:0/2607946248 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb23c0b64c0 msgr2=0x7fb23c0aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb23affd640 1 --2- 172.21.15.44:0/2607946248 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb23c0b64c0 0x7fb23c0aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb23affd640 1 -- 172.21.15.44:0/2607946248 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240094d0 con 0x7fb23c0cd3b0 2023-11-04T01:36:23.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb23affd640 1 --2- 172.21.15.44:0/2607946248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23c0cd3b0 0x7fb23c0c91b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb22402b950 tx=0x7fb2240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb233fff640 1 -- 172.21.15.44:0/2607946248 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22403ac60 con 0x7fb23c0cd3b0 2023-11-04T01:36:23.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb233fff640 1 -- 172.21.15.44:0/2607946248 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22403adc0 con 0x7fb23c0cd3b0 2023-11-04T01:36:23.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb24218a640 1 -- 172.21.15.44:0/2607946248 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23c159b50 con 0x7fb23c0cd3b0 2023-11-04T01:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb233fff640 1 -- 172.21.15.44:0/2607946248 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240445f0 con 0x7fb23c0cd3b0 2023-11-04T01:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.582+0000 7fb24218a640 1 -- 172.21.15.44:0/2607946248 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23c0c6fc0 con 0x7fb23c0cd3b0 2023-11-04T01:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.583+0000 7fb24218a640 1 -- 172.21.15.44:0/2607946248 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23c15a070 con 0x7fb23c0cd3b0 2023-11-04T01:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.584+0000 7fb233fff640 1 -- 172.21.15.44:0/2607946248 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb22404d450 con 0x7fb23c0cd3b0 2023-11-04T01:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.584+0000 7fb233fff640 1 --2- 172.21.15.44:0/2607946248 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb21c06ae70 0x7fb21c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.584+0000 7fb233fff640 1 -- 172.21.15.44:0/2607946248 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb22402d040 con 0x7fb23c0cd3b0 2023-11-04T01:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.585+0000 7fb23b7fe640 1 --2- 172.21.15.44:0/2607946248 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb21c06ae70 0x7fb21c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.585+0000 7fb23b7fe640 1 --2- 172.21.15.44:0/2607946248 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb21c06ae70 0x7fb21c06d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb22c007920 tx=0x7fb22c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.588+0000 7fb233fff640 1 -- 172.21.15.44:0/2607946248 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb23c15a070 con 0x7fb23c0cd3b0 2023-11-04T01:36:23.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.764+0000 7fb24218a640 1 -- 172.21.15.44:0/2607946248 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb23c0674e0 con 0x7fb23c0cd3b0 2023-11-04T01:36:23.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.765+0000 7fb233fff640 1 -- 172.21.15.44:0/2607946248 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb224035070 con 0x7fb23c0cd3b0 2023-11-04T01:36:23.767 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:36:23.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.766+0000 7fb24218a640 1 -- 172.21.15.44:0/2607946248 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb21c06ae70 msgr2=0x7fb21c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.766+0000 7fb24218a640 1 --2- 172.21.15.44:0/2607946248 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb21c06ae70 0x7fb21c06d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb22c007920 tx=0x7fb22c008040 comp rx=0 tx=0).stop 2023-11-04T01:36:23.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.766+0000 7fb24218a640 1 -- 172.21.15.44:0/2607946248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23c0cd3b0 msgr2=0x7fb23c0c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.766+0000 7fb24218a640 1 --2- 172.21.15.44:0/2607946248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23c0cd3b0 0x7fb23c0c91b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb22402b950 tx=0x7fb2240046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.766+0000 7fb24218a640 1 -- 172.21.15.44:0/2607946248 shutdown_connections 2023-11-04T01:36:23.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.766+0000 7fb24218a640 1 --2- 172.21.15.44:0/2607946248 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb21c06ae70 0x7fb21c06d330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.766+0000 7fb24218a640 1 --2- 172.21.15.44:0/2607946248 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb23c15af20 0x7fb23c0c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.766+0000 7fb24218a640 1 --2- 172.21.15.44:0/2607946248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23c0cd3b0 0x7fb23c0c91b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.766+0000 7fb24218a640 1 --2- 172.21.15.44:0/2607946248 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb23c0b64c0 0x7fb23c0aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.766+0000 7fb24218a640 1 -- 172.21.15.44:0/2607946248 >> 172.21.15.44:0/2607946248 conn(0x7fb23c06ea20 msgr2=0x7fb23c06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.767+0000 7fb24218a640 1 -- 172.21.15.44:0/2607946248 shutdown_connections 2023-11-04T01:36:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.767+0000 7fb24218a640 1 -- 172.21.15.44:0/2607946248 wait complete. 2023-11-04T01:36:23.779 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.886+0000 7f612726f640 1 Processor -- start 2023-11-04T01:36:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.886+0000 7f612726f640 1 -- start start 2023-11-04T01:36:23.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.887+0000 7f612726f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f61200c4ff0 0x7f61200cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.887+0000 7f612726f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61200adac0 0x7f61200adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.887+0000 7f612726f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612015aff0 con 0x7f6120159c00 2023-11-04T01:36:23.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.887+0000 7f612726f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61200ae460 con 0x7f61200c4ff0 2023-11-04T01:36:23.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.887+0000 7f612726f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612015a3e0 con 0x7f61200adac0 2023-11-04T01:36:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.887+0000 7f612580c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61200adac0 0x7f61200adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.887+0000 7f612480a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f61200c4ff0 0x7f61200cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.887+0000 7f612500b640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f6120159c00 0x7f61200c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:46816/0 (socket says 172.21.15.44:46816) 2023-11-04T01:36:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.887+0000 7f612500b640 1 -- 172.21.15.44:0/3404363972 learned_addr learned my addr 172.21.15.44:0/3404363972 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.887+0000 7f612580c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61200adac0 0x7f61200adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:43562/0 (socket says 172.21.15.44:43562) 2023-11-04T01:36:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.888+0000 7f6117fff640 1 -- 172.21.15.44:0/3404363972 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283340665 0 0) 0x7f612015aff0 con 0x7f6120159c00 2023-11-04T01:36:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.888+0000 7f6117fff640 1 -- 172.21.15.44:0/3404363972 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f610c003520 con 0x7f6120159c00 2023-11-04T01:36:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.888+0000 7f612580c640 1 -- 172.21.15.44:0/3404363972 >> v2:172.21.15.204:3300/0 conn(0x7f61200c4ff0 msgr2=0x7f61200cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.888+0000 7f612580c640 1 --2- 172.21.15.44:0/3404363972 >> v2:172.21.15.204:3300/0 conn(0x7f61200c4ff0 0x7f61200cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.888+0000 7f612580c640 1 -- 172.21.15.44:0/3404363972 >> v1:172.21.15.204:6789/0 conn(0x7f6120159c00 legacy=0x7f61200c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.888+0000 7f612580c640 1 -- 172.21.15.44:0/3404363972 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612015a6c0 con 0x7f61200adac0 2023-11-04T01:36:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.888+0000 7f612480a640 1 --2- 172.21.15.44:0/3404363972 >> v2:172.21.15.204:3300/0 conn(0x7f61200c4ff0 0x7f61200cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.889+0000 7f612580c640 1 --2- 172.21.15.44:0/3404363972 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61200adac0 0x7f61200adf20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6118009d90 tx=0x7f611802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbfaf631e28a222d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.889+0000 7f6117fff640 1 -- 172.21.15.44:0/3404363972 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611802cc50 con 0x7f61200adac0 2023-11-04T01:36:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.889+0000 7f6117fff640 1 -- 172.21.15.44:0/3404363972 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611802cdb0 con 0x7f61200adac0 2023-11-04T01:36:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.889+0000 7f6117fff640 1 -- 172.21.15.44:0/3404363972 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118034640 con 0x7f61200adac0 2023-11-04T01:36:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.889+0000 7f612726f640 1 -- 172.21.15.44:0/3404363972 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61200adac0 msgr2=0x7f61200adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.889+0000 7f612726f640 1 --2- 172.21.15.44:0/3404363972 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61200adac0 0x7f61200adf20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6118009d90 tx=0x7f611802bea0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.889+0000 7f612726f640 1 -- 172.21.15.44:0/3404363972 shutdown_connections 2023-11-04T01:36:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.889+0000 7f612726f640 1 --2- 172.21.15.44:0/3404363972 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61200adac0 0x7f61200adf20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.889+0000 7f612726f640 1 --2- 172.21.15.44:0/3404363972 >> v2:172.21.15.204:3300/0 conn(0x7f61200c4ff0 0x7f61200cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.889+0000 7f612726f640 1 -- 172.21.15.44:0/3404363972 >> 172.21.15.44:0/3404363972 conn(0x7f61200ce950 msgr2=0x7f61200ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.889+0000 7f612726f640 1 -- 172.21.15.44:0/3404363972 shutdown_connections 2023-11-04T01:36:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.889+0000 7f612726f640 1 -- 172.21.15.44:0/3404363972 wait complete. 2023-11-04T01:36:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.890+0000 7f612726f640 1 Processor -- start 2023-11-04T01:36:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.891+0000 7f612726f640 1 -- start start 2023-11-04T01:36:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.891+0000 7f612726f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61200adac0 0x7f6120145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.891+0000 7f612726f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61200c4ff0 0x7f6120142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.891+0000 7f612726f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6120159c00 0x7f6120144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.891+0000 7f612726f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6120142d80 con 0x7f6120159c00 2023-11-04T01:36:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.891+0000 7f612726f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6120142fe0 con 0x7f61200c4ff0 2023-11-04T01:36:23.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.891+0000 7f612726f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61201432c0 con 0x7f61200adac0 2023-11-04T01:36:23.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.891+0000 7f612580c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6120159c00 0x7f6120144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.891+0000 7f612580c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6120159c00 0x7f6120144080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38556/0 (socket says 172.21.15.44:38556) 2023-11-04T01:36:23.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.891+0000 7f612580c640 1 -- 172.21.15.44:0/1428950899 learned_addr learned my addr 172.21.15.44:0/1428950899 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:23.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.892+0000 7f612500b640 1 --2- 172.21.15.44:0/1428950899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61200adac0 0x7f6120145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.892+0000 7f612480a640 1 --2- 172.21.15.44:0/1428950899 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61200c4ff0 0x7f6120142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.892+0000 7f612580c640 1 -- 172.21.15.44:0/1428950899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61200adac0 msgr2=0x7f6120145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.892+0000 7f612580c640 1 --2- 172.21.15.44:0/1428950899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61200adac0 0x7f6120145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.892+0000 7f612580c640 1 -- 172.21.15.44:0/1428950899 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61200c4ff0 msgr2=0x7f6120142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.892+0000 7f612580c640 1 --2- 172.21.15.44:0/1428950899 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61200c4ff0 0x7f6120142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.892+0000 7f612580c640 1 -- 172.21.15.44:0/1428950899 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110009400 con 0x7f6120159c00 2023-11-04T01:36:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.892+0000 7f612480a640 1 --2- 172.21.15.44:0/1428950899 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61200c4ff0 0x7f6120142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.892+0000 7f612580c640 1 --2- 172.21.15.44:0/1428950899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6120159c00 0x7f6120144080 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6118009d90 tx=0x7f6118004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.892+0000 7f6115ffb640 1 -- 172.21.15.44:0/1428950899 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118004880 con 0x7f6120159c00 2023-11-04T01:36:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.892+0000 7f6115ffb640 1 -- 172.21.15.44:0/1428950899 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6118009450 con 0x7f6120159c00 2023-11-04T01:36:23.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.892+0000 7f6115ffb640 1 -- 172.21.15.44:0/1428950899 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118034640 con 0x7f6120159c00 2023-11-04T01:36:23.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.892+0000 7f612726f640 1 -- 172.21.15.44:0/1428950899 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6118009a70 con 0x7f6120159c00 2023-11-04T01:36:23.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.892+0000 7f612726f640 1 -- 172.21.15.44:0/1428950899 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6120143880 con 0x7f6120159c00 2023-11-04T01:36:23.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.893+0000 7f612726f640 1 -- 172.21.15.44:0/1428950899 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6120074290 con 0x7f6120159c00 2023-11-04T01:36:23.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.894+0000 7f6115ffb640 1 -- 172.21.15.44:0/1428950899 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f611803b030 con 0x7f6120159c00 2023-11-04T01:36:23.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.894+0000 7f6115ffb640 1 --2- 172.21.15.44:0/1428950899 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f610406ae70 0x7f610406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.894+0000 7f6115ffb640 1 -- 172.21.15.44:0/1428950899 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f61180aba00 con 0x7f6120159c00 2023-11-04T01:36:23.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.894+0000 7f612500b640 1 --2- 172.21.15.44:0/1428950899 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f610406ae70 0x7f610406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.895+0000 7f612500b640 1 --2- 172.21.15.44:0/1428950899 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f610406ae70 0x7f610406d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f611c005880 tx=0x7f611c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:23.898+0000 7f6115ffb640 1 -- 172.21.15.44:0/1428950899 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6118076930 con 0x7f6120159c00 2023-11-04T01:36:24.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.073+0000 7f612726f640 1 -- 172.21.15.44:0/1428950899 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6120070bc0 con 0x7f6120159c00 2023-11-04T01:36:24.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.074+0000 7f6115ffb640 1 -- 172.21.15.44:0/1428950899 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6118079f50 con 0x7f6120159c00 2023-11-04T01:36:24.076 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:24.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.075+0000 7f612726f640 1 -- 172.21.15.44:0/1428950899 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f610406ae70 msgr2=0x7f610406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.075+0000 7f612726f640 1 --2- 172.21.15.44:0/1428950899 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f610406ae70 0x7f610406d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f611c005880 tx=0x7f611c009040 comp rx=0 tx=0).stop 2023-11-04T01:36:24.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.076+0000 7f612726f640 1 -- 172.21.15.44:0/1428950899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6120159c00 msgr2=0x7f6120144080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.076+0000 7f612726f640 1 --2- 172.21.15.44:0/1428950899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6120159c00 0x7f6120144080 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6118009d90 tx=0x7f6118004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:24.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.076+0000 7f612726f640 1 -- 172.21.15.44:0/1428950899 shutdown_connections 2023-11-04T01:36:24.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.076+0000 7f612726f640 1 --2- 172.21.15.44:0/1428950899 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f610406ae70 0x7f610406d330 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.076+0000 7f612726f640 1 --2- 172.21.15.44:0/1428950899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6120159c00 0x7f6120144080 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.076+0000 7f612726f640 1 --2- 172.21.15.44:0/1428950899 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61200c4ff0 0x7f6120142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.076+0000 7f612726f640 1 --2- 172.21.15.44:0/1428950899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61200adac0 0x7f6120145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.076+0000 7f612726f640 1 -- 172.21.15.44:0/1428950899 >> 172.21.15.44:0/1428950899 conn(0x7f61200ce950 msgr2=0x7f61200713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:24.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.076+0000 7f612726f640 1 -- 172.21.15.44:0/1428950899 shutdown_connections 2023-11-04T01:36:24.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.076+0000 7f612726f640 1 -- 172.21.15.44:0/1428950899 wait complete. 2023-11-04T01:36:24.089 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:24.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.194+0000 7f753995e640 1 Processor -- start 2023-11-04T01:36:24.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.194+0000 7f753995e640 1 -- start start 2023-11-04T01:36:24.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f753995e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75340b0ae0 0x7f75340ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f753995e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f753406db20 0x7f753415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f753995e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75340b4110 con 0x7f7534159c70 2023-11-04T01:36:24.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f753995e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75340b49b0 con 0x7f753406db20 2023-11-04T01:36:24.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f753995e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75340b43f0 con 0x7f75340b0ae0 2023-11-04T01:36:24.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f7532ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7534159c70 0x7f75340b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47432/0 (socket says 172.21.15.44:47432) 2023-11-04T01:36:24.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f7532ffd640 1 -- 172.21.15.44:0/3836500345 learned_addr learned my addr 172.21.15.44:0/3836500345 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:24.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f75337fe640 1 --2- 172.21.15.44:0/3836500345 >> v2:172.21.15.204:3300/0 conn(0x7f753406db20 0x7f753415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f752bfff640 1 --2- 172.21.15.44:0/3836500345 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75340b0ae0 0x7f75340ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f75327fc640 1 -- 172.21.15.44:0/3836500345 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570662112 0 0) 0x7f75340b4110 con 0x7f7534159c70 2023-11-04T01:36:24.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f75327fc640 1 -- 172.21.15.44:0/3836500345 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7520003520 con 0x7f7534159c70 2023-11-04T01:36:24.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f75327fc640 1 -- 172.21.15.44:0/3836500345 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 558342144 0 0) 0x7f7520003520 con 0x7f7534159c70 2023-11-04T01:36:24.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f75327fc640 1 -- 172.21.15.44:0/3836500345 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75340b0ae0 msgr2=0x7f75340ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:24.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f75327fc640 1 --2- 172.21.15.44:0/3836500345 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75340b0ae0 0x7f75340ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f75327fc640 1 -- 172.21.15.44:0/3836500345 >> v2:172.21.15.204:3300/0 conn(0x7f753406db20 msgr2=0x7f753415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f75327fc640 1 --2- 172.21.15.44:0/3836500345 >> v2:172.21.15.204:3300/0 conn(0x7f753406db20 0x7f753415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f75327fc640 1 -- 172.21.15.44:0/3836500345 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75340b46d0 con 0x7f7534159c70 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f75327fc640 1 -- 172.21.15.44:0/3836500345 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f7524001670 con 0x7f7534159c70 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.195+0000 7f75327fc640 1 -- 172.21.15.44:0/3836500345 >> v1:172.21.15.44:6789/0 conn(0x7f7534159c70 legacy=0x7f75340b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.196+0000 7f75327fc640 1 --2- 172.21.15.44:0/3836500345 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7520003970 0x7f7520003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.196+0000 7f75327fc640 1 --2- 172.21.15.44:0/3836500345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75200047c0 0x7f7520004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.196+0000 7f75327fc640 1 --2- 172.21.15.44:0/3836500345 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75340b0ae0 0x7f7520005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.196+0000 7f75327fc640 1 -- 172.21.15.44:0/3836500345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340b49b0 con 0x7f75200047c0 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.196+0000 7f75327fc640 1 -- 172.21.15.44:0/3836500345 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340b43f0 con 0x7f7520003970 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.196+0000 7f75327fc640 1 -- 172.21.15.44:0/3836500345 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752000b980 con 0x7f75340b0ae0 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.196+0000 7f752bfff640 1 --2- 172.21.15.44:0/3836500345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75200047c0 0x7f7520004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.196+0000 7f7532ffd640 1 --2- 172.21.15.44:0/3836500345 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7520003970 0x7f7520003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.196+0000 7f75337fe640 1 --2- 172.21.15.44:0/3836500345 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75340b0ae0 0x7f7520005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.196+0000 7f752bfff640 1 -- 172.21.15.44:0/3836500345 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75340b0ae0 msgr2=0x7f7520005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.196+0000 7f752bfff640 1 --2- 172.21.15.44:0/3836500345 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75340b0ae0 0x7f7520005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.196+0000 7f752bfff640 1 -- 172.21.15.44:0/3836500345 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7520003970 msgr2=0x7f7520003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.196+0000 7f752bfff640 1 --2- 172.21.15.44:0/3836500345 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7520003970 0x7f7520003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.196+0000 7f752bfff640 1 -- 172.21.15.44:0/3836500345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520003520 con 0x7f75200047c0 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.197+0000 7f752bfff640 1 --2- 172.21.15.44:0/3836500345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75200047c0 0x7f7520004c40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f751c009ac0 tx=0x7f75200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609081685bff4b5b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.197+0000 7f75327fc640 1 -- 172.21.15.44:0/3836500345 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c02c6b0 con 0x7f75200047c0 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.197+0000 7f75327fc640 1 -- 172.21.15.44:0/3836500345 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c02c810 con 0x7f75200047c0 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.197+0000 7f75327fc640 1 -- 172.21.15.44:0/3836500345 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c02cba0 con 0x7f75200047c0 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.197+0000 7f753995e640 1 -- 172.21.15.44:0/3836500345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75200047c0 msgr2=0x7f7520004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.197+0000 7f753995e640 1 --2- 172.21.15.44:0/3836500345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75200047c0 0x7f7520004c40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f751c009ac0 tx=0x7f75200057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.197+0000 7f75337fe640 1 -- 172.21.15.44:0/3836500345 reap_dead start 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.197+0000 7f753995e640 1 -- 172.21.15.44:0/3836500345 shutdown_connections 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.197+0000 7f753995e640 1 -- 172.21.15.44:0/3836500345 >> 172.21.15.44:0/3836500345 conn(0x7f75340ce950 msgr2=0x7f75340ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:24.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.197+0000 7f753995e640 1 -- 172.21.15.44:0/3836500345 shutdown_connections 2023-11-04T01:36:24.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.197+0000 7f753995e640 1 -- 172.21.15.44:0/3836500345 wait complete. 2023-11-04T01:36:24.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.199+0000 7f753995e640 1 Processor -- start 2023-11-04T01:36:24.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.199+0000 7f753995e640 1 -- start start 2023-11-04T01:36:24.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.199+0000 7f753995e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75200047c0 0x7f75341541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.199+0000 7f753995e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75341efab0 0x7f7534156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.199+0000 7f753995e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7534151250 0x7f75341516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.199+0000 7f753995e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7534154710 con 0x7f75200047c0 2023-11-04T01:36:24.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.199+0000 7f753995e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7534156c90 con 0x7f7534151250 2023-11-04T01:36:24.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.199+0000 7f753995e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7534156f70 con 0x7f75341efab0 2023-11-04T01:36:24.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.199+0000 7f7532ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75200047c0 0x7f75341541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.200+0000 7f7532ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75200047c0 0x7f75341541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38572/0 (socket says 172.21.15.44:38572) 2023-11-04T01:36:24.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.200+0000 7f7532ffd640 1 -- 172.21.15.44:0/2186707804 learned_addr learned my addr 172.21.15.44:0/2186707804 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:24.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.200+0000 7f752bfff640 1 --2- 172.21.15.44:0/2186707804 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75341efab0 0x7f7534156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.200+0000 7f75337fe640 1 --2- 172.21.15.44:0/2186707804 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7534151250 0x7f75341516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.200+0000 7f7532ffd640 1 -- 172.21.15.44:0/2186707804 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75341efab0 msgr2=0x7f7534156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.200+0000 7f7532ffd640 1 --2- 172.21.15.44:0/2186707804 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75341efab0 0x7f7534156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.200+0000 7f7532ffd640 1 -- 172.21.15.44:0/2186707804 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7534151250 msgr2=0x7f75341516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.200+0000 7f7532ffd640 1 --2- 172.21.15.44:0/2186707804 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7534151250 0x7f75341516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.200+0000 7f7532ffd640 1 -- 172.21.15.44:0/2186707804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7534157250 con 0x7f75200047c0 2023-11-04T01:36:24.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.200+0000 7f7532ffd640 1 --2- 172.21.15.44:0/2186707804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75200047c0 0x7f75341541d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7524007310 tx=0x7f75240077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:24.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.200+0000 7f7530ff9640 1 -- 172.21.15.44:0/2186707804 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400f940 con 0x7f75200047c0 2023-11-04T01:36:24.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.200+0000 7f7530ff9640 1 -- 172.21.15.44:0/2186707804 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752400fac0 con 0x7f75200047c0 2023-11-04T01:36:24.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.200+0000 7f753995e640 1 -- 172.21.15.44:0/2186707804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7534150a50 con 0x7f75200047c0 2023-11-04T01:36:24.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.200+0000 7f7530ff9640 1 -- 172.21.15.44:0/2186707804 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400fe70 con 0x7f75200047c0 2023-11-04T01:36:24.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.200+0000 7f753995e640 1 -- 172.21.15.44:0/2186707804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7534156980 con 0x7f75200047c0 2023-11-04T01:36:24.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.201+0000 7f753995e640 1 -- 172.21.15.44:0/2186707804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7534150f70 con 0x7f75200047c0 2023-11-04T01:36:24.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.202+0000 7f7530ff9640 1 -- 172.21.15.44:0/2186707804 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f752401d460 con 0x7f75200047c0 2023-11-04T01:36:24.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.202+0000 7f7530ff9640 1 --2- 172.21.15.44:0/2186707804 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f751406aea0 0x7f751406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.202+0000 7f7530ff9640 1 -- 172.21.15.44:0/2186707804 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7524089b20 con 0x7f75200047c0 2023-11-04T01:36:24.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.202+0000 7f752bfff640 1 --2- 172.21.15.44:0/2186707804 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f751406aea0 0x7f751406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.203+0000 7f752bfff640 1 --2- 172.21.15.44:0/2186707804 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f751406aea0 0x7f751406d360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f751c036000 tx=0x7f751c030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:24.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.207+0000 7f7530ff9640 1 -- 172.21.15.44:0/2186707804 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7534150f70 con 0x7f75200047c0 2023-11-04T01:36:24.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.423+0000 7f753995e640 1 -- 172.21.15.44:0/2186707804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7534150f70 con 0x7f75200047c0 2023-11-04T01:36:24.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.423+0000 7f7530ff9640 1 -- 172.21.15.44:0/2186707804 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f7534150f70 con 0x7f75200047c0 2023-11-04T01:36:24.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:24.427 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2760874964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2760874964},{"type":"v1","addr":"172.21.15.204:6836","nonce":2760874964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3427243577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3427243577},{"type":"v1","addr":"172.21.15.44:6833","nonce":3427243577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/178191500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":178191500},{"type":"v1","addr":"172.21.15.204:6837","nonce":178191500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:58.556492+0000","modified":"2023-11-04T01:36:15.592459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/240936603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":240936603},{"type":"v1","addr":"172.21.15.44:6835","nonce":240936603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:36:24.428 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2023-11-04T01:36:24.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.425+0000 7f753995e640 1 -- 172.21.15.44:0/2186707804 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f751406aea0 msgr2=0x7f751406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.425+0000 7f753995e640 1 --2- 172.21.15.44:0/2186707804 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f751406aea0 0x7f751406d360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f751c036000 tx=0x7f751c030000 comp rx=0 tx=0).stop 2023-11-04T01:36:24.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.425+0000 7f753995e640 1 -- 172.21.15.44:0/2186707804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75200047c0 msgr2=0x7f75341541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.425+0000 7f753995e640 1 --2- 172.21.15.44:0/2186707804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75200047c0 0x7f75341541d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7524007310 tx=0x7f75240077d0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.425+0000 7f753995e640 1 -- 172.21.15.44:0/2186707804 shutdown_connections 2023-11-04T01:36:24.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.425+0000 7f753995e640 1 --2- 172.21.15.44:0/2186707804 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f751406aea0 0x7f751406d360 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f751c036000 tx=0x7f751c030000 comp rx=0 tx=0).stop 2023-11-04T01:36:24.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.425+0000 7f753995e640 1 --2- 172.21.15.44:0/2186707804 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7534151250 0x7f75341516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.425+0000 7f753995e640 1 --2- 172.21.15.44:0/2186707804 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75341efab0 0x7f7534156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.425+0000 7f753995e640 1 --2- 172.21.15.44:0/2186707804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75200047c0 0x7f75341541d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.425+0000 7f753995e640 1 -- 172.21.15.44:0/2186707804 >> 172.21.15.44:0/2186707804 conn(0x7f75340ce950 msgr2=0x7f75340ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:24.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.425+0000 7f753995e640 1 -- 172.21.15.44:0/2186707804 shutdown_connections 2023-11-04T01:36:24.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.425+0000 7f753995e640 1 -- 172.21.15.44:0/2186707804 wait complete. 2023-11-04T01:36:24.438 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.542+0000 7fdcaf8bb640 1 Processor -- start 2023-11-04T01:36:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.543+0000 7fdcaf8bb640 1 -- start start 2023-11-04T01:36:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.543+0000 7fdcaf8bb640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdca815ad80 0x7fdca80abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.543+0000 7fdcaf8bb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca80c9a40 0x7fdca80c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.543+0000 7fdcaf8bb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca806b720 con 0x7fdca806a1b0 2023-11-04T01:36:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.543+0000 7fdcaf8bb640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca80ca410 con 0x7fdca815ad80 2023-11-04T01:36:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.543+0000 7fdcaf8bb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca806cf60 con 0x7fdca80c9a40 2023-11-04T01:36:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.544+0000 7fdcade58640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca80c9a40 0x7fdca80c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.544+0000 7fdcade58640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca80c9a40 0x7fdca80c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:43626/0 (socket says 172.21.15.44:43626) 2023-11-04T01:36:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.544+0000 7fdcade58640 1 -- 172.21.15.44:0/2705516983 learned_addr learned my addr 172.21.15.44:0/2705516983 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.544+0000 7fdcad657640 1 --2- 172.21.15.44:0/2705516983 >> v2:172.21.15.204:3300/0 conn(0x7fdca815ad80 0x7fdca80abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.544+0000 7fdcade58640 1 -- 172.21.15.44:0/2705516983 >> v2:172.21.15.204:3300/0 conn(0x7fdca815ad80 msgr2=0x7fdca80abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.544+0000 7fdcade58640 1 --2- 172.21.15.44:0/2705516983 >> v2:172.21.15.204:3300/0 conn(0x7fdca815ad80 0x7fdca80abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.544+0000 7fdcade58640 1 -- 172.21.15.44:0/2705516983 >> v1:172.21.15.204:6789/0 conn(0x7fdca806a1b0 legacy=0x7fdca806b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.544+0000 7fdcade58640 1 -- 172.21.15.44:0/2705516983 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca80ac390 con 0x7fdca80c9a40 2023-11-04T01:36:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.544+0000 7fdcad657640 1 --2- 172.21.15.44:0/2705516983 >> v2:172.21.15.204:3300/0 conn(0x7fdca815ad80 0x7fdca80abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.545+0000 7fdcade58640 1 --2- 172.21.15.44:0/2705516983 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca80c9a40 0x7fdca80c9ed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009e50 tx=0x7fdca402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f049f572cdfe94db server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.545+0000 7fdc9ffff640 1 -- 172.21.15.44:0/2705516983 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca402cb00 con 0x7fdca80c9a40 2023-11-04T01:36:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.545+0000 7fdc9ffff640 1 -- 172.21.15.44:0/2705516983 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca402cc60 con 0x7fdca80c9a40 2023-11-04T01:36:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.545+0000 7fdc9ffff640 1 -- 172.21.15.44:0/2705516983 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca40343f0 con 0x7fdca80c9a40 2023-11-04T01:36:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.546+0000 7fdcaf8bb640 1 -- 172.21.15.44:0/2705516983 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca80c9a40 msgr2=0x7fdca80c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.546+0000 7fdcaf8bb640 1 --2- 172.21.15.44:0/2705516983 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca80c9a40 0x7fdca80c9ed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009e50 tx=0x7fdca402bf60 comp rx=0 tx=0).stop 2023-11-04T01:36:24.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.546+0000 7fdcaf8bb640 1 -- 172.21.15.44:0/2705516983 shutdown_connections 2023-11-04T01:36:24.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.546+0000 7fdcaf8bb640 1 --2- 172.21.15.44:0/2705516983 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca80c9a40 0x7fdca80c9ed0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.546+0000 7fdcaf8bb640 1 --2- 172.21.15.44:0/2705516983 >> v2:172.21.15.204:3300/0 conn(0x7fdca815ad80 0x7fdca80abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.546+0000 7fdcaf8bb640 1 -- 172.21.15.44:0/2705516983 >> 172.21.15.44:0/2705516983 conn(0x7fdca80b0cd0 msgr2=0x7fdca80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:24.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.546+0000 7fdcaf8bb640 1 -- 172.21.15.44:0/2705516983 shutdown_connections 2023-11-04T01:36:24.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.546+0000 7fdcaf8bb640 1 -- 172.21.15.44:0/2705516983 wait complete. 2023-11-04T01:36:24.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.547+0000 7fdcaf8bb640 1 Processor -- start 2023-11-04T01:36:24.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.547+0000 7fdcaf8bb640 1 -- start start 2023-11-04T01:36:24.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcaf8bb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdca806a1b0 0x7fdca8153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcaf8bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdca80c9a40 0x7fdca8098a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcaf8bb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca815ad80 0x7fdca8098fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcaf8bb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca809aba0 con 0x7fdca80c9a40 2023-11-04T01:36:24.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcaf8bb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca80c56a0 con 0x7fdca806a1b0 2023-11-04T01:36:24.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcaf8bb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca81537b0 con 0x7fdca815ad80 2023-11-04T01:36:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcace56640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdca80c9a40 0x7fdca8098a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcace56640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdca80c9a40 0x7fdca8098a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38584/0 (socket says 172.21.15.44:38584) 2023-11-04T01:36:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcace56640 1 -- 172.21.15.44:0/1409958784 learned_addr learned my addr 172.21.15.44:0/1409958784 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcade58640 1 --2- 172.21.15.44:0/1409958784 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca815ad80 0x7fdca8098fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcad657640 1 --2- 172.21.15.44:0/1409958784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdca806a1b0 0x7fdca8153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcace56640 1 -- 172.21.15.44:0/1409958784 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca815ad80 msgr2=0x7fdca8098fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcace56640 1 --2- 172.21.15.44:0/1409958784 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca815ad80 0x7fdca8098fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcace56640 1 -- 172.21.15.44:0/1409958784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdca806a1b0 msgr2=0x7fdca8153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcace56640 1 --2- 172.21.15.44:0/1409958784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdca806a1b0 0x7fdca8153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcace56640 1 -- 172.21.15.44:0/1409958784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0009400 con 0x7fdca80c9a40 2023-11-04T01:36:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.548+0000 7fdcace56640 1 --2- 172.21.15.44:0/1409958784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdca80c9a40 0x7fdca8098a60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800c3f0 tx=0x7fdc9800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.549+0000 7fdc9dffb640 1 -- 172.21.15.44:0/1409958784 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980052d0 con 0x7fdca80c9a40 2023-11-04T01:36:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.549+0000 7fdc9dffb640 1 -- 172.21.15.44:0/1409958784 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc98005450 con 0x7fdca80c9a40 2023-11-04T01:36:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.549+0000 7fdc9dffb640 1 -- 172.21.15.44:0/1409958784 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98007260 con 0x7fdca80c9a40 2023-11-04T01:36:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.549+0000 7fdcaf8bb640 1 -- 172.21.15.44:0/1409958784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca4009b30 con 0x7fdca80c9a40 2023-11-04T01:36:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.549+0000 7fdcaf8bb640 1 -- 172.21.15.44:0/1409958784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca80c4e00 con 0x7fdca80c9a40 2023-11-04T01:36:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.550+0000 7fdcaf8bb640 1 -- 172.21.15.44:0/1409958784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca8074290 con 0x7fdca80c9a40 2023-11-04T01:36:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.550+0000 7fdc9dffb640 1 -- 172.21.15.44:0/1409958784 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc980073c0 con 0x7fdca80c9a40 2023-11-04T01:36:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.550+0000 7fdc9dffb640 1 --2- 172.21.15.44:0/1409958784 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdc8c06ae70 0x7fdc8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.551+0000 7fdc9dffb640 1 -- 172.21.15.44:0/1409958784 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdc98088b30 con 0x7fdca80c9a40 2023-11-04T01:36:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.551+0000 7fdcad657640 1 --2- 172.21.15.44:0/1409958784 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdc8c06ae70 0x7fdc8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.551+0000 7fdcad657640 1 --2- 172.21.15.44:0/1409958784 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdc8c06ae70 0x7fdc8c06d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdca80c8630 tx=0x7fdca0009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:24.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.555+0000 7fdc9dffb640 1 -- 172.21.15.44:0/1409958784 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdc980539b0 con 0x7fdca80c9a40 2023-11-04T01:36:24.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.733+0000 7fdcaf8bb640 1 -- 172.21.15.44:0/1409958784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdca8066320 con 0x7fdca80c9a40 2023-11-04T01:36:24.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.734+0000 7fdc9dffb640 1 -- 172.21.15.44:0/1409958784 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fdc98056fd0 con 0x7fdca80c9a40 2023-11-04T01:36:24.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:24.738 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:03.589395+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:24.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.736+0000 7fdcaf8bb640 1 -- 172.21.15.44:0/1409958784 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdc8c06ae70 msgr2=0x7fdc8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.736+0000 7fdcaf8bb640 1 --2- 172.21.15.44:0/1409958784 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdc8c06ae70 0x7fdc8c06d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdca80c8630 tx=0x7fdca0009190 comp rx=0 tx=0).stop 2023-11-04T01:36:24.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.736+0000 7fdcaf8bb640 1 -- 172.21.15.44:0/1409958784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdca80c9a40 msgr2=0x7fdca8098a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.736+0000 7fdcaf8bb640 1 --2- 172.21.15.44:0/1409958784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdca80c9a40 0x7fdca8098a60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800c3f0 tx=0x7fdc9800c8b0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.736+0000 7fdcaf8bb640 1 -- 172.21.15.44:0/1409958784 shutdown_connections 2023-11-04T01:36:24.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.736+0000 7fdcaf8bb640 1 --2- 172.21.15.44:0/1409958784 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdc8c06ae70 0x7fdc8c06d330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.736+0000 7fdcaf8bb640 1 --2- 172.21.15.44:0/1409958784 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdca815ad80 0x7fdca8098fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.736+0000 7fdcaf8bb640 1 --2- 172.21.15.44:0/1409958784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdca80c9a40 0x7fdca8098a60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.736+0000 7fdcaf8bb640 1 --2- 172.21.15.44:0/1409958784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdca806a1b0 0x7fdca8153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.736+0000 7fdcaf8bb640 1 -- 172.21.15.44:0/1409958784 >> 172.21.15.44:0/1409958784 conn(0x7fdca80b0cd0 msgr2=0x7fdca80ac520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:24.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.736+0000 7fdcaf8bb640 1 -- 172.21.15.44:0/1409958784 shutdown_connections 2023-11-04T01:36:24.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.736+0000 7fdcaf8bb640 1 -- 172.21.15.44:0/1409958784 wait complete. 2023-11-04T01:36:24.749 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:24.750 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:24.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.857+0000 7f386fc07640 1 Processor -- start 2023-11-04T01:36:24.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.857+0000 7f386fc07640 1 -- start start 2023-11-04T01:36:24.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.858+0000 7f386fc07640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f38680ca0a0 0x7f38680cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.858+0000 7f386fc07640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38680cc300 0x7f38680cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.858+0000 7f386fc07640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38680caa20 con 0x7f386815e3f0 2023-11-04T01:36:24.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.858+0000 7f386fc07640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38680b3300 con 0x7f38680ca0a0 2023-11-04T01:36:24.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.858+0000 7f386fc07640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38680cb230 con 0x7f38680cc300 2023-11-04T01:36:24.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.858+0000 7f386e1a4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38680cc300 0x7f38680cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.858+0000 7f386e1a4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38680cc300 0x7f38680cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:43640/0 (socket says 172.21.15.44:43640) 2023-11-04T01:36:24.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.858+0000 7f386e1a4640 1 -- 172.21.15.44:0/2630207766 learned_addr learned my addr 172.21.15.44:0/2630207766 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:24.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.858+0000 7f386d1a2640 1 --2- 172.21.15.44:0/2630207766 >> v2:172.21.15.204:3300/0 conn(0x7f38680ca0a0 0x7f38680cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.858+0000 7f386e1a4640 1 -- 172.21.15.44:0/2630207766 >> v2:172.21.15.204:3300/0 conn(0x7f38680ca0a0 msgr2=0x7f38680cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:24.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.858+0000 7f386e1a4640 1 --2- 172.21.15.44:0/2630207766 >> v2:172.21.15.204:3300/0 conn(0x7f38680ca0a0 0x7f38680cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.858+0000 7f386e1a4640 1 -- 172.21.15.44:0/2630207766 >> v1:172.21.15.204:6789/0 conn(0x7f386815e3f0 legacy=0x7f38680b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.858+0000 7f386e1a4640 1 -- 172.21.15.44:0/2630207766 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38680ca530 con 0x7f38680cc300 2023-11-04T01:36:24.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.859+0000 7f386e1a4640 1 --2- 172.21.15.44:0/2630207766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38680cc300 0x7f38680cce60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3860009e50 tx=0x7f386002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=342611450dd805bc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:24.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.859+0000 7f386c9a1640 1 -- 172.21.15.44:0/2630207766 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386002cb00 con 0x7f38680cc300 2023-11-04T01:36:24.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.859+0000 7f386c9a1640 1 -- 172.21.15.44:0/2630207766 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386002cc60 con 0x7f38680cc300 2023-11-04T01:36:24.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.859+0000 7f386c9a1640 1 -- 172.21.15.44:0/2630207766 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38600343f0 con 0x7f38680cc300 2023-11-04T01:36:24.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.860+0000 7f386fc07640 1 -- 172.21.15.44:0/2630207766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38680cc300 msgr2=0x7f38680cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.860+0000 7f386fc07640 1 --2- 172.21.15.44:0/2630207766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38680cc300 0x7f38680cce60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3860009e50 tx=0x7f386002bf60 comp rx=0 tx=0).stop 2023-11-04T01:36:24.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.860+0000 7f386fc07640 1 -- 172.21.15.44:0/2630207766 shutdown_connections 2023-11-04T01:36:24.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.860+0000 7f386fc07640 1 --2- 172.21.15.44:0/2630207766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38680cc300 0x7f38680cce60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.860+0000 7f386fc07640 1 --2- 172.21.15.44:0/2630207766 >> v2:172.21.15.204:3300/0 conn(0x7f38680ca0a0 0x7f38680cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.860+0000 7f386fc07640 1 -- 172.21.15.44:0/2630207766 >> 172.21.15.44:0/2630207766 conn(0x7f3868071820 msgr2=0x7f3868071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:24.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.860+0000 7f386fc07640 1 -- 172.21.15.44:0/2630207766 shutdown_connections 2023-11-04T01:36:24.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.860+0000 7f386fc07640 1 -- 172.21.15.44:0/2630207766 wait complete. 2023-11-04T01:36:24.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.861+0000 7f386fc07640 1 Processor -- start 2023-11-04T01:36:24.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.861+0000 7f386fc07640 1 -- start start 2023-11-04T01:36:24.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386fc07640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38680cc300 0x7f3868158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386fc07640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f386815e3f0 0x7f386815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386fc07640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3868159670 0x7f38680c3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386fc07640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386815aaa0 con 0x7f3868159670 2023-11-04T01:36:24.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386fc07640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3868159e20 con 0x7f386815e3f0 2023-11-04T01:36:24.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386fc07640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386815a100 con 0x7f38680cc300 2023-11-04T01:36:24.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386e1a4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3868159670 0x7f38680c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386e1a4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3868159670 0x7f38680c3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38594/0 (socket says 172.21.15.44:38594) 2023-11-04T01:36:24.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386e1a4640 1 -- 172.21.15.44:0/288254003 learned_addr learned my addr 172.21.15.44:0/288254003 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:24.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386d1a2640 1 --2- 172.21.15.44:0/288254003 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f386815e3f0 0x7f386815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386d9a3640 1 --2- 172.21.15.44:0/288254003 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38680cc300 0x7f3868158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386e1a4640 1 -- 172.21.15.44:0/288254003 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38680cc300 msgr2=0x7f3868158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386e1a4640 1 --2- 172.21.15.44:0/288254003 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38680cc300 0x7f3868158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386e1a4640 1 -- 172.21.15.44:0/288254003 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f386815e3f0 msgr2=0x7f386815aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386e1a4640 1 --2- 172.21.15.44:0/288254003 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f386815e3f0 0x7f386815aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.862+0000 7f386e1a4640 1 -- 172.21.15.44:0/288254003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3860009b30 con 0x7f3868159670 2023-11-04T01:36:24.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.863+0000 7f386e1a4640 1 --2- 172.21.15.44:0/288254003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3868159670 0x7f38680c3820 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3860009e50 tx=0x7f3860004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:24.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.863+0000 7f385e7fc640 1 -- 172.21.15.44:0/288254003 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3860009510 con 0x7f3868159670 2023-11-04T01:36:24.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.863+0000 7f385e7fc640 1 -- 172.21.15.44:0/288254003 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386003e450 con 0x7f3868159670 2023-11-04T01:36:24.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.863+0000 7f386fc07640 1 -- 172.21.15.44:0/288254003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386815a3e0 con 0x7f3868159670 2023-11-04T01:36:24.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.863+0000 7f385e7fc640 1 -- 172.21.15.44:0/288254003 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386003e800 con 0x7f3868159670 2023-11-04T01:36:24.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.863+0000 7f386fc07640 1 -- 172.21.15.44:0/288254003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386815b400 con 0x7f3868159670 2023-11-04T01:36:24.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.864+0000 7f386fc07640 1 -- 172.21.15.44:0/288254003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38680cbd80 con 0x7f3868159670 2023-11-04T01:36:24.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.864+0000 7f385e7fc640 1 -- 172.21.15.44:0/288254003 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f386003e960 con 0x7f3868159670 2023-11-04T01:36:24.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.865+0000 7f385e7fc640 1 --2- 172.21.15.44:0/288254003 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f384c06ae70 0x7f384c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.865+0000 7f385e7fc640 1 -- 172.21.15.44:0/288254003 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f38600ac440 con 0x7f3868159670 2023-11-04T01:36:24.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.865+0000 7f386d9a3640 1 --2- 172.21.15.44:0/288254003 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f384c06ae70 0x7f384c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.865+0000 7f386d9a3640 1 --2- 172.21.15.44:0/288254003 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f384c06ae70 0x7f384c06d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3864000f60 tx=0x7f3864009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:24.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:24.869+0000 7f385e7fc640 1 -- 172.21.15.44:0/288254003 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3860077340 con 0x7f3868159670 2023-11-04T01:36:25.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.047+0000 7f386fc07640 1 -- 172.21.15.44:0/288254003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f386815abe0 con 0x7f3868159670 2023-11-04T01:36:25.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.048+0000 7f385e7fc640 1 -- 172.21.15.44:0/288254003 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f386815abe0 con 0x7f3868159670 2023-11-04T01:36:25.050 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:36:25.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.050+0000 7f386fc07640 1 -- 172.21.15.44:0/288254003 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f384c06ae70 msgr2=0x7f384c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.050+0000 7f386fc07640 1 --2- 172.21.15.44:0/288254003 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f384c06ae70 0x7f384c06d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3864000f60 tx=0x7f3864009040 comp rx=0 tx=0).stop 2023-11-04T01:36:25.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.050+0000 7f386fc07640 1 -- 172.21.15.44:0/288254003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3868159670 msgr2=0x7f38680c3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.050+0000 7f386fc07640 1 --2- 172.21.15.44:0/288254003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3868159670 0x7f38680c3820 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3860009e50 tx=0x7f3860004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.050+0000 7f386fc07640 1 -- 172.21.15.44:0/288254003 shutdown_connections 2023-11-04T01:36:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.050+0000 7f386fc07640 1 --2- 172.21.15.44:0/288254003 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f384c06ae70 0x7f384c06d330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.050+0000 7f386fc07640 1 --2- 172.21.15.44:0/288254003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3868159670 0x7f38680c3820 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.050+0000 7f386fc07640 1 --2- 172.21.15.44:0/288254003 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f386815e3f0 0x7f386815aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.050+0000 7f386fc07640 1 --2- 172.21.15.44:0/288254003 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38680cc300 0x7f3868158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.050+0000 7f386fc07640 1 -- 172.21.15.44:0/288254003 >> 172.21.15.44:0/288254003 conn(0x7f3868071820 msgr2=0x7f386815d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.050+0000 7f386fc07640 1 -- 172.21.15.44:0/288254003 shutdown_connections 2023-11-04T01:36:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.050+0000 7f386fc07640 1 -- 172.21.15.44:0/288254003 wait complete. 2023-11-04T01:36:25.065 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:25.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.174+0000 7fad88f05640 1 Processor -- start 2023-11-04T01:36:25.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.174+0000 7fad88f05640 1 -- start start 2023-11-04T01:36:25.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.175+0000 7fad88f05640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad840d0710 0x7fad840cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.175+0000 7fad88f05640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad840d0280 con 0x7fad8415e430 2023-11-04T01:36:25.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.175+0000 7fad88f05640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad840cdf00 con 0x7fad840cda50 2023-11-04T01:36:25.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.175+0000 7fad88f05640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad840cf670 con 0x7fad840d0710 2023-11-04T01:36:25.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.175+0000 7fad8259c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fad8415e430 0x7fad840cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47442/0 (socket says 172.21.15.44:47442) 2023-11-04T01:36:25.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.175+0000 7fad8259c640 1 -- 172.21.15.44:0/3833783747 learned_addr learned my addr 172.21.15.44:0/3833783747 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:25.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.175+0000 7fad7bfff640 1 --2- 172.21.15.44:0/3833783747 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad840d0710 0x7fad840cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.175+0000 7fad81d9b640 1 -- 172.21.15.44:0/3833783747 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40254427 0 0) 0x7fad840d0280 con 0x7fad8415e430 2023-11-04T01:36:25.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.175+0000 7fad81d9b640 1 -- 172.21.15.44:0/3833783747 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad70003520 con 0x7fad8415e430 2023-11-04T01:36:25.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.175+0000 7fad81d9b640 1 -- 172.21.15.44:0/3833783747 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3575823027 0 0) 0x7fad840cdf00 con 0x7fad840cda50 2023-11-04T01:36:25.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.175+0000 7fad81d9b640 1 -- 172.21.15.44:0/3833783747 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad840d0280 con 0x7fad840cda50 2023-11-04T01:36:25.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.175+0000 7fad7bfff640 1 -- 172.21.15.44:0/3833783747 >> v1:172.21.15.204:6789/0 conn(0x7fad840cda50 legacy=0x7fad840b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.175+0000 7fad7bfff640 1 -- 172.21.15.44:0/3833783747 >> v1:172.21.15.44:6789/0 conn(0x7fad8415e430 legacy=0x7fad840cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.175+0000 7fad7bfff640 1 -- 172.21.15.44:0/3833783747 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840cf950 con 0x7fad840d0710 2023-11-04T01:36:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.176+0000 7fad7bfff640 1 --2- 172.21.15.44:0/3833783747 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad840d0710 0x7fad840cd510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0097d0 tx=0x7fad6c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=470a67fedc3a9a88 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.176+0000 7fad81d9b640 1 -- 172.21.15.44:0/3833783747 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c031890 con 0x7fad840d0710 2023-11-04T01:36:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.176+0000 7fad81d9b640 1 -- 172.21.15.44:0/3833783747 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c0319f0 con 0x7fad840d0710 2023-11-04T01:36:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.177+0000 7fad81d9b640 1 -- 172.21.15.44:0/3833783747 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c031d60 con 0x7fad840d0710 2023-11-04T01:36:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.177+0000 7fad88f05640 1 -- 172.21.15.44:0/3833783747 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad840d0710 msgr2=0x7fad840cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.177+0000 7fad88f05640 1 --2- 172.21.15.44:0/3833783747 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad840d0710 0x7fad840cd510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0097d0 tx=0x7fad6c02b930 comp rx=0 tx=0).stop 2023-11-04T01:36:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.177+0000 7fad88f05640 1 -- 172.21.15.44:0/3833783747 shutdown_connections 2023-11-04T01:36:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.177+0000 7fad88f05640 1 --2- 172.21.15.44:0/3833783747 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad840d0710 0x7fad840cd510 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.177+0000 7fad88f05640 1 -- 172.21.15.44:0/3833783747 >> 172.21.15.44:0/3833783747 conn(0x7fad8406ea20 msgr2=0x7fad8406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:25.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.177+0000 7fad88f05640 1 -- 172.21.15.44:0/3833783747 shutdown_connections 2023-11-04T01:36:25.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.177+0000 7fad88f05640 1 -- 172.21.15.44:0/3833783747 wait complete. 2023-11-04T01:36:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.178+0000 7fad88f05640 1 Processor -- start 2023-11-04T01:36:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.178+0000 7fad88f05640 1 -- start start 2023-11-04T01:36:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.179+0000 7fad88f05640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad840cda50 0x7fad840b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.179+0000 7fad88f05640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad840d0710 0x7fad840b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.179+0000 7fad88f05640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad8415e430 0x7fad841efd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.179+0000 7fad88f05640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840b3500 con 0x7fad8415e430 2023-11-04T01:36:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.179+0000 7fad88f05640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840b1b30 con 0x7fad840d0710 2023-11-04T01:36:25.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.179+0000 7fad88f05640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad84150690 con 0x7fad840cda50 2023-11-04T01:36:25.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.179+0000 7fad82d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad8415e430 0x7fad841efd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.179+0000 7fad82d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad8415e430 0x7fad841efd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38606/0 (socket says 172.21.15.44:38606) 2023-11-04T01:36:25.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.179+0000 7fad82d9d640 1 -- 172.21.15.44:0/715486093 learned_addr learned my addr 172.21.15.44:0/715486093 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:25.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.180+0000 7fad7bfff640 1 --2- 172.21.15.44:0/715486093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad840d0710 0x7fad840b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.180+0000 7fad8259c640 1 --2- 172.21.15.44:0/715486093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad840cda50 0x7fad840b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.180+0000 7fad82d9d640 1 -- 172.21.15.44:0/715486093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad840cda50 msgr2=0x7fad840b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.180+0000 7fad82d9d640 1 --2- 172.21.15.44:0/715486093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad840cda50 0x7fad840b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.180+0000 7fad82d9d640 1 -- 172.21.15.44:0/715486093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad840d0710 msgr2=0x7fad840b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.180+0000 7fad82d9d640 1 --2- 172.21.15.44:0/715486093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad840d0710 0x7fad840b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.180+0000 7fad82d9d640 1 -- 172.21.15.44:0/715486093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c009400 con 0x7fad8415e430 2023-11-04T01:36:25.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.180+0000 7fad7bfff640 1 --2- 172.21.15.44:0/715486093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad840d0710 0x7fad840b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.180+0000 7fad82d9d640 1 --2- 172.21.15.44:0/715486093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad8415e430 0x7fad841efd30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fad7c00c6e0 tx=0x7fad7c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.180+0000 7fad7affd640 1 -- 172.21.15.44:0/715486093 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c003b70 con 0x7fad8415e430 2023-11-04T01:36:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.180+0000 7fad7affd640 1 -- 172.21.15.44:0/715486093 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c003cd0 con 0x7fad8415e430 2023-11-04T01:36:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.180+0000 7fad88f05640 1 -- 172.21.15.44:0/715486093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8414fb90 con 0x7fad8415e430 2023-11-04T01:36:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.180+0000 7fad7affd640 1 -- 172.21.15.44:0/715486093 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c0052d0 con 0x7fad8415e430 2023-11-04T01:36:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.180+0000 7fad88f05640 1 -- 172.21.15.44:0/715486093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad840b1470 con 0x7fad8415e430 2023-11-04T01:36:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.181+0000 7fad88f05640 1 -- 172.21.15.44:0/715486093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad840b1c70 con 0x7fad8415e430 2023-11-04T01:36:25.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.182+0000 7fad7affd640 1 -- 172.21.15.44:0/715486093 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad7c005430 con 0x7fad8415e430 2023-11-04T01:36:25.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.182+0000 7fad7affd640 1 --2- 172.21.15.44:0/715486093 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fad6406aea0 0x7fad6406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.182+0000 7fad7affd640 1 -- 172.21.15.44:0/715486093 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fad7c089600 con 0x7fad8415e430 2023-11-04T01:36:25.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.182+0000 7fad8259c640 1 --2- 172.21.15.44:0/715486093 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fad6406aea0 0x7fad6406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.183+0000 7fad8259c640 1 --2- 172.21.15.44:0/715486093 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fad6406aea0 0x7fad6406d360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fad740011e0 tx=0x7fad74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:25.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.186+0000 7fad7affd640 1 -- 172.21.15.44:0/715486093 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad840b1c70 con 0x7fad8415e430 2023-11-04T01:36:25.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.365+0000 7fad88f05640 1 -- 172.21.15.44:0/715486093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad840b1c70 con 0x7fad8415e430 2023-11-04T01:36:25.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.365+0000 7fad7affd640 1 -- 172.21.15.44:0/715486093 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad840b1c70 con 0x7fad8415e430 2023-11-04T01:36:25.370 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:25.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.367+0000 7fad88f05640 1 -- 172.21.15.44:0/715486093 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fad6406aea0 msgr2=0x7fad6406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.367+0000 7fad88f05640 1 --2- 172.21.15.44:0/715486093 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fad6406aea0 0x7fad6406d360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fad740011e0 tx=0x7fad74009040 comp rx=0 tx=0).stop 2023-11-04T01:36:25.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.367+0000 7fad88f05640 1 -- 172.21.15.44:0/715486093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad8415e430 msgr2=0x7fad841efd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.367+0000 7fad88f05640 1 --2- 172.21.15.44:0/715486093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad8415e430 0x7fad841efd30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fad7c00c6e0 tx=0x7fad7c00cba0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.367+0000 7fad88f05640 1 -- 172.21.15.44:0/715486093 shutdown_connections 2023-11-04T01:36:25.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.367+0000 7fad88f05640 1 --2- 172.21.15.44:0/715486093 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fad6406aea0 0x7fad6406d360 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.367+0000 7fad88f05640 1 --2- 172.21.15.44:0/715486093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad8415e430 0x7fad841efd30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.367+0000 7fad88f05640 1 --2- 172.21.15.44:0/715486093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad840d0710 0x7fad840b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.367+0000 7fad88f05640 1 --2- 172.21.15.44:0/715486093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad840cda50 0x7fad840b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.367+0000 7fad88f05640 1 -- 172.21.15.44:0/715486093 >> 172.21.15.44:0/715486093 conn(0x7fad8406ea20 msgr2=0x7fad8415bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:25.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.367+0000 7fad88f05640 1 -- 172.21.15.44:0/715486093 shutdown_connections 2023-11-04T01:36:25.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.367+0000 7fad88f05640 1 -- 172.21.15.44:0/715486093 wait complete. 2023-11-04T01:36:25.380 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:25.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.489+0000 7f626beb0640 1 Processor -- start 2023-11-04T01:36:25.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.489+0000 7f626beb0640 1 -- start start 2023-11-04T01:36:25.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.490+0000 7f626beb0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f626415e430 0x7f62640cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.490+0000 7f626beb0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62640d0280 con 0x7f62640d0710 2023-11-04T01:36:25.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.490+0000 7f626beb0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62640cf670 con 0x7f62640cf160 2023-11-04T01:36:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.490+0000 7f626beb0640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62640cf950 con 0x7f626415e430 2023-11-04T01:36:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.490+0000 7f6269c4c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f626415e430 0x7f62640cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.490+0000 7f626a44d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f62640d0710 0x7f62640b3d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47456/0 (socket says 172.21.15.44:47456) 2023-11-04T01:36:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.490+0000 7f626a44d640 1 -- 172.21.15.44:0/3961526006 learned_addr learned my addr 172.21.15.44:0/3961526006 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.490+0000 7f6269c4c640 1 -- 172.21.15.44:0/3961526006 >> v1:172.21.15.204:6789/0 conn(0x7f62640cf160 legacy=0x7f62640cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.490+0000 7f6269c4c640 1 -- 172.21.15.44:0/3961526006 >> v1:172.21.15.44:6789/0 conn(0x7f62640d0710 legacy=0x7f62640b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.490+0000 7f6269c4c640 1 -- 172.21.15.44:0/3961526006 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62640cfc30 con 0x7f626415e430 2023-11-04T01:36:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.490+0000 7f6268c4a640 1 -- 172.21.15.44:0/3961526006 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576794735 0 0) 0x7f62640d0280 con 0x7f62640d0710 2023-11-04T01:36:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.491+0000 7f6269c4c640 1 --2- 172.21.15.44:0/3961526006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f626415e430 0x7f62640cec20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f62600097a0 tx=0x7f626002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872e2ceab457517d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:25.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.491+0000 7f6268c4a640 1 -- 172.21.15.44:0/3961526006 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260031830 con 0x7f626415e430 2023-11-04T01:36:25.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.491+0000 7f6268c4a640 1 -- 172.21.15.44:0/3961526006 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6260031990 con 0x7f626415e430 2023-11-04T01:36:25.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.491+0000 7f6268c4a640 1 -- 172.21.15.44:0/3961526006 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260031d20 con 0x7f626415e430 2023-11-04T01:36:25.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.491+0000 7f626beb0640 1 -- 172.21.15.44:0/3961526006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f626415e430 msgr2=0x7f62640cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.491+0000 7f626beb0640 1 --2- 172.21.15.44:0/3961526006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f626415e430 0x7f62640cec20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f62600097a0 tx=0x7f626002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.492+0000 7f626beb0640 1 -- 172.21.15.44:0/3961526006 shutdown_connections 2023-11-04T01:36:25.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.492+0000 7f626beb0640 1 --2- 172.21.15.44:0/3961526006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f626415e430 0x7f62640cec20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.492+0000 7f626beb0640 1 -- 172.21.15.44:0/3961526006 >> 172.21.15.44:0/3961526006 conn(0x7f626406ea20 msgr2=0x7f626406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:25.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.492+0000 7f626beb0640 1 -- 172.21.15.44:0/3961526006 shutdown_connections 2023-11-04T01:36:25.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.492+0000 7f626beb0640 1 -- 172.21.15.44:0/3961526006 wait complete. 2023-11-04T01:36:25.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.493+0000 7f626beb0640 1 Processor -- start 2023-11-04T01:36:25.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.493+0000 7f626beb0640 1 -- start start 2023-11-04T01:36:25.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.493+0000 7f626beb0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62640cf160 0x7f62640a7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f626beb0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62640d0710 0x7f626414cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f626beb0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f626415e430 0x7f626414dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f626beb0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62640ca1d0 con 0x7f62640cf160 2023-11-04T01:36:25.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f626beb0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62640ca410 con 0x7f626415e430 2023-11-04T01:36:25.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f626beb0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62640ca6f0 con 0x7f62640d0710 2023-11-04T01:36:25.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f6269c4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62640cf160 0x7f62640a7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f6269c4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62640cf160 0x7f62640a7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38618/0 (socket says 172.21.15.44:38618) 2023-11-04T01:36:25.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f6269c4c640 1 -- 172.21.15.44:0/1795241766 learned_addr learned my addr 172.21.15.44:0/1795241766 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:25.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f626944b640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62640d0710 0x7f626414cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f626a44d640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f626415e430 0x7f626414dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f6269c4c640 1 -- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62640d0710 msgr2=0x7f626414cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f6269c4c640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62640d0710 0x7f626414cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f6269c4c640 1 -- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f626415e430 msgr2=0x7f626414dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f6269c4c640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f626415e430 0x7f626414dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f6269c4c640 1 -- 172.21.15.44:0/1795241766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6260009400 con 0x7f62640cf160 2023-11-04T01:36:25.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f626944b640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62640d0710 0x7f626414cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:25.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f626a44d640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f626415e430 0x7f626414dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:25.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f6269c4c640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62640cf160 0x7f62640a7540 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f62600097a0 tx=0x7f62600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:25.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f625a7fc640 1 -- 172.21.15.44:0/1795241766 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626003aa60 con 0x7f62640cf160 2023-11-04T01:36:25.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f625a7fc640 1 -- 172.21.15.44:0/1795241766 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626003abc0 con 0x7f62640cf160 2023-11-04T01:36:25.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f626beb0640 1 -- 172.21.15.44:0/1795241766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62640ca9d0 con 0x7f62640cf160 2023-11-04T01:36:25.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f625a7fc640 1 -- 172.21.15.44:0/1795241766 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62600443f0 con 0x7f62640cf160 2023-11-04T01:36:25.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.494+0000 7f626beb0640 1 -- 172.21.15.44:0/1795241766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62640caf90 con 0x7f62640cf160 2023-11-04T01:36:25.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.495+0000 7f626beb0640 1 -- 172.21.15.44:0/1795241766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6264074290 con 0x7f62640cf160 2023-11-04T01:36:25.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.496+0000 7f625a7fc640 1 -- 172.21.15.44:0/1795241766 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f626004d450 con 0x7f62640cf160 2023-11-04T01:36:25.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.496+0000 7f625a7fc640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f624806aea0 0x7f624806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.496+0000 7f625a7fc640 1 -- 172.21.15.44:0/1795241766 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f62600abb20 con 0x7f62640cf160 2023-11-04T01:36:25.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.497+0000 7f626944b640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f624806aea0 0x7f624806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.497+0000 7f626944b640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f624806aea0 0x7f624806d360 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f62640c91d0 tx=0x7f6254009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:25.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.501+0000 7f625a7fc640 1 -- 172.21.15.44:0/1795241766 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62600768e0 con 0x7f62640cf160 2023-11-04T01:36:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.675+0000 7f626beb0640 1 -- 172.21.15.44:0/1795241766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f626415cf20 con 0x7f62640cf160 2023-11-04T01:36:25.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.676+0000 7f625a7fc640 1 -- 172.21.15.44:0/1795241766 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6260079f00 con 0x7f62640cf160 2023-11-04T01:36:25.678 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:36:25.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.678+0000 7f626beb0640 1 -- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f624806aea0 msgr2=0x7f624806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.678+0000 7f626beb0640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f624806aea0 0x7f624806d360 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f62640c91d0 tx=0x7f6254009040 comp rx=0 tx=0).stop 2023-11-04T01:36:25.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.678+0000 7f626beb0640 1 -- 172.21.15.44:0/1795241766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62640cf160 msgr2=0x7f62640a7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.678+0000 7f626beb0640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62640cf160 0x7f62640a7540 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f62600097a0 tx=0x7f62600046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.678+0000 7f626beb0640 1 -- 172.21.15.44:0/1795241766 shutdown_connections 2023-11-04T01:36:25.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.678+0000 7f626beb0640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f624806aea0 0x7f624806d360 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.678+0000 7f626beb0640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f626415e430 0x7f626414dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.678+0000 7f626beb0640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62640d0710 0x7f626414cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.678+0000 7f626beb0640 1 --2- 172.21.15.44:0/1795241766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62640cf160 0x7f62640a7540 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.678+0000 7f626beb0640 1 -- 172.21.15.44:0/1795241766 >> 172.21.15.44:0/1795241766 conn(0x7f626406ea20 msgr2=0x7f62640c4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:25.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.678+0000 7f626beb0640 1 -- 172.21.15.44:0/1795241766 shutdown_connections 2023-11-04T01:36:25.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.678+0000 7f626beb0640 1 -- 172.21.15.44:0/1795241766 wait complete. 2023-11-04T01:36:25.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:25.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.797+0000 7fa116287640 1 Processor -- start 2023-11-04T01:36:25.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.798+0000 7fa116287640 1 -- start start 2023-11-04T01:36:25.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.798+0000 7fa116287640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa110153e60 0x7fa11015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.798+0000 7fa116287640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100b4880 0x7fa1100b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.798+0000 7fa116287640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1100cde60 con 0x7fa1100cd6d0 2023-11-04T01:36:25.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.798+0000 7fa116287640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa110160f90 con 0x7fa110153e60 2023-11-04T01:36:25.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.798+0000 7fa116287640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100b5200 con 0x7fa1100b4880 2023-11-04T01:36:25.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.799+0000 7fa114824640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100b4880 0x7fa1100b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.799+0000 7fa114824640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100b4880 0x7fa1100b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:43686/0 (socket says 172.21.15.44:43686) 2023-11-04T01:36:25.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.799+0000 7fa10ffff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa110153e60 0x7fa11015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.799+0000 7fa114824640 1 -- 172.21.15.44:0/960182531 learned_addr learned my addr 172.21.15.44:0/960182531 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:25.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.799+0000 7fa114824640 1 -- 172.21.15.44:0/960182531 >> v2:172.21.15.204:3300/0 conn(0x7fa110153e60 msgr2=0x7fa11015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:25.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.799+0000 7fa114824640 1 --2- 172.21.15.44:0/960182531 >> v2:172.21.15.204:3300/0 conn(0x7fa110153e60 0x7fa11015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.799+0000 7fa114824640 1 -- 172.21.15.44:0/960182531 >> v1:172.21.15.204:6789/0 conn(0x7fa1100cd6d0 legacy=0x7fa110161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.799+0000 7fa114824640 1 -- 172.21.15.44:0/960182531 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11015e400 con 0x7fa1100b4880 2023-11-04T01:36:25.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.800+0000 7fa114824640 1 --2- 172.21.15.44:0/960182531 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100b4880 0x7fa1100b4cc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa108009e50 tx=0x7fa10802bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f15a7ca491f3fec1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.800+0000 7fa10effd640 1 -- 172.21.15.44:0/960182531 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10802caf0 con 0x7fa1100b4880 2023-11-04T01:36:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.800+0000 7fa10effd640 1 -- 172.21.15.44:0/960182531 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10802cc50 con 0x7fa1100b4880 2023-11-04T01:36:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.800+0000 7fa10effd640 1 -- 172.21.15.44:0/960182531 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1080343f0 con 0x7fa1100b4880 2023-11-04T01:36:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.801+0000 7fa116287640 1 -- 172.21.15.44:0/960182531 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100b4880 msgr2=0x7fa1100b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.801+0000 7fa116287640 1 --2- 172.21.15.44:0/960182531 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100b4880 0x7fa1100b4cc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa108009e50 tx=0x7fa10802bf50 comp rx=0 tx=0).stop 2023-11-04T01:36:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.801+0000 7fa116287640 1 -- 172.21.15.44:0/960182531 shutdown_connections 2023-11-04T01:36:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.801+0000 7fa116287640 1 --2- 172.21.15.44:0/960182531 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100b4880 0x7fa1100b4cc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.801+0000 7fa116287640 1 --2- 172.21.15.44:0/960182531 >> v2:172.21.15.204:3300/0 conn(0x7fa110153e60 0x7fa11015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.801+0000 7fa116287640 1 -- 172.21.15.44:0/960182531 >> 172.21.15.44:0/960182531 conn(0x7fa1100cf880 msgr2=0x7fa1100cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:25.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.801+0000 7fa116287640 1 -- 172.21.15.44:0/960182531 shutdown_connections 2023-11-04T01:36:25.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.801+0000 7fa116287640 1 -- 172.21.15.44:0/960182531 wait complete. 2023-11-04T01:36:25.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.802+0000 7fa116287640 1 Processor -- start 2023-11-04T01:36:25.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.802+0000 7fa116287640 1 -- start start 2023-11-04T01:36:25.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa116287640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1100b4880 0x7fa110148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa116287640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1100cd6d0 0x7fa110156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa116287640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa110153e60 0x7fa1100b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa116287640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100cb330 con 0x7fa1100b4880 2023-11-04T01:36:25.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa116287640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100cb800 con 0x7fa1100cd6d0 2023-11-04T01:36:25.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa116287640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100ca290 con 0x7fa110153e60 2023-11-04T01:36:25.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa10ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1100b4880 0x7fa110148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa10ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1100b4880 0x7fa110148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38624/0 (socket says 172.21.15.44:38624) 2023-11-04T01:36:25.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa10ffff640 1 -- 172.21.15.44:0/4084190875 learned_addr learned my addr 172.21.15.44:0/4084190875 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:25.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa114824640 1 --2- 172.21.15.44:0/4084190875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa110153e60 0x7fa1100b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa10f7fe640 1 --2- 172.21.15.44:0/4084190875 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1100cd6d0 0x7fa110156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa10ffff640 1 -- 172.21.15.44:0/4084190875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa110153e60 msgr2=0x7fa1100b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa10ffff640 1 --2- 172.21.15.44:0/4084190875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa110153e60 0x7fa1100b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa10ffff640 1 -- 172.21.15.44:0/4084190875 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1100cd6d0 msgr2=0x7fa110156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa10ffff640 1 --2- 172.21.15.44:0/4084190875 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1100cd6d0 0x7fa110156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa10ffff640 1 -- 172.21.15.44:0/4084190875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa108009b30 con 0x7fa1100b4880 2023-11-04T01:36:25.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa114824640 1 --2- 172.21.15.44:0/4084190875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa110153e60 0x7fa1100b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:25.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.803+0000 7fa10ffff640 1 --2- 172.21.15.44:0/4084190875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1100b4880 0x7fa110148180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa10000e870 tx=0x7fa10000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:25.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.804+0000 7fa10cff9640 1 -- 172.21.15.44:0/4084190875 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1000094f0 con 0x7fa1100b4880 2023-11-04T01:36:25.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.804+0000 7fa10cff9640 1 -- 172.21.15.44:0/4084190875 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10000c940 con 0x7fa1100b4880 2023-11-04T01:36:25.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.804+0000 7fa10cff9640 1 -- 172.21.15.44:0/4084190875 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10000ccf0 con 0x7fa1100b4880 2023-11-04T01:36:25.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.804+0000 7fa116287640 1 -- 172.21.15.44:0/4084190875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1100ca570 con 0x7fa1100b4880 2023-11-04T01:36:25.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.804+0000 7fa116287640 1 -- 172.21.15.44:0/4084190875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1100cab30 con 0x7fa1100b4880 2023-11-04T01:36:25.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.805+0000 7fa116287640 1 -- 172.21.15.44:0/4084190875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa110074290 con 0x7fa1100b4880 2023-11-04T01:36:25.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.805+0000 7fa10cff9640 1 -- 172.21.15.44:0/4084190875 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa100013470 con 0x7fa1100b4880 2023-11-04T01:36:25.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.805+0000 7fa10cff9640 1 --2- 172.21.15.44:0/4084190875 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa0fc06ae70 0x7fa0fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:25.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.806+0000 7fa10cff9640 1 -- 172.21.15.44:0/4084190875 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa1000899b0 con 0x7fa1100b4880 2023-11-04T01:36:25.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.806+0000 7fa10f7fe640 1 --2- 172.21.15.44:0/4084190875 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa0fc06ae70 0x7fa0fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:25.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.806+0000 7fa10f7fe640 1 --2- 172.21.15.44:0/4084190875 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa0fc06ae70 0x7fa0fc06d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa110161730 tx=0x7fa104009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:25.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.810+0000 7fa10cff9640 1 -- 172.21.15.44:0/4084190875 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa100054780 con 0x7fa1100b4880 2023-11-04T01:36:25.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.983+0000 7fa116287640 1 -- 172.21.15.44:0/4084190875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa1100c9760 con 0x7fa1100b4880 2023-11-04T01:36:25.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.984+0000 7fa10cff9640 1 -- 172.21.15.44:0/4084190875 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa100057da0 con 0x7fa1100b4880 2023-11-04T01:36:25.991 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:25.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.985+0000 7fa116287640 1 -- 172.21.15.44:0/4084190875 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa0fc06ae70 msgr2=0x7fa0fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.985+0000 7fa116287640 1 --2- 172.21.15.44:0/4084190875 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa0fc06ae70 0x7fa0fc06d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa110161730 tx=0x7fa104009040 comp rx=0 tx=0).stop 2023-11-04T01:36:25.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.985+0000 7fa116287640 1 -- 172.21.15.44:0/4084190875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1100b4880 msgr2=0x7fa110148180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:25.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.985+0000 7fa116287640 1 --2- 172.21.15.44:0/4084190875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1100b4880 0x7fa110148180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa10000e870 tx=0x7fa10000ed30 comp rx=0 tx=0).stop 2023-11-04T01:36:25.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.985+0000 7fa116287640 1 -- 172.21.15.44:0/4084190875 shutdown_connections 2023-11-04T01:36:25.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.985+0000 7fa116287640 1 --2- 172.21.15.44:0/4084190875 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa0fc06ae70 0x7fa0fc06d330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.985+0000 7fa116287640 1 --2- 172.21.15.44:0/4084190875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa110153e60 0x7fa1100b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.985+0000 7fa116287640 1 --2- 172.21.15.44:0/4084190875 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1100cd6d0 0x7fa110156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.985+0000 7fa116287640 1 --2- 172.21.15.44:0/4084190875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1100b4880 0x7fa110148180 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:25.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.985+0000 7fa116287640 1 -- 172.21.15.44:0/4084190875 >> 172.21.15.44:0/4084190875 conn(0x7fa1100cf880 msgr2=0x7fa1100cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:25.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.985+0000 7fa116287640 1 -- 172.21.15.44:0/4084190875 shutdown_connections 2023-11-04T01:36:25.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:25.985+0000 7fa116287640 1 -- 172.21.15.44:0/4084190875 wait complete. 2023-11-04T01:36:25.999 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:26.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.103+0000 7ff24f06b640 1 Processor -- start 2023-11-04T01:36:26.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.103+0000 7ff24f06b640 1 -- start start 2023-11-04T01:36:26.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.104+0000 7ff24f06b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff2480b0ae0 0x7ff2480ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.104+0000 7ff24f06b640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2480b4110 con 0x7ff24806db20 2023-11-04T01:36:26.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.104+0000 7ff24f06b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2480b43f0 con 0x7ff248159c70 2023-11-04T01:36:26.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.104+0000 7ff24f06b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2480b49b0 con 0x7ff2480b0ae0 2023-11-04T01:36:26.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.104+0000 7ff24d608640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff24806db20 0x7ff24815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47458/0 (socket says 172.21.15.44:47458) 2023-11-04T01:36:26.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.104+0000 7ff24d608640 1 -- 172.21.15.44:0/1143862632 learned_addr learned my addr 172.21.15.44:0/1143862632 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:26.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.104+0000 7ff247fff640 1 --2- 172.21.15.44:0/1143862632 >> v2:172.21.15.204:3300/0 conn(0x7ff2480b0ae0 0x7ff2480ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.104+0000 7ff2477fe640 1 -- 172.21.15.44:0/1143862632 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37675791 0 0) 0x7ff2480b4110 con 0x7ff24806db20 2023-11-04T01:36:26.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.104+0000 7ff2477fe640 1 -- 172.21.15.44:0/1143862632 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff238003520 con 0x7ff24806db20 2023-11-04T01:36:26.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.104+0000 7ff2477fe640 1 -- 172.21.15.44:0/1143862632 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163520687 0 0) 0x7ff2480b43f0 con 0x7ff248159c70 2023-11-04T01:36:26.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.104+0000 7ff2477fe640 1 -- 172.21.15.44:0/1143862632 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2480b4110 con 0x7ff248159c70 2023-11-04T01:36:26.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.104+0000 7ff247fff640 1 -- 172.21.15.44:0/1143862632 >> v1:172.21.15.204:6789/0 conn(0x7ff248159c70 legacy=0x7ff2480b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.104+0000 7ff247fff640 1 -- 172.21.15.44:0/1143862632 >> v1:172.21.15.44:6789/0 conn(0x7ff24806db20 legacy=0x7ff24815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.104+0000 7ff247fff640 1 -- 172.21.15.44:0/1143862632 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2480b46d0 con 0x7ff2480b0ae0 2023-11-04T01:36:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.105+0000 7ff247fff640 1 --2- 172.21.15.44:0/1143862632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2480b0ae0 0x7ff2480ce370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff2340097a0 tx=0x7ff23402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=422cabbcfccca61c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.105+0000 7ff2477fe640 1 -- 172.21.15.44:0/1143862632 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234030610 con 0x7ff2480b0ae0 2023-11-04T01:36:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.106+0000 7ff2477fe640 1 -- 172.21.15.44:0/1143862632 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff234030770 con 0x7ff2480b0ae0 2023-11-04T01:36:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.106+0000 7ff2477fe640 1 -- 172.21.15.44:0/1143862632 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234030b00 con 0x7ff2480b0ae0 2023-11-04T01:36:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.106+0000 7ff24f06b640 1 -- 172.21.15.44:0/1143862632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2480b0ae0 msgr2=0x7ff2480ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.106+0000 7ff24f06b640 1 --2- 172.21.15.44:0/1143862632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2480b0ae0 0x7ff2480ce370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff2340097a0 tx=0x7ff23402b960 comp rx=0 tx=0).stop 2023-11-04T01:36:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.106+0000 7ff24f06b640 1 -- 172.21.15.44:0/1143862632 shutdown_connections 2023-11-04T01:36:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.106+0000 7ff24f06b640 1 --2- 172.21.15.44:0/1143862632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2480b0ae0 0x7ff2480ce370 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.106+0000 7ff24f06b640 1 -- 172.21.15.44:0/1143862632 >> 172.21.15.44:0/1143862632 conn(0x7ff2480ce950 msgr2=0x7ff2480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.106+0000 7ff24f06b640 1 -- 172.21.15.44:0/1143862632 shutdown_connections 2023-11-04T01:36:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.106+0000 7ff24f06b640 1 -- 172.21.15.44:0/1143862632 wait complete. 2023-11-04T01:36:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.107+0000 7ff24f06b640 1 Processor -- start 2023-11-04T01:36:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.107+0000 7ff24f06b640 1 -- start start 2023-11-04T01:36:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.108+0000 7ff24f06b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff24806db20 0x7ff248156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.108+0000 7ff24f06b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2480b0ae0 0x7ff2480c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.108+0000 7ff24f06b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff248159c70 0x7ff2480c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.108+0000 7ff24f06b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2480b33a0 con 0x7ff2480b0ae0 2023-11-04T01:36:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.108+0000 7ff24f06b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2480b1a40 con 0x7ff248159c70 2023-11-04T01:36:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.108+0000 7ff24f06b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2480b28a0 con 0x7ff24806db20 2023-11-04T01:36:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.108+0000 7ff247fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2480b0ae0 0x7ff2480c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.108+0000 7ff247fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2480b0ae0 0x7ff2480c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38632/0 (socket says 172.21.15.44:38632) 2023-11-04T01:36:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.108+0000 7ff247fff640 1 -- 172.21.15.44:0/1715347299 learned_addr learned my addr 172.21.15.44:0/1715347299 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.108+0000 7ff24d608640 1 --2- 172.21.15.44:0/1715347299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff248159c70 0x7ff2480c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.108+0000 7ff24ce07640 1 --2- 172.21.15.44:0/1715347299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff24806db20 0x7ff248156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.109+0000 7ff247fff640 1 -- 172.21.15.44:0/1715347299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff24806db20 msgr2=0x7ff248156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.109+0000 7ff247fff640 1 --2- 172.21.15.44:0/1715347299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff24806db20 0x7ff248156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.109+0000 7ff247fff640 1 -- 172.21.15.44:0/1715347299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff248159c70 msgr2=0x7ff2480c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.109+0000 7ff247fff640 1 --2- 172.21.15.44:0/1715347299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff248159c70 0x7ff2480c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.109+0000 7ff247fff640 1 -- 172.21.15.44:0/1715347299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff234009400 con 0x7ff2480b0ae0 2023-11-04T01:36:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.109+0000 7ff24d608640 1 --2- 172.21.15.44:0/1715347299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff248159c70 0x7ff2480c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.109+0000 7ff247fff640 1 --2- 172.21.15.44:0/1715347299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2480b0ae0 0x7ff2480c86e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff23402bf70 tx=0x7ff234004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.109+0000 7ff2457fa640 1 -- 172.21.15.44:0/1715347299 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23403e040 con 0x7ff2480b0ae0 2023-11-04T01:36:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.109+0000 7ff2457fa640 1 -- 172.21.15.44:0/1715347299 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff234039a40 con 0x7ff2480b0ae0 2023-11-04T01:36:26.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.109+0000 7ff24f06b640 1 -- 172.21.15.44:0/1715347299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2481574b0 con 0x7ff2480b0ae0 2023-11-04T01:36:26.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.109+0000 7ff2457fa640 1 -- 172.21.15.44:0/1715347299 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234039df0 con 0x7ff2480b0ae0 2023-11-04T01:36:26.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.109+0000 7ff24f06b640 1 -- 172.21.15.44:0/1715347299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2480b1f70 con 0x7ff2480b0ae0 2023-11-04T01:36:26.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.110+0000 7ff24f06b640 1 -- 172.21.15.44:0/1715347299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2480b2a10 con 0x7ff2480b0ae0 2023-11-04T01:36:26.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.110+0000 7ff2457fa640 1 -- 172.21.15.44:0/1715347299 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff23404d3b0 con 0x7ff2480b0ae0 2023-11-04T01:36:26.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.111+0000 7ff2457fa640 1 --2- 172.21.15.44:0/1715347299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff22c06ae70 0x7ff22c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.111+0000 7ff2457fa640 1 -- 172.21.15.44:0/1715347299 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff2340abbe0 con 0x7ff2480b0ae0 2023-11-04T01:36:26.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.111+0000 7ff24ce07640 1 --2- 172.21.15.44:0/1715347299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff22c06ae70 0x7ff22c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.111+0000 7ff24ce07640 1 --2- 172.21.15.44:0/1715347299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff22c06ae70 0x7ff22c06d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0011e0 tx=0x7ff23c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:26.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.115+0000 7ff2457fa640 1 -- 172.21.15.44:0/1715347299 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff234076a30 con 0x7ff2480b0ae0 2023-11-04T01:36:26.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.329+0000 7ff24f06b640 1 -- 172.21.15.44:0/1715347299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff248074290 con 0x7ff2480b0ae0 2023-11-04T01:36:26.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.329+0000 7ff2457fa640 1 -- 172.21.15.44:0/1715347299 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7ff23407a050 con 0x7ff2480b0ae0 2023-11-04T01:36:26.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:26.332 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2760874964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2760874964},{"type":"v1","addr":"172.21.15.204:6836","nonce":2760874964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3427243577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3427243577},{"type":"v1","addr":"172.21.15.44:6833","nonce":3427243577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/178191500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":178191500},{"type":"v1","addr":"172.21.15.204:6837","nonce":178191500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:58.556492+0000","modified":"2023-11-04T01:36:15.592459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/240936603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":240936603},{"type":"v1","addr":"172.21.15.44:6835","nonce":240936603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:36:26.332 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2023-11-04T01:36:26.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.331+0000 7ff24f06b640 1 -- 172.21.15.44:0/1715347299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff22c06ae70 msgr2=0x7ff22c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.331+0000 7ff24f06b640 1 --2- 172.21.15.44:0/1715347299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff22c06ae70 0x7ff22c06d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0011e0 tx=0x7ff23c009040 comp rx=0 tx=0).stop 2023-11-04T01:36:26.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.331+0000 7ff24f06b640 1 -- 172.21.15.44:0/1715347299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2480b0ae0 msgr2=0x7ff2480c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.331+0000 7ff24f06b640 1 --2- 172.21.15.44:0/1715347299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2480b0ae0 0x7ff2480c86e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff23402bf70 tx=0x7ff234004730 comp rx=0 tx=0).stop 2023-11-04T01:36:26.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.332+0000 7ff24f06b640 1 -- 172.21.15.44:0/1715347299 shutdown_connections 2023-11-04T01:36:26.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.332+0000 7ff24f06b640 1 --2- 172.21.15.44:0/1715347299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff22c06ae70 0x7ff22c06d330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.332+0000 7ff24f06b640 1 --2- 172.21.15.44:0/1715347299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff248159c70 0x7ff2480c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.332+0000 7ff24f06b640 1 --2- 172.21.15.44:0/1715347299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2480b0ae0 0x7ff2480c86e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.332+0000 7ff24f06b640 1 --2- 172.21.15.44:0/1715347299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff24806db20 0x7ff248156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.332+0000 7ff24f06b640 1 -- 172.21.15.44:0/1715347299 >> 172.21.15.44:0/1715347299 conn(0x7ff2480ce950 msgr2=0x7ff24815af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:26.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.332+0000 7ff24f06b640 1 -- 172.21.15.44:0/1715347299 shutdown_connections 2023-11-04T01:36:26.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.332+0000 7ff24f06b640 1 -- 172.21.15.44:0/1715347299 wait complete. 2023-11-04T01:36:26.344 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:26.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.449+0000 7fa61e7f5640 1 Processor -- start 2023-11-04T01:36:26.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.449+0000 7fa61e7f5640 1 -- start start 2023-11-04T01:36:26.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.450+0000 7fa61e7f5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa61815ae40 0x7fa61815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.450+0000 7fa61e7f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6180cbc00 0x7fa6180cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.450+0000 7fa61e7f5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6180cc450 con 0x7fa6180cd860 2023-11-04T01:36:26.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.450+0000 7fa61e7f5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61815f400 con 0x7fa61815ae40 2023-11-04T01:36:26.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.450+0000 7fa61e7f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61815b220 con 0x7fa6180cbc00 2023-11-04T01:36:26.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.450+0000 7fa617fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa61815ae40 0x7fa61815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.450+0000 7fa617fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa61815ae40 0x7fa61815bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38640/0 (socket says 172.21.15.44:38640) 2023-11-04T01:36:26.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.450+0000 7fa617fff640 1 -- 172.21.15.44:0/26778471 learned_addr learned my addr 172.21.15.44:0/26778471 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:26.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.450+0000 7fa6177fe640 1 --2- 172.21.15.44:0/26778471 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6180cbc00 0x7fa6180cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.450+0000 7fa617fff640 1 -- 172.21.15.44:0/26778471 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6180cbc00 msgr2=0x7fa6180cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:26.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.450+0000 7fa617fff640 1 --2- 172.21.15.44:0/26778471 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6180cbc00 0x7fa6180cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.450+0000 7fa617fff640 1 -- 172.21.15.44:0/26778471 >> v1:172.21.15.204:6789/0 conn(0x7fa6180cd860 legacy=0x7fa6180b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.450+0000 7fa617fff640 1 -- 172.21.15.44:0/26778471 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61815f890 con 0x7fa61815ae40 2023-11-04T01:36:26.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.450+0000 7fa6177fe640 1 --2- 172.21.15.44:0/26778471 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6180cbc00 0x7fa6180cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:26.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.451+0000 7fa617fff640 1 --2- 172.21.15.44:0/26778471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61815ae40 0x7fa61815bfb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa608009870 tx=0x7fa60802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0fc1f776d0179 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:26.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.451+0000 7fa616ffd640 1 -- 172.21.15.44:0/26778471 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608030840 con 0x7fa61815ae40 2023-11-04T01:36:26.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.451+0000 7fa616ffd640 1 -- 172.21.15.44:0/26778471 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6080309a0 con 0x7fa61815ae40 2023-11-04T01:36:26.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.451+0000 7fa616ffd640 1 -- 172.21.15.44:0/26778471 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608030d30 con 0x7fa61815ae40 2023-11-04T01:36:26.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.452+0000 7fa61e7f5640 1 -- 172.21.15.44:0/26778471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61815ae40 msgr2=0x7fa61815bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.452+0000 7fa61e7f5640 1 --2- 172.21.15.44:0/26778471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61815ae40 0x7fa61815bfb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa608009870 tx=0x7fa60802b980 comp rx=0 tx=0).stop 2023-11-04T01:36:26.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.452+0000 7fa61e7f5640 1 -- 172.21.15.44:0/26778471 shutdown_connections 2023-11-04T01:36:26.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.452+0000 7fa61e7f5640 1 --2- 172.21.15.44:0/26778471 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6180cbc00 0x7fa6180cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.452+0000 7fa61e7f5640 1 --2- 172.21.15.44:0/26778471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61815ae40 0x7fa61815bfb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.452+0000 7fa61e7f5640 1 -- 172.21.15.44:0/26778471 >> 172.21.15.44:0/26778471 conn(0x7fa61806ea90 msgr2=0x7fa61806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:26.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.452+0000 7fa61e7f5640 1 -- 172.21.15.44:0/26778471 shutdown_connections 2023-11-04T01:36:26.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.452+0000 7fa61e7f5640 1 -- 172.21.15.44:0/26778471 wait complete. 2023-11-04T01:36:26.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.453+0000 7fa61e7f5640 1 Processor -- start 2023-11-04T01:36:26.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.453+0000 7fa61e7f5640 1 -- start start 2023-11-04T01:36:26.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa61e7f5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa6180cbc00 0x7fa6180c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa61e7f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6180cd860 0x7fa6180c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa61e7f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61815ae40 0x7fa6180c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa61e7f5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180c5700 con 0x7fa61815ae40 2023-11-04T01:36:26.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa61e7f5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180c7570 con 0x7fa6180cbc00 2023-11-04T01:36:26.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa61e7f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180ca150 con 0x7fa6180cd860 2023-11-04T01:36:26.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa61cd92640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61815ae40 0x7fa6180c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa61cd92640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61815ae40 0x7fa6180c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38656/0 (socket says 172.21.15.44:38656) 2023-11-04T01:36:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa61cd92640 1 -- 172.21.15.44:0/923028723 learned_addr learned my addr 172.21.15.44:0/923028723 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa617fff640 1 --2- 172.21.15.44:0/923028723 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa6180cbc00 0x7fa6180c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa6177fe640 1 --2- 172.21.15.44:0/923028723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6180cd860 0x7fa6180c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa61cd92640 1 -- 172.21.15.44:0/923028723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6180cd860 msgr2=0x7fa6180c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa61cd92640 1 --2- 172.21.15.44:0/923028723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6180cd860 0x7fa6180c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa61cd92640 1 -- 172.21.15.44:0/923028723 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa6180cbc00 msgr2=0x7fa6180c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa61cd92640 1 --2- 172.21.15.44:0/923028723 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa6180cbc00 0x7fa6180c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa61cd92640 1 -- 172.21.15.44:0/923028723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6080094d0 con 0x7fa61815ae40 2023-11-04T01:36:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa617fff640 1 --2- 172.21.15.44:0/923028723 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa6180cbc00 0x7fa6180c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.454+0000 7fa61cd92640 1 --2- 172.21.15.44:0/923028723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61815ae40 0x7fa6180c7030 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa61000c7d0 tx=0x7fa61000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:26.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.455+0000 7fa614ff9640 1 -- 172.21.15.44:0/923028723 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610003b70 con 0x7fa61815ae40 2023-11-04T01:36:26.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.455+0000 7fa614ff9640 1 -- 172.21.15.44:0/923028723 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa610003cf0 con 0x7fa61815ae40 2023-11-04T01:36:26.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.455+0000 7fa61e7f5640 1 -- 172.21.15.44:0/923028723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6180ca430 con 0x7fa61815ae40 2023-11-04T01:36:26.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.455+0000 7fa614ff9640 1 -- 172.21.15.44:0/923028723 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000aa90 con 0x7fa61815ae40 2023-11-04T01:36:26.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.455+0000 7fa61e7f5640 1 -- 172.21.15.44:0/923028723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6180c5c30 con 0x7fa61815ae40 2023-11-04T01:36:26.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.456+0000 7fa61e7f5640 1 -- 172.21.15.44:0/923028723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6180ce2d0 con 0x7fa61815ae40 2023-11-04T01:36:26.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.456+0000 7fa614ff9640 1 -- 172.21.15.44:0/923028723 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa61000abf0 con 0x7fa61815ae40 2023-11-04T01:36:26.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.456+0000 7fa614ff9640 1 --2- 172.21.15.44:0/923028723 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa60406ae70 0x7fa60406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.457+0000 7fa614ff9640 1 -- 172.21.15.44:0/923028723 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa610089530 con 0x7fa61815ae40 2023-11-04T01:36:26.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.457+0000 7fa617fff640 1 --2- 172.21.15.44:0/923028723 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa60406ae70 0x7fa60406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.457+0000 7fa617fff640 1 --2- 172.21.15.44:0/923028723 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa60406ae70 0x7fa60406d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa608036000 tx=0x7fa60803b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:26.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.461+0000 7fa614ff9640 1 -- 172.21.15.44:0/923028723 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa610054380 con 0x7fa61815ae40 2023-11-04T01:36:26.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.636+0000 7fa61e7f5640 1 -- 172.21.15.44:0/923028723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6180cc450 con 0x7fa61815ae40 2023-11-04T01:36:26.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.638+0000 7fa614ff9640 1 -- 172.21.15.44:0/923028723 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fa6180cc450 con 0x7fa61815ae40 2023-11-04T01:36:26.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:26.640 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:03.589395+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:26.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.639+0000 7fa61e7f5640 1 -- 172.21.15.44:0/923028723 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa60406ae70 msgr2=0x7fa60406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.639+0000 7fa61e7f5640 1 --2- 172.21.15.44:0/923028723 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa60406ae70 0x7fa60406d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa608036000 tx=0x7fa60803b040 comp rx=0 tx=0).stop 2023-11-04T01:36:26.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.639+0000 7fa61e7f5640 1 -- 172.21.15.44:0/923028723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61815ae40 msgr2=0x7fa6180c7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.639+0000 7fa61e7f5640 1 --2- 172.21.15.44:0/923028723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61815ae40 0x7fa6180c7030 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa61000c7d0 tx=0x7fa61000cc90 comp rx=0 tx=0).stop 2023-11-04T01:36:26.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.639+0000 7fa61e7f5640 1 -- 172.21.15.44:0/923028723 shutdown_connections 2023-11-04T01:36:26.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.639+0000 7fa61e7f5640 1 --2- 172.21.15.44:0/923028723 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa60406ae70 0x7fa60406d330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.639+0000 7fa61e7f5640 1 --2- 172.21.15.44:0/923028723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61815ae40 0x7fa6180c7030 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.639+0000 7fa61e7f5640 1 --2- 172.21.15.44:0/923028723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6180cd860 0x7fa6180c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.639+0000 7fa61e7f5640 1 --2- 172.21.15.44:0/923028723 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa6180cbc00 0x7fa6180c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.639+0000 7fa61e7f5640 1 -- 172.21.15.44:0/923028723 >> 172.21.15.44:0/923028723 conn(0x7fa61806ea90 msgr2=0x7fa6180b63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:26.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.640+0000 7fa61e7f5640 1 -- 172.21.15.44:0/923028723 shutdown_connections 2023-11-04T01:36:26.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.640+0000 7fa61e7f5640 1 -- 172.21.15.44:0/923028723 wait complete. 2023-11-04T01:36:26.654 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:26.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.759+0000 7f023d461640 1 Processor -- start 2023-11-04T01:36:26.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.759+0000 7f023d461640 1 -- start start 2023-11-04T01:36:26.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.760+0000 7f023d461640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f023815ae40 0x7f023815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.760+0000 7f023d461640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f02380cbc00 0x7f02380cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.760+0000 7f023d461640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02380cc450 con 0x7f02380cd860 2023-11-04T01:36:26.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.760+0000 7f023d461640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023815f400 con 0x7f02380cbc00 2023-11-04T01:36:26.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.760+0000 7f023d461640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023815b220 con 0x7f023815ae40 2023-11-04T01:36:26.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.760+0000 7f02367fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f02380cbc00 0x7f02380cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.760+0000 7f02377fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f02380cd860 0x7f02380b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47466/0 (socket says 172.21.15.44:47466) 2023-11-04T01:36:26.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.760+0000 7f02377fe640 1 -- 172.21.15.44:0/1053627993 learned_addr learned my addr 172.21.15.44:0/1053627993 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:26.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.760+0000 7f0236ffd640 1 --2- 172.21.15.44:0/1053627993 >> v2:172.21.15.204:3300/0 conn(0x7f023815ae40 0x7f023815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.760+0000 7f02367fc640 1 -- 172.21.15.44:0/1053627993 >> v2:172.21.15.204:3300/0 conn(0x7f023815ae40 msgr2=0x7f023815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:26.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.760+0000 7f02367fc640 1 --2- 172.21.15.44:0/1053627993 >> v2:172.21.15.204:3300/0 conn(0x7f023815ae40 0x7f023815bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.760+0000 7f02367fc640 1 -- 172.21.15.44:0/1053627993 >> v1:172.21.15.44:6789/0 conn(0x7f02380cd860 legacy=0x7f02380b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.760+0000 7f02367fc640 1 -- 172.21.15.44:0/1053627993 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023815f890 con 0x7f02380cbc00 2023-11-04T01:36:26.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.761+0000 7f02367fc640 1 --2- 172.21.15.44:0/1053627993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02380cbc00 0x7f02380cd320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f023806e580 tx=0x7f022c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4a0fb789763ed8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:26.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.761+0000 7f0235ffb640 1 -- 172.21.15.44:0/1053627993 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c031830 con 0x7f02380cbc00 2023-11-04T01:36:26.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.761+0000 7f0235ffb640 1 -- 172.21.15.44:0/1053627993 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c031990 con 0x7f02380cbc00 2023-11-04T01:36:26.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.761+0000 7f0235ffb640 1 -- 172.21.15.44:0/1053627993 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c031d20 con 0x7f02380cbc00 2023-11-04T01:36:26.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.762+0000 7f023d461640 1 -- 172.21.15.44:0/1053627993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02380cbc00 msgr2=0x7f02380cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.762+0000 7f023d461640 1 --2- 172.21.15.44:0/1053627993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02380cbc00 0x7f02380cd320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f023806e580 tx=0x7f022c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.762+0000 7f023d461640 1 -- 172.21.15.44:0/1053627993 shutdown_connections 2023-11-04T01:36:26.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.762+0000 7f023d461640 1 --2- 172.21.15.44:0/1053627993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02380cbc00 0x7f02380cd320 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.762+0000 7f023d461640 1 --2- 172.21.15.44:0/1053627993 >> v2:172.21.15.204:3300/0 conn(0x7f023815ae40 0x7f023815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.762+0000 7f023d461640 1 -- 172.21.15.44:0/1053627993 >> 172.21.15.44:0/1053627993 conn(0x7f023806ea90 msgr2=0x7f023806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:26.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.762+0000 7f023d461640 1 -- 172.21.15.44:0/1053627993 shutdown_connections 2023-11-04T01:36:26.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.762+0000 7f023d461640 1 -- 172.21.15.44:0/1053627993 wait complete. 2023-11-04T01:36:26.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.763+0000 7f023d461640 1 Processor -- start 2023-11-04T01:36:26.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.763+0000 7f023d461640 1 -- start start 2023-11-04T01:36:26.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f023d461640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02380cbc00 0x7f02381536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f023d461640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02380cd860 0x7f02380c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f023d461640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f023815ae40 0x7f0238156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f023d461640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380c7120 con 0x7f02380cbc00 2023-11-04T01:36:26.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f023d461640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0238153d40 con 0x7f023815ae40 2023-11-04T01:36:26.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f023d461640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02380c8be0 con 0x7f02380cd860 2023-11-04T01:36:26.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f0236ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02380cbc00 0x7f02381536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f0236ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02380cbc00 0x7f02381536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38672/0 (socket says 172.21.15.44:38672) 2023-11-04T01:36:26.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f0236ffd640 1 -- 172.21.15.44:0/1697352571 learned_addr learned my addr 172.21.15.44:0/1697352571 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:26.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f02377fe640 1 --2- 172.21.15.44:0/1697352571 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f023815ae40 0x7f0238156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f02367fc640 1 --2- 172.21.15.44:0/1697352571 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02380cd860 0x7f02380c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f0236ffd640 1 -- 172.21.15.44:0/1697352571 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02380cd860 msgr2=0x7f02380c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f0236ffd640 1 --2- 172.21.15.44:0/1697352571 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02380cd860 0x7f02380c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f0236ffd640 1 -- 172.21.15.44:0/1697352571 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f023815ae40 msgr2=0x7f0238156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f0236ffd640 1 --2- 172.21.15.44:0/1697352571 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f023815ae40 0x7f0238156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f0236ffd640 1 -- 172.21.15.44:0/1697352571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c009400 con 0x7f02380cbc00 2023-11-04T01:36:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f02377fe640 1 --2- 172.21.15.44:0/1697352571 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f023815ae40 0x7f0238156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.764+0000 7f0236ffd640 1 --2- 172.21.15.44:0/1697352571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02380cbc00 0x7f02381536d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f022800efc0 tx=0x7f022800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.765+0000 7f021f7fe640 1 -- 172.21.15.44:0/1697352571 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228009b80 con 0x7f02380cbc00 2023-11-04T01:36:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.765+0000 7f021f7fe640 1 -- 172.21.15.44:0/1697352571 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022800f040 con 0x7f02380cbc00 2023-11-04T01:36:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.765+0000 7f023d461640 1 -- 172.21.15.44:0/1697352571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02380c6b60 con 0x7f02380cbc00 2023-11-04T01:36:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.765+0000 7f021f7fe640 1 -- 172.21.15.44:0/1697352571 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02280146a0 con 0x7f02380cbc00 2023-11-04T01:36:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.765+0000 7f023d461640 1 -- 172.21.15.44:0/1697352571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02380c8870 con 0x7f02380cbc00 2023-11-04T01:36:26.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.766+0000 7f023d461640 1 -- 172.21.15.44:0/1697352571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02380ce2d0 con 0x7f02380cbc00 2023-11-04T01:36:26.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.766+0000 7f021f7fe640 1 -- 172.21.15.44:0/1697352571 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0228014800 con 0x7f02380cbc00 2023-11-04T01:36:26.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.766+0000 7f021f7fe640 1 --2- 172.21.15.44:0/1697352571 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f022406ae70 0x7f022406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.767+0000 7f021f7fe640 1 -- 172.21.15.44:0/1697352571 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f022808a430 con 0x7f02380cbc00 2023-11-04T01:36:26.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.767+0000 7f02367fc640 1 --2- 172.21.15.44:0/1697352571 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f022406ae70 0x7f022406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.767+0000 7f02367fc640 1 --2- 172.21.15.44:0/1697352571 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f022406ae70 0x7f022406d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f022c036000 tx=0x7f022c03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:26.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.771+0000 7f021f7fe640 1 -- 172.21.15.44:0/1697352571 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02280551f0 con 0x7f02380cbc00 2023-11-04T01:36:26.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.983+0000 7f023d461640 1 -- 172.21.15.44:0/1697352571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02380c86d0 con 0x7f02380cbc00 2023-11-04T01:36:26.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.984+0000 7f021f7fe640 1 -- 172.21.15.44:0/1697352571 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f02380c86d0 con 0x7f02380cbc00 2023-11-04T01:36:26.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:26.986 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2760874964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2760874964},{"type":"v1","addr":"172.21.15.204:6836","nonce":2760874964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3427243577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3427243577},{"type":"v1","addr":"172.21.15.44:6833","nonce":3427243577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/178191500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":178191500},{"type":"v1","addr":"172.21.15.204:6837","nonce":178191500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:58.556492+0000","modified":"2023-11-04T01:36:15.592459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/240936603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":240936603},{"type":"v1","addr":"172.21.15.44:6835","nonce":240936603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:36:26.986 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2023-11-04T01:36:26.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.986+0000 7f023d461640 1 -- 172.21.15.44:0/1697352571 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f022406ae70 msgr2=0x7f022406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.986+0000 7f023d461640 1 --2- 172.21.15.44:0/1697352571 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f022406ae70 0x7f022406d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f022c036000 tx=0x7f022c03c040 comp rx=0 tx=0).stop 2023-11-04T01:36:26.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.986+0000 7f023d461640 1 -- 172.21.15.44:0/1697352571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02380cbc00 msgr2=0x7f02381536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.986+0000 7f023d461640 1 --2- 172.21.15.44:0/1697352571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02380cbc00 0x7f02381536d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f022800efc0 tx=0x7f022800c490 comp rx=0 tx=0).stop 2023-11-04T01:36:26.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.986+0000 7f023d461640 1 -- 172.21.15.44:0/1697352571 shutdown_connections 2023-11-04T01:36:26.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.986+0000 7f023d461640 1 --2- 172.21.15.44:0/1697352571 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f022406ae70 0x7f022406d330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.986+0000 7f023d461640 1 --2- 172.21.15.44:0/1697352571 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f023815ae40 0x7f0238156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.986+0000 7f023d461640 1 --2- 172.21.15.44:0/1697352571 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02380cd860 0x7f02380c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.986+0000 7f023d461640 1 --2- 172.21.15.44:0/1697352571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02380cbc00 0x7f02381536d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.986+0000 7f023d461640 1 -- 172.21.15.44:0/1697352571 >> 172.21.15.44:0/1697352571 conn(0x7f023806ea90 msgr2=0x7f023815bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:26.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.986+0000 7f023d461640 1 -- 172.21.15.44:0/1697352571 shutdown_connections 2023-11-04T01:36:26.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:26.986+0000 7f023d461640 1 -- 172.21.15.44:0/1697352571 wait complete. 2023-11-04T01:36:27.402 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:35:58.556492+0000', 'modified': '2023-11-04T01:36:15.592459+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/240936603', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 240936603}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 240936603}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:36:27.402 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:36:27.402 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:36:27.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.513+0000 7f0242565640 1 Processor -- start 2023-11-04T01:36:27.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.513+0000 7f0242565640 1 -- start start 2023-11-04T01:36:27.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f0242565640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f023c160430 0x7f023c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f0242565640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f023c0b2b60 0x7f023c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f0242565640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f023c06c1d0 0x7f023c160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f0242565640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023c0cb580 con 0x7f023c0b2b60 2023-11-04T01:36:27.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f0242565640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023c0b2fc0 con 0x7f023c160430 2023-11-04T01:36:27.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f0242565640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023c06ca40 con 0x7f023c06c1d0 2023-11-04T01:36:27.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f023b7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f023c0b2b60 0x7f023c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f023b7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f023c0b2b60 0x7f023c06bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38682/0 (socket says 172.21.15.44:38682) 2023-11-04T01:36:27.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f023b7fe640 1 -- 172.21.15.44:0/1872314448 learned_addr learned my addr 172.21.15.44:0/1872314448 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:27.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f0240b02640 1 --2- 172.21.15.44:0/1872314448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f023c06c1d0 0x7f023c160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f023bfff640 1 --2- 172.21.15.44:0/1872314448 >> v2:172.21.15.204:3300/0 conn(0x7f023c160430 0x7f023c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f023b7fe640 1 -- 172.21.15.44:0/1872314448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f023c06c1d0 msgr2=0x7f023c160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f023b7fe640 1 --2- 172.21.15.44:0/1872314448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f023c06c1d0 0x7f023c160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f023b7fe640 1 -- 172.21.15.44:0/1872314448 >> v2:172.21.15.204:3300/0 conn(0x7f023c160430 msgr2=0x7f023c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f023b7fe640 1 --2- 172.21.15.44:0/1872314448 >> v2:172.21.15.204:3300/0 conn(0x7f023c160430 0x7f023c0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f023b7fe640 1 -- 172.21.15.44:0/1872314448 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c06cd20 con 0x7f023c0b2b60 2023-11-04T01:36:27.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f0240b02640 1 --2- 172.21.15.44:0/1872314448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f023c06c1d0 0x7f023c160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:27.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.514+0000 7f023bfff640 1 --2- 172.21.15.44:0/1872314448 >> v2:172.21.15.204:3300/0 conn(0x7f023c160430 0x7f023c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:27.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.515+0000 7f023b7fe640 1 --2- 172.21.15.44:0/1872314448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023c0b2b60 0x7f023c06bc90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f023c06f6d0 tx=0x7f023002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a5a37d848ad2a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.515+0000 7f023affd640 1 -- 172.21.15.44:0/1872314448 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230031860 con 0x7f023c0b2b60 2023-11-04T01:36:27.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.515+0000 7f023affd640 1 -- 172.21.15.44:0/1872314448 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02300319c0 con 0x7f023c0b2b60 2023-11-04T01:36:27.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.515+0000 7f023affd640 1 -- 172.21.15.44:0/1872314448 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230031d50 con 0x7f023c0b2b60 2023-11-04T01:36:27.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.515+0000 7f0242565640 1 -- 172.21.15.44:0/1872314448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023c0b2b60 msgr2=0x7f023c06bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.515+0000 7f0242565640 1 --2- 172.21.15.44:0/1872314448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023c0b2b60 0x7f023c06bc90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f023c06f6d0 tx=0x7f023002b900 comp rx=0 tx=0).stop 2023-11-04T01:36:27.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.515+0000 7f0242565640 1 -- 172.21.15.44:0/1872314448 shutdown_connections 2023-11-04T01:36:27.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.516+0000 7f0242565640 1 --2- 172.21.15.44:0/1872314448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f023c06c1d0 0x7f023c160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.516+0000 7f0242565640 1 --2- 172.21.15.44:0/1872314448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023c0b2b60 0x7f023c06bc90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.516+0000 7f0242565640 1 --2- 172.21.15.44:0/1872314448 >> v2:172.21.15.204:3300/0 conn(0x7f023c160430 0x7f023c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.516+0000 7f0242565640 1 -- 172.21.15.44:0/1872314448 >> 172.21.15.44:0/1872314448 conn(0x7f023c06ea20 msgr2=0x7f023c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:27.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.516+0000 7f0242565640 1 -- 172.21.15.44:0/1872314448 shutdown_connections 2023-11-04T01:36:27.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.516+0000 7f0242565640 1 -- 172.21.15.44:0/1872314448 wait complete. 2023-11-04T01:36:27.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.517+0000 7f0242565640 1 Processor -- start 2023-11-04T01:36:27.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.517+0000 7f0242565640 1 -- start start 2023-11-04T01:36:27.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0242565640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f023c06c1d0 0x7f023c0b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0242565640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f023c0b2b60 0x7f023c0ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0242565640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023c160430 0x7f023c0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0242565640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c1f3c20 con 0x7f023c160430 2023-11-04T01:36:27.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0242565640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c1f6210 con 0x7f023c0b2b60 2023-11-04T01:36:27.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0242565640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023c1f64f0 con 0x7f023c06c1d0 2023-11-04T01:36:27.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0240b02640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023c160430 0x7f023c0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0240b02640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023c160430 0x7f023c0cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38684/0 (socket says 172.21.15.44:38684) 2023-11-04T01:36:27.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0240b02640 1 -- 172.21.15.44:0/1785089642 learned_addr learned my addr 172.21.15.44:0/1785089642 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:27.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f023bfff640 1 --2- 172.21.15.44:0/1785089642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f023c06c1d0 0x7f023c0b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f023b7fe640 1 --2- 172.21.15.44:0/1785089642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f023c0b2b60 0x7f023c0ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0240b02640 1 -- 172.21.15.44:0/1785089642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f023c06c1d0 msgr2=0x7f023c0b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0240b02640 1 --2- 172.21.15.44:0/1785089642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f023c06c1d0 0x7f023c0b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0240b02640 1 -- 172.21.15.44:0/1785089642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f023c0b2b60 msgr2=0x7f023c0ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0240b02640 1 --2- 172.21.15.44:0/1785089642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f023c0b2b60 0x7f023c0ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0240b02640 1 -- 172.21.15.44:0/1785089642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02300094d0 con 0x7f023c160430 2023-11-04T01:36:27.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f023b7fe640 1 --2- 172.21.15.44:0/1785089642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f023c0b2b60 0x7f023c0ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:27.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0240b02640 1 --2- 172.21.15.44:0/1785089642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023c160430 0x7f023c0cd140 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f023400cd10 tx=0x7f023400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0238ff9640 1 -- 172.21.15.44:0/1785089642 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023400f680 con 0x7f023c160430 2023-11-04T01:36:27.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0238ff9640 1 -- 172.21.15.44:0/1785089642 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023400f800 con 0x7f023c160430 2023-11-04T01:36:27.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.518+0000 7f0238ff9640 1 -- 172.21.15.44:0/1785089642 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023400fbb0 con 0x7f023c160430 2023-11-04T01:36:27.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.519+0000 7f0242565640 1 -- 172.21.15.44:0/1785089642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023c1f67d0 con 0x7f023c160430 2023-11-04T01:36:27.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.519+0000 7f0242565640 1 -- 172.21.15.44:0/1785089642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023c1f6d90 con 0x7f023c160430 2023-11-04T01:36:27.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.520+0000 7f0238ff9640 1 -- 172.21.15.44:0/1785089642 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f023400b040 con 0x7f023c160430 2023-11-04T01:36:27.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.520+0000 7f0238ff9640 1 --2- 172.21.15.44:0/1785089642 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f022806aea0 0x7f022806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.521+0000 7f0238ff9640 1 -- 172.21.15.44:0/1785089642 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f023408a270 con 0x7f023c160430 2023-11-04T01:36:27.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.521+0000 7f023bfff640 1 --2- 172.21.15.44:0/1785089642 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f022806aea0 0x7f022806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.521+0000 7f023bfff640 1 --2- 172.21.15.44:0/1785089642 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f022806aea0 0x7f022806d360 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f023c0cd850 tx=0x7f022c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.521+0000 7f02451ce740 1 Processor -- start 2023-11-04T01:36:27.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.521+0000 7f02451ce740 1 -- start start 2023-11-04T01:36:27.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.522+0000 7f02451ce740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb423850 0x561beb3f6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.522+0000 7f02451ce740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423c30 0x561beb4265e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.522+0000 7f02451ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb3f6c90 0x561beb426b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.522+0000 7f02451ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x561beb307740 con 0x561beb3f6c90 2023-11-04T01:36:27.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.522+0000 7f02451ce740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x561beb3698d0 con 0x561beb423c30 2023-11-04T01:36:27.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.522+0000 7f02451ce740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x561beb366fc0 con 0x561beb423850 2023-11-04T01:36:27.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.522+0000 7f0240b02640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb3f6c90 0x561beb426b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.522+0000 7f0240b02640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb3f6c90 0x561beb426b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38688/0 (socket says 172.21.15.44:38688) 2023-11-04T01:36:27.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.522+0000 7f0240b02640 1 -- 172.21.15.44:0/1010214646 learned_addr learned my addr 172.21.15.44:0/1010214646 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:27.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.522+0000 7f023bfff640 1 --2- 172.21.15.44:0/1010214646 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb423850 0x561beb3f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.522+0000 7f023b7fe640 1 --2- 172.21.15.44:0/1010214646 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423c30 0x561beb4265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.523+0000 7f0240b02640 1 -- 172.21.15.44:0/1010214646 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb423850 msgr2=0x561beb3f6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.523+0000 7f0240b02640 1 --2- 172.21.15.44:0/1010214646 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb423850 0x561beb3f6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.523+0000 7f0240b02640 1 -- 172.21.15.44:0/1010214646 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423c30 msgr2=0x561beb4265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.523+0000 7f0240b02640 1 --2- 172.21.15.44:0/1010214646 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423c30 0x561beb4265e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.523+0000 7f0240b02640 1 -- 172.21.15.44:0/1010214646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561beb325ca0 con 0x561beb3f6c90 2023-11-04T01:36:27.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.523+0000 7f0240b02640 1 --2- 172.21.15.44:0/1010214646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb3f6c90 0x561beb426b20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0234055150 tx=0x7f023408a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189b19b27afc1ffd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.523+0000 7f0221ffb640 1 -- 172.21.15.44:0/1010214646 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023405cda0 con 0x561beb3f6c90 2023-11-04T01:36:27.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.523+0000 7f0221ffb640 1 -- 172.21.15.44:0/1010214646 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0234060f50 con 0x561beb3f6c90 2023-11-04T01:36:27.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.523+0000 7f0221ffb640 1 -- 172.21.15.44:0/1010214646 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023400fd10 con 0x561beb3f6c90 2023-11-04T01:36:27.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.523+0000 7f02451ce740 1 -- 172.21.15.44:0/1010214646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb3f6c90 msgr2=0x561beb426b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.523+0000 7f02451ce740 1 --2- 172.21.15.44:0/1010214646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb3f6c90 0x561beb426b20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0234055150 tx=0x7f023408a050 comp rx=0 tx=0).stop 2023-11-04T01:36:27.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.524+0000 7f02451ce740 1 -- 172.21.15.44:0/1010214646 shutdown_connections 2023-11-04T01:36:27.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.524+0000 7f02451ce740 1 --2- 172.21.15.44:0/1010214646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb3f6c90 0x561beb426b20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.524+0000 7f02451ce740 1 --2- 172.21.15.44:0/1010214646 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423c30 0x561beb4265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.524+0000 7f02451ce740 1 --2- 172.21.15.44:0/1010214646 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb423850 0x561beb3f6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.524+0000 7f02451ce740 1 -- 172.21.15.44:0/1010214646 >> 172.21.15.44:0/1010214646 conn(0x561beb3f8a60 msgr2=0x561beb4415e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:27.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.524+0000 7f02451ce740 1 -- 172.21.15.44:0/1010214646 shutdown_connections 2023-11-04T01:36:27.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.524+0000 7f02451ce740 1 -- 172.21.15.44:0/1010214646 wait complete. 2023-11-04T01:36:27.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.524+0000 7f02451ce740 1 -- start start 2023-11-04T01:36:27.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.524+0000 7f02451ce740 1 Processor -- start 2023-11-04T01:36:27.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.525+0000 7f02451ce740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb423850 0x561beb41e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.525+0000 7f02451ce740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423c30 0x561beb41c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.525+0000 7f02451ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb41c970 0x561beb40d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.525+0000 7f02451ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x561beb3628b0 con 0x561beb41c970 2023-11-04T01:36:27.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.525+0000 7f02451ce740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x561beb31cc80 con 0x561beb423c30 2023-11-04T01:36:27.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.525+0000 7f02451ce740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x561beb31c920 con 0x561beb423850 2023-11-04T01:36:27.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.525+0000 7f02451ce740 10 client.0 _ll_register_callbacks cb 0x561beb074ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:36:27.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.525+0000 7f0240b02640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb41c970 0x561beb40d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.525+0000 7f0240b02640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb41c970 0x561beb40d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38702/0 (socket says 172.21.15.44:38702) 2023-11-04T01:36:27.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.525+0000 7f0240b02640 1 -- 172.21.15.44:0/3887279277 learned_addr learned my addr 172.21.15.44:0/3887279277 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:27.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.525+0000 7f023bfff640 1 --2- 172.21.15.44:0/3887279277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb423850 0x561beb41e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.525+0000 7f023b7fe640 1 --2- 172.21.15.44:0/3887279277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423c30 0x561beb41c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f0240b02640 1 -- 172.21.15.44:0/3887279277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb423850 msgr2=0x561beb41e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f0240b02640 1 --2- 172.21.15.44:0/3887279277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb423850 0x561beb41e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f0240b02640 1 -- 172.21.15.44:0/3887279277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423c30 msgr2=0x561beb41c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f0240b02640 1 --2- 172.21.15.44:0/3887279277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423c30 0x561beb41c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f0240b02640 1 -- 172.21.15.44:0/3887279277 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023c1f6d90 con 0x561beb41c970 2023-11-04T01:36:27.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f0240b02640 1 --2- 172.21.15.44:0/3887279277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb41c970 0x561beb40d220 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f023406e040 tx=0x7f023400af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b940479371831a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f021affd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:36:27.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f021affd640 1 -- 172.21.15.44:0/3887279277 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234058340 con 0x561beb41c970 2023-11-04T01:36:27.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f021affd640 1 -- 172.21.15.44:0/3887279277 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0234088100 con 0x561beb41c970 2023-11-04T01:36:27.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f02451ce740 1 -- 172.21.15.44:0/3887279277 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561beb30ebf0 con 0x561beb41c970 2023-11-04T01:36:27.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f021affd640 1 -- 172.21.15.44:0/3887279277 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f023405cda0 con 0x561beb41c970 2023-11-04T01:36:27.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f02451ce740 10 client.4848 fetch_fsmap learned FSMap version 9 2023-11-04T01:36:27.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f02451ce740 1 -- 172.21.15.44:0/3887279277 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x561beb360f30 con 0x561beb41c970 2023-11-04T01:36:27.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f021affd640 1 -- 172.21.15.44:0/3887279277 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561beb30ebf0 con 0x561beb41c970 2023-11-04T01:36:27.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f021affd640 1 -- 172.21.15.44:0/3887279277 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f023407b070 con 0x561beb41c970 2023-11-04T01:36:27.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f02451ce740 10 client.4848 fetch_fsmap finished waiting for FSMap version 9 2023-11-04T01:36:27.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f02451ce740 10 client.4848 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:36:27.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f02451ce740 20 client.4848 populate_metadata read hostname 'smithi044' 2023-11-04T01:36:27.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f02451ce740 1 --2- 172.21.15.44:0/3887279277 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x561beb455360 0x561beb424d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f02451ce740 4 client.4848 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.526+0000 7f02451ce740 1 -- 172.21.15.44:0/3887279277 --> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561beb35b890 con 0x561beb455360 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.527+0000 7f023bfff640 1 --2- 172.21.15.44:0/3887279277 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x561beb455360 0x561beb424d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.527+0000 7f021affd640 10 client.4848 ms_handle_connect on v2:172.21.15.44:6834/240936603 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.527+0000 7f023bfff640 1 --2- 172.21.15.44:0/3887279277 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x561beb455360 0x561beb424d70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f2d1e16197097a3 server_cookie=37b065e9dd24f010 in_seq=0 out_seq=0 2023-11-04T01:36:27.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.527+0000 7f021affd640 1 -- 172.21.15.44:0/3887279277 <== mds.0 v2:172.21.15.44:6834/240936603 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561beb35b890 con 0x561beb455360 2023-11-04T01:36:27.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.527+0000 7f021affd640 10 client.4848 handle_command_reply: tid=0 2023-11-04T01:36:27.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.527+0000 7f02451ce740 1 client.4848 shutdown 2023-11-04T01:36:27.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.528+0000 7f02451ce740 1 -- 172.21.15.44:0/3887279277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb41c970 msgr2=0x561beb40d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.528+0000 7f02451ce740 1 --2- 172.21.15.44:0/3887279277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb41c970 0x561beb40d220 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f023406e040 tx=0x7f023400af70 comp rx=0 tx=0).stop 2023-11-04T01:36:27.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.528+0000 7f02451ce740 1 -- 172.21.15.44:0/3887279277 shutdown_connections 2023-11-04T01:36:27.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.528+0000 7f02451ce740 1 --2- 172.21.15.44:0/3887279277 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x561beb455360 0x561beb424d70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.528+0000 7f02451ce740 1 --2- 172.21.15.44:0/3887279277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb41c970 0x561beb40d220 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.528+0000 7f02451ce740 1 --2- 172.21.15.44:0/3887279277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423c30 0x561beb41c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.528+0000 7f021affd640 0 client.4848 ms_handle_reset on v2:172.21.15.44:6834/240936603 2023-11-04T01:36:27.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.528+0000 7f02451ce740 1 --2- 172.21.15.44:0/3887279277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb423850 0x561beb41e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.528+0000 7f02451ce740 1 -- 172.21.15.44:0/3887279277 >> 172.21.15.44:0/3887279277 conn(0x561beb3f6c90 msgr2=0x561beb3fa740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:27.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.528+0000 7f02451ce740 1 -- 172.21.15.44:0/3887279277 shutdown_connections 2023-11-04T01:36:27.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.528+0000 7f02451ce740 1 -- 172.21.15.44:0/3887279277 wait complete. 2023-11-04T01:36:27.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.528+0000 7f02451ce740 20 client.4848 trim_cache size 0 max 16384 2023-11-04T01:36:27.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.543+0000 7f02451ce740 1 Processor -- start 2023-11-04T01:36:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.544+0000 7f02451ce740 1 -- start start 2023-11-04T01:36:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.544+0000 7f02451ce740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb41c970 0x561beb41d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.544+0000 7f02451ce740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423850 0x561beb443c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.544+0000 7f02451ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb423c30 0x561beb422680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.544+0000 7f02451ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x561beb2e2280 con 0x561beb423c30 2023-11-04T01:36:27.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.544+0000 7f02451ce740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x561beb4441a0 con 0x561beb423850 2023-11-04T01:36:27.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.544+0000 7f02451ce740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x561beb41bf50 con 0x561beb41c970 2023-11-04T01:36:27.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.544+0000 7f0240b02640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb423c30 0x561beb422680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.544+0000 7f0240b02640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb423c30 0x561beb422680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38718/0 (socket says 172.21.15.44:38718) 2023-11-04T01:36:27.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.544+0000 7f0240b02640 1 -- 172.21.15.44:0/532580826 learned_addr learned my addr 172.21.15.44:0/532580826 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:27.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.544+0000 7f023bfff640 1 --2- 172.21.15.44:0/532580826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb41c970 0x561beb41d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f023b7fe640 1 --2- 172.21.15.44:0/532580826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423850 0x561beb443c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f0240b02640 1 -- 172.21.15.44:0/532580826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb41c970 msgr2=0x561beb41d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f0240b02640 1 --2- 172.21.15.44:0/532580826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb41c970 0x561beb41d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f0240b02640 1 -- 172.21.15.44:0/532580826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423850 msgr2=0x561beb443c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f0240b02640 1 --2- 172.21.15.44:0/532580826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423850 0x561beb443c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f0240b02640 1 -- 172.21.15.44:0/532580826 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561beb2fed10 con 0x561beb423c30 2023-11-04T01:36:27.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f0240b02640 1 --2- 172.21.15.44:0/532580826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb423c30 0x561beb422680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0234060a20 tx=0x7f0234011040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe938191122ba0a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f02227fc640 1 -- 172.21.15.44:0/532580826 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023405cda0 con 0x561beb423c30 2023-11-04T01:36:27.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f02227fc640 1 -- 172.21.15.44:0/532580826 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0234060d10 con 0x561beb423c30 2023-11-04T01:36:27.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f02227fc640 1 -- 172.21.15.44:0/532580826 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02340593d0 con 0x561beb423c30 2023-11-04T01:36:27.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f02451ce740 1 -- 172.21.15.44:0/532580826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb423c30 msgr2=0x561beb422680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f02451ce740 1 --2- 172.21.15.44:0/532580826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb423c30 0x561beb422680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0234060a20 tx=0x7f0234011040 comp rx=0 tx=0).stop 2023-11-04T01:36:27.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f02451ce740 1 -- 172.21.15.44:0/532580826 shutdown_connections 2023-11-04T01:36:27.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f02451ce740 1 --2- 172.21.15.44:0/532580826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb423c30 0x561beb422680 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f02451ce740 1 --2- 172.21.15.44:0/532580826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423850 0x561beb443c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f02451ce740 1 --2- 172.21.15.44:0/532580826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb41c970 0x561beb41d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f02451ce740 1 -- 172.21.15.44:0/532580826 >> 172.21.15.44:0/532580826 conn(0x561beb3f6c90 msgr2=0x561beb424010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:27.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.545+0000 7f02451ce740 1 -- 172.21.15.44:0/532580826 shutdown_connections 2023-11-04T01:36:27.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.546+0000 7f02451ce740 1 -- 172.21.15.44:0/532580826 wait complete. 2023-11-04T01:36:27.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.546+0000 7f02451ce740 1 -- start start 2023-11-04T01:36:27.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.546+0000 7f02451ce740 1 Processor -- start 2023-11-04T01:36:27.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f02451ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb41c970 0x561beb422960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f02451ce740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb423850 0x561beb4abb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f02451ce740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423c30 0x561beb424d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f02451ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x561beb426a00 con 0x561beb41c970 2023-11-04T01:36:27.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f02451ce740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x561beb4ac090 con 0x561beb423c30 2023-11-04T01:36:27.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f02451ce740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x561beb4ae7f0 con 0x561beb423850 2023-11-04T01:36:27.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f02451ce740 10 client.0 _ll_register_callbacks cb 0x7f0234007960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:36:27.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f023bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb41c970 0x561beb422960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f023bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb41c970 0x561beb422960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38732/0 (socket says 172.21.15.44:38732) 2023-11-04T01:36:27.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f023bfff640 1 -- 172.21.15.44:0/243559627 learned_addr learned my addr 172.21.15.44:0/243559627 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:27.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f023b7fe640 1 --2- 172.21.15.44:0/243559627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb423850 0x561beb4abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f0240b02640 1 --2- 172.21.15.44:0/243559627 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423c30 0x561beb424d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f023bfff640 1 -- 172.21.15.44:0/243559627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb423850 msgr2=0x561beb4abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f023bfff640 1 --2- 172.21.15.44:0/243559627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb423850 0x561beb4abb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f023bfff640 1 -- 172.21.15.44:0/243559627 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423c30 msgr2=0x561beb424d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f023bfff640 1 --2- 172.21.15.44:0/243559627 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423c30 0x561beb424d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.547+0000 7f023bfff640 1 -- 172.21.15.44:0/243559627 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561beb360f30 con 0x561beb41c970 2023-11-04T01:36:27.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f023bfff640 1 --2- 172.21.15.44:0/243559627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb41c970 0x561beb422960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f022c00f800 tx=0x7f022c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ca1f3d466b2ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f021affd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:36:27.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f021affd640 1 -- 172.21.15.44:0/243559627 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c013660 con 0x561beb41c970 2023-11-04T01:36:27.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f021affd640 1 -- 172.21.15.44:0/243559627 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f022c0137c0 con 0x561beb41c970 2023-11-04T01:36:27.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f02451ce740 1 -- 172.21.15.44:0/243559627 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0234060f50 con 0x561beb41c970 2023-11-04T01:36:27.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f021affd640 1 -- 172.21.15.44:0/243559627 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f022c013980 con 0x561beb41c970 2023-11-04T01:36:27.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f02451ce740 10 client.4854 fetch_fsmap learned FSMap version 9 2023-11-04T01:36:27.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f02451ce740 1 -- 172.21.15.44:0/243559627 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x561beb324500 con 0x561beb41c970 2023-11-04T01:36:27.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f021affd640 1 -- 172.21.15.44:0/243559627 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0234060f50 con 0x561beb41c970 2023-11-04T01:36:27.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f021affd640 1 -- 172.21.15.44:0/243559627 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f022c02c070 con 0x561beb41c970 2023-11-04T01:36:27.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f02451ce740 10 client.4854 fetch_fsmap finished waiting for FSMap version 9 2023-11-04T01:36:27.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f02451ce740 10 client.4854 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:36:27.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f02451ce740 20 client.4854 populate_metadata read hostname 'smithi044' 2023-11-04T01:36:27.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f02451ce740 1 --2- 172.21.15.44:0/243559627 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x561beb4aacf0 0x561beb425290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f02451ce740 4 client.4854 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:36:27.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f02451ce740 1 -- 172.21.15.44:0/243559627 --> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561beb35b5b0 con 0x561beb4aacf0 2023-11-04T01:36:27.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.548+0000 7f023b7fe640 1 --2- 172.21.15.44:0/243559627 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x561beb4aacf0 0x561beb425290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f023b7fe640 1 --2- 172.21.15.44:0/243559627 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x561beb4aacf0 0x561beb425290 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeb58273623b9049 server_cookie=5e117e05a48ce6d3 in_seq=0 out_seq=0 2023-11-04T01:36:27.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f021affd640 10 client.4854 ms_handle_connect on v2:172.21.15.44:6834/240936603 2023-11-04T01:36:27.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f021affd640 1 -- 172.21.15.44:0/243559627 <== mds.0 v2:172.21.15.44:6834/240936603 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x561beb35b5b0 con 0x561beb4aacf0 2023-11-04T01:36:27.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f021affd640 10 client.4854 handle_command_reply: tid=0 2023-11-04T01:36:27.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f02451ce740 1 client.4854 shutdown 2023-11-04T01:36:27.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f02451ce740 1 -- 172.21.15.44:0/243559627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb41c970 msgr2=0x561beb422960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f02451ce740 1 --2- 172.21.15.44:0/243559627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb41c970 0x561beb422960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f022c00f800 tx=0x7f022c004730 comp rx=0 tx=0).stop 2023-11-04T01:36:27.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f02451ce740 1 -- 172.21.15.44:0/243559627 shutdown_connections 2023-11-04T01:36:27.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f02451ce740 1 --2- 172.21.15.44:0/243559627 >> [v2:172.21.15.44:6834/240936603,v1:172.21.15.44:6835/240936603] conn(0x561beb4aacf0 0x561beb425290 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f02451ce740 1 --2- 172.21.15.44:0/243559627 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561beb423c30 0x561beb424d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f02451ce740 1 --2- 172.21.15.44:0/243559627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561beb423850 0x561beb4abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f021affd640 0 client.4854 ms_handle_reset on v2:172.21.15.44:6834/240936603 2023-11-04T01:36:27.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f02451ce740 1 --2- 172.21.15.44:0/243559627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561beb41c970 0x561beb422960 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f02451ce740 1 -- 172.21.15.44:0/243559627 >> 172.21.15.44:0/243559627 conn(0x561beb3f6c90 msgr2=0x561beb3fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:27.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f02451ce740 1 -- 172.21.15.44:0/243559627 shutdown_connections 2023-11-04T01:36:27.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f02451ce740 1 -- 172.21.15.44:0/243559627 wait complete. 2023-11-04T01:36:27.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.549+0000 7f02451ce740 20 client.4854 trim_cache size 0 max 16384 2023-11-04T01:36:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:36:27.576 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:36:27.576 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2023-11-04T01:36:27.576 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4290, 2023-11-04T01:36:27.576 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:36:27.576 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:36:27.576 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:36:27.576 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 28.361808488000001, 2023-11-04T01:36:27.576 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 9, 2023-11-04T01:36:27.577 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 24, 2023-11-04T01:36:27.577 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 24, 2023-11-04T01:36:27.577 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 35.3034648 2023-11-04T01:36:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:36:27.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.550+0000 7f0242565640 1 -- 172.21.15.44:0/1785089642 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f022806aea0 msgr2=0x7f022806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.550+0000 7f0242565640 1 --2- 172.21.15.44:0/1785089642 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f022806aea0 0x7f022806d360 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f023c0cd850 tx=0x7f022c008040 comp rx=0 tx=0).stop 2023-11-04T01:36:27.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.550+0000 7f0242565640 1 -- 172.21.15.44:0/1785089642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023c160430 msgr2=0x7f023c0cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.550+0000 7f0242565640 1 --2- 172.21.15.44:0/1785089642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023c160430 0x7f023c0cd140 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f023400cd10 tx=0x7f023400a650 comp rx=0 tx=0).stop 2023-11-04T01:36:27.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.550+0000 7f0242565640 1 -- 172.21.15.44:0/1785089642 shutdown_connections 2023-11-04T01:36:27.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.550+0000 7f0242565640 1 --2- 172.21.15.44:0/1785089642 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f022806aea0 0x7f022806d360 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.550+0000 7f0242565640 1 --2- 172.21.15.44:0/1785089642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023c160430 0x7f023c0cd140 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.550+0000 7f0242565640 1 --2- 172.21.15.44:0/1785089642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f023c0b2b60 0x7f023c0ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.550+0000 7f0242565640 1 --2- 172.21.15.44:0/1785089642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f023c06c1d0 0x7f023c0b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.550+0000 7f0242565640 1 -- 172.21.15.44:0/1785089642 >> 172.21.15.44:0/1785089642 conn(0x7f023c06ea20 msgr2=0x7f023c0b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:27.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.550+0000 7f0242565640 1 -- 172.21.15.44:0/1785089642 shutdown_connections 2023-11-04T01:36:27.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.550+0000 7f0242565640 1 -- 172.21.15.44:0/1785089642 wait complete. 2023-11-04T01:36:27.580 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-04T01:36:27.600 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-04T01:36:27.600 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-04T01:36:27.600 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-04T01:36:27.600 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:36:27.600 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:27.600 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-04T01:36:27.600 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:36:27.600 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:27.601 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-04T01:36:27.601 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:36:27.601 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:27.601 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-04T01:36:27.601 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:36:27.602 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:27.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:27.602 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2023-11-04T01:36:27.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-04T01:36:27.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:27.619 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:27.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:27.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2023-11-04T01:36:27.726 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:36:27.736 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:36:27.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:27.798 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2023-11-04T01:36:27.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:27.816 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link delete ceph-brx 2023-11-04T01:36:27.888 INFO:teuthology.orchestra.run.smithi204.stderr:Cannot find device "ceph-brx" 2023-11-04T01:36:27.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:36:27.890 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-04T01:36:27.890 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:36:28.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.995+0000 7f983127c640 1 Processor -- start 2023-11-04T01:36:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.996+0000 7f983127c640 1 -- start start 2023-11-04T01:36:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.996+0000 7f983127c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f982c06a830 0x7f982c0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.996+0000 7f983127c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c15dd10 con 0x7f982c0b18b0 2023-11-04T01:36:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.996+0000 7f983127c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c15d720 con 0x7f982c0cce10 2023-11-04T01:36:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.996+0000 7f983127c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982c06fe00 con 0x7f982c06a830 2023-11-04T01:36:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982b7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f982c0b18b0 0x7f982c15ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47476/0 (socket says 172.21.15.44:47476) 2023-11-04T01:36:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982b7fe640 1 -- 172.21.15.44:0/1439784032 learned_addr learned my addr 172.21.15.44:0/1439784032 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f9823fff640 1 --2- 172.21.15.44:0/1439784032 >> v2:172.21.15.204:3300/0 conn(0x7f982c06a830 0x7f982c0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982a7fc640 1 -- 172.21.15.44:0/1439784032 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460221569 0 0) 0x7f982c15dd10 con 0x7f982c0b18b0 2023-11-04T01:36:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982a7fc640 1 -- 172.21.15.44:0/1439784032 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9818003520 con 0x7f982c0b18b0 2023-11-04T01:36:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982a7fc640 1 -- 172.21.15.44:0/1439784032 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3319559152 0 0) 0x7f9818003520 con 0x7f982c0b18b0 2023-11-04T01:36:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982a7fc640 1 -- 172.21.15.44:0/1439784032 >> v2:172.21.15.204:3300/0 conn(0x7f982c06a830 msgr2=0x7f982c0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982a7fc640 1 --2- 172.21.15.44:0/1439784032 >> v2:172.21.15.204:3300/0 conn(0x7f982c06a830 0x7f982c0b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982a7fc640 1 -- 172.21.15.44:0/1439784032 >> v1:172.21.15.204:6789/0 conn(0x7f982c0cce10 legacy=0x7f982c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982a7fc640 1 -- 172.21.15.44:0/1439784032 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c0700e0 con 0x7f982c0b18b0 2023-11-04T01:36:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982a7fc640 1 -- 172.21.15.44:0/1439784032 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f98240019f0 con 0x7f982c0b18b0 2023-11-04T01:36:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982a7fc640 1 -- 172.21.15.44:0/1439784032 >> v1:172.21.15.44:6789/0 conn(0x7f982c0b18b0 legacy=0x7f982c15ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982a7fc640 1 --2- 172.21.15.44:0/1439784032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9818003970 0x7f9818003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982a7fc640 1 --2- 172.21.15.44:0/1439784032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98180047c0 0x7f9818004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982a7fc640 1 --2- 172.21.15.44:0/1439784032 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98180052a0 0x7f981800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982a7fc640 1 -- 172.21.15.44:0/1439784032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c06fe00 con 0x7f9818003970 2023-11-04T01:36:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982a7fc640 1 -- 172.21.15.44:0/1439784032 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981800c170 con 0x7f98180052a0 2023-11-04T01:36:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982a7fc640 1 -- 172.21.15.44:0/1439784032 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981800c330 con 0x7f98180047c0 2023-11-04T01:36:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.997+0000 7f982affd640 1 --2- 172.21.15.44:0/1439784032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9818003970 0x7f9818003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.998+0000 7f982b7fe640 1 --2- 172.21.15.44:0/1439784032 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98180052a0 0x7f981800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.998+0000 7f9823fff640 1 --2- 172.21.15.44:0/1439784032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98180047c0 0x7f9818004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.998+0000 7f982affd640 1 -- 172.21.15.44:0/1439784032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98180047c0 msgr2=0x7f9818004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.998+0000 7f982affd640 1 --2- 172.21.15.44:0/1439784032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98180047c0 0x7f9818004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.998+0000 7f982affd640 1 -- 172.21.15.44:0/1439784032 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98180052a0 msgr2=0x7f981800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.998+0000 7f982affd640 1 --2- 172.21.15.44:0/1439784032 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98180052a0 0x7f981800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.998+0000 7f982b7fe640 1 -- 172.21.15.44:0/1439784032 reap_dead start 2023-11-04T01:36:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.998+0000 7f982affd640 1 -- 172.21.15.44:0/1439784032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9818003520 con 0x7f9818003970 2023-11-04T01:36:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.998+0000 7f982affd640 1 --2- 172.21.15.44:0/1439784032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9818003970 0x7f9818003d90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f981c001720 tx=0x7f98180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d3d001f2abe117 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.999+0000 7f982a7fc640 1 -- 172.21.15.44:0/1439784032 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0052d0 con 0x7f9818003970 2023-11-04T01:36:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.999+0000 7f982a7fc640 1 -- 172.21.15.44:0/1439784032 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c02e050 con 0x7f9818003970 2023-11-04T01:36:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.999+0000 7f982a7fc640 1 -- 172.21.15.44:0/1439784032 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c003830 con 0x7f9818003970 2023-11-04T01:36:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.999+0000 7f983127c640 1 -- 172.21.15.44:0/1439784032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9818003970 msgr2=0x7f9818003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.999+0000 7f983127c640 1 --2- 172.21.15.44:0/1439784032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9818003970 0x7f9818003d90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f981c001720 tx=0x7f98180057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.999+0000 7f983127c640 1 -- 172.21.15.44:0/1439784032 shutdown_connections 2023-11-04T01:36:28.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.999+0000 7f983127c640 1 --2- 172.21.15.44:0/1439784032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9818003970 0x7f9818003d90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.999+0000 7f983127c640 1 -- 172.21.15.44:0/1439784032 >> 172.21.15.44:0/1439784032 conn(0x7f982c06d8b0 msgr2=0x7f982c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:28.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.999+0000 7f983127c640 1 -- 172.21.15.44:0/1439784032 shutdown_connections 2023-11-04T01:36:28.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:27.999+0000 7f983127c640 1 -- 172.21.15.44:0/1439784032 wait complete. 2023-11-04T01:36:28.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.000+0000 7f983127c640 1 Processor -- start 2023-11-04T01:36:28.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.000+0000 7f983127c640 1 -- start start 2023-11-04T01:36:28.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.001+0000 7f983127c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9818003970 0x7f982c0c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:28.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.001+0000 7f983127c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f982c0b4cd0 0x7f982c150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:28.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.001+0000 7f983127c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c0cadf0 0x7f982c0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:28.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.001+0000 7f983127c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0c9b70 con 0x7f982c0cadf0 2023-11-04T01:36:28.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.001+0000 7f983127c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0cb7b0 con 0x7f9818003970 2023-11-04T01:36:28.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.001+0000 7f983127c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0c9080 con 0x7f982c0b4cd0 2023-11-04T01:36:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.001+0000 7f982b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c0cadf0 0x7f982c0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.001+0000 7f982b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c0cadf0 0x7f982c0cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38742/0 (socket says 172.21.15.44:38742) 2023-11-04T01:36:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.001+0000 7f982b7fe640 1 -- 172.21.15.44:0/1792227169 learned_addr learned my addr 172.21.15.44:0/1792227169 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.001+0000 7f9823fff640 1 --2- 172.21.15.44:0/1792227169 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f982c0b4cd0 0x7f982c150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.002+0000 7f982affd640 1 --2- 172.21.15.44:0/1792227169 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9818003970 0x7f982c0c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.002+0000 7f982b7fe640 1 -- 172.21.15.44:0/1792227169 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f982c0b4cd0 msgr2=0x7f982c150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.002+0000 7f982b7fe640 1 --2- 172.21.15.44:0/1792227169 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f982c0b4cd0 0x7f982c150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.002+0000 7f982b7fe640 1 -- 172.21.15.44:0/1792227169 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9818003970 msgr2=0x7f982c0c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.002+0000 7f982b7fe640 1 --2- 172.21.15.44:0/1792227169 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9818003970 0x7f982c0c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.002+0000 7f982b7fe640 1 -- 172.21.15.44:0/1792227169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c0b5150 con 0x7f982c0cadf0 2023-11-04T01:36:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.002+0000 7f9823fff640 1 --2- 172.21.15.44:0/1792227169 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f982c0b4cd0 0x7f982c150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.002+0000 7f982b7fe640 1 --2- 172.21.15.44:0/1792227169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c0cadf0 0x7f982c0cb270 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f982c06ec00 tx=0x7f9824007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.002+0000 7f98237fe640 1 -- 172.21.15.44:0/1792227169 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982400aab0 con 0x7f982c0cadf0 2023-11-04T01:36:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.002+0000 7f98237fe640 1 -- 172.21.15.44:0/1792227169 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982400ac10 con 0x7f982c0cadf0 2023-11-04T01:36:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.002+0000 7f983127c640 1 -- 172.21.15.44:0/1792227169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982c0c92d0 con 0x7f982c0cadf0 2023-11-04T01:36:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.002+0000 7f98237fe640 1 -- 172.21.15.44:0/1792227169 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98240133f0 con 0x7f982c0cadf0 2023-11-04T01:36:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.002+0000 7f983127c640 1 -- 172.21.15.44:0/1792227169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c0c9890 con 0x7f982c0cadf0 2023-11-04T01:36:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.003+0000 7f983127c640 1 -- 172.21.15.44:0/1792227169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982c0b59a0 con 0x7f982c0cadf0 2023-11-04T01:36:28.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.003+0000 7f98237fe640 1 -- 172.21.15.44:0/1792227169 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9824013550 con 0x7f982c0cadf0 2023-11-04T01:36:28.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.004+0000 7f98237fe640 1 --2- 172.21.15.44:0/1792227169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f980c06ae70 0x7f980c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:28.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.004+0000 7f98237fe640 1 -- 172.21.15.44:0/1792227169 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9824089e50 con 0x7f982c0cadf0 2023-11-04T01:36:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.004+0000 7f982affd640 1 --2- 172.21.15.44:0/1792227169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f980c06ae70 0x7f980c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.005+0000 7f982affd640 1 --2- 172.21.15.44:0/1792227169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f980c06ae70 0x7f980c06d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f981c033000 tx=0x7f981c009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.008+0000 7f98237fe640 1 -- 172.21.15.44:0/1792227169 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9824054c10 con 0x7f982c0cadf0 2023-11-04T01:36:28.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.219+0000 7f983127c640 1 -- 172.21.15.44:0/1792227169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f982c15f980 con 0x7f982c0cadf0 2023-11-04T01:36:28.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.219+0000 7f98237fe640 1 -- 172.21.15.44:0/1792227169 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9824058230 con 0x7f982c0cadf0 2023-11-04T01:36:28.222 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:36:28.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.221+0000 7f983127c640 1 -- 172.21.15.44:0/1792227169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f980c06ae70 msgr2=0x7f980c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:28.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.221+0000 7f983127c640 1 --2- 172.21.15.44:0/1792227169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f980c06ae70 0x7f980c06d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f981c033000 tx=0x7f981c009030 comp rx=0 tx=0).stop 2023-11-04T01:36:28.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.221+0000 7f983127c640 1 -- 172.21.15.44:0/1792227169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c0cadf0 msgr2=0x7f982c0cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:28.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.221+0000 7f983127c640 1 --2- 172.21.15.44:0/1792227169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c0cadf0 0x7f982c0cb270 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f982c06ec00 tx=0x7f9824007b00 comp rx=0 tx=0).stop 2023-11-04T01:36:28.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.221+0000 7f983127c640 1 -- 172.21.15.44:0/1792227169 shutdown_connections 2023-11-04T01:36:28.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.221+0000 7f983127c640 1 --2- 172.21.15.44:0/1792227169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f980c06ae70 0x7f980c06d330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.221+0000 7f983127c640 1 --2- 172.21.15.44:0/1792227169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c0cadf0 0x7f982c0cb270 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.221+0000 7f983127c640 1 --2- 172.21.15.44:0/1792227169 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f982c0b4cd0 0x7f982c150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.221+0000 7f983127c640 1 --2- 172.21.15.44:0/1792227169 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9818003970 0x7f982c0c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.221+0000 7f983127c640 1 -- 172.21.15.44:0/1792227169 >> 172.21.15.44:0/1792227169 conn(0x7f982c06d8b0 msgr2=0x7f982c0afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.221+0000 7f983127c640 1 -- 172.21.15.44:0/1792227169 shutdown_connections 2023-11-04T01:36:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:28.221+0000 7f983127c640 1 -- 172.21.15.44:0/1792227169 wait complete. 2023-11-04T01:36:28.234 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:36:28.234 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:36:28.234 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2023-11-04T01:36:28.234 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:36:28.234 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:28.235 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:36:28.235 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:36:28.235 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:36:28.235 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:36:28.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.235 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2023-11-04T01:36:28.251 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:28.251 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:28.251 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:28.251 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:28.251 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:28.251 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:28.251 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:28.251 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:28.251 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2023-11-04T01:36:28.252 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:28.252 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:28.252 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2023-11-04T01:36:28.252 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:36:28.252 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:28.252 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2023-11-04T01:36:28.252 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-04T01:36:28.252 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42481sec preferred_lft 42481sec 2023-11-04T01:36:28.252 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2023-11-04T01:36:28.252 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:28.252 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:28.252 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:28.253 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2023-11-04T01:36:28.253 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:36:28.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.253 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:36:28.253 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:36:28.253 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:36:28.253 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr flush dev ceph-brx 2023-11-04T01:36:28.253 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set ceph-brx up 2023-11-04T01:36:28.253 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:36:28.253 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:36:28.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.373 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:36:28.403 INFO:teuthology.orchestra.run.smithi044.stdout:1 2023-11-04T01:36:28.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.404 DEBUG:teuthology.orchestra.run.smithi044:> route 2023-11-04T01:36:28.462 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2023-11-04T01:36:28.462 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:36:28.462 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-04T01:36:28.462 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-04T01:36:28.462 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:36:28.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.463 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:36:28.463 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:36:28.463 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:36:28.463 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:36:28.463 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:36:28.463 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:36:28.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.569 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2023-11-04T01:36:28.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.584 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2023-11-04T01:36:28.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.639 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:36:28.639 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:36:28.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:28.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-04T01:36:28.639 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:36:28.731 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-04T01:36:28.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.731 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:36:28.731 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:36:28.731 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-04T01:36:28.731 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:36:28.731 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-04T01:36:28.731 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-04T01:36:28.731 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-04T01:36:28.732 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:36:28.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.834 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:36:28.835 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:36:28.835 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2023-11-04T01:36:28.835 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:36:28.835 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:36:28.884 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:36:28.884 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:28.884 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:28.898 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:36:28.899 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:28.899 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:28.953 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:36:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:36:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:36:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:36:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:36:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:36:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:36:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:36:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:36:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:36:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:36:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:36:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:36:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:36:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:36:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:36:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:36:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:36:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:36:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:36:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:29.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:29.013 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:36:29.069 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:36:29.069 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:36:29.112 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:29.132 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:36:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:36:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:36:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:36:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:36:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:36:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:36:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:36:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:36:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:36:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:36:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:36:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:36:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:36:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:36:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:36:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:36:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:36:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:36:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:36:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:29.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:29.137 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:36:29.213 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:36:29.210+0000 7f40f5441480 -1 init, newargv = 0x56108d07dbd0 newargc=15 2023-11-04T01:36:29.213 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[98281]: starting ceph client 2023-11-04T01:36:29.217 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[98281]: starting fuse 2023-11-04T01:36:30.290 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:36:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:36:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:36:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:36:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:36:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:36:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:36:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:36:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:36:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:36:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:36:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:36:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:36:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:36:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:36:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:36:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:36:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:36:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:36:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:36:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:30.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:30.313 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:36:30.369 INFO:teuthology.orchestra.run.smithi044.stdout:41 2023-11-04T01:36:30.370 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:36:30.370 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:36:30.370 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2023-11-04T01:36:30.370 DEBUG:teuthology.orchestra.run.smithi044:> import re 2023-11-04T01:36:30.370 DEBUG:teuthology.orchestra.run.smithi044:> import os 2023-11-04T01:36:30.370 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2023-11-04T01:36:30.370 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:36:30.370 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2023-11-04T01:36:30.371 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:36:30.371 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2023-11-04T01:36:30.371 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:36:30.371 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:36:30.371 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2023-11-04T01:36:30.371 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2023-11-04T01:36:30.371 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2023-11-04T01:36:30.371 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2023-11-04T01:36:30.371 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:36:30.371 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2023-11-04T01:36:30.371 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:36:30.371 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:36:30.371 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:36:30.371 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2023-11-04T01:36:30.371 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2023-11-04T01:36:30.372 DEBUG:teuthology.orchestra.run.smithi044:> return f 2023-11-04T01:36:30.372 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:36:30.372 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:36:30.372 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2023-11-04T01:36:30.372 DEBUG:teuthology.orchestra.run.smithi044:> ' 2023-11-04T01:36:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.98281.asok 2023-11-04T01:36:30.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:30.515 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.98281.asok 2023-11-04T01:36:30.515 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:30.515 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.98281.asok status 2023-11-04T01:36:30.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:36:30.693 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2023-11-04T01:36:30.693 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:36:30.694 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:36:30.694 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2023-11-04T01:36:30.694 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2023-11-04T01:36:30.694 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:36:30.694 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "98281", 2023-11-04T01:36:30.694 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2023-11-04T01:36:30.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:36:30.694 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2023-11-04T01:36:30.694 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2023-11-04T01:36:30.694 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4866, 2023-11-04T01:36:30.694 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2023-11-04T01:36:30.694 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2023-11-04T01:36:30.694 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4866 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 135803047 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 135803047 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.4866 192.168.0.1:0/135803047", 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/135803047", 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 9, 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 24, 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:36:30.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:30.707 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:36:30.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.812+0000 7ff4bb53c640 1 Processor -- start 2023-11-04T01:36:30.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.812+0000 7ff4bb53c640 1 -- start start 2023-11-04T01:36:30.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.813+0000 7ff4bb53c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4b40ce240 0x7ff4b4157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.813+0000 7ff4bb53c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff4b4157540 0x7ff4b40d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.813+0000 7ff4bb53c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b415e000 con 0x7ff4b40cde60 2023-11-04T01:36:30.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.813+0000 7ff4bb53c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b415e5c0 con 0x7ff4b4157540 2023-11-04T01:36:30.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.813+0000 7ff4bb53c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b415e2e0 con 0x7ff4b40ce240 2023-11-04T01:36:30.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.813+0000 7ff4b9ad9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff4b4157540 0x7ff4b40d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.813+0000 7ff4b92d8640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff4b40cde60 0x7ff4b415d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47490/0 (socket says 172.21.15.44:47490) 2023-11-04T01:36:30.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.813+0000 7ff4b92d8640 1 -- 172.21.15.44:0/3808517937 learned_addr learned my addr 172.21.15.44:0/3808517937 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:30.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.814+0000 7ff4b8ad7640 1 --2- 172.21.15.44:0/3808517937 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4b40ce240 0x7ff4b4157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.814+0000 7ff4b9ad9640 1 -- 172.21.15.44:0/3808517937 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4b40ce240 msgr2=0x7ff4b4157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:30.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.814+0000 7ff4b9ad9640 1 --2- 172.21.15.44:0/3808517937 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4b40ce240 0x7ff4b4157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.814+0000 7ff4b9ad9640 1 -- 172.21.15.44:0/3808517937 >> v1:172.21.15.44:6789/0 conn(0x7ff4b40cde60 legacy=0x7ff4b415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.814+0000 7ff4b3fff640 1 -- 172.21.15.44:0/3808517937 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001026891 0 0) 0x7ff4b415e000 con 0x7ff4b40cde60 2023-11-04T01:36:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.814+0000 7ff4b9ad9640 1 -- 172.21.15.44:0/3808517937 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b40d1120 con 0x7ff4b4157540 2023-11-04T01:36:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.815+0000 7ff4b9ad9640 1 --2- 172.21.15.44:0/3808517937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4b4157540 0x7ff4b40d1920 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009d90 tx=0x7ff4a402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedabb6b19250089 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.815+0000 7ff4b3fff640 1 -- 172.21.15.44:0/3808517937 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a402cc50 con 0x7ff4b4157540 2023-11-04T01:36:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.815+0000 7ff4b3fff640 1 -- 172.21.15.44:0/3808517937 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a402cdb0 con 0x7ff4b4157540 2023-11-04T01:36:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.815+0000 7ff4b3fff640 1 -- 172.21.15.44:0/3808517937 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4034660 con 0x7ff4b4157540 2023-11-04T01:36:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.815+0000 7ff4bb53c640 1 -- 172.21.15.44:0/3808517937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4b4157540 msgr2=0x7ff4b40d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.815+0000 7ff4bb53c640 1 --2- 172.21.15.44:0/3808517937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4b4157540 0x7ff4b40d1920 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009d90 tx=0x7ff4a402bea0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.815+0000 7ff4bb53c640 1 -- 172.21.15.44:0/3808517937 shutdown_connections 2023-11-04T01:36:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.815+0000 7ff4bb53c640 1 --2- 172.21.15.44:0/3808517937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4b4157540 0x7ff4b40d1920 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.815+0000 7ff4bb53c640 1 --2- 172.21.15.44:0/3808517937 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4b40ce240 0x7ff4b4157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.815+0000 7ff4bb53c640 1 -- 172.21.15.44:0/3808517937 >> 172.21.15.44:0/3808517937 conn(0x7ff4b4071f30 msgr2=0x7ff4b40cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.815+0000 7ff4bb53c640 1 -- 172.21.15.44:0/3808517937 shutdown_connections 2023-11-04T01:36:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.815+0000 7ff4bb53c640 1 -- 172.21.15.44:0/3808517937 wait complete. 2023-11-04T01:36:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.816+0000 7ff4bb53c640 1 Processor -- start 2023-11-04T01:36:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.817+0000 7ff4bb53c640 1 -- start start 2023-11-04T01:36:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.817+0000 7ff4bb53c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4b40cde60 0x7ff4b41f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.817+0000 7ff4bb53c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4b40ce240 0x7ff4b415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.817+0000 7ff4bb53c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4b4157540 0x7ff4b40c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.817+0000 7ff4bb53c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b4157b30 con 0x7ff4b4157540 2023-11-04T01:36:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.817+0000 7ff4bb53c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b41583d0 con 0x7ff4b40cde60 2023-11-04T01:36:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.817+0000 7ff4bb53c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b415c7c0 con 0x7ff4b40ce240 2023-11-04T01:36:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.817+0000 7ff4b9ad9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4b4157540 0x7ff4b40c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.817+0000 7ff4b9ad9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4b4157540 0x7ff4b40c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38768/0 (socket says 172.21.15.44:38768) 2023-11-04T01:36:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.817+0000 7ff4b9ad9640 1 -- 172.21.15.44:0/1252436106 learned_addr learned my addr 172.21.15.44:0/1252436106 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.818+0000 7ff4b8ad7640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4b40ce240 0x7ff4b415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.818+0000 7ff4b92d8640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4b40cde60 0x7ff4b41f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.818+0000 7ff4b9ad9640 1 -- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4b40ce240 msgr2=0x7ff4b415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.818+0000 7ff4b9ad9640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4b40ce240 0x7ff4b415be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.818+0000 7ff4b9ad9640 1 -- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4b40cde60 msgr2=0x7ff4b41f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.818+0000 7ff4b9ad9640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4b40cde60 0x7ff4b41f1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.818+0000 7ff4b9ad9640 1 -- 172.21.15.44:0/1252436106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4009a70 con 0x7ff4b4157540 2023-11-04T01:36:30.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.818+0000 7ff4b92d8640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4b40cde60 0x7ff4b41f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:30.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.818+0000 7ff4b8ad7640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4b40ce240 0x7ff4b415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:30.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.818+0000 7ff4b9ad9640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4b4157540 0x7ff4b40c6950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009eb0 tx=0x7ff4a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:30.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.818+0000 7ff4b1ffb640 1 -- 172.21.15.44:0/1252436106 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4040650 con 0x7ff4b4157540 2023-11-04T01:36:30.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.818+0000 7ff4b1ffb640 1 -- 172.21.15.44:0/1252436106 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a40407d0 con 0x7ff4b4157540 2023-11-04T01:36:30.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.818+0000 7ff4b1ffb640 1 -- 172.21.15.44:0/1252436106 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4040b80 con 0x7ff4b4157540 2023-11-04T01:36:30.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.818+0000 7ff4bb53c640 1 -- 172.21.15.44:0/1252436106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b4157d80 con 0x7ff4b4157540 2023-11-04T01:36:30.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.818+0000 7ff4bb53c640 1 -- 172.21.15.44:0/1252436106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b41f24d0 con 0x7ff4b4157540 2023-11-04T01:36:30.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.819+0000 7ff4bb53c640 1 -- 172.21.15.44:0/1252436106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b4158560 con 0x7ff4b4157540 2023-11-04T01:36:30.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.820+0000 7ff4b1ffb640 1 -- 172.21.15.44:0/1252436106 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4a4040ce0 con 0x7ff4b4157540 2023-11-04T01:36:30.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.820+0000 7ff4b1ffb640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff4a006ae70 0x7ff4a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.820+0000 7ff4b1ffb640 1 -- 172.21.15.44:0/1252436106 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff4a40ac720 con 0x7ff4b4157540 2023-11-04T01:36:30.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.820+0000 7ff4b92d8640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff4a006ae70 0x7ff4a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.821+0000 7ff4b92d8640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff4a006ae70 0x7ff4a006d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac000f60 tx=0x7ff4ac007c30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:30.824+0000 7ff4b1ffb640 1 -- 172.21.15.44:0/1252436106 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4a40774e0 con 0x7ff4b4157540 2023-11-04T01:36:31.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:31.036+0000 7ff4bb53c640 1 -- 172.21.15.44:0/1252436106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff4b40d0360 con 0x7ff4b4157540 2023-11-04T01:36:31.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:31.036+0000 7ff4b1ffb640 1 -- 172.21.15.44:0/1252436106 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff4a407ab00 con 0x7ff4b4157540 2023-11-04T01:36:31.037 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:36:31.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:31.038+0000 7ff4bb53c640 1 -- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff4a006ae70 msgr2=0x7ff4a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:31.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:31.038+0000 7ff4bb53c640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff4a006ae70 0x7ff4a006d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac000f60 tx=0x7ff4ac007c30 comp rx=0 tx=0).stop 2023-11-04T01:36:31.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:31.038+0000 7ff4bb53c640 1 -- 172.21.15.44:0/1252436106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4b4157540 msgr2=0x7ff4b40c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:31.038+0000 7ff4bb53c640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4b4157540 0x7ff4b40c6950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009eb0 tx=0x7ff4a4004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:31.038+0000 7ff4bb53c640 1 -- 172.21.15.44:0/1252436106 shutdown_connections 2023-11-04T01:36:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:31.038+0000 7ff4bb53c640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff4a006ae70 0x7ff4a006d330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:31.038+0000 7ff4bb53c640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4b4157540 0x7ff4b40c6950 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:31.038+0000 7ff4bb53c640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4b40ce240 0x7ff4b415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:31.038+0000 7ff4bb53c640 1 --2- 172.21.15.44:0/1252436106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4b40cde60 0x7ff4b41f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:31.038+0000 7ff4bb53c640 1 -- 172.21.15.44:0/1252436106 >> 172.21.15.44:0/1252436106 conn(0x7ff4b4071f30 msgr2=0x7ff4b4072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:31.038+0000 7ff4bb53c640 1 -- 172.21.15.44:0/1252436106 shutdown_connections 2023-11-04T01:36:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:31.038+0000 7ff4bb53c640 1 -- 172.21.15.44:0/1252436106 wait complete. 2023-11-04T01:36:31.054 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:36:31.055 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:36:31.055 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2023-11-04T01:36:31.055 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-04T01:36:31.055 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:31.055 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:36:31.055 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:36:31.055 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:36:31.055 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-04T01:36:31.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.055 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2023-11-04T01:36:31.071 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:31.071 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:31.071 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:31.071 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.071 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:31.071 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.071 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2023-11-04T01:36:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2023-11-04T01:36:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:36:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2023-11-04T01:36:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-04T01:36:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42478sec preferred_lft 42478sec 2023-11-04T01:36:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2023-11-04T01:36:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:31.073 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:31.073 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2023-11-04T01:36:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:36:31.073 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:31.073 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:36:31.073 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.073 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::9082:77ff:fe28:4353/64 scope link 2023-11-04T01:36:31.073 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:36:31.074 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:31.074 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::e49d:e3ff:fe56:d068/64 scope link 2023-11-04T01:36:31.074 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.074 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:36:31.141 INFO:teuthology.orchestra.run.smithi044.stdout:1 2023-11-04T01:36:31.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.142 DEBUG:teuthology.orchestra.run.smithi044:> route 2023-11-04T01:36:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2023-11-04T01:36:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:36:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-04T01:36:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-04T01:36:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:36:31.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.199 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:36:31.199 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:36:31.199 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:36:31.199 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:36:31.199 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:36:31.199 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:36:31.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.305 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2023-11-04T01:36:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:36:31.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.327 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2023-11-04T01:36:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-04T01:36:31.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.383 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:36:31.383 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:36:31.383 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:36:31.383 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-04T01:36:31.383 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:36:31.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.472 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-04T01:36:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:36:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:b7:e9:7f:2e:9b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:36:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:36:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::2cb7:e9ff:fe7f:2e9b/64 scope link 2023-11-04T01:36:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.505 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-04T01:36:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.577 INFO:teuthology.orchestra.run.smithi044.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:36:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:b7:e9:7f:2e:9b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:36:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:36:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::2cb7:e9ff:fe7f:2e9b/64 scope link 2023-11-04T01:36:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.578 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-04T01:36:31.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.578 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:36:31.579 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:36:31.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-04T01:36:31.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-04T01:36:31.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-04T01:36:31.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-04T01:36:31.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-04T01:36:31.579 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:36:31.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.720 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:36:31.720 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:36:31.720 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.1 up 2023-11-04T01:36:31.720 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.1 master ceph-brx 2023-11-04T01:36:31.720 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:36:31.769 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-04T01:36:31.769 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:31.769 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:31.786 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-04T01:36:31.786 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:31.786 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:31.841 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:36:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:36:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:36:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:36:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:36:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:36:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:36:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:36:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:36:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:36:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:36:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:36:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:36:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:36:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:36:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:36:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:36:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:36:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:36:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:36:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:36:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:36:31.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.901 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:36:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:41 2023-11-04T01:36:31.956 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-11-04T01:36:31.956 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-04T01:36:31.998 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:36:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:36:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:36:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:36:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:36:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:36:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:36:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:36:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:36:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:36:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:36:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:36:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:36:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:36:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:36:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:36:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:36:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:36:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:36:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:36:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:36:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:36:32.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:32.017 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:36:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:41 2023-11-04T01:36:32.095 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi044.stderr:2023-11-04T01:36:32.094+0000 7f757ae3d480 -1 init, newargv = 0x5585d4930c10 newargc=15 2023-11-04T01:36:32.096 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi044.stderr:ceph-fuse[98774]: starting ceph client 2023-11-04T01:36:32.099 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi044.stderr:ceph-fuse[98774]: starting fuse 2023-11-04T01:36:33.173 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:36:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:36:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:36:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:36:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:36:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:36:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:36:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:36:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:36:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:36:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:36:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:36:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:36:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:36:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:36:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:36:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:36:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:36:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:36:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:36:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:36:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:36:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:33.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:33.196 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:36:33.252 INFO:teuthology.orchestra.run.smithi044.stdout:41 2023-11-04T01:36:33.252 INFO:teuthology.orchestra.run.smithi044.stdout:44 2023-11-04T01:36:33.252 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2023-11-04T01:36:33.252 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:36:33.253 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2023-11-04T01:36:33.253 DEBUG:teuthology.orchestra.run.smithi044:> import re 2023-11-04T01:36:33.253 DEBUG:teuthology.orchestra.run.smithi044:> import os 2023-11-04T01:36:33.253 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2023-11-04T01:36:33.253 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:36:33.253 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2023-11-04T01:36:33.253 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-04T01:36:33.253 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2023-11-04T01:36:33.253 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-04T01:36:33.253 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:36:33.253 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2023-11-04T01:36:33.253 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2023-11-04T01:36:33.253 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2023-11-04T01:36:33.253 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2023-11-04T01:36:33.254 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:36:33.254 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2023-11-04T01:36:33.254 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:36:33.254 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:36:33.254 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:36:33.254 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2023-11-04T01:36:33.254 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2023-11-04T01:36:33.254 DEBUG:teuthology.orchestra.run.smithi044:> return f 2023-11-04T01:36:33.254 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:36:33.254 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:36:33.254 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.2")) 2023-11-04T01:36:33.254 DEBUG:teuthology.orchestra.run.smithi044:> ' 2023-11-04T01:36:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.2.98774.asok 2023-11-04T01:36:33.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:33.401 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.98774.asok 2023-11-04T01:36:33.401 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:33.401 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.2.98774.asok status 2023-11-04T01:36:33.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:33.578 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:36:33.579 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2023-11-04T01:36:33.579 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:36:33.579 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:36:33.579 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "2", 2023-11-04T01:36:33.579 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2023-11-04T01:36:33.579 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-04T01:36:33.579 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "98774", 2023-11-04T01:36:33.579 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2023-11-04T01:36:33.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:36:33.579 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2023-11-04T01:36:33.579 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2023-11-04T01:36:33.580 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4884, 2023-11-04T01:36:33.580 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2023-11-04T01:36:33.580 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2023-11-04T01:36:33.580 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2023-11-04T01:36:33.580 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4884 2023-11-04T01:36:33.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:36:33.580 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:36:33.580 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:36:33.580 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:36:33.580 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 183884107 2023-11-04T01:36:33.580 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:36:33.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:36:33.581 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:36:33.581 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:36:33.581 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:36:33.581 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 183884107 2023-11-04T01:36:33.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:36:33.581 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.4884 192.168.0.2:0/183884107", 2023-11-04T01:36:33.581 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.2:0/183884107", 2023-11-04T01:36:33.581 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2023-11-04T01:36:33.581 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 9, 2023-11-04T01:36:33.581 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 24, 2023-11-04T01:36:33.581 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:36:33.581 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2023-11-04T01:36:33.581 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2023-11-04T01:36:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:36:33.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:33.593 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:36:33.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.698+0000 7f9b04d25640 1 Processor -- start 2023-11-04T01:36:33.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.698+0000 7f9b04d25640 1 -- start start 2023-11-04T01:36:33.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.699+0000 7f9b04d25640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9b0015ab70 0x7f9b000cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.699+0000 7f9b04d25640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9b0006a830 0x7f9b000ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.699+0000 7f9b04d25640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b0006d310 con 0x7f9b0006eba0 2023-11-04T01:36:33.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.699+0000 7f9b04d25640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b000cba70 con 0x7f9b0006a830 2023-11-04T01:36:33.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.699+0000 7f9b04d25640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b00161c50 con 0x7f9b0015ab70 2023-11-04T01:36:33.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.699+0000 7f9afed9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9b0006a830 0x7f9b000ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.699+0000 7f9afed9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9b0006a830 0x7f9b000ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46296/0 (socket says 172.21.15.44:46296) 2023-11-04T01:36:33.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.699+0000 7f9afed9d640 1 -- 172.21.15.44:0/2388276351 learned_addr learned my addr 172.21.15.44:0/2388276351 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:33.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.699+0000 7f9afe59c640 1 --2- 172.21.15.44:0/2388276351 >> v2:172.21.15.204:3300/0 conn(0x7f9b0015ab70 0x7f9b000cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.699+0000 7f9afed9d640 1 -- 172.21.15.44:0/2388276351 >> v2:172.21.15.204:3300/0 conn(0x7f9b0015ab70 msgr2=0x7f9b000cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:33.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.699+0000 7f9afed9d640 1 --2- 172.21.15.44:0/2388276351 >> v2:172.21.15.204:3300/0 conn(0x7f9b0015ab70 0x7f9b000cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.699+0000 7f9afed9d640 1 -- 172.21.15.44:0/2388276351 >> v1:172.21.15.204:6789/0 conn(0x7f9b0006eba0 legacy=0x7f9b0006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:33.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.699+0000 7f9afed9d640 1 -- 172.21.15.44:0/2388276351 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0015d860 con 0x7f9b0006a830 2023-11-04T01:36:33.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.699+0000 7f9afe59c640 1 --2- 172.21.15.44:0/2388276351 >> v2:172.21.15.204:3300/0 conn(0x7f9b0015ab70 0x7f9b000cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.700+0000 7f9afed9d640 1 --2- 172.21.15.44:0/2388276351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0006a830 0x7f9b000ae5e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9b000b2600 tx=0x7f9af802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847b9525090d5f22 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.700+0000 7f9afdd9b640 1 -- 172.21.15.44:0/2388276351 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af802c9f0 con 0x7f9b0006a830 2023-11-04T01:36:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.700+0000 7f9afdd9b640 1 -- 172.21.15.44:0/2388276351 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af802cb50 con 0x7f9b0006a830 2023-11-04T01:36:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.700+0000 7f9afdd9b640 1 -- 172.21.15.44:0/2388276351 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af80343f0 con 0x7f9b0006a830 2023-11-04T01:36:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.701+0000 7f9b04d25640 1 -- 172.21.15.44:0/2388276351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0006a830 msgr2=0x7f9b000ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.701+0000 7f9b04d25640 1 --2- 172.21.15.44:0/2388276351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0006a830 0x7f9b000ae5e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9b000b2600 tx=0x7f9af802be50 comp rx=0 tx=0).stop 2023-11-04T01:36:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.701+0000 7f9b04d25640 1 -- 172.21.15.44:0/2388276351 shutdown_connections 2023-11-04T01:36:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.701+0000 7f9b04d25640 1 --2- 172.21.15.44:0/2388276351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0006a830 0x7f9b000ae5e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.701+0000 7f9b04d25640 1 --2- 172.21.15.44:0/2388276351 >> v2:172.21.15.204:3300/0 conn(0x7f9b0015ab70 0x7f9b000cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.701+0000 7f9b04d25640 1 -- 172.21.15.44:0/2388276351 >> 172.21.15.44:0/2388276351 conn(0x7f9b00098d40 msgr2=0x7f9b000cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:33.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.701+0000 7f9b04d25640 1 -- 172.21.15.44:0/2388276351 shutdown_connections 2023-11-04T01:36:33.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.701+0000 7f9b04d25640 1 -- 172.21.15.44:0/2388276351 wait complete. 2023-11-04T01:36:33.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.702+0000 7f9b04d25640 1 Processor -- start 2023-11-04T01:36:33.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.702+0000 7f9b04d25640 1 -- start start 2023-11-04T01:36:33.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9b04d25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0006a830 0x7f9b001f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9b04d25640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b0006eba0 0x7f9b000b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9b04d25640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b0015ab70 0x7f9b001596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9b04d25640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b001f61b0 con 0x7f9b0006a830 2023-11-04T01:36:33.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9b04d25640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0009a4b0 con 0x7f9b0015ab70 2023-11-04T01:36:33.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9b04d25640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000b4ef0 con 0x7f9b0006eba0 2023-11-04T01:36:33.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9afe59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0006a830 0x7f9b001f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9afe59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0006a830 0x7f9b001f6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46302/0 (socket says 172.21.15.44:46302) 2023-11-04T01:36:33.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9afe59c640 1 -- 172.21.15.44:0/760323969 learned_addr learned my addr 172.21.15.44:0/760323969 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:33.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9afed9d640 1 --2- 172.21.15.44:0/760323969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b0015ab70 0x7f9b001596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9af7fff640 1 --2- 172.21.15.44:0/760323969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b0006eba0 0x7f9b000b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9afe59c640 1 -- 172.21.15.44:0/760323969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b0006eba0 msgr2=0x7f9b000b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:33.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9afe59c640 1 --2- 172.21.15.44:0/760323969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b0006eba0 0x7f9b000b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9afe59c640 1 -- 172.21.15.44:0/760323969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b0015ab70 msgr2=0x7f9b001596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:33.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9afe59c640 1 --2- 172.21.15.44:0/760323969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b0015ab70 0x7f9b001596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.703+0000 7f9afe59c640 1 -- 172.21.15.44:0/760323969 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8009b30 con 0x7f9b0006a830 2023-11-04T01:36:33.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.704+0000 7f9afe59c640 1 --2- 172.21.15.44:0/760323969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0006a830 0x7f9b001f6640 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9af000c7f0 tx=0x7f9af000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:33.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.704+0000 7f9af6ffd640 1 -- 172.21.15.44:0/760323969 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0005b90 con 0x7f9b0006a830 2023-11-04T01:36:33.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.704+0000 7f9af6ffd640 1 -- 172.21.15.44:0/760323969 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af0005cf0 con 0x7f9b0006a830 2023-11-04T01:36:33.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.704+0000 7f9af6ffd640 1 -- 172.21.15.44:0/760323969 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0007a30 con 0x7f9b0006a830 2023-11-04T01:36:33.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.704+0000 7f9b04d25640 1 -- 172.21.15.44:0/760323969 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b000b51d0 con 0x7f9b0006a830 2023-11-04T01:36:33.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.704+0000 7f9b04d25640 1 -- 172.21.15.44:0/760323969 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b001f5e40 con 0x7f9b0006a830 2023-11-04T01:36:33.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.705+0000 7f9b04d25640 1 -- 172.21.15.44:0/760323969 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b00074290 con 0x7f9b0006a830 2023-11-04T01:36:33.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.705+0000 7f9af6ffd640 1 -- 172.21.15.44:0/760323969 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9af0007b90 con 0x7f9b0006a830 2023-11-04T01:36:33.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.706+0000 7f9af6ffd640 1 --2- 172.21.15.44:0/760323969 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ae006aea0 0x7f9ae006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.706+0000 7f9af6ffd640 1 -- 172.21.15.44:0/760323969 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9af0089850 con 0x7f9b0006a830 2023-11-04T01:36:33.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.706+0000 7f9af7fff640 1 --2- 172.21.15.44:0/760323969 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ae006aea0 0x7f9ae006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.706+0000 7f9af7fff640 1 --2- 172.21.15.44:0/760323969 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ae006aea0 0x7f9ae006d360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9b0015fa80 tx=0x7f9ae8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:33.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.710+0000 7f9af6ffd640 1 -- 172.21.15.44:0/760323969 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9af0054610 con 0x7f9b0006a830 2023-11-04T01:36:33.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.920+0000 7f9b04d25640 1 -- 172.21.15.44:0/760323969 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9b0006ae70 con 0x7f9b0006a830 2023-11-04T01:36:33.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.921+0000 7f9af6ffd640 1 -- 172.21.15.44:0/760323969 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9af001e070 con 0x7f9b0006a830 2023-11-04T01:36:33.922 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:36:33.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.923+0000 7f9b04d25640 1 -- 172.21.15.44:0/760323969 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ae006aea0 msgr2=0x7f9ae006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:33.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.923+0000 7f9b04d25640 1 --2- 172.21.15.44:0/760323969 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ae006aea0 0x7f9ae006d360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9b0015fa80 tx=0x7f9ae8008040 comp rx=0 tx=0).stop 2023-11-04T01:36:33.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.923+0000 7f9b04d25640 1 -- 172.21.15.44:0/760323969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0006a830 msgr2=0x7f9b001f6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:33.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.923+0000 7f9b04d25640 1 --2- 172.21.15.44:0/760323969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0006a830 0x7f9b001f6640 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9af000c7f0 tx=0x7f9af000cbf0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.923+0000 7f9b04d25640 1 -- 172.21.15.44:0/760323969 shutdown_connections 2023-11-04T01:36:33.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.923+0000 7f9b04d25640 1 --2- 172.21.15.44:0/760323969 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ae006aea0 0x7f9ae006d360 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.923+0000 7f9b04d25640 1 --2- 172.21.15.44:0/760323969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b0015ab70 0x7f9b001596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.923+0000 7f9b04d25640 1 --2- 172.21.15.44:0/760323969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b0006eba0 0x7f9b000b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.923+0000 7f9b04d25640 1 --2- 172.21.15.44:0/760323969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0006a830 0x7f9b001f6640 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.923+0000 7f9b04d25640 1 -- 172.21.15.44:0/760323969 >> 172.21.15.44:0/760323969 conn(0x7f9b00098d40 msgr2=0x7f9b000cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:33.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.923+0000 7f9b04d25640 1 -- 172.21.15.44:0/760323969 shutdown_connections 2023-11-04T01:36:33.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:33.923+0000 7f9b04d25640 1 -- 172.21.15.44:0/760323969 wait complete. 2023-11-04T01:36:33.934 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:36:33.935 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:36:33.935 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi204.front.sepia.ceph.com 2023-11-04T01:36:33.935 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-04T01:36:33.935 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:33.935 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:36:33.935 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:36:33.935 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:36:33.935 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-04T01:36:33.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:33.935 DEBUG:teuthology.orchestra.run.smithi204:> ip addr 2023-11-04T01:36:33.954 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:33.954 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:33.954 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:33.954 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:33.955 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:33.955 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:33.955 INFO:teuthology.orchestra.run.smithi204.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:33.955 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2a brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:33.955 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f0 2023-11-04T01:36:33.955 INFO:teuthology.orchestra.run.smithi204.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:33.955 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2b brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:33.955 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f1 2023-11-04T01:36:33.955 INFO:teuthology.orchestra.run.smithi204.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:33.955 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:aa brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:33.955 INFO:teuthology.orchestra.run.smithi204.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:36:33.956 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:ab brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:33.956 INFO:teuthology.orchestra.run.smithi204.stdout: inet 172.21.15.204/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:36:33.956 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft 41808sec preferred_lft 41808sec 2023-11-04T01:36:33.956 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::ec4:7aff:fe88:77ab/64 scope link 2023-11-04T01:36:33.956 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:33.956 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:36:33.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:33.956 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2023-11-04T01:36:33.956 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2023-11-04T01:36:33.957 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:36:33.957 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip addr flush dev ceph-brx 2023-11-04T01:36:33.957 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set ceph-brx up 2023-11-04T01:36:33.957 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:36:33.957 DEBUG:teuthology.orchestra.run.smithi204:> ') 2023-11-04T01:36:34.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:34.124 DEBUG:teuthology.orchestra.run.smithi204:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:36:34.151 INFO:teuthology.orchestra.run.smithi204.stdout:1 2023-11-04T01:36:34.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:34.153 DEBUG:teuthology.orchestra.run.smithi204:> route 2023-11-04T01:36:34.225 INFO:teuthology.orchestra.run.smithi204.stdout:Kernel IP routing table 2023-11-04T01:36:34.225 INFO:teuthology.orchestra.run.smithi204.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:36:34.225 INFO:teuthology.orchestra.run.smithi204.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:36:34.225 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:36:34.226 INFO:teuthology.orchestra.run.smithi204.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:36:34.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:34.226 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2023-11-04T01:36:34.226 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2023-11-04T01:36:34.226 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:36:34.226 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:36:34.226 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:36:34.226 DEBUG:teuthology.orchestra.run.smithi204:> ') 2023-11-04T01:36:34.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:34.514 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2023-11-04T01:36:34.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:34.532 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list-id 2023-11-04T01:36:34.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:34.587 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2023-11-04T01:36:34.587 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2023-11-04T01:36:34.587 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:34.587 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-04T01:36:34.587 DEBUG:teuthology.orchestra.run.smithi204:> ') 2023-11-04T01:36:34.671 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-04T01:36:34.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:34.671 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2023-11-04T01:36:34.672 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2023-11-04T01:36:34.672 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-04T01:36:34.672 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:36:34.672 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-04T01:36:34.672 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-04T01:36:34.672 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-04T01:36:34.672 DEBUG:teuthology.orchestra.run.smithi204:> ') 2023-11-04T01:36:34.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:34.836 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2023-11-04T01:36:34.836 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2023-11-04T01:36:34.837 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set brx.0 up 2023-11-04T01:36:34.837 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:36:34.837 DEBUG:teuthology.orchestra.run.smithi204:> ') 2023-11-04T01:36:34.882 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-04T01:36:34.882 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:34.882 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:34.937 INFO:teuthology.orchestra.run.smithi204.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-04T01:36:34.937 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:34.937 DEBUG:teuthology.orchestra.run.smithi204:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:34.992 DEBUG:teuthology.orchestra.run.smithi204:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:35.048 INFO:teuthology.orchestra.run.smithi204.stdout:/proc 2023-11-04T01:36:35.048 INFO:teuthology.orchestra.run.smithi204.stdout:/sys 2023-11-04T01:36:35.048 INFO:teuthology.orchestra.run.smithi204.stdout:/dev 2023-11-04T01:36:35.048 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/security 2023-11-04T01:36:35.048 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/shm 2023-11-04T01:36:35.048 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/pts 2023-11-04T01:36:35.048 INFO:teuthology.orchestra.run.smithi204.stdout:/run 2023-11-04T01:36:35.048 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/cgroup 2023-11-04T01:36:35.048 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/pstore 2023-11-04T01:36:35.048 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/bpf 2023-11-04T01:36:35.049 INFO:teuthology.orchestra.run.smithi204.stdout:/ 2023-11-04T01:36:35.049 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/selinux 2023-11-04T01:36:35.049 INFO:teuthology.orchestra.run.smithi204.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:35.049 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/mqueue 2023-11-04T01:36:35.049 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/hugepages 2023-11-04T01:36:35.049 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/debug 2023-11-04T01:36:35.049 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/tracing 2023-11-04T01:36:35.049 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:35.049 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/config 2023-11-04T01:36:35.049 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:35.049 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:35.049 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:35.049 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:35.050 INFO:teuthology.orchestra.run.smithi204.stdout:/run/user/1000 2023-11-04T01:36:35.050 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph 2023-11-04T01:36:35.050 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:36:35.050 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:36:35.050 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:36:35.050 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:36:35.050 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns 2023-11-04T01:36:35.050 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:35.050 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:35.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:35.050 DEBUG:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2023-11-04T01:36:35.102 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:36:35.102 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-04T01:36:35.145 DEBUG:teuthology.orchestra.run.smithi204:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:35.160 INFO:teuthology.orchestra.run.smithi204.stdout:/proc 2023-11-04T01:36:35.161 INFO:teuthology.orchestra.run.smithi204.stdout:/sys 2023-11-04T01:36:35.161 INFO:teuthology.orchestra.run.smithi204.stdout:/dev 2023-11-04T01:36:35.161 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/security 2023-11-04T01:36:35.161 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/shm 2023-11-04T01:36:35.161 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/pts 2023-11-04T01:36:35.161 INFO:teuthology.orchestra.run.smithi204.stdout:/run 2023-11-04T01:36:35.161 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/cgroup 2023-11-04T01:36:35.161 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/pstore 2023-11-04T01:36:35.161 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/bpf 2023-11-04T01:36:35.161 INFO:teuthology.orchestra.run.smithi204.stdout:/ 2023-11-04T01:36:35.161 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/selinux 2023-11-04T01:36:35.162 INFO:teuthology.orchestra.run.smithi204.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:35.162 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/mqueue 2023-11-04T01:36:35.162 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/hugepages 2023-11-04T01:36:35.162 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/debug 2023-11-04T01:36:35.162 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/tracing 2023-11-04T01:36:35.162 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:35.162 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/config 2023-11-04T01:36:35.162 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:35.162 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:35.162 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:35.162 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:35.162 INFO:teuthology.orchestra.run.smithi204.stdout:/run/user/1000 2023-11-04T01:36:35.162 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph 2023-11-04T01:36:35.163 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:36:35.163 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:36:35.163 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:36:35.163 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:36:35.164 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns 2023-11-04T01:36:35.164 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:35.164 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:35.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:35.164 DEBUG:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2023-11-04T01:36:35.251 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi204.stderr:2023-11-04T01:36:35.246+0000 7fa47dc3c480 -1 init, newargv = 0x55ac7dcec980 newargc=15 2023-11-04T01:36:35.251 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi204.stderr:ceph-fuse[124612]: starting ceph client 2023-11-04T01:36:35.253 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi204.stderr:ceph-fuse[124612]: starting fuse 2023-11-04T01:36:36.317 DEBUG:teuthology.orchestra.run.smithi204:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:36.335 INFO:teuthology.orchestra.run.smithi204.stdout:/proc 2023-11-04T01:36:36.336 INFO:teuthology.orchestra.run.smithi204.stdout:/sys 2023-11-04T01:36:36.336 INFO:teuthology.orchestra.run.smithi204.stdout:/dev 2023-11-04T01:36:36.336 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/security 2023-11-04T01:36:36.336 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/shm 2023-11-04T01:36:36.336 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/pts 2023-11-04T01:36:36.336 INFO:teuthology.orchestra.run.smithi204.stdout:/run 2023-11-04T01:36:36.336 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/cgroup 2023-11-04T01:36:36.336 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/pstore 2023-11-04T01:36:36.336 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/bpf 2023-11-04T01:36:36.336 INFO:teuthology.orchestra.run.smithi204.stdout:/ 2023-11-04T01:36:36.336 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/selinux 2023-11-04T01:36:36.336 INFO:teuthology.orchestra.run.smithi204.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:36.337 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/mqueue 2023-11-04T01:36:36.337 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/hugepages 2023-11-04T01:36:36.337 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/debug 2023-11-04T01:36:36.337 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/tracing 2023-11-04T01:36:36.337 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:36.337 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/config 2023-11-04T01:36:36.337 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:36.337 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:36.337 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:36.337 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:36.337 INFO:teuthology.orchestra.run.smithi204.stdout:/run/user/1000 2023-11-04T01:36:36.337 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph 2023-11-04T01:36:36.337 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:36:36.337 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:36:36.338 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:36:36.338 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:36:36.338 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns 2023-11-04T01:36:36.338 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:36.338 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:36.338 INFO:teuthology.orchestra.run.smithi204.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:36.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:36.338 DEBUG:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2023-11-04T01:36:36.392 INFO:teuthology.orchestra.run.smithi204.stdout:43 2023-11-04T01:36:36.392 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-04T01:36:36.392 DEBUG:teuthology.orchestra.run.smithi204:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:36:36.392 DEBUG:teuthology.orchestra.run.smithi204:> import glob 2023-11-04T01:36:36.392 DEBUG:teuthology.orchestra.run.smithi204:> import re 2023-11-04T01:36:36.392 DEBUG:teuthology.orchestra.run.smithi204:> import os 2023-11-04T01:36:36.393 DEBUG:teuthology.orchestra.run.smithi204:> import subprocess 2023-11-04T01:36:36.393 DEBUG:teuthology.orchestra.run.smithi204:> 2023-11-04T01:36:36.393 DEBUG:teuthology.orchestra.run.smithi204:> def _find_admin_socket(client_name): 2023-11-04T01:36:36.393 DEBUG:teuthology.orchestra.run.smithi204:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-04T01:36:36.393 DEBUG:teuthology.orchestra.run.smithi204:> files = glob.glob(asok_path) 2023-11-04T01:36:36.393 DEBUG:teuthology.orchestra.run.smithi204:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-04T01:36:36.393 DEBUG:teuthology.orchestra.run.smithi204:> 2023-11-04T01:36:36.393 DEBUG:teuthology.orchestra.run.smithi204:> # Given a non-glob path, it better be there 2023-11-04T01:36:36.393 DEBUG:teuthology.orchestra.run.smithi204:> if "*" not in asok_path: 2023-11-04T01:36:36.393 DEBUG:teuthology.orchestra.run.smithi204:> assert(len(files) == 1) 2023-11-04T01:36:36.393 DEBUG:teuthology.orchestra.run.smithi204:> return files[0] 2023-11-04T01:36:36.393 DEBUG:teuthology.orchestra.run.smithi204:> 2023-11-04T01:36:36.393 DEBUG:teuthology.orchestra.run.smithi204:> for f in files: 2023-11-04T01:36:36.393 DEBUG:teuthology.orchestra.run.smithi204:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:36:36.393 DEBUG:teuthology.orchestra.run.smithi204:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:36:36.394 DEBUG:teuthology.orchestra.run.smithi204:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:36:36.394 DEBUG:teuthology.orchestra.run.smithi204:> contents = proc_f.read() 2023-11-04T01:36:36.394 DEBUG:teuthology.orchestra.run.smithi204:> if mountpoint in contents: 2023-11-04T01:36:36.394 DEBUG:teuthology.orchestra.run.smithi204:> return f 2023-11-04T01:36:36.394 DEBUG:teuthology.orchestra.run.smithi204:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:36:36.394 DEBUG:teuthology.orchestra.run.smithi204:> 2023-11-04T01:36:36.394 DEBUG:teuthology.orchestra.run.smithi204:> print(_find_admin_socket("client.1")) 2023-11-04T01:36:36.394 DEBUG:teuthology.orchestra.run.smithi204:> ' 2023-11-04T01:36:36.515 INFO:teuthology.orchestra.run.smithi204.stdout:/var/run/ceph/ceph-client.1.124612.asok 2023-11-04T01:36:36.519 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:36.526 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.124612.asok 2023-11-04T01:36:36.526 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:36.526 DEBUG:teuthology.orchestra.run.smithi204:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.124612.asok status 2023-11-04T01:36:36.625 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:36.694 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2023-11-04T01:36:36.695 INFO:teuthology.orchestra.run.smithi204.stdout: "metadata": { 2023-11-04T01:36:36.695 INFO:teuthology.orchestra.run.smithi204.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:36:36.695 INFO:teuthology.orchestra.run.smithi204.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:36:36.695 INFO:teuthology.orchestra.run.smithi204.stdout: "entity_id": "1", 2023-11-04T01:36:36.695 INFO:teuthology.orchestra.run.smithi204.stdout: "hostname": "smithi204", 2023-11-04T01:36:36.695 INFO:teuthology.orchestra.run.smithi204.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-04T01:36:36.695 INFO:teuthology.orchestra.run.smithi204.stdout: "pid": "124612", 2023-11-04T01:36:36.695 INFO:teuthology.orchestra.run.smithi204.stdout: "root": "/" 2023-11-04T01:36:36.695 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2023-11-04T01:36:36.695 INFO:teuthology.orchestra.run.smithi204.stdout: "dentry_count": 0, 2023-11-04T01:36:36.695 INFO:teuthology.orchestra.run.smithi204.stdout: "dentry_pinned_count": 0, 2023-11-04T01:36:36.695 INFO:teuthology.orchestra.run.smithi204.stdout: "id": 4819, 2023-11-04T01:36:36.696 INFO:teuthology.orchestra.run.smithi204.stdout: "inst": { 2023-11-04T01:36:36.696 INFO:teuthology.orchestra.run.smithi204.stdout: "name": { 2023-11-04T01:36:36.696 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "client", 2023-11-04T01:36:36.696 INFO:teuthology.orchestra.run.smithi204.stdout: "num": 4819 2023-11-04T01:36:36.696 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2023-11-04T01:36:36.696 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": { 2023-11-04T01:36:36.696 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "v1", 2023-11-04T01:36:36.696 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:36:36.696 INFO:teuthology.orchestra.run.smithi204.stdout: "nonce": 1044031146 2023-11-04T01:36:36.696 INFO:teuthology.orchestra.run.smithi204.stdout: } 2023-11-04T01:36:36.696 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2023-11-04T01:36:36.696 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": { 2023-11-04T01:36:36.696 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "v1", 2023-11-04T01:36:36.697 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:36:36.697 INFO:teuthology.orchestra.run.smithi204.stdout: "nonce": 1044031146 2023-11-04T01:36:36.697 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2023-11-04T01:36:36.697 INFO:teuthology.orchestra.run.smithi204.stdout: "inst_str": "client.4819 192.168.0.1:0/1044031146", 2023-11-04T01:36:36.697 INFO:teuthology.orchestra.run.smithi204.stdout: "addr_str": "192.168.0.1:0/1044031146", 2023-11-04T01:36:36.697 INFO:teuthology.orchestra.run.smithi204.stdout: "inode_count": 1, 2023-11-04T01:36:36.697 INFO:teuthology.orchestra.run.smithi204.stdout: "mds_epoch": 9, 2023-11-04T01:36:36.697 INFO:teuthology.orchestra.run.smithi204.stdout: "osd_epoch": 24, 2023-11-04T01:36:36.697 INFO:teuthology.orchestra.run.smithi204.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:36:36.697 INFO:teuthology.orchestra.run.smithi204.stdout: "blocklisted": false, 2023-11-04T01:36:36.697 INFO:teuthology.orchestra.run.smithi204.stdout: "fs_name": "cephfs" 2023-11-04T01:36:36.697 INFO:teuthology.orchestra.run.smithi204.stdout:} 2023-11-04T01:36:36.701 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:36.708 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:36:36.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.827+0000 7fbc254b4640 1 Processor -- start 2023-11-04T01:36:36.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.827+0000 7fbc254b4640 1 -- start start 2023-11-04T01:36:36.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.828+0000 7fbc254b4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbc200b42c0 0x7fbc200c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.828+0000 7fbc254b4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc200c9c40 0x7fbc200b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.828+0000 7fbc254b4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc200ca090 con 0x7fbc2015ad80 2023-11-04T01:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.828+0000 7fbc254b4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2006cfa0 con 0x7fbc200b42c0 2023-11-04T01:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.828+0000 7fbc254b4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2006d280 con 0x7fbc200c9c40 2023-11-04T01:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.828+0000 7fbc1f7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc200c9c40 0x7fbc200b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.828+0000 7fbc1e7fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbc200b42c0 0x7fbc200c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.828+0000 7fbc1f7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc200c9c40 0x7fbc200b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:58802/0 (socket says 172.21.15.44:58802) 2023-11-04T01:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.828+0000 7fbc1f7fe640 1 -- 172.21.15.44:0/1333185516 learned_addr learned my addr 172.21.15.44:0/1333185516 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.829+0000 7fbc1e7fc640 1 -- 172.21.15.44:0/1333185516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc200c9c40 msgr2=0x7fbc200b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.829+0000 7fbc1e7fc640 1 --2- 172.21.15.44:0/1333185516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc200c9c40 0x7fbc200b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.829+0000 7fbc1e7fc640 1 -- 172.21.15.44:0/1333185516 >> v1:172.21.15.204:6789/0 conn(0x7fbc2015ad80 legacy=0x7fbc2006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.829+0000 7fbc1dffb640 1 -- 172.21.15.44:0/1333185516 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472085801 0 0) 0x7fbc10001110 con 0x7fbc2015ad80 2023-11-04T01:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.829+0000 7fbc1e7fc640 1 -- 172.21.15.44:0/1333185516 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2006d560 con 0x7fbc200b42c0 2023-11-04T01:36:36.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.829+0000 7fbc1f7fe640 1 --2- 172.21.15.44:0/1333185516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc200c9c40 0x7fbc200b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.829+0000 7fbc1e7fc640 1 --2- 172.21.15.44:0/1333185516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc200b42c0 0x7fbc200c9700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbc140097a0 tx=0x7fbc1402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9815ccf31e57be5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.830+0000 7fbc1dffb640 1 -- 172.21.15.44:0/1333185516 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14030610 con 0x7fbc200b42c0 2023-11-04T01:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.830+0000 7fbc1dffb640 1 -- 172.21.15.44:0/1333185516 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc14030770 con 0x7fbc200b42c0 2023-11-04T01:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.830+0000 7fbc1dffb640 1 -- 172.21.15.44:0/1333185516 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14030b00 con 0x7fbc200b42c0 2023-11-04T01:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.830+0000 7fbc254b4640 1 -- 172.21.15.44:0/1333185516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc200b42c0 msgr2=0x7fbc200c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.830+0000 7fbc254b4640 1 --2- 172.21.15.44:0/1333185516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc200b42c0 0x7fbc200c9700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbc140097a0 tx=0x7fbc1402b960 comp rx=0 tx=0).stop 2023-11-04T01:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.830+0000 7fbc254b4640 1 -- 172.21.15.44:0/1333185516 shutdown_connections 2023-11-04T01:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.830+0000 7fbc254b4640 1 --2- 172.21.15.44:0/1333185516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc200c9c40 0x7fbc200b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.830+0000 7fbc254b4640 1 --2- 172.21.15.44:0/1333185516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc200b42c0 0x7fbc200c9700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.830+0000 7fbc254b4640 1 -- 172.21.15.44:0/1333185516 >> 172.21.15.44:0/1333185516 conn(0x7fbc200ce950 msgr2=0x7fbc200ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.830+0000 7fbc254b4640 1 -- 172.21.15.44:0/1333185516 shutdown_connections 2023-11-04T01:36:36.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.830+0000 7fbc254b4640 1 -- 172.21.15.44:0/1333185516 wait complete. 2023-11-04T01:36:36.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.832+0000 7fbc254b4640 1 Processor -- start 2023-11-04T01:36:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.832+0000 7fbc254b4640 1 -- start start 2023-11-04T01:36:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.832+0000 7fbc254b4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc200b42c0 0x7fbc201f10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.832+0000 7fbc254b4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc200c9c40 0x7fbc20156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.832+0000 7fbc254b4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc2015ad80 0x7fbc200a7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.832+0000 7fbc254b4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2015cf50 con 0x7fbc200b42c0 2023-11-04T01:36:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.832+0000 7fbc254b4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2015d3e0 con 0x7fbc2015ad80 2023-11-04T01:36:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.832+0000 7fbc254b4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc201f1630 con 0x7fbc200c9c40 2023-11-04T01:36:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc1effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc200b42c0 0x7fbc201f10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc1effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc200b42c0 0x7fbc201f10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46318/0 (socket says 172.21.15.44:46318) 2023-11-04T01:36:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc1effd640 1 -- 172.21.15.44:0/3269183498 learned_addr learned my addr 172.21.15.44:0/3269183498 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc1f7fe640 1 --2- 172.21.15.44:0/3269183498 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc2015ad80 0x7fbc200a7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc1e7fc640 1 --2- 172.21.15.44:0/3269183498 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc200c9c40 0x7fbc20156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc1effd640 1 -- 172.21.15.44:0/3269183498 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc200c9c40 msgr2=0x7fbc20156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc1effd640 1 --2- 172.21.15.44:0/3269183498 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc200c9c40 0x7fbc20156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc1effd640 1 -- 172.21.15.44:0/3269183498 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc2015ad80 msgr2=0x7fbc200a7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc1effd640 1 --2- 172.21.15.44:0/3269183498 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc2015ad80 0x7fbc200a7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc1effd640 1 -- 172.21.15.44:0/3269183498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc18009b30 con 0x7fbc200b42c0 2023-11-04T01:36:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc1e7fc640 1 --2- 172.21.15.44:0/3269183498 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc200c9c40 0x7fbc20156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc1effd640 1 --2- 172.21.15.44:0/3269183498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc200b42c0 0x7fbc201f10f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000c410 tx=0x7fbc1000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc077fe640 1 -- 172.21.15.44:0/3269183498 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc100035f0 con 0x7fbc200b42c0 2023-11-04T01:36:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc077fe640 1 -- 172.21.15.44:0/3269183498 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc10003770 con 0x7fbc200b42c0 2023-11-04T01:36:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc077fe640 1 -- 172.21.15.44:0/3269183498 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10003b20 con 0x7fbc200b42c0 2023-11-04T01:36:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc254b4640 1 -- 172.21.15.44:0/3269183498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc14009400 con 0x7fbc200b42c0 2023-11-04T01:36:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.833+0000 7fbc254b4640 1 -- 172.21.15.44:0/3269183498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2015c340 con 0x7fbc200b42c0 2023-11-04T01:36:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.834+0000 7fbc254b4640 1 -- 172.21.15.44:0/3269183498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc20074290 con 0x7fbc200b42c0 2023-11-04T01:36:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.835+0000 7fbc077fe640 1 -- 172.21.15.44:0/3269183498 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc10003c80 con 0x7fbc200b42c0 2023-11-04T01:36:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.835+0000 7fbc077fe640 1 --2- 172.21.15.44:0/3269183498 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbc0c06aea0 0x7fbc0c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.835+0000 7fbc077fe640 1 -- 172.21.15.44:0/3269183498 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbc10088c80 con 0x7fbc200b42c0 2023-11-04T01:36:36.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.836+0000 7fbc1e7fc640 1 --2- 172.21.15.44:0/3269183498 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbc0c06aea0 0x7fbc0c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.836+0000 7fbc1e7fc640 1 --2- 172.21.15.44:0/3269183498 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbc0c06aea0 0x7fbc0c06d360 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbc14036000 tx=0x7fbc14008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:36.840+0000 7fbc077fe640 1 -- 172.21.15.44:0/3269183498 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc10053af0 con 0x7fbc200b42c0 2023-11-04T01:36:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:37.054+0000 7fbc254b4640 1 -- 172.21.15.44:0/3269183498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbc200ca090 con 0x7fbc200b42c0 2023-11-04T01:36:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:37.054+0000 7fbc077fe640 1 -- 172.21.15.44:0/3269183498 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbc200ca090 con 0x7fbc200b42c0 2023-11-04T01:36:37.055 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:36:37.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:37.056+0000 7fbc254b4640 1 -- 172.21.15.44:0/3269183498 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbc0c06aea0 msgr2=0x7fbc0c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:37.056+0000 7fbc254b4640 1 --2- 172.21.15.44:0/3269183498 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbc0c06aea0 0x7fbc0c06d360 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbc14036000 tx=0x7fbc14008030 comp rx=0 tx=0).stop 2023-11-04T01:36:37.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:37.056+0000 7fbc254b4640 1 -- 172.21.15.44:0/3269183498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc200b42c0 msgr2=0x7fbc201f10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:37.056+0000 7fbc254b4640 1 --2- 172.21.15.44:0/3269183498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc200b42c0 0x7fbc201f10f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000c410 tx=0x7fbc1000c8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:37.056+0000 7fbc254b4640 1 -- 172.21.15.44:0/3269183498 shutdown_connections 2023-11-04T01:36:37.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:37.056+0000 7fbc254b4640 1 --2- 172.21.15.44:0/3269183498 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbc0c06aea0 0x7fbc0c06d360 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:37.056+0000 7fbc254b4640 1 --2- 172.21.15.44:0/3269183498 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc2015ad80 0x7fbc200a7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:37.056+0000 7fbc254b4640 1 --2- 172.21.15.44:0/3269183498 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc200c9c40 0x7fbc20156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:37.056+0000 7fbc254b4640 1 --2- 172.21.15.44:0/3269183498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc200b42c0 0x7fbc201f10f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:37.056+0000 7fbc254b4640 1 -- 172.21.15.44:0/3269183498 >> 172.21.15.44:0/3269183498 conn(0x7fbc200ce950 msgr2=0x7fbc20072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:37.056+0000 7fbc254b4640 1 -- 172.21.15.44:0/3269183498 shutdown_connections 2023-11-04T01:36:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:37.056+0000 7fbc254b4640 1 -- 172.21.15.44:0/3269183498 wait complete. 2023-11-04T01:36:37.068 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:36:37.068 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:36:37.068 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi204.front.sepia.ceph.com 2023-11-04T01:36:37.068 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-04T01:36:37.068 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:37.068 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:36:37.069 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:36:37.069 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:36:37.069 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-04T01:36:37.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:37.069 DEBUG:teuthology.orchestra.run.smithi204:> ip addr 2023-11-04T01:36:37.085 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:37.085 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:37.085 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:37.085 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:37.085 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:37.085 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:37.085 INFO:teuthology.orchestra.run.smithi204.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:37.085 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2a brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:37.085 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f0 2023-11-04T01:36:37.085 INFO:teuthology.orchestra.run.smithi204.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:37.086 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2b brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:37.086 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f1 2023-11-04T01:36:37.086 INFO:teuthology.orchestra.run.smithi204.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:37.086 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:aa brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:37.086 INFO:teuthology.orchestra.run.smithi204.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:36:37.086 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:ab brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:37.086 INFO:teuthology.orchestra.run.smithi204.stdout: inet 172.21.15.204/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:36:37.086 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft 41805sec preferred_lft 41805sec 2023-11-04T01:36:37.086 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::ec4:7aff:fe88:77ab/64 scope link 2023-11-04T01:36:37.086 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:37.086 INFO:teuthology.orchestra.run.smithi204.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:36:37.086 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether d2:3e:7c:66:4e:75 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:37.087 INFO:teuthology.orchestra.run.smithi204.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:36:37.087 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:37.087 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::f0fb:8ff:feb8:d88b/64 scope link 2023-11-04T01:36:37.087 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:37.087 INFO:teuthology.orchestra.run.smithi204.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:36:37.087 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether d2:3e:7c:66:4e:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:37.087 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::d03e:7cff:fe66:4e75/64 scope link 2023-11-04T01:36:37.087 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:37.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:37.087 DEBUG:teuthology.orchestra.run.smithi204:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:36:37.150 INFO:teuthology.orchestra.run.smithi204.stdout:1 2023-11-04T01:36:37.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:37.152 DEBUG:teuthology.orchestra.run.smithi204:> route 2023-11-04T01:36:37.208 INFO:teuthology.orchestra.run.smithi204.stdout:Kernel IP routing table 2023-11-04T01:36:37.208 INFO:teuthology.orchestra.run.smithi204.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:36:37.209 INFO:teuthology.orchestra.run.smithi204.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:36:37.209 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:36:37.209 INFO:teuthology.orchestra.run.smithi204.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:36:37.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:37.209 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2023-11-04T01:36:37.209 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2023-11-04T01:36:37.209 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:36:37.209 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:36:37.209 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:36:37.210 DEBUG:teuthology.orchestra.run.smithi204:> ') 2023-11-04T01:36:37.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:37.304 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2023-11-04T01:36:37.323 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-04T01:36:37.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:37.324 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list-id 2023-11-04T01:36:37.378 INFO:teuthology.orchestra.run.smithi204.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-04T01:36:37.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:37.379 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2023-11-04T01:36:37.379 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2023-11-04T01:36:37.379 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:36:37.379 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-04T01:36:37.379 DEBUG:teuthology.orchestra.run.smithi204:> ') 2023-11-04T01:36:37.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:37.461 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-04T01:36:37.527 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:37.527 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:37.527 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:37.527 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:37.527 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:37.527 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:37.527 INFO:teuthology.orchestra.run.smithi204.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:36:37.527 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 62:de:ac:40:88:d4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:36:37.528 INFO:teuthology.orchestra.run.smithi204.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:36:37.528 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:37.528 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::60de:acff:fe40:88d4/64 scope link 2023-11-04T01:36:37.528 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:37.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:37.529 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-04T01:36:37.595 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:37.595 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:37.595 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:37.595 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:37.595 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:37.595 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:37.596 INFO:teuthology.orchestra.run.smithi204.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:36:37.596 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 62:de:ac:40:88:d4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:36:37.596 INFO:teuthology.orchestra.run.smithi204.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:36:37.596 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:37.596 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::60de:acff:fe40:88d4/64 scope link 2023-11-04T01:36:37.596 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:37.597 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-04T01:36:37.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:37.597 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2023-11-04T01:36:37.597 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2023-11-04T01:36:37.597 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-04T01:36:37.597 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-04T01:36:37.598 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-04T01:36:37.598 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-04T01:36:37.598 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-04T01:36:37.598 DEBUG:teuthology.orchestra.run.smithi204:> ') 2023-11-04T01:36:37.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:37.723 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2023-11-04T01:36:37.723 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2023-11-04T01:36:37.723 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set brx.1 up 2023-11-04T01:36:37.723 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set dev brx.1 master ceph-brx 2023-11-04T01:36:37.723 DEBUG:teuthology.orchestra.run.smithi204:> ') 2023-11-04T01:36:37.765 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-04T01:36:37.765 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:37.765 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:37.825 INFO:teuthology.orchestra.run.smithi204.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-04T01:36:37.825 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:37.825 DEBUG:teuthology.orchestra.run.smithi204:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:37.881 DEBUG:teuthology.orchestra.run.smithi204:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:37.938 INFO:teuthology.orchestra.run.smithi204.stdout:/proc 2023-11-04T01:36:37.938 INFO:teuthology.orchestra.run.smithi204.stdout:/sys 2023-11-04T01:36:37.938 INFO:teuthology.orchestra.run.smithi204.stdout:/dev 2023-11-04T01:36:37.939 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/security 2023-11-04T01:36:37.939 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/shm 2023-11-04T01:36:37.939 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/pts 2023-11-04T01:36:37.939 INFO:teuthology.orchestra.run.smithi204.stdout:/run 2023-11-04T01:36:37.939 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/cgroup 2023-11-04T01:36:37.939 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/pstore 2023-11-04T01:36:37.940 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/bpf 2023-11-04T01:36:37.940 INFO:teuthology.orchestra.run.smithi204.stdout:/ 2023-11-04T01:36:37.940 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/selinux 2023-11-04T01:36:37.940 INFO:teuthology.orchestra.run.smithi204.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:37.940 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/mqueue 2023-11-04T01:36:37.940 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/hugepages 2023-11-04T01:36:37.941 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/debug 2023-11-04T01:36:37.941 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/tracing 2023-11-04T01:36:37.941 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:37.941 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/config 2023-11-04T01:36:37.941 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:37.942 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:37.942 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:37.942 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:37.942 INFO:teuthology.orchestra.run.smithi204.stdout:/run/user/1000 2023-11-04T01:36:37.942 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph 2023-11-04T01:36:37.942 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:36:37.942 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:36:37.942 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:36:37.942 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:36:37.942 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns 2023-11-04T01:36:37.942 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:37.942 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:37.943 INFO:teuthology.orchestra.run.smithi204.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:37.943 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:36:37.943 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:36:37.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:37.943 DEBUG:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2023-11-04T01:36:37.994 INFO:teuthology.orchestra.run.smithi204.stdout:43 2023-11-04T01:36:37.994 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-04T01:36:37.994 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-04T01:36:38.036 DEBUG:teuthology.orchestra.run.smithi204:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:38.051 INFO:teuthology.orchestra.run.smithi204.stdout:/proc 2023-11-04T01:36:38.052 INFO:teuthology.orchestra.run.smithi204.stdout:/sys 2023-11-04T01:36:38.052 INFO:teuthology.orchestra.run.smithi204.stdout:/dev 2023-11-04T01:36:38.052 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/security 2023-11-04T01:36:38.052 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/shm 2023-11-04T01:36:38.052 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/pts 2023-11-04T01:36:38.052 INFO:teuthology.orchestra.run.smithi204.stdout:/run 2023-11-04T01:36:38.053 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/cgroup 2023-11-04T01:36:38.053 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/pstore 2023-11-04T01:36:38.053 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/bpf 2023-11-04T01:36:38.053 INFO:teuthology.orchestra.run.smithi204.stdout:/ 2023-11-04T01:36:38.053 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/selinux 2023-11-04T01:36:38.053 INFO:teuthology.orchestra.run.smithi204.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:38.053 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/mqueue 2023-11-04T01:36:38.053 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/hugepages 2023-11-04T01:36:38.054 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/debug 2023-11-04T01:36:38.054 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/tracing 2023-11-04T01:36:38.055 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:38.055 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/config 2023-11-04T01:36:38.055 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:38.055 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:38.055 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:38.055 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:38.056 INFO:teuthology.orchestra.run.smithi204.stdout:/run/user/1000 2023-11-04T01:36:38.056 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph 2023-11-04T01:36:38.056 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:36:38.056 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:36:38.056 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:36:38.056 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:36:38.056 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns 2023-11-04T01:36:38.057 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:38.057 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:38.057 INFO:teuthology.orchestra.run.smithi204.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:38.057 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:36:38.057 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:36:38.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:38.057 DEBUG:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2023-11-04T01:36:38.107 INFO:teuthology.orchestra.run.smithi204.stdout:43 2023-11-04T01:36:38.127 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi204.stderr:2023-11-04T01:36:38.125+0000 7f11fc84c480 -1 init, newargv = 0x5631ed97b7b0 newargc=15 2023-11-04T01:36:38.127 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi204.stderr:ceph-fuse[125064]: starting ceph client 2023-11-04T01:36:38.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi204.stderr:ceph-fuse[125064]: starting fuse 2023-11-04T01:36:39.210 DEBUG:teuthology.orchestra.run.smithi204:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:39.230 INFO:teuthology.orchestra.run.smithi204.stdout:/proc 2023-11-04T01:36:39.233 INFO:teuthology.orchestra.run.smithi204.stdout:/sys 2023-11-04T01:36:39.233 INFO:teuthology.orchestra.run.smithi204.stdout:/dev 2023-11-04T01:36:39.233 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/security 2023-11-04T01:36:39.234 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/shm 2023-11-04T01:36:39.234 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/pts 2023-11-04T01:36:39.234 INFO:teuthology.orchestra.run.smithi204.stdout:/run 2023-11-04T01:36:39.234 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/cgroup 2023-11-04T01:36:39.235 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/pstore 2023-11-04T01:36:39.235 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/bpf 2023-11-04T01:36:39.235 INFO:teuthology.orchestra.run.smithi204.stdout:/ 2023-11-04T01:36:39.235 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/selinux 2023-11-04T01:36:39.235 INFO:teuthology.orchestra.run.smithi204.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:39.236 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/mqueue 2023-11-04T01:36:39.236 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/hugepages 2023-11-04T01:36:39.236 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/debug 2023-11-04T01:36:39.236 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/tracing 2023-11-04T01:36:39.236 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:39.236 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/config 2023-11-04T01:36:39.236 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:39.236 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:39.236 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:39.236 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:39.236 INFO:teuthology.orchestra.run.smithi204.stdout:/run/user/1000 2023-11-04T01:36:39.236 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph 2023-11-04T01:36:39.236 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:36:39.237 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:36:39.237 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:36:39.237 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:36:39.237 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns 2023-11-04T01:36:39.237 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:39.237 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:39.237 INFO:teuthology.orchestra.run.smithi204.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:39.237 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:36:39.237 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:36:39.237 INFO:teuthology.orchestra.run.smithi204.stdout:/home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:39.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:39.238 DEBUG:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2023-11-04T01:36:39.288 INFO:teuthology.orchestra.run.smithi204.stdout:43 2023-11-04T01:36:39.288 INFO:teuthology.orchestra.run.smithi204.stdout:44 2023-11-04T01:36:39.289 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-04T01:36:39.289 DEBUG:teuthology.orchestra.run.smithi204:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:36:39.289 DEBUG:teuthology.orchestra.run.smithi204:> import glob 2023-11-04T01:36:39.289 DEBUG:teuthology.orchestra.run.smithi204:> import re 2023-11-04T01:36:39.290 DEBUG:teuthology.orchestra.run.smithi204:> import os 2023-11-04T01:36:39.290 DEBUG:teuthology.orchestra.run.smithi204:> import subprocess 2023-11-04T01:36:39.290 DEBUG:teuthology.orchestra.run.smithi204:> 2023-11-04T01:36:39.290 DEBUG:teuthology.orchestra.run.smithi204:> def _find_admin_socket(client_name): 2023-11-04T01:36:39.290 DEBUG:teuthology.orchestra.run.smithi204:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-04T01:36:39.290 DEBUG:teuthology.orchestra.run.smithi204:> files = glob.glob(asok_path) 2023-11-04T01:36:39.291 DEBUG:teuthology.orchestra.run.smithi204:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-04T01:36:39.291 DEBUG:teuthology.orchestra.run.smithi204:> 2023-11-04T01:36:39.291 DEBUG:teuthology.orchestra.run.smithi204:> # Given a non-glob path, it better be there 2023-11-04T01:36:39.291 DEBUG:teuthology.orchestra.run.smithi204:> if "*" not in asok_path: 2023-11-04T01:36:39.291 DEBUG:teuthology.orchestra.run.smithi204:> assert(len(files) == 1) 2023-11-04T01:36:39.291 DEBUG:teuthology.orchestra.run.smithi204:> return files[0] 2023-11-04T01:36:39.292 DEBUG:teuthology.orchestra.run.smithi204:> 2023-11-04T01:36:39.292 DEBUG:teuthology.orchestra.run.smithi204:> for f in files: 2023-11-04T01:36:39.292 DEBUG:teuthology.orchestra.run.smithi204:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:36:39.292 DEBUG:teuthology.orchestra.run.smithi204:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:36:39.292 DEBUG:teuthology.orchestra.run.smithi204:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:36:39.292 DEBUG:teuthology.orchestra.run.smithi204:> contents = proc_f.read() 2023-11-04T01:36:39.293 DEBUG:teuthology.orchestra.run.smithi204:> if mountpoint in contents: 2023-11-04T01:36:39.293 DEBUG:teuthology.orchestra.run.smithi204:> return f 2023-11-04T01:36:39.293 DEBUG:teuthology.orchestra.run.smithi204:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:36:39.293 DEBUG:teuthology.orchestra.run.smithi204:> 2023-11-04T01:36:39.293 DEBUG:teuthology.orchestra.run.smithi204:> print(_find_admin_socket("client.3")) 2023-11-04T01:36:39.293 DEBUG:teuthology.orchestra.run.smithi204:> ' 2023-11-04T01:36:39.416 INFO:teuthology.orchestra.run.smithi204.stdout:/var/run/ceph/ceph-client.3.125064.asok 2023-11-04T01:36:39.419 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:39.427 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.125064.asok 2023-11-04T01:36:39.427 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:39.427 DEBUG:teuthology.orchestra.run.smithi204:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.3.125064.asok status 2023-11-04T01:36:39.526 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:39.596 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2023-11-04T01:36:39.596 INFO:teuthology.orchestra.run.smithi204.stdout: "metadata": { 2023-11-04T01:36:39.596 INFO:teuthology.orchestra.run.smithi204.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:36:39.596 INFO:teuthology.orchestra.run.smithi204.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:36:39.596 INFO:teuthology.orchestra.run.smithi204.stdout: "entity_id": "3", 2023-11-04T01:36:39.596 INFO:teuthology.orchestra.run.smithi204.stdout: "hostname": "smithi204", 2023-11-04T01:36:39.596 INFO:teuthology.orchestra.run.smithi204.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-04T01:36:39.596 INFO:teuthology.orchestra.run.smithi204.stdout: "pid": "125064", 2023-11-04T01:36:39.597 INFO:teuthology.orchestra.run.smithi204.stdout: "root": "/" 2023-11-04T01:36:39.597 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2023-11-04T01:36:39.597 INFO:teuthology.orchestra.run.smithi204.stdout: "dentry_count": 0, 2023-11-04T01:36:39.597 INFO:teuthology.orchestra.run.smithi204.stdout: "dentry_pinned_count": 0, 2023-11-04T01:36:39.597 INFO:teuthology.orchestra.run.smithi204.stdout: "id": 4834, 2023-11-04T01:36:39.597 INFO:teuthology.orchestra.run.smithi204.stdout: "inst": { 2023-11-04T01:36:39.597 INFO:teuthology.orchestra.run.smithi204.stdout: "name": { 2023-11-04T01:36:39.597 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "client", 2023-11-04T01:36:39.597 INFO:teuthology.orchestra.run.smithi204.stdout: "num": 4834 2023-11-04T01:36:39.597 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2023-11-04T01:36:39.597 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": { 2023-11-04T01:36:39.597 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "v1", 2023-11-04T01:36:39.598 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:36:39.598 INFO:teuthology.orchestra.run.smithi204.stdout: "nonce": 380346358 2023-11-04T01:36:39.598 INFO:teuthology.orchestra.run.smithi204.stdout: } 2023-11-04T01:36:39.598 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2023-11-04T01:36:39.598 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": { 2023-11-04T01:36:39.598 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "v1", 2023-11-04T01:36:39.598 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:36:39.598 INFO:teuthology.orchestra.run.smithi204.stdout: "nonce": 380346358 2023-11-04T01:36:39.598 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2023-11-04T01:36:39.598 INFO:teuthology.orchestra.run.smithi204.stdout: "inst_str": "client.4834 192.168.0.2:0/380346358", 2023-11-04T01:36:39.598 INFO:teuthology.orchestra.run.smithi204.stdout: "addr_str": "192.168.0.2:0/380346358", 2023-11-04T01:36:39.598 INFO:teuthology.orchestra.run.smithi204.stdout: "inode_count": 1, 2023-11-04T01:36:39.598 INFO:teuthology.orchestra.run.smithi204.stdout: "mds_epoch": 9, 2023-11-04T01:36:39.599 INFO:teuthology.orchestra.run.smithi204.stdout: "osd_epoch": 24, 2023-11-04T01:36:39.599 INFO:teuthology.orchestra.run.smithi204.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:36:39.599 INFO:teuthology.orchestra.run.smithi204.stdout: "blocklisted": false, 2023-11-04T01:36:39.599 INFO:teuthology.orchestra.run.smithi204.stdout: "fs_name": "cephfs" 2023-11-04T01:36:39.599 INFO:teuthology.orchestra.run.smithi204.stdout:} 2023-11-04T01:36:39.603 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:39.613 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:39.613 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:36:39.613 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:39.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2023-11-04T01:36:39.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:39.695 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:39.696 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:39.696 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:39.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:39.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:39.770 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:39.770 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:36:39.770 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:39.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:39.835 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2023-11-04T01:36:39.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:39.841 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:39.842 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:39.842 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:39.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:39.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:39.912 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:39.912 DEBUG:teuthology.orchestra.run.smithi204:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:36:39.912 DEBUG:teuthology.orchestra.run.smithi204:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:39.970 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:39.971 INFO:teuthology.orchestra.run.smithi204.stdout:fuseblk 2023-11-04T01:36:39.971 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:39.978 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:39.979 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:39.979 DEBUG:teuthology.orchestra.run.smithi204:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:40.038 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:40.038 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:40.045 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:40.045 DEBUG:teuthology.orchestra.run.smithi204:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:36:40.045 DEBUG:teuthology.orchestra.run.smithi204:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:40.103 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:40.103 INFO:teuthology.orchestra.run.smithi204.stdout:fuseblk 2023-11-04T01:36:40.103 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:40.110 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:40.110 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:40.110 DEBUG:teuthology.orchestra.run.smithi204:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:40.168 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:40.169 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:40.175 INFO:teuthology.run_tasks:Running task exec... 2023-11-04T01:36:40.188 INFO:teuthology.task.exec:Executing custom commands... 2023-11-04T01:36:40.188 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:36:40.188 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/crash/warn_recent_interval 0' 2023-11-04T01:36:40.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.296+0000 7f9327589640 1 Processor -- start 2023-11-04T01:36:40.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.296+0000 7f9327589640 1 -- start start 2023-11-04T01:36:40.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9327589640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f93200b2ef0 0x7f93200cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9327589640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f93200b3380 0x7f93200cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9327589640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93200d00a0 con 0x7f932015ad20 2023-11-04T01:36:40.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9327589640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932015e990 con 0x7f93200b3380 2023-11-04T01:36:40.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9327589640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932006de80 con 0x7f93200b2ef0 2023-11-04T01:36:40.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9325b26640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f93200b3380 0x7f93200cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9325b26640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f93200b3380 0x7f93200cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46334/0 (socket says 172.21.15.44:46334) 2023-11-04T01:36:40.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9325b26640 1 -- 172.21.15.44:0/1600338106 learned_addr learned my addr 172.21.15.44:0/1600338106 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:40.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9325325640 1 --1- 172.21.15.44:0/1600338106 >> v1:172.21.15.44:6789/0 conn(0x7f932015ad20 0x7f93200cf990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41286/0 (socket says 172.21.15.44:41286) 2023-11-04T01:36:40.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9324b24640 1 --2- 172.21.15.44:0/1600338106 >> v2:172.21.15.204:3300/0 conn(0x7f93200b2ef0 0x7f93200cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9325b26640 1 -- 172.21.15.44:0/1600338106 >> v2:172.21.15.204:3300/0 conn(0x7f93200b2ef0 msgr2=0x7f93200cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:40.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9325b26640 1 --2- 172.21.15.44:0/1600338106 >> v2:172.21.15.204:3300/0 conn(0x7f93200b2ef0 0x7f93200cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9325b26640 1 -- 172.21.15.44:0/1600338106 >> v1:172.21.15.44:6789/0 conn(0x7f932015ad20 legacy=0x7f93200cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9317fff640 1 -- 172.21.15.44:0/1600338106 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403245888 0 0) 0x7f93200d00a0 con 0x7f932015ad20 2023-11-04T01:36:40.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9325b26640 1 -- 172.21.15.44:0/1600338106 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932006e160 con 0x7f93200b3380 2023-11-04T01:36:40.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.297+0000 7f9324b24640 1 --2- 172.21.15.44:0/1600338106 >> v2:172.21.15.204:3300/0 conn(0x7f93200b2ef0 0x7f93200cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:40.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.298+0000 7f9325b26640 1 --2- 172.21.15.44:0/1600338106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93200b3380 0x7f93200cdb50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f932006ead0 tx=0x7f931802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfab3d9b880974e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.298+0000 7f9317fff640 1 -- 172.21.15.44:0/1600338106 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931802cb20 con 0x7f93200b3380 2023-11-04T01:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.298+0000 7f9317fff640 1 -- 172.21.15.44:0/1600338106 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931802cc80 con 0x7f93200b3380 2023-11-04T01:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.298+0000 7f9317fff640 1 -- 172.21.15.44:0/1600338106 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93180343f0 con 0x7f93200b3380 2023-11-04T01:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.299+0000 7f9327589640 1 -- 172.21.15.44:0/1600338106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93200b3380 msgr2=0x7f93200cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.299+0000 7f9327589640 1 --2- 172.21.15.44:0/1600338106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93200b3380 0x7f93200cdb50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f932006ead0 tx=0x7f931802bf80 comp rx=0 tx=0).stop 2023-11-04T01:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.299+0000 7f9327589640 1 -- 172.21.15.44:0/1600338106 shutdown_connections 2023-11-04T01:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.299+0000 7f9327589640 1 --2- 172.21.15.44:0/1600338106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93200b3380 0x7f93200cdb50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.299+0000 7f9327589640 1 --2- 172.21.15.44:0/1600338106 >> v2:172.21.15.204:3300/0 conn(0x7f93200b2ef0 0x7f93200cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.299+0000 7f9327589640 1 -- 172.21.15.44:0/1600338106 >> 172.21.15.44:0/1600338106 conn(0x7f93200734d0 msgr2=0x7f93200738b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.299+0000 7f9327589640 1 -- 172.21.15.44:0/1600338106 shutdown_connections 2023-11-04T01:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.299+0000 7f9327589640 1 -- 172.21.15.44:0/1600338106 wait complete. 2023-11-04T01:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.300+0000 7f9327589640 1 Processor -- start 2023-11-04T01:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.300+0000 7f9327589640 1 -- start start 2023-11-04T01:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9327589640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93200b2ef0 0x7f932006c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9327589640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93200b3380 0x7f93201f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9327589640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f932015ad20 0x7f93200ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9327589640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932006b670 con 0x7f932015ad20 2023-11-04T01:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9327589640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932006b950 con 0x7f93200b2ef0 2023-11-04T01:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9327589640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932006bc30 con 0x7f93200b3380 2023-11-04T01:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9325b26640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f932015ad20 0x7f93200ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9325b26640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f932015ad20 0x7f93200ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46338/0 (socket says 172.21.15.44:46338) 2023-11-04T01:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9325b26640 1 -- 172.21.15.44:0/2014990933 learned_addr learned my addr 172.21.15.44:0/2014990933 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9324b24640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93200b3380 0x7f93201f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9325325640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93200b2ef0 0x7f932006c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9325b26640 1 -- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93200b3380 msgr2=0x7f93201f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9325b26640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93200b3380 0x7f93201f1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9325b26640 1 -- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93200b2ef0 msgr2=0x7f932006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9325b26640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93200b2ef0 0x7f932006c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9325b26640 1 -- 172.21.15.44:0/2014990933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9318009b30 con 0x7f932015ad20 2023-11-04T01:36:40.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9324b24640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93200b3380 0x7f93201f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:40.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9325325640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93200b2ef0 0x7f932006c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:40.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9325b26640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f932015ad20 0x7f93200ca870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9318036040 tx=0x7f9318004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9315ffb640 1 -- 172.21.15.44:0/2014990933 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318009510 con 0x7f932015ad20 2023-11-04T01:36:40.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9315ffb640 1 -- 172.21.15.44:0/2014990933 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318007e50 con 0x7f932015ad20 2023-11-04T01:36:40.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9315ffb640 1 -- 172.21.15.44:0/2014990933 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931803e670 con 0x7f932015ad20 2023-11-04T01:36:40.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.301+0000 7f9327589640 1 -- 172.21.15.44:0/2014990933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932006bf10 con 0x7f932015ad20 2023-11-04T01:36:40.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.302+0000 7f9327589640 1 -- 172.21.15.44:0/2014990933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93201f2160 con 0x7f932015ad20 2023-11-04T01:36:40.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.303+0000 7f9327589640 1 -- 172.21.15.44:0/2014990933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932006c430 con 0x7f932015ad20 2023-11-04T01:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.303+0000 7f9315ffb640 1 -- 172.21.15.44:0/2014990933 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f931803e7d0 con 0x7f932015ad20 2023-11-04T01:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.304+0000 7f9315ffb640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f930406ae70 0x7f930406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.304+0000 7f9315ffb640 1 -- 172.21.15.44:0/2014990933 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f93180ac5f0 con 0x7f932015ad20 2023-11-04T01:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.304+0000 7f9325325640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f930406ae70 0x7f930406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.304+0000 7f9325325640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f930406ae70 0x7f930406d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f931c000f60 tx=0x7f931c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.308+0000 7f9315ffb640 1 -- 172.21.15.44:0/2014990933 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f932006c430 con 0x7f932015ad20 2023-11-04T01:36:40.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.493+0000 7f9327589640 1 -- 172.21.15.44:0/2014990933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mgr/crash/warn_recent_interval}] v 0) v1 -- 0x7f932006c430 con 0x7f932015ad20 2023-11-04T01:36:40.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.496+0000 7f9315ffb640 1 -- 172.21.15.44:0/2014990933 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/crash/warn_recent_interval}]=0 v10)=0 v10) v1 ==== 128+0+0 (secure 0 0 0) 0x7f932006c430 con 0x7f932015ad20 2023-11-04T01:36:40.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.498+0000 7f9327589640 1 -- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f930406ae70 msgr2=0x7f930406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.498+0000 7f9327589640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f930406ae70 0x7f930406d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f931c000f60 tx=0x7f931c009040 comp rx=0 tx=0).stop 2023-11-04T01:36:40.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.498+0000 7f9327589640 1 -- 172.21.15.44:0/2014990933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f932015ad20 msgr2=0x7f93200ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.498+0000 7f9327589640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f932015ad20 0x7f93200ca870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9318036040 tx=0x7f9318004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.498+0000 7f9327589640 1 -- 172.21.15.44:0/2014990933 shutdown_connections 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.498+0000 7f9327589640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f930406ae70 0x7f930406d330 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.498+0000 7f9327589640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f932015ad20 0x7f93200ca870 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.498+0000 7f9327589640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93200b3380 0x7f93201f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.498+0000 7f9327589640 1 --2- 172.21.15.44:0/2014990933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93200b2ef0 0x7f932006c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.498+0000 7f9327589640 1 -- 172.21.15.44:0/2014990933 >> 172.21.15.44:0/2014990933 conn(0x7f93200734d0 msgr2=0x7f93200b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.498+0000 7f9327589640 1 -- 172.21.15.44:0/2014990933 shutdown_connections 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.498+0000 7f9327589640 1 -- 172.21.15.44:0/2014990933 wait complete. 2023-11-04T01:36:40.511 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-04T01:36:40.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:40.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.634+0000 7f78f432c640 1 Processor -- start 2023-11-04T01:36:40.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.635+0000 7f78f432c640 1 -- start start 2023-11-04T01:36:40.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.635+0000 7f78f432c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78ec06a830 0x7f78ec0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.635+0000 7f78f432c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec06d310 con 0x7f78ec06eba0 2023-11-04T01:36:40.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.635+0000 7f78f432c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec15d860 con 0x7f78ec15ab70 2023-11-04T01:36:40.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.635+0000 7f78f432c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0cba70 con 0x7f78ec06a830 2023-11-04T01:36:40.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.636+0000 7f78f28c9640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f78ec06eba0 0x7f78ec0ae5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41288/0 (socket says 172.21.15.44:41288) 2023-11-04T01:36:40.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.636+0000 7f78f28c9640 1 -- 172.21.15.44:0/2271317732 learned_addr learned my addr 172.21.15.44:0/2271317732 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:40.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.636+0000 7f78f18c7640 1 --2- 172.21.15.44:0/2271317732 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78ec06a830 0x7f78ec0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.636+0000 7f78f10c6640 1 -- 172.21.15.44:0/2271317732 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719266807 0 0) 0x7f78ec06d310 con 0x7f78ec06eba0 2023-11-04T01:36:40.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.636+0000 7f78f10c6640 1 -- 172.21.15.44:0/2271317732 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78d8003520 con 0x7f78ec06eba0 2023-11-04T01:36:40.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.636+0000 7f78f10c6640 1 -- 172.21.15.44:0/2271317732 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567703483 0 0) 0x7f78ec15d860 con 0x7f78ec15ab70 2023-11-04T01:36:40.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.636+0000 7f78f10c6640 1 -- 172.21.15.44:0/2271317732 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78ec06d310 con 0x7f78ec15ab70 2023-11-04T01:36:40.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.636+0000 7f78f10c6640 1 -- 172.21.15.44:0/2271317732 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 999030455 0 0) 0x7f78d8003520 con 0x7f78ec06eba0 2023-11-04T01:36:40.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.636+0000 7f78f18c7640 1 -- 172.21.15.44:0/2271317732 >> v1:172.21.15.204:6789/0 conn(0x7f78ec15ab70 legacy=0x7f78ec06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.636+0000 7f78f18c7640 1 -- 172.21.15.44:0/2271317732 >> v1:172.21.15.44:6789/0 conn(0x7f78ec06eba0 legacy=0x7f78ec0ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.636+0000 7f78f18c7640 1 -- 172.21.15.44:0/2271317732 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec15db40 con 0x7f78ec06a830 2023-11-04T01:36:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.637+0000 7f78f18c7640 1 --2- 172.21.15.44:0/2271317732 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78ec06a830 0x7f78ec0cbea0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0097c0 tx=0x7f78dc02b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3404d8a08441788d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.637+0000 7f78f10c6640 1 -- 172.21.15.44:0/2271317732 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e40019f0 con 0x7f78ec06a830 2023-11-04T01:36:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.637+0000 7f78f10c6640 1 -- 172.21.15.44:0/2271317732 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc02e050 con 0x7f78ec06a830 2023-11-04T01:36:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.637+0000 7f78f10c6640 1 -- 172.21.15.44:0/2271317732 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc030730 con 0x7f78ec06a830 2023-11-04T01:36:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.638+0000 7f78f432c640 1 -- 172.21.15.44:0/2271317732 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78ec06a830 msgr2=0x7f78ec0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.638+0000 7f78f432c640 1 --2- 172.21.15.44:0/2271317732 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78ec06a830 0x7f78ec0cbea0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0097c0 tx=0x7f78dc02b760 comp rx=0 tx=0).stop 2023-11-04T01:36:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.638+0000 7f78f432c640 1 -- 172.21.15.44:0/2271317732 shutdown_connections 2023-11-04T01:36:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.638+0000 7f78f432c640 1 --2- 172.21.15.44:0/2271317732 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78ec06a830 0x7f78ec0cbea0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.638+0000 7f78f432c640 1 -- 172.21.15.44:0/2271317732 >> 172.21.15.44:0/2271317732 conn(0x7f78ec098d40 msgr2=0x7f78ec0cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.638+0000 7f78f432c640 1 -- 172.21.15.44:0/2271317732 shutdown_connections 2023-11-04T01:36:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.638+0000 7f78f432c640 1 -- 172.21.15.44:0/2271317732 wait complete. 2023-11-04T01:36:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.639+0000 7f78f432c640 1 Processor -- start 2023-11-04T01:36:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.639+0000 7f78f432c640 1 -- start start 2023-11-04T01:36:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f432c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78ec06a830 0x7f78ec155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f432c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78ec06eba0 0x7f78ec1f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f432c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78ec15ab70 0x7f78ec1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f432c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec161c50 con 0x7f78ec06eba0 2023-11-04T01:36:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f432c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0c34e0 con 0x7f78ec06a830 2023-11-04T01:36:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f432c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0c36f0 con 0x7f78ec15ab70 2023-11-04T01:36:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f18c7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78ec06eba0 0x7f78ec1f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f18c7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78ec06eba0 0x7f78ec1f3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46348/0 (socket says 172.21.15.44:46348) 2023-11-04T01:36:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f18c7640 1 -- 172.21.15.44:0/357148695 learned_addr learned my addr 172.21.15.44:0/357148695 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f20c8640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78ec06a830 0x7f78ec155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f28c9640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78ec15ab70 0x7f78ec1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f18c7640 1 -- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78ec15ab70 msgr2=0x7f78ec1579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f18c7640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78ec15ab70 0x7f78ec1579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f18c7640 1 -- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78ec06a830 msgr2=0x7f78ec155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f18c7640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78ec06a830 0x7f78ec155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f18c7640 1 -- 172.21.15.44:0/357148695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc0093a0 con 0x7f78ec06eba0 2023-11-04T01:36:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f20c8640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78ec06a830 0x7f78ec155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:40.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f28c9640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78ec15ab70 0x7f78ec1579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:40.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78f18c7640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78ec06eba0 0x7f78ec1f3130 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f78dc035040 tx=0x7f78dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.640+0000 7f78e2ffd640 1 -- 172.21.15.44:0/357148695 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc005b90 con 0x7f78ec06eba0 2023-11-04T01:36:40.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.641+0000 7f78e2ffd640 1 -- 172.21.15.44:0/357148695 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc005d30 con 0x7f78ec06eba0 2023-11-04T01:36:40.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.641+0000 7f78f432c640 1 -- 172.21.15.44:0/357148695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec0c39d0 con 0x7f78ec06eba0 2023-11-04T01:36:40.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.641+0000 7f78e2ffd640 1 -- 172.21.15.44:0/357148695 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc005ea0 con 0x7f78ec06eba0 2023-11-04T01:36:40.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.641+0000 7f78f432c640 1 -- 172.21.15.44:0/357148695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ec0c3f90 con 0x7f78ec06eba0 2023-11-04T01:36:40.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.641+0000 7f78f432c640 1 -- 172.21.15.44:0/357148695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ec074290 con 0x7f78ec06eba0 2023-11-04T01:36:40.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.642+0000 7f78e2ffd640 1 -- 172.21.15.44:0/357148695 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f78dc039040 con 0x7f78ec06eba0 2023-11-04T01:36:40.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.642+0000 7f78e2ffd640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f78d006ae70 0x7f78d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.642+0000 7f78e2ffd640 1 -- 172.21.15.44:0/357148695 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f78dc0aaee0 con 0x7f78ec06eba0 2023-11-04T01:36:40.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.643+0000 7f78f20c8640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f78d006ae70 0x7f78d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.643+0000 7f78f20c8640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f78d006ae70 0x7f78d006d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f78e8001230 tx=0x7f78e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.647+0000 7f78e2ffd640 1 -- 172.21.15.44:0/357148695 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78dc075c60 con 0x7f78ec06eba0 2023-11-04T01:36:40.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.827+0000 7f78f432c640 1 -- 172.21.15.44:0/357148695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78ec0ce4c0 con 0x7f78ec06eba0 2023-11-04T01:36:40.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.828+0000 7f78e2ffd640 1 -- 172.21.15.44:0/357148695 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7f78dc037070 con 0x7f78ec06eba0 2023-11-04T01:36:40.830 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:40.830 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:40.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.830+0000 7f78f432c640 1 -- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f78d006ae70 msgr2=0x7f78d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.830+0000 7f78f432c640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f78d006ae70 0x7f78d006d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f78e8001230 tx=0x7f78e8009040 comp rx=0 tx=0).stop 2023-11-04T01:36:40.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.830+0000 7f78f432c640 1 -- 172.21.15.44:0/357148695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78ec06eba0 msgr2=0x7f78ec1f3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.830+0000 7f78f432c640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78ec06eba0 0x7f78ec1f3130 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f78dc035040 tx=0x7f78dc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.830+0000 7f78f432c640 1 -- 172.21.15.44:0/357148695 shutdown_connections 2023-11-04T01:36:40.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.830+0000 7f78f432c640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f78d006ae70 0x7f78d006d330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.830+0000 7f78f432c640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78ec15ab70 0x7f78ec1579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.830+0000 7f78f432c640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78ec06eba0 0x7f78ec1f3130 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.830+0000 7f78f432c640 1 --2- 172.21.15.44:0/357148695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78ec06a830 0x7f78ec155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.830+0000 7f78f432c640 1 -- 172.21.15.44:0/357148695 >> 172.21.15.44:0/357148695 conn(0x7f78ec098d40 msgr2=0x7f78ec06a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:40.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.830+0000 7f78f432c640 1 -- 172.21.15.44:0/357148695 shutdown_connections 2023-11-04T01:36:40.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.830+0000 7f78f432c640 1 -- 172.21.15.44:0/357148695 wait complete. 2023-11-04T01:36:40.846 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:40.846 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:40.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.954+0000 7f1b16a7c640 1 Processor -- start 2023-11-04T01:36:40.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.954+0000 7f1b16a7c640 1 -- start start 2023-11-04T01:36:40.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.954+0000 7f1b16a7c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1b100b2d30 0x7f1b1006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.954+0000 7f1b16a7c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1006ca40 con 0x7f1b10160430 2023-11-04T01:36:40.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.955+0000 7f1b16a7c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1006cd20 con 0x7f1b1006c1d0 2023-11-04T01:36:40.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.955+0000 7f1b16a7c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b100cb580 con 0x7f1b100b2d30 2023-11-04T01:36:40.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.955+0000 7f1b0ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1b100b2d30 0x7f1b1006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.955+0000 7f1b14818640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1b10160430 0x7f1b100b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41300/0 (socket says 172.21.15.44:41300) 2023-11-04T01:36:40.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.955+0000 7f1b14818640 1 -- 172.21.15.44:0/1881271290 learned_addr learned my addr 172.21.15.44:0/1881271290 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:40.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.955+0000 7f1b0ffff640 1 -- 172.21.15.44:0/1881271290 >> v1:172.21.15.204:6789/0 conn(0x7f1b1006c1d0 legacy=0x7f1b100cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.955+0000 7f1b0ffff640 1 -- 172.21.15.44:0/1881271290 >> v1:172.21.15.44:6789/0 conn(0x7f1b10160430 legacy=0x7f1b100b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.955+0000 7f1b0ffff640 1 -- 172.21.15.44:0/1881271290 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1006d000 con 0x7f1b100b2d30 2023-11-04T01:36:40.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.956+0000 7f1b0ffff640 1 --2- 172.21.15.44:0/1881271290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b100b2d30 0x7f1b1006bc90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0097d0 tx=0x7f1afc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c9460a73090e6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.956+0000 7f1b0f7fe640 1 -- 172.21.15.44:0/1881271290 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc030610 con 0x7f1b100b2d30 2023-11-04T01:36:40.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.956+0000 7f1b0f7fe640 1 -- 172.21.15.44:0/1881271290 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc030770 con 0x7f1b100b2d30 2023-11-04T01:36:40.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.956+0000 7f1b0f7fe640 1 -- 172.21.15.44:0/1881271290 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc030b00 con 0x7f1b100b2d30 2023-11-04T01:36:40.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.956+0000 7f1b16a7c640 1 -- 172.21.15.44:0/1881271290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b100b2d30 msgr2=0x7f1b1006bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.956+0000 7f1b16a7c640 1 --2- 172.21.15.44:0/1881271290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b100b2d30 0x7f1b1006bc90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0097d0 tx=0x7f1afc02b960 comp rx=0 tx=0).stop 2023-11-04T01:36:40.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.956+0000 7f1b16a7c640 1 -- 172.21.15.44:0/1881271290 shutdown_connections 2023-11-04T01:36:40.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.956+0000 7f1b16a7c640 1 --2- 172.21.15.44:0/1881271290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b100b2d30 0x7f1b1006bc90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.956+0000 7f1b16a7c640 1 -- 172.21.15.44:0/1881271290 >> 172.21.15.44:0/1881271290 conn(0x7f1b1006ea20 msgr2=0x7f1b1006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:40.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.957+0000 7f1b16a7c640 1 -- 172.21.15.44:0/1881271290 shutdown_connections 2023-11-04T01:36:40.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.957+0000 7f1b16a7c640 1 -- 172.21.15.44:0/1881271290 wait complete. 2023-11-04T01:36:40.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.958+0000 7f1b16a7c640 1 Processor -- start 2023-11-04T01:36:40.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.958+0000 7f1b16a7c640 1 -- start start 2023-11-04T01:36:40.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b16a7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b1006c1d0 0x7f1b101f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b16a7c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b100b2d30 0x7f1b100ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b16a7c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b10160430 0x7f1b100c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b16a7c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b101f6230 con 0x7f1b1006c1d0 2023-11-04T01:36:40.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b16a7c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b100c80e0 con 0x7f1b100b2d30 2023-11-04T01:36:40.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b16a7c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b100c83c0 con 0x7f1b10160430 2023-11-04T01:36:40.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b14818640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b1006c1d0 0x7f1b101f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b14818640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b1006c1d0 0x7f1b101f5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46376/0 (socket says 172.21.15.44:46376) 2023-11-04T01:36:40.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b14818640 1 -- 172.21.15.44:0/4139228642 learned_addr learned my addr 172.21.15.44:0/4139228642 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:40.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b0ffff640 1 --2- 172.21.15.44:0/4139228642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b100b2d30 0x7f1b100ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b15019640 1 --2- 172.21.15.44:0/4139228642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b10160430 0x7f1b100c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b14818640 1 -- 172.21.15.44:0/4139228642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b10160430 msgr2=0x7f1b100c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b14818640 1 --2- 172.21.15.44:0/4139228642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b10160430 0x7f1b100c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b14818640 1 -- 172.21.15.44:0/4139228642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b100b2d30 msgr2=0x7f1b100ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b14818640 1 --2- 172.21.15.44:0/4139228642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b100b2d30 0x7f1b100ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b14818640 1 -- 172.21.15.44:0/4139228642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc009400 con 0x7f1b1006c1d0 2023-11-04T01:36:40.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b0ffff640 1 --2- 172.21.15.44:0/4139228642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b100b2d30 0x7f1b100ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:40.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b14818640 1 --2- 172.21.15.44:0/4139228642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b1006c1d0 0x7f1b101f5cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400c480 tx=0x7f1b0400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b0d7fa640 1 -- 172.21.15.44:0/4139228642 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04005ce0 con 0x7f1b1006c1d0 2023-11-04T01:36:40.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b0d7fa640 1 -- 172.21.15.44:0/4139228642 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b04005e40 con 0x7f1b1006c1d0 2023-11-04T01:36:40.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b16a7c640 1 -- 172.21.15.44:0/4139228642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b100c86a0 con 0x7f1b1006c1d0 2023-11-04T01:36:40.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.959+0000 7f1b0d7fa640 1 -- 172.21.15.44:0/4139228642 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b040072f0 con 0x7f1b1006c1d0 2023-11-04T01:36:40.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.960+0000 7f1b16a7c640 1 -- 172.21.15.44:0/4139228642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b100c8c60 con 0x7f1b1006c1d0 2023-11-04T01:36:40.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.960+0000 7f1b16a7c640 1 -- 172.21.15.44:0/4139228642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b10074290 con 0x7f1b1006c1d0 2023-11-04T01:36:40.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.961+0000 7f1b0d7fa640 1 -- 172.21.15.44:0/4139228642 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b04007510 con 0x7f1b1006c1d0 2023-11-04T01:36:40.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.961+0000 7f1b0d7fa640 1 --2- 172.21.15.44:0/4139228642 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1af406ae70 0x7f1af406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.961+0000 7f1b0d7fa640 1 -- 172.21.15.44:0/4139228642 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1b04088e00 con 0x7f1b1006c1d0 2023-11-04T01:36:40.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.962+0000 7f1b0ffff640 1 --2- 172.21.15.44:0/4139228642 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1af406ae70 0x7f1af406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.962+0000 7f1b0ffff640 1 --2- 172.21.15.44:0/4139228642 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1af406ae70 0x7f1af406d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1afc036000 tx=0x7f1afc03b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:40.966+0000 7f1b0d7fa640 1 -- 172.21.15.44:0/4139228642 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1b04053c30 con 0x7f1b1006c1d0 2023-11-04T01:36:41.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.144+0000 7f1b16a7c640 1 -- 172.21.15.44:0/4139228642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b1015af70 con 0x7f1b1006c1d0 2023-11-04T01:36:41.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.144+0000 7f1b0d7fa640 1 -- 172.21.15.44:0/4139228642 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b04017020 con 0x7f1b1006c1d0 2023-11-04T01:36:41.147 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:36:41.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.146+0000 7f1b16a7c640 1 -- 172.21.15.44:0/4139228642 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1af406ae70 msgr2=0x7f1af406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.146+0000 7f1b16a7c640 1 --2- 172.21.15.44:0/4139228642 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1af406ae70 0x7f1af406d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1afc036000 tx=0x7f1afc03b040 comp rx=0 tx=0).stop 2023-11-04T01:36:41.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.146+0000 7f1b16a7c640 1 -- 172.21.15.44:0/4139228642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b1006c1d0 msgr2=0x7f1b101f5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.146+0000 7f1b16a7c640 1 --2- 172.21.15.44:0/4139228642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b1006c1d0 0x7f1b101f5cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400c480 tx=0x7f1b0400c940 comp rx=0 tx=0).stop 2023-11-04T01:36:41.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.146+0000 7f1b16a7c640 1 -- 172.21.15.44:0/4139228642 shutdown_connections 2023-11-04T01:36:41.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.146+0000 7f1b16a7c640 1 --2- 172.21.15.44:0/4139228642 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1af406ae70 0x7f1af406d330 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.146+0000 7f1b16a7c640 1 --2- 172.21.15.44:0/4139228642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b10160430 0x7f1b100c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.146+0000 7f1b16a7c640 1 --2- 172.21.15.44:0/4139228642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b100b2d30 0x7f1b100ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.146+0000 7f1b16a7c640 1 --2- 172.21.15.44:0/4139228642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b1006c1d0 0x7f1b101f5cf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.146+0000 7f1b16a7c640 1 -- 172.21.15.44:0/4139228642 >> 172.21.15.44:0/4139228642 conn(0x7f1b1006ea20 msgr2=0x7f1b1015b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.146+0000 7f1b16a7c640 1 -- 172.21.15.44:0/4139228642 shutdown_connections 2023-11-04T01:36:41.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.146+0000 7f1b16a7c640 1 -- 172.21.15.44:0/4139228642 wait complete. 2023-11-04T01:36:41.159 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:41.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.266+0000 7fe7456e0640 1 Processor -- start 2023-11-04T01:36:41.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.266+0000 7fe7456e0640 1 -- start start 2023-11-04T01:36:41.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.267+0000 7fe7456e0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe7400cd6d0 0x7fe740161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.267+0000 7fe7456e0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7400cde60 con 0x7fe7400b4880 2023-11-04T01:36:41.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.267+0000 7fe7456e0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe740160f90 con 0x7fe740153e60 2023-11-04T01:36:41.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.267+0000 7fe7456e0640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe740161960 con 0x7fe7400cd6d0 2023-11-04T01:36:41.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.267+0000 7fe73e7fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe7400cd6d0 0x7fe740161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.267+0000 7fe73e7fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe7400cd6d0 0x7fe740161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46380/0 (socket says 172.21.15.44:46380) 2023-11-04T01:36:41.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.267+0000 7fe73e7fc640 1 -- 172.21.15.44:0/3870563437 learned_addr learned my addr 172.21.15.44:0/3870563437 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:41.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.267+0000 7fe73f7fe640 1 --1- 172.21.15.44:0/3870563437 >> v1:172.21.15.44:6789/0 conn(0x7fe7400b4880 0x7fe7400d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41316/0 (socket says 172.21.15.44:41316) 2023-11-04T01:36:41.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.267+0000 7fe73e7fc640 1 -- 172.21.15.44:0/3870563437 >> v1:172.21.15.204:6789/0 conn(0x7fe740153e60 legacy=0x7fe74015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.267+0000 7fe73e7fc640 1 -- 172.21.15.44:0/3870563437 >> v1:172.21.15.44:6789/0 conn(0x7fe7400b4880 legacy=0x7fe7400d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.267+0000 7fe73e7fc640 1 -- 172.21.15.44:0/3870563437 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7400ce090 con 0x7fe7400cd6d0 2023-11-04T01:36:41.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.267+0000 7fe73dffb640 1 -- 172.21.15.44:0/3870563437 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952477671 0 0) 0x7fe7400cde60 con 0x7fe7400b4880 2023-11-04T01:36:41.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.268+0000 7fe73e7fc640 1 --2- 172.21.15.44:0/3870563437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7400cd6d0 0x7fe740161420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe734009870 tx=0x7fe73402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20359ff5c05b81cd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.268+0000 7fe73dffb640 1 -- 172.21.15.44:0/3870563437 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73402f840 con 0x7fe7400cd6d0 2023-11-04T01:36:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.268+0000 7fe73dffb640 1 -- 172.21.15.44:0/3870563437 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73402f9a0 con 0x7fe7400cd6d0 2023-11-04T01:36:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.268+0000 7fe73dffb640 1 -- 172.21.15.44:0/3870563437 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73402fd30 con 0x7fe7400cd6d0 2023-11-04T01:36:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.269+0000 7fe7456e0640 1 -- 172.21.15.44:0/3870563437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7400cd6d0 msgr2=0x7fe740161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.269+0000 7fe7456e0640 1 --2- 172.21.15.44:0/3870563437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7400cd6d0 0x7fe740161420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe734009870 tx=0x7fe73402ba20 comp rx=0 tx=0).stop 2023-11-04T01:36:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.269+0000 7fe7456e0640 1 -- 172.21.15.44:0/3870563437 shutdown_connections 2023-11-04T01:36:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.269+0000 7fe7456e0640 1 --2- 172.21.15.44:0/3870563437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7400cd6d0 0x7fe740161420 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.269+0000 7fe7456e0640 1 -- 172.21.15.44:0/3870563437 >> 172.21.15.44:0/3870563437 conn(0x7fe7400cf880 msgr2=0x7fe7400cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.269+0000 7fe7456e0640 1 -- 172.21.15.44:0/3870563437 shutdown_connections 2023-11-04T01:36:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.269+0000 7fe7456e0640 1 -- 172.21.15.44:0/3870563437 wait complete. 2023-11-04T01:36:41.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.270+0000 7fe7456e0640 1 Processor -- start 2023-11-04T01:36:41.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.270+0000 7fe7456e0640 1 -- start start 2023-11-04T01:36:41.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe7456e0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7400b4880 0x7fe7401534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe7456e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7400cd6d0 0x7fe740159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe7456e0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe740153e60 0x7fe740156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe7456e0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7400cb4a0 con 0x7fe7400cd6d0 2023-11-04T01:36:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe7456e0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7401f6b70 con 0x7fe7400b4880 2023-11-04T01:36:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe7456e0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74015a980 con 0x7fe740153e60 2023-11-04T01:36:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe73e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7400cd6d0 0x7fe740159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe73e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7400cd6d0 0x7fe740159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46396/0 (socket says 172.21.15.44:46396) 2023-11-04T01:36:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe73e7fc640 1 -- 172.21.15.44:0/1339781179 learned_addr learned my addr 172.21.15.44:0/1339781179 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe73effd640 1 --2- 172.21.15.44:0/1339781179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7400b4880 0x7fe7401534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe73f7fe640 1 --2- 172.21.15.44:0/1339781179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe740153e60 0x7fe740156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe73e7fc640 1 -- 172.21.15.44:0/1339781179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe740153e60 msgr2=0x7fe740156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe73e7fc640 1 --2- 172.21.15.44:0/1339781179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe740153e60 0x7fe740156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe73e7fc640 1 -- 172.21.15.44:0/1339781179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7400b4880 msgr2=0x7fe7401534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe73e7fc640 1 --2- 172.21.15.44:0/1339781179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7400b4880 0x7fe7401534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.271+0000 7fe73e7fc640 1 -- 172.21.15.44:0/1339781179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7340094d0 con 0x7fe7400cd6d0 2023-11-04T01:36:41.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.272+0000 7fe73e7fc640 1 --2- 172.21.15.44:0/1339781179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7400cd6d0 0x7fe740159fa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe734009870 tx=0x7fe734004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.272+0000 7fe7277fe640 1 -- 172.21.15.44:0/1339781179 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73402f7f0 con 0x7fe7400cd6d0 2023-11-04T01:36:41.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.272+0000 7fe7277fe640 1 -- 172.21.15.44:0/1339781179 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe734041400 con 0x7fe7400cd6d0 2023-11-04T01:36:41.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.272+0000 7fe7456e0640 1 -- 172.21.15.44:0/1339781179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7401f5db0 con 0x7fe7400cd6d0 2023-11-04T01:36:41.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.272+0000 7fe7277fe640 1 -- 172.21.15.44:0/1339781179 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7340417b0 con 0x7fe7400cd6d0 2023-11-04T01:36:41.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.272+0000 7fe7456e0640 1 -- 172.21.15.44:0/1339781179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7401f6370 con 0x7fe7400cd6d0 2023-11-04T01:36:41.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.273+0000 7fe7456e0640 1 -- 172.21.15.44:0/1339781179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe740074290 con 0x7fe7400cd6d0 2023-11-04T01:36:41.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.273+0000 7fe7277fe640 1 -- 172.21.15.44:0/1339781179 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe734041910 con 0x7fe7400cd6d0 2023-11-04T01:36:41.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.274+0000 7fe7277fe640 1 --2- 172.21.15.44:0/1339781179 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe72c06aea0 0x7fe72c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.274+0000 7fe7277fe640 1 -- 172.21.15.44:0/1339781179 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe73403c070 con 0x7fe7400cd6d0 2023-11-04T01:36:41.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.274+0000 7fe73effd640 1 --2- 172.21.15.44:0/1339781179 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe72c06aea0 0x7fe72c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.274+0000 7fe73effd640 1 --2- 172.21.15.44:0/1339781179 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe72c06aea0 0x7fe72c06d360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe7300012e0 tx=0x7fe730009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.278+0000 7fe7277fe640 1 -- 172.21.15.44:0/1339781179 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe734076f30 con 0x7fe7400cd6d0 2023-11-04T01:36:41.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.455+0000 7fe7456e0640 1 -- 172.21.15.44:0/1339781179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe7400d0b80 con 0x7fe7400cd6d0 2023-11-04T01:36:41.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.455+0000 7fe7277fe640 1 -- 172.21.15.44:0/1339781179 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe73407a550 con 0x7fe7400cd6d0 2023-11-04T01:36:41.457 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:41.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.457+0000 7fe7456e0640 1 -- 172.21.15.44:0/1339781179 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe72c06aea0 msgr2=0x7fe72c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.457+0000 7fe7456e0640 1 --2- 172.21.15.44:0/1339781179 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe72c06aea0 0x7fe72c06d360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe7300012e0 tx=0x7fe730009040 comp rx=0 tx=0).stop 2023-11-04T01:36:41.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.457+0000 7fe7456e0640 1 -- 172.21.15.44:0/1339781179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7400cd6d0 msgr2=0x7fe740159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.457+0000 7fe7456e0640 1 --2- 172.21.15.44:0/1339781179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7400cd6d0 0x7fe740159fa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe734009870 tx=0x7fe734004730 comp rx=0 tx=0).stop 2023-11-04T01:36:41.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.457+0000 7fe7456e0640 1 -- 172.21.15.44:0/1339781179 shutdown_connections 2023-11-04T01:36:41.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.457+0000 7fe7456e0640 1 --2- 172.21.15.44:0/1339781179 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe72c06aea0 0x7fe72c06d360 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.457+0000 7fe7456e0640 1 --2- 172.21.15.44:0/1339781179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe740153e60 0x7fe740156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.457+0000 7fe7456e0640 1 --2- 172.21.15.44:0/1339781179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7400cd6d0 0x7fe740159fa0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.457+0000 7fe7456e0640 1 --2- 172.21.15.44:0/1339781179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7400b4880 0x7fe7401534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.457+0000 7fe7456e0640 1 -- 172.21.15.44:0/1339781179 >> 172.21.15.44:0/1339781179 conn(0x7fe7400cf880 msgr2=0x7fe74015bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.457+0000 7fe7456e0640 1 -- 172.21.15.44:0/1339781179 shutdown_connections 2023-11-04T01:36:41.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.457+0000 7fe7456e0640 1 -- 172.21.15.44:0/1339781179 wait complete. 2023-11-04T01:36:41.470 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:41.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.577+0000 7fb8c484f640 1 Processor -- start 2023-11-04T01:36:41.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.577+0000 7fb8c484f640 1 -- start start 2023-11-04T01:36:41.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.578+0000 7fb8c484f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8c00ca0a0 0x7fb8c00cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.578+0000 7fb8c484f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c00caa20 con 0x7fb8c015e3f0 2023-11-04T01:36:41.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.578+0000 7fb8c484f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c00cb230 con 0x7fb8c00cc300 2023-11-04T01:36:41.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.578+0000 7fb8c484f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00b3300 con 0x7fb8c00ca0a0 2023-11-04T01:36:41.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.578+0000 7fb8be59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb8c015e3f0 0x7fb8c00b2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41318/0 (socket says 172.21.15.44:41318) 2023-11-04T01:36:41.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.578+0000 7fb8be59c640 1 -- 172.21.15.44:0/477035910 learned_addr learned my addr 172.21.15.44:0/477035910 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:41.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bdd9b640 1 --2- 172.21.15.44:0/477035910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8c00ca0a0 0x7fb8c00cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060050827 0 0) 0x7fb8c00caa20 con 0x7fb8c015e3f0 2023-11-04T01:36:41.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8ac003520 con 0x7fb8c015e3f0 2023-11-04T01:36:41.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591430185 0 0) 0x7fb8c00cb230 con 0x7fb8c00cc300 2023-11-04T01:36:41.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8c00caa20 con 0x7fb8c00cc300 2023-11-04T01:36:41.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2988993063 0 0) 0x7fb8ac003520 con 0x7fb8c015e3f0 2023-11-04T01:36:41.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8c00ca0a0 msgr2=0x7fb8c00cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 --2- 172.21.15.44:0/477035910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8c00ca0a0 0x7fb8c00cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 >> v1:172.21.15.204:6789/0 conn(0x7fb8c00cc300 legacy=0x7fb8c00b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c00ca530 con 0x7fb8c015e3f0 2023-11-04T01:36:41.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fb8b8001670 con 0x7fb8c015e3f0 2023-11-04T01:36:41.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 >> v1:172.21.15.44:6789/0 conn(0x7fb8c015e3f0 legacy=0x7fb8c00b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 --2- 172.21.15.44:0/477035910 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8ac003b30 0x7fb8ac003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 --2- 172.21.15.44:0/477035910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8ac0047c0 0x7fb8ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 --2- 172.21.15.44:0/477035910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8ac005180 0x7fb8ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00b3300 con 0x7fb8ac0047c0 2023-11-04T01:36:41.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac00bec0 con 0x7fb8ac003b30 2023-11-04T01:36:41.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac00c000 con 0x7fb8ac005180 2023-11-04T01:36:41.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bdd9b640 1 --2- 172.21.15.44:0/477035910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8ac0047c0 0x7fb8ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8be59c640 1 --2- 172.21.15.44:0/477035910 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8ac003b30 0x7fb8ac003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bed9d640 1 --2- 172.21.15.44:0/477035910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8ac005180 0x7fb8ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bdd9b640 1 -- 172.21.15.44:0/477035910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8ac005180 msgr2=0x7fb8ac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bdd9b640 1 --2- 172.21.15.44:0/477035910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8ac005180 0x7fb8ac00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bdd9b640 1 -- 172.21.15.44:0/477035910 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8ac003b30 msgr2=0x7fb8ac003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bdd9b640 1 --2- 172.21.15.44:0/477035910 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8ac003b30 0x7fb8ac003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bdd9b640 1 -- 172.21.15.44:0/477035910 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac003520 con 0x7fb8ac0047c0 2023-11-04T01:36:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.579+0000 7fb8bed9d640 1 --2- 172.21.15.44:0/477035910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8ac005180 0x7fb8ac00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.580+0000 7fb8bdd9b640 1 --2- 172.21.15.44:0/477035910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8ac0047c0 0x7fb8ac004c40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009ac0 tx=0x7fb8ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f10ad9983aa2993 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.580+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a802c6b0 con 0x7fb8ac0047c0 2023-11-04T01:36:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.580+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a802c810 con 0x7fb8ac0047c0 2023-11-04T01:36:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.580+0000 7fb8bd59a640 1 -- 172.21.15.44:0/477035910 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a802cba0 con 0x7fb8ac0047c0 2023-11-04T01:36:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.581+0000 7fb8c484f640 1 -- 172.21.15.44:0/477035910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8ac0047c0 msgr2=0x7fb8ac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.581+0000 7fb8c484f640 1 --2- 172.21.15.44:0/477035910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8ac0047c0 0x7fb8ac004c40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009ac0 tx=0x7fb8ac0057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.581+0000 7fb8bed9d640 1 -- 172.21.15.44:0/477035910 reap_dead start 2023-11-04T01:36:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.581+0000 7fb8c484f640 1 -- 172.21.15.44:0/477035910 shutdown_connections 2023-11-04T01:36:41.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.581+0000 7fb8c484f640 1 -- 172.21.15.44:0/477035910 >> 172.21.15.44:0/477035910 conn(0x7fb8c0071820 msgr2=0x7fb8c0071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.581+0000 7fb8c484f640 1 -- 172.21.15.44:0/477035910 shutdown_connections 2023-11-04T01:36:41.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.581+0000 7fb8c484f640 1 -- 172.21.15.44:0/477035910 wait complete. 2023-11-04T01:36:41.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.582+0000 7fb8c484f640 1 Processor -- start 2023-11-04T01:36:41.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.582+0000 7fb8c484f640 1 -- start start 2023-11-04T01:36:41.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8c484f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8ac0047c0 0x7fb8c0150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8c484f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8c00adfd0 0x7fb8c00ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8c484f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8c006d820 0x7fb8c006dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8c484f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00acb20 con 0x7fb8ac0047c0 2023-11-04T01:36:41.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8c484f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00ce030 con 0x7fb8c006d820 2023-11-04T01:36:41.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8c484f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c006e1e0 con 0x7fb8c00adfd0 2023-11-04T01:36:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8be59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8ac0047c0 0x7fb8c0150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8be59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8ac0047c0 0x7fb8c0150110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46412/0 (socket says 172.21.15.44:46412) 2023-11-04T01:36:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8be59c640 1 -- 172.21.15.44:0/1543064827 learned_addr learned my addr 172.21.15.44:0/1543064827 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8be59c640 1 -- 172.21.15.44:0/1543064827 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8c00adfd0 msgr2=0x7fb8c00ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8bed9d640 1 --2- 172.21.15.44:0/1543064827 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8c006d820 0x7fb8c006dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8bdd9b640 1 --2- 172.21.15.44:0/1543064827 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8c00adfd0 0x7fb8c00ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8be59c640 1 --2- 172.21.15.44:0/1543064827 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8c00adfd0 0x7fb8c00ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8be59c640 1 -- 172.21.15.44:0/1543064827 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8c006d820 msgr2=0x7fb8c006dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8be59c640 1 --2- 172.21.15.44:0/1543064827 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8c006d820 0x7fb8c006dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.583+0000 7fb8be59c640 1 -- 172.21.15.44:0/1543064827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c00cf000 con 0x7fb8ac0047c0 2023-11-04T01:36:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.584+0000 7fb8be59c640 1 --2- 172.21.15.44:0/1543064827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8ac0047c0 0x7fb8c0150110 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8007310 tx=0x7fb8b80077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.584+0000 7fb8b6ffd640 1 -- 172.21.15.44:0/1543064827 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b800f960 con 0x7fb8ac0047c0 2023-11-04T01:36:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.584+0000 7fb8b6ffd640 1 -- 172.21.15.44:0/1543064827 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b800fac0 con 0x7fb8ac0047c0 2023-11-04T01:36:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.584+0000 7fb8c484f640 1 -- 172.21.15.44:0/1543064827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c00ceb70 con 0x7fb8ac0047c0 2023-11-04T01:36:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.584+0000 7fb8b6ffd640 1 -- 172.21.15.44:0/1543064827 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b800fe70 con 0x7fb8ac0047c0 2023-11-04T01:36:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.584+0000 7fb8c484f640 1 -- 172.21.15.44:0/1543064827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c00ce520 con 0x7fb8ac0047c0 2023-11-04T01:36:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.585+0000 7fb8c484f640 1 -- 172.21.15.44:0/1543064827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c0074290 con 0x7fb8ac0047c0 2023-11-04T01:36:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.585+0000 7fb8b6ffd640 1 -- 172.21.15.44:0/1543064827 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb8b801d460 con 0x7fb8ac0047c0 2023-11-04T01:36:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.586+0000 7fb8b6ffd640 1 --2- 172.21.15.44:0/1543064827 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb8a006aea0 0x7fb8a006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.586+0000 7fb8b6ffd640 1 -- 172.21.15.44:0/1543064827 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb8b8089a20 con 0x7fb8ac0047c0 2023-11-04T01:36:41.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.586+0000 7fb8bdd9b640 1 --2- 172.21.15.44:0/1543064827 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb8a006aea0 0x7fb8a006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.586+0000 7fb8bdd9b640 1 --2- 172.21.15.44:0/1543064827 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb8a006aea0 0x7fb8a006d360 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8036000 tx=0x7fb8a8030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.590+0000 7fb8b6ffd640 1 -- 172.21.15.44:0/1543064827 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb8b8054710 con 0x7fb8ac0047c0 2023-11-04T01:36:41.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.764+0000 7fb8c484f640 1 -- 172.21.15.44:0/1543064827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8c00cefe0 con 0x7fb8ac0047c0 2023-11-04T01:36:41.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.765+0000 7fb8b6ffd640 1 -- 172.21.15.44:0/1543064827 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8b8057d30 con 0x7fb8ac0047c0 2023-11-04T01:36:41.767 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:36:41.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.767+0000 7fb8c484f640 1 -- 172.21.15.44:0/1543064827 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb8a006aea0 msgr2=0x7fb8a006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.767+0000 7fb8c484f640 1 --2- 172.21.15.44:0/1543064827 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb8a006aea0 0x7fb8a006d360 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8036000 tx=0x7fb8a8030000 comp rx=0 tx=0).stop 2023-11-04T01:36:41.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.767+0000 7fb8c484f640 1 -- 172.21.15.44:0/1543064827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8ac0047c0 msgr2=0x7fb8c0150110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.767+0000 7fb8c484f640 1 --2- 172.21.15.44:0/1543064827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8ac0047c0 0x7fb8c0150110 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8007310 tx=0x7fb8b80077d0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.767+0000 7fb8c484f640 1 -- 172.21.15.44:0/1543064827 shutdown_connections 2023-11-04T01:36:41.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.767+0000 7fb8c484f640 1 --2- 172.21.15.44:0/1543064827 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb8a006aea0 0x7fb8a006d360 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.767+0000 7fb8c484f640 1 --2- 172.21.15.44:0/1543064827 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8c006d820 0x7fb8c006dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.767+0000 7fb8c484f640 1 --2- 172.21.15.44:0/1543064827 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8c00adfd0 0x7fb8c00ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.767+0000 7fb8c484f640 1 --2- 172.21.15.44:0/1543064827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8ac0047c0 0x7fb8c0150110 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.767+0000 7fb8c484f640 1 -- 172.21.15.44:0/1543064827 >> 172.21.15.44:0/1543064827 conn(0x7fb8c0071820 msgr2=0x7fb8c015c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.767+0000 7fb8c484f640 1 -- 172.21.15.44:0/1543064827 shutdown_connections 2023-11-04T01:36:41.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.767+0000 7fb8c484f640 1 -- 172.21.15.44:0/1543064827 wait complete. 2023-11-04T01:36:41.780 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:41.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.887+0000 7f3275cc9640 1 Processor -- start 2023-11-04T01:36:41.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.887+0000 7f3275cc9640 1 -- start start 2023-11-04T01:36:41.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.888+0000 7f3275cc9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f327015ad30 0x7f32700adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.888+0000 7f3275cc9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32700ad730 0x7f3270070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.888+0000 7f3275cc9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32700c3900 con 0x7f3270070c50 2023-11-04T01:36:41.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.888+0000 7f3275cc9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32700ae260 con 0x7f327015ad30 2023-11-04T01:36:41.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.888+0000 7f3275cc9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327015f750 con 0x7f32700ad730 2023-11-04T01:36:41.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.888+0000 7f326f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f327015ad30 0x7f32700adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.888+0000 7f326f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f327015ad30 0x7f32700adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46414/0 (socket says 172.21.15.44:46414) 2023-11-04T01:36:41.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.888+0000 7f326f7fe640 1 -- 172.21.15.44:0/1859211365 learned_addr learned my addr 172.21.15.44:0/1859211365 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:41.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.888+0000 7f326effd640 1 --2- 172.21.15.44:0/1859211365 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32700ad730 0x7f3270070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.888+0000 7f326f7fe640 1 -- 172.21.15.44:0/1859211365 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32700ad730 msgr2=0x7f3270070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.888+0000 7f326f7fe640 1 --2- 172.21.15.44:0/1859211365 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32700ad730 0x7f3270070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.888+0000 7f326f7fe640 1 -- 172.21.15.44:0/1859211365 >> v1:172.21.15.204:6789/0 conn(0x7f3270070c50 legacy=0x7f32700c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.888+0000 7f326f7fe640 1 -- 172.21.15.44:0/1859211365 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32700c3be0 con 0x7f327015ad30 2023-11-04T01:36:41.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.888+0000 7f326effd640 1 --2- 172.21.15.44:0/1859211365 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32700ad730 0x7f3270070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:41.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.889+0000 7f326f7fe640 1 --2- 172.21.15.44:0/1859211365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f327015ad30 0x7f32700adc80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f32600098a0 tx=0x7f326002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6daabb8d91555823 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.889+0000 7f326e7fc640 1 -- 172.21.15.44:0/1859211365 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32600317c0 con 0x7f327015ad30 2023-11-04T01:36:41.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.889+0000 7f326e7fc640 1 -- 172.21.15.44:0/1859211365 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3260031920 con 0x7f327015ad30 2023-11-04T01:36:41.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.889+0000 7f326e7fc640 1 -- 172.21.15.44:0/1859211365 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260031cb0 con 0x7f327015ad30 2023-11-04T01:36:41.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.889+0000 7f3275cc9640 1 -- 172.21.15.44:0/1859211365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f327015ad30 msgr2=0x7f32700adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.889+0000 7f3275cc9640 1 --2- 172.21.15.44:0/1859211365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f327015ad30 0x7f32700adc80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f32600098a0 tx=0x7f326002b860 comp rx=0 tx=0).stop 2023-11-04T01:36:41.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.889+0000 7f3275cc9640 1 -- 172.21.15.44:0/1859211365 shutdown_connections 2023-11-04T01:36:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.889+0000 7f3275cc9640 1 --2- 172.21.15.44:0/1859211365 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32700ad730 0x7f3270070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.890+0000 7f3275cc9640 1 --2- 172.21.15.44:0/1859211365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f327015ad30 0x7f32700adc80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.890+0000 7f3275cc9640 1 -- 172.21.15.44:0/1859211365 >> 172.21.15.44:0/1859211365 conn(0x7f32700ce950 msgr2=0x7f32700ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.890+0000 7f3275cc9640 1 -- 172.21.15.44:0/1859211365 shutdown_connections 2023-11-04T01:36:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.890+0000 7f3275cc9640 1 -- 172.21.15.44:0/1859211365 wait complete. 2023-11-04T01:36:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.891+0000 7f3275cc9640 1 Processor -- start 2023-11-04T01:36:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.891+0000 7f3275cc9640 1 -- start start 2023-11-04T01:36:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f3275cc9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3270070c50 0x7f3270151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f3275cc9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32700ad730 0x7f32700c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f3275cc9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f327015ad30 0x7f32700c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f3275cc9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32701e67e0 con 0x7f3270070c50 2023-11-04T01:36:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f3275cc9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327013ec20 con 0x7f32700ad730 2023-11-04T01:36:41.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f3275cc9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32701e5b60 con 0x7f327015ad30 2023-11-04T01:36:41.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f326f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3270070c50 0x7f3270151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f326f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3270070c50 0x7f3270151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46428/0 (socket says 172.21.15.44:46428) 2023-11-04T01:36:41.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f326f7fe640 1 -- 172.21.15.44:0/2657762018 learned_addr learned my addr 172.21.15.44:0/2657762018 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:41.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f326effd640 1 --2- 172.21.15.44:0/2657762018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32700ad730 0x7f32700c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f326ffff640 1 --2- 172.21.15.44:0/2657762018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f327015ad30 0x7f32700c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f326f7fe640 1 -- 172.21.15.44:0/2657762018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f327015ad30 msgr2=0x7f32700c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f326f7fe640 1 --2- 172.21.15.44:0/2657762018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f327015ad30 0x7f32700c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f326f7fe640 1 -- 172.21.15.44:0/2657762018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32700ad730 msgr2=0x7f32700c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f326f7fe640 1 --2- 172.21.15.44:0/2657762018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32700ad730 0x7f32700c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f326f7fe640 1 -- 172.21.15.44:0/2657762018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32600094d0 con 0x7f3270070c50 2023-11-04T01:36:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f326ffff640 1 --2- 172.21.15.44:0/2657762018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f327015ad30 0x7f32700c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f326f7fe640 1 --2- 172.21.15.44:0/2657762018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3270070c50 0x7f3270151fc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3260000c00 tx=0x7f32600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f3267fff640 1 -- 172.21.15.44:0/2657762018 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32600329a0 con 0x7f3270070c50 2023-11-04T01:36:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f3267fff640 1 -- 172.21.15.44:0/2657762018 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3260032b20 con 0x7f3270070c50 2023-11-04T01:36:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f3275cc9640 1 -- 172.21.15.44:0/2657762018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32701e5e40 con 0x7f3270070c50 2023-11-04T01:36:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f3267fff640 1 -- 172.21.15.44:0/2657762018 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32600453f0 con 0x7f3270070c50 2023-11-04T01:36:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.892+0000 7f3275cc9640 1 -- 172.21.15.44:0/2657762018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32701e6400 con 0x7f3270070c50 2023-11-04T01:36:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.894+0000 7f3275cc9640 1 -- 172.21.15.44:0/2657762018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3270074290 con 0x7f3270070c50 2023-11-04T01:36:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.894+0000 7f3267fff640 1 -- 172.21.15.44:0/2657762018 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f326004d3f0 con 0x7f3270070c50 2023-11-04T01:36:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.894+0000 7f3267fff640 1 --2- 172.21.15.44:0/2657762018 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f325006ae70 0x7f325006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.894+0000 7f3267fff640 1 -- 172.21.15.44:0/2657762018 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f32600ab900 con 0x7f3270070c50 2023-11-04T01:36:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.894+0000 7f326effd640 1 --2- 172.21.15.44:0/2657762018 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f325006ae70 0x7f325006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.895+0000 7f326effd640 1 --2- 172.21.15.44:0/2657762018 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f325006ae70 0x7f325006d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3270152500 tx=0x7f3258008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:41.898+0000 7f3267fff640 1 -- 172.21.15.44:0/2657762018 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3260076680 con 0x7f3270070c50 2023-11-04T01:36:42.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.072+0000 7f3275cc9640 1 -- 172.21.15.44:0/2657762018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3270071970 con 0x7f3270070c50 2023-11-04T01:36:42.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.073+0000 7f3267fff640 1 -- 172.21.15.44:0/2657762018 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3260079ca0 con 0x7f3270070c50 2023-11-04T01:36:42.075 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:42.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.074+0000 7f3275cc9640 1 -- 172.21.15.44:0/2657762018 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f325006ae70 msgr2=0x7f325006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.074+0000 7f3275cc9640 1 --2- 172.21.15.44:0/2657762018 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f325006ae70 0x7f325006d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3270152500 tx=0x7f3258008040 comp rx=0 tx=0).stop 2023-11-04T01:36:42.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.074+0000 7f3275cc9640 1 -- 172.21.15.44:0/2657762018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3270070c50 msgr2=0x7f3270151fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.074+0000 7f3275cc9640 1 --2- 172.21.15.44:0/2657762018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3270070c50 0x7f3270151fc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3260000c00 tx=0x7f32600046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.074+0000 7f3275cc9640 1 -- 172.21.15.44:0/2657762018 shutdown_connections 2023-11-04T01:36:42.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.074+0000 7f3275cc9640 1 --2- 172.21.15.44:0/2657762018 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f325006ae70 0x7f325006d330 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.074+0000 7f3275cc9640 1 --2- 172.21.15.44:0/2657762018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f327015ad30 0x7f32700c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.074+0000 7f3275cc9640 1 --2- 172.21.15.44:0/2657762018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32700ad730 0x7f32700c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.074+0000 7f3275cc9640 1 --2- 172.21.15.44:0/2657762018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3270070c50 0x7f3270151fc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.074+0000 7f3275cc9640 1 -- 172.21.15.44:0/2657762018 >> 172.21.15.44:0/2657762018 conn(0x7f32700ce950 msgr2=0x7f327006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.075+0000 7f3275cc9640 1 -- 172.21.15.44:0/2657762018 shutdown_connections 2023-11-04T01:36:42.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.075+0000 7f3275cc9640 1 -- 172.21.15.44:0/2657762018 wait complete. 2023-11-04T01:36:42.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.192+0000 7f6de4ce5640 1 Processor -- start 2023-11-04T01:36:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.192+0000 7f6de4ce5640 1 -- start start 2023-11-04T01:36:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.193+0000 7f6de4ce5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6de015ad80 0x7f6de006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.193+0000 7f6de4ce5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6de00c9e10 0x7f6de00b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.193+0000 7f6de4ce5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de006cd00 con 0x7f6de00b42c0 2023-11-04T01:36:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.193+0000 7f6de4ce5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de006cfa0 con 0x7f6de015ad80 2023-11-04T01:36:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.193+0000 7f6de4ce5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de006d280 con 0x7f6de00c9e10 2023-11-04T01:36:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.193+0000 7f6dde59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6de015ad80 0x7f6de006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.193+0000 7f6dde59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6de015ad80 0x7f6de006c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46438/0 (socket says 172.21.15.44:46438) 2023-11-04T01:36:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.193+0000 7f6dde59c640 1 -- 172.21.15.44:0/1208353979 learned_addr learned my addr 172.21.15.44:0/1208353979 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.193+0000 7f6dded9d640 1 --2- 172.21.15.44:0/1208353979 >> v2:172.21.15.204:3300/0 conn(0x7f6de00c9e10 0x7f6de00b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.193+0000 7f6dde59c640 1 -- 172.21.15.44:0/1208353979 >> v2:172.21.15.204:3300/0 conn(0x7f6de00c9e10 msgr2=0x7f6de00b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.193+0000 7f6dde59c640 1 --2- 172.21.15.44:0/1208353979 >> v2:172.21.15.204:3300/0 conn(0x7f6de00c9e10 0x7f6de00b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.193+0000 7f6dde59c640 1 -- 172.21.15.44:0/1208353979 >> v1:172.21.15.204:6789/0 conn(0x7f6de00b42c0 legacy=0x7f6de00c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.193+0000 7f6dde59c640 1 -- 172.21.15.44:0/1208353979 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de006d560 con 0x7f6de015ad80 2023-11-04T01:36:42.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.194+0000 7f6dde59c640 1 --2- 172.21.15.44:0/1208353979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6de015ad80 0x7f6de006c7c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6de006c270 tx=0x7f6dd002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f04c9584aa0ea0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.194+0000 7f6dddd9b640 1 -- 172.21.15.44:0/1208353979 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0030860 con 0x7f6de015ad80 2023-11-04T01:36:42.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.194+0000 7f6dddd9b640 1 -- 172.21.15.44:0/1208353979 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd00309c0 con 0x7f6de015ad80 2023-11-04T01:36:42.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.194+0000 7f6dddd9b640 1 -- 172.21.15.44:0/1208353979 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0030d50 con 0x7f6de015ad80 2023-11-04T01:36:42.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.194+0000 7f6de4ce5640 1 -- 172.21.15.44:0/1208353979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6de015ad80 msgr2=0x7f6de006c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.194+0000 7f6de4ce5640 1 --2- 172.21.15.44:0/1208353979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6de015ad80 0x7f6de006c7c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6de006c270 tx=0x7f6dd002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.195+0000 7f6de4ce5640 1 -- 172.21.15.44:0/1208353979 shutdown_connections 2023-11-04T01:36:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.195+0000 7f6de4ce5640 1 --2- 172.21.15.44:0/1208353979 >> v2:172.21.15.204:3300/0 conn(0x7f6de00c9e10 0x7f6de00b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.195+0000 7f6de4ce5640 1 --2- 172.21.15.44:0/1208353979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6de015ad80 0x7f6de006c7c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.195+0000 7f6de4ce5640 1 -- 172.21.15.44:0/1208353979 >> 172.21.15.44:0/1208353979 conn(0x7f6de00ce950 msgr2=0x7f6de00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.195+0000 7f6de4ce5640 1 -- 172.21.15.44:0/1208353979 shutdown_connections 2023-11-04T01:36:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.195+0000 7f6de4ce5640 1 -- 172.21.15.44:0/1208353979 wait complete. 2023-11-04T01:36:42.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.196+0000 7f6de4ce5640 1 Processor -- start 2023-11-04T01:36:42.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.196+0000 7f6de4ce5640 1 -- start start 2023-11-04T01:36:42.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6de4ce5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6de00b42c0 0x7f6de00acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6de4ce5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6de00c9e10 0x7f6de00afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6de4ce5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6de015ad80 0x7f6de00b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6de4ce5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00c5190 con 0x7f6de00c9e10 2023-11-04T01:36:42.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6de4ce5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00ad160 con 0x7f6de015ad80 2023-11-04T01:36:42.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6de4ce5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00c8320 con 0x7f6de00b42c0 2023-11-04T01:36:42.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6dd7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6de00c9e10 0x7f6de00afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6dd7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6de00c9e10 0x7f6de00afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46446/0 (socket says 172.21.15.44:46446) 2023-11-04T01:36:42.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6dd7fff640 1 -- 172.21.15.44:0/1890129142 learned_addr learned my addr 172.21.15.44:0/1890129142 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:42.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6dde59c640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6de00b42c0 0x7f6de00acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6dded9d640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6de015ad80 0x7f6de00b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6dd7fff640 1 -- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6de00b42c0 msgr2=0x7f6de00acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6dd7fff640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6de00b42c0 0x7f6de00acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6dd7fff640 1 -- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6de015ad80 msgr2=0x7f6de00b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6dd7fff640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6de015ad80 0x7f6de00b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6dd7fff640 1 -- 172.21.15.44:0/1890129142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd00094d0 con 0x7f6de00c9e10 2023-11-04T01:36:42.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6dde59c640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6de00b42c0 0x7f6de00acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:42.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6dded9d640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6de015ad80 0x7f6de00b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:42.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6dd7fff640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6de00c9e10 0x7f6de00afc00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c440 tx=0x7f6dc800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.197+0000 7f6dd6ffd640 1 -- 172.21.15.44:0/1890129142 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8005480 con 0x7f6de00c9e10 2023-11-04T01:36:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.198+0000 7f6dd6ffd640 1 -- 172.21.15.44:0/1890129142 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc80035f0 con 0x7f6de00c9e10 2023-11-04T01:36:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.198+0000 7f6de4ce5640 1 -- 172.21.15.44:0/1890129142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de00ad370 con 0x7f6de00c9e10 2023-11-04T01:36:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.198+0000 7f6dd6ffd640 1 -- 172.21.15.44:0/1890129142 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80039c0 con 0x7f6de00c9e10 2023-11-04T01:36:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.198+0000 7f6de4ce5640 1 -- 172.21.15.44:0/1890129142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de00c7d60 con 0x7f6de00c9e10 2023-11-04T01:36:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.199+0000 7f6de4ce5640 1 -- 172.21.15.44:0/1890129142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de0074290 con 0x7f6de00c9e10 2023-11-04T01:36:42.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.199+0000 7f6dd6ffd640 1 -- 172.21.15.44:0/1890129142 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6dc8003b20 con 0x7f6de00c9e10 2023-11-04T01:36:42.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.199+0000 7f6dd6ffd640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6dc006ae70 0x7f6dc006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.199+0000 7f6dd6ffd640 1 -- 172.21.15.44:0/1890129142 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6dc8088ed0 con 0x7f6de00c9e10 2023-11-04T01:36:42.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.200+0000 7f6dde59c640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6dc006ae70 0x7f6dc006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.200+0000 7f6dde59c640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6dc006ae70 0x7f6dc006d330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0036000 tx=0x7f6dd003b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.204+0000 7f6dd6ffd640 1 -- 172.21.15.44:0/1890129142 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6dc8053c50 con 0x7f6de00c9e10 2023-11-04T01:36:42.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.381+0000 7f6de4ce5640 1 -- 172.21.15.44:0/1890129142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6de00b4880 con 0x7f6de00c9e10 2023-11-04T01:36:42.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.382+0000 7f6dd6ffd640 1 -- 172.21.15.44:0/1890129142 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7f6dc8017090 con 0x7f6de00c9e10 2023-11-04T01:36:42.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:42.387 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:42.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.385+0000 7f6de4ce5640 1 -- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6dc006ae70 msgr2=0x7f6dc006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.385+0000 7f6de4ce5640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6dc006ae70 0x7f6dc006d330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0036000 tx=0x7f6dd003b040 comp rx=0 tx=0).stop 2023-11-04T01:36:42.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.385+0000 7f6de4ce5640 1 -- 172.21.15.44:0/1890129142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6de00c9e10 msgr2=0x7f6de00afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.385+0000 7f6de4ce5640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6de00c9e10 0x7f6de00afc00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c440 tx=0x7f6dc800c900 comp rx=0 tx=0).stop 2023-11-04T01:36:42.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.385+0000 7f6de4ce5640 1 -- 172.21.15.44:0/1890129142 shutdown_connections 2023-11-04T01:36:42.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.385+0000 7f6de4ce5640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6dc006ae70 0x7f6dc006d330 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.385+0000 7f6de4ce5640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6de015ad80 0x7f6de00b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.385+0000 7f6de4ce5640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6de00c9e10 0x7f6de00afc00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.385+0000 7f6de4ce5640 1 --2- 172.21.15.44:0/1890129142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6de00b42c0 0x7f6de00acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.385+0000 7f6de4ce5640 1 -- 172.21.15.44:0/1890129142 >> 172.21.15.44:0/1890129142 conn(0x7f6de00ce950 msgr2=0x7f6de00b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.385+0000 7f6de4ce5640 1 -- 172.21.15.44:0/1890129142 shutdown_connections 2023-11-04T01:36:42.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.385+0000 7f6de4ce5640 1 -- 172.21.15.44:0/1890129142 wait complete. 2023-11-04T01:36:42.398 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:42.398 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:42.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.505+0000 7f02b2c94640 1 Processor -- start 2023-11-04T01:36:42.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.505+0000 7f02b2c94640 1 -- start start 2023-11-04T01:36:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.506+0000 7f02b2c94640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f02ac0cd6d0 0x7f02ac161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.506+0000 7f02b2c94640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02ac0cde60 con 0x7f02ac0b4880 2023-11-04T01:36:42.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.506+0000 7f02b2c94640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02ac160f90 con 0x7f02ac153e60 2023-11-04T01:36:42.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.506+0000 7f02b2c94640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02ac161960 con 0x7f02ac0cd6d0 2023-11-04T01:36:42.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.506+0000 7f02abfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f02ac0cd6d0 0x7f02ac161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.506+0000 7f02b1231640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f02ac0b4880 0x7f02ac0d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41330/0 (socket says 172.21.15.44:41330) 2023-11-04T01:36:42.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.506+0000 7f02b1231640 1 -- 172.21.15.44:0/223531700 learned_addr learned my addr 172.21.15.44:0/223531700 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:42.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.507+0000 7f02abfff640 1 -- 172.21.15.44:0/223531700 >> v1:172.21.15.204:6789/0 conn(0x7f02ac153e60 legacy=0x7f02ac15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.507+0000 7f02abfff640 1 -- 172.21.15.44:0/223531700 >> v1:172.21.15.44:6789/0 conn(0x7f02ac0b4880 legacy=0x7f02ac0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.507+0000 7f02abfff640 1 -- 172.21.15.44:0/223531700 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac0ce090 con 0x7f02ac0cd6d0 2023-11-04T01:36:42.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.507+0000 7f02abfff640 1 --2- 172.21.15.44:0/223531700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02ac0cd6d0 0x7f02ac161420 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f02a00097a0 tx=0x7f02a002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b33598c43ac3cac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.508+0000 7f02ab7fe640 1 -- 172.21.15.44:0/223531700 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a0030610 con 0x7f02ac0cd6d0 2023-11-04T01:36:42.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.508+0000 7f02ab7fe640 1 -- 172.21.15.44:0/223531700 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a0030770 con 0x7f02ac0cd6d0 2023-11-04T01:36:42.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.508+0000 7f02ab7fe640 1 -- 172.21.15.44:0/223531700 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a0030b00 con 0x7f02ac0cd6d0 2023-11-04T01:36:42.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.508+0000 7f02b2c94640 1 -- 172.21.15.44:0/223531700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02ac0cd6d0 msgr2=0x7f02ac161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.508+0000 7f02b2c94640 1 --2- 172.21.15.44:0/223531700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02ac0cd6d0 0x7f02ac161420 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f02a00097a0 tx=0x7f02a002b960 comp rx=0 tx=0).stop 2023-11-04T01:36:42.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.508+0000 7f02b2c94640 1 -- 172.21.15.44:0/223531700 shutdown_connections 2023-11-04T01:36:42.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.508+0000 7f02b2c94640 1 --2- 172.21.15.44:0/223531700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02ac0cd6d0 0x7f02ac161420 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.508+0000 7f02b2c94640 1 -- 172.21.15.44:0/223531700 >> 172.21.15.44:0/223531700 conn(0x7f02ac0cf880 msgr2=0x7f02ac0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.508+0000 7f02b2c94640 1 -- 172.21.15.44:0/223531700 shutdown_connections 2023-11-04T01:36:42.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.508+0000 7f02b2c94640 1 -- 172.21.15.44:0/223531700 wait complete. 2023-11-04T01:36:42.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.509+0000 7f02b2c94640 1 Processor -- start 2023-11-04T01:36:42.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.509+0000 7f02b2c94640 1 -- start start 2023-11-04T01:36:42.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.510+0000 7f02b2c94640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02ac0b4880 0x7f02ac152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.510+0000 7f02b2c94640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f02ac0cd6d0 0x7f02ac0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.510+0000 7f02b2c94640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02ac153e60 0x7f02ac154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.510+0000 7f02b2c94640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac0ca700 con 0x7f02ac153e60 2023-11-04T01:36:42.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.510+0000 7f02b2c94640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac153420 con 0x7f02ac0cd6d0 2023-11-04T01:36:42.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.510+0000 7f02b2c94640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac0cbb40 con 0x7f02ac0b4880 2023-11-04T01:36:42.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.510+0000 7f02b1231640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02ac153e60 0x7f02ac154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.510+0000 7f02b1231640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02ac153e60 0x7f02ac154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46468/0 (socket says 172.21.15.44:46468) 2023-11-04T01:36:42.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.510+0000 7f02b1231640 1 -- 172.21.15.44:0/856535912 learned_addr learned my addr 172.21.15.44:0/856535912 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:42.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.510+0000 7f02abfff640 1 --2- 172.21.15.44:0/856535912 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f02ac0cd6d0 0x7f02ac0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.510+0000 7f02b0a30640 1 --2- 172.21.15.44:0/856535912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02ac0b4880 0x7f02ac152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.511+0000 7f02b1231640 1 -- 172.21.15.44:0/856535912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02ac0b4880 msgr2=0x7f02ac152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.511+0000 7f02b1231640 1 --2- 172.21.15.44:0/856535912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02ac0b4880 0x7f02ac152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.511+0000 7f02b1231640 1 -- 172.21.15.44:0/856535912 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f02ac0cd6d0 msgr2=0x7f02ac0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.511+0000 7f02b1231640 1 --2- 172.21.15.44:0/856535912 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f02ac0cd6d0 0x7f02ac0c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.511+0000 7f02b1231640 1 -- 172.21.15.44:0/856535912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a0009400 con 0x7f02ac153e60 2023-11-04T01:36:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.511+0000 7f02b1231640 1 --2- 172.21.15.44:0/856535912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02ac153e60 0x7f02ac154570 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c420 tx=0x7f029c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.511+0000 7f02a97fa640 1 -- 172.21.15.44:0/856535912 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c005ce0 con 0x7f02ac153e60 2023-11-04T01:36:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.511+0000 7f02a97fa640 1 -- 172.21.15.44:0/856535912 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c005e40 con 0x7f02ac153e60 2023-11-04T01:36:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.511+0000 7f02b2c94640 1 -- 172.21.15.44:0/856535912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ac0cbdc0 con 0x7f02ac153e60 2023-11-04T01:36:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.511+0000 7f02a97fa640 1 -- 172.21.15.44:0/856535912 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c0072d0 con 0x7f02ac153e60 2023-11-04T01:36:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.511+0000 7f02b2c94640 1 -- 172.21.15.44:0/856535912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ac0cc360 con 0x7f02ac153e60 2023-11-04T01:36:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.512+0000 7f02b2c94640 1 -- 172.21.15.44:0/856535912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ac074290 con 0x7f02ac153e60 2023-11-04T01:36:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.513+0000 7f02a97fa640 1 -- 172.21.15.44:0/856535912 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f029c007430 con 0x7f02ac153e60 2023-11-04T01:36:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.513+0000 7f02a97fa640 1 --2- 172.21.15.44:0/856535912 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f029806aea0 0x7f029806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.513+0000 7f02a97fa640 1 -- 172.21.15.44:0/856535912 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f029c088ea0 con 0x7f02ac153e60 2023-11-04T01:36:42.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.513+0000 7f02b0a30640 1 --2- 172.21.15.44:0/856535912 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f029806aea0 0x7f029806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.514+0000 7f02b0a30640 1 --2- 172.21.15.44:0/856535912 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f029806aea0 0x7f029806d360 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f02a40012e0 tx=0x7f02a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.517+0000 7f02a97fa640 1 -- 172.21.15.44:0/856535912 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f029c053c40 con 0x7f02ac153e60 2023-11-04T01:36:42.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.693+0000 7f02b2c94640 1 -- 172.21.15.44:0/856535912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02ac15fa80 con 0x7f02ac153e60 2023-11-04T01:36:42.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.693+0000 7f02a97fa640 1 -- 172.21.15.44:0/856535912 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f029c017020 con 0x7f02ac153e60 2023-11-04T01:36:42.696 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:36:42.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.695+0000 7f02b2c94640 1 -- 172.21.15.44:0/856535912 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f029806aea0 msgr2=0x7f029806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.695+0000 7f02b2c94640 1 --2- 172.21.15.44:0/856535912 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f029806aea0 0x7f029806d360 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f02a40012e0 tx=0x7f02a4009040 comp rx=0 tx=0).stop 2023-11-04T01:36:42.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.695+0000 7f02b2c94640 1 -- 172.21.15.44:0/856535912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02ac153e60 msgr2=0x7f02ac154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.695+0000 7f02b2c94640 1 --2- 172.21.15.44:0/856535912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02ac153e60 0x7f02ac154570 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c420 tx=0x7f029c00c8e0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.695+0000 7f02b2c94640 1 -- 172.21.15.44:0/856535912 shutdown_connections 2023-11-04T01:36:42.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.695+0000 7f02b2c94640 1 --2- 172.21.15.44:0/856535912 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f029806aea0 0x7f029806d360 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.695+0000 7f02b2c94640 1 --2- 172.21.15.44:0/856535912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02ac153e60 0x7f02ac154570 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.695+0000 7f02b2c94640 1 --2- 172.21.15.44:0/856535912 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f02ac0cd6d0 0x7f02ac0c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.695+0000 7f02b2c94640 1 --2- 172.21.15.44:0/856535912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02ac0b4880 0x7f02ac152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.695+0000 7f02b2c94640 1 -- 172.21.15.44:0/856535912 >> 172.21.15.44:0/856535912 conn(0x7f02ac0cf880 msgr2=0x7f02ac0d3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.695+0000 7f02b2c94640 1 -- 172.21.15.44:0/856535912 shutdown_connections 2023-11-04T01:36:42.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.695+0000 7f02b2c94640 1 -- 172.21.15.44:0/856535912 wait complete. 2023-11-04T01:36:42.708 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:42.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.815+0000 7f63823b6640 1 Processor -- start 2023-11-04T01:36:42.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.815+0000 7f63823b6640 1 -- start start 2023-11-04T01:36:42.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.816+0000 7f63823b6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f637c15cfd0 0x7f637c06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.816+0000 7f63823b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f637c0cf180 0x7f637c161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.816+0000 7f63823b6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637c0cea20 con 0x7f637c0cd570 2023-11-04T01:36:42.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.816+0000 7f63823b6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637c15d3b0 con 0x7f637c15cfd0 2023-11-04T01:36:42.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.816+0000 7f63823b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c161980 con 0x7f637c0cf180 2023-11-04T01:36:42.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.817+0000 7f6380953640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f637c0cd570 0x7f637c0cb540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:37138/0 (socket says 172.21.15.44:37138) 2023-11-04T01:36:42.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.817+0000 7f637b7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f637c0cf180 0x7f637c161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.817+0000 7f6380953640 1 -- 172.21.15.44:0/3018238695 learned_addr learned my addr 172.21.15.44:0/3018238695 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:42.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.817+0000 7f637bfff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f637c15cfd0 0x7f637c06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.817+0000 7f637bfff640 1 -- 172.21.15.44:0/3018238695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f637c0cf180 msgr2=0x7f637c161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:42.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.817+0000 7f637bfff640 1 --2- 172.21.15.44:0/3018238695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f637c0cf180 0x7f637c161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.817+0000 7f637bfff640 1 -- 172.21.15.44:0/3018238695 >> v1:172.21.15.204:6789/0 conn(0x7f637c0cd570 legacy=0x7f637c0cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.817+0000 7f637bfff640 1 -- 172.21.15.44:0/3018238695 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c0cf610 con 0x7f637c15cfd0 2023-11-04T01:36:42.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.818+0000 7f637bfff640 1 --2- 172.21.15.44:0/3018238695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f637c15cfd0 0x7f637c06c0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f636c0097a0 tx=0x7f636c02b660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b660ede651c48065 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.818+0000 7f637affd640 1 -- 172.21.15.44:0/3018238695 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c030710 con 0x7f637c15cfd0 2023-11-04T01:36:42.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.818+0000 7f637affd640 1 -- 172.21.15.44:0/3018238695 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636c02e050 con 0x7f637c15cfd0 2023-11-04T01:36:42.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.818+0000 7f637affd640 1 -- 172.21.15.44:0/3018238695 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c030a90 con 0x7f637c15cfd0 2023-11-04T01:36:42.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.818+0000 7f63823b6640 1 -- 172.21.15.44:0/3018238695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f637c15cfd0 msgr2=0x7f637c06c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.818+0000 7f63823b6640 1 --2- 172.21.15.44:0/3018238695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f637c15cfd0 0x7f637c06c0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f636c0097a0 tx=0x7f636c02b660 comp rx=0 tx=0).stop 2023-11-04T01:36:42.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.818+0000 7f63823b6640 1 -- 172.21.15.44:0/3018238695 shutdown_connections 2023-11-04T01:36:42.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.819+0000 7f63823b6640 1 --2- 172.21.15.44:0/3018238695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f637c0cf180 0x7f637c161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.819+0000 7f63823b6640 1 --2- 172.21.15.44:0/3018238695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f637c15cfd0 0x7f637c06c0a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.819+0000 7f63823b6640 1 -- 172.21.15.44:0/3018238695 >> 172.21.15.44:0/3018238695 conn(0x7f637c06ea20 msgr2=0x7f637c06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.819+0000 7f63823b6640 1 -- 172.21.15.44:0/3018238695 shutdown_connections 2023-11-04T01:36:42.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.819+0000 7f63823b6640 1 -- 172.21.15.44:0/3018238695 wait complete. 2023-11-04T01:36:42.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.820+0000 7f63823b6640 1 Processor -- start 2023-11-04T01:36:42.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.820+0000 7f63823b6640 1 -- start start 2023-11-04T01:36:42.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f63823b6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f637c0cd570 0x7f637c1481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f63823b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f637c15cfd0 0x7f637c1479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f63823b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f637c1f2f40 0x7f637c0c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f63823b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c14a1e0 con 0x7f637c15cfd0 2023-11-04T01:36:42.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f63823b6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c147f10 con 0x7f637c0cd570 2023-11-04T01:36:42.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f63823b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c14aff0 con 0x7f637c1f2f40 2023-11-04T01:36:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f637b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f637c15cfd0 0x7f637c1479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f637b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f637c15cfd0 0x7f637c1479d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58596/0 (socket says 172.21.15.44:58596) 2023-11-04T01:36:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f637b7fe640 1 -- 172.21.15.44:0/2235398197 learned_addr learned my addr 172.21.15.44:0/2235398197 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f637bfff640 1 --2- 172.21.15.44:0/2235398197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f637c0cd570 0x7f637c1481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f6380953640 1 --2- 172.21.15.44:0/2235398197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f637c1f2f40 0x7f637c0c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f637b7fe640 1 -- 172.21.15.44:0/2235398197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f637c1f2f40 msgr2=0x7f637c0c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f637b7fe640 1 --2- 172.21.15.44:0/2235398197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f637c1f2f40 0x7f637c0c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f637b7fe640 1 -- 172.21.15.44:0/2235398197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f637c0cd570 msgr2=0x7f637c1481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f637b7fe640 1 --2- 172.21.15.44:0/2235398197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f637c0cd570 0x7f637c1481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f637b7fe640 1 -- 172.21.15.44:0/2235398197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c009400 con 0x7f637c15cfd0 2023-11-04T01:36:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f637bfff640 1 --2- 172.21.15.44:0/2235398197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f637c0cd570 0x7f637c1481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f637b7fe640 1 --2- 172.21.15.44:0/2235398197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f637c15cfd0 0x7f637c1479d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f636400e8a0 tx=0x7f636400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.821+0000 7f6378ff9640 1 -- 172.21.15.44:0/2235398197 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640094f0 con 0x7f637c15cfd0 2023-11-04T01:36:42.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.822+0000 7f6378ff9640 1 -- 172.21.15.44:0/2235398197 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636400c8e0 con 0x7f637c15cfd0 2023-11-04T01:36:42.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.822+0000 7f6378ff9640 1 -- 172.21.15.44:0/2235398197 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636400cc90 con 0x7f637c15cfd0 2023-11-04T01:36:42.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.822+0000 7f63823b6640 1 -- 172.21.15.44:0/2235398197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637c14a3e0 con 0x7f637c15cfd0 2023-11-04T01:36:42.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.822+0000 7f63823b6640 1 -- 172.21.15.44:0/2235398197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c14a9a0 con 0x7f637c15cfd0 2023-11-04T01:36:42.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.823+0000 7f63823b6640 1 -- 172.21.15.44:0/2235398197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f637c14b130 con 0x7f637c15cfd0 2023-11-04T01:36:42.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.823+0000 7f6378ff9640 1 -- 172.21.15.44:0/2235398197 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6364013470 con 0x7f637c15cfd0 2023-11-04T01:36:42.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.823+0000 7f6378ff9640 1 --2- 172.21.15.44:0/2235398197 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f635c06ae70 0x7f635c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.823+0000 7f6378ff9640 1 -- 172.21.15.44:0/2235398197 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f63640899c0 con 0x7f637c15cfd0 2023-11-04T01:36:42.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.824+0000 7f637bfff640 1 --2- 172.21.15.44:0/2235398197 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f635c06ae70 0x7f635c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.824+0000 7f637bfff640 1 --2- 172.21.15.44:0/2235398197 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f635c06ae70 0x7f635c06d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f636c034000 tx=0x7f636c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:42.828+0000 7f6378ff9640 1 -- 172.21.15.44:0/2235398197 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f637c14b130 con 0x7f637c15cfd0 2023-11-04T01:36:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.002+0000 7f63823b6640 1 -- 172.21.15.44:0/2235398197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f637c14b130 con 0x7f637c15cfd0 2023-11-04T01:36:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.002+0000 7f6378ff9640 1 -- 172.21.15.44:0/2235398197 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f637c14b130 con 0x7f637c15cfd0 2023-11-04T01:36:43.005 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.004+0000 7f63823b6640 1 -- 172.21.15.44:0/2235398197 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f635c06ae70 msgr2=0x7f635c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.004+0000 7f63823b6640 1 --2- 172.21.15.44:0/2235398197 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f635c06ae70 0x7f635c06d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f636c034000 tx=0x7f636c008030 comp rx=0 tx=0).stop 2023-11-04T01:36:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.004+0000 7f63823b6640 1 -- 172.21.15.44:0/2235398197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f637c15cfd0 msgr2=0x7f637c1479d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.004+0000 7f63823b6640 1 --2- 172.21.15.44:0/2235398197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f637c15cfd0 0x7f637c1479d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f636400e8a0 tx=0x7f636400ed60 comp rx=0 tx=0).stop 2023-11-04T01:36:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.004+0000 7f63823b6640 1 -- 172.21.15.44:0/2235398197 shutdown_connections 2023-11-04T01:36:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.004+0000 7f63823b6640 1 --2- 172.21.15.44:0/2235398197 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f635c06ae70 0x7f635c06d330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.004+0000 7f63823b6640 1 --2- 172.21.15.44:0/2235398197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f637c1f2f40 0x7f637c0c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.004+0000 7f63823b6640 1 --2- 172.21.15.44:0/2235398197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f637c15cfd0 0x7f637c1479d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.004+0000 7f63823b6640 1 --2- 172.21.15.44:0/2235398197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f637c0cd570 0x7f637c1481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.004+0000 7f63823b6640 1 -- 172.21.15.44:0/2235398197 >> 172.21.15.44:0/2235398197 conn(0x7f637c06ea20 msgr2=0x7f637c0ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.004+0000 7f63823b6640 1 -- 172.21.15.44:0/2235398197 shutdown_connections 2023-11-04T01:36:43.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.004+0000 7f63823b6640 1 -- 172.21.15.44:0/2235398197 wait complete. 2023-11-04T01:36:43.017 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:43.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.124+0000 7feb19305640 1 Processor -- start 2023-11-04T01:36:43.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.124+0000 7feb19305640 1 -- start start 2023-11-04T01:36:43.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.125+0000 7feb19305640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feb1415b140 0x7feb1406e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.125+0000 7feb19305640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb140b24f0 con 0x7feb1406cbd0 2023-11-04T01:36:43.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.125+0000 7feb19305640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb140ce220 con 0x7feb14067090 2023-11-04T01:36:43.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.125+0000 7feb19305640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb140cdc60 con 0x7feb1415b140 2023-11-04T01:36:43.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.125+0000 7feb127fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feb1415b140 0x7feb1406e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.125+0000 7feb12ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7feb1406cbd0 0x7feb1406cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42006/0 (socket says 172.21.15.44:42006) 2023-11-04T01:36:43.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.125+0000 7feb12ffd640 1 -- 172.21.15.44:0/3519149171 learned_addr learned my addr 172.21.15.44:0/3519149171 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:43.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.126+0000 7feb127fc640 1 -- 172.21.15.44:0/3519149171 >> v1:172.21.15.204:6789/0 conn(0x7feb14067090 legacy=0x7feb140b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.126+0000 7feb127fc640 1 -- 172.21.15.44:0/3519149171 >> v1:172.21.15.44:6789/0 conn(0x7feb1406cbd0 legacy=0x7feb1406cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.126+0000 7feb127fc640 1 -- 172.21.15.44:0/3519149171 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb140cdf40 con 0x7feb1415b140 2023-11-04T01:36:43.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.126+0000 7feb11ffb640 1 -- 172.21.15.44:0/3519149171 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22581153 0 0) 0x7feb140b24f0 con 0x7feb1406cbd0 2023-11-04T01:36:43.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.127+0000 7feb127fc640 1 --2- 172.21.15.44:0/3519149171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb1415b140 0x7feb1406e180 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feafc0097a0 tx=0x7feafc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38afb64bcd14536a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.127+0000 7feb11ffb640 1 -- 172.21.15.44:0/3519149171 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc031830 con 0x7feb1415b140 2023-11-04T01:36:43.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.127+0000 7feb11ffb640 1 -- 172.21.15.44:0/3519149171 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc031990 con 0x7feb1415b140 2023-11-04T01:36:43.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.127+0000 7feb11ffb640 1 -- 172.21.15.44:0/3519149171 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc031d20 con 0x7feb1415b140 2023-11-04T01:36:43.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.127+0000 7feb19305640 1 -- 172.21.15.44:0/3519149171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb1415b140 msgr2=0x7feb1406e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.127+0000 7feb19305640 1 --2- 172.21.15.44:0/3519149171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb1415b140 0x7feb1406e180 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feafc0097a0 tx=0x7feafc02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.127+0000 7feb19305640 1 -- 172.21.15.44:0/3519149171 shutdown_connections 2023-11-04T01:36:43.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.127+0000 7feb19305640 1 --2- 172.21.15.44:0/3519149171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb1415b140 0x7feb1406e180 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.127+0000 7feb19305640 1 -- 172.21.15.44:0/3519149171 >> 172.21.15.44:0/3519149171 conn(0x7feb1406a120 msgr2=0x7feb1406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.127+0000 7feb19305640 1 -- 172.21.15.44:0/3519149171 shutdown_connections 2023-11-04T01:36:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.127+0000 7feb19305640 1 -- 172.21.15.44:0/3519149171 wait complete. 2023-11-04T01:36:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.129+0000 7feb19305640 1 Processor -- start 2023-11-04T01:36:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.129+0000 7feb19305640 1 -- start start 2023-11-04T01:36:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.129+0000 7feb19305640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb14067090 0x7feb140c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.129+0000 7feb19305640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb1406cbd0 0x7feb140c3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.129+0000 7feb19305640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb1415b140 0x7feb140c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.129+0000 7feb19305640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb140c6450 con 0x7feb1415b140 2023-11-04T01:36:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.129+0000 7feb19305640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb140c3740 con 0x7feb1406cbd0 2023-11-04T01:36:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.129+0000 7feb19305640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb140c39c0 con 0x7feb14067090 2023-11-04T01:36:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.129+0000 7feb137fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb1415b140 0x7feb140c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.130+0000 7feb137fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb1415b140 0x7feb140c40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58606/0 (socket says 172.21.15.44:58606) 2023-11-04T01:36:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.130+0000 7feb137fe640 1 -- 172.21.15.44:0/4067721736 learned_addr learned my addr 172.21.15.44:0/4067721736 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.130+0000 7feb12ffd640 1 --2- 172.21.15.44:0/4067721736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb14067090 0x7feb140c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.130+0000 7feb127fc640 1 --2- 172.21.15.44:0/4067721736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb1406cbd0 0x7feb140c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.130+0000 7feb137fe640 1 -- 172.21.15.44:0/4067721736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb14067090 msgr2=0x7feb140c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.130+0000 7feb137fe640 1 --2- 172.21.15.44:0/4067721736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb14067090 0x7feb140c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.130+0000 7feb137fe640 1 -- 172.21.15.44:0/4067721736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb1406cbd0 msgr2=0x7feb140c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.130+0000 7feb137fe640 1 --2- 172.21.15.44:0/4067721736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb1406cbd0 0x7feb140c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.130+0000 7feb137fe640 1 -- 172.21.15.44:0/4067721736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc009400 con 0x7feb1415b140 2023-11-04T01:36:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.130+0000 7feb137fe640 1 --2- 172.21.15.44:0/4067721736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb1415b140 0x7feb140c40f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7feb0c001eb0 tx=0x7feb0c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.130+0000 7feb0b7fe640 1 -- 172.21.15.44:0/4067721736 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c0052d0 con 0x7feb1415b140 2023-11-04T01:36:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.130+0000 7feb0b7fe640 1 -- 172.21.15.44:0/4067721736 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c005430 con 0x7feb1415b140 2023-11-04T01:36:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.130+0000 7feb19305640 1 -- 172.21.15.44:0/4067721736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb140c3ca0 con 0x7feb1415b140 2023-11-04T01:36:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.130+0000 7feb0b7fe640 1 -- 172.21.15.44:0/4067721736 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c003810 con 0x7feb1415b140 2023-11-04T01:36:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.130+0000 7feb19305640 1 -- 172.21.15.44:0/4067721736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb140c60e0 con 0x7feb1415b140 2023-11-04T01:36:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.131+0000 7feb19305640 1 -- 172.21.15.44:0/4067721736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb140c65c0 con 0x7feb1415b140 2023-11-04T01:36:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.132+0000 7feb0b7fe640 1 -- 172.21.15.44:0/4067721736 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb0c003970 con 0x7feb1415b140 2023-11-04T01:36:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.132+0000 7feb0b7fe640 1 --2- 172.21.15.44:0/4067721736 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feaf406ae70 0x7feaf406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.132+0000 7feb0b7fe640 1 -- 172.21.15.44:0/4067721736 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feb0c088ec0 con 0x7feb1415b140 2023-11-04T01:36:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.132+0000 7feb12ffd640 1 --2- 172.21.15.44:0/4067721736 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feaf406ae70 0x7feaf406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.133+0000 7feb12ffd640 1 --2- 172.21.15.44:0/4067721736 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feaf406ae70 0x7feaf406d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb04001920 tx=0x7feb040018b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.136+0000 7feb0b7fe640 1 -- 172.21.15.44:0/4067721736 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feb0c053c60 con 0x7feb1415b140 2023-11-04T01:36:43.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.315+0000 7feb19305640 1 -- 172.21.15.44:0/4067721736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb14074290 con 0x7feb1415b140 2023-11-04T01:36:43.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.316+0000 7feb0b7fe640 1 -- 172.21.15.44:0/4067721736 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb0c0170a0 con 0x7feb1415b140 2023-11-04T01:36:43.318 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:36:43.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.318+0000 7feb19305640 1 -- 172.21.15.44:0/4067721736 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feaf406ae70 msgr2=0x7feaf406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.318+0000 7feb19305640 1 --2- 172.21.15.44:0/4067721736 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feaf406ae70 0x7feaf406d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb04001920 tx=0x7feb040018b0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.318+0000 7feb19305640 1 -- 172.21.15.44:0/4067721736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb1415b140 msgr2=0x7feb140c40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.318+0000 7feb19305640 1 --2- 172.21.15.44:0/4067721736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb1415b140 0x7feb140c40f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7feb0c001eb0 tx=0x7feb0c00c890 comp rx=0 tx=0).stop 2023-11-04T01:36:43.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.318+0000 7feb19305640 1 -- 172.21.15.44:0/4067721736 shutdown_connections 2023-11-04T01:36:43.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.318+0000 7feb19305640 1 --2- 172.21.15.44:0/4067721736 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feaf406ae70 0x7feaf406d330 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.318+0000 7feb19305640 1 --2- 172.21.15.44:0/4067721736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb1415b140 0x7feb140c40f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.318+0000 7feb19305640 1 --2- 172.21.15.44:0/4067721736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb1406cbd0 0x7feb140c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.318+0000 7feb19305640 1 --2- 172.21.15.44:0/4067721736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb14067090 0x7feb140c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.318+0000 7feb19305640 1 -- 172.21.15.44:0/4067721736 >> 172.21.15.44:0/4067721736 conn(0x7feb1406a120 msgr2=0x7feb1415b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.318+0000 7feb19305640 1 -- 172.21.15.44:0/4067721736 shutdown_connections 2023-11-04T01:36:43.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.318+0000 7feb19305640 1 -- 172.21.15.44:0/4067721736 wait complete. 2023-11-04T01:36:43.331 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:43.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.439+0000 7fee111a9640 1 Processor -- start 2023-11-04T01:36:43.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.439+0000 7fee111a9640 1 -- start start 2023-11-04T01:36:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee111a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fee0c160430 0x7fee0c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee111a9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fee0c0b2b60 0x7fee0c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee111a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee0c06c1d0 0x7fee0c160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee111a9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0c0cb580 con 0x7fee0c160430 2023-11-04T01:36:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee111a9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0c0b2fc0 con 0x7fee0c0b2b60 2023-11-04T01:36:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee111a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c06ca40 con 0x7fee0c06c1d0 2023-11-04T01:36:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee0ad9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fee0c160430 0x7fee0c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee0ad9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fee0c160430 0x7fee0c0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58620/0 (socket says 172.21.15.44:58620) 2023-11-04T01:36:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee0ad9d640 1 -- 172.21.15.44:0/513442772 learned_addr learned my addr 172.21.15.44:0/513442772 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee0a59c640 1 --2- 172.21.15.44:0/513442772 >> v2:172.21.15.204:3300/0 conn(0x7fee0c0b2b60 0x7fee0c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee0b59e640 1 --2- 172.21.15.44:0/513442772 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee0c06c1d0 0x7fee0c160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee0ad9d640 1 -- 172.21.15.44:0/513442772 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee0c06c1d0 msgr2=0x7fee0c160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee0ad9d640 1 --2- 172.21.15.44:0/513442772 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee0c06c1d0 0x7fee0c160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee0ad9d640 1 -- 172.21.15.44:0/513442772 >> v2:172.21.15.204:3300/0 conn(0x7fee0c0b2b60 msgr2=0x7fee0c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee0ad9d640 1 --2- 172.21.15.44:0/513442772 >> v2:172.21.15.204:3300/0 conn(0x7fee0c0b2b60 0x7fee0c06bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee0ad9d640 1 -- 172.21.15.44:0/513442772 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c06cd20 con 0x7fee0c160430 2023-11-04T01:36:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.440+0000 7fee0a59c640 1 --2- 172.21.15.44:0/513442772 >> v2:172.21.15.204:3300/0 conn(0x7fee0c0b2b60 0x7fee0c06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:43.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.441+0000 7fee0ad9d640 1 --2- 172.21.15.44:0/513442772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c160430 0x7fee0c0b2620 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fee0c06e5b0 tx=0x7fedfc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5da69f1d55d4446 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.441+0000 7fee09d9b640 1 -- 172.21.15.44:0/513442772 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc02ca70 con 0x7fee0c160430 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.441+0000 7fee09d9b640 1 -- 172.21.15.44:0/513442772 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc02cbd0 con 0x7fee0c160430 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.441+0000 7fee09d9b640 1 -- 172.21.15.44:0/513442772 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0343f0 con 0x7fee0c160430 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.442+0000 7fee111a9640 1 -- 172.21.15.44:0/513442772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c160430 msgr2=0x7fee0c0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.442+0000 7fee111a9640 1 --2- 172.21.15.44:0/513442772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c160430 0x7fee0c0b2620 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fee0c06e5b0 tx=0x7fedfc02bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.442+0000 7fee111a9640 1 -- 172.21.15.44:0/513442772 shutdown_connections 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.442+0000 7fee111a9640 1 --2- 172.21.15.44:0/513442772 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee0c06c1d0 0x7fee0c160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.442+0000 7fee111a9640 1 --2- 172.21.15.44:0/513442772 >> v2:172.21.15.204:3300/0 conn(0x7fee0c0b2b60 0x7fee0c06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.442+0000 7fee111a9640 1 --2- 172.21.15.44:0/513442772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c160430 0x7fee0c0b2620 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.442+0000 7fee111a9640 1 -- 172.21.15.44:0/513442772 >> 172.21.15.44:0/513442772 conn(0x7fee0c06ea20 msgr2=0x7fee0c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.442+0000 7fee111a9640 1 -- 172.21.15.44:0/513442772 shutdown_connections 2023-11-04T01:36:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.442+0000 7fee111a9640 1 -- 172.21.15.44:0/513442772 wait complete. 2023-11-04T01:36:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.443+0000 7fee111a9640 1 Processor -- start 2023-11-04T01:36:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.443+0000 7fee111a9640 1 -- start start 2023-11-04T01:36:43.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee111a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c06c1d0 0x7fee0c1525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee111a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee0c0b2b60 0x7fee0c152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee111a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee0c160430 0x7fee0c154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee111a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c153090 con 0x7fee0c06c1d0 2023-11-04T01:36:43.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee111a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c153360 con 0x7fee0c160430 2023-11-04T01:36:43.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee111a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c153640 con 0x7fee0c0b2b60 2023-11-04T01:36:43.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee0ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c06c1d0 0x7fee0c1525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee0ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c06c1d0 0x7fee0c1525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58622/0 (socket says 172.21.15.44:58622) 2023-11-04T01:36:43.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee0ad9d640 1 -- 172.21.15.44:0/1261209589 learned_addr learned my addr 172.21.15.44:0/1261209589 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee0a59c640 1 --2- 172.21.15.44:0/1261209589 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee0c0b2b60 0x7fee0c152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee0b59e640 1 --2- 172.21.15.44:0/1261209589 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee0c160430 0x7fee0c154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee0ad9d640 1 -- 172.21.15.44:0/1261209589 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee0c0b2b60 msgr2=0x7fee0c152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee0ad9d640 1 --2- 172.21.15.44:0/1261209589 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee0c0b2b60 0x7fee0c152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee0ad9d640 1 -- 172.21.15.44:0/1261209589 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee0c160430 msgr2=0x7fee0c154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee0ad9d640 1 --2- 172.21.15.44:0/1261209589 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee0c160430 0x7fee0c154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.444+0000 7fee0ad9d640 1 -- 172.21.15.44:0/1261209589 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc009b30 con 0x7fee0c06c1d0 2023-11-04T01:36:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.445+0000 7fee0ad9d640 1 --2- 172.21.15.44:0/1261209589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c06c1d0 0x7fee0c1525d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fedfc000f80 tx=0x7fedfc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.445+0000 7fedf37fe640 1 -- 172.21.15.44:0/1261209589 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc009510 con 0x7fee0c06c1d0 2023-11-04T01:36:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.445+0000 7fedf37fe640 1 -- 172.21.15.44:0/1261209589 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc03e450 con 0x7fee0c06c1d0 2023-11-04T01:36:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.445+0000 7fee111a9640 1 -- 172.21.15.44:0/1261209589 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0c153920 con 0x7fee0c06c1d0 2023-11-04T01:36:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.445+0000 7fedf37fe640 1 -- 172.21.15.44:0/1261209589 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc03e800 con 0x7fee0c06c1d0 2023-11-04T01:36:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.445+0000 7fee111a9640 1 -- 172.21.15.44:0/1261209589 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0c153ee0 con 0x7fee0c06c1d0 2023-11-04T01:36:43.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.446+0000 7fee111a9640 1 -- 172.21.15.44:0/1261209589 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0c1540d0 con 0x7fee0c06c1d0 2023-11-04T01:36:43.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.446+0000 7fedf37fe640 1 -- 172.21.15.44:0/1261209589 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fedfc03e960 con 0x7fee0c06c1d0 2023-11-04T01:36:43.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.447+0000 7fedf37fe640 1 --2- 172.21.15.44:0/1261209589 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fedf806ae70 0x7fedf806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.447+0000 7fedf37fe640 1 -- 172.21.15.44:0/1261209589 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fedfc0ac8c0 con 0x7fee0c06c1d0 2023-11-04T01:36:43.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.447+0000 7fee0a59c640 1 --2- 172.21.15.44:0/1261209589 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fedf806ae70 0x7fedf806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.447+0000 7fee0a59c640 1 --2- 172.21.15.44:0/1261209589 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fedf806ae70 0x7fedf806d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee0c155df0 tx=0x7fee00008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.451+0000 7fedf37fe640 1 -- 172.21.15.44:0/1261209589 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fedfc077520 con 0x7fee0c06c1d0 2023-11-04T01:36:43.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.626+0000 7fee111a9640 1 -- 172.21.15.44:0/1261209589 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fee0c074290 con 0x7fee0c06c1d0 2023-11-04T01:36:43.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.627+0000 7fedf37fe640 1 -- 172.21.15.44:0/1261209589 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fedfc07ab40 con 0x7fee0c06c1d0 2023-11-04T01:36:43.629 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.628+0000 7fee111a9640 1 -- 172.21.15.44:0/1261209589 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fedf806ae70 msgr2=0x7fedf806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.628+0000 7fee111a9640 1 --2- 172.21.15.44:0/1261209589 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fedf806ae70 0x7fedf806d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee0c155df0 tx=0x7fee00008040 comp rx=0 tx=0).stop 2023-11-04T01:36:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.628+0000 7fee111a9640 1 -- 172.21.15.44:0/1261209589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c06c1d0 msgr2=0x7fee0c1525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.628+0000 7fee111a9640 1 --2- 172.21.15.44:0/1261209589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c06c1d0 0x7fee0c1525d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fedfc000f80 tx=0x7fedfc004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.628+0000 7fee111a9640 1 -- 172.21.15.44:0/1261209589 shutdown_connections 2023-11-04T01:36:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.628+0000 7fee111a9640 1 --2- 172.21.15.44:0/1261209589 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fedf806ae70 0x7fedf806d330 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.628+0000 7fee111a9640 1 --2- 172.21.15.44:0/1261209589 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee0c160430 0x7fee0c154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.628+0000 7fee111a9640 1 --2- 172.21.15.44:0/1261209589 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee0c0b2b60 0x7fee0c152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.628+0000 7fee111a9640 1 --2- 172.21.15.44:0/1261209589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c06c1d0 0x7fee0c1525d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.628+0000 7fee111a9640 1 -- 172.21.15.44:0/1261209589 >> 172.21.15.44:0/1261209589 conn(0x7fee0c06ea20 msgr2=0x7fee0c0b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.628+0000 7fee111a9640 1 -- 172.21.15.44:0/1261209589 shutdown_connections 2023-11-04T01:36:43.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.629+0000 7fee111a9640 1 -- 172.21.15.44:0/1261209589 wait complete. 2023-11-04T01:36:43.642 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:43.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.746+0000 7f19df6a9640 1 Processor -- start 2023-11-04T01:36:43.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.746+0000 7f19df6a9640 1 -- start start 2023-11-04T01:36:43.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.747+0000 7f19df6a9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f19d80cde60 0x7f19d815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.747+0000 7f19df6a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f19d815daa0 0x7f19d8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.747+0000 7f19df6a9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d815e000 con 0x7f19d80ce240 2023-11-04T01:36:43.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.747+0000 7f19df6a9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d815e5c0 con 0x7f19d815daa0 2023-11-04T01:36:43.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.747+0000 7f19df6a9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d815e2e0 con 0x7f19d80cde60 2023-11-04T01:36:43.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.747+0000 7f19dcc44640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f19d815daa0 0x7f19d8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.747+0000 7f19dcc44640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f19d815daa0 0x7f19d8157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58626/0 (socket says 172.21.15.44:58626) 2023-11-04T01:36:43.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.747+0000 7f19dcc44640 1 -- 172.21.15.44:0/1632722231 learned_addr learned my addr 172.21.15.44:0/1632722231 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:43.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.748+0000 7f19dd445640 1 --2- 172.21.15.44:0/1632722231 >> v2:172.21.15.204:3300/0 conn(0x7f19d80cde60 0x7f19d815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.748+0000 7f19dcc44640 1 -- 172.21.15.44:0/1632722231 >> v2:172.21.15.204:3300/0 conn(0x7f19d80cde60 msgr2=0x7f19d815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:43.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.748+0000 7f19dcc44640 1 --2- 172.21.15.44:0/1632722231 >> v2:172.21.15.204:3300/0 conn(0x7f19d80cde60 0x7f19d815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.748+0000 7f19dcc44640 1 -- 172.21.15.44:0/1632722231 >> v1:172.21.15.204:6789/0 conn(0x7f19d80ce240 legacy=0x7f19d806b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.748+0000 7f19dcc44640 1 -- 172.21.15.44:0/1632722231 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d80d1120 con 0x7f19d815daa0 2023-11-04T01:36:43.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.748+0000 7f19dcc44640 1 --2- 172.21.15.44:0/1632722231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19d815daa0 0x7f19d8157000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f19d80b5550 tx=0x7f19c802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e39148bd205f1e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.749+0000 7f19cffff640 1 -- 172.21.15.44:0/1632722231 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8030860 con 0x7f19d815daa0 2023-11-04T01:36:43.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.749+0000 7f19cffff640 1 -- 172.21.15.44:0/1632722231 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c80309c0 con 0x7f19d815daa0 2023-11-04T01:36:43.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.749+0000 7f19cffff640 1 -- 172.21.15.44:0/1632722231 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8030d50 con 0x7f19d815daa0 2023-11-04T01:36:43.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.749+0000 7f19df6a9640 1 -- 172.21.15.44:0/1632722231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19d815daa0 msgr2=0x7f19d8157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.749+0000 7f19df6a9640 1 --2- 172.21.15.44:0/1632722231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19d815daa0 0x7f19d8157000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f19d80b5550 tx=0x7f19c802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.749+0000 7f19df6a9640 1 -- 172.21.15.44:0/1632722231 shutdown_connections 2023-11-04T01:36:43.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.749+0000 7f19df6a9640 1 --2- 172.21.15.44:0/1632722231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19d815daa0 0x7f19d8157000 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.749+0000 7f19df6a9640 1 --2- 172.21.15.44:0/1632722231 >> v2:172.21.15.204:3300/0 conn(0x7f19d80cde60 0x7f19d815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.749+0000 7f19df6a9640 1 -- 172.21.15.44:0/1632722231 >> 172.21.15.44:0/1632722231 conn(0x7f19d8071f30 msgr2=0x7f19d80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.749+0000 7f19df6a9640 1 -- 172.21.15.44:0/1632722231 shutdown_connections 2023-11-04T01:36:43.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.749+0000 7f19df6a9640 1 -- 172.21.15.44:0/1632722231 wait complete. 2023-11-04T01:36:43.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.750+0000 7f19df6a9640 1 Processor -- start 2023-11-04T01:36:43.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.751+0000 7f19df6a9640 1 -- start start 2023-11-04T01:36:43.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.751+0000 7f19df6a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19d80cde60 0x7f19d814e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.751+0000 7f19df6a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19d80ce240 0x7f19d8152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.751+0000 7f19df6a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19d815daa0 0x7f19d81511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.751+0000 7f19df6a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d8153590 con 0x7f19d80ce240 2023-11-04T01:36:43.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.751+0000 7f19df6a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d8153f00 con 0x7f19d815daa0 2023-11-04T01:36:43.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.751+0000 7f19df6a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d8152fd0 con 0x7f19d80cde60 2023-11-04T01:36:43.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.751+0000 7f19dcc44640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19d80ce240 0x7f19d8152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.751+0000 7f19dcc44640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19d80ce240 0x7f19d8152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58634/0 (socket says 172.21.15.44:58634) 2023-11-04T01:36:43.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.751+0000 7f19dcc44640 1 -- 172.21.15.44:0/1404761709 learned_addr learned my addr 172.21.15.44:0/1404761709 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:43.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.751+0000 7f19ddc46640 1 --2- 172.21.15.44:0/1404761709 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19d815daa0 0x7f19d81511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.751+0000 7f19dd445640 1 --2- 172.21.15.44:0/1404761709 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19d80cde60 0x7f19d814e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.752+0000 7f19dcc44640 1 -- 172.21.15.44:0/1404761709 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19d80cde60 msgr2=0x7f19d814e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.752+0000 7f19dcc44640 1 --2- 172.21.15.44:0/1404761709 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19d80cde60 0x7f19d814e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.752+0000 7f19dcc44640 1 -- 172.21.15.44:0/1404761709 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19d815daa0 msgr2=0x7f19d81511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.752+0000 7f19dcc44640 1 --2- 172.21.15.44:0/1404761709 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19d815daa0 0x7f19d81511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.752+0000 7f19dcc44640 1 -- 172.21.15.44:0/1404761709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c80094d0 con 0x7f19d80ce240 2023-11-04T01:36:43.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.752+0000 7f19dcc44640 1 --2- 172.21.15.44:0/1404761709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19d80ce240 0x7f19d8152580 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f19c8000c00 tx=0x7f19c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.752+0000 7f19cdffb640 1 -- 172.21.15.44:0/1404761709 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8039a90 con 0x7f19d80ce240 2023-11-04T01:36:43.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.752+0000 7f19cdffb640 1 -- 172.21.15.44:0/1404761709 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c8039c10 con 0x7f19d80ce240 2023-11-04T01:36:43.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.752+0000 7f19cdffb640 1 -- 172.21.15.44:0/1404761709 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8043410 con 0x7f19d80ce240 2023-11-04T01:36:43.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.752+0000 7f19df6a9640 1 -- 172.21.15.44:0/1404761709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d81532b0 con 0x7f19d80ce240 2023-11-04T01:36:43.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.752+0000 7f19df6a9640 1 -- 172.21.15.44:0/1404761709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d814e740 con 0x7f19d80ce240 2023-11-04T01:36:43.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.753+0000 7f19df6a9640 1 -- 172.21.15.44:0/1404761709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d8153980 con 0x7f19d80ce240 2023-11-04T01:36:43.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.754+0000 7f19cdffb640 1 -- 172.21.15.44:0/1404761709 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19c804c3b0 con 0x7f19d80ce240 2023-11-04T01:36:43.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.754+0000 7f19cdffb640 1 --2- 172.21.15.44:0/1404761709 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f19bc06ae70 0x7f19bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.754+0000 7f19cdffb640 1 -- 172.21.15.44:0/1404761709 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f19c80abed0 con 0x7f19d80ce240 2023-11-04T01:36:43.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.754+0000 7f19dd445640 1 --2- 172.21.15.44:0/1404761709 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f19bc06ae70 0x7f19bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.755+0000 7f19dd445640 1 --2- 172.21.15.44:0/1404761709 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f19bc06ae70 0x7f19bc06d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009b40 tx=0x7f19d4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.758+0000 7f19cdffb640 1 -- 172.21.15.44:0/1404761709 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f19d8153980 con 0x7f19d80ce240 2023-11-04T01:36:43.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.936+0000 7f19df6a9640 1 -- 172.21.15.44:0/1404761709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19d8154040 con 0x7f19d80ce240 2023-11-04T01:36:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.937+0000 7f19cdffb640 1 -- 172.21.15.44:0/1404761709 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7f19d8154040 con 0x7f19d80ce240 2023-11-04T01:36:43.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:43.939 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:43.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.939+0000 7f19df6a9640 1 -- 172.21.15.44:0/1404761709 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f19bc06ae70 msgr2=0x7f19bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.939+0000 7f19df6a9640 1 --2- 172.21.15.44:0/1404761709 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f19bc06ae70 0x7f19bc06d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009b40 tx=0x7f19d4009190 comp rx=0 tx=0).stop 2023-11-04T01:36:43.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.939+0000 7f19df6a9640 1 -- 172.21.15.44:0/1404761709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19d80ce240 msgr2=0x7f19d8152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.939+0000 7f19df6a9640 1 --2- 172.21.15.44:0/1404761709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19d80ce240 0x7f19d8152580 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f19c8000c00 tx=0x7f19c8004730 comp rx=0 tx=0).stop 2023-11-04T01:36:43.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.939+0000 7f19df6a9640 1 -- 172.21.15.44:0/1404761709 shutdown_connections 2023-11-04T01:36:43.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.939+0000 7f19df6a9640 1 --2- 172.21.15.44:0/1404761709 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f19bc06ae70 0x7f19bc06d330 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.939+0000 7f19df6a9640 1 --2- 172.21.15.44:0/1404761709 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19d815daa0 0x7f19d81511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.939+0000 7f19df6a9640 1 --2- 172.21.15.44:0/1404761709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19d80ce240 0x7f19d8152580 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.939+0000 7f19df6a9640 1 --2- 172.21.15.44:0/1404761709 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19d80cde60 0x7f19d814e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.939+0000 7f19df6a9640 1 -- 172.21.15.44:0/1404761709 >> 172.21.15.44:0/1404761709 conn(0x7f19d8071f30 msgr2=0x7f19d80c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.939+0000 7f19df6a9640 1 -- 172.21.15.44:0/1404761709 shutdown_connections 2023-11-04T01:36:43.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:43.939+0000 7f19df6a9640 1 -- 172.21.15.44:0/1404761709 wait complete. 2023-11-04T01:36:43.952 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:43.952 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:44.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.059+0000 7f5128f6c640 1 Processor -- start 2023-11-04T01:36:44.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.059+0000 7f5128f6c640 1 -- start start 2023-11-04T01:36:44.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.060+0000 7f5128f6c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5124153e60 0x7f512415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.060+0000 7f5128f6c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51240cd6d0 0x7f5124161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.060+0000 7f5128f6c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51240cde60 con 0x7f51240b4880 2023-11-04T01:36:44.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.060+0000 7f5128f6c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5124160f90 con 0x7f5124153e60 2023-11-04T01:36:44.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.060+0000 7f5128f6c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512415e400 con 0x7f51240cd6d0 2023-11-04T01:36:44.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.060+0000 7f512259c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5124153e60 0x7f512415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.060+0000 7f512259c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5124153e60 0x7f512415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58642/0 (socket says 172.21.15.44:58642) 2023-11-04T01:36:44.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.060+0000 7f512259c640 1 -- 172.21.15.44:0/2792922546 learned_addr learned my addr 172.21.15.44:0/2792922546 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:44.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.061+0000 7f5121d9b640 1 --2- 172.21.15.44:0/2792922546 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51240cd6d0 0x7f5124161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.061+0000 7f512259c640 1 -- 172.21.15.44:0/2792922546 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51240cd6d0 msgr2=0x7f5124161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.061+0000 7f512259c640 1 --2- 172.21.15.44:0/2792922546 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51240cd6d0 0x7f5124161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.061+0000 7f512259c640 1 -- 172.21.15.44:0/2792922546 >> v1:172.21.15.44:6789/0 conn(0x7f51240b4880 legacy=0x7f51240b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.061+0000 7f512159a640 1 -- 172.21.15.44:0/2792922546 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818869416 0 0) 0x7f51240cde60 con 0x7f51240b4880 2023-11-04T01:36:44.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.061+0000 7f512259c640 1 -- 172.21.15.44:0/2792922546 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5124161960 con 0x7f5124153e60 2023-11-04T01:36:44.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.061+0000 7f5121d9b640 1 --2- 172.21.15.44:0/2792922546 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51240cd6d0 0x7f5124161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:44.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.061+0000 7f512259c640 1 --2- 172.21.15.44:0/2792922546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5124153e60 0x7f512415dec0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f511c009870 tx=0x7f511c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b986bca2937c79f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.062+0000 7f512159a640 1 -- 172.21.15.44:0/2792922546 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c030840 con 0x7f5124153e60 2023-11-04T01:36:44.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.062+0000 7f512159a640 1 -- 172.21.15.44:0/2792922546 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c0309a0 con 0x7f5124153e60 2023-11-04T01:36:44.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.062+0000 7f512159a640 1 -- 172.21.15.44:0/2792922546 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c030d30 con 0x7f5124153e60 2023-11-04T01:36:44.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.062+0000 7f5128f6c640 1 -- 172.21.15.44:0/2792922546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5124153e60 msgr2=0x7f512415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.062+0000 7f5128f6c640 1 --2- 172.21.15.44:0/2792922546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5124153e60 0x7f512415dec0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f511c009870 tx=0x7f511c02b980 comp rx=0 tx=0).stop 2023-11-04T01:36:44.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.062+0000 7f5128f6c640 1 -- 172.21.15.44:0/2792922546 shutdown_connections 2023-11-04T01:36:44.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.062+0000 7f5128f6c640 1 --2- 172.21.15.44:0/2792922546 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51240cd6d0 0x7f5124161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.062+0000 7f5128f6c640 1 --2- 172.21.15.44:0/2792922546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5124153e60 0x7f512415dec0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.062+0000 7f5128f6c640 1 -- 172.21.15.44:0/2792922546 >> 172.21.15.44:0/2792922546 conn(0x7f51240cf880 msgr2=0x7f51240cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.062+0000 7f5128f6c640 1 -- 172.21.15.44:0/2792922546 shutdown_connections 2023-11-04T01:36:44.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.062+0000 7f5128f6c640 1 -- 172.21.15.44:0/2792922546 wait complete. 2023-11-04T01:36:44.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.064+0000 7f5128f6c640 1 Processor -- start 2023-11-04T01:36:44.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.064+0000 7f5128f6c640 1 -- start start 2023-11-04T01:36:44.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.064+0000 7f5128f6c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51240b4880 0x7f5124150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.064+0000 7f5128f6c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51240cd6d0 0x7f51240cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.064+0000 7f5128f6c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5124153e60 0x7f51240ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f5128f6c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51240cac70 con 0x7f51240b4880 2023-11-04T01:36:44.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f5128f6c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51240caf50 con 0x7f5124153e60 2023-11-04T01:36:44.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f5128f6c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51240cb230 con 0x7f51240cd6d0 2023-11-04T01:36:44.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f512259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51240b4880 0x7f5124150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f512259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51240b4880 0x7f5124150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58646/0 (socket says 172.21.15.44:58646) 2023-11-04T01:36:44.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f512259c640 1 -- 172.21.15.44:0/4132711957 learned_addr learned my addr 172.21.15.44:0/4132711957 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:44.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f512259c640 1 -- 172.21.15.44:0/4132711957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51240cd6d0 msgr2=0x7f51240cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f5121d9b640 1 --2- 172.21.15.44:0/4132711957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51240cd6d0 0x7f51240cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f5122d9d640 1 --2- 172.21.15.44:0/4132711957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5124153e60 0x7f51240ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f512259c640 1 --2- 172.21.15.44:0/4132711957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51240cd6d0 0x7f51240cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f512259c640 1 -- 172.21.15.44:0/4132711957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5124153e60 msgr2=0x7f51240ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f512259c640 1 --2- 172.21.15.44:0/4132711957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5124153e60 0x7f51240ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f512259c640 1 -- 172.21.15.44:0/4132711957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c0094d0 con 0x7f51240b4880 2023-11-04T01:36:44.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f5122d9d640 1 --2- 172.21.15.44:0/4132711957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5124153e60 0x7f51240ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:44.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f512259c640 1 --2- 172.21.15.44:0/4132711957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51240b4880 0x7f5124150270 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f511c000c00 tx=0x7f511c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f511affd640 1 -- 172.21.15.44:0/4132711957 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c030810 con 0x7f51240b4880 2023-11-04T01:36:44.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f511affd640 1 -- 172.21.15.44:0/4132711957 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c039d90 con 0x7f51240b4880 2023-11-04T01:36:44.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f5128f6c640 1 -- 172.21.15.44:0/4132711957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51240cb510 con 0x7f51240b4880 2023-11-04T01:36:44.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f511affd640 1 -- 172.21.15.44:0/4132711957 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c043670 con 0x7f51240b4880 2023-11-04T01:36:44.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.065+0000 7f5128f6c640 1 -- 172.21.15.44:0/4132711957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51241507b0 con 0x7f51240b4880 2023-11-04T01:36:44.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.066+0000 7f5128f6c640 1 -- 172.21.15.44:0/4132711957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51240cba30 con 0x7f51240b4880 2023-11-04T01:36:44.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.067+0000 7f511affd640 1 -- 172.21.15.44:0/4132711957 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f511c04c3b0 con 0x7f51240b4880 2023-11-04T01:36:44.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.067+0000 7f511affd640 1 --2- 172.21.15.44:0/4132711957 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f510406ae70 0x7f510406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.067+0000 7f511affd640 1 -- 172.21.15.44:0/4132711957 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f511c0ac050 con 0x7f51240b4880 2023-11-04T01:36:44.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.067+0000 7f5121d9b640 1 --2- 172.21.15.44:0/4132711957 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f510406ae70 0x7f510406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.068+0000 7f5121d9b640 1 --2- 172.21.15.44:0/4132711957 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f510406ae70 0x7f510406d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f51240cc920 tx=0x7f510c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.071+0000 7f511affd640 1 -- 172.21.15.44:0/4132711957 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51240cba30 con 0x7f51240b4880 2023-11-04T01:36:44.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.249+0000 7f5128f6c640 1 -- 172.21.15.44:0/4132711957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51240c9b90 con 0x7f51240b4880 2023-11-04T01:36:44.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.249+0000 7f511affd640 1 -- 172.21.15.44:0/4132711957 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f511c076d40 con 0x7f51240b4880 2023-11-04T01:36:44.251 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:36:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.251+0000 7f5128f6c640 1 -- 172.21.15.44:0/4132711957 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f510406ae70 msgr2=0x7f510406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.251+0000 7f5128f6c640 1 --2- 172.21.15.44:0/4132711957 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f510406ae70 0x7f510406d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f51240cc920 tx=0x7f510c008040 comp rx=0 tx=0).stop 2023-11-04T01:36:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.251+0000 7f5128f6c640 1 -- 172.21.15.44:0/4132711957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51240b4880 msgr2=0x7f5124150270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.251+0000 7f5128f6c640 1 --2- 172.21.15.44:0/4132711957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51240b4880 0x7f5124150270 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f511c000c00 tx=0x7f511c004730 comp rx=0 tx=0).stop 2023-11-04T01:36:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.251+0000 7f5128f6c640 1 -- 172.21.15.44:0/4132711957 shutdown_connections 2023-11-04T01:36:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.251+0000 7f5128f6c640 1 --2- 172.21.15.44:0/4132711957 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f510406ae70 0x7f510406d330 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.251+0000 7f5128f6c640 1 --2- 172.21.15.44:0/4132711957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5124153e60 0x7f51240ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.251+0000 7f5128f6c640 1 --2- 172.21.15.44:0/4132711957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51240cd6d0 0x7f51240cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.251+0000 7f5128f6c640 1 --2- 172.21.15.44:0/4132711957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51240b4880 0x7f5124150270 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.251+0000 7f5128f6c640 1 -- 172.21.15.44:0/4132711957 >> 172.21.15.44:0/4132711957 conn(0x7f51240cf880 msgr2=0x7f51240d2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.251+0000 7f5128f6c640 1 -- 172.21.15.44:0/4132711957 shutdown_connections 2023-11-04T01:36:44.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.251+0000 7f5128f6c640 1 -- 172.21.15.44:0/4132711957 wait complete. 2023-11-04T01:36:44.265 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:44.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.372+0000 7f76404e0640 1 Processor -- start 2023-11-04T01:36:44.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.372+0000 7f76404e0640 1 -- start start 2023-11-04T01:36:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.373+0000 7f76404e0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7638153e60 0x7f763815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.373+0000 7f76404e0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f76380cd6d0 0x7f7638161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.373+0000 7f76404e0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76380cde60 con 0x7f76380b4880 2023-11-04T01:36:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.373+0000 7f76404e0640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7638160f90 con 0x7f7638153e60 2023-11-04T01:36:44.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.373+0000 7f76404e0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763815e400 con 0x7f76380cd6d0 2023-11-04T01:36:44.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.373+0000 7f763e27c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7638153e60 0x7f763815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.373+0000 7f763e27c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7638153e60 0x7f763815dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58652/0 (socket says 172.21.15.44:58652) 2023-11-04T01:36:44.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.373+0000 7f763e27c640 1 -- 172.21.15.44:0/59462504 learned_addr learned my addr 172.21.15.44:0/59462504 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:44.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.373+0000 7f763e27c640 1 -- 172.21.15.44:0/59462504 >> v2:172.21.15.204:3300/0 conn(0x7f76380cd6d0 msgr2=0x7f7638161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.373+0000 7f763e27c640 1 --2- 172.21.15.44:0/59462504 >> v2:172.21.15.204:3300/0 conn(0x7f76380cd6d0 0x7f7638161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.373+0000 7f763e27c640 1 -- 172.21.15.44:0/59462504 >> v1:172.21.15.204:6789/0 conn(0x7f76380b4880 legacy=0x7f763806b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.373+0000 7f763e27c640 1 -- 172.21.15.44:0/59462504 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7638161960 con 0x7f7638153e60 2023-11-04T01:36:44.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.374+0000 7f763e27c640 1 --2- 172.21.15.44:0/59462504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7638153e60 0x7f763815dec0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f76380c9e80 tx=0x7f763402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93b8eeb255cefd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.374+0000 7f763d27a640 1 -- 172.21.15.44:0/59462504 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634031870 con 0x7f7638153e60 2023-11-04T01:36:44.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.374+0000 7f763d27a640 1 -- 172.21.15.44:0/59462504 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76340319d0 con 0x7f7638153e60 2023-11-04T01:36:44.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.374+0000 7f763d27a640 1 -- 172.21.15.44:0/59462504 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634031d60 con 0x7f7638153e60 2023-11-04T01:36:44.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.375+0000 7f76404e0640 1 -- 172.21.15.44:0/59462504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7638153e60 msgr2=0x7f763815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.375+0000 7f76404e0640 1 --2- 172.21.15.44:0/59462504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7638153e60 0x7f763815dec0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f76380c9e80 tx=0x7f763402b910 comp rx=0 tx=0).stop 2023-11-04T01:36:44.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.375+0000 7f76404e0640 1 -- 172.21.15.44:0/59462504 shutdown_connections 2023-11-04T01:36:44.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.375+0000 7f76404e0640 1 --2- 172.21.15.44:0/59462504 >> v2:172.21.15.204:3300/0 conn(0x7f76380cd6d0 0x7f7638161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.375+0000 7f76404e0640 1 --2- 172.21.15.44:0/59462504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7638153e60 0x7f763815dec0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.375+0000 7f76404e0640 1 -- 172.21.15.44:0/59462504 >> 172.21.15.44:0/59462504 conn(0x7f76380cf880 msgr2=0x7f76380cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.375+0000 7f76404e0640 1 -- 172.21.15.44:0/59462504 shutdown_connections 2023-11-04T01:36:44.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.375+0000 7f76404e0640 1 -- 172.21.15.44:0/59462504 wait complete. 2023-11-04T01:36:44.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.376+0000 7f76404e0640 1 Processor -- start 2023-11-04T01:36:44.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.376+0000 7f76404e0640 1 -- start start 2023-11-04T01:36:44.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f76404e0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76380b4880 0x7f76381f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f76404e0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76380cd6d0 0x7f76381564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f76404e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7638153e60 0x7f763814fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f76404e0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76381572f0 con 0x7f7638153e60 2023-11-04T01:36:44.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f76404e0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76381f3930 con 0x7f76380cd6d0 2023-11-04T01:36:44.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f76404e0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763814dfd0 con 0x7f76380b4880 2023-11-04T01:36:44.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f763ea7d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7638153e60 0x7f763814fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f763ea7d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7638153e60 0x7f763814fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58664/0 (socket says 172.21.15.44:58664) 2023-11-04T01:36:44.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f763ea7d640 1 -- 172.21.15.44:0/3683829621 learned_addr learned my addr 172.21.15.44:0/3683829621 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:44.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f763e27c640 1 --2- 172.21.15.44:0/3683829621 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76380b4880 0x7f76381f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f763da7b640 1 --2- 172.21.15.44:0/3683829621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76380cd6d0 0x7f76381564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f763ea7d640 1 -- 172.21.15.44:0/3683829621 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76380b4880 msgr2=0x7f76381f33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f763ea7d640 1 --2- 172.21.15.44:0/3683829621 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76380b4880 0x7f76381f33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f763ea7d640 1 -- 172.21.15.44:0/3683829621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76380cd6d0 msgr2=0x7f76381564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f763ea7d640 1 --2- 172.21.15.44:0/3683829621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76380cd6d0 0x7f76381564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f763ea7d640 1 -- 172.21.15.44:0/3683829621 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76340094d0 con 0x7f7638153e60 2023-11-04T01:36:44.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f763ea7d640 1 --2- 172.21.15.44:0/3683829621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7638153e60 0x7f763814fe10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f763000c780 tx=0x7f763000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.377+0000 7f762effd640 1 -- 172.21.15.44:0/3683829621 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630003b70 con 0x7f7638153e60 2023-11-04T01:36:44.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.378+0000 7f762effd640 1 -- 172.21.15.44:0/3683829621 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7630003cd0 con 0x7f7638153e60 2023-11-04T01:36:44.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.378+0000 7f76404e0640 1 -- 172.21.15.44:0/3683829621 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763814e2b0 con 0x7f7638153e60 2023-11-04T01:36:44.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.378+0000 7f762effd640 1 -- 172.21.15.44:0/3683829621 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76300052b0 con 0x7f7638153e60 2023-11-04T01:36:44.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.378+0000 7f76404e0640 1 -- 172.21.15.44:0/3683829621 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763814e870 con 0x7f7638153e60 2023-11-04T01:36:44.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.379+0000 7f76404e0640 1 -- 172.21.15.44:0/3683829621 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7638074290 con 0x7f7638153e60 2023-11-04T01:36:44.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.379+0000 7f762effd640 1 -- 172.21.15.44:0/3683829621 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7630005410 con 0x7f7638153e60 2023-11-04T01:36:44.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.379+0000 7f762effd640 1 --2- 172.21.15.44:0/3683829621 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f761c06ae70 0x7f761c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.379+0000 7f762effd640 1 -- 172.21.15.44:0/3683829621 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7630088d50 con 0x7f7638153e60 2023-11-04T01:36:44.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.380+0000 7f763e27c640 1 --2- 172.21.15.44:0/3683829621 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f761c06ae70 0x7f761c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.380+0000 7f763e27c640 1 --2- 172.21.15.44:0/3683829621 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f761c06ae70 0x7f761c06d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7634036000 tx=0x7f763403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.384+0000 7f762effd640 1 -- 172.21.15.44:0/3683829621 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f763008c030 con 0x7f7638153e60 2023-11-04T01:36:44.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.559+0000 7f76404e0640 1 -- 172.21.15.44:0/3683829621 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f76380d0b80 con 0x7f7638153e60 2023-11-04T01:36:44.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.559+0000 7f762effd640 1 -- 172.21.15.44:0/3683829621 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7630053af0 con 0x7f7638153e60 2023-11-04T01:36:44.561 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:44.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.561+0000 7f76404e0640 1 -- 172.21.15.44:0/3683829621 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f761c06ae70 msgr2=0x7f761c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.561+0000 7f76404e0640 1 --2- 172.21.15.44:0/3683829621 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f761c06ae70 0x7f761c06d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7634036000 tx=0x7f763403c040 comp rx=0 tx=0).stop 2023-11-04T01:36:44.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.561+0000 7f76404e0640 1 -- 172.21.15.44:0/3683829621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7638153e60 msgr2=0x7f763814fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.561+0000 7f76404e0640 1 --2- 172.21.15.44:0/3683829621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7638153e60 0x7f763814fe10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f763000c780 tx=0x7f763000cb80 comp rx=0 tx=0).stop 2023-11-04T01:36:44.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.561+0000 7f76404e0640 1 -- 172.21.15.44:0/3683829621 shutdown_connections 2023-11-04T01:36:44.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.561+0000 7f76404e0640 1 --2- 172.21.15.44:0/3683829621 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f761c06ae70 0x7f761c06d330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.561+0000 7f76404e0640 1 --2- 172.21.15.44:0/3683829621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7638153e60 0x7f763814fe10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.561+0000 7f76404e0640 1 --2- 172.21.15.44:0/3683829621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76380cd6d0 0x7f76381564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.561+0000 7f76404e0640 1 --2- 172.21.15.44:0/3683829621 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76380b4880 0x7f76381f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.561+0000 7f76404e0640 1 -- 172.21.15.44:0/3683829621 >> 172.21.15.44:0/3683829621 conn(0x7f76380cf880 msgr2=0x7f76380b75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.562+0000 7f76404e0640 1 -- 172.21.15.44:0/3683829621 shutdown_connections 2023-11-04T01:36:44.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.562+0000 7f76404e0640 1 -- 172.21.15.44:0/3683829621 wait complete. 2023-11-04T01:36:44.574 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:44.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.681+0000 7f59003c5640 1 Processor -- start 2023-11-04T01:36:44.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.681+0000 7f59003c5640 1 -- start start 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.682+0000 7f59003c5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f58f80cd6d0 0x7f58f8161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.682+0000 7f59003c5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f58f80b4880 0x7f58f80b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.682+0000 7f59003c5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f80cde60 con 0x7f58f8153e60 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.682+0000 7f59003c5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f8160f90 con 0x7f58f80cd6d0 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.682+0000 7f59003c5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f8161960 con 0x7f58f80b4880 2023-11-04T01:36:44.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.682+0000 7f58fd960640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f58f80cd6d0 0x7f58f8161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.682+0000 7f58fd960640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f58f80cd6d0 0x7f58f8161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58678/0 (socket says 172.21.15.44:58678) 2023-11-04T01:36:44.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.682+0000 7f58fd960640 1 -- 172.21.15.44:0/2695023389 learned_addr learned my addr 172.21.15.44:0/2695023389 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:44.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.683+0000 7f58fe962640 1 --2- 172.21.15.44:0/2695023389 >> v2:172.21.15.204:3300/0 conn(0x7f58f80b4880 0x7f58f80b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.683+0000 7f58fd960640 1 -- 172.21.15.44:0/2695023389 >> v2:172.21.15.204:3300/0 conn(0x7f58f80b4880 msgr2=0x7f58f80b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.683+0000 7f58fd960640 1 --2- 172.21.15.44:0/2695023389 >> v2:172.21.15.204:3300/0 conn(0x7f58f80b4880 0x7f58f80b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.683+0000 7f58fd960640 1 -- 172.21.15.44:0/2695023389 >> v1:172.21.15.204:6789/0 conn(0x7f58f8153e60 legacy=0x7f58f815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.683+0000 7f58fd960640 1 -- 172.21.15.44:0/2695023389 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f80b5220 con 0x7f58f80cd6d0 2023-11-04T01:36:44.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.683+0000 7f58fd960640 1 --2- 172.21.15.44:0/2695023389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80cd6d0 0x7f58f8161420 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f58f80b8f40 tx=0x7f58ec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ee898b8558efb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.684+0000 7f58fd15f640 1 -- 172.21.15.44:0/2695023389 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec031870 con 0x7f58f80cd6d0 2023-11-04T01:36:44.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.684+0000 7f58fd15f640 1 -- 172.21.15.44:0/2695023389 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec0319d0 con 0x7f58f80cd6d0 2023-11-04T01:36:44.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.684+0000 7f58fd15f640 1 -- 172.21.15.44:0/2695023389 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec031d60 con 0x7f58f80cd6d0 2023-11-04T01:36:44.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.684+0000 7f59003c5640 1 -- 172.21.15.44:0/2695023389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80cd6d0 msgr2=0x7f58f8161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.684+0000 7f59003c5640 1 --2- 172.21.15.44:0/2695023389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80cd6d0 0x7f58f8161420 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f58f80b8f40 tx=0x7f58ec02b910 comp rx=0 tx=0).stop 2023-11-04T01:36:44.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.684+0000 7f59003c5640 1 -- 172.21.15.44:0/2695023389 shutdown_connections 2023-11-04T01:36:44.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.684+0000 7f59003c5640 1 --2- 172.21.15.44:0/2695023389 >> v2:172.21.15.204:3300/0 conn(0x7f58f80b4880 0x7f58f80b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.684+0000 7f59003c5640 1 --2- 172.21.15.44:0/2695023389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80cd6d0 0x7f58f8161420 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.684+0000 7f59003c5640 1 -- 172.21.15.44:0/2695023389 >> 172.21.15.44:0/2695023389 conn(0x7f58f80cf880 msgr2=0x7f58f80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.684+0000 7f59003c5640 1 -- 172.21.15.44:0/2695023389 shutdown_connections 2023-11-04T01:36:44.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.684+0000 7f59003c5640 1 -- 172.21.15.44:0/2695023389 wait complete. 2023-11-04T01:36:44.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.685+0000 7f59003c5640 1 Processor -- start 2023-11-04T01:36:44.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.686+0000 7f59003c5640 1 -- start start 2023-11-04T01:36:44.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.686+0000 7f59003c5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80b4880 0x7f58f8156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.686+0000 7f59003c5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58f80cd6d0 0x7f58f81f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.686+0000 7f59003c5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58f8153e60 0x7f58f81f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.686+0000 7f59003c5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f80c6340 con 0x7f58f80b4880 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.686+0000 7f59003c5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f8158bc0 con 0x7f58f8153e60 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.686+0000 7f59003c5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f8158e80 con 0x7f58f80cd6d0 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.686+0000 7f58fe161640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80b4880 0x7f58f8156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.686+0000 7f58fe161640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80b4880 0x7f58f8156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58680/0 (socket says 172.21.15.44:58680) 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.686+0000 7f58fe161640 1 -- 172.21.15.44:0/313691703 learned_addr learned my addr 172.21.15.44:0/313691703 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.687+0000 7f58fe962640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58f8153e60 0x7f58f81f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.687+0000 7f58fd960640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58f80cd6d0 0x7f58f81f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.687+0000 7f58fe161640 1 -- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58f80cd6d0 msgr2=0x7f58f81f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.687+0000 7f58fe161640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58f80cd6d0 0x7f58f81f55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.687+0000 7f58fe161640 1 -- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58f8153e60 msgr2=0x7f58f81f3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.687+0000 7f58fe161640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58f8153e60 0x7f58f81f3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.687+0000 7f58fe161640 1 -- 172.21.15.44:0/313691703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec0094d0 con 0x7f58f80b4880 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.687+0000 7f58fd960640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58f80cd6d0 0x7f58f81f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.687+0000 7f58fe962640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58f8153e60 0x7f58f81f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.687+0000 7f58fe161640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80b4880 0x7f58f8156b30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f58f000b3f0 tx=0x7f58f000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.687+0000 7f58f6ffd640 1 -- 172.21.15.44:0/313691703 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f0011830 con 0x7f58f80b4880 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.687+0000 7f58f6ffd640 1 -- 172.21.15.44:0/313691703 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f0011990 con 0x7f58f80b4880 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.687+0000 7f58f6ffd640 1 -- 172.21.15.44:0/313691703 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f0011d40 con 0x7f58f80b4880 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.687+0000 7f59003c5640 1 -- 172.21.15.44:0/313691703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f8159160 con 0x7f58f80b4880 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.687+0000 7f59003c5640 1 -- 172.21.15.44:0/313691703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f8159720 con 0x7f58f80b4880 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.688+0000 7f59003c5640 1 -- 172.21.15.44:0/313691703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f8074290 con 0x7f58f80b4880 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.689+0000 7f58f6ffd640 1 -- 172.21.15.44:0/313691703 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f58f001a400 con 0x7f58f80b4880 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.689+0000 7f58f6ffd640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f58e406ae70 0x7f58e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.689+0000 7f58f6ffd640 1 -- 172.21.15.44:0/313691703 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f58f00897f0 con 0x7f58f80b4880 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.689+0000 7f58fd960640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f58e406ae70 0x7f58e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.690+0000 7f58fd960640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f58e406ae70 0x7f58e406d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f58ec036000 tx=0x7f58ec03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.693+0000 7f58f6ffd640 1 -- 172.21.15.44:0/313691703 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f58f0054570 con 0x7f58f80b4880 2023-11-04T01:36:44.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.870+0000 7f59003c5640 1 -- 172.21.15.44:0/313691703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58f80d0b80 con 0x7f58f80b4880 2023-11-04T01:36:44.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.871+0000 7f58f6ffd640 1 -- 172.21.15.44:0/313691703 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58f0057b90 con 0x7f58f80b4880 2023-11-04T01:36:44.873 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:36:44.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.872+0000 7f59003c5640 1 -- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f58e406ae70 msgr2=0x7f58e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.873+0000 7f59003c5640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f58e406ae70 0x7f58e406d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f58ec036000 tx=0x7f58ec03c040 comp rx=0 tx=0).stop 2023-11-04T01:36:44.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.873+0000 7f59003c5640 1 -- 172.21.15.44:0/313691703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80b4880 msgr2=0x7f58f8156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.873+0000 7f59003c5640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80b4880 0x7f58f8156b30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f58f000b3f0 tx=0x7f58f000b8b0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.873+0000 7f59003c5640 1 -- 172.21.15.44:0/313691703 shutdown_connections 2023-11-04T01:36:44.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.873+0000 7f59003c5640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f58e406ae70 0x7f58e406d330 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.873+0000 7f59003c5640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58f8153e60 0x7f58f81f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.873+0000 7f59003c5640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58f80cd6d0 0x7f58f81f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.873+0000 7f59003c5640 1 --2- 172.21.15.44:0/313691703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80b4880 0x7f58f8156b30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.873+0000 7f59003c5640 1 -- 172.21.15.44:0/313691703 >> 172.21.15.44:0/313691703 conn(0x7f58f80cf880 msgr2=0x7f58f815fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.873+0000 7f59003c5640 1 -- 172.21.15.44:0/313691703 shutdown_connections 2023-11-04T01:36:44.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.873+0000 7f59003c5640 1 -- 172.21.15.44:0/313691703 wait complete. 2023-11-04T01:36:44.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:44.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.993+0000 7f85c45bb640 1 Processor -- start 2023-11-04T01:36:44.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.993+0000 7f85c45bb640 1 -- start start 2023-11-04T01:36:44.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.994+0000 7f85c45bb640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f85bc0cd6d0 0x7f85bc161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.994+0000 7f85c45bb640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85bc0cde60 con 0x7f85bc153e60 2023-11-04T01:36:44.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.994+0000 7f85c45bb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85bc160f90 con 0x7f85bc0b4880 2023-11-04T01:36:44.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.994+0000 7f85c45bb640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85bc161960 con 0x7f85bc0cd6d0 2023-11-04T01:36:44.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.994+0000 7f85c1b56640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f85bc0cd6d0 0x7f85bc161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.994+0000 7f85c2357640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f85bc153e60 0x7f85bc15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42024/0 (socket says 172.21.15.44:42024) 2023-11-04T01:36:44.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.994+0000 7f85c2357640 1 -- 172.21.15.44:0/3047872479 learned_addr learned my addr 172.21.15.44:0/3047872479 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:44.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.995+0000 7f85c1b56640 1 -- 172.21.15.44:0/3047872479 >> v1:172.21.15.204:6789/0 conn(0x7f85bc0b4880 legacy=0x7f85bc0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.995+0000 7f85c1b56640 1 -- 172.21.15.44:0/3047872479 >> v1:172.21.15.44:6789/0 conn(0x7f85bc153e60 legacy=0x7f85bc15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.995+0000 7f85c1b56640 1 -- 172.21.15.44:0/3047872479 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc0ce090 con 0x7f85bc0cd6d0 2023-11-04T01:36:44.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.995+0000 7f85c1b56640 1 --2- 172.21.15.44:0/3047872479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85bc0cd6d0 0x7f85bc161420 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f85b00097a0 tx=0x7f85b002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f94f8317c12cd82 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.996+0000 7f85c1355640 1 -- 172.21.15.44:0/3047872479 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0031830 con 0x7f85bc0cd6d0 2023-11-04T01:36:44.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.996+0000 7f85c1355640 1 -- 172.21.15.44:0/3047872479 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b0031990 con 0x7f85bc0cd6d0 2023-11-04T01:36:44.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.996+0000 7f85c1355640 1 -- 172.21.15.44:0/3047872479 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0031d20 con 0x7f85bc0cd6d0 2023-11-04T01:36:44.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.996+0000 7f85c45bb640 1 -- 172.21.15.44:0/3047872479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85bc0cd6d0 msgr2=0x7f85bc161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.996+0000 7f85c45bb640 1 --2- 172.21.15.44:0/3047872479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85bc0cd6d0 0x7f85bc161420 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f85b00097a0 tx=0x7f85b002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.996+0000 7f85c45bb640 1 -- 172.21.15.44:0/3047872479 shutdown_connections 2023-11-04T01:36:45.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.996+0000 7f85c45bb640 1 --2- 172.21.15.44:0/3047872479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85bc0cd6d0 0x7f85bc161420 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.996+0000 7f85c45bb640 1 -- 172.21.15.44:0/3047872479 >> 172.21.15.44:0/3047872479 conn(0x7f85bc0cf880 msgr2=0x7f85bc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.996+0000 7f85c45bb640 1 -- 172.21.15.44:0/3047872479 shutdown_connections 2023-11-04T01:36:45.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.996+0000 7f85c45bb640 1 -- 172.21.15.44:0/3047872479 wait complete. 2023-11-04T01:36:45.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.997+0000 7f85c45bb640 1 Processor -- start 2023-11-04T01:36:45.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.998+0000 7f85c45bb640 1 -- start start 2023-11-04T01:36:45.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.998+0000 7f85c45bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85bc0b4880 0x7f85bc1f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.998+0000 7f85c45bb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85bc0cd6d0 0x7f85bc1f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.998+0000 7f85c45bb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85bc153e60 0x7f85bc1f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.998+0000 7f85c45bb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0c7170 con 0x7f85bc0b4880 2023-11-04T01:36:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.998+0000 7f85c45bb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0c6e90 con 0x7f85bc153e60 2023-11-04T01:36:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.998+0000 7f85c45bb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc157c10 con 0x7f85bc0cd6d0 2023-11-04T01:36:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.998+0000 7f85c2357640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85bc0b4880 0x7f85bc1f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.998+0000 7f85c2357640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85bc0b4880 0x7f85bc1f2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58698/0 (socket says 172.21.15.44:58698) 2023-11-04T01:36:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.998+0000 7f85c2357640 1 -- 172.21.15.44:0/2778279867 learned_addr learned my addr 172.21.15.44:0/2778279867 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.999+0000 7f85c1b56640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85bc0cd6d0 0x7f85bc1f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.999+0000 7f85c2b58640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85bc153e60 0x7f85bc1f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.999+0000 7f85c2357640 1 -- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85bc0cd6d0 msgr2=0x7f85bc1f5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.999+0000 7f85c2357640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85bc0cd6d0 0x7f85bc1f5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.999+0000 7f85c2357640 1 -- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85bc153e60 msgr2=0x7f85bc1f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.999+0000 7f85c2357640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85bc153e60 0x7f85bc1f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.999+0000 7f85c2357640 1 -- 172.21.15.44:0/2778279867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b0009400 con 0x7f85bc0b4880 2023-11-04T01:36:45.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.999+0000 7f85c1b56640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85bc0cd6d0 0x7f85bc1f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:45.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.999+0000 7f85c2b58640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85bc153e60 0x7f85bc1f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:45.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.999+0000 7f85c2357640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85bc0b4880 0x7f85bc1f2200 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f85b400c480 tx=0x7f85b400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.999+0000 7f85baffd640 1 -- 172.21.15.44:0/2778279867 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4005ce0 con 0x7f85bc0b4880 2023-11-04T01:36:45.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.999+0000 7f85baffd640 1 -- 172.21.15.44:0/2778279867 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b4005e40 con 0x7f85bc0b4880 2023-11-04T01:36:45.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.999+0000 7f85baffd640 1 -- 172.21.15.44:0/2778279867 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b40072f0 con 0x7f85bc0b4880 2023-11-04T01:36:45.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.999+0000 7f85c45bb640 1 -- 172.21.15.44:0/2778279867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85bc157ef0 con 0x7f85bc0b4880 2023-11-04T01:36:45.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:44.999+0000 7f85c45bb640 1 -- 172.21.15.44:0/2778279867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85bc0c6b20 con 0x7f85bc0b4880 2023-11-04T01:36:45.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.000+0000 7f85c45bb640 1 -- 172.21.15.44:0/2778279867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85bc074290 con 0x7f85bc0b4880 2023-11-04T01:36:45.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.000+0000 7f85baffd640 1 -- 172.21.15.44:0/2778279867 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f85b4007510 con 0x7f85bc0b4880 2023-11-04T01:36:45.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.001+0000 7f85baffd640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85a806ae70 0x7f85a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.001+0000 7f85baffd640 1 -- 172.21.15.44:0/2778279867 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f85b4088e00 con 0x7f85bc0b4880 2023-11-04T01:36:45.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.001+0000 7f85c1b56640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85a806ae70 0x7f85a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.002+0000 7f85c1b56640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85a806ae70 0x7f85a806d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f85b0036000 tx=0x7f85b003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.005+0000 7f85baffd640 1 -- 172.21.15.44:0/2778279867 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f85b4053c30 con 0x7f85bc0b4880 2023-11-04T01:36:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.179+0000 7f85c45bb640 1 -- 172.21.15.44:0/2778279867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f85bc155fd0 con 0x7f85bc0b4880 2023-11-04T01:36:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.179+0000 7f85baffd640 1 -- 172.21.15.44:0/2778279867 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f85b4017020 con 0x7f85bc0b4880 2023-11-04T01:36:45.182 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:45.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.181+0000 7f85c45bb640 1 -- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85a806ae70 msgr2=0x7f85a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.181+0000 7f85c45bb640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85a806ae70 0x7f85a806d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f85b0036000 tx=0x7f85b003c040 comp rx=0 tx=0).stop 2023-11-04T01:36:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.181+0000 7f85c45bb640 1 -- 172.21.15.44:0/2778279867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85bc0b4880 msgr2=0x7f85bc1f2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.181+0000 7f85c45bb640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85bc0b4880 0x7f85bc1f2200 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f85b400c480 tx=0x7f85b400c940 comp rx=0 tx=0).stop 2023-11-04T01:36:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.181+0000 7f85c45bb640 1 -- 172.21.15.44:0/2778279867 shutdown_connections 2023-11-04T01:36:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.181+0000 7f85c45bb640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85a806ae70 0x7f85a806d330 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.181+0000 7f85c45bb640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85bc153e60 0x7f85bc1f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.181+0000 7f85c45bb640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85bc0cd6d0 0x7f85bc1f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.181+0000 7f85c45bb640 1 --2- 172.21.15.44:0/2778279867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85bc0b4880 0x7f85bc1f2200 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.181+0000 7f85c45bb640 1 -- 172.21.15.44:0/2778279867 >> 172.21.15.44:0/2778279867 conn(0x7f85bc0cf880 msgr2=0x7f85bc0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.181+0000 7f85c45bb640 1 -- 172.21.15.44:0/2778279867 shutdown_connections 2023-11-04T01:36:45.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.181+0000 7f85c45bb640 1 -- 172.21.15.44:0/2778279867 wait complete. 2023-11-04T01:36:45.194 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:45.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.299+0000 7f56b6275640 1 Processor -- start 2023-11-04T01:36:45.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.299+0000 7f56b6275640 1 -- start start 2023-11-04T01:36:45.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.299+0000 7f56b6275640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f56b00cde60 0x7f56b015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.299+0000 7f56b6275640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56b015daa0 0x7f56b0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.299+0000 7f56b6275640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b015e000 con 0x7f56b00ce240 2023-11-04T01:36:45.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.299+0000 7f56b6275640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b015e5c0 con 0x7f56b00cde60 2023-11-04T01:36:45.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.299+0000 7f56b6275640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b015e2e0 con 0x7f56b015daa0 2023-11-04T01:36:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56b4812640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f56b00ce240 0x7f56b006b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42026/0 (socket says 172.21.15.44:42026) 2023-11-04T01:36:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56b4812640 1 -- 172.21.15.44:0/2737825099 learned_addr learned my addr 172.21.15.44:0/2737825099 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56affff640 1 --2- 172.21.15.44:0/2737825099 >> v2:172.21.15.204:3300/0 conn(0x7f56b00cde60 0x7f56b015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56af7fe640 1 --2- 172.21.15.44:0/2737825099 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56b015daa0 0x7f56b0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 -- 172.21.15.44:0/2737825099 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502067626 0 0) 0x7f56b015e000 con 0x7f56b00ce240 2023-11-04T01:36:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 -- 172.21.15.44:0/2737825099 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5698003520 con 0x7f56b00ce240 2023-11-04T01:36:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 -- 172.21.15.44:0/2737825099 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3854598644 0 0) 0x7f5698003520 con 0x7f56b00ce240 2023-11-04T01:36:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 -- 172.21.15.44:0/2737825099 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56b015daa0 msgr2=0x7f56b0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 --2- 172.21.15.44:0/2737825099 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56b015daa0 0x7f56b0157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 -- 172.21.15.44:0/2737825099 >> v2:172.21.15.204:3300/0 conn(0x7f56b00cde60 msgr2=0x7f56b015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 --2- 172.21.15.44:0/2737825099 >> v2:172.21.15.204:3300/0 conn(0x7f56b00cde60 0x7f56b015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 -- 172.21.15.44:0/2737825099 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b00d1120 con 0x7f56b00ce240 2023-11-04T01:36:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 -- 172.21.15.44:0/2737825099 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f56a80019f0 con 0x7f56b00ce240 2023-11-04T01:36:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56affff640 1 --2- 172.21.15.44:0/2737825099 >> v2:172.21.15.204:3300/0 conn(0x7f56b00cde60 0x7f56b015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 -- 172.21.15.44:0/2737825099 >> v1:172.21.15.44:6789/0 conn(0x7f56b00ce240 legacy=0x7f56b006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 --2- 172.21.15.44:0/2737825099 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5698003970 0x7f5698003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 --2- 172.21.15.44:0/2737825099 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56b015daa0 0x7f56980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 --2- 172.21.15.44:0/2737825099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5698004d00 0x7f5698005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 -- 172.21.15.44:0/2737825099 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b015e5c0 con 0x7f5698004d00 2023-11-04T01:36:45.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 -- 172.21.15.44:0/2737825099 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b015e2e0 con 0x7f5698003970 2023-11-04T01:36:45.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56aeffd640 1 -- 172.21.15.44:0/2737825099 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569800b980 con 0x7f56b015daa0 2023-11-04T01:36:45.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56b4812640 1 --2- 172.21.15.44:0/2737825099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5698004d00 0x7f5698005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56affff640 1 --2- 172.21.15.44:0/2737825099 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5698003970 0x7f5698003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.300+0000 7f56af7fe640 1 --2- 172.21.15.44:0/2737825099 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56b015daa0 0x7f56980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.301+0000 7f56b4812640 1 -- 172.21.15.44:0/2737825099 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56b015daa0 msgr2=0x7f56980047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.301+0000 7f56b4812640 1 --2- 172.21.15.44:0/2737825099 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56b015daa0 0x7f56980047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.301+0000 7f56b4812640 1 -- 172.21.15.44:0/2737825099 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5698003970 msgr2=0x7f5698003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.301+0000 7f56b4812640 1 --2- 172.21.15.44:0/2737825099 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5698003970 0x7f5698003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.301+0000 7f56b4812640 1 -- 172.21.15.44:0/2737825099 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5698003520 con 0x7f5698004d00 2023-11-04T01:36:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.301+0000 7f56b4812640 1 --2- 172.21.15.44:0/2737825099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5698004d00 0x7f5698005180 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f56a800a890 tx=0x7f56980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db188ebc66272937 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.301+0000 7f56aeffd640 1 -- 172.21.15.44:0/2737825099 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8034630 con 0x7f5698004d00 2023-11-04T01:36:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.302+0000 7f56aeffd640 1 -- 172.21.15.44:0/2737825099 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a802f070 con 0x7f5698004d00 2023-11-04T01:36:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.302+0000 7f56aeffd640 1 -- 172.21.15.44:0/2737825099 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8034a10 con 0x7f5698004d00 2023-11-04T01:36:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.302+0000 7f56b6275640 1 -- 172.21.15.44:0/2737825099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5698004d00 msgr2=0x7f5698005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.302+0000 7f56b6275640 1 --2- 172.21.15.44:0/2737825099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5698004d00 0x7f5698005180 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f56a800a890 tx=0x7f56980057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.302+0000 7f56b4812640 1 -- 172.21.15.44:0/2737825099 reap_dead start 2023-11-04T01:36:45.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.302+0000 7f56b6275640 1 -- 172.21.15.44:0/2737825099 shutdown_connections 2023-11-04T01:36:45.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.302+0000 7f56b6275640 1 -- 172.21.15.44:0/2737825099 >> 172.21.15.44:0/2737825099 conn(0x7f56b0071f30 msgr2=0x7f56b00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.302+0000 7f56b6275640 1 -- 172.21.15.44:0/2737825099 shutdown_connections 2023-11-04T01:36:45.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.302+0000 7f56b6275640 1 -- 172.21.15.44:0/2737825099 wait complete. 2023-11-04T01:36:45.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.303+0000 7f56b6275640 1 Processor -- start 2023-11-04T01:36:45.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.304+0000 7f56b6275640 1 -- start start 2023-11-04T01:36:45.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.304+0000 7f56b6275640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5698004d00 0x7f56b01467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.304+0000 7f56b6275640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56b01e4910 0x7f56b00c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.304+0000 7f56b6275640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56b01e4d90 0x7f56b00c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.304+0000 7f56b6275640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b0146d30 con 0x7f56b01e4d90 2023-11-04T01:36:45.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.304+0000 7f56b6275640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00c63e0 con 0x7f56b01e4910 2023-11-04T01:36:45.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.304+0000 7f56b6275640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b0143da0 con 0x7f5698004d00 2023-11-04T01:36:45.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.304+0000 7f56b4812640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56b01e4d90 0x7f56b00c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.304+0000 7f56b4812640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56b01e4d90 0x7f56b00c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58712/0 (socket says 172.21.15.44:58712) 2023-11-04T01:36:45.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.304+0000 7f56b4812640 1 -- 172.21.15.44:0/3242510934 learned_addr learned my addr 172.21.15.44:0/3242510934 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:45.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.304+0000 7f56af7fe640 1 --2- 172.21.15.44:0/3242510934 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56b01e4910 0x7f56b00c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.304+0000 7f56affff640 1 --2- 172.21.15.44:0/3242510934 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5698004d00 0x7f56b01467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.305+0000 7f56b4812640 1 -- 172.21.15.44:0/3242510934 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5698004d00 msgr2=0x7f56b01467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.305+0000 7f56b4812640 1 --2- 172.21.15.44:0/3242510934 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5698004d00 0x7f56b01467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.305+0000 7f56b4812640 1 -- 172.21.15.44:0/3242510934 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56b01e4910 msgr2=0x7f56b00c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.305+0000 7f56b4812640 1 --2- 172.21.15.44:0/3242510934 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56b01e4910 0x7f56b00c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.305+0000 7f56b4812640 1 -- 172.21.15.44:0/3242510934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b01e52d0 con 0x7f56b01e4d90 2023-11-04T01:36:45.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.305+0000 7f56b4812640 1 --2- 172.21.15.44:0/3242510934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56b01e4d90 0x7f56b00c9150 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f56a800a890 tx=0x7f56a8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.305+0000 7f56acff9640 1 -- 172.21.15.44:0/3242510934 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8034630 con 0x7f56b01e4d90 2023-11-04T01:36:45.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.305+0000 7f56acff9640 1 -- 172.21.15.44:0/3242510934 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a8034790 con 0x7f56b01e4d90 2023-11-04T01:36:45.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.305+0000 7f56b6275640 1 -- 172.21.15.44:0/3242510934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b0143ff0 con 0x7f56b01e4d90 2023-11-04T01:36:45.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.305+0000 7f56acff9640 1 -- 172.21.15.44:0/3242510934 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8034b00 con 0x7f56b01e4d90 2023-11-04T01:36:45.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.305+0000 7f56b6275640 1 -- 172.21.15.44:0/3242510934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b01445b0 con 0x7f56b01e4d90 2023-11-04T01:36:45.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.306+0000 7f56b6275640 1 -- 172.21.15.44:0/3242510934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b01447a0 con 0x7f56b01e4d90 2023-11-04T01:36:45.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.306+0000 7f56acff9640 1 -- 172.21.15.44:0/3242510934 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f56a8031030 con 0x7f56b01e4d90 2023-11-04T01:36:45.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.307+0000 7f56acff9640 1 --2- 172.21.15.44:0/3242510934 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f569c06ae70 0x7f569c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.307+0000 7f56acff9640 1 -- 172.21.15.44:0/3242510934 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f56a80ab480 con 0x7f56b01e4d90 2023-11-04T01:36:45.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.307+0000 7f56affff640 1 --2- 172.21.15.44:0/3242510934 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f569c06ae70 0x7f569c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.308+0000 7f56affff640 1 --2- 172.21.15.44:0/3242510934 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f569c06ae70 0x7f569c06d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f56a00093d0 tx=0x7f56a0009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.311+0000 7f56acff9640 1 -- 172.21.15.44:0/3242510934 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f56a8076170 con 0x7f56b01e4d90 2023-11-04T01:36:45.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.489+0000 7f56b6275640 1 -- 172.21.15.44:0/3242510934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56b01447a0 con 0x7f56b01e4d90 2023-11-04T01:36:45.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.490+0000 7f56acff9640 1 -- 172.21.15.44:0/3242510934 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7f56a8001fd0 con 0x7f56b01e4d90 2023-11-04T01:36:45.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:45.492 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:45.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.492+0000 7f56b6275640 1 -- 172.21.15.44:0/3242510934 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f569c06ae70 msgr2=0x7f569c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.492+0000 7f56b6275640 1 --2- 172.21.15.44:0/3242510934 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f569c06ae70 0x7f569c06d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f56a00093d0 tx=0x7f56a0009190 comp rx=0 tx=0).stop 2023-11-04T01:36:45.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.492+0000 7f56b6275640 1 -- 172.21.15.44:0/3242510934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56b01e4d90 msgr2=0x7f56b00c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.492+0000 7f56b6275640 1 --2- 172.21.15.44:0/3242510934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56b01e4d90 0x7f56b00c9150 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f56a800a890 tx=0x7f56a8001d80 comp rx=0 tx=0).stop 2023-11-04T01:36:45.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.492+0000 7f56b6275640 1 -- 172.21.15.44:0/3242510934 shutdown_connections 2023-11-04T01:36:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.492+0000 7f56b6275640 1 --2- 172.21.15.44:0/3242510934 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f569c06ae70 0x7f569c06d330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.492+0000 7f56b6275640 1 --2- 172.21.15.44:0/3242510934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56b01e4d90 0x7f56b00c9150 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.492+0000 7f56b6275640 1 --2- 172.21.15.44:0/3242510934 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56b01e4910 0x7f56b00c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.492+0000 7f56b6275640 1 --2- 172.21.15.44:0/3242510934 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5698004d00 0x7f56b01467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.492+0000 7f56b6275640 1 -- 172.21.15.44:0/3242510934 >> 172.21.15.44:0/3242510934 conn(0x7f56b0071f30 msgr2=0x7f56b00d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.492+0000 7f56b6275640 1 -- 172.21.15.44:0/3242510934 shutdown_connections 2023-11-04T01:36:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.492+0000 7f56b6275640 1 -- 172.21.15.44:0/3242510934 wait complete. 2023-11-04T01:36:45.505 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:45.505 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.613+0000 7fdd22955640 1 Processor -- start 2023-11-04T01:36:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.613+0000 7fdd22955640 1 -- start start 2023-11-04T01:36:45.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.613+0000 7fdd22955640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdd1c15af20 0x7fdd1c0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.613+0000 7fdd22955640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdd1c0cd3b0 0x7fdd1c0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.613+0000 7fdd22955640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c0d01f0 con 0x7fdd1c0b64c0 2023-11-04T01:36:45.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.613+0000 7fdd22955640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c0cc380 con 0x7fdd1c15af20 2023-11-04T01:36:45.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.613+0000 7fdd22955640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0cdd80 con 0x7fdd1c0cd3b0 2023-11-04T01:36:45.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.614+0000 7fdd1bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdd1c15af20 0x7fdd1c0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.614+0000 7fdd1bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdd1c15af20 0x7fdd1c0b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58728/0 (socket says 172.21.15.44:58728) 2023-11-04T01:36:45.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.614+0000 7fdd1bfff640 1 -- 172.21.15.44:0/1371097043 learned_addr learned my addr 172.21.15.44:0/1371097043 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:45.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.614+0000 7fdd20ef2640 1 --2- 172.21.15.44:0/1371097043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdd1c0cd3b0 0x7fdd1c0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.614+0000 7fdd1bfff640 1 -- 172.21.15.44:0/1371097043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdd1c0cd3b0 msgr2=0x7fdd1c0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:45.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.614+0000 7fdd1bfff640 1 --2- 172.21.15.44:0/1371097043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdd1c0cd3b0 0x7fdd1c0cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.614+0000 7fdd1bfff640 1 -- 172.21.15.44:0/1371097043 >> v1:172.21.15.204:6789/0 conn(0x7fdd1c0b64c0 legacy=0x7fdd1c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:45.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.614+0000 7fdd1bfff640 1 -- 172.21.15.44:0/1371097043 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c0b6a40 con 0x7fdd1c15af20 2023-11-04T01:36:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.615+0000 7fdd1bfff640 1 --2- 172.21.15.44:0/1371097043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd1c15af20 0x7fdd1c0b3cd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0098a0 tx=0x7fdd0c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3caeda40843ad9b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.615+0000 7fdd1affd640 1 -- 172.21.15.44:0/1371097043 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c031640 con 0x7fdd1c15af20 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.615+0000 7fdd1affd640 1 -- 172.21.15.44:0/1371097043 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c0317a0 con 0x7fdd1c15af20 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.615+0000 7fdd1affd640 1 -- 172.21.15.44:0/1371097043 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c031b30 con 0x7fdd1c15af20 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.615+0000 7fdd22955640 1 -- 172.21.15.44:0/1371097043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd1c15af20 msgr2=0x7fdd1c0b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.615+0000 7fdd22955640 1 --2- 172.21.15.44:0/1371097043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd1c15af20 0x7fdd1c0b3cd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0098a0 tx=0x7fdd0c02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.615+0000 7fdd22955640 1 -- 172.21.15.44:0/1371097043 shutdown_connections 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.615+0000 7fdd22955640 1 --2- 172.21.15.44:0/1371097043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdd1c0cd3b0 0x7fdd1c0cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.615+0000 7fdd22955640 1 --2- 172.21.15.44:0/1371097043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd1c15af20 0x7fdd1c0b3cd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.615+0000 7fdd22955640 1 -- 172.21.15.44:0/1371097043 >> 172.21.15.44:0/1371097043 conn(0x7fdd1c06ea20 msgr2=0x7fdd1c06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.615+0000 7fdd22955640 1 -- 172.21.15.44:0/1371097043 shutdown_connections 2023-11-04T01:36:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.615+0000 7fdd22955640 1 -- 172.21.15.44:0/1371097043 wait complete. 2023-11-04T01:36:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.617+0000 7fdd22955640 1 Processor -- start 2023-11-04T01:36:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.617+0000 7fdd22955640 1 -- start start 2023-11-04T01:36:45.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.617+0000 7fdd22955640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd1c0b64c0 0x7fdd1c0b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.617+0000 7fdd22955640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdd1c0cd3b0 0x7fdd1c14f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.617+0000 7fdd22955640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd1c15af20 0x7fdd1c0b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.617+0000 7fdd22955640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0b0e20 con 0x7fdd1c0b64c0 2023-11-04T01:36:45.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.617+0000 7fdd22955640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0b1100 con 0x7fdd1c15af20 2023-11-04T01:36:45.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.617+0000 7fdd22955640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0b13e0 con 0x7fdd1c0cd3b0 2023-11-04T01:36:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd1bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd1c0b64c0 0x7fdd1c0b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd1bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd1c0b64c0 0x7fdd1c0b1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58736/0 (socket says 172.21.15.44:58736) 2023-11-04T01:36:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd1bfff640 1 -- 172.21.15.44:0/817373313 learned_addr learned my addr 172.21.15.44:0/817373313 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd1b7fe640 1 --2- 172.21.15.44:0/817373313 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdd1c0cd3b0 0x7fdd1c14f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd20ef2640 1 --2- 172.21.15.44:0/817373313 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd1c15af20 0x7fdd1c0b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd1bfff640 1 -- 172.21.15.44:0/817373313 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdd1c0cd3b0 msgr2=0x7fdd1c14f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd1bfff640 1 --2- 172.21.15.44:0/817373313 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdd1c0cd3b0 0x7fdd1c14f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd1bfff640 1 -- 172.21.15.44:0/817373313 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd1c15af20 msgr2=0x7fdd1c0b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd1bfff640 1 --2- 172.21.15.44:0/817373313 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd1c15af20 0x7fdd1c0b05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd1bfff640 1 -- 172.21.15.44:0/817373313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c0094d0 con 0x7fdd1c0b64c0 2023-11-04T01:36:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd20ef2640 1 --2- 172.21.15.44:0/817373313 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd1c15af20 0x7fdd1c0b05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd1bfff640 1 --2- 172.21.15.44:0/817373313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd1c0b64c0 0x7fdd1c0b1ec0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c000c00 tx=0x7fdd0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd18ff9640 1 -- 172.21.15.44:0/817373313 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c03ac60 con 0x7fdd1c0b64c0 2023-11-04T01:36:45.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd18ff9640 1 -- 172.21.15.44:0/817373313 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c03adc0 con 0x7fdd1c0b64c0 2023-11-04T01:36:45.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd22955640 1 -- 172.21.15.44:0/817373313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c0b16c0 con 0x7fdd1c0b64c0 2023-11-04T01:36:45.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd18ff9640 1 -- 172.21.15.44:0/817373313 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c044610 con 0x7fdd1c0b64c0 2023-11-04T01:36:45.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.618+0000 7fdd22955640 1 -- 172.21.15.44:0/817373313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c14f6f0 con 0x7fdd1c0b64c0 2023-11-04T01:36:45.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.619+0000 7fdd22955640 1 -- 172.21.15.44:0/817373313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1c0b1be0 con 0x7fdd1c0b64c0 2023-11-04T01:36:45.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.620+0000 7fdd18ff9640 1 -- 172.21.15.44:0/817373313 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd0c02f050 con 0x7fdd1c0b64c0 2023-11-04T01:36:45.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.620+0000 7fdd18ff9640 1 --2- 172.21.15.44:0/817373313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdd0806ae70 0x7fdd0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.620+0000 7fdd18ff9640 1 -- 172.21.15.44:0/817373313 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdd0c0ab990 con 0x7fdd1c0b64c0 2023-11-04T01:36:45.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.620+0000 7fdd1b7fe640 1 --2- 172.21.15.44:0/817373313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdd0806ae70 0x7fdd0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.621+0000 7fdd1b7fe640 1 --2- 172.21.15.44:0/817373313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdd0806ae70 0x7fdd0806d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0afd10 tx=0x7fdd10007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.624+0000 7fdd18ff9640 1 -- 172.21.15.44:0/817373313 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdd0c076600 con 0x7fdd1c0b64c0 2023-11-04T01:36:45.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.801+0000 7fdd22955640 1 -- 172.21.15.44:0/817373313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd1c1525c0 con 0x7fdd1c0b64c0 2023-11-04T01:36:45.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.801+0000 7fdd18ff9640 1 -- 172.21.15.44:0/817373313 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd0c035020 con 0x7fdd1c0b64c0 2023-11-04T01:36:45.804 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:36:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.803+0000 7fdd22955640 1 -- 172.21.15.44:0/817373313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdd0806ae70 msgr2=0x7fdd0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.803+0000 7fdd22955640 1 --2- 172.21.15.44:0/817373313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdd0806ae70 0x7fdd0806d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0afd10 tx=0x7fdd10007e30 comp rx=0 tx=0).stop 2023-11-04T01:36:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.803+0000 7fdd22955640 1 -- 172.21.15.44:0/817373313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd1c0b64c0 msgr2=0x7fdd1c0b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.803+0000 7fdd22955640 1 --2- 172.21.15.44:0/817373313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd1c0b64c0 0x7fdd1c0b1ec0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c000c00 tx=0x7fdd0c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.803+0000 7fdd22955640 1 -- 172.21.15.44:0/817373313 shutdown_connections 2023-11-04T01:36:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.803+0000 7fdd22955640 1 --2- 172.21.15.44:0/817373313 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdd0806ae70 0x7fdd0806d330 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.803+0000 7fdd22955640 1 --2- 172.21.15.44:0/817373313 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd1c15af20 0x7fdd1c0b05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.803+0000 7fdd22955640 1 --2- 172.21.15.44:0/817373313 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdd1c0cd3b0 0x7fdd1c14f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.803+0000 7fdd22955640 1 --2- 172.21.15.44:0/817373313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd1c0b64c0 0x7fdd1c0b1ec0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.803+0000 7fdd22955640 1 -- 172.21.15.44:0/817373313 >> 172.21.15.44:0/817373313 conn(0x7fdd1c06ea20 msgr2=0x7fdd1c159810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.804+0000 7fdd22955640 1 -- 172.21.15.44:0/817373313 shutdown_connections 2023-11-04T01:36:45.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.804+0000 7fdd22955640 1 -- 172.21.15.44:0/817373313 wait complete. 2023-11-04T01:36:45.816 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.923+0000 7fcb5a4fc640 1 Processor -- start 2023-11-04T01:36:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.923+0000 7fcb5a4fc640 1 -- start start 2023-11-04T01:36:45.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.924+0000 7fcb5a4fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcb54160430 0x7fcb540b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.924+0000 7fcb5a4fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb5406c3a0 0x7fcb540cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.924+0000 7fcb5a4fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb540b2fc0 con 0x7fcb540b2b60 2023-11-04T01:36:45.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.924+0000 7fcb5a4fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb540cb580 con 0x7fcb54160430 2023-11-04T01:36:45.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.924+0000 7fcb5a4fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5406c7f0 con 0x7fcb5406c3a0 2023-11-04T01:36:45.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.925+0000 7fcb58a99640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb5406c3a0 0x7fcb540cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.925+0000 7fcb53fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcb54160430 0x7fcb540b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.925+0000 7fcb53fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcb54160430 0x7fcb540b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:49884/0 (socket says 172.21.15.44:49884) 2023-11-04T01:36:45.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.925+0000 7fcb58a99640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb5406c3a0 0x7fcb540cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:59324/0 (socket says 172.21.15.44:59324) 2023-11-04T01:36:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.925+0000 7fcb537fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fcb540b2b60 0x7fcb5406bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:37192/0 (socket says 172.21.15.44:37192) 2023-11-04T01:36:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.925+0000 7fcb58a99640 1 -- 172.21.15.44:0/2055304426 learned_addr learned my addr 172.21.15.44:0/2055304426 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.925+0000 7fcb53fff640 1 -- 172.21.15.44:0/2055304426 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb5406c3a0 msgr2=0x7fcb540cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.925+0000 7fcb53fff640 1 --2- 172.21.15.44:0/2055304426 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb5406c3a0 0x7fcb540cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.925+0000 7fcb53fff640 1 -- 172.21.15.44:0/2055304426 >> v1:172.21.15.204:6789/0 conn(0x7fcb540b2b60 legacy=0x7fcb5406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.925+0000 7fcb53fff640 1 -- 172.21.15.44:0/2055304426 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5406ca40 con 0x7fcb54160430 2023-11-04T01:36:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.925+0000 7fcb52ffd640 1 -- 172.21.15.44:0/2055304426 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774677786 0 0) 0x7fcb540b2fc0 con 0x7fcb540b2b60 2023-11-04T01:36:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.925+0000 7fcb58a99640 1 --2- 172.21.15.44:0/2055304426 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb5406c3a0 0x7fcb540cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:45.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.926+0000 7fcb53fff640 1 --2- 172.21.15.44:0/2055304426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb54160430 0x7fcb540b2620 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcb480097a0 tx=0x7fcb4802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=632dd28d1dfef37 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.926+0000 7fcb52ffd640 1 -- 172.21.15.44:0/2055304426 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4802d040 con 0x7fcb54160430 2023-11-04T01:36:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.926+0000 7fcb52ffd640 1 -- 172.21.15.44:0/2055304426 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb48031810 con 0x7fcb54160430 2023-11-04T01:36:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.926+0000 7fcb52ffd640 1 -- 172.21.15.44:0/2055304426 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48031ba0 con 0x7fcb54160430 2023-11-04T01:36:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.927+0000 7fcb5a4fc640 1 -- 172.21.15.44:0/2055304426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb54160430 msgr2=0x7fcb540b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.927+0000 7fcb5a4fc640 1 --2- 172.21.15.44:0/2055304426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb54160430 0x7fcb540b2620 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcb480097a0 tx=0x7fcb4802b8b0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.927+0000 7fcb5a4fc640 1 -- 172.21.15.44:0/2055304426 shutdown_connections 2023-11-04T01:36:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.927+0000 7fcb5a4fc640 1 --2- 172.21.15.44:0/2055304426 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb5406c3a0 0x7fcb540cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.927+0000 7fcb5a4fc640 1 --2- 172.21.15.44:0/2055304426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb54160430 0x7fcb540b2620 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.927+0000 7fcb5a4fc640 1 -- 172.21.15.44:0/2055304426 >> 172.21.15.44:0/2055304426 conn(0x7fcb5406ea20 msgr2=0x7fcb5406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.927+0000 7fcb5a4fc640 1 -- 172.21.15.44:0/2055304426 shutdown_connections 2023-11-04T01:36:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.927+0000 7fcb5a4fc640 1 -- 172.21.15.44:0/2055304426 wait complete. 2023-11-04T01:36:45.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.928+0000 7fcb5a4fc640 1 Processor -- start 2023-11-04T01:36:45.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.928+0000 7fcb5a4fc640 1 -- start start 2023-11-04T01:36:45.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb5a4fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb5406c3a0 0x7fcb541f2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb5a4fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb540b2b60 0x7fcb5414cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb5a4fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb54160430 0x7fcb540ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb5a4fc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb541581c0 con 0x7fcb540b2b60 2023-11-04T01:36:45.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb5a4fc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb541f3e10 con 0x7fcb5406c3a0 2023-11-04T01:36:45.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb5a4fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb541f3570 con 0x7fcb54160430 2023-11-04T01:36:45.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb537fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb540b2b60 0x7fcb5414cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb537fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb540b2b60 0x7fcb5414cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58752/0 (socket says 172.21.15.44:58752) 2023-11-04T01:36:45.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb537fe640 1 -- 172.21.15.44:0/3184666487 learned_addr learned my addr 172.21.15.44:0/3184666487 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:45.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb53fff640 1 --2- 172.21.15.44:0/3184666487 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb5406c3a0 0x7fcb541f2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb58a99640 1 --2- 172.21.15.44:0/3184666487 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb54160430 0x7fcb540ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb537fe640 1 -- 172.21.15.44:0/3184666487 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb54160430 msgr2=0x7fcb540ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb537fe640 1 --2- 172.21.15.44:0/3184666487 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb54160430 0x7fcb540ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb537fe640 1 -- 172.21.15.44:0/3184666487 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb5406c3a0 msgr2=0x7fcb541f2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb537fe640 1 --2- 172.21.15.44:0/3184666487 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb5406c3a0 0x7fcb541f2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.929+0000 7fcb537fe640 1 -- 172.21.15.44:0/3184666487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c009b30 con 0x7fcb540b2b60 2023-11-04T01:36:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.930+0000 7fcb537fe640 1 --2- 172.21.15.44:0/3184666487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb540b2b60 0x7fcb5414cf70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c4d0 tx=0x7fcb4400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.930+0000 7fcb50ff9640 1 -- 172.21.15.44:0/3184666487 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb440074e0 con 0x7fcb540b2b60 2023-11-04T01:36:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.930+0000 7fcb50ff9640 1 -- 172.21.15.44:0/3184666487 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb44007660 con 0x7fcb540b2b60 2023-11-04T01:36:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.930+0000 7fcb5a4fc640 1 -- 172.21.15.44:0/3184666487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb48009400 con 0x7fcb540b2b60 2023-11-04T01:36:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.930+0000 7fcb50ff9640 1 -- 172.21.15.44:0/3184666487 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44004a20 con 0x7fcb540b2b60 2023-11-04T01:36:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.930+0000 7fcb5a4fc640 1 -- 172.21.15.44:0/3184666487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb541f3b30 con 0x7fcb540b2b60 2023-11-04T01:36:45.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.931+0000 7fcb5a4fc640 1 -- 172.21.15.44:0/3184666487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb54158300 con 0x7fcb540b2b60 2023-11-04T01:36:45.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.931+0000 7fcb50ff9640 1 -- 172.21.15.44:0/3184666487 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb44004b80 con 0x7fcb540b2b60 2023-11-04T01:36:45.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.931+0000 7fcb50ff9640 1 --2- 172.21.15.44:0/3184666487 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcb4006ae70 0x7fcb4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.932+0000 7fcb50ff9640 1 -- 172.21.15.44:0/3184666487 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcb44088a80 con 0x7fcb540b2b60 2023-11-04T01:36:45.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.932+0000 7fcb53fff640 1 --2- 172.21.15.44:0/3184666487 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcb4006ae70 0x7fcb4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.932+0000 7fcb53fff640 1 --2- 172.21.15.44:0/3184666487 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcb4006ae70 0x7fcb4006d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcb48036000 tx=0x7fcb4803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:45.936+0000 7fcb50ff9640 1 -- 172.21.15.44:0/3184666487 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcb54158300 con 0x7fcb540b2b60 2023-11-04T01:36:46.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.115+0000 7fcb5a4fc640 1 -- 172.21.15.44:0/3184666487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb54158300 con 0x7fcb540b2b60 2023-11-04T01:36:46.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.115+0000 7fcb50ff9640 1 -- 172.21.15.44:0/3184666487 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb54158300 con 0x7fcb540b2b60 2023-11-04T01:36:46.117 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.117+0000 7fcb5a4fc640 1 -- 172.21.15.44:0/3184666487 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcb4006ae70 msgr2=0x7fcb4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.117+0000 7fcb5a4fc640 1 --2- 172.21.15.44:0/3184666487 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcb4006ae70 0x7fcb4006d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcb48036000 tx=0x7fcb4803c040 comp rx=0 tx=0).stop 2023-11-04T01:36:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.117+0000 7fcb5a4fc640 1 -- 172.21.15.44:0/3184666487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb540b2b60 msgr2=0x7fcb5414cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.117+0000 7fcb5a4fc640 1 --2- 172.21.15.44:0/3184666487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb540b2b60 0x7fcb5414cf70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c4d0 tx=0x7fcb4400c990 comp rx=0 tx=0).stop 2023-11-04T01:36:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.117+0000 7fcb5a4fc640 1 -- 172.21.15.44:0/3184666487 shutdown_connections 2023-11-04T01:36:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.117+0000 7fcb5a4fc640 1 --2- 172.21.15.44:0/3184666487 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcb4006ae70 0x7fcb4006d330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.117+0000 7fcb5a4fc640 1 --2- 172.21.15.44:0/3184666487 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb54160430 0x7fcb540ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.117+0000 7fcb5a4fc640 1 --2- 172.21.15.44:0/3184666487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb540b2b60 0x7fcb5414cf70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.117+0000 7fcb5a4fc640 1 --2- 172.21.15.44:0/3184666487 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb5406c3a0 0x7fcb541f2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.117+0000 7fcb5a4fc640 1 -- 172.21.15.44:0/3184666487 >> 172.21.15.44:0/3184666487 conn(0x7fcb5406ea20 msgr2=0x7fcb540cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.117+0000 7fcb5a4fc640 1 -- 172.21.15.44:0/3184666487 shutdown_connections 2023-11-04T01:36:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.117+0000 7fcb5a4fc640 1 -- 172.21.15.44:0/3184666487 wait complete. 2023-11-04T01:36:46.130 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:46.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.238+0000 7f5e48d4c640 1 Processor -- start 2023-11-04T01:36:46.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.238+0000 7f5e48d4c640 1 -- start start 2023-11-04T01:36:46.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.239+0000 7f5e48d4c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5e440cd6d0 0x7f5e44161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.239+0000 7f5e48d4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e440b4880 0x7f5e440b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.239+0000 7f5e48d4c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e440cde60 con 0x7f5e44153e60 2023-11-04T01:36:46.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.239+0000 7f5e48d4c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e44160f90 con 0x7f5e440cd6d0 2023-11-04T01:36:46.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.239+0000 7f5e48d4c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e44161960 con 0x7f5e440b4880 2023-11-04T01:36:46.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.240+0000 7f5e42d9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e440b4880 0x7f5e440b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.240+0000 7f5e41d9b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5e440cd6d0 0x7f5e44161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.240+0000 7f5e41d9b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5e440cd6d0 0x7f5e44161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:49890/0 (socket says 172.21.15.44:49890) 2023-11-04T01:36:46.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.240+0000 7f5e42d9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e440b4880 0x7f5e440b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:59336/0 (socket says 172.21.15.44:59336) 2023-11-04T01:36:46.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.240+0000 7f5e41d9b640 1 -- 172.21.15.44:0/379239824 learned_addr learned my addr 172.21.15.44:0/379239824 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.240+0000 7f5e4259c640 1 --1- 172.21.15.44:0/379239824 >> v1:172.21.15.204:6789/0 conn(0x7f5e44153e60 0x7f5e4415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:37204/0 (socket says 172.21.15.44:37204) 2023-11-04T01:36:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.240+0000 7f5e41d9b640 1 -- 172.21.15.44:0/379239824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e440b4880 msgr2=0x7f5e440b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.240+0000 7f5e41d9b640 1 --2- 172.21.15.44:0/379239824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e440b4880 0x7f5e440b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.240+0000 7f5e41d9b640 1 -- 172.21.15.44:0/379239824 >> v1:172.21.15.204:6789/0 conn(0x7f5e44153e60 legacy=0x7f5e4415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.240+0000 7f5e41d9b640 1 -- 172.21.15.44:0/379239824 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e440b5220 con 0x7f5e440cd6d0 2023-11-04T01:36:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.240+0000 7f5e4159a640 1 -- 172.21.15.44:0/379239824 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843000197 0 0) 0x7f5e440cde60 con 0x7f5e44153e60 2023-11-04T01:36:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.240+0000 7f5e42d9d640 1 --2- 172.21.15.44:0/379239824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e440b4880 0x7f5e440b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.241+0000 7f5e41d9b640 1 --2- 172.21.15.44:0/379239824 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e440cd6d0 0x7f5e44161420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009870 tx=0x7f5e2c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42dab5aa3e2fcc50 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.241+0000 7f5e4159a640 1 -- 172.21.15.44:0/379239824 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c030840 con 0x7f5e440cd6d0 2023-11-04T01:36:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.241+0000 7f5e4159a640 1 -- 172.21.15.44:0/379239824 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c0309a0 con 0x7f5e440cd6d0 2023-11-04T01:36:46.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.241+0000 7f5e4159a640 1 -- 172.21.15.44:0/379239824 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c030d30 con 0x7f5e440cd6d0 2023-11-04T01:36:46.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.242+0000 7f5e48d4c640 1 -- 172.21.15.44:0/379239824 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e440cd6d0 msgr2=0x7f5e44161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.242+0000 7f5e48d4c640 1 --2- 172.21.15.44:0/379239824 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e440cd6d0 0x7f5e44161420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009870 tx=0x7f5e2c02b980 comp rx=0 tx=0).stop 2023-11-04T01:36:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.242+0000 7f5e48d4c640 1 -- 172.21.15.44:0/379239824 shutdown_connections 2023-11-04T01:36:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.242+0000 7f5e48d4c640 1 --2- 172.21.15.44:0/379239824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e440b4880 0x7f5e440b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.242+0000 7f5e48d4c640 1 --2- 172.21.15.44:0/379239824 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e440cd6d0 0x7f5e44161420 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.242+0000 7f5e48d4c640 1 -- 172.21.15.44:0/379239824 >> 172.21.15.44:0/379239824 conn(0x7f5e440cf880 msgr2=0x7f5e440cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.242+0000 7f5e48d4c640 1 -- 172.21.15.44:0/379239824 shutdown_connections 2023-11-04T01:36:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.242+0000 7f5e48d4c640 1 -- 172.21.15.44:0/379239824 wait complete. 2023-11-04T01:36:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.243+0000 7f5e48d4c640 1 Processor -- start 2023-11-04T01:36:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.243+0000 7f5e48d4c640 1 -- start start 2023-11-04T01:36:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e48d4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e440b4880 0x7f5e440cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e48d4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e440cd6d0 0x7f5e44154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e48d4c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e44153e60 0x7f5e441552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e48d4c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e44155830 con 0x7f5e440b4880 2023-11-04T01:36:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e48d4c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440cb730 con 0x7f5e44153e60 2023-11-04T01:36:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e48d4c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e44155aa0 con 0x7f5e440cd6d0 2023-11-04T01:36:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e4259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e440b4880 0x7f5e440cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e4259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e440b4880 0x7f5e440cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58766/0 (socket says 172.21.15.44:58766) 2023-11-04T01:36:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e4259c640 1 -- 172.21.15.44:0/3619199474 learned_addr learned my addr 172.21.15.44:0/3619199474 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e42d9d640 1 --2- 172.21.15.44:0/3619199474 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e44153e60 0x7f5e441552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e41d9b640 1 --2- 172.21.15.44:0/3619199474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e440cd6d0 0x7f5e44154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e4259c640 1 -- 172.21.15.44:0/3619199474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e440cd6d0 msgr2=0x7f5e44154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e4259c640 1 --2- 172.21.15.44:0/3619199474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e440cd6d0 0x7f5e44154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e4259c640 1 -- 172.21.15.44:0/3619199474 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e44153e60 msgr2=0x7f5e441552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e4259c640 1 --2- 172.21.15.44:0/3619199474 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e44153e60 0x7f5e441552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e4259c640 1 -- 172.21.15.44:0/3619199474 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34009a70 con 0x7f5e440b4880 2023-11-04T01:36:46.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e42d9d640 1 --2- 172.21.15.44:0/3619199474 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e44153e60 0x7f5e441552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:46.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.244+0000 7f5e4259c640 1 --2- 172.21.15.44:0/3619199474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e440b4880 0x7f5e440cb1f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00c430 tx=0x7f5e3c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.245+0000 7f5e3affd640 1 -- 172.21.15.44:0/3619199474 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0074e0 con 0x7f5e440b4880 2023-11-04T01:36:46.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.245+0000 7f5e3affd640 1 -- 172.21.15.44:0/3619199474 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c007660 con 0x7f5e440b4880 2023-11-04T01:36:46.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.245+0000 7f5e48d4c640 1 -- 172.21.15.44:0/3619199474 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2c0094d0 con 0x7f5e440b4880 2023-11-04T01:36:46.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.245+0000 7f5e3affd640 1 -- 172.21.15.44:0/3619199474 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c004a20 con 0x7f5e440b4880 2023-11-04T01:36:46.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.245+0000 7f5e48d4c640 1 -- 172.21.15.44:0/3619199474 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e44158310 con 0x7f5e440b4880 2023-11-04T01:36:46.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.246+0000 7f5e48d4c640 1 -- 172.21.15.44:0/3619199474 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e44074290 con 0x7f5e440b4880 2023-11-04T01:36:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.246+0000 7f5e3affd640 1 -- 172.21.15.44:0/3619199474 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e3c004b80 con 0x7f5e440b4880 2023-11-04T01:36:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.246+0000 7f5e3affd640 1 --2- 172.21.15.44:0/3619199474 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5e2406ae70 0x7f5e2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.247+0000 7f5e3affd640 1 -- 172.21.15.44:0/3619199474 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5e3c089860 con 0x7f5e440b4880 2023-11-04T01:36:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.247+0000 7f5e41d9b640 1 --2- 172.21.15.44:0/3619199474 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5e2406ae70 0x7f5e2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.247+0000 7f5e41d9b640 1 --2- 172.21.15.44:0/3619199474 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5e2406ae70 0x7f5e2406d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c036000 tx=0x7f5e2c03b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.251+0000 7f5e3affd640 1 -- 172.21.15.44:0/3619199474 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5e3c054550 con 0x7f5e440b4880 2023-11-04T01:36:46.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.430+0000 7f5e48d4c640 1 -- 172.21.15.44:0/3619199474 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e441537a0 con 0x7f5e440b4880 2023-11-04T01:36:46.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.431+0000 7f5e3affd640 1 -- 172.21.15.44:0/3619199474 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e3c057b70 con 0x7f5e440b4880 2023-11-04T01:36:46.433 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:36:46.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.433+0000 7f5e48d4c640 1 -- 172.21.15.44:0/3619199474 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5e2406ae70 msgr2=0x7f5e2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.433+0000 7f5e48d4c640 1 --2- 172.21.15.44:0/3619199474 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5e2406ae70 0x7f5e2406d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c036000 tx=0x7f5e2c03b040 comp rx=0 tx=0).stop 2023-11-04T01:36:46.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.433+0000 7f5e48d4c640 1 -- 172.21.15.44:0/3619199474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e440b4880 msgr2=0x7f5e440cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.433+0000 7f5e48d4c640 1 --2- 172.21.15.44:0/3619199474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e440b4880 0x7f5e440cb1f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00c430 tx=0x7f5e3c00c8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.433+0000 7f5e48d4c640 1 -- 172.21.15.44:0/3619199474 shutdown_connections 2023-11-04T01:36:46.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.433+0000 7f5e48d4c640 1 --2- 172.21.15.44:0/3619199474 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5e2406ae70 0x7f5e2406d330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.433+0000 7f5e48d4c640 1 --2- 172.21.15.44:0/3619199474 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e44153e60 0x7f5e441552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.433+0000 7f5e48d4c640 1 --2- 172.21.15.44:0/3619199474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e440cd6d0 0x7f5e44154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.433+0000 7f5e48d4c640 1 --2- 172.21.15.44:0/3619199474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e440b4880 0x7f5e440cb1f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.433+0000 7f5e48d4c640 1 -- 172.21.15.44:0/3619199474 >> 172.21.15.44:0/3619199474 conn(0x7f5e440cf880 msgr2=0x7f5e440b7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:46.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.433+0000 7f5e48d4c640 1 -- 172.21.15.44:0/3619199474 shutdown_connections 2023-11-04T01:36:46.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.433+0000 7f5e48d4c640 1 -- 172.21.15.44:0/3619199474 wait complete. 2023-11-04T01:36:46.446 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:46.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.553+0000 7fdc097f5640 1 Processor -- start 2023-11-04T01:36:46.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.553+0000 7fdc097f5640 1 -- start start 2023-11-04T01:36:46.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.554+0000 7fdc097f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc041605b0 0x7fdc040ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.554+0000 7fdc097f5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc04160990 con 0x7fdc040b1a40 2023-11-04T01:36:46.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.554+0000 7fdc097f5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc040cc7c0 con 0x7fdc0406a830 2023-11-04T01:36:46.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.554+0000 7fdc097f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040cd750 con 0x7fdc041605b0 2023-11-04T01:36:46.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.554+0000 7fdc027fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdc040b1a40 0x7fdc0406a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42036/0 (socket says 172.21.15.44:42036) 2023-11-04T01:36:46.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.554+0000 7fdc027fc640 1 -- 172.21.15.44:0/360560469 learned_addr learned my addr 172.21.15.44:0/360560469 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:46.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.554+0000 7fdc02ffd640 1 --2- 172.21.15.44:0/360560469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc041605b0 0x7fdc040ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.554+0000 7fdc01ffb640 1 -- 172.21.15.44:0/360560469 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410811639 0 0) 0x7fdc04160990 con 0x7fdc040b1a40 2023-11-04T01:36:46.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.554+0000 7fdc01ffb640 1 -- 172.21.15.44:0/360560469 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbf0003520 con 0x7fdc040b1a40 2023-11-04T01:36:46.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc01ffb640 1 -- 172.21.15.44:0/360560469 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1543520479 0 0) 0x7fdbf0003520 con 0x7fdc040b1a40 2023-11-04T01:36:46.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc01ffb640 1 -- 172.21.15.44:0/360560469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc041605b0 msgr2=0x7fdc040ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:46.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc01ffb640 1 --2- 172.21.15.44:0/360560469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc041605b0 0x7fdc040ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc01ffb640 1 -- 172.21.15.44:0/360560469 >> v1:172.21.15.204:6789/0 conn(0x7fdc0406a830 legacy=0x7fdc040cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc01ffb640 1 -- 172.21.15.44:0/360560469 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc040cc4e0 con 0x7fdc040b1a40 2023-11-04T01:36:46.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc01ffb640 1 -- 172.21.15.44:0/360560469 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fdbec001670 con 0x7fdc040b1a40 2023-11-04T01:36:46.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc01ffb640 1 -- 172.21.15.44:0/360560469 >> v1:172.21.15.44:6789/0 conn(0x7fdc040b1a40 legacy=0x7fdc0406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc01ffb640 1 --2- 172.21.15.44:0/360560469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc041605b0 0x7fdbf00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc01ffb640 1 --2- 172.21.15.44:0/360560469 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdbf0003ee0 0x7fdbf00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc01ffb640 1 --2- 172.21.15.44:0/360560469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbf0004d00 0x7fdbf0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc01ffb640 1 -- 172.21.15.44:0/360560469 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040cd750 con 0x7fdbf0004d00 2023-11-04T01:36:46.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc01ffb640 1 -- 172.21.15.44:0/360560469 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf000bb40 con 0x7fdbf0003ee0 2023-11-04T01:36:46.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc01ffb640 1 -- 172.21.15.44:0/360560469 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf000bd00 con 0x7fdc041605b0 2023-11-04T01:36:46.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc037fe640 1 --2- 172.21.15.44:0/360560469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbf0004d00 0x7fdbf0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc02ffd640 1 --2- 172.21.15.44:0/360560469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc041605b0 0x7fdbf00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc027fc640 1 --2- 172.21.15.44:0/360560469 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdbf0003ee0 0x7fdbf00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc037fe640 1 -- 172.21.15.44:0/360560469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc041605b0 msgr2=0x7fdbf00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:46.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc037fe640 1 --2- 172.21.15.44:0/360560469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc041605b0 0x7fdbf00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc037fe640 1 -- 172.21.15.44:0/360560469 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdbf0003ee0 msgr2=0x7fdbf00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:46.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc037fe640 1 --2- 172.21.15.44:0/360560469 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdbf0003ee0 0x7fdbf00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.555+0000 7fdc037fe640 1 -- 172.21.15.44:0/360560469 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf0003520 con 0x7fdbf0004d00 2023-11-04T01:36:46.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.556+0000 7fdc037fe640 1 --2- 172.21.15.44:0/360560469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbf0004d00 0x7fdbf0005180 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdc040726e0 tx=0x7fdbf00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba14aa085d325ab server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.556+0000 7fdc01ffb640 1 -- 172.21.15.44:0/360560469 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf402d6b0 con 0x7fdbf0004d00 2023-11-04T01:36:46.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.556+0000 7fdc01ffb640 1 -- 172.21.15.44:0/360560469 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf402d830 con 0x7fdbf0004d00 2023-11-04T01:36:46.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.556+0000 7fdc01ffb640 1 -- 172.21.15.44:0/360560469 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf402dbe0 con 0x7fdbf0004d00 2023-11-04T01:36:46.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.557+0000 7fdc097f5640 1 -- 172.21.15.44:0/360560469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbf0004d00 msgr2=0x7fdbf0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.557+0000 7fdc097f5640 1 --2- 172.21.15.44:0/360560469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbf0004d00 0x7fdbf0005180 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdc040726e0 tx=0x7fdbf00057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.557+0000 7fdc037fe640 1 -- 172.21.15.44:0/360560469 reap_dead start 2023-11-04T01:36:46.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.557+0000 7fdc097f5640 1 -- 172.21.15.44:0/360560469 shutdown_connections 2023-11-04T01:36:46.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.557+0000 7fdc097f5640 1 -- 172.21.15.44:0/360560469 >> 172.21.15.44:0/360560469 conn(0x7fdc04071820 msgr2=0x7fdc04071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:46.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.557+0000 7fdc097f5640 1 -- 172.21.15.44:0/360560469 shutdown_connections 2023-11-04T01:36:46.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.557+0000 7fdc097f5640 1 -- 172.21.15.44:0/360560469 wait complete. 2023-11-04T01:36:46.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.558+0000 7fdc097f5640 1 Processor -- start 2023-11-04T01:36:46.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.558+0000 7fdc097f5640 1 -- start start 2023-11-04T01:36:46.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc097f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbf0004d00 0x7fdc040b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc097f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc041f3150 0x7fdc040c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc097f5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc04147080 0x7fdc040c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc097f5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0415bb30 con 0x7fdbf0004d00 2023-11-04T01:36:46.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc097f5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0415aeb0 con 0x7fdc04147080 2023-11-04T01:36:46.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc097f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0415b190 con 0x7fdc041f3150 2023-11-04T01:36:46.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc02ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbf0004d00 0x7fdc040b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc02ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbf0004d00 0x7fdc040b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58790/0 (socket says 172.21.15.44:58790) 2023-11-04T01:36:46.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc02ffd640 1 -- 172.21.15.44:0/3278494786 learned_addr learned my addr 172.21.15.44:0/3278494786 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:46.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc037fe640 1 --2- 172.21.15.44:0/3278494786 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc04147080 0x7fdc040c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc027fc640 1 --2- 172.21.15.44:0/3278494786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc041f3150 0x7fdc040c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc02ffd640 1 -- 172.21.15.44:0/3278494786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc041f3150 msgr2=0x7fdc040c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc02ffd640 1 --2- 172.21.15.44:0/3278494786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc041f3150 0x7fdc040c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc02ffd640 1 -- 172.21.15.44:0/3278494786 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc04147080 msgr2=0x7fdc040c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc02ffd640 1 --2- 172.21.15.44:0/3278494786 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc04147080 0x7fdc040c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc02ffd640 1 -- 172.21.15.44:0/3278494786 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0415b470 con 0x7fdbf0004d00 2023-11-04T01:36:46.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc027fc640 1 --2- 172.21.15.44:0/3278494786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc041f3150 0x7fdc040c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:46.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.559+0000 7fdc02ffd640 1 --2- 172.21.15.44:0/3278494786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbf0004d00 0x7fdc040b48a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0119a0 tx=0x7fdbfc011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.560+0000 7fdbfb7fe640 1 -- 172.21.15.44:0/3278494786 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc00faf0 con 0x7fdbf0004d00 2023-11-04T01:36:46.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.560+0000 7fdbfb7fe640 1 -- 172.21.15.44:0/3278494786 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc00fc50 con 0x7fdbf0004d00 2023-11-04T01:36:46.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.560+0000 7fdc097f5640 1 -- 172.21.15.44:0/3278494786 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0415b750 con 0x7fdbf0004d00 2023-11-04T01:36:46.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.560+0000 7fdbfb7fe640 1 -- 172.21.15.44:0/3278494786 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc014440 con 0x7fdbf0004d00 2023-11-04T01:36:46.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.560+0000 7fdc097f5640 1 -- 172.21.15.44:0/3278494786 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc041f35f0 con 0x7fdbf0004d00 2023-11-04T01:36:46.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.561+0000 7fdc097f5640 1 -- 172.21.15.44:0/3278494786 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc040672a0 con 0x7fdbf0004d00 2023-11-04T01:36:46.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.561+0000 7fdbfb7fe640 1 -- 172.21.15.44:0/3278494786 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdbfc0145a0 con 0x7fdbf0004d00 2023-11-04T01:36:46.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.561+0000 7fdbfb7fe640 1 --2- 172.21.15.44:0/3278494786 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdbe406aea0 0x7fdbe406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.562+0000 7fdbfb7fe640 1 -- 172.21.15.44:0/3278494786 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdbfc08a140 con 0x7fdbf0004d00 2023-11-04T01:36:46.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.562+0000 7fdc027fc640 1 --2- 172.21.15.44:0/3278494786 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdbe406aea0 0x7fdbe406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.562+0000 7fdc027fc640 1 --2- 172.21.15.44:0/3278494786 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdbe406aea0 0x7fdbe406d360 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdc040c5620 tx=0x7fdbec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.566+0000 7fdbfb7fe640 1 -- 172.21.15.44:0/3278494786 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdbfc054e30 con 0x7fdbf0004d00 2023-11-04T01:36:46.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.746+0000 7fdc097f5640 1 -- 172.21.15.44:0/3278494786 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdc04074290 con 0x7fdbf0004d00 2023-11-04T01:36:46.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.746+0000 7fdbfb7fe640 1 -- 172.21.15.44:0/3278494786 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdbfc058450 con 0x7fdbf0004d00 2023-11-04T01:36:46.748 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:46.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.748+0000 7fdc097f5640 1 -- 172.21.15.44:0/3278494786 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdbe406aea0 msgr2=0x7fdbe406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.748+0000 7fdc097f5640 1 --2- 172.21.15.44:0/3278494786 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdbe406aea0 0x7fdbe406d360 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdc040c5620 tx=0x7fdbec009040 comp rx=0 tx=0).stop 2023-11-04T01:36:46.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.748+0000 7fdc097f5640 1 -- 172.21.15.44:0/3278494786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbf0004d00 msgr2=0x7fdc040b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.748+0000 7fdc097f5640 1 --2- 172.21.15.44:0/3278494786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbf0004d00 0x7fdc040b48a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0119a0 tx=0x7fdbfc011e60 comp rx=0 tx=0).stop 2023-11-04T01:36:46.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.748+0000 7fdc097f5640 1 -- 172.21.15.44:0/3278494786 shutdown_connections 2023-11-04T01:36:46.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.748+0000 7fdc097f5640 1 --2- 172.21.15.44:0/3278494786 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdbe406aea0 0x7fdbe406d360 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.748+0000 7fdc097f5640 1 --2- 172.21.15.44:0/3278494786 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc04147080 0x7fdc040c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.748+0000 7fdc097f5640 1 --2- 172.21.15.44:0/3278494786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc041f3150 0x7fdc040c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.748+0000 7fdc097f5640 1 --2- 172.21.15.44:0/3278494786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbf0004d00 0x7fdc040b48a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.748+0000 7fdc097f5640 1 -- 172.21.15.44:0/3278494786 >> 172.21.15.44:0/3278494786 conn(0x7fdc04071820 msgr2=0x7fdc040b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:46.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.748+0000 7fdc097f5640 1 -- 172.21.15.44:0/3278494786 shutdown_connections 2023-11-04T01:36:46.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.748+0000 7fdc097f5640 1 -- 172.21.15.44:0/3278494786 wait complete. 2023-11-04T01:36:46.780 INFO:tasks.cephfs_test_runner:Starting test: test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that attempt to attach pool with snapshots to an fs fails 2023-11-04T01:36:46.780 INFO:tasks.cephfs_test_runner:test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:36:46.781 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:46.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.885+0000 7ffb47856640 1 Processor -- start 2023-11-04T01:36:46.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.885+0000 7ffb47856640 1 -- start start 2023-11-04T01:36:46.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.886+0000 7ffb47856640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb4015ae40 0x7ffb4015bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.886+0000 7ffb47856640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffb400cbc00 0x7ffb400cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.886+0000 7ffb47856640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb400cc450 con 0x7ffb400cd860 2023-11-04T01:36:46.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.886+0000 7ffb47856640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4015f400 con 0x7ffb400cbc00 2023-11-04T01:36:46.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.886+0000 7ffb47856640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4015b220 con 0x7ffb4015ae40 2023-11-04T01:36:46.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.886+0000 7ffb44df1640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffb400cbc00 0x7ffb400cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.886+0000 7ffb44df1640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffb400cbc00 0x7ffb400cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58798/0 (socket says 172.21.15.44:58798) 2023-11-04T01:36:46.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.886+0000 7ffb44df1640 1 -- 172.21.15.44:0/1117062053 learned_addr learned my addr 172.21.15.44:0/1117062053 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:46.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.886+0000 7ffb455f2640 1 --2- 172.21.15.44:0/1117062053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb4015ae40 0x7ffb4015bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.886+0000 7ffb44df1640 1 -- 172.21.15.44:0/1117062053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb4015ae40 msgr2=0x7ffb4015bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:46.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.886+0000 7ffb44df1640 1 --2- 172.21.15.44:0/1117062053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb4015ae40 0x7ffb4015bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.886+0000 7ffb44df1640 1 -- 172.21.15.44:0/1117062053 >> v1:172.21.15.204:6789/0 conn(0x7ffb400cd860 legacy=0x7ffb400b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.886+0000 7ffb44df1640 1 -- 172.21.15.44:0/1117062053 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4015f890 con 0x7ffb400cbc00 2023-11-04T01:36:46.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.887+0000 7ffb44df1640 1 --2- 172.21.15.44:0/1117062053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb400cbc00 0x7ffb400cd320 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009870 tx=0x7ffb3002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b1afbb944d89c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.887+0000 7ffb37fff640 1 -- 172.21.15.44:0/1117062053 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30030840 con 0x7ffb400cbc00 2023-11-04T01:36:46.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.887+0000 7ffb37fff640 1 -- 172.21.15.44:0/1117062053 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb300309a0 con 0x7ffb400cbc00 2023-11-04T01:36:46.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.887+0000 7ffb37fff640 1 -- 172.21.15.44:0/1117062053 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30030d30 con 0x7ffb400cbc00 2023-11-04T01:36:46.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.888+0000 7ffb47856640 1 -- 172.21.15.44:0/1117062053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb400cbc00 msgr2=0x7ffb400cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.888+0000 7ffb47856640 1 --2- 172.21.15.44:0/1117062053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb400cbc00 0x7ffb400cd320 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009870 tx=0x7ffb3002b980 comp rx=0 tx=0).stop 2023-11-04T01:36:46.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.888+0000 7ffb47856640 1 -- 172.21.15.44:0/1117062053 shutdown_connections 2023-11-04T01:36:46.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.888+0000 7ffb47856640 1 --2- 172.21.15.44:0/1117062053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb400cbc00 0x7ffb400cd320 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.888+0000 7ffb47856640 1 --2- 172.21.15.44:0/1117062053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb4015ae40 0x7ffb4015bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.888+0000 7ffb47856640 1 -- 172.21.15.44:0/1117062053 >> 172.21.15.44:0/1117062053 conn(0x7ffb4006ea90 msgr2=0x7ffb4006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:46.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.888+0000 7ffb47856640 1 -- 172.21.15.44:0/1117062053 shutdown_connections 2023-11-04T01:36:46.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.888+0000 7ffb47856640 1 -- 172.21.15.44:0/1117062053 wait complete. 2023-11-04T01:36:46.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.889+0000 7ffb47856640 1 Processor -- start 2023-11-04T01:36:46.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.889+0000 7ffb47856640 1 -- start start 2023-11-04T01:36:46.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.890+0000 7ffb47856640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffb400cbc00 0x7ffb4014f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.890+0000 7ffb47856640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb400cd860 0x7ffb400c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.890+0000 7ffb47856640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb4015ae40 0x7ffb40150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.890+0000 7ffb47856640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb400c91f0 con 0x7ffb400cd860 2023-11-04T01:36:46.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.890+0000 7ffb47856640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb400c8570 con 0x7ffb400cbc00 2023-11-04T01:36:46.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.890+0000 7ffb47856640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb400c8850 con 0x7ffb4015ae40 2023-11-04T01:36:46.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.890+0000 7ffb44df1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb400cd860 0x7ffb400c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.890+0000 7ffb44df1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb400cd860 0x7ffb400c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58808/0 (socket says 172.21.15.44:58808) 2023-11-04T01:36:46.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.890+0000 7ffb44df1640 1 -- 172.21.15.44:0/289546201 learned_addr learned my addr 172.21.15.44:0/289546201 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:46.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.890+0000 7ffb44df1640 1 -- 172.21.15.44:0/289546201 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb4015ae40 msgr2=0x7ffb40150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.890+0000 7ffb44df1640 1 --2- 172.21.15.44:0/289546201 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb4015ae40 0x7ffb40150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.890+0000 7ffb44df1640 1 -- 172.21.15.44:0/289546201 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffb400cbc00 msgr2=0x7ffb4014f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.890+0000 7ffb44df1640 1 --2- 172.21.15.44:0/289546201 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffb400cbc00 0x7ffb4014f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.890+0000 7ffb44df1640 1 -- 172.21.15.44:0/289546201 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb300094d0 con 0x7ffb400cd860 2023-11-04T01:36:46.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.891+0000 7ffb44df1640 1 --2- 172.21.15.44:0/289546201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb400cd860 0x7ffb400c7c70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffb30000c00 tx=0x7ffb30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.891+0000 7ffb35ffb640 1 -- 172.21.15.44:0/289546201 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30039c90 con 0x7ffb400cd860 2023-11-04T01:36:46.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.891+0000 7ffb35ffb640 1 -- 172.21.15.44:0/289546201 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb30039df0 con 0x7ffb400cd860 2023-11-04T01:36:46.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.891+0000 7ffb47856640 1 -- 172.21.15.44:0/289546201 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb400c8b30 con 0x7ffb400cd860 2023-11-04T01:36:46.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.891+0000 7ffb35ffb640 1 -- 172.21.15.44:0/289546201 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30043640 con 0x7ffb400cd860 2023-11-04T01:36:46.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.891+0000 7ffb47856640 1 -- 172.21.15.44:0/289546201 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4014f780 con 0x7ffb400cd860 2023-11-04T01:36:46.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.892+0000 7ffb47856640 1 -- 172.21.15.44:0/289546201 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb400ce2d0 con 0x7ffb400cd860 2023-11-04T01:36:46.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.892+0000 7ffb35ffb640 1 -- 172.21.15.44:0/289546201 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb300437a0 con 0x7ffb400cd860 2023-11-04T01:36:46.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.893+0000 7ffb35ffb640 1 --2- 172.21.15.44:0/289546201 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffb2406ae70 0x7ffb2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.893+0000 7ffb35ffb640 1 -- 172.21.15.44:0/289546201 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffb3003e070 con 0x7ffb400cd860 2023-11-04T01:36:46.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.893+0000 7ffb455f2640 1 --2- 172.21.15.44:0/289546201 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffb2406ae70 0x7ffb2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.894+0000 7ffb455f2640 1 --2- 172.21.15.44:0/289546201 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffb2406ae70 0x7ffb2406d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c0070b0 tx=0x7ffb3c007040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:46.897+0000 7ffb35ffb640 1 -- 172.21.15.44:0/289546201 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb300777d0 con 0x7ffb400cd860 2023-11-04T01:36:47.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.073+0000 7ffb47856640 1 -- 172.21.15.44:0/289546201 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb400c9330 con 0x7ffb400cd860 2023-11-04T01:36:47.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.074+0000 7ffb35ffb640 1 -- 172.21.15.44:0/289546201 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7ffb400c9330 con 0x7ffb400cd860 2023-11-04T01:36:47.077 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:47.077 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:47.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.076+0000 7ffb47856640 1 -- 172.21.15.44:0/289546201 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffb2406ae70 msgr2=0x7ffb2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.076+0000 7ffb47856640 1 --2- 172.21.15.44:0/289546201 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffb2406ae70 0x7ffb2406d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c0070b0 tx=0x7ffb3c007040 comp rx=0 tx=0).stop 2023-11-04T01:36:47.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.076+0000 7ffb47856640 1 -- 172.21.15.44:0/289546201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb400cd860 msgr2=0x7ffb400c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.076+0000 7ffb47856640 1 --2- 172.21.15.44:0/289546201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb400cd860 0x7ffb400c7c70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffb30000c00 tx=0x7ffb30004730 comp rx=0 tx=0).stop 2023-11-04T01:36:47.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.076+0000 7ffb47856640 1 -- 172.21.15.44:0/289546201 shutdown_connections 2023-11-04T01:36:47.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.076+0000 7ffb47856640 1 --2- 172.21.15.44:0/289546201 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffb2406ae70 0x7ffb2406d330 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.076+0000 7ffb47856640 1 --2- 172.21.15.44:0/289546201 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb4015ae40 0x7ffb40150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.076+0000 7ffb47856640 1 --2- 172.21.15.44:0/289546201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb400cd860 0x7ffb400c7c70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.076+0000 7ffb47856640 1 --2- 172.21.15.44:0/289546201 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffb400cbc00 0x7ffb4014f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.076+0000 7ffb47856640 1 -- 172.21.15.44:0/289546201 >> 172.21.15.44:0/289546201 conn(0x7ffb4006ea90 msgr2=0x7ffb400b6340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:47.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.076+0000 7ffb47856640 1 -- 172.21.15.44:0/289546201 shutdown_connections 2023-11-04T01:36:47.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.076+0000 7ffb47856640 1 -- 172.21.15.44:0/289546201 wait complete. 2023-11-04T01:36:47.089 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:47.090 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:47.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.199+0000 7f477bfff640 1 Processor -- start 2023-11-04T01:36:47.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.199+0000 7f477bfff640 1 -- start start 2023-11-04T01:36:47.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.200+0000 7f477bfff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f477c161540 0x7f477c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.200+0000 7f477bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f477c0cfa20 0x7f477c0d14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.200+0000 7f477bfff640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c0cfe90 con 0x7f477c15ce60 2023-11-04T01:36:47.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.200+0000 7f477bfff640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c0ce4c0 con 0x7f477c0cfa20 2023-11-04T01:36:47.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.200+0000 7f477bfff640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c15d240 con 0x7f477c161540 2023-11-04T01:36:47.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.200+0000 7f477affd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f477c15ce60 0x7f477c0b1d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42050/0 (socket says 172.21.15.44:42050) 2023-11-04T01:36:47.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.200+0000 7f477affd640 1 -- 172.21.15.44:0/3271761081 learned_addr learned my addr 172.21.15.44:0/3271761081 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:47.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.200+0000 7f477b7fe640 1 --2- 172.21.15.44:0/3271761081 >> v2:172.21.15.44:3300/0 conn(0x7f477c0cfa20 0x7f477c0d14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.200+0000 7f4779ffb640 1 -- 172.21.15.44:0/3271761081 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569038195 0 0) 0x7f4774001110 con 0x7f477c15ce60 2023-11-04T01:36:47.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.200+0000 7f477a7fc640 1 --2- 172.21.15.44:0/3271761081 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f477c161540 0x7f477c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.201+0000 7f4779ffb640 1 -- 172.21.15.44:0/3271761081 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4768003520 con 0x7f477c15ce60 2023-11-04T01:36:47.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.201+0000 7f477b7fe640 1 -- 172.21.15.44:0/3271761081 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f477c161540 msgr2=0x7f477c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:47.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.201+0000 7f477b7fe640 1 --2- 172.21.15.44:0/3271761081 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f477c161540 0x7f477c0cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.201+0000 7f477b7fe640 1 -- 172.21.15.44:0/3271761081 >> v1:172.21.15.44:6789/0 conn(0x7f477c15ce60 legacy=0x7f477c0b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.201+0000 7f477b7fe640 1 -- 172.21.15.44:0/3271761081 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c0cdc20 con 0x7f477c0cfa20 2023-11-04T01:36:47.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.201+0000 7f477a7fc640 1 --2- 172.21.15.44:0/3271761081 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f477c161540 0x7f477c0cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:47.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.201+0000 7f477b7fe640 1 --2- 172.21.15.44:0/3271761081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f477c0cfa20 0x7f477c0d14c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f476c009d90 tx=0x7f476c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188599d8f458de88 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.201+0000 7f4779ffb640 1 -- 172.21.15.44:0/3271761081 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c02cc50 con 0x7f477c0cfa20 2023-11-04T01:36:47.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.201+0000 7f4779ffb640 1 -- 172.21.15.44:0/3271761081 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c02cdb0 con 0x7f477c0cfa20 2023-11-04T01:36:47.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.201+0000 7f4779ffb640 1 -- 172.21.15.44:0/3271761081 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c034660 con 0x7f477c0cfa20 2023-11-04T01:36:47.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.202+0000 7f477bfff640 1 -- 172.21.15.44:0/3271761081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f477c0cfa20 msgr2=0x7f477c0d14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.202+0000 7f477bfff640 1 --2- 172.21.15.44:0/3271761081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f477c0cfa20 0x7f477c0d14c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f476c009d90 tx=0x7f476c02bea0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.202+0000 7f477bfff640 1 -- 172.21.15.44:0/3271761081 shutdown_connections 2023-11-04T01:36:47.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.202+0000 7f477bfff640 1 --2- 172.21.15.44:0/3271761081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f477c0cfa20 0x7f477c0d14c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.202+0000 7f477bfff640 1 --2- 172.21.15.44:0/3271761081 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f477c161540 0x7f477c0cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.202+0000 7f477bfff640 1 -- 172.21.15.44:0/3271761081 >> 172.21.15.44:0/3271761081 conn(0x7f477c06b4c0 msgr2=0x7f477c06b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:47.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.202+0000 7f477bfff640 1 -- 172.21.15.44:0/3271761081 shutdown_connections 2023-11-04T01:36:47.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.202+0000 7f477bfff640 1 -- 172.21.15.44:0/3271761081 wait complete. 2023-11-04T01:36:47.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.204+0000 7f477bfff640 1 Processor -- start 2023-11-04T01:36:47.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.204+0000 7f477bfff640 1 -- start start 2023-11-04T01:36:47.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.204+0000 7f477bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f477c0cfa20 0x7f477c148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.204+0000 7f477bfff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f477c15ce60 0x7f477c0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.204+0000 7f477bfff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f477c161540 0x7f477c0cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.204+0000 7f477bfff640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0b3c50 con 0x7f477c0cfa20 2023-11-04T01:36:47.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.204+0000 7f477bfff640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0b3040 con 0x7f477c15ce60 2023-11-04T01:36:47.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.204+0000 7f477bfff640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0b3320 con 0x7f477c161540 2023-11-04T01:36:47.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.204+0000 7f477affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f477c0cfa20 0x7f477c148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.204+0000 7f477affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f477c0cfa20 0x7f477c148090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58822/0 (socket says 172.21.15.44:58822) 2023-11-04T01:36:47.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.204+0000 7f477affd640 1 -- 172.21.15.44:0/2669246070 learned_addr learned my addr 172.21.15.44:0/2669246070 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:47.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.205+0000 7f477b7fe640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f477c161540 0x7f477c0cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.205+0000 7f477affd640 1 -- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f477c161540 msgr2=0x7f477c0cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.205+0000 7f477a7fc640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f477c15ce60 0x7f477c0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.205+0000 7f477affd640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f477c161540 0x7f477c0cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.205+0000 7f477affd640 1 -- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f477c15ce60 msgr2=0x7f477c0b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.205+0000 7f477affd640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f477c15ce60 0x7f477c0b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.205+0000 7f477affd640 1 -- 172.21.15.44:0/2669246070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c009a70 con 0x7f477c0cfa20 2023-11-04T01:36:47.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.205+0000 7f477b7fe640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f477c161540 0x7f477c0cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:47.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.205+0000 7f477a7fc640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f477c15ce60 0x7f477c0b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:47.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.205+0000 7f477affd640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f477c0cfa20 0x7f477c148090 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f477400c700 tx=0x7f477400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.205+0000 7f47737fe640 1 -- 172.21.15.44:0/2669246070 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774005ce0 con 0x7f477c0cfa20 2023-11-04T01:36:47.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.205+0000 7f47737fe640 1 -- 172.21.15.44:0/2669246070 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4774005e40 con 0x7f477c0cfa20 2023-11-04T01:36:47.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.205+0000 7f477bfff640 1 -- 172.21.15.44:0/2669246070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477c0b3600 con 0x7f477c0cfa20 2023-11-04T01:36:47.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.205+0000 7f47737fe640 1 -- 172.21.15.44:0/2669246070 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774007290 con 0x7f477c0cfa20 2023-11-04T01:36:47.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.205+0000 7f477bfff640 1 -- 172.21.15.44:0/2669246070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c0cb360 con 0x7f477c0cfa20 2023-11-04T01:36:47.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.206+0000 7f477bfff640 1 -- 172.21.15.44:0/2669246070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c04ece0 con 0x7f477c0cfa20 2023-11-04T01:36:47.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.207+0000 7f47737fe640 1 -- 172.21.15.44:0/2669246070 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47740074b0 con 0x7f477c0cfa20 2023-11-04T01:36:47.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.207+0000 7f47737fe640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f475c06ae70 0x7f475c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.207+0000 7f47737fe640 1 -- 172.21.15.44:0/2669246070 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4774088e20 con 0x7f477c0cfa20 2023-11-04T01:36:47.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.207+0000 7f477a7fc640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f475c06ae70 0x7f475c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.208+0000 7f477a7fc640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f475c06ae70 0x7f475c06d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4764006fd0 tx=0x7f4764008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.212+0000 7f47737fe640 1 -- 172.21.15.44:0/2669246070 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47740575a0 con 0x7f477c0cfa20 2023-11-04T01:36:47.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.388+0000 7f477bfff640 1 -- 172.21.15.44:0/2669246070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f477c0cfe90 con 0x7f477c0cfa20 2023-11-04T01:36:47.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.388+0000 7f47737fe640 1 -- 172.21.15.44:0/2669246070 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f477c0cfe90 con 0x7f477c0cfa20 2023-11-04T01:36:47.391 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:36:47.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.390+0000 7f477bfff640 1 -- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f475c06ae70 msgr2=0x7f475c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.390+0000 7f477bfff640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f475c06ae70 0x7f475c06d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4764006fd0 tx=0x7f4764008040 comp rx=0 tx=0).stop 2023-11-04T01:36:47.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.391+0000 7f477bfff640 1 -- 172.21.15.44:0/2669246070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f477c0cfa20 msgr2=0x7f477c148090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.391+0000 7f477bfff640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f477c0cfa20 0x7f477c148090 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f477400c700 tx=0x7f477400cb00 comp rx=0 tx=0).stop 2023-11-04T01:36:47.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.391+0000 7f477bfff640 1 -- 172.21.15.44:0/2669246070 shutdown_connections 2023-11-04T01:36:47.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.391+0000 7f477bfff640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f475c06ae70 0x7f475c06d330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.391+0000 7f477bfff640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f477c161540 0x7f477c0cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.391+0000 7f477bfff640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f477c15ce60 0x7f477c0b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.391+0000 7f477bfff640 1 --2- 172.21.15.44:0/2669246070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f477c0cfa20 0x7f477c148090 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.391+0000 7f477bfff640 1 -- 172.21.15.44:0/2669246070 >> 172.21.15.44:0/2669246070 conn(0x7f477c06b4c0 msgr2=0x7f477c0b75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:47.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.391+0000 7f477bfff640 1 -- 172.21.15.44:0/2669246070 shutdown_connections 2023-11-04T01:36:47.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.391+0000 7f477bfff640 1 -- 172.21.15.44:0/2669246070 wait complete. 2023-11-04T01:36:47.405 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:47.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.514+0000 7ff3161ce640 1 Processor -- start 2023-11-04T01:36:47.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.514+0000 7ff3161ce640 1 -- start start 2023-11-04T01:36:47.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.515+0000 7ff3161ce640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff310160430 0x7ff3100b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.515+0000 7ff3161ce640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff31006c3a0 0x7ff3100cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.515+0000 7ff3161ce640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3100b2fc0 con 0x7ff3100b2b60 2023-11-04T01:36:47.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.515+0000 7ff3161ce640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3100cb580 con 0x7ff310160430 2023-11-04T01:36:47.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.515+0000 7ff3161ce640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31006c7d0 con 0x7ff31006c3a0 2023-11-04T01:36:47.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.515+0000 7ff30f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff310160430 0x7ff3100b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.515+0000 7ff30f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff310160430 0x7ff3100b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58830/0 (socket says 172.21.15.44:58830) 2023-11-04T01:36:47.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.515+0000 7ff30f7fe640 1 -- 172.21.15.44:0/2093134077 learned_addr learned my addr 172.21.15.44:0/2093134077 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:47.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.515+0000 7ff30ffff640 1 --2- 172.21.15.44:0/2093134077 >> v2:172.21.15.204:3300/0 conn(0x7ff31006c3a0 0x7ff3100cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.515+0000 7ff30f7fe640 1 -- 172.21.15.44:0/2093134077 >> v2:172.21.15.204:3300/0 conn(0x7ff31006c3a0 msgr2=0x7ff3100cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:47.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.515+0000 7ff30f7fe640 1 --2- 172.21.15.44:0/2093134077 >> v2:172.21.15.204:3300/0 conn(0x7ff31006c3a0 0x7ff3100cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.515+0000 7ff30f7fe640 1 -- 172.21.15.44:0/2093134077 >> v1:172.21.15.204:6789/0 conn(0x7ff3100b2b60 legacy=0x7ff31006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:47.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.515+0000 7ff30f7fe640 1 -- 172.21.15.44:0/2093134077 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31006ca40 con 0x7ff310160430 2023-11-04T01:36:47.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.516+0000 7ff30f7fe640 1 --2- 172.21.15.44:0/2093134077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff310160430 0x7ff3100b2620 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff3100c4600 tx=0x7ff30002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f857b8b7ace55e10 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.516+0000 7ff30e7fc640 1 -- 172.21.15.44:0/2093134077 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300031870 con 0x7ff310160430 2023-11-04T01:36:47.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.516+0000 7ff30e7fc640 1 -- 172.21.15.44:0/2093134077 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3000319d0 con 0x7ff310160430 2023-11-04T01:36:47.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.516+0000 7ff30e7fc640 1 -- 172.21.15.44:0/2093134077 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300031d60 con 0x7ff310160430 2023-11-04T01:36:47.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.517+0000 7ff3161ce640 1 -- 172.21.15.44:0/2093134077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff310160430 msgr2=0x7ff3100b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.517+0000 7ff3161ce640 1 --2- 172.21.15.44:0/2093134077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff310160430 0x7ff3100b2620 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff3100c4600 tx=0x7ff30002b910 comp rx=0 tx=0).stop 2023-11-04T01:36:47.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.517+0000 7ff3161ce640 1 -- 172.21.15.44:0/2093134077 shutdown_connections 2023-11-04T01:36:47.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.517+0000 7ff3161ce640 1 --2- 172.21.15.44:0/2093134077 >> v2:172.21.15.204:3300/0 conn(0x7ff31006c3a0 0x7ff3100cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.517+0000 7ff3161ce640 1 --2- 172.21.15.44:0/2093134077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff310160430 0x7ff3100b2620 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.517+0000 7ff3161ce640 1 -- 172.21.15.44:0/2093134077 >> 172.21.15.44:0/2093134077 conn(0x7ff31006ea20 msgr2=0x7ff31006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:47.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.517+0000 7ff3161ce640 1 -- 172.21.15.44:0/2093134077 shutdown_connections 2023-11-04T01:36:47.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.517+0000 7ff3161ce640 1 -- 172.21.15.44:0/2093134077 wait complete. 2023-11-04T01:36:47.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.518+0000 7ff3161ce640 1 Processor -- start 2023-11-04T01:36:47.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.518+0000 7ff3161ce640 1 -- start start 2023-11-04T01:36:47.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff3161ce640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff31006c3a0 0x7ff3100b6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff3161ce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3100b2b60 0x7ff3101513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff3161ce640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff310160430 0x7ff3100c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff3161ce640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff310151930 con 0x7ff3100b2b60 2023-11-04T01:36:47.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff3161ce640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3100b5990 con 0x7ff310160430 2023-11-04T01:36:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff3161ce640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3100c5080 con 0x7ff31006c3a0 2023-11-04T01:36:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff30effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3100b2b60 0x7ff3101513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff30effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3100b2b60 0x7ff3101513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58844/0 (socket says 172.21.15.44:58844) 2023-11-04T01:36:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff30effd640 1 -- 172.21.15.44:0/151427626 learned_addr learned my addr 172.21.15.44:0/151427626 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff30ffff640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff310160430 0x7ff3100c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff30f7fe640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff31006c3a0 0x7ff3100b6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff30effd640 1 -- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff31006c3a0 msgr2=0x7ff3100b6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff30effd640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff31006c3a0 0x7ff3100b6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff30effd640 1 -- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff310160430 msgr2=0x7ff3100c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff30effd640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff310160430 0x7ff3100c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff30effd640 1 -- 172.21.15.44:0/151427626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3000094d0 con 0x7ff3100b2b60 2023-11-04T01:36:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff30f7fe640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff31006c3a0 0x7ff3100b6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff30ffff640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff310160430 0x7ff3100c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.519+0000 7ff30effd640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3100b2b60 0x7ff3101513f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff30400c430 tx=0x7ff30400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.520+0000 7ff2f7fff640 1 -- 172.21.15.44:0/151427626 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304011790 con 0x7ff3100b2b60 2023-11-04T01:36:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.520+0000 7ff2f7fff640 1 -- 172.21.15.44:0/151427626 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3040118f0 con 0x7ff3100b2b60 2023-11-04T01:36:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.520+0000 7ff3161ce640 1 -- 172.21.15.44:0/151427626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3100c5360 con 0x7ff3100b2b60 2023-11-04T01:36:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.520+0000 7ff2f7fff640 1 -- 172.21.15.44:0/151427626 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304011ce0 con 0x7ff3100b2b60 2023-11-04T01:36:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.520+0000 7ff3161ce640 1 -- 172.21.15.44:0/151427626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3100c5920 con 0x7ff3100b2b60 2023-11-04T01:36:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.521+0000 7ff3161ce640 1 -- 172.21.15.44:0/151427626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff310074290 con 0x7ff3100b2b60 2023-11-04T01:36:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.521+0000 7ff2f7fff640 1 -- 172.21.15.44:0/151427626 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff30401c460 con 0x7ff3100b2b60 2023-11-04T01:36:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.521+0000 7ff2f7fff640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff2fc06ae70 0x7ff2fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.522+0000 7ff2f7fff640 1 -- 172.21.15.44:0/151427626 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff304089990 con 0x7ff3100b2b60 2023-11-04T01:36:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.522+0000 7ff30f7fe640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff2fc06ae70 0x7ff2fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.522+0000 7ff30f7fe640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff2fc06ae70 0x7ff2fc06d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff300036000 tx=0x7ff30003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.526+0000 7ff2f7fff640 1 -- 172.21.15.44:0/151427626 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff304054680 con 0x7ff3100b2b60 2023-11-04T01:36:47.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.700+0000 7ff3161ce640 1 -- 172.21.15.44:0/151427626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3100c5ae0 con 0x7ff3100b2b60 2023-11-04T01:36:47.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.701+0000 7ff2f7fff640 1 -- 172.21.15.44:0/151427626 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff304057ca0 con 0x7ff3100b2b60 2023-11-04T01:36:47.703 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:47.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.703+0000 7ff3161ce640 1 -- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff2fc06ae70 msgr2=0x7ff2fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.703+0000 7ff3161ce640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff2fc06ae70 0x7ff2fc06d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff300036000 tx=0x7ff30003c040 comp rx=0 tx=0).stop 2023-11-04T01:36:47.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.703+0000 7ff3161ce640 1 -- 172.21.15.44:0/151427626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3100b2b60 msgr2=0x7ff3101513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.703+0000 7ff3161ce640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3100b2b60 0x7ff3101513f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff30400c430 tx=0x7ff30400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.703+0000 7ff3161ce640 1 -- 172.21.15.44:0/151427626 shutdown_connections 2023-11-04T01:36:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.703+0000 7ff3161ce640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff2fc06ae70 0x7ff2fc06d330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.703+0000 7ff3161ce640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff310160430 0x7ff3100c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.703+0000 7ff3161ce640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3100b2b60 0x7ff3101513f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.703+0000 7ff3161ce640 1 --2- 172.21.15.44:0/151427626 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff31006c3a0 0x7ff3100b6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.703+0000 7ff3161ce640 1 -- 172.21.15.44:0/151427626 >> 172.21.15.44:0/151427626 conn(0x7ff31006ea20 msgr2=0x7ff3100b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.703+0000 7ff3161ce640 1 -- 172.21.15.44:0/151427626 shutdown_connections 2023-11-04T01:36:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.703+0000 7ff3161ce640 1 -- 172.21.15.44:0/151427626 wait complete. 2023-11-04T01:36:47.716 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:47.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.823+0000 7efcc074c640 1 Processor -- start 2023-11-04T01:36:47.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.824+0000 7efcc074c640 1 -- start start 2023-11-04T01:36:47.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.824+0000 7efcc074c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efcb8160430 0x7efcb80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.824+0000 7efcc074c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efcb806c3a0 0x7efcb80cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.824+0000 7efcc074c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb80b2fc0 con 0x7efcb80b2b60 2023-11-04T01:36:47.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.824+0000 7efcc074c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb80cb580 con 0x7efcb8160430 2023-11-04T01:36:47.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.824+0000 7efcc074c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb806c7f0 con 0x7efcb806c3a0 2023-11-04T01:36:47.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbdce7640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efcb80b2b60 0x7efcb806bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42058/0 (socket says 172.21.15.44:42058) 2023-11-04T01:36:47.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbdce7640 1 -- 172.21.15.44:0/2699085131 learned_addr learned my addr 172.21.15.44:0/2699085131 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:47.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbece9640 1 --2- 172.21.15.44:0/2699085131 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efcb806c3a0 0x7efcb80cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbe4e8640 1 --2- 172.21.15.44:0/2699085131 >> v2:172.21.15.204:3300/0 conn(0x7efcb8160430 0x7efcb80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 -- 172.21.15.44:0/2699085131 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354621023 0 0) 0x7efcb80b2fc0 con 0x7efcb80b2b60 2023-11-04T01:36:47.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 -- 172.21.15.44:0/2699085131 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efca0003520 con 0x7efcb80b2b60 2023-11-04T01:36:47.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 -- 172.21.15.44:0/2699085131 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2078750104 0 0) 0x7efca0003520 con 0x7efcb80b2b60 2023-11-04T01:36:47.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 -- 172.21.15.44:0/2699085131 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efcb806c3a0 msgr2=0x7efcb80cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:47.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 --2- 172.21.15.44:0/2699085131 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efcb806c3a0 0x7efcb80cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 -- 172.21.15.44:0/2699085131 >> v2:172.21.15.204:3300/0 conn(0x7efcb8160430 msgr2=0x7efcb80b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 --2- 172.21.15.44:0/2699085131 >> v2:172.21.15.204:3300/0 conn(0x7efcb8160430 0x7efcb80b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 -- 172.21.15.44:0/2699085131 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb806ca40 con 0x7efcb80b2b60 2023-11-04T01:36:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 -- 172.21.15.44:0/2699085131 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7efcac001670 con 0x7efcb80b2b60 2023-11-04T01:36:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbe4e8640 1 --2- 172.21.15.44:0/2699085131 >> v2:172.21.15.204:3300/0 conn(0x7efcb8160430 0x7efcb80b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbece9640 1 --2- 172.21.15.44:0/2699085131 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efcb806c3a0 0x7efcb80cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 -- 172.21.15.44:0/2699085131 >> v1:172.21.15.44:6789/0 conn(0x7efcb80b2b60 legacy=0x7efcb806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 --2- 172.21.15.44:0/2699085131 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efca0003970 0x7efca0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 --2- 172.21.15.44:0/2699085131 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efcb806c3a0 0x7efca00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 --2- 172.21.15.44:0/2699085131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efca0004d00 0x7efca0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 -- 172.21.15.44:0/2699085131 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb80cb580 con 0x7efca0004d00 2023-11-04T01:36:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 -- 172.21.15.44:0/2699085131 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb806c7f0 con 0x7efca0003970 2023-11-04T01:36:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbd4e6640 1 -- 172.21.15.44:0/2699085131 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca000b980 con 0x7efcb806c3a0 2023-11-04T01:36:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbece9640 1 --2- 172.21.15.44:0/2699085131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efca0004d00 0x7efca0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.825+0000 7efcbe4e8640 1 --2- 172.21.15.44:0/2699085131 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efca0003970 0x7efca0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.826+0000 7efcbdce7640 1 --2- 172.21.15.44:0/2699085131 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efcb806c3a0 0x7efca00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.826+0000 7efcbece9640 1 -- 172.21.15.44:0/2699085131 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efcb806c3a0 msgr2=0x7efca00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.826+0000 7efcbece9640 1 --2- 172.21.15.44:0/2699085131 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efcb806c3a0 0x7efca00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.826+0000 7efcbece9640 1 -- 172.21.15.44:0/2699085131 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efca0003970 msgr2=0x7efca0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.826+0000 7efcbece9640 1 --2- 172.21.15.44:0/2699085131 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efca0003970 0x7efca0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.826+0000 7efcbece9640 1 -- 172.21.15.44:0/2699085131 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca8009a70 con 0x7efca0004d00 2023-11-04T01:36:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.826+0000 7efcbece9640 1 --2- 172.21.15.44:0/2699085131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efca0004d00 0x7efca0005180 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efca800e350 tx=0x7efca00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf557a22ac544e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.827+0000 7efcbd4e6640 1 -- 172.21.15.44:0/2699085131 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca802cd70 con 0x7efca0004d00 2023-11-04T01:36:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.827+0000 7efcbd4e6640 1 -- 172.21.15.44:0/2699085131 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca800f040 con 0x7efca0004d00 2023-11-04T01:36:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.827+0000 7efcbd4e6640 1 -- 172.21.15.44:0/2699085131 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca8034640 con 0x7efca0004d00 2023-11-04T01:36:47.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.827+0000 7efcc074c640 1 -- 172.21.15.44:0/2699085131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efca0004d00 msgr2=0x7efca0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.827+0000 7efcc074c640 1 --2- 172.21.15.44:0/2699085131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efca0004d00 0x7efca0005180 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efca800e350 tx=0x7efca00057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.827+0000 7efcbece9640 1 -- 172.21.15.44:0/2699085131 reap_dead start 2023-11-04T01:36:47.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.827+0000 7efcc074c640 1 -- 172.21.15.44:0/2699085131 shutdown_connections 2023-11-04T01:36:47.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.827+0000 7efcc074c640 1 -- 172.21.15.44:0/2699085131 >> 172.21.15.44:0/2699085131 conn(0x7efcb806ea20 msgr2=0x7efcb806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:47.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.827+0000 7efcc074c640 1 -- 172.21.15.44:0/2699085131 shutdown_connections 2023-11-04T01:36:47.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.827+0000 7efcc074c640 1 -- 172.21.15.44:0/2699085131 wait complete. 2023-11-04T01:36:47.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.828+0000 7efcc074c640 1 Processor -- start 2023-11-04T01:36:47.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.828+0000 7efcc074c640 1 -- start start 2023-11-04T01:36:47.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.829+0000 7efcc074c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efca0004d00 0x7efcb80c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.829+0000 7efcc074c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efcb81f25a0 0x7efcb80c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.829+0000 7efcc074c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcb80b3e30 0x7efcb80c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.829+0000 7efcc074c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb80b6790 con 0x7efcb80b3e30 2023-11-04T01:36:47.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.829+0000 7efcc074c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb8153390 con 0x7efca0004d00 2023-11-04T01:36:47.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.829+0000 7efcc074c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb8153670 con 0x7efcb81f25a0 2023-11-04T01:36:47.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.829+0000 7efcbece9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcb80b3e30 0x7efcb80c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.829+0000 7efcbece9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcb80b3e30 0x7efcb80c5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58872/0 (socket says 172.21.15.44:58872) 2023-11-04T01:36:47.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.829+0000 7efcbece9640 1 -- 172.21.15.44:0/696625524 learned_addr learned my addr 172.21.15.44:0/696625524 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:47.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.830+0000 7efcbdce7640 1 --2- 172.21.15.44:0/696625524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efcb81f25a0 0x7efcb80c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.830+0000 7efcbece9640 1 -- 172.21.15.44:0/696625524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efcb81f25a0 msgr2=0x7efcb80c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.830+0000 7efcbe4e8640 1 --2- 172.21.15.44:0/696625524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efca0004d00 0x7efcb80c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.830+0000 7efcbece9640 1 --2- 172.21.15.44:0/696625524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efcb81f25a0 0x7efcb80c4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.830+0000 7efcbece9640 1 -- 172.21.15.44:0/696625524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efca0004d00 msgr2=0x7efcb80c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.830+0000 7efcbece9640 1 --2- 172.21.15.44:0/696625524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efca0004d00 0x7efcb80c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.830+0000 7efcbece9640 1 -- 172.21.15.44:0/696625524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb8153950 con 0x7efcb80b3e30 2023-11-04T01:36:47.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.830+0000 7efcbe4e8640 1 --2- 172.21.15.44:0/696625524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efca0004d00 0x7efcb80c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:47.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.830+0000 7efcbece9640 1 --2- 172.21.15.44:0/696625524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcb80b3e30 0x7efcb80c5510 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efca8037040 tx=0x7efca8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.830+0000 7efcb6ffd640 1 -- 172.21.15.44:0/696625524 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca8043070 con 0x7efcb80b3e30 2023-11-04T01:36:47.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.830+0000 7efcb6ffd640 1 -- 172.21.15.44:0/696625524 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca8034bf0 con 0x7efcb80b3e30 2023-11-04T01:36:47.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.830+0000 7efcc074c640 1 -- 172.21.15.44:0/696625524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb8153080 con 0x7efcb80b3e30 2023-11-04T01:36:47.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.830+0000 7efcb6ffd640 1 -- 172.21.15.44:0/696625524 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca8003990 con 0x7efcb80b3e30 2023-11-04T01:36:47.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.830+0000 7efcc074c640 1 -- 172.21.15.44:0/696625524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb80b6220 con 0x7efcb80b3e30 2023-11-04T01:36:47.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.831+0000 7efcc074c640 1 -- 172.21.15.44:0/696625524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb8153b40 con 0x7efcb80b3e30 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.831+0000 7efcb6ffd640 1 -- 172.21.15.44:0/696625524 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efca803e440 con 0x7efcb80b3e30 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.832+0000 7efcb6ffd640 1 --2- 172.21.15.44:0/696625524 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efca406ae70 0x7efca406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.832+0000 7efcb6ffd640 1 -- 172.21.15.44:0/696625524 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efca80ab5e0 con 0x7efcb80b3e30 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.832+0000 7efcbe4e8640 1 --2- 172.21.15.44:0/696625524 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efca406ae70 0x7efca406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.833+0000 7efcbe4e8640 1 --2- 172.21.15.44:0/696625524 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efca406ae70 0x7efca406d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009c40 tx=0x7efcb0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:47.836+0000 7efcb6ffd640 1 -- 172.21.15.44:0/696625524 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efca8076360 con 0x7efcb80b3e30 2023-11-04T01:36:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.010+0000 7efcc074c640 1 -- 172.21.15.44:0/696625524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efcb8074290 con 0x7efcb80b3e30 2023-11-04T01:36:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.010+0000 7efcb6ffd640 1 -- 172.21.15.44:0/696625524 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7efca8009de0 con 0x7efcb80b3e30 2023-11-04T01:36:48.012 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:36:48.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.012+0000 7efcc074c640 1 -- 172.21.15.44:0/696625524 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efca406ae70 msgr2=0x7efca406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.012+0000 7efcc074c640 1 --2- 172.21.15.44:0/696625524 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efca406ae70 0x7efca406d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009c40 tx=0x7efcb0008040 comp rx=0 tx=0).stop 2023-11-04T01:36:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.012+0000 7efcc074c640 1 -- 172.21.15.44:0/696625524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcb80b3e30 msgr2=0x7efcb80c5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.012+0000 7efcc074c640 1 --2- 172.21.15.44:0/696625524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcb80b3e30 0x7efcb80c5510 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efca8037040 tx=0x7efca8009750 comp rx=0 tx=0).stop 2023-11-04T01:36:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.012+0000 7efcc074c640 1 -- 172.21.15.44:0/696625524 shutdown_connections 2023-11-04T01:36:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.012+0000 7efcc074c640 1 --2- 172.21.15.44:0/696625524 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efca406ae70 0x7efca406d330 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.012+0000 7efcc074c640 1 --2- 172.21.15.44:0/696625524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcb80b3e30 0x7efcb80c5510 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.012+0000 7efcc074c640 1 --2- 172.21.15.44:0/696625524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efcb81f25a0 0x7efcb80c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.012+0000 7efcc074c640 1 --2- 172.21.15.44:0/696625524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efca0004d00 0x7efcb80c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.012+0000 7efcc074c640 1 -- 172.21.15.44:0/696625524 >> 172.21.15.44:0/696625524 conn(0x7efcb806ea20 msgr2=0x7efcb80cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.012+0000 7efcc074c640 1 -- 172.21.15.44:0/696625524 shutdown_connections 2023-11-04T01:36:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.012+0000 7efcc074c640 1 -- 172.21.15.44:0/696625524 wait complete. 2023-11-04T01:36:48.025 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:48.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.133+0000 7fd8d1239640 1 Processor -- start 2023-11-04T01:36:48.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.133+0000 7fd8d1239640 1 -- start start 2023-11-04T01:36:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8d1239640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd8cc06a830 0x7fd8cc0ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8d1239640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8cc0ca620 con 0x7fd8cc15e1b0 2023-11-04T01:36:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8d1239640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8cc0ca060 con 0x7fd8cc15e590 2023-11-04T01:36:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8d1239640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8cc06e7e0 con 0x7fd8cc06a830 2023-11-04T01:36:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8cad9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd8cc15e1b0 0x7fd8cc06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42062/0 (socket says 172.21.15.44:42062) 2023-11-04T01:36:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8cad9d640 1 -- 172.21.15.44:0/3208045136 learned_addr learned my addr 172.21.15.44:0/3208045136 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8ca59c640 1 --2- 172.21.15.44:0/3208045136 >> v2:172.21.15.204:3300/0 conn(0x7fd8cc06a830 0x7fd8cc0ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8c9d9b640 1 -- 172.21.15.44:0/3208045136 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721432286 0 0) 0x7fd8cc0ca620 con 0x7fd8cc15e1b0 2023-11-04T01:36:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8c9d9b640 1 -- 172.21.15.44:0/3208045136 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8b4003520 con 0x7fd8cc15e1b0 2023-11-04T01:36:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8c9d9b640 1 -- 172.21.15.44:0/3208045136 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1784713696 0 0) 0x7fd8b4003520 con 0x7fd8cc15e1b0 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8c9d9b640 1 -- 172.21.15.44:0/3208045136 >> v2:172.21.15.204:3300/0 conn(0x7fd8cc06a830 msgr2=0x7fd8cc0ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8c9d9b640 1 --2- 172.21.15.44:0/3208045136 >> v2:172.21.15.204:3300/0 conn(0x7fd8cc06a830 0x7fd8cc0ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8c9d9b640 1 -- 172.21.15.44:0/3208045136 >> v1:172.21.15.204:6789/0 conn(0x7fd8cc15e590 legacy=0x7fd8cc0b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8c9d9b640 1 -- 172.21.15.44:0/3208045136 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc0ca340 con 0x7fd8cc15e1b0 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8c9d9b640 1 -- 172.21.15.44:0/3208045136 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fd8c0001670 con 0x7fd8cc15e1b0 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.134+0000 7fd8c9d9b640 1 -- 172.21.15.44:0/3208045136 >> v1:172.21.15.44:6789/0 conn(0x7fd8cc15e1b0 legacy=0x7fd8cc06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.135+0000 7fd8c9d9b640 1 --2- 172.21.15.44:0/3208045136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8b4003970 0x7fd8b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.135+0000 7fd8c9d9b640 1 --2- 172.21.15.44:0/3208045136 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8b40047c0 0x7fd8b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.135+0000 7fd8c9d9b640 1 --2- 172.21.15.44:0/3208045136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8b4005180 0x7fd8b400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.135+0000 7fd8c9d9b640 1 -- 172.21.15.44:0/3208045136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc06e7e0 con 0x7fd8b4005180 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.135+0000 7fd8c9d9b640 1 -- 172.21.15.44:0/3208045136 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b400c120 con 0x7fd8b40047c0 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.135+0000 7fd8c9d9b640 1 -- 172.21.15.44:0/3208045136 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b400c2e0 con 0x7fd8b4003970 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.135+0000 7fd8ca59c640 1 --2- 172.21.15.44:0/3208045136 >> v2:172.21.15.204:3300/0 conn(0x7fd8cc06a830 0x7fd8cc0ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.135+0000 7fd8cb59e640 1 --2- 172.21.15.44:0/3208045136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8b4005180 0x7fd8b400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.135+0000 7fd8cad9d640 1 --2- 172.21.15.44:0/3208045136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8b4003970 0x7fd8b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.135+0000 7fd8ca59c640 1 --2- 172.21.15.44:0/3208045136 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8b40047c0 0x7fd8b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.135+0000 7fd8cb59e640 1 -- 172.21.15.44:0/3208045136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8b4003970 msgr2=0x7fd8b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.135+0000 7fd8cb59e640 1 --2- 172.21.15.44:0/3208045136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8b4003970 0x7fd8b4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.135+0000 7fd8cb59e640 1 -- 172.21.15.44:0/3208045136 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8b40047c0 msgr2=0x7fd8b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.135+0000 7fd8cb59e640 1 --2- 172.21.15.44:0/3208045136 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8b40047c0 0x7fd8b4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.135+0000 7fd8cb59e640 1 -- 172.21.15.44:0/3208045136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b4003520 con 0x7fd8b4005180 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.136+0000 7fd8cb59e640 1 -- 172.21.15.44:0/3208045136 reap_dead start 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.136+0000 7fd8cb59e640 1 --2- 172.21.15.44:0/3208045136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8b4005180 0x7fd8b400b980 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4001e20 tx=0x7fd8b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a5f2072cd22487 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.136+0000 7fd8c9d9b640 1 -- 172.21.15.44:0/3208045136 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4003b70 con 0x7fd8b4005180 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.136+0000 7fd8c9d9b640 1 -- 172.21.15.44:0/3208045136 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c4003cd0 con 0x7fd8b4005180 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.136+0000 7fd8c9d9b640 1 -- 172.21.15.44:0/3208045136 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c40052f0 con 0x7fd8b4005180 2023-11-04T01:36:48.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.136+0000 7fd8d1239640 1 -- 172.21.15.44:0/3208045136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8b4005180 msgr2=0x7fd8b400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.136+0000 7fd8d1239640 1 --2- 172.21.15.44:0/3208045136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8b4005180 0x7fd8b400b980 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4001e20 tx=0x7fd8b40057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.137+0000 7fd8d1239640 1 -- 172.21.15.44:0/3208045136 shutdown_connections 2023-11-04T01:36:48.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.137+0000 7fd8d1239640 1 --2- 172.21.15.44:0/3208045136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8b4005180 0x7fd8b400b980 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.137+0000 7fd8d1239640 1 -- 172.21.15.44:0/3208045136 >> 172.21.15.44:0/3208045136 conn(0x7fd8cc06d800 msgr2=0x7fd8cc06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.137+0000 7fd8d1239640 1 -- 172.21.15.44:0/3208045136 shutdown_connections 2023-11-04T01:36:48.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.137+0000 7fd8d1239640 1 -- 172.21.15.44:0/3208045136 wait complete. 2023-11-04T01:36:48.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.138+0000 7fd8d1239640 1 Processor -- start 2023-11-04T01:36:48.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.138+0000 7fd8d1239640 1 -- start start 2023-11-04T01:36:48.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8d1239640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8b4005180 0x7fd8cc15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8d1239640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8cc0a8c80 0x7fd8cc0a9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8d1239640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8cc0b32f0 0x7fd8cc0b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8d1239640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc0cb060 con 0x7fd8cc0a8c80 2023-11-04T01:36:48.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8d1239640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc0b3ce0 con 0x7fd8b4005180 2023-11-04T01:36:48.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8d1239640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc1f0650 con 0x7fd8cc0b32f0 2023-11-04T01:36:48.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8ca59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8cc0a8c80 0x7fd8cc0a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8ca59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8cc0a8c80 0x7fd8cc0a9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58894/0 (socket says 172.21.15.44:58894) 2023-11-04T01:36:48.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8ca59c640 1 -- 172.21.15.44:0/578552186 learned_addr learned my addr 172.21.15.44:0/578552186 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:48.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8cad9d640 1 --2- 172.21.15.44:0/578552186 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8b4005180 0x7fd8cc15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8cb59e640 1 --2- 172.21.15.44:0/578552186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8cc0b32f0 0x7fd8cc0b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8ca59c640 1 -- 172.21.15.44:0/578552186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8cc0b32f0 msgr2=0x7fd8cc0b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8ca59c640 1 --2- 172.21.15.44:0/578552186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8cc0b32f0 0x7fd8cc0b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8ca59c640 1 -- 172.21.15.44:0/578552186 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8b4005180 msgr2=0x7fd8cc15a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8ca59c640 1 --2- 172.21.15.44:0/578552186 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8b4005180 0x7fd8cc15a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.139+0000 7fd8ca59c640 1 -- 172.21.15.44:0/578552186 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc1f08f0 con 0x7fd8cc0a8c80 2023-11-04T01:36:48.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.140+0000 7fd8ca59c640 1 --2- 172.21.15.44:0/578552186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8cc0a8c80 0x7fd8cc0a9100 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc011a90 tx=0x7fd8bc011f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.140+0000 7fd8b37fe640 1 -- 172.21.15.44:0/578552186 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc00fc10 con 0x7fd8cc0a8c80 2023-11-04T01:36:48.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.140+0000 7fd8b37fe640 1 -- 172.21.15.44:0/578552186 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc00fd70 con 0x7fd8cc0a8c80 2023-11-04T01:36:48.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.140+0000 7fd8b37fe640 1 -- 172.21.15.44:0/578552186 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc00fee0 con 0x7fd8cc0a8c80 2023-11-04T01:36:48.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.140+0000 7fd8d1239640 1 -- 172.21.15.44:0/578552186 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8cc1f0bd0 con 0x7fd8cc0a8c80 2023-11-04T01:36:48.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.140+0000 7fd8d1239640 1 -- 172.21.15.44:0/578552186 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8cc15a620 con 0x7fd8cc0a8c80 2023-11-04T01:36:48.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.141+0000 7fd8d1239640 1 -- 172.21.15.44:0/578552186 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8cc0b46a0 con 0x7fd8cc0a8c80 2023-11-04T01:36:48.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.142+0000 7fd8b37fe640 1 -- 172.21.15.44:0/578552186 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd8bc004260 con 0x7fd8cc0a8c80 2023-11-04T01:36:48.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.142+0000 7fd8b37fe640 1 --2- 172.21.15.44:0/578552186 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd8b806aea0 0x7fd8b806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.142+0000 7fd8b37fe640 1 -- 172.21.15.44:0/578552186 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd8bc08a0c0 con 0x7fd8cc0a8c80 2023-11-04T01:36:48.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.142+0000 7fd8cad9d640 1 --2- 172.21.15.44:0/578552186 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd8b806aea0 0x7fd8b806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.143+0000 7fd8cad9d640 1 --2- 172.21.15.44:0/578552186 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd8b806aea0 0x7fd8b806d360 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0d0100 tx=0x7fd8c0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.147+0000 7fd8b37fe640 1 -- 172.21.15.44:0/578552186 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd8bc054db0 con 0x7fd8cc0a8c80 2023-11-04T01:36:48.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.324+0000 7fd8d1239640 1 -- 172.21.15.44:0/578552186 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd8cc0726c0 con 0x7fd8cc0a8c80 2023-11-04T01:36:48.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.324+0000 7fd8b37fe640 1 -- 172.21.15.44:0/578552186 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd8bc0220a0 con 0x7fd8cc0a8c80 2023-11-04T01:36:48.327 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:48.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.326+0000 7fd8d1239640 1 -- 172.21.15.44:0/578552186 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd8b806aea0 msgr2=0x7fd8b806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.326+0000 7fd8d1239640 1 --2- 172.21.15.44:0/578552186 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd8b806aea0 0x7fd8b806d360 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0d0100 tx=0x7fd8c0009040 comp rx=0 tx=0).stop 2023-11-04T01:36:48.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.326+0000 7fd8d1239640 1 -- 172.21.15.44:0/578552186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8cc0a8c80 msgr2=0x7fd8cc0a9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.326+0000 7fd8d1239640 1 --2- 172.21.15.44:0/578552186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8cc0a8c80 0x7fd8cc0a9100 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc011a90 tx=0x7fd8bc011f50 comp rx=0 tx=0).stop 2023-11-04T01:36:48.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.326+0000 7fd8d1239640 1 -- 172.21.15.44:0/578552186 shutdown_connections 2023-11-04T01:36:48.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.326+0000 7fd8d1239640 1 --2- 172.21.15.44:0/578552186 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd8b806aea0 0x7fd8b806d360 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.326+0000 7fd8d1239640 1 --2- 172.21.15.44:0/578552186 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8cc0b32f0 0x7fd8cc0b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.326+0000 7fd8d1239640 1 --2- 172.21.15.44:0/578552186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8cc0a8c80 0x7fd8cc0a9100 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.326+0000 7fd8d1239640 1 --2- 172.21.15.44:0/578552186 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8b4005180 0x7fd8cc15a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.326+0000 7fd8d1239640 1 -- 172.21.15.44:0/578552186 >> 172.21.15.44:0/578552186 conn(0x7fd8cc06d800 msgr2=0x7fd8cc072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.326+0000 7fd8d1239640 1 -- 172.21.15.44:0/578552186 shutdown_connections 2023-11-04T01:36:48.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.326+0000 7fd8d1239640 1 -- 172.21.15.44:0/578552186 wait complete. 2023-11-04T01:36:48.340 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-11-04T01:36:48.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.460+0000 7ff8c592c640 1 Processor -- start 2023-11-04T01:36:48.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.460+0000 7ff8c592c640 1 -- start start 2023-11-04T01:36:48.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8c592c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8c00cde60 0x7ff8c015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8c592c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff8c015daa0 0x7ff8c0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8c592c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff8c00ce240 0x7ff8c0157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8c592c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c015e5c0 con 0x7ff8c00ce240 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8c592c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c0157a80 con 0x7ff8c015daa0 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8c592c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c015e000 con 0x7ff8c00cde60 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8bf7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff8c00ce240 0x7ff8c0157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8bf7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff8c00ce240 0x7ff8c0157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58904/0 (socket says 172.21.15.44:58904) 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8bf7fe640 1 -- 172.21.15.44:0/3261136232 learned_addr learned my addr 172.21.15.44:0/3261136232 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8bf7fe640 1 -- 172.21.15.44:0/3261136232 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8c00cde60 msgr2=0x7ff8c015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8beffd640 1 --2- 172.21.15.44:0/3261136232 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8c00cde60 0x7ff8c015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8b7fff640 1 --2- 172.21.15.44:0/3261136232 >> v2:172.21.15.204:3300/0 conn(0x7ff8c015daa0 0x7ff8c0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8bf7fe640 1 --2- 172.21.15.44:0/3261136232 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8c00cde60 0x7ff8c015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8bf7fe640 1 -- 172.21.15.44:0/3261136232 >> v2:172.21.15.204:3300/0 conn(0x7ff8c015daa0 msgr2=0x7ff8c0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8bf7fe640 1 --2- 172.21.15.44:0/3261136232 >> v2:172.21.15.204:3300/0 conn(0x7ff8c015daa0 0x7ff8c0157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.461+0000 7ff8bf7fe640 1 -- 172.21.15.44:0/3261136232 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c015e2e0 con 0x7ff8c00ce240 2023-11-04T01:36:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.462+0000 7ff8bf7fe640 1 --2- 172.21.15.44:0/3261136232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c00ce240 0x7ff8c0157540 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff8c006c7c0 tx=0x7ff8b802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d791e671f91c6090 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.462+0000 7ff8be7fc640 1 -- 172.21.15.44:0/3261136232 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b802ca70 con 0x7ff8c00ce240 2023-11-04T01:36:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.462+0000 7ff8be7fc640 1 -- 172.21.15.44:0/3261136232 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b802cbd0 con 0x7ff8c00ce240 2023-11-04T01:36:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.462+0000 7ff8be7fc640 1 -- 172.21.15.44:0/3261136232 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80343f0 con 0x7ff8c00ce240 2023-11-04T01:36:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.463+0000 7ff8c592c640 1 -- 172.21.15.44:0/3261136232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c00ce240 msgr2=0x7ff8c0157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.463+0000 7ff8c592c640 1 --2- 172.21.15.44:0/3261136232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c00ce240 0x7ff8c0157540 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff8c006c7c0 tx=0x7ff8b802bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.463+0000 7ff8c592c640 1 -- 172.21.15.44:0/3261136232 shutdown_connections 2023-11-04T01:36:48.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.463+0000 7ff8c592c640 1 --2- 172.21.15.44:0/3261136232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c00ce240 0x7ff8c0157540 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.463+0000 7ff8c592c640 1 --2- 172.21.15.44:0/3261136232 >> v2:172.21.15.204:3300/0 conn(0x7ff8c015daa0 0x7ff8c0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.463+0000 7ff8c592c640 1 --2- 172.21.15.44:0/3261136232 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8c00cde60 0x7ff8c015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.463+0000 7ff8c592c640 1 -- 172.21.15.44:0/3261136232 >> 172.21.15.44:0/3261136232 conn(0x7ff8c0071f30 msgr2=0x7ff8c00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.463+0000 7ff8c592c640 1 -- 172.21.15.44:0/3261136232 shutdown_connections 2023-11-04T01:36:48.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.463+0000 7ff8c592c640 1 -- 172.21.15.44:0/3261136232 wait complete. 2023-11-04T01:36:48.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.465+0000 7ff8c592c640 1 Processor -- start 2023-11-04T01:36:48.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.465+0000 7ff8c592c640 1 -- start start 2023-11-04T01:36:48.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.465+0000 7ff8c592c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8c00cde60 0x7ff8c0150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.465+0000 7ff8c592c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c00ce240 0x7ff8c014b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.465+0000 7ff8c592c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8c015daa0 0x7ff8c00c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.465+0000 7ff8c592c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c014b8f0 con 0x7ff8c00ce240 2023-11-04T01:36:48.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.465+0000 7ff8c592c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c00ca000 con 0x7ff8c015daa0 2023-11-04T01:36:48.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.465+0000 7ff8c592c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c00ca2e0 con 0x7ff8c00cde60 2023-11-04T01:36:48.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8b7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c00ce240 0x7ff8c014b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8b7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c00ce240 0x7ff8c014b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58914/0 (socket says 172.21.15.44:58914) 2023-11-04T01:36:48.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8b7fff640 1 -- 172.21.15.44:0/76108254 learned_addr learned my addr 172.21.15.44:0/76108254 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:48.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8beffd640 1 --2- 172.21.15.44:0/76108254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8c00cde60 0x7ff8c0150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8bf7fe640 1 --2- 172.21.15.44:0/76108254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8c015daa0 0x7ff8c00c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8b7fff640 1 -- 172.21.15.44:0/76108254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8c00cde60 msgr2=0x7ff8c0150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8b7fff640 1 --2- 172.21.15.44:0/76108254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8c00cde60 0x7ff8c0150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8b7fff640 1 -- 172.21.15.44:0/76108254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8c015daa0 msgr2=0x7ff8c00c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8b7fff640 1 --2- 172.21.15.44:0/76108254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8c015daa0 0x7ff8c00c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8b7fff640 1 -- 172.21.15.44:0/76108254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b8009b30 con 0x7ff8c00ce240 2023-11-04T01:36:48.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8b7fff640 1 --2- 172.21.15.44:0/76108254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c00ce240 0x7ff8c014b3b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800c7f0 tx=0x7ff8a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8bcff9640 1 -- 172.21.15.44:0/76108254 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8004220 con 0x7ff8c00ce240 2023-11-04T01:36:48.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8bcff9640 1 -- 172.21.15.44:0/76108254 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a8004380 con 0x7ff8c00ce240 2023-11-04T01:36:48.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8c592c640 1 -- 172.21.15.44:0/76108254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c00ca5c0 con 0x7ff8c00ce240 2023-11-04T01:36:48.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8bcff9640 1 -- 172.21.15.44:0/76108254 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8007840 con 0x7ff8c00ce240 2023-11-04T01:36:48.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.466+0000 7ff8c592c640 1 -- 172.21.15.44:0/76108254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c00cab80 con 0x7ff8c00ce240 2023-11-04T01:36:48.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.467+0000 7ff8c592c640 1 -- 172.21.15.44:0/76108254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c00cad70 con 0x7ff8c00ce240 2023-11-04T01:36:48.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.468+0000 7ff8bcff9640 1 -- 172.21.15.44:0/76108254 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8a8007bb0 con 0x7ff8c00ce240 2023-11-04T01:36:48.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.468+0000 7ff8bcff9640 1 --2- 172.21.15.44:0/76108254 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff8a006ae70 0x7ff8a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.468+0000 7ff8bcff9640 1 -- 172.21.15.44:0/76108254 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff8a80898c0 con 0x7ff8c00ce240 2023-11-04T01:36:48.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.469+0000 7ff8beffd640 1 --2- 172.21.15.44:0/76108254 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff8a006ae70 0x7ff8a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.469+0000 7ff8beffd640 1 --2- 172.21.15.44:0/76108254 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff8a006ae70 0x7ff8a006d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000aaf0 tx=0x7ff8b0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.472+0000 7ff8bcff9640 1 -- 172.21.15.44:0/76108254 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8a80545c0 con 0x7ff8c00ce240 2023-11-04T01:36:48.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:48.716+0000 7ff8c592c640 1 -- 172.21.15.44:0/76108254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7ff8c0074290 con 0x7ff8c00ce240 2023-11-04T01:36:49.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.358+0000 7ff8bcff9640 1 -- 172.21.15.44:0/76108254 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v69) v1 ==== 176+0+0 (secure 0 0 0) 0x7ff8a801e0f0 con 0x7ff8c00ce240 2023-11-04T01:36:49.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.360+0000 7ff8c592c640 1 -- 172.21.15.44:0/76108254 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff8a006ae70 msgr2=0x7ff8a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.360+0000 7ff8c592c640 1 --2- 172.21.15.44:0/76108254 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff8a006ae70 0x7ff8a006d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000aaf0 tx=0x7ff8b0008040 comp rx=0 tx=0).stop 2023-11-04T01:36:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.360+0000 7ff8c592c640 1 -- 172.21.15.44:0/76108254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c00ce240 msgr2=0x7ff8c014b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.360+0000 7ff8c592c640 1 --2- 172.21.15.44:0/76108254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c00ce240 0x7ff8c014b3b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800c7f0 tx=0x7ff8a800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.361+0000 7ff8c592c640 1 -- 172.21.15.44:0/76108254 shutdown_connections 2023-11-04T01:36:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.361+0000 7ff8c592c640 1 --2- 172.21.15.44:0/76108254 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff8a006ae70 0x7ff8a006d330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.361+0000 7ff8c592c640 1 --2- 172.21.15.44:0/76108254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8c015daa0 0x7ff8c00c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.361+0000 7ff8c592c640 1 --2- 172.21.15.44:0/76108254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c00ce240 0x7ff8c014b3b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.361+0000 7ff8c592c640 1 --2- 172.21.15.44:0/76108254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8c00cde60 0x7ff8c0150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.361+0000 7ff8c592c640 1 -- 172.21.15.44:0/76108254 >> 172.21.15.44:0/76108254 conn(0x7ff8c0071f30 msgr2=0x7ff8c00d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.361+0000 7ff8c592c640 1 -- 172.21.15.44:0/76108254 shutdown_connections 2023-11-04T01:36:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.361+0000 7ff8c592c640 1 -- 172.21.15.44:0/76108254 wait complete. 2023-11-04T01:36:49.373 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:36:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.481+0000 7f1652d9e640 1 Processor -- start 2023-11-04T01:36:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.481+0000 7f1652d9e640 1 -- start start 2023-11-04T01:36:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.482+0000 7f1652d9e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f164c15ad30 0x7f164c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.482+0000 7f1652d9e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f164c070e20 0x7f164c15e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.482+0000 7f1652d9e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c0c3900 con 0x7f164c0ad730 2023-11-04T01:36:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.482+0000 7f1652d9e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0ae260 con 0x7f164c15ad30 2023-11-04T01:36:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.482+0000 7f1652d9e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0c3be0 con 0x7f164c070e20 2023-11-04T01:36:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.482+0000 7f1650b3a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f164c15ad30 0x7f164c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.482+0000 7f1650b3a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f164c15ad30 0x7f164c0adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58916/0 (socket says 172.21.15.44:58916) 2023-11-04T01:36:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.482+0000 7f1650b3a640 1 -- 172.21.15.44:0/1055685562 learned_addr learned my addr 172.21.15.44:0/1055685562 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.483+0000 7f165133b640 1 --2- 172.21.15.44:0/1055685562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f164c070e20 0x7f164c15e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.483+0000 7f1650b3a640 1 -- 172.21.15.44:0/1055685562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f164c070e20 msgr2=0x7f164c15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.483+0000 7f1650b3a640 1 --2- 172.21.15.44:0/1055685562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f164c070e20 0x7f164c15e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.483+0000 7f1650b3a640 1 -- 172.21.15.44:0/1055685562 >> v1:172.21.15.204:6789/0 conn(0x7f164c0ad730 legacy=0x7f164c070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.483+0000 7f1650b3a640 1 -- 172.21.15.44:0/1055685562 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c0c3ec0 con 0x7f164c15ad30 2023-11-04T01:36:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.483+0000 7f165133b640 1 --2- 172.21.15.44:0/1055685562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f164c070e20 0x7f164c15e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.483+0000 7f1650b3a640 1 --2- 172.21.15.44:0/1055685562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f164c15ad30 0x7f164c0adc80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1644009e50 tx=0x7f164402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a931287f104b2e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.484+0000 7f164b7fe640 1 -- 172.21.15.44:0/1055685562 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164402ca70 con 0x7f164c15ad30 2023-11-04T01:36:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.484+0000 7f164b7fe640 1 -- 172.21.15.44:0/1055685562 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164402cbd0 con 0x7f164c15ad30 2023-11-04T01:36:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.484+0000 7f164b7fe640 1 -- 172.21.15.44:0/1055685562 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440343f0 con 0x7f164c15ad30 2023-11-04T01:36:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.484+0000 7f1652d9e640 1 -- 172.21.15.44:0/1055685562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f164c15ad30 msgr2=0x7f164c0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.484+0000 7f1652d9e640 1 --2- 172.21.15.44:0/1055685562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f164c15ad30 0x7f164c0adc80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1644009e50 tx=0x7f164402bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.484+0000 7f1652d9e640 1 -- 172.21.15.44:0/1055685562 shutdown_connections 2023-11-04T01:36:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.484+0000 7f1652d9e640 1 --2- 172.21.15.44:0/1055685562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f164c070e20 0x7f164c15e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.484+0000 7f1652d9e640 1 --2- 172.21.15.44:0/1055685562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f164c15ad30 0x7f164c0adc80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.484+0000 7f1652d9e640 1 -- 172.21.15.44:0/1055685562 >> 172.21.15.44:0/1055685562 conn(0x7f164c0ce950 msgr2=0x7f164c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.484+0000 7f1652d9e640 1 -- 172.21.15.44:0/1055685562 shutdown_connections 2023-11-04T01:36:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.484+0000 7f1652d9e640 1 -- 172.21.15.44:0/1055685562 wait complete. 2023-11-04T01:36:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.485+0000 7f1652d9e640 1 Processor -- start 2023-11-04T01:36:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.486+0000 7f1652d9e640 1 -- start start 2023-11-04T01:36:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.486+0000 7f1652d9e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f164c070e20 0x7f164c155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.486+0000 7f1652d9e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f164c0ad730 0x7f164c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.486+0000 7f1652d9e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f164c15ad30 0x7f164c0b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.486+0000 7f1652d9e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0b19f0 con 0x7f164c070e20 2023-11-04T01:36:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.486+0000 7f1652d9e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c156070 con 0x7f164c0ad730 2023-11-04T01:36:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.486+0000 7f1652d9e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0b1430 con 0x7f164c15ad30 2023-11-04T01:36:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.486+0000 7f1650b3a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f164c070e20 0x7f164c155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f1650b3a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f164c070e20 0x7f164c155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58918/0 (socket says 172.21.15.44:58918) 2023-11-04T01:36:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f1650b3a640 1 -- 172.21.15.44:0/3555377160 learned_addr learned my addr 172.21.15.44:0/3555377160 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f164bfff640 1 --2- 172.21.15.44:0/3555377160 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f164c0ad730 0x7f164c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f165133b640 1 --2- 172.21.15.44:0/3555377160 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f164c15ad30 0x7f164c0b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f1650b3a640 1 -- 172.21.15.44:0/3555377160 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f164c15ad30 msgr2=0x7f164c0b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f1650b3a640 1 --2- 172.21.15.44:0/3555377160 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f164c15ad30 0x7f164c0b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f1650b3a640 1 -- 172.21.15.44:0/3555377160 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f164c0ad730 msgr2=0x7f164c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f1650b3a640 1 --2- 172.21.15.44:0/3555377160 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f164c0ad730 0x7f164c15ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f1650b3a640 1 -- 172.21.15.44:0/3555377160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1644009b30 con 0x7f164c070e20 2023-11-04T01:36:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f164bfff640 1 --2- 172.21.15.44:0/3555377160 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f164c0ad730 0x7f164c15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f1650b3a640 1 --2- 172.21.15.44:0/3555377160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f164c070e20 0x7f164c155b30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1644000f80 tx=0x7f1644004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f16497fa640 1 -- 172.21.15.44:0/3555377160 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644009510 con 0x7f164c070e20 2023-11-04T01:36:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f16497fa640 1 -- 172.21.15.44:0/3555377160 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164403e450 con 0x7f164c070e20 2023-11-04T01:36:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f16497fa640 1 -- 172.21.15.44:0/3555377160 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164403e800 con 0x7f164c070e20 2023-11-04T01:36:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f1652d9e640 1 -- 172.21.15.44:0/3555377160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c0b1710 con 0x7f164c070e20 2023-11-04T01:36:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.487+0000 7f1652d9e640 1 -- 172.21.15.44:0/3555377160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c15c550 con 0x7f164c070e20 2023-11-04T01:36:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.488+0000 7f1652d9e640 1 -- 172.21.15.44:0/3555377160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c074290 con 0x7f164c070e20 2023-11-04T01:36:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.489+0000 7f16497fa640 1 -- 172.21.15.44:0/3555377160 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f164403e960 con 0x7f164c070e20 2023-11-04T01:36:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.489+0000 7f16497fa640 1 --2- 172.21.15.44:0/3555377160 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f163806ae70 0x7f163806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.489+0000 7f16497fa640 1 -- 172.21.15.44:0/3555377160 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f16440ac800 con 0x7f164c070e20 2023-11-04T01:36:49.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.489+0000 7f164bfff640 1 --2- 172.21.15.44:0/3555377160 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f163806ae70 0x7f163806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.490+0000 7f164bfff640 1 --2- 172.21.15.44:0/3555377160 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f163806ae70 0x7f163806d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1640007fd0 tx=0x7f1640009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.493+0000 7f16497fa640 1 -- 172.21.15.44:0/3555377160 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1644077470 con 0x7f164c070e20 2023-11-04T01:36:49.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.668+0000 7f1652d9e640 1 -- 172.21.15.44:0/3555377160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f164c0ad510 con 0x7f164c070e20 2023-11-04T01:36:49.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.671+0000 7f16497fa640 1 -- 172.21.15.44:0/3555377160 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v11)=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f164407aa90 con 0x7f164c070e20 2023-11-04T01:36:49.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.673+0000 7f1652d9e640 1 -- 172.21.15.44:0/3555377160 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f163806ae70 msgr2=0x7f163806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.673+0000 7f1652d9e640 1 --2- 172.21.15.44:0/3555377160 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f163806ae70 0x7f163806d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1640007fd0 tx=0x7f1640009040 comp rx=0 tx=0).stop 2023-11-04T01:36:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.673+0000 7f1652d9e640 1 -- 172.21.15.44:0/3555377160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f164c070e20 msgr2=0x7f164c155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.673+0000 7f1652d9e640 1 --2- 172.21.15.44:0/3555377160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f164c070e20 0x7f164c155b30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1644000f80 tx=0x7f1644004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.673+0000 7f1652d9e640 1 -- 172.21.15.44:0/3555377160 shutdown_connections 2023-11-04T01:36:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.673+0000 7f1652d9e640 1 --2- 172.21.15.44:0/3555377160 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f163806ae70 0x7f163806d330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.673+0000 7f1652d9e640 1 --2- 172.21.15.44:0/3555377160 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f164c15ad30 0x7f164c0b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.673+0000 7f1652d9e640 1 --2- 172.21.15.44:0/3555377160 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f164c0ad730 0x7f164c15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.673+0000 7f1652d9e640 1 --2- 172.21.15.44:0/3555377160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f164c070e20 0x7f164c155b30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.673+0000 7f1652d9e640 1 -- 172.21.15.44:0/3555377160 >> 172.21.15.44:0/3555377160 conn(0x7f164c0ce950 msgr2=0x7f164c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.673+0000 7f1652d9e640 1 -- 172.21.15.44:0/3555377160 shutdown_connections 2023-11-04T01:36:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:49.673+0000 7f1652d9e640 1 -- 172.21.15.44:0/3555377160 wait complete. 2023-11-04T01:36:49.687 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:36:49.687 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:36:49.741 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:36:49.786 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:36:49.787 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:36:49.787 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:49.803 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:36:49.803 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:49.858 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:49.899 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:36:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.002+0000 7ff9deb33640 1 Processor -- start 2023-11-04T01:36:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.002+0000 7ff9deb33640 1 -- start start 2023-11-04T01:36:50.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.002+0000 7ff9deb33640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff9d815ce60 0x7ff9d806b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.003+0000 7ff9deb33640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff9d80cf160 0x7ff9d80cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.003+0000 7ff9deb33640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d81615d0 con 0x7ff9d806bd30 2023-11-04T01:36:50.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.003+0000 7ff9deb33640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d80cbde0 con 0x7ff9d80cf160 2023-11-04T01:36:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.003+0000 7ff9deb33640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d80cfb30 con 0x7ff9d815ce60 2023-11-04T01:36:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.003+0000 7ff9dd0d0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff9d80cf160 0x7ff9d80cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.003+0000 7ff9dd0d0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff9d80cf160 0x7ff9d80cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58928/0 (socket says 172.21.15.44:58928) 2023-11-04T01:36:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.003+0000 7ff9dd0d0640 1 -- 172.21.15.44:0/1922855570 learned_addr learned my addr 172.21.15.44:0/1922855570 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.003+0000 7ff9dc8cf640 1 --2- 172.21.15.44:0/1922855570 >> v2:172.21.15.204:3300/0 conn(0x7ff9d815ce60 0x7ff9d806b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.003+0000 7ff9dd0d0640 1 -- 172.21.15.44:0/1922855570 >> v2:172.21.15.204:3300/0 conn(0x7ff9d815ce60 msgr2=0x7ff9d806b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.003+0000 7ff9dd0d0640 1 --2- 172.21.15.44:0/1922855570 >> v2:172.21.15.204:3300/0 conn(0x7ff9d815ce60 0x7ff9d806b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.003+0000 7ff9dd0d0640 1 -- 172.21.15.44:0/1922855570 >> v1:172.21.15.204:6789/0 conn(0x7ff9d806bd30 legacy=0x7ff9d8160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.003+0000 7ff9dd0d0640 1 -- 172.21.15.44:0/1922855570 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d81618b0 con 0x7ff9d80cf160 2023-11-04T01:36:50.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.004+0000 7ff9dd0d0640 1 --2- 172.21.15.44:0/1922855570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d80cf160 0x7ff9d80cf5f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff9d806e960 tx=0x7ff9d002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66279a6c4b79983f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.004+0000 7ff9d77fe640 1 -- 172.21.15.44:0/1922855570 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d002ca80 con 0x7ff9d80cf160 2023-11-04T01:36:50.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.004+0000 7ff9d77fe640 1 -- 172.21.15.44:0/1922855570 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d002cbe0 con 0x7ff9d80cf160 2023-11-04T01:36:50.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.004+0000 7ff9d77fe640 1 -- 172.21.15.44:0/1922855570 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00343f0 con 0x7ff9d80cf160 2023-11-04T01:36:50.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.004+0000 7ff9deb33640 1 -- 172.21.15.44:0/1922855570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d80cf160 msgr2=0x7ff9d80cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.004+0000 7ff9deb33640 1 --2- 172.21.15.44:0/1922855570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d80cf160 0x7ff9d80cf5f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff9d806e960 tx=0x7ff9d002bee0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.004+0000 7ff9deb33640 1 -- 172.21.15.44:0/1922855570 shutdown_connections 2023-11-04T01:36:50.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.004+0000 7ff9deb33640 1 --2- 172.21.15.44:0/1922855570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d80cf160 0x7ff9d80cf5f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.004+0000 7ff9deb33640 1 --2- 172.21.15.44:0/1922855570 >> v2:172.21.15.204:3300/0 conn(0x7ff9d815ce60 0x7ff9d806b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.005+0000 7ff9deb33640 1 -- 172.21.15.44:0/1922855570 >> 172.21.15.44:0/1922855570 conn(0x7ff9d806ea90 msgr2=0x7ff9d806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.005+0000 7ff9deb33640 1 -- 172.21.15.44:0/1922855570 shutdown_connections 2023-11-04T01:36:50.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.005+0000 7ff9deb33640 1 -- 172.21.15.44:0/1922855570 wait complete. 2023-11-04T01:36:50.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.006+0000 7ff9deb33640 1 Processor -- start 2023-11-04T01:36:50.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.006+0000 7ff9deb33640 1 -- start start 2023-11-04T01:36:50.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9deb33640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d80cf160 0x7ff9d80c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9deb33640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9d815ce60 0x7ff9d81f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9deb33640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9d81f60b0 0x7ff9d81f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9deb33640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d80c9c70 con 0x7ff9d80cf160 2023-11-04T01:36:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9deb33640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d80c8ff0 con 0x7ff9d815ce60 2023-11-04T01:36:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9deb33640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d80c92d0 con 0x7ff9d81f60b0 2023-11-04T01:36:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9dc8cf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d80cf160 0x7ff9d80c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9dc8cf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d80cf160 0x7ff9d80c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58942/0 (socket says 172.21.15.44:58942) 2023-11-04T01:36:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9dc8cf640 1 -- 172.21.15.44:0/2084631816 learned_addr learned my addr 172.21.15.44:0/2084631816 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9dc8cf640 1 -- 172.21.15.44:0/2084631816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9d81f60b0 msgr2=0x7ff9d81f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9dc8cf640 1 --2- 172.21.15.44:0/2084631816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9d81f60b0 0x7ff9d81f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9dc8cf640 1 -- 172.21.15.44:0/2084631816 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9d815ce60 msgr2=0x7ff9d81f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9d7fff640 1 --2- 172.21.15.44:0/2084631816 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9d815ce60 0x7ff9d81f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9dc8cf640 1 --2- 172.21.15.44:0/2084631816 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9d815ce60 0x7ff9d81f5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9dc8cf640 1 -- 172.21.15.44:0/2084631816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d0009b30 con 0x7ff9d80cf160 2023-11-04T01:36:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9dc8cf640 1 --2- 172.21.15.44:0/2084631816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d80cf160 0x7ff9d80c8680 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00d800 tx=0x7ff9cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9d57fa640 1 -- 172.21.15.44:0/2084631816 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc00b6c0 con 0x7ff9d80cf160 2023-11-04T01:36:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9d57fa640 1 -- 172.21.15.44:0/2084631816 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9cc00b820 con 0x7ff9d80cf160 2023-11-04T01:36:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9d57fa640 1 -- 172.21.15.44:0/2084631816 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc00bbb0 con 0x7ff9d80cf160 2023-11-04T01:36:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.007+0000 7ff9deb33640 1 -- 172.21.15.44:0/2084631816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d80c95b0 con 0x7ff9d80cf160 2023-11-04T01:36:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.008+0000 7ff9deb33640 1 -- 172.21.15.44:0/2084631816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d80c8bc0 con 0x7ff9d80cf160 2023-11-04T01:36:50.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.008+0000 7ff9deb33640 1 -- 172.21.15.44:0/2084631816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d80c9db0 con 0x7ff9d80cf160 2023-11-04T01:36:50.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.009+0000 7ff9d57fa640 1 -- 172.21.15.44:0/2084631816 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9cc00bd10 con 0x7ff9d80cf160 2023-11-04T01:36:50.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.009+0000 7ff9d57fa640 1 --2- 172.21.15.44:0/2084631816 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff9c406aea0 0x7ff9c406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.009+0000 7ff9d57fa640 1 -- 172.21.15.44:0/2084631816 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff9cc089f90 con 0x7ff9d80cf160 2023-11-04T01:36:50.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.010+0000 7ff9d7fff640 1 --2- 172.21.15.44:0/2084631816 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff9c406aea0 0x7ff9c406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.010+0000 7ff9d7fff640 1 --2- 172.21.15.44:0/2084631816 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff9c406aea0 0x7ff9c406d360 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8006fd0 tx=0x7ff9c8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.014+0000 7ff9d57fa640 1 -- 172.21.15.44:0/2084631816 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9cc0bcca0 con 0x7ff9d80cf160 2023-11-04T01:36:50.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.190+0000 7ff9deb33640 1 -- 172.21.15.44:0/2084631816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9d8074290 con 0x7ff9d80cf160 2023-11-04T01:36:50.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.191+0000 7ff9d57fa640 1 -- 172.21.15.44:0/2084631816 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7ff9cc054bf0 con 0x7ff9d80cf160 2023-11-04T01:36:50.194 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:50.194 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.193+0000 7ff9deb33640 1 -- 172.21.15.44:0/2084631816 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff9c406aea0 msgr2=0x7ff9c406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.193+0000 7ff9deb33640 1 --2- 172.21.15.44:0/2084631816 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff9c406aea0 0x7ff9c406d360 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8006fd0 tx=0x7ff9c8008040 comp rx=0 tx=0).stop 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.193+0000 7ff9deb33640 1 -- 172.21.15.44:0/2084631816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d80cf160 msgr2=0x7ff9d80c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.193+0000 7ff9deb33640 1 --2- 172.21.15.44:0/2084631816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d80cf160 0x7ff9d80c8680 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00d800 tx=0x7ff9cc00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.193+0000 7ff9deb33640 1 -- 172.21.15.44:0/2084631816 shutdown_connections 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.193+0000 7ff9deb33640 1 --2- 172.21.15.44:0/2084631816 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff9c406aea0 0x7ff9c406d360 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.193+0000 7ff9deb33640 1 --2- 172.21.15.44:0/2084631816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9d81f60b0 0x7ff9d81f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.193+0000 7ff9deb33640 1 --2- 172.21.15.44:0/2084631816 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9d815ce60 0x7ff9d81f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.193+0000 7ff9deb33640 1 --2- 172.21.15.44:0/2084631816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d80cf160 0x7ff9d80c8680 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.193+0000 7ff9deb33640 1 -- 172.21.15.44:0/2084631816 >> 172.21.15.44:0/2084631816 conn(0x7ff9d806ea90 msgr2=0x7ff9d81608e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.193+0000 7ff9deb33640 1 -- 172.21.15.44:0/2084631816 shutdown_connections 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.193+0000 7ff9deb33640 1 -- 172.21.15.44:0/2084631816 wait complete. 2023-11-04T01:36:50.206 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:50.207 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:50.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.314+0000 7f0949339640 1 Processor -- start 2023-11-04T01:36:50.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.314+0000 7f0949339640 1 -- start start 2023-11-04T01:36:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.314+0000 7f0949339640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f094415e1b0 0x7f09440ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.314+0000 7f0949339640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f094415e590 0x7f09440722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.314+0000 7f0949339640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09440ca620 con 0x7f09440b21f0 2023-11-04T01:36:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.314+0000 7f0949339640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094406e7e0 con 0x7f094415e590 2023-11-04T01:36:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.315+0000 7f0949339640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09440cb060 con 0x7f094415e1b0 2023-11-04T01:36:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.315+0000 7f09427fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f094415e590 0x7f09440722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.315+0000 7f09427fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f094415e590 0x7f09440722d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58952/0 (socket says 172.21.15.44:58952) 2023-11-04T01:36:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.315+0000 7f09427fc640 1 -- 172.21.15.44:0/3501120613 learned_addr learned my addr 172.21.15.44:0/3501120613 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.315+0000 7f0942ffd640 1 --2- 172.21.15.44:0/3501120613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f094415e1b0 0x7f09440ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.315+0000 7f09427fc640 1 -- 172.21.15.44:0/3501120613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f094415e1b0 msgr2=0x7f09440ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.315+0000 7f09427fc640 1 --2- 172.21.15.44:0/3501120613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f094415e1b0 0x7f09440ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.315+0000 7f09427fc640 1 -- 172.21.15.44:0/3501120613 >> v1:172.21.15.204:6789/0 conn(0x7f09440b21f0 legacy=0x7f094406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.315+0000 7f09427fc640 1 -- 172.21.15.44:0/3501120613 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09440ca060 con 0x7f094415e590 2023-11-04T01:36:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.316+0000 7f09427fc640 1 --2- 172.21.15.44:0/3501120613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094415e590 0x7f09440722d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0938009870 tx=0x7f093802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1bfae5fd7dfac2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.316+0000 7f0941ffb640 1 -- 172.21.15.44:0/3501120613 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938031640 con 0x7f094415e590 2023-11-04T01:36:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.316+0000 7f0941ffb640 1 -- 172.21.15.44:0/3501120613 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09380317a0 con 0x7f094415e590 2023-11-04T01:36:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.316+0000 7f0941ffb640 1 -- 172.21.15.44:0/3501120613 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938031b30 con 0x7f094415e590 2023-11-04T01:36:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.316+0000 7f0949339640 1 -- 172.21.15.44:0/3501120613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094415e590 msgr2=0x7f09440722d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.316+0000 7f0949339640 1 --2- 172.21.15.44:0/3501120613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094415e590 0x7f09440722d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0938009870 tx=0x7f093802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.316+0000 7f0949339640 1 -- 172.21.15.44:0/3501120613 shutdown_connections 2023-11-04T01:36:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.316+0000 7f0949339640 1 --2- 172.21.15.44:0/3501120613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094415e590 0x7f09440722d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.316+0000 7f0949339640 1 --2- 172.21.15.44:0/3501120613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f094415e1b0 0x7f09440ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.316+0000 7f0949339640 1 -- 172.21.15.44:0/3501120613 >> 172.21.15.44:0/3501120613 conn(0x7f094406d800 msgr2=0x7f094406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.317+0000 7f0949339640 1 -- 172.21.15.44:0/3501120613 shutdown_connections 2023-11-04T01:36:50.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.317+0000 7f0949339640 1 -- 172.21.15.44:0/3501120613 wait complete. 2023-11-04T01:36:50.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.318+0000 7f0949339640 1 Processor -- start 2023-11-04T01:36:50.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.318+0000 7f0949339640 1 -- start start 2023-11-04T01:36:50.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f0949339640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09440b21f0 0x7f09441f0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f0949339640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f094415e1b0 0x7f09441e40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f0949339640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094415e590 0x7f09440b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f0949339640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09440c7be0 con 0x7f094415e590 2023-11-04T01:36:50.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f0949339640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09440c7e40 con 0x7f094415e1b0 2023-11-04T01:36:50.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f0949339640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09440c8120 con 0x7f09440b21f0 2023-11-04T01:36:50.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f09437fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094415e590 0x7f09440b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f09437fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094415e590 0x7f09440b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58956/0 (socket says 172.21.15.44:58956) 2023-11-04T01:36:50.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f09437fe640 1 -- 172.21.15.44:0/635451809 learned_addr learned my addr 172.21.15.44:0/635451809 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:50.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f0942ffd640 1 --2- 172.21.15.44:0/635451809 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09440b21f0 0x7f09441f0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f09427fc640 1 --2- 172.21.15.44:0/635451809 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f094415e1b0 0x7f09441e40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f09437fe640 1 -- 172.21.15.44:0/635451809 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09440b21f0 msgr2=0x7f09441f0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f09437fe640 1 --2- 172.21.15.44:0/635451809 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09440b21f0 0x7f09441f0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f09437fe640 1 -- 172.21.15.44:0/635451809 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f094415e1b0 msgr2=0x7f09441e40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f09437fe640 1 --2- 172.21.15.44:0/635451809 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f094415e1b0 0x7f09441e40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f09437fe640 1 -- 172.21.15.44:0/635451809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09380094d0 con 0x7f094415e590 2023-11-04T01:36:50.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f09437fe640 1 --2- 172.21.15.44:0/635451809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094415e590 0x7f09440b04c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f093400c730 tx=0x7f093400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f092b7fe640 1 -- 172.21.15.44:0/635451809 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934003b70 con 0x7f094415e590 2023-11-04T01:36:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.319+0000 7f092b7fe640 1 -- 172.21.15.44:0/635451809 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0934003cd0 con 0x7f094415e590 2023-11-04T01:36:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.320+0000 7f092b7fe640 1 -- 172.21.15.44:0/635451809 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934005310 con 0x7f094415e590 2023-11-04T01:36:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.320+0000 7f0949339640 1 -- 172.21.15.44:0/635451809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09440c8400 con 0x7f094415e590 2023-11-04T01:36:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.320+0000 7f0949339640 1 -- 172.21.15.44:0/635451809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09440c89c0 con 0x7f094415e590 2023-11-04T01:36:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.321+0000 7f0949339640 1 -- 172.21.15.44:0/635451809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09440c8bb0 con 0x7f094415e590 2023-11-04T01:36:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.321+0000 7f092b7fe640 1 -- 172.21.15.44:0/635451809 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0934005680 con 0x7f094415e590 2023-11-04T01:36:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.321+0000 7f092b7fe640 1 --2- 172.21.15.44:0/635451809 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f093006ae70 0x7f093006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.321+0000 7f092b7fe640 1 -- 172.21.15.44:0/635451809 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0934089800 con 0x7f094415e590 2023-11-04T01:36:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.322+0000 7f0942ffd640 1 --2- 172.21.15.44:0/635451809 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f093006ae70 0x7f093006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.322+0000 7f0942ffd640 1 --2- 172.21.15.44:0/635451809 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f093006ae70 0x7f093006d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f093c009b40 tx=0x7f093c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.325+0000 7f092b7fe640 1 -- 172.21.15.44:0/635451809 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f09340545a0 con 0x7f094415e590 2023-11-04T01:36:50.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.501+0000 7f0949339640 1 -- 172.21.15.44:0/635451809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09441f0890 con 0x7f094415e590 2023-11-04T01:36:50.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.502+0000 7f092b7fe640 1 -- 172.21.15.44:0/635451809 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0934057bc0 con 0x7f094415e590 2023-11-04T01:36:50.506 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:36:50.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.503+0000 7f0949339640 1 -- 172.21.15.44:0/635451809 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f093006ae70 msgr2=0x7f093006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.503+0000 7f0949339640 1 --2- 172.21.15.44:0/635451809 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f093006ae70 0x7f093006d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f093c009b40 tx=0x7f093c009190 comp rx=0 tx=0).stop 2023-11-04T01:36:50.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.503+0000 7f0949339640 1 -- 172.21.15.44:0/635451809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094415e590 msgr2=0x7f09440b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.503+0000 7f0949339640 1 --2- 172.21.15.44:0/635451809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094415e590 0x7f09440b04c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f093400c730 tx=0x7f093400cbf0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.503+0000 7f0949339640 1 -- 172.21.15.44:0/635451809 shutdown_connections 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.503+0000 7f0949339640 1 --2- 172.21.15.44:0/635451809 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f093006ae70 0x7f093006d330 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.503+0000 7f0949339640 1 --2- 172.21.15.44:0/635451809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094415e590 0x7f09440b04c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.503+0000 7f0949339640 1 --2- 172.21.15.44:0/635451809 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f094415e1b0 0x7f09441e40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.503+0000 7f0949339640 1 --2- 172.21.15.44:0/635451809 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09440b21f0 0x7f09441f0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.503+0000 7f0949339640 1 -- 172.21.15.44:0/635451809 >> 172.21.15.44:0/635451809 conn(0x7f094406d800 msgr2=0x7f09441e6430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.504+0000 7f0949339640 1 -- 172.21.15.44:0/635451809 shutdown_connections 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.504+0000 7f0949339640 1 -- 172.21.15.44:0/635451809 wait complete. 2023-11-04T01:36:50.516 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:50.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.623+0000 7f794601a640 1 Processor -- start 2023-11-04T01:36:50.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.623+0000 7f794601a640 1 -- start start 2023-11-04T01:36:50.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.624+0000 7f794601a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f794015ad30 0x7f79400adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.624+0000 7f794601a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7940070e20 0x7f794015e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.624+0000 7f794601a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79400c3900 con 0x7f79400ad730 2023-11-04T01:36:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.624+0000 7f794601a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79400ae260 con 0x7f794015ad30 2023-11-04T01:36:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.624+0000 7f794601a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79400c3be0 con 0x7f7940070e20 2023-11-04T01:36:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.624+0000 7f793f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f794015ad30 0x7f79400adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.624+0000 7f793f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f794015ad30 0x7f79400adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58968/0 (socket says 172.21.15.44:58968) 2023-11-04T01:36:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.624+0000 7f793f7fe640 1 -- 172.21.15.44:0/158285367 learned_addr learned my addr 172.21.15.44:0/158285367 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.624+0000 7f793ffff640 1 --2- 172.21.15.44:0/158285367 >> v2:172.21.15.204:3300/0 conn(0x7f7940070e20 0x7f794015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.624+0000 7f793f7fe640 1 -- 172.21.15.44:0/158285367 >> v2:172.21.15.204:3300/0 conn(0x7f7940070e20 msgr2=0x7f794015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.624+0000 7f793f7fe640 1 --2- 172.21.15.44:0/158285367 >> v2:172.21.15.204:3300/0 conn(0x7f7940070e20 0x7f794015e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.624+0000 7f793f7fe640 1 -- 172.21.15.44:0/158285367 >> v1:172.21.15.204:6789/0 conn(0x7f79400ad730 legacy=0x7f7940070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.624+0000 7f793f7fe640 1 -- 172.21.15.44:0/158285367 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79400c3ec0 con 0x7f794015ad30 2023-11-04T01:36:50.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.625+0000 7f793f7fe640 1 --2- 172.21.15.44:0/158285367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f794015ad30 0x7f79400adc80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f79400cf9e0 tx=0x7f793002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195a77211f1cefd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.625+0000 7f793e7fc640 1 -- 172.21.15.44:0/158285367 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79300317e0 con 0x7f794015ad30 2023-11-04T01:36:50.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.626+0000 7f793e7fc640 1 -- 172.21.15.44:0/158285367 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7930031940 con 0x7f794015ad30 2023-11-04T01:36:50.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.626+0000 7f793e7fc640 1 -- 172.21.15.44:0/158285367 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930031cd0 con 0x7f794015ad30 2023-11-04T01:36:50.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.626+0000 7f794601a640 1 -- 172.21.15.44:0/158285367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f794015ad30 msgr2=0x7f79400adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.626+0000 7f794601a640 1 --2- 172.21.15.44:0/158285367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f794015ad30 0x7f79400adc80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f79400cf9e0 tx=0x7f793002b880 comp rx=0 tx=0).stop 2023-11-04T01:36:50.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.626+0000 7f794601a640 1 -- 172.21.15.44:0/158285367 shutdown_connections 2023-11-04T01:36:50.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.626+0000 7f794601a640 1 --2- 172.21.15.44:0/158285367 >> v2:172.21.15.204:3300/0 conn(0x7f7940070e20 0x7f794015e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.626+0000 7f794601a640 1 --2- 172.21.15.44:0/158285367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f794015ad30 0x7f79400adc80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.626+0000 7f794601a640 1 -- 172.21.15.44:0/158285367 >> 172.21.15.44:0/158285367 conn(0x7f79400ce950 msgr2=0x7f79400ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.626+0000 7f794601a640 1 -- 172.21.15.44:0/158285367 shutdown_connections 2023-11-04T01:36:50.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.626+0000 7f794601a640 1 -- 172.21.15.44:0/158285367 wait complete. 2023-11-04T01:36:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.627+0000 7f794601a640 1 Processor -- start 2023-11-04T01:36:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.627+0000 7f794601a640 1 -- start start 2023-11-04T01:36:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.628+0000 7f794601a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7940070e20 0x7f7940155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.628+0000 7f794601a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79400ad730 0x7f7940156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.628+0000 7f794601a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f794015ad30 0x7f7940158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.628+0000 7f794601a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79400b2810 con 0x7f7940070e20 2023-11-04T01:36:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.628+0000 7f794601a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79400b1f50 con 0x7f794015ad30 2023-11-04T01:36:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.628+0000 7f794601a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79400b21c0 con 0x7f79400ad730 2023-11-04T01:36:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.628+0000 7f793f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7940070e20 0x7f7940155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.628+0000 7f793f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7940070e20 0x7f7940155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58976/0 (socket says 172.21.15.44:58976) 2023-11-04T01:36:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.628+0000 7f793f7fe640 1 -- 172.21.15.44:0/375253140 learned_addr learned my addr 172.21.15.44:0/375253140 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.628+0000 7f793effd640 1 --2- 172.21.15.44:0/375253140 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79400ad730 0x7f7940156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.628+0000 7f793ffff640 1 --2- 172.21.15.44:0/375253140 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f794015ad30 0x7f7940158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.629+0000 7f793f7fe640 1 -- 172.21.15.44:0/375253140 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79400ad730 msgr2=0x7f7940156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.629+0000 7f793f7fe640 1 --2- 172.21.15.44:0/375253140 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79400ad730 0x7f7940156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.629+0000 7f793f7fe640 1 -- 172.21.15.44:0/375253140 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f794015ad30 msgr2=0x7f7940158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.629+0000 7f793f7fe640 1 --2- 172.21.15.44:0/375253140 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f794015ad30 0x7f7940158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.629+0000 7f793f7fe640 1 -- 172.21.15.44:0/375253140 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79300094d0 con 0x7f7940070e20 2023-11-04T01:36:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.629+0000 7f793f7fe640 1 --2- 172.21.15.44:0/375253140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7940070e20 0x7f7940155940 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7930000c00 tx=0x7f79300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.629+0000 7f7927fff640 1 -- 172.21.15.44:0/375253140 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930032880 con 0x7f7940070e20 2023-11-04T01:36:50.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.629+0000 7f7927fff640 1 -- 172.21.15.44:0/375253140 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7930032a00 con 0x7f7940070e20 2023-11-04T01:36:50.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.629+0000 7f7927fff640 1 -- 172.21.15.44:0/375253140 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930032db0 con 0x7f7940070e20 2023-11-04T01:36:50.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.629+0000 7f794601a640 1 -- 172.21.15.44:0/375253140 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79400b24a0 con 0x7f7940070e20 2023-11-04T01:36:50.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.629+0000 7f794601a640 1 -- 172.21.15.44:0/375253140 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7940156880 con 0x7f7940070e20 2023-11-04T01:36:50.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.630+0000 7f794601a640 1 -- 172.21.15.44:0/375253140 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7940074290 con 0x7f7940070e20 2023-11-04T01:36:50.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.630+0000 7f7927fff640 1 -- 172.21.15.44:0/375253140 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f79300453f0 con 0x7f7940070e20 2023-11-04T01:36:50.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.631+0000 7f7927fff640 1 --2- 172.21.15.44:0/375253140 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f792c06ae70 0x7f792c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.631+0000 7f7927fff640 1 -- 172.21.15.44:0/375253140 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f79300abc80 con 0x7f7940070e20 2023-11-04T01:36:50.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.631+0000 7f793effd640 1 --2- 172.21.15.44:0/375253140 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f792c06ae70 0x7f792c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.632+0000 7f793effd640 1 --2- 172.21.15.44:0/375253140 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f792c06ae70 0x7f792c06d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f79401f41b0 tx=0x7f7934007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.635+0000 7f7927fff640 1 -- 172.21.15.44:0/375253140 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7930076ab0 con 0x7f7940070e20 2023-11-04T01:36:50.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.809+0000 7f794601a640 1 -- 172.21.15.44:0/375253140 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7940071970 con 0x7f7940070e20 2023-11-04T01:36:50.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.810+0000 7f7927fff640 1 -- 172.21.15.44:0/375253140 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f793007a0d0 con 0x7f7940070e20 2023-11-04T01:36:50.812 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.811+0000 7f794601a640 1 -- 172.21.15.44:0/375253140 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f792c06ae70 msgr2=0x7f792c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.811+0000 7f794601a640 1 --2- 172.21.15.44:0/375253140 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f792c06ae70 0x7f792c06d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f79401f41b0 tx=0x7f7934007e30 comp rx=0 tx=0).stop 2023-11-04T01:36:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.811+0000 7f794601a640 1 -- 172.21.15.44:0/375253140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7940070e20 msgr2=0x7f7940155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.811+0000 7f794601a640 1 --2- 172.21.15.44:0/375253140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7940070e20 0x7f7940155940 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7930000c00 tx=0x7f79300046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.811+0000 7f794601a640 1 -- 172.21.15.44:0/375253140 shutdown_connections 2023-11-04T01:36:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.811+0000 7f794601a640 1 --2- 172.21.15.44:0/375253140 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f792c06ae70 0x7f792c06d330 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.811+0000 7f794601a640 1 --2- 172.21.15.44:0/375253140 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f794015ad30 0x7f7940158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.811+0000 7f794601a640 1 --2- 172.21.15.44:0/375253140 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79400ad730 0x7f7940156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.811+0000 7f794601a640 1 --2- 172.21.15.44:0/375253140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7940070e20 0x7f7940155940 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.811+0000 7f794601a640 1 -- 172.21.15.44:0/375253140 >> 172.21.15.44:0/375253140 conn(0x7f79400ce950 msgr2=0x7f794015d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.812+0000 7f794601a640 1 -- 172.21.15.44:0/375253140 shutdown_connections 2023-11-04T01:36:50.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.812+0000 7f794601a640 1 -- 172.21.15.44:0/375253140 wait complete. 2023-11-04T01:36:50.825 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:50.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.931+0000 7f42869f5640 1 Processor -- start 2023-11-04T01:36:50.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.932+0000 7f42869f5640 1 -- start start 2023-11-04T01:36:50.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.932+0000 7f42869f5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f42800cd6d0 0x7f4280161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.932+0000 7f42869f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42800b4880 0x7f42800b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.932+0000 7f42869f5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42800cde60 con 0x7f4280153e60 2023-11-04T01:36:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.932+0000 7f42869f5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4280160f90 con 0x7f42800cd6d0 2023-11-04T01:36:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.932+0000 7f42869f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4280161960 con 0x7f42800b4880 2023-11-04T01:36:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.933+0000 7f4284f92640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42800b4880 0x7f42800b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.933+0000 7f4284f92640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42800b4880 0x7f42800b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:59552/0 (socket says 172.21.15.44:59552) 2023-11-04T01:36:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.933+0000 7f427f7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f42800cd6d0 0x7f4280161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.933+0000 7f4284f92640 1 -- 172.21.15.44:0/3935649386 learned_addr learned my addr 172.21.15.44:0/3935649386 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.933+0000 7f4284f92640 1 -- 172.21.15.44:0/3935649386 >> v2:172.21.15.204:3300/0 conn(0x7f42800cd6d0 msgr2=0x7f4280161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.933+0000 7f4284f92640 1 --2- 172.21.15.44:0/3935649386 >> v2:172.21.15.204:3300/0 conn(0x7f42800cd6d0 0x7f4280161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.933+0000 7f4284f92640 1 -- 172.21.15.44:0/3935649386 >> v1:172.21.15.204:6789/0 conn(0x7f4280153e60 legacy=0x7f428015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.933+0000 7f4284f92640 1 -- 172.21.15.44:0/3935649386 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800b5220 con 0x7f42800b4880 2023-11-04T01:36:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.934+0000 7f4284f92640 1 --2- 172.21.15.44:0/3935649386 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42800b4880 0x7f42800b4ce0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4278009e50 tx=0x7f427802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdee343c4b99e598 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.934+0000 7f427effd640 1 -- 172.21.15.44:0/3935649386 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427802cb00 con 0x7f42800b4880 2023-11-04T01:36:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.934+0000 7f427effd640 1 -- 172.21.15.44:0/3935649386 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427802cc60 con 0x7f42800b4880 2023-11-04T01:36:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.934+0000 7f427effd640 1 -- 172.21.15.44:0/3935649386 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780343f0 con 0x7f42800b4880 2023-11-04T01:36:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.935+0000 7f42869f5640 1 -- 172.21.15.44:0/3935649386 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42800b4880 msgr2=0x7f42800b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.935+0000 7f42869f5640 1 --2- 172.21.15.44:0/3935649386 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42800b4880 0x7f42800b4ce0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4278009e50 tx=0x7f427802bf60 comp rx=0 tx=0).stop 2023-11-04T01:36:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.935+0000 7f42869f5640 1 -- 172.21.15.44:0/3935649386 shutdown_connections 2023-11-04T01:36:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.935+0000 7f42869f5640 1 --2- 172.21.15.44:0/3935649386 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42800b4880 0x7f42800b4ce0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.935+0000 7f42869f5640 1 --2- 172.21.15.44:0/3935649386 >> v2:172.21.15.204:3300/0 conn(0x7f42800cd6d0 0x7f4280161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.935+0000 7f42869f5640 1 -- 172.21.15.44:0/3935649386 >> 172.21.15.44:0/3935649386 conn(0x7f42800cf880 msgr2=0x7f42800cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.935+0000 7f42869f5640 1 -- 172.21.15.44:0/3935649386 shutdown_connections 2023-11-04T01:36:50.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.935+0000 7f42869f5640 1 -- 172.21.15.44:0/3935649386 wait complete. 2023-11-04T01:36:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.936+0000 7f42869f5640 1 Processor -- start 2023-11-04T01:36:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.936+0000 7f42869f5640 1 -- start start 2023-11-04T01:36:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f42869f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42800b4880 0x7f42800caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f42869f5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42800cd6d0 0x7f42801f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f42869f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4280153e60 0x7f42801567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f42869f5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4280158980 con 0x7f42800b4880 2023-11-04T01:36:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f42869f5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4280158bf0 con 0x7f42800cd6d0 2023-11-04T01:36:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f42869f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4280158ed0 con 0x7f4280153e60 2023-11-04T01:36:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f427ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42800b4880 0x7f42800caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f427ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42800b4880 0x7f42800caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58984/0 (socket says 172.21.15.44:58984) 2023-11-04T01:36:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f427ffff640 1 -- 172.21.15.44:0/141685482 learned_addr learned my addr 172.21.15.44:0/141685482 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f4284f92640 1 --2- 172.21.15.44:0/141685482 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4280153e60 0x7f42801567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f427f7fe640 1 --2- 172.21.15.44:0/141685482 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42800cd6d0 0x7f42801f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f427ffff640 1 -- 172.21.15.44:0/141685482 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4280153e60 msgr2=0x7f42801567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f427ffff640 1 --2- 172.21.15.44:0/141685482 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4280153e60 0x7f42801567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f427ffff640 1 -- 172.21.15.44:0/141685482 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42800cd6d0 msgr2=0x7f42801f6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f427ffff640 1 --2- 172.21.15.44:0/141685482 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42800cd6d0 0x7f42801f6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f427ffff640 1 -- 172.21.15.44:0/141685482 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278009b30 con 0x7f42800b4880 2023-11-04T01:36:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f427ffff640 1 --2- 172.21.15.44:0/141685482 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42800b4880 0x7f42800caf20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f427000c400 tx=0x7f427000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.937+0000 7f427cff9640 1 -- 172.21.15.44:0/141685482 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700052d0 con 0x7f42800b4880 2023-11-04T01:36:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.938+0000 7f427cff9640 1 -- 172.21.15.44:0/141685482 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4270005430 con 0x7f42800b4880 2023-11-04T01:36:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.938+0000 7f42869f5640 1 -- 172.21.15.44:0/141685482 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42801591b0 con 0x7f42800b4880 2023-11-04T01:36:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.938+0000 7f427cff9640 1 -- 172.21.15.44:0/141685482 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270003830 con 0x7f42800b4880 2023-11-04T01:36:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.938+0000 7f42869f5640 1 -- 172.21.15.44:0/141685482 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42800cb460 con 0x7f42800b4880 2023-11-04T01:36:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.938+0000 7f42869f5640 1 -- 172.21.15.44:0/141685482 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42801593a0 con 0x7f42800b4880 2023-11-04T01:36:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.939+0000 7f427cff9640 1 -- 172.21.15.44:0/141685482 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4270003990 con 0x7f42800b4880 2023-11-04T01:36:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.939+0000 7f427cff9640 1 --2- 172.21.15.44:0/141685482 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f426c06ae70 0x7f426c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.939+0000 7f427cff9640 1 -- 172.21.15.44:0/141685482 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4270088f20 con 0x7f42800b4880 2023-11-04T01:36:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.940+0000 7f427f7fe640 1 --2- 172.21.15.44:0/141685482 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f426c06ae70 0x7f426c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.940+0000 7f427f7fe640 1 --2- 172.21.15.44:0/141685482 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f426c06ae70 0x7f426c06d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f42800cd230 tx=0x7f4274009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:50.943+0000 7f427cff9640 1 -- 172.21.15.44:0/141685482 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4270053c40 con 0x7f42800b4880 2023-11-04T01:36:51.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.122+0000 7f42869f5640 1 -- 172.21.15.44:0/141685482 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4280074290 con 0x7f42800b4880 2023-11-04T01:36:51.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.122+0000 7f427cff9640 1 -- 172.21.15.44:0/141685482 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4270057260 con 0x7f42800b4880 2023-11-04T01:36:51.125 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:36:51.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.124+0000 7f42869f5640 1 -- 172.21.15.44:0/141685482 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f426c06ae70 msgr2=0x7f426c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.124+0000 7f42869f5640 1 --2- 172.21.15.44:0/141685482 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f426c06ae70 0x7f426c06d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f42800cd230 tx=0x7f4274009190 comp rx=0 tx=0).stop 2023-11-04T01:36:51.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.124+0000 7f42869f5640 1 -- 172.21.15.44:0/141685482 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42800b4880 msgr2=0x7f42800caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.124+0000 7f42869f5640 1 --2- 172.21.15.44:0/141685482 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42800b4880 0x7f42800caf20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f427000c400 tx=0x7f427000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.124+0000 7f42869f5640 1 -- 172.21.15.44:0/141685482 shutdown_connections 2023-11-04T01:36:51.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.124+0000 7f42869f5640 1 --2- 172.21.15.44:0/141685482 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f426c06ae70 0x7f426c06d330 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.124+0000 7f42869f5640 1 --2- 172.21.15.44:0/141685482 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4280153e60 0x7f42801567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.124+0000 7f42869f5640 1 --2- 172.21.15.44:0/141685482 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42800cd6d0 0x7f42801f6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.124+0000 7f42869f5640 1 --2- 172.21.15.44:0/141685482 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42800b4880 0x7f42800caf20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.124+0000 7f42869f5640 1 -- 172.21.15.44:0/141685482 >> 172.21.15.44:0/141685482 conn(0x7f42800cf880 msgr2=0x7f428015fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:51.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.124+0000 7f42869f5640 1 -- 172.21.15.44:0/141685482 shutdown_connections 2023-11-04T01:36:51.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.124+0000 7f42869f5640 1 -- 172.21.15.44:0/141685482 wait complete. 2023-11-04T01:36:51.137 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:51.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.245+0000 7f01f5dd7640 1 Processor -- start 2023-11-04T01:36:51.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.245+0000 7f01f5dd7640 1 -- start start 2023-11-04T01:36:51.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.246+0000 7f01f5dd7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f01f0153e60 0x7f01f015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.246+0000 7f01f5dd7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f00cde60 con 0x7f01f00b4880 2023-11-04T01:36:51.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.246+0000 7f01f5dd7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f0160f90 con 0x7f01f00cd6d0 2023-11-04T01:36:51.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.246+0000 7f01f5dd7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f015e400 con 0x7f01f0153e60 2023-11-04T01:36:51.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.246+0000 7f01ef7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f01f0153e60 0x7f01f015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.246+0000 7f01effff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f01f00b4880 0x7f01f00d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42070/0 (socket says 172.21.15.44:42070) 2023-11-04T01:36:51.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.246+0000 7f01effff640 1 -- 172.21.15.44:0/1943085725 learned_addr learned my addr 172.21.15.44:0/1943085725 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:51.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.246+0000 7f01ef7fe640 1 -- 172.21.15.44:0/1943085725 >> v1:172.21.15.204:6789/0 conn(0x7f01f00cd6d0 legacy=0x7f01f0161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:51.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.246+0000 7f01ef7fe640 1 -- 172.21.15.44:0/1943085725 >> v1:172.21.15.44:6789/0 conn(0x7f01f00b4880 legacy=0x7f01f00d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.247+0000 7f01ef7fe640 1 -- 172.21.15.44:0/1943085725 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f00ce090 con 0x7f01f0153e60 2023-11-04T01:36:51.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.247+0000 7f01ee7fc640 1 -- 172.21.15.44:0/1943085725 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875122868 0 0) 0x7f01f00cde60 con 0x7f01f00b4880 2023-11-04T01:36:51.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.247+0000 7f01ef7fe640 1 --2- 172.21.15.44:0/1943085725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f0153e60 0x7f01f015dec0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01d80097a0 tx=0x7f01d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7a32e56f5fecb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.247+0000 7f01ee7fc640 1 -- 172.21.15.44:0/1943085725 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8031830 con 0x7f01f0153e60 2023-11-04T01:36:51.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.247+0000 7f01ee7fc640 1 -- 172.21.15.44:0/1943085725 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d8031990 con 0x7f01f0153e60 2023-11-04T01:36:51.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.247+0000 7f01ee7fc640 1 -- 172.21.15.44:0/1943085725 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8031d20 con 0x7f01f0153e60 2023-11-04T01:36:51.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.248+0000 7f01f5dd7640 1 -- 172.21.15.44:0/1943085725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f0153e60 msgr2=0x7f01f015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.248+0000 7f01f5dd7640 1 --2- 172.21.15.44:0/1943085725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f0153e60 0x7f01f015dec0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01d80097a0 tx=0x7f01d802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.248+0000 7f01f5dd7640 1 -- 172.21.15.44:0/1943085725 shutdown_connections 2023-11-04T01:36:51.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.248+0000 7f01f5dd7640 1 --2- 172.21.15.44:0/1943085725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f0153e60 0x7f01f015dec0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.248+0000 7f01f5dd7640 1 -- 172.21.15.44:0/1943085725 >> 172.21.15.44:0/1943085725 conn(0x7f01f00cf880 msgr2=0x7f01f00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:51.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.248+0000 7f01f5dd7640 1 -- 172.21.15.44:0/1943085725 shutdown_connections 2023-11-04T01:36:51.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.248+0000 7f01f5dd7640 1 -- 172.21.15.44:0/1943085725 wait complete. 2023-11-04T01:36:51.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.249+0000 7f01f5dd7640 1 Processor -- start 2023-11-04T01:36:51.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.249+0000 7f01f5dd7640 1 -- start start 2023-11-04T01:36:51.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.250+0000 7f01f5dd7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f00b4880 0x7f01f01f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.250+0000 7f01f5dd7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01f00cd6d0 0x7f01f00cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.250+0000 7f01f5dd7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01f0153e60 0x7f01f01f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.250+0000 7f01f5dd7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f00cc220 con 0x7f01f00b4880 2023-11-04T01:36:51.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.250+0000 7f01f5dd7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f01570d0 con 0x7f01f00cd6d0 2023-11-04T01:36:51.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.250+0000 7f01f5dd7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f00c6aa0 con 0x7f01f0153e60 2023-11-04T01:36:51.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.250+0000 7f01ef7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f00b4880 0x7f01f01f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.250+0000 7f01ef7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f00b4880 0x7f01f01f3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59000/0 (socket says 172.21.15.44:59000) 2023-11-04T01:36:51.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.250+0000 7f01ef7fe640 1 -- 172.21.15.44:0/3678038665 learned_addr learned my addr 172.21.15.44:0/3678038665 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:51.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.251+0000 7f01effff640 1 --2- 172.21.15.44:0/3678038665 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01f0153e60 0x7f01f01f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.251+0000 7f01ef7fe640 1 -- 172.21.15.44:0/3678038665 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01f0153e60 msgr2=0x7f01f01f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.251+0000 7f01ef7fe640 1 --2- 172.21.15.44:0/3678038665 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01f0153e60 0x7f01f01f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.251+0000 7f01ef7fe640 1 -- 172.21.15.44:0/3678038665 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01f00cd6d0 msgr2=0x7f01f00cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.251+0000 7f01ef7fe640 1 --2- 172.21.15.44:0/3678038665 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01f00cd6d0 0x7f01f00cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.251+0000 7f01ef7fe640 1 -- 172.21.15.44:0/3678038665 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d8009400 con 0x7f01f00b4880 2023-11-04T01:36:51.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.251+0000 7f01effff640 1 --2- 172.21.15.44:0/3678038665 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01f0153e60 0x7f01f01f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:51.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.251+0000 7f01ef7fe640 1 --2- 172.21.15.44:0/3678038665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f00b4880 0x7f01f01f3c70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f01d8000c00 tx=0x7f01d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.251+0000 7f01e7fff640 1 -- 172.21.15.44:0/3678038665 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d803aa60 con 0x7f01f00b4880 2023-11-04T01:36:51.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.251+0000 7f01e7fff640 1 -- 172.21.15.44:0/3678038665 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d803abc0 con 0x7f01f00b4880 2023-11-04T01:36:51.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.251+0000 7f01f5dd7640 1 -- 172.21.15.44:0/3678038665 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f00c6d80 con 0x7f01f00b4880 2023-11-04T01:36:51.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.251+0000 7f01e7fff640 1 -- 172.21.15.44:0/3678038665 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d80443f0 con 0x7f01f00b4880 2023-11-04T01:36:51.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.251+0000 7f01f5dd7640 1 -- 172.21.15.44:0/3678038665 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f00c7340 con 0x7f01f00b4880 2023-11-04T01:36:51.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.252+0000 7f01f5dd7640 1 -- 172.21.15.44:0/3678038665 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f00c7530 con 0x7f01f00b4880 2023-11-04T01:36:51.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.252+0000 7f01e7fff640 1 -- 172.21.15.44:0/3678038665 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f01d804d450 con 0x7f01f00b4880 2023-11-04T01:36:51.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.253+0000 7f01e7fff640 1 --2- 172.21.15.44:0/3678038665 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f01d006ae70 0x7f01d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.253+0000 7f01e7fff640 1 -- 172.21.15.44:0/3678038665 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f01d80abbe0 con 0x7f01f00b4880 2023-11-04T01:36:51.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.253+0000 7f01eeffd640 1 --2- 172.21.15.44:0/3678038665 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f01d006ae70 0x7f01d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.254+0000 7f01eeffd640 1 --2- 172.21.15.44:0/3678038665 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f01d006ae70 0x7f01d006d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f01f00b8810 tx=0x7f01e00079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.257+0000 7f01e7fff640 1 -- 172.21.15.44:0/3678038665 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f01d80768d0 con 0x7f01f00b4880 2023-11-04T01:36:51.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.433+0000 7f01f5dd7640 1 -- 172.21.15.44:0/3678038665 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f01f0074290 con 0x7f01f00b4880 2023-11-04T01:36:51.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.433+0000 7f01e7fff640 1 -- 172.21.15.44:0/3678038665 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f01d80ab070 con 0x7f01f00b4880 2023-11-04T01:36:51.436 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:51.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.435+0000 7f01f5dd7640 1 -- 172.21.15.44:0/3678038665 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f01d006ae70 msgr2=0x7f01d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.435+0000 7f01f5dd7640 1 --2- 172.21.15.44:0/3678038665 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f01d006ae70 0x7f01d006d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f01f00b8810 tx=0x7f01e00079b0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.435+0000 7f01f5dd7640 1 -- 172.21.15.44:0/3678038665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f00b4880 msgr2=0x7f01f01f3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.435+0000 7f01f5dd7640 1 --2- 172.21.15.44:0/3678038665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f00b4880 0x7f01f01f3c70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f01d8000c00 tx=0x7f01d80046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.435+0000 7f01f5dd7640 1 -- 172.21.15.44:0/3678038665 shutdown_connections 2023-11-04T01:36:51.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.435+0000 7f01f5dd7640 1 --2- 172.21.15.44:0/3678038665 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f01d006ae70 0x7f01d006d330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.435+0000 7f01f5dd7640 1 --2- 172.21.15.44:0/3678038665 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01f0153e60 0x7f01f01f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.435+0000 7f01f5dd7640 1 --2- 172.21.15.44:0/3678038665 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01f00cd6d0 0x7f01f00cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.435+0000 7f01f5dd7640 1 --2- 172.21.15.44:0/3678038665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f00b4880 0x7f01f01f3c70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.435+0000 7f01f5dd7640 1 -- 172.21.15.44:0/3678038665 >> 172.21.15.44:0/3678038665 conn(0x7f01f00cf880 msgr2=0x7f01f00d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:51.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.435+0000 7f01f5dd7640 1 -- 172.21.15.44:0/3678038665 shutdown_connections 2023-11-04T01:36:51.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.435+0000 7f01f5dd7640 1 -- 172.21.15.44:0/3678038665 wait complete. 2023-11-04T01:36:51.448 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:51.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.553+0000 7f7c3471d640 1 Processor -- start 2023-11-04T01:36:51.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.553+0000 7f7c3471d640 1 -- start start 2023-11-04T01:36:51.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.554+0000 7f7c3471d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c2c0cdb20 0x7f7c2c0cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.554+0000 7f7c3471d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c0ce4c0 con 0x7f7c2c0b6150 2023-11-04T01:36:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.554+0000 7f7c3471d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c0b5230 con 0x7f7c2c15d060 2023-11-04T01:36:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.554+0000 7f7c3471d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c15d440 con 0x7f7c2c0cdb20 2023-11-04T01:36:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.554+0000 7f7c32cba640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7c2c0b6150 0x7f7c2c0b65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42080/0 (socket says 172.21.15.44:42080) 2023-11-04T01:36:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.554+0000 7f7c32cba640 1 -- 172.21.15.44:0/3492448360 learned_addr learned my addr 172.21.15.44:0/3492448360 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.554+0000 7f7c31cb8640 1 --2- 172.21.15.44:0/3492448360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c2c0cdb20 0x7f7c2c0cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c314b7640 1 -- 172.21.15.44:0/3492448360 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609410 0 0) 0x7f7c2c0ce4c0 con 0x7f7c2c0b6150 2023-11-04T01:36:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c314b7640 1 -- 172.21.15.44:0/3492448360 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c18003520 con 0x7f7c2c0b6150 2023-11-04T01:36:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c314b7640 1 -- 172.21.15.44:0/3492448360 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 186418329 0 0) 0x7f7c18003520 con 0x7f7c2c0b6150 2023-11-04T01:36:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c314b7640 1 -- 172.21.15.44:0/3492448360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c2c0cdb20 msgr2=0x7f7c2c0cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c314b7640 1 --2- 172.21.15.44:0/3492448360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c2c0cdb20 0x7f7c2c0cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c314b7640 1 -- 172.21.15.44:0/3492448360 >> v1:172.21.15.204:6789/0 conn(0x7f7c2c15d060 legacy=0x7f7c2c0b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c314b7640 1 -- 172.21.15.44:0/3492448360 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c0d1930 con 0x7f7c2c0b6150 2023-11-04T01:36:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c314b7640 1 -- 172.21.15.44:0/3492448360 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f7c280019f0 con 0x7f7c2c0b6150 2023-11-04T01:36:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c314b7640 1 -- 172.21.15.44:0/3492448360 >> v1:172.21.15.44:6789/0 conn(0x7f7c2c0b6150 legacy=0x7f7c2c0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c314b7640 1 --2- 172.21.15.44:0/3492448360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c180039a0 0x7f7c18003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c314b7640 1 --2- 172.21.15.44:0/3492448360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c180047c0 0x7f7c18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c314b7640 1 --2- 172.21.15.44:0/3492448360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c2c0cdb20 0x7f7c18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c314b7640 1 -- 172.21.15.44:0/3492448360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c15d440 con 0x7f7c180039a0 2023-11-04T01:36:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c314b7640 1 -- 172.21.15.44:0/3492448360 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1800ba30 con 0x7f7c180047c0 2023-11-04T01:36:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c314b7640 1 -- 172.21.15.44:0/3492448360 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1800bbf0 con 0x7f7c2c0cdb20 2023-11-04T01:36:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c324b9640 1 --2- 172.21.15.44:0/3492448360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c180039a0 0x7f7c18003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c31cb8640 1 --2- 172.21.15.44:0/3492448360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c180047c0 0x7f7c18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c32cba640 1 --2- 172.21.15.44:0/3492448360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c2c0cdb20 0x7f7c18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c324b9640 1 -- 172.21.15.44:0/3492448360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c2c0cdb20 msgr2=0x7f7c18005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:51.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c324b9640 1 --2- 172.21.15.44:0/3492448360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c2c0cdb20 0x7f7c18005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c324b9640 1 -- 172.21.15.44:0/3492448360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c180047c0 msgr2=0x7f7c18004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:51.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c324b9640 1 --2- 172.21.15.44:0/3492448360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c180047c0 0x7f7c18004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.555+0000 7f7c324b9640 1 -- 172.21.15.44:0/3492448360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c18003520 con 0x7f7c180039a0 2023-11-04T01:36:51.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.556+0000 7f7c324b9640 1 --2- 172.21.15.44:0/3492448360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c180039a0 0x7f7c18003dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7c24001580 tx=0x7f7c180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0d69e34313797f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.556+0000 7f7c314b7640 1 -- 172.21.15.44:0/3492448360 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240052d0 con 0x7f7c180039a0 2023-11-04T01:36:51.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.556+0000 7f7c314b7640 1 -- 172.21.15.44:0/3492448360 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2402e050 con 0x7f7c180039a0 2023-11-04T01:36:51.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.556+0000 7f7c314b7640 1 -- 172.21.15.44:0/3492448360 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240035f0 con 0x7f7c180039a0 2023-11-04T01:36:51.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.557+0000 7f7c3471d640 1 -- 172.21.15.44:0/3492448360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c180039a0 msgr2=0x7f7c18003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.557+0000 7f7c3471d640 1 --2- 172.21.15.44:0/3492448360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c180039a0 0x7f7c18003dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7c24001580 tx=0x7f7c180057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.557+0000 7f7c32cba640 1 -- 172.21.15.44:0/3492448360 reap_dead start 2023-11-04T01:36:51.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.557+0000 7f7c3471d640 1 -- 172.21.15.44:0/3492448360 shutdown_connections 2023-11-04T01:36:51.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.557+0000 7f7c3471d640 1 -- 172.21.15.44:0/3492448360 >> 172.21.15.44:0/3492448360 conn(0x7f7c2c0cf760 msgr2=0x7f7c2c0cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:51.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.557+0000 7f7c3471d640 1 -- 172.21.15.44:0/3492448360 shutdown_connections 2023-11-04T01:36:51.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.557+0000 7f7c3471d640 1 -- 172.21.15.44:0/3492448360 wait complete. 2023-11-04T01:36:51.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.558+0000 7f7c3471d640 1 Processor -- start 2023-11-04T01:36:51.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.558+0000 7f7c3471d640 1 -- start start 2023-11-04T01:36:51.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c3471d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c180039a0 0x7f7c2c1543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c3471d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c2c0c9560 0x7f7c2c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c3471d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c2c1563a0 0x7f7c2c156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c3471d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0c6400 con 0x7f7c2c1563a0 2023-11-04T01:36:51.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c3471d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c156d90 con 0x7f7c180039a0 2023-11-04T01:36:51.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c3471d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0c99e0 con 0x7f7c2c0c9560 2023-11-04T01:36:51.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c32cba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c2c1563a0 0x7f7c2c156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c32cba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c2c1563a0 0x7f7c2c156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59016/0 (socket says 172.21.15.44:59016) 2023-11-04T01:36:51.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c32cba640 1 -- 172.21.15.44:0/515506732 learned_addr learned my addr 172.21.15.44:0/515506732 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:51.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c31cb8640 1 --2- 172.21.15.44:0/515506732 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c2c0c9560 0x7f7c2c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c324b9640 1 --2- 172.21.15.44:0/515506732 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c180039a0 0x7f7c2c1543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c32cba640 1 -- 172.21.15.44:0/515506732 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c2c0c9560 msgr2=0x7f7c2c152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c32cba640 1 --2- 172.21.15.44:0/515506732 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c2c0c9560 0x7f7c2c152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c32cba640 1 -- 172.21.15.44:0/515506732 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c180039a0 msgr2=0x7f7c2c1543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c32cba640 1 --2- 172.21.15.44:0/515506732 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c180039a0 0x7f7c2c1543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c32cba640 1 -- 172.21.15.44:0/515506732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c154aa0 con 0x7f7c2c1563a0 2023-11-04T01:36:51.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c324b9640 1 --2- 172.21.15.44:0/515506732 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c180039a0 0x7f7c2c1543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:51.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.559+0000 7f7c32cba640 1 --2- 172.21.15.44:0/515506732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c2c1563a0 0x7f7c2c156850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0cebd0 tx=0x7f7c2800a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.560+0000 7f7c22ffd640 1 -- 172.21.15.44:0/515506732 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800ace0 con 0x7f7c2c1563a0 2023-11-04T01:36:51.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.560+0000 7f7c22ffd640 1 -- 172.21.15.44:0/515506732 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2800ae60 con 0x7f7c2c1563a0 2023-11-04T01:36:51.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.560+0000 7f7c3471d640 1 -- 172.21.15.44:0/515506732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c154d80 con 0x7f7c2c1563a0 2023-11-04T01:36:51.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.560+0000 7f7c22ffd640 1 -- 172.21.15.44:0/515506732 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28013630 con 0x7f7c2c1563a0 2023-11-04T01:36:51.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.560+0000 7f7c3471d640 1 -- 172.21.15.44:0/515506732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c0c69a0 con 0x7f7c2c1563a0 2023-11-04T01:36:51.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.561+0000 7f7c3471d640 1 -- 172.21.15.44:0/515506732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c154f70 con 0x7f7c2c1563a0 2023-11-04T01:36:51.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.561+0000 7f7c22ffd640 1 -- 172.21.15.44:0/515506732 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c28013790 con 0x7f7c2c1563a0 2023-11-04T01:36:51.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.561+0000 7f7c22ffd640 1 --2- 172.21.15.44:0/515506732 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c1006aea0 0x7f7c1006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.561+0000 7f7c22ffd640 1 -- 172.21.15.44:0/515506732 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7c2808a130 con 0x7f7c2c1563a0 2023-11-04T01:36:51.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.562+0000 7f7c324b9640 1 --2- 172.21.15.44:0/515506732 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c1006aea0 0x7f7c1006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.562+0000 7f7c324b9640 1 --2- 172.21.15.44:0/515506732 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c1006aea0 0x7f7c1006d360 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7c24033000 tx=0x7f7c24009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.566+0000 7f7c22ffd640 1 -- 172.21.15.44:0/515506732 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c28054ee0 con 0x7f7c2c1563a0 2023-11-04T01:36:51.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.753+0000 7f7c3471d640 1 -- 172.21.15.44:0/515506732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7c2c074290 con 0x7f7c2c1563a0 2023-11-04T01:36:51.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.753+0000 7f7c22ffd640 1 -- 172.21.15.44:0/515506732 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7c28058500 con 0x7f7c2c1563a0 2023-11-04T01:36:51.755 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2023-11-04T01:36:51.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.755+0000 7f7c3471d640 1 -- 172.21.15.44:0/515506732 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c1006aea0 msgr2=0x7f7c1006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.755+0000 7f7c3471d640 1 --2- 172.21.15.44:0/515506732 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c1006aea0 0x7f7c1006d360 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7c24033000 tx=0x7f7c24009030 comp rx=0 tx=0).stop 2023-11-04T01:36:51.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.755+0000 7f7c3471d640 1 -- 172.21.15.44:0/515506732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c2c1563a0 msgr2=0x7f7c2c156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.755+0000 7f7c3471d640 1 --2- 172.21.15.44:0/515506732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c2c1563a0 0x7f7c2c156850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0cebd0 tx=0x7f7c2800a6e0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.755+0000 7f7c3471d640 1 -- 172.21.15.44:0/515506732 shutdown_connections 2023-11-04T01:36:51.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.755+0000 7f7c3471d640 1 --2- 172.21.15.44:0/515506732 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c1006aea0 0x7f7c1006d360 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.755+0000 7f7c3471d640 1 --2- 172.21.15.44:0/515506732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c2c1563a0 0x7f7c2c156850 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.755+0000 7f7c3471d640 1 --2- 172.21.15.44:0/515506732 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c2c0c9560 0x7f7c2c152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.755+0000 7f7c3471d640 1 --2- 172.21.15.44:0/515506732 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c180039a0 0x7f7c2c1543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.755+0000 7f7c3471d640 1 -- 172.21.15.44:0/515506732 >> 172.21.15.44:0/515506732 conn(0x7f7c2c0cf760 msgr2=0x7f7c2c0caaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:51.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.755+0000 7f7c3471d640 1 -- 172.21.15.44:0/515506732 shutdown_connections 2023-11-04T01:36:51.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.755+0000 7f7c3471d640 1 -- 172.21.15.44:0/515506732 wait complete. 2023-11-04T01:36:51.768 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:36:51.768 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:51.784 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:51.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.928+0000 7f293da21640 1 Processor -- start 2023-11-04T01:36:51.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.928+0000 7f293da21640 1 -- start start 2023-11-04T01:36:51.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.929+0000 7f293da21640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2938160b10 0x7f2938160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.929+0000 7f293da21640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293806bf00 con 0x7f293815ce60 2023-11-04T01:36:51.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.929+0000 7f293da21640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29381615d0 con 0x7f29380cf160 2023-11-04T01:36:51.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.929+0000 7f293da21640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29380cbde0 con 0x7f2938160b10 2023-11-04T01:36:51.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.929+0000 7f2936ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f293815ce60 0x7f293806b7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42088/0 (socket says 172.21.15.44:42088) 2023-11-04T01:36:51.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.929+0000 7f2936ffd640 1 -- 172.21.15.44:0/206490165 learned_addr learned my addr 172.21.15.44:0/206490165 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:51.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.929+0000 7f292ffff640 1 --2- 172.21.15.44:0/206490165 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2938160b10 0x7f2938160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.929+0000 7f29367fc640 1 -- 172.21.15.44:0/206490165 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365219651 0 0) 0x7f293806bf00 con 0x7f293815ce60 2023-11-04T01:36:51.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.929+0000 7f29367fc640 1 -- 172.21.15.44:0/206490165 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2924003520 con 0x7f293815ce60 2023-11-04T01:36:51.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.929+0000 7f29367fc640 1 -- 172.21.15.44:0/206490165 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875020427 0 0) 0x7f29381615d0 con 0x7f29380cf160 2023-11-04T01:36:51.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.929+0000 7f292ffff640 1 -- 172.21.15.44:0/206490165 >> v1:172.21.15.204:6789/0 conn(0x7f29380cf160 legacy=0x7f29380cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.929+0000 7f292ffff640 1 -- 172.21.15.44:0/206490165 >> v1:172.21.15.44:6789/0 conn(0x7f293815ce60 legacy=0x7f293806b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.929+0000 7f292ffff640 1 -- 172.21.15.44:0/206490165 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29381618b0 con 0x7f2938160b10 2023-11-04T01:36:51.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.930+0000 7f292ffff640 1 --2- 172.21.15.44:0/206490165 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2938160b10 0x7f2938160f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f29200097d0 tx=0x7f292002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dab16ebc02fd4b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.930+0000 7f29367fc640 1 -- 172.21.15.44:0/206490165 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920031890 con 0x7f2938160b10 2023-11-04T01:36:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.931+0000 7f29367fc640 1 -- 172.21.15.44:0/206490165 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29200319f0 con 0x7f2938160b10 2023-11-04T01:36:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.931+0000 7f29367fc640 1 -- 172.21.15.44:0/206490165 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920031d80 con 0x7f2938160b10 2023-11-04T01:36:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.931+0000 7f293da21640 1 -- 172.21.15.44:0/206490165 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2938160b10 msgr2=0x7f2938160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.931+0000 7f293da21640 1 --2- 172.21.15.44:0/206490165 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2938160b10 0x7f2938160f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f29200097d0 tx=0x7f292002b930 comp rx=0 tx=0).stop 2023-11-04T01:36:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.931+0000 7f293da21640 1 -- 172.21.15.44:0/206490165 shutdown_connections 2023-11-04T01:36:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.931+0000 7f293da21640 1 --2- 172.21.15.44:0/206490165 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2938160b10 0x7f2938160f90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.931+0000 7f293da21640 1 -- 172.21.15.44:0/206490165 >> 172.21.15.44:0/206490165 conn(0x7f293806ea90 msgr2=0x7f293806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.931+0000 7f293da21640 1 -- 172.21.15.44:0/206490165 shutdown_connections 2023-11-04T01:36:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.931+0000 7f293da21640 1 -- 172.21.15.44:0/206490165 wait complete. 2023-11-04T01:36:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.932+0000 7f293da21640 1 Processor -- start 2023-11-04T01:36:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.932+0000 7f293da21640 1 -- start start 2023-11-04T01:36:51.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.933+0000 7f293da21640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29380cf160 0x7f2938151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.933+0000 7f293da21640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f293815ce60 0x7f29380ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.933+0000 7f293da21640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2938160b10 0x7f29380b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.933+0000 7f293da21640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2938151680 con 0x7f2938160b10 2023-11-04T01:36:51.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.933+0000 7f293da21640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2938152540 con 0x7f293815ce60 2023-11-04T01:36:51.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.933+0000 7f293da21640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29380c8bf0 con 0x7f29380cf160 2023-11-04T01:36:51.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.933+0000 7f29377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2938160b10 0x7f29380b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.933+0000 7f29377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2938160b10 0x7f29380b56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59032/0 (socket says 172.21.15.44:59032) 2023-11-04T01:36:51.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.933+0000 7f29377fe640 1 -- 172.21.15.44:0/2311671802 learned_addr learned my addr 172.21.15.44:0/2311671802 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:51.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.933+0000 7f2936ffd640 1 --2- 172.21.15.44:0/2311671802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29380cf160 0x7f2938151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.933+0000 7f292ffff640 1 --2- 172.21.15.44:0/2311671802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f293815ce60 0x7f29380ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.934+0000 7f29377fe640 1 -- 172.21.15.44:0/2311671802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29380cf160 msgr2=0x7f2938151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.934+0000 7f29377fe640 1 --2- 172.21.15.44:0/2311671802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29380cf160 0x7f2938151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.934+0000 7f29377fe640 1 -- 172.21.15.44:0/2311671802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f293815ce60 msgr2=0x7f29380ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.934+0000 7f29377fe640 1 --2- 172.21.15.44:0/2311671802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f293815ce60 0x7f29380ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.934+0000 7f29377fe640 1 -- 172.21.15.44:0/2311671802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2920009400 con 0x7f2938160b10 2023-11-04T01:36:51.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.934+0000 7f29377fe640 1 --2- 172.21.15.44:0/2311671802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2938160b10 0x7f29380b56b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f293000c740 tx=0x7f293000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.934+0000 7f2934ff9640 1 -- 172.21.15.44:0/2311671802 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2930003da0 con 0x7f2938160b10 2023-11-04T01:36:51.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.934+0000 7f2934ff9640 1 -- 172.21.15.44:0/2311671802 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293000ce50 con 0x7f2938160b10 2023-11-04T01:36:51.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.934+0000 7f293da21640 1 -- 172.21.15.44:0/2311671802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29380c8ed0 con 0x7f2938160b10 2023-11-04T01:36:51.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.934+0000 7f2934ff9640 1 -- 172.21.15.44:0/2311671802 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2930005290 con 0x7f2938160b10 2023-11-04T01:36:51.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.934+0000 7f293da21640 1 -- 172.21.15.44:0/2311671802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29380c9490 con 0x7f2938160b10 2023-11-04T01:36:51.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.935+0000 7f293da21640 1 -- 172.21.15.44:0/2311671802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29381526d0 con 0x7f2938160b10 2023-11-04T01:36:51.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.935+0000 7f2934ff9640 1 -- 172.21.15.44:0/2311671802 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f29300053f0 con 0x7f2938160b10 2023-11-04T01:36:51.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.936+0000 7f2934ff9640 1 --2- 172.21.15.44:0/2311671802 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f291806ae70 0x7f291806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.936+0000 7f2934ff9640 1 -- 172.21.15.44:0/2311671802 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2930089270 con 0x7f2938160b10 2023-11-04T01:36:51.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.936+0000 7f2936ffd640 1 --2- 172.21.15.44:0/2311671802 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f291806ae70 0x7f291806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.937+0000 7f2936ffd640 1 --2- 172.21.15.44:0/2311671802 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f291806ae70 0x7f291806d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2928005880 tx=0x7f2928009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:51.940+0000 7f2934ff9640 1 -- 172.21.15.44:0/2311671802 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2930053ef0 con 0x7f2938160b10 2023-11-04T01:36:52.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.117+0000 7f293da21640 1 -- 172.21.15.44:0/2311671802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2938074290 con 0x7f2938160b10 2023-11-04T01:36:52.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.118+0000 7f2934ff9640 1 -- 172.21.15.44:0/2311671802 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7f2930057510 con 0x7f2938160b10 2023-11-04T01:36:52.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:52.121 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:52.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.120+0000 7f293da21640 1 -- 172.21.15.44:0/2311671802 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f291806ae70 msgr2=0x7f291806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.120+0000 7f293da21640 1 --2- 172.21.15.44:0/2311671802 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f291806ae70 0x7f291806d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2928005880 tx=0x7f2928009040 comp rx=0 tx=0).stop 2023-11-04T01:36:52.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.120+0000 7f293da21640 1 -- 172.21.15.44:0/2311671802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2938160b10 msgr2=0x7f29380b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.120+0000 7f293da21640 1 --2- 172.21.15.44:0/2311671802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2938160b10 0x7f29380b56b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f293000c740 tx=0x7f293000cc00 comp rx=0 tx=0).stop 2023-11-04T01:36:52.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.120+0000 7f293da21640 1 -- 172.21.15.44:0/2311671802 shutdown_connections 2023-11-04T01:36:52.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.120+0000 7f293da21640 1 --2- 172.21.15.44:0/2311671802 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f291806ae70 0x7f291806d330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.120+0000 7f293da21640 1 --2- 172.21.15.44:0/2311671802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2938160b10 0x7f29380b56b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.120+0000 7f293da21640 1 --2- 172.21.15.44:0/2311671802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f293815ce60 0x7f29380ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.120+0000 7f293da21640 1 --2- 172.21.15.44:0/2311671802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29380cf160 0x7f2938151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.120+0000 7f293da21640 1 -- 172.21.15.44:0/2311671802 >> 172.21.15.44:0/2311671802 conn(0x7f293806ea90 msgr2=0x7f293806b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.120+0000 7f293da21640 1 -- 172.21.15.44:0/2311671802 shutdown_connections 2023-11-04T01:36:52.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.120+0000 7f293da21640 1 -- 172.21.15.44:0/2311671802 wait complete. 2023-11-04T01:36:52.133 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:52.134 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:52.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.241+0000 7f15abe44640 1 Processor -- start 2023-11-04T01:36:52.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.241+0000 7f15abe44640 1 -- start start 2023-11-04T01:36:52.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.242+0000 7f15abe44640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a4153e60 0x7f15a415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.242+0000 7f15abe44640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a40cde60 con 0x7f15a40cd6d0 2023-11-04T01:36:52.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.242+0000 7f15abe44640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a4160f90 con 0x7f15a40b4880 2023-11-04T01:36:52.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.242+0000 7f15abe44640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a415e400 con 0x7f15a4153e60 2023-11-04T01:36:52.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.242+0000 7f15a93df640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f15a40cd6d0 0x7f15a4161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42100/0 (socket says 172.21.15.44:42100) 2023-11-04T01:36:52.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.242+0000 7f15a93df640 1 -- 172.21.15.44:0/3558564114 learned_addr learned my addr 172.21.15.44:0/3558564114 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:52.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.243+0000 7f15a9be0640 1 --2- 172.21.15.44:0/3558564114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a4153e60 0x7f15a415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.243+0000 7f15a8bde640 1 -- 172.21.15.44:0/3558564114 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607500269 0 0) 0x7f15a40cde60 con 0x7f15a40cd6d0 2023-11-04T01:36:52.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.243+0000 7f15a8bde640 1 -- 172.21.15.44:0/3558564114 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1590003520 con 0x7f15a40cd6d0 2023-11-04T01:36:52.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.243+0000 7f15a8bde640 1 -- 172.21.15.44:0/3558564114 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857617381 0 0) 0x7f15a4160f90 con 0x7f15a40b4880 2023-11-04T01:36:52.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.243+0000 7f15a8bde640 1 -- 172.21.15.44:0/3558564114 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a40cde60 con 0x7f15a40b4880 2023-11-04T01:36:52.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.243+0000 7f15a9be0640 1 -- 172.21.15.44:0/3558564114 >> v1:172.21.15.204:6789/0 conn(0x7f15a40b4880 legacy=0x7f15a40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.243+0000 7f15a9be0640 1 -- 172.21.15.44:0/3558564114 >> v1:172.21.15.44:6789/0 conn(0x7f15a40cd6d0 legacy=0x7f15a4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.243+0000 7f15a9be0640 1 -- 172.21.15.44:0/3558564114 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a40ce090 con 0x7f15a4153e60 2023-11-04T01:36:52.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.244+0000 7f15a9be0640 1 --2- 172.21.15.44:0/3558564114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a4153e60 0x7f15a415dec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f159c0097d0 tx=0x7f159c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3eb29dce06630cce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.244+0000 7f15a8bde640 1 -- 172.21.15.44:0/3558564114 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c031890 con 0x7f15a4153e60 2023-11-04T01:36:52.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.244+0000 7f15a8bde640 1 -- 172.21.15.44:0/3558564114 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c0319f0 con 0x7f15a4153e60 2023-11-04T01:36:52.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.244+0000 7f15a8bde640 1 -- 172.21.15.44:0/3558564114 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c031d60 con 0x7f15a4153e60 2023-11-04T01:36:52.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.245+0000 7f15abe44640 1 -- 172.21.15.44:0/3558564114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a4153e60 msgr2=0x7f15a415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.245+0000 7f15abe44640 1 --2- 172.21.15.44:0/3558564114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a4153e60 0x7f15a415dec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f159c0097d0 tx=0x7f159c02b930 comp rx=0 tx=0).stop 2023-11-04T01:36:52.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.245+0000 7f15abe44640 1 -- 172.21.15.44:0/3558564114 shutdown_connections 2023-11-04T01:36:52.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.245+0000 7f15abe44640 1 --2- 172.21.15.44:0/3558564114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a4153e60 0x7f15a415dec0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.245+0000 7f15abe44640 1 -- 172.21.15.44:0/3558564114 >> 172.21.15.44:0/3558564114 conn(0x7f15a40cf880 msgr2=0x7f15a40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.245+0000 7f15abe44640 1 -- 172.21.15.44:0/3558564114 shutdown_connections 2023-11-04T01:36:52.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.245+0000 7f15abe44640 1 -- 172.21.15.44:0/3558564114 wait complete. 2023-11-04T01:36:52.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.246+0000 7f15abe44640 1 Processor -- start 2023-11-04T01:36:52.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.246+0000 7f15abe44640 1 -- start start 2023-11-04T01:36:52.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15abe44640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a40b4880 0x7f15a4155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15abe44640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15a40cd6d0 0x7f15a40c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15abe44640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a4153e60 0x7f15a4156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15abe44640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a40cce10 con 0x7f15a40b4880 2023-11-04T01:36:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15abe44640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a40c8c30 con 0x7f15a40cd6d0 2023-11-04T01:36:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15abe44640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a40c8f10 con 0x7f15a4153e60 2023-11-04T01:36:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15a9be0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a40b4880 0x7f15a4155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15a9be0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a40b4880 0x7f15a4155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59040/0 (socket says 172.21.15.44:59040) 2023-11-04T01:36:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15a9be0640 1 -- 172.21.15.44:0/945951421 learned_addr learned my addr 172.21.15.44:0/945951421 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15a93df640 1 --2- 172.21.15.44:0/945951421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15a40cd6d0 0x7f15a40c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15aa3e1640 1 --2- 172.21.15.44:0/945951421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a4153e60 0x7f15a4156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15a9be0640 1 -- 172.21.15.44:0/945951421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a4153e60 msgr2=0x7f15a4156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15a9be0640 1 --2- 172.21.15.44:0/945951421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a4153e60 0x7f15a4156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15a9be0640 1 -- 172.21.15.44:0/945951421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15a40cd6d0 msgr2=0x7f15a40c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15a9be0640 1 --2- 172.21.15.44:0/945951421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15a40cd6d0 0x7f15a40c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15a9be0640 1 -- 172.21.15.44:0/945951421 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c009400 con 0x7f15a40b4880 2023-11-04T01:36:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.247+0000 7f15a9be0640 1 --2- 172.21.15.44:0/945951421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a40b4880 0x7f15a4155c70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f159c000c00 tx=0x7f159c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.248+0000 7f159a7fc640 1 -- 172.21.15.44:0/945951421 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c03abe0 con 0x7f15a40b4880 2023-11-04T01:36:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.248+0000 7f159a7fc640 1 -- 172.21.15.44:0/945951421 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c03ad60 con 0x7f15a40b4880 2023-11-04T01:36:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.248+0000 7f15abe44640 1 -- 172.21.15.44:0/945951421 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a40cae20 con 0x7f15a40b4880 2023-11-04T01:36:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.248+0000 7f159a7fc640 1 -- 172.21.15.44:0/945951421 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c044630 con 0x7f15a40b4880 2023-11-04T01:36:52.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.248+0000 7f15abe44640 1 -- 172.21.15.44:0/945951421 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a41561b0 con 0x7f15a40b4880 2023-11-04T01:36:52.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.249+0000 7f15abe44640 1 -- 172.21.15.44:0/945951421 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a40cb2e0 con 0x7f15a40b4880 2023-11-04T01:36:52.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.249+0000 7f159a7fc640 1 -- 172.21.15.44:0/945951421 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f159c04d430 con 0x7f15a40b4880 2023-11-04T01:36:52.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.250+0000 7f159a7fc640 1 --2- 172.21.15.44:0/945951421 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f158806aea0 0x7f158806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.250+0000 7f159a7fc640 1 -- 172.21.15.44:0/945951421 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f159c0abf00 con 0x7f15a40b4880 2023-11-04T01:36:52.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.250+0000 7f15a93df640 1 --2- 172.21.15.44:0/945951421 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f158806aea0 0x7f158806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.250+0000 7f15a93df640 1 --2- 172.21.15.44:0/945951421 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f158806aea0 0x7f158806d360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f15a4156850 tx=0x7f1594007d70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.254+0000 7f159a7fc640 1 -- 172.21.15.44:0/945951421 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f159c076b80 con 0x7f15a40b4880 2023-11-04T01:36:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.430+0000 7f15abe44640 1 -- 172.21.15.44:0/945951421 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15a4074290 con 0x7f15a40b4880 2023-11-04T01:36:52.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.430+0000 7f159a7fc640 1 -- 172.21.15.44:0/945951421 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f159c07a1a0 con 0x7f15a40b4880 2023-11-04T01:36:52.433 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:36:52.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.432+0000 7f15abe44640 1 -- 172.21.15.44:0/945951421 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f158806aea0 msgr2=0x7f158806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.432+0000 7f15abe44640 1 --2- 172.21.15.44:0/945951421 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f158806aea0 0x7f158806d360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f15a4156850 tx=0x7f1594007d70 comp rx=0 tx=0).stop 2023-11-04T01:36:52.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.432+0000 7f15abe44640 1 -- 172.21.15.44:0/945951421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a40b4880 msgr2=0x7f15a4155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.432+0000 7f15abe44640 1 --2- 172.21.15.44:0/945951421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a40b4880 0x7f15a4155c70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f159c000c00 tx=0x7f159c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.432+0000 7f15abe44640 1 -- 172.21.15.44:0/945951421 shutdown_connections 2023-11-04T01:36:52.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.432+0000 7f15abe44640 1 --2- 172.21.15.44:0/945951421 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f158806aea0 0x7f158806d360 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.432+0000 7f15abe44640 1 --2- 172.21.15.44:0/945951421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a4153e60 0x7f15a4156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.432+0000 7f15abe44640 1 --2- 172.21.15.44:0/945951421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15a40cd6d0 0x7f15a40c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.432+0000 7f15abe44640 1 --2- 172.21.15.44:0/945951421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a40b4880 0x7f15a4155c70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.432+0000 7f15abe44640 1 -- 172.21.15.44:0/945951421 >> 172.21.15.44:0/945951421 conn(0x7f15a40cf880 msgr2=0x7f15a40d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.432+0000 7f15abe44640 1 -- 172.21.15.44:0/945951421 shutdown_connections 2023-11-04T01:36:52.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.432+0000 7f15abe44640 1 -- 172.21.15.44:0/945951421 wait complete. 2023-11-04T01:36:52.445 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:52.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.552+0000 7f9085200640 1 Processor -- start 2023-11-04T01:36:52.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.552+0000 7f9085200640 1 -- start start 2023-11-04T01:36:52.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.553+0000 7f9085200640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f908015d0a0 0x7f90800717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.553+0000 7f9085200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90800cdfa0 0x7f9080071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.553+0000 7f9085200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90800cd620 con 0x7f90800ce420 2023-11-04T01:36:52.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.553+0000 7f9085200640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90800cd3b0 con 0x7f908015d0a0 2023-11-04T01:36:52.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.553+0000 7f9085200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908015d480 con 0x7f90800cdfa0 2023-11-04T01:36:52.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.553+0000 7f907f59e640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f90800ce420 0x7f9080160bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38354/0 (socket says 172.21.15.44:38354) 2023-11-04T01:36:52.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.553+0000 7f907f59e640 1 -- 172.21.15.44:0/2149304612 learned_addr learned my addr 172.21.15.44:0/2149304612 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:52.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907e59c640 1 --2- 172.21.15.44:0/2149304612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90800cdfa0 0x7f9080071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907ed9d640 1 --2- 172.21.15.44:0/2149304612 >> v2:172.21.15.204:3300/0 conn(0x7f908015d0a0 0x7f90800717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 -- 172.21.15.44:0/2149304612 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271618021 0 0) 0x7f90800cd620 con 0x7f90800ce420 2023-11-04T01:36:52.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 -- 172.21.15.44:0/2149304612 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9068003520 con 0x7f90800ce420 2023-11-04T01:36:52.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 -- 172.21.15.44:0/2149304612 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1318447304 0 0) 0x7f9068003520 con 0x7f90800ce420 2023-11-04T01:36:52.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 -- 172.21.15.44:0/2149304612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90800cdfa0 msgr2=0x7f9080071fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 --2- 172.21.15.44:0/2149304612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90800cdfa0 0x7f9080071fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 -- 172.21.15.44:0/2149304612 >> v2:172.21.15.204:3300/0 conn(0x7f908015d0a0 msgr2=0x7f90800717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 --2- 172.21.15.44:0/2149304612 >> v2:172.21.15.204:3300/0 conn(0x7f908015d0a0 0x7f90800717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 -- 172.21.15.44:0/2149304612 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90800cd0d0 con 0x7f90800ce420 2023-11-04T01:36:52.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 -- 172.21.15.44:0/2149304612 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f90780019f0 con 0x7f90800ce420 2023-11-04T01:36:52.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 -- 172.21.15.44:0/2149304612 >> v1:172.21.15.44:6789/0 conn(0x7f90800ce420 legacy=0x7f9080160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 --2- 172.21.15.44:0/2149304612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9068003970 0x7f9068003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 --2- 172.21.15.44:0/2149304612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90680047c0 0x7f9068004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 --2- 172.21.15.44:0/2149304612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90800cdfa0 0x7f9068005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 -- 172.21.15.44:0/2149304612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90800cd3b0 con 0x7f9068003970 2023-11-04T01:36:52.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 -- 172.21.15.44:0/2149304612 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908015d480 con 0x7f90680047c0 2023-11-04T01:36:52.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907dd9b640 1 -- 172.21.15.44:0/2149304612 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906800b980 con 0x7f90800cdfa0 2023-11-04T01:36:52.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907ed9d640 1 --2- 172.21.15.44:0/2149304612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9068003970 0x7f9068003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907e59c640 1 --2- 172.21.15.44:0/2149304612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90680047c0 0x7f9068004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907f59e640 1 --2- 172.21.15.44:0/2149304612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90800cdfa0 0x7f9068005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907ed9d640 1 -- 172.21.15.44:0/2149304612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90800cdfa0 msgr2=0x7f9068005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907ed9d640 1 --2- 172.21.15.44:0/2149304612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90800cdfa0 0x7f9068005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907ed9d640 1 -- 172.21.15.44:0/2149304612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90680047c0 msgr2=0x7f9068004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907ed9d640 1 --2- 172.21.15.44:0/2149304612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90680047c0 0x7f9068004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.554+0000 7f907ed9d640 1 -- 172.21.15.44:0/2149304612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9068003520 con 0x7f9068003970 2023-11-04T01:36:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.555+0000 7f907ed9d640 1 --2- 172.21.15.44:0/2149304612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9068003970 0x7f9068003d90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9070009af0 tx=0x7f90680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b36c5a8a4fc647c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.555+0000 7f907dd9b640 1 -- 172.21.15.44:0/2149304612 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907002c710 con 0x7f9068003970 2023-11-04T01:36:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.555+0000 7f907dd9b640 1 -- 172.21.15.44:0/2149304612 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907002c870 con 0x7f9068003970 2023-11-04T01:36:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.555+0000 7f907dd9b640 1 -- 172.21.15.44:0/2149304612 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907002cc00 con 0x7f9068003970 2023-11-04T01:36:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.556+0000 7f9085200640 1 -- 172.21.15.44:0/2149304612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9068003970 msgr2=0x7f9068003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.556+0000 7f9085200640 1 --2- 172.21.15.44:0/2149304612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9068003970 0x7f9068003d90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9070009af0 tx=0x7f90680057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.556+0000 7f907f59e640 1 -- 172.21.15.44:0/2149304612 reap_dead start 2023-11-04T01:36:52.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.556+0000 7f9085200640 1 -- 172.21.15.44:0/2149304612 shutdown_connections 2023-11-04T01:36:52.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.556+0000 7f9085200640 1 -- 172.21.15.44:0/2149304612 >> 172.21.15.44:0/2149304612 conn(0x7f90800cc440 msgr2=0x7f90800cc820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.556+0000 7f9085200640 1 -- 172.21.15.44:0/2149304612 shutdown_connections 2023-11-04T01:36:52.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.556+0000 7f9085200640 1 -- 172.21.15.44:0/2149304612 wait complete. 2023-11-04T01:36:52.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.557+0000 7f9085200640 1 Processor -- start 2023-11-04T01:36:52.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.557+0000 7f9085200640 1 -- start start 2023-11-04T01:36:52.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.558+0000 7f9085200640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9068003970 0x7f90800c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.558+0000 7f9085200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9080156670 0x7f90800adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.558+0000 7f9085200640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90800b3210 0x7f9080155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.558+0000 7f9085200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90800b2110 con 0x7f9080156670 2023-11-04T01:36:52.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.558+0000 7f9085200640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90800b1590 con 0x7f9068003970 2023-11-04T01:36:52.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.558+0000 7f9085200640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90800b1870 con 0x7f90800b3210 2023-11-04T01:36:52.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.558+0000 7f907e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9080156670 0x7f90800adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.558+0000 7f907e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9080156670 0x7f90800adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38946/0 (socket says 172.21.15.44:38946) 2023-11-04T01:36:52.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.558+0000 7f907e59c640 1 -- 172.21.15.44:0/3504767706 learned_addr learned my addr 172.21.15.44:0/3504767706 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:52.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.559+0000 7f907ed9d640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9068003970 0x7f90800c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.559+0000 7f907f59e640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90800b3210 0x7f9080155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.559+0000 7f907e59c640 1 -- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90800b3210 msgr2=0x7f9080155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.559+0000 7f907e59c640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90800b3210 0x7f9080155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.559+0000 7f907e59c640 1 -- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9068003970 msgr2=0x7f90800c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.559+0000 7f907e59c640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9068003970 0x7f90800c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.559+0000 7f907e59c640 1 -- 172.21.15.44:0/3504767706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90800b1b50 con 0x7f9080156670 2023-11-04T01:36:52.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.559+0000 7f907ed9d640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9068003970 0x7f90800c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:52.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.559+0000 7f907f59e640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90800b3210 0x7f9080155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:52.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.559+0000 7f907e59c640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9080156670 0x7f90800adb60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f90740119a0 tx=0x7f9074011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.559+0000 7f90677fe640 1 -- 172.21.15.44:0/3504767706 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907400faf0 con 0x7f9080156670 2023-11-04T01:36:52.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.559+0000 7f90677fe640 1 -- 172.21.15.44:0/3504767706 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907400fc50 con 0x7f9080156670 2023-11-04T01:36:52.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.559+0000 7f9085200640 1 -- 172.21.15.44:0/3504767706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90800b1e30 con 0x7f9080156670 2023-11-04T01:36:52.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.559+0000 7f90677fe640 1 -- 172.21.15.44:0/3504767706 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9074014440 con 0x7f9080156670 2023-11-04T01:36:52.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.559+0000 7f9085200640 1 -- 172.21.15.44:0/3504767706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90800ae0a0 con 0x7f9080156670 2023-11-04T01:36:52.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.560+0000 7f9085200640 1 -- 172.21.15.44:0/3504767706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9080067250 con 0x7f9080156670 2023-11-04T01:36:52.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.560+0000 7f90677fe640 1 -- 172.21.15.44:0/3504767706 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f90740145a0 con 0x7f9080156670 2023-11-04T01:36:52.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.561+0000 7f90677fe640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f906c06aea0 0x7f906c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.561+0000 7f90677fe640 1 -- 172.21.15.44:0/3504767706 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f907408a250 con 0x7f9080156670 2023-11-04T01:36:52.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.561+0000 7f907ed9d640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f906c06aea0 0x7f906c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.562+0000 7f907ed9d640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f906c06aea0 0x7f906c06d360 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9070036000 tx=0x7f9070030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.565+0000 7f90677fe640 1 -- 172.21.15.44:0/3504767706 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9074054f40 con 0x7f9080156670 2023-11-04T01:36:52.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.742+0000 7f9085200640 1 -- 172.21.15.44:0/3504767706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f908004ece0 con 0x7f9080156670 2023-11-04T01:36:52.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.742+0000 7f90677fe640 1 -- 172.21.15.44:0/3504767706 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9074058560 con 0x7f9080156670 2023-11-04T01:36:52.744 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:52.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.744+0000 7f9085200640 1 -- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f906c06aea0 msgr2=0x7f906c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.744+0000 7f9085200640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f906c06aea0 0x7f906c06d360 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9070036000 tx=0x7f9070030000 comp rx=0 tx=0).stop 2023-11-04T01:36:52.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.744+0000 7f9085200640 1 -- 172.21.15.44:0/3504767706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9080156670 msgr2=0x7f90800adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.744+0000 7f9085200640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9080156670 0x7f90800adb60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f90740119a0 tx=0x7f9074011e60 comp rx=0 tx=0).stop 2023-11-04T01:36:52.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.744+0000 7f9085200640 1 -- 172.21.15.44:0/3504767706 shutdown_connections 2023-11-04T01:36:52.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.744+0000 7f9085200640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f906c06aea0 0x7f906c06d360 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.744+0000 7f9085200640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90800b3210 0x7f9080155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.744+0000 7f9085200640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9080156670 0x7f90800adb60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.744+0000 7f9085200640 1 --2- 172.21.15.44:0/3504767706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9068003970 0x7f90800c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.744+0000 7f9085200640 1 -- 172.21.15.44:0/3504767706 >> 172.21.15.44:0/3504767706 conn(0x7f90800cc440 msgr2=0x7f90800c4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.744+0000 7f9085200640 1 -- 172.21.15.44:0/3504767706 shutdown_connections 2023-11-04T01:36:52.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.744+0000 7f9085200640 1 -- 172.21.15.44:0/3504767706 wait complete. 2023-11-04T01:36:52.757 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:52.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.863+0000 7f132b4f2640 1 Processor -- start 2023-11-04T01:36:52.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.863+0000 7f132b4f2640 1 -- start start 2023-11-04T01:36:52.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.864+0000 7f132b4f2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f13240b64c0 0x7f13240b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.864+0000 7f132b4f2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f13240cd3b0 0x7f13240cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.864+0000 7f132b4f2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13240cdd40 con 0x7f132415af20 2023-11-04T01:36:52.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.864+0000 7f132b4f2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13240cc380 con 0x7f13240b64c0 2023-11-04T01:36:52.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.864+0000 7f132b4f2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13240d01f0 con 0x7f13240cd3b0 2023-11-04T01:36:52.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.864+0000 7f1328a8d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f13240b64c0 0x7f13240b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.864+0000 7f1328a8d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f13240b64c0 0x7f13240b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38958/0 (socket says 172.21.15.44:38958) 2023-11-04T01:36:52.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.864+0000 7f1328a8d640 1 -- 172.21.15.44:0/1633577328 learned_addr learned my addr 172.21.15.44:0/1633577328 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:52.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.865+0000 7f1329a8f640 1 --2- 172.21.15.44:0/1633577328 >> v2:172.21.15.204:3300/0 conn(0x7f13240cd3b0 0x7f13240cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.865+0000 7f1328a8d640 1 -- 172.21.15.44:0/1633577328 >> v2:172.21.15.204:3300/0 conn(0x7f13240cd3b0 msgr2=0x7f13240cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.865+0000 7f1328a8d640 1 --2- 172.21.15.44:0/1633577328 >> v2:172.21.15.204:3300/0 conn(0x7f13240cd3b0 0x7f13240cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.865+0000 7f1328a8d640 1 -- 172.21.15.44:0/1633577328 >> v1:172.21.15.204:6789/0 conn(0x7f132415af20 legacy=0x7f13240cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.865+0000 7f1328a8d640 1 -- 172.21.15.44:0/1633577328 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13240b6a40 con 0x7f13240b64c0 2023-11-04T01:36:52.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.866+0000 7f1328a8d640 1 --2- 172.21.15.44:0/1633577328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13240b64c0 0x7f13240b3cd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f13240b6950 tx=0x7f131802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5527efd20d4526a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.866+0000 7f1323fff640 1 -- 172.21.15.44:0/1633577328 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318030860 con 0x7f13240b64c0 2023-11-04T01:36:52.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.866+0000 7f1323fff640 1 -- 172.21.15.44:0/1633577328 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13180309c0 con 0x7f13240b64c0 2023-11-04T01:36:52.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.866+0000 7f1323fff640 1 -- 172.21.15.44:0/1633577328 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318030d50 con 0x7f13240b64c0 2023-11-04T01:36:52.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.866+0000 7f132b4f2640 1 -- 172.21.15.44:0/1633577328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13240b64c0 msgr2=0x7f13240b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.866+0000 7f132b4f2640 1 --2- 172.21.15.44:0/1633577328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13240b64c0 0x7f13240b3cd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f13240b6950 tx=0x7f131802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.866+0000 7f132b4f2640 1 -- 172.21.15.44:0/1633577328 shutdown_connections 2023-11-04T01:36:52.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.866+0000 7f132b4f2640 1 --2- 172.21.15.44:0/1633577328 >> v2:172.21.15.204:3300/0 conn(0x7f13240cd3b0 0x7f13240cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.866+0000 7f132b4f2640 1 --2- 172.21.15.44:0/1633577328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13240b64c0 0x7f13240b3cd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.866+0000 7f132b4f2640 1 -- 172.21.15.44:0/1633577328 >> 172.21.15.44:0/1633577328 conn(0x7f132406ea20 msgr2=0x7f132406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.866+0000 7f132b4f2640 1 -- 172.21.15.44:0/1633577328 shutdown_connections 2023-11-04T01:36:52.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.866+0000 7f132b4f2640 1 -- 172.21.15.44:0/1633577328 wait complete. 2023-11-04T01:36:52.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.867+0000 7f132b4f2640 1 Processor -- start 2023-11-04T01:36:52.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.868+0000 7f132b4f2640 1 -- start start 2023-11-04T01:36:52.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.868+0000 7f132b4f2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13240b64c0 0x7f13240b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.868+0000 7f132b4f2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f13240cd3b0 0x7f1324156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.868+0000 7f132b4f2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f132415af20 0x7f132414ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.868+0000 7f132b4f2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13240b20f0 con 0x7f132415af20 2023-11-04T01:36:52.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.868+0000 7f132b4f2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132406d290 con 0x7f13240b64c0 2023-11-04T01:36:52.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.868+0000 7f132b4f2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132406c750 con 0x7f13240cd3b0 2023-11-04T01:36:52.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.868+0000 7f1329a8f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f132415af20 0x7f132414ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.868+0000 7f1329a8f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f132415af20 0x7f132414ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38974/0 (socket says 172.21.15.44:38974) 2023-11-04T01:36:52.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.868+0000 7f1329a8f640 1 -- 172.21.15.44:0/1450554263 learned_addr learned my addr 172.21.15.44:0/1450554263 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:52.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.869+0000 7f1328a8d640 1 --2- 172.21.15.44:0/1450554263 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f13240cd3b0 0x7f1324156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.869+0000 7f132928e640 1 --2- 172.21.15.44:0/1450554263 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13240b64c0 0x7f13240b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.869+0000 7f1329a8f640 1 -- 172.21.15.44:0/1450554263 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f13240cd3b0 msgr2=0x7f1324156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.869+0000 7f1329a8f640 1 --2- 172.21.15.44:0/1450554263 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f13240cd3b0 0x7f1324156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.869+0000 7f1329a8f640 1 -- 172.21.15.44:0/1450554263 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13240b64c0 msgr2=0x7f13240b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.869+0000 7f1329a8f640 1 --2- 172.21.15.44:0/1450554263 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13240b64c0 0x7f13240b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.869+0000 7f1329a8f640 1 -- 172.21.15.44:0/1450554263 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13180094d0 con 0x7f132415af20 2023-11-04T01:36:52.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.869+0000 7f132928e640 1 --2- 172.21.15.44:0/1450554263 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13240b64c0 0x7f13240b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:52.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.869+0000 7f1329a8f640 1 --2- 172.21.15.44:0/1450554263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f132415af20 0x7f132414ed40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1314007e40 tx=0x7f131400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.869+0000 7f1321ffb640 1 -- 172.21.15.44:0/1450554263 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314014620 con 0x7f132415af20 2023-11-04T01:36:52.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.869+0000 7f1321ffb640 1 -- 172.21.15.44:0/1450554263 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131400ee90 con 0x7f132415af20 2023-11-04T01:36:52.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.869+0000 7f1321ffb640 1 -- 172.21.15.44:0/1450554263 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140149e0 con 0x7f132415af20 2023-11-04T01:36:52.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.869+0000 7f132b4f2640 1 -- 172.21.15.44:0/1450554263 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132406ccd0 con 0x7f132415af20 2023-11-04T01:36:52.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.869+0000 7f132b4f2640 1 -- 172.21.15.44:0/1450554263 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13240b2320 con 0x7f132415af20 2023-11-04T01:36:52.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.870+0000 7f132b4f2640 1 -- 172.21.15.44:0/1450554263 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132406d400 con 0x7f132415af20 2023-11-04T01:36:52.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.870+0000 7f1321ffb640 1 -- 172.21.15.44:0/1450554263 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1314014b40 con 0x7f132415af20 2023-11-04T01:36:52.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.871+0000 7f1321ffb640 1 --2- 172.21.15.44:0/1450554263 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f131006ae70 0x7f131006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.871+0000 7f1321ffb640 1 -- 172.21.15.44:0/1450554263 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f131408a300 con 0x7f132415af20 2023-11-04T01:36:52.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.871+0000 7f132928e640 1 --2- 172.21.15.44:0/1450554263 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f131006ae70 0x7f131006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.872+0000 7f132928e640 1 --2- 172.21.15.44:0/1450554263 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f131006ae70 0x7f131006d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f131c007fd0 tx=0x7f131c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:52.875+0000 7f1321ffb640 1 -- 172.21.15.44:0/1450554263 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1314055080 con 0x7f132415af20 2023-11-04T01:36:53.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.051+0000 7f132b4f2640 1 -- 172.21.15.44:0/1450554263 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f132406f2c0 con 0x7f132415af20 2023-11-04T01:36:53.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.052+0000 7f1321ffb640 1 -- 172.21.15.44:0/1450554263 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13140586a0 con 0x7f132415af20 2023-11-04T01:36:53.054 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:36:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.054+0000 7f132b4f2640 1 -- 172.21.15.44:0/1450554263 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f131006ae70 msgr2=0x7f131006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.054+0000 7f132b4f2640 1 --2- 172.21.15.44:0/1450554263 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f131006ae70 0x7f131006d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f131c007fd0 tx=0x7f131c009040 comp rx=0 tx=0).stop 2023-11-04T01:36:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.054+0000 7f132b4f2640 1 -- 172.21.15.44:0/1450554263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f132415af20 msgr2=0x7f132414ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.054+0000 7f132b4f2640 1 --2- 172.21.15.44:0/1450554263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f132415af20 0x7f132414ed40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1314007e40 tx=0x7f131400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.054+0000 7f132b4f2640 1 -- 172.21.15.44:0/1450554263 shutdown_connections 2023-11-04T01:36:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.054+0000 7f132b4f2640 1 --2- 172.21.15.44:0/1450554263 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f131006ae70 0x7f131006d330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.054+0000 7f132b4f2640 1 --2- 172.21.15.44:0/1450554263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f132415af20 0x7f132414ed40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.054+0000 7f132b4f2640 1 --2- 172.21.15.44:0/1450554263 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f13240cd3b0 0x7f1324156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.054+0000 7f132b4f2640 1 --2- 172.21.15.44:0/1450554263 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13240b64c0 0x7f13240b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.054+0000 7f132b4f2640 1 -- 172.21.15.44:0/1450554263 >> 172.21.15.44:0/1450554263 conn(0x7f132406ea20 msgr2=0x7f13240cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.054+0000 7f132b4f2640 1 -- 172.21.15.44:0/1450554263 shutdown_connections 2023-11-04T01:36:53.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.054+0000 7f132b4f2640 1 -- 172.21.15.44:0/1450554263 wait complete. 2023-11-04T01:36:53.066 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:53.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.174+0000 7f74aaf9e640 1 Processor -- start 2023-11-04T01:36:53.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.174+0000 7f74aaf9e640 1 -- start start 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.174+0000 7f74aaf9e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f74a4153e60 0x7f74a415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.174+0000 7f74aaf9e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f74a40b4880 0x7f74a40b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.174+0000 7f74aaf9e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a40cde60 con 0x7f74a40cd6d0 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.174+0000 7f74aaf9e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a4160f90 con 0x7f74a4153e60 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.174+0000 7f74aaf9e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a40b5200 con 0x7f74a40b4880 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.174+0000 7f74a8d3a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f74a4153e60 0x7f74a415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.175+0000 7f74a3fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f74a40cd6d0 0x7f74a4161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38364/0 (socket says 172.21.15.44:38364) 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.175+0000 7f74a3fff640 1 -- 172.21.15.44:0/1315665863 learned_addr learned my addr 172.21.15.44:0/1315665863 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:53.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.175+0000 7f74a953b640 1 --2- 172.21.15.44:0/1315665863 >> v2:172.21.15.204:3300/0 conn(0x7f74a40b4880 0x7f74a40b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.175+0000 7f74a8d3a640 1 -- 172.21.15.44:0/1315665863 >> v2:172.21.15.204:3300/0 conn(0x7f74a40b4880 msgr2=0x7f74a40b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.175+0000 7f74a8d3a640 1 --2- 172.21.15.44:0/1315665863 >> v2:172.21.15.204:3300/0 conn(0x7f74a40b4880 0x7f74a40b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.175+0000 7f74a8d3a640 1 -- 172.21.15.44:0/1315665863 >> v1:172.21.15.44:6789/0 conn(0x7f74a40cd6d0 legacy=0x7f74a4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.175+0000 7f74a8d3a640 1 -- 172.21.15.44:0/1315665863 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a415e400 con 0x7f74a4153e60 2023-11-04T01:36:53.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.175+0000 7f74a953b640 1 --2- 172.21.15.44:0/1315665863 >> v2:172.21.15.204:3300/0 conn(0x7f74a40b4880 0x7f74a40b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:53.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.176+0000 7f74a8d3a640 1 --2- 172.21.15.44:0/1315665863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a4153e60 0x7f74a415dec0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f74a40b8f40 tx=0x7f749802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa89197693e1233 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.176+0000 7f74a37fe640 1 -- 172.21.15.44:0/1315665863 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498031830 con 0x7f74a4153e60 2023-11-04T01:36:53.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.176+0000 7f74a37fe640 1 -- 172.21.15.44:0/1315665863 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7498031990 con 0x7f74a4153e60 2023-11-04T01:36:53.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.176+0000 7f74a37fe640 1 -- 172.21.15.44:0/1315665863 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498031d20 con 0x7f74a4153e60 2023-11-04T01:36:53.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.176+0000 7f74aaf9e640 1 -- 172.21.15.44:0/1315665863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a4153e60 msgr2=0x7f74a415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.176+0000 7f74aaf9e640 1 --2- 172.21.15.44:0/1315665863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a4153e60 0x7f74a415dec0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f74a40b8f40 tx=0x7f749802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.176+0000 7f74aaf9e640 1 -- 172.21.15.44:0/1315665863 shutdown_connections 2023-11-04T01:36:53.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.176+0000 7f74aaf9e640 1 --2- 172.21.15.44:0/1315665863 >> v2:172.21.15.204:3300/0 conn(0x7f74a40b4880 0x7f74a40b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.176+0000 7f74aaf9e640 1 --2- 172.21.15.44:0/1315665863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a4153e60 0x7f74a415dec0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.176+0000 7f74aaf9e640 1 -- 172.21.15.44:0/1315665863 >> 172.21.15.44:0/1315665863 conn(0x7f74a40cf880 msgr2=0x7f74a40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.176+0000 7f74aaf9e640 1 -- 172.21.15.44:0/1315665863 shutdown_connections 2023-11-04T01:36:53.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.176+0000 7f74aaf9e640 1 -- 172.21.15.44:0/1315665863 wait complete. 2023-11-04T01:36:53.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.177+0000 7f74aaf9e640 1 Processor -- start 2023-11-04T01:36:53.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.177+0000 7f74aaf9e640 1 -- start start 2023-11-04T01:36:53.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.178+0000 7f74aaf9e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a40b4880 0x7f74a415ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.178+0000 7f74aaf9e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74a40cd6d0 0x7f74a415f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.178+0000 7f74aaf9e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74a4153e60 0x7f74a40cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.178+0000 7f74aaf9e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4150c70 con 0x7f74a40b4880 2023-11-04T01:36:53.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.178+0000 7f74aaf9e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40caf20 con 0x7f74a40cd6d0 2023-11-04T01:36:53.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.178+0000 7f74aaf9e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40ccc00 con 0x7f74a4153e60 2023-11-04T01:36:53.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.178+0000 7f74a8d3a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a40b4880 0x7f74a415ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.178+0000 7f74a8d3a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a40b4880 0x7f74a415ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39000/0 (socket says 172.21.15.44:39000) 2023-11-04T01:36:53.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.179+0000 7f74a8d3a640 1 -- 172.21.15.44:0/1673940983 learned_addr learned my addr 172.21.15.44:0/1673940983 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:53.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.179+0000 7f74a3fff640 1 --2- 172.21.15.44:0/1673940983 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74a40cd6d0 0x7f74a415f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.179+0000 7f74a953b640 1 --2- 172.21.15.44:0/1673940983 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74a4153e60 0x7f74a40cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.179+0000 7f74a8d3a640 1 -- 172.21.15.44:0/1673940983 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74a4153e60 msgr2=0x7f74a40cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.179+0000 7f74a8d3a640 1 --2- 172.21.15.44:0/1673940983 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74a4153e60 0x7f74a40cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.179+0000 7f74a8d3a640 1 -- 172.21.15.44:0/1673940983 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74a40cd6d0 msgr2=0x7f74a415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.179+0000 7f74a8d3a640 1 --2- 172.21.15.44:0/1673940983 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74a40cd6d0 0x7f74a415f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.179+0000 7f74a8d3a640 1 -- 172.21.15.44:0/1673940983 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7498009400 con 0x7f74a40b4880 2023-11-04T01:36:53.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.179+0000 7f74a953b640 1 --2- 172.21.15.44:0/1673940983 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74a4153e60 0x7f74a40cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:53.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.179+0000 7f74a8d3a640 1 --2- 172.21.15.44:0/1673940983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a40b4880 0x7f74a415ecf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7498000c00 tx=0x7f74980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.179+0000 7f74a17fa640 1 -- 172.21.15.44:0/1673940983 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749803aa60 con 0x7f74a40b4880 2023-11-04T01:36:53.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.179+0000 7f74a17fa640 1 -- 172.21.15.44:0/1673940983 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749803abe0 con 0x7f74a40b4880 2023-11-04T01:36:53.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.179+0000 7f74aaf9e640 1 -- 172.21.15.44:0/1673940983 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a40cb1e0 con 0x7f74a40b4880 2023-11-04T01:36:53.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.179+0000 7f74a17fa640 1 -- 172.21.15.44:0/1673940983 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74980443f0 con 0x7f74a40b4880 2023-11-04T01:36:53.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.179+0000 7f74aaf9e640 1 -- 172.21.15.44:0/1673940983 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a40cb7a0 con 0x7f74a40b4880 2023-11-04T01:36:53.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.180+0000 7f74aaf9e640 1 -- 172.21.15.44:0/1673940983 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a40cb960 con 0x7f74a40b4880 2023-11-04T01:36:53.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.181+0000 7f74a17fa640 1 -- 172.21.15.44:0/1673940983 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f749804d450 con 0x7f74a40b4880 2023-11-04T01:36:53.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.181+0000 7f74a17fa640 1 --2- 172.21.15.44:0/1673940983 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f748806ae70 0x7f748806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.181+0000 7f74a17fa640 1 -- 172.21.15.44:0/1673940983 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f74980abb90 con 0x7f74a40b4880 2023-11-04T01:36:53.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.181+0000 7f74a3fff640 1 --2- 172.21.15.44:0/1673940983 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f748806ae70 0x7f748806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.182+0000 7f74a3fff640 1 --2- 172.21.15.44:0/1673940983 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f748806ae70 0x7f748806d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f74a40d3910 tx=0x7f7490009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.185+0000 7f74a17fa640 1 -- 172.21.15.44:0/1673940983 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74980767f0 con 0x7f74a40b4880 2023-11-04T01:36:53.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.362+0000 7f74aaf9e640 1 -- 172.21.15.44:0/1673940983 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f74a4074290 con 0x7f74a40b4880 2023-11-04T01:36:53.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.362+0000 7f74a17fa640 1 -- 172.21.15.44:0/1673940983 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7498035030 con 0x7f74a40b4880 2023-11-04T01:36:53.364 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:53.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.364+0000 7f74aaf9e640 1 -- 172.21.15.44:0/1673940983 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f748806ae70 msgr2=0x7f748806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.364+0000 7f74aaf9e640 1 --2- 172.21.15.44:0/1673940983 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f748806ae70 0x7f748806d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f74a40d3910 tx=0x7f7490009040 comp rx=0 tx=0).stop 2023-11-04T01:36:53.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.364+0000 7f74aaf9e640 1 -- 172.21.15.44:0/1673940983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a40b4880 msgr2=0x7f74a415ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.364+0000 7f74aaf9e640 1 --2- 172.21.15.44:0/1673940983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a40b4880 0x7f74a415ecf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7498000c00 tx=0x7f74980046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.364+0000 7f74aaf9e640 1 -- 172.21.15.44:0/1673940983 shutdown_connections 2023-11-04T01:36:53.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.364+0000 7f74aaf9e640 1 --2- 172.21.15.44:0/1673940983 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f748806ae70 0x7f748806d330 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.364+0000 7f74aaf9e640 1 --2- 172.21.15.44:0/1673940983 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74a4153e60 0x7f74a40cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.364+0000 7f74aaf9e640 1 --2- 172.21.15.44:0/1673940983 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74a40cd6d0 0x7f74a415f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.364+0000 7f74aaf9e640 1 --2- 172.21.15.44:0/1673940983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a40b4880 0x7f74a415ecf0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.364+0000 7f74aaf9e640 1 -- 172.21.15.44:0/1673940983 >> 172.21.15.44:0/1673940983 conn(0x7f74a40cf880 msgr2=0x7f74a415fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.364+0000 7f74aaf9e640 1 -- 172.21.15.44:0/1673940983 shutdown_connections 2023-11-04T01:36:53.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.364+0000 7f74aaf9e640 1 -- 172.21.15.44:0/1673940983 wait complete. 2023-11-04T01:36:53.377 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:53.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.483+0000 7fc86584b640 1 Processor -- start 2023-11-04T01:36:53.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.483+0000 7fc86584b640 1 -- start start 2023-11-04T01:36:53.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.484+0000 7fc86584b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc8600cd6d0 0x7fc860161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.484+0000 7fc86584b640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8600cde60 con 0x7fc860153e60 2023-11-04T01:36:53.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.484+0000 7fc86584b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc860160f90 con 0x7fc8600b4880 2023-11-04T01:36:53.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.484+0000 7fc86584b640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc860161960 con 0x7fc8600cd6d0 2023-11-04T01:36:53.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.484+0000 7fc8567fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc8600cd6d0 0x7fc860161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.484+0000 7fc8567fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc8600cd6d0 0x7fc860161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39014/0 (socket says 172.21.15.44:39014) 2023-11-04T01:36:53.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.484+0000 7fc85effd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc860153e60 0x7fc86015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38372/0 (socket says 172.21.15.44:38372) 2023-11-04T01:36:53.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.484+0000 7fc8567fc640 1 -- 172.21.15.44:0/4147177852 learned_addr learned my addr 172.21.15.44:0/4147177852 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:53.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.484+0000 7fc8567fc640 1 -- 172.21.15.44:0/4147177852 >> v1:172.21.15.204:6789/0 conn(0x7fc8600b4880 legacy=0x7fc8600d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.484+0000 7fc8567fc640 1 -- 172.21.15.44:0/4147177852 >> v1:172.21.15.44:6789/0 conn(0x7fc860153e60 legacy=0x7fc86015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.484+0000 7fc8567fc640 1 -- 172.21.15.44:0/4147177852 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8600ce090 con 0x7fc8600cd6d0 2023-11-04T01:36:53.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.485+0000 7fc8567fc640 1 --2- 172.21.15.44:0/4147177852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8600cd6d0 0x7fc860161420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc848009870 tx=0x7fc84802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f1f6af512d797f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.485+0000 7fc85e7fc640 1 -- 172.21.15.44:0/4147177852 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc848030860 con 0x7fc8600cd6d0 2023-11-04T01:36:53.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.485+0000 7fc85e7fc640 1 -- 172.21.15.44:0/4147177852 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8480309c0 con 0x7fc8600cd6d0 2023-11-04T01:36:53.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.485+0000 7fc85e7fc640 1 -- 172.21.15.44:0/4147177852 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc848030d50 con 0x7fc8600cd6d0 2023-11-04T01:36:53.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.485+0000 7fc86584b640 1 -- 172.21.15.44:0/4147177852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8600cd6d0 msgr2=0x7fc860161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.485+0000 7fc86584b640 1 --2- 172.21.15.44:0/4147177852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8600cd6d0 0x7fc860161420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc848009870 tx=0x7fc84802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.485+0000 7fc86584b640 1 -- 172.21.15.44:0/4147177852 shutdown_connections 2023-11-04T01:36:53.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.485+0000 7fc86584b640 1 --2- 172.21.15.44:0/4147177852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8600cd6d0 0x7fc860161420 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.485+0000 7fc86584b640 1 -- 172.21.15.44:0/4147177852 >> 172.21.15.44:0/4147177852 conn(0x7fc8600cf880 msgr2=0x7fc8600cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.486+0000 7fc86584b640 1 -- 172.21.15.44:0/4147177852 shutdown_connections 2023-11-04T01:36:53.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.486+0000 7fc86584b640 1 -- 172.21.15.44:0/4147177852 wait complete. 2023-11-04T01:36:53.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.487+0000 7fc86584b640 1 Processor -- start 2023-11-04T01:36:53.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.487+0000 7fc86584b640 1 -- start start 2023-11-04T01:36:53.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.487+0000 7fc86584b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8600b4880 0x7fc860156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.487+0000 7fc86584b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8600cd6d0 0x7fc860157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.487+0000 7fc86584b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc860153e60 0x7fc8601580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.487+0000 7fc86584b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc860156740 con 0x7fc860153e60 2023-11-04T01:36:53.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.487+0000 7fc86584b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc860155ac0 con 0x7fc8600b4880 2023-11-04T01:36:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.487+0000 7fc86584b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc860155da0 con 0x7fc8600cd6d0 2023-11-04T01:36:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc85f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc860153e60 0x7fc8601580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc85f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc860153e60 0x7fc8601580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39030/0 (socket says 172.21.15.44:39030) 2023-11-04T01:36:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc85f7fe640 1 -- 172.21.15.44:0/3230916218 learned_addr learned my addr 172.21.15.44:0/3230916218 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc85effd640 1 --2- 172.21.15.44:0/3230916218 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8600b4880 0x7fc860156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc8567fc640 1 --2- 172.21.15.44:0/3230916218 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8600cd6d0 0x7fc860157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc85f7fe640 1 -- 172.21.15.44:0/3230916218 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8600cd6d0 msgr2=0x7fc860157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc85f7fe640 1 --2- 172.21.15.44:0/3230916218 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8600cd6d0 0x7fc860157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc85f7fe640 1 -- 172.21.15.44:0/3230916218 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8600b4880 msgr2=0x7fc860156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc85f7fe640 1 --2- 172.21.15.44:0/3230916218 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8600b4880 0x7fc860156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc85f7fe640 1 -- 172.21.15.44:0/3230916218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8480094d0 con 0x7fc860153e60 2023-11-04T01:36:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc85f7fe640 1 --2- 172.21.15.44:0/3230916218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc860153e60 0x7fc8601580b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc85800c780 tx=0x7fc85800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc85cff9640 1 -- 172.21.15.44:0/3230916218 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858004b60 con 0x7fc860153e60 2023-11-04T01:36:53.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc85cff9640 1 -- 172.21.15.44:0/3230916218 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85800ce90 con 0x7fc860153e60 2023-11-04T01:36:53.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc85cff9640 1 -- 172.21.15.44:0/3230916218 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85800a850 con 0x7fc860153e60 2023-11-04T01:36:53.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc86584b640 1 -- 172.21.15.44:0/3230916218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc860156080 con 0x7fc860153e60 2023-11-04T01:36:53.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.488+0000 7fc86584b640 1 -- 172.21.15.44:0/3230916218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8601555c0 con 0x7fc860153e60 2023-11-04T01:36:53.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.489+0000 7fc86584b640 1 -- 172.21.15.44:0/3230916218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc860074290 con 0x7fc860153e60 2023-11-04T01:36:53.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.490+0000 7fc85cff9640 1 -- 172.21.15.44:0/3230916218 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc85800a9b0 con 0x7fc860153e60 2023-11-04T01:36:53.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.490+0000 7fc85cff9640 1 --2- 172.21.15.44:0/3230916218 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc84006ae70 0x7fc84006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.490+0000 7fc85cff9640 1 -- 172.21.15.44:0/3230916218 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc858089970 con 0x7fc860153e60 2023-11-04T01:36:53.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.490+0000 7fc85effd640 1 --2- 172.21.15.44:0/3230916218 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc84006ae70 0x7fc84006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.491+0000 7fc85effd640 1 --2- 172.21.15.44:0/3230916218 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc84006ae70 0x7fc84006d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc850007fd0 tx=0x7fc850007e80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.494+0000 7fc85cff9640 1 -- 172.21.15.44:0/3230916218 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc8580547a0 con 0x7fc860153e60 2023-11-04T01:36:53.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.682+0000 7fc86584b640 1 -- 172.21.15.44:0/3230916218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc8600d0b80 con 0x7fc860153e60 2023-11-04T01:36:53.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.682+0000 7fc85cff9640 1 -- 172.21.15.44:0/3230916218 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc858057dc0 con 0x7fc860153e60 2023-11-04T01:36:53.685 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2023-11-04T01:36:53.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.684+0000 7fc86584b640 1 -- 172.21.15.44:0/3230916218 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc84006ae70 msgr2=0x7fc84006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.684+0000 7fc86584b640 1 --2- 172.21.15.44:0/3230916218 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc84006ae70 0x7fc84006d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc850007fd0 tx=0x7fc850007e80 comp rx=0 tx=0).stop 2023-11-04T01:36:53.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.684+0000 7fc86584b640 1 -- 172.21.15.44:0/3230916218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc860153e60 msgr2=0x7fc8601580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.684+0000 7fc86584b640 1 --2- 172.21.15.44:0/3230916218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc860153e60 0x7fc8601580b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc85800c780 tx=0x7fc85800cc40 comp rx=0 tx=0).stop 2023-11-04T01:36:53.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.684+0000 7fc86584b640 1 -- 172.21.15.44:0/3230916218 shutdown_connections 2023-11-04T01:36:53.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.684+0000 7fc86584b640 1 --2- 172.21.15.44:0/3230916218 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc84006ae70 0x7fc84006d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.684+0000 7fc86584b640 1 --2- 172.21.15.44:0/3230916218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc860153e60 0x7fc8601580b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.684+0000 7fc86584b640 1 --2- 172.21.15.44:0/3230916218 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8600cd6d0 0x7fc860157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.684+0000 7fc86584b640 1 --2- 172.21.15.44:0/3230916218 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8600b4880 0x7fc860156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.684+0000 7fc86584b640 1 -- 172.21.15.44:0/3230916218 >> 172.21.15.44:0/3230916218 conn(0x7fc8600cf880 msgr2=0x7fc8600d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.684+0000 7fc86584b640 1 -- 172.21.15.44:0/3230916218 shutdown_connections 2023-11-04T01:36:53.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53.684+0000 7fc86584b640 1 -- 172.21.15.44:0/3230916218 wait complete. 2023-11-04T01:36:53.697 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2023-11-04T01:36:53.697 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:53.697 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:53.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:53.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[98281]: fuse finished with error 0 and tester_r 0 2023-11-04T01:36:53.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:53.766 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:36:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:53.769 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:36:53.774 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:36:53.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:53.775 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:36:53.830 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:36:53.830 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:53.852 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:36:53.852 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:53.910 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:53.951 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi204.stderr:2023-11-04T01:36:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:54.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.014+0000 7ff273d2c640 1 Processor -- start 2023-11-04T01:36:54.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.014+0000 7ff273d2c640 1 -- start start 2023-11-04T01:36:54.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.015+0000 7ff273d2c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff26c159c70 0x7ff26c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.015+0000 7ff273d2c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff26c0b0ae0 0x7ff26c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.015+0000 7ff273d2c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c0b4110 con 0x7ff26c06db20 2023-11-04T01:36:54.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.015+0000 7ff273d2c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26c0b49b0 con 0x7ff26c159c70 2023-11-04T01:36:54.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.015+0000 7ff273d2c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26c0b43f0 con 0x7ff26c0b0ae0 2023-11-04T01:36:54.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.015+0000 7ff271ac8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff26c159c70 0x7ff26c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.015+0000 7ff271ac8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff26c159c70 0x7ff26c0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39032/0 (socket says 172.21.15.44:39032) 2023-11-04T01:36:54.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.015+0000 7ff271ac8640 1 -- 172.21.15.44:0/583870689 learned_addr learned my addr 172.21.15.44:0/583870689 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:54.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.016+0000 7ff271ac8640 1 -- 172.21.15.44:0/583870689 >> v2:172.21.15.204:3300/0 conn(0x7ff26c0b0ae0 msgr2=0x7ff26c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:54.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.016+0000 7ff271ac8640 1 --2- 172.21.15.44:0/583870689 >> v2:172.21.15.204:3300/0 conn(0x7ff26c0b0ae0 0x7ff26c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.016+0000 7ff271ac8640 1 -- 172.21.15.44:0/583870689 >> v1:172.21.15.204:6789/0 conn(0x7ff26c06db20 legacy=0x7ff26c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:54.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.016+0000 7ff271ac8640 1 -- 172.21.15.44:0/583870689 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c0b46d0 con 0x7ff26c159c70 2023-11-04T01:36:54.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.016+0000 7ff271ac8640 1 --2- 172.21.15.44:0/583870689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26c159c70 0x7ff26c0ce370 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0c5910 tx=0x7ff26402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a331b4eb9d5fdd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.017+0000 7ff270ac6640 1 -- 172.21.15.44:0/583870689 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264031870 con 0x7ff26c159c70 2023-11-04T01:36:54.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.017+0000 7ff270ac6640 1 -- 172.21.15.44:0/583870689 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2640319d0 con 0x7ff26c159c70 2023-11-04T01:36:54.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.017+0000 7ff270ac6640 1 -- 172.21.15.44:0/583870689 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264031d60 con 0x7ff26c159c70 2023-11-04T01:36:54.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.017+0000 7ff273d2c640 1 -- 172.21.15.44:0/583870689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26c159c70 msgr2=0x7ff26c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.017+0000 7ff273d2c640 1 --2- 172.21.15.44:0/583870689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26c159c70 0x7ff26c0ce370 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0c5910 tx=0x7ff26402b910 comp rx=0 tx=0).stop 2023-11-04T01:36:54.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.017+0000 7ff273d2c640 1 -- 172.21.15.44:0/583870689 shutdown_connections 2023-11-04T01:36:54.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.017+0000 7ff273d2c640 1 --2- 172.21.15.44:0/583870689 >> v2:172.21.15.204:3300/0 conn(0x7ff26c0b0ae0 0x7ff26c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.017+0000 7ff273d2c640 1 --2- 172.21.15.44:0/583870689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26c159c70 0x7ff26c0ce370 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.017+0000 7ff273d2c640 1 -- 172.21.15.44:0/583870689 >> 172.21.15.44:0/583870689 conn(0x7ff26c0ce950 msgr2=0x7ff26c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.017+0000 7ff273d2c640 1 -- 172.21.15.44:0/583870689 shutdown_connections 2023-11-04T01:36:54.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.017+0000 7ff273d2c640 1 -- 172.21.15.44:0/583870689 wait complete. 2023-11-04T01:36:54.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.018+0000 7ff273d2c640 1 Processor -- start 2023-11-04T01:36:54.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.018+0000 7ff273d2c640 1 -- start start 2023-11-04T01:36:54.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.019+0000 7ff273d2c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff26c06db20 0x7ff26c0c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.019+0000 7ff273d2c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26c0b0ae0 0x7ff26c1e2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.019+0000 7ff273d2c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff26c159c70 0x7ff26c1e2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.019+0000 7ff273d2c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c15ce90 con 0x7ff26c0b0ae0 2023-11-04T01:36:54.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.019+0000 7ff273d2c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c140bd0 con 0x7ff26c159c70 2023-11-04T01:36:54.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.019+0000 7ff273d2c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c140eb0 con 0x7ff26c06db20 2023-11-04T01:36:54.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.019+0000 7ff2712c7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26c0b0ae0 0x7ff26c1e2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.019+0000 7ff2712c7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26c0b0ae0 0x7ff26c1e2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39048/0 (socket says 172.21.15.44:39048) 2023-11-04T01:36:54.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.019+0000 7ff2712c7640 1 -- 172.21.15.44:0/2273102289 learned_addr learned my addr 172.21.15.44:0/2273102289 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:54.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.019+0000 7ff2722c9640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff26c159c70 0x7ff26c1e2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.019+0000 7ff271ac8640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff26c06db20 0x7ff26c0c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.019+0000 7ff2712c7640 1 -- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff26c06db20 msgr2=0x7ff26c0c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.020+0000 7ff2712c7640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff26c06db20 0x7ff26c0c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.020+0000 7ff2712c7640 1 -- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff26c159c70 msgr2=0x7ff26c1e2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.020+0000 7ff2712c7640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff26c159c70 0x7ff26c1e2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.020+0000 7ff2712c7640 1 -- 172.21.15.44:0/2273102289 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2640094d0 con 0x7ff26c0b0ae0 2023-11-04T01:36:54.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.020+0000 7ff2722c9640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff26c159c70 0x7ff26c1e2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:54.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.020+0000 7ff271ac8640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff26c06db20 0x7ff26c0c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:54.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.020+0000 7ff2712c7640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26c0b0ae0 0x7ff26c1e2220 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff26000b3e0 tx=0x7ff26000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.020+0000 7ff26a7fc640 1 -- 172.21.15.44:0/2273102289 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260011830 con 0x7ff26c0b0ae0 2023-11-04T01:36:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.020+0000 7ff26a7fc640 1 -- 172.21.15.44:0/2273102289 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2600119b0 con 0x7ff26c0b0ae0 2023-11-04T01:36:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.020+0000 7ff273d2c640 1 -- 172.21.15.44:0/2273102289 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26c141190 con 0x7ff26c0b0ae0 2023-11-04T01:36:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.020+0000 7ff26a7fc640 1 -- 172.21.15.44:0/2273102289 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260011d60 con 0x7ff26c0b0ae0 2023-11-04T01:36:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.020+0000 7ff273d2c640 1 -- 172.21.15.44:0/2273102289 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26c155620 con 0x7ff26c0b0ae0 2023-11-04T01:36:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.021+0000 7ff273d2c640 1 -- 172.21.15.44:0/2273102289 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26c1416b0 con 0x7ff26c0b0ae0 2023-11-04T01:36:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.021+0000 7ff26a7fc640 1 -- 172.21.15.44:0/2273102289 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff26001a400 con 0x7ff26c0b0ae0 2023-11-04T01:36:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.022+0000 7ff26a7fc640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff25806ae40 0x7ff25806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.022+0000 7ff26a7fc640 1 -- 172.21.15.44:0/2273102289 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff260089b30 con 0x7ff26c0b0ae0 2023-11-04T01:36:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.022+0000 7ff271ac8640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff25806ae40 0x7ff25806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.023+0000 7ff271ac8640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff25806ae40 0x7ff25806d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff264036000 tx=0x7ff26403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.026+0000 7ff26a7fc640 1 -- 172.21.15.44:0/2273102289 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff26c1416b0 con 0x7ff26c0b0ae0 2023-11-04T01:36:54.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.203+0000 7ff273d2c640 1 -- 172.21.15.44:0/2273102289 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff26c1416b0 con 0x7ff26c0b0ae0 2023-11-04T01:36:54.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.204+0000 7ff26a7fc640 1 -- 172.21.15.44:0/2273102289 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7ff26c1416b0 con 0x7ff26c0b0ae0 2023-11-04T01:36:54.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:54.207 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:54.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.206+0000 7ff273d2c640 1 -- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff25806ae40 msgr2=0x7ff25806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.207+0000 7ff273d2c640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff25806ae40 0x7ff25806d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff264036000 tx=0x7ff26403c040 comp rx=0 tx=0).stop 2023-11-04T01:36:54.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.207+0000 7ff273d2c640 1 -- 172.21.15.44:0/2273102289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26c0b0ae0 msgr2=0x7ff26c1e2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.207+0000 7ff273d2c640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26c0b0ae0 0x7ff26c1e2220 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff26000b3e0 tx=0x7ff26000b8a0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.207+0000 7ff273d2c640 1 -- 172.21.15.44:0/2273102289 shutdown_connections 2023-11-04T01:36:54.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.207+0000 7ff273d2c640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff25806ae40 0x7ff25806d300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.207+0000 7ff273d2c640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff26c159c70 0x7ff26c1e2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.207+0000 7ff273d2c640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26c0b0ae0 0x7ff26c1e2220 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.207+0000 7ff273d2c640 1 --2- 172.21.15.44:0/2273102289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff26c06db20 0x7ff26c0c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.207+0000 7ff273d2c640 1 -- 172.21.15.44:0/2273102289 >> 172.21.15.44:0/2273102289 conn(0x7ff26c0ce950 msgr2=0x7ff26c0b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.207+0000 7ff273d2c640 1 -- 172.21.15.44:0/2273102289 shutdown_connections 2023-11-04T01:36:54.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.207+0000 7ff273d2c640 1 -- 172.21.15.44:0/2273102289 wait complete. 2023-11-04T01:36:54.219 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:54.220 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:54.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.327+0000 7f6979a6f640 1 Processor -- start 2023-11-04T01:36:54.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.327+0000 7f6979a6f640 1 -- start start 2023-11-04T01:36:54.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.327+0000 7f6979a6f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6974153e60 0x7f697415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.327+0000 7f6979a6f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f69740cd6d0 0x7f6974161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.327+0000 7f6979a6f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69740cde60 con 0x7f69740b4880 2023-11-04T01:36:54.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.327+0000 7f6979a6f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6974160f90 con 0x7f6974153e60 2023-11-04T01:36:54.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.327+0000 7f6979a6f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697415e400 con 0x7f69740cd6d0 2023-11-04T01:36:54.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.328+0000 7f69737fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6974153e60 0x7f697415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.328+0000 7f6973fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f69740b4880 0x7f697406b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38378/0 (socket says 172.21.15.44:38378) 2023-11-04T01:36:54.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.328+0000 7f6973fff640 1 -- 172.21.15.44:0/1578616381 learned_addr learned my addr 172.21.15.44:0/1578616381 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:54.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.328+0000 7f6972ffd640 1 --2- 172.21.15.44:0/1578616381 >> v2:172.21.15.204:3300/0 conn(0x7f69740cd6d0 0x7f6974161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.328+0000 7f69737fe640 1 -- 172.21.15.44:0/1578616381 >> v2:172.21.15.204:3300/0 conn(0x7f69740cd6d0 msgr2=0x7f6974161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:54.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.328+0000 7f69737fe640 1 --2- 172.21.15.44:0/1578616381 >> v2:172.21.15.204:3300/0 conn(0x7f69740cd6d0 0x7f6974161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.328+0000 7f69737fe640 1 -- 172.21.15.44:0/1578616381 >> v1:172.21.15.44:6789/0 conn(0x7f69740b4880 legacy=0x7f697406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.328+0000 7f69737fe640 1 -- 172.21.15.44:0/1578616381 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6974161960 con 0x7f6974153e60 2023-11-04T01:36:54.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.329+0000 7f69737fe640 1 --2- 172.21.15.44:0/1578616381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6974153e60 0x7f697415dec0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f69740c9e80 tx=0x7f696402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0bda44881e54887 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.329+0000 7f69727fc640 1 -- 172.21.15.44:0/1578616381 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964031830 con 0x7f6974153e60 2023-11-04T01:36:54.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.329+0000 7f69727fc640 1 -- 172.21.15.44:0/1578616381 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6964031990 con 0x7f6974153e60 2023-11-04T01:36:54.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.329+0000 7f69727fc640 1 -- 172.21.15.44:0/1578616381 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964031d20 con 0x7f6974153e60 2023-11-04T01:36:54.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.329+0000 7f6979a6f640 1 -- 172.21.15.44:0/1578616381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6974153e60 msgr2=0x7f697415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.329+0000 7f6979a6f640 1 --2- 172.21.15.44:0/1578616381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6974153e60 0x7f697415dec0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f69740c9e80 tx=0x7f696402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.329+0000 7f6979a6f640 1 -- 172.21.15.44:0/1578616381 shutdown_connections 2023-11-04T01:36:54.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.329+0000 7f6979a6f640 1 --2- 172.21.15.44:0/1578616381 >> v2:172.21.15.204:3300/0 conn(0x7f69740cd6d0 0x7f6974161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.329+0000 7f6979a6f640 1 --2- 172.21.15.44:0/1578616381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6974153e60 0x7f697415dec0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.329+0000 7f6979a6f640 1 -- 172.21.15.44:0/1578616381 >> 172.21.15.44:0/1578616381 conn(0x7f69740cf880 msgr2=0x7f69740cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.329+0000 7f6979a6f640 1 -- 172.21.15.44:0/1578616381 shutdown_connections 2023-11-04T01:36:54.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.329+0000 7f6979a6f640 1 -- 172.21.15.44:0/1578616381 wait complete. 2023-11-04T01:36:54.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.331+0000 7f6979a6f640 1 Processor -- start 2023-11-04T01:36:54.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.331+0000 7f6979a6f640 1 -- start start 2023-11-04T01:36:54.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.331+0000 7f6979a6f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f69740b4880 0x7f69741f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.331+0000 7f6979a6f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f69740cd6d0 0x7f6974154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.331+0000 7f6979a6f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6974153e60 0x7f6974146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.331+0000 7f6979a6f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69741f3940 con 0x7f6974153e60 2023-11-04T01:36:54.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.331+0000 7f6979a6f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69740cbd80 con 0x7f69740cd6d0 2023-11-04T01:36:54.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.331+0000 7f6979a6f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6974154780 con 0x7f69740b4880 2023-11-04T01:36:54.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f6973fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6974153e60 0x7f6974146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f6973fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6974153e60 0x7f6974146030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39072/0 (socket says 172.21.15.44:39072) 2023-11-04T01:36:54.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f6973fff640 1 -- 172.21.15.44:0/4077266306 learned_addr learned my addr 172.21.15.44:0/4077266306 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:54.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f6972ffd640 1 --2- 172.21.15.44:0/4077266306 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f69740cd6d0 0x7f6974154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f69737fe640 1 --2- 172.21.15.44:0/4077266306 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f69740b4880 0x7f69741f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f6973fff640 1 -- 172.21.15.44:0/4077266306 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f69740b4880 msgr2=0x7f69741f3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f6973fff640 1 --2- 172.21.15.44:0/4077266306 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f69740b4880 0x7f69741f3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f6973fff640 1 -- 172.21.15.44:0/4077266306 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f69740cd6d0 msgr2=0x7f6974154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f6973fff640 1 --2- 172.21.15.44:0/4077266306 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f69740cd6d0 0x7f6974154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f6973fff640 1 -- 172.21.15.44:0/4077266306 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6964009400 con 0x7f6974153e60 2023-11-04T01:36:54.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f6973fff640 1 --2- 172.21.15.44:0/4077266306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6974153e60 0x7f6974146030 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f696c00cbf0 tx=0x7f696c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f696bfff640 1 -- 172.21.15.44:0/4077266306 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c00ad40 con 0x7f6974153e60 2023-11-04T01:36:54.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f696bfff640 1 -- 172.21.15.44:0/4077266306 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c012400 con 0x7f6974153e60 2023-11-04T01:36:54.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f6979a6f640 1 -- 172.21.15.44:0/4077266306 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69741f6380 con 0x7f6974153e60 2023-11-04T01:36:54.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f696bfff640 1 -- 172.21.15.44:0/4077266306 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c00aea0 con 0x7f6974153e60 2023-11-04T01:36:54.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.332+0000 7f6979a6f640 1 -- 172.21.15.44:0/4077266306 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69741f6940 con 0x7f6974153e60 2023-11-04T01:36:54.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.333+0000 7f6979a6f640 1 -- 172.21.15.44:0/4077266306 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69740cbf30 con 0x7f6974153e60 2023-11-04T01:36:54.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.334+0000 7f696bfff640 1 -- 172.21.15.44:0/4077266306 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f696c007070 con 0x7f6974153e60 2023-11-04T01:36:54.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.334+0000 7f696bfff640 1 --2- 172.21.15.44:0/4077266306 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f695406ae70 0x7f695406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.334+0000 7f696bfff640 1 -- 172.21.15.44:0/4077266306 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f696c0898d0 con 0x7f6974153e60 2023-11-04T01:36:54.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.335+0000 7f69737fe640 1 --2- 172.21.15.44:0/4077266306 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f695406ae70 0x7f695406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.335+0000 7f69737fe640 1 --2- 172.21.15.44:0/4077266306 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f695406ae70 0x7f695406d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6964036000 tx=0x7f696403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.339+0000 7f696bfff640 1 -- 172.21.15.44:0/4077266306 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f69740cbf30 con 0x7f6974153e60 2023-11-04T01:36:54.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.514+0000 7f6979a6f640 1 -- 172.21.15.44:0/4077266306 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f69740cbf30 con 0x7f6974153e60 2023-11-04T01:36:54.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.514+0000 7f696bfff640 1 -- 172.21.15.44:0/4077266306 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f69740cbf30 con 0x7f6974153e60 2023-11-04T01:36:54.516 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:36:54.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.516+0000 7f6979a6f640 1 -- 172.21.15.44:0/4077266306 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f695406ae70 msgr2=0x7f695406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.516+0000 7f6979a6f640 1 --2- 172.21.15.44:0/4077266306 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f695406ae70 0x7f695406d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6964036000 tx=0x7f696403c040 comp rx=0 tx=0).stop 2023-11-04T01:36:54.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.516+0000 7f6979a6f640 1 -- 172.21.15.44:0/4077266306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6974153e60 msgr2=0x7f6974146030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.516+0000 7f6979a6f640 1 --2- 172.21.15.44:0/4077266306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6974153e60 0x7f6974146030 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f696c00cbf0 tx=0x7f696c00a430 comp rx=0 tx=0).stop 2023-11-04T01:36:54.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.516+0000 7f6979a6f640 1 -- 172.21.15.44:0/4077266306 shutdown_connections 2023-11-04T01:36:54.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.516+0000 7f6979a6f640 1 --2- 172.21.15.44:0/4077266306 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f695406ae70 0x7f695406d330 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.516+0000 7f6979a6f640 1 --2- 172.21.15.44:0/4077266306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6974153e60 0x7f6974146030 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.516+0000 7f6979a6f640 1 --2- 172.21.15.44:0/4077266306 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f69740cd6d0 0x7f6974154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.516+0000 7f6979a6f640 1 --2- 172.21.15.44:0/4077266306 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f69740b4880 0x7f69741f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.516+0000 7f6979a6f640 1 -- 172.21.15.44:0/4077266306 >> 172.21.15.44:0/4077266306 conn(0x7f69740cf880 msgr2=0x7f69740cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.516+0000 7f6979a6f640 1 -- 172.21.15.44:0/4077266306 shutdown_connections 2023-11-04T01:36:54.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.516+0000 7f6979a6f640 1 -- 172.21.15.44:0/4077266306 wait complete. 2023-11-04T01:36:54.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:54.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.637+0000 7f2154797640 1 Processor -- start 2023-11-04T01:36:54.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.637+0000 7f2154797640 1 -- start start 2023-11-04T01:36:54.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2154797640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f214c0cd6d0 0x7f214c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2154797640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f214c0b4880 0x7f214c0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2154797640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c0cde60 con 0x7f214c153e60 2023-11-04T01:36:54.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2154797640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214c160f90 con 0x7f214c0cd6d0 2023-11-04T01:36:54.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2154797640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c161960 con 0x7f214c0b4880 2023-11-04T01:36:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2152533640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f214c153e60 0x7f214c15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38386/0 (socket says 172.21.15.44:38386) 2023-11-04T01:36:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2152533640 1 -- 172.21.15.44:0/2488987202 learned_addr learned my addr 172.21.15.44:0/2488987202 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2151d32640 1 --2- 172.21.15.44:0/2488987202 >> v2:172.21.15.204:3300/0 conn(0x7f214c0cd6d0 0x7f214c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2152d34640 1 --2- 172.21.15.44:0/2488987202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f214c0b4880 0x7f214c0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2151531640 1 -- 172.21.15.44:0/2488987202 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790077588 0 0) 0x7f214c0cde60 con 0x7f214c153e60 2023-11-04T01:36:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2151531640 1 -- 172.21.15.44:0/2488987202 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2138003520 con 0x7f214c153e60 2023-11-04T01:36:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2151531640 1 -- 172.21.15.44:0/2488987202 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 725840796 0 0) 0x7f2138003520 con 0x7f214c153e60 2023-11-04T01:36:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2151531640 1 -- 172.21.15.44:0/2488987202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f214c0b4880 msgr2=0x7f214c0b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2151531640 1 --2- 172.21.15.44:0/2488987202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f214c0b4880 0x7f214c0b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2151531640 1 -- 172.21.15.44:0/2488987202 >> v2:172.21.15.204:3300/0 conn(0x7f214c0cd6d0 msgr2=0x7f214c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2151531640 1 --2- 172.21.15.44:0/2488987202 >> v2:172.21.15.204:3300/0 conn(0x7f214c0cd6d0 0x7f214c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2151531640 1 -- 172.21.15.44:0/2488987202 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0b5220 con 0x7f214c153e60 2023-11-04T01:36:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2151531640 1 -- 172.21.15.44:0/2488987202 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f2148001670 con 0x7f214c153e60 2023-11-04T01:36:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2151531640 1 -- 172.21.15.44:0/2488987202 >> v1:172.21.15.44:6789/0 conn(0x7f214c153e60 legacy=0x7f214c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.638+0000 7f2151531640 1 --2- 172.21.15.44:0/2488987202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2138003970 0x7f2138003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.639+0000 7f2151531640 1 --2- 172.21.15.44:0/2488987202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21380047c0 0x7f2138004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.639+0000 7f2151531640 1 --2- 172.21.15.44:0/2488987202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f214c0b4880 0x7f2138005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.639+0000 7f2151531640 1 -- 172.21.15.44:0/2488987202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c160f90 con 0x7f2138003970 2023-11-04T01:36:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.639+0000 7f2151531640 1 -- 172.21.15.44:0/2488987202 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c161960 con 0x7f21380047c0 2023-11-04T01:36:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.639+0000 7f2151531640 1 -- 172.21.15.44:0/2488987202 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213800b980 con 0x7f214c0b4880 2023-11-04T01:36:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.639+0000 7f2152533640 1 --2- 172.21.15.44:0/2488987202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2138003970 0x7f2138003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.639+0000 7f2152d34640 1 --2- 172.21.15.44:0/2488987202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f214c0b4880 0x7f2138005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.639+0000 7f2151d32640 1 --2- 172.21.15.44:0/2488987202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21380047c0 0x7f2138004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.639+0000 7f2152533640 1 -- 172.21.15.44:0/2488987202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f214c0b4880 msgr2=0x7f2138005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.639+0000 7f2152533640 1 --2- 172.21.15.44:0/2488987202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f214c0b4880 0x7f2138005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.639+0000 7f2152533640 1 -- 172.21.15.44:0/2488987202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21380047c0 msgr2=0x7f2138004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:54.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.639+0000 7f2152533640 1 --2- 172.21.15.44:0/2488987202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21380047c0 0x7f2138004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.639+0000 7f2152533640 1 -- 172.21.15.44:0/2488987202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2138003520 con 0x7f2138003970 2023-11-04T01:36:54.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.640+0000 7f2152533640 1 --2- 172.21.15.44:0/2488987202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2138003970 0x7f2138003d90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f214800c210 tx=0x7f21380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6170f94efaa60d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.640+0000 7f2151531640 1 -- 172.21.15.44:0/2488987202 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2148005ad0 con 0x7f2138003970 2023-11-04T01:36:54.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.640+0000 7f2151531640 1 -- 172.21.15.44:0/2488987202 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2148005c30 con 0x7f2138003970 2023-11-04T01:36:54.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.640+0000 7f2151531640 1 -- 172.21.15.44:0/2488987202 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214802c8d0 con 0x7f2138003970 2023-11-04T01:36:54.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.640+0000 7f2154797640 1 -- 172.21.15.44:0/2488987202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2138003970 msgr2=0x7f2138003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.640+0000 7f2154797640 1 --2- 172.21.15.44:0/2488987202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2138003970 0x7f2138003d90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f214800c210 tx=0x7f21380057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.640+0000 7f2152d34640 1 -- 172.21.15.44:0/2488987202 reap_dead start 2023-11-04T01:36:54.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.640+0000 7f2154797640 1 -- 172.21.15.44:0/2488987202 shutdown_connections 2023-11-04T01:36:54.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.640+0000 7f2154797640 1 -- 172.21.15.44:0/2488987202 >> 172.21.15.44:0/2488987202 conn(0x7f214c0cf880 msgr2=0x7f214c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.640+0000 7f2154797640 1 -- 172.21.15.44:0/2488987202 shutdown_connections 2023-11-04T01:36:54.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.640+0000 7f2154797640 1 -- 172.21.15.44:0/2488987202 wait complete. 2023-11-04T01:36:54.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.642+0000 7f2154797640 1 Processor -- start 2023-11-04T01:36:54.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.642+0000 7f2154797640 1 -- start start 2023-11-04T01:36:54.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.642+0000 7f2154797640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2138003970 0x7f214c0c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.642+0000 7f2154797640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f214c0c92b0 0x7f214c1461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.642+0000 7f2154797640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f214c0c8040 0x7f214c0cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.642+0000 7f2154797640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c146710 con 0x7f214c0c8040 2023-11-04T01:36:54.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.642+0000 7f2154797640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0c9730 con 0x7f2138003970 2023-11-04T01:36:54.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.642+0000 7f2154797640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0c6fa0 con 0x7f214c0c92b0 2023-11-04T01:36:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.642+0000 7f2152d34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f214c0c8040 0x7f214c0cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2152d34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f214c0c8040 0x7f214c0cbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39084/0 (socket says 172.21.15.44:39084) 2023-11-04T01:36:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2152d34640 1 -- 172.21.15.44:0/896117012 learned_addr learned my addr 172.21.15.44:0/896117012 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2152533640 1 --2- 172.21.15.44:0/896117012 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2138003970 0x7f214c0c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2151d32640 1 --2- 172.21.15.44:0/896117012 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f214c0c92b0 0x7f214c1461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2152d34640 1 -- 172.21.15.44:0/896117012 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f214c0c92b0 msgr2=0x7f214c1461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2152d34640 1 --2- 172.21.15.44:0/896117012 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f214c0c92b0 0x7f214c1461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2152d34640 1 -- 172.21.15.44:0/896117012 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2138003970 msgr2=0x7f214c0c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2152d34640 1 --2- 172.21.15.44:0/896117012 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2138003970 0x7f214c0c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2152d34640 1 -- 172.21.15.44:0/896117012 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0c7280 con 0x7f214c0c8040 2023-11-04T01:36:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2151d32640 1 --2- 172.21.15.44:0/896117012 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f214c0c92b0 0x7f214c1461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2152d34640 1 --2- 172.21.15.44:0/896117012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f214c0c8040 0x7f214c0cbf90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f214c06c900 tx=0x7f214400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2142ffd640 1 -- 172.21.15.44:0/896117012 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400e040 con 0x7f214c0c8040 2023-11-04T01:36:54.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2142ffd640 1 -- 172.21.15.44:0/896117012 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214400f040 con 0x7f214c0c8040 2023-11-04T01:36:54.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2154797640 1 -- 172.21.15.44:0/896117012 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c0c7560 con 0x7f214c0c8040 2023-11-04T01:36:54.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2142ffd640 1 -- 172.21.15.44:0/896117012 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144015430 con 0x7f214c0c8040 2023-11-04T01:36:54.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.643+0000 7f2154797640 1 -- 172.21.15.44:0/896117012 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c0c7b20 con 0x7f214c0c8040 2023-11-04T01:36:54.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.644+0000 7f2154797640 1 -- 172.21.15.44:0/896117012 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214c0c7d40 con 0x7f214c0c8040 2023-11-04T01:36:54.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.645+0000 7f2142ffd640 1 -- 172.21.15.44:0/896117012 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2144015590 con 0x7f214c0c8040 2023-11-04T01:36:54.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.645+0000 7f2142ffd640 1 --2- 172.21.15.44:0/896117012 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f213006ae70 0x7f213006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.645+0000 7f2142ffd640 1 -- 172.21.15.44:0/896117012 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f214408a010 con 0x7f214c0c8040 2023-11-04T01:36:54.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.645+0000 7f2152533640 1 --2- 172.21.15.44:0/896117012 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f213006ae70 0x7f213006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.646+0000 7f2152533640 1 --2- 172.21.15.44:0/896117012 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f213006ae70 0x7f213006d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2148034000 tx=0x7f2148007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.649+0000 7f2142ffd640 1 -- 172.21.15.44:0/896117012 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2144054d90 con 0x7f214c0c8040 2023-11-04T01:36:54.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.823+0000 7f2154797640 1 -- 172.21.15.44:0/896117012 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f214c074290 con 0x7f214c0c8040 2023-11-04T01:36:54.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.823+0000 7f2142ffd640 1 -- 172.21.15.44:0/896117012 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21440583b0 con 0x7f214c0c8040 2023-11-04T01:36:54.825 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:54.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.825+0000 7f2154797640 1 -- 172.21.15.44:0/896117012 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f213006ae70 msgr2=0x7f213006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.825+0000 7f2154797640 1 --2- 172.21.15.44:0/896117012 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f213006ae70 0x7f213006d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2148034000 tx=0x7f2148007000 comp rx=0 tx=0).stop 2023-11-04T01:36:54.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.825+0000 7f2154797640 1 -- 172.21.15.44:0/896117012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f214c0c8040 msgr2=0x7f214c0cbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.825+0000 7f2154797640 1 --2- 172.21.15.44:0/896117012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f214c0c8040 0x7f214c0cbf90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f214c06c900 tx=0x7f214400f580 comp rx=0 tx=0).stop 2023-11-04T01:36:54.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.825+0000 7f2154797640 1 -- 172.21.15.44:0/896117012 shutdown_connections 2023-11-04T01:36:54.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.825+0000 7f2154797640 1 --2- 172.21.15.44:0/896117012 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f213006ae70 0x7f213006d330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.825+0000 7f2154797640 1 --2- 172.21.15.44:0/896117012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f214c0c8040 0x7f214c0cbf90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.825+0000 7f2154797640 1 --2- 172.21.15.44:0/896117012 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f214c0c92b0 0x7f214c1461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.825+0000 7f2154797640 1 --2- 172.21.15.44:0/896117012 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2138003970 0x7f214c0c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.825+0000 7f2154797640 1 -- 172.21.15.44:0/896117012 >> 172.21.15.44:0/896117012 conn(0x7f214c0cf880 msgr2=0x7f214c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.825+0000 7f2154797640 1 -- 172.21.15.44:0/896117012 shutdown_connections 2023-11-04T01:36:54.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.825+0000 7f2154797640 1 -- 172.21.15.44:0/896117012 wait complete. 2023-11-04T01:36:54.838 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:54.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.945+0000 7f80419a9640 1 Processor -- start 2023-11-04T01:36:54.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.945+0000 7f80419a9640 1 -- start start 2023-11-04T01:36:54.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.946+0000 7f80419a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f803c0b2d30 0x7f803c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.946+0000 7f80419a9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f803c06c1d0 0x7f803c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.946+0000 7f80419a9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803c06ca40 con 0x7f803c160430 2023-11-04T01:36:54.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.946+0000 7f80419a9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803c0cb580 con 0x7f803c06c1d0 2023-11-04T01:36:54.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.946+0000 7f80419a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c06cd20 con 0x7f803c0b2d30 2023-11-04T01:36:54.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.946+0000 7f803a7fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f803c0b2d30 0x7f803c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.946+0000 7f803b7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f803c06c1d0 0x7f803c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.946+0000 7f803b7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f803c06c1d0 0x7f803c0cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:35636/0 (socket says 172.21.15.44:35636) 2023-11-04T01:36:54.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.946+0000 7f803a7fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f803c0b2d30 0x7f803c06bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:58982/0 (socket says 172.21.15.44:58982) 2023-11-04T01:36:54.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.946+0000 7f803b7fe640 1 -- 172.21.15.44:0/87207839 learned_addr learned my addr 172.21.15.44:0/87207839 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:54.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.947+0000 7f803a7fc640 1 -- 172.21.15.44:0/87207839 >> v2:172.21.15.204:3300/0 conn(0x7f803c06c1d0 msgr2=0x7f803c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:54.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.947+0000 7f803a7fc640 1 --2- 172.21.15.44:0/87207839 >> v2:172.21.15.204:3300/0 conn(0x7f803c06c1d0 0x7f803c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.947+0000 7f803a7fc640 1 -- 172.21.15.44:0/87207839 >> v1:172.21.15.204:6789/0 conn(0x7f803c160430 legacy=0x7f803c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.947+0000 7f8039ffb640 1 -- 172.21.15.44:0/87207839 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378263833 0 0) 0x7f803c06ca40 con 0x7f803c160430 2023-11-04T01:36:54.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.947+0000 7f803a7fc640 1 -- 172.21.15.44:0/87207839 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c06d000 con 0x7f803c0b2d30 2023-11-04T01:36:54.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.947+0000 7f803b7fe640 1 --2- 172.21.15.44:0/87207839 >> v2:172.21.15.204:3300/0 conn(0x7f803c06c1d0 0x7f803c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:54.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.947+0000 7f803a7fc640 1 --2- 172.21.15.44:0/87207839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f803c0b2d30 0x7f803c06bc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80300097a0 tx=0x7f803002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=597537d0d776085 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.948+0000 7f8039ffb640 1 -- 172.21.15.44:0/87207839 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030031830 con 0x7f803c0b2d30 2023-11-04T01:36:54.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.948+0000 7f8039ffb640 1 -- 172.21.15.44:0/87207839 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8030031990 con 0x7f803c0b2d30 2023-11-04T01:36:54.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.948+0000 7f8039ffb640 1 -- 172.21.15.44:0/87207839 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030031d20 con 0x7f803c0b2d30 2023-11-04T01:36:54.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.948+0000 7f80419a9640 1 -- 172.21.15.44:0/87207839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f803c0b2d30 msgr2=0x7f803c06bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.948+0000 7f80419a9640 1 --2- 172.21.15.44:0/87207839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f803c0b2d30 0x7f803c06bc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80300097a0 tx=0x7f803002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.948+0000 7f80419a9640 1 -- 172.21.15.44:0/87207839 shutdown_connections 2023-11-04T01:36:54.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.948+0000 7f80419a9640 1 --2- 172.21.15.44:0/87207839 >> v2:172.21.15.204:3300/0 conn(0x7f803c06c1d0 0x7f803c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.948+0000 7f80419a9640 1 --2- 172.21.15.44:0/87207839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f803c0b2d30 0x7f803c06bc90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.948+0000 7f80419a9640 1 -- 172.21.15.44:0/87207839 >> 172.21.15.44:0/87207839 conn(0x7f803c06ea20 msgr2=0x7f803c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.948+0000 7f80419a9640 1 -- 172.21.15.44:0/87207839 shutdown_connections 2023-11-04T01:36:54.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.948+0000 7f80419a9640 1 -- 172.21.15.44:0/87207839 wait complete. 2023-11-04T01:36:54.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.949+0000 7f80419a9640 1 Processor -- start 2023-11-04T01:36:54.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.950+0000 7f80419a9640 1 -- start start 2023-11-04T01:36:54.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.950+0000 7f80419a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f803c06c1d0 0x7f803c0c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.950+0000 7f80419a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f803c0b2d30 0x7f803c0b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.950+0000 7f80419a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f803c160430 0x7f803c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.950+0000 7f80419a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c1f69a0 con 0x7f803c160430 2023-11-04T01:36:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.950+0000 7f80419a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0b13d0 con 0x7f803c06c1d0 2023-11-04T01:36:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.950+0000 7f80419a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0b16b0 con 0x7f803c0b2d30 2023-11-04T01:36:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.950+0000 7f803b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f803c160430 0x7f803c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.950+0000 7f803b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f803c160430 0x7f803c0b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39098/0 (socket says 172.21.15.44:39098) 2023-11-04T01:36:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.950+0000 7f803b7fe640 1 -- 172.21.15.44:0/1089850054 learned_addr learned my addr 172.21.15.44:0/1089850054 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.951+0000 7f803a7fc640 1 --2- 172.21.15.44:0/1089850054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f803c0b2d30 0x7f803c0b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.951+0000 7f803affd640 1 --2- 172.21.15.44:0/1089850054 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f803c06c1d0 0x7f803c0c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.951+0000 7f803b7fe640 1 -- 172.21.15.44:0/1089850054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f803c0b2d30 msgr2=0x7f803c0b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.951+0000 7f803b7fe640 1 --2- 172.21.15.44:0/1089850054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f803c0b2d30 0x7f803c0b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.951+0000 7f803b7fe640 1 -- 172.21.15.44:0/1089850054 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f803c06c1d0 msgr2=0x7f803c0c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.951+0000 7f803b7fe640 1 --2- 172.21.15.44:0/1089850054 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f803c06c1d0 0x7f803c0c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.951+0000 7f803b7fe640 1 -- 172.21.15.44:0/1089850054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80340094d0 con 0x7f803c160430 2023-11-04T01:36:54.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.951+0000 7f803b7fe640 1 --2- 172.21.15.44:0/1089850054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f803c160430 0x7f803c0b2170 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f803400e930 tx=0x7f803400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.951+0000 7f8023fff640 1 -- 172.21.15.44:0/1089850054 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034009720 con 0x7f803c160430 2023-11-04T01:36:54.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.951+0000 7f8023fff640 1 -- 172.21.15.44:0/1089850054 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803400ca00 con 0x7f803c160430 2023-11-04T01:36:54.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.951+0000 7f80419a9640 1 -- 172.21.15.44:0/1089850054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8030009400 con 0x7f803c160430 2023-11-04T01:36:54.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.951+0000 7f8023fff640 1 -- 172.21.15.44:0/1089850054 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803400cd90 con 0x7f803c160430 2023-11-04T01:36:54.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.951+0000 7f80419a9640 1 -- 172.21.15.44:0/1089850054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803c0b1c70 con 0x7f803c160430 2023-11-04T01:36:54.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.952+0000 7f80419a9640 1 -- 172.21.15.44:0/1089850054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803c074290 con 0x7f803c160430 2023-11-04T01:36:54.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.953+0000 7f8023fff640 1 -- 172.21.15.44:0/1089850054 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8034013470 con 0x7f803c160430 2023-11-04T01:36:54.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.953+0000 7f8023fff640 1 --2- 172.21.15.44:0/1089850054 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f802806ae70 0x7f802806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.953+0000 7f8023fff640 1 -- 172.21.15.44:0/1089850054 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f80340895a0 con 0x7f803c160430 2023-11-04T01:36:54.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.953+0000 7f803affd640 1 --2- 172.21.15.44:0/1089850054 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f802806ae70 0x7f802806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.954+0000 7f803affd640 1 --2- 172.21.15.44:0/1089850054 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f802806ae70 0x7f802806d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f802c0012e0 tx=0x7f802c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:54.957+0000 7f8023fff640 1 -- 172.21.15.44:0/1089850054 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8034054340 con 0x7f803c160430 2023-11-04T01:36:55.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.133+0000 7f80419a9640 1 -- 172.21.15.44:0/1089850054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f803c0b6b20 con 0x7f803c160430 2023-11-04T01:36:55.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.133+0000 7f8023fff640 1 -- 172.21.15.44:0/1089850054 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8034057960 con 0x7f803c160430 2023-11-04T01:36:55.135 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:36:55.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.135+0000 7f80419a9640 1 -- 172.21.15.44:0/1089850054 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f802806ae70 msgr2=0x7f802806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.135+0000 7f80419a9640 1 --2- 172.21.15.44:0/1089850054 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f802806ae70 0x7f802806d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f802c0012e0 tx=0x7f802c009040 comp rx=0 tx=0).stop 2023-11-04T01:36:55.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.135+0000 7f80419a9640 1 -- 172.21.15.44:0/1089850054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f803c160430 msgr2=0x7f803c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.135+0000 7f80419a9640 1 --2- 172.21.15.44:0/1089850054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f803c160430 0x7f803c0b2170 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f803400e930 tx=0x7f803400edf0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.135+0000 7f80419a9640 1 -- 172.21.15.44:0/1089850054 shutdown_connections 2023-11-04T01:36:55.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.135+0000 7f80419a9640 1 --2- 172.21.15.44:0/1089850054 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f802806ae70 0x7f802806d330 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.135+0000 7f80419a9640 1 --2- 172.21.15.44:0/1089850054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f803c160430 0x7f803c0b2170 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.135+0000 7f80419a9640 1 --2- 172.21.15.44:0/1089850054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f803c0b2d30 0x7f803c0b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.135+0000 7f80419a9640 1 --2- 172.21.15.44:0/1089850054 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f803c06c1d0 0x7f803c0c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.135+0000 7f80419a9640 1 -- 172.21.15.44:0/1089850054 >> 172.21.15.44:0/1089850054 conn(0x7f803c06ea20 msgr2=0x7f803c0ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.135+0000 7f80419a9640 1 -- 172.21.15.44:0/1089850054 shutdown_connections 2023-11-04T01:36:55.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.135+0000 7f80419a9640 1 -- 172.21.15.44:0/1089850054 wait complete. 2023-11-04T01:36:55.148 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:55.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.256+0000 7f1bf1941640 1 Processor -- start 2023-11-04T01:36:55.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.257+0000 7f1bf1941640 1 -- start start 2023-11-04T01:36:55.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.257+0000 7f1bf1941640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1bec0b4880 0x7f1bec0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.257+0000 7f1bf1941640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bec0cde60 con 0x7f1bec0cd6d0 2023-11-04T01:36:55.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.257+0000 7f1bf1941640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bec160f90 con 0x7f1bec153e60 2023-11-04T01:36:55.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.257+0000 7f1bf1941640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bec0b5200 con 0x7f1bec0b4880 2023-11-04T01:36:55.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.257+0000 7f1bea7fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1bec0cd6d0 0x7f1bec161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38396/0 (socket says 172.21.15.44:38396) 2023-11-04T01:36:55.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.257+0000 7f1bea7fc640 1 -- 172.21.15.44:0/744465956 learned_addr learned my addr 172.21.15.44:0/744465956 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:55.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1beb7fe640 1 --2- 172.21.15.44:0/744465956 >> v2:172.21.15.204:3300/0 conn(0x7f1bec0b4880 0x7f1bec0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1be9ffb640 1 -- 172.21.15.44:0/744465956 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315829579 0 0) 0x7f1bec0cde60 con 0x7f1bec0cd6d0 2023-11-04T01:36:55.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1be9ffb640 1 -- 172.21.15.44:0/744465956 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bd4003520 con 0x7f1bec0cd6d0 2023-11-04T01:36:55.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1be9ffb640 1 -- 172.21.15.44:0/744465956 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3448191781 0 0) 0x7f1bd4003520 con 0x7f1bec0cd6d0 2023-11-04T01:36:55.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1be9ffb640 1 -- 172.21.15.44:0/744465956 >> v2:172.21.15.204:3300/0 conn(0x7f1bec0b4880 msgr2=0x7f1bec0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1be9ffb640 1 --2- 172.21.15.44:0/744465956 >> v2:172.21.15.204:3300/0 conn(0x7f1bec0b4880 0x7f1bec0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1be9ffb640 1 -- 172.21.15.44:0/744465956 >> v1:172.21.15.204:6789/0 conn(0x7f1bec153e60 legacy=0x7f1bec15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1be9ffb640 1 -- 172.21.15.44:0/744465956 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec0ce090 con 0x7f1bec0cd6d0 2023-11-04T01:36:55.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1be9ffb640 1 -- 172.21.15.44:0/744465956 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f1be0001670 con 0x7f1bec0cd6d0 2023-11-04T01:36:55.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1beb7fe640 1 --2- 172.21.15.44:0/744465956 >> v2:172.21.15.204:3300/0 conn(0x7f1bec0b4880 0x7f1bec0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:55.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1be9ffb640 1 -- 172.21.15.44:0/744465956 >> v1:172.21.15.44:6789/0 conn(0x7f1bec0cd6d0 legacy=0x7f1bec161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1be9ffb640 1 --2- 172.21.15.44:0/744465956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd4003970 0x7f1bd4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1be9ffb640 1 --2- 172.21.15.44:0/744465956 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bd40047c0 0x7f1bd4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1be9ffb640 1 --2- 172.21.15.44:0/744465956 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bd4005180 0x7f1bd400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1be9ffb640 1 -- 172.21.15.44:0/744465956 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0b5200 con 0x7f1bd4003970 2023-11-04T01:36:55.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1be9ffb640 1 -- 172.21.15.44:0/744465956 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd400c020 con 0x7f1bd40047c0 2023-11-04T01:36:55.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1be9ffb640 1 -- 172.21.15.44:0/744465956 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd400c1e0 con 0x7f1bd4005180 2023-11-04T01:36:55.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1beaffd640 1 --2- 172.21.15.44:0/744465956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd4003970 0x7f1bd4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1bea7fc640 1 --2- 172.21.15.44:0/744465956 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bd40047c0 0x7f1bd4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1beb7fe640 1 --2- 172.21.15.44:0/744465956 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bd4005180 0x7f1bd400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.258+0000 7f1beaffd640 1 -- 172.21.15.44:0/744465956 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bd4005180 msgr2=0x7f1bd400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.259+0000 7f1beaffd640 1 --2- 172.21.15.44:0/744465956 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bd4005180 0x7f1bd400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.259+0000 7f1beaffd640 1 -- 172.21.15.44:0/744465956 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bd40047c0 msgr2=0x7f1bd4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.259+0000 7f1beaffd640 1 --2- 172.21.15.44:0/744465956 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bd40047c0 0x7f1bd4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.259+0000 7f1beaffd640 1 -- 172.21.15.44:0/744465956 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd4003520 con 0x7f1bd4003970 2023-11-04T01:36:55.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.259+0000 7f1beb7fe640 1 --2- 172.21.15.44:0/744465956 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bd4005180 0x7f1bd400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:55.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.259+0000 7f1beb7fe640 1 -- 172.21.15.44:0/744465956 reap_dead start 2023-11-04T01:36:55.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.259+0000 7f1beaffd640 1 --2- 172.21.15.44:0/744465956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd4003970 0x7f1bd4003d90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc001e50 tx=0x7f1bd40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc39c9af3af5875 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.259+0000 7f1be9ffb640 1 -- 172.21.15.44:0/744465956 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc003b70 con 0x7f1bd4003970 2023-11-04T01:36:55.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.259+0000 7f1be9ffb640 1 -- 172.21.15.44:0/744465956 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc003cd0 con 0x7f1bd4003970 2023-11-04T01:36:55.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.259+0000 7f1be9ffb640 1 -- 172.21.15.44:0/744465956 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc005310 con 0x7f1bd4003970 2023-11-04T01:36:55.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.260+0000 7f1bf1941640 1 -- 172.21.15.44:0/744465956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd4003970 msgr2=0x7f1bd4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.260+0000 7f1bf1941640 1 --2- 172.21.15.44:0/744465956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd4003970 0x7f1bd4003d90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc001e50 tx=0x7f1bd40057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.260+0000 7f1bf1941640 1 -- 172.21.15.44:0/744465956 shutdown_connections 2023-11-04T01:36:55.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.260+0000 7f1bf1941640 1 --2- 172.21.15.44:0/744465956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd4003970 0x7f1bd4003d90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.260+0000 7f1bf1941640 1 -- 172.21.15.44:0/744465956 >> 172.21.15.44:0/744465956 conn(0x7f1bec0cf880 msgr2=0x7f1bec0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.260+0000 7f1bf1941640 1 -- 172.21.15.44:0/744465956 shutdown_connections 2023-11-04T01:36:55.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.260+0000 7f1bf1941640 1 -- 172.21.15.44:0/744465956 wait complete. 2023-11-04T01:36:55.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.261+0000 7f1bf1941640 1 Processor -- start 2023-11-04T01:36:55.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.261+0000 7f1bf1941640 1 -- start start 2023-11-04T01:36:55.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.262+0000 7f1bf1941640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bd4003970 0x7f1bec152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.262+0000 7f1bf1941640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bec0cbc50 0x7f1bec14fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.262+0000 7f1bf1941640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bec0cc0d0 0x7f1bec150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.262+0000 7f1bf1941640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec1506c0 con 0x7f1bec0cc0d0 2023-11-04T01:36:55.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.262+0000 7f1bf1941640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0ca2b0 con 0x7f1bec0cbc50 2023-11-04T01:36:55.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.262+0000 7f1bf1941640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0ca590 con 0x7f1bd4003970 2023-11-04T01:36:55.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.262+0000 7f1beb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bec0cc0d0 0x7f1bec150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.262+0000 7f1beb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bec0cc0d0 0x7f1bec150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39128/0 (socket says 172.21.15.44:39128) 2023-11-04T01:36:55.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.262+0000 7f1beb7fe640 1 -- 172.21.15.44:0/600860480 learned_addr learned my addr 172.21.15.44:0/600860480 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:55.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.262+0000 7f1bea7fc640 1 --2- 172.21.15.44:0/600860480 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bec0cbc50 0x7f1bec14fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.262+0000 7f1beb7fe640 1 -- 172.21.15.44:0/600860480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bd4003970 msgr2=0x7f1bec152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.262+0000 7f1beaffd640 1 --2- 172.21.15.44:0/600860480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bd4003970 0x7f1bec152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.262+0000 7f1beb7fe640 1 --2- 172.21.15.44:0/600860480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bd4003970 0x7f1bec152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.262+0000 7f1beb7fe640 1 -- 172.21.15.44:0/600860480 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bec0cbc50 msgr2=0x7f1bec14fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.263+0000 7f1beb7fe640 1 --2- 172.21.15.44:0/600860480 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bec0cbc50 0x7f1bec14fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.263+0000 7f1beb7fe640 1 -- 172.21.15.44:0/600860480 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec0ca870 con 0x7f1bec0cc0d0 2023-11-04T01:36:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.263+0000 7f1bea7fc640 1 --2- 172.21.15.44:0/600860480 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bec0cbc50 0x7f1bec14fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.263+0000 7f1beb7fe640 1 --2- 172.21.15.44:0/600860480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bec0cc0d0 0x7f1bec150180 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1bec06c900 tx=0x7f1be4011990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.263+0000 7f1bd3fff640 1 -- 172.21.15.44:0/600860480 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be4004440 con 0x7f1bec0cc0d0 2023-11-04T01:36:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.263+0000 7f1bd3fff640 1 -- 172.21.15.44:0/600860480 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be4003610 con 0x7f1bec0cc0d0 2023-11-04T01:36:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.263+0000 7f1bf1941640 1 -- 172.21.15.44:0/600860480 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bec0cab50 con 0x7f1bec0cc0d0 2023-11-04T01:36:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.263+0000 7f1bd3fff640 1 -- 172.21.15.44:0/600860480 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be4003980 con 0x7f1bec0cc0d0 2023-11-04T01:36:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.263+0000 7f1bf1941640 1 -- 172.21.15.44:0/600860480 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bec0c9ed0 con 0x7f1bec0cc0d0 2023-11-04T01:36:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.264+0000 7f1bf1941640 1 -- 172.21.15.44:0/600860480 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bec074290 con 0x7f1bec0cc0d0 2023-11-04T01:36:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.264+0000 7f1bd3fff640 1 -- 172.21.15.44:0/600860480 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1be4003ae0 con 0x7f1bec0cc0d0 2023-11-04T01:36:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.265+0000 7f1bd3fff640 1 --2- 172.21.15.44:0/600860480 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1bd806aea0 0x7f1bd806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.265+0000 7f1bd3fff640 1 -- 172.21.15.44:0/600860480 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1be4089c30 con 0x7f1bec0cc0d0 2023-11-04T01:36:55.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.265+0000 7f1beaffd640 1 --2- 172.21.15.44:0/600860480 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1bd806aea0 0x7f1bd806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.266+0000 7f1beaffd640 1 --2- 172.21.15.44:0/600860480 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1bd806aea0 0x7f1bd806d360 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc034000 tx=0x7f1bdc009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.269+0000 7f1bd3fff640 1 -- 172.21.15.44:0/600860480 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1be4054920 con 0x7f1bec0cc0d0 2023-11-04T01:36:55.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.444+0000 7f1bf1941640 1 -- 172.21.15.44:0/600860480 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1bec0d0b80 con 0x7f1bec0cc0d0 2023-11-04T01:36:55.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.444+0000 7f1bd3fff640 1 -- 172.21.15.44:0/600860480 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1be4057f40 con 0x7f1bec0cc0d0 2023-11-04T01:36:55.446 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:55.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.446+0000 7f1bf1941640 1 -- 172.21.15.44:0/600860480 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1bd806aea0 msgr2=0x7f1bd806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.446+0000 7f1bf1941640 1 --2- 172.21.15.44:0/600860480 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1bd806aea0 0x7f1bd806d360 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc034000 tx=0x7f1bdc009030 comp rx=0 tx=0).stop 2023-11-04T01:36:55.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.446+0000 7f1bf1941640 1 -- 172.21.15.44:0/600860480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bec0cc0d0 msgr2=0x7f1bec150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.446+0000 7f1bf1941640 1 --2- 172.21.15.44:0/600860480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bec0cc0d0 0x7f1bec150180 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1bec06c900 tx=0x7f1be4011990 comp rx=0 tx=0).stop 2023-11-04T01:36:55.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.446+0000 7f1bf1941640 1 -- 172.21.15.44:0/600860480 shutdown_connections 2023-11-04T01:36:55.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.446+0000 7f1bf1941640 1 --2- 172.21.15.44:0/600860480 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1bd806aea0 0x7f1bd806d360 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.446+0000 7f1bf1941640 1 --2- 172.21.15.44:0/600860480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bec0cc0d0 0x7f1bec150180 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.446+0000 7f1bf1941640 1 --2- 172.21.15.44:0/600860480 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bec0cbc50 0x7f1bec14fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.446+0000 7f1bf1941640 1 --2- 172.21.15.44:0/600860480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bd4003970 0x7f1bec152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.446+0000 7f1bf1941640 1 -- 172.21.15.44:0/600860480 >> 172.21.15.44:0/600860480 conn(0x7f1bec0cf880 msgr2=0x7f1bec15fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.446+0000 7f1bf1941640 1 -- 172.21.15.44:0/600860480 shutdown_connections 2023-11-04T01:36:55.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.446+0000 7f1bf1941640 1 -- 172.21.15.44:0/600860480 wait complete. 2023-11-04T01:36:55.459 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:55.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.564+0000 7fb12da44640 1 Processor -- start 2023-11-04T01:36:55.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.564+0000 7fb12da44640 1 -- start start 2023-11-04T01:36:55.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.565+0000 7fb12da44640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb128160430 0x7fb1280b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.565+0000 7fb12da44640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb12806c3a0 0x7fb1280cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.565+0000 7fb12da44640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1280b2fc0 con 0x7fb1280b2b60 2023-11-04T01:36:55.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.565+0000 7fb12da44640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1280cb580 con 0x7fb128160430 2023-11-04T01:36:55.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.565+0000 7fb12da44640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12806c7d0 con 0x7fb12806c3a0 2023-11-04T01:36:55.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.565+0000 7fb126ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb128160430 0x7fb1280b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.565+0000 7fb126ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb128160430 0x7fb1280b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39140/0 (socket says 172.21.15.44:39140) 2023-11-04T01:36:55.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.565+0000 7fb126ffd640 1 -- 172.21.15.44:0/2965201590 learned_addr learned my addr 172.21.15.44:0/2965201590 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:55.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.565+0000 7fb1277fe640 1 --2- 172.21.15.44:0/2965201590 >> v2:172.21.15.204:3300/0 conn(0x7fb12806c3a0 0x7fb1280cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.565+0000 7fb126ffd640 1 -- 172.21.15.44:0/2965201590 >> v2:172.21.15.204:3300/0 conn(0x7fb12806c3a0 msgr2=0x7fb1280cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.565+0000 7fb126ffd640 1 --2- 172.21.15.44:0/2965201590 >> v2:172.21.15.204:3300/0 conn(0x7fb12806c3a0 0x7fb1280cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.565+0000 7fb126ffd640 1 -- 172.21.15.44:0/2965201590 >> v1:172.21.15.204:6789/0 conn(0x7fb1280b2b60 legacy=0x7fb12806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.565+0000 7fb126ffd640 1 -- 172.21.15.44:0/2965201590 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12806ca40 con 0x7fb128160430 2023-11-04T01:36:55.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.566+0000 7fb126ffd640 1 --2- 172.21.15.44:0/2965201590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb128160430 0x7fb1280b2620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb1280c4600 tx=0x7fb11802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4568e7a3bedced8e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.566+0000 7fb125ffb640 1 -- 172.21.15.44:0/2965201590 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11802ca80 con 0x7fb128160430 2023-11-04T01:36:55.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.566+0000 7fb125ffb640 1 -- 172.21.15.44:0/2965201590 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11802cbe0 con 0x7fb128160430 2023-11-04T01:36:55.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.566+0000 7fb125ffb640 1 -- 172.21.15.44:0/2965201590 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1180343f0 con 0x7fb128160430 2023-11-04T01:36:55.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.567+0000 7fb12da44640 1 -- 172.21.15.44:0/2965201590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb128160430 msgr2=0x7fb1280b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.567+0000 7fb12da44640 1 --2- 172.21.15.44:0/2965201590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb128160430 0x7fb1280b2620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb1280c4600 tx=0x7fb11802bee0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.567+0000 7fb12da44640 1 -- 172.21.15.44:0/2965201590 shutdown_connections 2023-11-04T01:36:55.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.567+0000 7fb12da44640 1 --2- 172.21.15.44:0/2965201590 >> v2:172.21.15.204:3300/0 conn(0x7fb12806c3a0 0x7fb1280cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.567+0000 7fb12da44640 1 --2- 172.21.15.44:0/2965201590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb128160430 0x7fb1280b2620 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.567+0000 7fb12da44640 1 -- 172.21.15.44:0/2965201590 >> 172.21.15.44:0/2965201590 conn(0x7fb12806ea20 msgr2=0x7fb12806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.567+0000 7fb12da44640 1 -- 172.21.15.44:0/2965201590 shutdown_connections 2023-11-04T01:36:55.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.567+0000 7fb12da44640 1 -- 172.21.15.44:0/2965201590 wait complete. 2023-11-04T01:36:55.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.568+0000 7fb12da44640 1 Processor -- start 2023-11-04T01:36:55.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.568+0000 7fb12da44640 1 -- start start 2023-11-04T01:36:55.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.569+0000 7fb12da44640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb12806c3a0 0x7fb1280c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.569+0000 7fb12da44640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1280b2b60 0x7fb1280b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.569+0000 7fb12da44640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb128160430 0x7fb128152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.569+0000 7fb12da44640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb128152690 con 0x7fb1280b2b60 2023-11-04T01:36:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.569+0000 7fb12da44640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280b3f10 con 0x7fb12806c3a0 2023-11-04T01:36:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.569+0000 7fb12da44640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280b41f0 con 0x7fb128160430 2023-11-04T01:36:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.569+0000 7fb1267fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1280b2b60 0x7fb1280b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.569+0000 7fb1267fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1280b2b60 0x7fb1280b4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39156/0 (socket says 172.21.15.44:39156) 2023-11-04T01:36:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.569+0000 7fb1267fc640 1 -- 172.21.15.44:0/3025669567 learned_addr learned my addr 172.21.15.44:0/3025669567 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.569+0000 7fb126ffd640 1 --2- 172.21.15.44:0/3025669567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb12806c3a0 0x7fb1280c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.569+0000 7fb1277fe640 1 --2- 172.21.15.44:0/3025669567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb128160430 0x7fb128152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.569+0000 7fb1267fc640 1 -- 172.21.15.44:0/3025669567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb128160430 msgr2=0x7fb128152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.570+0000 7fb1267fc640 1 --2- 172.21.15.44:0/3025669567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb128160430 0x7fb128152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.570+0000 7fb1267fc640 1 -- 172.21.15.44:0/3025669567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb12806c3a0 msgr2=0x7fb1280c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.570+0000 7fb1267fc640 1 --2- 172.21.15.44:0/3025669567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb12806c3a0 0x7fb1280c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.570+0000 7fb1267fc640 1 -- 172.21.15.44:0/3025669567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb118009b30 con 0x7fb1280b2b60 2023-11-04T01:36:55.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.570+0000 7fb1277fe640 1 --2- 172.21.15.44:0/3025669567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb128160430 0x7fb128152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:55.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.570+0000 7fb1267fc640 1 --2- 172.21.15.44:0/3025669567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1280b2b60 0x7fb1280b4fb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb11000c430 tx=0x7fb11000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.570+0000 7fb11ffff640 1 -- 172.21.15.44:0/3025669567 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb110011790 con 0x7fb1280b2b60 2023-11-04T01:36:55.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.570+0000 7fb11ffff640 1 -- 172.21.15.44:0/3025669567 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1100118f0 con 0x7fb1280b2b60 2023-11-04T01:36:55.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.570+0000 7fb12da44640 1 -- 172.21.15.44:0/3025669567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1280b44d0 con 0x7fb1280b2b60 2023-11-04T01:36:55.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.570+0000 7fb11ffff640 1 -- 172.21.15.44:0/3025669567 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb110011ce0 con 0x7fb1280b2b60 2023-11-04T01:36:55.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.570+0000 7fb12da44640 1 -- 172.21.15.44:0/3025669567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1280b4a90 con 0x7fb1280b2b60 2023-11-04T01:36:55.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.571+0000 7fb12da44640 1 -- 172.21.15.44:0/3025669567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb128074290 con 0x7fb1280b2b60 2023-11-04T01:36:55.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.571+0000 7fb11ffff640 1 -- 172.21.15.44:0/3025669567 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb11001c460 con 0x7fb1280b2b60 2023-11-04T01:36:55.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.572+0000 7fb11ffff640 1 --2- 172.21.15.44:0/3025669567 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb10806aea0 0x7fb10806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.572+0000 7fb11ffff640 1 -- 172.21.15.44:0/3025669567 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb110089880 con 0x7fb1280b2b60 2023-11-04T01:36:55.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.572+0000 7fb126ffd640 1 --2- 172.21.15.44:0/3025669567 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb10806aea0 0x7fb10806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.573+0000 7fb126ffd640 1 --2- 172.21.15.44:0/3025669567 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb10806aea0 0x7fb10806d360 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb118035000 tx=0x7fb118030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.576+0000 7fb11ffff640 1 -- 172.21.15.44:0/3025669567 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb110054600 con 0x7fb1280b2b60 2023-11-04T01:36:55.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.763+0000 7fb12da44640 1 -- 172.21.15.44:0/3025669567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb1280b6b20 con 0x7fb1280b2b60 2023-11-04T01:36:55.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.764+0000 7fb11ffff640 1 -- 172.21.15.44:0/3025669567 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb110057c20 con 0x7fb1280b2b60 2023-11-04T01:36:55.766 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2023-11-04T01:36:55.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.766+0000 7fb12da44640 1 -- 172.21.15.44:0/3025669567 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb10806aea0 msgr2=0x7fb10806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.766+0000 7fb12da44640 1 --2- 172.21.15.44:0/3025669567 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb10806aea0 0x7fb10806d360 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb118035000 tx=0x7fb118030000 comp rx=0 tx=0).stop 2023-11-04T01:36:55.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.766+0000 7fb12da44640 1 -- 172.21.15.44:0/3025669567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1280b2b60 msgr2=0x7fb1280b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.766+0000 7fb12da44640 1 --2- 172.21.15.44:0/3025669567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1280b2b60 0x7fb1280b4fb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb11000c430 tx=0x7fb11000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.766+0000 7fb12da44640 1 -- 172.21.15.44:0/3025669567 shutdown_connections 2023-11-04T01:36:55.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.766+0000 7fb12da44640 1 --2- 172.21.15.44:0/3025669567 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb10806aea0 0x7fb10806d360 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.766+0000 7fb12da44640 1 --2- 172.21.15.44:0/3025669567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb128160430 0x7fb128152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.766+0000 7fb12da44640 1 --2- 172.21.15.44:0/3025669567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1280b2b60 0x7fb1280b4fb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.766+0000 7fb12da44640 1 --2- 172.21.15.44:0/3025669567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb12806c3a0 0x7fb1280c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.766+0000 7fb12da44640 1 -- 172.21.15.44:0/3025669567 >> 172.21.15.44:0/3025669567 conn(0x7fb12806ea20 msgr2=0x7fb1280cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.766+0000 7fb12da44640 1 -- 172.21.15.44:0/3025669567 shutdown_connections 2023-11-04T01:36:55.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.766+0000 7fb12da44640 1 -- 172.21.15.44:0/3025669567 wait complete. 2023-11-04T01:36:55.779 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:36:55.779 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:55.798 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:55.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.901+0000 7f65f37e2640 1 Processor -- start 2023-11-04T01:36:55.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.902+0000 7f65f37e2640 1 -- start start 2023-11-04T01:36:55.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.902+0000 7f65f37e2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec0cde60 0x7f65ec15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.902+0000 7f65f37e2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ec15e000 con 0x7f65ec15daa0 2023-11-04T01:36:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.902+0000 7f65f37e2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ec15e2e0 con 0x7f65ec0ce240 2023-11-04T01:36:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.902+0000 7f65f37e2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec15e5c0 con 0x7f65ec0cde60 2023-11-04T01:36:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65f0d7d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f65ec15daa0 0x7f65ec157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38398/0 (socket says 172.21.15.44:38398) 2023-11-04T01:36:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65f0d7d640 1 -- 172.21.15.44:0/4099263016 learned_addr learned my addr 172.21.15.44:0/4099263016 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65f157e640 1 --2- 172.21.15.44:0/4099263016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec0cde60 0x7f65ec15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65e3fff640 1 -- 172.21.15.44:0/4099263016 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030334496 0 0) 0x7f65ec15e000 con 0x7f65ec15daa0 2023-11-04T01:36:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65e3fff640 1 -- 172.21.15.44:0/4099263016 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65d8003520 con 0x7f65ec15daa0 2023-11-04T01:36:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65e3fff640 1 -- 172.21.15.44:0/4099263016 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2224173903 0 0) 0x7f65d8003520 con 0x7f65ec15daa0 2023-11-04T01:36:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65e3fff640 1 -- 172.21.15.44:0/4099263016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec0cde60 msgr2=0x7f65ec15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65e3fff640 1 --2- 172.21.15.44:0/4099263016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec0cde60 0x7f65ec15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65e3fff640 1 -- 172.21.15.44:0/4099263016 >> v1:172.21.15.204:6789/0 conn(0x7f65ec0ce240 legacy=0x7f65ec0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65e3fff640 1 -- 172.21.15.44:0/4099263016 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec0d1120 con 0x7f65ec15daa0 2023-11-04T01:36:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65e3fff640 1 -- 172.21.15.44:0/4099263016 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f65dc001670 con 0x7f65ec15daa0 2023-11-04T01:36:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65e3fff640 1 -- 172.21.15.44:0/4099263016 >> v1:172.21.15.44:6789/0 conn(0x7f65ec15daa0 legacy=0x7f65ec157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65e3fff640 1 --2- 172.21.15.44:0/4099263016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80039a0 0x7f65d8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65e3fff640 1 --2- 172.21.15.44:0/4099263016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec0cde60 0x7f65d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65e3fff640 1 --2- 172.21.15.44:0/4099263016 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65d8004d00 0x7f65d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65e3fff640 1 -- 172.21.15.44:0/4099263016 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec15e5c0 con 0x7f65d80039a0 2023-11-04T01:36:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65e3fff640 1 -- 172.21.15.44:0/4099263016 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d800ba30 con 0x7f65d8004d00 2023-11-04T01:36:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65e3fff640 1 -- 172.21.15.44:0/4099263016 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d800bbf0 con 0x7f65ec0cde60 2023-11-04T01:36:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65f157e640 1 --2- 172.21.15.44:0/4099263016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80039a0 0x7f65d8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.903+0000 7f65f0d7d640 1 --2- 172.21.15.44:0/4099263016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec0cde60 0x7f65d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.904+0000 7f65f1d7f640 1 --2- 172.21.15.44:0/4099263016 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65d8004d00 0x7f65d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.904+0000 7f65f157e640 1 -- 172.21.15.44:0/4099263016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec0cde60 msgr2=0x7f65d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.904+0000 7f65f157e640 1 --2- 172.21.15.44:0/4099263016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec0cde60 0x7f65d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.904+0000 7f65f157e640 1 -- 172.21.15.44:0/4099263016 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65d8004d00 msgr2=0x7f65d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.904+0000 7f65f157e640 1 --2- 172.21.15.44:0/4099263016 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65d8004d00 0x7f65d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.904+0000 7f65f157e640 1 -- 172.21.15.44:0/4099263016 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d8003520 con 0x7f65d80039a0 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.904+0000 7f65f157e640 1 --2- 172.21.15.44:0/4099263016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80039a0 0x7f65d8003dc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009f90 tx=0x7f65d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bce159efed9dbf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.905+0000 7f65e3fff640 1 -- 172.21.15.44:0/4099263016 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e802cbd0 con 0x7f65d80039a0 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.905+0000 7f65e3fff640 1 -- 172.21.15.44:0/4099263016 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e800f040 con 0x7f65d80039a0 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.905+0000 7f65e3fff640 1 -- 172.21.15.44:0/4099263016 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8034440 con 0x7f65d80039a0 2023-11-04T01:36:55.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.905+0000 7f65f37e2640 1 -- 172.21.15.44:0/4099263016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80039a0 msgr2=0x7f65d8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.905+0000 7f65f37e2640 1 --2- 172.21.15.44:0/4099263016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80039a0 0x7f65d8003dc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009f90 tx=0x7f65d80057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.905+0000 7f65f1d7f640 1 -- 172.21.15.44:0/4099263016 reap_dead start 2023-11-04T01:36:55.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.905+0000 7f65f37e2640 1 -- 172.21.15.44:0/4099263016 shutdown_connections 2023-11-04T01:36:55.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.905+0000 7f65f37e2640 1 -- 172.21.15.44:0/4099263016 >> 172.21.15.44:0/4099263016 conn(0x7f65ec071f30 msgr2=0x7f65ec0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.905+0000 7f65f37e2640 1 -- 172.21.15.44:0/4099263016 shutdown_connections 2023-11-04T01:36:55.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.905+0000 7f65f37e2640 1 -- 172.21.15.44:0/4099263016 wait complete. 2023-11-04T01:36:55.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.906+0000 7f65f37e2640 1 Processor -- start 2023-11-04T01:36:55.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.906+0000 7f65f37e2640 1 -- start start 2023-11-04T01:36:55.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.907+0000 7f65f37e2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65d80039a0 0x7f65ec153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.907+0000 7f65f37e2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65ec14e950 0x7f65ec155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.907+0000 7f65f37e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec1f36f0 0x7f65ec1f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.907+0000 7f65f37e2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec1556c0 con 0x7f65ec1f36f0 2023-11-04T01:36:55.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.907+0000 7f65f37e2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec150d30 con 0x7f65ec14e950 2023-11-04T01:36:55.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.907+0000 7f65f37e2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec1558d0 con 0x7f65d80039a0 2023-11-04T01:36:55.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.907+0000 7f65f1d7f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec1f36f0 0x7f65ec1f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.907+0000 7f65f1d7f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec1f36f0 0x7f65ec1f57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39170/0 (socket says 172.21.15.44:39170) 2023-11-04T01:36:55.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.907+0000 7f65f1d7f640 1 -- 172.21.15.44:0/1883726482 learned_addr learned my addr 172.21.15.44:0/1883726482 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:55.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.907+0000 7f65f157e640 1 --2- 172.21.15.44:0/1883726482 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65d80039a0 0x7f65ec153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.907+0000 7f65f0d7d640 1 --2- 172.21.15.44:0/1883726482 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65ec14e950 0x7f65ec155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.908+0000 7f65f1d7f640 1 -- 172.21.15.44:0/1883726482 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65d80039a0 msgr2=0x7f65ec153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.908+0000 7f65f1d7f640 1 --2- 172.21.15.44:0/1883726482 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65d80039a0 0x7f65ec153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.908+0000 7f65f1d7f640 1 -- 172.21.15.44:0/1883726482 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65ec14e950 msgr2=0x7f65ec155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.908+0000 7f65f1d7f640 1 --2- 172.21.15.44:0/1883726482 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65ec14e950 0x7f65ec155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.908+0000 7f65f1d7f640 1 -- 172.21.15.44:0/1883726482 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec150400 con 0x7f65ec1f36f0 2023-11-04T01:36:55.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.908+0000 7f65f1d7f640 1 --2- 172.21.15.44:0/1883726482 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec1f36f0 0x7f65ec1f57f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f65ec06c790 tx=0x7f65e400f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.908+0000 7f65e1ffb640 1 -- 172.21.15.44:0/1883726482 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e40053a0 con 0x7f65ec1f36f0 2023-11-04T01:36:55.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.908+0000 7f65e1ffb640 1 -- 172.21.15.44:0/1883726482 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e40035f0 con 0x7f65ec1f36f0 2023-11-04T01:36:55.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.908+0000 7f65f37e2640 1 -- 172.21.15.44:0/1883726482 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ec1506e0 con 0x7f65ec1f36f0 2023-11-04T01:36:55.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.908+0000 7f65e1ffb640 1 -- 172.21.15.44:0/1883726482 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e40039a0 con 0x7f65ec1f36f0 2023-11-04T01:36:55.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.908+0000 7f65f37e2640 1 -- 172.21.15.44:0/1883726482 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ec1f3b70 con 0x7f65ec1f36f0 2023-11-04T01:36:55.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.909+0000 7f65f37e2640 1 -- 172.21.15.44:0/1883726482 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ec074290 con 0x7f65ec1f36f0 2023-11-04T01:36:55.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.909+0000 7f65e1ffb640 1 -- 172.21.15.44:0/1883726482 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f65e4003b00 con 0x7f65ec1f36f0 2023-11-04T01:36:55.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.910+0000 7f65e1ffb640 1 --2- 172.21.15.44:0/1883726482 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65d006ae70 0x7f65d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.910+0000 7f65e1ffb640 1 -- 172.21.15.44:0/1883726482 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f65e40893e0 con 0x7f65ec1f36f0 2023-11-04T01:36:55.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.910+0000 7f65f157e640 1 --2- 172.21.15.44:0/1883726482 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65d006ae70 0x7f65d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.911+0000 7f65f157e640 1 --2- 172.21.15.44:0/1883726482 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65d006ae70 0x7f65d006d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f65e8036000 tx=0x7f65e802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:55.914+0000 7f65e1ffb640 1 -- 172.21.15.44:0/1883726482 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f65e4054210 con 0x7f65ec1f36f0 2023-11-04T01:36:56.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.090+0000 7f65f37e2640 1 -- 172.21.15.44:0/1883726482 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65ec156990 con 0x7f65ec1f36f0 2023-11-04T01:36:56.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.091+0000 7f65e1ffb640 1 -- 172.21.15.44:0/1883726482 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7f65e4057830 con 0x7f65ec1f36f0 2023-11-04T01:36:56.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:56.094 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:56.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.093+0000 7f65f37e2640 1 -- 172.21.15.44:0/1883726482 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65d006ae70 msgr2=0x7f65d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.093+0000 7f65f37e2640 1 --2- 172.21.15.44:0/1883726482 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65d006ae70 0x7f65d006d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f65e8036000 tx=0x7f65e802e000 comp rx=0 tx=0).stop 2023-11-04T01:36:56.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.093+0000 7f65f37e2640 1 -- 172.21.15.44:0/1883726482 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec1f36f0 msgr2=0x7f65ec1f57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.093+0000 7f65f37e2640 1 --2- 172.21.15.44:0/1883726482 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec1f36f0 0x7f65ec1f57f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f65ec06c790 tx=0x7f65e400f920 comp rx=0 tx=0).stop 2023-11-04T01:36:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.093+0000 7f65f37e2640 1 -- 172.21.15.44:0/1883726482 shutdown_connections 2023-11-04T01:36:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.093+0000 7f65f37e2640 1 --2- 172.21.15.44:0/1883726482 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65d006ae70 0x7f65d006d330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.093+0000 7f65f37e2640 1 --2- 172.21.15.44:0/1883726482 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec1f36f0 0x7f65ec1f57f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.093+0000 7f65f37e2640 1 --2- 172.21.15.44:0/1883726482 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65ec14e950 0x7f65ec155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.093+0000 7f65f37e2640 1 --2- 172.21.15.44:0/1883726482 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65d80039a0 0x7f65ec153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.093+0000 7f65f37e2640 1 -- 172.21.15.44:0/1883726482 >> 172.21.15.44:0/1883726482 conn(0x7f65ec071f30 msgr2=0x7f65ec0ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.093+0000 7f65f37e2640 1 -- 172.21.15.44:0/1883726482 shutdown_connections 2023-11-04T01:36:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.093+0000 7f65f37e2640 1 -- 172.21.15.44:0/1883726482 wait complete. 2023-11-04T01:36:56.106 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:56.107 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:56.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.214+0000 7f9d79e7c640 1 Processor -- start 2023-11-04T01:36:56.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.214+0000 7f9d79e7c640 1 -- start start 2023-11-04T01:36:56.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d79e7c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d740cccc0 0x7f9d7406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d79e7c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7406ca40 con 0x7f9d74160430 2023-11-04T01:36:56.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d79e7c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7406cd20 con 0x7f9d740b2d30 2023-11-04T01:36:56.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d79e7c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740cb580 con 0x7f9d740cccc0 2023-11-04T01:36:56.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d737fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9d74160430 0x7f9d740b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38400/0 (socket says 172.21.15.44:38400) 2023-11-04T01:36:56.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d737fe640 1 -- 172.21.15.44:0/4206340134 learned_addr learned my addr 172.21.15.44:0/4206340134 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:56.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d727fc640 1 -- 172.21.15.44:0/4206340134 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817202661 0 0) 0x7f9d7406ca40 con 0x7f9d74160430 2023-11-04T01:36:56.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d727fc640 1 -- 172.21.15.44:0/4206340134 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d60003520 con 0x7f9d74160430 2023-11-04T01:36:56.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d73fff640 1 --2- 172.21.15.44:0/4206340134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d740cccc0 0x7f9d7406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d727fc640 1 -- 172.21.15.44:0/4206340134 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 766129037 0 0) 0x7f9d60003520 con 0x7f9d74160430 2023-11-04T01:36:56.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d727fc640 1 -- 172.21.15.44:0/4206340134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d740cccc0 msgr2=0x7f9d7406c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:56.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d727fc640 1 --2- 172.21.15.44:0/4206340134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d740cccc0 0x7f9d7406c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d727fc640 1 -- 172.21.15.44:0/4206340134 >> v1:172.21.15.204:6789/0 conn(0x7f9d740b2d30 legacy=0x7f9d7406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d727fc640 1 -- 172.21.15.44:0/4206340134 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7406d000 con 0x7f9d74160430 2023-11-04T01:36:56.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d727fc640 1 -- 172.21.15.44:0/4206340134 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f9d5c001670 con 0x7f9d74160430 2023-11-04T01:36:56.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.215+0000 7f9d727fc640 1 -- 172.21.15.44:0/4206340134 >> v1:172.21.15.44:6789/0 conn(0x7f9d74160430 legacy=0x7f9d740b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.216+0000 7f9d727fc640 1 --2- 172.21.15.44:0/4206340134 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d600039a0 0x7f9d60003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.216+0000 7f9d727fc640 1 --2- 172.21.15.44:0/4206340134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600047c0 0x7f9d60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.216+0000 7f9d727fc640 1 --2- 172.21.15.44:0/4206340134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d740cccc0 0x7f9d600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.216+0000 7f9d727fc640 1 -- 172.21.15.44:0/4206340134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740cb580 con 0x7f9d600047c0 2023-11-04T01:36:56.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.216+0000 7f9d727fc640 1 -- 172.21.15.44:0/4206340134 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6000bab0 con 0x7f9d600039a0 2023-11-04T01:36:56.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.216+0000 7f9d727fc640 1 -- 172.21.15.44:0/4206340134 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6000bc70 con 0x7f9d740cccc0 2023-11-04T01:36:56.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.216+0000 7f9d72ffd640 1 --2- 172.21.15.44:0/4206340134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600047c0 0x7f9d60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.216+0000 7f9d737fe640 1 --2- 172.21.15.44:0/4206340134 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d600039a0 0x7f9d60003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.216+0000 7f9d73fff640 1 --2- 172.21.15.44:0/4206340134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d740cccc0 0x7f9d600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.216+0000 7f9d72ffd640 1 -- 172.21.15.44:0/4206340134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d740cccc0 msgr2=0x7f9d600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:56.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.216+0000 7f9d72ffd640 1 --2- 172.21.15.44:0/4206340134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d740cccc0 0x7f9d600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.216+0000 7f9d72ffd640 1 -- 172.21.15.44:0/4206340134 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d600039a0 msgr2=0x7f9d60003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:56.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.216+0000 7f9d72ffd640 1 --2- 172.21.15.44:0/4206340134 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d600039a0 0x7f9d60003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.216+0000 7f9d72ffd640 1 -- 172.21.15.44:0/4206340134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d60003520 con 0x7f9d600047c0 2023-11-04T01:36:56.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.217+0000 7f9d72ffd640 1 --2- 172.21.15.44:0/4206340134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600047c0 0x7f9d60004c40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9d64001750 tx=0x7f9d600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdab597182886b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.217+0000 7f9d727fc640 1 -- 172.21.15.44:0/4206340134 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d640052d0 con 0x7f9d600047c0 2023-11-04T01:36:56.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.217+0000 7f9d727fc640 1 -- 172.21.15.44:0/4206340134 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6402e050 con 0x7f9d600047c0 2023-11-04T01:36:56.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.217+0000 7f9d727fc640 1 -- 172.21.15.44:0/4206340134 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d640035f0 con 0x7f9d600047c0 2023-11-04T01:36:56.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.217+0000 7f9d79e7c640 1 -- 172.21.15.44:0/4206340134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600047c0 msgr2=0x7f9d60004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.217+0000 7f9d79e7c640 1 --2- 172.21.15.44:0/4206340134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600047c0 0x7f9d60004c40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9d64001750 tx=0x7f9d600057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.217+0000 7f9d73fff640 1 -- 172.21.15.44:0/4206340134 reap_dead start 2023-11-04T01:36:56.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.217+0000 7f9d79e7c640 1 -- 172.21.15.44:0/4206340134 shutdown_connections 2023-11-04T01:36:56.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.217+0000 7f9d79e7c640 1 -- 172.21.15.44:0/4206340134 >> 172.21.15.44:0/4206340134 conn(0x7f9d7406ea20 msgr2=0x7f9d7406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.217+0000 7f9d79e7c640 1 -- 172.21.15.44:0/4206340134 shutdown_connections 2023-11-04T01:36:56.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.217+0000 7f9d79e7c640 1 -- 172.21.15.44:0/4206340134 wait complete. 2023-11-04T01:36:56.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.219+0000 7f9d79e7c640 1 Processor -- start 2023-11-04T01:36:56.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.219+0000 7f9d79e7c640 1 -- start start 2023-11-04T01:36:56.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.219+0000 7f9d79e7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600047c0 0x7f9d741f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.219+0000 7f9d79e7c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d740c5e10 0x7f9d740c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d79e7c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d740b37c0 0x7f9d740b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d79e7c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740afc40 con 0x7f9d600047c0 2023-11-04T01:36:56.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d79e7c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740c4670 con 0x7f9d740b37c0 2023-11-04T01:36:56.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d79e7c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d741f2fe0 con 0x7f9d740c5e10 2023-11-04T01:36:56.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d737fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600047c0 0x7f9d741f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d737fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600047c0 0x7f9d741f27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39194/0 (socket says 172.21.15.44:39194) 2023-11-04T01:36:56.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d737fe640 1 -- 172.21.15.44:0/2412234204 learned_addr learned my addr 172.21.15.44:0/2412234204 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:56.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d72ffd640 1 --2- 172.21.15.44:0/2412234204 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d740c5e10 0x7f9d740c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d737fe640 1 -- 172.21.15.44:0/2412234204 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d740c5e10 msgr2=0x7f9d740c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d73fff640 1 --2- 172.21.15.44:0/2412234204 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d740b37c0 0x7f9d740b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d737fe640 1 --2- 172.21.15.44:0/2412234204 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d740c5e10 0x7f9d740c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d737fe640 1 -- 172.21.15.44:0/2412234204 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d740b37c0 msgr2=0x7f9d740b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d737fe640 1 --2- 172.21.15.44:0/2412234204 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d740b37c0 0x7f9d740b3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d737fe640 1 -- 172.21.15.44:0/2412234204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d741f32c0 con 0x7f9d600047c0 2023-11-04T01:36:56.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d737fe640 1 --2- 172.21.15.44:0/2412234204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600047c0 0x7f9d741f27b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c007290 tx=0x7f9d5c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d6bfff640 1 -- 172.21.15.44:0/2412234204 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c001650 con 0x7f9d600047c0 2023-11-04T01:36:56.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d6bfff640 1 -- 172.21.15.44:0/2412234204 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c00f9c0 con 0x7f9d600047c0 2023-11-04T01:36:56.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d79e7c640 1 -- 172.21.15.44:0/2412234204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d741f35a0 con 0x7f9d600047c0 2023-11-04T01:36:56.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d6bfff640 1 -- 172.21.15.44:0/2412234204 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c00fd50 con 0x7f9d600047c0 2023-11-04T01:36:56.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.220+0000 7f9d79e7c640 1 -- 172.21.15.44:0/2412234204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d741f2cf0 con 0x7f9d600047c0 2023-11-04T01:36:56.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.221+0000 7f9d79e7c640 1 -- 172.21.15.44:0/2412234204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d74074290 con 0x7f9d600047c0 2023-11-04T01:36:56.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.222+0000 7f9d6bfff640 1 -- 172.21.15.44:0/2412234204 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d5c01d460 con 0x7f9d600047c0 2023-11-04T01:36:56.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.222+0000 7f9d6bfff640 1 --2- 172.21.15.44:0/2412234204 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d5406aea0 0x7f9d5406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.222+0000 7f9d6bfff640 1 -- 172.21.15.44:0/2412234204 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9d5c089c10 con 0x7f9d600047c0 2023-11-04T01:36:56.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.222+0000 7f9d72ffd640 1 --2- 172.21.15.44:0/2412234204 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d5406aea0 0x7f9d5406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.223+0000 7f9d72ffd640 1 --2- 172.21.15.44:0/2412234204 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d5406aea0 0x7f9d5406d360 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9d64033000 tx=0x7f9d64009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.227+0000 7f9d6bfff640 1 -- 172.21.15.44:0/2412234204 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9d5c0547d0 con 0x7f9d600047c0 2023-11-04T01:36:56.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.403+0000 7f9d79e7c640 1 -- 172.21.15.44:0/2412234204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d740b6b20 con 0x7f9d600047c0 2023-11-04T01:36:56.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.403+0000 7f9d6bfff640 1 -- 172.21.15.44:0/2412234204 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9d5c057df0 con 0x7f9d600047c0 2023-11-04T01:36:56.405 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:36:56.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.405+0000 7f9d79e7c640 1 -- 172.21.15.44:0/2412234204 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d5406aea0 msgr2=0x7f9d5406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.405+0000 7f9d79e7c640 1 --2- 172.21.15.44:0/2412234204 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d5406aea0 0x7f9d5406d360 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9d64033000 tx=0x7f9d64009030 comp rx=0 tx=0).stop 2023-11-04T01:36:56.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.405+0000 7f9d79e7c640 1 -- 172.21.15.44:0/2412234204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600047c0 msgr2=0x7f9d741f27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.405+0000 7f9d79e7c640 1 --2- 172.21.15.44:0/2412234204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600047c0 0x7f9d741f27b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c007290 tx=0x7f9d5c007750 comp rx=0 tx=0).stop 2023-11-04T01:36:56.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.405+0000 7f9d79e7c640 1 -- 172.21.15.44:0/2412234204 shutdown_connections 2023-11-04T01:36:56.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.405+0000 7f9d79e7c640 1 --2- 172.21.15.44:0/2412234204 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d5406aea0 0x7f9d5406d360 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.405+0000 7f9d79e7c640 1 --2- 172.21.15.44:0/2412234204 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d740b37c0 0x7f9d740b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.405+0000 7f9d79e7c640 1 --2- 172.21.15.44:0/2412234204 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d740c5e10 0x7f9d740c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.405+0000 7f9d79e7c640 1 --2- 172.21.15.44:0/2412234204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600047c0 0x7f9d741f27b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.405+0000 7f9d79e7c640 1 -- 172.21.15.44:0/2412234204 >> 172.21.15.44:0/2412234204 conn(0x7f9d7406ea20 msgr2=0x7f9d7415f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.405+0000 7f9d79e7c640 1 -- 172.21.15.44:0/2412234204 shutdown_connections 2023-11-04T01:36:56.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.405+0000 7f9d79e7c640 1 -- 172.21.15.44:0/2412234204 wait complete. 2023-11-04T01:36:56.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:56.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.525+0000 7f29c4475640 1 Processor -- start 2023-11-04T01:36:56.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.525+0000 7f29c4475640 1 -- start start 2023-11-04T01:36:56.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.526+0000 7f29c4475640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f29bc0b4880 0x7f29bc0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.526+0000 7f29c4475640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc0cde60 con 0x7f29bc0cd6d0 2023-11-04T01:36:56.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.526+0000 7f29c4475640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc160f90 con 0x7f29bc153e60 2023-11-04T01:36:56.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.526+0000 7f29c4475640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc0b5200 con 0x7f29bc0b4880 2023-11-04T01:36:56.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.526+0000 7f29c2a12640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f29bc0b4880 0x7f29bc0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.526+0000 7f29c1a10640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f29bc0cd6d0 0x7f29bc161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38412/0 (socket says 172.21.15.44:38412) 2023-11-04T01:36:56.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.526+0000 7f29c1a10640 1 -- 172.21.15.44:0/486428539 learned_addr learned my addr 172.21.15.44:0/486428539 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:56.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.527+0000 7f29c2a12640 1 -- 172.21.15.44:0/486428539 >> v1:172.21.15.204:6789/0 conn(0x7f29bc153e60 legacy=0x7f29bc15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.527+0000 7f29c2a12640 1 -- 172.21.15.44:0/486428539 >> v1:172.21.15.44:6789/0 conn(0x7f29bc0cd6d0 legacy=0x7f29bc161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.527+0000 7f29c120f640 1 -- 172.21.15.44:0/486428539 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609101343 0 0) 0x7f29bc0cde60 con 0x7f29bc0cd6d0 2023-11-04T01:36:56.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.527+0000 7f29c2a12640 1 -- 172.21.15.44:0/486428539 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc0ce090 con 0x7f29bc0b4880 2023-11-04T01:36:56.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.528+0000 7f29c2a12640 1 --2- 172.21.15.44:0/486428539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc0b4880 0x7f29bc0b4cc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009d90 tx=0x7f29b402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af4d4995391c73d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.528+0000 7f29c120f640 1 -- 172.21.15.44:0/486428539 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b402cd00 con 0x7f29bc0b4880 2023-11-04T01:36:56.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.528+0000 7f29c120f640 1 -- 172.21.15.44:0/486428539 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b402ce60 con 0x7f29bc0b4880 2023-11-04T01:36:56.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.528+0000 7f29c120f640 1 -- 172.21.15.44:0/486428539 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4034660 con 0x7f29bc0b4880 2023-11-04T01:36:56.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.528+0000 7f29c4475640 1 -- 172.21.15.44:0/486428539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc0b4880 msgr2=0x7f29bc0b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.528+0000 7f29c4475640 1 --2- 172.21.15.44:0/486428539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc0b4880 0x7f29bc0b4cc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009d90 tx=0x7f29b402bf50 comp rx=0 tx=0).stop 2023-11-04T01:36:56.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.528+0000 7f29c4475640 1 -- 172.21.15.44:0/486428539 shutdown_connections 2023-11-04T01:36:56.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.528+0000 7f29c4475640 1 --2- 172.21.15.44:0/486428539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc0b4880 0x7f29bc0b4cc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.528+0000 7f29c4475640 1 -- 172.21.15.44:0/486428539 >> 172.21.15.44:0/486428539 conn(0x7f29bc0cf880 msgr2=0x7f29bc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.528+0000 7f29c4475640 1 -- 172.21.15.44:0/486428539 shutdown_connections 2023-11-04T01:36:56.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.528+0000 7f29c4475640 1 -- 172.21.15.44:0/486428539 wait complete. 2023-11-04T01:36:56.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.530+0000 7f29c4475640 1 Processor -- start 2023-11-04T01:36:56.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.530+0000 7f29c4475640 1 -- start start 2023-11-04T01:36:56.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.530+0000 7f29c4475640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc0b4880 0x7f29bc150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.530+0000 7f29c4475640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc0cd6d0 0x7f29bc0d1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.530+0000 7f29c4475640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29bc153e60 0x7f29bc0d24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.530+0000 7f29c4475640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc15ad70 con 0x7f29bc0b4880 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.530+0000 7f29c4475640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc15a1f0 con 0x7f29bc153e60 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.530+0000 7f29c4475640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc15a4d0 con 0x7f29bc0cd6d0 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.530+0000 7f29c2211640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc0b4880 0x7f29bc150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.530+0000 7f29c2211640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc0b4880 0x7f29bc150040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39212/0 (socket says 172.21.15.44:39212) 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.530+0000 7f29c2211640 1 -- 172.21.15.44:0/2390332059 learned_addr learned my addr 172.21.15.44:0/2390332059 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.531+0000 7f29c2a12640 1 --2- 172.21.15.44:0/2390332059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29bc153e60 0x7f29bc0d24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.531+0000 7f29c1a10640 1 --2- 172.21.15.44:0/2390332059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc0cd6d0 0x7f29bc0d1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.531+0000 7f29c2211640 1 -- 172.21.15.44:0/2390332059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc0cd6d0 msgr2=0x7f29bc0d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.531+0000 7f29c2211640 1 --2- 172.21.15.44:0/2390332059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc0cd6d0 0x7f29bc0d1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.531+0000 7f29c2211640 1 -- 172.21.15.44:0/2390332059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29bc153e60 msgr2=0x7f29bc0d24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.531+0000 7f29c2211640 1 --2- 172.21.15.44:0/2390332059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29bc153e60 0x7f29bc0d24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.531+0000 7f29c2211640 1 -- 172.21.15.44:0/2390332059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4009a70 con 0x7f29bc0b4880 2023-11-04T01:36:56.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.531+0000 7f29c1a10640 1 --2- 172.21.15.44:0/2390332059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc0cd6d0 0x7f29bc0d1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:56.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.531+0000 7f29c2211640 1 --2- 172.21.15.44:0/2390332059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc0b4880 0x7f29bc150040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f29b800c400 tx=0x7f29b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.531+0000 7f29b2ffd640 1 -- 172.21.15.44:0/2390332059 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b80052d0 con 0x7f29bc0b4880 2023-11-04T01:36:56.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.531+0000 7f29b2ffd640 1 -- 172.21.15.44:0/2390332059 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b8005430 con 0x7f29bc0b4880 2023-11-04T01:36:56.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.531+0000 7f29b2ffd640 1 -- 172.21.15.44:0/2390332059 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b8003830 con 0x7f29bc0b4880 2023-11-04T01:36:56.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.531+0000 7f29c4475640 1 -- 172.21.15.44:0/2390332059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc15a7b0 con 0x7f29bc0b4880 2023-11-04T01:36:56.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.531+0000 7f29c4475640 1 -- 172.21.15.44:0/2390332059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc150580 con 0x7f29bc0b4880 2023-11-04T01:36:56.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.532+0000 7f29c4475640 1 -- 172.21.15.44:0/2390332059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc150710 con 0x7f29bc0b4880 2023-11-04T01:36:56.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.533+0000 7f29b2ffd640 1 -- 172.21.15.44:0/2390332059 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f29b8003990 con 0x7f29bc0b4880 2023-11-04T01:36:56.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.533+0000 7f29b2ffd640 1 --2- 172.21.15.44:0/2390332059 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f29a006aea0 0x7f29a006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.533+0000 7f29b2ffd640 1 -- 172.21.15.44:0/2390332059 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f29b8088e30 con 0x7f29bc0b4880 2023-11-04T01:36:56.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.533+0000 7f29c1a10640 1 --2- 172.21.15.44:0/2390332059 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f29a006aea0 0x7f29a006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.534+0000 7f29c1a10640 1 --2- 172.21.15.44:0/2390332059 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f29a006aea0 0x7f29a006d360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f29bc15bc50 tx=0x7f29ac007c50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.537+0000 7f29b2ffd640 1 -- 172.21.15.44:0/2390332059 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f29b8053bd0 con 0x7f29bc0b4880 2023-11-04T01:36:56.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.712+0000 7f29c4475640 1 -- 172.21.15.44:0/2390332059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29bc1545a0 con 0x7f29bc0b4880 2023-11-04T01:36:56.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.712+0000 7f29b2ffd640 1 -- 172.21.15.44:0/2390332059 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29b80571f0 con 0x7f29bc0b4880 2023-11-04T01:36:56.714 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:56.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.714+0000 7f29c4475640 1 -- 172.21.15.44:0/2390332059 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f29a006aea0 msgr2=0x7f29a006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.714+0000 7f29c4475640 1 --2- 172.21.15.44:0/2390332059 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f29a006aea0 0x7f29a006d360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f29bc15bc50 tx=0x7f29ac007c50 comp rx=0 tx=0).stop 2023-11-04T01:36:56.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.714+0000 7f29c4475640 1 -- 172.21.15.44:0/2390332059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc0b4880 msgr2=0x7f29bc150040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.714+0000 7f29c4475640 1 --2- 172.21.15.44:0/2390332059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc0b4880 0x7f29bc150040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f29b800c400 tx=0x7f29b800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.714+0000 7f29c4475640 1 -- 172.21.15.44:0/2390332059 shutdown_connections 2023-11-04T01:36:56.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.714+0000 7f29c4475640 1 --2- 172.21.15.44:0/2390332059 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f29a006aea0 0x7f29a006d360 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.714+0000 7f29c4475640 1 --2- 172.21.15.44:0/2390332059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29bc153e60 0x7f29bc0d24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.714+0000 7f29c4475640 1 --2- 172.21.15.44:0/2390332059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc0cd6d0 0x7f29bc0d1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.714+0000 7f29c4475640 1 --2- 172.21.15.44:0/2390332059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc0b4880 0x7f29bc150040 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.714+0000 7f29c4475640 1 -- 172.21.15.44:0/2390332059 >> 172.21.15.44:0/2390332059 conn(0x7f29bc0cf880 msgr2=0x7f29bc15dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.714+0000 7f29c4475640 1 -- 172.21.15.44:0/2390332059 shutdown_connections 2023-11-04T01:36:56.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.714+0000 7f29c4475640 1 -- 172.21.15.44:0/2390332059 wait complete. 2023-11-04T01:36:56.727 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:56.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.834+0000 7f075e933640 1 Processor -- start 2023-11-04T01:36:56.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.834+0000 7f075e933640 1 -- start start 2023-11-04T01:36:56.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.835+0000 7f075e933640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f075815af20 0x7f07580b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.835+0000 7f075e933640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f07580cd3b0 0x7f07580cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.835+0000 7f075e933640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07580cdd40 con 0x7f07580b64c0 2023-11-04T01:36:56.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.835+0000 7f075e933640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07580cc380 con 0x7f07580cd3b0 2023-11-04T01:36:56.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.835+0000 7f075e933640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07580d01f0 con 0x7f075815af20 2023-11-04T01:36:56.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.835+0000 7f075ced0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f07580cd3b0 0x7f07580cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.835+0000 7f075ced0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f07580cd3b0 0x7f07580cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39228/0 (socket says 172.21.15.44:39228) 2023-11-04T01:36:56.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.835+0000 7f075ced0640 1 -- 172.21.15.44:0/2721000730 learned_addr learned my addr 172.21.15.44:0/2721000730 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:56.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.835+0000 7f0757fff640 1 --2- 172.21.15.44:0/2721000730 >> v2:172.21.15.204:3300/0 conn(0x7f075815af20 0x7f07580b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.835+0000 7f075ced0640 1 -- 172.21.15.44:0/2721000730 >> v2:172.21.15.204:3300/0 conn(0x7f075815af20 msgr2=0x7f07580b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:56.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.835+0000 7f075ced0640 1 --2- 172.21.15.44:0/2721000730 >> v2:172.21.15.204:3300/0 conn(0x7f075815af20 0x7f07580b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.835+0000 7f075ced0640 1 -- 172.21.15.44:0/2721000730 >> v1:172.21.15.204:6789/0 conn(0x7f07580b64c0 legacy=0x7f07580cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:56.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.835+0000 7f075ced0640 1 -- 172.21.15.44:0/2721000730 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07580b6a40 con 0x7f07580cd3b0 2023-11-04T01:36:56.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.836+0000 7f075ced0640 1 --2- 172.21.15.44:0/2721000730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07580cd3b0 0x7f07580cd800 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f07580b3760 tx=0x7f075002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69813afd208c3899 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.836+0000 7f0756ffd640 1 -- 172.21.15.44:0/2721000730 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075002cb20 con 0x7f07580cd3b0 2023-11-04T01:36:56.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.836+0000 7f0756ffd640 1 -- 172.21.15.44:0/2721000730 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075002cc80 con 0x7f07580cd3b0 2023-11-04T01:36:56.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.836+0000 7f0756ffd640 1 -- 172.21.15.44:0/2721000730 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07500343f0 con 0x7f07580cd3b0 2023-11-04T01:36:56.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.836+0000 7f075e933640 1 -- 172.21.15.44:0/2721000730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07580cd3b0 msgr2=0x7f07580cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.836+0000 7f075e933640 1 --2- 172.21.15.44:0/2721000730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07580cd3b0 0x7f07580cd800 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f07580b3760 tx=0x7f075002bf80 comp rx=0 tx=0).stop 2023-11-04T01:36:56.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.836+0000 7f075e933640 1 -- 172.21.15.44:0/2721000730 shutdown_connections 2023-11-04T01:36:56.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.837+0000 7f075e933640 1 --2- 172.21.15.44:0/2721000730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07580cd3b0 0x7f07580cd800 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.837+0000 7f075e933640 1 --2- 172.21.15.44:0/2721000730 >> v2:172.21.15.204:3300/0 conn(0x7f075815af20 0x7f07580b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.837+0000 7f075e933640 1 -- 172.21.15.44:0/2721000730 >> 172.21.15.44:0/2721000730 conn(0x7f075806ea20 msgr2=0x7f075806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.837+0000 7f075e933640 1 -- 172.21.15.44:0/2721000730 shutdown_connections 2023-11-04T01:36:56.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.837+0000 7f075e933640 1 -- 172.21.15.44:0/2721000730 wait complete. 2023-11-04T01:36:56.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.838+0000 7f075e933640 1 Processor -- start 2023-11-04T01:36:56.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.838+0000 7f075e933640 1 -- start start 2023-11-04T01:36:56.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075e933640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07580b64c0 0x7f0758157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075e933640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07580cd3b0 0x7f0758157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075e933640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f075815af20 0x7f07581f0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075e933640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0758157ba0 con 0x7f075815af20 2023-11-04T01:36:56.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075e933640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0758157de0 con 0x7f07580b64c0 2023-11-04T01:36:56.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075e933640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07581580c0 con 0x7f07580cd3b0 2023-11-04T01:36:56.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075ced0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f075815af20 0x7f07581f0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075ced0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f075815af20 0x7f07581f0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39230/0 (socket says 172.21.15.44:39230) 2023-11-04T01:36:56.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075ced0640 1 -- 172.21.15.44:0/2041163419 learned_addr learned my addr 172.21.15.44:0/2041163419 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:56.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f0757fff640 1 --2- 172.21.15.44:0/2041163419 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07580b64c0 0x7f0758157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f07577fe640 1 --2- 172.21.15.44:0/2041163419 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07580cd3b0 0x7f0758157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075ced0640 1 -- 172.21.15.44:0/2041163419 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07580cd3b0 msgr2=0x7f0758157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075ced0640 1 --2- 172.21.15.44:0/2041163419 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07580cd3b0 0x7f0758157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075ced0640 1 -- 172.21.15.44:0/2041163419 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07580b64c0 msgr2=0x7f0758157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075ced0640 1 --2- 172.21.15.44:0/2041163419 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07580b64c0 0x7f0758157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075ced0640 1 -- 172.21.15.44:0/2041163419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0750009b30 con 0x7f075815af20 2023-11-04T01:36:56.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075ced0640 1 --2- 172.21.15.44:0/2041163419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f075815af20 0x7f07581f0840 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0750009f40 tx=0x7f0750004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f0754ff9640 1 -- 172.21.15.44:0/2041163419 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750009510 con 0x7f075815af20 2023-11-04T01:36:56.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f0754ff9640 1 -- 172.21.15.44:0/2041163419 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075003e450 con 0x7f075815af20 2023-11-04T01:36:56.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f075e933640 1 -- 172.21.15.44:0/2041163419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07581583a0 con 0x7f075815af20 2023-11-04T01:36:56.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.839+0000 7f0754ff9640 1 -- 172.21.15.44:0/2041163419 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075003e800 con 0x7f075815af20 2023-11-04T01:36:56.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.840+0000 7f075e933640 1 -- 172.21.15.44:0/2041163419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0758158960 con 0x7f075815af20 2023-11-04T01:36:56.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.841+0000 7f075e933640 1 -- 172.21.15.44:0/2041163419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075815e660 con 0x7f075815af20 2023-11-04T01:36:56.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.841+0000 7f0754ff9640 1 -- 172.21.15.44:0/2041163419 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f075003e960 con 0x7f075815af20 2023-11-04T01:36:56.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.841+0000 7f0754ff9640 1 --2- 172.21.15.44:0/2041163419 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f074406ae70 0x7f074406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.841+0000 7f0754ff9640 1 -- 172.21.15.44:0/2041163419 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f07500ac3e0 con 0x7f075815af20 2023-11-04T01:36:56.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.841+0000 7f0757fff640 1 --2- 172.21.15.44:0/2041163419 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f074406ae70 0x7f074406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.842+0000 7f0757fff640 1 --2- 172.21.15.44:0/2041163419 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f074406ae70 0x7f074406d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f07580c77f0 tx=0x7f0748008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:56.846+0000 7f0754ff9640 1 -- 172.21.15.44:0/2041163419 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0750077180 con 0x7f075815af20 2023-11-04T01:36:57.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.019+0000 7f075e933640 1 -- 172.21.15.44:0/2041163419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07580b5ec0 con 0x7f075815af20 2023-11-04T01:36:57.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.019+0000 7f0754ff9640 1 -- 172.21.15.44:0/2041163419 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f075007a7a0 con 0x7f075815af20 2023-11-04T01:36:57.021 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:36:57.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.021+0000 7f075e933640 1 -- 172.21.15.44:0/2041163419 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f074406ae70 msgr2=0x7f074406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.021+0000 7f075e933640 1 --2- 172.21.15.44:0/2041163419 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f074406ae70 0x7f074406d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f07580c77f0 tx=0x7f0748008040 comp rx=0 tx=0).stop 2023-11-04T01:36:57.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.021+0000 7f075e933640 1 -- 172.21.15.44:0/2041163419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f075815af20 msgr2=0x7f07581f0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.021+0000 7f075e933640 1 --2- 172.21.15.44:0/2041163419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f075815af20 0x7f07581f0840 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0750009f40 tx=0x7f0750004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:57.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.021+0000 7f075e933640 1 -- 172.21.15.44:0/2041163419 shutdown_connections 2023-11-04T01:36:57.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.021+0000 7f075e933640 1 --2- 172.21.15.44:0/2041163419 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f074406ae70 0x7f074406d330 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.021+0000 7f075e933640 1 --2- 172.21.15.44:0/2041163419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f075815af20 0x7f07581f0840 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.021+0000 7f075e933640 1 --2- 172.21.15.44:0/2041163419 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07580cd3b0 0x7f0758157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.021+0000 7f075e933640 1 --2- 172.21.15.44:0/2041163419 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07580b64c0 0x7f0758157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.021+0000 7f075e933640 1 -- 172.21.15.44:0/2041163419 >> 172.21.15.44:0/2041163419 conn(0x7f075806ea20 msgr2=0x7f07580b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.021+0000 7f075e933640 1 -- 172.21.15.44:0/2041163419 shutdown_connections 2023-11-04T01:36:57.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.021+0000 7f075e933640 1 -- 172.21.15.44:0/2041163419 wait complete. 2023-11-04T01:36:57.034 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:57.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.141+0000 7f3fc2ba5640 1 Processor -- start 2023-11-04T01:36:57.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.141+0000 7f3fc2ba5640 1 -- start start 2023-11-04T01:36:57.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.141+0000 7f3fc2ba5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3fbc0b2d30 0x7f3fbc06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.141+0000 7f3fc2ba5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3fbc06c1d0 0x7f3fbc0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.141+0000 7f3fc2ba5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fbc06ca40 con 0x7f3fbc160430 2023-11-04T01:36:57.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.141+0000 7f3fc2ba5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fbc0cb580 con 0x7f3fbc06c1d0 2023-11-04T01:36:57.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.141+0000 7f3fc2ba5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc06cd20 con 0x7f3fbc0b2d30 2023-11-04T01:36:57.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.142+0000 7f3fc1142640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3fbc06c1d0 0x7f3fbc0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.142+0000 7f3fc1142640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3fbc06c1d0 0x7f3fbc0cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39232/0 (socket says 172.21.15.44:39232) 2023-11-04T01:36:57.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.142+0000 7f3fc1142640 1 -- 172.21.15.44:0/2482034278 learned_addr learned my addr 172.21.15.44:0/2482034278 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:57.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.142+0000 7f3fbbfff640 1 --2- 172.21.15.44:0/2482034278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3fbc0b2d30 0x7f3fbc06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.142+0000 7f3fc1142640 1 -- 172.21.15.44:0/2482034278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3fbc0b2d30 msgr2=0x7f3fbc06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:57.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.142+0000 7f3fc1142640 1 --2- 172.21.15.44:0/2482034278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3fbc0b2d30 0x7f3fbc06bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.142+0000 7f3fc1142640 1 -- 172.21.15.44:0/2482034278 >> v1:172.21.15.204:6789/0 conn(0x7f3fbc160430 legacy=0x7f3fbc0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.142+0000 7f3fc1142640 1 -- 172.21.15.44:0/2482034278 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc06d000 con 0x7f3fbc06c1d0 2023-11-04T01:36:57.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.143+0000 7f3fc1142640 1 --2- 172.21.15.44:0/2482034278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fbc06c1d0 0x7f3fbc0cbcb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009e50 tx=0x7f3fb402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d621cf2032c6ed08 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.143+0000 7f3fbb7fe640 1 -- 172.21.15.44:0/2482034278 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb402cb00 con 0x7f3fbc06c1d0 2023-11-04T01:36:57.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.143+0000 7f3fbb7fe640 1 -- 172.21.15.44:0/2482034278 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb402cc60 con 0x7f3fbc06c1d0 2023-11-04T01:36:57.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.143+0000 7f3fbb7fe640 1 -- 172.21.15.44:0/2482034278 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb40343f0 con 0x7f3fbc06c1d0 2023-11-04T01:36:57.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.143+0000 7f3fc2ba5640 1 -- 172.21.15.44:0/2482034278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fbc06c1d0 msgr2=0x7f3fbc0cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.143+0000 7f3fc2ba5640 1 --2- 172.21.15.44:0/2482034278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fbc06c1d0 0x7f3fbc0cbcb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009e50 tx=0x7f3fb402bf60 comp rx=0 tx=0).stop 2023-11-04T01:36:57.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.143+0000 7f3fc2ba5640 1 -- 172.21.15.44:0/2482034278 shutdown_connections 2023-11-04T01:36:57.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.143+0000 7f3fc2ba5640 1 --2- 172.21.15.44:0/2482034278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fbc06c1d0 0x7f3fbc0cbcb0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.143+0000 7f3fc2ba5640 1 --2- 172.21.15.44:0/2482034278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3fbc0b2d30 0x7f3fbc06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.143+0000 7f3fc2ba5640 1 -- 172.21.15.44:0/2482034278 >> 172.21.15.44:0/2482034278 conn(0x7f3fbc06ea20 msgr2=0x7f3fbc06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.144+0000 7f3fc2ba5640 1 -- 172.21.15.44:0/2482034278 shutdown_connections 2023-11-04T01:36:57.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.144+0000 7f3fc2ba5640 1 -- 172.21.15.44:0/2482034278 wait complete. 2023-11-04T01:36:57.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.145+0000 7f3fc2ba5640 1 Processor -- start 2023-11-04T01:36:57.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.145+0000 7f3fc2ba5640 1 -- start start 2023-11-04T01:36:57.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fc2ba5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3fbc06c1d0 0x7f3fbc0c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fc2ba5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fbc0b2d30 0x7f3fbc14f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fc2ba5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3fbc160430 0x7f3fbc15ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fc2ba5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0c9750 con 0x7f3fbc0b2d30 2023-11-04T01:36:57.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fc2ba5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0c4bb0 con 0x7f3fbc06c1d0 2023-11-04T01:36:57.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fc2ba5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0c4e50 con 0x7f3fbc160430 2023-11-04T01:36:57.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fbbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fbc0b2d30 0x7f3fbc14f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fbbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fbc0b2d30 0x7f3fbc14f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39244/0 (socket says 172.21.15.44:39244) 2023-11-04T01:36:57.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fbbfff640 1 -- 172.21.15.44:0/1656254176 learned_addr learned my addr 172.21.15.44:0/1656254176 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:57.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fc0941640 1 --2- 172.21.15.44:0/1656254176 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3fbc06c1d0 0x7f3fbc0c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fc1142640 1 --2- 172.21.15.44:0/1656254176 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3fbc160430 0x7f3fbc15ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fbbfff640 1 -- 172.21.15.44:0/1656254176 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3fbc160430 msgr2=0x7f3fbc15ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fbbfff640 1 --2- 172.21.15.44:0/1656254176 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3fbc160430 0x7f3fbc15ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fbbfff640 1 -- 172.21.15.44:0/1656254176 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3fbc06c1d0 msgr2=0x7f3fbc0c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fbbfff640 1 --2- 172.21.15.44:0/1656254176 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3fbc06c1d0 0x7f3fbc0c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fbbfff640 1 -- 172.21.15.44:0/1656254176 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb4009b30 con 0x7f3fbc0b2d30 2023-11-04T01:36:57.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fbbfff640 1 --2- 172.21.15.44:0/1656254176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fbc0b2d30 0x7f3fbc14f1b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800e9b0 tx=0x7f3fa800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fb97fa640 1 -- 172.21.15.44:0/1656254176 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8009670 con 0x7f3fbc0b2d30 2023-11-04T01:36:57.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.146+0000 7f3fb97fa640 1 -- 172.21.15.44:0/1656254176 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa800c9a0 con 0x7f3fbc0b2d30 2023-11-04T01:36:57.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.147+0000 7f3fc2ba5640 1 -- 172.21.15.44:0/1656254176 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fbc0c5130 con 0x7f3fbc0b2d30 2023-11-04T01:36:57.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.147+0000 7f3fb97fa640 1 -- 172.21.15.44:0/1656254176 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa800cd50 con 0x7f3fbc0b2d30 2023-11-04T01:36:57.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.147+0000 7f3fc2ba5640 1 -- 172.21.15.44:0/1656254176 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fbc0c56f0 con 0x7f3fbc0b2d30 2023-11-04T01:36:57.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.148+0000 7f3fc2ba5640 1 -- 172.21.15.44:0/1656254176 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fbc074290 con 0x7f3fbc0b2d30 2023-11-04T01:36:57.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.148+0000 7f3fb97fa640 1 -- 172.21.15.44:0/1656254176 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3fa8013470 con 0x7f3fbc0b2d30 2023-11-04T01:36:57.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.148+0000 7f3fb97fa640 1 --2- 172.21.15.44:0/1656254176 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3fa006aea0 0x7f3fa006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.149+0000 7f3fb97fa640 1 -- 172.21.15.44:0/1656254176 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3fa8089bf0 con 0x7f3fbc0b2d30 2023-11-04T01:36:57.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.149+0000 7f3fc0941640 1 --2- 172.21.15.44:0/1656254176 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3fa006aea0 0x7f3fa006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.149+0000 7f3fc0941640 1 --2- 172.21.15.44:0/1656254176 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3fa006aea0 0x7f3fa006d360 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0000f60 tx=0x7f3fb0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.153+0000 7f3fb97fa640 1 -- 172.21.15.44:0/1656254176 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3fa8054910 con 0x7f3fbc0b2d30 2023-11-04T01:36:57.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.329+0000 7f3fc2ba5640 1 -- 172.21.15.44:0/1656254176 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3fbc0b6b20 con 0x7f3fbc0b2d30 2023-11-04T01:36:57.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.329+0000 7f3fb97fa640 1 -- 172.21.15.44:0/1656254176 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3fa8057f30 con 0x7f3fbc0b2d30 2023-11-04T01:36:57.332 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:57.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.331+0000 7f3fc2ba5640 1 -- 172.21.15.44:0/1656254176 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3fa006aea0 msgr2=0x7f3fa006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.331+0000 7f3fc2ba5640 1 --2- 172.21.15.44:0/1656254176 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3fa006aea0 0x7f3fa006d360 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0000f60 tx=0x7f3fb0009040 comp rx=0 tx=0).stop 2023-11-04T01:36:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.332+0000 7f3fc2ba5640 1 -- 172.21.15.44:0/1656254176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fbc0b2d30 msgr2=0x7f3fbc14f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.332+0000 7f3fc2ba5640 1 --2- 172.21.15.44:0/1656254176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fbc0b2d30 0x7f3fbc14f1b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800e9b0 tx=0x7f3fa800ee70 comp rx=0 tx=0).stop 2023-11-04T01:36:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.332+0000 7f3fc2ba5640 1 -- 172.21.15.44:0/1656254176 shutdown_connections 2023-11-04T01:36:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.332+0000 7f3fc2ba5640 1 --2- 172.21.15.44:0/1656254176 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3fa006aea0 0x7f3fa006d360 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.332+0000 7f3fc2ba5640 1 --2- 172.21.15.44:0/1656254176 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3fbc160430 0x7f3fbc15ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.332+0000 7f3fc2ba5640 1 --2- 172.21.15.44:0/1656254176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fbc0b2d30 0x7f3fbc14f1b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.332+0000 7f3fc2ba5640 1 --2- 172.21.15.44:0/1656254176 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3fbc06c1d0 0x7f3fbc0c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.332+0000 7f3fc2ba5640 1 -- 172.21.15.44:0/1656254176 >> 172.21.15.44:0/1656254176 conn(0x7f3fbc06ea20 msgr2=0x7f3fbc0d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.332+0000 7f3fc2ba5640 1 -- 172.21.15.44:0/1656254176 shutdown_connections 2023-11-04T01:36:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.332+0000 7f3fc2ba5640 1 -- 172.21.15.44:0/1656254176 wait complete. 2023-11-04T01:36:57.345 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:57.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.451+0000 7f5bf73b6640 1 Processor -- start 2023-11-04T01:36:57.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.451+0000 7f5bf73b6640 1 -- start start 2023-11-04T01:36:57.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.452+0000 7f5bf73b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bf0159c00 0x7f5bf00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.452+0000 7f5bf73b6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5bf00ae1d0 0x7f5bf00c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.452+0000 7f5bf73b6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf015aff0 con 0x7f5bf00c48e0 2023-11-04T01:36:57.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.452+0000 7f5bf73b6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf00c52a0 con 0x7f5bf00ae1d0 2023-11-04T01:36:57.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.452+0000 7f5bf73b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf015a3e0 con 0x7f5bf0159c00 2023-11-04T01:36:57.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.452+0000 7f5bf5152640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bf0159c00 0x7f5bf00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.452+0000 7f5bf5953640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5bf00ae1d0 0x7f5bf00c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.452+0000 7f5bf5152640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bf0159c00 0x7f5bf00cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:59144/0 (socket says 172.21.15.44:59144) 2023-11-04T01:36:57.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.452+0000 7f5bf5152640 1 -- 172.21.15.44:0/2960590197 learned_addr learned my addr 172.21.15.44:0/2960590197 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:57.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.453+0000 7f5bf5152640 1 -- 172.21.15.44:0/2960590197 >> v2:172.21.15.204:3300/0 conn(0x7f5bf00ae1d0 msgr2=0x7f5bf00c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:57.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.453+0000 7f5bf5152640 1 --2- 172.21.15.44:0/2960590197 >> v2:172.21.15.204:3300/0 conn(0x7f5bf00ae1d0 0x7f5bf00c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.453+0000 7f5bf5152640 1 -- 172.21.15.44:0/2960590197 >> v1:172.21.15.204:6789/0 conn(0x7f5bf00c48e0 legacy=0x7f5bf00adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.453+0000 7f5bf5152640 1 -- 172.21.15.44:0/2960590197 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf015a6c0 con 0x7f5bf0159c00 2023-11-04T01:36:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.453+0000 7f5bf5953640 1 --2- 172.21.15.44:0/2960590197 >> v2:172.21.15.204:3300/0 conn(0x7f5bf00ae1d0 0x7f5bf00c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.453+0000 7f5bf5152640 1 --2- 172.21.15.44:0/2960590197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bf0159c00 0x7f5bf00cc890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009870 tx=0x7f5be802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40d4122b429a8a86 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.454+0000 7f5be7fff640 1 -- 172.21.15.44:0/2960590197 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8030840 con 0x7f5bf0159c00 2023-11-04T01:36:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.454+0000 7f5be7fff640 1 -- 172.21.15.44:0/2960590197 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be80309a0 con 0x7f5bf0159c00 2023-11-04T01:36:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.454+0000 7f5be7fff640 1 -- 172.21.15.44:0/2960590197 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8030d30 con 0x7f5bf0159c00 2023-11-04T01:36:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.454+0000 7f5bf73b6640 1 -- 172.21.15.44:0/2960590197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bf0159c00 msgr2=0x7f5bf00cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.454+0000 7f5bf73b6640 1 --2- 172.21.15.44:0/2960590197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bf0159c00 0x7f5bf00cc890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009870 tx=0x7f5be802b980 comp rx=0 tx=0).stop 2023-11-04T01:36:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.454+0000 7f5bf73b6640 1 -- 172.21.15.44:0/2960590197 shutdown_connections 2023-11-04T01:36:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.454+0000 7f5bf73b6640 1 --2- 172.21.15.44:0/2960590197 >> v2:172.21.15.204:3300/0 conn(0x7f5bf00ae1d0 0x7f5bf00c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.454+0000 7f5bf73b6640 1 --2- 172.21.15.44:0/2960590197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bf0159c00 0x7f5bf00cc890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.454+0000 7f5bf73b6640 1 -- 172.21.15.44:0/2960590197 >> 172.21.15.44:0/2960590197 conn(0x7f5bf00ce950 msgr2=0x7f5bf00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.454+0000 7f5bf73b6640 1 -- 172.21.15.44:0/2960590197 shutdown_connections 2023-11-04T01:36:57.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.454+0000 7f5bf73b6640 1 -- 172.21.15.44:0/2960590197 wait complete. 2023-11-04T01:36:57.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.456+0000 7f5bf73b6640 1 Processor -- start 2023-11-04T01:36:57.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.456+0000 7f5bf73b6640 1 -- start start 2023-11-04T01:36:57.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.456+0000 7f5bf73b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bf00ae1d0 0x7f5bf00ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.456+0000 7f5bf73b6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5bf00c48e0 0x7f5bf01f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.456+0000 7f5bf73b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bf0159c00 0x7f5bf00b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.456+0000 7f5bf73b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf01f1270 con 0x7f5bf00ae1d0 2023-11-04T01:36:57.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.456+0000 7f5bf73b6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00b45e0 con 0x7f5bf00c48e0 2023-11-04T01:36:57.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.456+0000 7f5bf73b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00aed00 con 0x7f5bf0159c00 2023-11-04T01:36:57.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.456+0000 7f5bf5152640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bf00ae1d0 0x7f5bf00ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.457+0000 7f5bf5152640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bf00ae1d0 0x7f5bf00ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39252/0 (socket says 172.21.15.44:39252) 2023-11-04T01:36:57.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.457+0000 7f5bf5152640 1 -- 172.21.15.44:0/2963491692 learned_addr learned my addr 172.21.15.44:0/2963491692 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:57.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.457+0000 7f5bf4951640 1 --2- 172.21.15.44:0/2963491692 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5bf00c48e0 0x7f5bf01f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.457+0000 7f5bf5953640 1 --2- 172.21.15.44:0/2963491692 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bf0159c00 0x7f5bf00b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.457+0000 7f5bf5152640 1 -- 172.21.15.44:0/2963491692 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bf0159c00 msgr2=0x7f5bf00b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.457+0000 7f5bf5152640 1 --2- 172.21.15.44:0/2963491692 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bf0159c00 0x7f5bf00b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.457+0000 7f5bf5152640 1 -- 172.21.15.44:0/2963491692 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5bf00c48e0 msgr2=0x7f5bf01f0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.457+0000 7f5bf5152640 1 --2- 172.21.15.44:0/2963491692 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5bf00c48e0 0x7f5bf01f0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.457+0000 7f5bf5152640 1 -- 172.21.15.44:0/2963491692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec009a70 con 0x7f5bf00ae1d0 2023-11-04T01:36:57.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.457+0000 7f5bf5152640 1 --2- 172.21.15.44:0/2963491692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bf00ae1d0 0x7f5bf00ae640 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5be8000c00 tx=0x7f5be8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.457+0000 7f5be5ffb640 1 -- 172.21.15.44:0/2963491692 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8039c90 con 0x7f5bf00ae1d0 2023-11-04T01:36:57.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.457+0000 7f5be5ffb640 1 -- 172.21.15.44:0/2963491692 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be8039e10 con 0x7f5bf00ae1d0 2023-11-04T01:36:57.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.457+0000 7f5bf73b6640 1 -- 172.21.15.44:0/2963491692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be80094d0 con 0x7f5bf00ae1d0 2023-11-04T01:36:57.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.457+0000 7f5be5ffb640 1 -- 172.21.15.44:0/2963491692 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8043640 con 0x7f5bf00ae1d0 2023-11-04T01:36:57.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.457+0000 7f5bf73b6640 1 -- 172.21.15.44:0/2963491692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf00af2c0 con 0x7f5bf00ae1d0 2023-11-04T01:36:57.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.458+0000 7f5bf73b6640 1 -- 172.21.15.44:0/2963491692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf0074290 con 0x7f5bf00ae1d0 2023-11-04T01:36:57.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.459+0000 7f5be5ffb640 1 -- 172.21.15.44:0/2963491692 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5be80437a0 con 0x7f5bf00ae1d0 2023-11-04T01:36:57.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.459+0000 7f5be5ffb640 1 --2- 172.21.15.44:0/2963491692 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5bd406ae70 0x7f5bd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.459+0000 7f5be5ffb640 1 -- 172.21.15.44:0/2963491692 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5be803e070 con 0x7f5bf00ae1d0 2023-11-04T01:36:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.460+0000 7f5bf4951640 1 --2- 172.21.15.44:0/2963491692 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5bd406ae70 0x7f5bd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.460+0000 7f5bf4951640 1 --2- 172.21.15.44:0/2963491692 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5bd406ae70 0x7f5bd406d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00ad790 tx=0x7f5be0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.463+0000 7f5be5ffb640 1 -- 172.21.15.44:0/2963491692 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5be8077590 con 0x7f5bf00ae1d0 2023-11-04T01:36:57.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.652+0000 7f5bf73b6640 1 -- 172.21.15.44:0/2963491692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5bf006c8b0 con 0x7f5bf00ae1d0 2023-11-04T01:36:57.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.652+0000 7f5be5ffb640 1 -- 172.21.15.44:0/2963491692 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5be807abb0 con 0x7f5bf00ae1d0 2023-11-04T01:36:57.654 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2023-11-04T01:36:57.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.654+0000 7f5bf73b6640 1 -- 172.21.15.44:0/2963491692 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5bd406ae70 msgr2=0x7f5bd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.654+0000 7f5bf73b6640 1 --2- 172.21.15.44:0/2963491692 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5bd406ae70 0x7f5bd406d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00ad790 tx=0x7f5be0009040 comp rx=0 tx=0).stop 2023-11-04T01:36:57.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.654+0000 7f5bf73b6640 1 -- 172.21.15.44:0/2963491692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bf00ae1d0 msgr2=0x7f5bf00ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.654+0000 7f5bf73b6640 1 --2- 172.21.15.44:0/2963491692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bf00ae1d0 0x7f5bf00ae640 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5be8000c00 tx=0x7f5be8004730 comp rx=0 tx=0).stop 2023-11-04T01:36:57.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.654+0000 7f5bf73b6640 1 -- 172.21.15.44:0/2963491692 shutdown_connections 2023-11-04T01:36:57.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.654+0000 7f5bf73b6640 1 --2- 172.21.15.44:0/2963491692 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5bd406ae70 0x7f5bd406d330 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.654+0000 7f5bf73b6640 1 --2- 172.21.15.44:0/2963491692 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bf0159c00 0x7f5bf00b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.654+0000 7f5bf73b6640 1 --2- 172.21.15.44:0/2963491692 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5bf00c48e0 0x7f5bf01f0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.654+0000 7f5bf73b6640 1 --2- 172.21.15.44:0/2963491692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bf00ae1d0 0x7f5bf00ae640 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.654+0000 7f5bf73b6640 1 -- 172.21.15.44:0/2963491692 >> 172.21.15.44:0/2963491692 conn(0x7f5bf00ce950 msgr2=0x7f5bf006d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.654+0000 7f5bf73b6640 1 -- 172.21.15.44:0/2963491692 shutdown_connections 2023-11-04T01:36:57.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:57.654+0000 7f5bf73b6640 1 -- 172.21.15.44:0/2963491692 wait complete. 2023-11-04T01:36:57.667 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi204.front.sepia.ceph.com... 2023-11-04T01:36:57.667 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:57.667 DEBUG:teuthology.orchestra.run.smithi204:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:57.735 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:57.736 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi204.stderr:ceph-fuse[124612]: fuse finished with error 0 and tester_r 0 2023-11-04T01:36:57.736 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:36:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:57.741 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi204.stderr:2023-11-04T01:36:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:57.743 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:36:57.749 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:36:57.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:57.750 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:36:57.811 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:36:57.814 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:36:57.934 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:36:57.934 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:57.950 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:36:57.950 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:58.005 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:58.046 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi044.stderr:2023-11-04T01:36:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:58.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.149+0000 7f1f5d93c640 1 Processor -- start 2023-11-04T01:36:58.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.149+0000 7f1f5d93c640 1 -- start start 2023-11-04T01:36:58.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.150+0000 7f1f5d93c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f580ce240 0x7f1f58157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.150+0000 7f1f5d93c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1f58157540 0x7f1f580d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.150+0000 7f1f5d93c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5815e000 con 0x7f1f580cde60 2023-11-04T01:36:58.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.150+0000 7f1f5d93c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5815e5c0 con 0x7f1f58157540 2023-11-04T01:36:58.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.150+0000 7f1f5d93c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5815e2e0 con 0x7f1f580ce240 2023-11-04T01:36:58.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.150+0000 7f1f577fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1f58157540 0x7f1f580d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.150+0000 7f1f567fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f580ce240 0x7f1f58157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.150+0000 7f1f577fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1f58157540 0x7f1f580d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:35798/0 (socket says 172.21.15.44:35798) 2023-11-04T01:36:58.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.150+0000 7f1f567fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f580ce240 0x7f1f58157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:59166/0 (socket says 172.21.15.44:59166) 2023-11-04T01:36:58.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.150+0000 7f1f577fe640 1 -- 172.21.15.44:0/537513239 learned_addr learned my addr 172.21.15.44:0/537513239 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:58.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.150+0000 7f1f56ffd640 1 --1- 172.21.15.44:0/537513239 >> v1:172.21.15.204:6789/0 conn(0x7f1f580cde60 0x7f1f5815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:42602/0 (socket says 172.21.15.44:42602) 2023-11-04T01:36:58.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.151+0000 7f1f567fc640 1 -- 172.21.15.44:0/537513239 >> v2:172.21.15.204:3300/0 conn(0x7f1f58157540 msgr2=0x7f1f580d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:58.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.151+0000 7f1f567fc640 1 --2- 172.21.15.44:0/537513239 >> v2:172.21.15.204:3300/0 conn(0x7f1f58157540 0x7f1f580d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.151+0000 7f1f567fc640 1 -- 172.21.15.44:0/537513239 >> v1:172.21.15.204:6789/0 conn(0x7f1f580cde60 legacy=0x7f1f5815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.151+0000 7f1f567fc640 1 -- 172.21.15.44:0/537513239 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f580d1120 con 0x7f1f580ce240 2023-11-04T01:36:58.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.151+0000 7f1f577fe640 1 --2- 172.21.15.44:0/537513239 >> v2:172.21.15.204:3300/0 conn(0x7f1f58157540 0x7f1f580d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:58.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.152+0000 7f1f567fc640 1 --2- 172.21.15.44:0/537513239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f580ce240 0x7f1f58157000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1f400097a0 tx=0x7f1f4002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69f4be215e0bcf1d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.152+0000 7f1f55ffb640 1 -- 172.21.15.44:0/537513239 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40031830 con 0x7f1f580ce240 2023-11-04T01:36:58.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.152+0000 7f1f55ffb640 1 -- 172.21.15.44:0/537513239 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f40031990 con 0x7f1f580ce240 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.152+0000 7f1f55ffb640 1 -- 172.21.15.44:0/537513239 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40031d20 con 0x7f1f580ce240 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.152+0000 7f1f5d93c640 1 -- 172.21.15.44:0/537513239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f580ce240 msgr2=0x7f1f58157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.152+0000 7f1f5d93c640 1 --2- 172.21.15.44:0/537513239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f580ce240 0x7f1f58157000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1f400097a0 tx=0x7f1f4002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.152+0000 7f1f5d93c640 1 -- 172.21.15.44:0/537513239 shutdown_connections 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.152+0000 7f1f5d93c640 1 --2- 172.21.15.44:0/537513239 >> v2:172.21.15.204:3300/0 conn(0x7f1f58157540 0x7f1f580d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.152+0000 7f1f5d93c640 1 --2- 172.21.15.44:0/537513239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f580ce240 0x7f1f58157000 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.152+0000 7f1f5d93c640 1 -- 172.21.15.44:0/537513239 >> 172.21.15.44:0/537513239 conn(0x7f1f58071f30 msgr2=0x7f1f580cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.152+0000 7f1f5d93c640 1 -- 172.21.15.44:0/537513239 shutdown_connections 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.152+0000 7f1f5d93c640 1 -- 172.21.15.44:0/537513239 wait complete. 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.154+0000 7f1f5d93c640 1 Processor -- start 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.154+0000 7f1f5d93c640 1 -- start start 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.154+0000 7f1f5d93c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f580cde60 0x7f1f581536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.154+0000 7f1f5d93c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f580ce240 0x7f1f58158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.154+0000 7f1f5d93c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f58157540 0x7f1f5815c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.154+0000 7f1f5d93c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5815c400 con 0x7f1f580ce240 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.154+0000 7f1f5d93c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5815b570 con 0x7f1f58157540 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.154+0000 7f1f5d93c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5815b780 con 0x7f1f580cde60 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f567fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f580ce240 0x7f1f58158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f567fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f580ce240 0x7f1f58158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39254/0 (socket says 172.21.15.44:39254) 2023-11-04T01:36:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f567fc640 1 -- 172.21.15.44:0/3759515602 learned_addr learned my addr 172.21.15.44:0/3759515602 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f56ffd640 1 --2- 172.21.15.44:0/3759515602 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f580cde60 0x7f1f581536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f577fe640 1 --2- 172.21.15.44:0/3759515602 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f58157540 0x7f1f5815c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f567fc640 1 -- 172.21.15.44:0/3759515602 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f580cde60 msgr2=0x7f1f581536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f567fc640 1 --2- 172.21.15.44:0/3759515602 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f580cde60 0x7f1f581536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f567fc640 1 -- 172.21.15.44:0/3759515602 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f58157540 msgr2=0x7f1f5815c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f567fc640 1 --2- 172.21.15.44:0/3759515602 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f58157540 0x7f1f5815c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f567fc640 1 -- 172.21.15.44:0/3759515602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f48009b30 con 0x7f1f580ce240 2023-11-04T01:36:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f567fc640 1 --2- 172.21.15.44:0/3759515602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f580ce240 0x7f1f58158a20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1f4002bee0 tx=0x7f1f400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f4ffff640 1 -- 172.21.15.44:0/3759515602 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4003a6f0 con 0x7f1f580ce240 2023-11-04T01:36:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f4ffff640 1 -- 172.21.15.44:0/3759515602 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4003a870 con 0x7f1f580ce240 2023-11-04T01:36:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f5d93c640 1 -- 172.21.15.44:0/3759515602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f40009400 con 0x7f1f580ce240 2023-11-04T01:36:58.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f4ffff640 1 -- 172.21.15.44:0/3759515602 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4003ac20 con 0x7f1f580ce240 2023-11-04T01:36:58.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.155+0000 7f1f5d93c640 1 -- 172.21.15.44:0/3759515602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5815bd40 con 0x7f1f580ce240 2023-11-04T01:36:58.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.156+0000 7f1f5d93c640 1 -- 172.21.15.44:0/3759515602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f580cfea0 con 0x7f1f580ce240 2023-11-04T01:36:58.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.157+0000 7f1f4ffff640 1 -- 172.21.15.44:0/3759515602 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f4004c3b0 con 0x7f1f580ce240 2023-11-04T01:36:58.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.157+0000 7f1f4ffff640 1 --2- 172.21.15.44:0/3759515602 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1f3806ae70 0x7f1f3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.157+0000 7f1f4ffff640 1 -- 172.21.15.44:0/3759515602 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1f400ab630 con 0x7f1f580ce240 2023-11-04T01:36:58.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.157+0000 7f1f56ffd640 1 --2- 172.21.15.44:0/3759515602 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1f3806ae70 0x7f1f3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.158+0000 7f1f56ffd640 1 --2- 172.21.15.44:0/3759515602 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1f3806ae70 0x7f1f3806d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1f50000f60 tx=0x7f1f50000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.162+0000 7f1f4ffff640 1 -- 172.21.15.44:0/3759515602 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1f400763d0 con 0x7f1f580ce240 2023-11-04T01:36:58.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.338+0000 7f1f5d93c640 1 -- 172.21.15.44:0/3759515602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f58074290 con 0x7f1f580ce240 2023-11-04T01:36:58.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.339+0000 7f1f4ffff640 1 -- 172.21.15.44:0/3759515602 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7f1f400799f0 con 0x7f1f580ce240 2023-11-04T01:36:58.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:36:58.341 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.341+0000 7f1f5d93c640 1 -- 172.21.15.44:0/3759515602 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1f3806ae70 msgr2=0x7f1f3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.341+0000 7f1f5d93c640 1 --2- 172.21.15.44:0/3759515602 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1f3806ae70 0x7f1f3806d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1f50000f60 tx=0x7f1f50000ed0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.341+0000 7f1f5d93c640 1 -- 172.21.15.44:0/3759515602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f580ce240 msgr2=0x7f1f58158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.341+0000 7f1f5d93c640 1 --2- 172.21.15.44:0/3759515602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f580ce240 0x7f1f58158a20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1f4002bee0 tx=0x7f1f400046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.341+0000 7f1f5d93c640 1 -- 172.21.15.44:0/3759515602 shutdown_connections 2023-11-04T01:36:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.341+0000 7f1f5d93c640 1 --2- 172.21.15.44:0/3759515602 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1f3806ae70 0x7f1f3806d330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.341+0000 7f1f5d93c640 1 --2- 172.21.15.44:0/3759515602 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f58157540 0x7f1f5815c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.341+0000 7f1f5d93c640 1 --2- 172.21.15.44:0/3759515602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f580ce240 0x7f1f58158a20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.341+0000 7f1f5d93c640 1 --2- 172.21.15.44:0/3759515602 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f580cde60 0x7f1f581536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.341+0000 7f1f5d93c640 1 -- 172.21.15.44:0/3759515602 >> 172.21.15.44:0/3759515602 conn(0x7f1f58071f30 msgr2=0x7f1f580b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.341+0000 7f1f5d93c640 1 -- 172.21.15.44:0/3759515602 shutdown_connections 2023-11-04T01:36:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.341+0000 7f1f5d93c640 1 -- 172.21.15.44:0/3759515602 wait complete. 2023-11-04T01:36:58.354 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:58.355 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:58.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.462+0000 7f3cd4834640 1 Processor -- start 2023-11-04T01:36:58.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.462+0000 7f3cd4834640 1 -- start start 2023-11-04T01:36:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.462+0000 7f3cd4834640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cd0160430 0x7f3cd00b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.463+0000 7f3cd4834640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3cd006c3a0 0x7f3cd00cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.463+0000 7f3cd4834640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd00b2fc0 con 0x7f3cd00b2b60 2023-11-04T01:36:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.463+0000 7f3cd4834640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd00cb580 con 0x7f3cd006c3a0 2023-11-04T01:36:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.463+0000 7f3cd4834640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd006ca40 con 0x7f3cd0160430 2023-11-04T01:36:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.463+0000 7f3cced9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3cd006c3a0 0x7f3cd00cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.463+0000 7f3cced9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3cd006c3a0 0x7f3cd00cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39256/0 (socket says 172.21.15.44:39256) 2023-11-04T01:36:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.463+0000 7f3cced9d640 1 -- 172.21.15.44:0/2927139035 learned_addr learned my addr 172.21.15.44:0/2927139035 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.463+0000 7f3cce59c640 1 --2- 172.21.15.44:0/2927139035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cd0160430 0x7f3cd00b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.463+0000 7f3cced9d640 1 -- 172.21.15.44:0/2927139035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cd0160430 msgr2=0x7f3cd00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.463+0000 7f3cced9d640 1 --2- 172.21.15.44:0/2927139035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cd0160430 0x7f3cd00b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.463+0000 7f3cced9d640 1 -- 172.21.15.44:0/2927139035 >> v1:172.21.15.204:6789/0 conn(0x7f3cd00b2b60 legacy=0x7f3cd006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.463+0000 7f3cced9d640 1 -- 172.21.15.44:0/2927139035 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd006c810 con 0x7f3cd006c3a0 2023-11-04T01:36:58.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.464+0000 7f3cced9d640 1 --2- 172.21.15.44:0/2927139035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd006c3a0 0x7f3cd00cbcb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009e50 tx=0x7f3cc802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6cda3de124ec0df server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.464+0000 7f3ccdd9b640 1 -- 172.21.15.44:0/2927139035 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc802cb00 con 0x7f3cd006c3a0 2023-11-04T01:36:58.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.464+0000 7f3ccdd9b640 1 -- 172.21.15.44:0/2927139035 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc802cc60 con 0x7f3cd006c3a0 2023-11-04T01:36:58.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.464+0000 7f3ccdd9b640 1 -- 172.21.15.44:0/2927139035 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80343f0 con 0x7f3cd006c3a0 2023-11-04T01:36:58.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.464+0000 7f3cd4834640 1 -- 172.21.15.44:0/2927139035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd006c3a0 msgr2=0x7f3cd00cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.464+0000 7f3cd4834640 1 --2- 172.21.15.44:0/2927139035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd006c3a0 0x7f3cd00cbcb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009e50 tx=0x7f3cc802bf60 comp rx=0 tx=0).stop 2023-11-04T01:36:58.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.464+0000 7f3cd4834640 1 -- 172.21.15.44:0/2927139035 shutdown_connections 2023-11-04T01:36:58.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.464+0000 7f3cd4834640 1 --2- 172.21.15.44:0/2927139035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd006c3a0 0x7f3cd00cbcb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.464+0000 7f3cd4834640 1 --2- 172.21.15.44:0/2927139035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cd0160430 0x7f3cd00b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.464+0000 7f3cd4834640 1 -- 172.21.15.44:0/2927139035 >> 172.21.15.44:0/2927139035 conn(0x7f3cd006ea20 msgr2=0x7f3cd006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.464+0000 7f3cd4834640 1 -- 172.21.15.44:0/2927139035 shutdown_connections 2023-11-04T01:36:58.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.464+0000 7f3cd4834640 1 -- 172.21.15.44:0/2927139035 wait complete. 2023-11-04T01:36:58.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.466+0000 7f3cd4834640 1 Processor -- start 2023-11-04T01:36:58.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.466+0000 7f3cd4834640 1 -- start start 2023-11-04T01:36:58.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cd4834640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd006c3a0 0x7f3cd0152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cd4834640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3cd00b2b60 0x7f3cd01f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cd4834640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cd0160430 0x7f3cd00c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cd4834640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00c9ac0 con 0x7f3cd006c3a0 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cd4834640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00c98d0 con 0x7f3cd00b2b60 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cd4834640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00b3960 con 0x7f3cd0160430 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cce59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd006c3a0 0x7f3cd0152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cce59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd006c3a0 0x7f3cd0152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39272/0 (socket says 172.21.15.44:39272) 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cce59c640 1 -- 172.21.15.44:0/680223635 learned_addr learned my addr 172.21.15.44:0/680223635 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cced9d640 1 --2- 172.21.15.44:0/680223635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cd0160430 0x7f3cd00c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cc5d9b640 1 --2- 172.21.15.44:0/680223635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3cd00b2b60 0x7f3cd01f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cce59c640 1 -- 172.21.15.44:0/680223635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cd0160430 msgr2=0x7f3cd00c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cce59c640 1 --2- 172.21.15.44:0/680223635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cd0160430 0x7f3cd00c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cce59c640 1 -- 172.21.15.44:0/680223635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3cd00b2b60 msgr2=0x7f3cd01f68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cce59c640 1 --2- 172.21.15.44:0/680223635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3cd00b2b60 0x7f3cd01f68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cce59c640 1 -- 172.21.15.44:0/680223635 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc8009b30 con 0x7f3cd006c3a0 2023-11-04T01:36:58.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cce59c640 1 --2- 172.21.15.44:0/680223635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd006c3a0 0x7f3cd0152120 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000e9b0 tx=0x7f3cc000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cc77fe640 1 -- 172.21.15.44:0/680223635 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0009670 con 0x7f3cd006c3a0 2023-11-04T01:36:58.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cc77fe640 1 -- 172.21.15.44:0/680223635 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc000c9a0 con 0x7f3cd006c3a0 2023-11-04T01:36:58.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cd4834640 1 -- 172.21.15.44:0/680223635 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd00b3c40 con 0x7f3cd006c3a0 2023-11-04T01:36:58.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cc77fe640 1 -- 172.21.15.44:0/680223635 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc000cd50 con 0x7f3cd006c3a0 2023-11-04T01:36:58.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.467+0000 7f3cd4834640 1 -- 172.21.15.44:0/680223635 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd00b4200 con 0x7f3cd006c3a0 2023-11-04T01:36:58.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.468+0000 7f3cd4834640 1 -- 172.21.15.44:0/680223635 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd0074290 con 0x7f3cd006c3a0 2023-11-04T01:36:58.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.469+0000 7f3cc77fe640 1 -- 172.21.15.44:0/680223635 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3cc0013470 con 0x7f3cd006c3a0 2023-11-04T01:36:58.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.469+0000 7f3cc77fe640 1 --2- 172.21.15.44:0/680223635 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3cb006aea0 0x7f3cb006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.469+0000 7f3cc77fe640 1 -- 172.21.15.44:0/680223635 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3cc0089b80 con 0x7f3cd006c3a0 2023-11-04T01:36:58.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.469+0000 7f3cc5d9b640 1 --2- 172.21.15.44:0/680223635 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3cb006aea0 0x7f3cb006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.470+0000 7f3cc5d9b640 1 --2- 172.21.15.44:0/680223635 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3cb006aea0 0x7f3cb006d360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0152660 tx=0x7f3cb8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.473+0000 7f3cc77fe640 1 -- 172.21.15.44:0/680223635 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3cc00548a0 con 0x7f3cd006c3a0 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.647+0000 7f3cd4834640 1 -- 172.21.15.44:0/680223635 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3cd00b6b20 con 0x7f3cd006c3a0 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.647+0000 7f3cc77fe640 1 -- 172.21.15.44:0/680223635 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3cc0057ec0 con 0x7f3cd006c3a0 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:36:58.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.649+0000 7f3cd4834640 1 -- 172.21.15.44:0/680223635 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3cb006aea0 msgr2=0x7f3cb006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.649+0000 7f3cd4834640 1 --2- 172.21.15.44:0/680223635 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3cb006aea0 0x7f3cb006d360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0152660 tx=0x7f3cb8009040 comp rx=0 tx=0).stop 2023-11-04T01:36:58.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.649+0000 7f3cd4834640 1 -- 172.21.15.44:0/680223635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd006c3a0 msgr2=0x7f3cd0152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.649+0000 7f3cd4834640 1 --2- 172.21.15.44:0/680223635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd006c3a0 0x7f3cd0152120 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000e9b0 tx=0x7f3cc000ee70 comp rx=0 tx=0).stop 2023-11-04T01:36:58.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.649+0000 7f3cd4834640 1 -- 172.21.15.44:0/680223635 shutdown_connections 2023-11-04T01:36:58.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.649+0000 7f3cd4834640 1 --2- 172.21.15.44:0/680223635 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3cb006aea0 0x7f3cb006d360 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.649+0000 7f3cd4834640 1 --2- 172.21.15.44:0/680223635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3cd0160430 0x7f3cd00c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.649+0000 7f3cd4834640 1 --2- 172.21.15.44:0/680223635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3cd00b2b60 0x7f3cd01f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.649+0000 7f3cd4834640 1 --2- 172.21.15.44:0/680223635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd006c3a0 0x7f3cd0152120 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.649+0000 7f3cd4834640 1 -- 172.21.15.44:0/680223635 >> 172.21.15.44:0/680223635 conn(0x7f3cd006ea20 msgr2=0x7f3cd00b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.649+0000 7f3cd4834640 1 -- 172.21.15.44:0/680223635 shutdown_connections 2023-11-04T01:36:58.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.649+0000 7f3cd4834640 1 -- 172.21.15.44:0/680223635 wait complete. 2023-11-04T01:36:58.662 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:58.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.773+0000 7ff033578640 1 Processor -- start 2023-11-04T01:36:58.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.773+0000 7ff033578640 1 -- start start 2023-11-04T01:36:58.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.775+0000 7ff033578640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff02c153850 0x7ff02c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.775+0000 7ff033578640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff02c0cc520 0x7ff02c070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.775+0000 7ff033578640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff02c0cc9d0 0x7ff02c0714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.775+0000 7ff033578640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02c0c3860 con 0x7ff02c0cc520 2023-11-04T01:36:58.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.775+0000 7ff033578640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02c0c9250 con 0x7ff02c153850 2023-11-04T01:36:58.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.775+0000 7ff033578640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c153c30 con 0x7ff02c0cc9d0 2023-11-04T01:36:58.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.775+0000 7ff030b13640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff02c0cc520 0x7ff02c070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.776+0000 7ff030b13640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff02c0cc520 0x7ff02c070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39282/0 (socket says 172.21.15.44:39282) 2023-11-04T01:36:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.776+0000 7ff030b13640 1 -- 172.21.15.44:0/3133894263 learned_addr learned my addr 172.21.15.44:0/3133894263 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.776+0000 7ff031314640 1 --2- 172.21.15.44:0/3133894263 >> v2:172.21.15.204:3300/0 conn(0x7ff02c153850 0x7ff02c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.776+0000 7ff031b15640 1 --2- 172.21.15.44:0/3133894263 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff02c0cc9d0 0x7ff02c0714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.776+0000 7ff030b13640 1 -- 172.21.15.44:0/3133894263 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff02c0cc9d0 msgr2=0x7ff02c0714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.776+0000 7ff030b13640 1 --2- 172.21.15.44:0/3133894263 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff02c0cc9d0 0x7ff02c0714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.776+0000 7ff030b13640 1 -- 172.21.15.44:0/3133894263 >> v2:172.21.15.204:3300/0 conn(0x7ff02c153850 msgr2=0x7ff02c15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.776+0000 7ff030b13640 1 --2- 172.21.15.44:0/3133894263 >> v2:172.21.15.204:3300/0 conn(0x7ff02c153850 0x7ff02c15a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.776+0000 7ff030b13640 1 -- 172.21.15.44:0/3133894263 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c15a700 con 0x7ff02c0cc520 2023-11-04T01:36:58.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.777+0000 7ff030b13640 1 --2- 172.21.15.44:0/3133894263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff02c0cc520 0x7ff02c070fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0c5710 tx=0x7ff01c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33541e57e1d88563 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.777+0000 7ff023fff640 1 -- 172.21.15.44:0/3133894263 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c031870 con 0x7ff02c0cc520 2023-11-04T01:36:58.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.777+0000 7ff023fff640 1 -- 172.21.15.44:0/3133894263 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c0319d0 con 0x7ff02c0cc520 2023-11-04T01:36:58.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.777+0000 7ff023fff640 1 -- 172.21.15.44:0/3133894263 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c031d60 con 0x7ff02c0cc520 2023-11-04T01:36:58.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.778+0000 7ff033578640 1 -- 172.21.15.44:0/3133894263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff02c0cc520 msgr2=0x7ff02c070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.778+0000 7ff033578640 1 --2- 172.21.15.44:0/3133894263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff02c0cc520 0x7ff02c070fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0c5710 tx=0x7ff01c02b910 comp rx=0 tx=0).stop 2023-11-04T01:36:58.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.778+0000 7ff033578640 1 -- 172.21.15.44:0/3133894263 shutdown_connections 2023-11-04T01:36:58.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.778+0000 7ff033578640 1 --2- 172.21.15.44:0/3133894263 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff02c0cc9d0 0x7ff02c0714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.778+0000 7ff033578640 1 --2- 172.21.15.44:0/3133894263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff02c0cc520 0x7ff02c070fa0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.778+0000 7ff033578640 1 --2- 172.21.15.44:0/3133894263 >> v2:172.21.15.204:3300/0 conn(0x7ff02c153850 0x7ff02c15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.778+0000 7ff033578640 1 -- 172.21.15.44:0/3133894263 >> 172.21.15.44:0/3133894263 conn(0x7ff02c0ce950 msgr2=0x7ff02c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.778+0000 7ff033578640 1 -- 172.21.15.44:0/3133894263 shutdown_connections 2023-11-04T01:36:58.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.778+0000 7ff033578640 1 -- 172.21.15.44:0/3133894263 wait complete. 2023-11-04T01:36:58.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.779+0000 7ff033578640 1 Processor -- start 2023-11-04T01:36:58.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.779+0000 7ff033578640 1 -- start start 2023-11-04T01:36:58.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.780+0000 7ff033578640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff02c0cc520 0x7ff02c0b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.780+0000 7ff033578640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff02c0cc9d0 0x7ff02c0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.780+0000 7ff033578640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff02c153850 0x7ff02c14b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.780+0000 7ff033578640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c0b0920 con 0x7ff02c0cc9d0 2023-11-04T01:36:58.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.780+0000 7ff033578640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c0b1f70 con 0x7ff02c0cc520 2023-11-04T01:36:58.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.780+0000 7ff033578640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c14bba0 con 0x7ff02c153850 2023-11-04T01:36:58.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.780+0000 7ff030b13640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff02c0cc9d0 0x7ff02c0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.780+0000 7ff030b13640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff02c0cc9d0 0x7ff02c0afe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39296/0 (socket says 172.21.15.44:39296) 2023-11-04T01:36:58.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.780+0000 7ff030b13640 1 -- 172.21.15.44:0/1100979894 learned_addr learned my addr 172.21.15.44:0/1100979894 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:58.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.780+0000 7ff031314640 1 --2- 172.21.15.44:0/1100979894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff02c0cc520 0x7ff02c0b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.780+0000 7ff031b15640 1 --2- 172.21.15.44:0/1100979894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff02c153850 0x7ff02c14b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.781+0000 7ff030b13640 1 -- 172.21.15.44:0/1100979894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff02c153850 msgr2=0x7ff02c14b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.781+0000 7ff030b13640 1 --2- 172.21.15.44:0/1100979894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff02c153850 0x7ff02c14b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.781+0000 7ff030b13640 1 -- 172.21.15.44:0/1100979894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff02c0cc520 msgr2=0x7ff02c0b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.781+0000 7ff030b13640 1 --2- 172.21.15.44:0/1100979894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff02c0cc520 0x7ff02c0b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.781+0000 7ff030b13640 1 -- 172.21.15.44:0/1100979894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c0094d0 con 0x7ff02c0cc9d0 2023-11-04T01:36:58.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.781+0000 7ff030b13640 1 --2- 172.21.15.44:0/1100979894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff02c0cc9d0 0x7ff02c0afe40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff01c000c00 tx=0x7ff01c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.781+0000 7ff021ffb640 1 -- 172.21.15.44:0/1100979894 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c03ac60 con 0x7ff02c0cc9d0 2023-11-04T01:36:58.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.781+0000 7ff021ffb640 1 -- 172.21.15.44:0/1100979894 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c03ade0 con 0x7ff02c0cc9d0 2023-11-04T01:36:58.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.781+0000 7ff033578640 1 -- 172.21.15.44:0/1100979894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02c14c640 con 0x7ff02c0cc9d0 2023-11-04T01:36:58.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.781+0000 7ff021ffb640 1 -- 172.21.15.44:0/1100979894 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c042630 con 0x7ff02c0cc9d0 2023-11-04T01:36:58.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.781+0000 7ff033578640 1 -- 172.21.15.44:0/1100979894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02c0b18b0 con 0x7ff02c0cc9d0 2023-11-04T01:36:58.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.783+0000 7ff033578640 1 -- 172.21.15.44:0/1100979894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02c0b20b0 con 0x7ff02c0cc9d0 2023-11-04T01:36:58.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.783+0000 7ff021ffb640 1 -- 172.21.15.44:0/1100979894 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff01c0303c0 con 0x7ff02c0cc9d0 2023-11-04T01:36:58.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.783+0000 7ff021ffb640 1 --2- 172.21.15.44:0/1100979894 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff01006aea0 0x7ff01006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.783+0000 7ff021ffb640 1 -- 172.21.15.44:0/1100979894 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff01c02d040 con 0x7ff02c0cc9d0 2023-11-04T01:36:58.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.783+0000 7ff031314640 1 --2- 172.21.15.44:0/1100979894 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff01006aea0 0x7ff01006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.784+0000 7ff031314640 1 --2- 172.21.15.44:0/1100979894 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff01006aea0 0x7ff01006d360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff028009a20 tx=0x7ff028009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.788+0000 7ff021ffb640 1 -- 172.21.15.44:0/1100979894 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff02c0b20b0 con 0x7ff02c0cc9d0 2023-11-04T01:36:58.980 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.976+0000 7ff033578640 1 -- 172.21.15.44:0/1100979894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff02c0b20b0 con 0x7ff02c0cc9d0 2023-11-04T01:36:58.980 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.976+0000 7ff021ffb640 1 -- 172.21.15.44:0/1100979894 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff01c0abe60 con 0x7ff02c0cc9d0 2023-11-04T01:36:58.980 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:58.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.978+0000 7ff033578640 1 -- 172.21.15.44:0/1100979894 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff01006aea0 msgr2=0x7ff01006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.978+0000 7ff033578640 1 --2- 172.21.15.44:0/1100979894 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff01006aea0 0x7ff01006d360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff028009a20 tx=0x7ff028009190 comp rx=0 tx=0).stop 2023-11-04T01:36:58.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.978+0000 7ff033578640 1 -- 172.21.15.44:0/1100979894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff02c0cc9d0 msgr2=0x7ff02c0afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.978+0000 7ff033578640 1 --2- 172.21.15.44:0/1100979894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff02c0cc9d0 0x7ff02c0afe40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff01c000c00 tx=0x7ff01c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.978+0000 7ff033578640 1 -- 172.21.15.44:0/1100979894 shutdown_connections 2023-11-04T01:36:58.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.978+0000 7ff033578640 1 --2- 172.21.15.44:0/1100979894 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff01006aea0 0x7ff01006d360 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.978+0000 7ff033578640 1 --2- 172.21.15.44:0/1100979894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff02c153850 0x7ff02c14b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.978+0000 7ff033578640 1 --2- 172.21.15.44:0/1100979894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff02c0cc9d0 0x7ff02c0afe40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.978+0000 7ff033578640 1 --2- 172.21.15.44:0/1100979894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff02c0cc520 0x7ff02c0b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.978+0000 7ff033578640 1 -- 172.21.15.44:0/1100979894 >> 172.21.15.44:0/1100979894 conn(0x7ff02c0ce950 msgr2=0x7ff02c15a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.979+0000 7ff033578640 1 -- 172.21.15.44:0/1100979894 shutdown_connections 2023-11-04T01:36:58.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:58.979+0000 7ff033578640 1 -- 172.21.15.44:0/1100979894 wait complete. 2023-11-04T01:36:58.992 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:59.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.098+0000 7f21ab7ce640 1 Processor -- start 2023-11-04T01:36:59.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.099+0000 7f21ab7ce640 1 -- start start 2023-11-04T01:36:59.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.099+0000 7f21ab7ce640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f21a4153e60 0x7f21a415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.100+0000 7f21ab7ce640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21a40b4880 0x7f21a40b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.100+0000 7f21ab7ce640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a40cde60 con 0x7f21a40cd6d0 2023-11-04T01:36:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.100+0000 7f21ab7ce640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a4160f90 con 0x7f21a4153e60 2023-11-04T01:36:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.100+0000 7f21ab7ce640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40b5200 con 0x7f21a40b4880 2023-11-04T01:36:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.100+0000 7f21a8d69640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f21a40cd6d0 0x7f21a4161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38428/0 (socket says 172.21.15.44:38428) 2023-11-04T01:36:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.100+0000 7f21a8d69640 1 -- 172.21.15.44:0/2941020649 learned_addr learned my addr 172.21.15.44:0/2941020649 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.100+0000 7f21a9d6b640 1 --2- 172.21.15.44:0/2941020649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21a40b4880 0x7f21a40b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.100+0000 7f21a956a640 1 --2- 172.21.15.44:0/2941020649 >> v2:172.21.15.204:3300/0 conn(0x7f21a4153e60 0x7f21a415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.100+0000 7f219bfff640 1 -- 172.21.15.44:0/2941020649 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896332845 0 0) 0x7f21a40cde60 con 0x7f21a40cd6d0 2023-11-04T01:36:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.100+0000 7f219bfff640 1 -- 172.21.15.44:0/2941020649 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2190003520 con 0x7f21a40cd6d0 2023-11-04T01:36:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.100+0000 7f21a956a640 1 -- 172.21.15.44:0/2941020649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21a40b4880 msgr2=0x7f21a40b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.100+0000 7f21a956a640 1 --2- 172.21.15.44:0/2941020649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21a40b4880 0x7f21a40b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.100+0000 7f21a956a640 1 -- 172.21.15.44:0/2941020649 >> v1:172.21.15.44:6789/0 conn(0x7f21a40cd6d0 legacy=0x7f21a4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.100+0000 7f21a956a640 1 -- 172.21.15.44:0/2941020649 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a415e400 con 0x7f21a4153e60 2023-11-04T01:36:59.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.100+0000 7f21a9d6b640 1 --2- 172.21.15.44:0/2941020649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21a40b4880 0x7f21a40b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:59.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.101+0000 7f21a956a640 1 --2- 172.21.15.44:0/2941020649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21a4153e60 0x7f21a415dec0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f21a00097a0 tx=0x7f21a002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa938428eb490204 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.101+0000 7f219bfff640 1 -- 172.21.15.44:0/2941020649 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0031830 con 0x7f21a4153e60 2023-11-04T01:36:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.101+0000 7f219bfff640 1 -- 172.21.15.44:0/2941020649 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a0031990 con 0x7f21a4153e60 2023-11-04T01:36:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.101+0000 7f219bfff640 1 -- 172.21.15.44:0/2941020649 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0031d20 con 0x7f21a4153e60 2023-11-04T01:36:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.102+0000 7f21ab7ce640 1 -- 172.21.15.44:0/2941020649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21a4153e60 msgr2=0x7f21a415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.102+0000 7f21ab7ce640 1 --2- 172.21.15.44:0/2941020649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21a4153e60 0x7f21a415dec0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f21a00097a0 tx=0x7f21a002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.102+0000 7f21ab7ce640 1 -- 172.21.15.44:0/2941020649 shutdown_connections 2023-11-04T01:36:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.102+0000 7f21ab7ce640 1 --2- 172.21.15.44:0/2941020649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21a40b4880 0x7f21a40b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.102+0000 7f21ab7ce640 1 --2- 172.21.15.44:0/2941020649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21a4153e60 0x7f21a415dec0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.102+0000 7f21ab7ce640 1 -- 172.21.15.44:0/2941020649 >> 172.21.15.44:0/2941020649 conn(0x7f21a40cf880 msgr2=0x7f21a40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.102+0000 7f21ab7ce640 1 -- 172.21.15.44:0/2941020649 shutdown_connections 2023-11-04T01:36:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.102+0000 7f21ab7ce640 1 -- 172.21.15.44:0/2941020649 wait complete. 2023-11-04T01:36:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.103+0000 7f21ab7ce640 1 Processor -- start 2023-11-04T01:36:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.103+0000 7f21ab7ce640 1 -- start start 2023-11-04T01:36:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21ab7ce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21a40b4880 0x7f21a41501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21ab7ce640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21a40cd6d0 0x7f21a40cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21ab7ce640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21a4153e60 0x7f21a41565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21ab7ce640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a4150720 con 0x7f21a40b4880 2023-11-04T01:36:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21ab7ce640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a41f3280 con 0x7f21a4153e60 2023-11-04T01:36:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21ab7ce640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a41f5c50 con 0x7f21a40cd6d0 2023-11-04T01:36:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21a956a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21a40b4880 0x7f21a41501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21a956a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21a40b4880 0x7f21a41501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39310/0 (socket says 172.21.15.44:39310) 2023-11-04T01:36:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21a956a640 1 -- 172.21.15.44:0/1103457639 learned_addr learned my addr 172.21.15.44:0/1103457639 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21a8d69640 1 --2- 172.21.15.44:0/1103457639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21a40cd6d0 0x7f21a40cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21a9d6b640 1 --2- 172.21.15.44:0/1103457639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21a4153e60 0x7f21a41565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21a956a640 1 -- 172.21.15.44:0/1103457639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21a40cd6d0 msgr2=0x7f21a40cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21a956a640 1 --2- 172.21.15.44:0/1103457639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21a40cd6d0 0x7f21a40cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21a956a640 1 -- 172.21.15.44:0/1103457639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21a4153e60 msgr2=0x7f21a41565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21a956a640 1 --2- 172.21.15.44:0/1103457639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21a4153e60 0x7f21a41565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21a956a640 1 -- 172.21.15.44:0/1103457639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c009a70 con 0x7f21a40b4880 2023-11-04T01:36:59.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.104+0000 7f21a956a640 1 --2- 172.21.15.44:0/1103457639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21a40b4880 0x7f21a41501e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f21a0034040 tx=0x7f21a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.105+0000 7f2199ffb640 1 -- 172.21.15.44:0/1103457639 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a003a830 con 0x7f21a40b4880 2023-11-04T01:36:59.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.105+0000 7f2199ffb640 1 -- 172.21.15.44:0/1103457639 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a003a9b0 con 0x7f21a40b4880 2023-11-04T01:36:59.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.105+0000 7f21ab7ce640 1 -- 172.21.15.44:0/1103457639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a0009400 con 0x7f21a40b4880 2023-11-04T01:36:59.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.105+0000 7f2199ffb640 1 -- 172.21.15.44:0/1103457639 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a003ad60 con 0x7f21a40b4880 2023-11-04T01:36:59.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.105+0000 7f21ab7ce640 1 -- 172.21.15.44:0/1103457639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a40cb5a0 con 0x7f21a40b4880 2023-11-04T01:36:59.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.106+0000 7f21ab7ce640 1 -- 172.21.15.44:0/1103457639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a4074290 con 0x7f21a40b4880 2023-11-04T01:36:59.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.106+0000 7f2199ffb640 1 -- 172.21.15.44:0/1103457639 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21a004d440 con 0x7f21a40b4880 2023-11-04T01:36:59.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.107+0000 7f2199ffb640 1 --2- 172.21.15.44:0/1103457639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f218806ae70 0x7f218806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.107+0000 7f2199ffb640 1 -- 172.21.15.44:0/1103457639 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f21a00ab870 con 0x7f21a40b4880 2023-11-04T01:36:59.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.107+0000 7f21a8d69640 1 --2- 172.21.15.44:0/1103457639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f218806ae70 0x7f218806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.107+0000 7f21a8d69640 1 --2- 172.21.15.44:0/1103457639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f218806ae70 0x7f218806d330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f21a41f5910 tx=0x7f2194007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.111+0000 7f2199ffb640 1 -- 172.21.15.44:0/1103457639 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21a0076550 con 0x7f21a40b4880 2023-11-04T01:36:59.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.290+0000 7f21ab7ce640 1 -- 172.21.15.44:0/1103457639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21a40d0b80 con 0x7f21a40b4880 2023-11-04T01:36:59.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.291+0000 7f2199ffb640 1 -- 172.21.15.44:0/1103457639 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f21a0079b70 con 0x7f21a40b4880 2023-11-04T01:36:59.293 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:36:59.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.293+0000 7f21ab7ce640 1 -- 172.21.15.44:0/1103457639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f218806ae70 msgr2=0x7f218806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.293+0000 7f21ab7ce640 1 --2- 172.21.15.44:0/1103457639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f218806ae70 0x7f218806d330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f21a41f5910 tx=0x7f2194007d30 comp rx=0 tx=0).stop 2023-11-04T01:36:59.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.293+0000 7f21ab7ce640 1 -- 172.21.15.44:0/1103457639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21a40b4880 msgr2=0x7f21a41501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.293+0000 7f21ab7ce640 1 --2- 172.21.15.44:0/1103457639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21a40b4880 0x7f21a41501e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f21a0034040 tx=0x7f21a00046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.293+0000 7f21ab7ce640 1 -- 172.21.15.44:0/1103457639 shutdown_connections 2023-11-04T01:36:59.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.293+0000 7f21ab7ce640 1 --2- 172.21.15.44:0/1103457639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f218806ae70 0x7f218806d330 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.293+0000 7f21ab7ce640 1 --2- 172.21.15.44:0/1103457639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21a4153e60 0x7f21a41565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.293+0000 7f21ab7ce640 1 --2- 172.21.15.44:0/1103457639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21a40cd6d0 0x7f21a40cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.293+0000 7f21ab7ce640 1 --2- 172.21.15.44:0/1103457639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21a40b4880 0x7f21a41501e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.293+0000 7f21ab7ce640 1 -- 172.21.15.44:0/1103457639 >> 172.21.15.44:0/1103457639 conn(0x7f21a40cf880 msgr2=0x7f21a40d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.293+0000 7f21ab7ce640 1 -- 172.21.15.44:0/1103457639 shutdown_connections 2023-11-04T01:36:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.293+0000 7f21ab7ce640 1 -- 172.21.15.44:0/1103457639 wait complete. 2023-11-04T01:36:59.307 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:59.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.416+0000 7fabf1ee5640 1 Processor -- start 2023-11-04T01:36:59.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.416+0000 7fabf1ee5640 1 -- start start 2023-11-04T01:36:59.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.416+0000 7fabf1ee5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabec0cdf80 0x7fabec0b6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.416+0000 7fabf1ee5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec0b5230 con 0x7fabec0cdb20 2023-11-04T01:36:59.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.416+0000 7fabf1ee5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec0d1930 con 0x7fabec15d060 2023-11-04T01:36:59.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.416+0000 7fabf1ee5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec15d440 con 0x7fabec0cdf80 2023-11-04T01:36:59.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.417+0000 7fabeaffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fabec0cdb20 0x7fabec0b6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38438/0 (socket says 172.21.15.44:38438) 2023-11-04T01:36:59.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.417+0000 7fabeaffd640 1 -- 172.21.15.44:0/3702994032 learned_addr learned my addr 172.21.15.44:0/3702994032 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:59.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.417+0000 7fabebfff640 1 --2- 172.21.15.44:0/3702994032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabec0cdf80 0x7fabec0b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.417+0000 7fabea7fc640 1 -- 172.21.15.44:0/3702994032 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214474839 0 0) 0x7fabe0001110 con 0x7fabec0cdb20 2023-11-04T01:36:59.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.417+0000 7fabea7fc640 1 -- 172.21.15.44:0/3702994032 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabd4003520 con 0x7fabec0cdb20 2023-11-04T01:36:59.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.417+0000 7fabea7fc640 1 -- 172.21.15.44:0/3702994032 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163135161 0 0) 0x7fabec0d1930 con 0x7fabec15d060 2023-11-04T01:36:59.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.417+0000 7fabea7fc640 1 -- 172.21.15.44:0/3702994032 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabe0001110 con 0x7fabec15d060 2023-11-04T01:36:59.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.417+0000 7fabebfff640 1 -- 172.21.15.44:0/3702994032 >> v1:172.21.15.204:6789/0 conn(0x7fabec15d060 legacy=0x7fabec0b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.417+0000 7fabebfff640 1 -- 172.21.15.44:0/3702994032 >> v1:172.21.15.44:6789/0 conn(0x7fabec0cdb20 legacy=0x7fabec0b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.417+0000 7fabea7fc640 1 -- 172.21.15.44:0/3702994032 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2701975424 0 0) 0x7fabd4003520 con 0x7fabec0cdb20 2023-11-04T01:36:59.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.417+0000 7fabebfff640 1 -- 172.21.15.44:0/3702994032 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec0d0d20 con 0x7fabec0cdf80 2023-11-04T01:36:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.418+0000 7fabebfff640 1 --2- 172.21.15.44:0/3702994032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabec0cdf80 0x7fabec0b6860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009dc0 tx=0x7fabe402bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a7e09bd676b8893 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.418+0000 7fabea7fc640 1 -- 172.21.15.44:0/3702994032 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0001820 con 0x7fabec0cdf80 2023-11-04T01:36:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.418+0000 7fabea7fc640 1 -- 172.21.15.44:0/3702994032 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe402c910 con 0x7fabec0cdf80 2023-11-04T01:36:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.418+0000 7fabea7fc640 1 -- 172.21.15.44:0/3702994032 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe402cca0 con 0x7fabec0cdf80 2023-11-04T01:36:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.419+0000 7fabf1ee5640 1 -- 172.21.15.44:0/3702994032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabec0cdf80 msgr2=0x7fabec0b6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.419+0000 7fabf1ee5640 1 --2- 172.21.15.44:0/3702994032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabec0cdf80 0x7fabec0b6860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009dc0 tx=0x7fabe402bde0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.419+0000 7fabf1ee5640 1 -- 172.21.15.44:0/3702994032 shutdown_connections 2023-11-04T01:36:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.419+0000 7fabf1ee5640 1 --2- 172.21.15.44:0/3702994032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabec0cdf80 0x7fabec0b6860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.419+0000 7fabf1ee5640 1 -- 172.21.15.44:0/3702994032 >> 172.21.15.44:0/3702994032 conn(0x7fabec0cf760 msgr2=0x7fabec0cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.419+0000 7fabf1ee5640 1 -- 172.21.15.44:0/3702994032 shutdown_connections 2023-11-04T01:36:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.419+0000 7fabf1ee5640 1 -- 172.21.15.44:0/3702994032 wait complete. 2023-11-04T01:36:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.421+0000 7fabf1ee5640 1 Processor -- start 2023-11-04T01:36:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.421+0000 7fabf1ee5640 1 -- start start 2023-11-04T01:36:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabf1ee5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabec0cdb20 0x7fabec156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabf1ee5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabec0cdf80 0x7fabec154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabf1ee5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabec15d060 0x7fabec1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabf1ee5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec153490 con 0x7fabec15d060 2023-11-04T01:36:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabf1ee5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec15d580 con 0x7fabec0cdb20 2023-11-04T01:36:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabf1ee5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec156ea0 con 0x7fabec0cdf80 2023-11-04T01:36:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabebfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabec15d060 0x7fabec1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabebfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabec15d060 0x7fabec1524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39312/0 (socket says 172.21.15.44:39312) 2023-11-04T01:36:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabebfff640 1 -- 172.21.15.44:0/3319923884 learned_addr learned my addr 172.21.15.44:0/3319923884 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabeaffd640 1 --2- 172.21.15.44:0/3319923884 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabec0cdf80 0x7fabec154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabeb7fe640 1 --2- 172.21.15.44:0/3319923884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabec0cdb20 0x7fabec156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabebfff640 1 -- 172.21.15.44:0/3319923884 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabec0cdf80 msgr2=0x7fabec154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabebfff640 1 --2- 172.21.15.44:0/3319923884 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabec0cdf80 0x7fabec154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabebfff640 1 -- 172.21.15.44:0/3319923884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabec0cdb20 msgr2=0x7fabec156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabebfff640 1 --2- 172.21.15.44:0/3319923884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabec0cdb20 0x7fabec156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabebfff640 1 -- 172.21.15.44:0/3319923884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe4009a70 con 0x7fabec15d060 2023-11-04T01:36:59.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.422+0000 7fabebfff640 1 --2- 172.21.15.44:0/3319923884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabec15d060 0x7fabec1524f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fabe402c3f0 tx=0x7fabe4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.423+0000 7fabd3fff640 1 -- 172.21.15.44:0/3319923884 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe4034e50 con 0x7fabec15d060 2023-11-04T01:36:59.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.423+0000 7fabd3fff640 1 -- 172.21.15.44:0/3319923884 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe4009450 con 0x7fabec15d060 2023-11-04T01:36:59.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.423+0000 7fabf1ee5640 1 -- 172.21.15.44:0/3319923884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec154e40 con 0x7fabec15d060 2023-11-04T01:36:59.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.423+0000 7fabd3fff640 1 -- 172.21.15.44:0/3319923884 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe403e650 con 0x7fabec15d060 2023-11-04T01:36:59.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.423+0000 7fabf1ee5640 1 -- 172.21.15.44:0/3319923884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabec15dab0 con 0x7fabec15d060 2023-11-04T01:36:59.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.424+0000 7fabf1ee5640 1 -- 172.21.15.44:0/3319923884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabec074290 con 0x7fabec15d060 2023-11-04T01:36:59.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.424+0000 7fabd3fff640 1 -- 172.21.15.44:0/3319923884 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fabe403b050 con 0x7fabec15d060 2023-11-04T01:36:59.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.424+0000 7fabd3fff640 1 --2- 172.21.15.44:0/3319923884 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fabd806ae70 0x7fabd806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.424+0000 7fabd3fff640 1 -- 172.21.15.44:0/3319923884 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fabe40abf90 con 0x7fabec15d060 2023-11-04T01:36:59.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.425+0000 7fabeb7fe640 1 --2- 172.21.15.44:0/3319923884 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fabd806ae70 0x7fabd806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.425+0000 7fabeb7fe640 1 --2- 172.21.15.44:0/3319923884 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fabd806ae70 0x7fabd806d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0011e0 tx=0x7fabdc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.429+0000 7fabd3fff640 1 -- 172.21.15.44:0/3319923884 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fabe4076c90 con 0x7fabec15d060 2023-11-04T01:36:59.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.608+0000 7fabf1ee5640 1 -- 172.21.15.44:0/3319923884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fabec0cc840 con 0x7fabec15d060 2023-11-04T01:36:59.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.608+0000 7fabd3fff640 1 -- 172.21.15.44:0/3319923884 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fabe404e0a0 con 0x7fabec15d060 2023-11-04T01:36:59.611 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:36:59.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.610+0000 7fabf1ee5640 1 -- 172.21.15.44:0/3319923884 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fabd806ae70 msgr2=0x7fabd806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.610+0000 7fabf1ee5640 1 --2- 172.21.15.44:0/3319923884 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fabd806ae70 0x7fabd806d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0011e0 tx=0x7fabdc009040 comp rx=0 tx=0).stop 2023-11-04T01:36:59.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.610+0000 7fabf1ee5640 1 -- 172.21.15.44:0/3319923884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabec15d060 msgr2=0x7fabec1524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.610+0000 7fabf1ee5640 1 --2- 172.21.15.44:0/3319923884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabec15d060 0x7fabec1524f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fabe402c3f0 tx=0x7fabe4004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:59.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.610+0000 7fabf1ee5640 1 -- 172.21.15.44:0/3319923884 shutdown_connections 2023-11-04T01:36:59.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.610+0000 7fabf1ee5640 1 --2- 172.21.15.44:0/3319923884 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fabd806ae70 0x7fabd806d330 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.610+0000 7fabf1ee5640 1 --2- 172.21.15.44:0/3319923884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabec15d060 0x7fabec1524f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.610+0000 7fabf1ee5640 1 --2- 172.21.15.44:0/3319923884 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fabec0cdf80 0x7fabec154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.610+0000 7fabf1ee5640 1 --2- 172.21.15.44:0/3319923884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabec0cdb20 0x7fabec156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.610+0000 7fabf1ee5640 1 -- 172.21.15.44:0/3319923884 >> 172.21.15.44:0/3319923884 conn(0x7fabec0cf760 msgr2=0x7fabec0cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.610+0000 7fabf1ee5640 1 -- 172.21.15.44:0/3319923884 shutdown_connections 2023-11-04T01:36:59.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.610+0000 7fabf1ee5640 1 -- 172.21.15.44:0/3319923884 wait complete. 2023-11-04T01:36:59.623 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:59.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.728+0000 7fc46ff89640 1 Processor -- start 2023-11-04T01:36:59.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.728+0000 7fc46ff89640 1 -- start start 2023-11-04T01:36:59.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.729+0000 7fc46ff89640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc4680cd6d0 0x7fc468161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.729+0000 7fc46ff89640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4680cde60 con 0x7fc4680b4880 2023-11-04T01:36:59.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.729+0000 7fc46ff89640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc468160f90 con 0x7fc468153e60 2023-11-04T01:36:59.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.729+0000 7fc46ff89640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc468161960 con 0x7fc4680cd6d0 2023-11-04T01:36:59.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.729+0000 7fc46e526640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc4680b4880 0x7fc4680d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38440/0 (socket says 172.21.15.44:38440) 2023-11-04T01:36:59.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.729+0000 7fc46e526640 1 -- 172.21.15.44:0/2773622291 learned_addr learned my addr 172.21.15.44:0/2773622291 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:36:59.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.729+0000 7fc46d524640 1 --2- 172.21.15.44:0/2773622291 >> v2:172.21.15.204:3300/0 conn(0x7fc4680cd6d0 0x7fc468161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.729+0000 7fc46cd23640 1 -- 172.21.15.44:0/2773622291 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336848252 0 0) 0x7fc4680cde60 con 0x7fc4680b4880 2023-11-04T01:36:59.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.730+0000 7fc46cd23640 1 -- 172.21.15.44:0/2773622291 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc454003520 con 0x7fc4680b4880 2023-11-04T01:36:59.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.730+0000 7fc46d524640 1 -- 172.21.15.44:0/2773622291 >> v1:172.21.15.204:6789/0 conn(0x7fc468153e60 legacy=0x7fc46815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.730+0000 7fc46d524640 1 -- 172.21.15.44:0/2773622291 >> v1:172.21.15.44:6789/0 conn(0x7fc4680b4880 legacy=0x7fc4680d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.730+0000 7fc46d524640 1 -- 172.21.15.44:0/2773622291 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4680ce090 con 0x7fc4680cd6d0 2023-11-04T01:36:59.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.730+0000 7fc46d524640 1 --2- 172.21.15.44:0/2773622291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4680cd6d0 0x7fc468161420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc4580097a0 tx=0x7fc45802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30bd03f0cfa82bf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.731+0000 7fc46cd23640 1 -- 172.21.15.44:0/2773622291 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc458030610 con 0x7fc4680cd6d0 2023-11-04T01:36:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.731+0000 7fc46cd23640 1 -- 172.21.15.44:0/2773622291 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc458030770 con 0x7fc4680cd6d0 2023-11-04T01:36:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.731+0000 7fc46cd23640 1 -- 172.21.15.44:0/2773622291 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc458030b00 con 0x7fc4680cd6d0 2023-11-04T01:36:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.731+0000 7fc46ff89640 1 -- 172.21.15.44:0/2773622291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4680cd6d0 msgr2=0x7fc468161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.731+0000 7fc46ff89640 1 --2- 172.21.15.44:0/2773622291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4680cd6d0 0x7fc468161420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc4580097a0 tx=0x7fc45802b960 comp rx=0 tx=0).stop 2023-11-04T01:36:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.731+0000 7fc46ff89640 1 -- 172.21.15.44:0/2773622291 shutdown_connections 2023-11-04T01:36:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.731+0000 7fc46ff89640 1 --2- 172.21.15.44:0/2773622291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4680cd6d0 0x7fc468161420 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.731+0000 7fc46ff89640 1 -- 172.21.15.44:0/2773622291 >> 172.21.15.44:0/2773622291 conn(0x7fc4680cf880 msgr2=0x7fc4680cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.731+0000 7fc46ff89640 1 -- 172.21.15.44:0/2773622291 shutdown_connections 2023-11-04T01:36:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.731+0000 7fc46ff89640 1 -- 172.21.15.44:0/2773622291 wait complete. 2023-11-04T01:36:59.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.732+0000 7fc46ff89640 1 Processor -- start 2023-11-04T01:36:59.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.732+0000 7fc46ff89640 1 -- start start 2023-11-04T01:36:59.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.733+0000 7fc46ff89640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4680b4880 0x7fc468155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.733+0000 7fc46ff89640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4680cd6d0 0x7fc4680d3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.733+0000 7fc46ff89640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc468153e60 0x7fc4681f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.733+0000 7fc46ff89640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4681555c0 con 0x7fc4680b4880 2023-11-04T01:36:59.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.733+0000 7fc46ff89640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4681564f0 con 0x7fc4680cd6d0 2023-11-04T01:36:59.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.733+0000 7fc46ff89640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4681f3390 con 0x7fc468153e60 2023-11-04T01:36:59.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.733+0000 7fc46dd25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4680b4880 0x7fc468155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.733+0000 7fc46dd25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4680b4880 0x7fc468155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39324/0 (socket says 172.21.15.44:39324) 2023-11-04T01:36:59.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.733+0000 7fc46dd25640 1 -- 172.21.15.44:0/3326761317 learned_addr learned my addr 172.21.15.44:0/3326761317 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:36:59.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.734+0000 7fc46d524640 1 --2- 172.21.15.44:0/3326761317 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4680cd6d0 0x7fc4680d3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.734+0000 7fc46e526640 1 --2- 172.21.15.44:0/3326761317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc468153e60 0x7fc4681f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.734+0000 7fc46dd25640 1 -- 172.21.15.44:0/3326761317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc468153e60 msgr2=0x7fc4681f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.734+0000 7fc46dd25640 1 --2- 172.21.15.44:0/3326761317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc468153e60 0x7fc4681f2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.734+0000 7fc46dd25640 1 -- 172.21.15.44:0/3326761317 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4680cd6d0 msgr2=0x7fc4680d3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.734+0000 7fc46dd25640 1 --2- 172.21.15.44:0/3326761317 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4680cd6d0 0x7fc4680d3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.734+0000 7fc46dd25640 1 -- 172.21.15.44:0/3326761317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc458009400 con 0x7fc4680b4880 2023-11-04T01:36:59.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.734+0000 7fc46dd25640 1 --2- 172.21.15.44:0/3326761317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4680b4880 0x7fc468155fb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc46400c400 tx=0x7fc46400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.734+0000 7fc45e7fc640 1 -- 172.21.15.44:0/3326761317 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4640052d0 con 0x7fc4680b4880 2023-11-04T01:36:59.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.734+0000 7fc45e7fc640 1 -- 172.21.15.44:0/3326761317 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc464005430 con 0x7fc4680b4880 2023-11-04T01:36:59.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.734+0000 7fc45e7fc640 1 -- 172.21.15.44:0/3326761317 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464003830 con 0x7fc4680b4880 2023-11-04T01:36:59.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.734+0000 7fc46ff89640 1 -- 172.21.15.44:0/3326761317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4681f3670 con 0x7fc4680b4880 2023-11-04T01:36:59.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.734+0000 7fc46ff89640 1 -- 172.21.15.44:0/3326761317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc468155ab0 con 0x7fc4680b4880 2023-11-04T01:36:59.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.735+0000 7fc46ff89640 1 -- 172.21.15.44:0/3326761317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc468074290 con 0x7fc4680b4880 2023-11-04T01:36:59.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.736+0000 7fc45e7fc640 1 -- 172.21.15.44:0/3326761317 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc464003990 con 0x7fc4680b4880 2023-11-04T01:36:59.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.736+0000 7fc45e7fc640 1 --2- 172.21.15.44:0/3326761317 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc44c06ae70 0x7fc44c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.736+0000 7fc45e7fc640 1 -- 172.21.15.44:0/3326761317 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc464088f50 con 0x7fc4680b4880 2023-11-04T01:36:59.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.736+0000 7fc46d524640 1 --2- 172.21.15.44:0/3326761317 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc44c06ae70 0x7fc44c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.737+0000 7fc46d524640 1 --2- 172.21.15.44:0/3326761317 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc44c06ae70 0x7fc44c06d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc458036000 tx=0x7fc458008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.740+0000 7fc45e7fc640 1 -- 172.21.15.44:0/3326761317 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc464053c40 con 0x7fc4680b4880 2023-11-04T01:36:59.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.930+0000 7fc46ff89640 1 -- 172.21.15.44:0/3326761317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc4680d0b80 con 0x7fc4680b4880 2023-11-04T01:36:59.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.930+0000 7fc45e7fc640 1 -- 172.21.15.44:0/3326761317 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc464017080 con 0x7fc4680b4880 2023-11-04T01:36:59.934 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2023-11-04T01:36:59.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.932+0000 7fc46ff89640 1 -- 172.21.15.44:0/3326761317 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc44c06ae70 msgr2=0x7fc44c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.932+0000 7fc46ff89640 1 --2- 172.21.15.44:0/3326761317 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc44c06ae70 0x7fc44c06d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc458036000 tx=0x7fc458008030 comp rx=0 tx=0).stop 2023-11-04T01:36:59.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.932+0000 7fc46ff89640 1 -- 172.21.15.44:0/3326761317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4680b4880 msgr2=0x7fc468155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.932+0000 7fc46ff89640 1 --2- 172.21.15.44:0/3326761317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4680b4880 0x7fc468155fb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc46400c400 tx=0x7fc46400c8c0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.932+0000 7fc46ff89640 1 -- 172.21.15.44:0/3326761317 shutdown_connections 2023-11-04T01:36:59.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.932+0000 7fc46ff89640 1 --2- 172.21.15.44:0/3326761317 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc44c06ae70 0x7fc44c06d330 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.932+0000 7fc46ff89640 1 --2- 172.21.15.44:0/3326761317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc468153e60 0x7fc4681f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.932+0000 7fc46ff89640 1 --2- 172.21.15.44:0/3326761317 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4680cd6d0 0x7fc4680d3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.932+0000 7fc46ff89640 1 --2- 172.21.15.44:0/3326761317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4680b4880 0x7fc468155fb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.932+0000 7fc46ff89640 1 -- 172.21.15.44:0/3326761317 >> 172.21.15.44:0/3326761317 conn(0x7fc4680cf880 msgr2=0x7fc46815fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.932+0000 7fc46ff89640 1 -- 172.21.15.44:0/3326761317 shutdown_connections 2023-11-04T01:36:59.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:36:59.932+0000 7fc46ff89640 1 -- 172.21.15.44:0/3326761317 wait complete. 2023-11-04T01:36:59.946 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:36:59.946 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:59.962 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:00.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.106+0000 7f6ea9c64640 1 Processor -- start 2023-11-04T01:37:00.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.106+0000 7f6ea9c64640 1 -- start start 2023-11-04T01:37:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.107+0000 7f6ea9c64640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6ea415ce60 0x7f6ea406b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.107+0000 7f6ea9c64640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ea40cf160 0x7f6ea40cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.107+0000 7f6ea9c64640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea41615d0 con 0x7f6ea406bd30 2023-11-04T01:37:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.107+0000 7f6ea9c64640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea40cbde0 con 0x7f6ea415ce60 2023-11-04T01:37:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.107+0000 7f6ea9c64640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea40cfb50 con 0x7f6ea40cf160 2023-11-04T01:37:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.107+0000 7f6ea3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ea40cf160 0x7f6ea40cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.108+0000 7f6ea37fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6ea415ce60 0x7f6ea406b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.108+0000 7f6ea3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ea40cf160 0x7f6ea40cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:59280/0 (socket says 172.21.15.44:59280) 2023-11-04T01:37:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.108+0000 7f6ea3fff640 1 -- 172.21.15.44:0/612097637 learned_addr learned my addr 172.21.15.44:0/612097637 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.108+0000 7f6ea3fff640 1 -- 172.21.15.44:0/612097637 >> v2:172.21.15.204:3300/0 conn(0x7f6ea415ce60 msgr2=0x7f6ea406b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.108+0000 7f6ea3fff640 1 --2- 172.21.15.44:0/612097637 >> v2:172.21.15.204:3300/0 conn(0x7f6ea415ce60 0x7f6ea406b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.108+0000 7f6ea3fff640 1 -- 172.21.15.44:0/612097637 >> v1:172.21.15.204:6789/0 conn(0x7f6ea406bd30 legacy=0x7f6ea4160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.108+0000 7f6ea3fff640 1 -- 172.21.15.44:0/612097637 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea41618b0 con 0x7f6ea40cf160 2023-11-04T01:37:00.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.108+0000 7f6ea37fe640 1 --2- 172.21.15.44:0/612097637 >> v2:172.21.15.204:3300/0 conn(0x7f6ea415ce60 0x7f6ea406b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:00.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.109+0000 7f6ea3fff640 1 --2- 172.21.15.44:0/612097637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ea40cf160 0x7f6ea40cf610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009e50 tx=0x7f6e9c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f2579baae214940 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.109+0000 7f6ea27fc640 1 -- 172.21.15.44:0/612097637 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c02cb00 con 0x7f6ea40cf160 2023-11-04T01:37:00.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.109+0000 7f6ea27fc640 1 -- 172.21.15.44:0/612097637 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c02cc60 con 0x7f6ea40cf160 2023-11-04T01:37:00.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.109+0000 7f6ea27fc640 1 -- 172.21.15.44:0/612097637 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c0343f0 con 0x7f6ea40cf160 2023-11-04T01:37:00.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.109+0000 7f6ea9c64640 1 -- 172.21.15.44:0/612097637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ea40cf160 msgr2=0x7f6ea40cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.109+0000 7f6ea9c64640 1 --2- 172.21.15.44:0/612097637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ea40cf160 0x7f6ea40cf610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009e50 tx=0x7f6e9c02bf60 comp rx=0 tx=0).stop 2023-11-04T01:37:00.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.109+0000 7f6ea9c64640 1 -- 172.21.15.44:0/612097637 shutdown_connections 2023-11-04T01:37:00.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.109+0000 7f6ea9c64640 1 --2- 172.21.15.44:0/612097637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ea40cf160 0x7f6ea40cf610 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.109+0000 7f6ea9c64640 1 --2- 172.21.15.44:0/612097637 >> v2:172.21.15.204:3300/0 conn(0x7f6ea415ce60 0x7f6ea406b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.109+0000 7f6ea9c64640 1 -- 172.21.15.44:0/612097637 >> 172.21.15.44:0/612097637 conn(0x7f6ea406ea90 msgr2=0x7f6ea406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.110+0000 7f6ea9c64640 1 -- 172.21.15.44:0/612097637 shutdown_connections 2023-11-04T01:37:00.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.110+0000 7f6ea9c64640 1 -- 172.21.15.44:0/612097637 wait complete. 2023-11-04T01:37:00.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.111+0000 7f6ea9c64640 1 Processor -- start 2023-11-04T01:37:00.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.111+0000 7f6ea9c64640 1 -- start start 2023-11-04T01:37:00.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea9c64640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ea40cf160 0x7f6ea40c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea9c64640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ea415ce60 0x7f6ea414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea9c64640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ea4150490 0x7f6ea415eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea9c64640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea4157d20 con 0x7f6ea415ce60 2023-11-04T01:37:00.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea9c64640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea4158000 con 0x7f6ea40cf160 2023-11-04T01:37:00.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea9c64640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea41582e0 con 0x7f6ea4150490 2023-11-04T01:37:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ea415ce60 0x7f6ea414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea37fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ea40cf160 0x7f6ea40c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ea415ce60 0x7f6ea414ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39340/0 (socket says 172.21.15.44:39340) 2023-11-04T01:37:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea2ffd640 1 -- 172.21.15.44:0/949567625 learned_addr learned my addr 172.21.15.44:0/949567625 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea3fff640 1 --2- 172.21.15.44:0/949567625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ea4150490 0x7f6ea415eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea2ffd640 1 -- 172.21.15.44:0/949567625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ea4150490 msgr2=0x7f6ea415eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea2ffd640 1 --2- 172.21.15.44:0/949567625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ea4150490 0x7f6ea415eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea2ffd640 1 -- 172.21.15.44:0/949567625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ea40cf160 msgr2=0x7f6ea40c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea2ffd640 1 --2- 172.21.15.44:0/949567625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ea40cf160 0x7f6ea40c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea2ffd640 1 -- 172.21.15.44:0/949567625 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e94009400 con 0x7f6ea415ce60 2023-11-04T01:37:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea37fe640 1 --2- 172.21.15.44:0/949567625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ea40cf160 0x7f6ea40c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.112+0000 7f6ea2ffd640 1 --2- 172.21.15.44:0/949567625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ea415ce60 0x7f6ea414ff50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800c450 tx=0x7f6e9800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.113+0000 7f6e8bfff640 1 -- 172.21.15.44:0/949567625 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e980052d0 con 0x7f6ea415ce60 2023-11-04T01:37:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.113+0000 7f6e8bfff640 1 -- 172.21.15.44:0/949567625 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e98005430 con 0x7f6ea415ce60 2023-11-04T01:37:00.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.113+0000 7f6ea9c64640 1 -- 172.21.15.44:0/949567625 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9c009b30 con 0x7f6ea415ce60 2023-11-04T01:37:00.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.113+0000 7f6e8bfff640 1 -- 172.21.15.44:0/949567625 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e98012870 con 0x7f6ea415ce60 2023-11-04T01:37:00.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.113+0000 7f6ea9c64640 1 -- 172.21.15.44:0/949567625 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea41588a0 con 0x7f6ea415ce60 2023-11-04T01:37:00.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.114+0000 7f6ea9c64640 1 -- 172.21.15.44:0/949567625 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea4074290 con 0x7f6ea415ce60 2023-11-04T01:37:00.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.114+0000 7f6e8bfff640 1 -- 172.21.15.44:0/949567625 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e980129d0 con 0x7f6ea415ce60 2023-11-04T01:37:00.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.114+0000 7f6e8bfff640 1 --2- 172.21.15.44:0/949567625 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6e9006ae70 0x7f6e9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.114+0000 7f6e8bfff640 1 -- 172.21.15.44:0/949567625 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6e98089340 con 0x7f6ea415ce60 2023-11-04T01:37:00.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.115+0000 7f6ea37fe640 1 --2- 172.21.15.44:0/949567625 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6e9006ae70 0x7f6e9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.115+0000 7f6ea37fe640 1 --2- 172.21.15.44:0/949567625 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6e9006ae70 0x7f6e9006d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ea41604c0 tx=0x7f6e94009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.118+0000 7f6e8bfff640 1 -- 172.21.15.44:0/949567625 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e98054170 con 0x7f6ea415ce60 2023-11-04T01:37:00.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.296+0000 7f6ea9c64640 1 -- 172.21.15.44:0/949567625 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ea406b3e0 con 0x7f6ea415ce60 2023-11-04T01:37:00.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.297+0000 7f6e8bfff640 1 -- 172.21.15.44:0/949567625 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7f6e98057790 con 0x7f6ea415ce60 2023-11-04T01:37:00.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:00.299 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:00.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.299+0000 7f6ea9c64640 1 -- 172.21.15.44:0/949567625 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6e9006ae70 msgr2=0x7f6e9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.299+0000 7f6ea9c64640 1 --2- 172.21.15.44:0/949567625 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6e9006ae70 0x7f6e9006d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ea41604c0 tx=0x7f6e94009190 comp rx=0 tx=0).stop 2023-11-04T01:37:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.299+0000 7f6ea9c64640 1 -- 172.21.15.44:0/949567625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ea415ce60 msgr2=0x7f6ea414ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.299+0000 7f6ea9c64640 1 --2- 172.21.15.44:0/949567625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ea415ce60 0x7f6ea414ff50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800c450 tx=0x7f6e9800c910 comp rx=0 tx=0).stop 2023-11-04T01:37:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.299+0000 7f6ea9c64640 1 -- 172.21.15.44:0/949567625 shutdown_connections 2023-11-04T01:37:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.299+0000 7f6ea9c64640 1 --2- 172.21.15.44:0/949567625 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6e9006ae70 0x7f6e9006d330 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.299+0000 7f6ea9c64640 1 --2- 172.21.15.44:0/949567625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ea4150490 0x7f6ea415eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.299+0000 7f6ea9c64640 1 --2- 172.21.15.44:0/949567625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ea415ce60 0x7f6ea414ff50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.299+0000 7f6ea9c64640 1 --2- 172.21.15.44:0/949567625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ea40cf160 0x7f6ea40c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.299+0000 7f6ea9c64640 1 -- 172.21.15.44:0/949567625 >> 172.21.15.44:0/949567625 conn(0x7f6ea406ea90 msgr2=0x7f6ea41608e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.299+0000 7f6ea9c64640 1 -- 172.21.15.44:0/949567625 shutdown_connections 2023-11-04T01:37:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.299+0000 7f6ea9c64640 1 -- 172.21.15.44:0/949567625 wait complete. 2023-11-04T01:37:00.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:00.313 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:00.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.420+0000 7f55ce52c640 1 Processor -- start 2023-11-04T01:37:00.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.421+0000 7f55ce52c640 1 -- start start 2023-11-04T01:37:00.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.421+0000 7f55ce52c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55c80b1a40 0x7f55c80ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.421+0000 7f55ce52c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f55c806a830 0x7f55c80cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.421+0000 7f55ce52c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c8160990 con 0x7f55c81605b0 2023-11-04T01:37:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.421+0000 7f55ce52c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c80cc7c0 con 0x7f55c806a830 2023-11-04T01:37:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.421+0000 7f55ce52c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80cd750 con 0x7f55c80b1a40 2023-11-04T01:37:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.421+0000 7f55c7fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f55c81605b0 0x7f55c806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38442/0 (socket says 172.21.15.44:38442) 2023-11-04T01:37:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.421+0000 7f55c7fff640 1 -- 172.21.15.44:0/3342934829 learned_addr learned my addr 172.21.15.44:0/3342934829 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c77fe640 1 --2- 172.21.15.44:0/3342934829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55c80b1a40 0x7f55c80ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55ccac9640 1 --2- 172.21.15.44:0/3342934829 >> v2:172.21.15.204:3300/0 conn(0x7f55c806a830 0x7f55c80cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 -- 172.21.15.44:0/3342934829 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130112661 0 0) 0x7f55c8160990 con 0x7f55c81605b0 2023-11-04T01:37:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 -- 172.21.15.44:0/3342934829 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b0003520 con 0x7f55c81605b0 2023-11-04T01:37:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 -- 172.21.15.44:0/3342934829 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2433198794 0 0) 0x7f55b0003520 con 0x7f55c81605b0 2023-11-04T01:37:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 -- 172.21.15.44:0/3342934829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55c80b1a40 msgr2=0x7f55c80ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 --2- 172.21.15.44:0/3342934829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55c80b1a40 0x7f55c80ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 -- 172.21.15.44:0/3342934829 >> v2:172.21.15.204:3300/0 conn(0x7f55c806a830 msgr2=0x7f55c80cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 --2- 172.21.15.44:0/3342934829 >> v2:172.21.15.204:3300/0 conn(0x7f55c806a830 0x7f55c80cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 -- 172.21.15.44:0/3342934829 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c80cc4e0 con 0x7f55c81605b0 2023-11-04T01:37:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 -- 172.21.15.44:0/3342934829 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f55b8001670 con 0x7f55c81605b0 2023-11-04T01:37:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 -- 172.21.15.44:0/3342934829 >> v1:172.21.15.44:6789/0 conn(0x7f55c81605b0 legacy=0x7f55c806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 --2- 172.21.15.44:0/3342934829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55b0003970 0x7f55b0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 --2- 172.21.15.44:0/3342934829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55b00042d0 0x7f55b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 --2- 172.21.15.44:0/3342934829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55b0004eb0 0x7f55b000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 -- 172.21.15.44:0/3342934829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80cc7c0 con 0x7f55b00042d0 2023-11-04T01:37:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 -- 172.21.15.44:0/3342934829 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80cd750 con 0x7f55b0004eb0 2023-11-04T01:37:00.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c6ffd640 1 -- 172.21.15.44:0/3342934829 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b000bec0 con 0x7f55b0003970 2023-11-04T01:37:00.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c77fe640 1 --2- 172.21.15.44:0/3342934829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55b00042d0 0x7f55b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55ccac9640 1 --2- 172.21.15.44:0/3342934829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55b0004eb0 0x7f55b000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.422+0000 7f55c7fff640 1 --2- 172.21.15.44:0/3342934829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55b0003970 0x7f55b0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.423+0000 7f55c77fe640 1 -- 172.21.15.44:0/3342934829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55b0003970 msgr2=0x7f55b0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.423+0000 7f55c77fe640 1 --2- 172.21.15.44:0/3342934829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55b0003970 0x7f55b0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.423+0000 7f55c77fe640 1 -- 172.21.15.44:0/3342934829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55b0004eb0 msgr2=0x7f55b000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.423+0000 7f55c77fe640 1 --2- 172.21.15.44:0/3342934829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55b0004eb0 0x7f55b000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.423+0000 7f55c77fe640 1 -- 172.21.15.44:0/3342934829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b0003520 con 0x7f55b00042d0 2023-11-04T01:37:00.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.423+0000 7f55c77fe640 1 --2- 172.21.15.44:0/3342934829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55b00042d0 0x7f55b00047c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009ac0 tx=0x7f55b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523017fb5e2dfc1a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.423+0000 7f55c6ffd640 1 -- 172.21.15.44:0/3342934829 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc02c6b0 con 0x7f55b00042d0 2023-11-04T01:37:00.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.423+0000 7f55c6ffd640 1 -- 172.21.15.44:0/3342934829 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc02c810 con 0x7f55b00042d0 2023-11-04T01:37:00.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.424+0000 7f55c6ffd640 1 -- 172.21.15.44:0/3342934829 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc02cba0 con 0x7f55b00042d0 2023-11-04T01:37:00.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.424+0000 7f55ce52c640 1 -- 172.21.15.44:0/3342934829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55b00042d0 msgr2=0x7f55b00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.424+0000 7f55ce52c640 1 --2- 172.21.15.44:0/3342934829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55b00042d0 0x7f55b00047c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009ac0 tx=0x7f55b00057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.424+0000 7f55ccac9640 1 -- 172.21.15.44:0/3342934829 reap_dead start 2023-11-04T01:37:00.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.424+0000 7f55ce52c640 1 -- 172.21.15.44:0/3342934829 shutdown_connections 2023-11-04T01:37:00.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.424+0000 7f55ce52c640 1 -- 172.21.15.44:0/3342934829 >> 172.21.15.44:0/3342934829 conn(0x7f55c8071820 msgr2=0x7f55c8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.424+0000 7f55ce52c640 1 -- 172.21.15.44:0/3342934829 shutdown_connections 2023-11-04T01:37:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.424+0000 7f55ce52c640 1 -- 172.21.15.44:0/3342934829 wait complete. 2023-11-04T01:37:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.425+0000 7f55ce52c640 1 Processor -- start 2023-11-04T01:37:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.425+0000 7f55ce52c640 1 -- start start 2023-11-04T01:37:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.426+0000 7f55ce52c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55b00042d0 0x7f55c80ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.426+0000 7f55ce52c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55c80c9130 0x7f55c80b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.426+0000 7f55ce52c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55c815be80 0x7f55c80b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.426+0000 7f55ce52c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80c6b20 con 0x7f55b00042d0 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.426+0000 7f55ce52c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80b4d40 con 0x7f55c815be80 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.426+0000 7f55ce52c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80c95b0 con 0x7f55c80c9130 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.426+0000 7f55c7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55b00042d0 0x7f55c80ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.426+0000 7f55c7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55b00042d0 0x7f55c80ac180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39344/0 (socket says 172.21.15.44:39344) 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.426+0000 7f55c7fff640 1 -- 172.21.15.44:0/1468850631 learned_addr learned my addr 172.21.15.44:0/1468850631 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.426+0000 7f55c77fe640 1 --2- 172.21.15.44:0/1468850631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55c80c9130 0x7f55c80b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.426+0000 7f55ccac9640 1 --2- 172.21.15.44:0/1468850631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55c815be80 0x7f55c80b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.427+0000 7f55c7fff640 1 -- 172.21.15.44:0/1468850631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55c80c9130 msgr2=0x7f55c80b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.427+0000 7f55c7fff640 1 --2- 172.21.15.44:0/1468850631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55c80c9130 0x7f55c80b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.427+0000 7f55c7fff640 1 -- 172.21.15.44:0/1468850631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55c815be80 msgr2=0x7f55c80b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.427+0000 7f55c7fff640 1 --2- 172.21.15.44:0/1468850631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55c815be80 0x7f55c80b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.427+0000 7f55c7fff640 1 -- 172.21.15.44:0/1468850631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c80c9880 con 0x7f55b00042d0 2023-11-04T01:37:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.427+0000 7f55c7fff640 1 --2- 172.21.15.44:0/1468850631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55b00042d0 0x7f55c80ac180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f55b8004f80 tx=0x7f55b80074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.427+0000 7f55c4ff9640 1 -- 172.21.15.44:0/1468850631 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b8007740 con 0x7f55b00042d0 2023-11-04T01:37:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.427+0000 7f55c4ff9640 1 -- 172.21.15.44:0/1468850631 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b800f9c0 con 0x7f55b00042d0 2023-11-04T01:37:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.427+0000 7f55ce52c640 1 -- 172.21.15.44:0/1468850631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c80c6d70 con 0x7f55b00042d0 2023-11-04T01:37:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.427+0000 7f55c4ff9640 1 -- 172.21.15.44:0/1468850631 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b800fd90 con 0x7f55b00042d0 2023-11-04T01:37:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.427+0000 7f55ce52c640 1 -- 172.21.15.44:0/1468850631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c80c7330 con 0x7f55b00042d0 2023-11-04T01:37:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.428+0000 7f55ce52c640 1 -- 172.21.15.44:0/1468850631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c80672a0 con 0x7f55b00042d0 2023-11-04T01:37:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.428+0000 7f55c4ff9640 1 -- 172.21.15.44:0/1468850631 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f55b801d460 con 0x7f55b00042d0 2023-11-04T01:37:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.429+0000 7f55c4ff9640 1 --2- 172.21.15.44:0/1468850631 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f55b406aea0 0x7f55b406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.429+0000 7f55c4ff9640 1 -- 172.21.15.44:0/1468850631 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f55b8089b30 con 0x7f55b00042d0 2023-11-04T01:37:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.429+0000 7f55c77fe640 1 --2- 172.21.15.44:0/1468850631 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f55b406aea0 0x7f55b406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.430+0000 7f55c77fe640 1 --2- 172.21.15.44:0/1468850631 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f55b406aea0 0x7f55b406d360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f55bc036000 tx=0x7f55bc030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.433+0000 7f55c4ff9640 1 -- 172.21.15.44:0/1468850631 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f55b80548e0 con 0x7f55b00042d0 2023-11-04T01:37:00.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.609+0000 7f55ce52c640 1 -- 172.21.15.44:0/1468850631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55c8074290 con 0x7f55b00042d0 2023-11-04T01:37:00.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.610+0000 7f55c4ff9640 1 -- 172.21.15.44:0/1468850631 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55b8057f00 con 0x7f55b00042d0 2023-11-04T01:37:00.612 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:37:00.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.611+0000 7f55ce52c640 1 -- 172.21.15.44:0/1468850631 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f55b406aea0 msgr2=0x7f55b406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.611+0000 7f55ce52c640 1 --2- 172.21.15.44:0/1468850631 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f55b406aea0 0x7f55b406d360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f55bc036000 tx=0x7f55bc030000 comp rx=0 tx=0).stop 2023-11-04T01:37:00.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.611+0000 7f55ce52c640 1 -- 172.21.15.44:0/1468850631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55b00042d0 msgr2=0x7f55c80ac180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.611+0000 7f55ce52c640 1 --2- 172.21.15.44:0/1468850631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55b00042d0 0x7f55c80ac180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f55b8004f80 tx=0x7f55b80074f0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.611+0000 7f55ce52c640 1 -- 172.21.15.44:0/1468850631 shutdown_connections 2023-11-04T01:37:00.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.611+0000 7f55ce52c640 1 --2- 172.21.15.44:0/1468850631 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f55b406aea0 0x7f55b406d360 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.611+0000 7f55ce52c640 1 --2- 172.21.15.44:0/1468850631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55c815be80 0x7f55c80b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.611+0000 7f55ce52c640 1 --2- 172.21.15.44:0/1468850631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55c80c9130 0x7f55c80b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.611+0000 7f55ce52c640 1 --2- 172.21.15.44:0/1468850631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55b00042d0 0x7f55c80ac180 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.611+0000 7f55ce52c640 1 -- 172.21.15.44:0/1468850631 >> 172.21.15.44:0/1468850631 conn(0x7f55c8071820 msgr2=0x7f55c80cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.612+0000 7f55ce52c640 1 -- 172.21.15.44:0/1468850631 shutdown_connections 2023-11-04T01:37:00.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.612+0000 7f55ce52c640 1 -- 172.21.15.44:0/1468850631 wait complete. 2023-11-04T01:37:00.624 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:00.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.732+0000 7ffbcae0e640 1 Processor -- start 2023-11-04T01:37:00.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.732+0000 7ffbcae0e640 1 -- start start 2023-11-04T01:37:00.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.733+0000 7ffbcae0e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffbc40cc300 0x7ffbc40b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.733+0000 7ffbcae0e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc40caa20 con 0x7ffbc40ca0a0 2023-11-04T01:37:00.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.733+0000 7ffbcae0e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc40cb230 con 0x7ffbc415e3f0 2023-11-04T01:37:00.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.733+0000 7ffbcae0e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc40b3300 con 0x7ffbc40cc300 2023-11-04T01:37:00.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.733+0000 7ffbc93ab640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffbc40cc300 0x7ffbc40b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.733+0000 7ffbc3fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ffbc40ca0a0 0x7ffbc40cc920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38456/0 (socket says 172.21.15.44:38456) 2023-11-04T01:37:00.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.733+0000 7ffbc93ab640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffbc40cc300 0x7ffbc40b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39348/0 (socket says 172.21.15.44:39348) 2023-11-04T01:37:00.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.733+0000 7ffbc3fff640 1 -- 172.21.15.44:0/1739179719 learned_addr learned my addr 172.21.15.44:0/1739179719 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:00.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.733+0000 7ffbc93ab640 1 -- 172.21.15.44:0/1739179719 >> v1:172.21.15.204:6789/0 conn(0x7ffbc415e3f0 legacy=0x7ffbc40b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.733+0000 7ffbc93ab640 1 -- 172.21.15.44:0/1739179719 >> v1:172.21.15.44:6789/0 conn(0x7ffbc40ca0a0 legacy=0x7ffbc40cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.733+0000 7ffbc93ab640 1 -- 172.21.15.44:0/1739179719 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc40ca530 con 0x7ffbc40cc300 2023-11-04T01:37:00.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.733+0000 7ffbc37fe640 1 -- 172.21.15.44:0/1739179719 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125662759 0 0) 0x7ffbc40caa20 con 0x7ffbc40ca0a0 2023-11-04T01:37:00.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.734+0000 7ffbc93ab640 1 --2- 172.21.15.44:0/1739179719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbc40cc300 0x7ffbc40b1890 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009d90 tx=0x7ffbbc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba66e49088b6cfa9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.734+0000 7ffbc37fe640 1 -- 172.21.15.44:0/1739179719 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc02cd00 con 0x7ffbc40cc300 2023-11-04T01:37:00.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.734+0000 7ffbc37fe640 1 -- 172.21.15.44:0/1739179719 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbbc02ce60 con 0x7ffbc40cc300 2023-11-04T01:37:00.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.734+0000 7ffbc37fe640 1 -- 172.21.15.44:0/1739179719 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc034660 con 0x7ffbc40cc300 2023-11-04T01:37:00.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.734+0000 7ffbcae0e640 1 -- 172.21.15.44:0/1739179719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbc40cc300 msgr2=0x7ffbc40b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.734+0000 7ffbcae0e640 1 --2- 172.21.15.44:0/1739179719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbc40cc300 0x7ffbc40b1890 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009d90 tx=0x7ffbbc02bf50 comp rx=0 tx=0).stop 2023-11-04T01:37:00.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.735+0000 7ffbcae0e640 1 -- 172.21.15.44:0/1739179719 shutdown_connections 2023-11-04T01:37:00.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.735+0000 7ffbcae0e640 1 --2- 172.21.15.44:0/1739179719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbc40cc300 0x7ffbc40b1890 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.735+0000 7ffbcae0e640 1 -- 172.21.15.44:0/1739179719 >> 172.21.15.44:0/1739179719 conn(0x7ffbc4071820 msgr2=0x7ffbc4071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.735+0000 7ffbcae0e640 1 -- 172.21.15.44:0/1739179719 shutdown_connections 2023-11-04T01:37:00.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.735+0000 7ffbcae0e640 1 -- 172.21.15.44:0/1739179719 wait complete. 2023-11-04T01:37:00.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.736+0000 7ffbcae0e640 1 Processor -- start 2023-11-04T01:37:00.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.736+0000 7ffbcae0e640 1 -- start start 2023-11-04T01:37:00.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbcae0e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbc40cc300 0x7ffbc414fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbcae0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbc415e3f0 0x7ffbc40c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbcae0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbc40c9590 0x7ffbc40b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbcae0e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc41f4b20 con 0x7ffbc40c9590 2023-11-04T01:37:00.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbcae0e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc41e57e0 con 0x7ffbc40cc300 2023-11-04T01:37:00.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbcae0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc41f3f10 con 0x7ffbc415e3f0 2023-11-04T01:37:00.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbc93ab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbc40c9590 0x7ffbc40b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbc93ab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbc40c9590 0x7ffbc40b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39354/0 (socket says 172.21.15.44:39354) 2023-11-04T01:37:00.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbc93ab640 1 -- 172.21.15.44:0/125196858 learned_addr learned my addr 172.21.15.44:0/125196858 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:00.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbc8baa640 1 --2- 172.21.15.44:0/125196858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbc40cc300 0x7ffbc414fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbc93ab640 1 -- 172.21.15.44:0/125196858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbc415e3f0 msgr2=0x7ffbc40c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbc3fff640 1 --2- 172.21.15.44:0/125196858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbc415e3f0 0x7ffbc40c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbc93ab640 1 --2- 172.21.15.44:0/125196858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbc415e3f0 0x7ffbc40c9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbc93ab640 1 -- 172.21.15.44:0/125196858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbc40cc300 msgr2=0x7ffbc414fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbc93ab640 1 --2- 172.21.15.44:0/125196858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbc40cc300 0x7ffbc414fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbc93ab640 1 -- 172.21.15.44:0/125196858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc009a70 con 0x7ffbc40c9590 2023-11-04T01:37:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbc8baa640 1 --2- 172.21.15.44:0/125196858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbc40cc300 0x7ffbc414fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbc93ab640 1 --2- 172.21.15.44:0/125196858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbc40c9590 0x7ffbc40b5020 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009d90 tx=0x7ffbbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbc17fa640 1 -- 172.21.15.44:0/125196858 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc03d600 con 0x7ffbc40c9590 2023-11-04T01:37:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbc17fa640 1 -- 172.21.15.44:0/125196858 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbbc03d780 con 0x7ffbc40c9590 2023-11-04T01:37:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.737+0000 7ffbcae0e640 1 -- 172.21.15.44:0/125196858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc41f41f0 con 0x7ffbc40c9590 2023-11-04T01:37:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.738+0000 7ffbc17fa640 1 -- 172.21.15.44:0/125196858 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc03db30 con 0x7ffbc40c9590 2023-11-04T01:37:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.738+0000 7ffbcae0e640 1 -- 172.21.15.44:0/125196858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc41f47b0 con 0x7ffbc40c9590 2023-11-04T01:37:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.739+0000 7ffbcae0e640 1 -- 172.21.15.44:0/125196858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc4074290 con 0x7ffbc40c9590 2023-11-04T01:37:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.739+0000 7ffbc17fa640 1 -- 172.21.15.44:0/125196858 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffbbc03b040 con 0x7ffbc40c9590 2023-11-04T01:37:00.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.739+0000 7ffbc17fa640 1 --2- 172.21.15.44:0/125196858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffba406ae70 0x7ffba406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.739+0000 7ffbc17fa640 1 -- 172.21.15.44:0/125196858 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffbbc0aba40 con 0x7ffbc40c9590 2023-11-04T01:37:00.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.740+0000 7ffbc8baa640 1 --2- 172.21.15.44:0/125196858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffba406ae70 0x7ffba406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.740+0000 7ffbc8baa640 1 --2- 172.21.15.44:0/125196858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffba406ae70 0x7ffba406d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffbc41e5110 tx=0x7ffbac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.744+0000 7ffbc17fa640 1 -- 172.21.15.44:0/125196858 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffbbc0ade60 con 0x7ffbc40c9590 2023-11-04T01:37:00.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.919+0000 7ffbcae0e640 1 -- 172.21.15.44:0/125196858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffbc40cb430 con 0x7ffbc40c9590 2023-11-04T01:37:00.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.920+0000 7ffbc17fa640 1 -- 172.21.15.44:0/125196858 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffbbc076730 con 0x7ffbc40c9590 2023-11-04T01:37:00.922 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:37:00.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.921+0000 7ffbcae0e640 1 -- 172.21.15.44:0/125196858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffba406ae70 msgr2=0x7ffba406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.921+0000 7ffbcae0e640 1 --2- 172.21.15.44:0/125196858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffba406ae70 0x7ffba406d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffbc41e5110 tx=0x7ffbac009040 comp rx=0 tx=0).stop 2023-11-04T01:37:00.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.921+0000 7ffbcae0e640 1 -- 172.21.15.44:0/125196858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbc40c9590 msgr2=0x7ffbc40b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.921+0000 7ffbcae0e640 1 --2- 172.21.15.44:0/125196858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbc40c9590 0x7ffbc40b5020 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009d90 tx=0x7ffbbc004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:00.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.922+0000 7ffbcae0e640 1 -- 172.21.15.44:0/125196858 shutdown_connections 2023-11-04T01:37:00.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.922+0000 7ffbcae0e640 1 --2- 172.21.15.44:0/125196858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffba406ae70 0x7ffba406d330 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.922+0000 7ffbcae0e640 1 --2- 172.21.15.44:0/125196858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbc40c9590 0x7ffbc40b5020 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.922+0000 7ffbcae0e640 1 --2- 172.21.15.44:0/125196858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbc415e3f0 0x7ffbc40c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.922+0000 7ffbcae0e640 1 --2- 172.21.15.44:0/125196858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbc40cc300 0x7ffbc414fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.922+0000 7ffbcae0e640 1 -- 172.21.15.44:0/125196858 >> 172.21.15.44:0/125196858 conn(0x7ffbc4071820 msgr2=0x7ffbc40b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.922+0000 7ffbcae0e640 1 -- 172.21.15.44:0/125196858 shutdown_connections 2023-11-04T01:37:00.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:00.922+0000 7ffbcae0e640 1 -- 172.21.15.44:0/125196858 wait complete. 2023-11-04T01:37:00.935 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.041+0000 7f97d752c640 1 Processor -- start 2023-11-04T01:37:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.042+0000 7f97d752c640 1 -- start start 2023-11-04T01:37:01.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.042+0000 7f97d752c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97d0159c00 0x7f97d00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.042+0000 7f97d752c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d015aff0 con 0x7f97d00c48e0 2023-11-04T01:37:01.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.042+0000 7f97d752c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d015a3e0 con 0x7f97d00ae1d0 2023-11-04T01:37:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.042+0000 7f97d752c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d015a6c0 con 0x7f97d0159c00 2023-11-04T01:37:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97d4ac7640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f97d00c48e0 0x7f97d00adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38468/0 (socket says 172.21.15.44:38468) 2023-11-04T01:37:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97d4ac7640 1 -- 172.21.15.44:0/2860325603 learned_addr learned my addr 172.21.15.44:0/2860325603 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97d52c8640 1 --2- 172.21.15.44:0/2860325603 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97d0159c00 0x7f97d00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171598894 0 0) 0x7f97d015aff0 con 0x7f97d00c48e0 2023-11-04T01:37:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b8003520 con 0x7f97d00c48e0 2023-11-04T01:37:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185836692 0 0) 0x7f97d015a3e0 con 0x7f97d00ae1d0 2023-11-04T01:37:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d015aff0 con 0x7f97d00ae1d0 2023-11-04T01:37:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1812976949 0 0) 0x7f97b8003520 con 0x7f97d00c48e0 2023-11-04T01:37:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97d0159c00 msgr2=0x7f97d00cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 --2- 172.21.15.44:0/2860325603 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97d0159c00 0x7f97d00cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 >> v1:172.21.15.204:6789/0 conn(0x7f97d00ae1d0 legacy=0x7f97d00709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d015a9a0 con 0x7f97d00c48e0 2023-11-04T01:37:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f97c40015f0 con 0x7f97d00c48e0 2023-11-04T01:37:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 >> v1:172.21.15.44:6789/0 conn(0x7f97d00c48e0 legacy=0x7f97d00adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 --2- 172.21.15.44:0/2860325603 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97d0159c00 0x7f97b8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 --2- 172.21.15.44:0/2860325603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97b80040e0 0x7f97b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 --2- 172.21.15.44:0/2860325603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97b8004d00 0x7f97b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d015a6c0 con 0x7f97b80040e0 2023-11-04T01:37:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b800bac0 con 0x7f97b8004d00 2023-11-04T01:37:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b800bc80 con 0x7f97d0159c00 2023-11-04T01:37:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.043+0000 7f97d4ac7640 1 --2- 172.21.15.44:0/2860325603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97b80040e0 0x7f97b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.044+0000 7f97d52c8640 1 --2- 172.21.15.44:0/2860325603 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97d0159c00 0x7f97b8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.044+0000 7f97d5ac9640 1 --2- 172.21.15.44:0/2860325603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97b8004d00 0x7f97b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.044+0000 7f97d4ac7640 1 -- 172.21.15.44:0/2860325603 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97d0159c00 msgr2=0x7f97b8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.044+0000 7f97d4ac7640 1 --2- 172.21.15.44:0/2860325603 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97d0159c00 0x7f97b8003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.044+0000 7f97d4ac7640 1 -- 172.21.15.44:0/2860325603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97b8004d00 msgr2=0x7f97b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.044+0000 7f97d4ac7640 1 --2- 172.21.15.44:0/2860325603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97b8004d00 0x7f97b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.044+0000 7f97d4ac7640 1 -- 172.21.15.44:0/2860325603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b8003520 con 0x7f97b80040e0 2023-11-04T01:37:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.044+0000 7f97d5ac9640 1 --2- 172.21.15.44:0/2860325603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97b8004d00 0x7f97b8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.045+0000 7f97d4ac7640 1 --2- 172.21.15.44:0/2860325603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97b80040e0 0x7f97b80047c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f97c4007f40 tx=0x7f97b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e34bbfeb77d3c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.045+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4005b90 con 0x7f97b80040e0 2023-11-04T01:37:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.045+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c4005d10 con 0x7f97b80040e0 2023-11-04T01:37:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.045+0000 7f97cffff640 1 -- 172.21.15.44:0/2860325603 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c40072b0 con 0x7f97b80040e0 2023-11-04T01:37:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.045+0000 7f97d752c640 1 -- 172.21.15.44:0/2860325603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97b80040e0 msgr2=0x7f97b80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.045+0000 7f97d752c640 1 --2- 172.21.15.44:0/2860325603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97b80040e0 0x7f97b80047c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f97c4007f40 tx=0x7f97b80057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.045+0000 7f97d5ac9640 1 -- 172.21.15.44:0/2860325603 reap_dead start 2023-11-04T01:37:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.045+0000 7f97d752c640 1 -- 172.21.15.44:0/2860325603 shutdown_connections 2023-11-04T01:37:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.045+0000 7f97d752c640 1 -- 172.21.15.44:0/2860325603 >> 172.21.15.44:0/2860325603 conn(0x7f97d00ce950 msgr2=0x7f97d00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.045+0000 7f97d752c640 1 -- 172.21.15.44:0/2860325603 shutdown_connections 2023-11-04T01:37:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.045+0000 7f97d752c640 1 -- 172.21.15.44:0/2860325603 wait complete. 2023-11-04T01:37:01.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.046+0000 7f97d752c640 1 Processor -- start 2023-11-04T01:37:01.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.047+0000 7f97d752c640 1 -- start start 2023-11-04T01:37:01.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.047+0000 7f97d752c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97b80040e0 0x7f97d0158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.047+0000 7f97d752c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97d00cd0a0 0x7f97d014af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.047+0000 7f97d752c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97d00cd520 0x7f97d014b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.047+0000 7f97d752c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d0158ca0 con 0x7f97b80040e0 2023-11-04T01:37:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.047+0000 7f97d752c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d00ae970 con 0x7f97d00cd520 2023-11-04T01:37:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.047+0000 7f97d752c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d00aec50 con 0x7f97d00cd0a0 2023-11-04T01:37:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.047+0000 7f97d52c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97b80040e0 0x7f97d0158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.047+0000 7f97d52c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97b80040e0 0x7f97d0158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39382/0 (socket says 172.21.15.44:39382) 2023-11-04T01:37:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.047+0000 7f97d52c8640 1 -- 172.21.15.44:0/323981761 learned_addr learned my addr 172.21.15.44:0/323981761 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.047+0000 7f97d5ac9640 1 --2- 172.21.15.44:0/323981761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97d00cd520 0x7f97d014b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.048+0000 7f97d4ac7640 1 --2- 172.21.15.44:0/323981761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97d00cd0a0 0x7f97d014af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.048+0000 7f97d52c8640 1 -- 172.21.15.44:0/323981761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97d00cd0a0 msgr2=0x7f97d014af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.048+0000 7f97d52c8640 1 --2- 172.21.15.44:0/323981761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97d00cd0a0 0x7f97d014af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.048+0000 7f97d52c8640 1 -- 172.21.15.44:0/323981761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97d00cd520 msgr2=0x7f97d014b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.048+0000 7f97d52c8640 1 --2- 172.21.15.44:0/323981761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97d00cd520 0x7f97d014b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.048+0000 7f97d52c8640 1 -- 172.21.15.44:0/323981761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d00aef30 con 0x7f97b80040e0 2023-11-04T01:37:01.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.048+0000 7f97d5ac9640 1 --2- 172.21.15.44:0/323981761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97d00cd520 0x7f97d014b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:01.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.048+0000 7f97d52c8640 1 --2- 172.21.15.44:0/323981761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97b80040e0 0x7f97d0158760 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f97c8011ab0 tx=0x7f97c8011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.048+0000 7f97cdffb640 1 -- 172.21.15.44:0/323981761 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c8016070 con 0x7f97b80040e0 2023-11-04T01:37:01.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.048+0000 7f97cdffb640 1 -- 172.21.15.44:0/323981761 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c8010e10 con 0x7f97b80040e0 2023-11-04T01:37:01.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.048+0000 7f97d752c640 1 -- 172.21.15.44:0/323981761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d00af210 con 0x7f97b80040e0 2023-11-04T01:37:01.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.048+0000 7f97cdffb640 1 -- 172.21.15.44:0/323981761 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c801a610 con 0x7f97b80040e0 2023-11-04T01:37:01.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.048+0000 7f97d752c640 1 -- 172.21.15.44:0/323981761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d00ae640 con 0x7f97b80040e0 2023-11-04T01:37:01.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.049+0000 7f97d752c640 1 -- 172.21.15.44:0/323981761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d0074290 con 0x7f97b80040e0 2023-11-04T01:37:01.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.050+0000 7f97cdffb640 1 -- 172.21.15.44:0/323981761 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f97c801a770 con 0x7f97b80040e0 2023-11-04T01:37:01.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.050+0000 7f97cdffb640 1 --2- 172.21.15.44:0/323981761 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97bc06ae70 0x7f97bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.050+0000 7f97cdffb640 1 -- 172.21.15.44:0/323981761 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f97c808bc10 con 0x7f97b80040e0 2023-11-04T01:37:01.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.050+0000 7f97d4ac7640 1 --2- 172.21.15.44:0/323981761 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97bc06ae70 0x7f97bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.051+0000 7f97d4ac7640 1 --2- 172.21.15.44:0/323981761 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97bc06ae70 0x7f97bc06d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f97c4007f10 tx=0x7f97c4009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.054+0000 7f97cdffb640 1 -- 172.21.15.44:0/323981761 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97c80569b0 con 0x7f97b80040e0 2023-11-04T01:37:01.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.229+0000 7f97d752c640 1 -- 172.21.15.44:0/323981761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97d006cc00 con 0x7f97b80040e0 2023-11-04T01:37:01.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.229+0000 7f97cdffb640 1 -- 172.21.15.44:0/323981761 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97c801f020 con 0x7f97b80040e0 2023-11-04T01:37:01.231 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:37:01.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.231+0000 7f97d752c640 1 -- 172.21.15.44:0/323981761 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97bc06ae70 msgr2=0x7f97bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.231+0000 7f97d752c640 1 --2- 172.21.15.44:0/323981761 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97bc06ae70 0x7f97bc06d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f97c4007f10 tx=0x7f97c4009030 comp rx=0 tx=0).stop 2023-11-04T01:37:01.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.231+0000 7f97d752c640 1 -- 172.21.15.44:0/323981761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97b80040e0 msgr2=0x7f97d0158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.231+0000 7f97d752c640 1 --2- 172.21.15.44:0/323981761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97b80040e0 0x7f97d0158760 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f97c8011ab0 tx=0x7f97c8011f70 comp rx=0 tx=0).stop 2023-11-04T01:37:01.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.231+0000 7f97d752c640 1 -- 172.21.15.44:0/323981761 shutdown_connections 2023-11-04T01:37:01.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.231+0000 7f97d752c640 1 --2- 172.21.15.44:0/323981761 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97bc06ae70 0x7f97bc06d330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.231+0000 7f97d752c640 1 --2- 172.21.15.44:0/323981761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f97d00cd520 0x7f97d014b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.231+0000 7f97d752c640 1 --2- 172.21.15.44:0/323981761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f97d00cd0a0 0x7f97d014af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.231+0000 7f97d752c640 1 --2- 172.21.15.44:0/323981761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97b80040e0 0x7f97d0158760 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.231+0000 7f97d752c640 1 -- 172.21.15.44:0/323981761 >> 172.21.15.44:0/323981761 conn(0x7f97d00ce950 msgr2=0x7f97d0154cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:01.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.231+0000 7f97d752c640 1 -- 172.21.15.44:0/323981761 shutdown_connections 2023-11-04T01:37:01.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.231+0000 7f97d752c640 1 -- 172.21.15.44:0/323981761 wait complete. 2023-11-04T01:37:01.244 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:01.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.351+0000 7f21e69e2640 1 Processor -- start 2023-11-04T01:37:01.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.351+0000 7f21e69e2640 1 -- start start 2023-11-04T01:37:01.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21e69e2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f21e00b4880 0x7f21e00b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21e69e2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e00cde60 con 0x7f21e00cd6d0 2023-11-04T01:37:01.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21e69e2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e0160f90 con 0x7f21e0153e60 2023-11-04T01:37:01.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21e69e2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e00b5200 con 0x7f21e00b4880 2023-11-04T01:37:01.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21df7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f21e00cd6d0 0x7f21e0161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38470/0 (socket says 172.21.15.44:38470) 2023-11-04T01:37:01.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21df7fe640 1 -- 172.21.15.44:0/2562300095 learned_addr learned my addr 172.21.15.44:0/2562300095 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:01.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21e4f7f640 1 --2- 172.21.15.44:0/2562300095 >> v2:172.21.15.204:3300/0 conn(0x7f21e00b4880 0x7f21e00b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21deffd640 1 -- 172.21.15.44:0/2562300095 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229333715 0 0) 0x7f21e00cde60 con 0x7f21e00cd6d0 2023-11-04T01:37:01.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21deffd640 1 -- 172.21.15.44:0/2562300095 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21c8003520 con 0x7f21e00cd6d0 2023-11-04T01:37:01.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21deffd640 1 -- 172.21.15.44:0/2562300095 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1945627446 0 0) 0x7f21c8003520 con 0x7f21e00cd6d0 2023-11-04T01:37:01.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21deffd640 1 -- 172.21.15.44:0/2562300095 >> v2:172.21.15.204:3300/0 conn(0x7f21e00b4880 msgr2=0x7f21e00b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:01.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21deffd640 1 --2- 172.21.15.44:0/2562300095 >> v2:172.21.15.204:3300/0 conn(0x7f21e00b4880 0x7f21e00b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21deffd640 1 -- 172.21.15.44:0/2562300095 >> v1:172.21.15.204:6789/0 conn(0x7f21e0153e60 legacy=0x7f21e015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21deffd640 1 -- 172.21.15.44:0/2562300095 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e00ce090 con 0x7f21e00cd6d0 2023-11-04T01:37:01.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21e4f7f640 1 --2- 172.21.15.44:0/2562300095 >> v2:172.21.15.204:3300/0 conn(0x7f21e00b4880 0x7f21e00b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:01.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21deffd640 1 -- 172.21.15.44:0/2562300095 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f21d4001670 con 0x7f21e00cd6d0 2023-11-04T01:37:01.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21deffd640 1 -- 172.21.15.44:0/2562300095 >> v1:172.21.15.44:6789/0 conn(0x7f21e00cd6d0 legacy=0x7f21e0161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21deffd640 1 --2- 172.21.15.44:0/2562300095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21c8003970 0x7f21c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21deffd640 1 --2- 172.21.15.44:0/2562300095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21c80047c0 0x7f21c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21deffd640 1 --2- 172.21.15.44:0/2562300095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8005180 0x7f21c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21deffd640 1 -- 172.21.15.44:0/2562300095 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00b5200 con 0x7f21c8005180 2023-11-04T01:37:01.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21deffd640 1 -- 172.21.15.44:0/2562300095 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c800c020 con 0x7f21c8003970 2023-11-04T01:37:01.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.352+0000 7f21deffd640 1 -- 172.21.15.44:0/2562300095 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c800c1e0 con 0x7f21c80047c0 2023-11-04T01:37:01.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.353+0000 7f21e4f7f640 1 --2- 172.21.15.44:0/2562300095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8005180 0x7f21c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.353+0000 7f21dffff640 1 --2- 172.21.15.44:0/2562300095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21c8003970 0x7f21c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.353+0000 7f21df7fe640 1 --2- 172.21.15.44:0/2562300095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21c80047c0 0x7f21c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.353+0000 7f21e4f7f640 1 -- 172.21.15.44:0/2562300095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21c80047c0 msgr2=0x7f21c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:01.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.353+0000 7f21e4f7f640 1 --2- 172.21.15.44:0/2562300095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21c80047c0 0x7f21c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.353+0000 7f21e4f7f640 1 -- 172.21.15.44:0/2562300095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21c8003970 msgr2=0x7f21c8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:01.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.353+0000 7f21e4f7f640 1 --2- 172.21.15.44:0/2562300095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21c8003970 0x7f21c8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.353+0000 7f21e4f7f640 1 -- 172.21.15.44:0/2562300095 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c8003520 con 0x7f21c8005180 2023-11-04T01:37:01.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.353+0000 7f21dffff640 1 --2- 172.21.15.44:0/2562300095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21c8003970 0x7f21c8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:01.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.354+0000 7f21e4f7f640 1 -- 172.21.15.44:0/2562300095 reap_dead start 2023-11-04T01:37:01.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.354+0000 7f21e4f7f640 1 --2- 172.21.15.44:0/2562300095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8005180 0x7f21c800b980 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f21d800e350 tx=0x7f21c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2d85e27aaf70ce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.354+0000 7f21deffd640 1 -- 172.21.15.44:0/2562300095 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d802ce00 con 0x7f21c8005180 2023-11-04T01:37:01.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.354+0000 7f21deffd640 1 -- 172.21.15.44:0/2562300095 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d800f040 con 0x7f21c8005180 2023-11-04T01:37:01.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.354+0000 7f21deffd640 1 -- 172.21.15.44:0/2562300095 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8003bd0 con 0x7f21c8005180 2023-11-04T01:37:01.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.354+0000 7f21e69e2640 1 -- 172.21.15.44:0/2562300095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8005180 msgr2=0x7f21c800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.354+0000 7f21e69e2640 1 --2- 172.21.15.44:0/2562300095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8005180 0x7f21c800b980 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f21d800e350 tx=0x7f21c80057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.354+0000 7f21e69e2640 1 -- 172.21.15.44:0/2562300095 shutdown_connections 2023-11-04T01:37:01.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.354+0000 7f21e69e2640 1 --2- 172.21.15.44:0/2562300095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8005180 0x7f21c800b980 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.354+0000 7f21e69e2640 1 -- 172.21.15.44:0/2562300095 >> 172.21.15.44:0/2562300095 conn(0x7f21e00cf880 msgr2=0x7f21e00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:01.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.354+0000 7f21e69e2640 1 -- 172.21.15.44:0/2562300095 shutdown_connections 2023-11-04T01:37:01.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.354+0000 7f21e69e2640 1 -- 172.21.15.44:0/2562300095 wait complete. 2023-11-04T01:37:01.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.356+0000 7f21e69e2640 1 Processor -- start 2023-11-04T01:37:01.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.356+0000 7f21e69e2640 1 -- start start 2023-11-04T01:37:01.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.356+0000 7f21e69e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8005180 0x7f21e00c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.356+0000 7f21e69e2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e00c7340 0x7f21e00c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.356+0000 7f21e69e2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21e00b7b60 0x7f21e00b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.356+0000 7f21e69e2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00c8ac0 con 0x7f21c8005180 2023-11-04T01:37:01.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.356+0000 7f21e69e2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00c5f50 con 0x7f21e00b7b60 2023-11-04T01:37:01.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.356+0000 7f21e69e2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00b8520 con 0x7f21e00c7340 2023-11-04T01:37:01.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21dffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8005180 0x7f21e00c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21dffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8005180 0x7f21e00c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39406/0 (socket says 172.21.15.44:39406) 2023-11-04T01:37:01.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21dffff640 1 -- 172.21.15.44:0/2811501299 learned_addr learned my addr 172.21.15.44:0/2811501299 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:01.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21e4f7f640 1 --2- 172.21.15.44:0/2811501299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21e00b7b60 0x7f21e00b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21df7fe640 1 --2- 172.21.15.44:0/2811501299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e00c7340 0x7f21e00c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21dffff640 1 -- 172.21.15.44:0/2811501299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e00c7340 msgr2=0x7f21e00c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21dffff640 1 --2- 172.21.15.44:0/2811501299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e00c7340 0x7f21e00c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21dffff640 1 -- 172.21.15.44:0/2811501299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21e00b7b60 msgr2=0x7f21e00b7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21dffff640 1 --2- 172.21.15.44:0/2811501299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21e00b7b60 0x7f21e00b7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21dffff640 1 -- 172.21.15.44:0/2811501299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e0156820 con 0x7f21c8005180 2023-11-04T01:37:01.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21df7fe640 1 --2- 172.21.15.44:0/2811501299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e00c7340 0x7f21e00c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:01.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21dffff640 1 --2- 172.21.15.44:0/2811501299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8005180 0x7f21e00c5a10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f21d000f820 tx=0x7f21d000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21dcff9640 1 -- 172.21.15.44:0/2811501299 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d00052e0 con 0x7f21c8005180 2023-11-04T01:37:01.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21dcff9640 1 -- 172.21.15.44:0/2811501299 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d0005440 con 0x7f21c8005180 2023-11-04T01:37:01.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21e69e2640 1 -- 172.21.15.44:0/2811501299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e00c7eb0 con 0x7f21c8005180 2023-11-04T01:37:01.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21dcff9640 1 -- 172.21.15.44:0/2811501299 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d000d950 con 0x7f21c8005180 2023-11-04T01:37:01.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.357+0000 7f21e69e2640 1 -- 172.21.15.44:0/2811501299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e00c8470 con 0x7f21c8005180 2023-11-04T01:37:01.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.358+0000 7f21e69e2640 1 -- 172.21.15.44:0/2811501299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e0074290 con 0x7f21c8005180 2023-11-04T01:37:01.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.359+0000 7f21dcff9640 1 -- 172.21.15.44:0/2811501299 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21d000dab0 con 0x7f21c8005180 2023-11-04T01:37:01.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.359+0000 7f21dcff9640 1 --2- 172.21.15.44:0/2811501299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21cc06ae70 0x7f21cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.359+0000 7f21dcff9640 1 -- 172.21.15.44:0/2811501299 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f21d0089a90 con 0x7f21c8005180 2023-11-04T01:37:01.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.359+0000 7f21df7fe640 1 --2- 172.21.15.44:0/2811501299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21cc06ae70 0x7f21cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.360+0000 7f21df7fe640 1 --2- 172.21.15.44:0/2811501299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21cc06ae70 0x7f21cc06d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f21d4001050 tx=0x7f21d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.363+0000 7f21dcff9640 1 -- 172.21.15.44:0/2811501299 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21d0054780 con 0x7f21c8005180 2023-11-04T01:37:01.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.538+0000 7f21e69e2640 1 -- 172.21.15.44:0/2811501299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f21e00d0b80 con 0x7f21c8005180 2023-11-04T01:37:01.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.538+0000 7f21dcff9640 1 -- 172.21.15.44:0/2811501299 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f21d0057da0 con 0x7f21c8005180 2023-11-04T01:37:01.540 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:37:01.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.540+0000 7f21e69e2640 1 -- 172.21.15.44:0/2811501299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21cc06ae70 msgr2=0x7f21cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.540+0000 7f21e69e2640 1 --2- 172.21.15.44:0/2811501299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21cc06ae70 0x7f21cc06d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f21d4001050 tx=0x7f21d4009040 comp rx=0 tx=0).stop 2023-11-04T01:37:01.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.540+0000 7f21e69e2640 1 -- 172.21.15.44:0/2811501299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8005180 msgr2=0x7f21e00c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.540+0000 7f21e69e2640 1 --2- 172.21.15.44:0/2811501299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8005180 0x7f21e00c5a10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f21d000f820 tx=0x7f21d000fce0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.540+0000 7f21e69e2640 1 -- 172.21.15.44:0/2811501299 shutdown_connections 2023-11-04T01:37:01.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.540+0000 7f21e69e2640 1 --2- 172.21.15.44:0/2811501299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21cc06ae70 0x7f21cc06d330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.540+0000 7f21e69e2640 1 --2- 172.21.15.44:0/2811501299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21e00b7b60 0x7f21e00b7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.540+0000 7f21e69e2640 1 --2- 172.21.15.44:0/2811501299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e00c7340 0x7f21e00c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.540+0000 7f21e69e2640 1 --2- 172.21.15.44:0/2811501299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8005180 0x7f21e00c5a10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.540+0000 7f21e69e2640 1 -- 172.21.15.44:0/2811501299 >> 172.21.15.44:0/2811501299 conn(0x7f21e00cf880 msgr2=0x7f21e00d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:01.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.540+0000 7f21e69e2640 1 -- 172.21.15.44:0/2811501299 shutdown_connections 2023-11-04T01:37:01.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.540+0000 7f21e69e2640 1 -- 172.21.15.44:0/2811501299 wait complete. 2023-11-04T01:37:01.553 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:37:01.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.659+0000 7eff1bf05640 1 Processor -- start 2023-11-04T01:37:01.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.660+0000 7eff1bf05640 1 -- start start 2023-11-04T01:37:01.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.660+0000 7eff1bf05640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7eff14159c00 0x7eff140cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.660+0000 7eff1bf05640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7eff140c48e0 0x7eff140c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.660+0000 7eff1bf05640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1415aff0 con 0x7eff140adac0 2023-11-04T01:37:01.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.660+0000 7eff1bf05640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff140c52d0 con 0x7eff140c48e0 2023-11-04T01:37:01.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.660+0000 7eff1bf05640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1415a3e0 con 0x7eff14159c00 2023-11-04T01:37:01.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.661+0000 7eff194a0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7eff140c48e0 0x7eff140c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.661+0000 7eff1a4a2640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7eff140adac0 0x7eff140adea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38474/0 (socket says 172.21.15.44:38474) 2023-11-04T01:37:01.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.661+0000 7eff194a0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7eff140c48e0 0x7eff140c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39420/0 (socket says 172.21.15.44:39420) 2023-11-04T01:37:01.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.661+0000 7eff1a4a2640 1 -- 172.21.15.44:0/2600747368 learned_addr learned my addr 172.21.15.44:0/2600747368 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:01.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.661+0000 7eff19ca1640 1 --2- 172.21.15.44:0/2600747368 >> v2:172.21.15.204:3300/0 conn(0x7eff14159c00 0x7eff140cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.661+0000 7eff194a0640 1 -- 172.21.15.44:0/2600747368 >> v2:172.21.15.204:3300/0 conn(0x7eff14159c00 msgr2=0x7eff140cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:01.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.661+0000 7eff194a0640 1 --2- 172.21.15.44:0/2600747368 >> v2:172.21.15.204:3300/0 conn(0x7eff14159c00 0x7eff140cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.661+0000 7eff194a0640 1 -- 172.21.15.44:0/2600747368 >> v1:172.21.15.44:6789/0 conn(0x7eff140adac0 legacy=0x7eff140adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.661+0000 7eff194a0640 1 -- 172.21.15.44:0/2600747368 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1415a6c0 con 0x7eff140c48e0 2023-11-04T01:37:01.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.661+0000 7eff18c9f640 1 -- 172.21.15.44:0/2600747368 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28384945 0 0) 0x7eff1415aff0 con 0x7eff140adac0 2023-11-04T01:37:01.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.662+0000 7eff194a0640 1 --2- 172.21.15.44:0/2600747368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff140c48e0 0x7eff140c4d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7eff140cc4d0 tx=0x7eff0402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96086e6baf2a33d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.662+0000 7eff18c9f640 1 -- 172.21.15.44:0/2600747368 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0402e070 con 0x7eff140c48e0 2023-11-04T01:37:01.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.662+0000 7eff18c9f640 1 -- 172.21.15.44:0/2600747368 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff040315a0 con 0x7eff140c48e0 2023-11-04T01:37:01.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.662+0000 7eff18c9f640 1 -- 172.21.15.44:0/2600747368 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04031930 con 0x7eff140c48e0 2023-11-04T01:37:01.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.662+0000 7eff1bf05640 1 -- 172.21.15.44:0/2600747368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff140c48e0 msgr2=0x7eff140c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.662+0000 7eff1bf05640 1 --2- 172.21.15.44:0/2600747368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff140c48e0 0x7eff140c4d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7eff140cc4d0 tx=0x7eff0402b840 comp rx=0 tx=0).stop 2023-11-04T01:37:01.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.662+0000 7eff1bf05640 1 -- 172.21.15.44:0/2600747368 shutdown_connections 2023-11-04T01:37:01.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.662+0000 7eff1bf05640 1 --2- 172.21.15.44:0/2600747368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff140c48e0 0x7eff140c4d90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.662+0000 7eff1bf05640 1 --2- 172.21.15.44:0/2600747368 >> v2:172.21.15.204:3300/0 conn(0x7eff14159c00 0x7eff140cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.662+0000 7eff1bf05640 1 -- 172.21.15.44:0/2600747368 >> 172.21.15.44:0/2600747368 conn(0x7eff140ce950 msgr2=0x7eff140ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:01.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.662+0000 7eff1bf05640 1 -- 172.21.15.44:0/2600747368 shutdown_connections 2023-11-04T01:37:01.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.662+0000 7eff1bf05640 1 -- 172.21.15.44:0/2600747368 wait complete. 2023-11-04T01:37:01.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.664+0000 7eff1bf05640 1 Processor -- start 2023-11-04T01:37:01.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.664+0000 7eff1bf05640 1 -- start start 2023-11-04T01:37:01.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.664+0000 7eff1bf05640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff140adac0 0x7eff1414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.664+0000 7eff1bf05640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff140c48e0 0x7eff1406da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.664+0000 7eff1bf05640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff14159c00 0x7eff1406df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.664+0000 7eff1bf05640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff141f4900 con 0x7eff140c48e0 2023-11-04T01:37:01.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.664+0000 7eff1bf05640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1414fb30 con 0x7eff140adac0 2023-11-04T01:37:01.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.664+0000 7eff1bf05640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff141f3a30 con 0x7eff14159c00 2023-11-04T01:37:01.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.664+0000 7eff194a0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff140c48e0 0x7eff1406da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.664+0000 7eff194a0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff140c48e0 0x7eff1406da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39432/0 (socket says 172.21.15.44:39432) 2023-11-04T01:37:01.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.664+0000 7eff194a0640 1 -- 172.21.15.44:0/932682223 learned_addr learned my addr 172.21.15.44:0/932682223 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:01.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.665+0000 7eff19ca1640 1 --2- 172.21.15.44:0/932682223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff140adac0 0x7eff1414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.665+0000 7eff1a4a2640 1 --2- 172.21.15.44:0/932682223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff14159c00 0x7eff1406df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.665+0000 7eff194a0640 1 -- 172.21.15.44:0/932682223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff14159c00 msgr2=0x7eff1406df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.665+0000 7eff194a0640 1 --2- 172.21.15.44:0/932682223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff14159c00 0x7eff1406df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.665+0000 7eff194a0640 1 -- 172.21.15.44:0/932682223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff140adac0 msgr2=0x7eff1414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.665+0000 7eff194a0640 1 --2- 172.21.15.44:0/932682223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff140adac0 0x7eff1414f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.665+0000 7eff194a0640 1 -- 172.21.15.44:0/932682223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff04009400 con 0x7eff140c48e0 2023-11-04T01:37:01.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.665+0000 7eff19ca1640 1 --2- 172.21.15.44:0/932682223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff140adac0 0x7eff1414f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:01.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.665+0000 7eff194a0640 1 --2- 172.21.15.44:0/932682223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff140c48e0 0x7eff1406da00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7eff04034040 tx=0x7eff040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.665+0000 7eff0a7fc640 1 -- 172.21.15.44:0/932682223 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04004230 con 0x7eff140c48e0 2023-11-04T01:37:01.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.665+0000 7eff0a7fc640 1 -- 172.21.15.44:0/932682223 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff04004390 con 0x7eff140c48e0 2023-11-04T01:37:01.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.665+0000 7eff1bf05640 1 -- 172.21.15.44:0/932682223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff141f3c80 con 0x7eff140c48e0 2023-11-04T01:37:01.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.665+0000 7eff0a7fc640 1 -- 172.21.15.44:0/932682223 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04032880 con 0x7eff140c48e0 2023-11-04T01:37:01.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.665+0000 7eff1bf05640 1 -- 172.21.15.44:0/932682223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff141f4240 con 0x7eff140c48e0 2023-11-04T01:37:01.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.666+0000 7eff1bf05640 1 -- 172.21.15.44:0/932682223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff14074290 con 0x7eff140c48e0 2023-11-04T01:37:01.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.666+0000 7eff0a7fc640 1 -- 172.21.15.44:0/932682223 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff040329e0 con 0x7eff140c48e0 2023-11-04T01:37:01.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.667+0000 7eff0a7fc640 1 --2- 172.21.15.44:0/932682223 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efef806ae70 0x7efef806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.667+0000 7eff0a7fc640 1 -- 172.21.15.44:0/932682223 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7eff040aba70 con 0x7eff140c48e0 2023-11-04T01:37:01.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.667+0000 7eff19ca1640 1 --2- 172.21.15.44:0/932682223 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efef806ae70 0x7efef806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.668+0000 7eff19ca1640 1 --2- 172.21.15.44:0/932682223 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efef806ae70 0x7efef806d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7eff10006fd0 tx=0x7eff10008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.671+0000 7eff0a7fc640 1 -- 172.21.15.44:0/932682223 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7eff040767f0 con 0x7eff140c48e0 2023-11-04T01:37:01.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.861+0000 7eff1bf05640 1 -- 172.21.15.44:0/932682223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7eff140cac90 con 0x7eff140c48e0 2023-11-04T01:37:01.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.861+0000 7eff0a7fc640 1 -- 172.21.15.44:0/932682223 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7eff04044340 con 0x7eff140c48e0 2023-11-04T01:37:01.863 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2023-11-04T01:37:01.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.863+0000 7eff1bf05640 1 -- 172.21.15.44:0/932682223 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efef806ae70 msgr2=0x7efef806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.863+0000 7eff1bf05640 1 --2- 172.21.15.44:0/932682223 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efef806ae70 0x7efef806d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7eff10006fd0 tx=0x7eff10008040 comp rx=0 tx=0).stop 2023-11-04T01:37:01.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.863+0000 7eff1bf05640 1 -- 172.21.15.44:0/932682223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff140c48e0 msgr2=0x7eff1406da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.863+0000 7eff1bf05640 1 --2- 172.21.15.44:0/932682223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff140c48e0 0x7eff1406da00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7eff04034040 tx=0x7eff040046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.863+0000 7eff1bf05640 1 -- 172.21.15.44:0/932682223 shutdown_connections 2023-11-04T01:37:01.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.863+0000 7eff1bf05640 1 --2- 172.21.15.44:0/932682223 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efef806ae70 0x7efef806d330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.863+0000 7eff1bf05640 1 --2- 172.21.15.44:0/932682223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff14159c00 0x7eff1406df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.863+0000 7eff1bf05640 1 --2- 172.21.15.44:0/932682223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff140c48e0 0x7eff1406da00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.863+0000 7eff1bf05640 1 --2- 172.21.15.44:0/932682223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff140adac0 0x7eff1414f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.863+0000 7eff1bf05640 1 -- 172.21.15.44:0/932682223 >> 172.21.15.44:0/932682223 conn(0x7eff140ce950 msgr2=0x7eff140cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:01.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.863+0000 7eff1bf05640 1 -- 172.21.15.44:0/932682223 shutdown_connections 2023-11-04T01:37:01.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01.863+0000 7eff1bf05640 1 -- 172.21.15.44:0/932682223 wait complete. 2023-11-04T01:37:01.876 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2023-11-04T01:37:01.876 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:01.876 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-04T01:37:01.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:01.939 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi044.stderr:ceph-fuse[98774]: fuse finished with error 0 and tester_r 0 2023-11-04T01:37:01.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:01.944 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi044.stderr:2023-11-04T01:37:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:01.947 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:01.952 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:37:01.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:01.952 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:37:02.009 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:37:02.009 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:02.029 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:37:02.029 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:02.087 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:02.128 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi204.stderr:2023-11-04T01:37:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:02.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.191+0000 7f3c8c6d4640 1 Processor -- start 2023-11-04T01:37:02.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.191+0000 7f3c8c6d4640 1 -- start start 2023-11-04T01:37:02.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.192+0000 7f3c8c6d4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3c840ce240 0x7f3c84157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.192+0000 7f3c8c6d4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c84157540 0x7f3c840d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.192+0000 7f3c8c6d4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8415e000 con 0x7f3c840cde60 2023-11-04T01:37:02.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.192+0000 7f3c8c6d4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8415e5c0 con 0x7f3c840ce240 2023-11-04T01:37:02.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.192+0000 7f3c8c6d4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8415e2e0 con 0x7f3c84157540 2023-11-04T01:37:02.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.192+0000 7f3c8ac71640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c84157540 0x7f3c840d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.192+0000 7f3c89c6f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3c840ce240 0x7f3c84157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.192+0000 7f3c8ac71640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c84157540 0x7f3c840d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:59376/0 (socket says 172.21.15.44:59376) 2023-11-04T01:37:02.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.192+0000 7f3c89c6f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3c840ce240 0x7f3c84157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:35988/0 (socket says 172.21.15.44:35988) 2023-11-04T01:37:02.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.192+0000 7f3c8ac71640 1 -- 172.21.15.44:0/1726863613 learned_addr learned my addr 172.21.15.44:0/1726863613 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:02.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.193+0000 7f3c89c6f640 1 -- 172.21.15.44:0/1726863613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c84157540 msgr2=0x7f3c840d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:02.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.193+0000 7f3c89c6f640 1 --2- 172.21.15.44:0/1726863613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c84157540 0x7f3c840d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.193+0000 7f3c89c6f640 1 -- 172.21.15.44:0/1726863613 >> v1:172.21.15.204:6789/0 conn(0x7f3c840cde60 legacy=0x7f3c8415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.193+0000 7f3c89c6f640 1 -- 172.21.15.44:0/1726863613 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c840d1120 con 0x7f3c840ce240 2023-11-04T01:37:02.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.193+0000 7f3c8ac71640 1 --2- 172.21.15.44:0/1726863613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c84157540 0x7f3c840d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:02.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.194+0000 7f3c89c6f640 1 --2- 172.21.15.44:0/1726863613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c840ce240 0x7f3c84157000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3c740097a0 tx=0x7f3c7402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64175ee4e4520a76 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:02.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.194+0000 7f3c8946e640 1 -- 172.21.15.44:0/1726863613 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c74031830 con 0x7f3c840ce240 2023-11-04T01:37:02.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.194+0000 7f3c8946e640 1 -- 172.21.15.44:0/1726863613 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c74031990 con 0x7f3c840ce240 2023-11-04T01:37:02.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.194+0000 7f3c8946e640 1 -- 172.21.15.44:0/1726863613 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c74031d20 con 0x7f3c840ce240 2023-11-04T01:37:02.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.195+0000 7f3c8c6d4640 1 -- 172.21.15.44:0/1726863613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c840ce240 msgr2=0x7f3c84157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.195+0000 7f3c8c6d4640 1 --2- 172.21.15.44:0/1726863613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c840ce240 0x7f3c84157000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3c740097a0 tx=0x7f3c7402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.195+0000 7f3c8c6d4640 1 -- 172.21.15.44:0/1726863613 shutdown_connections 2023-11-04T01:37:02.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.195+0000 7f3c8c6d4640 1 --2- 172.21.15.44:0/1726863613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c84157540 0x7f3c840d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.195+0000 7f3c8c6d4640 1 --2- 172.21.15.44:0/1726863613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c840ce240 0x7f3c84157000 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.195+0000 7f3c8c6d4640 1 -- 172.21.15.44:0/1726863613 >> 172.21.15.44:0/1726863613 conn(0x7f3c84071f30 msgr2=0x7f3c840cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:02.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.195+0000 7f3c8c6d4640 1 -- 172.21.15.44:0/1726863613 shutdown_connections 2023-11-04T01:37:02.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.195+0000 7f3c8c6d4640 1 -- 172.21.15.44:0/1726863613 wait complete. 2023-11-04T01:37:02.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.196+0000 7f3c8c6d4640 1 Processor -- start 2023-11-04T01:37:02.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.196+0000 7f3c8c6d4640 1 -- start start 2023-11-04T01:37:02.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8c6d4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c840cde60 0x7f3c8414f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8c6d4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c840ce240 0x7f3c8414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8c6d4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c84157540 0x7f3c8414b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8c6d4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8414a900 con 0x7f3c84157540 2023-11-04T01:37:02.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8c6d4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c841f27d0 con 0x7f3c840cde60 2023-11-04T01:37:02.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8c6d4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8414ad20 con 0x7f3c840ce240 2023-11-04T01:37:02.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8ac71640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c84157540 0x7f3c8414b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8ac71640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c84157540 0x7f3c8414b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39436/0 (socket says 172.21.15.44:39436) 2023-11-04T01:37:02.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8ac71640 1 -- 172.21.15.44:0/1624005847 learned_addr learned my addr 172.21.15.44:0/1624005847 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:02.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8a470640 1 --2- 172.21.15.44:0/1624005847 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c840cde60 0x7f3c8414f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c89c6f640 1 --2- 172.21.15.44:0/1624005847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c840ce240 0x7f3c8414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8ac71640 1 -- 172.21.15.44:0/1624005847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c840ce240 msgr2=0x7f3c8414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8ac71640 1 --2- 172.21.15.44:0/1624005847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c840ce240 0x7f3c8414afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8ac71640 1 -- 172.21.15.44:0/1624005847 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c840cde60 msgr2=0x7f3c8414f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8ac71640 1 --2- 172.21.15.44:0/1624005847 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c840cde60 0x7f3c8414f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8ac71640 1 -- 172.21.15.44:0/1624005847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c009b30 con 0x7f3c84157540 2023-11-04T01:37:02.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.197+0000 7f3c8ac71640 1 --2- 172.21.15.44:0/1624005847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c84157540 0x7f3c8414b4e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009e70 tx=0x7f3c7c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:02.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.198+0000 7f3c7affd640 1 -- 172.21.15.44:0/1624005847 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c018070 con 0x7f3c84157540 2023-11-04T01:37:02.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.198+0000 7f3c8c6d4640 1 -- 172.21.15.44:0/1624005847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c74009400 con 0x7f3c84157540 2023-11-04T01:37:02.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.198+0000 7f3c7affd640 1 -- 172.21.15.44:0/1624005847 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c00f040 con 0x7f3c84157540 2023-11-04T01:37:02.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.198+0000 7f3c7affd640 1 -- 172.21.15.44:0/1624005847 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c00ce00 con 0x7f3c84157540 2023-11-04T01:37:02.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.198+0000 7f3c8c6d4640 1 -- 172.21.15.44:0/1624005847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c84149f60 con 0x7f3c84157540 2023-11-04T01:37:02.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.199+0000 7f3c8c6d4640 1 -- 172.21.15.44:0/1624005847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8414aa40 con 0x7f3c84157540 2023-11-04T01:37:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.199+0000 7f3c7affd640 1 -- 172.21.15.44:0/1624005847 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c7c014480 con 0x7f3c84157540 2023-11-04T01:37:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.200+0000 7f3c7affd640 1 --2- 172.21.15.44:0/1624005847 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3c6806ae70 0x7f3c6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.200+0000 7f3c7affd640 1 -- 172.21.15.44:0/1624005847 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3c7c089b10 con 0x7f3c84157540 2023-11-04T01:37:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.200+0000 7f3c8a470640 1 --2- 172.21.15.44:0/1624005847 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3c6806ae70 0x7f3c6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.200+0000 7f3c8a470640 1 --2- 172.21.15.44:0/1624005847 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3c6806ae70 0x7f3c6806d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3c80000f60 tx=0x7f3c80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.204+0000 7f3c7affd640 1 -- 172.21.15.44:0/1624005847 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c8414aa40 con 0x7f3c84157540 2023-11-04T01:37:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.380+0000 7f3c8c6d4640 1 -- 172.21.15.44:0/1624005847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c8414aa40 con 0x7f3c84157540 2023-11-04T01:37:02.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.381+0000 7f3c7affd640 1 -- 172.21.15.44:0/1624005847 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7f3c8414aa40 con 0x7f3c84157540 2023-11-04T01:37:02.384 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:02.384 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:02.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.383+0000 7f3c8c6d4640 1 -- 172.21.15.44:0/1624005847 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3c6806ae70 msgr2=0x7f3c6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.383+0000 7f3c8c6d4640 1 --2- 172.21.15.44:0/1624005847 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3c6806ae70 0x7f3c6806d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3c80000f60 tx=0x7f3c80009040 comp rx=0 tx=0).stop 2023-11-04T01:37:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.383+0000 7f3c8c6d4640 1 -- 172.21.15.44:0/1624005847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c84157540 msgr2=0x7f3c8414b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.383+0000 7f3c8c6d4640 1 --2- 172.21.15.44:0/1624005847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c84157540 0x7f3c8414b4e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009e70 tx=0x7f3c7c00c490 comp rx=0 tx=0).stop 2023-11-04T01:37:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.383+0000 7f3c8c6d4640 1 -- 172.21.15.44:0/1624005847 shutdown_connections 2023-11-04T01:37:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.383+0000 7f3c8c6d4640 1 --2- 172.21.15.44:0/1624005847 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3c6806ae70 0x7f3c6806d330 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.383+0000 7f3c8c6d4640 1 --2- 172.21.15.44:0/1624005847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c84157540 0x7f3c8414b4e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.383+0000 7f3c8c6d4640 1 --2- 172.21.15.44:0/1624005847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c840ce240 0x7f3c8414afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.383+0000 7f3c8c6d4640 1 --2- 172.21.15.44:0/1624005847 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c840cde60 0x7f3c8414f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.383+0000 7f3c8c6d4640 1 -- 172.21.15.44:0/1624005847 >> 172.21.15.44:0/1624005847 conn(0x7f3c84071f30 msgr2=0x7f3c840b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.383+0000 7f3c8c6d4640 1 -- 172.21.15.44:0/1624005847 shutdown_connections 2023-11-04T01:37:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.383+0000 7f3c8c6d4640 1 -- 172.21.15.44:0/1624005847 wait complete. 2023-11-04T01:37:02.396 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:02.397 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:02.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.504+0000 7f7be0ee5640 1 Processor -- start 2023-11-04T01:37:02.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.504+0000 7f7be0ee5640 1 -- start start 2023-11-04T01:37:02.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.505+0000 7f7be0ee5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7bdc153e60 0x7f7bdc15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.505+0000 7f7be0ee5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7bdc0b4880 0x7f7bdc0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.505+0000 7f7be0ee5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bdc0cde60 con 0x7f7bdc0cd6d0 2023-11-04T01:37:02.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.505+0000 7f7be0ee5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bdc160f90 con 0x7f7bdc153e60 2023-11-04T01:37:02.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.505+0000 7f7be0ee5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0b5200 con 0x7f7bdc0b4880 2023-11-04T01:37:02.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.505+0000 7f7bdad9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7bdc0b4880 0x7f7bdc0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.505+0000 7f7bda59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7bdc153e60 0x7f7bdc15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.505+0000 7f7bda59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7bdc153e60 0x7f7bdc15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:36008/0 (socket says 172.21.15.44:36008) 2023-11-04T01:37:02.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.505+0000 7f7bda59c640 1 -- 172.21.15.44:0/1331329179 learned_addr learned my addr 172.21.15.44:0/1331329179 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:02.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.505+0000 7f7bdad9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7bdc0b4880 0x7f7bdc0b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:59396/0 (socket says 172.21.15.44:59396) 2023-11-04T01:37:02.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.505+0000 7f7bda59c640 1 -- 172.21.15.44:0/1331329179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7bdc0b4880 msgr2=0x7f7bdc0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:02.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.505+0000 7f7bda59c640 1 --2- 172.21.15.44:0/1331329179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7bdc0b4880 0x7f7bdc0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.505+0000 7f7bda59c640 1 -- 172.21.15.44:0/1331329179 >> v1:172.21.15.204:6789/0 conn(0x7f7bdc0cd6d0 legacy=0x7f7bdc161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.505+0000 7f7bda59c640 1 -- 172.21.15.44:0/1331329179 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc15e400 con 0x7f7bdc153e60 2023-11-04T01:37:02.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.506+0000 7f7bda59c640 1 --2- 172.21.15.44:0/1331329179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7bdc153e60 0x7f7bdc15dec0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009870 tx=0x7f7bcc02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d4dc64ec4f72624 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:02.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.506+0000 7f7bd9d9b640 1 -- 172.21.15.44:0/1331329179 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc030840 con 0x7f7bdc153e60 2023-11-04T01:37:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.506+0000 7f7bd9d9b640 1 -- 172.21.15.44:0/1331329179 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bcc0309a0 con 0x7f7bdc153e60 2023-11-04T01:37:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.506+0000 7f7bd9d9b640 1 -- 172.21.15.44:0/1331329179 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc030d30 con 0x7f7bdc153e60 2023-11-04T01:37:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.507+0000 7f7be0ee5640 1 -- 172.21.15.44:0/1331329179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7bdc153e60 msgr2=0x7f7bdc15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.507+0000 7f7be0ee5640 1 --2- 172.21.15.44:0/1331329179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7bdc153e60 0x7f7bdc15dec0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009870 tx=0x7f7bcc02b980 comp rx=0 tx=0).stop 2023-11-04T01:37:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.507+0000 7f7be0ee5640 1 -- 172.21.15.44:0/1331329179 shutdown_connections 2023-11-04T01:37:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.507+0000 7f7be0ee5640 1 --2- 172.21.15.44:0/1331329179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7bdc0b4880 0x7f7bdc0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.507+0000 7f7be0ee5640 1 --2- 172.21.15.44:0/1331329179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7bdc153e60 0x7f7bdc15dec0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.507+0000 7f7be0ee5640 1 -- 172.21.15.44:0/1331329179 >> 172.21.15.44:0/1331329179 conn(0x7f7bdc0cf880 msgr2=0x7f7bdc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.507+0000 7f7be0ee5640 1 -- 172.21.15.44:0/1331329179 shutdown_connections 2023-11-04T01:37:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.507+0000 7f7be0ee5640 1 -- 172.21.15.44:0/1331329179 wait complete. 2023-11-04T01:37:02.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.508+0000 7f7be0ee5640 1 Processor -- start 2023-11-04T01:37:02.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.508+0000 7f7be0ee5640 1 -- start start 2023-11-04T01:37:02.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.509+0000 7f7be0ee5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0b4880 0x7f7bdc150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.509+0000 7f7be0ee5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7bdc0cd6d0 0x7f7bdc14c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.509+0000 7f7be0ee5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7bdc153e60 0x7f7bdc155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.509+0000 7f7be0ee5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0ca8e0 con 0x7f7bdc0b4880 2023-11-04T01:37:02.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.509+0000 7f7be0ee5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0cabc0 con 0x7f7bdc153e60 2023-11-04T01:37:02.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.509+0000 7f7be0ee5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0caea0 con 0x7f7bdc0cd6d0 2023-11-04T01:37:02.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.509+0000 7f7bda59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0b4880 0x7f7bdc150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.509+0000 7f7bda59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0b4880 0x7f7bdc150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39444/0 (socket says 172.21.15.44:39444) 2023-11-04T01:37:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.509+0000 7f7bda59c640 1 -- 172.21.15.44:0/3677162302 learned_addr learned my addr 172.21.15.44:0/3677162302 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.509+0000 7f7bdad9d640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7bdc153e60 0x7f7bdc155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.509+0000 7f7bd3fff640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7bdc0cd6d0 0x7f7bdc14c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.510+0000 7f7bda59c640 1 -- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7bdc0cd6d0 msgr2=0x7f7bdc14c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.510+0000 7f7bda59c640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7bdc0cd6d0 0x7f7bdc14c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.510+0000 7f7bda59c640 1 -- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7bdc153e60 msgr2=0x7f7bdc155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.510+0000 7f7bda59c640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7bdc153e60 0x7f7bdc155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.510+0000 7f7bda59c640 1 -- 172.21.15.44:0/3677162302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc0094d0 con 0x7f7bdc0b4880 2023-11-04T01:37:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.510+0000 7f7bd3fff640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7bdc0cd6d0 0x7f7bdc14c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.510+0000 7f7bdad9d640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7bdc153e60 0x7f7bdc155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.510+0000 7f7bda59c640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0b4880 0x7f7bdc150660 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc000c00 tx=0x7f7bcc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:02.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.510+0000 7f7bd2ffd640 1 -- 172.21.15.44:0/3677162302 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc039a90 con 0x7f7bdc0b4880 2023-11-04T01:37:02.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.510+0000 7f7bd2ffd640 1 -- 172.21.15.44:0/3677162302 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bcc039bf0 con 0x7f7bdc0b4880 2023-11-04T01:37:02.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.510+0000 7f7be0ee5640 1 -- 172.21.15.44:0/3677162302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc0cb180 con 0x7f7bdc0b4880 2023-11-04T01:37:02.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.510+0000 7f7bd2ffd640 1 -- 172.21.15.44:0/3677162302 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc043410 con 0x7f7bdc0b4880 2023-11-04T01:37:02.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.510+0000 7f7be0ee5640 1 -- 172.21.15.44:0/3677162302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc0cb740 con 0x7f7bdc0b4880 2023-11-04T01:37:02.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.511+0000 7f7be0ee5640 1 -- 172.21.15.44:0/3677162302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bdc074290 con 0x7f7bdc0b4880 2023-11-04T01:37:02.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.512+0000 7f7bd2ffd640 1 -- 172.21.15.44:0/3677162302 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7bcc02f390 con 0x7f7bdc0b4880 2023-11-04T01:37:02.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.512+0000 7f7bd2ffd640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7bbc06ae70 0x7f7bbc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.512+0000 7f7bd2ffd640 1 -- 172.21.15.44:0/3677162302 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7bcc0abb20 con 0x7f7bdc0b4880 2023-11-04T01:37:02.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.512+0000 7f7bd3fff640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7bbc06ae70 0x7f7bbc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.513+0000 7f7bd3fff640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7bbc06ae70 0x7f7bbc06d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc15bff0 tx=0x7f7bc4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:02.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.516+0000 7f7bd2ffd640 1 -- 172.21.15.44:0/3677162302 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7bcc076790 con 0x7f7bdc0b4880 2023-11-04T01:37:02.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.692+0000 7f7be0ee5640 1 -- 172.21.15.44:0/3677162302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7bdc0d1340 con 0x7f7bdc0b4880 2023-11-04T01:37:02.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.692+0000 7f7bd2ffd640 1 -- 172.21.15.44:0/3677162302 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7bcc079db0 con 0x7f7bdc0b4880 2023-11-04T01:37:02.694 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:37:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.694+0000 7f7be0ee5640 1 -- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7bbc06ae70 msgr2=0x7f7bbc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.694+0000 7f7be0ee5640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7bbc06ae70 0x7f7bbc06d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc15bff0 tx=0x7f7bc4009040 comp rx=0 tx=0).stop 2023-11-04T01:37:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.694+0000 7f7be0ee5640 1 -- 172.21.15.44:0/3677162302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0b4880 msgr2=0x7f7bdc150660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.694+0000 7f7be0ee5640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0b4880 0x7f7bdc150660 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc000c00 tx=0x7f7bcc004730 comp rx=0 tx=0).stop 2023-11-04T01:37:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.694+0000 7f7be0ee5640 1 -- 172.21.15.44:0/3677162302 shutdown_connections 2023-11-04T01:37:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.694+0000 7f7be0ee5640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7bbc06ae70 0x7f7bbc06d330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.694+0000 7f7be0ee5640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7bdc153e60 0x7f7bdc155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.694+0000 7f7be0ee5640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7bdc0cd6d0 0x7f7bdc14c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.694+0000 7f7be0ee5640 1 --2- 172.21.15.44:0/3677162302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0b4880 0x7f7bdc150660 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.694+0000 7f7be0ee5640 1 -- 172.21.15.44:0/3677162302 >> 172.21.15.44:0/3677162302 conn(0x7f7bdc0cf880 msgr2=0x7f7bdc0d2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.694+0000 7f7be0ee5640 1 -- 172.21.15.44:0/3677162302 shutdown_connections 2023-11-04T01:37:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.694+0000 7f7be0ee5640 1 -- 172.21.15.44:0/3677162302 wait complete. 2023-11-04T01:37:02.708 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:02.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.815+0000 7f66d53f5640 1 Processor -- start 2023-11-04T01:37:02.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.815+0000 7f66d53f5640 1 -- start start 2023-11-04T01:37:02.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.816+0000 7f66d53f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66d00cd6d0 0x7f66d0161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.816+0000 7f66d53f5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f66d00b4880 0x7f66d00b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.816+0000 7f66d53f5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d00cde60 con 0x7f66d0153e60 2023-11-04T01:37:02.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.816+0000 7f66d53f5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d0160f90 con 0x7f66d00b4880 2023-11-04T01:37:02.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.816+0000 7f66d53f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00b51e0 con 0x7f66d00cd6d0 2023-11-04T01:37:02.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.816+0000 7f66cf7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f66d00b4880 0x7f66d00b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.816+0000 7f66cf7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f66d00b4880 0x7f66d00b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37466/0 (socket says 172.21.15.44:37466) 2023-11-04T01:37:02.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.816+0000 7f66cf7fe640 1 -- 172.21.15.44:0/2194143439 learned_addr learned my addr 172.21.15.44:0/2194143439 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:02.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.816+0000 7f66ce7fc640 1 --2- 172.21.15.44:0/2194143439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66d00cd6d0 0x7f66d0161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.817+0000 7f66cf7fe640 1 -- 172.21.15.44:0/2194143439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66d00cd6d0 msgr2=0x7f66d0161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:02.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.817+0000 7f66cf7fe640 1 --2- 172.21.15.44:0/2194143439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66d00cd6d0 0x7f66d0161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.817+0000 7f66cf7fe640 1 -- 172.21.15.44:0/2194143439 >> v1:172.21.15.204:6789/0 conn(0x7f66d0153e60 legacy=0x7f66d015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.817+0000 7f66cf7fe640 1 -- 172.21.15.44:0/2194143439 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d0161960 con 0x7f66d00b4880 2023-11-04T01:37:02.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.817+0000 7f66cf7fe640 1 --2- 172.21.15.44:0/2194143439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66d00b4880 0x7f66d00b4ca0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009e50 tx=0x7f66c002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8c65e8d8bc71c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:02.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.818+0000 7f66cdffb640 1 -- 172.21.15.44:0/2194143439 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c002cb00 con 0x7f66d00b4880 2023-11-04T01:37:02.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.818+0000 7f66cdffb640 1 -- 172.21.15.44:0/2194143439 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c002cc60 con 0x7f66d00b4880 2023-11-04T01:37:02.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.818+0000 7f66cdffb640 1 -- 172.21.15.44:0/2194143439 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00343f0 con 0x7f66d00b4880 2023-11-04T01:37:02.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.818+0000 7f66d53f5640 1 -- 172.21.15.44:0/2194143439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66d00b4880 msgr2=0x7f66d00b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.818+0000 7f66d53f5640 1 --2- 172.21.15.44:0/2194143439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66d00b4880 0x7f66d00b4ca0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009e50 tx=0x7f66c002bf60 comp rx=0 tx=0).stop 2023-11-04T01:37:02.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.818+0000 7f66d53f5640 1 -- 172.21.15.44:0/2194143439 shutdown_connections 2023-11-04T01:37:02.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.818+0000 7f66d53f5640 1 --2- 172.21.15.44:0/2194143439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66d00b4880 0x7f66d00b4ca0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.818+0000 7f66d53f5640 1 --2- 172.21.15.44:0/2194143439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66d00cd6d0 0x7f66d0161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.818+0000 7f66d53f5640 1 -- 172.21.15.44:0/2194143439 >> 172.21.15.44:0/2194143439 conn(0x7f66d00cf880 msgr2=0x7f66d00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:02.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.818+0000 7f66d53f5640 1 -- 172.21.15.44:0/2194143439 shutdown_connections 2023-11-04T01:37:02.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.818+0000 7f66d53f5640 1 -- 172.21.15.44:0/2194143439 wait complete. 2023-11-04T01:37:02.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.819+0000 7f66d53f5640 1 Processor -- start 2023-11-04T01:37:02.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.820+0000 7f66d53f5640 1 -- start start 2023-11-04T01:37:02.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.820+0000 7f66d53f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66d00b4880 0x7f66d0159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.820+0000 7f66d53f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66d00cd6d0 0x7f66d01f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.820+0000 7f66d53f5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66d0153e60 0x7f66d01f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.820+0000 7f66d53f5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00cb610 con 0x7f66d00b4880 2023-11-04T01:37:02.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.820+0000 7f66d53f5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00c7a50 con 0x7f66d0153e60 2023-11-04T01:37:02.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.820+0000 7f66d53f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00c7d30 con 0x7f66d00cd6d0 2023-11-04T01:37:02.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.820+0000 7f66ceffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66d00b4880 0x7f66d0159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.820+0000 7f66ceffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66d00b4880 0x7f66d0159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37480/0 (socket says 172.21.15.44:37480) 2023-11-04T01:37:02.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.820+0000 7f66ceffd640 1 -- 172.21.15.44:0/1361679238 learned_addr learned my addr 172.21.15.44:0/1361679238 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:02.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.821+0000 7f66cf7fe640 1 --2- 172.21.15.44:0/1361679238 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66d0153e60 0x7f66d01f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.821+0000 7f66ce7fc640 1 --2- 172.21.15.44:0/1361679238 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66d00cd6d0 0x7f66d01f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.821+0000 7f66ceffd640 1 -- 172.21.15.44:0/1361679238 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66d00cd6d0 msgr2=0x7f66d01f2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.821+0000 7f66ceffd640 1 --2- 172.21.15.44:0/1361679238 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66d00cd6d0 0x7f66d01f2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.821+0000 7f66ceffd640 1 -- 172.21.15.44:0/1361679238 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66d0153e60 msgr2=0x7f66d01f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.821+0000 7f66ceffd640 1 --2- 172.21.15.44:0/1361679238 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66d0153e60 0x7f66d01f5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.821+0000 7f66ceffd640 1 -- 172.21.15.44:0/1361679238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c0009b30 con 0x7f66d00b4880 2023-11-04T01:37:02.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.821+0000 7f66ceffd640 1 --2- 172.21.15.44:0/1361679238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66d00b4880 0x7f66d0159960 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f66c800c3c0 tx=0x7f66c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:02.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.821+0000 7f66c77fe640 1 -- 172.21.15.44:0/1361679238 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c80052d0 con 0x7f66d00b4880 2023-11-04T01:37:02.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.821+0000 7f66c77fe640 1 -- 172.21.15.44:0/1361679238 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c8005450 con 0x7f66d00b4880 2023-11-04T01:37:02.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.821+0000 7f66d53f5640 1 -- 172.21.15.44:0/1361679238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d00c8010 con 0x7f66d00b4880 2023-11-04T01:37:02.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.821+0000 7f66c77fe640 1 -- 172.21.15.44:0/1361679238 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8007260 con 0x7f66d00b4880 2023-11-04T01:37:02.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.821+0000 7f66d53f5640 1 -- 172.21.15.44:0/1361679238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d0159ea0 con 0x7f66d00b4880 2023-11-04T01:37:02.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.822+0000 7f66d53f5640 1 -- 172.21.15.44:0/1361679238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d0074290 con 0x7f66d00b4880 2023-11-04T01:37:02.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.822+0000 7f66c77fe640 1 -- 172.21.15.44:0/1361679238 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f66c80073c0 con 0x7f66d00b4880 2023-11-04T01:37:02.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.823+0000 7f66c77fe640 1 --2- 172.21.15.44:0/1361679238 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f66b006ae70 0x7f66b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.823+0000 7f66c77fe640 1 -- 172.21.15.44:0/1361679238 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f66c8088d70 con 0x7f66d00b4880 2023-11-04T01:37:02.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.823+0000 7f66ce7fc640 1 --2- 172.21.15.44:0/1361679238 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f66b006ae70 0x7f66b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.824+0000 7f66ce7fc640 1 --2- 172.21.15.44:0/1361679238 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f66b006ae70 0x7f66b006d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f66d0161890 tx=0x7f66b8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:02.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:02.827+0000 7f66c77fe640 1 -- 172.21.15.44:0/1361679238 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66c8053a60 con 0x7f66d00b4880 2023-11-04T01:37:03.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.006+0000 7f66d53f5640 1 -- 172.21.15.44:0/1361679238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f66d00d0b80 con 0x7f66d00b4880 2023-11-04T01:37:03.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.006+0000 7f66c77fe640 1 -- 172.21.15.44:0/1361679238 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f66c8057080 con 0x7f66d00b4880 2023-11-04T01:37:03.009 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:37:03.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.008+0000 7f66d53f5640 1 -- 172.21.15.44:0/1361679238 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f66b006ae70 msgr2=0x7f66b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.008+0000 7f66d53f5640 1 --2- 172.21.15.44:0/1361679238 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f66b006ae70 0x7f66b006d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f66d0161890 tx=0x7f66b8008040 comp rx=0 tx=0).stop 2023-11-04T01:37:03.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.008+0000 7f66d53f5640 1 -- 172.21.15.44:0/1361679238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66d00b4880 msgr2=0x7f66d0159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.008+0000 7f66d53f5640 1 --2- 172.21.15.44:0/1361679238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66d00b4880 0x7f66d0159960 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f66c800c3c0 tx=0x7f66c800c880 comp rx=0 tx=0).stop 2023-11-04T01:37:03.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.008+0000 7f66d53f5640 1 -- 172.21.15.44:0/1361679238 shutdown_connections 2023-11-04T01:37:03.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.008+0000 7f66d53f5640 1 --2- 172.21.15.44:0/1361679238 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f66b006ae70 0x7f66b006d330 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.008+0000 7f66d53f5640 1 --2- 172.21.15.44:0/1361679238 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66d0153e60 0x7f66d01f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.008+0000 7f66d53f5640 1 --2- 172.21.15.44:0/1361679238 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66d00cd6d0 0x7f66d01f2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.008+0000 7f66d53f5640 1 --2- 172.21.15.44:0/1361679238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66d00b4880 0x7f66d0159960 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.008+0000 7f66d53f5640 1 -- 172.21.15.44:0/1361679238 >> 172.21.15.44:0/1361679238 conn(0x7f66d00cf880 msgr2=0x7f66d00d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:03.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.008+0000 7f66d53f5640 1 -- 172.21.15.44:0/1361679238 shutdown_connections 2023-11-04T01:37:03.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.008+0000 7f66d53f5640 1 -- 172.21.15.44:0/1361679238 wait complete. 2023-11-04T01:37:03.021 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:03.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.128+0000 7f9973ab4640 1 Processor -- start 2023-11-04T01:37:03.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.128+0000 7f9973ab4640 1 -- start start 2023-11-04T01:37:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.129+0000 7f9973ab4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f996c0b4880 0x7f996c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.129+0000 7f9973ab4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f996c0cde60 con 0x7f996c153e60 2023-11-04T01:37:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.129+0000 7f9973ab4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f996c160f90 con 0x7f996c0cd6d0 2023-11-04T01:37:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.129+0000 7f9973ab4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f996c0b5200 con 0x7f996c0b4880 2023-11-04T01:37:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.129+0000 7f9972051640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f996c0b4880 0x7f996c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.129+0000 7f9971850640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f996c153e60 0x7f996c15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49058/0 (socket says 172.21.15.44:49058) 2023-11-04T01:37:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.129+0000 7f9971850640 1 -- 172.21.15.44:0/3611600431 learned_addr learned my addr 172.21.15.44:0/3611600431 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.130+0000 7f9972051640 1 -- 172.21.15.44:0/3611600431 >> v1:172.21.15.204:6789/0 conn(0x7f996c0cd6d0 legacy=0x7f996c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.130+0000 7f9972051640 1 -- 172.21.15.44:0/3611600431 >> v1:172.21.15.44:6789/0 conn(0x7f996c153e60 legacy=0x7f996c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.130+0000 7f9972051640 1 -- 172.21.15.44:0/3611600431 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c0ce090 con 0x7f996c0b4880 2023-11-04T01:37:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.130+0000 7f997084e640 1 -- 172.21.15.44:0/3611600431 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325070488 0 0) 0x7f996c0cde60 con 0x7f996c153e60 2023-11-04T01:37:03.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.130+0000 7f9972051640 1 --2- 172.21.15.44:0/3611600431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f996c0b4880 0x7f996c0b4cc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f995c009d90 tx=0x7f995c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fa12555badd618 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:03.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.131+0000 7f997084e640 1 -- 172.21.15.44:0/3611600431 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c02cd00 con 0x7f996c0b4880 2023-11-04T01:37:03.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.131+0000 7f997084e640 1 -- 172.21.15.44:0/3611600431 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c02ce60 con 0x7f996c0b4880 2023-11-04T01:37:03.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.131+0000 7f997084e640 1 -- 172.21.15.44:0/3611600431 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c034660 con 0x7f996c0b4880 2023-11-04T01:37:03.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.131+0000 7f9973ab4640 1 -- 172.21.15.44:0/3611600431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f996c0b4880 msgr2=0x7f996c0b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.131+0000 7f9973ab4640 1 --2- 172.21.15.44:0/3611600431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f996c0b4880 0x7f996c0b4cc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f995c009d90 tx=0x7f995c02bf50 comp rx=0 tx=0).stop 2023-11-04T01:37:03.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.131+0000 7f9973ab4640 1 -- 172.21.15.44:0/3611600431 shutdown_connections 2023-11-04T01:37:03.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.131+0000 7f9973ab4640 1 --2- 172.21.15.44:0/3611600431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f996c0b4880 0x7f996c0b4cc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.131+0000 7f9973ab4640 1 -- 172.21.15.44:0/3611600431 >> 172.21.15.44:0/3611600431 conn(0x7f996c0cf880 msgr2=0x7f996c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:03.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.131+0000 7f9973ab4640 1 -- 172.21.15.44:0/3611600431 shutdown_connections 2023-11-04T01:37:03.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.131+0000 7f9973ab4640 1 -- 172.21.15.44:0/3611600431 wait complete. 2023-11-04T01:37:03.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.132+0000 7f9973ab4640 1 Processor -- start 2023-11-04T01:37:03.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.133+0000 7f9973ab4640 1 -- start start 2023-11-04T01:37:03.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.133+0000 7f9973ab4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f996c0b4880 0x7f996c156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.133+0000 7f9973ab4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f996c0cd6d0 0x7f996c1f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.133+0000 7f9973ab4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f996c153e60 0x7f996c1f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.133+0000 7f9973ab4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c0c61f0 con 0x7f996c0b4880 2023-11-04T01:37:03.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.133+0000 7f9973ab4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c15a900 con 0x7f996c0cd6d0 2023-11-04T01:37:03.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.133+0000 7f9973ab4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996c155690 con 0x7f996c153e60 2023-11-04T01:37:03.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.133+0000 7f9971850640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f996c0b4880 0x7f996c156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.133+0000 7f9971850640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f996c0b4880 0x7f996c156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37498/0 (socket says 172.21.15.44:37498) 2023-11-04T01:37:03.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.133+0000 7f9971850640 1 -- 172.21.15.44:0/2725073265 learned_addr learned my addr 172.21.15.44:0/2725073265 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:03.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.134+0000 7f9972051640 1 --2- 172.21.15.44:0/2725073265 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f996c153e60 0x7f996c1f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.134+0000 7f997104f640 1 --2- 172.21.15.44:0/2725073265 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f996c0cd6d0 0x7f996c1f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.134+0000 7f9971850640 1 -- 172.21.15.44:0/2725073265 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f996c153e60 msgr2=0x7f996c1f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.134+0000 7f9971850640 1 --2- 172.21.15.44:0/2725073265 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f996c153e60 0x7f996c1f3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.134+0000 7f9971850640 1 -- 172.21.15.44:0/2725073265 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f996c0cd6d0 msgr2=0x7f996c1f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.134+0000 7f9971850640 1 --2- 172.21.15.44:0/2725073265 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f996c0cd6d0 0x7f996c1f3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.134+0000 7f9971850640 1 -- 172.21.15.44:0/2725073265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c009a70 con 0x7f996c0b4880 2023-11-04T01:37:03.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.134+0000 7f9971850640 1 --2- 172.21.15.44:0/2725073265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f996c0b4880 0x7f996c156730 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f996400c3f0 tx=0x7f996400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:03.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.134+0000 7f996a7fc640 1 -- 172.21.15.44:0/2725073265 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99640074e0 con 0x7f996c0b4880 2023-11-04T01:37:03.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.134+0000 7f996a7fc640 1 -- 172.21.15.44:0/2725073265 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9964007640 con 0x7f996c0b4880 2023-11-04T01:37:03.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.134+0000 7f9973ab4640 1 -- 172.21.15.44:0/2725073265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996c155970 con 0x7f996c0b4880 2023-11-04T01:37:03.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.134+0000 7f996a7fc640 1 -- 172.21.15.44:0/2725073265 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9964004a20 con 0x7f996c0b4880 2023-11-04T01:37:03.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.134+0000 7f9973ab4640 1 -- 172.21.15.44:0/2725073265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f996c155f30 con 0x7f996c0b4880 2023-11-04T01:37:03.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.135+0000 7f9973ab4640 1 -- 172.21.15.44:0/2725073265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f996c074290 con 0x7f996c0b4880 2023-11-04T01:37:03.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.135+0000 7f996a7fc640 1 -- 172.21.15.44:0/2725073265 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9964004b80 con 0x7f996c0b4880 2023-11-04T01:37:03.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.136+0000 7f996a7fc640 1 --2- 172.21.15.44:0/2725073265 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f995806ae70 0x7f995806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.136+0000 7f996a7fc640 1 -- 172.21.15.44:0/2725073265 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9964089750 con 0x7f996c0b4880 2023-11-04T01:37:03.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.136+0000 7f997104f640 1 --2- 172.21.15.44:0/2725073265 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f995806ae70 0x7f995806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.136+0000 7f997104f640 1 --2- 172.21.15.44:0/2725073265 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f995806ae70 0x7f995806d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f996c1f5da0 tx=0x7f9960009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:03.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.140+0000 7f996a7fc640 1 -- 172.21.15.44:0/2725073265 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f99640544d0 con 0x7f996c0b4880 2023-11-04T01:37:03.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.319+0000 7f9973ab4640 1 -- 172.21.15.44:0/2725073265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f996c0d0b80 con 0x7f996c0b4880 2023-11-04T01:37:03.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.319+0000 7f996a7fc640 1 -- 172.21.15.44:0/2725073265 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9964057af0 con 0x7f996c0b4880 2023-11-04T01:37:03.322 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:37:03.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.321+0000 7f9973ab4640 1 -- 172.21.15.44:0/2725073265 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f995806ae70 msgr2=0x7f995806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.321+0000 7f9973ab4640 1 --2- 172.21.15.44:0/2725073265 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f995806ae70 0x7f995806d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f996c1f5da0 tx=0x7f9960009040 comp rx=0 tx=0).stop 2023-11-04T01:37:03.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.321+0000 7f9973ab4640 1 -- 172.21.15.44:0/2725073265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f996c0b4880 msgr2=0x7f996c156730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.321+0000 7f9973ab4640 1 --2- 172.21.15.44:0/2725073265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f996c0b4880 0x7f996c156730 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f996400c3f0 tx=0x7f996400c8b0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.321+0000 7f9973ab4640 1 -- 172.21.15.44:0/2725073265 shutdown_connections 2023-11-04T01:37:03.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.321+0000 7f9973ab4640 1 --2- 172.21.15.44:0/2725073265 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f995806ae70 0x7f995806d330 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.321+0000 7f9973ab4640 1 --2- 172.21.15.44:0/2725073265 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f996c153e60 0x7f996c1f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.321+0000 7f9973ab4640 1 --2- 172.21.15.44:0/2725073265 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f996c0cd6d0 0x7f996c1f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.321+0000 7f9973ab4640 1 --2- 172.21.15.44:0/2725073265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f996c0b4880 0x7f996c156730 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.321+0000 7f9973ab4640 1 -- 172.21.15.44:0/2725073265 >> 172.21.15.44:0/2725073265 conn(0x7f996c0cf880 msgr2=0x7f996c15bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:03.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.322+0000 7f9973ab4640 1 -- 172.21.15.44:0/2725073265 shutdown_connections 2023-11-04T01:37:03.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.322+0000 7f9973ab4640 1 -- 172.21.15.44:0/2725073265 wait complete. 2023-11-04T01:37:03.334 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:03.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.442+0000 7f5b2c378640 1 Processor -- start 2023-11-04T01:37:03.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.442+0000 7f5b2c378640 1 -- start start 2023-11-04T01:37:03.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.443+0000 7f5b2c378640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b240b64c0 0x7f5b240b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.443+0000 7f5b2c378640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b240d01f0 con 0x7f5b240cd3b0 2023-11-04T01:37:03.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.443+0000 7f5b2c378640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b240b6a40 con 0x7f5b2415af20 2023-11-04T01:37:03.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.443+0000 7f5b2c378640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b240cc380 con 0x7f5b240b64c0 2023-11-04T01:37:03.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.443+0000 7f5b2a915640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5b240cd3b0 0x7f5b240cec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49068/0 (socket says 172.21.15.44:49068) 2023-11-04T01:37:03.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.443+0000 7f5b2a915640 1 -- 172.21.15.44:0/3689365991 learned_addr learned my addr 172.21.15.44:0/3689365991 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:03.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29913640 1 --2- 172.21.15.44:0/3689365991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b240b64c0 0x7f5b240b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890297943 0 0) 0x7f5b240d01f0 con 0x7f5b240cd3b0 2023-11-04T01:37:03.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b0c003520 con 0x7f5b240cd3b0 2023-11-04T01:37:03.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445555632 0 0) 0x7f5b240b6a40 con 0x7f5b2415af20 2023-11-04T01:37:03.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b240d01f0 con 0x7f5b2415af20 2023-11-04T01:37:03.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2065234487 0 0) 0x7f5b0c003520 con 0x7f5b240cd3b0 2023-11-04T01:37:03.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b240b64c0 msgr2=0x7f5b240b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:03.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 --2- 172.21.15.44:0/3689365991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b240b64c0 0x7f5b240b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 >> v1:172.21.15.204:6789/0 conn(0x7f5b2415af20 legacy=0x7f5b240cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b240d04b0 con 0x7f5b240cd3b0 2023-11-04T01:37:03.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f5b140019f0 con 0x7f5b240cd3b0 2023-11-04T01:37:03.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 >> v1:172.21.15.44:6789/0 conn(0x7f5b240cd3b0 legacy=0x7f5b240cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 --2- 172.21.15.44:0/3689365991 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b0c003b30 0x7f5b0c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 --2- 172.21.15.44:0/3689365991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b0c0047c0 0x7f5b0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 --2- 172.21.15.44:0/3689365991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b240b64c0 0x7f5b0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b240cc380 con 0x7f5b0c0047c0 2023-11-04T01:37:03.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c00ba30 con 0x7f5b0c003b30 2023-11-04T01:37:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c00bbf0 con 0x7f5b240b64c0 2023-11-04T01:37:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29913640 1 --2- 172.21.15.44:0/3689365991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b0c0047c0 0x7f5b0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b2a114640 1 --2- 172.21.15.44:0/3689365991 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b0c003b30 0x7f5b0c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b2a915640 1 --2- 172.21.15.44:0/3689365991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b240b64c0 0x7f5b0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.444+0000 7f5b29913640 1 -- 172.21.15.44:0/3689365991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b240b64c0 msgr2=0x7f5b0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.445+0000 7f5b29913640 1 --2- 172.21.15.44:0/3689365991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b240b64c0 0x7f5b0c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.445+0000 7f5b29913640 1 -- 172.21.15.44:0/3689365991 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b0c003b30 msgr2=0x7f5b0c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.445+0000 7f5b29913640 1 --2- 172.21.15.44:0/3689365991 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b0c003b30 0x7f5b0c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.445+0000 7f5b29913640 1 -- 172.21.15.44:0/3689365991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c003520 con 0x7f5b0c0047c0 2023-11-04T01:37:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.445+0000 7f5b29913640 1 --2- 172.21.15.44:0/3689365991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b0c0047c0 0x7f5b0c004c40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009ac0 tx=0x7f5b0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707152207dca1a7a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.445+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1802c6b0 con 0x7f5b0c0047c0 2023-11-04T01:37:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.445+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1802c810 con 0x7f5b0c0047c0 2023-11-04T01:37:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.445+0000 7f5b29112640 1 -- 172.21.15.44:0/3689365991 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1802cba0 con 0x7f5b0c0047c0 2023-11-04T01:37:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.446+0000 7f5b2c378640 1 -- 172.21.15.44:0/3689365991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b0c0047c0 msgr2=0x7f5b0c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.446+0000 7f5b2c378640 1 --2- 172.21.15.44:0/3689365991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b0c0047c0 0x7f5b0c004c40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009ac0 tx=0x7f5b0c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.446+0000 7f5b2a915640 1 -- 172.21.15.44:0/3689365991 reap_dead start 2023-11-04T01:37:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.446+0000 7f5b2c378640 1 -- 172.21.15.44:0/3689365991 shutdown_connections 2023-11-04T01:37:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.446+0000 7f5b2c378640 1 -- 172.21.15.44:0/3689365991 >> 172.21.15.44:0/3689365991 conn(0x7f5b2406ea20 msgr2=0x7f5b2406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.446+0000 7f5b2c378640 1 -- 172.21.15.44:0/3689365991 shutdown_connections 2023-11-04T01:37:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.446+0000 7f5b2c378640 1 -- 172.21.15.44:0/3689365991 wait complete. 2023-11-04T01:37:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.447+0000 7f5b2c378640 1 Processor -- start 2023-11-04T01:37:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.447+0000 7f5b2c378640 1 -- start start 2023-11-04T01:37:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b2c378640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b0c0047c0 0x7f5b240b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b2c378640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b240c5fc0 0x7f5b240c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b2c378640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b24150ad0 0x7f5b240c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b2c378640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b240c5b30 con 0x7f5b24150ad0 2023-11-04T01:37:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b2c378640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b240c4f20 con 0x7f5b240c5fc0 2023-11-04T01:37:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b2c378640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b240c5200 con 0x7f5b0c0047c0 2023-11-04T01:37:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b2a915640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b24150ad0 0x7f5b240c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b2a915640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b24150ad0 0x7f5b240c8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37528/0 (socket says 172.21.15.44:37528) 2023-11-04T01:37:03.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b2a915640 1 -- 172.21.15.44:0/2224182762 learned_addr learned my addr 172.21.15.44:0/2224182762 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:03.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b2a114640 1 --2- 172.21.15.44:0/2224182762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b0c0047c0 0x7f5b240b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b29913640 1 --2- 172.21.15.44:0/2224182762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b240c5fc0 0x7f5b240c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b2a915640 1 -- 172.21.15.44:0/2224182762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b0c0047c0 msgr2=0x7f5b240b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b2a915640 1 --2- 172.21.15.44:0/2224182762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b0c0047c0 0x7f5b240b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b2a915640 1 -- 172.21.15.44:0/2224182762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b240c5fc0 msgr2=0x7f5b240c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b2a915640 1 --2- 172.21.15.44:0/2224182762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b240c5fc0 0x7f5b240c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.448+0000 7f5b2a915640 1 -- 172.21.15.44:0/2224182762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b240c54e0 con 0x7f5b24150ad0 2023-11-04T01:37:03.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.449+0000 7f5b2a915640 1 --2- 172.21.15.44:0/2224182762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b24150ad0 0x7f5b240c8f20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5b24066750 tx=0x7f5b1400a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:03.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.449+0000 7f5b22ffd640 1 -- 172.21.15.44:0/2224182762 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1400ac00 con 0x7f5b24150ad0 2023-11-04T01:37:03.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.449+0000 7f5b22ffd640 1 -- 172.21.15.44:0/2224182762 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1400ada0 con 0x7f5b24150ad0 2023-11-04T01:37:03.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.449+0000 7f5b22ffd640 1 -- 172.21.15.44:0/2224182762 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14013630 con 0x7f5b24150ad0 2023-11-04T01:37:03.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.449+0000 7f5b2c378640 1 -- 172.21.15.44:0/2224182762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b240c57c0 con 0x7f5b24150ad0 2023-11-04T01:37:03.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.449+0000 7f5b2c378640 1 -- 172.21.15.44:0/2224182762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b24150f50 con 0x7f5b24150ad0 2023-11-04T01:37:03.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.450+0000 7f5b2c378640 1 -- 172.21.15.44:0/2224182762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b24151140 con 0x7f5b24150ad0 2023-11-04T01:37:03.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.450+0000 7f5b22ffd640 1 -- 172.21.15.44:0/2224182762 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b14013790 con 0x7f5b24150ad0 2023-11-04T01:37:03.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.451+0000 7f5b22ffd640 1 --2- 172.21.15.44:0/2224182762 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5b1006ae70 0x7f5b1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.451+0000 7f5b22ffd640 1 -- 172.21.15.44:0/2224182762 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5b1408a160 con 0x7f5b24150ad0 2023-11-04T01:37:03.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.451+0000 7f5b2a114640 1 --2- 172.21.15.44:0/2224182762 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5b1006ae70 0x7f5b1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.451+0000 7f5b2a114640 1 --2- 172.21.15.44:0/2224182762 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5b1006ae70 0x7f5b1006d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0055d0 tx=0x7f5b1c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:03.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.455+0000 7f5b22ffd640 1 -- 172.21.15.44:0/2224182762 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5b14054dc0 con 0x7f5b24150ad0 2023-11-04T01:37:03.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.628+0000 7f5b2c378640 1 -- 172.21.15.44:0/2224182762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5b24157470 con 0x7f5b24150ad0 2023-11-04T01:37:03.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.629+0000 7f5b22ffd640 1 -- 172.21.15.44:0/2224182762 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5b140583e0 con 0x7f5b24150ad0 2023-11-04T01:37:03.631 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:37:03.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.630+0000 7f5b2c378640 1 -- 172.21.15.44:0/2224182762 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5b1006ae70 msgr2=0x7f5b1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.630+0000 7f5b2c378640 1 --2- 172.21.15.44:0/2224182762 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5b1006ae70 0x7f5b1006d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0055d0 tx=0x7f5b1c009040 comp rx=0 tx=0).stop 2023-11-04T01:37:03.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.630+0000 7f5b2c378640 1 -- 172.21.15.44:0/2224182762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b24150ad0 msgr2=0x7f5b240c8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.630+0000 7f5b2c378640 1 --2- 172.21.15.44:0/2224182762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b24150ad0 0x7f5b240c8f20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5b24066750 tx=0x7f5b1400a600 comp rx=0 tx=0).stop 2023-11-04T01:37:03.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.630+0000 7f5b2c378640 1 -- 172.21.15.44:0/2224182762 shutdown_connections 2023-11-04T01:37:03.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.630+0000 7f5b2c378640 1 --2- 172.21.15.44:0/2224182762 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5b1006ae70 0x7f5b1006d330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.630+0000 7f5b2c378640 1 --2- 172.21.15.44:0/2224182762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b24150ad0 0x7f5b240c8f20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.630+0000 7f5b2c378640 1 --2- 172.21.15.44:0/2224182762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b240c5fc0 0x7f5b240c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.630+0000 7f5b2c378640 1 --2- 172.21.15.44:0/2224182762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b0c0047c0 0x7f5b240b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.630+0000 7f5b2c378640 1 -- 172.21.15.44:0/2224182762 >> 172.21.15.44:0/2224182762 conn(0x7f5b2406ea20 msgr2=0x7f5b24158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:03.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.630+0000 7f5b2c378640 1 -- 172.21.15.44:0/2224182762 shutdown_connections 2023-11-04T01:37:03.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.631+0000 7f5b2c378640 1 -- 172.21.15.44:0/2224182762 wait complete. 2023-11-04T01:37:03.644 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:37:03.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.748+0000 7f6a93cd4640 1 Processor -- start 2023-11-04T01:37:03.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.749+0000 7f6a93cd4640 1 -- start start 2023-11-04T01:37:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.749+0000 7f6a93cd4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6a8c159c00 0x7f6a8c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.749+0000 7f6a93cd4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6a8c0c48e0 0x7f6a8c0c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.749+0000 7f6a93cd4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8c15aff0 con 0x7f6a8c0adac0 2023-11-04T01:37:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.749+0000 7f6a93cd4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c0c52d0 con 0x7f6a8c0c48e0 2023-11-04T01:37:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.749+0000 7f6a93cd4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c15a3e0 con 0x7f6a8c159c00 2023-11-04T01:37:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.750+0000 7f6a9126f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6a8c0c48e0 0x7f6a8c0c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.750+0000 7f6a92271640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6a8c0adac0 0x7f6a8c0adea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49078/0 (socket says 172.21.15.44:49078) 2023-11-04T01:37:03.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.750+0000 7f6a92271640 1 -- 172.21.15.44:0/830974745 learned_addr learned my addr 172.21.15.44:0/830974745 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:03.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.750+0000 7f6a91a70640 1 --2- 172.21.15.44:0/830974745 >> v2:172.21.15.204:3300/0 conn(0x7f6a8c159c00 0x7f6a8c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.750+0000 7f6a9126f640 1 -- 172.21.15.44:0/830974745 >> v2:172.21.15.204:3300/0 conn(0x7f6a8c159c00 msgr2=0x7f6a8c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:03.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.750+0000 7f6a9126f640 1 --2- 172.21.15.44:0/830974745 >> v2:172.21.15.204:3300/0 conn(0x7f6a8c159c00 0x7f6a8c0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.750+0000 7f6a9126f640 1 -- 172.21.15.44:0/830974745 >> v1:172.21.15.44:6789/0 conn(0x7f6a8c0adac0 legacy=0x7f6a8c0adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.750+0000 7f6a90a6e640 1 -- 172.21.15.44:0/830974745 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909255452 0 0) 0x7f6a8c15aff0 con 0x7f6a8c0adac0 2023-11-04T01:37:03.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.750+0000 7f6a9126f640 1 -- 172.21.15.44:0/830974745 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c15a6c0 con 0x7f6a8c0c48e0 2023-11-04T01:37:03.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.751+0000 7f6a9126f640 1 --2- 172.21.15.44:0/830974745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8c0c48e0 0x7f6a8c0c4d90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0cc4d0 tx=0x7f6a7c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b33273c6a0b3f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.751+0000 7f6a90a6e640 1 -- 172.21.15.44:0/830974745 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c02e070 con 0x7f6a8c0c48e0 2023-11-04T01:37:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.751+0000 7f6a90a6e640 1 -- 172.21.15.44:0/830974745 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7c0315a0 con 0x7f6a8c0c48e0 2023-11-04T01:37:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.751+0000 7f6a90a6e640 1 -- 172.21.15.44:0/830974745 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c031930 con 0x7f6a8c0c48e0 2023-11-04T01:37:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.751+0000 7f6a93cd4640 1 -- 172.21.15.44:0/830974745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8c0c48e0 msgr2=0x7f6a8c0c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.751+0000 7f6a93cd4640 1 --2- 172.21.15.44:0/830974745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8c0c48e0 0x7f6a8c0c4d90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0cc4d0 tx=0x7f6a7c02b840 comp rx=0 tx=0).stop 2023-11-04T01:37:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.751+0000 7f6a93cd4640 1 -- 172.21.15.44:0/830974745 shutdown_connections 2023-11-04T01:37:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.751+0000 7f6a93cd4640 1 --2- 172.21.15.44:0/830974745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8c0c48e0 0x7f6a8c0c4d90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.751+0000 7f6a93cd4640 1 --2- 172.21.15.44:0/830974745 >> v2:172.21.15.204:3300/0 conn(0x7f6a8c159c00 0x7f6a8c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.751+0000 7f6a93cd4640 1 -- 172.21.15.44:0/830974745 >> 172.21.15.44:0/830974745 conn(0x7f6a8c0ce950 msgr2=0x7f6a8c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.752+0000 7f6a93cd4640 1 -- 172.21.15.44:0/830974745 shutdown_connections 2023-11-04T01:37:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.752+0000 7f6a93cd4640 1 -- 172.21.15.44:0/830974745 wait complete. 2023-11-04T01:37:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.753+0000 7f6a93cd4640 1 Processor -- start 2023-11-04T01:37:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.753+0000 7f6a93cd4640 1 -- start start 2023-11-04T01:37:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.753+0000 7f6a93cd4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8c0adac0 0x7f6a8c14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.753+0000 7f6a93cd4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6a8c0c48e0 0x7f6a8c06da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.753+0000 7f6a93cd4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6a8c159c00 0x7f6a8c06df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.753+0000 7f6a93cd4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c1f4900 con 0x7f6a8c0adac0 2023-11-04T01:37:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.753+0000 7f6a93cd4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c14fb30 con 0x7f6a8c159c00 2023-11-04T01:37:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.753+0000 7f6a93cd4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c1f3a30 con 0x7f6a8c0c48e0 2023-11-04T01:37:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a91a70640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8c0adac0 0x7f6a8c14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a91a70640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8c0adac0 0x7f6a8c14f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37552/0 (socket says 172.21.15.44:37552) 2023-11-04T01:37:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a91a70640 1 -- 172.21.15.44:0/902909358 learned_addr learned my addr 172.21.15.44:0/902909358 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a9126f640 1 --2- 172.21.15.44:0/902909358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6a8c0c48e0 0x7f6a8c06da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a92271640 1 --2- 172.21.15.44:0/902909358 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6a8c159c00 0x7f6a8c06df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a91a70640 1 -- 172.21.15.44:0/902909358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6a8c0c48e0 msgr2=0x7f6a8c06da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a91a70640 1 --2- 172.21.15.44:0/902909358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6a8c0c48e0 0x7f6a8c06da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a91a70640 1 -- 172.21.15.44:0/902909358 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6a8c159c00 msgr2=0x7f6a8c06df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a91a70640 1 --2- 172.21.15.44:0/902909358 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6a8c159c00 0x7f6a8c06df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a91a70640 1 -- 172.21.15.44:0/902909358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c009400 con 0x7f6a8c0adac0 2023-11-04T01:37:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a91a70640 1 --2- 172.21.15.44:0/902909358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8c0adac0 0x7f6a8c14f5f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800d5f0 tx=0x7f6a8800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a827fc640 1 -- 172.21.15.44:0/902909358 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a880125f0 con 0x7f6a8c0adac0 2023-11-04T01:37:03.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a827fc640 1 -- 172.21.15.44:0/902909358 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a88012750 con 0x7f6a8c0adac0 2023-11-04T01:37:03.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a827fc640 1 -- 172.21.15.44:0/902909358 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88012b00 con 0x7f6a8c0adac0 2023-11-04T01:37:03.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a93cd4640 1 -- 172.21.15.44:0/902909358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c1f3c80 con 0x7f6a8c0adac0 2023-11-04T01:37:03.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.754+0000 7f6a93cd4640 1 -- 172.21.15.44:0/902909358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c1f4240 con 0x7f6a8c0adac0 2023-11-04T01:37:03.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.755+0000 7f6a93cd4640 1 -- 172.21.15.44:0/902909358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c074290 con 0x7f6a8c0adac0 2023-11-04T01:37:03.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.756+0000 7f6a827fc640 1 -- 172.21.15.44:0/902909358 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a88012c60 con 0x7f6a8c0adac0 2023-11-04T01:37:03.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.756+0000 7f6a827fc640 1 --2- 172.21.15.44:0/902909358 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6a7006ae70 0x7f6a7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.756+0000 7f6a827fc640 1 -- 172.21.15.44:0/902909358 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6a88089e10 con 0x7f6a8c0adac0 2023-11-04T01:37:03.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.756+0000 7f6a9126f640 1 --2- 172.21.15.44:0/902909358 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6a7006ae70 0x7f6a7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.757+0000 7f6a9126f640 1 --2- 172.21.15.44:0/902909358 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6a7006ae70 0x7f6a7006d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c036000 tx=0x7f6a7c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:03.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.760+0000 7f6a827fc640 1 -- 172.21.15.44:0/902909358 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6a88054b90 con 0x7f6a8c0adac0 2023-11-04T01:37:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.948+0000 7f6a93cd4640 1 -- 172.21.15.44:0/902909358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6a8c0cac90 con 0x7f6a8c0adac0 2023-11-04T01:37:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.949+0000 7f6a827fc640 1 -- 172.21.15.44:0/902909358 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6a880581b0 con 0x7f6a8c0adac0 2023-11-04T01:37:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2023-11-04T01:37:03.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.951+0000 7f6a93cd4640 1 -- 172.21.15.44:0/902909358 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6a7006ae70 msgr2=0x7f6a7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.951+0000 7f6a93cd4640 1 --2- 172.21.15.44:0/902909358 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6a7006ae70 0x7f6a7006d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c036000 tx=0x7f6a7c008030 comp rx=0 tx=0).stop 2023-11-04T01:37:03.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.951+0000 7f6a93cd4640 1 -- 172.21.15.44:0/902909358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8c0adac0 msgr2=0x7f6a8c14f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.951+0000 7f6a93cd4640 1 --2- 172.21.15.44:0/902909358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8c0adac0 0x7f6a8c14f5f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800d5f0 tx=0x7f6a8800dab0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.951+0000 7f6a93cd4640 1 -- 172.21.15.44:0/902909358 shutdown_connections 2023-11-04T01:37:03.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.951+0000 7f6a93cd4640 1 --2- 172.21.15.44:0/902909358 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6a7006ae70 0x7f6a7006d330 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.951+0000 7f6a93cd4640 1 --2- 172.21.15.44:0/902909358 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6a8c159c00 0x7f6a8c06df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.951+0000 7f6a93cd4640 1 --2- 172.21.15.44:0/902909358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6a8c0c48e0 0x7f6a8c06da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.951+0000 7f6a93cd4640 1 --2- 172.21.15.44:0/902909358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8c0adac0 0x7f6a8c14f5f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.951+0000 7f6a93cd4640 1 -- 172.21.15.44:0/902909358 >> 172.21.15.44:0/902909358 conn(0x7f6a8c0ce950 msgr2=0x7f6a8c0cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:03.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.951+0000 7f6a93cd4640 1 -- 172.21.15.44:0/902909358 shutdown_connections 2023-11-04T01:37:03.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:03.951+0000 7f6a93cd4640 1 -- 172.21.15.44:0/902909358 wait complete. 2023-11-04T01:37:03.963 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:37:03.964 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:03.983 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.087+0000 7f3f82c6f640 1 Processor -- start 2023-11-04T01:37:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.087+0000 7f3f82c6f640 1 -- start start 2023-11-04T01:37:04.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.088+0000 7f3f82c6f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3f7c0b0ae0 0x7f3f7c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.088+0000 7f3f82c6f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7c0b4110 con 0x7f3f7c159c70 2023-11-04T01:37:04.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.088+0000 7f3f82c6f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7c0b43f0 con 0x7f3f7c06db20 2023-11-04T01:37:04.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.088+0000 7f3f82c6f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f7c0b49b0 con 0x7f3f7c0b0ae0 2023-11-04T01:37:04.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.088+0000 7f3f7bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3f7c0b0ae0 0x7f3f7c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.088+0000 7f3f7bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3f7c0b0ae0 0x7f3f7c0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37568/0 (socket says 172.21.15.44:37568) 2023-11-04T01:37:04.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.088+0000 7f3f80a0b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3f7c159c70 0x7f3f7c0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49080/0 (socket says 172.21.15.44:49080) 2023-11-04T01:37:04.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.088+0000 7f3f7bfff640 1 -- 172.21.15.44:0/1931246130 learned_addr learned my addr 172.21.15.44:0/1931246130 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:04.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.088+0000 7f3f7bfff640 1 -- 172.21.15.44:0/1931246130 >> v1:172.21.15.204:6789/0 conn(0x7f3f7c06db20 legacy=0x7f3f7c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.088+0000 7f3f7bfff640 1 -- 172.21.15.44:0/1931246130 >> v1:172.21.15.44:6789/0 conn(0x7f3f7c159c70 legacy=0x7f3f7c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.088+0000 7f3f7bfff640 1 -- 172.21.15.44:0/1931246130 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c0b46d0 con 0x7f3f7c0b0ae0 2023-11-04T01:37:04.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.089+0000 7f3f7bfff640 1 --2- 172.21.15.44:0/1931246130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c0b0ae0 0x7f3f7c0ce370 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009870 tx=0x7f3f6802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2612d6a9254b3234 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:04.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.089+0000 7f3f7b7fe640 1 -- 172.21.15.44:0/1931246130 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6802f840 con 0x7f3f7c0b0ae0 2023-11-04T01:37:04.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.089+0000 7f3f7b7fe640 1 -- 172.21.15.44:0/1931246130 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6802f9a0 con 0x7f3f7c0b0ae0 2023-11-04T01:37:04.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.089+0000 7f3f7b7fe640 1 -- 172.21.15.44:0/1931246130 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6802fd30 con 0x7f3f7c0b0ae0 2023-11-04T01:37:04.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.090+0000 7f3f82c6f640 1 -- 172.21.15.44:0/1931246130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c0b0ae0 msgr2=0x7f3f7c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.090+0000 7f3f82c6f640 1 --2- 172.21.15.44:0/1931246130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c0b0ae0 0x7f3f7c0ce370 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009870 tx=0x7f3f6802ba20 comp rx=0 tx=0).stop 2023-11-04T01:37:04.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.090+0000 7f3f82c6f640 1 -- 172.21.15.44:0/1931246130 shutdown_connections 2023-11-04T01:37:04.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.090+0000 7f3f82c6f640 1 --2- 172.21.15.44:0/1931246130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c0b0ae0 0x7f3f7c0ce370 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.090+0000 7f3f82c6f640 1 -- 172.21.15.44:0/1931246130 >> 172.21.15.44:0/1931246130 conn(0x7f3f7c0ce950 msgr2=0x7f3f7c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:04.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.090+0000 7f3f82c6f640 1 -- 172.21.15.44:0/1931246130 shutdown_connections 2023-11-04T01:37:04.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.090+0000 7f3f82c6f640 1 -- 172.21.15.44:0/1931246130 wait complete. 2023-11-04T01:37:04.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.091+0000 7f3f82c6f640 1 Processor -- start 2023-11-04T01:37:04.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.091+0000 7f3f82c6f640 1 -- start start 2023-11-04T01:37:04.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f82c6f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c06db20 0x7f3f7c1efd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f82c6f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f7c0b0ae0 0x7f3f7c1e6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f82c6f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f7c159c70 0x7f3f7c1f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f82c6f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c1e7160 con 0x7f3f7c06db20 2023-11-04T01:37:04.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f82c6f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c1e6e90 con 0x7f3f7c0b0ae0 2023-11-04T01:37:04.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f82c6f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c1e3e10 con 0x7f3f7c159c70 2023-11-04T01:37:04.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f80a0b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c06db20 0x7f3f7c1efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f80a0b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c06db20 0x7f3f7c1efd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37580/0 (socket says 172.21.15.44:37580) 2023-11-04T01:37:04.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f80a0b640 1 -- 172.21.15.44:0/3680083373 learned_addr learned my addr 172.21.15.44:0/3680083373 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:04.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f80a0b640 1 -- 172.21.15.44:0/3680083373 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f7c159c70 msgr2=0x7f3f7c1f14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f80a0b640 1 --2- 172.21.15.44:0/3680083373 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f7c159c70 0x7f3f7c1f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f80a0b640 1 -- 172.21.15.44:0/3680083373 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f7c0b0ae0 msgr2=0x7f3f7c1e6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f80a0b640 1 --2- 172.21.15.44:0/3680083373 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f7c0b0ae0 0x7f3f7c1e6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f80a0b640 1 -- 172.21.15.44:0/3680083373 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f680094d0 con 0x7f3f7c06db20 2023-11-04T01:37:04.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f80a0b640 1 --2- 172.21.15.44:0/3680083373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c06db20 0x7f3f7c1efd90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000c3e0 tx=0x7f3f7000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:04.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.092+0000 7f3f797fa640 1 -- 172.21.15.44:0/3680083373 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f700074e0 con 0x7f3f7c06db20 2023-11-04T01:37:04.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.093+0000 7f3f797fa640 1 -- 172.21.15.44:0/3680083373 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f70007640 con 0x7f3f7c06db20 2023-11-04T01:37:04.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.093+0000 7f3f797fa640 1 -- 172.21.15.44:0/3680083373 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f700049e0 con 0x7f3f7c06db20 2023-11-04T01:37:04.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.093+0000 7f3f82c6f640 1 -- 172.21.15.44:0/3680083373 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7c1e40f0 con 0x7f3f7c06db20 2023-11-04T01:37:04.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.093+0000 7f3f82c6f640 1 -- 172.21.15.44:0/3680083373 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7c1e46b0 con 0x7f3f7c06db20 2023-11-04T01:37:04.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.094+0000 7f3f82c6f640 1 -- 172.21.15.44:0/3680083373 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7c1e48a0 con 0x7f3f7c06db20 2023-11-04T01:37:04.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.094+0000 7f3f797fa640 1 -- 172.21.15.44:0/3680083373 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3f70004b40 con 0x7f3f7c06db20 2023-11-04T01:37:04.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.094+0000 7f3f797fa640 1 --2- 172.21.15.44:0/3680083373 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f6006ae70 0x7f3f6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.094+0000 7f3f797fa640 1 -- 172.21.15.44:0/3680083373 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3f700893c0 con 0x7f3f7c06db20 2023-11-04T01:37:04.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.095+0000 7f3f7bfff640 1 --2- 172.21.15.44:0/3680083373 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f6006ae70 0x7f3f6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.095+0000 7f3f7bfff640 1 --2- 172.21.15.44:0/3680083373 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f6006ae70 0x7f3f6006d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3f68036000 tx=0x7f3f68039040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:04.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.099+0000 7f3f797fa640 1 -- 172.21.15.44:0/3680083373 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3f700540b0 con 0x7f3f7c06db20 2023-11-04T01:37:04.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.276+0000 7f3f82c6f640 1 -- 172.21.15.44:0/3680083373 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f7c0cde20 con 0x7f3f7c06db20 2023-11-04T01:37:04.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.277+0000 7f3f797fa640 1 -- 172.21.15.44:0/3680083373 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7f3f700576d0 con 0x7f3f7c06db20 2023-11-04T01:37:04.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:04.279 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:04.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.278+0000 7f3f82c6f640 1 -- 172.21.15.44:0/3680083373 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f6006ae70 msgr2=0x7f3f6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.278+0000 7f3f82c6f640 1 --2- 172.21.15.44:0/3680083373 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f6006ae70 0x7f3f6006d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3f68036000 tx=0x7f3f68039040 comp rx=0 tx=0).stop 2023-11-04T01:37:04.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.278+0000 7f3f82c6f640 1 -- 172.21.15.44:0/3680083373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c06db20 msgr2=0x7f3f7c1efd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.278+0000 7f3f82c6f640 1 --2- 172.21.15.44:0/3680083373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c06db20 0x7f3f7c1efd90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000c3e0 tx=0x7f3f7000c8a0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.279+0000 7f3f82c6f640 1 -- 172.21.15.44:0/3680083373 shutdown_connections 2023-11-04T01:37:04.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.279+0000 7f3f82c6f640 1 --2- 172.21.15.44:0/3680083373 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f6006ae70 0x7f3f6006d330 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.279+0000 7f3f82c6f640 1 --2- 172.21.15.44:0/3680083373 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f7c159c70 0x7f3f7c1f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.279+0000 7f3f82c6f640 1 --2- 172.21.15.44:0/3680083373 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f7c0b0ae0 0x7f3f7c1e6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.279+0000 7f3f82c6f640 1 --2- 172.21.15.44:0/3680083373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c06db20 0x7f3f7c1efd90 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.279+0000 7f3f82c6f640 1 -- 172.21.15.44:0/3680083373 >> 172.21.15.44:0/3680083373 conn(0x7f3f7c0ce950 msgr2=0x7f3f7c070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:04.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.279+0000 7f3f82c6f640 1 -- 172.21.15.44:0/3680083373 shutdown_connections 2023-11-04T01:37:04.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.279+0000 7f3f82c6f640 1 -- 172.21.15.44:0/3680083373 wait complete. 2023-11-04T01:37:04.292 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:04.292 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:04.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.399+0000 7f89f424f640 1 Processor -- start 2023-11-04T01:37:04.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.399+0000 7f89f424f640 1 -- start start 2023-11-04T01:37:04.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.400+0000 7f89f424f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89ec0cd6d0 0x7f89ec161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.400+0000 7f89f424f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ec0cde60 con 0x7f89ec0b4880 2023-11-04T01:37:04.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.400+0000 7f89f424f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ec160f90 con 0x7f89ec153e60 2023-11-04T01:37:04.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.400+0000 7f89f424f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec161960 con 0x7f89ec0cd6d0 2023-11-04T01:37:04.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.400+0000 7f89f27ec640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f89ec0b4880 0x7f89ec0b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49092/0 (socket says 172.21.15.44:49092) 2023-11-04T01:37:04.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.400+0000 7f89f27ec640 1 -- 172.21.15.44:0/2170351107 learned_addr learned my addr 172.21.15.44:0/2170351107 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:04.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.400+0000 7f89f17ea640 1 --2- 172.21.15.44:0/2170351107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89ec0cd6d0 0x7f89ec161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.400+0000 7f89f0fe9640 1 -- 172.21.15.44:0/2170351107 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090406673 0 0) 0x7f89ec0cde60 con 0x7f89ec0b4880 2023-11-04T01:37:04.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.400+0000 7f89f0fe9640 1 -- 172.21.15.44:0/2170351107 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d8003520 con 0x7f89ec0b4880 2023-11-04T01:37:04.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.401+0000 7f89f17ea640 1 -- 172.21.15.44:0/2170351107 >> v1:172.21.15.204:6789/0 conn(0x7f89ec153e60 legacy=0x7f89ec15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.401+0000 7f89f17ea640 1 -- 172.21.15.44:0/2170351107 >> v1:172.21.15.44:6789/0 conn(0x7f89ec0b4880 legacy=0x7f89ec0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.401+0000 7f89f17ea640 1 -- 172.21.15.44:0/2170351107 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec0ce090 con 0x7f89ec0cd6d0 2023-11-04T01:37:04.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.401+0000 7f89f17ea640 1 --2- 172.21.15.44:0/2170351107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89ec0cd6d0 0x7f89ec161420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0097d0 tx=0x7f89dc02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb29631827afb04a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:04.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.403+0000 7f89f0fe9640 1 -- 172.21.15.44:0/2170351107 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc031890 con 0x7f89ec0cd6d0 2023-11-04T01:37:04.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.403+0000 7f89f0fe9640 1 -- 172.21.15.44:0/2170351107 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc0319f0 con 0x7f89ec0cd6d0 2023-11-04T01:37:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.403+0000 7f89f0fe9640 1 -- 172.21.15.44:0/2170351107 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc031d60 con 0x7f89ec0cd6d0 2023-11-04T01:37:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.404+0000 7f89f424f640 1 -- 172.21.15.44:0/2170351107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89ec0cd6d0 msgr2=0x7f89ec161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.404+0000 7f89f424f640 1 --2- 172.21.15.44:0/2170351107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89ec0cd6d0 0x7f89ec161420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0097d0 tx=0x7f89dc02b930 comp rx=0 tx=0).stop 2023-11-04T01:37:04.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.404+0000 7f89f424f640 1 -- 172.21.15.44:0/2170351107 shutdown_connections 2023-11-04T01:37:04.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.404+0000 7f89f424f640 1 --2- 172.21.15.44:0/2170351107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89ec0cd6d0 0x7f89ec161420 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.404+0000 7f89f424f640 1 -- 172.21.15.44:0/2170351107 >> 172.21.15.44:0/2170351107 conn(0x7f89ec0cf880 msgr2=0x7f89ec0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:04.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.404+0000 7f89f424f640 1 -- 172.21.15.44:0/2170351107 shutdown_connections 2023-11-04T01:37:04.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.404+0000 7f89f424f640 1 -- 172.21.15.44:0/2170351107 wait complete. 2023-11-04T01:37:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.405+0000 7f89f424f640 1 Processor -- start 2023-11-04T01:37:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.405+0000 7f89f424f640 1 -- start start 2023-11-04T01:37:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f424f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89ec0b4880 0x7f89ec153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f424f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f89ec0cd6d0 0x7f89ec0cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f424f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89ec153e60 0x7f89ec158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f424f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec155a10 con 0x7f89ec0b4880 2023-11-04T01:37:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f424f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec155cd0 con 0x7f89ec0cd6d0 2023-11-04T01:37:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f424f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec159280 con 0x7f89ec153e60 2023-11-04T01:37:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f1feb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89ec0b4880 0x7f89ec153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f1feb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89ec0b4880 0x7f89ec153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37594/0 (socket says 172.21.15.44:37594) 2023-11-04T01:37:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f1feb640 1 -- 172.21.15.44:0/2034633614 learned_addr learned my addr 172.21.15.44:0/2034633614 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f27ec640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89ec153e60 0x7f89ec158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f17ea640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f89ec0cd6d0 0x7f89ec0cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f1feb640 1 -- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89ec153e60 msgr2=0x7f89ec158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f1feb640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89ec153e60 0x7f89ec158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f1feb640 1 -- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f89ec0cd6d0 msgr2=0x7f89ec0cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f1feb640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f89ec0cd6d0 0x7f89ec0cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f1feb640 1 -- 172.21.15.44:0/2034633614 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc009400 con 0x7f89ec0b4880 2023-11-04T01:37:04.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f27ec640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89ec153e60 0x7f89ec158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:04.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.406+0000 7f89f17ea640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f89ec0cd6d0 0x7f89ec0cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:04.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.407+0000 7f89f1feb640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89ec0b4880 0x7f89ec153380 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f89e800c3c0 tx=0x7f89e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:04.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.407+0000 7f89e27fc640 1 -- 172.21.15.44:0/2034633614 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e80052d0 con 0x7f89ec0b4880 2023-11-04T01:37:04.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.407+0000 7f89e27fc640 1 -- 172.21.15.44:0/2034633614 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8005450 con 0x7f89ec0b4880 2023-11-04T01:37:04.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.407+0000 7f89f424f640 1 -- 172.21.15.44:0/2034633614 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ec0cc860 con 0x7f89ec0b4880 2023-11-04T01:37:04.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.407+0000 7f89e27fc640 1 -- 172.21.15.44:0/2034633614 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8007260 con 0x7f89ec0b4880 2023-11-04T01:37:04.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.407+0000 7f89f424f640 1 -- 172.21.15.44:0/2034633614 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ec0cc2a0 con 0x7f89ec0b4880 2023-11-04T01:37:04.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.408+0000 7f89f424f640 1 -- 172.21.15.44:0/2034633614 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ec074290 con 0x7f89ec0b4880 2023-11-04T01:37:04.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.408+0000 7f89e27fc640 1 -- 172.21.15.44:0/2034633614 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f89e80073c0 con 0x7f89ec0b4880 2023-11-04T01:37:04.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.409+0000 7f89e27fc640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f89d006aea0 0x7f89d006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.409+0000 7f89e27fc640 1 -- 172.21.15.44:0/2034633614 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f89e8088e20 con 0x7f89ec0b4880 2023-11-04T01:37:04.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.409+0000 7f89f17ea640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f89d006aea0 0x7f89d006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.409+0000 7f89f17ea640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f89d006aea0 0x7f89d006d360 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f89dc036000 tx=0x7f89dc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:04.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.413+0000 7f89e27fc640 1 -- 172.21.15.44:0/2034633614 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f89e8053a80 con 0x7f89ec0b4880 2023-11-04T01:37:04.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.587+0000 7f89f424f640 1 -- 172.21.15.44:0/2034633614 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89ec0d0b80 con 0x7f89ec0b4880 2023-11-04T01:37:04.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.587+0000 7f89e27fc640 1 -- 172.21.15.44:0/2034633614 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89e80570a0 con 0x7f89ec0b4880 2023-11-04T01:37:04.589 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:37:04.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.589+0000 7f89f424f640 1 -- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f89d006aea0 msgr2=0x7f89d006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.589+0000 7f89f424f640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f89d006aea0 0x7f89d006d360 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f89dc036000 tx=0x7f89dc008030 comp rx=0 tx=0).stop 2023-11-04T01:37:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.589+0000 7f89f424f640 1 -- 172.21.15.44:0/2034633614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89ec0b4880 msgr2=0x7f89ec153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.589+0000 7f89f424f640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89ec0b4880 0x7f89ec153380 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f89e800c3c0 tx=0x7f89e800c880 comp rx=0 tx=0).stop 2023-11-04T01:37:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.589+0000 7f89f424f640 1 -- 172.21.15.44:0/2034633614 shutdown_connections 2023-11-04T01:37:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.589+0000 7f89f424f640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f89d006aea0 0x7f89d006d360 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.589+0000 7f89f424f640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89ec153e60 0x7f89ec158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.589+0000 7f89f424f640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f89ec0cd6d0 0x7f89ec0cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.589+0000 7f89f424f640 1 --2- 172.21.15.44:0/2034633614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89ec0b4880 0x7f89ec153380 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.589+0000 7f89f424f640 1 -- 172.21.15.44:0/2034633614 >> 172.21.15.44:0/2034633614 conn(0x7f89ec0cf880 msgr2=0x7f89ec0d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.589+0000 7f89f424f640 1 -- 172.21.15.44:0/2034633614 shutdown_connections 2023-11-04T01:37:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.589+0000 7f89f424f640 1 -- 172.21.15.44:0/2034633614 wait complete. 2023-11-04T01:37:04.602 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:04.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.708+0000 7fe5b3df5640 1 Processor -- start 2023-11-04T01:37:04.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.708+0000 7fe5b3df5640 1 -- start start 2023-11-04T01:37:04.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.709+0000 7fe5b3df5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe5ac15cfd0 0x7fe5ac06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.709+0000 7fe5b3df5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe5ac0cf180 0x7fe5ac161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.709+0000 7fe5b3df5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ac0cea20 con 0x7fe5ac0cd570 2023-11-04T01:37:04.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.709+0000 7fe5b3df5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ac15d3b0 con 0x7fe5ac15cfd0 2023-11-04T01:37:04.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.709+0000 7fe5b3df5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ac161980 con 0x7fe5ac0cf180 2023-11-04T01:37:04.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.709+0000 7fe5b1b91640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe5ac15cfd0 0x7fe5ac06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.709+0000 7fe5b1b91640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe5ac15cfd0 0x7fe5ac06c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37600/0 (socket says 172.21.15.44:37600) 2023-11-04T01:37:04.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.709+0000 7fe5b2392640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe5ac0cd570 0x7fe5ac0cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49094/0 (socket says 172.21.15.44:49094) 2023-11-04T01:37:04.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.709+0000 7fe5b1b91640 1 -- 172.21.15.44:0/1158658244 learned_addr learned my addr 172.21.15.44:0/1158658244 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:04.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.710+0000 7fe5b1390640 1 --2- 172.21.15.44:0/1158658244 >> v2:172.21.15.204:3300/0 conn(0x7fe5ac0cf180 0x7fe5ac161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.710+0000 7fe5b1b91640 1 -- 172.21.15.44:0/1158658244 >> v2:172.21.15.204:3300/0 conn(0x7fe5ac0cf180 msgr2=0x7fe5ac161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:04.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.710+0000 7fe5b1b91640 1 --2- 172.21.15.44:0/1158658244 >> v2:172.21.15.204:3300/0 conn(0x7fe5ac0cf180 0x7fe5ac161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.710+0000 7fe5b1b91640 1 -- 172.21.15.44:0/1158658244 >> v1:172.21.15.44:6789/0 conn(0x7fe5ac0cd570 legacy=0x7fe5ac0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.710+0000 7fe5b1b91640 1 -- 172.21.15.44:0/1158658244 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac0cf610 con 0x7fe5ac15cfd0 2023-11-04T01:37:04.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.711+0000 7fe5b1b91640 1 --2- 172.21.15.44:0/1158658244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5ac15cfd0 0x7fe5ac06c0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac06b0c0 tx=0x7fe5a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf7605321d06634 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:04.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.711+0000 7fe5b0b8f640 1 -- 172.21.15.44:0/1158658244 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4031870 con 0x7fe5ac15cfd0 2023-11-04T01:37:04.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.711+0000 7fe5b0b8f640 1 -- 172.21.15.44:0/1158658244 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a40319d0 con 0x7fe5ac15cfd0 2023-11-04T01:37:04.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.711+0000 7fe5b0b8f640 1 -- 172.21.15.44:0/1158658244 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4031d60 con 0x7fe5ac15cfd0 2023-11-04T01:37:04.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.711+0000 7fe5b3df5640 1 -- 172.21.15.44:0/1158658244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5ac15cfd0 msgr2=0x7fe5ac06c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.711+0000 7fe5b3df5640 1 --2- 172.21.15.44:0/1158658244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5ac15cfd0 0x7fe5ac06c0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac06b0c0 tx=0x7fe5a402b910 comp rx=0 tx=0).stop 2023-11-04T01:37:04.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.711+0000 7fe5b3df5640 1 -- 172.21.15.44:0/1158658244 shutdown_connections 2023-11-04T01:37:04.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.711+0000 7fe5b3df5640 1 --2- 172.21.15.44:0/1158658244 >> v2:172.21.15.204:3300/0 conn(0x7fe5ac0cf180 0x7fe5ac161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.711+0000 7fe5b3df5640 1 --2- 172.21.15.44:0/1158658244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5ac15cfd0 0x7fe5ac06c0a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.711+0000 7fe5b3df5640 1 -- 172.21.15.44:0/1158658244 >> 172.21.15.44:0/1158658244 conn(0x7fe5ac06ea20 msgr2=0x7fe5ac06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:04.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.711+0000 7fe5b3df5640 1 -- 172.21.15.44:0/1158658244 shutdown_connections 2023-11-04T01:37:04.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.711+0000 7fe5b3df5640 1 -- 172.21.15.44:0/1158658244 wait complete. 2023-11-04T01:37:04.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.712+0000 7fe5b3df5640 1 Processor -- start 2023-11-04T01:37:04.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.713+0000 7fe5b3df5640 1 -- start start 2023-11-04T01:37:04.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.713+0000 7fe5b3df5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5ac0cd570 0x7fe5ac0ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.713+0000 7fe5b3df5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5ac15cfd0 0x7fe5ac15a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.713+0000 7fe5b3df5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5ac0ab950 0x7fe5ac15f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.713+0000 7fe5b3df5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac0ad910 con 0x7fe5ac0cd570 2023-11-04T01:37:04.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.713+0000 7fe5b3df5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac15a660 con 0x7fe5ac15cfd0 2023-11-04T01:37:04.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.713+0000 7fe5b3df5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac0ac330 con 0x7fe5ac0ab950 2023-11-04T01:37:04.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.713+0000 7fe5b1b91640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5ac0cd570 0x7fe5ac0ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.713+0000 7fe5b1b91640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5ac0cd570 0x7fe5ac0ad3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37608/0 (socket says 172.21.15.44:37608) 2023-11-04T01:37:04.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.713+0000 7fe5b1b91640 1 -- 172.21.15.44:0/1211420597 learned_addr learned my addr 172.21.15.44:0/1211420597 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:04.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.714+0000 7fe5b1390640 1 --2- 172.21.15.44:0/1211420597 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5ac15cfd0 0x7fe5ac15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.714+0000 7fe5b2392640 1 --2- 172.21.15.44:0/1211420597 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5ac0ab950 0x7fe5ac15f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.714+0000 7fe5b1b91640 1 -- 172.21.15.44:0/1211420597 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5ac0ab950 msgr2=0x7fe5ac15f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.714+0000 7fe5b1b91640 1 --2- 172.21.15.44:0/1211420597 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5ac0ab950 0x7fe5ac15f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.714+0000 7fe5b1b91640 1 -- 172.21.15.44:0/1211420597 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5ac15cfd0 msgr2=0x7fe5ac15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.714+0000 7fe5b1b91640 1 --2- 172.21.15.44:0/1211420597 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5ac15cfd0 0x7fe5ac15a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.714+0000 7fe5b1b91640 1 -- 172.21.15.44:0/1211420597 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a40094d0 con 0x7fe5ac0cd570 2023-11-04T01:37:04.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.714+0000 7fe5b1b91640 1 --2- 172.21.15.44:0/1211420597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5ac0cd570 0x7fe5ac0ad3d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe5a402b950 tx=0x7fe5a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.714+0000 7fe5aa7fc640 1 -- 172.21.15.44:0/1211420597 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a403ad30 con 0x7fe5ac0cd570 2023-11-04T01:37:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.714+0000 7fe5aa7fc640 1 -- 172.21.15.44:0/1211420597 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a40443f0 con 0x7fe5ac0cd570 2023-11-04T01:37:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.714+0000 7fe5b3df5640 1 -- 172.21.15.44:0/1211420597 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ac0ac610 con 0x7fe5ac0cd570 2023-11-04T01:37:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.714+0000 7fe5aa7fc640 1 -- 172.21.15.44:0/1211420597 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a40447a0 con 0x7fe5ac0cd570 2023-11-04T01:37:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.714+0000 7fe5b3df5640 1 -- 172.21.15.44:0/1211420597 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ac0acbd0 con 0x7fe5ac0cd570 2023-11-04T01:37:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.715+0000 7fe5b3df5640 1 -- 172.21.15.44:0/1211420597 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ac06b300 con 0x7fe5ac0cd570 2023-11-04T01:37:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.715+0000 7fe5aa7fc640 1 -- 172.21.15.44:0/1211420597 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe5a404d450 con 0x7fe5ac0cd570 2023-11-04T01:37:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.716+0000 7fe5aa7fc640 1 --2- 172.21.15.44:0/1211420597 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe59806ae70 0x7fe59806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.716+0000 7fe5aa7fc640 1 -- 172.21.15.44:0/1211420597 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe5a402d040 con 0x7fe5ac0cd570 2023-11-04T01:37:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.716+0000 7fe5b1390640 1 --2- 172.21.15.44:0/1211420597 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe59806ae70 0x7fe59806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.716+0000 7fe5b1390640 1 --2- 172.21.15.44:0/1211420597 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe59806ae70 0x7fe59806d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0006fd0 tx=0x7fe5a0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:04.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.720+0000 7fe5aa7fc640 1 -- 172.21.15.44:0/1211420597 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe5a40b0070 con 0x7fe5ac0cd570 2023-11-04T01:37:04.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.894+0000 7fe5b3df5640 1 -- 172.21.15.44:0/1211420597 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe5ac0cdc20 con 0x7fe5ac0cd570 2023-11-04T01:37:04.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.895+0000 7fe5aa7fc640 1 -- 172.21.15.44:0/1211420597 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe5a40350a0 con 0x7fe5ac0cd570 2023-11-04T01:37:04.897 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:37:04.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.896+0000 7fe5b3df5640 1 -- 172.21.15.44:0/1211420597 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe59806ae70 msgr2=0x7fe59806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.896+0000 7fe5b3df5640 1 --2- 172.21.15.44:0/1211420597 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe59806ae70 0x7fe59806d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0006fd0 tx=0x7fe5a0008040 comp rx=0 tx=0).stop 2023-11-04T01:37:04.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.897+0000 7fe5b3df5640 1 -- 172.21.15.44:0/1211420597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5ac0cd570 msgr2=0x7fe5ac0ad3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.897+0000 7fe5b3df5640 1 --2- 172.21.15.44:0/1211420597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5ac0cd570 0x7fe5ac0ad3d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe5a402b950 tx=0x7fe5a40046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.897+0000 7fe5b3df5640 1 -- 172.21.15.44:0/1211420597 shutdown_connections 2023-11-04T01:37:04.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.897+0000 7fe5b3df5640 1 --2- 172.21.15.44:0/1211420597 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe59806ae70 0x7fe59806d330 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.897+0000 7fe5b3df5640 1 --2- 172.21.15.44:0/1211420597 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5ac0ab950 0x7fe5ac15f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.897+0000 7fe5b3df5640 1 --2- 172.21.15.44:0/1211420597 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5ac15cfd0 0x7fe5ac15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.897+0000 7fe5b3df5640 1 --2- 172.21.15.44:0/1211420597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5ac0cd570 0x7fe5ac0ad3d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.897+0000 7fe5b3df5640 1 -- 172.21.15.44:0/1211420597 >> 172.21.15.44:0/1211420597 conn(0x7fe5ac06ea20 msgr2=0x7fe5ac15c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:04.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.897+0000 7fe5b3df5640 1 -- 172.21.15.44:0/1211420597 shutdown_connections 2023-11-04T01:37:04.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:04.897+0000 7fe5b3df5640 1 -- 172.21.15.44:0/1211420597 wait complete. 2023-11-04T01:37:04.909 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:05.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.017+0000 7efd1d644640 1 Processor -- start 2023-11-04T01:37:05.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.017+0000 7efd1d644640 1 -- start start 2023-11-04T01:37:05.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.018+0000 7efd1d644640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efd181605b0 0x7efd180ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.018+0000 7efd1d644640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd1806a830 0x7efd180cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.018+0000 7efd1d644640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd18160990 con 0x7efd180b1a40 2023-11-04T01:37:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.018+0000 7efd1d644640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd180cc7c0 con 0x7efd181605b0 2023-11-04T01:37:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.018+0000 7efd1d644640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd180cd750 con 0x7efd1806a830 2023-11-04T01:37:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.018+0000 7efd177fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd1806a830 0x7efd180cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.018+0000 7efd16ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efd181605b0 0x7efd180ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.018+0000 7efd16ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efd181605b0 0x7efd180ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:53112/0 (socket says 172.21.15.44:53112) 2023-11-04T01:37:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.018+0000 7efd16ffd640 1 -- 172.21.15.44:0/3289654472 learned_addr learned my addr 172.21.15.44:0/3289654472 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.018+0000 7efd177fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd1806a830 0x7efd180cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:52604/0 (socket says 172.21.15.44:52604) 2023-11-04T01:37:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.019+0000 7efd16ffd640 1 -- 172.21.15.44:0/3289654472 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd1806a830 msgr2=0x7efd180cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.019+0000 7efd16ffd640 1 --2- 172.21.15.44:0/3289654472 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd1806a830 0x7efd180cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.019+0000 7efd16ffd640 1 -- 172.21.15.44:0/3289654472 >> v1:172.21.15.204:6789/0 conn(0x7efd180b1a40 legacy=0x7efd1806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.019+0000 7efd16ffd640 1 -- 172.21.15.44:0/3289654472 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd180cc4e0 con 0x7efd181605b0 2023-11-04T01:37:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.019+0000 7efd177fe640 1 --2- 172.21.15.44:0/3289654472 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd1806a830 0x7efd180cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:05.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.019+0000 7efd16ffd640 1 --2- 172.21.15.44:0/3289654472 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd181605b0 0x7efd180ccbc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efd08009870 tx=0x7efd0802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=719bc3e88c48577c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:05.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.020+0000 7efd15ffb640 1 -- 172.21.15.44:0/3289654472 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd080317c0 con 0x7efd181605b0 2023-11-04T01:37:05.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.020+0000 7efd15ffb640 1 -- 172.21.15.44:0/3289654472 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd08031920 con 0x7efd181605b0 2023-11-04T01:37:05.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.020+0000 7efd15ffb640 1 -- 172.21.15.44:0/3289654472 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd08031cb0 con 0x7efd181605b0 2023-11-04T01:37:05.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.020+0000 7efd1d644640 1 -- 172.21.15.44:0/3289654472 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd181605b0 msgr2=0x7efd180ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.020+0000 7efd1d644640 1 --2- 172.21.15.44:0/3289654472 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd181605b0 0x7efd180ccbc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efd08009870 tx=0x7efd0802b860 comp rx=0 tx=0).stop 2023-11-04T01:37:05.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.020+0000 7efd1d644640 1 -- 172.21.15.44:0/3289654472 shutdown_connections 2023-11-04T01:37:05.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.020+0000 7efd1d644640 1 --2- 172.21.15.44:0/3289654472 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd1806a830 0x7efd180cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.020+0000 7efd1d644640 1 --2- 172.21.15.44:0/3289654472 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd181605b0 0x7efd180ccbc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.020+0000 7efd1d644640 1 -- 172.21.15.44:0/3289654472 >> 172.21.15.44:0/3289654472 conn(0x7efd18071820 msgr2=0x7efd18071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:05.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.020+0000 7efd1d644640 1 -- 172.21.15.44:0/3289654472 shutdown_connections 2023-11-04T01:37:05.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.020+0000 7efd1d644640 1 -- 172.21.15.44:0/3289654472 wait complete. 2023-11-04T01:37:05.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.021+0000 7efd1d644640 1 Processor -- start 2023-11-04T01:37:05.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.021+0000 7efd1d644640 1 -- start start 2023-11-04T01:37:05.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.022+0000 7efd1d644640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd1806a830 0x7efd1815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.022+0000 7efd1d644640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd181605b0 0x7efd180c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.022+0000 7efd1d644640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd180acbd0 0x7efd1815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.022+0000 7efd1d644640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd180ab8e0 con 0x7efd180acbd0 2023-11-04T01:37:05.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.022+0000 7efd1d644640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd180abb30 con 0x7efd181605b0 2023-11-04T01:37:05.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.022+0000 7efd1d644640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd180abe10 con 0x7efd1806a830 2023-11-04T01:37:05.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.022+0000 7efd177fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd180acbd0 0x7efd1815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.022+0000 7efd177fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd180acbd0 0x7efd1815b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37610/0 (socket says 172.21.15.44:37610) 2023-11-04T01:37:05.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.022+0000 7efd177fe640 1 -- 172.21.15.44:0/4207083572 learned_addr learned my addr 172.21.15.44:0/4207083572 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:05.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.023+0000 7efd16ffd640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd1806a830 0x7efd1815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.023+0000 7efd167fc640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd181605b0 0x7efd180c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.023+0000 7efd177fe640 1 -- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd1806a830 msgr2=0x7efd1815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.023+0000 7efd177fe640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd1806a830 0x7efd1815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.023+0000 7efd177fe640 1 -- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd181605b0 msgr2=0x7efd180c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.023+0000 7efd177fe640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd181605b0 0x7efd180c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.023+0000 7efd177fe640 1 -- 172.21.15.44:0/4207083572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd10009a70 con 0x7efd180acbd0 2023-11-04T01:37:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.023+0000 7efd16ffd640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd1806a830 0x7efd1815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.023+0000 7efd167fc640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd181605b0 0x7efd180c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.023+0000 7efd177fe640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd180acbd0 0x7efd1815b3c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efd1000efb0 tx=0x7efd1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.023+0000 7efcff7fe640 1 -- 172.21.15.44:0/4207083572 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd10014480 con 0x7efd180acbd0 2023-11-04T01:37:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.023+0000 7efcff7fe640 1 -- 172.21.15.44:0/4207083572 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1000f040 con 0x7efd180acbd0 2023-11-04T01:37:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.023+0000 7efd1d644640 1 -- 172.21.15.44:0/4207083572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd080094d0 con 0x7efd180acbd0 2023-11-04T01:37:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.023+0000 7efcff7fe640 1 -- 172.21.15.44:0/4207083572 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd10014800 con 0x7efd180acbd0 2023-11-04T01:37:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.023+0000 7efd1d644640 1 -- 172.21.15.44:0/4207083572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd180ac3d0 con 0x7efd180acbd0 2023-11-04T01:37:05.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.024+0000 7efd1d644640 1 -- 172.21.15.44:0/4207083572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd180672a0 con 0x7efd180acbd0 2023-11-04T01:37:05.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.025+0000 7efcff7fe640 1 -- 172.21.15.44:0/4207083572 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd10014960 con 0x7efd180acbd0 2023-11-04T01:37:05.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.025+0000 7efcff7fe640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efd0406ae70 0x7efd0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.025+0000 7efcff7fe640 1 -- 172.21.15.44:0/4207083572 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efd1008a9f0 con 0x7efd180acbd0 2023-11-04T01:37:05.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.025+0000 7efd16ffd640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efd0406ae70 0x7efd0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.026+0000 7efd16ffd640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efd0406ae70 0x7efd0406d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efd08036000 tx=0x7efd0803d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:05.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.029+0000 7efcff7fe640 1 -- 172.21.15.44:0/4207083572 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efd100556e0 con 0x7efd180acbd0 2023-11-04T01:37:05.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.206+0000 7efd1d644640 1 -- 172.21.15.44:0/4207083572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd18074290 con 0x7efd180acbd0 2023-11-04T01:37:05.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.206+0000 7efcff7fe640 1 -- 172.21.15.44:0/4207083572 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd100180a0 con 0x7efd180acbd0 2023-11-04T01:37:05.209 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:37:05.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.208+0000 7efd1d644640 1 -- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efd0406ae70 msgr2=0x7efd0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.208+0000 7efd1d644640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efd0406ae70 0x7efd0406d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efd08036000 tx=0x7efd0803d040 comp rx=0 tx=0).stop 2023-11-04T01:37:05.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.208+0000 7efd1d644640 1 -- 172.21.15.44:0/4207083572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd180acbd0 msgr2=0x7efd1815b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.208+0000 7efd1d644640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd180acbd0 0x7efd1815b3c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efd1000efb0 tx=0x7efd1000c490 comp rx=0 tx=0).stop 2023-11-04T01:37:05.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.208+0000 7efd1d644640 1 -- 172.21.15.44:0/4207083572 shutdown_connections 2023-11-04T01:37:05.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.208+0000 7efd1d644640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efd0406ae70 0x7efd0406d330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.208+0000 7efd1d644640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd180acbd0 0x7efd1815b3c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.208+0000 7efd1d644640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd181605b0 0x7efd180c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.208+0000 7efd1d644640 1 --2- 172.21.15.44:0/4207083572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd1806a830 0x7efd1815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.208+0000 7efd1d644640 1 -- 172.21.15.44:0/4207083572 >> 172.21.15.44:0/4207083572 conn(0x7efd18071820 msgr2=0x7efd180cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:05.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.208+0000 7efd1d644640 1 -- 172.21.15.44:0/4207083572 shutdown_connections 2023-11-04T01:37:05.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.208+0000 7efd1d644640 1 -- 172.21.15.44:0/4207083572 wait complete. 2023-11-04T01:37:05.221 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:05.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.328+0000 7fec70d90640 1 Processor -- start 2023-11-04T01:37:05.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.328+0000 7fec70d90640 1 -- start start 2023-11-04T01:37:05.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.329+0000 7fec70d90640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec6c0cd6d0 0x7fec6c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.329+0000 7fec70d90640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fec6c0b4880 0x7fec6c0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.329+0000 7fec70d90640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6c0cde60 con 0x7fec6c153e60 2023-11-04T01:37:05.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.329+0000 7fec70d90640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec6c160f90 con 0x7fec6c0b4880 2023-11-04T01:37:05.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.329+0000 7fec70d90640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0b51e0 con 0x7fec6c0cd6d0 2023-11-04T01:37:05.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.329+0000 7fec6ad9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fec6c0b4880 0x7fec6c0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.329+0000 7fec6a59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fec6c153e60 0x7fec6c15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49100/0 (socket says 172.21.15.44:49100) 2023-11-04T01:37:05.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.329+0000 7fec6a59c640 1 -- 172.21.15.44:0/187533567 learned_addr learned my addr 172.21.15.44:0/187533567 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:05.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.329+0000 7fec69d9b640 1 --2- 172.21.15.44:0/187533567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec6c0cd6d0 0x7fec6c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.330+0000 7fec6ad9d640 1 -- 172.21.15.44:0/187533567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec6c0cd6d0 msgr2=0x7fec6c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:05.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.330+0000 7fec6ad9d640 1 --2- 172.21.15.44:0/187533567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec6c0cd6d0 0x7fec6c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.330+0000 7fec6ad9d640 1 -- 172.21.15.44:0/187533567 >> v1:172.21.15.44:6789/0 conn(0x7fec6c153e60 legacy=0x7fec6c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.330+0000 7fec6959a640 1 -- 172.21.15.44:0/187533567 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285746476 0 0) 0x7fec6c0cde60 con 0x7fec6c153e60 2023-11-04T01:37:05.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.330+0000 7fec6ad9d640 1 -- 172.21.15.44:0/187533567 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c161960 con 0x7fec6c0b4880 2023-11-04T01:37:05.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.330+0000 7fec69d9b640 1 --2- 172.21.15.44:0/187533567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec6c0cd6d0 0x7fec6c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:05.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.330+0000 7fec6ad9d640 1 --2- 172.21.15.44:0/187533567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec6c0b4880 0x7fec6c0b4ca0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009d90 tx=0x7fec5c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a3eee046a0432b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:05.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.330+0000 7fec6959a640 1 -- 172.21.15.44:0/187533567 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c02cc50 con 0x7fec6c0b4880 2023-11-04T01:37:05.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.331+0000 7fec6959a640 1 -- 172.21.15.44:0/187533567 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c02cdb0 con 0x7fec6c0b4880 2023-11-04T01:37:05.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.331+0000 7fec6959a640 1 -- 172.21.15.44:0/187533567 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c034660 con 0x7fec6c0b4880 2023-11-04T01:37:05.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.331+0000 7fec70d90640 1 -- 172.21.15.44:0/187533567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec6c0b4880 msgr2=0x7fec6c0b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.331+0000 7fec70d90640 1 --2- 172.21.15.44:0/187533567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec6c0b4880 0x7fec6c0b4ca0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009d90 tx=0x7fec5c02bea0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.331+0000 7fec70d90640 1 -- 172.21.15.44:0/187533567 shutdown_connections 2023-11-04T01:37:05.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.331+0000 7fec70d90640 1 --2- 172.21.15.44:0/187533567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec6c0b4880 0x7fec6c0b4ca0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.331+0000 7fec70d90640 1 --2- 172.21.15.44:0/187533567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec6c0cd6d0 0x7fec6c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.331+0000 7fec70d90640 1 -- 172.21.15.44:0/187533567 >> 172.21.15.44:0/187533567 conn(0x7fec6c0cf880 msgr2=0x7fec6c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:05.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.331+0000 7fec70d90640 1 -- 172.21.15.44:0/187533567 shutdown_connections 2023-11-04T01:37:05.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.331+0000 7fec70d90640 1 -- 172.21.15.44:0/187533567 wait complete. 2023-11-04T01:37:05.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.332+0000 7fec70d90640 1 Processor -- start 2023-11-04T01:37:05.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.333+0000 7fec70d90640 1 -- start start 2023-11-04T01:37:05.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.333+0000 7fec70d90640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec6c0b4880 0x7fec6c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.333+0000 7fec70d90640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec6c0cd6d0 0x7fec6c0c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.333+0000 7fec70d90640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec6c153e60 0x7fec6c0c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.333+0000 7fec70d90640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c1f6500 con 0x7fec6c153e60 2023-11-04T01:37:05.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.333+0000 7fec70d90640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0c8a10 con 0x7fec6c0b4880 2023-11-04T01:37:05.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.333+0000 7fec70d90640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0c8730 con 0x7fec6c0cd6d0 2023-11-04T01:37:05.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.333+0000 7fec6ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec6c153e60 0x7fec6c0c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.333+0000 7fec6ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec6c153e60 0x7fec6c0c8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37620/0 (socket says 172.21.15.44:37620) 2023-11-04T01:37:05.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.333+0000 7fec6ad9d640 1 -- 172.21.15.44:0/3349674053 learned_addr learned my addr 172.21.15.44:0/3349674053 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:05.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.334+0000 7fec69d9b640 1 --2- 172.21.15.44:0/3349674053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec6c0cd6d0 0x7fec6c0c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.334+0000 7fec6a59c640 1 --2- 172.21.15.44:0/3349674053 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec6c0b4880 0x7fec6c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.334+0000 7fec6ad9d640 1 -- 172.21.15.44:0/3349674053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec6c0cd6d0 msgr2=0x7fec6c0c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.334+0000 7fec6ad9d640 1 --2- 172.21.15.44:0/3349674053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec6c0cd6d0 0x7fec6c0c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.334+0000 7fec6ad9d640 1 -- 172.21.15.44:0/3349674053 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec6c0b4880 msgr2=0x7fec6c0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.334+0000 7fec6ad9d640 1 --2- 172.21.15.44:0/3349674053 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec6c0b4880 0x7fec6c0ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.334+0000 7fec6ad9d640 1 -- 172.21.15.44:0/3349674053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c009a70 con 0x7fec6c153e60 2023-11-04T01:37:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.334+0000 7fec6a59c640 1 --2- 172.21.15.44:0/3349674053 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec6c0b4880 0x7fec6c0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.334+0000 7fec6ad9d640 1 --2- 172.21.15.44:0/3349674053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec6c153e60 0x7fec6c0c8de0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009d90 tx=0x7fec5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.334+0000 7fec62ffd640 1 -- 172.21.15.44:0/3349674053 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c040650 con 0x7fec6c153e60 2023-11-04T01:37:05.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.334+0000 7fec62ffd640 1 -- 172.21.15.44:0/3349674053 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c0407d0 con 0x7fec6c153e60 2023-11-04T01:37:05.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.334+0000 7fec70d90640 1 -- 172.21.15.44:0/3349674053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6c1f5e40 con 0x7fec6c153e60 2023-11-04T01:37:05.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.334+0000 7fec62ffd640 1 -- 172.21.15.44:0/3349674053 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c040b80 con 0x7fec6c153e60 2023-11-04T01:37:05.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.334+0000 7fec70d90640 1 -- 172.21.15.44:0/3349674053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c0c8420 con 0x7fec6c153e60 2023-11-04T01:37:05.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.335+0000 7fec70d90640 1 -- 172.21.15.44:0/3349674053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6c074290 con 0x7fec6c153e60 2023-11-04T01:37:05.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.336+0000 7fec62ffd640 1 -- 172.21.15.44:0/3349674053 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fec5c040ce0 con 0x7fec6c153e60 2023-11-04T01:37:05.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.336+0000 7fec62ffd640 1 --2- 172.21.15.44:0/3349674053 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fec4c06ae70 0x7fec4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.336+0000 7fec62ffd640 1 -- 172.21.15.44:0/3349674053 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fec5c0ac630 con 0x7fec6c153e60 2023-11-04T01:37:05.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.336+0000 7fec6a59c640 1 --2- 172.21.15.44:0/3349674053 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fec4c06ae70 0x7fec4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.337+0000 7fec6a59c640 1 --2- 172.21.15.44:0/3349674053 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fec4c06ae70 0x7fec4c06d330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fec64000f60 tx=0x7fec64007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:05.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.340+0000 7fec62ffd640 1 -- 172.21.15.44:0/3349674053 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fec5c0773b0 con 0x7fec6c153e60 2023-11-04T01:37:05.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.515+0000 7fec70d90640 1 -- 172.21.15.44:0/3349674053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fec6c0d1340 con 0x7fec6c153e60 2023-11-04T01:37:05.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.516+0000 7fec62ffd640 1 -- 172.21.15.44:0/3349674053 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fec5c07a9d0 con 0x7fec6c153e60 2023-11-04T01:37:05.518 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:37:05.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.518+0000 7fec70d90640 1 -- 172.21.15.44:0/3349674053 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fec4c06ae70 msgr2=0x7fec4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.518+0000 7fec70d90640 1 --2- 172.21.15.44:0/3349674053 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fec4c06ae70 0x7fec4c06d330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fec64000f60 tx=0x7fec64007ca0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.518+0000 7fec70d90640 1 -- 172.21.15.44:0/3349674053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec6c153e60 msgr2=0x7fec6c0c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.518+0000 7fec70d90640 1 --2- 172.21.15.44:0/3349674053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec6c153e60 0x7fec6c0c8de0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009d90 tx=0x7fec5c004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:05.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.518+0000 7fec70d90640 1 -- 172.21.15.44:0/3349674053 shutdown_connections 2023-11-04T01:37:05.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.518+0000 7fec70d90640 1 --2- 172.21.15.44:0/3349674053 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fec4c06ae70 0x7fec4c06d330 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.518+0000 7fec70d90640 1 --2- 172.21.15.44:0/3349674053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec6c153e60 0x7fec6c0c8de0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.518+0000 7fec70d90640 1 --2- 172.21.15.44:0/3349674053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec6c0cd6d0 0x7fec6c0c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.518+0000 7fec70d90640 1 --2- 172.21.15.44:0/3349674053 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec6c0b4880 0x7fec6c0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.518+0000 7fec70d90640 1 -- 172.21.15.44:0/3349674053 >> 172.21.15.44:0/3349674053 conn(0x7fec6c0cf880 msgr2=0x7fec6c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:05.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.518+0000 7fec70d90640 1 -- 172.21.15.44:0/3349674053 shutdown_connections 2023-11-04T01:37:05.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.518+0000 7fec70d90640 1 -- 172.21.15.44:0/3349674053 wait complete. 2023-11-04T01:37:05.531 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:37:05.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.637+0000 7f2476b61640 1 Processor -- start 2023-11-04T01:37:05.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.637+0000 7f2476b61640 1 -- start start 2023-11-04T01:37:05.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.638+0000 7f2476b61640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2470153e60 0x7f247015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.638+0000 7f2476b61640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f24700cd6d0 0x7f2470161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.638+0000 7f2476b61640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24700cde60 con 0x7f24700b4880 2023-11-04T01:37:05.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.638+0000 7f2476b61640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2470160f90 con 0x7f2470153e60 2023-11-04T01:37:05.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.638+0000 7f2476b61640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247015e400 con 0x7f24700cd6d0 2023-11-04T01:37:05.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.638+0000 7f24748fd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2470153e60 0x7f247015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.638+0000 7f24748fd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2470153e60 0x7f247015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37632/0 (socket says 172.21.15.44:37632) 2023-11-04T01:37:05.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.638+0000 7f24748fd640 1 -- 172.21.15.44:0/2044454651 learned_addr learned my addr 172.21.15.44:0/2044454651 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:05.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.638+0000 7f24750fe640 1 --1- 172.21.15.44:0/2044454651 >> v1:172.21.15.44:6789/0 conn(0x7f24700b4880 0x7f24700b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49116/0 (socket says 172.21.15.44:49116) 2023-11-04T01:37:05.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.639+0000 7f246ffff640 1 --2- 172.21.15.44:0/2044454651 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f24700cd6d0 0x7f2470161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.639+0000 7f24748fd640 1 -- 172.21.15.44:0/2044454651 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f24700cd6d0 msgr2=0x7f2470161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:05.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.639+0000 7f24748fd640 1 --2- 172.21.15.44:0/2044454651 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f24700cd6d0 0x7f2470161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.639+0000 7f24748fd640 1 -- 172.21.15.44:0/2044454651 >> v1:172.21.15.44:6789/0 conn(0x7f24700b4880 legacy=0x7f24700b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.639+0000 7f24748fd640 1 -- 172.21.15.44:0/2044454651 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2470161960 con 0x7f2470153e60 2023-11-04T01:37:05.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.639+0000 7f246f7fe640 1 -- 172.21.15.44:0/2044454651 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573249306 0 0) 0x7f24700cde60 con 0x7f24700b4880 2023-11-04T01:37:05.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.639+0000 7f24748fd640 1 --2- 172.21.15.44:0/2044454651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2470153e60 0x7f247015dec0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2468009e50 tx=0x7f246802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6654c5d0f831df server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:05.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.640+0000 7f246f7fe640 1 -- 172.21.15.44:0/2044454651 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246802cb00 con 0x7f2470153e60 2023-11-04T01:37:05.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.640+0000 7f246f7fe640 1 -- 172.21.15.44:0/2044454651 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246802cc60 con 0x7f2470153e60 2023-11-04T01:37:05.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.640+0000 7f246f7fe640 1 -- 172.21.15.44:0/2044454651 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24680343f0 con 0x7f2470153e60 2023-11-04T01:37:05.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.640+0000 7f2476b61640 1 -- 172.21.15.44:0/2044454651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2470153e60 msgr2=0x7f247015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.640+0000 7f2476b61640 1 --2- 172.21.15.44:0/2044454651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2470153e60 0x7f247015dec0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2468009e50 tx=0x7f246802bf60 comp rx=0 tx=0).stop 2023-11-04T01:37:05.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.640+0000 7f2476b61640 1 -- 172.21.15.44:0/2044454651 shutdown_connections 2023-11-04T01:37:05.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.640+0000 7f2476b61640 1 --2- 172.21.15.44:0/2044454651 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f24700cd6d0 0x7f2470161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.640+0000 7f2476b61640 1 --2- 172.21.15.44:0/2044454651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2470153e60 0x7f247015dec0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.640+0000 7f2476b61640 1 -- 172.21.15.44:0/2044454651 >> 172.21.15.44:0/2044454651 conn(0x7f24700cf880 msgr2=0x7f24700cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:05.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.640+0000 7f2476b61640 1 -- 172.21.15.44:0/2044454651 shutdown_connections 2023-11-04T01:37:05.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.640+0000 7f2476b61640 1 -- 172.21.15.44:0/2044454651 wait complete. 2023-11-04T01:37:05.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.641+0000 7f2476b61640 1 Processor -- start 2023-11-04T01:37:05.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.641+0000 7f2476b61640 1 -- start start 2023-11-04T01:37:05.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.642+0000 7f2476b61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24700b4880 0x7f24700c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.642+0000 7f2476b61640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f24700cd6d0 0x7f24700d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.642+0000 7f2476b61640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2470153e60 0x7f24700d3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.642+0000 7f2476b61640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700c8f10 con 0x7f24700b4880 2023-11-04T01:37:05.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.642+0000 7f2476b61640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700c8300 con 0x7f24700cd6d0 2023-11-04T01:37:05.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.642+0000 7f2476b61640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24700c85e0 con 0x7f2470153e60 2023-11-04T01:37:05.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.642+0000 7f24748fd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24700b4880 0x7f24700c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.642+0000 7f24748fd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24700b4880 0x7f24700c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37634/0 (socket says 172.21.15.44:37634) 2023-11-04T01:37:05.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.642+0000 7f24748fd640 1 -- 172.21.15.44:0/2035619898 learned_addr learned my addr 172.21.15.44:0/2035619898 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:05.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.643+0000 7f246ffff640 1 --2- 172.21.15.44:0/2035619898 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f24700cd6d0 0x7f24700d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.643+0000 7f24750fe640 1 --2- 172.21.15.44:0/2035619898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2470153e60 0x7f24700d3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.643+0000 7f24748fd640 1 -- 172.21.15.44:0/2035619898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2470153e60 msgr2=0x7f24700d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.643+0000 7f24748fd640 1 --2- 172.21.15.44:0/2035619898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2470153e60 0x7f24700d3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.643+0000 7f24748fd640 1 -- 172.21.15.44:0/2035619898 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f24700cd6d0 msgr2=0x7f24700d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.643+0000 7f24748fd640 1 --2- 172.21.15.44:0/2035619898 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f24700cd6d0 0x7f24700d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.643+0000 7f24748fd640 1 -- 172.21.15.44:0/2035619898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2468009b30 con 0x7f24700b4880 2023-11-04T01:37:05.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.643+0000 7f24750fe640 1 --2- 172.21.15.44:0/2035619898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2470153e60 0x7f24700d3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:05.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.643+0000 7f24748fd640 1 --2- 172.21.15.44:0/2035619898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24700b4880 0x7f24700c7940 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2468036040 tx=0x7f2468004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:05.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.643+0000 7f246d7fa640 1 -- 172.21.15.44:0/2035619898 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468009510 con 0x7f24700b4880 2023-11-04T01:37:05.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.643+0000 7f246d7fa640 1 -- 172.21.15.44:0/2035619898 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246803e450 con 0x7f24700b4880 2023-11-04T01:37:05.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.643+0000 7f2476b61640 1 -- 172.21.15.44:0/2035619898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24700c88c0 con 0x7f24700b4880 2023-11-04T01:37:05.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.643+0000 7f246d7fa640 1 -- 172.21.15.44:0/2035619898 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246803e800 con 0x7f24700b4880 2023-11-04T01:37:05.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.643+0000 7f2476b61640 1 -- 172.21.15.44:0/2035619898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24701f5e10 con 0x7f24700b4880 2023-11-04T01:37:05.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.644+0000 7f2476b61640 1 -- 172.21.15.44:0/2035619898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2470074290 con 0x7f24700b4880 2023-11-04T01:37:05.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.645+0000 7f246d7fa640 1 -- 172.21.15.44:0/2035619898 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f246803e960 con 0x7f24700b4880 2023-11-04T01:37:05.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.645+0000 7f246d7fa640 1 --2- 172.21.15.44:0/2035619898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f245006ae70 0x7f245006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.645+0000 7f246d7fa640 1 -- 172.21.15.44:0/2035619898 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f24680ac700 con 0x7f24700b4880 2023-11-04T01:37:05.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.645+0000 7f246ffff640 1 --2- 172.21.15.44:0/2035619898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f245006ae70 0x7f245006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.646+0000 7f246ffff640 1 --2- 172.21.15.44:0/2035619898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f245006ae70 0x7f245006d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2470153490 tx=0x7f2458008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:05.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.649+0000 7f246d7fa640 1 -- 172.21.15.44:0/2035619898 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2468077530 con 0x7f24700b4880 2023-11-04T01:37:05.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.839+0000 7f2476b61640 1 -- 172.21.15.44:0/2035619898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f24700d0b80 con 0x7f24700b4880 2023-11-04T01:37:05.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.840+0000 7f246d7fa640 1 -- 172.21.15.44:0/2035619898 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f246807ab50 con 0x7f24700b4880 2023-11-04T01:37:05.842 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2023-11-04T01:37:05.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.842+0000 7f2476b61640 1 -- 172.21.15.44:0/2035619898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f245006ae70 msgr2=0x7f245006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.842+0000 7f2476b61640 1 --2- 172.21.15.44:0/2035619898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f245006ae70 0x7f245006d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2470153490 tx=0x7f2458008040 comp rx=0 tx=0).stop 2023-11-04T01:37:05.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.842+0000 7f2476b61640 1 -- 172.21.15.44:0/2035619898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24700b4880 msgr2=0x7f24700c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.842+0000 7f2476b61640 1 --2- 172.21.15.44:0/2035619898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24700b4880 0x7f24700c7940 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2468036040 tx=0x7f2468004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:05.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.842+0000 7f2476b61640 1 -- 172.21.15.44:0/2035619898 shutdown_connections 2023-11-04T01:37:05.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.842+0000 7f2476b61640 1 --2- 172.21.15.44:0/2035619898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f245006ae70 0x7f245006d330 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.842+0000 7f2476b61640 1 --2- 172.21.15.44:0/2035619898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2470153e60 0x7f24700d3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.842+0000 7f2476b61640 1 --2- 172.21.15.44:0/2035619898 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f24700cd6d0 0x7f24700d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.842+0000 7f2476b61640 1 --2- 172.21.15.44:0/2035619898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24700b4880 0x7f24700c7940 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.842+0000 7f2476b61640 1 -- 172.21.15.44:0/2035619898 >> 172.21.15.44:0/2035619898 conn(0x7f24700cf880 msgr2=0x7f24700cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:05.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.842+0000 7f2476b61640 1 -- 172.21.15.44:0/2035619898 shutdown_connections 2023-11-04T01:37:05.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:05.842+0000 7f2476b61640 1 -- 172.21.15.44:0/2035619898 wait complete. 2023-11-04T01:37:05.855 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi204.front.sepia.ceph.com... 2023-11-04T01:37:05.855 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:05.855 DEBUG:teuthology.orchestra.run.smithi204:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-04T01:37:05.924 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:37:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:05.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi204.stderr:ceph-fuse[125064]: fuse finished with error 0 and tester_r 0 2023-11-04T01:37:05.925 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-04T01:37:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:05.930 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi204.stderr:2023-11-04T01:37:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:05.934 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:05.939 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:37:05.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:05.940 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:37:05.995 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:37:05.996 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.101+0000 7fb723f5e640 1 Processor -- start 2023-11-04T01:37:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.101+0000 7fb723f5e640 1 -- start start 2023-11-04T01:37:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.102+0000 7fb723f5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb71c160b10 0x7fb71c160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.102+0000 7fb723f5e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb71c0cf160 0x7fb71c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.102+0000 7fb723f5e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c06bf00 con 0x7fb71c15ce60 2023-11-04T01:37:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.102+0000 7fb723f5e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71c0cbde0 con 0x7fb71c0cf160 2023-11-04T01:37:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.102+0000 7fb723f5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0cfb30 con 0x7fb71c160b10 2023-11-04T01:37:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.102+0000 7fb7224fb640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb71c0cf160 0x7fb71c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.102+0000 7fb7224fb640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb71c0cf160 0x7fb71c0cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37648/0 (socket says 172.21.15.44:37648) 2023-11-04T01:37:06.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.102+0000 7fb7224fb640 1 -- 172.21.15.44:0/3000662914 learned_addr learned my addr 172.21.15.44:0/3000662914 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:06.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.102+0000 7fb7214f9640 1 --2- 172.21.15.44:0/3000662914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb71c160b10 0x7fb71c160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.102+0000 7fb7224fb640 1 -- 172.21.15.44:0/3000662914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb71c160b10 msgr2=0x7fb71c160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:06.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.102+0000 7fb7224fb640 1 --2- 172.21.15.44:0/3000662914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb71c160b10 0x7fb71c160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.102+0000 7fb7224fb640 1 -- 172.21.15.44:0/3000662914 >> v1:172.21.15.204:6789/0 conn(0x7fb71c15ce60 legacy=0x7fb71c06b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.102+0000 7fb7224fb640 1 -- 172.21.15.44:0/3000662914 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c1615d0 con 0x7fb71c0cf160 2023-11-04T01:37:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.103+0000 7fb7224fb640 1 --2- 172.21.15.44:0/3000662914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cf160 0x7fb71c0cf5f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb714009e50 tx=0x7fb71402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef0142f0bbdfbdf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.103+0000 7fb720cf8640 1 -- 172.21.15.44:0/3000662914 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71402cb00 con 0x7fb71c0cf160 2023-11-04T01:37:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.103+0000 7fb720cf8640 1 -- 172.21.15.44:0/3000662914 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71402cc60 con 0x7fb71c0cf160 2023-11-04T01:37:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.103+0000 7fb720cf8640 1 -- 172.21.15.44:0/3000662914 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7140343f0 con 0x7fb71c0cf160 2023-11-04T01:37:06.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.104+0000 7fb723f5e640 1 -- 172.21.15.44:0/3000662914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cf160 msgr2=0x7fb71c0cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.104+0000 7fb723f5e640 1 --2- 172.21.15.44:0/3000662914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cf160 0x7fb71c0cf5f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb714009e50 tx=0x7fb71402bf60 comp rx=0 tx=0).stop 2023-11-04T01:37:06.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.104+0000 7fb723f5e640 1 -- 172.21.15.44:0/3000662914 shutdown_connections 2023-11-04T01:37:06.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.104+0000 7fb723f5e640 1 --2- 172.21.15.44:0/3000662914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cf160 0x7fb71c0cf5f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.104+0000 7fb723f5e640 1 --2- 172.21.15.44:0/3000662914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb71c160b10 0x7fb71c160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.104+0000 7fb723f5e640 1 -- 172.21.15.44:0/3000662914 >> 172.21.15.44:0/3000662914 conn(0x7fb71c06ea90 msgr2=0x7fb71c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:06.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.104+0000 7fb723f5e640 1 -- 172.21.15.44:0/3000662914 shutdown_connections 2023-11-04T01:37:06.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.104+0000 7fb723f5e640 1 -- 172.21.15.44:0/3000662914 wait complete. 2023-11-04T01:37:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.105+0000 7fb723f5e640 1 Processor -- start 2023-11-04T01:37:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.105+0000 7fb723f5e640 1 -- start start 2023-11-04T01:37:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb723f5e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cf160 0x7fb71c0c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb723f5e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb71c15ce60 0x7fb71c15d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb723f5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb71c160b10 0x7fb71c151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb723f5e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c15dc40 con 0x7fb71c0cf160 2023-11-04T01:37:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb723f5e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c15de70 con 0x7fb71c15ce60 2023-11-04T01:37:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb723f5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c15e150 con 0x7fb71c160b10 2023-11-04T01:37:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb721cfa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cf160 0x7fb71c0c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb721cfa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cf160 0x7fb71c0c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37654/0 (socket says 172.21.15.44:37654) 2023-11-04T01:37:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb721cfa640 1 -- 172.21.15.44:0/3527070158 learned_addr learned my addr 172.21.15.44:0/3527070158 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb7224fb640 1 --2- 172.21.15.44:0/3527070158 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb71c160b10 0x7fb71c151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb7214f9640 1 --2- 172.21.15.44:0/3527070158 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb71c15ce60 0x7fb71c15d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb721cfa640 1 -- 172.21.15.44:0/3527070158 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb71c160b10 msgr2=0x7fb71c151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb721cfa640 1 --2- 172.21.15.44:0/3527070158 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb71c160b10 0x7fb71c151040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb721cfa640 1 -- 172.21.15.44:0/3527070158 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb71c15ce60 msgr2=0x7fb71c15d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb721cfa640 1 --2- 172.21.15.44:0/3527070158 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb71c15ce60 0x7fb71c15d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb721cfa640 1 -- 172.21.15.44:0/3527070158 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb714009b30 con 0x7fb71c0cf160 2023-11-04T01:37:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb721cfa640 1 --2- 172.21.15.44:0/3527070158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cf160 0x7fb71c0c91e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb71800c400 tx=0x7fb71800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.106+0000 7fb7127fc640 1 -- 172.21.15.44:0/3527070158 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7180052d0 con 0x7fb71c0cf160 2023-11-04T01:37:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.107+0000 7fb7127fc640 1 -- 172.21.15.44:0/3527070158 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb718005430 con 0x7fb71c0cf160 2023-11-04T01:37:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.107+0000 7fb723f5e640 1 -- 172.21.15.44:0/3527070158 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71c15e430 con 0x7fb71c0cf160 2023-11-04T01:37:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.107+0000 7fb7127fc640 1 -- 172.21.15.44:0/3527070158 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718003830 con 0x7fb71c0cf160 2023-11-04T01:37:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.107+0000 7fb723f5e640 1 -- 172.21.15.44:0/3527070158 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71c15e9f0 con 0x7fb71c0cf160 2023-11-04T01:37:06.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.108+0000 7fb723f5e640 1 -- 172.21.15.44:0/3527070158 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c15ec10 con 0x7fb71c0cf160 2023-11-04T01:37:06.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.108+0000 7fb7127fc640 1 -- 172.21.15.44:0/3527070158 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb718003990 con 0x7fb71c0cf160 2023-11-04T01:37:06.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.108+0000 7fb7127fc640 1 --2- 172.21.15.44:0/3527070158 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb70006ae70 0x7fb70006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.108+0000 7fb7127fc640 1 -- 172.21.15.44:0/3527070158 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb718088f50 con 0x7fb71c0cf160 2023-11-04T01:37:06.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.108+0000 7fb7214f9640 1 --2- 172.21.15.44:0/3527070158 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb70006ae70 0x7fb70006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.109+0000 7fb7214f9640 1 --2- 172.21.15.44:0/3527070158 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb70006ae70 0x7fb70006d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb70c006fd0 tx=0x7fb70c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:06.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.112+0000 7fb7127fc640 1 -- 172.21.15.44:0/3527070158 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb718053c40 con 0x7fb71c0cf160 2023-11-04T01:37:06.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.325+0000 7fb723f5e640 1 -- 172.21.15.44:0/3527070158 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb71c074290 con 0x7fb71c0cf160 2023-11-04T01:37:06.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.326+0000 7fb7127fc640 1 -- 172.21.15.44:0/3527070158 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fb718017090 con 0x7fb71c0cf160 2023-11-04T01:37:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:06.328 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2760874964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2760874964},{"type":"v1","addr":"172.21.15.204:6836","nonce":2760874964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3427243577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3427243577},{"type":"v1","addr":"172.21.15.44:6833","nonce":3427243577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/178191500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":178191500},{"type":"v1","addr":"172.21.15.204:6837","nonce":178191500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:58.556492+0000","modified":"2023-11-04T01:36:15.592459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/240936603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":240936603},{"type":"v1","addr":"172.21.15.44:6835","nonce":240936603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:37:06.328 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2023-11-04T01:37:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.327+0000 7fb723f5e640 1 -- 172.21.15.44:0/3527070158 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb70006ae70 msgr2=0x7fb70006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.327+0000 7fb723f5e640 1 --2- 172.21.15.44:0/3527070158 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb70006ae70 0x7fb70006d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb70c006fd0 tx=0x7fb70c008040 comp rx=0 tx=0).stop 2023-11-04T01:37:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.327+0000 7fb723f5e640 1 -- 172.21.15.44:0/3527070158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cf160 msgr2=0x7fb71c0c91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.327+0000 7fb723f5e640 1 --2- 172.21.15.44:0/3527070158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cf160 0x7fb71c0c91e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb71800c400 tx=0x7fb71800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.328+0000 7fb723f5e640 1 -- 172.21.15.44:0/3527070158 shutdown_connections 2023-11-04T01:37:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.328+0000 7fb723f5e640 1 --2- 172.21.15.44:0/3527070158 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb70006ae70 0x7fb70006d330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.328+0000 7fb723f5e640 1 --2- 172.21.15.44:0/3527070158 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb71c160b10 0x7fb71c151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.328+0000 7fb723f5e640 1 --2- 172.21.15.44:0/3527070158 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb71c15ce60 0x7fb71c15d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.328+0000 7fb723f5e640 1 --2- 172.21.15.44:0/3527070158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cf160 0x7fb71c0c91e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.328+0000 7fb723f5e640 1 -- 172.21.15.44:0/3527070158 >> 172.21.15.44:0/3527070158 conn(0x7fb71c06ea90 msgr2=0x7fb71c0cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:06.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.328+0000 7fb723f5e640 1 -- 172.21.15.44:0/3527070158 shutdown_connections 2023-11-04T01:37:06.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.328+0000 7fb723f5e640 1 -- 172.21.15.44:0/3527070158 wait complete. 2023-11-04T01:37:06.342 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.447+0000 7fd8847c9640 1 Processor -- start 2023-11-04T01:37:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.447+0000 7fd8847c9640 1 -- start start 2023-11-04T01:37:06.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.448+0000 7fd8847c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd87c0cde60 0x7fd87c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.448+0000 7fd8847c9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c15e000 con 0x7fd87c0ce240 2023-11-04T01:37:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.448+0000 7fd8847c9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c15e2e0 con 0x7fd87c15daa0 2023-11-04T01:37:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.448+0000 7fd8847c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c15e5c0 con 0x7fd87c0cde60 2023-11-04T01:37:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.448+0000 7fd882d66640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd87c0ce240 0x7fd87c0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49122/0 (socket says 172.21.15.44:49122) 2023-11-04T01:37:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.448+0000 7fd882d66640 1 -- 172.21.15.44:0/92228258 learned_addr learned my addr 172.21.15.44:0/92228258 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.448+0000 7fd882565640 1 --2- 172.21.15.44:0/92228258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd87c0cde60 0x7fd87c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.448+0000 7fd881563640 1 -- 172.21.15.44:0/92228258 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207534137 0 0) 0x7fd87c15e000 con 0x7fd87c0ce240 2023-11-04T01:37:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.448+0000 7fd881563640 1 -- 172.21.15.44:0/92228258 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd868003520 con 0x7fd87c0ce240 2023-11-04T01:37:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.448+0000 7fd881563640 1 -- 172.21.15.44:0/92228258 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597325463 0 0) 0x7fd87c15e2e0 con 0x7fd87c15daa0 2023-11-04T01:37:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.448+0000 7fd881563640 1 -- 172.21.15.44:0/92228258 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd87c15e000 con 0x7fd87c15daa0 2023-11-04T01:37:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.448+0000 7fd882565640 1 -- 172.21.15.44:0/92228258 >> v1:172.21.15.204:6789/0 conn(0x7fd87c15daa0 legacy=0x7fd87c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.448+0000 7fd881563640 1 -- 172.21.15.44:0/92228258 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1081809402 0 0) 0x7fd868003520 con 0x7fd87c0ce240 2023-11-04T01:37:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.448+0000 7fd882565640 1 -- 172.21.15.44:0/92228258 >> v1:172.21.15.44:6789/0 conn(0x7fd87c0ce240 legacy=0x7fd87c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.448+0000 7fd882565640 1 -- 172.21.15.44:0/92228258 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c0d1120 con 0x7fd87c0cde60 2023-11-04T01:37:06.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.449+0000 7fd882565640 1 --2- 172.21.15.44:0/92228258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd87c0cde60 0x7fd87c15d560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd8780097d0 tx=0x7fd87802b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72e0d6fe43041f26 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:06.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.449+0000 7fd881563640 1 -- 172.21.15.44:0/92228258 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740019f0 con 0x7fd87c0cde60 2023-11-04T01:37:06.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.450+0000 7fd881563640 1 -- 172.21.15.44:0/92228258 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87802e050 con 0x7fd87c0cde60 2023-11-04T01:37:06.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.450+0000 7fd881563640 1 -- 172.21.15.44:0/92228258 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878030730 con 0x7fd87c0cde60 2023-11-04T01:37:06.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.450+0000 7fd8847c9640 1 -- 172.21.15.44:0/92228258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd87c0cde60 msgr2=0x7fd87c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.450+0000 7fd8847c9640 1 --2- 172.21.15.44:0/92228258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd87c0cde60 0x7fd87c15d560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd8780097d0 tx=0x7fd87802b800 comp rx=0 tx=0).stop 2023-11-04T01:37:06.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.450+0000 7fd8847c9640 1 -- 172.21.15.44:0/92228258 shutdown_connections 2023-11-04T01:37:06.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.450+0000 7fd8847c9640 1 --2- 172.21.15.44:0/92228258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd87c0cde60 0x7fd87c15d560 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.450+0000 7fd8847c9640 1 -- 172.21.15.44:0/92228258 >> 172.21.15.44:0/92228258 conn(0x7fd87c071f30 msgr2=0x7fd87c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:06.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.450+0000 7fd8847c9640 1 -- 172.21.15.44:0/92228258 shutdown_connections 2023-11-04T01:37:06.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.450+0000 7fd8847c9640 1 -- 172.21.15.44:0/92228258 wait complete. 2023-11-04T01:37:06.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.451+0000 7fd8847c9640 1 Processor -- start 2023-11-04T01:37:06.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.451+0000 7fd8847c9640 1 -- start start 2023-11-04T01:37:06.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.452+0000 7fd8847c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd87c0cde60 0x7fd87c158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.452+0000 7fd8847c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd87c0ce240 0x7fd87c15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.452+0000 7fd8847c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd87c15daa0 0x7fd87c154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.452+0000 7fd8847c9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c15cfd0 con 0x7fd87c0cde60 2023-11-04T01:37:06.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.452+0000 7fd8847c9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c154cd0 con 0x7fd87c0ce240 2023-11-04T01:37:06.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.452+0000 7fd8847c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c1f22b0 con 0x7fd87c15daa0 2023-11-04T01:37:06.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.452+0000 7fd882565640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd87c0cde60 0x7fd87c158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.452+0000 7fd882565640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd87c0cde60 0x7fd87c158620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37656/0 (socket says 172.21.15.44:37656) 2023-11-04T01:37:06.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.452+0000 7fd882565640 1 -- 172.21.15.44:0/3867894546 learned_addr learned my addr 172.21.15.44:0/3867894546 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:06.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.452+0000 7fd881d64640 1 --2- 172.21.15.44:0/3867894546 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd87c0ce240 0x7fd87c15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.452+0000 7fd882d66640 1 --2- 172.21.15.44:0/3867894546 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd87c15daa0 0x7fd87c154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.453+0000 7fd882565640 1 -- 172.21.15.44:0/3867894546 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd87c15daa0 msgr2=0x7fd87c154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.453+0000 7fd882565640 1 --2- 172.21.15.44:0/3867894546 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd87c15daa0 0x7fd87c154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.453+0000 7fd882565640 1 -- 172.21.15.44:0/3867894546 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd87c0ce240 msgr2=0x7fd87c15ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.453+0000 7fd882565640 1 --2- 172.21.15.44:0/3867894546 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd87c0ce240 0x7fd87c15ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.453+0000 7fd882565640 1 -- 172.21.15.44:0/3867894546 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd878009400 con 0x7fd87c0cde60 2023-11-04T01:37:06.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.453+0000 7fd882565640 1 --2- 172.21.15.44:0/3867894546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd87c0cde60 0x7fd87c158620 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd8780098f0 tx=0x7fd8780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:06.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.453+0000 7fd872ffd640 1 -- 172.21.15.44:0/3867894546 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87803b810 con 0x7fd87c0cde60 2023-11-04T01:37:06.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.453+0000 7fd872ffd640 1 -- 172.21.15.44:0/3867894546 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87803b970 con 0x7fd87c0cde60 2023-11-04T01:37:06.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.453+0000 7fd8847c9640 1 -- 172.21.15.44:0/3867894546 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87c158d00 con 0x7fd87c0cde60 2023-11-04T01:37:06.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.453+0000 7fd872ffd640 1 -- 172.21.15.44:0/3867894546 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87803bd20 con 0x7fd87c0cde60 2023-11-04T01:37:06.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.453+0000 7fd8847c9640 1 -- 172.21.15.44:0/3867894546 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87c1592c0 con 0x7fd87c0cde60 2023-11-04T01:37:06.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.454+0000 7fd8847c9640 1 -- 172.21.15.44:0/3867894546 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87c074290 con 0x7fd87c0cde60 2023-11-04T01:37:06.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.454+0000 7fd872ffd640 1 -- 172.21.15.44:0/3867894546 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd878039040 con 0x7fd87c0cde60 2023-11-04T01:37:06.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.455+0000 7fd872ffd640 1 --2- 172.21.15.44:0/3867894546 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd86006ae70 0x7fd86006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.455+0000 7fd872ffd640 1 -- 172.21.15.44:0/3867894546 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd8780aafa0 con 0x7fd87c0cde60 2023-11-04T01:37:06.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.455+0000 7fd881d64640 1 --2- 172.21.15.44:0/3867894546 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd86006ae70 0x7fd86006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.456+0000 7fd881d64640 1 --2- 172.21.15.44:0/3867894546 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd86006ae70 0x7fd86006d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0c9800 tx=0x7fd86c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:06.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.459+0000 7fd872ffd640 1 -- 172.21.15.44:0/3867894546 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd8780ddca0 con 0x7fd87c0cde60 2023-11-04T01:37:06.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.634+0000 7fd8847c9640 1 -- 172.21.15.44:0/3867894546 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd87c156db0 con 0x7fd87c0cde60 2023-11-04T01:37:06.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.636+0000 7fd872ffd640 1 -- 172.21.15.44:0/3867894546 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7fd87804c090 con 0x7fd87c0cde60 2023-11-04T01:37:06.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:06.638 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:06.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.638+0000 7fd8847c9640 1 -- 172.21.15.44:0/3867894546 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd86006ae70 msgr2=0x7fd86006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.638+0000 7fd8847c9640 1 --2- 172.21.15.44:0/3867894546 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd86006ae70 0x7fd86006d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0c9800 tx=0x7fd86c009040 comp rx=0 tx=0).stop 2023-11-04T01:37:06.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.638+0000 7fd8847c9640 1 -- 172.21.15.44:0/3867894546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd87c0cde60 msgr2=0x7fd87c158620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.638+0000 7fd8847c9640 1 --2- 172.21.15.44:0/3867894546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd87c0cde60 0x7fd87c158620 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd8780098f0 tx=0x7fd8780046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.638+0000 7fd8847c9640 1 -- 172.21.15.44:0/3867894546 shutdown_connections 2023-11-04T01:37:06.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.638+0000 7fd8847c9640 1 --2- 172.21.15.44:0/3867894546 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd86006ae70 0x7fd86006d330 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.638+0000 7fd8847c9640 1 --2- 172.21.15.44:0/3867894546 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd87c15daa0 0x7fd87c154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.638+0000 7fd8847c9640 1 --2- 172.21.15.44:0/3867894546 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd87c0ce240 0x7fd87c15ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.638+0000 7fd8847c9640 1 --2- 172.21.15.44:0/3867894546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd87c0cde60 0x7fd87c158620 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.638+0000 7fd8847c9640 1 -- 172.21.15.44:0/3867894546 >> 172.21.15.44:0/3867894546 conn(0x7fd87c071f30 msgr2=0x7fd87c0c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:06.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.638+0000 7fd8847c9640 1 -- 172.21.15.44:0/3867894546 shutdown_connections 2023-11-04T01:37:06.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.638+0000 7fd8847c9640 1 -- 172.21.15.44:0/3867894546 wait complete. 2023-11-04T01:37:06.651 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:56.801551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:57.523693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:01.243259+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:06.652 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:06.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.759+0000 7f4f7311d640 1 Processor -- start 2023-11-04T01:37:06.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.759+0000 7f4f7311d640 1 -- start start 2023-11-04T01:37:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.759+0000 7f4f7311d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4f6c15e3f0 0x7f4f6c0b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.759+0000 7f4f7311d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6c0cc300 0x7f4f6c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.759+0000 7f4f7311d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c0caa20 con 0x7f4f6c0ca0a0 2023-11-04T01:37:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.759+0000 7f4f7311d640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6c0cb230 con 0x7f4f6c15e3f0 2023-11-04T01:37:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.759+0000 7f4f7311d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c0ca530 con 0x7f4f6c0cc300 2023-11-04T01:37:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.760+0000 7f4f70eb9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4f6c15e3f0 0x7f4f6c0b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.760+0000 7f4f70eb9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4f6c15e3f0 0x7f4f6c0b2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37666/0 (socket says 172.21.15.44:37666) 2023-11-04T01:37:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.760+0000 7f4f70eb9640 1 -- 172.21.15.44:0/730455036 learned_addr learned my addr 172.21.15.44:0/730455036 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.760+0000 7f4f716ba640 1 --2- 172.21.15.44:0/730455036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6c0cc300 0x7f4f6c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.760+0000 7f4f70eb9640 1 -- 172.21.15.44:0/730455036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6c0cc300 msgr2=0x7f4f6c0b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.760+0000 7f4f70eb9640 1 --2- 172.21.15.44:0/730455036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6c0cc300 0x7f4f6c0b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.760+0000 7f4f70eb9640 1 -- 172.21.15.44:0/730455036 >> v1:172.21.15.204:6789/0 conn(0x7f4f6c0ca0a0 legacy=0x7f4f6c0cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.760+0000 7f4f70eb9640 1 -- 172.21.15.44:0/730455036 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c0cac70 con 0x7f4f6c15e3f0 2023-11-04T01:37:06.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.760+0000 7f4f716ba640 1 --2- 172.21.15.44:0/730455036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6c0cc300 0x7f4f6c0b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:06.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.761+0000 7f4f70eb9640 1 --2- 172.21.15.44:0/730455036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6c15e3f0 0x7f4f6c0b2bf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009e50 tx=0x7f4f6402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f837e314595ef22c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:06.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.761+0000 7f4f6b7fe640 1 -- 172.21.15.44:0/730455036 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6402cb00 con 0x7f4f6c15e3f0 2023-11-04T01:37:06.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.761+0000 7f4f6b7fe640 1 -- 172.21.15.44:0/730455036 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6402cc60 con 0x7f4f6c15e3f0 2023-11-04T01:37:06.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.761+0000 7f4f6b7fe640 1 -- 172.21.15.44:0/730455036 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f640343f0 con 0x7f4f6c15e3f0 2023-11-04T01:37:06.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.761+0000 7f4f7311d640 1 -- 172.21.15.44:0/730455036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6c15e3f0 msgr2=0x7f4f6c0b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.761+0000 7f4f7311d640 1 --2- 172.21.15.44:0/730455036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6c15e3f0 0x7f4f6c0b2bf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009e50 tx=0x7f4f6402bf60 comp rx=0 tx=0).stop 2023-11-04T01:37:06.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.761+0000 7f4f7311d640 1 -- 172.21.15.44:0/730455036 shutdown_connections 2023-11-04T01:37:06.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.761+0000 7f4f7311d640 1 --2- 172.21.15.44:0/730455036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6c0cc300 0x7f4f6c0b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.761+0000 7f4f7311d640 1 --2- 172.21.15.44:0/730455036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6c15e3f0 0x7f4f6c0b2bf0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.761+0000 7f4f7311d640 1 -- 172.21.15.44:0/730455036 >> 172.21.15.44:0/730455036 conn(0x7f4f6c071820 msgr2=0x7f4f6c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:06.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.761+0000 7f4f7311d640 1 -- 172.21.15.44:0/730455036 shutdown_connections 2023-11-04T01:37:06.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.761+0000 7f4f7311d640 1 -- 172.21.15.44:0/730455036 wait complete. 2023-11-04T01:37:06.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.763+0000 7f4f7311d640 1 Processor -- start 2023-11-04T01:37:06.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.763+0000 7f4f7311d640 1 -- start start 2023-11-04T01:37:06.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f7311d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6c0cc300 0x7f4f6c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f7311d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6c15e3f0 0x7f4f6c0b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f7311d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6c0b0a10 0x7f4f6c0c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f7311d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c0b0ea0 con 0x7f4f6c0cc300 2023-11-04T01:37:06.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f7311d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c15a860 con 0x7f4f6c0b0a10 2023-11-04T01:37:06.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f7311d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c0c8340 con 0x7f4f6c15e3f0 2023-11-04T01:37:06.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f70eb9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6c0cc300 0x7f4f6c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f70eb9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6c0cc300 0x7f4f6c152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37670/0 (socket says 172.21.15.44:37670) 2023-11-04T01:37:06.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f70eb9640 1 -- 172.21.15.44:0/549442807 learned_addr learned my addr 172.21.15.44:0/549442807 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:06.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f6bfff640 1 --2- 172.21.15.44:0/549442807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6c15e3f0 0x7f4f6c0b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f716ba640 1 --2- 172.21.15.44:0/549442807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6c0b0a10 0x7f4f6c0c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f70eb9640 1 -- 172.21.15.44:0/549442807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6c15e3f0 msgr2=0x7f4f6c0b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f70eb9640 1 --2- 172.21.15.44:0/549442807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6c15e3f0 0x7f4f6c0b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f70eb9640 1 -- 172.21.15.44:0/549442807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6c0b0a10 msgr2=0x7f4f6c0c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f70eb9640 1 --2- 172.21.15.44:0/549442807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6c0b0a10 0x7f4f6c0c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f70eb9640 1 -- 172.21.15.44:0/549442807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f64009b30 con 0x7f4f6c0cc300 2023-11-04T01:37:06.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f70eb9640 1 --2- 172.21.15.44:0/549442807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6c0cc300 0x7f4f6c152f20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4f64000f80 tx=0x7f4f64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:06.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f697fa640 1 -- 172.21.15.44:0/549442807 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64009510 con 0x7f4f6c0cc300 2023-11-04T01:37:06.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f697fa640 1 -- 172.21.15.44:0/549442807 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6403e450 con 0x7f4f6c0cc300 2023-11-04T01:37:06.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f697fa640 1 -- 172.21.15.44:0/549442807 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6403e7e0 con 0x7f4f6c0cc300 2023-11-04T01:37:06.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f7311d640 1 -- 172.21.15.44:0/549442807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6c153460 con 0x7f4f6c0cc300 2023-11-04T01:37:06.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.764+0000 7f4f7311d640 1 -- 172.21.15.44:0/549442807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c0c7a10 con 0x7f4f6c0cc300 2023-11-04T01:37:06.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.765+0000 7f4f7311d640 1 -- 172.21.15.44:0/549442807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6c074290 con 0x7f4f6c0cc300 2023-11-04T01:37:06.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.766+0000 7f4f697fa640 1 -- 172.21.15.44:0/549442807 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f6403e940 con 0x7f4f6c0cc300 2023-11-04T01:37:06.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.766+0000 7f4f697fa640 1 --2- 172.21.15.44:0/549442807 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f4c06ae70 0x7f4f4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.766+0000 7f4f697fa640 1 -- 172.21.15.44:0/549442807 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4f640ac750 con 0x7f4f6c0cc300 2023-11-04T01:37:06.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.766+0000 7f4f6bfff640 1 --2- 172.21.15.44:0/549442807 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f4c06ae70 0x7f4f4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.767+0000 7f4f6bfff640 1 --2- 172.21.15.44:0/549442807 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f4c06ae70 0x7f4f4c06d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0cf4b0 tx=0x7f4f5c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:06.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.770+0000 7f4f697fa640 1 -- 172.21.15.44:0/549442807 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f640773b0 con 0x7f4f6c0cc300 2023-11-04T01:37:06.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.948+0000 7f4f7311d640 1 -- 172.21.15.44:0/549442807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f6c0cdaa0 con 0x7f4f6c0cc300 2023-11-04T01:37:06.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.949+0000 7f4f697fa640 1 -- 172.21.15.44:0/549442807 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f6407a9d0 con 0x7f4f6c0cc300 2023-11-04T01:37:06.951 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:37:06.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.950+0000 7f4f7311d640 1 -- 172.21.15.44:0/549442807 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f4c06ae70 msgr2=0x7f4f4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.950+0000 7f4f7311d640 1 --2- 172.21.15.44:0/549442807 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f4c06ae70 0x7f4f4c06d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0cf4b0 tx=0x7f4f5c009040 comp rx=0 tx=0).stop 2023-11-04T01:37:06.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.950+0000 7f4f7311d640 1 -- 172.21.15.44:0/549442807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6c0cc300 msgr2=0x7f4f6c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.950+0000 7f4f7311d640 1 --2- 172.21.15.44:0/549442807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6c0cc300 0x7f4f6c152f20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4f64000f80 tx=0x7f4f64004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:06.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.951+0000 7f4f7311d640 1 -- 172.21.15.44:0/549442807 shutdown_connections 2023-11-04T01:37:06.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.951+0000 7f4f7311d640 1 --2- 172.21.15.44:0/549442807 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f4c06ae70 0x7f4f4c06d330 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.951+0000 7f4f7311d640 1 --2- 172.21.15.44:0/549442807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6c0b0a10 0x7f4f6c0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.951+0000 7f4f7311d640 1 --2- 172.21.15.44:0/549442807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6c15e3f0 0x7f4f6c0b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.951+0000 7f4f7311d640 1 --2- 172.21.15.44:0/549442807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6c0cc300 0x7f4f6c152f20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.951+0000 7f4f7311d640 1 -- 172.21.15.44:0/549442807 >> 172.21.15.44:0/549442807 conn(0x7f4f6c071820 msgr2=0x7f4f6c0b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:06.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.951+0000 7f4f7311d640 1 -- 172.21.15.44:0/549442807 shutdown_connections 2023-11-04T01:37:06.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:06.951+0000 7f4f7311d640 1 -- 172.21.15.44:0/549442807 wait complete. 2023-11-04T01:37:06.964 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:07.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.072+0000 7f3f6f65d640 1 Processor -- start 2023-11-04T01:37:07.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.072+0000 7f3f6f65d640 1 -- start start 2023-11-04T01:37:07.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.073+0000 7f3f6f65d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f6815ad30 0x7f3f680adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.073+0000 7f3f6f65d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3f680ad730 0x7f3f68070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.073+0000 7f3f6f65d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f680c3900 con 0x7f3f68070c50 2023-11-04T01:37:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.073+0000 7f3f6f65d640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f680ae260 con 0x7f3f680ad730 2023-11-04T01:37:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.073+0000 7f3f6f65d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6815f750 con 0x7f3f6815ad30 2023-11-04T01:37:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.073+0000 7f3f6cbf8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3f680ad730 0x7f3f68070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.073+0000 7f3f6cbf8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3f680ad730 0x7f3f68070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37686/0 (socket says 172.21.15.44:37686) 2023-11-04T01:37:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.073+0000 7f3f6cbf8640 1 -- 172.21.15.44:0/4281709775 learned_addr learned my addr 172.21.15.44:0/4281709775 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.073+0000 7f3f6d3f9640 1 --2- 172.21.15.44:0/4281709775 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f6815ad30 0x7f3f680adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.073+0000 7f3f6cbf8640 1 -- 172.21.15.44:0/4281709775 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f6815ad30 msgr2=0x7f3f680adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.073+0000 7f3f6cbf8640 1 --2- 172.21.15.44:0/4281709775 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f6815ad30 0x7f3f680adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.073+0000 7f3f6cbf8640 1 -- 172.21.15.44:0/4281709775 >> v1:172.21.15.204:6789/0 conn(0x7f3f68070c50 legacy=0x7f3f680c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.073+0000 7f3f6cbf8640 1 -- 172.21.15.44:0/4281709775 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f680c3be0 con 0x7f3f680ad730 2023-11-04T01:37:07.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.074+0000 7f3f6cbf8640 1 --2- 172.21.15.44:0/4281709775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f680ad730 0x7f3f68070710 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3f580098a0 tx=0x7f3f5802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d743f5d80078964 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.074+0000 7f3f5ffff640 1 -- 172.21.15.44:0/4281709775 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580317c0 con 0x7f3f680ad730 2023-11-04T01:37:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.074+0000 7f3f5ffff640 1 -- 172.21.15.44:0/4281709775 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f58031920 con 0x7f3f680ad730 2023-11-04T01:37:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.074+0000 7f3f5ffff640 1 -- 172.21.15.44:0/4281709775 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58031cb0 con 0x7f3f680ad730 2023-11-04T01:37:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.075+0000 7f3f6f65d640 1 -- 172.21.15.44:0/4281709775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f680ad730 msgr2=0x7f3f68070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.075+0000 7f3f6f65d640 1 --2- 172.21.15.44:0/4281709775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f680ad730 0x7f3f68070710 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3f580098a0 tx=0x7f3f5802b860 comp rx=0 tx=0).stop 2023-11-04T01:37:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.075+0000 7f3f6f65d640 1 -- 172.21.15.44:0/4281709775 shutdown_connections 2023-11-04T01:37:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.075+0000 7f3f6f65d640 1 --2- 172.21.15.44:0/4281709775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f680ad730 0x7f3f68070710 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.075+0000 7f3f6f65d640 1 --2- 172.21.15.44:0/4281709775 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f6815ad30 0x7f3f680adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.075+0000 7f3f6f65d640 1 -- 172.21.15.44:0/4281709775 >> 172.21.15.44:0/4281709775 conn(0x7f3f680ce950 msgr2=0x7f3f680ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.075+0000 7f3f6f65d640 1 -- 172.21.15.44:0/4281709775 shutdown_connections 2023-11-04T01:37:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.075+0000 7f3f6f65d640 1 -- 172.21.15.44:0/4281709775 wait complete. 2023-11-04T01:37:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.076+0000 7f3f6f65d640 1 Processor -- start 2023-11-04T01:37:07.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.076+0000 7f3f6f65d640 1 -- start start 2023-11-04T01:37:07.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6f65d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f68070c50 0x7f3f681e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6f65d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f680ad730 0x7f3f68150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6f65d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f6815ad30 0x7f3f68155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6f65d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f681e5d50 con 0x7f3f680ad730 2023-11-04T01:37:07.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6f65d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f68150a40 con 0x7f3f68070c50 2023-11-04T01:37:07.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6f65d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f68155d80 con 0x7f3f6815ad30 2023-11-04T01:37:07.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6cbf8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f680ad730 0x7f3f68150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6cbf8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f680ad730 0x7f3f68150500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37696/0 (socket says 172.21.15.44:37696) 2023-11-04T01:37:07.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6cbf8640 1 -- 172.21.15.44:0/1707809930 learned_addr learned my addr 172.21.15.44:0/1707809930 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:07.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6dbfa640 1 --2- 172.21.15.44:0/1707809930 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f6815ad30 0x7f3f68155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6d3f9640 1 --2- 172.21.15.44:0/1707809930 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f68070c50 0x7f3f681e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6cbf8640 1 -- 172.21.15.44:0/1707809930 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f6815ad30 msgr2=0x7f3f68155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6cbf8640 1 --2- 172.21.15.44:0/1707809930 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f6815ad30 0x7f3f68155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6cbf8640 1 -- 172.21.15.44:0/1707809930 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f68070c50 msgr2=0x7f3f681e4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6cbf8640 1 --2- 172.21.15.44:0/1707809930 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f68070c50 0x7f3f681e4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6cbf8640 1 -- 172.21.15.44:0/1707809930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580094d0 con 0x7f3f680ad730 2023-11-04T01:37:07.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.077+0000 7f3f6cbf8640 1 --2- 172.21.15.44:0/1707809930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f680ad730 0x7f3f68150500 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3f58000c00 tx=0x7f3f580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.078+0000 7f3f5dffb640 1 -- 172.21.15.44:0/1707809930 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58032860 con 0x7f3f680ad730 2023-11-04T01:37:07.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.078+0000 7f3f5dffb640 1 -- 172.21.15.44:0/1707809930 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f580329c0 con 0x7f3f680ad730 2023-11-04T01:37:07.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.078+0000 7f3f5dffb640 1 -- 172.21.15.44:0/1707809930 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58032d70 con 0x7f3f680ad730 2023-11-04T01:37:07.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.078+0000 7f3f6f65d640 1 -- 172.21.15.44:0/1707809930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f681e50d0 con 0x7f3f680ad730 2023-11-04T01:37:07.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.078+0000 7f3f6f65d640 1 -- 172.21.15.44:0/1707809930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f681e5690 con 0x7f3f680ad730 2023-11-04T01:37:07.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.079+0000 7f3f6f65d640 1 -- 172.21.15.44:0/1707809930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f68074290 con 0x7f3f680ad730 2023-11-04T01:37:07.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.079+0000 7f3f5dffb640 1 -- 172.21.15.44:0/1707809930 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3f5804e450 con 0x7f3f680ad730 2023-11-04T01:37:07.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.080+0000 7f3f5dffb640 1 --2- 172.21.15.44:0/1707809930 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f4c06ae70 0x7f3f4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.080+0000 7f3f5dffb640 1 -- 172.21.15.44:0/1707809930 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3f580abb40 con 0x7f3f680ad730 2023-11-04T01:37:07.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.080+0000 7f3f6d3f9640 1 --2- 172.21.15.44:0/1707809930 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f4c06ae70 0x7f3f4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.080+0000 7f3f6d3f9640 1 --2- 172.21.15.44:0/1707809930 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f4c06ae70 0x7f3f4c06d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3f64006fd0 tx=0x7f3f64008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.084+0000 7f3f5dffb640 1 -- 172.21.15.44:0/1707809930 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3f580768c0 con 0x7f3f680ad730 2023-11-04T01:37:07.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.260+0000 7f3f6f65d640 1 -- 172.21.15.44:0/1707809930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f68071970 con 0x7f3f680ad730 2023-11-04T01:37:07.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.261+0000 7f3f5dffb640 1 -- 172.21.15.44:0/1707809930 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f58079ee0 con 0x7f3f680ad730 2023-11-04T01:37:07.263 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:37:07.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.263+0000 7f3f6f65d640 1 -- 172.21.15.44:0/1707809930 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f4c06ae70 msgr2=0x7f3f4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.263+0000 7f3f6f65d640 1 --2- 172.21.15.44:0/1707809930 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f4c06ae70 0x7f3f4c06d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3f64006fd0 tx=0x7f3f64008040 comp rx=0 tx=0).stop 2023-11-04T01:37:07.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.263+0000 7f3f6f65d640 1 -- 172.21.15.44:0/1707809930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f680ad730 msgr2=0x7f3f68150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.263+0000 7f3f6f65d640 1 --2- 172.21.15.44:0/1707809930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f680ad730 0x7f3f68150500 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3f58000c00 tx=0x7f3f580046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.263+0000 7f3f6f65d640 1 -- 172.21.15.44:0/1707809930 shutdown_connections 2023-11-04T01:37:07.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.263+0000 7f3f6f65d640 1 --2- 172.21.15.44:0/1707809930 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f4c06ae70 0x7f3f4c06d330 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.263+0000 7f3f6f65d640 1 --2- 172.21.15.44:0/1707809930 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f6815ad30 0x7f3f68155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.263+0000 7f3f6f65d640 1 --2- 172.21.15.44:0/1707809930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f680ad730 0x7f3f68150500 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.263+0000 7f3f6f65d640 1 --2- 172.21.15.44:0/1707809930 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f68070c50 0x7f3f681e4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.263+0000 7f3f6f65d640 1 -- 172.21.15.44:0/1707809930 >> 172.21.15.44:0/1707809930 conn(0x7f3f680ce950 msgr2=0x7f3f681539b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:07.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.263+0000 7f3f6f65d640 1 -- 172.21.15.44:0/1707809930 shutdown_connections 2023-11-04T01:37:07.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.263+0000 7f3f6f65d640 1 -- 172.21.15.44:0/1707809930 wait complete. 2023-11-04T01:37:07.276 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:07.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.382+0000 7f4ee6a0e640 1 Processor -- start 2023-11-04T01:37:07.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.383+0000 7f4ee6a0e640 1 -- start start 2023-11-04T01:37:07.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.383+0000 7f4ee6a0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ee00cccc0 0x7f4ee006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.383+0000 7f4ee6a0e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee006ca40 con 0x7f4ee0160430 2023-11-04T01:37:07.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.383+0000 7f4ee6a0e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee006cd20 con 0x7f4ee00b2d30 2023-11-04T01:37:07.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.383+0000 7f4ee6a0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00cb580 con 0x7f4ee00cccc0 2023-11-04T01:37:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.383+0000 7f4edffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4ee0160430 0x7f4ee00b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49132/0 (socket says 172.21.15.44:49132) 2023-11-04T01:37:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.383+0000 7f4edffff640 1 -- 172.21.15.44:0/2418497442 learned_addr learned my addr 172.21.15.44:0/2418497442 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4ee4fab640 1 --2- 172.21.15.44:0/2418497442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ee00cccc0 0x7f4ee006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edeffd640 1 -- 172.21.15.44:0/2418497442 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053428335 0 0) 0x7f4ee006ca40 con 0x7f4ee0160430 2023-11-04T01:37:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edeffd640 1 -- 172.21.15.44:0/2418497442 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ec8003520 con 0x7f4ee0160430 2023-11-04T01:37:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edeffd640 1 -- 172.21.15.44:0/2418497442 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2688178323 0 0) 0x7f4ec8003520 con 0x7f4ee0160430 2023-11-04T01:37:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edeffd640 1 -- 172.21.15.44:0/2418497442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ee00cccc0 msgr2=0x7f4ee006c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edeffd640 1 --2- 172.21.15.44:0/2418497442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ee00cccc0 0x7f4ee006c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edeffd640 1 -- 172.21.15.44:0/2418497442 >> v1:172.21.15.204:6789/0 conn(0x7f4ee00b2d30 legacy=0x7f4ee006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edeffd640 1 -- 172.21.15.44:0/2418497442 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee006d000 con 0x7f4ee0160430 2023-11-04T01:37:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edeffd640 1 -- 172.21.15.44:0/2418497442 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f4ed0001670 con 0x7f4ee0160430 2023-11-04T01:37:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edeffd640 1 -- 172.21.15.44:0/2418497442 >> v1:172.21.15.44:6789/0 conn(0x7f4ee0160430 legacy=0x7f4ee00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edeffd640 1 --2- 172.21.15.44:0/2418497442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ec80039a0 0x7f4ec8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edeffd640 1 --2- 172.21.15.44:0/2418497442 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec8004350 0x7f4ec8004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edeffd640 1 --2- 172.21.15.44:0/2418497442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ee00cccc0 0x7f4ec8005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edeffd640 1 -- 172.21.15.44:0/2418497442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00cb580 con 0x7f4ec80039a0 2023-11-04T01:37:07.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edeffd640 1 -- 172.21.15.44:0/2418497442 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec800ba30 con 0x7f4ec8004350 2023-11-04T01:37:07.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edeffd640 1 -- 172.21.15.44:0/2418497442 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec800bbf0 con 0x7f4ee00cccc0 2023-11-04T01:37:07.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edffff640 1 --2- 172.21.15.44:0/2418497442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ec80039a0 0x7f4ec8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edf7fe640 1 --2- 172.21.15.44:0/2418497442 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec8004350 0x7f4ec8004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4ee4fab640 1 --2- 172.21.15.44:0/2418497442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ee00cccc0 0x7f4ec8005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edffff640 1 -- 172.21.15.44:0/2418497442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ee00cccc0 msgr2=0x7f4ec8005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:07.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edffff640 1 --2- 172.21.15.44:0/2418497442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ee00cccc0 0x7f4ec8005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edffff640 1 -- 172.21.15.44:0/2418497442 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec8004350 msgr2=0x7f4ec8004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:07.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.384+0000 7f4edffff640 1 --2- 172.21.15.44:0/2418497442 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec8004350 0x7f4ec8004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.385+0000 7f4edffff640 1 -- 172.21.15.44:0/2418497442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec8003520 con 0x7f4ec80039a0 2023-11-04T01:37:07.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.385+0000 7f4edffff640 1 --2- 172.21.15.44:0/2418497442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ec80039a0 0x7f4ec8003d80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000c190 tx=0x7f4ec80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f870968f6da37d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.385+0000 7f4edeffd640 1 -- 172.21.15.44:0/2418497442 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0005ad0 con 0x7f4ec80039a0 2023-11-04T01:37:07.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.385+0000 7f4edeffd640 1 -- 172.21.15.44:0/2418497442 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed0005c50 con 0x7f4ec80039a0 2023-11-04T01:37:07.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.385+0000 7f4edeffd640 1 -- 172.21.15.44:0/2418497442 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed002c850 con 0x7f4ec80039a0 2023-11-04T01:37:07.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.386+0000 7f4ee6a0e640 1 -- 172.21.15.44:0/2418497442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ec80039a0 msgr2=0x7f4ec8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.386+0000 7f4ee6a0e640 1 --2- 172.21.15.44:0/2418497442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ec80039a0 0x7f4ec8003d80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000c190 tx=0x7f4ec80057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.386+0000 7f4ee4fab640 1 -- 172.21.15.44:0/2418497442 reap_dead start 2023-11-04T01:37:07.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.386+0000 7f4ee6a0e640 1 -- 172.21.15.44:0/2418497442 shutdown_connections 2023-11-04T01:37:07.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.386+0000 7f4ee6a0e640 1 -- 172.21.15.44:0/2418497442 >> 172.21.15.44:0/2418497442 conn(0x7f4ee006ea20 msgr2=0x7f4ee006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:07.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.386+0000 7f4ee6a0e640 1 -- 172.21.15.44:0/2418497442 shutdown_connections 2023-11-04T01:37:07.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.386+0000 7f4ee6a0e640 1 -- 172.21.15.44:0/2418497442 wait complete. 2023-11-04T01:37:07.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.387+0000 7f4ee6a0e640 1 Processor -- start 2023-11-04T01:37:07.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.387+0000 7f4ee6a0e640 1 -- start start 2023-11-04T01:37:07.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4ee6a0e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec80039a0 0x7f4ee0152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4ee6a0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ee00c65a0 0x7f4ee015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4ee6a0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ee00c6a00 0x7f4ee015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4ee6a0e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00c4670 con 0x7f4ee00c6a00 2023-11-04T01:37:07.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4ee6a0e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee0153330 con 0x7f4ec80039a0 2023-11-04T01:37:07.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4ee6a0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00c6f60 con 0x7f4ee00c65a0 2023-11-04T01:37:07.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4ee4fab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ee00c6a00 0x7f4ee015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4ee4fab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ee00c6a00 0x7f4ee015afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37702/0 (socket says 172.21.15.44:37702) 2023-11-04T01:37:07.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4ee4fab640 1 -- 172.21.15.44:0/2817067286 learned_addr learned my addr 172.21.15.44:0/2817067286 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:07.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4edffff640 1 --2- 172.21.15.44:0/2817067286 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec80039a0 0x7f4ee0152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4edf7fe640 1 --2- 172.21.15.44:0/2817067286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ee00c65a0 0x7f4ee015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4ee4fab640 1 -- 172.21.15.44:0/2817067286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ee00c65a0 msgr2=0x7f4ee015aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4ee4fab640 1 --2- 172.21.15.44:0/2817067286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ee00c65a0 0x7f4ee015aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4ee4fab640 1 -- 172.21.15.44:0/2817067286 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec80039a0 msgr2=0x7f4ee0152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4ee4fab640 1 --2- 172.21.15.44:0/2817067286 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec80039a0 0x7f4ee0152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.388+0000 7f4ee4fab640 1 -- 172.21.15.44:0/2817067286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee00c48c0 con 0x7f4ee00c6a00 2023-11-04T01:37:07.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.389+0000 7f4edf7fe640 1 --2- 172.21.15.44:0/2817067286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ee00c65a0 0x7f4ee015aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:07.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.389+0000 7f4ee4fab640 1 --2- 172.21.15.44:0/2817067286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ee00c6a00 0x7f4ee015afe0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00ce700 tx=0x7f4ed80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.389+0000 7f4edcff9640 1 -- 172.21.15.44:0/2817067286 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800e070 con 0x7f4ee00c6a00 2023-11-04T01:37:07.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.389+0000 7f4edcff9640 1 -- 172.21.15.44:0/2817067286 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed8003990 con 0x7f4ee00c6a00 2023-11-04T01:37:07.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.389+0000 7f4ee6a0e640 1 -- 172.21.15.44:0/2817067286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee00c4ba0 con 0x7f4ee00c6a00 2023-11-04T01:37:07.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.389+0000 7f4edcff9640 1 -- 172.21.15.44:0/2817067286 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8003b40 con 0x7f4ee00c6a00 2023-11-04T01:37:07.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.389+0000 7f4ee6a0e640 1 -- 172.21.15.44:0/2817067286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee00c53a0 con 0x7f4ee00c6a00 2023-11-04T01:37:07.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.390+0000 7f4ee6a0e640 1 -- 172.21.15.44:0/2817067286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee0074290 con 0x7f4ee00c6a00 2023-11-04T01:37:07.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.390+0000 7f4edcff9640 1 -- 172.21.15.44:0/2817067286 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ed8003ca0 con 0x7f4ee00c6a00 2023-11-04T01:37:07.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.391+0000 7f4edcff9640 1 --2- 172.21.15.44:0/2817067286 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ecc06ae70 0x7f4ecc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.391+0000 7f4edcff9640 1 -- 172.21.15.44:0/2817067286 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4ed8089fe0 con 0x7f4ee00c6a00 2023-11-04T01:37:07.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.391+0000 7f4edffff640 1 --2- 172.21.15.44:0/2817067286 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ecc06ae70 0x7f4ecc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.392+0000 7f4edffff640 1 --2- 172.21.15.44:0/2817067286 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ecc06ae70 0x7f4ecc06d330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0034000 tx=0x7f4ed0009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.395+0000 7f4edcff9640 1 -- 172.21.15.44:0/2817067286 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ed8054c30 con 0x7f4ee00c6a00 2023-11-04T01:37:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.577+0000 7f4ee6a0e640 1 -- 172.21.15.44:0/2817067286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ee00cb790 con 0x7f4ee00c6a00 2023-11-04T01:37:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.577+0000 7f4edcff9640 1 -- 172.21.15.44:0/2817067286 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ed8058250 con 0x7f4ee00c6a00 2023-11-04T01:37:07.579 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:37:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.579+0000 7f4ee6a0e640 1 -- 172.21.15.44:0/2817067286 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ecc06ae70 msgr2=0x7f4ecc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.579+0000 7f4ee6a0e640 1 --2- 172.21.15.44:0/2817067286 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ecc06ae70 0x7f4ecc06d330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0034000 tx=0x7f4ed0009030 comp rx=0 tx=0).stop 2023-11-04T01:37:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.579+0000 7f4ee6a0e640 1 -- 172.21.15.44:0/2817067286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ee00c6a00 msgr2=0x7f4ee015afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.579+0000 7f4ee6a0e640 1 --2- 172.21.15.44:0/2817067286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ee00c6a00 0x7f4ee015afe0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00ce700 tx=0x7f4ed80115a0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.579+0000 7f4ee6a0e640 1 -- 172.21.15.44:0/2817067286 shutdown_connections 2023-11-04T01:37:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.579+0000 7f4ee6a0e640 1 --2- 172.21.15.44:0/2817067286 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ecc06ae70 0x7f4ecc06d330 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.579+0000 7f4ee6a0e640 1 --2- 172.21.15.44:0/2817067286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ee00c6a00 0x7f4ee015afe0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.579+0000 7f4ee6a0e640 1 --2- 172.21.15.44:0/2817067286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ee00c65a0 0x7f4ee015aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.579+0000 7f4ee6a0e640 1 --2- 172.21.15.44:0/2817067286 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec80039a0 0x7f4ee0152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.579+0000 7f4ee6a0e640 1 -- 172.21.15.44:0/2817067286 >> 172.21.15.44:0/2817067286 conn(0x7f4ee006ea20 msgr2=0x7f4ee00cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:07.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.580+0000 7f4ee6a0e640 1 -- 172.21.15.44:0/2817067286 shutdown_connections 2023-11-04T01:37:07.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.580+0000 7f4ee6a0e640 1 -- 172.21.15.44:0/2817067286 wait complete. 2023-11-04T01:37:07.592 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:07.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.701+0000 7f7ab9b25640 1 Processor -- start 2023-11-04T01:37:07.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.701+0000 7f7ab9b25640 1 -- start start 2023-11-04T01:37:07.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.701+0000 7f7ab9b25640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ab4153e60 0x7f7ab415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.701+0000 7f7ab9b25640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7ab40b4880 0x7f7ab40b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab9b25640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab40cde60 con 0x7f7ab40cd6d0 2023-11-04T01:37:07.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab9b25640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab40b5230 con 0x7f7ab40b4880 2023-11-04T01:37:07.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab9b25640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4160f90 con 0x7f7ab4153e60 2023-11-04T01:37:07.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab2ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7ab40cd6d0 0x7f7ab4161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49136/0 (socket says 172.21.15.44:49136) 2023-11-04T01:37:07.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab2ffd640 1 -- 172.21.15.44:0/2693803415 learned_addr learned my addr 172.21.15.44:0/2693803415 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:07.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab37fe640 1 --2- 172.21.15.44:0/2693803415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ab4153e60 0x7f7ab415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab3fff640 1 --2- 172.21.15.44:0/2693803415 >> v2:172.21.15.204:3300/0 conn(0x7f7ab40b4880 0x7f7ab40b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 -- 172.21.15.44:0/2693803415 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721423944 0 0) 0x7f7ab40cde60 con 0x7f7ab40cd6d0 2023-11-04T01:37:07.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 -- 172.21.15.44:0/2693803415 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a9c003520 con 0x7f7ab40cd6d0 2023-11-04T01:37:07.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 -- 172.21.15.44:0/2693803415 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1438545253 0 0) 0x7f7a9c003520 con 0x7f7ab40cd6d0 2023-11-04T01:37:07.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 -- 172.21.15.44:0/2693803415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ab4153e60 msgr2=0x7f7ab415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:07.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 --2- 172.21.15.44:0/2693803415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ab4153e60 0x7f7ab415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 -- 172.21.15.44:0/2693803415 >> v2:172.21.15.204:3300/0 conn(0x7f7ab40b4880 msgr2=0x7f7ab40b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:07.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 --2- 172.21.15.44:0/2693803415 >> v2:172.21.15.204:3300/0 conn(0x7f7ab40b4880 0x7f7ab40b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 -- 172.21.15.44:0/2693803415 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab415e400 con 0x7f7ab40cd6d0 2023-11-04T01:37:07.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 -- 172.21.15.44:0/2693803415 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f7aa8001670 con 0x7f7ab40cd6d0 2023-11-04T01:37:07.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 -- 172.21.15.44:0/2693803415 >> v1:172.21.15.44:6789/0 conn(0x7f7ab40cd6d0 legacy=0x7f7ab4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 --2- 172.21.15.44:0/2693803415 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7a9c003970 0x7f7a9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 --2- 172.21.15.44:0/2693803415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a9c0047c0 0x7f7a9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 --2- 172.21.15.44:0/2693803415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ab4153e60 0x7f7a9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 -- 172.21.15.44:0/2693803415 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40b5230 con 0x7f7a9c0047c0 2023-11-04T01:37:07.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 -- 172.21.15.44:0/2693803415 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4160f90 con 0x7f7a9c003970 2023-11-04T01:37:07.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab27fc640 1 -- 172.21.15.44:0/2693803415 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9c00b980 con 0x7f7ab4153e60 2023-11-04T01:37:07.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.702+0000 7f7ab2ffd640 1 --2- 172.21.15.44:0/2693803415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a9c0047c0 0x7f7a9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.703+0000 7f7ab37fe640 1 --2- 172.21.15.44:0/2693803415 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7a9c003970 0x7f7a9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.703+0000 7f7ab3fff640 1 --2- 172.21.15.44:0/2693803415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ab4153e60 0x7f7a9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.703+0000 7f7ab2ffd640 1 -- 172.21.15.44:0/2693803415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ab4153e60 msgr2=0x7f7a9c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:07.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.703+0000 7f7ab2ffd640 1 --2- 172.21.15.44:0/2693803415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ab4153e60 0x7f7a9c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.703+0000 7f7ab2ffd640 1 -- 172.21.15.44:0/2693803415 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7a9c003970 msgr2=0x7f7a9c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:07.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.703+0000 7f7ab2ffd640 1 --2- 172.21.15.44:0/2693803415 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7a9c003970 0x7f7a9c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.703+0000 7f7ab2ffd640 1 -- 172.21.15.44:0/2693803415 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9c003520 con 0x7f7a9c0047c0 2023-11-04T01:37:07.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.704+0000 7f7ab2ffd640 1 --2- 172.21.15.44:0/2693803415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a9c0047c0 0x7f7a9c004c40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800c210 tx=0x7f7a9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449f78f470ff612a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.704+0000 7f7ab27fc640 1 -- 172.21.15.44:0/2693803415 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8005ad0 con 0x7f7a9c0047c0 2023-11-04T01:37:07.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.704+0000 7f7ab27fc640 1 -- 172.21.15.44:0/2693803415 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa8005c50 con 0x7f7a9c0047c0 2023-11-04T01:37:07.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.704+0000 7f7ab27fc640 1 -- 172.21.15.44:0/2693803415 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa802c890 con 0x7f7a9c0047c0 2023-11-04T01:37:07.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.704+0000 7f7ab9b25640 1 -- 172.21.15.44:0/2693803415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a9c0047c0 msgr2=0x7f7a9c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.704+0000 7f7ab9b25640 1 --2- 172.21.15.44:0/2693803415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a9c0047c0 0x7f7a9c004c40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800c210 tx=0x7f7a9c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.704+0000 7f7ab3fff640 1 -- 172.21.15.44:0/2693803415 reap_dead start 2023-11-04T01:37:07.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.704+0000 7f7ab9b25640 1 -- 172.21.15.44:0/2693803415 shutdown_connections 2023-11-04T01:37:07.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.704+0000 7f7ab9b25640 1 -- 172.21.15.44:0/2693803415 >> 172.21.15.44:0/2693803415 conn(0x7f7ab40cf880 msgr2=0x7f7ab40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:07.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.704+0000 7f7ab9b25640 1 -- 172.21.15.44:0/2693803415 shutdown_connections 2023-11-04T01:37:07.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.704+0000 7f7ab9b25640 1 -- 172.21.15.44:0/2693803415 wait complete. 2023-11-04T01:37:07.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.705+0000 7f7ab9b25640 1 Processor -- start 2023-11-04T01:37:07.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.706+0000 7f7ab9b25640 1 -- start start 2023-11-04T01:37:07.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.706+0000 7f7ab9b25640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7a9c0047c0 0x7f7ab40d3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.706+0000 7f7ab9b25640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ab40c8390 0x7f7ab4150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.706+0000 7f7ab9b25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab40cbc70 0x7f7ab40cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.706+0000 7f7ab9b25640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40cc630 con 0x7f7ab40cbc70 2023-11-04T01:37:07.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.706+0000 7f7ab9b25640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab41552a0 con 0x7f7a9c0047c0 2023-11-04T01:37:07.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.706+0000 7f7ab9b25640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40d38c0 con 0x7f7ab40c8390 2023-11-04T01:37:07.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7ab3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab40cbc70 0x7f7ab40cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7ab3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab40cbc70 0x7f7ab40cc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37716/0 (socket says 172.21.15.44:37716) 2023-11-04T01:37:07.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7ab3fff640 1 -- 172.21.15.44:0/2216028213 learned_addr learned my addr 172.21.15.44:0/2216028213 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:07.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7ab37fe640 1 --2- 172.21.15.44:0/2216028213 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7a9c0047c0 0x7f7ab40d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7ab2ffd640 1 --2- 172.21.15.44:0/2216028213 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ab40c8390 0x7f7ab4150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7ab3fff640 1 -- 172.21.15.44:0/2216028213 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ab40c8390 msgr2=0x7f7ab4150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7ab3fff640 1 --2- 172.21.15.44:0/2216028213 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ab40c8390 0x7f7ab4150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7ab3fff640 1 -- 172.21.15.44:0/2216028213 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7a9c0047c0 msgr2=0x7f7ab40d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7ab3fff640 1 --2- 172.21.15.44:0/2216028213 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7a9c0047c0 0x7f7ab40d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7ab3fff640 1 -- 172.21.15.44:0/2216028213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab40c8900 con 0x7f7ab40cbc70 2023-11-04T01:37:07.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7ab3fff640 1 --2- 172.21.15.44:0/2216028213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab40cbc70 0x7f7ab40cc0f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7ab408abe0 tx=0x7f7aac00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7a9bfff640 1 -- 172.21.15.44:0/2216028213 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac00e040 con 0x7f7ab40cbc70 2023-11-04T01:37:07.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7a9bfff640 1 -- 172.21.15.44:0/2216028213 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac00f040 con 0x7f7ab40cbc70 2023-11-04T01:37:07.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7ab9b25640 1 -- 172.21.15.44:0/2216028213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab40c8be0 con 0x7f7ab40cbc70 2023-11-04T01:37:07.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7a9bfff640 1 -- 172.21.15.44:0/2216028213 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac015670 con 0x7f7ab40cbc70 2023-11-04T01:37:07.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.707+0000 7f7ab9b25640 1 -- 172.21.15.44:0/2216028213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab40c91a0 con 0x7f7ab40cbc70 2023-11-04T01:37:07.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.708+0000 7f7ab9b25640 1 -- 172.21.15.44:0/2216028213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab4155410 con 0x7f7ab40cbc70 2023-11-04T01:37:07.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.709+0000 7f7a9bfff640 1 -- 172.21.15.44:0/2216028213 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7aac0157d0 con 0x7f7ab40cbc70 2023-11-04T01:37:07.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.709+0000 7f7a9bfff640 1 --2- 172.21.15.44:0/2216028213 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7aa006aea0 0x7f7aa006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.709+0000 7f7a9bfff640 1 -- 172.21.15.44:0/2216028213 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7aac08a040 con 0x7f7ab40cbc70 2023-11-04T01:37:07.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.710+0000 7f7ab37fe640 1 --2- 172.21.15.44:0/2216028213 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7aa006aea0 0x7f7aa006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.710+0000 7f7ab37fe640 1 --2- 172.21.15.44:0/2216028213 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7aa006aea0 0x7f7aa006d360 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009a60 tx=0x7f7aa4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.713+0000 7f7a9bfff640 1 -- 172.21.15.44:0/2216028213 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7aac054d30 con 0x7f7ab40cbc70 2023-11-04T01:37:07.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.887+0000 7f7ab9b25640 1 -- 172.21.15.44:0/2216028213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7ab4074290 con 0x7f7ab40cbc70 2023-11-04T01:37:07.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.887+0000 7f7a9bfff640 1 -- 172.21.15.44:0/2216028213 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7aac058350 con 0x7f7ab40cbc70 2023-11-04T01:37:07.889 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:37:07.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.889+0000 7f7ab9b25640 1 -- 172.21.15.44:0/2216028213 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7aa006aea0 msgr2=0x7f7aa006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.889+0000 7f7ab9b25640 1 --2- 172.21.15.44:0/2216028213 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7aa006aea0 0x7f7aa006d360 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009a60 tx=0x7f7aa4009190 comp rx=0 tx=0).stop 2023-11-04T01:37:07.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.889+0000 7f7ab9b25640 1 -- 172.21.15.44:0/2216028213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab40cbc70 msgr2=0x7f7ab40cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.889+0000 7f7ab9b25640 1 --2- 172.21.15.44:0/2216028213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab40cbc70 0x7f7ab40cc0f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7ab408abe0 tx=0x7f7aac00f580 comp rx=0 tx=0).stop 2023-11-04T01:37:07.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.889+0000 7f7ab9b25640 1 -- 172.21.15.44:0/2216028213 shutdown_connections 2023-11-04T01:37:07.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.889+0000 7f7ab9b25640 1 --2- 172.21.15.44:0/2216028213 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7aa006aea0 0x7f7aa006d360 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.889+0000 7f7ab9b25640 1 --2- 172.21.15.44:0/2216028213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab40cbc70 0x7f7ab40cc0f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.889+0000 7f7ab9b25640 1 --2- 172.21.15.44:0/2216028213 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ab40c8390 0x7f7ab4150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.889+0000 7f7ab9b25640 1 --2- 172.21.15.44:0/2216028213 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7a9c0047c0 0x7f7ab40d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.889+0000 7f7ab9b25640 1 -- 172.21.15.44:0/2216028213 >> 172.21.15.44:0/2216028213 conn(0x7f7ab40cf880 msgr2=0x7f7ab40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:07.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.889+0000 7f7ab9b25640 1 -- 172.21.15.44:0/2216028213 shutdown_connections 2023-11-04T01:37:07.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:07.889+0000 7f7ab9b25640 1 -- 172.21.15.44:0/2216028213 wait complete. 2023-11-04T01:37:07.902 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:08.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.007+0000 7fe7c6b9e640 1 Processor -- start 2023-11-04T01:37:08.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.007+0000 7fe7c6b9e640 1 -- start start 2023-11-04T01:37:08.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.008+0000 7fe7c6b9e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe7c00b8540 0x7fe7c00b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.008+0000 7fe7c6b9e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c00d14f0 con 0x7fe7c00d0ff0 2023-11-04T01:37:08.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.008+0000 7fe7c6b9e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c00d17d0 con 0x7fe7c00d2b40 2023-11-04T01:37:08.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.008+0000 7fe7c6b9e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c00d2170 con 0x7fe7c00b8540 2023-11-04T01:37:08.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.008+0000 7fe7c639d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe7c00b8540 0x7fe7c00b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.008+0000 7fe7c639d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe7c00b8540 0x7fe7c00b6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37718/0 (socket says 172.21.15.44:37718) 2023-11-04T01:37:08.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.008+0000 7fe7c539b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe7c00d0ff0 0x7fe7c00b5d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49146/0 (socket says 172.21.15.44:49146) 2023-11-04T01:37:08.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.008+0000 7fe7c639d640 1 -- 172.21.15.44:0/1429983413 learned_addr learned my addr 172.21.15.44:0/1429983413 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:08.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.008+0000 7fe7c639d640 1 -- 172.21.15.44:0/1429983413 >> v1:172.21.15.204:6789/0 conn(0x7fe7c00d2b40 legacy=0x7fe7c00d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.008+0000 7fe7c639d640 1 -- 172.21.15.44:0/1429983413 >> v1:172.21.15.44:6789/0 conn(0x7fe7c00d0ff0 legacy=0x7fe7c00b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.008+0000 7fe7c639d640 1 -- 172.21.15.44:0/1429983413 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c00d1ab0 con 0x7fe7c00b8540 2023-11-04T01:37:08.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.008+0000 7fe7c4b9a640 1 -- 172.21.15.44:0/1429983413 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304335157 0 0) 0x7fe7c00d14f0 con 0x7fe7c00d0ff0 2023-11-04T01:37:08.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.009+0000 7fe7c639d640 1 --2- 172.21.15.44:0/1429983413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c00b8540 0x7fe7c00b6460 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009e50 tx=0x7fe7b802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f37e44460049fe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:08.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.009+0000 7fe7c4b9a640 1 -- 172.21.15.44:0/1429983413 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b802cbb0 con 0x7fe7c00b8540 2023-11-04T01:37:08.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.009+0000 7fe7c4b9a640 1 -- 172.21.15.44:0/1429983413 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b802cd10 con 0x7fe7c00b8540 2023-11-04T01:37:08.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.009+0000 7fe7c4b9a640 1 -- 172.21.15.44:0/1429983413 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8034610 con 0x7fe7c00b8540 2023-11-04T01:37:08.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.010+0000 7fe7c6b9e640 1 -- 172.21.15.44:0/1429983413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c00b8540 msgr2=0x7fe7c00b6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.010+0000 7fe7c6b9e640 1 --2- 172.21.15.44:0/1429983413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c00b8540 0x7fe7c00b6460 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009e50 tx=0x7fe7b802c010 comp rx=0 tx=0).stop 2023-11-04T01:37:08.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.010+0000 7fe7c6b9e640 1 -- 172.21.15.44:0/1429983413 shutdown_connections 2023-11-04T01:37:08.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.010+0000 7fe7c6b9e640 1 --2- 172.21.15.44:0/1429983413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c00b8540 0x7fe7c00b6460 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.010+0000 7fe7c6b9e640 1 -- 172.21.15.44:0/1429983413 >> 172.21.15.44:0/1429983413 conn(0x7fe7c0071c70 msgr2=0x7fe7c0072080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:08.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.010+0000 7fe7c6b9e640 1 -- 172.21.15.44:0/1429983413 shutdown_connections 2023-11-04T01:37:08.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.010+0000 7fe7c6b9e640 1 -- 172.21.15.44:0/1429983413 wait complete. 2023-11-04T01:37:08.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.011+0000 7fe7c6b9e640 1 Processor -- start 2023-11-04T01:37:08.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.011+0000 7fe7c6b9e640 1 -- start start 2023-11-04T01:37:08.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c6b9e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7c00b8540 0x7fe7c01f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c6b9e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7c00d0ff0 0x7fe7c00cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c6b9e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c00d2b40 0x7fe7c015f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c6b9e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c015d5e0 con 0x7fe7c00d2b40 2023-11-04T01:37:08.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c6b9e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c01f22e0 con 0x7fe7c00d0ff0 2023-11-04T01:37:08.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c6b9e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00cc1a0 con 0x7fe7c00b8540 2023-11-04T01:37:08.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c639d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c00d2b40 0x7fe7c015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c639d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c00d2b40 0x7fe7c015f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37726/0 (socket says 172.21.15.44:37726) 2023-11-04T01:37:08.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c639d640 1 -- 172.21.15.44:0/628421589 learned_addr learned my addr 172.21.15.44:0/628421589 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:08.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c539b640 1 --2- 172.21.15.44:0/628421589 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7c00d0ff0 0x7fe7c00cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c5b9c640 1 --2- 172.21.15.44:0/628421589 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7c00b8540 0x7fe7c01f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c639d640 1 -- 172.21.15.44:0/628421589 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7c00b8540 msgr2=0x7fe7c01f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c639d640 1 --2- 172.21.15.44:0/628421589 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7c00b8540 0x7fe7c01f1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c639d640 1 -- 172.21.15.44:0/628421589 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7c00d0ff0 msgr2=0x7fe7c00cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c639d640 1 --2- 172.21.15.44:0/628421589 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7c00d0ff0 0x7fe7c00cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.012+0000 7fe7c639d640 1 -- 172.21.15.44:0/628421589 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b8009b30 con 0x7fe7c00d2b40 2023-11-04T01:37:08.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.013+0000 7fe7c639d640 1 --2- 172.21.15.44:0/628421589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c00d2b40 0x7fe7c015f920 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8036040 tx=0x7fe7b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:08.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.013+0000 7fe7b67fc640 1 -- 172.21.15.44:0/628421589 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b803e450 con 0x7fe7c00d2b40 2023-11-04T01:37:08.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.013+0000 7fe7b67fc640 1 -- 172.21.15.44:0/628421589 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b803e5d0 con 0x7fe7c00d2b40 2023-11-04T01:37:08.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.013+0000 7fe7c6b9e640 1 -- 172.21.15.44:0/628421589 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c00cc480 con 0x7fe7c00d2b40 2023-11-04T01:37:08.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.013+0000 7fe7b67fc640 1 -- 172.21.15.44:0/628421589 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b803e980 con 0x7fe7c00d2b40 2023-11-04T01:37:08.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.013+0000 7fe7c6b9e640 1 -- 172.21.15.44:0/628421589 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c015d270 con 0x7fe7c00d2b40 2023-11-04T01:37:08.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.014+0000 7fe7c6b9e640 1 -- 172.21.15.44:0/628421589 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c015d750 con 0x7fe7c00d2b40 2023-11-04T01:37:08.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.014+0000 7fe7b67fc640 1 -- 172.21.15.44:0/628421589 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe7b803eae0 con 0x7fe7c00d2b40 2023-11-04T01:37:08.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.015+0000 7fe7b67fc640 1 --2- 172.21.15.44:0/628421589 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe7a406ae70 0x7fe7a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.015+0000 7fe7b67fc640 1 -- 172.21.15.44:0/628421589 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe7b80ac930 con 0x7fe7c00d2b40 2023-11-04T01:37:08.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.015+0000 7fe7c5b9c640 1 --2- 172.21.15.44:0/628421589 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe7a406ae70 0x7fe7a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.016+0000 7fe7c5b9c640 1 --2- 172.21.15.44:0/628421589 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe7a406ae70 0x7fe7a406d330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc000f60 tx=0x7fe7bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:08.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.019+0000 7fe7b67fc640 1 -- 172.21.15.44:0/628421589 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7b8077630 con 0x7fe7c00d2b40 2023-11-04T01:37:08.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.231+0000 7fe7c6b9e640 1 -- 172.21.15.44:0/628421589 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7c004ece0 con 0x7fe7c00d2b40 2023-11-04T01:37:08.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.231+0000 7fe7b67fc640 1 -- 172.21.15.44:0/628421589 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fe7b807ac50 con 0x7fe7c00d2b40 2023-11-04T01:37:08.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:08.234 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2760874964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2760874964},{"type":"v1","addr":"172.21.15.204:6836","nonce":2760874964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3427243577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3427243577},{"type":"v1","addr":"172.21.15.44:6833","nonce":3427243577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/178191500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":178191500},{"type":"v1","addr":"172.21.15.204:6837","nonce":178191500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:58.556492+0000","modified":"2023-11-04T01:36:15.592459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/240936603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":240936603},{"type":"v1","addr":"172.21.15.44:6835","nonce":240936603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:37:08.234 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2023-11-04T01:37:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.234+0000 7fe7c6b9e640 1 -- 172.21.15.44:0/628421589 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe7a406ae70 msgr2=0x7fe7a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.234+0000 7fe7c6b9e640 1 --2- 172.21.15.44:0/628421589 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe7a406ae70 0x7fe7a406d330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc000f60 tx=0x7fe7bc009040 comp rx=0 tx=0).stop 2023-11-04T01:37:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.234+0000 7fe7c6b9e640 1 -- 172.21.15.44:0/628421589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c00d2b40 msgr2=0x7fe7c015f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.234+0000 7fe7c6b9e640 1 --2- 172.21.15.44:0/628421589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c00d2b40 0x7fe7c015f920 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8036040 tx=0x7fe7b8004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.234+0000 7fe7c6b9e640 1 -- 172.21.15.44:0/628421589 shutdown_connections 2023-11-04T01:37:08.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.234+0000 7fe7c6b9e640 1 --2- 172.21.15.44:0/628421589 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe7a406ae70 0x7fe7a406d330 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.234+0000 7fe7c6b9e640 1 --2- 172.21.15.44:0/628421589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c00d2b40 0x7fe7c015f920 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.234+0000 7fe7c6b9e640 1 --2- 172.21.15.44:0/628421589 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7c00d0ff0 0x7fe7c00cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.234+0000 7fe7c6b9e640 1 --2- 172.21.15.44:0/628421589 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7c00b8540 0x7fe7c01f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.234+0000 7fe7c6b9e640 1 -- 172.21.15.44:0/628421589 >> 172.21.15.44:0/628421589 conn(0x7fe7c0071c70 msgr2=0x7fe7c00c8500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:08.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.234+0000 7fe7c6b9e640 1 -- 172.21.15.44:0/628421589 shutdown_connections 2023-11-04T01:37:08.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.234+0000 7fe7c6b9e640 1 -- 172.21.15.44:0/628421589 wait complete. 2023-11-04T01:37:08.247 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:08.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.350+0000 7f31fb91d640 1 Processor -- start 2023-11-04T01:37:08.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.351+0000 7f31fb91d640 1 -- start start 2023-11-04T01:37:08.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.351+0000 7f31fb91d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31f4160b10 0x7f31f4160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.351+0000 7f31fb91d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f406bf00 con 0x7f31f415ce60 2023-11-04T01:37:08.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.351+0000 7f31fb91d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f41615d0 con 0x7f31f40cf160 2023-11-04T01:37:08.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.351+0000 7f31fb91d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f40cbde0 con 0x7f31f4160b10 2023-11-04T01:37:08.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.352+0000 7f31f96b9640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f31f415ce60 0x7f31f406b7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49152/0 (socket says 172.21.15.44:49152) 2023-11-04T01:37:08.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.352+0000 7f31f96b9640 1 -- 172.21.15.44:0/2894589723 learned_addr learned my addr 172.21.15.44:0/2894589723 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:08.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.352+0000 7f31f8eb8640 1 --2- 172.21.15.44:0/2894589723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31f4160b10 0x7f31f4160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.352+0000 7f31ebfff640 1 -- 172.21.15.44:0/2894589723 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019161539 0 0) 0x7f31f406bf00 con 0x7f31f415ce60 2023-11-04T01:37:08.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.352+0000 7f31ebfff640 1 -- 172.21.15.44:0/2894589723 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e0003520 con 0x7f31f415ce60 2023-11-04T01:37:08.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.352+0000 7f31f8eb8640 1 -- 172.21.15.44:0/2894589723 >> v1:172.21.15.204:6789/0 conn(0x7f31f40cf160 legacy=0x7f31f40cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.352+0000 7f31ebfff640 1 -- 172.21.15.44:0/2894589723 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126463060 0 0) 0x7f31f41615d0 con 0x7f31f40cf160 2023-11-04T01:37:08.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.352+0000 7f31f8eb8640 1 -- 172.21.15.44:0/2894589723 >> v1:172.21.15.44:6789/0 conn(0x7f31f415ce60 legacy=0x7f31f406b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.352+0000 7f31f8eb8640 1 -- 172.21.15.44:0/2894589723 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f41618b0 con 0x7f31f4160b10 2023-11-04T01:37:08.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.353+0000 7f31f8eb8640 1 --2- 172.21.15.44:0/2894589723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31f4160b10 0x7f31f4160f90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f31e40097d0 tx=0x7f31e402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbc8494b056a029c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:08.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.353+0000 7f31ebfff640 1 -- 172.21.15.44:0/2894589723 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e4031890 con 0x7f31f4160b10 2023-11-04T01:37:08.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.353+0000 7f31ebfff640 1 -- 172.21.15.44:0/2894589723 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e40319f0 con 0x7f31f4160b10 2023-11-04T01:37:08.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.353+0000 7f31ebfff640 1 -- 172.21.15.44:0/2894589723 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e4031d80 con 0x7f31f4160b10 2023-11-04T01:37:08.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.354+0000 7f31fb91d640 1 -- 172.21.15.44:0/2894589723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31f4160b10 msgr2=0x7f31f4160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.354+0000 7f31fb91d640 1 --2- 172.21.15.44:0/2894589723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31f4160b10 0x7f31f4160f90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f31e40097d0 tx=0x7f31e402b930 comp rx=0 tx=0).stop 2023-11-04T01:37:08.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.354+0000 7f31fb91d640 1 -- 172.21.15.44:0/2894589723 shutdown_connections 2023-11-04T01:37:08.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.354+0000 7f31fb91d640 1 --2- 172.21.15.44:0/2894589723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31f4160b10 0x7f31f4160f90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.354+0000 7f31fb91d640 1 -- 172.21.15.44:0/2894589723 >> 172.21.15.44:0/2894589723 conn(0x7f31f406ea90 msgr2=0x7f31f406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:08.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.354+0000 7f31fb91d640 1 -- 172.21.15.44:0/2894589723 shutdown_connections 2023-11-04T01:37:08.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.354+0000 7f31fb91d640 1 -- 172.21.15.44:0/2894589723 wait complete. 2023-11-04T01:37:08.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.355+0000 7f31fb91d640 1 Processor -- start 2023-11-04T01:37:08.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.355+0000 7f31fb91d640 1 -- start start 2023-11-04T01:37:08.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31fb91d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31f40cf160 0x7f31f4151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31fb91d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31f415ce60 0x7f31f40ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31fb91d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31f4160b10 0x7f31f40b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31fb91d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f4151680 con 0x7f31f40cf160 2023-11-04T01:37:08.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31fb91d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f4152540 con 0x7f31f4160b10 2023-11-04T01:37:08.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31fb91d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f40c8bf0 con 0x7f31f415ce60 2023-11-04T01:37:08.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31f96b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31f40cf160 0x7f31f4151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31f96b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31f40cf160 0x7f31f4151140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37732/0 (socket says 172.21.15.44:37732) 2023-11-04T01:37:08.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31f96b9640 1 -- 172.21.15.44:0/2534378237 learned_addr learned my addr 172.21.15.44:0/2534378237 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:08.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31f8eb8640 1 --2- 172.21.15.44:0/2534378237 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31f415ce60 0x7f31f40ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31f9eba640 1 --2- 172.21.15.44:0/2534378237 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31f4160b10 0x7f31f40b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31f96b9640 1 -- 172.21.15.44:0/2534378237 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31f415ce60 msgr2=0x7f31f40ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31f96b9640 1 --2- 172.21.15.44:0/2534378237 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31f415ce60 0x7f31f40ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31f96b9640 1 -- 172.21.15.44:0/2534378237 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31f4160b10 msgr2=0x7f31f40b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31f96b9640 1 --2- 172.21.15.44:0/2534378237 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31f4160b10 0x7f31f40b56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31f96b9640 1 -- 172.21.15.44:0/2534378237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e4009400 con 0x7f31f40cf160 2023-11-04T01:37:08.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31f96b9640 1 --2- 172.21.15.44:0/2534378237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31f40cf160 0x7f31f4151140 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f31f000c3c0 tx=0x7f31f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:08.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31e9ffb640 1 -- 172.21.15.44:0/2534378237 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0005ce0 con 0x7f31f40cf160 2023-11-04T01:37:08.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31e9ffb640 1 -- 172.21.15.44:0/2534378237 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f0005e40 con 0x7f31f40cf160 2023-11-04T01:37:08.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31fb91d640 1 -- 172.21.15.44:0/2534378237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f40c8ed0 con 0x7f31f40cf160 2023-11-04T01:37:08.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.356+0000 7f31e9ffb640 1 -- 172.21.15.44:0/2534378237 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00072f0 con 0x7f31f40cf160 2023-11-04T01:37:08.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.357+0000 7f31fb91d640 1 -- 172.21.15.44:0/2534378237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f40c9490 con 0x7f31f40cf160 2023-11-04T01:37:08.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.358+0000 7f31fb91d640 1 -- 172.21.15.44:0/2534378237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f4074290 con 0x7f31f40cf160 2023-11-04T01:37:08.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.358+0000 7f31e9ffb640 1 -- 172.21.15.44:0/2534378237 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31f0007450 con 0x7f31f40cf160 2023-11-04T01:37:08.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.358+0000 7f31e9ffb640 1 --2- 172.21.15.44:0/2534378237 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f31d806ae70 0x7f31d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.358+0000 7f31e9ffb640 1 -- 172.21.15.44:0/2534378237 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f31f0088f80 con 0x7f31f40cf160 2023-11-04T01:37:08.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.359+0000 7f31f8eb8640 1 --2- 172.21.15.44:0/2534378237 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f31d806ae70 0x7f31d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.359+0000 7f31f8eb8640 1 --2- 172.21.15.44:0/2534378237 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f31d806ae70 0x7f31d806d330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f31e4036000 tx=0x7f31e403d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:08.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.363+0000 7f31e9ffb640 1 -- 172.21.15.44:0/2534378237 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f31f0053c80 con 0x7f31f40cf160 2023-11-04T01:37:08.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.540+0000 7f31fb91d640 1 -- 172.21.15.44:0/2534378237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31f40cee80 con 0x7f31f40cf160 2023-11-04T01:37:08.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.542+0000 7f31e9ffb640 1 -- 172.21.15.44:0/2534378237 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7f31f0017070 con 0x7f31f40cf160 2023-11-04T01:37:08.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:08.544 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.543+0000 7f31fb91d640 1 -- 172.21.15.44:0/2534378237 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f31d806ae70 msgr2=0x7f31d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.543+0000 7f31fb91d640 1 --2- 172.21.15.44:0/2534378237 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f31d806ae70 0x7f31d806d330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f31e4036000 tx=0x7f31e403d040 comp rx=0 tx=0).stop 2023-11-04T01:37:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.543+0000 7f31fb91d640 1 -- 172.21.15.44:0/2534378237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31f40cf160 msgr2=0x7f31f4151140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.543+0000 7f31fb91d640 1 --2- 172.21.15.44:0/2534378237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31f40cf160 0x7f31f4151140 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f31f000c3c0 tx=0x7f31f000c880 comp rx=0 tx=0).stop 2023-11-04T01:37:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.543+0000 7f31fb91d640 1 -- 172.21.15.44:0/2534378237 shutdown_connections 2023-11-04T01:37:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.543+0000 7f31fb91d640 1 --2- 172.21.15.44:0/2534378237 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f31d806ae70 0x7f31d806d330 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.543+0000 7f31fb91d640 1 --2- 172.21.15.44:0/2534378237 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31f4160b10 0x7f31f40b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.543+0000 7f31fb91d640 1 --2- 172.21.15.44:0/2534378237 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31f415ce60 0x7f31f40ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.543+0000 7f31fb91d640 1 --2- 172.21.15.44:0/2534378237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31f40cf160 0x7f31f4151140 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.543+0000 7f31fb91d640 1 -- 172.21.15.44:0/2534378237 >> 172.21.15.44:0/2534378237 conn(0x7f31f406ea90 msgr2=0x7f31f406b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.544+0000 7f31fb91d640 1 -- 172.21.15.44:0/2534378237 shutdown_connections 2023-11-04T01:37:08.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.544+0000 7f31fb91d640 1 -- 172.21.15.44:0/2534378237 wait complete. 2023-11-04T01:37:08.557 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:37:08.557 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:08.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.661+0000 7f7750ba9640 1 Processor -- start 2023-11-04T01:37:08.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.661+0000 7f7750ba9640 1 -- start start 2023-11-04T01:37:08.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.662+0000 7f7750ba9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f774c15ce60 0x7f774c06b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.662+0000 7f7750ba9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f774c0cf160 0x7f774c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.662+0000 7f7750ba9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f774c1615d0 con 0x7f774c06bd30 2023-11-04T01:37:08.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.662+0000 7f7750ba9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774c0cbde0 con 0x7f774c15ce60 2023-11-04T01:37:08.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.662+0000 7f7750ba9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774c0cfb30 con 0x7f774c0cf160 2023-11-04T01:37:08.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.662+0000 7f774a59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f774c15ce60 0x7f774c06b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.662+0000 7f774a59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f774c15ce60 0x7f774c06b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37742/0 (socket says 172.21.15.44:37742) 2023-11-04T01:37:08.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.662+0000 7f774a59c640 1 -- 172.21.15.44:0/1155195590 learned_addr learned my addr 172.21.15.44:0/1155195590 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:08.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.662+0000 7f774a59c640 1 -- 172.21.15.44:0/1155195590 >> v2:172.21.15.204:3300/0 conn(0x7f774c0cf160 msgr2=0x7f774c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:08.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.662+0000 7f774a59c640 1 --2- 172.21.15.44:0/1155195590 >> v2:172.21.15.204:3300/0 conn(0x7f774c0cf160 0x7f774c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.662+0000 7f774a59c640 1 -- 172.21.15.44:0/1155195590 >> v1:172.21.15.204:6789/0 conn(0x7f774c06bd30 legacy=0x7f774c160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:08.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.662+0000 7f774a59c640 1 -- 172.21.15.44:0/1155195590 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774c1618b0 con 0x7f774c15ce60 2023-11-04T01:37:08.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.663+0000 7f774a59c640 1 --2- 172.21.15.44:0/1155195590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f774c15ce60 0x7f774c06b7f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f774c06f7a0 tx=0x7f774402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aaf4876a8c096e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:08.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.663+0000 7f774959a640 1 -- 172.21.15.44:0/1155195590 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744031870 con 0x7f774c15ce60 2023-11-04T01:37:08.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.663+0000 7f774959a640 1 -- 172.21.15.44:0/1155195590 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77440319d0 con 0x7f774c15ce60 2023-11-04T01:37:08.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.663+0000 7f774959a640 1 -- 172.21.15.44:0/1155195590 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744031d60 con 0x7f774c15ce60 2023-11-04T01:37:08.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.664+0000 7f7750ba9640 1 -- 172.21.15.44:0/1155195590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f774c15ce60 msgr2=0x7f774c06b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.664+0000 7f7750ba9640 1 --2- 172.21.15.44:0/1155195590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f774c15ce60 0x7f774c06b7f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f774c06f7a0 tx=0x7f774402b910 comp rx=0 tx=0).stop 2023-11-04T01:37:08.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.664+0000 7f7750ba9640 1 -- 172.21.15.44:0/1155195590 shutdown_connections 2023-11-04T01:37:08.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.664+0000 7f7750ba9640 1 --2- 172.21.15.44:0/1155195590 >> v2:172.21.15.204:3300/0 conn(0x7f774c0cf160 0x7f774c0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.664+0000 7f7750ba9640 1 --2- 172.21.15.44:0/1155195590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f774c15ce60 0x7f774c06b7f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.664+0000 7f7750ba9640 1 -- 172.21.15.44:0/1155195590 >> 172.21.15.44:0/1155195590 conn(0x7f774c06ea90 msgr2=0x7f774c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:08.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.664+0000 7f7750ba9640 1 -- 172.21.15.44:0/1155195590 shutdown_connections 2023-11-04T01:37:08.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.664+0000 7f7750ba9640 1 -- 172.21.15.44:0/1155195590 wait complete. 2023-11-04T01:37:08.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.665+0000 7f7750ba9640 1 Processor -- start 2023-11-04T01:37:08.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.665+0000 7f7750ba9640 1 -- start start 2023-11-04T01:37:08.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f7750ba9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f774c0cf160 0x7f774c15f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f7750ba9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f774c15ce60 0x7f774c1e9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f7750ba9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f774c1e6910 0x7f774c1e6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f7750ba9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774c15ef70 con 0x7f774c0cf160 2023-11-04T01:37:08.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f7750ba9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774c1e73d0 con 0x7f774c1e6910 2023-11-04T01:37:08.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f7750ba9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774c15e8b0 con 0x7f774c15ce60 2023-11-04T01:37:08.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f774a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f774c0cf160 0x7f774c15f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f774a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f774c0cf160 0x7f774c15f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37756/0 (socket says 172.21.15.44:37756) 2023-11-04T01:37:08.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f774a59c640 1 -- 172.21.15.44:0/193547634 learned_addr learned my addr 172.21.15.44:0/193547634 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:08.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f774ad9d640 1 --2- 172.21.15.44:0/193547634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f774c1e6910 0x7f774c1e6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f774a59c640 1 -- 172.21.15.44:0/193547634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f774c15ce60 msgr2=0x7f774c1e9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f774a59c640 1 --2- 172.21.15.44:0/193547634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f774c15ce60 0x7f774c1e9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f774a59c640 1 -- 172.21.15.44:0/193547634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f774c1e6910 msgr2=0x7f774c1e6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f774a59c640 1 --2- 172.21.15.44:0/193547634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f774c1e6910 0x7f774c1e6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f774a59c640 1 -- 172.21.15.44:0/193547634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77440094d0 con 0x7f774c0cf160 2023-11-04T01:37:08.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.666+0000 7f774ad9d640 1 --2- 172.21.15.44:0/193547634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f774c1e6910 0x7f774c1e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:08.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.667+0000 7f774a59c640 1 --2- 172.21.15.44:0/193547634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f774c0cf160 0x7f774c15f390 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7744000c00 tx=0x7f77440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:08.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.667+0000 7f7742ffd640 1 -- 172.21.15.44:0/193547634 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744031840 con 0x7f774c0cf160 2023-11-04T01:37:08.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.667+0000 7f7742ffd640 1 -- 172.21.15.44:0/193547634 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77440443f0 con 0x7f774c0cf160 2023-11-04T01:37:08.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.667+0000 7f7750ba9640 1 -- 172.21.15.44:0/193547634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f774c15eb90 con 0x7f774c0cf160 2023-11-04T01:37:08.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.667+0000 7f7742ffd640 1 -- 172.21.15.44:0/193547634 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77440447c0 con 0x7f774c0cf160 2023-11-04T01:37:08.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.667+0000 7f7750ba9640 1 -- 172.21.15.44:0/193547634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f774c1e76b0 con 0x7f774c0cf160 2023-11-04T01:37:08.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.668+0000 7f7750ba9640 1 -- 172.21.15.44:0/193547634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774c15f1e0 con 0x7f774c0cf160 2023-11-04T01:37:08.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.668+0000 7f7742ffd640 1 -- 172.21.15.44:0/193547634 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7744044920 con 0x7f774c0cf160 2023-11-04T01:37:08.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.669+0000 7f7742ffd640 1 --2- 172.21.15.44:0/193547634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f772c06aea0 0x7f772c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.669+0000 7f7742ffd640 1 -- 172.21.15.44:0/193547634 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f774402d040 con 0x7f774c0cf160 2023-11-04T01:37:08.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.669+0000 7f7749d9b640 1 --2- 172.21.15.44:0/193547634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f772c06aea0 0x7f772c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.670+0000 7f7749d9b640 1 --2- 172.21.15.44:0/193547634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f772c06aea0 0x7f772c06d360 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f774c15a830 tx=0x7f7734006ba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:08.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.673+0000 7f7742ffd640 1 -- 172.21.15.44:0/193547634 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7744077030 con 0x7f774c0cf160 2023-11-04T01:37:08.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.885+0000 7f7750ba9640 1 -- 172.21.15.44:0/193547634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f774c074290 con 0x7f774c0cf160 2023-11-04T01:37:08.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.886+0000 7f7742ffd640 1 -- 172.21.15.44:0/193547634 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f774407a650 con 0x7f774c0cf160 2023-11-04T01:37:08.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:08.888 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2760874964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2760874964},{"type":"v1","addr":"172.21.15.204:6836","nonce":2760874964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3427243577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3427243577},{"type":"v1","addr":"172.21.15.44:6833","nonce":3427243577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/178191500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":178191500},{"type":"v1","addr":"172.21.15.204:6837","nonce":178191500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:58.556492+0000","modified":"2023-11-04T01:36:15.592459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/240936603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":240936603},{"type":"v1","addr":"172.21.15.44:6835","nonce":240936603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:37:08.889 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2023-11-04T01:37:08.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.888+0000 7f7750ba9640 1 -- 172.21.15.44:0/193547634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f772c06aea0 msgr2=0x7f772c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.888+0000 7f7750ba9640 1 --2- 172.21.15.44:0/193547634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f772c06aea0 0x7f772c06d360 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f774c15a830 tx=0x7f7734006ba0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.888+0000 7f7750ba9640 1 -- 172.21.15.44:0/193547634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f774c0cf160 msgr2=0x7f774c15f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.888+0000 7f7750ba9640 1 --2- 172.21.15.44:0/193547634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f774c0cf160 0x7f774c15f390 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7744000c00 tx=0x7f77440046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.888+0000 7f7750ba9640 1 -- 172.21.15.44:0/193547634 shutdown_connections 2023-11-04T01:37:08.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.888+0000 7f7750ba9640 1 --2- 172.21.15.44:0/193547634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f772c06aea0 0x7f772c06d360 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.888+0000 7f7750ba9640 1 --2- 172.21.15.44:0/193547634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f774c1e6910 0x7f774c1e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.888+0000 7f7750ba9640 1 --2- 172.21.15.44:0/193547634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f774c15ce60 0x7f774c1e9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.888+0000 7f7750ba9640 1 --2- 172.21.15.44:0/193547634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f774c0cf160 0x7f774c15f390 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.888+0000 7f7750ba9640 1 -- 172.21.15.44:0/193547634 >> 172.21.15.44:0/193547634 conn(0x7f774c06ea90 msgr2=0x7f774c0c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:08.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.888+0000 7f7750ba9640 1 -- 172.21.15.44:0/193547634 shutdown_connections 2023-11-04T01:37:08.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:08.888+0000 7f7750ba9640 1 -- 172.21.15.44:0/193547634 wait complete. 2023-11-04T01:37:08.901 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:09.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.005+0000 7f9b5b42b640 1 Processor -- start 2023-11-04T01:37:09.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.006+0000 7f9b5b42b640 1 -- start start 2023-11-04T01:37:09.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.006+0000 7f9b5b42b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9b540cec10 0x7f9b540b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.006+0000 7f9b5b42b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b540b2b40 0x7f9b540b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.006+0000 7f9b5b42b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b540b3c10 con 0x7f9b5415ac70 2023-11-04T01:37:09.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.006+0000 7f9b5b42b640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b540b2ff0 con 0x7f9b540cec10 2023-11-04T01:37:09.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.006+0000 7f9b5b42b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540cf180 con 0x7f9b540b2b40 2023-11-04T01:37:09.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.007+0000 7f9b589c6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9b540cec10 0x7f9b540b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.007+0000 7f9b589c6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9b540cec10 0x7f9b540b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37762/0 (socket says 172.21.15.44:37762) 2023-11-04T01:37:09.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.007+0000 7f9b589c6640 1 -- 172.21.15.44:0/382914145 learned_addr learned my addr 172.21.15.44:0/382914145 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:09.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.007+0000 7f9b599c8640 1 --2- 172.21.15.44:0/382914145 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b540b2b40 0x7f9b540b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.007+0000 7f9b589c6640 1 -- 172.21.15.44:0/382914145 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b540b2b40 msgr2=0x7f9b540b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:09.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.007+0000 7f9b589c6640 1 --2- 172.21.15.44:0/382914145 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b540b2b40 0x7f9b540b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.007+0000 7f9b589c6640 1 -- 172.21.15.44:0/382914145 >> v1:172.21.15.204:6789/0 conn(0x7f9b5415ac70 legacy=0x7f9b540d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.007+0000 7f9b589c6640 1 -- 172.21.15.44:0/382914145 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b540cf460 con 0x7f9b540cec10 2023-11-04T01:37:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.008+0000 7f9b589c6640 1 --2- 172.21.15.44:0/382914145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b540cec10 0x7f9b540b2600 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9b540b3700 tx=0x7f9b4402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1580f4ce348cc6e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.008+0000 7f9b4bfff640 1 -- 172.21.15.44:0/382914145 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44031830 con 0x7f9b540cec10 2023-11-04T01:37:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.008+0000 7f9b4bfff640 1 -- 172.21.15.44:0/382914145 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b44031990 con 0x7f9b540cec10 2023-11-04T01:37:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.008+0000 7f9b4bfff640 1 -- 172.21.15.44:0/382914145 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44031d20 con 0x7f9b540cec10 2023-11-04T01:37:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.008+0000 7f9b5b42b640 1 -- 172.21.15.44:0/382914145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b540cec10 msgr2=0x7f9b540b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.008+0000 7f9b5b42b640 1 --2- 172.21.15.44:0/382914145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b540cec10 0x7f9b540b2600 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9b540b3700 tx=0x7f9b4402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.008+0000 7f9b5b42b640 1 -- 172.21.15.44:0/382914145 shutdown_connections 2023-11-04T01:37:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.008+0000 7f9b5b42b640 1 --2- 172.21.15.44:0/382914145 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b540b2b40 0x7f9b540b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.008+0000 7f9b5b42b640 1 --2- 172.21.15.44:0/382914145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b540cec10 0x7f9b540b2600 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.008+0000 7f9b5b42b640 1 -- 172.21.15.44:0/382914145 >> 172.21.15.44:0/382914145 conn(0x7f9b540cd600 msgr2=0x7f9b540cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.009+0000 7f9b5b42b640 1 -- 172.21.15.44:0/382914145 shutdown_connections 2023-11-04T01:37:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.009+0000 7f9b5b42b640 1 -- 172.21.15.44:0/382914145 wait complete. 2023-11-04T01:37:09.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.010+0000 7f9b5b42b640 1 Processor -- start 2023-11-04T01:37:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.010+0000 7f9b5b42b640 1 -- start start 2023-11-04T01:37:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.010+0000 7f9b5b42b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b540b2b40 0x7f9b541e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.010+0000 7f9b5b42b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b540cec10 0x7f9b540c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.010+0000 7f9b5b42b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b5415ac70 0x7f9b54158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.010+0000 7f9b5b42b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540c7370 con 0x7f9b5415ac70 2023-11-04T01:37:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.010+0000 7f9b5b42b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b541e7290 con 0x7f9b540cec10 2023-11-04T01:37:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.010+0000 7f9b5b42b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540c5140 con 0x7f9b540b2b40 2023-11-04T01:37:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b599c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b5415ac70 0x7f9b54158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b599c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b5415ac70 0x7f9b54158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37770/0 (socket says 172.21.15.44:37770) 2023-11-04T01:37:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b599c8640 1 -- 172.21.15.44:0/1146448338 learned_addr learned my addr 172.21.15.44:0/1146448338 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b589c6640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b540cec10 0x7f9b540c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b591c7640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b540b2b40 0x7f9b541e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b599c8640 1 -- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b540b2b40 msgr2=0x7f9b541e6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b599c8640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b540b2b40 0x7f9b541e6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b599c8640 1 -- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b540cec10 msgr2=0x7f9b540c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b599c8640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b540cec10 0x7f9b540c6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b599c8640 1 -- 172.21.15.44:0/1146448338 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b440094d0 con 0x7f9b5415ac70 2023-11-04T01:37:09.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b591c7640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b540b2b40 0x7f9b541e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:09.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b589c6640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b540cec10 0x7f9b540c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:09.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b599c8640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b5415ac70 0x7f9b54158170 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c007e60 tx=0x7f9b4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b49ffb640 1 -- 172.21.15.44:0/1146448338 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c014420 con 0x7f9b5415ac70 2023-11-04T01:37:09.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b49ffb640 1 -- 172.21.15.44:0/1146448338 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c0145a0 con 0x7f9b5415ac70 2023-11-04T01:37:09.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b5b42b640 1 -- 172.21.15.44:0/1146448338 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b540c5420 con 0x7f9b5415ac70 2023-11-04T01:37:09.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b49ffb640 1 -- 172.21.15.44:0/1146448338 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c014950 con 0x7f9b5415ac70 2023-11-04T01:37:09.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.011+0000 7f9b5b42b640 1 -- 172.21.15.44:0/1146448338 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b540c59e0 con 0x7f9b5415ac70 2023-11-04T01:37:09.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.012+0000 7f9b5b42b640 1 -- 172.21.15.44:0/1146448338 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b540c5bd0 con 0x7f9b5415ac70 2023-11-04T01:37:09.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.013+0000 7f9b49ffb640 1 -- 172.21.15.44:0/1146448338 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b4c014ab0 con 0x7f9b5415ac70 2023-11-04T01:37:09.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.013+0000 7f9b49ffb640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9b3806ae70 0x7f9b3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.013+0000 7f9b49ffb640 1 -- 172.21.15.44:0/1146448338 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9b4c08a330 con 0x7f9b5415ac70 2023-11-04T01:37:09.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.014+0000 7f9b591c7640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9b3806ae70 0x7f9b3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.014+0000 7f9b591c7640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9b3806ae70 0x7f9b3806d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9b50003ee0 tx=0x7f9b50009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.018+0000 7f9b49ffb640 1 -- 172.21.15.44:0/1146448338 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9b4c055010 con 0x7f9b5415ac70 2023-11-04T01:37:09.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.233+0000 7f9b5b42b640 1 -- 172.21.15.44:0/1146448338 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b540b6b00 con 0x7f9b5415ac70 2023-11-04T01:37:09.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.233+0000 7f9b49ffb640 1 -- 172.21.15.44:0/1146448338 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f9b4c058630 con 0x7f9b5415ac70 2023-11-04T01:37:09.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:09.236 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2760874964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2760874964},{"type":"v1","addr":"172.21.15.204:6836","nonce":2760874964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3427243577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3427243577},{"type":"v1","addr":"172.21.15.44:6833","nonce":3427243577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/178191500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":178191500},{"type":"v1","addr":"172.21.15.204:6837","nonce":178191500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:58.556492+0000","modified":"2023-11-04T01:36:15.592459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/240936603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":240936603},{"type":"v1","addr":"172.21.15.44:6835","nonce":240936603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:37:09.236 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2023-11-04T01:37:09.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.235+0000 7f9b5b42b640 1 -- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9b3806ae70 msgr2=0x7f9b3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.235+0000 7f9b5b42b640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9b3806ae70 0x7f9b3806d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9b50003ee0 tx=0x7f9b50009040 comp rx=0 tx=0).stop 2023-11-04T01:37:09.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.235+0000 7f9b5b42b640 1 -- 172.21.15.44:0/1146448338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b5415ac70 msgr2=0x7f9b54158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.235+0000 7f9b5b42b640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b5415ac70 0x7f9b54158170 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c007e60 tx=0x7f9b4c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.235+0000 7f9b5b42b640 1 -- 172.21.15.44:0/1146448338 shutdown_connections 2023-11-04T01:37:09.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.235+0000 7f9b5b42b640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9b3806ae70 0x7f9b3806d330 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.235+0000 7f9b5b42b640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b5415ac70 0x7f9b54158170 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.235+0000 7f9b5b42b640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9b540cec10 0x7f9b540c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.235+0000 7f9b5b42b640 1 --2- 172.21.15.44:0/1146448338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9b540b2b40 0x7f9b541e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.235+0000 7f9b5b42b640 1 -- 172.21.15.44:0/1146448338 >> 172.21.15.44:0/1146448338 conn(0x7f9b540cd600 msgr2=0x7f9b540c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:09.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.235+0000 7f9b5b42b640 1 -- 172.21.15.44:0/1146448338 shutdown_connections 2023-11-04T01:37:09.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.235+0000 7f9b5b42b640 1 -- 172.21.15.44:0/1146448338 wait complete. 2023-11-04T01:37:09.248 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:09.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.352+0000 7f635264f640 1 Processor -- start 2023-11-04T01:37:09.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.352+0000 7f635264f640 1 -- start start 2023-11-04T01:37:09.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.353+0000 7f635264f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f634c0cde60 0x7f634c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.353+0000 7f635264f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f634c0ce240 0x7f634c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.353+0000 7f635264f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c15e000 con 0x7f634c15daa0 2023-11-04T01:37:09.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.353+0000 7f635264f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c15e5c0 con 0x7f634c0cde60 2023-11-04T01:37:09.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.353+0000 7f635264f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c15e2e0 con 0x7f634c0ce240 2023-11-04T01:37:09.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.353+0000 7f634bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f634c0cde60 0x7f634c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.353+0000 7f634b7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f634c15daa0 0x7f634c157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49164/0 (socket says 172.21.15.44:49164) 2023-11-04T01:37:09.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.353+0000 7f634b7fe640 1 -- 172.21.15.44:0/2023383843 learned_addr learned my addr 172.21.15.44:0/2023383843 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:09.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.354+0000 7f6350bec640 1 --2- 172.21.15.44:0/2023383843 >> v2:172.21.15.204:3300/0 conn(0x7f634c0ce240 0x7f634c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.354+0000 7f634bfff640 1 -- 172.21.15.44:0/2023383843 >> v2:172.21.15.204:3300/0 conn(0x7f634c0ce240 msgr2=0x7f634c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:09.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.354+0000 7f634bfff640 1 --2- 172.21.15.44:0/2023383843 >> v2:172.21.15.204:3300/0 conn(0x7f634c0ce240 0x7f634c0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.354+0000 7f634bfff640 1 -- 172.21.15.44:0/2023383843 >> v1:172.21.15.44:6789/0 conn(0x7f634c15daa0 legacy=0x7f634c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.354+0000 7f634bfff640 1 -- 172.21.15.44:0/2023383843 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c0d1120 con 0x7f634c0cde60 2023-11-04T01:37:09.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.354+0000 7f634bfff640 1 --2- 172.21.15.44:0/2023383843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0cde60 0x7f634c15d560 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f634c0cf2e0 tx=0x7f633c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8013e93d361df18d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.355+0000 7f634affd640 1 -- 172.21.15.44:0/2023383843 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c031830 con 0x7f634c0cde60 2023-11-04T01:37:09.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.355+0000 7f634affd640 1 -- 172.21.15.44:0/2023383843 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c031990 con 0x7f634c0cde60 2023-11-04T01:37:09.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.355+0000 7f634affd640 1 -- 172.21.15.44:0/2023383843 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c031d20 con 0x7f634c0cde60 2023-11-04T01:37:09.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.355+0000 7f635264f640 1 -- 172.21.15.44:0/2023383843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0cde60 msgr2=0x7f634c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.355+0000 7f635264f640 1 --2- 172.21.15.44:0/2023383843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0cde60 0x7f634c15d560 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f634c0cf2e0 tx=0x7f633c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.355+0000 7f635264f640 1 -- 172.21.15.44:0/2023383843 shutdown_connections 2023-11-04T01:37:09.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.355+0000 7f635264f640 1 --2- 172.21.15.44:0/2023383843 >> v2:172.21.15.204:3300/0 conn(0x7f634c0ce240 0x7f634c0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.355+0000 7f635264f640 1 --2- 172.21.15.44:0/2023383843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0cde60 0x7f634c15d560 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.355+0000 7f635264f640 1 -- 172.21.15.44:0/2023383843 >> 172.21.15.44:0/2023383843 conn(0x7f634c071f30 msgr2=0x7f634c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:09.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.355+0000 7f635264f640 1 -- 172.21.15.44:0/2023383843 shutdown_connections 2023-11-04T01:37:09.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.355+0000 7f635264f640 1 -- 172.21.15.44:0/2023383843 wait complete. 2023-11-04T01:37:09.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.356+0000 7f635264f640 1 Processor -- start 2023-11-04T01:37:09.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.357+0000 7f635264f640 1 -- start start 2023-11-04T01:37:09.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.357+0000 7f635264f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c0cde60 0x7f634c1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.357+0000 7f635264f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0ce240 0x7f634c1f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.357+0000 7f635264f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f634c15daa0 0x7f634c1e7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.357+0000 7f635264f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c155a10 con 0x7f634c0ce240 2023-11-04T01:37:09.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.357+0000 7f635264f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c1f6870 con 0x7f634c15daa0 2023-11-04T01:37:09.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.357+0000 7f635264f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c145360 con 0x7f634c0cde60 2023-11-04T01:37:09.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.357+0000 7f634b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0ce240 0x7f634c1f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.357+0000 7f634b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0ce240 0x7f634c1f6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37780/0 (socket says 172.21.15.44:37780) 2023-11-04T01:37:09.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.357+0000 7f634b7fe640 1 -- 172.21.15.44:0/142290878 learned_addr learned my addr 172.21.15.44:0/142290878 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:09.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.358+0000 7f6350bec640 1 --2- 172.21.15.44:0/142290878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f634c15daa0 0x7f634c1e7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.358+0000 7f634bfff640 1 --2- 172.21.15.44:0/142290878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c0cde60 0x7f634c1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.358+0000 7f634b7fe640 1 -- 172.21.15.44:0/142290878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c0cde60 msgr2=0x7f634c1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.358+0000 7f634b7fe640 1 --2- 172.21.15.44:0/142290878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c0cde60 0x7f634c1554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.358+0000 7f634b7fe640 1 -- 172.21.15.44:0/142290878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f634c15daa0 msgr2=0x7f634c1e7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.358+0000 7f634b7fe640 1 --2- 172.21.15.44:0/142290878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f634c15daa0 0x7f634c1e7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.358+0000 7f634b7fe640 1 -- 172.21.15.44:0/142290878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c009400 con 0x7f634c0ce240 2023-11-04T01:37:09.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.358+0000 7f634b7fe640 1 --2- 172.21.15.44:0/142290878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0ce240 0x7f634c1f6330 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f634000c3c0 tx=0x7f634000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.358+0000 7f6348ff9640 1 -- 172.21.15.44:0/142290878 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340005ce0 con 0x7f634c0ce240 2023-11-04T01:37:09.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.358+0000 7f6348ff9640 1 -- 172.21.15.44:0/142290878 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6340005e40 con 0x7f634c0ce240 2023-11-04T01:37:09.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.358+0000 7f635264f640 1 -- 172.21.15.44:0/142290878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c145640 con 0x7f634c0ce240 2023-11-04T01:37:09.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.358+0000 7f6348ff9640 1 -- 172.21.15.44:0/142290878 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63400072d0 con 0x7f634c0ce240 2023-11-04T01:37:09.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.358+0000 7f635264f640 1 -- 172.21.15.44:0/142290878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c145c00 con 0x7f634c0ce240 2023-11-04T01:37:09.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.359+0000 7f635264f640 1 -- 172.21.15.44:0/142290878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c074290 con 0x7f634c0ce240 2023-11-04T01:37:09.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.359+0000 7f6348ff9640 1 -- 172.21.15.44:0/142290878 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f63400074f0 con 0x7f634c0ce240 2023-11-04T01:37:09.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.360+0000 7f6348ff9640 1 --2- 172.21.15.44:0/142290878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f633806ae70 0x7f633806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.360+0000 7f6348ff9640 1 -- 172.21.15.44:0/142290878 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6340088e00 con 0x7f634c0ce240 2023-11-04T01:37:09.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.360+0000 7f634bfff640 1 --2- 172.21.15.44:0/142290878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f633806ae70 0x7f633806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.361+0000 7f634bfff640 1 --2- 172.21.15.44:0/142290878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f633806ae70 0x7f633806d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f633c036000 tx=0x7f633c03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.364+0000 7f6348ff9640 1 -- 172.21.15.44:0/142290878 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6340053ba0 con 0x7f634c0ce240 2023-11-04T01:37:09.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.541+0000 7f635264f640 1 -- 172.21.15.44:0/142290878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f634c072e70 con 0x7f634c0ce240 2023-11-04T01:37:09.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.542+0000 7f6348ff9640 1 -- 172.21.15.44:0/142290878 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18733 (secure 0 0 0) 0x7f6340017020 con 0x7f634c0ce240 2023-11-04T01:37:09.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:09.545 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:36:40.324320+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:56.801551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:57.523693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:01.243259+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:09.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.544+0000 7f635264f640 1 -- 172.21.15.44:0/142290878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f633806ae70 msgr2=0x7f633806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.544+0000 7f635264f640 1 --2- 172.21.15.44:0/142290878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f633806ae70 0x7f633806d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f633c036000 tx=0x7f633c03c040 comp rx=0 tx=0).stop 2023-11-04T01:37:09.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.544+0000 7f635264f640 1 -- 172.21.15.44:0/142290878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0ce240 msgr2=0x7f634c1f6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.544+0000 7f635264f640 1 --2- 172.21.15.44:0/142290878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0ce240 0x7f634c1f6330 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f634000c3c0 tx=0x7f634000c880 comp rx=0 tx=0).stop 2023-11-04T01:37:09.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.544+0000 7f635264f640 1 -- 172.21.15.44:0/142290878 shutdown_connections 2023-11-04T01:37:09.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.544+0000 7f635264f640 1 --2- 172.21.15.44:0/142290878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f633806ae70 0x7f633806d330 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.544+0000 7f635264f640 1 --2- 172.21.15.44:0/142290878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f634c15daa0 0x7f634c1e7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.544+0000 7f635264f640 1 --2- 172.21.15.44:0/142290878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0ce240 0x7f634c1f6330 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.544+0000 7f635264f640 1 --2- 172.21.15.44:0/142290878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c0cde60 0x7f634c1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.544+0000 7f635264f640 1 -- 172.21.15.44:0/142290878 >> 172.21.15.44:0/142290878 conn(0x7f634c071f30 msgr2=0x7f634c0b6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:09.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.544+0000 7f635264f640 1 -- 172.21.15.44:0/142290878 shutdown_connections 2023-11-04T01:37:09.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.544+0000 7f635264f640 1 -- 172.21.15.44:0/142290878 wait complete. 2023-11-04T01:37:09.558 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:37:09.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.663+0000 7fbc83961640 1 Processor -- start 2023-11-04T01:37:09.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.663+0000 7fbc83961640 1 -- start start 2023-11-04T01:37:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc83961640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbc7c0cd6d0 0x7fbc7c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc83961640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc7c0b4880 0x7fbc7c0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc83961640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7c0cde60 con 0x7fbc7c153e60 2023-11-04T01:37:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc83961640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7c160f90 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc83961640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c161960 con 0x7fbc7c0b4880 2023-11-04T01:37:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc816fd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbc7c153e60 0x7fbc7c15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49170/0 (socket says 172.21.15.44:49170) 2023-11-04T01:37:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc816fd640 1 -- 172.21.15.44:0/1093509544 learned_addr learned my addr 172.21.15.44:0/1093509544 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc80efc640 1 --2- 172.21.15.44:0/1093509544 >> v2:172.21.15.204:3300/0 conn(0x7fbc7c0cd6d0 0x7fbc7c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc81efe640 1 --2- 172.21.15.44:0/1093509544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc7c0b4880 0x7fbc7c0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc73fff640 1 -- 172.21.15.44:0/1093509544 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357746461 0 0) 0x7fbc7c0cde60 con 0x7fbc7c153e60 2023-11-04T01:37:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc73fff640 1 -- 172.21.15.44:0/1093509544 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc68003520 con 0x7fbc7c153e60 2023-11-04T01:37:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc80efc640 1 -- 172.21.15.44:0/1093509544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc7c0b4880 msgr2=0x7fbc7c0b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc80efc640 1 --2- 172.21.15.44:0/1093509544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc7c0b4880 0x7fbc7c0b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc80efc640 1 -- 172.21.15.44:0/1093509544 >> v1:172.21.15.44:6789/0 conn(0x7fbc7c153e60 legacy=0x7fbc7c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc80efc640 1 -- 172.21.15.44:0/1093509544 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c0b5220 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.664+0000 7fbc81efe640 1 --2- 172.21.15.44:0/1093509544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc7c0b4880 0x7fbc7c0b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:09.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.665+0000 7fbc80efc640 1 --2- 172.21.15.44:0/1093509544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc7c0cd6d0 0x7fbc7c161420 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0097a0 tx=0x7fbc6c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17fbd1c64b239122 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.665+0000 7fbc73fff640 1 -- 172.21.15.44:0/1093509544 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c02d040 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.665+0000 7fbc73fff640 1 -- 172.21.15.44:0/1093509544 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c031810 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.665+0000 7fbc73fff640 1 -- 172.21.15.44:0/1093509544 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c031ba0 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.666+0000 7fbc83961640 1 -- 172.21.15.44:0/1093509544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc7c0cd6d0 msgr2=0x7fbc7c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.666+0000 7fbc83961640 1 --2- 172.21.15.44:0/1093509544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc7c0cd6d0 0x7fbc7c161420 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0097a0 tx=0x7fbc6c02b8b0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.666+0000 7fbc83961640 1 -- 172.21.15.44:0/1093509544 shutdown_connections 2023-11-04T01:37:09.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.666+0000 7fbc83961640 1 --2- 172.21.15.44:0/1093509544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc7c0b4880 0x7fbc7c0b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.666+0000 7fbc83961640 1 --2- 172.21.15.44:0/1093509544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc7c0cd6d0 0x7fbc7c161420 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.666+0000 7fbc83961640 1 -- 172.21.15.44:0/1093509544 >> 172.21.15.44:0/1093509544 conn(0x7fbc7c0cf880 msgr2=0x7fbc7c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:09.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.666+0000 7fbc83961640 1 -- 172.21.15.44:0/1093509544 shutdown_connections 2023-11-04T01:37:09.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.666+0000 7fbc83961640 1 -- 172.21.15.44:0/1093509544 wait complete. 2023-11-04T01:37:09.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.667+0000 7fbc83961640 1 Processor -- start 2023-11-04T01:37:09.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.667+0000 7fbc83961640 1 -- start start 2023-11-04T01:37:09.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc83961640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc7c0b4880 0x7fbc7c158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc83961640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc7c0cd6d0 0x7fbc7c0cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc83961640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc7c153e60 0x7fbc7c0cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc83961640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c154c80 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc83961640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c1f3950 con 0x7fbc7c153e60 2023-11-04T01:37:09.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc83961640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c1542e0 con 0x7fbc7c0b4880 2023-11-04T01:37:09.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc80efc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc7c0cd6d0 0x7fbc7c0cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc80efc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc7c0cd6d0 0x7fbc7c0cb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37794/0 (socket says 172.21.15.44:37794) 2023-11-04T01:37:09.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc80efc640 1 -- 172.21.15.44:0/2967778558 learned_addr learned my addr 172.21.15.44:0/2967778558 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:09.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc816fd640 1 --2- 172.21.15.44:0/2967778558 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc7c0b4880 0x7fbc7c158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc81efe640 1 --2- 172.21.15.44:0/2967778558 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc7c153e60 0x7fbc7c0cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc80efc640 1 -- 172.21.15.44:0/2967778558 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc7c0b4880 msgr2=0x7fbc7c158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc80efc640 1 --2- 172.21.15.44:0/2967778558 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc7c0b4880 0x7fbc7c158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc80efc640 1 -- 172.21.15.44:0/2967778558 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc7c153e60 msgr2=0x7fbc7c0cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc80efc640 1 --2- 172.21.15.44:0/2967778558 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc7c153e60 0x7fbc7c0cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.668+0000 7fbc80efc640 1 -- 172.21.15.44:0/2967778558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc74009a70 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.669+0000 7fbc80efc640 1 --2- 172.21.15.44:0/2967778558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc7c0cd6d0 0x7fbc7c0cb4c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0098c0 tx=0x7fbc6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.669+0000 7fbc71ffb640 1 -- 172.21.15.44:0/2967778558 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c03ad60 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.669+0000 7fbc71ffb640 1 -- 172.21.15.44:0/2967778558 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c044400 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.669+0000 7fbc83961640 1 -- 172.21.15.44:0/2967778558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6c009400 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.669+0000 7fbc71ffb640 1 -- 172.21.15.44:0/2967778558 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0445b0 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.669+0000 7fbc83961640 1 -- 172.21.15.44:0/2967778558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c1548a0 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.670+0000 7fbc83961640 1 -- 172.21.15.44:0/2967778558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7c154dc0 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.670+0000 7fbc71ffb640 1 -- 172.21.15.44:0/2967778558 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc6c04d440 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.671+0000 7fbc71ffb640 1 --2- 172.21.15.44:0/2967778558 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbc6006ae70 0x7fbc6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.671+0000 7fbc71ffb640 1 -- 172.21.15.44:0/2967778558 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbc6c0abaf0 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.671+0000 7fbc816fd640 1 --2- 172.21.15.44:0/2967778558 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbc6006ae70 0x7fbc6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.672+0000 7fbc816fd640 1 --2- 172.21.15.44:0/2967778558 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbc6006ae70 0x7fbc6006d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbc780011e0 tx=0x7fbc78009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.675+0000 7fbc71ffb640 1 -- 172.21.15.44:0/2967778558 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc7c154dc0 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.889+0000 7fbc83961640 1 -- 172.21.15.44:0/2967778558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbc7c154dc0 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.891 INFO:tasks.ceph.mon.a.smithi044.stderr:2023-11-04T01:37:09.889+0000 7fd852594640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:37:09.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.891+0000 7fbc71ffb640 1 -- 172.21.15.44:0/2967778558 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbc7c154dc0 con 0x7fbc7c0cd6d0 2023-11-04T01:37:09.896 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:37:09.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.894+0000 7fbc83961640 1 -- 172.21.15.44:0/2967778558 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbc6006ae70 msgr2=0x7fbc6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.894+0000 7fbc83961640 1 --2- 172.21.15.44:0/2967778558 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbc6006ae70 0x7fbc6006d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbc780011e0 tx=0x7fbc78009040 comp rx=0 tx=0).stop 2023-11-04T01:37:09.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.894+0000 7fbc83961640 1 -- 172.21.15.44:0/2967778558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc7c0cd6d0 msgr2=0x7fbc7c0cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.894+0000 7fbc83961640 1 --2- 172.21.15.44:0/2967778558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc7c0cd6d0 0x7fbc7c0cb4c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0098c0 tx=0x7fbc6c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.895+0000 7fbc83961640 1 -- 172.21.15.44:0/2967778558 shutdown_connections 2023-11-04T01:37:09.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.895+0000 7fbc83961640 1 --2- 172.21.15.44:0/2967778558 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbc6006ae70 0x7fbc6006d330 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.895+0000 7fbc83961640 1 --2- 172.21.15.44:0/2967778558 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc7c153e60 0x7fbc7c0cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.895+0000 7fbc83961640 1 --2- 172.21.15.44:0/2967778558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc7c0cd6d0 0x7fbc7c0cb4c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.895+0000 7fbc83961640 1 --2- 172.21.15.44:0/2967778558 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc7c0b4880 0x7fbc7c158bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.895+0000 7fbc83961640 1 -- 172.21.15.44:0/2967778558 >> 172.21.15.44:0/2967778558 conn(0x7fbc7c0cf880 msgr2=0x7fbc7c15fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:09.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.895+0000 7fbc83961640 1 -- 172.21.15.44:0/2967778558 shutdown_connections 2023-11-04T01:37:09.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:09.895+0000 7fbc83961640 1 -- 172.21.15.44:0/2967778558 wait complete. 2023-11-04T01:37:09.900 INFO:tasks.ceph.mds.c.smithi044.stderr: -4579> 2023-11-04T01:36:04.268+0000 7f47b029c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:37:09.911 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:37:09.933 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2023-11-04T01:37:10.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.020+0000 7f342f007640 1 Processor -- start 2023-11-04T01:37:10.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.020+0000 7f342f007640 1 -- start start 2023-11-04T01:37:10.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.020+0000 7f342f007640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f342815ad30 0x7f34280adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:10.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f342f007640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34280c3900 con 0x7f3428070e20 2023-11-04T01:37:10.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f342f007640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34280c3be0 con 0x7f34280ad730 2023-11-04T01:37:10.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f342f007640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34280ae260 con 0x7f342815ad30 2023-11-04T01:37:10.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f342d5a4640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3428070e20 0x7f342815e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49186/0 (socket says 172.21.15.44:49186) 2023-11-04T01:37:10.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f342d5a4640 1 -- 172.21.15.44:0/1623505448 learned_addr learned my addr 172.21.15.44:0/1623505448 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:10.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f34277fe640 1 -- 172.21.15.44:0/1623505448 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421820765 0 0) 0x7f34280c3900 con 0x7f3428070e20 2023-11-04T01:37:10.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f34277fe640 1 -- 172.21.15.44:0/1623505448 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3414003520 con 0x7f3428070e20 2023-11-04T01:37:10.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f342cda3640 1 --2- 172.21.15.44:0/1623505448 >> v2:172.21.15.204:3300/0 conn(0x7f342815ad30 0x7f34280adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:10.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f34277fe640 1 -- 172.21.15.44:0/1623505448 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2570303814 0 0) 0x7f3414003520 con 0x7f3428070e20 2023-11-04T01:37:10.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f34277fe640 1 -- 172.21.15.44:0/1623505448 >> v2:172.21.15.204:3300/0 conn(0x7f342815ad30 msgr2=0x7f34280adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:10.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f34277fe640 1 --2- 172.21.15.44:0/1623505448 >> v2:172.21.15.204:3300/0 conn(0x7f342815ad30 0x7f34280adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f34277fe640 1 -- 172.21.15.44:0/1623505448 >> v1:172.21.15.204:6789/0 conn(0x7f34280ad730 legacy=0x7f3428070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f34277fe640 1 -- 172.21.15.44:0/1623505448 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34280c3ec0 con 0x7f3428070e20 2023-11-04T01:37:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f34277fe640 1 -- 172.21.15.44:0/1623505448 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f3420001670 con 0x7f3428070e20 2023-11-04T01:37:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f34277fe640 1 -- 172.21.15.44:0/1623505448 >> v1:172.21.15.44:6789/0 conn(0x7f3428070e20 legacy=0x7f342815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f34277fe640 1 --2- 172.21.15.44:0/1623505448 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3414003970 0x7f3414003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f34277fe640 1 --2- 172.21.15.44:0/1623505448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34140047c0 0x7f3414004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f34277fe640 1 --2- 172.21.15.44:0/1623505448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3414005180 0x7f341400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f34277fe640 1 -- 172.21.15.44:0/1623505448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280ae260 con 0x7f34140047c0 2023-11-04T01:37:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f34277fe640 1 -- 172.21.15.44:0/1623505448 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341400c120 con 0x7f3414003970 2023-11-04T01:37:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.021+0000 7f34277fe640 1 -- 172.21.15.44:0/1623505448 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341400c2e0 con 0x7f3414005180 2023-11-04T01:37:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.022+0000 7f3427fff640 1 --2- 172.21.15.44:0/1623505448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34140047c0 0x7f3414004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.022+0000 7f342cda3640 1 --2- 172.21.15.44:0/1623505448 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3414003970 0x7f3414003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.022+0000 7f342d5a4640 1 --2- 172.21.15.44:0/1623505448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3414005180 0x7f341400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.022+0000 7f3427fff640 1 -- 172.21.15.44:0/1623505448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3414005180 msgr2=0x7f341400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:10.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.022+0000 7f3427fff640 1 --2- 172.21.15.44:0/1623505448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3414005180 0x7f341400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.022+0000 7f3427fff640 1 -- 172.21.15.44:0/1623505448 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3414003970 msgr2=0x7f3414003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:10.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.022+0000 7f3427fff640 1 --2- 172.21.15.44:0/1623505448 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3414003970 0x7f3414003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.022+0000 7f3427fff640 1 -- 172.21.15.44:0/1623505448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3414003520 con 0x7f34140047c0 2023-11-04T01:37:10.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.022+0000 7f342d5a4640 1 --2- 172.21.15.44:0/1623505448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3414005180 0x7f341400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:10.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.022+0000 7f342d5a4640 1 -- 172.21.15.44:0/1623505448 reap_dead start 2023-11-04T01:37:10.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.023+0000 7f3427fff640 1 --2- 172.21.15.44:0/1623505448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34140047c0 0x7f3414004c40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3418001e50 tx=0x7f34140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14564da00aaba6c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:10.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.023+0000 7f34277fe640 1 -- 172.21.15.44:0/1623505448 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418003b70 con 0x7f34140047c0 2023-11-04T01:37:10.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.023+0000 7f34277fe640 1 -- 172.21.15.44:0/1623505448 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3418003cd0 con 0x7f34140047c0 2023-11-04T01:37:10.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.023+0000 7f34277fe640 1 -- 172.21.15.44:0/1623505448 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418005310 con 0x7f34140047c0 2023-11-04T01:37:10.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.023+0000 7f342f007640 1 -- 172.21.15.44:0/1623505448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34140047c0 msgr2=0x7f3414004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:10.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.023+0000 7f342f007640 1 --2- 172.21.15.44:0/1623505448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34140047c0 0x7f3414004c40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3418001e50 tx=0x7f34140057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.023+0000 7f342f007640 1 -- 172.21.15.44:0/1623505448 shutdown_connections 2023-11-04T01:37:10.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.023+0000 7f342f007640 1 --2- 172.21.15.44:0/1623505448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34140047c0 0x7f3414004c40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.023+0000 7f342f007640 1 -- 172.21.15.44:0/1623505448 >> 172.21.15.44:0/1623505448 conn(0x7f34280ce950 msgr2=0x7f34280ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:10.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.023+0000 7f342f007640 1 -- 172.21.15.44:0/1623505448 shutdown_connections 2023-11-04T01:37:10.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.023+0000 7f342f007640 1 -- 172.21.15.44:0/1623505448 wait complete. 2023-11-04T01:37:10.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.024+0000 7f342f007640 1 Processor -- start 2023-11-04T01:37:10.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.024+0000 7f342f007640 1 -- start start 2023-11-04T01:37:10.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.025+0000 7f342f007640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34140047c0 0x7f342815d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:10.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.025+0000 7f342f007640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34280cc520 0x7f34281545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:10.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.025+0000 7f342f007640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34280b39a0 0x7f34280b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:10.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.025+0000 7f342f007640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280b4390 con 0x7f34280b39a0 2023-11-04T01:37:10.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.025+0000 7f342f007640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342815df60 con 0x7f34280cc520 2023-11-04T01:37:10.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.025+0000 7f342f007640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34280cdc10 con 0x7f34140047c0 2023-11-04T01:37:10.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.025+0000 7f342d5a4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34280b39a0 0x7f34280b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:10.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.025+0000 7f342d5a4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34280b39a0 0x7f34280b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37838/0 (socket says 172.21.15.44:37838) 2023-11-04T01:37:10.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.025+0000 7f342d5a4640 1 -- 172.21.15.44:0/994408613 learned_addr learned my addr 172.21.15.44:0/994408613 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:10.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.026+0000 7f3427fff640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34280cc520 0x7f34281545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:10.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.026+0000 7f342cda3640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34140047c0 0x7f342815d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:10.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.026+0000 7f342d5a4640 1 -- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34140047c0 msgr2=0x7f342815d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:10.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.026+0000 7f342d5a4640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34140047c0 0x7f342815d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.026+0000 7f342d5a4640 1 -- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34280cc520 msgr2=0x7f34281545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:10.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.026+0000 7f342d5a4640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34280cc520 0x7f34281545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.026+0000 7f342d5a4640 1 -- 172.21.15.44:0/994408613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342815dcc0 con 0x7f34280b39a0 2023-11-04T01:37:10.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.026+0000 7f342cda3640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34140047c0 0x7f342815d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:10.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.026+0000 7f3427fff640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34280cc520 0x7f34281545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:10.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.026+0000 7f342d5a4640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34280b39a0 0x7f34280b3e50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f34280ce890 tx=0x7f342000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:10.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.026+0000 7f34257fa640 1 -- 172.21.15.44:0/994408613 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342000eed0 con 0x7f34280b39a0 2023-11-04T01:37:10.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.026+0000 7f34257fa640 1 -- 172.21.15.44:0/994408613 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342000c5b0 con 0x7f34280b39a0 2023-11-04T01:37:10.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.026+0000 7f342f007640 1 -- 172.21.15.44:0/994408613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34280cd2e0 con 0x7f34280b39a0 2023-11-04T01:37:10.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.026+0000 7f34257fa640 1 -- 172.21.15.44:0/994408613 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342000c960 con 0x7f34280b39a0 2023-11-04T01:37:10.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.026+0000 7f342f007640 1 -- 172.21.15.44:0/994408613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34280cd8a0 con 0x7f34280b39a0 2023-11-04T01:37:10.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.027+0000 7f342f007640 1 -- 172.21.15.44:0/994408613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34280cd140 con 0x7f34280b39a0 2023-11-04T01:37:10.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.028+0000 7f34257fa640 1 -- 172.21.15.44:0/994408613 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f342000cac0 con 0x7f34280b39a0 2023-11-04T01:37:10.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.028+0000 7f34257fa640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f340806aea0 0x7f340806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:10.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.028+0000 7f34257fa640 1 -- 172.21.15.44:0/994408613 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f3420089310 con 0x7f34280b39a0 2023-11-04T01:37:10.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.028+0000 7f342cda3640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f340806aea0 0x7f340806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:10.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.029+0000 7f342cda3640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f340806aea0 0x7f340806d360 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f34280c8730 tx=0x7f3410008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:10.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.032+0000 7f34257fa640 1 -- 172.21.15.44:0/994408613 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f34280cd140 con 0x7f34280b39a0 2023-11-04T01:37:10.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.244+0000 7f342f007640 1 -- 172.21.15.44:0/994408613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f34281f2b20 con 0x7f34280b39a0 2023-11-04T01:37:10.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.893+0000 7f34257fa640 1 -- 172.21.15.44:0/994408613 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f34281f2b20 con 0x7f34280b39a0 2023-11-04T01:37:10.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.895+0000 7f342f007640 1 -- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f340806aea0 msgr2=0x7f340806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:10.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.895+0000 7f342f007640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f340806aea0 0x7f340806d360 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f34280c8730 tx=0x7f3410008040 comp rx=0 tx=0).stop 2023-11-04T01:37:10.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.895+0000 7f342f007640 1 -- 172.21.15.44:0/994408613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34280b39a0 msgr2=0x7f34280b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:10.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.895+0000 7f342f007640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34280b39a0 0x7f34280b3e50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f34280ce890 tx=0x7f342000eb90 comp rx=0 tx=0).stop 2023-11-04T01:37:10.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.896+0000 7f342f007640 1 -- 172.21.15.44:0/994408613 shutdown_connections 2023-11-04T01:37:10.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.896+0000 7f342f007640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f340806aea0 0x7f340806d360 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.896+0000 7f342f007640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34280b39a0 0x7f34280b3e50 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.896+0000 7f342f007640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34280cc520 0x7f34281545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.896+0000 7f342f007640 1 --2- 172.21.15.44:0/994408613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34140047c0 0x7f342815d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.896+0000 7f342f007640 1 -- 172.21.15.44:0/994408613 >> 172.21.15.44:0/994408613 conn(0x7f34280ce950 msgr2=0x7f3428072be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:10.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.896+0000 7f342f007640 1 -- 172.21.15.44:0/994408613 shutdown_connections 2023-11-04T01:37:10.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:10.896+0000 7f342f007640 1 -- 172.21.15.44:0/994408613 wait complete. 2023-11-04T01:37:10.912 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:37:11.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.070+0000 7fda364af640 1 Processor -- start 2023-11-04T01:37:11.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.070+0000 7fda364af640 1 -- start start 2023-11-04T01:37:11.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.071+0000 7fda364af640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fda300cd9f0 0x7fda300cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:11.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.071+0000 7fda364af640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fda300d27c0 0x7fda3015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:11.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.071+0000 7fda364af640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda300d1320 con 0x7fda3015d4b0 2023-11-04T01:37:11.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.071+0000 7fda364af640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3015e4d0 con 0x7fda300d27c0 2023-11-04T01:37:11.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.071+0000 7fda364af640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda300ce310 con 0x7fda300cd9f0 2023-11-04T01:37:11.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.071+0000 7fda34a4c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fda300d27c0 0x7fda3015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:11.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.071+0000 7fda34a4c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fda300d27c0 0x7fda3015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37846/0 (socket says 172.21.15.44:37846) 2023-11-04T01:37:11.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.071+0000 7fda34a4c640 1 -- 172.21.15.44:0/2173698274 learned_addr learned my addr 172.21.15.44:0/2173698274 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:11.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.071+0000 7fda34a4c640 1 -- 172.21.15.44:0/2173698274 >> v2:172.21.15.204:3300/0 conn(0x7fda300cd9f0 msgr2=0x7fda300cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:11.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.071+0000 7fda2ffff640 1 --2- 172.21.15.44:0/2173698274 >> v2:172.21.15.204:3300/0 conn(0x7fda300cd9f0 0x7fda300cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:11.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.071+0000 7fda34a4c640 1 --2- 172.21.15.44:0/2173698274 >> v2:172.21.15.204:3300/0 conn(0x7fda300cd9f0 0x7fda300cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.071+0000 7fda34a4c640 1 -- 172.21.15.44:0/2173698274 >> v1:172.21.15.204:6789/0 conn(0x7fda3015d4b0 legacy=0x7fda300b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:11.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.071+0000 7fda34a4c640 1 -- 172.21.15.44:0/2173698274 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3015df10 con 0x7fda300d27c0 2023-11-04T01:37:11.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.071+0000 7fda2ffff640 1 --2- 172.21.15.44:0/2173698274 >> v2:172.21.15.204:3300/0 conn(0x7fda300cd9f0 0x7fda300cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:11.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.072+0000 7fda34a4c640 1 --2- 172.21.15.44:0/2173698274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda300d27c0 0x7fda3015d910 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fda28009e50 tx=0x7fda2802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480b7a42b2e2af38 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:11.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.072+0000 7fda2effd640 1 -- 172.21.15.44:0/2173698274 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2802cb00 con 0x7fda300d27c0 2023-11-04T01:37:11.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.072+0000 7fda2effd640 1 -- 172.21.15.44:0/2173698274 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2802cc60 con 0x7fda300d27c0 2023-11-04T01:37:11.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.072+0000 7fda2effd640 1 -- 172.21.15.44:0/2173698274 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda280343f0 con 0x7fda300d27c0 2023-11-04T01:37:11.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.073+0000 7fda364af640 1 -- 172.21.15.44:0/2173698274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda300d27c0 msgr2=0x7fda3015d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:11.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.073+0000 7fda364af640 1 --2- 172.21.15.44:0/2173698274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda300d27c0 0x7fda3015d910 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fda28009e50 tx=0x7fda2802bf60 comp rx=0 tx=0).stop 2023-11-04T01:37:11.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.073+0000 7fda364af640 1 -- 172.21.15.44:0/2173698274 shutdown_connections 2023-11-04T01:37:11.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.073+0000 7fda364af640 1 --2- 172.21.15.44:0/2173698274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda300d27c0 0x7fda3015d910 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.073+0000 7fda364af640 1 --2- 172.21.15.44:0/2173698274 >> v2:172.21.15.204:3300/0 conn(0x7fda300cd9f0 0x7fda300cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.073+0000 7fda364af640 1 -- 172.21.15.44:0/2173698274 >> 172.21.15.44:0/2173698274 conn(0x7fda30071c40 msgr2=0x7fda30072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:11.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.073+0000 7fda364af640 1 -- 172.21.15.44:0/2173698274 shutdown_connections 2023-11-04T01:37:11.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.073+0000 7fda364af640 1 -- 172.21.15.44:0/2173698274 wait complete. 2023-11-04T01:37:11.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.074+0000 7fda364af640 1 Processor -- start 2023-11-04T01:37:11.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.074+0000 7fda364af640 1 -- start start 2023-11-04T01:37:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda364af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda300cd9f0 0x7fda30159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda364af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda300d27c0 0x7fda300c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda364af640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda3015d4b0 0x7fda300c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda364af640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda301f77e0 con 0x7fda300cd9f0 2023-11-04T01:37:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda364af640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda300c7e40 con 0x7fda3015d4b0 2023-11-04T01:37:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda364af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda300ca600 con 0x7fda300d27c0 2023-11-04T01:37:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda2ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda300cd9f0 0x7fda30159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda2ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda300cd9f0 0x7fda30159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37852/0 (socket says 172.21.15.44:37852) 2023-11-04T01:37:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda2ffff640 1 -- 172.21.15.44:0/744055385 learned_addr learned my addr 172.21.15.44:0/744055385 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda2f7fe640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda300d27c0 0x7fda300c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda34a4c640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda3015d4b0 0x7fda300c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda2ffff640 1 -- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda300d27c0 msgr2=0x7fda300c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda2ffff640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda300d27c0 0x7fda300c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda2ffff640 1 -- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda3015d4b0 msgr2=0x7fda300c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda2ffff640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda3015d4b0 0x7fda300c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda2ffff640 1 -- 172.21.15.44:0/744055385 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda28009b30 con 0x7fda300cd9f0 2023-11-04T01:37:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda2f7fe640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda300d27c0 0x7fda300c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda34a4c640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda3015d4b0 0x7fda300c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.075+0000 7fda2ffff640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda300cd9f0 0x7fda30159ea0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fda2000c820 tx=0x7fda2000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.076+0000 7fda2cff9640 1 -- 172.21.15.44:0/744055385 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20007a30 con 0x7fda300cd9f0 2023-11-04T01:37:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.076+0000 7fda2cff9640 1 -- 172.21.15.44:0/744055385 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda20007b90 con 0x7fda300cd9f0 2023-11-04T01:37:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.076+0000 7fda364af640 1 -- 172.21.15.44:0/744055385 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda301f7500 con 0x7fda300cd9f0 2023-11-04T01:37:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.076+0000 7fda2cff9640 1 -- 172.21.15.44:0/744055385 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2000ce10 con 0x7fda300cd9f0 2023-11-04T01:37:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.076+0000 7fda364af640 1 -- 172.21.15.44:0/744055385 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda300ca220 con 0x7fda300cd9f0 2023-11-04T01:37:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.077+0000 7fda364af640 1 -- 172.21.15.44:0/744055385 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda3004e490 con 0x7fda300cd9f0 2023-11-04T01:37:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.077+0000 7fda2cff9640 1 -- 172.21.15.44:0/744055385 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda200113f0 con 0x7fda300cd9f0 2023-11-04T01:37:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.077+0000 7fda2cff9640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fda1c06ae70 0x7fda1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.078+0000 7fda2cff9640 1 -- 172.21.15.44:0/744055385 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fda20089af0 con 0x7fda300cd9f0 2023-11-04T01:37:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.078+0000 7fda2f7fe640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fda1c06ae70 0x7fda1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.078+0000 7fda2f7fe640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fda1c06ae70 0x7fda1c06d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fda30071820 tx=0x7fda24009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:11.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.082+0000 7fda2cff9640 1 -- 172.21.15.44:0/744055385 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fda20054790 con 0x7fda300cd9f0 2023-11-04T01:37:11.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.261+0000 7fda364af640 1 -- 172.21.15.44:0/744055385 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fda3015dc30 con 0x7fda300cd9f0 2023-11-04T01:37:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.894+0000 7fda2cff9640 1 -- 172.21.15.44:0/744055385 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fda2001f0d0 con 0x7fda300cd9f0 2023-11-04T01:37:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:37:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.897+0000 7fda364af640 1 -- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fda1c06ae70 msgr2=0x7fda1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.897+0000 7fda364af640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fda1c06ae70 0x7fda1c06d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fda30071820 tx=0x7fda24009040 comp rx=0 tx=0).stop 2023-11-04T01:37:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.897+0000 7fda364af640 1 -- 172.21.15.44:0/744055385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda300cd9f0 msgr2=0x7fda30159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.897+0000 7fda364af640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda300cd9f0 0x7fda30159ea0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fda2000c820 tx=0x7fda2000cce0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.897+0000 7fda364af640 1 -- 172.21.15.44:0/744055385 shutdown_connections 2023-11-04T01:37:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.897+0000 7fda364af640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fda1c06ae70 0x7fda1c06d330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.897+0000 7fda364af640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda3015d4b0 0x7fda300c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.897+0000 7fda364af640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda300d27c0 0x7fda300c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.897+0000 7fda364af640 1 --2- 172.21.15.44:0/744055385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda300cd9f0 0x7fda30159ea0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.897+0000 7fda364af640 1 -- 172.21.15.44:0/744055385 >> 172.21.15.44:0/744055385 conn(0x7fda30071c40 msgr2=0x7fda3015eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.897+0000 7fda364af640 1 -- 172.21.15.44:0/744055385 shutdown_connections 2023-11-04T01:37:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:11.898+0000 7fda364af640 1 -- 172.21.15.44:0/744055385 wait complete. 2023-11-04T01:37:11.915 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:37:12.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.033+0000 7f383a41a640 1 Processor -- start 2023-11-04T01:37:12.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.034+0000 7f383a41a640 1 -- start start 2023-11-04T01:37:12.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.034+0000 7f383a41a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f383415ceb0 0x7f38340d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.034+0000 7f383a41a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f38340cde70 0x7f38340b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.034+0000 7f383a41a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38340d1290 con 0x7f38340d34c0 2023-11-04T01:37:12.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.034+0000 7f383a41a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38340d1570 con 0x7f38340cde70 2023-11-04T01:37:12.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.034+0000 7f383a41a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38340d1850 con 0x7f383415ceb0 2023-11-04T01:37:12.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.035+0000 7f38389b7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f38340cde70 0x7f38340b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.035+0000 7f38337fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f38340d34c0 0x7f38340cd760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:52122/0 (socket says 172.21.15.44:52122) 2023-11-04T01:37:12.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.035+0000 7f38337fe640 1 -- 172.21.15.44:0/2382709009 learned_addr learned my addr 172.21.15.44:0/2382709009 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:12.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.035+0000 7f3833fff640 1 --2- 172.21.15.44:0/2382709009 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f383415ceb0 0x7f38340d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.035+0000 7f38389b7640 1 -- 172.21.15.44:0/2382709009 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f383415ceb0 msgr2=0x7f38340d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:12.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.035+0000 7f38389b7640 1 --2- 172.21.15.44:0/2382709009 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f383415ceb0 0x7f38340d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.035+0000 7f38389b7640 1 -- 172.21.15.44:0/2382709009 >> v1:172.21.15.204:6789/0 conn(0x7f38340d34c0 legacy=0x7f38340cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.035+0000 7f38389b7640 1 -- 172.21.15.44:0/2382709009 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38340d1b30 con 0x7f38340cde70 2023-11-04T01:37:12.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.035+0000 7f3832ffd640 1 -- 172.21.15.44:0/2382709009 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456907696 0 0) 0x7f38340d1290 con 0x7f38340d34c0 2023-11-04T01:37:12.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.036+0000 7f38389b7640 1 --2- 172.21.15.44:0/2382709009 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38340cde70 0x7f38340b61b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f382c009d90 tx=0x7f382c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=556c0e007c67abdd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:12.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.036+0000 7f3832ffd640 1 -- 172.21.15.44:0/2382709009 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c02cc50 con 0x7f38340cde70 2023-11-04T01:37:12.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.036+0000 7f3832ffd640 1 -- 172.21.15.44:0/2382709009 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c02cdb0 con 0x7f38340cde70 2023-11-04T01:37:12.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.036+0000 7f3832ffd640 1 -- 172.21.15.44:0/2382709009 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c034660 con 0x7f38340cde70 2023-11-04T01:37:12.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.037+0000 7f383a41a640 1 -- 172.21.15.44:0/2382709009 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38340cde70 msgr2=0x7f38340b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.037+0000 7f383a41a640 1 --2- 172.21.15.44:0/2382709009 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38340cde70 0x7f38340b61b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f382c009d90 tx=0x7f382c02bea0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.037+0000 7f383a41a640 1 -- 172.21.15.44:0/2382709009 shutdown_connections 2023-11-04T01:37:12.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.037+0000 7f383a41a640 1 --2- 172.21.15.44:0/2382709009 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38340cde70 0x7f38340b61b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.037+0000 7f383a41a640 1 --2- 172.21.15.44:0/2382709009 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f383415ceb0 0x7f38340d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.037+0000 7f383a41a640 1 -- 172.21.15.44:0/2382709009 >> 172.21.15.44:0/2382709009 conn(0x7f3834071c40 msgr2=0x7f3834072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:12.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.037+0000 7f383a41a640 1 -- 172.21.15.44:0/2382709009 shutdown_connections 2023-11-04T01:37:12.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.037+0000 7f383a41a640 1 -- 172.21.15.44:0/2382709009 wait complete. 2023-11-04T01:37:12.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.038+0000 7f383a41a640 1 Processor -- start 2023-11-04T01:37:12.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.038+0000 7f383a41a640 1 -- start start 2023-11-04T01:37:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f383a41a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38340cde70 0x7f38341592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f383a41a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38340d34c0 0x7f383414bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f383a41a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f383415ceb0 0x7f38340c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f383a41a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38340c9260 con 0x7f383415ceb0 2023-11-04T01:37:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f383a41a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38341f3a60 con 0x7f38340d34c0 2023-11-04T01:37:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f383a41a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38341597e0 con 0x7f38340cde70 2023-11-04T01:37:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f38389b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f383415ceb0 0x7f38340c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f38389b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f383415ceb0 0x7f38340c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37864/0 (socket says 172.21.15.44:37864) 2023-11-04T01:37:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f38389b7640 1 -- 172.21.15.44:0/1951679089 learned_addr learned my addr 172.21.15.44:0/1951679089 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f3833fff640 1 --2- 172.21.15.44:0/1951679089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38340cde70 0x7f38341592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f38337fe640 1 --2- 172.21.15.44:0/1951679089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38340d34c0 0x7f383414bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f38389b7640 1 -- 172.21.15.44:0/1951679089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38340cde70 msgr2=0x7f38341592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f38389b7640 1 --2- 172.21.15.44:0/1951679089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38340cde70 0x7f38341592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f38389b7640 1 -- 172.21.15.44:0/1951679089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38340d34c0 msgr2=0x7f383414bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f38389b7640 1 --2- 172.21.15.44:0/1951679089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38340d34c0 0x7f383414bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.039+0000 7f38389b7640 1 -- 172.21.15.44:0/1951679089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c009a70 con 0x7f383415ceb0 2023-11-04T01:37:12.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.040+0000 7f38389b7640 1 --2- 172.21.15.44:0/1951679089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f383415ceb0 0x7f38340c68f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f382c009d90 tx=0x7f382c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:12.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.040+0000 7f3830ff9640 1 -- 172.21.15.44:0/1951679089 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c040650 con 0x7f383415ceb0 2023-11-04T01:37:12.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.040+0000 7f3830ff9640 1 -- 172.21.15.44:0/1951679089 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c0407b0 con 0x7f383415ceb0 2023-11-04T01:37:12.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.040+0000 7f383a41a640 1 -- 172.21.15.44:0/1951679089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383414c0d0 con 0x7f383415ceb0 2023-11-04T01:37:12.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.040+0000 7f3830ff9640 1 -- 172.21.15.44:0/1951679089 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c040b60 con 0x7f383415ceb0 2023-11-04T01:37:12.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.040+0000 7f383a41a640 1 -- 172.21.15.44:0/1951679089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38341f34a0 con 0x7f383415ceb0 2023-11-04T01:37:12.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.041+0000 7f383a41a640 1 -- 172.21.15.44:0/1951679089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38340c6430 con 0x7f383415ceb0 2023-11-04T01:37:12.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.041+0000 7f3830ff9640 1 -- 172.21.15.44:0/1951679089 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f382c040cc0 con 0x7f383415ceb0 2023-11-04T01:37:12.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.042+0000 7f3830ff9640 1 --2- 172.21.15.44:0/1951679089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f382006ae70 0x7f382006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.042+0000 7f3830ff9640 1 -- 172.21.15.44:0/1951679089 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f382c0ac580 con 0x7f383415ceb0 2023-11-04T01:37:12.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.042+0000 7f3833fff640 1 --2- 172.21.15.44:0/1951679089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f382006ae70 0x7f382006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.043+0000 7f3833fff640 1 --2- 172.21.15.44:0/1951679089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f382006ae70 0x7f382006d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3828009a30 tx=0x7f3828008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:12.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.046+0000 7f3830ff9640 1 -- 172.21.15.44:0/1951679089 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f382c077460 con 0x7f383415ceb0 2023-11-04T01:37:12.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.221+0000 7f383a41a640 1 -- 172.21.15.44:0/1951679089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f383415fb30 con 0x7f383415ceb0 2023-11-04T01:37:12.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.896+0000 7f3830ff9640 1 -- 172.21.15.44:0/1951679089 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f382c009450 con 0x7f383415ceb0 2023-11-04T01:37:12.899 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2023-11-04T01:37:12.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.900+0000 7f383a41a640 1 -- 172.21.15.44:0/1951679089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f382006ae70 msgr2=0x7f382006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.900+0000 7f383a41a640 1 --2- 172.21.15.44:0/1951679089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f382006ae70 0x7f382006d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3828009a30 tx=0x7f3828008040 comp rx=0 tx=0).stop 2023-11-04T01:37:12.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.900+0000 7f383a41a640 1 -- 172.21.15.44:0/1951679089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f383415ceb0 msgr2=0x7f38340c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.900+0000 7f383a41a640 1 --2- 172.21.15.44:0/1951679089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f383415ceb0 0x7f38340c68f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f382c009d90 tx=0x7f382c004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:12.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.902+0000 7f383a41a640 1 -- 172.21.15.44:0/1951679089 shutdown_connections 2023-11-04T01:37:12.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.902+0000 7f383a41a640 1 --2- 172.21.15.44:0/1951679089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f382006ae70 0x7f382006d330 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.902+0000 7f383a41a640 1 --2- 172.21.15.44:0/1951679089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f383415ceb0 0x7f38340c68f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.902+0000 7f383a41a640 1 --2- 172.21.15.44:0/1951679089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38340d34c0 0x7f383414bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.902+0000 7f383a41a640 1 --2- 172.21.15.44:0/1951679089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38340cde70 0x7f38341592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.902+0000 7f383a41a640 1 -- 172.21.15.44:0/1951679089 >> 172.21.15.44:0/1951679089 conn(0x7f3834071c40 msgr2=0x7f3834160050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:12.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.903+0000 7f383a41a640 1 -- 172.21.15.44:0/1951679089 shutdown_connections 2023-11-04T01:37:12.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:12.903+0000 7f383a41a640 1 -- 172.21.15.44:0/1951679089 wait complete. 2023-11-04T01:37:12.921 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-04T01:37:13.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.035+0000 7f00ab555640 1 Processor -- start 2023-11-04T01:37:13.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.035+0000 7f00ab555640 1 -- start start 2023-11-04T01:37:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.036+0000 7f00ab555640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f00a415d1b0 0x7f00a40ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.036+0000 7f00ab555640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f00a40cdc50 0x7f00a415d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.036+0000 7f00ab555640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a4161870 con 0x7f00a40cecf0 2023-11-04T01:37:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.036+0000 7f00ab555640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a4160c60 con 0x7f00a415d1b0 2023-11-04T01:37:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.036+0000 7f00ab555640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a4160f40 con 0x7f00a40cdc50 2023-11-04T01:37:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.036+0000 7f00a92f1640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f00a415d1b0 0x7f00a40ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.036+0000 7f00a92f1640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f00a415d1b0 0x7f00a40ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60146/0 (socket says 172.21.15.44:60146) 2023-11-04T01:37:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.036+0000 7f00a92f1640 1 -- 172.21.15.44:0/700960940 learned_addr learned my addr 172.21.15.44:0/700960940 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.037+0000 7f00a92f1640 1 -- 172.21.15.44:0/700960940 >> v2:172.21.15.204:3300/0 conn(0x7f00a40cdc50 msgr2=0x7f00a415d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:13.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.036+0000 7f00a9af2640 1 --2- 172.21.15.44:0/700960940 >> v2:172.21.15.204:3300/0 conn(0x7f00a40cdc50 0x7f00a415d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.037+0000 7f00a92f1640 1 --2- 172.21.15.44:0/700960940 >> v2:172.21.15.204:3300/0 conn(0x7f00a40cdc50 0x7f00a415d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.037+0000 7f00a92f1640 1 -- 172.21.15.44:0/700960940 >> v1:172.21.15.204:6789/0 conn(0x7f00a40cecf0 legacy=0x7f00a40cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:13.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.037+0000 7f00a92f1640 1 -- 172.21.15.44:0/700960940 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a4161220 con 0x7f00a415d1b0 2023-11-04T01:37:13.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.037+0000 7f00a9af2640 1 --2- 172.21.15.44:0/700960940 >> v2:172.21.15.204:3300/0 conn(0x7f00a40cdc50 0x7f00a415d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.037+0000 7f00a92f1640 1 --2- 172.21.15.44:0/700960940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00a415d1b0 0x7f00a40ce7b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f00a4089ff0 tx=0x7f009c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b7e969219d91ba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.037+0000 7f00a3fff640 1 -- 172.21.15.44:0/700960940 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c031870 con 0x7f00a415d1b0 2023-11-04T01:37:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.037+0000 7f00a3fff640 1 -- 172.21.15.44:0/700960940 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009c0319d0 con 0x7f00a415d1b0 2023-11-04T01:37:13.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.038+0000 7f00a3fff640 1 -- 172.21.15.44:0/700960940 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c031d60 con 0x7f00a415d1b0 2023-11-04T01:37:13.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.038+0000 7f00ab555640 1 -- 172.21.15.44:0/700960940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00a415d1b0 msgr2=0x7f00a40ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.038+0000 7f00ab555640 1 --2- 172.21.15.44:0/700960940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00a415d1b0 0x7f00a40ce7b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f00a4089ff0 tx=0x7f009c02b910 comp rx=0 tx=0).stop 2023-11-04T01:37:13.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.038+0000 7f00ab555640 1 -- 172.21.15.44:0/700960940 shutdown_connections 2023-11-04T01:37:13.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.038+0000 7f00ab555640 1 --2- 172.21.15.44:0/700960940 >> v2:172.21.15.204:3300/0 conn(0x7f00a40cdc50 0x7f00a415d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.038+0000 7f00ab555640 1 --2- 172.21.15.44:0/700960940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00a415d1b0 0x7f00a40ce7b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.038+0000 7f00ab555640 1 -- 172.21.15.44:0/700960940 >> 172.21.15.44:0/700960940 conn(0x7f00a406ea20 msgr2=0x7f00a406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:13.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.038+0000 7f00ab555640 1 -- 172.21.15.44:0/700960940 shutdown_connections 2023-11-04T01:37:13.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.038+0000 7f00ab555640 1 -- 172.21.15.44:0/700960940 wait complete. 2023-11-04T01:37:13.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.039+0000 7f00ab555640 1 Processor -- start 2023-11-04T01:37:13.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.039+0000 7f00ab555640 1 -- start start 2023-11-04T01:37:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.040+0000 7f00ab555640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00a40cdc50 0x7f00a40b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.040+0000 7f00ab555640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a40cecf0 0x7f00a415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.040+0000 7f00ab555640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a415d1b0 0x7f00a40b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.040+0000 7f00ab555640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a415e1d0 con 0x7f00a40cdc50 2023-11-04T01:37:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.040+0000 7f00ab555640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a40b25d0 con 0x7f00a40cecf0 2023-11-04T01:37:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.040+0000 7f00ab555640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a40b3de0 con 0x7f00a415d1b0 2023-11-04T01:37:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.040+0000 7f00a92f1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00a40cdc50 0x7f00a40b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.040+0000 7f00a92f1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00a40cdc50 0x7f00a40b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60162/0 (socket says 172.21.15.44:60162) 2023-11-04T01:37:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.040+0000 7f00a92f1640 1 -- 172.21.15.44:0/2441273893 learned_addr learned my addr 172.21.15.44:0/2441273893 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.040+0000 7f00a8af0640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a40cecf0 0x7f00a415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.040+0000 7f00a9af2640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a415d1b0 0x7f00a40b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.041+0000 7f00a92f1640 1 -- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a415d1b0 msgr2=0x7f00a40b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.041+0000 7f00a92f1640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a415d1b0 0x7f00a40b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.041+0000 7f00a92f1640 1 -- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a40cecf0 msgr2=0x7f00a415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.041+0000 7f00a92f1640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a40cecf0 0x7f00a415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.041+0000 7f00a92f1640 1 -- 172.21.15.44:0/2441273893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009c0094d0 con 0x7f00a40cdc50 2023-11-04T01:37:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.041+0000 7f00a8af0640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a40cecf0 0x7f00a415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.041+0000 7f00a9af2640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a415d1b0 0x7f00a40b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.041+0000 7f00a92f1640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00a40cdc50 0x7f00a40b3800 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f009c000c00 tx=0x7f009c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.041+0000 7f00a1ffb640 1 -- 172.21.15.44:0/2441273893 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c031840 con 0x7f00a40cdc50 2023-11-04T01:37:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.041+0000 7f00a1ffb640 1 -- 172.21.15.44:0/2441273893 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009c0443f0 con 0x7f00a40cdc50 2023-11-04T01:37:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.041+0000 7f00ab555640 1 -- 172.21.15.44:0/2441273893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a40b40c0 con 0x7f00a40cdc50 2023-11-04T01:37:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.041+0000 7f00a1ffb640 1 -- 172.21.15.44:0/2441273893 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c0447a0 con 0x7f00a40cdc50 2023-11-04T01:37:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.041+0000 7f00ab555640 1 -- 172.21.15.44:0/2441273893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a40b4680 con 0x7f00a40cdc50 2023-11-04T01:37:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.042+0000 7f00ab555640 1 -- 172.21.15.44:0/2441273893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a415e340 con 0x7f00a40cdc50 2023-11-04T01:37:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.043+0000 7f00a1ffb640 1 -- 172.21.15.44:0/2441273893 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f009c04d450 con 0x7f00a40cdc50 2023-11-04T01:37:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.043+0000 7f00a1ffb640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f009006ae70 0x7f009006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.043+0000 7f00a1ffb640 1 -- 172.21.15.44:0/2441273893 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f009c02d040 con 0x7f00a40cdc50 2023-11-04T01:37:13.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.043+0000 7f00a8af0640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f009006ae70 0x7f009006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.044+0000 7f00a8af0640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f009006ae70 0x7f009006d330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f00a40b4cf0 tx=0x7f0098009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.047+0000 7f00a1ffb640 1 -- 172.21.15.44:0/2441273893 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00a415e340 con 0x7f00a40cdc50 2023-11-04T01:37:13.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.222+0000 7f00ab555640 1 -- 172.21.15.44:0/2441273893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f00a415e310 con 0x7f00a40cdc50 2023-11-04T01:37:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.897+0000 7f00a1ffb640 1 -- 172.21.15.44:0/2441273893 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f009c0b2080 con 0x7f00a40cdc50 2023-11-04T01:37:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data_ec' removed 2023-11-04T01:37:13.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.901+0000 7f00ab555640 1 -- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f009006ae70 msgr2=0x7f009006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.901+0000 7f00ab555640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f009006ae70 0x7f009006d330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f00a40b4cf0 tx=0x7f0098009040 comp rx=0 tx=0).stop 2023-11-04T01:37:13.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.901+0000 7f00ab555640 1 -- 172.21.15.44:0/2441273893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00a40cdc50 msgr2=0x7f00a40b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.901+0000 7f00ab555640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00a40cdc50 0x7f00a40b3800 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f009c000c00 tx=0x7f009c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.903+0000 7f00ab555640 1 -- 172.21.15.44:0/2441273893 shutdown_connections 2023-11-04T01:37:13.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.903+0000 7f00ab555640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f009006ae70 0x7f009006d330 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.903+0000 7f00ab555640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a415d1b0 0x7f00a40b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.903+0000 7f00ab555640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a40cecf0 0x7f00a415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.903+0000 7f00ab555640 1 --2- 172.21.15.44:0/2441273893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00a40cdc50 0x7f00a40b3800 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.903+0000 7f00ab555640 1 -- 172.21.15.44:0/2441273893 >> 172.21.15.44:0/2441273893 conn(0x7f00a406ea20 msgr2=0x7f00a415b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:13.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.905+0000 7f00ab555640 1 -- 172.21.15.44:0/2441273893 shutdown_connections 2023-11-04T01:37:13.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:13.905+0000 7f00ab555640 1 -- 172.21.15.44:0/2441273893 wait complete. 2023-11-04T01:37:13.925 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:37:13.925 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:37:13.925 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:37:13.925 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:13.925 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:37:13.926 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:37:13.926 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:37:13.926 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:13.926 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:37:13.926 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:37:13.926 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:37:13.926 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:13.927 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:37:13.927 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:37:13.927 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:37:13.927 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:13.939 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:37:13.940 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:37:13.940 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:37:13.941 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:37:13.943 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:37:13.943 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:37:13.943 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:37:13.944 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:37:13.982 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:37:13.983 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:13.983 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:37:13.983 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:13.987 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:37:13.987 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:37:13.987 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:13.987 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:13.988 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:37:14.064 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2023-11-04T01:37:14.064 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2023-11-04T01:37:14.068 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2023-11-04T01:37:14.069 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2023-11-04T01:37:14.069 INFO:tasks.ceph.mds.c.smithi044.stderr:2023-11-04T01:37:14.068+0000 7f8e535d4640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-11-04T01:37:14.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.101+0000 7f3927b2c640 1 Processor -- start 2023-11-04T01:37:14.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.101+0000 7f3927b2c640 1 -- start start 2023-11-04T01:37:14.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.102+0000 7f3927b2c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39200b4880 0x7f39200b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.102+0000 7f3927b2c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39200cde60 con 0x7f39200cd6d0 2023-11-04T01:37:14.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.102+0000 7f3927b2c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3920160f90 con 0x7f3920153e60 2023-11-04T01:37:14.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.102+0000 7f39250c7640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f39200cd6d0 0x7f3920161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52002/0 (socket says 172.21.15.44:52002) 2023-11-04T01:37:14.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.102+0000 7f39250c7640 1 -- 172.21.15.44:0/743797875 learned_addr learned my addr 172.21.15.44:0/743797875 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:14.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.102+0000 7f3927b2c640 1 -- 172.21.15.44:0/743797875 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39200b5200 con 0x7f39200b4880 2023-11-04T01:37:14.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.102+0000 7f39260c9640 1 --2- 172.21.15.44:0/743797875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39200b4880 0x7f39200b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.103+0000 7f39248c6640 1 -- 172.21.15.44:0/743797875 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812807141 0 0) 0x7f39200cde60 con 0x7f39200cd6d0 2023-11-04T01:37:14.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.103+0000 7f39248c6640 1 -- 172.21.15.44:0/743797875 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f390c003520 con 0x7f39200cd6d0 2023-11-04T01:37:14.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.103+0000 7f39248c6640 1 -- 172.21.15.44:0/743797875 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845198156 0 0) 0x7f3920160f90 con 0x7f3920153e60 2023-11-04T01:37:14.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.103+0000 7f39248c6640 1 -- 172.21.15.44:0/743797875 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39200cde60 con 0x7f3920153e60 2023-11-04T01:37:14.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.103+0000 7f39260c9640 1 -- 172.21.15.44:0/743797875 >> v1:172.21.15.204:6789/0 conn(0x7f3920153e60 legacy=0x7f392015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.103+0000 7f39260c9640 1 -- 172.21.15.44:0/743797875 >> v1:172.21.15.44:6789/0 conn(0x7f39200cd6d0 legacy=0x7f3920161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.103+0000 7f39260c9640 1 -- 172.21.15.44:0/743797875 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39200ce090 con 0x7f39200b4880 2023-11-04T01:37:14.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.104+0000 7f39260c9640 1 --2- 172.21.15.44:0/743797875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39200b4880 0x7f39200b4cc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3918009dc0 tx=0x7f391802bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6643dd3849d34b54 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.104+0000 7f39248c6640 1 -- 172.21.15.44:0/743797875 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391802ccc0 con 0x7f39200b4880 2023-11-04T01:37:14.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.104+0000 7f39248c6640 1 -- 172.21.15.44:0/743797875 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391802ce20 con 0x7f39200b4880 2023-11-04T01:37:14.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.104+0000 7f39248c6640 1 -- 172.21.15.44:0/743797875 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918034660 con 0x7f39200b4880 2023-11-04T01:37:14.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.104+0000 7f3927b2c640 1 -- 172.21.15.44:0/743797875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39200b4880 msgr2=0x7f39200b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.104+0000 7f3927b2c640 1 --2- 172.21.15.44:0/743797875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39200b4880 0x7f39200b4cc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3918009dc0 tx=0x7f391802bf10 comp rx=0 tx=0).stop 2023-11-04T01:37:14.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.104+0000 7f3927b2c640 1 -- 172.21.15.44:0/743797875 shutdown_connections 2023-11-04T01:37:14.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.104+0000 7f3927b2c640 1 --2- 172.21.15.44:0/743797875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39200b4880 0x7f39200b4cc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.104+0000 7f3927b2c640 1 -- 172.21.15.44:0/743797875 >> 172.21.15.44:0/743797875 conn(0x7f39200cf880 msgr2=0x7f39200cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:14.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.104+0000 7f3927b2c640 1 -- 172.21.15.44:0/743797875 shutdown_connections 2023-11-04T01:37:14.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.104+0000 7f3927b2c640 1 -- 172.21.15.44:0/743797875 wait complete. 2023-11-04T01:37:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.106+0000 7f3927b2c640 1 Processor -- start 2023-11-04T01:37:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.106+0000 7f3927b2c640 1 -- start start 2023-11-04T01:37:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f3927b2c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39200b4880 0x7f39201f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f3927b2c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39200cd6d0 0x7f3920154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f3927b2c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3920153e60 0x7f39200b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f3927b2c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39200b7f70 con 0x7f3920153e60 2023-11-04T01:37:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f3927b2c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3920159540 con 0x7f39200b4880 2023-11-04T01:37:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f3927b2c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39200b8160 con 0x7f39200cd6d0 2023-11-04T01:37:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f39260c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3920153e60 0x7f39200b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f39260c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3920153e60 0x7f39200b7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60180/0 (socket says 172.21.15.44:60180) 2023-11-04T01:37:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f39260c9640 1 -- 172.21.15.44:0/562397696 learned_addr learned my addr 172.21.15.44:0/562397696 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f39258c8640 1 --2- 172.21.15.44:0/562397696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39200b4880 0x7f39201f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f39250c7640 1 --2- 172.21.15.44:0/562397696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39200cd6d0 0x7f3920154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f39260c9640 1 -- 172.21.15.44:0/562397696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39200cd6d0 msgr2=0x7f3920154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f39260c9640 1 --2- 172.21.15.44:0/562397696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39200cd6d0 0x7f3920154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f39260c9640 1 -- 172.21.15.44:0/562397696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39200b4880 msgr2=0x7f39201f2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f39260c9640 1 --2- 172.21.15.44:0/562397696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39200b4880 0x7f39201f2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.107+0000 7f39260c9640 1 -- 172.21.15.44:0/562397696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3918009a70 con 0x7f3920153e60 2023-11-04T01:37:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.108+0000 7f39260c9640 1 --2- 172.21.15.44:0/562397696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3920153e60 0x7f39200b7a30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3918037040 tx=0x7f3918004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.108+0000 7f39167fc640 1 -- 172.21.15.44:0/562397696 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918040650 con 0x7f3920153e60 2023-11-04T01:37:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.108+0000 7f39167fc640 1 -- 172.21.15.44:0/562397696 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39180407b0 con 0x7f3920153e60 2023-11-04T01:37:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.108+0000 7f3927b2c640 1 -- 172.21.15.44:0/562397696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3920159770 con 0x7f3920153e60 2023-11-04T01:37:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.108+0000 7f39167fc640 1 -- 172.21.15.44:0/562397696 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918040b60 con 0x7f3920153e60 2023-11-04T01:37:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.108+0000 7f3927b2c640 1 -- 172.21.15.44:0/562397696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3920159d30 con 0x7f3920153e60 2023-11-04T01:37:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.109+0000 7f3927b2c640 1 -- 172.21.15.44:0/562397696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3920074290 con 0x7f3920153e60 2023-11-04T01:37:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.109+0000 7f39167fc640 1 -- 172.21.15.44:0/562397696 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3918040cc0 con 0x7f3920153e60 2023-11-04T01:37:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.110+0000 7f39167fc640 1 --2- 172.21.15.44:0/562397696 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f390406ae70 0x7f390406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.110+0000 7f39167fc640 1 -- 172.21.15.44:0/562397696 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f39180abf60 con 0x7f3920153e60 2023-11-04T01:37:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.110+0000 7f39258c8640 1 --2- 172.21.15.44:0/562397696 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f390406ae70 0x7f390406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.110+0000 7f39258c8640 1 --2- 172.21.15.44:0/562397696 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f390406ae70 0x7f390406d330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f39100011e0 tx=0x7f3910009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.114+0000 7f39167fc640 1 -- 172.21.15.44:0/562397696 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39180771e0 con 0x7f3920153e60 2023-11-04T01:37:14.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:14.306+0000 7f3927b2c640 1 -- 172.21.15.44:0/562397696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f39200ce340 con 0x7f3920153e60 2023-11-04T01:37:15.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.198+0000 7f39167fc640 1 -- 172.21.15.44:0/562397696 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3918009450 con 0x7f3920153e60 2023-11-04T01:37:15.201 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2023-11-04T01:37:15.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.201+0000 7f3927b2c640 1 -- 172.21.15.44:0/562397696 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f390406ae70 msgr2=0x7f390406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.201+0000 7f3927b2c640 1 --2- 172.21.15.44:0/562397696 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f390406ae70 0x7f390406d330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f39100011e0 tx=0x7f3910009040 comp rx=0 tx=0).stop 2023-11-04T01:37:15.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.201+0000 7f3927b2c640 1 -- 172.21.15.44:0/562397696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3920153e60 msgr2=0x7f39200b7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.201+0000 7f3927b2c640 1 --2- 172.21.15.44:0/562397696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3920153e60 0x7f39200b7a30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3918037040 tx=0x7f3918004ab0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.201+0000 7f3927b2c640 1 -- 172.21.15.44:0/562397696 shutdown_connections 2023-11-04T01:37:15.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.201+0000 7f3927b2c640 1 --2- 172.21.15.44:0/562397696 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f390406ae70 0x7f390406d330 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.201+0000 7f3927b2c640 1 --2- 172.21.15.44:0/562397696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3920153e60 0x7f39200b7a30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.201+0000 7f3927b2c640 1 --2- 172.21.15.44:0/562397696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39200cd6d0 0x7f3920154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.201+0000 7f3927b2c640 1 --2- 172.21.15.44:0/562397696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39200b4880 0x7f39201f2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.201+0000 7f3927b2c640 1 -- 172.21.15.44:0/562397696 >> 172.21.15.44:0/562397696 conn(0x7f39200cf880 msgr2=0x7f39200d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.201+0000 7f3927b2c640 1 -- 172.21.15.44:0/562397696 shutdown_connections 2023-11-04T01:37:15.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.201+0000 7f3927b2c640 1 -- 172.21.15.44:0/562397696 wait complete. 2023-11-04T01:37:15.217 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:37:15.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.329+0000 7f8ff1af3640 1 Processor -- start 2023-11-04T01:37:15.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.329+0000 7f8ff1af3640 1 -- start start 2023-11-04T01:37:15.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.330+0000 7f8ff1af3640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8fec157710 0x7f8fec167b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.330+0000 7f8ff1af3640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fec15e000 con 0x7f8fec0cde60 2023-11-04T01:37:15.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.330+0000 7f8ff1af3640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fec15e2e0 con 0x7f8fec0ce240 2023-11-04T01:37:15.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.330+0000 7f8ff1af3640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fec15e5c0 con 0x7f8fec157710 2023-11-04T01:37:15.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.330+0000 7f8feb7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8fec0cde60 0x7f8fec15d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52012/0 (socket says 172.21.15.44:52012) 2023-11-04T01:37:15.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.330+0000 7f8feb7fe640 1 -- 172.21.15.44:0/1939127751 learned_addr learned my addr 172.21.15.44:0/1939127751 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:15.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8febfff640 1 --2- 172.21.15.44:0/1939127751 >> v2:172.21.15.204:3300/0 conn(0x7f8fec157710 0x7f8fec167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8fea7fc640 1 -- 172.21.15.44:0/1939127751 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747903690 0 0) 0x7f8fec15e000 con 0x7f8fec0cde60 2023-11-04T01:37:15.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8fea7fc640 1 -- 172.21.15.44:0/1939127751 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fd4003520 con 0x7f8fec0cde60 2023-11-04T01:37:15.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8fea7fc640 1 -- 172.21.15.44:0/1939127751 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3333916654 0 0) 0x7f8fd4003520 con 0x7f8fec0cde60 2023-11-04T01:37:15.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8fea7fc640 1 -- 172.21.15.44:0/1939127751 >> v2:172.21.15.204:3300/0 conn(0x7f8fec157710 msgr2=0x7f8fec167b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:15.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8fea7fc640 1 --2- 172.21.15.44:0/1939127751 >> v2:172.21.15.204:3300/0 conn(0x7f8fec157710 0x7f8fec167b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8fea7fc640 1 -- 172.21.15.44:0/1939127751 >> v1:172.21.15.204:6789/0 conn(0x7f8fec0ce240 legacy=0x7f8fec157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8fea7fc640 1 -- 172.21.15.44:0/1939127751 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec0d1120 con 0x7f8fec0cde60 2023-11-04T01:37:15.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8fea7fc640 1 -- 172.21.15.44:0/1939127751 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f8fdc001670 con 0x7f8fec0cde60 2023-11-04T01:37:15.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8febfff640 1 --2- 172.21.15.44:0/1939127751 >> v2:172.21.15.204:3300/0 conn(0x7f8fec157710 0x7f8fec167b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:15.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8fea7fc640 1 -- 172.21.15.44:0/1939127751 >> v1:172.21.15.44:6789/0 conn(0x7f8fec0cde60 legacy=0x7f8fec15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8fea7fc640 1 --2- 172.21.15.44:0/1939127751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fd4003970 0x7f8fd4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8fea7fc640 1 --2- 172.21.15.44:0/1939127751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fd40047c0 0x7f8fd4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8fea7fc640 1 --2- 172.21.15.44:0/1939127751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd4005180 0x7f8fd400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8fea7fc640 1 -- 172.21.15.44:0/1939127751 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec15e5c0 con 0x7f8fd4005180 2023-11-04T01:37:15.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8fea7fc640 1 -- 172.21.15.44:0/1939127751 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd400c020 con 0x7f8fd4003970 2023-11-04T01:37:15.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8fea7fc640 1 -- 172.21.15.44:0/1939127751 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd400c1e0 con 0x7f8fd40047c0 2023-11-04T01:37:15.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8febfff640 1 --2- 172.21.15.44:0/1939127751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd4005180 0x7f8fd400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8feb7fe640 1 --2- 172.21.15.44:0/1939127751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fd4003970 0x7f8fd4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8feaffd640 1 --2- 172.21.15.44:0/1939127751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fd40047c0 0x7f8fd4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8febfff640 1 -- 172.21.15.44:0/1939127751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fd40047c0 msgr2=0x7f8fd4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:15.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8febfff640 1 --2- 172.21.15.44:0/1939127751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fd40047c0 0x7f8fd4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8febfff640 1 -- 172.21.15.44:0/1939127751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fd4003970 msgr2=0x7f8fd4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:15.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8febfff640 1 --2- 172.21.15.44:0/1939127751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fd4003970 0x7f8fd4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.331+0000 7f8febfff640 1 -- 172.21.15.44:0/1939127751 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd4003520 con 0x7f8fd4005180 2023-11-04T01:37:15.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.332+0000 7f8feaffd640 1 --2- 172.21.15.44:0/1939127751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fd40047c0 0x7f8fd4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:15.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.332+0000 7f8febfff640 1 -- 172.21.15.44:0/1939127751 reap_dead start 2023-11-04T01:37:15.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.332+0000 7f8febfff640 1 --2- 172.21.15.44:0/1939127751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd4005180 0x7f8fd400b980 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400e350 tx=0x7f8fd40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3015be6b0a2787 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.332+0000 7f8fea7fc640 1 -- 172.21.15.44:0/1939127751 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe402ce00 con 0x7f8fd4005180 2023-11-04T01:37:15.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.332+0000 7f8fea7fc640 1 -- 172.21.15.44:0/1939127751 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe400f040 con 0x7f8fd4005180 2023-11-04T01:37:15.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.332+0000 7f8fea7fc640 1 -- 172.21.15.44:0/1939127751 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4034680 con 0x7f8fd4005180 2023-11-04T01:37:15.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.333+0000 7f8ff1af3640 1 -- 172.21.15.44:0/1939127751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd4005180 msgr2=0x7f8fd400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.333+0000 7f8ff1af3640 1 --2- 172.21.15.44:0/1939127751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd4005180 0x7f8fd400b980 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400e350 tx=0x7f8fd40057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.333+0000 7f8ff1af3640 1 -- 172.21.15.44:0/1939127751 shutdown_connections 2023-11-04T01:37:15.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.333+0000 7f8ff1af3640 1 --2- 172.21.15.44:0/1939127751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd4005180 0x7f8fd400b980 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.333+0000 7f8ff1af3640 1 -- 172.21.15.44:0/1939127751 >> 172.21.15.44:0/1939127751 conn(0x7f8fec071f30 msgr2=0x7f8fec0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.333+0000 7f8ff1af3640 1 -- 172.21.15.44:0/1939127751 shutdown_connections 2023-11-04T01:37:15.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.333+0000 7f8ff1af3640 1 -- 172.21.15.44:0/1939127751 wait complete. 2023-11-04T01:37:15.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.334+0000 7f8ff1af3640 1 Processor -- start 2023-11-04T01:37:15.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.334+0000 7f8ff1af3640 1 -- start start 2023-11-04T01:37:15.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.335+0000 7f8ff1af3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd4005180 0x7f8fec0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.335+0000 7f8ff1af3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fec1598b0 0x7f8fec15c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.335+0000 7f8ff1af3640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fec15c780 0x7f8fec158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.335+0000 7f8ff1af3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec15cc00 con 0x7f8fd4005180 2023-11-04T01:37:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.335+0000 7f8ff1af3640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec149020 con 0x7f8fec15c780 2023-11-04T01:37:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.335+0000 7f8ff1af3640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec149300 con 0x7f8fec1598b0 2023-11-04T01:37:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.335+0000 7f8feb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd4005180 0x7f8fec0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.335+0000 7f8feb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd4005180 0x7f8fec0b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60204/0 (socket says 172.21.15.44:60204) 2023-11-04T01:37:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.335+0000 7f8feb7fe640 1 -- 172.21.15.44:0/3875927093 learned_addr learned my addr 172.21.15.44:0/3875927093 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.335+0000 7f8feaffd640 1 --2- 172.21.15.44:0/3875927093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fec1598b0 0x7f8fec15c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.335+0000 7f8febfff640 1 --2- 172.21.15.44:0/3875927093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fec15c780 0x7f8fec158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.336+0000 7f8feb7fe640 1 -- 172.21.15.44:0/3875927093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fec1598b0 msgr2=0x7f8fec15c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.336+0000 7f8feb7fe640 1 --2- 172.21.15.44:0/3875927093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fec1598b0 0x7f8fec15c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.336+0000 7f8feb7fe640 1 -- 172.21.15.44:0/3875927093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fec15c780 msgr2=0x7f8fec158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.336+0000 7f8feb7fe640 1 --2- 172.21.15.44:0/3875927093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fec15c780 0x7f8fec158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.336+0000 7f8feb7fe640 1 -- 172.21.15.44:0/3875927093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec1495e0 con 0x7f8fd4005180 2023-11-04T01:37:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.336+0000 7f8feb7fe640 1 --2- 172.21.15.44:0/3875927093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd4005180 0x7f8fec0b42a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0072c0 tx=0x7f8fdc007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.336+0000 7f8fd3fff640 1 -- 172.21.15.44:0/3875927093 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00f960 con 0x7f8fd4005180 2023-11-04T01:37:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.336+0000 7f8fd3fff640 1 -- 172.21.15.44:0/3875927093 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc00fae0 con 0x7f8fd4005180 2023-11-04T01:37:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.336+0000 7f8fd3fff640 1 -- 172.21.15.44:0/3875927093 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00fe90 con 0x7f8fd4005180 2023-11-04T01:37:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.336+0000 7f8ff1af3640 1 -- 172.21.15.44:0/3875927093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fec1498c0 con 0x7f8fd4005180 2023-11-04T01:37:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.336+0000 7f8ff1af3640 1 -- 172.21.15.44:0/3875927093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fec159d30 con 0x7f8fd4005180 2023-11-04T01:37:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.337+0000 7f8ff1af3640 1 -- 172.21.15.44:0/3875927093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fec074290 con 0x7f8fd4005180 2023-11-04T01:37:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.337+0000 7f8fd3fff640 1 -- 172.21.15.44:0/3875927093 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8fdc01d460 con 0x7f8fd4005180 2023-11-04T01:37:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.338+0000 7f8fd3fff640 1 --2- 172.21.15.44:0/3875927093 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8fd806ae70 0x7f8fd806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.338+0000 7f8fd3fff640 1 -- 172.21.15.44:0/3875927093 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8fdc089500 con 0x7f8fd4005180 2023-11-04T01:37:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.338+0000 7f8feaffd640 1 --2- 172.21.15.44:0/3875927093 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8fd806ae70 0x7f8fd806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.338+0000 7f8feaffd640 1 --2- 172.21.15.44:0/3875927093 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8fd806ae70 0x7f8fd806d330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0000c00 tx=0x7f8fe0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.342+0000 7f8fd3fff640 1 -- 172.21.15.44:0/3875927093 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8fdc054850 con 0x7f8fd4005180 2023-11-04T01:37:15.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.586+0000 7f8ff1af3640 1 -- 172.21.15.44:0/3875927093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8fec0c6550 con 0x7f8fd4005180 2023-11-04T01:37:15.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.586+0000 7f8fd3fff640 1 -- 172.21.15.44:0/3875927093 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f8fdc057e70 con 0x7f8fd4005180 2023-11-04T01:37:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:15.588 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:37:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2023-11-04T01:37:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2023-11-04T01:37:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0Vldrw2ExAA5cS9IfcK2l8SXaZdWm4f8g==", 2023-11-04T01:37:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:37:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:37:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2023-11-04T01:37:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlOogfIRAAYEw/sXZBXk/GJOrnBTA7xg==", 2023-11-04T01:37:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:37:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:37:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2023-11-04T01:37:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlDPc/GxAA32BghmM85xfJ14TjYFtNRw==", 2023-11-04T01:37:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:37:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:37:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2023-11-04T01:37:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlYpOSKBAAVivyMFmzkREyWWFObAwKHw==", 2023-11-04T01:37:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:37:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:37:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2023-11-04T01:37:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDIn0VlTfR3ExAAt6S9NmZfuM9CoPfVNGkhmA==", 2023-11-04T01:37:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2023-11-04T01:37:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDLn0VlqkLfExAABN3cHR+cDXm0tN4tpWR+0w==", 2023-11-04T01:37:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2023-11-04T01:37:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDOn0Vl9JO/EhAAuC0w9vFxOiRs7Tm3UZHVXg==", 2023-11-04T01:37:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2023-11-04T01:37:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDRn0VlKSy2EhAAerLDC/nZsTK5KdG+Q1Ycow==", 2023-11-04T01:37:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2023-11-04T01:37:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDXn0Vl9FINGxAA5lLkwH709SJ00yfxB6MCaw==", 2023-11-04T01:37:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2023-11-04T01:37:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDan0Vlo5v3GRAA/ZGOqGFMxQuGirRMadC+9Q==", 2023-11-04T01:37:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2023-11-04T01:37:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDdn0Vl+q9GGBAA7obGN4GMa7glnpuDSQKV2g==", 2023-11-04T01:37:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2023-11-04T01:37:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDgn0VlbLVCFxAANjcDDYPfWCNGQF1twWc35w==", 2023-11-04T01:37:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2023-11-04T01:37:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlmqcrLRAAFCsu/sJUUh45gPboIgq6Dw==", 2023-11-04T01:37:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:37:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:37:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:37:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2023-11-04T01:37:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlSFWINBAAAvkXSoHilQ3GXBE61Tvx2w==", 2023-11-04T01:37:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:37:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:37:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:37:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2023-11-04T01:37:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0Vlcp71MBAAkYQz0CUf7LY9WIvX0mXzKg==", 2023-11-04T01:37:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:37:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:37:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:37:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2023-11-04T01:37:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0Vl08lCOhAAQxQts3txc7gsu8txLGzouA==", 2023-11-04T01:37:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:37:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:37:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:37:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2023-11-04T01:37:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDDn0VlgZZFMBAA94xTIAij5lx9yGEyPDd/SQ==", 2023-11-04T01:37:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2023-11-04T01:37:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:37:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:37:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-mds", 2023-11-04T01:37:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDmn0Vl+dGgGBAAliLmp0563JOtqu6bOOR0Hw==", 2023-11-04T01:37:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-mds" 2023-11-04T01:37:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-mgr", 2023-11-04T01:37:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDmn0VlC9ugGBAA8rSSZ3ny92yGD7w1gd5B1g==", 2023-11-04T01:37:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-04T01:37:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-osd", 2023-11-04T01:37:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDmn0VlnuKgGBAAKINiN1MTi3r9X3eMgtIK4Q==", 2023-11-04T01:37:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-osd" 2023-11-04T01:37:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-rbd", 2023-11-04T01:37:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDmn0Vl2emgGBAAJhtdg1CrBM74qK0f6CrEmg==", 2023-11-04T01:37:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-04T01:37:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-04T01:37:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDmn0VlmfGgGBAAkadU+lI9n5Pl60W0y2J9AQ==", 2023-11-04T01:37:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-04T01:37:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-rgw", 2023-11-04T01:37:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDmn0VlkPmgGBAAnUP7HTh8N3fqnGBsOiDwBQ==", 2023-11-04T01:37:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-04T01:37:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2023-11-04T01:37:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlSeFMDxAAwW0lbfxAbIKPgPCkJD1FMg==", 2023-11-04T01:37:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2023-11-04T01:37:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2023-11-04T01:37:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2023-11-04T01:37:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlX+8eCxAAuBbLfpXHKHIIDc4zo9Insw==", 2023-11-04T01:37:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2023-11-04T01:37:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2023-11-04T01:37:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2023-11-04T01:37:15.608 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:37:15.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.588+0000 7f8ff1af3640 1 -- 172.21.15.44:0/3875927093 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8fd806ae70 msgr2=0x7f8fd806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.588+0000 7f8ff1af3640 1 --2- 172.21.15.44:0/3875927093 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8fd806ae70 0x7f8fd806d330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0000c00 tx=0x7f8fe0009040 comp rx=0 tx=0).stop 2023-11-04T01:37:15.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.588+0000 7f8ff1af3640 1 -- 172.21.15.44:0/3875927093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd4005180 msgr2=0x7f8fec0b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.588+0000 7f8ff1af3640 1 --2- 172.21.15.44:0/3875927093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd4005180 0x7f8fec0b42a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0072c0 tx=0x7f8fdc007780 comp rx=0 tx=0).stop 2023-11-04T01:37:15.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.588+0000 7f8ff1af3640 1 -- 172.21.15.44:0/3875927093 shutdown_connections 2023-11-04T01:37:15.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.588+0000 7f8ff1af3640 1 --2- 172.21.15.44:0/3875927093 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8fd806ae70 0x7f8fd806d330 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.588+0000 7f8ff1af3640 1 --2- 172.21.15.44:0/3875927093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fec15c780 0x7f8fec158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.588+0000 7f8ff1af3640 1 --2- 172.21.15.44:0/3875927093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fec1598b0 0x7f8fec15c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.588+0000 7f8ff1af3640 1 --2- 172.21.15.44:0/3875927093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd4005180 0x7f8fec0b42a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.588+0000 7f8ff1af3640 1 -- 172.21.15.44:0/3875927093 >> 172.21.15.44:0/3875927093 conn(0x7f8fec071f30 msgr2=0x7f8fec0b6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.588+0000 7f8ff1af3640 1 -- 172.21.15.44:0/3875927093 shutdown_connections 2023-11-04T01:37:15.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.588+0000 7f8ff1af3640 1 -- 172.21.15.44:0/3875927093 wait complete. 2023-11-04T01:37:15.613 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-04T01:37:15.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.720+0000 7f260b125640 1 Processor -- start 2023-11-04T01:37:15.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.721+0000 7f260b125640 1 -- start start 2023-11-04T01:37:15.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.721+0000 7f260b125640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2604153e60 0x7f260415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.721+0000 7f260b125640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26040cde60 con 0x7f26040cd6d0 2023-11-04T01:37:15.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.721+0000 7f260b125640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2604160f90 con 0x7f26040b4880 2023-11-04T01:37:15.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.721+0000 7f260b125640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260415e400 con 0x7f2604153e60 2023-11-04T01:37:15.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f2603fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f26040cd6d0 0x7f2604161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52024/0 (socket says 172.21.15.44:52024) 2023-11-04T01:37:15.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f2603fff640 1 -- 172.21.15.44:0/3818883012 learned_addr learned my addr 172.21.15.44:0/3818883012 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:15.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f2608ec1640 1 --2- 172.21.15.44:0/3818883012 >> v2:172.21.15.204:3300/0 conn(0x7f2604153e60 0x7f260415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304828337 0 0) 0x7f26040cde60 con 0x7f26040cd6d0 2023-11-04T01:37:15.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f4003520 con 0x7f26040cd6d0 2023-11-04T01:37:15.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336179663 0 0) 0x7f2604160f90 con 0x7f26040b4880 2023-11-04T01:37:15.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26040cde60 con 0x7f26040b4880 2023-11-04T01:37:15.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 496018136 0 0) 0x7f25f4003520 con 0x7f26040cd6d0 2023-11-04T01:37:15.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 >> v2:172.21.15.204:3300/0 conn(0x7f2604153e60 msgr2=0x7f260415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:15.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 --2- 172.21.15.44:0/3818883012 >> v2:172.21.15.204:3300/0 conn(0x7f2604153e60 0x7f260415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 >> v1:172.21.15.204:6789/0 conn(0x7f26040b4880 legacy=0x7f26040d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26040ce090 con 0x7f26040cd6d0 2023-11-04T01:37:15.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f25f0001670 con 0x7f26040cd6d0 2023-11-04T01:37:15.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f2608ec1640 1 --2- 172.21.15.44:0/3818883012 >> v2:172.21.15.204:3300/0 conn(0x7f2604153e60 0x7f260415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:15.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 >> v1:172.21.15.44:6789/0 conn(0x7f26040cd6d0 legacy=0x7f2604161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 --2- 172.21.15.44:0/3818883012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25f4003b00 0x7f25f4003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 --2- 172.21.15.44:0/3818883012 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25f40047c0 0x7f25f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 --2- 172.21.15.44:0/3818883012 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25f4005180 0x7f25f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260415e400 con 0x7f25f4003b00 2023-11-04T01:37:15.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f400c000 con 0x7f25f40047c0 2023-11-04T01:37:15.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f400c1c0 con 0x7f25f4005180 2023-11-04T01:37:15.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f2608ec1640 1 --2- 172.21.15.44:0/3818883012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25f4003b00 0x7f25f4003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f2603fff640 1 --2- 172.21.15.44:0/3818883012 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25f40047c0 0x7f25f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.722+0000 7f26096c2640 1 --2- 172.21.15.44:0/3818883012 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25f4005180 0x7f25f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.723+0000 7f2608ec1640 1 -- 172.21.15.44:0/3818883012 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25f4005180 msgr2=0x7f25f400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:15.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.723+0000 7f2608ec1640 1 --2- 172.21.15.44:0/3818883012 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25f4005180 0x7f25f400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.723+0000 7f2608ec1640 1 -- 172.21.15.44:0/3818883012 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25f40047c0 msgr2=0x7f25f4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:15.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.723+0000 7f2608ec1640 1 --2- 172.21.15.44:0/3818883012 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25f40047c0 0x7f25f4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.723+0000 7f2608ec1640 1 -- 172.21.15.44:0/3818883012 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f4003520 con 0x7f25f4003b00 2023-11-04T01:37:15.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.723+0000 7f26096c2640 1 --2- 172.21.15.44:0/3818883012 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25f4005180 0x7f25f400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:15.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.723+0000 7f26096c2640 1 -- 172.21.15.44:0/3818883012 reap_dead start 2023-11-04T01:37:15.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.723+0000 7f2608ec1640 1 --2- 172.21.15.44:0/3818883012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25f4003b00 0x7f25f4003f00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009c90 tx=0x7f25f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ed84410958edd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.723+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f802c8f0 con 0x7f25f4003b00 2023-11-04T01:37:15.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.723+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f802ca50 con 0x7f25f4003b00 2023-11-04T01:37:15.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.723+0000 7f26037fe640 1 -- 172.21.15.44:0/3818883012 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f802ce40 con 0x7f25f4003b00 2023-11-04T01:37:15.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.724+0000 7f260b125640 1 -- 172.21.15.44:0/3818883012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25f4003b00 msgr2=0x7f25f4003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.724+0000 7f260b125640 1 --2- 172.21.15.44:0/3818883012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25f4003b00 0x7f25f4003f00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009c90 tx=0x7f25f40057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.724+0000 7f260b125640 1 -- 172.21.15.44:0/3818883012 shutdown_connections 2023-11-04T01:37:15.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.724+0000 7f260b125640 1 --2- 172.21.15.44:0/3818883012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25f4003b00 0x7f25f4003f00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.724+0000 7f260b125640 1 -- 172.21.15.44:0/3818883012 >> 172.21.15.44:0/3818883012 conn(0x7f26040cf880 msgr2=0x7f26040cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.724+0000 7f260b125640 1 -- 172.21.15.44:0/3818883012 shutdown_connections 2023-11-04T01:37:15.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.724+0000 7f260b125640 1 -- 172.21.15.44:0/3818883012 wait complete. 2023-11-04T01:37:15.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.725+0000 7f260b125640 1 Processor -- start 2023-11-04T01:37:15.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.725+0000 7f260b125640 1 -- start start 2023-11-04T01:37:15.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.726+0000 7f260b125640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25f4003b00 0x7f26041f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.726+0000 7f260b125640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26041480c0 0x7f26041f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.726+0000 7f260b125640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26041f6250 0x7f26040d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.726+0000 7f260b125640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26041f3720 con 0x7f26041480c0 2023-11-04T01:37:15.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.726+0000 7f260b125640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26041f2740 con 0x7f26041f6250 2023-11-04T01:37:15.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.726+0000 7f260b125640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26041f6790 con 0x7f25f4003b00 2023-11-04T01:37:15.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.726+0000 7f2603fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26041480c0 0x7f26041f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.726+0000 7f2603fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26041480c0 0x7f26041f5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60234/0 (socket says 172.21.15.44:60234) 2023-11-04T01:37:15.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.726+0000 7f2603fff640 1 -- 172.21.15.44:0/3522163261 learned_addr learned my addr 172.21.15.44:0/3522163261 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.726+0000 7f2608ec1640 1 --2- 172.21.15.44:0/3522163261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25f4003b00 0x7f26041f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.726+0000 7f26096c2640 1 --2- 172.21.15.44:0/3522163261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26041f6250 0x7f26040d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.726+0000 7f2603fff640 1 -- 172.21.15.44:0/3522163261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25f4003b00 msgr2=0x7f26041f31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.726+0000 7f2603fff640 1 --2- 172.21.15.44:0/3522163261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25f4003b00 0x7f26041f31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.727+0000 7f2603fff640 1 -- 172.21.15.44:0/3522163261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26041f6250 msgr2=0x7f26040d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.727+0000 7f2603fff640 1 --2- 172.21.15.44:0/3522163261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26041f6250 0x7f26040d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.727+0000 7f2603fff640 1 -- 172.21.15.44:0/3522163261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26041f6a70 con 0x7f26041480c0 2023-11-04T01:37:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.727+0000 7f2603fff640 1 --2- 172.21.15.44:0/3522163261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26041480c0 0x7f26041f5d10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f25f000e7f0 tx=0x7f25f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.727+0000 7f26017fa640 1 -- 172.21.15.44:0/3522163261 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f000c870 con 0x7f26041480c0 2023-11-04T01:37:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.727+0000 7f26017fa640 1 -- 172.21.15.44:0/3522163261 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f000c9d0 con 0x7f26041480c0 2023-11-04T01:37:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.727+0000 7f260b125640 1 -- 172.21.15.44:0/3522163261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26041f29e0 con 0x7f26041480c0 2023-11-04T01:37:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.727+0000 7f26017fa640 1 -- 172.21.15.44:0/3522163261 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f000cd60 con 0x7f26041480c0 2023-11-04T01:37:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.727+0000 7f260b125640 1 -- 172.21.15.44:0/3522163261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26040ccb80 con 0x7f26041480c0 2023-11-04T01:37:15.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.728+0000 7f260b125640 1 -- 172.21.15.44:0/3522163261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26041f2ea0 con 0x7f26041480c0 2023-11-04T01:37:15.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.728+0000 7f26017fa640 1 -- 172.21.15.44:0/3522163261 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f25f001d460 con 0x7f26041480c0 2023-11-04T01:37:15.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.729+0000 7f26017fa640 1 --2- 172.21.15.44:0/3522163261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f25e806aea0 0x7f25e806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.729+0000 7f26017fa640 1 -- 172.21.15.44:0/3522163261 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f25f0089290 con 0x7f26041480c0 2023-11-04T01:37:15.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.729+0000 7f2608ec1640 1 --2- 172.21.15.44:0/3522163261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f25e806aea0 0x7f25e806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.730+0000 7f2608ec1640 1 --2- 172.21.15.44:0/3522163261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f25e806aea0 0x7f25e806d360 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f25f8036000 tx=0x7f25f8030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.733+0000 7f26017fa640 1 -- 172.21.15.44:0/3522163261 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f25f00545e0 con 0x7f26041480c0 2023-11-04T01:37:15.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.977+0000 7f260b125640 1 -- 172.21.15.44:0/3522163261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f2604074290 con 0x7f26041480c0 2023-11-04T01:37:15.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.979+0000 7f26017fa640 1 -- 172.21.15.44:0/3522163261 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f25f0057c00 con 0x7f26041480c0 2023-11-04T01:37:15.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.981+0000 7f260b125640 1 -- 172.21.15.44:0/3522163261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f25e806aea0 msgr2=0x7f25e806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.981+0000 7f260b125640 1 --2- 172.21.15.44:0/3522163261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f25e806aea0 0x7f25e806d360 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f25f8036000 tx=0x7f25f8030000 comp rx=0 tx=0).stop 2023-11-04T01:37:15.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.981+0000 7f260b125640 1 -- 172.21.15.44:0/3522163261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26041480c0 msgr2=0x7f26041f5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.981+0000 7f260b125640 1 --2- 172.21.15.44:0/3522163261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26041480c0 0x7f26041f5d10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f25f000e7f0 tx=0x7f25f000ecb0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.981+0000 7f260b125640 1 -- 172.21.15.44:0/3522163261 shutdown_connections 2023-11-04T01:37:15.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.981+0000 7f260b125640 1 --2- 172.21.15.44:0/3522163261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f25e806aea0 0x7f25e806d360 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.981+0000 7f260b125640 1 --2- 172.21.15.44:0/3522163261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26041f6250 0x7f26040d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.981+0000 7f260b125640 1 --2- 172.21.15.44:0/3522163261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26041480c0 0x7f26041f5d10 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.981+0000 7f260b125640 1 --2- 172.21.15.44:0/3522163261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25f4003b00 0x7f26041f31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.981+0000 7f260b125640 1 -- 172.21.15.44:0/3522163261 >> 172.21.15.44:0/3522163261 conn(0x7f26040cf880 msgr2=0x7f26040d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.981+0000 7f260b125640 1 -- 172.21.15.44:0/3522163261 shutdown_connections 2023-11-04T01:37:15.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:15.981+0000 7f260b125640 1 -- 172.21.15.44:0/3522163261 wait complete. 2023-11-04T01:37:15.994 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-04T01:37:16.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.099+0000 7f33e79d7640 1 Processor -- start 2023-11-04T01:37:16.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.099+0000 7f33e79d7640 1 -- start start 2023-11-04T01:37:16.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.100+0000 7f33e79d7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f33e0153e60 0x7f33e015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.100+0000 7f33e79d7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f33e00cd6d0 0x7f33e0161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.100+0000 7f33e79d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33e00b4880 0x7f33e00b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.100+0000 7f33e79d7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e00cde60 con 0x7f33e0153e60 2023-11-04T01:37:16.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.100+0000 7f33e79d7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e00b5220 con 0x7f33e00cd6d0 2023-11-04T01:37:16.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.100+0000 7f33e79d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0160f90 con 0x7f33e00b4880 2023-11-04T01:37:16.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.100+0000 7f33e5773640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f33e0153e60 0x7f33e015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.100+0000 7f33e5773640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f33e0153e60 0x7f33e015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60240/0 (socket says 172.21.15.44:60240) 2023-11-04T01:37:16.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.100+0000 7f33e5773640 1 -- 172.21.15.44:0/524193835 learned_addr learned my addr 172.21.15.44:0/524193835 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:16.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.101+0000 7f33e5f74640 1 --2- 172.21.15.44:0/524193835 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33e00b4880 0x7f33e00b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.101+0000 7f33e4f72640 1 --2- 172.21.15.44:0/524193835 >> v2:172.21.15.204:3300/0 conn(0x7f33e00cd6d0 0x7f33e0161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.101+0000 7f33e5773640 1 -- 172.21.15.44:0/524193835 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33e00b4880 msgr2=0x7f33e00b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.101+0000 7f33e5773640 1 --2- 172.21.15.44:0/524193835 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33e00b4880 0x7f33e00b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.101+0000 7f33e5773640 1 -- 172.21.15.44:0/524193835 >> v2:172.21.15.204:3300/0 conn(0x7f33e00cd6d0 msgr2=0x7f33e0161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.101+0000 7f33e5773640 1 --2- 172.21.15.44:0/524193835 >> v2:172.21.15.204:3300/0 conn(0x7f33e00cd6d0 0x7f33e0161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.101+0000 7f33e5773640 1 -- 172.21.15.44:0/524193835 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e015e400 con 0x7f33e0153e60 2023-11-04T01:37:16.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.101+0000 7f33e4f72640 1 --2- 172.21.15.44:0/524193835 >> v2:172.21.15.204:3300/0 conn(0x7f33e00cd6d0 0x7f33e0161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:16.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.101+0000 7f33e5773640 1 --2- 172.21.15.44:0/524193835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e0153e60 0x7f33e015dec0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f33e00c9e80 tx=0x7f33d802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995db774c9fa4fae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.102+0000 7f33dffff640 1 -- 172.21.15.44:0/524193835 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8031640 con 0x7f33e0153e60 2023-11-04T01:37:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.102+0000 7f33dffff640 1 -- 172.21.15.44:0/524193835 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d80317a0 con 0x7f33e0153e60 2023-11-04T01:37:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.102+0000 7f33dffff640 1 -- 172.21.15.44:0/524193835 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8031b30 con 0x7f33e0153e60 2023-11-04T01:37:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.102+0000 7f33e79d7640 1 -- 172.21.15.44:0/524193835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e0153e60 msgr2=0x7f33e015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.102+0000 7f33e79d7640 1 --2- 172.21.15.44:0/524193835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e0153e60 0x7f33e015dec0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f33e00c9e80 tx=0x7f33d802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.102+0000 7f33e79d7640 1 -- 172.21.15.44:0/524193835 shutdown_connections 2023-11-04T01:37:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.102+0000 7f33e79d7640 1 --2- 172.21.15.44:0/524193835 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33e00b4880 0x7f33e00b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.102+0000 7f33e79d7640 1 --2- 172.21.15.44:0/524193835 >> v2:172.21.15.204:3300/0 conn(0x7f33e00cd6d0 0x7f33e0161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.102+0000 7f33e79d7640 1 --2- 172.21.15.44:0/524193835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e0153e60 0x7f33e015dec0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.102+0000 7f33e79d7640 1 -- 172.21.15.44:0/524193835 >> 172.21.15.44:0/524193835 conn(0x7f33e00cf880 msgr2=0x7f33e00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.102+0000 7f33e79d7640 1 -- 172.21.15.44:0/524193835 shutdown_connections 2023-11-04T01:37:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.102+0000 7f33e79d7640 1 -- 172.21.15.44:0/524193835 wait complete. 2023-11-04T01:37:16.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.103+0000 7f33e79d7640 1 Processor -- start 2023-11-04T01:37:16.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.103+0000 7f33e79d7640 1 -- start start 2023-11-04T01:37:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.104+0000 7f33e79d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33e00b4880 0x7f33e0150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.104+0000 7f33e79d7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33e00cd6d0 0x7f33e0156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.104+0000 7f33e79d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e0153e60 0x7f33e0155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.104+0000 7f33e79d7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0154ff0 con 0x7f33e0153e60 2023-11-04T01:37:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.104+0000 7f33e79d7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0150a90 con 0x7f33e00cd6d0 2023-11-04T01:37:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.104+0000 7f33e79d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0155950 con 0x7f33e00b4880 2023-11-04T01:37:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.104+0000 7f33e5f74640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e0153e60 0x7f33e0155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.104+0000 7f33e5f74640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e0153e60 0x7f33e0155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60254/0 (socket says 172.21.15.44:60254) 2023-11-04T01:37:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.104+0000 7f33e5f74640 1 -- 172.21.15.44:0/3886512631 learned_addr learned my addr 172.21.15.44:0/3886512631 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.104+0000 7f33e4f72640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33e00cd6d0 0x7f33e0156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.104+0000 7f33e5773640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33e00b4880 0x7f33e0150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.105+0000 7f33e5f74640 1 -- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33e00b4880 msgr2=0x7f33e0150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.105+0000 7f33e5f74640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33e00b4880 0x7f33e0150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.105+0000 7f33e5f74640 1 -- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33e00cd6d0 msgr2=0x7f33e0156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.105+0000 7f33e5f74640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33e00cd6d0 0x7f33e0156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.105+0000 7f33e5f74640 1 -- 172.21.15.44:0/3886512631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80094d0 con 0x7f33e0153e60 2023-11-04T01:37:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.105+0000 7f33e5773640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33e00b4880 0x7f33e0150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.105+0000 7f33e4f72640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33e00cd6d0 0x7f33e0156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.105+0000 7f33e5f74640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e0153e60 0x7f33e0155410 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f33d0007e90 tx=0x7f33d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.105+0000 7f33ddffb640 1 -- 172.21.15.44:0/3886512631 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0014420 con 0x7f33e0153e60 2023-11-04T01:37:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.105+0000 7f33ddffb640 1 -- 172.21.15.44:0/3886512631 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d00145a0 con 0x7f33e0153e60 2023-11-04T01:37:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.105+0000 7f33e79d7640 1 -- 172.21.15.44:0/3886512631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e0154370 con 0x7f33e0153e60 2023-11-04T01:37:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.105+0000 7f33ddffb640 1 -- 172.21.15.44:0/3886512631 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0014950 con 0x7f33e0153e60 2023-11-04T01:37:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.105+0000 7f33e79d7640 1 -- 172.21.15.44:0/3886512631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e0154930 con 0x7f33e0153e60 2023-11-04T01:37:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.106+0000 7f33e79d7640 1 -- 172.21.15.44:0/3886512631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e0074290 con 0x7f33e0153e60 2023-11-04T01:37:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.106+0000 7f33ddffb640 1 -- 172.21.15.44:0/3886512631 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f33d0014ab0 con 0x7f33e0153e60 2023-11-04T01:37:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.107+0000 7f33ddffb640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f33cc06ae70 0x7f33cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.107+0000 7f33ddffb640 1 -- 172.21.15.44:0/3886512631 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f33d0089cb0 con 0x7f33e0153e60 2023-11-04T01:37:16.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.107+0000 7f33e5773640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f33cc06ae70 0x7f33cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.108+0000 7f33e5773640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f33cc06ae70 0x7f33cc06d330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f33d8036000 tx=0x7f33d803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.111+0000 7f33ddffb640 1 -- 172.21.15.44:0/3886512631 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f33d0055000 con 0x7f33e0153e60 2023-11-04T01:37:16.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.355+0000 7f33e79d7640 1 -- 172.21.15.44:0/3886512631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f33e00d0b80 con 0x7f33e0153e60 2023-11-04T01:37:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.357+0000 7f33ddffb640 1 -- 172.21.15.44:0/3886512631 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f33d0058620 con 0x7f33e0153e60 2023-11-04T01:37:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.359+0000 7f33e79d7640 1 -- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f33cc06ae70 msgr2=0x7f33cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.359+0000 7f33e79d7640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f33cc06ae70 0x7f33cc06d330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f33d8036000 tx=0x7f33d803c040 comp rx=0 tx=0).stop 2023-11-04T01:37:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.359+0000 7f33e79d7640 1 -- 172.21.15.44:0/3886512631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e0153e60 msgr2=0x7f33e0155410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.359+0000 7f33e79d7640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e0153e60 0x7f33e0155410 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f33d0007e90 tx=0x7f33d000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.359+0000 7f33e79d7640 1 -- 172.21.15.44:0/3886512631 shutdown_connections 2023-11-04T01:37:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.359+0000 7f33e79d7640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f33cc06ae70 0x7f33cc06d330 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.359+0000 7f33e79d7640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e0153e60 0x7f33e0155410 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.359+0000 7f33e79d7640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33e00cd6d0 0x7f33e0156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.359+0000 7f33e79d7640 1 --2- 172.21.15.44:0/3886512631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33e00b4880 0x7f33e0150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.359+0000 7f33e79d7640 1 -- 172.21.15.44:0/3886512631 >> 172.21.15.44:0/3886512631 conn(0x7f33e00cf880 msgr2=0x7f33e00d2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.359+0000 7f33e79d7640 1 -- 172.21.15.44:0/3886512631 shutdown_connections 2023-11-04T01:37:16.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.359+0000 7f33e79d7640 1 -- 172.21.15.44:0/3886512631 wait complete. 2023-11-04T01:37:16.375 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-04T01:37:16.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.480+0000 7f43a31c0640 1 Processor -- start 2023-11-04T01:37:16.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.480+0000 7f43a31c0640 1 -- start start 2023-11-04T01:37:16.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.481+0000 7f43a31c0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f439c160430 0x7f439c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.481+0000 7f43a31c0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f439c0b2b60 0x7f439c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.481+0000 7f43a31c0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c0b2fc0 con 0x7f439c06c1d0 2023-11-04T01:37:16.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.481+0000 7f43a31c0640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439c0cb580 con 0x7f439c0b2b60 2023-11-04T01:37:16.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.481+0000 7f43a31c0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439c06ca40 con 0x7f439c160430 2023-11-04T01:37:16.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.481+0000 7f439bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f439c0b2b60 0x7f439c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.481+0000 7f43a175d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f439c06c1d0 0x7f439c160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52032/0 (socket says 172.21.15.44:52032) 2023-11-04T01:37:16.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.481+0000 7f43a175d640 1 -- 172.21.15.44:0/3949768266 learned_addr learned my addr 172.21.15.44:0/3949768266 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:16.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.481+0000 7f43a0f5c640 1 --2- 172.21.15.44:0/3949768266 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f439c160430 0x7f439c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.481+0000 7f439bfff640 1 -- 172.21.15.44:0/3949768266 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f439c160430 msgr2=0x7f439c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.481+0000 7f439bfff640 1 --2- 172.21.15.44:0/3949768266 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f439c160430 0x7f439c0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.481+0000 7f439bfff640 1 -- 172.21.15.44:0/3949768266 >> v1:172.21.15.44:6789/0 conn(0x7f439c06c1d0 legacy=0x7f439c160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.481+0000 7f439b7fe640 1 -- 172.21.15.44:0/3949768266 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569617106 0 0) 0x7f439c0b2fc0 con 0x7f439c06c1d0 2023-11-04T01:37:16.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.481+0000 7f439bfff640 1 -- 172.21.15.44:0/3949768266 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c06cd20 con 0x7f439c0b2b60 2023-11-04T01:37:16.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.482+0000 7f439bfff640 1 --2- 172.21.15.44:0/3949768266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f439c0b2b60 0x7f439c06bc90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f43880097a0 tx=0x7f438802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ece0d23f84af24f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.482+0000 7f439b7fe640 1 -- 172.21.15.44:0/3949768266 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388031830 con 0x7f439c0b2b60 2023-11-04T01:37:16.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.482+0000 7f439b7fe640 1 -- 172.21.15.44:0/3949768266 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4388031990 con 0x7f439c0b2b60 2023-11-04T01:37:16.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.482+0000 7f439b7fe640 1 -- 172.21.15.44:0/3949768266 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388031d20 con 0x7f439c0b2b60 2023-11-04T01:37:16.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.482+0000 7f43a31c0640 1 -- 172.21.15.44:0/3949768266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f439c0b2b60 msgr2=0x7f439c06bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.482+0000 7f43a31c0640 1 --2- 172.21.15.44:0/3949768266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f439c0b2b60 0x7f439c06bc90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f43880097a0 tx=0x7f438802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.483+0000 7f43a31c0640 1 -- 172.21.15.44:0/3949768266 shutdown_connections 2023-11-04T01:37:16.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.483+0000 7f43a31c0640 1 --2- 172.21.15.44:0/3949768266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f439c0b2b60 0x7f439c06bc90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.483+0000 7f43a31c0640 1 --2- 172.21.15.44:0/3949768266 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f439c160430 0x7f439c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.483+0000 7f43a31c0640 1 -- 172.21.15.44:0/3949768266 >> 172.21.15.44:0/3949768266 conn(0x7f439c06ea20 msgr2=0x7f439c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.483+0000 7f43a31c0640 1 -- 172.21.15.44:0/3949768266 shutdown_connections 2023-11-04T01:37:16.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.483+0000 7f43a31c0640 1 -- 172.21.15.44:0/3949768266 wait complete. 2023-11-04T01:37:16.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.484+0000 7f43a31c0640 1 Processor -- start 2023-11-04T01:37:16.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.484+0000 7f43a31c0640 1 -- start start 2023-11-04T01:37:16.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f43a31c0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f439c06c1d0 0x7f439c152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f43a31c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f439c0b2b60 0x7f439c0c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f43a31c0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f439c160430 0x7f439c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f43a31c0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c152690 con 0x7f439c0b2b60 2023-11-04T01:37:16.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f43a31c0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c0c8bc0 con 0x7f439c06c1d0 2023-11-04T01:37:16.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f43a31c0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439c0c92c0 con 0x7f439c160430 2023-11-04T01:37:16.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f439bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f439c0b2b60 0x7f439c0c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f439bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f439c0b2b60 0x7f439c0c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60272/0 (socket says 172.21.15.44:60272) 2023-11-04T01:37:16.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f439bfff640 1 -- 172.21.15.44:0/438572897 learned_addr learned my addr 172.21.15.44:0/438572897 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:16.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f43a175d640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f439c160430 0x7f439c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f43a0f5c640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f439c06c1d0 0x7f439c152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f439bfff640 1 -- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f439c160430 msgr2=0x7f439c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f439bfff640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f439c160430 0x7f439c0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f439bfff640 1 -- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f439c06c1d0 msgr2=0x7f439c152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f439bfff640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f439c06c1d0 0x7f439c152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f439bfff640 1 -- 172.21.15.44:0/438572897 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4388009400 con 0x7f439c0b2b60 2023-11-04T01:37:16.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f43a175d640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f439c160430 0x7f439c0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:16.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f43a0f5c640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f439c06c1d0 0x7f439c152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:16.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f439bfff640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f439c0b2b60 0x7f439c0c8680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f438802bee0 tx=0x7f43880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f43997fa640 1 -- 172.21.15.44:0/438572897 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438803a6f0 con 0x7f439c0b2b60 2023-11-04T01:37:16.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f43997fa640 1 -- 172.21.15.44:0/438572897 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438803a870 con 0x7f439c0b2b60 2023-11-04T01:37:16.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f43a31c0640 1 -- 172.21.15.44:0/438572897 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c0c95a0 con 0x7f439c0b2b60 2023-11-04T01:37:16.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f43997fa640 1 -- 172.21.15.44:0/438572897 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438803ac20 con 0x7f439c0b2b60 2023-11-04T01:37:16.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.485+0000 7f43a31c0640 1 -- 172.21.15.44:0/438572897 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c0c9b60 con 0x7f439c0b2b60 2023-11-04T01:37:16.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.486+0000 7f43a31c0640 1 -- 172.21.15.44:0/438572897 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439c074290 con 0x7f439c0b2b60 2023-11-04T01:37:16.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.487+0000 7f43997fa640 1 -- 172.21.15.44:0/438572897 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f438804c3b0 con 0x7f439c0b2b60 2023-11-04T01:37:16.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.487+0000 7f43997fa640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f438006ae70 0x7f438006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.487+0000 7f43997fa640 1 -- 172.21.15.44:0/438572897 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f43880ab240 con 0x7f439c0b2b60 2023-11-04T01:37:16.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.488+0000 7f43a0f5c640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f438006ae70 0x7f438006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.488+0000 7f43a0f5c640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f438006ae70 0x7f438006d330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4390006fd0 tx=0x7f4390008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.492+0000 7f43997fa640 1 -- 172.21.15.44:0/438572897 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4388076610 con 0x7f439c0b2b60 2023-11-04T01:37:16.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.733+0000 7f43a31c0640 1 -- 172.21.15.44:0/438572897 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f439c0b6b20 con 0x7f439c0b2b60 2023-11-04T01:37:16.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.735+0000 7f43997fa640 1 -- 172.21.15.44:0/438572897 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4388079c30 con 0x7f439c0b2b60 2023-11-04T01:37:16.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.737+0000 7f43a31c0640 1 -- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f438006ae70 msgr2=0x7f438006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.737+0000 7f43a31c0640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f438006ae70 0x7f438006d330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4390006fd0 tx=0x7f4390008040 comp rx=0 tx=0).stop 2023-11-04T01:37:16.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.737+0000 7f43a31c0640 1 -- 172.21.15.44:0/438572897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f439c0b2b60 msgr2=0x7f439c0c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.737+0000 7f43a31c0640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f439c0b2b60 0x7f439c0c8680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f438802bee0 tx=0x7f43880046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.737+0000 7f43a31c0640 1 -- 172.21.15.44:0/438572897 shutdown_connections 2023-11-04T01:37:16.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.737+0000 7f43a31c0640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f438006ae70 0x7f438006d330 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.737+0000 7f43a31c0640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f439c160430 0x7f439c0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.737+0000 7f43a31c0640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f439c0b2b60 0x7f439c0c8680 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.737+0000 7f43a31c0640 1 --2- 172.21.15.44:0/438572897 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f439c06c1d0 0x7f439c152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.737+0000 7f43a31c0640 1 -- 172.21.15.44:0/438572897 >> 172.21.15.44:0/438572897 conn(0x7f439c06ea20 msgr2=0x7f439c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.737+0000 7f43a31c0640 1 -- 172.21.15.44:0/438572897 shutdown_connections 2023-11-04T01:37:16.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.737+0000 7f43a31c0640 1 -- 172.21.15.44:0/438572897 wait complete. 2023-11-04T01:37:16.750 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-04T01:37:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.855+0000 7fae50d65640 1 Processor -- start 2023-11-04T01:37:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.855+0000 7fae50d65640 1 -- start start 2023-11-04T01:37:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.856+0000 7fae50d65640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae4c160430 0x7fae4c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.856+0000 7fae50d65640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fae4c06c3a0 0x7fae4c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.856+0000 7fae50d65640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c0b2fc0 con 0x7fae4c0b2b60 2023-11-04T01:37:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.856+0000 7fae50d65640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4c0cb580 con 0x7fae4c06c3a0 2023-11-04T01:37:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.856+0000 7fae50d65640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c06ca40 con 0x7fae4c160430 2023-11-04T01:37:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.856+0000 7fae4a59c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae4c160430 0x7fae4c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.856+0000 7fae4ad9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fae4c06c3a0 0x7fae4c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.856+0000 7fae49d9b640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fae4c0b2b60 0x7fae4c06bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:35414/0 (socket says 172.21.15.44:35414) 2023-11-04T01:37:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.856+0000 7fae49d9b640 1 -- 172.21.15.44:0/4091863219 learned_addr learned my addr 172.21.15.44:0/4091863219 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.857+0000 7fae4a59c640 1 -- 172.21.15.44:0/4091863219 >> v2:172.21.15.204:3300/0 conn(0x7fae4c06c3a0 msgr2=0x7fae4c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.857+0000 7fae4a59c640 1 --2- 172.21.15.44:0/4091863219 >> v2:172.21.15.204:3300/0 conn(0x7fae4c06c3a0 0x7fae4c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.857+0000 7fae4a59c640 1 -- 172.21.15.44:0/4091863219 >> v1:172.21.15.204:6789/0 conn(0x7fae4c0b2b60 legacy=0x7fae4c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.857+0000 7fae4a59c640 1 -- 172.21.15.44:0/4091863219 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c06c810 con 0x7fae4c160430 2023-11-04T01:37:16.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.858+0000 7fae4a59c640 1 --2- 172.21.15.44:0/4091863219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae4c160430 0x7fae4c0b2620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fae440097a0 tx=0x7fae4402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bd57453e63b4c8b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.858+0000 7fae4959a640 1 -- 172.21.15.44:0/4091863219 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44031830 con 0x7fae4c160430 2023-11-04T01:37:16.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.858+0000 7fae4959a640 1 -- 172.21.15.44:0/4091863219 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae44031990 con 0x7fae4c160430 2023-11-04T01:37:16.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.858+0000 7fae4959a640 1 -- 172.21.15.44:0/4091863219 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44031d20 con 0x7fae4c160430 2023-11-04T01:37:16.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.858+0000 7fae50d65640 1 -- 172.21.15.44:0/4091863219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae4c160430 msgr2=0x7fae4c0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.858+0000 7fae50d65640 1 --2- 172.21.15.44:0/4091863219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae4c160430 0x7fae4c0b2620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fae440097a0 tx=0x7fae4402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.858+0000 7fae50d65640 1 -- 172.21.15.44:0/4091863219 shutdown_connections 2023-11-04T01:37:16.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.858+0000 7fae50d65640 1 --2- 172.21.15.44:0/4091863219 >> v2:172.21.15.204:3300/0 conn(0x7fae4c06c3a0 0x7fae4c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.858+0000 7fae50d65640 1 --2- 172.21.15.44:0/4091863219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae4c160430 0x7fae4c0b2620 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.858+0000 7fae50d65640 1 -- 172.21.15.44:0/4091863219 >> 172.21.15.44:0/4091863219 conn(0x7fae4c06ea20 msgr2=0x7fae4c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.858+0000 7fae50d65640 1 -- 172.21.15.44:0/4091863219 shutdown_connections 2023-11-04T01:37:16.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.858+0000 7fae50d65640 1 -- 172.21.15.44:0/4091863219 wait complete. 2023-11-04T01:37:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.860+0000 7fae50d65640 1 Processor -- start 2023-11-04T01:37:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.860+0000 7fae50d65640 1 -- start start 2023-11-04T01:37:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae50d65640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae4c06c3a0 0x7fae4c151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae50d65640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae4c0b2b60 0x7fae4c0ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae50d65640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae4c160430 0x7fae4c158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae50d65640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c154050 con 0x7fae4c06c3a0 2023-11-04T01:37:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae50d65640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0caa70 con 0x7fae4c0b2b60 2023-11-04T01:37:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae50d65640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c1530f0 con 0x7fae4c160430 2023-11-04T01:37:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae4a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae4c06c3a0 0x7fae4c151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae4a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae4c06c3a0 0x7fae4c151d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60274/0 (socket says 172.21.15.44:60274) 2023-11-04T01:37:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae4a59c640 1 -- 172.21.15.44:0/3287411301 learned_addr learned my addr 172.21.15.44:0/3287411301 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae4ad9d640 1 --2- 172.21.15.44:0/3287411301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae4c160430 0x7fae4c158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae49d9b640 1 --2- 172.21.15.44:0/3287411301 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae4c0b2b60 0x7fae4c0ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae4a59c640 1 -- 172.21.15.44:0/3287411301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae4c160430 msgr2=0x7fae4c158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae4a59c640 1 --2- 172.21.15.44:0/3287411301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae4c160430 0x7fae4c158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae4a59c640 1 -- 172.21.15.44:0/3287411301 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae4c0b2b60 msgr2=0x7fae4c0ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae4a59c640 1 --2- 172.21.15.44:0/3287411301 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae4c0b2b60 0x7fae4c0ca530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae4a59c640 1 -- 172.21.15.44:0/3287411301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae44009400 con 0x7fae4c06c3a0 2023-11-04T01:37:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae4ad9d640 1 --2- 172.21.15.44:0/3287411301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae4c160430 0x7fae4c158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae4a59c640 1 --2- 172.21.15.44:0/3287411301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae4c06c3a0 0x7fae4c151d00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fae44034040 tx=0x7fae440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae42ffd640 1 -- 172.21.15.44:0/3287411301 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4403a8f0 con 0x7fae4c06c3a0 2023-11-04T01:37:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae42ffd640 1 -- 172.21.15.44:0/3287411301 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4403aa70 con 0x7fae4c06c3a0 2023-11-04T01:37:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae50d65640 1 -- 172.21.15.44:0/3287411301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4c1533d0 con 0x7fae4c06c3a0 2023-11-04T01:37:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.861+0000 7fae42ffd640 1 -- 172.21.15.44:0/3287411301 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4403ae20 con 0x7fae4c06c3a0 2023-11-04T01:37:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.862+0000 7fae50d65640 1 -- 172.21.15.44:0/3287411301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4c153990 con 0x7fae4c06c3a0 2023-11-04T01:37:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.862+0000 7fae50d65640 1 -- 172.21.15.44:0/3287411301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4c06d400 con 0x7fae4c06c3a0 2023-11-04T01:37:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.863+0000 7fae42ffd640 1 -- 172.21.15.44:0/3287411301 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae4404d440 con 0x7fae4c06c3a0 2023-11-04T01:37:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.863+0000 7fae42ffd640 1 --2- 172.21.15.44:0/3287411301 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fae2c06ae70 0x7fae2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.863+0000 7fae42ffd640 1 -- 172.21.15.44:0/3287411301 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fae440ab450 con 0x7fae4c06c3a0 2023-11-04T01:37:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.864+0000 7fae49d9b640 1 --2- 172.21.15.44:0/3287411301 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fae2c06ae70 0x7fae2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.864+0000 7fae49d9b640 1 --2- 172.21.15.44:0/3287411301 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fae2c06ae70 0x7fae2c06d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0afcb0 tx=0x7fae34009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:16.867+0000 7fae42ffd640 1 -- 172.21.15.44:0/3287411301 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fae440767a0 con 0x7fae4c06c3a0 2023-11-04T01:37:17.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.109+0000 7fae50d65640 1 -- 172.21.15.44:0/3287411301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fae4c074290 con 0x7fae4c06c3a0 2023-11-04T01:37:17.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.110+0000 7fae42ffd640 1 -- 172.21.15.44:0/3287411301 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fae44079dc0 con 0x7fae4c06c3a0 2023-11-04T01:37:17.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.112+0000 7fae50d65640 1 -- 172.21.15.44:0/3287411301 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fae2c06ae70 msgr2=0x7fae2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.112+0000 7fae50d65640 1 --2- 172.21.15.44:0/3287411301 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fae2c06ae70 0x7fae2c06d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0afcb0 tx=0x7fae34009040 comp rx=0 tx=0).stop 2023-11-04T01:37:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.112+0000 7fae50d65640 1 -- 172.21.15.44:0/3287411301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae4c06c3a0 msgr2=0x7fae4c151d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.112+0000 7fae50d65640 1 --2- 172.21.15.44:0/3287411301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae4c06c3a0 0x7fae4c151d00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fae44034040 tx=0x7fae440046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.112+0000 7fae50d65640 1 -- 172.21.15.44:0/3287411301 shutdown_connections 2023-11-04T01:37:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.112+0000 7fae50d65640 1 --2- 172.21.15.44:0/3287411301 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fae2c06ae70 0x7fae2c06d330 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.112+0000 7fae50d65640 1 --2- 172.21.15.44:0/3287411301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae4c160430 0x7fae4c158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.112+0000 7fae50d65640 1 --2- 172.21.15.44:0/3287411301 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae4c0b2b60 0x7fae4c0ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.112+0000 7fae50d65640 1 --2- 172.21.15.44:0/3287411301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae4c06c3a0 0x7fae4c151d00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.112+0000 7fae50d65640 1 -- 172.21.15.44:0/3287411301 >> 172.21.15.44:0/3287411301 conn(0x7fae4c06ea20 msgr2=0x7fae4c0b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.112+0000 7fae50d65640 1 -- 172.21.15.44:0/3287411301 shutdown_connections 2023-11-04T01:37:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.112+0000 7fae50d65640 1 -- 172.21.15.44:0/3287411301 wait complete. 2023-11-04T01:37:17.125 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-04T01:37:17.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.230+0000 7f6a5ff5e640 1 Processor -- start 2023-11-04T01:37:17.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.230+0000 7f6a5ff5e640 1 -- start start 2023-11-04T01:37:17.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.231+0000 7f6a5ff5e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6a580cd6d0 0x7f6a58161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.231+0000 7f6a5ff5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6a580b4880 0x7f6a580b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.231+0000 7f6a5ff5e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a580cde60 con 0x7f6a58153e60 2023-11-04T01:37:17.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.231+0000 7f6a5ff5e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a58160f90 con 0x7f6a580cd6d0 2023-11-04T01:37:17.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.231+0000 7f6a5ff5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a58161960 con 0x7f6a580b4880 2023-11-04T01:37:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.231+0000 7f6a5d4f9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6a580cd6d0 0x7f6a58161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.231+0000 7f6a5d4f9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6a580cd6d0 0x7f6a58161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60290/0 (socket says 172.21.15.44:60290) 2023-11-04T01:37:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.231+0000 7f6a5d4f9640 1 -- 172.21.15.44:0/49673669 learned_addr learned my addr 172.21.15.44:0/49673669 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.231+0000 7f6a5e4fb640 1 --2- 172.21.15.44:0/49673669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6a580b4880 0x7f6a580b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.231+0000 7f6a5d4f9640 1 -- 172.21.15.44:0/49673669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6a580b4880 msgr2=0x7f6a580b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.231+0000 7f6a5d4f9640 1 --2- 172.21.15.44:0/49673669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6a580b4880 0x7f6a580b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.231+0000 7f6a5d4f9640 1 -- 172.21.15.44:0/49673669 >> v1:172.21.15.204:6789/0 conn(0x7f6a58153e60 legacy=0x7f6a5815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.231+0000 7f6a5d4f9640 1 -- 172.21.15.44:0/49673669 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a580b5220 con 0x7f6a580cd6d0 2023-11-04T01:37:17.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.232+0000 7f6a5d4f9640 1 --2- 172.21.15.44:0/49673669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a580cd6d0 0x7f6a58161420 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009870 tx=0x7f6a4802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec0a3e3d78e6349 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.232+0000 7f6a5ccf8640 1 -- 172.21.15.44:0/49673669 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48030840 con 0x7f6a580cd6d0 2023-11-04T01:37:17.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.232+0000 7f6a5ccf8640 1 -- 172.21.15.44:0/49673669 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a480309a0 con 0x7f6a580cd6d0 2023-11-04T01:37:17.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.232+0000 7f6a5ccf8640 1 -- 172.21.15.44:0/49673669 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48030d30 con 0x7f6a580cd6d0 2023-11-04T01:37:17.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.233+0000 7f6a5ff5e640 1 -- 172.21.15.44:0/49673669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a580cd6d0 msgr2=0x7f6a58161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.233+0000 7f6a5ff5e640 1 --2- 172.21.15.44:0/49673669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a580cd6d0 0x7f6a58161420 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009870 tx=0x7f6a4802b980 comp rx=0 tx=0).stop 2023-11-04T01:37:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.233+0000 7f6a5ff5e640 1 -- 172.21.15.44:0/49673669 shutdown_connections 2023-11-04T01:37:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.233+0000 7f6a5ff5e640 1 --2- 172.21.15.44:0/49673669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6a580b4880 0x7f6a580b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.233+0000 7f6a5ff5e640 1 --2- 172.21.15.44:0/49673669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a580cd6d0 0x7f6a58161420 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.233+0000 7f6a5ff5e640 1 -- 172.21.15.44:0/49673669 >> 172.21.15.44:0/49673669 conn(0x7f6a580cf880 msgr2=0x7f6a580cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.233+0000 7f6a5ff5e640 1 -- 172.21.15.44:0/49673669 shutdown_connections 2023-11-04T01:37:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.233+0000 7f6a5ff5e640 1 -- 172.21.15.44:0/49673669 wait complete. 2023-11-04T01:37:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.234+0000 7f6a5ff5e640 1 Processor -- start 2023-11-04T01:37:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.234+0000 7f6a5ff5e640 1 -- start start 2023-11-04T01:37:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5ff5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6a580b4880 0x7f6a58155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5ff5e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6a580cd6d0 0x7f6a58159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5ff5e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a58153e60 0x7f6a580c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5ff5e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5815a530 con 0x7f6a58153e60 2023-11-04T01:37:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5ff5e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a58155d20 con 0x7f6a580cd6d0 2023-11-04T01:37:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5ff5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a58156000 con 0x7f6a580b4880 2023-11-04T01:37:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5e4fb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a58153e60 0x7f6a580c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5e4fb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a58153e60 0x7f6a580c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60298/0 (socket says 172.21.15.44:60298) 2023-11-04T01:37:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5e4fb640 1 -- 172.21.15.44:0/4061595582 learned_addr learned my addr 172.21.15.44:0/4061595582 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5dcfa640 1 --2- 172.21.15.44:0/4061595582 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6a580b4880 0x7f6a58155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5d4f9640 1 --2- 172.21.15.44:0/4061595582 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6a580cd6d0 0x7f6a58159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5e4fb640 1 -- 172.21.15.44:0/4061595582 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6a580b4880 msgr2=0x7f6a58155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5e4fb640 1 --2- 172.21.15.44:0/4061595582 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6a580b4880 0x7f6a58155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5e4fb640 1 -- 172.21.15.44:0/4061595582 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6a580cd6d0 msgr2=0x7f6a58159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5e4fb640 1 --2- 172.21.15.44:0/4061595582 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6a580cd6d0 0x7f6a58159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5e4fb640 1 -- 172.21.15.44:0/4061595582 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a480094d0 con 0x7f6a58153e60 2023-11-04T01:37:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.235+0000 7f6a5e4fb640 1 --2- 172.21.15.44:0/4061595582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a58153e60 0x7f6a580c8790 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6a50007e40 tx=0x7f6a5000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.236+0000 7f6a4e7fc640 1 -- 172.21.15.44:0/4061595582 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a50014620 con 0x7f6a58153e60 2023-11-04T01:37:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.236+0000 7f6a4e7fc640 1 -- 172.21.15.44:0/4061595582 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5000ee90 con 0x7f6a58153e60 2023-11-04T01:37:17.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.236+0000 7f6a5ff5e640 1 -- 172.21.15.44:0/4061595582 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a581562e0 con 0x7f6a58153e60 2023-11-04T01:37:17.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.236+0000 7f6a4e7fc640 1 -- 172.21.15.44:0/4061595582 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a500149e0 con 0x7f6a58153e60 2023-11-04T01:37:17.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.236+0000 7f6a5ff5e640 1 -- 172.21.15.44:0/4061595582 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a581568a0 con 0x7f6a58153e60 2023-11-04T01:37:17.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.237+0000 7f6a5ff5e640 1 -- 172.21.15.44:0/4061595582 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a58160bc0 con 0x7f6a58153e60 2023-11-04T01:37:17.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.237+0000 7f6a4e7fc640 1 -- 172.21.15.44:0/4061595582 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a50014b40 con 0x7f6a58153e60 2023-11-04T01:37:17.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.237+0000 7f6a4e7fc640 1 --2- 172.21.15.44:0/4061595582 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6a3c06ae70 0x7f6a3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.237+0000 7f6a4e7fc640 1 -- 172.21.15.44:0/4061595582 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6a50089e20 con 0x7f6a58153e60 2023-11-04T01:37:17.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.238+0000 7f6a5dcfa640 1 --2- 172.21.15.44:0/4061595582 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6a3c06ae70 0x7f6a3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.238+0000 7f6a5dcfa640 1 --2- 172.21.15.44:0/4061595582 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6a3c06ae70 0x7f6a3c06d330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6a54000f60 tx=0x7f6a54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.241+0000 7f6a4e7fc640 1 -- 172.21.15.44:0/4061595582 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6a500550e0 con 0x7f6a58153e60 2023-11-04T01:37:17.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.485+0000 7f6a5ff5e640 1 -- 172.21.15.44:0/4061595582 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f6a58074290 con 0x7f6a58153e60 2023-11-04T01:37:17.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.487+0000 7f6a4e7fc640 1 -- 172.21.15.44:0/4061595582 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6a50058700 con 0x7f6a58153e60 2023-11-04T01:37:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.489+0000 7f6a5ff5e640 1 -- 172.21.15.44:0/4061595582 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6a3c06ae70 msgr2=0x7f6a3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.489+0000 7f6a5ff5e640 1 --2- 172.21.15.44:0/4061595582 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6a3c06ae70 0x7f6a3c06d330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6a54000f60 tx=0x7f6a54009040 comp rx=0 tx=0).stop 2023-11-04T01:37:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.489+0000 7f6a5ff5e640 1 -- 172.21.15.44:0/4061595582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a58153e60 msgr2=0x7f6a580c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.489+0000 7f6a5ff5e640 1 --2- 172.21.15.44:0/4061595582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a58153e60 0x7f6a580c8790 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6a50007e40 tx=0x7f6a5000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.489+0000 7f6a5ff5e640 1 -- 172.21.15.44:0/4061595582 shutdown_connections 2023-11-04T01:37:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.489+0000 7f6a5ff5e640 1 --2- 172.21.15.44:0/4061595582 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6a3c06ae70 0x7f6a3c06d330 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.489+0000 7f6a5ff5e640 1 --2- 172.21.15.44:0/4061595582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a58153e60 0x7f6a580c8790 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.489+0000 7f6a5ff5e640 1 --2- 172.21.15.44:0/4061595582 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6a580cd6d0 0x7f6a58159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.489+0000 7f6a5ff5e640 1 --2- 172.21.15.44:0/4061595582 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6a580b4880 0x7f6a58155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.489+0000 7f6a5ff5e640 1 -- 172.21.15.44:0/4061595582 >> 172.21.15.44:0/4061595582 conn(0x7f6a580cf880 msgr2=0x7f6a5815fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.489+0000 7f6a5ff5e640 1 -- 172.21.15.44:0/4061595582 shutdown_connections 2023-11-04T01:37:17.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.489+0000 7f6a5ff5e640 1 -- 172.21.15.44:0/4061595582 wait complete. 2023-11-04T01:37:17.501 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-04T01:37:17.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.607+0000 7fb1d94f2640 1 Processor -- start 2023-11-04T01:37:17.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.607+0000 7fb1d94f2640 1 -- start start 2023-11-04T01:37:17.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.607+0000 7fb1d94f2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb1d4160430 0x7fb1d40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.607+0000 7fb1d94f2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d40b2b60 0x7fb1d406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.607+0000 7fb1d94f2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d40b2fc0 con 0x7fb1d406c1d0 2023-11-04T01:37:17.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.608+0000 7fb1d94f2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d40cb580 con 0x7fb1d4160430 2023-11-04T01:37:17.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.608+0000 7fb1d94f2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d406ca40 con 0x7fb1d40b2b60 2023-11-04T01:37:17.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.608+0000 7fb1d2ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb1d4160430 0x7fb1d40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.608+0000 7fb1d2ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb1d4160430 0x7fb1d40b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60308/0 (socket says 172.21.15.44:60308) 2023-11-04T01:37:17.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.608+0000 7fb1d2ffd640 1 -- 172.21.15.44:0/3255831688 learned_addr learned my addr 172.21.15.44:0/3255831688 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:17.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.608+0000 7fb1cbfff640 1 --2- 172.21.15.44:0/3255831688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d40b2b60 0x7fb1d406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.608+0000 7fb1d2ffd640 1 -- 172.21.15.44:0/3255831688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d40b2b60 msgr2=0x7fb1d406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.608+0000 7fb1d2ffd640 1 --2- 172.21.15.44:0/3255831688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d40b2b60 0x7fb1d406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.608+0000 7fb1d2ffd640 1 -- 172.21.15.44:0/3255831688 >> v1:172.21.15.204:6789/0 conn(0x7fb1d406c1d0 legacy=0x7fb1d4160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.608+0000 7fb1d2ffd640 1 -- 172.21.15.44:0/3255831688 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d406cd20 con 0x7fb1d4160430 2023-11-04T01:37:17.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.609+0000 7fb1d2ffd640 1 --2- 172.21.15.44:0/3255831688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1d4160430 0x7fb1d40b2620 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009870 tx=0x7fb1c402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600089d306b07ab6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.609+0000 7fb1d27fc640 1 -- 172.21.15.44:0/3255831688 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4030840 con 0x7fb1d4160430 2023-11-04T01:37:17.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.609+0000 7fb1d27fc640 1 -- 172.21.15.44:0/3255831688 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c40309a0 con 0x7fb1d4160430 2023-11-04T01:37:17.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.609+0000 7fb1d27fc640 1 -- 172.21.15.44:0/3255831688 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4030d30 con 0x7fb1d4160430 2023-11-04T01:37:17.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.610+0000 7fb1d94f2640 1 -- 172.21.15.44:0/3255831688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1d4160430 msgr2=0x7fb1d40b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.610+0000 7fb1d94f2640 1 --2- 172.21.15.44:0/3255831688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1d4160430 0x7fb1d40b2620 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009870 tx=0x7fb1c402b980 comp rx=0 tx=0).stop 2023-11-04T01:37:17.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.610+0000 7fb1d94f2640 1 -- 172.21.15.44:0/3255831688 shutdown_connections 2023-11-04T01:37:17.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.610+0000 7fb1d94f2640 1 --2- 172.21.15.44:0/3255831688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d40b2b60 0x7fb1d406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.610+0000 7fb1d94f2640 1 --2- 172.21.15.44:0/3255831688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1d4160430 0x7fb1d40b2620 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.610+0000 7fb1d94f2640 1 -- 172.21.15.44:0/3255831688 >> 172.21.15.44:0/3255831688 conn(0x7fb1d406ea20 msgr2=0x7fb1d406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.610+0000 7fb1d94f2640 1 -- 172.21.15.44:0/3255831688 shutdown_connections 2023-11-04T01:37:17.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.610+0000 7fb1d94f2640 1 -- 172.21.15.44:0/3255831688 wait complete. 2023-11-04T01:37:17.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.611+0000 7fb1d94f2640 1 Processor -- start 2023-11-04T01:37:17.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.611+0000 7fb1d94f2640 1 -- start start 2023-11-04T01:37:17.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d94f2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1d406c1d0 0x7fb1d41523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d94f2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d40b2b60 0x7fb1d40b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d94f2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1d4160430 0x7fb1d40c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d94f2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40c4630 con 0x7fb1d4160430 2023-11-04T01:37:17.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d94f2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40b44b0 con 0x7fb1d406c1d0 2023-11-04T01:37:17.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d94f2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40b4790 con 0x7fb1d40b2b60 2023-11-04T01:37:17.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1d4160430 0x7fb1d40c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1d4160430 0x7fb1d40c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60322/0 (socket says 172.21.15.44:60322) 2023-11-04T01:37:17.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d37fe640 1 -- 172.21.15.44:0/1291963978 learned_addr learned my addr 172.21.15.44:0/1291963978 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:17.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1cbfff640 1 --2- 172.21.15.44:0/1291963978 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d40b2b60 0x7fb1d40b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d2ffd640 1 --2- 172.21.15.44:0/1291963978 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1d406c1d0 0x7fb1d41523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d37fe640 1 -- 172.21.15.44:0/1291963978 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d40b2b60 msgr2=0x7fb1d40b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d37fe640 1 --2- 172.21.15.44:0/1291963978 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d40b2b60 0x7fb1d40b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d37fe640 1 -- 172.21.15.44:0/1291963978 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1d406c1d0 msgr2=0x7fb1d41523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d37fe640 1 --2- 172.21.15.44:0/1291963978 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1d406c1d0 0x7fb1d41523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d37fe640 1 -- 172.21.15.44:0/1291963978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c40094d0 con 0x7fb1d4160430 2023-11-04T01:37:17.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d2ffd640 1 --2- 172.21.15.44:0/1291963978 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1d406c1d0 0x7fb1d41523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:17.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d37fe640 1 --2- 172.21.15.44:0/1291963978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1d4160430 0x7fb1d40c6c50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00c7a0 tx=0x7fb1cc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1cb7fe640 1 -- 172.21.15.44:0/1291963978 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc003b70 con 0x7fb1d4160430 2023-11-04T01:37:17.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1cb7fe640 1 -- 172.21.15.44:0/1291963978 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc003cf0 con 0x7fb1d4160430 2023-11-04T01:37:17.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1cb7fe640 1 -- 172.21.15.44:0/1291963978 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc003ea0 con 0x7fb1d4160430 2023-11-04T01:37:17.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.612+0000 7fb1d94f2640 1 -- 172.21.15.44:0/1291963978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d40b4a70 con 0x7fb1d4160430 2023-11-04T01:37:17.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.613+0000 7fb1d94f2640 1 -- 172.21.15.44:0/1291963978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d4152920 con 0x7fb1d4160430 2023-11-04T01:37:17.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.614+0000 7fb1d94f2640 1 -- 172.21.15.44:0/1291963978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d40c47a0 con 0x7fb1d4160430 2023-11-04T01:37:17.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.614+0000 7fb1cb7fe640 1 -- 172.21.15.44:0/1291963978 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1cc00aa90 con 0x7fb1d4160430 2023-11-04T01:37:17.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.614+0000 7fb1cb7fe640 1 --2- 172.21.15.44:0/1291963978 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb1b406ae70 0x7fb1b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.614+0000 7fb1cb7fe640 1 -- 172.21.15.44:0/1291963978 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb1cc089110 con 0x7fb1d4160430 2023-11-04T01:37:17.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.614+0000 7fb1d2ffd640 1 --2- 172.21.15.44:0/1291963978 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb1b406ae70 0x7fb1b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.615+0000 7fb1d2ffd640 1 --2- 172.21.15.44:0/1291963978 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb1b406ae70 0x7fb1b406d330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4036000 tx=0x7fb1c403b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.618+0000 7fb1cb7fe640 1 -- 172.21.15.44:0/1291963978 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1cc054460 con 0x7fb1d4160430 2023-11-04T01:37:17.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.861+0000 7fb1d94f2640 1 -- 172.21.15.44:0/1291963978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fb1d4074290 con 0x7fb1d4160430 2023-11-04T01:37:17.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.863+0000 7fb1cb7fe640 1 -- 172.21.15.44:0/1291963978 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb1cc057a80 con 0x7fb1d4160430 2023-11-04T01:37:17.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.866+0000 7fb1d94f2640 1 -- 172.21.15.44:0/1291963978 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb1b406ae70 msgr2=0x7fb1b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.866+0000 7fb1d94f2640 1 --2- 172.21.15.44:0/1291963978 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb1b406ae70 0x7fb1b406d330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4036000 tx=0x7fb1c403b040 comp rx=0 tx=0).stop 2023-11-04T01:37:17.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.866+0000 7fb1d94f2640 1 -- 172.21.15.44:0/1291963978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1d4160430 msgr2=0x7fb1d40c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.866+0000 7fb1d94f2640 1 --2- 172.21.15.44:0/1291963978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1d4160430 0x7fb1d40c6c50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00c7a0 tx=0x7fb1cc00cc60 comp rx=0 tx=0).stop 2023-11-04T01:37:17.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.866+0000 7fb1d94f2640 1 -- 172.21.15.44:0/1291963978 shutdown_connections 2023-11-04T01:37:17.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.866+0000 7fb1d94f2640 1 --2- 172.21.15.44:0/1291963978 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb1b406ae70 0x7fb1b406d330 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.866+0000 7fb1d94f2640 1 --2- 172.21.15.44:0/1291963978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1d4160430 0x7fb1d40c6c50 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.866+0000 7fb1d94f2640 1 --2- 172.21.15.44:0/1291963978 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1d40b2b60 0x7fb1d40b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.866+0000 7fb1d94f2640 1 --2- 172.21.15.44:0/1291963978 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1d406c1d0 0x7fb1d41523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.866+0000 7fb1d94f2640 1 -- 172.21.15.44:0/1291963978 >> 172.21.15.44:0/1291963978 conn(0x7fb1d406ea20 msgr2=0x7fb1d40afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.866+0000 7fb1d94f2640 1 -- 172.21.15.44:0/1291963978 shutdown_connections 2023-11-04T01:37:17.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.866+0000 7fb1d94f2640 1 -- 172.21.15.44:0/1291963978 wait complete. 2023-11-04T01:37:17.879 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:17.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.983+0000 7f472c139640 1 Processor -- start 2023-11-04T01:37:17.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.983+0000 7f472c139640 1 -- start start 2023-11-04T01:37:17.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.984+0000 7f472c139640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f47240cf870 0x7f4724160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.984+0000 7f472c139640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472406bf00 con 0x7f4724160b10 2023-11-04T01:37:17.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.984+0000 7f472c139640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47241615d0 con 0x7f472415ce60 2023-11-04T01:37:17.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.984+0000 7f472c139640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47240cbde0 con 0x7f47240cf870 2023-11-04T01:37:17.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.984+0000 7f47296d4640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4724160b10 0x7f47240cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52034/0 (socket says 172.21.15.44:52034) 2023-11-04T01:37:17.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.984+0000 7f47296d4640 1 -- 172.21.15.44:0/4190899206 learned_addr learned my addr 172.21.15.44:0/4190899206 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:17.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.984+0000 7f4728ed3640 1 -- 172.21.15.44:0/4190899206 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321485421 0 0) 0x7f472406bf00 con 0x7f4724160b10 2023-11-04T01:37:17.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.984+0000 7f472a6d6640 1 --2- 172.21.15.44:0/4190899206 >> v2:172.21.15.204:3300/0 conn(0x7f47240cf870 0x7f4724160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.984+0000 7f4728ed3640 1 -- 172.21.15.44:0/4190899206 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f470c003520 con 0x7f4724160b10 2023-11-04T01:37:17.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4728ed3640 1 -- 172.21.15.44:0/4190899206 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 220681953 0 0) 0x7f470c003520 con 0x7f4724160b10 2023-11-04T01:37:17.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4728ed3640 1 -- 172.21.15.44:0/4190899206 >> v2:172.21.15.204:3300/0 conn(0x7f47240cf870 msgr2=0x7f4724160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4728ed3640 1 --2- 172.21.15.44:0/4190899206 >> v2:172.21.15.204:3300/0 conn(0x7f47240cf870 0x7f4724160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4728ed3640 1 -- 172.21.15.44:0/4190899206 >> v1:172.21.15.204:6789/0 conn(0x7f472415ce60 legacy=0x7f472406b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4728ed3640 1 -- 172.21.15.44:0/4190899206 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47241618b0 con 0x7f4724160b10 2023-11-04T01:37:17.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4728ed3640 1 -- 172.21.15.44:0/4190899206 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f4718001670 con 0x7f4724160b10 2023-11-04T01:37:17.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4728ed3640 1 -- 172.21.15.44:0/4190899206 >> v1:172.21.15.44:6789/0 conn(0x7f4724160b10 legacy=0x7f47240cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4728ed3640 1 --2- 172.21.15.44:0/4190899206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f470c003970 0x7f470c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4728ed3640 1 --2- 172.21.15.44:0/4190899206 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f470c004370 0x7f470c004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4728ed3640 1 --2- 172.21.15.44:0/4190899206 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f470c005040 0x7f470c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4728ed3640 1 -- 172.21.15.44:0/4190899206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240cbde0 con 0x7f470c003970 2023-11-04T01:37:17.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4728ed3640 1 -- 172.21.15.44:0/4190899206 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c00bfa0 con 0x7f470c004370 2023-11-04T01:37:17.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4728ed3640 1 -- 172.21.15.44:0/4190899206 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470c00c160 con 0x7f470c005040 2023-11-04T01:37:17.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4729ed5640 1 --2- 172.21.15.44:0/4190899206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f470c003970 0x7f470c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f47296d4640 1 --2- 172.21.15.44:0/4190899206 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f470c004370 0x7f470c004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f472a6d6640 1 --2- 172.21.15.44:0/4190899206 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f470c005040 0x7f470c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4729ed5640 1 -- 172.21.15.44:0/4190899206 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f470c005040 msgr2=0x7f470c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4729ed5640 1 --2- 172.21.15.44:0/4190899206 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f470c005040 0x7f470c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4729ed5640 1 -- 172.21.15.44:0/4190899206 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f470c004370 msgr2=0x7f470c004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4729ed5640 1 --2- 172.21.15.44:0/4190899206 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f470c004370 0x7f470c004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f4729ed5640 1 -- 172.21.15.44:0/4190899206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c003520 con 0x7f470c003970 2023-11-04T01:37:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.985+0000 7f472a6d6640 1 -- 172.21.15.44:0/4190899206 reap_dead start 2023-11-04T01:37:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.986+0000 7f4729ed5640 1 --2- 172.21.15.44:0/4190899206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f470c003970 0x7f470c003d50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f471c001860 tx=0x7f470c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb9ecac45dc7999 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.986+0000 7f4728ed3640 1 -- 172.21.15.44:0/4190899206 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c033410 con 0x7f470c003970 2023-11-04T01:37:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.986+0000 7f4728ed3640 1 -- 172.21.15.44:0/4190899206 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c033590 con 0x7f470c003970 2023-11-04T01:37:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.986+0000 7f4728ed3640 1 -- 172.21.15.44:0/4190899206 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c033940 con 0x7f470c003970 2023-11-04T01:37:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.987+0000 7f472c139640 1 -- 172.21.15.44:0/4190899206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f470c003970 msgr2=0x7f470c003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.987+0000 7f472c139640 1 --2- 172.21.15.44:0/4190899206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f470c003970 0x7f470c003d50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f471c001860 tx=0x7f470c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.987+0000 7f472c139640 1 -- 172.21.15.44:0/4190899206 shutdown_connections 2023-11-04T01:37:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.987+0000 7f472c139640 1 --2- 172.21.15.44:0/4190899206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f470c003970 0x7f470c003d50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.987+0000 7f472c139640 1 -- 172.21.15.44:0/4190899206 >> 172.21.15.44:0/4190899206 conn(0x7f472406ea90 msgr2=0x7f472406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.987+0000 7f472c139640 1 -- 172.21.15.44:0/4190899206 shutdown_connections 2023-11-04T01:37:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.987+0000 7f472c139640 1 -- 172.21.15.44:0/4190899206 wait complete. 2023-11-04T01:37:17.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.988+0000 7f472c139640 1 Processor -- start 2023-11-04T01:37:18.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.988+0000 7f472c139640 1 -- start start 2023-11-04T01:37:18.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472c139640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f470c003970 0x7f47241f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472c139640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f472415f9e0 0x7f472415fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472c139640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47240b51f0 0x7f47240b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472c139640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47241588d0 con 0x7f47240b51f0 2023-11-04T01:37:18.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472c139640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47241f3610 con 0x7f470c003970 2023-11-04T01:37:18.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472c139640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47241f5530 con 0x7f472415f9e0 2023-11-04T01:37:18.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472a6d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47240b51f0 0x7f47240b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472a6d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47240b51f0 0x7f47240b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60332/0 (socket says 172.21.15.44:60332) 2023-11-04T01:37:18.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472a6d6640 1 -- 172.21.15.44:0/3370954403 learned_addr learned my addr 172.21.15.44:0/3370954403 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:18.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f4729ed5640 1 --2- 172.21.15.44:0/3370954403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f470c003970 0x7f47241f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f47296d4640 1 --2- 172.21.15.44:0/3370954403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f472415f9e0 0x7f472415fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472a6d6640 1 -- 172.21.15.44:0/3370954403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f472415f9e0 msgr2=0x7f472415fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472a6d6640 1 --2- 172.21.15.44:0/3370954403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f472415f9e0 0x7f472415fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472a6d6640 1 -- 172.21.15.44:0/3370954403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f470c003970 msgr2=0x7f47241f4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472a6d6640 1 --2- 172.21.15.44:0/3370954403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f470c003970 0x7f47241f4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472a6d6640 1 -- 172.21.15.44:0/3370954403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4724160380 con 0x7f47240b51f0 2023-11-04T01:37:18.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f4729ed5640 1 --2- 172.21.15.44:0/3370954403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f470c003970 0x7f47241f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:18.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472a6d6640 1 --2- 172.21.15.44:0/3370954403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47240b51f0 0x7f47240b5670 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4724161500 tx=0x7f47140115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f47227fc640 1 -- 172.21.15.44:0/3370954403 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471400e070 con 0x7f47240b51f0 2023-11-04T01:37:18.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f47227fc640 1 -- 172.21.15.44:0/3370954403 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4714011e10 con 0x7f47240b51f0 2023-11-04T01:37:18.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f472c139640 1 -- 172.21.15.44:0/3370954403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47240c95f0 con 0x7f47240b51f0 2023-11-04T01:37:18.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.989+0000 7f47227fc640 1 -- 172.21.15.44:0/3370954403 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714003990 con 0x7f47240b51f0 2023-11-04T01:37:18.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.990+0000 7f472c139640 1 -- 172.21.15.44:0/3370954403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47240b6180 con 0x7f47240b51f0 2023-11-04T01:37:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.990+0000 7f472c139640 1 -- 172.21.15.44:0/3370954403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47240b6370 con 0x7f47240b51f0 2023-11-04T01:37:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.991+0000 7f47227fc640 1 -- 172.21.15.44:0/3370954403 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4714003af0 con 0x7f47240b51f0 2023-11-04T01:37:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.991+0000 7f47227fc640 1 --2- 172.21.15.44:0/3370954403 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f471006ae70 0x7f471006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.991+0000 7f47227fc640 1 -- 172.21.15.44:0/3370954403 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4714089a40 con 0x7f47240b51f0 2023-11-04T01:37:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.991+0000 7f4729ed5640 1 --2- 172.21.15.44:0/3370954403 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f471006ae70 0x7f471006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.992+0000 7f4729ed5640 1 --2- 172.21.15.44:0/3370954403 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f471006ae70 0x7f471006d330 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f471c035000 tx=0x7f471c009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:17.995+0000 7f47227fc640 1 -- 172.21.15.44:0/3370954403 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f471408be60 con 0x7f47240b51f0 2023-11-04T01:37:18.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.172+0000 7f472c139640 1 -- 172.21.15.44:0/3370954403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4724074290 con 0x7f47240b51f0 2023-11-04T01:37:18.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.173+0000 7f47227fc640 1 -- 172.21.15.44:0/3370954403 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13062 (secure 0 0 0) 0x7f4714054d00 con 0x7f47240b51f0 2023-11-04T01:37:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:18.175 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":35,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:15.195484+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:18.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.175+0000 7f472c139640 1 -- 172.21.15.44:0/3370954403 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f471006ae70 msgr2=0x7f471006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.175+0000 7f472c139640 1 --2- 172.21.15.44:0/3370954403 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f471006ae70 0x7f471006d330 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f471c035000 tx=0x7f471c009030 comp rx=0 tx=0).stop 2023-11-04T01:37:18.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.175+0000 7f472c139640 1 -- 172.21.15.44:0/3370954403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47240b51f0 msgr2=0x7f47240b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.175+0000 7f472c139640 1 --2- 172.21.15.44:0/3370954403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47240b51f0 0x7f47240b5670 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4724161500 tx=0x7f47140115a0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.175+0000 7f472c139640 1 -- 172.21.15.44:0/3370954403 shutdown_connections 2023-11-04T01:37:18.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.175+0000 7f472c139640 1 --2- 172.21.15.44:0/3370954403 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f471006ae70 0x7f471006d330 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.175+0000 7f472c139640 1 --2- 172.21.15.44:0/3370954403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47240b51f0 0x7f47240b5670 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.175+0000 7f472c139640 1 --2- 172.21.15.44:0/3370954403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f472415f9e0 0x7f472415fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.175+0000 7f472c139640 1 --2- 172.21.15.44:0/3370954403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f470c003970 0x7f47241f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.175+0000 7f472c139640 1 -- 172.21.15.44:0/3370954403 >> 172.21.15.44:0/3370954403 conn(0x7f472406ea90 msgr2=0x7f472415bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:18.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.175+0000 7f472c139640 1 -- 172.21.15.44:0/3370954403 shutdown_connections 2023-11-04T01:37:18.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.175+0000 7f472c139640 1 -- 172.21.15.44:0/3370954403 wait complete. 2023-11-04T01:37:18.193 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:37:18.194 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:18.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.301+0000 7fa1e611d640 1 Processor -- start 2023-11-04T01:37:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.301+0000 7fa1e611d640 1 -- start start 2023-11-04T01:37:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.302+0000 7fa1e611d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa1e015e430 0x7fa1e00cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.302+0000 7fa1e611d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1e00cf160 0x7fa1e00cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.302+0000 7fa1e611d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa1e00d0710 0x7fa1e00cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.302+0000 7fa1e611d640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e00cdf90 con 0x7fa1e00d0710 2023-11-04T01:37:18.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.302+0000 7fa1e611d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e00d0280 con 0x7fa1e015e430 2023-11-04T01:37:18.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.302+0000 7fa1e611d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e00cf670 con 0x7fa1e00cf160 2023-11-04T01:37:18.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.302+0000 7fa1dffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa1e00d0710 0x7fa1e00cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.302+0000 7fa1dffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa1e00d0710 0x7fa1e00cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60340/0 (socket says 172.21.15.44:60340) 2023-11-04T01:37:18.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.302+0000 7fa1dffff640 1 -- 172.21.15.44:0/1164292755 learned_addr learned my addr 172.21.15.44:0/1164292755 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:18.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.303+0000 7fa1df7fe640 1 --2- 172.21.15.44:0/1164292755 >> v2:172.21.15.204:3300/0 conn(0x7fa1e015e430 0x7fa1e00cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.303+0000 7fa1deffd640 1 --2- 172.21.15.44:0/1164292755 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1e00cf160 0x7fa1e00cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.303+0000 7fa1dffff640 1 -- 172.21.15.44:0/1164292755 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1e00cf160 msgr2=0x7fa1e00cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:18.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.303+0000 7fa1dffff640 1 --2- 172.21.15.44:0/1164292755 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1e00cf160 0x7fa1e00cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.303+0000 7fa1dffff640 1 -- 172.21.15.44:0/1164292755 >> v2:172.21.15.204:3300/0 conn(0x7fa1e015e430 msgr2=0x7fa1e00cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.303+0000 7fa1dffff640 1 --2- 172.21.15.44:0/1164292755 >> v2:172.21.15.204:3300/0 conn(0x7fa1e015e430 0x7fa1e00cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.303+0000 7fa1dffff640 1 -- 172.21.15.44:0/1164292755 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e00cf950 con 0x7fa1e00d0710 2023-11-04T01:37:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.303+0000 7fa1df7fe640 1 --2- 172.21.15.44:0/1164292755 >> v2:172.21.15.204:3300/0 conn(0x7fa1e015e430 0x7fa1e00cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.303+0000 7fa1dffff640 1 --2- 172.21.15.44:0/1164292755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e00d0710 0x7fa1e00cda50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa1e006e5b0 tx=0x7fa1d802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1970afcb04880d6d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.304+0000 7fa1de7fc640 1 -- 172.21.15.44:0/1164292755 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d802ca70 con 0x7fa1e00d0710 2023-11-04T01:37:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.304+0000 7fa1de7fc640 1 -- 172.21.15.44:0/1164292755 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d802cbd0 con 0x7fa1e00d0710 2023-11-04T01:37:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.304+0000 7fa1de7fc640 1 -- 172.21.15.44:0/1164292755 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80343f0 con 0x7fa1e00d0710 2023-11-04T01:37:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.304+0000 7fa1e611d640 1 -- 172.21.15.44:0/1164292755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e00d0710 msgr2=0x7fa1e00cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.304+0000 7fa1e611d640 1 --2- 172.21.15.44:0/1164292755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e00d0710 0x7fa1e00cda50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa1e006e5b0 tx=0x7fa1d802bed0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.304+0000 7fa1e611d640 1 -- 172.21.15.44:0/1164292755 shutdown_connections 2023-11-04T01:37:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.304+0000 7fa1e611d640 1 --2- 172.21.15.44:0/1164292755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e00d0710 0x7fa1e00cda50 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.304+0000 7fa1e611d640 1 --2- 172.21.15.44:0/1164292755 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1e00cf160 0x7fa1e00cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.304+0000 7fa1e611d640 1 --2- 172.21.15.44:0/1164292755 >> v2:172.21.15.204:3300/0 conn(0x7fa1e015e430 0x7fa1e00cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.304+0000 7fa1e611d640 1 -- 172.21.15.44:0/1164292755 >> 172.21.15.44:0/1164292755 conn(0x7fa1e006ea20 msgr2=0x7fa1e006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.304+0000 7fa1e611d640 1 -- 172.21.15.44:0/1164292755 shutdown_connections 2023-11-04T01:37:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.304+0000 7fa1e611d640 1 -- 172.21.15.44:0/1164292755 wait complete. 2023-11-04T01:37:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.305+0000 7fa1e611d640 1 Processor -- start 2023-11-04T01:37:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.306+0000 7fa1e611d640 1 -- start start 2023-11-04T01:37:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.306+0000 7fa1e611d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e00cf160 0x7fa1e00c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.306+0000 7fa1e611d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1e00d0710 0x7fa1e0152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.306+0000 7fa1e611d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1e015e430 0x7fa1e006c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.306+0000 7fa1e611d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e0153100 con 0x7fa1e00cf160 2023-11-04T01:37:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.306+0000 7fa1e611d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e01537b0 con 0x7fa1e00d0710 2023-11-04T01:37:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.306+0000 7fa1e611d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e00c8370 con 0x7fa1e015e430 2023-11-04T01:37:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.306+0000 7fa1df7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e00cf160 0x7fa1e00c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.306+0000 7fa1df7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e00cf160 0x7fa1e00c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60352/0 (socket says 172.21.15.44:60352) 2023-11-04T01:37:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.306+0000 7fa1df7fe640 1 -- 172.21.15.44:0/9238297 learned_addr learned my addr 172.21.15.44:0/9238297 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.307+0000 7fa1dffff640 1 --2- 172.21.15.44:0/9238297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1e015e430 0x7fa1e006c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.307+0000 7fa1df7fe640 1 -- 172.21.15.44:0/9238297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1e015e430 msgr2=0x7fa1e006c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.307+0000 7fa1df7fe640 1 --2- 172.21.15.44:0/9238297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1e015e430 0x7fa1e006c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.307+0000 7fa1deffd640 1 --2- 172.21.15.44:0/9238297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1e00d0710 0x7fa1e0152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.307+0000 7fa1df7fe640 1 -- 172.21.15.44:0/9238297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1e00d0710 msgr2=0x7fa1e0152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.307+0000 7fa1df7fe640 1 --2- 172.21.15.44:0/9238297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1e00d0710 0x7fa1e0152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.307+0000 7fa1df7fe640 1 -- 172.21.15.44:0/9238297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d8009b30 con 0x7fa1e00cf160 2023-11-04T01:37:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.307+0000 7fa1deffd640 1 --2- 172.21.15.44:0/9238297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1e00d0710 0x7fa1e0152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.307+0000 7fa1df7fe640 1 --2- 172.21.15.44:0/9238297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e00cf160 0x7fa1e00c7c70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000c7f0 tx=0x7fa1d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.307+0000 7fa1c7fff640 1 -- 172.21.15.44:0/9238297 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0007a30 con 0x7fa1e00cf160 2023-11-04T01:37:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.307+0000 7fa1c7fff640 1 -- 172.21.15.44:0/9238297 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d0007b90 con 0x7fa1e00cf160 2023-11-04T01:37:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.307+0000 7fa1e611d640 1 -- 172.21.15.44:0/9238297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e00c8650 con 0x7fa1e00cf160 2023-11-04T01:37:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.307+0000 7fa1c7fff640 1 -- 172.21.15.44:0/9238297 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d000ce40 con 0x7fa1e00cf160 2023-11-04T01:37:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.307+0000 7fa1e611d640 1 -- 172.21.15.44:0/9238297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e00c8c10 con 0x7fa1e00cf160 2023-11-04T01:37:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.308+0000 7fa1e611d640 1 -- 172.21.15.44:0/9238297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e0074290 con 0x7fa1e00cf160 2023-11-04T01:37:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.308+0000 7fa1c7fff640 1 -- 172.21.15.44:0/9238297 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa1d00113f0 con 0x7fa1e00cf160 2023-11-04T01:37:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.309+0000 7fa1c7fff640 1 --2- 172.21.15.44:0/9238297 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa1cc06ae70 0x7fa1cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.309+0000 7fa1c7fff640 1 -- 172.21.15.44:0/9238297 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa1d00895b0 con 0x7fa1e00cf160 2023-11-04T01:37:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.309+0000 7fa1deffd640 1 --2- 172.21.15.44:0/9238297 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa1cc06ae70 0x7fa1cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.310+0000 7fa1deffd640 1 --2- 172.21.15.44:0/9238297 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa1cc06ae70 0x7fa1cc06d330 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4006fd0 tx=0x7fa1d4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.313+0000 7fa1c7fff640 1 -- 172.21.15.44:0/9238297 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1d0054860 con 0x7fa1e00cf160 2023-11-04T01:37:18.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.488+0000 7fa1e611d640 1 -- 172.21.15.44:0/9238297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1e00b4dd0 con 0x7fa1e00cf160 2023-11-04T01:37:18.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.489+0000 7fa1c7fff640 1 -- 172.21.15.44:0/9238297 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1d0057e80 con 0x7fa1e00cf160 2023-11-04T01:37:18.491 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:37:18.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.490+0000 7fa1e611d640 1 -- 172.21.15.44:0/9238297 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa1cc06ae70 msgr2=0x7fa1cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.490+0000 7fa1e611d640 1 --2- 172.21.15.44:0/9238297 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa1cc06ae70 0x7fa1cc06d330 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4006fd0 tx=0x7fa1d4008040 comp rx=0 tx=0).stop 2023-11-04T01:37:18.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.490+0000 7fa1e611d640 1 -- 172.21.15.44:0/9238297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e00cf160 msgr2=0x7fa1e00c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.490+0000 7fa1e611d640 1 --2- 172.21.15.44:0/9238297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e00cf160 0x7fa1e00c7c70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000c7f0 tx=0x7fa1d000cbf0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.491+0000 7fa1e611d640 1 -- 172.21.15.44:0/9238297 shutdown_connections 2023-11-04T01:37:18.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.491+0000 7fa1e611d640 1 --2- 172.21.15.44:0/9238297 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa1cc06ae70 0x7fa1cc06d330 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.491+0000 7fa1e611d640 1 --2- 172.21.15.44:0/9238297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1e015e430 0x7fa1e006c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.491+0000 7fa1e611d640 1 --2- 172.21.15.44:0/9238297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1e00d0710 0x7fa1e0152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.491+0000 7fa1e611d640 1 --2- 172.21.15.44:0/9238297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e00cf160 0x7fa1e00c7c70 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.491+0000 7fa1e611d640 1 -- 172.21.15.44:0/9238297 >> 172.21.15.44:0/9238297 conn(0x7fa1e006ea20 msgr2=0x7fa1e00cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:18.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.491+0000 7fa1e611d640 1 -- 172.21.15.44:0/9238297 shutdown_connections 2023-11-04T01:37:18.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.491+0000 7fa1e611d640 1 -- 172.21.15.44:0/9238297 wait complete. 2023-11-04T01:37:18.503 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:37:18.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.608+0000 7f202c397640 1 Processor -- start 2023-11-04T01:37:18.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.608+0000 7f202c397640 1 -- start start 2023-11-04T01:37:18.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.609+0000 7f202c397640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f202415ce60 0x7f202406b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.609+0000 7f202c397640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f202406bd30 0x7f2024160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.609+0000 7f202c397640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20241615d0 con 0x7f2024161050 2023-11-04T01:37:18.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.609+0000 7f202c397640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20240cbde0 con 0x7f202415ce60 2023-11-04T01:37:18.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.609+0000 7f202c397640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20241618b0 con 0x7f202406bd30 2023-11-04T01:37:18.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.609+0000 7f202a133640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f202415ce60 0x7f202406b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.609+0000 7f202a934640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2024161050 0x7f20240cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52036/0 (socket says 172.21.15.44:52036) 2023-11-04T01:37:18.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.609+0000 7f202a934640 1 -- 172.21.15.44:0/2031801488 learned_addr learned my addr 172.21.15.44:0/2031801488 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:18.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.609+0000 7f2029932640 1 --2- 172.21.15.44:0/2031801488 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f202406bd30 0x7f2024160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.609+0000 7f202a133640 1 -- 172.21.15.44:0/2031801488 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f202406bd30 msgr2=0x7f2024160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:18.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.609+0000 7f202a133640 1 --2- 172.21.15.44:0/2031801488 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f202406bd30 0x7f2024160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.609+0000 7f202a133640 1 -- 172.21.15.44:0/2031801488 >> v1:172.21.15.44:6789/0 conn(0x7f2024161050 legacy=0x7f20240cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.609+0000 7f202a133640 1 -- 172.21.15.44:0/2031801488 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20240cba00 con 0x7f202415ce60 2023-11-04T01:37:18.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.609+0000 7f2029131640 1 -- 172.21.15.44:0/2031801488 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638690037 0 0) 0x7f20241615d0 con 0x7f2024161050 2023-11-04T01:37:18.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.610+0000 7f202a133640 1 --2- 172.21.15.44:0/2031801488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f202415ce60 0x7f202406b7f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f20200097a0 tx=0x7f202002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8800e781c80f8b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.610+0000 7f2029131640 1 -- 172.21.15.44:0/2031801488 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020031830 con 0x7f202415ce60 2023-11-04T01:37:18.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.610+0000 7f2029131640 1 -- 172.21.15.44:0/2031801488 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2020031990 con 0x7f202415ce60 2023-11-04T01:37:18.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.610+0000 7f2029131640 1 -- 172.21.15.44:0/2031801488 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020031d20 con 0x7f202415ce60 2023-11-04T01:37:18.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.610+0000 7f202c397640 1 -- 172.21.15.44:0/2031801488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f202415ce60 msgr2=0x7f202406b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.610+0000 7f202c397640 1 --2- 172.21.15.44:0/2031801488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f202415ce60 0x7f202406b7f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f20200097a0 tx=0x7f202002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.611+0000 7f202c397640 1 -- 172.21.15.44:0/2031801488 shutdown_connections 2023-11-04T01:37:18.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.611+0000 7f202c397640 1 --2- 172.21.15.44:0/2031801488 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f202406bd30 0x7f2024160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.611+0000 7f202c397640 1 --2- 172.21.15.44:0/2031801488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f202415ce60 0x7f202406b7f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.611+0000 7f202c397640 1 -- 172.21.15.44:0/2031801488 >> 172.21.15.44:0/2031801488 conn(0x7f202406ea90 msgr2=0x7f202406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:18.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.611+0000 7f202c397640 1 -- 172.21.15.44:0/2031801488 shutdown_connections 2023-11-04T01:37:18.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.611+0000 7f202c397640 1 -- 172.21.15.44:0/2031801488 wait complete. 2023-11-04T01:37:18.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.612+0000 7f202c397640 1 Processor -- start 2023-11-04T01:37:18.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.612+0000 7f202c397640 1 -- start start 2023-11-04T01:37:18.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f202c397640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f202415ce60 0x7f20240b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f202c397640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2024161050 0x7f20240cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f202c397640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20241f1b80 0x7f20241f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f202c397640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20241f6c40 con 0x7f2024161050 2023-11-04T01:37:18.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f202c397640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20241f2540 con 0x7f20241f1b80 2023-11-04T01:37:18.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f202c397640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20241f6030 con 0x7f202415ce60 2023-11-04T01:37:18.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f2029932640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2024161050 0x7f20240cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f2029932640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2024161050 0x7f20240cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60382/0 (socket says 172.21.15.44:60382) 2023-11-04T01:37:18.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f2029932640 1 -- 172.21.15.44:0/3146873776 learned_addr learned my addr 172.21.15.44:0/3146873776 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:18.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f202a133640 1 --2- 172.21.15.44:0/3146873776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f202415ce60 0x7f20240b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f202a934640 1 --2- 172.21.15.44:0/3146873776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20241f1b80 0x7f20241f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f2029932640 1 -- 172.21.15.44:0/3146873776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f202415ce60 msgr2=0x7f20240b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f2029932640 1 --2- 172.21.15.44:0/3146873776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f202415ce60 0x7f20240b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f2029932640 1 -- 172.21.15.44:0/3146873776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20241f1b80 msgr2=0x7f20241f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f2029932640 1 --2- 172.21.15.44:0/3146873776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20241f1b80 0x7f20241f2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f2029932640 1 -- 172.21.15.44:0/3146873776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2020009400 con 0x7f2024161050 2023-11-04T01:37:18.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f202a133640 1 --2- 172.21.15.44:0/3146873776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f202415ce60 0x7f20240b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:18.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f2029932640 1 --2- 172.21.15.44:0/3146873776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2024161050 0x7f20240cc470 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f201400d5f0 tx=0x7f201400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f201affd640 1 -- 172.21.15.44:0/3146873776 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20140125f0 con 0x7f2024161050 2023-11-04T01:37:18.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f201affd640 1 -- 172.21.15.44:0/3146873776 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2014012750 con 0x7f2024161050 2023-11-04T01:37:18.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f201affd640 1 -- 172.21.15.44:0/3146873776 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014012b00 con 0x7f2024161050 2023-11-04T01:37:18.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f202c397640 1 -- 172.21.15.44:0/3146873776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20241f6310 con 0x7f2024161050 2023-11-04T01:37:18.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.613+0000 7f202c397640 1 -- 172.21.15.44:0/3146873776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20241f68d0 con 0x7f2024161050 2023-11-04T01:37:18.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.614+0000 7f202c397640 1 -- 172.21.15.44:0/3146873776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202415e850 con 0x7f2024161050 2023-11-04T01:37:18.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.615+0000 7f201affd640 1 -- 172.21.15.44:0/3146873776 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2014012c60 con 0x7f2024161050 2023-11-04T01:37:18.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.615+0000 7f201affd640 1 --2- 172.21.15.44:0/3146873776 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f200806aea0 0x7f200806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.615+0000 7f201affd640 1 -- 172.21.15.44:0/3146873776 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2014089890 con 0x7f2024161050 2023-11-04T01:37:18.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.615+0000 7f202a133640 1 --2- 172.21.15.44:0/3146873776 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f200806aea0 0x7f200806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.616+0000 7f202a133640 1 --2- 172.21.15.44:0/3146873776 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f200806aea0 0x7f200806d360 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2020036000 tx=0x7f202003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.620+0000 7f201affd640 1 -- 172.21.15.44:0/3146873776 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f202415e850 con 0x7f2024161050 2023-11-04T01:37:18.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.797+0000 7f202c397640 1 -- 172.21.15.44:0/3146873776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f202415e850 con 0x7f2024161050 2023-11-04T01:37:18.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.797+0000 7f201affd640 1 -- 172.21.15.44:0/3146873776 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7f202415e850 con 0x7f2024161050 2023-11-04T01:37:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:18.800 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2023-11-04T01:37:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2023-11-04T01:37:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2023-11-04T01:37:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:18.800 INFO:teuthology.orchestra.run.smithi044.stdout:] 2023-11-04T01:37:18.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.799+0000 7f202c397640 1 -- 172.21.15.44:0/3146873776 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f200806aea0 msgr2=0x7f200806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.799+0000 7f202c397640 1 --2- 172.21.15.44:0/3146873776 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f200806aea0 0x7f200806d360 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2020036000 tx=0x7f202003c040 comp rx=0 tx=0).stop 2023-11-04T01:37:18.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.799+0000 7f202c397640 1 -- 172.21.15.44:0/3146873776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2024161050 msgr2=0x7f20240cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.799+0000 7f202c397640 1 --2- 172.21.15.44:0/3146873776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2024161050 0x7f20240cc470 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f201400d5f0 tx=0x7f201400dab0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.799+0000 7f202c397640 1 -- 172.21.15.44:0/3146873776 shutdown_connections 2023-11-04T01:37:18.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.799+0000 7f202c397640 1 --2- 172.21.15.44:0/3146873776 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f200806aea0 0x7f200806d360 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.799+0000 7f202c397640 1 --2- 172.21.15.44:0/3146873776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20241f1b80 0x7f20241f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.799+0000 7f202c397640 1 --2- 172.21.15.44:0/3146873776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2024161050 0x7f20240cc470 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.799+0000 7f202c397640 1 --2- 172.21.15.44:0/3146873776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f202415ce60 0x7f20240b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.799+0000 7f202c397640 1 -- 172.21.15.44:0/3146873776 >> 172.21.15.44:0/3146873776 conn(0x7f202406ea90 msgr2=0x7f20240c59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:18.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.799+0000 7f202c397640 1 -- 172.21.15.44:0/3146873776 shutdown_connections 2023-11-04T01:37:18.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.799+0000 7f202c397640 1 -- 172.21.15.44:0/3146873776 wait complete. 2023-11-04T01:37:18.812 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:37:18.812 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:37:18.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.920+0000 7f2e0773c640 1 Processor -- start 2023-11-04T01:37:18.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.920+0000 7f2e0773c640 1 -- start start 2023-11-04T01:37:18.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.921+0000 7f2e0773c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e000cd9f0 0x7f2e000cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.921+0000 7f2e0773c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2e000d27c0 0x7f2e0015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.921+0000 7f2e0773c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e000d1320 con 0x7f2e0015d4b0 2023-11-04T01:37:18.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.921+0000 7f2e0773c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0015e4d0 con 0x7f2e000d27c0 2023-11-04T01:37:18.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.921+0000 7f2e0773c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e000ce310 con 0x7f2e000cd9f0 2023-11-04T01:37:18.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.921+0000 7f2e04cd7640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2e0015d4b0 0x7f2e000b47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52042/0 (socket says 172.21.15.44:52042) 2023-11-04T01:37:18.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.921+0000 7f2e04cd7640 1 -- 172.21.15.44:0/1400136711 learned_addr learned my addr 172.21.15.44:0/1400136711 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:18.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.922+0000 7f2e05cd9640 1 --2- 172.21.15.44:0/1400136711 >> v2:172.21.15.204:3300/0 conn(0x7f2e000d27c0 0x7f2e0015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.922+0000 7f2e054d8640 1 --2- 172.21.15.44:0/1400136711 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e000cd9f0 0x7f2e000cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.922+0000 7f2e05cd9640 1 -- 172.21.15.44:0/1400136711 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e000cd9f0 msgr2=0x7f2e000cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:18.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.922+0000 7f2e05cd9640 1 --2- 172.21.15.44:0/1400136711 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e000cd9f0 0x7f2e000cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.922+0000 7f2e05cd9640 1 -- 172.21.15.44:0/1400136711 >> v1:172.21.15.44:6789/0 conn(0x7f2e0015d4b0 legacy=0x7f2e000b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.922+0000 7f2e05cd9640 1 -- 172.21.15.44:0/1400136711 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0015df10 con 0x7f2e000d27c0 2023-11-04T01:37:18.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.922+0000 7f2e054d8640 1 --2- 172.21.15.44:0/1400136711 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e000cd9f0 0x7f2e000cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:18.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.923+0000 7f2e05cd9640 1 --2- 172.21.15.44:0/1400136711 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e000d27c0 0x7f2e0015d910 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009d90 tx=0x7f2df802bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b31781decc597b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.924+0000 7f2df7fff640 1 -- 172.21.15.44:0/1400136711 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df802cce0 con 0x7f2e000d27c0 2023-11-04T01:37:18.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.924+0000 7f2df7fff640 1 -- 172.21.15.44:0/1400136711 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df802ce40 con 0x7f2e000d27c0 2023-11-04T01:37:18.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.924+0000 7f2df7fff640 1 -- 172.21.15.44:0/1400136711 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8034660 con 0x7f2e000d27c0 2023-11-04T01:37:18.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.925+0000 7f2e0773c640 1 -- 172.21.15.44:0/1400136711 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e000d27c0 msgr2=0x7f2e0015d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.925+0000 7f2e0773c640 1 --2- 172.21.15.44:0/1400136711 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e000d27c0 0x7f2e0015d910 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009d90 tx=0x7f2df802bf30 comp rx=0 tx=0).stop 2023-11-04T01:37:18.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.925+0000 7f2e0773c640 1 -- 172.21.15.44:0/1400136711 shutdown_connections 2023-11-04T01:37:18.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.925+0000 7f2e0773c640 1 --2- 172.21.15.44:0/1400136711 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e000d27c0 0x7f2e0015d910 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.925+0000 7f2e0773c640 1 --2- 172.21.15.44:0/1400136711 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e000cd9f0 0x7f2e000cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.925+0000 7f2e0773c640 1 -- 172.21.15.44:0/1400136711 >> 172.21.15.44:0/1400136711 conn(0x7f2e00071c40 msgr2=0x7f2e00072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:18.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.925+0000 7f2e0773c640 1 -- 172.21.15.44:0/1400136711 shutdown_connections 2023-11-04T01:37:18.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.925+0000 7f2e0773c640 1 -- 172.21.15.44:0/1400136711 wait complete. 2023-11-04T01:37:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.926+0000 7f2e0773c640 1 Processor -- start 2023-11-04T01:37:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.926+0000 7f2e0773c640 1 -- start start 2023-11-04T01:37:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e0773c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e000cd9f0 0x7f2e001f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e0773c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e000d27c0 0x7f2e001f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e0773c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e0015d4b0 0x7f2e000b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e0773c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e000c66c0 con 0x7f2e0015d4b0 2023-11-04T01:37:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e0773c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e000b27c0 con 0x7f2e000cd9f0 2023-11-04T01:37:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e0773c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e001f3d90 con 0x7f2e000d27c0 2023-11-04T01:37:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e05cd9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e0015d4b0 0x7f2e000b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e05cd9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e0015d4b0 0x7f2e000b6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60386/0 (socket says 172.21.15.44:60386) 2023-11-04T01:37:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e05cd9640 1 -- 172.21.15.44:0/115480102 learned_addr learned my addr 172.21.15.44:0/115480102 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e054d8640 1 --2- 172.21.15.44:0/115480102 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e000cd9f0 0x7f2e001f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e04cd7640 1 --2- 172.21.15.44:0/115480102 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e000d27c0 0x7f2e001f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e05cd9640 1 -- 172.21.15.44:0/115480102 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e000d27c0 msgr2=0x7f2e001f2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e05cd9640 1 --2- 172.21.15.44:0/115480102 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e000d27c0 0x7f2e001f2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e05cd9640 1 -- 172.21.15.44:0/115480102 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e000cd9f0 msgr2=0x7f2e001f3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e05cd9640 1 --2- 172.21.15.44:0/115480102 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e000cd9f0 0x7f2e001f3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e05cd9640 1 -- 172.21.15.44:0/115480102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc009400 con 0x7f2e0015d4b0 2023-11-04T01:37:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.927+0000 7f2e05cd9640 1 --2- 172.21.15.44:0/115480102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e0015d4b0 0x7f2e000b6e10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009d90 tx=0x7f2df8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.928+0000 7f2df5ffb640 1 -- 172.21.15.44:0/115480102 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df803d600 con 0x7f2e0015d4b0 2023-11-04T01:37:18.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.928+0000 7f2df5ffb640 1 -- 172.21.15.44:0/115480102 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df803d780 con 0x7f2e0015d4b0 2023-11-04T01:37:18.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.928+0000 7f2e0773c640 1 -- 172.21.15.44:0/115480102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df8009a70 con 0x7f2e0015d4b0 2023-11-04T01:37:18.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.928+0000 7f2df5ffb640 1 -- 172.21.15.44:0/115480102 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df803db30 con 0x7f2e0015d4b0 2023-11-04T01:37:18.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.928+0000 7f2e0773c640 1 -- 172.21.15.44:0/115480102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e000b2cb0 con 0x7f2e0015d4b0 2023-11-04T01:37:18.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.929+0000 7f2e0773c640 1 -- 172.21.15.44:0/115480102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0004e490 con 0x7f2e0015d4b0 2023-11-04T01:37:18.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.929+0000 7f2df5ffb640 1 -- 172.21.15.44:0/115480102 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2df803b040 con 0x7f2e0015d4b0 2023-11-04T01:37:18.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.930+0000 7f2df5ffb640 1 --2- 172.21.15.44:0/115480102 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2de406ae70 0x7f2de406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.930+0000 7f2df5ffb640 1 -- 172.21.15.44:0/115480102 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2df80ab8a0 con 0x7f2e0015d4b0 2023-11-04T01:37:18.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.930+0000 7f2e054d8640 1 --2- 172.21.15.44:0/115480102 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2de406ae70 0x7f2de406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.931+0000 7f2e054d8640 1 --2- 172.21.15.44:0/115480102 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2de406ae70 0x7f2de406d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009c30 tx=0x7f2dfc009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:18.934+0000 7f2df5ffb640 1 -- 172.21.15.44:0/115480102 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2df8076c10 con 0x7f2e0015d4b0 2023-11-04T01:37:19.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:19.110+0000 7f2e0773c640 1 -- 172.21.15.44:0/115480102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2e0015b2a0 con 0x7f2e0015d4b0 2023-11-04T01:37:19.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:19.930+0000 7f2df5ffb640 1 -- 172.21.15.44:0/115480102 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2df80390b0 con 0x7f2e0015d4b0 2023-11-04T01:37:19.932 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2023-11-04T01:37:19.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:19.934+0000 7f2e0773c640 1 -- 172.21.15.44:0/115480102 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2de406ae70 msgr2=0x7f2de406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:19.934+0000 7f2e0773c640 1 --2- 172.21.15.44:0/115480102 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2de406ae70 0x7f2de406d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009c30 tx=0x7f2dfc009190 comp rx=0 tx=0).stop 2023-11-04T01:37:19.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:19.934+0000 7f2e0773c640 1 -- 172.21.15.44:0/115480102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e0015d4b0 msgr2=0x7f2e000b6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:19.934+0000 7f2e0773c640 1 --2- 172.21.15.44:0/115480102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e0015d4b0 0x7f2e000b6e10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009d90 tx=0x7f2df8004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:19.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:19.935+0000 7f2e0773c640 1 -- 172.21.15.44:0/115480102 shutdown_connections 2023-11-04T01:37:19.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:19.935+0000 7f2e0773c640 1 --2- 172.21.15.44:0/115480102 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2de406ae70 0x7f2de406d330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:19.935+0000 7f2e0773c640 1 --2- 172.21.15.44:0/115480102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e0015d4b0 0x7f2e000b6e10 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:19.935+0000 7f2e0773c640 1 --2- 172.21.15.44:0/115480102 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e000d27c0 0x7f2e001f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:19.935+0000 7f2e0773c640 1 --2- 172.21.15.44:0/115480102 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e000cd9f0 0x7f2e001f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:19.935+0000 7f2e0773c640 1 -- 172.21.15.44:0/115480102 >> 172.21.15.44:0/115480102 conn(0x7f2e00071c40 msgr2=0x7f2e00159940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:19.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:19.935+0000 7f2e0773c640 1 -- 172.21.15.44:0/115480102 shutdown_connections 2023-11-04T01:37:19.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:19.935+0000 7f2e0773c640 1 -- 172.21.15.44:0/115480102 wait complete. 2023-11-04T01:37:19.953 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:37:20.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.070+0000 7f6b1b365640 1 Processor -- start 2023-11-04T01:37:20.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.071+0000 7f6b1b365640 1 -- start start 2023-11-04T01:37:20.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.071+0000 7f6b1b365640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6b14153e60 0x7f6b1415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.071+0000 7f6b1b365640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b140cde60 con 0x7f6b140cd6d0 2023-11-04T01:37:20.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.071+0000 7f6b1b365640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b14160f90 con 0x7f6b140b4880 2023-11-04T01:37:20.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.071+0000 7f6b1b365640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1415e400 con 0x7f6b14153e60 2023-11-04T01:37:20.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.071+0000 7f6b19101640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6b14153e60 0x7f6b1415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.071+0000 7f6b19101640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6b14153e60 0x7f6b1415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60394/0 (socket says 172.21.15.44:60394) 2023-11-04T01:37:20.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.071+0000 7f6b18900640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6b140cd6d0 0x7f6b14161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52052/0 (socket says 172.21.15.44:52052) 2023-11-04T01:37:20.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.072+0000 7f6b19101640 1 -- 172.21.15.44:0/990245740 learned_addr learned my addr 172.21.15.44:0/990245740 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:20.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.072+0000 7f6b19101640 1 -- 172.21.15.44:0/990245740 >> v1:172.21.15.204:6789/0 conn(0x7f6b140b4880 legacy=0x7f6b140d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:20.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.072+0000 7f6b19101640 1 -- 172.21.15.44:0/990245740 >> v1:172.21.15.44:6789/0 conn(0x7f6b140cd6d0 legacy=0x7f6b14161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.072+0000 7f6b0bfff640 1 -- 172.21.15.44:0/990245740 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183782551 0 0) 0x7f6b140cde60 con 0x7f6b140cd6d0 2023-11-04T01:37:20.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.072+0000 7f6b19101640 1 -- 172.21.15.44:0/990245740 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b140ce090 con 0x7f6b14153e60 2023-11-04T01:37:20.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.073+0000 7f6b19101640 1 --2- 172.21.15.44:0/990245740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b14153e60 0x7f6b1415dec0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009870 tx=0x7f6b1002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fad38fa8c3dfe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:20.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.073+0000 7f6b0bfff640 1 -- 172.21.15.44:0/990245740 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1002f840 con 0x7f6b14153e60 2023-11-04T01:37:20.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.073+0000 7f6b0bfff640 1 -- 172.21.15.44:0/990245740 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1002f9a0 con 0x7f6b14153e60 2023-11-04T01:37:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.073+0000 7f6b0bfff640 1 -- 172.21.15.44:0/990245740 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1002fd30 con 0x7f6b14153e60 2023-11-04T01:37:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.073+0000 7f6b1b365640 1 -- 172.21.15.44:0/990245740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b14153e60 msgr2=0x7f6b1415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.073+0000 7f6b1b365640 1 --2- 172.21.15.44:0/990245740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b14153e60 0x7f6b1415dec0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009870 tx=0x7f6b1002ba20 comp rx=0 tx=0).stop 2023-11-04T01:37:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.073+0000 7f6b1b365640 1 -- 172.21.15.44:0/990245740 shutdown_connections 2023-11-04T01:37:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.073+0000 7f6b1b365640 1 --2- 172.21.15.44:0/990245740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b14153e60 0x7f6b1415dec0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.073+0000 7f6b1b365640 1 -- 172.21.15.44:0/990245740 >> 172.21.15.44:0/990245740 conn(0x7f6b140cf880 msgr2=0x7f6b140cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.073+0000 7f6b1b365640 1 -- 172.21.15.44:0/990245740 shutdown_connections 2023-11-04T01:37:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.073+0000 7f6b1b365640 1 -- 172.21.15.44:0/990245740 wait complete. 2023-11-04T01:37:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.074+0000 7f6b1b365640 1 Processor -- start 2023-11-04T01:37:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.075+0000 7f6b1b365640 1 -- start start 2023-11-04T01:37:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.075+0000 7f6b1b365640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b140b4880 0x7f6b14156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.075+0000 7f6b1b365640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b140cd6d0 0x7f6b141f3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.075+0000 7f6b1b365640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6b14153e60 0x7f6b14152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.075+0000 7f6b1b365640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140c9ed0 con 0x7f6b140b4880 2023-11-04T01:37:20.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.075+0000 7f6b1b365640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140ca770 con 0x7f6b14153e60 2023-11-04T01:37:20.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.075+0000 7f6b1b365640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b141f28a0 con 0x7f6b140cd6d0 2023-11-04T01:37:20.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.075+0000 7f6b19101640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b140b4880 0x7f6b14156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.075+0000 7f6b19101640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b140b4880 0x7f6b14156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60408/0 (socket says 172.21.15.44:60408) 2023-11-04T01:37:20.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.075+0000 7f6b19101640 1 -- 172.21.15.44:0/243311109 learned_addr learned my addr 172.21.15.44:0/243311109 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.076+0000 7f6b18900640 1 --2- 172.21.15.44:0/243311109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b140cd6d0 0x7f6b141f3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.076+0000 7f6b19902640 1 --2- 172.21.15.44:0/243311109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6b14153e60 0x7f6b14152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.076+0000 7f6b19101640 1 -- 172.21.15.44:0/243311109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b140cd6d0 msgr2=0x7f6b141f3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.076+0000 7f6b19101640 1 --2- 172.21.15.44:0/243311109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b140cd6d0 0x7f6b141f3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.076+0000 7f6b19101640 1 -- 172.21.15.44:0/243311109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6b14153e60 msgr2=0x7f6b14152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.076+0000 7f6b19101640 1 --2- 172.21.15.44:0/243311109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6b14153e60 0x7f6b14152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.076+0000 7f6b19101640 1 -- 172.21.15.44:0/243311109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b100094d0 con 0x7f6b140b4880 2023-11-04T01:37:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.076+0000 7f6b19101640 1 --2- 172.21.15.44:0/243311109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b140b4880 0x7f6b14156bf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009870 tx=0x7f6b10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.076+0000 7f6b09ffb640 1 -- 172.21.15.44:0/243311109 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1002f7f0 con 0x7f6b140b4880 2023-11-04T01:37:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.076+0000 7f6b09ffb640 1 -- 172.21.15.44:0/243311109 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b10041400 con 0x7f6b140b4880 2023-11-04T01:37:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.076+0000 7f6b09ffb640 1 -- 172.21.15.44:0/243311109 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100417b0 con 0x7f6b140b4880 2023-11-04T01:37:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.076+0000 7f6b1b365640 1 -- 172.21.15.44:0/243311109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b141f3b10 con 0x7f6b140b4880 2023-11-04T01:37:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.076+0000 7f6b1b365640 1 -- 172.21.15.44:0/243311109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b140ca0b0 con 0x7f6b140b4880 2023-11-04T01:37:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.077+0000 7f6b1b365640 1 -- 172.21.15.44:0/243311109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b14157b50 con 0x7f6b140b4880 2023-11-04T01:37:20.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.078+0000 7f6b09ffb640 1 -- 172.21.15.44:0/243311109 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b10041910 con 0x7f6b140b4880 2023-11-04T01:37:20.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.078+0000 7f6b09ffb640 1 --2- 172.21.15.44:0/243311109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6af806ae70 0x7f6af806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.078+0000 7f6b09ffb640 1 -- 172.21.15.44:0/243311109 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f6b1003c070 con 0x7f6b140b4880 2023-11-04T01:37:20.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.078+0000 7f6b18900640 1 --2- 172.21.15.44:0/243311109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6af806ae70 0x7f6af806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.079+0000 7f6b18900640 1 --2- 172.21.15.44:0/243311109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6af806ae70 0x7f6af806d330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6b1415db40 tx=0x7f6b04007b90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:20.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.083+0000 7f6b09ffb640 1 -- 172.21.15.44:0/243311109 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b100775b0 con 0x7f6b140b4880 2023-11-04T01:37:20.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.260+0000 7f6b1b365640 1 -- 172.21.15.44:0/243311109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6b140d1d00 con 0x7f6b140b4880 2023-11-04T01:37:20.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.935+0000 7f6b09ffb640 1 -- 172.21.15.44:0/243311109 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6b1007abd0 con 0x7f6b140b4880 2023-11-04T01:37:20.937 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2023-11-04T01:37:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.938+0000 7f6b1b365640 1 -- 172.21.15.44:0/243311109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6af806ae70 msgr2=0x7f6af806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.938+0000 7f6b1b365640 1 --2- 172.21.15.44:0/243311109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6af806ae70 0x7f6af806d330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6b1415db40 tx=0x7f6b04007b90 comp rx=0 tx=0).stop 2023-11-04T01:37:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.938+0000 7f6b1b365640 1 -- 172.21.15.44:0/243311109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b140b4880 msgr2=0x7f6b14156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.938+0000 7f6b1b365640 1 --2- 172.21.15.44:0/243311109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b140b4880 0x7f6b14156bf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009870 tx=0x7f6b10004730 comp rx=0 tx=0).stop 2023-11-04T01:37:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.938+0000 7f6b1b365640 1 -- 172.21.15.44:0/243311109 shutdown_connections 2023-11-04T01:37:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.938+0000 7f6b1b365640 1 --2- 172.21.15.44:0/243311109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6af806ae70 0x7f6af806d330 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.938+0000 7f6b1b365640 1 --2- 172.21.15.44:0/243311109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6b14153e60 0x7f6b14152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.938+0000 7f6b1b365640 1 --2- 172.21.15.44:0/243311109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6b140cd6d0 0x7f6b141f3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.938+0000 7f6b1b365640 1 --2- 172.21.15.44:0/243311109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b140b4880 0x7f6b14156bf0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.938+0000 7f6b1b365640 1 -- 172.21.15.44:0/243311109 >> 172.21.15.44:0/243311109 conn(0x7f6b140cf880 msgr2=0x7f6b1415fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.938+0000 7f6b1b365640 1 -- 172.21.15.44:0/243311109 shutdown_connections 2023-11-04T01:37:20.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:20.938+0000 7f6b1b365640 1 -- 172.21.15.44:0/243311109 wait complete. 2023-11-04T01:37:20.968 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:37:21.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.080+0000 7fb70befc640 1 Processor -- start 2023-11-04T01:37:21.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.080+0000 7fb70befc640 1 -- start start 2023-11-04T01:37:21.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.081+0000 7fb70befc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb704159c00 0x7fb7040cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.081+0000 7fb70befc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7040c48e0 0x7fb7040c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.081+0000 7fb70befc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70415aff0 con 0x7fb7040adac0 2023-11-04T01:37:21.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.081+0000 7fb70befc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7040c52a0 con 0x7fb7040c48e0 2023-11-04T01:37:21.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.081+0000 7fb70befc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70415a3e0 con 0x7fb704159c00 2023-11-04T01:37:21.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.081+0000 7fb709497640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7040c48e0 0x7fb7040c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.081+0000 7fb709497640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7040c48e0 0x7fb7040c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60416/0 (socket says 172.21.15.44:60416) 2023-11-04T01:37:21.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.081+0000 7fb709497640 1 -- 172.21.15.44:0/808200789 learned_addr learned my addr 172.21.15.44:0/808200789 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:21.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.081+0000 7fb70a499640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb7040adac0 0x7fb7040adef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52066/0 (socket says 172.21.15.44:52066) 2023-11-04T01:37:21.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.081+0000 7fb709c98640 1 --2- 172.21.15.44:0/808200789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb704159c00 0x7fb7040cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.081+0000 7fb709497640 1 -- 172.21.15.44:0/808200789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb704159c00 msgr2=0x7fb7040cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:21.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.081+0000 7fb709497640 1 --2- 172.21.15.44:0/808200789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb704159c00 0x7fb7040cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.081+0000 7fb709497640 1 -- 172.21.15.44:0/808200789 >> v1:172.21.15.44:6789/0 conn(0x7fb7040adac0 legacy=0x7fb7040adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.081+0000 7fb708c96640 1 -- 172.21.15.44:0/808200789 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484597655 0 0) 0x7fb70415aff0 con 0x7fb7040adac0 2023-11-04T01:37:21.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.081+0000 7fb709497640 1 -- 172.21.15.44:0/808200789 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70415a6c0 con 0x7fb7040c48e0 2023-11-04T01:37:21.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.082+0000 7fb709497640 1 --2- 172.21.15.44:0/808200789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7040c48e0 0x7fb7040c4d60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009870 tx=0x7fb6f402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfba7af878d81ae6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:21.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.082+0000 7fb708c96640 1 -- 172.21.15.44:0/808200789 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4030840 con 0x7fb7040c48e0 2023-11-04T01:37:21.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.082+0000 7fb708c96640 1 -- 172.21.15.44:0/808200789 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f40309a0 con 0x7fb7040c48e0 2023-11-04T01:37:21.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.082+0000 7fb708c96640 1 -- 172.21.15.44:0/808200789 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4030d30 con 0x7fb7040c48e0 2023-11-04T01:37:21.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.083+0000 7fb70befc640 1 -- 172.21.15.44:0/808200789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7040c48e0 msgr2=0x7fb7040c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.083+0000 7fb70befc640 1 --2- 172.21.15.44:0/808200789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7040c48e0 0x7fb7040c4d60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009870 tx=0x7fb6f402b980 comp rx=0 tx=0).stop 2023-11-04T01:37:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.083+0000 7fb70befc640 1 -- 172.21.15.44:0/808200789 shutdown_connections 2023-11-04T01:37:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.083+0000 7fb70befc640 1 --2- 172.21.15.44:0/808200789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7040c48e0 0x7fb7040c4d60 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.083+0000 7fb70befc640 1 --2- 172.21.15.44:0/808200789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb704159c00 0x7fb7040cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.083+0000 7fb70befc640 1 -- 172.21.15.44:0/808200789 >> 172.21.15.44:0/808200789 conn(0x7fb7040ce950 msgr2=0x7fb7040ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.083+0000 7fb70befc640 1 -- 172.21.15.44:0/808200789 shutdown_connections 2023-11-04T01:37:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.083+0000 7fb70befc640 1 -- 172.21.15.44:0/808200789 wait complete. 2023-11-04T01:37:21.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.084+0000 7fb70befc640 1 Processor -- start 2023-11-04T01:37:21.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.084+0000 7fb70befc640 1 -- start start 2023-11-04T01:37:21.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb70befc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7040adac0 0x7fb704158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb70befc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7040c48e0 0x7fb704155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb70befc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb704159c00 0x7fb704153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb70befc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb704159360 con 0x7fb704159c00 2023-11-04T01:37:21.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb70befc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7040c77b0 con 0x7fb7040adac0 2023-11-04T01:37:21.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb70befc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb704155b40 con 0x7fb7040c48e0 2023-11-04T01:37:21.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb70a499640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb704159c00 0x7fb704153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb70a499640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb704159c00 0x7fb704153f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60424/0 (socket says 172.21.15.44:60424) 2023-11-04T01:37:21.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb70a499640 1 -- 172.21.15.44:0/1605793534 learned_addr learned my addr 172.21.15.44:0/1605793534 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:21.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb709497640 1 --2- 172.21.15.44:0/1605793534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7040c48e0 0x7fb704155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb70a499640 1 -- 172.21.15.44:0/1605793534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7040c48e0 msgr2=0x7fb704155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb709c98640 1 --2- 172.21.15.44:0/1605793534 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7040adac0 0x7fb704158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb70a499640 1 --2- 172.21.15.44:0/1605793534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7040c48e0 0x7fb704155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb70a499640 1 -- 172.21.15.44:0/1605793534 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7040adac0 msgr2=0x7fb704158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb70a499640 1 --2- 172.21.15.44:0/1605793534 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7040adac0 0x7fb704158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb70a499640 1 -- 172.21.15.44:0/1605793534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f40094d0 con 0x7fb704159c00 2023-11-04T01:37:21.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.085+0000 7fb70a499640 1 --2- 172.21.15.44:0/1605793534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb704159c00 0x7fb704153f80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c730 tx=0x7fb6fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:21.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.086+0000 7fb6fa7fc640 1 -- 172.21.15.44:0/1605793534 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00ce40 con 0x7fb704159c00 2023-11-04T01:37:21.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.086+0000 7fb6fa7fc640 1 -- 172.21.15.44:0/1605793534 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc00a640 con 0x7fb704159c00 2023-11-04T01:37:21.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.086+0000 7fb70befc640 1 -- 172.21.15.44:0/1605793534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70414bf00 con 0x7fb704159c00 2023-11-04T01:37:21.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.086+0000 7fb6fa7fc640 1 -- 172.21.15.44:0/1605793534 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00aa30 con 0x7fb704159c00 2023-11-04T01:37:21.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.086+0000 7fb70befc640 1 -- 172.21.15.44:0/1605793534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70414c480 con 0x7fb704159c00 2023-11-04T01:37:21.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.087+0000 7fb70befc640 1 -- 172.21.15.44:0/1605793534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7040c7960 con 0x7fb704159c00 2023-11-04T01:37:21.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.087+0000 7fb6fa7fc640 1 -- 172.21.15.44:0/1605793534 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6fc00ab90 con 0x7fb704159c00 2023-11-04T01:37:21.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.088+0000 7fb6fa7fc640 1 --2- 172.21.15.44:0/1605793534 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb6e806ae70 0x7fb6e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.088+0000 7fb6fa7fc640 1 -- 172.21.15.44:0/1605793534 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fb6fc088e60 con 0x7fb704159c00 2023-11-04T01:37:21.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.088+0000 7fb709c98640 1 --2- 172.21.15.44:0/1605793534 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb6e806ae70 0x7fb6e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.088+0000 7fb709c98640 1 --2- 172.21.15.44:0/1605793534 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb6e806ae70 0x7fb6e806d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb7040c6fb0 tx=0x7fb700008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:21.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.092+0000 7fb6fa7fc640 1 -- 172.21.15.44:0/1605793534 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb7040c7960 con 0x7fb704159c00 2023-11-04T01:37:21.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.305+0000 7fb70befc640 1 -- 172.21.15.44:0/1605793534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb7040c7960 con 0x7fb704159c00 2023-11-04T01:37:21.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.937+0000 7fb6fa7fc640 1 -- 172.21.15.44:0/1605793534 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb7040c7960 con 0x7fb704159c00 2023-11-04T01:37:21.939 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 5 and data pool 6 2023-11-04T01:37:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.942+0000 7fb70befc640 1 -- 172.21.15.44:0/1605793534 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb6e806ae70 msgr2=0x7fb6e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.942+0000 7fb70befc640 1 --2- 172.21.15.44:0/1605793534 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb6e806ae70 0x7fb6e806d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb7040c6fb0 tx=0x7fb700008040 comp rx=0 tx=0).stop 2023-11-04T01:37:21.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.942+0000 7fb70befc640 1 -- 172.21.15.44:0/1605793534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb704159c00 msgr2=0x7fb704153f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.942+0000 7fb70befc640 1 --2- 172.21.15.44:0/1605793534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb704159c00 0x7fb704153f80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c730 tx=0x7fb6fc00cbf0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.943+0000 7fb70befc640 1 -- 172.21.15.44:0/1605793534 shutdown_connections 2023-11-04T01:37:21.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.943+0000 7fb70befc640 1 --2- 172.21.15.44:0/1605793534 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb6e806ae70 0x7fb6e806d330 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.943+0000 7fb70befc640 1 --2- 172.21.15.44:0/1605793534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb704159c00 0x7fb704153f80 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.943+0000 7fb70befc640 1 --2- 172.21.15.44:0/1605793534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7040c48e0 0x7fb704155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.943+0000 7fb70befc640 1 --2- 172.21.15.44:0/1605793534 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7040adac0 0x7fb704158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.943+0000 7fb70befc640 1 -- 172.21.15.44:0/1605793534 >> 172.21.15.44:0/1605793534 conn(0x7fb7040ce950 msgr2=0x7fb704071220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:21.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.945+0000 7fb70befc640 1 -- 172.21.15.44:0/1605793534 shutdown_connections 2023-11-04T01:37:21.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:21.949+0000 7fb70befc640 1 -- 172.21.15.44:0/1605793534 wait complete. 2023-11-04T01:37:21.979 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:22.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.089+0000 7f0682d55640 1 Processor -- start 2023-11-04T01:37:22.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.089+0000 7f0682d55640 1 -- start start 2023-11-04T01:37:22.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.089+0000 7f0682d55640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f067c0cde60 0x7f067c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.089+0000 7f0682d55640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f067c0ce240 0x7f067c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.089+0000 7f0682d55640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f067c15e000 con 0x7f067c15daa0 2023-11-04T01:37:22.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.089+0000 7f0682d55640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f067c15e5c0 con 0x7f067c0ce240 2023-11-04T01:37:22.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.089+0000 7f0682d55640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067c15e2e0 con 0x7f067c0cde60 2023-11-04T01:37:22.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.090+0000 7f06812f2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f067c0ce240 0x7f067c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.090+0000 7f067bfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f067c15daa0 0x7f067c157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52070/0 (socket says 172.21.15.44:52070) 2023-11-04T01:37:22.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.090+0000 7f067bfff640 1 -- 172.21.15.44:0/324865440 learned_addr learned my addr 172.21.15.44:0/324865440 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:22.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.090+0000 7f0680af1640 1 --2- 172.21.15.44:0/324865440 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f067c0cde60 0x7f067c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.090+0000 7f06812f2640 1 -- 172.21.15.44:0/324865440 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f067c0cde60 msgr2=0x7f067c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:22.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.090+0000 7f06812f2640 1 --2- 172.21.15.44:0/324865440 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f067c0cde60 0x7f067c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.090+0000 7f06812f2640 1 -- 172.21.15.44:0/324865440 >> v1:172.21.15.44:6789/0 conn(0x7f067c15daa0 legacy=0x7f067c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.090+0000 7f067b7fe640 1 -- 172.21.15.44:0/324865440 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508866061 0 0) 0x7f067c15e000 con 0x7f067c15daa0 2023-11-04T01:37:22.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.090+0000 7f06812f2640 1 -- 172.21.15.44:0/324865440 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067c0d1120 con 0x7f067c0ce240 2023-11-04T01:37:22.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.091+0000 7f06812f2640 1 --2- 172.21.15.44:0/324865440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f067c0ce240 0x7f067c0d1920 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0674009d90 tx=0x7f067402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeaa95fec8139911 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.091+0000 7f067b7fe640 1 -- 172.21.15.44:0/324865440 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067402cc50 con 0x7f067c0ce240 2023-11-04T01:37:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.091+0000 7f067b7fe640 1 -- 172.21.15.44:0/324865440 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067402cdb0 con 0x7f067c0ce240 2023-11-04T01:37:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.091+0000 7f067b7fe640 1 -- 172.21.15.44:0/324865440 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674034660 con 0x7f067c0ce240 2023-11-04T01:37:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.091+0000 7f0682d55640 1 -- 172.21.15.44:0/324865440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f067c0ce240 msgr2=0x7f067c0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.091+0000 7f0682d55640 1 --2- 172.21.15.44:0/324865440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f067c0ce240 0x7f067c0d1920 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0674009d90 tx=0x7f067402bea0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.091+0000 7f0682d55640 1 -- 172.21.15.44:0/324865440 shutdown_connections 2023-11-04T01:37:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.091+0000 7f0682d55640 1 --2- 172.21.15.44:0/324865440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f067c0ce240 0x7f067c0d1920 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.091+0000 7f0682d55640 1 --2- 172.21.15.44:0/324865440 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f067c0cde60 0x7f067c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.091+0000 7f0682d55640 1 -- 172.21.15.44:0/324865440 >> 172.21.15.44:0/324865440 conn(0x7f067c071f30 msgr2=0x7f067c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.091+0000 7f0682d55640 1 -- 172.21.15.44:0/324865440 shutdown_connections 2023-11-04T01:37:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.091+0000 7f0682d55640 1 -- 172.21.15.44:0/324865440 wait complete. 2023-11-04T01:37:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.093+0000 7f0682d55640 1 Processor -- start 2023-11-04T01:37:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.093+0000 7f0682d55640 1 -- start start 2023-11-04T01:37:22.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f0682d55640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f067c0cde60 0x7f067c0cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f0682d55640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f067c0ce240 0x7f067c152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f0682d55640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f067c15daa0 0x7f067c1f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f0682d55640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c153fc0 con 0x7f067c0ce240 2023-11-04T01:37:22.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f0682d55640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c1529a0 con 0x7f067c0cde60 2023-11-04T01:37:22.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f0682d55640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067c152c00 con 0x7f067c15daa0 2023-11-04T01:37:22.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f067bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f067c0ce240 0x7f067c152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f067bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f067c0ce240 0x7f067c152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60448/0 (socket says 172.21.15.44:60448) 2023-11-04T01:37:22.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f067bfff640 1 -- 172.21.15.44:0/2305355336 learned_addr learned my addr 172.21.15.44:0/2305355336 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:22.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f0680af1640 1 --2- 172.21.15.44:0/2305355336 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f067c0cde60 0x7f067c0cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f06812f2640 1 --2- 172.21.15.44:0/2305355336 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f067c15daa0 0x7f067c1f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f067bfff640 1 -- 172.21.15.44:0/2305355336 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f067c15daa0 msgr2=0x7f067c1f1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f067bfff640 1 --2- 172.21.15.44:0/2305355336 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f067c15daa0 0x7f067c1f1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f067bfff640 1 -- 172.21.15.44:0/2305355336 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f067c0cde60 msgr2=0x7f067c0cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f067bfff640 1 --2- 172.21.15.44:0/2305355336 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f067c0cde60 0x7f067c0cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f067bfff640 1 -- 172.21.15.44:0/2305355336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0674009a70 con 0x7f067c0ce240 2023-11-04T01:37:22.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f0680af1640 1 --2- 172.21.15.44:0/2305355336 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f067c0cde60 0x7f067c0cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:22.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f067bfff640 1 --2- 172.21.15.44:0/2305355336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f067c0ce240 0x7f067c152460 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f066800c430 tx=0x7f066800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f06797fa640 1 -- 172.21.15.44:0/2305355336 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06680074e0 con 0x7f067c0ce240 2023-11-04T01:37:22.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f06797fa640 1 -- 172.21.15.44:0/2305355336 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0668007660 con 0x7f067c0ce240 2023-11-04T01:37:22.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f0682d55640 1 -- 172.21.15.44:0/2305355336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067c152ee0 con 0x7f067c0ce240 2023-11-04T01:37:22.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f06797fa640 1 -- 172.21.15.44:0/2305355336 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668004a20 con 0x7f067c0ce240 2023-11-04T01:37:22.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.094+0000 7f0682d55640 1 -- 172.21.15.44:0/2305355336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067c1534a0 con 0x7f067c0ce240 2023-11-04T01:37:22.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.095+0000 7f0682d55640 1 -- 172.21.15.44:0/2305355336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f067c154100 con 0x7f067c0ce240 2023-11-04T01:37:22.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.096+0000 7f06797fa640 1 -- 172.21.15.44:0/2305355336 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0668004b80 con 0x7f067c0ce240 2023-11-04T01:37:22.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.096+0000 7f06797fa640 1 --2- 172.21.15.44:0/2305355336 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f066006ae70 0x7f066006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.096+0000 7f06797fa640 1 -- 172.21.15.44:0/2305355336 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0668089590 con 0x7f067c0ce240 2023-11-04T01:37:22.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.096+0000 7f0680af1640 1 --2- 172.21.15.44:0/2305355336 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f066006ae70 0x7f066006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.097+0000 7f0680af1640 1 --2- 172.21.15.44:0/2305355336 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f066006ae70 0x7f066006d330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0670009b90 tx=0x7f0670008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.101+0000 7f06797fa640 1 -- 172.21.15.44:0/2305355336 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f067c154100 con 0x7f067c0ce240 2023-11-04T01:37:22.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.278+0000 7f0682d55640 1 -- 172.21.15.44:0/2305355336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f067c154100 con 0x7f067c0ce240 2023-11-04T01:37:22.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.279+0000 7f06797fa640 1 -- 172.21.15.44:0/2305355336 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16787 (secure 0 0 0) 0x7f067c154100 con 0x7f067c0ce240 2023-11-04T01:37:22.282 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:22.282 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":38,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:21.306815+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:19.141183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:20.292111+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:22.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.281+0000 7f0682d55640 1 -- 172.21.15.44:0/2305355336 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f066006ae70 msgr2=0x7f066006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.281+0000 7f0682d55640 1 --2- 172.21.15.44:0/2305355336 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f066006ae70 0x7f066006d330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0670009b90 tx=0x7f0670008040 comp rx=0 tx=0).stop 2023-11-04T01:37:22.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.281+0000 7f0682d55640 1 -- 172.21.15.44:0/2305355336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f067c0ce240 msgr2=0x7f067c152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.281+0000 7f0682d55640 1 --2- 172.21.15.44:0/2305355336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f067c0ce240 0x7f067c152460 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f066800c430 tx=0x7f066800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.281+0000 7f0682d55640 1 -- 172.21.15.44:0/2305355336 shutdown_connections 2023-11-04T01:37:22.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.281+0000 7f0682d55640 1 --2- 172.21.15.44:0/2305355336 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f066006ae70 0x7f066006d330 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.281+0000 7f0682d55640 1 --2- 172.21.15.44:0/2305355336 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f067c15daa0 0x7f067c1f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.281+0000 7f0682d55640 1 --2- 172.21.15.44:0/2305355336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f067c0ce240 0x7f067c152460 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.281+0000 7f0682d55640 1 --2- 172.21.15.44:0/2305355336 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f067c0cde60 0x7f067c0cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.281+0000 7f0682d55640 1 -- 172.21.15.44:0/2305355336 >> 172.21.15.44:0/2305355336 conn(0x7f067c071f30 msgr2=0x7f067c0c9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:22.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.281+0000 7f0682d55640 1 -- 172.21.15.44:0/2305355336 shutdown_connections 2023-11-04T01:37:22.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.281+0000 7f0682d55640 1 -- 172.21.15.44:0/2305355336 wait complete. 2023-11-04T01:37:22.294 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:22.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.398+0000 7faa75632640 1 Processor -- start 2023-11-04T01:37:22.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.398+0000 7faa75632640 1 -- start start 2023-11-04T01:37:22.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa75632640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7faa700af060 0x7faa700b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa75632640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa700b1590 con 0x7faa700aec80 2023-11-04T01:37:22.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa75632640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7006a8e0 con 0x7faa7006ef40 2023-11-04T01:37:22.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa75632640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa70155a40 con 0x7faa700af060 2023-11-04T01:37:22.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa6effd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7faa700aec80 0x7faa7006a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52072/0 (socket says 172.21.15.44:52072) 2023-11-04T01:37:22.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa6effd640 1 -- 172.21.15.44:0/2781089826 learned_addr learned my addr 172.21.15.44:0/2781089826 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:22.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa67fff640 1 --2- 172.21.15.44:0/2781089826 >> v2:172.21.15.204:3300/0 conn(0x7faa700af060 0x7faa700b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa6e7fc640 1 -- 172.21.15.44:0/2781089826 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106548132 0 0) 0x7faa700b1590 con 0x7faa700aec80 2023-11-04T01:37:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa6e7fc640 1 -- 172.21.15.44:0/2781089826 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa5c003520 con 0x7faa700aec80 2023-11-04T01:37:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa6e7fc640 1 -- 172.21.15.44:0/2781089826 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3058047982 0 0) 0x7faa5c003520 con 0x7faa700aec80 2023-11-04T01:37:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa6e7fc640 1 -- 172.21.15.44:0/2781089826 >> v2:172.21.15.204:3300/0 conn(0x7faa700af060 msgr2=0x7faa700b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa6e7fc640 1 --2- 172.21.15.44:0/2781089826 >> v2:172.21.15.204:3300/0 conn(0x7faa700af060 0x7faa700b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa6e7fc640 1 -- 172.21.15.44:0/2781089826 >> v1:172.21.15.204:6789/0 conn(0x7faa7006ef40 legacy=0x7faa700cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa6e7fc640 1 -- 172.21.15.44:0/2781089826 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa700b1800 con 0x7faa700aec80 2023-11-04T01:37:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa6e7fc640 1 -- 172.21.15.44:0/2781089826 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7faa600017f0 con 0x7faa700aec80 2023-11-04T01:37:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa6e7fc640 1 -- 172.21.15.44:0/2781089826 >> v1:172.21.15.44:6789/0 conn(0x7faa700aec80 legacy=0x7faa7006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.399+0000 7faa6e7fc640 1 --2- 172.21.15.44:0/2781089826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa5c003970 0x7faa5c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.400+0000 7faa6e7fc640 1 --2- 172.21.15.44:0/2781089826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa5c0047c0 0x7faa5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.400+0000 7faa6e7fc640 1 --2- 172.21.15.44:0/2781089826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa5c005180 0x7faa5c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.400+0000 7faa6e7fc640 1 -- 172.21.15.44:0/2781089826 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa70155a40 con 0x7faa5c0047c0 2023-11-04T01:37:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.400+0000 7faa6e7fc640 1 -- 172.21.15.44:0/2781089826 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c00c020 con 0x7faa5c005180 2023-11-04T01:37:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.400+0000 7faa6e7fc640 1 -- 172.21.15.44:0/2781089826 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c00c1e0 con 0x7faa5c003970 2023-11-04T01:37:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.400+0000 7faa67fff640 1 --2- 172.21.15.44:0/2781089826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa5c0047c0 0x7faa5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.400+0000 7faa6effd640 1 --2- 172.21.15.44:0/2781089826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa5c003970 0x7faa5c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.400+0000 7faa6f7fe640 1 --2- 172.21.15.44:0/2781089826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa5c005180 0x7faa5c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.400+0000 7faa67fff640 1 -- 172.21.15.44:0/2781089826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa5c003970 msgr2=0x7faa5c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.400+0000 7faa67fff640 1 --2- 172.21.15.44:0/2781089826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa5c003970 0x7faa5c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.400+0000 7faa67fff640 1 -- 172.21.15.44:0/2781089826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa5c005180 msgr2=0x7faa5c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.400+0000 7faa67fff640 1 --2- 172.21.15.44:0/2781089826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa5c005180 0x7faa5c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.400+0000 7faa67fff640 1 -- 172.21.15.44:0/2781089826 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c003520 con 0x7faa5c0047c0 2023-11-04T01:37:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.400+0000 7faa6f7fe640 1 -- 172.21.15.44:0/2781089826 reap_dead start 2023-11-04T01:37:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.401+0000 7faa67fff640 1 --2- 172.21.15.44:0/2781089826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa5c0047c0 0x7faa5c004c40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7faa58009ab0 tx=0x7faa5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8431e0653c40df56 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.401+0000 7faa6e7fc640 1 -- 172.21.15.44:0/2781089826 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58005990 con 0x7faa5c0047c0 2023-11-04T01:37:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.401+0000 7faa6e7fc640 1 -- 172.21.15.44:0/2781089826 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa58005af0 con 0x7faa5c0047c0 2023-11-04T01:37:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.401+0000 7faa6e7fc640 1 -- 172.21.15.44:0/2781089826 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58005ea0 con 0x7faa5c0047c0 2023-11-04T01:37:22.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.402+0000 7faa75632640 1 -- 172.21.15.44:0/2781089826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa5c0047c0 msgr2=0x7faa5c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.402+0000 7faa75632640 1 --2- 172.21.15.44:0/2781089826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa5c0047c0 0x7faa5c004c40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7faa58009ab0 tx=0x7faa5c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.402+0000 7faa75632640 1 -- 172.21.15.44:0/2781089826 shutdown_connections 2023-11-04T01:37:22.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.402+0000 7faa75632640 1 --2- 172.21.15.44:0/2781089826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa5c0047c0 0x7faa5c004c40 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.402+0000 7faa75632640 1 -- 172.21.15.44:0/2781089826 >> 172.21.15.44:0/2781089826 conn(0x7faa70098d40 msgr2=0x7faa700cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:22.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.402+0000 7faa75632640 1 -- 172.21.15.44:0/2781089826 shutdown_connections 2023-11-04T01:37:22.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.402+0000 7faa75632640 1 -- 172.21.15.44:0/2781089826 wait complete. 2023-11-04T01:37:22.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.403+0000 7faa75632640 1 Processor -- start 2023-11-04T01:37:22.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.403+0000 7faa75632640 1 -- start start 2023-11-04T01:37:22.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa75632640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa5c0047c0 0x7faa700b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa75632640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa700b2690 0x7faa70150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa75632640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa700b04c0 0x7faa700b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa75632640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa700b0e80 con 0x7faa5c0047c0 2023-11-04T01:37:22.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa75632640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa700b5600 con 0x7faa700b04c0 2023-11-04T01:37:22.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa75632640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa700b3860 con 0x7faa700b2690 2023-11-04T01:37:22.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa6effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa5c0047c0 0x7faa700b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa6effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa5c0047c0 0x7faa700b50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60468/0 (socket says 172.21.15.44:60468) 2023-11-04T01:37:22.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa6effd640 1 -- 172.21.15.44:0/3161108120 learned_addr learned my addr 172.21.15.44:0/3161108120 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:22.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa67fff640 1 --2- 172.21.15.44:0/3161108120 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa700b2690 0x7faa70150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa6f7fe640 1 --2- 172.21.15.44:0/3161108120 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa700b04c0 0x7faa700b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa6effd640 1 -- 172.21.15.44:0/3161108120 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa700b2690 msgr2=0x7faa70150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa6effd640 1 --2- 172.21.15.44:0/3161108120 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa700b2690 0x7faa70150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa6effd640 1 -- 172.21.15.44:0/3161108120 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa700b04c0 msgr2=0x7faa700b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa6effd640 1 --2- 172.21.15.44:0/3161108120 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa700b04c0 0x7faa700b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa6effd640 1 -- 172.21.15.44:0/3161108120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa700b4510 con 0x7faa5c0047c0 2023-11-04T01:37:22.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa6effd640 1 --2- 172.21.15.44:0/3161108120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa5c0047c0 0x7faa700b50c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7faa6000f8e0 tx=0x7faa6000fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa677fe640 1 -- 172.21.15.44:0/3161108120 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa600073a0 con 0x7faa5c0047c0 2023-11-04T01:37:22.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa677fe640 1 -- 172.21.15.44:0/3161108120 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa60007500 con 0x7faa5c0047c0 2023-11-04T01:37:22.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa677fe640 1 -- 172.21.15.44:0/3161108120 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa600059c0 con 0x7faa5c0047c0 2023-11-04T01:37:22.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa75632640 1 -- 172.21.15.44:0/3161108120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa700b2c50 con 0x7faa5c0047c0 2023-11-04T01:37:22.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.404+0000 7faa75632640 1 -- 172.21.15.44:0/3161108120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa700b3210 con 0x7faa5c0047c0 2023-11-04T01:37:22.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.405+0000 7faa75632640 1 -- 172.21.15.44:0/3161108120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa70074290 con 0x7faa5c0047c0 2023-11-04T01:37:22.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.406+0000 7faa677fe640 1 -- 172.21.15.44:0/3161108120 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa60005b20 con 0x7faa5c0047c0 2023-11-04T01:37:22.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.406+0000 7faa677fe640 1 --2- 172.21.15.44:0/3161108120 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faa5006aea0 0x7faa5006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.406+0000 7faa677fe640 1 -- 172.21.15.44:0/3161108120 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faa60089a20 con 0x7faa5c0047c0 2023-11-04T01:37:22.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.407+0000 7faa67fff640 1 --2- 172.21.15.44:0/3161108120 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faa5006aea0 0x7faa5006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.407+0000 7faa67fff640 1 --2- 172.21.15.44:0/3161108120 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faa5006aea0 0x7faa5006d360 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faa58035000 tx=0x7faa58030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.411+0000 7faa677fe640 1 -- 172.21.15.44:0/3161108120 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faa60054990 con 0x7faa5c0047c0 2023-11-04T01:37:22.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.586+0000 7faa75632640 1 -- 172.21.15.44:0/3161108120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa701550b0 con 0x7faa5c0047c0 2023-11-04T01:37:22.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.587+0000 7faa677fe640 1 -- 172.21.15.44:0/3161108120 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16787 (secure 0 0 0) 0x7faa60057fb0 con 0x7faa5c0047c0 2023-11-04T01:37:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:22.589 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":38,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:21.306815+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:19.141183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:20.292111+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.589+0000 7faa75632640 1 -- 172.21.15.44:0/3161108120 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faa5006aea0 msgr2=0x7faa5006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.589+0000 7faa75632640 1 --2- 172.21.15.44:0/3161108120 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faa5006aea0 0x7faa5006d360 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faa58035000 tx=0x7faa58030000 comp rx=0 tx=0).stop 2023-11-04T01:37:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.589+0000 7faa75632640 1 -- 172.21.15.44:0/3161108120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa5c0047c0 msgr2=0x7faa700b50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.589+0000 7faa75632640 1 --2- 172.21.15.44:0/3161108120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa5c0047c0 0x7faa700b50c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7faa6000f8e0 tx=0x7faa6000fda0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.589+0000 7faa75632640 1 -- 172.21.15.44:0/3161108120 shutdown_connections 2023-11-04T01:37:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.589+0000 7faa75632640 1 --2- 172.21.15.44:0/3161108120 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faa5006aea0 0x7faa5006d360 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.589+0000 7faa75632640 1 --2- 172.21.15.44:0/3161108120 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa700b04c0 0x7faa700b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.589+0000 7faa75632640 1 --2- 172.21.15.44:0/3161108120 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa700b2690 0x7faa70150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.589+0000 7faa75632640 1 --2- 172.21.15.44:0/3161108120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa5c0047c0 0x7faa700b50c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.589+0000 7faa75632640 1 -- 172.21.15.44:0/3161108120 >> 172.21.15.44:0/3161108120 conn(0x7faa70098d40 msgr2=0x7faa70154190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:22.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.589+0000 7faa75632640 1 -- 172.21.15.44:0/3161108120 shutdown_connections 2023-11-04T01:37:22.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.589+0000 7faa75632640 1 -- 172.21.15.44:0/3161108120 wait complete. 2023-11-04T01:37:22.602 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:37:22.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.709+0000 7efe1a0c9640 1 Processor -- start 2023-11-04T01:37:22.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.709+0000 7efe1a0c9640 1 -- start start 2023-11-04T01:37:22.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.710+0000 7efe1a0c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe1415af20 0x7efe140b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.710+0000 7efe1a0c9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efe140b64c0 0x7efe140cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.710+0000 7efe1a0c9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe140d01f0 con 0x7efe140cd3b0 2023-11-04T01:37:22.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.710+0000 7efe1a0c9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe140b6a40 con 0x7efe140b64c0 2023-11-04T01:37:22.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.710+0000 7efe1a0c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe140d04b0 con 0x7efe1415af20 2023-11-04T01:37:22.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.710+0000 7efe13fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efe140cd3b0 0x7efe140b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35176/0 (socket says 172.21.15.44:35176) 2023-11-04T01:37:22.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.710+0000 7efe12ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efe140b64c0 0x7efe140cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.710+0000 7efe13fff640 1 -- 172.21.15.44:0/1592364882 learned_addr learned my addr 172.21.15.44:0/1592364882 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:22.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.711+0000 7efe137fe640 1 --2- 172.21.15.44:0/1592364882 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe1415af20 0x7efe140b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.711+0000 7efe127fc640 1 -- 172.21.15.44:0/1592364882 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910896936 0 0) 0x7efe140d01f0 con 0x7efe140cd3b0 2023-11-04T01:37:22.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.711+0000 7efe127fc640 1 -- 172.21.15.44:0/1592364882 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdfc003520 con 0x7efe140cd3b0 2023-11-04T01:37:22.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.711+0000 7efe12ffd640 1 -- 172.21.15.44:0/1592364882 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe1415af20 msgr2=0x7efe140b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:22.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.711+0000 7efe12ffd640 1 --2- 172.21.15.44:0/1592364882 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe1415af20 0x7efe140b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.711+0000 7efe12ffd640 1 -- 172.21.15.44:0/1592364882 >> v1:172.21.15.44:6789/0 conn(0x7efe140cd3b0 legacy=0x7efe140b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.711+0000 7efe12ffd640 1 -- 172.21.15.44:0/1592364882 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe140d0790 con 0x7efe140b64c0 2023-11-04T01:37:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.712+0000 7efe12ffd640 1 --2- 172.21.15.44:0/1592364882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe140b64c0 0x7efe140cbc70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efe080097a0 tx=0x7efe0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdc1634d6fde65a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.712+0000 7efe127fc640 1 -- 172.21.15.44:0/1592364882 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08031830 con 0x7efe140b64c0 2023-11-04T01:37:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.712+0000 7efe127fc640 1 -- 172.21.15.44:0/1592364882 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe08031990 con 0x7efe140b64c0 2023-11-04T01:37:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.712+0000 7efe127fc640 1 -- 172.21.15.44:0/1592364882 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08031d00 con 0x7efe140b64c0 2023-11-04T01:37:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.712+0000 7efe1a0c9640 1 -- 172.21.15.44:0/1592364882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe140b64c0 msgr2=0x7efe140cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.712+0000 7efe1a0c9640 1 --2- 172.21.15.44:0/1592364882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe140b64c0 0x7efe140cbc70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efe080097a0 tx=0x7efe0802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.712+0000 7efe1a0c9640 1 -- 172.21.15.44:0/1592364882 shutdown_connections 2023-11-04T01:37:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.712+0000 7efe1a0c9640 1 --2- 172.21.15.44:0/1592364882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe140b64c0 0x7efe140cbc70 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.712+0000 7efe1a0c9640 1 --2- 172.21.15.44:0/1592364882 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe1415af20 0x7efe140b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.712+0000 7efe1a0c9640 1 -- 172.21.15.44:0/1592364882 >> 172.21.15.44:0/1592364882 conn(0x7efe1406ea20 msgr2=0x7efe1406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.712+0000 7efe1a0c9640 1 -- 172.21.15.44:0/1592364882 shutdown_connections 2023-11-04T01:37:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.712+0000 7efe1a0c9640 1 -- 172.21.15.44:0/1592364882 wait complete. 2023-11-04T01:37:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.714+0000 7efe1a0c9640 1 Processor -- start 2023-11-04T01:37:22.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.714+0000 7efe1a0c9640 1 -- start start 2023-11-04T01:37:22.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.714+0000 7efe1a0c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe140b64c0 0x7efe1414af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.714+0000 7efe1a0c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe140cd3b0 0x7efe1406c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.714+0000 7efe1a0c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe1415af20 0x7efe1406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe1a0c9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe140c82b0 con 0x7efe1415af20 2023-11-04T01:37:22.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe1a0c9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe140c9110 con 0x7efe140cd3b0 2023-11-04T01:37:22.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe1a0c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe140c8500 con 0x7efe140b64c0 2023-11-04T01:37:22.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe13fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe1415af20 0x7efe1406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe13fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe1415af20 0x7efe1406cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41494/0 (socket says 172.21.15.44:41494) 2023-11-04T01:37:22.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe13fff640 1 -- 172.21.15.44:0/2490249629 learned_addr learned my addr 172.21.15.44:0/2490249629 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:22.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe137fe640 1 --2- 172.21.15.44:0/2490249629 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe140b64c0 0x7efe1414af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe12ffd640 1 --2- 172.21.15.44:0/2490249629 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe140cd3b0 0x7efe1406c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe13fff640 1 -- 172.21.15.44:0/2490249629 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe140b64c0 msgr2=0x7efe1414af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe13fff640 1 --2- 172.21.15.44:0/2490249629 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe140b64c0 0x7efe1414af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe13fff640 1 -- 172.21.15.44:0/2490249629 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe140cd3b0 msgr2=0x7efe1406c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe13fff640 1 --2- 172.21.15.44:0/2490249629 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe140cd3b0 0x7efe1406c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe13fff640 1 -- 172.21.15.44:0/2490249629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe08009400 con 0x7efe1415af20 2023-11-04T01:37:22.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe13fff640 1 --2- 172.21.15.44:0/2490249629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe1415af20 0x7efe1406cac0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00cb70 tx=0x7efe0c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efdfbfff640 1 -- 172.21.15.44:0/2490249629 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c00ad40 con 0x7efe1415af20 2023-11-04T01:37:22.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efdfbfff640 1 -- 172.21.15.44:0/2490249629 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c012400 con 0x7efe1415af20 2023-11-04T01:37:22.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe1a0c9640 1 -- 172.21.15.44:0/2490249629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe140c87e0 con 0x7efe1415af20 2023-11-04T01:37:22.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efdfbfff640 1 -- 172.21.15.44:0/2490249629 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c00aea0 con 0x7efe1415af20 2023-11-04T01:37:22.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.715+0000 7efe1a0c9640 1 -- 172.21.15.44:0/2490249629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe140c8da0 con 0x7efe1415af20 2023-11-04T01:37:22.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.716+0000 7efe1a0c9640 1 -- 172.21.15.44:0/2490249629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe14154d80 con 0x7efe1415af20 2023-11-04T01:37:22.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.717+0000 7efdfbfff640 1 -- 172.21.15.44:0/2490249629 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efe0c007070 con 0x7efe1415af20 2023-11-04T01:37:22.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.717+0000 7efdfbfff640 1 --2- 172.21.15.44:0/2490249629 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efe0006ae70 0x7efe0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.717+0000 7efdfbfff640 1 -- 172.21.15.44:0/2490249629 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efe0c089700 con 0x7efe1415af20 2023-11-04T01:37:22.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.717+0000 7efe137fe640 1 --2- 172.21.15.44:0/2490249629 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efe0006ae70 0x7efe0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.718+0000 7efe137fe640 1 --2- 172.21.15.44:0/2490249629 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efe0006ae70 0x7efe0006d330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efe04009aa0 tx=0x7efe04009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.721+0000 7efdfbfff640 1 -- 172.21.15.44:0/2490249629 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efe0c054720 con 0x7efe1415af20 2023-11-04T01:37:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.933+0000 7efe1a0c9640 1 -- 172.21.15.44:0/2490249629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efe1406f5b0 con 0x7efe1415af20 2023-11-04T01:37:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.952+0000 7efdfbfff640 1 -- 172.21.15.44:0/2490249629 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7efe0c057d40 con 0x7efe1415af20 2023-11-04T01:37:22.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.954+0000 7efe1a0c9640 1 -- 172.21.15.44:0/2490249629 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efe0006ae70 msgr2=0x7efe0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.954+0000 7efe1a0c9640 1 --2- 172.21.15.44:0/2490249629 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efe0006ae70 0x7efe0006d330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efe04009aa0 tx=0x7efe04009190 comp rx=0 tx=0).stop 2023-11-04T01:37:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.954+0000 7efe1a0c9640 1 -- 172.21.15.44:0/2490249629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe1415af20 msgr2=0x7efe1406cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.954+0000 7efe1a0c9640 1 --2- 172.21.15.44:0/2490249629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe1415af20 0x7efe1406cac0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00cb70 tx=0x7efe0c00a430 comp rx=0 tx=0).stop 2023-11-04T01:37:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.954+0000 7efe1a0c9640 1 -- 172.21.15.44:0/2490249629 shutdown_connections 2023-11-04T01:37:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.954+0000 7efe1a0c9640 1 --2- 172.21.15.44:0/2490249629 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efe0006ae70 0x7efe0006d330 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.954+0000 7efe1a0c9640 1 --2- 172.21.15.44:0/2490249629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe1415af20 0x7efe1406cac0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.954+0000 7efe1a0c9640 1 --2- 172.21.15.44:0/2490249629 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe140cd3b0 0x7efe1406c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.954+0000 7efe1a0c9640 1 --2- 172.21.15.44:0/2490249629 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe140b64c0 0x7efe1414af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.954+0000 7efe1a0c9640 1 -- 172.21.15.44:0/2490249629 >> 172.21.15.44:0/2490249629 conn(0x7efe1406ea20 msgr2=0x7efe140cda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.954+0000 7efe1a0c9640 1 -- 172.21.15.44:0/2490249629 shutdown_connections 2023-11-04T01:37:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:22.954+0000 7efe1a0c9640 1 -- 172.21.15.44:0/2490249629 wait complete. 2023-11-04T01:37:22.967 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:37:22.967 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:37:23.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.075+0000 7f40ebb4c640 1 Processor -- start 2023-11-04T01:37:23.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.075+0000 7f40ebb4c640 1 -- start start 2023-11-04T01:37:23.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.076+0000 7f40ebb4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40e415d1b0 0x7f40e40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.076+0000 7f40ebb4c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f40e4066000 0x7f40e406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.076+0000 7f40ebb4c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e40c9bf0 con 0x7f40e4070ff0 2023-11-04T01:37:23.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.076+0000 7f40ebb4c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40cd890 con 0x7f40e4066000 2023-11-04T01:37:23.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.076+0000 7f40ebb4c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40cdb30 con 0x7f40e415d1b0 2023-11-04T01:37:23.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.076+0000 7f40e90e7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40e415d1b0 0x7f40e40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.076+0000 7f40ea0e9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f40e4066000 0x7f40e406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.076+0000 7f40e90e7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40e415d1b0 0x7f40e40cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:49408/0 (socket says 172.21.15.44:49408) 2023-11-04T01:37:23.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.076+0000 7f40e90e7640 1 -- 172.21.15.44:0/3342461359 learned_addr learned my addr 172.21.15.44:0/3342461359 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:23.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.076+0000 7f40e98e8640 1 --1- 172.21.15.44:0/3342461359 >> v1:172.21.15.204:6789/0 conn(0x7f40e4070ff0 0x7f40e40713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:55274/0 (socket says 172.21.15.44:55274) 2023-11-04T01:37:23.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.076+0000 7f40ea0e9640 1 -- 172.21.15.44:0/3342461359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40e415d1b0 msgr2=0x7f40e40cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:23.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.076+0000 7f40ea0e9640 1 --2- 172.21.15.44:0/3342461359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40e415d1b0 0x7f40e40cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.076+0000 7f40ea0e9640 1 -- 172.21.15.44:0/3342461359 >> v1:172.21.15.204:6789/0 conn(0x7f40e4070ff0 legacy=0x7f40e40713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.076+0000 7f40ea0e9640 1 -- 172.21.15.44:0/3342461359 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e40cde10 con 0x7f40e4066000 2023-11-04T01:37:23.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.076+0000 7f40e90e7640 1 --2- 172.21.15.44:0/3342461359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40e415d1b0 0x7f40e40cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:23.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.077+0000 7f40ea0e9640 1 --2- 172.21.15.44:0/3342461359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40e4066000 0x7f40e406a500 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009d90 tx=0x7f40dc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8771732d34bda87b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.077+0000 7f40e88e6640 1 -- 172.21.15.44:0/3342461359 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc02cc50 con 0x7f40e4066000 2023-11-04T01:37:23.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.077+0000 7f40e88e6640 1 -- 172.21.15.44:0/3342461359 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc02cdb0 con 0x7f40e4066000 2023-11-04T01:37:23.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.077+0000 7f40e88e6640 1 -- 172.21.15.44:0/3342461359 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc034660 con 0x7f40e4066000 2023-11-04T01:37:23.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.078+0000 7f40ebb4c640 1 -- 172.21.15.44:0/3342461359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40e4066000 msgr2=0x7f40e406a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.078+0000 7f40ebb4c640 1 --2- 172.21.15.44:0/3342461359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40e4066000 0x7f40e406a500 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009d90 tx=0x7f40dc02bea0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.078+0000 7f40ebb4c640 1 -- 172.21.15.44:0/3342461359 shutdown_connections 2023-11-04T01:37:23.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.078+0000 7f40ebb4c640 1 --2- 172.21.15.44:0/3342461359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40e4066000 0x7f40e406a500 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.078+0000 7f40ebb4c640 1 --2- 172.21.15.44:0/3342461359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40e415d1b0 0x7f40e40cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.078+0000 7f40ebb4c640 1 -- 172.21.15.44:0/3342461359 >> 172.21.15.44:0/3342461359 conn(0x7f40e40cbc90 msgr2=0x7f40e40cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:23.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.078+0000 7f40ebb4c640 1 -- 172.21.15.44:0/3342461359 shutdown_connections 2023-11-04T01:37:23.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.078+0000 7f40ebb4c640 1 -- 172.21.15.44:0/3342461359 wait complete. 2023-11-04T01:37:23.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.079+0000 7f40ebb4c640 1 Processor -- start 2023-11-04T01:37:23.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.079+0000 7f40ebb4c640 1 -- start start 2023-11-04T01:37:23.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40ebb4c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40e4066000 0x7f40e40c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40ebb4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e4070ff0 0x7f40e41537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40ebb4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40e415d1b0 0x7f40e415ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40ebb4c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40c5a90 con 0x7f40e4070ff0 2023-11-04T01:37:23.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40ebb4c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40c4e80 con 0x7f40e4066000 2023-11-04T01:37:23.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40ebb4c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40c5160 con 0x7f40e415d1b0 2023-11-04T01:37:23.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40e90e7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e4070ff0 0x7f40e41537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40e90e7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e4070ff0 0x7f40e41537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41508/0 (socket says 172.21.15.44:41508) 2023-11-04T01:37:23.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40e90e7640 1 -- 172.21.15.44:0/1150171635 learned_addr learned my addr 172.21.15.44:0/1150171635 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:23.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40ea0e9640 1 --2- 172.21.15.44:0/1150171635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40e415d1b0 0x7f40e415ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40e98e8640 1 --2- 172.21.15.44:0/1150171635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40e4066000 0x7f40e40c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40e90e7640 1 -- 172.21.15.44:0/1150171635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40e415d1b0 msgr2=0x7f40e415ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40e90e7640 1 --2- 172.21.15.44:0/1150171635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40e415d1b0 0x7f40e415ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40e90e7640 1 -- 172.21.15.44:0/1150171635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40e4066000 msgr2=0x7f40e40c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40e90e7640 1 --2- 172.21.15.44:0/1150171635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40e4066000 0x7f40e40c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40e90e7640 1 -- 172.21.15.44:0/1150171635 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d40094d0 con 0x7f40e4070ff0 2023-11-04T01:37:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.080+0000 7f40e98e8640 1 --2- 172.21.15.44:0/1150171635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40e4066000 0x7f40e40c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.081+0000 7f40e90e7640 1 --2- 172.21.15.44:0/1150171635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e4070ff0 0x7f40e41537d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f40d400e9d0 tx=0x7f40d400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.081+0000 7f40da7fc640 1 -- 172.21.15.44:0/1150171635 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d400ca60 con 0x7f40e4070ff0 2023-11-04T01:37:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.081+0000 7f40ebb4c640 1 -- 172.21.15.44:0/1150171635 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40dc009a70 con 0x7f40e4070ff0 2023-11-04T01:37:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.081+0000 7f40da7fc640 1 -- 172.21.15.44:0/1150171635 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d400cbc0 con 0x7f40e4070ff0 2023-11-04T01:37:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.081+0000 7f40da7fc640 1 -- 172.21.15.44:0/1150171635 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4013470 con 0x7f40e4070ff0 2023-11-04T01:37:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.081+0000 7f40ebb4c640 1 -- 172.21.15.44:0/1150171635 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e40c5720 con 0x7f40e4070ff0 2023-11-04T01:37:23.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.082+0000 7f40ebb4c640 1 -- 172.21.15.44:0/1150171635 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e4074290 con 0x7f40e4070ff0 2023-11-04T01:37:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.082+0000 7f40da7fc640 1 -- 172.21.15.44:0/1150171635 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f40d40135d0 con 0x7f40e4070ff0 2023-11-04T01:37:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.082+0000 7f40da7fc640 1 --2- 172.21.15.44:0/1150171635 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f40c806ae70 0x7f40c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.083+0000 7f40da7fc640 1 -- 172.21.15.44:0/1150171635 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f40d4089b20 con 0x7f40e4070ff0 2023-11-04T01:37:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.083+0000 7f40e98e8640 1 --2- 172.21.15.44:0/1150171635 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f40c806ae70 0x7f40c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.083+0000 7f40e98e8640 1 --2- 172.21.15.44:0/1150171635 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f40c806ae70 0x7f40c806d330 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f40e0000f60 tx=0x7f40e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.087+0000 7f40da7fc640 1 -- 172.21.15.44:0/1150171635 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40d4054a10 con 0x7f40e4070ff0 2023-11-04T01:37:23.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.299+0000 7f40ebb4c640 1 -- 172.21.15.44:0/1150171635 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f40e406b140 con 0x7f40e4070ff0 2023-11-04T01:37:23.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.957+0000 7f40da7fc640 1 -- 172.21.15.44:0/1150171635 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f40d4058030 con 0x7f40e4070ff0 2023-11-04T01:37:23.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.960+0000 7f40ebb4c640 1 -- 172.21.15.44:0/1150171635 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f40c806ae70 msgr2=0x7f40c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.960+0000 7f40ebb4c640 1 --2- 172.21.15.44:0/1150171635 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f40c806ae70 0x7f40c806d330 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f40e0000f60 tx=0x7f40e0009040 comp rx=0 tx=0).stop 2023-11-04T01:37:23.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.960+0000 7f40ebb4c640 1 -- 172.21.15.44:0/1150171635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e4070ff0 msgr2=0x7f40e41537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.960+0000 7f40ebb4c640 1 --2- 172.21.15.44:0/1150171635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e4070ff0 0x7f40e41537d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f40d400e9d0 tx=0x7f40d400ee90 comp rx=0 tx=0).stop 2023-11-04T01:37:23.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.960+0000 7f40ebb4c640 1 -- 172.21.15.44:0/1150171635 shutdown_connections 2023-11-04T01:37:23.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.960+0000 7f40ebb4c640 1 --2- 172.21.15.44:0/1150171635 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f40c806ae70 0x7f40c806d330 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.960+0000 7f40ebb4c640 1 --2- 172.21.15.44:0/1150171635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40e415d1b0 0x7f40e415ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.960+0000 7f40ebb4c640 1 --2- 172.21.15.44:0/1150171635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e4070ff0 0x7f40e41537d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.960+0000 7f40ebb4c640 1 --2- 172.21.15.44:0/1150171635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40e4066000 0x7f40e40c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.960+0000 7f40ebb4c640 1 -- 172.21.15.44:0/1150171635 >> 172.21.15.44:0/1150171635 conn(0x7f40e40cbc90 msgr2=0x7f40e40713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:23.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.960+0000 7f40ebb4c640 1 -- 172.21.15.44:0/1150171635 shutdown_connections 2023-11-04T01:37:23.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:23.960+0000 7f40ebb4c640 1 -- 172.21.15.44:0/1150171635 wait complete. 2023-11-04T01:37:23.975 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:37:23.975 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:24.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.086+0000 7f34f5e0e640 1 Processor -- start 2023-11-04T01:37:24.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.086+0000 7f34f5e0e640 1 -- start start 2023-11-04T01:37:24.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34f5e0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f00cde60 0x7f34f015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34f5e0e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f34f00ce240 0x7f34f00d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34f5e0e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f015e000 con 0x7f34f015daa0 2023-11-04T01:37:24.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34f5e0e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f015e5c0 con 0x7f34f00ce240 2023-11-04T01:37:24.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34f5e0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f015e2e0 con 0x7f34f00cde60 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34eeffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f34f015daa0 0x7f34f0157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35190/0 (socket says 172.21.15.44:35190) 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34eeffd640 1 -- 172.21.15.44:0/1138398320 learned_addr learned my addr 172.21.15.44:0/1138398320 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34effff640 1 --2- 172.21.15.44:0/1138398320 >> v2:172.21.15.44:3300/0 conn(0x7f34f00ce240 0x7f34f00d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34ef7fe640 1 --2- 172.21.15.44:0/1138398320 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f00cde60 0x7f34f015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34ee7fc640 1 -- 172.21.15.44:0/1138398320 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477351312 0 0) 0x7f34f015e000 con 0x7f34f015daa0 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34ee7fc640 1 -- 172.21.15.44:0/1138398320 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d8003520 con 0x7f34f015daa0 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34effff640 1 -- 172.21.15.44:0/1138398320 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f00cde60 msgr2=0x7f34f015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34effff640 1 --2- 172.21.15.44:0/1138398320 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f00cde60 0x7f34f015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34effff640 1 -- 172.21.15.44:0/1138398320 >> v1:172.21.15.44:6789/0 conn(0x7f34f015daa0 legacy=0x7f34f0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34effff640 1 -- 172.21.15.44:0/1138398320 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f00d1120 con 0x7f34f00ce240 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.087+0000 7f34ef7fe640 1 --2- 172.21.15.44:0/1138398320 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f00cde60 0x7f34f015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.088+0000 7f34effff640 1 --2- 172.21.15.44:0/1138398320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34f00ce240 0x7f34f00d1920 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009d90 tx=0x7f34e802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2eb2a296e8fdf27 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.088+0000 7f34ee7fc640 1 -- 172.21.15.44:0/1138398320 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e802cc50 con 0x7f34f00ce240 2023-11-04T01:37:24.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.088+0000 7f34ee7fc640 1 -- 172.21.15.44:0/1138398320 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e802cdb0 con 0x7f34f00ce240 2023-11-04T01:37:24.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.088+0000 7f34ee7fc640 1 -- 172.21.15.44:0/1138398320 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e8034660 con 0x7f34f00ce240 2023-11-04T01:37:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.089+0000 7f34f5e0e640 1 -- 172.21.15.44:0/1138398320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34f00ce240 msgr2=0x7f34f00d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.089+0000 7f34f5e0e640 1 --2- 172.21.15.44:0/1138398320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34f00ce240 0x7f34f00d1920 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009d90 tx=0x7f34e802bea0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.089+0000 7f34f5e0e640 1 -- 172.21.15.44:0/1138398320 shutdown_connections 2023-11-04T01:37:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.089+0000 7f34f5e0e640 1 --2- 172.21.15.44:0/1138398320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34f00ce240 0x7f34f00d1920 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.089+0000 7f34f5e0e640 1 --2- 172.21.15.44:0/1138398320 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f00cde60 0x7f34f015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.089+0000 7f34f5e0e640 1 -- 172.21.15.44:0/1138398320 >> 172.21.15.44:0/1138398320 conn(0x7f34f0071f30 msgr2=0x7f34f00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.089+0000 7f34f5e0e640 1 -- 172.21.15.44:0/1138398320 shutdown_connections 2023-11-04T01:37:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.089+0000 7f34f5e0e640 1 -- 172.21.15.44:0/1138398320 wait complete. 2023-11-04T01:37:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.090+0000 7f34f5e0e640 1 Processor -- start 2023-11-04T01:37:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.090+0000 7f34f5e0e640 1 -- start start 2023-11-04T01:37:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34f5e0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34f00cde60 0x7f34f01551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34f5e0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f00ce240 0x7f34f01f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34f5e0e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34f015daa0 0x7f34f00cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34f5e0e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f01556f0 con 0x7f34f00cde60 2023-11-04T01:37:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34f5e0e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f015ab50 con 0x7f34f015daa0 2023-11-04T01:37:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34f5e0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f015ae30 con 0x7f34f00ce240 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34ef7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34f00cde60 0x7f34f01551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34ef7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34f00cde60 0x7f34f01551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41530/0 (socket says 172.21.15.44:41530) 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34ef7fe640 1 -- 172.21.15.44:0/3418488883 learned_addr learned my addr 172.21.15.44:0/3418488883 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34eeffd640 1 --2- 172.21.15.44:0/3418488883 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f00ce240 0x7f34f01f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34effff640 1 --2- 172.21.15.44:0/3418488883 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34f015daa0 0x7f34f00cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34ef7fe640 1 -- 172.21.15.44:0/3418488883 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f00ce240 msgr2=0x7f34f01f2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34ef7fe640 1 --2- 172.21.15.44:0/3418488883 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f00ce240 0x7f34f01f2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34ef7fe640 1 -- 172.21.15.44:0/3418488883 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34f015daa0 msgr2=0x7f34f00cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34ef7fe640 1 --2- 172.21.15.44:0/3418488883 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34f015daa0 0x7f34f00cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34ef7fe640 1 -- 172.21.15.44:0/3418488883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e8009a70 con 0x7f34f00cde60 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.091+0000 7f34effff640 1 --2- 172.21.15.44:0/3418488883 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34f015daa0 0x7f34f00cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.092+0000 7f34ef7fe640 1 --2- 172.21.15.44:0/3418488883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34f00cde60 0x7f34f01551b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f34e400e7e0 tx=0x7f34e400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.092+0000 7f34d7fff640 1 -- 172.21.15.44:0/3418488883 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e4004030 con 0x7f34f00cde60 2023-11-04T01:37:24.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.092+0000 7f34d7fff640 1 -- 172.21.15.44:0/3418488883 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e4004190 con 0x7f34f00cde60 2023-11-04T01:37:24.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.092+0000 7f34f5e0e640 1 -- 172.21.15.44:0/3418488883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f015b110 con 0x7f34f00cde60 2023-11-04T01:37:24.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.092+0000 7f34d7fff640 1 -- 172.21.15.44:0/3418488883 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e4004520 con 0x7f34f00cde60 2023-11-04T01:37:24.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.092+0000 7f34f5e0e640 1 -- 172.21.15.44:0/3418488883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f015b6d0 con 0x7f34f00cde60 2023-11-04T01:37:24.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.093+0000 7f34f5e0e640 1 -- 172.21.15.44:0/3418488883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f00d0950 con 0x7f34f00cde60 2023-11-04T01:37:24.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.093+0000 7f34d7fff640 1 -- 172.21.15.44:0/3418488883 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34e400c6d0 con 0x7f34f00cde60 2023-11-04T01:37:24.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.094+0000 7f34d7fff640 1 --2- 172.21.15.44:0/3418488883 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f34dc06ae70 0x7f34dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.094+0000 7f34d7fff640 1 -- 172.21.15.44:0/3418488883 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f34e40893f0 con 0x7f34f00cde60 2023-11-04T01:37:24.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.094+0000 7f34eeffd640 1 --2- 172.21.15.44:0/3418488883 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f34dc06ae70 0x7f34dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.094+0000 7f34eeffd640 1 --2- 172.21.15.44:0/3418488883 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f34dc06ae70 0x7f34dc06d330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f34f00a97d0 tx=0x7f34e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.098+0000 7f34d7fff640 1 -- 172.21.15.44:0/3418488883 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f34e4054360 con 0x7f34f00cde60 2023-11-04T01:37:24.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.310+0000 7f34f5e0e640 1 -- 172.21.15.44:0/3418488883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34f0074290 con 0x7f34f00cde60 2023-11-04T01:37:24.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.311+0000 7f34d7fff640 1 -- 172.21.15.44:0/3418488883 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f34e4057980 con 0x7f34f00cde60 2023-11-04T01:37:24.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:24.313 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5024,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/620952929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":620952929},{"type":"v1","addr":"172.21.15.44:6834","nonce":620952929}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2082760690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":2082760690},{"type":"v1","addr":"172.21.15.204:6836","nonce":2082760690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5323,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2330742876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2330742876},{"type":"v1","addr":"172.21.15.204:6837","nonce":2330742876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:21.307124+0000","modified":"2023-11-04T01:37:23.300604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5514":{"gid":5514,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/2457583329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2457583329},{"type":"v1","addr":"172.21.15.44:6835","nonce":2457583329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:37:24.313 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 15 2023-11-04T01:37:24.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.312+0000 7f34f5e0e640 1 -- 172.21.15.44:0/3418488883 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f34dc06ae70 msgr2=0x7f34dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.312+0000 7f34f5e0e640 1 --2- 172.21.15.44:0/3418488883 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f34dc06ae70 0x7f34dc06d330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f34f00a97d0 tx=0x7f34e0009040 comp rx=0 tx=0).stop 2023-11-04T01:37:24.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.313+0000 7f34f5e0e640 1 -- 172.21.15.44:0/3418488883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34f00cde60 msgr2=0x7f34f01551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.313+0000 7f34f5e0e640 1 --2- 172.21.15.44:0/3418488883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34f00cde60 0x7f34f01551b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f34e400e7e0 tx=0x7f34e400eca0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.313+0000 7f34f5e0e640 1 -- 172.21.15.44:0/3418488883 shutdown_connections 2023-11-04T01:37:24.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.313+0000 7f34f5e0e640 1 --2- 172.21.15.44:0/3418488883 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f34dc06ae70 0x7f34dc06d330 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.313+0000 7f34f5e0e640 1 --2- 172.21.15.44:0/3418488883 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34f015daa0 0x7f34f00cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.313+0000 7f34f5e0e640 1 --2- 172.21.15.44:0/3418488883 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f00ce240 0x7f34f01f2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.313+0000 7f34f5e0e640 1 --2- 172.21.15.44:0/3418488883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34f00cde60 0x7f34f01551b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.313+0000 7f34f5e0e640 1 -- 172.21.15.44:0/3418488883 >> 172.21.15.44:0/3418488883 conn(0x7f34f0071f30 msgr2=0x7f34f00b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.313+0000 7f34f5e0e640 1 -- 172.21.15.44:0/3418488883 shutdown_connections 2023-11-04T01:37:24.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.313+0000 7f34f5e0e640 1 -- 172.21.15.44:0/3418488883 wait complete. 2023-11-04T01:37:24.325 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:24.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.430+0000 7f4a6de34640 1 Processor -- start 2023-11-04T01:37:24.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.430+0000 7f4a6de34640 1 -- start start 2023-11-04T01:37:24.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.431+0000 7f4a6de34640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a68160b10 0x7f4a68160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.431+0000 7f4a6de34640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4a680cf160 0x7f4a680cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.431+0000 7f4a6de34640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6806bf00 con 0x7f4a6815ce60 2023-11-04T01:37:24.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.431+0000 7f4a6de34640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a680cbde0 con 0x7f4a680cf160 2023-11-04T01:37:24.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.431+0000 7f4a6de34640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a680cfb30 con 0x7f4a68160b10 2023-11-04T01:37:24.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.431+0000 7f4a67fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4a680cf160 0x7f4a680cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.431+0000 7f4a67fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4a680cf160 0x7f4a680cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41536/0 (socket says 172.21.15.44:41536) 2023-11-04T01:37:24.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.431+0000 7f4a66ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a68160b10 0x7f4a68160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.431+0000 7f4a67fff640 1 -- 172.21.15.44:0/4179271722 learned_addr learned my addr 172.21.15.44:0/4179271722 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:24.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.432+0000 7f4a67fff640 1 -- 172.21.15.44:0/4179271722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a68160b10 msgr2=0x7f4a68160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:24.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.432+0000 7f4a67fff640 1 --2- 172.21.15.44:0/4179271722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a68160b10 0x7f4a68160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.432+0000 7f4a67fff640 1 -- 172.21.15.44:0/4179271722 >> v1:172.21.15.204:6789/0 conn(0x7f4a6815ce60 legacy=0x7f4a6806b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.432+0000 7f4a67fff640 1 -- 172.21.15.44:0/4179271722 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a681615d0 con 0x7f4a680cf160 2023-11-04T01:37:24.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.432+0000 7f4a667fc640 1 -- 172.21.15.44:0/4179271722 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468492549 0 0) 0x7f4a6806bf00 con 0x7f4a6815ce60 2023-11-04T01:37:24.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.432+0000 7f4a67fff640 1 --2- 172.21.15.44:0/4179271722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a680cf160 0x7f4a680cf5f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009e50 tx=0x7f4a6002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b153f2c137813bd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.433+0000 7f4a667fc640 1 -- 172.21.15.44:0/4179271722 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6002cb00 con 0x7f4a680cf160 2023-11-04T01:37:24.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.433+0000 7f4a667fc640 1 -- 172.21.15.44:0/4179271722 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6002cc60 con 0x7f4a680cf160 2023-11-04T01:37:24.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.433+0000 7f4a667fc640 1 -- 172.21.15.44:0/4179271722 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a600343f0 con 0x7f4a680cf160 2023-11-04T01:37:24.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.433+0000 7f4a6de34640 1 -- 172.21.15.44:0/4179271722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a680cf160 msgr2=0x7f4a680cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.433+0000 7f4a6de34640 1 --2- 172.21.15.44:0/4179271722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a680cf160 0x7f4a680cf5f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009e50 tx=0x7f4a6002bf60 comp rx=0 tx=0).stop 2023-11-04T01:37:24.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.433+0000 7f4a6de34640 1 -- 172.21.15.44:0/4179271722 shutdown_connections 2023-11-04T01:37:24.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.433+0000 7f4a6de34640 1 --2- 172.21.15.44:0/4179271722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a680cf160 0x7f4a680cf5f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.433+0000 7f4a6de34640 1 --2- 172.21.15.44:0/4179271722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a68160b10 0x7f4a68160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.433+0000 7f4a6de34640 1 -- 172.21.15.44:0/4179271722 >> 172.21.15.44:0/4179271722 conn(0x7f4a6806ea90 msgr2=0x7f4a6806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.433+0000 7f4a6de34640 1 -- 172.21.15.44:0/4179271722 shutdown_connections 2023-11-04T01:37:24.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.433+0000 7f4a6de34640 1 -- 172.21.15.44:0/4179271722 wait complete. 2023-11-04T01:37:24.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.434+0000 7f4a6de34640 1 Processor -- start 2023-11-04T01:37:24.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.435+0000 7f4a6de34640 1 -- start start 2023-11-04T01:37:24.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.435+0000 7f4a6de34640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a680cf160 0x7f4a68151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.435+0000 7f4a6de34640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a6815ce60 0x7f4a68150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.435+0000 7f4a6de34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a68160b10 0x7f4a680c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.435+0000 7f4a6de34640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68154c50 con 0x7f4a68160b10 2023-11-04T01:37:24.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.435+0000 7f4a6de34640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68151130 con 0x7f4a6815ce60 2023-11-04T01:37:24.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.435+0000 7f4a6de34640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a680c81b0 con 0x7f4a680cf160 2023-11-04T01:37:24.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.435+0000 7f4a67fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a68160b10 0x7f4a680c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.435+0000 7f4a67fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a68160b10 0x7f4a680c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41546/0 (socket says 172.21.15.44:41546) 2023-11-04T01:37:24.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.435+0000 7f4a67fff640 1 -- 172.21.15.44:0/2094091782 learned_addr learned my addr 172.21.15.44:0/2094091782 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:24.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.436+0000 7f4a66ffd640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a6815ce60 0x7f4a68150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.436+0000 7f4a677fe640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a680cf160 0x7f4a68151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.436+0000 7f4a67fff640 1 -- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a680cf160 msgr2=0x7f4a68151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.436+0000 7f4a67fff640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a680cf160 0x7f4a68151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.436+0000 7f4a67fff640 1 -- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a6815ce60 msgr2=0x7f4a68150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.436+0000 7f4a67fff640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a6815ce60 0x7f4a68150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.436+0000 7f4a67fff640 1 -- 172.21.15.44:0/2094091782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a60009b30 con 0x7f4a68160b10 2023-11-04T01:37:24.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.436+0000 7f4a677fe640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a680cf160 0x7f4a68151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:24.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.436+0000 7f4a66ffd640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a6815ce60 0x7f4a68150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:24.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.436+0000 7f4a67fff640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a68160b10 0x7f4a680c7c70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009e50 tx=0x7f4a60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.436+0000 7f4a4ffff640 1 -- 172.21.15.44:0/2094091782 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a60009510 con 0x7f4a68160b10 2023-11-04T01:37:24.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.436+0000 7f4a4ffff640 1 -- 172.21.15.44:0/2094091782 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6003e450 con 0x7f4a68160b10 2023-11-04T01:37:24.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.436+0000 7f4a6de34640 1 -- 172.21.15.44:0/2094091782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a680c8430 con 0x7f4a68160b10 2023-11-04T01:37:24.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.436+0000 7f4a4ffff640 1 -- 172.21.15.44:0/2094091782 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6003e800 con 0x7f4a68160b10 2023-11-04T01:37:24.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.436+0000 7f4a6de34640 1 -- 172.21.15.44:0/2094091782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a680c89f0 con 0x7f4a68160b10 2023-11-04T01:37:24.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.437+0000 7f4a6de34640 1 -- 172.21.15.44:0/2094091782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a680c91f0 con 0x7f4a68160b10 2023-11-04T01:37:24.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.438+0000 7f4a4ffff640 1 -- 172.21.15.44:0/2094091782 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4a6003e960 con 0x7f4a68160b10 2023-11-04T01:37:24.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.438+0000 7f4a4ffff640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4a5406aea0 0x7f4a5406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.438+0000 7f4a4ffff640 1 -- 172.21.15.44:0/2094091782 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4a600ac370 con 0x7f4a68160b10 2023-11-04T01:37:24.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.438+0000 7f4a677fe640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4a5406aea0 0x7f4a5406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.439+0000 7f4a677fe640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4a5406aea0 0x7f4a5406d360 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c000f60 tx=0x7f4a5c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.442+0000 7f4a4ffff640 1 -- 172.21.15.44:0/2094091782 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4a680c91f0 con 0x7f4a68160b10 2023-11-04T01:37:24.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.619+0000 7f4a6de34640 1 -- 172.21.15.44:0/2094091782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a680c91f0 con 0x7f4a68160b10 2023-11-04T01:37:24.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.620+0000 7f4a4ffff640 1 -- 172.21.15.44:0/2094091782 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16774 (secure 0 0 0) 0x7f4a680c91f0 con 0x7f4a68160b10 2023-11-04T01:37:24.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:24.622 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":39,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:22.948989+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:19.141183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:20.292111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:24.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.622+0000 7f4a6de34640 1 -- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4a5406aea0 msgr2=0x7f4a5406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.622+0000 7f4a6de34640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4a5406aea0 0x7f4a5406d360 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c000f60 tx=0x7f4a5c009040 comp rx=0 tx=0).stop 2023-11-04T01:37:24.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.622+0000 7f4a6de34640 1 -- 172.21.15.44:0/2094091782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a68160b10 msgr2=0x7f4a680c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.622+0000 7f4a6de34640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a68160b10 0x7f4a680c7c70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009e50 tx=0x7f4a60004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:24.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.622+0000 7f4a6de34640 1 -- 172.21.15.44:0/2094091782 shutdown_connections 2023-11-04T01:37:24.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.622+0000 7f4a6de34640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4a5406aea0 0x7f4a5406d360 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.622+0000 7f4a6de34640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a68160b10 0x7f4a680c7c70 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.622+0000 7f4a6de34640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a6815ce60 0x7f4a68150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.622+0000 7f4a6de34640 1 --2- 172.21.15.44:0/2094091782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a680cf160 0x7f4a68151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.622+0000 7f4a6de34640 1 -- 172.21.15.44:0/2094091782 >> 172.21.15.44:0/2094091782 conn(0x7f4a6806ea90 msgr2=0x7f4a680cca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.622+0000 7f4a6de34640 1 -- 172.21.15.44:0/2094091782 shutdown_connections 2023-11-04T01:37:24.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.622+0000 7f4a6de34640 1 -- 172.21.15.44:0/2094091782 wait complete. 2023-11-04T01:37:24.636 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:37:24.636 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:24.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.740+0000 7f9591a7c640 1 Processor -- start 2023-11-04T01:37:24.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.740+0000 7f9591a7c640 1 -- start start 2023-11-04T01:37:24.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.741+0000 7f9591a7c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f958c15ad80 0x7f958c0abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.741+0000 7f9591a7c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958c06b720 con 0x7f958c0c9a40 2023-11-04T01:37:24.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.741+0000 7f9591a7c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958c06cf60 con 0x7f958c06a1b0 2023-11-04T01:37:24.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.741+0000 7f9591a7c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f958c0ac390 con 0x7f958c15ad80 2023-11-04T01:37:24.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.741+0000 7f958bfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f958c0c9a40 0x7f958c06dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35202/0 (socket says 172.21.15.44:35202) 2023-11-04T01:37:24.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.741+0000 7f958bfff640 1 -- 172.21.15.44:0/1333701720 learned_addr learned my addr 172.21.15.44:0/1333701720 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:24.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.741+0000 7f958b7fe640 1 --2- 172.21.15.44:0/1333701720 >> v2:172.21.15.204:3300/0 conn(0x7f958c15ad80 0x7f958c0abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.741+0000 7f958a7fc640 1 -- 172.21.15.44:0/1333701720 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693513512 0 0) 0x7f958c06b720 con 0x7f958c0c9a40 2023-11-04T01:37:24.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.741+0000 7f958a7fc640 1 -- 172.21.15.44:0/1333701720 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9574003520 con 0x7f958c0c9a40 2023-11-04T01:37:24.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.742+0000 7f958a7fc640 1 -- 172.21.15.44:0/1333701720 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626425849 0 0) 0x7f958c06cf60 con 0x7f958c06a1b0 2023-11-04T01:37:24.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.742+0000 7f958a7fc640 1 -- 172.21.15.44:0/1333701720 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f958c06b720 con 0x7f958c06a1b0 2023-11-04T01:37:24.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.742+0000 7f958a7fc640 1 -- 172.21.15.44:0/1333701720 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2703699733 0 0) 0x7f9574003520 con 0x7f958c0c9a40 2023-11-04T01:37:24.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.742+0000 7f958b7fe640 1 -- 172.21.15.44:0/1333701720 >> v1:172.21.15.204:6789/0 conn(0x7f958c06a1b0 legacy=0x7f958c06b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.742+0000 7f958b7fe640 1 -- 172.21.15.44:0/1333701720 >> v1:172.21.15.44:6789/0 conn(0x7f958c0c9a40 legacy=0x7f958c06dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.742+0000 7f958b7fe640 1 -- 172.21.15.44:0/1333701720 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c15b160 con 0x7f958c15ad80 2023-11-04T01:37:24.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.742+0000 7f958b7fe640 1 --2- 172.21.15.44:0/1333701720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f958c15ad80 0x7f958c0abe50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f957c0097a0 tx=0x7f957c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dec741d25c50960 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.743+0000 7f958a7fc640 1 -- 172.21.15.44:0/1333701720 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c02f050 con 0x7f958c15ad80 2023-11-04T01:37:24.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.743+0000 7f958a7fc640 1 -- 172.21.15.44:0/1333701720 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c031500 con 0x7f958c15ad80 2023-11-04T01:37:24.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.743+0000 7f958a7fc640 1 -- 172.21.15.44:0/1333701720 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95840019f0 con 0x7f958c15ad80 2023-11-04T01:37:24.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.743+0000 7f9591a7c640 1 -- 172.21.15.44:0/1333701720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f958c15ad80 msgr2=0x7f958c0abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.743+0000 7f9591a7c640 1 --2- 172.21.15.44:0/1333701720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f958c15ad80 0x7f958c0abe50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f957c0097a0 tx=0x7f957c02b820 comp rx=0 tx=0).stop 2023-11-04T01:37:24.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.743+0000 7f9591a7c640 1 -- 172.21.15.44:0/1333701720 shutdown_connections 2023-11-04T01:37:24.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.743+0000 7f9591a7c640 1 --2- 172.21.15.44:0/1333701720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f958c15ad80 0x7f958c0abe50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.743+0000 7f9591a7c640 1 -- 172.21.15.44:0/1333701720 >> 172.21.15.44:0/1333701720 conn(0x7f958c0b0cd0 msgr2=0x7f958c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.743+0000 7f9591a7c640 1 -- 172.21.15.44:0/1333701720 shutdown_connections 2023-11-04T01:37:24.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.743+0000 7f9591a7c640 1 -- 172.21.15.44:0/1333701720 wait complete. 2023-11-04T01:37:24.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.744+0000 7f9591a7c640 1 Processor -- start 2023-11-04T01:37:24.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.745+0000 7f9591a7c640 1 -- start start 2023-11-04T01:37:24.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.745+0000 7f9591a7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f958c06a1b0 0x7f958c154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.745+0000 7f9591a7c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f958c0c9a40 0x7f958c0c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.745+0000 7f9591a7c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f958c15ad80 0x7f958c0c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.745+0000 7f9591a7c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c154c80 con 0x7f958c06a1b0 2023-11-04T01:37:24.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.745+0000 7f9591a7c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c0c3d60 con 0x7f958c15ad80 2023-11-04T01:37:24.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.745+0000 7f9591a7c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958c156a90 con 0x7f958c0c9a40 2023-11-04T01:37:24.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.745+0000 7f958b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f958c06a1b0 0x7f958c154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f958b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f958c06a1b0 0x7f958c154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41556/0 (socket says 172.21.15.44:41556) 2023-11-04T01:37:24.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f958b7fe640 1 -- 172.21.15.44:0/588830311 learned_addr learned my addr 172.21.15.44:0/588830311 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:24.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f958affd640 1 --2- 172.21.15.44:0/588830311 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f958c0c9a40 0x7f958c0c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f958bfff640 1 --2- 172.21.15.44:0/588830311 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f958c15ad80 0x7f958c0c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f958b7fe640 1 -- 172.21.15.44:0/588830311 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f958c0c9a40 msgr2=0x7f958c0c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f958b7fe640 1 --2- 172.21.15.44:0/588830311 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f958c0c9a40 0x7f958c0c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f958b7fe640 1 -- 172.21.15.44:0/588830311 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f958c15ad80 msgr2=0x7f958c0c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f958b7fe640 1 --2- 172.21.15.44:0/588830311 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f958c15ad80 0x7f958c0c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f958b7fe640 1 -- 172.21.15.44:0/588830311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c009400 con 0x7f958c06a1b0 2023-11-04T01:37:24.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f958bfff640 1 --2- 172.21.15.44:0/588830311 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f958c15ad80 0x7f958c0c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:24.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f958b7fe640 1 --2- 172.21.15.44:0/588830311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f958c06a1b0 0x7f958c154740 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f957c036040 tx=0x7f957c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f9573fff640 1 -- 172.21.15.44:0/588830311 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c03c8d0 con 0x7f958c06a1b0 2023-11-04T01:37:24.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f9573fff640 1 -- 172.21.15.44:0/588830311 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c03ca30 con 0x7f958c06a1b0 2023-11-04T01:37:24.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f9573fff640 1 -- 172.21.15.44:0/588830311 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c03cdc0 con 0x7f958c06a1b0 2023-11-04T01:37:24.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f9591a7c640 1 -- 172.21.15.44:0/588830311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958c0cd100 con 0x7f958c06a1b0 2023-11-04T01:37:24.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.746+0000 7f9591a7c640 1 -- 172.21.15.44:0/588830311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958c0cd6c0 con 0x7f958c06a1b0 2023-11-04T01:37:24.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.747+0000 7f9591a7c640 1 -- 172.21.15.44:0/588830311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958c074290 con 0x7f958c06a1b0 2023-11-04T01:37:24.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.748+0000 7f9573fff640 1 -- 172.21.15.44:0/588830311 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f957c03a040 con 0x7f958c06a1b0 2023-11-04T01:37:24.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.748+0000 7f9573fff640 1 --2- 172.21.15.44:0/588830311 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f957806aea0 0x7f957806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.748+0000 7f9573fff640 1 -- 172.21.15.44:0/588830311 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f957c0aaf70 con 0x7f958c06a1b0 2023-11-04T01:37:24.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.749+0000 7f958affd640 1 --2- 172.21.15.44:0/588830311 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f957806aea0 0x7f957806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.749+0000 7f958affd640 1 --2- 172.21.15.44:0/588830311 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f957806aea0 0x7f957806d360 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f95800010e0 tx=0x7f9580009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.752+0000 7f9573fff640 1 -- 172.21.15.44:0/588830311 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f957c075f60 con 0x7f958c06a1b0 2023-11-04T01:37:24.924 INFO:tasks.ceph.mds.c.smithi044.stderr:2023-11-04T01:37:24.922+0000 7f8e4d5c8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:37:24.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.925+0000 7f9591a7c640 1 -- 172.21.15.44:0/588830311 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f958c06d200 con 0x7f957806aea0 2023-11-04T01:37:24.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.933+0000 7f9573fff640 1 -- 172.21.15.44:0/588830311 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284390 (secure 0 0 0) 0x7f958000d440 con 0x7f957806aea0 2023-11-04T01:37:24.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:24.941 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:37:24.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.936+0000 7f9591a7c640 1 -- 172.21.15.44:0/588830311 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f957806aea0 msgr2=0x7f957806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.936+0000 7f9591a7c640 1 --2- 172.21.15.44:0/588830311 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f957806aea0 0x7f957806d360 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f95800010e0 tx=0x7f9580009040 comp rx=0 tx=0).stop 2023-11-04T01:37:24.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.936+0000 7f9591a7c640 1 -- 172.21.15.44:0/588830311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f958c06a1b0 msgr2=0x7f958c154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.936+0000 7f9591a7c640 1 --2- 172.21.15.44:0/588830311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f958c06a1b0 0x7f958c154740 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f957c036040 tx=0x7f957c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.936+0000 7f9591a7c640 1 -- 172.21.15.44:0/588830311 shutdown_connections 2023-11-04T01:37:24.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.936+0000 7f9591a7c640 1 --2- 172.21.15.44:0/588830311 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f957806aea0 0x7f957806d360 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.936+0000 7f9591a7c640 1 --2- 172.21.15.44:0/588830311 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f958c15ad80 0x7f958c0c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.936+0000 7f9591a7c640 1 --2- 172.21.15.44:0/588830311 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f958c0c9a40 0x7f958c0c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.936+0000 7f9591a7c640 1 --2- 172.21.15.44:0/588830311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f958c06a1b0 0x7f958c154740 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.936+0000 7f9591a7c640 1 -- 172.21.15.44:0/588830311 >> 172.21.15.44:0/588830311 conn(0x7f958c0b0cd0 msgr2=0x7f958c0ad1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.936+0000 7f9591a7c640 1 -- 172.21.15.44:0/588830311 shutdown_connections 2023-11-04T01:37:24.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:24.936+0000 7f9591a7c640 1 -- 172.21.15.44:0/588830311 wait complete. 2023-11-04T01:37:24.949 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-11-04T01:37:24.593945+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220600,"kb_used_data":4436,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754120,"statfs":{"total":773094113280,"available":772868218880,"internally_reserved":0,"allocated":4542464,"data_stored":2596633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.661295"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950338+0000","last_change":"2023-11-04T01:37:20.950338+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950338+0000","last_undegraded":"2023-11-04T01:37:20.950338+0000","last_fullsized":"2023-11-04T01:37:20.950338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949625+0000","last_change":"2023-11-04T01:37:20.949625+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949625+0000","last_undegraded":"2023-11-04T01:37:20.949625+0000","last_fullsized":"2023-11-04T01:37:20.949625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951782+0000","last_change":"2023-11-04T01:37:20.951782+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951782+0000","last_undegraded":"2023-11-04T01:37:20.951782+0000","last_fullsized":"2023-11-04T01:37:20.951782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.947525+0000","last_change":"2023-11-04T01:37:20.947525+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.947525+0000","last_undegraded":"2023-11-04T01:37:20.947525+0000","last_fullsized":"2023-11-04T01:37:20.947525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945719+0000","last_change":"2023-11-04T01:37:20.945719+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945719+0000","last_undegraded":"2023-11-04T01:37:20.945719+0000","last_fullsized":"2023-11-04T01:37:20.945719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951017+0000","last_change":"2023-11-04T01:37:20.951017+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951017+0000","last_undegraded":"2023-11-04T01:37:20.951017+0000","last_fullsized":"2023-11-04T01:37:20.951017+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944094+0000","last_change":"2023-11-04T01:37:20.944094+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944094+0000","last_undegraded":"2023-11-04T01:37:20.944094+0000","last_fullsized":"2023-11-04T01:37:20.944094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948816+0000","last_change":"2023-11-04T01:37:20.948816+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948816+0000","last_undegraded":"2023-11-04T01:37:20.948816+0000","last_fullsized":"2023-11-04T01:37:20.948816+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951314+0000","last_change":"2023-11-04T01:37:20.951314+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951314+0000","last_undegraded":"2023-11-04T01:37:20.951314+0000","last_fullsized":"2023-11-04T01:37:20.951314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944249+0000","last_change":"2023-11-04T01:37:20.944249+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944249+0000","last_undegraded":"2023-11-04T01:37:20.944249+0000","last_fullsized":"2023-11-04T01:37:20.944249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944749+0000","last_change":"2023-11-04T01:37:20.944749+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944749+0000","last_undegraded":"2023-11-04T01:37:20.944749+0000","last_fullsized":"2023-11-04T01:37:20.944749+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950616+0000","last_change":"2023-11-04T01:37:20.950616+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950616+0000","last_undegraded":"2023-11-04T01:37:20.950616+0000","last_fullsized":"2023-11-04T01:37:20.950616+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944595+0000","last_change":"2023-11-04T01:37:20.944595+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944595+0000","last_undegraded":"2023-11-04T01:37:20.944595+0000","last_fullsized":"2023-11-04T01:37:20.944595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940641+0000","last_change":"2023-11-04T01:37:20.940641+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940641+0000","last_undegraded":"2023-11-04T01:37:20.940641+0000","last_fullsized":"2023-11-04T01:37:20.940641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943560+0000","last_change":"2023-11-04T01:37:20.943560+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943560+0000","last_undegraded":"2023-11-04T01:37:20.943560+0000","last_fullsized":"2023-11-04T01:37:20.943560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950363+0000","last_change":"2023-11-04T01:37:20.950363+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950363+0000","last_undegraded":"2023-11-04T01:37:20.950363+0000","last_fullsized":"2023-11-04T01:37:20.950363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950695+0000","last_change":"2023-11-04T01:37:20.950695+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950695+0000","last_undegraded":"2023-11-04T01:37:20.950695+0000","last_fullsized":"2023-11-04T01:37:20.950695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.942081+0000","last_change":"2023-11-04T01:37:20.942081+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.942081+0000","last_undegraded":"2023-11-04T01:37:20.942081+0000","last_fullsized":"2023-11-04T01:37:20.942081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945020+0000","last_change":"2023-11-04T01:37:20.945020+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945020+0000","last_undegraded":"2023-11-04T01:37:20.945020+0000","last_fullsized":"2023-11-04T01:37:20.945020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941840+0000","last_change":"2023-11-04T01:37:20.941840+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941840+0000","last_undegraded":"2023-11-04T01:37:20.941840+0000","last_fullsized":"2023-11-04T01:37:20.941840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943634+0000","last_change":"2023-11-04T01:37:20.943634+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943634+0000","last_undegraded":"2023-11-04T01:37:20.943634+0000","last_fullsized":"2023-11-04T01:37:20.943634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.939369+0000","last_change":"2023-11-04T01:37:20.939369+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.939369+0000","last_undegraded":"2023-11-04T01:37:20.939369+0000","last_fullsized":"2023-11-04T01:37:20.939369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950275+0000","last_change":"2023-11-04T01:37:20.950275+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950275+0000","last_undegraded":"2023-11-04T01:37:20.950275+0000","last_fullsized":"2023-11-04T01:37:20.950275+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943717+0000","last_change":"2023-11-04T01:37:20.943717+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943717+0000","last_undegraded":"2023-11-04T01:37:20.943717+0000","last_fullsized":"2023-11-04T01:37:20.943717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.942243+0000","last_change":"2023-11-04T01:37:20.942243+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.942243+0000","last_undegraded":"2023-11-04T01:37:20.942243+0000","last_fullsized":"2023-11-04T01:37:20.942243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950535+0000","last_change":"2023-11-04T01:37:20.950535+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950535+0000","last_undegraded":"2023-11-04T01:37:20.950535+0000","last_fullsized":"2023-11-04T01:37:20.950535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941482+0000","last_change":"2023-11-04T01:37:20.941482+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941482+0000","last_undegraded":"2023-11-04T01:37:20.941482+0000","last_fullsized":"2023-11-04T01:37:20.941482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944621+0000","last_change":"2023-11-04T01:37:20.944621+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944621+0000","last_undegraded":"2023-11-04T01:37:20.944621+0000","last_fullsized":"2023-11-04T01:37:20.944621+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941356+0000","last_change":"2023-11-04T01:37:20.941356+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941356+0000","last_undegraded":"2023-11-04T01:37:20.941356+0000","last_fullsized":"2023-11-04T01:37:20.941356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941238+0000","last_change":"2023-11-04T01:37:20.941238+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941238+0000","last_undegraded":"2023-11-04T01:37:20.941238+0000","last_fullsized":"2023-11-04T01:37:20.941238+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949361+0000","last_change":"2023-11-04T01:37:20.949361+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949361+0000","last_undegraded":"2023-11-04T01:37:20.949361+0000","last_fullsized":"2023-11-04T01:37:20.949361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948497+0000","last_change":"2023-11-04T01:37:20.948497+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948497+0000","last_undegraded":"2023-11-04T01:37:20.948497+0000","last_fullsized":"2023-11-04T01:37:20.948497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950780+0000","last_change":"2023-11-04T01:37:20.950780+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950780+0000","last_undegraded":"2023-11-04T01:37:20.950780+0000","last_fullsized":"2023-11-04T01:37:20.950780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.951671+0000","last_change":"2023-11-04T01:37:20.948850+0000","last_active":"2023-11-04T01:37:20.951671+0000","last_peered":"2023-11-04T01:37:20.951671+0000","last_clean":"2023-11-04T01:37:20.951671+0000","last_became_active":"2023-11-04T01:37:20.948589+0000","last_became_peered":"2023-11-04T01:37:20.948589+0000","last_unstale":"2023-11-04T01:37:20.951671+0000","last_undegraded":"2023-11-04T01:37:20.951671+0000","last_fullsized":"2023-11-04T01:37:20.951671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:15:44.156052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946971+0000","last_change":"2023-11-04T01:37:20.946971+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946971+0000","last_undegraded":"2023-11-04T01:37:20.946971+0000","last_fullsized":"2023-11-04T01:37:20.946971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959410+0000","last_change":"2023-11-04T01:37:20.957554+0000","last_active":"2023-11-04T01:37:20.959410+0000","last_peered":"2023-11-04T01:37:20.959410+0000","last_clean":"2023-11-04T01:37:20.959410+0000","last_became_active":"2023-11-04T01:37:20.957283+0000","last_became_peered":"2023-11-04T01:37:20.957283+0000","last_unstale":"2023-11-04T01:37:20.959410+0000","last_undegraded":"2023-11-04T01:37:20.959410+0000","last_fullsized":"2023-11-04T01:37:20.959410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:18.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.939649+0000","last_change":"2023-11-04T01:37:20.939649+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.939649+0000","last_undegraded":"2023-11-04T01:37:20.939649+0000","last_fullsized":"2023-11-04T01:37:20.939649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953317+0000","last_change":"2023-11-04T01:37:20.951123+0000","last_active":"2023-11-04T01:37:20.953317+0000","last_peered":"2023-11-04T01:37:20.953317+0000","last_clean":"2023-11-04T01:37:20.953317+0000","last_became_active":"2023-11-04T01:37:20.950796+0000","last_became_peered":"2023-11-04T01:37:20.950796+0000","last_unstale":"2023-11-04T01:37:20.953317+0000","last_undegraded":"2023-11-04T01:37:20.953317+0000","last_fullsized":"2023-11-04T01:37:20.953317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:20:25.874532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948800+0000","last_change":"2023-11-04T01:37:20.948800+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948800+0000","last_undegraded":"2023-11-04T01:37:20.948800+0000","last_fullsized":"2023-11-04T01:37:20.948800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.947315+0000","last_change":"2023-11-04T01:37:20.946610+0000","last_active":"2023-11-04T01:37:20.947315+0000","last_peered":"2023-11-04T01:37:20.947315+0000","last_clean":"2023-11-04T01:37:20.947315+0000","last_became_active":"2023-11-04T01:37:20.946320+0000","last_became_peered":"2023-11-04T01:37:20.946320+0000","last_unstale":"2023-11-04T01:37:20.947315+0000","last_undegraded":"2023-11-04T01:37:20.947315+0000","last_fullsized":"2023-11-04T01:37:20.947315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:15:44.156052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950057+0000","last_change":"2023-11-04T01:37:20.950057+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950057+0000","last_undegraded":"2023-11-04T01:37:20.950057+0000","last_fullsized":"2023-11-04T01:37:20.950057+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962206+0000","last_change":"2023-11-04T01:37:20.958166+0000","last_active":"2023-11-04T01:37:20.962206+0000","last_peered":"2023-11-04T01:37:20.962206+0000","last_clean":"2023-11-04T01:37:20.962206+0000","last_became_active":"2023-11-04T01:37:20.957832+0000","last_became_peered":"2023-11-04T01:37:20.957832+0000","last_unstale":"2023-11-04T01:37:20.962206+0000","last_undegraded":"2023-11-04T01:37:20.962206+0000","last_fullsized":"2023-11-04T01:37:20.962206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:55.724864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943131+0000","last_change":"2023-11-04T01:37:20.943131+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943131+0000","last_undegraded":"2023-11-04T01:37:20.943131+0000","last_fullsized":"2023-11-04T01:37:20.943131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962277+0000","last_change":"2023-11-04T01:37:20.958018+0000","last_active":"2023-11-04T01:37:20.962277+0000","last_peered":"2023-11-04T01:37:20.962277+0000","last_clean":"2023-11-04T01:37:20.962277+0000","last_became_active":"2023-11-04T01:37:20.957734+0000","last_became_peered":"2023-11-04T01:37:20.957734+0000","last_unstale":"2023-11-04T01:37:20.962277+0000","last_undegraded":"2023-11-04T01:37:20.962277+0000","last_fullsized":"2023-11-04T01:37:20.962277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:25.355203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.939903+0000","last_change":"2023-11-04T01:37:20.939903+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.939903+0000","last_undegraded":"2023-11-04T01:37:20.939903+0000","last_fullsized":"2023-11-04T01:37:20.939903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953179+0000","last_change":"2023-11-04T01:37:20.951909+0000","last_active":"2023-11-04T01:37:20.953179+0000","last_peered":"2023-11-04T01:37:20.953179+0000","last_clean":"2023-11-04T01:37:20.953179+0000","last_became_active":"2023-11-04T01:37:20.951595+0000","last_became_peered":"2023-11-04T01:37:20.951595+0000","last_unstale":"2023-11-04T01:37:20.953179+0000","last_undegraded":"2023-11-04T01:37:20.953179+0000","last_fullsized":"2023-11-04T01:37:20.953179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:25.355203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948012+0000","last_change":"2023-11-04T01:37:20.948012+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948012+0000","last_undegraded":"2023-11-04T01:37:20.948012+0000","last_fullsized":"2023-11-04T01:37:20.948012+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.950590+0000","last_change":"2023-11-04T01:37:20.948666+0000","last_active":"2023-11-04T01:37:20.950590+0000","last_peered":"2023-11-04T01:37:20.950590+0000","last_clean":"2023-11-04T01:37:20.950590+0000","last_became_active":"2023-11-04T01:37:20.948379+0000","last_became_peered":"2023-11-04T01:37:20.948379+0000","last_unstale":"2023-11-04T01:37:20.950590+0000","last_undegraded":"2023-11-04T01:37:20.950590+0000","last_fullsized":"2023-11-04T01:37:20.950590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:00.482538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944553+0000","last_change":"2023-11-04T01:37:20.944553+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944553+0000","last_undegraded":"2023-11-04T01:37:20.944553+0000","last_fullsized":"2023-11-04T01:37:20.944553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959272+0000","last_change":"2023-11-04T01:37:20.951039+0000","last_active":"2023-11-04T01:37:20.959272+0000","last_peered":"2023-11-04T01:37:20.959272+0000","last_clean":"2023-11-04T01:37:20.959272+0000","last_became_active":"2023-11-04T01:37:20.950768+0000","last_became_peered":"2023-11-04T01:37:20.950768+0000","last_unstale":"2023-11-04T01:37:20.959272+0000","last_undegraded":"2023-11-04T01:37:20.959272+0000","last_fullsized":"2023-11-04T01:37:20.959272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:42.847107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951525+0000","last_change":"2023-11-04T01:37:20.951525+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951525+0000","last_undegraded":"2023-11-04T01:37:20.951525+0000","last_fullsized":"2023-11-04T01:37:20.951525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957314+0000","last_change":"2023-11-04T01:37:20.953603+0000","last_active":"2023-11-04T01:37:20.957314+0000","last_peered":"2023-11-04T01:37:20.957314+0000","last_clean":"2023-11-04T01:37:20.957314+0000","last_became_active":"2023-11-04T01:37:20.953355+0000","last_became_peered":"2023-11-04T01:37:20.953355+0000","last_unstale":"2023-11-04T01:37:20.957314+0000","last_undegraded":"2023-11-04T01:37:20.957314+0000","last_fullsized":"2023-11-04T01:37:20.957314+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:42.847107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950439+0000","last_change":"2023-11-04T01:37:20.950439+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950439+0000","last_undegraded":"2023-11-04T01:37:20.950439+0000","last_fullsized":"2023-11-04T01:37:20.950439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957274+0000","last_change":"2023-11-04T01:37:20.951932+0000","last_active":"2023-11-04T01:37:20.957274+0000","last_peered":"2023-11-04T01:37:20.957274+0000","last_clean":"2023-11-04T01:37:20.957274+0000","last_became_active":"2023-11-04T01:37:20.951672+0000","last_became_peered":"2023-11-04T01:37:20.951672+0000","last_unstale":"2023-11-04T01:37:20.957274+0000","last_undegraded":"2023-11-04T01:37:20.957274+0000","last_fullsized":"2023-11-04T01:37:20.957274+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:18.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940748+0000","last_change":"2023-11-04T01:37:20.940748+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940748+0000","last_undegraded":"2023-11-04T01:37:20.940748+0000","last_fullsized":"2023-11-04T01:37:20.940748+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959474+0000","last_change":"2023-11-04T01:37:20.957547+0000","last_active":"2023-11-04T01:37:20.959474+0000","last_peered":"2023-11-04T01:37:20.959474+0000","last_clean":"2023-11-04T01:37:20.959474+0000","last_became_active":"2023-11-04T01:37:20.957264+0000","last_became_peered":"2023-11-04T01:37:20.957264+0000","last_unstale":"2023-11-04T01:37:20.959474+0000","last_undegraded":"2023-11-04T01:37:20.959474+0000","last_fullsized":"2023-11-04T01:37:20.959474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:57:28.939429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949170+0000","last_change":"2023-11-04T01:37:20.949170+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949170+0000","last_undegraded":"2023-11-04T01:37:20.949170+0000","last_fullsized":"2023-11-04T01:37:20.949170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959449+0000","last_change":"2023-11-04T01:37:20.957462+0000","last_active":"2023-11-04T01:37:20.959449+0000","last_peered":"2023-11-04T01:37:20.959449+0000","last_clean":"2023-11-04T01:37:20.959449+0000","last_became_active":"2023-11-04T01:37:20.957172+0000","last_became_peered":"2023-11-04T01:37:20.957172+0000","last_unstale":"2023-11-04T01:37:20.959449+0000","last_undegraded":"2023-11-04T01:37:20.959449+0000","last_fullsized":"2023-11-04T01:37:20.959449+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:03.376922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946705+0000","last_change":"2023-11-04T01:37:20.946705+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946705+0000","last_undegraded":"2023-11-04T01:37:20.946705+0000","last_fullsized":"2023-11-04T01:37:20.946705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953259+0000","last_change":"2023-11-04T01:37:20.951880+0000","last_active":"2023-11-04T01:37:20.953259+0000","last_peered":"2023-11-04T01:37:20.953259+0000","last_clean":"2023-11-04T01:37:20.953259+0000","last_became_active":"2023-11-04T01:37:20.951551+0000","last_became_peered":"2023-11-04T01:37:20.951551+0000","last_unstale":"2023-11-04T01:37:20.953259+0000","last_undegraded":"2023-11-04T01:37:20.953259+0000","last_fullsized":"2023-11-04T01:37:20.953259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949390+0000","last_change":"2023-11-04T01:37:20.949390+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949390+0000","last_undegraded":"2023-11-04T01:37:20.949390+0000","last_fullsized":"2023-11-04T01:37:20.949390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.950729+0000","last_change":"2023-11-04T01:37:20.946684+0000","last_active":"2023-11-04T01:37:20.950729+0000","last_peered":"2023-11-04T01:37:20.950729+0000","last_clean":"2023-11-04T01:37:20.950729+0000","last_became_active":"2023-11-04T01:37:20.946206+0000","last_became_peered":"2023-11-04T01:37:20.946206+0000","last_unstale":"2023-11-04T01:37:20.950729+0000","last_undegraded":"2023-11-04T01:37:20.950729+0000","last_fullsized":"2023-11-04T01:37:20.950729+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:13:11.543891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946949+0000","last_change":"2023-11-04T01:37:20.946949+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946949+0000","last_undegraded":"2023-11-04T01:37:20.946949+0000","last_fullsized":"2023-11-04T01:37:20.946949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962618+0000","last_change":"2023-11-04T01:37:20.960179+0000","last_active":"2023-11-04T01:37:20.962618+0000","last_peered":"2023-11-04T01:37:20.962618+0000","last_clean":"2023-11-04T01:37:20.962618+0000","last_became_active":"2023-11-04T01:37:20.959900+0000","last_became_peered":"2023-11-04T01:37:20.959900+0000","last_unstale":"2023-11-04T01:37:20.962618+0000","last_undegraded":"2023-11-04T01:37:20.962618+0000","last_fullsized":"2023-11-04T01:37:20.962618+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:20:25.874532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946705+0000","last_change":"2023-11-04T01:37:20.946705+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946705+0000","last_undegraded":"2023-11-04T01:37:20.946705+0000","last_fullsized":"2023-11-04T01:37:20.946705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.951304+0000","last_change":"2023-11-04T01:37:20.947847+0000","last_active":"2023-11-04T01:37:20.951304+0000","last_peered":"2023-11-04T01:37:20.951304+0000","last_clean":"2023-11-04T01:37:20.951304+0000","last_became_active":"2023-11-04T01:37:20.947565+0000","last_became_peered":"2023-11-04T01:37:20.947565+0000","last_unstale":"2023-11-04T01:37:20.951304+0000","last_undegraded":"2023-11-04T01:37:20.951304+0000","last_fullsized":"2023-11-04T01:37:20.951304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:51.912669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943416+0000","last_change":"2023-11-04T01:37:20.943416+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943416+0000","last_undegraded":"2023-11-04T01:37:20.943416+0000","last_fullsized":"2023-11-04T01:37:20.943416+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.954457+0000","last_change":"2023-11-04T01:37:20.950827+0000","last_active":"2023-11-04T01:37:20.954457+0000","last_peered":"2023-11-04T01:37:20.954457+0000","last_clean":"2023-11-04T01:37:20.954457+0000","last_became_active":"2023-11-04T01:37:20.950575+0000","last_became_peered":"2023-11-04T01:37:20.950575+0000","last_unstale":"2023-11-04T01:37:20.954457+0000","last_undegraded":"2023-11-04T01:37:20.954457+0000","last_fullsized":"2023-11-04T01:37:20.954457+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:20:01.127723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940112+0000","last_change":"2023-11-04T01:37:20.940112+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940112+0000","last_undegraded":"2023-11-04T01:37:20.940112+0000","last_fullsized":"2023-11-04T01:37:20.940112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.960190+0000","last_change":"2023-11-04T01:37:20.959217+0000","last_active":"2023-11-04T01:37:20.960190+0000","last_peered":"2023-11-04T01:37:20.960190+0000","last_clean":"2023-11-04T01:37:20.960190+0000","last_became_active":"2023-11-04T01:37:20.958336+0000","last_became_peered":"2023-11-04T01:37:20.958336+0000","last_unstale":"2023-11-04T01:37:20.960190+0000","last_undegraded":"2023-11-04T01:37:20.960190+0000","last_fullsized":"2023-11-04T01:37:20.960190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:03:48.533243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944682+0000","last_change":"2023-11-04T01:37:20.944682+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944682+0000","last_undegraded":"2023-11-04T01:37:20.944682+0000","last_fullsized":"2023-11-04T01:37:20.944682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953210+0000","last_change":"2023-11-04T01:37:20.950464+0000","last_active":"2023-11-04T01:37:20.953210+0000","last_peered":"2023-11-04T01:37:20.953210+0000","last_clean":"2023-11-04T01:37:20.953210+0000","last_became_active":"2023-11-04T01:37:20.950133+0000","last_became_peered":"2023-11-04T01:37:20.950133+0000","last_unstale":"2023-11-04T01:37:20.953210+0000","last_undegraded":"2023-11-04T01:37:20.953210+0000","last_fullsized":"2023-11-04T01:37:20.953210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:44.200233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949983+0000","last_change":"2023-11-04T01:37:20.949983+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949983+0000","last_undegraded":"2023-11-04T01:37:20.949983+0000","last_fullsized":"2023-11-04T01:37:20.949983+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.958220+0000","last_change":"2023-11-04T01:37:20.955294+0000","last_active":"2023-11-04T01:37:20.958220+0000","last_peered":"2023-11-04T01:37:20.958220+0000","last_clean":"2023-11-04T01:37:20.958220+0000","last_became_active":"2023-11-04T01:37:20.955019+0000","last_became_peered":"2023-11-04T01:37:20.955019+0000","last_unstale":"2023-11-04T01:37:20.958220+0000","last_undegraded":"2023-11-04T01:37:20.958220+0000","last_fullsized":"2023-11-04T01:37:20.958220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:53.772500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.947499+0000","last_change":"2023-11-04T01:37:20.947499+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.947499+0000","last_undegraded":"2023-11-04T01:37:20.947499+0000","last_fullsized":"2023-11-04T01:37:20.947499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.956263+0000","last_change":"2023-11-04T01:37:20.952410+0000","last_active":"2023-11-04T01:37:20.956263+0000","last_peered":"2023-11-04T01:37:20.956263+0000","last_clean":"2023-11-04T01:37:20.956263+0000","last_became_active":"2023-11-04T01:37:20.952143+0000","last_became_peered":"2023-11-04T01:37:20.952143+0000","last_unstale":"2023-11-04T01:37:20.956263+0000","last_undegraded":"2023-11-04T01:37:20.956263+0000","last_fullsized":"2023-11-04T01:37:20.956263+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:05:40.366579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.942494+0000","last_change":"2023-11-04T01:37:20.942494+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.942494+0000","last_undegraded":"2023-11-04T01:37:20.942494+0000","last_fullsized":"2023-11-04T01:37:20.942494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962232+0000","last_change":"2023-11-04T01:37:20.957857+0000","last_active":"2023-11-04T01:37:20.962232+0000","last_peered":"2023-11-04T01:37:20.962232+0000","last_clean":"2023-11-04T01:37:20.962232+0000","last_became_active":"2023-11-04T01:37:20.957415+0000","last_became_peered":"2023-11-04T01:37:20.957415+0000","last_unstale":"2023-11-04T01:37:20.962232+0000","last_undegraded":"2023-11-04T01:37:20.962232+0000","last_fullsized":"2023-11-04T01:37:20.962232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:55.724864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946189+0000","last_change":"2023-11-04T01:37:20.946189+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946189+0000","last_undegraded":"2023-11-04T01:37:20.946189+0000","last_fullsized":"2023-11-04T01:37:20.946189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.960780+0000","last_change":"2023-11-04T01:37:20.958969+0000","last_active":"2023-11-04T01:37:20.960780+0000","last_peered":"2023-11-04T01:37:20.960780+0000","last_clean":"2023-11-04T01:37:20.960780+0000","last_became_active":"2023-11-04T01:37:20.958656+0000","last_became_peered":"2023-11-04T01:37:20.958656+0000","last_unstale":"2023-11-04T01:37:20.960780+0000","last_undegraded":"2023-11-04T01:37:20.960780+0000","last_fullsized":"2023-11-04T01:37:20.960780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:59:20.169775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946503+0000","last_change":"2023-11-04T01:37:20.946503+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946503+0000","last_undegraded":"2023-11-04T01:37:20.946503+0000","last_fullsized":"2023-11-04T01:37:20.946503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.956572+0000","last_change":"2023-11-04T01:37:20.951195+0000","last_active":"2023-11-04T01:37:20.956572+0000","last_peered":"2023-11-04T01:37:20.956572+0000","last_clean":"2023-11-04T01:37:20.956572+0000","last_became_active":"2023-11-04T01:37:20.950916+0000","last_became_peered":"2023-11-04T01:37:20.950916+0000","last_unstale":"2023-11-04T01:37:20.956572+0000","last_undegraded":"2023-11-04T01:37:20.956572+0000","last_fullsized":"2023-11-04T01:37:20.956572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951134+0000","last_change":"2023-11-04T01:37:20.951134+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951134+0000","last_undegraded":"2023-11-04T01:37:20.951134+0000","last_fullsized":"2023-11-04T01:37:20.951134+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957912+0000","last_change":"2023-11-04T01:37:20.954111+0000","last_active":"2023-11-04T01:37:20.957912+0000","last_peered":"2023-11-04T01:37:20.957912+0000","last_clean":"2023-11-04T01:37:20.957912+0000","last_became_active":"2023-11-04T01:37:20.953851+0000","last_became_peered":"2023-11-04T01:37:20.953851+0000","last_unstale":"2023-11-04T01:37:20.957912+0000","last_undegraded":"2023-11-04T01:37:20.957912+0000","last_fullsized":"2023-11-04T01:37:20.957912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:31.988502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945193+0000","last_change":"2023-11-04T01:37:20.945193+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945193+0000","last_undegraded":"2023-11-04T01:37:20.945193+0000","last_fullsized":"2023-11-04T01:37:20.945193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.960305+0000","last_change":"2023-11-04T01:37:20.958189+0000","last_active":"2023-11-04T01:37:20.960305+0000","last_peered":"2023-11-04T01:37:20.960305+0000","last_clean":"2023-11-04T01:37:20.960305+0000","last_became_active":"2023-11-04T01:37:20.957903+0000","last_became_peered":"2023-11-04T01:37:20.957903+0000","last_unstale":"2023-11-04T01:37:20.960305+0000","last_undegraded":"2023-11-04T01:37:20.960305+0000","last_fullsized":"2023-11-04T01:37:20.960305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948680+0000","last_change":"2023-11-04T01:37:20.948680+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948680+0000","last_undegraded":"2023-11-04T01:37:20.948680+0000","last_fullsized":"2023-11-04T01:37:20.948680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959762+0000","last_change":"2023-11-04T01:37:20.957300+0000","last_active":"2023-11-04T01:37:20.959762+0000","last_peered":"2023-11-04T01:37:20.959762+0000","last_clean":"2023-11-04T01:37:20.959762+0000","last_became_active":"2023-11-04T01:37:20.957035+0000","last_became_peered":"2023-11-04T01:37:20.957035+0000","last_unstale":"2023-11-04T01:37:20.959762+0000","last_undegraded":"2023-11-04T01:37:20.959762+0000","last_fullsized":"2023-11-04T01:37:20.959762+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:55.724864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945994+0000","last_change":"2023-11-04T01:37:20.945994+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945994+0000","last_undegraded":"2023-11-04T01:37:20.945994+0000","last_fullsized":"2023-11-04T01:37:20.945994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957141+0000","last_change":"2023-11-04T01:37:20.955263+0000","last_active":"2023-11-04T01:37:20.957141+0000","last_peered":"2023-11-04T01:37:20.957141+0000","last_clean":"2023-11-04T01:37:20.957141+0000","last_became_active":"2023-11-04T01:37:20.955015+0000","last_became_peered":"2023-11-04T01:37:20.955015+0000","last_unstale":"2023-11-04T01:37:20.957141+0000","last_undegraded":"2023-11-04T01:37:20.957141+0000","last_fullsized":"2023-11-04T01:37:20.957141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:00.482538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940263+0000","last_change":"2023-11-04T01:37:20.940263+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940263+0000","last_undegraded":"2023-11-04T01:37:20.940263+0000","last_fullsized":"2023-11-04T01:37:20.940263+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.945648+0000","last_change":"2023-11-04T01:37:20.944425+0000","last_active":"2023-11-04T01:37:20.945648+0000","last_peered":"2023-11-04T01:37:20.945648+0000","last_clean":"2023-11-04T01:37:20.945648+0000","last_became_active":"2023-11-04T01:37:20.944147+0000","last_became_peered":"2023-11-04T01:37:20.944147+0000","last_unstale":"2023-11-04T01:37:20.945648+0000","last_undegraded":"2023-11-04T01:37:20.945648+0000","last_fullsized":"2023-11-04T01:37:20.945648+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:13:11.543891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949823+0000","last_change":"2023-11-04T01:37:20.949823+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949823+0000","last_undegraded":"2023-11-04T01:37:20.949823+0000","last_fullsized":"2023-11-04T01:37:20.949823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959712+0000","last_change":"2023-11-04T01:37:20.953474+0000","last_active":"2023-11-04T01:37:20.959712+0000","last_peered":"2023-11-04T01:37:20.959712+0000","last_clean":"2023-11-04T01:37:20.959712+0000","last_became_active":"2023-11-04T01:37:20.953215+0000","last_became_peered":"2023-11-04T01:37:20.953215+0000","last_unstale":"2023-11-04T01:37:20.959712+0000","last_undegraded":"2023-11-04T01:37:20.959712+0000","last_fullsized":"2023-11-04T01:37:20.959712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:49.592008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943316+0000","last_change":"2023-11-04T01:37:20.943316+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943316+0000","last_undegraded":"2023-11-04T01:37:20.943316+0000","last_fullsized":"2023-11-04T01:37:20.943316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962376+0000","last_change":"2023-11-04T01:37:20.958978+0000","last_active":"2023-11-04T01:37:20.962376+0000","last_peered":"2023-11-04T01:37:20.962376+0000","last_clean":"2023-11-04T01:37:20.962376+0000","last_became_active":"2023-11-04T01:37:20.958778+0000","last_became_peered":"2023-11-04T01:37:20.958778+0000","last_unstale":"2023-11-04T01:37:20.962376+0000","last_undegraded":"2023-11-04T01:37:20.962376+0000","last_fullsized":"2023-11-04T01:37:20.962376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-04T01:37:19.935331+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:37:19.935331+0000","last_peered":"2023-11-04T01:37:19.935331+0000","last_clean":"2023-11-04T01:37:19.935331+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:37:19.935331+0000","last_undegraded":"2023-11-04T01:37:19.935331+0000","last_fullsized":"2023-11-04T01:37:19.935331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":770780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.42099999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.55300000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.64500000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.68999999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.503},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.72499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58299999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.40500000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.499}]},{"osd":3,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56899999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.39300000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.35399999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52300000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60799999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.32600000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.41699999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.438}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.53900000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.504}]},{"osd":2,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.64700000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.747}]},{"osd":7,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.628},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.76000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.314},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.26200000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.377}]},{"osd":4,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.53000000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46000000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.44600000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.57599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.247},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.27500000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.312},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.34100000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.37},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.41099999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.625},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.58099999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.224},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.32800000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.30399999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.25800000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.434}]},{"osd":5,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.41299999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.42499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1003520,"data_stored":763166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.40100000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.432}]},{"osd":3,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.38},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.754}]},{"osd":5,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76200000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:24.957 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:25.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.094+0000 7fefe1733640 1 Processor -- start 2023-11-04T01:37:25.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.094+0000 7fefe1733640 1 -- start start 2023-11-04T01:37:25.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.095+0000 7fefe1733640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefdc0b0ae0 0x7fefdc0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.095+0000 7fefe1733640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fefdc06db20 0x7fefdc15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.095+0000 7fefe1733640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefdc0b4110 con 0x7fefdc159c70 2023-11-04T01:37:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.095+0000 7fefe1733640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefdc0b49b0 con 0x7fefdc06db20 2023-11-04T01:37:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.095+0000 7fefe1733640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0b43f0 con 0x7fefdc0b0ae0 2023-11-04T01:37:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.095+0000 7fefdb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fefdc06db20 0x7fefdc15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.095+0000 7fefdb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fefdc06db20 0x7fefdc15d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41572/0 (socket says 172.21.15.44:41572) 2023-11-04T01:37:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.095+0000 7fefdb7fe640 1 -- 172.21.15.44:0/3747166916 learned_addr learned my addr 172.21.15.44:0/3747166916 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.096+0000 7fefda7fc640 1 --2- 172.21.15.44:0/3747166916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefdc0b0ae0 0x7fefdc0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.096+0000 7fefdb7fe640 1 -- 172.21.15.44:0/3747166916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefdc0b0ae0 msgr2=0x7fefdc0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.096+0000 7fefdb7fe640 1 --2- 172.21.15.44:0/3747166916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefdc0b0ae0 0x7fefdc0ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.096+0000 7fefdb7fe640 1 -- 172.21.15.44:0/3747166916 >> v1:172.21.15.204:6789/0 conn(0x7fefdc159c70 legacy=0x7fefdc0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.096+0000 7fefdb7fe640 1 -- 172.21.15.44:0/3747166916 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc0b46d0 con 0x7fefdc06db20 2023-11-04T01:37:25.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.096+0000 7fefda7fc640 1 --2- 172.21.15.44:0/3747166916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefdc0b0ae0 0x7fefdc0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:25.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.096+0000 7fefdb7fe640 1 --2- 172.21.15.44:0/3747166916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefdc06db20 0x7fefdc15d7d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009870 tx=0x7fefd402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef5c3a6362a29a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.097+0000 7fefd9ffb640 1 -- 172.21.15.44:0/3747166916 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4031640 con 0x7fefdc06db20 2023-11-04T01:37:25.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.097+0000 7fefd9ffb640 1 -- 172.21.15.44:0/3747166916 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd40317a0 con 0x7fefdc06db20 2023-11-04T01:37:25.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.097+0000 7fefd9ffb640 1 -- 172.21.15.44:0/3747166916 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4031b30 con 0x7fefdc06db20 2023-11-04T01:37:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.097+0000 7fefe1733640 1 -- 172.21.15.44:0/3747166916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefdc06db20 msgr2=0x7fefdc15d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.097+0000 7fefe1733640 1 --2- 172.21.15.44:0/3747166916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefdc06db20 0x7fefdc15d7d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009870 tx=0x7fefd402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.097+0000 7fefe1733640 1 -- 172.21.15.44:0/3747166916 shutdown_connections 2023-11-04T01:37:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.097+0000 7fefe1733640 1 --2- 172.21.15.44:0/3747166916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefdc06db20 0x7fefdc15d7d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.097+0000 7fefe1733640 1 --2- 172.21.15.44:0/3747166916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefdc0b0ae0 0x7fefdc0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.097+0000 7fefe1733640 1 -- 172.21.15.44:0/3747166916 >> 172.21.15.44:0/3747166916 conn(0x7fefdc0ce950 msgr2=0x7fefdc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.097+0000 7fefe1733640 1 -- 172.21.15.44:0/3747166916 shutdown_connections 2023-11-04T01:37:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.097+0000 7fefe1733640 1 -- 172.21.15.44:0/3747166916 wait complete. 2023-11-04T01:37:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.099+0000 7fefe1733640 1 Processor -- start 2023-11-04T01:37:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.099+0000 7fefe1733640 1 -- start start 2023-11-04T01:37:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.099+0000 7fefe1733640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefdc06db20 0x7fefdc1f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.099+0000 7fefe1733640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefdc0b0ae0 0x7fefdc15d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.099+0000 7fefe1733640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefdc159c70 0x7fefdc15da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.099+0000 7fefe1733640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc1f34a0 con 0x7fefdc06db20 2023-11-04T01:37:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.099+0000 7fefe1733640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0c72d0 con 0x7fefdc159c70 2023-11-04T01:37:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.099+0000 7fefe1733640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0c75b0 con 0x7fefdc0b0ae0 2023-11-04T01:37:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.099+0000 7fefdaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefdc06db20 0x7fefdc1f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.099+0000 7fefdaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefdc06db20 0x7fefdc1f2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41574/0 (socket says 172.21.15.44:41574) 2023-11-04T01:37:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.099+0000 7fefdaffd640 1 -- 172.21.15.44:0/1216315648 learned_addr learned my addr 172.21.15.44:0/1216315648 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.100+0000 7fefdaffd640 1 -- 172.21.15.44:0/1216315648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefdc0b0ae0 msgr2=0x7fefdc15d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.100+0000 7fefdaffd640 1 --2- 172.21.15.44:0/1216315648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefdc0b0ae0 0x7fefdc15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.100+0000 7fefdaffd640 1 -- 172.21.15.44:0/1216315648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefdc159c70 msgr2=0x7fefdc15da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.100+0000 7fefdaffd640 1 --2- 172.21.15.44:0/1216315648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefdc159c70 0x7fefdc15da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.100+0000 7fefdaffd640 1 -- 172.21.15.44:0/1216315648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd40094d0 con 0x7fefdc06db20 2023-11-04T01:37:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.100+0000 7fefdaffd640 1 --2- 172.21.15.44:0/1216315648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefdc06db20 0x7fefdc1f2f60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00c7c0 tx=0x7fefcc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.100+0000 7fefd37fe640 1 -- 172.21.15.44:0/1216315648 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc00aa50 con 0x7fefdc06db20 2023-11-04T01:37:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.100+0000 7fefd37fe640 1 -- 172.21.15.44:0/1216315648 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc00abb0 con 0x7fefdc06db20 2023-11-04T01:37:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.100+0000 7fefe1733640 1 -- 172.21.15.44:0/1216315648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefdc0c7890 con 0x7fefdc06db20 2023-11-04T01:37:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.100+0000 7fefd37fe640 1 -- 172.21.15.44:0/1216315648 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc012420 con 0x7fefdc06db20 2023-11-04T01:37:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.100+0000 7fefe1733640 1 -- 172.21.15.44:0/1216315648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc0c7e50 con 0x7fefdc06db20 2023-11-04T01:37:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.101+0000 7fefe1733640 1 -- 172.21.15.44:0/1216315648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefdc074290 con 0x7fefdc06db20 2023-11-04T01:37:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.101+0000 7fefd37fe640 1 -- 172.21.15.44:0/1216315648 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fefcc012580 con 0x7fefdc06db20 2023-11-04T01:37:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.102+0000 7fefd37fe640 1 --2- 172.21.15.44:0/1216315648 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fefbc06ae70 0x7fefbc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.102+0000 7fefd37fe640 1 -- 172.21.15.44:0/1216315648 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fefcc089b10 con 0x7fefdc06db20 2023-11-04T01:37:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.102+0000 7fefda7fc640 1 --2- 172.21.15.44:0/1216315648 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fefbc06ae70 0x7fefbc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.103+0000 7fefda7fc640 1 --2- 172.21.15.44:0/1216315648 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fefbc06ae70 0x7fefbc06d330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fefc4006fd0 tx=0x7fefc4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.106+0000 7fefd37fe640 1 -- 172.21.15.44:0/1216315648 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fefcc0549e0 con 0x7fefdc06db20 2023-11-04T01:37:25.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.278+0000 7fefe1733640 1 -- 172.21.15.44:0/1216315648 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fefdc0cde50 con 0x7fefbc06ae70 2023-11-04T01:37:25.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.286+0000 7fefd37fe640 1 -- 172.21.15.44:0/1216315648 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284390 (secure 0 0 0) 0x7fefc4007e70 con 0x7fefbc06ae70 2023-11-04T01:37:25.291 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:25.292 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:37:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.288+0000 7fefe1733640 1 -- 172.21.15.44:0/1216315648 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fefbc06ae70 msgr2=0x7fefbc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.288+0000 7fefe1733640 1 --2- 172.21.15.44:0/1216315648 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fefbc06ae70 0x7fefbc06d330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fefc4006fd0 tx=0x7fefc4008040 comp rx=0 tx=0).stop 2023-11-04T01:37:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.288+0000 7fefe1733640 1 -- 172.21.15.44:0/1216315648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefdc06db20 msgr2=0x7fefdc1f2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.288+0000 7fefe1733640 1 --2- 172.21.15.44:0/1216315648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefdc06db20 0x7fefdc1f2f60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00c7c0 tx=0x7fefcc00cc80 comp rx=0 tx=0).stop 2023-11-04T01:37:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.289+0000 7fefe1733640 1 -- 172.21.15.44:0/1216315648 shutdown_connections 2023-11-04T01:37:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.289+0000 7fefe1733640 1 --2- 172.21.15.44:0/1216315648 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fefbc06ae70 0x7fefbc06d330 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.289+0000 7fefe1733640 1 --2- 172.21.15.44:0/1216315648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefdc159c70 0x7fefdc15da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.289+0000 7fefe1733640 1 --2- 172.21.15.44:0/1216315648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefdc0b0ae0 0x7fefdc15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.289+0000 7fefe1733640 1 --2- 172.21.15.44:0/1216315648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefdc06db20 0x7fefdc1f2f60 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.289+0000 7fefe1733640 1 -- 172.21.15.44:0/1216315648 >> 172.21.15.44:0/1216315648 conn(0x7fefdc0ce950 msgr2=0x7fefdc0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.289+0000 7fefe1733640 1 -- 172.21.15.44:0/1216315648 shutdown_connections 2023-11-04T01:37:25.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.289+0000 7fefe1733640 1 -- 172.21.15.44:0/1216315648 wait complete. 2023-11-04T01:37:25.301 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-11-04T01:37:24.593945+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220600,"kb_used_data":4436,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754120,"statfs":{"total":773094113280,"available":772868218880,"internally_reserved":0,"allocated":4542464,"data_stored":2596633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.661295"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950338+0000","last_change":"2023-11-04T01:37:20.950338+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950338+0000","last_undegraded":"2023-11-04T01:37:20.950338+0000","last_fullsized":"2023-11-04T01:37:20.950338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949625+0000","last_change":"2023-11-04T01:37:20.949625+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949625+0000","last_undegraded":"2023-11-04T01:37:20.949625+0000","last_fullsized":"2023-11-04T01:37:20.949625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951782+0000","last_change":"2023-11-04T01:37:20.951782+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951782+0000","last_undegraded":"2023-11-04T01:37:20.951782+0000","last_fullsized":"2023-11-04T01:37:20.951782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.947525+0000","last_change":"2023-11-04T01:37:20.947525+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.947525+0000","last_undegraded":"2023-11-04T01:37:20.947525+0000","last_fullsized":"2023-11-04T01:37:20.947525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945719+0000","last_change":"2023-11-04T01:37:20.945719+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945719+0000","last_undegraded":"2023-11-04T01:37:20.945719+0000","last_fullsized":"2023-11-04T01:37:20.945719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951017+0000","last_change":"2023-11-04T01:37:20.951017+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951017+0000","last_undegraded":"2023-11-04T01:37:20.951017+0000","last_fullsized":"2023-11-04T01:37:20.951017+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944094+0000","last_change":"2023-11-04T01:37:20.944094+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944094+0000","last_undegraded":"2023-11-04T01:37:20.944094+0000","last_fullsized":"2023-11-04T01:37:20.944094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948816+0000","last_change":"2023-11-04T01:37:20.948816+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948816+0000","last_undegraded":"2023-11-04T01:37:20.948816+0000","last_fullsized":"2023-11-04T01:37:20.948816+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951314+0000","last_change":"2023-11-04T01:37:20.951314+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951314+0000","last_undegraded":"2023-11-04T01:37:20.951314+0000","last_fullsized":"2023-11-04T01:37:20.951314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944249+0000","last_change":"2023-11-04T01:37:20.944249+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944249+0000","last_undegraded":"2023-11-04T01:37:20.944249+0000","last_fullsized":"2023-11-04T01:37:20.944249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944749+0000","last_change":"2023-11-04T01:37:20.944749+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944749+0000","last_undegraded":"2023-11-04T01:37:20.944749+0000","last_fullsized":"2023-11-04T01:37:20.944749+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950616+0000","last_change":"2023-11-04T01:37:20.950616+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950616+0000","last_undegraded":"2023-11-04T01:37:20.950616+0000","last_fullsized":"2023-11-04T01:37:20.950616+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944595+0000","last_change":"2023-11-04T01:37:20.944595+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944595+0000","last_undegraded":"2023-11-04T01:37:20.944595+0000","last_fullsized":"2023-11-04T01:37:20.944595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940641+0000","last_change":"2023-11-04T01:37:20.940641+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940641+0000","last_undegraded":"2023-11-04T01:37:20.940641+0000","last_fullsized":"2023-11-04T01:37:20.940641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943560+0000","last_change":"2023-11-04T01:37:20.943560+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943560+0000","last_undegraded":"2023-11-04T01:37:20.943560+0000","last_fullsized":"2023-11-04T01:37:20.943560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950363+0000","last_change":"2023-11-04T01:37:20.950363+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950363+0000","last_undegraded":"2023-11-04T01:37:20.950363+0000","last_fullsized":"2023-11-04T01:37:20.950363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950695+0000","last_change":"2023-11-04T01:37:20.950695+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950695+0000","last_undegraded":"2023-11-04T01:37:20.950695+0000","last_fullsized":"2023-11-04T01:37:20.950695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.942081+0000","last_change":"2023-11-04T01:37:20.942081+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.942081+0000","last_undegraded":"2023-11-04T01:37:20.942081+0000","last_fullsized":"2023-11-04T01:37:20.942081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945020+0000","last_change":"2023-11-04T01:37:20.945020+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945020+0000","last_undegraded":"2023-11-04T01:37:20.945020+0000","last_fullsized":"2023-11-04T01:37:20.945020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941840+0000","last_change":"2023-11-04T01:37:20.941840+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941840+0000","last_undegraded":"2023-11-04T01:37:20.941840+0000","last_fullsized":"2023-11-04T01:37:20.941840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943634+0000","last_change":"2023-11-04T01:37:20.943634+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943634+0000","last_undegraded":"2023-11-04T01:37:20.943634+0000","last_fullsized":"2023-11-04T01:37:20.943634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.939369+0000","last_change":"2023-11-04T01:37:20.939369+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.939369+0000","last_undegraded":"2023-11-04T01:37:20.939369+0000","last_fullsized":"2023-11-04T01:37:20.939369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950275+0000","last_change":"2023-11-04T01:37:20.950275+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950275+0000","last_undegraded":"2023-11-04T01:37:20.950275+0000","last_fullsized":"2023-11-04T01:37:20.950275+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943717+0000","last_change":"2023-11-04T01:37:20.943717+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943717+0000","last_undegraded":"2023-11-04T01:37:20.943717+0000","last_fullsized":"2023-11-04T01:37:20.943717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.942243+0000","last_change":"2023-11-04T01:37:20.942243+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.942243+0000","last_undegraded":"2023-11-04T01:37:20.942243+0000","last_fullsized":"2023-11-04T01:37:20.942243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950535+0000","last_change":"2023-11-04T01:37:20.950535+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950535+0000","last_undegraded":"2023-11-04T01:37:20.950535+0000","last_fullsized":"2023-11-04T01:37:20.950535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941482+0000","last_change":"2023-11-04T01:37:20.941482+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941482+0000","last_undegraded":"2023-11-04T01:37:20.941482+0000","last_fullsized":"2023-11-04T01:37:20.941482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944621+0000","last_change":"2023-11-04T01:37:20.944621+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944621+0000","last_undegraded":"2023-11-04T01:37:20.944621+0000","last_fullsized":"2023-11-04T01:37:20.944621+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941356+0000","last_change":"2023-11-04T01:37:20.941356+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941356+0000","last_undegraded":"2023-11-04T01:37:20.941356+0000","last_fullsized":"2023-11-04T01:37:20.941356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941238+0000","last_change":"2023-11-04T01:37:20.941238+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941238+0000","last_undegraded":"2023-11-04T01:37:20.941238+0000","last_fullsized":"2023-11-04T01:37:20.941238+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949361+0000","last_change":"2023-11-04T01:37:20.949361+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949361+0000","last_undegraded":"2023-11-04T01:37:20.949361+0000","last_fullsized":"2023-11-04T01:37:20.949361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948497+0000","last_change":"2023-11-04T01:37:20.948497+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948497+0000","last_undegraded":"2023-11-04T01:37:20.948497+0000","last_fullsized":"2023-11-04T01:37:20.948497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950780+0000","last_change":"2023-11-04T01:37:20.950780+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950780+0000","last_undegraded":"2023-11-04T01:37:20.950780+0000","last_fullsized":"2023-11-04T01:37:20.950780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.951671+0000","last_change":"2023-11-04T01:37:20.948850+0000","last_active":"2023-11-04T01:37:20.951671+0000","last_peered":"2023-11-04T01:37:20.951671+0000","last_clean":"2023-11-04T01:37:20.951671+0000","last_became_active":"2023-11-04T01:37:20.948589+0000","last_became_peered":"2023-11-04T01:37:20.948589+0000","last_unstale":"2023-11-04T01:37:20.951671+0000","last_undegraded":"2023-11-04T01:37:20.951671+0000","last_fullsized":"2023-11-04T01:37:20.951671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:15:44.156052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946971+0000","last_change":"2023-11-04T01:37:20.946971+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946971+0000","last_undegraded":"2023-11-04T01:37:20.946971+0000","last_fullsized":"2023-11-04T01:37:20.946971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959410+0000","last_change":"2023-11-04T01:37:20.957554+0000","last_active":"2023-11-04T01:37:20.959410+0000","last_peered":"2023-11-04T01:37:20.959410+0000","last_clean":"2023-11-04T01:37:20.959410+0000","last_became_active":"2023-11-04T01:37:20.957283+0000","last_became_peered":"2023-11-04T01:37:20.957283+0000","last_unstale":"2023-11-04T01:37:20.959410+0000","last_undegraded":"2023-11-04T01:37:20.959410+0000","last_fullsized":"2023-11-04T01:37:20.959410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:18.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.939649+0000","last_change":"2023-11-04T01:37:20.939649+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.939649+0000","last_undegraded":"2023-11-04T01:37:20.939649+0000","last_fullsized":"2023-11-04T01:37:20.939649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953317+0000","last_change":"2023-11-04T01:37:20.951123+0000","last_active":"2023-11-04T01:37:20.953317+0000","last_peered":"2023-11-04T01:37:20.953317+0000","last_clean":"2023-11-04T01:37:20.953317+0000","last_became_active":"2023-11-04T01:37:20.950796+0000","last_became_peered":"2023-11-04T01:37:20.950796+0000","last_unstale":"2023-11-04T01:37:20.953317+0000","last_undegraded":"2023-11-04T01:37:20.953317+0000","last_fullsized":"2023-11-04T01:37:20.953317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:20:25.874532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948800+0000","last_change":"2023-11-04T01:37:20.948800+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948800+0000","last_undegraded":"2023-11-04T01:37:20.948800+0000","last_fullsized":"2023-11-04T01:37:20.948800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.947315+0000","last_change":"2023-11-04T01:37:20.946610+0000","last_active":"2023-11-04T01:37:20.947315+0000","last_peered":"2023-11-04T01:37:20.947315+0000","last_clean":"2023-11-04T01:37:20.947315+0000","last_became_active":"2023-11-04T01:37:20.946320+0000","last_became_peered":"2023-11-04T01:37:20.946320+0000","last_unstale":"2023-11-04T01:37:20.947315+0000","last_undegraded":"2023-11-04T01:37:20.947315+0000","last_fullsized":"2023-11-04T01:37:20.947315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:15:44.156052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950057+0000","last_change":"2023-11-04T01:37:20.950057+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950057+0000","last_undegraded":"2023-11-04T01:37:20.950057+0000","last_fullsized":"2023-11-04T01:37:20.950057+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962206+0000","last_change":"2023-11-04T01:37:20.958166+0000","last_active":"2023-11-04T01:37:20.962206+0000","last_peered":"2023-11-04T01:37:20.962206+0000","last_clean":"2023-11-04T01:37:20.962206+0000","last_became_active":"2023-11-04T01:37:20.957832+0000","last_became_peered":"2023-11-04T01:37:20.957832+0000","last_unstale":"2023-11-04T01:37:20.962206+0000","last_undegraded":"2023-11-04T01:37:20.962206+0000","last_fullsized":"2023-11-04T01:37:20.962206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:55.724864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943131+0000","last_change":"2023-11-04T01:37:20.943131+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943131+0000","last_undegraded":"2023-11-04T01:37:20.943131+0000","last_fullsized":"2023-11-04T01:37:20.943131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962277+0000","last_change":"2023-11-04T01:37:20.958018+0000","last_active":"2023-11-04T01:37:20.962277+0000","last_peered":"2023-11-04T01:37:20.962277+0000","last_clean":"2023-11-04T01:37:20.962277+0000","last_became_active":"2023-11-04T01:37:20.957734+0000","last_became_peered":"2023-11-04T01:37:20.957734+0000","last_unstale":"2023-11-04T01:37:20.962277+0000","last_undegraded":"2023-11-04T01:37:20.962277+0000","last_fullsized":"2023-11-04T01:37:20.962277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:25.355203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.939903+0000","last_change":"2023-11-04T01:37:20.939903+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.939903+0000","last_undegraded":"2023-11-04T01:37:20.939903+0000","last_fullsized":"2023-11-04T01:37:20.939903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953179+0000","last_change":"2023-11-04T01:37:20.951909+0000","last_active":"2023-11-04T01:37:20.953179+0000","last_peered":"2023-11-04T01:37:20.953179+0000","last_clean":"2023-11-04T01:37:20.953179+0000","last_became_active":"2023-11-04T01:37:20.951595+0000","last_became_peered":"2023-11-04T01:37:20.951595+0000","last_unstale":"2023-11-04T01:37:20.953179+0000","last_undegraded":"2023-11-04T01:37:20.953179+0000","last_fullsized":"2023-11-04T01:37:20.953179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:25.355203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948012+0000","last_change":"2023-11-04T01:37:20.948012+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948012+0000","last_undegraded":"2023-11-04T01:37:20.948012+0000","last_fullsized":"2023-11-04T01:37:20.948012+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.950590+0000","last_change":"2023-11-04T01:37:20.948666+0000","last_active":"2023-11-04T01:37:20.950590+0000","last_peered":"2023-11-04T01:37:20.950590+0000","last_clean":"2023-11-04T01:37:20.950590+0000","last_became_active":"2023-11-04T01:37:20.948379+0000","last_became_peered":"2023-11-04T01:37:20.948379+0000","last_unstale":"2023-11-04T01:37:20.950590+0000","last_undegraded":"2023-11-04T01:37:20.950590+0000","last_fullsized":"2023-11-04T01:37:20.950590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:00.482538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944553+0000","last_change":"2023-11-04T01:37:20.944553+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944553+0000","last_undegraded":"2023-11-04T01:37:20.944553+0000","last_fullsized":"2023-11-04T01:37:20.944553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959272+0000","last_change":"2023-11-04T01:37:20.951039+0000","last_active":"2023-11-04T01:37:20.959272+0000","last_peered":"2023-11-04T01:37:20.959272+0000","last_clean":"2023-11-04T01:37:20.959272+0000","last_became_active":"2023-11-04T01:37:20.950768+0000","last_became_peered":"2023-11-04T01:37:20.950768+0000","last_unstale":"2023-11-04T01:37:20.959272+0000","last_undegraded":"2023-11-04T01:37:20.959272+0000","last_fullsized":"2023-11-04T01:37:20.959272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:42.847107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951525+0000","last_change":"2023-11-04T01:37:20.951525+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951525+0000","last_undegraded":"2023-11-04T01:37:20.951525+0000","last_fullsized":"2023-11-04T01:37:20.951525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957314+0000","last_change":"2023-11-04T01:37:20.953603+0000","last_active":"2023-11-04T01:37:20.957314+0000","last_peered":"2023-11-04T01:37:20.957314+0000","last_clean":"2023-11-04T01:37:20.957314+0000","last_became_active":"2023-11-04T01:37:20.953355+0000","last_became_peered":"2023-11-04T01:37:20.953355+0000","last_unstale":"2023-11-04T01:37:20.957314+0000","last_undegraded":"2023-11-04T01:37:20.957314+0000","last_fullsized":"2023-11-04T01:37:20.957314+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:42.847107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950439+0000","last_change":"2023-11-04T01:37:20.950439+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950439+0000","last_undegraded":"2023-11-04T01:37:20.950439+0000","last_fullsized":"2023-11-04T01:37:20.950439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957274+0000","last_change":"2023-11-04T01:37:20.951932+0000","last_active":"2023-11-04T01:37:20.957274+0000","last_peered":"2023-11-04T01:37:20.957274+0000","last_clean":"2023-11-04T01:37:20.957274+0000","last_became_active":"2023-11-04T01:37:20.951672+0000","last_became_peered":"2023-11-04T01:37:20.951672+0000","last_unstale":"2023-11-04T01:37:20.957274+0000","last_undegraded":"2023-11-04T01:37:20.957274+0000","last_fullsized":"2023-11-04T01:37:20.957274+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:18.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940748+0000","last_change":"2023-11-04T01:37:20.940748+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940748+0000","last_undegraded":"2023-11-04T01:37:20.940748+0000","last_fullsized":"2023-11-04T01:37:20.940748+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959474+0000","last_change":"2023-11-04T01:37:20.957547+0000","last_active":"2023-11-04T01:37:20.959474+0000","last_peered":"2023-11-04T01:37:20.959474+0000","last_clean":"2023-11-04T01:37:20.959474+0000","last_became_active":"2023-11-04T01:37:20.957264+0000","last_became_peered":"2023-11-04T01:37:20.957264+0000","last_unstale":"2023-11-04T01:37:20.959474+0000","last_undegraded":"2023-11-04T01:37:20.959474+0000","last_fullsized":"2023-11-04T01:37:20.959474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:57:28.939429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949170+0000","last_change":"2023-11-04T01:37:20.949170+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949170+0000","last_undegraded":"2023-11-04T01:37:20.949170+0000","last_fullsized":"2023-11-04T01:37:20.949170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959449+0000","last_change":"2023-11-04T01:37:20.957462+0000","last_active":"2023-11-04T01:37:20.959449+0000","last_peered":"2023-11-04T01:37:20.959449+0000","last_clean":"2023-11-04T01:37:20.959449+0000","last_became_active":"2023-11-04T01:37:20.957172+0000","last_became_peered":"2023-11-04T01:37:20.957172+0000","last_unstale":"2023-11-04T01:37:20.959449+0000","last_undegraded":"2023-11-04T01:37:20.959449+0000","last_fullsized":"2023-11-04T01:37:20.959449+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:03.376922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946705+0000","last_change":"2023-11-04T01:37:20.946705+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946705+0000","last_undegraded":"2023-11-04T01:37:20.946705+0000","last_fullsized":"2023-11-04T01:37:20.946705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953259+0000","last_change":"2023-11-04T01:37:20.951880+0000","last_active":"2023-11-04T01:37:20.953259+0000","last_peered":"2023-11-04T01:37:20.953259+0000","last_clean":"2023-11-04T01:37:20.953259+0000","last_became_active":"2023-11-04T01:37:20.951551+0000","last_became_peered":"2023-11-04T01:37:20.951551+0000","last_unstale":"2023-11-04T01:37:20.953259+0000","last_undegraded":"2023-11-04T01:37:20.953259+0000","last_fullsized":"2023-11-04T01:37:20.953259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949390+0000","last_change":"2023-11-04T01:37:20.949390+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949390+0000","last_undegraded":"2023-11-04T01:37:20.949390+0000","last_fullsized":"2023-11-04T01:37:20.949390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.950729+0000","last_change":"2023-11-04T01:37:20.946684+0000","last_active":"2023-11-04T01:37:20.950729+0000","last_peered":"2023-11-04T01:37:20.950729+0000","last_clean":"2023-11-04T01:37:20.950729+0000","last_became_active":"2023-11-04T01:37:20.946206+0000","last_became_peered":"2023-11-04T01:37:20.946206+0000","last_unstale":"2023-11-04T01:37:20.950729+0000","last_undegraded":"2023-11-04T01:37:20.950729+0000","last_fullsized":"2023-11-04T01:37:20.950729+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:13:11.543891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946949+0000","last_change":"2023-11-04T01:37:20.946949+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946949+0000","last_undegraded":"2023-11-04T01:37:20.946949+0000","last_fullsized":"2023-11-04T01:37:20.946949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962618+0000","last_change":"2023-11-04T01:37:20.960179+0000","last_active":"2023-11-04T01:37:20.962618+0000","last_peered":"2023-11-04T01:37:20.962618+0000","last_clean":"2023-11-04T01:37:20.962618+0000","last_became_active":"2023-11-04T01:37:20.959900+0000","last_became_peered":"2023-11-04T01:37:20.959900+0000","last_unstale":"2023-11-04T01:37:20.962618+0000","last_undegraded":"2023-11-04T01:37:20.962618+0000","last_fullsized":"2023-11-04T01:37:20.962618+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:20:25.874532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946705+0000","last_change":"2023-11-04T01:37:20.946705+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946705+0000","last_undegraded":"2023-11-04T01:37:20.946705+0000","last_fullsized":"2023-11-04T01:37:20.946705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.951304+0000","last_change":"2023-11-04T01:37:20.947847+0000","last_active":"2023-11-04T01:37:20.951304+0000","last_peered":"2023-11-04T01:37:20.951304+0000","last_clean":"2023-11-04T01:37:20.951304+0000","last_became_active":"2023-11-04T01:37:20.947565+0000","last_became_peered":"2023-11-04T01:37:20.947565+0000","last_unstale":"2023-11-04T01:37:20.951304+0000","last_undegraded":"2023-11-04T01:37:20.951304+0000","last_fullsized":"2023-11-04T01:37:20.951304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:51.912669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943416+0000","last_change":"2023-11-04T01:37:20.943416+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943416+0000","last_undegraded":"2023-11-04T01:37:20.943416+0000","last_fullsized":"2023-11-04T01:37:20.943416+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.954457+0000","last_change":"2023-11-04T01:37:20.950827+0000","last_active":"2023-11-04T01:37:20.954457+0000","last_peered":"2023-11-04T01:37:20.954457+0000","last_clean":"2023-11-04T01:37:20.954457+0000","last_became_active":"2023-11-04T01:37:20.950575+0000","last_became_peered":"2023-11-04T01:37:20.950575+0000","last_unstale":"2023-11-04T01:37:20.954457+0000","last_undegraded":"2023-11-04T01:37:20.954457+0000","last_fullsized":"2023-11-04T01:37:20.954457+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:20:01.127723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940112+0000","last_change":"2023-11-04T01:37:20.940112+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940112+0000","last_undegraded":"2023-11-04T01:37:20.940112+0000","last_fullsized":"2023-11-04T01:37:20.940112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.960190+0000","last_change":"2023-11-04T01:37:20.959217+0000","last_active":"2023-11-04T01:37:20.960190+0000","last_peered":"2023-11-04T01:37:20.960190+0000","last_clean":"2023-11-04T01:37:20.960190+0000","last_became_active":"2023-11-04T01:37:20.958336+0000","last_became_peered":"2023-11-04T01:37:20.958336+0000","last_unstale":"2023-11-04T01:37:20.960190+0000","last_undegraded":"2023-11-04T01:37:20.960190+0000","last_fullsized":"2023-11-04T01:37:20.960190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:03:48.533243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944682+0000","last_change":"2023-11-04T01:37:20.944682+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944682+0000","last_undegraded":"2023-11-04T01:37:20.944682+0000","last_fullsized":"2023-11-04T01:37:20.944682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953210+0000","last_change":"2023-11-04T01:37:20.950464+0000","last_active":"2023-11-04T01:37:20.953210+0000","last_peered":"2023-11-04T01:37:20.953210+0000","last_clean":"2023-11-04T01:37:20.953210+0000","last_became_active":"2023-11-04T01:37:20.950133+0000","last_became_peered":"2023-11-04T01:37:20.950133+0000","last_unstale":"2023-11-04T01:37:20.953210+0000","last_undegraded":"2023-11-04T01:37:20.953210+0000","last_fullsized":"2023-11-04T01:37:20.953210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:44.200233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949983+0000","last_change":"2023-11-04T01:37:20.949983+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949983+0000","last_undegraded":"2023-11-04T01:37:20.949983+0000","last_fullsized":"2023-11-04T01:37:20.949983+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.958220+0000","last_change":"2023-11-04T01:37:20.955294+0000","last_active":"2023-11-04T01:37:20.958220+0000","last_peered":"2023-11-04T01:37:20.958220+0000","last_clean":"2023-11-04T01:37:20.958220+0000","last_became_active":"2023-11-04T01:37:20.955019+0000","last_became_peered":"2023-11-04T01:37:20.955019+0000","last_unstale":"2023-11-04T01:37:20.958220+0000","last_undegraded":"2023-11-04T01:37:20.958220+0000","last_fullsized":"2023-11-04T01:37:20.958220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:53.772500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.947499+0000","last_change":"2023-11-04T01:37:20.947499+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.947499+0000","last_undegraded":"2023-11-04T01:37:20.947499+0000","last_fullsized":"2023-11-04T01:37:20.947499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.956263+0000","last_change":"2023-11-04T01:37:20.952410+0000","last_active":"2023-11-04T01:37:20.956263+0000","last_peered":"2023-11-04T01:37:20.956263+0000","last_clean":"2023-11-04T01:37:20.956263+0000","last_became_active":"2023-11-04T01:37:20.952143+0000","last_became_peered":"2023-11-04T01:37:20.952143+0000","last_unstale":"2023-11-04T01:37:20.956263+0000","last_undegraded":"2023-11-04T01:37:20.956263+0000","last_fullsized":"2023-11-04T01:37:20.956263+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:05:40.366579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.942494+0000","last_change":"2023-11-04T01:37:20.942494+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.942494+0000","last_undegraded":"2023-11-04T01:37:20.942494+0000","last_fullsized":"2023-11-04T01:37:20.942494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962232+0000","last_change":"2023-11-04T01:37:20.957857+0000","last_active":"2023-11-04T01:37:20.962232+0000","last_peered":"2023-11-04T01:37:20.962232+0000","last_clean":"2023-11-04T01:37:20.962232+0000","last_became_active":"2023-11-04T01:37:20.957415+0000","last_became_peered":"2023-11-04T01:37:20.957415+0000","last_unstale":"2023-11-04T01:37:20.962232+0000","last_undegraded":"2023-11-04T01:37:20.962232+0000","last_fullsized":"2023-11-04T01:37:20.962232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:55.724864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946189+0000","last_change":"2023-11-04T01:37:20.946189+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946189+0000","last_undegraded":"2023-11-04T01:37:20.946189+0000","last_fullsized":"2023-11-04T01:37:20.946189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.960780+0000","last_change":"2023-11-04T01:37:20.958969+0000","last_active":"2023-11-04T01:37:20.960780+0000","last_peered":"2023-11-04T01:37:20.960780+0000","last_clean":"2023-11-04T01:37:20.960780+0000","last_became_active":"2023-11-04T01:37:20.958656+0000","last_became_peered":"2023-11-04T01:37:20.958656+0000","last_unstale":"2023-11-04T01:37:20.960780+0000","last_undegraded":"2023-11-04T01:37:20.960780+0000","last_fullsized":"2023-11-04T01:37:20.960780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:59:20.169775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946503+0000","last_change":"2023-11-04T01:37:20.946503+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946503+0000","last_undegraded":"2023-11-04T01:37:20.946503+0000","last_fullsized":"2023-11-04T01:37:20.946503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.956572+0000","last_change":"2023-11-04T01:37:20.951195+0000","last_active":"2023-11-04T01:37:20.956572+0000","last_peered":"2023-11-04T01:37:20.956572+0000","last_clean":"2023-11-04T01:37:20.956572+0000","last_became_active":"2023-11-04T01:37:20.950916+0000","last_became_peered":"2023-11-04T01:37:20.950916+0000","last_unstale":"2023-11-04T01:37:20.956572+0000","last_undegraded":"2023-11-04T01:37:20.956572+0000","last_fullsized":"2023-11-04T01:37:20.956572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951134+0000","last_change":"2023-11-04T01:37:20.951134+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951134+0000","last_undegraded":"2023-11-04T01:37:20.951134+0000","last_fullsized":"2023-11-04T01:37:20.951134+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957912+0000","last_change":"2023-11-04T01:37:20.954111+0000","last_active":"2023-11-04T01:37:20.957912+0000","last_peered":"2023-11-04T01:37:20.957912+0000","last_clean":"2023-11-04T01:37:20.957912+0000","last_became_active":"2023-11-04T01:37:20.953851+0000","last_became_peered":"2023-11-04T01:37:20.953851+0000","last_unstale":"2023-11-04T01:37:20.957912+0000","last_undegraded":"2023-11-04T01:37:20.957912+0000","last_fullsized":"2023-11-04T01:37:20.957912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:31.988502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945193+0000","last_change":"2023-11-04T01:37:20.945193+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945193+0000","last_undegraded":"2023-11-04T01:37:20.945193+0000","last_fullsized":"2023-11-04T01:37:20.945193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.960305+0000","last_change":"2023-11-04T01:37:20.958189+0000","last_active":"2023-11-04T01:37:20.960305+0000","last_peered":"2023-11-04T01:37:20.960305+0000","last_clean":"2023-11-04T01:37:20.960305+0000","last_became_active":"2023-11-04T01:37:20.957903+0000","last_became_peered":"2023-11-04T01:37:20.957903+0000","last_unstale":"2023-11-04T01:37:20.960305+0000","last_undegraded":"2023-11-04T01:37:20.960305+0000","last_fullsized":"2023-11-04T01:37:20.960305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948680+0000","last_change":"2023-11-04T01:37:20.948680+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948680+0000","last_undegraded":"2023-11-04T01:37:20.948680+0000","last_fullsized":"2023-11-04T01:37:20.948680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959762+0000","last_change":"2023-11-04T01:37:20.957300+0000","last_active":"2023-11-04T01:37:20.959762+0000","last_peered":"2023-11-04T01:37:20.959762+0000","last_clean":"2023-11-04T01:37:20.959762+0000","last_became_active":"2023-11-04T01:37:20.957035+0000","last_became_peered":"2023-11-04T01:37:20.957035+0000","last_unstale":"2023-11-04T01:37:20.959762+0000","last_undegraded":"2023-11-04T01:37:20.959762+0000","last_fullsized":"2023-11-04T01:37:20.959762+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:55.724864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945994+0000","last_change":"2023-11-04T01:37:20.945994+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945994+0000","last_undegraded":"2023-11-04T01:37:20.945994+0000","last_fullsized":"2023-11-04T01:37:20.945994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957141+0000","last_change":"2023-11-04T01:37:20.955263+0000","last_active":"2023-11-04T01:37:20.957141+0000","last_peered":"2023-11-04T01:37:20.957141+0000","last_clean":"2023-11-04T01:37:20.957141+0000","last_became_active":"2023-11-04T01:37:20.955015+0000","last_became_peered":"2023-11-04T01:37:20.955015+0000","last_unstale":"2023-11-04T01:37:20.957141+0000","last_undegraded":"2023-11-04T01:37:20.957141+0000","last_fullsized":"2023-11-04T01:37:20.957141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:00.482538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940263+0000","last_change":"2023-11-04T01:37:20.940263+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940263+0000","last_undegraded":"2023-11-04T01:37:20.940263+0000","last_fullsized":"2023-11-04T01:37:20.940263+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.945648+0000","last_change":"2023-11-04T01:37:20.944425+0000","last_active":"2023-11-04T01:37:20.945648+0000","last_peered":"2023-11-04T01:37:20.945648+0000","last_clean":"2023-11-04T01:37:20.945648+0000","last_became_active":"2023-11-04T01:37:20.944147+0000","last_became_peered":"2023-11-04T01:37:20.944147+0000","last_unstale":"2023-11-04T01:37:20.945648+0000","last_undegraded":"2023-11-04T01:37:20.945648+0000","last_fullsized":"2023-11-04T01:37:20.945648+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:13:11.543891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949823+0000","last_change":"2023-11-04T01:37:20.949823+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949823+0000","last_undegraded":"2023-11-04T01:37:20.949823+0000","last_fullsized":"2023-11-04T01:37:20.949823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959712+0000","last_change":"2023-11-04T01:37:20.953474+0000","last_active":"2023-11-04T01:37:20.959712+0000","last_peered":"2023-11-04T01:37:20.959712+0000","last_clean":"2023-11-04T01:37:20.959712+0000","last_became_active":"2023-11-04T01:37:20.953215+0000","last_became_peered":"2023-11-04T01:37:20.953215+0000","last_unstale":"2023-11-04T01:37:20.959712+0000","last_undegraded":"2023-11-04T01:37:20.959712+0000","last_fullsized":"2023-11-04T01:37:20.959712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:49.592008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943316+0000","last_change":"2023-11-04T01:37:20.943316+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943316+0000","last_undegraded":"2023-11-04T01:37:20.943316+0000","last_fullsized":"2023-11-04T01:37:20.943316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962376+0000","last_change":"2023-11-04T01:37:20.958978+0000","last_active":"2023-11-04T01:37:20.962376+0000","last_peered":"2023-11-04T01:37:20.962376+0000","last_clean":"2023-11-04T01:37:20.962376+0000","last_became_active":"2023-11-04T01:37:20.958778+0000","last_became_peered":"2023-11-04T01:37:20.958778+0000","last_unstale":"2023-11-04T01:37:20.962376+0000","last_undegraded":"2023-11-04T01:37:20.962376+0000","last_fullsized":"2023-11-04T01:37:20.962376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-04T01:37:19.935331+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:37:19.935331+0000","last_peered":"2023-11-04T01:37:19.935331+0000","last_clean":"2023-11-04T01:37:19.935331+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:37:19.935331+0000","last_undegraded":"2023-11-04T01:37:19.935331+0000","last_fullsized":"2023-11-04T01:37:19.935331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":770780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.42099999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.55300000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.64500000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.68999999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.503},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.72499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58299999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.40500000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.499}]},{"osd":3,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56899999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.39300000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.35399999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52300000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60799999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.32600000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.41699999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.438}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.53900000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.504}]},{"osd":2,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.64700000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.747}]},{"osd":7,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.628},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.76000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.314},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.26200000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.377}]},{"osd":4,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.53000000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46000000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.44600000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.57599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.247},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.27500000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.312},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.34100000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.37},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.41099999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.625},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.58099999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.224},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.32800000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.30399999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.25800000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.434}]},{"osd":5,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.41299999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.42499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1003520,"data_stored":763166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.40100000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.432}]},{"osd":3,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.38},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.754}]},{"osd":5,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76200000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:25.306 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:25.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.446+0000 7fa3748f2640 1 Processor -- start 2023-11-04T01:37:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.446+0000 7fa3748f2640 1 -- start start 2023-11-04T01:37:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.447+0000 7fa3748f2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa3700ce240 0x7fa370157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.447+0000 7fa3748f2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa370157540 0x7fa3700d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.447+0000 7fa3748f2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37015e000 con 0x7fa3700cde60 2023-11-04T01:37:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.447+0000 7fa3748f2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37015e5c0 con 0x7fa3700ce240 2023-11-04T01:37:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.447+0000 7fa3748f2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37015e2e0 con 0x7fa370157540 2023-11-04T01:37:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.448+0000 7fa36ed9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa370157540 0x7fa3700d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.448+0000 7fa36dd9b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa3700ce240 0x7fa370157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.448+0000 7fa36e59c640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fa3700cde60 0x7fa37015d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:55302/0 (socket says 172.21.15.44:55302) 2023-11-04T01:37:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.448+0000 7fa36e59c640 1 -- 172.21.15.44:0/2835297797 learned_addr learned my addr 172.21.15.44:0/2835297797 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.448+0000 7fa36d59a640 1 -- 172.21.15.44:0/2835297797 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857800993 0 0) 0x7fa37015e000 con 0x7fa3700cde60 2023-11-04T01:37:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.448+0000 7fa36d59a640 1 -- 172.21.15.44:0/2835297797 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa35c003520 con 0x7fa3700cde60 2023-11-04T01:37:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.448+0000 7fa36dd9b640 1 -- 172.21.15.44:0/2835297797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa370157540 msgr2=0x7fa3700d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.448+0000 7fa36dd9b640 1 --2- 172.21.15.44:0/2835297797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa370157540 0x7fa3700d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.448+0000 7fa36dd9b640 1 -- 172.21.15.44:0/2835297797 >> v1:172.21.15.204:6789/0 conn(0x7fa3700cde60 legacy=0x7fa37015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.448+0000 7fa36dd9b640 1 -- 172.21.15.44:0/2835297797 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3700d1120 con 0x7fa3700ce240 2023-11-04T01:37:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.448+0000 7fa36ed9d640 1 --2- 172.21.15.44:0/2835297797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa370157540 0x7fa3700d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.449+0000 7fa36dd9b640 1 --2- 172.21.15.44:0/2835297797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3700ce240 0x7fa370157000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa3580097a0 tx=0x7fa35802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f2dc8fdd11871d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.449+0000 7fa36d59a640 1 -- 172.21.15.44:0/2835297797 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358031830 con 0x7fa3700ce240 2023-11-04T01:37:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.449+0000 7fa36d59a640 1 -- 172.21.15.44:0/2835297797 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa358031990 con 0x7fa3700ce240 2023-11-04T01:37:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.449+0000 7fa36d59a640 1 -- 172.21.15.44:0/2835297797 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358031d00 con 0x7fa3700ce240 2023-11-04T01:37:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.450+0000 7fa3748f2640 1 -- 172.21.15.44:0/2835297797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3700ce240 msgr2=0x7fa370157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.450+0000 7fa3748f2640 1 --2- 172.21.15.44:0/2835297797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3700ce240 0x7fa370157000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa3580097a0 tx=0x7fa35802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.450+0000 7fa3748f2640 1 -- 172.21.15.44:0/2835297797 shutdown_connections 2023-11-04T01:37:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.450+0000 7fa3748f2640 1 --2- 172.21.15.44:0/2835297797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa370157540 0x7fa3700d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.450+0000 7fa3748f2640 1 --2- 172.21.15.44:0/2835297797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3700ce240 0x7fa370157000 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.450+0000 7fa3748f2640 1 -- 172.21.15.44:0/2835297797 >> 172.21.15.44:0/2835297797 conn(0x7fa370071f30 msgr2=0x7fa3700cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.450+0000 7fa3748f2640 1 -- 172.21.15.44:0/2835297797 shutdown_connections 2023-11-04T01:37:25.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.450+0000 7fa3748f2640 1 -- 172.21.15.44:0/2835297797 wait complete. 2023-11-04T01:37:25.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.451+0000 7fa3748f2640 1 Processor -- start 2023-11-04T01:37:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.451+0000 7fa3748f2640 1 -- start start 2023-11-04T01:37:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.452+0000 7fa3748f2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3700cde60 0x7fa370148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.452+0000 7fa3748f2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3700ce240 0x7fa3701f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.452+0000 7fa3748f2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa370157540 0x7fa3700c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.452+0000 7fa3748f2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3701f29d0 con 0x7fa370157540 2023-11-04T01:37:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.452+0000 7fa3748f2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3701f6d10 con 0x7fa3700cde60 2023-11-04T01:37:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.452+0000 7fa3748f2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa370149270 con 0x7fa3700ce240 2023-11-04T01:37:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.452+0000 7fa36ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa370157540 0x7fa3700c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.452+0000 7fa36ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa370157540 0x7fa3700c8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41582/0 (socket says 172.21.15.44:41582) 2023-11-04T01:37:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.452+0000 7fa36ed9d640 1 -- 172.21.15.44:0/186773269 learned_addr learned my addr 172.21.15.44:0/186773269 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.452+0000 7fa36e59c640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3700cde60 0x7fa370148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.452+0000 7fa36dd9b640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3700ce240 0x7fa3701f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.452+0000 7fa36ed9d640 1 -- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3700ce240 msgr2=0x7fa3701f67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.452+0000 7fa36ed9d640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3700ce240 0x7fa3701f67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.453+0000 7fa36ed9d640 1 -- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3700cde60 msgr2=0x7fa370148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.453+0000 7fa36ed9d640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3700cde60 0x7fa370148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.453+0000 7fa36ed9d640 1 -- 172.21.15.44:0/186773269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa360009a70 con 0x7fa370157540 2023-11-04T01:37:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.453+0000 7fa36dd9b640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3700ce240 0x7fa3701f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.453+0000 7fa36e59c640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3700cde60 0x7fa370148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.453+0000 7fa36ed9d640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa370157540 0x7fa3700c8b00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa36000efc0 tx=0x7fa36000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.453+0000 7fa366ffd640 1 -- 172.21.15.44:0/186773269 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360009cd0 con 0x7fa370157540 2023-11-04T01:37:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.453+0000 7fa366ffd640 1 -- 172.21.15.44:0/186773269 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36000f040 con 0x7fa370157540 2023-11-04T01:37:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.453+0000 7fa366ffd640 1 -- 172.21.15.44:0/186773269 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360003990 con 0x7fa370157540 2023-11-04T01:37:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.453+0000 7fa3748f2640 1 -- 172.21.15.44:0/186773269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa358009400 con 0x7fa370157540 2023-11-04T01:37:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.453+0000 7fa3748f2640 1 -- 172.21.15.44:0/186773269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa370148cb0 con 0x7fa370157540 2023-11-04T01:37:25.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.454+0000 7fa3748f2640 1 -- 172.21.15.44:0/186773269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3701f2b40 con 0x7fa370157540 2023-11-04T01:37:25.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.454+0000 7fa366ffd640 1 -- 172.21.15.44:0/186773269 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa360014480 con 0x7fa370157540 2023-11-04T01:37:25.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.455+0000 7fa366ffd640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa35006aea0 0x7fa35006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.455+0000 7fa366ffd640 1 -- 172.21.15.44:0/186773269 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa36008a390 con 0x7fa370157540 2023-11-04T01:37:25.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.455+0000 7fa36e59c640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa35006aea0 0x7fa35006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.456+0000 7fa36e59c640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa35006aea0 0x7fa35006d360 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa368005880 tx=0x7fa368009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.459+0000 7fa366ffd640 1 -- 172.21.15.44:0/186773269 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3701f2b40 con 0x7fa370157540 2023-11-04T01:37:25.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.631+0000 7fa3748f2640 1 -- 172.21.15.44:0/186773269 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3700d1400 con 0x7fa35006aea0 2023-11-04T01:37:25.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.638+0000 7fa366ffd640 1 -- 172.21.15.44:0/186773269 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284390 (secure 0 0 0) 0x7fa368001ce0 con 0x7fa35006aea0 2023-11-04T01:37:25.644 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:25.645 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:37:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.641+0000 7fa3748f2640 1 -- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa35006aea0 msgr2=0x7fa35006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.641+0000 7fa3748f2640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa35006aea0 0x7fa35006d360 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa368005880 tx=0x7fa368009040 comp rx=0 tx=0).stop 2023-11-04T01:37:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.641+0000 7fa3748f2640 1 -- 172.21.15.44:0/186773269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa370157540 msgr2=0x7fa3700c8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.641+0000 7fa3748f2640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa370157540 0x7fa3700c8b00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa36000efc0 tx=0x7fa36000c490 comp rx=0 tx=0).stop 2023-11-04T01:37:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.641+0000 7fa3748f2640 1 -- 172.21.15.44:0/186773269 shutdown_connections 2023-11-04T01:37:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.641+0000 7fa3748f2640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa35006aea0 0x7fa35006d360 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.641+0000 7fa3748f2640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa370157540 0x7fa3700c8b00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.641+0000 7fa3748f2640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3700ce240 0x7fa3701f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.641+0000 7fa3748f2640 1 --2- 172.21.15.44:0/186773269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3700cde60 0x7fa370148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.641+0000 7fa3748f2640 1 -- 172.21.15.44:0/186773269 >> 172.21.15.44:0/186773269 conn(0x7fa370071f30 msgr2=0x7fa370072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.642+0000 7fa3748f2640 1 -- 172.21.15.44:0/186773269 shutdown_connections 2023-11-04T01:37:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.642+0000 7fa3748f2640 1 -- 172.21.15.44:0/186773269 wait complete. 2023-11-04T01:37:25.655 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-11-04T01:37:24.593945+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220600,"kb_used_data":4436,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754120,"statfs":{"total":773094113280,"available":772868218880,"internally_reserved":0,"allocated":4542464,"data_stored":2596633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.661295"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950338+0000","last_change":"2023-11-04T01:37:20.950338+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950338+0000","last_undegraded":"2023-11-04T01:37:20.950338+0000","last_fullsized":"2023-11-04T01:37:20.950338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949625+0000","last_change":"2023-11-04T01:37:20.949625+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949625+0000","last_undegraded":"2023-11-04T01:37:20.949625+0000","last_fullsized":"2023-11-04T01:37:20.949625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951782+0000","last_change":"2023-11-04T01:37:20.951782+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951782+0000","last_undegraded":"2023-11-04T01:37:20.951782+0000","last_fullsized":"2023-11-04T01:37:20.951782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.947525+0000","last_change":"2023-11-04T01:37:20.947525+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.947525+0000","last_undegraded":"2023-11-04T01:37:20.947525+0000","last_fullsized":"2023-11-04T01:37:20.947525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945719+0000","last_change":"2023-11-04T01:37:20.945719+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945719+0000","last_undegraded":"2023-11-04T01:37:20.945719+0000","last_fullsized":"2023-11-04T01:37:20.945719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951017+0000","last_change":"2023-11-04T01:37:20.951017+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951017+0000","last_undegraded":"2023-11-04T01:37:20.951017+0000","last_fullsized":"2023-11-04T01:37:20.951017+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944094+0000","last_change":"2023-11-04T01:37:20.944094+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944094+0000","last_undegraded":"2023-11-04T01:37:20.944094+0000","last_fullsized":"2023-11-04T01:37:20.944094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948816+0000","last_change":"2023-11-04T01:37:20.948816+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948816+0000","last_undegraded":"2023-11-04T01:37:20.948816+0000","last_fullsized":"2023-11-04T01:37:20.948816+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951314+0000","last_change":"2023-11-04T01:37:20.951314+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951314+0000","last_undegraded":"2023-11-04T01:37:20.951314+0000","last_fullsized":"2023-11-04T01:37:20.951314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944249+0000","last_change":"2023-11-04T01:37:20.944249+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944249+0000","last_undegraded":"2023-11-04T01:37:20.944249+0000","last_fullsized":"2023-11-04T01:37:20.944249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944749+0000","last_change":"2023-11-04T01:37:20.944749+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944749+0000","last_undegraded":"2023-11-04T01:37:20.944749+0000","last_fullsized":"2023-11-04T01:37:20.944749+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950616+0000","last_change":"2023-11-04T01:37:20.950616+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950616+0000","last_undegraded":"2023-11-04T01:37:20.950616+0000","last_fullsized":"2023-11-04T01:37:20.950616+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944595+0000","last_change":"2023-11-04T01:37:20.944595+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944595+0000","last_undegraded":"2023-11-04T01:37:20.944595+0000","last_fullsized":"2023-11-04T01:37:20.944595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940641+0000","last_change":"2023-11-04T01:37:20.940641+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940641+0000","last_undegraded":"2023-11-04T01:37:20.940641+0000","last_fullsized":"2023-11-04T01:37:20.940641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943560+0000","last_change":"2023-11-04T01:37:20.943560+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943560+0000","last_undegraded":"2023-11-04T01:37:20.943560+0000","last_fullsized":"2023-11-04T01:37:20.943560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950363+0000","last_change":"2023-11-04T01:37:20.950363+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950363+0000","last_undegraded":"2023-11-04T01:37:20.950363+0000","last_fullsized":"2023-11-04T01:37:20.950363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950695+0000","last_change":"2023-11-04T01:37:20.950695+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950695+0000","last_undegraded":"2023-11-04T01:37:20.950695+0000","last_fullsized":"2023-11-04T01:37:20.950695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.942081+0000","last_change":"2023-11-04T01:37:20.942081+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.942081+0000","last_undegraded":"2023-11-04T01:37:20.942081+0000","last_fullsized":"2023-11-04T01:37:20.942081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945020+0000","last_change":"2023-11-04T01:37:20.945020+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945020+0000","last_undegraded":"2023-11-04T01:37:20.945020+0000","last_fullsized":"2023-11-04T01:37:20.945020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941840+0000","last_change":"2023-11-04T01:37:20.941840+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941840+0000","last_undegraded":"2023-11-04T01:37:20.941840+0000","last_fullsized":"2023-11-04T01:37:20.941840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943634+0000","last_change":"2023-11-04T01:37:20.943634+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943634+0000","last_undegraded":"2023-11-04T01:37:20.943634+0000","last_fullsized":"2023-11-04T01:37:20.943634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.939369+0000","last_change":"2023-11-04T01:37:20.939369+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.939369+0000","last_undegraded":"2023-11-04T01:37:20.939369+0000","last_fullsized":"2023-11-04T01:37:20.939369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950275+0000","last_change":"2023-11-04T01:37:20.950275+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950275+0000","last_undegraded":"2023-11-04T01:37:20.950275+0000","last_fullsized":"2023-11-04T01:37:20.950275+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943717+0000","last_change":"2023-11-04T01:37:20.943717+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943717+0000","last_undegraded":"2023-11-04T01:37:20.943717+0000","last_fullsized":"2023-11-04T01:37:20.943717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.942243+0000","last_change":"2023-11-04T01:37:20.942243+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.942243+0000","last_undegraded":"2023-11-04T01:37:20.942243+0000","last_fullsized":"2023-11-04T01:37:20.942243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950535+0000","last_change":"2023-11-04T01:37:20.950535+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950535+0000","last_undegraded":"2023-11-04T01:37:20.950535+0000","last_fullsized":"2023-11-04T01:37:20.950535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941482+0000","last_change":"2023-11-04T01:37:20.941482+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941482+0000","last_undegraded":"2023-11-04T01:37:20.941482+0000","last_fullsized":"2023-11-04T01:37:20.941482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944621+0000","last_change":"2023-11-04T01:37:20.944621+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944621+0000","last_undegraded":"2023-11-04T01:37:20.944621+0000","last_fullsized":"2023-11-04T01:37:20.944621+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941356+0000","last_change":"2023-11-04T01:37:20.941356+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941356+0000","last_undegraded":"2023-11-04T01:37:20.941356+0000","last_fullsized":"2023-11-04T01:37:20.941356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941238+0000","last_change":"2023-11-04T01:37:20.941238+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941238+0000","last_undegraded":"2023-11-04T01:37:20.941238+0000","last_fullsized":"2023-11-04T01:37:20.941238+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949361+0000","last_change":"2023-11-04T01:37:20.949361+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949361+0000","last_undegraded":"2023-11-04T01:37:20.949361+0000","last_fullsized":"2023-11-04T01:37:20.949361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948497+0000","last_change":"2023-11-04T01:37:20.948497+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948497+0000","last_undegraded":"2023-11-04T01:37:20.948497+0000","last_fullsized":"2023-11-04T01:37:20.948497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950780+0000","last_change":"2023-11-04T01:37:20.950780+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950780+0000","last_undegraded":"2023-11-04T01:37:20.950780+0000","last_fullsized":"2023-11-04T01:37:20.950780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.951671+0000","last_change":"2023-11-04T01:37:20.948850+0000","last_active":"2023-11-04T01:37:20.951671+0000","last_peered":"2023-11-04T01:37:20.951671+0000","last_clean":"2023-11-04T01:37:20.951671+0000","last_became_active":"2023-11-04T01:37:20.948589+0000","last_became_peered":"2023-11-04T01:37:20.948589+0000","last_unstale":"2023-11-04T01:37:20.951671+0000","last_undegraded":"2023-11-04T01:37:20.951671+0000","last_fullsized":"2023-11-04T01:37:20.951671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:15:44.156052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946971+0000","last_change":"2023-11-04T01:37:20.946971+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946971+0000","last_undegraded":"2023-11-04T01:37:20.946971+0000","last_fullsized":"2023-11-04T01:37:20.946971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959410+0000","last_change":"2023-11-04T01:37:20.957554+0000","last_active":"2023-11-04T01:37:20.959410+0000","last_peered":"2023-11-04T01:37:20.959410+0000","last_clean":"2023-11-04T01:37:20.959410+0000","last_became_active":"2023-11-04T01:37:20.957283+0000","last_became_peered":"2023-11-04T01:37:20.957283+0000","last_unstale":"2023-11-04T01:37:20.959410+0000","last_undegraded":"2023-11-04T01:37:20.959410+0000","last_fullsized":"2023-11-04T01:37:20.959410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:18.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.939649+0000","last_change":"2023-11-04T01:37:20.939649+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.939649+0000","last_undegraded":"2023-11-04T01:37:20.939649+0000","last_fullsized":"2023-11-04T01:37:20.939649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953317+0000","last_change":"2023-11-04T01:37:20.951123+0000","last_active":"2023-11-04T01:37:20.953317+0000","last_peered":"2023-11-04T01:37:20.953317+0000","last_clean":"2023-11-04T01:37:20.953317+0000","last_became_active":"2023-11-04T01:37:20.950796+0000","last_became_peered":"2023-11-04T01:37:20.950796+0000","last_unstale":"2023-11-04T01:37:20.953317+0000","last_undegraded":"2023-11-04T01:37:20.953317+0000","last_fullsized":"2023-11-04T01:37:20.953317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:20:25.874532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948800+0000","last_change":"2023-11-04T01:37:20.948800+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948800+0000","last_undegraded":"2023-11-04T01:37:20.948800+0000","last_fullsized":"2023-11-04T01:37:20.948800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.947315+0000","last_change":"2023-11-04T01:37:20.946610+0000","last_active":"2023-11-04T01:37:20.947315+0000","last_peered":"2023-11-04T01:37:20.947315+0000","last_clean":"2023-11-04T01:37:20.947315+0000","last_became_active":"2023-11-04T01:37:20.946320+0000","last_became_peered":"2023-11-04T01:37:20.946320+0000","last_unstale":"2023-11-04T01:37:20.947315+0000","last_undegraded":"2023-11-04T01:37:20.947315+0000","last_fullsized":"2023-11-04T01:37:20.947315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:15:44.156052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950057+0000","last_change":"2023-11-04T01:37:20.950057+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950057+0000","last_undegraded":"2023-11-04T01:37:20.950057+0000","last_fullsized":"2023-11-04T01:37:20.950057+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962206+0000","last_change":"2023-11-04T01:37:20.958166+0000","last_active":"2023-11-04T01:37:20.962206+0000","last_peered":"2023-11-04T01:37:20.962206+0000","last_clean":"2023-11-04T01:37:20.962206+0000","last_became_active":"2023-11-04T01:37:20.957832+0000","last_became_peered":"2023-11-04T01:37:20.957832+0000","last_unstale":"2023-11-04T01:37:20.962206+0000","last_undegraded":"2023-11-04T01:37:20.962206+0000","last_fullsized":"2023-11-04T01:37:20.962206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:55.724864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943131+0000","last_change":"2023-11-04T01:37:20.943131+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943131+0000","last_undegraded":"2023-11-04T01:37:20.943131+0000","last_fullsized":"2023-11-04T01:37:20.943131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962277+0000","last_change":"2023-11-04T01:37:20.958018+0000","last_active":"2023-11-04T01:37:20.962277+0000","last_peered":"2023-11-04T01:37:20.962277+0000","last_clean":"2023-11-04T01:37:20.962277+0000","last_became_active":"2023-11-04T01:37:20.957734+0000","last_became_peered":"2023-11-04T01:37:20.957734+0000","last_unstale":"2023-11-04T01:37:20.962277+0000","last_undegraded":"2023-11-04T01:37:20.962277+0000","last_fullsized":"2023-11-04T01:37:20.962277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:25.355203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.939903+0000","last_change":"2023-11-04T01:37:20.939903+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.939903+0000","last_undegraded":"2023-11-04T01:37:20.939903+0000","last_fullsized":"2023-11-04T01:37:20.939903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953179+0000","last_change":"2023-11-04T01:37:20.951909+0000","last_active":"2023-11-04T01:37:20.953179+0000","last_peered":"2023-11-04T01:37:20.953179+0000","last_clean":"2023-11-04T01:37:20.953179+0000","last_became_active":"2023-11-04T01:37:20.951595+0000","last_became_peered":"2023-11-04T01:37:20.951595+0000","last_unstale":"2023-11-04T01:37:20.953179+0000","last_undegraded":"2023-11-04T01:37:20.953179+0000","last_fullsized":"2023-11-04T01:37:20.953179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:25.355203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948012+0000","last_change":"2023-11-04T01:37:20.948012+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948012+0000","last_undegraded":"2023-11-04T01:37:20.948012+0000","last_fullsized":"2023-11-04T01:37:20.948012+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.950590+0000","last_change":"2023-11-04T01:37:20.948666+0000","last_active":"2023-11-04T01:37:20.950590+0000","last_peered":"2023-11-04T01:37:20.950590+0000","last_clean":"2023-11-04T01:37:20.950590+0000","last_became_active":"2023-11-04T01:37:20.948379+0000","last_became_peered":"2023-11-04T01:37:20.948379+0000","last_unstale":"2023-11-04T01:37:20.950590+0000","last_undegraded":"2023-11-04T01:37:20.950590+0000","last_fullsized":"2023-11-04T01:37:20.950590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:00.482538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944553+0000","last_change":"2023-11-04T01:37:20.944553+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944553+0000","last_undegraded":"2023-11-04T01:37:20.944553+0000","last_fullsized":"2023-11-04T01:37:20.944553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959272+0000","last_change":"2023-11-04T01:37:20.951039+0000","last_active":"2023-11-04T01:37:20.959272+0000","last_peered":"2023-11-04T01:37:20.959272+0000","last_clean":"2023-11-04T01:37:20.959272+0000","last_became_active":"2023-11-04T01:37:20.950768+0000","last_became_peered":"2023-11-04T01:37:20.950768+0000","last_unstale":"2023-11-04T01:37:20.959272+0000","last_undegraded":"2023-11-04T01:37:20.959272+0000","last_fullsized":"2023-11-04T01:37:20.959272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:42.847107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951525+0000","last_change":"2023-11-04T01:37:20.951525+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951525+0000","last_undegraded":"2023-11-04T01:37:20.951525+0000","last_fullsized":"2023-11-04T01:37:20.951525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957314+0000","last_change":"2023-11-04T01:37:20.953603+0000","last_active":"2023-11-04T01:37:20.957314+0000","last_peered":"2023-11-04T01:37:20.957314+0000","last_clean":"2023-11-04T01:37:20.957314+0000","last_became_active":"2023-11-04T01:37:20.953355+0000","last_became_peered":"2023-11-04T01:37:20.953355+0000","last_unstale":"2023-11-04T01:37:20.957314+0000","last_undegraded":"2023-11-04T01:37:20.957314+0000","last_fullsized":"2023-11-04T01:37:20.957314+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:42.847107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950439+0000","last_change":"2023-11-04T01:37:20.950439+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950439+0000","last_undegraded":"2023-11-04T01:37:20.950439+0000","last_fullsized":"2023-11-04T01:37:20.950439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957274+0000","last_change":"2023-11-04T01:37:20.951932+0000","last_active":"2023-11-04T01:37:20.957274+0000","last_peered":"2023-11-04T01:37:20.957274+0000","last_clean":"2023-11-04T01:37:20.957274+0000","last_became_active":"2023-11-04T01:37:20.951672+0000","last_became_peered":"2023-11-04T01:37:20.951672+0000","last_unstale":"2023-11-04T01:37:20.957274+0000","last_undegraded":"2023-11-04T01:37:20.957274+0000","last_fullsized":"2023-11-04T01:37:20.957274+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:18.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940748+0000","last_change":"2023-11-04T01:37:20.940748+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940748+0000","last_undegraded":"2023-11-04T01:37:20.940748+0000","last_fullsized":"2023-11-04T01:37:20.940748+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959474+0000","last_change":"2023-11-04T01:37:20.957547+0000","last_active":"2023-11-04T01:37:20.959474+0000","last_peered":"2023-11-04T01:37:20.959474+0000","last_clean":"2023-11-04T01:37:20.959474+0000","last_became_active":"2023-11-04T01:37:20.957264+0000","last_became_peered":"2023-11-04T01:37:20.957264+0000","last_unstale":"2023-11-04T01:37:20.959474+0000","last_undegraded":"2023-11-04T01:37:20.959474+0000","last_fullsized":"2023-11-04T01:37:20.959474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:57:28.939429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949170+0000","last_change":"2023-11-04T01:37:20.949170+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949170+0000","last_undegraded":"2023-11-04T01:37:20.949170+0000","last_fullsized":"2023-11-04T01:37:20.949170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959449+0000","last_change":"2023-11-04T01:37:20.957462+0000","last_active":"2023-11-04T01:37:20.959449+0000","last_peered":"2023-11-04T01:37:20.959449+0000","last_clean":"2023-11-04T01:37:20.959449+0000","last_became_active":"2023-11-04T01:37:20.957172+0000","last_became_peered":"2023-11-04T01:37:20.957172+0000","last_unstale":"2023-11-04T01:37:20.959449+0000","last_undegraded":"2023-11-04T01:37:20.959449+0000","last_fullsized":"2023-11-04T01:37:20.959449+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:03.376922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946705+0000","last_change":"2023-11-04T01:37:20.946705+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946705+0000","last_undegraded":"2023-11-04T01:37:20.946705+0000","last_fullsized":"2023-11-04T01:37:20.946705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953259+0000","last_change":"2023-11-04T01:37:20.951880+0000","last_active":"2023-11-04T01:37:20.953259+0000","last_peered":"2023-11-04T01:37:20.953259+0000","last_clean":"2023-11-04T01:37:20.953259+0000","last_became_active":"2023-11-04T01:37:20.951551+0000","last_became_peered":"2023-11-04T01:37:20.951551+0000","last_unstale":"2023-11-04T01:37:20.953259+0000","last_undegraded":"2023-11-04T01:37:20.953259+0000","last_fullsized":"2023-11-04T01:37:20.953259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949390+0000","last_change":"2023-11-04T01:37:20.949390+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949390+0000","last_undegraded":"2023-11-04T01:37:20.949390+0000","last_fullsized":"2023-11-04T01:37:20.949390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.950729+0000","last_change":"2023-11-04T01:37:20.946684+0000","last_active":"2023-11-04T01:37:20.950729+0000","last_peered":"2023-11-04T01:37:20.950729+0000","last_clean":"2023-11-04T01:37:20.950729+0000","last_became_active":"2023-11-04T01:37:20.946206+0000","last_became_peered":"2023-11-04T01:37:20.946206+0000","last_unstale":"2023-11-04T01:37:20.950729+0000","last_undegraded":"2023-11-04T01:37:20.950729+0000","last_fullsized":"2023-11-04T01:37:20.950729+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:13:11.543891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946949+0000","last_change":"2023-11-04T01:37:20.946949+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946949+0000","last_undegraded":"2023-11-04T01:37:20.946949+0000","last_fullsized":"2023-11-04T01:37:20.946949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962618+0000","last_change":"2023-11-04T01:37:20.960179+0000","last_active":"2023-11-04T01:37:20.962618+0000","last_peered":"2023-11-04T01:37:20.962618+0000","last_clean":"2023-11-04T01:37:20.962618+0000","last_became_active":"2023-11-04T01:37:20.959900+0000","last_became_peered":"2023-11-04T01:37:20.959900+0000","last_unstale":"2023-11-04T01:37:20.962618+0000","last_undegraded":"2023-11-04T01:37:20.962618+0000","last_fullsized":"2023-11-04T01:37:20.962618+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:20:25.874532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946705+0000","last_change":"2023-11-04T01:37:20.946705+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946705+0000","last_undegraded":"2023-11-04T01:37:20.946705+0000","last_fullsized":"2023-11-04T01:37:20.946705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.951304+0000","last_change":"2023-11-04T01:37:20.947847+0000","last_active":"2023-11-04T01:37:20.951304+0000","last_peered":"2023-11-04T01:37:20.951304+0000","last_clean":"2023-11-04T01:37:20.951304+0000","last_became_active":"2023-11-04T01:37:20.947565+0000","last_became_peered":"2023-11-04T01:37:20.947565+0000","last_unstale":"2023-11-04T01:37:20.951304+0000","last_undegraded":"2023-11-04T01:37:20.951304+0000","last_fullsized":"2023-11-04T01:37:20.951304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:51.912669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943416+0000","last_change":"2023-11-04T01:37:20.943416+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943416+0000","last_undegraded":"2023-11-04T01:37:20.943416+0000","last_fullsized":"2023-11-04T01:37:20.943416+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.954457+0000","last_change":"2023-11-04T01:37:20.950827+0000","last_active":"2023-11-04T01:37:20.954457+0000","last_peered":"2023-11-04T01:37:20.954457+0000","last_clean":"2023-11-04T01:37:20.954457+0000","last_became_active":"2023-11-04T01:37:20.950575+0000","last_became_peered":"2023-11-04T01:37:20.950575+0000","last_unstale":"2023-11-04T01:37:20.954457+0000","last_undegraded":"2023-11-04T01:37:20.954457+0000","last_fullsized":"2023-11-04T01:37:20.954457+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:20:01.127723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940112+0000","last_change":"2023-11-04T01:37:20.940112+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940112+0000","last_undegraded":"2023-11-04T01:37:20.940112+0000","last_fullsized":"2023-11-04T01:37:20.940112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.960190+0000","last_change":"2023-11-04T01:37:20.959217+0000","last_active":"2023-11-04T01:37:20.960190+0000","last_peered":"2023-11-04T01:37:20.960190+0000","last_clean":"2023-11-04T01:37:20.960190+0000","last_became_active":"2023-11-04T01:37:20.958336+0000","last_became_peered":"2023-11-04T01:37:20.958336+0000","last_unstale":"2023-11-04T01:37:20.960190+0000","last_undegraded":"2023-11-04T01:37:20.960190+0000","last_fullsized":"2023-11-04T01:37:20.960190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:03:48.533243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944682+0000","last_change":"2023-11-04T01:37:20.944682+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944682+0000","last_undegraded":"2023-11-04T01:37:20.944682+0000","last_fullsized":"2023-11-04T01:37:20.944682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953210+0000","last_change":"2023-11-04T01:37:20.950464+0000","last_active":"2023-11-04T01:37:20.953210+0000","last_peered":"2023-11-04T01:37:20.953210+0000","last_clean":"2023-11-04T01:37:20.953210+0000","last_became_active":"2023-11-04T01:37:20.950133+0000","last_became_peered":"2023-11-04T01:37:20.950133+0000","last_unstale":"2023-11-04T01:37:20.953210+0000","last_undegraded":"2023-11-04T01:37:20.953210+0000","last_fullsized":"2023-11-04T01:37:20.953210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:44.200233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949983+0000","last_change":"2023-11-04T01:37:20.949983+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949983+0000","last_undegraded":"2023-11-04T01:37:20.949983+0000","last_fullsized":"2023-11-04T01:37:20.949983+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.958220+0000","last_change":"2023-11-04T01:37:20.955294+0000","last_active":"2023-11-04T01:37:20.958220+0000","last_peered":"2023-11-04T01:37:20.958220+0000","last_clean":"2023-11-04T01:37:20.958220+0000","last_became_active":"2023-11-04T01:37:20.955019+0000","last_became_peered":"2023-11-04T01:37:20.955019+0000","last_unstale":"2023-11-04T01:37:20.958220+0000","last_undegraded":"2023-11-04T01:37:20.958220+0000","last_fullsized":"2023-11-04T01:37:20.958220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:53.772500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.947499+0000","last_change":"2023-11-04T01:37:20.947499+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.947499+0000","last_undegraded":"2023-11-04T01:37:20.947499+0000","last_fullsized":"2023-11-04T01:37:20.947499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.956263+0000","last_change":"2023-11-04T01:37:20.952410+0000","last_active":"2023-11-04T01:37:20.956263+0000","last_peered":"2023-11-04T01:37:20.956263+0000","last_clean":"2023-11-04T01:37:20.956263+0000","last_became_active":"2023-11-04T01:37:20.952143+0000","last_became_peered":"2023-11-04T01:37:20.952143+0000","last_unstale":"2023-11-04T01:37:20.956263+0000","last_undegraded":"2023-11-04T01:37:20.956263+0000","last_fullsized":"2023-11-04T01:37:20.956263+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:05:40.366579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.942494+0000","last_change":"2023-11-04T01:37:20.942494+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.942494+0000","last_undegraded":"2023-11-04T01:37:20.942494+0000","last_fullsized":"2023-11-04T01:37:20.942494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962232+0000","last_change":"2023-11-04T01:37:20.957857+0000","last_active":"2023-11-04T01:37:20.962232+0000","last_peered":"2023-11-04T01:37:20.962232+0000","last_clean":"2023-11-04T01:37:20.962232+0000","last_became_active":"2023-11-04T01:37:20.957415+0000","last_became_peered":"2023-11-04T01:37:20.957415+0000","last_unstale":"2023-11-04T01:37:20.962232+0000","last_undegraded":"2023-11-04T01:37:20.962232+0000","last_fullsized":"2023-11-04T01:37:20.962232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:55.724864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946189+0000","last_change":"2023-11-04T01:37:20.946189+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946189+0000","last_undegraded":"2023-11-04T01:37:20.946189+0000","last_fullsized":"2023-11-04T01:37:20.946189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.960780+0000","last_change":"2023-11-04T01:37:20.958969+0000","last_active":"2023-11-04T01:37:20.960780+0000","last_peered":"2023-11-04T01:37:20.960780+0000","last_clean":"2023-11-04T01:37:20.960780+0000","last_became_active":"2023-11-04T01:37:20.958656+0000","last_became_peered":"2023-11-04T01:37:20.958656+0000","last_unstale":"2023-11-04T01:37:20.960780+0000","last_undegraded":"2023-11-04T01:37:20.960780+0000","last_fullsized":"2023-11-04T01:37:20.960780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:59:20.169775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946503+0000","last_change":"2023-11-04T01:37:20.946503+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946503+0000","last_undegraded":"2023-11-04T01:37:20.946503+0000","last_fullsized":"2023-11-04T01:37:20.946503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.956572+0000","last_change":"2023-11-04T01:37:20.951195+0000","last_active":"2023-11-04T01:37:20.956572+0000","last_peered":"2023-11-04T01:37:20.956572+0000","last_clean":"2023-11-04T01:37:20.956572+0000","last_became_active":"2023-11-04T01:37:20.950916+0000","last_became_peered":"2023-11-04T01:37:20.950916+0000","last_unstale":"2023-11-04T01:37:20.956572+0000","last_undegraded":"2023-11-04T01:37:20.956572+0000","last_fullsized":"2023-11-04T01:37:20.956572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951134+0000","last_change":"2023-11-04T01:37:20.951134+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951134+0000","last_undegraded":"2023-11-04T01:37:20.951134+0000","last_fullsized":"2023-11-04T01:37:20.951134+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957912+0000","last_change":"2023-11-04T01:37:20.954111+0000","last_active":"2023-11-04T01:37:20.957912+0000","last_peered":"2023-11-04T01:37:20.957912+0000","last_clean":"2023-11-04T01:37:20.957912+0000","last_became_active":"2023-11-04T01:37:20.953851+0000","last_became_peered":"2023-11-04T01:37:20.953851+0000","last_unstale":"2023-11-04T01:37:20.957912+0000","last_undegraded":"2023-11-04T01:37:20.957912+0000","last_fullsized":"2023-11-04T01:37:20.957912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:31.988502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945193+0000","last_change":"2023-11-04T01:37:20.945193+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945193+0000","last_undegraded":"2023-11-04T01:37:20.945193+0000","last_fullsized":"2023-11-04T01:37:20.945193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.960305+0000","last_change":"2023-11-04T01:37:20.958189+0000","last_active":"2023-11-04T01:37:20.960305+0000","last_peered":"2023-11-04T01:37:20.960305+0000","last_clean":"2023-11-04T01:37:20.960305+0000","last_became_active":"2023-11-04T01:37:20.957903+0000","last_became_peered":"2023-11-04T01:37:20.957903+0000","last_unstale":"2023-11-04T01:37:20.960305+0000","last_undegraded":"2023-11-04T01:37:20.960305+0000","last_fullsized":"2023-11-04T01:37:20.960305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948680+0000","last_change":"2023-11-04T01:37:20.948680+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948680+0000","last_undegraded":"2023-11-04T01:37:20.948680+0000","last_fullsized":"2023-11-04T01:37:20.948680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959762+0000","last_change":"2023-11-04T01:37:20.957300+0000","last_active":"2023-11-04T01:37:20.959762+0000","last_peered":"2023-11-04T01:37:20.959762+0000","last_clean":"2023-11-04T01:37:20.959762+0000","last_became_active":"2023-11-04T01:37:20.957035+0000","last_became_peered":"2023-11-04T01:37:20.957035+0000","last_unstale":"2023-11-04T01:37:20.959762+0000","last_undegraded":"2023-11-04T01:37:20.959762+0000","last_fullsized":"2023-11-04T01:37:20.959762+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:55.724864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945994+0000","last_change":"2023-11-04T01:37:20.945994+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945994+0000","last_undegraded":"2023-11-04T01:37:20.945994+0000","last_fullsized":"2023-11-04T01:37:20.945994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957141+0000","last_change":"2023-11-04T01:37:20.955263+0000","last_active":"2023-11-04T01:37:20.957141+0000","last_peered":"2023-11-04T01:37:20.957141+0000","last_clean":"2023-11-04T01:37:20.957141+0000","last_became_active":"2023-11-04T01:37:20.955015+0000","last_became_peered":"2023-11-04T01:37:20.955015+0000","last_unstale":"2023-11-04T01:37:20.957141+0000","last_undegraded":"2023-11-04T01:37:20.957141+0000","last_fullsized":"2023-11-04T01:37:20.957141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:00.482538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940263+0000","last_change":"2023-11-04T01:37:20.940263+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940263+0000","last_undegraded":"2023-11-04T01:37:20.940263+0000","last_fullsized":"2023-11-04T01:37:20.940263+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.945648+0000","last_change":"2023-11-04T01:37:20.944425+0000","last_active":"2023-11-04T01:37:20.945648+0000","last_peered":"2023-11-04T01:37:20.945648+0000","last_clean":"2023-11-04T01:37:20.945648+0000","last_became_active":"2023-11-04T01:37:20.944147+0000","last_became_peered":"2023-11-04T01:37:20.944147+0000","last_unstale":"2023-11-04T01:37:20.945648+0000","last_undegraded":"2023-11-04T01:37:20.945648+0000","last_fullsized":"2023-11-04T01:37:20.945648+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:13:11.543891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949823+0000","last_change":"2023-11-04T01:37:20.949823+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949823+0000","last_undegraded":"2023-11-04T01:37:20.949823+0000","last_fullsized":"2023-11-04T01:37:20.949823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959712+0000","last_change":"2023-11-04T01:37:20.953474+0000","last_active":"2023-11-04T01:37:20.959712+0000","last_peered":"2023-11-04T01:37:20.959712+0000","last_clean":"2023-11-04T01:37:20.959712+0000","last_became_active":"2023-11-04T01:37:20.953215+0000","last_became_peered":"2023-11-04T01:37:20.953215+0000","last_unstale":"2023-11-04T01:37:20.959712+0000","last_undegraded":"2023-11-04T01:37:20.959712+0000","last_fullsized":"2023-11-04T01:37:20.959712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:49.592008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943316+0000","last_change":"2023-11-04T01:37:20.943316+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943316+0000","last_undegraded":"2023-11-04T01:37:20.943316+0000","last_fullsized":"2023-11-04T01:37:20.943316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962376+0000","last_change":"2023-11-04T01:37:20.958978+0000","last_active":"2023-11-04T01:37:20.962376+0000","last_peered":"2023-11-04T01:37:20.962376+0000","last_clean":"2023-11-04T01:37:20.962376+0000","last_became_active":"2023-11-04T01:37:20.958778+0000","last_became_peered":"2023-11-04T01:37:20.958778+0000","last_unstale":"2023-11-04T01:37:20.962376+0000","last_undegraded":"2023-11-04T01:37:20.962376+0000","last_fullsized":"2023-11-04T01:37:20.962376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-04T01:37:19.935331+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:37:19.935331+0000","last_peered":"2023-11-04T01:37:19.935331+0000","last_clean":"2023-11-04T01:37:19.935331+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:37:19.935331+0000","last_undegraded":"2023-11-04T01:37:19.935331+0000","last_fullsized":"2023-11-04T01:37:19.935331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":770780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.42099999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.55300000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.64500000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.68999999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.503},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.72499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58299999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.40500000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.499}]},{"osd":3,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56899999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.39300000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.35399999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52300000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60799999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.32600000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.41699999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.438}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.53900000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.504}]},{"osd":2,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.64700000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.747}]},{"osd":7,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.628},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.76000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.314},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.26200000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.377}]},{"osd":4,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.53000000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46000000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.44600000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.57599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.247},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.27500000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.312},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.34100000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.37},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.41099999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.625},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.58099999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.224},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.32800000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.30399999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.25800000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.434}]},{"osd":5,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.41299999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.42499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1003520,"data_stored":763166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.40100000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.432}]},{"osd":3,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.38},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.754}]},{"osd":5,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76200000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:25.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-11-04T01:37:25.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.950338+0000', 'last_change': '2023-11-04T01:37:20.950338+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.950338+0000', 'last_undegraded': '2023-11-04T01:37:20.950338+0000', 'last_fullsized': '2023-11-04T01:37:20.950338+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:37:25.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-11-04T01:37:25.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.949625+0000', 'last_change': '2023-11-04T01:37:20.949625+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.949625+0000', 'last_undegraded': '2023-11-04T01:37:20.949625+0000', 'last_fullsized': '2023-11-04T01:37:20.949625+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:37:25.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-11-04T01:37:25.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.951782+0000', 'last_change': '2023-11-04T01:37:20.951782+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.951782+0000', 'last_undegraded': '2023-11-04T01:37:20.951782+0000', 'last_fullsized': '2023-11-04T01:37:20.951782+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:37:25.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-11-04T01:37:25.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.947525+0000', 'last_change': '2023-11-04T01:37:20.947525+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.947525+0000', 'last_undegraded': '2023-11-04T01:37:20.947525+0000', 'last_fullsized': '2023-11-04T01:37:20.947525+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:37:25.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-11-04T01:37:25.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.945719+0000', 'last_change': '2023-11-04T01:37:20.945719+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.945719+0000', 'last_undegraded': '2023-11-04T01:37:20.945719+0000', 'last_fullsized': '2023-11-04T01:37:20.945719+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:37:25.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-11-04T01:37:25.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.951017+0000', 'last_change': '2023-11-04T01:37:20.951017+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.951017+0000', 'last_undegraded': '2023-11-04T01:37:20.951017+0000', 'last_fullsized': '2023-11-04T01:37:20.951017+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:37:25.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-11-04T01:37:25.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.944094+0000', 'last_change': '2023-11-04T01:37:20.944094+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.944094+0000', 'last_undegraded': '2023-11-04T01:37:20.944094+0000', 'last_fullsized': '2023-11-04T01:37:20.944094+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:37:25.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-11-04T01:37:25.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.948816+0000', 'last_change': '2023-11-04T01:37:20.948816+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.948816+0000', 'last_undegraded': '2023-11-04T01:37:20.948816+0000', 'last_fullsized': '2023-11-04T01:37:20.948816+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:37:25.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-11-04T01:37:25.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.951314+0000', 'last_change': '2023-11-04T01:37:20.951314+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.951314+0000', 'last_undegraded': '2023-11-04T01:37:20.951314+0000', 'last_fullsized': '2023-11-04T01:37:20.951314+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:37:25.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-11-04T01:37:25.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.944249+0000', 'last_change': '2023-11-04T01:37:20.944249+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.944249+0000', 'last_undegraded': '2023-11-04T01:37:20.944249+0000', 'last_fullsized': '2023-11-04T01:37:20.944249+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:37:25.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-11-04T01:37:25.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.944749+0000', 'last_change': '2023-11-04T01:37:20.944749+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.944749+0000', 'last_undegraded': '2023-11-04T01:37:20.944749+0000', 'last_fullsized': '2023-11-04T01:37:20.944749+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:37:25.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-11-04T01:37:25.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.950616+0000', 'last_change': '2023-11-04T01:37:20.950616+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.950616+0000', 'last_undegraded': '2023-11-04T01:37:20.950616+0000', 'last_fullsized': '2023-11-04T01:37:20.950616+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:37:25.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-11-04T01:37:25.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.944595+0000', 'last_change': '2023-11-04T01:37:20.944595+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.944595+0000', 'last_undegraded': '2023-11-04T01:37:20.944595+0000', 'last_fullsized': '2023-11-04T01:37:20.944595+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:37:25.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-11-04T01:37:25.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.940641+0000', 'last_change': '2023-11-04T01:37:20.940641+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.940641+0000', 'last_undegraded': '2023-11-04T01:37:20.940641+0000', 'last_fullsized': '2023-11-04T01:37:20.940641+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:37:25.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-11-04T01:37:25.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.943560+0000', 'last_change': '2023-11-04T01:37:20.943560+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.943560+0000', 'last_undegraded': '2023-11-04T01:37:20.943560+0000', 'last_fullsized': '2023-11-04T01:37:20.943560+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:37:25.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-11-04T01:37:25.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.950363+0000', 'last_change': '2023-11-04T01:37:20.950363+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.950363+0000', 'last_undegraded': '2023-11-04T01:37:20.950363+0000', 'last_fullsized': '2023-11-04T01:37:20.950363+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:37:25.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-11-04T01:37:25.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.950695+0000', 'last_change': '2023-11-04T01:37:20.950695+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.950695+0000', 'last_undegraded': '2023-11-04T01:37:20.950695+0000', 'last_fullsized': '2023-11-04T01:37:20.950695+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:37:25.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-11-04T01:37:25.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.942081+0000', 'last_change': '2023-11-04T01:37:20.942081+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.942081+0000', 'last_undegraded': '2023-11-04T01:37:20.942081+0000', 'last_fullsized': '2023-11-04T01:37:20.942081+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:37:25.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-11-04T01:37:25.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.945020+0000', 'last_change': '2023-11-04T01:37:20.945020+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.945020+0000', 'last_undegraded': '2023-11-04T01:37:20.945020+0000', 'last_fullsized': '2023-11-04T01:37:20.945020+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:37:25.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-11-04T01:37:25.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.941840+0000', 'last_change': '2023-11-04T01:37:20.941840+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.941840+0000', 'last_undegraded': '2023-11-04T01:37:20.941840+0000', 'last_fullsized': '2023-11-04T01:37:20.941840+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:37:25.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-11-04T01:37:25.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.943634+0000', 'last_change': '2023-11-04T01:37:20.943634+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.943634+0000', 'last_undegraded': '2023-11-04T01:37:20.943634+0000', 'last_fullsized': '2023-11-04T01:37:20.943634+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:37:25.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-11-04T01:37:25.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.939369+0000', 'last_change': '2023-11-04T01:37:20.939369+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.939369+0000', 'last_undegraded': '2023-11-04T01:37:20.939369+0000', 'last_fullsized': '2023-11-04T01:37:20.939369+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:37:25.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-11-04T01:37:25.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.950275+0000', 'last_change': '2023-11-04T01:37:20.950275+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.950275+0000', 'last_undegraded': '2023-11-04T01:37:20.950275+0000', 'last_fullsized': '2023-11-04T01:37:20.950275+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:37:25.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-11-04T01:37:25.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.943717+0000', 'last_change': '2023-11-04T01:37:20.943717+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.943717+0000', 'last_undegraded': '2023-11-04T01:37:20.943717+0000', 'last_fullsized': '2023-11-04T01:37:20.943717+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:37:25.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-11-04T01:37:25.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.942243+0000', 'last_change': '2023-11-04T01:37:20.942243+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.942243+0000', 'last_undegraded': '2023-11-04T01:37:20.942243+0000', 'last_fullsized': '2023-11-04T01:37:20.942243+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:37:25.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-11-04T01:37:25.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.950535+0000', 'last_change': '2023-11-04T01:37:20.950535+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.950535+0000', 'last_undegraded': '2023-11-04T01:37:20.950535+0000', 'last_fullsized': '2023-11-04T01:37:20.950535+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:37:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-11-04T01:37:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.941482+0000', 'last_change': '2023-11-04T01:37:20.941482+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.941482+0000', 'last_undegraded': '2023-11-04T01:37:20.941482+0000', 'last_fullsized': '2023-11-04T01:37:20.941482+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:37:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-11-04T01:37:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.944621+0000', 'last_change': '2023-11-04T01:37:20.944621+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.944621+0000', 'last_undegraded': '2023-11-04T01:37:20.944621+0000', 'last_fullsized': '2023-11-04T01:37:20.944621+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:37:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-11-04T01:37:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.941356+0000', 'last_change': '2023-11-04T01:37:20.941356+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.941356+0000', 'last_undegraded': '2023-11-04T01:37:20.941356+0000', 'last_fullsized': '2023-11-04T01:37:20.941356+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:37:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-11-04T01:37:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.941238+0000', 'last_change': '2023-11-04T01:37:20.941238+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.941238+0000', 'last_undegraded': '2023-11-04T01:37:20.941238+0000', 'last_fullsized': '2023-11-04T01:37:20.941238+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:37:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-11-04T01:37:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.949361+0000', 'last_change': '2023-11-04T01:37:20.949361+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.949361+0000', 'last_undegraded': '2023-11-04T01:37:20.949361+0000', 'last_fullsized': '2023-11-04T01:37:20.949361+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:37:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-11-04T01:37:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.948497+0000', 'last_change': '2023-11-04T01:37:20.948497+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.948497+0000', 'last_undegraded': '2023-11-04T01:37:20.948497+0000', 'last_fullsized': '2023-11-04T01:37:20.948497+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:37:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-11-04T01:37:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.950780+0000', 'last_change': '2023-11-04T01:37:20.950780+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.950780+0000', 'last_undegraded': '2023-11-04T01:37:20.950780+0000', 'last_fullsized': '2023-11-04T01:37:20.950780+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:37:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-11-04T01:37:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.946971+0000', 'last_change': '2023-11-04T01:37:20.946971+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.946971+0000', 'last_undegraded': '2023-11-04T01:37:20.946971+0000', 'last_fullsized': '2023-11-04T01:37:20.946971+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:37:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-11-04T01:37:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.939649+0000', 'last_change': '2023-11-04T01:37:20.939649+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.939649+0000', 'last_undegraded': '2023-11-04T01:37:20.939649+0000', 'last_fullsized': '2023-11-04T01:37:20.939649+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:37:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-11-04T01:37:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.948800+0000', 'last_change': '2023-11-04T01:37:20.948800+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.948800+0000', 'last_undegraded': '2023-11-04T01:37:20.948800+0000', 'last_fullsized': '2023-11-04T01:37:20.948800+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:37:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-11-04T01:37:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.950057+0000', 'last_change': '2023-11-04T01:37:20.950057+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.950057+0000', 'last_undegraded': '2023-11-04T01:37:20.950057+0000', 'last_fullsized': '2023-11-04T01:37:20.950057+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:37:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-11-04T01:37:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.943131+0000', 'last_change': '2023-11-04T01:37:20.943131+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.943131+0000', 'last_undegraded': '2023-11-04T01:37:20.943131+0000', 'last_fullsized': '2023-11-04T01:37:20.943131+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:37:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-11-04T01:37:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.939903+0000', 'last_change': '2023-11-04T01:37:20.939903+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.939903+0000', 'last_undegraded': '2023-11-04T01:37:20.939903+0000', 'last_fullsized': '2023-11-04T01:37:20.939903+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:37:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-11-04T01:37:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.948012+0000', 'last_change': '2023-11-04T01:37:20.948012+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.948012+0000', 'last_undegraded': '2023-11-04T01:37:20.948012+0000', 'last_fullsized': '2023-11-04T01:37:20.948012+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:37:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-11-04T01:37:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.944553+0000', 'last_change': '2023-11-04T01:37:20.944553+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.944553+0000', 'last_undegraded': '2023-11-04T01:37:20.944553+0000', 'last_fullsized': '2023-11-04T01:37:20.944553+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:37:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-11-04T01:37:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.951525+0000', 'last_change': '2023-11-04T01:37:20.951525+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.951525+0000', 'last_undegraded': '2023-11-04T01:37:20.951525+0000', 'last_fullsized': '2023-11-04T01:37:20.951525+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:37:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-11-04T01:37:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.950439+0000', 'last_change': '2023-11-04T01:37:20.950439+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.950439+0000', 'last_undegraded': '2023-11-04T01:37:20.950439+0000', 'last_fullsized': '2023-11-04T01:37:20.950439+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:37:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-11-04T01:37:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.940748+0000', 'last_change': '2023-11-04T01:37:20.940748+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.940748+0000', 'last_undegraded': '2023-11-04T01:37:20.940748+0000', 'last_fullsized': '2023-11-04T01:37:20.940748+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:37:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-11-04T01:37:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.949170+0000', 'last_change': '2023-11-04T01:37:20.949170+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.949170+0000', 'last_undegraded': '2023-11-04T01:37:20.949170+0000', 'last_fullsized': '2023-11-04T01:37:20.949170+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:37:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-11-04T01:37:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.946705+0000', 'last_change': '2023-11-04T01:37:20.946705+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.946705+0000', 'last_undegraded': '2023-11-04T01:37:20.946705+0000', 'last_fullsized': '2023-11-04T01:37:20.946705+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:37:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-11-04T01:37:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.949390+0000', 'last_change': '2023-11-04T01:37:20.949390+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.949390+0000', 'last_undegraded': '2023-11-04T01:37:20.949390+0000', 'last_fullsized': '2023-11-04T01:37:20.949390+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:37:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-11-04T01:37:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.946949+0000', 'last_change': '2023-11-04T01:37:20.946949+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.946949+0000', 'last_undegraded': '2023-11-04T01:37:20.946949+0000', 'last_fullsized': '2023-11-04T01:37:20.946949+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:37:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-11-04T01:37:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.946705+0000', 'last_change': '2023-11-04T01:37:20.946705+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.946705+0000', 'last_undegraded': '2023-11-04T01:37:20.946705+0000', 'last_fullsized': '2023-11-04T01:37:20.946705+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:37:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-11-04T01:37:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.943416+0000', 'last_change': '2023-11-04T01:37:20.943416+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.943416+0000', 'last_undegraded': '2023-11-04T01:37:20.943416+0000', 'last_fullsized': '2023-11-04T01:37:20.943416+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:37:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-11-04T01:37:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.940112+0000', 'last_change': '2023-11-04T01:37:20.940112+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.940112+0000', 'last_undegraded': '2023-11-04T01:37:20.940112+0000', 'last_fullsized': '2023-11-04T01:37:20.940112+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:37:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-11-04T01:37:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.944682+0000', 'last_change': '2023-11-04T01:37:20.944682+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.944682+0000', 'last_undegraded': '2023-11-04T01:37:20.944682+0000', 'last_fullsized': '2023-11-04T01:37:20.944682+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:37:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-11-04T01:37:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.949983+0000', 'last_change': '2023-11-04T01:37:20.949983+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.949983+0000', 'last_undegraded': '2023-11-04T01:37:20.949983+0000', 'last_fullsized': '2023-11-04T01:37:20.949983+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:37:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-11-04T01:37:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.947499+0000', 'last_change': '2023-11-04T01:37:20.947499+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.947499+0000', 'last_undegraded': '2023-11-04T01:37:20.947499+0000', 'last_fullsized': '2023-11-04T01:37:20.947499+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:37:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-11-04T01:37:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.942494+0000', 'last_change': '2023-11-04T01:37:20.942494+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.942494+0000', 'last_undegraded': '2023-11-04T01:37:20.942494+0000', 'last_fullsized': '2023-11-04T01:37:20.942494+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:37:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-11-04T01:37:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.946189+0000', 'last_change': '2023-11-04T01:37:20.946189+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.946189+0000', 'last_undegraded': '2023-11-04T01:37:20.946189+0000', 'last_fullsized': '2023-11-04T01:37:20.946189+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:37:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-11-04T01:37:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.946503+0000', 'last_change': '2023-11-04T01:37:20.946503+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.946503+0000', 'last_undegraded': '2023-11-04T01:37:20.946503+0000', 'last_fullsized': '2023-11-04T01:37:20.946503+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:37:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-11-04T01:37:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.951134+0000', 'last_change': '2023-11-04T01:37:20.951134+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.951134+0000', 'last_undegraded': '2023-11-04T01:37:20.951134+0000', 'last_fullsized': '2023-11-04T01:37:20.951134+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:37:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-11-04T01:37:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.945193+0000', 'last_change': '2023-11-04T01:37:20.945193+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.945193+0000', 'last_undegraded': '2023-11-04T01:37:20.945193+0000', 'last_fullsized': '2023-11-04T01:37:20.945193+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:37:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-11-04T01:37:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.948680+0000', 'last_change': '2023-11-04T01:37:20.948680+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.948680+0000', 'last_undegraded': '2023-11-04T01:37:20.948680+0000', 'last_fullsized': '2023-11-04T01:37:20.948680+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:37:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-11-04T01:37:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.945994+0000', 'last_change': '2023-11-04T01:37:20.945994+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.945994+0000', 'last_undegraded': '2023-11-04T01:37:20.945994+0000', 'last_fullsized': '2023-11-04T01:37:20.945994+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:37:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-11-04T01:37:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.940263+0000', 'last_change': '2023-11-04T01:37:20.940263+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.940263+0000', 'last_undegraded': '2023-11-04T01:37:20.940263+0000', 'last_fullsized': '2023-11-04T01:37:20.940263+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:37:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-11-04T01:37:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.949823+0000', 'last_change': '2023-11-04T01:37:20.949823+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.949823+0000', 'last_undegraded': '2023-11-04T01:37:20.949823+0000', 'last_fullsized': '2023-11-04T01:37:20.949823+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:37:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-11-04T01:37:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:37:20.943316+0000', 'last_change': '2023-11-04T01:37:20.943316+0000', 'last_active': '2023-11-04T01:37:20.931762+0000', 'last_peered': '2023-11-04T01:37:20.931762+0000', 'last_clean': '2023-11-04T01:37:20.931762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:37:20.943316+0000', 'last_undegraded': '2023-11-04T01:37:20.943316+0000', 'last_fullsized': '2023-11-04T01:37:20.943316+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'last_clean_scrub_stamp': '2023-11-04T01:37:20.931762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:37:25.678 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-04T01:37:25.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.798+0000 7fb77bf25640 1 Processor -- start 2023-11-04T01:37:25.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.798+0000 7fb77bf25640 1 -- start start 2023-11-04T01:37:25.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.799+0000 7fb77bf25640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7740cde60 0x7fb77415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.799+0000 7fb77bf25640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7740ce240 0x7fb7740d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.799+0000 7fb77bf25640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77415e000 con 0x7fb77415daa0 2023-11-04T01:37:25.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.799+0000 7fb77bf25640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77415e5c0 con 0x7fb7740ce240 2023-11-04T01:37:25.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.799+0000 7fb77bf25640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77415e2e0 con 0x7fb7740cde60 2023-11-04T01:37:25.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.799+0000 7fb77a4c2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7740ce240 0x7fb7740d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.799+0000 7fb77a4c2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7740ce240 0x7fb7740d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41590/0 (socket says 172.21.15.44:41590) 2023-11-04T01:37:25.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.799+0000 7fb77a4c2640 1 -- 172.21.15.44:0/2303600671 learned_addr learned my addr 172.21.15.44:0/2303600671 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:25.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.800+0000 7fb779cc1640 1 --2- 172.21.15.44:0/2303600671 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7740cde60 0x7fb77415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.800+0000 7fb77a4c2640 1 -- 172.21.15.44:0/2303600671 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7740cde60 msgr2=0x7fb77415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.800+0000 7fb77a4c2640 1 --2- 172.21.15.44:0/2303600671 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7740cde60 0x7fb77415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.800+0000 7fb77a4c2640 1 -- 172.21.15.44:0/2303600671 >> v1:172.21.15.204:6789/0 conn(0x7fb77415daa0 legacy=0x7fb774157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.800+0000 7fb77a4c2640 1 -- 172.21.15.44:0/2303600671 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7740d1120 con 0x7fb7740ce240 2023-11-04T01:37:25.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.800+0000 7fb779cc1640 1 --2- 172.21.15.44:0/2303600671 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7740cde60 0x7fb77415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:25.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.800+0000 7fb77a4c2640 1 --2- 172.21.15.44:0/2303600671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7740ce240 0x7fb7740d1920 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb770009e50 tx=0x7fb77002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0d47b93d8c1c87 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.801+0000 7fb778cbf640 1 -- 172.21.15.44:0/2303600671 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77002ca70 con 0x7fb7740ce240 2023-11-04T01:37:25.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.801+0000 7fb778cbf640 1 -- 172.21.15.44:0/2303600671 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77002cbd0 con 0x7fb7740ce240 2023-11-04T01:37:25.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.801+0000 7fb778cbf640 1 -- 172.21.15.44:0/2303600671 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7700343f0 con 0x7fb7740ce240 2023-11-04T01:37:25.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.801+0000 7fb77bf25640 1 -- 172.21.15.44:0/2303600671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7740ce240 msgr2=0x7fb7740d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.801+0000 7fb77bf25640 1 --2- 172.21.15.44:0/2303600671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7740ce240 0x7fb7740d1920 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb770009e50 tx=0x7fb77002bed0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.801+0000 7fb77bf25640 1 -- 172.21.15.44:0/2303600671 shutdown_connections 2023-11-04T01:37:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.801+0000 7fb77bf25640 1 --2- 172.21.15.44:0/2303600671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7740ce240 0x7fb7740d1920 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.801+0000 7fb77bf25640 1 --2- 172.21.15.44:0/2303600671 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7740cde60 0x7fb77415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.801+0000 7fb77bf25640 1 -- 172.21.15.44:0/2303600671 >> 172.21.15.44:0/2303600671 conn(0x7fb774071f30 msgr2=0x7fb7740cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.801+0000 7fb77bf25640 1 -- 172.21.15.44:0/2303600671 shutdown_connections 2023-11-04T01:37:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.801+0000 7fb77bf25640 1 -- 172.21.15.44:0/2303600671 wait complete. 2023-11-04T01:37:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.802+0000 7fb77bf25640 1 Processor -- start 2023-11-04T01:37:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.802+0000 7fb77bf25640 1 -- start start 2023-11-04T01:37:25.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.803+0000 7fb77bf25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7740cde60 0x7fb774153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.803+0000 7fb77bf25640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7740ce240 0x7fb774151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.803+0000 7fb77bf25640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb77415daa0 0x7fb7740cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.803+0000 7fb77bf25640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740cd680 con 0x7fb7740cde60 2023-11-04T01:37:25.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.803+0000 7fb77bf25640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740cd3a0 con 0x7fb77415daa0 2023-11-04T01:37:25.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.803+0000 7fb77bf25640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7741526b0 con 0x7fb7740ce240 2023-11-04T01:37:25.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.803+0000 7fb779cc1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7740cde60 0x7fb774153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.803+0000 7fb779cc1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7740cde60 0x7fb774153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41602/0 (socket says 172.21.15.44:41602) 2023-11-04T01:37:25.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.803+0000 7fb779cc1640 1 -- 172.21.15.44:0/1425062674 learned_addr learned my addr 172.21.15.44:0/1425062674 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:25.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.803+0000 7fb7794c0640 1 --2- 172.21.15.44:0/1425062674 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7740ce240 0x7fb774151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.803+0000 7fb77a4c2640 1 --2- 172.21.15.44:0/1425062674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb77415daa0 0x7fb7740cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.804+0000 7fb779cc1640 1 -- 172.21.15.44:0/1425062674 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7740ce240 msgr2=0x7fb774151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.804+0000 7fb779cc1640 1 --2- 172.21.15.44:0/1425062674 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7740ce240 0x7fb774151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.804+0000 7fb779cc1640 1 -- 172.21.15.44:0/1425062674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb77415daa0 msgr2=0x7fb7740cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.804+0000 7fb779cc1640 1 --2- 172.21.15.44:0/1425062674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb77415daa0 0x7fb7740cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.804+0000 7fb779cc1640 1 -- 172.21.15.44:0/1425062674 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb770009b30 con 0x7fb7740cde60 2023-11-04T01:37:25.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.804+0000 7fb779cc1640 1 --2- 172.21.15.44:0/1425062674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7740cde60 0x7fb774153190 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00c7f0 tx=0x7fb76c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.804+0000 7fb76a7fc640 1 -- 172.21.15.44:0/1425062674 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c007a30 con 0x7fb7740cde60 2023-11-04T01:37:25.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.804+0000 7fb76a7fc640 1 -- 172.21.15.44:0/1425062674 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c007b90 con 0x7fb7740cde60 2023-11-04T01:37:25.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.804+0000 7fb76a7fc640 1 -- 172.21.15.44:0/1425062674 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00ce40 con 0x7fb7740cde60 2023-11-04T01:37:25.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.804+0000 7fb77bf25640 1 -- 172.21.15.44:0/1425062674 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb774152990 con 0x7fb7740cde60 2023-11-04T01:37:25.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.804+0000 7fb77bf25640 1 -- 172.21.15.44:0/1425062674 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb774151980 con 0x7fb7740cde60 2023-11-04T01:37:25.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.805+0000 7fb77bf25640 1 -- 172.21.15.44:0/1425062674 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb774152eb0 con 0x7fb7740cde60 2023-11-04T01:37:25.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.805+0000 7fb76a7fc640 1 -- 172.21.15.44:0/1425062674 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb76c0113f0 con 0x7fb7740cde60 2023-11-04T01:37:25.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.806+0000 7fb76a7fc640 1 --2- 172.21.15.44:0/1425062674 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb75806ae70 0x7fb75806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.806+0000 7fb76a7fc640 1 -- 172.21.15.44:0/1425062674 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb76c089950 con 0x7fb7740cde60 2023-11-04T01:37:25.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.806+0000 7fb7794c0640 1 --2- 172.21.15.44:0/1425062674 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb75806ae70 0x7fb75806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.806+0000 7fb7794c0640 1 --2- 172.21.15.44:0/1425062674 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb75806ae70 0x7fb75806d330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb764006fd0 tx=0x7fb764008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:25.810+0000 7fb76a7fc640 1 -- 172.21.15.44:0/1425062674 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb76c0548b0 con 0x7fb7740cde60 2023-11-04T01:37:26.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.056+0000 7fb77bf25640 1 -- 172.21.15.44:0/1425062674 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb774074290 con 0x7fb7740cde60 2023-11-04T01:37:26.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.057+0000 7fb76a7fc640 1 -- 172.21.15.44:0/1425062674 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1033 (secure 0 0 0) 0x7fb76c01f420 con 0x7fb7740cde60 2023-11-04T01:37:26.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:26.059 INFO:teuthology.orchestra.run.smithi044.stdout:{"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":111,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1699061745,"num_in_osds":8,"osd_in_since":1699061736,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225894400,"bytes_avail":772868218880,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5514}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-04T01:37:04.589410+0000","services":{}},"progress_events":{}} 2023-11-04T01:37:26.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.058+0000 7fb77bf25640 1 -- 172.21.15.44:0/1425062674 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb75806ae70 msgr2=0x7fb75806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.058+0000 7fb77bf25640 1 --2- 172.21.15.44:0/1425062674 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb75806ae70 0x7fb75806d330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb764006fd0 tx=0x7fb764008040 comp rx=0 tx=0).stop 2023-11-04T01:37:26.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.058+0000 7fb77bf25640 1 -- 172.21.15.44:0/1425062674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7740cde60 msgr2=0x7fb774153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.058+0000 7fb77bf25640 1 --2- 172.21.15.44:0/1425062674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7740cde60 0x7fb774153190 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00c7f0 tx=0x7fb76c00cbf0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.059+0000 7fb77bf25640 1 -- 172.21.15.44:0/1425062674 shutdown_connections 2023-11-04T01:37:26.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.059+0000 7fb77bf25640 1 --2- 172.21.15.44:0/1425062674 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb75806ae70 0x7fb75806d330 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.059+0000 7fb77bf25640 1 --2- 172.21.15.44:0/1425062674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb77415daa0 0x7fb7740cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.059+0000 7fb77bf25640 1 --2- 172.21.15.44:0/1425062674 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7740ce240 0x7fb774151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.059+0000 7fb77bf25640 1 --2- 172.21.15.44:0/1425062674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7740cde60 0x7fb774153190 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.059+0000 7fb77bf25640 1 -- 172.21.15.44:0/1425062674 >> 172.21.15.44:0/1425062674 conn(0x7fb774071f30 msgr2=0x7fb7740d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.059+0000 7fb77bf25640 1 -- 172.21.15.44:0/1425062674 shutdown_connections 2023-11-04T01:37:26.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.059+0000 7fb77bf25640 1 -- 172.21.15.44:0/1425062674 wait complete. 2023-11-04T01:37:26.073 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-04T01:37:26.073 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:26.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.177+0000 7f3c17e94640 1 Processor -- start 2023-11-04T01:37:26.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.178+0000 7f3c17e94640 1 -- start start 2023-11-04T01:37:26.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.178+0000 7f3c17e94640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3c100ce240 0x7f3c10157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.179+0000 7f3c17e94640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c1015e000 con 0x7f3c100cde60 2023-11-04T01:37:26.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.179+0000 7f3c17e94640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c1015e2e0 con 0x7f3c10157540 2023-11-04T01:37:26.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.179+0000 7f3c17e94640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c1015e5c0 con 0x7f3c100ce240 2023-11-04T01:37:26.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.179+0000 7f3c1542f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3c100ce240 0x7f3c10157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.179+0000 7f3c15c30640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3c100cde60 0x7f3c1015d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35210/0 (socket says 172.21.15.44:35210) 2023-11-04T01:37:26.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.179+0000 7f3c15c30640 1 -- 172.21.15.44:0/368204955 learned_addr learned my addr 172.21.15.44:0/368204955 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:26.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.179+0000 7f3c1542f640 1 -- 172.21.15.44:0/368204955 >> v1:172.21.15.204:6789/0 conn(0x7f3c10157540 legacy=0x7f3c100d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.179+0000 7f3c1542f640 1 -- 172.21.15.44:0/368204955 >> v1:172.21.15.44:6789/0 conn(0x7f3c100cde60 legacy=0x7f3c1015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.179+0000 7f3c1542f640 1 -- 172.21.15.44:0/368204955 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c100d1120 con 0x7f3c100ce240 2023-11-04T01:37:26.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.180+0000 7f3c1542f640 1 --2- 172.21.15.44:0/368204955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c100ce240 0x7f3c10157000 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3c000097a0 tx=0x7f3c0002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7678cd769010c985 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.180+0000 7f3c14c2e640 1 -- 172.21.15.44:0/368204955 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00030610 con 0x7f3c100ce240 2023-11-04T01:37:26.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.180+0000 7f3c14c2e640 1 -- 172.21.15.44:0/368204955 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c00030770 con 0x7f3c100ce240 2023-11-04T01:37:26.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.180+0000 7f3c14c2e640 1 -- 172.21.15.44:0/368204955 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00030b00 con 0x7f3c100ce240 2023-11-04T01:37:26.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.181+0000 7f3c17e94640 1 -- 172.21.15.44:0/368204955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c100ce240 msgr2=0x7f3c10157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.181+0000 7f3c17e94640 1 --2- 172.21.15.44:0/368204955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c100ce240 0x7f3c10157000 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3c000097a0 tx=0x7f3c0002b960 comp rx=0 tx=0).stop 2023-11-04T01:37:26.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.181+0000 7f3c17e94640 1 -- 172.21.15.44:0/368204955 shutdown_connections 2023-11-04T01:37:26.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.181+0000 7f3c17e94640 1 --2- 172.21.15.44:0/368204955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c100ce240 0x7f3c10157000 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.181+0000 7f3c17e94640 1 -- 172.21.15.44:0/368204955 >> 172.21.15.44:0/368204955 conn(0x7f3c10071f30 msgr2=0x7f3c100cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.181+0000 7f3c17e94640 1 -- 172.21.15.44:0/368204955 shutdown_connections 2023-11-04T01:37:26.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.181+0000 7f3c17e94640 1 -- 172.21.15.44:0/368204955 wait complete. 2023-11-04T01:37:26.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.182+0000 7f3c17e94640 1 Processor -- start 2023-11-04T01:37:26.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.182+0000 7f3c17e94640 1 -- start start 2023-11-04T01:37:26.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c17e94640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c100cde60 0x7f3c1014f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c17e94640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c100ce240 0x7f3c10159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c17e94640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c10157540 0x7f3c100cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c17e94640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1014f620 con 0x7f3c100cde60 2023-11-04T01:37:26.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c17e94640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1015a300 con 0x7f3c100ce240 2023-11-04T01:37:26.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c17e94640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1015a5e0 con 0x7f3c10157540 2023-11-04T01:37:26.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c15c30640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c100cde60 0x7f3c1014f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c15c30640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c100cde60 0x7f3c1014f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41618/0 (socket says 172.21.15.44:41618) 2023-11-04T01:37:26.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c15c30640 1 -- 172.21.15.44:0/2411518437 learned_addr learned my addr 172.21.15.44:0/2411518437 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:26.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c15c30640 1 -- 172.21.15.44:0/2411518437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c10157540 msgr2=0x7f3c100cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c16431640 1 --2- 172.21.15.44:0/2411518437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c10157540 0x7f3c100cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c1542f640 1 --2- 172.21.15.44:0/2411518437 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c100ce240 0x7f3c10159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c15c30640 1 --2- 172.21.15.44:0/2411518437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c10157540 0x7f3c100cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c15c30640 1 -- 172.21.15.44:0/2411518437 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c100ce240 msgr2=0x7f3c10159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c15c30640 1 --2- 172.21.15.44:0/2411518437 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c100ce240 0x7f3c10159940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c15c30640 1 -- 172.21.15.44:0/2411518437 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c00009400 con 0x7f3c100cde60 2023-11-04T01:37:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c15c30640 1 --2- 172.21.15.44:0/2411518437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c100cde60 0x7f3c1014f0e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00c480 tx=0x7f3c0c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.183+0000 7f3c067fc640 1 -- 172.21.15.44:0/2411518437 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c005ce0 con 0x7f3c100cde60 2023-11-04T01:37:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.184+0000 7f3c067fc640 1 -- 172.21.15.44:0/2411518437 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0c005e40 con 0x7f3c100cde60 2023-11-04T01:37:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.184+0000 7f3c17e94640 1 -- 172.21.15.44:0/2411518437 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1015a8c0 con 0x7f3c100cde60 2023-11-04T01:37:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.184+0000 7f3c067fc640 1 -- 172.21.15.44:0/2411518437 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c0072f0 con 0x7f3c100cde60 2023-11-04T01:37:26.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.184+0000 7f3c17e94640 1 -- 172.21.15.44:0/2411518437 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1015ae80 con 0x7f3c100cde60 2023-11-04T01:37:26.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.185+0000 7f3c17e94640 1 -- 172.21.15.44:0/2411518437 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c10074290 con 0x7f3c100cde60 2023-11-04T01:37:26.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.185+0000 7f3c067fc640 1 -- 172.21.15.44:0/2411518437 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c0c007510 con 0x7f3c100cde60 2023-11-04T01:37:26.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.185+0000 7f3c067fc640 1 --2- 172.21.15.44:0/2411518437 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3bf406ae70 0x7f3bf406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.185+0000 7f3c067fc640 1 -- 172.21.15.44:0/2411518437 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3c0c088b80 con 0x7f3c100cde60 2023-11-04T01:37:26.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.186+0000 7f3c1542f640 1 --2- 172.21.15.44:0/2411518437 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3bf406ae70 0x7f3bf406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.186+0000 7f3c1542f640 1 --2- 172.21.15.44:0/2411518437 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3bf406ae70 0x7f3bf406d330 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3c00036000 tx=0x7f3c0003b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.190+0000 7f3c067fc640 1 -- 172.21.15.44:0/2411518437 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c0c053c30 con 0x7f3c100cde60 2023-11-04T01:37:26.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.361+0000 7f3c17e94640 1 -- 172.21.15.44:0/2411518437 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c101579b0 con 0x7f3bf406ae70 2023-11-04T01:37:26.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.369+0000 7f3c067fc640 1 -- 172.21.15.44:0/2411518437 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284390 (secure 0 0 0) 0x7f3c000308e0 con 0x7f3bf406ae70 2023-11-04T01:37:26.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:26.375 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:37:26.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.372+0000 7f3c17e94640 1 -- 172.21.15.44:0/2411518437 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3bf406ae70 msgr2=0x7f3bf406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.372+0000 7f3c17e94640 1 --2- 172.21.15.44:0/2411518437 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3bf406ae70 0x7f3bf406d330 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3c00036000 tx=0x7f3c0003b040 comp rx=0 tx=0).stop 2023-11-04T01:37:26.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.372+0000 7f3c17e94640 1 -- 172.21.15.44:0/2411518437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c100cde60 msgr2=0x7f3c1014f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.372+0000 7f3c17e94640 1 --2- 172.21.15.44:0/2411518437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c100cde60 0x7f3c1014f0e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00c480 tx=0x7f3c0c00c940 comp rx=0 tx=0).stop 2023-11-04T01:37:26.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.372+0000 7f3c17e94640 1 -- 172.21.15.44:0/2411518437 shutdown_connections 2023-11-04T01:37:26.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.372+0000 7f3c17e94640 1 --2- 172.21.15.44:0/2411518437 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3bf406ae70 0x7f3bf406d330 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.372+0000 7f3c17e94640 1 --2- 172.21.15.44:0/2411518437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c10157540 0x7f3c100cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.372+0000 7f3c17e94640 1 --2- 172.21.15.44:0/2411518437 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c100ce240 0x7f3c10159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.372+0000 7f3c17e94640 1 --2- 172.21.15.44:0/2411518437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c100cde60 0x7f3c1014f0e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.372+0000 7f3c17e94640 1 -- 172.21.15.44:0/2411518437 >> 172.21.15.44:0/2411518437 conn(0x7f3c10071f30 msgr2=0x7f3c100d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.372+0000 7f3c17e94640 1 -- 172.21.15.44:0/2411518437 shutdown_connections 2023-11-04T01:37:26.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:26.372+0000 7f3c17e94640 1 -- 172.21.15.44:0/2411518437 wait complete. 2023-11-04T01:37:26.386 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-11-04T01:37:24.593945+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220600,"kb_used_data":4436,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754120,"statfs":{"total":773094113280,"available":772868218880,"internally_reserved":0,"allocated":4542464,"data_stored":2596633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.661295"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950338+0000","last_change":"2023-11-04T01:37:20.950338+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950338+0000","last_undegraded":"2023-11-04T01:37:20.950338+0000","last_fullsized":"2023-11-04T01:37:20.950338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949625+0000","last_change":"2023-11-04T01:37:20.949625+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949625+0000","last_undegraded":"2023-11-04T01:37:20.949625+0000","last_fullsized":"2023-11-04T01:37:20.949625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951782+0000","last_change":"2023-11-04T01:37:20.951782+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951782+0000","last_undegraded":"2023-11-04T01:37:20.951782+0000","last_fullsized":"2023-11-04T01:37:20.951782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.947525+0000","last_change":"2023-11-04T01:37:20.947525+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.947525+0000","last_undegraded":"2023-11-04T01:37:20.947525+0000","last_fullsized":"2023-11-04T01:37:20.947525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945719+0000","last_change":"2023-11-04T01:37:20.945719+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945719+0000","last_undegraded":"2023-11-04T01:37:20.945719+0000","last_fullsized":"2023-11-04T01:37:20.945719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951017+0000","last_change":"2023-11-04T01:37:20.951017+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951017+0000","last_undegraded":"2023-11-04T01:37:20.951017+0000","last_fullsized":"2023-11-04T01:37:20.951017+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944094+0000","last_change":"2023-11-04T01:37:20.944094+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944094+0000","last_undegraded":"2023-11-04T01:37:20.944094+0000","last_fullsized":"2023-11-04T01:37:20.944094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948816+0000","last_change":"2023-11-04T01:37:20.948816+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948816+0000","last_undegraded":"2023-11-04T01:37:20.948816+0000","last_fullsized":"2023-11-04T01:37:20.948816+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951314+0000","last_change":"2023-11-04T01:37:20.951314+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951314+0000","last_undegraded":"2023-11-04T01:37:20.951314+0000","last_fullsized":"2023-11-04T01:37:20.951314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944249+0000","last_change":"2023-11-04T01:37:20.944249+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944249+0000","last_undegraded":"2023-11-04T01:37:20.944249+0000","last_fullsized":"2023-11-04T01:37:20.944249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944749+0000","last_change":"2023-11-04T01:37:20.944749+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944749+0000","last_undegraded":"2023-11-04T01:37:20.944749+0000","last_fullsized":"2023-11-04T01:37:20.944749+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950616+0000","last_change":"2023-11-04T01:37:20.950616+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950616+0000","last_undegraded":"2023-11-04T01:37:20.950616+0000","last_fullsized":"2023-11-04T01:37:20.950616+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944595+0000","last_change":"2023-11-04T01:37:20.944595+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944595+0000","last_undegraded":"2023-11-04T01:37:20.944595+0000","last_fullsized":"2023-11-04T01:37:20.944595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940641+0000","last_change":"2023-11-04T01:37:20.940641+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940641+0000","last_undegraded":"2023-11-04T01:37:20.940641+0000","last_fullsized":"2023-11-04T01:37:20.940641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943560+0000","last_change":"2023-11-04T01:37:20.943560+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943560+0000","last_undegraded":"2023-11-04T01:37:20.943560+0000","last_fullsized":"2023-11-04T01:37:20.943560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950363+0000","last_change":"2023-11-04T01:37:20.950363+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950363+0000","last_undegraded":"2023-11-04T01:37:20.950363+0000","last_fullsized":"2023-11-04T01:37:20.950363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950695+0000","last_change":"2023-11-04T01:37:20.950695+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950695+0000","last_undegraded":"2023-11-04T01:37:20.950695+0000","last_fullsized":"2023-11-04T01:37:20.950695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.942081+0000","last_change":"2023-11-04T01:37:20.942081+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.942081+0000","last_undegraded":"2023-11-04T01:37:20.942081+0000","last_fullsized":"2023-11-04T01:37:20.942081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945020+0000","last_change":"2023-11-04T01:37:20.945020+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945020+0000","last_undegraded":"2023-11-04T01:37:20.945020+0000","last_fullsized":"2023-11-04T01:37:20.945020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941840+0000","last_change":"2023-11-04T01:37:20.941840+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941840+0000","last_undegraded":"2023-11-04T01:37:20.941840+0000","last_fullsized":"2023-11-04T01:37:20.941840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943634+0000","last_change":"2023-11-04T01:37:20.943634+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943634+0000","last_undegraded":"2023-11-04T01:37:20.943634+0000","last_fullsized":"2023-11-04T01:37:20.943634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.939369+0000","last_change":"2023-11-04T01:37:20.939369+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.939369+0000","last_undegraded":"2023-11-04T01:37:20.939369+0000","last_fullsized":"2023-11-04T01:37:20.939369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950275+0000","last_change":"2023-11-04T01:37:20.950275+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950275+0000","last_undegraded":"2023-11-04T01:37:20.950275+0000","last_fullsized":"2023-11-04T01:37:20.950275+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943717+0000","last_change":"2023-11-04T01:37:20.943717+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943717+0000","last_undegraded":"2023-11-04T01:37:20.943717+0000","last_fullsized":"2023-11-04T01:37:20.943717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.942243+0000","last_change":"2023-11-04T01:37:20.942243+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.942243+0000","last_undegraded":"2023-11-04T01:37:20.942243+0000","last_fullsized":"2023-11-04T01:37:20.942243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950535+0000","last_change":"2023-11-04T01:37:20.950535+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950535+0000","last_undegraded":"2023-11-04T01:37:20.950535+0000","last_fullsized":"2023-11-04T01:37:20.950535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941482+0000","last_change":"2023-11-04T01:37:20.941482+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941482+0000","last_undegraded":"2023-11-04T01:37:20.941482+0000","last_fullsized":"2023-11-04T01:37:20.941482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944621+0000","last_change":"2023-11-04T01:37:20.944621+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944621+0000","last_undegraded":"2023-11-04T01:37:20.944621+0000","last_fullsized":"2023-11-04T01:37:20.944621+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941356+0000","last_change":"2023-11-04T01:37:20.941356+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941356+0000","last_undegraded":"2023-11-04T01:37:20.941356+0000","last_fullsized":"2023-11-04T01:37:20.941356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.941238+0000","last_change":"2023-11-04T01:37:20.941238+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.941238+0000","last_undegraded":"2023-11-04T01:37:20.941238+0000","last_fullsized":"2023-11-04T01:37:20.941238+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949361+0000","last_change":"2023-11-04T01:37:20.949361+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949361+0000","last_undegraded":"2023-11-04T01:37:20.949361+0000","last_fullsized":"2023-11-04T01:37:20.949361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948497+0000","last_change":"2023-11-04T01:37:20.948497+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948497+0000","last_undegraded":"2023-11-04T01:37:20.948497+0000","last_fullsized":"2023-11-04T01:37:20.948497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950780+0000","last_change":"2023-11-04T01:37:20.950780+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950780+0000","last_undegraded":"2023-11-04T01:37:20.950780+0000","last_fullsized":"2023-11-04T01:37:20.950780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.951671+0000","last_change":"2023-11-04T01:37:20.948850+0000","last_active":"2023-11-04T01:37:20.951671+0000","last_peered":"2023-11-04T01:37:20.951671+0000","last_clean":"2023-11-04T01:37:20.951671+0000","last_became_active":"2023-11-04T01:37:20.948589+0000","last_became_peered":"2023-11-04T01:37:20.948589+0000","last_unstale":"2023-11-04T01:37:20.951671+0000","last_undegraded":"2023-11-04T01:37:20.951671+0000","last_fullsized":"2023-11-04T01:37:20.951671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:15:44.156052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946971+0000","last_change":"2023-11-04T01:37:20.946971+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946971+0000","last_undegraded":"2023-11-04T01:37:20.946971+0000","last_fullsized":"2023-11-04T01:37:20.946971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959410+0000","last_change":"2023-11-04T01:37:20.957554+0000","last_active":"2023-11-04T01:37:20.959410+0000","last_peered":"2023-11-04T01:37:20.959410+0000","last_clean":"2023-11-04T01:37:20.959410+0000","last_became_active":"2023-11-04T01:37:20.957283+0000","last_became_peered":"2023-11-04T01:37:20.957283+0000","last_unstale":"2023-11-04T01:37:20.959410+0000","last_undegraded":"2023-11-04T01:37:20.959410+0000","last_fullsized":"2023-11-04T01:37:20.959410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:18.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.939649+0000","last_change":"2023-11-04T01:37:20.939649+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.939649+0000","last_undegraded":"2023-11-04T01:37:20.939649+0000","last_fullsized":"2023-11-04T01:37:20.939649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953317+0000","last_change":"2023-11-04T01:37:20.951123+0000","last_active":"2023-11-04T01:37:20.953317+0000","last_peered":"2023-11-04T01:37:20.953317+0000","last_clean":"2023-11-04T01:37:20.953317+0000","last_became_active":"2023-11-04T01:37:20.950796+0000","last_became_peered":"2023-11-04T01:37:20.950796+0000","last_unstale":"2023-11-04T01:37:20.953317+0000","last_undegraded":"2023-11-04T01:37:20.953317+0000","last_fullsized":"2023-11-04T01:37:20.953317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:20:25.874532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948800+0000","last_change":"2023-11-04T01:37:20.948800+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948800+0000","last_undegraded":"2023-11-04T01:37:20.948800+0000","last_fullsized":"2023-11-04T01:37:20.948800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.947315+0000","last_change":"2023-11-04T01:37:20.946610+0000","last_active":"2023-11-04T01:37:20.947315+0000","last_peered":"2023-11-04T01:37:20.947315+0000","last_clean":"2023-11-04T01:37:20.947315+0000","last_became_active":"2023-11-04T01:37:20.946320+0000","last_became_peered":"2023-11-04T01:37:20.946320+0000","last_unstale":"2023-11-04T01:37:20.947315+0000","last_undegraded":"2023-11-04T01:37:20.947315+0000","last_fullsized":"2023-11-04T01:37:20.947315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:15:44.156052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950057+0000","last_change":"2023-11-04T01:37:20.950057+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950057+0000","last_undegraded":"2023-11-04T01:37:20.950057+0000","last_fullsized":"2023-11-04T01:37:20.950057+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962206+0000","last_change":"2023-11-04T01:37:20.958166+0000","last_active":"2023-11-04T01:37:20.962206+0000","last_peered":"2023-11-04T01:37:20.962206+0000","last_clean":"2023-11-04T01:37:20.962206+0000","last_became_active":"2023-11-04T01:37:20.957832+0000","last_became_peered":"2023-11-04T01:37:20.957832+0000","last_unstale":"2023-11-04T01:37:20.962206+0000","last_undegraded":"2023-11-04T01:37:20.962206+0000","last_fullsized":"2023-11-04T01:37:20.962206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:55.724864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943131+0000","last_change":"2023-11-04T01:37:20.943131+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943131+0000","last_undegraded":"2023-11-04T01:37:20.943131+0000","last_fullsized":"2023-11-04T01:37:20.943131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962277+0000","last_change":"2023-11-04T01:37:20.958018+0000","last_active":"2023-11-04T01:37:20.962277+0000","last_peered":"2023-11-04T01:37:20.962277+0000","last_clean":"2023-11-04T01:37:20.962277+0000","last_became_active":"2023-11-04T01:37:20.957734+0000","last_became_peered":"2023-11-04T01:37:20.957734+0000","last_unstale":"2023-11-04T01:37:20.962277+0000","last_undegraded":"2023-11-04T01:37:20.962277+0000","last_fullsized":"2023-11-04T01:37:20.962277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:25.355203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.939903+0000","last_change":"2023-11-04T01:37:20.939903+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.939903+0000","last_undegraded":"2023-11-04T01:37:20.939903+0000","last_fullsized":"2023-11-04T01:37:20.939903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953179+0000","last_change":"2023-11-04T01:37:20.951909+0000","last_active":"2023-11-04T01:37:20.953179+0000","last_peered":"2023-11-04T01:37:20.953179+0000","last_clean":"2023-11-04T01:37:20.953179+0000","last_became_active":"2023-11-04T01:37:20.951595+0000","last_became_peered":"2023-11-04T01:37:20.951595+0000","last_unstale":"2023-11-04T01:37:20.953179+0000","last_undegraded":"2023-11-04T01:37:20.953179+0000","last_fullsized":"2023-11-04T01:37:20.953179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:25.355203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948012+0000","last_change":"2023-11-04T01:37:20.948012+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948012+0000","last_undegraded":"2023-11-04T01:37:20.948012+0000","last_fullsized":"2023-11-04T01:37:20.948012+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.950590+0000","last_change":"2023-11-04T01:37:20.948666+0000","last_active":"2023-11-04T01:37:20.950590+0000","last_peered":"2023-11-04T01:37:20.950590+0000","last_clean":"2023-11-04T01:37:20.950590+0000","last_became_active":"2023-11-04T01:37:20.948379+0000","last_became_peered":"2023-11-04T01:37:20.948379+0000","last_unstale":"2023-11-04T01:37:20.950590+0000","last_undegraded":"2023-11-04T01:37:20.950590+0000","last_fullsized":"2023-11-04T01:37:20.950590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:00.482538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944553+0000","last_change":"2023-11-04T01:37:20.944553+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944553+0000","last_undegraded":"2023-11-04T01:37:20.944553+0000","last_fullsized":"2023-11-04T01:37:20.944553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959272+0000","last_change":"2023-11-04T01:37:20.951039+0000","last_active":"2023-11-04T01:37:20.959272+0000","last_peered":"2023-11-04T01:37:20.959272+0000","last_clean":"2023-11-04T01:37:20.959272+0000","last_became_active":"2023-11-04T01:37:20.950768+0000","last_became_peered":"2023-11-04T01:37:20.950768+0000","last_unstale":"2023-11-04T01:37:20.959272+0000","last_undegraded":"2023-11-04T01:37:20.959272+0000","last_fullsized":"2023-11-04T01:37:20.959272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:42.847107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951525+0000","last_change":"2023-11-04T01:37:20.951525+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951525+0000","last_undegraded":"2023-11-04T01:37:20.951525+0000","last_fullsized":"2023-11-04T01:37:20.951525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957314+0000","last_change":"2023-11-04T01:37:20.953603+0000","last_active":"2023-11-04T01:37:20.957314+0000","last_peered":"2023-11-04T01:37:20.957314+0000","last_clean":"2023-11-04T01:37:20.957314+0000","last_became_active":"2023-11-04T01:37:20.953355+0000","last_became_peered":"2023-11-04T01:37:20.953355+0000","last_unstale":"2023-11-04T01:37:20.957314+0000","last_undegraded":"2023-11-04T01:37:20.957314+0000","last_fullsized":"2023-11-04T01:37:20.957314+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:42.847107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.950439+0000","last_change":"2023-11-04T01:37:20.950439+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.950439+0000","last_undegraded":"2023-11-04T01:37:20.950439+0000","last_fullsized":"2023-11-04T01:37:20.950439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957274+0000","last_change":"2023-11-04T01:37:20.951932+0000","last_active":"2023-11-04T01:37:20.957274+0000","last_peered":"2023-11-04T01:37:20.957274+0000","last_clean":"2023-11-04T01:37:20.957274+0000","last_became_active":"2023-11-04T01:37:20.951672+0000","last_became_peered":"2023-11-04T01:37:20.951672+0000","last_unstale":"2023-11-04T01:37:20.957274+0000","last_undegraded":"2023-11-04T01:37:20.957274+0000","last_fullsized":"2023-11-04T01:37:20.957274+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:18.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940748+0000","last_change":"2023-11-04T01:37:20.940748+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940748+0000","last_undegraded":"2023-11-04T01:37:20.940748+0000","last_fullsized":"2023-11-04T01:37:20.940748+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959474+0000","last_change":"2023-11-04T01:37:20.957547+0000","last_active":"2023-11-04T01:37:20.959474+0000","last_peered":"2023-11-04T01:37:20.959474+0000","last_clean":"2023-11-04T01:37:20.959474+0000","last_became_active":"2023-11-04T01:37:20.957264+0000","last_became_peered":"2023-11-04T01:37:20.957264+0000","last_unstale":"2023-11-04T01:37:20.959474+0000","last_undegraded":"2023-11-04T01:37:20.959474+0000","last_fullsized":"2023-11-04T01:37:20.959474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:57:28.939429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949170+0000","last_change":"2023-11-04T01:37:20.949170+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949170+0000","last_undegraded":"2023-11-04T01:37:20.949170+0000","last_fullsized":"2023-11-04T01:37:20.949170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959449+0000","last_change":"2023-11-04T01:37:20.957462+0000","last_active":"2023-11-04T01:37:20.959449+0000","last_peered":"2023-11-04T01:37:20.959449+0000","last_clean":"2023-11-04T01:37:20.959449+0000","last_became_active":"2023-11-04T01:37:20.957172+0000","last_became_peered":"2023-11-04T01:37:20.957172+0000","last_unstale":"2023-11-04T01:37:20.959449+0000","last_undegraded":"2023-11-04T01:37:20.959449+0000","last_fullsized":"2023-11-04T01:37:20.959449+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:03.376922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946705+0000","last_change":"2023-11-04T01:37:20.946705+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946705+0000","last_undegraded":"2023-11-04T01:37:20.946705+0000","last_fullsized":"2023-11-04T01:37:20.946705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953259+0000","last_change":"2023-11-04T01:37:20.951880+0000","last_active":"2023-11-04T01:37:20.953259+0000","last_peered":"2023-11-04T01:37:20.953259+0000","last_clean":"2023-11-04T01:37:20.953259+0000","last_became_active":"2023-11-04T01:37:20.951551+0000","last_became_peered":"2023-11-04T01:37:20.951551+0000","last_unstale":"2023-11-04T01:37:20.953259+0000","last_undegraded":"2023-11-04T01:37:20.953259+0000","last_fullsized":"2023-11-04T01:37:20.953259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949390+0000","last_change":"2023-11-04T01:37:20.949390+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949390+0000","last_undegraded":"2023-11-04T01:37:20.949390+0000","last_fullsized":"2023-11-04T01:37:20.949390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.950729+0000","last_change":"2023-11-04T01:37:20.946684+0000","last_active":"2023-11-04T01:37:20.950729+0000","last_peered":"2023-11-04T01:37:20.950729+0000","last_clean":"2023-11-04T01:37:20.950729+0000","last_became_active":"2023-11-04T01:37:20.946206+0000","last_became_peered":"2023-11-04T01:37:20.946206+0000","last_unstale":"2023-11-04T01:37:20.950729+0000","last_undegraded":"2023-11-04T01:37:20.950729+0000","last_fullsized":"2023-11-04T01:37:20.950729+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:13:11.543891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946949+0000","last_change":"2023-11-04T01:37:20.946949+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946949+0000","last_undegraded":"2023-11-04T01:37:20.946949+0000","last_fullsized":"2023-11-04T01:37:20.946949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962618+0000","last_change":"2023-11-04T01:37:20.960179+0000","last_active":"2023-11-04T01:37:20.962618+0000","last_peered":"2023-11-04T01:37:20.962618+0000","last_clean":"2023-11-04T01:37:20.962618+0000","last_became_active":"2023-11-04T01:37:20.959900+0000","last_became_peered":"2023-11-04T01:37:20.959900+0000","last_unstale":"2023-11-04T01:37:20.962618+0000","last_undegraded":"2023-11-04T01:37:20.962618+0000","last_fullsized":"2023-11-04T01:37:20.962618+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:20:25.874532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946705+0000","last_change":"2023-11-04T01:37:20.946705+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946705+0000","last_undegraded":"2023-11-04T01:37:20.946705+0000","last_fullsized":"2023-11-04T01:37:20.946705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.951304+0000","last_change":"2023-11-04T01:37:20.947847+0000","last_active":"2023-11-04T01:37:20.951304+0000","last_peered":"2023-11-04T01:37:20.951304+0000","last_clean":"2023-11-04T01:37:20.951304+0000","last_became_active":"2023-11-04T01:37:20.947565+0000","last_became_peered":"2023-11-04T01:37:20.947565+0000","last_unstale":"2023-11-04T01:37:20.951304+0000","last_undegraded":"2023-11-04T01:37:20.951304+0000","last_fullsized":"2023-11-04T01:37:20.951304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:51.912669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943416+0000","last_change":"2023-11-04T01:37:20.943416+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943416+0000","last_undegraded":"2023-11-04T01:37:20.943416+0000","last_fullsized":"2023-11-04T01:37:20.943416+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.954457+0000","last_change":"2023-11-04T01:37:20.950827+0000","last_active":"2023-11-04T01:37:20.954457+0000","last_peered":"2023-11-04T01:37:20.954457+0000","last_clean":"2023-11-04T01:37:20.954457+0000","last_became_active":"2023-11-04T01:37:20.950575+0000","last_became_peered":"2023-11-04T01:37:20.950575+0000","last_unstale":"2023-11-04T01:37:20.954457+0000","last_undegraded":"2023-11-04T01:37:20.954457+0000","last_fullsized":"2023-11-04T01:37:20.954457+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:20:01.127723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940112+0000","last_change":"2023-11-04T01:37:20.940112+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940112+0000","last_undegraded":"2023-11-04T01:37:20.940112+0000","last_fullsized":"2023-11-04T01:37:20.940112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.960190+0000","last_change":"2023-11-04T01:37:20.959217+0000","last_active":"2023-11-04T01:37:20.960190+0000","last_peered":"2023-11-04T01:37:20.960190+0000","last_clean":"2023-11-04T01:37:20.960190+0000","last_became_active":"2023-11-04T01:37:20.958336+0000","last_became_peered":"2023-11-04T01:37:20.958336+0000","last_unstale":"2023-11-04T01:37:20.960190+0000","last_undegraded":"2023-11-04T01:37:20.960190+0000","last_fullsized":"2023-11-04T01:37:20.960190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:03:48.533243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.944682+0000","last_change":"2023-11-04T01:37:20.944682+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.944682+0000","last_undegraded":"2023-11-04T01:37:20.944682+0000","last_fullsized":"2023-11-04T01:37:20.944682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.953210+0000","last_change":"2023-11-04T01:37:20.950464+0000","last_active":"2023-11-04T01:37:20.953210+0000","last_peered":"2023-11-04T01:37:20.953210+0000","last_clean":"2023-11-04T01:37:20.953210+0000","last_became_active":"2023-11-04T01:37:20.950133+0000","last_became_peered":"2023-11-04T01:37:20.950133+0000","last_unstale":"2023-11-04T01:37:20.953210+0000","last_undegraded":"2023-11-04T01:37:20.953210+0000","last_fullsized":"2023-11-04T01:37:20.953210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:44.200233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949983+0000","last_change":"2023-11-04T01:37:20.949983+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949983+0000","last_undegraded":"2023-11-04T01:37:20.949983+0000","last_fullsized":"2023-11-04T01:37:20.949983+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.958220+0000","last_change":"2023-11-04T01:37:20.955294+0000","last_active":"2023-11-04T01:37:20.958220+0000","last_peered":"2023-11-04T01:37:20.958220+0000","last_clean":"2023-11-04T01:37:20.958220+0000","last_became_active":"2023-11-04T01:37:20.955019+0000","last_became_peered":"2023-11-04T01:37:20.955019+0000","last_unstale":"2023-11-04T01:37:20.958220+0000","last_undegraded":"2023-11-04T01:37:20.958220+0000","last_fullsized":"2023-11-04T01:37:20.958220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:53.772500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.947499+0000","last_change":"2023-11-04T01:37:20.947499+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.947499+0000","last_undegraded":"2023-11-04T01:37:20.947499+0000","last_fullsized":"2023-11-04T01:37:20.947499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.956263+0000","last_change":"2023-11-04T01:37:20.952410+0000","last_active":"2023-11-04T01:37:20.956263+0000","last_peered":"2023-11-04T01:37:20.956263+0000","last_clean":"2023-11-04T01:37:20.956263+0000","last_became_active":"2023-11-04T01:37:20.952143+0000","last_became_peered":"2023-11-04T01:37:20.952143+0000","last_unstale":"2023-11-04T01:37:20.956263+0000","last_undegraded":"2023-11-04T01:37:20.956263+0000","last_fullsized":"2023-11-04T01:37:20.956263+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:05:40.366579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.942494+0000","last_change":"2023-11-04T01:37:20.942494+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.942494+0000","last_undegraded":"2023-11-04T01:37:20.942494+0000","last_fullsized":"2023-11-04T01:37:20.942494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962232+0000","last_change":"2023-11-04T01:37:20.957857+0000","last_active":"2023-11-04T01:37:20.962232+0000","last_peered":"2023-11-04T01:37:20.962232+0000","last_clean":"2023-11-04T01:37:20.962232+0000","last_became_active":"2023-11-04T01:37:20.957415+0000","last_became_peered":"2023-11-04T01:37:20.957415+0000","last_unstale":"2023-11-04T01:37:20.962232+0000","last_undegraded":"2023-11-04T01:37:20.962232+0000","last_fullsized":"2023-11-04T01:37:20.962232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:55.724864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946189+0000","last_change":"2023-11-04T01:37:20.946189+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946189+0000","last_undegraded":"2023-11-04T01:37:20.946189+0000","last_fullsized":"2023-11-04T01:37:20.946189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.960780+0000","last_change":"2023-11-04T01:37:20.958969+0000","last_active":"2023-11-04T01:37:20.960780+0000","last_peered":"2023-11-04T01:37:20.960780+0000","last_clean":"2023-11-04T01:37:20.960780+0000","last_became_active":"2023-11-04T01:37:20.958656+0000","last_became_peered":"2023-11-04T01:37:20.958656+0000","last_unstale":"2023-11-04T01:37:20.960780+0000","last_undegraded":"2023-11-04T01:37:20.960780+0000","last_fullsized":"2023-11-04T01:37:20.960780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:59:20.169775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.946503+0000","last_change":"2023-11-04T01:37:20.946503+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.946503+0000","last_undegraded":"2023-11-04T01:37:20.946503+0000","last_fullsized":"2023-11-04T01:37:20.946503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.956572+0000","last_change":"2023-11-04T01:37:20.951195+0000","last_active":"2023-11-04T01:37:20.956572+0000","last_peered":"2023-11-04T01:37:20.956572+0000","last_clean":"2023-11-04T01:37:20.956572+0000","last_became_active":"2023-11-04T01:37:20.950916+0000","last_became_peered":"2023-11-04T01:37:20.950916+0000","last_unstale":"2023-11-04T01:37:20.956572+0000","last_undegraded":"2023-11-04T01:37:20.956572+0000","last_fullsized":"2023-11-04T01:37:20.956572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.951134+0000","last_change":"2023-11-04T01:37:20.951134+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.951134+0000","last_undegraded":"2023-11-04T01:37:20.951134+0000","last_fullsized":"2023-11-04T01:37:20.951134+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957912+0000","last_change":"2023-11-04T01:37:20.954111+0000","last_active":"2023-11-04T01:37:20.957912+0000","last_peered":"2023-11-04T01:37:20.957912+0000","last_clean":"2023-11-04T01:37:20.957912+0000","last_became_active":"2023-11-04T01:37:20.953851+0000","last_became_peered":"2023-11-04T01:37:20.953851+0000","last_unstale":"2023-11-04T01:37:20.957912+0000","last_undegraded":"2023-11-04T01:37:20.957912+0000","last_fullsized":"2023-11-04T01:37:20.957912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:31.988502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945193+0000","last_change":"2023-11-04T01:37:20.945193+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945193+0000","last_undegraded":"2023-11-04T01:37:20.945193+0000","last_fullsized":"2023-11-04T01:37:20.945193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.960305+0000","last_change":"2023-11-04T01:37:20.958189+0000","last_active":"2023-11-04T01:37:20.960305+0000","last_peered":"2023-11-04T01:37:20.960305+0000","last_clean":"2023-11-04T01:37:20.960305+0000","last_became_active":"2023-11-04T01:37:20.957903+0000","last_became_peered":"2023-11-04T01:37:20.957903+0000","last_unstale":"2023-11-04T01:37:20.960305+0000","last_undegraded":"2023-11-04T01:37:20.960305+0000","last_fullsized":"2023-11-04T01:37:20.960305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.948680+0000","last_change":"2023-11-04T01:37:20.948680+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.948680+0000","last_undegraded":"2023-11-04T01:37:20.948680+0000","last_fullsized":"2023-11-04T01:37:20.948680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959762+0000","last_change":"2023-11-04T01:37:20.957300+0000","last_active":"2023-11-04T01:37:20.959762+0000","last_peered":"2023-11-04T01:37:20.959762+0000","last_clean":"2023-11-04T01:37:20.959762+0000","last_became_active":"2023-11-04T01:37:20.957035+0000","last_became_peered":"2023-11-04T01:37:20.957035+0000","last_unstale":"2023-11-04T01:37:20.959762+0000","last_undegraded":"2023-11-04T01:37:20.959762+0000","last_fullsized":"2023-11-04T01:37:20.959762+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:55.724864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.945994+0000","last_change":"2023-11-04T01:37:20.945994+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.945994+0000","last_undegraded":"2023-11-04T01:37:20.945994+0000","last_fullsized":"2023-11-04T01:37:20.945994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.957141+0000","last_change":"2023-11-04T01:37:20.955263+0000","last_active":"2023-11-04T01:37:20.957141+0000","last_peered":"2023-11-04T01:37:20.957141+0000","last_clean":"2023-11-04T01:37:20.957141+0000","last_became_active":"2023-11-04T01:37:20.955015+0000","last_became_peered":"2023-11-04T01:37:20.955015+0000","last_unstale":"2023-11-04T01:37:20.957141+0000","last_undegraded":"2023-11-04T01:37:20.957141+0000","last_fullsized":"2023-11-04T01:37:20.957141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:00.482538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.940263+0000","last_change":"2023-11-04T01:37:20.940263+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.940263+0000","last_undegraded":"2023-11-04T01:37:20.940263+0000","last_fullsized":"2023-11-04T01:37:20.940263+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.945648+0000","last_change":"2023-11-04T01:37:20.944425+0000","last_active":"2023-11-04T01:37:20.945648+0000","last_peered":"2023-11-04T01:37:20.945648+0000","last_clean":"2023-11-04T01:37:20.945648+0000","last_became_active":"2023-11-04T01:37:20.944147+0000","last_became_peered":"2023-11-04T01:37:20.944147+0000","last_unstale":"2023-11-04T01:37:20.945648+0000","last_undegraded":"2023-11-04T01:37:20.945648+0000","last_fullsized":"2023-11-04T01:37:20.945648+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:13:11.543891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.949823+0000","last_change":"2023-11-04T01:37:20.949823+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.949823+0000","last_undegraded":"2023-11-04T01:37:20.949823+0000","last_fullsized":"2023-11-04T01:37:20.949823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.959712+0000","last_change":"2023-11-04T01:37:20.953474+0000","last_active":"2023-11-04T01:37:20.959712+0000","last_peered":"2023-11-04T01:37:20.959712+0000","last_clean":"2023-11-04T01:37:20.959712+0000","last_became_active":"2023-11-04T01:37:20.953215+0000","last_became_peered":"2023-11-04T01:37:20.953215+0000","last_unstale":"2023-11-04T01:37:20.959712+0000","last_undegraded":"2023-11-04T01:37:20.959712+0000","last_fullsized":"2023-11-04T01:37:20.959712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:49.592008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-04T01:37:20.943316+0000","last_change":"2023-11-04T01:37:20.943316+0000","last_active":"2023-11-04T01:37:20.931762+0000","last_peered":"2023-11-04T01:37:20.931762+0000","last_clean":"2023-11-04T01:37:20.931762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:20.943316+0000","last_undegraded":"2023-11-04T01:37:20.943316+0000","last_fullsized":"2023-11-04T01:37:20.943316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:20.962376+0000","last_change":"2023-11-04T01:37:20.958978+0000","last_active":"2023-11-04T01:37:20.962376+0000","last_peered":"2023-11-04T01:37:20.962376+0000","last_clean":"2023-11-04T01:37:20.962376+0000","last_became_active":"2023-11-04T01:37:20.958778+0000","last_became_peered":"2023-11-04T01:37:20.958778+0000","last_unstale":"2023-11-04T01:37:20.962376+0000","last_undegraded":"2023-11-04T01:37:20.962376+0000","last_fullsized":"2023-11-04T01:37:20.962376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-04T01:37:19.935331+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:37:19.935331+0000","last_peered":"2023-11-04T01:37:19.935331+0000","last_clean":"2023-11-04T01:37:19.935331+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:37:19.935331+0000","last_undegraded":"2023-11-04T01:37:19.935331+0000","last_fullsized":"2023-11-04T01:37:19.935331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":770780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.42099999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.55300000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.64500000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.68999999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.503},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.72499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58299999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.40500000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.499}]},{"osd":3,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56899999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.39300000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.35399999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52300000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60799999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.32600000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.41699999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.438}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.53900000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.504}]},{"osd":2,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.64700000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.747}]},{"osd":7,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.628},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.76000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.314},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.26200000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.377}]},{"osd":4,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.53000000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46000000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.44600000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.57599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.247},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.27500000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.312},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.34100000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.37},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.41099999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.625},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.58099999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.224},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.32800000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.30399999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.25800000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.434}]},{"osd":5,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.41299999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.42499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1003520,"data_stored":763166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.40100000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.432}]},{"osd":3,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.38},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.754}]},{"osd":5,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76200000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:27.942 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:37:27.946 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:37:29.391 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.509+0000 7f1fd63b6640 1 Processor -- start 2023-11-04T01:37:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.509+0000 7f1fd63b6640 1 -- start start 2023-11-04T01:37:29.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fd63b6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1fd015ce60 0x7f1fd006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fd63b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd006bd30 0x7f1fd0160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fd63b6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd01615d0 con 0x7f1fd0161050 2023-11-04T01:37:29.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fd63b6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd00cbde0 con 0x7f1fd015ce60 2023-11-04T01:37:29.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fd63b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd01618b0 con 0x7f1fd006bd30 2023-11-04T01:37:29.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fd4953640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1fd0161050 0x7f1fd00cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35216/0 (socket says 172.21.15.44:35216) 2023-11-04T01:37:29.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fd4953640 1 -- 172.21.15.44:0/3420227234 learned_addr learned my addr 172.21.15.44:0/3420227234 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:29.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fceffd640 1 -- 172.21.15.44:0/3420227234 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2098076221 0 0) 0x7f1fd01615d0 con 0x7f1fd0161050 2023-11-04T01:37:29.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fcffff640 1 --2- 172.21.15.44:0/3420227234 >> v2:172.21.15.204:3300/0 conn(0x7f1fd015ce60 0x7f1fd006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fcf7fe640 1 --2- 172.21.15.44:0/3420227234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd006bd30 0x7f1fd0160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fceffd640 1 -- 172.21.15.44:0/3420227234 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fb8003520 con 0x7f1fd0161050 2023-11-04T01:37:29.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fceffd640 1 -- 172.21.15.44:0/3420227234 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3396793850 0 0) 0x7f1fb8003520 con 0x7f1fd0161050 2023-11-04T01:37:29.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fceffd640 1 -- 172.21.15.44:0/3420227234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd006bd30 msgr2=0x7f1fd0160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fceffd640 1 --2- 172.21.15.44:0/3420227234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd006bd30 0x7f1fd0160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fceffd640 1 -- 172.21.15.44:0/3420227234 >> v2:172.21.15.204:3300/0 conn(0x7f1fd015ce60 msgr2=0x7f1fd006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fceffd640 1 --2- 172.21.15.44:0/3420227234 >> v2:172.21.15.204:3300/0 conn(0x7f1fd015ce60 0x7f1fd006b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fceffd640 1 -- 172.21.15.44:0/3420227234 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd00cba00 con 0x7f1fd0161050 2023-11-04T01:37:29.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fceffd640 1 -- 172.21.15.44:0/3420227234 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f1fc80019f0 con 0x7f1fd0161050 2023-11-04T01:37:29.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fceffd640 1 -- 172.21.15.44:0/3420227234 >> v1:172.21.15.44:6789/0 conn(0x7f1fd0161050 legacy=0x7f1fd00cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fceffd640 1 --2- 172.21.15.44:0/3420227234 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fb8003970 0x7f1fb8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.510+0000 7f1fceffd640 1 --2- 172.21.15.44:0/3420227234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fb80047c0 0x7f1fb8004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.511+0000 7f1fceffd640 1 --2- 172.21.15.44:0/3420227234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fb8005140 0x7f1fb800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.511+0000 7f1fceffd640 1 -- 172.21.15.44:0/3420227234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00cbde0 con 0x7f1fb8005140 2023-11-04T01:37:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.511+0000 7f1fceffd640 1 -- 172.21.15.44:0/3420227234 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd01618b0 con 0x7f1fb8003970 2023-11-04T01:37:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.511+0000 7f1fceffd640 1 -- 172.21.15.44:0/3420227234 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80045c0 con 0x7f1fb80047c0 2023-11-04T01:37:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.511+0000 7f1fd4953640 1 --2- 172.21.15.44:0/3420227234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fb8005140 0x7f1fb800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.511+0000 7f1fcf7fe640 1 --2- 172.21.15.44:0/3420227234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fb80047c0 0x7f1fb8004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.511+0000 7f1fcffff640 1 --2- 172.21.15.44:0/3420227234 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fb8003970 0x7f1fb8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.511+0000 7f1fd4953640 1 -- 172.21.15.44:0/3420227234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fb80047c0 msgr2=0x7f1fb8004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.511+0000 7f1fd4953640 1 --2- 172.21.15.44:0/3420227234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fb80047c0 0x7f1fb8004c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.511+0000 7f1fd4953640 1 -- 172.21.15.44:0/3420227234 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fb8003970 msgr2=0x7f1fb8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.511+0000 7f1fd4953640 1 --2- 172.21.15.44:0/3420227234 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fb8003970 0x7f1fb8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.511+0000 7f1fd4953640 1 -- 172.21.15.44:0/3420227234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb8003520 con 0x7f1fb8005140 2023-11-04T01:37:29.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.512+0000 7f1fd4953640 1 --2- 172.21.15.44:0/3420227234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fb8005140 0x7f1fb800b980 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0161500 tx=0x7f1fb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650a12695c590c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.512+0000 7f1fceffd640 1 -- 172.21.15.44:0/3420227234 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8034630 con 0x7f1fb8005140 2023-11-04T01:37:29.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.512+0000 7f1fceffd640 1 -- 172.21.15.44:0/3420227234 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc802f070 con 0x7f1fb8005140 2023-11-04T01:37:29.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.512+0000 7f1fceffd640 1 -- 172.21.15.44:0/3420227234 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc80349d0 con 0x7f1fb8005140 2023-11-04T01:37:29.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.512+0000 7f1fd63b6640 1 -- 172.21.15.44:0/3420227234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fb8005140 msgr2=0x7f1fb800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.512+0000 7f1fd63b6640 1 --2- 172.21.15.44:0/3420227234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fb8005140 0x7f1fb800b980 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0161500 tx=0x7f1fb80057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.512+0000 7f1fd4953640 1 -- 172.21.15.44:0/3420227234 reap_dead start 2023-11-04T01:37:29.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.513+0000 7f1fd63b6640 1 -- 172.21.15.44:0/3420227234 shutdown_connections 2023-11-04T01:37:29.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.513+0000 7f1fd63b6640 1 -- 172.21.15.44:0/3420227234 >> 172.21.15.44:0/3420227234 conn(0x7f1fd006ea90 msgr2=0x7f1fd006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.513+0000 7f1fd63b6640 1 -- 172.21.15.44:0/3420227234 shutdown_connections 2023-11-04T01:37:29.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.513+0000 7f1fd63b6640 1 -- 172.21.15.44:0/3420227234 wait complete. 2023-11-04T01:37:29.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.514+0000 7f1fd63b6640 1 Processor -- start 2023-11-04T01:37:29.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.514+0000 7f1fd63b6640 1 -- start start 2023-11-04T01:37:29.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fd63b6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fd01540e0 0x7f1fd00c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fd63b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd00b4180 0x7f1fd00b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fd63b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd00b5da0 0x7f1fd00c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fd63b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00b5270 con 0x7f1fd00b5da0 2023-11-04T01:37:29.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fd63b6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00ca320 con 0x7f1fd01540e0 2023-11-04T01:37:29.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fd63b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00b6220 con 0x7f1fd00b4180 2023-11-04T01:37:29.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fd4953640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd00b5da0 0x7f1fd00c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fd4953640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd00b5da0 0x7f1fd00c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41636/0 (socket says 172.21.15.44:41636) 2023-11-04T01:37:29.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fd4953640 1 -- 172.21.15.44:0/689994084 learned_addr learned my addr 172.21.15.44:0/689994084 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:29.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fcf7fe640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd00b4180 0x7f1fd00b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fcffff640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fd01540e0 0x7f1fd00c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fd4953640 1 -- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd00b4180 msgr2=0x7f1fd00b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fd4953640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd00b4180 0x7f1fd00b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fd4953640 1 -- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fd01540e0 msgr2=0x7f1fd00c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fd4953640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fd01540e0 0x7f1fd00c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fd4953640 1 -- 172.21.15.44:0/689994084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd015df80 con 0x7f1fd00b5da0 2023-11-04T01:37:29.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fcf7fe640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd00b4180 0x7f1fd00b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:29.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.515+0000 7f1fcffff640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fd01540e0 0x7f1fd00c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:29.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.516+0000 7f1fd4953640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd00b5da0 0x7f1fd00c7c70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800a9c0 tx=0x7f1fc8001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.516+0000 7f1fccff9640 1 -- 172.21.15.44:0/689994084 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8034840 con 0x7f1fd00b5da0 2023-11-04T01:37:29.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.516+0000 7f1fccff9640 1 -- 172.21.15.44:0/689994084 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc802ce90 con 0x7f1fd00b5da0 2023-11-04T01:37:29.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.516+0000 7f1fd63b6640 1 -- 172.21.15.44:0/689994084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd00b49d0 con 0x7f1fd00b5da0 2023-11-04T01:37:29.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.516+0000 7f1fccff9640 1 -- 172.21.15.44:0/689994084 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8034ba0 con 0x7f1fd00b5da0 2023-11-04T01:37:29.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.516+0000 7f1fd63b6640 1 -- 172.21.15.44:0/689994084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd00b4f90 con 0x7f1fd00b5da0 2023-11-04T01:37:29.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.517+0000 7f1fd63b6640 1 -- 172.21.15.44:0/689994084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd0074290 con 0x7f1fd00b5da0 2023-11-04T01:37:29.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.517+0000 7f1fccff9640 1 -- 172.21.15.44:0/689994084 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1fc8031030 con 0x7f1fd00b5da0 2023-11-04T01:37:29.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.518+0000 7f1fccff9640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1fbc06ae70 0x7f1fbc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.518+0000 7f1fccff9640 1 -- 172.21.15.44:0/689994084 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1fc80ab990 con 0x7f1fd00b5da0 2023-11-04T01:37:29.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.518+0000 7f1fcffff640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1fbc06ae70 0x7f1fbc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.518+0000 7f1fcffff640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1fbc06ae70 0x7f1fbc06d330 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009ab0 tx=0x7f1fc0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.522+0000 7f1fccff9640 1 -- 172.21.15.44:0/689994084 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1fc8076a20 con 0x7f1fd00b5da0 2023-11-04T01:37:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.695+0000 7f1fd63b6640 1 -- 172.21.15.44:0/689994084 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fd00cb6b0 con 0x7f1fbc06ae70 2023-11-04T01:37:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.703+0000 7f1fccff9640 1 -- 172.21.15.44:0/689994084 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289758 (secure 0 0 0) 0x7f1fc0013a20 con 0x7f1fbc06ae70 2023-11-04T01:37:29.708 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:37:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.706+0000 7f1fd63b6640 1 -- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1fbc06ae70 msgr2=0x7f1fbc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.706+0000 7f1fd63b6640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1fbc06ae70 0x7f1fbc06d330 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009ab0 tx=0x7f1fc0008040 comp rx=0 tx=0).stop 2023-11-04T01:37:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.706+0000 7f1fd63b6640 1 -- 172.21.15.44:0/689994084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd00b5da0 msgr2=0x7f1fd00c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.706+0000 7f1fd63b6640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd00b5da0 0x7f1fd00c7c70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800a9c0 tx=0x7f1fc8001360 comp rx=0 tx=0).stop 2023-11-04T01:37:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.706+0000 7f1fd63b6640 1 -- 172.21.15.44:0/689994084 shutdown_connections 2023-11-04T01:37:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.706+0000 7f1fd63b6640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1fbc06ae70 0x7f1fbc06d330 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.706+0000 7f1fd63b6640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd00b5da0 0x7f1fd00c7c70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.706+0000 7f1fd63b6640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd00b4180 0x7f1fd00b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.706+0000 7f1fd63b6640 1 --2- 172.21.15.44:0/689994084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fd01540e0 0x7f1fd00c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.706+0000 7f1fd63b6640 1 -- 172.21.15.44:0/689994084 >> 172.21.15.44:0/689994084 conn(0x7f1fd006ea90 msgr2=0x7f1fd00cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.706+0000 7f1fd63b6640 1 -- 172.21.15.44:0/689994084 shutdown_connections 2023-11-04T01:37:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.706+0000 7f1fd63b6640 1 -- 172.21.15.44:0/689994084 wait complete. 2023-11-04T01:37:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2023-11-04T01:37:28.594852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220936,"kb_used_data":4740,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753784,"statfs":{"total":773094113280,"available":772867874816,"internally_reserved":0,"allocated":4853760,"data_stored":2737553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.657480"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.955774+0000","last_change":"2023-11-04T01:37:21.954969+0000","last_active":"2023-11-04T01:37:22.955774+0000","last_peered":"2023-11-04T01:37:22.955774+0000","last_clean":"2023-11-04T01:37:22.955774+0000","last_became_active":"2023-11-04T01:37:21.954717+0000","last_became_peered":"2023-11-04T01:37:21.954717+0000","last_unstale":"2023-11-04T01:37:22.955774+0000","last_undegraded":"2023-11-04T01:37:22.955774+0000","last_fullsized":"2023-11-04T01:37:22.955774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:32.700953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.955579+0000","last_change":"2023-11-04T01:37:21.961380+0000","last_active":"2023-11-04T01:37:22.955579+0000","last_peered":"2023-11-04T01:37:22.955579+0000","last_clean":"2023-11-04T01:37:22.955579+0000","last_became_active":"2023-11-04T01:37:21.961107+0000","last_became_peered":"2023-11-04T01:37:21.961107+0000","last_unstale":"2023-11-04T01:37:22.955579+0000","last_undegraded":"2023-11-04T01:37:22.955579+0000","last_fullsized":"2023-11-04T01:37:22.955579+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:07.999013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.123459+0000","last_change":"2023-11-04T01:37:21.970794+0000","last_active":"2023-11-04T01:37:24.123459+0000","last_peered":"2023-11-04T01:37:24.123459+0000","last_clean":"2023-11-04T01:37:24.123459+0000","last_became_active":"2023-11-04T01:37:21.970467+0000","last_became_peered":"2023-11-04T01:37:21.970467+0000","last_unstale":"2023-11-04T01:37:24.123459+0000","last_undegraded":"2023-11-04T01:37:24.123459+0000","last_fullsized":"2023-11-04T01:37:24.123459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:48.908890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.074867+0000","last_change":"2023-11-04T01:37:21.968683+0000","last_active":"2023-11-04T01:37:24.074867+0000","last_peered":"2023-11-04T01:37:24.074867+0000","last_clean":"2023-11-04T01:37:24.074867+0000","last_became_active":"2023-11-04T01:37:21.968392+0000","last_became_peered":"2023-11-04T01:37:21.968392+0000","last_unstale":"2023-11-04T01:37:24.074867+0000","last_undegraded":"2023-11-04T01:37:24.074867+0000","last_fullsized":"2023-11-04T01:37:24.074867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:56.730215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.074755+0000","last_change":"2023-11-04T01:37:21.959057+0000","last_active":"2023-11-04T01:37:24.074755+0000","last_peered":"2023-11-04T01:37:24.074755+0000","last_clean":"2023-11-04T01:37:24.074755+0000","last_became_active":"2023-11-04T01:37:21.958779+0000","last_became_peered":"2023-11-04T01:37:21.958779+0000","last_unstale":"2023-11-04T01:37:24.074755+0000","last_undegraded":"2023-11-04T01:37:24.074755+0000","last_fullsized":"2023-11-04T01:37:24.074755+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:26.360554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.023962+0000","last_change":"2023-11-04T01:37:21.949592+0000","last_active":"2023-11-04T01:37:23.023962+0000","last_peered":"2023-11-04T01:37:23.023962+0000","last_clean":"2023-11-04T01:37:23.023962+0000","last_became_active":"2023-11-04T01:37:21.949305+0000","last_became_peered":"2023-11-04T01:37:21.949305+0000","last_unstale":"2023-11-04T01:37:23.023962+0000","last_undegraded":"2023-11-04T01:37:23.023962+0000","last_fullsized":"2023-11-04T01:37:23.023962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:43.605431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.077097+0000","last_change":"2023-11-04T01:37:21.969765+0000","last_active":"2023-11-04T01:37:24.077097+0000","last_peered":"2023-11-04T01:37:24.077097+0000","last_clean":"2023-11-04T01:37:24.077097+0000","last_became_active":"2023-11-04T01:37:21.969499+0000","last_became_peered":"2023-11-04T01:37:21.969499+0000","last_unstale":"2023-11-04T01:37:24.077097+0000","last_undegraded":"2023-11-04T01:37:24.077097+0000","last_fullsized":"2023-11-04T01:37:24.077097+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:12:52.313445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.955212+0000","last_change":"2023-11-04T01:37:21.960054+0000","last_active":"2023-11-04T01:37:22.955212+0000","last_peered":"2023-11-04T01:37:22.955212+0000","last_clean":"2023-11-04T01:37:22.955212+0000","last_became_active":"2023-11-04T01:37:21.959790+0000","last_became_peered":"2023-11-04T01:37:21.959790+0000","last_unstale":"2023-11-04T01:37:22.955212+0000","last_undegraded":"2023-11-04T01:37:22.955212+0000","last_fullsized":"2023-11-04T01:37:22.955212+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:03.169085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.123483+0000","last_change":"2023-11-04T01:37:21.970565+0000","last_active":"2023-11-04T01:37:24.123483+0000","last_peered":"2023-11-04T01:37:24.123483+0000","last_clean":"2023-11-04T01:37:24.123483+0000","last_became_active":"2023-11-04T01:37:21.970285+0000","last_became_peered":"2023-11-04T01:37:21.970285+0000","last_unstale":"2023-11-04T01:37:24.123483+0000","last_undegraded":"2023-11-04T01:37:24.123483+0000","last_fullsized":"2023-11-04T01:37:24.123483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:25.358521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.077510+0000","last_change":"2023-11-04T01:37:21.967268+0000","last_active":"2023-11-04T01:37:24.077510+0000","last_peered":"2023-11-04T01:37:24.077510+0000","last_clean":"2023-11-04T01:37:24.077510+0000","last_became_active":"2023-11-04T01:37:21.966874+0000","last_became_peered":"2023-11-04T01:37:21.966874+0000","last_unstale":"2023-11-04T01:37:24.077510+0000","last_undegraded":"2023-11-04T01:37:24.077510+0000","last_fullsized":"2023-11-04T01:37:24.077510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:07.999013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.077524+0000","last_change":"2023-11-04T01:37:21.961966+0000","last_active":"2023-11-04T01:37:24.077524+0000","last_peered":"2023-11-04T01:37:24.077524+0000","last_clean":"2023-11-04T01:37:24.077524+0000","last_became_active":"2023-11-04T01:37:21.961695+0000","last_became_peered":"2023-11-04T01:37:21.961695+0000","last_unstale":"2023-11-04T01:37:24.077524+0000","last_undegraded":"2023-11-04T01:37:24.077524+0000","last_fullsized":"2023-11-04T01:37:24.077524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:46.890851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.123372+0000","last_change":"2023-11-04T01:37:21.958015+0000","last_active":"2023-11-04T01:37:24.123372+0000","last_peered":"2023-11-04T01:37:24.123372+0000","last_clean":"2023-11-04T01:37:24.123372+0000","last_became_active":"2023-11-04T01:37:21.957740+0000","last_became_peered":"2023-11-04T01:37:21.957740+0000","last_unstale":"2023-11-04T01:37:24.123372+0000","last_undegraded":"2023-11-04T01:37:24.123372+0000","last_fullsized":"2023-11-04T01:37:24.123372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:43.605431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.077257+0000","last_change":"2023-11-04T01:37:21.962902+0000","last_active":"2023-11-04T01:37:24.077257+0000","last_peered":"2023-11-04T01:37:24.077257+0000","last_clean":"2023-11-04T01:37:24.077257+0000","last_became_active":"2023-11-04T01:37:21.961877+0000","last_became_peered":"2023-11-04T01:37:21.961877+0000","last_unstale":"2023-11-04T01:37:24.077257+0000","last_undegraded":"2023-11-04T01:37:24.077257+0000","last_fullsized":"2023-11-04T01:37:24.077257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:43.930924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.962716+0000","last_change":"2023-11-04T01:37:21.965016+0000","last_active":"2023-11-04T01:37:22.962716+0000","last_peered":"2023-11-04T01:37:22.962716+0000","last_clean":"2023-11-04T01:37:22.962716+0000","last_became_active":"2023-11-04T01:37:21.964732+0000","last_became_peered":"2023-11-04T01:37:21.964732+0000","last_unstale":"2023-11-04T01:37:22.962716+0000","last_undegraded":"2023-11-04T01:37:22.962716+0000","last_fullsized":"2023-11-04T01:37:22.962716+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:05.709569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.077148+0000","last_change":"2023-11-04T01:37:21.962647+0000","last_active":"2023-11-04T01:37:24.077148+0000","last_peered":"2023-11-04T01:37:24.077148+0000","last_clean":"2023-11-04T01:37:24.077148+0000","last_became_active":"2023-11-04T01:37:21.962368+0000","last_became_peered":"2023-11-04T01:37:21.962368+0000","last_unstale":"2023-11-04T01:37:24.077148+0000","last_undegraded":"2023-11-04T01:37:24.077148+0000","last_fullsized":"2023-11-04T01:37:24.077148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:03.169085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.359104+0000","last_change":"2023-11-04T01:37:21.957255+0000","last_active":"2023-11-04T01:37:23.359104+0000","last_peered":"2023-11-04T01:37:23.359104+0000","last_clean":"2023-11-04T01:37:23.359104+0000","last_became_active":"2023-11-04T01:37:21.956990+0000","last_became_peered":"2023-11-04T01:37:21.956990+0000","last_unstale":"2023-11-04T01:37:23.359104+0000","last_undegraded":"2023-11-04T01:37:23.359104+0000","last_fullsized":"2023-11-04T01:37:23.359104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:19.370093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.359629+0000","last_change":"2023-11-04T01:37:21.956454+0000","last_active":"2023-11-04T01:37:23.359629+0000","last_peered":"2023-11-04T01:37:23.359629+0000","last_clean":"2023-11-04T01:37:23.359629+0000","last_became_active":"2023-11-04T01:37:21.956187+0000","last_became_peered":"2023-11-04T01:37:21.956187+0000","last_unstale":"2023-11-04T01:37:23.359629+0000","last_undegraded":"2023-11-04T01:37:23.359629+0000","last_fullsized":"2023-11-04T01:37:23.359629+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:40.942750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.962788+0000","last_change":"2023-11-04T01:37:21.958912+0000","last_active":"2023-11-04T01:37:22.962788+0000","last_peered":"2023-11-04T01:37:22.962788+0000","last_clean":"2023-11-04T01:37:22.962788+0000","last_became_active":"2023-11-04T01:37:21.958623+0000","last_became_peered":"2023-11-04T01:37:21.958623+0000","last_unstale":"2023-11-04T01:37:22.962788+0000","last_undegraded":"2023-11-04T01:37:22.962788+0000","last_fullsized":"2023-11-04T01:37:22.962788+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:05.709569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.074945+0000","last_change":"2023-11-04T01:37:21.962936+0000","last_active":"2023-11-04T01:37:24.074945+0000","last_peered":"2023-11-04T01:37:24.074945+0000","last_clean":"2023-11-04T01:37:24.074945+0000","last_became_active":"2023-11-04T01:37:21.962417+0000","last_became_peered":"2023-11-04T01:37:21.962417+0000","last_unstale":"2023-11-04T01:37:24.074945+0000","last_undegraded":"2023-11-04T01:37:24.074945+0000","last_fullsized":"2023-11-04T01:37:24.074945+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:52.918020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.962502+0000","last_change":"2023-11-04T01:37:21.960081+0000","last_active":"2023-11-04T01:37:22.962502+0000","last_peered":"2023-11-04T01:37:22.962502+0000","last_clean":"2023-11-04T01:37:22.962502+0000","last_became_active":"2023-11-04T01:37:21.959819+0000","last_became_peered":"2023-11-04T01:37:21.959819+0000","last_unstale":"2023-11-04T01:37:22.962502+0000","last_undegraded":"2023-11-04T01:37:22.962502+0000","last_fullsized":"2023-11-04T01:37:22.962502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:07.218071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.077258+0000","last_change":"2023-11-04T01:37:21.965406+0000","last_active":"2023-11-04T01:37:24.077258+0000","last_peered":"2023-11-04T01:37:24.077258+0000","last_clean":"2023-11-04T01:37:24.077258+0000","last_became_active":"2023-11-04T01:37:21.965142+0000","last_became_peered":"2023-11-04T01:37:21.965142+0000","last_unstale":"2023-11-04T01:37:24.077258+0000","last_undegraded":"2023-11-04T01:37:24.077258+0000","last_fullsized":"2023-11-04T01:37:24.077258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:43.725192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.962800+0000","last_change":"2023-11-04T01:37:21.961889+0000","last_active":"2023-11-04T01:37:22.962800+0000","last_peered":"2023-11-04T01:37:22.962800+0000","last_clean":"2023-11-04T01:37:22.962800+0000","last_became_active":"2023-11-04T01:37:21.961638+0000","last_became_peered":"2023-11-04T01:37:21.961638+0000","last_unstale":"2023-11-04T01:37:22.962800+0000","last_undegraded":"2023-11-04T01:37:22.962800+0000","last_fullsized":"2023-11-04T01:37:22.962800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:33.461934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.359284+0000","last_change":"2023-11-04T01:37:21.960609+0000","last_active":"2023-11-04T01:37:23.359284+0000","last_peered":"2023-11-04T01:37:23.359284+0000","last_clean":"2023-11-04T01:37:23.359284+0000","last_became_active":"2023-11-04T01:37:21.960298+0000","last_became_peered":"2023-11-04T01:37:21.960298+0000","last_unstale":"2023-11-04T01:37:23.359284+0000","last_undegraded":"2023-11-04T01:37:23.359284+0000","last_fullsized":"2023-11-04T01:37:23.359284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:02.370203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.074606+0000","last_change":"2023-11-04T01:37:21.969804+0000","last_active":"2023-11-04T01:37:24.074606+0000","last_peered":"2023-11-04T01:37:24.074606+0000","last_clean":"2023-11-04T01:37:24.074606+0000","last_became_active":"2023-11-04T01:37:21.969512+0000","last_became_peered":"2023-11-04T01:37:21.969512+0000","last_unstale":"2023-11-04T01:37:24.074606+0000","last_undegraded":"2023-11-04T01:37:24.074606+0000","last_fullsized":"2023-11-04T01:37:24.074606+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:20:26.879882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.963047+0000","last_change":"2023-11-04T01:37:21.955888+0000","last_active":"2023-11-04T01:37:22.963047+0000","last_peered":"2023-11-04T01:37:22.963047+0000","last_clean":"2023-11-04T01:37:22.963047+0000","last_became_active":"2023-11-04T01:37:21.954572+0000","last_became_peered":"2023-11-04T01:37:21.954572+0000","last_unstale":"2023-11-04T01:37:22.963047+0000","last_undegraded":"2023-11-04T01:37:22.963047+0000","last_fullsized":"2023-11-04T01:37:22.963047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:33.461934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.024144+0000","last_change":"2023-11-04T01:37:21.970311+0000","last_active":"2023-11-04T01:37:23.024144+0000","last_peered":"2023-11-04T01:37:23.024144+0000","last_clean":"2023-11-04T01:37:23.024144+0000","last_became_active":"2023-11-04T01:37:21.969863+0000","last_became_peered":"2023-11-04T01:37:21.969863+0000","last_unstale":"2023-11-04T01:37:23.024144+0000","last_undegraded":"2023-11-04T01:37:23.024144+0000","last_fullsized":"2023-11-04T01:37:23.024144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:19.370093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.962568+0000","last_change":"2023-11-04T01:37:21.961638+0000","last_active":"2023-11-04T01:37:22.962568+0000","last_peered":"2023-11-04T01:37:22.962568+0000","last_clean":"2023-11-04T01:37:22.962568+0000","last_became_active":"2023-11-04T01:37:21.961220+0000","last_became_peered":"2023-11-04T01:37:21.961220+0000","last_unstale":"2023-11-04T01:37:22.962568+0000","last_undegraded":"2023-11-04T01:37:22.962568+0000","last_fullsized":"2023-11-04T01:37:22.962568+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:42.941030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.077393+0000","last_change":"2023-11-04T01:37:21.965308+0000","last_active":"2023-11-04T01:37:24.077393+0000","last_peered":"2023-11-04T01:37:24.077393+0000","last_clean":"2023-11-04T01:37:24.077393+0000","last_became_active":"2023-11-04T01:37:21.964866+0000","last_became_peered":"2023-11-04T01:37:21.964866+0000","last_unstale":"2023-11-04T01:37:24.077393+0000","last_undegraded":"2023-11-04T01:37:24.077393+0000","last_fullsized":"2023-11-04T01:37:24.077393+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:40.942750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.962370+0000","last_change":"2023-11-04T01:37:21.950025+0000","last_active":"2023-11-04T01:37:22.962370+0000","last_peered":"2023-11-04T01:37:22.962370+0000","last_clean":"2023-11-04T01:37:22.962370+0000","last_became_active":"2023-11-04T01:37:21.949733+0000","last_became_peered":"2023-11-04T01:37:21.949733+0000","last_unstale":"2023-11-04T01:37:22.962370+0000","last_undegraded":"2023-11-04T01:37:22.962370+0000","last_fullsized":"2023-11-04T01:37:22.962370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:04.382273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.962186+0000","last_change":"2023-11-04T01:37:21.948929+0000","last_active":"2023-11-04T01:37:22.962186+0000","last_peered":"2023-11-04T01:37:22.962186+0000","last_clean":"2023-11-04T01:37:22.962186+0000","last_became_active":"2023-11-04T01:37:21.948666+0000","last_became_peered":"2023-11-04T01:37:21.948666+0000","last_unstale":"2023-11-04T01:37:22.962186+0000","last_undegraded":"2023-11-04T01:37:22.962186+0000","last_fullsized":"2023-11-04T01:37:22.962186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:50.597358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.359289+0000","last_change":"2023-11-04T01:37:21.959827+0000","last_active":"2023-11-04T01:37:23.359289+0000","last_peered":"2023-11-04T01:37:23.359289+0000","last_clean":"2023-11-04T01:37:23.359289+0000","last_became_active":"2023-11-04T01:37:21.959520+0000","last_became_peered":"2023-11-04T01:37:21.959520+0000","last_unstale":"2023-11-04T01:37:23.359289+0000","last_undegraded":"2023-11-04T01:37:23.359289+0000","last_fullsized":"2023-11-04T01:37:23.359289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:16.713110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.023863+0000","last_change":"2023-11-04T01:37:21.959466+0000","last_active":"2023-11-04T01:37:23.023863+0000","last_peered":"2023-11-04T01:37:23.023863+0000","last_clean":"2023-11-04T01:37:23.023863+0000","last_became_active":"2023-11-04T01:37:21.959169+0000","last_became_peered":"2023-11-04T01:37:21.959169+0000","last_unstale":"2023-11-04T01:37:23.023863+0000","last_undegraded":"2023-11-04T01:37:23.023863+0000","last_fullsized":"2023-11-04T01:37:23.023863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:20:05.952914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.359428+0000","last_change":"2023-11-04T01:37:21.969978+0000","last_active":"2023-11-04T01:37:23.359428+0000","last_peered":"2023-11-04T01:37:23.359428+0000","last_clean":"2023-11-04T01:37:23.359428+0000","last_became_active":"2023-11-04T01:37:21.969531+0000","last_became_peered":"2023-11-04T01:37:21.969531+0000","last_unstale":"2023-11-04T01:37:23.359428+0000","last_undegraded":"2023-11-04T01:37:23.359428+0000","last_fullsized":"2023-11-04T01:37:23.359428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:12:52.313445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.963022+0000","last_change":"2023-11-04T01:37:20.948850+0000","last_active":"2023-11-04T01:37:21.963022+0000","last_peered":"2023-11-04T01:37:21.963022+0000","last_clean":"2023-11-04T01:37:21.963022+0000","last_became_active":"2023-11-04T01:37:20.948589+0000","last_became_peered":"2023-11-04T01:37:20.948589+0000","last_unstale":"2023-11-04T01:37:21.963022+0000","last_undegraded":"2023-11-04T01:37:21.963022+0000","last_fullsized":"2023-11-04T01:37:21.963022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:42.847107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.024166+0000","last_change":"2023-11-04T01:37:21.965828+0000","last_active":"2023-11-04T01:37:23.024166+0000","last_peered":"2023-11-04T01:37:23.024166+0000","last_clean":"2023-11-04T01:37:23.024166+0000","last_became_active":"2023-11-04T01:37:21.965127+0000","last_became_peered":"2023-11-04T01:37:21.965127+0000","last_unstale":"2023-11-04T01:37:23.024166+0000","last_undegraded":"2023-11-04T01:37:23.024166+0000","last_fullsized":"2023-11-04T01:37:23.024166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:48.908890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.966671+0000","last_change":"2023-11-04T01:37:20.957554+0000","last_active":"2023-11-04T01:37:21.966671+0000","last_peered":"2023-11-04T01:37:21.966671+0000","last_clean":"2023-11-04T01:37:21.966671+0000","last_became_active":"2023-11-04T01:37:20.957283+0000","last_became_peered":"2023-11-04T01:37:20.957283+0000","last_unstale":"2023-11-04T01:37:21.966671+0000","last_undegraded":"2023-11-04T01:37:21.966671+0000","last_fullsized":"2023-11-04T01:37:21.966671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:22.159933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.963243+0000","last_change":"2023-11-04T01:37:21.964334+0000","last_active":"2023-11-04T01:37:22.963243+0000","last_peered":"2023-11-04T01:37:22.963243+0000","last_clean":"2023-11-04T01:37:22.963243+0000","last_became_active":"2023-11-04T01:37:21.964055+0000","last_became_peered":"2023-11-04T01:37:21.964055+0000","last_unstale":"2023-11-04T01:37:22.963243+0000","last_undegraded":"2023-11-04T01:37:22.963243+0000","last_fullsized":"2023-11-04T01:37:22.963243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:07.308023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.965504+0000","last_change":"2023-11-04T01:37:20.951123+0000","last_active":"2023-11-04T01:37:21.965504+0000","last_peered":"2023-11-04T01:37:21.965504+0000","last_clean":"2023-11-04T01:37:21.965504+0000","last_became_active":"2023-11-04T01:37:20.950796+0000","last_became_peered":"2023-11-04T01:37:20.950796+0000","last_unstale":"2023-11-04T01:37:21.965504+0000","last_undegraded":"2023-11-04T01:37:21.965504+0000","last_fullsized":"2023-11-04T01:37:21.965504+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:32.456583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.955759+0000","last_change":"2023-11-04T01:37:21.950061+0000","last_active":"2023-11-04T01:37:22.955759+0000","last_peered":"2023-11-04T01:37:22.955759+0000","last_clean":"2023-11-04T01:37:22.955759+0000","last_became_active":"2023-11-04T01:37:21.949798+0000","last_became_peered":"2023-11-04T01:37:21.949798+0000","last_unstale":"2023-11-04T01:37:22.955759+0000","last_undegraded":"2023-11-04T01:37:22.955759+0000","last_fullsized":"2023-11-04T01:37:22.955759+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:30.561008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.972924+0000","last_change":"2023-11-04T01:37:20.946610+0000","last_active":"2023-11-04T01:37:21.972924+0000","last_peered":"2023-11-04T01:37:21.972924+0000","last_clean":"2023-11-04T01:37:21.972924+0000","last_became_active":"2023-11-04T01:37:20.946320+0000","last_became_peered":"2023-11-04T01:37:20.946320+0000","last_unstale":"2023-11-04T01:37:21.972924+0000","last_undegraded":"2023-11-04T01:37:21.972924+0000","last_fullsized":"2023-11-04T01:37:21.972924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:49.592008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.123459+0000","last_change":"2023-11-04T01:37:21.962768+0000","last_active":"2023-11-04T01:37:24.123459+0000","last_peered":"2023-11-04T01:37:24.123459+0000","last_clean":"2023-11-04T01:37:24.123459+0000","last_became_active":"2023-11-04T01:37:21.962494+0000","last_became_peered":"2023-11-04T01:37:21.962494+0000","last_unstale":"2023-11-04T01:37:24.123459+0000","last_undegraded":"2023-11-04T01:37:24.123459+0000","last_fullsized":"2023-11-04T01:37:24.123459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:02.370203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.969429+0000","last_change":"2023-11-04T01:37:20.958166+0000","last_active":"2023-11-04T01:37:21.969429+0000","last_peered":"2023-11-04T01:37:21.969429+0000","last_clean":"2023-11-04T01:37:21.969429+0000","last_became_active":"2023-11-04T01:37:20.957832+0000","last_became_peered":"2023-11-04T01:37:20.957832+0000","last_unstale":"2023-11-04T01:37:21.969429+0000","last_undegraded":"2023-11-04T01:37:21.969429+0000","last_fullsized":"2023-11-04T01:37:21.969429+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.212721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.077394+0000","last_change":"2023-11-04T01:37:21.966544+0000","last_active":"2023-11-04T01:37:24.077394+0000","last_peered":"2023-11-04T01:37:24.077394+0000","last_clean":"2023-11-04T01:37:24.077394+0000","last_became_active":"2023-11-04T01:37:21.966285+0000","last_became_peered":"2023-11-04T01:37:21.966285+0000","last_unstale":"2023-11-04T01:37:24.077394+0000","last_undegraded":"2023-11-04T01:37:24.077394+0000","last_fullsized":"2023-11-04T01:37:24.077394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:31:25.132216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.972294+0000","last_change":"2023-11-04T01:37:20.958018+0000","last_active":"2023-11-04T01:37:21.972294+0000","last_peered":"2023-11-04T01:37:21.972294+0000","last_clean":"2023-11-04T01:37:21.972294+0000","last_became_active":"2023-11-04T01:37:20.957734+0000","last_became_peered":"2023-11-04T01:37:20.957734+0000","last_unstale":"2023-11-04T01:37:21.972294+0000","last_undegraded":"2023-11-04T01:37:21.972294+0000","last_fullsized":"2023-11-04T01:37:21.972294+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:22.159933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.962599+0000","last_change":"2023-11-04T01:37:21.963677+0000","last_active":"2023-11-04T01:37:22.962599+0000","last_peered":"2023-11-04T01:37:22.962599+0000","last_clean":"2023-11-04T01:37:22.962599+0000","last_became_active":"2023-11-04T01:37:21.963421+0000","last_became_peered":"2023-11-04T01:37:21.963421+0000","last_unstale":"2023-11-04T01:37:22.962599+0000","last_undegraded":"2023-11-04T01:37:22.962599+0000","last_fullsized":"2023-11-04T01:37:22.962599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:42.941030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.947087+0000","last_change":"2023-11-04T01:37:20.951909+0000","last_active":"2023-11-04T01:37:21.947087+0000","last_peered":"2023-11-04T01:37:21.947087+0000","last_clean":"2023-11-04T01:37:21.947087+0000","last_became_active":"2023-11-04T01:37:20.951595+0000","last_became_peered":"2023-11-04T01:37:20.951595+0000","last_unstale":"2023-11-04T01:37:21.947087+0000","last_undegraded":"2023-11-04T01:37:21.947087+0000","last_fullsized":"2023-11-04T01:37:21.947087+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:04.704219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.955379+0000","last_change":"2023-11-04T01:37:21.957769+0000","last_active":"2023-11-04T01:37:22.955379+0000","last_peered":"2023-11-04T01:37:22.955379+0000","last_clean":"2023-11-04T01:37:22.955379+0000","last_became_active":"2023-11-04T01:37:21.955876+0000","last_became_peered":"2023-11-04T01:37:21.955876+0000","last_unstale":"2023-11-04T01:37:22.955379+0000","last_undegraded":"2023-11-04T01:37:22.955379+0000","last_fullsized":"2023-11-04T01:37:22.955379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:43.930924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.950396+0000","last_change":"2023-11-04T01:37:20.948666+0000","last_active":"2023-11-04T01:37:21.950396+0000","last_peered":"2023-11-04T01:37:21.950396+0000","last_clean":"2023-11-04T01:37:21.950396+0000","last_became_active":"2023-11-04T01:37:20.948379+0000","last_became_peered":"2023-11-04T01:37:20.948379+0000","last_unstale":"2023-11-04T01:37:21.950396+0000","last_undegraded":"2023-11-04T01:37:21.950396+0000","last_fullsized":"2023-11-04T01:37:21.950396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:42.847107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.074870+0000","last_change":"2023-11-04T01:37:21.959192+0000","last_active":"2023-11-04T01:37:24.074870+0000","last_peered":"2023-11-04T01:37:24.074870+0000","last_clean":"2023-11-04T01:37:24.074870+0000","last_became_active":"2023-11-04T01:37:21.958927+0000","last_became_peered":"2023-11-04T01:37:21.958927+0000","last_unstale":"2023-11-04T01:37:24.074870+0000","last_undegraded":"2023-11-04T01:37:24.074870+0000","last_fullsized":"2023-11-04T01:37:24.074870+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:45.633701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.942282+0000","last_change":"2023-11-04T01:37:20.951039+0000","last_active":"2023-11-04T01:37:21.942282+0000","last_peered":"2023-11-04T01:37:21.942282+0000","last_clean":"2023-11-04T01:37:21.942282+0000","last_became_active":"2023-11-04T01:37:20.950768+0000","last_became_peered":"2023-11-04T01:37:20.950768+0000","last_unstale":"2023-11-04T01:37:21.942282+0000","last_undegraded":"2023-11-04T01:37:21.942282+0000","last_fullsized":"2023-11-04T01:37:21.942282+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:47.903540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.359449+0000","last_change":"2023-11-04T01:37:21.955785+0000","last_active":"2023-11-04T01:37:23.359449+0000","last_peered":"2023-11-04T01:37:23.359449+0000","last_clean":"2023-11-04T01:37:23.359449+0000","last_became_active":"2023-11-04T01:37:21.955232+0000","last_became_peered":"2023-11-04T01:37:21.955232+0000","last_unstale":"2023-11-04T01:37:23.359449+0000","last_undegraded":"2023-11-04T01:37:23.359449+0000","last_fullsized":"2023-11-04T01:37:23.359449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:03.169085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.953085+0000","last_change":"2023-11-04T01:37:20.953603+0000","last_active":"2023-11-04T01:37:21.953085+0000","last_peered":"2023-11-04T01:37:21.953085+0000","last_clean":"2023-11-04T01:37:21.953085+0000","last_became_active":"2023-11-04T01:37:20.953355+0000","last_became_peered":"2023-11-04T01:37:20.953355+0000","last_unstale":"2023-11-04T01:37:21.953085+0000","last_undegraded":"2023-11-04T01:37:21.953085+0000","last_fullsized":"2023-11-04T01:37:21.953085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:01.364853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.123514+0000","last_change":"2023-11-04T01:37:21.967380+0000","last_active":"2023-11-04T01:37:24.123514+0000","last_peered":"2023-11-04T01:37:24.123514+0000","last_clean":"2023-11-04T01:37:24.123514+0000","last_became_active":"2023-11-04T01:37:21.967042+0000","last_became_peered":"2023-11-04T01:37:21.967042+0000","last_unstale":"2023-11-04T01:37:24.123514+0000","last_undegraded":"2023-11-04T01:37:24.123514+0000","last_fullsized":"2023-11-04T01:37:24.123514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:12:52.313445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.971368+0000","last_change":"2023-11-04T01:37:20.951932+0000","last_active":"2023-11-04T01:37:21.971368+0000","last_peered":"2023-11-04T01:37:21.971368+0000","last_clean":"2023-11-04T01:37:21.971368+0000","last_became_active":"2023-11-04T01:37:20.951672+0000","last_became_peered":"2023-11-04T01:37:20.951672+0000","last_unstale":"2023-11-04T01:37:21.971368+0000","last_undegraded":"2023-11-04T01:37:21.971368+0000","last_fullsized":"2023-11-04T01:37:21.971368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:24.353171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.963099+0000","last_change":"2023-11-04T01:37:21.961286+0000","last_active":"2023-11-04T01:37:22.963099+0000","last_peered":"2023-11-04T01:37:22.963099+0000","last_clean":"2023-11-04T01:37:22.963099+0000","last_became_active":"2023-11-04T01:37:21.961020+0000","last_became_peered":"2023-11-04T01:37:21.961020+0000","last_unstale":"2023-11-04T01:37:22.963099+0000","last_undegraded":"2023-11-04T01:37:22.963099+0000","last_fullsized":"2023-11-04T01:37:22.963099+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:23.165284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.974990+0000","last_change":"2023-11-04T01:37:20.957547+0000","last_active":"2023-11-04T01:37:21.974990+0000","last_peered":"2023-11-04T01:37:21.974990+0000","last_clean":"2023-11-04T01:37:21.974990+0000","last_became_active":"2023-11-04T01:37:20.957264+0000","last_became_peered":"2023-11-04T01:37:20.957264+0000","last_unstale":"2023-11-04T01:37:21.974990+0000","last_undegraded":"2023-11-04T01:37:21.974990+0000","last_fullsized":"2023-11-04T01:37:21.974990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:42.600080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.123421+0000","last_change":"2023-11-04T01:37:21.971508+0000","last_active":"2023-11-04T01:37:24.123421+0000","last_peered":"2023-11-04T01:37:24.123421+0000","last_clean":"2023-11-04T01:37:24.123421+0000","last_became_active":"2023-11-04T01:37:21.971218+0000","last_became_peered":"2023-11-04T01:37:21.971218+0000","last_unstale":"2023-11-04T01:37:24.123421+0000","last_undegraded":"2023-11-04T01:37:24.123421+0000","last_fullsized":"2023-11-04T01:37:24.123421+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:19.370093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.970328+0000","last_change":"2023-11-04T01:37:20.957462+0000","last_active":"2023-11-04T01:37:21.970328+0000","last_peered":"2023-11-04T01:37:21.970328+0000","last_clean":"2023-11-04T01:37:21.970328+0000","last_became_active":"2023-11-04T01:37:20.957172+0000","last_became_peered":"2023-11-04T01:37:20.957172+0000","last_unstale":"2023-11-04T01:37:21.970328+0000","last_undegraded":"2023-11-04T01:37:21.970328+0000","last_fullsized":"2023-11-04T01:37:21.970328+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:20:04.947563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.955298+0000","last_change":"2023-11-04T01:37:21.952341+0000","last_active":"2023-11-04T01:37:22.955298+0000","last_peered":"2023-11-04T01:37:22.955298+0000","last_clean":"2023-11-04T01:37:22.955298+0000","last_became_active":"2023-11-04T01:37:21.952082+0000","last_became_peered":"2023-11-04T01:37:21.952082+0000","last_unstale":"2023-11-04T01:37:22.955298+0000","last_undegraded":"2023-11-04T01:37:22.955298+0000","last_fullsized":"2023-11-04T01:37:22.955298+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:16.713110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.946638+0000","last_change":"2023-11-04T01:37:20.951880+0000","last_active":"2023-11-04T01:37:21.946638+0000","last_peered":"2023-11-04T01:37:21.946638+0000","last_clean":"2023-11-04T01:37:21.946638+0000","last_became_active":"2023-11-04T01:37:20.951551+0000","last_became_peered":"2023-11-04T01:37:20.951551+0000","last_unstale":"2023-11-04T01:37:21.946638+0000","last_undegraded":"2023-11-04T01:37:21.946638+0000","last_fullsized":"2023-11-04T01:37:21.946638+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:03.376922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.359250+0000","last_change":"2023-11-04T01:37:21.965918+0000","last_active":"2023-11-04T01:37:23.359250+0000","last_peered":"2023-11-04T01:37:23.359250+0000","last_clean":"2023-11-04T01:37:23.359250+0000","last_became_active":"2023-11-04T01:37:21.965247+0000","last_became_peered":"2023-11-04T01:37:21.965247+0000","last_unstale":"2023-11-04T01:37:23.359250+0000","last_undegraded":"2023-11-04T01:37:23.359250+0000","last_fullsized":"2023-11-04T01:37:23.359250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:25.358521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.944137+0000","last_change":"2023-11-04T01:37:20.946684+0000","last_active":"2023-11-04T01:37:21.944137+0000","last_peered":"2023-11-04T01:37:21.944137+0000","last_clean":"2023-11-04T01:37:21.944137+0000","last_became_active":"2023-11-04T01:37:20.946206+0000","last_became_peered":"2023-11-04T01:37:20.946206+0000","last_unstale":"2023-11-04T01:37:21.944137+0000","last_undegraded":"2023-11-04T01:37:21.944137+0000","last_fullsized":"2023-11-04T01:37:21.944137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:44.628350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.955420+0000","last_change":"2023-11-04T01:37:21.954326+0000","last_active":"2023-11-04T01:37:22.955420+0000","last_peered":"2023-11-04T01:37:22.955420+0000","last_clean":"2023-11-04T01:37:22.955420+0000","last_became_active":"2023-11-04T01:37:21.953743+0000","last_became_peered":"2023-11-04T01:37:21.953743+0000","last_unstale":"2023-11-04T01:37:22.955420+0000","last_undegraded":"2023-11-04T01:37:22.955420+0000","last_fullsized":"2023-11-04T01:37:22.955420+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:43.725192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.972294+0000","last_change":"2023-11-04T01:37:20.960179+0000","last_active":"2023-11-04T01:37:21.972294+0000","last_peered":"2023-11-04T01:37:21.972294+0000","last_clean":"2023-11-04T01:37:21.972294+0000","last_became_active":"2023-11-04T01:37:20.959900+0000","last_became_peered":"2023-11-04T01:37:20.959900+0000","last_unstale":"2023-11-04T01:37:21.972294+0000","last_undegraded":"2023-11-04T01:37:21.972294+0000","last_fullsized":"2023-11-04T01:37:21.972294+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:42.847107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.955470+0000","last_change":"2023-11-04T01:37:21.950688+0000","last_active":"2023-11-04T01:37:22.955470+0000","last_peered":"2023-11-04T01:37:22.955470+0000","last_clean":"2023-11-04T01:37:22.955470+0000","last_became_active":"2023-11-04T01:37:21.950417+0000","last_became_peered":"2023-11-04T01:37:21.950417+0000","last_unstale":"2023-11-04T01:37:22.955470+0000","last_undegraded":"2023-11-04T01:37:22.955470+0000","last_fullsized":"2023-11-04T01:37:22.955470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:40.942750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.971213+0000","last_change":"2023-11-04T01:37:20.947847+0000","last_active":"2023-11-04T01:37:21.971213+0000","last_peered":"2023-11-04T01:37:21.971213+0000","last_clean":"2023-11-04T01:37:21.971213+0000","last_became_active":"2023-11-04T01:37:20.947565+0000","last_became_peered":"2023-11-04T01:37:20.947565+0000","last_unstale":"2023-11-04T01:37:21.971213+0000","last_undegraded":"2023-11-04T01:37:21.971213+0000","last_fullsized":"2023-11-04T01:37:21.971213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:32.456583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.077636+0000","last_change":"2023-11-04T01:37:21.967627+0000","last_active":"2023-11-04T01:37:24.077636+0000","last_peered":"2023-11-04T01:37:24.077636+0000","last_clean":"2023-11-04T01:37:24.077636+0000","last_became_active":"2023-11-04T01:37:21.965672+0000","last_became_peered":"2023-11-04T01:37:21.965672+0000","last_unstale":"2023-11-04T01:37:24.077636+0000","last_undegraded":"2023-11-04T01:37:24.077636+0000","last_fullsized":"2023-11-04T01:37:24.077636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:30.561008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.971958+0000","last_change":"2023-11-04T01:37:20.950827+0000","last_active":"2023-11-04T01:37:21.971958+0000","last_peered":"2023-11-04T01:37:21.971958+0000","last_clean":"2023-11-04T01:37:21.971958+0000","last_became_active":"2023-11-04T01:37:20.950575+0000","last_became_peered":"2023-11-04T01:37:20.950575+0000","last_unstale":"2023-11-04T01:37:21.971958+0000","last_undegraded":"2023-11-04T01:37:21.971958+0000","last_fullsized":"2023-11-04T01:37:21.971958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:03.376922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.963186+0000","last_change":"2023-11-04T01:37:21.965890+0000","last_active":"2023-11-04T01:37:22.963186+0000","last_peered":"2023-11-04T01:37:22.963186+0000","last_clean":"2023-11-04T01:37:22.963186+0000","last_became_active":"2023-11-04T01:37:21.965647+0000","last_became_peered":"2023-11-04T01:37:21.965647+0000","last_unstale":"2023-11-04T01:37:22.963186+0000","last_undegraded":"2023-11-04T01:37:22.963186+0000","last_fullsized":"2023-11-04T01:37:22.963186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:20:05.952914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.964830+0000","last_change":"2023-11-04T01:37:20.959217+0000","last_active":"2023-11-04T01:37:21.964830+0000","last_peered":"2023-11-04T01:37:21.964830+0000","last_clean":"2023-11-04T01:37:21.964830+0000","last_became_active":"2023-11-04T01:37:20.958336+0000","last_became_peered":"2023-11-04T01:37:20.958336+0000","last_unstale":"2023-11-04T01:37:21.964830+0000","last_undegraded":"2023-11-04T01:37:21.964830+0000","last_fullsized":"2023-11-04T01:37:21.964830+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:20:01.127723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.074945+0000","last_change":"2023-11-04T01:37:21.955238+0000","last_active":"2023-11-04T01:37:24.074945+0000","last_peered":"2023-11-04T01:37:24.074945+0000","last_clean":"2023-11-04T01:37:24.074945+0000","last_became_active":"2023-11-04T01:37:21.954947+0000","last_became_peered":"2023-11-04T01:37:21.954947+0000","last_unstale":"2023-11-04T01:37:24.074945+0000","last_undegraded":"2023-11-04T01:37:24.074945+0000","last_fullsized":"2023-11-04T01:37:24.074945+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:19.754425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.946937+0000","last_change":"2023-11-04T01:37:20.950464+0000","last_active":"2023-11-04T01:37:21.946937+0000","last_peered":"2023-11-04T01:37:21.946937+0000","last_clean":"2023-11-04T01:37:21.946937+0000","last_became_active":"2023-11-04T01:37:20.950133+0000","last_became_peered":"2023-11-04T01:37:20.950133+0000","last_unstale":"2023-11-04T01:37:21.946937+0000","last_undegraded":"2023-11-04T01:37:21.946937+0000","last_fullsized":"2023-11-04T01:37:21.946937+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:41.935679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.359259+0000","last_change":"2023-11-04T01:37:21.960591+0000","last_active":"2023-11-04T01:37:23.359259+0000","last_peered":"2023-11-04T01:37:23.359259+0000","last_clean":"2023-11-04T01:37:23.359259+0000","last_became_active":"2023-11-04T01:37:21.960325+0000","last_became_peered":"2023-11-04T01:37:21.960325+0000","last_unstale":"2023-11-04T01:37:23.359259+0000","last_undegraded":"2023-11-04T01:37:23.359259+0000","last_fullsized":"2023-11-04T01:37:23.359259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:48.908890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.958467+0000","last_change":"2023-11-04T01:37:20.955294+0000","last_active":"2023-11-04T01:37:21.958467+0000","last_peered":"2023-11-04T01:37:21.958467+0000","last_clean":"2023-11-04T01:37:21.958467+0000","last_became_active":"2023-11-04T01:37:20.955019+0000","last_became_peered":"2023-11-04T01:37:20.955019+0000","last_unstale":"2023-11-04T01:37:21.958467+0000","last_undegraded":"2023-11-04T01:37:21.958467+0000","last_fullsized":"2023-11-04T01:37:21.958467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:49:25.914839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.123381+0000","last_change":"2023-11-04T01:37:21.958089+0000","last_active":"2023-11-04T01:37:24.123381+0000","last_peered":"2023-11-04T01:37:24.123381+0000","last_clean":"2023-11-04T01:37:24.123381+0000","last_became_active":"2023-11-04T01:37:21.957793+0000","last_became_peered":"2023-11-04T01:37:21.957793+0000","last_unstale":"2023-11-04T01:37:24.123381+0000","last_undegraded":"2023-11-04T01:37:24.123381+0000","last_fullsized":"2023-11-04T01:37:24.123381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:46:34.559766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.952420+0000","last_change":"2023-11-04T01:37:20.952410+0000","last_active":"2023-11-04T01:37:21.952420+0000","last_peered":"2023-11-04T01:37:21.952420+0000","last_clean":"2023-11-04T01:37:21.952420+0000","last_became_active":"2023-11-04T01:37:20.952143+0000","last_became_peered":"2023-11-04T01:37:20.952143+0000","last_unstale":"2023-11-04T01:37:21.952420+0000","last_undegraded":"2023-11-04T01:37:21.952420+0000","last_fullsized":"2023-11-04T01:37:21.952420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:00.482538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.077232+0000","last_change":"2023-11-04T01:37:21.957038+0000","last_active":"2023-11-04T01:37:24.077232+0000","last_peered":"2023-11-04T01:37:24.077232+0000","last_clean":"2023-11-04T01:37:24.077232+0000","last_became_active":"2023-11-04T01:37:21.956577+0000","last_became_peered":"2023-11-04T01:37:21.956577+0000","last_unstale":"2023-11-04T01:37:24.077232+0000","last_undegraded":"2023-11-04T01:37:24.077232+0000","last_fullsized":"2023-11-04T01:37:24.077232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:16.713110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.946338+0000","last_change":"2023-11-04T01:37:20.957857+0000","last_active":"2023-11-04T01:37:21.946338+0000","last_peered":"2023-11-04T01:37:21.946338+0000","last_clean":"2023-11-04T01:37:21.946338+0000","last_became_active":"2023-11-04T01:37:20.957415+0000","last_became_peered":"2023-11-04T01:37:20.957415+0000","last_unstale":"2023-11-04T01:37:21.946338+0000","last_undegraded":"2023-11-04T01:37:21.946338+0000","last_fullsized":"2023-11-04T01:37:21.946338+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:41.935679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.955506+0000","last_change":"2023-11-04T01:37:21.957581+0000","last_active":"2023-11-04T01:37:22.955506+0000","last_peered":"2023-11-04T01:37:22.955506+0000","last_clean":"2023-11-04T01:37:22.955506+0000","last_became_active":"2023-11-04T01:37:21.957268+0000","last_became_peered":"2023-11-04T01:37:21.957268+0000","last_unstale":"2023-11-04T01:37:22.955506+0000","last_undegraded":"2023-11-04T01:37:22.955506+0000","last_fullsized":"2023-11-04T01:37:22.955506+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:31:25.132216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.954262+0000","last_change":"2023-11-04T01:37:20.958969+0000","last_active":"2023-11-04T01:37:21.954262+0000","last_peered":"2023-11-04T01:37:21.954262+0000","last_clean":"2023-11-04T01:37:21.954262+0000","last_became_active":"2023-11-04T01:37:20.958656+0000","last_became_peered":"2023-11-04T01:37:20.958656+0000","last_unstale":"2023-11-04T01:37:21.954262+0000","last_undegraded":"2023-11-04T01:37:21.954262+0000","last_fullsized":"2023-11-04T01:37:21.954262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:44.200233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.024017+0000","last_change":"2023-11-04T01:37:21.958849+0000","last_active":"2023-11-04T01:37:23.024017+0000","last_peered":"2023-11-04T01:37:23.024017+0000","last_clean":"2023-11-04T01:37:23.024017+0000","last_became_active":"2023-11-04T01:37:21.958386+0000","last_became_peered":"2023-11-04T01:37:21.958386+0000","last_unstale":"2023-11-04T01:37:23.024017+0000","last_undegraded":"2023-11-04T01:37:23.024017+0000","last_fullsized":"2023-11-04T01:37:23.024017+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:46:34.559766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.969546+0000","last_change":"2023-11-04T01:37:20.951195+0000","last_active":"2023-11-04T01:37:21.969546+0000","last_peered":"2023-11-04T01:37:21.969546+0000","last_clean":"2023-11-04T01:37:21.969546+0000","last_became_active":"2023-11-04T01:37:20.950916+0000","last_became_peered":"2023-11-04T01:37:20.950916+0000","last_unstale":"2023-11-04T01:37:21.969546+0000","last_undegraded":"2023-11-04T01:37:21.969546+0000","last_fullsized":"2023-11-04T01:37:21.969546+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:20:04.947563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.359528+0000","last_change":"2023-11-04T01:37:21.955526+0000","last_active":"2023-11-04T01:37:23.359528+0000","last_peered":"2023-11-04T01:37:23.359528+0000","last_clean":"2023-11-04T01:37:23.359528+0000","last_became_active":"2023-11-04T01:37:21.954890+0000","last_became_peered":"2023-11-04T01:37:21.954890+0000","last_unstale":"2023-11-04T01:37:23.359528+0000","last_undegraded":"2023-11-04T01:37:23.359528+0000","last_fullsized":"2023-11-04T01:37:23.359528+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:43.930924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.074908+0000","last_change":"2023-11-04T01:37:20.954111+0000","last_active":"2023-11-04T01:37:24.074908+0000","last_peered":"2023-11-04T01:37:24.074908+0000","last_clean":"2023-11-04T01:37:24.074908+0000","last_became_active":"2023-11-04T01:37:20.953851+0000","last_became_peered":"2023-11-04T01:37:20.953851+0000","last_unstale":"2023-11-04T01:37:24.074908+0000","last_undegraded":"2023-11-04T01:37:24.074908+0000","last_fullsized":"2023-11-04T01:37:24.074908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:15:44.156052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.955682+0000","last_change":"2023-11-04T01:37:21.965986+0000","last_active":"2023-11-04T01:37:22.955682+0000","last_peered":"2023-11-04T01:37:22.955682+0000","last_clean":"2023-11-04T01:37:22.955682+0000","last_became_active":"2023-11-04T01:37:21.965681+0000","last_became_peered":"2023-11-04T01:37:21.965681+0000","last_unstale":"2023-11-04T01:37:22.955682+0000","last_undegraded":"2023-11-04T01:37:22.955682+0000","last_fullsized":"2023-11-04T01:37:22.955682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:46.890851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.949045+0000","last_change":"2023-11-04T01:37:20.958189+0000","last_active":"2023-11-04T01:37:21.949045+0000","last_peered":"2023-11-04T01:37:21.949045+0000","last_clean":"2023-11-04T01:37:21.949045+0000","last_became_active":"2023-11-04T01:37:20.957903+0000","last_became_peered":"2023-11-04T01:37:20.957903+0000","last_unstale":"2023-11-04T01:37:21.949045+0000","last_undegraded":"2023-11-04T01:37:21.949045+0000","last_fullsized":"2023-11-04T01:37:21.949045+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:49:41.935679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.123569+0000","last_change":"2023-11-04T01:37:21.952676+0000","last_active":"2023-11-04T01:37:24.123569+0000","last_peered":"2023-11-04T01:37:24.123569+0000","last_clean":"2023-11-04T01:37:24.123569+0000","last_became_active":"2023-11-04T01:37:21.952412+0000","last_became_peered":"2023-11-04T01:37:21.952412+0000","last_unstale":"2023-11-04T01:37:24.123569+0000","last_undegraded":"2023-11-04T01:37:24.123569+0000","last_fullsized":"2023-11-04T01:37:24.123569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:03.169085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.949413+0000","last_change":"2023-11-04T01:37:20.957300+0000","last_active":"2023-11-04T01:37:21.949413+0000","last_peered":"2023-11-04T01:37:21.949413+0000","last_clean":"2023-11-04T01:37:21.949413+0000","last_became_active":"2023-11-04T01:37:20.957035+0000","last_became_peered":"2023-11-04T01:37:20.957035+0000","last_unstale":"2023-11-04T01:37:21.949413+0000","last_undegraded":"2023-11-04T01:37:21.949413+0000","last_fullsized":"2023-11-04T01:37:21.949413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:32.456583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.023921+0000","last_change":"2023-11-04T01:37:21.955977+0000","last_active":"2023-11-04T01:37:23.023921+0000","last_peered":"2023-11-04T01:37:23.023921+0000","last_clean":"2023-11-04T01:37:23.023921+0000","last_became_active":"2023-11-04T01:37:21.955063+0000","last_became_peered":"2023-11-04T01:37:21.955063+0000","last_unstale":"2023-11-04T01:37:23.023921+0000","last_undegraded":"2023-11-04T01:37:23.023921+0000","last_fullsized":"2023-11-04T01:37:23.023921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:07.308023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.944625+0000","last_change":"2023-11-04T01:37:20.955263+0000","last_active":"2023-11-04T01:37:21.944625+0000","last_peered":"2023-11-04T01:37:21.944625+0000","last_clean":"2023-11-04T01:37:21.944625+0000","last_became_active":"2023-11-04T01:37:20.955015+0000","last_became_peered":"2023-11-04T01:37:20.955015+0000","last_unstale":"2023-11-04T01:37:21.944625+0000","last_undegraded":"2023-11-04T01:37:21.944625+0000","last_fullsized":"2023-11-04T01:37:21.944625+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:51.912669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:22.962397+0000","last_change":"2023-11-04T01:37:21.958800+0000","last_active":"2023-11-04T01:37:22.962397+0000","last_peered":"2023-11-04T01:37:22.962397+0000","last_clean":"2023-11-04T01:37:22.962397+0000","last_became_active":"2023-11-04T01:37:21.958513+0000","last_became_peered":"2023-11-04T01:37:21.958513+0000","last_unstale":"2023-11-04T01:37:22.962397+0000","last_undegraded":"2023-11-04T01:37:22.962397+0000","last_fullsized":"2023-11-04T01:37:22.962397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:07.218071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.950469+0000","last_change":"2023-11-04T01:37:20.944425+0000","last_active":"2023-11-04T01:37:21.950469+0000","last_peered":"2023-11-04T01:37:21.950469+0000","last_clean":"2023-11-04T01:37:21.950469+0000","last_became_active":"2023-11-04T01:37:20.944147+0000","last_became_peered":"2023-11-04T01:37:20.944147+0000","last_unstale":"2023-11-04T01:37:21.950469+0000","last_undegraded":"2023-11-04T01:37:21.950469+0000","last_fullsized":"2023-11-04T01:37:21.950469+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:57:28.939429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:23.359575+0000","last_change":"2023-11-04T01:37:21.954691+0000","last_active":"2023-11-04T01:37:23.359575+0000","last_peered":"2023-11-04T01:37:23.359575+0000","last_clean":"2023-11-04T01:37:23.359575+0000","last_became_active":"2023-11-04T01:37:21.954390+0000","last_became_peered":"2023-11-04T01:37:21.954390+0000","last_unstale":"2023-11-04T01:37:23.359575+0000","last_undegraded":"2023-11-04T01:37:23.359575+0000","last_fullsized":"2023-11-04T01:37:23.359575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:43.725192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.942218+0000","last_change":"2023-11-04T01:37:20.953474+0000","last_active":"2023-11-04T01:37:21.942218+0000","last_peered":"2023-11-04T01:37:21.942218+0000","last_clean":"2023-11-04T01:37:21.942218+0000","last_became_active":"2023-11-04T01:37:20.953215+0000","last_became_peered":"2023-11-04T01:37:20.953215+0000","last_unstale":"2023-11-04T01:37:21.942218+0000","last_undegraded":"2023-11-04T01:37:21.942218+0000","last_fullsized":"2023-11-04T01:37:21.942218+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:18.364742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-04T01:37:24.077636+0000","last_change":"2023-11-04T01:37:21.967802+0000","last_active":"2023-11-04T01:37:24.077636+0000","last_peered":"2023-11-04T01:37:24.077636+0000","last_clean":"2023-11-04T01:37:24.077636+0000","last_became_active":"2023-11-04T01:37:21.967454+0000","last_became_peered":"2023-11-04T01:37:21.967454+0000","last_unstale":"2023-11-04T01:37:24.077636+0000","last_undegraded":"2023-11-04T01:37:24.077636+0000","last_fullsized":"2023-11-04T01:37:24.077636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:20.931762+0000","last_clean_scrub_stamp":"2023-11-04T01:37:20.931762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:32.700953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.947272+0000","last_change":"2023-11-04T01:37:20.958978+0000","last_active":"2023-11-04T01:37:21.947272+0000","last_peered":"2023-11-04T01:37:21.947272+0000","last_clean":"2023-11-04T01:37:21.947272+0000","last_became_active":"2023-11-04T01:37:20.958778+0000","last_became_peered":"2023-11-04T01:37:20.958778+0000","last_unstale":"2023-11-04T01:37:21.947272+0000","last_undegraded":"2023-11-04T01:37:21.947272+0000","last_fullsized":"2023-11-04T01:37:21.947272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:19.926411+0000","last_clean_scrub_stamp":"2023-11-04T01:37:19.926411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:42.600080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:21.946094+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:37:21.946094+0000","last_peered":"2023-11-04T01:37:21.946094+0000","last_clean":"2023-11-04T01:37:21.946094+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:37:21.946094+0000","last_undegraded":"2023-11-04T01:37:21.946094+0000","last_fullsized":"2023-11-04T01:37:21.946094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1060864,"data_stored":786177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.61799999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.502},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.59199999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.64300000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.51700000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.438}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":194709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52000000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.497},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.436},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.40100000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.65100000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.68600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.436}]},{"osd":1,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.54200000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.38700000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48199999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.501}]},{"osd":6,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.62}]},{"osd":7,"last update":"Sat Nov 4 01:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.59199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":194731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.55800000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.502}]},{"osd":2,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.61899999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.70099999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.64800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":195773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.22800000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.26200000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.315},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.46700000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.504},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.41899999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.42899999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.52500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.249},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.308}]},{"osd":1,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.35499999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34000000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.76200000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.71699999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.628},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.68200000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":194217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.29899999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.38200000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.35899999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.76200000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.625},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.89700000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.69899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1044480,"data_stored":783510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.45500000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36099999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.42099999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.76200000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.80600000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Nov 4 01:36:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:37:29.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:37:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.870+0000 7f35a464f640 1 Processor -- start 2023-11-04T01:37:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.870+0000 7f35a464f640 1 -- start start 2023-11-04T01:37:29.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.871+0000 7f35a464f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f359c1605b0 0x7f359c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.871+0000 7f35a464f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f359c06a830 0x7f359c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.871+0000 7f35a464f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c160990 con 0x7f359c0b1a40 2023-11-04T01:37:29.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.871+0000 7f35a464f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c0cc7c0 con 0x7f359c06a830 2023-11-04T01:37:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.871+0000 7f35a464f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c0cd750 con 0x7f359c1605b0 2023-11-04T01:37:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.871+0000 7f35a2bec640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f359c06a830 0x7f359c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.871+0000 7f35a2bec640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f359c06a830 0x7f359c0cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41650/0 (socket says 172.21.15.44:41650) 2023-11-04T01:37:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.871+0000 7f35a2bec640 1 -- 172.21.15.44:0/3333046137 learned_addr learned my addr 172.21.15.44:0/3333046137 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.871+0000 7f35a23eb640 1 --2- 172.21.15.44:0/3333046137 >> v2:172.21.15.204:3300/0 conn(0x7f359c1605b0 0x7f359c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.871+0000 7f35a2bec640 1 -- 172.21.15.44:0/3333046137 >> v2:172.21.15.204:3300/0 conn(0x7f359c1605b0 msgr2=0x7f359c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.871+0000 7f35a2bec640 1 --2- 172.21.15.44:0/3333046137 >> v2:172.21.15.204:3300/0 conn(0x7f359c1605b0 0x7f359c0ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.871+0000 7f35a2bec640 1 -- 172.21.15.44:0/3333046137 >> v1:172.21.15.204:6789/0 conn(0x7f359c0b1a40 legacy=0x7f359c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.871+0000 7f35a2bec640 1 -- 172.21.15.44:0/3333046137 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c0cc4e0 con 0x7f359c06a830 2023-11-04T01:37:29.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.872+0000 7f35a2bec640 1 --2- 172.21.15.44:0/3333046137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f359c06a830 0x7f359c0cf9f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f359c072900 tx=0x7f359402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb282ee3a99f072 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.872+0000 7f35a13e9640 1 -- 172.21.15.44:0/3333046137 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359402c960 con 0x7f359c06a830 2023-11-04T01:37:29.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.872+0000 7f35a13e9640 1 -- 172.21.15.44:0/3333046137 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359402cac0 con 0x7f359c06a830 2023-11-04T01:37:29.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.872+0000 7f35a13e9640 1 -- 172.21.15.44:0/3333046137 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359402ce50 con 0x7f359c06a830 2023-11-04T01:37:29.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.873+0000 7f35a464f640 1 -- 172.21.15.44:0/3333046137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f359c06a830 msgr2=0x7f359c0cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.873+0000 7f35a464f640 1 --2- 172.21.15.44:0/3333046137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f359c06a830 0x7f359c0cf9f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f359c072900 tx=0x7f359402bdc0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.873+0000 7f35a464f640 1 -- 172.21.15.44:0/3333046137 shutdown_connections 2023-11-04T01:37:29.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.873+0000 7f35a464f640 1 --2- 172.21.15.44:0/3333046137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f359c06a830 0x7f359c0cf9f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.873+0000 7f35a464f640 1 --2- 172.21.15.44:0/3333046137 >> v2:172.21.15.204:3300/0 conn(0x7f359c1605b0 0x7f359c0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.873+0000 7f35a464f640 1 -- 172.21.15.44:0/3333046137 >> 172.21.15.44:0/3333046137 conn(0x7f359c071820 msgr2=0x7f359c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.873+0000 7f35a464f640 1 -- 172.21.15.44:0/3333046137 shutdown_connections 2023-11-04T01:37:29.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.873+0000 7f35a464f640 1 -- 172.21.15.44:0/3333046137 wait complete. 2023-11-04T01:37:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.874+0000 7f35a464f640 1 Processor -- start 2023-11-04T01:37:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.874+0000 7f35a464f640 1 -- start start 2023-11-04T01:37:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f35a464f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f359c06a830 0x7f359c148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f35a464f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f359c1605b0 0x7f359c0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f35a464f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f359c0b2670 0x7f359c1479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f35a464f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0b4200 con 0x7f359c0b2670 2023-11-04T01:37:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f35a464f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0b30c0 con 0x7f359c06a830 2023-11-04T01:37:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f35a464f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0c4ce0 con 0x7f359c1605b0 2023-11-04T01:37:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f35a2bec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f359c0b2670 0x7f359c1479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f35a2bec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f359c0b2670 0x7f359c1479d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41652/0 (socket says 172.21.15.44:41652) 2023-11-04T01:37:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f35a2bec640 1 -- 172.21.15.44:0/2101292967 learned_addr learned my addr 172.21.15.44:0/2101292967 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f35a2bec640 1 -- 172.21.15.44:0/2101292967 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f359c1605b0 msgr2=0x7f359c0adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f35a2bec640 1 --2- 172.21.15.44:0/2101292967 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f359c1605b0 0x7f359c0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f35a2bec640 1 -- 172.21.15.44:0/2101292967 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f359c06a830 msgr2=0x7f359c148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f35a2bec640 1 --2- 172.21.15.44:0/2101292967 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f359c06a830 0x7f359c148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f35a2bec640 1 -- 172.21.15.44:0/2101292967 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594009b30 con 0x7f359c0b2670 2023-11-04T01:37:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f35a2bec640 1 --2- 172.21.15.44:0/2101292967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f359c0b2670 0x7f359c1479d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3594036040 tx=0x7f3594004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.875+0000 7f3592ffd640 1 -- 172.21.15.44:0/2101292967 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594009510 con 0x7f359c0b2670 2023-11-04T01:37:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.876+0000 7f3592ffd640 1 -- 172.21.15.44:0/2101292967 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359403e450 con 0x7f359c0b2670 2023-11-04T01:37:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.876+0000 7f35a464f640 1 -- 172.21.15.44:0/2101292967 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c0c4fc0 con 0x7f359c0b2670 2023-11-04T01:37:29.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.876+0000 7f3592ffd640 1 -- 172.21.15.44:0/2101292967 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359403e800 con 0x7f359c0b2670 2023-11-04T01:37:29.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.876+0000 7f35a464f640 1 -- 172.21.15.44:0/2101292967 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c15be30 con 0x7f359c0b2670 2023-11-04T01:37:29.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.877+0000 7f35a464f640 1 -- 172.21.15.44:0/2101292967 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c0672a0 con 0x7f359c0b2670 2023-11-04T01:37:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.877+0000 7f3592ffd640 1 -- 172.21.15.44:0/2101292967 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f359403e960 con 0x7f359c0b2670 2023-11-04T01:37:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.877+0000 7f3592ffd640 1 --2- 172.21.15.44:0/2101292967 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f358006ae70 0x7f358006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.878+0000 7f3592ffd640 1 -- 172.21.15.44:0/2101292967 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f35940ac610 con 0x7f359c0b2670 2023-11-04T01:37:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.878+0000 7f35a23eb640 1 --2- 172.21.15.44:0/2101292967 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f358006ae70 0x7f358006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.878+0000 7f35a23eb640 1 --2- 172.21.15.44:0/2101292967 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f358006ae70 0x7f358006d330 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f359c0c9fd0 tx=0x7f3598008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:29.882+0000 7f3592ffd640 1 -- 172.21.15.44:0/2101292967 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3594077630 con 0x7f359c0b2670 2023-11-04T01:37:30.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.124+0000 7f35a464f640 1 -- 172.21.15.44:0/2101292967 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f359c0c4b40 con 0x7f359c0b2670 2023-11-04T01:37:30.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.126+0000 7f3592ffd640 1 -- 172.21.15.44:0/2101292967 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f359c0c4b40 con 0x7f359c0b2670 2023-11-04T01:37:30.129 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2023-11-04T01:37:30.129 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDEn0VlmqcrLRAAFCsu/sJUUh45gPboIgq6Dw== 2023-11-04T01:37:30.129 INFO:teuthology.orchestra.run.smithi044.stdout: caps mds = "allow" 2023-11-04T01:37:30.129 INFO:teuthology.orchestra.run.smithi044.stdout: caps mon = "allow r" 2023-11-04T01:37:30.129 INFO:teuthology.orchestra.run.smithi044.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:37:30.130 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2023-11-04T01:37:30.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.128+0000 7f35a464f640 1 -- 172.21.15.44:0/2101292967 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f358006ae70 msgr2=0x7f358006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.128+0000 7f35a464f640 1 --2- 172.21.15.44:0/2101292967 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f358006ae70 0x7f358006d330 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f359c0c9fd0 tx=0x7f3598008040 comp rx=0 tx=0).stop 2023-11-04T01:37:30.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.128+0000 7f35a464f640 1 -- 172.21.15.44:0/2101292967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f359c0b2670 msgr2=0x7f359c1479d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.128+0000 7f35a464f640 1 --2- 172.21.15.44:0/2101292967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f359c0b2670 0x7f359c1479d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3594036040 tx=0x7f3594004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:30.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.128+0000 7f35a464f640 1 -- 172.21.15.44:0/2101292967 shutdown_connections 2023-11-04T01:37:30.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.128+0000 7f35a464f640 1 --2- 172.21.15.44:0/2101292967 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f358006ae70 0x7f358006d330 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.128+0000 7f35a464f640 1 --2- 172.21.15.44:0/2101292967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f359c0b2670 0x7f359c1479d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.128+0000 7f35a464f640 1 --2- 172.21.15.44:0/2101292967 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f359c1605b0 0x7f359c0adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.128+0000 7f35a464f640 1 --2- 172.21.15.44:0/2101292967 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f359c06a830 0x7f359c148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.128+0000 7f35a464f640 1 -- 172.21.15.44:0/2101292967 >> 172.21.15.44:0/2101292967 conn(0x7f359c071820 msgr2=0x7f359c15f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.129+0000 7f35a464f640 1 -- 172.21.15.44:0/2101292967 shutdown_connections 2023-11-04T01:37:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.129+0000 7f35a464f640 1 -- 172.21.15.44:0/2101292967 wait complete. 2023-11-04T01:37:30.141 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:30.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.246+0000 7f57ce087640 1 Processor -- start 2023-11-04T01:37:30.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.246+0000 7f57ce087640 1 -- start start 2023-11-04T01:37:30.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.247+0000 7f57ce087640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f57c8159c70 0x7f57c80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.247+0000 7f57ce087640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57c806db20 0x7f57c80b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.247+0000 7f57ce087640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c80b4110 con 0x7f57c80b0910 2023-11-04T01:37:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.247+0000 7f57ce087640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c80b49b0 con 0x7f57c8159c70 2023-11-04T01:37:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.247+0000 7f57ce087640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80b0da0 con 0x7f57c806db20 2023-11-04T01:37:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.247+0000 7f57c7fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f57c80b0910 0x7f57c815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35218/0 (socket says 172.21.15.44:35218) 2023-11-04T01:37:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.247+0000 7f57c7fff640 1 -- 172.21.15.44:0/2328410807 learned_addr learned my addr 172.21.15.44:0/2328410807 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.247+0000 7f57c77fe640 1 --2- 172.21.15.44:0/2328410807 >> v2:172.21.15.204:3300/0 conn(0x7f57c8159c70 0x7f57c80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.247+0000 7f57c6ffd640 1 --2- 172.21.15.44:0/2328410807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57c806db20 0x7f57c80b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.247+0000 7f57c67fc640 1 -- 172.21.15.44:0/2328410807 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181245679 0 0) 0x7f57c80b4110 con 0x7f57c80b0910 2023-11-04T01:37:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.247+0000 7f57c67fc640 1 -- 172.21.15.44:0/2328410807 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57b0003520 con 0x7f57c80b0910 2023-11-04T01:37:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.247+0000 7f57c77fe640 1 -- 172.21.15.44:0/2328410807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57c806db20 msgr2=0x7f57c80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.247+0000 7f57c77fe640 1 --2- 172.21.15.44:0/2328410807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57c806db20 0x7f57c80b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.247+0000 7f57c77fe640 1 -- 172.21.15.44:0/2328410807 >> v1:172.21.15.44:6789/0 conn(0x7f57c80b0910 legacy=0x7f57c815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.247+0000 7f57c77fe640 1 -- 172.21.15.44:0/2328410807 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c80b43f0 con 0x7f57c8159c70 2023-11-04T01:37:30.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.248+0000 7f57c77fe640 1 --2- 172.21.15.44:0/2328410807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57c8159c70 0x7f57c80ce370 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f57b80097a0 tx=0x7f57b802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a50791c113c89b42 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:30.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.248+0000 7f57c67fc640 1 -- 172.21.15.44:0/2328410807 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8031830 con 0x7f57c8159c70 2023-11-04T01:37:30.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.248+0000 7f57c67fc640 1 -- 172.21.15.44:0/2328410807 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b8031990 con 0x7f57c8159c70 2023-11-04T01:37:30.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.249+0000 7f57c67fc640 1 -- 172.21.15.44:0/2328410807 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8031d00 con 0x7f57c8159c70 2023-11-04T01:37:30.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.249+0000 7f57ce087640 1 -- 172.21.15.44:0/2328410807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57c8159c70 msgr2=0x7f57c80ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.249+0000 7f57ce087640 1 --2- 172.21.15.44:0/2328410807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57c8159c70 0x7f57c80ce370 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f57b80097a0 tx=0x7f57b802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.249+0000 7f57ce087640 1 -- 172.21.15.44:0/2328410807 shutdown_connections 2023-11-04T01:37:30.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.249+0000 7f57ce087640 1 --2- 172.21.15.44:0/2328410807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57c806db20 0x7f57c80b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.249+0000 7f57ce087640 1 --2- 172.21.15.44:0/2328410807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57c8159c70 0x7f57c80ce370 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.249+0000 7f57ce087640 1 -- 172.21.15.44:0/2328410807 >> 172.21.15.44:0/2328410807 conn(0x7f57c80ce950 msgr2=0x7f57c80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:30.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.249+0000 7f57ce087640 1 -- 172.21.15.44:0/2328410807 shutdown_connections 2023-11-04T01:37:30.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.249+0000 7f57ce087640 1 -- 172.21.15.44:0/2328410807 wait complete. 2023-11-04T01:37:30.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.250+0000 7f57ce087640 1 Processor -- start 2023-11-04T01:37:30.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.250+0000 7f57ce087640 1 -- start start 2023-11-04T01:37:30.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.251+0000 7f57ce087640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57c806db20 0x7f57c80a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.251+0000 7f57ce087640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57c80b0910 0x7f57c81ef890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.251+0000 7f57ce087640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57c8159c70 0x7f57c815a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.251+0000 7f57ce087640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c8157ae0 con 0x7f57c806db20 2023-11-04T01:37:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.251+0000 7f57ce087640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80a7b60 con 0x7f57c8159c70 2023-11-04T01:37:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.251+0000 7f57ce087640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80a7e40 con 0x7f57c80b0910 2023-11-04T01:37:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.251+0000 7f57c77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57c806db20 0x7f57c80a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.251+0000 7f57c77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57c806db20 0x7f57c80a74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41666/0 (socket says 172.21.15.44:41666) 2023-11-04T01:37:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.251+0000 7f57c77fe640 1 -- 172.21.15.44:0/3252195808 learned_addr learned my addr 172.21.15.44:0/3252195808 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.252+0000 7f57c7fff640 1 --2- 172.21.15.44:0/3252195808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57c8159c70 0x7f57c815a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.252+0000 7f57c6ffd640 1 --2- 172.21.15.44:0/3252195808 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57c80b0910 0x7f57c81ef890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.252+0000 7f57c77fe640 1 -- 172.21.15.44:0/3252195808 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57c80b0910 msgr2=0x7f57c81ef890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.252+0000 7f57c77fe640 1 --2- 172.21.15.44:0/3252195808 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57c80b0910 0x7f57c81ef890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.252+0000 7f57c77fe640 1 -- 172.21.15.44:0/3252195808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57c8159c70 msgr2=0x7f57c815a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.252+0000 7f57c77fe640 1 --2- 172.21.15.44:0/3252195808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57c8159c70 0x7f57c815a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.252+0000 7f57c77fe640 1 -- 172.21.15.44:0/3252195808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b8009400 con 0x7f57c806db20 2023-11-04T01:37:30.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.252+0000 7f57c77fe640 1 --2- 172.21.15.44:0/3252195808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57c806db20 0x7f57c80a74d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f57b802b910 tx=0x7f57b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:30.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.252+0000 7f57affff640 1 -- 172.21.15.44:0/3252195808 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b803a830 con 0x7f57c806db20 2023-11-04T01:37:30.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.252+0000 7f57affff640 1 -- 172.21.15.44:0/3252195808 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b803a9b0 con 0x7f57c806db20 2023-11-04T01:37:30.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.252+0000 7f57ce087640 1 -- 172.21.15.44:0/3252195808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c80a8120 con 0x7f57c806db20 2023-11-04T01:37:30.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.252+0000 7f57affff640 1 -- 172.21.15.44:0/3252195808 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b803ad60 con 0x7f57c806db20 2023-11-04T01:37:30.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.252+0000 7f57ce087640 1 -- 172.21.15.44:0/3252195808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c81efdd0 con 0x7f57c806db20 2023-11-04T01:37:30.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.253+0000 7f57ce087640 1 -- 172.21.15.44:0/3252195808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c8074290 con 0x7f57c806db20 2023-11-04T01:37:30.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.254+0000 7f57affff640 1 -- 172.21.15.44:0/3252195808 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f57b804d450 con 0x7f57c806db20 2023-11-04T01:37:30.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.254+0000 7f57affff640 1 --2- 172.21.15.44:0/3252195808 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f57b406ae70 0x7f57b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.254+0000 7f57affff640 1 -- 172.21.15.44:0/3252195808 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f57b80ab730 con 0x7f57c806db20 2023-11-04T01:37:30.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.254+0000 7f57c6ffd640 1 --2- 172.21.15.44:0/3252195808 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f57b406ae70 0x7f57b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.255+0000 7f57c6ffd640 1 --2- 172.21.15.44:0/3252195808 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f57b406ae70 0x7f57b406d330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f57c81f35e0 tx=0x7f57bc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:30.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.258+0000 7f57affff640 1 -- 172.21.15.44:0/3252195808 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f57b8076730 con 0x7f57c806db20 2023-11-04T01:37:30.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.470+0000 7f57ce087640 1 -- 172.21.15.44:0/3252195808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57c806d3f0 con 0x7f57c806db20 2023-11-04T01:37:30.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.470+0000 7f57affff640 1 -- 172.21.15.44:0/3252195808 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f57b8079d50 con 0x7f57c806db20 2023-11-04T01:37:30.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:30.475 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5024,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/620952929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":620952929},{"type":"v1","addr":"172.21.15.44:6834","nonce":620952929}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2082760690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":2082760690},{"type":"v1","addr":"172.21.15.204:6836","nonce":2082760690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5323,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2330742876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2330742876},{"type":"v1","addr":"172.21.15.204:6837","nonce":2330742876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:21.307124+0000","modified":"2023-11-04T01:37:23.300604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5514":{"gid":5514,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/2457583329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2457583329},{"type":"v1","addr":"172.21.15.44:6835","nonce":2457583329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 15 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.472+0000 7f57ce087640 1 -- 172.21.15.44:0/3252195808 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f57b406ae70 msgr2=0x7f57b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.472+0000 7f57ce087640 1 --2- 172.21.15.44:0/3252195808 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f57b406ae70 0x7f57b406d330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f57c81f35e0 tx=0x7f57bc008040 comp rx=0 tx=0).stop 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.472+0000 7f57ce087640 1 -- 172.21.15.44:0/3252195808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57c806db20 msgr2=0x7f57c80a74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.472+0000 7f57ce087640 1 --2- 172.21.15.44:0/3252195808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57c806db20 0x7f57c80a74d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f57b802b910 tx=0x7f57b80046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.472+0000 7f57ce087640 1 -- 172.21.15.44:0/3252195808 shutdown_connections 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.472+0000 7f57ce087640 1 --2- 172.21.15.44:0/3252195808 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f57b406ae70 0x7f57b406d330 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.472+0000 7f57ce087640 1 --2- 172.21.15.44:0/3252195808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57c8159c70 0x7f57c815a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.472+0000 7f57ce087640 1 --2- 172.21.15.44:0/3252195808 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57c80b0910 0x7f57c81ef890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.472+0000 7f57ce087640 1 --2- 172.21.15.44:0/3252195808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57c806db20 0x7f57c80a74d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.472+0000 7f57ce087640 1 -- 172.21.15.44:0/3252195808 >> 172.21.15.44:0/3252195808 conn(0x7f57c80ce950 msgr2=0x7f57c80b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:30.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.472+0000 7f57ce087640 1 -- 172.21.15.44:0/3252195808 shutdown_connections 2023-11-04T01:37:30.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.472+0000 7f57ce087640 1 -- 172.21.15.44:0/3252195808 wait complete. 2023-11-04T01:37:30.888 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:37:21.307124+0000', 'modified': '2023-11-04T01:37:23.300604+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5514}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5514': {'gid': 5514, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/2457583329', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 2457583329}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 2457583329}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:37:30.888 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:37:30.888 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:37:31.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.997+0000 7f8101e44640 1 Processor -- start 2023-11-04T01:37:31.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.997+0000 7f8101e44640 1 -- start start 2023-11-04T01:37:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.998+0000 7f8101e44640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f80fc070e20 0x7f80fc0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.998+0000 7f8101e44640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80fc0ad730 0x7f80fc15e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.998+0000 7f8101e44640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80fc0c3900 con 0x7f80fc15ad30 2023-11-04T01:37:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.998+0000 7f8101e44640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80fc0ae260 con 0x7f80fc070e20 2023-11-04T01:37:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.998+0000 7f8101e44640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc0c3be0 con 0x7f80fc0ad730 2023-11-04T01:37:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.998+0000 7f80fb7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f80fc15ad30 0x7f80fc070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35222/0 (socket says 172.21.15.44:35222) 2023-11-04T01:37:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.998+0000 7f80fb7fe640 1 -- 172.21.15.44:0/2810967412 learned_addr learned my addr 172.21.15.44:0/2810967412 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.998+0000 7f80faffd640 1 --2- 172.21.15.44:0/2810967412 >> v2:172.21.15.204:3300/0 conn(0x7f80fc070e20 0x7f80fc0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.998+0000 7f80fbfff640 1 --2- 172.21.15.44:0/2810967412 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80fc0ad730 0x7f80fc15e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.998+0000 7f80fa7fc640 1 -- 172.21.15.44:0/2810967412 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496495302 0 0) 0x7f80fc0c3900 con 0x7f80fc15ad30 2023-11-04T01:37:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.998+0000 7f80fa7fc640 1 -- 172.21.15.44:0/2810967412 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80e4003520 con 0x7f80fc15ad30 2023-11-04T01:37:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.998+0000 7f80faffd640 1 -- 172.21.15.44:0/2810967412 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80fc0ad730 msgr2=0x7f80fc15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.998+0000 7f80faffd640 1 --2- 172.21.15.44:0/2810967412 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80fc0ad730 0x7f80fc15e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.998+0000 7f80faffd640 1 -- 172.21.15.44:0/2810967412 >> v1:172.21.15.44:6789/0 conn(0x7f80fc15ad30 legacy=0x7f80fc070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.998+0000 7f80faffd640 1 -- 172.21.15.44:0/2810967412 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc0c3ec0 con 0x7f80fc070e20 2023-11-04T01:37:31.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.999+0000 7f80faffd640 1 --2- 172.21.15.44:0/2810967412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80fc070e20 0x7f80fc0adc80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0097a0 tx=0x7f80ec02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b79d18aef70d791e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.999+0000 7f80fa7fc640 1 -- 172.21.15.44:0/2810967412 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec031780 con 0x7f80fc070e20 2023-11-04T01:37:31.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.999+0000 7f80fa7fc640 1 -- 172.21.15.44:0/2810967412 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec0318e0 con 0x7f80fc070e20 2023-11-04T01:37:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:30.999+0000 7f80fa7fc640 1 -- 172.21.15.44:0/2810967412 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec031c70 con 0x7f80fc070e20 2023-11-04T01:37:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.000+0000 7f8101e44640 1 -- 172.21.15.44:0/2810967412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80fc070e20 msgr2=0x7f80fc0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.000+0000 7f8101e44640 1 --2- 172.21.15.44:0/2810967412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80fc070e20 0x7f80fc0adc80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0097a0 tx=0x7f80ec02b820 comp rx=0 tx=0).stop 2023-11-04T01:37:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.000+0000 7f8101e44640 1 -- 172.21.15.44:0/2810967412 shutdown_connections 2023-11-04T01:37:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.000+0000 7f8101e44640 1 --2- 172.21.15.44:0/2810967412 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80fc0ad730 0x7f80fc15e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.000+0000 7f8101e44640 1 --2- 172.21.15.44:0/2810967412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80fc070e20 0x7f80fc0adc80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.000+0000 7f8101e44640 1 -- 172.21.15.44:0/2810967412 >> 172.21.15.44:0/2810967412 conn(0x7f80fc0ce950 msgr2=0x7f80fc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.000+0000 7f8101e44640 1 -- 172.21.15.44:0/2810967412 shutdown_connections 2023-11-04T01:37:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.000+0000 7f8101e44640 1 -- 172.21.15.44:0/2810967412 wait complete. 2023-11-04T01:37:31.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.001+0000 7f8101e44640 1 Processor -- start 2023-11-04T01:37:31.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.001+0000 7f8101e44640 1 -- start start 2023-11-04T01:37:31.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f8101e44640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80fc070e20 0x7f80fc159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f8101e44640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80fc0ad730 0x7f80fc0cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f8101e44640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80fc15ad30 0x7f80fc143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f8101e44640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc1591d0 con 0x7f80fc0ad730 2023-11-04T01:37:31.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f8101e44640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc0ccb80 con 0x7f80fc15ad30 2023-11-04T01:37:31.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f8101e44640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc0cc5c0 con 0x7f80fc070e20 2023-11-04T01:37:31.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f80faffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80fc0ad730 0x7f80fc0cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f80faffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80fc0ad730 0x7f80fc0cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41682/0 (socket says 172.21.15.44:41682) 2023-11-04T01:37:31.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f80faffd640 1 -- 172.21.15.44:0/1529738867 learned_addr learned my addr 172.21.15.44:0/1529738867 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:31.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f80fb7fe640 1 --2- 172.21.15.44:0/1529738867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80fc070e20 0x7f80fc159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f80fbfff640 1 --2- 172.21.15.44:0/1529738867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80fc15ad30 0x7f80fc143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f80faffd640 1 -- 172.21.15.44:0/1529738867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80fc070e20 msgr2=0x7f80fc159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f80faffd640 1 --2- 172.21.15.44:0/1529738867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80fc070e20 0x7f80fc159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f80faffd640 1 -- 172.21.15.44:0/1529738867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80fc15ad30 msgr2=0x7f80fc143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f80faffd640 1 --2- 172.21.15.44:0/1529738867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80fc15ad30 0x7f80fc143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.002+0000 7f80faffd640 1 -- 172.21.15.44:0/1529738867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec009400 con 0x7f80fc0ad730 2023-11-04T01:37:31.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.003+0000 7f80faffd640 1 --2- 172.21.15.44:0/1529738867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80fc0ad730 0x7f80fc0cd0b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f80ec034040 tx=0x7f80ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.003+0000 7f80e3fff640 1 -- 172.21.15.44:0/1529738867 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec032820 con 0x7f80fc0ad730 2023-11-04T01:37:31.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.003+0000 7f80e3fff640 1 -- 172.21.15.44:0/1529738867 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec032980 con 0x7f80fc0ad730 2023-11-04T01:37:31.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.003+0000 7f8101e44640 1 -- 172.21.15.44:0/1529738867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80fc0cc8a0 con 0x7f80fc0ad730 2023-11-04T01:37:31.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.003+0000 7f80e3fff640 1 -- 172.21.15.44:0/1529738867 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec032d30 con 0x7f80fc0ad730 2023-11-04T01:37:31.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.003+0000 7f8101e44640 1 -- 172.21.15.44:0/1529738867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80fc159ba0 con 0x7f80fc0ad730 2023-11-04T01:37:31.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.005+0000 7f80e3fff640 1 -- 172.21.15.44:0/1529738867 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f80ec04e440 con 0x7f80fc0ad730 2023-11-04T01:37:31.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.005+0000 7f80e3fff640 1 --2- 172.21.15.44:0/1529738867 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f80e806ae70 0x7f80e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.005+0000 7f80e3fff640 1 -- 172.21.15.44:0/1529738867 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f80ec0ab730 con 0x7f80fc0ad730 2023-11-04T01:37:31.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.005+0000 7f80fb7fe640 1 --2- 172.21.15.44:0/1529738867 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f80e806ae70 0x7f80e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.006+0000 7f80fb7fe640 1 --2- 172.21.15.44:0/1529738867 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f80e806ae70 0x7f80e806d330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f80f00011e0 tx=0x7f80f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.006+0000 7f81049d3740 1 Processor -- start 2023-11-04T01:37:31.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.006+0000 7f81049d3740 1 -- start start 2023-11-04T01:37:31.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f81049d3740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721ae0850 0x55f721ab3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f81049d3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0c30 0x55f721ae35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f81049d3740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ab3c90 0x55f721ae3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f81049d3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7219c4740 con 0x55f721ae0c30 2023-11-04T01:37:31.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f81049d3740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f721a268d0 con 0x55f721ab3c90 2023-11-04T01:37:31.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f81049d3740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f721a23fc0 con 0x55f721ae0850 2023-11-04T01:37:31.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f80faffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0c30 0x55f721ae35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f80faffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0c30 0x55f721ae35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41690/0 (socket says 172.21.15.44:41690) 2023-11-04T01:37:31.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f80faffd640 1 -- 172.21.15.44:0/1453925036 learned_addr learned my addr 172.21.15.44:0/1453925036 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:31.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f80fb7fe640 1 --2- 172.21.15.44:0/1453925036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721ae0850 0x55f721ab3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f80fbfff640 1 --2- 172.21.15.44:0/1453925036 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ab3c90 0x55f721ae3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f80faffd640 1 -- 172.21.15.44:0/1453925036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721ae0850 msgr2=0x55f721ab3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f80faffd640 1 --2- 172.21.15.44:0/1453925036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721ae0850 0x55f721ab3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f80faffd640 1 -- 172.21.15.44:0/1453925036 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ab3c90 msgr2=0x55f721ae3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f80faffd640 1 --2- 172.21.15.44:0/1453925036 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ab3c90 0x55f721ae3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f80faffd640 1 -- 172.21.15.44:0/1453925036 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7219e2ca0 con 0x55f721ae0c30 2023-11-04T01:37:31.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.007+0000 7f80faffd640 1 --2- 172.21.15.44:0/1453925036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0c30 0x55f721ae35e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0a9b20 tx=0x7f80ec07aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f649b8736ab63aa7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.008+0000 7f80e17fa640 1 -- 172.21.15.44:0/1453925036 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec07e4c0 con 0x55f721ae0c30 2023-11-04T01:37:31.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.008+0000 7f80e17fa640 1 -- 172.21.15.44:0/1453925036 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec091e90 con 0x55f721ae0c30 2023-11-04T01:37:31.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.008+0000 7f80e17fa640 1 -- 172.21.15.44:0/1453925036 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec082670 con 0x55f721ae0c30 2023-11-04T01:37:31.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.008+0000 7f81049d3740 1 -- 172.21.15.44:0/1453925036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0c30 msgr2=0x55f721ae35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.008+0000 7f81049d3740 1 --2- 172.21.15.44:0/1453925036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0c30 0x55f721ae35e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0a9b20 tx=0x7f80ec07aa70 comp rx=0 tx=0).stop 2023-11-04T01:37:31.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.008+0000 7f81049d3740 1 -- 172.21.15.44:0/1453925036 shutdown_connections 2023-11-04T01:37:31.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.008+0000 7f81049d3740 1 --2- 172.21.15.44:0/1453925036 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ab3c90 0x55f721ae3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.008+0000 7f81049d3740 1 --2- 172.21.15.44:0/1453925036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0c30 0x55f721ae35e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.008+0000 7f81049d3740 1 --2- 172.21.15.44:0/1453925036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721ae0850 0x55f721ab3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.008+0000 7f81049d3740 1 -- 172.21.15.44:0/1453925036 >> 172.21.15.44:0/1453925036 conn(0x55f721ab5a60 msgr2=0x55f721afe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.008+0000 7f81049d3740 1 -- 172.21.15.44:0/1453925036 shutdown_connections 2023-11-04T01:37:31.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.008+0000 7f81049d3740 1 -- 172.21.15.44:0/1453925036 wait complete. 2023-11-04T01:37:31.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.009+0000 7f81049d3740 1 -- start start 2023-11-04T01:37:31.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.009+0000 7f81049d3740 1 Processor -- start 2023-11-04T01:37:31.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f81049d3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0850 0x55f721b0e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f81049d3740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ae0c30 0x55f721af87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f81049d3740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721af8ce0 0x55f721b10f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f81049d3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f721a1f8b0 con 0x55f721ae0850 2023-11-04T01:37:31.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f81049d3740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7219d9c80 con 0x55f721ae0c30 2023-11-04T01:37:31.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f81049d3740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f7219d9920 con 0x55f721af8ce0 2023-11-04T01:37:31.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f81049d3740 10 client.0 _ll_register_callbacks cb 0x55f721731ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:37:31.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f80fb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0850 0x55f721b0e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f80fb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0850 0x55f721b0e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41698/0 (socket says 172.21.15.44:41698) 2023-11-04T01:37:31.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f80fb7fe640 1 -- 172.21.15.44:0/1542219818 learned_addr learned my addr 172.21.15.44:0/1542219818 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:31.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f80fbfff640 1 --2- 172.21.15.44:0/1542219818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721af8ce0 0x55f721b10f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f80faffd640 1 --2- 172.21.15.44:0/1542219818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ae0c30 0x55f721af87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f80fb7fe640 1 -- 172.21.15.44:0/1542219818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721af8ce0 msgr2=0x55f721b10f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f80fb7fe640 1 --2- 172.21.15.44:0/1542219818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721af8ce0 0x55f721b10f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f80fb7fe640 1 -- 172.21.15.44:0/1542219818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ae0c30 msgr2=0x55f721af87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f80fb7fe640 1 --2- 172.21.15.44:0/1542219818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ae0c30 0x55f721af87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f80fb7fe640 1 -- 172.21.15.44:0/1542219818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80fc159ba0 con 0x55f721ae0850 2023-11-04T01:37:31.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f80fb7fe640 1 --2- 172.21.15.44:0/1542219818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0850 0x55f721b0e540 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f80f0005e80 tx=0x7f80f0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89998d15d9972166 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f80da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:37:31.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f80da7fc640 1 -- 172.21.15.44:0/1542219818 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0007560 con 0x55f721ae0850 2023-11-04T01:37:31.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.010+0000 7f80da7fc640 1 -- 172.21.15.44:0/1542219818 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f80f00076c0 con 0x55f721ae0850 2023-11-04T01:37:31.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.011+0000 7f81049d3740 1 -- 172.21.15.44:0/1542219818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7219cbbf0 con 0x55f721ae0850 2023-11-04T01:37:31.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.011+0000 7f80da7fc640 1 -- 172.21.15.44:0/1542219818 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80f0013420 con 0x55f721ae0850 2023-11-04T01:37:31.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.011+0000 7f81049d3740 10 client.5706 fetch_fsmap learned FSMap version 15 2023-11-04T01:37:31.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.011+0000 7f81049d3740 1 -- 172.21.15.44:0/1542219818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55f721a1df30 con 0x55f721ae0850 2023-11-04T01:37:31.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.011+0000 7f80da7fc640 1 -- 172.21.15.44:0/1542219818 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f7219cbbf0 con 0x55f721ae0850 2023-11-04T01:37:31.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.011+0000 7f80da7fc640 1 -- 172.21.15.44:0/1542219818 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f80f0013580 con 0x55f721ae0850 2023-11-04T01:37:31.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.011+0000 7f81049d3740 10 client.5706 fetch_fsmap finished waiting for FSMap version 15 2023-11-04T01:37:31.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.011+0000 7f81049d3740 10 client.5706 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:37:31.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.011+0000 7f81049d3740 20 client.5706 populate_metadata read hostname 'smithi044' 2023-11-04T01:37:31.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.011+0000 7f81049d3740 1 --2- 172.21.15.44:0/1542219818 >> [v2:172.21.15.44:6833/2457583329,v1:172.21.15.44:6835/2457583329] conn(0x55f721af73a0 0x55f721b1be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.011+0000 7f81049d3740 4 client.5706 mds_command: new command op to 5514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:37:31.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.011+0000 7f81049d3740 1 -- 172.21.15.44:0/1542219818 --> [v2:172.21.15.44:6833/2457583329,v1:172.21.15.44:6835/2457583329] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f721a18890 con 0x55f721af73a0 2023-11-04T01:37:31.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.011+0000 7f80faffd640 1 --2- 172.21.15.44:0/1542219818 >> [v2:172.21.15.44:6833/2457583329,v1:172.21.15.44:6835/2457583329] conn(0x55f721af73a0 0x55f721b1be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.011+0000 7f80da7fc640 10 client.5706 ms_handle_connect on v2:172.21.15.44:6833/2457583329 2023-11-04T01:37:31.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.011+0000 7f80faffd640 1 --2- 172.21.15.44:0/1542219818 >> [v2:172.21.15.44:6833/2457583329,v1:172.21.15.44:6835/2457583329] conn(0x55f721af73a0 0x55f721b1be70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c61084183461d297 server_cookie=5eba6ce4c79e10f6 in_seq=0 out_seq=0 2023-11-04T01:37:31.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.012+0000 7f80da7fc640 1 -- 172.21.15.44:0/1542219818 <== mds.0 v2:172.21.15.44:6833/2457583329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f721a18890 con 0x55f721af73a0 2023-11-04T01:37:31.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.012+0000 7f80da7fc640 10 client.5706 handle_command_reply: tid=0 2023-11-04T01:37:31.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.012+0000 7f81049d3740 1 client.5706 shutdown 2023-11-04T01:37:31.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.012+0000 7f81049d3740 1 -- 172.21.15.44:0/1542219818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0850 msgr2=0x55f721b0e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.012+0000 7f81049d3740 1 --2- 172.21.15.44:0/1542219818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0850 0x55f721b0e540 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f80f0005e80 tx=0x7f80f0000ed0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.012+0000 7f81049d3740 1 -- 172.21.15.44:0/1542219818 shutdown_connections 2023-11-04T01:37:31.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.012+0000 7f81049d3740 1 --2- 172.21.15.44:0/1542219818 >> [v2:172.21.15.44:6833/2457583329,v1:172.21.15.44:6835/2457583329] conn(0x55f721af73a0 0x55f721b1be70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.012+0000 7f81049d3740 1 --2- 172.21.15.44:0/1542219818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721af8ce0 0x55f721b10f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.012+0000 7f81049d3740 1 --2- 172.21.15.44:0/1542219818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ae0c30 0x55f721af87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.012+0000 7f81049d3740 1 --2- 172.21.15.44:0/1542219818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0850 0x55f721b0e540 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.012+0000 7f80da7fc640 0 client.5706 ms_handle_reset on v2:172.21.15.44:6833/2457583329 2023-11-04T01:37:31.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.012+0000 7f81049d3740 1 -- 172.21.15.44:0/1542219818 >> 172.21.15.44:0/1542219818 conn(0x55f721ab3c90 msgr2=0x55f721b02480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.012+0000 7f81049d3740 1 -- 172.21.15.44:0/1542219818 shutdown_connections 2023-11-04T01:37:31.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.012+0000 7f81049d3740 1 -- 172.21.15.44:0/1542219818 wait complete. 2023-11-04T01:37:31.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.012+0000 7f81049d3740 20 client.5706 trim_cache size 0 max 16384 2023-11-04T01:37:31.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.028+0000 7f81049d3740 1 Processor -- start 2023-11-04T01:37:31.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.028+0000 7f81049d3740 1 -- start start 2023-11-04T01:37:31.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f81049d3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0850 0x55f721adf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f81049d3740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ae0c30 0x55f721af4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f81049d3740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721af8ce0 0x55f721af54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f81049d3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72199f280 con 0x55f721ae0850 2023-11-04T01:37:31.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f81049d3740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f721ae7380 con 0x55f721ae0c30 2023-11-04T01:37:31.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f81049d3740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f721ab56a0 con 0x55f721af8ce0 2023-11-04T01:37:31.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f80fb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0850 0x55f721adf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f80fb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0850 0x55f721adf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41714/0 (socket says 172.21.15.44:41714) 2023-11-04T01:37:31.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f80fb7fe640 1 -- 172.21.15.44:0/2217884825 learned_addr learned my addr 172.21.15.44:0/2217884825 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:31.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f80fb7fe640 1 -- 172.21.15.44:0/2217884825 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721af8ce0 msgr2=0x55f721af54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f80fb7fe640 1 --2- 172.21.15.44:0/2217884825 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721af8ce0 0x55f721af54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f80fb7fe640 1 -- 172.21.15.44:0/2217884825 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ae0c30 msgr2=0x55f721af4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f80fb7fe640 1 --2- 172.21.15.44:0/2217884825 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ae0c30 0x55f721af4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f80fb7fe640 1 -- 172.21.15.44:0/2217884825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7219bbd10 con 0x55f721ae0850 2023-11-04T01:37:31.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f80fb7fe640 1 --2- 172.21.15.44:0/2217884825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0850 0x55f721adf540 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f80f0000f50 tx=0x7f80f001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad47ac59c40436a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.029+0000 7f80e1ffb640 1 -- 172.21.15.44:0/2217884825 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f000eb80 con 0x55f721ae0850 2023-11-04T01:37:31.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.030+0000 7f80e1ffb640 1 -- 172.21.15.44:0/2217884825 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0013e00 con 0x55f721ae0850 2023-11-04T01:37:31.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.030+0000 7f80e1ffb640 1 -- 172.21.15.44:0/2217884825 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0013a40 con 0x55f721ae0850 2023-11-04T01:37:31.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.030+0000 7f81049d3740 1 -- 172.21.15.44:0/2217884825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0850 msgr2=0x55f721adf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.030+0000 7f81049d3740 1 --2- 172.21.15.44:0/2217884825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0850 0x55f721adf540 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f80f0000f50 tx=0x7f80f001f000 comp rx=0 tx=0).stop 2023-11-04T01:37:31.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.030+0000 7f81049d3740 1 -- 172.21.15.44:0/2217884825 shutdown_connections 2023-11-04T01:37:31.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.030+0000 7f81049d3740 1 --2- 172.21.15.44:0/2217884825 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721af8ce0 0x55f721af54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.030+0000 7f81049d3740 1 --2- 172.21.15.44:0/2217884825 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ae0c30 0x55f721af4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.030+0000 7f81049d3740 1 --2- 172.21.15.44:0/2217884825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721ae0850 0x55f721adf540 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.030+0000 7f81049d3740 1 -- 172.21.15.44:0/2217884825 >> 172.21.15.44:0/2217884825 conn(0x55f721ab3c90 msgr2=0x55f721ab7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.030+0000 7f81049d3740 1 -- 172.21.15.44:0/2217884825 shutdown_connections 2023-11-04T01:37:31.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.030+0000 7f81049d3740 1 -- 172.21.15.44:0/2217884825 wait complete. 2023-11-04T01:37:31.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.031+0000 7f81049d3740 1 -- start start 2023-11-04T01:37:31.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.031+0000 7f81049d3740 1 Processor -- start 2023-11-04T01:37:31.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.031+0000 7f81049d3740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ae0850 0x55f721ab24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.031+0000 7f81049d3740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721ae0c30 0x55f721ab2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.031+0000 7f81049d3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721af8ce0 0x55f721b6c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.031+0000 7f81049d3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f721afdeb0 con 0x55f721af8ce0 2023-11-04T01:37:31.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f81049d3740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f721ab7b20 con 0x55f721ae0850 2023-11-04T01:37:31.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f81049d3740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f721b0e760 con 0x55f721ae0c30 2023-11-04T01:37:31.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f81049d3740 10 client.0 _ll_register_callbacks cb 0x7f80ec032e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:37:31.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80fbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721af8ce0 0x55f721b6c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80fbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721af8ce0 0x55f721b6c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41730/0 (socket says 172.21.15.44:41730) 2023-11-04T01:37:31.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80fbfff640 1 -- 172.21.15.44:0/3117115590 learned_addr learned my addr 172.21.15.44:0/3117115590 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:31.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80fb7fe640 1 --2- 172.21.15.44:0/3117115590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ae0850 0x55f721ab24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80faffd640 1 --2- 172.21.15.44:0/3117115590 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721ae0c30 0x55f721ab2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80fbfff640 1 -- 172.21.15.44:0/3117115590 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721ae0c30 msgr2=0x55f721ab2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80fbfff640 1 --2- 172.21.15.44:0/3117115590 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721ae0c30 0x55f721ab2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80fbfff640 1 -- 172.21.15.44:0/3117115590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ae0850 msgr2=0x55f721ab24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80fbfff640 1 --2- 172.21.15.44:0/3117115590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ae0850 0x55f721ab24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80fbfff640 1 -- 172.21.15.44:0/3117115590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f721a1df30 con 0x55f721af8ce0 2023-11-04T01:37:31.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80fb7fe640 1 --2- 172.21.15.44:0/3117115590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ae0850 0x55f721ab24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:31.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80fbfff640 1 --2- 172.21.15.44:0/3117115590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721af8ce0 0x55f721b6c610 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f80f4007330 tx=0x7f80f40077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1105c100dd6da067 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:37:31.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80da7fc640 1 -- 172.21.15.44:0/3117115590 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f401d710 con 0x55f721af8ce0 2023-11-04T01:37:31.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80da7fc640 1 -- 172.21.15.44:0/3117115590 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f80f401d870 con 0x55f721af8ce0 2023-11-04T01:37:31.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f81049d3740 1 -- 172.21.15.44:0/3117115590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f721b016f0 con 0x55f721af8ce0 2023-11-04T01:37:31.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f80da7fc640 1 -- 172.21.15.44:0/3117115590 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80f401da30 con 0x55f721af8ce0 2023-11-04T01:37:31.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f81049d3740 10 client.5712 fetch_fsmap learned FSMap version 15 2023-11-04T01:37:31.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.032+0000 7f81049d3740 1 -- 172.21.15.44:0/3117115590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55f7219e1500 con 0x55f721af8ce0 2023-11-04T01:37:31.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f80da7fc640 1 -- 172.21.15.44:0/3117115590 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f721b016f0 con 0x55f721af8ce0 2023-11-04T01:37:31.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f80da7fc640 1 -- 172.21.15.44:0/3117115590 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f80f401a050 con 0x55f721af8ce0 2023-11-04T01:37:31.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f81049d3740 10 client.5712 fetch_fsmap finished waiting for FSMap version 15 2023-11-04T01:37:31.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f81049d3740 10 client.5712 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:37:31.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f81049d3740 20 client.5712 populate_metadata read hostname 'smithi044' 2023-11-04T01:37:31.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f81049d3740 1 --2- 172.21.15.44:0/3117115590 >> [v2:172.21.15.44:6833/2457583329,v1:172.21.15.44:6835/2457583329] conn(0x55f721b6cbc0 0x55f721b6cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f81049d3740 4 client.5712 mds_command: new command op to 5514 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:37:31.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f81049d3740 1 -- 172.21.15.44:0/3117115590 --> [v2:172.21.15.44:6833/2457583329,v1:172.21.15.44:6835/2457583329] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f80ec091e90 con 0x55f721b6cbc0 2023-11-04T01:37:31.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f80fb7fe640 1 --2- 172.21.15.44:0/3117115590 >> [v2:172.21.15.44:6833/2457583329,v1:172.21.15.44:6835/2457583329] conn(0x55f721b6cbc0 0x55f721b6cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f80da7fc640 10 client.5712 ms_handle_connect on v2:172.21.15.44:6833/2457583329 2023-11-04T01:37:31.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f80fb7fe640 1 --2- 172.21.15.44:0/3117115590 >> [v2:172.21.15.44:6833/2457583329,v1:172.21.15.44:6835/2457583329] conn(0x55f721b6cbc0 0x55f721b6cfa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e64b1ba180dd5f8b server_cookie=cde643e8d953400b in_seq=0 out_seq=0 2023-11-04T01:37:31.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f80da7fc640 1 -- 172.21.15.44:0/3117115590 <== mds.0 v2:172.21.15.44:6833/2457583329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f80ec091e90 con 0x55f721b6cbc0 2023-11-04T01:37:31.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f80da7fc640 10 client.5712 handle_command_reply: tid=0 2023-11-04T01:37:31.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f81049d3740 1 client.5712 shutdown 2023-11-04T01:37:31.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f81049d3740 1 -- 172.21.15.44:0/3117115590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721af8ce0 msgr2=0x55f721b6c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.033+0000 7f81049d3740 1 --2- 172.21.15.44:0/3117115590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721af8ce0 0x55f721b6c610 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f80f4007330 tx=0x7f80f40077f0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f81049d3740 1 -- 172.21.15.44:0/3117115590 shutdown_connections 2023-11-04T01:37:31.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f81049d3740 1 --2- 172.21.15.44:0/3117115590 >> [v2:172.21.15.44:6833/2457583329,v1:172.21.15.44:6835/2457583329] conn(0x55f721b6cbc0 0x55f721b6cfa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f81049d3740 1 --2- 172.21.15.44:0/3117115590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f721af8ce0 0x55f721b6c610 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f81049d3740 1 --2- 172.21.15.44:0/3117115590 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f721ae0c30 0x55f721ab2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f80da7fc640 0 client.5712 ms_handle_reset on v2:172.21.15.44:6833/2457583329 2023-11-04T01:37:31.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f81049d3740 1 --2- 172.21.15.44:0/3117115590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f721ae0850 0x55f721ab24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f81049d3740 1 -- 172.21.15.44:0/3117115590 >> 172.21.15.44:0/3117115590 conn(0x55f721ab3c90 msgr2=0x55f721af8480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f81049d3740 1 -- 172.21.15.44:0/3117115590 shutdown_connections 2023-11-04T01:37:31.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f81049d3740 1 -- 172.21.15.44:0/3117115590 wait complete. 2023-11-04T01:37:31.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f81049d3740 20 client.5712 trim_cache size 0 max 16384 2023-11-04T01:37:31.077 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:37:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:37:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2023-11-04T01:37:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 5514, 2023-11-04T01:37:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:37:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:37:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:37:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 9.0959862149999999, 2023-11-04T01:37:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 15, 2023-11-04T01:37:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 39, 2023-11-04T01:37:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 39, 2023-11-04T01:37:31.078 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 16.964576688000001 2023-11-04T01:37:31.078 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:37:31.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f8101e44640 1 -- 172.21.15.44:0/1529738867 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f80e806ae70 msgr2=0x7f80e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f8101e44640 1 --2- 172.21.15.44:0/1529738867 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f80e806ae70 0x7f80e806d330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f80f00011e0 tx=0x7f80f0009040 comp rx=0 tx=0).stop 2023-11-04T01:37:31.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f8101e44640 1 -- 172.21.15.44:0/1529738867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80fc0ad730 msgr2=0x7f80fc0cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f8101e44640 1 --2- 172.21.15.44:0/1529738867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80fc0ad730 0x7f80fc0cd0b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f80ec034040 tx=0x7f80ec0046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f8101e44640 1 -- 172.21.15.44:0/1529738867 shutdown_connections 2023-11-04T01:37:31.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f8101e44640 1 --2- 172.21.15.44:0/1529738867 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f80e806ae70 0x7f80e806d330 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f8101e44640 1 --2- 172.21.15.44:0/1529738867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80fc15ad30 0x7f80fc143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f8101e44640 1 --2- 172.21.15.44:0/1529738867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80fc0ad730 0x7f80fc0cd0b0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f8101e44640 1 --2- 172.21.15.44:0/1529738867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80fc070e20 0x7f80fc159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f8101e44640 1 -- 172.21.15.44:0/1529738867 >> 172.21.15.44:0/1529738867 conn(0x7f80fc0ce950 msgr2=0x7f80fc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f8101e44640 1 -- 172.21.15.44:0/1529738867 shutdown_connections 2023-11-04T01:37:31.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.034+0000 7f8101e44640 1 -- 172.21.15.44:0/1529738867 wait complete. 2023-11-04T01:37:31.080 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:37:31.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.184+0000 7f2e19790640 1 Processor -- start 2023-11-04T01:37:31.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.184+0000 7f2e19790640 1 -- start start 2023-11-04T01:37:31.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.185+0000 7f2e19790640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e1415ce60 0x7f2e1406b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.185+0000 7f2e19790640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e141615d0 con 0x7f2e140cf160 2023-11-04T01:37:31.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.185+0000 7f2e19790640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e141618b0 con 0x7f2e1406bd30 2023-11-04T01:37:31.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.185+0000 7f2e19790640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140cbde0 con 0x7f2e1415ce60 2023-11-04T01:37:31.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.185+0000 7f2e137fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2e140cf160 0x7f2e140cc200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35232/0 (socket says 172.21.15.44:35232) 2023-11-04T01:37:31.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.185+0000 7f2e137fe640 1 -- 172.21.15.44:0/2064143935 learned_addr learned my addr 172.21.15.44:0/2064143935 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:31.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.185+0000 7f2e12ffd640 1 --2- 172.21.15.44:0/2064143935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e1415ce60 0x7f2e1406b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.185+0000 7f2e127fc640 1 -- 172.21.15.44:0/2064143935 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601986220 0 0) 0x7f2e141615d0 con 0x7f2e140cf160 2023-11-04T01:37:31.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.185+0000 7f2e127fc640 1 -- 172.21.15.44:0/2064143935 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e00003520 con 0x7f2e140cf160 2023-11-04T01:37:31.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e127fc640 1 -- 172.21.15.44:0/2064143935 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 73132001 0 0) 0x7f2e00003520 con 0x7f2e140cf160 2023-11-04T01:37:31.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e127fc640 1 -- 172.21.15.44:0/2064143935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e1415ce60 msgr2=0x7f2e1406b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e127fc640 1 --2- 172.21.15.44:0/2064143935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e1415ce60 0x7f2e1406b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e127fc640 1 -- 172.21.15.44:0/2064143935 >> v1:172.21.15.204:6789/0 conn(0x7f2e1406bd30 legacy=0x7f2e14160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e127fc640 1 -- 172.21.15.44:0/2064143935 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140cba00 con 0x7f2e140cf160 2023-11-04T01:37:31.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e127fc640 1 -- 172.21.15.44:0/2064143935 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f2e0c0019f0 con 0x7f2e140cf160 2023-11-04T01:37:31.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e127fc640 1 -- 172.21.15.44:0/2064143935 >> v1:172.21.15.44:6789/0 conn(0x7f2e140cf160 legacy=0x7f2e140cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e127fc640 1 --2- 172.21.15.44:0/2064143935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e1415ce60 0x7f2e000039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e127fc640 1 --2- 172.21.15.44:0/2064143935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e00003ee0 0x7f2e000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e127fc640 1 --2- 172.21.15.44:0/2064143935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e00004d00 0x7f2e00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e127fc640 1 -- 172.21.15.44:0/2064143935 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140cbde0 con 0x7f2e00003ee0 2023-11-04T01:37:31.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e127fc640 1 -- 172.21.15.44:0/2064143935 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0000b9e0 con 0x7f2e00004d00 2023-11-04T01:37:31.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e127fc640 1 -- 172.21.15.44:0/2064143935 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0000bba0 con 0x7f2e1415ce60 2023-11-04T01:37:31.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e0bfff640 1 --2- 172.21.15.44:0/2064143935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e00003ee0 0x7f2e000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e12ffd640 1 --2- 172.21.15.44:0/2064143935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e1415ce60 0x7f2e000039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e137fe640 1 --2- 172.21.15.44:0/2064143935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e00004d00 0x7f2e00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e0bfff640 1 -- 172.21.15.44:0/2064143935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e1415ce60 msgr2=0x7f2e000039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e0bfff640 1 --2- 172.21.15.44:0/2064143935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e1415ce60 0x7f2e000039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e0bfff640 1 -- 172.21.15.44:0/2064143935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e00004d00 msgr2=0x7f2e00005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e0bfff640 1 --2- 172.21.15.44:0/2064143935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e00004d00 0x7f2e00005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e0bfff640 1 -- 172.21.15.44:0/2064143935 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e00003520 con 0x7f2e00003ee0 2023-11-04T01:37:31.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.186+0000 7f2e137fe640 1 --2- 172.21.15.44:0/2064143935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e00004d00 0x7f2e00005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:31.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.187+0000 7f2e0bfff640 1 --2- 172.21.15.44:0/2064143935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e00003ee0 0x7f2e000047c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc001910 tx=0x7f2e000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de852508f473c457 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.187+0000 7f2e127fc640 1 -- 172.21.15.44:0/2064143935 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc032600 con 0x7f2e00003ee0 2023-11-04T01:37:31.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.187+0000 7f2e127fc640 1 -- 172.21.15.44:0/2064143935 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc02e050 con 0x7f2e00003ee0 2023-11-04T01:37:31.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.187+0000 7f2e127fc640 1 -- 172.21.15.44:0/2064143935 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0329c0 con 0x7f2e00003ee0 2023-11-04T01:37:31.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.188+0000 7f2e19790640 1 -- 172.21.15.44:0/2064143935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e00003ee0 msgr2=0x7f2e000047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.188+0000 7f2e19790640 1 --2- 172.21.15.44:0/2064143935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e00003ee0 0x7f2e000047c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc001910 tx=0x7f2e000057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.188+0000 7f2e137fe640 1 -- 172.21.15.44:0/2064143935 reap_dead start 2023-11-04T01:37:31.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.188+0000 7f2e19790640 1 -- 172.21.15.44:0/2064143935 shutdown_connections 2023-11-04T01:37:31.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.188+0000 7f2e19790640 1 -- 172.21.15.44:0/2064143935 >> 172.21.15.44:0/2064143935 conn(0x7f2e1406ea90 msgr2=0x7f2e1406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.188+0000 7f2e19790640 1 -- 172.21.15.44:0/2064143935 shutdown_connections 2023-11-04T01:37:31.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.188+0000 7f2e19790640 1 -- 172.21.15.44:0/2064143935 wait complete. 2023-11-04T01:37:31.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.189+0000 7f2e19790640 1 Processor -- start 2023-11-04T01:37:31.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.189+0000 7f2e19790640 1 -- start start 2023-11-04T01:37:31.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e19790640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e00003ee0 0x7f2e140c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e19790640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e1414f2d0 0x7f2e140c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e19790640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e140b4c50 0x7f2e1415e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e19790640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140c83e0 con 0x7f2e140b4c50 2023-11-04T01:37:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e19790640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140c8d30 con 0x7f2e00003ee0 2023-11-04T01:37:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e19790640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140c81b0 con 0x7f2e1414f2d0 2023-11-04T01:37:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e137fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e140b4c50 0x7f2e1415e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e137fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e140b4c50 0x7f2e1415e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41740/0 (socket says 172.21.15.44:41740) 2023-11-04T01:37:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e137fe640 1 -- 172.21.15.44:0/885392202 learned_addr learned my addr 172.21.15.44:0/885392202 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e12ffd640 1 --2- 172.21.15.44:0/885392202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e00003ee0 0x7f2e140c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e0bfff640 1 --2- 172.21.15.44:0/885392202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e1414f2d0 0x7f2e140c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e137fe640 1 -- 172.21.15.44:0/885392202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e1414f2d0 msgr2=0x7f2e140c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e137fe640 1 --2- 172.21.15.44:0/885392202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e1414f2d0 0x7f2e140c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e137fe640 1 -- 172.21.15.44:0/885392202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e00003ee0 msgr2=0x7f2e140c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e137fe640 1 --2- 172.21.15.44:0/885392202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e00003ee0 0x7f2e140c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e137fe640 1 -- 172.21.15.44:0/885392202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140b3770 con 0x7f2e140b4c50 2023-11-04T01:37:31.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e12ffd640 1 --2- 172.21.15.44:0/885392202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e00003ee0 0x7f2e140c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:31.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e137fe640 1 --2- 172.21.15.44:0/885392202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e140b4c50 0x7f2e1415e290 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2e140cb1a0 tx=0x7f2e0c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e0b7fe640 1 -- 172.21.15.44:0/885392202 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c007ae0 con 0x7f2e140b4c50 2023-11-04T01:37:31.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e0b7fe640 1 -- 172.21.15.44:0/885392202 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c00ed70 con 0x7f2e140b4c50 2023-11-04T01:37:31.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e19790640 1 -- 172.21.15.44:0/885392202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e140ca3d0 con 0x7f2e140b4c50 2023-11-04T01:37:31.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.190+0000 7f2e0b7fe640 1 -- 172.21.15.44:0/885392202 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c00eee0 con 0x7f2e140b4c50 2023-11-04T01:37:31.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.191+0000 7f2e19790640 1 -- 172.21.15.44:0/885392202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e140ca990 con 0x7f2e140b4c50 2023-11-04T01:37:31.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.192+0000 7f2e19790640 1 -- 172.21.15.44:0/885392202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e140b3900 con 0x7f2e140b4c50 2023-11-04T01:37:31.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.192+0000 7f2e0b7fe640 1 -- 172.21.15.44:0/885392202 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e0c014630 con 0x7f2e140b4c50 2023-11-04T01:37:31.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.192+0000 7f2e0b7fe640 1 --2- 172.21.15.44:0/885392202 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2df406aea0 0x7f2df406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.192+0000 7f2e0b7fe640 1 -- 172.21.15.44:0/885392202 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2e0c089460 con 0x7f2e140b4c50 2023-11-04T01:37:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.193+0000 7f2e12ffd640 1 --2- 172.21.15.44:0/885392202 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2df406aea0 0x7f2df406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.193+0000 7f2e12ffd640 1 --2- 172.21.15.44:0/885392202 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2df406aea0 0x7f2df406d360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2e141f6f30 tx=0x7f2e04008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.198+0000 7f2e0b7fe640 1 -- 172.21.15.44:0/885392202 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e0c0543c0 con 0x7f2e140b4c50 2023-11-04T01:37:31.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.411+0000 7f2e19790640 1 -- 172.21.15.44:0/885392202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2e14074290 con 0x7f2e140b4c50 2023-11-04T01:37:31.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.411+0000 7f2e0b7fe640 1 -- 172.21.15.44:0/885392202 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2e0c0579e0 con 0x7f2e140b4c50 2023-11-04T01:37:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:37:31.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.413+0000 7f2e19790640 1 -- 172.21.15.44:0/885392202 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2df406aea0 msgr2=0x7f2df406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.413+0000 7f2e19790640 1 --2- 172.21.15.44:0/885392202 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2df406aea0 0x7f2df406d360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2e141f6f30 tx=0x7f2e04008040 comp rx=0 tx=0).stop 2023-11-04T01:37:31.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.413+0000 7f2e19790640 1 -- 172.21.15.44:0/885392202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e140b4c50 msgr2=0x7f2e1415e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.413+0000 7f2e19790640 1 --2- 172.21.15.44:0/885392202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e140b4c50 0x7f2e1415e290 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2e140cb1a0 tx=0x7f2e0c00e530 comp rx=0 tx=0).stop 2023-11-04T01:37:31.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.413+0000 7f2e19790640 1 -- 172.21.15.44:0/885392202 shutdown_connections 2023-11-04T01:37:31.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.413+0000 7f2e19790640 1 --2- 172.21.15.44:0/885392202 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2df406aea0 0x7f2df406d360 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.413+0000 7f2e19790640 1 --2- 172.21.15.44:0/885392202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e140b4c50 0x7f2e1415e290 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.413+0000 7f2e19790640 1 --2- 172.21.15.44:0/885392202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e1414f2d0 0x7f2e140c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.413+0000 7f2e19790640 1 --2- 172.21.15.44:0/885392202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e00003ee0 0x7f2e140c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.413+0000 7f2e19790640 1 -- 172.21.15.44:0/885392202 >> 172.21.15.44:0/885392202 conn(0x7f2e1406ea90 msgr2=0x7f2e1415fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.413+0000 7f2e19790640 1 -- 172.21.15.44:0/885392202 shutdown_connections 2023-11-04T01:37:31.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:31.413+0000 7f2e19790640 1 -- 172.21.15.44:0/885392202 wait complete. 2023-11-04T01:37:31.426 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:37:31.426 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:37:31.426 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2023-11-04T01:37:31.426 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:37:31.426 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:31.426 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:37:31.426 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:37:31.426 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:37:31.426 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:37:31.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:31.427 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2023-11-04T01:37:31.442 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:37:31.443 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:37:31.443 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:37:31.443 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:31.443 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2023-11-04T01:37:31.443 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:31.443 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:31.443 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2023-11-04T01:37:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:31.443 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:31.443 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2023-11-04T01:37:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:37:31.444 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:31.444 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2023-11-04T01:37:31.444 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-04T01:37:31.444 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42418sec preferred_lft 42418sec 2023-11-04T01:37:31.444 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2023-11-04T01:37:31.444 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:31.444 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:31.444 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2023-11-04T01:37:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:37:31.444 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:31.444 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:37:31.444 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:31.445 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::9082:77ff:fe28:4353/64 scope link 2023-11-04T01:37:31.445 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:37:31.445 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:31.445 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::e49d:e3ff:fe56:d068/64 scope link 2023-11-04T01:37:31.445 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:37:31.445 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether f2:23:83:31:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:31.445 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::f023:83ff:fe31:915/64 scope link 2023-11-04T01:37:31.445 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:31.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:31.446 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:37:31.513 INFO:teuthology.orchestra.run.smithi044.stdout:1 2023-11-04T01:37:31.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:31.515 DEBUG:teuthology.orchestra.run.smithi044:> route 2023-11-04T01:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2023-11-04T01:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-04T01:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-04T01:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:37:31.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:31.572 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:37:31.572 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:37:31.572 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:37:31.572 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:37:31.572 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:37:31.572 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:37:31.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:31.678 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2023-11-04T01:37:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:37:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:37:31.693 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:37:31.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:31.694 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2023-11-04T01:37:31.764 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:37:31.764 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:31.764 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:37:31.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:31.819 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:31.875 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:37:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:37:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:37:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:37:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:37:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:37:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:37:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:37:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:37:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:37:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:37:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:37:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:37:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:37:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:37:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:37:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:37:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:37:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:37:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:37:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:31.934 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:31.934 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:31.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:31.934 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:37:31.986 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:37:31.986 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:37:32.028 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:37:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:37:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:37:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:37:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:37:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:37:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:37:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:37:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:37:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:37:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:37:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:37:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:37:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:37:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:37:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:37:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:37:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:37:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:37:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:37:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:32.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:32.047 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:37:32.126 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:37:32.124+0000 7f0920c0b480 -1 init, newargv = 0x55c85b281bd0 newargc=15 2023-11-04T01:37:32.126 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[104768]: starting ceph client 2023-11-04T01:37:32.130 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[104768]: starting fuse 2023-11-04T01:37:33.201 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:37:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:37:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:37:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:37:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:37:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:37:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:37:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:37:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:37:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:37:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:37:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:37:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:37:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:37:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:37:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:37:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:37:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:37:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:37:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:37:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:33.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:33.225 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:37:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:41 2023-11-04T01:37:33.284 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:37:33.284 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:37:33.284 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2023-11-04T01:37:33.284 DEBUG:teuthology.orchestra.run.smithi044:> import re 2023-11-04T01:37:33.284 DEBUG:teuthology.orchestra.run.smithi044:> import os 2023-11-04T01:37:33.284 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2023-11-04T01:37:33.285 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:37:33.285 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2023-11-04T01:37:33.285 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:37:33.285 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2023-11-04T01:37:33.285 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:37:33.285 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:37:33.285 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2023-11-04T01:37:33.285 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2023-11-04T01:37:33.285 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2023-11-04T01:37:33.285 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2023-11-04T01:37:33.285 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:37:33.285 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2023-11-04T01:37:33.285 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:37:33.285 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:37:33.286 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:37:33.286 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2023-11-04T01:37:33.286 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2023-11-04T01:37:33.286 DEBUG:teuthology.orchestra.run.smithi044:> return f 2023-11-04T01:37:33.286 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:37:33.286 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:37:33.286 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2023-11-04T01:37:33.286 DEBUG:teuthology.orchestra.run.smithi044:> ' 2023-11-04T01:37:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.104768.asok 2023-11-04T01:37:33.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:33.431 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.104768.asok 2023-11-04T01:37:33.432 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:33.432 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.104768.asok status 2023-11-04T01:37:33.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:37:33.611 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2023-11-04T01:37:33.611 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:37:33.611 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:37:33.611 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2023-11-04T01:37:33.611 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2023-11-04T01:37:33.611 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:37:33.611 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "104768", 2023-11-04T01:37:33.611 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2023-11-04T01:37:33.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:33.611 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2023-11-04T01:37:33.612 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2023-11-04T01:37:33.612 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 5724, 2023-11-04T01:37:33.612 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2023-11-04T01:37:33.612 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2023-11-04T01:37:33.612 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2023-11-04T01:37:33.612 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 5724 2023-11-04T01:37:33.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:33.612 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:37:33.612 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:37:33.612 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:37:33.612 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 643366178 2023-11-04T01:37:33.612 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:33.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:33.613 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:37:33.613 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:37:33.613 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:37:33.613 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 643366178 2023-11-04T01:37:33.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:33.613 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.5724 192.168.0.1:0/643366178", 2023-11-04T01:37:33.613 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/643366178", 2023-11-04T01:37:33.613 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2023-11-04T01:37:33.613 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 15, 2023-11-04T01:37:33.613 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 39, 2023-11-04T01:37:33.613 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:37:33.613 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2023-11-04T01:37:33.613 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2023-11-04T01:37:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:37:33.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:33.625 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:33.625 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:37:33.625 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:33.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:33.689 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2023-11-04T01:37:33.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:33.696 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:33.696 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:33.696 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:33.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:33.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:33.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create snap-test-pool 2023-11-04T01:37:33.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.872+0000 7f60c833c640 1 Processor -- start 2023-11-04T01:37:33.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.872+0000 7f60c833c640 1 -- start start 2023-11-04T01:37:33.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.873+0000 7f60c833c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f60c00c4ff0 0x7f60c00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.873+0000 7f60c833c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60c00adac0 0x7f60c00adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.873+0000 7f60c833c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c015aff0 con 0x7f60c0159c00 2023-11-04T01:37:33.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.873+0000 7f60c833c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c00ae460 con 0x7f60c00c4ff0 2023-11-04T01:37:33.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.873+0000 7f60c833c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c015a3e0 con 0x7f60c00adac0 2023-11-04T01:37:33.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.873+0000 7f60c58d7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f60c00c4ff0 0x7f60c00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.873+0000 7f60c60d8640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f60c0159c00 0x7f60c00c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57728/0 (socket says 172.21.15.44:57728) 2023-11-04T01:37:33.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.873+0000 7f60c60d8640 1 -- 172.21.15.44:0/3451232888 learned_addr learned my addr 172.21.15.44:0/3451232888 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:33.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.873+0000 7f60c68d9640 1 --2- 172.21.15.44:0/3451232888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60c00adac0 0x7f60c00adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.873+0000 7f60c58d7640 1 -- 172.21.15.44:0/3451232888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60c00adac0 msgr2=0x7f60c00adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:33.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.873+0000 7f60c58d7640 1 --2- 172.21.15.44:0/3451232888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60c00adac0 0x7f60c00adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.873+0000 7f60c58d7640 1 -- 172.21.15.44:0/3451232888 >> v1:172.21.15.44:6789/0 conn(0x7f60c0159c00 legacy=0x7f60c00c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.873+0000 7f60c58d7640 1 -- 172.21.15.44:0/3451232888 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c015a6c0 con 0x7f60c00c4ff0 2023-11-04T01:37:33.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.873+0000 7f60c50d6640 1 -- 172.21.15.44:0/3451232888 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3696450482 0 0) 0x7f60c015aff0 con 0x7f60c0159c00 2023-11-04T01:37:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.873+0000 7f60c68d9640 1 --2- 172.21.15.44:0/3451232888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60c00adac0 0x7f60c00adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.874+0000 7f60c58d7640 1 --2- 172.21.15.44:0/3451232888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60c00c4ff0 0x7f60c00cc890 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f60b00097a0 tx=0x7f60b002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc84214f5b73ca4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.874+0000 7f60c50d6640 1 -- 172.21.15.44:0/3451232888 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b0031830 con 0x7f60c00c4ff0 2023-11-04T01:37:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.874+0000 7f60c50d6640 1 -- 172.21.15.44:0/3451232888 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b0031990 con 0x7f60c00c4ff0 2023-11-04T01:37:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.874+0000 7f60c50d6640 1 -- 172.21.15.44:0/3451232888 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b0031d20 con 0x7f60c00c4ff0 2023-11-04T01:37:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.875+0000 7f60c833c640 1 -- 172.21.15.44:0/3451232888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60c00c4ff0 msgr2=0x7f60c00cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.875+0000 7f60c833c640 1 --2- 172.21.15.44:0/3451232888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60c00c4ff0 0x7f60c00cc890 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f60b00097a0 tx=0x7f60b002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.875+0000 7f60c833c640 1 -- 172.21.15.44:0/3451232888 shutdown_connections 2023-11-04T01:37:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.875+0000 7f60c833c640 1 --2- 172.21.15.44:0/3451232888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60c00adac0 0x7f60c00adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.875+0000 7f60c833c640 1 --2- 172.21.15.44:0/3451232888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60c00c4ff0 0x7f60c00cc890 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.875+0000 7f60c833c640 1 -- 172.21.15.44:0/3451232888 >> 172.21.15.44:0/3451232888 conn(0x7f60c00ce950 msgr2=0x7f60c00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:33.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.875+0000 7f60c833c640 1 -- 172.21.15.44:0/3451232888 shutdown_connections 2023-11-04T01:37:33.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.875+0000 7f60c833c640 1 -- 172.21.15.44:0/3451232888 wait complete. 2023-11-04T01:37:33.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.876+0000 7f60c833c640 1 Processor -- start 2023-11-04T01:37:33.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.876+0000 7f60c833c640 1 -- start start 2023-11-04T01:37:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c833c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60c00adac0 0x7f60c015b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c833c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60c00c4ff0 0x7f60c015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c833c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60c0159c00 0x7f60c0144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c833c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c00a7ef0 con 0x7f60c0159c00 2023-11-04T01:37:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c833c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c01473c0 con 0x7f60c00adac0 2023-11-04T01:37:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c833c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c01467b0 con 0x7f60c00c4ff0 2023-11-04T01:37:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c68d9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60c0159c00 0x7f60c0144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c68d9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60c0159c00 0x7f60c0144f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59962/0 (socket says 172.21.15.44:59962) 2023-11-04T01:37:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c68d9640 1 -- 172.21.15.44:0/3760849034 learned_addr learned my addr 172.21.15.44:0/3760849034 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c58d7640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60c00c4ff0 0x7f60c015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c60d8640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60c00adac0 0x7f60c015b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c68d9640 1 -- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60c00c4ff0 msgr2=0x7f60c015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c68d9640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60c00c4ff0 0x7f60c015b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c68d9640 1 -- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60c00adac0 msgr2=0x7f60c015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c68d9640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60c00adac0 0x7f60c015b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c68d9640 1 -- 172.21.15.44:0/3760849034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b0009400 con 0x7f60c0159c00 2023-11-04T01:37:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c58d7640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60c00c4ff0 0x7f60c015b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.877+0000 7f60c60d8640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60c00adac0 0x7f60c015b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.878+0000 7f60c68d9640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60c0159c00 0x7f60c0144f90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f60b800cf20 tx=0x7f60b800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.878+0000 7f60b6ffd640 1 -- 172.21.15.44:0/3760849034 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b800d840 con 0x7f60c0159c00 2023-11-04T01:37:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.878+0000 7f60b6ffd640 1 -- 172.21.15.44:0/3760849034 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b800d9a0 con 0x7f60c0159c00 2023-11-04T01:37:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.878+0000 7f60c833c640 1 -- 172.21.15.44:0/3760849034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c0146a90 con 0x7f60c0159c00 2023-11-04T01:37:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.878+0000 7f60b6ffd640 1 -- 172.21.15.44:0/3760849034 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b800dd50 con 0x7f60c0159c00 2023-11-04T01:37:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.878+0000 7f60c833c640 1 -- 172.21.15.44:0/3760849034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c0147050 con 0x7f60c0159c00 2023-11-04T01:37:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.879+0000 7f60c833c640 1 -- 172.21.15.44:0/3760849034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c0147570 con 0x7f60c0159c00 2023-11-04T01:37:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.879+0000 7f60b6ffd640 1 -- 172.21.15.44:0/3760849034 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60b801e3b0 con 0x7f60c0159c00 2023-11-04T01:37:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.879+0000 7f60b6ffd640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f60a406ae70 0x7f60a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.880+0000 7f60b6ffd640 1 -- 172.21.15.44:0/3760849034 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f60b808a190 con 0x7f60c0159c00 2023-11-04T01:37:33.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.880+0000 7f60c60d8640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f60a406ae70 0x7f60a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.880+0000 7f60c60d8640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f60a406ae70 0x7f60a406d330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f60bc000f60 tx=0x7f60bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:33.884+0000 7f60b6ffd640 1 -- 172.21.15.44:0/3760849034 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60c0147570 con 0x7f60c0159c00 2023-11-04T01:37:34.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.058+0000 7f60c833c640 1 -- 172.21.15.44:0/3760849034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "snap-test-pool"} v 0) v1 -- 0x7f60c0147570 con 0x7f60c0159c00 2023-11-04T01:37:34.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.205+0000 7f60b6ffd640 1 -- 172.21.15.44:0/3760849034 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "snap-test-pool"}]=0 pool 'snap-test-pool' created v40) v1 ==== 118+0+0 (secure 0 0 0) 0x7f60c0147570 con 0x7f60c0159c00 2023-11-04T01:37:34.207 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'snap-test-pool' created 2023-11-04T01:37:34.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.208+0000 7f60c833c640 1 -- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f60a406ae70 msgr2=0x7f60a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.208+0000 7f60c833c640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f60a406ae70 0x7f60a406d330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f60bc000f60 tx=0x7f60bc009040 comp rx=0 tx=0).stop 2023-11-04T01:37:34.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.208+0000 7f60c833c640 1 -- 172.21.15.44:0/3760849034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60c0159c00 msgr2=0x7f60c0144f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.208+0000 7f60c833c640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60c0159c00 0x7f60c0144f90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f60b800cf20 tx=0x7f60b800a7d0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.208+0000 7f60c833c640 1 -- 172.21.15.44:0/3760849034 shutdown_connections 2023-11-04T01:37:34.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.208+0000 7f60c833c640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f60a406ae70 0x7f60a406d330 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.208+0000 7f60c833c640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60c0159c00 0x7f60c0144f90 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.208+0000 7f60c833c640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60c00c4ff0 0x7f60c015b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.208+0000 7f60c833c640 1 --2- 172.21.15.44:0/3760849034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60c00adac0 0x7f60c015b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.208+0000 7f60c833c640 1 -- 172.21.15.44:0/3760849034 >> 172.21.15.44:0/3760849034 conn(0x7f60c00ce950 msgr2=0x7f60c00c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:34.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.208+0000 7f60c833c640 1 -- 172.21.15.44:0/3760849034 shutdown_connections 2023-11-04T01:37:34.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.208+0000 7f60c833c640 1 -- 172.21.15.44:0/3760849034 wait complete. 2023-11-04T01:37:34.225 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool mksnap snap3 2023-11-04T01:37:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.265+0000 7f3eda376f40 1 Processor -- start 2023-11-04T01:37:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.265+0000 7f3eda376f40 1 -- start start 2023-11-04T01:37:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3eda376f40 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec0002260 0x560ad6db2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3eda376f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560ad6db14e0 0x560ad6db3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3eda376f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560ad6d93ea0 0x560ad6d04f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3eda376f40 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad6c893b0 con 0x7f3ec0002260 2023-11-04T01:37:34.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3eda376f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad6c23650 con 0x560ad6db14e0 2023-11-04T01:37:34.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3eda376f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x560ad6c232f0 con 0x560ad6d93ea0 2023-11-04T01:37:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3ed7e78640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec0002260 0x560ad6db2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3ed7e78640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec0002260 0x560ad6db2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59972/0 (socket says 172.21.15.44:59972) 2023-11-04T01:37:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3ed7e78640 1 -- 172.21.15.44:0/2986734990 learned_addr learned my addr 172.21.15.44:0/2986734990 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3ed8679640 1 --2- 172.21.15.44:0/2986734990 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560ad6d93ea0 0x560ad6d04f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3ed7677640 1 --2- 172.21.15.44:0/2986734990 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560ad6db14e0 0x560ad6db3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3ed7e78640 1 -- 172.21.15.44:0/2986734990 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560ad6d93ea0 msgr2=0x560ad6d04f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3ed7e78640 1 --2- 172.21.15.44:0/2986734990 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560ad6d93ea0 0x560ad6d04f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3ed7e78640 1 -- 172.21.15.44:0/2986734990 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560ad6db14e0 msgr2=0x560ad6db3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3ed7e78640 1 --2- 172.21.15.44:0/2986734990 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560ad6db14e0 0x560ad6db3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3ed7e78640 1 -- 172.21.15.44:0/2986734990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ad6c2f780 con 0x7f3ec0002260 2023-11-04T01:37:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3ed7677640 1 --2- 172.21.15.44:0/2986734990 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560ad6db14e0 0x560ad6db3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3ed7e78640 1 --2- 172.21.15.44:0/2986734990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec0002260 0x560ad6db2d10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009760 tx=0x7f3ec8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7ed4f4d9a34bad server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3ed6675640 1 -- 172.21.15.44:0/2986734990 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8052910 con 0x7f3ec0002260 2023-11-04T01:37:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3ed6675640 1 -- 172.21.15.44:0/2986734990 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec8052a70 con 0x7f3ec0002260 2023-11-04T01:37:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.266+0000 7f3ed6675640 1 -- 172.21.15.44:0/2986734990 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8052e20 con 0x7f3ec0002260 2023-11-04T01:37:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.267+0000 7f3eda376f40 1 -- 172.21.15.44:0/2986734990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec0002260 msgr2=0x560ad6db2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.267+0000 7f3eda376f40 1 --2- 172.21.15.44:0/2986734990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec0002260 0x560ad6db2d10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009760 tx=0x7f3ec8002fb0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.267+0000 7f3eda376f40 1 -- 172.21.15.44:0/2986734990 shutdown_connections 2023-11-04T01:37:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.267+0000 7f3eda376f40 1 --2- 172.21.15.44:0/2986734990 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560ad6d93ea0 0x560ad6d04f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.267+0000 7f3eda376f40 1 --2- 172.21.15.44:0/2986734990 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560ad6db14e0 0x560ad6db3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.267+0000 7f3eda376f40 1 --2- 172.21.15.44:0/2986734990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec0002260 0x560ad6db2d10 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.267+0000 7f3eda376f40 1 -- 172.21.15.44:0/2986734990 >> 172.21.15.44:0/2986734990 conn(0x560ad6d21530 msgr2=0x560ad6cc4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.267+0000 7f3eda376f40 1 -- 172.21.15.44:0/2986734990 shutdown_connections 2023-11-04T01:37:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.267+0000 7f3eda376f40 1 -- 172.21.15.44:0/2986734990 wait complete. 2023-11-04T01:37:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.268+0000 7f3eda376f40 1 Processor -- start 2023-11-04T01:37:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.268+0000 7f3eda376f40 1 -- start start 2023-11-04T01:37:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.268+0000 7f3eda376f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560ad6d93ea0 0x560ad6d92750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.268+0000 7f3eda376f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560ad6db14e0 0x560ad6d0a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.268+0000 7f3eda376f40 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec0002260 0x560ad6d92f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.268+0000 7f3eda376f40 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad6c034f0 con 0x7f3ec0002260 2023-11-04T01:37:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.268+0000 7f3eda376f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad6d08d00 con 0x560ad6db14e0 2023-11-04T01:37:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.268+0000 7f3eda376f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x560ad6d08fe0 con 0x560ad6d93ea0 2023-11-04T01:37:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.268+0000 7f3ed8679640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec0002260 0x560ad6d92f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.268+0000 7f3ed8679640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec0002260 0x560ad6d92f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59982/0 (socket says 172.21.15.44:59982) 2023-11-04T01:37:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.268+0000 7f3ed8679640 1 -- 172.21.15.44:0/3812196234 learned_addr learned my addr 172.21.15.44:0/3812196234 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.268+0000 7f3ed7e78640 1 --2- 172.21.15.44:0/3812196234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560ad6d93ea0 0x560ad6d92750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.268+0000 7f3ed7677640 1 --2- 172.21.15.44:0/3812196234 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560ad6db14e0 0x560ad6d0a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.269+0000 7f3ed8679640 1 -- 172.21.15.44:0/3812196234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560ad6d93ea0 msgr2=0x560ad6d92750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.269+0000 7f3ed8679640 1 --2- 172.21.15.44:0/3812196234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560ad6d93ea0 0x560ad6d92750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.269+0000 7f3ed8679640 1 -- 172.21.15.44:0/3812196234 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560ad6db14e0 msgr2=0x560ad6d0a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.269+0000 7f3ed8679640 1 --2- 172.21.15.44:0/3812196234 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560ad6db14e0 0x560ad6d0a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.269+0000 7f3ed8679640 1 -- 172.21.15.44:0/3812196234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0001e10 con 0x7f3ec0002260 2023-11-04T01:37:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.269+0000 7f3ed8679640 1 --2- 172.21.15.44:0/3812196234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec0002260 0x560ad6d92f20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x560ad6cc7670 tx=0x7f3ed00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.269+0000 7f3ed5673640 1 -- 172.21.15.44:0/3812196234 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0013740 con 0x7f3ec0002260 2023-11-04T01:37:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.269+0000 7f3ed5673640 1 -- 172.21.15.44:0/3812196234 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed00138c0 con 0x7f3ec0002260 2023-11-04T01:37:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.269+0000 7f3ed5673640 1 -- 172.21.15.44:0/3812196234 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0013c70 con 0x7f3ec0002260 2023-11-04T01:37:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.269+0000 7f3eda376f40 1 -- 172.21.15.44:0/3812196234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560ad6c22930 con 0x7f3ec0002260 2023-11-04T01:37:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.269+0000 7f3eda376f40 1 -- 172.21.15.44:0/3812196234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ad6c22390 con 0x7f3ec0002260 2023-11-04T01:37:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.271+0000 7f3ed5673640 1 -- 172.21.15.44:0/3812196234 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ed0003040 con 0x7f3ec0002260 2023-11-04T01:37:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.271+0000 7f3ed5673640 1 --2- 172.21.15.44:0/3812196234 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3ec4069850 0x7f3ec406bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.271+0000 7f3ed5673640 1 -- 172.21.15.44:0/3812196234 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3ed0088970 con 0x7f3ec0002260 2023-11-04T01:37:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.271+0000 7f3eda376f40 1 -- 172.21.15.44:0/3812196234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- pool_op(create snap pool 7 tid 1 name snap3 v0) v4 -- 0x560ad6c93330 con 0x7f3ec0002260 2023-11-04T01:37:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.271+0000 7f3ed7e78640 1 --2- 172.21.15.44:0/3812196234 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3ec4069850 0x7f3ec406bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:34.272+0000 7f3ed7e78640 1 --2- 172.21.15.44:0/3812196234 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3ec4069850 0x7f3ec406bd10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3ec805c000 tx=0x7f3ec804c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.210+0000 7f3ed5673640 1 -- 172.21.15.44:0/3812196234 <== mon.0 v2:172.21.15.44:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v41) v1 ==== 43+0+0 (secure 0 0 0) 0x7f3ed00538c0 con 0x7f3ec0002260 2023-11-04T01:37:35.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.211+0000 7f3ed5673640 1 -- 172.21.15.44:0/3812196234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=41}) v3 -- 0x7f3ec4072540 con 0x7f3ec0002260 2023-11-04T01:37:35.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.211+0000 7f3ed5673640 1 -- 172.21.15.44:0/3812196234 <== mon.0 v2:172.21.15.44:3300/0 7 ==== osd_map(41..41 src has 1..41) v4 ==== 718+0+0 (secure 0 0 0) 0x7f3ed0057580 con 0x7f3ec0002260 2023-11-04T01:37:35.214 INFO:teuthology.orchestra.run.smithi044.stdout:created pool snap-test-pool snap snap3 2023-11-04T01:37:35.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.216+0000 7f3eda376f40 1 -- 172.21.15.44:0/3812196234 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3ec4069850 msgr2=0x7f3ec406bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.216+0000 7f3eda376f40 1 --2- 172.21.15.44:0/3812196234 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3ec4069850 0x7f3ec406bd10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3ec805c000 tx=0x7f3ec804c000 comp rx=0 tx=0).stop 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.217+0000 7f3eda376f40 1 -- 172.21.15.44:0/3812196234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec0002260 msgr2=0x560ad6d92f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.217+0000 7f3eda376f40 1 --2- 172.21.15.44:0/3812196234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec0002260 0x560ad6d92f20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x560ad6cc7670 tx=0x7f3ed00118d0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.217+0000 7f3eda376f40 1 -- 172.21.15.44:0/3812196234 shutdown_connections 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.217+0000 7f3eda376f40 1 --2- 172.21.15.44:0/3812196234 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3ec4069850 0x7f3ec406bd10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.217+0000 7f3eda376f40 1 --2- 172.21.15.44:0/3812196234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec0002260 0x560ad6d92f20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.217+0000 7f3eda376f40 1 --2- 172.21.15.44:0/3812196234 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560ad6db14e0 0x560ad6d0a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.217+0000 7f3eda376f40 1 --2- 172.21.15.44:0/3812196234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560ad6d93ea0 0x560ad6d92750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.217+0000 7f3eda376f40 1 -- 172.21.15.44:0/3812196234 >> 172.21.15.44:0/3812196234 conn(0x560ad6d21530 msgr2=0x560ad6db2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:35.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.219+0000 7f3eda376f40 1 -- 172.21.15.44:0/3812196234 shutdown_connections 2023-11-04T01:37:35.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.219+0000 7f3eda376f40 1 -- 172.21.15.44:0/3812196234 wait complete. 2023-11-04T01:37:35.228 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs snap-test-pool 2023-11-04T01:37:35.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.383+0000 7f025ace5640 1 Processor -- start 2023-11-04T01:37:35.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.383+0000 7f025ace5640 1 -- start start 2023-11-04T01:37:35.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.384+0000 7f025ace5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0254153e60 0x7f025415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.384+0000 7f025ace5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f02540b4880 0x7f02540b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.384+0000 7f025ace5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02540cde60 con 0x7f02540cd6d0 2023-11-04T01:37:35.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.384+0000 7f025ace5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0254160f90 con 0x7f02540b4880 2023-11-04T01:37:35.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.384+0000 7f025ace5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02540b5200 con 0x7f0254153e60 2023-11-04T01:37:35.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.384+0000 7f0259282640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f02540b4880 0x7f02540b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.384+0000 7f0253fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f02540cd6d0 0x7f0254161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57750/0 (socket says 172.21.15.44:57750) 2023-11-04T01:37:35.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.384+0000 7f0253fff640 1 -- 172.21.15.44:0/1279324206 learned_addr learned my addr 172.21.15.44:0/1279324206 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:35.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.384+0000 7f02537fe640 1 -- 172.21.15.44:0/1279324206 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373276447 0 0) 0x7f02540cde60 con 0x7f02540cd6d0 2023-11-04T01:37:35.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.384+0000 7f02537fe640 1 -- 172.21.15.44:0/1279324206 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f023c003520 con 0x7f02540cd6d0 2023-11-04T01:37:35.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.384+0000 7f0259282640 1 -- 172.21.15.44:0/1279324206 >> v2:172.21.15.204:3300/0 conn(0x7f0254153e60 msgr2=0x7f025415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:35.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.384+0000 7f0258a81640 1 --2- 172.21.15.44:0/1279324206 >> v2:172.21.15.204:3300/0 conn(0x7f0254153e60 0x7f025415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.384+0000 7f0259282640 1 --2- 172.21.15.44:0/1279324206 >> v2:172.21.15.204:3300/0 conn(0x7f0254153e60 0x7f025415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.384+0000 7f0259282640 1 -- 172.21.15.44:0/1279324206 >> v1:172.21.15.44:6789/0 conn(0x7f02540cd6d0 legacy=0x7f0254161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.384+0000 7f0259282640 1 -- 172.21.15.44:0/1279324206 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025415e400 con 0x7f02540b4880 2023-11-04T01:37:35.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.385+0000 7f0259282640 1 --2- 172.21.15.44:0/1279324206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02540b4880 0x7f02540b4cc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f025408abe0 tx=0x7f024c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77163f814eef6255 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.385+0000 7f02537fe640 1 -- 172.21.15.44:0/1279324206 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c02cc80 con 0x7f02540b4880 2023-11-04T01:37:35.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.385+0000 7f02537fe640 1 -- 172.21.15.44:0/1279324206 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c02cde0 con 0x7f02540b4880 2023-11-04T01:37:35.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.385+0000 7f02537fe640 1 -- 172.21.15.44:0/1279324206 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c034660 con 0x7f02540b4880 2023-11-04T01:37:35.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.386+0000 7f025ace5640 1 -- 172.21.15.44:0/1279324206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02540b4880 msgr2=0x7f02540b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.386+0000 7f025ace5640 1 --2- 172.21.15.44:0/1279324206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02540b4880 0x7f02540b4cc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f025408abe0 tx=0x7f024c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.386+0000 7f025ace5640 1 -- 172.21.15.44:0/1279324206 shutdown_connections 2023-11-04T01:37:35.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.386+0000 7f025ace5640 1 --2- 172.21.15.44:0/1279324206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02540b4880 0x7f02540b4cc0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.386+0000 7f025ace5640 1 --2- 172.21.15.44:0/1279324206 >> v2:172.21.15.204:3300/0 conn(0x7f0254153e60 0x7f025415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.386+0000 7f025ace5640 1 -- 172.21.15.44:0/1279324206 >> 172.21.15.44:0/1279324206 conn(0x7f02540cf880 msgr2=0x7f02540cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:35.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.386+0000 7f025ace5640 1 -- 172.21.15.44:0/1279324206 shutdown_connections 2023-11-04T01:37:35.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.386+0000 7f025ace5640 1 -- 172.21.15.44:0/1279324206 wait complete. 2023-11-04T01:37:35.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.387+0000 7f025ace5640 1 Processor -- start 2023-11-04T01:37:35.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.387+0000 7f025ace5640 1 -- start start 2023-11-04T01:37:35.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.388+0000 7f025ace5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02540b4880 0x7f0254153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.388+0000 7f025ace5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02540cd6d0 0x7f0254157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.388+0000 7f025ace5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0254153e60 0x7f0254156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.388+0000 7f025ace5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02541580b0 con 0x7f02540b4880 2023-11-04T01:37:35.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.388+0000 7f025ace5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025415a660 con 0x7f0254153e60 2023-11-04T01:37:35.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.388+0000 7f025ace5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0254157270 con 0x7f02540cd6d0 2023-11-04T01:37:35.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.388+0000 7f0258a81640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02540b4880 0x7f0254153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.388+0000 7f0258a81640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02540b4880 0x7f0254153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59996/0 (socket says 172.21.15.44:59996) 2023-11-04T01:37:35.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.388+0000 7f0258a81640 1 -- 172.21.15.44:0/1143438904 learned_addr learned my addr 172.21.15.44:0/1143438904 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:35.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.388+0000 7f0253fff640 1 --2- 172.21.15.44:0/1143438904 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02540cd6d0 0x7f0254157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.388+0000 7f0259282640 1 --2- 172.21.15.44:0/1143438904 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0254153e60 0x7f0254156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.389+0000 7f0258a81640 1 -- 172.21.15.44:0/1143438904 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02540cd6d0 msgr2=0x7f0254157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.389+0000 7f0258a81640 1 --2- 172.21.15.44:0/1143438904 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02540cd6d0 0x7f0254157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.389+0000 7f0258a81640 1 -- 172.21.15.44:0/1143438904 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0254153e60 msgr2=0x7f0254156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.389+0000 7f0258a81640 1 --2- 172.21.15.44:0/1143438904 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0254153e60 0x7f0254156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.389+0000 7f0258a81640 1 -- 172.21.15.44:0/1143438904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c009a70 con 0x7f02540b4880 2023-11-04T01:37:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.389+0000 7f0258a81640 1 --2- 172.21.15.44:0/1143438904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02540b4880 0x7f0254153430 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f024400c7f0 tx=0x7f024400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.389+0000 7f02517fa640 1 -- 172.21.15.44:0/1143438904 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0244004220 con 0x7f02540b4880 2023-11-04T01:37:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.389+0000 7f02517fa640 1 -- 172.21.15.44:0/1143438904 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0244004380 con 0x7f02540b4880 2023-11-04T01:37:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.389+0000 7f025ace5640 1 -- 172.21.15.44:0/1143438904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025415a8d0 con 0x7f02540b4880 2023-11-04T01:37:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.389+0000 7f02517fa640 1 -- 172.21.15.44:0/1143438904 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0244007840 con 0x7f02540b4880 2023-11-04T01:37:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.389+0000 7f025ace5640 1 -- 172.21.15.44:0/1143438904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0254155030 con 0x7f02540b4880 2023-11-04T01:37:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.390+0000 7f025ace5640 1 -- 172.21.15.44:0/1143438904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0254074290 con 0x7f02540b4880 2023-11-04T01:37:35.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.390+0000 7f02517fa640 1 -- 172.21.15.44:0/1143438904 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0244007bb0 con 0x7f02540b4880 2023-11-04T01:37:35.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.391+0000 7f02517fa640 1 --2- 172.21.15.44:0/1143438904 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f024006ae70 0x7f024006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.391+0000 7f02517fa640 1 -- 172.21.15.44:0/1143438904 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f0244089840 con 0x7f02540b4880 2023-11-04T01:37:35.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.391+0000 7f0253fff640 1 --2- 172.21.15.44:0/1143438904 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f024006ae70 0x7f024006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.392+0000 7f0253fff640 1 --2- 172.21.15.44:0/1143438904 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f024006ae70 0x7f024006d330 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f02540c9950 tx=0x7f0248009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.396+0000 7f02517fa640 1 -- 172.21.15.44:0/1143438904 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0244054620 con 0x7f02540b4880 2023-11-04T01:37:35.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.613+0000 7f025ace5640 1 -- 172.21.15.44:0/1143438904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"} v 0) v1 -- 0x7f02540d0b80 con 0x7f02540b4880 2023-11-04T01:37:35.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.613+0000 7f02517fa640 1 -- 172.21.15.44:0/1143438904 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"}]=-95 pool(7) already has mon-managed snaps; can't attach pool to fs v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f024401e0b0 con 0x7f02540b4880 2023-11-04T01:37:35.615 INFO:teuthology.orchestra.run.smithi044.stderr:Error ENOTSUP: pool(7) already has mon-managed snaps; can't attach pool to fs 2023-11-04T01:37:35.620 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:37:35.621 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool rmsnap snap3 2023-11-04T01:37:35.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.659+0000 7f7a03847f40 1 Processor -- start 2023-11-04T01:37:35.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.659+0000 7f7a03847f40 1 -- start start 2023-11-04T01:37:35.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a03847f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c4d557ac50 0x55c4d55c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a03847f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c4d55ab780 0x55c4d55c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a03847f40 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4d5639d30 0x55c4d5638270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a03847f40 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d552b3b0 con 0x55c4d5639d30 2023-11-04T01:37:35.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a03847f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d54c5650 con 0x55c4d557ac50 2023-11-04T01:37:35.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a03847f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4d54c52f0 con 0x55c4d55ab780 2023-11-04T01:37:35.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a0138a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4d5639d30 0x55c4d5638270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a0138a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4d5639d30 0x55c4d5638270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60020/0 (socket says 172.21.15.44:60020) 2023-11-04T01:37:35.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a0138a640 1 -- 172.21.15.44:0/861042860 learned_addr learned my addr 172.21.15.44:0/861042860 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:35.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f79fbfff640 1 --2- 172.21.15.44:0/861042860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c4d55ab780 0x55c4d55c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a00b89640 1 --2- 172.21.15.44:0/861042860 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c4d557ac50 0x55c4d55c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a0138a640 1 -- 172.21.15.44:0/861042860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c4d55ab780 msgr2=0x55c4d55c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:35.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a0138a640 1 --2- 172.21.15.44:0/861042860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c4d55ab780 0x55c4d55c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a0138a640 1 -- 172.21.15.44:0/861042860 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c4d557ac50 msgr2=0x55c4d55c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:35.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a0138a640 1 --2- 172.21.15.44:0/861042860 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c4d557ac50 0x55c4d55c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a0138a640 1 -- 172.21.15.44:0/861042860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f4005de0 con 0x55c4d5639d30 2023-11-04T01:37:35.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.660+0000 7f7a00b89640 1 --2- 172.21.15.44:0/861042860 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c4d557ac50 0x55c4d55c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:35.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.661+0000 7f7a0138a640 1 --2- 172.21.15.44:0/861042860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4d5639d30 0x55c4d5638270 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00d320 tx=0x7f79fc00d7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632255e4b9e26f7b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.661+0000 7f79faffd640 1 -- 172.21.15.44:0/861042860 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc006230 con 0x55c4d5639d30 2023-11-04T01:37:35.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.661+0000 7f79faffd640 1 -- 172.21.15.44:0/861042860 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc0040d0 con 0x55c4d5639d30 2023-11-04T01:37:35.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.661+0000 7f79faffd640 1 -- 172.21.15.44:0/861042860 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0108a0 con 0x55c4d5639d30 2023-11-04T01:37:35.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.661+0000 7f7a03847f40 1 -- 172.21.15.44:0/861042860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4d5639d30 msgr2=0x55c4d5638270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.661+0000 7f7a03847f40 1 --2- 172.21.15.44:0/861042860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4d5639d30 0x55c4d5638270 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00d320 tx=0x7f79fc00d7e0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.661+0000 7f7a03847f40 1 -- 172.21.15.44:0/861042860 shutdown_connections 2023-11-04T01:37:35.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.661+0000 7f7a03847f40 1 --2- 172.21.15.44:0/861042860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4d5639d30 0x55c4d5638270 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.661+0000 7f7a03847f40 1 --2- 172.21.15.44:0/861042860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c4d55ab780 0x55c4d55c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.661+0000 7f7a03847f40 1 --2- 172.21.15.44:0/861042860 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c4d557ac50 0x55c4d55c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.661+0000 7f7a03847f40 1 -- 172.21.15.44:0/861042860 >> 172.21.15.44:0/861042860 conn(0x55c4d55a7f40 msgr2=0x55c4d55c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:35.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.661+0000 7f7a03847f40 1 -- 172.21.15.44:0/861042860 shutdown_connections 2023-11-04T01:37:35.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.661+0000 7f7a03847f40 1 -- 172.21.15.44:0/861042860 wait complete. 2023-11-04T01:37:35.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.662+0000 7f7a03847f40 1 Processor -- start 2023-11-04T01:37:35.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.662+0000 7f7a03847f40 1 -- start start 2023-11-04T01:37:35.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a03847f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c4d557ac50 0x55c4d55c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a03847f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c4d55ab780 0x55c4d56354e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a03847f40 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4d5639d30 0x55c4d56317e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a03847f40 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d54a54f0 con 0x55c4d5639d30 2023-11-04T01:37:35.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a03847f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d5635050 con 0x55c4d55ab780 2023-11-04T01:37:35.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a03847f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4d5636850 con 0x55c4d557ac50 2023-11-04T01:37:35.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a0138a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4d5639d30 0x55c4d56317e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a0138a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4d5639d30 0x55c4d56317e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60028/0 (socket says 172.21.15.44:60028) 2023-11-04T01:37:35.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a0138a640 1 -- 172.21.15.44:0/2406042742 learned_addr learned my addr 172.21.15.44:0/2406042742 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:35.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a00b89640 1 --2- 172.21.15.44:0/2406042742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c4d557ac50 0x55c4d55c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a0138a640 1 -- 172.21.15.44:0/2406042742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c4d557ac50 msgr2=0x55c4d55c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f79fbfff640 1 --2- 172.21.15.44:0/2406042742 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c4d55ab780 0x55c4d56354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a0138a640 1 --2- 172.21.15.44:0/2406042742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c4d557ac50 0x55c4d55c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a0138a640 1 -- 172.21.15.44:0/2406042742 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c4d55ab780 msgr2=0x55c4d56354e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a0138a640 1 --2- 172.21.15.44:0/2406042742 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c4d55ab780 0x55c4d56354e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a0138a640 1 -- 172.21.15.44:0/2406042742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4d54c45a0 con 0x55c4d5639d30 2023-11-04T01:37:35.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a00b89640 1 --2- 172.21.15.44:0/2406042742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c4d557ac50 0x55c4d55c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:35.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f7a0138a640 1 --2- 172.21.15.44:0/2406042742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4d5639d30 0x55c4d56317e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00dce0 tx=0x7f79fc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.663+0000 7f79f9ffb640 1 -- 172.21.15.44:0/2406042742 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc010e70 con 0x55c4d5639d30 2023-11-04T01:37:35.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.664+0000 7f79f9ffb640 1 -- 172.21.15.44:0/2406042742 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc01e070 con 0x55c4d5639d30 2023-11-04T01:37:35.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.664+0000 7f7a03847f40 1 -- 172.21.15.44:0/2406042742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c4d54d1780 con 0x55c4d5639d30 2023-11-04T01:37:35.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.664+0000 7f79f9ffb640 1 -- 172.21.15.44:0/2406042742 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc001740 con 0x55c4d5639d30 2023-11-04T01:37:35.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.664+0000 7f7a03847f40 1 -- 172.21.15.44:0/2406042742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4d54c4930 con 0x55c4d5639d30 2023-11-04T01:37:35.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.665+0000 7f79f9ffb640 1 -- 172.21.15.44:0/2406042742 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f79fc0018a0 con 0x55c4d5639d30 2023-11-04T01:37:35.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.665+0000 7f79f9ffb640 1 --2- 172.21.15.44:0/2406042742 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f79e4069820 0x7f79e406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.665+0000 7f79f9ffb640 1 -- 172.21.15.44:0/2406042742 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f79fc089e70 con 0x55c4d5639d30 2023-11-04T01:37:35.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.665+0000 7f7a03847f40 1 -- 172.21.15.44:0/2406042742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- pool_op(delete snap pool 7 tid 1 name snap3 v0) v4 -- 0x55c4d5535330 con 0x55c4d5639d30 2023-11-04T01:37:35.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.665+0000 7f7a00b89640 1 --2- 172.21.15.44:0/2406042742 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f79e4069820 0x7f79e406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:35.666+0000 7f7a00b89640 1 --2- 172.21.15.44:0/2406042742 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f79e4069820 0x7f79e406bce0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f79f4054000 tx=0x7f79f404e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.219+0000 7f79f9ffb640 1 -- 172.21.15.44:0/2406042742 <== mon.0 v2:172.21.15.44:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v42) v1 ==== 43+0+0 (secure 0 0 0) 0x7f79fc015070 con 0x55c4d5639d30 2023-11-04T01:37:36.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.219+0000 7f79f9ffb640 1 -- 172.21.15.44:0/2406042742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=42}) v3 -- 0x7f79e40725d0 con 0x55c4d5639d30 2023-11-04T01:37:36.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.220+0000 7f79f9ffb640 1 -- 172.21.15.44:0/2406042742 <== mon.0 v2:172.21.15.44:3300/0 7 ==== osd_map(42..42 src has 1..42) v4 ==== 643+0+0 (secure 0 0 0) 0x7f79fc059000 con 0x55c4d5639d30 2023-11-04T01:37:36.222 INFO:teuthology.orchestra.run.smithi044.stdout:removed pool snap-test-pool snap snap3 2023-11-04T01:37:36.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.220+0000 7f7a03847f40 1 -- 172.21.15.44:0/2406042742 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f79e4069820 msgr2=0x7f79e406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.220+0000 7f7a03847f40 1 --2- 172.21.15.44:0/2406042742 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f79e4069820 0x7f79e406bce0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f79f4054000 tx=0x7f79f404e000 comp rx=0 tx=0).stop 2023-11-04T01:37:36.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.220+0000 7f7a03847f40 1 -- 172.21.15.44:0/2406042742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4d5639d30 msgr2=0x55c4d56317e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.220+0000 7f7a03847f40 1 --2- 172.21.15.44:0/2406042742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4d5639d30 0x55c4d56317e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00dce0 tx=0x7f79fc001250 comp rx=0 tx=0).stop 2023-11-04T01:37:36.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.220+0000 7f7a03847f40 1 -- 172.21.15.44:0/2406042742 shutdown_connections 2023-11-04T01:37:36.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.220+0000 7f7a03847f40 1 --2- 172.21.15.44:0/2406042742 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f79e4069820 0x7f79e406bce0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.220+0000 7f7a03847f40 1 --2- 172.21.15.44:0/2406042742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4d5639d30 0x55c4d56317e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.220+0000 7f7a03847f40 1 --2- 172.21.15.44:0/2406042742 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c4d55ab780 0x55c4d56354e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.220+0000 7f7a03847f40 1 --2- 172.21.15.44:0/2406042742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c4d557ac50 0x55c4d55c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.220+0000 7f7a03847f40 1 -- 172.21.15.44:0/2406042742 >> 172.21.15.44:0/2406042742 conn(0x55c4d55a7f40 msgr2=0x55c4d564a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:36.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.220+0000 7f7a03847f40 1 -- 172.21.15.44:0/2406042742 shutdown_connections 2023-11-04T01:37:36.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.220+0000 7f7a03847f40 1 -- 172.21.15.44:0/2406042742 wait complete. 2023-11-04T01:37:36.226 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete snap-test-pool 2023-11-04T01:37:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.380+0000 7f15cc9b6640 1 Processor -- start 2023-11-04T01:37:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.380+0000 7f15cc9b6640 1 -- start start 2023-11-04T01:37:36.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.381+0000 7f15cc9b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15c80cd6d0 0x7f15c8161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.381+0000 7f15cc9b6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f15c80b4880 0x7f15c80b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.381+0000 7f15cc9b6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c80cde60 con 0x7f15c8153e60 2023-11-04T01:37:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.381+0000 7f15cc9b6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c8160f90 con 0x7f15c80b4880 2023-11-04T01:37:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.381+0000 7f15cc9b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c80b51e0 con 0x7f15c80cd6d0 2023-11-04T01:37:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.381+0000 7f15c659c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f15c8153e60 0x7f15c815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57756/0 (socket says 172.21.15.44:57756) 2023-11-04T01:37:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.381+0000 7f15c6d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f15c80b4880 0x7f15c80b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.381+0000 7f15c659c640 1 -- 172.21.15.44:0/1164967245 learned_addr learned my addr 172.21.15.44:0/1164967245 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.381+0000 7f15c6d9d640 1 -- 172.21.15.44:0/1164967245 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15c80cd6d0 msgr2=0x7f15c8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.381+0000 7f15c5d9b640 1 --2- 172.21.15.44:0/1164967245 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15c80cd6d0 0x7f15c8161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.381+0000 7f15c6d9d640 1 --2- 172.21.15.44:0/1164967245 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15c80cd6d0 0x7f15c8161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.381+0000 7f15c559a640 1 -- 172.21.15.44:0/1164967245 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260256344 0 0) 0x7f15c80cde60 con 0x7f15c8153e60 2023-11-04T01:37:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.381+0000 7f15c6d9d640 1 -- 172.21.15.44:0/1164967245 >> v1:172.21.15.44:6789/0 conn(0x7f15c8153e60 legacy=0x7f15c815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.382+0000 7f15c6d9d640 1 -- 172.21.15.44:0/1164967245 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c8161960 con 0x7f15c80b4880 2023-11-04T01:37:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.382+0000 7f15c5d9b640 1 --2- 172.21.15.44:0/1164967245 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15c80cd6d0 0x7f15c8161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:36.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.382+0000 7f15c6d9d640 1 --2- 172.21.15.44:0/1164967245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15c80b4880 0x7f15c80b4ca0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009d90 tx=0x7f15c002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e0c608fa534266 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.382+0000 7f15c559a640 1 -- 172.21.15.44:0/1164967245 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c002cc50 con 0x7f15c80b4880 2023-11-04T01:37:36.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.382+0000 7f15c559a640 1 -- 172.21.15.44:0/1164967245 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c002cdb0 con 0x7f15c80b4880 2023-11-04T01:37:36.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.383+0000 7f15c559a640 1 -- 172.21.15.44:0/1164967245 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0034660 con 0x7f15c80b4880 2023-11-04T01:37:36.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.383+0000 7f15cc9b6640 1 -- 172.21.15.44:0/1164967245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15c80b4880 msgr2=0x7f15c80b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.383+0000 7f15cc9b6640 1 --2- 172.21.15.44:0/1164967245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15c80b4880 0x7f15c80b4ca0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009d90 tx=0x7f15c002bea0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.383+0000 7f15cc9b6640 1 -- 172.21.15.44:0/1164967245 shutdown_connections 2023-11-04T01:37:36.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.383+0000 7f15cc9b6640 1 --2- 172.21.15.44:0/1164967245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15c80b4880 0x7f15c80b4ca0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.383+0000 7f15cc9b6640 1 --2- 172.21.15.44:0/1164967245 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15c80cd6d0 0x7f15c8161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.383+0000 7f15cc9b6640 1 -- 172.21.15.44:0/1164967245 >> 172.21.15.44:0/1164967245 conn(0x7f15c80cf880 msgr2=0x7f15c80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:36.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.383+0000 7f15cc9b6640 1 -- 172.21.15.44:0/1164967245 shutdown_connections 2023-11-04T01:37:36.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.383+0000 7f15cc9b6640 1 -- 172.21.15.44:0/1164967245 wait complete. 2023-11-04T01:37:36.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.384+0000 7f15cc9b6640 1 Processor -- start 2023-11-04T01:37:36.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.385+0000 7f15cc9b6640 1 -- start start 2023-11-04T01:37:36.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.385+0000 7f15cc9b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15c80b4880 0x7f15c81530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.385+0000 7f15cc9b6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15c80cd6d0 0x7f15c8159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.385+0000 7f15cc9b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15c8153e60 0x7f15c8159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.385+0000 7f15cc9b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c80c9260 con 0x7f15c8153e60 2023-11-04T01:37:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.385+0000 7f15cc9b6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c8153620 con 0x7f15c80cd6d0 2023-11-04T01:37:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.385+0000 7f15cc9b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c80c85e0 con 0x7f15c80b4880 2023-11-04T01:37:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.385+0000 7f15c6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15c8153e60 0x7f15c8159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.385+0000 7f15c6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15c8153e60 0x7f15c8159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60034/0 (socket says 172.21.15.44:60034) 2023-11-04T01:37:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.385+0000 7f15c6d9d640 1 -- 172.21.15.44:0/2037601183 learned_addr learned my addr 172.21.15.44:0/2037601183 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.386+0000 7f15c5d9b640 1 --2- 172.21.15.44:0/2037601183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15c80cd6d0 0x7f15c8159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.386+0000 7f15c659c640 1 --2- 172.21.15.44:0/2037601183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15c80b4880 0x7f15c81530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.386+0000 7f15c6d9d640 1 -- 172.21.15.44:0/2037601183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15c80b4880 msgr2=0x7f15c81530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.386+0000 7f15c6d9d640 1 --2- 172.21.15.44:0/2037601183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15c80b4880 0x7f15c81530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.386+0000 7f15c6d9d640 1 -- 172.21.15.44:0/2037601183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15c80cd6d0 msgr2=0x7f15c8159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.386+0000 7f15c6d9d640 1 --2- 172.21.15.44:0/2037601183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15c80cd6d0 0x7f15c8159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.386+0000 7f15c6d9d640 1 -- 172.21.15.44:0/2037601183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c0009a70 con 0x7f15c8153e60 2023-11-04T01:37:36.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.386+0000 7f15c6d9d640 1 --2- 172.21.15.44:0/2037601183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15c8153e60 0x7f15c8159f70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009d90 tx=0x7f15c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.386+0000 7f15b6ffd640 1 -- 172.21.15.44:0/2037601183 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0040650 con 0x7f15c8153e60 2023-11-04T01:37:36.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.386+0000 7f15b6ffd640 1 -- 172.21.15.44:0/2037601183 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c00407d0 con 0x7f15c8153e60 2023-11-04T01:37:36.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.386+0000 7f15cc9b6640 1 -- 172.21.15.44:0/2037601183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c80c88c0 con 0x7f15c8153e60 2023-11-04T01:37:36.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.386+0000 7f15b6ffd640 1 -- 172.21.15.44:0/2037601183 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0040b80 con 0x7f15c8153e60 2023-11-04T01:37:36.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.386+0000 7f15cc9b6640 1 -- 172.21.15.44:0/2037601183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c80c8e80 con 0x7f15c8153e60 2023-11-04T01:37:36.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.387+0000 7f15cc9b6640 1 -- 172.21.15.44:0/2037601183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c80c93a0 con 0x7f15c8153e60 2023-11-04T01:37:36.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.388+0000 7f15b6ffd640 1 -- 172.21.15.44:0/2037601183 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15c0040ce0 con 0x7f15c8153e60 2023-11-04T01:37:36.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.388+0000 7f15b6ffd640 1 --2- 172.21.15.44:0/2037601183 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f15a806ae70 0x7f15a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.388+0000 7f15b6ffd640 1 -- 172.21.15.44:0/2037601183 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f15c00ac5e0 con 0x7f15c8153e60 2023-11-04T01:37:36.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.388+0000 7f15c659c640 1 --2- 172.21.15.44:0/2037601183 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f15a806ae70 0x7f15a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.389+0000 7f15c659c640 1 --2- 172.21.15.44:0/2037601183 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f15a806ae70 0x7f15a806d330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f15b8000f60 tx=0x7f15b8007c00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.392+0000 7f15b6ffd640 1 -- 172.21.15.44:0/2037601183 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f15c80c93a0 con 0x7f15c8153e60 2023-11-04T01:37:36.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.570+0000 7f15cc9b6640 1 -- 172.21.15.44:0/2037601183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "snap-test-pool"} v 0) v1 -- 0x7f15c80c93a0 con 0x7f15c8153e60 2023-11-04T01:37:36.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.570+0000 7f15b6ffd640 1 -- 172.21.15.44:0/2037601183 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "snap-test-pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v42) v1 ==== 296+0+0 (secure 0 0 0) 0x7f15c80c93a0 con 0x7f15c8153e60 2023-11-04T01:37:36.572 INFO:teuthology.orchestra.run.smithi044.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:37:36.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:37:36.578 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:37:36.578 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:37:36.632 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:37:36.685 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:37:36.686 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:37:36.686 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:36.703 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:36.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.847+0000 7feabdec9640 1 Processor -- start 2023-11-04T01:37:36.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.848+0000 7feabdec9640 1 -- start start 2023-11-04T01:37:36.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.848+0000 7feabdec9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7feab815ce70 0x7feab806d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.848+0000 7feabdec9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feab815d250 0x7feab80c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.848+0000 7feabdec9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab806a120 con 0x7feab80c9d70 2023-11-04T01:37:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.848+0000 7feabdec9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab80cdc10 con 0x7feab815ce70 2023-11-04T01:37:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.848+0000 7feabdec9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab806def0 con 0x7feab815d250 2023-11-04T01:37:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.848+0000 7feab7fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7feab80c9d70 0x7feab80ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57764/0 (socket says 172.21.15.44:57764) 2023-11-04T01:37:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.848+0000 7feab7fff640 1 -- 172.21.15.44:0/3459945995 learned_addr learned my addr 172.21.15.44:0/3459945995 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab6ffd640 1 --2- 172.21.15.44:0/3459945995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feab815d250 0x7feab80c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab77fe640 1 --2- 172.21.15.44:0/3459945995 >> v2:172.21.15.204:3300/0 conn(0x7feab815ce70 0x7feab806d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 -- 172.21.15.44:0/3459945995 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890437300 0 0) 0x7feab806a120 con 0x7feab80c9d70 2023-11-04T01:37:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 -- 172.21.15.44:0/3459945995 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaa0003520 con 0x7feab80c9d70 2023-11-04T01:37:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 -- 172.21.15.44:0/3459945995 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1488120290 0 0) 0x7feaa0003520 con 0x7feab80c9d70 2023-11-04T01:37:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 -- 172.21.15.44:0/3459945995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feab815d250 msgr2=0x7feab80c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 --2- 172.21.15.44:0/3459945995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feab815d250 0x7feab80c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 -- 172.21.15.44:0/3459945995 >> v2:172.21.15.204:3300/0 conn(0x7feab815ce70 msgr2=0x7feab806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 --2- 172.21.15.44:0/3459945995 >> v2:172.21.15.204:3300/0 conn(0x7feab815ce70 0x7feab806d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 -- 172.21.15.44:0/3459945995 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab806a370 con 0x7feab80c9d70 2023-11-04T01:37:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 -- 172.21.15.44:0/3459945995 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7feab00019f0 con 0x7feab80c9d70 2023-11-04T01:37:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 -- 172.21.15.44:0/3459945995 >> v1:172.21.15.44:6789/0 conn(0x7feab80c9d70 legacy=0x7feab80ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 --2- 172.21.15.44:0/3459945995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feaa0003970 0x7feaa0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 --2- 172.21.15.44:0/3459945995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feab815d250 0x7feaa00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 --2- 172.21.15.44:0/3459945995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa0004d00 0x7feaa0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 -- 172.21.15.44:0/3459945995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab80cdc10 con 0x7feaa0004d00 2023-11-04T01:37:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 -- 172.21.15.44:0/3459945995 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab806def0 con 0x7feaa0003970 2023-11-04T01:37:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab67fc640 1 -- 172.21.15.44:0/3459945995 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa000b980 con 0x7feab815d250 2023-11-04T01:37:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab7fff640 1 --2- 172.21.15.44:0/3459945995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa0004d00 0x7feaa0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab77fe640 1 --2- 172.21.15.44:0/3459945995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feaa0003970 0x7feaa0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.849+0000 7feab6ffd640 1 --2- 172.21.15.44:0/3459945995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feab815d250 0x7feaa00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.850+0000 7feab7fff640 1 -- 172.21.15.44:0/3459945995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feab815d250 msgr2=0x7feaa00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.850+0000 7feab7fff640 1 --2- 172.21.15.44:0/3459945995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feab815d250 0x7feaa00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.850+0000 7feab7fff640 1 -- 172.21.15.44:0/3459945995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feaa0003970 msgr2=0x7feaa0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.850+0000 7feab7fff640 1 --2- 172.21.15.44:0/3459945995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feaa0003970 0x7feaa0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.850+0000 7feab7fff640 1 -- 172.21.15.44:0/3459945995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa0003520 con 0x7feaa0004d00 2023-11-04T01:37:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.850+0000 7feab7fff640 1 --2- 172.21.15.44:0/3459945995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa0004d00 0x7feaa0005180 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7feab000a830 tx=0x7feaa00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4f0dd762f007f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.850+0000 7feab67fc640 1 -- 172.21.15.44:0/3459945995 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab0034630 con 0x7feaa0004d00 2023-11-04T01:37:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.850+0000 7feab67fc640 1 -- 172.21.15.44:0/3459945995 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab002f070 con 0x7feaa0004d00 2023-11-04T01:37:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.850+0000 7feab67fc640 1 -- 172.21.15.44:0/3459945995 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab00349d0 con 0x7feaa0004d00 2023-11-04T01:37:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.851+0000 7feabdec9640 1 -- 172.21.15.44:0/3459945995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa0004d00 msgr2=0x7feaa0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.851+0000 7feabdec9640 1 --2- 172.21.15.44:0/3459945995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa0004d00 0x7feaa0005180 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7feab000a830 tx=0x7feaa00057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.851+0000 7feab7fff640 1 -- 172.21.15.44:0/3459945995 reap_dead start 2023-11-04T01:37:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.851+0000 7feabdec9640 1 -- 172.21.15.44:0/3459945995 shutdown_connections 2023-11-04T01:37:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.851+0000 7feabdec9640 1 -- 172.21.15.44:0/3459945995 >> 172.21.15.44:0/3459945995 conn(0x7feab80b0cd0 msgr2=0x7feab80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.851+0000 7feabdec9640 1 -- 172.21.15.44:0/3459945995 shutdown_connections 2023-11-04T01:37:36.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.851+0000 7feabdec9640 1 -- 172.21.15.44:0/3459945995 wait complete. 2023-11-04T01:37:36.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.852+0000 7feabdec9640 1 Processor -- start 2023-11-04T01:37:36.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.852+0000 7feabdec9640 1 -- start start 2023-11-04T01:37:36.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.853+0000 7feabdec9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feab80c57e0 0x7feab80c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.853+0000 7feabdec9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feab80c71b0 0x7feab8158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.853+0000 7feabdec9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feab8158fd0 0x7feab81443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.853+0000 7feabdec9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab8159460 con 0x7feab80c57e0 2023-11-04T01:37:36.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.853+0000 7feabdec9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab80c7c60 con 0x7feab80c71b0 2023-11-04T01:37:36.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.853+0000 7feabdec9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab80c76a0 con 0x7feab8158fd0 2023-11-04T01:37:36.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.853+0000 7feab77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feab80c57e0 0x7feab80c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.853+0000 7feab77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feab80c57e0 0x7feab80c6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60052/0 (socket says 172.21.15.44:60052) 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.853+0000 7feab77fe640 1 -- 172.21.15.44:0/2806693557 learned_addr learned my addr 172.21.15.44:0/2806693557 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.853+0000 7feab7fff640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feab8158fd0 0x7feab81443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.853+0000 7feab6ffd640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feab80c71b0 0x7feab8158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.854+0000 7feab77fe640 1 -- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feab8158fd0 msgr2=0x7feab81443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.854+0000 7feab77fe640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feab8158fd0 0x7feab81443d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.854+0000 7feab77fe640 1 -- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feab80c71b0 msgr2=0x7feab8158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.854+0000 7feab77fe640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feab80c71b0 0x7feab8158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.854+0000 7feab77fe640 1 -- 172.21.15.44:0/2806693557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab80c7980 con 0x7feab80c57e0 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.854+0000 7feab7fff640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feab8158fd0 0x7feab81443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.854+0000 7feab6ffd640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feab80c71b0 0x7feab8158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.854+0000 7feab77fe640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feab80c57e0 0x7feab80c6c70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7feaa8011960 tx=0x7feaa8011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.854+0000 7fea9ffff640 1 -- 172.21.15.44:0/2806693557 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800faf0 con 0x7feab80c57e0 2023-11-04T01:37:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.854+0000 7fea9ffff640 1 -- 172.21.15.44:0/2806693557 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa800fc50 con 0x7feab80c57e0 2023-11-04T01:37:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.854+0000 7feabdec9640 1 -- 172.21.15.44:0/2806693557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab81424d0 con 0x7feab80c57e0 2023-11-04T01:37:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.854+0000 7fea9ffff640 1 -- 172.21.15.44:0/2806693557 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8014440 con 0x7feab80c57e0 2023-11-04T01:37:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.854+0000 7feabdec9640 1 -- 172.21.15.44:0/2806693557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab80c5bc0 con 0x7feab80c57e0 2023-11-04T01:37:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.855+0000 7feabdec9640 1 -- 172.21.15.44:0/2806693557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab8074290 con 0x7feab80c57e0 2023-11-04T01:37:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.855+0000 7fea9ffff640 1 -- 172.21.15.44:0/2806693557 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feaa801d400 con 0x7feab80c57e0 2023-11-04T01:37:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.856+0000 7fea9ffff640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feaa406ae70 0x7feaa406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.856+0000 7fea9ffff640 1 -- 172.21.15.44:0/2806693557 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7feaa808a0b0 con 0x7feab80c57e0 2023-11-04T01:37:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.856+0000 7feab6ffd640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feaa406ae70 0x7feaa406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.857+0000 7feab6ffd640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feaa406ae70 0x7feaa406d330 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feab80c75d0 tx=0x7feaac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:36.860+0000 7fea9ffff640 1 -- 172.21.15.44:0/2806693557 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feaa8054f10 con 0x7feab80c57e0 2023-11-04T01:37:37.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.038+0000 7feabdec9640 1 -- 172.21.15.44:0/2806693557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feab80cb0a0 con 0x7feab80c57e0 2023-11-04T01:37:37.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.039+0000 7fea9ffff640 1 -- 172.21.15.44:0/2806693557 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18613 (secure 0 0 0) 0x7feaa8058530 con 0x7feab80c57e0 2023-11-04T01:37:37.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:37.042 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":42,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:36.215799+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:19.141183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:20.292111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:37.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.041+0000 7feabdec9640 1 -- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feaa406ae70 msgr2=0x7feaa406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.041+0000 7feabdec9640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feaa406ae70 0x7feaa406d330 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feab80c75d0 tx=0x7feaac008040 comp rx=0 tx=0).stop 2023-11-04T01:37:37.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.041+0000 7feabdec9640 1 -- 172.21.15.44:0/2806693557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feab80c57e0 msgr2=0x7feab80c6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.041+0000 7feabdec9640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feab80c57e0 0x7feab80c6c70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7feaa8011960 tx=0x7feaa8011e20 comp rx=0 tx=0).stop 2023-11-04T01:37:37.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.041+0000 7feabdec9640 1 -- 172.21.15.44:0/2806693557 shutdown_connections 2023-11-04T01:37:37.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.041+0000 7feabdec9640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feaa406ae70 0x7feaa406d330 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.041+0000 7feabdec9640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feab8158fd0 0x7feab81443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.041+0000 7feabdec9640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feab80c71b0 0x7feab8158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.041+0000 7feabdec9640 1 --2- 172.21.15.44:0/2806693557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feab80c57e0 0x7feab80c6c70 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.041+0000 7feabdec9640 1 -- 172.21.15.44:0/2806693557 >> 172.21.15.44:0/2806693557 conn(0x7feab80b0cd0 msgr2=0x7feab80abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.041+0000 7feabdec9640 1 -- 172.21.15.44:0/2806693557 shutdown_connections 2023-11-04T01:37:37.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.041+0000 7feabdec9640 1 -- 172.21.15.44:0/2806693557 wait complete. 2023-11-04T01:37:37.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:37:19.141183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:37:20.292111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:37:37.055 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:37.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.162+0000 7fed5d9cc640 1 Processor -- start 2023-11-04T01:37:37.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.162+0000 7fed5d9cc640 1 -- start start 2023-11-04T01:37:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.163+0000 7fed5d9cc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fed580ca0a0 0x7fed580cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.163+0000 7fed5d9cc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed580cc300 0x7fed580cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.163+0000 7fed5d9cc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed580caa20 con 0x7fed5815e3f0 2023-11-04T01:37:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.163+0000 7fed5d9cc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed580b3300 con 0x7fed580ca0a0 2023-11-04T01:37:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.163+0000 7fed5d9cc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed580cb230 con 0x7fed580cc300 2023-11-04T01:37:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.163+0000 7fed56ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fed5815e3f0 0x7fed580b2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57780/0 (socket says 172.21.15.44:57780) 2023-11-04T01:37:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.163+0000 7fed56ffd640 1 -- 172.21.15.44:0/1325509280 learned_addr learned my addr 172.21.15.44:0/1325509280 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.163+0000 7fed567fc640 1 -- 172.21.15.44:0/1325509280 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988723246 0 0) 0x7fed580caa20 con 0x7fed5815e3f0 2023-11-04T01:37:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.163+0000 7fed567fc640 1 -- 172.21.15.44:0/1325509280 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed44003520 con 0x7fed5815e3f0 2023-11-04T01:37:37.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.163+0000 7fed577fe640 1 --2- 172.21.15.44:0/1325509280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed580cc300 0x7fed580cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.163+0000 7fed4ffff640 1 --2- 172.21.15.44:0/1325509280 >> v2:172.21.15.204:3300/0 conn(0x7fed580ca0a0 0x7fed580cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.163+0000 7fed567fc640 1 -- 172.21.15.44:0/1325509280 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3393150957 0 0) 0x7fed44003520 con 0x7fed5815e3f0 2023-11-04T01:37:37.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.163+0000 7fed567fc640 1 -- 172.21.15.44:0/1325509280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed580cc300 msgr2=0x7fed580cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:37.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.163+0000 7fed567fc640 1 --2- 172.21.15.44:0/1325509280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed580cc300 0x7fed580cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed567fc640 1 -- 172.21.15.44:0/1325509280 >> v2:172.21.15.204:3300/0 conn(0x7fed580ca0a0 msgr2=0x7fed580cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:37.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed567fc640 1 --2- 172.21.15.44:0/1325509280 >> v2:172.21.15.204:3300/0 conn(0x7fed580ca0a0 0x7fed580cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed567fc640 1 -- 172.21.15.44:0/1325509280 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed580ca530 con 0x7fed5815e3f0 2023-11-04T01:37:37.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed567fc640 1 -- 172.21.15.44:0/1325509280 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fed48001670 con 0x7fed5815e3f0 2023-11-04T01:37:37.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed567fc640 1 -- 172.21.15.44:0/1325509280 >> v1:172.21.15.44:6789/0 conn(0x7fed5815e3f0 legacy=0x7fed580b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed567fc640 1 --2- 172.21.15.44:0/1325509280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed44003970 0x7fed44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed567fc640 1 --2- 172.21.15.44:0/1325509280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed580cc300 0x7fed440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed567fc640 1 --2- 172.21.15.44:0/1325509280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed44004d00 0x7fed44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed567fc640 1 -- 172.21.15.44:0/1325509280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed580b3300 con 0x7fed44004d00 2023-11-04T01:37:37.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed567fc640 1 -- 172.21.15.44:0/1325509280 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed580cb230 con 0x7fed44003970 2023-11-04T01:37:37.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed567fc640 1 -- 172.21.15.44:0/1325509280 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4400b980 con 0x7fed580cc300 2023-11-04T01:37:37.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed577fe640 1 --2- 172.21.15.44:0/1325509280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed44004d00 0x7fed44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed56ffd640 1 --2- 172.21.15.44:0/1325509280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed44003970 0x7fed44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed4ffff640 1 --2- 172.21.15.44:0/1325509280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed580cc300 0x7fed440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed577fe640 1 -- 172.21.15.44:0/1325509280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed580cc300 msgr2=0x7fed440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:37.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed577fe640 1 --2- 172.21.15.44:0/1325509280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed580cc300 0x7fed440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed577fe640 1 -- 172.21.15.44:0/1325509280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed44003970 msgr2=0x7fed44003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:37.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed577fe640 1 --2- 172.21.15.44:0/1325509280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed44003970 0x7fed44003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.164+0000 7fed577fe640 1 -- 172.21.15.44:0/1325509280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed44003520 con 0x7fed44004d00 2023-11-04T01:37:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.165+0000 7fed577fe640 1 --2- 172.21.15.44:0/1325509280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed44004d00 0x7fed44005180 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fed580af450 tx=0x7fed440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d55e612cf99004 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.165+0000 7fed567fc640 1 -- 172.21.15.44:0/1325509280 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5002cb90 con 0x7fed44004d00 2023-11-04T01:37:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.165+0000 7fed567fc640 1 -- 172.21.15.44:0/1325509280 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5000f040 con 0x7fed44004d00 2023-11-04T01:37:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.165+0000 7fed567fc640 1 -- 172.21.15.44:0/1325509280 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed50034440 con 0x7fed44004d00 2023-11-04T01:37:37.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.165+0000 7fed5d9cc640 1 -- 172.21.15.44:0/1325509280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed44004d00 msgr2=0x7fed44005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.165+0000 7fed5d9cc640 1 --2- 172.21.15.44:0/1325509280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed44004d00 0x7fed44005180 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fed580af450 tx=0x7fed440057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.165+0000 7fed577fe640 1 -- 172.21.15.44:0/1325509280 reap_dead start 2023-11-04T01:37:37.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.166+0000 7fed5d9cc640 1 -- 172.21.15.44:0/1325509280 shutdown_connections 2023-11-04T01:37:37.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.166+0000 7fed5d9cc640 1 -- 172.21.15.44:0/1325509280 >> 172.21.15.44:0/1325509280 conn(0x7fed58071820 msgr2=0x7fed58071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.166+0000 7fed5d9cc640 1 -- 172.21.15.44:0/1325509280 shutdown_connections 2023-11-04T01:37:37.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.166+0000 7fed5d9cc640 1 -- 172.21.15.44:0/1325509280 wait complete. 2023-11-04T01:37:37.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.167+0000 7fed5d9cc640 1 Processor -- start 2023-11-04T01:37:37.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.167+0000 7fed5d9cc640 1 -- start start 2023-11-04T01:37:37.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.167+0000 7fed5d9cc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed44004d00 0x7fed580abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.167+0000 7fed5d9cc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed580ce7b0 0x7fed580cec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed5d9cc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed581e4330 0x7fed581e47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed5d9cc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed581e3f10 con 0x7fed580ce7b0 2023-11-04T01:37:37.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed5d9cc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed580cf150 con 0x7fed44004d00 2023-11-04T01:37:37.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed5d9cc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5814f3e0 con 0x7fed581e4330 2023-11-04T01:37:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed580ce7b0 0x7fed580cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed580ce7b0 0x7fed580cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60070/0 (socket says 172.21.15.44:60070) 2023-11-04T01:37:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed4ffff640 1 -- 172.21.15.44:0/2165591244 learned_addr learned my addr 172.21.15.44:0/2165591244 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed577fe640 1 --2- 172.21.15.44:0/2165591244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed581e4330 0x7fed581e47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed56ffd640 1 --2- 172.21.15.44:0/2165591244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed44004d00 0x7fed580abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed4ffff640 1 -- 172.21.15.44:0/2165591244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed581e4330 msgr2=0x7fed581e47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed4ffff640 1 --2- 172.21.15.44:0/2165591244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed581e4330 0x7fed581e47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed4ffff640 1 -- 172.21.15.44:0/2165591244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed44004d00 msgr2=0x7fed580abf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed4ffff640 1 --2- 172.21.15.44:0/2165591244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed44004d00 0x7fed580abf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed4ffff640 1 -- 172.21.15.44:0/2165591244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed580cf630 con 0x7fed580ce7b0 2023-11-04T01:37:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed4ffff640 1 --2- 172.21.15.44:0/2165591244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed580ce7b0 0x7fed580cec10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fed40011ad0 tx=0x7fed40011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed54ff9640 1 -- 172.21.15.44:0/2165591244 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed40009680 con 0x7fed580ce7b0 2023-11-04T01:37:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed54ff9640 1 -- 172.21.15.44:0/2165591244 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4000faf0 con 0x7fed580ce7b0 2023-11-04T01:37:37.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed5d9cc640 1 -- 172.21.15.44:0/2165591244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed580ac450 con 0x7fed580ce7b0 2023-11-04T01:37:37.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed54ff9640 1 -- 172.21.15.44:0/2165591244 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4000fe80 con 0x7fed580ce7b0 2023-11-04T01:37:37.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.168+0000 7fed5d9cc640 1 -- 172.21.15.44:0/2165591244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed581e3850 con 0x7fed580ce7b0 2023-11-04T01:37:37.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.169+0000 7fed5d9cc640 1 -- 172.21.15.44:0/2165591244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed581e4050 con 0x7fed580ce7b0 2023-11-04T01:37:37.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.170+0000 7fed54ff9640 1 -- 172.21.15.44:0/2165591244 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed40014440 con 0x7fed580ce7b0 2023-11-04T01:37:37.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.170+0000 7fed54ff9640 1 --2- 172.21.15.44:0/2165591244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fed3806ae70 0x7fed3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.170+0000 7fed54ff9640 1 -- 172.21.15.44:0/2165591244 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fed4008a120 con 0x7fed580ce7b0 2023-11-04T01:37:37.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.171+0000 7fed56ffd640 1 --2- 172.21.15.44:0/2165591244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fed3806ae70 0x7fed3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.171+0000 7fed56ffd640 1 --2- 172.21.15.44:0/2165591244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fed3806ae70 0x7fed3806d330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fed48007d90 tx=0x7fed480078f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.175+0000 7fed54ff9640 1 -- 172.21.15.44:0/2165591244 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fed581e4050 con 0x7fed580ce7b0 2023-11-04T01:37:37.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.352+0000 7fed5d9cc640 1 -- 172.21.15.44:0/2165591244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed58074290 con 0x7fed580ce7b0 2023-11-04T01:37:37.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.352+0000 7fed54ff9640 1 -- 172.21.15.44:0/2165591244 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed40058970 con 0x7fed580ce7b0 2023-11-04T01:37:37.354 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:37:37.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.354+0000 7fed5d9cc640 1 -- 172.21.15.44:0/2165591244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fed3806ae70 msgr2=0x7fed3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.354+0000 7fed5d9cc640 1 --2- 172.21.15.44:0/2165591244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fed3806ae70 0x7fed3806d330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fed48007d90 tx=0x7fed480078f0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.354+0000 7fed5d9cc640 1 -- 172.21.15.44:0/2165591244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed580ce7b0 msgr2=0x7fed580cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.354+0000 7fed5d9cc640 1 --2- 172.21.15.44:0/2165591244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed580ce7b0 0x7fed580cec10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fed40011ad0 tx=0x7fed40011ed0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.354+0000 7fed5d9cc640 1 -- 172.21.15.44:0/2165591244 shutdown_connections 2023-11-04T01:37:37.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.354+0000 7fed5d9cc640 1 --2- 172.21.15.44:0/2165591244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fed3806ae70 0x7fed3806d330 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.355+0000 7fed5d9cc640 1 --2- 172.21.15.44:0/2165591244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed581e4330 0x7fed581e47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.355+0000 7fed5d9cc640 1 --2- 172.21.15.44:0/2165591244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed580ce7b0 0x7fed580cec10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.355+0000 7fed5d9cc640 1 --2- 172.21.15.44:0/2165591244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed44004d00 0x7fed580abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.355+0000 7fed5d9cc640 1 -- 172.21.15.44:0/2165591244 >> 172.21.15.44:0/2165591244 conn(0x7fed58071820 msgr2=0x7fed580b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.355+0000 7fed5d9cc640 1 -- 172.21.15.44:0/2165591244 shutdown_connections 2023-11-04T01:37:37.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.355+0000 7fed5d9cc640 1 -- 172.21.15.44:0/2165591244 wait complete. 2023-11-04T01:37:37.367 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:37.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.476+0000 7f0b65690640 1 Processor -- start 2023-11-04T01:37:37.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.476+0000 7f0b65690640 1 -- start start 2023-11-04T01:37:37.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.477+0000 7f0b65690640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0b600ae1d0 0x7f0b600cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.477+0000 7f0b65690640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6015aff0 con 0x7f0b600c4ff0 2023-11-04T01:37:37.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.477+0000 7f0b65690640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6015a3e0 con 0x7f0b60159c00 2023-11-04T01:37:37.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.477+0000 7f0b65690640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6015a6c0 con 0x7f0b600ae1d0 2023-11-04T01:37:37.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.477+0000 7f0b5f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0b600ae1d0 0x7f0b600cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.477+0000 7f0b57fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0b600c4ff0 0x7f0b600adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57784/0 (socket says 172.21.15.44:57784) 2023-11-04T01:37:37.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.477+0000 7f0b57fff640 1 -- 172.21.15.44:0/4246110664 learned_addr learned my addr 172.21.15.44:0/4246110664 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:37.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.477+0000 7f0b5f7fe640 1 -- 172.21.15.44:0/4246110664 >> v1:172.21.15.204:6789/0 conn(0x7f0b60159c00 legacy=0x7f0b600c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:37.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.477+0000 7f0b5f7fe640 1 -- 172.21.15.44:0/4246110664 >> v1:172.21.15.44:6789/0 conn(0x7f0b600c4ff0 legacy=0x7f0b600adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.477+0000 7f0b5f7fe640 1 -- 172.21.15.44:0/4246110664 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6015a9a0 con 0x7f0b600ae1d0 2023-11-04T01:37:37.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.478+0000 7f0b5f7fe640 1 --2- 172.21.15.44:0/4246110664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b600ae1d0 0x7f0b600cc890 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009d90 tx=0x7f0b5802e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358165adae70287b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.478+0000 7f0b5e7fc640 1 -- 172.21.15.44:0/4246110664 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5802ee70 con 0x7f0b600ae1d0 2023-11-04T01:37:37.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.478+0000 7f0b5e7fc640 1 -- 172.21.15.44:0/4246110664 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b58036440 con 0x7f0b600ae1d0 2023-11-04T01:37:37.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.478+0000 7f0b5e7fc640 1 -- 172.21.15.44:0/4246110664 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580367d0 con 0x7f0b600ae1d0 2023-11-04T01:37:37.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.479+0000 7f0b65690640 1 -- 172.21.15.44:0/4246110664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b600ae1d0 msgr2=0x7f0b600cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.479+0000 7f0b65690640 1 --2- 172.21.15.44:0/4246110664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b600ae1d0 0x7f0b600cc890 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009d90 tx=0x7f0b5802e0c0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.479+0000 7f0b65690640 1 -- 172.21.15.44:0/4246110664 shutdown_connections 2023-11-04T01:37:37.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.479+0000 7f0b65690640 1 --2- 172.21.15.44:0/4246110664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b600ae1d0 0x7f0b600cc890 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.479+0000 7f0b65690640 1 -- 172.21.15.44:0/4246110664 >> 172.21.15.44:0/4246110664 conn(0x7f0b600ce950 msgr2=0x7f0b600ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.479+0000 7f0b65690640 1 -- 172.21.15.44:0/4246110664 shutdown_connections 2023-11-04T01:37:37.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.479+0000 7f0b65690640 1 -- 172.21.15.44:0/4246110664 wait complete. 2023-11-04T01:37:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.480+0000 7f0b65690640 1 Processor -- start 2023-11-04T01:37:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.480+0000 7f0b65690640 1 -- start start 2023-11-04T01:37:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b65690640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b600ae1d0 0x7f0b600c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b65690640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b600c4ff0 0x7f0b60149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b65690640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b60159c00 0x7f0b6014bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b65690640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6014ec20 con 0x7f0b600c4ff0 2023-11-04T01:37:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b65690640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6014ef00 con 0x7f0b600ae1d0 2023-11-04T01:37:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b65690640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6014f1e0 con 0x7f0b60159c00 2023-11-04T01:37:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b600c4ff0 0x7f0b60149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b600c4ff0 0x7f0b60149fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60090/0 (socket says 172.21.15.44:60090) 2023-11-04T01:37:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b57fff640 1 -- 172.21.15.44:0/2224423554 learned_addr learned my addr 172.21.15.44:0/2224423554 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b5effd640 1 --2- 172.21.15.44:0/2224423554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b600ae1d0 0x7f0b600c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b5f7fe640 1 --2- 172.21.15.44:0/2224423554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b60159c00 0x7f0b6014bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b57fff640 1 -- 172.21.15.44:0/2224423554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b60159c00 msgr2=0x7f0b6014bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b57fff640 1 --2- 172.21.15.44:0/2224423554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b60159c00 0x7f0b6014bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b57fff640 1 -- 172.21.15.44:0/2224423554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b600ae1d0 msgr2=0x7f0b600c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b57fff640 1 --2- 172.21.15.44:0/2224423554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b600ae1d0 0x7f0b600c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b57fff640 1 -- 172.21.15.44:0/2224423554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b58009a70 con 0x7f0b600c4ff0 2023-11-04T01:37:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b57fff640 1 --2- 172.21.15.44:0/2224423554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b600c4ff0 0x7f0b60149fe0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800c400 tx=0x7f0b4800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b577fe640 1 -- 172.21.15.44:0/2224423554 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48005ce0 con 0x7f0b600c4ff0 2023-11-04T01:37:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b577fe640 1 -- 172.21.15.44:0/2224423554 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b48005e40 con 0x7f0b600c4ff0 2023-11-04T01:37:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b65690640 1 -- 172.21.15.44:0/2224423554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6014f4c0 con 0x7f0b600c4ff0 2023-11-04T01:37:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.481+0000 7f0b577fe640 1 -- 172.21.15.44:0/2224423554 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b480072f0 con 0x7f0b600c4ff0 2023-11-04T01:37:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.482+0000 7f0b65690640 1 -- 172.21.15.44:0/2224423554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6014e840 con 0x7f0b600c4ff0 2023-11-04T01:37:37.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.483+0000 7f0b65690640 1 -- 172.21.15.44:0/2224423554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6014f9e0 con 0x7f0b600c4ff0 2023-11-04T01:37:37.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.483+0000 7f0b577fe640 1 -- 172.21.15.44:0/2224423554 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b48007510 con 0x7f0b600c4ff0 2023-11-04T01:37:37.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.483+0000 7f0b577fe640 1 --2- 172.21.15.44:0/2224423554 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0b4006ae70 0x7f0b4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.483+0000 7f0b577fe640 1 -- 172.21.15.44:0/2224423554 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f0b48088ee0 con 0x7f0b600c4ff0 2023-11-04T01:37:37.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.484+0000 7f0b5effd640 1 --2- 172.21.15.44:0/2224423554 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0b4006ae70 0x7f0b4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.484+0000 7f0b5effd640 1 --2- 172.21.15.44:0/2224423554 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0b4006ae70 0x7f0b4006d330 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0b50006fd0 tx=0x7f0b50008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.487+0000 7f0b577fe640 1 -- 172.21.15.44:0/2224423554 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b6014f9e0 con 0x7f0b600c4ff0 2023-11-04T01:37:37.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.661+0000 7f0b65690640 1 -- 172.21.15.44:0/2224423554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b6014f9e0 con 0x7f0b600c4ff0 2023-11-04T01:37:37.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.662+0000 7f0b577fe640 1 -- 172.21.15.44:0/2224423554 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0b6014f9e0 con 0x7f0b600c4ff0 2023-11-04T01:37:37.664 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:37:37.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.664+0000 7f0b65690640 1 -- 172.21.15.44:0/2224423554 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0b4006ae70 msgr2=0x7f0b4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.664+0000 7f0b65690640 1 --2- 172.21.15.44:0/2224423554 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0b4006ae70 0x7f0b4006d330 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0b50006fd0 tx=0x7f0b50008040 comp rx=0 tx=0).stop 2023-11-04T01:37:37.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.664+0000 7f0b65690640 1 -- 172.21.15.44:0/2224423554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b600c4ff0 msgr2=0x7f0b60149fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.664+0000 7f0b65690640 1 --2- 172.21.15.44:0/2224423554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b600c4ff0 0x7f0b60149fe0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800c400 tx=0x7f0b4800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.664+0000 7f0b65690640 1 -- 172.21.15.44:0/2224423554 shutdown_connections 2023-11-04T01:37:37.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.664+0000 7f0b65690640 1 --2- 172.21.15.44:0/2224423554 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0b4006ae70 0x7f0b4006d330 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.664+0000 7f0b65690640 1 --2- 172.21.15.44:0/2224423554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b60159c00 0x7f0b6014bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.664+0000 7f0b65690640 1 --2- 172.21.15.44:0/2224423554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b600c4ff0 0x7f0b60149fe0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.664+0000 7f0b65690640 1 --2- 172.21.15.44:0/2224423554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b600ae1d0 0x7f0b600c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.664+0000 7f0b65690640 1 -- 172.21.15.44:0/2224423554 >> 172.21.15.44:0/2224423554 conn(0x7f0b600ce950 msgr2=0x7f0b600c44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.664+0000 7f0b65690640 1 -- 172.21.15.44:0/2224423554 shutdown_connections 2023-11-04T01:37:37.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.664+0000 7f0b65690640 1 -- 172.21.15.44:0/2224423554 wait complete. 2023-11-04T01:37:37.677 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:37.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.784+0000 7f4978e2b640 1 Processor -- start 2023-11-04T01:37:37.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.784+0000 7f4978e2b640 1 -- start start 2023-11-04T01:37:37.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4978e2b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4974160430 0x7f49740b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4978e2b640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49740b2fc0 con 0x7f49740b2b60 2023-11-04T01:37:37.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4978e2b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497406c7d0 con 0x7f497406c3a0 2023-11-04T01:37:37.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4978e2b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49740cb580 con 0x7f4974160430 2023-11-04T01:37:37.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f496bfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f49740b2b60 0x7f497406bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57800/0 (socket says 172.21.15.44:57800) 2023-11-04T01:37:37.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f496bfff640 1 -- 172.21.15.44:0/2163380799 learned_addr learned my addr 172.21.15.44:0/2163380799 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:37.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f497259c640 1 --2- 172.21.15.44:0/2163380799 >> v2:172.21.15.204:3300/0 conn(0x7f4974160430 0x7f49740b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178160284 0 0) 0x7f49740b2fc0 con 0x7f49740b2b60 2023-11-04T01:37:37.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4960003520 con 0x7f49740b2b60 2023-11-04T01:37:37.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260816283 0 0) 0x7f497406c7d0 con 0x7f497406c3a0 2023-11-04T01:37:37.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49740b2fc0 con 0x7f497406c3a0 2023-11-04T01:37:37.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 33080255 0 0) 0x7f4960003520 con 0x7f49740b2b60 2023-11-04T01:37:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 >> v2:172.21.15.204:3300/0 conn(0x7f4974160430 msgr2=0x7f49740b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4971d9b640 1 --2- 172.21.15.44:0/2163380799 >> v2:172.21.15.204:3300/0 conn(0x7f4974160430 0x7f49740b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 >> v1:172.21.15.204:6789/0 conn(0x7f497406c3a0 legacy=0x7f49740cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497406ca40 con 0x7f49740b2b60 2023-11-04T01:37:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f495c001670 con 0x7f49740b2b60 2023-11-04T01:37:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f497259c640 1 --2- 172.21.15.44:0/2163380799 >> v2:172.21.15.204:3300/0 conn(0x7f4974160430 0x7f49740b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 >> v1:172.21.15.44:6789/0 conn(0x7f49740b2b60 legacy=0x7f497406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.785+0000 7f4971d9b640 1 --2- 172.21.15.44:0/2163380799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4960003b00 0x7f4960003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.786+0000 7f4971d9b640 1 --2- 172.21.15.44:0/2163380799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49600047c0 0x7f4960004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.786+0000 7f4971d9b640 1 --2- 172.21.15.44:0/2163380799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4960005180 0x7f496000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.786+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49740cb580 con 0x7f4960003b00 2023-11-04T01:37:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.786+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496000c000 con 0x7f49600047c0 2023-11-04T01:37:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.786+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496000c1c0 con 0x7f4960005180 2023-11-04T01:37:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.786+0000 7f497259c640 1 --2- 172.21.15.44:0/2163380799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4960003b00 0x7f4960003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.786+0000 7f496bfff640 1 --2- 172.21.15.44:0/2163380799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49600047c0 0x7f4960004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.786+0000 7f4972d9d640 1 --2- 172.21.15.44:0/2163380799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4960005180 0x7f496000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.786+0000 7f497259c640 1 -- 172.21.15.44:0/2163380799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4960005180 msgr2=0x7f496000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.786+0000 7f497259c640 1 --2- 172.21.15.44:0/2163380799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4960005180 0x7f496000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.786+0000 7f497259c640 1 -- 172.21.15.44:0/2163380799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49600047c0 msgr2=0x7f4960004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.786+0000 7f497259c640 1 --2- 172.21.15.44:0/2163380799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49600047c0 0x7f4960004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.786+0000 7f497259c640 1 -- 172.21.15.44:0/2163380799 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4960003520 con 0x7f4960003b00 2023-11-04T01:37:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.786+0000 7f4972d9d640 1 -- 172.21.15.44:0/2163380799 reap_dead start 2023-11-04T01:37:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.787+0000 7f497259c640 1 --2- 172.21.15.44:0/2163380799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4960003b00 0x7f4960003f00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4964009c90 tx=0x7f49600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7cca932bbc6a10 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.787+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496402c8f0 con 0x7f4960003b00 2023-11-04T01:37:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.787+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496402ca50 con 0x7f4960003b00 2023-11-04T01:37:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.787+0000 7f4971d9b640 1 -- 172.21.15.44:0/2163380799 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496402ce40 con 0x7f4960003b00 2023-11-04T01:37:37.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.787+0000 7f4978e2b640 1 -- 172.21.15.44:0/2163380799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4960003b00 msgr2=0x7f4960003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.787+0000 7f4978e2b640 1 --2- 172.21.15.44:0/2163380799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4960003b00 0x7f4960003f00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4964009c90 tx=0x7f49600057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.787+0000 7f4978e2b640 1 -- 172.21.15.44:0/2163380799 shutdown_connections 2023-11-04T01:37:37.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.787+0000 7f4978e2b640 1 --2- 172.21.15.44:0/2163380799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4960003b00 0x7f4960003f00 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.787+0000 7f4978e2b640 1 -- 172.21.15.44:0/2163380799 >> 172.21.15.44:0/2163380799 conn(0x7f497406ea20 msgr2=0x7f497406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.787+0000 7f4978e2b640 1 -- 172.21.15.44:0/2163380799 shutdown_connections 2023-11-04T01:37:37.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.787+0000 7f4978e2b640 1 -- 172.21.15.44:0/2163380799 wait complete. 2023-11-04T01:37:37.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.789+0000 7f4978e2b640 1 Processor -- start 2023-11-04T01:37:37.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.789+0000 7f4978e2b640 1 -- start start 2023-11-04T01:37:37.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.789+0000 7f4978e2b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4960003b00 0x7f49740b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.789+0000 7f4978e2b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4974157dc0 0x7f49741f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.789+0000 7f4978e2b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49740b37c0 0x7f49741f68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.789+0000 7f4978e2b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49741550c0 con 0x7f49740b37c0 2023-11-04T01:37:37.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.789+0000 7f4978e2b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4974155920 con 0x7f4974157dc0 2023-11-04T01:37:37.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.789+0000 7f4978e2b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49740b4f70 con 0x7f4960003b00 2023-11-04T01:37:37.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f4972d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49740b37c0 0x7f49741f68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f4972d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49740b37c0 0x7f49741f68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60106/0 (socket says 172.21.15.44:60106) 2023-11-04T01:37:37.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f4972d9d640 1 -- 172.21.15.44:0/2893272244 learned_addr learned my addr 172.21.15.44:0/2893272244 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:37.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f496bfff640 1 --2- 172.21.15.44:0/2893272244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4974157dc0 0x7f49741f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f497259c640 1 --2- 172.21.15.44:0/2893272244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4960003b00 0x7f49740b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f4972d9d640 1 -- 172.21.15.44:0/2893272244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4960003b00 msgr2=0x7f49740b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f4972d9d640 1 --2- 172.21.15.44:0/2893272244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4960003b00 0x7f49740b46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f4972d9d640 1 -- 172.21.15.44:0/2893272244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4974157dc0 msgr2=0x7f49741f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f4972d9d640 1 --2- 172.21.15.44:0/2893272244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4974157dc0 0x7f49741f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f4972d9d640 1 -- 172.21.15.44:0/2893272244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49741552d0 con 0x7f49740b37c0 2023-11-04T01:37:37.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f497259c640 1 --2- 172.21.15.44:0/2893272244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4960003b00 0x7f49740b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f4972d9d640 1 --2- 172.21.15.44:0/2893272244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49740b37c0 0x7f49741f68c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f49740d06a0 tx=0x7f496c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f496affd640 1 -- 172.21.15.44:0/2893272244 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c00ee50 con 0x7f49740b37c0 2023-11-04T01:37:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f496affd640 1 -- 172.21.15.44:0/2893272244 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c003b80 con 0x7f49740b37c0 2023-11-04T01:37:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f4978e2b640 1 -- 172.21.15.44:0/2893272244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49741555b0 con 0x7f49740b37c0 2023-11-04T01:37:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f496affd640 1 -- 172.21.15.44:0/2893272244 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c0050d0 con 0x7f49740b37c0 2023-11-04T01:37:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.790+0000 7f4978e2b640 1 -- 172.21.15.44:0/2893272244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49740b4bf0 con 0x7f49740b37c0 2023-11-04T01:37:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.791+0000 7f4978e2b640 1 -- 172.21.15.44:0/2893272244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4974074290 con 0x7f49740b37c0 2023-11-04T01:37:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.792+0000 7f496affd640 1 -- 172.21.15.44:0/2893272244 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f496c005230 con 0x7f49740b37c0 2023-11-04T01:37:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.792+0000 7f496affd640 1 --2- 172.21.15.44:0/2893272244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f495406aea0 0x7f495406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.792+0000 7f496affd640 1 -- 172.21.15.44:0/2893272244 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f496c089600 con 0x7f49740b37c0 2023-11-04T01:37:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.792+0000 7f497259c640 1 --2- 172.21.15.44:0/2893272244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f495406aea0 0x7f495406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.793+0000 7f497259c640 1 --2- 172.21.15.44:0/2893272244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f495406aea0 0x7f495406d360 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4964036000 tx=0x7f4964030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.797+0000 7f496affd640 1 -- 172.21.15.44:0/2893272244 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f496c054460 con 0x7f49740b37c0 2023-11-04T01:37:37.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.973+0000 7f4978e2b640 1 -- 172.21.15.44:0/2893272244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49740cb760 con 0x7f49740b37c0 2023-11-04T01:37:37.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.974+0000 7f496affd640 1 -- 172.21.15.44:0/2893272244 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f496c057a80 con 0x7f49740b37c0 2023-11-04T01:37:37.976 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:37:37.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.976+0000 7f4978e2b640 1 -- 172.21.15.44:0/2893272244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f495406aea0 msgr2=0x7f495406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.976+0000 7f4978e2b640 1 --2- 172.21.15.44:0/2893272244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f495406aea0 0x7f495406d360 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4964036000 tx=0x7f4964030000 comp rx=0 tx=0).stop 2023-11-04T01:37:37.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.976+0000 7f4978e2b640 1 -- 172.21.15.44:0/2893272244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49740b37c0 msgr2=0x7f49741f68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.976+0000 7f4978e2b640 1 --2- 172.21.15.44:0/2893272244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49740b37c0 0x7f49741f68c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f49740d06a0 tx=0x7f496c00ec00 comp rx=0 tx=0).stop 2023-11-04T01:37:37.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.976+0000 7f4978e2b640 1 -- 172.21.15.44:0/2893272244 shutdown_connections 2023-11-04T01:37:37.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.976+0000 7f4978e2b640 1 --2- 172.21.15.44:0/2893272244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f495406aea0 0x7f495406d360 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.976+0000 7f4978e2b640 1 --2- 172.21.15.44:0/2893272244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49740b37c0 0x7f49741f68c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.976+0000 7f4978e2b640 1 --2- 172.21.15.44:0/2893272244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4974157dc0 0x7f49741f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.976+0000 7f4978e2b640 1 --2- 172.21.15.44:0/2893272244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4960003b00 0x7f49740b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.976+0000 7f4978e2b640 1 -- 172.21.15.44:0/2893272244 >> 172.21.15.44:0/2893272244 conn(0x7f497406ea20 msgr2=0x7f497415f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.976+0000 7f4978e2b640 1 -- 172.21.15.44:0/2893272244 shutdown_connections 2023-11-04T01:37:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:37.976+0000 7f4978e2b640 1 -- 172.21.15.44:0/2893272244 wait complete. 2023-11-04T01:37:37.988 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:37:38.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.095+0000 7ff0a58d4640 1 Processor -- start 2023-11-04T01:37:38.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.095+0000 7ff0a58d4640 1 -- start start 2023-11-04T01:37:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.096+0000 7ff0a58d4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0a015ccc0 0x7ff0a00b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.096+0000 7ff0a58d4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff0a00cdd90 0x7ff0a00b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.096+0000 7ff0a58d4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a0160df0 con 0x7ff0a015d0a0 2023-11-04T01:37:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.096+0000 7ff0a58d4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a00ce260 con 0x7ff0a00cdd90 2023-11-04T01:37:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.096+0000 7ff0a58d4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a00ce540 con 0x7ff0a015ccc0 2023-11-04T01:37:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.096+0000 7ff09e7fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff0a015d0a0 0x7ff0a00cd680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57812/0 (socket says 172.21.15.44:57812) 2023-11-04T01:37:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.096+0000 7ff09e7fc640 1 -- 172.21.15.44:0/137320342 learned_addr learned my addr 172.21.15.44:0/137320342 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.097+0000 7ff09effd640 1 --2- 172.21.15.44:0/137320342 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0a015ccc0 0x7ff0a00b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.097+0000 7ff09f7fe640 1 --2- 172.21.15.44:0/137320342 >> v2:172.21.15.204:3300/0 conn(0x7ff0a00cdd90 0x7ff0a00b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.097+0000 7ff09dffb640 1 -- 172.21.15.44:0/137320342 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919684799 0 0) 0x7ff094001110 con 0x7ff0a015d0a0 2023-11-04T01:37:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.097+0000 7ff09dffb640 1 -- 172.21.15.44:0/137320342 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff088003520 con 0x7ff0a015d0a0 2023-11-04T01:37:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.097+0000 7ff09f7fe640 1 -- 172.21.15.44:0/137320342 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0a015ccc0 msgr2=0x7ff0a00b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.097+0000 7ff09f7fe640 1 --2- 172.21.15.44:0/137320342 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0a015ccc0 0x7ff0a00b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.097+0000 7ff09dffb640 1 -- 172.21.15.44:0/137320342 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 105431980 0 0) 0x7ff088003520 con 0x7ff0a015d0a0 2023-11-04T01:37:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.097+0000 7ff09f7fe640 1 -- 172.21.15.44:0/137320342 >> v1:172.21.15.44:6789/0 conn(0x7ff0a015d0a0 legacy=0x7ff0a00cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.097+0000 7ff09f7fe640 1 -- 172.21.15.44:0/137320342 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a00d1050 con 0x7ff0a00cdd90 2023-11-04T01:37:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.097+0000 7ff09effd640 1 --2- 172.21.15.44:0/137320342 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0a015ccc0 0x7ff0a00b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.098+0000 7ff09f7fe640 1 --2- 172.21.15.44:0/137320342 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0a00cdd90 0x7ff0a00b4de0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff090009d90 tx=0x7ff09002bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13ca8b305dc66379 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.098+0000 7ff09dffb640 1 -- 172.21.15.44:0/137320342 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff094001800 con 0x7ff0a00cdd90 2023-11-04T01:37:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.098+0000 7ff09dffb640 1 -- 172.21.15.44:0/137320342 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09002c8a0 con 0x7ff0a00cdd90 2023-11-04T01:37:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.098+0000 7ff09dffb640 1 -- 172.21.15.44:0/137320342 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09002cc10 con 0x7ff0a00cdd90 2023-11-04T01:37:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.098+0000 7ff0a58d4640 1 -- 172.21.15.44:0/137320342 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0a00cdd90 msgr2=0x7ff0a00b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.098+0000 7ff0a58d4640 1 --2- 172.21.15.44:0/137320342 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0a00cdd90 0x7ff0a00b4de0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff090009d90 tx=0x7ff09002bd70 comp rx=0 tx=0).stop 2023-11-04T01:37:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.098+0000 7ff0a58d4640 1 -- 172.21.15.44:0/137320342 shutdown_connections 2023-11-04T01:37:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.098+0000 7ff0a58d4640 1 --2- 172.21.15.44:0/137320342 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0a00cdd90 0x7ff0a00b4de0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.098+0000 7ff0a58d4640 1 --2- 172.21.15.44:0/137320342 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0a015ccc0 0x7ff0a00b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.098+0000 7ff0a58d4640 1 -- 172.21.15.44:0/137320342 >> 172.21.15.44:0/137320342 conn(0x7ff0a00cf8a0 msgr2=0x7ff0a00cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.099+0000 7ff0a58d4640 1 -- 172.21.15.44:0/137320342 shutdown_connections 2023-11-04T01:37:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.099+0000 7ff0a58d4640 1 -- 172.21.15.44:0/137320342 wait complete. 2023-11-04T01:37:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.100+0000 7ff0a58d4640 1 Processor -- start 2023-11-04T01:37:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.100+0000 7ff0a58d4640 1 -- start start 2023-11-04T01:37:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff0a58d4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0a00cdd90 0x7ff0a015adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff0a58d4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0a015ccc0 0x7ff0a014e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff0a58d4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0a015d0a0 0x7ff0a014e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff0a58d4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a014eb10 con 0x7ff0a015ccc0 2023-11-04T01:37:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff0a58d4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0151c60 con 0x7ff0a00cdd90 2023-11-04T01:37:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff0a58d4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0151eb0 con 0x7ff0a015d0a0 2023-11-04T01:37:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff09e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0a015ccc0 0x7ff0a014e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff09e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0a015ccc0 0x7ff0a014e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60116/0 (socket says 172.21.15.44:60116) 2023-11-04T01:37:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff09e7fc640 1 -- 172.21.15.44:0/3184322137 learned_addr learned my addr 172.21.15.44:0/3184322137 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff09f7fe640 1 --2- 172.21.15.44:0/3184322137 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0a015d0a0 0x7ff0a014e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff09effd640 1 --2- 172.21.15.44:0/3184322137 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0a00cdd90 0x7ff0a015adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff09e7fc640 1 -- 172.21.15.44:0/3184322137 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0a015d0a0 msgr2=0x7ff0a014e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff09e7fc640 1 --2- 172.21.15.44:0/3184322137 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0a015d0a0 0x7ff0a014e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff09e7fc640 1 -- 172.21.15.44:0/3184322137 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0a00cdd90 msgr2=0x7ff0a015adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff09e7fc640 1 --2- 172.21.15.44:0/3184322137 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0a00cdd90 0x7ff0a015adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff09e7fc640 1 -- 172.21.15.44:0/3184322137 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff098009400 con 0x7ff0a015ccc0 2023-11-04T01:37:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff09e7fc640 1 --2- 172.21.15.44:0/3184322137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0a015ccc0 0x7ff0a014e090 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff09400c750 tx=0x7ff09400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff087fff640 1 -- 172.21.15.44:0/3184322137 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff094005ad0 con 0x7ff0a015ccc0 2023-11-04T01:37:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff087fff640 1 -- 172.21.15.44:0/3184322137 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff094005c30 con 0x7ff0a015ccc0 2023-11-04T01:37:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff0a58d4640 1 -- 172.21.15.44:0/3184322137 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff090009a70 con 0x7ff0a015ccc0 2023-11-04T01:37:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff087fff640 1 -- 172.21.15.44:0/3184322137 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff094007070 con 0x7ff0a015ccc0 2023-11-04T01:37:38.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.101+0000 7ff0a58d4640 1 -- 172.21.15.44:0/3184322137 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a0152470 con 0x7ff0a015ccc0 2023-11-04T01:37:38.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.102+0000 7ff0a58d4640 1 -- 172.21.15.44:0/3184322137 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a00674e0 con 0x7ff0a015ccc0 2023-11-04T01:37:38.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.103+0000 7ff087fff640 1 -- 172.21.15.44:0/3184322137 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff0940071d0 con 0x7ff0a015ccc0 2023-11-04T01:37:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.103+0000 7ff087fff640 1 --2- 172.21.15.44:0/3184322137 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff08c06ae70 0x7ff08c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.103+0000 7ff087fff640 1 -- 172.21.15.44:0/3184322137 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7ff0940893f0 con 0x7ff0a015ccc0 2023-11-04T01:37:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.103+0000 7ff09effd640 1 --2- 172.21.15.44:0/3184322137 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff08c06ae70 0x7ff08c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.104+0000 7ff09effd640 1 --2- 172.21.15.44:0/3184322137 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff08c06ae70 0x7ff08c06d330 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00c6850 tx=0x7ff098008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.107+0000 7ff087fff640 1 -- 172.21.15.44:0/3184322137 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff094054250 con 0x7ff0a015ccc0 2023-11-04T01:37:38.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.283+0000 7ff0a58d4640 1 -- 172.21.15.44:0/3184322137 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7ff0a0160df0 con 0x7ff0a015ccc0 2023-11-04T01:37:38.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.284+0000 7ff087fff640 1 -- 172.21.15.44:0/3184322137 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v42) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff0a0160df0 con 0x7ff0a015ccc0 2023-11-04T01:37:38.286 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:37:38.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.285+0000 7ff0a58d4640 1 -- 172.21.15.44:0/3184322137 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff08c06ae70 msgr2=0x7ff08c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.285+0000 7ff0a58d4640 1 --2- 172.21.15.44:0/3184322137 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff08c06ae70 0x7ff08c06d330 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00c6850 tx=0x7ff098008040 comp rx=0 tx=0).stop 2023-11-04T01:37:38.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.285+0000 7ff0a58d4640 1 -- 172.21.15.44:0/3184322137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0a015ccc0 msgr2=0x7ff0a014e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.285+0000 7ff0a58d4640 1 --2- 172.21.15.44:0/3184322137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0a015ccc0 0x7ff0a014e090 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff09400c750 tx=0x7ff09400cc10 comp rx=0 tx=0).stop 2023-11-04T01:37:38.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.286+0000 7ff0a58d4640 1 -- 172.21.15.44:0/3184322137 shutdown_connections 2023-11-04T01:37:38.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.286+0000 7ff0a58d4640 1 --2- 172.21.15.44:0/3184322137 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff08c06ae70 0x7ff08c06d330 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.286+0000 7ff0a58d4640 1 --2- 172.21.15.44:0/3184322137 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0a015d0a0 0x7ff0a014e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.286+0000 7ff0a58d4640 1 --2- 172.21.15.44:0/3184322137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0a015ccc0 0x7ff0a014e090 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.286+0000 7ff0a58d4640 1 --2- 172.21.15.44:0/3184322137 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0a00cdd90 0x7ff0a015adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.286+0000 7ff0a58d4640 1 -- 172.21.15.44:0/3184322137 >> 172.21.15.44:0/3184322137 conn(0x7ff0a00cf8a0 msgr2=0x7ff0a014f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.286+0000 7ff0a58d4640 1 -- 172.21.15.44:0/3184322137 shutdown_connections 2023-11-04T01:37:38.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.286+0000 7ff0a58d4640 1 -- 172.21.15.44:0/3184322137 wait complete. 2023-11-04T01:37:38.299 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:37:38.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.404+0000 7f50a5c34640 1 Processor -- start 2023-11-04T01:37:38.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.404+0000 7f50a5c34640 1 -- start start 2023-11-04T01:37:38.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.405+0000 7f50a5c34640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50a015af20 0x7f50a00b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.405+0000 7f50a5c34640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f50a00b64c0 0x7f50a00cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.405+0000 7f50a5c34640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a00d01f0 con 0x7f50a00cd3b0 2023-11-04T01:37:38.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.405+0000 7f50a5c34640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a00b6a40 con 0x7f50a00b64c0 2023-11-04T01:37:38.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.405+0000 7f50a5c34640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a00d04b0 con 0x7f50a015af20 2023-11-04T01:37:38.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.405+0000 7f509effd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f50a00b64c0 0x7f50a00cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.405+0000 7f509ffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f50a00cd3b0 0x7f50a00b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57816/0 (socket says 172.21.15.44:57816) 2023-11-04T01:37:38.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.405+0000 7f509ffff640 1 -- 172.21.15.44:0/4084089964 learned_addr learned my addr 172.21.15.44:0/4084089964 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:38.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.405+0000 7f509f7fe640 1 --2- 172.21.15.44:0/4084089964 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50a015af20 0x7f50a00b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.406+0000 7f509effd640 1 -- 172.21.15.44:0/4084089964 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50a015af20 msgr2=0x7f50a00b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.406+0000 7f509effd640 1 --2- 172.21.15.44:0/4084089964 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50a015af20 0x7f50a00b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.406+0000 7f509effd640 1 -- 172.21.15.44:0/4084089964 >> v1:172.21.15.44:6789/0 conn(0x7f50a00cd3b0 legacy=0x7f50a00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.406+0000 7f509effd640 1 -- 172.21.15.44:0/4084089964 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a00d0790 con 0x7f50a00b64c0 2023-11-04T01:37:38.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.406+0000 7f509e7fc640 1 -- 172.21.15.44:0/4084089964 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819847139 0 0) 0x7f50a00d01f0 con 0x7f50a00cd3b0 2023-11-04T01:37:38.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.406+0000 7f509effd640 1 --2- 172.21.15.44:0/4084089964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50a00b64c0 0x7f50a00cbc70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f50900097a0 tx=0x7f509002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4014dbab350663 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.407+0000 7f509e7fc640 1 -- 172.21.15.44:0/4084089964 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090031830 con 0x7f50a00b64c0 2023-11-04T01:37:38.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.407+0000 7f509e7fc640 1 -- 172.21.15.44:0/4084089964 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090031990 con 0x7f50a00b64c0 2023-11-04T01:37:38.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.407+0000 7f509e7fc640 1 -- 172.21.15.44:0/4084089964 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090031d20 con 0x7f50a00b64c0 2023-11-04T01:37:38.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.407+0000 7f50a5c34640 1 -- 172.21.15.44:0/4084089964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50a00b64c0 msgr2=0x7f50a00cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.407+0000 7f50a5c34640 1 --2- 172.21.15.44:0/4084089964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50a00b64c0 0x7f50a00cbc70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f50900097a0 tx=0x7f509002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.407+0000 7f50a5c34640 1 -- 172.21.15.44:0/4084089964 shutdown_connections 2023-11-04T01:37:38.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.407+0000 7f50a5c34640 1 --2- 172.21.15.44:0/4084089964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50a00b64c0 0x7f50a00cbc70 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.407+0000 7f50a5c34640 1 --2- 172.21.15.44:0/4084089964 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50a015af20 0x7f50a00b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.407+0000 7f50a5c34640 1 -- 172.21.15.44:0/4084089964 >> 172.21.15.44:0/4084089964 conn(0x7f50a006ea20 msgr2=0x7f50a006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.407+0000 7f50a5c34640 1 -- 172.21.15.44:0/4084089964 shutdown_connections 2023-11-04T01:37:38.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.407+0000 7f50a5c34640 1 -- 172.21.15.44:0/4084089964 wait complete. 2023-11-04T01:37:38.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.408+0000 7f50a5c34640 1 Processor -- start 2023-11-04T01:37:38.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.409+0000 7f50a5c34640 1 -- start start 2023-11-04T01:37:38.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.409+0000 7f50a5c34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50a00b64c0 0x7f50a01f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.409+0000 7f50a5c34640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50a00cd3b0 0x7f50a006b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.409+0000 7f50a5c34640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50a015af20 0x7f50a00b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.409+0000 7f50a5c34640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a006ccb0 con 0x7f50a00b64c0 2023-11-04T01:37:38.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.409+0000 7f50a5c34640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a01f2380 con 0x7f50a00cd3b0 2023-11-04T01:37:38.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.409+0000 7f50a5c34640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a006c0a0 con 0x7f50a015af20 2023-11-04T01:37:38.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.409+0000 7f509f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50a00b64c0 0x7f50a01f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.409+0000 7f509f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50a00b64c0 0x7f50a01f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60122/0 (socket says 172.21.15.44:60122) 2023-11-04T01:37:38.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.409+0000 7f509f7fe640 1 -- 172.21.15.44:0/1739597290 learned_addr learned my addr 172.21.15.44:0/1739597290 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:38.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.410+0000 7f509ffff640 1 --2- 172.21.15.44:0/1739597290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50a015af20 0x7f50a00b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.410+0000 7f509effd640 1 --2- 172.21.15.44:0/1739597290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50a00cd3b0 0x7f50a006b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.410+0000 7f509f7fe640 1 -- 172.21.15.44:0/1739597290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50a015af20 msgr2=0x7f50a00b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.410+0000 7f509f7fe640 1 --2- 172.21.15.44:0/1739597290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50a015af20 0x7f50a00b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.410+0000 7f509f7fe640 1 -- 172.21.15.44:0/1739597290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50a00cd3b0 msgr2=0x7f50a006b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.410+0000 7f509f7fe640 1 --2- 172.21.15.44:0/1739597290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50a00cd3b0 0x7f50a006b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.410+0000 7f509f7fe640 1 -- 172.21.15.44:0/1739597290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5090009400 con 0x7f50a00b64c0 2023-11-04T01:37:38.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.410+0000 7f509ffff640 1 --2- 172.21.15.44:0/1739597290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50a015af20 0x7f50a00b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:38.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.410+0000 7f509f7fe640 1 --2- 172.21.15.44:0/1739597290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50a00b64c0 0x7f50a01f1e40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f509400e8a0 tx=0x7f509400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.410+0000 7f5087fff640 1 -- 172.21.15.44:0/1739597290 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50940094f0 con 0x7f50a00b64c0 2023-11-04T01:37:38.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.410+0000 7f5087fff640 1 -- 172.21.15.44:0/1739597290 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509400c940 con 0x7f50a00b64c0 2023-11-04T01:37:38.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.410+0000 7f50a5c34640 1 -- 172.21.15.44:0/1739597290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a006c380 con 0x7f50a00b64c0 2023-11-04T01:37:38.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.410+0000 7f5087fff640 1 -- 172.21.15.44:0/1739597290 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509400ccf0 con 0x7f50a00b64c0 2023-11-04T01:37:38.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.410+0000 7f50a5c34640 1 -- 172.21.15.44:0/1739597290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a006c940 con 0x7f50a00b64c0 2023-11-04T01:37:38.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.411+0000 7f50a5c34640 1 -- 172.21.15.44:0/1739597290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a015a010 con 0x7f50a00b64c0 2023-11-04T01:37:38.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.412+0000 7f5087fff640 1 -- 172.21.15.44:0/1739597290 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5094013470 con 0x7f50a00b64c0 2023-11-04T01:37:38.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.412+0000 7f5087fff640 1 --2- 172.21.15.44:0/1739597290 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f508c06ae70 0x7f508c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.412+0000 7f5087fff640 1 -- 172.21.15.44:0/1739597290 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f5094089990 con 0x7f50a00b64c0 2023-11-04T01:37:38.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.412+0000 7f509effd640 1 --2- 172.21.15.44:0/1739597290 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f508c06ae70 0x7f508c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.413+0000 7f509effd640 1 --2- 172.21.15.44:0/1739597290 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f508c06ae70 0x7f508c06d330 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5090036000 tx=0x7f509003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.416+0000 7f5087fff640 1 -- 172.21.15.44:0/1739597290 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5094054760 con 0x7f50a00b64c0 2023-11-04T01:37:38.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.605+0000 7f50a5c34640 1 -- 172.21.15.44:0/1739597290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f50a00674e0 con 0x7f50a00b64c0 2023-11-04T01:37:38.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.606+0000 7f5087fff640 1 -- 172.21.15.44:0/1739597290 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5094057d80 con 0x7f50a00b64c0 2023-11-04T01:37:38.608 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2023-11-04T01:37:38.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.607+0000 7f50a5c34640 1 -- 172.21.15.44:0/1739597290 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f508c06ae70 msgr2=0x7f508c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.607+0000 7f50a5c34640 1 --2- 172.21.15.44:0/1739597290 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f508c06ae70 0x7f508c06d330 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5090036000 tx=0x7f509003c040 comp rx=0 tx=0).stop 2023-11-04T01:37:38.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.607+0000 7f50a5c34640 1 -- 172.21.15.44:0/1739597290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50a00b64c0 msgr2=0x7f50a01f1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.607+0000 7f50a5c34640 1 --2- 172.21.15.44:0/1739597290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50a00b64c0 0x7f50a01f1e40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f509400e8a0 tx=0x7f509400ed60 comp rx=0 tx=0).stop 2023-11-04T01:37:38.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.607+0000 7f50a5c34640 1 -- 172.21.15.44:0/1739597290 shutdown_connections 2023-11-04T01:37:38.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.607+0000 7f50a5c34640 1 --2- 172.21.15.44:0/1739597290 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f508c06ae70 0x7f508c06d330 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.607+0000 7f50a5c34640 1 --2- 172.21.15.44:0/1739597290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50a015af20 0x7f50a00b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.607+0000 7f50a5c34640 1 --2- 172.21.15.44:0/1739597290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50a00cd3b0 0x7f50a006b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.607+0000 7f50a5c34640 1 --2- 172.21.15.44:0/1739597290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50a00b64c0 0x7f50a01f1e40 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.607+0000 7f50a5c34640 1 -- 172.21.15.44:0/1739597290 >> 172.21.15.44:0/1739597290 conn(0x7f50a006ea20 msgr2=0x7f50a0152b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.608+0000 7f50a5c34640 1 -- 172.21.15.44:0/1739597290 shutdown_connections 2023-11-04T01:37:38.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38.608+0000 7f50a5c34640 1 -- 172.21.15.44:0/1739597290 wait complete. 2023-11-04T01:37:38.620 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2023-11-04T01:37:38.620 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:38.620 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:38.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:38.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[104768]: fuse finished with error 0 and tester_r 0 2023-11-04T01:37:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:38.689 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:37:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:38.692 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:37:38.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:38.692 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:37:38.708 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:37:38.708 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:38.727 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:37:38.727 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:37:38.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:38.727 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:37:38.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:37:38.786 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:37:38.786 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:37:38.786 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:38.802 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:37:38.802 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:37:38.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:38.803 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:37:38.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:37:38.858 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:37:38.859 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:37:38.859 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:38.876 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:37:38.877 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:37:38.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:38.877 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:37:38.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:37:38.934 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:37:38.934 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:39.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.038+0000 7fc5e2ba9640 1 Processor -- start 2023-11-04T01:37:39.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.038+0000 7fc5e2ba9640 1 -- start start 2023-11-04T01:37:39.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.039+0000 7fc5e2ba9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5dc15ce60 0x7fc5dc06b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.039+0000 7fc5e2ba9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5dc06bd30 0x7fc5dc160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.039+0000 7fc5e2ba9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5dc1615d0 con 0x7fc5dc161050 2023-11-04T01:37:39.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.039+0000 7fc5e2ba9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc0cbde0 con 0x7fc5dc06bd30 2023-11-04T01:37:39.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.039+0000 7fc5e2ba9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc1618b0 con 0x7fc5dc15ce60 2023-11-04T01:37:39.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.039+0000 7fc5e1146640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc5dc161050 0x7fc5dc0cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57832/0 (socket says 172.21.15.44:57832) 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.039+0000 7fc5e1146640 1 -- 172.21.15.44:0/1767060047 learned_addr learned my addr 172.21.15.44:0/1767060047 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.039+0000 7fc5e0945640 1 --2- 172.21.15.44:0/1767060047 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5dc15ce60 0x7fc5dc06b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.039+0000 7fc5dbfff640 1 --2- 172.21.15.44:0/1767060047 >> v2:172.21.15.204:3300/0 conn(0x7fc5dc06bd30 0x7fc5dc160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.039+0000 7fc5db7fe640 1 -- 172.21.15.44:0/1767060047 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240831715 0 0) 0x7fc5dc1615d0 con 0x7fc5dc161050 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.039+0000 7fc5db7fe640 1 -- 172.21.15.44:0/1767060047 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5c4003520 con 0x7fc5dc161050 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5db7fe640 1 -- 172.21.15.44:0/1767060047 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2886144261 0 0) 0x7fc5c4003520 con 0x7fc5dc161050 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5db7fe640 1 -- 172.21.15.44:0/1767060047 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5dc15ce60 msgr2=0x7fc5dc06b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5db7fe640 1 --2- 172.21.15.44:0/1767060047 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5dc15ce60 0x7fc5dc06b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5db7fe640 1 -- 172.21.15.44:0/1767060047 >> v2:172.21.15.204:3300/0 conn(0x7fc5dc06bd30 msgr2=0x7fc5dc160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5db7fe640 1 --2- 172.21.15.44:0/1767060047 >> v2:172.21.15.204:3300/0 conn(0x7fc5dc06bd30 0x7fc5dc160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5db7fe640 1 -- 172.21.15.44:0/1767060047 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc0cba00 con 0x7fc5dc161050 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5db7fe640 1 -- 172.21.15.44:0/1767060047 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fc5d40019f0 con 0x7fc5dc161050 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5db7fe640 1 -- 172.21.15.44:0/1767060047 >> v1:172.21.15.44:6789/0 conn(0x7fc5dc161050 legacy=0x7fc5dc0cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5db7fe640 1 --2- 172.21.15.44:0/1767060047 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5c4003970 0x7fc5c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5db7fe640 1 --2- 172.21.15.44:0/1767060047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c40047c0 0x7fc5c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5db7fe640 1 --2- 172.21.15.44:0/1767060047 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5dc15ce60 0x7fc5c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5db7fe640 1 -- 172.21.15.44:0/1767060047 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0cbde0 con 0x7fc5c40047c0 2023-11-04T01:37:39.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5db7fe640 1 -- 172.21.15.44:0/1767060047 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc1618b0 con 0x7fc5c4003970 2023-11-04T01:37:39.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5db7fe640 1 -- 172.21.15.44:0/1767060047 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c400b980 con 0x7fc5dc15ce60 2023-11-04T01:37:39.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5dbfff640 1 --2- 172.21.15.44:0/1767060047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c40047c0 0x7fc5c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5e0945640 1 --2- 172.21.15.44:0/1767060047 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5c4003970 0x7fc5c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5e1146640 1 --2- 172.21.15.44:0/1767060047 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5dc15ce60 0x7fc5c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5dbfff640 1 -- 172.21.15.44:0/1767060047 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5dc15ce60 msgr2=0x7fc5c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5dbfff640 1 --2- 172.21.15.44:0/1767060047 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5dc15ce60 0x7fc5c4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5dbfff640 1 -- 172.21.15.44:0/1767060047 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5c4003970 msgr2=0x7fc5c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5dbfff640 1 --2- 172.21.15.44:0/1767060047 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5c4003970 0x7fc5c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.040+0000 7fc5dbfff640 1 -- 172.21.15.44:0/1767060047 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c4003520 con 0x7fc5c40047c0 2023-11-04T01:37:39.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.041+0000 7fc5dbfff640 1 --2- 172.21.15.44:0/1767060047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c40047c0 0x7fc5c4004c40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009ac0 tx=0x7fc5c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb340ab9be8c1ba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.041+0000 7fc5db7fe640 1 -- 172.21.15.44:0/1767060047 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d002c6d0 con 0x7fc5c40047c0 2023-11-04T01:37:39.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.041+0000 7fc5db7fe640 1 -- 172.21.15.44:0/1767060047 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d002c830 con 0x7fc5c40047c0 2023-11-04T01:37:39.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.041+0000 7fc5db7fe640 1 -- 172.21.15.44:0/1767060047 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d002cbc0 con 0x7fc5c40047c0 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.042+0000 7fc5e2ba9640 1 -- 172.21.15.44:0/1767060047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c40047c0 msgr2=0x7fc5c4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.042+0000 7fc5e2ba9640 1 --2- 172.21.15.44:0/1767060047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c40047c0 0x7fc5c4004c40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009ac0 tx=0x7fc5c40057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.042+0000 7fc5e1146640 1 -- 172.21.15.44:0/1767060047 reap_dead start 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.042+0000 7fc5e2ba9640 1 -- 172.21.15.44:0/1767060047 shutdown_connections 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.042+0000 7fc5e2ba9640 1 -- 172.21.15.44:0/1767060047 >> 172.21.15.44:0/1767060047 conn(0x7fc5dc06ea90 msgr2=0x7fc5dc06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.042+0000 7fc5e2ba9640 1 -- 172.21.15.44:0/1767060047 shutdown_connections 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.042+0000 7fc5e2ba9640 1 -- 172.21.15.44:0/1767060047 wait complete. 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.043+0000 7fc5e2ba9640 1 Processor -- start 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.043+0000 7fc5e2ba9640 1 -- start start 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e2ba9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5dc1500a0 0x7fc5dc0b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e2ba9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5dc159fb0 0x7fc5dc0b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e2ba9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5dc0c5510 0x7fc5dc0c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e2ba9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0c5ed0 con 0x7fc5dc1500a0 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e2ba9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0b40e0 con 0x7fc5dc0c5510 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e2ba9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0b43c0 con 0x7fc5dc159fb0 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e0945640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5dc1500a0 0x7fc5dc0b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e0945640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5dc1500a0 0x7fc5dc0b5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60126/0 (socket says 172.21.15.44:60126) 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e0945640 1 -- 172.21.15.44:0/753675842 learned_addr learned my addr 172.21.15.44:0/753675842 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5dbfff640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5dc159fb0 0x7fc5dc0b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e1146640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5dc0c5510 0x7fc5dc0c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e0945640 1 -- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5dc159fb0 msgr2=0x7fc5dc0b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e0945640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5dc159fb0 0x7fc5dc0b3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e0945640 1 -- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5dc0c5510 msgr2=0x7fc5dc0c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e0945640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5dc0c5510 0x7fc5dc0c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e0945640 1 -- 172.21.15.44:0/753675842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc0b46a0 con 0x7fc5dc1500a0 2023-11-04T01:37:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5dbfff640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5dc159fb0 0x7fc5dc0b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e1146640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5dc0c5510 0x7fc5dc0c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.044+0000 7fc5e0945640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5dc1500a0 0x7fc5dc0b5180 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0118e0 tx=0x7fc5cc011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.045+0000 7fc5d97fa640 1 -- 172.21.15.44:0/753675842 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc00faf0 con 0x7fc5dc1500a0 2023-11-04T01:37:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.045+0000 7fc5d97fa640 1 -- 172.21.15.44:0/753675842 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5cc00fc50 con 0x7fc5dc1500a0 2023-11-04T01:37:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.045+0000 7fc5e2ba9640 1 -- 172.21.15.44:0/753675842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc0b4980 con 0x7fc5dc1500a0 2023-11-04T01:37:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.045+0000 7fc5d97fa640 1 -- 172.21.15.44:0/753675842 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc014440 con 0x7fc5dc1500a0 2023-11-04T01:37:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.045+0000 7fc5e2ba9640 1 -- 172.21.15.44:0/753675842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc150480 con 0x7fc5dc1500a0 2023-11-04T01:37:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.046+0000 7fc5e2ba9640 1 -- 172.21.15.44:0/753675842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5dc074290 con 0x7fc5dc1500a0 2023-11-04T01:37:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.046+0000 7fc5d97fa640 1 -- 172.21.15.44:0/753675842 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc5cc01d400 con 0x7fc5dc1500a0 2023-11-04T01:37:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.047+0000 7fc5d97fa640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc5c806aea0 0x7fc5c806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.047+0000 7fc5d97fa640 1 -- 172.21.15.44:0/753675842 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fc5cc08a110 con 0x7fc5dc1500a0 2023-11-04T01:37:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.047+0000 7fc5dbfff640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc5c806aea0 0x7fc5c806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.048+0000 7fc5dbfff640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc5c806aea0 0x7fc5c806d360 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0036000 tx=0x7fc5d0030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.051+0000 7fc5d97fa640 1 -- 172.21.15.44:0/753675842 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc5cc054ee0 con 0x7fc5dc1500a0 2023-11-04T01:37:39.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.266+0000 7fc5e2ba9640 1 -- 172.21.15.44:0/753675842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5dc0ce970 con 0x7fc5dc1500a0 2023-11-04T01:37:39.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.267+0000 7fc5d97fa640 1 -- 172.21.15.44:0/753675842 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fc5cc058500 con 0x7fc5dc1500a0 2023-11-04T01:37:39.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:39.269 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5024,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/620952929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":620952929},{"type":"v1","addr":"172.21.15.44:6834","nonce":620952929}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2082760690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":2082760690},{"type":"v1","addr":"172.21.15.204:6836","nonce":2082760690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5323,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2330742876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2330742876},{"type":"v1","addr":"172.21.15.204:6837","nonce":2330742876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:21.307124+0000","modified":"2023-11-04T01:37:23.300604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5514":{"gid":5514,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/2457583329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2457583329},{"type":"v1","addr":"172.21.15.44:6835","nonce":2457583329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:37:39.270 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 15 2023-11-04T01:37:39.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.269+0000 7fc5e2ba9640 1 -- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc5c806aea0 msgr2=0x7fc5c806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.269+0000 7fc5e2ba9640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc5c806aea0 0x7fc5c806d360 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0036000 tx=0x7fc5d0030000 comp rx=0 tx=0).stop 2023-11-04T01:37:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.269+0000 7fc5e2ba9640 1 -- 172.21.15.44:0/753675842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5dc1500a0 msgr2=0x7fc5dc0b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.269+0000 7fc5e2ba9640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5dc1500a0 0x7fc5dc0b5180 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0118e0 tx=0x7fc5cc011da0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.269+0000 7fc5e2ba9640 1 -- 172.21.15.44:0/753675842 shutdown_connections 2023-11-04T01:37:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.269+0000 7fc5e2ba9640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc5c806aea0 0x7fc5c806d360 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.269+0000 7fc5e2ba9640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5dc0c5510 0x7fc5dc0c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.269+0000 7fc5e2ba9640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5dc159fb0 0x7fc5dc0b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.269+0000 7fc5e2ba9640 1 --2- 172.21.15.44:0/753675842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5dc1500a0 0x7fc5dc0b5180 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.269+0000 7fc5e2ba9640 1 -- 172.21.15.44:0/753675842 >> 172.21.15.44:0/753675842 conn(0x7fc5dc06ea90 msgr2=0x7fc5dc0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.269+0000 7fc5e2ba9640 1 -- 172.21.15.44:0/753675842 shutdown_connections 2023-11-04T01:37:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.269+0000 7fc5e2ba9640 1 -- 172.21.15.44:0/753675842 wait complete. 2023-11-04T01:37:39.282 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:39.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.386+0000 7f4ee07a9640 1 Processor -- start 2023-11-04T01:37:39.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.386+0000 7f4ee07a9640 1 -- start start 2023-11-04T01:37:39.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.387+0000 7f4ee07a9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4ed80ce240 0x7f4ed8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.387+0000 7f4ee07a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ed8157540 0x7f4ed80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.387+0000 7f4ee07a9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed815e000 con 0x7f4ed80cde60 2023-11-04T01:37:39.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.387+0000 7f4ee07a9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed815e5c0 con 0x7f4ed80ce240 2023-11-04T01:37:39.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.387+0000 7f4ee07a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed815e2e0 con 0x7f4ed8157540 2023-11-04T01:37:39.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.387+0000 7f4ede545640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4ed80cde60 0x7f4ed815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57834/0 (socket says 172.21.15.44:57834) 2023-11-04T01:37:39.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.387+0000 7f4ede545640 1 -- 172.21.15.44:0/822321637 learned_addr learned my addr 172.21.15.44:0/822321637 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:39.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 -- 172.21.15.44:0/822321637 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281563122 0 0) 0x7f4ed815e000 con 0x7f4ed80cde60 2023-11-04T01:37:39.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 -- 172.21.15.44:0/822321637 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ec0003520 con 0x7f4ed80cde60 2023-11-04T01:37:39.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4eded46640 1 --2- 172.21.15.44:0/822321637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ed8157540 0x7f4ed80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4eddd44640 1 --2- 172.21.15.44:0/822321637 >> v2:172.21.15.204:3300/0 conn(0x7f4ed80ce240 0x7f4ed8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 -- 172.21.15.44:0/822321637 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 479941256 0 0) 0x7f4ec0003520 con 0x7f4ed80cde60 2023-11-04T01:37:39.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 -- 172.21.15.44:0/822321637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ed8157540 msgr2=0x7f4ed80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 --2- 172.21.15.44:0/822321637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ed8157540 0x7f4ed80d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 -- 172.21.15.44:0/822321637 >> v2:172.21.15.204:3300/0 conn(0x7f4ed80ce240 msgr2=0x7f4ed8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 --2- 172.21.15.44:0/822321637 >> v2:172.21.15.204:3300/0 conn(0x7f4ed80ce240 0x7f4ed8157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 -- 172.21.15.44:0/822321637 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed80d1120 con 0x7f4ed80cde60 2023-11-04T01:37:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 -- 172.21.15.44:0/822321637 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f4ed0001670 con 0x7f4ed80cde60 2023-11-04T01:37:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 -- 172.21.15.44:0/822321637 >> v1:172.21.15.44:6789/0 conn(0x7f4ed80cde60 legacy=0x7f4ed815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 --2- 172.21.15.44:0/822321637 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec0003970 0x7f4ec0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 --2- 172.21.15.44:0/822321637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ec00047c0 0x7f4ec0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 --2- 172.21.15.44:0/822321637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ed8157540 0x7f4ec0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 -- 172.21.15.44:0/822321637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed815e5c0 con 0x7f4ec00047c0 2023-11-04T01:37:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 -- 172.21.15.44:0/822321637 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed815e2e0 con 0x7f4ec0003970 2023-11-04T01:37:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4edd543640 1 -- 172.21.15.44:0/822321637 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec000ba30 con 0x7f4ed8157540 2023-11-04T01:37:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4eddd44640 1 --2- 172.21.15.44:0/822321637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ec00047c0 0x7f4ec0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4ede545640 1 --2- 172.21.15.44:0/822321637 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec0003970 0x7f4ec0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4eded46640 1 --2- 172.21.15.44:0/822321637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ed8157540 0x7f4ec0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4eddd44640 1 -- 172.21.15.44:0/822321637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ed8157540 msgr2=0x7f4ec0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4eddd44640 1 --2- 172.21.15.44:0/822321637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ed8157540 0x7f4ec0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4eddd44640 1 -- 172.21.15.44:0/822321637 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec0003970 msgr2=0x7f4ec0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4eddd44640 1 --2- 172.21.15.44:0/822321637 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec0003970 0x7f4ec0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4eddd44640 1 -- 172.21.15.44:0/822321637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec0003520 con 0x7f4ec00047c0 2023-11-04T01:37:39.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.388+0000 7f4eded46640 1 --2- 172.21.15.44:0/822321637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ed8157540 0x7f4ec0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:39.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.389+0000 7f4eddd44640 1 --2- 172.21.15.44:0/822321637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ec00047c0 0x7f4ec0004c40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00ba00 tx=0x7f4ec00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa9f06cfd29a56a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.389+0000 7f4edd543640 1 -- 172.21.15.44:0/822321637 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc032630 con 0x7f4ec00047c0 2023-11-04T01:37:39.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.389+0000 7f4edd543640 1 -- 172.21.15.44:0/822321637 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc032790 con 0x7f4ec00047c0 2023-11-04T01:37:39.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.389+0000 7f4edd543640 1 -- 172.21.15.44:0/822321637 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc032b20 con 0x7f4ec00047c0 2023-11-04T01:37:39.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.390+0000 7f4ee07a9640 1 -- 172.21.15.44:0/822321637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ec00047c0 msgr2=0x7f4ec0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.390+0000 7f4ee07a9640 1 --2- 172.21.15.44:0/822321637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ec00047c0 0x7f4ec0004c40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00ba00 tx=0x7f4ec00057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.390+0000 7f4eded46640 1 -- 172.21.15.44:0/822321637 reap_dead start 2023-11-04T01:37:39.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.390+0000 7f4ee07a9640 1 -- 172.21.15.44:0/822321637 shutdown_connections 2023-11-04T01:37:39.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.390+0000 7f4ee07a9640 1 -- 172.21.15.44:0/822321637 >> 172.21.15.44:0/822321637 conn(0x7f4ed8071f30 msgr2=0x7f4ed80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.390+0000 7f4ee07a9640 1 -- 172.21.15.44:0/822321637 shutdown_connections 2023-11-04T01:37:39.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.390+0000 7f4ee07a9640 1 -- 172.21.15.44:0/822321637 wait complete. 2023-11-04T01:37:39.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.391+0000 7f4ee07a9640 1 Processor -- start 2023-11-04T01:37:39.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.391+0000 7f4ee07a9640 1 -- start start 2023-11-04T01:37:39.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4ee07a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec00047c0 0x7f4ed81f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4ee07a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ed8159a00 0x7f4ed80cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4ee07a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ed8159e80 0x7f4ed80cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4ee07a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed815b060 con 0x7f4ed8159e80 2023-11-04T01:37:39.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4ee07a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed81f5da0 con 0x7f4ec00047c0 2023-11-04T01:37:39.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4ee07a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed815a3e0 con 0x7f4ed8159a00 2023-11-04T01:37:39.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4eded46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ed8159e80 0x7f4ed80cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4eded46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ed8159e80 0x7f4ed80cbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60148/0 (socket says 172.21.15.44:60148) 2023-11-04T01:37:39.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4eded46640 1 -- 172.21.15.44:0/395340792 learned_addr learned my addr 172.21.15.44:0/395340792 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:39.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4eddd44640 1 --2- 172.21.15.44:0/395340792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ed8159a00 0x7f4ed80cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4ede545640 1 --2- 172.21.15.44:0/395340792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec00047c0 0x7f4ed81f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4eded46640 1 -- 172.21.15.44:0/395340792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ed8159a00 msgr2=0x7f4ed80cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4eded46640 1 --2- 172.21.15.44:0/395340792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ed8159a00 0x7f4ed80cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4eded46640 1 -- 172.21.15.44:0/395340792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec00047c0 msgr2=0x7f4ed81f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4eded46640 1 --2- 172.21.15.44:0/395340792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec00047c0 0x7f4ed81f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4eded46640 1 -- 172.21.15.44:0/395340792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed815a6c0 con 0x7f4ed8159e80 2023-11-04T01:37:39.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4ede545640 1 --2- 172.21.15.44:0/395340792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec00047c0 0x7f4ed81f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:39.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.392+0000 7f4eded46640 1 --2- 172.21.15.44:0/395340792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ed8159e80 0x7f4ed80cbfc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80cf5c0 tx=0x7f4ec8004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.393+0000 7f4ed6ffd640 1 -- 172.21.15.44:0/395340792 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8007c50 con 0x7f4ed8159e80 2023-11-04T01:37:39.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.393+0000 7f4ed6ffd640 1 -- 172.21.15.44:0/395340792 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec800f050 con 0x7f4ed8159e80 2023-11-04T01:37:39.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.393+0000 7f4ee07a9640 1 -- 172.21.15.44:0/395340792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed815a9a0 con 0x7f4ed8159e80 2023-11-04T01:37:39.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.393+0000 7f4ed6ffd640 1 -- 172.21.15.44:0/395340792 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8014410 con 0x7f4ed8159e80 2023-11-04T01:37:39.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.393+0000 7f4ee07a9640 1 -- 172.21.15.44:0/395340792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed815bb30 con 0x7f4ed8159e80 2023-11-04T01:37:39.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.394+0000 7f4ee07a9640 1 -- 172.21.15.44:0/395340792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed81f2a50 con 0x7f4ed8159e80 2023-11-04T01:37:39.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.394+0000 7f4ed6ffd640 1 -- 172.21.15.44:0/395340792 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ec8014590 con 0x7f4ed8159e80 2023-11-04T01:37:39.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.394+0000 7f4ed6ffd640 1 --2- 172.21.15.44:0/395340792 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ec406ae70 0x7f4ec406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.395+0000 7f4ed6ffd640 1 -- 172.21.15.44:0/395340792 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f4ec8089cc0 con 0x7f4ed8159e80 2023-11-04T01:37:39.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.395+0000 7f4ede545640 1 --2- 172.21.15.44:0/395340792 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ec406ae70 0x7f4ec406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.395+0000 7f4ede545640 1 --2- 172.21.15.44:0/395340792 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ec406ae70 0x7f4ec406d330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80ccf30 tx=0x7f4ed0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.399+0000 7f4ed6ffd640 1 -- 172.21.15.44:0/395340792 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ec8054b20 con 0x7f4ed8159e80 2023-11-04T01:37:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.575+0000 7f4ee07a9640 1 -- 172.21.15.44:0/395340792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ed815b1a0 con 0x7f4ed8159e80 2023-11-04T01:37:39.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.576+0000 7f4ed6ffd640 1 -- 172.21.15.44:0/395340792 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18613 (secure 0 0 0) 0x7f4ec8058140 con 0x7f4ed8159e80 2023-11-04T01:37:39.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:39.579 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":42,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:36.215799+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:19.141183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:20.292111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:39.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.578+0000 7f4ee07a9640 1 -- 172.21.15.44:0/395340792 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ec406ae70 msgr2=0x7f4ec406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.578+0000 7f4ee07a9640 1 --2- 172.21.15.44:0/395340792 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ec406ae70 0x7f4ec406d330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80ccf30 tx=0x7f4ed0009040 comp rx=0 tx=0).stop 2023-11-04T01:37:39.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.578+0000 7f4ee07a9640 1 -- 172.21.15.44:0/395340792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ed8159e80 msgr2=0x7f4ed80cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.578+0000 7f4ee07a9640 1 --2- 172.21.15.44:0/395340792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ed8159e80 0x7f4ed80cbfc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80cf5c0 tx=0x7f4ec8004840 comp rx=0 tx=0).stop 2023-11-04T01:37:39.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.578+0000 7f4ee07a9640 1 -- 172.21.15.44:0/395340792 shutdown_connections 2023-11-04T01:37:39.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.578+0000 7f4ee07a9640 1 --2- 172.21.15.44:0/395340792 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ec406ae70 0x7f4ec406d330 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.578+0000 7f4ee07a9640 1 --2- 172.21.15.44:0/395340792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ed8159e80 0x7f4ed80cbfc0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.578+0000 7f4ee07a9640 1 --2- 172.21.15.44:0/395340792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ed8159a00 0x7f4ed80cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.578+0000 7f4ee07a9640 1 --2- 172.21.15.44:0/395340792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ec00047c0 0x7f4ed81f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.578+0000 7f4ee07a9640 1 -- 172.21.15.44:0/395340792 >> 172.21.15.44:0/395340792 conn(0x7f4ed8071f30 msgr2=0x7f4ed8072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.578+0000 7f4ee07a9640 1 -- 172.21.15.44:0/395340792 shutdown_connections 2023-11-04T01:37:39.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.578+0000 7f4ee07a9640 1 -- 172.21.15.44:0/395340792 wait complete. 2023-11-04T01:37:39.591 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:37:19.141183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:37:20.292111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:37:39.592 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:39.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.698+0000 7f37990e7640 1 Processor -- start 2023-11-04T01:37:39.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.698+0000 7f37990e7640 1 -- start start 2023-11-04T01:37:39.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f37990e7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f379415e430 0x7f37940cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f37990e7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37940cf160 0x7f37940cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f37990e7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f37940d0710 0x7f37940cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f37990e7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37940cdf90 con 0x7f379415e430 2023-11-04T01:37:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f37990e7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37940d0280 con 0x7f37940d0710 2023-11-04T01:37:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f37990e7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37940cf670 con 0x7f37940cf160 2023-11-04T01:37:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f3792d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f379415e430 0x7f37940cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f3792d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f379415e430 0x7f37940cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60160/0 (socket says 172.21.15.44:60160) 2023-11-04T01:37:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f3792d9d640 1 -- 172.21.15.44:0/3566542180 learned_addr learned my addr 172.21.15.44:0/3566542180 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f379259c640 1 --2- 172.21.15.44:0/3566542180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37940cf160 0x7f37940cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f379359e640 1 --2- 172.21.15.44:0/3566542180 >> v2:172.21.15.204:3300/0 conn(0x7f37940d0710 0x7f37940cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f3792d9d640 1 -- 172.21.15.44:0/3566542180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37940cf160 msgr2=0x7f37940cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f3792d9d640 1 --2- 172.21.15.44:0/3566542180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37940cf160 0x7f37940cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f3792d9d640 1 -- 172.21.15.44:0/3566542180 >> v2:172.21.15.204:3300/0 conn(0x7f37940d0710 msgr2=0x7f37940cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f3792d9d640 1 --2- 172.21.15.44:0/3566542180 >> v2:172.21.15.204:3300/0 conn(0x7f37940d0710 0x7f37940cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f3792d9d640 1 -- 172.21.15.44:0/3566542180 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37940cf950 con 0x7f379415e430 2023-11-04T01:37:39.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f379259c640 1 --2- 172.21.15.44:0/3566542180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37940cf160 0x7f37940cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:39.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f379359e640 1 --2- 172.21.15.44:0/3566542180 >> v2:172.21.15.204:3300/0 conn(0x7f37940d0710 0x7f37940cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:39.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f3792d9d640 1 --2- 172.21.15.44:0/3566542180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f379415e430 0x7f37940cec20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f379406f860 tx=0x7f378c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5460aa8f5b3a1921 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f3791d9b640 1 -- 172.21.15.44:0/3566542180 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c031870 con 0x7f379415e430 2023-11-04T01:37:39.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f3791d9b640 1 -- 172.21.15.44:0/3566542180 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c0319d0 con 0x7f379415e430 2023-11-04T01:37:39.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.700+0000 7f3791d9b640 1 -- 172.21.15.44:0/3566542180 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c031d60 con 0x7f379415e430 2023-11-04T01:37:39.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.701+0000 7f37990e7640 1 -- 172.21.15.44:0/3566542180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f379415e430 msgr2=0x7f37940cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.701+0000 7f37990e7640 1 --2- 172.21.15.44:0/3566542180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f379415e430 0x7f37940cec20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f379406f860 tx=0x7f378c02b910 comp rx=0 tx=0).stop 2023-11-04T01:37:39.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.701+0000 7f37990e7640 1 -- 172.21.15.44:0/3566542180 shutdown_connections 2023-11-04T01:37:39.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.701+0000 7f37990e7640 1 --2- 172.21.15.44:0/3566542180 >> v2:172.21.15.204:3300/0 conn(0x7f37940d0710 0x7f37940cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.701+0000 7f37990e7640 1 --2- 172.21.15.44:0/3566542180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37940cf160 0x7f37940cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.701+0000 7f37990e7640 1 --2- 172.21.15.44:0/3566542180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f379415e430 0x7f37940cec20 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.701+0000 7f37990e7640 1 -- 172.21.15.44:0/3566542180 >> 172.21.15.44:0/3566542180 conn(0x7f379406ea20 msgr2=0x7f379406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.701+0000 7f37990e7640 1 -- 172.21.15.44:0/3566542180 shutdown_connections 2023-11-04T01:37:39.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.701+0000 7f37990e7640 1 -- 172.21.15.44:0/3566542180 wait complete. 2023-11-04T01:37:39.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.702+0000 7f37990e7640 1 Processor -- start 2023-11-04T01:37:39.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.702+0000 7f37990e7640 1 -- start start 2023-11-04T01:37:39.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.703+0000 7f37990e7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37940cf160 0x7f37941f6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.703+0000 7f37990e7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37940d0710 0x7f37941f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.703+0000 7f37990e7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f379415e430 0x7f37940c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.703+0000 7f37990e7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3794158520 con 0x7f37940cf160 2023-11-04T01:37:39.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.703+0000 7f37990e7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37940c64b0 con 0x7f37940d0710 2023-11-04T01:37:39.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.703+0000 7f37990e7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37940c6790 con 0x7f379415e430 2023-11-04T01:37:39.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.703+0000 7f3792d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37940cf160 0x7f37941f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.703+0000 7f3792d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37940cf160 0x7f37941f6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60176/0 (socket says 172.21.15.44:60176) 2023-11-04T01:37:39.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.703+0000 7f3792d9d640 1 -- 172.21.15.44:0/3810194829 learned_addr learned my addr 172.21.15.44:0/3810194829 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:39.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.703+0000 7f379259c640 1 --2- 172.21.15.44:0/3810194829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37940d0710 0x7f37941f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.703+0000 7f379359e640 1 --2- 172.21.15.44:0/3810194829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f379415e430 0x7f37940c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.703+0000 7f3792d9d640 1 -- 172.21.15.44:0/3810194829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f379415e430 msgr2=0x7f37940c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.703+0000 7f3792d9d640 1 --2- 172.21.15.44:0/3810194829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f379415e430 0x7f37940c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.704+0000 7f3792d9d640 1 -- 172.21.15.44:0/3810194829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37940d0710 msgr2=0x7f37941f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.704+0000 7f3792d9d640 1 --2- 172.21.15.44:0/3810194829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37940d0710 0x7f37941f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.704+0000 7f3792d9d640 1 -- 172.21.15.44:0/3810194829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c0094d0 con 0x7f37940cf160 2023-11-04T01:37:39.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.704+0000 7f379259c640 1 --2- 172.21.15.44:0/3810194829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37940d0710 0x7f37941f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:39.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.704+0000 7f3792d9d640 1 --2- 172.21.15.44:0/3810194829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37940cf160 0x7f37941f6050 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f378c02b950 tx=0x7f378c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.704+0000 7f378b7fe640 1 -- 172.21.15.44:0/3810194829 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c03ad30 con 0x7f37940cf160 2023-11-04T01:37:39.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.704+0000 7f378b7fe640 1 -- 172.21.15.44:0/3810194829 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c0443f0 con 0x7f37940cf160 2023-11-04T01:37:39.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.704+0000 7f37990e7640 1 -- 172.21.15.44:0/3810194829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37940c6a70 con 0x7f37940cf160 2023-11-04T01:37:39.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.704+0000 7f378b7fe640 1 -- 172.21.15.44:0/3810194829 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c0447a0 con 0x7f37940cf160 2023-11-04T01:37:39.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.704+0000 7f37990e7640 1 -- 172.21.15.44:0/3810194829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37940c5c70 con 0x7f37940cf160 2023-11-04T01:37:39.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.705+0000 7f37990e7640 1 -- 172.21.15.44:0/3810194829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37940c70c0 con 0x7f37940cf160 2023-11-04T01:37:39.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.705+0000 7f378b7fe640 1 -- 172.21.15.44:0/3810194829 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f378c04d450 con 0x7f37940cf160 2023-11-04T01:37:39.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.706+0000 7f378b7fe640 1 --2- 172.21.15.44:0/3810194829 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f377406ae70 0x7f377406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.706+0000 7f378b7fe640 1 -- 172.21.15.44:0/3810194829 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f378c02d040 con 0x7f37940cf160 2023-11-04T01:37:39.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.706+0000 7f379259c640 1 --2- 172.21.15.44:0/3810194829 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f377406ae70 0x7f377406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.707+0000 7f379259c640 1 --2- 172.21.15.44:0/3810194829 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f377406ae70 0x7f377406d330 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f379406d410 tx=0x7f377c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.710+0000 7f378b7fe640 1 -- 172.21.15.44:0/3810194829 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f378c076cd0 con 0x7f37940cf160 2023-11-04T01:37:39.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.884+0000 7f37990e7640 1 -- 172.21.15.44:0/3810194829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3794074290 con 0x7f37940cf160 2023-11-04T01:37:39.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.885+0000 7f378b7fe640 1 -- 172.21.15.44:0/3810194829 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f378c035070 con 0x7f37940cf160 2023-11-04T01:37:39.887 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:37:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.887+0000 7f37990e7640 1 -- 172.21.15.44:0/3810194829 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f377406ae70 msgr2=0x7f377406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.887+0000 7f37990e7640 1 --2- 172.21.15.44:0/3810194829 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f377406ae70 0x7f377406d330 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f379406d410 tx=0x7f377c008040 comp rx=0 tx=0).stop 2023-11-04T01:37:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.887+0000 7f37990e7640 1 -- 172.21.15.44:0/3810194829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37940cf160 msgr2=0x7f37941f6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.887+0000 7f37990e7640 1 --2- 172.21.15.44:0/3810194829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37940cf160 0x7f37941f6050 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f378c02b950 tx=0x7f378c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.887+0000 7f37990e7640 1 -- 172.21.15.44:0/3810194829 shutdown_connections 2023-11-04T01:37:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.887+0000 7f37990e7640 1 --2- 172.21.15.44:0/3810194829 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f377406ae70 0x7f377406d330 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.887+0000 7f37990e7640 1 --2- 172.21.15.44:0/3810194829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f379415e430 0x7f37940c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.887+0000 7f37990e7640 1 --2- 172.21.15.44:0/3810194829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37940d0710 0x7f37941f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.887+0000 7f37990e7640 1 --2- 172.21.15.44:0/3810194829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37940cf160 0x7f37941f6050 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.887+0000 7f37990e7640 1 -- 172.21.15.44:0/3810194829 >> 172.21.15.44:0/3810194829 conn(0x7f379406ea20 msgr2=0x7f37940b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.887+0000 7f37990e7640 1 -- 172.21.15.44:0/3810194829 shutdown_connections 2023-11-04T01:37:39.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:39.887+0000 7f37990e7640 1 -- 172.21.15.44:0/3810194829 wait complete. 2023-11-04T01:37:39.900 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:40.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.006+0000 7f3599361640 1 Processor -- start 2023-11-04T01:37:40.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.006+0000 7f3599361640 1 -- start start 2023-11-04T01:37:40.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.007+0000 7f3599361640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3594153e60 0x7f359415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.007+0000 7f3599361640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f35940b4880 0x7f35940b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.007+0000 7f3599361640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35940cde60 con 0x7f35940cd6d0 2023-11-04T01:37:40.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.007+0000 7f3599361640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35940b5230 con 0x7f35940b4880 2023-11-04T01:37:40.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.007+0000 7f3599361640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3594160f90 con 0x7f3594153e60 2023-11-04T01:37:40.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.007+0000 7f35927fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f35940cd6d0 0x7f3594161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57842/0 (socket says 172.21.15.44:57842) 2023-11-04T01:37:40.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.007+0000 7f35927fc640 1 -- 172.21.15.44:0/4270109687 learned_addr learned my addr 172.21.15.44:0/4270109687 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:40.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 -- 172.21.15.44:0/4270109687 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159321972 0 0) 0x7f35940cde60 con 0x7f35940cd6d0 2023-11-04T01:37:40.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f35937fe640 1 --2- 172.21.15.44:0/4270109687 >> v2:172.21.15.204:3300/0 conn(0x7f35940b4880 0x7f35940b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3592ffd640 1 --2- 172.21.15.44:0/4270109687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3594153e60 0x7f359415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 -- 172.21.15.44:0/4270109687 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f357c003520 con 0x7f35940cd6d0 2023-11-04T01:37:40.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 -- 172.21.15.44:0/4270109687 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 456215845 0 0) 0x7f357c003520 con 0x7f35940cd6d0 2023-11-04T01:37:40.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 -- 172.21.15.44:0/4270109687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3594153e60 msgr2=0x7f359415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:40.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 --2- 172.21.15.44:0/4270109687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3594153e60 0x7f359415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 -- 172.21.15.44:0/4270109687 >> v2:172.21.15.204:3300/0 conn(0x7f35940b4880 msgr2=0x7f35940b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:40.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 --2- 172.21.15.44:0/4270109687 >> v2:172.21.15.204:3300/0 conn(0x7f35940b4880 0x7f35940b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 -- 172.21.15.44:0/4270109687 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359415e400 con 0x7f35940cd6d0 2023-11-04T01:37:40.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 -- 172.21.15.44:0/4270109687 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f3588001670 con 0x7f35940cd6d0 2023-11-04T01:37:40.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3592ffd640 1 --2- 172.21.15.44:0/4270109687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3594153e60 0x7f359415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:40.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 -- 172.21.15.44:0/4270109687 >> v1:172.21.15.44:6789/0 conn(0x7f35940cd6d0 legacy=0x7f3594161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 --2- 172.21.15.44:0/4270109687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3594153e60 0x7f357c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 --2- 172.21.15.44:0/4270109687 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f357c003eb0 0x7f357c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 --2- 172.21.15.44:0/4270109687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357c004d00 0x7f357c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 -- 172.21.15.44:0/4270109687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35940b5230 con 0x7f357c004d00 2023-11-04T01:37:40.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 -- 172.21.15.44:0/4270109687 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3594160f90 con 0x7f357c003eb0 2023-11-04T01:37:40.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3591ffb640 1 -- 172.21.15.44:0/4270109687 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c00b9b0 con 0x7f3594153e60 2023-11-04T01:37:40.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f35937fe640 1 --2- 172.21.15.44:0/4270109687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357c004d00 0x7f357c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f3592ffd640 1 --2- 172.21.15.44:0/4270109687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3594153e60 0x7f357c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f35927fc640 1 --2- 172.21.15.44:0/4270109687 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f357c003eb0 0x7f357c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f35937fe640 1 -- 172.21.15.44:0/4270109687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3594153e60 msgr2=0x7f357c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:40.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f35937fe640 1 --2- 172.21.15.44:0/4270109687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3594153e60 0x7f357c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f35937fe640 1 -- 172.21.15.44:0/4270109687 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f357c003eb0 msgr2=0x7f357c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:40.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f35937fe640 1 --2- 172.21.15.44:0/4270109687 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f357c003eb0 0x7f357c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.008+0000 7f35937fe640 1 -- 172.21.15.44:0/4270109687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c003520 con 0x7f357c004d00 2023-11-04T01:37:40.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.009+0000 7f35937fe640 1 --2- 172.21.15.44:0/4270109687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357c004d00 0x7f357c005180 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3584009fc0 tx=0x7f357c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81aae7d7f00c9b57 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.009+0000 7f3591ffb640 1 -- 172.21.15.44:0/4270109687 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358402cc60 con 0x7f357c004d00 2023-11-04T01:37:40.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.009+0000 7f3591ffb640 1 -- 172.21.15.44:0/4270109687 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358400f040 con 0x7f357c004d00 2023-11-04T01:37:40.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.009+0000 7f3591ffb640 1 -- 172.21.15.44:0/4270109687 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584034440 con 0x7f357c004d00 2023-11-04T01:37:40.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.010+0000 7f3599361640 1 -- 172.21.15.44:0/4270109687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357c004d00 msgr2=0x7f357c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.010+0000 7f3599361640 1 --2- 172.21.15.44:0/4270109687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357c004d00 0x7f357c005180 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3584009fc0 tx=0x7f357c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.010+0000 7f35937fe640 1 -- 172.21.15.44:0/4270109687 reap_dead start 2023-11-04T01:37:40.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.010+0000 7f3599361640 1 -- 172.21.15.44:0/4270109687 shutdown_connections 2023-11-04T01:37:40.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.010+0000 7f3599361640 1 -- 172.21.15.44:0/4270109687 >> 172.21.15.44:0/4270109687 conn(0x7f35940cf880 msgr2=0x7f35940cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:40.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.010+0000 7f3599361640 1 -- 172.21.15.44:0/4270109687 shutdown_connections 2023-11-04T01:37:40.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.010+0000 7f3599361640 1 -- 172.21.15.44:0/4270109687 wait complete. 2023-11-04T01:37:40.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.011+0000 7f3599361640 1 Processor -- start 2023-11-04T01:37:40.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.011+0000 7f3599361640 1 -- start start 2023-11-04T01:37:40.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.012+0000 7f3599361640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357c004d00 0x7f3594150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.012+0000 7f3599361640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f35940cc270 0x7f35940cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.012+0000 7f3599361640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3594155dc0 0x7f3594156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.012+0000 7f3599361640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35940ccc30 con 0x7f357c004d00 2023-11-04T01:37:40.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.012+0000 7f3599361640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35941552e0 con 0x7f35940cc270 2023-11-04T01:37:40.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.012+0000 7f3599361640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3594154240 con 0x7f3594155dc0 2023-11-04T01:37:40.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.012+0000 7f3592ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357c004d00 0x7f3594150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.012+0000 7f3592ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357c004d00 0x7f3594150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60202/0 (socket says 172.21.15.44:60202) 2023-11-04T01:37:40.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.012+0000 7f3592ffd640 1 -- 172.21.15.44:0/1164170095 learned_addr learned my addr 172.21.15.44:0/1164170095 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:40.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.012+0000 7f3592ffd640 1 -- 172.21.15.44:0/1164170095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3594155dc0 msgr2=0x7f3594156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.012+0000 7f3592ffd640 1 --2- 172.21.15.44:0/1164170095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3594155dc0 0x7f3594156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.012+0000 7f3592ffd640 1 -- 172.21.15.44:0/1164170095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f35940cc270 msgr2=0x7f35940cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.012+0000 7f3592ffd640 1 --2- 172.21.15.44:0/1164170095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f35940cc270 0x7f35940cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.012+0000 7f3592ffd640 1 -- 172.21.15.44:0/1164170095 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594154520 con 0x7f357c004d00 2023-11-04T01:37:40.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.013+0000 7f3592ffd640 1 --2- 172.21.15.44:0/1164170095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357c004d00 0x7f3594150590 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f358c0115f0 tx=0x7f358c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.013+0000 7f357b7fe640 1 -- 172.21.15.44:0/1164170095 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c00c070 con 0x7f357c004d00 2023-11-04T01:37:40.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.013+0000 7f357b7fe640 1 -- 172.21.15.44:0/1164170095 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c004220 con 0x7f357c004d00 2023-11-04T01:37:40.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.013+0000 7f3599361640 1 -- 172.21.15.44:0/1164170095 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3594154800 con 0x7f357c004d00 2023-11-04T01:37:40.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.013+0000 7f357b7fe640 1 -- 172.21.15.44:0/1164170095 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c015670 con 0x7f357c004d00 2023-11-04T01:37:40.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.013+0000 7f3599361640 1 -- 172.21.15.44:0/1164170095 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3594154dc0 con 0x7f357c004d00 2023-11-04T01:37:40.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.014+0000 7f3599361640 1 -- 172.21.15.44:0/1164170095 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3594074290 con 0x7f357c004d00 2023-11-04T01:37:40.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.014+0000 7f357b7fe640 1 -- 172.21.15.44:0/1164170095 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f358c0157d0 con 0x7f357c004d00 2023-11-04T01:37:40.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.015+0000 7f357b7fe640 1 --2- 172.21.15.44:0/1164170095 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f358006ae70 0x7f358006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.015+0000 7f357b7fe640 1 -- 172.21.15.44:0/1164170095 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f358c089920 con 0x7f357c004d00 2023-11-04T01:37:40.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.015+0000 7f35927fc640 1 --2- 172.21.15.44:0/1164170095 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f358006ae70 0x7f358006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.015+0000 7f35927fc640 1 --2- 172.21.15.44:0/1164170095 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f358006ae70 0x7f358006d330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3588001b60 tx=0x7f3588001af0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.019+0000 7f357b7fe640 1 -- 172.21.15.44:0/1164170095 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f358c0546f0 con 0x7f357c004d00 2023-11-04T01:37:40.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.197+0000 7f3599361640 1 -- 172.21.15.44:0/1164170095 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f35940b5010 con 0x7f357c004d00 2023-11-04T01:37:40.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.198+0000 7f357b7fe640 1 -- 172.21.15.44:0/1164170095 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f358c057d10 con 0x7f357c004d00 2023-11-04T01:37:40.200 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:37:40.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.200+0000 7f3599361640 1 -- 172.21.15.44:0/1164170095 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f358006ae70 msgr2=0x7f358006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.200+0000 7f3599361640 1 --2- 172.21.15.44:0/1164170095 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f358006ae70 0x7f358006d330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3588001b60 tx=0x7f3588001af0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.200+0000 7f3599361640 1 -- 172.21.15.44:0/1164170095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357c004d00 msgr2=0x7f3594150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.200+0000 7f3599361640 1 --2- 172.21.15.44:0/1164170095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357c004d00 0x7f3594150590 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f358c0115f0 tx=0x7f358c011ab0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.200+0000 7f3599361640 1 -- 172.21.15.44:0/1164170095 shutdown_connections 2023-11-04T01:37:40.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.200+0000 7f3599361640 1 --2- 172.21.15.44:0/1164170095 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f358006ae70 0x7f358006d330 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.200+0000 7f3599361640 1 --2- 172.21.15.44:0/1164170095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3594155dc0 0x7f3594156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.200+0000 7f3599361640 1 --2- 172.21.15.44:0/1164170095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f35940cc270 0x7f35940cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.200+0000 7f3599361640 1 --2- 172.21.15.44:0/1164170095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357c004d00 0x7f3594150590 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.200+0000 7f3599361640 1 -- 172.21.15.44:0/1164170095 >> 172.21.15.44:0/1164170095 conn(0x7f35940cf880 msgr2=0x7f35940d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:40.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.200+0000 7f3599361640 1 -- 172.21.15.44:0/1164170095 shutdown_connections 2023-11-04T01:37:40.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.200+0000 7f3599361640 1 -- 172.21.15.44:0/1164170095 wait complete. 2023-11-04T01:37:40.213 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:40.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.322+0000 7fa8a3df5640 1 Processor -- start 2023-11-04T01:37:40.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.322+0000 7fa8a3df5640 1 -- start start 2023-11-04T01:37:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.323+0000 7fa8a3df5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa89c0cd6d0 0x7fa89c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.323+0000 7fa8a3df5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa89c0b4880 0x7fa89c0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.323+0000 7fa8a3df5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89c0cde60 con 0x7fa89c153e60 2023-11-04T01:37:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.323+0000 7fa8a3df5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89c160f90 con 0x7fa89c0b4880 2023-11-04T01:37:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.323+0000 7fa8a3df5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0b51e0 con 0x7fa89c0cd6d0 2023-11-04T01:37:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.323+0000 7fa8a2392640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa89c0b4880 0x7fa89c0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.323+0000 7fa8a2392640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa89c0b4880 0x7fa89c0b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60208/0 (socket says 172.21.15.44:60208) 2023-11-04T01:37:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.323+0000 7fa8a2392640 1 -- 172.21.15.44:0/1627769743 learned_addr learned my addr 172.21.15.44:0/1627769743 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.324+0000 7fa8a1390640 1 --2- 172.21.15.44:0/1627769743 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa89c0cd6d0 0x7fa89c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.324+0000 7fa8a2392640 1 -- 172.21.15.44:0/1627769743 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa89c0cd6d0 msgr2=0x7fa89c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:40.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.324+0000 7fa8a2392640 1 --2- 172.21.15.44:0/1627769743 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa89c0cd6d0 0x7fa89c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.324+0000 7fa8a2392640 1 -- 172.21.15.44:0/1627769743 >> v1:172.21.15.204:6789/0 conn(0x7fa89c153e60 legacy=0x7fa89c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:40.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.324+0000 7fa8a2392640 1 -- 172.21.15.44:0/1627769743 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c161960 con 0x7fa89c0b4880 2023-11-04T01:37:40.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.324+0000 7fa8a2392640 1 --2- 172.21.15.44:0/1627769743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa89c0b4880 0x7fa89c0b4ca0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009e50 tx=0x7fa88c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6502e559ae9742 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.325+0000 7fa8a0b8f640 1 -- 172.21.15.44:0/1627769743 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c02ca70 con 0x7fa89c0b4880 2023-11-04T01:37:40.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.325+0000 7fa8a0b8f640 1 -- 172.21.15.44:0/1627769743 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c02cbd0 con 0x7fa89c0b4880 2023-11-04T01:37:40.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.325+0000 7fa8a0b8f640 1 -- 172.21.15.44:0/1627769743 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0343f0 con 0x7fa89c0b4880 2023-11-04T01:37:40.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.325+0000 7fa8a3df5640 1 -- 172.21.15.44:0/1627769743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa89c0b4880 msgr2=0x7fa89c0b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.325+0000 7fa8a3df5640 1 --2- 172.21.15.44:0/1627769743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa89c0b4880 0x7fa89c0b4ca0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009e50 tx=0x7fa88c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.325+0000 7fa8a3df5640 1 -- 172.21.15.44:0/1627769743 shutdown_connections 2023-11-04T01:37:40.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.325+0000 7fa8a3df5640 1 --2- 172.21.15.44:0/1627769743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa89c0b4880 0x7fa89c0b4ca0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.325+0000 7fa8a3df5640 1 --2- 172.21.15.44:0/1627769743 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa89c0cd6d0 0x7fa89c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.325+0000 7fa8a3df5640 1 -- 172.21.15.44:0/1627769743 >> 172.21.15.44:0/1627769743 conn(0x7fa89c0cf880 msgr2=0x7fa89c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:40.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.325+0000 7fa8a3df5640 1 -- 172.21.15.44:0/1627769743 shutdown_connections 2023-11-04T01:37:40.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.325+0000 7fa8a3df5640 1 -- 172.21.15.44:0/1627769743 wait complete. 2023-11-04T01:37:40.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.326+0000 7fa8a3df5640 1 Processor -- start 2023-11-04T01:37:40.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.327+0000 7fa8a3df5640 1 -- start start 2023-11-04T01:37:40.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.327+0000 7fa8a3df5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa89c0b4880 0x7fa89c0c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.327+0000 7fa8a3df5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa89c0cd6d0 0x7fa89c15f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.327+0000 7fa8a3df5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa89c153e60 0x7fa89c15fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.327+0000 7fa8a3df5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0c7940 con 0x7fa89c0cd6d0 2023-11-04T01:37:40.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.327+0000 7fa8a3df5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0c8950 con 0x7fa89c153e60 2023-11-04T01:37:40.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.327+0000 7fa8a3df5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0c7b90 con 0x7fa89c0b4880 2023-11-04T01:37:40.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.327+0000 7fa8a1390640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa89c0cd6d0 0x7fa89c15f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.327+0000 7fa8a1390640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa89c0cd6d0 0x7fa89c15f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60210/0 (socket says 172.21.15.44:60210) 2023-11-04T01:37:40.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.327+0000 7fa8a1390640 1 -- 172.21.15.44:0/1685262704 learned_addr learned my addr 172.21.15.44:0/1685262704 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:40.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.328+0000 7fa8a2392640 1 --2- 172.21.15.44:0/1685262704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa89c153e60 0x7fa89c15fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.328+0000 7fa8a1b91640 1 --2- 172.21.15.44:0/1685262704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa89c0b4880 0x7fa89c0c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.328+0000 7fa8a1390640 1 -- 172.21.15.44:0/1685262704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa89c0b4880 msgr2=0x7fa89c0c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.328+0000 7fa8a1390640 1 --2- 172.21.15.44:0/1685262704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa89c0b4880 0x7fa89c0c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.328+0000 7fa8a1390640 1 -- 172.21.15.44:0/1685262704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa89c153e60 msgr2=0x7fa89c15fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.328+0000 7fa8a1390640 1 --2- 172.21.15.44:0/1685262704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa89c153e60 0x7fa89c15fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.328+0000 7fa8a1390640 1 -- 172.21.15.44:0/1685262704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c009b30 con 0x7fa89c0cd6d0 2023-11-04T01:37:40.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.328+0000 7fa8a1390640 1 --2- 172.21.15.44:0/1685262704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa89c0cd6d0 0x7fa89c15f5e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa89000d800 tx=0x7fa89000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.328+0000 7fa89a7fc640 1 -- 172.21.15.44:0/1685262704 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89000b6c0 con 0x7fa89c0cd6d0 2023-11-04T01:37:40.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.328+0000 7fa89a7fc640 1 -- 172.21.15.44:0/1685262704 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89000b820 con 0x7fa89c0cd6d0 2023-11-04T01:37:40.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.328+0000 7fa8a3df5640 1 -- 172.21.15.44:0/1685262704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89c0c7e70 con 0x7fa89c0cd6d0 2023-11-04T01:37:40.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.328+0000 7fa89a7fc640 1 -- 172.21.15.44:0/1685262704 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89000bbb0 con 0x7fa89c0cd6d0 2023-11-04T01:37:40.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.328+0000 7fa8a3df5640 1 -- 172.21.15.44:0/1685262704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89c0c8430 con 0x7fa89c0cd6d0 2023-11-04T01:37:40.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.329+0000 7fa8a3df5640 1 -- 172.21.15.44:0/1685262704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89c074290 con 0x7fa89c0cd6d0 2023-11-04T01:37:40.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.329+0000 7fa89a7fc640 1 -- 172.21.15.44:0/1685262704 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa89000bd10 con 0x7fa89c0cd6d0 2023-11-04T01:37:40.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.330+0000 7fa89a7fc640 1 --2- 172.21.15.44:0/1685262704 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa88806ae70 0x7fa88806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.330+0000 7fa89a7fc640 1 -- 172.21.15.44:0/1685262704 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6439+0+0 (secure 0 0 0) 0x7fa890089dd0 con 0x7fa89c0cd6d0 2023-11-04T01:37:40.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.330+0000 7fa8a1b91640 1 --2- 172.21.15.44:0/1685262704 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa88806ae70 0x7fa88806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.331+0000 7fa8a1b91640 1 --2- 172.21.15.44:0/1685262704 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa88806ae70 0x7fa88806d330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa894006fd0 tx=0x7fa894008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.335+0000 7fa89a7fc640 1 -- 172.21.15.44:0/1685262704 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa890054c30 con 0x7fa89c0cd6d0 2023-11-04T01:37:40.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.509+0000 7fa8a3df5640 1 -- 172.21.15.44:0/1685262704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa89c0d0b80 con 0x7fa89c0cd6d0 2023-11-04T01:37:40.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.509+0000 7fa89a7fc640 1 -- 172.21.15.44:0/1685262704 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa89008b0a0 con 0x7fa89c0cd6d0 2023-11-04T01:37:40.512 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:37:40.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.511+0000 7fa8a3df5640 1 -- 172.21.15.44:0/1685262704 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa88806ae70 msgr2=0x7fa88806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.511+0000 7fa8a3df5640 1 --2- 172.21.15.44:0/1685262704 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa88806ae70 0x7fa88806d330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa894006fd0 tx=0x7fa894008040 comp rx=0 tx=0).stop 2023-11-04T01:37:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.511+0000 7fa8a3df5640 1 -- 172.21.15.44:0/1685262704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa89c0cd6d0 msgr2=0x7fa89c15f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.511+0000 7fa8a3df5640 1 --2- 172.21.15.44:0/1685262704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa89c0cd6d0 0x7fa89c15f5e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa89000d800 tx=0x7fa89000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.511+0000 7fa8a3df5640 1 -- 172.21.15.44:0/1685262704 shutdown_connections 2023-11-04T01:37:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.511+0000 7fa8a3df5640 1 --2- 172.21.15.44:0/1685262704 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa88806ae70 0x7fa88806d330 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.511+0000 7fa8a3df5640 1 --2- 172.21.15.44:0/1685262704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa89c153e60 0x7fa89c15fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.511+0000 7fa8a3df5640 1 --2- 172.21.15.44:0/1685262704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa89c0cd6d0 0x7fa89c15f5e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.511+0000 7fa8a3df5640 1 --2- 172.21.15.44:0/1685262704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa89c0b4880 0x7fa89c0c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.511+0000 7fa8a3df5640 1 -- 172.21.15.44:0/1685262704 >> 172.21.15.44:0/1685262704 conn(0x7fa89c0cf880 msgr2=0x7fa89c0d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.511+0000 7fa8a3df5640 1 -- 172.21.15.44:0/1685262704 shutdown_connections 2023-11-04T01:37:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.511+0000 7fa8a3df5640 1 -- 172.21.15.44:0/1685262704 wait complete. 2023-11-04T01:37:40.524 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:37:40.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d89aaf640 1 Processor -- start 2023-11-04T01:37:40.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d89aaf640 1 -- start start 2023-11-04T01:37:40.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d89aaf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d84153e60 0x7f4d8415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d89aaf640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d840cde60 con 0x7f4d840b4880 2023-11-04T01:37:40.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d89aaf640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d84160f90 con 0x7f4d840cd6d0 2023-11-04T01:37:40.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d89aaf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8415e400 con 0x7f4d84153e60 2023-11-04T01:37:40.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d83fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4d840b4880 0x7f4d840d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57856/0 (socket says 172.21.15.44:57856) 2023-11-04T01:37:40.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d83fff640 1 -- 172.21.15.44:0/3053179906 learned_addr learned my addr 172.21.15.44:0/3053179906 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:40.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d837fe640 1 --2- 172.21.15.44:0/3053179906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d84153e60 0x7f4d8415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d827fc640 1 -- 172.21.15.44:0/3053179906 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835414875 0 0) 0x7f4d840cde60 con 0x7f4d840b4880 2023-11-04T01:37:40.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d827fc640 1 -- 172.21.15.44:0/3053179906 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d6c003520 con 0x7f4d840b4880 2023-11-04T01:37:40.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d827fc640 1 -- 172.21.15.44:0/3053179906 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083074535 0 0) 0x7f4d84160f90 con 0x7f4d840cd6d0 2023-11-04T01:37:40.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d827fc640 1 -- 172.21.15.44:0/3053179906 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d840cde60 con 0x7f4d840cd6d0 2023-11-04T01:37:40.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d827fc640 1 -- 172.21.15.44:0/3053179906 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 997098892 0 0) 0x7f4d6c003520 con 0x7f4d840b4880 2023-11-04T01:37:40.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d837fe640 1 -- 172.21.15.44:0/3053179906 >> v1:172.21.15.204:6789/0 conn(0x7f4d840cd6d0 legacy=0x7f4d84161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d837fe640 1 -- 172.21.15.44:0/3053179906 >> v1:172.21.15.44:6789/0 conn(0x7f4d840b4880 legacy=0x7f4d840d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.633+0000 7f4d837fe640 1 -- 172.21.15.44:0/3053179906 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d840ce090 con 0x7f4d84153e60 2023-11-04T01:37:40.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.634+0000 7f4d837fe640 1 --2- 172.21.15.44:0/3053179906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d84153e60 0x7f4d8415dec0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4d740097d0 tx=0x7f4d7402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21fcd150b23158ee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.634+0000 7f4d827fc640 1 -- 172.21.15.44:0/3053179906 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c0019f0 con 0x7f4d84153e60 2023-11-04T01:37:40.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.634+0000 7f4d827fc640 1 -- 172.21.15.44:0/3053179906 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7402e050 con 0x7f4d84153e60 2023-11-04T01:37:40.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.634+0000 7f4d827fc640 1 -- 172.21.15.44:0/3053179906 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74030730 con 0x7f4d84153e60 2023-11-04T01:37:40.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.635+0000 7f4d89aaf640 1 -- 172.21.15.44:0/3053179906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d84153e60 msgr2=0x7f4d8415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.635+0000 7f4d89aaf640 1 --2- 172.21.15.44:0/3053179906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d84153e60 0x7f4d8415dec0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4d740097d0 tx=0x7f4d7402b800 comp rx=0 tx=0).stop 2023-11-04T01:37:40.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.635+0000 7f4d89aaf640 1 -- 172.21.15.44:0/3053179906 shutdown_connections 2023-11-04T01:37:40.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.635+0000 7f4d89aaf640 1 --2- 172.21.15.44:0/3053179906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d84153e60 0x7f4d8415dec0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.635+0000 7f4d89aaf640 1 -- 172.21.15.44:0/3053179906 >> 172.21.15.44:0/3053179906 conn(0x7f4d840cf880 msgr2=0x7f4d840cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:40.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.635+0000 7f4d89aaf640 1 -- 172.21.15.44:0/3053179906 shutdown_connections 2023-11-04T01:37:40.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.635+0000 7f4d89aaf640 1 -- 172.21.15.44:0/3053179906 wait complete. 2023-11-04T01:37:40.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.636+0000 7f4d89aaf640 1 Processor -- start 2023-11-04T01:37:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.636+0000 7f4d89aaf640 1 -- start start 2023-11-04T01:37:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d89aaf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d840b4880 0x7f4d841f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d89aaf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d840cd6d0 0x7f4d840c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d89aaf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d84153e60 0x7f4d841545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d89aaf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d840c6930 con 0x7f4d84153e60 2023-11-04T01:37:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d89aaf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d84154df0 con 0x7f4d840b4880 2023-11-04T01:37:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d89aaf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d840c8710 con 0x7f4d840cd6d0 2023-11-04T01:37:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d83fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d84153e60 0x7f4d841545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d83fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d84153e60 0x7f4d841545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60224/0 (socket says 172.21.15.44:60224) 2023-11-04T01:37:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d83fff640 1 -- 172.21.15.44:0/3674124524 learned_addr learned my addr 172.21.15.44:0/3674124524 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d82ffd640 1 --2- 172.21.15.44:0/3674124524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d840cd6d0 0x7f4d840c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d837fe640 1 --2- 172.21.15.44:0/3674124524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d840b4880 0x7f4d841f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d83fff640 1 -- 172.21.15.44:0/3674124524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d840cd6d0 msgr2=0x7f4d840c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d83fff640 1 --2- 172.21.15.44:0/3674124524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d840cd6d0 0x7f4d840c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d83fff640 1 -- 172.21.15.44:0/3674124524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d840b4880 msgr2=0x7f4d841f37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d83fff640 1 --2- 172.21.15.44:0/3674124524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d840b4880 0x7f4d841f37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.637+0000 7f4d83fff640 1 -- 172.21.15.44:0/3674124524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d74009400 con 0x7f4d84153e60 2023-11-04T01:37:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.638+0000 7f4d83fff640 1 --2- 172.21.15.44:0/3674124524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d84153e60 0x7f4d841545a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c001fa0 tx=0x7f4d7c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.638+0000 7f4d6bfff640 1 -- 172.21.15.44:0/3674124524 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c012400 con 0x7f4d84153e60 2023-11-04T01:37:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.638+0000 7f4d6bfff640 1 -- 172.21.15.44:0/3674124524 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c012560 con 0x7f4d84153e60 2023-11-04T01:37:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.638+0000 7f4d6bfff640 1 -- 172.21.15.44:0/3674124524 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c012910 con 0x7f4d84153e60 2023-11-04T01:37:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.638+0000 7f4d89aaf640 1 -- 172.21.15.44:0/3674124524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d840c89e0 con 0x7f4d84153e60 2023-11-04T01:37:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.638+0000 7f4d89aaf640 1 -- 172.21.15.44:0/3674124524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d840c8fa0 con 0x7f4d84153e60 2023-11-04T01:37:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.639+0000 7f4d89aaf640 1 -- 172.21.15.44:0/3674124524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d84074290 con 0x7f4d84153e60 2023-11-04T01:37:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.639+0000 7f4d6bfff640 1 -- 172.21.15.44:0/3674124524 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d7c012a70 con 0x7f4d84153e60 2023-11-04T01:37:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.640+0000 7f4d6bfff640 1 --2- 172.21.15.44:0/3674124524 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4d7006ae70 0x7f4d7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.640+0000 7f4d6bfff640 1 -- 172.21.15.44:0/3674124524 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6439+0+0 (secure 0 0 0) 0x7f4d7c089fe0 con 0x7f4d84153e60 2023-11-04T01:37:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.640+0000 7f4d837fe640 1 --2- 172.21.15.44:0/3674124524 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4d7006ae70 0x7f4d7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.640+0000 7f4d837fe640 1 --2- 172.21.15.44:0/3674124524 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4d7006ae70 0x7f4d7006d330 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4d74034000 tx=0x7f4d74008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.645+0000 7f4d6bfff640 1 -- 172.21.15.44:0/3674124524 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d7c054e20 con 0x7f4d84153e60 2023-11-04T01:37:40.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.818+0000 7f4d89aaf640 1 -- 172.21.15.44:0/3674124524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f4d840c66e0 con 0x7f4d84153e60 2023-11-04T01:37:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.818+0000 7f4d6bfff640 1 -- 172.21.15.44:0/3674124524 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v43) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4d7c058440 con 0x7f4d84153e60 2023-11-04T01:37:40.820 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:37:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.820+0000 7f4d89aaf640 1 -- 172.21.15.44:0/3674124524 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4d7006ae70 msgr2=0x7f4d7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.820+0000 7f4d89aaf640 1 --2- 172.21.15.44:0/3674124524 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4d7006ae70 0x7f4d7006d330 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4d74034000 tx=0x7f4d74008030 comp rx=0 tx=0).stop 2023-11-04T01:37:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.820+0000 7f4d89aaf640 1 -- 172.21.15.44:0/3674124524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d84153e60 msgr2=0x7f4d841545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.820+0000 7f4d89aaf640 1 --2- 172.21.15.44:0/3674124524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d84153e60 0x7f4d841545a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c001fa0 tx=0x7f4d7c00a430 comp rx=0 tx=0).stop 2023-11-04T01:37:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.820+0000 7f4d89aaf640 1 -- 172.21.15.44:0/3674124524 shutdown_connections 2023-11-04T01:37:40.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.820+0000 7f4d89aaf640 1 --2- 172.21.15.44:0/3674124524 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4d7006ae70 0x7f4d7006d330 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.820+0000 7f4d89aaf640 1 --2- 172.21.15.44:0/3674124524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d84153e60 0x7f4d841545a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.820+0000 7f4d89aaf640 1 --2- 172.21.15.44:0/3674124524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d840cd6d0 0x7f4d840c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.820+0000 7f4d89aaf640 1 --2- 172.21.15.44:0/3674124524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d840b4880 0x7f4d841f37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.820+0000 7f4d89aaf640 1 -- 172.21.15.44:0/3674124524 >> 172.21.15.44:0/3674124524 conn(0x7f4d840cf880 msgr2=0x7f4d8415e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:40.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.820+0000 7f4d89aaf640 1 -- 172.21.15.44:0/3674124524 shutdown_connections 2023-11-04T01:37:40.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.820+0000 7f4d89aaf640 1 -- 172.21.15.44:0/3674124524 wait complete. 2023-11-04T01:37:40.833 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:40.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.938+0000 7f1aacc21640 1 Processor -- start 2023-11-04T01:37:40.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.938+0000 7f1aacc21640 1 -- start start 2023-11-04T01:37:40.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.939+0000 7f1aacc21640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1aa80ce370 0x7f1aa806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.939+0000 7f1aacc21640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa806e060 con 0x7f1aa80b0ae0 2023-11-04T01:37:40.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.939+0000 7f1aacc21640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa80b4110 con 0x7f1aa8159c70 2023-11-04T01:37:40.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.939+0000 7f1aacc21640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa80b49b0 con 0x7f1aa80ce370 2023-11-04T01:37:40.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.939+0000 7f1aa6d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1aa80ce370 0x7f1aa806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.939+0000 7f1aa5d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1aa80b0ae0 0x7f1aa815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57866/0 (socket says 172.21.15.44:57866) 2023-11-04T01:37:40.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.939+0000 7f1aa5d9b640 1 -- 172.21.15.44:0/4061162949 learned_addr learned my addr 172.21.15.44:0/4061162949 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:40.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.940+0000 7f1aa6d9d640 1 -- 172.21.15.44:0/4061162949 >> v1:172.21.15.204:6789/0 conn(0x7f1aa8159c70 legacy=0x7f1aa80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.940+0000 7f1aa6d9d640 1 -- 172.21.15.44:0/4061162949 >> v1:172.21.15.44:6789/0 conn(0x7f1aa80b0ae0 legacy=0x7f1aa815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.940+0000 7f1aa559a640 1 -- 172.21.15.44:0/4061162949 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816586326 0 0) 0x7f1aa806e060 con 0x7f1aa80b0ae0 2023-11-04T01:37:40.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.940+0000 7f1aa6d9d640 1 -- 172.21.15.44:0/4061162949 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa80b43f0 con 0x7f1aa80ce370 2023-11-04T01:37:40.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.940+0000 7f1aa6d9d640 1 --2- 172.21.15.44:0/4061162949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa80ce370 0x7f1aa806db20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1aa806e1f0 tx=0x7f1a9802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508bc99450909ba5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.941+0000 7f1aa559a640 1 -- 172.21.15.44:0/4061162949 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9802cce0 con 0x7f1aa80ce370 2023-11-04T01:37:40.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.941+0000 7f1aa559a640 1 -- 172.21.15.44:0/4061162949 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9802ce40 con 0x7f1aa80ce370 2023-11-04T01:37:40.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.941+0000 7f1aa559a640 1 -- 172.21.15.44:0/4061162949 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98034660 con 0x7f1aa80ce370 2023-11-04T01:37:40.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.941+0000 7f1aacc21640 1 -- 172.21.15.44:0/4061162949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa80ce370 msgr2=0x7f1aa806db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.941+0000 7f1aacc21640 1 --2- 172.21.15.44:0/4061162949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa80ce370 0x7f1aa806db20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1aa806e1f0 tx=0x7f1a9802bf30 comp rx=0 tx=0).stop 2023-11-04T01:37:40.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.941+0000 7f1aacc21640 1 -- 172.21.15.44:0/4061162949 shutdown_connections 2023-11-04T01:37:40.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.941+0000 7f1aacc21640 1 --2- 172.21.15.44:0/4061162949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa80ce370 0x7f1aa806db20 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.941+0000 7f1aacc21640 1 -- 172.21.15.44:0/4061162949 >> 172.21.15.44:0/4061162949 conn(0x7f1aa80ce950 msgr2=0x7f1aa80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:40.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.941+0000 7f1aacc21640 1 -- 172.21.15.44:0/4061162949 shutdown_connections 2023-11-04T01:37:40.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.941+0000 7f1aacc21640 1 -- 172.21.15.44:0/4061162949 wait complete. 2023-11-04T01:37:40.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.943+0000 7f1aacc21640 1 Processor -- start 2023-11-04T01:37:40.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.943+0000 7f1aacc21640 1 -- start start 2023-11-04T01:37:40.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.943+0000 7f1aacc21640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa80b0ae0 0x7f1aa80ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.943+0000 7f1aacc21640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1aa80ce370 0x7f1aa81f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.943+0000 7f1aacc21640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1aa8159c70 0x7f1aa815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.943+0000 7f1aacc21640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa80ce7e0 con 0x7f1aa80b0ae0 2023-11-04T01:37:40.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.943+0000 7f1aacc21640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa815c0e0 con 0x7f1aa80ce370 2023-11-04T01:37:40.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.943+0000 7f1aacc21640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa815b5e0 con 0x7f1aa8159c70 2023-11-04T01:37:40.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.943+0000 7f1aa659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa80b0ae0 0x7f1aa80ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.943+0000 7f1aa659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa80b0ae0 0x7f1aa80ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60242/0 (socket says 172.21.15.44:60242) 2023-11-04T01:37:40.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.944+0000 7f1aa659c640 1 -- 172.21.15.44:0/2692982613 learned_addr learned my addr 172.21.15.44:0/2692982613 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:40.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.944+0000 7f1aa6d9d640 1 --2- 172.21.15.44:0/2692982613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1aa8159c70 0x7f1aa815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.944+0000 7f1aa5d9b640 1 --2- 172.21.15.44:0/2692982613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1aa80ce370 0x7f1aa81f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.944+0000 7f1aa659c640 1 -- 172.21.15.44:0/2692982613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1aa8159c70 msgr2=0x7f1aa815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.944+0000 7f1aa659c640 1 --2- 172.21.15.44:0/2692982613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1aa8159c70 0x7f1aa815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.944+0000 7f1aa659c640 1 -- 172.21.15.44:0/2692982613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1aa80ce370 msgr2=0x7f1aa81f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.944+0000 7f1aa659c640 1 --2- 172.21.15.44:0/2692982613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1aa80ce370 0x7f1aa81f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.944+0000 7f1aa659c640 1 -- 172.21.15.44:0/2692982613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a98009a70 con 0x7f1aa80b0ae0 2023-11-04T01:37:40.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.944+0000 7f1aa659c640 1 --2- 172.21.15.44:0/2692982613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa80b0ae0 0x7f1aa80ab8e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000c400 tx=0x7f1aa000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.944+0000 7f1a96ffd640 1 -- 172.21.15.44:0/2692982613 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa00052d0 con 0x7f1aa80b0ae0 2023-11-04T01:37:40.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.944+0000 7f1a96ffd640 1 -- 172.21.15.44:0/2692982613 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa0005430 con 0x7f1aa80b0ae0 2023-11-04T01:37:40.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.944+0000 7f1aacc21640 1 -- 172.21.15.44:0/2692982613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa815b840 con 0x7f1aa80b0ae0 2023-11-04T01:37:40.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.944+0000 7f1a96ffd640 1 -- 172.21.15.44:0/2692982613 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0003830 con 0x7f1aa80b0ae0 2023-11-04T01:37:40.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.944+0000 7f1aacc21640 1 -- 172.21.15.44:0/2692982613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa815be00 con 0x7f1aa80b0ae0 2023-11-04T01:37:40.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.945+0000 7f1aacc21640 1 -- 172.21.15.44:0/2692982613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa8074290 con 0x7f1aa80b0ae0 2023-11-04T01:37:40.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.946+0000 7f1a96ffd640 1 -- 172.21.15.44:0/2692982613 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1aa0003990 con 0x7f1aa80b0ae0 2023-11-04T01:37:40.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.946+0000 7f1a96ffd640 1 --2- 172.21.15.44:0/2692982613 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a8806ae70 0x7f1a8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.946+0000 7f1a96ffd640 1 -- 172.21.15.44:0/2692982613 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6439+0+0 (secure 0 0 0) 0x7f1aa0088db0 con 0x7f1aa80b0ae0 2023-11-04T01:37:40.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.946+0000 7f1aa5d9b640 1 --2- 172.21.15.44:0/2692982613 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a8806ae70 0x7f1a8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.947+0000 7f1aa5d9b640 1 --2- 172.21.15.44:0/2692982613 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a8806ae70 0x7f1a8806d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c000f60 tx=0x7f1a9c007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:40.950+0000 7f1a96ffd640 1 -- 172.21.15.44:0/2692982613 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1aa0053c40 con 0x7f1aa80b0ae0 2023-11-04T01:37:41.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.162+0000 7f1aacc21640 1 -- 172.21.15.44:0/2692982613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1aa806d3f0 con 0x7f1aa80b0ae0 2023-11-04T01:37:41.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.163+0000 7f1a96ffd640 1 -- 172.21.15.44:0/2692982613 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f1aa0057260 con 0x7f1aa80b0ae0 2023-11-04T01:37:41.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:41.164 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5024,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/620952929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":620952929},{"type":"v1","addr":"172.21.15.44:6834","nonce":620952929}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2082760690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":2082760690},{"type":"v1","addr":"172.21.15.204:6836","nonce":2082760690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5323,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2330742876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2330742876},{"type":"v1","addr":"172.21.15.204:6837","nonce":2330742876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:21.307124+0000","modified":"2023-11-04T01:37:23.300604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5514":{"gid":5514,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/2457583329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2457583329},{"type":"v1","addr":"172.21.15.44:6835","nonce":2457583329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:37:41.164 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 15 2023-11-04T01:37:41.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.164+0000 7f1aacc21640 1 -- 172.21.15.44:0/2692982613 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a8806ae70 msgr2=0x7f1a8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.164+0000 7f1aacc21640 1 --2- 172.21.15.44:0/2692982613 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a8806ae70 0x7f1a8806d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c000f60 tx=0x7f1a9c007d50 comp rx=0 tx=0).stop 2023-11-04T01:37:41.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.164+0000 7f1aacc21640 1 -- 172.21.15.44:0/2692982613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa80b0ae0 msgr2=0x7f1aa80ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.164+0000 7f1aacc21640 1 --2- 172.21.15.44:0/2692982613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa80b0ae0 0x7f1aa80ab8e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000c400 tx=0x7f1aa000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.165+0000 7f1aacc21640 1 -- 172.21.15.44:0/2692982613 shutdown_connections 2023-11-04T01:37:41.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.165+0000 7f1aacc21640 1 --2- 172.21.15.44:0/2692982613 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a8806ae70 0x7f1a8806d330 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.165+0000 7f1aacc21640 1 --2- 172.21.15.44:0/2692982613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1aa8159c70 0x7f1aa815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.165+0000 7f1aacc21640 1 --2- 172.21.15.44:0/2692982613 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1aa80ce370 0x7f1aa81f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.165+0000 7f1aacc21640 1 --2- 172.21.15.44:0/2692982613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa80b0ae0 0x7f1aa80ab8e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.165+0000 7f1aacc21640 1 -- 172.21.15.44:0/2692982613 >> 172.21.15.44:0/2692982613 conn(0x7f1aa80ce950 msgr2=0x7f1aa815d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:41.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.165+0000 7f1aacc21640 1 -- 172.21.15.44:0/2692982613 shutdown_connections 2023-11-04T01:37:41.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.165+0000 7f1aacc21640 1 -- 172.21.15.44:0/2692982613 wait complete. 2023-11-04T01:37:41.177 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:41.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.284+0000 7f30ff1c9640 1 Processor -- start 2023-11-04T01:37:41.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.284+0000 7f30ff1c9640 1 -- start start 2023-11-04T01:37:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.285+0000 7f30ff1c9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f30f80cde60 0x7f30f815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.285+0000 7f30ff1c9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f30f80ce240 0x7f30f80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.285+0000 7f30ff1c9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f815e000 con 0x7f30f815daa0 2023-11-04T01:37:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.285+0000 7f30ff1c9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f815e5c0 con 0x7f30f80ce240 2023-11-04T01:37:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.285+0000 7f30ff1c9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f815e2e0 con 0x7f30f80cde60 2023-11-04T01:37:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.285+0000 7f30fd766640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f30f80ce240 0x7f30f80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.285+0000 7f30fd766640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f30f80ce240 0x7f30f80d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60244/0 (socket says 172.21.15.44:60244) 2023-11-04T01:37:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.285+0000 7f30fd766640 1 -- 172.21.15.44:0/921602251 learned_addr learned my addr 172.21.15.44:0/921602251 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.286+0000 7f30fcf65640 1 --2- 172.21.15.44:0/921602251 >> v2:172.21.15.204:3300/0 conn(0x7f30f80cde60 0x7f30f815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.286+0000 7f30fd766640 1 -- 172.21.15.44:0/921602251 >> v2:172.21.15.204:3300/0 conn(0x7f30f80cde60 msgr2=0x7f30f815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.286+0000 7f30fd766640 1 --2- 172.21.15.44:0/921602251 >> v2:172.21.15.204:3300/0 conn(0x7f30f80cde60 0x7f30f815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.286+0000 7f30fd766640 1 -- 172.21.15.44:0/921602251 >> v1:172.21.15.204:6789/0 conn(0x7f30f815daa0 legacy=0x7f30f8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.286+0000 7f30fd766640 1 -- 172.21.15.44:0/921602251 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f80d1120 con 0x7f30f80ce240 2023-11-04T01:37:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.286+0000 7f30fd766640 1 --2- 172.21.15.44:0/921602251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f80ce240 0x7f30f80d1920 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f30f80b5550 tx=0x7f30e002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd97b086ad34a3a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.287+0000 7f30f77fe640 1 -- 172.21.15.44:0/921602251 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0030860 con 0x7f30f80ce240 2023-11-04T01:37:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.287+0000 7f30f77fe640 1 -- 172.21.15.44:0/921602251 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e00309c0 con 0x7f30f80ce240 2023-11-04T01:37:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.287+0000 7f30f77fe640 1 -- 172.21.15.44:0/921602251 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0030d50 con 0x7f30f80ce240 2023-11-04T01:37:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.287+0000 7f30ff1c9640 1 -- 172.21.15.44:0/921602251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f80ce240 msgr2=0x7f30f80d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.287+0000 7f30ff1c9640 1 --2- 172.21.15.44:0/921602251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f80ce240 0x7f30f80d1920 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f30f80b5550 tx=0x7f30e002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.287+0000 7f30ff1c9640 1 -- 172.21.15.44:0/921602251 shutdown_connections 2023-11-04T01:37:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.287+0000 7f30ff1c9640 1 --2- 172.21.15.44:0/921602251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f80ce240 0x7f30f80d1920 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.287+0000 7f30ff1c9640 1 --2- 172.21.15.44:0/921602251 >> v2:172.21.15.204:3300/0 conn(0x7f30f80cde60 0x7f30f815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.287+0000 7f30ff1c9640 1 -- 172.21.15.44:0/921602251 >> 172.21.15.44:0/921602251 conn(0x7f30f8071f30 msgr2=0x7f30f80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.287+0000 7f30ff1c9640 1 -- 172.21.15.44:0/921602251 shutdown_connections 2023-11-04T01:37:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.287+0000 7f30ff1c9640 1 -- 172.21.15.44:0/921602251 wait complete. 2023-11-04T01:37:41.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.288+0000 7f30ff1c9640 1 Processor -- start 2023-11-04T01:37:41.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.288+0000 7f30ff1c9640 1 -- start start 2023-11-04T01:37:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.289+0000 7f30ff1c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f80cde60 0x7f30f80ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.289+0000 7f30ff1c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f80ce240 0x7f30f814b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.289+0000 7f30ff1c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30f815daa0 0x7f30f80d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.289+0000 7f30ff1c9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80cae40 con 0x7f30f80ce240 2023-11-04T01:37:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.289+0000 7f30ff1c9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80cc830 con 0x7f30f80cde60 2023-11-04T01:37:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.289+0000 7f30ff1c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80cbcb0 con 0x7f30f815daa0 2023-11-04T01:37:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.289+0000 7f30f7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f80ce240 0x7f30f814b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.289+0000 7f30f7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f80ce240 0x7f30f814b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60260/0 (socket says 172.21.15.44:60260) 2023-11-04T01:37:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.289+0000 7f30f7fff640 1 -- 172.21.15.44:0/577438924 learned_addr learned my addr 172.21.15.44:0/577438924 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.290+0000 7f30fd766640 1 --2- 172.21.15.44:0/577438924 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30f815daa0 0x7f30f80d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.290+0000 7f30fcf65640 1 --2- 172.21.15.44:0/577438924 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f80cde60 0x7f30f80ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.290+0000 7f30f7fff640 1 -- 172.21.15.44:0/577438924 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30f815daa0 msgr2=0x7f30f80d1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.290+0000 7f30f7fff640 1 --2- 172.21.15.44:0/577438924 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30f815daa0 0x7f30f80d1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.290+0000 7f30f7fff640 1 -- 172.21.15.44:0/577438924 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f80cde60 msgr2=0x7f30f80ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.290+0000 7f30f7fff640 1 --2- 172.21.15.44:0/577438924 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f80cde60 0x7f30f80ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.290+0000 7f30f7fff640 1 -- 172.21.15.44:0/577438924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e00094d0 con 0x7f30f80ce240 2023-11-04T01:37:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.290+0000 7f30f7fff640 1 --2- 172.21.15.44:0/577438924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f80ce240 0x7f30f814b320 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f30e800c3c0 tx=0x7f30e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:41.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.290+0000 7f30f57fa640 1 -- 172.21.15.44:0/577438924 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e80052d0 con 0x7f30f80ce240 2023-11-04T01:37:41.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.290+0000 7f30f57fa640 1 -- 172.21.15.44:0/577438924 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8005450 con 0x7f30f80ce240 2023-11-04T01:37:41.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.290+0000 7f30f57fa640 1 -- 172.21.15.44:0/577438924 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8003830 con 0x7f30f80ce240 2023-11-04T01:37:41.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.290+0000 7f30ff1c9640 1 -- 172.21.15.44:0/577438924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f80cbf90 con 0x7f30f80ce240 2023-11-04T01:37:41.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.290+0000 7f30ff1c9640 1 -- 172.21.15.44:0/577438924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f80cc550 con 0x7f30f80ce240 2023-11-04T01:37:41.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.291+0000 7f30ff1c9640 1 -- 172.21.15.44:0/577438924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f814f000 con 0x7f30f80ce240 2023-11-04T01:37:41.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.291+0000 7f30f57fa640 1 -- 172.21.15.44:0/577438924 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f30e8003990 con 0x7f30f80ce240 2023-11-04T01:37:41.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.292+0000 7f30f57fa640 1 --2- 172.21.15.44:0/577438924 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f30d806ae70 0x7f30d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.292+0000 7f30f57fa640 1 -- 172.21.15.44:0/577438924 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6439+0+0 (secure 0 0 0) 0x7f30e8088de0 con 0x7f30f80ce240 2023-11-04T01:37:41.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.292+0000 7f30fcf65640 1 --2- 172.21.15.44:0/577438924 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f30d806ae70 0x7f30d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.293+0000 7f30fcf65640 1 --2- 172.21.15.44:0/577438924 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f30d806ae70 0x7f30d806d330 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009a60 tx=0x7f30f0003990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:41.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.296+0000 7f30f57fa640 1 -- 172.21.15.44:0/577438924 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f30f814f000 con 0x7f30f80ce240 2023-11-04T01:37:41.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.474+0000 7f30ff1c9640 1 -- 172.21.15.44:0/577438924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30f814f000 con 0x7f30f80ce240 2023-11-04T01:37:41.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.476+0000 7f30f57fa640 1 -- 172.21.15.44:0/577438924 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18563 (secure 0 0 0) 0x7f30f814f000 con 0x7f30f80ce240 2023-11-04T01:37:41.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:41.477 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":44,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:41.242460+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:19.141183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:20.292111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.35","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:41.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.478+0000 7f30ff1c9640 1 -- 172.21.15.44:0/577438924 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f30d806ae70 msgr2=0x7f30d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.478+0000 7f30ff1c9640 1 --2- 172.21.15.44:0/577438924 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f30d806ae70 0x7f30d806d330 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009a60 tx=0x7f30f0003990 comp rx=0 tx=0).stop 2023-11-04T01:37:41.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.478+0000 7f30ff1c9640 1 -- 172.21.15.44:0/577438924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f80ce240 msgr2=0x7f30f814b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.478+0000 7f30ff1c9640 1 --2- 172.21.15.44:0/577438924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f80ce240 0x7f30f814b320 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f30e800c3c0 tx=0x7f30e800c880 comp rx=0 tx=0).stop 2023-11-04T01:37:41.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.478+0000 7f30ff1c9640 1 -- 172.21.15.44:0/577438924 shutdown_connections 2023-11-04T01:37:41.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.478+0000 7f30ff1c9640 1 --2- 172.21.15.44:0/577438924 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f30d806ae70 0x7f30d806d330 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.478+0000 7f30ff1c9640 1 --2- 172.21.15.44:0/577438924 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30f815daa0 0x7f30f80d1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.478+0000 7f30ff1c9640 1 --2- 172.21.15.44:0/577438924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f80ce240 0x7f30f814b320 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.478+0000 7f30ff1c9640 1 --2- 172.21.15.44:0/577438924 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f80cde60 0x7f30f80ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.478+0000 7f30ff1c9640 1 -- 172.21.15.44:0/577438924 >> 172.21.15.44:0/577438924 conn(0x7f30f8071f30 msgr2=0x7f30f80b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:41.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.478+0000 7f30ff1c9640 1 -- 172.21.15.44:0/577438924 shutdown_connections 2023-11-04T01:37:41.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.478+0000 7f30ff1c9640 1 -- 172.21.15.44:0/577438924 wait complete. 2023-11-04T01:37:41.490 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:37:41.490 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:41.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.596+0000 7f20511e2640 1 Processor -- start 2023-11-04T01:37:41.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.596+0000 7f20511e2640 1 -- start start 2023-11-04T01:37:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.596+0000 7f20511e2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f204c157710 0x7f204c167b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.596+0000 7f20511e2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204c15e000 con 0x7f204c0cde60 2023-11-04T01:37:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.596+0000 7f20511e2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204c15e2e0 con 0x7f204c0ce240 2023-11-04T01:37:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.596+0000 7f20511e2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204c15e5c0 con 0x7f204c157710 2023-11-04T01:37:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.597+0000 7f204b59e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f204c157710 0x7f204c167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.597+0000 7f204ad9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f204c0cde60 0x7f204c15d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57868/0 (socket says 172.21.15.44:57868) 2023-11-04T01:37:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.597+0000 7f204ad9d640 1 -- 172.21.15.44:0/1560550438 learned_addr learned my addr 172.21.15.44:0/1560550438 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.597+0000 7f204b59e640 1 -- 172.21.15.44:0/1560550438 >> v1:172.21.15.204:6789/0 conn(0x7f204c0ce240 legacy=0x7f204c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.597+0000 7f204b59e640 1 -- 172.21.15.44:0/1560550438 >> v1:172.21.15.44:6789/0 conn(0x7f204c0cde60 legacy=0x7f204c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.597+0000 7f204a59c640 1 -- 172.21.15.44:0/1560550438 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141451343 0 0) 0x7f204c15e000 con 0x7f204c0cde60 2023-11-04T01:37:41.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.597+0000 7f204b59e640 1 -- 172.21.15.44:0/1560550438 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c0d1120 con 0x7f204c157710 2023-11-04T01:37:41.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.598+0000 7f204b59e640 1 --2- 172.21.15.44:0/1560550438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f204c157710 0x7f204c167b90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2044009d90 tx=0x7f204402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cf94093ac41eec server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:41.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.598+0000 7f204a59c640 1 -- 172.21.15.44:0/1560550438 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204402cd00 con 0x7f204c157710 2023-11-04T01:37:41.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.598+0000 7f204a59c640 1 -- 172.21.15.44:0/1560550438 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204402ce60 con 0x7f204c157710 2023-11-04T01:37:41.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.598+0000 7f204a59c640 1 -- 172.21.15.44:0/1560550438 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2044034660 con 0x7f204c157710 2023-11-04T01:37:41.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.598+0000 7f20511e2640 1 -- 172.21.15.44:0/1560550438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f204c157710 msgr2=0x7f204c167b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.598+0000 7f20511e2640 1 --2- 172.21.15.44:0/1560550438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f204c157710 0x7f204c167b90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2044009d90 tx=0x7f204402bf50 comp rx=0 tx=0).stop 2023-11-04T01:37:41.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.598+0000 7f20511e2640 1 -- 172.21.15.44:0/1560550438 shutdown_connections 2023-11-04T01:37:41.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.598+0000 7f20511e2640 1 --2- 172.21.15.44:0/1560550438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f204c157710 0x7f204c167b90 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.598+0000 7f20511e2640 1 -- 172.21.15.44:0/1560550438 >> 172.21.15.44:0/1560550438 conn(0x7f204c071f30 msgr2=0x7f204c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:41.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.598+0000 7f20511e2640 1 -- 172.21.15.44:0/1560550438 shutdown_connections 2023-11-04T01:37:41.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.598+0000 7f20511e2640 1 -- 172.21.15.44:0/1560550438 wait complete. 2023-11-04T01:37:41.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.600+0000 7f20511e2640 1 Processor -- start 2023-11-04T01:37:41.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.600+0000 7f20511e2640 1 -- start start 2023-11-04T01:37:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f20511e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f204c0cde60 0x7f204c0ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f20511e2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f204c0ce240 0x7f204c14b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f20511e2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f204c157710 0x7f204c1f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f20511e2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0c9ef0 con 0x7f204c0cde60 2023-11-04T01:37:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f20511e2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0cae40 con 0x7f204c157710 2023-11-04T01:37:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f20511e2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c1f3530 con 0x7f204c0ce240 2023-11-04T01:37:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f204ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f204c0cde60 0x7f204c0ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f204ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f204c0cde60 0x7f204c0ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60276/0 (socket says 172.21.15.44:60276) 2023-11-04T01:37:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f204ad9d640 1 -- 172.21.15.44:0/418612600 learned_addr learned my addr 172.21.15.44:0/418612600 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f2043fff640 1 --2- 172.21.15.44:0/418612600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f204c0ce240 0x7f204c14b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f204ad9d640 1 -- 172.21.15.44:0/418612600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f204c0ce240 msgr2=0x7f204c14b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f204ad9d640 1 --2- 172.21.15.44:0/418612600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f204c0ce240 0x7f204c14b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f204b59e640 1 --2- 172.21.15.44:0/418612600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f204c157710 0x7f204c1f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f204ad9d640 1 -- 172.21.15.44:0/418612600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f204c157710 msgr2=0x7f204c1f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f204ad9d640 1 --2- 172.21.15.44:0/418612600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f204c157710 0x7f204c1f2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f204ad9d640 1 -- 172.21.15.44:0/418612600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2044009a70 con 0x7f204c0cde60 2023-11-04T01:37:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f2043fff640 1 --2- 172.21.15.44:0/418612600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f204c0ce240 0x7f204c14b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f204ad9d640 1 --2- 172.21.15.44:0/418612600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f204c0cde60 0x7f204c0ca900 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f203c00c4a0 tx=0x7f203c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f20437fe640 1 -- 172.21.15.44:0/418612600 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c0074e0 con 0x7f204c0cde60 2023-11-04T01:37:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f20437fe640 1 -- 172.21.15.44:0/418612600 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c007640 con 0x7f204c0cde60 2023-11-04T01:37:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f20511e2640 1 -- 172.21.15.44:0/418612600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204c1f3810 con 0x7f204c0cde60 2023-11-04T01:37:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f20437fe640 1 -- 172.21.15.44:0/418612600 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c004a00 con 0x7f204c0cde60 2023-11-04T01:37:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.601+0000 7f20511e2640 1 -- 172.21.15.44:0/418612600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c0ca3e0 con 0x7f204c0cde60 2023-11-04T01:37:41.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.602+0000 7f20511e2640 1 -- 172.21.15.44:0/418612600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204c0ca5d0 con 0x7f204c0cde60 2023-11-04T01:37:41.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.603+0000 7f20437fe640 1 -- 172.21.15.44:0/418612600 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f203c004b60 con 0x7f204c0cde60 2023-11-04T01:37:41.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.603+0000 7f20437fe640 1 --2- 172.21.15.44:0/418612600 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f202c06ae70 0x7f202c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.603+0000 7f20437fe640 1 -- 172.21.15.44:0/418612600 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6439+0+0 (secure 0 0 0) 0x7f203c088e10 con 0x7f204c0cde60 2023-11-04T01:37:41.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.604+0000 7f2043fff640 1 --2- 172.21.15.44:0/418612600 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f202c06ae70 0x7f202c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.604+0000 7f2043fff640 1 --2- 172.21.15.44:0/418612600 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f202c06ae70 0x7f202c06d330 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f204c1580c0 tx=0x7f2034009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:41.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.607+0000 7f20437fe640 1 -- 172.21.15.44:0/418612600 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f203c053be0 con 0x7f204c0cde60 2023-11-04T01:37:41.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.820+0000 7f20511e2640 1 -- 172.21.15.44:0/418612600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f204c074290 con 0x7f204c0cde60 2023-11-04T01:37:41.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.821+0000 7f20437fe640 1 -- 172.21.15.44:0/418612600 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f203c018020 con 0x7f204c0cde60 2023-11-04T01:37:41.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:41.822 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5024,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/620952929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":620952929},{"type":"v1","addr":"172.21.15.44:6834","nonce":620952929}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2082760690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":2082760690},{"type":"v1","addr":"172.21.15.204:6836","nonce":2082760690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5323,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2330742876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2330742876},{"type":"v1","addr":"172.21.15.204:6837","nonce":2330742876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:21.307124+0000","modified":"2023-11-04T01:37:23.300604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5514":{"gid":5514,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/2457583329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2457583329},{"type":"v1","addr":"172.21.15.44:6835","nonce":2457583329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:37:41.822 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 15 2023-11-04T01:37:41.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.822+0000 7f20511e2640 1 -- 172.21.15.44:0/418612600 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f202c06ae70 msgr2=0x7f202c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.822+0000 7f20511e2640 1 --2- 172.21.15.44:0/418612600 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f202c06ae70 0x7f202c06d330 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f204c1580c0 tx=0x7f2034009040 comp rx=0 tx=0).stop 2023-11-04T01:37:41.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.822+0000 7f20511e2640 1 -- 172.21.15.44:0/418612600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f204c0cde60 msgr2=0x7f204c0ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.822+0000 7f20511e2640 1 --2- 172.21.15.44:0/418612600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f204c0cde60 0x7f204c0ca900 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f203c00c4a0 tx=0x7f203c00c960 comp rx=0 tx=0).stop 2023-11-04T01:37:41.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.823+0000 7f20511e2640 1 -- 172.21.15.44:0/418612600 shutdown_connections 2023-11-04T01:37:41.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.823+0000 7f20511e2640 1 --2- 172.21.15.44:0/418612600 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f202c06ae70 0x7f202c06d330 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.823+0000 7f20511e2640 1 --2- 172.21.15.44:0/418612600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f204c157710 0x7f204c1f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.823+0000 7f20511e2640 1 --2- 172.21.15.44:0/418612600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f204c0ce240 0x7f204c14b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.823+0000 7f20511e2640 1 --2- 172.21.15.44:0/418612600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f204c0cde60 0x7f204c0ca900 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.823+0000 7f20511e2640 1 -- 172.21.15.44:0/418612600 >> 172.21.15.44:0/418612600 conn(0x7f204c071f30 msgr2=0x7f204c0d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:41.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.823+0000 7f20511e2640 1 -- 172.21.15.44:0/418612600 shutdown_connections 2023-11-04T01:37:41.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.823+0000 7f20511e2640 1 -- 172.21.15.44:0/418612600 wait complete. 2023-11-04T01:37:41.834 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:41.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.939+0000 7f119959e640 1 Processor -- start 2023-11-04T01:37:41.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.940+0000 7f119959e640 1 -- start start 2023-11-04T01:37:41.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.940+0000 7f119959e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f11940d0ff0 0x7f11940b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.940+0000 7f119959e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11940b8540 0x7f11940b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.940+0000 7f119959e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11940d14f0 con 0x7f11940d2b40 2023-11-04T01:37:41.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.940+0000 7f119959e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11940d2170 con 0x7f11940d0ff0 2023-11-04T01:37:41.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.940+0000 7f119959e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11940d17d0 con 0x7f11940b8540 2023-11-04T01:37:41.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.940+0000 7f11937fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f11940d0ff0 0x7f11940b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.940+0000 7f1193fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f11940d2b40 0x7f11940d2f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57882/0 (socket says 172.21.15.44:57882) 2023-11-04T01:37:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.941+0000 7f1193fff640 1 -- 172.21.15.44:0/3378749366 learned_addr learned my addr 172.21.15.44:0/3378749366 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.941+0000 7f1198d9d640 1 --2- 172.21.15.44:0/3378749366 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11940b8540 0x7f11940b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.941+0000 7f11937fe640 1 -- 172.21.15.44:0/3378749366 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11940b8540 msgr2=0x7f11940b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.941+0000 7f11937fe640 1 --2- 172.21.15.44:0/3378749366 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11940b8540 0x7f11940b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.941+0000 7f11937fe640 1 -- 172.21.15.44:0/3378749366 >> v1:172.21.15.44:6789/0 conn(0x7f11940d2b40 legacy=0x7f11940d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.941+0000 7f1192ffd640 1 -- 172.21.15.44:0/3378749366 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407200387 0 0) 0x7f11940d14f0 con 0x7f11940d2b40 2023-11-04T01:37:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.941+0000 7f11937fe640 1 -- 172.21.15.44:0/3378749366 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11940d1ab0 con 0x7f11940d0ff0 2023-11-04T01:37:41.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.942+0000 7f11937fe640 1 --2- 172.21.15.44:0/3378749366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11940d0ff0 0x7f11940b5d50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f11880097a0 tx=0x7f118802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822191be4b4aabf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:41.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.942+0000 7f1192ffd640 1 -- 172.21.15.44:0/3378749366 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188031830 con 0x7f11940d0ff0 2023-11-04T01:37:41.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.942+0000 7f1192ffd640 1 -- 172.21.15.44:0/3378749366 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1188031990 con 0x7f11940d0ff0 2023-11-04T01:37:41.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.942+0000 7f1192ffd640 1 -- 172.21.15.44:0/3378749366 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188031d20 con 0x7f11940d0ff0 2023-11-04T01:37:41.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.942+0000 7f119959e640 1 -- 172.21.15.44:0/3378749366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11940d0ff0 msgr2=0x7f11940b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.942+0000 7f119959e640 1 --2- 172.21.15.44:0/3378749366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11940d0ff0 0x7f11940b5d50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f11880097a0 tx=0x7f118802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.942+0000 7f119959e640 1 -- 172.21.15.44:0/3378749366 shutdown_connections 2023-11-04T01:37:41.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.942+0000 7f119959e640 1 --2- 172.21.15.44:0/3378749366 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11940b8540 0x7f11940b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.942+0000 7f119959e640 1 --2- 172.21.15.44:0/3378749366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11940d0ff0 0x7f11940b5d50 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.942+0000 7f119959e640 1 -- 172.21.15.44:0/3378749366 >> 172.21.15.44:0/3378749366 conn(0x7f1194071c70 msgr2=0x7f1194072080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:41.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.942+0000 7f119959e640 1 -- 172.21.15.44:0/3378749366 shutdown_connections 2023-11-04T01:37:41.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.942+0000 7f119959e640 1 -- 172.21.15.44:0/3378749366 wait complete. 2023-11-04T01:37:41.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.944+0000 7f119959e640 1 Processor -- start 2023-11-04T01:37:41.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.944+0000 7f119959e640 1 -- start start 2023-11-04T01:37:41.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f119959e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11940b8540 0x7f11940ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f119959e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11940d0ff0 0x7f119415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f119959e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11940d2b40 0x7f11941f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f119959e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11940ca3e0 con 0x7f11940d0ff0 2023-11-04T01:37:41.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f119959e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11940ab340 con 0x7f11940d2b40 2023-11-04T01:37:41.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f119959e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11940cad40 con 0x7f11940b8540 2023-11-04T01:37:41.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f11937fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11940d0ff0 0x7f119415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f11937fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11940d0ff0 0x7f119415bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60302/0 (socket says 172.21.15.44:60302) 2023-11-04T01:37:41.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f11937fe640 1 -- 172.21.15.44:0/50373503 learned_addr learned my addr 172.21.15.44:0/50373503 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:41.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f1193fff640 1 --2- 172.21.15.44:0/50373503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11940b8540 0x7f11940ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f11937fe640 1 -- 172.21.15.44:0/50373503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11940b8540 msgr2=0x7f11940ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f1198d9d640 1 --2- 172.21.15.44:0/50373503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11940d2b40 0x7f11941f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f11937fe640 1 --2- 172.21.15.44:0/50373503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11940b8540 0x7f11940ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f11937fe640 1 -- 172.21.15.44:0/50373503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11940d2b40 msgr2=0x7f11941f2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f11937fe640 1 --2- 172.21.15.44:0/50373503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11940d2b40 0x7f11941f2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f11937fe640 1 -- 172.21.15.44:0/50373503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1188009400 con 0x7f11940d0ff0 2023-11-04T01:37:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f1193fff640 1 --2- 172.21.15.44:0/50373503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11940b8540 0x7f11940ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f11937fe640 1 --2- 172.21.15.44:0/50373503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11940d0ff0 0x7f119415bdb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1188000c00 tx=0x7f11880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.945+0000 7f1190ff9640 1 -- 172.21.15.44:0/50373503 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188004230 con 0x7f11940d0ff0 2023-11-04T01:37:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.946+0000 7f1190ff9640 1 -- 172.21.15.44:0/50373503 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1188004390 con 0x7f11940d0ff0 2023-11-04T01:37:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.946+0000 7f119959e640 1 -- 172.21.15.44:0/50373503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11941f33e0 con 0x7f11940d0ff0 2023-11-04T01:37:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.946+0000 7f1190ff9640 1 -- 172.21.15.44:0/50373503 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118803a880 con 0x7f11940d0ff0 2023-11-04T01:37:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.946+0000 7f119959e640 1 -- 172.21.15.44:0/50373503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11941f3100 con 0x7f11940d0ff0 2023-11-04T01:37:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.947+0000 7f119959e640 1 -- 172.21.15.44:0/50373503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119404ece0 con 0x7f11940d0ff0 2023-11-04T01:37:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.947+0000 7f1190ff9640 1 -- 172.21.15.44:0/50373503 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f118803a9e0 con 0x7f11940d0ff0 2023-11-04T01:37:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.947+0000 7f1190ff9640 1 --2- 172.21.15.44:0/50373503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f118006ae70 0x7f118006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.948+0000 7f1190ff9640 1 -- 172.21.15.44:0/50373503 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6439+0+0 (secure 0 0 0) 0x7f11880ac300 con 0x7f11940d0ff0 2023-11-04T01:37:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.948+0000 7f1193fff640 1 --2- 172.21.15.44:0/50373503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f118006ae70 0x7f118006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.948+0000 7f1193fff640 1 --2- 172.21.15.44:0/50373503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f118006ae70 0x7f118006d330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1184000f60 tx=0x7f1184009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:41.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:41.952+0000 7f1190ff9640 1 -- 172.21.15.44:0/50373503 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1188077280 con 0x7f11940d0ff0 2023-11-04T01:37:42.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.163+0000 7f119959e640 1 -- 172.21.15.44:0/50373503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11940b22f0 con 0x7f11940d0ff0 2023-11-04T01:37:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.163+0000 7f1190ff9640 1 -- 172.21.15.44:0/50373503 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f118807a8a0 con 0x7f11940d0ff0 2023-11-04T01:37:42.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:42.164 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5024,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/620952929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":620952929},{"type":"v1","addr":"172.21.15.44:6834","nonce":620952929}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2082760690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":2082760690},{"type":"v1","addr":"172.21.15.204:6836","nonce":2082760690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5323,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2330742876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2330742876},{"type":"v1","addr":"172.21.15.204:6837","nonce":2330742876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:21.307124+0000","modified":"2023-11-04T01:37:23.300604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5514":{"gid":5514,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/2457583329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2457583329},{"type":"v1","addr":"172.21.15.44:6835","nonce":2457583329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:37:42.165 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 15 2023-11-04T01:37:42.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.165+0000 7f119959e640 1 -- 172.21.15.44:0/50373503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f118006ae70 msgr2=0x7f118006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.165+0000 7f119959e640 1 --2- 172.21.15.44:0/50373503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f118006ae70 0x7f118006d330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1184000f60 tx=0x7f1184009040 comp rx=0 tx=0).stop 2023-11-04T01:37:42.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.165+0000 7f119959e640 1 -- 172.21.15.44:0/50373503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11940d0ff0 msgr2=0x7f119415bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.165+0000 7f119959e640 1 --2- 172.21.15.44:0/50373503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11940d0ff0 0x7f119415bdb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1188000c00 tx=0x7f11880046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.165+0000 7f119959e640 1 -- 172.21.15.44:0/50373503 shutdown_connections 2023-11-04T01:37:42.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.165+0000 7f119959e640 1 --2- 172.21.15.44:0/50373503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f118006ae70 0x7f118006d330 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.165+0000 7f119959e640 1 --2- 172.21.15.44:0/50373503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11940d2b40 0x7f11941f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.165+0000 7f119959e640 1 --2- 172.21.15.44:0/50373503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11940d0ff0 0x7f119415bdb0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.165+0000 7f119959e640 1 --2- 172.21.15.44:0/50373503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11940b8540 0x7f11940ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.165+0000 7f119959e640 1 -- 172.21.15.44:0/50373503 >> 172.21.15.44:0/50373503 conn(0x7f1194071c70 msgr2=0x7f1194072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:42.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.165+0000 7f119959e640 1 -- 172.21.15.44:0/50373503 shutdown_connections 2023-11-04T01:37:42.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.165+0000 7f119959e640 1 -- 172.21.15.44:0/50373503 wait complete. 2023-11-04T01:37:42.177 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:42.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.282+0000 7f9a00083640 1 Processor -- start 2023-11-04T01:37:42.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.283+0000 7f9a00083640 1 -- start start 2023-11-04T01:37:42.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.283+0000 7f9a00083640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f99f80cde60 0x7f99f815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.283+0000 7f9a00083640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99f815daa0 0x7f99f8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.283+0000 7f9a00083640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f99f80ce240 0x7f99f8157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.283+0000 7f9a00083640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f815e5c0 con 0x7f99f80cde60 2023-11-04T01:37:42.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.283+0000 7f9a00083640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f8157a80 con 0x7f99f80ce240 2023-11-04T01:37:42.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.283+0000 7f9a00083640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f815e000 con 0x7f99f815daa0 2023-11-04T01:37:42.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.283+0000 7f99fde1f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f99f80cde60 0x7f99f815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.284+0000 7f99fde1f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f99f80cde60 0x7f99f815d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60306/0 (socket says 172.21.15.44:60306) 2023-11-04T01:37:42.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.284+0000 7f99fde1f640 1 -- 172.21.15.44:0/108082042 learned_addr learned my addr 172.21.15.44:0/108082042 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:42.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.284+0000 7f99fd61e640 1 --2- 172.21.15.44:0/108082042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99f815daa0 0x7f99f8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.284+0000 7f99fe620640 1 --2- 172.21.15.44:0/108082042 >> v2:172.21.15.204:3300/0 conn(0x7f99f80ce240 0x7f99f8157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.284+0000 7f99fde1f640 1 -- 172.21.15.44:0/108082042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99f815daa0 msgr2=0x7f99f8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:42.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.284+0000 7f99fde1f640 1 --2- 172.21.15.44:0/108082042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99f815daa0 0x7f99f8157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.284+0000 7f99fde1f640 1 -- 172.21.15.44:0/108082042 >> v2:172.21.15.204:3300/0 conn(0x7f99f80ce240 msgr2=0x7f99f8157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:42.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.284+0000 7f99fde1f640 1 --2- 172.21.15.44:0/108082042 >> v2:172.21.15.204:3300/0 conn(0x7f99f80ce240 0x7f99f8157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.284+0000 7f99fde1f640 1 -- 172.21.15.44:0/108082042 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f815e2e0 con 0x7f99f80cde60 2023-11-04T01:37:42.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.285+0000 7f99fde1f640 1 --2- 172.21.15.44:0/108082042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f80cde60 0x7f99f815d560 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f99f815df30 tx=0x7f99f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ccf83938463dc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.285+0000 7f99fce1d640 1 -- 172.21.15.44:0/108082042 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0031870 con 0x7f99f80cde60 2023-11-04T01:37:42.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.285+0000 7f99fce1d640 1 -- 172.21.15.44:0/108082042 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f00319d0 con 0x7f99f80cde60 2023-11-04T01:37:42.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.285+0000 7f99fce1d640 1 -- 172.21.15.44:0/108082042 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0031d60 con 0x7f99f80cde60 2023-11-04T01:37:42.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.285+0000 7f9a00083640 1 -- 172.21.15.44:0/108082042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f80cde60 msgr2=0x7f99f815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.285+0000 7f9a00083640 1 --2- 172.21.15.44:0/108082042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f80cde60 0x7f99f815d560 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f99f815df30 tx=0x7f99f002b910 comp rx=0 tx=0).stop 2023-11-04T01:37:42.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.285+0000 7f9a00083640 1 -- 172.21.15.44:0/108082042 shutdown_connections 2023-11-04T01:37:42.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.285+0000 7f9a00083640 1 --2- 172.21.15.44:0/108082042 >> v2:172.21.15.204:3300/0 conn(0x7f99f80ce240 0x7f99f8157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.285+0000 7f9a00083640 1 --2- 172.21.15.44:0/108082042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99f815daa0 0x7f99f8157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.285+0000 7f9a00083640 1 --2- 172.21.15.44:0/108082042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f80cde60 0x7f99f815d560 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.285+0000 7f9a00083640 1 -- 172.21.15.44:0/108082042 >> 172.21.15.44:0/108082042 conn(0x7f99f8071f30 msgr2=0x7f99f80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:42.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.286+0000 7f9a00083640 1 -- 172.21.15.44:0/108082042 shutdown_connections 2023-11-04T01:37:42.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.286+0000 7f9a00083640 1 -- 172.21.15.44:0/108082042 wait complete. 2023-11-04T01:37:42.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.287+0000 7f9a00083640 1 Processor -- start 2023-11-04T01:37:42.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.287+0000 7f9a00083640 1 -- start start 2023-11-04T01:37:42.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.287+0000 7f9a00083640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f80cde60 0x7f99f81f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.287+0000 7f9a00083640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99f80ce240 0x7f99f8152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.287+0000 7f9a00083640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99f815daa0 0x7f99f80c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.287+0000 7f9a00083640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f81f67c0 con 0x7f99f80cde60 2023-11-04T01:37:42.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.287+0000 7f9a00083640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f81565b0 con 0x7f99f815daa0 2023-11-04T01:37:42.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.287+0000 7f9a00083640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f81f5f20 con 0x7f99f80ce240 2023-11-04T01:37:42.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.287+0000 7f99fde1f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f80cde60 0x7f99f81f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.287+0000 7f99fde1f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f80cde60 0x7f99f81f5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60312/0 (socket says 172.21.15.44:60312) 2023-11-04T01:37:42.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.287+0000 7f99fde1f640 1 -- 172.21.15.44:0/1316093720 learned_addr learned my addr 172.21.15.44:0/1316093720 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:42.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.288+0000 7f99fe620640 1 --2- 172.21.15.44:0/1316093720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99f815daa0 0x7f99f80c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.288+0000 7f99fd61e640 1 --2- 172.21.15.44:0/1316093720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99f80ce240 0x7f99f8152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.288+0000 7f99fde1f640 1 -- 172.21.15.44:0/1316093720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99f80ce240 msgr2=0x7f99f8152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.288+0000 7f99fde1f640 1 --2- 172.21.15.44:0/1316093720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99f80ce240 0x7f99f8152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.288+0000 7f99fde1f640 1 -- 172.21.15.44:0/1316093720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99f815daa0 msgr2=0x7f99f80c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.288+0000 7f99fde1f640 1 --2- 172.21.15.44:0/1316093720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99f815daa0 0x7f99f80c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.288+0000 7f99fde1f640 1 -- 172.21.15.44:0/1316093720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f00094d0 con 0x7f99f80cde60 2023-11-04T01:37:42.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.288+0000 7f99fe620640 1 --2- 172.21.15.44:0/1316093720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99f815daa0 0x7f99f80c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:42.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.288+0000 7f99fde1f640 1 --2- 172.21.15.44:0/1316093720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f80cde60 0x7f99f81f5820 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f99f002b950 tx=0x7f99f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.288+0000 7f99f67fc640 1 -- 172.21.15.44:0/1316093720 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f003ad30 con 0x7f99f80cde60 2023-11-04T01:37:42.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.288+0000 7f99f67fc640 1 -- 172.21.15.44:0/1316093720 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f00443f0 con 0x7f99f80cde60 2023-11-04T01:37:42.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.288+0000 7f9a00083640 1 -- 172.21.15.44:0/1316093720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f81f6200 con 0x7f99f80cde60 2023-11-04T01:37:42.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.288+0000 7f99f67fc640 1 -- 172.21.15.44:0/1316093720 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f00447a0 con 0x7f99f80cde60 2023-11-04T01:37:42.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.288+0000 7f9a00083640 1 -- 172.21.15.44:0/1316093720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f8159b60 con 0x7f99f80cde60 2023-11-04T01:37:42.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.289+0000 7f9a00083640 1 -- 172.21.15.44:0/1316093720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f81599c0 con 0x7f99f80cde60 2023-11-04T01:37:42.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.290+0000 7f99f67fc640 1 -- 172.21.15.44:0/1316093720 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f99f004d450 con 0x7f99f80cde60 2023-11-04T01:37:42.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.290+0000 7f99f67fc640 1 --2- 172.21.15.44:0/1316093720 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f99e406ae70 0x7f99e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.290+0000 7f99f67fc640 1 -- 172.21.15.44:0/1316093720 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6439+0+0 (secure 0 0 0) 0x7f99f002d040 con 0x7f99f80cde60 2023-11-04T01:37:42.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.290+0000 7f99fd61e640 1 --2- 172.21.15.44:0/1316093720 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f99e406ae70 0x7f99e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.291+0000 7f99fd61e640 1 --2- 172.21.15.44:0/1316093720 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f99e406ae70 0x7f99e406d330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f99f80d22c0 tx=0x7f99ec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.294+0000 7f99f67fc640 1 -- 172.21.15.44:0/1316093720 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f99f81599c0 con 0x7f99f80cde60 2023-11-04T01:37:42.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.471+0000 7f9a00083640 1 -- 172.21.15.44:0/1316093720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99f81599c0 con 0x7f99f80cde60 2023-11-04T01:37:42.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.472+0000 7f99f67fc640 1 -- 172.21.15.44:0/1316093720 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18563 (secure 0 0 0) 0x7f99f81599c0 con 0x7f99f80cde60 2023-11-04T01:37:42.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:42.474 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":44,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:41.242460+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:19.141183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:20.292111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.35","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:42.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.474+0000 7f9a00083640 1 -- 172.21.15.44:0/1316093720 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f99e406ae70 msgr2=0x7f99e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.474+0000 7f9a00083640 1 --2- 172.21.15.44:0/1316093720 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f99e406ae70 0x7f99e406d330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f99f80d22c0 tx=0x7f99ec008040 comp rx=0 tx=0).stop 2023-11-04T01:37:42.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.474+0000 7f9a00083640 1 -- 172.21.15.44:0/1316093720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f80cde60 msgr2=0x7f99f81f5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.474+0000 7f9a00083640 1 --2- 172.21.15.44:0/1316093720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f80cde60 0x7f99f81f5820 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f99f002b950 tx=0x7f99f00046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.474+0000 7f9a00083640 1 -- 172.21.15.44:0/1316093720 shutdown_connections 2023-11-04T01:37:42.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.474+0000 7f9a00083640 1 --2- 172.21.15.44:0/1316093720 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f99e406ae70 0x7f99e406d330 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.474+0000 7f9a00083640 1 --2- 172.21.15.44:0/1316093720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99f815daa0 0x7f99f80c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.474+0000 7f9a00083640 1 --2- 172.21.15.44:0/1316093720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99f80ce240 0x7f99f8152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.474+0000 7f9a00083640 1 --2- 172.21.15.44:0/1316093720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f80cde60 0x7f99f81f5820 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.474+0000 7f9a00083640 1 -- 172.21.15.44:0/1316093720 >> 172.21.15.44:0/1316093720 conn(0x7f99f8071f30 msgr2=0x7f99f8156dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:42.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.474+0000 7f9a00083640 1 -- 172.21.15.44:0/1316093720 shutdown_connections 2023-11-04T01:37:42.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.474+0000 7f9a00083640 1 -- 172.21.15.44:0/1316093720 wait complete. 2023-11-04T01:37:42.487 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:37:42.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.594+0000 7ffaa9583640 1 Processor -- start 2023-11-04T01:37:42.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.594+0000 7ffaa9583640 1 -- start start 2023-11-04T01:37:42.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.595+0000 7ffaa9583640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ffaa40b2d30 0x7ffaa406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.595+0000 7ffaa9583640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffaa406c1d0 0x7ffaa40cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.595+0000 7ffaa9583640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa406ca40 con 0x7ffaa4160430 2023-11-04T01:37:42.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.595+0000 7ffaa9583640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa40cb580 con 0x7ffaa406c1d0 2023-11-04T01:37:42.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.595+0000 7ffaa9583640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa406cd20 con 0x7ffaa40b2d30 2023-11-04T01:37:42.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.595+0000 7ffaa37fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffaa406c1d0 0x7ffaa40cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.595+0000 7ffaa2ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ffaa4160430 0x7ffaa40b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55200/0 (socket says 172.21.15.44:55200) 2023-11-04T01:37:42.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.595+0000 7ffaa2ffd640 1 -- 172.21.15.44:0/3342960510 learned_addr learned my addr 172.21.15.44:0/3342960510 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:42.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.595+0000 7ffaa27fc640 1 --2- 172.21.15.44:0/3342960510 >> v2:172.21.15.204:3300/0 conn(0x7ffaa40b2d30 0x7ffaa406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.595+0000 7ffaa37fe640 1 -- 172.21.15.44:0/3342960510 >> v2:172.21.15.204:3300/0 conn(0x7ffaa40b2d30 msgr2=0x7ffaa406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:42.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.595+0000 7ffaa37fe640 1 --2- 172.21.15.44:0/3342960510 >> v2:172.21.15.204:3300/0 conn(0x7ffaa40b2d30 0x7ffaa406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.595+0000 7ffaa37fe640 1 -- 172.21.15.44:0/3342960510 >> v1:172.21.15.44:6789/0 conn(0x7ffaa4160430 legacy=0x7ffaa40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.595+0000 7ffaa37fe640 1 -- 172.21.15.44:0/3342960510 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa406d000 con 0x7ffaa406c1d0 2023-11-04T01:37:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.596+0000 7ffaa37fe640 1 --2- 172.21.15.44:0/3342960510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa406c1d0 0x7ffaa40cbcb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009d90 tx=0x7ffa9c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0fce269d1499e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.596+0000 7ffaa1ffb640 1 -- 172.21.15.44:0/3342960510 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c02cc60 con 0x7ffaa406c1d0 2023-11-04T01:37:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.596+0000 7ffaa1ffb640 1 -- 172.21.15.44:0/3342960510 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c02cdc0 con 0x7ffaa406c1d0 2023-11-04T01:37:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.596+0000 7ffaa1ffb640 1 -- 172.21.15.44:0/3342960510 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c034660 con 0x7ffaa406c1d0 2023-11-04T01:37:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.596+0000 7ffaa9583640 1 -- 172.21.15.44:0/3342960510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa406c1d0 msgr2=0x7ffaa40cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.596+0000 7ffaa9583640 1 --2- 172.21.15.44:0/3342960510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa406c1d0 0x7ffaa40cbcb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009d90 tx=0x7ffa9c02beb0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.597+0000 7ffaa9583640 1 -- 172.21.15.44:0/3342960510 shutdown_connections 2023-11-04T01:37:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.597+0000 7ffaa9583640 1 --2- 172.21.15.44:0/3342960510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa406c1d0 0x7ffaa40cbcb0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.597+0000 7ffaa9583640 1 --2- 172.21.15.44:0/3342960510 >> v2:172.21.15.204:3300/0 conn(0x7ffaa40b2d30 0x7ffaa406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.597+0000 7ffaa9583640 1 -- 172.21.15.44:0/3342960510 >> 172.21.15.44:0/3342960510 conn(0x7ffaa406ea20 msgr2=0x7ffaa406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.597+0000 7ffaa9583640 1 -- 172.21.15.44:0/3342960510 shutdown_connections 2023-11-04T01:37:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.597+0000 7ffaa9583640 1 -- 172.21.15.44:0/3342960510 wait complete. 2023-11-04T01:37:42.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.598+0000 7ffaa9583640 1 Processor -- start 2023-11-04T01:37:42.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.598+0000 7ffaa9583640 1 -- start start 2023-11-04T01:37:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa9583640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa406c1d0 0x7ffaa40c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa9583640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffaa40b2d30 0x7ffaa40c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa9583640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffaa4160430 0x7ffaa40b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa9583640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40c4670 con 0x7ffaa406c1d0 2023-11-04T01:37:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa9583640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40c5600 con 0x7ffaa40b2d30 2023-11-04T01:37:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa9583640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40b19e0 con 0x7ffaa4160430 2023-11-04T01:37:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa406c1d0 0x7ffaa40c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa406c1d0 0x7ffaa40c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32780/0 (socket says 172.21.15.44:32780) 2023-11-04T01:37:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa2ffd640 1 -- 172.21.15.44:0/3672606487 learned_addr learned my addr 172.21.15.44:0/3672606487 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:42.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa27fc640 1 --2- 172.21.15.44:0/3672606487 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffaa40b2d30 0x7ffaa40c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa37fe640 1 --2- 172.21.15.44:0/3672606487 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffaa4160430 0x7ffaa40b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa2ffd640 1 -- 172.21.15.44:0/3672606487 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffaa4160430 msgr2=0x7ffaa40b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa2ffd640 1 --2- 172.21.15.44:0/3672606487 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffaa4160430 0x7ffaa40b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa2ffd640 1 -- 172.21.15.44:0/3672606487 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffaa40b2d30 msgr2=0x7ffaa40c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa2ffd640 1 --2- 172.21.15.44:0/3672606487 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffaa40b2d30 0x7ffaa40c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa2ffd640 1 -- 172.21.15.44:0/3672606487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c009a70 con 0x7ffaa406c1d0 2023-11-04T01:37:42.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.599+0000 7ffaa2ffd640 1 --2- 172.21.15.44:0/3672606487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa406c1d0 0x7ffaa40c6ac0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400c4a0 tx=0x7ffa9400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.600+0000 7ffa8b7fe640 1 -- 172.21.15.44:0/3672606487 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94005ce0 con 0x7ffaa406c1d0 2023-11-04T01:37:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.600+0000 7ffa8b7fe640 1 -- 172.21.15.44:0/3672606487 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa94005e40 con 0x7ffaa406c1d0 2023-11-04T01:37:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.600+0000 7ffaa9583640 1 -- 172.21.15.44:0/3672606487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa40c7150 con 0x7ffaa406c1d0 2023-11-04T01:37:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.600+0000 7ffa8b7fe640 1 -- 172.21.15.44:0/3672606487 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94007270 con 0x7ffaa406c1d0 2023-11-04T01:37:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.600+0000 7ffaa9583640 1 -- 172.21.15.44:0/3672606487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa40c48c0 con 0x7ffaa406c1d0 2023-11-04T01:37:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.601+0000 7ffaa9583640 1 -- 172.21.15.44:0/3672606487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa40d0360 con 0x7ffaa406c1d0 2023-11-04T01:37:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.601+0000 7ffa8b7fe640 1 -- 172.21.15.44:0/3672606487 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa94007490 con 0x7ffaa406c1d0 2023-11-04T01:37:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.601+0000 7ffa8b7fe640 1 --2- 172.21.15.44:0/3672606487 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffa9006ae70 0x7ffa9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.602+0000 7ffa8b7fe640 1 -- 172.21.15.44:0/3672606487 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6439+0+0 (secure 0 0 0) 0x7ffa94088ca0 con 0x7ffaa406c1d0 2023-11-04T01:37:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.602+0000 7ffaa27fc640 1 --2- 172.21.15.44:0/3672606487 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffa9006ae70 0x7ffa9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.602+0000 7ffaa27fc640 1 --2- 172.21.15.44:0/3672606487 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffa9006ae70 0x7ffa9006d330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40b64a0 tx=0x7ffa98008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.606+0000 7ffa8b7fe640 1 -- 172.21.15.44:0/3672606487 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffa94053bb0 con 0x7ffaa406c1d0 2023-11-04T01:37:42.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.819+0000 7ffaa9583640 1 -- 172.21.15.44:0/3672606487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ffaa4074290 con 0x7ffaa406c1d0 2023-11-04T01:37:42.820 INFO:tasks.ceph.mon.a.smithi044.stderr:2023-11-04T01:37:42.819+0000 7fd852594640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:37:42.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.821+0000 7ffa8b7fe640 1 -- 172.21.15.44:0/3672606487 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7ffa94017020 con 0x7ffaa406c1d0 2023-11-04T01:37:42.822 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:37:42.823 INFO:tasks.ceph.mds.c.smithi044.stderr: -1974> 2023-11-04T01:37:14.068+0000 7f8e535d4640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-11-04T01:37:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.824+0000 7ffaa9583640 1 -- 172.21.15.44:0/3672606487 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffa9006ae70 msgr2=0x7ffa9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.824+0000 7ffaa9583640 1 --2- 172.21.15.44:0/3672606487 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffa9006ae70 0x7ffa9006d330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40b64a0 tx=0x7ffa98008040 comp rx=0 tx=0).stop 2023-11-04T01:37:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.824+0000 7ffaa9583640 1 -- 172.21.15.44:0/3672606487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa406c1d0 msgr2=0x7ffaa40c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.824+0000 7ffaa9583640 1 --2- 172.21.15.44:0/3672606487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa406c1d0 0x7ffaa40c6ac0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400c4a0 tx=0x7ffa9400c960 comp rx=0 tx=0).stop 2023-11-04T01:37:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.824+0000 7ffaa9583640 1 -- 172.21.15.44:0/3672606487 shutdown_connections 2023-11-04T01:37:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.824+0000 7ffaa9583640 1 --2- 172.21.15.44:0/3672606487 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffa9006ae70 0x7ffa9006d330 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.824+0000 7ffaa9583640 1 --2- 172.21.15.44:0/3672606487 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffaa4160430 0x7ffaa40b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.824+0000 7ffaa9583640 1 --2- 172.21.15.44:0/3672606487 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffaa40b2d30 0x7ffaa40c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.824+0000 7ffaa9583640 1 --2- 172.21.15.44:0/3672606487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa406c1d0 0x7ffaa40c6ac0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.824+0000 7ffaa9583640 1 -- 172.21.15.44:0/3672606487 >> 172.21.15.44:0/3672606487 conn(0x7ffaa406ea20 msgr2=0x7ffaa40ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:42.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.824+0000 7ffaa9583640 1 -- 172.21.15.44:0/3672606487 shutdown_connections 2023-11-04T01:37:42.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.824+0000 7ffaa9583640 1 -- 172.21.15.44:0/3672606487 wait complete. 2023-11-04T01:37:42.826 INFO:tasks.ceph.mds.c.smithi044.stderr: -808> 2023-11-04T01:37:24.922+0000 7f8e4d5c8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:37:42.836 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:37:42.851 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2023-11-04T01:37:42.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.945+0000 7f172df4c640 1 Processor -- start 2023-11-04T01:37:42.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.945+0000 7f172df4c640 1 -- start start 2023-11-04T01:37:42.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.945+0000 7f172df4c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1728160430 0x7f17280b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.945+0000 7f172df4c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f172806c3a0 0x7f17280cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.945+0000 7f172df4c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17280b2fc0 con 0x7f17280b2b60 2023-11-04T01:37:42.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.945+0000 7f172df4c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17280cb580 con 0x7f172806c3a0 2023-11-04T01:37:42.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.945+0000 7f172df4c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172806c7d0 con 0x7f1728160430 2023-11-04T01:37:42.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.946+0000 7f1727fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f172806c3a0 0x7f17280cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.946+0000 7f1727fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f172806c3a0 0x7f17280cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32806/0 (socket says 172.21.15.44:32806) 2023-11-04T01:37:42.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.946+0000 7f1727fff640 1 -- 172.21.15.44:0/3109206258 learned_addr learned my addr 172.21.15.44:0/3109206258 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:42.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.946+0000 7f17277fe640 1 --2- 172.21.15.44:0/3109206258 >> v2:172.21.15.204:3300/0 conn(0x7f1728160430 0x7f17280b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.946+0000 7f1727fff640 1 -- 172.21.15.44:0/3109206258 >> v2:172.21.15.204:3300/0 conn(0x7f1728160430 msgr2=0x7f17280b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:42.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.946+0000 7f1727fff640 1 --2- 172.21.15.44:0/3109206258 >> v2:172.21.15.204:3300/0 conn(0x7f1728160430 0x7f17280b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.946+0000 7f1727fff640 1 -- 172.21.15.44:0/3109206258 >> v1:172.21.15.204:6789/0 conn(0x7f17280b2b60 legacy=0x7f172806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.946+0000 7f1727fff640 1 -- 172.21.15.44:0/3109206258 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172806ca40 con 0x7f172806c3a0 2023-11-04T01:37:42.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.947+0000 7f1727fff640 1 --2- 172.21.15.44:0/3109206258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f172806c3a0 0x7f17280cbcb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f172806f6d0 tx=0x7f172002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b32b1312d549ee5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.947+0000 7f17267fc640 1 -- 172.21.15.44:0/3109206258 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172002cb20 con 0x7f172806c3a0 2023-11-04T01:37:42.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.947+0000 7f17267fc640 1 -- 172.21.15.44:0/3109206258 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172002cc80 con 0x7f172806c3a0 2023-11-04T01:37:42.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.947+0000 7f17267fc640 1 -- 172.21.15.44:0/3109206258 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17200343f0 con 0x7f172806c3a0 2023-11-04T01:37:42.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.947+0000 7f172df4c640 1 -- 172.21.15.44:0/3109206258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f172806c3a0 msgr2=0x7f17280cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.947+0000 7f172df4c640 1 --2- 172.21.15.44:0/3109206258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f172806c3a0 0x7f17280cbcb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f172806f6d0 tx=0x7f172002bf80 comp rx=0 tx=0).stop 2023-11-04T01:37:42.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.947+0000 7f172df4c640 1 -- 172.21.15.44:0/3109206258 shutdown_connections 2023-11-04T01:37:42.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.947+0000 7f172df4c640 1 --2- 172.21.15.44:0/3109206258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f172806c3a0 0x7f17280cbcb0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.947+0000 7f172df4c640 1 --2- 172.21.15.44:0/3109206258 >> v2:172.21.15.204:3300/0 conn(0x7f1728160430 0x7f17280b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.947+0000 7f172df4c640 1 -- 172.21.15.44:0/3109206258 >> 172.21.15.44:0/3109206258 conn(0x7f172806ea20 msgr2=0x7f172806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:42.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.947+0000 7f172df4c640 1 -- 172.21.15.44:0/3109206258 shutdown_connections 2023-11-04T01:37:42.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.947+0000 7f172df4c640 1 -- 172.21.15.44:0/3109206258 wait complete. 2023-11-04T01:37:42.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.949+0000 7f172df4c640 1 Processor -- start 2023-11-04T01:37:42.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.949+0000 7f172df4c640 1 -- start start 2023-11-04T01:37:42.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.949+0000 7f172df4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f172806c3a0 0x7f17280b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.949+0000 7f172df4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17280b2b60 0x7f17281517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.949+0000 7f172df4c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1728160430 0x7f172815ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.949+0000 7f172df4c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280c7c70 con 0x7f17280b2b60 2023-11-04T01:37:42.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.949+0000 7f172df4c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280c87f0 con 0x7f1728160430 2023-11-04T01:37:42.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.949+0000 7f172df4c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1728151cf0 con 0x7f172806c3a0 2023-11-04T01:37:42.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f1726ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17280b2b60 0x7f17281517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f1726ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17280b2b60 0x7f17281517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32808/0 (socket says 172.21.15.44:32808) 2023-11-04T01:37:42.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f1726ffd640 1 -- 172.21.15.44:0/75688205 learned_addr learned my addr 172.21.15.44:0/75688205 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:42.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f17277fe640 1 --2- 172.21.15.44:0/75688205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f172806c3a0 0x7f17280b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f1727fff640 1 --2- 172.21.15.44:0/75688205 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1728160430 0x7f172815ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f1726ffd640 1 -- 172.21.15.44:0/75688205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f172806c3a0 msgr2=0x7f17280b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f1726ffd640 1 --2- 172.21.15.44:0/75688205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f172806c3a0 0x7f17280b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f1726ffd640 1 -- 172.21.15.44:0/75688205 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1728160430 msgr2=0x7f172815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f1726ffd640 1 --2- 172.21.15.44:0/75688205 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1728160430 0x7f172815ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f1726ffd640 1 -- 172.21.15.44:0/75688205 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1720009b30 con 0x7f17280b2b60 2023-11-04T01:37:42.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f1726ffd640 1 --2- 172.21.15.44:0/75688205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17280b2b60 0x7f17281517b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f171c00c480 tx=0x7f171c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f170ffff640 1 -- 172.21.15.44:0/75688205 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0052d0 con 0x7f17280b2b60 2023-11-04T01:37:42.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f170ffff640 1 -- 172.21.15.44:0/75688205 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c005430 con 0x7f17280b2b60 2023-11-04T01:37:42.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f172df4c640 1 -- 172.21.15.44:0/75688205 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17280c7ec0 con 0x7f17280b2b60 2023-11-04T01:37:42.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f170ffff640 1 -- 172.21.15.44:0/75688205 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c012870 con 0x7f17280b2b60 2023-11-04T01:37:42.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.950+0000 7f172df4c640 1 -- 172.21.15.44:0/75688205 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17280c8480 con 0x7f17280b2b60 2023-11-04T01:37:42.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.951+0000 7f172df4c640 1 -- 172.21.15.44:0/75688205 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1728074290 con 0x7f17280b2b60 2023-11-04T01:37:42.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.952+0000 7f170ffff640 1 -- 172.21.15.44:0/75688205 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f171c0129d0 con 0x7f17280b2b60 2023-11-04T01:37:42.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.952+0000 7f170ffff640 1 --2- 172.21.15.44:0/75688205 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f171406aea0 0x7f171406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.952+0000 7f170ffff640 1 -- 172.21.15.44:0/75688205 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6525+0+0 (secure 0 0 0) 0x7f171c0892d0 con 0x7f17280b2b60 2023-11-04T01:37:42.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.952+0000 7f17277fe640 1 --2- 172.21.15.44:0/75688205 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f171406aea0 0x7f171406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.953+0000 7f17277fe640 1 --2- 172.21.15.44:0/75688205 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f171406aea0 0x7f171406d360 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f17180079a0 tx=0x7f1718008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.957 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:42.957+0000 7f170ffff640 1 -- 172.21.15.44:0/75688205 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f171c054190 con 0x7f17280b2b60 2023-11-04T01:37:43.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.167+0000 7f172df4c640 1 -- 172.21.15.44:0/75688205 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f17280b6b20 con 0x7f17280b2b60 2023-11-04T01:37:43.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.822+0000 7f170ffff640 1 -- 172.21.15.44:0/75688205 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f171c0577b0 con 0x7f17280b2b60 2023-11-04T01:37:43.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.825+0000 7f172df4c640 1 -- 172.21.15.44:0/75688205 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f171406aea0 msgr2=0x7f171406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:43.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.825+0000 7f172df4c640 1 --2- 172.21.15.44:0/75688205 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f171406aea0 0x7f171406d360 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f17180079a0 tx=0x7f1718008040 comp rx=0 tx=0).stop 2023-11-04T01:37:43.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.825+0000 7f172df4c640 1 -- 172.21.15.44:0/75688205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17280b2b60 msgr2=0x7f17281517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:43.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.825+0000 7f172df4c640 1 --2- 172.21.15.44:0/75688205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17280b2b60 0x7f17281517b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f171c00c480 tx=0x7f171c00c940 comp rx=0 tx=0).stop 2023-11-04T01:37:43.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.825+0000 7f172df4c640 1 -- 172.21.15.44:0/75688205 shutdown_connections 2023-11-04T01:37:43.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.825+0000 7f172df4c640 1 --2- 172.21.15.44:0/75688205 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f171406aea0 0x7f171406d360 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.825+0000 7f172df4c640 1 --2- 172.21.15.44:0/75688205 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1728160430 0x7f172815ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.825+0000 7f172df4c640 1 --2- 172.21.15.44:0/75688205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17280b2b60 0x7f17281517b0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.825+0000 7f172df4c640 1 --2- 172.21.15.44:0/75688205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f172806c3a0 0x7f17280b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.825+0000 7f172df4c640 1 -- 172.21.15.44:0/75688205 >> 172.21.15.44:0/75688205 conn(0x7f172806ea20 msgr2=0x7f17280b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:43.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.825+0000 7f172df4c640 1 -- 172.21.15.44:0/75688205 shutdown_connections 2023-11-04T01:37:43.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.825+0000 7f172df4c640 1 -- 172.21.15.44:0/75688205 wait complete. 2023-11-04T01:37:43.840 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:37:43.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.998+0000 7f566086f640 1 Processor -- start 2023-11-04T01:37:43.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.998+0000 7f566086f640 1 -- start start 2023-11-04T01:37:44.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.998+0000 7f566086f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f565c0cd9f0 0x7f565c0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.998+0000 7f566086f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f565c0d27c0 0x7f565c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.998+0000 7f566086f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c0d1320 con 0x7f565c15d4b0 2023-11-04T01:37:44.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.998+0000 7f566086f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565c15e4d0 con 0x7f565c0cd9f0 2023-11-04T01:37:44.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.998+0000 7f566086f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565c0ce310 con 0x7f565c0d27c0 2023-11-04T01:37:44.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.999+0000 7f565a59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f565c0cd9f0 0x7f565c0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.999+0000 7f565a59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f565c0cd9f0 0x7f565c0cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32818/0 (socket says 172.21.15.44:32818) 2023-11-04T01:37:44.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.999+0000 7f5653fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f565c15d4b0 0x7f565c0b47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55218/0 (socket says 172.21.15.44:55218) 2023-11-04T01:37:44.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.999+0000 7f565a59c640 1 -- 172.21.15.44:0/1922215903 learned_addr learned my addr 172.21.15.44:0/1922215903 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:44.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.999+0000 7f565ad9d640 1 --2- 172.21.15.44:0/1922215903 >> v2:172.21.15.204:3300/0 conn(0x7f565c0d27c0 0x7f565c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.999+0000 7f565a59c640 1 -- 172.21.15.44:0/1922215903 >> v2:172.21.15.204:3300/0 conn(0x7f565c0d27c0 msgr2=0x7f565c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:44.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.999+0000 7f565a59c640 1 --2- 172.21.15.44:0/1922215903 >> v2:172.21.15.204:3300/0 conn(0x7f565c0d27c0 0x7f565c15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.999+0000 7f565a59c640 1 -- 172.21.15.44:0/1922215903 >> v1:172.21.15.44:6789/0 conn(0x7f565c15d4b0 legacy=0x7f565c0b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.999+0000 7f5659d9b640 1 -- 172.21.15.44:0/1922215903 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856754324 0 0) 0x7f565c0d1320 con 0x7f565c15d4b0 2023-11-04T01:37:44.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:43.999+0000 7f565a59c640 1 -- 172.21.15.44:0/1922215903 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c15df10 con 0x7f565c0cd9f0 2023-11-04T01:37:44.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.000+0000 7f565a59c640 1 --2- 172.21.15.44:0/1922215903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f565c0cd9f0 0x7f565c0cddd0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f564c009870 tx=0x7f564c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b76c60a97adf28a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:44.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.000+0000 7f5659d9b640 1 -- 172.21.15.44:0/1922215903 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c02f840 con 0x7f565c0cd9f0 2023-11-04T01:37:44.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.000+0000 7f5659d9b640 1 -- 172.21.15.44:0/1922215903 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c02f9a0 con 0x7f565c0cd9f0 2023-11-04T01:37:44.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.000+0000 7f5659d9b640 1 -- 172.21.15.44:0/1922215903 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c02fd30 con 0x7f565c0cd9f0 2023-11-04T01:37:44.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.000+0000 7f566086f640 1 -- 172.21.15.44:0/1922215903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f565c0cd9f0 msgr2=0x7f565c0cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.000+0000 7f566086f640 1 --2- 172.21.15.44:0/1922215903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f565c0cd9f0 0x7f565c0cddd0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f564c009870 tx=0x7f564c02ba20 comp rx=0 tx=0).stop 2023-11-04T01:37:44.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.001+0000 7f566086f640 1 -- 172.21.15.44:0/1922215903 shutdown_connections 2023-11-04T01:37:44.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.001+0000 7f566086f640 1 --2- 172.21.15.44:0/1922215903 >> v2:172.21.15.204:3300/0 conn(0x7f565c0d27c0 0x7f565c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.001+0000 7f566086f640 1 --2- 172.21.15.44:0/1922215903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f565c0cd9f0 0x7f565c0cddd0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.001+0000 7f566086f640 1 -- 172.21.15.44:0/1922215903 >> 172.21.15.44:0/1922215903 conn(0x7f565c071c40 msgr2=0x7f565c072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:44.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.001+0000 7f566086f640 1 -- 172.21.15.44:0/1922215903 shutdown_connections 2023-11-04T01:37:44.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.001+0000 7f566086f640 1 -- 172.21.15.44:0/1922215903 wait complete. 2023-11-04T01:37:44.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.002+0000 7f566086f640 1 Processor -- start 2023-11-04T01:37:44.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.002+0000 7f566086f640 1 -- start start 2023-11-04T01:37:44.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f566086f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f565c0cd9f0 0x7f565c154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f566086f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f565c0d27c0 0x7f565c158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f566086f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f565c15d4b0 0x7f565c0c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f566086f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c1586d0 con 0x7f565c0cd9f0 2023-11-04T01:37:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f566086f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c157ac0 con 0x7f565c0d27c0 2023-11-04T01:37:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f566086f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c157da0 con 0x7f565c15d4b0 2023-11-04T01:37:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f565a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f565c0cd9f0 0x7f565c154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f565a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f565c0cd9f0 0x7f565c154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32830/0 (socket says 172.21.15.44:32830) 2023-11-04T01:37:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f565a59c640 1 -- 172.21.15.44:0/2584541872 learned_addr learned my addr 172.21.15.44:0/2584541872 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f565ad9d640 1 --2- 172.21.15.44:0/2584541872 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f565c15d4b0 0x7f565c0c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f5653fff640 1 --2- 172.21.15.44:0/2584541872 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f565c0d27c0 0x7f565c158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f565a59c640 1 -- 172.21.15.44:0/2584541872 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f565c15d4b0 msgr2=0x7f565c0c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f565a59c640 1 --2- 172.21.15.44:0/2584541872 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f565c15d4b0 0x7f565c0c79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f565a59c640 1 -- 172.21.15.44:0/2584541872 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f565c0d27c0 msgr2=0x7f565c158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f565a59c640 1 --2- 172.21.15.44:0/2584541872 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f565c0d27c0 0x7f565c158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.003+0000 7f565a59c640 1 -- 172.21.15.44:0/2584541872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c0094d0 con 0x7f565c0cd9f0 2023-11-04T01:37:44.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.004+0000 7f565a59c640 1 --2- 172.21.15.44:0/2584541872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f565c0cd9f0 0x7f565c154380 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f564c000c00 tx=0x7f564c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:44.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.004+0000 7f5652ffd640 1 -- 172.21.15.44:0/2584541872 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c037c40 con 0x7f565c0cd9f0 2023-11-04T01:37:44.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.004+0000 7f5652ffd640 1 -- 172.21.15.44:0/2584541872 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c037da0 con 0x7f565c0cd9f0 2023-11-04T01:37:44.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.004+0000 7f566086f640 1 -- 172.21.15.44:0/2584541872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565c158080 con 0x7f565c0cd9f0 2023-11-04T01:37:44.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.004+0000 7f5652ffd640 1 -- 172.21.15.44:0/2584541872 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c041640 con 0x7f565c0cd9f0 2023-11-04T01:37:44.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.004+0000 7f566086f640 1 -- 172.21.15.44:0/2584541872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565c1548c0 con 0x7f565c0cd9f0 2023-11-04T01:37:44.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.005+0000 7f566086f640 1 -- 172.21.15.44:0/2584541872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565c04e490 con 0x7f565c0cd9f0 2023-11-04T01:37:44.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.005+0000 7f5652ffd640 1 -- 172.21.15.44:0/2584541872 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f564c0417a0 con 0x7f565c0cd9f0 2023-11-04T01:37:44.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.006+0000 7f5652ffd640 1 --2- 172.21.15.44:0/2584541872 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f563c06ae70 0x7f563c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.006+0000 7f5652ffd640 1 -- 172.21.15.44:0/2584541872 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6525+0+0 (secure 0 0 0) 0x7f564c03c070 con 0x7f565c0cd9f0 2023-11-04T01:37:44.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.006+0000 7f5653fff640 1 --2- 172.21.15.44:0/2584541872 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f563c06ae70 0x7f563c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.006+0000 7f5653fff640 1 --2- 172.21.15.44:0/2584541872 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f563c06ae70 0x7f563c06d330 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5644007fd0 tx=0x7f5644009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:44.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.010+0000 7f5652ffd640 1 -- 172.21.15.44:0/2584541872 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f564c077370 con 0x7f565c0cd9f0 2023-11-04T01:37:44.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:44.187+0000 7f566086f640 1 -- 172.21.15.44:0/2584541872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f565c0d0cb0 con 0x7f565c0cd9f0 2023-11-04T01:37:45.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.186+0000 7f5652ffd640 1 -- 172.21.15.44:0/2584541872 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v47) v1 ==== 181+0+0 (secure 0 0 0) 0x7f564c07a990 con 0x7f565c0cd9f0 2023-11-04T01:37:45.187 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:37:45.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.190+0000 7f566086f640 1 -- 172.21.15.44:0/2584541872 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f563c06ae70 msgr2=0x7f563c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.190+0000 7f566086f640 1 --2- 172.21.15.44:0/2584541872 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f563c06ae70 0x7f563c06d330 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5644007fd0 tx=0x7f5644009040 comp rx=0 tx=0).stop 2023-11-04T01:37:45.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.190+0000 7f566086f640 1 -- 172.21.15.44:0/2584541872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f565c0cd9f0 msgr2=0x7f565c154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.190+0000 7f566086f640 1 --2- 172.21.15.44:0/2584541872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f565c0cd9f0 0x7f565c154380 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f564c000c00 tx=0x7f564c004730 comp rx=0 tx=0).stop 2023-11-04T01:37:45.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.191+0000 7f566086f640 1 -- 172.21.15.44:0/2584541872 shutdown_connections 2023-11-04T01:37:45.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.191+0000 7f566086f640 1 --2- 172.21.15.44:0/2584541872 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f563c06ae70 0x7f563c06d330 secure :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5644007fd0 tx=0x7f5644009040 comp rx=0 tx=0).stop 2023-11-04T01:37:45.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.191+0000 7f566086f640 1 --2- 172.21.15.44:0/2584541872 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f565c15d4b0 0x7f565c0c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.191+0000 7f566086f640 1 --2- 172.21.15.44:0/2584541872 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f565c0d27c0 0x7f565c158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.191+0000 7f566086f640 1 --2- 172.21.15.44:0/2584541872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f565c0cd9f0 0x7f565c154380 secure :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f564c000c00 tx=0x7f564c004730 comp rx=0 tx=0).stop 2023-11-04T01:37:45.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.191+0000 7f566086f640 1 -- 172.21.15.44:0/2584541872 >> 172.21.15.44:0/2584541872 conn(0x7f565c071c40 msgr2=0x7f565c15ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:45.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.192+0000 7f566086f640 1 -- 172.21.15.44:0/2584541872 shutdown_connections 2023-11-04T01:37:45.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.192+0000 7f566086f640 1 -- 172.21.15.44:0/2584541872 wait complete. 2023-11-04T01:37:45.208 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:37:45.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.323+0000 7f44514a9640 1 Processor -- start 2023-11-04T01:37:45.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.323+0000 7f44514a9640 1 -- start start 2023-11-04T01:37:45.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.324+0000 7f44514a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f444c0cd9f0 0x7f444c0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.324+0000 7f44514a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f444c0d27c0 0x7f444c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.324+0000 7f44514a9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444c0d1320 con 0x7f444c15d4b0 2023-11-04T01:37:45.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.324+0000 7f44514a9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444c15e4d0 con 0x7f444c0cd9f0 2023-11-04T01:37:45.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.324+0000 7f44514a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0ce310 con 0x7f444c0d27c0 2023-11-04T01:37:45.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.324+0000 7f444affd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f444c0cd9f0 0x7f444c0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.324+0000 7f444a7fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f444c15d4b0 0x7f444c0b47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55222/0 (socket says 172.21.15.44:55222) 2023-11-04T01:37:45.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.324+0000 7f444a7fc640 1 -- 172.21.15.44:0/1219376832 learned_addr learned my addr 172.21.15.44:0/1219376832 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:45.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.324+0000 7f444affd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f444c0cd9f0 0x7f444c0cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32846/0 (socket says 172.21.15.44:32846) 2023-11-04T01:37:45.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.325+0000 7f444b7fe640 1 --2- 172.21.15.44:0/1219376832 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f444c0d27c0 0x7f444c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.325+0000 7f444affd640 1 -- 172.21.15.44:0/1219376832 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f444c0d27c0 msgr2=0x7f444c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:45.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.325+0000 7f444affd640 1 --2- 172.21.15.44:0/1219376832 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f444c0d27c0 0x7f444c15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.325+0000 7f444affd640 1 -- 172.21.15.44:0/1219376832 >> v1:172.21.15.44:6789/0 conn(0x7f444c15d4b0 legacy=0x7f444c0b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.325+0000 7f4449ffb640 1 -- 172.21.15.44:0/1219376832 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984444330 0 0) 0x7f444c0d1320 con 0x7f444c15d4b0 2023-11-04T01:37:45.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.325+0000 7f444affd640 1 -- 172.21.15.44:0/1219376832 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c15df10 con 0x7f444c0cd9f0 2023-11-04T01:37:45.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.325+0000 7f444b7fe640 1 --2- 172.21.15.44:0/1219376832 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f444c0d27c0 0x7f444c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:45.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.325+0000 7f444affd640 1 --2- 172.21.15.44:0/1219376832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f444c0cd9f0 0x7f444c0cddd0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f443c009d90 tx=0x7f443c02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163d7b4763db91a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.326+0000 7f4449ffb640 1 -- 172.21.15.44:0/1219376832 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c02cce0 con 0x7f444c0cd9f0 2023-11-04T01:37:45.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.326+0000 7f4449ffb640 1 -- 172.21.15.44:0/1219376832 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c02ce40 con 0x7f444c0cd9f0 2023-11-04T01:37:45.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.326+0000 7f4449ffb640 1 -- 172.21.15.44:0/1219376832 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c034660 con 0x7f444c0cd9f0 2023-11-04T01:37:45.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.326+0000 7f44514a9640 1 -- 172.21.15.44:0/1219376832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f444c0cd9f0 msgr2=0x7f444c0cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.326+0000 7f44514a9640 1 --2- 172.21.15.44:0/1219376832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f444c0cd9f0 0x7f444c0cddd0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f443c009d90 tx=0x7f443c02bf30 comp rx=0 tx=0).stop 2023-11-04T01:37:45.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.326+0000 7f44514a9640 1 -- 172.21.15.44:0/1219376832 shutdown_connections 2023-11-04T01:37:45.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.326+0000 7f44514a9640 1 --2- 172.21.15.44:0/1219376832 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f444c0d27c0 0x7f444c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.326+0000 7f44514a9640 1 --2- 172.21.15.44:0/1219376832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f444c0cd9f0 0x7f444c0cddd0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.326+0000 7f44514a9640 1 -- 172.21.15.44:0/1219376832 >> 172.21.15.44:0/1219376832 conn(0x7f444c071c40 msgr2=0x7f444c072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:45.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.326+0000 7f44514a9640 1 -- 172.21.15.44:0/1219376832 shutdown_connections 2023-11-04T01:37:45.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.326+0000 7f44514a9640 1 -- 172.21.15.44:0/1219376832 wait complete. 2023-11-04T01:37:45.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.328+0000 7f44514a9640 1 Processor -- start 2023-11-04T01:37:45.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.328+0000 7f44514a9640 1 -- start start 2023-11-04T01:37:45.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.328+0000 7f44514a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f444c0cd9f0 0x7f444c1510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.328+0000 7f44514a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f444c0d27c0 0x7f444c0b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.328+0000 7f44514a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f444c15d4b0 0x7f444c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.328+0000 7f44514a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c1515f0 con 0x7f444c0cd9f0 2023-11-04T01:37:45.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.328+0000 7f44514a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0b30c0 con 0x7f444c15d4b0 2023-11-04T01:37:45.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.328+0000 7f44514a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0b33a0 con 0x7f444c0d27c0 2023-11-04T01:37:45.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.328+0000 7f444affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f444c0cd9f0 0x7f444c1510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.328+0000 7f444affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f444c0cd9f0 0x7f444c1510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32854/0 (socket says 172.21.15.44:32854) 2023-11-04T01:37:45.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.328+0000 7f444affd640 1 -- 172.21.15.44:0/3717899042 learned_addr learned my addr 172.21.15.44:0/3717899042 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:45.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.329+0000 7f444a7fc640 1 --2- 172.21.15.44:0/3717899042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f444c0d27c0 0x7f444c0b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.329+0000 7f444b7fe640 1 --2- 172.21.15.44:0/3717899042 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f444c15d4b0 0x7f444c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.329+0000 7f444affd640 1 -- 172.21.15.44:0/3717899042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f444c0d27c0 msgr2=0x7f444c0b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.329+0000 7f444affd640 1 --2- 172.21.15.44:0/3717899042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f444c0d27c0 0x7f444c0b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.329+0000 7f444affd640 1 -- 172.21.15.44:0/3717899042 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f444c15d4b0 msgr2=0x7f444c15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.329+0000 7f444affd640 1 --2- 172.21.15.44:0/3717899042 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f444c15d4b0 0x7f444c15e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.329+0000 7f444affd640 1 -- 172.21.15.44:0/3717899042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c009a70 con 0x7f444c0cd9f0 2023-11-04T01:37:45.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.329+0000 7f444affd640 1 --2- 172.21.15.44:0/3717899042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f444c0cd9f0 0x7f444c1510b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f443c000f80 tx=0x7f443c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.329+0000 7f44337fe640 1 -- 172.21.15.44:0/3717899042 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c003b90 con 0x7f444c0cd9f0 2023-11-04T01:37:45.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.329+0000 7f44337fe640 1 -- 172.21.15.44:0/3717899042 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c003cf0 con 0x7f444c0cd9f0 2023-11-04T01:37:45.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.329+0000 7f44514a9640 1 -- 172.21.15.44:0/3717899042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444c0b3680 con 0x7f444c0cd9f0 2023-11-04T01:37:45.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.329+0000 7f44337fe640 1 -- 172.21.15.44:0/3717899042 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c004260 con 0x7f444c0cd9f0 2023-11-04T01:37:45.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.329+0000 7f44514a9640 1 -- 172.21.15.44:0/3717899042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f444c0b3c40 con 0x7f444c0cd9f0 2023-11-04T01:37:45.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.330+0000 7f44514a9640 1 -- 172.21.15.44:0/3717899042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444c04e490 con 0x7f444c0cd9f0 2023-11-04T01:37:45.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.331+0000 7f44337fe640 1 -- 172.21.15.44:0/3717899042 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f443c03b050 con 0x7f444c0cd9f0 2023-11-04T01:37:45.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.331+0000 7f44337fe640 1 --2- 172.21.15.44:0/3717899042 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f443806ae70 0x7f443806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.331+0000 7f44337fe640 1 -- 172.21.15.44:0/3717899042 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6059+0+0 (secure 0 0 0) 0x7f443c0abee0 con 0x7f444c0cd9f0 2023-11-04T01:37:45.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.331+0000 7f444a7fc640 1 --2- 172.21.15.44:0/3717899042 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f443806ae70 0x7f443806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.332+0000 7f444a7fc640 1 --2- 172.21.15.44:0/3717899042 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f443806ae70 0x7f443806d330 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f444c0cd910 tx=0x7f4440007c00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.335+0000 7f44337fe640 1 -- 172.21.15.44:0/3717899042 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f443c076e30 con 0x7f444c0cd9f0 2023-11-04T01:37:45.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:45.510+0000 7f44514a9640 1 -- 172.21.15.44:0/3717899042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f444c0b6540 con 0x7f444c0cd9f0 2023-11-04T01:37:46.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.259+0000 7f44337fe640 1 -- 172.21.15.44:0/3717899042 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v48) v1 ==== 169+0+0 (secure 0 0 0) 0x7f443c07a450 con 0x7f444c0cd9f0 2023-11-04T01:37:46.260 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2023-11-04T01:37:46.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.262+0000 7f44514a9640 1 -- 172.21.15.44:0/3717899042 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f443806ae70 msgr2=0x7f443806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.262+0000 7f44514a9640 1 --2- 172.21.15.44:0/3717899042 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f443806ae70 0x7f443806d330 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f444c0cd910 tx=0x7f4440007c00 comp rx=0 tx=0).stop 2023-11-04T01:37:46.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.262+0000 7f44514a9640 1 -- 172.21.15.44:0/3717899042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f444c0cd9f0 msgr2=0x7f444c1510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.262+0000 7f44514a9640 1 --2- 172.21.15.44:0/3717899042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f444c0cd9f0 0x7f444c1510b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f443c000f80 tx=0x7f443c004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:46.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.262+0000 7f44514a9640 1 -- 172.21.15.44:0/3717899042 shutdown_connections 2023-11-04T01:37:46.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.262+0000 7f44514a9640 1 --2- 172.21.15.44:0/3717899042 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f443806ae70 0x7f443806d330 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.262+0000 7f44514a9640 1 --2- 172.21.15.44:0/3717899042 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f444c15d4b0 0x7f444c15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.262+0000 7f44514a9640 1 --2- 172.21.15.44:0/3717899042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f444c0d27c0 0x7f444c0b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.262+0000 7f44514a9640 1 --2- 172.21.15.44:0/3717899042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f444c0cd9f0 0x7f444c1510b0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.262+0000 7f44514a9640 1 -- 172.21.15.44:0/3717899042 >> 172.21.15.44:0/3717899042 conn(0x7f444c071c40 msgr2=0x7f444c15fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:46.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.262+0000 7f44514a9640 1 -- 172.21.15.44:0/3717899042 shutdown_connections 2023-11-04T01:37:46.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.262+0000 7f44514a9640 1 -- 172.21.15.44:0/3717899042 wait complete. 2023-11-04T01:37:46.281 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:37:46.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.394+0000 7f95bf4a2640 1 Processor -- start 2023-11-04T01:37:46.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.394+0000 7f95bf4a2640 1 -- start start 2023-11-04T01:37:46.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.395+0000 7f95bf4a2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f95b8159c00 0x7f95b80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.395+0000 7f95bf4a2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f95b80ae1d0 0x7f95b80c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.395+0000 7f95bf4a2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b815aff0 con 0x7f95b80c48e0 2023-11-04T01:37:46.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.395+0000 7f95bf4a2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b80c52d0 con 0x7f95b80ae1d0 2023-11-04T01:37:46.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.395+0000 7f95bf4a2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b815a3e0 con 0x7f95b8159c00 2023-11-04T01:37:46.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.395+0000 7f95bda3f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f95b80ae1d0 0x7f95b80c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.395+0000 7f95bca3d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f95b80c48e0 0x7f95b80adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55238/0 (socket says 172.21.15.44:55238) 2023-11-04T01:37:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.395+0000 7f95bca3d640 1 -- 172.21.15.44:0/2802059103 learned_addr learned my addr 172.21.15.44:0/2802059103 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.395+0000 7f95bda3f640 1 -- 172.21.15.44:0/2802059103 >> v2:172.21.15.204:3300/0 conn(0x7f95b8159c00 msgr2=0x7f95b80cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.395+0000 7f95bda3f640 1 --2- 172.21.15.44:0/2802059103 >> v2:172.21.15.204:3300/0 conn(0x7f95b8159c00 0x7f95b80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.395+0000 7f95bda3f640 1 -- 172.21.15.44:0/2802059103 >> v1:172.21.15.44:6789/0 conn(0x7f95b80c48e0 legacy=0x7f95b80adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.395+0000 7f95bda3f640 1 -- 172.21.15.44:0/2802059103 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b815a6c0 con 0x7f95b80ae1d0 2023-11-04T01:37:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.395+0000 7f95affff640 1 -- 172.21.15.44:0/2802059103 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485825401 0 0) 0x7f95b815aff0 con 0x7f95b80c48e0 2023-11-04T01:37:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.396+0000 7f95bda3f640 1 --2- 172.21.15.44:0/2802059103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95b80ae1d0 0x7f95b80c4d90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f95b80cc4d0 tx=0x7f95b002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60450b48a8bd0773 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.396+0000 7f95affff640 1 -- 172.21.15.44:0/2802059103 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b002cbf0 con 0x7f95b80ae1d0 2023-11-04T01:37:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.396+0000 7f95affff640 1 -- 172.21.15.44:0/2802059103 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b002cd50 con 0x7f95b80ae1d0 2023-11-04T01:37:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.396+0000 7f95affff640 1 -- 172.21.15.44:0/2802059103 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0034660 con 0x7f95b80ae1d0 2023-11-04T01:37:46.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.397+0000 7f95bf4a2640 1 -- 172.21.15.44:0/2802059103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95b80ae1d0 msgr2=0x7f95b80c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.397+0000 7f95bf4a2640 1 --2- 172.21.15.44:0/2802059103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95b80ae1d0 0x7f95b80c4d90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f95b80cc4d0 tx=0x7f95b002be40 comp rx=0 tx=0).stop 2023-11-04T01:37:46.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.397+0000 7f95bf4a2640 1 -- 172.21.15.44:0/2802059103 shutdown_connections 2023-11-04T01:37:46.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.397+0000 7f95bf4a2640 1 --2- 172.21.15.44:0/2802059103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95b80ae1d0 0x7f95b80c4d90 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.397+0000 7f95bf4a2640 1 --2- 172.21.15.44:0/2802059103 >> v2:172.21.15.204:3300/0 conn(0x7f95b8159c00 0x7f95b80cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.397+0000 7f95bf4a2640 1 -- 172.21.15.44:0/2802059103 >> 172.21.15.44:0/2802059103 conn(0x7f95b80ce950 msgr2=0x7f95b80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:46.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.397+0000 7f95bf4a2640 1 -- 172.21.15.44:0/2802059103 shutdown_connections 2023-11-04T01:37:46.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.397+0000 7f95bf4a2640 1 -- 172.21.15.44:0/2802059103 wait complete. 2023-11-04T01:37:46.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.398+0000 7f95bf4a2640 1 Processor -- start 2023-11-04T01:37:46.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.398+0000 7f95bf4a2640 1 -- start start 2023-11-04T01:37:46.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bf4a2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95b80ae1d0 0x7f95b8154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bf4a2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95b80c48e0 0x7f95b80b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bf4a2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95b8159c00 0x7f95b81577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bf4a2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80b2a50 con 0x7f95b80c48e0 2023-11-04T01:37:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bf4a2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80b2c30 con 0x7f95b8159c00 2023-11-04T01:37:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bf4a2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80b2f10 con 0x7f95b80ae1d0 2023-11-04T01:37:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bca3d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95b80c48e0 0x7f95b80b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bca3d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95b80c48e0 0x7f95b80b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32870/0 (socket says 172.21.15.44:32870) 2023-11-04T01:37:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bca3d640 1 -- 172.21.15.44:0/139639759 learned_addr learned my addr 172.21.15.44:0/139639759 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bda3f640 1 --2- 172.21.15.44:0/139639759 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95b8159c00 0x7f95b81577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bd23e640 1 --2- 172.21.15.44:0/139639759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95b80ae1d0 0x7f95b8154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bca3d640 1 -- 172.21.15.44:0/139639759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95b80ae1d0 msgr2=0x7f95b8154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bca3d640 1 --2- 172.21.15.44:0/139639759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95b80ae1d0 0x7f95b8154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bca3d640 1 -- 172.21.15.44:0/139639759 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95b8159c00 msgr2=0x7f95b81577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bca3d640 1 --2- 172.21.15.44:0/139639759 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95b8159c00 0x7f95b81577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bca3d640 1 -- 172.21.15.44:0/139639759 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0009a70 con 0x7f95b80c48e0 2023-11-04T01:37:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.399+0000 7f95bca3d640 1 --2- 172.21.15.44:0/139639759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95b80c48e0 0x7f95b80b3cd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f95a800c4d0 tx=0x7f95a800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:46.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.400+0000 7f95adffb640 1 -- 172.21.15.44:0/139639759 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a80074e0 con 0x7f95b80c48e0 2023-11-04T01:37:46.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.400+0000 7f95adffb640 1 -- 172.21.15.44:0/139639759 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a8007660 con 0x7f95b80c48e0 2023-11-04T01:37:46.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.400+0000 7f95bf4a2640 1 -- 172.21.15.44:0/139639759 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b80b31f0 con 0x7f95b80c48e0 2023-11-04T01:37:46.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.400+0000 7f95adffb640 1 -- 172.21.15.44:0/139639759 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8004a20 con 0x7f95b80c48e0 2023-11-04T01:37:46.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.400+0000 7f95bf4a2640 1 -- 172.21.15.44:0/139639759 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b80b37b0 con 0x7f95b80c48e0 2023-11-04T01:37:46.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.401+0000 7f95bf4a2640 1 -- 172.21.15.44:0/139639759 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b8074290 con 0x7f95b80c48e0 2023-11-04T01:37:46.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.401+0000 7f95adffb640 1 -- 172.21.15.44:0/139639759 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95a8004b80 con 0x7f95b80c48e0 2023-11-04T01:37:46.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.401+0000 7f95adffb640 1 --2- 172.21.15.44:0/139639759 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f959c06ae70 0x7f959c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.402+0000 7f95adffb640 1 -- 172.21.15.44:0/139639759 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f95a8088c00 con 0x7f95b80c48e0 2023-11-04T01:37:46.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.402+0000 7f95bd23e640 1 --2- 172.21.15.44:0/139639759 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f959c06ae70 0x7f959c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.402+0000 7f95bd23e640 1 --2- 172.21.15.44:0/139639759 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f959c06ae70 0x7f959c06d330 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f95b400b810 tx=0x7f95b4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:46.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.406+0000 7f95adffb640 1 -- 172.21.15.44:0/139639759 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f95a8053c00 con 0x7f95b80c48e0 2023-11-04T01:37:46.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.581+0000 7f95bf4a2640 1 -- 172.21.15.44:0/139639759 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f95b81545a0 con 0x7f95b80c48e0 2023-11-04T01:37:46.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.584+0000 7f95adffb640 1 -- 172.21.15.44:0/139639759 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f95a8018020 con 0x7f95b80c48e0 2023-11-04T01:37:46.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.587+0000 7f95bf4a2640 1 -- 172.21.15.44:0/139639759 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f959c06ae70 msgr2=0x7f959c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.587+0000 7f95bf4a2640 1 --2- 172.21.15.44:0/139639759 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f959c06ae70 0x7f959c06d330 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f95b400b810 tx=0x7f95b4008040 comp rx=0 tx=0).stop 2023-11-04T01:37:46.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.587+0000 7f95bf4a2640 1 -- 172.21.15.44:0/139639759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95b80c48e0 msgr2=0x7f95b80b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.587+0000 7f95bf4a2640 1 --2- 172.21.15.44:0/139639759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95b80c48e0 0x7f95b80b3cd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f95a800c4d0 tx=0x7f95a800c990 comp rx=0 tx=0).stop 2023-11-04T01:37:46.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.587+0000 7f95bf4a2640 1 -- 172.21.15.44:0/139639759 shutdown_connections 2023-11-04T01:37:46.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.587+0000 7f95bf4a2640 1 --2- 172.21.15.44:0/139639759 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f959c06ae70 0x7f959c06d330 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.587+0000 7f95bf4a2640 1 --2- 172.21.15.44:0/139639759 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95b8159c00 0x7f95b81577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.587+0000 7f95bf4a2640 1 --2- 172.21.15.44:0/139639759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95b80c48e0 0x7f95b80b3cd0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.587+0000 7f95bf4a2640 1 --2- 172.21.15.44:0/139639759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95b80ae1d0 0x7f95b8154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.587+0000 7f95bf4a2640 1 -- 172.21.15.44:0/139639759 >> 172.21.15.44:0/139639759 conn(0x7f95b80ce950 msgr2=0x7f95b80ad640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:46.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.587+0000 7f95bf4a2640 1 -- 172.21.15.44:0/139639759 shutdown_connections 2023-11-04T01:37:46.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.587+0000 7f95bf4a2640 1 -- 172.21.15.44:0/139639759 wait complete. 2023-11-04T01:37:46.599 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-11-04T01:37:46.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.704+0000 7f71b134c640 1 Processor -- start 2023-11-04T01:37:46.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.704+0000 7f71b134c640 1 -- start start 2023-11-04T01:37:46.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71b134c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f71ac0b1c00 0x7f71ac0aef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71b134c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f71ac0cb840 0x7f71ac0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71b134c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ac15a390 con 0x7f71ac159fb0 2023-11-04T01:37:46.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71b134c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ac0cb3b0 con 0x7f71ac0b1c00 2023-11-04T01:37:46.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71b134c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ac0ceb60 con 0x7f71ac0cb840 2023-11-04T01:37:46.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71a3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f71ac0b1c00 0x7f71ac0aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71aaffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f71ac159fb0 0x7f71ac0b14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55252/0 (socket says 172.21.15.44:55252) 2023-11-04T01:37:46.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71aaffd640 1 -- 172.21.15.44:0/3190367217 learned_addr learned my addr 172.21.15.44:0/3190367217 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:46.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71a3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f71ac0b1c00 0x7f71ac0aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32878/0 (socket says 172.21.15.44:32878) 2023-11-04T01:37:46.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71a3fff640 1 -- 172.21.15.44:0/3190367217 >> v2:172.21.15.204:3300/0 conn(0x7f71ac0cb840 msgr2=0x7f71ac0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:46.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71ab7fe640 1 --2- 172.21.15.44:0/3190367217 >> v2:172.21.15.204:3300/0 conn(0x7f71ac0cb840 0x7f71ac0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71aa7fc640 1 -- 172.21.15.44:0/3190367217 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367126691 0 0) 0x7f719c001290 con 0x7f71ac159fb0 2023-11-04T01:37:46.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71a3fff640 1 --2- 172.21.15.44:0/3190367217 >> v2:172.21.15.204:3300/0 conn(0x7f71ac0cb840 0x7f71ac0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71a3fff640 1 -- 172.21.15.44:0/3190367217 >> v1:172.21.15.44:6789/0 conn(0x7f71ac159fb0 legacy=0x7f71ac0b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71a3fff640 1 -- 172.21.15.44:0/3190367217 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac0caa80 con 0x7f71ac0b1c00 2023-11-04T01:37:46.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.705+0000 7f71ab7fe640 1 --2- 172.21.15.44:0/3190367217 >> v2:172.21.15.204:3300/0 conn(0x7f71ac0cb840 0x7f71ac0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:46.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.706+0000 7f71a3fff640 1 --2- 172.21.15.44:0/3190367217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ac0b1c00 0x7f71ac0aef60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f71ac072620 tx=0x7f719402e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205190fb14c4fe01 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:46.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.706+0000 7f71aa7fc640 1 -- 172.21.15.44:0/3190367217 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719402edc0 con 0x7f71ac0b1c00 2023-11-04T01:37:46.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.706+0000 7f71aa7fc640 1 -- 172.21.15.44:0/3190367217 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7194036440 con 0x7f71ac0b1c00 2023-11-04T01:37:46.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.706+0000 7f71aa7fc640 1 -- 172.21.15.44:0/3190367217 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940367d0 con 0x7f71ac0b1c00 2023-11-04T01:37:46.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.707+0000 7f71b134c640 1 -- 172.21.15.44:0/3190367217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ac0b1c00 msgr2=0x7f71ac0aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.707+0000 7f71b134c640 1 --2- 172.21.15.44:0/3190367217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ac0b1c00 0x7f71ac0aef60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f71ac072620 tx=0x7f719402e010 comp rx=0 tx=0).stop 2023-11-04T01:37:46.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.707+0000 7f71b134c640 1 -- 172.21.15.44:0/3190367217 shutdown_connections 2023-11-04T01:37:46.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.707+0000 7f71b134c640 1 --2- 172.21.15.44:0/3190367217 >> v2:172.21.15.204:3300/0 conn(0x7f71ac0cb840 0x7f71ac0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.707+0000 7f71b134c640 1 --2- 172.21.15.44:0/3190367217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ac0b1c00 0x7f71ac0aef60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.707+0000 7f71b134c640 1 -- 172.21.15.44:0/3190367217 >> 172.21.15.44:0/3190367217 conn(0x7f71ac098d40 msgr2=0x7f71ac0cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:46.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.707+0000 7f71b134c640 1 -- 172.21.15.44:0/3190367217 shutdown_connections 2023-11-04T01:37:46.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.707+0000 7f71b134c640 1 -- 172.21.15.44:0/3190367217 wait complete. 2023-11-04T01:37:46.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.708+0000 7f71b134c640 1 Processor -- start 2023-11-04T01:37:46.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.708+0000 7f71b134c640 1 -- start start 2023-11-04T01:37:46.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71b134c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0b1c00 0x7f71ac158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71b134c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac0cb840 0x7f71ac0c2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71b134c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ac159fb0 0x7f71ac0b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71b134c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0c39f0 con 0x7f71ac159fb0 2023-11-04T01:37:46.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71b134c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0c3cd0 con 0x7f71ac0cb840 2023-11-04T01:37:46.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71b134c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0c3fb0 con 0x7f71ac0b1c00 2023-11-04T01:37:46.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71ab7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ac159fb0 0x7f71ac0b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71ab7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ac159fb0 0x7f71ac0b2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32884/0 (socket says 172.21.15.44:32884) 2023-11-04T01:37:46.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71ab7fe640 1 -- 172.21.15.44:0/1310175361 learned_addr learned my addr 172.21.15.44:0/1310175361 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:46.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71a3fff640 1 --2- 172.21.15.44:0/1310175361 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac0cb840 0x7f71ac0c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71aaffd640 1 --2- 172.21.15.44:0/1310175361 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0b1c00 0x7f71ac158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71ab7fe640 1 -- 172.21.15.44:0/1310175361 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0b1c00 msgr2=0x7f71ac158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71ab7fe640 1 --2- 172.21.15.44:0/1310175361 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0b1c00 0x7f71ac158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71ab7fe640 1 -- 172.21.15.44:0/1310175361 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac0cb840 msgr2=0x7f71ac0c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71ab7fe640 1 --2- 172.21.15.44:0/1310175361 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac0cb840 0x7f71ac0c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71ab7fe640 1 -- 172.21.15.44:0/1310175361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719400b640 con 0x7f71ac159fb0 2023-11-04T01:37:46.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71aaffd640 1 --2- 172.21.15.44:0/1310175361 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0b1c00 0x7f71ac158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:46.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71ab7fe640 1 --2- 172.21.15.44:0/1310175361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ac159fb0 0x7f71ac0b2b30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f71a400cef0 tx=0x7f71a400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:46.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71a37fe640 1 -- 172.21.15.44:0/1310175361 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400d840 con 0x7f71ac159fb0 2023-11-04T01:37:46.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.709+0000 7f71a37fe640 1 -- 172.21.15.44:0/1310175361 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a400d9c0 con 0x7f71ac159fb0 2023-11-04T01:37:46.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.710+0000 7f71b134c640 1 -- 172.21.15.44:0/1310175361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ac0c4290 con 0x7f71ac159fb0 2023-11-04T01:37:46.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.710+0000 7f71a37fe640 1 -- 172.21.15.44:0/1310175361 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400dd70 con 0x7f71ac159fb0 2023-11-04T01:37:46.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.710+0000 7f71b134c640 1 -- 172.21.15.44:0/1310175361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ac159070 con 0x7f71ac159fb0 2023-11-04T01:37:46.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.711+0000 7f71b134c640 1 -- 172.21.15.44:0/1310175361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ac0c47b0 con 0x7f71ac159fb0 2023-11-04T01:37:46.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.711+0000 7f71a37fe640 1 -- 172.21.15.44:0/1310175361 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71a401e3b0 con 0x7f71ac159fb0 2023-11-04T01:37:46.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.711+0000 7f71a37fe640 1 --2- 172.21.15.44:0/1310175361 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f718c06ae70 0x7f718c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.712+0000 7f71a37fe640 1 -- 172.21.15.44:0/1310175361 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f71a4089fe0 con 0x7f71ac159fb0 2023-11-04T01:37:46.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.712+0000 7f71aaffd640 1 --2- 172.21.15.44:0/1310175361 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f718c06ae70 0x7f718c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.712+0000 7f71aaffd640 1 --2- 172.21.15.44:0/1310175361 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f718c06ae70 0x7f718c06d330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f719c0010e0 tx=0x7f719c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:46.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.716+0000 7f71a37fe640 1 -- 172.21.15.44:0/1310175361 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f71ac0c47b0 con 0x7f71ac159fb0 2023-11-04T01:37:46.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:46.968+0000 7f71b134c640 1 -- 172.21.15.44:0/1310175361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7f71ac0c47b0 con 0x7f71ac159fb0 2023-11-04T01:37:47.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.260+0000 7f71a37fe640 1 -- 172.21.15.44:0/1310175361 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v123) v1 ==== 173+0+0 (secure 0 0 0) 0x7f71ac0c47b0 con 0x7f71ac159fb0 2023-11-04T01:37:47.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.262+0000 7f71b134c640 1 -- 172.21.15.44:0/1310175361 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f718c06ae70 msgr2=0x7f718c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.262+0000 7f71b134c640 1 --2- 172.21.15.44:0/1310175361 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f718c06ae70 0x7f718c06d330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f719c0010e0 tx=0x7f719c009040 comp rx=0 tx=0).stop 2023-11-04T01:37:47.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.262+0000 7f71b134c640 1 -- 172.21.15.44:0/1310175361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ac159fb0 msgr2=0x7f71ac0b2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.262+0000 7f71b134c640 1 --2- 172.21.15.44:0/1310175361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ac159fb0 0x7f71ac0b2b30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f71a400cef0 tx=0x7f71a400a710 comp rx=0 tx=0).stop 2023-11-04T01:37:47.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.263+0000 7f71b134c640 1 -- 172.21.15.44:0/1310175361 shutdown_connections 2023-11-04T01:37:47.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.263+0000 7f71b134c640 1 --2- 172.21.15.44:0/1310175361 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f718c06ae70 0x7f718c06d330 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.263+0000 7f71b134c640 1 --2- 172.21.15.44:0/1310175361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ac159fb0 0x7f71ac0b2b30 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.263+0000 7f71b134c640 1 --2- 172.21.15.44:0/1310175361 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac0cb840 0x7f71ac0c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.263+0000 7f71b134c640 1 --2- 172.21.15.44:0/1310175361 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0b1c00 0x7f71ac158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.263+0000 7f71b134c640 1 -- 172.21.15.44:0/1310175361 >> 172.21.15.44:0/1310175361 conn(0x7f71ac098d40 msgr2=0x7f71ac06d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:47.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.263+0000 7f71b134c640 1 -- 172.21.15.44:0/1310175361 shutdown_connections 2023-11-04T01:37:47.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.263+0000 7f71b134c640 1 -- 172.21.15.44:0/1310175361 wait complete. 2023-11-04T01:37:47.277 INFO:tasks.cephfs_test_runner:Test that attempt to attach pool with snapshots to an fs fails ... ok 2023-11-04T01:37:47.277 INFO:tasks.cephfs_test_runner:Starting test: test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that creation of monitor managed snaps fails for pools attached 2023-11-04T01:37:47.278 INFO:tasks.cephfs_test_runner:test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:37:47.279 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.386+0000 7f94395f5640 1 Processor -- start 2023-11-04T01:37:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.386+0000 7f94395f5640 1 -- start start 2023-11-04T01:37:47.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.386+0000 7f94395f5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f943415ab70 0x7f94340cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.386+0000 7f94395f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f943406eba0 0x7f943406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.386+0000 7f94395f5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f943406a660 0x7f94340ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.387+0000 7f94395f5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94340cba70 con 0x7f943406a660 2023-11-04T01:37:47.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.387+0000 7f94395f5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943415d650 con 0x7f943415ab70 2023-11-04T01:37:47.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.387+0000 7f94395f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943415e620 con 0x7f943406eba0 2023-11-04T01:37:47.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.387+0000 7f94337fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f943406a660 0x7f94340ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.387+0000 7f94337fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f943406a660 0x7f94340ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32892/0 (socket says 172.21.15.44:32892) 2023-11-04T01:37:47.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.387+0000 7f94337fe640 1 -- 172.21.15.44:0/1496837141 learned_addr learned my addr 172.21.15.44:0/1496837141 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:47.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.387+0000 7f942bfff640 1 --2- 172.21.15.44:0/1496837141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f943406eba0 0x7f943406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.387+0000 7f94337fe640 1 -- 172.21.15.44:0/1496837141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f943406eba0 msgr2=0x7f943406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:47.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.387+0000 7f9432ffd640 1 --2- 172.21.15.44:0/1496837141 >> v2:172.21.15.204:3300/0 conn(0x7f943415ab70 0x7f94340cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.387+0000 7f94337fe640 1 --2- 172.21.15.44:0/1496837141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f943406eba0 0x7f943406a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.387+0000 7f94337fe640 1 -- 172.21.15.44:0/1496837141 >> v2:172.21.15.204:3300/0 conn(0x7f943415ab70 msgr2=0x7f94340cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:47.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.387+0000 7f94337fe640 1 --2- 172.21.15.44:0/1496837141 >> v2:172.21.15.204:3300/0 conn(0x7f943415ab70 0x7f94340cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.387+0000 7f94337fe640 1 -- 172.21.15.44:0/1496837141 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943406aa90 con 0x7f943406a660 2023-11-04T01:37:47.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.388+0000 7f94337fe640 1 --2- 172.21.15.44:0/1496837141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943406a660 0x7f94340ae5e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f94340b2600 tx=0x7f942c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a44de3415d57d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:47.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.388+0000 7f94327fc640 1 -- 172.21.15.44:0/1496837141 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c02c9e0 con 0x7f943406a660 2023-11-04T01:37:47.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.388+0000 7f94327fc640 1 -- 172.21.15.44:0/1496837141 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c02cb40 con 0x7f943406a660 2023-11-04T01:37:47.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.388+0000 7f94327fc640 1 -- 172.21.15.44:0/1496837141 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0343f0 con 0x7f943406a660 2023-11-04T01:37:47.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.388+0000 7f94395f5640 1 -- 172.21.15.44:0/1496837141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943406a660 msgr2=0x7f94340ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.388+0000 7f94395f5640 1 --2- 172.21.15.44:0/1496837141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943406a660 0x7f94340ae5e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f94340b2600 tx=0x7f942c02be40 comp rx=0 tx=0).stop 2023-11-04T01:37:47.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.389+0000 7f94395f5640 1 -- 172.21.15.44:0/1496837141 shutdown_connections 2023-11-04T01:37:47.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.389+0000 7f94395f5640 1 --2- 172.21.15.44:0/1496837141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943406a660 0x7f94340ae5e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.389+0000 7f94395f5640 1 --2- 172.21.15.44:0/1496837141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f943406eba0 0x7f943406a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.389+0000 7f94395f5640 1 --2- 172.21.15.44:0/1496837141 >> v2:172.21.15.204:3300/0 conn(0x7f943415ab70 0x7f94340cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.389+0000 7f94395f5640 1 -- 172.21.15.44:0/1496837141 >> 172.21.15.44:0/1496837141 conn(0x7f9434098d40 msgr2=0x7f94340cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:47.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.389+0000 7f94395f5640 1 -- 172.21.15.44:0/1496837141 shutdown_connections 2023-11-04T01:37:47.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.389+0000 7f94395f5640 1 -- 172.21.15.44:0/1496837141 wait complete. 2023-11-04T01:37:47.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.390+0000 7f94395f5640 1 Processor -- start 2023-11-04T01:37:47.392 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.390+0000 7f94395f5640 1 -- start start 2023-11-04T01:37:47.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f94395f5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f943406a660 0x7f943409d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f94395f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943406eba0 0x7f94341f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f94395f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f943415ab70 0x7f94340c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f94395f5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94341f3ba0 con 0x7f943406eba0 2023-11-04T01:37:47.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f94395f5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94341f35e0 con 0x7f943406a660 2023-11-04T01:37:47.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f94395f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94341f38c0 con 0x7f943415ab70 2023-11-04T01:37:47.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f942bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943406eba0 0x7f94341f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f942bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943406eba0 0x7f94341f2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32894/0 (socket says 172.21.15.44:32894) 2023-11-04T01:37:47.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f942bfff640 1 -- 172.21.15.44:0/855449008 learned_addr learned my addr 172.21.15.44:0/855449008 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f9432ffd640 1 --2- 172.21.15.44:0/855449008 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f943406a660 0x7f943409d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f942bfff640 1 -- 172.21.15.44:0/855449008 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f943415ab70 msgr2=0x7f94340c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f94337fe640 1 --2- 172.21.15.44:0/855449008 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f943415ab70 0x7f94340c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f942bfff640 1 --2- 172.21.15.44:0/855449008 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f943415ab70 0x7f94340c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f942bfff640 1 -- 172.21.15.44:0/855449008 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f943406a660 msgr2=0x7f943409d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f942bfff640 1 --2- 172.21.15.44:0/855449008 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f943406a660 0x7f943409d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f942bfff640 1 -- 172.21.15.44:0/855449008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c009b30 con 0x7f943406eba0 2023-11-04T01:37:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f9432ffd640 1 --2- 172.21.15.44:0/855449008 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f943406a660 0x7f943409d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f942bfff640 1 --2- 172.21.15.44:0/855449008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943406eba0 0x7f94341f2cb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f941c00c570 tx=0x7f941c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f942b7fe640 1 -- 172.21.15.44:0/855449008 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c011800 con 0x7f943406eba0 2023-11-04T01:37:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f942b7fe640 1 -- 172.21.15.44:0/855449008 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c011960 con 0x7f943406eba0 2023-11-04T01:37:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f94395f5640 1 -- 172.21.15.44:0/855449008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943409c810 con 0x7f943406eba0 2023-11-04T01:37:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.391+0000 7f942b7fe640 1 -- 172.21.15.44:0/855449008 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c011d10 con 0x7f943406eba0 2023-11-04T01:37:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.392+0000 7f94395f5640 1 -- 172.21.15.44:0/855449008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943409d550 con 0x7f943406eba0 2023-11-04T01:37:47.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.393+0000 7f94395f5640 1 -- 172.21.15.44:0/855449008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94340cd590 con 0x7f943406eba0 2023-11-04T01:37:47.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.393+0000 7f942b7fe640 1 -- 172.21.15.44:0/855449008 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f941c018360 con 0x7f943406eba0 2023-11-04T01:37:47.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.393+0000 7f942b7fe640 1 --2- 172.21.15.44:0/855449008 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f941406ae70 0x7f941406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.393+0000 7f942b7fe640 1 -- 172.21.15.44:0/855449008 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f941c089680 con 0x7f943406eba0 2023-11-04T01:37:47.396 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.394+0000 7f9432ffd640 1 --2- 172.21.15.44:0/855449008 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f941406ae70 0x7f941406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.394+0000 7f9432ffd640 1 --2- 172.21.15.44:0/855449008 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f941406ae70 0x7f941406d330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9424006fd0 tx=0x7f9424008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:47.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.398+0000 7f942b7fe640 1 -- 172.21.15.44:0/855449008 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f941c054680 con 0x7f943406eba0 2023-11-04T01:37:47.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.576+0000 7f94395f5640 1 -- 172.21.15.44:0/855449008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f943409cd30 con 0x7f943406eba0 2023-11-04T01:37:47.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.577+0000 7f942b7fe640 1 -- 172.21.15.44:0/855449008 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+14944 (secure 0 0 0) 0x7f943409cd30 con 0x7f943406eba0 2023-11-04T01:37:47.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:47.578 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":48,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:46.256120+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/2457583329":"2023-11-05T01:37:42.819777+0000","172.21.15.44:6833/2457583329":"2023-11-05T01:37:42.819777+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:47.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.579+0000 7f94395f5640 1 -- 172.21.15.44:0/855449008 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f941406ae70 msgr2=0x7f941406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.579+0000 7f94395f5640 1 --2- 172.21.15.44:0/855449008 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f941406ae70 0x7f941406d330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9424006fd0 tx=0x7f9424008040 comp rx=0 tx=0).stop 2023-11-04T01:37:47.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.579+0000 7f94395f5640 1 -- 172.21.15.44:0/855449008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943406eba0 msgr2=0x7f94341f2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.579+0000 7f94395f5640 1 --2- 172.21.15.44:0/855449008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943406eba0 0x7f94341f2cb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f941c00c570 tx=0x7f941c00ca30 comp rx=0 tx=0).stop 2023-11-04T01:37:47.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.579+0000 7f94395f5640 1 -- 172.21.15.44:0/855449008 shutdown_connections 2023-11-04T01:37:47.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.579+0000 7f94395f5640 1 --2- 172.21.15.44:0/855449008 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f941406ae70 0x7f941406d330 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.579+0000 7f94395f5640 1 --2- 172.21.15.44:0/855449008 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f943415ab70 0x7f94340c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.579+0000 7f94395f5640 1 --2- 172.21.15.44:0/855449008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943406eba0 0x7f94341f2cb0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.579+0000 7f94395f5640 1 --2- 172.21.15.44:0/855449008 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f943406a660 0x7f943409d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.579+0000 7f94395f5640 1 -- 172.21.15.44:0/855449008 >> 172.21.15.44:0/855449008 conn(0x7f9434098d40 msgr2=0x7f94340b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:47.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.579+0000 7f94395f5640 1 -- 172.21.15.44:0/855449008 shutdown_connections 2023-11-04T01:37:47.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.579+0000 7f94395f5640 1 -- 172.21.15.44:0/855449008 wait complete. 2023-11-04T01:37:47.591 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:37:47.592 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:47.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.700+0000 7f4d99656640 1 Processor -- start 2023-11-04T01:37:47.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.700+0000 7f4d99656640 1 -- start start 2023-11-04T01:37:47.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.701+0000 7f4d99656640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4d94160430 0x7f4d940b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.701+0000 7f4d99656640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9406c3a0 0x7f4d940cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.701+0000 7f4d99656640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d940b2fc0 con 0x7f4d940b2b60 2023-11-04T01:37:47.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.701+0000 7f4d99656640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d940cb580 con 0x7f4d94160430 2023-11-04T01:37:47.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.701+0000 7f4d99656640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9406c7f0 con 0x7f4d9406c3a0 2023-11-04T01:37:47.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.701+0000 7f4d92ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4d94160430 0x7f4d940b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.701+0000 7f4d92ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4d94160430 0x7f4d940b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32906/0 (socket says 172.21.15.44:32906) 2023-11-04T01:37:47.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.701+0000 7f4d92ffd640 1 -- 172.21.15.44:0/3847035959 learned_addr learned my addr 172.21.15.44:0/3847035959 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:47.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.701+0000 7f4d92ffd640 1 -- 172.21.15.44:0/3847035959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9406c3a0 msgr2=0x7f4d940cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:47.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.701+0000 7f4d937fe640 1 --2- 172.21.15.44:0/3847035959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9406c3a0 0x7f4d940cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.701+0000 7f4d92ffd640 1 --2- 172.21.15.44:0/3847035959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9406c3a0 0x7f4d940cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.701+0000 7f4d92ffd640 1 -- 172.21.15.44:0/3847035959 >> v1:172.21.15.204:6789/0 conn(0x7f4d940b2b60 legacy=0x7f4d9406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:47.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.701+0000 7f4d92ffd640 1 -- 172.21.15.44:0/3847035959 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9406ca40 con 0x7f4d94160430 2023-11-04T01:37:47.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.701+0000 7f4d937fe640 1 --2- 172.21.15.44:0/3847035959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9406c3a0 0x7f4d940cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:47.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.702+0000 7f4d92ffd640 1 --2- 172.21.15.44:0/3847035959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d94160430 0x7f4d940b2620 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009870 tx=0x7f4d8402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1af1a15f6f98fcf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:47.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.702+0000 7f4d91ffb640 1 -- 172.21.15.44:0/3847035959 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84031640 con 0x7f4d94160430 2023-11-04T01:37:47.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.702+0000 7f4d91ffb640 1 -- 172.21.15.44:0/3847035959 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d840317a0 con 0x7f4d94160430 2023-11-04T01:37:47.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.702+0000 7f4d91ffb640 1 -- 172.21.15.44:0/3847035959 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84031b30 con 0x7f4d94160430 2023-11-04T01:37:47.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.703+0000 7f4d99656640 1 -- 172.21.15.44:0/3847035959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d94160430 msgr2=0x7f4d940b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.703+0000 7f4d99656640 1 --2- 172.21.15.44:0/3847035959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d94160430 0x7f4d940b2620 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009870 tx=0x7f4d8402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.703+0000 7f4d99656640 1 -- 172.21.15.44:0/3847035959 shutdown_connections 2023-11-04T01:37:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.703+0000 7f4d99656640 1 --2- 172.21.15.44:0/3847035959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9406c3a0 0x7f4d940cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.703+0000 7f4d99656640 1 --2- 172.21.15.44:0/3847035959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d94160430 0x7f4d940b2620 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.703+0000 7f4d99656640 1 -- 172.21.15.44:0/3847035959 >> 172.21.15.44:0/3847035959 conn(0x7f4d9406ea20 msgr2=0x7f4d9406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.703+0000 7f4d99656640 1 -- 172.21.15.44:0/3847035959 shutdown_connections 2023-11-04T01:37:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.703+0000 7f4d99656640 1 -- 172.21.15.44:0/3847035959 wait complete. 2023-11-04T01:37:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.704+0000 7f4d99656640 1 Processor -- start 2023-11-04T01:37:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.704+0000 7f4d99656640 1 -- start start 2023-11-04T01:37:47.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d99656640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d9406c3a0 0x7f4d940c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d99656640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d940b2b60 0x7f4d940c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d99656640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d94160430 0x7f4d9414ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d99656640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d940c9950 con 0x7f4d9406c3a0 2023-11-04T01:37:47.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d99656640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d940c9c30 con 0x7f4d940b2b60 2023-11-04T01:37:47.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d99656640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d940c9f10 con 0x7f4d94160430 2023-11-04T01:37:47.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d92ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d9406c3a0 0x7f4d940c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d92ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d9406c3a0 0x7f4d940c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32916/0 (socket says 172.21.15.44:32916) 2023-11-04T01:37:47.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d92ffd640 1 -- 172.21.15.44:0/2735147598 learned_addr learned my addr 172.21.15.44:0/2735147598 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:47.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d937fe640 1 --2- 172.21.15.44:0/2735147598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d94160430 0x7f4d9414ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d927fc640 1 --2- 172.21.15.44:0/2735147598 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d940b2b60 0x7f4d940c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d92ffd640 1 -- 172.21.15.44:0/2735147598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d94160430 msgr2=0x7f4d9414ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d92ffd640 1 --2- 172.21.15.44:0/2735147598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d94160430 0x7f4d9414ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d92ffd640 1 -- 172.21.15.44:0/2735147598 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d940b2b60 msgr2=0x7f4d940c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d92ffd640 1 --2- 172.21.15.44:0/2735147598 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d940b2b60 0x7f4d940c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d92ffd640 1 -- 172.21.15.44:0/2735147598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d840094d0 con 0x7f4d9406c3a0 2023-11-04T01:37:47.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.705+0000 7f4d927fc640 1 --2- 172.21.15.44:0/2735147598 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d940b2b60 0x7f4d940c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:47.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.706+0000 7f4d92ffd640 1 --2- 172.21.15.44:0/2735147598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d9406c3a0 0x7f4d940c9120 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009870 tx=0x7f4d840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:47.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.706+0000 7f4d7b7fe640 1 -- 172.21.15.44:0/2735147598 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8403ac60 con 0x7f4d9406c3a0 2023-11-04T01:37:47.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.706+0000 7f4d7b7fe640 1 -- 172.21.15.44:0/2735147598 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8403ade0 con 0x7f4d9406c3a0 2023-11-04T01:37:47.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.706+0000 7f4d99656640 1 -- 172.21.15.44:0/2735147598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d940ca1f0 con 0x7f4d9406c3a0 2023-11-04T01:37:47.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.706+0000 7f4d7b7fe640 1 -- 172.21.15.44:0/2735147598 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84044630 con 0x7f4d9406c3a0 2023-11-04T01:37:47.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.706+0000 7f4d99656640 1 -- 172.21.15.44:0/2735147598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d940c9660 con 0x7f4d9406c3a0 2023-11-04T01:37:47.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.707+0000 7f4d99656640 1 -- 172.21.15.44:0/2735147598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d940ca710 con 0x7f4d9406c3a0 2023-11-04T01:37:47.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.707+0000 7f4d7b7fe640 1 -- 172.21.15.44:0/2735147598 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d8402f050 con 0x7f4d9406c3a0 2023-11-04T01:37:47.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.708+0000 7f4d7b7fe640 1 --2- 172.21.15.44:0/2735147598 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4d8006ae70 0x7f4d8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.708+0000 7f4d7b7fe640 1 -- 172.21.15.44:0/2735147598 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f4d840ab750 con 0x7f4d9406c3a0 2023-11-04T01:37:47.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.708+0000 7f4d927fc640 1 --2- 172.21.15.44:0/2735147598 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4d8006ae70 0x7f4d8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.708+0000 7f4d927fc640 1 --2- 172.21.15.44:0/2735147598 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4d8006ae70 0x7f4d8006d330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4d88007fd0 tx=0x7f4d88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:47.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.712+0000 7f4d7b7fe640 1 -- 172.21.15.44:0/2735147598 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d940ca710 con 0x7f4d9406c3a0 2023-11-04T01:37:47.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.890+0000 7f4d99656640 1 -- 172.21.15.44:0/2735147598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d940ca710 con 0x7f4d9406c3a0 2023-11-04T01:37:47.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.890+0000 7f4d7b7fe640 1 -- 172.21.15.44:0/2735147598 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d940ca710 con 0x7f4d9406c3a0 2023-11-04T01:37:47.892 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:37:47.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.892+0000 7f4d99656640 1 -- 172.21.15.44:0/2735147598 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4d8006ae70 msgr2=0x7f4d8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.892+0000 7f4d99656640 1 --2- 172.21.15.44:0/2735147598 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4d8006ae70 0x7f4d8006d330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4d88007fd0 tx=0x7f4d88009040 comp rx=0 tx=0).stop 2023-11-04T01:37:47.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.892+0000 7f4d99656640 1 -- 172.21.15.44:0/2735147598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d9406c3a0 msgr2=0x7f4d940c9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.892+0000 7f4d99656640 1 --2- 172.21.15.44:0/2735147598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d9406c3a0 0x7f4d940c9120 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009870 tx=0x7f4d840046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.892+0000 7f4d99656640 1 -- 172.21.15.44:0/2735147598 shutdown_connections 2023-11-04T01:37:47.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.892+0000 7f4d99656640 1 --2- 172.21.15.44:0/2735147598 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4d8006ae70 0x7f4d8006d330 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.892+0000 7f4d99656640 1 --2- 172.21.15.44:0/2735147598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d94160430 0x7f4d9414ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.892+0000 7f4d99656640 1 --2- 172.21.15.44:0/2735147598 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d940b2b60 0x7f4d940c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.892+0000 7f4d99656640 1 --2- 172.21.15.44:0/2735147598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d9406c3a0 0x7f4d940c9120 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.892+0000 7f4d99656640 1 -- 172.21.15.44:0/2735147598 >> 172.21.15.44:0/2735147598 conn(0x7f4d9406ea20 msgr2=0x7f4d940cd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:47.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.892+0000 7f4d99656640 1 -- 172.21.15.44:0/2735147598 shutdown_connections 2023-11-04T01:37:47.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:47.892+0000 7f4d99656640 1 -- 172.21.15.44:0/2735147598 wait complete. 2023-11-04T01:37:47.904 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:37:48.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.012+0000 7f9ec8b78640 1 Processor -- start 2023-11-04T01:37:48.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.012+0000 7f9ec8b78640 1 -- start start 2023-11-04T01:37:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.013+0000 7f9ec8b78640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec4160430 0x7f9ec40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.013+0000 7f9ec8b78640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ec40b2b60 0x7f9ec406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.013+0000 7f9ec8b78640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec40b2fc0 con 0x7f9ec406c1d0 2023-11-04T01:37:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.013+0000 7f9ec8b78640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec40cb580 con 0x7f9ec40b2b60 2023-11-04T01:37:48.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.013+0000 7f9ec8b78640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec406ca40 con 0x7f9ec4160430 2023-11-04T01:37:48.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.013+0000 7f9ec1d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ec40b2b60 0x7f9ec406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.013+0000 7f9ec2d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9ec406c1d0 0x7f9ec4160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55260/0 (socket says 172.21.15.44:55260) 2023-11-04T01:37:48.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.013+0000 7f9ec2d9d640 1 -- 172.21.15.44:0/2225650549 learned_addr learned my addr 172.21.15.44:0/2225650549 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:48.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.013+0000 7f9ec259c640 1 --2- 172.21.15.44:0/2225650549 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec4160430 0x7f9ec40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.013+0000 7f9ec1d9b640 1 -- 172.21.15.44:0/2225650549 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec4160430 msgr2=0x7f9ec40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:48.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.013+0000 7f9ec1d9b640 1 --2- 172.21.15.44:0/2225650549 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec4160430 0x7f9ec40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.013+0000 7f9ec1d9b640 1 -- 172.21.15.44:0/2225650549 >> v1:172.21.15.44:6789/0 conn(0x7f9ec406c1d0 legacy=0x7f9ec4160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.013+0000 7f9ec159a640 1 -- 172.21.15.44:0/2225650549 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233838963 0 0) 0x7f9ec40b2fc0 con 0x7f9ec406c1d0 2023-11-04T01:37:48.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.014+0000 7f9ec1d9b640 1 -- 172.21.15.44:0/2225650549 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec406cd20 con 0x7f9ec40b2b60 2023-11-04T01:37:48.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.014+0000 7f9ec259c640 1 --2- 172.21.15.44:0/2225650549 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec4160430 0x7f9ec40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:48.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.014+0000 7f9ec1d9b640 1 --2- 172.21.15.44:0/2225650549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec40b2b60 0x7f9ec406bc90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80097a0 tx=0x7f9eb802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857317c1f86f7882 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:48.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.014+0000 7f9ec159a640 1 -- 172.21.15.44:0/2225650549 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8031830 con 0x7f9ec40b2b60 2023-11-04T01:37:48.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.014+0000 7f9ec159a640 1 -- 172.21.15.44:0/2225650549 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb8031990 con 0x7f9ec40b2b60 2023-11-04T01:37:48.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.014+0000 7f9ec159a640 1 -- 172.21.15.44:0/2225650549 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8031d20 con 0x7f9ec40b2b60 2023-11-04T01:37:48.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.015+0000 7f9ec8b78640 1 -- 172.21.15.44:0/2225650549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec40b2b60 msgr2=0x7f9ec406bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.015+0000 7f9ec8b78640 1 --2- 172.21.15.44:0/2225650549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec40b2b60 0x7f9ec406bc90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80097a0 tx=0x7f9eb802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.015+0000 7f9ec8b78640 1 -- 172.21.15.44:0/2225650549 shutdown_connections 2023-11-04T01:37:48.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.015+0000 7f9ec8b78640 1 --2- 172.21.15.44:0/2225650549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec40b2b60 0x7f9ec406bc90 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.015+0000 7f9ec8b78640 1 --2- 172.21.15.44:0/2225650549 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec4160430 0x7f9ec40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.015+0000 7f9ec8b78640 1 -- 172.21.15.44:0/2225650549 >> 172.21.15.44:0/2225650549 conn(0x7f9ec406ea20 msgr2=0x7f9ec406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:48.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.015+0000 7f9ec8b78640 1 -- 172.21.15.44:0/2225650549 shutdown_connections 2023-11-04T01:37:48.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.015+0000 7f9ec8b78640 1 -- 172.21.15.44:0/2225650549 wait complete. 2023-11-04T01:37:48.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.016+0000 7f9ec8b78640 1 Processor -- start 2023-11-04T01:37:48.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.016+0000 7f9ec8b78640 1 -- start start 2023-11-04T01:37:48.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.017+0000 7f9ec8b78640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec406c1d0 0x7f9ec40c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.017+0000 7f9ec8b78640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec40b2b60 0x7f9ec41f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.017+0000 7f9ec8b78640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ec4160430 0x7f9ec41f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.017+0000 7f9ec8b78640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec41f6be0 con 0x7f9ec40b2b60 2023-11-04T01:37:48.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.017+0000 7f9ec8b78640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec40c77d0 con 0x7f9ec4160430 2023-11-04T01:37:48.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.017+0000 7f9ec8b78640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec40c6c50 con 0x7f9ec406c1d0 2023-11-04T01:37:48.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.017+0000 7f9ec1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec40b2b60 0x7f9ec41f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.017+0000 7f9ec1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec40b2b60 0x7f9ec41f66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32942/0 (socket says 172.21.15.44:32942) 2023-11-04T01:37:48.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.017+0000 7f9ec1d9b640 1 -- 172.21.15.44:0/1319938725 learned_addr learned my addr 172.21.15.44:0/1319938725 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:48.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.017+0000 7f9ec259c640 1 --2- 172.21.15.44:0/1319938725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec406c1d0 0x7f9ec40c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.018+0000 7f9ec2d9d640 1 --2- 172.21.15.44:0/1319938725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ec4160430 0x7f9ec41f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.018+0000 7f9ec1d9b640 1 -- 172.21.15.44:0/1319938725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec406c1d0 msgr2=0x7f9ec40c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.018+0000 7f9ec1d9b640 1 --2- 172.21.15.44:0/1319938725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec406c1d0 0x7f9ec40c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.018+0000 7f9ec1d9b640 1 -- 172.21.15.44:0/1319938725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ec4160430 msgr2=0x7f9ec41f1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.018+0000 7f9ec1d9b640 1 --2- 172.21.15.44:0/1319938725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ec4160430 0x7f9ec41f1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.018+0000 7f9ec1d9b640 1 -- 172.21.15.44:0/1319938725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb8009400 con 0x7f9ec40b2b60 2023-11-04T01:37:48.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.018+0000 7f9ec1d9b640 1 --2- 172.21.15.44:0/1319938725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec40b2b60 0x7f9ec41f66a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8000c00 tx=0x7f9eb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:48.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.018+0000 7f9eb2ffd640 1 -- 172.21.15.44:0/1319938725 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8004230 con 0x7f9ec40b2b60 2023-11-04T01:37:48.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.018+0000 7f9eb2ffd640 1 -- 172.21.15.44:0/1319938725 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb8004390 con 0x7f9ec40b2b60 2023-11-04T01:37:48.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.018+0000 7f9ec8b78640 1 -- 172.21.15.44:0/1319938725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec40c6f30 con 0x7f9ec40b2b60 2023-11-04T01:37:48.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.018+0000 7f9eb2ffd640 1 -- 172.21.15.44:0/1319938725 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb803a920 con 0x7f9ec40b2b60 2023-11-04T01:37:48.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.018+0000 7f9ec8b78640 1 -- 172.21.15.44:0/1319938725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec40c74f0 con 0x7f9ec40b2b60 2023-11-04T01:37:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.019+0000 7f9ec8b78640 1 -- 172.21.15.44:0/1319938725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec40c8d50 con 0x7f9ec40b2b60 2023-11-04T01:37:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.019+0000 7f9eb2ffd640 1 -- 172.21.15.44:0/1319938725 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9eb803aa80 con 0x7f9ec40b2b60 2023-11-04T01:37:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.020+0000 7f9eb2ffd640 1 --2- 172.21.15.44:0/1319938725 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ea406ae70 0x7f9ea406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.020+0000 7f9eb2ffd640 1 -- 172.21.15.44:0/1319938725 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f9eb80abd00 con 0x7f9ec40b2b60 2023-11-04T01:37:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.020+0000 7f9ec259c640 1 --2- 172.21.15.44:0/1319938725 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ea406ae70 0x7f9ea406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.020+0000 7f9ec259c640 1 --2- 172.21.15.44:0/1319938725 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ea406ae70 0x7f9ea406d330 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00a950 tx=0x7f9ebc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:48.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.024+0000 7f9eb2ffd640 1 -- 172.21.15.44:0/1319938725 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9ec40c8d50 con 0x7f9ec40b2b60 2023-11-04T01:37:48.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.197+0000 7f9ec8b78640 1 -- 172.21.15.44:0/1319938725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f9ec40c8d50 con 0x7f9ec40b2b60 2023-11-04T01:37:48.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.198+0000 7f9eb2ffd640 1 -- 172.21.15.44:0/1319938725 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v48) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9ec40c8d50 con 0x7f9ec40b2b60 2023-11-04T01:37:48.199 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:37:48.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.200+0000 7f9ec8b78640 1 -- 172.21.15.44:0/1319938725 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ea406ae70 msgr2=0x7f9ea406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.200+0000 7f9ec8b78640 1 --2- 172.21.15.44:0/1319938725 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ea406ae70 0x7f9ea406d330 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00a950 tx=0x7f9ebc008040 comp rx=0 tx=0).stop 2023-11-04T01:37:48.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.200+0000 7f9ec8b78640 1 -- 172.21.15.44:0/1319938725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec40b2b60 msgr2=0x7f9ec41f66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.200+0000 7f9ec8b78640 1 --2- 172.21.15.44:0/1319938725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec40b2b60 0x7f9ec41f66a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8000c00 tx=0x7f9eb80046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.200+0000 7f9ec8b78640 1 -- 172.21.15.44:0/1319938725 shutdown_connections 2023-11-04T01:37:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.200+0000 7f9ec8b78640 1 --2- 172.21.15.44:0/1319938725 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ea406ae70 0x7f9ea406d330 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.200+0000 7f9ec8b78640 1 --2- 172.21.15.44:0/1319938725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ec4160430 0x7f9ec41f1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.200+0000 7f9ec8b78640 1 --2- 172.21.15.44:0/1319938725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec40b2b60 0x7f9ec41f66a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.200+0000 7f9ec8b78640 1 --2- 172.21.15.44:0/1319938725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec406c1d0 0x7f9ec40c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.200+0000 7f9ec8b78640 1 -- 172.21.15.44:0/1319938725 >> 172.21.15.44:0/1319938725 conn(0x7f9ec406ea20 msgr2=0x7f9ec40cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.200+0000 7f9ec8b78640 1 -- 172.21.15.44:0/1319938725 shutdown_connections 2023-11-04T01:37:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.200+0000 7f9ec8b78640 1 -- 172.21.15.44:0/1319938725 wait complete. 2023-11-04T01:37:48.212 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-11-04T01:37:48.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.317+0000 7f1c829a5640 1 Processor -- start 2023-11-04T01:37:48.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.317+0000 7f1c829a5640 1 -- start start 2023-11-04T01:37:48.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.318+0000 7f1c829a5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c7c15ae40 0x7f1c7c0b0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.318+0000 7f1c829a5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1c7c0c9390 0x7f1c7c0b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.318+0000 7f1c829a5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7c06ce50 con 0x7f1c7c06c950 2023-11-04T01:37:48.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.318+0000 7f1c829a5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7c06d130 con 0x7f1c7c0c9390 2023-11-04T01:37:48.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.318+0000 7f1c829a5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c06d410 con 0x7f1c7c15ae40 2023-11-04T01:37:48.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.318+0000 7f1c7b7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1c7c06c950 0x7f1c7c0707e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55262/0 (socket says 172.21.15.44:55262) 2023-11-04T01:37:48.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.318+0000 7f1c7b7fe640 1 -- 172.21.15.44:0/1116072980 learned_addr learned my addr 172.21.15.44:0/1116072980 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:48.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.318+0000 7f1c7bfff640 1 --2- 172.21.15.44:0/1116072980 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c7c15ae40 0x7f1c7c0b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.318+0000 7f1c80f42640 1 --2- 172.21.15.44:0/1116072980 >> v2:172.21.15.204:3300/0 conn(0x7f1c7c0c9390 0x7f1c7c0b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.318+0000 7f1c7affd640 1 -- 172.21.15.44:0/1116072980 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142373703 0 0) 0x7f1c7c06ce50 con 0x7f1c7c06c950 2023-11-04T01:37:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.318+0000 7f1c7affd640 1 -- 172.21.15.44:0/1116072980 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c64003520 con 0x7f1c7c06c950 2023-11-04T01:37:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.319+0000 7f1c7affd640 1 -- 172.21.15.44:0/1116072980 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2389813811 0 0) 0x7f1c64003520 con 0x7f1c7c06c950 2023-11-04T01:37:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.319+0000 7f1c7bfff640 1 -- 172.21.15.44:0/1116072980 >> v2:172.21.15.204:3300/0 conn(0x7f1c7c0c9390 msgr2=0x7f1c7c0b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.319+0000 7f1c7bfff640 1 --2- 172.21.15.44:0/1116072980 >> v2:172.21.15.204:3300/0 conn(0x7f1c7c0c9390 0x7f1c7c0b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.319+0000 7f1c7bfff640 1 -- 172.21.15.44:0/1116072980 >> v1:172.21.15.44:6789/0 conn(0x7f1c7c06c950 legacy=0x7f1c7c0707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.319+0000 7f1c7bfff640 1 -- 172.21.15.44:0/1116072980 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c06d6f0 con 0x7f1c7c15ae40 2023-11-04T01:37:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.319+0000 7f1c80f42640 1 --2- 172.21.15.44:0/1116072980 >> v2:172.21.15.204:3300/0 conn(0x7f1c7c0c9390 0x7f1c7c0b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:48.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.319+0000 7f1c7bfff640 1 --2- 172.21.15.44:0/1116072980 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c7c15ae40 0x7f1c7c0b0490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1c700097a0 tx=0x7f1c7002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8dadaed2d4e4015 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:48.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.320+0000 7f1c7affd640 1 -- 172.21.15.44:0/1116072980 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c001670 con 0x7f1c7c15ae40 2023-11-04T01:37:48.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.320+0000 7f1c7affd640 1 -- 172.21.15.44:0/1116072980 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7002e050 con 0x7f1c7c15ae40 2023-11-04T01:37:48.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.320+0000 7f1c7affd640 1 -- 172.21.15.44:0/1116072980 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70030710 con 0x7f1c7c15ae40 2023-11-04T01:37:48.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.320+0000 7f1c829a5640 1 -- 172.21.15.44:0/1116072980 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c7c15ae40 msgr2=0x7f1c7c0b0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.320+0000 7f1c829a5640 1 --2- 172.21.15.44:0/1116072980 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c7c15ae40 0x7f1c7c0b0490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1c700097a0 tx=0x7f1c7002b790 comp rx=0 tx=0).stop 2023-11-04T01:37:48.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.320+0000 7f1c829a5640 1 -- 172.21.15.44:0/1116072980 shutdown_connections 2023-11-04T01:37:48.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.320+0000 7f1c829a5640 1 --2- 172.21.15.44:0/1116072980 >> v2:172.21.15.204:3300/0 conn(0x7f1c7c0c9390 0x7f1c7c0b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.320+0000 7f1c829a5640 1 --2- 172.21.15.44:0/1116072980 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c7c15ae40 0x7f1c7c0b0490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.320+0000 7f1c829a5640 1 -- 172.21.15.44:0/1116072980 >> 172.21.15.44:0/1116072980 conn(0x7f1c7c0cb490 msgr2=0x7f1c7c0cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:48.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.320+0000 7f1c829a5640 1 -- 172.21.15.44:0/1116072980 shutdown_connections 2023-11-04T01:37:48.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.320+0000 7f1c829a5640 1 -- 172.21.15.44:0/1116072980 wait complete. 2023-11-04T01:37:48.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.321+0000 7f1c829a5640 1 Processor -- start 2023-11-04T01:37:48.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.322+0000 7f1c829a5640 1 -- start start 2023-11-04T01:37:48.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.322+0000 7f1c829a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c7c06c950 0x7f1c7c0c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.322+0000 7f1c829a5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c7c0c9390 0x7f1c7c0ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.322+0000 7f1c829a5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c7c15ae40 0x7f1c7c0c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.322+0000 7f1c829a5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c0addd0 con 0x7f1c7c06c950 2023-11-04T01:37:48.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.322+0000 7f1c829a5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c0c53f0 con 0x7f1c7c15ae40 2023-11-04T01:37:48.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.322+0000 7f1c829a5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c0c6020 con 0x7f1c7c0c9390 2023-11-04T01:37:48.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.322+0000 7f1c7bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c7c06c950 0x7f1c7c0c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.322+0000 7f1c7bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c7c06c950 0x7f1c7c0c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32944/0 (socket says 172.21.15.44:32944) 2023-11-04T01:37:48.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.322+0000 7f1c7bfff640 1 -- 172.21.15.44:0/2913778020 learned_addr learned my addr 172.21.15.44:0/2913778020 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:48.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.323+0000 7f1c7b7fe640 1 --2- 172.21.15.44:0/2913778020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c7c0c9390 0x7f1c7c0ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.323+0000 7f1c80f42640 1 --2- 172.21.15.44:0/2913778020 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c7c15ae40 0x7f1c7c0c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.323+0000 7f1c7bfff640 1 -- 172.21.15.44:0/2913778020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c7c0c9390 msgr2=0x7f1c7c0ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.323+0000 7f1c7bfff640 1 --2- 172.21.15.44:0/2913778020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c7c0c9390 0x7f1c7c0ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.323+0000 7f1c7bfff640 1 -- 172.21.15.44:0/2913778020 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c7c15ae40 msgr2=0x7f1c7c0c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.323+0000 7f1c7bfff640 1 --2- 172.21.15.44:0/2913778020 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c7c15ae40 0x7f1c7c0c5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.323+0000 7f1c7bfff640 1 -- 172.21.15.44:0/2913778020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c74009a70 con 0x7f1c7c06c950 2023-11-04T01:37:48.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.323+0000 7f1c80f42640 1 --2- 172.21.15.44:0/2913778020 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c7c15ae40 0x7f1c7c0c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:48.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.323+0000 7f1c7bfff640 1 --2- 172.21.15.44:0/2913778020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c7c06c950 0x7f1c7c0c4d80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1c700098c0 tx=0x7f1c700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:48.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.323+0000 7f1c78ff9640 1 -- 172.21.15.44:0/2913778020 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7003c620 con 0x7f1c7c06c950 2023-11-04T01:37:48.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.323+0000 7f1c78ff9640 1 -- 172.21.15.44:0/2913778020 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7003c7a0 con 0x7f1c7c06c950 2023-11-04T01:37:48.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.323+0000 7f1c829a5640 1 -- 172.21.15.44:0/2913778020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c70009400 con 0x7f1c7c06c950 2023-11-04T01:37:48.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.323+0000 7f1c78ff9640 1 -- 172.21.15.44:0/2913778020 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7003cb50 con 0x7f1c7c06c950 2023-11-04T01:37:48.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.323+0000 7f1c829a5640 1 -- 172.21.15.44:0/2913778020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7c0cca20 con 0x7f1c7c06c950 2023-11-04T01:37:48.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.324+0000 7f1c829a5640 1 -- 172.21.15.44:0/2913778020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7c074290 con 0x7f1c7c06c950 2023-11-04T01:37:48.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.324+0000 7f1c78ff9640 1 -- 172.21.15.44:0/2913778020 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c70039070 con 0x7f1c7c06c950 2023-11-04T01:37:48.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.325+0000 7f1c78ff9640 1 --2- 172.21.15.44:0/2913778020 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1c6806ae70 0x7f1c6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.325+0000 7f1c78ff9640 1 -- 172.21.15.44:0/2913778020 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f1c700aac70 con 0x7f1c7c06c950 2023-11-04T01:37:48.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.325+0000 7f1c7b7fe640 1 --2- 172.21.15.44:0/2913778020 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1c6806ae70 0x7f1c6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.326+0000 7f1c7b7fe640 1 --2- 172.21.15.44:0/2913778020 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1c6806ae70 0x7f1c6806d330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0c2010 tx=0x7f1c6c001d20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:48.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.329+0000 7f1c78ff9640 1 -- 172.21.15.44:0/2913778020 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c70075e40 con 0x7f1c7c06c950 2023-11-04T01:37:48.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:48.574+0000 7f1c829a5640 1 -- 172.21.15.44:0/2913778020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7f1c7c15e590 con 0x7f1c7c06c950 2023-11-04T01:37:49.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.268+0000 7f1c78ff9640 1 -- 172.21.15.44:0/2913778020 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v125) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1c700400f0 con 0x7f1c7c06c950 2023-11-04T01:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.271+0000 7f1c829a5640 1 -- 172.21.15.44:0/2913778020 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1c6806ae70 msgr2=0x7f1c6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.271+0000 7f1c829a5640 1 --2- 172.21.15.44:0/2913778020 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1c6806ae70 0x7f1c6806d330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0c2010 tx=0x7f1c6c001d20 comp rx=0 tx=0).stop 2023-11-04T01:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.271+0000 7f1c829a5640 1 -- 172.21.15.44:0/2913778020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c7c06c950 msgr2=0x7f1c7c0c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.271+0000 7f1c829a5640 1 --2- 172.21.15.44:0/2913778020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c7c06c950 0x7f1c7c0c4d80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1c700098c0 tx=0x7f1c700046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.271+0000 7f1c829a5640 1 -- 172.21.15.44:0/2913778020 shutdown_connections 2023-11-04T01:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.271+0000 7f1c829a5640 1 --2- 172.21.15.44:0/2913778020 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1c6806ae70 0x7f1c6806d330 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.271+0000 7f1c829a5640 1 --2- 172.21.15.44:0/2913778020 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c7c15ae40 0x7f1c7c0c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.271+0000 7f1c829a5640 1 --2- 172.21.15.44:0/2913778020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c7c0c9390 0x7f1c7c0ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.271+0000 7f1c829a5640 1 --2- 172.21.15.44:0/2913778020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c7c06c950 0x7f1c7c0c4d80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.271+0000 7f1c829a5640 1 -- 172.21.15.44:0/2913778020 >> 172.21.15.44:0/2913778020 conn(0x7f1c7c0cb490 msgr2=0x7f1c7c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:49.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.272+0000 7f1c829a5640 1 -- 172.21.15.44:0/2913778020 shutdown_connections 2023-11-04T01:37:49.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.272+0000 7f1c829a5640 1 -- 172.21.15.44:0/2913778020 wait complete. 2023-11-04T01:37:49.286 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:37:49.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.400+0000 7f2df6f9e640 1 Processor -- start 2023-11-04T01:37:49.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.400+0000 7f2df6f9e640 1 -- start start 2023-11-04T01:37:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df6f9e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2df015e430 0x7f2df006d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df6f9e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df00b24b0 con 0x7f2df006dbe0 2023-11-04T01:37:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df6f9e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df00b1f00 con 0x7f2df0159cc0 2023-11-04T01:37:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df6f9e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df006e070 con 0x7f2df015e430 2023-11-04T01:37:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df679d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2df006dbe0 0x7f2df00c91c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55264/0 (socket says 172.21.15.44:55264) 2023-11-04T01:37:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df679d640 1 -- 172.21.15.44:0/378811715 learned_addr learned my addr 172.21.15.44:0/378811715 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df579b640 1 --2- 172.21.15.44:0/378811715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2df015e430 0x7f2df006d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616587780 0 0) 0x7f2df00b24b0 con 0x7f2df006dbe0 2023-11-04T01:37:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ddc003520 con 0x7f2df006dbe0 2023-11-04T01:37:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588722562 0 0) 0x7f2df00b1f00 con 0x7f2df0159cc0 2023-11-04T01:37:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2df00b24b0 con 0x7f2df0159cc0 2023-11-04T01:37:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 569628397 0 0) 0x7f2ddc003520 con 0x7f2df006dbe0 2023-11-04T01:37:49.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2df015e430 msgr2=0x7f2df006d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:49.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df4f9a640 1 --2- 172.21.15.44:0/378811715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2df015e430 0x7f2df006d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 >> v1:172.21.15.204:6789/0 conn(0x7f2df0159cc0 legacy=0x7f2df00b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df00b21d0 con 0x7f2df006dbe0 2023-11-04T01:37:49.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f2de80019f0 con 0x7f2df006dbe0 2023-11-04T01:37:49.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df579b640 1 --2- 172.21.15.44:0/378811715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2df015e430 0x7f2df006d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:49.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.401+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 >> v1:172.21.15.44:6789/0 conn(0x7f2df006dbe0 legacy=0x7f2df00c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.402+0000 7f2df4f9a640 1 --2- 172.21.15.44:0/378811715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ddc003b30 0x7f2ddc003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.402+0000 7f2df4f9a640 1 --2- 172.21.15.44:0/378811715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2df015e430 0x7f2ddc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.402+0000 7f2df4f9a640 1 --2- 172.21.15.44:0/378811715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ddc004d00 0x7f2ddc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.402+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df006e070 con 0x7f2ddc003b30 2023-11-04T01:37:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.402+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc00b980 con 0x7f2ddc004d00 2023-11-04T01:37:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.402+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc00bb40 con 0x7f2df015e430 2023-11-04T01:37:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.402+0000 7f2df5f9c640 1 --2- 172.21.15.44:0/378811715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ddc003b30 0x7f2ddc003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.402+0000 7f2df579b640 1 --2- 172.21.15.44:0/378811715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2df015e430 0x7f2ddc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.402+0000 7f2df679d640 1 --2- 172.21.15.44:0/378811715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ddc004d00 0x7f2ddc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.402+0000 7f2df5f9c640 1 -- 172.21.15.44:0/378811715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2df015e430 msgr2=0x7f2ddc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.402+0000 7f2df5f9c640 1 --2- 172.21.15.44:0/378811715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2df015e430 0x7f2ddc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.402+0000 7f2df5f9c640 1 -- 172.21.15.44:0/378811715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ddc004d00 msgr2=0x7f2ddc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.402+0000 7f2df5f9c640 1 --2- 172.21.15.44:0/378811715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ddc004d00 0x7f2ddc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.402+0000 7f2df5f9c640 1 -- 172.21.15.44:0/378811715 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de0009400 con 0x7f2ddc003b30 2023-11-04T01:37:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.403+0000 7f2df5f9c640 1 --2- 172.21.15.44:0/378811715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ddc003b30 0x7f2ddc003f30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0018d0 tx=0x7f2ddc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb8c744916412a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.403+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec0052d0 con 0x7f2ddc003b30 2023-11-04T01:37:49.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.403+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec005430 con 0x7f2ddc003b30 2023-11-04T01:37:49.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.403+0000 7f2df4f9a640 1 -- 172.21.15.44:0/378811715 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec003810 con 0x7f2ddc003b30 2023-11-04T01:37:49.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.403+0000 7f2df6f9e640 1 -- 172.21.15.44:0/378811715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ddc003b30 msgr2=0x7f2ddc003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.403+0000 7f2df6f9e640 1 --2- 172.21.15.44:0/378811715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ddc003b30 0x7f2ddc003f30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0018d0 tx=0x7f2ddc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.403+0000 7f2df679d640 1 -- 172.21.15.44:0/378811715 reap_dead start 2023-11-04T01:37:49.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.403+0000 7f2df6f9e640 1 -- 172.21.15.44:0/378811715 shutdown_connections 2023-11-04T01:37:49.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.403+0000 7f2df6f9e640 1 -- 172.21.15.44:0/378811715 >> 172.21.15.44:0/378811715 conn(0x7f2df00ce670 msgr2=0x7f2df00cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:49.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.404+0000 7f2df6f9e640 1 -- 172.21.15.44:0/378811715 shutdown_connections 2023-11-04T01:37:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.404+0000 7f2df6f9e640 1 -- 172.21.15.44:0/378811715 wait complete. 2023-11-04T01:37:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.405+0000 7f2df6f9e640 1 Processor -- start 2023-11-04T01:37:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.405+0000 7f2df6f9e640 1 -- start start 2023-11-04T01:37:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df6f9e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ddc003b30 0x7f2df00a7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df6f9e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2df0157f10 0x7f2df01f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df6f9e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2df0158390 0x7f2df01f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df6f9e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df015c430 con 0x7f2ddc003b30 2023-11-04T01:37:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df6f9e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df015c8c0 con 0x7f2df0158390 2023-11-04T01:37:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df6f9e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df015b820 con 0x7f2df0157f10 2023-11-04T01:37:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df5f9c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ddc003b30 0x7f2df00a7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df5f9c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ddc003b30 0x7f2df00a7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32962/0 (socket says 172.21.15.44:32962) 2023-11-04T01:37:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df5f9c640 1 -- 172.21.15.44:0/350856324 learned_addr learned my addr 172.21.15.44:0/350856324 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df579b640 1 --2- 172.21.15.44:0/350856324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2df0157f10 0x7f2df01f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df679d640 1 --2- 172.21.15.44:0/350856324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2df0158390 0x7f2df01f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df5f9c640 1 -- 172.21.15.44:0/350856324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2df0157f10 msgr2=0x7f2df01f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df5f9c640 1 --2- 172.21.15.44:0/350856324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2df0157f10 0x7f2df01f2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df5f9c640 1 -- 172.21.15.44:0/350856324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2df0158390 msgr2=0x7f2df01f2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df5f9c640 1 --2- 172.21.15.44:0/350856324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2df0158390 0x7f2df01f2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df5f9c640 1 -- 172.21.15.44:0/350856324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df015bb00 con 0x7f2ddc003b30 2023-11-04T01:37:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.406+0000 7f2df5f9c640 1 --2- 172.21.15.44:0/350856324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ddc003b30 0x7f2df00a7f50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2dec005040 tx=0x7f2dec0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.407+0000 7f2de67fc640 1 -- 172.21.15.44:0/350856324 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec007450 con 0x7f2ddc003b30 2023-11-04T01:37:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.407+0000 7f2de67fc640 1 -- 172.21.15.44:0/350856324 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec0075b0 con 0x7f2ddc003b30 2023-11-04T01:37:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.407+0000 7f2df6f9e640 1 -- 172.21.15.44:0/350856324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df015bde0 con 0x7f2ddc003b30 2023-11-04T01:37:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.407+0000 7f2de67fc640 1 -- 172.21.15.44:0/350856324 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec0037f0 con 0x7f2ddc003b30 2023-11-04T01:37:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.407+0000 7f2df6f9e640 1 -- 172.21.15.44:0/350856324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df01f2a90 con 0x7f2ddc003b30 2023-11-04T01:37:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.408+0000 7f2df6f9e640 1 -- 172.21.15.44:0/350856324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df00cec80 con 0x7f2ddc003b30 2023-11-04T01:37:49.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.408+0000 7f2de67fc640 1 -- 172.21.15.44:0/350856324 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2dec003950 con 0x7f2ddc003b30 2023-11-04T01:37:49.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.409+0000 7f2de67fc640 1 --2- 172.21.15.44:0/350856324 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2dd406ae70 0x7f2dd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.409+0000 7f2de67fc640 1 -- 172.21.15.44:0/350856324 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f2dec0ab400 con 0x7f2ddc003b30 2023-11-04T01:37:49.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.409+0000 7f2df579b640 1 --2- 172.21.15.44:0/350856324 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2dd406ae70 0x7f2dd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.409+0000 7f2df579b640 1 --2- 172.21.15.44:0/350856324 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2dd406ae70 0x7f2dd406d330 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2df01588b0 tx=0x7f2de0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:49.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.413+0000 7f2de67fc640 1 -- 172.21.15.44:0/350856324 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2dec0765d0 con 0x7f2ddc003b30 2023-11-04T01:37:49.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.588+0000 7f2df6f9e640 1 -- 172.21.15.44:0/350856324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2df004ece0 con 0x7f2ddc003b30 2023-11-04T01:37:49.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.591+0000 7f2de67fc640 1 -- 172.21.15.44:0/350856324 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v13)=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2dec079bf0 con 0x7f2ddc003b30 2023-11-04T01:37:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.593+0000 7f2df6f9e640 1 -- 172.21.15.44:0/350856324 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2dd406ae70 msgr2=0x7f2dd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.593+0000 7f2df6f9e640 1 --2- 172.21.15.44:0/350856324 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2dd406ae70 0x7f2dd406d330 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2df01588b0 tx=0x7f2de0008040 comp rx=0 tx=0).stop 2023-11-04T01:37:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.593+0000 7f2df6f9e640 1 -- 172.21.15.44:0/350856324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ddc003b30 msgr2=0x7f2df00a7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.593+0000 7f2df6f9e640 1 --2- 172.21.15.44:0/350856324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ddc003b30 0x7f2df00a7f50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2dec005040 tx=0x7f2dec0012d0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.593+0000 7f2df6f9e640 1 -- 172.21.15.44:0/350856324 shutdown_connections 2023-11-04T01:37:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.593+0000 7f2df6f9e640 1 --2- 172.21.15.44:0/350856324 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2dd406ae70 0x7f2dd406d330 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.593+0000 7f2df6f9e640 1 --2- 172.21.15.44:0/350856324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2df0158390 0x7f2df01f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.593+0000 7f2df6f9e640 1 --2- 172.21.15.44:0/350856324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2df0157f10 0x7f2df01f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.593+0000 7f2df6f9e640 1 --2- 172.21.15.44:0/350856324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ddc003b30 0x7f2df00a7f50 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.593+0000 7f2df6f9e640 1 -- 172.21.15.44:0/350856324 >> 172.21.15.44:0/350856324 conn(0x7f2df00ce670 msgr2=0x7f2df0156c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.593+0000 7f2df6f9e640 1 -- 172.21.15.44:0/350856324 shutdown_connections 2023-11-04T01:37:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.593+0000 7f2df6f9e640 1 -- 172.21.15.44:0/350856324 wait complete. 2023-11-04T01:37:49.605 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:37:49.605 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:37:49.647 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:37:49.698 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:37:49.699 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:37:49.699 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:49.714 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:37:49.715 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:37:49.715 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:49.732 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:37:49.732 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:37:49.732 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:49.771 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:37:49.771 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:37:49.771 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:49.788 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:37:49.788 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:37:49.788 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:49.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.916+0000 7fd36d390640 1 Processor -- start 2023-11-04T01:37:49.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.916+0000 7fd36d390640 1 -- start start 2023-11-04T01:37:49.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.917+0000 7fd36d390640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd36815bfb0 0x7fd3680cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.917+0000 7fd36d390640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd3680cd860 0x7fd3680ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.917+0000 7fd36d390640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3680cc450 con 0x7fd36815ae40 2023-11-04T01:37:49.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.917+0000 7fd36d390640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36815f400 con 0x7fd3680cd860 2023-11-04T01:37:49.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.917+0000 7fd36d390640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36815b220 con 0x7fd36815bfb0 2023-11-04T01:37:49.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.917+0000 7fd3677fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd3680cd860 0x7fd3680ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.917+0000 7fd3677fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd3680cd860 0x7fd3680ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32978/0 (socket says 172.21.15.44:32978) 2023-11-04T01:37:49.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.917+0000 7fd3677fe640 1 -- 172.21.15.44:0/4003021096 learned_addr learned my addr 172.21.15.44:0/4003021096 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:49.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.917+0000 7fd3667fc640 1 --2- 172.21.15.44:0/4003021096 >> v2:172.21.15.204:3300/0 conn(0x7fd36815bfb0 0x7fd3680cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.917+0000 7fd3677fe640 1 -- 172.21.15.44:0/4003021096 >> v2:172.21.15.204:3300/0 conn(0x7fd36815bfb0 msgr2=0x7fd3680cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:49.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.917+0000 7fd3677fe640 1 --2- 172.21.15.44:0/4003021096 >> v2:172.21.15.204:3300/0 conn(0x7fd36815bfb0 0x7fd3680cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.917+0000 7fd3677fe640 1 -- 172.21.15.44:0/4003021096 >> v1:172.21.15.204:6789/0 conn(0x7fd36815ae40 legacy=0x7fd3680cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.917+0000 7fd3677fe640 1 -- 172.21.15.44:0/4003021096 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36815f890 con 0x7fd3680cd860 2023-11-04T01:37:49.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.918+0000 7fd3677fe640 1 --2- 172.21.15.44:0/4003021096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3680cd860 0x7fd3680ced70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd3680b05d0 tx=0x7fd36002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337a4041f039112e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.918+0000 7fd365ffb640 1 -- 172.21.15.44:0/4003021096 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360030860 con 0x7fd3680cd860 2023-11-04T01:37:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.918+0000 7fd365ffb640 1 -- 172.21.15.44:0/4003021096 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3600309c0 con 0x7fd3680cd860 2023-11-04T01:37:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.918+0000 7fd365ffb640 1 -- 172.21.15.44:0/4003021096 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360030d50 con 0x7fd3680cd860 2023-11-04T01:37:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.919+0000 7fd36d390640 1 -- 172.21.15.44:0/4003021096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3680cd860 msgr2=0x7fd3680ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.919+0000 7fd36d390640 1 --2- 172.21.15.44:0/4003021096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3680cd860 0x7fd3680ced70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd3680b05d0 tx=0x7fd36002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.919+0000 7fd36d390640 1 -- 172.21.15.44:0/4003021096 shutdown_connections 2023-11-04T01:37:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.919+0000 7fd36d390640 1 --2- 172.21.15.44:0/4003021096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3680cd860 0x7fd3680ced70 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.919+0000 7fd36d390640 1 --2- 172.21.15.44:0/4003021096 >> v2:172.21.15.204:3300/0 conn(0x7fd36815bfb0 0x7fd3680cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.919+0000 7fd36d390640 1 -- 172.21.15.44:0/4003021096 >> 172.21.15.44:0/4003021096 conn(0x7fd36806ea90 msgr2=0x7fd36806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.919+0000 7fd36d390640 1 -- 172.21.15.44:0/4003021096 shutdown_connections 2023-11-04T01:37:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.919+0000 7fd36d390640 1 -- 172.21.15.44:0/4003021096 wait complete. 2023-11-04T01:37:49.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.920+0000 7fd36d390640 1 Processor -- start 2023-11-04T01:37:49.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.920+0000 7fd36d390640 1 -- start start 2023-11-04T01:37:49.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.921+0000 7fd36d390640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3680cd860 0x7fd3680c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.921+0000 7fd36d390640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd36815ae40 0x7fd36814f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.921+0000 7fd36d390640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd36815bfb0 0x7fd3680ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.921+0000 7fd36d390640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3680cab80 con 0x7fd3680cd860 2023-11-04T01:37:49.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.921+0000 7fd36d390640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3680c73e0 con 0x7fd36815bfb0 2023-11-04T01:37:49.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.921+0000 7fd36d390640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3680ca8e0 con 0x7fd36815ae40 2023-11-04T01:37:49.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.921+0000 7fd366ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3680cd860 0x7fd3680c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.921+0000 7fd366ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3680cd860 0x7fd3680c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32988/0 (socket says 172.21.15.44:32988) 2023-11-04T01:37:49.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.921+0000 7fd366ffd640 1 -- 172.21.15.44:0/1995723494 learned_addr learned my addr 172.21.15.44:0/1995723494 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:49.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.921+0000 7fd366ffd640 1 -- 172.21.15.44:0/1995723494 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd36815ae40 msgr2=0x7fd36814f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.921+0000 7fd366ffd640 1 --2- 172.21.15.44:0/1995723494 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd36815ae40 0x7fd36814f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.921+0000 7fd366ffd640 1 -- 172.21.15.44:0/1995723494 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd36815bfb0 msgr2=0x7fd3680ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.921+0000 7fd3677fe640 1 --2- 172.21.15.44:0/1995723494 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd36815bfb0 0x7fd3680ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.921+0000 7fd366ffd640 1 --2- 172.21.15.44:0/1995723494 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd36815bfb0 0x7fd3680ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.921+0000 7fd366ffd640 1 -- 172.21.15.44:0/1995723494 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3600094d0 con 0x7fd3680cd860 2023-11-04T01:37:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.922+0000 7fd366ffd640 1 --2- 172.21.15.44:0/1995723494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3680cd860 0x7fd3680c9dd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd35800c870 tx=0x7fd35800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.922+0000 7fd35f7fe640 1 -- 172.21.15.44:0/1995723494 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358003b70 con 0x7fd3680cd860 2023-11-04T01:37:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.922+0000 7fd35f7fe640 1 -- 172.21.15.44:0/1995723494 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd358003cf0 con 0x7fd3680cd860 2023-11-04T01:37:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.922+0000 7fd36d390640 1 -- 172.21.15.44:0/1995723494 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3680c6ab0 con 0x7fd3680cd860 2023-11-04T01:37:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.922+0000 7fd35f7fe640 1 -- 172.21.15.44:0/1995723494 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35800aa90 con 0x7fd3680cd860 2023-11-04T01:37:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.922+0000 7fd36d390640 1 -- 172.21.15.44:0/1995723494 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3680c7070 con 0x7fd3680cd860 2023-11-04T01:37:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.923+0000 7fd36d390640 1 -- 172.21.15.44:0/1995723494 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3680ce2d0 con 0x7fd3680cd860 2023-11-04T01:37:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.923+0000 7fd35f7fe640 1 -- 172.21.15.44:0/1995723494 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd35800abf0 con 0x7fd3680cd860 2023-11-04T01:37:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.924+0000 7fd35f7fe640 1 --2- 172.21.15.44:0/1995723494 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd34806ae70 0x7fd34806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.924+0000 7fd35f7fe640 1 -- 172.21.15.44:0/1995723494 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd358089380 con 0x7fd3680cd860 2023-11-04T01:37:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.924+0000 7fd3667fc640 1 --2- 172.21.15.44:0/1995723494 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd34806ae70 0x7fd34806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.924+0000 7fd3667fc640 1 --2- 172.21.15.44:0/1995723494 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd34806ae70 0x7fd34806d330 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd350006e80 tx=0x7fd350008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:49.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:49.928+0000 7fd35f7fe640 1 -- 172.21.15.44:0/1995723494 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd358054410 con 0x7fd3680cd860 2023-11-04T01:37:50.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.139+0000 7fd36d390640 1 -- 172.21.15.44:0/1995723494 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3680cc450 con 0x7fd3680cd860 2023-11-04T01:37:50.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.139+0000 7fd35f7fe640 1 -- 172.21.15.44:0/1995723494 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3702 (secure 0 0 0) 0x7fd3680cc450 con 0x7fd3680cd860 2023-11-04T01:37:50.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:50.141 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5024,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/620952929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":620952929},{"type":"v1","addr":"172.21.15.44:6834","nonce":620952929}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2082760690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":2082760690},{"type":"v1","addr":"172.21.15.204:6836","nonce":2082760690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5323,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2330742876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2330742876},{"type":"v1","addr":"172.21.15.204:6837","nonce":2330742876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5904,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2711049820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2711049820},{"type":"v1","addr":"172.21.15.44:6835","nonce":2711049820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[]} 2023-11-04T01:37:50.141 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 17 2023-11-04T01:37:50.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.141+0000 7fd36d390640 1 -- 172.21.15.44:0/1995723494 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd34806ae70 msgr2=0x7fd34806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.141+0000 7fd36d390640 1 --2- 172.21.15.44:0/1995723494 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd34806ae70 0x7fd34806d330 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd350006e80 tx=0x7fd350008040 comp rx=0 tx=0).stop 2023-11-04T01:37:50.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.141+0000 7fd36d390640 1 -- 172.21.15.44:0/1995723494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3680cd860 msgr2=0x7fd3680c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.141+0000 7fd36d390640 1 --2- 172.21.15.44:0/1995723494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3680cd860 0x7fd3680c9dd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd35800c870 tx=0x7fd35800cd30 comp rx=0 tx=0).stop 2023-11-04T01:37:50.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.142+0000 7fd36d390640 1 -- 172.21.15.44:0/1995723494 shutdown_connections 2023-11-04T01:37:50.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.142+0000 7fd36d390640 1 --2- 172.21.15.44:0/1995723494 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd34806ae70 0x7fd34806d330 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.142+0000 7fd36d390640 1 --2- 172.21.15.44:0/1995723494 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd36815bfb0 0x7fd3680ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.142+0000 7fd36d390640 1 --2- 172.21.15.44:0/1995723494 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd36815ae40 0x7fd36814f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.142+0000 7fd36d390640 1 --2- 172.21.15.44:0/1995723494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3680cd860 0x7fd3680c9dd0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.142+0000 7fd36d390640 1 -- 172.21.15.44:0/1995723494 >> 172.21.15.44:0/1995723494 conn(0x7fd36806ea90 msgr2=0x7fd3680b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:50.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.142+0000 7fd36d390640 1 -- 172.21.15.44:0/1995723494 shutdown_connections 2023-11-04T01:37:50.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.142+0000 7fd36d390640 1 -- 172.21.15.44:0/1995723494 wait complete. 2023-11-04T01:37:50.154 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:37:50.154 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:37:50.154 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:37:50.155 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:50.155 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:37:50.155 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:37:50.155 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:37:50.155 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:50.155 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:37:50.155 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:37:50.156 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:37:50.156 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:50.156 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:37:50.156 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:37:50.156 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:37:50.156 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:50.167 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:37:50.167 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:37:50.168 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:37:50.168 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:37:50.169 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:37:50.169 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:37:50.170 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:37:50.170 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:37:50.209 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:37:50.210 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:50.211 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:37:50.211 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:50.212 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:37:50.212 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:50.213 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:37:50.213 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:50.213 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:37:50.290 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2023-11-04T01:37:50.291 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2023-11-04T01:37:50.293 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2023-11-04T01:37:50.293 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2023-11-04T01:37:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.323+0000 7f8e80725640 1 Processor -- start 2023-11-04T01:37:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.323+0000 7f8e80725640 1 -- start start 2023-11-04T01:37:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.324+0000 7f8e80725640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8e780b4880 0x7f8e780b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.324+0000 7f8e7ecc2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8e780b4880 0x7f8e780b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.324+0000 7f8e80725640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e780cde60 con 0x7f8e78153e60 2023-11-04T01:37:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.324+0000 7f8e7ecc2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8e780b4880 0x7f8e780b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33024/0 (socket says 172.21.15.44:33024) 2023-11-04T01:37:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.324+0000 7f8e7ecc2640 1 -- 172.21.15.44:0/3761381211 learned_addr learned my addr 172.21.15.44:0/3761381211 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.324+0000 7f8e80725640 1 -- 172.21.15.44:0/3761381211 --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e78160f90 con 0x7f8e780cd6d0 2023-11-04T01:37:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.324+0000 7f8e80725640 1 -- 172.21.15.44:0/3761381211 --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e780b5200 con 0x7f8e780b4880 2023-11-04T01:37:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.325+0000 7f8e7d4bf640 1 -- 172.21.15.44:0/3761381211 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252056628 0 0) 0x7f8e780cde60 con 0x7f8e78153e60 2023-11-04T01:37:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.325+0000 7f8e7d4bf640 1 -- 172.21.15.44:0/3761381211 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e64003520 con 0x7f8e78153e60 2023-11-04T01:37:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.325+0000 7f8e7ecc2640 1 -- 172.21.15.44:0/3761381211 >> v1:172.21.15.204:6789/0 conn(0x7f8e780cd6d0 legacy=0x7f8e78161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.325+0000 7f8e7ecc2640 1 -- 172.21.15.44:0/3761381211 >> v1:172.21.15.44:6789/0 conn(0x7f8e78153e60 legacy=0x7f8e7815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.325+0000 7f8e7ecc2640 1 -- 172.21.15.44:0/3761381211 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e780ce090 con 0x7f8e780b4880 2023-11-04T01:37:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.326+0000 7f8e7ecc2640 1 --2- 172.21.15.44:0/3761381211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e780b4880 0x7f8e780b4cc0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009e50 tx=0x7f8e7002be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8990c25dd750602d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.326+0000 7f8e7d4bf640 1 -- 172.21.15.44:0/3761381211 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7002c990 con 0x7f8e780b4880 2023-11-04T01:37:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.326+0000 7f8e7d4bf640 1 -- 172.21.15.44:0/3761381211 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7002caf0 con 0x7f8e780b4880 2023-11-04T01:37:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.326+0000 7f8e7d4bf640 1 -- 172.21.15.44:0/3761381211 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7002ce80 con 0x7f8e780b4880 2023-11-04T01:37:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.326+0000 7f8e80725640 1 -- 172.21.15.44:0/3761381211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e780b4880 msgr2=0x7f8e780b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.326+0000 7f8e80725640 1 --2- 172.21.15.44:0/3761381211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e780b4880 0x7f8e780b4cc0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009e50 tx=0x7f8e7002be70 comp rx=0 tx=0).stop 2023-11-04T01:37:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.326+0000 7f8e80725640 1 -- 172.21.15.44:0/3761381211 shutdown_connections 2023-11-04T01:37:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.326+0000 7f8e80725640 1 --2- 172.21.15.44:0/3761381211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e780b4880 0x7f8e780b4cc0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.326+0000 7f8e80725640 1 -- 172.21.15.44:0/3761381211 >> 172.21.15.44:0/3761381211 conn(0x7f8e780cf880 msgr2=0x7f8e780cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.326+0000 7f8e80725640 1 -- 172.21.15.44:0/3761381211 shutdown_connections 2023-11-04T01:37:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.326+0000 7f8e80725640 1 -- 172.21.15.44:0/3761381211 wait complete. 2023-11-04T01:37:50.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.328+0000 7f8e80725640 1 Processor -- start 2023-11-04T01:37:50.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.328+0000 7f8e80725640 1 -- start start 2023-11-04T01:37:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.328+0000 7f8e80725640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e780b4880 0x7f8e7815a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.328+0000 7f8e80725640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e780cd6d0 0x7f8e7815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.328+0000 7f8e80725640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e78153e60 0x7f8e7813e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.328+0000 7f8e80725640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7815ee90 con 0x7f8e780b4880 2023-11-04T01:37:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.328+0000 7f8e80725640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7815f170 con 0x7f8e780cd6d0 2023-11-04T01:37:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.328+0000 7f8e80725640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7815f450 con 0x7f8e78153e60 2023-11-04T01:37:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.328+0000 7f8e7e4c1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e780b4880 0x7f8e7815a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.328+0000 7f8e7e4c1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e780b4880 0x7f8e7815a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33036/0 (socket says 172.21.15.44:33036) 2023-11-04T01:37:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.328+0000 7f8e7e4c1640 1 -- 172.21.15.44:0/1747145388 learned_addr learned my addr 172.21.15.44:0/1747145388 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.329+0000 7f8e7dcc0640 1 --2- 172.21.15.44:0/1747145388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e780cd6d0 0x7f8e7815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.329+0000 7f8e7ecc2640 1 --2- 172.21.15.44:0/1747145388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e78153e60 0x7f8e7813e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.329+0000 7f8e7e4c1640 1 -- 172.21.15.44:0/1747145388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e78153e60 msgr2=0x7f8e7813e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.329+0000 7f8e7e4c1640 1 --2- 172.21.15.44:0/1747145388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e78153e60 0x7f8e7813e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.329+0000 7f8e7e4c1640 1 -- 172.21.15.44:0/1747145388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e780cd6d0 msgr2=0x7f8e7815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.329+0000 7f8e7e4c1640 1 --2- 172.21.15.44:0/1747145388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e780cd6d0 0x7f8e7815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.329+0000 7f8e7e4c1640 1 -- 172.21.15.44:0/1747145388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e70009b30 con 0x7f8e780b4880 2023-11-04T01:37:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.329+0000 7f8e7e4c1640 1 --2- 172.21.15.44:0/1747145388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e780b4880 0x7f8e7815a2e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800c430 tx=0x7f8e6800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.329+0000 7f8e6effd640 1 -- 172.21.15.44:0/1747145388 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e680052d0 con 0x7f8e780b4880 2023-11-04T01:37:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.329+0000 7f8e6effd640 1 -- 172.21.15.44:0/1747145388 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e68005450 con 0x7f8e780b4880 2023-11-04T01:37:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.329+0000 7f8e80725640 1 -- 172.21.15.44:0/1747145388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7815f730 con 0x7f8e780b4880 2023-11-04T01:37:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.329+0000 7f8e6effd640 1 -- 172.21.15.44:0/1747145388 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68003830 con 0x7f8e780b4880 2023-11-04T01:37:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.329+0000 7f8e80725640 1 -- 172.21.15.44:0/1747145388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e78160390 con 0x7f8e780b4880 2023-11-04T01:37:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.330+0000 7f8e80725640 1 -- 172.21.15.44:0/1747145388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e780c7940 con 0x7f8e780b4880 2023-11-04T01:37:50.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.331+0000 7f8e6effd640 1 -- 172.21.15.44:0/1747145388 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e68003990 con 0x7f8e780b4880 2023-11-04T01:37:50.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.331+0000 7f8e6effd640 1 --2- 172.21.15.44:0/1747145388 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8e5c06aea0 0x7f8e5c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.331+0000 7f8e6effd640 1 -- 172.21.15.44:0/1747145388 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f8e68088c70 con 0x7f8e780b4880 2023-11-04T01:37:50.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.331+0000 7f8e7dcc0640 1 --2- 172.21.15.44:0/1747145388 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8e5c06aea0 0x7f8e5c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.332+0000 7f8e7dcc0640 1 --2- 172.21.15.44:0/1747145388 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8e5c06aea0 0x7f8e5c06d360 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8e780c76d0 tx=0x7f8e74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.335+0000 7f8e6effd640 1 -- 172.21.15.44:0/1747145388 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8e68053fc0 con 0x7f8e780b4880 2023-11-04T01:37:50.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:50.528+0000 7f8e80725640 1 -- 172.21.15.44:0/1747145388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8e780c7940 con 0x7f8e780b4880 2023-11-04T01:37:51.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.281+0000 7f8e6effd640 1 -- 172.21.15.44:0/1747145388 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v50) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8e780c7940 con 0x7f8e780b4880 2023-11-04T01:37:51.282 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2023-11-04T01:37:51.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.285+0000 7f8e80725640 1 -- 172.21.15.44:0/1747145388 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8e5c06aea0 msgr2=0x7f8e5c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.285+0000 7f8e80725640 1 --2- 172.21.15.44:0/1747145388 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8e5c06aea0 0x7f8e5c06d360 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8e780c76d0 tx=0x7f8e74009040 comp rx=0 tx=0).stop 2023-11-04T01:37:51.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.285+0000 7f8e80725640 1 -- 172.21.15.44:0/1747145388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e780b4880 msgr2=0x7f8e7815a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.285+0000 7f8e80725640 1 --2- 172.21.15.44:0/1747145388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e780b4880 0x7f8e7815a2e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800c430 tx=0x7f8e6800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.285+0000 7f8e80725640 1 -- 172.21.15.44:0/1747145388 shutdown_connections 2023-11-04T01:37:51.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.285+0000 7f8e80725640 1 --2- 172.21.15.44:0/1747145388 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8e5c06aea0 0x7f8e5c06d360 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.285+0000 7f8e80725640 1 --2- 172.21.15.44:0/1747145388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e78153e60 0x7f8e7813e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.285+0000 7f8e80725640 1 --2- 172.21.15.44:0/1747145388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e780cd6d0 0x7f8e7815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.285+0000 7f8e80725640 1 --2- 172.21.15.44:0/1747145388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e780b4880 0x7f8e7815a2e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.285+0000 7f8e80725640 1 -- 172.21.15.44:0/1747145388 >> 172.21.15.44:0/1747145388 conn(0x7f8e780cf880 msgr2=0x7f8e78161420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:51.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.285+0000 7f8e80725640 1 -- 172.21.15.44:0/1747145388 shutdown_connections 2023-11-04T01:37:51.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.285+0000 7f8e80725640 1 -- 172.21.15.44:0/1747145388 wait complete. 2023-11-04T01:37:51.300 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:37:51.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.412+0000 7f4423a58640 1 Processor -- start 2023-11-04T01:37:51.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.412+0000 7f4423a58640 1 -- start start 2023-11-04T01:37:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.413+0000 7f4423a58640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f441c0cde60 0x7f441c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.413+0000 7f4423a58640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f441c0ce240 0x7f441c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.413+0000 7f4423a58640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c15e000 con 0x7f441c15daa0 2023-11-04T01:37:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.413+0000 7f4423a58640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c15e5c0 con 0x7f441c0cde60 2023-11-04T01:37:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.413+0000 7f4423a58640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c15e2e0 con 0x7f441c0ce240 2023-11-04T01:37:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.413+0000 7f44217f4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f441c0cde60 0x7f441c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.413+0000 7f44217f4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f441c0cde60 0x7f441c15d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33048/0 (socket says 172.21.15.44:33048) 2023-11-04T01:37:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.413+0000 7f44217f4640 1 -- 172.21.15.44:0/694002519 learned_addr learned my addr 172.21.15.44:0/694002519 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.413+0000 7f4421ff5640 1 --2- 172.21.15.44:0/694002519 >> v2:172.21.15.204:3300/0 conn(0x7f441c0ce240 0x7f441c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.413+0000 7f44217f4640 1 -- 172.21.15.44:0/694002519 >> v2:172.21.15.204:3300/0 conn(0x7f441c0ce240 msgr2=0x7f441c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.413+0000 7f44217f4640 1 --2- 172.21.15.44:0/694002519 >> v2:172.21.15.204:3300/0 conn(0x7f441c0ce240 0x7f441c0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.413+0000 7f44217f4640 1 -- 172.21.15.44:0/694002519 >> v1:172.21.15.204:6789/0 conn(0x7f441c15daa0 legacy=0x7f441c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.413+0000 7f44217f4640 1 -- 172.21.15.44:0/694002519 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c0d1120 con 0x7f441c0cde60 2023-11-04T01:37:51.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.414+0000 7f44217f4640 1 --2- 172.21.15.44:0/694002519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f441c0cde60 0x7f441c15d560 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f441c0cf2e0 tx=0x7f441802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c4a816f8e0176b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:51.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.414+0000 7f4413fff640 1 -- 172.21.15.44:0/694002519 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4418031870 con 0x7f441c0cde60 2023-11-04T01:37:51.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.414+0000 7f4413fff640 1 -- 172.21.15.44:0/694002519 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44180319d0 con 0x7f441c0cde60 2023-11-04T01:37:51.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.414+0000 7f4413fff640 1 -- 172.21.15.44:0/694002519 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4418031d60 con 0x7f441c0cde60 2023-11-04T01:37:51.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.415+0000 7f4423a58640 1 -- 172.21.15.44:0/694002519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f441c0cde60 msgr2=0x7f441c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.415+0000 7f4423a58640 1 --2- 172.21.15.44:0/694002519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f441c0cde60 0x7f441c15d560 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f441c0cf2e0 tx=0x7f441802b910 comp rx=0 tx=0).stop 2023-11-04T01:37:51.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.415+0000 7f4423a58640 1 -- 172.21.15.44:0/694002519 shutdown_connections 2023-11-04T01:37:51.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.415+0000 7f4423a58640 1 --2- 172.21.15.44:0/694002519 >> v2:172.21.15.204:3300/0 conn(0x7f441c0ce240 0x7f441c0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.415+0000 7f4423a58640 1 --2- 172.21.15.44:0/694002519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f441c0cde60 0x7f441c15d560 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.415+0000 7f4423a58640 1 -- 172.21.15.44:0/694002519 >> 172.21.15.44:0/694002519 conn(0x7f441c071f30 msgr2=0x7f441c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:51.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.415+0000 7f4423a58640 1 -- 172.21.15.44:0/694002519 shutdown_connections 2023-11-04T01:37:51.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.415+0000 7f4423a58640 1 -- 172.21.15.44:0/694002519 wait complete. 2023-11-04T01:37:51.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.416+0000 7f4423a58640 1 Processor -- start 2023-11-04T01:37:51.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.416+0000 7f4423a58640 1 -- start start 2023-11-04T01:37:51.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f4423a58640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f441c0cde60 0x7f441c152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f4423a58640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f441c0ce240 0x7f441c1e3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f4423a58640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f441c15daa0 0x7f441c0c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f4423a58640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c1e4990 con 0x7f441c15daa0 2023-11-04T01:37:51.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f4423a58640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c1e4c70 con 0x7f441c0ce240 2023-11-04T01:37:51.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f4423a58640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c1e4f50 con 0x7f441c0cde60 2023-11-04T01:37:51.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f4421ff5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f441c15daa0 0x7f441c0c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f4421ff5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f441c15daa0 0x7f441c0c6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33062/0 (socket says 172.21.15.44:33062) 2023-11-04T01:37:51.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f4421ff5640 1 -- 172.21.15.44:0/21069701 learned_addr learned my addr 172.21.15.44:0/21069701 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:51.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f44217f4640 1 --2- 172.21.15.44:0/21069701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f441c0cde60 0x7f441c152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f4420ff3640 1 --2- 172.21.15.44:0/21069701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f441c0ce240 0x7f441c1e3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f4421ff5640 1 -- 172.21.15.44:0/21069701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f441c0cde60 msgr2=0x7f441c152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f4421ff5640 1 --2- 172.21.15.44:0/21069701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f441c0cde60 0x7f441c152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f4421ff5640 1 -- 172.21.15.44:0/21069701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f441c0ce240 msgr2=0x7f441c1e3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f4421ff5640 1 --2- 172.21.15.44:0/21069701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f441c0ce240 0x7f441c1e3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.417+0000 7f4421ff5640 1 -- 172.21.15.44:0/21069701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44180094d0 con 0x7f441c15daa0 2023-11-04T01:37:51.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.418+0000 7f4421ff5640 1 --2- 172.21.15.44:0/21069701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f441c15daa0 0x7f441c0c6b00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4414007e30 tx=0x7f441400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:51.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.418+0000 7f4411ffb640 1 -- 172.21.15.44:0/21069701 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414014620 con 0x7f441c15daa0 2023-11-04T01:37:51.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.418+0000 7f4411ffb640 1 -- 172.21.15.44:0/21069701 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441400ee90 con 0x7f441c15daa0 2023-11-04T01:37:51.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.418+0000 7f4423a58640 1 -- 172.21.15.44:0/21069701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c1e5230 con 0x7f441c15daa0 2023-11-04T01:37:51.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.418+0000 7f4411ffb640 1 -- 172.21.15.44:0/21069701 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44140149c0 con 0x7f441c15daa0 2023-11-04T01:37:51.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.418+0000 7f4423a58640 1 -- 172.21.15.44:0/21069701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c0cc120 con 0x7f441c15daa0 2023-11-04T01:37:51.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.419+0000 7f4423a58640 1 -- 172.21.15.44:0/21069701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441c1f2390 con 0x7f441c15daa0 2023-11-04T01:37:51.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.419+0000 7f4411ffb640 1 -- 172.21.15.44:0/21069701 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4414014b20 con 0x7f441c15daa0 2023-11-04T01:37:51.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.419+0000 7f4411ffb640 1 --2- 172.21.15.44:0/21069701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f440006aea0 0x7f440006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.420+0000 7f4411ffb640 1 -- 172.21.15.44:0/21069701 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4414089d90 con 0x7f441c15daa0 2023-11-04T01:37:51.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.420+0000 7f44217f4640 1 --2- 172.21.15.44:0/21069701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f440006aea0 0x7f440006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.420+0000 7f44217f4640 1 --2- 172.21.15.44:0/21069701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f440006aea0 0x7f440006d360 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4418036000 tx=0x7f441803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:51.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.424+0000 7f4411ffb640 1 -- 172.21.15.44:0/21069701 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4414054fa0 con 0x7f441c15daa0 2023-11-04T01:37:51.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.669+0000 7f4423a58640 1 -- 172.21.15.44:0/21069701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f441c074290 con 0x7f441c15daa0 2023-11-04T01:37:51.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.669+0000 7f4411ffb640 1 -- 172.21.15.44:0/21069701 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f44140585c0 con 0x7f441c15daa0 2023-11-04T01:37:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:51.672 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:37:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2023-11-04T01:37:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2023-11-04T01:37:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0Vldrw2ExAA5cS9IfcK2l8SXaZdWm4f8g==", 2023-11-04T01:37:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:37:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:37:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2023-11-04T01:37:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlOogfIRAAYEw/sXZBXk/GJOrnBTA7xg==", 2023-11-04T01:37:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:37:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:37:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2023-11-04T01:37:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlDPc/GxAA32BghmM85xfJ14TjYFtNRw==", 2023-11-04T01:37:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:37:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:37:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2023-11-04T01:37:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlYpOSKBAAVivyMFmzkREyWWFObAwKHw==", 2023-11-04T01:37:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:37:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:37:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2023-11-04T01:37:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDIn0VlTfR3ExAAt6S9NmZfuM9CoPfVNGkhmA==", 2023-11-04T01:37:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2023-11-04T01:37:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDLn0VlqkLfExAABN3cHR+cDXm0tN4tpWR+0w==", 2023-11-04T01:37:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDOn0Vl9JO/EhAAuC0w9vFxOiRs7Tm3UZHVXg==", 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2023-11-04T01:37:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDRn0VlKSy2EhAAerLDC/nZsTK5KdG+Q1Ycow==", 2023-11-04T01:37:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2023-11-04T01:37:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDXn0Vl9FINGxAA5lLkwH709SJ00yfxB6MCaw==", 2023-11-04T01:37:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2023-11-04T01:37:51.680 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDan0Vlo5v3GRAA/ZGOqGFMxQuGirRMadC+9Q==", 2023-11-04T01:37:51.680 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.680 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:51.680 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:51.680 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:51.680 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.680 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2023-11-04T01:37:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDdn0Vl+q9GGBAA7obGN4GMa7glnpuDSQKV2g==", 2023-11-04T01:37:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2023-11-04T01:37:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDgn0VlbLVCFxAANjcDDYPfWCNGQF1twWc35w==", 2023-11-04T01:37:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:37:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2023-11-04T01:37:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlmqcrLRAAFCsu/sJUUh45gPboIgq6Dw==", 2023-11-04T01:37:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow r", 2023-11-04T01:37:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:37:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2023-11-04T01:37:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlSFWINBAAAvkXSoHilQ3GXBE61Tvx2w==", 2023-11-04T01:37:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:37:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:37:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:37:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2023-11-04T01:37:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0Vlcp71MBAAkYQz0CUf7LY9WIvX0mXzKg==", 2023-11-04T01:37:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:37:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:37:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:37:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2023-11-04T01:37:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0Vl08lCOhAAQxQts3txc7gsu8txLGzouA==", 2023-11-04T01:37:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:37:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:37:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:37:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:37:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2023-11-04T01:37:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDDn0VlgZZFMBAA94xTIAij5lx9yGEyPDd/SQ==", 2023-11-04T01:37:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2023-11-04T01:37:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:37:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:37:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2023-11-04T01:37:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlSeFMDxAAwW0lbfxAbIKPgPCkJD1FMg==", 2023-11-04T01:37:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2023-11-04T01:37:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2023-11-04T01:37:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2023-11-04T01:37:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlX+8eCxAAuBbLfpXHKHIIDc4zo9Insw==", 2023-11-04T01:37:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:37:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2023-11-04T01:37:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2023-11-04T01:37:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:37:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2023-11-04T01:37:51.687 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:37:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.671+0000 7f4423a58640 1 -- 172.21.15.44:0/21069701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f440006aea0 msgr2=0x7f440006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.671+0000 7f4423a58640 1 --2- 172.21.15.44:0/21069701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f440006aea0 0x7f440006d360 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4418036000 tx=0x7f441803c040 comp rx=0 tx=0).stop 2023-11-04T01:37:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.671+0000 7f4423a58640 1 -- 172.21.15.44:0/21069701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f441c15daa0 msgr2=0x7f441c0c6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.671+0000 7f4423a58640 1 --2- 172.21.15.44:0/21069701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f441c15daa0 0x7f441c0c6b00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4414007e30 tx=0x7f441400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.671+0000 7f4423a58640 1 -- 172.21.15.44:0/21069701 shutdown_connections 2023-11-04T01:37:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.671+0000 7f4423a58640 1 --2- 172.21.15.44:0/21069701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f440006aea0 0x7f440006d360 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.671+0000 7f4423a58640 1 --2- 172.21.15.44:0/21069701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f441c15daa0 0x7f441c0c6b00 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.671+0000 7f4423a58640 1 --2- 172.21.15.44:0/21069701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f441c0ce240 0x7f441c1e3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.671+0000 7f4423a58640 1 --2- 172.21.15.44:0/21069701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f441c0cde60 0x7f441c152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.671+0000 7f4423a58640 1 -- 172.21.15.44:0/21069701 >> 172.21.15.44:0/21069701 conn(0x7f441c071f30 msgr2=0x7f441c0b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.671+0000 7f4423a58640 1 -- 172.21.15.44:0/21069701 shutdown_connections 2023-11-04T01:37:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.671+0000 7f4423a58640 1 -- 172.21.15.44:0/21069701 wait complete. 2023-11-04T01:37:51.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:51.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.794+0000 7faa075a9640 1 Processor -- start 2023-11-04T01:37:51.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.794+0000 7faa075a9640 1 -- start start 2023-11-04T01:37:51.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.795+0000 7faa075a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faa000cde60 0x7faa0015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.795+0000 7faa075a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0015daa0 0x7faa00157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.795+0000 7faa075a9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0015e000 con 0x7faa000ce240 2023-11-04T01:37:51.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.795+0000 7faa075a9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0015e5c0 con 0x7faa000cde60 2023-11-04T01:37:51.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.795+0000 7faa075a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0015e2e0 con 0x7faa0015daa0 2023-11-04T01:37:51.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.795+0000 7faa05345640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faa000cde60 0x7faa0015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.795+0000 7faa05345640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faa000cde60 0x7faa0015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33078/0 (socket says 172.21.15.44:33078) 2023-11-04T01:37:51.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.795+0000 7faa05345640 1 -- 172.21.15.44:0/83700690 learned_addr learned my addr 172.21.15.44:0/83700690 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:51.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.796+0000 7faa04b44640 1 --2- 172.21.15.44:0/83700690 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0015daa0 0x7faa00157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.796+0000 7faa05345640 1 -- 172.21.15.44:0/83700690 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0015daa0 msgr2=0x7faa00157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:51.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.796+0000 7faa05345640 1 --2- 172.21.15.44:0/83700690 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0015daa0 0x7faa00157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.796+0000 7faa05345640 1 -- 172.21.15.44:0/83700690 >> v1:172.21.15.204:6789/0 conn(0x7faa000ce240 legacy=0x7faa0006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:51.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.796+0000 7faa05345640 1 -- 172.21.15.44:0/83700690 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa000d1120 con 0x7faa000cde60 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.796+0000 7faa05345640 1 --2- 172.21.15.44:0/83700690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa000cde60 0x7faa0015d560 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009e50 tx=0x7fa9f002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b19f7f73f9c611 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.797+0000 7fa9fffff640 1 -- 172.21.15.44:0/83700690 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f002cb00 con 0x7faa000cde60 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.797+0000 7fa9fffff640 1 -- 172.21.15.44:0/83700690 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f002cc60 con 0x7faa000cde60 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.797+0000 7fa9fffff640 1 -- 172.21.15.44:0/83700690 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f00343f0 con 0x7faa000cde60 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.797+0000 7faa075a9640 1 -- 172.21.15.44:0/83700690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa000cde60 msgr2=0x7faa0015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.797+0000 7faa075a9640 1 --2- 172.21.15.44:0/83700690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa000cde60 0x7faa0015d560 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009e50 tx=0x7fa9f002bf60 comp rx=0 tx=0).stop 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.797+0000 7faa075a9640 1 -- 172.21.15.44:0/83700690 shutdown_connections 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.797+0000 7faa075a9640 1 --2- 172.21.15.44:0/83700690 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0015daa0 0x7faa00157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.797+0000 7faa075a9640 1 --2- 172.21.15.44:0/83700690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa000cde60 0x7faa0015d560 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.797+0000 7faa075a9640 1 -- 172.21.15.44:0/83700690 >> 172.21.15.44:0/83700690 conn(0x7faa00071f30 msgr2=0x7faa000cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:51.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.797+0000 7faa075a9640 1 -- 172.21.15.44:0/83700690 shutdown_connections 2023-11-04T01:37:51.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.797+0000 7faa075a9640 1 -- 172.21.15.44:0/83700690 wait complete. 2023-11-04T01:37:51.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.798+0000 7faa075a9640 1 Processor -- start 2023-11-04T01:37:51.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.798+0000 7faa075a9640 1 -- start start 2023-11-04T01:37:51.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.799+0000 7faa075a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa000cde60 0x7faa0015acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.799+0000 7faa075a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa000ce240 0x7faa001f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.799+0000 7faa075a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0015daa0 0x7faa0015cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.799+0000 7faa075a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0015b230 con 0x7faa000ce240 2023-11-04T01:37:51.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.799+0000 7faa075a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa001f2a30 con 0x7faa000cde60 2023-11-04T01:37:51.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.799+0000 7faa075a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0015d040 con 0x7faa0015daa0 2023-11-04T01:37:51.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.799+0000 7faa04b44640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa000ce240 0x7faa001f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.799+0000 7faa04b44640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa000ce240 0x7faa001f24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33094/0 (socket says 172.21.15.44:33094) 2023-11-04T01:37:51.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.799+0000 7faa04b44640 1 -- 172.21.15.44:0/696184043 learned_addr learned my addr 172.21.15.44:0/696184043 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:51.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.799+0000 7faa05345640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa000cde60 0x7faa0015acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.799+0000 7faa05b46640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0015daa0 0x7faa0015cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.800+0000 7faa04b44640 1 -- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0015daa0 msgr2=0x7faa0015cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.800+0000 7faa04b44640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0015daa0 0x7faa0015cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.800+0000 7faa04b44640 1 -- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa000cde60 msgr2=0x7faa0015acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.800+0000 7faa04b44640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa000cde60 0x7faa0015acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.800+0000 7faa04b44640 1 -- 172.21.15.44:0/696184043 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f0009b30 con 0x7faa000ce240 2023-11-04T01:37:51.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.800+0000 7faa05345640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa000cde60 0x7faa0015acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:51.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.800+0000 7faa05b46640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0015daa0 0x7faa0015cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:51.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.800+0000 7faa04b44640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa000ce240 0x7faa001f24f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400d620 tx=0x7fa9f400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:51.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.800+0000 7fa9fdffb640 1 -- 172.21.15.44:0/696184043 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f400b620 con 0x7faa000ce240 2023-11-04T01:37:51.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.800+0000 7fa9fdffb640 1 -- 172.21.15.44:0/696184043 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f400b780 con 0x7faa000ce240 2023-11-04T01:37:51.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.800+0000 7faa075a9640 1 -- 172.21.15.44:0/696184043 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa001f34e0 con 0x7faa000ce240 2023-11-04T01:37:51.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.800+0000 7fa9fdffb640 1 -- 172.21.15.44:0/696184043 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f400bb30 con 0x7faa000ce240 2023-11-04T01:37:51.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.800+0000 7faa075a9640 1 -- 172.21.15.44:0/696184043 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa001f37f0 con 0x7faa000ce240 2023-11-04T01:37:51.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.801+0000 7faa075a9640 1 -- 172.21.15.44:0/696184043 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa00074290 con 0x7faa000ce240 2023-11-04T01:37:51.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.802+0000 7fa9fdffb640 1 -- 172.21.15.44:0/696184043 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa9f400bc90 con 0x7faa000ce240 2023-11-04T01:37:51.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.802+0000 7fa9fdffb640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa9ec06ae70 0x7fa9ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.802+0000 7fa9fdffb640 1 -- 172.21.15.44:0/696184043 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa9f4089a00 con 0x7faa000ce240 2023-11-04T01:37:51.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.802+0000 7faa05345640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa9ec06ae70 0x7fa9ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.803+0000 7faa05345640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa9ec06ae70 0x7fa9ec06d330 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0035000 tx=0x7fa9f0030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:51.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.806+0000 7fa9fdffb640 1 -- 172.21.15.44:0/696184043 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa9f4054b60 con 0x7faa000ce240 2023-11-04T01:37:51.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.982+0000 7faa075a9640 1 -- 172.21.15.44:0/696184043 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa000d0a70 con 0x7faa000ce240 2023-11-04T01:37:51.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.983+0000 7fa9fdffb640 1 -- 172.21.15.44:0/696184043 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+14815 (secure 0 0 0) 0x7fa9f4058180 con 0x7faa000ce240 2023-11-04T01:37:51.985 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:51.986 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":52,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:51.295285+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:51.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.985+0000 7faa075a9640 1 -- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa9ec06ae70 msgr2=0x7fa9ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.985+0000 7faa075a9640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa9ec06ae70 0x7fa9ec06d330 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0035000 tx=0x7fa9f0030000 comp rx=0 tx=0).stop 2023-11-04T01:37:51.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.985+0000 7faa075a9640 1 -- 172.21.15.44:0/696184043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa000ce240 msgr2=0x7faa001f24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.985+0000 7faa075a9640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa000ce240 0x7faa001f24f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400d620 tx=0x7fa9f400dae0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.985+0000 7faa075a9640 1 -- 172.21.15.44:0/696184043 shutdown_connections 2023-11-04T01:37:51.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.985+0000 7faa075a9640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa9ec06ae70 0x7fa9ec06d330 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.985+0000 7faa075a9640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0015daa0 0x7faa0015cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.985+0000 7faa075a9640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa000ce240 0x7faa001f24f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.985+0000 7faa075a9640 1 --2- 172.21.15.44:0/696184043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa000cde60 0x7faa0015acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.985+0000 7faa075a9640 1 -- 172.21.15.44:0/696184043 >> 172.21.15.44:0/696184043 conn(0x7faa00071f30 msgr2=0x7faa000c69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:51.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.985+0000 7faa075a9640 1 -- 172.21.15.44:0/696184043 shutdown_connections 2023-11-04T01:37:51.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:51.985+0000 7faa075a9640 1 -- 172.21.15.44:0/696184043 wait complete. 2023-11-04T01:37:51.998 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:37:51.998 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:52.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.105+0000 7f7159a7c640 1 Processor -- start 2023-11-04T01:37:52.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.105+0000 7f7159a7c640 1 -- start start 2023-11-04T01:37:52.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.106+0000 7f7159a7c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f71540cf180 0x7f715406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.106+0000 7f7159a7c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71540cd570 0x7f71540cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.106+0000 7f7159a7c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71540cdf00 con 0x7f715415cfd0 2023-11-04T01:37:52.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.106+0000 7f7159a7c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715415d3b0 con 0x7f71540cf180 2023-11-04T01:37:52.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.106+0000 7f7159a7c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71540cea20 con 0x7f71540cd570 2023-11-04T01:37:52.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.106+0000 7f71537fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f715415cfd0 0x7f7154161440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55286/0 (socket says 172.21.15.44:55286) 2023-11-04T01:37:52.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.106+0000 7f71537fe640 1 -- 172.21.15.44:0/605759252 learned_addr learned my addr 172.21.15.44:0/605759252 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:52.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.106+0000 7f7153fff640 1 --2- 172.21.15.44:0/605759252 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71540cd570 0x7f71540cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.106+0000 7f7152ffd640 1 --2- 172.21.15.44:0/605759252 >> v2:172.21.15.204:3300/0 conn(0x7f71540cf180 0x7f715406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.107+0000 7f71527fc640 1 -- 172.21.15.44:0/605759252 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188809384 0 0) 0x7f71540cdf00 con 0x7f715415cfd0 2023-11-04T01:37:52.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.107+0000 7f71527fc640 1 -- 172.21.15.44:0/605759252 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f713c003520 con 0x7f715415cfd0 2023-11-04T01:37:52.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.107+0000 7f71527fc640 1 -- 172.21.15.44:0/605759252 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2001325166 0 0) 0x7f713c003520 con 0x7f715415cfd0 2023-11-04T01:37:52.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.107+0000 7f7153fff640 1 -- 172.21.15.44:0/605759252 >> v2:172.21.15.204:3300/0 conn(0x7f71540cf180 msgr2=0x7f715406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:52.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.107+0000 7f7153fff640 1 --2- 172.21.15.44:0/605759252 >> v2:172.21.15.204:3300/0 conn(0x7f71540cf180 0x7f715406c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.107+0000 7f7153fff640 1 -- 172.21.15.44:0/605759252 >> v1:172.21.15.44:6789/0 conn(0x7f715415cfd0 legacy=0x7f7154161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.107+0000 7f7153fff640 1 -- 172.21.15.44:0/605759252 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71540cf610 con 0x7f71540cd570 2023-11-04T01:37:52.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.107+0000 7f7152ffd640 1 --2- 172.21.15.44:0/605759252 >> v2:172.21.15.204:3300/0 conn(0x7f71540cf180 0x7f715406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:52.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.108+0000 7f7153fff640 1 --2- 172.21.15.44:0/605759252 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71540cd570 0x7f71540cd9c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f714c009d90 tx=0x7f714c02bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f89e1978c4d147a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.108+0000 7f71527fc640 1 -- 172.21.15.44:0/605759252 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144001690 con 0x7f71540cd570 2023-11-04T01:37:52.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.108+0000 7f71527fc640 1 -- 172.21.15.44:0/605759252 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c02c810 con 0x7f71540cd570 2023-11-04T01:37:52.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.108+0000 7f71527fc640 1 -- 172.21.15.44:0/605759252 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c02cba0 con 0x7f71540cd570 2023-11-04T01:37:52.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.108+0000 7f7159a7c640 1 -- 172.21.15.44:0/605759252 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71540cd570 msgr2=0x7f71540cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.108+0000 7f7159a7c640 1 --2- 172.21.15.44:0/605759252 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71540cd570 0x7f71540cd9c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f714c009d90 tx=0x7f714c02bce0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.108+0000 7f7159a7c640 1 -- 172.21.15.44:0/605759252 shutdown_connections 2023-11-04T01:37:52.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.108+0000 7f7159a7c640 1 --2- 172.21.15.44:0/605759252 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71540cd570 0x7f71540cd9c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.108+0000 7f7159a7c640 1 --2- 172.21.15.44:0/605759252 >> v2:172.21.15.204:3300/0 conn(0x7f71540cf180 0x7f715406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.108+0000 7f7159a7c640 1 -- 172.21.15.44:0/605759252 >> 172.21.15.44:0/605759252 conn(0x7f715406ea20 msgr2=0x7f715406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:52.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.109+0000 7f7159a7c640 1 -- 172.21.15.44:0/605759252 shutdown_connections 2023-11-04T01:37:52.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.109+0000 7f7159a7c640 1 -- 172.21.15.44:0/605759252 wait complete. 2023-11-04T01:37:52.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.110+0000 7f7159a7c640 1 Processor -- start 2023-11-04T01:37:52.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.110+0000 7f7159a7c640 1 -- start start 2023-11-04T01:37:52.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7159a7c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71540cd570 0x7f71540c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7159a7c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f715415cfd0 0x7f71540c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7159a7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71540c4c10 0x7f71540c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7159a7c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71540c5120 con 0x7f71540c4c10 2023-11-04T01:37:52.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7159a7c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71540c5400 con 0x7f715415cfd0 2023-11-04T01:37:52.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7159a7c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71540c56e0 con 0x7f71540cd570 2023-11-04T01:37:52.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7153fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71540c4c10 0x7f71540c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7153fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71540c4c10 0x7f71540c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33110/0 (socket says 172.21.15.44:33110) 2023-11-04T01:37:52.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7153fff640 1 -- 172.21.15.44:0/2580433141 learned_addr learned my addr 172.21.15.44:0/2580433141 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:52.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7152ffd640 1 --2- 172.21.15.44:0/2580433141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f715415cfd0 0x7f71540c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f71537fe640 1 --2- 172.21.15.44:0/2580433141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71540cd570 0x7f71540c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7153fff640 1 -- 172.21.15.44:0/2580433141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71540cd570 msgr2=0x7f71540c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7153fff640 1 --2- 172.21.15.44:0/2580433141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71540cd570 0x7f71540c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7153fff640 1 -- 172.21.15.44:0/2580433141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f715415cfd0 msgr2=0x7f71540c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7153fff640 1 --2- 172.21.15.44:0/2580433141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f715415cfd0 0x7f71540c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7153fff640 1 -- 172.21.15.44:0/2580433141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7148009400 con 0x7f71540c4c10 2023-11-04T01:37:52.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7153fff640 1 --2- 172.21.15.44:0/2580433141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71540c4c10 0x7f71540c70d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f714c009d90 tx=0x7f714c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f713bfff640 1 -- 172.21.15.44:0/2580433141 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c009450 con 0x7f71540c4c10 2023-11-04T01:37:52.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f713bfff640 1 -- 172.21.15.44:0/2580433141 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c034c50 con 0x7f71540c4c10 2023-11-04T01:37:52.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.111+0000 7f7159a7c640 1 -- 172.21.15.44:0/2580433141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714c009a70 con 0x7f71540c4c10 2023-11-04T01:37:52.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.112+0000 7f713bfff640 1 -- 172.21.15.44:0/2580433141 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c040450 con 0x7f71540c4c10 2023-11-04T01:37:52.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.112+0000 7f7159a7c640 1 -- 172.21.15.44:0/2580433141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71540c5ca0 con 0x7f71540c4c10 2023-11-04T01:37:52.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.112+0000 7f7159a7c640 1 -- 172.21.15.44:0/2580433141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71540c3e10 con 0x7f71540c4c10 2023-11-04T01:37:52.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.113+0000 7f713bfff640 1 -- 172.21.15.44:0/2580433141 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f714c0405b0 con 0x7f71540c4c10 2023-11-04T01:37:52.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.113+0000 7f713bfff640 1 --2- 172.21.15.44:0/2580433141 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f714006ae70 0x7f714006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.114+0000 7f713bfff640 1 -- 172.21.15.44:0/2580433141 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f714c0abd70 con 0x7f71540c4c10 2023-11-04T01:37:52.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.114+0000 7f71537fe640 1 --2- 172.21.15.44:0/2580433141 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f714006ae70 0x7f714006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.114+0000 7f71537fe640 1 --2- 172.21.15.44:0/2580433141 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f714006ae70 0x7f714006d330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7144001bd0 tx=0x7f7144001b20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.118+0000 7f713bfff640 1 -- 172.21.15.44:0/2580433141 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f714c077010 con 0x7f71540c4c10 2023-11-04T01:37:52.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.295+0000 7f7159a7c640 1 -- 172.21.15.44:0/2580433141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f715406b300 con 0x7f71540c4c10 2023-11-04T01:37:52.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.295+0000 7f713bfff640 1 -- 172.21.15.44:0/2580433141 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f714c07a630 con 0x7f71540c4c10 2023-11-04T01:37:52.298 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:37:52.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.297+0000 7f7159a7c640 1 -- 172.21.15.44:0/2580433141 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f714006ae70 msgr2=0x7f714006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.297+0000 7f7159a7c640 1 --2- 172.21.15.44:0/2580433141 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f714006ae70 0x7f714006d330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7144001bd0 tx=0x7f7144001b20 comp rx=0 tx=0).stop 2023-11-04T01:37:52.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.297+0000 7f7159a7c640 1 -- 172.21.15.44:0/2580433141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71540c4c10 msgr2=0x7f71540c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.297+0000 7f7159a7c640 1 --2- 172.21.15.44:0/2580433141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71540c4c10 0x7f71540c70d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f714c009d90 tx=0x7f714c004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:52.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.297+0000 7f7159a7c640 1 -- 172.21.15.44:0/2580433141 shutdown_connections 2023-11-04T01:37:52.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.297+0000 7f7159a7c640 1 --2- 172.21.15.44:0/2580433141 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f714006ae70 0x7f714006d330 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.297+0000 7f7159a7c640 1 --2- 172.21.15.44:0/2580433141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71540c4c10 0x7f71540c70d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.297+0000 7f7159a7c640 1 --2- 172.21.15.44:0/2580433141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f715415cfd0 0x7f71540c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.297+0000 7f7159a7c640 1 --2- 172.21.15.44:0/2580433141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71540cd570 0x7f71540c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.297+0000 7f7159a7c640 1 -- 172.21.15.44:0/2580433141 >> 172.21.15.44:0/2580433141 conn(0x7f715406ea20 msgr2=0x7f715415dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:52.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.298+0000 7f7159a7c640 1 -- 172.21.15.44:0/2580433141 shutdown_connections 2023-11-04T01:37:52.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.298+0000 7f7159a7c640 1 -- 172.21.15.44:0/2580433141 wait complete. 2023-11-04T01:37:52.310 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:37:52.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.417+0000 7f6350eb4640 1 Processor -- start 2023-11-04T01:37:52.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.417+0000 7f6350eb4640 1 -- start start 2023-11-04T01:37:52.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.418+0000 7f6350eb4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f634c15af20 0x7f634c0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.418+0000 7f6350eb4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f634c0cd3b0 0x7f634c0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.418+0000 7f6350eb4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c0cdd40 con 0x7f634c0b64c0 2023-11-04T01:37:52.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.418+0000 7f6350eb4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c0cc380 con 0x7f634c15af20 2023-11-04T01:37:52.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.418+0000 7f6350eb4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c0d01f0 con 0x7f634c0cd3b0 2023-11-04T01:37:52.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.418+0000 7f634a59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f634c15af20 0x7f634c0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.418+0000 7f6349d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f634c0b64c0 0x7f634c0cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55302/0 (socket says 172.21.15.44:55302) 2023-11-04T01:37:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.418+0000 7f634a59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f634c15af20 0x7f634c0b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33116/0 (socket says 172.21.15.44:33116) 2023-11-04T01:37:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.418+0000 7f6349d9b640 1 -- 172.21.15.44:0/200612745 learned_addr learned my addr 172.21.15.44:0/200612745 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.419+0000 7f634ad9d640 1 --2- 172.21.15.44:0/200612745 >> v2:172.21.15.204:3300/0 conn(0x7f634c0cd3b0 0x7f634c0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.419+0000 7f634a59c640 1 -- 172.21.15.44:0/200612745 >> v2:172.21.15.204:3300/0 conn(0x7f634c0cd3b0 msgr2=0x7f634c0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.419+0000 7f634a59c640 1 --2- 172.21.15.44:0/200612745 >> v2:172.21.15.204:3300/0 conn(0x7f634c0cd3b0 0x7f634c0cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.419+0000 7f634a59c640 1 -- 172.21.15.44:0/200612745 >> v1:172.21.15.44:6789/0 conn(0x7f634c0b64c0 legacy=0x7f634c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.419+0000 7f634959a640 1 -- 172.21.15.44:0/200612745 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638640169 0 0) 0x7f634c0cdd40 con 0x7f634c0b64c0 2023-11-04T01:37:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.419+0000 7f634a59c640 1 -- 172.21.15.44:0/200612745 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c0b6a40 con 0x7f634c15af20 2023-11-04T01:37:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.420+0000 7f634a59c640 1 --2- 172.21.15.44:0/200612745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c15af20 0x7f634c0b3cd0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f634c0b6950 tx=0x7f634402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff67b8fde7bd0a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.420+0000 7f634959a640 1 -- 172.21.15.44:0/200612745 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344031830 con 0x7f634c15af20 2023-11-04T01:37:52.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.420+0000 7f634959a640 1 -- 172.21.15.44:0/200612745 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6344031990 con 0x7f634c15af20 2023-11-04T01:37:52.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.420+0000 7f634959a640 1 -- 172.21.15.44:0/200612745 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344031d20 con 0x7f634c15af20 2023-11-04T01:37:52.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.420+0000 7f6350eb4640 1 -- 172.21.15.44:0/200612745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c15af20 msgr2=0x7f634c0b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.420+0000 7f6350eb4640 1 --2- 172.21.15.44:0/200612745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c15af20 0x7f634c0b3cd0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f634c0b6950 tx=0x7f634402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.420+0000 7f6350eb4640 1 -- 172.21.15.44:0/200612745 shutdown_connections 2023-11-04T01:37:52.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.420+0000 7f6350eb4640 1 --2- 172.21.15.44:0/200612745 >> v2:172.21.15.204:3300/0 conn(0x7f634c0cd3b0 0x7f634c0cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.420+0000 7f6350eb4640 1 --2- 172.21.15.44:0/200612745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c15af20 0x7f634c0b3cd0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.420+0000 7f6350eb4640 1 -- 172.21.15.44:0/200612745 >> 172.21.15.44:0/200612745 conn(0x7f634c06ea20 msgr2=0x7f634c06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:52.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.420+0000 7f6350eb4640 1 -- 172.21.15.44:0/200612745 shutdown_connections 2023-11-04T01:37:52.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.420+0000 7f6350eb4640 1 -- 172.21.15.44:0/200612745 wait complete. 2023-11-04T01:37:52.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.422+0000 7f6350eb4640 1 Processor -- start 2023-11-04T01:37:52.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.422+0000 7f6350eb4640 1 -- start start 2023-11-04T01:37:52.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.422+0000 7f6350eb4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f634c0b64c0 0x7f634c15b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.422+0000 7f6350eb4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0cd3b0 0x7f634c0b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.422+0000 7f6350eb4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c15af20 0x7f634c0b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.422+0000 7f6350eb4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c143b50 con 0x7f634c0cd3b0 2023-11-04T01:37:52.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.422+0000 7f6350eb4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c143e30 con 0x7f634c0b64c0 2023-11-04T01:37:52.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.422+0000 7f6350eb4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c144110 con 0x7f634c15af20 2023-11-04T01:37:52.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.422+0000 7f6349d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0cd3b0 0x7f634c0b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.422+0000 7f6349d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0cd3b0 0x7f634c0b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33132/0 (socket says 172.21.15.44:33132) 2023-11-04T01:37:52.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.422+0000 7f6349d9b640 1 -- 172.21.15.44:0/2815231660 learned_addr learned my addr 172.21.15.44:0/2815231660 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:52.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.423+0000 7f634a59c640 1 --2- 172.21.15.44:0/2815231660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f634c0b64c0 0x7f634c15b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.423+0000 7f6349d9b640 1 -- 172.21.15.44:0/2815231660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c15af20 msgr2=0x7f634c0b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.423+0000 7f6349d9b640 1 --2- 172.21.15.44:0/2815231660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c15af20 0x7f634c0b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.423+0000 7f6349d9b640 1 -- 172.21.15.44:0/2815231660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f634c0b64c0 msgr2=0x7f634c15b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.423+0000 7f6349d9b640 1 --2- 172.21.15.44:0/2815231660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f634c0b64c0 0x7f634c15b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.423+0000 7f6349d9b640 1 -- 172.21.15.44:0/2815231660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6344009400 con 0x7f634c0cd3b0 2023-11-04T01:37:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.423+0000 7f6349d9b640 1 --2- 172.21.15.44:0/2815231660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0cd3b0 0x7f634c0b27d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f633400c4d0 tx=0x7f633400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.423+0000 7f6342ffd640 1 -- 172.21.15.44:0/2815231660 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63340074e0 con 0x7f634c0cd3b0 2023-11-04T01:37:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.423+0000 7f6342ffd640 1 -- 172.21.15.44:0/2815231660 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6334007660 con 0x7f634c0cd3b0 2023-11-04T01:37:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.423+0000 7f6342ffd640 1 -- 172.21.15.44:0/2815231660 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334004a20 con 0x7f634c0cd3b0 2023-11-04T01:37:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.423+0000 7f6350eb4640 1 -- 172.21.15.44:0/2815231660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c1443f0 con 0x7f634c0cd3b0 2023-11-04T01:37:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.423+0000 7f6350eb4640 1 -- 172.21.15.44:0/2815231660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c1f4a10 con 0x7f634c0cd3b0 2023-11-04T01:37:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.424+0000 7f6350eb4640 1 -- 172.21.15.44:0/2815231660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c1445e0 con 0x7f634c0cd3b0 2023-11-04T01:37:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.425+0000 7f6342ffd640 1 -- 172.21.15.44:0/2815231660 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6334004b80 con 0x7f634c0cd3b0 2023-11-04T01:37:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.425+0000 7f6342ffd640 1 --2- 172.21.15.44:0/2815231660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f632c06ae70 0x7f632c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.425+0000 7f6342ffd640 1 -- 172.21.15.44:0/2815231660 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f6334088700 con 0x7f634c0cd3b0 2023-11-04T01:37:52.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.425+0000 7f634a59c640 1 --2- 172.21.15.44:0/2815231660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f632c06ae70 0x7f632c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.426+0000 7f634a59c640 1 --2- 172.21.15.44:0/2815231660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f632c06ae70 0x7f632c06d330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6344036000 tx=0x7f634403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.429+0000 7f6342ffd640 1 -- 172.21.15.44:0/2815231660 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6334053860 con 0x7f634c0cd3b0 2023-11-04T01:37:52.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.605+0000 7f6350eb4640 1 -- 172.21.15.44:0/2815231660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f634c143c90 con 0x7f634c0cd3b0 2023-11-04T01:37:52.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.605+0000 7f6342ffd640 1 -- 172.21.15.44:0/2815231660 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v52) v1 ==== 103+0+11 (secure 0 0 0) 0x7f634c143c90 con 0x7f634c0cd3b0 2023-11-04T01:37:52.608 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:37:52.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.607+0000 7f6350eb4640 1 -- 172.21.15.44:0/2815231660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f632c06ae70 msgr2=0x7f632c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.607+0000 7f6350eb4640 1 --2- 172.21.15.44:0/2815231660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f632c06ae70 0x7f632c06d330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6344036000 tx=0x7f634403c040 comp rx=0 tx=0).stop 2023-11-04T01:37:52.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.607+0000 7f6350eb4640 1 -- 172.21.15.44:0/2815231660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0cd3b0 msgr2=0x7f634c0b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.607+0000 7f6350eb4640 1 --2- 172.21.15.44:0/2815231660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0cd3b0 0x7f634c0b27d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f633400c4d0 tx=0x7f633400c990 comp rx=0 tx=0).stop 2023-11-04T01:37:52.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.607+0000 7f6350eb4640 1 -- 172.21.15.44:0/2815231660 shutdown_connections 2023-11-04T01:37:52.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.607+0000 7f6350eb4640 1 --2- 172.21.15.44:0/2815231660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f632c06ae70 0x7f632c06d330 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.607+0000 7f6350eb4640 1 --2- 172.21.15.44:0/2815231660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f634c15af20 0x7f634c0b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.607+0000 7f6350eb4640 1 --2- 172.21.15.44:0/2815231660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f634c0cd3b0 0x7f634c0b27d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.607+0000 7f6350eb4640 1 --2- 172.21.15.44:0/2815231660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f634c0b64c0 0x7f634c15b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.607+0000 7f6350eb4640 1 -- 172.21.15.44:0/2815231660 >> 172.21.15.44:0/2815231660 conn(0x7f634c06ea20 msgr2=0x7f634c0b5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:52.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.607+0000 7f6350eb4640 1 -- 172.21.15.44:0/2815231660 shutdown_connections 2023-11-04T01:37:52.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.607+0000 7f6350eb4640 1 -- 172.21.15.44:0/2815231660 wait complete. 2023-11-04T01:37:52.620 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:37:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.724+0000 7f3b3b6a9640 1 Processor -- start 2023-11-04T01:37:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.724+0000 7f3b3b6a9640 1 -- start start 2023-11-04T01:37:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.724+0000 7f3b3b6a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b34159c70 0x7f3b340ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.725+0000 7f3b3b6a9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3b340b0ae0 0x7f3b3415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.725+0000 7f3b3b6a9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b340b4110 con 0x7f3b3406db20 2023-11-04T01:37:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.725+0000 7f3b3b6a9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b340b49b0 con 0x7f3b340b0ae0 2023-11-04T01:37:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.725+0000 7f3b3b6a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340b43f0 con 0x7f3b34159c70 2023-11-04T01:37:52.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.725+0000 7f3b38c44640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3b3406db20 0x7f3b340b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41758/0 (socket says 172.21.15.44:41758) 2023-11-04T01:37:52.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.725+0000 7f3b38c44640 1 -- 172.21.15.44:0/1315836210 learned_addr learned my addr 172.21.15.44:0/1315836210 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:52.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.725+0000 7f3b39445640 1 --2- 172.21.15.44:0/1315836210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b34159c70 0x7f3b340ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.725+0000 7f3b39c46640 1 --2- 172.21.15.44:0/1315836210 >> v2:172.21.15.204:3300/0 conn(0x7f3b340b0ae0 0x7f3b3415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.725+0000 7f3b2bfff640 1 -- 172.21.15.44:0/1315836210 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999124262 0 0) 0x7f3b340b4110 con 0x7f3b3406db20 2023-11-04T01:37:52.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.725+0000 7f3b2bfff640 1 -- 172.21.15.44:0/1315836210 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b20003520 con 0x7f3b3406db20 2023-11-04T01:37:52.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.725+0000 7f3b39c46640 1 -- 172.21.15.44:0/1315836210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b34159c70 msgr2=0x7f3b340ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:52.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.725+0000 7f3b39c46640 1 --2- 172.21.15.44:0/1315836210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b34159c70 0x7f3b340ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.725+0000 7f3b39c46640 1 -- 172.21.15.44:0/1315836210 >> v1:172.21.15.44:6789/0 conn(0x7f3b3406db20 legacy=0x7f3b340b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.725+0000 7f3b39c46640 1 -- 172.21.15.44:0/1315836210 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b340b46d0 con 0x7f3b340b0ae0 2023-11-04T01:37:52.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.725+0000 7f3b39445640 1 --2- 172.21.15.44:0/1315836210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b34159c70 0x7f3b340ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:52.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.726+0000 7f3b39c46640 1 --2- 172.21.15.44:0/1315836210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b340b0ae0 0x7f3b3415d7d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009d90 tx=0x7f3b2c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aca01456d0b12469 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.726+0000 7f3b2bfff640 1 -- 172.21.15.44:0/1315836210 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c02cc50 con 0x7f3b340b0ae0 2023-11-04T01:37:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.726+0000 7f3b2bfff640 1 -- 172.21.15.44:0/1315836210 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c02cdb0 con 0x7f3b340b0ae0 2023-11-04T01:37:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.726+0000 7f3b2bfff640 1 -- 172.21.15.44:0/1315836210 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c034640 con 0x7f3b340b0ae0 2023-11-04T01:37:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.727+0000 7f3b3b6a9640 1 -- 172.21.15.44:0/1315836210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b340b0ae0 msgr2=0x7f3b3415d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.727+0000 7f3b3b6a9640 1 --2- 172.21.15.44:0/1315836210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b340b0ae0 0x7f3b3415d7d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009d90 tx=0x7f3b2c02bea0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.727+0000 7f3b3b6a9640 1 -- 172.21.15.44:0/1315836210 shutdown_connections 2023-11-04T01:37:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.727+0000 7f3b3b6a9640 1 --2- 172.21.15.44:0/1315836210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b340b0ae0 0x7f3b3415d7d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.727+0000 7f3b3b6a9640 1 --2- 172.21.15.44:0/1315836210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b34159c70 0x7f3b340ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.727+0000 7f3b3b6a9640 1 -- 172.21.15.44:0/1315836210 >> 172.21.15.44:0/1315836210 conn(0x7f3b340ce950 msgr2=0x7f3b340ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.727+0000 7f3b3b6a9640 1 -- 172.21.15.44:0/1315836210 shutdown_connections 2023-11-04T01:37:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.727+0000 7f3b3b6a9640 1 -- 172.21.15.44:0/1315836210 wait complete. 2023-11-04T01:37:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.728+0000 7f3b3b6a9640 1 Processor -- start 2023-11-04T01:37:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.728+0000 7f3b3b6a9640 1 -- start start 2023-11-04T01:37:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b3b6a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b3406db20 0x7f3b34150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b3b6a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b340b0ae0 0x7f3b34155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b3b6a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b34159c70 0x7f3b3414d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b3b6a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340c7c60 con 0x7f3b34159c70 2023-11-04T01:37:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b3b6a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340c5b50 con 0x7f3b3406db20 2023-11-04T01:37:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b3b6a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34155d80 con 0x7f3b340b0ae0 2023-11-04T01:37:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b39c46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b34159c70 0x7f3b3414d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b39c46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b34159c70 0x7f3b3414d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40508/0 (socket says 172.21.15.44:40508) 2023-11-04T01:37:52.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b39c46640 1 -- 172.21.15.44:0/2316837584 learned_addr learned my addr 172.21.15.44:0/2316837584 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:52.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b39445640 1 --2- 172.21.15.44:0/2316837584 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b3406db20 0x7f3b34150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b38c44640 1 --2- 172.21.15.44:0/2316837584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b340b0ae0 0x7f3b34155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b39c46640 1 -- 172.21.15.44:0/2316837584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b340b0ae0 msgr2=0x7f3b34155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b39c46640 1 --2- 172.21.15.44:0/2316837584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b340b0ae0 0x7f3b34155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b39c46640 1 -- 172.21.15.44:0/2316837584 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b3406db20 msgr2=0x7f3b34150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b39c46640 1 --2- 172.21.15.44:0/2316837584 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b3406db20 0x7f3b34150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b39c46640 1 -- 172.21.15.44:0/2316837584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b30009400 con 0x7f3b34159c70 2023-11-04T01:37:52.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.729+0000 7f3b39445640 1 --2- 172.21.15.44:0/2316837584 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b3406db20 0x7f3b34150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:52.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.730+0000 7f3b39c46640 1 --2- 172.21.15.44:0/2316837584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b34159c70 0x7f3b3414d7a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009eb0 tx=0x7f3b2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.730+0000 7f3b29ffb640 1 -- 172.21.15.44:0/2316837584 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c009450 con 0x7f3b34159c70 2023-11-04T01:37:52.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.730+0000 7f3b29ffb640 1 -- 172.21.15.44:0/2316837584 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c03f420 con 0x7f3b34159c70 2023-11-04T01:37:52.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.730+0000 7f3b3b6a9640 1 -- 172.21.15.44:0/2316837584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c009a70 con 0x7f3b34159c70 2023-11-04T01:37:52.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.730+0000 7f3b29ffb640 1 -- 172.21.15.44:0/2316837584 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c03f7f0 con 0x7f3b34159c70 2023-11-04T01:37:52.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.730+0000 7f3b3b6a9640 1 -- 172.21.15.44:0/2316837584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b340c7e70 con 0x7f3b34159c70 2023-11-04T01:37:52.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.731+0000 7f3b3b6a9640 1 -- 172.21.15.44:0/2316837584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b340c5ce0 con 0x7f3b34159c70 2023-11-04T01:37:52.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.732+0000 7f3b29ffb640 1 -- 172.21.15.44:0/2316837584 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b2c03f950 con 0x7f3b34159c70 2023-11-04T01:37:52.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.732+0000 7f3b29ffb640 1 --2- 172.21.15.44:0/2316837584 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b1806ae70 0x7f3b1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.732+0000 7f3b29ffb640 1 -- 172.21.15.44:0/2316837584 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f3b2c0abca0 con 0x7f3b34159c70 2023-11-04T01:37:52.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.732+0000 7f3b39445640 1 --2- 172.21.15.44:0/2316837584 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b1806ae70 0x7f3b1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.733+0000 7f3b39445640 1 --2- 172.21.15.44:0/2316837584 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b1806ae70 0x7f3b1806d330 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009d20 tx=0x7f3b30008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.736+0000 7f3b29ffb640 1 -- 172.21.15.44:0/2316837584 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b2c076f50 con 0x7f3b34159c70 2023-11-04T01:37:52.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.913+0000 7f3b3b6a9640 1 -- 172.21.15.44:0/2316837584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3b340ce090 con 0x7f3b34159c70 2023-11-04T01:37:52.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.913+0000 7f3b29ffb640 1 -- 172.21.15.44:0/2316837584 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v52) v1 ==== 84+0+137 (secure 0 0 0) 0x7f3b2c0390a0 con 0x7f3b34159c70 2023-11-04T01:37:52.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:52.916 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2023-11-04T01:37:52.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:52.916 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2023-11-04T01:37:52.916 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2023-11-04T01:37:52.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:37:52.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:37:52.916 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 7, 2023-11-04T01:37:52.916 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": "snap-test-pool" 2023-11-04T01:37:52.916 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:37:52.916 INFO:teuthology.orchestra.run.smithi044.stdout:] 2023-11-04T01:37:52.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.915+0000 7f3b3b6a9640 1 -- 172.21.15.44:0/2316837584 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b1806ae70 msgr2=0x7f3b1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.915+0000 7f3b3b6a9640 1 --2- 172.21.15.44:0/2316837584 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b1806ae70 0x7f3b1806d330 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009d20 tx=0x7f3b30008040 comp rx=0 tx=0).stop 2023-11-04T01:37:52.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.915+0000 7f3b3b6a9640 1 -- 172.21.15.44:0/2316837584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b34159c70 msgr2=0x7f3b3414d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.915+0000 7f3b3b6a9640 1 --2- 172.21.15.44:0/2316837584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b34159c70 0x7f3b3414d7a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009eb0 tx=0x7f3b2c004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:52.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.915+0000 7f3b3b6a9640 1 -- 172.21.15.44:0/2316837584 shutdown_connections 2023-11-04T01:37:52.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.915+0000 7f3b3b6a9640 1 --2- 172.21.15.44:0/2316837584 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b1806ae70 0x7f3b1806d330 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.915+0000 7f3b3b6a9640 1 --2- 172.21.15.44:0/2316837584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b34159c70 0x7f3b3414d7a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.915+0000 7f3b3b6a9640 1 --2- 172.21.15.44:0/2316837584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b340b0ae0 0x7f3b34155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.915+0000 7f3b3b6a9640 1 --2- 172.21.15.44:0/2316837584 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b3406db20 0x7f3b34150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.915+0000 7f3b3b6a9640 1 -- 172.21.15.44:0/2316837584 >> 172.21.15.44:0/2316837584 conn(0x7f3b340ce950 msgr2=0x7f3b340ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:52.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.915+0000 7f3b3b6a9640 1 -- 172.21.15.44:0/2316837584 shutdown_connections 2023-11-04T01:37:52.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:52.915+0000 7f3b3b6a9640 1 -- 172.21.15.44:0/2316837584 wait complete. 2023-11-04T01:37:52.928 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:37:52.928 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:37:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.036+0000 7ff3ba753640 1 Processor -- start 2023-11-04T01:37:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.036+0000 7ff3ba753640 1 -- start start 2023-11-04T01:37:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3ba753640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff3b406dd50 0x7ff3b4165bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3ba753640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b415c0d0 con 0x7ff3b4151ea0 2023-11-04T01:37:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3ba753640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b406cf90 con 0x7ff3b415f510 2023-11-04T01:37:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3ba753640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b406d270 con 0x7ff3b406dd50 2023-11-04T01:37:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b3fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff3b4151ea0 0x7ff3b415b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41764/0 (socket says 172.21.15.44:41764) 2023-11-04T01:37:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b3fff640 1 -- 172.21.15.44:0/3937099194 learned_addr learned my addr 172.21.15.44:0/3937099194 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b8cf0640 1 --2- 172.21.15.44:0/3937099194 >> v2:172.21.15.204:3300/0 conn(0x7ff3b406dd50 0x7ff3b4165bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b2ffd640 1 -- 172.21.15.44:0/3937099194 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554531482 0 0) 0x7ff3b415c0d0 con 0x7ff3b4151ea0 2023-11-04T01:37:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b2ffd640 1 -- 172.21.15.44:0/3937099194 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff39c003520 con 0x7ff3b4151ea0 2023-11-04T01:37:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b2ffd640 1 -- 172.21.15.44:0/3937099194 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2485323236 0 0) 0x7ff39c003520 con 0x7ff3b4151ea0 2023-11-04T01:37:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b2ffd640 1 -- 172.21.15.44:0/3937099194 >> v2:172.21.15.204:3300/0 conn(0x7ff3b406dd50 msgr2=0x7ff3b4165bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b2ffd640 1 --2- 172.21.15.44:0/3937099194 >> v2:172.21.15.204:3300/0 conn(0x7ff3b406dd50 0x7ff3b4165bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b2ffd640 1 -- 172.21.15.44:0/3937099194 >> v1:172.21.15.204:6789/0 conn(0x7ff3b415f510 legacy=0x7ff3b40cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b2ffd640 1 -- 172.21.15.44:0/3937099194 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b406d550 con 0x7ff3b4151ea0 2023-11-04T01:37:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b2ffd640 1 -- 172.21.15.44:0/3937099194 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7ff3a4001670 con 0x7ff3b4151ea0 2023-11-04T01:37:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b2ffd640 1 -- 172.21.15.44:0/3937099194 >> v1:172.21.15.44:6789/0 conn(0x7ff3b4151ea0 legacy=0x7ff3b415b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b2ffd640 1 --2- 172.21.15.44:0/3937099194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff39c003970 0x7ff39c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b2ffd640 1 --2- 172.21.15.44:0/3937099194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff39c0047c0 0x7ff39c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b2ffd640 1 --2- 172.21.15.44:0/3937099194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff39c005180 0x7ff39c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b2ffd640 1 -- 172.21.15.44:0/3937099194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b406d270 con 0x7ff39c0047c0 2023-11-04T01:37:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b2ffd640 1 -- 172.21.15.44:0/3937099194 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c00c020 con 0x7ff39c005180 2023-11-04T01:37:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b2ffd640 1 -- 172.21.15.44:0/3937099194 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c00c1e0 con 0x7ff39c003970 2023-11-04T01:37:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.037+0000 7ff3b37fe640 1 --2- 172.21.15.44:0/3937099194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff39c0047c0 0x7ff39c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.038+0000 7ff3b3fff640 1 --2- 172.21.15.44:0/3937099194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff39c003970 0x7ff39c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.038+0000 7ff3b8cf0640 1 --2- 172.21.15.44:0/3937099194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff39c005180 0x7ff39c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.038+0000 7ff3b37fe640 1 -- 172.21.15.44:0/3937099194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff39c003970 msgr2=0x7ff39c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.038+0000 7ff3b37fe640 1 --2- 172.21.15.44:0/3937099194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff39c003970 0x7ff39c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.038+0000 7ff3b37fe640 1 -- 172.21.15.44:0/3937099194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff39c005180 msgr2=0x7ff39c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.038+0000 7ff3b37fe640 1 --2- 172.21.15.44:0/3937099194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff39c005180 0x7ff39c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.038+0000 7ff3b37fe640 1 -- 172.21.15.44:0/3937099194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39c003520 con 0x7ff39c0047c0 2023-11-04T01:37:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.038+0000 7ff3b8cf0640 1 -- 172.21.15.44:0/3937099194 reap_dead start 2023-11-04T01:37:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.038+0000 7ff3b3fff640 1 --2- 172.21.15.44:0/3937099194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff39c003970 0x7ff39c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.039+0000 7ff3b37fe640 1 --2- 172.21.15.44:0/3937099194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff39c0047c0 0x7ff39c004c40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8001750 tx=0x7ff39c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fddf1e3c918c06 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.039+0000 7ff3b2ffd640 1 -- 172.21.15.44:0/3937099194 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a80052d0 con 0x7ff39c0047c0 2023-11-04T01:37:53.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.039+0000 7ff3b2ffd640 1 -- 172.21.15.44:0/3937099194 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a802e050 con 0x7ff39c0047c0 2023-11-04T01:37:53.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.039+0000 7ff3b2ffd640 1 -- 172.21.15.44:0/3937099194 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8003830 con 0x7ff39c0047c0 2023-11-04T01:37:53.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.039+0000 7ff3ba753640 1 -- 172.21.15.44:0/3937099194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff39c0047c0 msgr2=0x7ff39c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.039+0000 7ff3ba753640 1 --2- 172.21.15.44:0/3937099194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff39c0047c0 0x7ff39c004c40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8001750 tx=0x7ff39c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.039+0000 7ff3ba753640 1 -- 172.21.15.44:0/3937099194 shutdown_connections 2023-11-04T01:37:53.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.039+0000 7ff3ba753640 1 --2- 172.21.15.44:0/3937099194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff39c0047c0 0x7ff39c004c40 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.039+0000 7ff3ba753640 1 -- 172.21.15.44:0/3937099194 >> 172.21.15.44:0/3937099194 conn(0x7ff3b40b05d0 msgr2=0x7ff3b40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:53.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.039+0000 7ff3ba753640 1 -- 172.21.15.44:0/3937099194 shutdown_connections 2023-11-04T01:37:53.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.039+0000 7ff3ba753640 1 -- 172.21.15.44:0/3937099194 wait complete. 2023-11-04T01:37:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.040+0000 7ff3ba753640 1 Processor -- start 2023-11-04T01:37:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.041+0000 7ff3ba753640 1 -- start start 2023-11-04T01:37:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.041+0000 7ff3ba753640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff39c0047c0 0x7ff3b41f09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.041+0000 7ff3ba753640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3b40c5a90 0x7ff3b41ede10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.041+0000 7ff3ba753640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3b40b3660 0x7ff3b40b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.041+0000 7ff3ba753640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b40b4050 con 0x7ff3b40b3660 2023-11-04T01:37:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.041+0000 7ff3ba753640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b4152280 con 0x7ff3b40c5a90 2023-11-04T01:37:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.041+0000 7ff3ba753640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b40c6270 con 0x7ff39c0047c0 2023-11-04T01:37:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.041+0000 7ff3b8cf0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3b40b3660 0x7ff3b40b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.041+0000 7ff3b8cf0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3b40b3660 0x7ff3b40b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40528/0 (socket says 172.21.15.44:40528) 2023-11-04T01:37:53.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.041+0000 7ff3b8cf0640 1 -- 172.21.15.44:0/1946673476 learned_addr learned my addr 172.21.15.44:0/1946673476 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:53.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.042+0000 7ff3b37fe640 1 --2- 172.21.15.44:0/1946673476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3b40c5a90 0x7ff3b41ede10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.042+0000 7ff3b3fff640 1 --2- 172.21.15.44:0/1946673476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff39c0047c0 0x7ff3b41f09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.042+0000 7ff3b8cf0640 1 -- 172.21.15.44:0/1946673476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff39c0047c0 msgr2=0x7ff3b41f09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.042+0000 7ff3b8cf0640 1 --2- 172.21.15.44:0/1946673476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff39c0047c0 0x7ff3b41f09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.042+0000 7ff3b8cf0640 1 -- 172.21.15.44:0/1946673476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3b40c5a90 msgr2=0x7ff3b41ede10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.042+0000 7ff3b8cf0640 1 --2- 172.21.15.44:0/1946673476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3b40c5a90 0x7ff3b41ede10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.042+0000 7ff3b8cf0640 1 -- 172.21.15.44:0/1946673476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b40c6550 con 0x7ff3b40b3660 2023-11-04T01:37:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.042+0000 7ff3b37fe640 1 --2- 172.21.15.44:0/1946673476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3b40c5a90 0x7ff3b41ede10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.042+0000 7ff3b8cf0640 1 --2- 172.21.15.44:0/1946673476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3b40b3660 0x7ff3b40b3b10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40cc8e0 tx=0x7ff3ac00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.042+0000 7ff3b0ff9640 1 -- 172.21.15.44:0/1946673476 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac00e040 con 0x7ff3b40b3660 2023-11-04T01:37:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.042+0000 7ff3b0ff9640 1 -- 172.21.15.44:0/1946673476 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ac00f040 con 0x7ff3b40b3660 2023-11-04T01:37:53.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.042+0000 7ff3ba753640 1 -- 172.21.15.44:0/1946673476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b40c6830 con 0x7ff3b40b3660 2023-11-04T01:37:53.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.042+0000 7ff3b0ff9640 1 -- 172.21.15.44:0/1946673476 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac015430 con 0x7ff3b40b3660 2023-11-04T01:37:53.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.042+0000 7ff3ba753640 1 -- 172.21.15.44:0/1946673476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b41ee350 con 0x7ff3b40b3660 2023-11-04T01:37:53.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.043+0000 7ff3ba753640 1 -- 172.21.15.44:0/1946673476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b4152710 con 0x7ff3b40b3660 2023-11-04T01:37:53.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.043+0000 7ff3b0ff9640 1 -- 172.21.15.44:0/1946673476 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3ac015590 con 0x7ff3b40b3660 2023-11-04T01:37:53.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.044+0000 7ff3b0ff9640 1 --2- 172.21.15.44:0/1946673476 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff3a006aea0 0x7ff3a006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.044+0000 7ff3b0ff9640 1 -- 172.21.15.44:0/1946673476 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff3ac089ff0 con 0x7ff3b40b3660 2023-11-04T01:37:53.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.044+0000 7ff3b3fff640 1 --2- 172.21.15.44:0/1946673476 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff3a006aea0 0x7ff3a006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.045+0000 7ff3b3fff640 1 --2- 172.21.15.44:0/1946673476 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff3a006aea0 0x7ff3a006d360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4001010 tx=0x7ff3a4001110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.048+0000 7ff3b0ff9640 1 -- 172.21.15.44:0/1946673476 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3b4152710 con 0x7ff3b40b3660 2023-11-04T01:37:53.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.225+0000 7ff3ba753640 1 -- 172.21.15.44:0/1946673476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff3b4152710 con 0x7ff3b40b3660 2023-11-04T01:37:53.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.286+0000 7ff3b0ff9640 1 -- 172.21.15.44:0/1946673476 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff3b4152710 con 0x7ff3b40b3660 2023-11-04T01:37:53.288 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2023-11-04T01:37:53.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.288+0000 7ff3ba753640 1 -- 172.21.15.44:0/1946673476 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff3a006aea0 msgr2=0x7ff3a006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.288+0000 7ff3ba753640 1 --2- 172.21.15.44:0/1946673476 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff3a006aea0 0x7ff3a006d360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4001010 tx=0x7ff3a4001110 comp rx=0 tx=0).stop 2023-11-04T01:37:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.288+0000 7ff3ba753640 1 -- 172.21.15.44:0/1946673476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3b40b3660 msgr2=0x7ff3b40b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.288+0000 7ff3ba753640 1 --2- 172.21.15.44:0/1946673476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3b40b3660 0x7ff3b40b3b10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40cc8e0 tx=0x7ff3ac00f1b0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.288+0000 7ff3ba753640 1 -- 172.21.15.44:0/1946673476 shutdown_connections 2023-11-04T01:37:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.288+0000 7ff3ba753640 1 --2- 172.21.15.44:0/1946673476 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff3a006aea0 0x7ff3a006d360 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.288+0000 7ff3ba753640 1 --2- 172.21.15.44:0/1946673476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3b40b3660 0x7ff3b40b3b10 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.288+0000 7ff3ba753640 1 --2- 172.21.15.44:0/1946673476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3b40c5a90 0x7ff3b41ede10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.288+0000 7ff3ba753640 1 --2- 172.21.15.44:0/1946673476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff39c0047c0 0x7ff3b41f09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.288+0000 7ff3ba753640 1 -- 172.21.15.44:0/1946673476 >> 172.21.15.44:0/1946673476 conn(0x7ff3b40b05d0 msgr2=0x7ff3b40c98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.288+0000 7ff3ba753640 1 -- 172.21.15.44:0/1946673476 shutdown_connections 2023-11-04T01:37:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.288+0000 7ff3ba753640 1 -- 172.21.15.44:0/1946673476 wait complete. 2023-11-04T01:37:53.305 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:37:53.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.419+0000 7f325636e640 1 Processor -- start 2023-11-04T01:37:53.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.419+0000 7f325636e640 1 -- start start 2023-11-04T01:37:53.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.420+0000 7f325636e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f325015e430 0x7f32500cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.420+0000 7f325636e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f32500cf160 0x7f32500cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.420+0000 7f325636e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32500d0280 con 0x7f32500d0710 2023-11-04T01:37:53.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.420+0000 7f325636e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32500cf670 con 0x7f32500cf160 2023-11-04T01:37:53.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.420+0000 7f325636e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32500cf950 con 0x7f325015e430 2023-11-04T01:37:53.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.420+0000 7f324ffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f325015e430 0x7f32500cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.420+0000 7f324f7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f32500cf160 0x7f32500cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.420+0000 7f324ffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f325015e430 0x7f32500cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:33786/0 (socket says 172.21.15.44:33786) 2023-11-04T01:37:53.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.420+0000 7f324f7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f32500cf160 0x7f32500cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:59848/0 (socket says 172.21.15.44:59848) 2023-11-04T01:37:53.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.420+0000 7f324ffff640 1 -- 172.21.15.44:0/885964741 learned_addr learned my addr 172.21.15.44:0/885964741 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.420+0000 7f325490b640 1 --1- 172.21.15.44:0/885964741 >> v1:172.21.15.204:6789/0 conn(0x7f32500d0710 0x7f32500b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:57218/0 (socket says 172.21.15.44:57218) 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.421+0000 7f324ffff640 1 -- 172.21.15.44:0/885964741 >> v2:172.21.15.204:3300/0 conn(0x7f32500cf160 msgr2=0x7f32500cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.421+0000 7f324ffff640 1 --2- 172.21.15.44:0/885964741 >> v2:172.21.15.204:3300/0 conn(0x7f32500cf160 0x7f32500cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.421+0000 7f324ffff640 1 -- 172.21.15.44:0/885964741 >> v1:172.21.15.204:6789/0 conn(0x7f32500d0710 legacy=0x7f32500b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.421+0000 7f324ffff640 1 -- 172.21.15.44:0/885964741 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32500cfc30 con 0x7f325015e430 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.421+0000 7f324f7fe640 1 --2- 172.21.15.44:0/885964741 >> v2:172.21.15.204:3300/0 conn(0x7f32500cf160 0x7f32500cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:53.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.421+0000 7f324ffff640 1 --2- 172.21.15.44:0/885964741 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f325015e430 0x7f32500cec20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3244009870 tx=0x7f324402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=611b136becc54b6c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.422+0000 7f324effd640 1 -- 172.21.15.44:0/885964741 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3244030840 con 0x7f325015e430 2023-11-04T01:37:53.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.422+0000 7f324effd640 1 -- 172.21.15.44:0/885964741 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32440309a0 con 0x7f325015e430 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.422+0000 7f324effd640 1 -- 172.21.15.44:0/885964741 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3244030d30 con 0x7f325015e430 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.422+0000 7f325636e640 1 -- 172.21.15.44:0/885964741 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f325015e430 msgr2=0x7f32500cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.422+0000 7f325636e640 1 --2- 172.21.15.44:0/885964741 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f325015e430 0x7f32500cec20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3244009870 tx=0x7f324402b980 comp rx=0 tx=0).stop 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.422+0000 7f325636e640 1 -- 172.21.15.44:0/885964741 shutdown_connections 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.422+0000 7f325636e640 1 --2- 172.21.15.44:0/885964741 >> v2:172.21.15.204:3300/0 conn(0x7f32500cf160 0x7f32500cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.422+0000 7f325636e640 1 --2- 172.21.15.44:0/885964741 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f325015e430 0x7f32500cec20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.422+0000 7f325636e640 1 -- 172.21.15.44:0/885964741 >> 172.21.15.44:0/885964741 conn(0x7f325006ea20 msgr2=0x7f325006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.422+0000 7f325636e640 1 -- 172.21.15.44:0/885964741 shutdown_connections 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.422+0000 7f325636e640 1 -- 172.21.15.44:0/885964741 wait complete. 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.423+0000 7f325636e640 1 Processor -- start 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.423+0000 7f325636e640 1 -- start start 2023-11-04T01:37:53.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.424+0000 7f325636e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32500cf160 0x7f32501f12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.424+0000 7f325636e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32500d0710 0x7f32500aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.424+0000 7f325636e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f325015e430 0x7f32500a7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.424+0000 7f325636e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32500c8d70 con 0x7f325015e430 2023-11-04T01:37:53.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.424+0000 7f325636e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32501f17f0 con 0x7f32500d0710 2023-11-04T01:37:53.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.424+0000 7f325636e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32500c81f0 con 0x7f32500cf160 2023-11-04T01:37:53.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.424+0000 7f325490b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f325015e430 0x7f32500a7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.424+0000 7f325490b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f325015e430 0x7f32500a7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40532/0 (socket says 172.21.15.44:40532) 2023-11-04T01:37:53.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.424+0000 7f325490b640 1 -- 172.21.15.44:0/2013574953 learned_addr learned my addr 172.21.15.44:0/2013574953 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:53.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.424+0000 7f324ffff640 1 --2- 172.21.15.44:0/2013574953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32500cf160 0x7f32501f12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.424+0000 7f324f7fe640 1 --2- 172.21.15.44:0/2013574953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32500d0710 0x7f32500aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.425+0000 7f325490b640 1 -- 172.21.15.44:0/2013574953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32500cf160 msgr2=0x7f32501f12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.425+0000 7f325490b640 1 --2- 172.21.15.44:0/2013574953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32500cf160 0x7f32501f12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.425+0000 7f325490b640 1 -- 172.21.15.44:0/2013574953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32500d0710 msgr2=0x7f32500aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.425+0000 7f325490b640 1 --2- 172.21.15.44:0/2013574953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32500d0710 0x7f32500aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.425+0000 7f325490b640 1 -- 172.21.15.44:0/2013574953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3240009400 con 0x7f325015e430 2023-11-04T01:37:53.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.425+0000 7f325490b640 1 --2- 172.21.15.44:0/2013574953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f325015e430 0x7f32500a7b30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f324800c780 tx=0x7f324800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.425+0000 7f324cff9640 1 -- 172.21.15.44:0/2013574953 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324800ce90 con 0x7f325015e430 2023-11-04T01:37:53.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.425+0000 7f324cff9640 1 -- 172.21.15.44:0/2013574953 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324800a640 con 0x7f325015e430 2023-11-04T01:37:53.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.425+0000 7f324cff9640 1 -- 172.21.15.44:0/2013574953 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324800a9f0 con 0x7f325015e430 2023-11-04T01:37:53.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.425+0000 7f325636e640 1 -- 172.21.15.44:0/2013574953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32440094d0 con 0x7f325015e430 2023-11-04T01:37:53.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.425+0000 7f325636e640 1 -- 172.21.15.44:0/2013574953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32500c87b0 con 0x7f325015e430 2023-11-04T01:37:53.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.426+0000 7f325636e640 1 -- 172.21.15.44:0/2013574953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3250074290 con 0x7f325015e430 2023-11-04T01:37:53.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.427+0000 7f324cff9640 1 -- 172.21.15.44:0/2013574953 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f324800ab50 con 0x7f325015e430 2023-11-04T01:37:53.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.427+0000 7f324cff9640 1 --2- 172.21.15.44:0/2013574953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f323c06ae70 0x7f323c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.427+0000 7f324cff9640 1 -- 172.21.15.44:0/2013574953 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f3248088dc0 con 0x7f325015e430 2023-11-04T01:37:53.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.427+0000 7f324ffff640 1 --2- 172.21.15.44:0/2013574953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f323c06ae70 0x7f323c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.428+0000 7f324ffff640 1 --2- 172.21.15.44:0/2013574953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f323c06ae70 0x7f323c06d330 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3244036000 tx=0x7f3244008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.431+0000 7f324cff9640 1 -- 172.21.15.44:0/2013574953 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3248053e60 con 0x7f325015e430 2023-11-04T01:37:53.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:53.608+0000 7f325636e640 1 -- 172.21.15.44:0/2013574953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f32500d1960 con 0x7f325015e430 2023-11-04T01:37:54.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.294+0000 7f324cff9640 1 -- 172.21.15.44:0/2013574953 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v54) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3248017020 con 0x7f325015e430 2023-11-04T01:37:54.297 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2023-11-04T01:37:54.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.298+0000 7f325636e640 1 -- 172.21.15.44:0/2013574953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f323c06ae70 msgr2=0x7f323c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.298+0000 7f325636e640 1 --2- 172.21.15.44:0/2013574953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f323c06ae70 0x7f323c06d330 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3244036000 tx=0x7f3244008030 comp rx=0 tx=0).stop 2023-11-04T01:37:54.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.298+0000 7f325636e640 1 -- 172.21.15.44:0/2013574953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f325015e430 msgr2=0x7f32500a7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.298+0000 7f325636e640 1 --2- 172.21.15.44:0/2013574953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f325015e430 0x7f32500a7b30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f324800c780 tx=0x7f324800cc40 comp rx=0 tx=0).stop 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.299+0000 7f325636e640 1 -- 172.21.15.44:0/2013574953 shutdown_connections 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.299+0000 7f325636e640 1 --2- 172.21.15.44:0/2013574953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f323c06ae70 0x7f323c06d330 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.299+0000 7f325636e640 1 --2- 172.21.15.44:0/2013574953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f325015e430 0x7f32500a7b30 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.299+0000 7f325636e640 1 --2- 172.21.15.44:0/2013574953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32500d0710 0x7f32500aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.299+0000 7f325636e640 1 --2- 172.21.15.44:0/2013574953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32500cf160 0x7f32501f12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.299+0000 7f325636e640 1 -- 172.21.15.44:0/2013574953 >> 172.21.15.44:0/2013574953 conn(0x7f325006ea20 msgr2=0x7f32500b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:54.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.304+0000 7f325636e640 1 -- 172.21.15.44:0/2013574953 shutdown_connections 2023-11-04T01:37:54.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.306+0000 7f325636e640 1 -- 172.21.15.44:0/2013574953 wait complete. 2023-11-04T01:37:54.328 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:37:54.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.439+0000 7fe44e9e2640 1 Processor -- start 2023-11-04T01:37:54.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.439+0000 7fe44e9e2640 1 -- start start 2023-11-04T01:37:54.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.440+0000 7fe44e9e2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4480b2d30 0x7fe44806bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.440+0000 7fe44e9e2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe44806c1d0 0x7fe4480cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.440+0000 7fe44e9e2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44806ca40 con 0x7fe448160430 2023-11-04T01:37:54.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.440+0000 7fe44e9e2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4480cb580 con 0x7fe4480b2d30 2023-11-04T01:37:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.440+0000 7fe44e9e2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44806cd20 con 0x7fe44806c1d0 2023-11-04T01:37:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.440+0000 7fe4477fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4480b2d30 0x7fe44806bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.440+0000 7fe447fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe448160430 0x7fe4480b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41780/0 (socket says 172.21.15.44:41780) 2023-11-04T01:37:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.440+0000 7fe447fff640 1 -- 172.21.15.44:0/2580033340 learned_addr learned my addr 172.21.15.44:0/2580033340 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.440+0000 7fe44cf7f640 1 --2- 172.21.15.44:0/2580033340 >> v2:172.21.15.204:3300/0 conn(0x7fe44806c1d0 0x7fe4480cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.440+0000 7fe4477fe640 1 -- 172.21.15.44:0/2580033340 >> v2:172.21.15.204:3300/0 conn(0x7fe44806c1d0 msgr2=0x7fe4480cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.440+0000 7fe4477fe640 1 --2- 172.21.15.44:0/2580033340 >> v2:172.21.15.204:3300/0 conn(0x7fe44806c1d0 0x7fe4480cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.440+0000 7fe4477fe640 1 -- 172.21.15.44:0/2580033340 >> v1:172.21.15.44:6789/0 conn(0x7fe448160430 legacy=0x7fe4480b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.440+0000 7fe446ffd640 1 -- 172.21.15.44:0/2580033340 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565513440 0 0) 0x7fe44806ca40 con 0x7fe448160430 2023-11-04T01:37:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.440+0000 7fe4477fe640 1 -- 172.21.15.44:0/2580033340 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44806d000 con 0x7fe4480b2d30 2023-11-04T01:37:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.441+0000 7fe4477fe640 1 --2- 172.21.15.44:0/2580033340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4480b2d30 0x7fe44806bc90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe4380097a0 tx=0x7fe43802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e322fb1e0ea0abcb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.441+0000 7fe446ffd640 1 -- 172.21.15.44:0/2580033340 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe438031830 con 0x7fe4480b2d30 2023-11-04T01:37:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.441+0000 7fe446ffd640 1 -- 172.21.15.44:0/2580033340 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe438031990 con 0x7fe4480b2d30 2023-11-04T01:37:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.441+0000 7fe446ffd640 1 -- 172.21.15.44:0/2580033340 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe438031d20 con 0x7fe4480b2d30 2023-11-04T01:37:54.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.442+0000 7fe44e9e2640 1 -- 172.21.15.44:0/2580033340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4480b2d30 msgr2=0x7fe44806bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.442+0000 7fe44e9e2640 1 --2- 172.21.15.44:0/2580033340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4480b2d30 0x7fe44806bc90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe4380097a0 tx=0x7fe43802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.442+0000 7fe44e9e2640 1 -- 172.21.15.44:0/2580033340 shutdown_connections 2023-11-04T01:37:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.442+0000 7fe44e9e2640 1 --2- 172.21.15.44:0/2580033340 >> v2:172.21.15.204:3300/0 conn(0x7fe44806c1d0 0x7fe4480cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.442+0000 7fe44e9e2640 1 --2- 172.21.15.44:0/2580033340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4480b2d30 0x7fe44806bc90 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.442+0000 7fe44e9e2640 1 -- 172.21.15.44:0/2580033340 >> 172.21.15.44:0/2580033340 conn(0x7fe44806ea20 msgr2=0x7fe44806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.442+0000 7fe44e9e2640 1 -- 172.21.15.44:0/2580033340 shutdown_connections 2023-11-04T01:37:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.442+0000 7fe44e9e2640 1 -- 172.21.15.44:0/2580033340 wait complete. 2023-11-04T01:37:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.443+0000 7fe44e9e2640 1 Processor -- start 2023-11-04T01:37:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.443+0000 7fe44e9e2640 1 -- start start 2023-11-04T01:37:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.444+0000 7fe44e9e2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44806c1d0 0x7fe4480b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.444+0000 7fe44e9e2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4480b2d30 0x7fe4480b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.444+0000 7fe44e9e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe448160430 0x7fe4480b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.444+0000 7fe44e9e2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480b51b0 con 0x7fe448160430 2023-11-04T01:37:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.444+0000 7fe44e9e2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480c9a80 con 0x7fe4480b2d30 2023-11-04T01:37:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.444+0000 7fe44e9e2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480c9d20 con 0x7fe44806c1d0 2023-11-04T01:37:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.444+0000 7fe44cf7f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe448160430 0x7fe4480b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.444+0000 7fe44cf7f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe448160430 0x7fe4480b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40550/0 (socket says 172.21.15.44:40550) 2023-11-04T01:37:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.444+0000 7fe44cf7f640 1 -- 172.21.15.44:0/214286950 learned_addr learned my addr 172.21.15.44:0/214286950 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.444+0000 7fe447fff640 1 --2- 172.21.15.44:0/214286950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44806c1d0 0x7fe4480b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.444+0000 7fe4477fe640 1 --2- 172.21.15.44:0/214286950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4480b2d30 0x7fe4480b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.445+0000 7fe44cf7f640 1 -- 172.21.15.44:0/214286950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44806c1d0 msgr2=0x7fe4480b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.445+0000 7fe44cf7f640 1 --2- 172.21.15.44:0/214286950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44806c1d0 0x7fe4480b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.445+0000 7fe44cf7f640 1 -- 172.21.15.44:0/214286950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4480b2d30 msgr2=0x7fe4480b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.445+0000 7fe44cf7f640 1 --2- 172.21.15.44:0/214286950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4480b2d30 0x7fe4480b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.445+0000 7fe44cf7f640 1 -- 172.21.15.44:0/214286950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe438009400 con 0x7fe448160430 2023-11-04T01:37:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.445+0000 7fe4477fe640 1 --2- 172.21.15.44:0/214286950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4480b2d30 0x7fe4480b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.445+0000 7fe44cf7f640 1 --2- 172.21.15.44:0/214286950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe448160430 0x7fe4480b4c70 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe44000cc30 tx=0x7fe44000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.445+0000 7fe444ff9640 1 -- 172.21.15.44:0/214286950 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44000ce40 con 0x7fe448160430 2023-11-04T01:37:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.445+0000 7fe444ff9640 1 -- 172.21.15.44:0/214286950 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe440003990 con 0x7fe448160430 2023-11-04T01:37:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.445+0000 7fe44e9e2640 1 -- 172.21.15.44:0/214286950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4480ca000 con 0x7fe448160430 2023-11-04T01:37:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.445+0000 7fe444ff9640 1 -- 172.21.15.44:0/214286950 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe440003d20 con 0x7fe448160430 2023-11-04T01:37:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.445+0000 7fe44e9e2640 1 -- 172.21.15.44:0/214286950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4480ca5c0 con 0x7fe448160430 2023-11-04T01:37:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.446+0000 7fe44e9e2640 1 -- 172.21.15.44:0/214286950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe448074290 con 0x7fe448160430 2023-11-04T01:37:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.447+0000 7fe444ff9640 1 -- 172.21.15.44:0/214286950 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe440003e80 con 0x7fe448160430 2023-11-04T01:37:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.447+0000 7fe444ff9640 1 --2- 172.21.15.44:0/214286950 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe43406ae70 0x7fe43406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.447+0000 7fe444ff9640 1 -- 172.21.15.44:0/214286950 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6282+0+0 (secure 0 0 0) 0x7fe440089b70 con 0x7fe448160430 2023-11-04T01:37:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.447+0000 7fe447fff640 1 --2- 172.21.15.44:0/214286950 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe43406ae70 0x7fe43406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.448+0000 7fe447fff640 1 --2- 172.21.15.44:0/214286950 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe43406ae70 0x7fe43406d330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe43c000f60 tx=0x7fe43c007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.451+0000 7fe444ff9640 1 -- 172.21.15.44:0/214286950 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe440054a90 con 0x7fe448160430 2023-11-04T01:37:54.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:54.666+0000 7fe44e9e2640 1 -- 172.21.15.44:0/214286950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe4480b6b20 con 0x7fe448160430 2023-11-04T01:37:55.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.317+0000 7fe444ff9640 1 -- 172.21.15.44:0/214286950 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe44001d070 con 0x7fe448160430 2023-11-04T01:37:55.320 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 8 and data pool 9 2023-11-04T01:37:55.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.324+0000 7fe44e9e2640 1 -- 172.21.15.44:0/214286950 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe43406ae70 msgr2=0x7fe43406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.324+0000 7fe44e9e2640 1 --2- 172.21.15.44:0/214286950 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe43406ae70 0x7fe43406d330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe43c000f60 tx=0x7fe43c007d50 comp rx=0 tx=0).stop 2023-11-04T01:37:55.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.324+0000 7fe44e9e2640 1 -- 172.21.15.44:0/214286950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe448160430 msgr2=0x7fe4480b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.324+0000 7fe44e9e2640 1 --2- 172.21.15.44:0/214286950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe448160430 0x7fe4480b4c70 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe44000cc30 tx=0x7fe44000a5c0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.324+0000 7fe44e9e2640 1 -- 172.21.15.44:0/214286950 shutdown_connections 2023-11-04T01:37:55.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.324+0000 7fe44e9e2640 1 --2- 172.21.15.44:0/214286950 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe43406ae70 0x7fe43406d330 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.324+0000 7fe44e9e2640 1 --2- 172.21.15.44:0/214286950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe448160430 0x7fe4480b4c70 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.324+0000 7fe44e9e2640 1 --2- 172.21.15.44:0/214286950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4480b2d30 0x7fe4480b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.324+0000 7fe44e9e2640 1 --2- 172.21.15.44:0/214286950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44806c1d0 0x7fe4480b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.324+0000 7fe44e9e2640 1 -- 172.21.15.44:0/214286950 >> 172.21.15.44:0/214286950 conn(0x7fe44806ea20 msgr2=0x7fe4480cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.326+0000 7fe44e9e2640 1 -- 172.21.15.44:0/214286950 shutdown_connections 2023-11-04T01:37:55.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.326+0000 7fe44e9e2640 1 -- 172.21.15.44:0/214286950 wait complete. 2023-11-04T01:37:55.344 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:55.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.452+0000 7f6885d1d640 1 Processor -- start 2023-11-04T01:37:55.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.452+0000 7f6885d1d640 1 -- start start 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.453+0000 7f6885d1d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f68800b0ae0 0x7f68800ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.453+0000 7f6885d1d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68800b4110 con 0x7f6880159c70 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.453+0000 7f6885d1d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68800b43f0 con 0x7f688006db20 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.453+0000 7f6885d1d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68800b49b0 con 0x7f68800b0ae0 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.453+0000 7f687f7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6880159c70 0x7f68800b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41790/0 (socket says 172.21.15.44:41790) 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.453+0000 7f687f7fe640 1 -- 172.21.15.44:0/1041992551 learned_addr learned my addr 172.21.15.44:0/1041992551 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687effd640 1 --2- 172.21.15.44:0/1041992551 >> v2:172.21.15.204:3300/0 conn(0x7f68800b0ae0 0x7f68800ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687e7fc640 1 -- 172.21.15.44:0/1041992551 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819975004 0 0) 0x7f68800b4110 con 0x7f6880159c70 2023-11-04T01:37:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687e7fc640 1 -- 172.21.15.44:0/1041992551 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6868003520 con 0x7f6880159c70 2023-11-04T01:37:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687e7fc640 1 -- 172.21.15.44:0/1041992551 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2182695609 0 0) 0x7f6868003520 con 0x7f6880159c70 2023-11-04T01:37:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687e7fc640 1 -- 172.21.15.44:0/1041992551 >> v2:172.21.15.204:3300/0 conn(0x7f68800b0ae0 msgr2=0x7f68800ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687e7fc640 1 --2- 172.21.15.44:0/1041992551 >> v2:172.21.15.204:3300/0 conn(0x7f68800b0ae0 0x7f68800ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687e7fc640 1 -- 172.21.15.44:0/1041992551 >> v1:172.21.15.204:6789/0 conn(0x7f688006db20 legacy=0x7f688015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687e7fc640 1 -- 172.21.15.44:0/1041992551 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68800b46d0 con 0x7f6880159c70 2023-11-04T01:37:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687e7fc640 1 -- 172.21.15.44:0/1041992551 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f6870001670 con 0x7f6880159c70 2023-11-04T01:37:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687e7fc640 1 -- 172.21.15.44:0/1041992551 >> v1:172.21.15.44:6789/0 conn(0x7f6880159c70 legacy=0x7f68800b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687e7fc640 1 --2- 172.21.15.44:0/1041992551 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6868003970 0x7f6868003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687e7fc640 1 --2- 172.21.15.44:0/1041992551 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68680047c0 0x7f6868004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687e7fc640 1 --2- 172.21.15.44:0/1041992551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868005180 0x7f686800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687e7fc640 1 -- 172.21.15.44:0/1041992551 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68800b49b0 con 0x7f6868005180 2023-11-04T01:37:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687e7fc640 1 -- 172.21.15.44:0/1041992551 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686800c020 con 0x7f68680047c0 2023-11-04T01:37:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687e7fc640 1 -- 172.21.15.44:0/1041992551 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686800c1e0 con 0x7f6868003970 2023-11-04T01:37:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687ffff640 1 --2- 172.21.15.44:0/1041992551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868005180 0x7f686800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687effd640 1 --2- 172.21.15.44:0/1041992551 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68680047c0 0x7f6868004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687f7fe640 1 --2- 172.21.15.44:0/1041992551 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6868003970 0x7f6868003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687ffff640 1 -- 172.21.15.44:0/1041992551 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6868003970 msgr2=0x7f6868003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687ffff640 1 --2- 172.21.15.44:0/1041992551 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6868003970 0x7f6868003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687ffff640 1 -- 172.21.15.44:0/1041992551 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68680047c0 msgr2=0x7f6868004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.454+0000 7f687ffff640 1 --2- 172.21.15.44:0/1041992551 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68680047c0 0x7f6868004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.455+0000 7f687ffff640 1 -- 172.21.15.44:0/1041992551 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6868003520 con 0x7f6868005180 2023-11-04T01:37:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.455+0000 7f687effd640 1 --2- 172.21.15.44:0/1041992551 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68680047c0 0x7f6868004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.455+0000 7f687ffff640 1 -- 172.21.15.44:0/1041992551 reap_dead start 2023-11-04T01:37:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.455+0000 7f687ffff640 1 --2- 172.21.15.44:0/1041992551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868005180 0x7f686800b980 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6878001e50 tx=0x7f68680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716edb0b0423aec7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.455+0000 7f687e7fc640 1 -- 172.21.15.44:0/1041992551 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878003b70 con 0x7f6868005180 2023-11-04T01:37:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.455+0000 7f687e7fc640 1 -- 172.21.15.44:0/1041992551 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878003d10 con 0x7f6868005180 2023-11-04T01:37:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.455+0000 7f687e7fc640 1 -- 172.21.15.44:0/1041992551 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878005310 con 0x7f6868005180 2023-11-04T01:37:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.456+0000 7f6885d1d640 1 -- 172.21.15.44:0/1041992551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868005180 msgr2=0x7f686800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.456+0000 7f6885d1d640 1 --2- 172.21.15.44:0/1041992551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868005180 0x7f686800b980 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6878001e50 tx=0x7f68680057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.456+0000 7f6885d1d640 1 -- 172.21.15.44:0/1041992551 shutdown_connections 2023-11-04T01:37:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.456+0000 7f6885d1d640 1 --2- 172.21.15.44:0/1041992551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868005180 0x7f686800b980 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.456+0000 7f6885d1d640 1 -- 172.21.15.44:0/1041992551 >> 172.21.15.44:0/1041992551 conn(0x7f68800ce950 msgr2=0x7f68800ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.456+0000 7f6885d1d640 1 -- 172.21.15.44:0/1041992551 shutdown_connections 2023-11-04T01:37:55.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.456+0000 7f6885d1d640 1 -- 172.21.15.44:0/1041992551 wait complete. 2023-11-04T01:37:55.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.457+0000 7f6885d1d640 1 Processor -- start 2023-11-04T01:37:55.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.457+0000 7f6885d1d640 1 -- start start 2023-11-04T01:37:55.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f6885d1d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6868005180 0x7f688014bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f6885d1d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68800a9360 0x7f6880156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f6885d1d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68801f05c0 0x7f68801f0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f6885d1d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68801546e0 con 0x7f68801f05c0 2023-11-04T01:37:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f6885d1d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688014c290 con 0x7f68800a9360 2023-11-04T01:37:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f6885d1d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68800a82c0 con 0x7f6868005180 2023-11-04T01:37:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f687ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68801f05c0 0x7f68801f0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f687ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68801f05c0 0x7f68801f0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40554/0 (socket says 172.21.15.44:40554) 2023-11-04T01:37:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f687ffff640 1 -- 172.21.15.44:0/4165880413 learned_addr learned my addr 172.21.15.44:0/4165880413 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f687effd640 1 --2- 172.21.15.44:0/4165880413 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68800a9360 0x7f6880156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f687f7fe640 1 --2- 172.21.15.44:0/4165880413 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6868005180 0x7f688014bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f687ffff640 1 -- 172.21.15.44:0/4165880413 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6868005180 msgr2=0x7f688014bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f687ffff640 1 --2- 172.21.15.44:0/4165880413 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6868005180 0x7f688014bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f687ffff640 1 -- 172.21.15.44:0/4165880413 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68800a9360 msgr2=0x7f6880156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f687ffff640 1 --2- 172.21.15.44:0/4165880413 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68800a9360 0x7f6880156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.458+0000 7f687ffff640 1 -- 172.21.15.44:0/4165880413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68800a85a0 con 0x7f68801f05c0 2023-11-04T01:37:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.459+0000 7f687ffff640 1 --2- 172.21.15.44:0/4165880413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68801f05c0 0x7f68801f0a40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6878005040 tx=0x7f68780014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.459+0000 7f6867fff640 1 -- 172.21.15.44:0/4165880413 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878006d50 con 0x7f68801f05c0 2023-11-04T01:37:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.459+0000 7f6867fff640 1 -- 172.21.15.44:0/4165880413 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878007030 con 0x7f68801f05c0 2023-11-04T01:37:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.459+0000 7f6885d1d640 1 -- 172.21.15.44:0/4165880413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68800a8880 con 0x7f68801f05c0 2023-11-04T01:37:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.459+0000 7f6867fff640 1 -- 172.21.15.44:0/4165880413 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780073a0 con 0x7f68801f05c0 2023-11-04T01:37:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.459+0000 7f6885d1d640 1 -- 172.21.15.44:0/4165880413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68800a8e40 con 0x7f68801f05c0 2023-11-04T01:37:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.460+0000 7f6885d1d640 1 -- 172.21.15.44:0/4165880413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6880074290 con 0x7f68801f05c0 2023-11-04T01:37:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.460+0000 7f6867fff640 1 -- 172.21.15.44:0/4165880413 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6878007500 con 0x7f68801f05c0 2023-11-04T01:37:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.461+0000 7f6867fff640 1 --2- 172.21.15.44:0/4165880413 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f686c06ae70 0x7f686c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.461+0000 7f6867fff640 1 -- 172.21.15.44:0/4165880413 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f68780ab0c0 con 0x7f68801f05c0 2023-11-04T01:37:55.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.461+0000 7f687f7fe640 1 --2- 172.21.15.44:0/4165880413 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f686c06ae70 0x7f686c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.461+0000 7f687f7fe640 1 --2- 172.21.15.44:0/4165880413 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f686c06ae70 0x7f686c06d330 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f68700017a0 tx=0x7f6870001610 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.465+0000 7f6867fff640 1 -- 172.21.15.44:0/4165880413 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6878075fb0 con 0x7f68801f05c0 2023-11-04T01:37:55.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.641+0000 7f6885d1d640 1 -- 172.21.15.44:0/4165880413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f688006d3f0 con 0x7f68801f05c0 2023-11-04T01:37:55.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.642+0000 7f6867fff640 1 -- 172.21.15.44:0/4165880413 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18536 (secure 0 0 0) 0x7f68780795d0 con 0x7f68801f05c0 2023-11-04T01:37:55.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:55.645 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":55,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:54.668139+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:53.256647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:53.639654+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.645+0000 7f6885d1d640 1 -- 172.21.15.44:0/4165880413 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f686c06ae70 msgr2=0x7f686c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.645+0000 7f6885d1d640 1 --2- 172.21.15.44:0/4165880413 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f686c06ae70 0x7f686c06d330 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f68700017a0 tx=0x7f6870001610 comp rx=0 tx=0).stop 2023-11-04T01:37:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.645+0000 7f6885d1d640 1 -- 172.21.15.44:0/4165880413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68801f05c0 msgr2=0x7f68801f0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.645+0000 7f6885d1d640 1 --2- 172.21.15.44:0/4165880413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68801f05c0 0x7f68801f0a40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6878005040 tx=0x7f68780014a0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.645+0000 7f6885d1d640 1 -- 172.21.15.44:0/4165880413 shutdown_connections 2023-11-04T01:37:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.645+0000 7f6885d1d640 1 --2- 172.21.15.44:0/4165880413 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f686c06ae70 0x7f686c06d330 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.645+0000 7f6885d1d640 1 --2- 172.21.15.44:0/4165880413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68801f05c0 0x7f68801f0a40 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.645+0000 7f6885d1d640 1 --2- 172.21.15.44:0/4165880413 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68800a9360 0x7f6880156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.645+0000 7f6885d1d640 1 --2- 172.21.15.44:0/4165880413 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6868005180 0x7f688014bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.645+0000 7f6885d1d640 1 -- 172.21.15.44:0/4165880413 >> 172.21.15.44:0/4165880413 conn(0x7f68800ce950 msgr2=0x7f68800b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.645+0000 7f6885d1d640 1 -- 172.21.15.44:0/4165880413 shutdown_connections 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.645+0000 7f6885d1d640 1 -- 172.21.15.44:0/4165880413 wait complete. 2023-11-04T01:37:55.658 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:55.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.770+0000 7f088af76640 1 Processor -- start 2023-11-04T01:37:55.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.770+0000 7f088af76640 1 -- start start 2023-11-04T01:37:55.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.771+0000 7f088af76640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0884159c70 0x7f08840ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.771+0000 7f088af76640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08840b4110 con 0x7f08840b0ae0 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.771+0000 7f088af76640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08840b43f0 con 0x7f088406db20 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.771+0000 7f088af76640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08840b49b0 con 0x7f0884159c70 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.771+0000 7f0888d12640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0884159c70 0x7f08840ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.771+0000 7f0889513640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f08840b0ae0 0x7f088415d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41804/0 (socket says 172.21.15.44:41804) 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.771+0000 7f0889513640 1 -- 172.21.15.44:0/333363518 learned_addr learned my addr 172.21.15.44:0/333363518 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.771+0000 7f0888d12640 1 -- 172.21.15.44:0/333363518 >> v1:172.21.15.204:6789/0 conn(0x7f088406db20 legacy=0x7f08840b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.771+0000 7f0888d12640 1 -- 172.21.15.44:0/333363518 >> v1:172.21.15.44:6789/0 conn(0x7f08840b0ae0 legacy=0x7f088415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.771+0000 7f0888d12640 1 -- 172.21.15.44:0/333363518 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08840b46d0 con 0x7f0884159c70 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.771+0000 7f08837fe640 1 -- 172.21.15.44:0/333363518 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581053931 0 0) 0x7f08840b4110 con 0x7f08840b0ae0 2023-11-04T01:37:55.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.772+0000 7f0888d12640 1 --2- 172.21.15.44:0/333363518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0884159c70 0x7f08840ce370 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f08780097a0 tx=0x7f087802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58bd53e808ab5aaf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.772+0000 7f08837fe640 1 -- 172.21.15.44:0/333363518 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878031830 con 0x7f0884159c70 2023-11-04T01:37:55.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.772+0000 7f08837fe640 1 -- 172.21.15.44:0/333363518 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0878031990 con 0x7f0884159c70 2023-11-04T01:37:55.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.772+0000 7f08837fe640 1 -- 172.21.15.44:0/333363518 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878031d20 con 0x7f0884159c70 2023-11-04T01:37:55.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.773+0000 7f088af76640 1 -- 172.21.15.44:0/333363518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0884159c70 msgr2=0x7f08840ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.773+0000 7f088af76640 1 --2- 172.21.15.44:0/333363518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0884159c70 0x7f08840ce370 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f08780097a0 tx=0x7f087802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.773+0000 7f088af76640 1 -- 172.21.15.44:0/333363518 shutdown_connections 2023-11-04T01:37:55.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.773+0000 7f088af76640 1 --2- 172.21.15.44:0/333363518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0884159c70 0x7f08840ce370 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.773+0000 7f088af76640 1 -- 172.21.15.44:0/333363518 >> 172.21.15.44:0/333363518 conn(0x7f08840ce950 msgr2=0x7f08840ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.773+0000 7f088af76640 1 -- 172.21.15.44:0/333363518 shutdown_connections 2023-11-04T01:37:55.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.773+0000 7f088af76640 1 -- 172.21.15.44:0/333363518 wait complete. 2023-11-04T01:37:55.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.774+0000 7f088af76640 1 Processor -- start 2023-11-04T01:37:55.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.774+0000 7f088af76640 1 -- start start 2023-11-04T01:37:55.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f088af76640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f088406db20 0x7f0884150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f088af76640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08840b0ae0 0x7f0884151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f088af76640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0884159c70 0x7f0884070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f088af76640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08840c4c50 con 0x7f0884159c70 2023-11-04T01:37:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f088af76640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08841f7f50 con 0x7f088406db20 2023-11-04T01:37:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f088af76640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08841f7c70 con 0x7f08840b0ae0 2023-11-04T01:37:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f0889513640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0884159c70 0x7f0884070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f0889513640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0884159c70 0x7f0884070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40582/0 (socket says 172.21.15.44:40582) 2023-11-04T01:37:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f0889513640 1 -- 172.21.15.44:0/3491833893 learned_addr learned my addr 172.21.15.44:0/3491833893 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f0888d12640 1 --2- 172.21.15.44:0/3491833893 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f088406db20 0x7f0884150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f0883fff640 1 --2- 172.21.15.44:0/3491833893 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08840b0ae0 0x7f0884151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f0889513640 1 -- 172.21.15.44:0/3491833893 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08840b0ae0 msgr2=0x7f0884151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f0889513640 1 --2- 172.21.15.44:0/3491833893 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08840b0ae0 0x7f0884151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f0889513640 1 -- 172.21.15.44:0/3491833893 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f088406db20 msgr2=0x7f0884150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f0889513640 1 --2- 172.21.15.44:0/3491833893 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f088406db20 0x7f0884150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.775+0000 7f0889513640 1 -- 172.21.15.44:0/3491833893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0878009400 con 0x7f0884159c70 2023-11-04T01:37:55.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.776+0000 7f0889513640 1 --2- 172.21.15.44:0/3491833893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0884159c70 0x7f0884070710 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f087c00c7b0 tx=0x7f087c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.776+0000 7f08817fa640 1 -- 172.21.15.44:0/3491833893 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c00a640 con 0x7f0884159c70 2023-11-04T01:37:55.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.776+0000 7f08817fa640 1 -- 172.21.15.44:0/3491833893 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c00a7a0 con 0x7f0884159c70 2023-11-04T01:37:55.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.776+0000 7f088af76640 1 -- 172.21.15.44:0/3491833893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088414fcb0 con 0x7f0884159c70 2023-11-04T01:37:55.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.776+0000 7f08817fa640 1 -- 172.21.15.44:0/3491833893 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c00ab90 con 0x7f0884159c70 2023-11-04T01:37:55.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.776+0000 7f088af76640 1 -- 172.21.15.44:0/3491833893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0884150270 con 0x7f0884159c70 2023-11-04T01:37:55.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.777+0000 7f088af76640 1 -- 172.21.15.44:0/3491833893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088406df90 con 0x7f0884159c70 2023-11-04T01:37:55.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.777+0000 7f08817fa640 1 -- 172.21.15.44:0/3491833893 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f087c00acf0 con 0x7f0884159c70 2023-11-04T01:37:55.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.778+0000 7f08817fa640 1 --2- 172.21.15.44:0/3491833893 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f086806ae70 0x7f086806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.778+0000 7f08817fa640 1 -- 172.21.15.44:0/3491833893 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f087c088ff0 con 0x7f0884159c70 2023-11-04T01:37:55.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.778+0000 7f0888d12640 1 --2- 172.21.15.44:0/3491833893 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f086806ae70 0x7f086806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.779+0000 7f0888d12640 1 --2- 172.21.15.44:0/3491833893 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f086806ae70 0x7f086806d330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0878036000 tx=0x7f0878008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.782+0000 7f08817fa640 1 -- 172.21.15.44:0/3491833893 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f088406df90 con 0x7f0884159c70 2023-11-04T01:37:55.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.958+0000 7f088af76640 1 -- 172.21.15.44:0/3491833893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f088406df90 con 0x7f0884159c70 2023-11-04T01:37:55.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.959+0000 7f08817fa640 1 -- 172.21.15.44:0/3491833893 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18536 (secure 0 0 0) 0x7f088406df90 con 0x7f0884159c70 2023-11-04T01:37:55.962 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:55.962 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":55,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:54.668139+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:53.256647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:53.639654+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:55.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.961+0000 7f088af76640 1 -- 172.21.15.44:0/3491833893 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f086806ae70 msgr2=0x7f086806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.961+0000 7f088af76640 1 --2- 172.21.15.44:0/3491833893 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f086806ae70 0x7f086806d330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0878036000 tx=0x7f0878008030 comp rx=0 tx=0).stop 2023-11-04T01:37:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.961+0000 7f088af76640 1 -- 172.21.15.44:0/3491833893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0884159c70 msgr2=0x7f0884070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.961+0000 7f088af76640 1 --2- 172.21.15.44:0/3491833893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0884159c70 0x7f0884070710 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f087c00c7b0 tx=0x7f087c00cc70 comp rx=0 tx=0).stop 2023-11-04T01:37:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.961+0000 7f088af76640 1 -- 172.21.15.44:0/3491833893 shutdown_connections 2023-11-04T01:37:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.961+0000 7f088af76640 1 --2- 172.21.15.44:0/3491833893 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f086806ae70 0x7f086806d330 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.961+0000 7f088af76640 1 --2- 172.21.15.44:0/3491833893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0884159c70 0x7f0884070710 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.961+0000 7f088af76640 1 --2- 172.21.15.44:0/3491833893 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08840b0ae0 0x7f0884151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.961+0000 7f088af76640 1 --2- 172.21.15.44:0/3491833893 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f088406db20 0x7f0884150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.961+0000 7f088af76640 1 -- 172.21.15.44:0/3491833893 >> 172.21.15.44:0/3491833893 conn(0x7f08840ce950 msgr2=0x7f088415a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.961+0000 7f088af76640 1 -- 172.21.15.44:0/3491833893 shutdown_connections 2023-11-04T01:37:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:55.961+0000 7f088af76640 1 -- 172.21.15.44:0/3491833893 wait complete. 2023-11-04T01:37:55.975 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:37:56.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.082+0000 7ff30bfd0640 1 Processor -- start 2023-11-04T01:37:56.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.082+0000 7ff30bfd0640 1 -- start start 2023-11-04T01:37:56.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.083+0000 7ff30bfd0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff3040cd6d0 0x7ff304161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.083+0000 7ff30bfd0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3040b4880 0x7ff3040b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.083+0000 7ff30bfd0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3040cde60 con 0x7ff304153e60 2023-11-04T01:37:56.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.083+0000 7ff30bfd0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff304160f90 con 0x7ff3040cd6d0 2023-11-04T01:37:56.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.083+0000 7ff30bfd0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff304161960 con 0x7ff3040b4880 2023-11-04T01:37:56.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.083+0000 7ff30a56d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3040b4880 0x7ff3040b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.083+0000 7ff30956b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff3040cd6d0 0x7ff304161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.083+0000 7ff30956b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff3040cd6d0 0x7ff304161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:59928/0 (socket says 172.21.15.44:59928) 2023-11-04T01:37:56.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.083+0000 7ff30a56d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3040b4880 0x7ff3040b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:33848/0 (socket says 172.21.15.44:33848) 2023-11-04T01:37:56.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.083+0000 7ff309d6c640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7ff304153e60 0x7ff30415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:57244/0 (socket says 172.21.15.44:57244) 2023-11-04T01:37:56.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.083+0000 7ff30a56d640 1 -- 172.21.15.44:0/570118508 learned_addr learned my addr 172.21.15.44:0/570118508 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:56.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.084+0000 7ff30956b640 1 -- 172.21.15.44:0/570118508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3040b4880 msgr2=0x7ff3040b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.084+0000 7ff30956b640 1 --2- 172.21.15.44:0/570118508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3040b4880 0x7ff3040b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.084+0000 7ff30956b640 1 -- 172.21.15.44:0/570118508 >> v1:172.21.15.204:6789/0 conn(0x7ff304153e60 legacy=0x7ff30415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.084+0000 7ff308d6a640 1 -- 172.21.15.44:0/570118508 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596701819 0 0) 0x7ff3040cde60 con 0x7ff304153e60 2023-11-04T01:37:56.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.084+0000 7ff30956b640 1 -- 172.21.15.44:0/570118508 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3040b5220 con 0x7ff3040cd6d0 2023-11-04T01:37:56.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.084+0000 7ff30a56d640 1 --2- 172.21.15.44:0/570118508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3040b4880 0x7ff3040b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:56.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.085+0000 7ff30956b640 1 --2- 172.21.15.44:0/570118508 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3040cd6d0 0x7ff304161420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40097a0 tx=0x7ff2f402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b79dee54e49f2d1b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.085+0000 7ff308d6a640 1 -- 172.21.15.44:0/570118508 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f402d040 con 0x7ff3040cd6d0 2023-11-04T01:37:56.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.085+0000 7ff308d6a640 1 -- 172.21.15.44:0/570118508 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f4031810 con 0x7ff3040cd6d0 2023-11-04T01:37:56.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.085+0000 7ff308d6a640 1 -- 172.21.15.44:0/570118508 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4031ba0 con 0x7ff3040cd6d0 2023-11-04T01:37:56.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.085+0000 7ff30bfd0640 1 -- 172.21.15.44:0/570118508 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3040cd6d0 msgr2=0x7ff304161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.085+0000 7ff30bfd0640 1 --2- 172.21.15.44:0/570118508 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3040cd6d0 0x7ff304161420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40097a0 tx=0x7ff2f402b8b0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.085+0000 7ff30bfd0640 1 -- 172.21.15.44:0/570118508 shutdown_connections 2023-11-04T01:37:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.085+0000 7ff30bfd0640 1 --2- 172.21.15.44:0/570118508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3040b4880 0x7ff3040b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.085+0000 7ff30bfd0640 1 --2- 172.21.15.44:0/570118508 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3040cd6d0 0x7ff304161420 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.085+0000 7ff30bfd0640 1 -- 172.21.15.44:0/570118508 >> 172.21.15.44:0/570118508 conn(0x7ff3040cf880 msgr2=0x7ff3040cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.085+0000 7ff30bfd0640 1 -- 172.21.15.44:0/570118508 shutdown_connections 2023-11-04T01:37:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.085+0000 7ff30bfd0640 1 -- 172.21.15.44:0/570118508 wait complete. 2023-11-04T01:37:56.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.087+0000 7ff30bfd0640 1 Processor -- start 2023-11-04T01:37:56.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.087+0000 7ff30bfd0640 1 -- start start 2023-11-04T01:37:56.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.087+0000 7ff30bfd0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3040b4880 0x7ff3040cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.087+0000 7ff30bfd0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3040cd6d0 0x7ff304154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.087+0000 7ff30bfd0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff304153e60 0x7ff3041552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.087+0000 7ff30bfd0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff304155830 con 0x7ff3040b4880 2023-11-04T01:37:56.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.087+0000 7ff30bfd0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040cb730 con 0x7ff3040cd6d0 2023-11-04T01:37:56.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.087+0000 7ff30bfd0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff304155aa0 con 0x7ff304153e60 2023-11-04T01:37:56.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.087+0000 7ff309d6c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3040b4880 0x7ff3040cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.087+0000 7ff309d6c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3040b4880 0x7ff3040cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40596/0 (socket says 172.21.15.44:40596) 2023-11-04T01:37:56.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.087+0000 7ff309d6c640 1 -- 172.21.15.44:0/3531038840 learned_addr learned my addr 172.21.15.44:0/3531038840 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:56.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.088+0000 7ff30956b640 1 --2- 172.21.15.44:0/3531038840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3040cd6d0 0x7ff304154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.088+0000 7ff30a56d640 1 --2- 172.21.15.44:0/3531038840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff304153e60 0x7ff3041552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.088+0000 7ff309d6c640 1 -- 172.21.15.44:0/3531038840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff304153e60 msgr2=0x7ff3041552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.088+0000 7ff309d6c640 1 --2- 172.21.15.44:0/3531038840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff304153e60 0x7ff3041552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.088+0000 7ff309d6c640 1 -- 172.21.15.44:0/3531038840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3040cd6d0 msgr2=0x7ff304154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.088+0000 7ff309d6c640 1 --2- 172.21.15.44:0/3531038840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3040cd6d0 0x7ff304154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.088+0000 7ff309d6c640 1 -- 172.21.15.44:0/3531038840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc009b30 con 0x7ff3040b4880 2023-11-04T01:37:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.088+0000 7ff309d6c640 1 --2- 172.21.15.44:0/3531038840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3040b4880 0x7ff3040cb1f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff30000c430 tx=0x7ff30000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.088+0000 7ff2fa7fc640 1 -- 172.21.15.44:0/3531038840 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3000074e0 con 0x7ff3040b4880 2023-11-04T01:37:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.088+0000 7ff2fa7fc640 1 -- 172.21.15.44:0/3531038840 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff300007660 con 0x7ff3040b4880 2023-11-04T01:37:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.088+0000 7ff30bfd0640 1 -- 172.21.15.44:0/3531038840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f4009400 con 0x7ff3040b4880 2023-11-04T01:37:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.088+0000 7ff2fa7fc640 1 -- 172.21.15.44:0/3531038840 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300004a20 con 0x7ff3040b4880 2023-11-04T01:37:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.088+0000 7ff30bfd0640 1 -- 172.21.15.44:0/3531038840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff304158310 con 0x7ff3040b4880 2023-11-04T01:37:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.089+0000 7ff30bfd0640 1 -- 172.21.15.44:0/3531038840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff304074290 con 0x7ff3040b4880 2023-11-04T01:37:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.090+0000 7ff2fa7fc640 1 -- 172.21.15.44:0/3531038840 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff300004b80 con 0x7ff3040b4880 2023-11-04T01:37:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.090+0000 7ff2fa7fc640 1 --2- 172.21.15.44:0/3531038840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff2e806ae70 0x7ff2e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.090+0000 7ff2fa7fc640 1 -- 172.21.15.44:0/3531038840 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff300089740 con 0x7ff3040b4880 2023-11-04T01:37:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.090+0000 7ff30956b640 1 --2- 172.21.15.44:0/3531038840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff2e806ae70 0x7ff2e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.091+0000 7ff30956b640 1 --2- 172.21.15.44:0/3531038840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff2e806ae70 0x7ff2e806d330 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4036000 tx=0x7ff2f4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.094+0000 7ff2fa7fc640 1 -- 172.21.15.44:0/3531038840 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff300054550 con 0x7ff3040b4880 2023-11-04T01:37:56.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:56.313+0000 7ff30bfd0640 1 -- 172.21.15.44:0/3531038840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff3041537a0 con 0x7ff3040b4880 2023-11-04T01:37:57.285 INFO:tasks.ceph.mds.c.smithi044.stderr:2023-11-04T01:37:57.283+0000 7fb7ec1e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:37:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.321+0000 7ff2fa7fc640 1 -- 172.21.15.44:0/3531038840 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff300057b70 con 0x7ff3040b4880 2023-11-04T01:37:57.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.323+0000 7ff30bfd0640 1 -- 172.21.15.44:0/3531038840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff2e806ae70 msgr2=0x7ff2e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.323+0000 7ff30bfd0640 1 --2- 172.21.15.44:0/3531038840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff2e806ae70 0x7ff2e806d330 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4036000 tx=0x7ff2f4008030 comp rx=0 tx=0).stop 2023-11-04T01:37:57.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.323+0000 7ff30bfd0640 1 -- 172.21.15.44:0/3531038840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3040b4880 msgr2=0x7ff3040cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.323+0000 7ff30bfd0640 1 --2- 172.21.15.44:0/3531038840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3040b4880 0x7ff3040cb1f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff30000c430 tx=0x7ff30000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.324+0000 7ff30bfd0640 1 -- 172.21.15.44:0/3531038840 shutdown_connections 2023-11-04T01:37:57.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.324+0000 7ff30bfd0640 1 --2- 172.21.15.44:0/3531038840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff2e806ae70 0x7ff2e806d330 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.324+0000 7ff30bfd0640 1 --2- 172.21.15.44:0/3531038840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff304153e60 0x7ff3041552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.324+0000 7ff30bfd0640 1 --2- 172.21.15.44:0/3531038840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3040cd6d0 0x7ff304154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.324+0000 7ff30bfd0640 1 --2- 172.21.15.44:0/3531038840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3040b4880 0x7ff3040cb1f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.324+0000 7ff30bfd0640 1 -- 172.21.15.44:0/3531038840 >> 172.21.15.44:0/3531038840 conn(0x7ff3040cf880 msgr2=0x7ff3040b7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:57.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.324+0000 7ff30bfd0640 1 -- 172.21.15.44:0/3531038840 shutdown_connections 2023-11-04T01:37:57.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.324+0000 7ff30bfd0640 1 -- 172.21.15.44:0/3531038840 wait complete. 2023-11-04T01:37:57.339 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:37:57.339 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:37:57.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.452+0000 7f209d39e640 1 Processor -- start 2023-11-04T01:37:57.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.453+0000 7f209d39e640 1 -- start start 2023-11-04T01:37:57.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.453+0000 7f209d39e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2098161540 0x7f20980cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.453+0000 7f209d39e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20980cfe90 con 0x7f20980cfa20 2023-11-04T01:37:57.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.453+0000 7f209d39e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20980cdc20 con 0x7f209815ce60 2023-11-04T01:37:57.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.453+0000 7f209d39e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20980ce4c0 con 0x7f2098161540 2023-11-04T01:37:57.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f209cb9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f20980cfa20 0x7f20980d14c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41806/0 (socket says 172.21.15.44:41806) 2023-11-04T01:37:57.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f209cb9d640 1 -- 172.21.15.44:0/4155431094 learned_addr learned my addr 172.21.15.44:0/4155431094 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:57.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f20977fe640 1 --2- 172.21.15.44:0/4155431094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2098161540 0x7f20980cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2096ffd640 1 -- 172.21.15.44:0/4155431094 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705623603 0 0) 0x7f2090001490 con 0x7f20980cfa20 2023-11-04T01:37:57.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2096ffd640 1 -- 172.21.15.44:0/4155431094 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2084003520 con 0x7f20980cfa20 2023-11-04T01:37:57.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2096ffd640 1 -- 172.21.15.44:0/4155431094 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3862760584 0 0) 0x7f2084003520 con 0x7f20980cfa20 2023-11-04T01:37:57.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2096ffd640 1 -- 172.21.15.44:0/4155431094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2098161540 msgr2=0x7f20980cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:57.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2096ffd640 1 --2- 172.21.15.44:0/4155431094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2098161540 0x7f20980cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2096ffd640 1 -- 172.21.15.44:0/4155431094 >> v1:172.21.15.204:6789/0 conn(0x7f209815ce60 legacy=0x7f20980b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2096ffd640 1 -- 172.21.15.44:0/4155431094 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20980cdf00 con 0x7f20980cfa20 2023-11-04T01:37:57.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2096ffd640 1 -- 172.21.15.44:0/4155431094 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f2090001b80 con 0x7f20980cfa20 2023-11-04T01:37:57.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2096ffd640 1 -- 172.21.15.44:0/4155431094 >> v1:172.21.15.44:6789/0 conn(0x7f20980cfa20 legacy=0x7f20980d14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2096ffd640 1 --2- 172.21.15.44:0/4155431094 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20840039a0 0x7f2084003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2096ffd640 1 --2- 172.21.15.44:0/4155431094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840047c0 0x7f2084004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2096ffd640 1 --2- 172.21.15.44:0/4155431094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2098161540 0x7f2084005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2096ffd640 1 -- 172.21.15.44:0/4155431094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208400ba30 con 0x7f20840047c0 2023-11-04T01:37:57.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2096ffd640 1 -- 172.21.15.44:0/4155431094 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208400bb70 con 0x7f20840039a0 2023-11-04T01:37:57.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2096ffd640 1 -- 172.21.15.44:0/4155431094 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208400bd30 con 0x7f2098161540 2023-11-04T01:37:57.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f20977fe640 1 --2- 172.21.15.44:0/4155431094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840047c0 0x7f2084004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f2097fff640 1 --2- 172.21.15.44:0/4155431094 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20840039a0 0x7f2084003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.454+0000 7f209cb9d640 1 --2- 172.21.15.44:0/4155431094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2098161540 0x7f2084005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.455+0000 7f20977fe640 1 -- 172.21.15.44:0/4155431094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2098161540 msgr2=0x7f2084005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:57.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.455+0000 7f20977fe640 1 --2- 172.21.15.44:0/4155431094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2098161540 0x7f2084005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.455+0000 7f20977fe640 1 -- 172.21.15.44:0/4155431094 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20840039a0 msgr2=0x7f2084003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:57.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.455+0000 7f20977fe640 1 --2- 172.21.15.44:0/4155431094 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20840039a0 0x7f2084003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.455+0000 7f20977fe640 1 -- 172.21.15.44:0/4155431094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2084003520 con 0x7f20840047c0 2023-11-04T01:37:57.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.455+0000 7f20977fe640 1 --2- 172.21.15.44:0/4155431094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840047c0 0x7f2084004c40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2080009a90 tx=0x7f20840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de4ee96ea44ef06 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:57.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.455+0000 7f2096ffd640 1 -- 172.21.15.44:0/4155431094 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208002c680 con 0x7f20840047c0 2023-11-04T01:37:57.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.456+0000 7f2096ffd640 1 -- 172.21.15.44:0/4155431094 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208002c7e0 con 0x7f20840047c0 2023-11-04T01:37:57.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.456+0000 7f2096ffd640 1 -- 172.21.15.44:0/4155431094 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208002cb70 con 0x7f20840047c0 2023-11-04T01:37:57.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.456+0000 7f209d39e640 1 -- 172.21.15.44:0/4155431094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840047c0 msgr2=0x7f2084004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.456+0000 7f209d39e640 1 --2- 172.21.15.44:0/4155431094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840047c0 0x7f2084004c40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2080009a90 tx=0x7f20840057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.456+0000 7f209cb9d640 1 -- 172.21.15.44:0/4155431094 reap_dead start 2023-11-04T01:37:57.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.456+0000 7f209d39e640 1 -- 172.21.15.44:0/4155431094 shutdown_connections 2023-11-04T01:37:57.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.456+0000 7f209d39e640 1 -- 172.21.15.44:0/4155431094 >> 172.21.15.44:0/4155431094 conn(0x7f209806b4c0 msgr2=0x7f209806b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:57.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.456+0000 7f209d39e640 1 -- 172.21.15.44:0/4155431094 shutdown_connections 2023-11-04T01:37:57.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.456+0000 7f209d39e640 1 -- 172.21.15.44:0/4155431094 wait complete. 2023-11-04T01:37:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.457+0000 7f209d39e640 1 Processor -- start 2023-11-04T01:37:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.458+0000 7f209d39e640 1 -- start start 2023-11-04T01:37:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.458+0000 7f209d39e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20840047c0 0x7f209815bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.458+0000 7f209d39e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f209815d240 0x7f20981f3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.458+0000 7f209d39e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f209815fa90 0x7f209815ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.458+0000 7f209d39e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2098160450 con 0x7f209815d240 2023-11-04T01:37:57.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.458+0000 7f209d39e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209815e410 con 0x7f20840047c0 2023-11-04T01:37:57.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.458+0000 7f209d39e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20981f37c0 con 0x7f209815fa90 2023-11-04T01:37:57.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.458+0000 7f20977fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f209815d240 0x7f20981f3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f20977fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f209815d240 0x7f20981f3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40618/0 (socket says 172.21.15.44:40618) 2023-11-04T01:37:57.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f20977fe640 1 -- 172.21.15.44:0/755682637 learned_addr learned my addr 172.21.15.44:0/755682637 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:57.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f2097fff640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20840047c0 0x7f209815bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f209cb9d640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f209815fa90 0x7f209815ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f20977fe640 1 -- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f209815fa90 msgr2=0x7f209815ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f20977fe640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f209815fa90 0x7f209815ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f20977fe640 1 -- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20840047c0 msgr2=0x7f209815bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f20977fe640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20840047c0 0x7f209815bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f20977fe640 1 -- 172.21.15.44:0/755682637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209815e8a0 con 0x7f209815d240 2023-11-04T01:37:57.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f2097fff640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20840047c0 0x7f209815bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:57.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f209cb9d640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f209815fa90 0x7f209815ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:57.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f20977fe640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f209815d240 0x7f20981f3280 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f208002c220 tx=0x7f2080004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:57.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f2094ff9640 1 -- 172.21.15.44:0/755682637 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080003810 con 0x7f209815d240 2023-11-04T01:37:57.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f2094ff9640 1 -- 172.21.15.44:0/755682637 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2080003970 con 0x7f209815d240 2023-11-04T01:37:57.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f209d39e640 1 -- 172.21.15.44:0/755682637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209815d800 con 0x7f209815d240 2023-11-04T01:37:57.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f2094ff9640 1 -- 172.21.15.44:0/755682637 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080003ce0 con 0x7f209815d240 2023-11-04T01:37:57.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.459+0000 7f209d39e640 1 -- 172.21.15.44:0/755682637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209815ddc0 con 0x7f209815d240 2023-11-04T01:37:57.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.460+0000 7f209d39e640 1 -- 172.21.15.44:0/755682637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f209815e5a0 con 0x7f209815d240 2023-11-04T01:37:57.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.461+0000 7f2094ff9640 1 -- 172.21.15.44:0/755682637 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2080034440 con 0x7f209815d240 2023-11-04T01:37:57.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.461+0000 7f2094ff9640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f207806aea0 0x7f207806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.461+0000 7f2094ff9640 1 -- 172.21.15.44:0/755682637 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f20800ab710 con 0x7f209815d240 2023-11-04T01:37:57.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.462+0000 7f2097fff640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f207806aea0 0x7f207806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.462+0000 7f2097fff640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f207806aea0 0x7f207806d360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f20980b7420 tx=0x7f2088009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:57.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.465+0000 7f2094ff9640 1 -- 172.21.15.44:0/755682637 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2080076780 con 0x7f209815d240 2023-11-04T01:37:57.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:57.678+0000 7f209d39e640 1 -- 172.21.15.44:0/755682637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f209804ece0 con 0x7f209815d240 2023-11-04T01:37:58.084 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:37:58.086 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:37:58.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.329+0000 7f2094ff9640 1 -- 172.21.15.44:0/755682637 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f20800044e0 con 0x7f209815d240 2023-11-04T01:37:58.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.332+0000 7f209d39e640 1 -- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f207806aea0 msgr2=0x7f207806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.332+0000 7f209d39e640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f207806aea0 0x7f207806d360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f20980b7420 tx=0x7f2088009040 comp rx=0 tx=0).stop 2023-11-04T01:37:58.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.332+0000 7f209d39e640 1 -- 172.21.15.44:0/755682637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f209815d240 msgr2=0x7f20981f3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.332+0000 7f209d39e640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f209815d240 0x7f20981f3280 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f208002c220 tx=0x7f2080004730 comp rx=0 tx=0).stop 2023-11-04T01:37:58.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.332+0000 7f209d39e640 1 -- 172.21.15.44:0/755682637 shutdown_connections 2023-11-04T01:37:58.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.332+0000 7f209d39e640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f207806aea0 0x7f207806d360 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.332+0000 7f209d39e640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f209815fa90 0x7f209815ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.332+0000 7f209d39e640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f209815d240 0x7f20981f3280 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.332+0000 7f209d39e640 1 --2- 172.21.15.44:0/755682637 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20840047c0 0x7f209815bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.332+0000 7f209d39e640 1 -- 172.21.15.44:0/755682637 >> 172.21.15.44:0/755682637 conn(0x7f209806b4c0 msgr2=0x7f20980b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:58.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.332+0000 7f209d39e640 1 -- 172.21.15.44:0/755682637 shutdown_connections 2023-11-04T01:37:58.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.332+0000 7f209d39e640 1 -- 172.21.15.44:0/755682637 wait complete. 2023-11-04T01:37:58.347 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:37:58.348 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:58.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.459+0000 7f684f210640 1 Processor -- start 2023-11-04T01:37:58.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.459+0000 7f684f210640 1 -- start start 2023-11-04T01:37:58.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.460+0000 7f684f210640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68480cda60 0x7f68480ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.460+0000 7f684f210640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f68480b0cd0 0x7f6848070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.460+0000 7f684f210640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68480cc990 con 0x7f68480cace0 2023-11-04T01:37:58.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.460+0000 7f684f210640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68480ccc70 con 0x7f68480b0cd0 2023-11-04T01:37:58.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.460+0000 7f684f210640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68480c9ce0 con 0x7f68480cda60 2023-11-04T01:37:58.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.460+0000 7f6847fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f68480b0cd0 0x7f6848070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.460+0000 7f684cfac640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68480cda60 0x7f68480ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.460+0000 7f6847fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f68480b0cd0 0x7f6848070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:59976/0 (socket says 172.21.15.44:59976) 2023-11-04T01:37:58.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.460+0000 7f684cfac640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68480cda60 0x7f68480ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:33884/0 (socket says 172.21.15.44:33884) 2023-11-04T01:37:58.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.460+0000 7f684d7ad640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f68480cace0 0x7f684806c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:57266/0 (socket says 172.21.15.44:57266) 2023-11-04T01:37:58.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.460+0000 7f6847fff640 1 -- 172.21.15.44:0/2720371070 learned_addr learned my addr 172.21.15.44:0/2720371070 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:58.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.460+0000 7f6847fff640 1 -- 172.21.15.44:0/2720371070 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68480cda60 msgr2=0x7f68480ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:58.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.460+0000 7f6847fff640 1 --2- 172.21.15.44:0/2720371070 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68480cda60 0x7f68480ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.461+0000 7f6847fff640 1 -- 172.21.15.44:0/2720371070 >> v1:172.21.15.204:6789/0 conn(0x7f68480cace0 legacy=0x7f684806c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.461+0000 7f68477fe640 1 -- 172.21.15.44:0/2720371070 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 558777078 0 0) 0x7f68480cc990 con 0x7f68480cace0 2023-11-04T01:37:58.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.461+0000 7f6847fff640 1 -- 172.21.15.44:0/2720371070 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68480c9fc0 con 0x7f68480b0cd0 2023-11-04T01:37:58.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.461+0000 7f684cfac640 1 --2- 172.21.15.44:0/2720371070 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68480cda60 0x7f68480ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.461+0000 7f6847fff640 1 --2- 172.21.15.44:0/2720371070 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68480b0cd0 0x7f6848070630 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6834009870 tx=0x7f683402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeb8bb5d0949804b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.461+0000 7f68477fe640 1 -- 172.21.15.44:0/2720371070 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834030840 con 0x7f68480b0cd0 2023-11-04T01:37:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.462+0000 7f68477fe640 1 -- 172.21.15.44:0/2720371070 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68340309a0 con 0x7f68480b0cd0 2023-11-04T01:37:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.462+0000 7f68477fe640 1 -- 172.21.15.44:0/2720371070 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834030d30 con 0x7f68480b0cd0 2023-11-04T01:37:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.462+0000 7f684f210640 1 -- 172.21.15.44:0/2720371070 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68480b0cd0 msgr2=0x7f6848070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.462+0000 7f684f210640 1 --2- 172.21.15.44:0/2720371070 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68480b0cd0 0x7f6848070630 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6834009870 tx=0x7f683402b980 comp rx=0 tx=0).stop 2023-11-04T01:37:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.462+0000 7f684f210640 1 -- 172.21.15.44:0/2720371070 shutdown_connections 2023-11-04T01:37:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.462+0000 7f684f210640 1 --2- 172.21.15.44:0/2720371070 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68480b0cd0 0x7f6848070630 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.462+0000 7f684f210640 1 --2- 172.21.15.44:0/2720371070 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68480cda60 0x7f68480ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.462+0000 7f684f210640 1 -- 172.21.15.44:0/2720371070 >> 172.21.15.44:0/2720371070 conn(0x7f68480ce950 msgr2=0x7f68480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.462+0000 7f684f210640 1 -- 172.21.15.44:0/2720371070 shutdown_connections 2023-11-04T01:37:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.462+0000 7f684f210640 1 -- 172.21.15.44:0/2720371070 wait complete. 2023-11-04T01:37:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.463+0000 7f684f210640 1 Processor -- start 2023-11-04T01:37:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.463+0000 7f684f210640 1 -- start start 2023-11-04T01:37:58.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.464+0000 7f684f210640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68480b0cd0 0x7f68480b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.464+0000 7f684f210640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68480cace0 0x7f684814adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.464+0000 7f684f210640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68480cda60 0x7f68480b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.464+0000 7f684f210640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684814b2f0 con 0x7f68480cda60 2023-11-04T01:37:58.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.464+0000 7f684f210640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68480b2dd0 con 0x7f68480cace0 2023-11-04T01:37:58.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.464+0000 7f684f210640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68480b30b0 con 0x7f68480b0cd0 2023-11-04T01:37:58.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.464+0000 7f684d7ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68480cda60 0x7f68480b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.464+0000 7f684d7ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68480cda60 0x7f68480b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40628/0 (socket says 172.21.15.44:40628) 2023-11-04T01:37:58.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.464+0000 7f684d7ad640 1 -- 172.21.15.44:0/2799814788 learned_addr learned my addr 172.21.15.44:0/2799814788 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:58.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.465+0000 7f6847fff640 1 --2- 172.21.15.44:0/2799814788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68480cace0 0x7f684814adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.465+0000 7f684cfac640 1 --2- 172.21.15.44:0/2799814788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68480b0cd0 0x7f68480b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.465+0000 7f684d7ad640 1 -- 172.21.15.44:0/2799814788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68480b0cd0 msgr2=0x7f68480b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.465+0000 7f684d7ad640 1 --2- 172.21.15.44:0/2799814788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68480b0cd0 0x7f68480b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.465+0000 7f684d7ad640 1 -- 172.21.15.44:0/2799814788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68480cace0 msgr2=0x7f684814adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.465+0000 7f684d7ad640 1 --2- 172.21.15.44:0/2799814788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68480cace0 0x7f684814adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.465+0000 7f684d7ad640 1 -- 172.21.15.44:0/2799814788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683c009400 con 0x7f68480cda60 2023-11-04T01:37:58.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.465+0000 7f684d7ad640 1 --2- 172.21.15.44:0/2799814788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68480cda60 0x7f68480b25a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f684000ede0 tx=0x7f684000c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.465+0000 7f68457fa640 1 -- 172.21.15.44:0/2799814788 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684000ce00 con 0x7f68480cda60 2023-11-04T01:37:58.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.465+0000 7f68457fa640 1 -- 172.21.15.44:0/2799814788 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6840004b40 con 0x7f68480cda60 2023-11-04T01:37:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.465+0000 7f684f210640 1 -- 172.21.15.44:0/2799814788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68340094d0 con 0x7f68480cda60 2023-11-04T01:37:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.465+0000 7f68457fa640 1 -- 172.21.15.44:0/2799814788 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840008380 con 0x7f68480cda60 2023-11-04T01:37:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.465+0000 7f684f210640 1 -- 172.21.15.44:0/2799814788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68480b3670 con 0x7f68480cda60 2023-11-04T01:37:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.466+0000 7f684f210640 1 -- 172.21.15.44:0/2799814788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6848074290 con 0x7f68480cda60 2023-11-04T01:37:58.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.467+0000 7f68457fa640 1 -- 172.21.15.44:0/2799814788 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f68400084e0 con 0x7f68480cda60 2023-11-04T01:37:58.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.467+0000 7f68457fa640 1 --2- 172.21.15.44:0/2799814788 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f682c06ae70 0x7f682c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.467+0000 7f68457fa640 1 -- 172.21.15.44:0/2799814788 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f684008c240 con 0x7f68480cda60 2023-11-04T01:37:58.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.468+0000 7f684cfac640 1 --2- 172.21.15.44:0/2799814788 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f682c06ae70 0x7f682c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.468+0000 7f684cfac640 1 --2- 172.21.15.44:0/2799814788 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f682c06ae70 0x7f682c06d330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f683c009c30 tx=0x7f683c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.471+0000 7f68457fa640 1 -- 172.21.15.44:0/2799814788 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6840057190 con 0x7f68480cda60 2023-11-04T01:37:58.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.681+0000 7f684f210640 1 -- 172.21.15.44:0/2799814788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68480b4600 con 0x7f68480cda60 2023-11-04T01:37:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.682+0000 7f68457fa640 1 -- 172.21.15.44:0/2799814788 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f684005a7b0 con 0x7f68480cda60 2023-11-04T01:37:58.684 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:58.684 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/683817288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":683817288},{"type":"v1","addr":"172.21.15.44:6835","nonce":683817288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5306,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/4160536413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":4160536413},{"type":"v1","addr":"172.21.15.204:6836","nonce":4160536413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/1970301848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1970301848},{"type":"v1","addr":"172.21.15.204:6837","nonce":1970301848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:54.668449+0000","modified":"2023-11-04T01:37:57.680007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6834/982248126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":982248126},{"type":"v1","addr":"172.21.15.44:6834","nonce":982248126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:37:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 24 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.684+0000 7f684f210640 1 -- 172.21.15.44:0/2799814788 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f682c06ae70 msgr2=0x7f682c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.684+0000 7f684f210640 1 --2- 172.21.15.44:0/2799814788 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f682c06ae70 0x7f682c06d330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f683c009c30 tx=0x7f683c009190 comp rx=0 tx=0).stop 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.684+0000 7f684f210640 1 -- 172.21.15.44:0/2799814788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68480cda60 msgr2=0x7f68480b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.684+0000 7f684f210640 1 --2- 172.21.15.44:0/2799814788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68480cda60 0x7f68480b25a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f684000ede0 tx=0x7f684000c630 comp rx=0 tx=0).stop 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.684+0000 7f684f210640 1 -- 172.21.15.44:0/2799814788 shutdown_connections 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.684+0000 7f684f210640 1 --2- 172.21.15.44:0/2799814788 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f682c06ae70 0x7f682c06d330 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.684+0000 7f684f210640 1 --2- 172.21.15.44:0/2799814788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68480cda60 0x7f68480b25a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.684+0000 7f684f210640 1 --2- 172.21.15.44:0/2799814788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68480cace0 0x7f684814adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.684+0000 7f684f210640 1 --2- 172.21.15.44:0/2799814788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68480b0cd0 0x7f68480b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.684+0000 7f684f210640 1 -- 172.21.15.44:0/2799814788 >> 172.21.15.44:0/2799814788 conn(0x7f68480ce950 msgr2=0x7f68480af320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:58.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.684+0000 7f684f210640 1 -- 172.21.15.44:0/2799814788 shutdown_connections 2023-11-04T01:37:58.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.684+0000 7f684f210640 1 -- 172.21.15.44:0/2799814788 wait complete. 2023-11-04T01:37:58.697 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:58.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.801+0000 7f980e6af640 1 Processor -- start 2023-11-04T01:37:58.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.801+0000 7f980e6af640 1 -- start start 2023-11-04T01:37:58.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.802+0000 7f980e6af640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f980815ae40 0x7f980815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.802+0000 7f980e6af640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f98080cda30 0x7f98080ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.802+0000 7f980e6af640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98080cc450 con 0x7f98080cbc00 2023-11-04T01:37:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.802+0000 7f980e6af640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980815f400 con 0x7f980815ae40 2023-11-04T01:37:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.802+0000 7f980e6af640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980815b220 con 0x7f98080cda30 2023-11-04T01:37:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.802+0000 7f9807fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f980815ae40 0x7f980815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.802+0000 7f9807fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f980815ae40 0x7f980815bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40634/0 (socket says 172.21.15.44:40634) 2023-11-04T01:37:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.802+0000 7f9807fff640 1 -- 172.21.15.44:0/585954244 learned_addr learned my addr 172.21.15.44:0/585954244 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.802+0000 7f9807fff640 1 -- 172.21.15.44:0/585954244 >> v2:172.21.15.204:3300/0 conn(0x7f98080cda30 msgr2=0x7f98080ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.802+0000 7f980cc4c640 1 --2- 172.21.15.44:0/585954244 >> v2:172.21.15.204:3300/0 conn(0x7f98080cda30 0x7f98080ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.802+0000 7f9807fff640 1 --2- 172.21.15.44:0/585954244 >> v2:172.21.15.204:3300/0 conn(0x7f98080cda30 0x7f98080ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.802+0000 7f9807fff640 1 -- 172.21.15.44:0/585954244 >> v1:172.21.15.204:6789/0 conn(0x7f98080cbc00 legacy=0x7f98080cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:58.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.802+0000 7f9807fff640 1 -- 172.21.15.44:0/585954244 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980815f890 con 0x7f980815ae40 2023-11-04T01:37:58.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.803+0000 7f9807fff640 1 --2- 172.21.15.44:0/585954244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f980815ae40 0x7f980815bfb0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f98080ce5c0 tx=0x7f97fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb77731232f9f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.803+0000 7f9806ffd640 1 -- 172.21.15.44:0/585954244 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc031870 con 0x7f980815ae40 2023-11-04T01:37:58.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.803+0000 7f9806ffd640 1 -- 172.21.15.44:0/585954244 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc0319d0 con 0x7f980815ae40 2023-11-04T01:37:58.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.803+0000 7f9806ffd640 1 -- 172.21.15.44:0/585954244 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc031d60 con 0x7f980815ae40 2023-11-04T01:37:58.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.804+0000 7f980e6af640 1 -- 172.21.15.44:0/585954244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f980815ae40 msgr2=0x7f980815bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.804+0000 7f980e6af640 1 --2- 172.21.15.44:0/585954244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f980815ae40 0x7f980815bfb0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f98080ce5c0 tx=0x7f97fc02b910 comp rx=0 tx=0).stop 2023-11-04T01:37:58.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.804+0000 7f980e6af640 1 -- 172.21.15.44:0/585954244 shutdown_connections 2023-11-04T01:37:58.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.804+0000 7f980e6af640 1 --2- 172.21.15.44:0/585954244 >> v2:172.21.15.204:3300/0 conn(0x7f98080cda30 0x7f98080ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.804+0000 7f980e6af640 1 --2- 172.21.15.44:0/585954244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f980815ae40 0x7f980815bfb0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.804+0000 7f980e6af640 1 -- 172.21.15.44:0/585954244 >> 172.21.15.44:0/585954244 conn(0x7f980806ea90 msgr2=0x7f980806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:58.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.804+0000 7f980e6af640 1 -- 172.21.15.44:0/585954244 shutdown_connections 2023-11-04T01:37:58.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.804+0000 7f980e6af640 1 -- 172.21.15.44:0/585954244 wait complete. 2023-11-04T01:37:58.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.805+0000 7f980e6af640 1 Processor -- start 2023-11-04T01:37:58.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.805+0000 7f980e6af640 1 -- start start 2023-11-04T01:37:58.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f980e6af640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98080cbc00 0x7f98080c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f980e6af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98080cda30 0x7f98080b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f980e6af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f980815ae40 0x7f98080c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f980e6af640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98080c6820 con 0x7f98080cda30 2023-11-04T01:37:58.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f980e6af640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98080c8230 con 0x7f98080cbc00 2023-11-04T01:37:58.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f980e6af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98080c8510 con 0x7f980815ae40 2023-11-04T01:37:58.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f98077fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98080cda30 0x7f98080b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f98077fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98080cda30 0x7f98080b5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40650/0 (socket says 172.21.15.44:40650) 2023-11-04T01:37:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f98077fe640 1 -- 172.21.15.44:0/1183565230 learned_addr learned my addr 172.21.15.44:0/1183565230 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f980cc4c640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f980815ae40 0x7f98080c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f9807fff640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98080cbc00 0x7f98080c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f98077fe640 1 -- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f980815ae40 msgr2=0x7f98080c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f98077fe640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f980815ae40 0x7f98080c46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f98077fe640 1 -- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98080cbc00 msgr2=0x7f98080c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f98077fe640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98080cbc00 0x7f98080c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f98077fe640 1 -- 172.21.15.44:0/1183565230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97fc0094d0 con 0x7f98080cda30 2023-11-04T01:37:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f980cc4c640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f980815ae40 0x7f98080c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.806+0000 7f9807fff640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98080cbc00 0x7f98080c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.807+0000 7f98077fe640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98080cda30 0x7f98080b5030 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f97f800c430 tx=0x7f97f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.807+0000 7f9804ff9640 1 -- 172.21.15.44:0/1183565230 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8011790 con 0x7f98080cda30 2023-11-04T01:37:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.807+0000 7f9804ff9640 1 -- 172.21.15.44:0/1183565230 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f80118f0 con 0x7f98080cda30 2023-11-04T01:37:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.807+0000 7f980e6af640 1 -- 172.21.15.44:0/1183565230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98080c87f0 con 0x7f98080cda30 2023-11-04T01:37:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.807+0000 7f9804ff9640 1 -- 172.21.15.44:0/1183565230 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8011ce0 con 0x7f98080cda30 2023-11-04T01:37:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.807+0000 7f980e6af640 1 -- 172.21.15.44:0/1183565230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98080b0870 con 0x7f98080cda30 2023-11-04T01:37:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.808+0000 7f980e6af640 1 -- 172.21.15.44:0/1183565230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98080ce2d0 con 0x7f98080cda30 2023-11-04T01:37:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.808+0000 7f9804ff9640 1 -- 172.21.15.44:0/1183565230 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f97f801c460 con 0x7f98080cda30 2023-11-04T01:37:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.809+0000 7f9804ff9640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97f406ae70 0x7f97f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.809+0000 7f9804ff9640 1 -- 172.21.15.44:0/1183565230 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f97f80897e0 con 0x7f98080cda30 2023-11-04T01:37:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.809+0000 7f9807fff640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97f406ae70 0x7f97f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.810+0000 7f9807fff640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97f406ae70 0x7f97f406d330 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f97fc036000 tx=0x7f97fc03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.813+0000 7f9804ff9640 1 -- 172.21.15.44:0/1183565230 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97f8054680 con 0x7f98080cda30 2023-11-04T01:37:58.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.991+0000 7f980e6af640 1 -- 172.21.15.44:0/1183565230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f980806d390 con 0x7f98080cda30 2023-11-04T01:37:58.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.992+0000 7f9804ff9640 1 -- 172.21.15.44:0/1183565230 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+18523 (secure 0 0 0) 0x7f97f8057ca0 con 0x7f98080cda30 2023-11-04T01:37:58.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:58.995 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":56,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:56.297312+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:53.256647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:53.639654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:58.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.994+0000 7f980e6af640 1 -- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97f406ae70 msgr2=0x7f97f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.994+0000 7f980e6af640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97f406ae70 0x7f97f406d330 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f97fc036000 tx=0x7f97fc03c040 comp rx=0 tx=0).stop 2023-11-04T01:37:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.994+0000 7f980e6af640 1 -- 172.21.15.44:0/1183565230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98080cda30 msgr2=0x7f98080b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.994+0000 7f980e6af640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98080cda30 0x7f98080b5030 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f97f800c430 tx=0x7f97f800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.994+0000 7f980e6af640 1 -- 172.21.15.44:0/1183565230 shutdown_connections 2023-11-04T01:37:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.994+0000 7f980e6af640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97f406ae70 0x7f97f406d330 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.994+0000 7f980e6af640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f980815ae40 0x7f98080c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.994+0000 7f980e6af640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98080cda30 0x7f98080b5030 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.994+0000 7f980e6af640 1 --2- 172.21.15.44:0/1183565230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98080cbc00 0x7f98080c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.994+0000 7f980e6af640 1 -- 172.21.15.44:0/1183565230 >> 172.21.15.44:0/1183565230 conn(0x7f980806ea90 msgr2=0x7f98080b60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.994+0000 7f980e6af640 1 -- 172.21.15.44:0/1183565230 shutdown_connections 2023-11-04T01:37:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:58.994+0000 7f980e6af640 1 -- 172.21.15.44:0/1183565230 wait complete. 2023-11-04T01:37:59.008 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:37:59.008 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:59.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.114+0000 7f9cc9007640 1 Processor -- start 2023-11-04T01:37:59.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.114+0000 7f9cc9007640 1 -- start start 2023-11-04T01:37:59.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.115+0000 7f9cc9007640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9cc40ce370 0x7f9cc406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.115+0000 7f9cc9007640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc406e060 con 0x7f9cc4159c70 2023-11-04T01:37:59.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.115+0000 7f9cc9007640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc40b4110 con 0x7f9cc40b0ae0 2023-11-04T01:37:59.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.115+0000 7f9cc9007640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc40b49b0 con 0x7f9cc40ce370 2023-11-04T01:37:59.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.115+0000 7f9cc359e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9cc40ce370 0x7f9cc406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.115+0000 7f9cc2d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9cc4159c70 0x7f9cc40b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41814/0 (socket says 172.21.15.44:41814) 2023-11-04T01:37:59.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.115+0000 7f9cc2d9d640 1 -- 172.21.15.44:0/2887540564 learned_addr learned my addr 172.21.15.44:0/2887540564 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:59.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.115+0000 7f9cc259c640 1 -- 172.21.15.44:0/2887540564 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694430588 0 0) 0x7f9cc406e060 con 0x7f9cc4159c70 2023-11-04T01:37:59.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.115+0000 7f9cc259c640 1 -- 172.21.15.44:0/2887540564 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cb0003520 con 0x7f9cc4159c70 2023-11-04T01:37:59.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.115+0000 7f9cc359e640 1 -- 172.21.15.44:0/2887540564 >> v1:172.21.15.204:6789/0 conn(0x7f9cc40b0ae0 legacy=0x7f9cc415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.115+0000 7f9cc359e640 1 -- 172.21.15.44:0/2887540564 >> v1:172.21.15.44:6789/0 conn(0x7f9cc4159c70 legacy=0x7f9cc40b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.115+0000 7f9cc359e640 1 -- 172.21.15.44:0/2887540564 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc40b43f0 con 0x7f9cc40ce370 2023-11-04T01:37:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.116+0000 7f9cc359e640 1 --2- 172.21.15.44:0/2887540564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cc40ce370 0x7f9cc406db20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9cc406e1f0 tx=0x7f9cbc02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d35b7c4ee935abf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.116+0000 7f9cc259c640 1 -- 172.21.15.44:0/2887540564 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc02cce0 con 0x7f9cc40ce370 2023-11-04T01:37:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.116+0000 7f9cc259c640 1 -- 172.21.15.44:0/2887540564 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cbc02ce40 con 0x7f9cc40ce370 2023-11-04T01:37:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.116+0000 7f9cc259c640 1 -- 172.21.15.44:0/2887540564 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc034660 con 0x7f9cc40ce370 2023-11-04T01:37:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.116+0000 7f9cc9007640 1 -- 172.21.15.44:0/2887540564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cc40ce370 msgr2=0x7f9cc406db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.116+0000 7f9cc9007640 1 --2- 172.21.15.44:0/2887540564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cc40ce370 0x7f9cc406db20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9cc406e1f0 tx=0x7f9cbc02bf30 comp rx=0 tx=0).stop 2023-11-04T01:37:59.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.117+0000 7f9cc9007640 1 -- 172.21.15.44:0/2887540564 shutdown_connections 2023-11-04T01:37:59.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.117+0000 7f9cc9007640 1 --2- 172.21.15.44:0/2887540564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cc40ce370 0x7f9cc406db20 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.117+0000 7f9cc9007640 1 -- 172.21.15.44:0/2887540564 >> 172.21.15.44:0/2887540564 conn(0x7f9cc40ce950 msgr2=0x7f9cc40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:59.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.117+0000 7f9cc9007640 1 -- 172.21.15.44:0/2887540564 shutdown_connections 2023-11-04T01:37:59.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.117+0000 7f9cc9007640 1 -- 172.21.15.44:0/2887540564 wait complete. 2023-11-04T01:37:59.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.118+0000 7f9cc9007640 1 Processor -- start 2023-11-04T01:37:59.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.118+0000 7f9cc9007640 1 -- start start 2023-11-04T01:37:59.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cc9007640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9cc40b0ae0 0x7f9cc414e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cc9007640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cc40ce370 0x7f9cc415c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cc9007640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cc4159c70 0x7f9cc415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cc9007640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc40ce7e0 con 0x7f9cc40ce370 2023-11-04T01:37:59.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cc9007640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc414e6d0 con 0x7f9cc40b0ae0 2023-11-04T01:37:59.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cc9007640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc40ab980 con 0x7f9cc4159c70 2023-11-04T01:37:59.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cbbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cc40ce370 0x7f9cc415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cbbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cc40ce370 0x7f9cc415c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40672/0 (socket says 172.21.15.44:40672) 2023-11-04T01:37:59.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cbbfff640 1 -- 172.21.15.44:0/1457746329 learned_addr learned my addr 172.21.15.44:0/1457746329 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:59.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cc359e640 1 --2- 172.21.15.44:0/1457746329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cc4159c70 0x7f9cc415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cc2d9d640 1 --2- 172.21.15.44:0/1457746329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9cc40b0ae0 0x7f9cc414e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cbbfff640 1 -- 172.21.15.44:0/1457746329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cc4159c70 msgr2=0x7f9cc415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cbbfff640 1 --2- 172.21.15.44:0/1457746329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cc4159c70 0x7f9cc415cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cbbfff640 1 -- 172.21.15.44:0/1457746329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9cc40b0ae0 msgr2=0x7f9cc414e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cbbfff640 1 --2- 172.21.15.44:0/1457746329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9cc40b0ae0 0x7f9cc414e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cbbfff640 1 -- 172.21.15.44:0/1457746329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc009a70 con 0x7f9cc40ce370 2023-11-04T01:37:59.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.119+0000 7f9cbbfff640 1 --2- 172.21.15.44:0/1457746329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cc40ce370 0x7f9cc415c720 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c450 tx=0x7f9cac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.120+0000 7f9cbb7fe640 1 -- 172.21.15.44:0/1457746329 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac0052d0 con 0x7f9cc40ce370 2023-11-04T01:37:59.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.120+0000 7f9cbb7fe640 1 -- 172.21.15.44:0/1457746329 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac005430 con 0x7f9cc40ce370 2023-11-04T01:37:59.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.120+0000 7f9cc9007640 1 -- 172.21.15.44:0/1457746329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc40abc60 con 0x7f9cc40ce370 2023-11-04T01:37:59.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.120+0000 7f9cbb7fe640 1 -- 172.21.15.44:0/1457746329 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac012870 con 0x7f9cc40ce370 2023-11-04T01:37:59.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.120+0000 7f9cc9007640 1 -- 172.21.15.44:0/1457746329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc40ac220 con 0x7f9cc40ce370 2023-11-04T01:37:59.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.121+0000 7f9cc9007640 1 -- 172.21.15.44:0/1457746329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc4074290 con 0x7f9cc40ce370 2023-11-04T01:37:59.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.121+0000 7f9cbb7fe640 1 -- 172.21.15.44:0/1457746329 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9cac0129d0 con 0x7f9cc40ce370 2023-11-04T01:37:59.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.121+0000 7f9cbb7fe640 1 --2- 172.21.15.44:0/1457746329 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ca406aea0 0x7f9ca406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.121+0000 7f9cbb7fe640 1 -- 172.21.15.44:0/1457746329 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9cac089230 con 0x7f9cc40ce370 2023-11-04T01:37:59.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.122+0000 7f9cc2d9d640 1 --2- 172.21.15.44:0/1457746329 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ca406aea0 0x7f9ca406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.122+0000 7f9cc2d9d640 1 --2- 172.21.15.44:0/1457746329 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ca406aea0 0x7f9ca406d360 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40011e0 tx=0x7f9cb4007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.126+0000 7f9cbb7fe640 1 -- 172.21.15.44:0/1457746329 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9cac0540f0 con 0x7f9cc40ce370 2023-11-04T01:37:59.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.300+0000 7f9cc9007640 1 -- 172.21.15.44:0/1457746329 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9cc40cdb70 con 0x7f9ca406aea0 2023-11-04T01:37:59.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.310+0000 7f9cbb7fe640 1 -- 172.21.15.44:0/1457746329 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370525 (secure 0 0 0) 0x7f9cb4005850 con 0x7f9ca406aea0 2023-11-04T01:37:59.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:59.319 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:37:59.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.313+0000 7f9cc9007640 1 -- 172.21.15.44:0/1457746329 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ca406aea0 msgr2=0x7f9ca406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.313+0000 7f9cc9007640 1 --2- 172.21.15.44:0/1457746329 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ca406aea0 0x7f9ca406d360 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40011e0 tx=0x7f9cb4007d30 comp rx=0 tx=0).stop 2023-11-04T01:37:59.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.313+0000 7f9cc9007640 1 -- 172.21.15.44:0/1457746329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cc40ce370 msgr2=0x7f9cc415c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.313+0000 7f9cc9007640 1 --2- 172.21.15.44:0/1457746329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cc40ce370 0x7f9cc415c720 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c450 tx=0x7f9cac00c910 comp rx=0 tx=0).stop 2023-11-04T01:37:59.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.313+0000 7f9cc9007640 1 -- 172.21.15.44:0/1457746329 shutdown_connections 2023-11-04T01:37:59.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.313+0000 7f9cc9007640 1 --2- 172.21.15.44:0/1457746329 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9ca406aea0 0x7f9ca406d360 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.313+0000 7f9cc9007640 1 --2- 172.21.15.44:0/1457746329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cc4159c70 0x7f9cc415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.313+0000 7f9cc9007640 1 --2- 172.21.15.44:0/1457746329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cc40ce370 0x7f9cc415c720 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.313+0000 7f9cc9007640 1 --2- 172.21.15.44:0/1457746329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9cc40b0ae0 0x7f9cc414e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.313+0000 7f9cc9007640 1 -- 172.21.15.44:0/1457746329 >> 172.21.15.44:0/1457746329 conn(0x7f9cc40ce950 msgr2=0x7f9cc4158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:59.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.313+0000 7f9cc9007640 1 -- 172.21.15.44:0/1457746329 shutdown_connections 2023-11-04T01:37:59.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.313+0000 7f9cc9007640 1 -- 172.21.15.44:0/1457746329 wait complete. 2023-11-04T01:37:59.326 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-11-04T01:37:58.602793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222572,"kb_used_data":6364,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752148,"statfs":{"total":773094113280,"available":772866199552,"internally_reserved":0,"allocated":6516736,"data_stored":3589835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.314047"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326734+0000","last_change":"2023-11-04T01:37:55.319147+0000","last_active":"2023-11-04T01:37:56.326734+0000","last_peered":"2023-11-04T01:37:56.326734+0000","last_clean":"2023-11-04T01:37:56.326734+0000","last_became_active":"2023-11-04T01:37:55.318881+0000","last_became_peered":"2023-11-04T01:37:55.318881+0000","last_unstale":"2023-11-04T01:37:56.326734+0000","last_undegraded":"2023-11-04T01:37:56.326734+0000","last_fullsized":"2023-11-04T01:37:56.326734+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:20.247112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327690+0000","last_change":"2023-11-04T01:37:55.315754+0000","last_active":"2023-11-04T01:37:56.327690+0000","last_peered":"2023-11-04T01:37:56.327690+0000","last_clean":"2023-11-04T01:37:56.327690+0000","last_became_active":"2023-11-04T01:37:55.315469+0000","last_became_peered":"2023-11-04T01:37:55.315469+0000","last_unstale":"2023-11-04T01:37:56.327690+0000","last_undegraded":"2023-11-04T01:37:56.327690+0000","last_fullsized":"2023-11-04T01:37:56.327690+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.463657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326859+0000","last_change":"2023-11-04T01:37:55.312302+0000","last_active":"2023-11-04T01:37:56.326859+0000","last_peered":"2023-11-04T01:37:56.326859+0000","last_clean":"2023-11-04T01:37:56.326859+0000","last_became_active":"2023-11-04T01:37:55.312018+0000","last_became_peered":"2023-11-04T01:37:55.312018+0000","last_unstale":"2023-11-04T01:37:56.326859+0000","last_undegraded":"2023-11-04T01:37:56.326859+0000","last_fullsized":"2023-11-04T01:37:56.326859+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:39.265071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327482+0000","last_change":"2023-11-04T01:37:55.321717+0000","last_active":"2023-11-04T01:37:56.327482+0000","last_peered":"2023-11-04T01:37:56.327482+0000","last_clean":"2023-11-04T01:37:56.327482+0000","last_became_active":"2023-11-04T01:37:55.321460+0000","last_became_peered":"2023-11-04T01:37:55.321460+0000","last_unstale":"2023-11-04T01:37:56.327482+0000","last_undegraded":"2023-11-04T01:37:56.327482+0000","last_fullsized":"2023-11-04T01:37:56.327482+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:16.126675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326358+0000","last_change":"2023-11-04T01:37:55.313209+0000","last_active":"2023-11-04T01:37:56.326358+0000","last_peered":"2023-11-04T01:37:56.326358+0000","last_clean":"2023-11-04T01:37:56.326358+0000","last_became_active":"2023-11-04T01:37:55.312961+0000","last_became_peered":"2023-11-04T01:37:55.312961+0000","last_unstale":"2023-11-04T01:37:56.326358+0000","last_undegraded":"2023-11-04T01:37:56.326358+0000","last_fullsized":"2023-11-04T01:37:56.326358+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:14.299012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.300694+0000","last_change":"2023-11-04T01:37:55.321163+0000","last_active":"2023-11-04T01:37:56.300694+0000","last_peered":"2023-11-04T01:37:56.300694+0000","last_clean":"2023-11-04T01:37:56.300694+0000","last_became_active":"2023-11-04T01:37:55.320851+0000","last_became_peered":"2023-11-04T01:37:55.320851+0000","last_unstale":"2023-11-04T01:37:56.300694+0000","last_undegraded":"2023-11-04T01:37:56.300694+0000","last_fullsized":"2023-11-04T01:37:56.300694+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:16.126675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301584+0000","last_change":"2023-11-04T01:37:55.318259+0000","last_active":"2023-11-04T01:37:56.301584+0000","last_peered":"2023-11-04T01:37:56.301584+0000","last_clean":"2023-11-04T01:37:56.301584+0000","last_became_active":"2023-11-04T01:37:55.317971+0000","last_became_peered":"2023-11-04T01:37:55.317971+0000","last_unstale":"2023-11-04T01:37:56.301584+0000","last_undegraded":"2023-11-04T01:37:56.301584+0000","last_fullsized":"2023-11-04T01:37:56.301584+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:45.843734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326720+0000","last_change":"2023-11-04T01:37:55.310018+0000","last_active":"2023-11-04T01:37:56.326720+0000","last_peered":"2023-11-04T01:37:56.326720+0000","last_clean":"2023-11-04T01:37:56.326720+0000","last_became_active":"2023-11-04T01:37:55.309741+0000","last_became_peered":"2023-11-04T01:37:55.309741+0000","last_unstale":"2023-11-04T01:37:56.326720+0000","last_undegraded":"2023-11-04T01:37:56.326720+0000","last_fullsized":"2023-11-04T01:37:56.326720+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:19.420233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.302504+0000","last_change":"2023-11-04T01:37:55.314422+0000","last_active":"2023-11-04T01:37:56.302504+0000","last_peered":"2023-11-04T01:37:56.302504+0000","last_clean":"2023-11-04T01:37:56.302504+0000","last_became_active":"2023-11-04T01:37:55.314188+0000","last_became_peered":"2023-11-04T01:37:55.314188+0000","last_unstale":"2023-11-04T01:37:56.302504+0000","last_undegraded":"2023-11-04T01:37:56.302504+0000","last_fullsized":"2023-11-04T01:37:56.302504+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:27.282176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327052+0000","last_change":"2023-11-04T01:37:55.314746+0000","last_active":"2023-11-04T01:37:56.327052+0000","last_peered":"2023-11-04T01:37:56.327052+0000","last_clean":"2023-11-04T01:37:56.327052+0000","last_became_active":"2023-11-04T01:37:55.314484+0000","last_became_peered":"2023-11-04T01:37:55.314484+0000","last_unstale":"2023-11-04T01:37:56.327052+0000","last_undegraded":"2023-11-04T01:37:56.327052+0000","last_fullsized":"2023-11-04T01:37:56.327052+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:05:22.602635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327053+0000","last_change":"2023-11-04T01:37:55.316131+0000","last_active":"2023-11-04T01:37:56.327053+0000","last_peered":"2023-11-04T01:37:56.327053+0000","last_clean":"2023-11-04T01:37:56.327053+0000","last_became_active":"2023-11-04T01:37:55.315832+0000","last_became_peered":"2023-11-04T01:37:55.315832+0000","last_unstale":"2023-11-04T01:37:56.327053+0000","last_undegraded":"2023-11-04T01:37:56.327053+0000","last_fullsized":"2023-11-04T01:37:56.327053+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:27.282176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327224+0000","last_change":"2023-11-04T01:37:55.317452+0000","last_active":"2023-11-04T01:37:56.327224+0000","last_peered":"2023-11-04T01:37:56.327224+0000","last_clean":"2023-11-04T01:37:56.327224+0000","last_became_active":"2023-11-04T01:37:55.317229+0000","last_became_peered":"2023-11-04T01:37:55.317229+0000","last_unstale":"2023-11-04T01:37:56.327224+0000","last_undegraded":"2023-11-04T01:37:56.327224+0000","last_fullsized":"2023-11-04T01:37:56.327224+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:07.997947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.302048+0000","last_change":"2023-11-04T01:37:55.322571+0000","last_active":"2023-11-04T01:37:56.302048+0000","last_peered":"2023-11-04T01:37:56.302048+0000","last_clean":"2023-11-04T01:37:56.302048+0000","last_became_active":"2023-11-04T01:37:55.321915+0000","last_became_peered":"2023-11-04T01:37:55.321915+0000","last_unstale":"2023-11-04T01:37:56.302048+0000","last_undegraded":"2023-11-04T01:37:56.302048+0000","last_fullsized":"2023-11-04T01:37:56.302048+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:32.215751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.302378+0000","last_change":"2023-11-04T01:37:55.321111+0000","last_active":"2023-11-04T01:37:56.302378+0000","last_peered":"2023-11-04T01:37:56.302378+0000","last_clean":"2023-11-04T01:37:56.302378+0000","last_became_active":"2023-11-04T01:37:55.320751+0000","last_became_peered":"2023-11-04T01:37:55.320751+0000","last_unstale":"2023-11-04T01:37:56.302378+0000","last_undegraded":"2023-11-04T01:37:56.302378+0000","last_fullsized":"2023-11-04T01:37:56.302378+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:05:22.602635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301712+0000","last_change":"2023-11-04T01:37:55.320161+0000","last_active":"2023-11-04T01:37:56.301712+0000","last_peered":"2023-11-04T01:37:56.301712+0000","last_clean":"2023-11-04T01:37:56.301712+0000","last_became_active":"2023-11-04T01:37:55.319895+0000","last_became_peered":"2023-11-04T01:37:55.319895+0000","last_unstale":"2023-11-04T01:37:56.301712+0000","last_undegraded":"2023-11-04T01:37:56.301712+0000","last_fullsized":"2023-11-04T01:37:56.301712+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:55.384004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.300667+0000","last_change":"2023-11-04T01:37:55.317440+0000","last_active":"2023-11-04T01:37:56.300667+0000","last_peered":"2023-11-04T01:37:56.300667+0000","last_clean":"2023-11-04T01:37:56.300667+0000","last_became_active":"2023-11-04T01:37:55.317168+0000","last_became_peered":"2023-11-04T01:37:55.317168+0000","last_unstale":"2023-11-04T01:37:56.300667+0000","last_undegraded":"2023-11-04T01:37:56.300667+0000","last_fullsized":"2023-11-04T01:37:56.300667+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:28.325804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327655+0000","last_change":"2023-11-04T01:37:55.316458+0000","last_active":"2023-11-04T01:37:56.327655+0000","last_peered":"2023-11-04T01:37:56.327655+0000","last_clean":"2023-11-04T01:37:56.327655+0000","last_became_active":"2023-11-04T01:37:55.316035+0000","last_became_peered":"2023-11-04T01:37:55.316035+0000","last_unstale":"2023-11-04T01:37:56.327655+0000","last_undegraded":"2023-11-04T01:37:56.327655+0000","last_fullsized":"2023-11-04T01:37:56.327655+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:27.343001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327524+0000","last_change":"2023-11-04T01:37:55.311409+0000","last_active":"2023-11-04T01:37:56.327524+0000","last_peered":"2023-11-04T01:37:56.327524+0000","last_clean":"2023-11-04T01:37:56.327524+0000","last_became_active":"2023-11-04T01:37:55.311114+0000","last_became_peered":"2023-11-04T01:37:55.311114+0000","last_unstale":"2023-11-04T01:37:56.327524+0000","last_undegraded":"2023-11-04T01:37:56.327524+0000","last_fullsized":"2023-11-04T01:37:56.327524+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:42:09.033250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326435+0000","last_change":"2023-11-04T01:37:55.318407+0000","last_active":"2023-11-04T01:37:56.326435+0000","last_peered":"2023-11-04T01:37:56.326435+0000","last_clean":"2023-11-04T01:37:56.326435+0000","last_became_active":"2023-11-04T01:37:55.318104+0000","last_became_peered":"2023-11-04T01:37:55.318104+0000","last_unstale":"2023-11-04T01:37:56.326435+0000","last_undegraded":"2023-11-04T01:37:56.326435+0000","last_fullsized":"2023-11-04T01:37:56.326435+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:31:58.488478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327562+0000","last_change":"2023-11-04T01:37:55.319339+0000","last_active":"2023-11-04T01:37:56.327562+0000","last_peered":"2023-11-04T01:37:56.327562+0000","last_clean":"2023-11-04T01:37:56.327562+0000","last_became_active":"2023-11-04T01:37:55.319043+0000","last_became_peered":"2023-11-04T01:37:55.319043+0000","last_unstale":"2023-11-04T01:37:56.327562+0000","last_undegraded":"2023-11-04T01:37:56.327562+0000","last_fullsized":"2023-11-04T01:37:56.327562+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:02:09.768200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326933+0000","last_change":"2023-11-04T01:37:55.313098+0000","last_active":"2023-11-04T01:37:56.326933+0000","last_peered":"2023-11-04T01:37:56.326933+0000","last_clean":"2023-11-04T01:37:56.326933+0000","last_became_active":"2023-11-04T01:37:55.312844+0000","last_became_peered":"2023-11-04T01:37:55.312844+0000","last_unstale":"2023-11-04T01:37:56.326933+0000","last_undegraded":"2023-11-04T01:37:56.326933+0000","last_fullsized":"2023-11-04T01:37:56.326933+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:07.997947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327259+0000","last_change":"2023-11-04T01:37:55.306042+0000","last_active":"2023-11-04T01:37:56.327259+0000","last_peered":"2023-11-04T01:37:56.327259+0000","last_clean":"2023-11-04T01:37:56.327259+0000","last_became_active":"2023-11-04T01:37:55.305765+0000","last_became_peered":"2023-11-04T01:37:55.305765+0000","last_unstale":"2023-11-04T01:37:56.327259+0000","last_undegraded":"2023-11-04T01:37:56.327259+0000","last_fullsized":"2023-11-04T01:37:56.327259+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:38.516669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326929+0000","last_change":"2023-11-04T01:37:55.309682+0000","last_active":"2023-11-04T01:37:56.326929+0000","last_peered":"2023-11-04T01:37:56.326929+0000","last_clean":"2023-11-04T01:37:56.326929+0000","last_became_active":"2023-11-04T01:37:55.309440+0000","last_became_peered":"2023-11-04T01:37:55.309440+0000","last_unstale":"2023-11-04T01:37:56.326929+0000","last_undegraded":"2023-11-04T01:37:56.326929+0000","last_fullsized":"2023-11-04T01:37:56.326929+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:03:14.904779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301456+0000","last_change":"2023-11-04T01:37:55.318701+0000","last_active":"2023-11-04T01:37:56.301456+0000","last_peered":"2023-11-04T01:37:56.301456+0000","last_clean":"2023-11-04T01:37:56.301456+0000","last_became_active":"2023-11-04T01:37:55.318352+0000","last_became_peered":"2023-11-04T01:37:55.318352+0000","last_unstale":"2023-11-04T01:37:56.301456+0000","last_undegraded":"2023-11-04T01:37:56.301456+0000","last_fullsized":"2023-11-04T01:37:56.301456+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:42:10.569412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326725+0000","last_change":"2023-11-04T01:37:55.311983+0000","last_active":"2023-11-04T01:37:56.326725+0000","last_peered":"2023-11-04T01:37:56.326725+0000","last_clean":"2023-11-04T01:37:56.326725+0000","last_became_active":"2023-11-04T01:37:55.311661+0000","last_became_peered":"2023-11-04T01:37:55.311661+0000","last_unstale":"2023-11-04T01:37:56.326725+0000","last_undegraded":"2023-11-04T01:37:56.326725+0000","last_fullsized":"2023-11-04T01:37:56.326725+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:41.355275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327263+0000","last_change":"2023-11-04T01:37:55.318941+0000","last_active":"2023-11-04T01:37:56.327263+0000","last_peered":"2023-11-04T01:37:56.327263+0000","last_clean":"2023-11-04T01:37:56.327263+0000","last_became_active":"2023-11-04T01:37:55.318650+0000","last_became_peered":"2023-11-04T01:37:55.318650+0000","last_unstale":"2023-11-04T01:37:56.327263+0000","last_undegraded":"2023-11-04T01:37:56.327263+0000","last_fullsized":"2023-11-04T01:37:56.327263+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:56.729998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301005+0000","last_change":"2023-11-04T01:37:55.319105+0000","last_active":"2023-11-04T01:37:56.301005+0000","last_peered":"2023-11-04T01:37:56.301005+0000","last_clean":"2023-11-04T01:37:56.301005+0000","last_became_active":"2023-11-04T01:37:55.318779+0000","last_became_peered":"2023-11-04T01:37:55.318779+0000","last_unstale":"2023-11-04T01:37:56.301005+0000","last_undegraded":"2023-11-04T01:37:56.301005+0000","last_fullsized":"2023-11-04T01:37:56.301005+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:42:09.033250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326320+0000","last_change":"2023-11-04T01:37:55.320060+0000","last_active":"2023-11-04T01:37:56.326320+0000","last_peered":"2023-11-04T01:37:56.326320+0000","last_clean":"2023-11-04T01:37:56.326320+0000","last_became_active":"2023-11-04T01:37:55.319744+0000","last_became_peered":"2023-11-04T01:37:55.319744+0000","last_unstale":"2023-11-04T01:37:56.326320+0000","last_undegraded":"2023-11-04T01:37:56.326320+0000","last_fullsized":"2023-11-04T01:37:56.326320+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:42:17.081453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327757+0000","last_change":"2023-11-04T01:37:55.313090+0000","last_active":"2023-11-04T01:37:56.327757+0000","last_peered":"2023-11-04T01:37:56.327757+0000","last_clean":"2023-11-04T01:37:56.327757+0000","last_became_active":"2023-11-04T01:37:55.312818+0000","last_became_peered":"2023-11-04T01:37:55.312818+0000","last_unstale":"2023-11-04T01:37:56.327757+0000","last_undegraded":"2023-11-04T01:37:56.327757+0000","last_fullsized":"2023-11-04T01:37:56.327757+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:04.767143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326776+0000","last_change":"2023-11-04T01:37:55.314397+0000","last_active":"2023-11-04T01:37:56.326776+0000","last_peered":"2023-11-04T01:37:56.326776+0000","last_clean":"2023-11-04T01:37:56.326776+0000","last_became_active":"2023-11-04T01:37:55.314140+0000","last_became_peered":"2023-11-04T01:37:55.314140+0000","last_unstale":"2023-11-04T01:37:56.326776+0000","last_undegraded":"2023-11-04T01:37:56.326776+0000","last_fullsized":"2023-11-04T01:37:56.326776+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:43.319690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326231+0000","last_change":"2023-11-04T01:37:55.312140+0000","last_active":"2023-11-04T01:37:56.326231+0000","last_peered":"2023-11-04T01:37:56.326231+0000","last_clean":"2023-11-04T01:37:56.326231+0000","last_became_active":"2023-11-04T01:37:55.311857+0000","last_became_peered":"2023-11-04T01:37:55.311857+0000","last_unstale":"2023-11-04T01:37:56.326231+0000","last_undegraded":"2023-11-04T01:37:56.326231+0000","last_fullsized":"2023-11-04T01:37:56.326231+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:49:17.287186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.300636+0000","last_change":"2023-11-04T01:37:55.324948+0000","last_active":"2023-11-04T01:37:56.300636+0000","last_peered":"2023-11-04T01:37:56.300636+0000","last_clean":"2023-11-04T01:37:56.300636+0000","last_became_active":"2023-11-04T01:37:55.324676+0000","last_became_peered":"2023-11-04T01:37:55.324676+0000","last_unstale":"2023-11-04T01:37:56.300636+0000","last_undegraded":"2023-11-04T01:37:56.300636+0000","last_fullsized":"2023-11-04T01:37:56.300636+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:56.729998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327070+0000","last_change":"2023-11-04T01:37:55.311646+0000","last_active":"2023-11-04T01:37:56.327070+0000","last_peered":"2023-11-04T01:37:56.327070+0000","last_clean":"2023-11-04T01:37:56.327070+0000","last_became_active":"2023-11-04T01:37:55.311296+0000","last_became_peered":"2023-11-04T01:37:55.311296+0000","last_unstale":"2023-11-04T01:37:56.327070+0000","last_undegraded":"2023-11-04T01:37:56.327070+0000","last_fullsized":"2023-11-04T01:37:56.327070+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:28.325804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301602+0000","last_change":"2023-11-04T01:37:54.309942+0000","last_active":"2023-11-04T01:37:56.301602+0000","last_peered":"2023-11-04T01:37:56.301602+0000","last_clean":"2023-11-04T01:37:56.301602+0000","last_became_active":"2023-11-04T01:37:54.309674+0000","last_became_peered":"2023-11-04T01:37:54.309674+0000","last_unstale":"2023-11-04T01:37:56.301602+0000","last_undegraded":"2023-11-04T01:37:56.301602+0000","last_fullsized":"2023-11-04T01:37:56.301602+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:10.745900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.309284+0000","last_change":"2023-11-04T01:37:36.221026+0000","last_active":"2023-11-04T01:37:55.309284+0000","last_peered":"2023-11-04T01:37:55.309284+0000","last_clean":"2023-11-04T01:37:55.309284+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:37:55.309284+0000","last_undegraded":"2023-11-04T01:37:55.309284+0000","last_fullsized":"2023-11-04T01:37:55.309284+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067716399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326635+0000","last_change":"2023-11-04T01:37:55.319053+0000","last_active":"2023-11-04T01:37:56.326635+0000","last_peered":"2023-11-04T01:37:56.326635+0000","last_clean":"2023-11-04T01:37:56.326635+0000","last_became_active":"2023-11-04T01:37:55.318588+0000","last_became_peered":"2023-11-04T01:37:55.318588+0000","last_unstale":"2023-11-04T01:37:56.326635+0000","last_undegraded":"2023-11-04T01:37:56.326635+0000","last_fullsized":"2023-11-04T01:37:56.326635+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:43.319690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327624+0000","last_change":"2023-11-04T01:37:54.312565+0000","last_active":"2023-11-04T01:37:56.327624+0000","last_peered":"2023-11-04T01:37:56.327624+0000","last_clean":"2023-11-04T01:37:56.327624+0000","last_became_active":"2023-11-04T01:37:54.312308+0000","last_became_peered":"2023-11-04T01:37:54.312308+0000","last_unstale":"2023-11-04T01:37:56.327624+0000","last_undegraded":"2023-11-04T01:37:56.327624+0000","last_fullsized":"2023-11-04T01:37:56.327624+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:06.990896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.310952+0000","last_change":"2023-11-04T01:37:36.229027+0000","last_active":"2023-11-04T01:37:55.310952+0000","last_peered":"2023-11-04T01:37:55.310952+0000","last_clean":"2023-11-04T01:37:55.310952+0000","last_became_active":"2023-11-04T01:37:35.218342+0000","last_became_peered":"2023-11-04T01:37:35.218342+0000","last_unstale":"2023-11-04T01:37:55.310952+0000","last_undegraded":"2023-11-04T01:37:55.310952+0000","last_fullsized":"2023-11-04T01:37:55.310952+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059666400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327072+0000","last_change":"2023-11-04T01:37:55.309129+0000","last_active":"2023-11-04T01:37:56.327072+0000","last_peered":"2023-11-04T01:37:56.327072+0000","last_clean":"2023-11-04T01:37:56.327072+0000","last_became_active":"2023-11-04T01:37:55.308863+0000","last_became_peered":"2023-11-04T01:37:55.308863+0000","last_unstale":"2023-11-04T01:37:56.327072+0000","last_undegraded":"2023-11-04T01:37:56.327072+0000","last_fullsized":"2023-11-04T01:37:56.327072+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:16.126675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"55'8","reported_seq":20,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326634+0000","last_change":"2023-11-04T01:37:54.316253+0000","last_active":"2023-11-04T01:37:56.326634+0000","last_peered":"2023-11-04T01:37:56.326634+0000","last_clean":"2023-11-04T01:37:56.326634+0000","last_became_active":"2023-11-04T01:37:54.315961+0000","last_became_peered":"2023-11-04T01:37:54.315961+0000","last_unstale":"2023-11-04T01:37:56.326634+0000","last_undegraded":"2023-11-04T01:37:56.326634+0000","last_fullsized":"2023-11-04T01:37:56.326634+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:44.836684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.306175+0000","last_change":"2023-11-04T01:37:36.222868+0000","last_active":"2023-11-04T01:37:55.306175+0000","last_peered":"2023-11-04T01:37:55.306175+0000","last_clean":"2023-11-04T01:37:55.306175+0000","last_became_active":"2023-11-04T01:37:35.220180+0000","last_became_peered":"2023-11-04T01:37:35.220180+0000","last_unstale":"2023-11-04T01:37:55.306175+0000","last_undegraded":"2023-11-04T01:37:55.306175+0000","last_fullsized":"2023-11-04T01:37:55.306175+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001103574,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301382+0000","last_change":"2023-11-04T01:37:55.319231+0000","last_active":"2023-11-04T01:37:56.301382+0000","last_peered":"2023-11-04T01:37:56.301382+0000","last_clean":"2023-11-04T01:37:56.301382+0000","last_became_active":"2023-11-04T01:37:55.318872+0000","last_became_peered":"2023-11-04T01:37:55.318872+0000","last_unstale":"2023-11-04T01:37:56.301382+0000","last_undegraded":"2023-11-04T01:37:56.301382+0000","last_fullsized":"2023-11-04T01:37:56.301382+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:06:54.625507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326672+0000","last_change":"2023-11-04T01:37:54.308828+0000","last_active":"2023-11-04T01:37:56.326672+0000","last_peered":"2023-11-04T01:37:56.326672+0000","last_clean":"2023-11-04T01:37:56.326672+0000","last_became_active":"2023-11-04T01:37:54.308569+0000","last_became_peered":"2023-11-04T01:37:54.308569+0000","last_unstale":"2023-11-04T01:37:56.326672+0000","last_undegraded":"2023-11-04T01:37:56.326672+0000","last_fullsized":"2023-11-04T01:37:56.326672+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:55:40.555098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.305458+0000","last_change":"2023-11-04T01:37:36.221053+0000","last_active":"2023-11-04T01:37:55.305458+0000","last_peered":"2023-11-04T01:37:55.305458+0000","last_clean":"2023-11-04T01:37:55.305458+0000","last_became_active":"2023-11-04T01:37:35.227176+0000","last_became_peered":"2023-11-04T01:37:35.227176+0000","last_unstale":"2023-11-04T01:37:55.305458+0000","last_undegraded":"2023-11-04T01:37:55.305458+0000","last_fullsized":"2023-11-04T01:37:55.305458+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000594178,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327798+0000","last_change":"2023-11-04T01:37:55.309134+0000","last_active":"2023-11-04T01:37:56.327798+0000","last_peered":"2023-11-04T01:37:56.327798+0000","last_clean":"2023-11-04T01:37:56.327798+0000","last_became_active":"2023-11-04T01:37:55.308841+0000","last_became_peered":"2023-11-04T01:37:55.308841+0000","last_unstale":"2023-11-04T01:37:56.327798+0000","last_undegraded":"2023-11-04T01:37:56.327798+0000","last_fullsized":"2023-11-04T01:37:56.327798+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:41.419871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327589+0000","last_change":"2023-11-04T01:37:54.313597+0000","last_active":"2023-11-04T01:37:56.327589+0000","last_peered":"2023-11-04T01:37:56.327589+0000","last_clean":"2023-11-04T01:37:56.327589+0000","last_became_active":"2023-11-04T01:37:54.313170+0000","last_became_peered":"2023-11-04T01:37:54.313170+0000","last_unstale":"2023-11-04T01:37:56.327589+0000","last_undegraded":"2023-11-04T01:37:56.327589+0000","last_fullsized":"2023-11-04T01:37:56.327589+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:02.749026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.307187+0000","last_change":"2023-11-04T01:37:36.221842+0000","last_active":"2023-11-04T01:37:55.307187+0000","last_peered":"2023-11-04T01:37:55.307187+0000","last_clean":"2023-11-04T01:37:55.307187+0000","last_became_active":"2023-11-04T01:37:35.214305+0000","last_became_peered":"2023-11-04T01:37:35.214305+0000","last_unstale":"2023-11-04T01:37:55.307187+0000","last_undegraded":"2023-11-04T01:37:55.307187+0000","last_fullsized":"2023-11-04T01:37:55.307187+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:13:05.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014999690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.302509+0000","last_change":"2023-11-04T01:37:55.320625+0000","last_active":"2023-11-04T01:37:56.302509+0000","last_peered":"2023-11-04T01:37:56.302509+0000","last_clean":"2023-11-04T01:37:56.302509+0000","last_became_active":"2023-11-04T01:37:55.320338+0000","last_became_peered":"2023-11-04T01:37:55.320338+0000","last_unstale":"2023-11-04T01:37:56.302509+0000","last_undegraded":"2023-11-04T01:37:56.302509+0000","last_fullsized":"2023-11-04T01:37:56.302509+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:59.810743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327834+0000","last_change":"2023-11-04T01:37:54.317192+0000","last_active":"2023-11-04T01:37:56.327834+0000","last_peered":"2023-11-04T01:37:56.327834+0000","last_clean":"2023-11-04T01:37:56.327834+0000","last_became_active":"2023-11-04T01:37:54.316904+0000","last_became_peered":"2023-11-04T01:37:54.316904+0000","last_unstale":"2023-11-04T01:37:56.327834+0000","last_undegraded":"2023-11-04T01:37:56.327834+0000","last_fullsized":"2023-11-04T01:37:56.327834+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:31:31.305858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.313040+0000","last_change":"2023-11-04T01:37:36.694601+0000","last_active":"2023-11-04T01:37:55.313040+0000","last_peered":"2023-11-04T01:37:55.313040+0000","last_clean":"2023-11-04T01:37:55.313040+0000","last_became_active":"2023-11-04T01:37:35.223746+0000","last_became_peered":"2023-11-04T01:37:35.223746+0000","last_unstale":"2023-11-04T01:37:55.313040+0000","last_undegraded":"2023-11-04T01:37:55.313040+0000","last_fullsized":"2023-11-04T01:37:55.313040+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:35.960485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000555376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327422+0000","last_change":"2023-11-04T01:37:55.317719+0000","last_active":"2023-11-04T01:37:56.327422+0000","last_peered":"2023-11-04T01:37:56.327422+0000","last_clean":"2023-11-04T01:37:56.327422+0000","last_became_active":"2023-11-04T01:37:55.317431+0000","last_became_peered":"2023-11-04T01:37:55.317431+0000","last_unstale":"2023-11-04T01:37:56.327422+0000","last_undegraded":"2023-11-04T01:37:56.327422+0000","last_fullsized":"2023-11-04T01:37:56.327422+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:03.756077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"55'6","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.302538+0000","last_change":"2023-11-04T01:37:54.314000+0000","last_active":"2023-11-04T01:37:56.302538+0000","last_peered":"2023-11-04T01:37:56.302538+0000","last_clean":"2023-11-04T01:37:56.302538+0000","last_became_active":"2023-11-04T01:37:54.313674+0000","last_became_peered":"2023-11-04T01:37:54.313674+0000","last_unstale":"2023-11-04T01:37:56.302538+0000","last_undegraded":"2023-11-04T01:37:56.302538+0000","last_fullsized":"2023-11-04T01:37:56.302538+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:31.208700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.312536+0000","last_change":"2023-11-04T01:37:36.695075+0000","last_active":"2023-11-04T01:37:55.312536+0000","last_peered":"2023-11-04T01:37:55.312536+0000","last_clean":"2023-11-04T01:37:55.312536+0000","last_became_active":"2023-11-04T01:37:35.221165+0000","last_became_peered":"2023-11-04T01:37:35.221165+0000","last_unstale":"2023-11-04T01:37:55.312536+0000","last_undegraded":"2023-11-04T01:37:55.312536+0000","last_fullsized":"2023-11-04T01:37:55.312536+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:17.958372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072817499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326970+0000","last_change":"2023-11-04T01:37:55.317097+0000","last_active":"2023-11-04T01:37:56.326970+0000","last_peered":"2023-11-04T01:37:56.326970+0000","last_clean":"2023-11-04T01:37:56.326970+0000","last_became_active":"2023-11-04T01:37:55.316472+0000","last_became_peered":"2023-11-04T01:37:55.316472+0000","last_unstale":"2023-11-04T01:37:56.326970+0000","last_undegraded":"2023-11-04T01:37:56.326970+0000","last_fullsized":"2023-11-04T01:37:56.326970+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:55.384004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"55'3","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327097+0000","last_change":"2023-11-04T01:37:54.319467+0000","last_active":"2023-11-04T01:37:56.327097+0000","last_peered":"2023-11-04T01:37:56.327097+0000","last_clean":"2023-11-04T01:37:56.327097+0000","last_became_active":"2023-11-04T01:37:54.319252+0000","last_became_peered":"2023-11-04T01:37:54.319252+0000","last_unstale":"2023-11-04T01:37:56.327097+0000","last_undegraded":"2023-11-04T01:37:56.327097+0000","last_fullsized":"2023-11-04T01:37:56.327097+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:46:20.176864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.307581+0000","last_change":"2023-11-04T01:37:36.221747+0000","last_active":"2023-11-04T01:37:55.307581+0000","last_peered":"2023-11-04T01:37:55.307581+0000","last_clean":"2023-11-04T01:37:55.307581+0000","last_became_active":"2023-11-04T01:37:35.223198+0000","last_became_peered":"2023-11-04T01:37:35.223198+0000","last_unstale":"2023-11-04T01:37:55.307581+0000","last_undegraded":"2023-11-04T01:37:55.307581+0000","last_fullsized":"2023-11-04T01:37:55.307581+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097726499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327655+0000","last_change":"2023-11-04T01:37:55.316430+0000","last_active":"2023-11-04T01:37:56.327655+0000","last_peered":"2023-11-04T01:37:56.327655+0000","last_clean":"2023-11-04T01:37:56.327655+0000","last_became_active":"2023-11-04T01:37:55.316145+0000","last_became_peered":"2023-11-04T01:37:55.316145+0000","last_unstale":"2023-11-04T01:37:56.327655+0000","last_undegraded":"2023-11-04T01:37:56.327655+0000","last_fullsized":"2023-11-04T01:37:56.327655+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:26.742257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.300819+0000","last_change":"2023-11-04T01:37:54.313345+0000","last_active":"2023-11-04T01:37:56.300819+0000","last_peered":"2023-11-04T01:37:56.300819+0000","last_clean":"2023-11-04T01:37:56.300819+0000","last_became_active":"2023-11-04T01:37:54.312629+0000","last_became_peered":"2023-11-04T01:37:54.312629+0000","last_unstale":"2023-11-04T01:37:56.300819+0000","last_undegraded":"2023-11-04T01:37:56.300819+0000","last_fullsized":"2023-11-04T01:37:56.300819+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:29.806110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.301775+0000","last_change":"2023-11-04T01:37:36.422496+0000","last_active":"2023-11-04T01:37:55.301775+0000","last_peered":"2023-11-04T01:37:55.301775+0000","last_clean":"2023-11-04T01:37:55.301775+0000","last_became_active":"2023-11-04T01:37:35.221763+0000","last_became_peered":"2023-11-04T01:37:35.221763+0000","last_unstale":"2023-11-04T01:37:55.301775+0000","last_undegraded":"2023-11-04T01:37:55.301775+0000","last_fullsized":"2023-11-04T01:37:55.301775+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073676299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327389+0000","last_change":"2023-11-04T01:37:55.315869+0000","last_active":"2023-11-04T01:37:56.327389+0000","last_peered":"2023-11-04T01:37:56.327389+0000","last_clean":"2023-11-04T01:37:56.327389+0000","last_became_active":"2023-11-04T01:37:55.315565+0000","last_became_peered":"2023-11-04T01:37:55.315565+0000","last_unstale":"2023-11-04T01:37:56.327389+0000","last_undegraded":"2023-11-04T01:37:56.327389+0000","last_fullsized":"2023-11-04T01:37:56.327389+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:11.510821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.302458+0000","last_change":"2023-11-04T01:37:54.313576+0000","last_active":"2023-11-04T01:37:56.302458+0000","last_peered":"2023-11-04T01:37:56.302458+0000","last_clean":"2023-11-04T01:37:56.302458+0000","last_became_active":"2023-11-04T01:37:54.313224+0000","last_became_peered":"2023-11-04T01:37:54.313224+0000","last_unstale":"2023-11-04T01:37:56.302458+0000","last_undegraded":"2023-11-04T01:37:56.302458+0000","last_fullsized":"2023-11-04T01:37:56.302458+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:20:57.032209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.301382+0000","last_change":"2023-11-04T01:37:36.229940+0000","last_active":"2023-11-04T01:37:55.301382+0000","last_peered":"2023-11-04T01:37:55.301382+0000","last_clean":"2023-11-04T01:37:55.301382+0000","last_became_active":"2023-11-04T01:37:35.225121+0000","last_became_peered":"2023-11-04T01:37:35.225121+0000","last_unstale":"2023-11-04T01:37:55.301382+0000","last_undegraded":"2023-11-04T01:37:55.301382+0000","last_fullsized":"2023-11-04T01:37:55.301382+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:12.130671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075648399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327125+0000","last_change":"2023-11-04T01:37:55.316806+0000","last_active":"2023-11-04T01:37:56.327125+0000","last_peered":"2023-11-04T01:37:56.327125+0000","last_clean":"2023-11-04T01:37:56.327125+0000","last_became_active":"2023-11-04T01:37:55.316483+0000","last_became_peered":"2023-11-04T01:37:55.316483+0000","last_unstale":"2023-11-04T01:37:56.327125+0000","last_undegraded":"2023-11-04T01:37:56.327125+0000","last_fullsized":"2023-11-04T01:37:56.327125+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:41.757354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301980+0000","last_change":"2023-11-04T01:37:54.315437+0000","last_active":"2023-11-04T01:37:56.301980+0000","last_peered":"2023-11-04T01:37:56.301980+0000","last_clean":"2023-11-04T01:37:56.301980+0000","last_became_active":"2023-11-04T01:37:54.315159+0000","last_became_peered":"2023-11-04T01:37:54.315159+0000","last_unstale":"2023-11-04T01:37:56.301980+0000","last_undegraded":"2023-11-04T01:37:56.301980+0000","last_fullsized":"2023-11-04T01:37:56.301980+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:54:06.702017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.301302+0000","last_change":"2023-11-04T01:37:36.422801+0000","last_active":"2023-11-04T01:37:55.301302+0000","last_peered":"2023-11-04T01:37:55.301302+0000","last_clean":"2023-11-04T01:37:55.301302+0000","last_became_active":"2023-11-04T01:37:35.217091+0000","last_became_peered":"2023-11-04T01:37:35.217091+0000","last_unstale":"2023-11-04T01:37:55.301302+0000","last_undegraded":"2023-11-04T01:37:55.301302+0000","last_fullsized":"2023-11-04T01:37:55.301302+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082211999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301537+0000","last_change":"2023-11-04T01:37:55.320360+0000","last_active":"2023-11-04T01:37:56.301537+0000","last_peered":"2023-11-04T01:37:56.301537+0000","last_clean":"2023-11-04T01:37:56.301537+0000","last_became_active":"2023-11-04T01:37:55.320078+0000","last_became_peered":"2023-11-04T01:37:55.320078+0000","last_unstale":"2023-11-04T01:37:56.301537+0000","last_undegraded":"2023-11-04T01:37:56.301537+0000","last_fullsized":"2023-11-04T01:37:56.301537+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:31.951818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326577+0000","last_change":"2023-11-04T01:37:54.313354+0000","last_active":"2023-11-04T01:37:56.326577+0000","last_peered":"2023-11-04T01:37:56.326577+0000","last_clean":"2023-11-04T01:37:56.326577+0000","last_became_active":"2023-11-04T01:37:54.313063+0000","last_became_peered":"2023-11-04T01:37:54.313063+0000","last_unstale":"2023-11-04T01:37:56.326577+0000","last_undegraded":"2023-11-04T01:37:56.326577+0000","last_fullsized":"2023-11-04T01:37:56.326577+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:14.596009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.306646+0000","last_change":"2023-11-04T01:37:36.222683+0000","last_active":"2023-11-04T01:37:55.306646+0000","last_peered":"2023-11-04T01:37:55.306646+0000","last_clean":"2023-11-04T01:37:55.306646+0000","last_became_active":"2023-11-04T01:37:35.222694+0000","last_became_peered":"2023-11-04T01:37:35.222694+0000","last_unstale":"2023-11-04T01:37:55.306646+0000","last_undegraded":"2023-11-04T01:37:55.306646+0000","last_fullsized":"2023-11-04T01:37:55.306646+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000490194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327411+0000","last_change":"2023-11-04T01:37:55.319085+0000","last_active":"2023-11-04T01:37:56.327411+0000","last_peered":"2023-11-04T01:37:56.327411+0000","last_clean":"2023-11-04T01:37:56.327411+0000","last_became_active":"2023-11-04T01:37:55.318788+0000","last_became_peered":"2023-11-04T01:37:55.318788+0000","last_unstale":"2023-11-04T01:37:56.327411+0000","last_undegraded":"2023-11-04T01:37:56.327411+0000","last_fullsized":"2023-11-04T01:37:56.327411+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:53.984298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327496+0000","last_change":"2023-11-04T01:37:54.313428+0000","last_active":"2023-11-04T01:37:56.327496+0000","last_peered":"2023-11-04T01:37:56.327496+0000","last_clean":"2023-11-04T01:37:56.327496+0000","last_became_active":"2023-11-04T01:37:54.312837+0000","last_became_peered":"2023-11-04T01:37:54.312837+0000","last_unstale":"2023-11-04T01:37:56.327496+0000","last_undegraded":"2023-11-04T01:37:56.327496+0000","last_fullsized":"2023-11-04T01:37:56.327496+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:42:08.026200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.301720+0000","last_change":"2023-11-04T01:37:36.422156+0000","last_active":"2023-11-04T01:37:55.301720+0000","last_peered":"2023-11-04T01:37:55.301720+0000","last_clean":"2023-11-04T01:37:55.301720+0000","last_became_active":"2023-11-04T01:37:35.214925+0000","last_became_peered":"2023-11-04T01:37:35.214925+0000","last_unstale":"2023-11-04T01:37:55.301720+0000","last_undegraded":"2023-11-04T01:37:55.301720+0000","last_fullsized":"2023-11-04T01:37:55.301720+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058029000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301123+0000","last_change":"2023-11-04T01:37:55.320552+0000","last_active":"2023-11-04T01:37:56.301123+0000","last_peered":"2023-11-04T01:37:56.301123+0000","last_clean":"2023-11-04T01:37:56.301123+0000","last_became_active":"2023-11-04T01:37:55.320285+0000","last_became_peered":"2023-11-04T01:37:55.320285+0000","last_unstale":"2023-11-04T01:37:56.301123+0000","last_undegraded":"2023-11-04T01:37:56.301123+0000","last_fullsized":"2023-11-04T01:37:56.301123+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:41.419871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"55'4","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301191+0000","last_change":"2023-11-04T01:37:54.313329+0000","last_active":"2023-11-04T01:37:56.301191+0000","last_peered":"2023-11-04T01:37:56.301191+0000","last_clean":"2023-11-04T01:37:56.301191+0000","last_became_active":"2023-11-04T01:37:54.312982+0000","last_became_peered":"2023-11-04T01:37:54.312982+0000","last_unstale":"2023-11-04T01:37:56.301191+0000","last_undegraded":"2023-11-04T01:37:56.301191+0000","last_fullsized":"2023-11-04T01:37:56.301191+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:03:13.897729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.300310+0000","last_change":"2023-11-04T01:37:36.229258+0000","last_active":"2023-11-04T01:37:55.300310+0000","last_peered":"2023-11-04T01:37:55.300310+0000","last_clean":"2023-11-04T01:37:55.300310+0000","last_became_active":"2023-11-04T01:37:35.221720+0000","last_became_peered":"2023-11-04T01:37:35.221720+0000","last_unstale":"2023-11-04T01:37:55.300310+0000","last_undegraded":"2023-11-04T01:37:55.300310+0000","last_fullsized":"2023-11-04T01:37:55.300310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:09.633236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068644799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301406+0000","last_change":"2023-11-04T01:37:55.322064+0000","last_active":"2023-11-04T01:37:56.301406+0000","last_peered":"2023-11-04T01:37:56.301406+0000","last_clean":"2023-11-04T01:37:56.301406+0000","last_became_active":"2023-11-04T01:37:55.321810+0000","last_became_peered":"2023-11-04T01:37:55.321810+0000","last_unstale":"2023-11-04T01:37:56.301406+0000","last_undegraded":"2023-11-04T01:37:56.301406+0000","last_fullsized":"2023-11-04T01:37:56.301406+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:19.420233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327240+0000","last_change":"2023-11-04T01:37:54.314347+0000","last_active":"2023-11-04T01:37:56.327240+0000","last_peered":"2023-11-04T01:37:56.327240+0000","last_clean":"2023-11-04T01:37:56.327240+0000","last_became_active":"2023-11-04T01:37:54.313831+0000","last_became_peered":"2023-11-04T01:37:54.313831+0000","last_unstale":"2023-11-04T01:37:56.327240+0000","last_undegraded":"2023-11-04T01:37:56.327240+0000","last_fullsized":"2023-11-04T01:37:56.327240+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:29.806110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.312615+0000","last_change":"2023-11-04T01:37:36.695175+0000","last_active":"2023-11-04T01:37:55.312615+0000","last_peered":"2023-11-04T01:37:55.312615+0000","last_clean":"2023-11-04T01:37:55.312615+0000","last_became_active":"2023-11-04T01:37:35.224473+0000","last_became_peered":"2023-11-04T01:37:35.224473+0000","last_unstale":"2023-11-04T01:37:55.312615+0000","last_undegraded":"2023-11-04T01:37:55.312615+0000","last_fullsized":"2023-11-04T01:37:55.312615+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065377199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301076+0000","last_change":"2023-11-04T01:37:55.318710+0000","last_active":"2023-11-04T01:37:56.301076+0000","last_peered":"2023-11-04T01:37:56.301076+0000","last_clean":"2023-11-04T01:37:56.301076+0000","last_became_active":"2023-11-04T01:37:55.318035+0000","last_became_peered":"2023-11-04T01:37:55.318035+0000","last_unstale":"2023-11-04T01:37:56.301076+0000","last_undegraded":"2023-11-04T01:37:56.301076+0000","last_fullsized":"2023-11-04T01:37:56.301076+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:16.762583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301256+0000","last_change":"2023-11-04T01:37:54.313146+0000","last_active":"2023-11-04T01:37:56.301256+0000","last_peered":"2023-11-04T01:37:56.301256+0000","last_clean":"2023-11-04T01:37:56.301256+0000","last_became_active":"2023-11-04T01:37:54.312857+0000","last_became_peered":"2023-11-04T01:37:54.312857+0000","last_unstale":"2023-11-04T01:37:56.301256+0000","last_undegraded":"2023-11-04T01:37:56.301256+0000","last_fullsized":"2023-11-04T01:37:56.301256+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:06.990896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.304966+0000","last_change":"2023-11-04T01:37:36.222100+0000","last_active":"2023-11-04T01:37:55.304966+0000","last_peered":"2023-11-04T01:37:55.304966+0000","last_clean":"2023-11-04T01:37:55.304966+0000","last_became_active":"2023-11-04T01:37:35.219622+0000","last_became_peered":"2023-11-04T01:37:35.219622+0000","last_unstale":"2023-11-04T01:37:55.304966+0000","last_undegraded":"2023-11-04T01:37:55.304966+0000","last_fullsized":"2023-11-04T01:37:55.304966+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:16.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653496,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327222+0000","last_change":"2023-11-04T01:37:55.308533+0000","last_active":"2023-11-04T01:37:56.327222+0000","last_peered":"2023-11-04T01:37:56.327222+0000","last_clean":"2023-11-04T01:37:56.327222+0000","last_became_active":"2023-11-04T01:37:55.308246+0000","last_became_peered":"2023-11-04T01:37:55.308246+0000","last_unstale":"2023-11-04T01:37:56.327222+0000","last_undegraded":"2023-11-04T01:37:56.327222+0000","last_fullsized":"2023-11-04T01:37:56.327222+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:00.481215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.302270+0000","last_change":"2023-11-04T01:37:54.314171+0000","last_active":"2023-11-04T01:37:56.302270+0000","last_peered":"2023-11-04T01:37:56.302270+0000","last_clean":"2023-11-04T01:37:56.302270+0000","last_became_active":"2023-11-04T01:37:54.313869+0000","last_became_peered":"2023-11-04T01:37:54.313869+0000","last_unstale":"2023-11-04T01:37:56.302270+0000","last_undegraded":"2023-11-04T01:37:56.302270+0000","last_fullsized":"2023-11-04T01:37:56.302270+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:55.938602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.305354+0000","last_change":"2023-11-04T01:37:36.222451+0000","last_active":"2023-11-04T01:37:55.305354+0000","last_peered":"2023-11-04T01:37:55.305354+0000","last_clean":"2023-11-04T01:37:55.305354+0000","last_became_active":"2023-11-04T01:37:35.221090+0000","last_became_peered":"2023-11-04T01:37:35.221090+0000","last_unstale":"2023-11-04T01:37:55.305354+0000","last_undegraded":"2023-11-04T01:37:55.305354+0000","last_fullsized":"2023-11-04T01:37:55.305354+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077263799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327531+0000","last_change":"2023-11-04T01:37:55.314270+0000","last_active":"2023-11-04T01:37:56.327531+0000","last_peered":"2023-11-04T01:37:56.327531+0000","last_clean":"2023-11-04T01:37:56.327531+0000","last_became_active":"2023-11-04T01:37:55.313961+0000","last_became_peered":"2023-11-04T01:37:55.313961+0000","last_unstale":"2023-11-04T01:37:56.327531+0000","last_undegraded":"2023-11-04T01:37:56.327531+0000","last_fullsized":"2023-11-04T01:37:56.327531+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:26.038913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326674+0000","last_change":"2023-11-04T01:37:54.306752+0000","last_active":"2023-11-04T01:37:56.326674+0000","last_peered":"2023-11-04T01:37:56.326674+0000","last_clean":"2023-11-04T01:37:56.326674+0000","last_became_active":"2023-11-04T01:37:54.306427+0000","last_became_peered":"2023-11-04T01:37:54.306427+0000","last_unstale":"2023-11-04T01:37:56.326674+0000","last_undegraded":"2023-11-04T01:37:56.326674+0000","last_fullsized":"2023-11-04T01:37:56.326674+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:46.187528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.305102+0000","last_change":"2023-11-04T01:37:36.222643+0000","last_active":"2023-11-04T01:37:55.305102+0000","last_peered":"2023-11-04T01:37:55.305102+0000","last_clean":"2023-11-04T01:37:55.305102+0000","last_became_active":"2023-11-04T01:37:35.215534+0000","last_became_peered":"2023-11-04T01:37:35.215534+0000","last_unstale":"2023-11-04T01:37:55.305102+0000","last_undegraded":"2023-11-04T01:37:55.305102+0000","last_fullsized":"2023-11-04T01:37:55.305102+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011110530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327262+0000","last_change":"2023-11-04T01:37:55.311770+0000","last_active":"2023-11-04T01:37:56.327262+0000","last_peered":"2023-11-04T01:37:56.327262+0000","last_clean":"2023-11-04T01:37:56.327262+0000","last_became_active":"2023-11-04T01:37:55.311455+0000","last_became_peered":"2023-11-04T01:37:55.311455+0000","last_unstale":"2023-11-04T01:37:56.327262+0000","last_undegraded":"2023-11-04T01:37:56.327262+0000","last_fullsized":"2023-11-04T01:37:56.327262+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:48:20.516213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326600+0000","last_change":"2023-11-04T01:37:54.313034+0000","last_active":"2023-11-04T01:37:56.326600+0000","last_peered":"2023-11-04T01:37:56.326600+0000","last_clean":"2023-11-04T01:37:56.326600+0000","last_became_active":"2023-11-04T01:37:54.312761+0000","last_became_peered":"2023-11-04T01:37:54.312761+0000","last_unstale":"2023-11-04T01:37:56.326600+0000","last_undegraded":"2023-11-04T01:37:56.326600+0000","last_fullsized":"2023-11-04T01:37:56.326600+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:14.596009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.313643+0000","last_change":"2023-11-04T01:37:36.695402+0000","last_active":"2023-11-04T01:37:55.313643+0000","last_peered":"2023-11-04T01:37:55.313643+0000","last_clean":"2023-11-04T01:37:55.313643+0000","last_became_active":"2023-11-04T01:37:35.220346+0000","last_became_peered":"2023-11-04T01:37:35.220346+0000","last_unstale":"2023-11-04T01:37:55.313643+0000","last_undegraded":"2023-11-04T01:37:55.313643+0000","last_fullsized":"2023-11-04T01:37:55.313643+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062230100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326432+0000","last_change":"2023-11-04T01:37:55.315450+0000","last_active":"2023-11-04T01:37:56.326432+0000","last_peered":"2023-11-04T01:37:56.326432+0000","last_clean":"2023-11-04T01:37:56.326432+0000","last_became_active":"2023-11-04T01:37:55.315173+0000","last_became_peered":"2023-11-04T01:37:55.315173+0000","last_unstale":"2023-11-04T01:37:56.326432+0000","last_undegraded":"2023-11-04T01:37:56.326432+0000","last_fullsized":"2023-11-04T01:37:56.326432+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:45.843734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326528+0000","last_change":"2023-11-04T01:37:54.310743+0000","last_active":"2023-11-04T01:37:56.326528+0000","last_peered":"2023-11-04T01:37:56.326528+0000","last_clean":"2023-11-04T01:37:56.326528+0000","last_became_active":"2023-11-04T01:37:54.310437+0000","last_became_peered":"2023-11-04T01:37:54.310437+0000","last_unstale":"2023-11-04T01:37:56.326528+0000","last_undegraded":"2023-11-04T01:37:56.326528+0000","last_fullsized":"2023-11-04T01:37:56.326528+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:55.938602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":30,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.301873+0000","last_change":"2023-11-04T01:37:36.426315+0000","last_active":"2023-11-04T01:37:55.301873+0000","last_peered":"2023-11-04T01:37:55.301873+0000","last_clean":"2023-11-04T01:37:55.301873+0000","last_became_active":"2023-11-04T01:37:35.223958+0000","last_became_peered":"2023-11-04T01:37:35.223958+0000","last_unstale":"2023-11-04T01:37:55.301873+0000","last_undegraded":"2023-11-04T01:37:55.301873+0000","last_fullsized":"2023-11-04T01:37:55.301873+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:46.733116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025167400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327651+0000","last_change":"2023-11-04T01:37:55.322278+0000","last_active":"2023-11-04T01:37:56.327651+0000","last_peered":"2023-11-04T01:37:56.327651+0000","last_clean":"2023-11-04T01:37:56.327651+0000","last_became_active":"2023-11-04T01:37:55.321982+0000","last_became_peered":"2023-11-04T01:37:55.321982+0000","last_unstale":"2023-11-04T01:37:56.327651+0000","last_undegraded":"2023-11-04T01:37:56.327651+0000","last_fullsized":"2023-11-04T01:37:56.327651+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:00.481215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301398+0000","last_change":"2023-11-04T01:37:54.313085+0000","last_active":"2023-11-04T01:37:56.301398+0000","last_peered":"2023-11-04T01:37:56.301398+0000","last_clean":"2023-11-04T01:37:56.301398+0000","last_became_active":"2023-11-04T01:37:54.312779+0000","last_became_peered":"2023-11-04T01:37:54.312779+0000","last_unstale":"2023-11-04T01:37:56.301398+0000","last_undegraded":"2023-11-04T01:37:56.301398+0000","last_fullsized":"2023-11-04T01:37:56.301398+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:42.312639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.312939+0000","last_change":"2023-11-04T01:37:36.694540+0000","last_active":"2023-11-04T01:37:55.312939+0000","last_peered":"2023-11-04T01:37:55.312939+0000","last_clean":"2023-11-04T01:37:55.312939+0000","last_became_active":"2023-11-04T01:37:35.225863+0000","last_became_peered":"2023-11-04T01:37:35.225863+0000","last_unstale":"2023-11-04T01:37:55.312939+0000","last_undegraded":"2023-11-04T01:37:55.312939+0000","last_fullsized":"2023-11-04T01:37:55.312939+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:42.654853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042277299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327384+0000","last_change":"2023-11-04T01:37:55.321381+0000","last_active":"2023-11-04T01:37:56.327384+0000","last_peered":"2023-11-04T01:37:56.327384+0000","last_clean":"2023-11-04T01:37:56.327384+0000","last_became_active":"2023-11-04T01:37:55.321106+0000","last_became_peered":"2023-11-04T01:37:55.321106+0000","last_unstale":"2023-11-04T01:37:56.327384+0000","last_undegraded":"2023-11-04T01:37:56.327384+0000","last_fullsized":"2023-11-04T01:37:56.327384+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:28.325804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327502+0000","last_change":"2023-11-04T01:37:54.313697+0000","last_active":"2023-11-04T01:37:56.327502+0000","last_peered":"2023-11-04T01:37:56.327502+0000","last_clean":"2023-11-04T01:37:56.327502+0000","last_became_active":"2023-11-04T01:37:54.313440+0000","last_became_peered":"2023-11-04T01:37:54.313440+0000","last_unstale":"2023-11-04T01:37:56.327502+0000","last_undegraded":"2023-11-04T01:37:56.327502+0000","last_fullsized":"2023-11-04T01:37:56.327502+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:31.208700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.301679+0000","last_change":"2023-11-04T01:37:36.426202+0000","last_active":"2023-11-04T01:37:55.301679+0000","last_peered":"2023-11-04T01:37:55.301679+0000","last_clean":"2023-11-04T01:37:55.301679+0000","last_became_active":"2023-11-04T01:37:35.222997+0000","last_became_peered":"2023-11-04T01:37:35.222997+0000","last_unstale":"2023-11-04T01:37:55.301679+0000","last_undegraded":"2023-11-04T01:37:55.301679+0000","last_fullsized":"2023-11-04T01:37:55.301679+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:18.980751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041393700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301128+0000","last_change":"2023-11-04T01:37:55.322718+0000","last_active":"2023-11-04T01:37:56.301128+0000","last_peered":"2023-11-04T01:37:56.301128+0000","last_clean":"2023-11-04T01:37:56.301128+0000","last_became_active":"2023-11-04T01:37:55.322424+0000","last_became_peered":"2023-11-04T01:37:55.322424+0000","last_unstale":"2023-11-04T01:37:56.301128+0000","last_undegraded":"2023-11-04T01:37:56.301128+0000","last_fullsized":"2023-11-04T01:37:56.301128+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:46.960958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327303+0000","last_change":"2023-11-04T01:37:54.313128+0000","last_active":"2023-11-04T01:37:56.327303+0000","last_peered":"2023-11-04T01:37:56.327303+0000","last_clean":"2023-11-04T01:37:56.327303+0000","last_became_active":"2023-11-04T01:37:54.312849+0000","last_became_peered":"2023-11-04T01:37:54.312849+0000","last_unstale":"2023-11-04T01:37:56.327303+0000","last_undegraded":"2023-11-04T01:37:56.327303+0000","last_fullsized":"2023-11-04T01:37:56.327303+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:30.142280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.304385+0000","last_change":"2023-11-04T01:37:36.220713+0000","last_active":"2023-11-04T01:37:55.304385+0000","last_peered":"2023-11-04T01:37:55.304385+0000","last_clean":"2023-11-04T01:37:55.304385+0000","last_became_active":"2023-11-04T01:37:35.220311+0000","last_became_peered":"2023-11-04T01:37:35.220311+0000","last_unstale":"2023-11-04T01:37:55.304385+0000","last_undegraded":"2023-11-04T01:37:55.304385+0000","last_fullsized":"2023-11-04T01:37:55.304385+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062999799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327092+0000","last_change":"2023-11-04T01:37:55.317285+0000","last_active":"2023-11-04T01:37:56.327092+0000","last_peered":"2023-11-04T01:37:56.327092+0000","last_clean":"2023-11-04T01:37:56.327092+0000","last_became_active":"2023-11-04T01:37:55.316829+0000","last_became_peered":"2023-11-04T01:37:55.316829+0000","last_unstale":"2023-11-04T01:37:56.327092+0000","last_undegraded":"2023-11-04T01:37:56.327092+0000","last_fullsized":"2023-11-04T01:37:56.327092+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:59.810743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301894+0000","last_change":"2023-11-04T01:37:54.311693+0000","last_active":"2023-11-04T01:37:56.301894+0000","last_peered":"2023-11-04T01:37:56.301894+0000","last_clean":"2023-11-04T01:37:56.301894+0000","last_became_active":"2023-11-04T01:37:54.311360+0000","last_became_peered":"2023-11-04T01:37:54.311360+0000","last_unstale":"2023-11-04T01:37:56.301894+0000","last_undegraded":"2023-11-04T01:37:56.301894+0000","last_fullsized":"2023-11-04T01:37:56.301894+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:54:06.702017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.300130+0000","last_change":"2023-11-04T01:37:36.229580+0000","last_active":"2023-11-04T01:37:55.300130+0000","last_peered":"2023-11-04T01:37:55.300130+0000","last_clean":"2023-11-04T01:37:55.300130+0000","last_became_active":"2023-11-04T01:37:35.220940+0000","last_became_peered":"2023-11-04T01:37:35.220940+0000","last_unstale":"2023-11-04T01:37:55.300130+0000","last_undegraded":"2023-11-04T01:37:55.300130+0000","last_fullsized":"2023-11-04T01:37:55.300130+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:27.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070235600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.300995+0000","last_change":"2023-11-04T01:37:55.314465+0000","last_active":"2023-11-04T01:37:56.300995+0000","last_peered":"2023-11-04T01:37:56.300995+0000","last_clean":"2023-11-04T01:37:56.300995+0000","last_became_active":"2023-11-04T01:37:55.314163+0000","last_became_peered":"2023-11-04T01:37:55.314163+0000","last_unstale":"2023-11-04T01:37:56.300995+0000","last_undegraded":"2023-11-04T01:37:56.300995+0000","last_fullsized":"2023-11-04T01:37:56.300995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:03.756077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327453+0000","last_change":"2023-11-04T01:37:54.310962+0000","last_active":"2023-11-04T01:37:56.327453+0000","last_peered":"2023-11-04T01:37:56.327453+0000","last_clean":"2023-11-04T01:37:56.327453+0000","last_became_active":"2023-11-04T01:37:54.310693+0000","last_became_peered":"2023-11-04T01:37:54.310693+0000","last_unstale":"2023-11-04T01:37:56.327453+0000","last_undegraded":"2023-11-04T01:37:56.327453+0000","last_fullsized":"2023-11-04T01:37:56.327453+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:06:53.618456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.302457+0000","last_change":"2023-11-04T01:37:36.422542+0000","last_active":"2023-11-04T01:37:55.302457+0000","last_peered":"2023-11-04T01:37:55.302457+0000","last_clean":"2023-11-04T01:37:55.302457+0000","last_became_active":"2023-11-04T01:37:35.224836+0000","last_became_peered":"2023-11-04T01:37:35.224836+0000","last_unstale":"2023-11-04T01:37:55.302457+0000","last_undegraded":"2023-11-04T01:37:55.302457+0000","last_fullsized":"2023-11-04T01:37:55.302457+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066982800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326831+0000","last_change":"2023-11-04T01:37:55.318872+0000","last_active":"2023-11-04T01:37:56.326831+0000","last_peered":"2023-11-04T01:37:56.326831+0000","last_clean":"2023-11-04T01:37:56.326831+0000","last_became_active":"2023-11-04T01:37:55.317666+0000","last_became_peered":"2023-11-04T01:37:55.317666+0000","last_unstale":"2023-11-04T01:37:56.326831+0000","last_undegraded":"2023-11-04T01:37:56.326831+0000","last_fullsized":"2023-11-04T01:37:56.326831+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:39.265071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327744+0000","last_change":"2023-11-04T01:37:54.311447+0000","last_active":"2023-11-04T01:37:56.327744+0000","last_peered":"2023-11-04T01:37:56.327744+0000","last_clean":"2023-11-04T01:37:56.327744+0000","last_became_active":"2023-11-04T01:37:54.311177+0000","last_became_peered":"2023-11-04T01:37:54.311177+0000","last_unstale":"2023-11-04T01:37:56.327744+0000","last_undegraded":"2023-11-04T01:37:56.327744+0000","last_fullsized":"2023-11-04T01:37:56.327744+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:22:59.474164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.312934+0000","last_change":"2023-11-04T01:37:36.694868+0000","last_active":"2023-11-04T01:37:55.312934+0000","last_peered":"2023-11-04T01:37:55.312934+0000","last_clean":"2023-11-04T01:37:55.312934+0000","last_became_active":"2023-11-04T01:37:35.221181+0000","last_became_peered":"2023-11-04T01:37:35.221181+0000","last_unstale":"2023-11-04T01:37:55.312934+0000","last_undegraded":"2023-11-04T01:37:55.312934+0000","last_fullsized":"2023-11-04T01:37:55.312934+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046748800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.300813+0000","last_change":"2023-11-04T01:37:55.320360+0000","last_active":"2023-11-04T01:37:56.300813+0000","last_peered":"2023-11-04T01:37:56.300813+0000","last_clean":"2023-11-04T01:37:56.300813+0000","last_became_active":"2023-11-04T01:37:55.320061+0000","last_became_peered":"2023-11-04T01:37:55.320061+0000","last_unstale":"2023-11-04T01:37:56.300813+0000","last_undegraded":"2023-11-04T01:37:56.300813+0000","last_fullsized":"2023-11-04T01:37:56.300813+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:00.481215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326492+0000","last_change":"2023-11-04T01:37:54.315885+0000","last_active":"2023-11-04T01:37:56.326492+0000","last_peered":"2023-11-04T01:37:56.326492+0000","last_clean":"2023-11-04T01:37:56.326492+0000","last_became_active":"2023-11-04T01:37:54.315431+0000","last_became_peered":"2023-11-04T01:37:54.315431+0000","last_unstale":"2023-11-04T01:37:56.326492+0000","last_undegraded":"2023-11-04T01:37:56.326492+0000","last_fullsized":"2023-11-04T01:37:56.326492+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:05:21.595584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.306253+0000","last_change":"2023-11-04T01:37:36.222930+0000","last_active":"2023-11-04T01:37:55.306253+0000","last_peered":"2023-11-04T01:37:55.306253+0000","last_clean":"2023-11-04T01:37:55.306253+0000","last_became_active":"2023-11-04T01:37:35.220373+0000","last_became_peered":"2023-11-04T01:37:35.220373+0000","last_unstale":"2023-11-04T01:37:55.306253+0000","last_undegraded":"2023-11-04T01:37:55.306253+0000","last_fullsized":"2023-11-04T01:37:55.306253+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074099599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326968+0000","last_change":"2023-11-04T01:37:55.319334+0000","last_active":"2023-11-04T01:37:56.326968+0000","last_peered":"2023-11-04T01:37:56.326968+0000","last_clean":"2023-11-04T01:37:56.326968+0000","last_became_active":"2023-11-04T01:37:55.317142+0000","last_became_peered":"2023-11-04T01:37:55.317142+0000","last_unstale":"2023-11-04T01:37:56.326968+0000","last_undegraded":"2023-11-04T01:37:56.326968+0000","last_fullsized":"2023-11-04T01:37:56.326968+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:03:14.904779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301135+0000","last_change":"2023-11-04T01:37:54.315881+0000","last_active":"2023-11-04T01:37:56.301135+0000","last_peered":"2023-11-04T01:37:56.301135+0000","last_clean":"2023-11-04T01:37:56.301135+0000","last_became_active":"2023-11-04T01:37:54.315640+0000","last_became_peered":"2023-11-04T01:37:54.315640+0000","last_unstale":"2023-11-04T01:37:56.301135+0000","last_undegraded":"2023-11-04T01:37:56.301135+0000","last_fullsized":"2023-11-04T01:37:56.301135+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:38.258020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.306302+0000","last_change":"2023-11-04T01:37:36.221676+0000","last_active":"2023-11-04T01:37:55.306302+0000","last_peered":"2023-11-04T01:37:55.306302+0000","last_clean":"2023-11-04T01:37:55.306302+0000","last_became_active":"2023-11-04T01:37:35.226996+0000","last_became_peered":"2023-11-04T01:37:35.226996+0000","last_unstale":"2023-11-04T01:37:55.306302+0000","last_undegraded":"2023-11-04T01:37:55.306302+0000","last_fullsized":"2023-11-04T01:37:55.306302+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089115500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327664+0000","last_change":"2023-11-04T01:37:55.312077+0000","last_active":"2023-11-04T01:37:56.327664+0000","last_peered":"2023-11-04T01:37:56.327664+0000","last_clean":"2023-11-04T01:37:56.327664+0000","last_became_active":"2023-11-04T01:37:55.311635+0000","last_became_peered":"2023-11-04T01:37:55.311635+0000","last_unstale":"2023-11-04T01:37:56.327664+0000","last_undegraded":"2023-11-04T01:37:56.327664+0000","last_fullsized":"2023-11-04T01:37:56.327664+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:16.762583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327813+0000","last_change":"2023-11-04T01:37:54.311197+0000","last_active":"2023-11-04T01:37:56.327813+0000","last_peered":"2023-11-04T01:37:56.327813+0000","last_clean":"2023-11-04T01:37:56.327813+0000","last_became_active":"2023-11-04T01:37:54.310886+0000","last_became_peered":"2023-11-04T01:37:54.310886+0000","last_unstale":"2023-11-04T01:37:56.327813+0000","last_undegraded":"2023-11-04T01:37:56.327813+0000","last_fullsized":"2023-11-04T01:37:56.327813+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:55.722947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.307588+0000","last_change":"2023-11-04T01:37:36.228535+0000","last_active":"2023-11-04T01:37:55.307588+0000","last_peered":"2023-11-04T01:37:55.307588+0000","last_clean":"2023-11-04T01:37:55.307588+0000","last_became_active":"2023-11-04T01:37:35.221173+0000","last_became_peered":"2023-11-04T01:37:35.221173+0000","last_unstale":"2023-11-04T01:37:55.307588+0000","last_undegraded":"2023-11-04T01:37:55.307588+0000","last_fullsized":"2023-11-04T01:37:55.307588+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049831099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326990+0000","last_change":"2023-11-04T01:37:55.317460+0000","last_active":"2023-11-04T01:37:56.326990+0000","last_peered":"2023-11-04T01:37:56.326990+0000","last_clean":"2023-11-04T01:37:56.326990+0000","last_became_active":"2023-11-04T01:37:55.317189+0000","last_became_peered":"2023-11-04T01:37:55.317189+0000","last_unstale":"2023-11-04T01:37:56.326990+0000","last_undegraded":"2023-11-04T01:37:56.326990+0000","last_fullsized":"2023-11-04T01:37:56.326990+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:56.729998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301162+0000","last_change":"2023-11-04T01:37:54.315337+0000","last_active":"2023-11-04T01:37:56.301162+0000","last_peered":"2023-11-04T01:37:56.301162+0000","last_clean":"2023-11-04T01:37:56.301162+0000","last_became_active":"2023-11-04T01:37:54.315047+0000","last_became_peered":"2023-11-04T01:37:54.315047+0000","last_unstale":"2023-11-04T01:37:56.301162+0000","last_undegraded":"2023-11-04T01:37:56.301162+0000","last_fullsized":"2023-11-04T01:37:56.301162+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:30.142280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.300842+0000","last_change":"2023-11-04T01:37:36.229678+0000","last_active":"2023-11-04T01:37:55.300842+0000","last_peered":"2023-11-04T01:37:55.300842+0000","last_clean":"2023-11-04T01:37:55.300842+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:37:55.300842+0000","last_undegraded":"2023-11-04T01:37:55.300842+0000","last_fullsized":"2023-11-04T01:37:55.300842+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:50.484332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327361+0000","last_change":"2023-11-04T01:37:55.316016+0000","last_active":"2023-11-04T01:37:56.327361+0000","last_peered":"2023-11-04T01:37:56.327361+0000","last_clean":"2023-11-04T01:37:56.327361+0000","last_became_active":"2023-11-04T01:37:55.315159+0000","last_became_peered":"2023-11-04T01:37:55.315159+0000","last_unstale":"2023-11-04T01:37:56.327361+0000","last_undegraded":"2023-11-04T01:37:56.327361+0000","last_fullsized":"2023-11-04T01:37:56.327361+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:10.071946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327508+0000","last_change":"2023-11-04T01:37:54.314110+0000","last_active":"2023-11-04T01:37:56.327508+0000","last_peered":"2023-11-04T01:37:56.327508+0000","last_clean":"2023-11-04T01:37:56.327508+0000","last_became_active":"2023-11-04T01:37:54.313849+0000","last_became_peered":"2023-11-04T01:37:54.313849+0000","last_unstale":"2023-11-04T01:37:56.327508+0000","last_undegraded":"2023-11-04T01:37:56.327508+0000","last_fullsized":"2023-11-04T01:37:56.327508+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:46:20.176864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.300244+0000","last_change":"2023-11-04T01:37:36.229908+0000","last_active":"2023-11-04T01:37:55.300244+0000","last_peered":"2023-11-04T01:37:55.300244+0000","last_clean":"2023-11-04T01:37:55.300244+0000","last_became_active":"2023-11-04T01:37:35.221822+0000","last_became_peered":"2023-11-04T01:37:35.221822+0000","last_unstale":"2023-11-04T01:37:55.300244+0000","last_undegraded":"2023-11-04T01:37:55.300244+0000","last_fullsized":"2023-11-04T01:37:55.300244+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:11.866738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089270799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326521+0000","last_change":"2023-11-04T01:37:55.311709+0000","last_active":"2023-11-04T01:37:56.326521+0000","last_peered":"2023-11-04T01:37:56.326521+0000","last_clean":"2023-11-04T01:37:56.326521+0000","last_became_active":"2023-11-04T01:37:55.311417+0000","last_became_peered":"2023-11-04T01:37:55.311417+0000","last_unstale":"2023-11-04T01:37:56.326521+0000","last_undegraded":"2023-11-04T01:37:56.326521+0000","last_fullsized":"2023-11-04T01:37:56.326521+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:46.960958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301931+0000","last_change":"2023-11-04T01:37:54.307776+0000","last_active":"2023-11-04T01:37:56.301931+0000","last_peered":"2023-11-04T01:37:56.301931+0000","last_clean":"2023-11-04T01:37:56.301931+0000","last_became_active":"2023-11-04T01:37:54.307489+0000","last_became_peered":"2023-11-04T01:37:54.307489+0000","last_unstale":"2023-11-04T01:37:56.301931+0000","last_undegraded":"2023-11-04T01:37:56.301931+0000","last_fullsized":"2023-11-04T01:37:56.301931+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:46.187528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.313020+0000","last_change":"2023-11-04T01:37:36.695345+0000","last_active":"2023-11-04T01:37:55.313020+0000","last_peered":"2023-11-04T01:37:55.313020+0000","last_clean":"2023-11-04T01:37:55.313020+0000","last_became_active":"2023-11-04T01:37:35.225441+0000","last_became_peered":"2023-11-04T01:37:35.225441+0000","last_unstale":"2023-11-04T01:37:55.313020+0000","last_undegraded":"2023-11-04T01:37:55.313020+0000","last_fullsized":"2023-11-04T01:37:55.313020+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052758199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":195,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.300332+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:37:55.300332+0000","last_peered":"2023-11-04T01:37:55.300332+0000","last_clean":"2023-11-04T01:37:55.300332+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:37:55.300332+0000","last_undegraded":"2023-11-04T01:37:55.300332+0000","last_fullsized":"2023-11-04T01:37:55.300332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1269760,"data_stored":896420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.503,"15min":0.503},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64000000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.53300000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.745,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.435}]},{"osd":2,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.375,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.51700000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.61199999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46300000000000002,"15min":0.45700000000000002},"min":{"1min":0.314,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.36599999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.32800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.371,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.629}]},{"osd":6,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.45000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.434,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":298919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.443,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53900000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.41099999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":1.004,"15min":1.004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55100000000000005,"15min":0.54100000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76100000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78500000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.46899999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79800000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.63900000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65800000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.624},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":675840,"data_stored":306544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71399999999999997,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.67900000000000005,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45500000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":1.24,"15min":1.24},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.42399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64900000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.48899999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72999999999999998,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67300000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.67200000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.5},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.69699999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72299999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.502,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65300000000000002,"5min":0.877,"15min":0.877},"last":0.36099999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75600000000000001,"5min":1.284,"15min":1.284},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71999999999999997,"5min":0.746,"15min":0.746},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.38100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":667648,"data_stored":300531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.38700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39800000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.317,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76400000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.746,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60699999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78300000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.622},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.433,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":1.022,"15min":1.022},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":1.002,"15min":1.002},"last":0.497},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71699999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.46999999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":1.127,"15min":1.127},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80200000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.55600000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77600000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.747,"5min":1.079,"15min":1.079},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81000000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.629,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":1.093,"15min":1.093},"last":0.66700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":298975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.33400000000000002,"15min":0.34000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.49299999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.48399999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.26900000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.39700000000000002,"15min":0.40799999999999997},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.44600000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.311},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.41799999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.33600000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.57699999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.312,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59499999999999997,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61599999999999999,"15min":0.627},"min":{"1min":0.36299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.752,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.622,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.65900000000000003,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.435},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57899999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80600000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.47699999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79400000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68500000000000005,"15min":0.69699999999999995},"min":{"1min":0.51000000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.752,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":298975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.36099999999999999,"15min":0.371},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.42399999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.36799999999999999,"15min":0.375},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.625,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.38600000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.308},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38200000000000001,"15min":0.38600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.35799999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55500000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.5,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34399999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.621},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65000000000000002,"15min":0.65800000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86299999999999999,"5min":1.052,"15min":1.052},"last":0.58899999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.876,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.67400000000000004,"15min":0.68200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.67500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":659456,"data_stored":299009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32700000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.46500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.496}]},{"osd":2,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.44},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40200000000000002,"15min":0.40400000000000003},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.58699999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58399999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39000000000000001,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.52800000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.77900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":1.02,"15min":1.02},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89700000000000002,"5min":1.089,"15min":1.089},"last":0.81399999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92600000000000005,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.747}]},{"osd":7,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92400000000000004,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96699999999999997,"5min":1.153,"15min":1.153},"last":0.76300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1261568,"data_stored":890462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.35299999999999998,"15min":0.35599999999999998},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47099999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34699999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55200000000000005,"5min":0.629,"15min":0.629},"last":0.36299999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59499999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.48899999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46200000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.28799999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.497,"5min":0.628,"15min":0.628},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65700000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.498}]},{"osd":4,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.45600000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.48399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77200000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.70799999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.59699999999999998},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.80600000000000005,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81999999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.628},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84099999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.622},"min":{"1min":0.47099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81699999999999995,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.495,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86499999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:59.333 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:59.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.471+0000 7fce0057c640 1 Processor -- start 2023-11-04T01:37:59.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.471+0000 7fce0057c640 1 -- start start 2023-11-04T01:37:59.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.472+0000 7fce0057c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcdf80ce240 0x7fcdf8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.472+0000 7fce0057c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcdf8157540 0x7fcdf80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.472+0000 7fce0057c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf815e000 con 0x7fcdf80cde60 2023-11-04T01:37:59.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.472+0000 7fce0057c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf815e5c0 con 0x7fcdf80ce240 2023-11-04T01:37:59.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.472+0000 7fce0057c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf815e2e0 con 0x7fcdf8157540 2023-11-04T01:37:59.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.472+0000 7fcdfdb17640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcdf80ce240 0x7fcdf8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.472+0000 7fcdfe318640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcdf80cde60 0x7fcdf815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41830/0 (socket says 172.21.15.44:41830) 2023-11-04T01:37:59.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.472+0000 7fcdfe318640 1 -- 172.21.15.44:0/2339332304 learned_addr learned my addr 172.21.15.44:0/2339332304 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:37:59.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.472+0000 7fcdfdb17640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcdf80ce240 0x7fcdf8157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40682/0 (socket says 172.21.15.44:40682) 2023-11-04T01:37:59.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.472+0000 7fcdfeb19640 1 --2- 172.21.15.44:0/2339332304 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcdf8157540 0x7fcdf80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.472+0000 7fcdfdb17640 1 -- 172.21.15.44:0/2339332304 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcdf8157540 msgr2=0x7fcdf80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:59.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.472+0000 7fcdfdb17640 1 --2- 172.21.15.44:0/2339332304 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcdf8157540 0x7fcdf80d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.472+0000 7fcdfdb17640 1 -- 172.21.15.44:0/2339332304 >> v1:172.21.15.44:6789/0 conn(0x7fcdf80cde60 legacy=0x7fcdf815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.472+0000 7fcdfdb17640 1 -- 172.21.15.44:0/2339332304 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf80d1120 con 0x7fcdf80ce240 2023-11-04T01:37:59.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.473+0000 7fcdfdb17640 1 --2- 172.21.15.44:0/2339332304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf80ce240 0x7fcdf8157000 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fcde80097a0 tx=0x7fcde802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1389de7632b14773 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.473+0000 7fcdfd316640 1 -- 172.21.15.44:0/2339332304 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde8031830 con 0x7fcdf80ce240 2023-11-04T01:37:59.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.473+0000 7fcdfd316640 1 -- 172.21.15.44:0/2339332304 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde8031990 con 0x7fcdf80ce240 2023-11-04T01:37:59.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.473+0000 7fcdfd316640 1 -- 172.21.15.44:0/2339332304 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde8031d20 con 0x7fcdf80ce240 2023-11-04T01:37:59.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.474+0000 7fce0057c640 1 -- 172.21.15.44:0/2339332304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf80ce240 msgr2=0x7fcdf8157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.474+0000 7fce0057c640 1 --2- 172.21.15.44:0/2339332304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf80ce240 0x7fcdf8157000 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fcde80097a0 tx=0x7fcde802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.474+0000 7fce0057c640 1 -- 172.21.15.44:0/2339332304 shutdown_connections 2023-11-04T01:37:59.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.474+0000 7fce0057c640 1 --2- 172.21.15.44:0/2339332304 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcdf8157540 0x7fcdf80d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.474+0000 7fce0057c640 1 --2- 172.21.15.44:0/2339332304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf80ce240 0x7fcdf8157000 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.474+0000 7fce0057c640 1 -- 172.21.15.44:0/2339332304 >> 172.21.15.44:0/2339332304 conn(0x7fcdf8071f30 msgr2=0x7fcdf80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:59.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.474+0000 7fce0057c640 1 -- 172.21.15.44:0/2339332304 shutdown_connections 2023-11-04T01:37:59.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.474+0000 7fce0057c640 1 -- 172.21.15.44:0/2339332304 wait complete. 2023-11-04T01:37:59.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.475+0000 7fce0057c640 1 Processor -- start 2023-11-04T01:37:59.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.475+0000 7fce0057c640 1 -- start start 2023-11-04T01:37:59.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fce0057c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcdf80cde60 0x7fcdf81528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fce0057c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcdf80ce240 0x7fcdf80cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fce0057c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf8157540 0x7fcdf80c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fce0057c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf80ccf60 con 0x7fcdf8157540 2023-11-04T01:37:59.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fce0057c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf80cc350 con 0x7fcdf80ce240 2023-11-04T01:37:59.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fce0057c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf80cc630 con 0x7fcdf80cde60 2023-11-04T01:37:59.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fcdfeb19640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf8157540 0x7fcdf80c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fcdfeb19640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf8157540 0x7fcdf80c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40686/0 (socket says 172.21.15.44:40686) 2023-11-04T01:37:59.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fcdfeb19640 1 -- 172.21.15.44:0/1565765115 learned_addr learned my addr 172.21.15.44:0/1565765115 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:59.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fcdfe318640 1 --2- 172.21.15.44:0/1565765115 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcdf80cde60 0x7fcdf81528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fcdfdb17640 1 --2- 172.21.15.44:0/1565765115 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcdf80ce240 0x7fcdf80cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fcdfeb19640 1 -- 172.21.15.44:0/1565765115 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcdf80cde60 msgr2=0x7fcdf81528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fcdfeb19640 1 --2- 172.21.15.44:0/1565765115 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcdf80cde60 0x7fcdf81528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fcdfeb19640 1 -- 172.21.15.44:0/1565765115 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcdf80ce240 msgr2=0x7fcdf80cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fcdfeb19640 1 --2- 172.21.15.44:0/1565765115 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcdf80ce240 0x7fcdf80cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.476+0000 7fcdfeb19640 1 -- 172.21.15.44:0/1565765115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde8009400 con 0x7fcdf8157540 2023-11-04T01:37:59.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.477+0000 7fcdfeb19640 1 --2- 172.21.15.44:0/1565765115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf8157540 0x7fcdf80c8210 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000d5d0 tx=0x7fcdf000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.477+0000 7fcdeeffd640 1 -- 172.21.15.44:0/1565765115 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00125f0 con 0x7fcdf8157540 2023-11-04T01:37:59.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.477+0000 7fcdeeffd640 1 -- 172.21.15.44:0/1565765115 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf0012770 con 0x7fcdf8157540 2023-11-04T01:37:59.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.477+0000 7fce0057c640 1 -- 172.21.15.44:0/1565765115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf80cc910 con 0x7fcdf8157540 2023-11-04T01:37:59.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.477+0000 7fcdeeffd640 1 -- 172.21.15.44:0/1565765115 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0012b20 con 0x7fcdf8157540 2023-11-04T01:37:59.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.477+0000 7fce0057c640 1 -- 172.21.15.44:0/1565765115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf8152e20 con 0x7fcdf8157540 2023-11-04T01:37:59.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.478+0000 7fce0057c640 1 -- 172.21.15.44:0/1565765115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf80cd0d0 con 0x7fcdf8157540 2023-11-04T01:37:59.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.478+0000 7fcdeeffd640 1 -- 172.21.15.44:0/1565765115 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcdf0012c80 con 0x7fcdf8157540 2023-11-04T01:37:59.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.479+0000 7fcdeeffd640 1 --2- 172.21.15.44:0/1565765115 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcddc06ae70 0x7fcddc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.479+0000 7fcdeeffd640 1 -- 172.21.15.44:0/1565765115 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcdf0089e20 con 0x7fcdf8157540 2023-11-04T01:37:59.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.479+0000 7fcdfe318640 1 --2- 172.21.15.44:0/1565765115 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcddc06ae70 0x7fcddc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.480+0000 7fcdfe318640 1 --2- 172.21.15.44:0/1565765115 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcddc06ae70 0x7fcddc06d330 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4005c00 tx=0x7fcdf4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.483+0000 7fcdeeffd640 1 -- 172.21.15.44:0/1565765115 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcdf0054ba0 con 0x7fcdf8157540 2023-11-04T01:37:59.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.656+0000 7fce0057c640 1 -- 172.21.15.44:0/1565765115 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcdf81579b0 con 0x7fcddc06ae70 2023-11-04T01:37:59.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.666+0000 7fcdeeffd640 1 -- 172.21.15.44:0/1565765115 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370525 (secure 0 0 0) 0x7fcdf400ecf0 con 0x7fcddc06ae70 2023-11-04T01:37:59.672 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:37:59.674 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:37:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.670+0000 7fce0057c640 1 -- 172.21.15.44:0/1565765115 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcddc06ae70 msgr2=0x7fcddc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.670+0000 7fce0057c640 1 --2- 172.21.15.44:0/1565765115 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcddc06ae70 0x7fcddc06d330 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4005c00 tx=0x7fcdf4009040 comp rx=0 tx=0).stop 2023-11-04T01:37:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.670+0000 7fce0057c640 1 -- 172.21.15.44:0/1565765115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf8157540 msgr2=0x7fcdf80c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.670+0000 7fce0057c640 1 --2- 172.21.15.44:0/1565765115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf8157540 0x7fcdf80c8210 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000d5d0 tx=0x7fcdf000da90 comp rx=0 tx=0).stop 2023-11-04T01:37:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.670+0000 7fce0057c640 1 -- 172.21.15.44:0/1565765115 shutdown_connections 2023-11-04T01:37:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.670+0000 7fce0057c640 1 --2- 172.21.15.44:0/1565765115 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcddc06ae70 0x7fcddc06d330 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.670+0000 7fce0057c640 1 --2- 172.21.15.44:0/1565765115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf8157540 0x7fcdf80c8210 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.670+0000 7fce0057c640 1 --2- 172.21.15.44:0/1565765115 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcdf80ce240 0x7fcdf80cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.670+0000 7fce0057c640 1 --2- 172.21.15.44:0/1565765115 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcdf80cde60 0x7fcdf81528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.670+0000 7fce0057c640 1 -- 172.21.15.44:0/1565765115 >> 172.21.15.44:0/1565765115 conn(0x7fcdf8071f30 msgr2=0x7fcdf80d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.670+0000 7fce0057c640 1 -- 172.21.15.44:0/1565765115 shutdown_connections 2023-11-04T01:37:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.670+0000 7fce0057c640 1 -- 172.21.15.44:0/1565765115 wait complete. 2023-11-04T01:37:59.682 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-11-04T01:37:58.602793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222572,"kb_used_data":6364,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752148,"statfs":{"total":773094113280,"available":772866199552,"internally_reserved":0,"allocated":6516736,"data_stored":3589835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.314047"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326734+0000","last_change":"2023-11-04T01:37:55.319147+0000","last_active":"2023-11-04T01:37:56.326734+0000","last_peered":"2023-11-04T01:37:56.326734+0000","last_clean":"2023-11-04T01:37:56.326734+0000","last_became_active":"2023-11-04T01:37:55.318881+0000","last_became_peered":"2023-11-04T01:37:55.318881+0000","last_unstale":"2023-11-04T01:37:56.326734+0000","last_undegraded":"2023-11-04T01:37:56.326734+0000","last_fullsized":"2023-11-04T01:37:56.326734+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:20.247112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327690+0000","last_change":"2023-11-04T01:37:55.315754+0000","last_active":"2023-11-04T01:37:56.327690+0000","last_peered":"2023-11-04T01:37:56.327690+0000","last_clean":"2023-11-04T01:37:56.327690+0000","last_became_active":"2023-11-04T01:37:55.315469+0000","last_became_peered":"2023-11-04T01:37:55.315469+0000","last_unstale":"2023-11-04T01:37:56.327690+0000","last_undegraded":"2023-11-04T01:37:56.327690+0000","last_fullsized":"2023-11-04T01:37:56.327690+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.463657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326859+0000","last_change":"2023-11-04T01:37:55.312302+0000","last_active":"2023-11-04T01:37:56.326859+0000","last_peered":"2023-11-04T01:37:56.326859+0000","last_clean":"2023-11-04T01:37:56.326859+0000","last_became_active":"2023-11-04T01:37:55.312018+0000","last_became_peered":"2023-11-04T01:37:55.312018+0000","last_unstale":"2023-11-04T01:37:56.326859+0000","last_undegraded":"2023-11-04T01:37:56.326859+0000","last_fullsized":"2023-11-04T01:37:56.326859+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:39.265071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327482+0000","last_change":"2023-11-04T01:37:55.321717+0000","last_active":"2023-11-04T01:37:56.327482+0000","last_peered":"2023-11-04T01:37:56.327482+0000","last_clean":"2023-11-04T01:37:56.327482+0000","last_became_active":"2023-11-04T01:37:55.321460+0000","last_became_peered":"2023-11-04T01:37:55.321460+0000","last_unstale":"2023-11-04T01:37:56.327482+0000","last_undegraded":"2023-11-04T01:37:56.327482+0000","last_fullsized":"2023-11-04T01:37:56.327482+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:16.126675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326358+0000","last_change":"2023-11-04T01:37:55.313209+0000","last_active":"2023-11-04T01:37:56.326358+0000","last_peered":"2023-11-04T01:37:56.326358+0000","last_clean":"2023-11-04T01:37:56.326358+0000","last_became_active":"2023-11-04T01:37:55.312961+0000","last_became_peered":"2023-11-04T01:37:55.312961+0000","last_unstale":"2023-11-04T01:37:56.326358+0000","last_undegraded":"2023-11-04T01:37:56.326358+0000","last_fullsized":"2023-11-04T01:37:56.326358+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:14.299012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.300694+0000","last_change":"2023-11-04T01:37:55.321163+0000","last_active":"2023-11-04T01:37:56.300694+0000","last_peered":"2023-11-04T01:37:56.300694+0000","last_clean":"2023-11-04T01:37:56.300694+0000","last_became_active":"2023-11-04T01:37:55.320851+0000","last_became_peered":"2023-11-04T01:37:55.320851+0000","last_unstale":"2023-11-04T01:37:56.300694+0000","last_undegraded":"2023-11-04T01:37:56.300694+0000","last_fullsized":"2023-11-04T01:37:56.300694+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:16.126675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301584+0000","last_change":"2023-11-04T01:37:55.318259+0000","last_active":"2023-11-04T01:37:56.301584+0000","last_peered":"2023-11-04T01:37:56.301584+0000","last_clean":"2023-11-04T01:37:56.301584+0000","last_became_active":"2023-11-04T01:37:55.317971+0000","last_became_peered":"2023-11-04T01:37:55.317971+0000","last_unstale":"2023-11-04T01:37:56.301584+0000","last_undegraded":"2023-11-04T01:37:56.301584+0000","last_fullsized":"2023-11-04T01:37:56.301584+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:45.843734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326720+0000","last_change":"2023-11-04T01:37:55.310018+0000","last_active":"2023-11-04T01:37:56.326720+0000","last_peered":"2023-11-04T01:37:56.326720+0000","last_clean":"2023-11-04T01:37:56.326720+0000","last_became_active":"2023-11-04T01:37:55.309741+0000","last_became_peered":"2023-11-04T01:37:55.309741+0000","last_unstale":"2023-11-04T01:37:56.326720+0000","last_undegraded":"2023-11-04T01:37:56.326720+0000","last_fullsized":"2023-11-04T01:37:56.326720+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:19.420233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.302504+0000","last_change":"2023-11-04T01:37:55.314422+0000","last_active":"2023-11-04T01:37:56.302504+0000","last_peered":"2023-11-04T01:37:56.302504+0000","last_clean":"2023-11-04T01:37:56.302504+0000","last_became_active":"2023-11-04T01:37:55.314188+0000","last_became_peered":"2023-11-04T01:37:55.314188+0000","last_unstale":"2023-11-04T01:37:56.302504+0000","last_undegraded":"2023-11-04T01:37:56.302504+0000","last_fullsized":"2023-11-04T01:37:56.302504+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:27.282176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327052+0000","last_change":"2023-11-04T01:37:55.314746+0000","last_active":"2023-11-04T01:37:56.327052+0000","last_peered":"2023-11-04T01:37:56.327052+0000","last_clean":"2023-11-04T01:37:56.327052+0000","last_became_active":"2023-11-04T01:37:55.314484+0000","last_became_peered":"2023-11-04T01:37:55.314484+0000","last_unstale":"2023-11-04T01:37:56.327052+0000","last_undegraded":"2023-11-04T01:37:56.327052+0000","last_fullsized":"2023-11-04T01:37:56.327052+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:05:22.602635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327053+0000","last_change":"2023-11-04T01:37:55.316131+0000","last_active":"2023-11-04T01:37:56.327053+0000","last_peered":"2023-11-04T01:37:56.327053+0000","last_clean":"2023-11-04T01:37:56.327053+0000","last_became_active":"2023-11-04T01:37:55.315832+0000","last_became_peered":"2023-11-04T01:37:55.315832+0000","last_unstale":"2023-11-04T01:37:56.327053+0000","last_undegraded":"2023-11-04T01:37:56.327053+0000","last_fullsized":"2023-11-04T01:37:56.327053+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:27.282176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327224+0000","last_change":"2023-11-04T01:37:55.317452+0000","last_active":"2023-11-04T01:37:56.327224+0000","last_peered":"2023-11-04T01:37:56.327224+0000","last_clean":"2023-11-04T01:37:56.327224+0000","last_became_active":"2023-11-04T01:37:55.317229+0000","last_became_peered":"2023-11-04T01:37:55.317229+0000","last_unstale":"2023-11-04T01:37:56.327224+0000","last_undegraded":"2023-11-04T01:37:56.327224+0000","last_fullsized":"2023-11-04T01:37:56.327224+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:07.997947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.302048+0000","last_change":"2023-11-04T01:37:55.322571+0000","last_active":"2023-11-04T01:37:56.302048+0000","last_peered":"2023-11-04T01:37:56.302048+0000","last_clean":"2023-11-04T01:37:56.302048+0000","last_became_active":"2023-11-04T01:37:55.321915+0000","last_became_peered":"2023-11-04T01:37:55.321915+0000","last_unstale":"2023-11-04T01:37:56.302048+0000","last_undegraded":"2023-11-04T01:37:56.302048+0000","last_fullsized":"2023-11-04T01:37:56.302048+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:32.215751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.302378+0000","last_change":"2023-11-04T01:37:55.321111+0000","last_active":"2023-11-04T01:37:56.302378+0000","last_peered":"2023-11-04T01:37:56.302378+0000","last_clean":"2023-11-04T01:37:56.302378+0000","last_became_active":"2023-11-04T01:37:55.320751+0000","last_became_peered":"2023-11-04T01:37:55.320751+0000","last_unstale":"2023-11-04T01:37:56.302378+0000","last_undegraded":"2023-11-04T01:37:56.302378+0000","last_fullsized":"2023-11-04T01:37:56.302378+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:05:22.602635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301712+0000","last_change":"2023-11-04T01:37:55.320161+0000","last_active":"2023-11-04T01:37:56.301712+0000","last_peered":"2023-11-04T01:37:56.301712+0000","last_clean":"2023-11-04T01:37:56.301712+0000","last_became_active":"2023-11-04T01:37:55.319895+0000","last_became_peered":"2023-11-04T01:37:55.319895+0000","last_unstale":"2023-11-04T01:37:56.301712+0000","last_undegraded":"2023-11-04T01:37:56.301712+0000","last_fullsized":"2023-11-04T01:37:56.301712+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:55.384004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.300667+0000","last_change":"2023-11-04T01:37:55.317440+0000","last_active":"2023-11-04T01:37:56.300667+0000","last_peered":"2023-11-04T01:37:56.300667+0000","last_clean":"2023-11-04T01:37:56.300667+0000","last_became_active":"2023-11-04T01:37:55.317168+0000","last_became_peered":"2023-11-04T01:37:55.317168+0000","last_unstale":"2023-11-04T01:37:56.300667+0000","last_undegraded":"2023-11-04T01:37:56.300667+0000","last_fullsized":"2023-11-04T01:37:56.300667+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:28.325804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327655+0000","last_change":"2023-11-04T01:37:55.316458+0000","last_active":"2023-11-04T01:37:56.327655+0000","last_peered":"2023-11-04T01:37:56.327655+0000","last_clean":"2023-11-04T01:37:56.327655+0000","last_became_active":"2023-11-04T01:37:55.316035+0000","last_became_peered":"2023-11-04T01:37:55.316035+0000","last_unstale":"2023-11-04T01:37:56.327655+0000","last_undegraded":"2023-11-04T01:37:56.327655+0000","last_fullsized":"2023-11-04T01:37:56.327655+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:27.343001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327524+0000","last_change":"2023-11-04T01:37:55.311409+0000","last_active":"2023-11-04T01:37:56.327524+0000","last_peered":"2023-11-04T01:37:56.327524+0000","last_clean":"2023-11-04T01:37:56.327524+0000","last_became_active":"2023-11-04T01:37:55.311114+0000","last_became_peered":"2023-11-04T01:37:55.311114+0000","last_unstale":"2023-11-04T01:37:56.327524+0000","last_undegraded":"2023-11-04T01:37:56.327524+0000","last_fullsized":"2023-11-04T01:37:56.327524+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:42:09.033250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326435+0000","last_change":"2023-11-04T01:37:55.318407+0000","last_active":"2023-11-04T01:37:56.326435+0000","last_peered":"2023-11-04T01:37:56.326435+0000","last_clean":"2023-11-04T01:37:56.326435+0000","last_became_active":"2023-11-04T01:37:55.318104+0000","last_became_peered":"2023-11-04T01:37:55.318104+0000","last_unstale":"2023-11-04T01:37:56.326435+0000","last_undegraded":"2023-11-04T01:37:56.326435+0000","last_fullsized":"2023-11-04T01:37:56.326435+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:31:58.488478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327562+0000","last_change":"2023-11-04T01:37:55.319339+0000","last_active":"2023-11-04T01:37:56.327562+0000","last_peered":"2023-11-04T01:37:56.327562+0000","last_clean":"2023-11-04T01:37:56.327562+0000","last_became_active":"2023-11-04T01:37:55.319043+0000","last_became_peered":"2023-11-04T01:37:55.319043+0000","last_unstale":"2023-11-04T01:37:56.327562+0000","last_undegraded":"2023-11-04T01:37:56.327562+0000","last_fullsized":"2023-11-04T01:37:56.327562+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:02:09.768200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326933+0000","last_change":"2023-11-04T01:37:55.313098+0000","last_active":"2023-11-04T01:37:56.326933+0000","last_peered":"2023-11-04T01:37:56.326933+0000","last_clean":"2023-11-04T01:37:56.326933+0000","last_became_active":"2023-11-04T01:37:55.312844+0000","last_became_peered":"2023-11-04T01:37:55.312844+0000","last_unstale":"2023-11-04T01:37:56.326933+0000","last_undegraded":"2023-11-04T01:37:56.326933+0000","last_fullsized":"2023-11-04T01:37:56.326933+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:07.997947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327259+0000","last_change":"2023-11-04T01:37:55.306042+0000","last_active":"2023-11-04T01:37:56.327259+0000","last_peered":"2023-11-04T01:37:56.327259+0000","last_clean":"2023-11-04T01:37:56.327259+0000","last_became_active":"2023-11-04T01:37:55.305765+0000","last_became_peered":"2023-11-04T01:37:55.305765+0000","last_unstale":"2023-11-04T01:37:56.327259+0000","last_undegraded":"2023-11-04T01:37:56.327259+0000","last_fullsized":"2023-11-04T01:37:56.327259+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:38.516669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326929+0000","last_change":"2023-11-04T01:37:55.309682+0000","last_active":"2023-11-04T01:37:56.326929+0000","last_peered":"2023-11-04T01:37:56.326929+0000","last_clean":"2023-11-04T01:37:56.326929+0000","last_became_active":"2023-11-04T01:37:55.309440+0000","last_became_peered":"2023-11-04T01:37:55.309440+0000","last_unstale":"2023-11-04T01:37:56.326929+0000","last_undegraded":"2023-11-04T01:37:56.326929+0000","last_fullsized":"2023-11-04T01:37:56.326929+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:03:14.904779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301456+0000","last_change":"2023-11-04T01:37:55.318701+0000","last_active":"2023-11-04T01:37:56.301456+0000","last_peered":"2023-11-04T01:37:56.301456+0000","last_clean":"2023-11-04T01:37:56.301456+0000","last_became_active":"2023-11-04T01:37:55.318352+0000","last_became_peered":"2023-11-04T01:37:55.318352+0000","last_unstale":"2023-11-04T01:37:56.301456+0000","last_undegraded":"2023-11-04T01:37:56.301456+0000","last_fullsized":"2023-11-04T01:37:56.301456+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:42:10.569412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326725+0000","last_change":"2023-11-04T01:37:55.311983+0000","last_active":"2023-11-04T01:37:56.326725+0000","last_peered":"2023-11-04T01:37:56.326725+0000","last_clean":"2023-11-04T01:37:56.326725+0000","last_became_active":"2023-11-04T01:37:55.311661+0000","last_became_peered":"2023-11-04T01:37:55.311661+0000","last_unstale":"2023-11-04T01:37:56.326725+0000","last_undegraded":"2023-11-04T01:37:56.326725+0000","last_fullsized":"2023-11-04T01:37:56.326725+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:41.355275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327263+0000","last_change":"2023-11-04T01:37:55.318941+0000","last_active":"2023-11-04T01:37:56.327263+0000","last_peered":"2023-11-04T01:37:56.327263+0000","last_clean":"2023-11-04T01:37:56.327263+0000","last_became_active":"2023-11-04T01:37:55.318650+0000","last_became_peered":"2023-11-04T01:37:55.318650+0000","last_unstale":"2023-11-04T01:37:56.327263+0000","last_undegraded":"2023-11-04T01:37:56.327263+0000","last_fullsized":"2023-11-04T01:37:56.327263+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:56.729998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301005+0000","last_change":"2023-11-04T01:37:55.319105+0000","last_active":"2023-11-04T01:37:56.301005+0000","last_peered":"2023-11-04T01:37:56.301005+0000","last_clean":"2023-11-04T01:37:56.301005+0000","last_became_active":"2023-11-04T01:37:55.318779+0000","last_became_peered":"2023-11-04T01:37:55.318779+0000","last_unstale":"2023-11-04T01:37:56.301005+0000","last_undegraded":"2023-11-04T01:37:56.301005+0000","last_fullsized":"2023-11-04T01:37:56.301005+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:42:09.033250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326320+0000","last_change":"2023-11-04T01:37:55.320060+0000","last_active":"2023-11-04T01:37:56.326320+0000","last_peered":"2023-11-04T01:37:56.326320+0000","last_clean":"2023-11-04T01:37:56.326320+0000","last_became_active":"2023-11-04T01:37:55.319744+0000","last_became_peered":"2023-11-04T01:37:55.319744+0000","last_unstale":"2023-11-04T01:37:56.326320+0000","last_undegraded":"2023-11-04T01:37:56.326320+0000","last_fullsized":"2023-11-04T01:37:56.326320+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:42:17.081453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327757+0000","last_change":"2023-11-04T01:37:55.313090+0000","last_active":"2023-11-04T01:37:56.327757+0000","last_peered":"2023-11-04T01:37:56.327757+0000","last_clean":"2023-11-04T01:37:56.327757+0000","last_became_active":"2023-11-04T01:37:55.312818+0000","last_became_peered":"2023-11-04T01:37:55.312818+0000","last_unstale":"2023-11-04T01:37:56.327757+0000","last_undegraded":"2023-11-04T01:37:56.327757+0000","last_fullsized":"2023-11-04T01:37:56.327757+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:04.767143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326776+0000","last_change":"2023-11-04T01:37:55.314397+0000","last_active":"2023-11-04T01:37:56.326776+0000","last_peered":"2023-11-04T01:37:56.326776+0000","last_clean":"2023-11-04T01:37:56.326776+0000","last_became_active":"2023-11-04T01:37:55.314140+0000","last_became_peered":"2023-11-04T01:37:55.314140+0000","last_unstale":"2023-11-04T01:37:56.326776+0000","last_undegraded":"2023-11-04T01:37:56.326776+0000","last_fullsized":"2023-11-04T01:37:56.326776+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:43.319690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326231+0000","last_change":"2023-11-04T01:37:55.312140+0000","last_active":"2023-11-04T01:37:56.326231+0000","last_peered":"2023-11-04T01:37:56.326231+0000","last_clean":"2023-11-04T01:37:56.326231+0000","last_became_active":"2023-11-04T01:37:55.311857+0000","last_became_peered":"2023-11-04T01:37:55.311857+0000","last_unstale":"2023-11-04T01:37:56.326231+0000","last_undegraded":"2023-11-04T01:37:56.326231+0000","last_fullsized":"2023-11-04T01:37:56.326231+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:49:17.287186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.300636+0000","last_change":"2023-11-04T01:37:55.324948+0000","last_active":"2023-11-04T01:37:56.300636+0000","last_peered":"2023-11-04T01:37:56.300636+0000","last_clean":"2023-11-04T01:37:56.300636+0000","last_became_active":"2023-11-04T01:37:55.324676+0000","last_became_peered":"2023-11-04T01:37:55.324676+0000","last_unstale":"2023-11-04T01:37:56.300636+0000","last_undegraded":"2023-11-04T01:37:56.300636+0000","last_fullsized":"2023-11-04T01:37:56.300636+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:56.729998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327070+0000","last_change":"2023-11-04T01:37:55.311646+0000","last_active":"2023-11-04T01:37:56.327070+0000","last_peered":"2023-11-04T01:37:56.327070+0000","last_clean":"2023-11-04T01:37:56.327070+0000","last_became_active":"2023-11-04T01:37:55.311296+0000","last_became_peered":"2023-11-04T01:37:55.311296+0000","last_unstale":"2023-11-04T01:37:56.327070+0000","last_undegraded":"2023-11-04T01:37:56.327070+0000","last_fullsized":"2023-11-04T01:37:56.327070+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:28.325804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301602+0000","last_change":"2023-11-04T01:37:54.309942+0000","last_active":"2023-11-04T01:37:56.301602+0000","last_peered":"2023-11-04T01:37:56.301602+0000","last_clean":"2023-11-04T01:37:56.301602+0000","last_became_active":"2023-11-04T01:37:54.309674+0000","last_became_peered":"2023-11-04T01:37:54.309674+0000","last_unstale":"2023-11-04T01:37:56.301602+0000","last_undegraded":"2023-11-04T01:37:56.301602+0000","last_fullsized":"2023-11-04T01:37:56.301602+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:10.745900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.309284+0000","last_change":"2023-11-04T01:37:36.221026+0000","last_active":"2023-11-04T01:37:55.309284+0000","last_peered":"2023-11-04T01:37:55.309284+0000","last_clean":"2023-11-04T01:37:55.309284+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:37:55.309284+0000","last_undegraded":"2023-11-04T01:37:55.309284+0000","last_fullsized":"2023-11-04T01:37:55.309284+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067716399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326635+0000","last_change":"2023-11-04T01:37:55.319053+0000","last_active":"2023-11-04T01:37:56.326635+0000","last_peered":"2023-11-04T01:37:56.326635+0000","last_clean":"2023-11-04T01:37:56.326635+0000","last_became_active":"2023-11-04T01:37:55.318588+0000","last_became_peered":"2023-11-04T01:37:55.318588+0000","last_unstale":"2023-11-04T01:37:56.326635+0000","last_undegraded":"2023-11-04T01:37:56.326635+0000","last_fullsized":"2023-11-04T01:37:56.326635+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:43.319690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327624+0000","last_change":"2023-11-04T01:37:54.312565+0000","last_active":"2023-11-04T01:37:56.327624+0000","last_peered":"2023-11-04T01:37:56.327624+0000","last_clean":"2023-11-04T01:37:56.327624+0000","last_became_active":"2023-11-04T01:37:54.312308+0000","last_became_peered":"2023-11-04T01:37:54.312308+0000","last_unstale":"2023-11-04T01:37:56.327624+0000","last_undegraded":"2023-11-04T01:37:56.327624+0000","last_fullsized":"2023-11-04T01:37:56.327624+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:06.990896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.310952+0000","last_change":"2023-11-04T01:37:36.229027+0000","last_active":"2023-11-04T01:37:55.310952+0000","last_peered":"2023-11-04T01:37:55.310952+0000","last_clean":"2023-11-04T01:37:55.310952+0000","last_became_active":"2023-11-04T01:37:35.218342+0000","last_became_peered":"2023-11-04T01:37:35.218342+0000","last_unstale":"2023-11-04T01:37:55.310952+0000","last_undegraded":"2023-11-04T01:37:55.310952+0000","last_fullsized":"2023-11-04T01:37:55.310952+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059666400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327072+0000","last_change":"2023-11-04T01:37:55.309129+0000","last_active":"2023-11-04T01:37:56.327072+0000","last_peered":"2023-11-04T01:37:56.327072+0000","last_clean":"2023-11-04T01:37:56.327072+0000","last_became_active":"2023-11-04T01:37:55.308863+0000","last_became_peered":"2023-11-04T01:37:55.308863+0000","last_unstale":"2023-11-04T01:37:56.327072+0000","last_undegraded":"2023-11-04T01:37:56.327072+0000","last_fullsized":"2023-11-04T01:37:56.327072+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:16.126675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"55'8","reported_seq":20,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326634+0000","last_change":"2023-11-04T01:37:54.316253+0000","last_active":"2023-11-04T01:37:56.326634+0000","last_peered":"2023-11-04T01:37:56.326634+0000","last_clean":"2023-11-04T01:37:56.326634+0000","last_became_active":"2023-11-04T01:37:54.315961+0000","last_became_peered":"2023-11-04T01:37:54.315961+0000","last_unstale":"2023-11-04T01:37:56.326634+0000","last_undegraded":"2023-11-04T01:37:56.326634+0000","last_fullsized":"2023-11-04T01:37:56.326634+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:44.836684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.306175+0000","last_change":"2023-11-04T01:37:36.222868+0000","last_active":"2023-11-04T01:37:55.306175+0000","last_peered":"2023-11-04T01:37:55.306175+0000","last_clean":"2023-11-04T01:37:55.306175+0000","last_became_active":"2023-11-04T01:37:35.220180+0000","last_became_peered":"2023-11-04T01:37:35.220180+0000","last_unstale":"2023-11-04T01:37:55.306175+0000","last_undegraded":"2023-11-04T01:37:55.306175+0000","last_fullsized":"2023-11-04T01:37:55.306175+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001103574,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301382+0000","last_change":"2023-11-04T01:37:55.319231+0000","last_active":"2023-11-04T01:37:56.301382+0000","last_peered":"2023-11-04T01:37:56.301382+0000","last_clean":"2023-11-04T01:37:56.301382+0000","last_became_active":"2023-11-04T01:37:55.318872+0000","last_became_peered":"2023-11-04T01:37:55.318872+0000","last_unstale":"2023-11-04T01:37:56.301382+0000","last_undegraded":"2023-11-04T01:37:56.301382+0000","last_fullsized":"2023-11-04T01:37:56.301382+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:06:54.625507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326672+0000","last_change":"2023-11-04T01:37:54.308828+0000","last_active":"2023-11-04T01:37:56.326672+0000","last_peered":"2023-11-04T01:37:56.326672+0000","last_clean":"2023-11-04T01:37:56.326672+0000","last_became_active":"2023-11-04T01:37:54.308569+0000","last_became_peered":"2023-11-04T01:37:54.308569+0000","last_unstale":"2023-11-04T01:37:56.326672+0000","last_undegraded":"2023-11-04T01:37:56.326672+0000","last_fullsized":"2023-11-04T01:37:56.326672+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:55:40.555098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.305458+0000","last_change":"2023-11-04T01:37:36.221053+0000","last_active":"2023-11-04T01:37:55.305458+0000","last_peered":"2023-11-04T01:37:55.305458+0000","last_clean":"2023-11-04T01:37:55.305458+0000","last_became_active":"2023-11-04T01:37:35.227176+0000","last_became_peered":"2023-11-04T01:37:35.227176+0000","last_unstale":"2023-11-04T01:37:55.305458+0000","last_undegraded":"2023-11-04T01:37:55.305458+0000","last_fullsized":"2023-11-04T01:37:55.305458+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000594178,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327798+0000","last_change":"2023-11-04T01:37:55.309134+0000","last_active":"2023-11-04T01:37:56.327798+0000","last_peered":"2023-11-04T01:37:56.327798+0000","last_clean":"2023-11-04T01:37:56.327798+0000","last_became_active":"2023-11-04T01:37:55.308841+0000","last_became_peered":"2023-11-04T01:37:55.308841+0000","last_unstale":"2023-11-04T01:37:56.327798+0000","last_undegraded":"2023-11-04T01:37:56.327798+0000","last_fullsized":"2023-11-04T01:37:56.327798+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:41.419871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327589+0000","last_change":"2023-11-04T01:37:54.313597+0000","last_active":"2023-11-04T01:37:56.327589+0000","last_peered":"2023-11-04T01:37:56.327589+0000","last_clean":"2023-11-04T01:37:56.327589+0000","last_became_active":"2023-11-04T01:37:54.313170+0000","last_became_peered":"2023-11-04T01:37:54.313170+0000","last_unstale":"2023-11-04T01:37:56.327589+0000","last_undegraded":"2023-11-04T01:37:56.327589+0000","last_fullsized":"2023-11-04T01:37:56.327589+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:02.749026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.307187+0000","last_change":"2023-11-04T01:37:36.221842+0000","last_active":"2023-11-04T01:37:55.307187+0000","last_peered":"2023-11-04T01:37:55.307187+0000","last_clean":"2023-11-04T01:37:55.307187+0000","last_became_active":"2023-11-04T01:37:35.214305+0000","last_became_peered":"2023-11-04T01:37:35.214305+0000","last_unstale":"2023-11-04T01:37:55.307187+0000","last_undegraded":"2023-11-04T01:37:55.307187+0000","last_fullsized":"2023-11-04T01:37:55.307187+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:13:05.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014999690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.302509+0000","last_change":"2023-11-04T01:37:55.320625+0000","last_active":"2023-11-04T01:37:56.302509+0000","last_peered":"2023-11-04T01:37:56.302509+0000","last_clean":"2023-11-04T01:37:56.302509+0000","last_became_active":"2023-11-04T01:37:55.320338+0000","last_became_peered":"2023-11-04T01:37:55.320338+0000","last_unstale":"2023-11-04T01:37:56.302509+0000","last_undegraded":"2023-11-04T01:37:56.302509+0000","last_fullsized":"2023-11-04T01:37:56.302509+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:59.810743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327834+0000","last_change":"2023-11-04T01:37:54.317192+0000","last_active":"2023-11-04T01:37:56.327834+0000","last_peered":"2023-11-04T01:37:56.327834+0000","last_clean":"2023-11-04T01:37:56.327834+0000","last_became_active":"2023-11-04T01:37:54.316904+0000","last_became_peered":"2023-11-04T01:37:54.316904+0000","last_unstale":"2023-11-04T01:37:56.327834+0000","last_undegraded":"2023-11-04T01:37:56.327834+0000","last_fullsized":"2023-11-04T01:37:56.327834+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:31:31.305858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.313040+0000","last_change":"2023-11-04T01:37:36.694601+0000","last_active":"2023-11-04T01:37:55.313040+0000","last_peered":"2023-11-04T01:37:55.313040+0000","last_clean":"2023-11-04T01:37:55.313040+0000","last_became_active":"2023-11-04T01:37:35.223746+0000","last_became_peered":"2023-11-04T01:37:35.223746+0000","last_unstale":"2023-11-04T01:37:55.313040+0000","last_undegraded":"2023-11-04T01:37:55.313040+0000","last_fullsized":"2023-11-04T01:37:55.313040+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:35.960485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000555376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327422+0000","last_change":"2023-11-04T01:37:55.317719+0000","last_active":"2023-11-04T01:37:56.327422+0000","last_peered":"2023-11-04T01:37:56.327422+0000","last_clean":"2023-11-04T01:37:56.327422+0000","last_became_active":"2023-11-04T01:37:55.317431+0000","last_became_peered":"2023-11-04T01:37:55.317431+0000","last_unstale":"2023-11-04T01:37:56.327422+0000","last_undegraded":"2023-11-04T01:37:56.327422+0000","last_fullsized":"2023-11-04T01:37:56.327422+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:03.756077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"55'6","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.302538+0000","last_change":"2023-11-04T01:37:54.314000+0000","last_active":"2023-11-04T01:37:56.302538+0000","last_peered":"2023-11-04T01:37:56.302538+0000","last_clean":"2023-11-04T01:37:56.302538+0000","last_became_active":"2023-11-04T01:37:54.313674+0000","last_became_peered":"2023-11-04T01:37:54.313674+0000","last_unstale":"2023-11-04T01:37:56.302538+0000","last_undegraded":"2023-11-04T01:37:56.302538+0000","last_fullsized":"2023-11-04T01:37:56.302538+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:31.208700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.312536+0000","last_change":"2023-11-04T01:37:36.695075+0000","last_active":"2023-11-04T01:37:55.312536+0000","last_peered":"2023-11-04T01:37:55.312536+0000","last_clean":"2023-11-04T01:37:55.312536+0000","last_became_active":"2023-11-04T01:37:35.221165+0000","last_became_peered":"2023-11-04T01:37:35.221165+0000","last_unstale":"2023-11-04T01:37:55.312536+0000","last_undegraded":"2023-11-04T01:37:55.312536+0000","last_fullsized":"2023-11-04T01:37:55.312536+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:17.958372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072817499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326970+0000","last_change":"2023-11-04T01:37:55.317097+0000","last_active":"2023-11-04T01:37:56.326970+0000","last_peered":"2023-11-04T01:37:56.326970+0000","last_clean":"2023-11-04T01:37:56.326970+0000","last_became_active":"2023-11-04T01:37:55.316472+0000","last_became_peered":"2023-11-04T01:37:55.316472+0000","last_unstale":"2023-11-04T01:37:56.326970+0000","last_undegraded":"2023-11-04T01:37:56.326970+0000","last_fullsized":"2023-11-04T01:37:56.326970+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:55.384004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"55'3","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327097+0000","last_change":"2023-11-04T01:37:54.319467+0000","last_active":"2023-11-04T01:37:56.327097+0000","last_peered":"2023-11-04T01:37:56.327097+0000","last_clean":"2023-11-04T01:37:56.327097+0000","last_became_active":"2023-11-04T01:37:54.319252+0000","last_became_peered":"2023-11-04T01:37:54.319252+0000","last_unstale":"2023-11-04T01:37:56.327097+0000","last_undegraded":"2023-11-04T01:37:56.327097+0000","last_fullsized":"2023-11-04T01:37:56.327097+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:46:20.176864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.307581+0000","last_change":"2023-11-04T01:37:36.221747+0000","last_active":"2023-11-04T01:37:55.307581+0000","last_peered":"2023-11-04T01:37:55.307581+0000","last_clean":"2023-11-04T01:37:55.307581+0000","last_became_active":"2023-11-04T01:37:35.223198+0000","last_became_peered":"2023-11-04T01:37:35.223198+0000","last_unstale":"2023-11-04T01:37:55.307581+0000","last_undegraded":"2023-11-04T01:37:55.307581+0000","last_fullsized":"2023-11-04T01:37:55.307581+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097726499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327655+0000","last_change":"2023-11-04T01:37:55.316430+0000","last_active":"2023-11-04T01:37:56.327655+0000","last_peered":"2023-11-04T01:37:56.327655+0000","last_clean":"2023-11-04T01:37:56.327655+0000","last_became_active":"2023-11-04T01:37:55.316145+0000","last_became_peered":"2023-11-04T01:37:55.316145+0000","last_unstale":"2023-11-04T01:37:56.327655+0000","last_undegraded":"2023-11-04T01:37:56.327655+0000","last_fullsized":"2023-11-04T01:37:56.327655+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:26.742257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.300819+0000","last_change":"2023-11-04T01:37:54.313345+0000","last_active":"2023-11-04T01:37:56.300819+0000","last_peered":"2023-11-04T01:37:56.300819+0000","last_clean":"2023-11-04T01:37:56.300819+0000","last_became_active":"2023-11-04T01:37:54.312629+0000","last_became_peered":"2023-11-04T01:37:54.312629+0000","last_unstale":"2023-11-04T01:37:56.300819+0000","last_undegraded":"2023-11-04T01:37:56.300819+0000","last_fullsized":"2023-11-04T01:37:56.300819+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:29.806110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.301775+0000","last_change":"2023-11-04T01:37:36.422496+0000","last_active":"2023-11-04T01:37:55.301775+0000","last_peered":"2023-11-04T01:37:55.301775+0000","last_clean":"2023-11-04T01:37:55.301775+0000","last_became_active":"2023-11-04T01:37:35.221763+0000","last_became_peered":"2023-11-04T01:37:35.221763+0000","last_unstale":"2023-11-04T01:37:55.301775+0000","last_undegraded":"2023-11-04T01:37:55.301775+0000","last_fullsized":"2023-11-04T01:37:55.301775+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073676299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327389+0000","last_change":"2023-11-04T01:37:55.315869+0000","last_active":"2023-11-04T01:37:56.327389+0000","last_peered":"2023-11-04T01:37:56.327389+0000","last_clean":"2023-11-04T01:37:56.327389+0000","last_became_active":"2023-11-04T01:37:55.315565+0000","last_became_peered":"2023-11-04T01:37:55.315565+0000","last_unstale":"2023-11-04T01:37:56.327389+0000","last_undegraded":"2023-11-04T01:37:56.327389+0000","last_fullsized":"2023-11-04T01:37:56.327389+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:11.510821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.302458+0000","last_change":"2023-11-04T01:37:54.313576+0000","last_active":"2023-11-04T01:37:56.302458+0000","last_peered":"2023-11-04T01:37:56.302458+0000","last_clean":"2023-11-04T01:37:56.302458+0000","last_became_active":"2023-11-04T01:37:54.313224+0000","last_became_peered":"2023-11-04T01:37:54.313224+0000","last_unstale":"2023-11-04T01:37:56.302458+0000","last_undegraded":"2023-11-04T01:37:56.302458+0000","last_fullsized":"2023-11-04T01:37:56.302458+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:20:57.032209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.301382+0000","last_change":"2023-11-04T01:37:36.229940+0000","last_active":"2023-11-04T01:37:55.301382+0000","last_peered":"2023-11-04T01:37:55.301382+0000","last_clean":"2023-11-04T01:37:55.301382+0000","last_became_active":"2023-11-04T01:37:35.225121+0000","last_became_peered":"2023-11-04T01:37:35.225121+0000","last_unstale":"2023-11-04T01:37:55.301382+0000","last_undegraded":"2023-11-04T01:37:55.301382+0000","last_fullsized":"2023-11-04T01:37:55.301382+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:12.130671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075648399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327125+0000","last_change":"2023-11-04T01:37:55.316806+0000","last_active":"2023-11-04T01:37:56.327125+0000","last_peered":"2023-11-04T01:37:56.327125+0000","last_clean":"2023-11-04T01:37:56.327125+0000","last_became_active":"2023-11-04T01:37:55.316483+0000","last_became_peered":"2023-11-04T01:37:55.316483+0000","last_unstale":"2023-11-04T01:37:56.327125+0000","last_undegraded":"2023-11-04T01:37:56.327125+0000","last_fullsized":"2023-11-04T01:37:56.327125+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:41.757354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301980+0000","last_change":"2023-11-04T01:37:54.315437+0000","last_active":"2023-11-04T01:37:56.301980+0000","last_peered":"2023-11-04T01:37:56.301980+0000","last_clean":"2023-11-04T01:37:56.301980+0000","last_became_active":"2023-11-04T01:37:54.315159+0000","last_became_peered":"2023-11-04T01:37:54.315159+0000","last_unstale":"2023-11-04T01:37:56.301980+0000","last_undegraded":"2023-11-04T01:37:56.301980+0000","last_fullsized":"2023-11-04T01:37:56.301980+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:54:06.702017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.301302+0000","last_change":"2023-11-04T01:37:36.422801+0000","last_active":"2023-11-04T01:37:55.301302+0000","last_peered":"2023-11-04T01:37:55.301302+0000","last_clean":"2023-11-04T01:37:55.301302+0000","last_became_active":"2023-11-04T01:37:35.217091+0000","last_became_peered":"2023-11-04T01:37:35.217091+0000","last_unstale":"2023-11-04T01:37:55.301302+0000","last_undegraded":"2023-11-04T01:37:55.301302+0000","last_fullsized":"2023-11-04T01:37:55.301302+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082211999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301537+0000","last_change":"2023-11-04T01:37:55.320360+0000","last_active":"2023-11-04T01:37:56.301537+0000","last_peered":"2023-11-04T01:37:56.301537+0000","last_clean":"2023-11-04T01:37:56.301537+0000","last_became_active":"2023-11-04T01:37:55.320078+0000","last_became_peered":"2023-11-04T01:37:55.320078+0000","last_unstale":"2023-11-04T01:37:56.301537+0000","last_undegraded":"2023-11-04T01:37:56.301537+0000","last_fullsized":"2023-11-04T01:37:56.301537+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:31.951818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326577+0000","last_change":"2023-11-04T01:37:54.313354+0000","last_active":"2023-11-04T01:37:56.326577+0000","last_peered":"2023-11-04T01:37:56.326577+0000","last_clean":"2023-11-04T01:37:56.326577+0000","last_became_active":"2023-11-04T01:37:54.313063+0000","last_became_peered":"2023-11-04T01:37:54.313063+0000","last_unstale":"2023-11-04T01:37:56.326577+0000","last_undegraded":"2023-11-04T01:37:56.326577+0000","last_fullsized":"2023-11-04T01:37:56.326577+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:14.596009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.306646+0000","last_change":"2023-11-04T01:37:36.222683+0000","last_active":"2023-11-04T01:37:55.306646+0000","last_peered":"2023-11-04T01:37:55.306646+0000","last_clean":"2023-11-04T01:37:55.306646+0000","last_became_active":"2023-11-04T01:37:35.222694+0000","last_became_peered":"2023-11-04T01:37:35.222694+0000","last_unstale":"2023-11-04T01:37:55.306646+0000","last_undegraded":"2023-11-04T01:37:55.306646+0000","last_fullsized":"2023-11-04T01:37:55.306646+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000490194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327411+0000","last_change":"2023-11-04T01:37:55.319085+0000","last_active":"2023-11-04T01:37:56.327411+0000","last_peered":"2023-11-04T01:37:56.327411+0000","last_clean":"2023-11-04T01:37:56.327411+0000","last_became_active":"2023-11-04T01:37:55.318788+0000","last_became_peered":"2023-11-04T01:37:55.318788+0000","last_unstale":"2023-11-04T01:37:56.327411+0000","last_undegraded":"2023-11-04T01:37:56.327411+0000","last_fullsized":"2023-11-04T01:37:56.327411+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:53.984298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327496+0000","last_change":"2023-11-04T01:37:54.313428+0000","last_active":"2023-11-04T01:37:56.327496+0000","last_peered":"2023-11-04T01:37:56.327496+0000","last_clean":"2023-11-04T01:37:56.327496+0000","last_became_active":"2023-11-04T01:37:54.312837+0000","last_became_peered":"2023-11-04T01:37:54.312837+0000","last_unstale":"2023-11-04T01:37:56.327496+0000","last_undegraded":"2023-11-04T01:37:56.327496+0000","last_fullsized":"2023-11-04T01:37:56.327496+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:42:08.026200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.301720+0000","last_change":"2023-11-04T01:37:36.422156+0000","last_active":"2023-11-04T01:37:55.301720+0000","last_peered":"2023-11-04T01:37:55.301720+0000","last_clean":"2023-11-04T01:37:55.301720+0000","last_became_active":"2023-11-04T01:37:35.214925+0000","last_became_peered":"2023-11-04T01:37:35.214925+0000","last_unstale":"2023-11-04T01:37:55.301720+0000","last_undegraded":"2023-11-04T01:37:55.301720+0000","last_fullsized":"2023-11-04T01:37:55.301720+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058029000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301123+0000","last_change":"2023-11-04T01:37:55.320552+0000","last_active":"2023-11-04T01:37:56.301123+0000","last_peered":"2023-11-04T01:37:56.301123+0000","last_clean":"2023-11-04T01:37:56.301123+0000","last_became_active":"2023-11-04T01:37:55.320285+0000","last_became_peered":"2023-11-04T01:37:55.320285+0000","last_unstale":"2023-11-04T01:37:56.301123+0000","last_undegraded":"2023-11-04T01:37:56.301123+0000","last_fullsized":"2023-11-04T01:37:56.301123+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:41.419871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"55'4","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301191+0000","last_change":"2023-11-04T01:37:54.313329+0000","last_active":"2023-11-04T01:37:56.301191+0000","last_peered":"2023-11-04T01:37:56.301191+0000","last_clean":"2023-11-04T01:37:56.301191+0000","last_became_active":"2023-11-04T01:37:54.312982+0000","last_became_peered":"2023-11-04T01:37:54.312982+0000","last_unstale":"2023-11-04T01:37:56.301191+0000","last_undegraded":"2023-11-04T01:37:56.301191+0000","last_fullsized":"2023-11-04T01:37:56.301191+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:03:13.897729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.300310+0000","last_change":"2023-11-04T01:37:36.229258+0000","last_active":"2023-11-04T01:37:55.300310+0000","last_peered":"2023-11-04T01:37:55.300310+0000","last_clean":"2023-11-04T01:37:55.300310+0000","last_became_active":"2023-11-04T01:37:35.221720+0000","last_became_peered":"2023-11-04T01:37:35.221720+0000","last_unstale":"2023-11-04T01:37:55.300310+0000","last_undegraded":"2023-11-04T01:37:55.300310+0000","last_fullsized":"2023-11-04T01:37:55.300310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:09.633236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068644799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301406+0000","last_change":"2023-11-04T01:37:55.322064+0000","last_active":"2023-11-04T01:37:56.301406+0000","last_peered":"2023-11-04T01:37:56.301406+0000","last_clean":"2023-11-04T01:37:56.301406+0000","last_became_active":"2023-11-04T01:37:55.321810+0000","last_became_peered":"2023-11-04T01:37:55.321810+0000","last_unstale":"2023-11-04T01:37:56.301406+0000","last_undegraded":"2023-11-04T01:37:56.301406+0000","last_fullsized":"2023-11-04T01:37:56.301406+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:19.420233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327240+0000","last_change":"2023-11-04T01:37:54.314347+0000","last_active":"2023-11-04T01:37:56.327240+0000","last_peered":"2023-11-04T01:37:56.327240+0000","last_clean":"2023-11-04T01:37:56.327240+0000","last_became_active":"2023-11-04T01:37:54.313831+0000","last_became_peered":"2023-11-04T01:37:54.313831+0000","last_unstale":"2023-11-04T01:37:56.327240+0000","last_undegraded":"2023-11-04T01:37:56.327240+0000","last_fullsized":"2023-11-04T01:37:56.327240+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:29.806110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.312615+0000","last_change":"2023-11-04T01:37:36.695175+0000","last_active":"2023-11-04T01:37:55.312615+0000","last_peered":"2023-11-04T01:37:55.312615+0000","last_clean":"2023-11-04T01:37:55.312615+0000","last_became_active":"2023-11-04T01:37:35.224473+0000","last_became_peered":"2023-11-04T01:37:35.224473+0000","last_unstale":"2023-11-04T01:37:55.312615+0000","last_undegraded":"2023-11-04T01:37:55.312615+0000","last_fullsized":"2023-11-04T01:37:55.312615+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065377199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301076+0000","last_change":"2023-11-04T01:37:55.318710+0000","last_active":"2023-11-04T01:37:56.301076+0000","last_peered":"2023-11-04T01:37:56.301076+0000","last_clean":"2023-11-04T01:37:56.301076+0000","last_became_active":"2023-11-04T01:37:55.318035+0000","last_became_peered":"2023-11-04T01:37:55.318035+0000","last_unstale":"2023-11-04T01:37:56.301076+0000","last_undegraded":"2023-11-04T01:37:56.301076+0000","last_fullsized":"2023-11-04T01:37:56.301076+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:16.762583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301256+0000","last_change":"2023-11-04T01:37:54.313146+0000","last_active":"2023-11-04T01:37:56.301256+0000","last_peered":"2023-11-04T01:37:56.301256+0000","last_clean":"2023-11-04T01:37:56.301256+0000","last_became_active":"2023-11-04T01:37:54.312857+0000","last_became_peered":"2023-11-04T01:37:54.312857+0000","last_unstale":"2023-11-04T01:37:56.301256+0000","last_undegraded":"2023-11-04T01:37:56.301256+0000","last_fullsized":"2023-11-04T01:37:56.301256+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:06.990896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.304966+0000","last_change":"2023-11-04T01:37:36.222100+0000","last_active":"2023-11-04T01:37:55.304966+0000","last_peered":"2023-11-04T01:37:55.304966+0000","last_clean":"2023-11-04T01:37:55.304966+0000","last_became_active":"2023-11-04T01:37:35.219622+0000","last_became_peered":"2023-11-04T01:37:35.219622+0000","last_unstale":"2023-11-04T01:37:55.304966+0000","last_undegraded":"2023-11-04T01:37:55.304966+0000","last_fullsized":"2023-11-04T01:37:55.304966+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:16.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653496,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327222+0000","last_change":"2023-11-04T01:37:55.308533+0000","last_active":"2023-11-04T01:37:56.327222+0000","last_peered":"2023-11-04T01:37:56.327222+0000","last_clean":"2023-11-04T01:37:56.327222+0000","last_became_active":"2023-11-04T01:37:55.308246+0000","last_became_peered":"2023-11-04T01:37:55.308246+0000","last_unstale":"2023-11-04T01:37:56.327222+0000","last_undegraded":"2023-11-04T01:37:56.327222+0000","last_fullsized":"2023-11-04T01:37:56.327222+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:00.481215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.302270+0000","last_change":"2023-11-04T01:37:54.314171+0000","last_active":"2023-11-04T01:37:56.302270+0000","last_peered":"2023-11-04T01:37:56.302270+0000","last_clean":"2023-11-04T01:37:56.302270+0000","last_became_active":"2023-11-04T01:37:54.313869+0000","last_became_peered":"2023-11-04T01:37:54.313869+0000","last_unstale":"2023-11-04T01:37:56.302270+0000","last_undegraded":"2023-11-04T01:37:56.302270+0000","last_fullsized":"2023-11-04T01:37:56.302270+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:55.938602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.305354+0000","last_change":"2023-11-04T01:37:36.222451+0000","last_active":"2023-11-04T01:37:55.305354+0000","last_peered":"2023-11-04T01:37:55.305354+0000","last_clean":"2023-11-04T01:37:55.305354+0000","last_became_active":"2023-11-04T01:37:35.221090+0000","last_became_peered":"2023-11-04T01:37:35.221090+0000","last_unstale":"2023-11-04T01:37:55.305354+0000","last_undegraded":"2023-11-04T01:37:55.305354+0000","last_fullsized":"2023-11-04T01:37:55.305354+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077263799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327531+0000","last_change":"2023-11-04T01:37:55.314270+0000","last_active":"2023-11-04T01:37:56.327531+0000","last_peered":"2023-11-04T01:37:56.327531+0000","last_clean":"2023-11-04T01:37:56.327531+0000","last_became_active":"2023-11-04T01:37:55.313961+0000","last_became_peered":"2023-11-04T01:37:55.313961+0000","last_unstale":"2023-11-04T01:37:56.327531+0000","last_undegraded":"2023-11-04T01:37:56.327531+0000","last_fullsized":"2023-11-04T01:37:56.327531+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:26.038913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326674+0000","last_change":"2023-11-04T01:37:54.306752+0000","last_active":"2023-11-04T01:37:56.326674+0000","last_peered":"2023-11-04T01:37:56.326674+0000","last_clean":"2023-11-04T01:37:56.326674+0000","last_became_active":"2023-11-04T01:37:54.306427+0000","last_became_peered":"2023-11-04T01:37:54.306427+0000","last_unstale":"2023-11-04T01:37:56.326674+0000","last_undegraded":"2023-11-04T01:37:56.326674+0000","last_fullsized":"2023-11-04T01:37:56.326674+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:46.187528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.305102+0000","last_change":"2023-11-04T01:37:36.222643+0000","last_active":"2023-11-04T01:37:55.305102+0000","last_peered":"2023-11-04T01:37:55.305102+0000","last_clean":"2023-11-04T01:37:55.305102+0000","last_became_active":"2023-11-04T01:37:35.215534+0000","last_became_peered":"2023-11-04T01:37:35.215534+0000","last_unstale":"2023-11-04T01:37:55.305102+0000","last_undegraded":"2023-11-04T01:37:55.305102+0000","last_fullsized":"2023-11-04T01:37:55.305102+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011110530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327262+0000","last_change":"2023-11-04T01:37:55.311770+0000","last_active":"2023-11-04T01:37:56.327262+0000","last_peered":"2023-11-04T01:37:56.327262+0000","last_clean":"2023-11-04T01:37:56.327262+0000","last_became_active":"2023-11-04T01:37:55.311455+0000","last_became_peered":"2023-11-04T01:37:55.311455+0000","last_unstale":"2023-11-04T01:37:56.327262+0000","last_undegraded":"2023-11-04T01:37:56.327262+0000","last_fullsized":"2023-11-04T01:37:56.327262+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:48:20.516213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326600+0000","last_change":"2023-11-04T01:37:54.313034+0000","last_active":"2023-11-04T01:37:56.326600+0000","last_peered":"2023-11-04T01:37:56.326600+0000","last_clean":"2023-11-04T01:37:56.326600+0000","last_became_active":"2023-11-04T01:37:54.312761+0000","last_became_peered":"2023-11-04T01:37:54.312761+0000","last_unstale":"2023-11-04T01:37:56.326600+0000","last_undegraded":"2023-11-04T01:37:56.326600+0000","last_fullsized":"2023-11-04T01:37:56.326600+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:14.596009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.313643+0000","last_change":"2023-11-04T01:37:36.695402+0000","last_active":"2023-11-04T01:37:55.313643+0000","last_peered":"2023-11-04T01:37:55.313643+0000","last_clean":"2023-11-04T01:37:55.313643+0000","last_became_active":"2023-11-04T01:37:35.220346+0000","last_became_peered":"2023-11-04T01:37:35.220346+0000","last_unstale":"2023-11-04T01:37:55.313643+0000","last_undegraded":"2023-11-04T01:37:55.313643+0000","last_fullsized":"2023-11-04T01:37:55.313643+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062230100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326432+0000","last_change":"2023-11-04T01:37:55.315450+0000","last_active":"2023-11-04T01:37:56.326432+0000","last_peered":"2023-11-04T01:37:56.326432+0000","last_clean":"2023-11-04T01:37:56.326432+0000","last_became_active":"2023-11-04T01:37:55.315173+0000","last_became_peered":"2023-11-04T01:37:55.315173+0000","last_unstale":"2023-11-04T01:37:56.326432+0000","last_undegraded":"2023-11-04T01:37:56.326432+0000","last_fullsized":"2023-11-04T01:37:56.326432+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:45.843734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326528+0000","last_change":"2023-11-04T01:37:54.310743+0000","last_active":"2023-11-04T01:37:56.326528+0000","last_peered":"2023-11-04T01:37:56.326528+0000","last_clean":"2023-11-04T01:37:56.326528+0000","last_became_active":"2023-11-04T01:37:54.310437+0000","last_became_peered":"2023-11-04T01:37:54.310437+0000","last_unstale":"2023-11-04T01:37:56.326528+0000","last_undegraded":"2023-11-04T01:37:56.326528+0000","last_fullsized":"2023-11-04T01:37:56.326528+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:55.938602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":30,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.301873+0000","last_change":"2023-11-04T01:37:36.426315+0000","last_active":"2023-11-04T01:37:55.301873+0000","last_peered":"2023-11-04T01:37:55.301873+0000","last_clean":"2023-11-04T01:37:55.301873+0000","last_became_active":"2023-11-04T01:37:35.223958+0000","last_became_peered":"2023-11-04T01:37:35.223958+0000","last_unstale":"2023-11-04T01:37:55.301873+0000","last_undegraded":"2023-11-04T01:37:55.301873+0000","last_fullsized":"2023-11-04T01:37:55.301873+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:46.733116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025167400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327651+0000","last_change":"2023-11-04T01:37:55.322278+0000","last_active":"2023-11-04T01:37:56.327651+0000","last_peered":"2023-11-04T01:37:56.327651+0000","last_clean":"2023-11-04T01:37:56.327651+0000","last_became_active":"2023-11-04T01:37:55.321982+0000","last_became_peered":"2023-11-04T01:37:55.321982+0000","last_unstale":"2023-11-04T01:37:56.327651+0000","last_undegraded":"2023-11-04T01:37:56.327651+0000","last_fullsized":"2023-11-04T01:37:56.327651+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:00.481215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301398+0000","last_change":"2023-11-04T01:37:54.313085+0000","last_active":"2023-11-04T01:37:56.301398+0000","last_peered":"2023-11-04T01:37:56.301398+0000","last_clean":"2023-11-04T01:37:56.301398+0000","last_became_active":"2023-11-04T01:37:54.312779+0000","last_became_peered":"2023-11-04T01:37:54.312779+0000","last_unstale":"2023-11-04T01:37:56.301398+0000","last_undegraded":"2023-11-04T01:37:56.301398+0000","last_fullsized":"2023-11-04T01:37:56.301398+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:42.312639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.312939+0000","last_change":"2023-11-04T01:37:36.694540+0000","last_active":"2023-11-04T01:37:55.312939+0000","last_peered":"2023-11-04T01:37:55.312939+0000","last_clean":"2023-11-04T01:37:55.312939+0000","last_became_active":"2023-11-04T01:37:35.225863+0000","last_became_peered":"2023-11-04T01:37:35.225863+0000","last_unstale":"2023-11-04T01:37:55.312939+0000","last_undegraded":"2023-11-04T01:37:55.312939+0000","last_fullsized":"2023-11-04T01:37:55.312939+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:42.654853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042277299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327384+0000","last_change":"2023-11-04T01:37:55.321381+0000","last_active":"2023-11-04T01:37:56.327384+0000","last_peered":"2023-11-04T01:37:56.327384+0000","last_clean":"2023-11-04T01:37:56.327384+0000","last_became_active":"2023-11-04T01:37:55.321106+0000","last_became_peered":"2023-11-04T01:37:55.321106+0000","last_unstale":"2023-11-04T01:37:56.327384+0000","last_undegraded":"2023-11-04T01:37:56.327384+0000","last_fullsized":"2023-11-04T01:37:56.327384+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:28.325804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327502+0000","last_change":"2023-11-04T01:37:54.313697+0000","last_active":"2023-11-04T01:37:56.327502+0000","last_peered":"2023-11-04T01:37:56.327502+0000","last_clean":"2023-11-04T01:37:56.327502+0000","last_became_active":"2023-11-04T01:37:54.313440+0000","last_became_peered":"2023-11-04T01:37:54.313440+0000","last_unstale":"2023-11-04T01:37:56.327502+0000","last_undegraded":"2023-11-04T01:37:56.327502+0000","last_fullsized":"2023-11-04T01:37:56.327502+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:31.208700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.301679+0000","last_change":"2023-11-04T01:37:36.426202+0000","last_active":"2023-11-04T01:37:55.301679+0000","last_peered":"2023-11-04T01:37:55.301679+0000","last_clean":"2023-11-04T01:37:55.301679+0000","last_became_active":"2023-11-04T01:37:35.222997+0000","last_became_peered":"2023-11-04T01:37:35.222997+0000","last_unstale":"2023-11-04T01:37:55.301679+0000","last_undegraded":"2023-11-04T01:37:55.301679+0000","last_fullsized":"2023-11-04T01:37:55.301679+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:18.980751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041393700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301128+0000","last_change":"2023-11-04T01:37:55.322718+0000","last_active":"2023-11-04T01:37:56.301128+0000","last_peered":"2023-11-04T01:37:56.301128+0000","last_clean":"2023-11-04T01:37:56.301128+0000","last_became_active":"2023-11-04T01:37:55.322424+0000","last_became_peered":"2023-11-04T01:37:55.322424+0000","last_unstale":"2023-11-04T01:37:56.301128+0000","last_undegraded":"2023-11-04T01:37:56.301128+0000","last_fullsized":"2023-11-04T01:37:56.301128+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:46.960958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327303+0000","last_change":"2023-11-04T01:37:54.313128+0000","last_active":"2023-11-04T01:37:56.327303+0000","last_peered":"2023-11-04T01:37:56.327303+0000","last_clean":"2023-11-04T01:37:56.327303+0000","last_became_active":"2023-11-04T01:37:54.312849+0000","last_became_peered":"2023-11-04T01:37:54.312849+0000","last_unstale":"2023-11-04T01:37:56.327303+0000","last_undegraded":"2023-11-04T01:37:56.327303+0000","last_fullsized":"2023-11-04T01:37:56.327303+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:30.142280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.304385+0000","last_change":"2023-11-04T01:37:36.220713+0000","last_active":"2023-11-04T01:37:55.304385+0000","last_peered":"2023-11-04T01:37:55.304385+0000","last_clean":"2023-11-04T01:37:55.304385+0000","last_became_active":"2023-11-04T01:37:35.220311+0000","last_became_peered":"2023-11-04T01:37:35.220311+0000","last_unstale":"2023-11-04T01:37:55.304385+0000","last_undegraded":"2023-11-04T01:37:55.304385+0000","last_fullsized":"2023-11-04T01:37:55.304385+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062999799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327092+0000","last_change":"2023-11-04T01:37:55.317285+0000","last_active":"2023-11-04T01:37:56.327092+0000","last_peered":"2023-11-04T01:37:56.327092+0000","last_clean":"2023-11-04T01:37:56.327092+0000","last_became_active":"2023-11-04T01:37:55.316829+0000","last_became_peered":"2023-11-04T01:37:55.316829+0000","last_unstale":"2023-11-04T01:37:56.327092+0000","last_undegraded":"2023-11-04T01:37:56.327092+0000","last_fullsized":"2023-11-04T01:37:56.327092+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:59.810743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301894+0000","last_change":"2023-11-04T01:37:54.311693+0000","last_active":"2023-11-04T01:37:56.301894+0000","last_peered":"2023-11-04T01:37:56.301894+0000","last_clean":"2023-11-04T01:37:56.301894+0000","last_became_active":"2023-11-04T01:37:54.311360+0000","last_became_peered":"2023-11-04T01:37:54.311360+0000","last_unstale":"2023-11-04T01:37:56.301894+0000","last_undegraded":"2023-11-04T01:37:56.301894+0000","last_fullsized":"2023-11-04T01:37:56.301894+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:54:06.702017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.300130+0000","last_change":"2023-11-04T01:37:36.229580+0000","last_active":"2023-11-04T01:37:55.300130+0000","last_peered":"2023-11-04T01:37:55.300130+0000","last_clean":"2023-11-04T01:37:55.300130+0000","last_became_active":"2023-11-04T01:37:35.220940+0000","last_became_peered":"2023-11-04T01:37:35.220940+0000","last_unstale":"2023-11-04T01:37:55.300130+0000","last_undegraded":"2023-11-04T01:37:55.300130+0000","last_fullsized":"2023-11-04T01:37:55.300130+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:27.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070235600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.300995+0000","last_change":"2023-11-04T01:37:55.314465+0000","last_active":"2023-11-04T01:37:56.300995+0000","last_peered":"2023-11-04T01:37:56.300995+0000","last_clean":"2023-11-04T01:37:56.300995+0000","last_became_active":"2023-11-04T01:37:55.314163+0000","last_became_peered":"2023-11-04T01:37:55.314163+0000","last_unstale":"2023-11-04T01:37:56.300995+0000","last_undegraded":"2023-11-04T01:37:56.300995+0000","last_fullsized":"2023-11-04T01:37:56.300995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:03.756077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327453+0000","last_change":"2023-11-04T01:37:54.310962+0000","last_active":"2023-11-04T01:37:56.327453+0000","last_peered":"2023-11-04T01:37:56.327453+0000","last_clean":"2023-11-04T01:37:56.327453+0000","last_became_active":"2023-11-04T01:37:54.310693+0000","last_became_peered":"2023-11-04T01:37:54.310693+0000","last_unstale":"2023-11-04T01:37:56.327453+0000","last_undegraded":"2023-11-04T01:37:56.327453+0000","last_fullsized":"2023-11-04T01:37:56.327453+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:06:53.618456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.302457+0000","last_change":"2023-11-04T01:37:36.422542+0000","last_active":"2023-11-04T01:37:55.302457+0000","last_peered":"2023-11-04T01:37:55.302457+0000","last_clean":"2023-11-04T01:37:55.302457+0000","last_became_active":"2023-11-04T01:37:35.224836+0000","last_became_peered":"2023-11-04T01:37:35.224836+0000","last_unstale":"2023-11-04T01:37:55.302457+0000","last_undegraded":"2023-11-04T01:37:55.302457+0000","last_fullsized":"2023-11-04T01:37:55.302457+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066982800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326831+0000","last_change":"2023-11-04T01:37:55.318872+0000","last_active":"2023-11-04T01:37:56.326831+0000","last_peered":"2023-11-04T01:37:56.326831+0000","last_clean":"2023-11-04T01:37:56.326831+0000","last_became_active":"2023-11-04T01:37:55.317666+0000","last_became_peered":"2023-11-04T01:37:55.317666+0000","last_unstale":"2023-11-04T01:37:56.326831+0000","last_undegraded":"2023-11-04T01:37:56.326831+0000","last_fullsized":"2023-11-04T01:37:56.326831+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:39.265071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327744+0000","last_change":"2023-11-04T01:37:54.311447+0000","last_active":"2023-11-04T01:37:56.327744+0000","last_peered":"2023-11-04T01:37:56.327744+0000","last_clean":"2023-11-04T01:37:56.327744+0000","last_became_active":"2023-11-04T01:37:54.311177+0000","last_became_peered":"2023-11-04T01:37:54.311177+0000","last_unstale":"2023-11-04T01:37:56.327744+0000","last_undegraded":"2023-11-04T01:37:56.327744+0000","last_fullsized":"2023-11-04T01:37:56.327744+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:22:59.474164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.312934+0000","last_change":"2023-11-04T01:37:36.694868+0000","last_active":"2023-11-04T01:37:55.312934+0000","last_peered":"2023-11-04T01:37:55.312934+0000","last_clean":"2023-11-04T01:37:55.312934+0000","last_became_active":"2023-11-04T01:37:35.221181+0000","last_became_peered":"2023-11-04T01:37:35.221181+0000","last_unstale":"2023-11-04T01:37:55.312934+0000","last_undegraded":"2023-11-04T01:37:55.312934+0000","last_fullsized":"2023-11-04T01:37:55.312934+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046748800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.300813+0000","last_change":"2023-11-04T01:37:55.320360+0000","last_active":"2023-11-04T01:37:56.300813+0000","last_peered":"2023-11-04T01:37:56.300813+0000","last_clean":"2023-11-04T01:37:56.300813+0000","last_became_active":"2023-11-04T01:37:55.320061+0000","last_became_peered":"2023-11-04T01:37:55.320061+0000","last_unstale":"2023-11-04T01:37:56.300813+0000","last_undegraded":"2023-11-04T01:37:56.300813+0000","last_fullsized":"2023-11-04T01:37:56.300813+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:00.481215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326492+0000","last_change":"2023-11-04T01:37:54.315885+0000","last_active":"2023-11-04T01:37:56.326492+0000","last_peered":"2023-11-04T01:37:56.326492+0000","last_clean":"2023-11-04T01:37:56.326492+0000","last_became_active":"2023-11-04T01:37:54.315431+0000","last_became_peered":"2023-11-04T01:37:54.315431+0000","last_unstale":"2023-11-04T01:37:56.326492+0000","last_undegraded":"2023-11-04T01:37:56.326492+0000","last_fullsized":"2023-11-04T01:37:56.326492+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:05:21.595584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.306253+0000","last_change":"2023-11-04T01:37:36.222930+0000","last_active":"2023-11-04T01:37:55.306253+0000","last_peered":"2023-11-04T01:37:55.306253+0000","last_clean":"2023-11-04T01:37:55.306253+0000","last_became_active":"2023-11-04T01:37:35.220373+0000","last_became_peered":"2023-11-04T01:37:35.220373+0000","last_unstale":"2023-11-04T01:37:55.306253+0000","last_undegraded":"2023-11-04T01:37:55.306253+0000","last_fullsized":"2023-11-04T01:37:55.306253+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074099599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326968+0000","last_change":"2023-11-04T01:37:55.319334+0000","last_active":"2023-11-04T01:37:56.326968+0000","last_peered":"2023-11-04T01:37:56.326968+0000","last_clean":"2023-11-04T01:37:56.326968+0000","last_became_active":"2023-11-04T01:37:55.317142+0000","last_became_peered":"2023-11-04T01:37:55.317142+0000","last_unstale":"2023-11-04T01:37:56.326968+0000","last_undegraded":"2023-11-04T01:37:56.326968+0000","last_fullsized":"2023-11-04T01:37:56.326968+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:03:14.904779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301135+0000","last_change":"2023-11-04T01:37:54.315881+0000","last_active":"2023-11-04T01:37:56.301135+0000","last_peered":"2023-11-04T01:37:56.301135+0000","last_clean":"2023-11-04T01:37:56.301135+0000","last_became_active":"2023-11-04T01:37:54.315640+0000","last_became_peered":"2023-11-04T01:37:54.315640+0000","last_unstale":"2023-11-04T01:37:56.301135+0000","last_undegraded":"2023-11-04T01:37:56.301135+0000","last_fullsized":"2023-11-04T01:37:56.301135+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:38.258020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.306302+0000","last_change":"2023-11-04T01:37:36.221676+0000","last_active":"2023-11-04T01:37:55.306302+0000","last_peered":"2023-11-04T01:37:55.306302+0000","last_clean":"2023-11-04T01:37:55.306302+0000","last_became_active":"2023-11-04T01:37:35.226996+0000","last_became_peered":"2023-11-04T01:37:35.226996+0000","last_unstale":"2023-11-04T01:37:55.306302+0000","last_undegraded":"2023-11-04T01:37:55.306302+0000","last_fullsized":"2023-11-04T01:37:55.306302+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089115500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327664+0000","last_change":"2023-11-04T01:37:55.312077+0000","last_active":"2023-11-04T01:37:56.327664+0000","last_peered":"2023-11-04T01:37:56.327664+0000","last_clean":"2023-11-04T01:37:56.327664+0000","last_became_active":"2023-11-04T01:37:55.311635+0000","last_became_peered":"2023-11-04T01:37:55.311635+0000","last_unstale":"2023-11-04T01:37:56.327664+0000","last_undegraded":"2023-11-04T01:37:56.327664+0000","last_fullsized":"2023-11-04T01:37:56.327664+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:16.762583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327813+0000","last_change":"2023-11-04T01:37:54.311197+0000","last_active":"2023-11-04T01:37:56.327813+0000","last_peered":"2023-11-04T01:37:56.327813+0000","last_clean":"2023-11-04T01:37:56.327813+0000","last_became_active":"2023-11-04T01:37:54.310886+0000","last_became_peered":"2023-11-04T01:37:54.310886+0000","last_unstale":"2023-11-04T01:37:56.327813+0000","last_undegraded":"2023-11-04T01:37:56.327813+0000","last_fullsized":"2023-11-04T01:37:56.327813+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:55.722947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.307588+0000","last_change":"2023-11-04T01:37:36.228535+0000","last_active":"2023-11-04T01:37:55.307588+0000","last_peered":"2023-11-04T01:37:55.307588+0000","last_clean":"2023-11-04T01:37:55.307588+0000","last_became_active":"2023-11-04T01:37:35.221173+0000","last_became_peered":"2023-11-04T01:37:35.221173+0000","last_unstale":"2023-11-04T01:37:55.307588+0000","last_undegraded":"2023-11-04T01:37:55.307588+0000","last_fullsized":"2023-11-04T01:37:55.307588+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049831099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326990+0000","last_change":"2023-11-04T01:37:55.317460+0000","last_active":"2023-11-04T01:37:56.326990+0000","last_peered":"2023-11-04T01:37:56.326990+0000","last_clean":"2023-11-04T01:37:56.326990+0000","last_became_active":"2023-11-04T01:37:55.317189+0000","last_became_peered":"2023-11-04T01:37:55.317189+0000","last_unstale":"2023-11-04T01:37:56.326990+0000","last_undegraded":"2023-11-04T01:37:56.326990+0000","last_fullsized":"2023-11-04T01:37:56.326990+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:56.729998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301162+0000","last_change":"2023-11-04T01:37:54.315337+0000","last_active":"2023-11-04T01:37:56.301162+0000","last_peered":"2023-11-04T01:37:56.301162+0000","last_clean":"2023-11-04T01:37:56.301162+0000","last_became_active":"2023-11-04T01:37:54.315047+0000","last_became_peered":"2023-11-04T01:37:54.315047+0000","last_unstale":"2023-11-04T01:37:56.301162+0000","last_undegraded":"2023-11-04T01:37:56.301162+0000","last_fullsized":"2023-11-04T01:37:56.301162+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:30.142280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.300842+0000","last_change":"2023-11-04T01:37:36.229678+0000","last_active":"2023-11-04T01:37:55.300842+0000","last_peered":"2023-11-04T01:37:55.300842+0000","last_clean":"2023-11-04T01:37:55.300842+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:37:55.300842+0000","last_undegraded":"2023-11-04T01:37:55.300842+0000","last_fullsized":"2023-11-04T01:37:55.300842+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:50.484332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327361+0000","last_change":"2023-11-04T01:37:55.316016+0000","last_active":"2023-11-04T01:37:56.327361+0000","last_peered":"2023-11-04T01:37:56.327361+0000","last_clean":"2023-11-04T01:37:56.327361+0000","last_became_active":"2023-11-04T01:37:55.315159+0000","last_became_peered":"2023-11-04T01:37:55.315159+0000","last_unstale":"2023-11-04T01:37:56.327361+0000","last_undegraded":"2023-11-04T01:37:56.327361+0000","last_fullsized":"2023-11-04T01:37:56.327361+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:10.071946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.327508+0000","last_change":"2023-11-04T01:37:54.314110+0000","last_active":"2023-11-04T01:37:56.327508+0000","last_peered":"2023-11-04T01:37:56.327508+0000","last_clean":"2023-11-04T01:37:56.327508+0000","last_became_active":"2023-11-04T01:37:54.313849+0000","last_became_peered":"2023-11-04T01:37:54.313849+0000","last_unstale":"2023-11-04T01:37:56.327508+0000","last_undegraded":"2023-11-04T01:37:56.327508+0000","last_fullsized":"2023-11-04T01:37:56.327508+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:46:20.176864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":29,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.300244+0000","last_change":"2023-11-04T01:37:36.229908+0000","last_active":"2023-11-04T01:37:55.300244+0000","last_peered":"2023-11-04T01:37:55.300244+0000","last_clean":"2023-11-04T01:37:55.300244+0000","last_became_active":"2023-11-04T01:37:35.221822+0000","last_became_peered":"2023-11-04T01:37:35.221822+0000","last_unstale":"2023-11-04T01:37:55.300244+0000","last_undegraded":"2023-11-04T01:37:55.300244+0000","last_fullsized":"2023-11-04T01:37:55.300244+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:11.866738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089270799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.326521+0000","last_change":"2023-11-04T01:37:55.311709+0000","last_active":"2023-11-04T01:37:56.326521+0000","last_peered":"2023-11-04T01:37:56.326521+0000","last_clean":"2023-11-04T01:37:56.326521+0000","last_became_active":"2023-11-04T01:37:55.311417+0000","last_became_peered":"2023-11-04T01:37:55.311417+0000","last_unstale":"2023-11-04T01:37:56.326521+0000","last_undegraded":"2023-11-04T01:37:56.326521+0000","last_fullsized":"2023-11-04T01:37:56.326521+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:54.288023+0000","last_clean_scrub_stamp":"2023-11-04T01:37:54.288023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:46.960958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-04T01:37:56.301931+0000","last_change":"2023-11-04T01:37:54.307776+0000","last_active":"2023-11-04T01:37:56.301931+0000","last_peered":"2023-11-04T01:37:56.301931+0000","last_clean":"2023-11-04T01:37:56.301931+0000","last_became_active":"2023-11-04T01:37:54.307489+0000","last_became_peered":"2023-11-04T01:37:54.307489+0000","last_unstale":"2023-11-04T01:37:56.301931+0000","last_undegraded":"2023-11-04T01:37:56.301931+0000","last_fullsized":"2023-11-04T01:37:56.301931+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:53.280973+0000","last_clean_scrub_stamp":"2023-11-04T01:37:53.280973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:46.187528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.313020+0000","last_change":"2023-11-04T01:37:36.695345+0000","last_active":"2023-11-04T01:37:55.313020+0000","last_peered":"2023-11-04T01:37:55.313020+0000","last_clean":"2023-11-04T01:37:55.313020+0000","last_became_active":"2023-11-04T01:37:35.225441+0000","last_became_peered":"2023-11-04T01:37:35.225441+0000","last_unstale":"2023-11-04T01:37:55.313020+0000","last_undegraded":"2023-11-04T01:37:55.313020+0000","last_fullsized":"2023-11-04T01:37:55.313020+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052758199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":195,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-04T01:37:55.300332+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:37:55.300332+0000","last_peered":"2023-11-04T01:37:55.300332+0000","last_clean":"2023-11-04T01:37:55.300332+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:37:55.300332+0000","last_undegraded":"2023-11-04T01:37:55.300332+0000","last_fullsized":"2023-11-04T01:37:55.300332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1269760,"data_stored":896420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.503,"15min":0.503},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64000000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.53300000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.745,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.435}]},{"osd":2,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.375,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.51700000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.61199999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46300000000000002,"15min":0.45700000000000002},"min":{"1min":0.314,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.36599999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.32800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.371,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.629}]},{"osd":6,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.45000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.434,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":298919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.443,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53900000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.41099999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":1.004,"15min":1.004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55100000000000005,"15min":0.54100000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76100000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78500000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.46899999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79800000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.63900000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65800000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.624},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":675840,"data_stored":306544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71399999999999997,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.67900000000000005,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45500000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":1.24,"15min":1.24},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.42399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64900000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.48899999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72999999999999998,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67300000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.67200000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.5},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.69699999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72299999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.502,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65300000000000002,"5min":0.877,"15min":0.877},"last":0.36099999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75600000000000001,"5min":1.284,"15min":1.284},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71999999999999997,"5min":0.746,"15min":0.746},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.38100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":667648,"data_stored":300531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.38700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39800000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.317,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76400000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.746,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60699999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78300000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.622},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.433,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":1.022,"15min":1.022},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":1.002,"15min":1.002},"last":0.497},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71699999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.46999999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":1.127,"15min":1.127},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80200000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.55600000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77600000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.747,"5min":1.079,"15min":1.079},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81000000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.629,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":1.093,"15min":1.093},"last":0.66700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":298975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.33400000000000002,"15min":0.34000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.49299999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.48399999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.26900000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.39700000000000002,"15min":0.40799999999999997},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.44600000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.311},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.41799999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.33600000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.57699999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.312,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59499999999999997,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61599999999999999,"15min":0.627},"min":{"1min":0.36299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.752,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.622,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.65900000000000003,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.435},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57899999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80600000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.47699999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79400000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68500000000000005,"15min":0.69699999999999995},"min":{"1min":0.51000000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.752,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":298975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.36099999999999999,"15min":0.371},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.42399999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.36799999999999999,"15min":0.375},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.625,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.38600000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.308},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38200000000000001,"15min":0.38600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.35799999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55500000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.5,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34399999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.621},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65000000000000002,"15min":0.65800000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86299999999999999,"5min":1.052,"15min":1.052},"last":0.58899999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.876,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.67400000000000004,"15min":0.68200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.67500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":659456,"data_stored":299009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32700000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.46500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.496}]},{"osd":2,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.44},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40200000000000002,"15min":0.40400000000000003},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.58699999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58399999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39000000000000001,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.52800000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.77900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":1.02,"15min":1.02},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89700000000000002,"5min":1.089,"15min":1.089},"last":0.81399999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92600000000000005,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.747}]},{"osd":7,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92400000000000004,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96699999999999997,"5min":1.153,"15min":1.153},"last":0.76300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1261568,"data_stored":890462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.35299999999999998,"15min":0.35599999999999998},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47099999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34699999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55200000000000005,"5min":0.629,"15min":0.629},"last":0.36299999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59499999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.48899999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46200000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.28799999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.497,"5min":0.628,"15min":0.628},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65700000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.498}]},{"osd":4,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.45600000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.48399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77200000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.70799999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.59699999999999998},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.80600000000000005,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81999999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.628},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84099999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.622},"min":{"1min":0.47099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81699999999999995,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.495,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86499999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:59.688 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:37:59.689 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:37:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.834+0000 7f0f1e6e5640 1 Processor -- start 2023-11-04T01:37:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.834+0000 7f0f1e6e5640 1 -- start start 2023-11-04T01:37:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.834+0000 7f0f1e6e5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0f18160430 0x7f0f180b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.835+0000 7f0f1e6e5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f180b2b60 0x7f0f1806bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.835+0000 7f0f1e6e5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f180b2fc0 con 0x7f0f1806c1d0 2023-11-04T01:37:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.835+0000 7f0f1e6e5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f180cb580 con 0x7f0f180b2b60 2023-11-04T01:37:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.835+0000 7f0f1e6e5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1806ca40 con 0x7f0f18160430 2023-11-04T01:37:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.835+0000 7f0f177fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f180b2b60 0x7f0f1806bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.835+0000 7f0f177fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f180b2b60 0x7f0f1806bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40700/0 (socket says 172.21.15.44:40700) 2023-11-04T01:37:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.835+0000 7f0f177fe640 1 -- 172.21.15.44:0/594420691 learned_addr learned my addr 172.21.15.44:0/594420691 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.835+0000 7f0f17fff640 1 --2- 172.21.15.44:0/594420691 >> v2:172.21.15.204:3300/0 conn(0x7f0f18160430 0x7f0f180b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.835+0000 7f0f177fe640 1 -- 172.21.15.44:0/594420691 >> v2:172.21.15.204:3300/0 conn(0x7f0f18160430 msgr2=0x7f0f180b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.835+0000 7f0f177fe640 1 --2- 172.21.15.44:0/594420691 >> v2:172.21.15.204:3300/0 conn(0x7f0f18160430 0x7f0f180b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.835+0000 7f0f177fe640 1 -- 172.21.15.44:0/594420691 >> v1:172.21.15.204:6789/0 conn(0x7f0f1806c1d0 legacy=0x7f0f18160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.835+0000 7f0f177fe640 1 -- 172.21.15.44:0/594420691 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1806cd20 con 0x7f0f180b2b60 2023-11-04T01:37:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.836+0000 7f0f177fe640 1 --2- 172.21.15.44:0/594420691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f180b2b60 0x7f0f1806bc90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0f1806f6d0 tx=0x7f0f0c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cec459f2428cda server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.836+0000 7f0f16ffd640 1 -- 172.21.15.44:0/594420691 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c030860 con 0x7f0f180b2b60 2023-11-04T01:37:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.836+0000 7f0f16ffd640 1 -- 172.21.15.44:0/594420691 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0c0309c0 con 0x7f0f180b2b60 2023-11-04T01:37:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.836+0000 7f0f16ffd640 1 -- 172.21.15.44:0/594420691 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c030d50 con 0x7f0f180b2b60 2023-11-04T01:37:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.836+0000 7f0f1e6e5640 1 -- 172.21.15.44:0/594420691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f180b2b60 msgr2=0x7f0f1806bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.836+0000 7f0f1e6e5640 1 --2- 172.21.15.44:0/594420691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f180b2b60 0x7f0f1806bc90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0f1806f6d0 tx=0x7f0f0c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.837+0000 7f0f1e6e5640 1 -- 172.21.15.44:0/594420691 shutdown_connections 2023-11-04T01:37:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.837+0000 7f0f1e6e5640 1 --2- 172.21.15.44:0/594420691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f180b2b60 0x7f0f1806bc90 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.837+0000 7f0f1e6e5640 1 --2- 172.21.15.44:0/594420691 >> v2:172.21.15.204:3300/0 conn(0x7f0f18160430 0x7f0f180b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.837+0000 7f0f1e6e5640 1 -- 172.21.15.44:0/594420691 >> 172.21.15.44:0/594420691 conn(0x7f0f1806ea20 msgr2=0x7f0f1806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.837+0000 7f0f1e6e5640 1 -- 172.21.15.44:0/594420691 shutdown_connections 2023-11-04T01:37:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.837+0000 7f0f1e6e5640 1 -- 172.21.15.44:0/594420691 wait complete. 2023-11-04T01:37:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.838+0000 7f0f1e6e5640 1 Processor -- start 2023-11-04T01:37:59.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.838+0000 7f0f1e6e5640 1 -- start start 2023-11-04T01:37:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f1e6e5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f1806c1d0 0x7f0f18148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f1e6e5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f180b2b60 0x7f0f180cd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f1e6e5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f18160430 0x7f0f180cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f1e6e5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f180c4670 con 0x7f0f18160430 2023-11-04T01:37:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f1e6e5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f180c7380 con 0x7f0f1806c1d0 2023-11-04T01:37:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f1e6e5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f180c4910 con 0x7f0f180b2b60 2023-11-04T01:37:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f1cc82640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f18160430 0x7f0f180cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f1cc82640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f18160430 0x7f0f180cd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40716/0 (socket says 172.21.15.44:40716) 2023-11-04T01:37:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f1cc82640 1 -- 172.21.15.44:0/2595915511 learned_addr learned my addr 172.21.15.44:0/2595915511 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:37:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f17fff640 1 --2- 172.21.15.44:0/2595915511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f1806c1d0 0x7f0f18148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f177fe640 1 --2- 172.21.15.44:0/2595915511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f180b2b60 0x7f0f180cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f1cc82640 1 -- 172.21.15.44:0/2595915511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f180b2b60 msgr2=0x7f0f180cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f1cc82640 1 --2- 172.21.15.44:0/2595915511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f180b2b60 0x7f0f180cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f1cc82640 1 -- 172.21.15.44:0/2595915511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f1806c1d0 msgr2=0x7f0f18148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f1cc82640 1 --2- 172.21.15.44:0/2595915511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f1806c1d0 0x7f0f18148e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f1cc82640 1 -- 172.21.15.44:0/2595915511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c0094d0 con 0x7f0f18160430 2023-11-04T01:37:59.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f17fff640 1 --2- 172.21.15.44:0/2595915511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f1806c1d0 0x7f0f18148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:59.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f1cc82640 1 --2- 172.21.15.44:0/2595915511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f18160430 0x7f0f180cd580 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000c7a0 tx=0x7f0f1000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.839+0000 7f0f14ff9640 1 -- 172.21.15.44:0/2595915511 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10003b70 con 0x7f0f18160430 2023-11-04T01:37:59.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.840+0000 7f0f14ff9640 1 -- 172.21.15.44:0/2595915511 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f10003cf0 con 0x7f0f18160430 2023-11-04T01:37:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.840+0000 7f0f1e6e5640 1 -- 172.21.15.44:0/2595915511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f180c4bf0 con 0x7f0f18160430 2023-11-04T01:37:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.840+0000 7f0f14ff9640 1 -- 172.21.15.44:0/2595915511 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10003ea0 con 0x7f0f18160430 2023-11-04T01:37:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.840+0000 7f0f1e6e5640 1 -- 172.21.15.44:0/2595915511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f18149360 con 0x7f0f18160430 2023-11-04T01:37:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.841+0000 7f0f1e6e5640 1 -- 172.21.15.44:0/2595915511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f180c5110 con 0x7f0f18160430 2023-11-04T01:37:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.841+0000 7f0f14ff9640 1 -- 172.21.15.44:0/2595915511 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f1000aab0 con 0x7f0f18160430 2023-11-04T01:37:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.841+0000 7f0f14ff9640 1 --2- 172.21.15.44:0/2595915511 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0f0406ae70 0x7f0f0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.842+0000 7f0f14ff9640 1 -- 172.21.15.44:0/2595915511 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0f10089770 con 0x7f0f18160430 2023-11-04T01:37:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.842+0000 7f0f17fff640 1 --2- 172.21.15.44:0/2595915511 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0f0406ae70 0x7f0f0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.842+0000 7f0f17fff640 1 --2- 172.21.15.44:0/2595915511 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0f0406ae70 0x7f0f0406d330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009af0 tx=0x7f0f08008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:37:59.846+0000 7f0f14ff9640 1 -- 172.21.15.44:0/2595915511 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f180c5110 con 0x7f0f18160430 2023-11-04T01:38:00.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.089+0000 7f0f1e6e5640 1 -- 172.21.15.44:0/2595915511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0f180c5110 con 0x7f0f18160430 2023-11-04T01:38:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.091+0000 7f0f14ff9640 1 -- 172.21.15.44:0/2595915511 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0f180c5110 con 0x7f0f18160430 2023-11-04T01:38:00.093 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2023-11-04T01:38:00.093 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDEn0VlmqcrLRAAFCsu/sJUUh45gPboIgq6Dw== 2023-11-04T01:38:00.093 INFO:teuthology.orchestra.run.smithi044.stdout: caps mds = "allow" 2023-11-04T01:38:00.094 INFO:teuthology.orchestra.run.smithi044.stdout: caps mon = "allow r" 2023-11-04T01:38:00.094 INFO:teuthology.orchestra.run.smithi044.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:38:00.094 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2023-11-04T01:38:00.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.093+0000 7f0f1e6e5640 1 -- 172.21.15.44:0/2595915511 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0f0406ae70 msgr2=0x7f0f0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.093+0000 7f0f1e6e5640 1 --2- 172.21.15.44:0/2595915511 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0f0406ae70 0x7f0f0406d330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009af0 tx=0x7f0f08008040 comp rx=0 tx=0).stop 2023-11-04T01:38:00.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.093+0000 7f0f1e6e5640 1 -- 172.21.15.44:0/2595915511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f18160430 msgr2=0x7f0f180cd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.093+0000 7f0f1e6e5640 1 --2- 172.21.15.44:0/2595915511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f18160430 0x7f0f180cd580 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000c7a0 tx=0x7f0f1000cc60 comp rx=0 tx=0).stop 2023-11-04T01:38:00.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.093+0000 7f0f1e6e5640 1 -- 172.21.15.44:0/2595915511 shutdown_connections 2023-11-04T01:38:00.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.093+0000 7f0f1e6e5640 1 --2- 172.21.15.44:0/2595915511 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0f0406ae70 0x7f0f0406d330 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.093+0000 7f0f1e6e5640 1 --2- 172.21.15.44:0/2595915511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f18160430 0x7f0f180cd580 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.093+0000 7f0f1e6e5640 1 --2- 172.21.15.44:0/2595915511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f180b2b60 0x7f0f180cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.093+0000 7f0f1e6e5640 1 --2- 172.21.15.44:0/2595915511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f1806c1d0 0x7f0f18148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.093+0000 7f0f1e6e5640 1 -- 172.21.15.44:0/2595915511 >> 172.21.15.44:0/2595915511 conn(0x7f0f1806ea20 msgr2=0x7f0f180b1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:00.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.093+0000 7f0f1e6e5640 1 -- 172.21.15.44:0/2595915511 shutdown_connections 2023-11-04T01:38:00.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.093+0000 7f0f1e6e5640 1 -- 172.21.15.44:0/2595915511 wait complete. 2023-11-04T01:38:00.106 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.210+0000 7fca5d561640 1 Processor -- start 2023-11-04T01:38:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.210+0000 7fca5d561640 1 -- start start 2023-11-04T01:38:00.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.211+0000 7fca5d561640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58159c70 0x7fca580ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.211+0000 7fca5d561640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fca580b0ae0 0x7fca5815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.211+0000 7fca5d561640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca580b4110 con 0x7fca5806db20 2023-11-04T01:38:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.211+0000 7fca5d561640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca580b49b0 con 0x7fca580b0ae0 2023-11-04T01:38:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.211+0000 7fca5d561640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca580b43f0 con 0x7fca58159c70 2023-11-04T01:38:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.211+0000 7fca577fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fca580b0ae0 0x7fca5815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.211+0000 7fca56ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58159c70 0x7fca580ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.211+0000 7fca4ffff640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fca5806db20 0x7fca580b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:57312/0 (socket says 172.21.15.44:57312) 2023-11-04T01:38:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.211+0000 7fca4ffff640 1 -- 172.21.15.44:0/2331826475 learned_addr learned my addr 172.21.15.44:0/2331826475 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.211+0000 7fca577fe640 1 -- 172.21.15.44:0/2331826475 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58159c70 msgr2=0x7fca580ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.211+0000 7fca577fe640 1 --2- 172.21.15.44:0/2331826475 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58159c70 0x7fca580ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.211+0000 7fca577fe640 1 -- 172.21.15.44:0/2331826475 >> v1:172.21.15.204:6789/0 conn(0x7fca5806db20 legacy=0x7fca580b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.211+0000 7fca577fe640 1 -- 172.21.15.44:0/2331826475 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca580b46d0 con 0x7fca580b0ae0 2023-11-04T01:38:00.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.212+0000 7fca577fe640 1 --2- 172.21.15.44:0/2331826475 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca580b0ae0 0x7fca5815d7d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fca5000bfa0 tx=0x7fca5002e0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd27f15b3e10b83b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.212+0000 7fca567fc640 1 -- 172.21.15.44:0/2331826475 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5002ea40 con 0x7fca580b0ae0 2023-11-04T01:38:00.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.212+0000 7fca567fc640 1 -- 172.21.15.44:0/2331826475 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5002eba0 con 0x7fca580b0ae0 2023-11-04T01:38:00.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.213+0000 7fca567fc640 1 -- 172.21.15.44:0/2331826475 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50009540 con 0x7fca580b0ae0 2023-11-04T01:38:00.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.213+0000 7fca5d561640 1 -- 172.21.15.44:0/2331826475 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca580b0ae0 msgr2=0x7fca5815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.213+0000 7fca5d561640 1 --2- 172.21.15.44:0/2331826475 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca580b0ae0 0x7fca5815d7d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fca5000bfa0 tx=0x7fca5002e0a0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.213+0000 7fca5d561640 1 -- 172.21.15.44:0/2331826475 shutdown_connections 2023-11-04T01:38:00.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.213+0000 7fca5d561640 1 --2- 172.21.15.44:0/2331826475 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca580b0ae0 0x7fca5815d7d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.213+0000 7fca5d561640 1 --2- 172.21.15.44:0/2331826475 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58159c70 0x7fca580ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.213+0000 7fca5d561640 1 -- 172.21.15.44:0/2331826475 >> 172.21.15.44:0/2331826475 conn(0x7fca580ce950 msgr2=0x7fca580ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:00.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.213+0000 7fca5d561640 1 -- 172.21.15.44:0/2331826475 shutdown_connections 2023-11-04T01:38:00.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.213+0000 7fca5d561640 1 -- 172.21.15.44:0/2331826475 wait complete. 2023-11-04T01:38:00.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.214+0000 7fca5d561640 1 Processor -- start 2023-11-04T01:38:00.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.214+0000 7fca5d561640 1 -- start start 2023-11-04T01:38:00.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.215+0000 7fca5d561640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca5806db20 0x7fca581f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.215+0000 7fca5d561640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca580b0ae0 0x7fca5815d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.215+0000 7fca5d561640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58159c70 0x7fca5815da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.215+0000 7fca5d561640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca581f44e0 con 0x7fca580b0ae0 2023-11-04T01:38:00.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.215+0000 7fca5d561640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca580c8770 con 0x7fca5806db20 2023-11-04T01:38:00.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.215+0000 7fca5d561640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca581f6b80 con 0x7fca58159c70 2023-11-04T01:38:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.215+0000 7fca4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca580b0ae0 0x7fca5815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.215+0000 7fca4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca580b0ae0 0x7fca5815d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40730/0 (socket says 172.21.15.44:40730) 2023-11-04T01:38:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.215+0000 7fca4ffff640 1 -- 172.21.15.44:0/3460033730 learned_addr learned my addr 172.21.15.44:0/3460033730 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.215+0000 7fca56ffd640 1 --2- 172.21.15.44:0/3460033730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca5806db20 0x7fca581f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.215+0000 7fca577fe640 1 --2- 172.21.15.44:0/3460033730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58159c70 0x7fca5815da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.216+0000 7fca4ffff640 1 -- 172.21.15.44:0/3460033730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58159c70 msgr2=0x7fca5815da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.216+0000 7fca4ffff640 1 --2- 172.21.15.44:0/3460033730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58159c70 0x7fca5815da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.216+0000 7fca4ffff640 1 -- 172.21.15.44:0/3460033730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca5806db20 msgr2=0x7fca581f6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.216+0000 7fca4ffff640 1 --2- 172.21.15.44:0/3460033730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca5806db20 0x7fca581f6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.216+0000 7fca4ffff640 1 -- 172.21.15.44:0/3460033730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5000bc80 con 0x7fca580b0ae0 2023-11-04T01:38:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.216+0000 7fca577fe640 1 --2- 172.21.15.44:0/3460033730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58159c70 0x7fca5815da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.216+0000 7fca4ffff640 1 --2- 172.21.15.44:0/3460033730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca580b0ae0 0x7fca5815d510 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fca4000c4d0 tx=0x7fca4000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.216+0000 7fca4f7fe640 1 -- 172.21.15.44:0/3460033730 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40005ce0 con 0x7fca580b0ae0 2023-11-04T01:38:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.216+0000 7fca4f7fe640 1 -- 172.21.15.44:0/3460033730 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca40005e40 con 0x7fca580b0ae0 2023-11-04T01:38:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.216+0000 7fca5d561640 1 -- 172.21.15.44:0/3460033730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca581f38d0 con 0x7fca580b0ae0 2023-11-04T01:38:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.216+0000 7fca4f7fe640 1 -- 172.21.15.44:0/3460033730 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40007270 con 0x7fca580b0ae0 2023-11-04T01:38:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.216+0000 7fca5d561640 1 -- 172.21.15.44:0/3460033730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca581f3e90 con 0x7fca580b0ae0 2023-11-04T01:38:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.217+0000 7fca5d561640 1 -- 172.21.15.44:0/3460033730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca581f4690 con 0x7fca580b0ae0 2023-11-04T01:38:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.217+0000 7fca4f7fe640 1 -- 172.21.15.44:0/3460033730 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca400073d0 con 0x7fca580b0ae0 2023-11-04T01:38:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.218+0000 7fca4f7fe640 1 --2- 172.21.15.44:0/3460033730 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fca3806aea0 0x7fca3806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.218+0000 7fca4f7fe640 1 -- 172.21.15.44:0/3460033730 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fca40088d00 con 0x7fca580b0ae0 2023-11-04T01:38:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.218+0000 7fca56ffd640 1 --2- 172.21.15.44:0/3460033730 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fca3806aea0 0x7fca3806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.218+0000 7fca56ffd640 1 --2- 172.21.15.44:0/3460033730 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fca3806aea0 0x7fca3806d360 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fca580cf080 tx=0x7fca48009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.222+0000 7fca4f7fe640 1 -- 172.21.15.44:0/3460033730 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fca581f4690 con 0x7fca580b0ae0 2023-11-04T01:38:00.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.434+0000 7fca5d561640 1 -- 172.21.15.44:0/3460033730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca581f4690 con 0x7fca580b0ae0 2023-11-04T01:38:00.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.434+0000 7fca4f7fe640 1 -- 172.21.15.44:0/3460033730 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fca581f4690 con 0x7fca580b0ae0 2023-11-04T01:38:00.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:00.437 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/683817288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":683817288},{"type":"v1","addr":"172.21.15.44:6835","nonce":683817288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5306,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/4160536413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":4160536413},{"type":"v1","addr":"172.21.15.204:6836","nonce":4160536413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/1970301848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1970301848},{"type":"v1","addr":"172.21.15.204:6837","nonce":1970301848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:54.668449+0000","modified":"2023-11-04T01:37:57.680007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6834/982248126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":982248126},{"type":"v1","addr":"172.21.15.44:6834","nonce":982248126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:38:00.437 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 24 2023-11-04T01:38:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.436+0000 7fca5d561640 1 -- 172.21.15.44:0/3460033730 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fca3806aea0 msgr2=0x7fca3806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.436+0000 7fca5d561640 1 --2- 172.21.15.44:0/3460033730 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fca3806aea0 0x7fca3806d360 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fca580cf080 tx=0x7fca48009190 comp rx=0 tx=0).stop 2023-11-04T01:38:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.436+0000 7fca5d561640 1 -- 172.21.15.44:0/3460033730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca580b0ae0 msgr2=0x7fca5815d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.436+0000 7fca5d561640 1 --2- 172.21.15.44:0/3460033730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca580b0ae0 0x7fca5815d510 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fca4000c4d0 tx=0x7fca4000c990 comp rx=0 tx=0).stop 2023-11-04T01:38:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.436+0000 7fca5d561640 1 -- 172.21.15.44:0/3460033730 shutdown_connections 2023-11-04T01:38:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.436+0000 7fca5d561640 1 --2- 172.21.15.44:0/3460033730 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fca3806aea0 0x7fca3806d360 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.436+0000 7fca5d561640 1 --2- 172.21.15.44:0/3460033730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58159c70 0x7fca5815da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.436+0000 7fca5d561640 1 --2- 172.21.15.44:0/3460033730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca580b0ae0 0x7fca5815d510 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.436+0000 7fca5d561640 1 --2- 172.21.15.44:0/3460033730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca5806db20 0x7fca581f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.436+0000 7fca5d561640 1 -- 172.21.15.44:0/3460033730 >> 172.21.15.44:0/3460033730 conn(0x7fca580ce950 msgr2=0x7fca580cbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.436+0000 7fca5d561640 1 -- 172.21.15.44:0/3460033730 shutdown_connections 2023-11-04T01:38:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.436+0000 7fca5d561640 1 -- 172.21.15.44:0/3460033730 wait complete. 2023-11-04T01:38:00.852 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:37:54.668449+0000', 'modified': '2023-11-04T01:37:57.680007+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6006}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6006': {'gid': 6006, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6834/982248126', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 982248126}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 982248126}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:38:00.852 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:38:00.852 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:38:00.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.964+0000 7f1ed9875640 1 Processor -- start 2023-11-04T01:38:00.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.964+0000 7f1ed9875640 1 -- start start 2023-11-04T01:38:00.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.964+0000 7f1ed9875640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1ed40cccc0 0x7f1ed406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.964+0000 7f1ed9875640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed406ca40 con 0x7f1ed4160430 2023-11-04T01:38:00.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.964+0000 7f1ed9875640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed406cd20 con 0x7f1ed40b2d30 2023-11-04T01:38:00.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.964+0000 7f1ed9875640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed40cb580 con 0x7f1ed40cccc0 2023-11-04T01:38:00.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.964+0000 7f1ed2ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1ed4160430 0x7f1ed40b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41840/0 (socket says 172.21.15.44:41840) 2023-11-04T01:38:00.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.965+0000 7f1ed2ffd640 1 -- 172.21.15.44:0/4176012711 learned_addr learned my addr 172.21.15.44:0/4176012711 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:00.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.965+0000 7f1ed37fe640 1 --2- 172.21.15.44:0/4176012711 >> v2:172.21.15.204:3300/0 conn(0x7f1ed40cccc0 0x7f1ed406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.965+0000 7f1ed1ffb640 1 -- 172.21.15.44:0/4176012711 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593535391 0 0) 0x7f1ed406ca40 con 0x7f1ed4160430 2023-11-04T01:38:00.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.965+0000 7f1ed1ffb640 1 -- 172.21.15.44:0/4176012711 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ec0003520 con 0x7f1ed4160430 2023-11-04T01:38:00.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.965+0000 7f1ed37fe640 1 -- 172.21.15.44:0/4176012711 >> v1:172.21.15.204:6789/0 conn(0x7f1ed40b2d30 legacy=0x7f1ed406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.965+0000 7f1ed1ffb640 1 -- 172.21.15.44:0/4176012711 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3893559599 0 0) 0x7f1ec0003520 con 0x7f1ed4160430 2023-11-04T01:38:00.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.965+0000 7f1ed37fe640 1 -- 172.21.15.44:0/4176012711 >> v1:172.21.15.44:6789/0 conn(0x7f1ed4160430 legacy=0x7f1ed40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.965+0000 7f1ed37fe640 1 -- 172.21.15.44:0/4176012711 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed406d000 con 0x7f1ed40cccc0 2023-11-04T01:38:00.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.966+0000 7f1ed37fe640 1 --2- 172.21.15.44:0/4176012711 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ed40cccc0 0x7f1ed406c3a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009d90 tx=0x7f1ec402bc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad41bc8bb87ea1bb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.966+0000 7f1ed1ffb640 1 -- 172.21.15.44:0/4176012711 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc001670 con 0x7f1ed40cccc0 2023-11-04T01:38:00.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.966+0000 7f1ed1ffb640 1 -- 172.21.15.44:0/4176012711 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec402c7a0 con 0x7f1ed40cccc0 2023-11-04T01:38:00.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.966+0000 7f1ed1ffb640 1 -- 172.21.15.44:0/4176012711 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec402cb30 con 0x7f1ed40cccc0 2023-11-04T01:38:00.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.967+0000 7f1ed9875640 1 -- 172.21.15.44:0/4176012711 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ed40cccc0 msgr2=0x7f1ed406c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.967+0000 7f1ed9875640 1 --2- 172.21.15.44:0/4176012711 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ed40cccc0 0x7f1ed406c3a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009d90 tx=0x7f1ec402bc70 comp rx=0 tx=0).stop 2023-11-04T01:38:00.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.967+0000 7f1ed9875640 1 -- 172.21.15.44:0/4176012711 shutdown_connections 2023-11-04T01:38:00.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.967+0000 7f1ed9875640 1 --2- 172.21.15.44:0/4176012711 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ed40cccc0 0x7f1ed406c3a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.967+0000 7f1ed9875640 1 -- 172.21.15.44:0/4176012711 >> 172.21.15.44:0/4176012711 conn(0x7f1ed406ea20 msgr2=0x7f1ed406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:00.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.967+0000 7f1ed9875640 1 -- 172.21.15.44:0/4176012711 shutdown_connections 2023-11-04T01:38:00.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.967+0000 7f1ed9875640 1 -- 172.21.15.44:0/4176012711 wait complete. 2023-11-04T01:38:00.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.968+0000 7f1ed9875640 1 Processor -- start 2023-11-04T01:38:00.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.968+0000 7f1ed9875640 1 -- start start 2023-11-04T01:38:00.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed9875640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ed40b2d30 0x7f1ed414e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed9875640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ed40cccc0 0x7f1ed40b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed9875640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ed4160430 0x7f1ed40b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed9875640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed40b1bb0 con 0x7f1ed40cccc0 2023-11-04T01:38:00.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed9875640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed4153d80 con 0x7f1ed40b2d30 2023-11-04T01:38:00.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed9875640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed40b0fa0 con 0x7f1ed4160430 2023-11-04T01:38:00.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed27fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ed40cccc0 0x7f1ed40b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed27fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ed40cccc0 0x7f1ed40b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40740/0 (socket says 172.21.15.44:40740) 2023-11-04T01:38:00.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed27fc640 1 -- 172.21.15.44:0/4167979301 learned_addr learned my addr 172.21.15.44:0/4167979301 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:00.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed2ffd640 1 --2- 172.21.15.44:0/4167979301 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ed40b2d30 0x7f1ed414e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed37fe640 1 --2- 172.21.15.44:0/4167979301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ed4160430 0x7f1ed40b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed27fc640 1 -- 172.21.15.44:0/4167979301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ed4160430 msgr2=0x7f1ed40b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed27fc640 1 --2- 172.21.15.44:0/4167979301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ed4160430 0x7f1ed40b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed27fc640 1 -- 172.21.15.44:0/4167979301 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ed40b2d30 msgr2=0x7f1ed414e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed27fc640 1 --2- 172.21.15.44:0/4167979301 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ed40b2d30 0x7f1ed414e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed27fc640 1 -- 172.21.15.44:0/4167979301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec4009a70 con 0x7f1ed40cccc0 2023-11-04T01:38:00.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed2ffd640 1 --2- 172.21.15.44:0/4167979301 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ed40b2d30 0x7f1ed414e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:00.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ed27fc640 1 --2- 172.21.15.44:0/4167979301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ed40cccc0 0x7f1ed40b0910 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c780 tx=0x7f1ebc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.969+0000 7f1ecbfff640 1 -- 172.21.15.44:0/4167979301 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc005270 con 0x7f1ed40cccc0 2023-11-04T01:38:00.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.970+0000 7f1ecbfff640 1 -- 172.21.15.44:0/4167979301 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc0053f0 con 0x7f1ed40cccc0 2023-11-04T01:38:00.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.970+0000 7f1ed9875640 1 -- 172.21.15.44:0/4167979301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed40b1280 con 0x7f1ed40cccc0 2023-11-04T01:38:00.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.970+0000 7f1ecbfff640 1 -- 172.21.15.44:0/4167979301 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00a880 con 0x7f1ed40cccc0 2023-11-04T01:38:00.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.970+0000 7f1ed9875640 1 -- 172.21.15.44:0/4167979301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed40b1840 con 0x7f1ed40cccc0 2023-11-04T01:38:00.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.972+0000 7f1ecbfff640 1 -- 172.21.15.44:0/4167979301 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ebc00a9e0 con 0x7f1ed40cccc0 2023-11-04T01:38:00.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.972+0000 7f1ecbfff640 1 --2- 172.21.15.44:0/4167979301 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1eb406aea0 0x7f1eb406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.972+0000 7f1ecbfff640 1 -- 172.21.15.44:0/4167979301 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1ebc088f60 con 0x7f1ed40cccc0 2023-11-04T01:38:00.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.972+0000 7f1ed2ffd640 1 --2- 172.21.15.44:0/4167979301 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1eb406aea0 0x7f1eb406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.973+0000 7f1edc409740 1 Processor -- start 2023-11-04T01:38:00.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.973+0000 7f1edc409740 1 -- start start 2023-11-04T01:38:00.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.973+0000 7f1ed2ffd640 1 --2- 172.21.15.44:0/4167979301 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1eb406aea0 0x7f1eb406d360 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc001eb0 tx=0x7f1ecc001ce0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1edc409740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d55850 0x55fad1d28750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1edc409740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 0x55fad1d585e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1edc409740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d28c90 0x55fad1d58b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1edc409740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fad1c39740 con 0x55fad1d55850 2023-11-04T01:38:00.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1edc409740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fad1c9b8d0 con 0x55fad1d55c30 2023-11-04T01:38:00.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1edc409740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fad1c98fc0 con 0x55fad1d28c90 2023-11-04T01:38:00.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1ed2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d55850 0x55fad1d28750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1ed2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d55850 0x55fad1d28750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40754/0 (socket says 172.21.15.44:40754) 2023-11-04T01:38:00.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1ed2ffd640 1 -- 172.21.15.44:0/222163130 learned_addr learned my addr 172.21.15.44:0/222163130 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:00.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1ed27fc640 1 --2- 172.21.15.44:0/222163130 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 0x55fad1d585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1ed37fe640 1 --2- 172.21.15.44:0/222163130 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d28c90 0x55fad1d58b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1ed2ffd640 1 -- 172.21.15.44:0/222163130 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d28c90 msgr2=0x55fad1d58b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:00.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1ed2ffd640 1 --2- 172.21.15.44:0/222163130 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d28c90 0x55fad1d58b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1ed2ffd640 1 -- 172.21.15.44:0/222163130 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 msgr2=0x55fad1d585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:00.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1ed2ffd640 1 --2- 172.21.15.44:0/222163130 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 0x55fad1d585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1ed2ffd640 1 -- 172.21.15.44:0/222163130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fad1c57ca0 con 0x55fad1d55850 2023-11-04T01:38:00.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1ed27fc640 1 --2- 172.21.15.44:0/222163130 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 0x55fad1d585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:00.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1ed2ffd640 1 --2- 172.21.15.44:0/222163130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d55850 0x55fad1d28750 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0052b0 tx=0x7f1ecc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d6e48b9b143c96 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1ec97fa640 1 -- 172.21.15.44:0/222163130 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc00e7b0 con 0x55fad1d55850 2023-11-04T01:38:00.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1ec97fa640 1 -- 172.21.15.44:0/222163130 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc00e910 con 0x55fad1d55850 2023-11-04T01:38:00.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.974+0000 7f1ec97fa640 1 -- 172.21.15.44:0/222163130 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc00ec80 con 0x55fad1d55850 2023-11-04T01:38:00.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.975+0000 7f1edc409740 1 -- 172.21.15.44:0/222163130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d55850 msgr2=0x55fad1d28750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.975+0000 7f1edc409740 1 --2- 172.21.15.44:0/222163130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d55850 0x55fad1d28750 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0052b0 tx=0x7f1ecc011000 comp rx=0 tx=0).stop 2023-11-04T01:38:00.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.975+0000 7f1edc409740 1 -- 172.21.15.44:0/222163130 shutdown_connections 2023-11-04T01:38:00.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.975+0000 7f1edc409740 1 --2- 172.21.15.44:0/222163130 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d28c90 0x55fad1d58b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.975+0000 7f1edc409740 1 --2- 172.21.15.44:0/222163130 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 0x55fad1d585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.975+0000 7f1edc409740 1 --2- 172.21.15.44:0/222163130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d55850 0x55fad1d28750 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.975+0000 7f1edc409740 1 -- 172.21.15.44:0/222163130 >> 172.21.15.44:0/222163130 conn(0x55fad1d2aa60 msgr2=0x55fad1d735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:00.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.975+0000 7f1edc409740 1 -- 172.21.15.44:0/222163130 shutdown_connections 2023-11-04T01:38:00.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.975+0000 7f1edc409740 1 -- 172.21.15.44:0/222163130 wait complete. 2023-11-04T01:38:00.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.976+0000 7f1edc409740 1 -- start start 2023-11-04T01:38:00.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.976+0000 7f1edc409740 1 Processor -- start 2023-11-04T01:38:00.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.976+0000 7f1edc409740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d55850 0x55fad1d46ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.976+0000 7f1edc409740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 0x55fad1d6dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.976+0000 7f1edc409740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d472a0 0x55fad1d5b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.976+0000 7f1edc409740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fad1c948b0 con 0x55fad1d472a0 2023-11-04T01:38:00.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.976+0000 7f1edc409740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fad1c4ec80 con 0x55fad1d55c30 2023-11-04T01:38:00.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.976+0000 7f1edc409740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fad1c4e920 con 0x55fad1d55850 2023-11-04T01:38:00.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.976+0000 7f1edc409740 10 client.0 _ll_register_callbacks cb 0x55fad19a6ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:38:00.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1ed37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d472a0 0x55fad1d5b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1ed37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d472a0 0x55fad1d5b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40766/0 (socket says 172.21.15.44:40766) 2023-11-04T01:38:00.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1ed37fe640 1 -- 172.21.15.44:0/1959141632 learned_addr learned my addr 172.21.15.44:0/1959141632 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:00.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1ed27fc640 1 --2- 172.21.15.44:0/1959141632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 0x55fad1d6dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1ed2ffd640 1 --2- 172.21.15.44:0/1959141632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d55850 0x55fad1d46ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1ed37fe640 1 -- 172.21.15.44:0/1959141632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d55850 msgr2=0x55fad1d46ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:00.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1ed37fe640 1 --2- 172.21.15.44:0/1959141632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d55850 0x55fad1d46ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1ed37fe640 1 -- 172.21.15.44:0/1959141632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 msgr2=0x55fad1d6dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:00.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1ed37fe640 1 --2- 172.21.15.44:0/1959141632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 0x55fad1d6dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1ed37fe640 1 -- 172.21.15.44:0/1959141632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc00f040 con 0x55fad1d472a0 2023-11-04T01:38:00.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1ed37fe640 1 --2- 172.21.15.44:0/1959141632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d472a0 0x55fad1d5b260 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1ec402c280 tx=0x7f1ec4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193a2b928f1ceb60 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1eb27fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:38:00.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1eb27fc640 1 -- 172.21.15.44:0/1959141632 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4003b90 con 0x55fad1d472a0 2023-11-04T01:38:00.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1eb27fc640 1 -- 172.21.15.44:0/1959141632 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1ec4045070 con 0x55fad1d472a0 2023-11-04T01:38:00.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1edc409740 1 -- 172.21.15.44:0/1959141632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fad1c40bf0 con 0x55fad1d472a0 2023-11-04T01:38:00.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1eb27fc640 1 -- 172.21.15.44:0/1959141632 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ec4003cf0 con 0x55fad1d472a0 2023-11-04T01:38:00.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1edc409740 10 client.6147 fetch_fsmap learned FSMap version 24 2023-11-04T01:38:00.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.977+0000 7f1edc409740 1 -- 172.21.15.44:0/1959141632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55fad1c92f30 con 0x55fad1d472a0 2023-11-04T01:38:00.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.978+0000 7f1eb27fc640 1 -- 172.21.15.44:0/1959141632 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fad1c40bf0 con 0x55fad1d472a0 2023-11-04T01:38:00.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.978+0000 7f1eb27fc640 1 -- 172.21.15.44:0/1959141632 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1ec403f660 con 0x55fad1d472a0 2023-11-04T01:38:00.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.978+0000 7f1edc409740 10 client.6147 fetch_fsmap finished waiting for FSMap version 24 2023-11-04T01:38:00.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.978+0000 7f1edc409740 10 client.6147 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:38:00.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.978+0000 7f1edc409740 20 client.6147 populate_metadata read hostname 'smithi044' 2023-11-04T01:38:00.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.978+0000 7f1edc409740 1 --2- 172.21.15.44:0/1959141632 >> [v2:172.21.15.44:6832/982248126,v1:172.21.15.44:6834/982248126] conn(0x55fad1d8ece0 0x55fad1d910d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.978+0000 7f1edc409740 4 client.6147 mds_command: new command op to 6006 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:38:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.978+0000 7f1edc409740 1 -- 172.21.15.44:0/1959141632 --> [v2:172.21.15.44:6832/982248126,v1:172.21.15.44:6834/982248126] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fad1c8d890 con 0x55fad1d8ece0 2023-11-04T01:38:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.978+0000 7f1ed2ffd640 1 --2- 172.21.15.44:0/1959141632 >> [v2:172.21.15.44:6832/982248126,v1:172.21.15.44:6834/982248126] conn(0x55fad1d8ece0 0x55fad1d910d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.978+0000 7f1ed2ffd640 1 --2- 172.21.15.44:0/1959141632 >> [v2:172.21.15.44:6832/982248126,v1:172.21.15.44:6834/982248126] conn(0x55fad1d8ece0 0x55fad1d910d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db6aa83a80ee01f7 server_cookie=338d7fcb4f4ccb81 in_seq=0 out_seq=0 2023-11-04T01:38:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.978+0000 7f1eb27fc640 10 client.6147 ms_handle_connect on v2:172.21.15.44:6832/982248126 2023-11-04T01:38:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.979+0000 7f1eb27fc640 1 -- 172.21.15.44:0/1959141632 <== mds.0 v2:172.21.15.44:6832/982248126 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fad1c8d890 con 0x55fad1d8ece0 2023-11-04T01:38:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.979+0000 7f1eb27fc640 10 client.6147 handle_command_reply: tid=0 2023-11-04T01:38:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.979+0000 7f1edc409740 1 client.6147 shutdown 2023-11-04T01:38:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.979+0000 7f1edc409740 1 -- 172.21.15.44:0/1959141632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d472a0 msgr2=0x55fad1d5b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.979+0000 7f1edc409740 1 --2- 172.21.15.44:0/1959141632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d472a0 0x55fad1d5b260 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1ec402c280 tx=0x7f1ec4004ab0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.979+0000 7f1edc409740 1 -- 172.21.15.44:0/1959141632 shutdown_connections 2023-11-04T01:38:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.979+0000 7f1edc409740 1 --2- 172.21.15.44:0/1959141632 >> [v2:172.21.15.44:6832/982248126,v1:172.21.15.44:6834/982248126] conn(0x55fad1d8ece0 0x55fad1d910d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.979+0000 7f1edc409740 1 --2- 172.21.15.44:0/1959141632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d472a0 0x55fad1d5b260 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.979+0000 7f1edc409740 1 --2- 172.21.15.44:0/1959141632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 0x55fad1d6dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.979+0000 7f1eb27fc640 0 client.6147 ms_handle_reset on v2:172.21.15.44:6832/982248126 2023-11-04T01:38:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.979+0000 7f1edc409740 1 --2- 172.21.15.44:0/1959141632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d55850 0x55fad1d46ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.979+0000 7f1edc409740 1 -- 172.21.15.44:0/1959141632 >> 172.21.15.44:0/1959141632 conn(0x55fad1d28c90 msgr2=0x55fad1d6d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.979+0000 7f1edc409740 1 -- 172.21.15.44:0/1959141632 shutdown_connections 2023-11-04T01:38:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.979+0000 7f1edc409740 1 -- 172.21.15.44:0/1959141632 wait complete. 2023-11-04T01:38:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.979+0000 7f1edc409740 20 client.6147 trim_cache size 0 max 16384 2023-11-04T01:38:00.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.995+0000 7f1edc409740 1 Processor -- start 2023-11-04T01:38:01.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.995+0000 7f1edc409740 1 -- start start 2023-11-04T01:38:01.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.995+0000 7f1edc409740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d472a0 0x55fad1d2c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.995+0000 7f1edc409740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d55850 0x55fad1d2c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1edc409740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d55c30 0x55fad1d595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1edc409740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fad1c14280 con 0x55fad1d55c30 2023-11-04T01:38:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1edc409740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fad1c33150 con 0x55fad1d472a0 2023-11-04T01:38:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1edc409740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fad1d2a120 con 0x55fad1d55850 2023-11-04T01:38:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1ed37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d55c30 0x55fad1d595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1ed37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d55c30 0x55fad1d595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40774/0 (socket says 172.21.15.44:40774) 2023-11-04T01:38:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1ed37fe640 1 -- 172.21.15.44:0/3734438399 learned_addr learned my addr 172.21.15.44:0/3734438399 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1ed2ffd640 1 --2- 172.21.15.44:0/3734438399 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d472a0 0x55fad1d2c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1ed27fc640 1 --2- 172.21.15.44:0/3734438399 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d55850 0x55fad1d2c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1ed37fe640 1 -- 172.21.15.44:0/3734438399 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d55850 msgr2=0x55fad1d2c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1ed37fe640 1 --2- 172.21.15.44:0/3734438399 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d55850 0x55fad1d2c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1ed37fe640 1 -- 172.21.15.44:0/3734438399 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d472a0 msgr2=0x55fad1d2c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1ed37fe640 1 --2- 172.21.15.44:0/3734438399 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d472a0 0x55fad1d2c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1ed37fe640 1 -- 172.21.15.44:0/3734438399 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fad1c30d10 con 0x55fad1d55c30 2023-11-04T01:38:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1ed37fe640 1 --2- 172.21.15.44:0/3734438399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d55c30 0x55fad1d595d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1ec402bcb0 tx=0x7f1ec4041070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d854c35be891023 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1ec9ffb640 1 -- 172.21.15.44:0/3734438399 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec403fad0 con 0x55fad1d55c30 2023-11-04T01:38:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1ec9ffb640 1 -- 172.21.15.44:0/3734438399 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec4043070 con 0x55fad1d55c30 2023-11-04T01:38:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.996+0000 7f1ec9ffb640 1 -- 172.21.15.44:0/3734438399 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4003990 con 0x55fad1d55c30 2023-11-04T01:38:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.997+0000 7f1edc409740 1 -- 172.21.15.44:0/3734438399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d55c30 msgr2=0x55fad1d595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.997+0000 7f1edc409740 1 --2- 172.21.15.44:0/3734438399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d55c30 0x55fad1d595d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1ec402bcb0 tx=0x7f1ec4041070 comp rx=0 tx=0).stop 2023-11-04T01:38:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.997+0000 7f1edc409740 1 -- 172.21.15.44:0/3734438399 shutdown_connections 2023-11-04T01:38:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.997+0000 7f1edc409740 1 --2- 172.21.15.44:0/3734438399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d55c30 0x55fad1d595d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.997+0000 7f1edc409740 1 --2- 172.21.15.44:0/3734438399 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d55850 0x55fad1d2c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.997+0000 7f1edc409740 1 --2- 172.21.15.44:0/3734438399 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d472a0 0x55fad1d2c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.997+0000 7f1edc409740 1 -- 172.21.15.44:0/3734438399 >> 172.21.15.44:0/3734438399 conn(0x55fad1d28c90 msgr2=0x55fad1d76af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.997+0000 7f1edc409740 1 -- 172.21.15.44:0/3734438399 shutdown_connections 2023-11-04T01:38:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.997+0000 7f1edc409740 1 -- 172.21.15.44:0/3734438399 wait complete. 2023-11-04T01:38:01.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.998+0000 7f1edc409740 1 -- start start 2023-11-04T01:38:01.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.998+0000 7f1edc409740 1 Processor -- start 2023-11-04T01:38:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.998+0000 7f1edc409740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d472a0 0x55fad1d95980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.998+0000 7f1edc409740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d55850 0x55fad1d728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.998+0000 7f1edc409740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 0x55fad1d72e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.998+0000 7f1edc409740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fad1d2edd0 con 0x55fad1d472a0 2023-11-04T01:38:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.998+0000 7f1edc409740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fad1d95ec0 con 0x55fad1d55c30 2023-11-04T01:38:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.998+0000 7f1edc409740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fad1d86450 con 0x55fad1d55850 2023-11-04T01:38:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.998+0000 7f1edc409740 10 client.0 _ll_register_callbacks cb 0x7f1ecc0012d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:38:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.998+0000 7f1ed2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d472a0 0x55fad1d95980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.998+0000 7f1ed2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d472a0 0x55fad1d95980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40778/0 (socket says 172.21.15.44:40778) 2023-11-04T01:38:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.998+0000 7f1ed2ffd640 1 -- 172.21.15.44:0/2920189540 learned_addr learned my addr 172.21.15.44:0/2920189540 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1ed37fe640 1 --2- 172.21.15.44:0/2920189540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 0x55fad1d72e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1ed27fc640 1 --2- 172.21.15.44:0/2920189540 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d55850 0x55fad1d728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1ed2ffd640 1 -- 172.21.15.44:0/2920189540 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d55850 msgr2=0x55fad1d728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1ed2ffd640 1 --2- 172.21.15.44:0/2920189540 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d55850 0x55fad1d728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1ed2ffd640 1 -- 172.21.15.44:0/2920189540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 msgr2=0x55fad1d72e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1ed2ffd640 1 --2- 172.21.15.44:0/2920189540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 0x55fad1d72e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1ed2ffd640 1 -- 172.21.15.44:0/2920189540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fad1c92f30 con 0x55fad1d472a0 2023-11-04T01:38:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1ed2ffd640 1 --2- 172.21.15.44:0/2920189540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d472a0 0x55fad1d95980 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc017000 tx=0x7f1ecc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f9e98888c0ade0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1eb27fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:38:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1eb27fc640 1 -- 172.21.15.44:0/2920189540 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc02d370 con 0x55fad1d472a0 2023-11-04T01:38:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1eb27fc640 1 -- 172.21.15.44:0/2920189540 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1ecc028040 con 0x55fad1d472a0 2023-11-04T01:38:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1edc409740 1 -- 172.21.15.44:0/2920189540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1ecc00e910 con 0x55fad1d472a0 2023-11-04T01:38:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1eb27fc640 1 -- 172.21.15.44:0/2920189540 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ecc02d4d0 con 0x55fad1d472a0 2023-11-04T01:38:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1edc409740 10 client.6153 fetch_fsmap learned FSMap version 24 2023-11-04T01:38:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1edc409740 1 -- 172.21.15.44:0/2920189540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55fad1c56500 con 0x55fad1d472a0 2023-11-04T01:38:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:00.999+0000 7f1eb27fc640 1 -- 172.21.15.44:0/2920189540 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc00e910 con 0x55fad1d472a0 2023-11-04T01:38:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1eb27fc640 1 -- 172.21.15.44:0/2920189540 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1ecc02d630 con 0x55fad1d472a0 2023-11-04T01:38:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 10 client.6153 fetch_fsmap finished waiting for FSMap version 24 2023-11-04T01:38:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 10 client.6153 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:38:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 20 client.6153 populate_metadata read hostname 'smithi044' 2023-11-04T01:38:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 1 --2- 172.21.15.44:0/2920189540 >> [v2:172.21.15.44:6832/982248126,v1:172.21.15.44:6834/982248126] conn(0x55fad1dde040 0x55fad1dde420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 4 client.6153 mds_command: new command op to 6006 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:38:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 1 -- 172.21.15.44:0/2920189540 --> [v2:172.21.15.44:6832/982248126,v1:172.21.15.44:6834/982248126] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fad1c8d5b0 con 0x55fad1dde040 2023-11-04T01:38:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1ed27fc640 1 --2- 172.21.15.44:0/2920189540 >> [v2:172.21.15.44:6832/982248126,v1:172.21.15.44:6834/982248126] conn(0x55fad1dde040 0x55fad1dde420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1eb27fc640 10 client.6153 ms_handle_connect on v2:172.21.15.44:6832/982248126 2023-11-04T01:38:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1ed27fc640 1 --2- 172.21.15.44:0/2920189540 >> [v2:172.21.15.44:6832/982248126,v1:172.21.15.44:6834/982248126] conn(0x55fad1dde040 0x55fad1dde420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e48a52f8d87c101 server_cookie=b7d1c74bfba249b6 in_seq=0 out_seq=0 2023-11-04T01:38:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1eb27fc640 1 -- 172.21.15.44:0/2920189540 <== mds.0 v2:172.21.15.44:6832/982248126 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55fad1c8d5b0 con 0x55fad1dde040 2023-11-04T01:38:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1eb27fc640 10 client.6153 handle_command_reply: tid=0 2023-11-04T01:38:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 1 client.6153 shutdown 2023-11-04T01:38:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 1 -- 172.21.15.44:0/2920189540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d472a0 msgr2=0x55fad1d95980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 1 --2- 172.21.15.44:0/2920189540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d472a0 0x55fad1d95980 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc017000 tx=0x7f1ecc000ed0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 1 -- 172.21.15.44:0/2920189540 shutdown_connections 2023-11-04T01:38:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 1 --2- 172.21.15.44:0/2920189540 >> [v2:172.21.15.44:6832/982248126,v1:172.21.15.44:6834/982248126] conn(0x55fad1dde040 0x55fad1dde420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 1 --2- 172.21.15.44:0/2920189540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fad1d55c30 0x55fad1d72e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 1 --2- 172.21.15.44:0/2920189540 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fad1d55850 0x55fad1d728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 1 --2- 172.21.15.44:0/2920189540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fad1d472a0 0x55fad1d95980 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 1 -- 172.21.15.44:0/2920189540 >> 172.21.15.44:0/2920189540 conn(0x55fad1d28c90 msgr2=0x55fad1d28400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:01.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1eb27fc640 0 client.6153 ms_handle_reset on v2:172.21.15.44:6832/982248126 2023-11-04T01:38:01.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.000+0000 7f1edc409740 1 -- 172.21.15.44:0/2920189540 shutdown_connections 2023-11-04T01:38:01.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.001+0000 7f1edc409740 1 -- 172.21.15.44:0/2920189540 wait complete. 2023-11-04T01:38:01.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.001+0000 7f1edc409740 20 client.6153 trim_cache size 0 max 16384 2023-11-04T01:38:01.013 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:38:01.013 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:38:01.013 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2023-11-04T01:38:01.014 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6006, 2023-11-04T01:38:01.014 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:38:01.014 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:38:01.014 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:38:01.014 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 5.6910347569999997, 2023-11-04T01:38:01.014 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 24, 2023-11-04T01:38:01.014 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 56, 2023-11-04T01:38:01.014 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 56, 2023-11-04T01:38:01.014 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 10.709830156000001 2023-11-04T01:38:01.014 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:38:01.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.001+0000 7f1ed9875640 1 -- 172.21.15.44:0/4167979301 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1eb406aea0 msgr2=0x7f1eb406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.001+0000 7f1ed9875640 1 --2- 172.21.15.44:0/4167979301 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1eb406aea0 0x7f1eb406d360 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc001eb0 tx=0x7f1ecc001ce0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.001+0000 7f1ed9875640 1 -- 172.21.15.44:0/4167979301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ed40cccc0 msgr2=0x7f1ed40b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.001+0000 7f1ed9875640 1 --2- 172.21.15.44:0/4167979301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ed40cccc0 0x7f1ed40b0910 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c780 tx=0x7f1ebc00cc40 comp rx=0 tx=0).stop 2023-11-04T01:38:01.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.001+0000 7f1ed9875640 1 -- 172.21.15.44:0/4167979301 shutdown_connections 2023-11-04T01:38:01.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.001+0000 7f1ed9875640 1 --2- 172.21.15.44:0/4167979301 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1eb406aea0 0x7f1eb406d360 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.001+0000 7f1ed9875640 1 --2- 172.21.15.44:0/4167979301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ed4160430 0x7f1ed40b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.001+0000 7f1ed9875640 1 --2- 172.21.15.44:0/4167979301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ed40cccc0 0x7f1ed40b0910 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.001+0000 7f1ed9875640 1 --2- 172.21.15.44:0/4167979301 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ed40b2d30 0x7f1ed414e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.001+0000 7f1ed9875640 1 -- 172.21.15.44:0/4167979301 >> 172.21.15.44:0/4167979301 conn(0x7f1ed406ea20 msgr2=0x7f1ed40cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:01.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.001+0000 7f1ed9875640 1 -- 172.21.15.44:0/4167979301 shutdown_connections 2023-11-04T01:38:01.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.001+0000 7f1ed9875640 1 -- 172.21.15.44:0/4167979301 wait complete. 2023-11-04T01:38:01.017 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:38:01.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.122+0000 7f72be54c640 1 Processor -- start 2023-11-04T01:38:01.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.122+0000 7f72be54c640 1 -- start start 2023-11-04T01:38:01.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.123+0000 7f72be54c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f72b8160b10 0x7f72b8160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.123+0000 7f72be54c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f72b80cf160 0x7f72b80cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.123+0000 7f72be54c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b806bf00 con 0x7f72b815ce60 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.123+0000 7f72be54c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b80cbde0 con 0x7f72b80cf160 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.123+0000 7f72be54c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b80cfb30 con 0x7f72b8160b10 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.123+0000 7f72bcae9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f72b80cf160 0x7f72b80cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.123+0000 7f72bcae9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f72b80cf160 0x7f72b80cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40784/0 (socket says 172.21.15.44:40784) 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.123+0000 7f72bcae9640 1 -- 172.21.15.44:0/2756990230 learned_addr learned my addr 172.21.15.44:0/2756990230 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.123+0000 7f72b77fe640 1 --2- 172.21.15.44:0/2756990230 >> v2:172.21.15.204:3300/0 conn(0x7f72b8160b10 0x7f72b8160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.124+0000 7f72bcae9640 1 -- 172.21.15.44:0/2756990230 >> v2:172.21.15.204:3300/0 conn(0x7f72b8160b10 msgr2=0x7f72b8160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.124+0000 7f72bcae9640 1 --2- 172.21.15.44:0/2756990230 >> v2:172.21.15.204:3300/0 conn(0x7f72b8160b10 0x7f72b8160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.124+0000 7f72bcae9640 1 -- 172.21.15.44:0/2756990230 >> v1:172.21.15.204:6789/0 conn(0x7f72b815ce60 legacy=0x7f72b806b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.124+0000 7f72bcae9640 1 -- 172.21.15.44:0/2756990230 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b81615d0 con 0x7f72b80cf160 2023-11-04T01:38:01.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.124+0000 7f72b77fe640 1 --2- 172.21.15.44:0/2756990230 >> v2:172.21.15.204:3300/0 conn(0x7f72b8160b10 0x7f72b8160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.124+0000 7f72bcae9640 1 --2- 172.21.15.44:0/2756990230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72b80cf160 0x7f72b80cf5f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f72b8072590 tx=0x7f72b002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc759121434338c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.124+0000 7f72b6ffd640 1 -- 172.21.15.44:0/2756990230 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b002cb20 con 0x7f72b80cf160 2023-11-04T01:38:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.125+0000 7f72b6ffd640 1 -- 172.21.15.44:0/2756990230 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b002cc80 con 0x7f72b80cf160 2023-11-04T01:38:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.125+0000 7f72b6ffd640 1 -- 172.21.15.44:0/2756990230 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00343f0 con 0x7f72b80cf160 2023-11-04T01:38:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.125+0000 7f72be54c640 1 -- 172.21.15.44:0/2756990230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72b80cf160 msgr2=0x7f72b80cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.125+0000 7f72be54c640 1 --2- 172.21.15.44:0/2756990230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72b80cf160 0x7f72b80cf5f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f72b8072590 tx=0x7f72b002bf80 comp rx=0 tx=0).stop 2023-11-04T01:38:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.125+0000 7f72be54c640 1 -- 172.21.15.44:0/2756990230 shutdown_connections 2023-11-04T01:38:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.125+0000 7f72be54c640 1 --2- 172.21.15.44:0/2756990230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72b80cf160 0x7f72b80cf5f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.125+0000 7f72be54c640 1 --2- 172.21.15.44:0/2756990230 >> v2:172.21.15.204:3300/0 conn(0x7f72b8160b10 0x7f72b8160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.125+0000 7f72be54c640 1 -- 172.21.15.44:0/2756990230 >> 172.21.15.44:0/2756990230 conn(0x7f72b806ea90 msgr2=0x7f72b806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.125+0000 7f72be54c640 1 -- 172.21.15.44:0/2756990230 shutdown_connections 2023-11-04T01:38:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.125+0000 7f72be54c640 1 -- 172.21.15.44:0/2756990230 wait complete. 2023-11-04T01:38:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.126+0000 7f72be54c640 1 Processor -- start 2023-11-04T01:38:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.127+0000 7f72be54c640 1 -- start start 2023-11-04T01:38:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.127+0000 7f72be54c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72b80cf160 0x7f72b81593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.127+0000 7f72be54c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72b815ce60 0x7f72b815ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.127+0000 7f72be54c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72b8160b10 0x7f72b80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.127+0000 7f72be54c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8160040 con 0x7f72b8160b10 2023-11-04T01:38:01.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.127+0000 7f72be54c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b815f7a0 con 0x7f72b80cf160 2023-11-04T01:38:01.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.127+0000 7f72be54c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b815fa80 con 0x7f72b815ce60 2023-11-04T01:38:01.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.127+0000 7f72bcae9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72b8160b10 0x7f72b80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.127+0000 7f72bcae9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72b8160b10 0x7f72b80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40800/0 (socket says 172.21.15.44:40800) 2023-11-04T01:38:01.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.127+0000 7f72bcae9640 1 -- 172.21.15.44:0/964723222 learned_addr learned my addr 172.21.15.44:0/964723222 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:01.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.128+0000 7f72bcae9640 1 -- 172.21.15.44:0/964723222 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72b815ce60 msgr2=0x7f72b815ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.128+0000 7f72bcae9640 1 --2- 172.21.15.44:0/964723222 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72b815ce60 0x7f72b815ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.128+0000 7f72bcae9640 1 -- 172.21.15.44:0/964723222 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72b80cf160 msgr2=0x7f72b81593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.128+0000 7f72b7fff640 1 --2- 172.21.15.44:0/964723222 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72b80cf160 0x7f72b81593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.128+0000 7f72bcae9640 1 --2- 172.21.15.44:0/964723222 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72b80cf160 0x7f72b81593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.128+0000 7f72bcae9640 1 -- 172.21.15.44:0/964723222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b0009b30 con 0x7f72b8160b10 2023-11-04T01:38:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.128+0000 7f72bcae9640 1 --2- 172.21.15.44:0/964723222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72b8160b10 0x7f72b80b4ed0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f72b0036040 tx=0x7f72b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.128+0000 7f72b4ff9640 1 -- 172.21.15.44:0/964723222 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0007e70 con 0x7f72b8160b10 2023-11-04T01:38:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.128+0000 7f72b4ff9640 1 -- 172.21.15.44:0/964723222 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0009510 con 0x7f72b8160b10 2023-11-04T01:38:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.128+0000 7f72b4ff9640 1 -- 172.21.15.44:0/964723222 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b003e690 con 0x7f72b8160b10 2023-11-04T01:38:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.128+0000 7f72be54c640 1 -- 172.21.15.44:0/964723222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b815fd60 con 0x7f72b8160b10 2023-11-04T01:38:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.128+0000 7f72be54c640 1 -- 172.21.15.44:0/964723222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b8159900 con 0x7f72b8160b10 2023-11-04T01:38:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.129+0000 7f72be54c640 1 -- 172.21.15.44:0/964723222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b8074290 con 0x7f72b8160b10 2023-11-04T01:38:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.130+0000 7f72b4ff9640 1 -- 172.21.15.44:0/964723222 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f72b003e7f0 con 0x7f72b8160b10 2023-11-04T01:38:01.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.130+0000 7f72b4ff9640 1 --2- 172.21.15.44:0/964723222 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f72a406ae70 0x7f72a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.130+0000 7f72b4ff9640 1 -- 172.21.15.44:0/964723222 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f72b00ac3f0 con 0x7f72b8160b10 2023-11-04T01:38:01.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.130+0000 7f72b7fff640 1 --2- 172.21.15.44:0/964723222 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f72a406ae70 0x7f72a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.131+0000 7f72b7fff640 1 --2- 172.21.15.44:0/964723222 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f72a406ae70 0x7f72a406d330 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f72a8000f60 tx=0x7f72a8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:01.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.134+0000 7f72b4ff9640 1 -- 172.21.15.44:0/964723222 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f72b00773b0 con 0x7f72b8160b10 2023-11-04T01:38:01.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.349+0000 7f72be54c640 1 -- 172.21.15.44:0/964723222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f72b815c660 con 0x7f72b8160b10 2023-11-04T01:38:01.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.349+0000 7f72b4ff9640 1 -- 172.21.15.44:0/964723222 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f72b007a9d0 con 0x7f72b8160b10 2023-11-04T01:38:01.351 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:38:01.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.351+0000 7f72be54c640 1 -- 172.21.15.44:0/964723222 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f72a406ae70 msgr2=0x7f72a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.351+0000 7f72be54c640 1 --2- 172.21.15.44:0/964723222 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f72a406ae70 0x7f72a406d330 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f72a8000f60 tx=0x7f72a8009040 comp rx=0 tx=0).stop 2023-11-04T01:38:01.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.351+0000 7f72be54c640 1 -- 172.21.15.44:0/964723222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72b8160b10 msgr2=0x7f72b80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.351+0000 7f72be54c640 1 --2- 172.21.15.44:0/964723222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72b8160b10 0x7f72b80b4ed0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f72b0036040 tx=0x7f72b0004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:01.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.351+0000 7f72be54c640 1 -- 172.21.15.44:0/964723222 shutdown_connections 2023-11-04T01:38:01.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.351+0000 7f72be54c640 1 --2- 172.21.15.44:0/964723222 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f72a406ae70 0x7f72a406d330 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.351+0000 7f72be54c640 1 --2- 172.21.15.44:0/964723222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72b8160b10 0x7f72b80b4ed0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.351+0000 7f72be54c640 1 --2- 172.21.15.44:0/964723222 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72b815ce60 0x7f72b815ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.351+0000 7f72be54c640 1 --2- 172.21.15.44:0/964723222 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72b80cf160 0x7f72b81593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.351+0000 7f72be54c640 1 -- 172.21.15.44:0/964723222 >> 172.21.15.44:0/964723222 conn(0x7f72b806ea90 msgr2=0x7f72b80d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:01.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.351+0000 7f72be54c640 1 -- 172.21.15.44:0/964723222 shutdown_connections 2023-11-04T01:38:01.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:01.351+0000 7f72be54c640 1 -- 172.21.15.44:0/964723222 wait complete. 2023-11-04T01:38:01.366 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:38:01.367 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:38:01.367 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2023-11-04T01:38:01.367 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:38:01.367 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:01.367 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:38:01.367 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:38:01.367 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:38:01.367 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:01.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:01.368 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2023-11-04T01:38:01.383 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:38:01.383 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:38:01.383 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:38:01.384 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:01.384 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2023-11-04T01:38:01.384 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:01.384 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:01.384 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:01.384 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2023-11-04T01:38:01.384 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:01.384 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:01.384 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2023-11-04T01:38:01.384 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:38:01.384 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:01.384 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2023-11-04T01:38:01.384 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-04T01:38:01.385 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42388sec preferred_lft 42388sec 2023-11-04T01:38:01.385 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2023-11-04T01:38:01.385 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:01.385 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:01.385 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:01.385 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2023-11-04T01:38:01.385 INFO:teuthology.orchestra.run.smithi044.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:38:01.385 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:01.385 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:38:01.385 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:01.385 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::9082:77ff:fe28:4353/64 scope link 2023-11-04T01:38:01.385 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:01.385 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:38:01.385 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:01.386 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::e49d:e3ff:fe56:d068/64 scope link 2023-11-04T01:38:01.386 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:01.386 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:38:01.386 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether f2:23:83:31:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:01.386 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::f023:83ff:fe31:915/64 scope link 2023-11-04T01:38:01.386 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:01.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:01.387 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:38:01.453 INFO:teuthology.orchestra.run.smithi044.stdout:1 2023-11-04T01:38:01.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:01.454 DEBUG:teuthology.orchestra.run.smithi044:> route 2023-11-04T01:38:01.510 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2023-11-04T01:38:01.511 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:38:01.511 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-04T01:38:01.511 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-04T01:38:01.511 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:38:01.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:01.511 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:38:01.511 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:38:01.512 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:38:01.512 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:38:01.512 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:38:01.512 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:38:01.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:01.617 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2023-11-04T01:38:01.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:38:01.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:38:01.632 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:01.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:01.633 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2023-11-04T01:38:01.703 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:38:01.704 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:38:01.704 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:01.760 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:01.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:38:01.771 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:01.816 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:01.872 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:38:01.872 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:38:01.872 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:38:01.872 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:38:01.872 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:38:01.872 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:38:01.872 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:38:01.872 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:38:01.872 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:38:01.873 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:38:01.873 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:38:01.873 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:38:01.873 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:01.873 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:38:01.873 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:38:01.873 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:38:01.873 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:38:01.873 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:01.873 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:38:01.873 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:01.873 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:01.873 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:01.874 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:01.874 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:38:01.874 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:38:01.874 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:01.874 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:01.874 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:01.874 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:01.874 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:38:01.874 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:01.874 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:01.874 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:01.875 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:01.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:01.875 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:38:01.927 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:38:01.927 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:38:01.970 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:01.986 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:38:01.986 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:38:01.986 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:38:01.986 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:38:01.986 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:38:01.986 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:38:01.986 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:38:01.986 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:38:01.986 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:38:01.987 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:38:01.987 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:38:01.987 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:38:01.987 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:01.987 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:38:01.987 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:38:01.987 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:38:01.987 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:38:01.987 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:01.987 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:38:01.987 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:01.988 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:01.988 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:01.988 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:01.988 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:38:01.988 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:38:01.988 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:01.988 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:01.988 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:01.988 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:01.988 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:38:01.988 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:01.988 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:01.988 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:01.989 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:01.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:01.989 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:38:02.068 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:38:02.065+0000 7f818e047480 -1 init, newargv = 0x556f0fc14e00 newargc=15 2023-11-04T01:38:02.068 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[107758]: starting ceph client 2023-11-04T01:38:02.071 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[107758]: starting fuse 2023-11-04T01:38:03.144 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:03.164 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:38:03.165 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:38:03.165 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:38:03.165 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:38:03.165 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:38:03.165 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:38:03.165 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:38:03.165 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:38:03.165 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:38:03.165 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:38:03.165 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:38:03.165 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:38:03.166 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:03.166 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:38:03.166 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:38:03.166 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:38:03.166 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:38:03.166 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:03.166 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:38:03.166 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:03.166 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:03.166 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:03.166 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:03.166 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:38:03.167 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:38:03.167 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:03.167 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:03.167 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:03.167 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:03.167 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:38:03.167 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:03.167 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:03.167 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:03.167 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:03.167 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:03.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:03.168 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:38:03.223 INFO:teuthology.orchestra.run.smithi044.stdout:41 2023-11-04T01:38:03.223 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:38:03.223 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:38:03.223 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2023-11-04T01:38:03.223 DEBUG:teuthology.orchestra.run.smithi044:> import re 2023-11-04T01:38:03.223 DEBUG:teuthology.orchestra.run.smithi044:> import os 2023-11-04T01:38:03.223 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2023-11-04T01:38:03.224 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:38:03.224 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2023-11-04T01:38:03.224 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:38:03.224 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2023-11-04T01:38:03.224 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:38:03.224 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:38:03.224 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2023-11-04T01:38:03.224 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2023-11-04T01:38:03.224 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2023-11-04T01:38:03.224 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2023-11-04T01:38:03.224 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:38:03.224 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2023-11-04T01:38:03.224 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:38:03.224 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:38:03.225 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:38:03.225 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2023-11-04T01:38:03.225 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2023-11-04T01:38:03.225 DEBUG:teuthology.orchestra.run.smithi044:> return f 2023-11-04T01:38:03.225 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:38:03.225 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:38:03.225 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2023-11-04T01:38:03.225 DEBUG:teuthology.orchestra.run.smithi044:> ' 2023-11-04T01:38:03.360 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.107758.asok 2023-11-04T01:38:03.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:03.371 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.107758.asok 2023-11-04T01:38:03.371 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:03.372 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.107758.asok status 2023-11-04T01:38:03.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:03.551 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:38:03.551 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2023-11-04T01:38:03.551 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:38:03.551 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:38:03.552 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2023-11-04T01:38:03.552 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2023-11-04T01:38:03.552 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:38:03.552 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "107758", 2023-11-04T01:38:03.552 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2023-11-04T01:38:03.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:03.552 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2023-11-04T01:38:03.552 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2023-11-04T01:38:03.552 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6165, 2023-11-04T01:38:03.552 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2023-11-04T01:38:03.552 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2023-11-04T01:38:03.552 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2023-11-04T01:38:03.552 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 6165 2023-11-04T01:38:03.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:03.553 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:38:03.553 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:38:03.553 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:38:03.553 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3359222979 2023-11-04T01:38:03.553 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:03.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:03.553 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:38:03.553 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:38:03.553 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:38:03.553 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3359222979 2023-11-04T01:38:03.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:03.553 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.6165 192.168.0.1:0/3359222979", 2023-11-04T01:38:03.553 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/3359222979", 2023-11-04T01:38:03.554 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2023-11-04T01:38:03.554 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 24, 2023-11-04T01:38:03.554 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 56, 2023-11-04T01:38:03.554 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:38:03.554 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2023-11-04T01:38:03.554 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2023-11-04T01:38:03.554 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:38:03.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:03.564 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:03.564 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:38:03.565 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:03.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:03.628 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2023-11-04T01:38:03.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:03.635 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:03.635 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:03.635 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:03.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:03.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:03.706 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data mksnap snap1 2023-11-04T01:38:03.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.745+0000 7f975de37f40 1 Processor -- start 2023-11-04T01:38:03.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.745+0000 7f975de37f40 1 -- start start 2023-11-04T01:38:03.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975de37f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d373f04130 0x55d373fceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975de37f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d373f48e40 0x55d373fd3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975de37f40 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d373fd6860 0x55d373fd3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975de37f40 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d373eb03b0 con 0x55d373fd6860 2023-11-04T01:38:03.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975de37f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d373e4a650 con 0x55d373f04130 2023-11-04T01:38:03.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975de37f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d373e4a2f0 con 0x55d373f48e40 2023-11-04T01:38:03.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975ba26640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d373fd6860 0x55d373fd3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975ba26640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d373fd6860 0x55d373fd3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50214/0 (socket says 172.21.15.44:50214) 2023-11-04T01:38:03.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975ba26640 1 -- 172.21.15.44:0/377591657 learned_addr learned my addr 172.21.15.44:0/377591657 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:03.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975aa24640 1 --2- 172.21.15.44:0/377591657 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d373f48e40 0x55d373fd3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975b225640 1 --2- 172.21.15.44:0/377591657 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d373f04130 0x55d373fceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975ba26640 1 -- 172.21.15.44:0/377591657 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d373f48e40 msgr2=0x55d373fd3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975ba26640 1 --2- 172.21.15.44:0/377591657 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d373f48e40 0x55d373fd3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975ba26640 1 -- 172.21.15.44:0/377591657 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d373f04130 msgr2=0x55d373fceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975ba26640 1 --2- 172.21.15.44:0/377591657 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d373f04130 0x55d373fceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.746+0000 7f975ba26640 1 -- 172.21.15.44:0/377591657 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c005de0 con 0x55d373fd6860 2023-11-04T01:38:03.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.747+0000 7f975ba26640 1 --2- 172.21.15.44:0/377591657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d373fd6860 0x55d373fd3560 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f975400a4b0 tx=0x7f975400a970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32bd11e76b0776a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.747+0000 7f9759a22640 1 -- 172.21.15.44:0/377591657 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975400e710 con 0x55d373fd6860 2023-11-04T01:38:03.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.747+0000 7f9759a22640 1 -- 172.21.15.44:0/377591657 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975400e890 con 0x55d373fd6860 2023-11-04T01:38:03.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.747+0000 7f9759a22640 1 -- 172.21.15.44:0/377591657 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975400ec40 con 0x55d373fd6860 2023-11-04T01:38:03.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.747+0000 7f975de37f40 1 -- 172.21.15.44:0/377591657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d373fd6860 msgr2=0x55d373fd3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.747+0000 7f975de37f40 1 --2- 172.21.15.44:0/377591657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d373fd6860 0x55d373fd3560 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f975400a4b0 tx=0x7f975400a970 comp rx=0 tx=0).stop 2023-11-04T01:38:03.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.747+0000 7f975de37f40 1 -- 172.21.15.44:0/377591657 shutdown_connections 2023-11-04T01:38:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.747+0000 7f975de37f40 1 --2- 172.21.15.44:0/377591657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d373fd6860 0x55d373fd3560 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.747+0000 7f975de37f40 1 --2- 172.21.15.44:0/377591657 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d373f48e40 0x55d373fd3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.747+0000 7f975de37f40 1 --2- 172.21.15.44:0/377591657 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d373f04130 0x55d373fceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.747+0000 7f975de37f40 1 -- 172.21.15.44:0/377591657 >> 172.21.15.44:0/377591657 conn(0x55d373f49670 msgr2=0x55d373fd2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.747+0000 7f975de37f40 1 -- 172.21.15.44:0/377591657 shutdown_connections 2023-11-04T01:38:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.747+0000 7f975de37f40 1 -- 172.21.15.44:0/377591657 wait complete. 2023-11-04T01:38:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.748+0000 7f975de37f40 1 Processor -- start 2023-11-04T01:38:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.748+0000 7f975de37f40 1 -- start start 2023-11-04T01:38:03.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:03.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.748+0000 7f975de37f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d373f04130 0x55d373fce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.748+0000 7f975de37f40 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d373f48e40 0x55d373fb5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.748+0000 7f975de37f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d373fd6860 0x55d373f31180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.748+0000 7f975de37f40 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d373e2a4f0 con 0x55d373f48e40 2023-11-04T01:38:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.748+0000 7f975de37f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d373fcbb40 con 0x55d373fd6860 2023-11-04T01:38:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.748+0000 7f975de37f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d373fd3530 con 0x55d373f04130 2023-11-04T01:38:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f975aa24640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d373f48e40 0x55d373fb5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f975aa24640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d373f48e40 0x55d373fb5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50216/0 (socket says 172.21.15.44:50216) 2023-11-04T01:38:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f975aa24640 1 -- 172.21.15.44:0/1911338090 learned_addr learned my addr 172.21.15.44:0/1911338090 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f975b225640 1 --2- 172.21.15.44:0/1911338090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d373f04130 0x55d373fce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f975ba26640 1 --2- 172.21.15.44:0/1911338090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d373fd6860 0x55d373f31180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f975aa24640 1 -- 172.21.15.44:0/1911338090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d373f04130 msgr2=0x55d373fce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f975aa24640 1 --2- 172.21.15.44:0/1911338090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d373f04130 0x55d373fce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f975aa24640 1 -- 172.21.15.44:0/1911338090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d373fd6860 msgr2=0x55d373f31180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f975aa24640 1 --2- 172.21.15.44:0/1911338090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d373fd6860 0x55d373f31180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f975aa24640 1 -- 172.21.15.44:0/1911338090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975400a0e0 con 0x55d373f48e40 2023-11-04T01:38:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f975aa24640 1 --2- 172.21.15.44:0/1911338090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d373f48e40 0x55d373fb5720 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9750007f80 tx=0x7f9750006810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f9758a20640 1 -- 172.21.15.44:0/1911338090 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750011700 con 0x55d373f48e40 2023-11-04T01:38:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f9758a20640 1 -- 172.21.15.44:0/1911338090 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975000f040 con 0x55d373f48e40 2023-11-04T01:38:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f975de37f40 1 -- 172.21.15.44:0/1911338090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d373e56780 con 0x55d373f48e40 2023-11-04T01:38:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f9758a20640 1 -- 172.21.15.44:0/1911338090 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750011aa0 con 0x55d373f48e40 2023-11-04T01:38:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.749+0000 7f975de37f40 1 -- 172.21.15.44:0/1911338090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d373e49930 con 0x55d373f48e40 2023-11-04T01:38:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.751+0000 7f9758a20640 1 -- 172.21.15.44:0/1911338090 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9750011c00 con 0x55d373f48e40 2023-11-04T01:38:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.751+0000 7f9758a20640 1 --2- 172.21.15.44:0/1911338090 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9748069820 0x7f974806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.751+0000 7f9758a20640 1 -- 172.21.15.44:0/1911338090 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9750087a20 con 0x55d373f48e40 2023-11-04T01:38:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.751+0000 7f975de37f40 1 -- 172.21.15.44:0/1911338090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- pool_op(create snap pool 9 tid 1 name snap1 v0) v4 -- 0x55d373eba330 con 0x55d373f48e40 2023-11-04T01:38:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.751+0000 7f975b225640 1 --2- 172.21.15.44:0/1911338090 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9748069820 0x7f974806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.752+0000 7f9758a20640 1 -- 172.21.15.44:0/1911338090 <== mon.0 v2:172.21.15.44:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v56) v1 ==== 43+0+0 (secure 0 0 0) 0x7f9750018020 con 0x55d373f48e40 2023-11-04T01:38:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:error creating pool cephfs_data snapshot snap1: (95) Operation not supported 2023-11-04T01:38:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.752+0000 7f975de37f40 1 -- 172.21.15.44:0/1911338090 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9748069820 msgr2=0x7f974806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.752+0000 7f975de37f40 1 --2- 172.21.15.44:0/1911338090 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9748069820 0x7f974806bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.752+0000 7f975de37f40 1 -- 172.21.15.44:0/1911338090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d373f48e40 msgr2=0x55d373fb5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.752+0000 7f975de37f40 1 --2- 172.21.15.44:0/1911338090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d373f48e40 0x55d373fb5720 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9750007f80 tx=0x7f9750006810 comp rx=0 tx=0).stop 2023-11-04T01:38:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.752+0000 7f975de37f40 1 -- 172.21.15.44:0/1911338090 shutdown_connections 2023-11-04T01:38:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.752+0000 7f975de37f40 1 --2- 172.21.15.44:0/1911338090 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9748069820 0x7f974806bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.752+0000 7f975de37f40 1 --2- 172.21.15.44:0/1911338090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d373fd6860 0x55d373f31180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.752+0000 7f975de37f40 1 --2- 172.21.15.44:0/1911338090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d373f48e40 0x55d373fb5720 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.752+0000 7f975de37f40 1 --2- 172.21.15.44:0/1911338090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d373f04130 0x55d373fce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.752+0000 7f975de37f40 1 -- 172.21.15.44:0/1911338090 >> 172.21.15.44:0/1911338090 conn(0x55d373f49670 msgr2=0x55d373f4b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:03.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.752+0000 7f975de37f40 1 -- 172.21.15.44:0/1911338090 shutdown_connections 2023-11-04T01:38:03.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.752+0000 7f975de37f40 1 -- 172.21.15.44:0/1911338090 wait complete. 2023-11-04T01:38:03.762 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata mksnap snap2 2023-11-04T01:38:03.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.836+0000 7f133a0f5f40 1 Processor -- start 2023-11-04T01:38:03.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.836+0000 7f133a0f5f40 1 -- start start 2023-11-04T01:38:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f133a0f5f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fe9862f070 0x55fe986b5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f133a0f5f40 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe98632d00 0x55fe9862aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f133a0f5f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fe986be450 0x55fe9862af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f133a0f5f40 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe985993b0 con 0x55fe98632d00 2023-11-04T01:38:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f133a0f5f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe98533650 con 0x55fe9862f070 2023-11-04T01:38:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f133a0f5f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe985332f0 con 0x55fe986be450 2023-11-04T01:38:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f13373f6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe98632d00 0x55fe9862aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f13373f6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe98632d00 0x55fe9862aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50228/0 (socket says 172.21.15.44:50228) 2023-11-04T01:38:03.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f13373f6640 1 -- 172.21.15.44:0/1664842142 learned_addr learned my addr 172.21.15.44:0/1664842142 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:03.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f1337bf7640 1 --2- 172.21.15.44:0/1664842142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fe9862f070 0x55fe986b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f13383f8640 1 --2- 172.21.15.44:0/1664842142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fe986be450 0x55fe9862af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f13373f6640 1 -- 172.21.15.44:0/1664842142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fe986be450 msgr2=0x55fe9862af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f13373f6640 1 --2- 172.21.15.44:0/1664842142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fe986be450 0x55fe9862af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f13373f6640 1 -- 172.21.15.44:0/1664842142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fe9862f070 msgr2=0x55fe986b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f13373f6640 1 --2- 172.21.15.44:0/1664842142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fe9862f070 0x55fe986b5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f13373f6640 1 -- 172.21.15.44:0/1664842142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133000a1c0 con 0x55fe98632d00 2023-11-04T01:38:03.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.837+0000 7f1337bf7640 1 --2- 172.21.15.44:0/1664842142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fe9862f070 0x55fe986b5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:03.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.838+0000 7f13373f6640 1 --2- 172.21.15.44:0/1664842142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe98632d00 0x55fe9862aa10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f132c009910 tx=0x7f132c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c293e3c3ec55187 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.838+0000 7f13363f4640 1 -- 172.21.15.44:0/1664842142 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c00f040 con 0x55fe98632d00 2023-11-04T01:38:03.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.838+0000 7f13363f4640 1 -- 172.21.15.44:0/1664842142 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c008950 con 0x55fe98632d00 2023-11-04T01:38:03.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.838+0000 7f13363f4640 1 -- 172.21.15.44:0/1664842142 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c008d00 con 0x55fe98632d00 2023-11-04T01:38:03.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.838+0000 7f133a0f5f40 1 -- 172.21.15.44:0/1664842142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe98632d00 msgr2=0x55fe9862aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.838+0000 7f133a0f5f40 1 --2- 172.21.15.44:0/1664842142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe98632d00 0x55fe9862aa10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f132c009910 tx=0x7f132c005a00 comp rx=0 tx=0).stop 2023-11-04T01:38:03.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.838+0000 7f133a0f5f40 1 -- 172.21.15.44:0/1664842142 shutdown_connections 2023-11-04T01:38:03.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.838+0000 7f133a0f5f40 1 --2- 172.21.15.44:0/1664842142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fe986be450 0x55fe9862af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.838+0000 7f133a0f5f40 1 --2- 172.21.15.44:0/1664842142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe98632d00 0x55fe9862aa10 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.838+0000 7f133a0f5f40 1 --2- 172.21.15.44:0/1664842142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fe9862f070 0x55fe986b5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.838+0000 7f133a0f5f40 1 -- 172.21.15.44:0/1664842142 >> 172.21.15.44:0/1664842142 conn(0x55fe98631530 msgr2=0x55fe98631910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:03.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.838+0000 7f133a0f5f40 1 -- 172.21.15.44:0/1664842142 shutdown_connections 2023-11-04T01:38:03.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.838+0000 7f133a0f5f40 1 -- 172.21.15.44:0/1664842142 wait complete. 2023-11-04T01:38:03.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.839+0000 7f133a0f5f40 1 Processor -- start 2023-11-04T01:38:03.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.839+0000 7f133a0f5f40 1 -- start start 2023-11-04T01:38:03.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:03.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f133a0f5f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fe9862f070 0x55fe986b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f133a0f5f40 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe98632d00 0x55fe98618e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f133a0f5f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fe986be450 0x55fe986bd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f133a0f5f40 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe985134f0 con 0x55fe98632d00 2023-11-04T01:38:03.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f133a0f5f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe9862db50 con 0x55fe9862f070 2023-11-04T01:38:03.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f133a0f5f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe986b4b50 con 0x55fe986be450 2023-11-04T01:38:03.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f13373f6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe98632d00 0x55fe98618e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f13373f6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe98632d00 0x55fe98618e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50244/0 (socket says 172.21.15.44:50244) 2023-11-04T01:38:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f13373f6640 1 -- 172.21.15.44:0/1285416314 learned_addr learned my addr 172.21.15.44:0/1285416314 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f13383f8640 1 --2- 172.21.15.44:0/1285416314 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fe986be450 0x55fe986bd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f1337bf7640 1 --2- 172.21.15.44:0/1285416314 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fe9862f070 0x55fe986b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f13373f6640 1 -- 172.21.15.44:0/1285416314 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fe986be450 msgr2=0x55fe986bd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f13373f6640 1 --2- 172.21.15.44:0/1285416314 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fe986be450 0x55fe986bd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f13373f6640 1 -- 172.21.15.44:0/1285416314 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fe9862f070 msgr2=0x55fe986b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f13373f6640 1 --2- 172.21.15.44:0/1285416314 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fe9862f070 0x55fe986b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f13373f6640 1 -- 172.21.15.44:0/1285416314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c009510 con 0x55fe98632d00 2023-11-04T01:38:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f13383f8640 1 --2- 172.21.15.44:0/1285416314 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fe986be450 0x55fe986bd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f13373f6640 1 --2- 172.21.15.44:0/1285416314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe98632d00 0x55fe98618e30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x55fe985eb400 tx=0x7f132c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f13353f2640 1 -- 172.21.15.44:0/1285416314 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c00f040 con 0x55fe98632d00 2023-11-04T01:38:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f13353f2640 1 -- 172.21.15.44:0/1285416314 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c013850 con 0x55fe98632d00 2023-11-04T01:38:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f133a0f5f40 1 -- 172.21.15.44:0/1285416314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fe9853f780 con 0x55fe98632d00 2023-11-04T01:38:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f13353f2640 1 -- 172.21.15.44:0/1285416314 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c013c00 con 0x55fe98632d00 2023-11-04T01:38:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.840+0000 7f133a0f5f40 1 -- 172.21.15.44:0/1285416314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fe98532930 con 0x55fe98632d00 2023-11-04T01:38:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.842+0000 7f13353f2640 1 -- 172.21.15.44:0/1285416314 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f132c01d400 con 0x55fe98632d00 2023-11-04T01:38:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.842+0000 7f13353f2640 1 --2- 172.21.15.44:0/1285416314 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1324069850 0x7f132406bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.842+0000 7f13353f2640 1 -- 172.21.15.44:0/1285416314 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f132c089f40 con 0x55fe98632d00 2023-11-04T01:38:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.842+0000 7f1337bf7640 1 --2- 172.21.15.44:0/1285416314 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1324069850 0x7f132406bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.842+0000 7f133a0f5f40 1 -- 172.21.15.44:0/1285416314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- pool_op(create snap pool 8 tid 1 name snap2 v0) v4 -- 0x55fe985a3330 con 0x55fe98632d00 2023-11-04T01:38:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.842+0000 7f13353f2640 1 -- 172.21.15.44:0/1285416314 <== mon.0 v2:172.21.15.44:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v56) v1 ==== 43+0+0 (secure 0 0 0) 0x7f132c054e90 con 0x55fe98632d00 2023-11-04T01:38:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:error creating pool cephfs_metadata snapshot snap2: (95) Operation not supported 2023-11-04T01:38:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.843+0000 7f133a0f5f40 1 -- 172.21.15.44:0/1285416314 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1324069850 msgr2=0x7f132406bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.843+0000 7f133a0f5f40 1 --2- 172.21.15.44:0/1285416314 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1324069850 0x7f132406bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.843+0000 7f133a0f5f40 1 -- 172.21.15.44:0/1285416314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe98632d00 msgr2=0x55fe98618e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.843+0000 7f1337bf7640 1 --2- 172.21.15.44:0/1285416314 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1324069850 0x7f132406bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.843+0000 7f133a0f5f40 1 --2- 172.21.15.44:0/1285416314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe98632d00 0x55fe98618e30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x55fe985eb400 tx=0x7f132c003020 comp rx=0 tx=0).stop 2023-11-04T01:38:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.843+0000 7f133a0f5f40 1 -- 172.21.15.44:0/1285416314 shutdown_connections 2023-11-04T01:38:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.843+0000 7f133a0f5f40 1 --2- 172.21.15.44:0/1285416314 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1324069850 0x7f132406bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.843+0000 7f133a0f5f40 1 --2- 172.21.15.44:0/1285416314 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fe986be450 0x55fe986bd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.843+0000 7f133a0f5f40 1 --2- 172.21.15.44:0/1285416314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe98632d00 0x55fe98618e30 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.843+0000 7f133a0f5f40 1 --2- 172.21.15.44:0/1285416314 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fe9862f070 0x55fe986b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.843+0000 7f133a0f5f40 1 -- 172.21.15.44:0/1285416314 >> 172.21.15.44:0/1285416314 conn(0x55fe98631530 msgr2=0x55fe98631910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.843+0000 7f133a0f5f40 1 -- 172.21.15.44:0/1285416314 shutdown_connections 2023-11-04T01:38:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.843+0000 7f133a0f5f40 1 -- 172.21.15.44:0/1285416314 wait complete. 2023-11-04T01:38:03.852 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool mksnap cephfs_data snap3 2023-11-04T01:38:03.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.995+0000 7f58f44af640 1 Processor -- start 2023-11-04T01:38:03.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.995+0000 7f58f44af640 1 -- start start 2023-11-04T01:38:03.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.996+0000 7f58f44af640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f58ec160430 0x7f58ec0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.996+0000 7f58f44af640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f58ec06c3a0 0x7f58ec0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.996+0000 7f58f44af640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ec0b2fc0 con 0x7f58ec0b2b60 2023-11-04T01:38:03.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.996+0000 7f58f44af640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ec0cb580 con 0x7f58ec06c3a0 2023-11-04T01:38:03.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.996+0000 7f58f44af640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ec06c7d0 con 0x7f58ec160430 2023-11-04T01:38:03.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.996+0000 7f58f2a4c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f58ec06c3a0 0x7f58ec0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.996+0000 7f58f2a4c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f58ec06c3a0 0x7f58ec0cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50252/0 (socket says 172.21.15.44:50252) 2023-11-04T01:38:03.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.996+0000 7f58f2a4c640 1 -- 172.21.15.44:0/148584751 learned_addr learned my addr 172.21.15.44:0/148584751 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:03.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.996+0000 7f58f1a4a640 1 --1- 172.21.15.44:0/148584751 >> v1:172.21.15.44:6789/0 conn(0x7f58ec0b2b60 0x7f58ec06bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57130/0 (socket says 172.21.15.44:57130) 2023-11-04T01:38:03.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.996+0000 7f58f224b640 1 --2- 172.21.15.44:0/148584751 >> v2:172.21.15.204:3300/0 conn(0x7f58ec160430 0x7f58ec0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.996+0000 7f58f2a4c640 1 -- 172.21.15.44:0/148584751 >> v2:172.21.15.204:3300/0 conn(0x7f58ec160430 msgr2=0x7f58ec0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.996+0000 7f58f2a4c640 1 --2- 172.21.15.44:0/148584751 >> v2:172.21.15.204:3300/0 conn(0x7f58ec160430 0x7f58ec0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.996+0000 7f58f2a4c640 1 -- 172.21.15.44:0/148584751 >> v1:172.21.15.44:6789/0 conn(0x7f58ec0b2b60 legacy=0x7f58ec06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.996+0000 7f58f1249640 1 -- 172.21.15.44:0/148584751 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173596665 0 0) 0x7f58ec0b2fc0 con 0x7f58ec0b2b60 2023-11-04T01:38:03.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.996+0000 7f58f2a4c640 1 -- 172.21.15.44:0/148584751 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec06ca40 con 0x7f58ec06c3a0 2023-11-04T01:38:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.997+0000 7f58f2a4c640 1 --2- 172.21.15.44:0/148584751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58ec06c3a0 0x7f58ec0cbcb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f58ec06f6d0 tx=0x7f58e402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e1f312bcb3559e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.997+0000 7f58f1249640 1 -- 172.21.15.44:0/148584751 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e402cb20 con 0x7f58ec06c3a0 2023-11-04T01:38:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.997+0000 7f58f1249640 1 -- 172.21.15.44:0/148584751 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e402cc80 con 0x7f58ec06c3a0 2023-11-04T01:38:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.997+0000 7f58f1249640 1 -- 172.21.15.44:0/148584751 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e40343f0 con 0x7f58ec06c3a0 2023-11-04T01:38:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.998+0000 7f58f44af640 1 -- 172.21.15.44:0/148584751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58ec06c3a0 msgr2=0x7f58ec0cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.998+0000 7f58f44af640 1 --2- 172.21.15.44:0/148584751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58ec06c3a0 0x7f58ec0cbcb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f58ec06f6d0 tx=0x7f58e402bf80 comp rx=0 tx=0).stop 2023-11-04T01:38:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.998+0000 7f58f44af640 1 -- 172.21.15.44:0/148584751 shutdown_connections 2023-11-04T01:38:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.998+0000 7f58f44af640 1 --2- 172.21.15.44:0/148584751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58ec06c3a0 0x7f58ec0cbcb0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.998+0000 7f58f44af640 1 --2- 172.21.15.44:0/148584751 >> v2:172.21.15.204:3300/0 conn(0x7f58ec160430 0x7f58ec0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.998+0000 7f58f44af640 1 -- 172.21.15.44:0/148584751 >> 172.21.15.44:0/148584751 conn(0x7f58ec06ea20 msgr2=0x7f58ec06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.998+0000 7f58f44af640 1 -- 172.21.15.44:0/148584751 shutdown_connections 2023-11-04T01:38:04.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.998+0000 7f58f44af640 1 -- 172.21.15.44:0/148584751 wait complete. 2023-11-04T01:38:04.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.999+0000 7f58f44af640 1 Processor -- start 2023-11-04T01:38:04.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:03.999+0000 7f58f44af640 1 -- start start 2023-11-04T01:38:04.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f44af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58ec06c3a0 0x7f58ec15ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f44af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58ec0b2b60 0x7f58ec151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f44af640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58ec160430 0x7f58ec152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f44af640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec1527b0 con 0x7f58ec06c3a0 2023-11-04T01:38:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f44af640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec0c5060 con 0x7f58ec160430 2023-11-04T01:38:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f44af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec0c5340 con 0x7f58ec0b2b60 2023-11-04T01:38:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f224b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58ec06c3a0 0x7f58ec15ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f224b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58ec06c3a0 0x7f58ec15ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50260/0 (socket says 172.21.15.44:50260) 2023-11-04T01:38:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f224b640 1 -- 172.21.15.44:0/528947930 learned_addr learned my addr 172.21.15.44:0/528947930 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f2a4c640 1 --2- 172.21.15.44:0/528947930 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58ec160430 0x7f58ec152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f1a4a640 1 --2- 172.21.15.44:0/528947930 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58ec0b2b60 0x7f58ec151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f224b640 1 -- 172.21.15.44:0/528947930 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58ec0b2b60 msgr2=0x7f58ec151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f224b640 1 --2- 172.21.15.44:0/528947930 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58ec0b2b60 0x7f58ec151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f224b640 1 -- 172.21.15.44:0/528947930 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58ec160430 msgr2=0x7f58ec152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f224b640 1 --2- 172.21.15.44:0/528947930 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58ec160430 0x7f58ec152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f224b640 1 -- 172.21.15.44:0/528947930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e4009b30 con 0x7f58ec06c3a0 2023-11-04T01:38:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f2a4c640 1 --2- 172.21.15.44:0/528947930 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58ec160430 0x7f58ec152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f224b640 1 --2- 172.21.15.44:0/528947930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58ec06c3a0 0x7f58ec15ece0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f58e800c7f0 tx=0x7f58e800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58e2ffd640 1 -- 172.21.15.44:0/528947930 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e8004220 con 0x7f58ec06c3a0 2023-11-04T01:38:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58e2ffd640 1 -- 172.21.15.44:0/528947930 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e8004380 con 0x7f58ec06c3a0 2023-11-04T01:38:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f44af640 1 -- 172.21.15.44:0/528947930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ec0c5620 con 0x7f58ec06c3a0 2023-11-04T01:38:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58e2ffd640 1 -- 172.21.15.44:0/528947930 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e8007840 con 0x7f58ec06c3a0 2023-11-04T01:38:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.000+0000 7f58f44af640 1 -- 172.21.15.44:0/528947930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ec0c5be0 con 0x7f58ec06c3a0 2023-11-04T01:38:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.001+0000 7f58f44af640 1 -- 172.21.15.44:0/528947930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ec0c8da0 con 0x7f58ec06c3a0 2023-11-04T01:38:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.002+0000 7f58e2ffd640 1 -- 172.21.15.44:0/528947930 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f58e8007bb0 con 0x7f58ec06c3a0 2023-11-04T01:38:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.002+0000 7f58e2ffd640 1 --2- 172.21.15.44:0/528947930 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f58d006aea0 0x7f58d006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.002+0000 7f58e2ffd640 1 -- 172.21.15.44:0/528947930 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f58e8089720 con 0x7f58ec06c3a0 2023-11-04T01:38:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.002+0000 7f58f1a4a640 1 --2- 172.21.15.44:0/528947930 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f58d006aea0 0x7f58d006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.003+0000 7f58f1a4a640 1 --2- 172.21.15.44:0/528947930 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f58d006aea0 0x7f58d006d360 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f58dc007fd0 tx=0x7f58dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.006+0000 7f58e2ffd640 1 -- 172.21.15.44:0/528947930 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f58ec0c8da0 con 0x7f58ec06c3a0 2023-11-04T01:38:04.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.181+0000 7f58f44af640 1 -- 172.21.15.44:0/528947930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool mksnap", "pool": "cephfs_data", "snap": "snap3"} v 0) v1 -- 0x7f58ec0c8da0 con 0x7f58ec06c3a0 2023-11-04T01:38:04.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.182+0000 7f58e2ffd640 1 -- 172.21.15.44:0/528947930 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool mksnap", "pool": "cephfs_data", "snap": "snap3"}]=-95 (95) Operation not supported v56) v1 ==== 131+0+0 (secure 0 0 0) 0x7f58ec0c8da0 con 0x7f58ec06c3a0 2023-11-04T01:38:04.184 INFO:teuthology.orchestra.run.smithi044.stderr:Error ENOTSUP: (95) Operation not supported 2023-11-04T01:38:04.189 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:38:04.189 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool mksnap cephfs_metadata snap4 2023-11-04T01:38:04.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.295+0000 7f7261fe7640 1 Processor -- start 2023-11-04T01:38:04.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.296+0000 7f7261fe7640 1 -- start start 2023-11-04T01:38:04.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.296+0000 7f7261fe7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f725c0b1a40 0x7f725c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.296+0000 7f7261fe7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f725c06a830 0x7f725c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.296+0000 7f7261fe7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725c160990 con 0x7f725c1605b0 2023-11-04T01:38:04.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.296+0000 7f7261fe7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725c0cc7c0 con 0x7f725c06a830 2023-11-04T01:38:04.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.296+0000 7f7261fe7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725c0cd750 con 0x7f725c0b1a40 2023-11-04T01:38:04.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.296+0000 7f725bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f725c06a830 0x7f725c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.296+0000 7f725bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f725c06a830 0x7f725c0cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50272/0 (socket says 172.21.15.44:50272) 2023-11-04T01:38:04.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.296+0000 7f725bfff640 1 -- 172.21.15.44:0/3077732659 learned_addr learned my addr 172.21.15.44:0/3077732659 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:04.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.297+0000 7f725affd640 1 --2- 172.21.15.44:0/3077732659 >> v2:172.21.15.204:3300/0 conn(0x7f725c0b1a40 0x7f725c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.297+0000 7f725bfff640 1 -- 172.21.15.44:0/3077732659 >> v2:172.21.15.204:3300/0 conn(0x7f725c0b1a40 msgr2=0x7f725c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:04.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.297+0000 7f725bfff640 1 --2- 172.21.15.44:0/3077732659 >> v2:172.21.15.204:3300/0 conn(0x7f725c0b1a40 0x7f725c0ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.297+0000 7f725bfff640 1 -- 172.21.15.44:0/3077732659 >> v1:172.21.15.204:6789/0 conn(0x7f725c1605b0 legacy=0x7f725c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:04.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.297+0000 7f725bfff640 1 -- 172.21.15.44:0/3077732659 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c0cc4e0 con 0x7f725c06a830 2023-11-04T01:38:04.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.297+0000 7f725bfff640 1 --2- 172.21.15.44:0/3077732659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f725c06a830 0x7f725c0cf9f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f725c067540 tx=0x7f725402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d616fdd1a7ae0f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.298+0000 7f725a7fc640 1 -- 172.21.15.44:0/3077732659 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725402c960 con 0x7f725c06a830 2023-11-04T01:38:04.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.298+0000 7f725a7fc640 1 -- 172.21.15.44:0/3077732659 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725402cac0 con 0x7f725c06a830 2023-11-04T01:38:04.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.298+0000 7f725a7fc640 1 -- 172.21.15.44:0/3077732659 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725402ce50 con 0x7f725c06a830 2023-11-04T01:38:04.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.298+0000 7f7261fe7640 1 -- 172.21.15.44:0/3077732659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f725c06a830 msgr2=0x7f725c0cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.298+0000 7f7261fe7640 1 --2- 172.21.15.44:0/3077732659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f725c06a830 0x7f725c0cf9f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f725c067540 tx=0x7f725402bdc0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.298+0000 7f7261fe7640 1 -- 172.21.15.44:0/3077732659 shutdown_connections 2023-11-04T01:38:04.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.298+0000 7f7261fe7640 1 --2- 172.21.15.44:0/3077732659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f725c06a830 0x7f725c0cf9f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.298+0000 7f7261fe7640 1 --2- 172.21.15.44:0/3077732659 >> v2:172.21.15.204:3300/0 conn(0x7f725c0b1a40 0x7f725c0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.298+0000 7f7261fe7640 1 -- 172.21.15.44:0/3077732659 >> 172.21.15.44:0/3077732659 conn(0x7f725c071820 msgr2=0x7f725c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:04.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.298+0000 7f7261fe7640 1 -- 172.21.15.44:0/3077732659 shutdown_connections 2023-11-04T01:38:04.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.298+0000 7f7261fe7640 1 -- 172.21.15.44:0/3077732659 wait complete. 2023-11-04T01:38:04.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.299+0000 7f7261fe7640 1 Processor -- start 2023-11-04T01:38:04.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.300+0000 7f7261fe7640 1 -- start start 2023-11-04T01:38:04.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.300+0000 7f7261fe7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f725c06a830 0x7f725c1f6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.300+0000 7f7261fe7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f725c1605b0 0x7f725c1f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.300+0000 7f7261fe7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f725c0b2670 0x7f725c0c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.300+0000 7f7261fe7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c1f6d50 con 0x7f725c0b2670 2023-11-04T01:38:04.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.300+0000 7f7261fe7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c0b41b0 con 0x7f725c06a830 2023-11-04T01:38:04.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.300+0000 7f7261fe7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725c0b4410 con 0x7f725c1605b0 2023-11-04T01:38:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.300+0000 7f725bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f725c0b2670 0x7f725c0c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.300+0000 7f725bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f725c0b2670 0x7f725c0c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50274/0 (socket says 172.21.15.44:50274) 2023-11-04T01:38:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.300+0000 7f725bfff640 1 -- 172.21.15.44:0/2409933615 learned_addr learned my addr 172.21.15.44:0/2409933615 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.301+0000 7f725b7fe640 1 --2- 172.21.15.44:0/2409933615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f725c06a830 0x7f725c1f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.301+0000 7f725affd640 1 --2- 172.21.15.44:0/2409933615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f725c1605b0 0x7f725c1f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.301+0000 7f725bfff640 1 -- 172.21.15.44:0/2409933615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f725c1605b0 msgr2=0x7f725c1f2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.301+0000 7f725bfff640 1 --2- 172.21.15.44:0/2409933615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f725c1605b0 0x7f725c1f2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.301+0000 7f725bfff640 1 -- 172.21.15.44:0/2409933615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f725c06a830 msgr2=0x7f725c1f6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.301+0000 7f725bfff640 1 --2- 172.21.15.44:0/2409933615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f725c06a830 0x7f725c1f6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.301+0000 7f725bfff640 1 -- 172.21.15.44:0/2409933615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7254009b30 con 0x7f725c0b2670 2023-11-04T01:38:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.301+0000 7f725b7fe640 1 --2- 172.21.15.44:0/2409933615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f725c06a830 0x7f725c1f6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.301+0000 7f725bfff640 1 --2- 172.21.15.44:0/2409933615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f725c0b2670 0x7f725c0c8b30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f725402c300 tx=0x7f7254004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.301+0000 7f7243fff640 1 -- 172.21.15.44:0/2409933615 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725402ce30 con 0x7f725c0b2670 2023-11-04T01:38:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.301+0000 7f7243fff640 1 -- 172.21.15.44:0/2409933615 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7254040470 con 0x7f725c0b2670 2023-11-04T01:38:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.301+0000 7f7261fe7640 1 -- 172.21.15.44:0/2409933615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725c0b46f0 con 0x7f725c0b2670 2023-11-04T01:38:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.301+0000 7f7243fff640 1 -- 172.21.15.44:0/2409933615 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254040820 con 0x7f725c0b2670 2023-11-04T01:38:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.301+0000 7f7261fe7640 1 -- 172.21.15.44:0/2409933615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725c0b4cb0 con 0x7f725c0b2670 2023-11-04T01:38:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.302+0000 7f7261fe7640 1 -- 172.21.15.44:0/2409933615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725c0672a0 con 0x7f725c0b2670 2023-11-04T01:38:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.303+0000 7f7243fff640 1 -- 172.21.15.44:0/2409933615 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7254040980 con 0x7f725c0b2670 2023-11-04T01:38:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.303+0000 7f7243fff640 1 --2- 172.21.15.44:0/2409933615 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f724806ae70 0x7f724806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.303+0000 7f7243fff640 1 -- 172.21.15.44:0/2409933615 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f72540ac850 con 0x7f725c0b2670 2023-11-04T01:38:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.303+0000 7f725b7fe640 1 --2- 172.21.15.44:0/2409933615 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f724806ae70 0x7f724806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.304+0000 7f725b7fe640 1 --2- 172.21.15.44:0/2409933615 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f724806ae70 0x7f724806d330 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f724c006fd0 tx=0x7f724c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.307+0000 7f7243fff640 1 -- 172.21.15.44:0/2409933615 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7254077670 con 0x7f725c0b2670 2023-11-04T01:38:04.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.484+0000 7f7261fe7640 1 -- 172.21.15.44:0/2409933615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool mksnap", "pool": "cephfs_metadata", "snap": "snap4"} v 0) v1 -- 0x7f725c074290 con 0x7f725c0b2670 2023-11-04T01:38:04.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.484+0000 7f7243fff640 1 -- 172.21.15.44:0/2409933615 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool mksnap", "pool": "cephfs_metadata", "snap": "snap4"}]=-95 (95) Operation not supported v56) v1 ==== 135+0+0 (secure 0 0 0) 0x7f725407ac90 con 0x7f725c0b2670 2023-11-04T01:38:04.486 INFO:teuthology.orchestra.run.smithi044.stderr:Error ENOTSUP: (95) Operation not supported 2023-11-04T01:38:04.492 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:38:04.492 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:38:04.492 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:04.538 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:04.583 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:38:04.584 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:38:04.584 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:04.601 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:04.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.745+0000 7f9c4e9c0640 1 Processor -- start 2023-11-04T01:38:04.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.745+0000 7f9c4e9c0640 1 -- start start 2023-11-04T01:38:04.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.746+0000 7f9c4e9c0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9c480cde60 0x7f9c4815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.746+0000 7f9c4e9c0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9c480ce240 0x7f9c480d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.746+0000 7f9c4e9c0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4815e000 con 0x7f9c4815daa0 2023-11-04T01:38:04.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.746+0000 7f9c4e9c0640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4815e5c0 con 0x7f9c480ce240 2023-11-04T01:38:04.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.746+0000 7f9c4e9c0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4815e2e0 con 0x7f9c480cde60 2023-11-04T01:38:04.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.746+0000 7f9c4cf5d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9c480ce240 0x7f9c480d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.746+0000 7f9c477fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9c4815daa0 0x7f9c48157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57136/0 (socket says 172.21.15.44:57136) 2023-11-04T01:38:04.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.746+0000 7f9c477fe640 1 -- 172.21.15.44:0/1861935639 learned_addr learned my addr 172.21.15.44:0/1861935639 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:04.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.746+0000 7f9c47fff640 1 --2- 172.21.15.44:0/1861935639 >> v2:172.21.15.204:3300/0 conn(0x7f9c480cde60 0x7f9c4815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.746+0000 7f9c4cf5d640 1 -- 172.21.15.44:0/1861935639 >> v2:172.21.15.204:3300/0 conn(0x7f9c480cde60 msgr2=0x7f9c4815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:04.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.746+0000 7f9c4cf5d640 1 --2- 172.21.15.44:0/1861935639 >> v2:172.21.15.204:3300/0 conn(0x7f9c480cde60 0x7f9c4815d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.746+0000 7f9c4cf5d640 1 -- 172.21.15.44:0/1861935639 >> v1:172.21.15.44:6789/0 conn(0x7f9c4815daa0 legacy=0x7f9c48157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.746+0000 7f9c4cf5d640 1 -- 172.21.15.44:0/1861935639 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c480d1120 con 0x7f9c480ce240 2023-11-04T01:38:04.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.747+0000 7f9c4cf5d640 1 --2- 172.21.15.44:0/1861935639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c480ce240 0x7f9c480d1920 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9c480b5550 tx=0x7f9c4002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94833f501782f10 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.747+0000 7f9c46ffd640 1 -- 172.21.15.44:0/1861935639 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4002cc80 con 0x7f9c480ce240 2023-11-04T01:38:04.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.747+0000 7f9c46ffd640 1 -- 172.21.15.44:0/1861935639 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4002cde0 con 0x7f9c480ce240 2023-11-04T01:38:04.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.747+0000 7f9c46ffd640 1 -- 172.21.15.44:0/1861935639 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c40034660 con 0x7f9c480ce240 2023-11-04T01:38:04.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.748+0000 7f9c4e9c0640 1 -- 172.21.15.44:0/1861935639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c480ce240 msgr2=0x7f9c480d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.748+0000 7f9c4e9c0640 1 --2- 172.21.15.44:0/1861935639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c480ce240 0x7f9c480d1920 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9c480b5550 tx=0x7f9c4002bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.748+0000 7f9c4e9c0640 1 -- 172.21.15.44:0/1861935639 shutdown_connections 2023-11-04T01:38:04.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.748+0000 7f9c4e9c0640 1 --2- 172.21.15.44:0/1861935639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c480ce240 0x7f9c480d1920 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.748+0000 7f9c4e9c0640 1 --2- 172.21.15.44:0/1861935639 >> v2:172.21.15.204:3300/0 conn(0x7f9c480cde60 0x7f9c4815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.748+0000 7f9c4e9c0640 1 -- 172.21.15.44:0/1861935639 >> 172.21.15.44:0/1861935639 conn(0x7f9c48071f30 msgr2=0x7f9c480cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:04.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.748+0000 7f9c4e9c0640 1 -- 172.21.15.44:0/1861935639 shutdown_connections 2023-11-04T01:38:04.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.748+0000 7f9c4e9c0640 1 -- 172.21.15.44:0/1861935639 wait complete. 2023-11-04T01:38:04.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.749+0000 7f9c4e9c0640 1 Processor -- start 2023-11-04T01:38:04.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.749+0000 7f9c4e9c0640 1 -- start start 2023-11-04T01:38:04.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c4e9c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c480cde60 0x7f9c480ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c4e9c0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c480ce240 0x7f9c4814b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c4e9c0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4815daa0 0x7f9c480d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c4e9c0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480cae40 con 0x7f9c480cde60 2023-11-04T01:38:04.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c4e9c0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480cc830 con 0x7f9c480ce240 2023-11-04T01:38:04.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c4e9c0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480cbcb0 con 0x7f9c4815daa0 2023-11-04T01:38:04.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c47fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c480cde60 0x7f9c480ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c47fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c480cde60 0x7f9c480ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50288/0 (socket says 172.21.15.44:50288) 2023-11-04T01:38:04.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c47fff640 1 -- 172.21.15.44:0/4035933840 learned_addr learned my addr 172.21.15.44:0/4035933840 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:04.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c477fe640 1 --2- 172.21.15.44:0/4035933840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c480ce240 0x7f9c4814b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c4cf5d640 1 --2- 172.21.15.44:0/4035933840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4815daa0 0x7f9c480d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c47fff640 1 -- 172.21.15.44:0/4035933840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4815daa0 msgr2=0x7f9c480d1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c47fff640 1 --2- 172.21.15.44:0/4035933840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4815daa0 0x7f9c480d1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c47fff640 1 -- 172.21.15.44:0/4035933840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c480ce240 msgr2=0x7f9c4814b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c47fff640 1 --2- 172.21.15.44:0/4035933840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c480ce240 0x7f9c4814b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c47fff640 1 -- 172.21.15.44:0/4035933840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c40009a70 con 0x7f9c480cde60 2023-11-04T01:38:04.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.750+0000 7f9c47fff640 1 --2- 172.21.15.44:0/4035933840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c480cde60 0x7f9c480ca900 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00c7f0 tx=0x7f9c3c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.751+0000 7f9c44ff9640 1 -- 172.21.15.44:0/4035933840 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c004220 con 0x7f9c480cde60 2023-11-04T01:38:04.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.751+0000 7f9c44ff9640 1 -- 172.21.15.44:0/4035933840 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c0043a0 con 0x7f9c480cde60 2023-11-04T01:38:04.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.751+0000 7f9c4e9c0640 1 -- 172.21.15.44:0/4035933840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c480cbf90 con 0x7f9c480cde60 2023-11-04T01:38:04.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.751+0000 7f9c44ff9640 1 -- 172.21.15.44:0/4035933840 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c007860 con 0x7f9c480cde60 2023-11-04T01:38:04.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.751+0000 7f9c4e9c0640 1 -- 172.21.15.44:0/4035933840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c480cc550 con 0x7f9c480cde60 2023-11-04T01:38:04.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.752+0000 7f9c4e9c0640 1 -- 172.21.15.44:0/4035933840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4814f000 con 0x7f9c480cde60 2023-11-04T01:38:04.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.752+0000 7f9c44ff9640 1 -- 172.21.15.44:0/4035933840 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c3c007bd0 con 0x7f9c480cde60 2023-11-04T01:38:04.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.753+0000 7f9c44ff9640 1 --2- 172.21.15.44:0/4035933840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c3406ae70 0x7f9c3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.753+0000 7f9c44ff9640 1 -- 172.21.15.44:0/4035933840 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9c3c0897a0 con 0x7f9c480cde60 2023-11-04T01:38:04.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.753+0000 7f9c477fe640 1 --2- 172.21.15.44:0/4035933840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c3406ae70 0x7f9c3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.753+0000 7f9c477fe640 1 --2- 172.21.15.44:0/4035933840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c3406ae70 0x7f9c3406d330 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9c480c9970 tx=0x7f9c38009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.757+0000 7f9c44ff9640 1 -- 172.21.15.44:0/4035933840 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c3c054640 con 0x7f9c480cde60 2023-11-04T01:38:04.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.933+0000 7f9c4e9c0640 1 -- 172.21.15.44:0/4035933840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c48074290 con 0x7f9c480cde60 2023-11-04T01:38:04.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.935+0000 7f9c44ff9640 1 -- 172.21.15.44:0/4035933840 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+18523 (secure 0 0 0) 0x7f9c3c057c60 con 0x7f9c480cde60 2023-11-04T01:38:04.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:04.937 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":56,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:56.297312+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:53.256647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:53.639654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:04.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.937+0000 7f9c4e9c0640 1 -- 172.21.15.44:0/4035933840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c3406ae70 msgr2=0x7f9c3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.937+0000 7f9c4e9c0640 1 --2- 172.21.15.44:0/4035933840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c3406ae70 0x7f9c3406d330 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9c480c9970 tx=0x7f9c38009040 comp rx=0 tx=0).stop 2023-11-04T01:38:04.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.937+0000 7f9c4e9c0640 1 -- 172.21.15.44:0/4035933840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c480cde60 msgr2=0x7f9c480ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.937+0000 7f9c4e9c0640 1 --2- 172.21.15.44:0/4035933840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c480cde60 0x7f9c480ca900 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00c7f0 tx=0x7f9c3c00ccb0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.937+0000 7f9c4e9c0640 1 -- 172.21.15.44:0/4035933840 shutdown_connections 2023-11-04T01:38:04.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.937+0000 7f9c4e9c0640 1 --2- 172.21.15.44:0/4035933840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c3406ae70 0x7f9c3406d330 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.937+0000 7f9c4e9c0640 1 --2- 172.21.15.44:0/4035933840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4815daa0 0x7f9c480d1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.937+0000 7f9c4e9c0640 1 --2- 172.21.15.44:0/4035933840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c480ce240 0x7f9c4814b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.937+0000 7f9c4e9c0640 1 --2- 172.21.15.44:0/4035933840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c480cde60 0x7f9c480ca900 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.937+0000 7f9c4e9c0640 1 -- 172.21.15.44:0/4035933840 >> 172.21.15.44:0/4035933840 conn(0x7f9c48071f30 msgr2=0x7f9c480b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:04.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.937+0000 7f9c4e9c0640 1 -- 172.21.15.44:0/4035933840 shutdown_connections 2023-11-04T01:38:04.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:04.937+0000 7f9c4e9c0640 1 -- 172.21.15.44:0/4035933840 wait complete. 2023-11-04T01:38:04.950 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:37:53.256647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:37:53.639654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:04.950 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:05.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.057+0000 7f0ce227c640 1 Processor -- start 2023-11-04T01:38:05.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.057+0000 7f0ce227c640 1 -- start start 2023-11-04T01:38:05.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.058+0000 7f0ce227c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cdc15af20 0x7f0cdc0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.058+0000 7f0ce227c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0cdc0b64c0 0x7f0cdc0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.058+0000 7f0ce227c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cdc0d01f0 con 0x7f0cdc0cd3b0 2023-11-04T01:38:05.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.058+0000 7f0ce227c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cdc0b6a40 con 0x7f0cdc0b64c0 2023-11-04T01:38:05.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.058+0000 7f0ce227c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc0d04b0 con 0x7f0cdc15af20 2023-11-04T01:38:05.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.058+0000 7f0ce0819640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0cdc0cd3b0 0x7f0cdc0b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57150/0 (socket says 172.21.15.44:57150) 2023-11-04T01:38:05.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.058+0000 7f0ce0819640 1 -- 172.21.15.44:0/2626195332 learned_addr learned my addr 172.21.15.44:0/2626195332 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:05.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.059+0000 7f0cdb7fe640 1 --2- 172.21.15.44:0/2626195332 >> v2:172.21.15.204:3300/0 conn(0x7f0cdc0b64c0 0x7f0cdc0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.059+0000 7f0cdbfff640 1 --2- 172.21.15.44:0/2626195332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cdc15af20 0x7f0cdc0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.059+0000 7f0cdaffd640 1 -- 172.21.15.44:0/2626195332 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414918830 0 0) 0x7f0cdc0d01f0 con 0x7f0cdc0cd3b0 2023-11-04T01:38:05.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.059+0000 7f0cdaffd640 1 -- 172.21.15.44:0/2626195332 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc4003520 con 0x7f0cdc0cd3b0 2023-11-04T01:38:05.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.059+0000 7f0cdb7fe640 1 -- 172.21.15.44:0/2626195332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cdc15af20 msgr2=0x7f0cdc0b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:05.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.059+0000 7f0cdb7fe640 1 --2- 172.21.15.44:0/2626195332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cdc15af20 0x7f0cdc0b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.059+0000 7f0cdaffd640 1 -- 172.21.15.44:0/2626195332 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 655451726 0 0) 0x7f0cc4003520 con 0x7f0cdc0cd3b0 2023-11-04T01:38:05.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.059+0000 7f0cdb7fe640 1 -- 172.21.15.44:0/2626195332 >> v1:172.21.15.44:6789/0 conn(0x7f0cdc0cd3b0 legacy=0x7f0cdc0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.059+0000 7f0cdb7fe640 1 -- 172.21.15.44:0/2626195332 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc0d0790 con 0x7f0cdc0b64c0 2023-11-04T01:38:05.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.060+0000 7f0cdb7fe640 1 --2- 172.21.15.44:0/2626195332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cdc0b64c0 0x7f0cdc0cbc70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00097a0 tx=0x7f0cd002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aafb6bd814e17e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.060+0000 7f0cdaffd640 1 -- 172.21.15.44:0/2626195332 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd40019f0 con 0x7f0cdc0b64c0 2023-11-04T01:38:05.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.060+0000 7f0cdaffd640 1 -- 172.21.15.44:0/2626195332 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd002e050 con 0x7f0cdc0b64c0 2023-11-04T01:38:05.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.060+0000 7f0cdaffd640 1 -- 172.21.15.44:0/2626195332 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0030710 con 0x7f0cdc0b64c0 2023-11-04T01:38:05.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.060+0000 7f0ce227c640 1 -- 172.21.15.44:0/2626195332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cdc0b64c0 msgr2=0x7f0cdc0cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.060+0000 7f0ce227c640 1 --2- 172.21.15.44:0/2626195332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cdc0b64c0 0x7f0cdc0cbc70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00097a0 tx=0x7f0cd002b790 comp rx=0 tx=0).stop 2023-11-04T01:38:05.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.060+0000 7f0ce227c640 1 -- 172.21.15.44:0/2626195332 shutdown_connections 2023-11-04T01:38:05.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.060+0000 7f0ce227c640 1 --2- 172.21.15.44:0/2626195332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cdc0b64c0 0x7f0cdc0cbc70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.060+0000 7f0ce227c640 1 --2- 172.21.15.44:0/2626195332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cdc15af20 0x7f0cdc0b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.060+0000 7f0ce227c640 1 -- 172.21.15.44:0/2626195332 >> 172.21.15.44:0/2626195332 conn(0x7f0cdc06ea20 msgr2=0x7f0cdc06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:05.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.060+0000 7f0ce227c640 1 -- 172.21.15.44:0/2626195332 shutdown_connections 2023-11-04T01:38:05.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.060+0000 7f0ce227c640 1 -- 172.21.15.44:0/2626195332 wait complete. 2023-11-04T01:38:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.062+0000 7f0ce227c640 1 Processor -- start 2023-11-04T01:38:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.062+0000 7f0ce227c640 1 -- start start 2023-11-04T01:38:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce227c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cdc0b64c0 0x7f0cdc0b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce227c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cdc0cd3b0 0x7f0cdc0b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce227c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cdc15af20 0x7f0cdc0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce227c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc158e30 con 0x7f0cdc15af20 2023-11-04T01:38:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce227c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc14c8b0 con 0x7f0cdc0cd3b0 2023-11-04T01:38:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce227c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc06c7b0 con 0x7f0cdc0b64c0 2023-11-04T01:38:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce0819640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cdc15af20 0x7f0cdc0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce0819640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cdc15af20 0x7f0cdc0b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50304/0 (socket says 172.21.15.44:50304) 2023-11-04T01:38:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce0819640 1 -- 172.21.15.44:0/3685374630 learned_addr learned my addr 172.21.15.44:0/3685374630 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0cdbfff640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cdc0b64c0 0x7f0cdc0b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0cdb7fe640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cdc0cd3b0 0x7f0cdc0b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce0819640 1 -- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cdc0b64c0 msgr2=0x7f0cdc0b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce0819640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cdc0b64c0 0x7f0cdc0b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce0819640 1 -- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cdc0cd3b0 msgr2=0x7f0cdc0b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce0819640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cdc0cd3b0 0x7f0cdc0b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce0819640 1 -- 172.21.15.44:0/3685374630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd0009400 con 0x7f0cdc15af20 2023-11-04T01:38:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0cdbfff640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cdc0b64c0 0x7f0cdc0b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0cdb7fe640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cdc0cd3b0 0x7f0cdc0b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce0819640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cdc15af20 0x7f0cdc0b2e50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4001830 tx=0x7f0cd400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0cd8ff9640 1 -- 172.21.15.44:0/3685374630 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4012400 con 0x7f0cdc15af20 2023-11-04T01:38:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0cd8ff9640 1 -- 172.21.15.44:0/3685374630 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd4012560 con 0x7f0cdc15af20 2023-11-04T01:38:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0cd8ff9640 1 -- 172.21.15.44:0/3685374630 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4012910 con 0x7f0cdc15af20 2023-11-04T01:38:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce227c640 1 -- 172.21.15.44:0/3685374630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cdc06ca90 con 0x7f0cdc15af20 2023-11-04T01:38:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.063+0000 7f0ce227c640 1 -- 172.21.15.44:0/3685374630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cdc1566c0 con 0x7f0cdc15af20 2023-11-04T01:38:05.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.065+0000 7f0ce227c640 1 -- 172.21.15.44:0/3685374630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cdc14cab0 con 0x7f0cdc15af20 2023-11-04T01:38:05.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.065+0000 7f0cd8ff9640 1 -- 172.21.15.44:0/3685374630 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0cd4012a70 con 0x7f0cdc15af20 2023-11-04T01:38:05.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.065+0000 7f0cd8ff9640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0cc806ae70 0x7f0cc806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.065+0000 7f0cd8ff9640 1 -- 172.21.15.44:0/3685374630 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0cd4089fc0 con 0x7f0cdc15af20 2023-11-04T01:38:05.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.065+0000 7f0cdbfff640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0cc806ae70 0x7f0cc806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.066+0000 7f0cdbfff640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0cc806ae70 0x7f0cc806d330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc156330 tx=0x7f0ccc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.069+0000 7f0cd8ff9640 1 -- 172.21.15.44:0/3685374630 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0cd40bcca0 con 0x7f0cdc15af20 2023-11-04T01:38:05.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.246+0000 7f0ce227c640 1 -- 172.21.15.44:0/3685374630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0cdc155920 con 0x7f0cdc15af20 2023-11-04T01:38:05.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.246+0000 7f0cd8ff9640 1 -- 172.21.15.44:0/3685374630 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0cd4054e60 con 0x7f0cdc15af20 2023-11-04T01:38:05.249 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:38:05.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.248+0000 7f0ce227c640 1 -- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0cc806ae70 msgr2=0x7f0cc806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.248+0000 7f0ce227c640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0cc806ae70 0x7f0cc806d330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc156330 tx=0x7f0ccc008040 comp rx=0 tx=0).stop 2023-11-04T01:38:05.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.248+0000 7f0ce227c640 1 -- 172.21.15.44:0/3685374630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cdc15af20 msgr2=0x7f0cdc0b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.248+0000 7f0ce227c640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cdc15af20 0x7f0cdc0b2e50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4001830 tx=0x7f0cd400a430 comp rx=0 tx=0).stop 2023-11-04T01:38:05.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.248+0000 7f0ce227c640 1 -- 172.21.15.44:0/3685374630 shutdown_connections 2023-11-04T01:38:05.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.248+0000 7f0ce227c640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0cc806ae70 0x7f0cc806d330 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.248+0000 7f0ce227c640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cdc15af20 0x7f0cdc0b2e50 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.248+0000 7f0ce227c640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cdc0cd3b0 0x7f0cdc0b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.248+0000 7f0ce227c640 1 --2- 172.21.15.44:0/3685374630 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cdc0b64c0 0x7f0cdc0b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.248+0000 7f0ce227c640 1 -- 172.21.15.44:0/3685374630 >> 172.21.15.44:0/3685374630 conn(0x7f0cdc06ea20 msgr2=0x7f0cdc0b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:05.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.248+0000 7f0ce227c640 1 -- 172.21.15.44:0/3685374630 shutdown_connections 2023-11-04T01:38:05.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.248+0000 7f0ce227c640 1 -- 172.21.15.44:0/3685374630 wait complete. 2023-11-04T01:38:05.262 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:05.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.372+0000 7f3a23e0e640 1 Processor -- start 2023-11-04T01:38:05.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.372+0000 7f3a23e0e640 1 -- start start 2023-11-04T01:38:05.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.373+0000 7f3a23e0e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3a1c153e60 0x7f3a1c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.373+0000 7f3a23e0e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3a1c0cd6d0 0x7f3a1c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.373+0000 7f3a23e0e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1c0cde60 con 0x7f3a1c0b4880 2023-11-04T01:38:05.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.373+0000 7f3a23e0e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c160f90 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.373+0000 7f3a23e0e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c15e400 con 0x7f3a1c153e60 2023-11-04T01:38:05.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.373+0000 7f3a213a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3a1c0cd6d0 0x7f3a1c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.373+0000 7f3a213a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3a1c0cd6d0 0x7f3a1c161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50312/0 (socket says 172.21.15.44:50312) 2023-11-04T01:38:05.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.373+0000 7f3a213a9640 1 -- 172.21.15.44:0/3244714840 learned_addr learned my addr 172.21.15.44:0/3244714840 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:05.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.374+0000 7f3a21baa640 1 --2- 172.21.15.44:0/3244714840 >> v2:172.21.15.204:3300/0 conn(0x7f3a1c153e60 0x7f3a1c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.374+0000 7f3a213a9640 1 -- 172.21.15.44:0/3244714840 >> v2:172.21.15.204:3300/0 conn(0x7f3a1c153e60 msgr2=0x7f3a1c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:05.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.374+0000 7f3a213a9640 1 --2- 172.21.15.44:0/3244714840 >> v2:172.21.15.204:3300/0 conn(0x7f3a1c153e60 0x7f3a1c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.374+0000 7f3a213a9640 1 -- 172.21.15.44:0/3244714840 >> v1:172.21.15.204:6789/0 conn(0x7f3a1c0b4880 legacy=0x7f3a1c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:05.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.374+0000 7f3a213a9640 1 -- 172.21.15.44:0/3244714840 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c161960 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.374+0000 7f3a213a9640 1 --2- 172.21.15.44:0/3244714840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1c0cd6d0 0x7f3a1c161420 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c08abe0 tx=0x7f3a1002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8af9b5fbf48dafa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.375+0000 7f3a20ba8640 1 -- 172.21.15.44:0/3244714840 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10031870 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.375+0000 7f3a20ba8640 1 -- 172.21.15.44:0/3244714840 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a100319d0 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.375+0000 7f3a20ba8640 1 -- 172.21.15.44:0/3244714840 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10031d60 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.375+0000 7f3a23e0e640 1 -- 172.21.15.44:0/3244714840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1c0cd6d0 msgr2=0x7f3a1c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.375+0000 7f3a23e0e640 1 --2- 172.21.15.44:0/3244714840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1c0cd6d0 0x7f3a1c161420 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c08abe0 tx=0x7f3a1002b910 comp rx=0 tx=0).stop 2023-11-04T01:38:05.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.375+0000 7f3a23e0e640 1 -- 172.21.15.44:0/3244714840 shutdown_connections 2023-11-04T01:38:05.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.375+0000 7f3a23e0e640 1 --2- 172.21.15.44:0/3244714840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1c0cd6d0 0x7f3a1c161420 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.375+0000 7f3a23e0e640 1 --2- 172.21.15.44:0/3244714840 >> v2:172.21.15.204:3300/0 conn(0x7f3a1c153e60 0x7f3a1c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.375+0000 7f3a23e0e640 1 -- 172.21.15.44:0/3244714840 >> 172.21.15.44:0/3244714840 conn(0x7f3a1c0cf880 msgr2=0x7f3a1c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:05.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.375+0000 7f3a23e0e640 1 -- 172.21.15.44:0/3244714840 shutdown_connections 2023-11-04T01:38:05.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.375+0000 7f3a23e0e640 1 -- 172.21.15.44:0/3244714840 wait complete. 2023-11-04T01:38:05.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.376+0000 7f3a23e0e640 1 Processor -- start 2023-11-04T01:38:05.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.376+0000 7f3a23e0e640 1 -- start start 2023-11-04T01:38:05.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.377+0000 7f3a23e0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a1c0b4880 0x7f3a1c0c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.377+0000 7f3a23e0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1c0cd6d0 0x7f3a1c1580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.377+0000 7f3a23e0e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a1c153e60 0x7f3a1c15f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.377+0000 7f3a23e0e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0c6110 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.377+0000 7f3a23e0e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c1f5ad0 con 0x7f3a1c153e60 2023-11-04T01:38:05.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.377+0000 7f3a23e0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c1f5d20 con 0x7f3a1c0b4880 2023-11-04T01:38:05.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.377+0000 7f3a213a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1c0cd6d0 0x7f3a1c1580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.377+0000 7f3a213a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1c0cd6d0 0x7f3a1c1580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50314/0 (socket says 172.21.15.44:50314) 2023-11-04T01:38:05.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.377+0000 7f3a213a9640 1 -- 172.21.15.44:0/2237553023 learned_addr learned my addr 172.21.15.44:0/2237553023 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:05.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.377+0000 7f3a223ab640 1 --2- 172.21.15.44:0/2237553023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a1c153e60 0x7f3a1c15f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.377+0000 7f3a21baa640 1 --2- 172.21.15.44:0/2237553023 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a1c0b4880 0x7f3a1c0c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.378+0000 7f3a213a9640 1 -- 172.21.15.44:0/2237553023 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a1c0b4880 msgr2=0x7f3a1c0c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.378+0000 7f3a213a9640 1 --2- 172.21.15.44:0/2237553023 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a1c0b4880 0x7f3a1c0c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.378+0000 7f3a213a9640 1 -- 172.21.15.44:0/2237553023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a1c153e60 msgr2=0x7f3a1c15f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.378+0000 7f3a213a9640 1 --2- 172.21.15.44:0/2237553023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a1c153e60 0x7f3a1c15f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.378+0000 7f3a213a9640 1 -- 172.21.15.44:0/2237553023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a100094d0 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.378+0000 7f3a213a9640 1 --2- 172.21.15.44:0/2237553023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1c0cd6d0 0x7f3a1c1580c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3a10000c00 tx=0x7f3a100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.378+0000 7f3a1a7fc640 1 -- 172.21.15.44:0/2237553023 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1003abe0 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.378+0000 7f3a1a7fc640 1 -- 172.21.15.44:0/2237553023 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1003ad40 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.378+0000 7f3a23e0e640 1 -- 172.21.15.44:0/2237553023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c1f6000 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.378+0000 7f3a1a7fc640 1 -- 172.21.15.44:0/2237553023 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10044610 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.378+0000 7f3a23e0e640 1 -- 172.21.15.44:0/2237553023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c1f65c0 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.379+0000 7f3a23e0e640 1 -- 172.21.15.44:0/2237553023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c074290 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.379+0000 7f3a1a7fc640 1 -- 172.21.15.44:0/2237553023 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a1004d450 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.380+0000 7f3a1a7fc640 1 --2- 172.21.15.44:0/2237553023 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3a0806aea0 0x7f3a0806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.380+0000 7f3a1a7fc640 1 -- 172.21.15.44:0/2237553023 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3a1002d040 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.380+0000 7f3a21baa640 1 --2- 172.21.15.44:0/2237553023 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3a0806aea0 0x7f3a0806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.381+0000 7f3a21baa640 1 --2- 172.21.15.44:0/2237553023 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3a0806aea0 0x7f3a0806d360 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0099c0 tx=0x7f3a0c003990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.384+0000 7f3a1a7fc640 1 -- 172.21.15.44:0/2237553023 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a10076c50 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.560+0000 7f3a23e0e640 1 -- 172.21.15.44:0/2237553023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f3a1c074290 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.560+0000 7f3a1a7fc640 1 -- 172.21.15.44:0/2237553023 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v56) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3a100350a0 con 0x7f3a1c0cd6d0 2023-11-04T01:38:05.565 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.563+0000 7f3a23e0e640 1 -- 172.21.15.44:0/2237553023 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3a0806aea0 msgr2=0x7f3a0806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.563+0000 7f3a23e0e640 1 --2- 172.21.15.44:0/2237553023 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3a0806aea0 0x7f3a0806d360 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0099c0 tx=0x7f3a0c003990 comp rx=0 tx=0).stop 2023-11-04T01:38:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.563+0000 7f3a23e0e640 1 -- 172.21.15.44:0/2237553023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1c0cd6d0 msgr2=0x7f3a1c1580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.563+0000 7f3a23e0e640 1 --2- 172.21.15.44:0/2237553023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1c0cd6d0 0x7f3a1c1580c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3a10000c00 tx=0x7f3a100046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.563+0000 7f3a23e0e640 1 -- 172.21.15.44:0/2237553023 shutdown_connections 2023-11-04T01:38:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.563+0000 7f3a23e0e640 1 --2- 172.21.15.44:0/2237553023 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3a0806aea0 0x7f3a0806d360 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.563+0000 7f3a23e0e640 1 --2- 172.21.15.44:0/2237553023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a1c153e60 0x7f3a1c15f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.563+0000 7f3a23e0e640 1 --2- 172.21.15.44:0/2237553023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1c0cd6d0 0x7f3a1c1580c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.563+0000 7f3a23e0e640 1 --2- 172.21.15.44:0/2237553023 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a1c0b4880 0x7f3a1c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.563+0000 7f3a23e0e640 1 -- 172.21.15.44:0/2237553023 >> 172.21.15.44:0/2237553023 conn(0x7f3a1c0cf880 msgr2=0x7f3a1c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.563+0000 7f3a23e0e640 1 -- 172.21.15.44:0/2237553023 shutdown_connections 2023-11-04T01:38:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.563+0000 7f3a23e0e640 1 -- 172.21.15.44:0/2237553023 wait complete. 2023-11-04T01:38:05.575 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:38:05.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.683+0000 7f7580fb6640 1 Processor -- start 2023-11-04T01:38:05.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.683+0000 7f7580fb6640 1 -- start start 2023-11-04T01:38:05.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.684+0000 7f7580fb6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f757c0cd6d0 0x7f757c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.684+0000 7f7580fb6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0b4880 0x7f757c0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.684+0000 7f7580fb6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757c0cde60 con 0x7f757c153e60 2023-11-04T01:38:05.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.684+0000 7f7580fb6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c160f90 con 0x7f757c0cd6d0 2023-11-04T01:38:05.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.684+0000 7f7580fb6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c161960 con 0x7f757c0b4880 2023-11-04T01:38:05.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.684+0000 7f7579d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f757c0cd6d0 0x7f757c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.684+0000 7f757a59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f757c153e60 0x7f757c15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57158/0 (socket says 172.21.15.44:57158) 2023-11-04T01:38:05.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.684+0000 7f757a59c640 1 -- 172.21.15.44:0/1432419651 learned_addr learned my addr 172.21.15.44:0/1432419651 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:05.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.684+0000 7f757ad9d640 1 --2- 172.21.15.44:0/1432419651 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0b4880 0x7f757c0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.684+0000 7f7579d9b640 1 -- 172.21.15.44:0/1432419651 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0b4880 msgr2=0x7f757c0b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:05.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.684+0000 7f7579d9b640 1 --2- 172.21.15.44:0/1432419651 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0b4880 0x7f757c0b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.684+0000 7f7579d9b640 1 -- 172.21.15.44:0/1432419651 >> v1:172.21.15.44:6789/0 conn(0x7f757c153e60 legacy=0x7f757c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.684+0000 7f7579d9b640 1 -- 172.21.15.44:0/1432419651 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c0b5220 con 0x7f757c0cd6d0 2023-11-04T01:38:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.684+0000 7f757959a640 1 -- 172.21.15.44:0/1432419651 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638466467 0 0) 0x7f757c0cde60 con 0x7f757c153e60 2023-11-04T01:38:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.685+0000 7f7579d9b640 1 --2- 172.21.15.44:0/1432419651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c0cd6d0 0x7f757c161420 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7570009d90 tx=0x7f757002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f08c675b64f64e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.685+0000 7f757959a640 1 -- 172.21.15.44:0/1432419651 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757002cc50 con 0x7f757c0cd6d0 2023-11-04T01:38:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.685+0000 7f757959a640 1 -- 172.21.15.44:0/1432419651 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757002cdb0 con 0x7f757c0cd6d0 2023-11-04T01:38:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.685+0000 7f757959a640 1 -- 172.21.15.44:0/1432419651 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570034660 con 0x7f757c0cd6d0 2023-11-04T01:38:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.685+0000 7f7580fb6640 1 -- 172.21.15.44:0/1432419651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c0cd6d0 msgr2=0x7f757c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.685+0000 7f7580fb6640 1 --2- 172.21.15.44:0/1432419651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c0cd6d0 0x7f757c161420 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7570009d90 tx=0x7f757002bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.686+0000 7f7580fb6640 1 -- 172.21.15.44:0/1432419651 shutdown_connections 2023-11-04T01:38:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.686+0000 7f7580fb6640 1 --2- 172.21.15.44:0/1432419651 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0b4880 0x7f757c0b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.686+0000 7f7580fb6640 1 --2- 172.21.15.44:0/1432419651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c0cd6d0 0x7f757c161420 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.686+0000 7f7580fb6640 1 -- 172.21.15.44:0/1432419651 >> 172.21.15.44:0/1432419651 conn(0x7f757c0cf880 msgr2=0x7f757c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:05.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.686+0000 7f7580fb6640 1 -- 172.21.15.44:0/1432419651 shutdown_connections 2023-11-04T01:38:05.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.686+0000 7f7580fb6640 1 -- 172.21.15.44:0/1432419651 wait complete. 2023-11-04T01:38:05.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.687+0000 7f7580fb6640 1 Processor -- start 2023-11-04T01:38:05.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.687+0000 7f7580fb6640 1 -- start start 2023-11-04T01:38:05.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f7580fb6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0b4880 0x7f757c156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f7580fb6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f757c0cd6d0 0x7f757c1455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f7580fb6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c153e60 0x7f757c152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f7580fb6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c158c60 con 0x7f757c153e60 2023-11-04T01:38:05.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f7580fb6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c157380 con 0x7f757c0cd6d0 2023-11-04T01:38:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f7580fb6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c158ed0 con 0x7f757c0b4880 2023-11-04T01:38:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f757ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c153e60 0x7f757c152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f757ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c153e60 0x7f757c152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50326/0 (socket says 172.21.15.44:50326) 2023-11-04T01:38:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f757ad9d640 1 -- 172.21.15.44:0/3607497368 learned_addr learned my addr 172.21.15.44:0/3607497368 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f7579d9b640 1 --2- 172.21.15.44:0/3607497368 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f757c0cd6d0 0x7f757c1455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f757a59c640 1 --2- 172.21.15.44:0/3607497368 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0b4880 0x7f757c156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f757ad9d640 1 -- 172.21.15.44:0/3607497368 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0b4880 msgr2=0x7f757c156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f757ad9d640 1 --2- 172.21.15.44:0/3607497368 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0b4880 0x7f757c156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f757ad9d640 1 -- 172.21.15.44:0/3607497368 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f757c0cd6d0 msgr2=0x7f757c1455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f757ad9d640 1 --2- 172.21.15.44:0/3607497368 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f757c0cd6d0 0x7f757c1455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f757ad9d640 1 -- 172.21.15.44:0/3607497368 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7570009a70 con 0x7f757c153e60 2023-11-04T01:38:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f757a59c640 1 --2- 172.21.15.44:0/3607497368 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0b4880 0x7f757c156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f757ad9d640 1 --2- 172.21.15.44:0/3607497368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c153e60 0x7f757c152d50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f757400d800 tx=0x7f757400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f756affd640 1 -- 172.21.15.44:0/3607497368 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757400b6c0 con 0x7f757c153e60 2023-11-04T01:38:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f756affd640 1 -- 172.21.15.44:0/3607497368 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757400b840 con 0x7f757c153e60 2023-11-04T01:38:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.688+0000 7f7580fb6640 1 -- 172.21.15.44:0/3607497368 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c1591b0 con 0x7f757c153e60 2023-11-04T01:38:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.689+0000 7f756affd640 1 -- 172.21.15.44:0/3607497368 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757400bbf0 con 0x7f757c153e60 2023-11-04T01:38:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.689+0000 7f7580fb6640 1 -- 172.21.15.44:0/3607497368 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c156f50 con 0x7f757c153e60 2023-11-04T01:38:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.690+0000 7f7580fb6640 1 -- 172.21.15.44:0/3607497368 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757c1593d0 con 0x7f757c153e60 2023-11-04T01:38:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.690+0000 7f756affd640 1 -- 172.21.15.44:0/3607497368 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f757400bd50 con 0x7f757c153e60 2023-11-04T01:38:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.690+0000 7f756affd640 1 --2- 172.21.15.44:0/3607497368 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f755c06ae70 0x7f755c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.690+0000 7f756affd640 1 -- 172.21.15.44:0/3607497368 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7574089e40 con 0x7f757c153e60 2023-11-04T01:38:05.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.690+0000 7f757a59c640 1 --2- 172.21.15.44:0/3607497368 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f755c06ae70 0x7f755c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.691+0000 7f757a59c640 1 --2- 172.21.15.44:0/3607497368 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f755c06ae70 0x7f755c06d330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f756c000f60 tx=0x7f756c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.694+0000 7f756affd640 1 -- 172.21.15.44:0/3607497368 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7574054c50 con 0x7f757c153e60 2023-11-04T01:38:05.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.872+0000 7f7580fb6640 1 -- 172.21.15.44:0/3607497368 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f757c074290 con 0x7f757c153e60 2023-11-04T01:38:05.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.873+0000 7f756affd640 1 -- 172.21.15.44:0/3607497368 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7574058270 con 0x7f757c153e60 2023-11-04T01:38:05.875 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:05.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.875+0000 7f7580fb6640 1 -- 172.21.15.44:0/3607497368 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f755c06ae70 msgr2=0x7f755c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.875+0000 7f7580fb6640 1 --2- 172.21.15.44:0/3607497368 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f755c06ae70 0x7f755c06d330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f756c000f60 tx=0x7f756c009040 comp rx=0 tx=0).stop 2023-11-04T01:38:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.875+0000 7f7580fb6640 1 -- 172.21.15.44:0/3607497368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c153e60 msgr2=0x7f757c152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.875+0000 7f7580fb6640 1 --2- 172.21.15.44:0/3607497368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c153e60 0x7f757c152d50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f757400d800 tx=0x7f757400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.875+0000 7f7580fb6640 1 -- 172.21.15.44:0/3607497368 shutdown_connections 2023-11-04T01:38:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.875+0000 7f7580fb6640 1 --2- 172.21.15.44:0/3607497368 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f755c06ae70 0x7f755c06d330 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.875+0000 7f7580fb6640 1 --2- 172.21.15.44:0/3607497368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c153e60 0x7f757c152d50 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.875+0000 7f7580fb6640 1 --2- 172.21.15.44:0/3607497368 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f757c0cd6d0 0x7f757c1455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.875+0000 7f7580fb6640 1 --2- 172.21.15.44:0/3607497368 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0b4880 0x7f757c156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.875+0000 7f7580fb6640 1 -- 172.21.15.44:0/3607497368 >> 172.21.15.44:0/3607497368 conn(0x7f757c0cf880 msgr2=0x7f757c15fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.875+0000 7f7580fb6640 1 -- 172.21.15.44:0/3607497368 shutdown_connections 2023-11-04T01:38:05.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.875+0000 7f7580fb6640 1 -- 172.21.15.44:0/3607497368 wait complete. 2023-11-04T01:38:05.888 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:38:05.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.994+0000 7fac6035e640 1 Processor -- start 2023-11-04T01:38:05.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.995+0000 7fac6035e640 1 -- start start 2023-11-04T01:38:05.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.995+0000 7fac6035e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac58153e60 0x7fac5815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.995+0000 7fac6035e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac580cde60 con 0x7fac580cd6d0 2023-11-04T01:38:05.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.995+0000 7fac6035e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac58160f90 con 0x7fac580b4880 2023-11-04T01:38:05.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.995+0000 7fac6035e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5815e400 con 0x7fac58153e60 2023-11-04T01:38:05.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d8f9640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fac580cd6d0 0x7fac58161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57164/0 (socket says 172.21.15.44:57164) 2023-11-04T01:38:05.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d8f9640 1 -- 172.21.15.44:0/3070712696 learned_addr learned my addr 172.21.15.44:0/3070712696 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:06.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d0f8640 1 -- 172.21.15.44:0/3070712696 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743062081 0 0) 0x7fac580cde60 con 0x7fac580cd6d0 2023-11-04T01:38:06.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d0f8640 1 -- 172.21.15.44:0/3070712696 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac44003520 con 0x7fac580cd6d0 2023-11-04T01:38:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5e0fa640 1 --2- 172.21.15.44:0/3070712696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac58153e60 0x7fac5815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d0f8640 1 -- 172.21.15.44:0/3070712696 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2043009083 0 0) 0x7fac44003520 con 0x7fac580cd6d0 2023-11-04T01:38:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d0f8640 1 -- 172.21.15.44:0/3070712696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac58153e60 msgr2=0x7fac5815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d0f8640 1 --2- 172.21.15.44:0/3070712696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac58153e60 0x7fac5815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d0f8640 1 -- 172.21.15.44:0/3070712696 >> v1:172.21.15.204:6789/0 conn(0x7fac580b4880 legacy=0x7fac580d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d0f8640 1 -- 172.21.15.44:0/3070712696 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac580ce090 con 0x7fac580cd6d0 2023-11-04T01:38:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d0f8640 1 -- 172.21.15.44:0/3070712696 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fac48001670 con 0x7fac580cd6d0 2023-11-04T01:38:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d0f8640 1 -- 172.21.15.44:0/3070712696 >> v1:172.21.15.44:6789/0 conn(0x7fac580cd6d0 legacy=0x7fac58161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d0f8640 1 --2- 172.21.15.44:0/3070712696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac440039a0 0x7fac44003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d0f8640 1 --2- 172.21.15.44:0/3070712696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac58153e60 0x7fac440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d0f8640 1 --2- 172.21.15.44:0/3070712696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44004d00 0x7fac44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d0f8640 1 -- 172.21.15.44:0/3070712696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5815e400 con 0x7fac44004d00 2023-11-04T01:38:06.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d0f8640 1 -- 172.21.15.44:0/3070712696 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4400ba30 con 0x7fac440039a0 2023-11-04T01:38:06.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d0f8640 1 -- 172.21.15.44:0/3070712696 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4400bbf0 con 0x7fac58153e60 2023-11-04T01:38:06.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5e8fb640 1 --2- 172.21.15.44:0/3070712696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44004d00 0x7fac44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5e0fa640 1 --2- 172.21.15.44:0/3070712696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac440039a0 0x7fac44003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.996+0000 7fac5d8f9640 1 --2- 172.21.15.44:0/3070712696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac58153e60 0x7fac440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.997+0000 7fac5e8fb640 1 -- 172.21.15.44:0/3070712696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac58153e60 msgr2=0x7fac440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:06.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.997+0000 7fac5e8fb640 1 --2- 172.21.15.44:0/3070712696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac58153e60 0x7fac440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.997+0000 7fac5e8fb640 1 -- 172.21.15.44:0/3070712696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac440039a0 msgr2=0x7fac44003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:06.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.997+0000 7fac5e8fb640 1 --2- 172.21.15.44:0/3070712696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac440039a0 0x7fac44003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.997+0000 7fac5e8fb640 1 -- 172.21.15.44:0/3070712696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac44003520 con 0x7fac44004d00 2023-11-04T01:38:06.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.997+0000 7fac5e8fb640 1 --2- 172.21.15.44:0/3070712696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44004d00 0x7fac44005180 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fac50001e20 tx=0x7fac440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6cbc98dbf441d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.998+0000 7fac5d0f8640 1 -- 172.21.15.44:0/3070712696 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50003b70 con 0x7fac44004d00 2023-11-04T01:38:06.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.998+0000 7fac5d0f8640 1 -- 172.21.15.44:0/3070712696 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac50003cd0 con 0x7fac44004d00 2023-11-04T01:38:06.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.998+0000 7fac5d0f8640 1 -- 172.21.15.44:0/3070712696 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50005310 con 0x7fac44004d00 2023-11-04T01:38:06.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.998+0000 7fac6035e640 1 -- 172.21.15.44:0/3070712696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44004d00 msgr2=0x7fac44005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.998+0000 7fac6035e640 1 --2- 172.21.15.44:0/3070712696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44004d00 0x7fac44005180 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fac50001e20 tx=0x7fac440057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.998+0000 7fac5e8fb640 1 -- 172.21.15.44:0/3070712696 reap_dead start 2023-11-04T01:38:06.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.998+0000 7fac6035e640 1 -- 172.21.15.44:0/3070712696 shutdown_connections 2023-11-04T01:38:06.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.998+0000 7fac6035e640 1 -- 172.21.15.44:0/3070712696 >> 172.21.15.44:0/3070712696 conn(0x7fac580cf880 msgr2=0x7fac580cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:06.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.998+0000 7fac6035e640 1 -- 172.21.15.44:0/3070712696 shutdown_connections 2023-11-04T01:38:06.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.998+0000 7fac6035e640 1 -- 172.21.15.44:0/3070712696 wait complete. 2023-11-04T01:38:06.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.999+0000 7fac6035e640 1 Processor -- start 2023-11-04T01:38:06.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:05.999+0000 7fac6035e640 1 -- start start 2023-11-04T01:38:06.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.000+0000 7fac6035e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44004d00 0x7fac5815c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.000+0000 7fac6035e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac580d2de0 0x7fac580d3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.000+0000 7fac6035e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac581586b0 0x7fac58158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.000+0000 7fac6035e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac580d37a0 con 0x7fac44004d00 2023-11-04T01:38:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.000+0000 7fac6035e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5815a650 con 0x7fac580d2de0 2023-11-04T01:38:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.000+0000 7fac6035e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5815b490 con 0x7fac581586b0 2023-11-04T01:38:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.000+0000 7fac5e0fa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44004d00 0x7fac5815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.000+0000 7fac5e0fa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44004d00 0x7fac5815c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50346/0 (socket says 172.21.15.44:50346) 2023-11-04T01:38:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.000+0000 7fac5e0fa640 1 -- 172.21.15.44:0/3872611511 learned_addr learned my addr 172.21.15.44:0/3872611511 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.000+0000 7fac5e0fa640 1 -- 172.21.15.44:0/3872611511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac581586b0 msgr2=0x7fac58158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.000+0000 7fac5e0fa640 1 --2- 172.21.15.44:0/3872611511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac581586b0 0x7fac58158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.000+0000 7fac5e0fa640 1 -- 172.21.15.44:0/3872611511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac580d2de0 msgr2=0x7fac580d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.000+0000 7fac5e0fa640 1 --2- 172.21.15.44:0/3872611511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac580d2de0 0x7fac580d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.000+0000 7fac5e0fa640 1 -- 172.21.15.44:0/3872611511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5815a880 con 0x7fac44004d00 2023-11-04T01:38:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.001+0000 7fac5e0fa640 1 --2- 172.21.15.44:0/3872611511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44004d00 0x7fac5815c560 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fac540119d0 tx=0x7fac54011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.001+0000 7fac4effd640 1 -- 172.21.15.44:0/3872611511 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5400fa50 con 0x7fac44004d00 2023-11-04T01:38:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.001+0000 7fac4effd640 1 -- 172.21.15.44:0/3872611511 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5400fbb0 con 0x7fac44004d00 2023-11-04T01:38:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.001+0000 7fac6035e640 1 -- 172.21.15.44:0/3872611511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5815ab60 con 0x7fac44004d00 2023-11-04T01:38:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.001+0000 7fac4effd640 1 -- 172.21.15.44:0/3872611511 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54014440 con 0x7fac44004d00 2023-11-04T01:38:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.001+0000 7fac6035e640 1 -- 172.21.15.44:0/3872611511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5815b120 con 0x7fac44004d00 2023-11-04T01:38:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.002+0000 7fac6035e640 1 -- 172.21.15.44:0/3872611511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac58074290 con 0x7fac44004d00 2023-11-04T01:38:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.002+0000 7fac4effd640 1 -- 172.21.15.44:0/3872611511 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fac5401d400 con 0x7fac44004d00 2023-11-04T01:38:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.002+0000 7fac4effd640 1 --2- 172.21.15.44:0/3872611511 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fac3c06aea0 0x7fac3c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.003+0000 7fac4effd640 1 -- 172.21.15.44:0/3872611511 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fac54089fb0 con 0x7fac44004d00 2023-11-04T01:38:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.003+0000 7fac5d8f9640 1 --2- 172.21.15.44:0/3872611511 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fac3c06aea0 0x7fac3c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.004+0000 7fac5d8f9640 1 --2- 172.21.15.44:0/3872611511 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fac3c06aea0 0x7fac3c06d360 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fac48001b40 tx=0x7fac48001bf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.007+0000 7fac4effd640 1 -- 172.21.15.44:0/3872611511 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac540bcca0 con 0x7fac44004d00 2023-11-04T01:38:06.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.181+0000 7fac6035e640 1 -- 172.21.15.44:0/3872611511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac5815d920 con 0x7fac44004d00 2023-11-04T01:38:06.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.181+0000 7fac4effd640 1 -- 172.21.15.44:0/3872611511 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac54054dc0 con 0x7fac44004d00 2023-11-04T01:38:06.183 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:38:06.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.183+0000 7fac6035e640 1 -- 172.21.15.44:0/3872611511 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fac3c06aea0 msgr2=0x7fac3c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.183+0000 7fac6035e640 1 --2- 172.21.15.44:0/3872611511 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fac3c06aea0 0x7fac3c06d360 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fac48001b40 tx=0x7fac48001bf0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.183+0000 7fac6035e640 1 -- 172.21.15.44:0/3872611511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44004d00 msgr2=0x7fac5815c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.183+0000 7fac6035e640 1 --2- 172.21.15.44:0/3872611511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44004d00 0x7fac5815c560 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fac540119d0 tx=0x7fac54011e90 comp rx=0 tx=0).stop 2023-11-04T01:38:06.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.183+0000 7fac6035e640 1 -- 172.21.15.44:0/3872611511 shutdown_connections 2023-11-04T01:38:06.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.183+0000 7fac6035e640 1 --2- 172.21.15.44:0/3872611511 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fac3c06aea0 0x7fac3c06d360 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.183+0000 7fac6035e640 1 --2- 172.21.15.44:0/3872611511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac581586b0 0x7fac58158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.183+0000 7fac6035e640 1 --2- 172.21.15.44:0/3872611511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac580d2de0 0x7fac580d3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.183+0000 7fac6035e640 1 --2- 172.21.15.44:0/3872611511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44004d00 0x7fac5815c560 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.183+0000 7fac6035e640 1 -- 172.21.15.44:0/3872611511 >> 172.21.15.44:0/3872611511 conn(0x7fac580cf880 msgr2=0x7fac5815fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:06.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.183+0000 7fac6035e640 1 -- 172.21.15.44:0/3872611511 shutdown_connections 2023-11-04T01:38:06.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.183+0000 7fac6035e640 1 -- 172.21.15.44:0/3872611511 wait complete. 2023-11-04T01:38:06.196 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:38:06.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.301+0000 7f0d8d583640 1 Processor -- start 2023-11-04T01:38:06.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.301+0000 7f0d8d583640 1 -- start start 2023-11-04T01:38:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.302+0000 7f0d8d583640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0d8815ad30 0x7f0d880adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.302+0000 7f0d8d583640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0d88070e20 0x7f0d8815e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.302+0000 7f0d8d583640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d880c3900 con 0x7f0d880ad730 2023-11-04T01:38:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.302+0000 7f0d8d583640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d880ae260 con 0x7f0d8815ad30 2023-11-04T01:38:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.302+0000 7f0d8d583640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d880c3be0 con 0x7f0d88070e20 2023-11-04T01:38:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.302+0000 7f0d86ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0d8815ad30 0x7f0d880adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.302+0000 7f0d86ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0d8815ad30 0x7f0d880adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50354/0 (socket says 172.21.15.44:50354) 2023-11-04T01:38:06.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.302+0000 7f0d86ffd640 1 -- 172.21.15.44:0/3659698925 learned_addr learned my addr 172.21.15.44:0/3659698925 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:06.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.302+0000 7f0d877fe640 1 --2- 172.21.15.44:0/3659698925 >> v2:172.21.15.204:3300/0 conn(0x7f0d88070e20 0x7f0d8815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.302+0000 7f0d86ffd640 1 -- 172.21.15.44:0/3659698925 >> v2:172.21.15.204:3300/0 conn(0x7f0d88070e20 msgr2=0x7f0d8815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.302+0000 7f0d86ffd640 1 --2- 172.21.15.44:0/3659698925 >> v2:172.21.15.204:3300/0 conn(0x7f0d88070e20 0x7f0d8815e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.302+0000 7f0d86ffd640 1 -- 172.21.15.44:0/3659698925 >> v1:172.21.15.204:6789/0 conn(0x7f0d880ad730 legacy=0x7f0d88070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.302+0000 7f0d86ffd640 1 -- 172.21.15.44:0/3659698925 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d880c3ec0 con 0x7f0d8815ad30 2023-11-04T01:38:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.303+0000 7f0d86ffd640 1 --2- 172.21.15.44:0/3659698925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d8815ad30 0x7f0d880adc80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0d880cf9e0 tx=0x7f0d7802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7541773a6571e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.303+0000 7f0d867fc640 1 -- 172.21.15.44:0/3659698925 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d780317e0 con 0x7f0d8815ad30 2023-11-04T01:38:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.303+0000 7f0d867fc640 1 -- 172.21.15.44:0/3659698925 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d78031940 con 0x7f0d8815ad30 2023-11-04T01:38:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.303+0000 7f0d867fc640 1 -- 172.21.15.44:0/3659698925 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78031cd0 con 0x7f0d8815ad30 2023-11-04T01:38:06.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.303+0000 7f0d8d583640 1 -- 172.21.15.44:0/3659698925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d8815ad30 msgr2=0x7f0d880adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.303+0000 7f0d8d583640 1 --2- 172.21.15.44:0/3659698925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d8815ad30 0x7f0d880adc80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0d880cf9e0 tx=0x7f0d7802b880 comp rx=0 tx=0).stop 2023-11-04T01:38:06.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.303+0000 7f0d8d583640 1 -- 172.21.15.44:0/3659698925 shutdown_connections 2023-11-04T01:38:06.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.303+0000 7f0d8d583640 1 --2- 172.21.15.44:0/3659698925 >> v2:172.21.15.204:3300/0 conn(0x7f0d88070e20 0x7f0d8815e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.303+0000 7f0d8d583640 1 --2- 172.21.15.44:0/3659698925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d8815ad30 0x7f0d880adc80 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.303+0000 7f0d8d583640 1 -- 172.21.15.44:0/3659698925 >> 172.21.15.44:0/3659698925 conn(0x7f0d880ce950 msgr2=0x7f0d880ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:06.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.304+0000 7f0d8d583640 1 -- 172.21.15.44:0/3659698925 shutdown_connections 2023-11-04T01:38:06.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.304+0000 7f0d8d583640 1 -- 172.21.15.44:0/3659698925 wait complete. 2023-11-04T01:38:06.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.305+0000 7f0d8d583640 1 Processor -- start 2023-11-04T01:38:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.305+0000 7f0d8d583640 1 -- start start 2023-11-04T01:38:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.305+0000 7f0d8d583640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d88070e20 0x7f0d880ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.305+0000 7f0d8d583640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d880ad730 0x7f0d881f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d8d583640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d8815ad30 0x7f0d88151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d8d583640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d880b3e80 con 0x7f0d880ad730 2023-11-04T01:38:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d8d583640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d880cca30 con 0x7f0d88070e20 2023-11-04T01:38:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d8d583640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d881f6fd0 con 0x7f0d8815ad30 2023-11-04T01:38:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d7ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d880ad730 0x7f0d881f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d7ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d880ad730 0x7f0d881f6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50358/0 (socket says 172.21.15.44:50358) 2023-11-04T01:38:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d7ffff640 1 -- 172.21.15.44:0/2302541612 learned_addr learned my addr 172.21.15.44:0/2302541612 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d877fe640 1 --2- 172.21.15.44:0/2302541612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d8815ad30 0x7f0d88151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d86ffd640 1 --2- 172.21.15.44:0/2302541612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d88070e20 0x7f0d880ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d7ffff640 1 -- 172.21.15.44:0/2302541612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d8815ad30 msgr2=0x7f0d88151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d7ffff640 1 --2- 172.21.15.44:0/2302541612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d8815ad30 0x7f0d88151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d7ffff640 1 -- 172.21.15.44:0/2302541612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d88070e20 msgr2=0x7f0d880ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d7ffff640 1 --2- 172.21.15.44:0/2302541612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d88070e20 0x7f0d880ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d7ffff640 1 -- 172.21.15.44:0/2302541612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d780094d0 con 0x7f0d880ad730 2023-11-04T01:38:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d7ffff640 1 --2- 172.21.15.44:0/2302541612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d880ad730 0x7f0d881f6570 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c430 tx=0x7f0d7000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d7f7fe640 1 -- 172.21.15.44:0/2302541612 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70011790 con 0x7f0d880ad730 2023-11-04T01:38:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d7f7fe640 1 -- 172.21.15.44:0/2302541612 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d700118f0 con 0x7f0d880ad730 2023-11-04T01:38:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d8d583640 1 -- 172.21.15.44:0/2302541612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d880cc6c0 con 0x7f0d880ad730 2023-11-04T01:38:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.306+0000 7f0d7f7fe640 1 -- 172.21.15.44:0/2302541612 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70011ce0 con 0x7f0d880ad730 2023-11-04T01:38:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.307+0000 7f0d8d583640 1 -- 172.21.15.44:0/2302541612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d880c8660 con 0x7f0d880ad730 2023-11-04T01:38:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.307+0000 7f0d8d583640 1 -- 172.21.15.44:0/2302541612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d880cc520 con 0x7f0d880ad730 2023-11-04T01:38:06.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.308+0000 7f0d7f7fe640 1 -- 172.21.15.44:0/2302541612 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d7001c460 con 0x7f0d880ad730 2023-11-04T01:38:06.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.308+0000 7f0d7f7fe640 1 --2- 172.21.15.44:0/2302541612 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0d6806ae70 0x7f0d6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.308+0000 7f0d7f7fe640 1 -- 172.21.15.44:0/2302541612 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0d70089710 con 0x7f0d880ad730 2023-11-04T01:38:06.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.308+0000 7f0d86ffd640 1 --2- 172.21.15.44:0/2302541612 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0d6806ae70 0x7f0d6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.309+0000 7f0d86ffd640 1 --2- 172.21.15.44:0/2302541612 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0d6806ae70 0x7f0d6806d330 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0d78036000 tx=0x7f0d7803d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.312+0000 7f0d7f7fe640 1 -- 172.21.15.44:0/2302541612 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d880cc520 con 0x7f0d880ad730 2023-11-04T01:38:06.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.501+0000 7f0d8d583640 1 -- 172.21.15.44:0/2302541612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0d880cc520 con 0x7f0d880ad730 2023-11-04T01:38:06.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.501+0000 7f0d7f7fe640 1 -- 172.21.15.44:0/2302541612 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0d880cc520 con 0x7f0d880ad730 2023-11-04T01:38:06.503 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.503+0000 7f0d8d583640 1 -- 172.21.15.44:0/2302541612 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0d6806ae70 msgr2=0x7f0d6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.503+0000 7f0d8d583640 1 --2- 172.21.15.44:0/2302541612 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0d6806ae70 0x7f0d6806d330 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0d78036000 tx=0x7f0d7803d040 comp rx=0 tx=0).stop 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.503+0000 7f0d8d583640 1 -- 172.21.15.44:0/2302541612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d880ad730 msgr2=0x7f0d881f6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.503+0000 7f0d8d583640 1 --2- 172.21.15.44:0/2302541612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d880ad730 0x7f0d881f6570 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c430 tx=0x7f0d7000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.503+0000 7f0d8d583640 1 -- 172.21.15.44:0/2302541612 shutdown_connections 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.503+0000 7f0d8d583640 1 --2- 172.21.15.44:0/2302541612 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0d6806ae70 0x7f0d6806d330 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.503+0000 7f0d8d583640 1 --2- 172.21.15.44:0/2302541612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d8815ad30 0x7f0d88151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.503+0000 7f0d8d583640 1 --2- 172.21.15.44:0/2302541612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d880ad730 0x7f0d881f6570 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.503+0000 7f0d8d583640 1 --2- 172.21.15.44:0/2302541612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d88070e20 0x7f0d880ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.503+0000 7f0d8d583640 1 -- 172.21.15.44:0/2302541612 >> 172.21.15.44:0/2302541612 conn(0x7f0d880ce950 msgr2=0x7f0d8815d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:06.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.503+0000 7f0d8d583640 1 -- 172.21.15.44:0/2302541612 shutdown_connections 2023-11-04T01:38:06.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.503+0000 7f0d8d583640 1 -- 172.21.15.44:0/2302541612 wait complete. 2023-11-04T01:38:06.515 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2023-11-04T01:38:06.515 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:06.516 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:06.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:06.580 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[107758]: fuse finished with error 0 and tester_r 0 2023-11-04T01:38:06.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:06.585 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:38:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:06.588 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:38:06.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:06.588 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:38:06.603 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:38:06.604 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:06.622 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:06.623 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:38:06.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:06.623 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:38:06.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:06.680 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:38:06.681 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:38:06.681 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:06.696 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:06.696 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:38:06.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:06.697 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:38:06.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:06.752 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:38:06.753 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:38:06.753 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:06.770 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:06.770 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:38:06.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:06.771 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:38:06.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:06.828 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:38:06.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:06.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.932+0000 7f51d0af2640 1 Processor -- start 2023-11-04T01:38:06.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.932+0000 7f51d0af2640 1 -- start start 2023-11-04T01:38:06.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51d0af2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f51cc15ae40 0x7f51cc15bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51d0af2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51cc0cda30 0x7f51cc0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51d0af2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51cc0cc450 con 0x7f51cc0cbc00 2023-11-04T01:38:06.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51d0af2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51cc15f400 con 0x7f51cc15ae40 2023-11-04T01:38:06.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51d0af2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc15b220 con 0x7f51cc0cda30 2023-11-04T01:38:06.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51cad9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51cc0cda30 0x7f51cc0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51ca59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f51cc15ae40 0x7f51cc15bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51ca59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f51cc15ae40 0x7f51cc15bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:46060/0 (socket says 172.21.15.44:46060) 2023-11-04T01:38:06.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51c3fff640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f51cc0cbc00 0x7f51cc0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:59986/0 (socket says 172.21.15.44:59986) 2023-11-04T01:38:06.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51cad9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51cc0cda30 0x7f51cc0ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:38132/0 (socket says 172.21.15.44:38132) 2023-11-04T01:38:06.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51ca59c640 1 -- 172.21.15.44:0/3392304147 learned_addr learned my addr 172.21.15.44:0/3392304147 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:06.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51cad9d640 1 -- 172.21.15.44:0/3392304147 >> v2:172.21.15.204:3300/0 conn(0x7f51cc15ae40 msgr2=0x7f51cc15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:06.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51cad9d640 1 --2- 172.21.15.44:0/3392304147 >> v2:172.21.15.204:3300/0 conn(0x7f51cc15ae40 0x7f51cc15bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51cad9d640 1 -- 172.21.15.44:0/3392304147 >> v1:172.21.15.204:6789/0 conn(0x7f51cc0cbc00 legacy=0x7f51cc0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51cad9d640 1 -- 172.21.15.44:0/3392304147 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc15f890 con 0x7f51cc0cda30 2023-11-04T01:38:06.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.933+0000 7f51ca59c640 1 --2- 172.21.15.44:0/3392304147 >> v2:172.21.15.204:3300/0 conn(0x7f51cc15ae40 0x7f51cc15bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:06.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.934+0000 7f51cad9d640 1 --2- 172.21.15.44:0/3392304147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51cc0cda30 0x7f51cc0ced70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009d90 tx=0x7f51c402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f417c728b9cd595e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.934+0000 7f51c9d9b640 1 -- 172.21.15.44:0/3392304147 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c402cc50 con 0x7f51cc0cda30 2023-11-04T01:38:06.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.934+0000 7f51c9d9b640 1 -- 172.21.15.44:0/3392304147 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c402cdb0 con 0x7f51cc0cda30 2023-11-04T01:38:06.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.934+0000 7f51c9d9b640 1 -- 172.21.15.44:0/3392304147 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c4034660 con 0x7f51cc0cda30 2023-11-04T01:38:06.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.935+0000 7f51d0af2640 1 -- 172.21.15.44:0/3392304147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51cc0cda30 msgr2=0x7f51cc0ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.935+0000 7f51d0af2640 1 --2- 172.21.15.44:0/3392304147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51cc0cda30 0x7f51cc0ced70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009d90 tx=0x7f51c402bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.935+0000 7f51d0af2640 1 -- 172.21.15.44:0/3392304147 shutdown_connections 2023-11-04T01:38:06.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.935+0000 7f51d0af2640 1 --2- 172.21.15.44:0/3392304147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51cc0cda30 0x7f51cc0ced70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.935+0000 7f51d0af2640 1 --2- 172.21.15.44:0/3392304147 >> v2:172.21.15.204:3300/0 conn(0x7f51cc15ae40 0x7f51cc15bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.935+0000 7f51d0af2640 1 -- 172.21.15.44:0/3392304147 >> 172.21.15.44:0/3392304147 conn(0x7f51cc06ea90 msgr2=0x7f51cc06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:06.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.935+0000 7f51d0af2640 1 -- 172.21.15.44:0/3392304147 shutdown_connections 2023-11-04T01:38:06.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.935+0000 7f51d0af2640 1 -- 172.21.15.44:0/3392304147 wait complete. 2023-11-04T01:38:06.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.936+0000 7f51d0af2640 1 Processor -- start 2023-11-04T01:38:06.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.936+0000 7f51d0af2640 1 -- start start 2023-11-04T01:38:06.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.937+0000 7f51d0af2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51cc0cbc00 0x7f51cc146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.937+0000 7f51d0af2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51cc0cda30 0x7f51cc0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.937+0000 7f51d0af2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f51cc15ae40 0x7f51cc0b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.937+0000 7f51d0af2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc146e60 con 0x7f51cc0cda30 2023-11-04T01:38:06.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.937+0000 7f51d0af2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc0c9830 con 0x7f51cc15ae40 2023-11-04T01:38:06.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.937+0000 7f51d0af2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc0c9b10 con 0x7f51cc0cbc00 2023-11-04T01:38:06.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.937+0000 7f51c3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51cc0cda30 0x7f51cc0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.937+0000 7f51c3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51cc0cda30 0x7f51cc0b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50366/0 (socket says 172.21.15.44:50366) 2023-11-04T01:38:06.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.937+0000 7f51c3fff640 1 -- 172.21.15.44:0/4102162988 learned_addr learned my addr 172.21.15.44:0/4102162988 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:06.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.938+0000 7f51ca59c640 1 --2- 172.21.15.44:0/4102162988 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51cc0cbc00 0x7f51cc146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.938+0000 7f51cad9d640 1 --2- 172.21.15.44:0/4102162988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f51cc15ae40 0x7f51cc0b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.938+0000 7f51c3fff640 1 -- 172.21.15.44:0/4102162988 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51cc0cbc00 msgr2=0x7f51cc146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.938+0000 7f51c3fff640 1 --2- 172.21.15.44:0/4102162988 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51cc0cbc00 0x7f51cc146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.938+0000 7f51c3fff640 1 -- 172.21.15.44:0/4102162988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f51cc15ae40 msgr2=0x7f51cc0b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.938+0000 7f51c3fff640 1 --2- 172.21.15.44:0/4102162988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f51cc15ae40 0x7f51cc0b61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.938+0000 7f51c3fff640 1 -- 172.21.15.44:0/4102162988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0094d0 con 0x7f51cc0cda30 2023-11-04T01:38:06.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.938+0000 7f51c3fff640 1 --2- 172.21.15.44:0/4102162988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51cc0cda30 0x7f51cc0b5cb0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f51b400c400 tx=0x7f51b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.938+0000 7f51c2ffd640 1 -- 172.21.15.44:0/4102162988 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40074e0 con 0x7f51cc0cda30 2023-11-04T01:38:06.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.938+0000 7f51c2ffd640 1 -- 172.21.15.44:0/4102162988 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b4007640 con 0x7f51cc0cda30 2023-11-04T01:38:06.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.938+0000 7f51d0af2640 1 -- 172.21.15.44:0/4102162988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c4009a70 con 0x7f51cc0cda30 2023-11-04T01:38:06.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.938+0000 7f51c2ffd640 1 -- 172.21.15.44:0/4102162988 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4004a00 con 0x7f51cc0cda30 2023-11-04T01:38:06.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.938+0000 7f51d0af2640 1 -- 172.21.15.44:0/4102162988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51cc0ca0d0 con 0x7f51cc0cda30 2023-11-04T01:38:06.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.939+0000 7f51d0af2640 1 -- 172.21.15.44:0/4102162988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51cc0ce2d0 con 0x7f51cc0cda30 2023-11-04T01:38:06.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.940+0000 7f51c2ffd640 1 -- 172.21.15.44:0/4102162988 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51b4004b60 con 0x7f51cc0cda30 2023-11-04T01:38:06.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.940+0000 7f51c2ffd640 1 --2- 172.21.15.44:0/4102162988 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f51ac06ae70 0x7f51ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.940+0000 7f51c2ffd640 1 -- 172.21.15.44:0/4102162988 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f51b4088fd0 con 0x7f51cc0cda30 2023-11-04T01:38:06.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.940+0000 7f51ca59c640 1 --2- 172.21.15.44:0/4102162988 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f51ac06ae70 0x7f51ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.941+0000 7f51ca59c640 1 --2- 172.21.15.44:0/4102162988 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f51ac06ae70 0x7f51ac06d330 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f51bc006ca0 tx=0x7f51bc009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:06.944+0000 7f51c2ffd640 1 -- 172.21.15.44:0/4102162988 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51b4053ea0 con 0x7f51cc0cda30 2023-11-04T01:38:07.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.155+0000 7f51d0af2640 1 -- 172.21.15.44:0/4102162988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51cc0cc450 con 0x7f51cc0cda30 2023-11-04T01:38:07.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.156+0000 7f51c2ffd640 1 -- 172.21.15.44:0/4102162988 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f51cc0cc450 con 0x7f51cc0cda30 2023-11-04T01:38:07.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:07.158 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/683817288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":683817288},{"type":"v1","addr":"172.21.15.44:6835","nonce":683817288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5306,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/4160536413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":4160536413},{"type":"v1","addr":"172.21.15.204:6836","nonce":4160536413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/1970301848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1970301848},{"type":"v1","addr":"172.21.15.204:6837","nonce":1970301848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:54.668449+0000","modified":"2023-11-04T01:37:57.680007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6834/982248126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":982248126},{"type":"v1","addr":"172.21.15.44:6834","nonce":982248126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:38:07.159 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 24 2023-11-04T01:38:07.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.158+0000 7f51d0af2640 1 -- 172.21.15.44:0/4102162988 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f51ac06ae70 msgr2=0x7f51ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.158+0000 7f51d0af2640 1 --2- 172.21.15.44:0/4102162988 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f51ac06ae70 0x7f51ac06d330 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f51bc006ca0 tx=0x7f51bc009240 comp rx=0 tx=0).stop 2023-11-04T01:38:07.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.158+0000 7f51d0af2640 1 -- 172.21.15.44:0/4102162988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51cc0cda30 msgr2=0x7f51cc0b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.158+0000 7f51d0af2640 1 --2- 172.21.15.44:0/4102162988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51cc0cda30 0x7f51cc0b5cb0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f51b400c400 tx=0x7f51b400c8c0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.158+0000 7f51d0af2640 1 -- 172.21.15.44:0/4102162988 shutdown_connections 2023-11-04T01:38:07.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.158+0000 7f51d0af2640 1 --2- 172.21.15.44:0/4102162988 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f51ac06ae70 0x7f51ac06d330 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.158+0000 7f51d0af2640 1 --2- 172.21.15.44:0/4102162988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f51cc15ae40 0x7f51cc0b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.158+0000 7f51d0af2640 1 --2- 172.21.15.44:0/4102162988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51cc0cda30 0x7f51cc0b5cb0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.158+0000 7f51d0af2640 1 --2- 172.21.15.44:0/4102162988 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f51cc0cbc00 0x7f51cc146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.158+0000 7f51d0af2640 1 -- 172.21.15.44:0/4102162988 >> 172.21.15.44:0/4102162988 conn(0x7f51cc06ea90 msgr2=0x7f51cc15bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.158+0000 7f51d0af2640 1 -- 172.21.15.44:0/4102162988 shutdown_connections 2023-11-04T01:38:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.158+0000 7f51d0af2640 1 -- 172.21.15.44:0/4102162988 wait complete. 2023-11-04T01:38:07.171 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:07.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.277+0000 7fd918444640 1 Processor -- start 2023-11-04T01:38:07.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.277+0000 7fd918444640 1 -- start start 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd918444640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd91015ce60 0x7fd91006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd918444640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd91006bd30 0x7fd910160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd918444640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd910161050 0x7fd9100cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd918444640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9100cbde0 con 0x7fd91006bd30 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd918444640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9101615d0 con 0x7fd91015ce60 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd918444640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9101618b0 con 0x7fd910161050 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd9159df640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd91006bd30 0x7fd910160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd9159df640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd91006bd30 0x7fd910160b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50382/0 (socket says 172.21.15.44:50382) 2023-11-04T01:38:07.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd9159df640 1 -- 172.21.15.44:0/2568866559 learned_addr learned my addr 172.21.15.44:0/2568866559 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:07.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd9161e0640 1 --2- 172.21.15.44:0/2568866559 >> v2:172.21.15.204:3300/0 conn(0x7fd91015ce60 0x7fd91006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd9169e1640 1 --2- 172.21.15.44:0/2568866559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd910161050 0x7fd9100cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd9159df640 1 -- 172.21.15.44:0/2568866559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd910161050 msgr2=0x7fd9100cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:07.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd9159df640 1 --2- 172.21.15.44:0/2568866559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd910161050 0x7fd9100cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd9159df640 1 -- 172.21.15.44:0/2568866559 >> v2:172.21.15.204:3300/0 conn(0x7fd91015ce60 msgr2=0x7fd91006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:07.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd9159df640 1 --2- 172.21.15.44:0/2568866559 >> v2:172.21.15.204:3300/0 conn(0x7fd91015ce60 0x7fd91006b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.278+0000 7fd9159df640 1 -- 172.21.15.44:0/2568866559 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9100cba00 con 0x7fd91006bd30 2023-11-04T01:38:07.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.279+0000 7fd9159df640 1 --2- 172.21.15.44:0/2568866559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91006bd30 0x7fd910160b10 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd91006e960 tx=0x7fd90002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f95b2711bb129b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.279+0000 7fd9151de640 1 -- 172.21.15.44:0/2568866559 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900031870 con 0x7fd91006bd30 2023-11-04T01:38:07.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.279+0000 7fd9151de640 1 -- 172.21.15.44:0/2568866559 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9000319d0 con 0x7fd91006bd30 2023-11-04T01:38:07.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.279+0000 7fd9151de640 1 -- 172.21.15.44:0/2568866559 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900031d60 con 0x7fd91006bd30 2023-11-04T01:38:07.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.280+0000 7fd918444640 1 -- 172.21.15.44:0/2568866559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91006bd30 msgr2=0x7fd910160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.280+0000 7fd918444640 1 --2- 172.21.15.44:0/2568866559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91006bd30 0x7fd910160b10 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd91006e960 tx=0x7fd90002b910 comp rx=0 tx=0).stop 2023-11-04T01:38:07.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.280+0000 7fd918444640 1 -- 172.21.15.44:0/2568866559 shutdown_connections 2023-11-04T01:38:07.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.280+0000 7fd918444640 1 --2- 172.21.15.44:0/2568866559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd910161050 0x7fd9100cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.280+0000 7fd918444640 1 --2- 172.21.15.44:0/2568866559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91006bd30 0x7fd910160b10 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.280+0000 7fd918444640 1 --2- 172.21.15.44:0/2568866559 >> v2:172.21.15.204:3300/0 conn(0x7fd91015ce60 0x7fd91006b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.280+0000 7fd918444640 1 -- 172.21.15.44:0/2568866559 >> 172.21.15.44:0/2568866559 conn(0x7fd91006ea90 msgr2=0x7fd91006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:07.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.280+0000 7fd918444640 1 -- 172.21.15.44:0/2568866559 shutdown_connections 2023-11-04T01:38:07.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.280+0000 7fd918444640 1 -- 172.21.15.44:0/2568866559 wait complete. 2023-11-04T01:38:07.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.281+0000 7fd918444640 1 Processor -- start 2023-11-04T01:38:07.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.281+0000 7fd918444640 1 -- start start 2023-11-04T01:38:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.282+0000 7fd918444640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91015ce60 0x7fd9101f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.282+0000 7fd918444640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd910161050 0x7fd910158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.282+0000 7fd918444640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9100b62e0 0x7fd9100c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.282+0000 7fd918444640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100c7ff0 con 0x7fd91015ce60 2023-11-04T01:38:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.282+0000 7fd918444640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9101f3990 con 0x7fd910161050 2023-11-04T01:38:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.282+0000 7fd918444640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100b67e0 con 0x7fd9100b62e0 2023-11-04T01:38:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.282+0000 7fd9161e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91015ce60 0x7fd9101f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.282+0000 7fd9161e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91015ce60 0x7fd9101f3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50384/0 (socket says 172.21.15.44:50384) 2023-11-04T01:38:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.282+0000 7fd9161e0640 1 -- 172.21.15.44:0/1026563089 learned_addr learned my addr 172.21.15.44:0/1026563089 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.282+0000 7fd9161e0640 1 -- 172.21.15.44:0/1026563089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9100b62e0 msgr2=0x7fd9100c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.282+0000 7fd9161e0640 1 --2- 172.21.15.44:0/1026563089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9100b62e0 0x7fd9100c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.282+0000 7fd9161e0640 1 -- 172.21.15.44:0/1026563089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd910161050 msgr2=0x7fd910158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.282+0000 7fd9161e0640 1 --2- 172.21.15.44:0/1026563089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd910161050 0x7fd910158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.282+0000 7fd9161e0640 1 -- 172.21.15.44:0/1026563089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9000094d0 con 0x7fd91015ce60 2023-11-04T01:38:07.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.282+0000 7fd9161e0640 1 --2- 172.21.15.44:0/1026563089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91015ce60 0x7fd9101f3450 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00d800 tx=0x7fd90c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.283+0000 7fd906ffd640 1 -- 172.21.15.44:0/1026563089 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0096a0 con 0x7fd91015ce60 2023-11-04T01:38:07.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.283+0000 7fd906ffd640 1 -- 172.21.15.44:0/1026563089 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c009800 con 0x7fd91015ce60 2023-11-04T01:38:07.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.283+0000 7fd918444640 1 -- 172.21.15.44:0/1026563089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91015f880 con 0x7fd91015ce60 2023-11-04T01:38:07.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.283+0000 7fd906ffd640 1 -- 172.21.15.44:0/1026563089 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c009b90 con 0x7fd91015ce60 2023-11-04T01:38:07.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.283+0000 7fd918444640 1 -- 172.21.15.44:0/1026563089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91015fe40 con 0x7fd91015ce60 2023-11-04T01:38:07.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.284+0000 7fd918444640 1 -- 172.21.15.44:0/1026563089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd910074290 con 0x7fd91015ce60 2023-11-04T01:38:07.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.284+0000 7fd906ffd640 1 -- 172.21.15.44:0/1026563089 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd90c009cf0 con 0x7fd91015ce60 2023-11-04T01:38:07.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.285+0000 7fd906ffd640 1 --2- 172.21.15.44:0/1026563089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd8f406ae70 0x7fd8f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.285+0000 7fd906ffd640 1 -- 172.21.15.44:0/1026563089 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd90c089d30 con 0x7fd91015ce60 2023-11-04T01:38:07.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.285+0000 7fd9159df640 1 --2- 172.21.15.44:0/1026563089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd8f406ae70 0x7fd8f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.285+0000 7fd9159df640 1 --2- 172.21.15.44:0/1026563089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd8f406ae70 0x7fd8f406d330 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd900036000 tx=0x7fd900030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.289+0000 7fd906ffd640 1 -- 172.21.15.44:0/1026563089 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd90c054b40 con 0x7fd91015ce60 2023-11-04T01:38:07.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.466+0000 7fd918444640 1 -- 172.21.15.44:0/1026563089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd91006b3e0 con 0x7fd91015ce60 2023-11-04T01:38:07.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.467+0000 7fd906ffd640 1 -- 172.21.15.44:0/1026563089 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+18523 (secure 0 0 0) 0x7fd90c00b440 con 0x7fd91015ce60 2023-11-04T01:38:07.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:07.469 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":56,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:56.297312+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:53.256647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:53.639654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:07.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.469+0000 7fd918444640 1 -- 172.21.15.44:0/1026563089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd8f406ae70 msgr2=0x7fd8f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.469+0000 7fd918444640 1 --2- 172.21.15.44:0/1026563089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd8f406ae70 0x7fd8f406d330 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd900036000 tx=0x7fd900030000 comp rx=0 tx=0).stop 2023-11-04T01:38:07.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.469+0000 7fd918444640 1 -- 172.21.15.44:0/1026563089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91015ce60 msgr2=0x7fd9101f3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.469+0000 7fd918444640 1 --2- 172.21.15.44:0/1026563089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91015ce60 0x7fd9101f3450 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00d800 tx=0x7fd90c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.469+0000 7fd918444640 1 -- 172.21.15.44:0/1026563089 shutdown_connections 2023-11-04T01:38:07.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.469+0000 7fd918444640 1 --2- 172.21.15.44:0/1026563089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd8f406ae70 0x7fd8f406d330 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.469+0000 7fd918444640 1 --2- 172.21.15.44:0/1026563089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9100b62e0 0x7fd9100c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.469+0000 7fd918444640 1 --2- 172.21.15.44:0/1026563089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd910161050 0x7fd910158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.469+0000 7fd918444640 1 --2- 172.21.15.44:0/1026563089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91015ce60 0x7fd9101f3450 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.469+0000 7fd918444640 1 -- 172.21.15.44:0/1026563089 >> 172.21.15.44:0/1026563089 conn(0x7fd91006ea90 msgr2=0x7fd9100c6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:07.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.469+0000 7fd918444640 1 -- 172.21.15.44:0/1026563089 shutdown_connections 2023-11-04T01:38:07.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.469+0000 7fd918444640 1 -- 172.21.15.44:0/1026563089 wait complete. 2023-11-04T01:38:07.482 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:37:53.256647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:37:53.639654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:07.483 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:07.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.590+0000 7f2217807640 1 Processor -- start 2023-11-04T01:38:07.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.590+0000 7f2217807640 1 -- start start 2023-11-04T01:38:07.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.591+0000 7f2217807640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f221006a830 0x7f22100ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.591+0000 7f2217807640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2210160990 con 0x7f22100b1a40 2023-11-04T01:38:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.591+0000 7f2217807640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22100cc7c0 con 0x7f22101605b0 2023-11-04T01:38:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.591+0000 7f2217807640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22100cd750 con 0x7f221006a830 2023-11-04T01:38:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.591+0000 7f2215da4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f221006a830 0x7f22100ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.591+0000 7f2214da2640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f22100b1a40 0x7f22100cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57178/0 (socket says 172.21.15.44:57178) 2023-11-04T01:38:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.591+0000 7f2214da2640 1 -- 172.21.15.44:0/3668225159 learned_addr learned my addr 172.21.15.44:0/3668225159 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.591+0000 7f2215da4640 1 -- 172.21.15.44:0/3668225159 >> v1:172.21.15.204:6789/0 conn(0x7f22101605b0 legacy=0x7f221006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.591+0000 7f2215da4640 1 -- 172.21.15.44:0/3668225159 >> v1:172.21.15.44:6789/0 conn(0x7f22100b1a40 legacy=0x7f22100cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.591+0000 7f220ffff640 1 -- 172.21.15.44:0/3668225159 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767981058 0 0) 0x7f2210160990 con 0x7f22100b1a40 2023-11-04T01:38:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.591+0000 7f2215da4640 1 -- 172.21.15.44:0/3668225159 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22100cc4e0 con 0x7f221006a830 2023-11-04T01:38:07.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.592+0000 7f2215da4640 1 --2- 172.21.15.44:0/3668225159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f221006a830 0x7f22100ccbc0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f22080097a0 tx=0x7f220802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae74a0041ba134e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.592+0000 7f220ffff640 1 -- 172.21.15.44:0/3668225159 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220802f050 con 0x7f221006a830 2023-11-04T01:38:07.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.592+0000 7f220ffff640 1 -- 172.21.15.44:0/3668225159 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2208031700 con 0x7f221006a830 2023-11-04T01:38:07.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.592+0000 7f220ffff640 1 -- 172.21.15.44:0/3668225159 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208031a90 con 0x7f221006a830 2023-11-04T01:38:07.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.593+0000 7f2217807640 1 -- 172.21.15.44:0/3668225159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f221006a830 msgr2=0x7f22100ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.593+0000 7f2217807640 1 --2- 172.21.15.44:0/3668225159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f221006a830 0x7f22100ccbc0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f22080097a0 tx=0x7f220802b7a0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.593+0000 7f2217807640 1 -- 172.21.15.44:0/3668225159 shutdown_connections 2023-11-04T01:38:07.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.593+0000 7f2217807640 1 --2- 172.21.15.44:0/3668225159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f221006a830 0x7f22100ccbc0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.593+0000 7f2217807640 1 -- 172.21.15.44:0/3668225159 >> 172.21.15.44:0/3668225159 conn(0x7f2210071820 msgr2=0x7f2210071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:07.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.593+0000 7f2217807640 1 -- 172.21.15.44:0/3668225159 shutdown_connections 2023-11-04T01:38:07.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.593+0000 7f2217807640 1 -- 172.21.15.44:0/3668225159 wait complete. 2023-11-04T01:38:07.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.594+0000 7f2217807640 1 Processor -- start 2023-11-04T01:38:07.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.594+0000 7f2217807640 1 -- start start 2023-11-04T01:38:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2217807640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f221006a830 0x7f22101f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2217807640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22101605b0 0x7f221015b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2217807640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22100b47b0 0x7f22100b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2217807640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221015bbc0 con 0x7f22100b47b0 2023-11-04T01:38:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2217807640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22100b5250 con 0x7f22101605b0 2023-11-04T01:38:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2217807640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22100b5530 con 0x7f221006a830 2023-11-04T01:38:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2215da4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22100b47b0 0x7f22100b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2215da4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22100b47b0 0x7f22100b4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50402/0 (socket says 172.21.15.44:50402) 2023-11-04T01:38:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2215da4640 1 -- 172.21.15.44:0/3899920844 learned_addr learned my addr 172.21.15.44:0/3899920844 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f22155a3640 1 --2- 172.21.15.44:0/3899920844 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f221006a830 0x7f22101f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2214da2640 1 --2- 172.21.15.44:0/3899920844 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22101605b0 0x7f221015b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2215da4640 1 -- 172.21.15.44:0/3899920844 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f221006a830 msgr2=0x7f22101f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2215da4640 1 --2- 172.21.15.44:0/3899920844 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f221006a830 0x7f22101f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2215da4640 1 -- 172.21.15.44:0/3899920844 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22101605b0 msgr2=0x7f221015b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2215da4640 1 --2- 172.21.15.44:0/3899920844 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22101605b0 0x7f221015b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2215da4640 1 -- 172.21.15.44:0/3899920844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2208009400 con 0x7f22100b47b0 2023-11-04T01:38:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2214da2640 1 --2- 172.21.15.44:0/3899920844 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22101605b0 0x7f221015b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.595+0000 7f2215da4640 1 --2- 172.21.15.44:0/3899920844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22100b47b0 0x7f22100b4c60 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f22080097a0 tx=0x7f22080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.596+0000 7f220dffb640 1 -- 172.21.15.44:0/3899920844 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208033bb0 con 0x7f22100b47b0 2023-11-04T01:38:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.596+0000 7f220dffb640 1 -- 172.21.15.44:0/3899920844 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2208033d10 con 0x7f22100b47b0 2023-11-04T01:38:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.596+0000 7f2217807640 1 -- 172.21.15.44:0/3899920844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22101f2b90 con 0x7f22100b47b0 2023-11-04T01:38:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.596+0000 7f220dffb640 1 -- 172.21.15.44:0/3899920844 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220803d690 con 0x7f22100b47b0 2023-11-04T01:38:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.596+0000 7f2217807640 1 -- 172.21.15.44:0/3899920844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22101f2810 con 0x7f22100b47b0 2023-11-04T01:38:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.597+0000 7f2217807640 1 -- 172.21.15.44:0/3899920844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22100672a0 con 0x7f22100b47b0 2023-11-04T01:38:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.597+0000 7f220dffb640 1 -- 172.21.15.44:0/3899920844 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f220803a040 con 0x7f22100b47b0 2023-11-04T01:38:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.598+0000 7f220dffb640 1 --2- 172.21.15.44:0/3899920844 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21fc06ae70 0x7f21fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.598+0000 7f220dffb640 1 -- 172.21.15.44:0/3899920844 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f22080ab540 con 0x7f22100b47b0 2023-11-04T01:38:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.598+0000 7f22155a3640 1 --2- 172.21.15.44:0/3899920844 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21fc06ae70 0x7f21fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.599+0000 7f22155a3640 1 --2- 172.21.15.44:0/3899920844 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21fc06ae70 0x7f21fc06d330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f22100cb470 tx=0x7f2200003d90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.602+0000 7f220dffb640 1 -- 172.21.15.44:0/3899920844 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2208076500 con 0x7f22100b47b0 2023-11-04T01:38:07.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.779+0000 7f2217807640 1 -- 172.21.15.44:0/3899920844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f221015da10 con 0x7f22100b47b0 2023-11-04T01:38:07.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.780+0000 7f220dffb640 1 -- 172.21.15.44:0/3899920844 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2208079b20 con 0x7f22100b47b0 2023-11-04T01:38:07.782 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:38:07.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.782+0000 7f2217807640 1 -- 172.21.15.44:0/3899920844 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21fc06ae70 msgr2=0x7f21fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.782+0000 7f2217807640 1 --2- 172.21.15.44:0/3899920844 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21fc06ae70 0x7f21fc06d330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f22100cb470 tx=0x7f2200003d90 comp rx=0 tx=0).stop 2023-11-04T01:38:07.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.782+0000 7f2217807640 1 -- 172.21.15.44:0/3899920844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22100b47b0 msgr2=0x7f22100b4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.782+0000 7f2217807640 1 --2- 172.21.15.44:0/3899920844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22100b47b0 0x7f22100b4c60 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f22080097a0 tx=0x7f22080046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.782+0000 7f2217807640 1 -- 172.21.15.44:0/3899920844 shutdown_connections 2023-11-04T01:38:07.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.782+0000 7f2217807640 1 --2- 172.21.15.44:0/3899920844 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21fc06ae70 0x7f21fc06d330 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.782+0000 7f2217807640 1 --2- 172.21.15.44:0/3899920844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22100b47b0 0x7f22100b4c60 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.782+0000 7f2217807640 1 --2- 172.21.15.44:0/3899920844 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22101605b0 0x7f221015b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.782+0000 7f2217807640 1 --2- 172.21.15.44:0/3899920844 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f221006a830 0x7f22101f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.782+0000 7f2217807640 1 -- 172.21.15.44:0/3899920844 >> 172.21.15.44:0/3899920844 conn(0x7f2210071820 msgr2=0x7f22100b07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:07.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.782+0000 7f2217807640 1 -- 172.21.15.44:0/3899920844 shutdown_connections 2023-11-04T01:38:07.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.782+0000 7f2217807640 1 -- 172.21.15.44:0/3899920844 wait complete. 2023-11-04T01:38:07.795 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:07.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.903+0000 7fa865516640 1 Processor -- start 2023-11-04T01:38:07.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.903+0000 7fa865516640 1 -- start start 2023-11-04T01:38:07.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa865516640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa860153e60 0x7fa86015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa865516640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8600cd6d0 0x7fa860161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa865516640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8600cde60 con 0x7fa8600b4880 2023-11-04T01:38:07.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa865516640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa860160f90 con 0x7fa860153e60 2023-11-04T01:38:07.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa865516640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86015e400 con 0x7fa8600cd6d0 2023-11-04T01:38:07.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa85f7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa8600b4880 0x7fa8600b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57194/0 (socket says 172.21.15.44:57194) 2023-11-04T01:38:07.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa85f7fe640 1 -- 172.21.15.44:0/3598185704 learned_addr learned my addr 172.21.15.44:0/3598185704 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:07.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa85e7fc640 1 --2- 172.21.15.44:0/3598185704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8600cd6d0 0x7fa860161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa85effd640 1 --2- 172.21.15.44:0/3598185704 >> v2:172.21.15.204:3300/0 conn(0x7fa860153e60 0x7fa86015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa85dffb640 1 -- 172.21.15.44:0/3598185704 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70406447 0 0) 0x7fa8600cde60 con 0x7fa8600b4880 2023-11-04T01:38:07.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa85dffb640 1 -- 172.21.15.44:0/3598185704 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa848003520 con 0x7fa8600b4880 2023-11-04T01:38:07.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa85dffb640 1 -- 172.21.15.44:0/3598185704 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1432216273 0 0) 0x7fa848003520 con 0x7fa8600b4880 2023-11-04T01:38:07.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa85dffb640 1 -- 172.21.15.44:0/3598185704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8600cd6d0 msgr2=0x7fa860161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:07.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa85dffb640 1 --2- 172.21.15.44:0/3598185704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8600cd6d0 0x7fa860161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa85dffb640 1 -- 172.21.15.44:0/3598185704 >> v2:172.21.15.204:3300/0 conn(0x7fa860153e60 msgr2=0x7fa86015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:07.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa85dffb640 1 --2- 172.21.15.44:0/3598185704 >> v2:172.21.15.204:3300/0 conn(0x7fa860153e60 0x7fa86015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa85dffb640 1 -- 172.21.15.44:0/3598185704 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa860161960 con 0x7fa8600b4880 2023-11-04T01:38:07.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.904+0000 7fa85dffb640 1 -- 172.21.15.44:0/3598185704 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fa8580019f0 con 0x7fa8600b4880 2023-11-04T01:38:07.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85dffb640 1 -- 172.21.15.44:0/3598185704 >> v1:172.21.15.44:6789/0 conn(0x7fa8600b4880 legacy=0x7fa8600b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85dffb640 1 --2- 172.21.15.44:0/3598185704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa848003970 0x7fa848003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85dffb640 1 --2- 172.21.15.44:0/3598185704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8480047c0 0x7fa848004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85dffb640 1 --2- 172.21.15.44:0/3598185704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa848005180 0x7fa84800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85dffb640 1 -- 172.21.15.44:0/3598185704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa860160f90 con 0x7fa8480047c0 2023-11-04T01:38:07.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85dffb640 1 -- 172.21.15.44:0/3598185704 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86015e400 con 0x7fa848003970 2023-11-04T01:38:07.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85dffb640 1 -- 172.21.15.44:0/3598185704 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84800bec0 con 0x7fa848005180 2023-11-04T01:38:07.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85e7fc640 1 --2- 172.21.15.44:0/3598185704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8600cd6d0 0x7fa860161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:07.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85effd640 1 --2- 172.21.15.44:0/3598185704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa848003970 0x7fa848003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85f7fe640 1 --2- 172.21.15.44:0/3598185704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa848005180 0x7fa84800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85e7fc640 1 --2- 172.21.15.44:0/3598185704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8480047c0 0x7fa848004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85effd640 1 -- 172.21.15.44:0/3598185704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa848005180 msgr2=0x7fa84800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:07.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85effd640 1 --2- 172.21.15.44:0/3598185704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa848005180 0x7fa84800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85effd640 1 -- 172.21.15.44:0/3598185704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8480047c0 msgr2=0x7fa848004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:07.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85effd640 1 --2- 172.21.15.44:0/3598185704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8480047c0 0x7fa848004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.905+0000 7fa85effd640 1 -- 172.21.15.44:0/3598185704 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa848003520 con 0x7fa848003970 2023-11-04T01:38:07.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.906+0000 7fa85effd640 1 --2- 172.21.15.44:0/3598185704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa848003970 0x7fa848003d90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa854009af0 tx=0x7fa8480057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad2b8ba3570dc695 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.906+0000 7fa85dffb640 1 -- 172.21.15.44:0/3598185704 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85402c710 con 0x7fa848003970 2023-11-04T01:38:07.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.906+0000 7fa85dffb640 1 -- 172.21.15.44:0/3598185704 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85402c870 con 0x7fa848003970 2023-11-04T01:38:07.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.906+0000 7fa85dffb640 1 -- 172.21.15.44:0/3598185704 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85402cc00 con 0x7fa848003970 2023-11-04T01:38:07.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.907+0000 7fa865516640 1 -- 172.21.15.44:0/3598185704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa848003970 msgr2=0x7fa848003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.907+0000 7fa865516640 1 --2- 172.21.15.44:0/3598185704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa848003970 0x7fa848003d90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa854009af0 tx=0x7fa8480057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.907+0000 7fa85f7fe640 1 -- 172.21.15.44:0/3598185704 reap_dead start 2023-11-04T01:38:07.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.907+0000 7fa865516640 1 -- 172.21.15.44:0/3598185704 shutdown_connections 2023-11-04T01:38:07.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.907+0000 7fa865516640 1 -- 172.21.15.44:0/3598185704 >> 172.21.15.44:0/3598185704 conn(0x7fa8600cf880 msgr2=0x7fa8600cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:07.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.907+0000 7fa865516640 1 -- 172.21.15.44:0/3598185704 shutdown_connections 2023-11-04T01:38:07.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.907+0000 7fa865516640 1 -- 172.21.15.44:0/3598185704 wait complete. 2023-11-04T01:38:07.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.908+0000 7fa865516640 1 Processor -- start 2023-11-04T01:38:07.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.908+0000 7fa865516640 1 -- start start 2023-11-04T01:38:07.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa865516640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa848003970 0x7fa860143070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa865516640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8600cbc90 0x7fa8600cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa865516640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8600ca8e0 0x7fa8600cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa865516640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600cc650 con 0x7fa8600ca8e0 2023-11-04T01:38:07.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa865516640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600cb880 con 0x7fa8600cbc90 2023-11-04T01:38:07.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa865516640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600cb2d0 con 0x7fa848003970 2023-11-04T01:38:07.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa85f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8600ca8e0 0x7fa8600cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa85f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8600ca8e0 0x7fa8600cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50422/0 (socket says 172.21.15.44:50422) 2023-11-04T01:38:07.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa85f7fe640 1 -- 172.21.15.44:0/1979263725 learned_addr learned my addr 172.21.15.44:0/1979263725 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:07.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa85effd640 1 --2- 172.21.15.44:0/1979263725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa848003970 0x7fa860143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa85e7fc640 1 --2- 172.21.15.44:0/1979263725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8600cbc90 0x7fa8600cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa85f7fe640 1 -- 172.21.15.44:0/1979263725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa848003970 msgr2=0x7fa860143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa85f7fe640 1 --2- 172.21.15.44:0/1979263725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa848003970 0x7fa860143070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa85f7fe640 1 -- 172.21.15.44:0/1979263725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8600cbc90 msgr2=0x7fa8600cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa85f7fe640 1 --2- 172.21.15.44:0/1979263725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8600cbc90 0x7fa8600cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.909+0000 7fa85f7fe640 1 -- 172.21.15.44:0/1979263725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600cb5a0 con 0x7fa8600ca8e0 2023-11-04T01:38:07.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.910+0000 7fa85f7fe640 1 --2- 172.21.15.44:0/1979263725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8600ca8e0 0x7fa8600cad90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa86006c8b0 tx=0x7fa858007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.910+0000 7fa8477fe640 1 -- 172.21.15.44:0/1979263725 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85800abe0 con 0x7fa8600ca8e0 2023-11-04T01:38:07.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.910+0000 7fa8477fe640 1 -- 172.21.15.44:0/1979263725 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85800ad80 con 0x7fa8600ca8e0 2023-11-04T01:38:07.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.910+0000 7fa865516640 1 -- 172.21.15.44:0/1979263725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8600c6a20 con 0x7fa8600ca8e0 2023-11-04T01:38:07.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.910+0000 7fa8477fe640 1 -- 172.21.15.44:0/1979263725 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858013630 con 0x7fa8600ca8e0 2023-11-04T01:38:07.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.910+0000 7fa865516640 1 -- 172.21.15.44:0/1979263725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8600c6fe0 con 0x7fa8600ca8e0 2023-11-04T01:38:07.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.911+0000 7fa865516640 1 -- 172.21.15.44:0/1979263725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8600c71d0 con 0x7fa8600ca8e0 2023-11-04T01:38:07.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.911+0000 7fa8477fe640 1 -- 172.21.15.44:0/1979263725 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa858013790 con 0x7fa8600ca8e0 2023-11-04T01:38:07.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.912+0000 7fa8477fe640 1 --2- 172.21.15.44:0/1979263725 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa84c06ae70 0x7fa84c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.912+0000 7fa8477fe640 1 -- 172.21.15.44:0/1979263725 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa85808a080 con 0x7fa8600ca8e0 2023-11-04T01:38:07.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.912+0000 7fa85effd640 1 --2- 172.21.15.44:0/1979263725 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa84c06ae70 0x7fa84c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.913+0000 7fa85effd640 1 --2- 172.21.15.44:0/1979263725 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa84c06ae70 0x7fa84c06d330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa854036000 tx=0x7fa854030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:07.916+0000 7fa8477fe640 1 -- 172.21.15.44:0/1979263725 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa858054fd0 con 0x7fa8600ca8e0 2023-11-04T01:38:08.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.091+0000 7fa865516640 1 -- 172.21.15.44:0/1979263725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fa860074290 con 0x7fa8600ca8e0 2023-11-04T01:38:08.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.091+0000 7fa8477fe640 1 -- 172.21.15.44:0/1979263725 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v56) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa8580585f0 con 0x7fa8600ca8e0 2023-11-04T01:38:08.094 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.093+0000 7fa865516640 1 -- 172.21.15.44:0/1979263725 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa84c06ae70 msgr2=0x7fa84c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.093+0000 7fa865516640 1 --2- 172.21.15.44:0/1979263725 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa84c06ae70 0x7fa84c06d330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa854036000 tx=0x7fa854030000 comp rx=0 tx=0).stop 2023-11-04T01:38:08.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.093+0000 7fa865516640 1 -- 172.21.15.44:0/1979263725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8600ca8e0 msgr2=0x7fa8600cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.093+0000 7fa865516640 1 --2- 172.21.15.44:0/1979263725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8600ca8e0 0x7fa8600cad90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa86006c8b0 tx=0x7fa858007bd0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.093+0000 7fa865516640 1 -- 172.21.15.44:0/1979263725 shutdown_connections 2023-11-04T01:38:08.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.093+0000 7fa865516640 1 --2- 172.21.15.44:0/1979263725 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa84c06ae70 0x7fa84c06d330 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.093+0000 7fa865516640 1 --2- 172.21.15.44:0/1979263725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8600ca8e0 0x7fa8600cad90 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.093+0000 7fa865516640 1 --2- 172.21.15.44:0/1979263725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8600cbc90 0x7fa8600cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.093+0000 7fa865516640 1 --2- 172.21.15.44:0/1979263725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa848003970 0x7fa860143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.093+0000 7fa865516640 1 -- 172.21.15.44:0/1979263725 >> 172.21.15.44:0/1979263725 conn(0x7fa8600cf880 msgr2=0x7fa86015f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:08.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.093+0000 7fa865516640 1 -- 172.21.15.44:0/1979263725 shutdown_connections 2023-11-04T01:38:08.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.093+0000 7fa865516640 1 -- 172.21.15.44:0/1979263725 wait complete. 2023-11-04T01:38:08.106 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:38:08.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.214+0000 7fad0bd78640 1 Processor -- start 2023-11-04T01:38:08.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.214+0000 7fad0bd78640 1 -- start start 2023-11-04T01:38:08.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.215+0000 7fad0bd78640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fad04153e60 0x7fad0415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.215+0000 7fad0bd78640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fad040b4880 0x7fad040b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.215+0000 7fad0bd78640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad040cde60 con 0x7fad040cd6d0 2023-11-04T01:38:08.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.215+0000 7fad0bd78640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad04160f90 con 0x7fad040b4880 2023-11-04T01:38:08.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.215+0000 7fad0bd78640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad040b5200 con 0x7fad04153e60 2023-11-04T01:38:08.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.215+0000 7fad0a315640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fad040b4880 0x7fad040b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.215+0000 7fad0a315640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fad040b4880 0x7fad040b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50432/0 (socket says 172.21.15.44:50432) 2023-11-04T01:38:08.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.215+0000 7fad0a315640 1 -- 172.21.15.44:0/439180302 learned_addr learned my addr 172.21.15.44:0/439180302 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:08.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.215+0000 7fad09b14640 1 --2- 172.21.15.44:0/439180302 >> v2:172.21.15.204:3300/0 conn(0x7fad04153e60 0x7fad0415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.215+0000 7fad0a315640 1 -- 172.21.15.44:0/439180302 >> v2:172.21.15.204:3300/0 conn(0x7fad04153e60 msgr2=0x7fad0415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:08.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.215+0000 7fad0a315640 1 --2- 172.21.15.44:0/439180302 >> v2:172.21.15.204:3300/0 conn(0x7fad04153e60 0x7fad0415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.215+0000 7fad0a315640 1 -- 172.21.15.44:0/439180302 >> v1:172.21.15.204:6789/0 conn(0x7fad040cd6d0 legacy=0x7fad04161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.215+0000 7fad0a315640 1 -- 172.21.15.44:0/439180302 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0415e400 con 0x7fad040b4880 2023-11-04T01:38:08.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.216+0000 7fad0a315640 1 --2- 172.21.15.44:0/439180302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad040b4880 0x7fad040b4cc0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fad0408abe0 tx=0x7facfc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53faee43aeae6c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.216+0000 7fad08b12640 1 -- 172.21.15.44:0/439180302 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc02cb20 con 0x7fad040b4880 2023-11-04T01:38:08.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.216+0000 7fad08b12640 1 -- 172.21.15.44:0/439180302 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc02cc80 con 0x7fad040b4880 2023-11-04T01:38:08.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.216+0000 7fad08b12640 1 -- 172.21.15.44:0/439180302 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc0343f0 con 0x7fad040b4880 2023-11-04T01:38:08.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.217+0000 7fad0bd78640 1 -- 172.21.15.44:0/439180302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad040b4880 msgr2=0x7fad040b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.217+0000 7fad0bd78640 1 --2- 172.21.15.44:0/439180302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad040b4880 0x7fad040b4cc0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fad0408abe0 tx=0x7facfc02bf80 comp rx=0 tx=0).stop 2023-11-04T01:38:08.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.217+0000 7fad0bd78640 1 -- 172.21.15.44:0/439180302 shutdown_connections 2023-11-04T01:38:08.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.217+0000 7fad0bd78640 1 --2- 172.21.15.44:0/439180302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad040b4880 0x7fad040b4cc0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.217+0000 7fad0bd78640 1 --2- 172.21.15.44:0/439180302 >> v2:172.21.15.204:3300/0 conn(0x7fad04153e60 0x7fad0415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.217+0000 7fad0bd78640 1 -- 172.21.15.44:0/439180302 >> 172.21.15.44:0/439180302 conn(0x7fad040cf880 msgr2=0x7fad040cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:08.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.217+0000 7fad0bd78640 1 -- 172.21.15.44:0/439180302 shutdown_connections 2023-11-04T01:38:08.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.217+0000 7fad0bd78640 1 -- 172.21.15.44:0/439180302 wait complete. 2023-11-04T01:38:08.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.218+0000 7fad0bd78640 1 Processor -- start 2023-11-04T01:38:08.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.218+0000 7fad0bd78640 1 -- start start 2023-11-04T01:38:08.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad0bd78640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad040b4880 0x7fad0414c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad0bd78640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad040cd6d0 0x7fad04156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad0bd78640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad04153e60 0x7fad04156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad0bd78640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0414c870 con 0x7fad040b4880 2023-11-04T01:38:08.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad0bd78640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0415f360 con 0x7fad04153e60 2023-11-04T01:38:08.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad0bd78640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0415e7e0 con 0x7fad040cd6d0 2023-11-04T01:38:08.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad09b14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad040b4880 0x7fad0414c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad09b14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad040b4880 0x7fad0414c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50442/0 (socket says 172.21.15.44:50442) 2023-11-04T01:38:08.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad09b14640 1 -- 172.21.15.44:0/1639906258 learned_addr learned my addr 172.21.15.44:0/1639906258 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:08.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad09313640 1 --2- 172.21.15.44:0/1639906258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad040cd6d0 0x7fad04156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad0a315640 1 --2- 172.21.15.44:0/1639906258 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad04153e60 0x7fad04156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad09b14640 1 -- 172.21.15.44:0/1639906258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad040cd6d0 msgr2=0x7fad04156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad09b14640 1 --2- 172.21.15.44:0/1639906258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad040cd6d0 0x7fad04156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad09b14640 1 -- 172.21.15.44:0/1639906258 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad04153e60 msgr2=0x7fad04156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad09b14640 1 --2- 172.21.15.44:0/1639906258 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad04153e60 0x7fad04156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad09b14640 1 -- 172.21.15.44:0/1639906258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc009b30 con 0x7fad040b4880 2023-11-04T01:38:08.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7fad09b14640 1 --2- 172.21.15.44:0/1639906258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad040b4880 0x7fad0414c330 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fad0000e870 tx=0x7fad0000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7facfa7fc640 1 -- 172.21.15.44:0/1639906258 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000094f0 con 0x7fad040b4880 2023-11-04T01:38:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.219+0000 7facfa7fc640 1 -- 172.21.15.44:0/1639906258 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0000c940 con 0x7fad040b4880 2023-11-04T01:38:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.220+0000 7fad0bd78640 1 -- 172.21.15.44:0/1639906258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0415eac0 con 0x7fad040b4880 2023-11-04T01:38:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.220+0000 7facfa7fc640 1 -- 172.21.15.44:0/1639906258 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0000ccf0 con 0x7fad040b4880 2023-11-04T01:38:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.220+0000 7fad0bd78640 1 -- 172.21.15.44:0/1639906258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0415f080 con 0x7fad040b4880 2023-11-04T01:38:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.221+0000 7fad0bd78640 1 -- 172.21.15.44:0/1639906258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad040d06e0 con 0x7fad040b4880 2023-11-04T01:38:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.221+0000 7facfa7fc640 1 -- 172.21.15.44:0/1639906258 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad00013470 con 0x7fad040b4880 2023-11-04T01:38:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.221+0000 7facfa7fc640 1 --2- 172.21.15.44:0/1639906258 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7face806ae70 0x7face806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.222+0000 7facfa7fc640 1 -- 172.21.15.44:0/1639906258 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fad00089910 con 0x7fad040b4880 2023-11-04T01:38:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.222+0000 7fad09313640 1 --2- 172.21.15.44:0/1639906258 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7face806ae70 0x7face806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.222+0000 7fad09313640 1 --2- 172.21.15.44:0/1639906258 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7face806ae70 0x7face806d330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fad040c6580 tx=0x7facf4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.226+0000 7facfa7fc640 1 -- 172.21.15.44:0/1639906258 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad000547e0 con 0x7fad040b4880 2023-11-04T01:38:08.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.401+0000 7fad0bd78640 1 -- 172.21.15.44:0/1639906258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad04074290 con 0x7fad040b4880 2023-11-04T01:38:08.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.402+0000 7facfa7fc640 1 -- 172.21.15.44:0/1639906258 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad00057e00 con 0x7fad040b4880 2023-11-04T01:38:08.404 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:08.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.404+0000 7fad0bd78640 1 -- 172.21.15.44:0/1639906258 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7face806ae70 msgr2=0x7face806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.404+0000 7fad0bd78640 1 --2- 172.21.15.44:0/1639906258 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7face806ae70 0x7face806d330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fad040c6580 tx=0x7facf4009040 comp rx=0 tx=0).stop 2023-11-04T01:38:08.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.404+0000 7fad0bd78640 1 -- 172.21.15.44:0/1639906258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad040b4880 msgr2=0x7fad0414c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.404+0000 7fad0bd78640 1 --2- 172.21.15.44:0/1639906258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad040b4880 0x7fad0414c330 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fad0000e870 tx=0x7fad0000ed30 comp rx=0 tx=0).stop 2023-11-04T01:38:08.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.404+0000 7fad0bd78640 1 -- 172.21.15.44:0/1639906258 shutdown_connections 2023-11-04T01:38:08.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.404+0000 7fad0bd78640 1 --2- 172.21.15.44:0/1639906258 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7face806ae70 0x7face806d330 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.404+0000 7fad0bd78640 1 --2- 172.21.15.44:0/1639906258 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad04153e60 0x7fad04156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.404+0000 7fad0bd78640 1 --2- 172.21.15.44:0/1639906258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad040cd6d0 0x7fad04156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.404+0000 7fad0bd78640 1 --2- 172.21.15.44:0/1639906258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad040b4880 0x7fad0414c330 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.404+0000 7fad0bd78640 1 -- 172.21.15.44:0/1639906258 >> 172.21.15.44:0/1639906258 conn(0x7fad040cf880 msgr2=0x7fad040d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:08.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.404+0000 7fad0bd78640 1 -- 172.21.15.44:0/1639906258 shutdown_connections 2023-11-04T01:38:08.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.404+0000 7fad0bd78640 1 -- 172.21.15.44:0/1639906258 wait complete. 2023-11-04T01:38:08.417 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:38:08.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.524+0000 7fbe55eaf640 1 Processor -- start 2023-11-04T01:38:08.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.524+0000 7fbe55eaf640 1 -- start start 2023-11-04T01:38:08.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.525+0000 7fbe55eaf640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbe500cd6d0 0x7fbe50161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.525+0000 7fbe55eaf640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe500cde60 con 0x7fbe500b4880 2023-11-04T01:38:08.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.525+0000 7fbe55eaf640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe50160f90 con 0x7fbe50153e60 2023-11-04T01:38:08.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.525+0000 7fbe55eaf640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe50161960 con 0x7fbe500cd6d0 2023-11-04T01:38:08.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.525+0000 7fbe4effd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbe500cd6d0 0x7fbe50161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.525+0000 7fbe4ffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbe500b4880 0x7fbe500d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57196/0 (socket says 172.21.15.44:57196) 2023-11-04T01:38:08.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.525+0000 7fbe4effd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbe500cd6d0 0x7fbe50161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50452/0 (socket says 172.21.15.44:50452) 2023-11-04T01:38:08.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.525+0000 7fbe4ffff640 1 -- 172.21.15.44:0/4189225469 learned_addr learned my addr 172.21.15.44:0/4189225469 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:08.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.525+0000 7fbe4effd640 1 -- 172.21.15.44:0/4189225469 >> v1:172.21.15.204:6789/0 conn(0x7fbe50153e60 legacy=0x7fbe5015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:08.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.525+0000 7fbe4effd640 1 -- 172.21.15.44:0/4189225469 >> v1:172.21.15.44:6789/0 conn(0x7fbe500b4880 legacy=0x7fbe500d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.525+0000 7fbe4effd640 1 -- 172.21.15.44:0/4189225469 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe500ce090 con 0x7fbe500cd6d0 2023-11-04T01:38:08.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.525+0000 7fbe4e7fc640 1 -- 172.21.15.44:0/4189225469 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036435725 0 0) 0x7fbe500cde60 con 0x7fbe500b4880 2023-11-04T01:38:08.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.526+0000 7fbe4effd640 1 --2- 172.21.15.44:0/4189225469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe500cd6d0 0x7fbe50161420 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbe440097a0 tx=0x7fbe4402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d80094d0bc7c601 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.526+0000 7fbe4e7fc640 1 -- 172.21.15.44:0/4189225469 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44031830 con 0x7fbe500cd6d0 2023-11-04T01:38:08.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.526+0000 7fbe4e7fc640 1 -- 172.21.15.44:0/4189225469 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe44031990 con 0x7fbe500cd6d0 2023-11-04T01:38:08.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.526+0000 7fbe4e7fc640 1 -- 172.21.15.44:0/4189225469 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44031d20 con 0x7fbe500cd6d0 2023-11-04T01:38:08.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.527+0000 7fbe55eaf640 1 -- 172.21.15.44:0/4189225469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe500cd6d0 msgr2=0x7fbe50161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.527+0000 7fbe55eaf640 1 --2- 172.21.15.44:0/4189225469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe500cd6d0 0x7fbe50161420 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbe440097a0 tx=0x7fbe4402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.527+0000 7fbe55eaf640 1 -- 172.21.15.44:0/4189225469 shutdown_connections 2023-11-04T01:38:08.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.527+0000 7fbe55eaf640 1 --2- 172.21.15.44:0/4189225469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe500cd6d0 0x7fbe50161420 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.527+0000 7fbe55eaf640 1 -- 172.21.15.44:0/4189225469 >> 172.21.15.44:0/4189225469 conn(0x7fbe500cf880 msgr2=0x7fbe500cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:08.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.527+0000 7fbe55eaf640 1 -- 172.21.15.44:0/4189225469 shutdown_connections 2023-11-04T01:38:08.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.527+0000 7fbe55eaf640 1 -- 172.21.15.44:0/4189225469 wait complete. 2023-11-04T01:38:08.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.528+0000 7fbe55eaf640 1 Processor -- start 2023-11-04T01:38:08.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.528+0000 7fbe55eaf640 1 -- start start 2023-11-04T01:38:08.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe55eaf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe500b4880 0x7fbe50159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe55eaf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe500cd6d0 0x7fbe50159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe55eaf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe50153e60 0x7fbe5015ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe55eaf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe501f2fc0 con 0x7fbe500b4880 2023-11-04T01:38:08.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe55eaf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5015aab0 con 0x7fbe500cd6d0 2023-11-04T01:38:08.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe55eaf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe501f2670 con 0x7fbe50153e60 2023-11-04T01:38:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe4f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe500b4880 0x7fbe50159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe4f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe500b4880 0x7fbe50159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50460/0 (socket says 172.21.15.44:50460) 2023-11-04T01:38:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe4f7fe640 1 -- 172.21.15.44:0/2639177720 learned_addr learned my addr 172.21.15.44:0/2639177720 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe4ffff640 1 --2- 172.21.15.44:0/2639177720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe50153e60 0x7fbe5015ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe4effd640 1 --2- 172.21.15.44:0/2639177720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe500cd6d0 0x7fbe50159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe4f7fe640 1 -- 172.21.15.44:0/2639177720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe50153e60 msgr2=0x7fbe5015ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe4f7fe640 1 --2- 172.21.15.44:0/2639177720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe50153e60 0x7fbe5015ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe4f7fe640 1 -- 172.21.15.44:0/2639177720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe500cd6d0 msgr2=0x7fbe50159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe4f7fe640 1 --2- 172.21.15.44:0/2639177720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe500cd6d0 0x7fbe50159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe4f7fe640 1 -- 172.21.15.44:0/2639177720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe44009400 con 0x7fbe500b4880 2023-11-04T01:38:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.529+0000 7fbe4f7fe640 1 --2- 172.21.15.44:0/2639177720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe500b4880 0x7fbe50159850 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000b420 tx=0x7fbe4000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.530+0000 7fbe37fff640 1 -- 172.21.15.44:0/2639177720 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40011830 con 0x7fbe500b4880 2023-11-04T01:38:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.530+0000 7fbe37fff640 1 -- 172.21.15.44:0/2639177720 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40011990 con 0x7fbe500b4880 2023-11-04T01:38:08.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.530+0000 7fbe55eaf640 1 -- 172.21.15.44:0/2639177720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5015a7d0 con 0x7fbe500b4880 2023-11-04T01:38:08.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.530+0000 7fbe37fff640 1 -- 172.21.15.44:0/2639177720 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40011d40 con 0x7fbe500b4880 2023-11-04T01:38:08.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.530+0000 7fbe55eaf640 1 -- 172.21.15.44:0/2639177720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe501f2be0 con 0x7fbe500b4880 2023-11-04T01:38:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.531+0000 7fbe55eaf640 1 -- 172.21.15.44:0/2639177720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe50074290 con 0x7fbe500b4880 2023-11-04T01:38:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.531+0000 7fbe37fff640 1 -- 172.21.15.44:0/2639177720 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe4001b460 con 0x7fbe500b4880 2023-11-04T01:38:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.532+0000 7fbe37fff640 1 --2- 172.21.15.44:0/2639177720 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbe3c06ae70 0x7fbe3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.532+0000 7fbe37fff640 1 -- 172.21.15.44:0/2639177720 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbe400894c0 con 0x7fbe500b4880 2023-11-04T01:38:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.532+0000 7fbe4effd640 1 --2- 172.21.15.44:0/2639177720 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbe3c06ae70 0x7fbe3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.532+0000 7fbe4effd640 1 --2- 172.21.15.44:0/2639177720 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbe3c06ae70 0x7fbe3c06d330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbe44036000 tx=0x7fbe4403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.536+0000 7fbe37fff640 1 -- 172.21.15.44:0/2639177720 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe40054230 con 0x7fbe500b4880 2023-11-04T01:38:08.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.714+0000 7fbe55eaf640 1 -- 172.21.15.44:0/2639177720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe500d0b80 con 0x7fbe500b4880 2023-11-04T01:38:08.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.714+0000 7fbe37fff640 1 -- 172.21.15.44:0/2639177720 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe40057850 con 0x7fbe500b4880 2023-11-04T01:38:08.717 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:38:08.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.716+0000 7fbe55eaf640 1 -- 172.21.15.44:0/2639177720 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbe3c06ae70 msgr2=0x7fbe3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.716+0000 7fbe55eaf640 1 --2- 172.21.15.44:0/2639177720 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbe3c06ae70 0x7fbe3c06d330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbe44036000 tx=0x7fbe4403c040 comp rx=0 tx=0).stop 2023-11-04T01:38:08.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.716+0000 7fbe55eaf640 1 -- 172.21.15.44:0/2639177720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe500b4880 msgr2=0x7fbe50159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.716+0000 7fbe55eaf640 1 --2- 172.21.15.44:0/2639177720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe500b4880 0x7fbe50159850 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000b420 tx=0x7fbe4000b8e0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.716+0000 7fbe55eaf640 1 -- 172.21.15.44:0/2639177720 shutdown_connections 2023-11-04T01:38:08.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.716+0000 7fbe55eaf640 1 --2- 172.21.15.44:0/2639177720 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbe3c06ae70 0x7fbe3c06d330 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.716+0000 7fbe55eaf640 1 --2- 172.21.15.44:0/2639177720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe50153e60 0x7fbe5015ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.716+0000 7fbe55eaf640 1 --2- 172.21.15.44:0/2639177720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe500cd6d0 0x7fbe50159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.716+0000 7fbe55eaf640 1 --2- 172.21.15.44:0/2639177720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe500b4880 0x7fbe50159850 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.716+0000 7fbe55eaf640 1 -- 172.21.15.44:0/2639177720 >> 172.21.15.44:0/2639177720 conn(0x7fbe500cf880 msgr2=0x7fbe5015fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:08.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.716+0000 7fbe55eaf640 1 -- 172.21.15.44:0/2639177720 shutdown_connections 2023-11-04T01:38:08.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.716+0000 7fbe55eaf640 1 -- 172.21.15.44:0/2639177720 wait complete. 2023-11-04T01:38:08.729 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:08.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.833+0000 7f099464b640 1 Processor -- start 2023-11-04T01:38:08.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.833+0000 7f099464b640 1 -- start start 2023-11-04T01:38:08.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.834+0000 7f099464b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f098c15ce60 0x7f098c06b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.834+0000 7f099464b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f098c06bd30 0x7f098c160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.834+0000 7f099464b640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c1615d0 con 0x7f098c161050 2023-11-04T01:38:08.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.834+0000 7f099464b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c0cbde0 con 0x7f098c15ce60 2023-11-04T01:38:08.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.834+0000 7f099464b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c1618b0 con 0x7f098c06bd30 2023-11-04T01:38:08.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.834+0000 7f0992be8640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f098c161050 0x7f098c0cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57208/0 (socket says 172.21.15.44:57208) 2023-11-04T01:38:08.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.834+0000 7f0992be8640 1 -- 172.21.15.44:0/372775328 learned_addr learned my addr 172.21.15.44:0/372775328 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:08.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.835+0000 7f09923e7640 1 --2- 172.21.15.44:0/372775328 >> v2:172.21.15.204:3300/0 conn(0x7f098c15ce60 0x7f098c06b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.835+0000 7f0991be6640 1 --2- 172.21.15.44:0/372775328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f098c06bd30 0x7f098c160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.835+0000 7f09913e5640 1 -- 172.21.15.44:0/372775328 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650617179 0 0) 0x7f098c1615d0 con 0x7f098c161050 2023-11-04T01:38:08.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.835+0000 7f09913e5640 1 -- 172.21.15.44:0/372775328 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0974003520 con 0x7f098c161050 2023-11-04T01:38:08.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.835+0000 7f09923e7640 1 -- 172.21.15.44:0/372775328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f098c06bd30 msgr2=0x7f098c160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:08.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.835+0000 7f09923e7640 1 --2- 172.21.15.44:0/372775328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f098c06bd30 0x7f098c160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.835+0000 7f09923e7640 1 -- 172.21.15.44:0/372775328 >> v1:172.21.15.44:6789/0 conn(0x7f098c161050 legacy=0x7f098c0cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.835+0000 7f09923e7640 1 -- 172.21.15.44:0/372775328 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c0cba00 con 0x7f098c15ce60 2023-11-04T01:38:08.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.835+0000 7f0991be6640 1 --2- 172.21.15.44:0/372775328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f098c06bd30 0x7f098c160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:08.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.836+0000 7f09923e7640 1 --2- 172.21.15.44:0/372775328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f098c15ce60 0x7f098c06b7f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f097c009d90 tx=0x7f097c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c295d4bceb2f4c12 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.836+0000 7f09913e5640 1 -- 172.21.15.44:0/372775328 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c02cc50 con 0x7f098c15ce60 2023-11-04T01:38:08.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.836+0000 7f09913e5640 1 -- 172.21.15.44:0/372775328 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c02cdb0 con 0x7f098c15ce60 2023-11-04T01:38:08.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.836+0000 7f09913e5640 1 -- 172.21.15.44:0/372775328 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c034660 con 0x7f098c15ce60 2023-11-04T01:38:08.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.837+0000 7f099464b640 1 -- 172.21.15.44:0/372775328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f098c15ce60 msgr2=0x7f098c06b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.837+0000 7f099464b640 1 --2- 172.21.15.44:0/372775328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f098c15ce60 0x7f098c06b7f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f097c009d90 tx=0x7f097c02bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.837+0000 7f099464b640 1 -- 172.21.15.44:0/372775328 shutdown_connections 2023-11-04T01:38:08.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.837+0000 7f099464b640 1 --2- 172.21.15.44:0/372775328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f098c06bd30 0x7f098c160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.837+0000 7f099464b640 1 --2- 172.21.15.44:0/372775328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f098c15ce60 0x7f098c06b7f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.837+0000 7f099464b640 1 -- 172.21.15.44:0/372775328 >> 172.21.15.44:0/372775328 conn(0x7f098c06ea90 msgr2=0x7f098c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:08.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.837+0000 7f099464b640 1 -- 172.21.15.44:0/372775328 shutdown_connections 2023-11-04T01:38:08.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.837+0000 7f099464b640 1 -- 172.21.15.44:0/372775328 wait complete. 2023-11-04T01:38:08.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.838+0000 7f099464b640 1 Processor -- start 2023-11-04T01:38:08.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.838+0000 7f099464b640 1 -- start start 2023-11-04T01:38:08.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f099464b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f098c15ce60 0x7f098c14f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f099464b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f098c161050 0x7f098c0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f099464b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f098c0cc740 0x7f098c0b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f099464b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0ccbf0 con 0x7f098c15ce60 2023-11-04T01:38:08.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f099464b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c15f220 con 0x7f098c161050 2023-11-04T01:38:08.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f099464b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c1604b0 con 0x7f098c0cc740 2023-11-04T01:38:08.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f09923e7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f098c15ce60 0x7f098c14f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f09923e7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f098c15ce60 0x7f098c14f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50464/0 (socket says 172.21.15.44:50464) 2023-11-04T01:38:08.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f09923e7640 1 -- 172.21.15.44:0/2665724454 learned_addr learned my addr 172.21.15.44:0/2665724454 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:08.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f0992be8640 1 --2- 172.21.15.44:0/2665724454 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f098c0cc740 0x7f098c0b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f0991be6640 1 --2- 172.21.15.44:0/2665724454 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f098c161050 0x7f098c0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f09923e7640 1 -- 172.21.15.44:0/2665724454 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f098c0cc740 msgr2=0x7f098c0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f09923e7640 1 --2- 172.21.15.44:0/2665724454 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f098c0cc740 0x7f098c0b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f09923e7640 1 -- 172.21.15.44:0/2665724454 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f098c161050 msgr2=0x7f098c0cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f09923e7640 1 --2- 172.21.15.44:0/2665724454 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f098c161050 0x7f098c0cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f09923e7640 1 -- 172.21.15.44:0/2665724454 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0980009400 con 0x7f098c15ce60 2023-11-04T01:38:08.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f09923e7640 1 --2- 172.21.15.44:0/2665724454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f098c15ce60 0x7f098c14f020 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f097c009d90 tx=0x7f097c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f098affd640 1 -- 172.21.15.44:0/2665724454 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c040650 con 0x7f098c15ce60 2023-11-04T01:38:08.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f098affd640 1 -- 172.21.15.44:0/2665724454 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c0407b0 con 0x7f098c15ce60 2023-11-04T01:38:08.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f098affd640 1 -- 172.21.15.44:0/2665724454 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c040b60 con 0x7f098c15ce60 2023-11-04T01:38:08.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.839+0000 7f099464b640 1 -- 172.21.15.44:0/2665724454 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097c009a70 con 0x7f098c15ce60 2023-11-04T01:38:08.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.840+0000 7f099464b640 1 -- 172.21.15.44:0/2665724454 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c15f410 con 0x7f098c15ce60 2023-11-04T01:38:08.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.840+0000 7f099464b640 1 -- 172.21.15.44:0/2665724454 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098c074290 con 0x7f098c15ce60 2023-11-04T01:38:08.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.841+0000 7f098affd640 1 -- 172.21.15.44:0/2665724454 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f097c040cc0 con 0x7f098c15ce60 2023-11-04T01:38:08.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.841+0000 7f098affd640 1 --2- 172.21.15.44:0/2665724454 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f097806aea0 0x7f097806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.842+0000 7f098affd640 1 -- 172.21.15.44:0/2665724454 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f097c0ac4b0 con 0x7f098c15ce60 2023-11-04T01:38:08.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.842+0000 7f0991be6640 1 --2- 172.21.15.44:0/2665724454 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f097806aea0 0x7f097806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.842+0000 7f0991be6640 1 --2- 172.21.15.44:0/2665724454 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f097806aea0 0x7f097806d360 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f098c0b0ab0 tx=0x7f0980008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:08.846+0000 7f098affd640 1 -- 172.21.15.44:0/2665724454 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f097c077250 con 0x7f098c15ce60 2023-11-04T01:38:09.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.056+0000 7f099464b640 1 -- 172.21.15.44:0/2665724454 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f098c06b3e0 con 0x7f098c15ce60 2023-11-04T01:38:09.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.057+0000 7f098affd640 1 -- 172.21.15.44:0/2665724454 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f097c009450 con 0x7f098c15ce60 2023-11-04T01:38:09.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:09.059 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/683817288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":683817288},{"type":"v1","addr":"172.21.15.44:6835","nonce":683817288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5306,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/4160536413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":4160536413},{"type":"v1","addr":"172.21.15.204:6836","nonce":4160536413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/1970301848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1970301848},{"type":"v1","addr":"172.21.15.204:6837","nonce":1970301848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:54.668449+0000","modified":"2023-11-04T01:37:57.680007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6834/982248126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":982248126},{"type":"v1","addr":"172.21.15.44:6834","nonce":982248126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:38:09.059 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 24 2023-11-04T01:38:09.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.059+0000 7f099464b640 1 -- 172.21.15.44:0/2665724454 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f097806aea0 msgr2=0x7f097806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.059+0000 7f099464b640 1 --2- 172.21.15.44:0/2665724454 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f097806aea0 0x7f097806d360 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f098c0b0ab0 tx=0x7f0980008040 comp rx=0 tx=0).stop 2023-11-04T01:38:09.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.059+0000 7f099464b640 1 -- 172.21.15.44:0/2665724454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f098c15ce60 msgr2=0x7f098c14f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.059+0000 7f099464b640 1 --2- 172.21.15.44:0/2665724454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f098c15ce60 0x7f098c14f020 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f097c009d90 tx=0x7f097c004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:09.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.059+0000 7f099464b640 1 -- 172.21.15.44:0/2665724454 shutdown_connections 2023-11-04T01:38:09.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.059+0000 7f099464b640 1 --2- 172.21.15.44:0/2665724454 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f097806aea0 0x7f097806d360 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.059+0000 7f099464b640 1 --2- 172.21.15.44:0/2665724454 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f098c0cc740 0x7f098c0b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.059+0000 7f099464b640 1 --2- 172.21.15.44:0/2665724454 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f098c161050 0x7f098c0cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.059+0000 7f099464b640 1 --2- 172.21.15.44:0/2665724454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f098c15ce60 0x7f098c14f020 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.059+0000 7f099464b640 1 -- 172.21.15.44:0/2665724454 >> 172.21.15.44:0/2665724454 conn(0x7f098c06ea90 msgr2=0x7f098c15c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:09.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.059+0000 7f099464b640 1 -- 172.21.15.44:0/2665724454 shutdown_connections 2023-11-04T01:38:09.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.059+0000 7f099464b640 1 -- 172.21.15.44:0/2665724454 wait complete. 2023-11-04T01:38:09.072 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:09.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.176+0000 7fb6fc990640 1 Processor -- start 2023-11-04T01:38:09.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.176+0000 7fb6fc990640 1 -- start start 2023-11-04T01:38:09.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.177+0000 7fb6fc990640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6f815d250 0x7fb6f80c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.177+0000 7fb6fc990640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f806a120 con 0x7fb6f80c9d70 2023-11-04T01:38:09.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.177+0000 7fb6fc990640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f806a370 con 0x7fb6f815ce70 2023-11-04T01:38:09.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.177+0000 7fb6fc990640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f80cdc10 con 0x7fb6f815d250 2023-11-04T01:38:09.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.177+0000 7fb6f6d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb6f80c9d70 0x7fb6f80ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57222/0 (socket says 172.21.15.44:57222) 2023-11-04T01:38:09.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.177+0000 7fb6f6d9d640 1 -- 172.21.15.44:0/1216914574 learned_addr learned my addr 172.21.15.44:0/1216914574 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:09.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.177+0000 7fb6effff640 1 --2- 172.21.15.44:0/1216914574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6f815d250 0x7fb6f80c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.177+0000 7fb6f5d9b640 1 -- 172.21.15.44:0/1216914574 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527553583 0 0) 0x7fb6f806a120 con 0x7fb6f80c9d70 2023-11-04T01:38:09.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.177+0000 7fb6f5d9b640 1 -- 172.21.15.44:0/1216914574 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6e4003520 con 0x7fb6f80c9d70 2023-11-04T01:38:09.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.177+0000 7fb6f5d9b640 1 -- 172.21.15.44:0/1216914574 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2030585527 0 0) 0x7fb6e4003520 con 0x7fb6f80c9d70 2023-11-04T01:38:09.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.177+0000 7fb6f5d9b640 1 -- 172.21.15.44:0/1216914574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6f815d250 msgr2=0x7fb6f80c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:09.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.177+0000 7fb6f5d9b640 1 --2- 172.21.15.44:0/1216914574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6f815d250 0x7fb6f80c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.177+0000 7fb6f5d9b640 1 -- 172.21.15.44:0/1216914574 >> v1:172.21.15.204:6789/0 conn(0x7fb6f815ce70 legacy=0x7fb6f806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.177+0000 7fb6f5d9b640 1 -- 172.21.15.44:0/1216914574 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f806a650 con 0x7fb6f80c9d70 2023-11-04T01:38:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.177+0000 7fb6f5d9b640 1 -- 172.21.15.44:0/1216914574 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fb6f00019f0 con 0x7fb6f80c9d70 2023-11-04T01:38:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.178+0000 7fb6f5d9b640 1 -- 172.21.15.44:0/1216914574 >> v1:172.21.15.44:6789/0 conn(0x7fb6f80c9d70 legacy=0x7fb6f80ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.178+0000 7fb6f5d9b640 1 --2- 172.21.15.44:0/1216914574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6e40039a0 0x7fb6e4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.178+0000 7fb6f5d9b640 1 --2- 172.21.15.44:0/1216914574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6f815d250 0x7fb6e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.178+0000 7fb6f5d9b640 1 --2- 172.21.15.44:0/1216914574 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6e4004d00 0x7fb6e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.178+0000 7fb6f5d9b640 1 -- 172.21.15.44:0/1216914574 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f80cdc10 con 0x7fb6e40039a0 2023-11-04T01:38:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.178+0000 7fb6f5d9b640 1 -- 172.21.15.44:0/1216914574 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e400ba30 con 0x7fb6e4004d00 2023-11-04T01:38:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.178+0000 7fb6f5d9b640 1 -- 172.21.15.44:0/1216914574 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e400bbf0 con 0x7fb6f815d250 2023-11-04T01:38:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.178+0000 7fb6f659c640 1 --2- 172.21.15.44:0/1216914574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6e40039a0 0x7fb6e4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.178+0000 7fb6effff640 1 --2- 172.21.15.44:0/1216914574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6f815d250 0x7fb6e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.178+0000 7fb6f6d9d640 1 --2- 172.21.15.44:0/1216914574 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6e4004d00 0x7fb6e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.178+0000 7fb6f659c640 1 -- 172.21.15.44:0/1216914574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6f815d250 msgr2=0x7fb6e40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:09.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.178+0000 7fb6f659c640 1 --2- 172.21.15.44:0/1216914574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6f815d250 0x7fb6e40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.178+0000 7fb6f659c640 1 -- 172.21.15.44:0/1216914574 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6e4004d00 msgr2=0x7fb6e4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:09.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.178+0000 7fb6f659c640 1 --2- 172.21.15.44:0/1216914574 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6e4004d00 0x7fb6e4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.178+0000 7fb6f659c640 1 -- 172.21.15.44:0/1216914574 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e4003520 con 0x7fb6e40039a0 2023-11-04T01:38:09.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.179+0000 7fb6f659c640 1 --2- 172.21.15.44:0/1216914574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6e40039a0 0x7fb6e4003dc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8001720 tx=0x7fb6e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1726b478ff8a6f60 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.179+0000 7fb6f5d9b640 1 -- 172.21.15.44:0/1216914574 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80052d0 con 0x7fb6e40039a0 2023-11-04T01:38:09.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.179+0000 7fb6f5d9b640 1 -- 172.21.15.44:0/1216914574 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e802e050 con 0x7fb6e40039a0 2023-11-04T01:38:09.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.179+0000 7fb6f5d9b640 1 -- 172.21.15.44:0/1216914574 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80035f0 con 0x7fb6e40039a0 2023-11-04T01:38:09.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.179+0000 7fb6fc990640 1 -- 172.21.15.44:0/1216914574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6e40039a0 msgr2=0x7fb6e4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.179+0000 7fb6fc990640 1 --2- 172.21.15.44:0/1216914574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6e40039a0 0x7fb6e4003dc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8001720 tx=0x7fb6e40057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.179+0000 7fb6f6d9d640 1 -- 172.21.15.44:0/1216914574 reap_dead start 2023-11-04T01:38:09.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.179+0000 7fb6fc990640 1 -- 172.21.15.44:0/1216914574 shutdown_connections 2023-11-04T01:38:09.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.179+0000 7fb6fc990640 1 -- 172.21.15.44:0/1216914574 >> 172.21.15.44:0/1216914574 conn(0x7fb6f80b0cd0 msgr2=0x7fb6f80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:09.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.179+0000 7fb6fc990640 1 -- 172.21.15.44:0/1216914574 shutdown_connections 2023-11-04T01:38:09.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.179+0000 7fb6fc990640 1 -- 172.21.15.44:0/1216914574 wait complete. 2023-11-04T01:38:09.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.181+0000 7fb6fc990640 1 Processor -- start 2023-11-04T01:38:09.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.181+0000 7fb6fc990640 1 -- start start 2023-11-04T01:38:09.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.181+0000 7fb6fc990640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6e40039a0 0x7fb6f8156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.181+0000 7fb6fc990640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6f80c5770 0x7fb6f8158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.181+0000 7fb6fc990640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6f815a330 0x7fb6f815ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.181+0000 7fb6fc990640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f81e38a0 con 0x7fb6f815a330 2023-11-04T01:38:09.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.181+0000 7fb6fc990640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f8159290 con 0x7fb6f80c5770 2023-11-04T01:38:09.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.181+0000 7fb6fc990640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f8159570 con 0x7fb6e40039a0 2023-11-04T01:38:09.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6f6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6f815a330 0x7fb6f815ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6f6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6f815a330 0x7fb6f815ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50484/0 (socket says 172.21.15.44:50484) 2023-11-04T01:38:09.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6f6d9d640 1 -- 172.21.15.44:0/2487398230 learned_addr learned my addr 172.21.15.44:0/2487398230 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:09.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6f659c640 1 --2- 172.21.15.44:0/2487398230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6e40039a0 0x7fb6f8156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6effff640 1 --2- 172.21.15.44:0/2487398230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6f80c5770 0x7fb6f8158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6f6d9d640 1 -- 172.21.15.44:0/2487398230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6e40039a0 msgr2=0x7fb6f8156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6f6d9d640 1 --2- 172.21.15.44:0/2487398230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6e40039a0 0x7fb6f8156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6f6d9d640 1 -- 172.21.15.44:0/2487398230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6f80c5770 msgr2=0x7fb6f8158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6f6d9d640 1 --2- 172.21.15.44:0/2487398230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6f80c5770 0x7fb6f8158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6f6d9d640 1 -- 172.21.15.44:0/2487398230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f8159850 con 0x7fb6f815a330 2023-11-04T01:38:09.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6effff640 1 --2- 172.21.15.44:0/2487398230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6f80c5770 0x7fb6f8158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:09.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6f6d9d640 1 --2- 172.21.15.44:0/2487398230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6f815a330 0x7fb6f815ab70 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80d02c0 tx=0x7fb6f0007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6eeffd640 1 -- 172.21.15.44:0/2487398230 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f000ac30 con 0x7fb6f815a330 2023-11-04T01:38:09.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6eeffd640 1 -- 172.21.15.44:0/2487398230 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f000ad90 con 0x7fb6f815a330 2023-11-04T01:38:09.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6fc990640 1 -- 172.21.15.44:0/2487398230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f8159b30 con 0x7fb6f815a330 2023-11-04T01:38:09.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6eeffd640 1 -- 172.21.15.44:0/2487398230 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0013610 con 0x7fb6f815a330 2023-11-04T01:38:09.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.182+0000 7fb6fc990640 1 -- 172.21.15.44:0/2487398230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f8158fa0 con 0x7fb6f815a330 2023-11-04T01:38:09.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.183+0000 7fb6fc990640 1 -- 172.21.15.44:0/2487398230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f815a050 con 0x7fb6f815a330 2023-11-04T01:38:09.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.184+0000 7fb6eeffd640 1 -- 172.21.15.44:0/2487398230 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6f0013770 con 0x7fb6f815a330 2023-11-04T01:38:09.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.184+0000 7fb6eeffd640 1 --2- 172.21.15.44:0/2487398230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb6d806ae70 0x7fb6d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.184+0000 7fb6eeffd640 1 -- 172.21.15.44:0/2487398230 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb6f008a240 con 0x7fb6f815a330 2023-11-04T01:38:09.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.185+0000 7fb6f659c640 1 --2- 172.21.15.44:0/2487398230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb6d806ae70 0x7fb6d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.185+0000 7fb6f659c640 1 --2- 172.21.15.44:0/2487398230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb6d806ae70 0x7fb6d806d330 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8033000 tx=0x7fb6e8009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.190+0000 7fb6eeffd640 1 -- 172.21.15.44:0/2487398230 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb6f815a050 con 0x7fb6f815a330 2023-11-04T01:38:09.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.369+0000 7fb6fc990640 1 -- 172.21.15.44:0/2487398230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6f815a050 con 0x7fb6f815a330 2023-11-04T01:38:09.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.370+0000 7fb6eeffd640 1 -- 172.21.15.44:0/2487398230 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+18523 (secure 0 0 0) 0x7fb6f815a050 con 0x7fb6f815a330 2023-11-04T01:38:09.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:09.373 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":56,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:56.297312+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:53.256647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:53.639654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:09.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.373+0000 7fb6fc990640 1 -- 172.21.15.44:0/2487398230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb6d806ae70 msgr2=0x7fb6d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.373+0000 7fb6fc990640 1 --2- 172.21.15.44:0/2487398230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb6d806ae70 0x7fb6d806d330 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8033000 tx=0x7fb6e8009030 comp rx=0 tx=0).stop 2023-11-04T01:38:09.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.373+0000 7fb6fc990640 1 -- 172.21.15.44:0/2487398230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6f815a330 msgr2=0x7fb6f815ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.373+0000 7fb6fc990640 1 --2- 172.21.15.44:0/2487398230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6f815a330 0x7fb6f815ab70 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80d02c0 tx=0x7fb6f0007bd0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.373+0000 7fb6fc990640 1 -- 172.21.15.44:0/2487398230 shutdown_connections 2023-11-04T01:38:09.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.373+0000 7fb6fc990640 1 --2- 172.21.15.44:0/2487398230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb6d806ae70 0x7fb6d806d330 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.373+0000 7fb6fc990640 1 --2- 172.21.15.44:0/2487398230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6f815a330 0x7fb6f815ab70 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.373+0000 7fb6fc990640 1 --2- 172.21.15.44:0/2487398230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6f80c5770 0x7fb6f8158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.373+0000 7fb6fc990640 1 --2- 172.21.15.44:0/2487398230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6e40039a0 0x7fb6f8156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.373+0000 7fb6fc990640 1 -- 172.21.15.44:0/2487398230 >> 172.21.15.44:0/2487398230 conn(0x7fb6f80b0cd0 msgr2=0x7fb6f80ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:09.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.373+0000 7fb6fc990640 1 -- 172.21.15.44:0/2487398230 shutdown_connections 2023-11-04T01:38:09.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.373+0000 7fb6fc990640 1 -- 172.21.15.44:0/2487398230 wait complete. 2023-11-04T01:38:09.386 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:38:09.386 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:09.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.491+0000 7f4e51a44640 1 Processor -- start 2023-11-04T01:38:09.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.491+0000 7f4e51a44640 1 -- start start 2023-11-04T01:38:09.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.492+0000 7f4e51a44640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4e4c06cc50 0x7f4e4c0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.492+0000 7f4e51a44640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4c0b2b40 0x7f4e4c0cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.492+0000 7f4e51a44640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4c0b2f70 con 0x7f4e4c15ce40 2023-11-04T01:38:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.492+0000 7f4e51a44640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4c06b910 con 0x7f4e4c06cc50 2023-11-04T01:38:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.492+0000 7f4e51a44640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c06bbb0 con 0x7f4e4c0b2b40 2023-11-04T01:38:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.492+0000 7f4e4b7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4c0b2b40 0x7f4e4c0cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.492+0000 7f4e4a7fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4e4c06cc50 0x7f4e4c0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.493+0000 7f4e4affd640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f4e4c15ce40 0x7f4e4c161460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:60038/0 (socket says 172.21.15.44:60038) 2023-11-04T01:38:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.493+0000 7f4e4affd640 1 -- 172.21.15.44:0/79335380 learned_addr learned my addr 172.21.15.44:0/79335380 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.493+0000 7f4e49ffb640 1 -- 172.21.15.44:0/79335380 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591587484 0 0) 0x7f4e4c0b2f70 con 0x7f4e4c15ce40 2023-11-04T01:38:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.493+0000 7f4e49ffb640 1 -- 172.21.15.44:0/79335380 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e38003520 con 0x7f4e4c15ce40 2023-11-04T01:38:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.493+0000 7f4e4a7fc640 1 -- 172.21.15.44:0/79335380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4c0b2b40 msgr2=0x7f4e4c0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.493+0000 7f4e4a7fc640 1 --2- 172.21.15.44:0/79335380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4c0b2b40 0x7f4e4c0cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.493+0000 7f4e4a7fc640 1 -- 172.21.15.44:0/79335380 >> v1:172.21.15.204:6789/0 conn(0x7f4e4c15ce40 legacy=0x7f4e4c161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.493+0000 7f4e4a7fc640 1 -- 172.21.15.44:0/79335380 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c06be90 con 0x7f4e4c06cc50 2023-11-04T01:38:09.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.493+0000 7f4e4b7fe640 1 --2- 172.21.15.44:0/79335380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4c0b2b40 0x7f4e4c0cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:09.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.494+0000 7f4e4a7fc640 1 --2- 172.21.15.44:0/79335380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4c06cc50 0x7f4e4c0b2600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4e340097a0 tx=0x7f4e3402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=164f5162099304dd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.494+0000 7f4e49ffb640 1 -- 172.21.15.44:0/79335380 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3402d040 con 0x7f4e4c06cc50 2023-11-04T01:38:09.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.494+0000 7f4e49ffb640 1 -- 172.21.15.44:0/79335380 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e34031810 con 0x7f4e4c06cc50 2023-11-04T01:38:09.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.494+0000 7f4e49ffb640 1 -- 172.21.15.44:0/79335380 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34031ba0 con 0x7f4e4c06cc50 2023-11-04T01:38:09.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.495+0000 7f4e51a44640 1 -- 172.21.15.44:0/79335380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4c06cc50 msgr2=0x7f4e4c0b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.495+0000 7f4e51a44640 1 --2- 172.21.15.44:0/79335380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4c06cc50 0x7f4e4c0b2600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4e340097a0 tx=0x7f4e3402b8b0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.495+0000 7f4e51a44640 1 -- 172.21.15.44:0/79335380 shutdown_connections 2023-11-04T01:38:09.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.495+0000 7f4e51a44640 1 --2- 172.21.15.44:0/79335380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4c0b2b40 0x7f4e4c0cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.495+0000 7f4e51a44640 1 --2- 172.21.15.44:0/79335380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4c06cc50 0x7f4e4c0b2600 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.495+0000 7f4e51a44640 1 -- 172.21.15.44:0/79335380 >> 172.21.15.44:0/79335380 conn(0x7f4e4c0cd600 msgr2=0x7f4e4c0cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:09.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.495+0000 7f4e51a44640 1 -- 172.21.15.44:0/79335380 shutdown_connections 2023-11-04T01:38:09.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.495+0000 7f4e51a44640 1 -- 172.21.15.44:0/79335380 wait complete. 2023-11-04T01:38:09.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.496+0000 7f4e51a44640 1 Processor -- start 2023-11-04T01:38:09.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.496+0000 7f4e51a44640 1 -- start start 2023-11-04T01:38:09.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e51a44640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4c06cc50 0x7f4e4c0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e51a44640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4c0b2b40 0x7f4e4c0c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e51a44640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4c15ce40 0x7f4e4c15b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e51a44640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c0b5aa0 con 0x7f4e4c0b2b40 2023-11-04T01:38:09.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e51a44640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c15a520 con 0x7f4e4c15ce40 2023-11-04T01:38:09.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e51a44640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c0c8090 con 0x7f4e4c06cc50 2023-11-04T01:38:09.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e4a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4c0b2b40 0x7f4e4c0c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e4a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4c0b2b40 0x7f4e4c0c9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50500/0 (socket says 172.21.15.44:50500) 2023-11-04T01:38:09.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e4a7fc640 1 -- 172.21.15.44:0/3366843069 learned_addr learned my addr 172.21.15.44:0/3366843069 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:09.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e4affd640 1 --2- 172.21.15.44:0/3366843069 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4c06cc50 0x7f4e4c0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e4b7fe640 1 --2- 172.21.15.44:0/3366843069 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4c15ce40 0x7f4e4c15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e4a7fc640 1 -- 172.21.15.44:0/3366843069 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4c06cc50 msgr2=0x7f4e4c0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e4a7fc640 1 --2- 172.21.15.44:0/3366843069 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4c06cc50 0x7f4e4c0b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e4a7fc640 1 -- 172.21.15.44:0/3366843069 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4c15ce40 msgr2=0x7f4e4c15b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e4a7fc640 1 --2- 172.21.15.44:0/3366843069 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4c15ce40 0x7f4e4c15b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e4a7fc640 1 -- 172.21.15.44:0/3366843069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e44009a70 con 0x7f4e4c0b2b40 2023-11-04T01:38:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e4b7fe640 1 --2- 172.21.15.44:0/3366843069 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4c15ce40 0x7f4e4c15b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.497+0000 7f4e4a7fc640 1 --2- 172.21.15.44:0/3366843069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4c0b2b40 0x7f4e4c0c9680 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4e3402bec0 tx=0x7f4e340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.498+0000 7f4e43fff640 1 -- 172.21.15.44:0/3366843069 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34031610 con 0x7f4e4c0b2b40 2023-11-04T01:38:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.498+0000 7f4e43fff640 1 -- 172.21.15.44:0/3366843069 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3403ad60 con 0x7f4e4c0b2b40 2023-11-04T01:38:09.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.498+0000 7f4e43fff640 1 -- 172.21.15.44:0/3366843069 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34042630 con 0x7f4e4c0b2b40 2023-11-04T01:38:09.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.498+0000 7f4e51a44640 1 -- 172.21.15.44:0/3366843069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e34009400 con 0x7f4e4c0b2b40 2023-11-04T01:38:09.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.498+0000 7f4e51a44640 1 -- 172.21.15.44:0/3366843069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4c0b54e0 con 0x7f4e4c0b2b40 2023-11-04T01:38:09.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.499+0000 7f4e51a44640 1 -- 172.21.15.44:0/3366843069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4c15a2f0 con 0x7f4e4c0b2b40 2023-11-04T01:38:09.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.499+0000 7f4e43fff640 1 -- 172.21.15.44:0/3366843069 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e34042790 con 0x7f4e4c0b2b40 2023-11-04T01:38:09.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.500+0000 7f4e43fff640 1 --2- 172.21.15.44:0/3366843069 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e2c06aea0 0x7f4e2c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.500+0000 7f4e43fff640 1 -- 172.21.15.44:0/3366843069 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4e340ab650 con 0x7f4e4c0b2b40 2023-11-04T01:38:09.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.500+0000 7f4e4affd640 1 --2- 172.21.15.44:0/3366843069 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e2c06aea0 0x7f4e2c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.501+0000 7f4e4affd640 1 --2- 172.21.15.44:0/3366843069 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e2c06aea0 0x7f4e2c06d360 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c001230 tx=0x7f4e3c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.504+0000 7f4e43fff640 1 -- 172.21.15.44:0/3366843069 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e4c15a2f0 con 0x7f4e4c0b2b40 2023-11-04T01:38:09.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.716+0000 7f4e51a44640 1 -- 172.21.15.44:0/3366843069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e4c15a6b0 con 0x7f4e4c0b2b40 2023-11-04T01:38:09.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.717+0000 7f4e43fff640 1 -- 172.21.15.44:0/3366843069 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f4e34076450 con 0x7f4e4c0b2b40 2023-11-04T01:38:09.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:09.719 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/683817288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":683817288},{"type":"v1","addr":"172.21.15.44:6835","nonce":683817288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5306,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/4160536413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":4160536413},{"type":"v1","addr":"172.21.15.204:6836","nonce":4160536413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/1970301848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1970301848},{"type":"v1","addr":"172.21.15.204:6837","nonce":1970301848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:54.668449+0000","modified":"2023-11-04T01:37:57.680007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6834/982248126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":982248126},{"type":"v1","addr":"172.21.15.44:6834","nonce":982248126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:38:09.720 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 24 2023-11-04T01:38:09.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.719+0000 7f4e51a44640 1 -- 172.21.15.44:0/3366843069 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e2c06aea0 msgr2=0x7f4e2c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.719+0000 7f4e51a44640 1 --2- 172.21.15.44:0/3366843069 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e2c06aea0 0x7f4e2c06d360 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c001230 tx=0x7f4e3c009040 comp rx=0 tx=0).stop 2023-11-04T01:38:09.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.719+0000 7f4e51a44640 1 -- 172.21.15.44:0/3366843069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4c0b2b40 msgr2=0x7f4e4c0c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.719+0000 7f4e51a44640 1 --2- 172.21.15.44:0/3366843069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4c0b2b40 0x7f4e4c0c9680 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4e3402bec0 tx=0x7f4e340046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.719+0000 7f4e51a44640 1 -- 172.21.15.44:0/3366843069 shutdown_connections 2023-11-04T01:38:09.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.719+0000 7f4e51a44640 1 --2- 172.21.15.44:0/3366843069 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e2c06aea0 0x7f4e2c06d360 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.719+0000 7f4e51a44640 1 --2- 172.21.15.44:0/3366843069 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4c15ce40 0x7f4e4c15b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.719+0000 7f4e51a44640 1 --2- 172.21.15.44:0/3366843069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4c0b2b40 0x7f4e4c0c9680 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.719+0000 7f4e51a44640 1 --2- 172.21.15.44:0/3366843069 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4c06cc50 0x7f4e4c0b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.719+0000 7f4e51a44640 1 -- 172.21.15.44:0/3366843069 >> 172.21.15.44:0/3366843069 conn(0x7f4e4c0cd600 msgr2=0x7f4e4c15f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.719+0000 7f4e51a44640 1 -- 172.21.15.44:0/3366843069 shutdown_connections 2023-11-04T01:38:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.719+0000 7f4e51a44640 1 -- 172.21.15.44:0/3366843069 wait complete. 2023-11-04T01:38:09.734 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:09.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.839+0000 7f2bca4b4640 1 Processor -- start 2023-11-04T01:38:09.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.839+0000 7f2bca4b4640 1 -- start start 2023-11-04T01:38:09.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.840+0000 7f2bca4b4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2bc406c6f0 0x7f2bc406cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.840+0000 7f2bca4b4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bc40b07f0 0x7f2bc40b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.840+0000 7f2bca4b4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc40ca450 con 0x7f2bc415aa30 2023-11-04T01:38:09.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.840+0000 7f2bca4b4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc40b11a0 con 0x7f2bc406c6f0 2023-11-04T01:38:09.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.840+0000 7f2bca4b4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc415bc30 con 0x7f2bc40b07f0 2023-11-04T01:38:09.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.840+0000 7f2bc37fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2bc406c6f0 0x7f2bc406cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.840+0000 7f2bc37fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2bc406c6f0 0x7f2bc406cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50516/0 (socket says 172.21.15.44:50516) 2023-11-04T01:38:09.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.840+0000 7f2bc37fe640 1 -- 172.21.15.44:0/1524465146 learned_addr learned my addr 172.21.15.44:0/1524465146 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:09.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.840+0000 7f2bc8a51640 1 --2- 172.21.15.44:0/1524465146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bc40b07f0 0x7f2bc40b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.840+0000 7f2bc37fe640 1 -- 172.21.15.44:0/1524465146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bc40b07f0 msgr2=0x7f2bc40b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:09.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.840+0000 7f2bc37fe640 1 --2- 172.21.15.44:0/1524465146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bc40b07f0 0x7f2bc40b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.840+0000 7f2bc37fe640 1 -- 172.21.15.44:0/1524465146 >> v1:172.21.15.204:6789/0 conn(0x7f2bc415aa30 legacy=0x7f2bc40c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.840+0000 7f2bc37fe640 1 -- 172.21.15.44:0/1524465146 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc415bf10 con 0x7f2bc406c6f0 2023-11-04T01:38:09.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.840+0000 7f2bc8a51640 1 --2- 172.21.15.44:0/1524465146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bc40b07f0 0x7f2bc40b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:09.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.841+0000 7f2bc37fe640 1 --2- 172.21.15.44:0/1524465146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bc406c6f0 0x7f2bc406cb80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009870 tx=0x7f2bb402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8faa3e83253579c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.841+0000 7f2bc2ffd640 1 -- 172.21.15.44:0/1524465146 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4030840 con 0x7f2bc406c6f0 2023-11-04T01:38:09.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.841+0000 7f2bc2ffd640 1 -- 172.21.15.44:0/1524465146 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb40309a0 con 0x7f2bc406c6f0 2023-11-04T01:38:09.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.841+0000 7f2bc2ffd640 1 -- 172.21.15.44:0/1524465146 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4030d30 con 0x7f2bc406c6f0 2023-11-04T01:38:09.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.842+0000 7f2bca4b4640 1 -- 172.21.15.44:0/1524465146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bc406c6f0 msgr2=0x7f2bc406cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.842+0000 7f2bca4b4640 1 --2- 172.21.15.44:0/1524465146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bc406c6f0 0x7f2bc406cb80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009870 tx=0x7f2bb402b980 comp rx=0 tx=0).stop 2023-11-04T01:38:09.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.842+0000 7f2bca4b4640 1 -- 172.21.15.44:0/1524465146 shutdown_connections 2023-11-04T01:38:09.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.842+0000 7f2bca4b4640 1 --2- 172.21.15.44:0/1524465146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bc40b07f0 0x7f2bc40b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.842+0000 7f2bca4b4640 1 --2- 172.21.15.44:0/1524465146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bc406c6f0 0x7f2bc406cb80 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.842+0000 7f2bca4b4640 1 -- 172.21.15.44:0/1524465146 >> 172.21.15.44:0/1524465146 conn(0x7f2bc40cb7f0 msgr2=0x7f2bc40cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:09.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.842+0000 7f2bca4b4640 1 -- 172.21.15.44:0/1524465146 shutdown_connections 2023-11-04T01:38:09.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.842+0000 7f2bca4b4640 1 -- 172.21.15.44:0/1524465146 wait complete. 2023-11-04T01:38:09.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.843+0000 7f2bca4b4640 1 Processor -- start 2023-11-04T01:38:09.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.843+0000 7f2bca4b4640 1 -- start start 2023-11-04T01:38:09.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bca4b4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bc406c6f0 0x7f2bc41451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bca4b4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bc40b07f0 0x7f2bc40ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bca4b4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bc415aa30 0x7f2bc40ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bca4b4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc4145720 con 0x7f2bc40b07f0 2023-11-04T01:38:09.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bca4b4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc41527e0 con 0x7f2bc406c6f0 2023-11-04T01:38:09.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bca4b4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc4152a80 con 0x7f2bc415aa30 2023-11-04T01:38:09.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bc37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bc40b07f0 0x7f2bc40ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bc37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bc40b07f0 0x7f2bc40ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50518/0 (socket says 172.21.15.44:50518) 2023-11-04T01:38:09.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bc37fe640 1 -- 172.21.15.44:0/2137947074 learned_addr learned my addr 172.21.15.44:0/2137947074 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:09.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bc8a51640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bc415aa30 0x7f2bc40ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bc3fff640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bc406c6f0 0x7f2bc41451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bc37fe640 1 -- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bc415aa30 msgr2=0x7f2bc40ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bc37fe640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bc415aa30 0x7f2bc40ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bc37fe640 1 -- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bc406c6f0 msgr2=0x7f2bc41451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bc37fe640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bc406c6f0 0x7f2bc41451e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bc37fe640 1 -- 172.21.15.44:0/2137947074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb40094d0 con 0x7f2bc40b07f0 2023-11-04T01:38:09.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bc8a51640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bc415aa30 0x7f2bc40ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:09.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.844+0000 7f2bc3fff640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bc406c6f0 0x7f2bc41451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:09.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.845+0000 7f2bc37fe640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bc40b07f0 0x7f2bc40ce060 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4000c00 tx=0x7f2bb4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.845+0000 7f2bc0ff9640 1 -- 172.21.15.44:0/2137947074 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4039a90 con 0x7f2bc40b07f0 2023-11-04T01:38:09.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.845+0000 7f2bc0ff9640 1 -- 172.21.15.44:0/2137947074 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb4039bf0 con 0x7f2bc40b07f0 2023-11-04T01:38:09.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.845+0000 7f2bca4b4640 1 -- 172.21.15.44:0/2137947074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc4152d60 con 0x7f2bc40b07f0 2023-11-04T01:38:09.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.845+0000 7f2bc0ff9640 1 -- 172.21.15.44:0/2137947074 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4043410 con 0x7f2bc40b07f0 2023-11-04T01:38:09.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.845+0000 7f2bca4b4640 1 -- 172.21.15.44:0/2137947074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc40b39e0 con 0x7f2bc40b07f0 2023-11-04T01:38:09.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.846+0000 7f2bca4b4640 1 -- 172.21.15.44:0/2137947074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc40b3c30 con 0x7f2bc40b07f0 2023-11-04T01:38:09.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.846+0000 7f2bc0ff9640 1 -- 172.21.15.44:0/2137947074 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2bb404c3b0 con 0x7f2bc40b07f0 2023-11-04T01:38:09.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.847+0000 7f2bc0ff9640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2ba406ae70 0x7f2ba406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.847+0000 7f2bc0ff9640 1 -- 172.21.15.44:0/2137947074 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2bb40abd50 con 0x7f2bc40b07f0 2023-11-04T01:38:09.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.847+0000 7f2bc3fff640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2ba406ae70 0x7f2ba406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.848+0000 7f2bc3fff640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2ba406ae70 0x7f2ba406d330 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2bac007fd0 tx=0x7f2bac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:09.851+0000 7f2bc0ff9640 1 -- 172.21.15.44:0/2137947074 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2bb40af030 con 0x7f2bc40b07f0 2023-11-04T01:38:10.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.064+0000 7f2bca4b4640 1 -- 172.21.15.44:0/2137947074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bc4074290 con 0x7f2bc40b07f0 2023-11-04T01:38:10.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.064+0000 7f2bc0ff9640 1 -- 172.21.15.44:0/2137947074 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f2bb4076b60 con 0x7f2bc40b07f0 2023-11-04T01:38:10.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:10.067 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/683817288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":683817288},{"type":"v1","addr":"172.21.15.44:6835","nonce":683817288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5306,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/4160536413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":4160536413},{"type":"v1","addr":"172.21.15.204:6836","nonce":4160536413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/1970301848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1970301848},{"type":"v1","addr":"172.21.15.204:6837","nonce":1970301848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:54.668449+0000","modified":"2023-11-04T01:37:57.680007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6834/982248126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":982248126},{"type":"v1","addr":"172.21.15.44:6834","nonce":982248126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:38:10.067 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 24 2023-11-04T01:38:10.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.066+0000 7f2bca4b4640 1 -- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2ba406ae70 msgr2=0x7f2ba406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.066+0000 7f2bca4b4640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2ba406ae70 0x7f2ba406d330 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2bac007fd0 tx=0x7f2bac009040 comp rx=0 tx=0).stop 2023-11-04T01:38:10.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.066+0000 7f2bca4b4640 1 -- 172.21.15.44:0/2137947074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bc40b07f0 msgr2=0x7f2bc40ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.066+0000 7f2bca4b4640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bc40b07f0 0x7f2bc40ce060 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4000c00 tx=0x7f2bb4004730 comp rx=0 tx=0).stop 2023-11-04T01:38:10.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.066+0000 7f2bca4b4640 1 -- 172.21.15.44:0/2137947074 shutdown_connections 2023-11-04T01:38:10.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.066+0000 7f2bca4b4640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2ba406ae70 0x7f2ba406d330 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.066+0000 7f2bca4b4640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bc415aa30 0x7f2bc40ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.066+0000 7f2bca4b4640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bc40b07f0 0x7f2bc40ce060 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.066+0000 7f2bca4b4640 1 --2- 172.21.15.44:0/2137947074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bc406c6f0 0x7f2bc41451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.066+0000 7f2bca4b4640 1 -- 172.21.15.44:0/2137947074 >> 172.21.15.44:0/2137947074 conn(0x7f2bc40cb7f0 msgr2=0x7f2bc40cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:10.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.067+0000 7f2bca4b4640 1 -- 172.21.15.44:0/2137947074 shutdown_connections 2023-11-04T01:38:10.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.067+0000 7f2bca4b4640 1 -- 172.21.15.44:0/2137947074 wait complete. 2023-11-04T01:38:10.079 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:10.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.183+0000 7fb56e3c7640 1 Processor -- start 2023-11-04T01:38:10.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.183+0000 7fb56e3c7640 1 -- start start 2023-11-04T01:38:10.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.184+0000 7fb56e3c7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb56815ce70 0x7fb56806d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.184+0000 7fb56e3c7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb56815d250 0x7fb5680c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.184+0000 7fb56e3c7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56806a120 con 0x7fb5680c9d70 2023-11-04T01:38:10.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.184+0000 7fb56e3c7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5680cdc10 con 0x7fb56815ce70 2023-11-04T01:38:10.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.184+0000 7fb56e3c7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb56806def0 con 0x7fb56815d250 2023-11-04T01:38:10.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.184+0000 7fb567fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb56815ce70 0x7fb56806d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.184+0000 7fb567fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb56815ce70 0x7fb56806d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50530/0 (socket says 172.21.15.44:50530) 2023-11-04T01:38:10.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.184+0000 7fb567fff640 1 -- 172.21.15.44:0/2138411381 learned_addr learned my addr 172.21.15.44:0/2138411381 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:10.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.184+0000 7fb56c964640 1 --1- 172.21.15.44:0/2138411381 >> v1:172.21.15.44:6789/0 conn(0x7fb5680c9d70 0x7fb5680ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57230/0 (socket says 172.21.15.44:57230) 2023-11-04T01:38:10.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.184+0000 7fb567fff640 1 -- 172.21.15.44:0/2138411381 >> v2:172.21.15.204:3300/0 conn(0x7fb56815d250 msgr2=0x7fb5680c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:10.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.184+0000 7fb567fff640 1 --2- 172.21.15.44:0/2138411381 >> v2:172.21.15.204:3300/0 conn(0x7fb56815d250 0x7fb5680c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.184+0000 7fb567fff640 1 -- 172.21.15.44:0/2138411381 >> v1:172.21.15.44:6789/0 conn(0x7fb5680c9d70 legacy=0x7fb5680ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.184+0000 7fb567fff640 1 -- 172.21.15.44:0/2138411381 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56806a370 con 0x7fb56815ce70 2023-11-04T01:38:10.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.185+0000 7fb567fff640 1 --2- 172.21.15.44:0/2138411381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb56815ce70 0x7fb56806d9b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb5680d02c0 tx=0x7fb55c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f26c363b732c3a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:10.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.185+0000 7fb566ffd640 1 -- 172.21.15.44:0/2138411381 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c030860 con 0x7fb56815ce70 2023-11-04T01:38:10.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.185+0000 7fb566ffd640 1 -- 172.21.15.44:0/2138411381 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c0309c0 con 0x7fb56815ce70 2023-11-04T01:38:10.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.185+0000 7fb566ffd640 1 -- 172.21.15.44:0/2138411381 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c030d50 con 0x7fb56815ce70 2023-11-04T01:38:10.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.186+0000 7fb56e3c7640 1 -- 172.21.15.44:0/2138411381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb56815ce70 msgr2=0x7fb56806d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.186+0000 7fb56e3c7640 1 --2- 172.21.15.44:0/2138411381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb56815ce70 0x7fb56806d9b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb5680d02c0 tx=0x7fb55c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.186+0000 7fb56e3c7640 1 -- 172.21.15.44:0/2138411381 shutdown_connections 2023-11-04T01:38:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.186+0000 7fb56e3c7640 1 --2- 172.21.15.44:0/2138411381 >> v2:172.21.15.204:3300/0 conn(0x7fb56815d250 0x7fb5680c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.186+0000 7fb56e3c7640 1 --2- 172.21.15.44:0/2138411381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb56815ce70 0x7fb56806d9b0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.186+0000 7fb56e3c7640 1 -- 172.21.15.44:0/2138411381 >> 172.21.15.44:0/2138411381 conn(0x7fb5680b0cd0 msgr2=0x7fb5680b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.186+0000 7fb56e3c7640 1 -- 172.21.15.44:0/2138411381 shutdown_connections 2023-11-04T01:38:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.186+0000 7fb56e3c7640 1 -- 172.21.15.44:0/2138411381 wait complete. 2023-11-04T01:38:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.187+0000 7fb56e3c7640 1 Processor -- start 2023-11-04T01:38:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.187+0000 7fb56e3c7640 1 -- start start 2023-11-04T01:38:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb56e3c7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb56815ce70 0x7fb5680c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb56e3c7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb56815d250 0x7fb5680c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb56e3c7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5680c7b50 0x7fb5680c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb56e3c7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680c71f0 con 0x7fb5680c7b50 2023-11-04T01:38:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb56e3c7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680c62b0 con 0x7fb56815d250 2023-11-04T01:38:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb56e3c7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680c6570 con 0x7fb56815ce70 2023-11-04T01:38:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb56c964640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5680c7b50 0x7fb5680c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb56c964640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5680c7b50 0x7fb5680c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50546/0 (socket says 172.21.15.44:50546) 2023-11-04T01:38:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb56c964640 1 -- 172.21.15.44:0/2131160673 learned_addr learned my addr 172.21.15.44:0/2131160673 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb567fff640 1 --2- 172.21.15.44:0/2131160673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb56815ce70 0x7fb5680c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb5677fe640 1 --2- 172.21.15.44:0/2131160673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb56815d250 0x7fb5680c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb56c964640 1 -- 172.21.15.44:0/2131160673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb56815ce70 msgr2=0x7fb5680c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb56c964640 1 --2- 172.21.15.44:0/2131160673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb56815ce70 0x7fb5680c5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb56c964640 1 -- 172.21.15.44:0/2131160673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb56815d250 msgr2=0x7fb5680c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb56c964640 1 --2- 172.21.15.44:0/2131160673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb56815d250 0x7fb5680c7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb56c964640 1 -- 172.21.15.44:0/2131160673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0094d0 con 0x7fb5680c7b50 2023-11-04T01:38:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.188+0000 7fb56c964640 1 --2- 172.21.15.44:0/2131160673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5680c7b50 0x7fb5680c8730 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb56000c7a0 tx=0x7fb56000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:10.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.189+0000 7fb564ff9640 1 -- 172.21.15.44:0/2131160673 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000a640 con 0x7fb5680c7b50 2023-11-04T01:38:10.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.189+0000 7fb564ff9640 1 -- 172.21.15.44:0/2131160673 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56000a7a0 con 0x7fb5680c7b50 2023-11-04T01:38:10.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.189+0000 7fb56e3c7640 1 -- 172.21.15.44:0/2131160673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5680c6850 con 0x7fb5680c7b50 2023-11-04T01:38:10.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.189+0000 7fb564ff9640 1 -- 172.21.15.44:0/2131160673 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000ab10 con 0x7fb5680c7b50 2023-11-04T01:38:10.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.189+0000 7fb56e3c7640 1 -- 172.21.15.44:0/2131160673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5680c6e10 con 0x7fb5680c7b50 2023-11-04T01:38:10.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.190+0000 7fb56e3c7640 1 -- 172.21.15.44:0/2131160673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5680c7330 con 0x7fb5680c7b50 2023-11-04T01:38:10.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.190+0000 7fb564ff9640 1 -- 172.21.15.44:0/2131160673 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb56000ac70 con 0x7fb5680c7b50 2023-11-04T01:38:10.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.190+0000 7fb564ff9640 1 --2- 172.21.15.44:0/2131160673 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb55406aea0 0x7fb55406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.191+0000 7fb564ff9640 1 -- 172.21.15.44:0/2131160673 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb560088fb0 con 0x7fb5680c7b50 2023-11-04T01:38:10.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.191+0000 7fb567fff640 1 --2- 172.21.15.44:0/2131160673 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb55406aea0 0x7fb55406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.191+0000 7fb567fff640 1 --2- 172.21.15.44:0/2131160673 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb55406aea0 0x7fb55406d360 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb55c036000 tx=0x7fb55c03b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:10.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.195+0000 7fb564ff9640 1 -- 172.21.15.44:0/2131160673 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb5600bbca0 con 0x7fb5680c7b50 2023-11-04T01:38:10.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.373+0000 7fb56e3c7640 1 -- 172.21.15.44:0/2131160673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb568074290 con 0x7fb5680c7b50 2023-11-04T01:38:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.375+0000 7fb564ff9640 1 -- 172.21.15.44:0/2131160673 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+18523 (secure 0 0 0) 0x7fb560017020 con 0x7fb5680c7b50 2023-11-04T01:38:10.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:10.377 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":56,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:37:56.297312+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:53.256647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:53.639654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:10.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.376+0000 7fb56e3c7640 1 -- 172.21.15.44:0/2131160673 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb55406aea0 msgr2=0x7fb55406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.376+0000 7fb56e3c7640 1 --2- 172.21.15.44:0/2131160673 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb55406aea0 0x7fb55406d360 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb55c036000 tx=0x7fb55c03b040 comp rx=0 tx=0).stop 2023-11-04T01:38:10.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.376+0000 7fb56e3c7640 1 -- 172.21.15.44:0/2131160673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5680c7b50 msgr2=0x7fb5680c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.376+0000 7fb56e3c7640 1 --2- 172.21.15.44:0/2131160673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5680c7b50 0x7fb5680c8730 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb56000c7a0 tx=0x7fb56000cc60 comp rx=0 tx=0).stop 2023-11-04T01:38:10.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.377+0000 7fb56e3c7640 1 -- 172.21.15.44:0/2131160673 shutdown_connections 2023-11-04T01:38:10.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.377+0000 7fb56e3c7640 1 --2- 172.21.15.44:0/2131160673 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb55406aea0 0x7fb55406d360 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.377+0000 7fb56e3c7640 1 --2- 172.21.15.44:0/2131160673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5680c7b50 0x7fb5680c8730 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.377+0000 7fb56e3c7640 1 --2- 172.21.15.44:0/2131160673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb56815d250 0x7fb5680c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.377+0000 7fb56e3c7640 1 --2- 172.21.15.44:0/2131160673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb56815ce70 0x7fb5680c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.377+0000 7fb56e3c7640 1 -- 172.21.15.44:0/2131160673 >> 172.21.15.44:0/2131160673 conn(0x7fb5680b0cd0 msgr2=0x7fb5680ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:10.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.377+0000 7fb56e3c7640 1 -- 172.21.15.44:0/2131160673 shutdown_connections 2023-11-04T01:38:10.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.377+0000 7fb56e3c7640 1 -- 172.21.15.44:0/2131160673 wait complete. 2023-11-04T01:38:10.390 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:38:10.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.495+0000 7f7c679f5640 1 Processor -- start 2023-11-04T01:38:10.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.495+0000 7f7c679f5640 1 -- start start 2023-11-04T01:38:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.496+0000 7f7c679f5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7c600cd6d0 0x7f7c60161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.496+0000 7f7c679f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c600b4880 0x7f7c600b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.496+0000 7f7c679f5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c600cde60 con 0x7f7c60153e60 2023-11-04T01:38:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.496+0000 7f7c679f5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c60160f90 con 0x7f7c600cd6d0 2023-11-04T01:38:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.496+0000 7f7c679f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60161960 con 0x7f7c600b4880 2023-11-04T01:38:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.496+0000 7f7c64f90640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7c600cd6d0 0x7f7c60161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.496+0000 7f7c64f90640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7c600cd6d0 0x7f7c60161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50558/0 (socket says 172.21.15.44:50558) 2023-11-04T01:38:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.496+0000 7f7c64f90640 1 -- 172.21.15.44:0/2243447345 learned_addr learned my addr 172.21.15.44:0/2243447345 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.497+0000 7f7c65f92640 1 --2- 172.21.15.44:0/2243447345 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c600b4880 0x7f7c600b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.497+0000 7f7c64f90640 1 -- 172.21.15.44:0/2243447345 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c600b4880 msgr2=0x7f7c600b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.497+0000 7f7c64f90640 1 --2- 172.21.15.44:0/2243447345 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c600b4880 0x7f7c600b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.497+0000 7f7c64f90640 1 -- 172.21.15.44:0/2243447345 >> v1:172.21.15.204:6789/0 conn(0x7f7c60153e60 legacy=0x7f7c6015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.497+0000 7f7c64f90640 1 -- 172.21.15.44:0/2243447345 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c600b5220 con 0x7f7c600cd6d0 2023-11-04T01:38:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.497+0000 7f7c64f90640 1 --2- 172.21.15.44:0/2243447345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c600cd6d0 0x7f7c60161420 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009870 tx=0x7f7c5402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a5d5933c3d01bb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.498+0000 7f7c5ffff640 1 -- 172.21.15.44:0/2243447345 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54030840 con 0x7f7c600cd6d0 2023-11-04T01:38:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.498+0000 7f7c5ffff640 1 -- 172.21.15.44:0/2243447345 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c540309a0 con 0x7f7c600cd6d0 2023-11-04T01:38:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.498+0000 7f7c5ffff640 1 -- 172.21.15.44:0/2243447345 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54030d30 con 0x7f7c600cd6d0 2023-11-04T01:38:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.498+0000 7f7c679f5640 1 -- 172.21.15.44:0/2243447345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c600cd6d0 msgr2=0x7f7c60161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.498+0000 7f7c679f5640 1 --2- 172.21.15.44:0/2243447345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c600cd6d0 0x7f7c60161420 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009870 tx=0x7f7c5402b980 comp rx=0 tx=0).stop 2023-11-04T01:38:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.498+0000 7f7c679f5640 1 -- 172.21.15.44:0/2243447345 shutdown_connections 2023-11-04T01:38:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.498+0000 7f7c679f5640 1 --2- 172.21.15.44:0/2243447345 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c600b4880 0x7f7c600b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.498+0000 7f7c679f5640 1 --2- 172.21.15.44:0/2243447345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c600cd6d0 0x7f7c60161420 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.498+0000 7f7c679f5640 1 -- 172.21.15.44:0/2243447345 >> 172.21.15.44:0/2243447345 conn(0x7f7c600cf880 msgr2=0x7f7c600cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:10.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.498+0000 7f7c679f5640 1 -- 172.21.15.44:0/2243447345 shutdown_connections 2023-11-04T01:38:10.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.498+0000 7f7c679f5640 1 -- 172.21.15.44:0/2243447345 wait complete. 2023-11-04T01:38:10.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.499+0000 7f7c679f5640 1 Processor -- start 2023-11-04T01:38:10.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.499+0000 7f7c679f5640 1 -- start start 2023-11-04T01:38:10.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.500+0000 7f7c679f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c600b4880 0x7f7c60157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.500+0000 7f7c679f5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c600cd6d0 0x7f7c601f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.500+0000 7f7c679f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c60153e60 0x7f7c600cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.500+0000 7f7c679f5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6015bba0 con 0x7f7c60153e60 2023-11-04T01:38:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.500+0000 7f7c679f5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6015b270 con 0x7f7c600cd6d0 2023-11-04T01:38:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.500+0000 7f7c679f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6015b550 con 0x7f7c600b4880 2023-11-04T01:38:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.500+0000 7f7c65f92640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c60153e60 0x7f7c600cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.500+0000 7f7c65f92640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c60153e60 0x7f7c600cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50560/0 (socket says 172.21.15.44:50560) 2023-11-04T01:38:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.500+0000 7f7c65f92640 1 -- 172.21.15.44:0/3510402025 learned_addr learned my addr 172.21.15.44:0/3510402025 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.500+0000 7f7c64f90640 1 --2- 172.21.15.44:0/3510402025 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c600cd6d0 0x7f7c601f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.500+0000 7f7c65791640 1 --2- 172.21.15.44:0/3510402025 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c600b4880 0x7f7c60157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.501+0000 7f7c65f92640 1 -- 172.21.15.44:0/3510402025 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c600b4880 msgr2=0x7f7c60157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.501+0000 7f7c65f92640 1 --2- 172.21.15.44:0/3510402025 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c600b4880 0x7f7c60157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.501+0000 7f7c65f92640 1 -- 172.21.15.44:0/3510402025 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c600cd6d0 msgr2=0x7f7c601f2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.501+0000 7f7c65f92640 1 --2- 172.21.15.44:0/3510402025 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c600cd6d0 0x7f7c601f2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.501+0000 7f7c65f92640 1 -- 172.21.15.44:0/3510402025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540094d0 con 0x7f7c60153e60 2023-11-04T01:38:10.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.501+0000 7f7c65f92640 1 --2- 172.21.15.44:0/3510402025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c60153e60 0x7f7c600cc190 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7c50007e40 tx=0x7f7c5000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:10.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.501+0000 7f7c5dffb640 1 -- 172.21.15.44:0/3510402025 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50014620 con 0x7f7c60153e60 2023-11-04T01:38:10.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.501+0000 7f7c5dffb640 1 -- 172.21.15.44:0/3510402025 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5000ee90 con 0x7f7c60153e60 2023-11-04T01:38:10.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.501+0000 7f7c5dffb640 1 -- 172.21.15.44:0/3510402025 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c500149e0 con 0x7f7c60153e60 2023-11-04T01:38:10.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.501+0000 7f7c679f5640 1 -- 172.21.15.44:0/3510402025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6015b830 con 0x7f7c60153e60 2023-11-04T01:38:10.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.501+0000 7f7c679f5640 1 -- 172.21.15.44:0/3510402025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c601580b0 con 0x7f7c60153e60 2023-11-04T01:38:10.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.502+0000 7f7c679f5640 1 -- 172.21.15.44:0/3510402025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6015bd10 con 0x7f7c60153e60 2023-11-04T01:38:10.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.502+0000 7f7c5dffb640 1 -- 172.21.15.44:0/3510402025 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c50014b40 con 0x7f7c60153e60 2023-11-04T01:38:10.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.503+0000 7f7c5dffb640 1 --2- 172.21.15.44:0/3510402025 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c4c06ae70 0x7f7c4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.503+0000 7f7c5dffb640 1 -- 172.21.15.44:0/3510402025 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7c5008a150 con 0x7f7c60153e60 2023-11-04T01:38:10.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.503+0000 7f7c65791640 1 --2- 172.21.15.44:0/3510402025 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c4c06ae70 0x7f7c4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.504+0000 7f7c65791640 1 --2- 172.21.15.44:0/3510402025 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c4c06ae70 0x7f7c4c06d330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7c580016e0 tx=0x7f7c58009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:10.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.507+0000 7f7c5dffb640 1 -- 172.21.15.44:0/3510402025 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c50055010 con 0x7f7c60153e60 2023-11-04T01:38:10.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.719+0000 7f7c679f5640 1 -- 172.21.15.44:0/3510402025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7c60074290 con 0x7f7c60153e60 2023-11-04T01:38:10.721 INFO:tasks.ceph.mon.a.smithi044.stderr:2023-11-04T01:38:10.719+0000 7fd852594640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:38:10.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.721+0000 7f7c5dffb640 1 -- 172.21.15.44:0/3510402025 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7c50058630 con 0x7f7c60153e60 2023-11-04T01:38:10.723 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:38:10.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.723+0000 7f7c679f5640 1 -- 172.21.15.44:0/3510402025 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c4c06ae70 msgr2=0x7f7c4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.723+0000 7f7c679f5640 1 --2- 172.21.15.44:0/3510402025 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c4c06ae70 0x7f7c4c06d330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7c580016e0 tx=0x7f7c58009040 comp rx=0 tx=0).stop 2023-11-04T01:38:10.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.723+0000 7f7c679f5640 1 -- 172.21.15.44:0/3510402025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c60153e60 msgr2=0x7f7c600cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.723+0000 7f7c679f5640 1 --2- 172.21.15.44:0/3510402025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c60153e60 0x7f7c600cc190 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7c50007e40 tx=0x7f7c5000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.723+0000 7f7c679f5640 1 -- 172.21.15.44:0/3510402025 shutdown_connections 2023-11-04T01:38:10.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.724+0000 7f7c679f5640 1 --2- 172.21.15.44:0/3510402025 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c4c06ae70 0x7f7c4c06d330 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.724+0000 7f7c679f5640 1 --2- 172.21.15.44:0/3510402025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c60153e60 0x7f7c600cc190 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.724+0000 7f7c679f5640 1 --2- 172.21.15.44:0/3510402025 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c600cd6d0 0x7f7c601f2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.724+0000 7f7c679f5640 1 --2- 172.21.15.44:0/3510402025 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c600b4880 0x7f7c60157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.724+0000 7f7c679f5640 1 -- 172.21.15.44:0/3510402025 >> 172.21.15.44:0/3510402025 conn(0x7f7c600cf880 msgr2=0x7f7c600b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:10.727 INFO:tasks.ceph.mds.c.smithi044.stderr: -685> 2023-11-04T01:37:57.283+0000 7fb7ec1e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:38:10.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.724+0000 7f7c679f5640 1 -- 172.21.15.44:0/3510402025 shutdown_connections 2023-11-04T01:38:10.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.724+0000 7f7c679f5640 1 -- 172.21.15.44:0/3510402025 wait complete. 2023-11-04T01:38:10.738 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:38:10.750 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2023-11-04T01:38:10.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.844+0000 7f7579b65640 1 Processor -- start 2023-11-04T01:38:10.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.844+0000 7f7579b65640 1 -- start start 2023-11-04T01:38:10.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.844+0000 7f7579b65640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7574160430 0x7f75740b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.845+0000 7f7579b65640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f757406c3a0 0x7f75740cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.845+0000 7f7579b65640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75740b2fc0 con 0x7f75740b2b60 2023-11-04T01:38:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.845+0000 7f7579b65640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75740cb580 con 0x7f757406c3a0 2023-11-04T01:38:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.845+0000 7f7579b65640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757406c7d0 con 0x7f7574160430 2023-11-04T01:38:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.845+0000 7f7573fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f757406c3a0 0x7f75740cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.845+0000 7f7573fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f757406c3a0 0x7f75740cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50590/0 (socket says 172.21.15.44:50590) 2023-11-04T01:38:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.845+0000 7f7573fff640 1 -- 172.21.15.44:0/45453253 learned_addr learned my addr 172.21.15.44:0/45453253 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.845+0000 7f75737fe640 1 --2- 172.21.15.44:0/45453253 >> v2:172.21.15.204:3300/0 conn(0x7f7574160430 0x7f75740b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.845+0000 7f7573fff640 1 -- 172.21.15.44:0/45453253 >> v2:172.21.15.204:3300/0 conn(0x7f7574160430 msgr2=0x7f75740b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.845+0000 7f7573fff640 1 --2- 172.21.15.44:0/45453253 >> v2:172.21.15.204:3300/0 conn(0x7f7574160430 0x7f75740b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.845+0000 7f7573fff640 1 -- 172.21.15.44:0/45453253 >> v1:172.21.15.204:6789/0 conn(0x7f75740b2b60 legacy=0x7f757406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.845+0000 7f7573fff640 1 -- 172.21.15.44:0/45453253 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757406ca40 con 0x7f757406c3a0 2023-11-04T01:38:10.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.846+0000 7f7573fff640 1 --2- 172.21.15.44:0/45453253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757406c3a0 0x7f75740cbcb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f757406f6d0 tx=0x7f756c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2406107b04305cce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:10.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.846+0000 7f75727fc640 1 -- 172.21.15.44:0/45453253 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c02cb20 con 0x7f757406c3a0 2023-11-04T01:38:10.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.846+0000 7f75727fc640 1 -- 172.21.15.44:0/45453253 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c02cc80 con 0x7f757406c3a0 2023-11-04T01:38:10.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.846+0000 7f75727fc640 1 -- 172.21.15.44:0/45453253 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c0343f0 con 0x7f757406c3a0 2023-11-04T01:38:10.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.846+0000 7f7579b65640 1 -- 172.21.15.44:0/45453253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757406c3a0 msgr2=0x7f75740cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.846+0000 7f7579b65640 1 --2- 172.21.15.44:0/45453253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757406c3a0 0x7f75740cbcb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f757406f6d0 tx=0x7f756c02bf80 comp rx=0 tx=0).stop 2023-11-04T01:38:10.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.846+0000 7f7579b65640 1 -- 172.21.15.44:0/45453253 shutdown_connections 2023-11-04T01:38:10.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.846+0000 7f7579b65640 1 --2- 172.21.15.44:0/45453253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757406c3a0 0x7f75740cbcb0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.846+0000 7f7579b65640 1 --2- 172.21.15.44:0/45453253 >> v2:172.21.15.204:3300/0 conn(0x7f7574160430 0x7f75740b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.846+0000 7f7579b65640 1 -- 172.21.15.44:0/45453253 >> 172.21.15.44:0/45453253 conn(0x7f757406ea20 msgr2=0x7f757406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:10.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.846+0000 7f7579b65640 1 -- 172.21.15.44:0/45453253 shutdown_connections 2023-11-04T01:38:10.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.847+0000 7f7579b65640 1 -- 172.21.15.44:0/45453253 wait complete. 2023-11-04T01:38:10.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.848+0000 7f7579b65640 1 Processor -- start 2023-11-04T01:38:10.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.848+0000 7f7579b65640 1 -- start start 2023-11-04T01:38:10.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7579b65640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f757406c3a0 0x7f7574152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7579b65640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75740b2b60 0x7f75740c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7579b65640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7574160430 0x7f757415ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7579b65640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75740c8c80 con 0x7f7574160430 2023-11-04T01:38:10.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7579b65640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75740b3cd0 con 0x7f757406c3a0 2023-11-04T01:38:10.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7579b65640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7574152690 con 0x7f75740b2b60 2023-11-04T01:38:10.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7573fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7574160430 0x7f757415ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7573fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7574160430 0x7f757415ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50600/0 (socket says 172.21.15.44:50600) 2023-11-04T01:38:10.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7573fff640 1 -- 172.21.15.44:0/691112084 learned_addr learned my addr 172.21.15.44:0/691112084 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:10.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f75737fe640 1 --2- 172.21.15.44:0/691112084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f757406c3a0 0x7f7574152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7572ffd640 1 --2- 172.21.15.44:0/691112084 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75740b2b60 0x7f75740c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7573fff640 1 -- 172.21.15.44:0/691112084 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75740b2b60 msgr2=0x7f75740c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7573fff640 1 --2- 172.21.15.44:0/691112084 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75740b2b60 0x7f75740c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7573fff640 1 -- 172.21.15.44:0/691112084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f757406c3a0 msgr2=0x7f7574152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7573fff640 1 --2- 172.21.15.44:0/691112084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f757406c3a0 0x7f7574152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7573fff640 1 -- 172.21.15.44:0/691112084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c009b30 con 0x7f7574160430 2023-11-04T01:38:10.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7573fff640 1 --2- 172.21.15.44:0/691112084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7574160430 0x7f757415ea70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f756c009f40 tx=0x7f756c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:10.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f756bfff640 1 -- 172.21.15.44:0/691112084 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c007e70 con 0x7f7574160430 2023-11-04T01:38:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f756bfff640 1 -- 172.21.15.44:0/691112084 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c009510 con 0x7f7574160430 2023-11-04T01:38:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7579b65640 1 -- 172.21.15.44:0/691112084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75740c86c0 con 0x7f7574160430 2023-11-04T01:38:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f756bfff640 1 -- 172.21.15.44:0/691112084 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c03e690 con 0x7f7574160430 2023-11-04T01:38:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.849+0000 7f7579b65640 1 -- 172.21.15.44:0/691112084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75740b3960 con 0x7f7574160430 2023-11-04T01:38:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.850+0000 7f7579b65640 1 -- 172.21.15.44:0/691112084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75740b37c0 con 0x7f7574160430 2023-11-04T01:38:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.851+0000 7f756bfff640 1 -- 172.21.15.44:0/691112084 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f756c03e7f0 con 0x7f7574160430 2023-11-04T01:38:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.851+0000 7f756bfff640 1 --2- 172.21.15.44:0/691112084 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f755406ae70 0x7f755406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.851+0000 7f756bfff640 1 -- 172.21.15.44:0/691112084 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f756c0ac370 con 0x7f7574160430 2023-11-04T01:38:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.851+0000 7f75737fe640 1 --2- 172.21.15.44:0/691112084 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f755406ae70 0x7f755406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.852+0000 7f75737fe640 1 --2- 172.21.15.44:0/691112084 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f755406ae70 0x7f755406d330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f75740c75c0 tx=0x7f755c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:10.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:10.855+0000 7f756bfff640 1 -- 172.21.15.44:0/691112084 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f75740b37c0 con 0x7f7574160430 2023-11-04T01:38:11.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.068+0000 7f7579b65640 1 -- 172.21.15.44:0/691112084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f75740b37c0 con 0x7f7574160430 2023-11-04T01:38:11.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.722+0000 7f756bfff640 1 -- 172.21.15.44:0/691112084 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f75740b37c0 con 0x7f7574160430 2023-11-04T01:38:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.725+0000 7f7579b65640 1 -- 172.21.15.44:0/691112084 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f755406ae70 msgr2=0x7f755406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.725+0000 7f7579b65640 1 --2- 172.21.15.44:0/691112084 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f755406ae70 0x7f755406d330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f75740c75c0 tx=0x7f755c008040 comp rx=0 tx=0).stop 2023-11-04T01:38:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.725+0000 7f7579b65640 1 -- 172.21.15.44:0/691112084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7574160430 msgr2=0x7f757415ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.725+0000 7f7579b65640 1 --2- 172.21.15.44:0/691112084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7574160430 0x7f757415ea70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f756c009f40 tx=0x7f756c004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.725+0000 7f7579b65640 1 -- 172.21.15.44:0/691112084 shutdown_connections 2023-11-04T01:38:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.725+0000 7f7579b65640 1 --2- 172.21.15.44:0/691112084 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f755406ae70 0x7f755406d330 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.725+0000 7f7579b65640 1 --2- 172.21.15.44:0/691112084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7574160430 0x7f757415ea70 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.725+0000 7f7579b65640 1 --2- 172.21.15.44:0/691112084 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75740b2b60 0x7f75740c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.725+0000 7f7579b65640 1 --2- 172.21.15.44:0/691112084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f757406c3a0 0x7f7574152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.725+0000 7f7579b65640 1 -- 172.21.15.44:0/691112084 >> 172.21.15.44:0/691112084 conn(0x7f757406ea20 msgr2=0x7f75740b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:11.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.725+0000 7f7579b65640 1 -- 172.21.15.44:0/691112084 shutdown_connections 2023-11-04T01:38:11.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.725+0000 7f7579b65640 1 -- 172.21.15.44:0/691112084 wait complete. 2023-11-04T01:38:11.739 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:38:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.889+0000 7fd62279e640 1 Processor -- start 2023-11-04T01:38:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.889+0000 7fd62279e640 1 -- start start 2023-11-04T01:38:11.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.890+0000 7fd62279e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd61c15f510 0x7fd61c0cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.890+0000 7fd62279e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd61c06dd50 0x7fd61c0cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.890+0000 7fd62279e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61c0cbbd0 con 0x7fd61c151ea0 2023-11-04T01:38:11.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.890+0000 7fd62279e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61c15c0d0 con 0x7fd61c06dd50 2023-11-04T01:38:11.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.890+0000 7fd62279e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61c06cf90 con 0x7fd61c15f510 2023-11-04T01:38:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.890+0000 7fd620d3b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd61c06dd50 0x7fd61c0cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.890+0000 7fd620d3b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd61c06dd50 0x7fd61c0cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50604/0 (socket says 172.21.15.44:50604) 2023-11-04T01:38:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.890+0000 7fd620d3b640 1 -- 172.21.15.44:0/4166231281 learned_addr learned my addr 172.21.15.44:0/4166231281 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.890+0000 7fd61b7fe640 1 --2- 172.21.15.44:0/4166231281 >> v2:172.21.15.204:3300/0 conn(0x7fd61c15f510 0x7fd61c0cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.890+0000 7fd620d3b640 1 -- 172.21.15.44:0/4166231281 >> v2:172.21.15.204:3300/0 conn(0x7fd61c15f510 msgr2=0x7fd61c0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.890+0000 7fd620d3b640 1 --2- 172.21.15.44:0/4166231281 >> v2:172.21.15.204:3300/0 conn(0x7fd61c15f510 0x7fd61c0cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.890+0000 7fd620d3b640 1 -- 172.21.15.44:0/4166231281 >> v1:172.21.15.204:6789/0 conn(0x7fd61c151ea0 legacy=0x7fd61c15b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.890+0000 7fd620d3b640 1 -- 172.21.15.44:0/4166231281 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c06d270 con 0x7fd61c06dd50 2023-11-04T01:38:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.891+0000 7fd620d3b640 1 --2- 172.21.15.44:0/4166231281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c06dd50 0x7fd61c0cb690 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0b1370 tx=0x7fd61402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48606d3843c48b06 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.891+0000 7fd61affd640 1 -- 172.21.15.44:0/4166231281 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61402ca80 con 0x7fd61c06dd50 2023-11-04T01:38:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.891+0000 7fd61affd640 1 -- 172.21.15.44:0/4166231281 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61402cbe0 con 0x7fd61c06dd50 2023-11-04T01:38:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.891+0000 7fd61affd640 1 -- 172.21.15.44:0/4166231281 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6140343f0 con 0x7fd61c06dd50 2023-11-04T01:38:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.892+0000 7fd62279e640 1 -- 172.21.15.44:0/4166231281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c06dd50 msgr2=0x7fd61c0cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.892+0000 7fd62279e640 1 --2- 172.21.15.44:0/4166231281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c06dd50 0x7fd61c0cb690 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0b1370 tx=0x7fd61402bee0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.892+0000 7fd62279e640 1 -- 172.21.15.44:0/4166231281 shutdown_connections 2023-11-04T01:38:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.892+0000 7fd62279e640 1 --2- 172.21.15.44:0/4166231281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c06dd50 0x7fd61c0cb690 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.892+0000 7fd62279e640 1 --2- 172.21.15.44:0/4166231281 >> v2:172.21.15.204:3300/0 conn(0x7fd61c15f510 0x7fd61c0cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.892+0000 7fd62279e640 1 -- 172.21.15.44:0/4166231281 >> 172.21.15.44:0/4166231281 conn(0x7fd61c0b05d0 msgr2=0x7fd61c0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.892+0000 7fd62279e640 1 -- 172.21.15.44:0/4166231281 shutdown_connections 2023-11-04T01:38:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.892+0000 7fd62279e640 1 -- 172.21.15.44:0/4166231281 wait complete. 2023-11-04T01:38:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.893+0000 7fd62279e640 1 Processor -- start 2023-11-04T01:38:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.893+0000 7fd62279e640 1 -- start start 2023-11-04T01:38:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd62279e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd61c06dd50 0x7fd61c149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd62279e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd61c151ea0 0x7fd61c0b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd62279e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c15f510 0x7fd61c1f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd62279e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c154940 con 0x7fd61c15f510 2023-11-04T01:38:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd62279e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c1540a0 con 0x7fd61c06dd50 2023-11-04T01:38:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd62279e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c154380 con 0x7fd61c151ea0 2023-11-04T01:38:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd620d3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c15f510 0x7fd61c1f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd620d3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c15f510 0x7fd61c1f4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50606/0 (socket says 172.21.15.44:50606) 2023-11-04T01:38:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd620d3b640 1 -- 172.21.15.44:0/1299927803 learned_addr learned my addr 172.21.15.44:0/1299927803 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd61b7fe640 1 --2- 172.21.15.44:0/1299927803 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd61c151ea0 0x7fd61c0b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd61bfff640 1 --2- 172.21.15.44:0/1299927803 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd61c06dd50 0x7fd61c149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd620d3b640 1 -- 172.21.15.44:0/1299927803 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd61c151ea0 msgr2=0x7fd61c0b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd620d3b640 1 --2- 172.21.15.44:0/1299927803 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd61c151ea0 0x7fd61c0b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd620d3b640 1 -- 172.21.15.44:0/1299927803 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd61c06dd50 msgr2=0x7fd61c149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd620d3b640 1 --2- 172.21.15.44:0/1299927803 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd61c06dd50 0x7fd61c149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.894+0000 7fd620d3b640 1 -- 172.21.15.44:0/1299927803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd614009b30 con 0x7fd61c15f510 2023-11-04T01:38:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.895+0000 7fd620d3b640 1 --2- 172.21.15.44:0/1299927803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c15f510 0x7fd61c1f4340 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd614036040 tx=0x7fd614004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.895+0000 7fd618ff9640 1 -- 172.21.15.44:0/1299927803 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61403e450 con 0x7fd61c15f510 2023-11-04T01:38:11.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.895+0000 7fd618ff9640 1 -- 172.21.15.44:0/1299927803 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61403e5d0 con 0x7fd61c15f510 2023-11-04T01:38:11.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.895+0000 7fd62279e640 1 -- 172.21.15.44:0/1299927803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61c154660 con 0x7fd61c15f510 2023-11-04T01:38:11.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.895+0000 7fd618ff9640 1 -- 172.21.15.44:0/1299927803 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61403e980 con 0x7fd61c15f510 2023-11-04T01:38:11.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.895+0000 7fd62279e640 1 -- 172.21.15.44:0/1299927803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61c149960 con 0x7fd61c15f510 2023-11-04T01:38:11.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.896+0000 7fd62279e640 1 -- 172.21.15.44:0/1299927803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61c1525f0 con 0x7fd61c15f510 2023-11-04T01:38:11.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.896+0000 7fd618ff9640 1 -- 172.21.15.44:0/1299927803 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd61402cd50 con 0x7fd61c15f510 2023-11-04T01:38:11.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.897+0000 7fd618ff9640 1 --2- 172.21.15.44:0/1299927803 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd60806ae70 0x7fd60806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.897+0000 7fd618ff9640 1 -- 172.21.15.44:0/1299927803 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fd6140ac430 con 0x7fd61c15f510 2023-11-04T01:38:11.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.897+0000 7fd61bfff640 1 --2- 172.21.15.44:0/1299927803 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd60806ae70 0x7fd60806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.897+0000 7fd61bfff640 1 --2- 172.21.15.44:0/1299927803 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd60806ae70 0x7fd60806d330 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd61c1f5420 tx=0x7fd610009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:11.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:11.901+0000 7fd618ff9640 1 -- 172.21.15.44:0/1299927803 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd61c1525f0 con 0x7fd61c15f510 2023-11-04T01:38:12.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.077+0000 7fd62279e640 1 -- 172.21.15.44:0/1299927803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd61c1525f0 con 0x7fd61c15f510 2023-11-04T01:38:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.724+0000 7fd618ff9640 1 -- 172.21.15.44:0/1299927803 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd61c1525f0 con 0x7fd61c15f510 2023-11-04T01:38:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:38:12.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.728+0000 7fd62279e640 1 -- 172.21.15.44:0/1299927803 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd60806ae70 msgr2=0x7fd60806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.728+0000 7fd62279e640 1 --2- 172.21.15.44:0/1299927803 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd60806ae70 0x7fd60806d330 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd61c1f5420 tx=0x7fd610009040 comp rx=0 tx=0).stop 2023-11-04T01:38:12.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.728+0000 7fd62279e640 1 -- 172.21.15.44:0/1299927803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c15f510 msgr2=0x7fd61c1f4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.728+0000 7fd62279e640 1 --2- 172.21.15.44:0/1299927803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c15f510 0x7fd61c1f4340 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd614036040 tx=0x7fd614004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:12.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.728+0000 7fd62279e640 1 -- 172.21.15.44:0/1299927803 shutdown_connections 2023-11-04T01:38:12.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.728+0000 7fd62279e640 1 --2- 172.21.15.44:0/1299927803 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd60806ae70 0x7fd60806d330 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.728+0000 7fd62279e640 1 --2- 172.21.15.44:0/1299927803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c15f510 0x7fd61c1f4340 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.728+0000 7fd62279e640 1 --2- 172.21.15.44:0/1299927803 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd61c151ea0 0x7fd61c0b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.728+0000 7fd62279e640 1 --2- 172.21.15.44:0/1299927803 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd61c06dd50 0x7fd61c149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.728+0000 7fd62279e640 1 -- 172.21.15.44:0/1299927803 >> 172.21.15.44:0/1299927803 conn(0x7fd61c0b05d0 msgr2=0x7fd61c0ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:12.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.728+0000 7fd62279e640 1 -- 172.21.15.44:0/1299927803 shutdown_connections 2023-11-04T01:38:12.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.728+0000 7fd62279e640 1 -- 172.21.15.44:0/1299927803 wait complete. 2023-11-04T01:38:12.744 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:38:12.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.858+0000 7f73ee21f640 1 Processor -- start 2023-11-04T01:38:12.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.858+0000 7f73ee21f640 1 -- start start 2023-11-04T01:38:12.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.859+0000 7f73ee21f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f73e815e650 0x7f73e80cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.859+0000 7f73ee21f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73e80afc00 0x7f73e80b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.859+0000 7f73ee21f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e80ceb70 con 0x7f73e80d1ab0 2023-11-04T01:38:12.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.859+0000 7f73ee21f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e80b2820 con 0x7f73e815e650 2023-11-04T01:38:12.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.859+0000 7f73ee21f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80cfd70 con 0x7f73e80afc00 2023-11-04T01:38:12.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.859+0000 7f73e77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f73e815e650 0x7f73e80cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.859+0000 7f73e77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f73e815e650 0x7f73e80cf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43888/0 (socket says 172.21.15.44:43888) 2023-11-04T01:38:12.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.860+0000 7f73e77fe640 1 -- 172.21.15.44:0/1397241837 learned_addr learned my addr 172.21.15.44:0/1397241837 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:12.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.860+0000 7f73e6ffd640 1 --2- 172.21.15.44:0/1397241837 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73e80afc00 0x7f73e80b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.860+0000 7f73e77fe640 1 -- 172.21.15.44:0/1397241837 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73e80afc00 msgr2=0x7f73e80b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.860+0000 7f73e77fe640 1 --2- 172.21.15.44:0/1397241837 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73e80afc00 0x7f73e80b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.860+0000 7f73e77fe640 1 -- 172.21.15.44:0/1397241837 >> v1:172.21.15.204:6789/0 conn(0x7f73e80d1ab0 legacy=0x7f73e80ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.860+0000 7f73e77fe640 1 -- 172.21.15.44:0/1397241837 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e80b2260 con 0x7f73e815e650 2023-11-04T01:38:12.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.861+0000 7f73e77fe640 1 --2- 172.21.15.44:0/1397241837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73e815e650 0x7f73e80cf830 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009870 tx=0x7f73d802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c352dd515d37c541 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.861+0000 7f73e67fc640 1 -- 172.21.15.44:0/1397241837 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d8031640 con 0x7f73e815e650 2023-11-04T01:38:12.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.861+0000 7f73e67fc640 1 -- 172.21.15.44:0/1397241837 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d80317a0 con 0x7f73e815e650 2023-11-04T01:38:12.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.861+0000 7f73e67fc640 1 -- 172.21.15.44:0/1397241837 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d8031b30 con 0x7f73e815e650 2023-11-04T01:38:12.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.861+0000 7f73ee21f640 1 -- 172.21.15.44:0/1397241837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73e815e650 msgr2=0x7f73e80cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.861+0000 7f73ee21f640 1 --2- 172.21.15.44:0/1397241837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73e815e650 0x7f73e80cf830 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009870 tx=0x7f73d802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.861+0000 7f73ee21f640 1 -- 172.21.15.44:0/1397241837 shutdown_connections 2023-11-04T01:38:12.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.861+0000 7f73ee21f640 1 --2- 172.21.15.44:0/1397241837 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73e80afc00 0x7f73e80b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.861+0000 7f73ee21f640 1 --2- 172.21.15.44:0/1397241837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73e815e650 0x7f73e80cf830 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.861+0000 7f73ee21f640 1 -- 172.21.15.44:0/1397241837 >> 172.21.15.44:0/1397241837 conn(0x7f73e809a140 msgr2=0x7f73e80d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:12.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.861+0000 7f73ee21f640 1 -- 172.21.15.44:0/1397241837 shutdown_connections 2023-11-04T01:38:12.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.861+0000 7f73ee21f640 1 -- 172.21.15.44:0/1397241837 wait complete. 2023-11-04T01:38:12.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.862+0000 7f73ee21f640 1 Processor -- start 2023-11-04T01:38:12.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.863+0000 7f73ee21f640 1 -- start start 2023-11-04T01:38:12.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.863+0000 7f73ee21f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73e80afc00 0x7f73e80ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.863+0000 7f73ee21f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73e80d1ab0 0x7f73e80c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.863+0000 7f73ee21f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73e815e650 0x7f73e806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.863+0000 7f73ee21f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e806c5e0 con 0x7f73e80d1ab0 2023-11-04T01:38:12.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.863+0000 7f73ee21f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8152910 con 0x7f73e815e650 2023-11-04T01:38:12.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.863+0000 7f73ee21f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80cada0 con 0x7f73e80afc00 2023-11-04T01:38:12.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.863+0000 7f73e6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73e80d1ab0 0x7f73e80c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.863+0000 7f73e6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73e80d1ab0 0x7f73e80c69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43890/0 (socket says 172.21.15.44:43890) 2023-11-04T01:38:12.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.863+0000 7f73e6ffd640 1 -- 172.21.15.44:0/359750923 learned_addr learned my addr 172.21.15.44:0/359750923 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:12.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.864+0000 7f73e7fff640 1 --2- 172.21.15.44:0/359750923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73e815e650 0x7f73e806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.864+0000 7f73e77fe640 1 --2- 172.21.15.44:0/359750923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73e80afc00 0x7f73e80ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.864+0000 7f73e6ffd640 1 -- 172.21.15.44:0/359750923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73e80afc00 msgr2=0x7f73e80ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.864+0000 7f73e6ffd640 1 --2- 172.21.15.44:0/359750923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73e80afc00 0x7f73e80ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.864+0000 7f73e6ffd640 1 -- 172.21.15.44:0/359750923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73e815e650 msgr2=0x7f73e806ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.864+0000 7f73e6ffd640 1 --2- 172.21.15.44:0/359750923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73e815e650 0x7f73e806ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.864+0000 7f73e6ffd640 1 -- 172.21.15.44:0/359750923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d80094d0 con 0x7f73e80d1ab0 2023-11-04T01:38:12.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.864+0000 7f73e6ffd640 1 --2- 172.21.15.44:0/359750923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73e80d1ab0 0x7f73e80c69f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f73dc00d620 tx=0x7f73dc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.864+0000 7f73cffff640 1 -- 172.21.15.44:0/359750923 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc00b620 con 0x7f73e80d1ab0 2023-11-04T01:38:12.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.864+0000 7f73cffff640 1 -- 172.21.15.44:0/359750923 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc00b780 con 0x7f73e80d1ab0 2023-11-04T01:38:12.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.864+0000 7f73ee21f640 1 -- 172.21.15.44:0/359750923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e806b960 con 0x7f73e80d1ab0 2023-11-04T01:38:12.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.864+0000 7f73cffff640 1 -- 172.21.15.44:0/359750923 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc00bb30 con 0x7f73e80d1ab0 2023-11-04T01:38:12.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.864+0000 7f73ee21f640 1 -- 172.21.15.44:0/359750923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e806bf20 con 0x7f73e80d1ab0 2023-11-04T01:38:12.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.865+0000 7f73ee21f640 1 -- 172.21.15.44:0/359750923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e806c850 con 0x7f73e80d1ab0 2023-11-04T01:38:12.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.866+0000 7f73cffff640 1 -- 172.21.15.44:0/359750923 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73dc00bc90 con 0x7f73e80d1ab0 2023-11-04T01:38:12.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.866+0000 7f73cffff640 1 --2- 172.21.15.44:0/359750923 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f73d406ae70 0x7f73d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.866+0000 7f73cffff640 1 -- 172.21.15.44:0/359750923 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6030+0+0 (secure 0 0 0) 0x7f73dc089a40 con 0x7f73e80d1ab0 2023-11-04T01:38:12.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.866+0000 7f73e77fe640 1 --2- 172.21.15.44:0/359750923 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f73d406ae70 0x7f73d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.867+0000 7f73e77fe640 1 --2- 172.21.15.44:0/359750923 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f73d406ae70 0x7f73d406d330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f73d8036000 tx=0x7f73d803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:12.871+0000 7f73cffff640 1 -- 172.21.15.44:0/359750923 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73dc08be60 con 0x7f73e80d1ab0 2023-11-04T01:38:13.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.053+0000 7f73ee21f640 1 -- 172.21.15.44:0/359750923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f73e80674e0 con 0x7f73e80d1ab0 2023-11-04T01:38:13.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.726+0000 7f73cffff640 1 -- 172.21.15.44:0/359750923 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) v1 ==== 169+0+0 (secure 0 0 0) 0x7f73dc054af0 con 0x7f73e80d1ab0 2023-11-04T01:38:13.728 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2023-11-04T01:38:13.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.731+0000 7f73ee21f640 1 -- 172.21.15.44:0/359750923 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f73d406ae70 msgr2=0x7f73d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.731+0000 7f73ee21f640 1 --2- 172.21.15.44:0/359750923 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f73d406ae70 0x7f73d406d330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f73d8036000 tx=0x7f73d803c040 comp rx=0 tx=0).stop 2023-11-04T01:38:13.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.731+0000 7f73ee21f640 1 -- 172.21.15.44:0/359750923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73e80d1ab0 msgr2=0x7f73e80c69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.731+0000 7f73ee21f640 1 --2- 172.21.15.44:0/359750923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73e80d1ab0 0x7f73e80c69f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f73dc00d620 tx=0x7f73dc00dae0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.732+0000 7f73ee21f640 1 -- 172.21.15.44:0/359750923 shutdown_connections 2023-11-04T01:38:13.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.732+0000 7f73ee21f640 1 --2- 172.21.15.44:0/359750923 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f73d406ae70 0x7f73d406d330 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.732+0000 7f73ee21f640 1 --2- 172.21.15.44:0/359750923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73e815e650 0x7f73e806ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.732+0000 7f73ee21f640 1 --2- 172.21.15.44:0/359750923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73e80d1ab0 0x7f73e80c69f0 secure :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f73dc00d620 tx=0x7f73dc00dae0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.732+0000 7f73ee21f640 1 --2- 172.21.15.44:0/359750923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73e80afc00 0x7f73e80ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.732+0000 7f73ee21f640 1 -- 172.21.15.44:0/359750923 >> 172.21.15.44:0/359750923 conn(0x7f73e809a140 msgr2=0x7f73e8154690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:13.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.733+0000 7f73ee21f640 1 -- 172.21.15.44:0/359750923 shutdown_connections 2023-11-04T01:38:13.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.733+0000 7f73ee21f640 1 -- 172.21.15.44:0/359750923 wait complete. 2023-11-04T01:38:13.751 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:38:13.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.863+0000 7f37dd21a640 1 Processor -- start 2023-11-04T01:38:13.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.863+0000 7f37dd21a640 1 -- start start 2023-11-04T01:38:13.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.864+0000 7f37dd21a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37d8153e60 0x7f37d815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.864+0000 7f37dd21a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f37d80cd6d0 0x7f37d8161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.864+0000 7f37dd21a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f37d80b4880 0x7f37d80b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.864+0000 7f37dd21a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d80cde60 con 0x7f37d80b4880 2023-11-04T01:38:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.864+0000 7f37dd21a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d8160f90 con 0x7f37d80cd6d0 2023-11-04T01:38:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.864+0000 7f37dd21a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d80b5200 con 0x7f37d8153e60 2023-11-04T01:38:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.864+0000 7f37d759e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f37d80b4880 0x7f37d80b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.864+0000 7f37d759e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f37d80b4880 0x7f37d80b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43896/0 (socket says 172.21.15.44:43896) 2023-11-04T01:38:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.864+0000 7f37d759e640 1 -- 172.21.15.44:0/923974132 learned_addr learned my addr 172.21.15.44:0/923974132 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.864+0000 7f37d659c640 1 --2- 172.21.15.44:0/923974132 >> v2:172.21.15.204:3300/0 conn(0x7f37d80cd6d0 0x7f37d8161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.864+0000 7f37d6d9d640 1 --2- 172.21.15.44:0/923974132 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37d8153e60 0x7f37d815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.865+0000 7f37d759e640 1 -- 172.21.15.44:0/923974132 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37d8153e60 msgr2=0x7f37d815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.865+0000 7f37d759e640 1 --2- 172.21.15.44:0/923974132 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37d8153e60 0x7f37d815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.865+0000 7f37d759e640 1 -- 172.21.15.44:0/923974132 >> v2:172.21.15.204:3300/0 conn(0x7f37d80cd6d0 msgr2=0x7f37d8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:13.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.865+0000 7f37d759e640 1 --2- 172.21.15.44:0/923974132 >> v2:172.21.15.204:3300/0 conn(0x7f37d80cd6d0 0x7f37d8161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.865+0000 7f37d759e640 1 -- 172.21.15.44:0/923974132 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d815e400 con 0x7f37d80b4880 2023-11-04T01:38:13.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.865+0000 7f37d659c640 1 --2- 172.21.15.44:0/923974132 >> v2:172.21.15.204:3300/0 conn(0x7f37d80cd6d0 0x7f37d8161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:13.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.865+0000 7f37d6d9d640 1 --2- 172.21.15.44:0/923974132 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37d8153e60 0x7f37d815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:13.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.865+0000 7f37d759e640 1 --2- 172.21.15.44:0/923974132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d80b4880 0x7f37d80b4cc0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f37d806c930 tx=0x7f37c802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7395c11d0b5a2ee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:13.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.866+0000 7f37d5d9b640 1 -- 172.21.15.44:0/923974132 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c8031870 con 0x7f37d80b4880 2023-11-04T01:38:13.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.866+0000 7f37d5d9b640 1 -- 172.21.15.44:0/923974132 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c80319d0 con 0x7f37d80b4880 2023-11-04T01:38:13.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.866+0000 7f37d5d9b640 1 -- 172.21.15.44:0/923974132 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c8031d60 con 0x7f37d80b4880 2023-11-04T01:38:13.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.866+0000 7f37dd21a640 1 -- 172.21.15.44:0/923974132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d80b4880 msgr2=0x7f37d80b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.866+0000 7f37dd21a640 1 --2- 172.21.15.44:0/923974132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d80b4880 0x7f37d80b4cc0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f37d806c930 tx=0x7f37c802b910 comp rx=0 tx=0).stop 2023-11-04T01:38:13.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.866+0000 7f37dd21a640 1 -- 172.21.15.44:0/923974132 shutdown_connections 2023-11-04T01:38:13.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.866+0000 7f37dd21a640 1 --2- 172.21.15.44:0/923974132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d80b4880 0x7f37d80b4cc0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.866+0000 7f37dd21a640 1 --2- 172.21.15.44:0/923974132 >> v2:172.21.15.204:3300/0 conn(0x7f37d80cd6d0 0x7f37d8161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.866+0000 7f37dd21a640 1 --2- 172.21.15.44:0/923974132 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37d8153e60 0x7f37d815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.866+0000 7f37dd21a640 1 -- 172.21.15.44:0/923974132 >> 172.21.15.44:0/923974132 conn(0x7f37d80cf880 msgr2=0x7f37d80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:13.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.866+0000 7f37dd21a640 1 -- 172.21.15.44:0/923974132 shutdown_connections 2023-11-04T01:38:13.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.866+0000 7f37dd21a640 1 -- 172.21.15.44:0/923974132 wait complete. 2023-11-04T01:38:13.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.868+0000 7f37dd21a640 1 Processor -- start 2023-11-04T01:38:13.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.868+0000 7f37dd21a640 1 -- start start 2023-11-04T01:38:13.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.868+0000 7f37dd21a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d80b4880 0x7f37d8154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.868+0000 7f37dd21a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37d80cd6d0 0x7f37d80c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.868+0000 7f37dd21a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37d8153e60 0x7f37d8144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.868+0000 7f37dd21a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d8143680 con 0x7f37d80b4880 2023-11-04T01:38:13.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.868+0000 7f37dd21a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d80c68f0 con 0x7f37d80cd6d0 2023-11-04T01:38:13.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.868+0000 7f37dd21a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d8154780 con 0x7f37d8153e60 2023-11-04T01:38:13.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37d6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d80b4880 0x7f37d8154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37d6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d80b4880 0x7f37d8154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43900/0 (socket says 172.21.15.44:43900) 2023-11-04T01:38:13.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37d6d9d640 1 -- 172.21.15.44:0/426330307 learned_addr learned my addr 172.21.15.44:0/426330307 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:13.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37d759e640 1 --2- 172.21.15.44:0/426330307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37d8153e60 0x7f37d8144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37d659c640 1 --2- 172.21.15.44:0/426330307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37d80cd6d0 0x7f37d80c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37d6d9d640 1 -- 172.21.15.44:0/426330307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37d8153e60 msgr2=0x7f37d8144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37d6d9d640 1 --2- 172.21.15.44:0/426330307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37d8153e60 0x7f37d8144eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37d6d9d640 1 -- 172.21.15.44:0/426330307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37d80cd6d0 msgr2=0x7f37d80c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37d6d9d640 1 --2- 172.21.15.44:0/426330307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37d80cd6d0 0x7f37d80c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37d6d9d640 1 -- 172.21.15.44:0/426330307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c80094d0 con 0x7f37d80b4880 2023-11-04T01:38:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37d6d9d640 1 --2- 172.21.15.44:0/426330307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d80b4880 0x7f37d8154240 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f37d0007f20 tx=0x7f37d000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37cf7fe640 1 -- 172.21.15.44:0/426330307 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000dee0 con 0x7f37d80b4880 2023-11-04T01:38:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37cf7fe640 1 -- 172.21.15.44:0/426330307 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d000f040 con 0x7f37d80b4880 2023-11-04T01:38:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37cf7fe640 1 -- 172.21.15.44:0/426330307 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d0003db0 con 0x7f37d80b4880 2023-11-04T01:38:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37dd21a640 1 -- 172.21.15.44:0/426330307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d80c9590 con 0x7f37d80b4880 2023-11-04T01:38:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.869+0000 7f37dd21a640 1 -- 172.21.15.44:0/426330307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d81432a0 con 0x7f37d80b4880 2023-11-04T01:38:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.870+0000 7f37dd21a640 1 -- 172.21.15.44:0/426330307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d8142e20 con 0x7f37d80b4880 2023-11-04T01:38:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.871+0000 7f37cf7fe640 1 -- 172.21.15.44:0/426330307 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f37d0004030 con 0x7f37d80b4880 2023-11-04T01:38:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.871+0000 7f37cf7fe640 1 --2- 172.21.15.44:0/426330307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f37b806ae70 0x7f37b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.871+0000 7f37cf7fe640 1 -- 172.21.15.44:0/426330307 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f37d00896d0 con 0x7f37d80b4880 2023-11-04T01:38:13.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.871+0000 7f37d659c640 1 --2- 172.21.15.44:0/426330307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f37b806ae70 0x7f37b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.872+0000 7f37d659c640 1 --2- 172.21.15.44:0/426330307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f37b806ae70 0x7f37b806d330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f37c0006fd0 tx=0x7f37c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:13.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:13.876+0000 7f37cf7fe640 1 -- 172.21.15.44:0/426330307 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f37d8142e20 con 0x7f37d80b4880 2023-11-04T01:38:14.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.055+0000 7f37dd21a640 1 -- 172.21.15.44:0/426330307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f37d8142e20 con 0x7f37d80b4880 2023-11-04T01:38:14.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.058+0000 7f37cf7fe640 1 -- 172.21.15.44:0/426330307 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f37d8142e20 con 0x7f37d80b4880 2023-11-04T01:38:14.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.060+0000 7f37dd21a640 1 -- 172.21.15.44:0/426330307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f37b806ae70 msgr2=0x7f37b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.060+0000 7f37dd21a640 1 --2- 172.21.15.44:0/426330307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f37b806ae70 0x7f37b806d330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f37c0006fd0 tx=0x7f37c0008040 comp rx=0 tx=0).stop 2023-11-04T01:38:14.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.060+0000 7f37dd21a640 1 -- 172.21.15.44:0/426330307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d80b4880 msgr2=0x7f37d8154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.060+0000 7f37dd21a640 1 --2- 172.21.15.44:0/426330307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d80b4880 0x7f37d8154240 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f37d0007f20 tx=0x7f37d000d560 comp rx=0 tx=0).stop 2023-11-04T01:38:14.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.060+0000 7f37dd21a640 1 -- 172.21.15.44:0/426330307 shutdown_connections 2023-11-04T01:38:14.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.060+0000 7f37dd21a640 1 --2- 172.21.15.44:0/426330307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f37b806ae70 0x7f37b806d330 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.060+0000 7f37dd21a640 1 --2- 172.21.15.44:0/426330307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37d8153e60 0x7f37d8144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.060+0000 7f37dd21a640 1 --2- 172.21.15.44:0/426330307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37d80cd6d0 0x7f37d80c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.060+0000 7f37dd21a640 1 --2- 172.21.15.44:0/426330307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d80b4880 0x7f37d8154240 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.060+0000 7f37dd21a640 1 -- 172.21.15.44:0/426330307 >> 172.21.15.44:0/426330307 conn(0x7f37d80cf880 msgr2=0x7f37d80cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:14.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.060+0000 7f37dd21a640 1 -- 172.21.15.44:0/426330307 shutdown_connections 2023-11-04T01:38:14.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.060+0000 7f37dd21a640 1 -- 172.21.15.44:0/426330307 wait complete. 2023-11-04T01:38:14.073 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-11-04T01:38:14.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.177+0000 7fe483bc0640 1 Processor -- start 2023-11-04T01:38:14.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.177+0000 7fe483bc0640 1 -- start start 2023-11-04T01:38:14.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.178+0000 7fe483bc0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe47c06cbb0 0x7fe47c0cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.178+0000 7fe483bc0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c0ccce0 con 0x7fe47c0b2db0 2023-11-04T01:38:14.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.178+0000 7fe483bc0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c0cbc40 con 0x7fe47c0cf9c0 2023-11-04T01:38:14.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.178+0000 7fe483bc0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47c0cbf20 con 0x7fe47c06cbb0 2023-11-04T01:38:14.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.178+0000 7fe48215d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe47c0b2db0 0x7fe47c06b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41302/0 (socket says 172.21.15.44:41302) 2023-11-04T01:38:14.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.178+0000 7fe48215d640 1 -- 172.21.15.44:0/110214863 learned_addr learned my addr 172.21.15.44:0/110214863 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:14.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.178+0000 7fe48195c640 1 --2- 172.21.15.44:0/110214863 >> v2:172.21.15.204:3300/0 conn(0x7fe47c06cbb0 0x7fe47c0cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.178+0000 7fe48095a640 1 -- 172.21.15.44:0/110214863 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300568327 0 0) 0x7fe47c0ccce0 con 0x7fe47c0b2db0 2023-11-04T01:38:14.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.178+0000 7fe48095a640 1 -- 172.21.15.44:0/110214863 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe468003520 con 0x7fe47c0b2db0 2023-11-04T01:38:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.178+0000 7fe48095a640 1 -- 172.21.15.44:0/110214863 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 459154471 0 0) 0x7fe468003520 con 0x7fe47c0b2db0 2023-11-04T01:38:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.178+0000 7fe48095a640 1 -- 172.21.15.44:0/110214863 >> v2:172.21.15.204:3300/0 conn(0x7fe47c06cbb0 msgr2=0x7fe47c0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.178+0000 7fe48095a640 1 --2- 172.21.15.44:0/110214863 >> v2:172.21.15.204:3300/0 conn(0x7fe47c06cbb0 0x7fe47c0cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.178+0000 7fe48095a640 1 -- 172.21.15.44:0/110214863 >> v1:172.21.15.204:6789/0 conn(0x7fe47c0cf9c0 legacy=0x7fe47c0b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.178+0000 7fe48095a640 1 -- 172.21.15.44:0/110214863 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c0cc200 con 0x7fe47c0b2db0 2023-11-04T01:38:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.178+0000 7fe48095a640 1 -- 172.21.15.44:0/110214863 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fe4740019f0 con 0x7fe47c0b2db0 2023-11-04T01:38:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48095a640 1 -- 172.21.15.44:0/110214863 >> v1:172.21.15.44:6789/0 conn(0x7fe47c0b2db0 legacy=0x7fe47c06b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48095a640 1 --2- 172.21.15.44:0/110214863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe468003970 0x7fe468003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48095a640 1 --2- 172.21.15.44:0/110214863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4680047c0 0x7fe468004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48095a640 1 --2- 172.21.15.44:0/110214863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe468005180 0x7fe46800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48095a640 1 -- 172.21.15.44:0/110214863 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0cbf20 con 0x7fe4680047c0 2023-11-04T01:38:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48095a640 1 -- 172.21.15.44:0/110214863 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46800c020 con 0x7fe468005180 2023-11-04T01:38:14.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48095a640 1 -- 172.21.15.44:0/110214863 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46800c1e0 con 0x7fe468003970 2023-11-04T01:38:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48115b640 1 --2- 172.21.15.44:0/110214863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4680047c0 0x7fe468004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48195c640 1 --2- 172.21.15.44:0/110214863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe468003970 0x7fe468003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48215d640 1 --2- 172.21.15.44:0/110214863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe468005180 0x7fe46800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48115b640 1 -- 172.21.15.44:0/110214863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe468003970 msgr2=0x7fe468003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48115b640 1 --2- 172.21.15.44:0/110214863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe468003970 0x7fe468003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48115b640 1 -- 172.21.15.44:0/110214863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe468005180 msgr2=0x7fe46800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48115b640 1 --2- 172.21.15.44:0/110214863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe468005180 0x7fe46800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48115b640 1 -- 172.21.15.44:0/110214863 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe468003520 con 0x7fe4680047c0 2023-11-04T01:38:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.179+0000 7fe48215d640 1 -- 172.21.15.44:0/110214863 reap_dead start 2023-11-04T01:38:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.180+0000 7fe48115b640 1 --2- 172.21.15.44:0/110214863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4680047c0 0x7fe468004c40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe46c001750 tx=0x7fe4680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c61be5358c42eb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.180+0000 7fe48095a640 1 -- 172.21.15.44:0/110214863 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0052d0 con 0x7fe4680047c0 2023-11-04T01:38:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.180+0000 7fe48095a640 1 -- 172.21.15.44:0/110214863 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c02e050 con 0x7fe4680047c0 2023-11-04T01:38:14.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.180+0000 7fe48095a640 1 -- 172.21.15.44:0/110214863 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c003830 con 0x7fe4680047c0 2023-11-04T01:38:14.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.180+0000 7fe483bc0640 1 -- 172.21.15.44:0/110214863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4680047c0 msgr2=0x7fe468004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.180+0000 7fe483bc0640 1 --2- 172.21.15.44:0/110214863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4680047c0 0x7fe468004c40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe46c001750 tx=0x7fe4680057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.180+0000 7fe483bc0640 1 -- 172.21.15.44:0/110214863 shutdown_connections 2023-11-04T01:38:14.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.181+0000 7fe483bc0640 1 --2- 172.21.15.44:0/110214863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4680047c0 0x7fe468004c40 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.181+0000 7fe483bc0640 1 -- 172.21.15.44:0/110214863 >> 172.21.15.44:0/110214863 conn(0x7fe47c0cd6a0 msgr2=0x7fe47c0cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:14.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.181+0000 7fe483bc0640 1 -- 172.21.15.44:0/110214863 shutdown_connections 2023-11-04T01:38:14.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.181+0000 7fe483bc0640 1 -- 172.21.15.44:0/110214863 wait complete. 2023-11-04T01:38:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.182+0000 7fe483bc0640 1 Processor -- start 2023-11-04T01:38:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.182+0000 7fe483bc0640 1 -- start start 2023-11-04T01:38:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe483bc0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4680047c0 0x7fe47c1f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe483bc0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe47c1554b0 0x7fe47c1507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe483bc0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe47c1559b0 0x7fe47c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe483bc0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c156f30 con 0x7fe4680047c0 2023-11-04T01:38:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe483bc0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c155f30 con 0x7fe47c1554b0 2023-11-04T01:38:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe483bc0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c1f70d0 con 0x7fe47c1559b0 2023-11-04T01:38:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe48195c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4680047c0 0x7fe47c1f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe48195c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4680047c0 0x7fe47c1f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43920/0 (socket says 172.21.15.44:43920) 2023-11-04T01:38:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe48195c640 1 -- 172.21.15.44:0/574126641 learned_addr learned my addr 172.21.15.44:0/574126641 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe48115b640 1 --2- 172.21.15.44:0/574126641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe47c1554b0 0x7fe47c1507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe48215d640 1 --2- 172.21.15.44:0/574126641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe47c1559b0 0x7fe47c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe48195c640 1 -- 172.21.15.44:0/574126641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe47c1559b0 msgr2=0x7fe47c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe48195c640 1 --2- 172.21.15.44:0/574126641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe47c1559b0 0x7fe47c0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe48195c640 1 -- 172.21.15.44:0/574126641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe47c1554b0 msgr2=0x7fe47c1507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe48195c640 1 --2- 172.21.15.44:0/574126641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe47c1554b0 0x7fe47c1507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe48195c640 1 -- 172.21.15.44:0/574126641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c1546f0 con 0x7fe4680047c0 2023-11-04T01:38:14.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe48195c640 1 --2- 172.21.15.44:0/574126641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4680047c0 0x7fe47c1f6b90 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe478011950 tx=0x7fe478011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.183+0000 7fe4727fc640 1 -- 172.21.15.44:0/574126641 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47800faf0 con 0x7fe4680047c0 2023-11-04T01:38:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.184+0000 7fe4727fc640 1 -- 172.21.15.44:0/574126641 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47800fc50 con 0x7fe4680047c0 2023-11-04T01:38:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.184+0000 7fe483bc0640 1 -- 172.21.15.44:0/574126641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47c1549d0 con 0x7fe4680047c0 2023-11-04T01:38:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.184+0000 7fe4727fc640 1 -- 172.21.15.44:0/574126641 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe478014440 con 0x7fe4680047c0 2023-11-04T01:38:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.184+0000 7fe483bc0640 1 -- 172.21.15.44:0/574126641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c154f90 con 0x7fe4680047c0 2023-11-04T01:38:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.185+0000 7fe483bc0640 1 -- 172.21.15.44:0/574126641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c074290 con 0x7fe4680047c0 2023-11-04T01:38:14.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.186+0000 7fe4727fc640 1 -- 172.21.15.44:0/574126641 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe47801d400 con 0x7fe4680047c0 2023-11-04T01:38:14.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.187+0000 7fe4727fc640 1 --2- 172.21.15.44:0/574126641 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe46006ae70 0x7fe46006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.187+0000 7fe4727fc640 1 -- 172.21.15.44:0/574126641 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe47808a390 con 0x7fe4680047c0 2023-11-04T01:38:14.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.187+0000 7fe48115b640 1 --2- 172.21.15.44:0/574126641 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe46006ae70 0x7fe46006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.188+0000 7fe48115b640 1 --2- 172.21.15.44:0/574126641 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe46006ae70 0x7fe46006d330 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe46c033000 tx=0x7fe46c009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.191+0000 7fe4727fc640 1 -- 172.21.15.44:0/574126641 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4780554a0 con 0x7fe4680047c0 2023-11-04T01:38:14.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.440+0000 7fe483bc0640 1 -- 172.21.15.44:0/574126641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7fe47c0cf7a0 con 0x7fe4680047c0 2023-11-04T01:38:14.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.735+0000 7fe4727fc640 1 -- 172.21.15.44:0/574126641 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v149) v1 ==== 178+0+0 (secure 0 0 0) 0x7fe478058ac0 con 0x7fe4680047c0 2023-11-04T01:38:14.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.737+0000 7fe483bc0640 1 -- 172.21.15.44:0/574126641 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe46006ae70 msgr2=0x7fe46006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.737+0000 7fe483bc0640 1 --2- 172.21.15.44:0/574126641 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe46006ae70 0x7fe46006d330 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe46c033000 tx=0x7fe46c009030 comp rx=0 tx=0).stop 2023-11-04T01:38:14.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.737+0000 7fe483bc0640 1 -- 172.21.15.44:0/574126641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4680047c0 msgr2=0x7fe47c1f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.737+0000 7fe483bc0640 1 --2- 172.21.15.44:0/574126641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4680047c0 0x7fe47c1f6b90 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe478011950 tx=0x7fe478011e10 comp rx=0 tx=0).stop 2023-11-04T01:38:14.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.737+0000 7fe483bc0640 1 -- 172.21.15.44:0/574126641 shutdown_connections 2023-11-04T01:38:14.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.737+0000 7fe483bc0640 1 --2- 172.21.15.44:0/574126641 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe46006ae70 0x7fe46006d330 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.737+0000 7fe483bc0640 1 --2- 172.21.15.44:0/574126641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe47c1559b0 0x7fe47c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.737+0000 7fe483bc0640 1 --2- 172.21.15.44:0/574126641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe47c1554b0 0x7fe47c1507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.737+0000 7fe483bc0640 1 --2- 172.21.15.44:0/574126641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4680047c0 0x7fe47c1f6b90 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.737+0000 7fe483bc0640 1 -- 172.21.15.44:0/574126641 >> 172.21.15.44:0/574126641 conn(0x7fe47c0cd6a0 msgr2=0x7fe47c15bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:14.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.737+0000 7fe483bc0640 1 -- 172.21.15.44:0/574126641 shutdown_connections 2023-11-04T01:38:14.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.737+0000 7fe483bc0640 1 -- 172.21.15.44:0/574126641 wait complete. 2023-11-04T01:38:14.751 INFO:tasks.cephfs_test_runner:Test that creation of monitor managed snaps fails for pools attached ... ok 2023-11-04T01:38:14.751 INFO:tasks.cephfs_test_runner:Starting test: test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that using a pool with snaps for fs creation fails 2023-11-04T01:38:14.751 INFO:tasks.cephfs_test_runner:test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:38:14.752 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:14.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.858+0000 7fece1607640 1 Processor -- start 2023-11-04T01:38:14.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.858+0000 7fece1607640 1 -- start start 2023-11-04T01:38:14.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.859+0000 7fece1607640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fecdc0b2c50 0x7fecdc06ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.859+0000 7fece1607640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecdc06c050 con 0x7fecdc0b2870 2023-11-04T01:38:14.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.859+0000 7fece1607640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecdc06c330 con 0x7fecdc0cd170 2023-11-04T01:38:14.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.859+0000 7fece1607640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc06ccd0 con 0x7fecdc0b2c50 2023-11-04T01:38:14.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.859+0000 7fecdaffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fecdc0b2870 0x7fecdc0cca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41316/0 (socket says 172.21.15.44:41316) 2023-11-04T01:38:14.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.859+0000 7fecdaffd640 1 -- 172.21.15.44:0/1489258451 learned_addr learned my addr 172.21.15.44:0/1489258451 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:14.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecdb7fe640 1 --2- 172.21.15.44:0/1489258451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fecdc0b2c50 0x7fecdc06ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510442141 0 0) 0x7fecdc06c050 con 0x7fecdc0b2870 2023-11-04T01:38:14.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc8003520 con 0x7fecdc0b2870 2023-11-04T01:38:14.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155985803 0 0) 0x7fecdc06c330 con 0x7fecdc0cd170 2023-11-04T01:38:14.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecdc06c050 con 0x7fecdc0cd170 2023-11-04T01:38:14.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3079179973 0 0) 0x7fecc8003520 con 0x7fecdc0b2870 2023-11-04T01:38:14.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fecdc0b2c50 msgr2=0x7fecdc06ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:14.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 --2- 172.21.15.44:0/1489258451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fecdc0b2c50 0x7fecdc06ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 >> v1:172.21.15.204:6789/0 conn(0x7fecdc0cd170 legacy=0x7fecdc15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc06c610 con 0x7fecdc0b2870 2023-11-04T01:38:14.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7feccc001b10 con 0x7fecdc0b2870 2023-11-04T01:38:14.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 >> v1:172.21.15.44:6789/0 conn(0x7fecdc0b2870 legacy=0x7fecdc0cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 --2- 172.21.15.44:0/1489258451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecc8003b30 0x7fecc8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 --2- 172.21.15.44:0/1489258451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fecdc0b2c50 0x7fecc80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 --2- 172.21.15.44:0/1489258451 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fecc8004d00 0x7fecc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc06ccd0 con 0x7fecc8003b30 2023-11-04T01:38:14.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc800bbc0 con 0x7fecc8004d00 2023-11-04T01:38:14.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc800bd80 con 0x7fecdc0b2c50 2023-11-04T01:38:14.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecdaffd640 1 --2- 172.21.15.44:0/1489258451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecc8003b30 0x7fecc8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecda7fc640 1 --2- 172.21.15.44:0/1489258451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fecdc0b2c50 0x7fecc80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecdb7fe640 1 --2- 172.21.15.44:0/1489258451 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fecc8004d00 0x7fecc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecdaffd640 1 -- 172.21.15.44:0/1489258451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fecdc0b2c50 msgr2=0x7fecc80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:14.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.860+0000 7fecdaffd640 1 --2- 172.21.15.44:0/1489258451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fecdc0b2c50 0x7fecc80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.861+0000 7fecdaffd640 1 -- 172.21.15.44:0/1489258451 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fecc8004d00 msgr2=0x7fecc8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:14.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.861+0000 7fecdaffd640 1 --2- 172.21.15.44:0/1489258451 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fecc8004d00 0x7fecc8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.861+0000 7fecdaffd640 1 -- 172.21.15.44:0/1489258451 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc8003520 con 0x7fecc8003b30 2023-11-04T01:38:14.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.861+0000 7fecdb7fe640 1 --2- 172.21.15.44:0/1489258451 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fecc8004d00 0x7fecc8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:14.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.861+0000 7fecdaffd640 1 --2- 172.21.15.44:0/1489258451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecc8003b30 0x7fecc8003f30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7feccc00c490 tx=0x7fecc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c165c935fd66227a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.861+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc005d20 con 0x7fecc8003b30 2023-11-04T01:38:14.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.861+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc005e80 con 0x7fecc8003b30 2023-11-04T01:38:14.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.861+0000 7fecd9ffb640 1 -- 172.21.15.44:0/1489258451 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc02cc80 con 0x7fecc8003b30 2023-11-04T01:38:14.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.862+0000 7fece1607640 1 -- 172.21.15.44:0/1489258451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecc8003b30 msgr2=0x7fecc8003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.862+0000 7fece1607640 1 --2- 172.21.15.44:0/1489258451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecc8003b30 0x7fecc8003f30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7feccc00c490 tx=0x7fecc80057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.862+0000 7fecdb7fe640 1 -- 172.21.15.44:0/1489258451 reap_dead start 2023-11-04T01:38:14.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.862+0000 7fece1607640 1 -- 172.21.15.44:0/1489258451 shutdown_connections 2023-11-04T01:38:14.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.862+0000 7fece1607640 1 -- 172.21.15.44:0/1489258451 >> 172.21.15.44:0/1489258451 conn(0x7fecdc0cd600 msgr2=0x7fecdc0cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:14.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.862+0000 7fece1607640 1 -- 172.21.15.44:0/1489258451 shutdown_connections 2023-11-04T01:38:14.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.862+0000 7fece1607640 1 -- 172.21.15.44:0/1489258451 wait complete. 2023-11-04T01:38:14.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.863+0000 7fece1607640 1 Processor -- start 2023-11-04T01:38:14.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.863+0000 7fece1607640 1 -- start start 2023-11-04T01:38:14.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.864+0000 7fece1607640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecc8003b30 0x7fecdc156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.864+0000 7fece1607640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fecdc1e61a0 0x7fecdc15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.864+0000 7fece1607640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fecdc15b2f0 0x7fecdc0c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.864+0000 7fece1607640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc1e7600 con 0x7fecc8003b30 2023-11-04T01:38:14.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.864+0000 7fece1607640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc15b770 con 0x7fecdc1e61a0 2023-11-04T01:38:14.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.864+0000 7fece1607640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc157170 con 0x7fecdc15b2f0 2023-11-04T01:38:14.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.864+0000 7fecdaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecc8003b30 0x7fecdc156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.864+0000 7fecdaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecc8003b30 0x7fecdc156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43942/0 (socket says 172.21.15.44:43942) 2023-11-04T01:38:14.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.864+0000 7fecdaffd640 1 -- 172.21.15.44:0/4126399484 learned_addr learned my addr 172.21.15.44:0/4126399484 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:14.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.865+0000 7fecdaffd640 1 -- 172.21.15.44:0/4126399484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fecdc15b2f0 msgr2=0x7fecdc0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.865+0000 7fecdaffd640 1 --2- 172.21.15.44:0/4126399484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fecdc15b2f0 0x7fecdc0c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.865+0000 7fecda7fc640 1 --2- 172.21.15.44:0/4126399484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fecdc1e61a0 0x7fecdc15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.865+0000 7fecdaffd640 1 -- 172.21.15.44:0/4126399484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fecdc1e61a0 msgr2=0x7fecdc15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.865+0000 7fecdaffd640 1 --2- 172.21.15.44:0/4126399484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fecdc1e61a0 0x7fecdc15adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.865+0000 7fecdaffd640 1 -- 172.21.15.44:0/4126399484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc1e6980 con 0x7fecc8003b30 2023-11-04T01:38:14.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.865+0000 7fecdaffd640 1 --2- 172.21.15.44:0/4126399484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecc8003b30 0x7fecdc156c30 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7feccc00c490 tx=0x7feccc001dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.865+0000 7fecd37fe640 1 -- 172.21.15.44:0/4126399484 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc02ce50 con 0x7fecc8003b30 2023-11-04T01:38:14.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.865+0000 7fecd37fe640 1 -- 172.21.15.44:0/4126399484 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc007070 con 0x7fecc8003b30 2023-11-04T01:38:14.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.865+0000 7fece1607640 1 -- 172.21.15.44:0/4126399484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc1e6c60 con 0x7fecc8003b30 2023-11-04T01:38:14.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.865+0000 7fecd37fe640 1 -- 172.21.15.44:0/4126399484 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc007420 con 0x7fecc8003b30 2023-11-04T01:38:14.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.865+0000 7fece1607640 1 -- 172.21.15.44:0/4126399484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc1e7220 con 0x7fecc8003b30 2023-11-04T01:38:14.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.866+0000 7fece1607640 1 -- 172.21.15.44:0/4126399484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecdc1e7870 con 0x7fecc8003b30 2023-11-04T01:38:14.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.866+0000 7fecd37fe640 1 -- 172.21.15.44:0/4126399484 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feccc032070 con 0x7fecc8003b30 2023-11-04T01:38:14.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.867+0000 7fecd37fe640 1 --2- 172.21.15.44:0/4126399484 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fecbc06ae70 0x7fecbc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.867+0000 7fecd37fe640 1 -- 172.21.15.44:0/4126399484 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5616+0+0 (secure 0 0 0) 0x7feccc0aa9d0 con 0x7fecc8003b30 2023-11-04T01:38:14.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.867+0000 7fecda7fc640 1 --2- 172.21.15.44:0/4126399484 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fecbc06ae70 0x7fecbc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.868+0000 7fecda7fc640 1 --2- 172.21.15.44:0/4126399484 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fecbc06ae70 0x7fecbc06d330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fecc4000c00 tx=0x7fecc4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:14.871+0000 7fecd37fe640 1 -- 172.21.15.44:0/4126399484 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feccc075ae0 con 0x7fecc8003b30 2023-11-04T01:38:15.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.050+0000 7fece1607640 1 -- 172.21.15.44:0/4126399484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecdc06b300 con 0x7fecc8003b30 2023-11-04T01:38:15.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.051+0000 7fecd37fe640 1 -- 172.21.15.44:0/4126399484 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+14942 (secure 0 0 0) 0x7feccc045090 con 0x7fecc8003b30 2023-11-04T01:38:15.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:15.053 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":59,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:38:13.725682+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6834/982248126":"2023-11-05T01:38:10.720712+0000","172.21.15.44:6832/982248126":"2023-11-05T01:38:10.720712+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:15.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.053+0000 7fece1607640 1 -- 172.21.15.44:0/4126399484 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fecbc06ae70 msgr2=0x7fecbc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.053+0000 7fece1607640 1 --2- 172.21.15.44:0/4126399484 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fecbc06ae70 0x7fecbc06d330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fecc4000c00 tx=0x7fecc4009040 comp rx=0 tx=0).stop 2023-11-04T01:38:15.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.053+0000 7fece1607640 1 -- 172.21.15.44:0/4126399484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecc8003b30 msgr2=0x7fecdc156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.053+0000 7fece1607640 1 --2- 172.21.15.44:0/4126399484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecc8003b30 0x7fecdc156c30 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7feccc00c490 tx=0x7feccc001dd0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.053+0000 7fece1607640 1 -- 172.21.15.44:0/4126399484 shutdown_connections 2023-11-04T01:38:15.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.053+0000 7fece1607640 1 --2- 172.21.15.44:0/4126399484 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fecbc06ae70 0x7fecbc06d330 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.053+0000 7fece1607640 1 --2- 172.21.15.44:0/4126399484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fecdc15b2f0 0x7fecdc0c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.053+0000 7fece1607640 1 --2- 172.21.15.44:0/4126399484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fecdc1e61a0 0x7fecdc15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.053+0000 7fece1607640 1 --2- 172.21.15.44:0/4126399484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecc8003b30 0x7fecdc156c30 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.053+0000 7fece1607640 1 -- 172.21.15.44:0/4126399484 >> 172.21.15.44:0/4126399484 conn(0x7fecdc0cd600 msgr2=0x7fecdc0b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:15.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.053+0000 7fece1607640 1 -- 172.21.15.44:0/4126399484 shutdown_connections 2023-11-04T01:38:15.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.053+0000 7fece1607640 1 -- 172.21.15.44:0/4126399484 wait complete. 2023-11-04T01:38:15.066 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:15.066 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:15.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.173+0000 7f85baf05640 1 Processor -- start 2023-11-04T01:38:15.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.174+0000 7f85baf05640 1 -- start start 2023-11-04T01:38:15.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.174+0000 7f85baf05640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85b415cfd0 0x7f85b406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.174+0000 7f85baf05640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f85b40cf180 0x7f85b4161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.174+0000 7f85baf05640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f85b40cd570 0x7f85b40cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.174+0000 7f85baf05640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b415d3b0 con 0x7f85b40cd570 2023-11-04T01:38:15.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.174+0000 7f85baf05640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b40cdf00 con 0x7f85b40cf180 2023-11-04T01:38:15.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.174+0000 7f85baf05640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b40cea20 con 0x7f85b415cfd0 2023-11-04T01:38:15.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.175+0000 7f85b94a2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f85b40cd570 0x7f85b40cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.175+0000 7f85b94a2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f85b40cd570 0x7f85b40cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43950/0 (socket says 172.21.15.44:43950) 2023-11-04T01:38:15.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.175+0000 7f85b94a2640 1 -- 172.21.15.44:0/1416803937 learned_addr learned my addr 172.21.15.44:0/1416803937 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:15.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.175+0000 7f85b8ca1640 1 --2- 172.21.15.44:0/1416803937 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85b415cfd0 0x7f85b406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.175+0000 7f85b3fff640 1 --2- 172.21.15.44:0/1416803937 >> v2:172.21.15.204:3300/0 conn(0x7f85b40cf180 0x7f85b4161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.175+0000 7f85b94a2640 1 -- 172.21.15.44:0/1416803937 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85b415cfd0 msgr2=0x7f85b406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:15.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.175+0000 7f85b94a2640 1 --2- 172.21.15.44:0/1416803937 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85b415cfd0 0x7f85b406c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.175+0000 7f85b94a2640 1 -- 172.21.15.44:0/1416803937 >> v2:172.21.15.204:3300/0 conn(0x7f85b40cf180 msgr2=0x7f85b4161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:15.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.175+0000 7f85b94a2640 1 --2- 172.21.15.44:0/1416803937 >> v2:172.21.15.204:3300/0 conn(0x7f85b40cf180 0x7f85b4161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.175+0000 7f85b94a2640 1 -- 172.21.15.44:0/1416803937 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b4161980 con 0x7f85b40cd570 2023-11-04T01:38:15.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.176+0000 7f85b94a2640 1 --2- 172.21.15.44:0/1416803937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85b40cd570 0x7f85b40cd9c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f85b406b120 tx=0x7f85ac02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b93db1001eb127 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.176+0000 7f85b37fe640 1 -- 172.21.15.44:0/1416803937 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac02c9e0 con 0x7f85b40cd570 2023-11-04T01:38:15.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.176+0000 7f85b37fe640 1 -- 172.21.15.44:0/1416803937 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ac02cb40 con 0x7f85b40cd570 2023-11-04T01:38:15.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.176+0000 7f85b37fe640 1 -- 172.21.15.44:0/1416803937 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac0343f0 con 0x7f85b40cd570 2023-11-04T01:38:15.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.176+0000 7f85baf05640 1 -- 172.21.15.44:0/1416803937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85b40cd570 msgr2=0x7f85b40cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.176+0000 7f85baf05640 1 --2- 172.21.15.44:0/1416803937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85b40cd570 0x7f85b40cd9c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f85b406b120 tx=0x7f85ac02be40 comp rx=0 tx=0).stop 2023-11-04T01:38:15.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.176+0000 7f85baf05640 1 -- 172.21.15.44:0/1416803937 shutdown_connections 2023-11-04T01:38:15.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.176+0000 7f85baf05640 1 --2- 172.21.15.44:0/1416803937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85b40cd570 0x7f85b40cd9c0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.176+0000 7f85baf05640 1 --2- 172.21.15.44:0/1416803937 >> v2:172.21.15.204:3300/0 conn(0x7f85b40cf180 0x7f85b4161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.176+0000 7f85baf05640 1 --2- 172.21.15.44:0/1416803937 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85b415cfd0 0x7f85b406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.176+0000 7f85baf05640 1 -- 172.21.15.44:0/1416803937 >> 172.21.15.44:0/1416803937 conn(0x7f85b406ea20 msgr2=0x7f85b406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:15.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.176+0000 7f85baf05640 1 -- 172.21.15.44:0/1416803937 shutdown_connections 2023-11-04T01:38:15.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.176+0000 7f85baf05640 1 -- 172.21.15.44:0/1416803937 wait complete. 2023-11-04T01:38:15.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.177+0000 7f85baf05640 1 Processor -- start 2023-11-04T01:38:15.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.178+0000 7f85baf05640 1 -- start start 2023-11-04T01:38:15.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.178+0000 7f85baf05640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85b40cd570 0x7f85b40c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.178+0000 7f85baf05640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85b415cfd0 0x7f85b4151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.178+0000 7f85baf05640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85b40b57b0 0x7f85b40b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.178+0000 7f85baf05640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b40b1220 con 0x7f85b40cd570 2023-11-04T01:38:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.178+0000 7f85baf05640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b40b14e0 con 0x7f85b40b57b0 2023-11-04T01:38:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.178+0000 7f85baf05640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b40b5080 con 0x7f85b415cfd0 2023-11-04T01:38:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.178+0000 7f85b8ca1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85b40cd570 0x7f85b40c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85b8ca1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85b40cd570 0x7f85b40c46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43964/0 (socket says 172.21.15.44:43964) 2023-11-04T01:38:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85b8ca1640 1 -- 172.21.15.44:0/3753851541 learned_addr learned my addr 172.21.15.44:0/3753851541 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85b3fff640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85b415cfd0 0x7f85b4151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85b94a2640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85b40b57b0 0x7f85b40b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85b8ca1640 1 -- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85b415cfd0 msgr2=0x7f85b4151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85b8ca1640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85b415cfd0 0x7f85b4151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85b8ca1640 1 -- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85b40b57b0 msgr2=0x7f85b40b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85b8ca1640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85b40b57b0 0x7f85b40b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85b8ca1640 1 -- 172.21.15.44:0/3753851541 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac009b30 con 0x7f85b40cd570 2023-11-04T01:38:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85b3fff640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85b415cfd0 0x7f85b4151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85b94a2640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85b40b57b0 0x7f85b40b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85b8ca1640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85b40cd570 0x7f85b40c46d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f85a800e870 tx=0x7f85a800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85b17fa640 1 -- 172.21.15.44:0/3753851541 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a80094f0 con 0x7f85b40cd570 2023-11-04T01:38:15.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85b17fa640 1 -- 172.21.15.44:0/3753851541 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a800c940 con 0x7f85b40cd570 2023-11-04T01:38:15.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85baf05640 1 -- 172.21.15.44:0/3753851541 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b40b3980 con 0x7f85b40cd570 2023-11-04T01:38:15.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85b17fa640 1 -- 172.21.15.44:0/3753851541 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a800ccf0 con 0x7f85b40cd570 2023-11-04T01:38:15.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.179+0000 7f85baf05640 1 -- 172.21.15.44:0/3753851541 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b40b4ac0 con 0x7f85b40cd570 2023-11-04T01:38:15.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.180+0000 7f85baf05640 1 -- 172.21.15.44:0/3753851541 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b40674e0 con 0x7f85b40cd570 2023-11-04T01:38:15.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.181+0000 7f85b17fa640 1 -- 172.21.15.44:0/3753851541 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f85a8013470 con 0x7f85b40cd570 2023-11-04T01:38:15.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.181+0000 7f85b17fa640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f859806aea0 0x7f859806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.181+0000 7f85b17fa640 1 -- 172.21.15.44:0/3753851541 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f85a8089510 con 0x7f85b40cd570 2023-11-04T01:38:15.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.181+0000 7f85b3fff640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f859806aea0 0x7f859806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.182+0000 7f85b3fff640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f859806aea0 0x7f859806d360 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f85b40b0fb0 tx=0x7f85a0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.186+0000 7f85b17fa640 1 -- 172.21.15.44:0/3753851541 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f85a80546b0 con 0x7f85b40cd570 2023-11-04T01:38:15.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.367+0000 7f85baf05640 1 -- 172.21.15.44:0/3753851541 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85b406b300 con 0x7f85b40cd570 2023-11-04T01:38:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.368+0000 7f85b17fa640 1 -- 172.21.15.44:0/3753851541 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85a8057cd0 con 0x7f85b40cd570 2023-11-04T01:38:15.370 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:38:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.370+0000 7f85baf05640 1 -- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f859806aea0 msgr2=0x7f859806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.370+0000 7f85baf05640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f859806aea0 0x7f859806d360 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f85b40b0fb0 tx=0x7f85a0008040 comp rx=0 tx=0).stop 2023-11-04T01:38:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.370+0000 7f85baf05640 1 -- 172.21.15.44:0/3753851541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85b40cd570 msgr2=0x7f85b40c46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.370+0000 7f85baf05640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85b40cd570 0x7f85b40c46d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f85a800e870 tx=0x7f85a800ed30 comp rx=0 tx=0).stop 2023-11-04T01:38:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.370+0000 7f85baf05640 1 -- 172.21.15.44:0/3753851541 shutdown_connections 2023-11-04T01:38:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.370+0000 7f85baf05640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f859806aea0 0x7f859806d360 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.370+0000 7f85baf05640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85b40b57b0 0x7f85b40b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.370+0000 7f85baf05640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85b415cfd0 0x7f85b4151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.370+0000 7f85baf05640 1 --2- 172.21.15.44:0/3753851541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85b40cd570 0x7f85b40c46d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.370+0000 7f85baf05640 1 -- 172.21.15.44:0/3753851541 >> 172.21.15.44:0/3753851541 conn(0x7f85b406ea20 msgr2=0x7f85b415e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.370+0000 7f85baf05640 1 -- 172.21.15.44:0/3753851541 shutdown_connections 2023-11-04T01:38:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.370+0000 7f85baf05640 1 -- 172.21.15.44:0/3753851541 wait complete. 2023-11-04T01:38:15.382 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:15.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.489+0000 7fafef55e640 1 Processor -- start 2023-11-04T01:38:15.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.489+0000 7fafef55e640 1 -- start start 2023-11-04T01:38:15.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.490+0000 7fafef55e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafe80ca0a0 0x7fafe80cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.490+0000 7fafef55e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fafe80cc300 0x7fafe80cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.490+0000 7fafef55e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe80caa20 con 0x7fafe815e3f0 2023-11-04T01:38:15.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.490+0000 7fafef55e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe80b3300 con 0x7fafe80cc300 2023-11-04T01:38:15.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.490+0000 7fafef55e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80cb230 con 0x7fafe80ca0a0 2023-11-04T01:38:15.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.490+0000 7fafed2fa640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fafe815e3f0 0x7fafe80b2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41326/0 (socket says 172.21.15.44:41326) 2023-11-04T01:38:15.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.490+0000 7fafed2fa640 1 -- 172.21.15.44:0/4255813415 learned_addr learned my addr 172.21.15.44:0/4255813415 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:15.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 -- 172.21.15.44:0/4255813415 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694341480 0 0) 0x7fafe80caa20 con 0x7fafe815e3f0 2023-11-04T01:38:15.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafecaf9640 1 --2- 172.21.15.44:0/4255813415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafe80ca0a0 0x7fafe80cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafedafb640 1 --2- 172.21.15.44:0/4255813415 >> v2:172.21.15.204:3300/0 conn(0x7fafe80cc300 0x7fafe80cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 -- 172.21.15.44:0/4255813415 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafd0003520 con 0x7fafe815e3f0 2023-11-04T01:38:15.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 -- 172.21.15.44:0/4255813415 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1151375585 0 0) 0x7fafd0003520 con 0x7fafe815e3f0 2023-11-04T01:38:15.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 -- 172.21.15.44:0/4255813415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafe80ca0a0 msgr2=0x7fafe80cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:15.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 --2- 172.21.15.44:0/4255813415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafe80ca0a0 0x7fafe80cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 -- 172.21.15.44:0/4255813415 >> v2:172.21.15.204:3300/0 conn(0x7fafe80cc300 msgr2=0x7fafe80cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:15.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 --2- 172.21.15.44:0/4255813415 >> v2:172.21.15.204:3300/0 conn(0x7fafe80cc300 0x7fafe80cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 -- 172.21.15.44:0/4255813415 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe80ca530 con 0x7fafe815e3f0 2023-11-04T01:38:15.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 -- 172.21.15.44:0/4255813415 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fafe0001670 con 0x7fafe815e3f0 2023-11-04T01:38:15.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 -- 172.21.15.44:0/4255813415 >> v1:172.21.15.44:6789/0 conn(0x7fafe815e3f0 legacy=0x7fafe80b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 --2- 172.21.15.44:0/4255813415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd0003970 0x7fafd0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 --2- 172.21.15.44:0/4255813415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafd00047c0 0x7fafd0004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 --2- 172.21.15.44:0/4255813415 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fafd0005140 0x7fafd000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 -- 172.21.15.44:0/4255813415 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80b3300 con 0x7fafd0003970 2023-11-04T01:38:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 -- 172.21.15.44:0/4255813415 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80cb230 con 0x7fafd0005140 2023-11-04T01:38:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafe7fff640 1 -- 172.21.15.44:0/4255813415 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd0004610 con 0x7fafd00047c0 2023-11-04T01:38:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafed2fa640 1 --2- 172.21.15.44:0/4255813415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd0003970 0x7fafd0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafecaf9640 1 --2- 172.21.15.44:0/4255813415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafd00047c0 0x7fafd0004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafedafb640 1 --2- 172.21.15.44:0/4255813415 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fafd0005140 0x7fafd000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafed2fa640 1 -- 172.21.15.44:0/4255813415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafd00047c0 msgr2=0x7fafd0004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafed2fa640 1 --2- 172.21.15.44:0/4255813415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafd00047c0 0x7fafd0004c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafed2fa640 1 -- 172.21.15.44:0/4255813415 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fafd0005140 msgr2=0x7fafd000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafed2fa640 1 --2- 172.21.15.44:0/4255813415 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fafd0005140 0x7fafd000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafed2fa640 1 -- 172.21.15.44:0/4255813415 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd0003520 con 0x7fafd0003970 2023-11-04T01:38:15.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.491+0000 7fafecaf9640 1 --2- 172.21.15.44:0/4255813415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafd00047c0 0x7fafd0004c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:15.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.492+0000 7fafed2fa640 1 --2- 172.21.15.44:0/4255813415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd0003970 0x7fafd0003d90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fafe000c160 tx=0x7fafd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d325fc897be2a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.492+0000 7fafe7fff640 1 -- 172.21.15.44:0/4255813415 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0005ad0 con 0x7fafd0003970 2023-11-04T01:38:15.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.492+0000 7fafe7fff640 1 -- 172.21.15.44:0/4255813415 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe0005c30 con 0x7fafd0003970 2023-11-04T01:38:15.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.492+0000 7fafe7fff640 1 -- 172.21.15.44:0/4255813415 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe002c810 con 0x7fafd0003970 2023-11-04T01:38:15.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.493+0000 7fafef55e640 1 -- 172.21.15.44:0/4255813415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd0003970 msgr2=0x7fafd0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.493+0000 7fafef55e640 1 --2- 172.21.15.44:0/4255813415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd0003970 0x7fafd0003d90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fafe000c160 tx=0x7fafd00057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.493+0000 7fafedafb640 1 -- 172.21.15.44:0/4255813415 reap_dead start 2023-11-04T01:38:15.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.493+0000 7fafef55e640 1 -- 172.21.15.44:0/4255813415 shutdown_connections 2023-11-04T01:38:15.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.493+0000 7fafef55e640 1 -- 172.21.15.44:0/4255813415 >> 172.21.15.44:0/4255813415 conn(0x7fafe8071820 msgr2=0x7fafe8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:15.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.493+0000 7fafef55e640 1 -- 172.21.15.44:0/4255813415 shutdown_connections 2023-11-04T01:38:15.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.493+0000 7fafef55e640 1 -- 172.21.15.44:0/4255813415 wait complete. 2023-11-04T01:38:15.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.494+0000 7fafef55e640 1 Processor -- start 2023-11-04T01:38:15.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.494+0000 7fafef55e640 1 -- start start 2023-11-04T01:38:15.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafef55e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd0003970 0x7fafe80c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafef55e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafe80c7b70 0x7fafe81538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafef55e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fafe80cef50 0x7fafe80abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafef55e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80c8070 con 0x7fafd0003970 2023-11-04T01:38:15.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafef55e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80c8350 con 0x7fafe80cef50 2023-11-04T01:38:15.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafef55e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80c8630 con 0x7fafe80c7b70 2023-11-04T01:38:15.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafed2fa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd0003970 0x7fafe80c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafed2fa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd0003970 0x7fafe80c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43972/0 (socket says 172.21.15.44:43972) 2023-11-04T01:38:15.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafed2fa640 1 -- 172.21.15.44:0/2810926878 learned_addr learned my addr 172.21.15.44:0/2810926878 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:15.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafecaf9640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafe80c7b70 0x7fafe81538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafed2fa640 1 -- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafe80c7b70 msgr2=0x7fafe81538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafedafb640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fafe80cef50 0x7fafe80abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafed2fa640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafe80c7b70 0x7fafe81538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafed2fa640 1 -- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fafe80cef50 msgr2=0x7fafe80abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafed2fa640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fafe80cef50 0x7fafe80abb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafed2fa640 1 -- 172.21.15.44:0/2810926878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe80c8910 con 0x7fafd0003970 2023-11-04T01:38:15.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafecaf9640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafe80c7b70 0x7fafe81538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:15.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafedafb640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fafe80cef50 0x7fafe80abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:15.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.495+0000 7fafed2fa640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd0003970 0x7fafe80c9110 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fafe0000c00 tx=0x7fafe0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.496+0000 7fafe5ffb640 1 -- 172.21.15.44:0/2810926878 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe003c040 con 0x7fafd0003970 2023-11-04T01:38:15.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.496+0000 7fafe5ffb640 1 -- 172.21.15.44:0/2810926878 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe002cc20 con 0x7fafd0003970 2023-11-04T01:38:15.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.496+0000 7fafef55e640 1 -- 172.21.15.44:0/2810926878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe80c8bf0 con 0x7fafd0003970 2023-11-04T01:38:15.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.496+0000 7fafe5ffb640 1 -- 172.21.15.44:0/2810926878 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0007070 con 0x7fafd0003970 2023-11-04T01:38:15.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.496+0000 7fafef55e640 1 -- 172.21.15.44:0/2810926878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe80cf3e0 con 0x7fafd0003970 2023-11-04T01:38:15.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.497+0000 7fafef55e640 1 -- 172.21.15.44:0/2810926878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe80c8d80 con 0x7fafd0003970 2023-11-04T01:38:15.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.497+0000 7fafe5ffb640 1 -- 172.21.15.44:0/2810926878 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fafe0032070 con 0x7fafd0003970 2023-11-04T01:38:15.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.498+0000 7fafe5ffb640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fafd406ae70 0x7fafd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.498+0000 7fafe5ffb640 1 -- 172.21.15.44:0/2810926878 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fafe00aaa40 con 0x7fafd0003970 2023-11-04T01:38:15.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.498+0000 7fafecaf9640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fafd406ae70 0x7fafd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.498+0000 7fafecaf9640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fafd406ae70 0x7fafd406d330 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fafe80c6110 tx=0x7fafdc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.502+0000 7fafe5ffb640 1 -- 172.21.15.44:0/2810926878 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fafe00ace60 con 0x7fafd0003970 2023-11-04T01:38:15.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.676+0000 7fafef55e640 1 -- 172.21.15.44:0/2810926878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fafe8074290 con 0x7fafd0003970 2023-11-04T01:38:15.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.677+0000 7fafe5ffb640 1 -- 172.21.15.44:0/2810926878 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v59) v1 ==== 103+0+11 (secure 0 0 0) 0x7fafe00460a0 con 0x7fafd0003970 2023-11-04T01:38:15.679 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:15.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.679+0000 7fafef55e640 1 -- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fafd406ae70 msgr2=0x7fafd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.679+0000 7fafef55e640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fafd406ae70 0x7fafd406d330 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fafe80c6110 tx=0x7fafdc008040 comp rx=0 tx=0).stop 2023-11-04T01:38:15.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.679+0000 7fafef55e640 1 -- 172.21.15.44:0/2810926878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd0003970 msgr2=0x7fafe80c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.679+0000 7fafef55e640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd0003970 0x7fafe80c9110 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fafe0000c00 tx=0x7fafe0000fe0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.679+0000 7fafef55e640 1 -- 172.21.15.44:0/2810926878 shutdown_connections 2023-11-04T01:38:15.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.679+0000 7fafef55e640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fafd406ae70 0x7fafd406d330 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.679+0000 7fafef55e640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fafe80cef50 0x7fafe80abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.679+0000 7fafef55e640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafe80c7b70 0x7fafe81538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.679+0000 7fafef55e640 1 --2- 172.21.15.44:0/2810926878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd0003970 0x7fafe80c9110 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.679+0000 7fafef55e640 1 -- 172.21.15.44:0/2810926878 >> 172.21.15.44:0/2810926878 conn(0x7fafe8071820 msgr2=0x7fafe806d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:15.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.679+0000 7fafef55e640 1 -- 172.21.15.44:0/2810926878 shutdown_connections 2023-11-04T01:38:15.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.679+0000 7fafef55e640 1 -- 172.21.15.44:0/2810926878 wait complete. 2023-11-04T01:38:15.692 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-11-04T01:38:15.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.797+0000 7f7f122b4640 1 Processor -- start 2023-11-04T01:38:15.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.797+0000 7f7f122b4640 1 -- start start 2023-11-04T01:38:15.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.798+0000 7f7f122b4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7f0c15ce60 0x7f7f0c06b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.798+0000 7f7f122b4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7f0c0cf160 0x7f7f0c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.798+0000 7f7f122b4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0c1615d0 con 0x7f7f0c06bd30 2023-11-04T01:38:15.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.798+0000 7f7f122b4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0c0cbde0 con 0x7f7f0c15ce60 2023-11-04T01:38:15.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.798+0000 7f7f122b4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0c0cfb30 con 0x7f7f0c0cf160 2023-11-04T01:38:15.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.798+0000 7f7f0bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7f0c15ce60 0x7f7f0c06b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.798+0000 7f7f0b7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7f0c06bd30 0x7f7f0c160b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41330/0 (socket says 172.21.15.44:41330) 2023-11-04T01:38:15.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.798+0000 7f7f0bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7f0c15ce60 0x7f7f0c06b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43976/0 (socket says 172.21.15.44:43976) 2023-11-04T01:38:15.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.798+0000 7f7f0b7fe640 1 -- 172.21.15.44:0/3580023527 learned_addr learned my addr 172.21.15.44:0/3580023527 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:15.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.798+0000 7f7f0bfff640 1 -- 172.21.15.44:0/3580023527 >> v2:172.21.15.204:3300/0 conn(0x7f7f0c0cf160 msgr2=0x7f7f0c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:15.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.798+0000 7f7f0bfff640 1 --2- 172.21.15.44:0/3580023527 >> v2:172.21.15.204:3300/0 conn(0x7f7f0c0cf160 0x7f7f0c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.798+0000 7f7f0bfff640 1 -- 172.21.15.44:0/3580023527 >> v1:172.21.15.44:6789/0 conn(0x7f7f0c06bd30 legacy=0x7f7f0c160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.798+0000 7f7f0bfff640 1 -- 172.21.15.44:0/3580023527 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c1618b0 con 0x7f7f0c15ce60 2023-11-04T01:38:15.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.798+0000 7f7f0affd640 1 -- 172.21.15.44:0/3580023527 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897358582 0 0) 0x7f7f0c1615d0 con 0x7f7f0c06bd30 2023-11-04T01:38:15.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.799+0000 7f7f0bfff640 1 --2- 172.21.15.44:0/3580023527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0c15ce60 0x7f7f0c06b7f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c06f7a0 tx=0x7f7f0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f97108f0f25b10b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.799+0000 7f7f0affd640 1 -- 172.21.15.44:0/3580023527 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00031830 con 0x7f7f0c15ce60 2023-11-04T01:38:15.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.799+0000 7f7f0affd640 1 -- 172.21.15.44:0/3580023527 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f00031990 con 0x7f7f0c15ce60 2023-11-04T01:38:15.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.799+0000 7f7f0affd640 1 -- 172.21.15.44:0/3580023527 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00031d20 con 0x7f7f0c15ce60 2023-11-04T01:38:15.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.800+0000 7f7f122b4640 1 -- 172.21.15.44:0/3580023527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0c15ce60 msgr2=0x7f7f0c06b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.800+0000 7f7f122b4640 1 --2- 172.21.15.44:0/3580023527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0c15ce60 0x7f7f0c06b7f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c06f7a0 tx=0x7f7f0002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.800+0000 7f7f122b4640 1 -- 172.21.15.44:0/3580023527 shutdown_connections 2023-11-04T01:38:15.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.800+0000 7f7f122b4640 1 --2- 172.21.15.44:0/3580023527 >> v2:172.21.15.204:3300/0 conn(0x7f7f0c0cf160 0x7f7f0c0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.800+0000 7f7f122b4640 1 --2- 172.21.15.44:0/3580023527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0c15ce60 0x7f7f0c06b7f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.800+0000 7f7f122b4640 1 -- 172.21.15.44:0/3580023527 >> 172.21.15.44:0/3580023527 conn(0x7f7f0c06ea90 msgr2=0x7f7f0c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:15.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.800+0000 7f7f122b4640 1 -- 172.21.15.44:0/3580023527 shutdown_connections 2023-11-04T01:38:15.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.800+0000 7f7f122b4640 1 -- 172.21.15.44:0/3580023527 wait complete. 2023-11-04T01:38:15.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.801+0000 7f7f122b4640 1 Processor -- start 2023-11-04T01:38:15.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.801+0000 7f7f122b4640 1 -- start start 2023-11-04T01:38:15.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f122b4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7f0c0cf160 0x7f7f0c15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f122b4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7f0c15ce60 0x7f7f0c0b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f122b4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0c0c84f0 0x7f7f0c0c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f122b4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c156b70 con 0x7f7f0c0c84f0 2023-11-04T01:38:15.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f122b4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c15ddd0 con 0x7f7f0c15ce60 2023-11-04T01:38:15.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f122b4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c15e0b0 con 0x7f7f0c0cf160 2023-11-04T01:38:15.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f10851640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0c0c84f0 0x7f7f0c0c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f10851640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0c0c84f0 0x7f7f0c0c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43980/0 (socket says 172.21.15.44:43980) 2023-11-04T01:38:15.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f10851640 1 -- 172.21.15.44:0/2781843838 learned_addr learned my addr 172.21.15.44:0/2781843838 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:15.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f0bfff640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7f0c0cf160 0x7f7f0c15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f0b7fe640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7f0c15ce60 0x7f7f0c0b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f10851640 1 -- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7f0c0cf160 msgr2=0x7f7f0c15a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f10851640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7f0c0cf160 0x7f7f0c15a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f10851640 1 -- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7f0c15ce60 msgr2=0x7f7f0c0b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f10851640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7f0c15ce60 0x7f7f0c0b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f10851640 1 -- 172.21.15.44:0/2781843838 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f00009400 con 0x7f7f0c0c84f0 2023-11-04T01:38:15.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f0b7fe640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7f0c15ce60 0x7f7f0c0b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:15.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.802+0000 7f7f0bfff640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7f0c0cf160 0x7f7f0c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:15.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.803+0000 7f7f10851640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0c0c84f0 0x7f7f0c0c89a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400b970 tx=0x7f7f0400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.803+0000 7f7f08ff9640 1 -- 172.21.15.44:0/2781843838 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0400cb40 con 0x7f7f0c0c84f0 2023-11-04T01:38:15.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.803+0000 7f7f08ff9640 1 -- 172.21.15.44:0/2781843838 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0400ccc0 con 0x7f7f0c0c84f0 2023-11-04T01:38:15.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.803+0000 7f7f08ff9640 1 -- 172.21.15.44:0/2781843838 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04014680 con 0x7f7f0c0c84f0 2023-11-04T01:38:15.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.803+0000 7f7f122b4640 1 -- 172.21.15.44:0/2781843838 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c15e390 con 0x7f7f0c0c84f0 2023-11-04T01:38:15.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.803+0000 7f7f122b4640 1 -- 172.21.15.44:0/2781843838 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c15e950 con 0x7f7f0c0c84f0 2023-11-04T01:38:15.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.804+0000 7f7f122b4640 1 -- 172.21.15.44:0/2781843838 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0c15eb70 con 0x7f7f0c0c84f0 2023-11-04T01:38:15.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.804+0000 7f7f08ff9640 1 -- 172.21.15.44:0/2781843838 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f0401d3b0 con 0x7f7f0c0c84f0 2023-11-04T01:38:15.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.805+0000 7f7f08ff9640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7ef806ae70 0x7f7ef806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.805+0000 7f7f08ff9640 1 -- 172.21.15.44:0/2781843838 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f7f04089530 con 0x7f7f0c0c84f0 2023-11-04T01:38:15.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.805+0000 7f7f0bfff640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7ef806ae70 0x7f7ef806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.806+0000 7f7f0bfff640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7ef806ae70 0x7f7ef806d330 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7f00036000 tx=0x7f7f0003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:15.809+0000 7f7f08ff9640 1 -- 172.21.15.44:0/2781843838 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7f04054640 con 0x7f7f0c0c84f0 2023-11-04T01:38:16.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.057+0000 7f7f122b4640 1 -- 172.21.15.44:0/2781843838 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7f7f0c074290 con 0x7f7f0c0c84f0 2023-11-04T01:38:16.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.741+0000 7f7f08ff9640 1 -- 172.21.15.44:0/2781843838 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v151) v1 ==== 176+0+0 (secure 0 0 0) 0x7f7f04057c60 con 0x7f7f0c0c84f0 2023-11-04T01:38:16.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.743+0000 7f7f122b4640 1 -- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7ef806ae70 msgr2=0x7f7ef806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.743+0000 7f7f122b4640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7ef806ae70 0x7f7ef806d330 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7f00036000 tx=0x7f7f0003c040 comp rx=0 tx=0).stop 2023-11-04T01:38:16.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.743+0000 7f7f122b4640 1 -- 172.21.15.44:0/2781843838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0c0c84f0 msgr2=0x7f7f0c0c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.743+0000 7f7f122b4640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0c0c84f0 0x7f7f0c0c89a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400b970 tx=0x7f7f0400be30 comp rx=0 tx=0).stop 2023-11-04T01:38:16.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.744+0000 7f7f122b4640 1 -- 172.21.15.44:0/2781843838 shutdown_connections 2023-11-04T01:38:16.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.744+0000 7f7f122b4640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7ef806ae70 0x7f7ef806d330 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.744+0000 7f7f122b4640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0c0c84f0 0x7f7f0c0c89a0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.744+0000 7f7f122b4640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7f0c15ce60 0x7f7f0c0b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.744+0000 7f7f122b4640 1 --2- 172.21.15.44:0/2781843838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7f0c0cf160 0x7f7f0c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.744+0000 7f7f122b4640 1 -- 172.21.15.44:0/2781843838 >> 172.21.15.44:0/2781843838 conn(0x7f7f0c06ea90 msgr2=0x7f7f0c15a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.744+0000 7f7f122b4640 1 -- 172.21.15.44:0/2781843838 shutdown_connections 2023-11-04T01:38:16.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.744+0000 7f7f122b4640 1 -- 172.21.15.44:0/2781843838 wait complete. 2023-11-04T01:38:16.759 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:38:16.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.872+0000 7fd437fce640 1 Processor -- start 2023-11-04T01:38:16.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.872+0000 7fd437fce640 1 -- start start 2023-11-04T01:38:16.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.873+0000 7fd437fce640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300cccc0 0x7fd43006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.873+0000 7fd437fce640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43006ca40 con 0x7fd430160430 2023-11-04T01:38:16.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.873+0000 7fd437fce640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43006cd20 con 0x7fd4300b2d30 2023-11-04T01:38:16.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.873+0000 7fd437fce640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300cb580 con 0x7fd4300cccc0 2023-11-04T01:38:16.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.873+0000 7fd435d6a640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd430160430 0x7fd4300b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41334/0 (socket says 172.21.15.44:41334) 2023-11-04T01:38:16.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.873+0000 7fd435d6a640 1 -- 172.21.15.44:0/3123088297 learned_addr learned my addr 172.21.15.44:0/3123088297 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.873+0000 7fd434d68640 1 -- 172.21.15.44:0/3123088297 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014275056 0 0) 0x7fd43006ca40 con 0x7fd430160430 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.873+0000 7fd434d68640 1 -- 172.21.15.44:0/3123088297 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd418003520 con 0x7fd430160430 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.873+0000 7fd43656b640 1 --2- 172.21.15.44:0/3123088297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300cccc0 0x7fd43006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd434d68640 1 -- 172.21.15.44:0/3123088297 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2033977001 0 0) 0x7fd418003520 con 0x7fd430160430 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd434d68640 1 -- 172.21.15.44:0/3123088297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300cccc0 msgr2=0x7fd43006c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd434d68640 1 --2- 172.21.15.44:0/3123088297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300cccc0 0x7fd43006c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd434d68640 1 -- 172.21.15.44:0/3123088297 >> v1:172.21.15.204:6789/0 conn(0x7fd4300b2d30 legacy=0x7fd43006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd434d68640 1 -- 172.21.15.44:0/3123088297 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43006d000 con 0x7fd430160430 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd434d68640 1 -- 172.21.15.44:0/3123088297 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fd428001670 con 0x7fd430160430 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd434d68640 1 -- 172.21.15.44:0/3123088297 >> v1:172.21.15.44:6789/0 conn(0x7fd430160430 legacy=0x7fd4300b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd434d68640 1 --2- 172.21.15.44:0/3123088297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300cccc0 0x7fd4180039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd434d68640 1 --2- 172.21.15.44:0/3123088297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd418003f20 0x7fd4180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd434d68640 1 --2- 172.21.15.44:0/3123088297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd418004d00 0x7fd418005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd434d68640 1 -- 172.21.15.44:0/3123088297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300cb580 con 0x7fd418004d00 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd434d68640 1 -- 172.21.15.44:0/3123088297 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41800bb10 con 0x7fd418003f20 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd434d68640 1 -- 172.21.15.44:0/3123088297 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41800bcd0 con 0x7fd4300cccc0 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd43656b640 1 --2- 172.21.15.44:0/3123088297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd418004d00 0x7fd418005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd435d6a640 1 --2- 172.21.15.44:0/3123088297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300cccc0 0x7fd4180039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd435569640 1 --2- 172.21.15.44:0/3123088297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd418003f20 0x7fd4180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd43656b640 1 -- 172.21.15.44:0/3123088297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300cccc0 msgr2=0x7fd4180039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd43656b640 1 --2- 172.21.15.44:0/3123088297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300cccc0 0x7fd4180039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd43656b640 1 -- 172.21.15.44:0/3123088297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd418003f20 msgr2=0x7fd4180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd43656b640 1 --2- 172.21.15.44:0/3123088297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd418003f20 0x7fd4180047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.874+0000 7fd43656b640 1 -- 172.21.15.44:0/3123088297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd418003520 con 0x7fd418004d00 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.875+0000 7fd43656b640 1 --2- 172.21.15.44:0/3123088297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd418004d00 0x7fd418005180 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd420009fc0 tx=0x7fd4180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdf60f23d313d90 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.875+0000 7fd434d68640 1 -- 172.21.15.44:0/3123088297 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42002cc20 con 0x7fd418004d00 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.875+0000 7fd434d68640 1 -- 172.21.15.44:0/3123088297 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42000f040 con 0x7fd418004d00 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.875+0000 7fd434d68640 1 -- 172.21.15.44:0/3123088297 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420034440 con 0x7fd418004d00 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.876+0000 7fd437fce640 1 -- 172.21.15.44:0/3123088297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd418004d00 msgr2=0x7fd418005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.876+0000 7fd437fce640 1 --2- 172.21.15.44:0/3123088297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd418004d00 0x7fd418005180 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd420009fc0 tx=0x7fd4180057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.876+0000 7fd43656b640 1 -- 172.21.15.44:0/3123088297 reap_dead start 2023-11-04T01:38:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.876+0000 7fd437fce640 1 -- 172.21.15.44:0/3123088297 shutdown_connections 2023-11-04T01:38:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.876+0000 7fd437fce640 1 -- 172.21.15.44:0/3123088297 >> 172.21.15.44:0/3123088297 conn(0x7fd43006ea20 msgr2=0x7fd43006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.876+0000 7fd437fce640 1 -- 172.21.15.44:0/3123088297 shutdown_connections 2023-11-04T01:38:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.876+0000 7fd437fce640 1 -- 172.21.15.44:0/3123088297 wait complete. 2023-11-04T01:38:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.877+0000 7fd437fce640 1 Processor -- start 2023-11-04T01:38:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.877+0000 7fd437fce640 1 -- start start 2023-11-04T01:38:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd437fce640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300b27d0 0x7fd4300ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd437fce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4301f63f0 0x7fd4301f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd437fce640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4301466b0 0x7fd430146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd437fce640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4301f6db0 con 0x7fd4301f63f0 2023-11-04T01:38:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd437fce640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300c8680 con 0x7fd4301466b0 2023-11-04T01:38:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd437fce640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300c88d0 con 0x7fd4300b27d0 2023-11-04T01:38:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd435569640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4301f63f0 0x7fd4301f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd435569640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4301f63f0 0x7fd4301f6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43992/0 (socket says 172.21.15.44:43992) 2023-11-04T01:38:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd435569640 1 -- 172.21.15.44:0/2882286855 learned_addr learned my addr 172.21.15.44:0/2882286855 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd435d6a640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300b27d0 0x7fd4300ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd43656b640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4301466b0 0x7fd430146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd435569640 1 -- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300b27d0 msgr2=0x7fd4300ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd435569640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300b27d0 0x7fd4300ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd435569640 1 -- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4301466b0 msgr2=0x7fd430146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd435569640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4301466b0 0x7fd430146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd435569640 1 -- 172.21.15.44:0/2882286855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4300c8bb0 con 0x7fd4301f63f0 2023-11-04T01:38:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd435d6a640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300b27d0 0x7fd4300ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd43656b640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4301466b0 0x7fd430146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:16.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd435569640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4301f63f0 0x7fd4301f6870 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd42400f820 tx=0x7fd42400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd42e7fc640 1 -- 172.21.15.44:0/2882286855 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4240050d0 con 0x7fd4301f63f0 2023-11-04T01:38:16.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd42e7fc640 1 -- 172.21.15.44:0/2882286855 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd424005230 con 0x7fd4301f63f0 2023-11-04T01:38:16.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd42e7fc640 1 -- 172.21.15.44:0/2882286855 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400d730 con 0x7fd4301f63f0 2023-11-04T01:38:16.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.878+0000 7fd437fce640 1 -- 172.21.15.44:0/2882286855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4300c8e90 con 0x7fd4301f63f0 2023-11-04T01:38:16.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.879+0000 7fd437fce640 1 -- 172.21.15.44:0/2882286855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd430147070 con 0x7fd4301f63f0 2023-11-04T01:38:16.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.880+0000 7fd437fce640 1 -- 172.21.15.44:0/2882286855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd430074290 con 0x7fd4301f63f0 2023-11-04T01:38:16.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.880+0000 7fd42e7fc640 1 -- 172.21.15.44:0/2882286855 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd42400d890 con 0x7fd4301f63f0 2023-11-04T01:38:16.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.880+0000 7fd42e7fc640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd41c06ae70 0x7fd41c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.880+0000 7fd42e7fc640 1 -- 172.21.15.44:0/2882286855 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd424089540 con 0x7fd4301f63f0 2023-11-04T01:38:16.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.881+0000 7fd435d6a640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd41c06ae70 0x7fd41c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.881+0000 7fd435d6a640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd41c06ae70 0x7fd41c06d330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd428004840 tx=0x7fd428009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:16.884+0000 7fd42e7fc640 1 -- 172.21.15.44:0/2882286855 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd424054660 con 0x7fd4301f63f0 2023-11-04T01:38:17.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.064+0000 7fd437fce640 1 -- 172.21.15.44:0/2882286855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd4300b6b20 con 0x7fd4301f63f0 2023-11-04T01:38:17.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.067+0000 7fd42e7fc640 1 -- 172.21.15.44:0/2882286855 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v15)=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd424057c80 con 0x7fd4301f63f0 2023-11-04T01:38:17.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.069+0000 7fd437fce640 1 -- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd41c06ae70 msgr2=0x7fd41c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.069+0000 7fd437fce640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd41c06ae70 0x7fd41c06d330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd428004840 tx=0x7fd428009040 comp rx=0 tx=0).stop 2023-11-04T01:38:17.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.069+0000 7fd437fce640 1 -- 172.21.15.44:0/2882286855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4301f63f0 msgr2=0x7fd4301f6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.069+0000 7fd437fce640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4301f63f0 0x7fd4301f6870 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd42400f820 tx=0x7fd42400fce0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.069+0000 7fd437fce640 1 -- 172.21.15.44:0/2882286855 shutdown_connections 2023-11-04T01:38:17.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.069+0000 7fd437fce640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd41c06ae70 0x7fd41c06d330 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.069+0000 7fd437fce640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4301466b0 0x7fd430146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.069+0000 7fd437fce640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4301f63f0 0x7fd4301f6870 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.069+0000 7fd437fce640 1 --2- 172.21.15.44:0/2882286855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300b27d0 0x7fd4300ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.069+0000 7fd437fce640 1 -- 172.21.15.44:0/2882286855 >> 172.21.15.44:0/2882286855 conn(0x7fd43006ea20 msgr2=0x7fd4300cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:17.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.069+0000 7fd437fce640 1 -- 172.21.15.44:0/2882286855 shutdown_connections 2023-11-04T01:38:17.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.069+0000 7fd437fce640 1 -- 172.21.15.44:0/2882286855 wait complete. 2023-11-04T01:38:17.081 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:38:17.082 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:17.151 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:17.192 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:38:17.193 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:38:17.193 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:17.209 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:17.209 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:38:17.209 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:17.250 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:17.251 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:38:17.251 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:17.266 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:17.267 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:38:17.267 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:17.308 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:17.308 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:38:17.308 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:17.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.412+0000 7fbe4b6a9640 1 Processor -- start 2023-11-04T01:38:17.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.412+0000 7fbe4b6a9640 1 -- start start 2023-11-04T01:38:17.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.413+0000 7fbe4b6a9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbe440cde60 0x7fbe4415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.413+0000 7fbe4b6a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbe440ce240 0x7fbe440d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.413+0000 7fbe4b6a9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4415e000 con 0x7fbe4415daa0 2023-11-04T01:38:17.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.413+0000 7fbe4b6a9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4415e5c0 con 0x7fbe440ce240 2023-11-04T01:38:17.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.413+0000 7fbe4b6a9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4415e2e0 con 0x7fbe440cde60 2023-11-04T01:38:17.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.413+0000 7fbe49c46640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbe440ce240 0x7fbe440d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.413+0000 7fbe48c44640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbe4415daa0 0x7fbe44157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41340/0 (socket says 172.21.15.44:41340) 2023-11-04T01:38:17.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.413+0000 7fbe48c44640 1 -- 172.21.15.44:0/2436353834 learned_addr learned my addr 172.21.15.44:0/2436353834 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:17.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.413+0000 7fbe49c46640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbe440ce240 0x7fbe440d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43996/0 (socket says 172.21.15.44:43996) 2023-11-04T01:38:17.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.414+0000 7fbe49445640 1 --2- 172.21.15.44:0/2436353834 >> v2:172.21.15.204:3300/0 conn(0x7fbe440cde60 0x7fbe4415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.414+0000 7fbe49c46640 1 -- 172.21.15.44:0/2436353834 >> v2:172.21.15.204:3300/0 conn(0x7fbe440cde60 msgr2=0x7fbe4415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:17.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.414+0000 7fbe49c46640 1 --2- 172.21.15.44:0/2436353834 >> v2:172.21.15.204:3300/0 conn(0x7fbe440cde60 0x7fbe4415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.414+0000 7fbe49c46640 1 -- 172.21.15.44:0/2436353834 >> v1:172.21.15.44:6789/0 conn(0x7fbe4415daa0 legacy=0x7fbe44157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.414+0000 7fbe43fff640 1 -- 172.21.15.44:0/2436353834 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418469799 0 0) 0x7fbe4415e000 con 0x7fbe4415daa0 2023-11-04T01:38:17.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.414+0000 7fbe49c46640 1 -- 172.21.15.44:0/2436353834 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe440d1120 con 0x7fbe440ce240 2023-11-04T01:38:17.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.414+0000 7fbe49c46640 1 --2- 172.21.15.44:0/2436353834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe440ce240 0x7fbe440d1920 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fbe440b5550 tx=0x7fbe3402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd016608d9a2b44 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:17.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.415+0000 7fbe43fff640 1 -- 172.21.15.44:0/2436353834 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3402cc80 con 0x7fbe440ce240 2023-11-04T01:38:17.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.415+0000 7fbe43fff640 1 -- 172.21.15.44:0/2436353834 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3402cde0 con 0x7fbe440ce240 2023-11-04T01:38:17.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.415+0000 7fbe43fff640 1 -- 172.21.15.44:0/2436353834 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34034660 con 0x7fbe440ce240 2023-11-04T01:38:17.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.415+0000 7fbe4b6a9640 1 -- 172.21.15.44:0/2436353834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe440ce240 msgr2=0x7fbe440d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.415+0000 7fbe4b6a9640 1 --2- 172.21.15.44:0/2436353834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe440ce240 0x7fbe440d1920 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fbe440b5550 tx=0x7fbe3402bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.415+0000 7fbe4b6a9640 1 -- 172.21.15.44:0/2436353834 shutdown_connections 2023-11-04T01:38:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.415+0000 7fbe4b6a9640 1 --2- 172.21.15.44:0/2436353834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe440ce240 0x7fbe440d1920 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.415+0000 7fbe4b6a9640 1 --2- 172.21.15.44:0/2436353834 >> v2:172.21.15.204:3300/0 conn(0x7fbe440cde60 0x7fbe4415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.415+0000 7fbe4b6a9640 1 -- 172.21.15.44:0/2436353834 >> 172.21.15.44:0/2436353834 conn(0x7fbe44071f30 msgr2=0x7fbe440cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.415+0000 7fbe4b6a9640 1 -- 172.21.15.44:0/2436353834 shutdown_connections 2023-11-04T01:38:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.415+0000 7fbe4b6a9640 1 -- 172.21.15.44:0/2436353834 wait complete. 2023-11-04T01:38:17.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.416+0000 7fbe4b6a9640 1 Processor -- start 2023-11-04T01:38:17.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.416+0000 7fbe4b6a9640 1 -- start start 2023-11-04T01:38:17.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.417+0000 7fbe4b6a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe440cde60 0x7fbe44151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.417+0000 7fbe4b6a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe440ce240 0x7fbe440d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.417+0000 7fbe4b6a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe4415daa0 0x7fbe440d3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.417+0000 7fbe4b6a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe441f29d0 con 0x7fbe440ce240 2023-11-04T01:38:17.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.417+0000 7fbe4b6a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe441e3810 con 0x7fbe440cde60 2023-11-04T01:38:17.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.417+0000 7fbe4b6a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe441f6ed0 con 0x7fbe4415daa0 2023-11-04T01:38:17.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.417+0000 7fbe48c44640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe440ce240 0x7fbe440d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.417+0000 7fbe48c44640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe440ce240 0x7fbe440d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44004/0 (socket says 172.21.15.44:44004) 2023-11-04T01:38:17.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.417+0000 7fbe48c44640 1 -- 172.21.15.44:0/3122137430 learned_addr learned my addr 172.21.15.44:0/3122137430 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:17.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.417+0000 7fbe49c46640 1 --2- 172.21.15.44:0/3122137430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe4415daa0 0x7fbe440d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.417+0000 7fbe49445640 1 --2- 172.21.15.44:0/3122137430 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe440cde60 0x7fbe44151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.418+0000 7fbe48c44640 1 -- 172.21.15.44:0/3122137430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe4415daa0 msgr2=0x7fbe440d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.418+0000 7fbe48c44640 1 --2- 172.21.15.44:0/3122137430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe4415daa0 0x7fbe440d3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.418+0000 7fbe48c44640 1 -- 172.21.15.44:0/3122137430 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe440cde60 msgr2=0x7fbe44151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.418+0000 7fbe48c44640 1 --2- 172.21.15.44:0/3122137430 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe440cde60 0x7fbe44151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.418+0000 7fbe48c44640 1 -- 172.21.15.44:0/3122137430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe34009a70 con 0x7fbe440ce240 2023-11-04T01:38:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.418+0000 7fbe48c44640 1 --2- 172.21.15.44:0/3122137430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe440ce240 0x7fbe440d2e00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800c440 tx=0x7fbe3800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.418+0000 7fbe41ffb640 1 -- 172.21.15.44:0/3122137430 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe380074e0 con 0x7fbe440ce240 2023-11-04T01:38:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.418+0000 7fbe41ffb640 1 -- 172.21.15.44:0/3122137430 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe38007640 con 0x7fbe440ce240 2023-11-04T01:38:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.418+0000 7fbe4b6a9640 1 -- 172.21.15.44:0/3122137430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe441f6bf0 con 0x7fbe440ce240 2023-11-04T01:38:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.418+0000 7fbe41ffb640 1 -- 172.21.15.44:0/3122137430 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38004a20 con 0x7fbe440ce240 2023-11-04T01:38:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.418+0000 7fbe4b6a9640 1 -- 172.21.15.44:0/3122137430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe441f2ea0 con 0x7fbe440ce240 2023-11-04T01:38:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.419+0000 7fbe4b6a9640 1 -- 172.21.15.44:0/3122137430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe44074290 con 0x7fbe440ce240 2023-11-04T01:38:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.420+0000 7fbe41ffb640 1 -- 172.21.15.44:0/3122137430 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe38004b80 con 0x7fbe440ce240 2023-11-04T01:38:17.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.420+0000 7fbe41ffb640 1 --2- 172.21.15.44:0/3122137430 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbe3006ae70 0x7fbe3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.420+0000 7fbe41ffb640 1 -- 172.21.15.44:0/3122137430 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fbe38088a10 con 0x7fbe440ce240 2023-11-04T01:38:17.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.420+0000 7fbe49445640 1 --2- 172.21.15.44:0/3122137430 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbe3006ae70 0x7fbe3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.421+0000 7fbe49445640 1 --2- 172.21.15.44:0/3122137430 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbe3006ae70 0x7fbe3006d330 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c006fd0 tx=0x7fbe3c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:17.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.424+0000 7fbe41ffb640 1 -- 172.21.15.44:0/3122137430 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe380575b0 con 0x7fbe440ce240 2023-11-04T01:38:17.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.636+0000 7fbe4b6a9640 1 -- 172.21.15.44:0/3122137430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe440d23f0 con 0x7fbe440ce240 2023-11-04T01:38:17.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.636+0000 7fbe41ffb640 1 -- 172.21.15.44:0/3122137430 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3699 (secure 0 0 0) 0x7fbe38018020 con 0x7fbe440ce240 2023-11-04T01:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/683817288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":683817288},{"type":"v1","addr":"172.21.15.44:6835","nonce":683817288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5306,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/4160536413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":4160536413},{"type":"v1","addr":"172.21.15.204:6836","nonce":4160536413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/1970301848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1970301848},{"type":"v1","addr":"172.21.15.204:6837","nonce":1970301848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6321,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/565429472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":565429472},{"type":"v1","addr":"172.21.15.44:6834","nonce":565429472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[]} 2023-11-04T01:38:17.639 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 26 2023-11-04T01:38:17.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.638+0000 7fbe4b6a9640 1 -- 172.21.15.44:0/3122137430 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbe3006ae70 msgr2=0x7fbe3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.638+0000 7fbe4b6a9640 1 --2- 172.21.15.44:0/3122137430 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbe3006ae70 0x7fbe3006d330 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c006fd0 tx=0x7fbe3c008040 comp rx=0 tx=0).stop 2023-11-04T01:38:17.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.638+0000 7fbe4b6a9640 1 -- 172.21.15.44:0/3122137430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe440ce240 msgr2=0x7fbe440d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.638+0000 7fbe4b6a9640 1 --2- 172.21.15.44:0/3122137430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe440ce240 0x7fbe440d2e00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800c440 tx=0x7fbe3800c900 comp rx=0 tx=0).stop 2023-11-04T01:38:17.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.638+0000 7fbe4b6a9640 1 -- 172.21.15.44:0/3122137430 shutdown_connections 2023-11-04T01:38:17.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.638+0000 7fbe4b6a9640 1 --2- 172.21.15.44:0/3122137430 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbe3006ae70 0x7fbe3006d330 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.638+0000 7fbe4b6a9640 1 --2- 172.21.15.44:0/3122137430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe4415daa0 0x7fbe440d3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.638+0000 7fbe4b6a9640 1 --2- 172.21.15.44:0/3122137430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe440ce240 0x7fbe440d2e00 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.638+0000 7fbe4b6a9640 1 --2- 172.21.15.44:0/3122137430 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe440cde60 0x7fbe44151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.638+0000 7fbe4b6a9640 1 -- 172.21.15.44:0/3122137430 >> 172.21.15.44:0/3122137430 conn(0x7fbe44071f30 msgr2=0x7fbe440cd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:17.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.638+0000 7fbe4b6a9640 1 -- 172.21.15.44:0/3122137430 shutdown_connections 2023-11-04T01:38:17.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.638+0000 7fbe4b6a9640 1 -- 172.21.15.44:0/3122137430 wait complete. 2023-11-04T01:38:17.651 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:38:17.651 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:38:17.652 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:38:17.652 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:17.652 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:38:17.652 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:38:17.652 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:38:17.652 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:17.652 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:38:17.653 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:38:17.653 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:38:17.653 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:17.653 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:38:17.653 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:38:17.653 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:38:17.653 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:17.661 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:38:17.661 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:38:17.662 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:38:17.662 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:38:17.664 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:38:17.665 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:38:17.665 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:38:17.666 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:38:17.705 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:38:17.706 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:17.707 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:38:17.707 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:17.708 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:38:17.708 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:17.709 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:38:17.709 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:17.709 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:38:17.788 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2023-11-04T01:38:17.789 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2023-11-04T01:38:17.789 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2023-11-04T01:38:17.790 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2023-11-04T01:38:17.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.821+0000 7ff260d25640 1 Processor -- start 2023-11-04T01:38:17.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.821+0000 7ff260d25640 1 -- start start 2023-11-04T01:38:17.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.822+0000 7ff260d25640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c153e60 0x7ff25c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.822+0000 7ff260d25640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff25c0b4880 0x7ff25c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.822+0000 7ff260d25640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25c0cde60 con 0x7ff25c0cd6d0 2023-11-04T01:38:17.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.822+0000 7ff260d25640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff25c0b5230 con 0x7ff25c0b4880 2023-11-04T01:38:17.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.822+0000 7ff260d25640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c160f90 con 0x7ff25c153e60 2023-11-04T01:38:17.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.822+0000 7ff25a59c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c153e60 0x7ff25c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.823+0000 7ff25ad9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff25c0b4880 0x7ff25c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.823+0000 7ff259d9b640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7ff25c0cd6d0 0x7ff25c161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:33576/0 (socket says 172.21.15.44:33576) 2023-11-04T01:38:17.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.823+0000 7ff259d9b640 1 -- 172.21.15.44:0/2675681094 learned_addr learned my addr 172.21.15.44:0/2675681094 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:17.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.823+0000 7ff25959a640 1 -- 172.21.15.44:0/2675681094 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386708561 0 0) 0x7ff25c0cde60 con 0x7ff25c0cd6d0 2023-11-04T01:38:17.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.823+0000 7ff25959a640 1 -- 172.21.15.44:0/2675681094 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff244003520 con 0x7ff25c0cd6d0 2023-11-04T01:38:17.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.823+0000 7ff25a59c640 1 -- 172.21.15.44:0/2675681094 >> v2:172.21.15.204:3300/0 conn(0x7ff25c0b4880 msgr2=0x7ff25c0b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:17.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.823+0000 7ff25a59c640 1 --2- 172.21.15.44:0/2675681094 >> v2:172.21.15.204:3300/0 conn(0x7ff25c0b4880 0x7ff25c0b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.823+0000 7ff25a59c640 1 -- 172.21.15.44:0/2675681094 >> v1:172.21.15.204:6789/0 conn(0x7ff25c0cd6d0 legacy=0x7ff25c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.823+0000 7ff25a59c640 1 -- 172.21.15.44:0/2675681094 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c15e400 con 0x7ff25c153e60 2023-11-04T01:38:17.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.823+0000 7ff25ad9d640 1 --2- 172.21.15.44:0/2675681094 >> v2:172.21.15.204:3300/0 conn(0x7ff25c0b4880 0x7ff25c0b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:17.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.824+0000 7ff25a59c640 1 --2- 172.21.15.44:0/2675681094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c153e60 0x7ff25c15dec0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009d90 tx=0x7ff24c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=714362cd390b32ae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:17.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.824+0000 7ff25959a640 1 -- 172.21.15.44:0/2675681094 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c02cc50 con 0x7ff25c153e60 2023-11-04T01:38:17.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.824+0000 7ff25959a640 1 -- 172.21.15.44:0/2675681094 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c02cdb0 con 0x7ff25c153e60 2023-11-04T01:38:17.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.824+0000 7ff25959a640 1 -- 172.21.15.44:0/2675681094 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c034640 con 0x7ff25c153e60 2023-11-04T01:38:17.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.824+0000 7ff260d25640 1 -- 172.21.15.44:0/2675681094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c153e60 msgr2=0x7ff25c15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.824+0000 7ff260d25640 1 --2- 172.21.15.44:0/2675681094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c153e60 0x7ff25c15dec0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009d90 tx=0x7ff24c02bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.825+0000 7ff260d25640 1 -- 172.21.15.44:0/2675681094 shutdown_connections 2023-11-04T01:38:17.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.825+0000 7ff260d25640 1 --2- 172.21.15.44:0/2675681094 >> v2:172.21.15.204:3300/0 conn(0x7ff25c0b4880 0x7ff25c0b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.825+0000 7ff260d25640 1 --2- 172.21.15.44:0/2675681094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c153e60 0x7ff25c15dec0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.825+0000 7ff260d25640 1 -- 172.21.15.44:0/2675681094 >> 172.21.15.44:0/2675681094 conn(0x7ff25c0cf880 msgr2=0x7ff25c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:17.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.825+0000 7ff260d25640 1 -- 172.21.15.44:0/2675681094 shutdown_connections 2023-11-04T01:38:17.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.825+0000 7ff260d25640 1 -- 172.21.15.44:0/2675681094 wait complete. 2023-11-04T01:38:17.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.826+0000 7ff260d25640 1 Processor -- start 2023-11-04T01:38:17.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.826+0000 7ff260d25640 1 -- start start 2023-11-04T01:38:17.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff260d25640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff25c0b4880 0x7ff25c150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff260d25640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c0cd6d0 0x7ff25c1f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff260d25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff25c153e60 0x7ff25c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff260d25640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c1f69e0 con 0x7ff25c153e60 2023-11-04T01:38:17.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff260d25640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0c8f00 con 0x7ff25c0b4880 2023-11-04T01:38:17.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff260d25640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0c8a70 con 0x7ff25c0cd6d0 2023-11-04T01:38:17.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff25ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff25c153e60 0x7ff25c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff259d9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c0cd6d0 0x7ff25c1f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff25a59c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff25c0b4880 0x7ff25c150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff25ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff25c153e60 0x7ff25c0b7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44030/0 (socket says 172.21.15.44:44030) 2023-11-04T01:38:17.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff25ad9d640 1 -- 172.21.15.44:0/1169421833 learned_addr learned my addr 172.21.15.44:0/1169421833 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:17.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff25ad9d640 1 -- 172.21.15.44:0/1169421833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c0cd6d0 msgr2=0x7ff25c1f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff25ad9d640 1 --2- 172.21.15.44:0/1169421833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c0cd6d0 0x7ff25c1f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff25ad9d640 1 -- 172.21.15.44:0/1169421833 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff25c0b4880 msgr2=0x7ff25c150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff25ad9d640 1 --2- 172.21.15.44:0/1169421833 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff25c0b4880 0x7ff25c150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.827+0000 7ff25ad9d640 1 -- 172.21.15.44:0/1169421833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff254009400 con 0x7ff25c153e60 2023-11-04T01:38:17.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.828+0000 7ff25ad9d640 1 --2- 172.21.15.44:0/1169421833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff25c153e60 0x7ff25c0b7150 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff25400e930 tx=0x7ff25400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:17.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.828+0000 7ff24affd640 1 -- 172.21.15.44:0/1169421833 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff254009700 con 0x7ff25c153e60 2023-11-04T01:38:17.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.828+0000 7ff24affd640 1 -- 172.21.15.44:0/1169421833 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25400ca00 con 0x7ff25c153e60 2023-11-04T01:38:17.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.828+0000 7ff260d25640 1 -- 172.21.15.44:0/1169421833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff24c009a70 con 0x7ff25c153e60 2023-11-04T01:38:17.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.828+0000 7ff24affd640 1 -- 172.21.15.44:0/1169421833 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25400cd90 con 0x7ff25c153e60 2023-11-04T01:38:17.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.828+0000 7ff260d25640 1 -- 172.21.15.44:0/1169421833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25c0c8140 con 0x7ff25c153e60 2023-11-04T01:38:17.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.829+0000 7ff260d25640 1 -- 172.21.15.44:0/1169421833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25c074290 con 0x7ff25c153e60 2023-11-04T01:38:17.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.829+0000 7ff24affd640 1 -- 172.21.15.44:0/1169421833 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff254013470 con 0x7ff25c153e60 2023-11-04T01:38:17.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.830+0000 7ff24affd640 1 --2- 172.21.15.44:0/1169421833 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff23c06aef0 0x7ff23c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.830+0000 7ff24affd640 1 -- 172.21.15.44:0/1169421833 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5616+0+0 (secure 0 0 0) 0x7ff254088fd0 con 0x7ff25c153e60 2023-11-04T01:38:17.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.830+0000 7ff25a59c640 1 --2- 172.21.15.44:0/1169421833 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff23c06aef0 0x7ff23c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.831+0000 7ff25a59c640 1 --2- 172.21.15.44:0/1169421833 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff23c06aef0 0x7ff23c06d3b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff24c036000 tx=0x7ff24c030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:17.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:17.834+0000 7ff24affd640 1 -- 172.21.15.44:0/1169421833 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff254054350 con 0x7ff25c153e60 2023-11-04T01:38:18.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.023+0000 7ff260d25640 1 -- 172.21.15.44:0/1169421833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff25c0c8bb0 con 0x7ff25c153e60 2023-11-04T01:38:18.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.758+0000 7ff24affd640 1 -- 172.21.15.44:0/1169421833 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff254057970 con 0x7ff25c153e60 2023-11-04T01:38:18.760 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2023-11-04T01:38:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.761+0000 7ff260d25640 1 -- 172.21.15.44:0/1169421833 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff23c06aef0 msgr2=0x7ff23c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.761+0000 7ff260d25640 1 --2- 172.21.15.44:0/1169421833 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff23c06aef0 0x7ff23c06d3b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff24c036000 tx=0x7ff24c030000 comp rx=0 tx=0).stop 2023-11-04T01:38:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.761+0000 7ff260d25640 1 -- 172.21.15.44:0/1169421833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff25c153e60 msgr2=0x7ff25c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.761+0000 7ff260d25640 1 --2- 172.21.15.44:0/1169421833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff25c153e60 0x7ff25c0b7150 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff25400e930 tx=0x7ff25400edf0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.761+0000 7ff260d25640 1 -- 172.21.15.44:0/1169421833 shutdown_connections 2023-11-04T01:38:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.761+0000 7ff260d25640 1 --2- 172.21.15.44:0/1169421833 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff23c06aef0 0x7ff23c06d3b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.761+0000 7ff260d25640 1 --2- 172.21.15.44:0/1169421833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff25c153e60 0x7ff25c0b7150 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.761+0000 7ff260d25640 1 --2- 172.21.15.44:0/1169421833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c0cd6d0 0x7ff25c1f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.761+0000 7ff260d25640 1 --2- 172.21.15.44:0/1169421833 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff25c0b4880 0x7ff25c150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.761+0000 7ff260d25640 1 -- 172.21.15.44:0/1169421833 >> 172.21.15.44:0/1169421833 conn(0x7ff25c0cf880 msgr2=0x7ff25c0d3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.762+0000 7ff260d25640 1 -- 172.21.15.44:0/1169421833 shutdown_connections 2023-11-04T01:38:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.762+0000 7ff260d25640 1 -- 172.21.15.44:0/1169421833 wait complete. 2023-11-04T01:38:18.778 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:38:18.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.888+0000 7f3175dc9640 1 Processor -- start 2023-11-04T01:38:18.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.888+0000 7f3175dc9640 1 -- start start 2023-11-04T01:38:18.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f3175dc9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f317015ce60 0x7f317006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f3175dc9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f317006bd30 0x7f3170160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f3175dc9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3170161050 0x7f31700cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f3175dc9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31700cbde0 con 0x7f317015ce60 2023-11-04T01:38:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f3175dc9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31701615d0 con 0x7f317006bd30 2023-11-04T01:38:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f3175dc9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31701618b0 con 0x7f3170161050 2023-11-04T01:38:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f316f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f317015ce60 0x7f317006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f316f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f317015ce60 0x7f317006b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44038/0 (socket says 172.21.15.44:44038) 2023-11-04T01:38:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f316f7fe640 1 -- 172.21.15.44:0/3240964949 learned_addr learned my addr 172.21.15.44:0/3240964949 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f316f7fe640 1 -- 172.21.15.44:0/3240964949 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3170161050 msgr2=0x7f31700cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f316f7fe640 1 --2- 172.21.15.44:0/3240964949 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3170161050 0x7f31700cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f316f7fe640 1 -- 172.21.15.44:0/3240964949 >> v2:172.21.15.204:3300/0 conn(0x7f317006bd30 msgr2=0x7f3170160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f316effd640 1 --2- 172.21.15.44:0/3240964949 >> v2:172.21.15.204:3300/0 conn(0x7f317006bd30 0x7f3170160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f316f7fe640 1 --2- 172.21.15.44:0/3240964949 >> v2:172.21.15.204:3300/0 conn(0x7f317006bd30 0x7f3170160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f316f7fe640 1 -- 172.21.15.44:0/3240964949 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31700cba00 con 0x7f317015ce60 2023-11-04T01:38:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.889+0000 7f316effd640 1 --2- 172.21.15.44:0/3240964949 >> v2:172.21.15.204:3300/0 conn(0x7f317006bd30 0x7f3170160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:18.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.890+0000 7f316f7fe640 1 --2- 172.21.15.44:0/3240964949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317015ce60 0x7f317006b7f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3170072590 tx=0x7f316002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5040d7d0e12fae55 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:18.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.890+0000 7f316e7fc640 1 -- 172.21.15.44:0/3240964949 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160031870 con 0x7f317015ce60 2023-11-04T01:38:18.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.890+0000 7f316e7fc640 1 -- 172.21.15.44:0/3240964949 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31600319d0 con 0x7f317015ce60 2023-11-04T01:38:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.890+0000 7f316e7fc640 1 -- 172.21.15.44:0/3240964949 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160031d60 con 0x7f317015ce60 2023-11-04T01:38:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.891+0000 7f3175dc9640 1 -- 172.21.15.44:0/3240964949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317015ce60 msgr2=0x7f317006b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.891+0000 7f3175dc9640 1 --2- 172.21.15.44:0/3240964949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317015ce60 0x7f317006b7f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3170072590 tx=0x7f316002b910 comp rx=0 tx=0).stop 2023-11-04T01:38:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.891+0000 7f3175dc9640 1 -- 172.21.15.44:0/3240964949 shutdown_connections 2023-11-04T01:38:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.891+0000 7f3175dc9640 1 --2- 172.21.15.44:0/3240964949 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3170161050 0x7f31700cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.891+0000 7f3175dc9640 1 --2- 172.21.15.44:0/3240964949 >> v2:172.21.15.204:3300/0 conn(0x7f317006bd30 0x7f3170160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.891+0000 7f3175dc9640 1 --2- 172.21.15.44:0/3240964949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317015ce60 0x7f317006b7f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.891+0000 7f3175dc9640 1 -- 172.21.15.44:0/3240964949 >> 172.21.15.44:0/3240964949 conn(0x7f317006ea90 msgr2=0x7f317006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.891+0000 7f3175dc9640 1 -- 172.21.15.44:0/3240964949 shutdown_connections 2023-11-04T01:38:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.891+0000 7f3175dc9640 1 -- 172.21.15.44:0/3240964949 wait complete. 2023-11-04T01:38:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.892+0000 7f3175dc9640 1 Processor -- start 2023-11-04T01:38:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.892+0000 7f3175dc9640 1 -- start start 2023-11-04T01:38:18.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f3175dc9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f317015ce60 0x7f31701f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:18.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f3175dc9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3170161050 0x7f31700b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:18.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f3175dc9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3170160090 0x7f31700c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:18.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f3175dc9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31701f26c0 con 0x7f3170161050 2023-11-04T01:38:18.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f3175dc9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317015e3f0 con 0x7f317015ce60 2023-11-04T01:38:18.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f3175dc9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31701f3e20 con 0x7f3170160090 2023-11-04T01:38:18.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f316effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3170161050 0x7f31700b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:18.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f316effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3170161050 0x7f31700b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44054/0 (socket says 172.21.15.44:44054) 2023-11-04T01:38:18.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f316effd640 1 -- 172.21.15.44:0/4200265876 learned_addr learned my addr 172.21.15.44:0/4200265876 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:18.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f316f7fe640 1 --2- 172.21.15.44:0/4200265876 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f317015ce60 0x7f31701f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:18.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f316ffff640 1 --2- 172.21.15.44:0/4200265876 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3170160090 0x7f31700c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:18.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f316effd640 1 -- 172.21.15.44:0/4200265876 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3170160090 msgr2=0x7f31700c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:18.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f316effd640 1 --2- 172.21.15.44:0/4200265876 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3170160090 0x7f31700c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f316effd640 1 -- 172.21.15.44:0/4200265876 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f317015ce60 msgr2=0x7f31701f38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f316effd640 1 --2- 172.21.15.44:0/4200265876 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f317015ce60 0x7f31701f38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.893+0000 7f316effd640 1 -- 172.21.15.44:0/4200265876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31600094d0 con 0x7f3170161050 2023-11-04T01:38:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.894+0000 7f316effd640 1 --2- 172.21.15.44:0/4200265876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3170161050 0x7f31700b54a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f316400c7f0 tx=0x7f316400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.894+0000 7f3157fff640 1 -- 172.21.15.44:0/4200265876 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164007820 con 0x7f3170161050 2023-11-04T01:38:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.894+0000 7f3157fff640 1 -- 172.21.15.44:0/4200265876 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3164007980 con 0x7f3170161050 2023-11-04T01:38:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.894+0000 7f3175dc9640 1 -- 172.21.15.44:0/4200265876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31700b5110 con 0x7f3170161050 2023-11-04T01:38:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.894+0000 7f3157fff640 1 -- 172.21.15.44:0/4200265876 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164007cf0 con 0x7f3170161050 2023-11-04T01:38:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.894+0000 7f3175dc9640 1 -- 172.21.15.44:0/4200265876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317015d870 con 0x7f3170161050 2023-11-04T01:38:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.895+0000 7f3175dc9640 1 -- 172.21.15.44:0/4200265876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3170074290 con 0x7f3170161050 2023-11-04T01:38:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.895+0000 7f3157fff640 1 -- 172.21.15.44:0/4200265876 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31640113f0 con 0x7f3170161050 2023-11-04T01:38:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.896+0000 7f3157fff640 1 --2- 172.21.15.44:0/4200265876 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f315c06aea0 0x7f315c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:18.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.896+0000 7f3157fff640 1 -- 172.21.15.44:0/4200265876 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f3164089760 con 0x7f3170161050 2023-11-04T01:38:18.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.896+0000 7f316f7fe640 1 --2- 172.21.15.44:0/4200265876 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f315c06aea0 0x7f315c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:18.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.897+0000 7f316f7fe640 1 --2- 172.21.15.44:0/4200265876 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f315c06aea0 0x7f315c06d360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3160036000 tx=0x7f316003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:18.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:18.900+0000 7f3157fff640 1 -- 172.21.15.44:0/4200265876 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3164054950 con 0x7f3170161050 2023-11-04T01:38:19.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.147+0000 7f3175dc9640 1 -- 172.21.15.44:0/4200265876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f317006b3e0 con 0x7f3170161050 2023-11-04T01:38:19.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.147+0000 7f3157fff640 1 -- 172.21.15.44:0/4200265876 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3164057f70 con 0x7f3170161050 2023-11-04T01:38:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:19.150 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:38:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2023-11-04T01:38:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2023-11-04T01:38:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0Vldrw2ExAA5cS9IfcK2l8SXaZdWm4f8g==", 2023-11-04T01:38:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:38:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:38:19.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlOogfIRAAYEw/sXZBXk/GJOrnBTA7xg==", 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlDPc/GxAA32BghmM85xfJ14TjYFtNRw==", 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlYpOSKBAAVivyMFmzkREyWWFObAwKHw==", 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:38:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:38:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2023-11-04T01:38:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDIn0VlTfR3ExAAt6S9NmZfuM9CoPfVNGkhmA==", 2023-11-04T01:38:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:19.153 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2023-11-04T01:38:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDLn0VlqkLfExAABN3cHR+cDXm0tN4tpWR+0w==", 2023-11-04T01:38:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2023-11-04T01:38:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDOn0Vl9JO/EhAAuC0w9vFxOiRs7Tm3UZHVXg==", 2023-11-04T01:38:19.154 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDRn0VlKSy2EhAAerLDC/nZsTK5KdG+Q1Ycow==", 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDXn0Vl9FINGxAA5lLkwH709SJ00yfxB6MCaw==", 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDan0Vlo5v3GRAA/ZGOqGFMxQuGirRMadC+9Q==", 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDdn0Vl+q9GGBAA7obGN4GMa7glnpuDSQKV2g==", 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2023-11-04T01:38:19.158 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDgn0VlbLVCFxAANjcDDYPfWCNGQF1twWc35w==", 2023-11-04T01:38:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.159 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2023-11-04T01:38:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlmqcrLRAAFCsu/sJUUh45gPboIgq6Dw==", 2023-11-04T01:38:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow r", 2023-11-04T01:38:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:38:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.160 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2023-11-04T01:38:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlSFWINBAAAvkXSoHilQ3GXBE61Tvx2w==", 2023-11-04T01:38:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:38:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:38:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:38:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.161 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2023-11-04T01:38:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0Vlcp71MBAAkYQz0CUf7LY9WIvX0mXzKg==", 2023-11-04T01:38:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:38:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:38:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:38:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2023-11-04T01:38:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0Vl08lCOhAAQxQts3txc7gsu8txLGzouA==", 2023-11-04T01:38:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.162 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:38:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:38:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:38:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2023-11-04T01:38:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDDn0VlgZZFMBAA94xTIAij5lx9yGEyPDd/SQ==", 2023-11-04T01:38:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2023-11-04T01:38:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:38:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:38:19.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2023-11-04T01:38:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlSeFMDxAAwW0lbfxAbIKPgPCkJD1FMg==", 2023-11-04T01:38:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2023-11-04T01:38:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2023-11-04T01:38:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2023-11-04T01:38:19.164 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlX+8eCxAAuBbLfpXHKHIIDc4zo9Insw==", 2023-11-04T01:38:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2023-11-04T01:38:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2023-11-04T01:38:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:19.165 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2023-11-04T01:38:19.165 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:38:19.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.150+0000 7f3175dc9640 1 -- 172.21.15.44:0/4200265876 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f315c06aea0 msgr2=0x7f315c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.150+0000 7f3175dc9640 1 --2- 172.21.15.44:0/4200265876 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f315c06aea0 0x7f315c06d360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3160036000 tx=0x7f316003c040 comp rx=0 tx=0).stop 2023-11-04T01:38:19.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.150+0000 7f3175dc9640 1 -- 172.21.15.44:0/4200265876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3170161050 msgr2=0x7f31700b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.150+0000 7f3175dc9640 1 --2- 172.21.15.44:0/4200265876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3170161050 0x7f31700b54a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f316400c7f0 tx=0x7f316400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.150+0000 7f3175dc9640 1 -- 172.21.15.44:0/4200265876 shutdown_connections 2023-11-04T01:38:19.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.150+0000 7f3175dc9640 1 --2- 172.21.15.44:0/4200265876 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f315c06aea0 0x7f315c06d360 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.150+0000 7f3175dc9640 1 --2- 172.21.15.44:0/4200265876 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3170160090 0x7f31700c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.150+0000 7f3175dc9640 1 --2- 172.21.15.44:0/4200265876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3170161050 0x7f31700b54a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.150+0000 7f3175dc9640 1 --2- 172.21.15.44:0/4200265876 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f317015ce60 0x7f31701f38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.150+0000 7f3175dc9640 1 -- 172.21.15.44:0/4200265876 >> 172.21.15.44:0/4200265876 conn(0x7f317006ea90 msgr2=0x7f31700b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:19.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.150+0000 7f3175dc9640 1 -- 172.21.15.44:0/4200265876 shutdown_connections 2023-11-04T01:38:19.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.150+0000 7f3175dc9640 1 -- 172.21.15.44:0/4200265876 wait complete. 2023-11-04T01:38:19.169 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:19.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.274+0000 7fe0385c0640 1 Processor -- start 2023-11-04T01:38:19.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.275+0000 7fe0385c0640 1 -- start start 2023-11-04T01:38:19.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.275+0000 7fe0385c0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe0300aec80 0x7fe0300b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.275+0000 7fe0385c0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe03006ef40 0x7fe0300cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.276+0000 7fe0385c0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0300b1590 con 0x7fe0300af060 2023-11-04T01:38:19.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.276+0000 7fe0385c0640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe030155a40 con 0x7fe0300aec80 2023-11-04T01:38:19.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.276+0000 7fe0385c0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03006a8e0 con 0x7fe03006ef40 2023-11-04T01:38:19.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.276+0000 7fe03635c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe0300aec80 0x7fe0300b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.276+0000 7fe035b5b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe0300af060 0x7fe03006a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41362/0 (socket says 172.21.15.44:41362) 2023-11-04T01:38:19.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.276+0000 7fe03635c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe0300aec80 0x7fe0300b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44056/0 (socket says 172.21.15.44:44056) 2023-11-04T01:38:19.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.276+0000 7fe035b5b640 1 -- 172.21.15.44:0/2194516837 learned_addr learned my addr 172.21.15.44:0/2194516837 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:19.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.276+0000 7fe036b5d640 1 --2- 172.21.15.44:0/2194516837 >> v2:172.21.15.204:3300/0 conn(0x7fe03006ef40 0x7fe0300cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.276+0000 7fe03635c640 1 -- 172.21.15.44:0/2194516837 >> v2:172.21.15.204:3300/0 conn(0x7fe03006ef40 msgr2=0x7fe0300cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:19.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.276+0000 7fe03635c640 1 --2- 172.21.15.44:0/2194516837 >> v2:172.21.15.204:3300/0 conn(0x7fe03006ef40 0x7fe0300cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.276+0000 7fe03635c640 1 -- 172.21.15.44:0/2194516837 >> v1:172.21.15.44:6789/0 conn(0x7fe0300af060 legacy=0x7fe03006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.276+0000 7fe03635c640 1 -- 172.21.15.44:0/2194516837 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0300b1800 con 0x7fe0300aec80 2023-11-04T01:38:19.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.276+0000 7fe03535a640 1 -- 172.21.15.44:0/2194516837 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570494085 0 0) 0x7fe0300b1590 con 0x7fe0300af060 2023-11-04T01:38:19.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.276+0000 7fe036b5d640 1 --2- 172.21.15.44:0/2194516837 >> v2:172.21.15.204:3300/0 conn(0x7fe03006ef40 0x7fe0300cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:19.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.277+0000 7fe03635c640 1 --2- 172.21.15.44:0/2194516837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300aec80 0x7fe0300b1fe0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe03015b4c0 tx=0x7fe02802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9910f049ea1561b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:19.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.277+0000 7fe03535a640 1 -- 172.21.15.44:0/2194516837 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe028031830 con 0x7fe0300aec80 2023-11-04T01:38:19.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.277+0000 7fe03535a640 1 -- 172.21.15.44:0/2194516837 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe028031990 con 0x7fe0300aec80 2023-11-04T01:38:19.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.277+0000 7fe03535a640 1 -- 172.21.15.44:0/2194516837 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe028031d20 con 0x7fe0300aec80 2023-11-04T01:38:19.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.277+0000 7fe0385c0640 1 -- 172.21.15.44:0/2194516837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300aec80 msgr2=0x7fe0300b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.277+0000 7fe0385c0640 1 --2- 172.21.15.44:0/2194516837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300aec80 0x7fe0300b1fe0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe03015b4c0 tx=0x7fe02802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.278+0000 7fe0385c0640 1 -- 172.21.15.44:0/2194516837 shutdown_connections 2023-11-04T01:38:19.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.278+0000 7fe0385c0640 1 --2- 172.21.15.44:0/2194516837 >> v2:172.21.15.204:3300/0 conn(0x7fe03006ef40 0x7fe0300cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.278+0000 7fe0385c0640 1 --2- 172.21.15.44:0/2194516837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300aec80 0x7fe0300b1fe0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.278+0000 7fe0385c0640 1 -- 172.21.15.44:0/2194516837 >> 172.21.15.44:0/2194516837 conn(0x7fe030098d40 msgr2=0x7fe0300cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:19.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.278+0000 7fe0385c0640 1 -- 172.21.15.44:0/2194516837 shutdown_connections 2023-11-04T01:38:19.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.278+0000 7fe0385c0640 1 -- 172.21.15.44:0/2194516837 wait complete. 2023-11-04T01:38:19.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.279+0000 7fe0385c0640 1 Processor -- start 2023-11-04T01:38:19.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.279+0000 7fe0385c0640 1 -- start start 2023-11-04T01:38:19.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.279+0000 7fe0385c0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03006ef40 0x7fe03015f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe0385c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300aec80 0x7fe0300c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe0385c0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0300af060 0x7fe030154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe0385c0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03015d3a0 con 0x7fe0300aec80 2023-11-04T01:38:19.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe0385c0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03015d680 con 0x7fe0300af060 2023-11-04T01:38:19.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe0385c0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03015d960 con 0x7fe03006ef40 2023-11-04T01:38:19.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe035b5b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300aec80 0x7fe0300c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe035b5b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300aec80 0x7fe0300c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44068/0 (socket says 172.21.15.44:44068) 2023-11-04T01:38:19.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe035b5b640 1 -- 172.21.15.44:0/1527876858 learned_addr learned my addr 172.21.15.44:0/1527876858 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:19.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe03635c640 1 --2- 172.21.15.44:0/1527876858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03006ef40 0x7fe03015f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe036b5d640 1 --2- 172.21.15.44:0/1527876858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0300af060 0x7fe030154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe035b5b640 1 -- 172.21.15.44:0/1527876858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03006ef40 msgr2=0x7fe03015f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe035b5b640 1 --2- 172.21.15.44:0/1527876858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03006ef40 0x7fe03015f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe035b5b640 1 -- 172.21.15.44:0/1527876858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0300af060 msgr2=0x7fe030154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe035b5b640 1 --2- 172.21.15.44:0/1527876858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0300af060 0x7fe030154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe035b5b640 1 -- 172.21.15.44:0/1527876858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0280093a0 con 0x7fe0300aec80 2023-11-04T01:38:19.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe035b5b640 1 --2- 172.21.15.44:0/1527876858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300aec80 0x7fe0300c8f70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe02400c410 tx=0x7fe02400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:19.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe02effd640 1 -- 172.21.15.44:0/1527876858 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0240074e0 con 0x7fe0300aec80 2023-11-04T01:38:19.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe02effd640 1 -- 172.21.15.44:0/1527876858 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0240057a0 con 0x7fe0300aec80 2023-11-04T01:38:19.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe0385c0640 1 -- 172.21.15.44:0/1527876858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03015dc40 con 0x7fe0300aec80 2023-11-04T01:38:19.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe02effd640 1 -- 172.21.15.44:0/1527876858 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024007660 con 0x7fe0300aec80 2023-11-04T01:38:19.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.280+0000 7fe0385c0640 1 -- 172.21.15.44:0/1527876858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0301e6f00 con 0x7fe0300aec80 2023-11-04T01:38:19.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.281+0000 7fe0385c0640 1 -- 172.21.15.44:0/1527876858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0301e7090 con 0x7fe0300aec80 2023-11-04T01:38:19.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.282+0000 7fe02effd640 1 -- 172.21.15.44:0/1527876858 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe024005bd0 con 0x7fe0300aec80 2023-11-04T01:38:19.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.282+0000 7fe02effd640 1 --2- 172.21.15.44:0/1527876858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe01c06ae70 0x7fe01c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.282+0000 7fe02effd640 1 -- 172.21.15.44:0/1527876858 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe024088b00 con 0x7fe0300aec80 2023-11-04T01:38:19.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.283+0000 7fe03635c640 1 --2- 172.21.15.44:0/1527876858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe01c06ae70 0x7fe01c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.283+0000 7fe03635c640 1 --2- 172.21.15.44:0/1527876858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe01c06ae70 0x7fe01c06d330 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe028036000 tx=0x7fe028008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:19.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.287+0000 7fe02effd640 1 -- 172.21.15.44:0/1527876858 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe024053d10 con 0x7fe0300aec80 2023-11-04T01:38:19.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.465+0000 7fe0385c0640 1 -- 172.21.15.44:0/1527876858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe03015e160 con 0x7fe0300aec80 2023-11-04T01:38:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.466+0000 7fe02effd640 1 -- 172.21.15.44:0/1527876858 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+14815 (secure 0 0 0) 0x7fe03015e160 con 0x7fe0300aec80 2023-11-04T01:38:19.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:19.468 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":63,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:38:18.770386+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.468+0000 7fe0385c0640 1 -- 172.21.15.44:0/1527876858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe01c06ae70 msgr2=0x7fe01c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.468+0000 7fe0385c0640 1 --2- 172.21.15.44:0/1527876858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe01c06ae70 0x7fe01c06d330 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe028036000 tx=0x7fe028008030 comp rx=0 tx=0).stop 2023-11-04T01:38:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.468+0000 7fe0385c0640 1 -- 172.21.15.44:0/1527876858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300aec80 msgr2=0x7fe0300c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.468+0000 7fe0385c0640 1 --2- 172.21.15.44:0/1527876858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300aec80 0x7fe0300c8f70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe02400c410 tx=0x7fe02400c8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.468+0000 7fe0385c0640 1 -- 172.21.15.44:0/1527876858 shutdown_connections 2023-11-04T01:38:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.468+0000 7fe0385c0640 1 --2- 172.21.15.44:0/1527876858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe01c06ae70 0x7fe01c06d330 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.468+0000 7fe0385c0640 1 --2- 172.21.15.44:0/1527876858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0300af060 0x7fe030154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.468+0000 7fe0385c0640 1 --2- 172.21.15.44:0/1527876858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300aec80 0x7fe0300c8f70 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.468+0000 7fe0385c0640 1 --2- 172.21.15.44:0/1527876858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03006ef40 0x7fe03015f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.468+0000 7fe0385c0640 1 -- 172.21.15.44:0/1527876858 >> 172.21.15.44:0/1527876858 conn(0x7fe030098d40 msgr2=0x7fe0300cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.468+0000 7fe0385c0640 1 -- 172.21.15.44:0/1527876858 shutdown_connections 2023-11-04T01:38:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.468+0000 7fe0385c0640 1 -- 172.21.15.44:0/1527876858 wait complete. 2023-11-04T01:38:19.481 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:19.482 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:19.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.589+0000 7f522f578640 1 Processor -- start 2023-11-04T01:38:19.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.589+0000 7f522f578640 1 -- start start 2023-11-04T01:38:19.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.590+0000 7f522f578640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f52280cd6d0 0x7f5228161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.590+0000 7f522f578640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52280cde60 con 0x7f5228153e60 2023-11-04T01:38:19.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.590+0000 7f522f578640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5228160f90 con 0x7f52280b4880 2023-11-04T01:38:19.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.590+0000 7f522f578640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5228161960 con 0x7f52280cd6d0 2023-11-04T01:38:19.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.590+0000 7f522cb13640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f52280cd6d0 0x7f5228161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.590+0000 7f522d314640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5228153e60 0x7f522815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41366/0 (socket says 172.21.15.44:41366) 2023-11-04T01:38:19.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.590+0000 7f522d314640 1 -- 172.21.15.44:0/1964346276 learned_addr learned my addr 172.21.15.44:0/1964346276 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:19.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.591+0000 7f522cb13640 1 -- 172.21.15.44:0/1964346276 >> v1:172.21.15.204:6789/0 conn(0x7f52280b4880 legacy=0x7f52280d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:19.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.591+0000 7f522cb13640 1 -- 172.21.15.44:0/1964346276 >> v1:172.21.15.44:6789/0 conn(0x7f5228153e60 legacy=0x7f522815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.591+0000 7f522cb13640 1 -- 172.21.15.44:0/1964346276 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52280ce090 con 0x7f52280cd6d0 2023-11-04T01:38:19.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.591+0000 7f521ffff640 1 -- 172.21.15.44:0/1964346276 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991719293 0 0) 0x7f52280cde60 con 0x7f5228153e60 2023-11-04T01:38:19.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.591+0000 7f522cb13640 1 --2- 172.21.15.44:0/1964346276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52280cd6d0 0x7f5228161420 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f52180097a0 tx=0x7f521802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a570b6d8803a901 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:19.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.592+0000 7f521ffff640 1 -- 172.21.15.44:0/1964346276 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218031830 con 0x7f52280cd6d0 2023-11-04T01:38:19.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.592+0000 7f521ffff640 1 -- 172.21.15.44:0/1964346276 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5218031990 con 0x7f52280cd6d0 2023-11-04T01:38:19.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.592+0000 7f521ffff640 1 -- 172.21.15.44:0/1964346276 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218031d20 con 0x7f52280cd6d0 2023-11-04T01:38:19.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.592+0000 7f522f578640 1 -- 172.21.15.44:0/1964346276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52280cd6d0 msgr2=0x7f5228161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.592+0000 7f522f578640 1 --2- 172.21.15.44:0/1964346276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52280cd6d0 0x7f5228161420 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f52180097a0 tx=0x7f521802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.592+0000 7f522f578640 1 -- 172.21.15.44:0/1964346276 shutdown_connections 2023-11-04T01:38:19.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.592+0000 7f522f578640 1 --2- 172.21.15.44:0/1964346276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52280cd6d0 0x7f5228161420 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.592+0000 7f522f578640 1 -- 172.21.15.44:0/1964346276 >> 172.21.15.44:0/1964346276 conn(0x7f52280cf880 msgr2=0x7f52280cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:19.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.592+0000 7f522f578640 1 -- 172.21.15.44:0/1964346276 shutdown_connections 2023-11-04T01:38:19.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.592+0000 7f522f578640 1 -- 172.21.15.44:0/1964346276 wait complete. 2023-11-04T01:38:19.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.593+0000 7f522f578640 1 Processor -- start 2023-11-04T01:38:19.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.593+0000 7f522f578640 1 -- start start 2023-11-04T01:38:19.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522f578640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52280b4880 0x7f52280c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522f578640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52280cd6d0 0x7f52281e8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522f578640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5228153e60 0x7f52280c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522f578640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5228159180 con 0x7f5228153e60 2023-11-04T01:38:19.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522f578640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5228158570 con 0x7f52280b4880 2023-11-04T01:38:19.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522f578640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5228158850 con 0x7f52280cd6d0 2023-11-04T01:38:19.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522db15640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5228153e60 0x7f52280c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522db15640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5228153e60 0x7f52280c6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44082/0 (socket says 172.21.15.44:44082) 2023-11-04T01:38:19.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522db15640 1 -- 172.21.15.44:0/1986342649 learned_addr learned my addr 172.21.15.44:0/1986342649 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:19.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522d314640 1 --2- 172.21.15.44:0/1986342649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52280b4880 0x7f52280c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522cb13640 1 --2- 172.21.15.44:0/1986342649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52280cd6d0 0x7f52281e8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522db15640 1 -- 172.21.15.44:0/1986342649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52280cd6d0 msgr2=0x7f52281e8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522db15640 1 --2- 172.21.15.44:0/1986342649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52280cd6d0 0x7f52281e8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522db15640 1 -- 172.21.15.44:0/1986342649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52280b4880 msgr2=0x7f52280c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522db15640 1 --2- 172.21.15.44:0/1986342649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52280b4880 0x7f52280c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.594+0000 7f522db15640 1 -- 172.21.15.44:0/1986342649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5218009400 con 0x7f5228153e60 2023-11-04T01:38:19.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.595+0000 7f522db15640 1 --2- 172.21.15.44:0/1986342649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5228153e60 0x7f52280c6930 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f522000c780 tx=0x7f522000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:19.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.595+0000 7f521dffb640 1 -- 172.21.15.44:0/1986342649 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220003d80 con 0x7f5228153e60 2023-11-04T01:38:19.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.595+0000 7f521dffb640 1 -- 172.21.15.44:0/1986342649 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522000ce90 con 0x7f5228153e60 2023-11-04T01:38:19.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.595+0000 7f522f578640 1 -- 172.21.15.44:0/1986342649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5228158b30 con 0x7f5228153e60 2023-11-04T01:38:19.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.595+0000 7f521dffb640 1 -- 172.21.15.44:0/1986342649 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52200052b0 con 0x7f5228153e60 2023-11-04T01:38:19.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.595+0000 7f522f578640 1 -- 172.21.15.44:0/1986342649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5228158220 con 0x7f5228153e60 2023-11-04T01:38:19.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.596+0000 7f522f578640 1 -- 172.21.15.44:0/1986342649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52281592f0 con 0x7f5228153e60 2023-11-04T01:38:19.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.596+0000 7f521dffb640 1 -- 172.21.15.44:0/1986342649 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5220005410 con 0x7f5228153e60 2023-11-04T01:38:19.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.597+0000 7f521dffb640 1 --2- 172.21.15.44:0/1986342649 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f520c06ae70 0x7f520c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.597+0000 7f521dffb640 1 -- 172.21.15.44:0/1986342649 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5220088d10 con 0x7f5228153e60 2023-11-04T01:38:19.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.597+0000 7f522d314640 1 --2- 172.21.15.44:0/1986342649 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f520c06ae70 0x7f520c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.598+0000 7f522d314640 1 --2- 172.21.15.44:0/1986342649 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f520c06ae70 0x7f520c06d330 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5224000f60 tx=0x7f5224007c00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:19.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.601+0000 7f521dffb640 1 -- 172.21.15.44:0/1986342649 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5220053f00 con 0x7f5228153e60 2023-11-04T01:38:19.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.778+0000 7f522f578640 1 -- 172.21.15.44:0/1986342649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52280d0b80 con 0x7f5228153e60 2023-11-04T01:38:19.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.778+0000 7f521dffb640 1 -- 172.21.15.44:0/1986342649 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5220017070 con 0x7f5228153e60 2023-11-04T01:38:19.780 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:38:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.780+0000 7f522f578640 1 -- 172.21.15.44:0/1986342649 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f520c06ae70 msgr2=0x7f520c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.780+0000 7f522f578640 1 --2- 172.21.15.44:0/1986342649 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f520c06ae70 0x7f520c06d330 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5224000f60 tx=0x7f5224007c00 comp rx=0 tx=0).stop 2023-11-04T01:38:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.780+0000 7f522f578640 1 -- 172.21.15.44:0/1986342649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5228153e60 msgr2=0x7f52280c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.780+0000 7f522f578640 1 --2- 172.21.15.44:0/1986342649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5228153e60 0x7f52280c6930 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f522000c780 tx=0x7f522000cc40 comp rx=0 tx=0).stop 2023-11-04T01:38:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.780+0000 7f522f578640 1 -- 172.21.15.44:0/1986342649 shutdown_connections 2023-11-04T01:38:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.780+0000 7f522f578640 1 --2- 172.21.15.44:0/1986342649 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f520c06ae70 0x7f520c06d330 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.780+0000 7f522f578640 1 --2- 172.21.15.44:0/1986342649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5228153e60 0x7f52280c6930 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.780+0000 7f522f578640 1 --2- 172.21.15.44:0/1986342649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52280cd6d0 0x7f52281e8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.780+0000 7f522f578640 1 --2- 172.21.15.44:0/1986342649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52280b4880 0x7f52280c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.780+0000 7f522f578640 1 -- 172.21.15.44:0/1986342649 >> 172.21.15.44:0/1986342649 conn(0x7f52280cf880 msgr2=0x7f522815c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.780+0000 7f522f578640 1 -- 172.21.15.44:0/1986342649 shutdown_connections 2023-11-04T01:38:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.780+0000 7f522f578640 1 -- 172.21.15.44:0/1986342649 wait complete. 2023-11-04T01:38:19.793 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:19.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.900+0000 7f68bd664640 1 Processor -- start 2023-11-04T01:38:19.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.900+0000 7f68bd664640 1 -- start start 2023-11-04T01:38:19.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.900+0000 7f68bd664640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f68b815d1b0 0x7f68b80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.900+0000 7f68bd664640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f68b8066000 0x7f68b806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.900+0000 7f68bd664640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b80c9bf0 con 0x7f68b8070ff0 2023-11-04T01:38:19.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.900+0000 7f68bd664640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b80cd890 con 0x7f68b8066000 2023-11-04T01:38:19.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.900+0000 7f68bd664640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b80cdb30 con 0x7f68b815d1b0 2023-11-04T01:38:19.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.901+0000 7f68b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f68b8066000 0x7f68b806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.901+0000 7f68b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f68b8066000 0x7f68b806a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44086/0 (socket says 172.21.15.44:44086) 2023-11-04T01:38:19.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.901+0000 7f68b77fe640 1 -- 172.21.15.44:0/2006739512 learned_addr learned my addr 172.21.15.44:0/2006739512 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:19.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.901+0000 7f68b67fc640 1 --2- 172.21.15.44:0/2006739512 >> v2:172.21.15.204:3300/0 conn(0x7f68b815d1b0 0x7f68b80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.901+0000 7f68b77fe640 1 -- 172.21.15.44:0/2006739512 >> v2:172.21.15.204:3300/0 conn(0x7f68b815d1b0 msgr2=0x7f68b80cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:19.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.901+0000 7f68b77fe640 1 --2- 172.21.15.44:0/2006739512 >> v2:172.21.15.204:3300/0 conn(0x7f68b815d1b0 0x7f68b80cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.901+0000 7f68b77fe640 1 -- 172.21.15.44:0/2006739512 >> v1:172.21.15.204:6789/0 conn(0x7f68b8070ff0 legacy=0x7f68b80713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.901+0000 7f68b77fe640 1 -- 172.21.15.44:0/2006739512 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b80cde10 con 0x7f68b8066000 2023-11-04T01:38:19.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.901+0000 7f68b67fc640 1 --2- 172.21.15.44:0/2006739512 >> v2:172.21.15.204:3300/0 conn(0x7f68b815d1b0 0x7f68b80cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:19.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.902+0000 7f68b77fe640 1 --2- 172.21.15.44:0/2006739512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68b8066000 0x7f68b806a500 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f68b806c430 tx=0x7f68b002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482af90cd9deb3bc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:19.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.902+0000 7f68b5ffb640 1 -- 172.21.15.44:0/2006739512 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b002cb20 con 0x7f68b8066000 2023-11-04T01:38:19.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.902+0000 7f68b5ffb640 1 -- 172.21.15.44:0/2006739512 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b002cc80 con 0x7f68b8066000 2023-11-04T01:38:19.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.902+0000 7f68b5ffb640 1 -- 172.21.15.44:0/2006739512 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b00343f0 con 0x7f68b8066000 2023-11-04T01:38:19.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.902+0000 7f68bd664640 1 -- 172.21.15.44:0/2006739512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68b8066000 msgr2=0x7f68b806a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.902+0000 7f68bd664640 1 --2- 172.21.15.44:0/2006739512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68b8066000 0x7f68b806a500 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f68b806c430 tx=0x7f68b002bf80 comp rx=0 tx=0).stop 2023-11-04T01:38:19.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.902+0000 7f68bd664640 1 -- 172.21.15.44:0/2006739512 shutdown_connections 2023-11-04T01:38:19.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.902+0000 7f68bd664640 1 --2- 172.21.15.44:0/2006739512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68b8066000 0x7f68b806a500 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.902+0000 7f68bd664640 1 --2- 172.21.15.44:0/2006739512 >> v2:172.21.15.204:3300/0 conn(0x7f68b815d1b0 0x7f68b80cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.902+0000 7f68bd664640 1 -- 172.21.15.44:0/2006739512 >> 172.21.15.44:0/2006739512 conn(0x7f68b80cbc90 msgr2=0x7f68b80cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:19.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.902+0000 7f68bd664640 1 -- 172.21.15.44:0/2006739512 shutdown_connections 2023-11-04T01:38:19.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.902+0000 7f68bd664640 1 -- 172.21.15.44:0/2006739512 wait complete. 2023-11-04T01:38:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.904+0000 7f68bd664640 1 Processor -- start 2023-11-04T01:38:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.904+0000 7f68bd664640 1 -- start start 2023-11-04T01:38:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.904+0000 7f68bd664640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68b8066000 0x7f68b8155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.904+0000 7f68bd664640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68b8070ff0 0x7f68b8155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.904+0000 7f68bd664640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68b815d1b0 0x7f68b81f2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.904+0000 7f68bd664640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b815b200 con 0x7f68b8070ff0 2023-11-04T01:38:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.904+0000 7f68bd664640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b81f35b0 con 0x7f68b8066000 2023-11-04T01:38:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.904+0000 7f68bd664640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b815a8d0 con 0x7f68b815d1b0 2023-11-04T01:38:19.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f68b67fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68b8070ff0 0x7f68b8155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f68b67fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68b8070ff0 0x7f68b8155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44098/0 (socket says 172.21.15.44:44098) 2023-11-04T01:38:19.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f68b67fc640 1 -- 172.21.15.44:0/2179809953 learned_addr learned my addr 172.21.15.44:0/2179809953 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:19.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f68b77fe640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68b815d1b0 0x7f68b81f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f68b6ffd640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68b8066000 0x7f68b8155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f68b67fc640 1 -- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68b815d1b0 msgr2=0x7f68b81f2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f68b67fc640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68b815d1b0 0x7f68b81f2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f68b67fc640 1 -- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68b8066000 msgr2=0x7f68b8155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f68b67fc640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68b8066000 0x7f68b8155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f68b67fc640 1 -- 172.21.15.44:0/2179809953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b0009b30 con 0x7f68b8070ff0 2023-11-04T01:38:19.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f68b77fe640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68b815d1b0 0x7f68b81f2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:19.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f68b6ffd640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68b8066000 0x7f68b8155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:19.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f68b67fc640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68b8070ff0 0x7f68b8155680 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00e810 tx=0x7f68ac00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:19.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f689f7fe640 1 -- 172.21.15.44:0/2179809953 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac004230 con 0x7f68b8070ff0 2023-11-04T01:38:19.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f689f7fe640 1 -- 172.21.15.44:0/2179809953 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac004390 con 0x7f68b8070ff0 2023-11-04T01:38:19.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f68bd664640 1 -- 172.21.15.44:0/2179809953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b815abb0 con 0x7f68b8070ff0 2023-11-04T01:38:19.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f689f7fe640 1 -- 172.21.15.44:0/2179809953 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac00c910 con 0x7f68b8070ff0 2023-11-04T01:38:19.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.905+0000 7f68bd664640 1 -- 172.21.15.44:0/2179809953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b815b690 con 0x7f68b8070ff0 2023-11-04T01:38:19.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.906+0000 7f68bd664640 1 -- 172.21.15.44:0/2179809953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b8074290 con 0x7f68b8070ff0 2023-11-04T01:38:19.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.907+0000 7f689f7fe640 1 -- 172.21.15.44:0/2179809953 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f68ac00ca70 con 0x7f68b8070ff0 2023-11-04T01:38:19.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.907+0000 7f689f7fe640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f68a406ae70 0x7f68a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.907+0000 7f689f7fe640 1 -- 172.21.15.44:0/2179809953 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f68ac0890f0 con 0x7f68b8070ff0 2023-11-04T01:38:19.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.907+0000 7f68b6ffd640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f68a406ae70 0x7f68a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.908+0000 7f68b6ffd640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f68a406ae70 0x7f68a406d330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f68b8156ac0 tx=0x7f68a8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:19.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:19.911+0000 7f689f7fe640 1 -- 172.21.15.44:0/2179809953 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f68ac0542e0 con 0x7f68b8070ff0 2023-11-04T01:38:20.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.085+0000 7f68bd664640 1 -- 172.21.15.44:0/2179809953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f68b80b5190 con 0x7f68b8070ff0 2023-11-04T01:38:20.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.085+0000 7f689f7fe640 1 -- 172.21.15.44:0/2179809953 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v63) v1 ==== 103+0+11 (secure 0 0 0) 0x7f68ac057900 con 0x7f68b8070ff0 2023-11-04T01:38:20.088 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:20.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.087+0000 7f68bd664640 1 -- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f68a406ae70 msgr2=0x7f68a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.087+0000 7f68bd664640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f68a406ae70 0x7f68a406d330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f68b8156ac0 tx=0x7f68a8009040 comp rx=0 tx=0).stop 2023-11-04T01:38:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.087+0000 7f68bd664640 1 -- 172.21.15.44:0/2179809953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68b8070ff0 msgr2=0x7f68b8155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.087+0000 7f68bd664640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68b8070ff0 0x7f68b8155680 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00e810 tx=0x7f68ac00ecd0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.087+0000 7f68bd664640 1 -- 172.21.15.44:0/2179809953 shutdown_connections 2023-11-04T01:38:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.087+0000 7f68bd664640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f68a406ae70 0x7f68a406d330 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.087+0000 7f68bd664640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68b815d1b0 0x7f68b81f2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.087+0000 7f68bd664640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68b8070ff0 0x7f68b8155680 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.087+0000 7f68bd664640 1 --2- 172.21.15.44:0/2179809953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68b8066000 0x7f68b8155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.087+0000 7f68bd664640 1 -- 172.21.15.44:0/2179809953 >> 172.21.15.44:0/2179809953 conn(0x7f68b80cbc90 msgr2=0x7f68b81610c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.087+0000 7f68bd664640 1 -- 172.21.15.44:0/2179809953 shutdown_connections 2023-11-04T01:38:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.087+0000 7f68bd664640 1 -- 172.21.15.44:0/2179809953 wait complete. 2023-11-04T01:38:20.100 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:38:20.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.205+0000 7f3415dc0640 1 Processor -- start 2023-11-04T01:38:20.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.205+0000 7f3415dc0640 1 -- start start 2023-11-04T01:38:20.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.206+0000 7f3415dc0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f341006a1b0 0x7f341006b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.206+0000 7f3415dc0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341006cf60 con 0x7f341015ad80 2023-11-04T01:38:20.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.206+0000 7f3415dc0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341015b160 con 0x7f34100c9a40 2023-11-04T01:38:20.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.206+0000 7f3415dc0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341006b9b0 con 0x7f341006a1b0 2023-11-04T01:38:20.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.206+0000 7f340f7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f341015ad80 0x7f34100abe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41380/0 (socket says 172.21.15.44:41380) 2023-11-04T01:38:20.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.206+0000 7f340f7fe640 1 -- 172.21.15.44:0/2160942970 learned_addr learned my addr 172.21.15.44:0/2160942970 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:20.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.206+0000 7f340effd640 1 --2- 172.21.15.44:0/2160942970 >> v2:172.21.15.204:3300/0 conn(0x7f341006a1b0 0x7f341006b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.206+0000 7f340e7fc640 1 -- 172.21.15.44:0/2160942970 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074158077 0 0) 0x7f341006cf60 con 0x7f341015ad80 2023-11-04T01:38:20.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.206+0000 7f340e7fc640 1 -- 172.21.15.44:0/2160942970 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33f8003520 con 0x7f341015ad80 2023-11-04T01:38:20.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340e7fc640 1 -- 172.21.15.44:0/2160942970 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1440739131 0 0) 0x7f33f8003520 con 0x7f341015ad80 2023-11-04T01:38:20.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340e7fc640 1 -- 172.21.15.44:0/2160942970 >> v2:172.21.15.204:3300/0 conn(0x7f341006a1b0 msgr2=0x7f341006b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:20.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340e7fc640 1 --2- 172.21.15.44:0/2160942970 >> v2:172.21.15.204:3300/0 conn(0x7f341006a1b0 0x7f341006b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340e7fc640 1 -- 172.21.15.44:0/2160942970 >> v1:172.21.15.204:6789/0 conn(0x7f34100c9a40 legacy=0x7f341006dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340e7fc640 1 -- 172.21.15.44:0/2160942970 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341006d200 con 0x7f341015ad80 2023-11-04T01:38:20.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340e7fc640 1 -- 172.21.15.44:0/2160942970 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f3400001670 con 0x7f341015ad80 2023-11-04T01:38:20.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340e7fc640 1 -- 172.21.15.44:0/2160942970 >> v1:172.21.15.44:6789/0 conn(0x7f341015ad80 legacy=0x7f34100abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340e7fc640 1 --2- 172.21.15.44:0/2160942970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33f8003970 0x7f33f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340e7fc640 1 --2- 172.21.15.44:0/2160942970 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33f80047c0 0x7f33f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340e7fc640 1 --2- 172.21.15.44:0/2160942970 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33f8005180 0x7f33f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340e7fc640 1 -- 172.21.15.44:0/2160942970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341006b9b0 con 0x7f33f8003970 2023-11-04T01:38:20.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340e7fc640 1 -- 172.21.15.44:0/2160942970 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f800c020 con 0x7f33f8005180 2023-11-04T01:38:20.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340e7fc640 1 -- 172.21.15.44:0/2160942970 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f800c1e0 con 0x7f33f80047c0 2023-11-04T01:38:20.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340f7fe640 1 --2- 172.21.15.44:0/2160942970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33f8003970 0x7f33f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340effd640 1 --2- 172.21.15.44:0/2160942970 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33f80047c0 0x7f33f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340ffff640 1 --2- 172.21.15.44:0/2160942970 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33f8005180 0x7f33f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340f7fe640 1 -- 172.21.15.44:0/2160942970 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33f80047c0 msgr2=0x7f33f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:20.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340f7fe640 1 --2- 172.21.15.44:0/2160942970 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33f80047c0 0x7f33f8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340f7fe640 1 -- 172.21.15.44:0/2160942970 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33f8005180 msgr2=0x7f33f800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:20.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340f7fe640 1 --2- 172.21.15.44:0/2160942970 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33f8005180 0x7f33f800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340f7fe640 1 -- 172.21.15.44:0/2160942970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f8003520 con 0x7f33f8003970 2023-11-04T01:38:20.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.207+0000 7f340ffff640 1 -- 172.21.15.44:0/2160942970 reap_dead start 2023-11-04T01:38:20.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.208+0000 7f340f7fe640 1 --2- 172.21.15.44:0/2160942970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33f8003970 0x7f33f8003d90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f340000c190 tx=0x7f33f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2ef24f699317e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.208+0000 7f340e7fc640 1 -- 172.21.15.44:0/2160942970 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400005ad0 con 0x7f33f8003970 2023-11-04T01:38:20.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.208+0000 7f340e7fc640 1 -- 172.21.15.44:0/2160942970 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3400005c30 con 0x7f33f8003970 2023-11-04T01:38:20.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.208+0000 7f340e7fc640 1 -- 172.21.15.44:0/2160942970 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340002cae0 con 0x7f33f8003970 2023-11-04T01:38:20.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.209+0000 7f3415dc0640 1 -- 172.21.15.44:0/2160942970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33f8003970 msgr2=0x7f33f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.209+0000 7f3415dc0640 1 --2- 172.21.15.44:0/2160942970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33f8003970 0x7f33f8003d90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f340000c190 tx=0x7f33f80057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.209+0000 7f3415dc0640 1 -- 172.21.15.44:0/2160942970 shutdown_connections 2023-11-04T01:38:20.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.209+0000 7f3415dc0640 1 --2- 172.21.15.44:0/2160942970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33f8003970 0x7f33f8003d90 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.209+0000 7f3415dc0640 1 -- 172.21.15.44:0/2160942970 >> 172.21.15.44:0/2160942970 conn(0x7f34100b0cd0 msgr2=0x7f34100b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:20.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.209+0000 7f3415dc0640 1 -- 172.21.15.44:0/2160942970 shutdown_connections 2023-11-04T01:38:20.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.209+0000 7f3415dc0640 1 -- 172.21.15.44:0/2160942970 wait complete. 2023-11-04T01:38:20.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.210+0000 7f3415dc0640 1 Processor -- start 2023-11-04T01:38:20.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.210+0000 7f3415dc0640 1 -- start start 2023-11-04T01:38:20.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f3415dc0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33f8003970 0x7f3410155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f3415dc0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3410099950 0x7f3410099db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f3415dc0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34100afe30 0x7f34100b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f3415dc0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34100b07f0 con 0x7f3410099950 2023-11-04T01:38:20.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f3415dc0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341009c3e0 con 0x7f34100afe30 2023-11-04T01:38:20.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f3415dc0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34100cedc0 con 0x7f33f8003970 2023-11-04T01:38:20.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f340effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3410099950 0x7f3410099db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f340effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3410099950 0x7f3410099db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44118/0 (socket says 172.21.15.44:44118) 2023-11-04T01:38:20.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f340effd640 1 -- 172.21.15.44:0/3346445443 learned_addr learned my addr 172.21.15.44:0/3346445443 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:20.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f340f7fe640 1 --2- 172.21.15.44:0/3346445443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33f8003970 0x7f3410155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f340ffff640 1 --2- 172.21.15.44:0/3346445443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34100afe30 0x7f34100b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f340effd640 1 -- 172.21.15.44:0/3346445443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33f8003970 msgr2=0x7f3410155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f340effd640 1 --2- 172.21.15.44:0/3346445443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33f8003970 0x7f3410155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f340effd640 1 -- 172.21.15.44:0/3346445443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34100afe30 msgr2=0x7f34100b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f340effd640 1 --2- 172.21.15.44:0/3346445443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34100afe30 0x7f34100b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f340effd640 1 -- 172.21.15.44:0/3346445443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341009c870 con 0x7f3410099950 2023-11-04T01:38:20.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f340f7fe640 1 --2- 172.21.15.44:0/3346445443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33f8003970 0x7f3410155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:20.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.211+0000 7f340effd640 1 --2- 172.21.15.44:0/3346445443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3410099950 0x7f3410099db0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3404011890 tx=0x7f3404011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.212+0000 7f33f7fff640 1 -- 172.21.15.44:0/3346445443 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404004240 con 0x7f3410099950 2023-11-04T01:38:20.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.212+0000 7f33f7fff640 1 -- 172.21.15.44:0/3346445443 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34040043a0 con 0x7f3410099950 2023-11-04T01:38:20.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.212+0000 7f3415dc0640 1 -- 172.21.15.44:0/3346445443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341009a3a0 con 0x7f3410099950 2023-11-04T01:38:20.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.212+0000 7f33f7fff640 1 -- 172.21.15.44:0/3346445443 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340400fa60 con 0x7f3410099950 2023-11-04T01:38:20.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.212+0000 7f3415dc0640 1 -- 172.21.15.44:0/3346445443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341009c070 con 0x7f3410099950 2023-11-04T01:38:20.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.213+0000 7f3415dc0640 1 -- 172.21.15.44:0/3346445443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3410074290 con 0x7f3410099950 2023-11-04T01:38:20.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.213+0000 7f33f7fff640 1 -- 172.21.15.44:0/3346445443 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f340400fbc0 con 0x7f3410099950 2023-11-04T01:38:20.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.213+0000 7f33f7fff640 1 --2- 172.21.15.44:0/3346445443 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f33fc06ae70 0x7f33fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.214+0000 7f33f7fff640 1 -- 172.21.15.44:0/3346445443 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f3404089b10 con 0x7f3410099950 2023-11-04T01:38:20.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.214+0000 7f340f7fe640 1 --2- 172.21.15.44:0/3346445443 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f33fc06ae70 0x7f33fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.214+0000 7f340f7fe640 1 --2- 172.21.15.44:0/3346445443 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f33fc06ae70 0x7f33fc06d330 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3400034000 tx=0x7f3400009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.218+0000 7f33f7fff640 1 -- 172.21.15.44:0/3346445443 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3404054bf0 con 0x7f3410099950 2023-11-04T01:38:20.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.395+0000 7f3415dc0640 1 -- 172.21.15.44:0/3346445443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3410066320 con 0x7f3410099950 2023-11-04T01:38:20.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.395+0000 7f33f7fff640 1 -- 172.21.15.44:0/3346445443 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) v1 ==== 84+0+137 (secure 0 0 0) 0x7f3404023020 con 0x7f3410099950 2023-11-04T01:38:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:20.398 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2023-11-04T01:38:20.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2023-11-04T01:38:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2023-11-04T01:38:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 7, 2023-11-04T01:38:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": "snap-test-pool" 2023-11-04T01:38:20.399 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:20.400 INFO:teuthology.orchestra.run.smithi044.stdout:] 2023-11-04T01:38:20.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.397+0000 7f3415dc0640 1 -- 172.21.15.44:0/3346445443 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f33fc06ae70 msgr2=0x7f33fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.397+0000 7f3415dc0640 1 --2- 172.21.15.44:0/3346445443 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f33fc06ae70 0x7f33fc06d330 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3400034000 tx=0x7f3400009030 comp rx=0 tx=0).stop 2023-11-04T01:38:20.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.397+0000 7f3415dc0640 1 -- 172.21.15.44:0/3346445443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3410099950 msgr2=0x7f3410099db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.397+0000 7f3415dc0640 1 --2- 172.21.15.44:0/3346445443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3410099950 0x7f3410099db0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3404011890 tx=0x7f3404011d50 comp rx=0 tx=0).stop 2023-11-04T01:38:20.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.397+0000 7f3415dc0640 1 -- 172.21.15.44:0/3346445443 shutdown_connections 2023-11-04T01:38:20.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.397+0000 7f3415dc0640 1 --2- 172.21.15.44:0/3346445443 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f33fc06ae70 0x7f33fc06d330 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.397+0000 7f3415dc0640 1 --2- 172.21.15.44:0/3346445443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34100afe30 0x7f34100b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.397+0000 7f3415dc0640 1 --2- 172.21.15.44:0/3346445443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3410099950 0x7f3410099db0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.397+0000 7f3415dc0640 1 --2- 172.21.15.44:0/3346445443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33f8003970 0x7f3410155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.397+0000 7f3415dc0640 1 -- 172.21.15.44:0/3346445443 >> 172.21.15.44:0/3346445443 conn(0x7f34100b0cd0 msgr2=0x7f34100c82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:20.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.397+0000 7f3415dc0640 1 -- 172.21.15.44:0/3346445443 shutdown_connections 2023-11-04T01:38:20.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.397+0000 7f3415dc0640 1 -- 172.21.15.44:0/3346445443 wait complete. 2023-11-04T01:38:20.410 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:38:20.411 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:38:20.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.519+0000 7f330284b640 1 Processor -- start 2023-11-04T01:38:20.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.519+0000 7f330284b640 1 -- start start 2023-11-04T01:38:20.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.520+0000 7f330284b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32fc15d1b0 0x7f32fc0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.520+0000 7f330284b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f32fc0cecf0 0x7f32fc0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.520+0000 7f330284b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32fc161870 con 0x7f32fc0cb680 2023-11-04T01:38:20.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.520+0000 7f330284b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32fc160c60 con 0x7f32fc0cecf0 2023-11-04T01:38:20.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.520+0000 7f330284b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc160f40 con 0x7f32fc15d1b0 2023-11-04T01:38:20.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.520+0000 7f32fbfff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32fc15d1b0 0x7f32fc0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.520+0000 7f32fb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f32fc0cecf0 0x7f32fc0cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.520+0000 7f32fbfff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32fc15d1b0 0x7f32fc0ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:36760/0 (socket says 172.21.15.44:36760) 2023-11-04T01:38:20.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.520+0000 7f32fbfff640 1 -- 172.21.15.44:0/3809514607 learned_addr learned my addr 172.21.15.44:0/3809514607 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:20.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.521+0000 7f32fbfff640 1 -- 172.21.15.44:0/3809514607 >> v2:172.21.15.204:3300/0 conn(0x7f32fc0cecf0 msgr2=0x7f32fc0cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:20.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.521+0000 7f32fbfff640 1 --2- 172.21.15.44:0/3809514607 >> v2:172.21.15.204:3300/0 conn(0x7f32fc0cecf0 0x7f32fc0cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.521+0000 7f32fbfff640 1 -- 172.21.15.44:0/3809514607 >> v1:172.21.15.204:6789/0 conn(0x7f32fc0cb680 legacy=0x7f32fc0b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.521+0000 7f32fbfff640 1 -- 172.21.15.44:0/3809514607 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc161220 con 0x7f32fc15d1b0 2023-11-04T01:38:20.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.521+0000 7f32fb7fe640 1 --2- 172.21.15.44:0/3809514607 >> v2:172.21.15.204:3300/0 conn(0x7f32fc0cecf0 0x7f32fc0cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.521+0000 7f32fbfff640 1 --2- 172.21.15.44:0/3809514607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32fc15d1b0 0x7f32fc0ce7b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f32f0009870 tx=0x7f32f002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f19c6674dfb0408 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.522+0000 7f32faffd640 1 -- 172.21.15.44:0/3809514607 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0030840 con 0x7f32fc15d1b0 2023-11-04T01:38:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.522+0000 7f32faffd640 1 -- 172.21.15.44:0/3809514607 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f00309a0 con 0x7f32fc15d1b0 2023-11-04T01:38:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.522+0000 7f32faffd640 1 -- 172.21.15.44:0/3809514607 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0030d30 con 0x7f32fc15d1b0 2023-11-04T01:38:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.522+0000 7f330284b640 1 -- 172.21.15.44:0/3809514607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32fc15d1b0 msgr2=0x7f32fc0ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.522+0000 7f330284b640 1 --2- 172.21.15.44:0/3809514607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32fc15d1b0 0x7f32fc0ce7b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f32f0009870 tx=0x7f32f002b980 comp rx=0 tx=0).stop 2023-11-04T01:38:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.522+0000 7f330284b640 1 -- 172.21.15.44:0/3809514607 shutdown_connections 2023-11-04T01:38:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.522+0000 7f330284b640 1 --2- 172.21.15.44:0/3809514607 >> v2:172.21.15.204:3300/0 conn(0x7f32fc0cecf0 0x7f32fc0cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.522+0000 7f330284b640 1 --2- 172.21.15.44:0/3809514607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32fc15d1b0 0x7f32fc0ce7b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.522+0000 7f330284b640 1 -- 172.21.15.44:0/3809514607 >> 172.21.15.44:0/3809514607 conn(0x7f32fc06ea20 msgr2=0x7f32fc06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.522+0000 7f330284b640 1 -- 172.21.15.44:0/3809514607 shutdown_connections 2023-11-04T01:38:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.522+0000 7f330284b640 1 -- 172.21.15.44:0/3809514607 wait complete. 2023-11-04T01:38:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.524+0000 7f330284b640 1 Processor -- start 2023-11-04T01:38:20.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.524+0000 7f330284b640 1 -- start start 2023-11-04T01:38:20.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.524+0000 7f330284b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32fc0cb680 0x7f32fc1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.524+0000 7f330284b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32fc0cecf0 0x7f32fc0c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.524+0000 7f330284b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32fc15d1b0 0x7f32fc0ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.524+0000 7f330284b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0b1380 con 0x7f32fc15d1b0 2023-11-04T01:38:20.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.524+0000 7f330284b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0b1600 con 0x7f32fc0cb680 2023-11-04T01:38:20.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.524+0000 7f330284b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0b18e0 con 0x7f32fc0cecf0 2023-11-04T01:38:20.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f3300de8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32fc15d1b0 0x7f32fc0ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f3300de8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32fc15d1b0 0x7f32fc0ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44124/0 (socket says 172.21.15.44:44124) 2023-11-04T01:38:20.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f32fb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32fc0cecf0 0x7f32fc0c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f3300de8640 1 -- 172.21.15.44:0/3687791726 learned_addr learned my addr 172.21.15.44:0/3687791726 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f32fbfff640 1 --2- 172.21.15.44:0/3687791726 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32fc0cb680 0x7f32fc1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f3300de8640 1 -- 172.21.15.44:0/3687791726 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32fc0cecf0 msgr2=0x7f32fc0c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f3300de8640 1 --2- 172.21.15.44:0/3687791726 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32fc0cecf0 0x7f32fc0c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f3300de8640 1 -- 172.21.15.44:0/3687791726 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32fc0cb680 msgr2=0x7f32fc1511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f3300de8640 1 --2- 172.21.15.44:0/3687791726 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32fc0cb680 0x7f32fc1511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f3300de8640 1 -- 172.21.15.44:0/3687791726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec009400 con 0x7f32fc15d1b0 2023-11-04T01:38:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f3300de8640 1 --2- 172.21.15.44:0/3687791726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32fc15d1b0 0x7f32fc0ca010 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f32f400c7a0 tx=0x7f32f400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f32f8ff9640 1 -- 172.21.15.44:0/3687791726 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4003b70 con 0x7f32fc15d1b0 2023-11-04T01:38:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f32f8ff9640 1 -- 172.21.15.44:0/3687791726 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f4003cf0 con 0x7f32fc15d1b0 2023-11-04T01:38:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f32f8ff9640 1 -- 172.21.15.44:0/3687791726 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4003ea0 con 0x7f32fc15d1b0 2023-11-04T01:38:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f330284b640 1 -- 172.21.15.44:0/3687791726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f00094d0 con 0x7f32fc15d1b0 2023-11-04T01:38:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.525+0000 7f330284b640 1 -- 172.21.15.44:0/3687791726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc0b1ea0 con 0x7f32fc15d1b0 2023-11-04T01:38:20.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.526+0000 7f330284b640 1 -- 172.21.15.44:0/3687791726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32fc04e490 con 0x7f32fc15d1b0 2023-11-04T01:38:20.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.527+0000 7f32f8ff9640 1 -- 172.21.15.44:0/3687791726 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f32f400aa90 con 0x7f32fc15d1b0 2023-11-04T01:38:20.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.527+0000 7f32f8ff9640 1 --2- 172.21.15.44:0/3687791726 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f32e806ae70 0x7f32e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.528+0000 7f32f8ff9640 1 -- 172.21.15.44:0/3687791726 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f32f4089300 con 0x7f32fc15d1b0 2023-11-04T01:38:20.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.528+0000 7f32fbfff640 1 --2- 172.21.15.44:0/3687791726 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f32e806ae70 0x7f32e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.528+0000 7f32fbfff640 1 --2- 172.21.15.44:0/3687791726 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f32e806ae70 0x7f32e806d330 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f32f0036000 tx=0x7f32f003b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.532+0000 7f32f8ff9640 1 -- 172.21.15.44:0/3687791726 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32f4054490 con 0x7f32fc15d1b0 2023-11-04T01:38:20.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.707+0000 7f330284b640 1 -- 172.21.15.44:0/3687791726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f32fc06bb30 con 0x7f32fc15d1b0 2023-11-04T01:38:20.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.758+0000 7f32f8ff9640 1 -- 172.21.15.44:0/3687791726 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v64) v1 ==== 138+0+0 (secure 0 0 0) 0x7f32f4057ab0 con 0x7f32fc15d1b0 2023-11-04T01:38:20.760 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2023-11-04T01:38:20.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.760+0000 7f330284b640 1 -- 172.21.15.44:0/3687791726 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f32e806ae70 msgr2=0x7f32e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.760+0000 7f330284b640 1 --2- 172.21.15.44:0/3687791726 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f32e806ae70 0x7f32e806d330 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f32f0036000 tx=0x7f32f003b040 comp rx=0 tx=0).stop 2023-11-04T01:38:20.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.760+0000 7f330284b640 1 -- 172.21.15.44:0/3687791726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32fc15d1b0 msgr2=0x7f32fc0ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.760+0000 7f330284b640 1 --2- 172.21.15.44:0/3687791726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32fc15d1b0 0x7f32fc0ca010 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f32f400c7a0 tx=0x7f32f400cc60 comp rx=0 tx=0).stop 2023-11-04T01:38:20.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.761+0000 7f330284b640 1 -- 172.21.15.44:0/3687791726 shutdown_connections 2023-11-04T01:38:20.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.761+0000 7f330284b640 1 --2- 172.21.15.44:0/3687791726 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f32e806ae70 0x7f32e806d330 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.761+0000 7f330284b640 1 --2- 172.21.15.44:0/3687791726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32fc15d1b0 0x7f32fc0ca010 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.761+0000 7f330284b640 1 --2- 172.21.15.44:0/3687791726 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32fc0cecf0 0x7f32fc0c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.761+0000 7f330284b640 1 --2- 172.21.15.44:0/3687791726 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32fc0cb680 0x7f32fc1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.761+0000 7f330284b640 1 -- 172.21.15.44:0/3687791726 >> 172.21.15.44:0/3687791726 conn(0x7f32fc06ea20 msgr2=0x7f32fc0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:20.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.761+0000 7f330284b640 1 -- 172.21.15.44:0/3687791726 shutdown_connections 2023-11-04T01:38:20.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.761+0000 7f330284b640 1 -- 172.21.15.44:0/3687791726 wait complete. 2023-11-04T01:38:20.777 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:38:20.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.888+0000 7fb1841ee640 1 Processor -- start 2023-11-04T01:38:20.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.888+0000 7fb1841ee640 1 -- start start 2023-11-04T01:38:20.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.889+0000 7fb1841ee640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb17c0b4880 0x7fb17c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.889+0000 7fb1841ee640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c0cde60 con 0x7fb17c153e60 2023-11-04T01:38:20.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.889+0000 7fb1841ee640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c160f90 con 0x7fb17c0cd6d0 2023-11-04T01:38:20.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.889+0000 7fb1841ee640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c0b5200 con 0x7fb17c0b4880 2023-11-04T01:38:20.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.889+0000 7fb181f8a640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb17c153e60 0x7fb17c15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41384/0 (socket says 172.21.15.44:41384) 2023-11-04T01:38:20.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.889+0000 7fb181f8a640 1 -- 172.21.15.44:0/1931650926 learned_addr learned my addr 172.21.15.44:0/1931650926 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:20.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.889+0000 7fb18278b640 1 --2- 172.21.15.44:0/1931650926 >> v2:172.21.15.204:3300/0 conn(0x7fb17c0b4880 0x7fb17c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.889+0000 7fb180f88640 1 -- 172.21.15.44:0/1931650926 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756685067 0 0) 0x7fb17c0cde60 con 0x7fb17c153e60 2023-11-04T01:38:20.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.889+0000 7fb180f88640 1 -- 172.21.15.44:0/1931650926 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb164003520 con 0x7fb17c153e60 2023-11-04T01:38:20.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb180f88640 1 -- 172.21.15.44:0/1931650926 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1853027039 0 0) 0x7fb164003520 con 0x7fb17c153e60 2023-11-04T01:38:20.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb180f88640 1 -- 172.21.15.44:0/1931650926 >> v2:172.21.15.204:3300/0 conn(0x7fb17c0b4880 msgr2=0x7fb17c0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:20.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb180f88640 1 --2- 172.21.15.44:0/1931650926 >> v2:172.21.15.204:3300/0 conn(0x7fb17c0b4880 0x7fb17c0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb180f88640 1 -- 172.21.15.44:0/1931650926 >> v1:172.21.15.204:6789/0 conn(0x7fb17c0cd6d0 legacy=0x7fb17c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb180f88640 1 -- 172.21.15.44:0/1931650926 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0ce090 con 0x7fb17c153e60 2023-11-04T01:38:20.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb180f88640 1 -- 172.21.15.44:0/1931650926 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fb174001670 con 0x7fb17c153e60 2023-11-04T01:38:20.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb180f88640 1 -- 172.21.15.44:0/1931650926 >> v1:172.21.15.44:6789/0 conn(0x7fb17c153e60 legacy=0x7fb17c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb180f88640 1 --2- 172.21.15.44:0/1931650926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb164003970 0x7fb164003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb180f88640 1 --2- 172.21.15.44:0/1931650926 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1640047c0 0x7fb164004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb180f88640 1 --2- 172.21.15.44:0/1931650926 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb164005180 0x7fb16400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb180f88640 1 -- 172.21.15.44:0/1931650926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0b5200 con 0x7fb164003970 2023-11-04T01:38:20.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb180f88640 1 -- 172.21.15.44:0/1931650926 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16400c020 con 0x7fb164005180 2023-11-04T01:38:20.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb180f88640 1 -- 172.21.15.44:0/1931650926 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16400c1e0 con 0x7fb1640047c0 2023-11-04T01:38:20.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb181f8a640 1 --2- 172.21.15.44:0/1931650926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb164003970 0x7fb164003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb18278b640 1 --2- 172.21.15.44:0/1931650926 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb164005180 0x7fb16400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb181789640 1 --2- 172.21.15.44:0/1931650926 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1640047c0 0x7fb164004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb181f8a640 1 -- 172.21.15.44:0/1931650926 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1640047c0 msgr2=0x7fb164004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:20.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb181f8a640 1 --2- 172.21.15.44:0/1931650926 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1640047c0 0x7fb164004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb181f8a640 1 -- 172.21.15.44:0/1931650926 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb164005180 msgr2=0x7fb16400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:20.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb181f8a640 1 --2- 172.21.15.44:0/1931650926 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb164005180 0x7fb16400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb18278b640 1 -- 172.21.15.44:0/1931650926 reap_dead start 2023-11-04T01:38:20.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.890+0000 7fb181f8a640 1 -- 172.21.15.44:0/1931650926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb164003520 con 0x7fb164003970 2023-11-04T01:38:20.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.891+0000 7fb181f8a640 1 --2- 172.21.15.44:0/1931650926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb164003970 0x7fb164003d90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb17400c160 tx=0x7fb1640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2fe88b53daf74 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.891+0000 7fb180f88640 1 -- 172.21.15.44:0/1931650926 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174005ad0 con 0x7fb164003970 2023-11-04T01:38:20.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.891+0000 7fb180f88640 1 -- 172.21.15.44:0/1931650926 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb174005c50 con 0x7fb164003970 2023-11-04T01:38:20.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.891+0000 7fb180f88640 1 -- 172.21.15.44:0/1931650926 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17402c810 con 0x7fb164003970 2023-11-04T01:38:20.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.892+0000 7fb1841ee640 1 -- 172.21.15.44:0/1931650926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb164003970 msgr2=0x7fb164003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.892+0000 7fb1841ee640 1 --2- 172.21.15.44:0/1931650926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb164003970 0x7fb164003d90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb17400c160 tx=0x7fb1640057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.892+0000 7fb1841ee640 1 -- 172.21.15.44:0/1931650926 shutdown_connections 2023-11-04T01:38:20.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.892+0000 7fb1841ee640 1 --2- 172.21.15.44:0/1931650926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb164003970 0x7fb164003d90 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.892+0000 7fb1841ee640 1 -- 172.21.15.44:0/1931650926 >> 172.21.15.44:0/1931650926 conn(0x7fb17c0cf880 msgr2=0x7fb17c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:20.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.892+0000 7fb1841ee640 1 -- 172.21.15.44:0/1931650926 shutdown_connections 2023-11-04T01:38:20.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.892+0000 7fb1841ee640 1 -- 172.21.15.44:0/1931650926 wait complete. 2023-11-04T01:38:20.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.893+0000 7fb1841ee640 1 Processor -- start 2023-11-04T01:38:20.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.893+0000 7fb1841ee640 1 -- start start 2023-11-04T01:38:20.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb1841ee640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb164003970 0x7fb17c0cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb1841ee640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb17c0c7340 0x7fb17c1f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb1841ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb17c0c8d50 0x7fb17c0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb1841ee640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0c9710 con 0x7fb17c0c8d50 2023-11-04T01:38:20.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb1841ee640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c1f2b30 con 0x7fb164003970 2023-11-04T01:38:20.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb1841ee640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0c7b90 con 0x7fb17c0c7340 2023-11-04T01:38:20.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb18278b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb17c0c8d50 0x7fb17c0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb18278b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb17c0c8d50 0x7fb17c0c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44150/0 (socket says 172.21.15.44:44150) 2023-11-04T01:38:20.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb18278b640 1 -- 172.21.15.44:0/1664154558 learned_addr learned my addr 172.21.15.44:0/1664154558 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:20.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb181f8a640 1 --2- 172.21.15.44:0/1664154558 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb164003970 0x7fb17c0cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb181789640 1 --2- 172.21.15.44:0/1664154558 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb17c0c7340 0x7fb17c1f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb18278b640 1 -- 172.21.15.44:0/1664154558 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb17c0c7340 msgr2=0x7fb17c1f21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb18278b640 1 --2- 172.21.15.44:0/1664154558 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb17c0c7340 0x7fb17c1f21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb18278b640 1 -- 172.21.15.44:0/1664154558 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb164003970 msgr2=0x7fb17c0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb18278b640 1 --2- 172.21.15.44:0/1664154558 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb164003970 0x7fb17c0cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb18278b640 1 -- 172.21.15.44:0/1664154558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0c7e70 con 0x7fb17c0c8d50 2023-11-04T01:38:20.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb181789640 1 --2- 172.21.15.44:0/1664154558 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb17c0c7340 0x7fb17c1f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:20.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb18278b640 1 --2- 172.21.15.44:0/1664154558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb17c0c8d50 0x7fb17c0c91d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb17c06c900 tx=0x7fb16c00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb17a7fc640 1 -- 172.21.15.44:0/1664154558 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c00e040 con 0x7fb17c0c8d50 2023-11-04T01:38:20.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb17a7fc640 1 -- 172.21.15.44:0/1664154558 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c00f040 con 0x7fb17c0c8d50 2023-11-04T01:38:20.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.894+0000 7fb1841ee640 1 -- 172.21.15.44:0/1664154558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c0c8150 con 0x7fb17c0c8d50 2023-11-04T01:38:20.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.895+0000 7fb17a7fc640 1 -- 172.21.15.44:0/1664154558 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c015430 con 0x7fb17c0c8d50 2023-11-04T01:38:20.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.895+0000 7fb1841ee640 1 -- 172.21.15.44:0/1664154558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c1f26e0 con 0x7fb17c0c8d50 2023-11-04T01:38:20.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.895+0000 7fb1841ee640 1 -- 172.21.15.44:0/1664154558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c1f2ce0 con 0x7fb17c0c8d50 2023-11-04T01:38:20.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.896+0000 7fb17a7fc640 1 -- 172.21.15.44:0/1664154558 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb16c015590 con 0x7fb17c0c8d50 2023-11-04T01:38:20.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.897+0000 7fb17a7fc640 1 --2- 172.21.15.44:0/1664154558 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb16806aea0 0x7fb16806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.897+0000 7fb17a7fc640 1 -- 172.21.15.44:0/1664154558 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5900+0+0 (secure 0 0 0) 0x7fb16c08a490 con 0x7fb17c0c8d50 2023-11-04T01:38:20.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.897+0000 7fb181f8a640 1 --2- 172.21.15.44:0/1664154558 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb16806aea0 0x7fb16806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.897+0000 7fb181f8a640 1 --2- 172.21.15.44:0/1664154558 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb16806aea0 0x7fb16806d360 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb174034000 tx=0x7fb174007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:20.901+0000 7fb17a7fc640 1 -- 172.21.15.44:0/1664154558 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb16c0555a0 con 0x7fb17c0c8d50 2023-11-04T01:38:21.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.077+0000 7fb1841ee640 1 -- 172.21.15.44:0/1664154558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb17c1f2ca0 con 0x7fb17c0c8d50 2023-11-04T01:38:21.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.761+0000 7fb17a7fc640 1 -- 172.21.15.44:0/1664154558 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v65) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb16c058bc0 con 0x7fb17c0c8d50 2023-11-04T01:38:21.763 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2023-11-04T01:38:21.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.765+0000 7fb1841ee640 1 -- 172.21.15.44:0/1664154558 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb16806aea0 msgr2=0x7fb16806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.766+0000 7fb1841ee640 1 --2- 172.21.15.44:0/1664154558 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb16806aea0 0x7fb16806d360 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb174034000 tx=0x7fb174007000 comp rx=0 tx=0).stop 2023-11-04T01:38:21.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.766+0000 7fb1841ee640 1 -- 172.21.15.44:0/1664154558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb17c0c8d50 msgr2=0x7fb17c0c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.766+0000 7fb1841ee640 1 --2- 172.21.15.44:0/1664154558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb17c0c8d50 0x7fb17c0c91d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb17c06c900 tx=0x7fb16c00f1b0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.766+0000 7fb1841ee640 1 -- 172.21.15.44:0/1664154558 shutdown_connections 2023-11-04T01:38:21.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.766+0000 7fb1841ee640 1 --2- 172.21.15.44:0/1664154558 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb16806aea0 0x7fb16806d360 secure :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb174034000 tx=0x7fb174007000 comp rx=0 tx=0).stop 2023-11-04T01:38:21.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.766+0000 7fb1841ee640 1 --2- 172.21.15.44:0/1664154558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb17c0c8d50 0x7fb17c0c91d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.766+0000 7fb1841ee640 1 --2- 172.21.15.44:0/1664154558 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb17c0c7340 0x7fb17c1f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.766+0000 7fb1841ee640 1 --2- 172.21.15.44:0/1664154558 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb164003970 0x7fb17c0cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.766+0000 7fb1841ee640 1 -- 172.21.15.44:0/1664154558 >> 172.21.15.44:0/1664154558 conn(0x7fb17c0cf880 msgr2=0x7fb17c0b8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:21.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.766+0000 7fb1841ee640 1 -- 172.21.15.44:0/1664154558 shutdown_connections 2023-11-04T01:38:21.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.766+0000 7fb1841ee640 1 -- 172.21.15.44:0/1664154558 wait complete. 2023-11-04T01:38:21.794 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:38:21.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.903+0000 7ff27d7d5640 1 Processor -- start 2023-11-04T01:38:21.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.903+0000 7ff27d7d5640 1 -- start start 2023-11-04T01:38:21.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.904+0000 7ff27d7d5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff2780cccc0 0x7ff27806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.904+0000 7ff27d7d5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27806ca40 con 0x7ff2780b2d30 2023-11-04T01:38:21.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.904+0000 7ff27d7d5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27806cd20 con 0x7ff278160430 2023-11-04T01:38:21.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.904+0000 7ff27d7d5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2780cb580 con 0x7ff2780cccc0 2023-11-04T01:38:21.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.904+0000 7ff2777fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff2780cccc0 0x7ff27806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.904+0000 7ff2767fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff2780b2d30 0x7ff27806bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41392/0 (socket says 172.21.15.44:41392) 2023-11-04T01:38:21.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.904+0000 7ff2777fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff2780cccc0 0x7ff27806c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44160/0 (socket says 172.21.15.44:44160) 2023-11-04T01:38:21.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.904+0000 7ff2767fc640 1 -- 172.21.15.44:0/822747504 learned_addr learned my addr 172.21.15.44:0/822747504 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:21.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.904+0000 7ff2777fe640 1 -- 172.21.15.44:0/822747504 >> v1:172.21.15.204:6789/0 conn(0x7ff278160430 legacy=0x7ff2780b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:21.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.904+0000 7ff2777fe640 1 -- 172.21.15.44:0/822747504 >> v1:172.21.15.44:6789/0 conn(0x7ff2780b2d30 legacy=0x7ff27806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.904+0000 7ff2777fe640 1 -- 172.21.15.44:0/822747504 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27806d000 con 0x7ff2780cccc0 2023-11-04T01:38:21.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.904+0000 7ff275ffb640 1 -- 172.21.15.44:0/822747504 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949426636 0 0) 0x7ff27806ca40 con 0x7ff2780b2d30 2023-11-04T01:38:21.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.905+0000 7ff2777fe640 1 --2- 172.21.15.44:0/822747504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2780cccc0 0x7ff27806c3a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff268009d90 tx=0x7ff26802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30acb7e8f40a1994 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:21.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.905+0000 7ff275ffb640 1 -- 172.21.15.44:0/822747504 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26802cc60 con 0x7ff2780cccc0 2023-11-04T01:38:21.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.905+0000 7ff275ffb640 1 -- 172.21.15.44:0/822747504 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26802cdc0 con 0x7ff2780cccc0 2023-11-04T01:38:21.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.905+0000 7ff275ffb640 1 -- 172.21.15.44:0/822747504 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268034660 con 0x7ff2780cccc0 2023-11-04T01:38:21.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.906+0000 7ff27d7d5640 1 -- 172.21.15.44:0/822747504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2780cccc0 msgr2=0x7ff27806c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.906+0000 7ff27d7d5640 1 --2- 172.21.15.44:0/822747504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2780cccc0 0x7ff27806c3a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff268009d90 tx=0x7ff26802beb0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.906+0000 7ff27d7d5640 1 -- 172.21.15.44:0/822747504 shutdown_connections 2023-11-04T01:38:21.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.906+0000 7ff27d7d5640 1 --2- 172.21.15.44:0/822747504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2780cccc0 0x7ff27806c3a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.906+0000 7ff27d7d5640 1 -- 172.21.15.44:0/822747504 >> 172.21.15.44:0/822747504 conn(0x7ff27806ea20 msgr2=0x7ff27806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:21.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.906+0000 7ff27d7d5640 1 -- 172.21.15.44:0/822747504 shutdown_connections 2023-11-04T01:38:21.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.906+0000 7ff27d7d5640 1 -- 172.21.15.44:0/822747504 wait complete. 2023-11-04T01:38:21.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.907+0000 7ff27d7d5640 1 Processor -- start 2023-11-04T01:38:21.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.907+0000 7ff27d7d5640 1 -- start start 2023-11-04T01:38:21.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff27d7d5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2780b2d30 0x7ff2780c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff27d7d5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2780cccc0 0x7ff2780c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff27d7d5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff278160430 0x7ff278149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff27d7d5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff278156680 con 0x7ff2780b2d30 2023-11-04T01:38:21.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff27d7d5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff278155a00 con 0x7ff278160430 2023-11-04T01:38:21.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff27d7d5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff278155ce0 con 0x7ff2780cccc0 2023-11-04T01:38:21.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff276ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2780b2d30 0x7ff2780c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff276ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2780b2d30 0x7ff2780c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44166/0 (socket says 172.21.15.44:44166) 2023-11-04T01:38:21.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff276ffd640 1 -- 172.21.15.44:0/3341145553 learned_addr learned my addr 172.21.15.44:0/3341145553 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:21.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff2777fe640 1 --2- 172.21.15.44:0/3341145553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff278160430 0x7ff278149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff2767fc640 1 --2- 172.21.15.44:0/3341145553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2780cccc0 0x7ff2780c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff276ffd640 1 -- 172.21.15.44:0/3341145553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2780cccc0 msgr2=0x7ff2780c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff276ffd640 1 --2- 172.21.15.44:0/3341145553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2780cccc0 0x7ff2780c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff276ffd640 1 -- 172.21.15.44:0/3341145553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff278160430 msgr2=0x7ff278149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff276ffd640 1 --2- 172.21.15.44:0/3341145553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff278160430 0x7ff278149940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff276ffd640 1 -- 172.21.15.44:0/3341145553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff268009a70 con 0x7ff2780b2d30 2023-11-04T01:38:21.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.908+0000 7ff2777fe640 1 --2- 172.21.15.44:0/3341145553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff278160430 0x7ff278149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:21.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.909+0000 7ff276ffd640 1 --2- 172.21.15.44:0/3341145553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2780b2d30 0x7ff2780c9dc0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff27000b3f0 tx=0x7ff27000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:21.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.909+0000 7ff25f7fe640 1 -- 172.21.15.44:0/3341145553 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270011830 con 0x7ff2780b2d30 2023-11-04T01:38:21.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.909+0000 7ff25f7fe640 1 -- 172.21.15.44:0/3341145553 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff270011990 con 0x7ff2780b2d30 2023-11-04T01:38:21.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.909+0000 7ff27d7d5640 1 -- 172.21.15.44:0/3341145553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff278155fc0 con 0x7ff2780b2d30 2023-11-04T01:38:21.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.909+0000 7ff25f7fe640 1 -- 172.21.15.44:0/3341145553 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270011d40 con 0x7ff2780b2d30 2023-11-04T01:38:21.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.909+0000 7ff27d7d5640 1 -- 172.21.15.44:0/3341145553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2780ca300 con 0x7ff2780b2d30 2023-11-04T01:38:21.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.910+0000 7ff27d7d5640 1 -- 172.21.15.44:0/3341145553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2781567c0 con 0x7ff2780b2d30 2023-11-04T01:38:21.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.910+0000 7ff25f7fe640 1 -- 172.21.15.44:0/3341145553 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff27001a400 con 0x7ff2780b2d30 2023-11-04T01:38:21.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.911+0000 7ff25f7fe640 1 --2- 172.21.15.44:0/3341145553 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff26406ae70 0x7ff26406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.911+0000 7ff25f7fe640 1 -- 172.21.15.44:0/3341145553 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6282+0+0 (secure 0 0 0) 0x7ff2700895c0 con 0x7ff2780b2d30 2023-11-04T01:38:21.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.911+0000 7ff2767fc640 1 --2- 172.21.15.44:0/3341145553 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff26406ae70 0x7ff26406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.911+0000 7ff2767fc640 1 --2- 172.21.15.44:0/3341145553 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff26406ae70 0x7ff26406d330 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff278153dd0 tx=0x7ff26c007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:21.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:21.915+0000 7ff25f7fe640 1 -- 172.21.15.44:0/3341145553 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff2781567c0 con 0x7ff2780b2d30 2023-11-04T01:38:22.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.127+0000 7ff27d7d5640 1 -- 172.21.15.44:0/3341145553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff2781567c0 con 0x7ff2780b2d30 2023-11-04T01:38:22.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.784+0000 7ff25f7fe640 1 -- 172.21.15.44:0/3341145553 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v29) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff2781567c0 con 0x7ff2780b2d30 2023-11-04T01:38:22.787 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 10 and data pool 11 2023-11-04T01:38:22.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.791+0000 7ff27d7d5640 1 -- 172.21.15.44:0/3341145553 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff26406ae70 msgr2=0x7ff26406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.791+0000 7ff27d7d5640 1 --2- 172.21.15.44:0/3341145553 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff26406ae70 0x7ff26406d330 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff278153dd0 tx=0x7ff26c007d50 comp rx=0 tx=0).stop 2023-11-04T01:38:22.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.791+0000 7ff27d7d5640 1 -- 172.21.15.44:0/3341145553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2780b2d30 msgr2=0x7ff2780c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.791+0000 7ff27d7d5640 1 --2- 172.21.15.44:0/3341145553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2780b2d30 0x7ff2780c9dc0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff27000b3f0 tx=0x7ff27000b8b0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.792+0000 7ff27d7d5640 1 -- 172.21.15.44:0/3341145553 shutdown_connections 2023-11-04T01:38:22.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.792+0000 7ff27d7d5640 1 --2- 172.21.15.44:0/3341145553 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff26406ae70 0x7ff26406d330 secure :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff278153dd0 tx=0x7ff26c007d50 comp rx=0 tx=0).stop 2023-11-04T01:38:22.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.792+0000 7ff27d7d5640 1 --2- 172.21.15.44:0/3341145553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff278160430 0x7ff278149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.792+0000 7ff27d7d5640 1 --2- 172.21.15.44:0/3341145553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2780cccc0 0x7ff2780c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.792+0000 7ff27d7d5640 1 --2- 172.21.15.44:0/3341145553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2780b2d30 0x7ff2780c9dc0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.793+0000 7ff27d7d5640 1 -- 172.21.15.44:0/3341145553 >> 172.21.15.44:0/3341145553 conn(0x7ff27806ea20 msgr2=0x7ff2780c7050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:22.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.795+0000 7ff27d7d5640 1 -- 172.21.15.44:0/3341145553 shutdown_connections 2023-11-04T01:38:22.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.795+0000 7ff27d7d5640 1 -- 172.21.15.44:0/3341145553 wait complete. 2023-11-04T01:38:22.821 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:22.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.930+0000 7fa1151a5640 1 Processor -- start 2023-11-04T01:38:22.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.930+0000 7fa1151a5640 1 -- start start 2023-11-04T01:38:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa1151a5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100aec80 0x7fa1100b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa1151a5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa1100af060 0x7fa11006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa1151a5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa11006ef40 0x7fa1100cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa1151a5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa110155a40 con 0x7fa11006ef40 2023-11-04T01:38:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa1151a5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1100b1590 con 0x7fa1100af060 2023-11-04T01:38:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa1151a5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11006a660 con 0x7fa1100aec80 2023-11-04T01:38:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa10f59e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa11006ef40 0x7fa1100cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa10f59e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa11006ef40 0x7fa1100cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44550/0 (socket says 172.21.15.44:44550) 2023-11-04T01:38:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa10f59e640 1 -- 172.21.15.44:0/2061233064 learned_addr learned my addr 172.21.15.44:0/2061233064 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa10f59e640 1 -- 172.21.15.44:0/2061233064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100aec80 msgr2=0x7fa1100b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa10ed9d640 1 --2- 172.21.15.44:0/2061233064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100aec80 0x7fa1100b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa10e59c640 1 --2- 172.21.15.44:0/2061233064 >> v2:172.21.15.204:3300/0 conn(0x7fa1100af060 0x7fa11006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa10f59e640 1 --2- 172.21.15.44:0/2061233064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100aec80 0x7fa1100b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa10f59e640 1 -- 172.21.15.44:0/2061233064 >> v2:172.21.15.204:3300/0 conn(0x7fa1100af060 msgr2=0x7fa11006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa10f59e640 1 --2- 172.21.15.44:0/2061233064 >> v2:172.21.15.204:3300/0 conn(0x7fa1100af060 0x7fa11006a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa10f59e640 1 -- 172.21.15.44:0/2061233064 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11006a8e0 con 0x7fa11006ef40 2023-11-04T01:38:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.931+0000 7fa10e59c640 1 --2- 172.21.15.44:0/2061233064 >> v2:172.21.15.204:3300/0 conn(0x7fa1100af060 0x7fa11006a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.932+0000 7fa10f59e640 1 --2- 172.21.15.44:0/2061233064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa11006ef40 0x7fa1100cb7a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fa1100cf930 tx=0x7fa10802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e709f1a35f8a013d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.932+0000 7fa10dd9b640 1 -- 172.21.15.44:0/2061233064 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108031860 con 0x7fa11006ef40 2023-11-04T01:38:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.932+0000 7fa10dd9b640 1 -- 172.21.15.44:0/2061233064 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1080319c0 con 0x7fa11006ef40 2023-11-04T01:38:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.932+0000 7fa10dd9b640 1 -- 172.21.15.44:0/2061233064 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108031d50 con 0x7fa11006ef40 2023-11-04T01:38:22.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.933+0000 7fa1151a5640 1 -- 172.21.15.44:0/2061233064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa11006ef40 msgr2=0x7fa1100cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.933+0000 7fa1151a5640 1 --2- 172.21.15.44:0/2061233064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa11006ef40 0x7fa1100cb7a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fa1100cf930 tx=0x7fa10802b900 comp rx=0 tx=0).stop 2023-11-04T01:38:22.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.933+0000 7fa1151a5640 1 -- 172.21.15.44:0/2061233064 shutdown_connections 2023-11-04T01:38:22.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.933+0000 7fa1151a5640 1 --2- 172.21.15.44:0/2061233064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa11006ef40 0x7fa1100cb7a0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.933+0000 7fa1151a5640 1 --2- 172.21.15.44:0/2061233064 >> v2:172.21.15.204:3300/0 conn(0x7fa1100af060 0x7fa11006a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.933+0000 7fa1151a5640 1 --2- 172.21.15.44:0/2061233064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100aec80 0x7fa1100b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.933+0000 7fa1151a5640 1 -- 172.21.15.44:0/2061233064 >> 172.21.15.44:0/2061233064 conn(0x7fa110098d40 msgr2=0x7fa1100cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:22.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.933+0000 7fa1151a5640 1 -- 172.21.15.44:0/2061233064 shutdown_connections 2023-11-04T01:38:22.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.933+0000 7fa1151a5640 1 -- 172.21.15.44:0/2061233064 wait complete. 2023-11-04T01:38:22.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.934+0000 7fa1151a5640 1 Processor -- start 2023-11-04T01:38:22.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.934+0000 7fa1151a5640 1 -- start start 2023-11-04T01:38:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.935+0000 7fa1151a5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa11006ef40 0x7fa11015f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.935+0000 7fa1151a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1100aec80 0x7fa11015c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.935+0000 7fa1151a5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100af060 0x7fa1100b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.935+0000 7fa1151a5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11015f6b0 con 0x7fa1100aec80 2023-11-04T01:38:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.935+0000 7fa1151a5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100b3710 con 0x7fa11006ef40 2023-11-04T01:38:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.935+0000 7fa1151a5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100b39f0 con 0x7fa1100af060 2023-11-04T01:38:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.935+0000 7fa10e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1100aec80 0x7fa11015c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.935+0000 7fa10e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1100aec80 0x7fa11015c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44552/0 (socket says 172.21.15.44:44552) 2023-11-04T01:38:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.935+0000 7fa10e59c640 1 -- 172.21.15.44:0/1904221701 learned_addr learned my addr 172.21.15.44:0/1904221701 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.935+0000 7fa10ed9d640 1 --2- 172.21.15.44:0/1904221701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa11006ef40 0x7fa11015f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.935+0000 7fa10f59e640 1 --2- 172.21.15.44:0/1904221701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100af060 0x7fa1100b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.935+0000 7fa10e59c640 1 -- 172.21.15.44:0/1904221701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100af060 msgr2=0x7fa1100b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.936+0000 7fa10e59c640 1 --2- 172.21.15.44:0/1904221701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100af060 0x7fa1100b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.936+0000 7fa10e59c640 1 -- 172.21.15.44:0/1904221701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa11006ef40 msgr2=0x7fa11015f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.936+0000 7fa10e59c640 1 --2- 172.21.15.44:0/1904221701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa11006ef40 0x7fa11015f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.936+0000 7fa10e59c640 1 -- 172.21.15.44:0/1904221701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1080094d0 con 0x7fa1100aec80 2023-11-04T01:38:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.936+0000 7fa10ed9d640 1 --2- 172.21.15.44:0/1904221701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa11006ef40 0x7fa11015f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.936+0000 7fa10e59c640 1 --2- 172.21.15.44:0/1904221701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1100aec80 0x7fa11015c5f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800c7f0 tx=0x7fa0f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.936+0000 7fa1077fe640 1 -- 172.21.15.44:0/1904221701 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f800cea0 con 0x7fa1100aec80 2023-11-04T01:38:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.936+0000 7fa1077fe640 1 -- 172.21.15.44:0/1904221701 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f8005b90 con 0x7fa1100aec80 2023-11-04T01:38:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.936+0000 7fa1077fe640 1 -- 172.21.15.44:0/1904221701 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8007830 con 0x7fa1100aec80 2023-11-04T01:38:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.936+0000 7fa1151a5640 1 -- 172.21.15.44:0/1904221701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1100b3cd0 con 0x7fa1100aec80 2023-11-04T01:38:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.936+0000 7fa1151a5640 1 -- 172.21.15.44:0/1904221701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1100c8a20 con 0x7fa1100aec80 2023-11-04T01:38:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.937+0000 7fa1151a5640 1 -- 172.21.15.44:0/1904221701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1100b3ef0 con 0x7fa1100aec80 2023-11-04T01:38:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.937+0000 7fa1077fe640 1 -- 172.21.15.44:0/1904221701 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa0f8007990 con 0x7fa1100aec80 2023-11-04T01:38:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.938+0000 7fa1077fe640 1 --2- 172.21.15.44:0/1904221701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa0f006aea0 0x7fa0f006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.938+0000 7fa1077fe640 1 -- 172.21.15.44:0/1904221701 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa0f80897a0 con 0x7fa1100aec80 2023-11-04T01:38:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.938+0000 7fa10ed9d640 1 --2- 172.21.15.44:0/1904221701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa0f006aea0 0x7fa0f006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.938+0000 7fa10ed9d640 1 --2- 172.21.15.44:0/1904221701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa0f006aea0 0x7fa0f006d360 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa100007fd0 tx=0x7fa100007670 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:22.942+0000 7fa1077fe640 1 -- 172.21.15.44:0/1904221701 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa0f8054640 con 0x7fa1100aec80 2023-11-04T01:38:23.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.119+0000 7fa1151a5640 1 -- 172.21.15.44:0/1904221701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa110074290 con 0x7fa1100aec80 2023-11-04T01:38:23.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.120+0000 7fa1077fe640 1 -- 172.21.15.44:0/1904221701 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18539 (secure 0 0 0) 0x7fa0f8057c60 con 0x7fa1100aec80 2023-11-04T01:38:23.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:23.122 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":66,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:38:22.129422+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:20.738739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:21.109334+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:23.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.122+0000 7fa1151a5640 1 -- 172.21.15.44:0/1904221701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa0f006aea0 msgr2=0x7fa0f006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.122+0000 7fa1151a5640 1 --2- 172.21.15.44:0/1904221701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa0f006aea0 0x7fa0f006d360 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa100007fd0 tx=0x7fa100007670 comp rx=0 tx=0).stop 2023-11-04T01:38:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.122+0000 7fa1151a5640 1 -- 172.21.15.44:0/1904221701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1100aec80 msgr2=0x7fa11015c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.122+0000 7fa1151a5640 1 --2- 172.21.15.44:0/1904221701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1100aec80 0x7fa11015c5f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800c7f0 tx=0x7fa0f800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.122+0000 7fa1151a5640 1 -- 172.21.15.44:0/1904221701 shutdown_connections 2023-11-04T01:38:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.122+0000 7fa1151a5640 1 --2- 172.21.15.44:0/1904221701 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa0f006aea0 0x7fa0f006d360 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.122+0000 7fa1151a5640 1 --2- 172.21.15.44:0/1904221701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1100af060 0x7fa1100b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.122+0000 7fa1151a5640 1 --2- 172.21.15.44:0/1904221701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1100aec80 0x7fa11015c5f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.122+0000 7fa1151a5640 1 --2- 172.21.15.44:0/1904221701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa11006ef40 0x7fa11015f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.122+0000 7fa1151a5640 1 -- 172.21.15.44:0/1904221701 >> 172.21.15.44:0/1904221701 conn(0x7fa110098d40 msgr2=0x7fa1100aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.122+0000 7fa1151a5640 1 -- 172.21.15.44:0/1904221701 shutdown_connections 2023-11-04T01:38:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.122+0000 7fa1151a5640 1 -- 172.21.15.44:0/1904221701 wait complete. 2023-11-04T01:38:23.136 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:23.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.241+0000 7f598abbb640 1 Processor -- start 2023-11-04T01:38:23.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.241+0000 7f598abbb640 1 -- start start 2023-11-04T01:38:23.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f598abbb640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5984159c70 0x7f59840ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f598abbb640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59840b4110 con 0x7f598406db20 2023-11-04T01:38:23.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f598abbb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59840b43f0 con 0x7f59840b0ae0 2023-11-04T01:38:23.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f598abbb640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59840b49b0 con 0x7f5984159c70 2023-11-04T01:38:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f5983fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f598406db20 0x7f59840b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50406/0 (socket says 172.21.15.44:50406) 2023-11-04T01:38:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f5983fff640 1 -- 172.21.15.44:0/939841963 learned_addr learned my addr 172.21.15.44:0/939841963 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f5988957640 1 --2- 172.21.15.44:0/939841963 >> v2:172.21.15.204:3300/0 conn(0x7f5984159c70 0x7f59840ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f59837fe640 1 -- 172.21.15.44:0/939841963 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494957380 0 0) 0x7f59840b4110 con 0x7f598406db20 2023-11-04T01:38:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f59837fe640 1 -- 172.21.15.44:0/939841963 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5974003520 con 0x7f598406db20 2023-11-04T01:38:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f59837fe640 1 -- 172.21.15.44:0/939841963 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 926695592 0 0) 0x7f5974003520 con 0x7f598406db20 2023-11-04T01:38:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f59837fe640 1 -- 172.21.15.44:0/939841963 >> v2:172.21.15.204:3300/0 conn(0x7f5984159c70 msgr2=0x7f59840ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f59837fe640 1 --2- 172.21.15.44:0/939841963 >> v2:172.21.15.204:3300/0 conn(0x7f5984159c70 0x7f59840ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f59837fe640 1 -- 172.21.15.44:0/939841963 >> v1:172.21.15.204:6789/0 conn(0x7f59840b0ae0 legacy=0x7f598415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f59837fe640 1 -- 172.21.15.44:0/939841963 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59840b46d0 con 0x7f598406db20 2023-11-04T01:38:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f59837fe640 1 -- 172.21.15.44:0/939841963 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f5970001670 con 0x7f598406db20 2023-11-04T01:38:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f59837fe640 1 -- 172.21.15.44:0/939841963 >> v1:172.21.15.44:6789/0 conn(0x7f598406db20 legacy=0x7f59840b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f59837fe640 1 --2- 172.21.15.44:0/939841963 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5974003970 0x7f5974003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f59837fe640 1 --2- 172.21.15.44:0/939841963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59740047c0 0x7f5974004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.242+0000 7f59837fe640 1 --2- 172.21.15.44:0/939841963 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5974005180 0x7f597400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.243+0000 7f59837fe640 1 -- 172.21.15.44:0/939841963 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59840b49b0 con 0x7f59740047c0 2023-11-04T01:38:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.243+0000 7f59837fe640 1 -- 172.21.15.44:0/939841963 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597400e230 con 0x7f5974003970 2023-11-04T01:38:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.243+0000 7f59837fe640 1 -- 172.21.15.44:0/939841963 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597400e3f0 con 0x7f5974005180 2023-11-04T01:38:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.243+0000 7f5983fff640 1 --2- 172.21.15.44:0/939841963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59740047c0 0x7f5974004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.243+0000 7f5988957640 1 --2- 172.21.15.44:0/939841963 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5974003970 0x7f5974003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.243+0000 7f5989158640 1 --2- 172.21.15.44:0/939841963 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5974005180 0x7f597400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.243+0000 7f5983fff640 1 -- 172.21.15.44:0/939841963 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5974005180 msgr2=0x7f597400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.243+0000 7f5983fff640 1 --2- 172.21.15.44:0/939841963 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5974005180 0x7f597400db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.243+0000 7f5983fff640 1 -- 172.21.15.44:0/939841963 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5974003970 msgr2=0x7f5974003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.243+0000 7f5983fff640 1 --2- 172.21.15.44:0/939841963 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5974003970 0x7f5974003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.243+0000 7f5983fff640 1 -- 172.21.15.44:0/939841963 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5974003520 con 0x7f59740047c0 2023-11-04T01:38:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.243+0000 7f5989158640 1 -- 172.21.15.44:0/939841963 reap_dead start 2023-11-04T01:38:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.244+0000 7f5983fff640 1 --2- 172.21.15.44:0/939841963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59740047c0 0x7f5974004c40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f597000c240 tx=0x7f59740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207a4deb793a6b8a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.244+0000 7f59837fe640 1 -- 172.21.15.44:0/939841963 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5970005ad0 con 0x7f59740047c0 2023-11-04T01:38:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.244+0000 7f59837fe640 1 -- 172.21.15.44:0/939841963 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5970005c30 con 0x7f59740047c0 2023-11-04T01:38:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.244+0000 7f59837fe640 1 -- 172.21.15.44:0/939841963 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597002c8b0 con 0x7f59740047c0 2023-11-04T01:38:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.244+0000 7f598abbb640 1 -- 172.21.15.44:0/939841963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59740047c0 msgr2=0x7f5974004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.244+0000 7f598abbb640 1 --2- 172.21.15.44:0/939841963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59740047c0 0x7f5974004c40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f597000c240 tx=0x7f59740057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.244+0000 7f598abbb640 1 -- 172.21.15.44:0/939841963 shutdown_connections 2023-11-04T01:38:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.244+0000 7f598abbb640 1 --2- 172.21.15.44:0/939841963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59740047c0 0x7f5974004c40 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.244+0000 7f598abbb640 1 -- 172.21.15.44:0/939841963 >> 172.21.15.44:0/939841963 conn(0x7f59840ce950 msgr2=0x7f59840ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.244+0000 7f598abbb640 1 -- 172.21.15.44:0/939841963 shutdown_connections 2023-11-04T01:38:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.244+0000 7f598abbb640 1 -- 172.21.15.44:0/939841963 wait complete. 2023-11-04T01:38:23.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.245+0000 7f598abbb640 1 Processor -- start 2023-11-04T01:38:23.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.245+0000 7f598abbb640 1 -- start start 2023-11-04T01:38:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.246+0000 7f598abbb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59740047c0 0x7f59841eedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.246+0000 7f598abbb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f598415bb00 0x7f598415bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.246+0000 7f598abbb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59840c7c60 0x7f59840c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.246+0000 7f598abbb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59840c8840 con 0x7f598415bb00 2023-11-04T01:38:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.246+0000 7f598abbb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598415c4c0 con 0x7f59840c7c60 2023-11-04T01:38:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.246+0000 7f598abbb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59841f29a0 con 0x7f59740047c0 2023-11-04T01:38:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.246+0000 7f5983fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f598415bb00 0x7f598415bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.246+0000 7f5983fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f598415bb00 0x7f598415bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44576/0 (socket says 172.21.15.44:44576) 2023-11-04T01:38:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.246+0000 7f5983fff640 1 -- 172.21.15.44:0/1078400787 learned_addr learned my addr 172.21.15.44:0/1078400787 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.247+0000 7f5989158640 1 --2- 172.21.15.44:0/1078400787 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59840c7c60 0x7f59840c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.247+0000 7f5988957640 1 --2- 172.21.15.44:0/1078400787 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59740047c0 0x7f59841eedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.247+0000 7f5983fff640 1 -- 172.21.15.44:0/1078400787 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59740047c0 msgr2=0x7f59841eedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.247+0000 7f5983fff640 1 --2- 172.21.15.44:0/1078400787 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59740047c0 0x7f59841eedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.247+0000 7f5983fff640 1 -- 172.21.15.44:0/1078400787 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59840c7c60 msgr2=0x7f59840c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.247+0000 7f5983fff640 1 --2- 172.21.15.44:0/1078400787 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59840c7c60 0x7f59840c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.247+0000 7f5983fff640 1 -- 172.21.15.44:0/1078400787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59841f2510 con 0x7f598415bb00 2023-11-04T01:38:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.247+0000 7f5988957640 1 --2- 172.21.15.44:0/1078400787 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59740047c0 0x7f59841eedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.247+0000 7f5983fff640 1 --2- 172.21.15.44:0/1078400787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f598415bb00 0x7f598415bf80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f5970001930 tx=0x7f597002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.247+0000 7f59817fa640 1 -- 172.21.15.44:0/1078400787 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597003c040 con 0x7f598415bb00 2023-11-04T01:38:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.247+0000 7f59817fa640 1 -- 172.21.15.44:0/1078400787 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597002ccc0 con 0x7f598415bb00 2023-11-04T01:38:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.247+0000 7f598abbb640 1 -- 172.21.15.44:0/1078400787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59841f1be0 con 0x7f598415bb00 2023-11-04T01:38:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.247+0000 7f59817fa640 1 -- 172.21.15.44:0/1078400787 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5970007290 con 0x7f598415bb00 2023-11-04T01:38:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.247+0000 7f598abbb640 1 -- 172.21.15.44:0/1078400787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59841f21a0 con 0x7f598415bb00 2023-11-04T01:38:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.248+0000 7f598abbb640 1 -- 172.21.15.44:0/1078400787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59841f2330 con 0x7f598415bb00 2023-11-04T01:38:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.249+0000 7f59817fa640 1 -- 172.21.15.44:0/1078400787 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5970032070 con 0x7f598415bb00 2023-11-04T01:38:23.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.249+0000 7f59817fa640 1 --2- 172.21.15.44:0/1078400787 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f596806aea0 0x7f596806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.249+0000 7f59817fa640 1 -- 172.21.15.44:0/1078400787 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f59700aae30 con 0x7f598415bb00 2023-11-04T01:38:23.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.249+0000 7f5988957640 1 --2- 172.21.15.44:0/1078400787 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f596806aea0 0x7f596806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.250+0000 7f5988957640 1 --2- 172.21.15.44:0/1078400787 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f596806aea0 0x7f596806d360 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f59840c7980 tx=0x7f5978008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.253+0000 7f59817fa640 1 -- 172.21.15.44:0/1078400787 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5970075d70 con 0x7f598415bb00 2023-11-04T01:38:23.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.430+0000 7f598abbb640 1 -- 172.21.15.44:0/1078400787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5984074290 con 0x7f598415bb00 2023-11-04T01:38:23.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.431+0000 7f59817fa640 1 -- 172.21.15.44:0/1078400787 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18539 (secure 0 0 0) 0x7f5970079390 con 0x7f598415bb00 2023-11-04T01:38:23.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:23.434 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":66,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:38:22.129422+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:20.738739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:21.109334+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:23.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.433+0000 7f598abbb640 1 -- 172.21.15.44:0/1078400787 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f596806aea0 msgr2=0x7f596806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.433+0000 7f598abbb640 1 --2- 172.21.15.44:0/1078400787 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f596806aea0 0x7f596806d360 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f59840c7980 tx=0x7f5978008040 comp rx=0 tx=0).stop 2023-11-04T01:38:23.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.433+0000 7f598abbb640 1 -- 172.21.15.44:0/1078400787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f598415bb00 msgr2=0x7f598415bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.433+0000 7f598abbb640 1 --2- 172.21.15.44:0/1078400787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f598415bb00 0x7f598415bf80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f5970001930 tx=0x7f597002e070 comp rx=0 tx=0).stop 2023-11-04T01:38:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.433+0000 7f598abbb640 1 -- 172.21.15.44:0/1078400787 shutdown_connections 2023-11-04T01:38:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.433+0000 7f598abbb640 1 --2- 172.21.15.44:0/1078400787 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f596806aea0 0x7f596806d360 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.433+0000 7f598abbb640 1 --2- 172.21.15.44:0/1078400787 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59840c7c60 0x7f59840c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.433+0000 7f598abbb640 1 --2- 172.21.15.44:0/1078400787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f598415bb00 0x7f598415bf80 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.433+0000 7f598abbb640 1 --2- 172.21.15.44:0/1078400787 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59740047c0 0x7f59841eedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.433+0000 7f598abbb640 1 -- 172.21.15.44:0/1078400787 >> 172.21.15.44:0/1078400787 conn(0x7f59840ce950 msgr2=0x7f59840cb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.433+0000 7f598abbb640 1 -- 172.21.15.44:0/1078400787 shutdown_connections 2023-11-04T01:38:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.433+0000 7f598abbb640 1 -- 172.21.15.44:0/1078400787 wait complete. 2023-11-04T01:38:23.446 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:38:23.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.554+0000 7fc697db0640 1 Processor -- start 2023-11-04T01:38:23.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.554+0000 7fc697db0640 1 -- start start 2023-11-04T01:38:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.555+0000 7fc697db0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc690153e60 0x7fc69015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.555+0000 7fc697db0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc6900cd6d0 0x7fc690161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.555+0000 7fc697db0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900cde60 con 0x7fc6900b4880 2023-11-04T01:38:23.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.555+0000 7fc697db0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc690160f90 con 0x7fc6900cd6d0 2023-11-04T01:38:23.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.555+0000 7fc697db0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69015e400 con 0x7fc690153e60 2023-11-04T01:38:23.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.555+0000 7fc695b4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc690153e60 0x7fc69015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.555+0000 7fc69534b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc6900cd6d0 0x7fc690161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.555+0000 7fc69534b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc6900cd6d0 0x7fc690161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:51932/0 (socket says 172.21.15.44:51932) 2023-11-04T01:38:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.555+0000 7fc69534b640 1 -- 172.21.15.44:0/3282764447 learned_addr learned my addr 172.21.15.44:0/3282764447 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.555+0000 7fc69534b640 1 -- 172.21.15.44:0/3282764447 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc690153e60 msgr2=0x7fc69015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.555+0000 7fc69534b640 1 --2- 172.21.15.44:0/3282764447 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc690153e60 0x7fc69015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.555+0000 7fc69534b640 1 -- 172.21.15.44:0/3282764447 >> v1:172.21.15.204:6789/0 conn(0x7fc6900b4880 legacy=0x7fc69006b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.555+0000 7fc69534b640 1 -- 172.21.15.44:0/3282764447 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc690161960 con 0x7fc6900cd6d0 2023-11-04T01:38:23.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.556+0000 7fc69534b640 1 --2- 172.21.15.44:0/3282764447 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc6900cd6d0 0x7fc690161420 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc680009870 tx=0x7fc68002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7434a1f386182a54 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.556+0000 7fc694b4a640 1 -- 172.21.15.44:0/3282764447 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc680030840 con 0x7fc6900cd6d0 2023-11-04T01:38:23.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.556+0000 7fc694b4a640 1 -- 172.21.15.44:0/3282764447 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6800309a0 con 0x7fc6900cd6d0 2023-11-04T01:38:23.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.556+0000 7fc694b4a640 1 -- 172.21.15.44:0/3282764447 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc680030d30 con 0x7fc6900cd6d0 2023-11-04T01:38:23.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.557+0000 7fc697db0640 1 -- 172.21.15.44:0/3282764447 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc6900cd6d0 msgr2=0x7fc690161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.557+0000 7fc697db0640 1 --2- 172.21.15.44:0/3282764447 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc6900cd6d0 0x7fc690161420 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc680009870 tx=0x7fc68002b980 comp rx=0 tx=0).stop 2023-11-04T01:38:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.557+0000 7fc697db0640 1 -- 172.21.15.44:0/3282764447 shutdown_connections 2023-11-04T01:38:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.557+0000 7fc697db0640 1 --2- 172.21.15.44:0/3282764447 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc6900cd6d0 0x7fc690161420 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.557+0000 7fc697db0640 1 --2- 172.21.15.44:0/3282764447 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc690153e60 0x7fc69015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.557+0000 7fc697db0640 1 -- 172.21.15.44:0/3282764447 >> 172.21.15.44:0/3282764447 conn(0x7fc6900cf880 msgr2=0x7fc6900cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.557+0000 7fc697db0640 1 -- 172.21.15.44:0/3282764447 shutdown_connections 2023-11-04T01:38:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.557+0000 7fc697db0640 1 -- 172.21.15.44:0/3282764447 wait complete. 2023-11-04T01:38:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.558+0000 7fc697db0640 1 Processor -- start 2023-11-04T01:38:23.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.558+0000 7fc697db0640 1 -- start start 2023-11-04T01:38:23.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc697db0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc6900b4880 0x7fc6900c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc697db0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc6900cd6d0 0x7fc6900cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc697db0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc690153e60 0x7fc6901f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc697db0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc690157600 con 0x7fc690153e60 2023-11-04T01:38:23.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc697db0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6901f38b0 con 0x7fc6900cd6d0 2023-11-04T01:38:23.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc697db0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900cc320 con 0x7fc6900b4880 2023-11-04T01:38:23.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc695b4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc6900b4880 0x7fc6900c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc695b4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc6900b4880 0x7fc6900c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:42236/0 (socket says 172.21.15.44:42236) 2023-11-04T01:38:23.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc695b4c640 1 -- 172.21.15.44:0/332053444 learned_addr learned my addr 172.21.15.44:0/332053444 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc69534b640 1 --2- 172.21.15.44:0/332053444 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc6900cd6d0 0x7fc6900cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc69634d640 1 --2- 172.21.15.44:0/332053444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc690153e60 0x7fc6901f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc695b4c640 1 -- 172.21.15.44:0/332053444 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc6900cd6d0 msgr2=0x7fc6900cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc695b4c640 1 --2- 172.21.15.44:0/332053444 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc6900cd6d0 0x7fc6900cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc695b4c640 1 -- 172.21.15.44:0/332053444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc690153e60 msgr2=0x7fc6901f3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc695b4c640 1 --2- 172.21.15.44:0/332053444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc690153e60 0x7fc6901f3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.559+0000 7fc695b4c640 1 -- 172.21.15.44:0/332053444 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800094d0 con 0x7fc6900b4880 2023-11-04T01:38:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.560+0000 7fc695b4c640 1 --2- 172.21.15.44:0/332053444 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc6900b4880 0x7fc6900c9310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009d10 tx=0x7fc68c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.560+0000 7fc6867fc640 1 -- 172.21.15.44:0/332053444 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c009b80 con 0x7fc6900b4880 2023-11-04T01:38:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.560+0000 7fc6867fc640 1 -- 172.21.15.44:0/332053444 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c00f040 con 0x7fc6900b4880 2023-11-04T01:38:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.560+0000 7fc697db0640 1 -- 172.21.15.44:0/332053444 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6900cc600 con 0x7fc6900b4880 2023-11-04T01:38:23.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.560+0000 7fc6867fc640 1 -- 172.21.15.44:0/332053444 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c014680 con 0x7fc6900b4880 2023-11-04T01:38:23.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.560+0000 7fc697db0640 1 -- 172.21.15.44:0/332053444 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6900ccbc0 con 0x7fc6900b4880 2023-11-04T01:38:23.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.561+0000 7fc697db0640 1 -- 172.21.15.44:0/332053444 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc690074290 con 0x7fc6900b4880 2023-11-04T01:38:23.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.562+0000 7fc6867fc640 1 -- 172.21.15.44:0/332053444 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc68c0147e0 con 0x7fc6900b4880 2023-11-04T01:38:23.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.562+0000 7fc6867fc640 1 --2- 172.21.15.44:0/332053444 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc67406ae70 0x7fc67406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.562+0000 7fc6867fc640 1 -- 172.21.15.44:0/332053444 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc68c08a4b0 con 0x7fc6900b4880 2023-11-04T01:38:23.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.562+0000 7fc69534b640 1 --2- 172.21.15.44:0/332053444 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc67406ae70 0x7fc67406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.563+0000 7fc69534b640 1 --2- 172.21.15.44:0/332053444 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc67406ae70 0x7fc67406d330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc680036000 tx=0x7fc680008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.566+0000 7fc6867fc640 1 -- 172.21.15.44:0/332053444 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc68c055350 con 0x7fc6900b4880 2023-11-04T01:38:23.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.781+0000 7fc697db0640 1 -- 172.21.15.44:0/332053444 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc6900b83b0 con 0x7fc6900b4880 2023-11-04T01:38:23.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.789+0000 7fc6867fc640 1 -- 172.21.15.44:0/332053444 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc68c058970 con 0x7fc6900b4880 2023-11-04T01:38:23.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.791+0000 7fc697db0640 1 -- 172.21.15.44:0/332053444 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc67406ae70 msgr2=0x7fc67406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.791+0000 7fc697db0640 1 --2- 172.21.15.44:0/332053444 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc67406ae70 0x7fc67406d330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc680036000 tx=0x7fc680008030 comp rx=0 tx=0).stop 2023-11-04T01:38:23.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.791+0000 7fc697db0640 1 -- 172.21.15.44:0/332053444 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc6900b4880 msgr2=0x7fc6900c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.791+0000 7fc697db0640 1 --2- 172.21.15.44:0/332053444 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc6900b4880 0x7fc6900c9310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009d10 tx=0x7fc68c00c490 comp rx=0 tx=0).stop 2023-11-04T01:38:23.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.791+0000 7fc697db0640 1 -- 172.21.15.44:0/332053444 shutdown_connections 2023-11-04T01:38:23.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.791+0000 7fc697db0640 1 --2- 172.21.15.44:0/332053444 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc67406ae70 0x7fc67406d330 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.791+0000 7fc697db0640 1 --2- 172.21.15.44:0/332053444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc690153e60 0x7fc6901f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.791+0000 7fc697db0640 1 --2- 172.21.15.44:0/332053444 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc6900cd6d0 0x7fc6900cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.791+0000 7fc697db0640 1 --2- 172.21.15.44:0/332053444 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc6900b4880 0x7fc6900c9310 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.791+0000 7fc697db0640 1 -- 172.21.15.44:0/332053444 >> 172.21.15.44:0/332053444 conn(0x7fc6900cf880 msgr2=0x7fc69015faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.791+0000 7fc697db0640 1 -- 172.21.15.44:0/332053444 shutdown_connections 2023-11-04T01:38:23.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.791+0000 7fc697db0640 1 -- 172.21.15.44:0/332053444 wait complete. 2023-11-04T01:38:23.805 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:38:23.805 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:38:23.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.913+0000 7f53ba13e640 1 Processor -- start 2023-11-04T01:38:23.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.913+0000 7f53ba13e640 1 -- start start 2023-11-04T01:38:23.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.914+0000 7f53ba13e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53b40b1a40 0x7f53b40ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.914+0000 7f53ba13e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f53b406a830 0x7f53b40cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.914+0000 7f53ba13e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b4160990 con 0x7f53b41605b0 2023-11-04T01:38:23.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.914+0000 7f53ba13e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b40cc7c0 con 0x7f53b406a830 2023-11-04T01:38:23.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.914+0000 7f53ba13e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40cd750 con 0x7f53b40b1a40 2023-11-04T01:38:23.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.914+0000 7f53b2ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53b40b1a40 0x7f53b40ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.914+0000 7f53b3fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f53b406a830 0x7f53b40cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.914+0000 7f53b2ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53b40b1a40 0x7f53b40ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:42248/0 (socket says 172.21.15.44:42248) 2023-11-04T01:38:23.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.914+0000 7f53b2ffd640 1 -- 172.21.15.44:0/3299357120 learned_addr learned my addr 172.21.15.44:0/3299357120 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:23.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.914+0000 7f53b37fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f53b41605b0 0x7f53b406a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:57232/0 (socket says 172.21.15.44:57232) 2023-11-04T01:38:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.914+0000 7f53b2ffd640 1 -- 172.21.15.44:0/3299357120 >> v2:172.21.15.204:3300/0 conn(0x7f53b406a830 msgr2=0x7f53b40cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.914+0000 7f53b2ffd640 1 --2- 172.21.15.44:0/3299357120 >> v2:172.21.15.204:3300/0 conn(0x7f53b406a830 0x7f53b40cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.914+0000 7f53b2ffd640 1 -- 172.21.15.44:0/3299357120 >> v1:172.21.15.204:6789/0 conn(0x7f53b41605b0 legacy=0x7f53b406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.915+0000 7f53b2ffd640 1 -- 172.21.15.44:0/3299357120 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b40cc4e0 con 0x7f53b40b1a40 2023-11-04T01:38:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.915+0000 7f53b3fff640 1 --2- 172.21.15.44:0/3299357120 >> v2:172.21.15.204:3300/0 conn(0x7f53b406a830 0x7f53b40cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.915+0000 7f53b2ffd640 1 --2- 172.21.15.44:0/3299357120 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53b40b1a40 0x7f53b40ccbc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009870 tx=0x7f53a802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e921a3c79a8c2f70 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.915+0000 7f53b27fc640 1 -- 172.21.15.44:0/3299357120 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a80317c0 con 0x7f53b40b1a40 2023-11-04T01:38:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.916+0000 7f53b27fc640 1 -- 172.21.15.44:0/3299357120 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a8031920 con 0x7f53b40b1a40 2023-11-04T01:38:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.916+0000 7f53b27fc640 1 -- 172.21.15.44:0/3299357120 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a8031cb0 con 0x7f53b40b1a40 2023-11-04T01:38:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.916+0000 7f53ba13e640 1 -- 172.21.15.44:0/3299357120 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53b40b1a40 msgr2=0x7f53b40ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.916+0000 7f53ba13e640 1 --2- 172.21.15.44:0/3299357120 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53b40b1a40 0x7f53b40ccbc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009870 tx=0x7f53a802b860 comp rx=0 tx=0).stop 2023-11-04T01:38:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.916+0000 7f53ba13e640 1 -- 172.21.15.44:0/3299357120 shutdown_connections 2023-11-04T01:38:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.916+0000 7f53ba13e640 1 --2- 172.21.15.44:0/3299357120 >> v2:172.21.15.204:3300/0 conn(0x7f53b406a830 0x7f53b40cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.916+0000 7f53ba13e640 1 --2- 172.21.15.44:0/3299357120 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53b40b1a40 0x7f53b40ccbc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.916+0000 7f53ba13e640 1 -- 172.21.15.44:0/3299357120 >> 172.21.15.44:0/3299357120 conn(0x7f53b4071820 msgr2=0x7f53b4071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.916+0000 7f53ba13e640 1 -- 172.21.15.44:0/3299357120 shutdown_connections 2023-11-04T01:38:23.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.916+0000 7f53ba13e640 1 -- 172.21.15.44:0/3299357120 wait complete. 2023-11-04T01:38:23.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.917+0000 7f53ba13e640 1 Processor -- start 2023-11-04T01:38:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.917+0000 7f53ba13e640 1 -- start start 2023-11-04T01:38:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.918+0000 7f53ba13e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53b406a830 0x7f53b4158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.918+0000 7f53ba13e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53b41605b0 0x7f53b40b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.918+0000 7f53ba13e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53b40b2bb0 0x7f53b40b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.918+0000 7f53ba13e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40b3df0 con 0x7f53b40b2bb0 2023-11-04T01:38:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.918+0000 7f53ba13e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b4158db0 con 0x7f53b406a830 2023-11-04T01:38:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.918+0000 7f53ba13e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40b31e0 con 0x7f53b41605b0 2023-11-04T01:38:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.918+0000 7f53b3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53b40b2bb0 0x7f53b40b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.918+0000 7f53b3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53b40b2bb0 0x7f53b40b4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44600/0 (socket says 172.21.15.44:44600) 2023-11-04T01:38:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.918+0000 7f53b3fff640 1 -- 172.21.15.44:0/3493554409 learned_addr learned my addr 172.21.15.44:0/3493554409 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.918+0000 7f53b2ffd640 1 --2- 172.21.15.44:0/3493554409 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53b41605b0 0x7f53b40b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.918+0000 7f53b37fe640 1 --2- 172.21.15.44:0/3493554409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53b406a830 0x7f53b4158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.919+0000 7f53b3fff640 1 -- 172.21.15.44:0/3493554409 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53b41605b0 msgr2=0x7f53b40b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.919+0000 7f53b3fff640 1 --2- 172.21.15.44:0/3493554409 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53b41605b0 0x7f53b40b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.919+0000 7f53b3fff640 1 -- 172.21.15.44:0/3493554409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53b406a830 msgr2=0x7f53b4158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.919+0000 7f53b3fff640 1 --2- 172.21.15.44:0/3493554409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53b406a830 0x7f53b4158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.919+0000 7f53b3fff640 1 -- 172.21.15.44:0/3493554409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac009a70 con 0x7f53b40b2bb0 2023-11-04T01:38:23.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.919+0000 7f53b3fff640 1 --2- 172.21.15.44:0/3493554409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53b40b2bb0 0x7f53b40b4960 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f53ac00efc0 tx=0x7f53ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.919+0000 7f539bfff640 1 -- 172.21.15.44:0/3493554409 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac014480 con 0x7f53b40b2bb0 2023-11-04T01:38:23.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.919+0000 7f539bfff640 1 -- 172.21.15.44:0/3493554409 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac00f040 con 0x7f53b40b2bb0 2023-11-04T01:38:23.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.919+0000 7f53ba13e640 1 -- 172.21.15.44:0/3493554409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a80094d0 con 0x7f53b40b2bb0 2023-11-04T01:38:23.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.919+0000 7f539bfff640 1 -- 172.21.15.44:0/3493554409 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac014840 con 0x7f53b40b2bb0 2023-11-04T01:38:23.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.919+0000 7f53ba13e640 1 -- 172.21.15.44:0/3493554409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b40b37a0 con 0x7f53b40b2bb0 2023-11-04T01:38:23.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.920+0000 7f53ba13e640 1 -- 172.21.15.44:0/3493554409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b40672a0 con 0x7f53b40b2bb0 2023-11-04T01:38:23.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.920+0000 7f539bfff640 1 -- 172.21.15.44:0/3493554409 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53ac0149a0 con 0x7f53b40b2bb0 2023-11-04T01:38:23.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.921+0000 7f539bfff640 1 --2- 172.21.15.44:0/3493554409 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53a006aea0 0x7f53a006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.921+0000 7f539bfff640 1 -- 172.21.15.44:0/3493554409 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f53ac08a6f0 con 0x7f53b40b2bb0 2023-11-04T01:38:23.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.921+0000 7f53b37fe640 1 --2- 172.21.15.44:0/3493554409 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53a006aea0 0x7f53a006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.922+0000 7f53b37fe640 1 --2- 172.21.15.44:0/3493554409 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53a006aea0 0x7f53a006d360 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f53a4000f60 tx=0x7f53a4000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:23.925+0000 7f539bfff640 1 -- 172.21.15.44:0/3493554409 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53ac0555b0 con 0x7f53b40b2bb0 2023-11-04T01:38:24.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.136+0000 7f53ba13e640 1 -- 172.21.15.44:0/3493554409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f53b4074290 con 0x7f53b40b2bb0 2023-11-04T01:38:24.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.799+0000 7f539bfff640 1 -- 172.21.15.44:0/3493554409 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f53ac058bd0 con 0x7f53b40b2bb0 2023-11-04T01:38:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.801+0000 7f53ba13e640 1 -- 172.21.15.44:0/3493554409 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53a006aea0 msgr2=0x7f53a006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.801+0000 7f53ba13e640 1 --2- 172.21.15.44:0/3493554409 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53a006aea0 0x7f53a006d360 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f53a4000f60 tx=0x7f53a4000ed0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.801+0000 7f53ba13e640 1 -- 172.21.15.44:0/3493554409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53b40b2bb0 msgr2=0x7f53b40b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.801+0000 7f53ba13e640 1 --2- 172.21.15.44:0/3493554409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53b40b2bb0 0x7f53b40b4960 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f53ac00efc0 tx=0x7f53ac00c490 comp rx=0 tx=0).stop 2023-11-04T01:38:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.801+0000 7f53ba13e640 1 -- 172.21.15.44:0/3493554409 shutdown_connections 2023-11-04T01:38:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.801+0000 7f53ba13e640 1 --2- 172.21.15.44:0/3493554409 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53a006aea0 0x7f53a006d360 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.801+0000 7f53ba13e640 1 --2- 172.21.15.44:0/3493554409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53b40b2bb0 0x7f53b40b4960 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.801+0000 7f53ba13e640 1 --2- 172.21.15.44:0/3493554409 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53b41605b0 0x7f53b40b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.801+0000 7f53ba13e640 1 --2- 172.21.15.44:0/3493554409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53b406a830 0x7f53b4158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.801+0000 7f53ba13e640 1 -- 172.21.15.44:0/3493554409 >> 172.21.15.44:0/3493554409 conn(0x7f53b4071820 msgr2=0x7f53b40cb880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.802+0000 7f53ba13e640 1 -- 172.21.15.44:0/3493554409 shutdown_connections 2023-11-04T01:38:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.802+0000 7f53ba13e640 1 -- 172.21.15.44:0/3493554409 wait complete. 2023-11-04T01:38:24.817 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:38:24.817 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.928+0000 7f22bbf33640 1 Processor -- start 2023-11-04T01:38:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.928+0000 7f22bbf33640 1 -- start start 2023-11-04T01:38:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.929+0000 7f22bbf33640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f22b406a830 0x7f22b40cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.929+0000 7f22bbf33640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f22b406eba0 0x7f22b40ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.929+0000 7f22bbf33640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b406d310 con 0x7f22b415ab70 2023-11-04T01:38:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.929+0000 7f22bbf33640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b40cba70 con 0x7f22b406a830 2023-11-04T01:38:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.929+0000 7f22bbf33640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b4161c50 con 0x7f22b406eba0 2023-11-04T01:38:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.929+0000 7f22b94ce640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f22b406a830 0x7f22b40cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.929+0000 7f22b94ce640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f22b406a830 0x7f22b40cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44602/0 (socket says 172.21.15.44:44602) 2023-11-04T01:38:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.929+0000 7f22b94ce640 1 -- 172.21.15.44:0/1481307403 learned_addr learned my addr 172.21.15.44:0/1481307403 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.929+0000 7f22b94ce640 1 -- 172.21.15.44:0/1481307403 >> v2:172.21.15.204:3300/0 conn(0x7f22b406eba0 msgr2=0x7f22b40ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.929+0000 7f22b94ce640 1 --2- 172.21.15.44:0/1481307403 >> v2:172.21.15.204:3300/0 conn(0x7f22b406eba0 0x7f22b40ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.929+0000 7f22b94ce640 1 -- 172.21.15.44:0/1481307403 >> v1:172.21.15.204:6789/0 conn(0x7f22b415ab70 legacy=0x7f22b406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:24.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.929+0000 7f22b94ce640 1 -- 172.21.15.44:0/1481307403 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b415d860 con 0x7f22b406a830 2023-11-04T01:38:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.930+0000 7f22b94ce640 1 --2- 172.21.15.44:0/1481307403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b406a830 0x7f22b40cbea0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f22b406ae20 tx=0x7f22b002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2629383a1fe4664 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.930+0000 7f22b8ccd640 1 -- 172.21.15.44:0/1481307403 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b0004230 con 0x7f22b406a830 2023-11-04T01:38:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.930+0000 7f22b8ccd640 1 -- 172.21.15.44:0/1481307403 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b0004390 con 0x7f22b406a830 2023-11-04T01:38:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.930+0000 7f22b8ccd640 1 -- 172.21.15.44:0/1481307403 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b0003810 con 0x7f22b406a830 2023-11-04T01:38:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.931+0000 7f22bbf33640 1 -- 172.21.15.44:0/1481307403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b406a830 msgr2=0x7f22b40cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.931+0000 7f22bbf33640 1 --2- 172.21.15.44:0/1481307403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b406a830 0x7f22b40cbea0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f22b406ae20 tx=0x7f22b002b860 comp rx=0 tx=0).stop 2023-11-04T01:38:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.931+0000 7f22bbf33640 1 -- 172.21.15.44:0/1481307403 shutdown_connections 2023-11-04T01:38:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.931+0000 7f22bbf33640 1 --2- 172.21.15.44:0/1481307403 >> v2:172.21.15.204:3300/0 conn(0x7f22b406eba0 0x7f22b40ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.931+0000 7f22bbf33640 1 --2- 172.21.15.44:0/1481307403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b406a830 0x7f22b40cbea0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.931+0000 7f22bbf33640 1 -- 172.21.15.44:0/1481307403 >> 172.21.15.44:0/1481307403 conn(0x7f22b4098d40 msgr2=0x7f22b40cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:24.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.931+0000 7f22bbf33640 1 -- 172.21.15.44:0/1481307403 shutdown_connections 2023-11-04T01:38:24.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.931+0000 7f22bbf33640 1 -- 172.21.15.44:0/1481307403 wait complete. 2023-11-04T01:38:24.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.932+0000 7f22bbf33640 1 Processor -- start 2023-11-04T01:38:24.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.932+0000 7f22bbf33640 1 -- start start 2023-11-04T01:38:24.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22bbf33640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22b406a830 0x7f22b415c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22bbf33640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22b406eba0 0x7f22b406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22bbf33640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b415ab70 0x7f22b406da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22bbf33640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b409a0f0 con 0x7f22b415ab70 2023-11-04T01:38:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22bbf33640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b41588d0 con 0x7f22b406eba0 2023-11-04T01:38:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22bbf33640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b409b8b0 con 0x7f22b406a830 2023-11-04T01:38:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22ba4d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b415ab70 0x7f22b406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22ba4d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b415ab70 0x7f22b406da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44610/0 (socket says 172.21.15.44:44610) 2023-11-04T01:38:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22ba4d0640 1 -- 172.21.15.44:0/1211487638 learned_addr learned my addr 172.21.15.44:0/1211487638 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22b94ce640 1 --2- 172.21.15.44:0/1211487638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22b406eba0 0x7f22b406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22b9ccf640 1 --2- 172.21.15.44:0/1211487638 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22b406a830 0x7f22b415c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22ba4d0640 1 -- 172.21.15.44:0/1211487638 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22b406a830 msgr2=0x7f22b415c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22ba4d0640 1 --2- 172.21.15.44:0/1211487638 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22b406a830 0x7f22b415c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22ba4d0640 1 -- 172.21.15.44:0/1211487638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22b406eba0 msgr2=0x7f22b406d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22ba4d0640 1 --2- 172.21.15.44:0/1211487638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22b406eba0 0x7f22b406d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.933+0000 7f22ba4d0640 1 -- 172.21.15.44:0/1211487638 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b0009460 con 0x7f22b415ab70 2023-11-04T01:38:24.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.934+0000 7f22ba4d0640 1 --2- 172.21.15.44:0/1211487638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b415ab70 0x7f22b406da20 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00b9a0 tx=0x7f22ac00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.934+0000 7f22aa7fc640 1 -- 172.21.15.44:0/1211487638 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00cba0 con 0x7f22b415ab70 2023-11-04T01:38:24.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.934+0000 7f22aa7fc640 1 -- 172.21.15.44:0/1211487638 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac00cd20 con 0x7f22b415ab70 2023-11-04T01:38:24.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.934+0000 7f22aa7fc640 1 -- 172.21.15.44:0/1211487638 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac014680 con 0x7f22b415ab70 2023-11-04T01:38:24.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.934+0000 7f22bbf33640 1 -- 172.21.15.44:0/1211487638 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b4099850 con 0x7f22b415ab70 2023-11-04T01:38:24.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.934+0000 7f22bbf33640 1 -- 172.21.15.44:0/1211487638 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b4099e10 con 0x7f22b415ab70 2023-11-04T01:38:24.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.935+0000 7f22bbf33640 1 -- 172.21.15.44:0/1211487638 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b409ba20 con 0x7f22b415ab70 2023-11-04T01:38:24.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.935+0000 7f22aa7fc640 1 -- 172.21.15.44:0/1211487638 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f22ac01d3b0 con 0x7f22b415ab70 2023-11-04T01:38:24.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.936+0000 7f22aa7fc640 1 --2- 172.21.15.44:0/1211487638 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f229806aea0 0x7f229806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.936+0000 7f22aa7fc640 1 -- 172.21.15.44:0/1211487638 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f22ac0898a0 con 0x7f22b415ab70 2023-11-04T01:38:24.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.936+0000 7f22b9ccf640 1 --2- 172.21.15.44:0/1211487638 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f229806aea0 0x7f229806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.937+0000 7f22b9ccf640 1 --2- 172.21.15.44:0/1211487638 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f229806aea0 0x7f229806d360 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f22a4007fd0 tx=0x7f22a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:24.940+0000 7f22aa7fc640 1 -- 172.21.15.44:0/1211487638 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f22ac054610 con 0x7f22b415ab70 2023-11-04T01:38:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.151+0000 7f22bbf33640 1 -- 172.21.15.44:0/1211487638 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22b415db10 con 0x7f22b415ab70 2023-11-04T01:38:25.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.152+0000 7f22aa7fc640 1 -- 172.21.15.44:0/1211487638 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f22ac019090 con 0x7f22b415ab70 2023-11-04T01:38:25.154 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:25.154 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5543,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/1112718006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1112718006},{"type":"v1","addr":"172.21.15.204:6837","nonce":1112718006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5935,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/719128216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":719128216},{"type":"v1","addr":"172.21.15.204:6836","nonce":719128216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3272698261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3272698261},{"type":"v1","addr":"172.21.15.44:6833","nonce":3272698261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:22.129730+0000","modified":"2023-11-04T01:38:24.137808+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/2413284016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2413284016},{"type":"v1","addr":"172.21.15.44:6835","nonce":2413284016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:38:25.155 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 31 2023-11-04T01:38:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.154+0000 7f22bbf33640 1 -- 172.21.15.44:0/1211487638 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f229806aea0 msgr2=0x7f229806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.154+0000 7f22bbf33640 1 --2- 172.21.15.44:0/1211487638 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f229806aea0 0x7f229806d360 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f22a4007fd0 tx=0x7f22a4009040 comp rx=0 tx=0).stop 2023-11-04T01:38:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.154+0000 7f22bbf33640 1 -- 172.21.15.44:0/1211487638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b415ab70 msgr2=0x7f22b406da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.154+0000 7f22bbf33640 1 --2- 172.21.15.44:0/1211487638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b415ab70 0x7f22b406da20 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00b9a0 tx=0x7f22ac00be60 comp rx=0 tx=0).stop 2023-11-04T01:38:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.154+0000 7f22bbf33640 1 -- 172.21.15.44:0/1211487638 shutdown_connections 2023-11-04T01:38:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.154+0000 7f22bbf33640 1 --2- 172.21.15.44:0/1211487638 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f229806aea0 0x7f229806d360 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.154+0000 7f22bbf33640 1 --2- 172.21.15.44:0/1211487638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b415ab70 0x7f22b406da20 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.154+0000 7f22bbf33640 1 --2- 172.21.15.44:0/1211487638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22b406eba0 0x7f22b406d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.154+0000 7f22bbf33640 1 --2- 172.21.15.44:0/1211487638 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22b406a830 0x7f22b415c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.154+0000 7f22bbf33640 1 -- 172.21.15.44:0/1211487638 >> 172.21.15.44:0/1211487638 conn(0x7f22b4098d40 msgr2=0x7f22b415a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.154+0000 7f22bbf33640 1 -- 172.21.15.44:0/1211487638 shutdown_connections 2023-11-04T01:38:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.154+0000 7f22bbf33640 1 -- 172.21.15.44:0/1211487638 wait complete. 2023-11-04T01:38:25.167 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:25.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.271+0000 7fad75a07640 1 Processor -- start 2023-11-04T01:38:25.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.272+0000 7fad75a07640 1 -- start start 2023-11-04T01:38:25.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.272+0000 7fad75a07640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fad7015cd20 0x7fad701613b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.272+0000 7fad75a07640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7006cae0 0x7fad700b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.272+0000 7fad75a07640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7006c650 con 0x7fad7006cf40 2023-11-04T01:38:25.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.272+0000 7fad75a07640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7006b830 con 0x7fad7015cd20 2023-11-04T01:38:25.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.272+0000 7fad75a07640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad701618f0 con 0x7fad7006cae0 2023-11-04T01:38:25.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.272+0000 7fad6effd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fad7015cd20 0x7fad701613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.272+0000 7fad6f7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fad7006cf40 0x7fad700cb490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50412/0 (socket says 172.21.15.44:50412) 2023-11-04T01:38:25.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.272+0000 7fad6effd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fad7015cd20 0x7fad701613b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44624/0 (socket says 172.21.15.44:44624) 2023-11-04T01:38:25.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.273+0000 7fad6f7fe640 1 -- 172.21.15.44:0/88490513 learned_addr learned my addr 172.21.15.44:0/88490513 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:25.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.273+0000 7fad6e7fc640 1 --2- 172.21.15.44:0/88490513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7006cae0 0x7fad700b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.273+0000 7fad6effd640 1 -- 172.21.15.44:0/88490513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7006cae0 msgr2=0x7fad700b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:25.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.273+0000 7fad6effd640 1 --2- 172.21.15.44:0/88490513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7006cae0 0x7fad700b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.273+0000 7fad6effd640 1 -- 172.21.15.44:0/88490513 >> v1:172.21.15.44:6789/0 conn(0x7fad7006cf40 legacy=0x7fad700cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.273+0000 7fad6dffb640 1 -- 172.21.15.44:0/88490513 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105390326 0 0) 0x7fad7006c650 con 0x7fad7006cf40 2023-11-04T01:38:25.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.273+0000 7fad6effd640 1 -- 172.21.15.44:0/88490513 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7006ba40 con 0x7fad7015cd20 2023-11-04T01:38:25.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.273+0000 7fad6e7fc640 1 --2- 172.21.15.44:0/88490513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7006cae0 0x7fad700b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:25.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.274+0000 7fad6effd640 1 --2- 172.21.15.44:0/88490513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7015cd20 0x7fad701613b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fad68009790 tx=0x7fad6802b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d680a6e7d86871 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.274+0000 7fad6dffb640 1 -- 172.21.15.44:0/88490513 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68031800 con 0x7fad7015cd20 2023-11-04T01:38:25.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.274+0000 7fad6dffb640 1 -- 172.21.15.44:0/88490513 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad68031960 con 0x7fad7015cd20 2023-11-04T01:38:25.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.274+0000 7fad6dffb640 1 -- 172.21.15.44:0/88490513 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68031cf0 con 0x7fad7015cd20 2023-11-04T01:38:25.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.274+0000 7fad75a07640 1 -- 172.21.15.44:0/88490513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7015cd20 msgr2=0x7fad701613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.274+0000 7fad75a07640 1 --2- 172.21.15.44:0/88490513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7015cd20 0x7fad701613b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fad68009790 tx=0x7fad6802b8a0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.274+0000 7fad75a07640 1 -- 172.21.15.44:0/88490513 shutdown_connections 2023-11-04T01:38:25.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.274+0000 7fad75a07640 1 --2- 172.21.15.44:0/88490513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7006cae0 0x7fad700b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.274+0000 7fad75a07640 1 --2- 172.21.15.44:0/88490513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7015cd20 0x7fad701613b0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.274+0000 7fad75a07640 1 -- 172.21.15.44:0/88490513 >> 172.21.15.44:0/88490513 conn(0x7fad700cd600 msgr2=0x7fad700cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:25.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.274+0000 7fad75a07640 1 -- 172.21.15.44:0/88490513 shutdown_connections 2023-11-04T01:38:25.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.274+0000 7fad75a07640 1 -- 172.21.15.44:0/88490513 wait complete. 2023-11-04T01:38:25.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.275+0000 7fad75a07640 1 Processor -- start 2023-11-04T01:38:25.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.276+0000 7fad75a07640 1 -- start start 2023-11-04T01:38:25.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.276+0000 7fad75a07640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad7006cae0 0x7fad7015f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.276+0000 7fad75a07640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7006cf40 0x7fad701f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.276+0000 7fad75a07640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7015cd20 0x7fad701f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.276+0000 7fad75a07640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad700b5d10 con 0x7fad7006cf40 2023-11-04T01:38:25.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.276+0000 7fad75a07640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad700ca5c0 con 0x7fad7006cae0 2023-11-04T01:38:25.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.276+0000 7fad75a07640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad700c7df0 con 0x7fad7015cd20 2023-11-04T01:38:25.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.276+0000 7fad6e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7006cf40 0x7fad701f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.276+0000 7fad6e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7006cf40 0x7fad701f3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44632/0 (socket says 172.21.15.44:44632) 2023-11-04T01:38:25.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.276+0000 7fad6e7fc640 1 -- 172.21.15.44:0/113681010 learned_addr learned my addr 172.21.15.44:0/113681010 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:25.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.277+0000 7fad6f7fe640 1 --2- 172.21.15.44:0/113681010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7015cd20 0x7fad701f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.277+0000 7fad6effd640 1 --2- 172.21.15.44:0/113681010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad7006cae0 0x7fad7015f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.277+0000 7fad6e7fc640 1 -- 172.21.15.44:0/113681010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7015cd20 msgr2=0x7fad701f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.277+0000 7fad6e7fc640 1 --2- 172.21.15.44:0/113681010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7015cd20 0x7fad701f6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.277+0000 7fad6e7fc640 1 -- 172.21.15.44:0/113681010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad7006cae0 msgr2=0x7fad7015f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.277+0000 7fad6e7fc640 1 --2- 172.21.15.44:0/113681010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad7006cae0 0x7fad7015f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.277+0000 7fad6e7fc640 1 -- 172.21.15.44:0/113681010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad680093a0 con 0x7fad7006cf40 2023-11-04T01:38:25.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.277+0000 7fad6e7fc640 1 --2- 172.21.15.44:0/113681010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7006cf40 0x7fad701f3c60 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fad5800e730 tx=0x7fad5800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.277+0000 7fad67fff640 1 -- 172.21.15.44:0/113681010 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58004230 con 0x7fad7006cf40 2023-11-04T01:38:25.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.277+0000 7fad67fff640 1 -- 172.21.15.44:0/113681010 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad58004390 con 0x7fad7006cf40 2023-11-04T01:38:25.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.277+0000 7fad67fff640 1 -- 172.21.15.44:0/113681010 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5800c8f0 con 0x7fad7006cf40 2023-11-04T01:38:25.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.277+0000 7fad75a07640 1 -- 172.21.15.44:0/113681010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad700c80d0 con 0x7fad7006cf40 2023-11-04T01:38:25.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.277+0000 7fad75a07640 1 -- 172.21.15.44:0/113681010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad700c8690 con 0x7fad7006cf40 2023-11-04T01:38:25.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.278+0000 7fad75a07640 1 -- 172.21.15.44:0/113681010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7006d3c0 con 0x7fad7006cf40 2023-11-04T01:38:25.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.279+0000 7fad67fff640 1 -- 172.21.15.44:0/113681010 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad5800ca50 con 0x7fad7006cf40 2023-11-04T01:38:25.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.279+0000 7fad67fff640 1 --2- 172.21.15.44:0/113681010 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fad5006ae70 0x7fad5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.279+0000 7fad67fff640 1 -- 172.21.15.44:0/113681010 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fad58089400 con 0x7fad7006cf40 2023-11-04T01:38:25.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.279+0000 7fad6effd640 1 --2- 172.21.15.44:0/113681010 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fad5006ae70 0x7fad5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.280+0000 7fad6effd640 1 --2- 172.21.15.44:0/113681010 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fad5006ae70 0x7fad5006d330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fad68036000 tx=0x7fad6803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.283+0000 7fad67fff640 1 -- 172.21.15.44:0/113681010 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad580542c0 con 0x7fad7006cf40 2023-11-04T01:38:25.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.460+0000 7fad75a07640 1 -- 172.21.15.44:0/113681010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad700b6b00 con 0x7fad7006cf40 2023-11-04T01:38:25.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.461+0000 7fad67fff640 1 -- 172.21.15.44:0/113681010 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+18526 (secure 0 0 0) 0x7fad580578e0 con 0x7fad7006cf40 2023-11-04T01:38:25.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:25.463 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":67,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:38:23.773822+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:20.738739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:21.109334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:25.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.463+0000 7fad75a07640 1 -- 172.21.15.44:0/113681010 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fad5006ae70 msgr2=0x7fad5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.463+0000 7fad75a07640 1 --2- 172.21.15.44:0/113681010 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fad5006ae70 0x7fad5006d330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fad68036000 tx=0x7fad6803c040 comp rx=0 tx=0).stop 2023-11-04T01:38:25.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.463+0000 7fad75a07640 1 -- 172.21.15.44:0/113681010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7006cf40 msgr2=0x7fad701f3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.463+0000 7fad75a07640 1 --2- 172.21.15.44:0/113681010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7006cf40 0x7fad701f3c60 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fad5800e730 tx=0x7fad5800ebf0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.463+0000 7fad75a07640 1 -- 172.21.15.44:0/113681010 shutdown_connections 2023-11-04T01:38:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.463+0000 7fad75a07640 1 --2- 172.21.15.44:0/113681010 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fad5006ae70 0x7fad5006d330 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.463+0000 7fad75a07640 1 --2- 172.21.15.44:0/113681010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7015cd20 0x7fad701f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.463+0000 7fad75a07640 1 --2- 172.21.15.44:0/113681010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7006cf40 0x7fad701f3c60 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.463+0000 7fad75a07640 1 --2- 172.21.15.44:0/113681010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad7006cae0 0x7fad7015f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.463+0000 7fad75a07640 1 -- 172.21.15.44:0/113681010 >> 172.21.15.44:0/113681010 conn(0x7fad700cd600 msgr2=0x7fad700b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.463+0000 7fad75a07640 1 -- 172.21.15.44:0/113681010 shutdown_connections 2023-11-04T01:38:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.463+0000 7fad75a07640 1 -- 172.21.15.44:0/113681010 wait complete. 2023-11-04T01:38:25.476 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:38:25.476 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:25.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.580+0000 7f6d259ee640 1 Processor -- start 2023-11-04T01:38:25.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.580+0000 7f6d259ee640 1 -- start start 2023-11-04T01:38:25.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.581+0000 7f6d259ee640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6d200cde60 0x7f6d2015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.581+0000 7f6d259ee640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d2015daa0 0x7f6d20157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.581+0000 7f6d259ee640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2015e000 con 0x7f6d200ce240 2023-11-04T01:38:25.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.581+0000 7f6d259ee640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2015e5c0 con 0x7f6d200cde60 2023-11-04T01:38:25.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.581+0000 7f6d259ee640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2015e2e0 con 0x7f6d2015daa0 2023-11-04T01:38:25.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.581+0000 7f6d1effd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6d200cde60 0x7f6d2015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.581+0000 7f6d1f7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6d200ce240 0x7f6d2006b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50424/0 (socket says 172.21.15.44:50424) 2023-11-04T01:38:25.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.581+0000 7f6d1f7fe640 1 -- 172.21.15.44:0/1912175798 learned_addr learned my addr 172.21.15.44:0/1912175798 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:25.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.581+0000 7f6d17fff640 1 --2- 172.21.15.44:0/1912175798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d2015daa0 0x7f6d20157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.581+0000 7f6d1effd640 1 -- 172.21.15.44:0/1912175798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d2015daa0 msgr2=0x7f6d20157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:25.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.581+0000 7f6d1effd640 1 --2- 172.21.15.44:0/1912175798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d2015daa0 0x7f6d20157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.581+0000 7f6d1effd640 1 -- 172.21.15.44:0/1912175798 >> v1:172.21.15.44:6789/0 conn(0x7f6d200ce240 legacy=0x7f6d2006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.581+0000 7f6d1effd640 1 -- 172.21.15.44:0/1912175798 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d200d1120 con 0x7f6d200cde60 2023-11-04T01:38:25.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.581+0000 7f6d1e7fc640 1 -- 172.21.15.44:0/1912175798 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031158647 0 0) 0x7f6d2015e000 con 0x7f6d200ce240 2023-11-04T01:38:25.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.582+0000 7f6d1effd640 1 --2- 172.21.15.44:0/1912175798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d200cde60 0x7f6d2015d560 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6d100097a0 tx=0x7f6d1002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d426491eeb269d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.582+0000 7f6d1e7fc640 1 -- 172.21.15.44:0/1912175798 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10031830 con 0x7f6d200cde60 2023-11-04T01:38:25.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.582+0000 7f6d1e7fc640 1 -- 172.21.15.44:0/1912175798 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d10031990 con 0x7f6d200cde60 2023-11-04T01:38:25.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.582+0000 7f6d1e7fc640 1 -- 172.21.15.44:0/1912175798 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10031d20 con 0x7f6d200cde60 2023-11-04T01:38:25.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.583+0000 7f6d259ee640 1 -- 172.21.15.44:0/1912175798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d200cde60 msgr2=0x7f6d2015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.583+0000 7f6d259ee640 1 --2- 172.21.15.44:0/1912175798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d200cde60 0x7f6d2015d560 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6d100097a0 tx=0x7f6d1002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.583+0000 7f6d259ee640 1 -- 172.21.15.44:0/1912175798 shutdown_connections 2023-11-04T01:38:25.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.583+0000 7f6d259ee640 1 --2- 172.21.15.44:0/1912175798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d2015daa0 0x7f6d20157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.583+0000 7f6d259ee640 1 --2- 172.21.15.44:0/1912175798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d200cde60 0x7f6d2015d560 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.583+0000 7f6d259ee640 1 -- 172.21.15.44:0/1912175798 >> 172.21.15.44:0/1912175798 conn(0x7f6d20071f30 msgr2=0x7f6d200cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:25.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.583+0000 7f6d259ee640 1 -- 172.21.15.44:0/1912175798 shutdown_connections 2023-11-04T01:38:25.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.583+0000 7f6d259ee640 1 -- 172.21.15.44:0/1912175798 wait complete. 2023-11-04T01:38:25.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.584+0000 7f6d259ee640 1 Processor -- start 2023-11-04T01:38:25.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.584+0000 7f6d259ee640 1 -- start start 2023-11-04T01:38:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d259ee640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d200cde60 0x7f6d20149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d259ee640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6d200ce240 0x7f6d201f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d259ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d2015daa0 0x7f6d2015ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d259ee640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d20147490 con 0x7f6d2015daa0 2023-11-04T01:38:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d259ee640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d201f5da0 con 0x7f6d200ce240 2023-11-04T01:38:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d259ee640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d20148b60 con 0x7f6d200cde60 2023-11-04T01:38:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d1f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d2015daa0 0x7f6d2015ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d1f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d2015daa0 0x7f6d2015ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44654/0 (socket says 172.21.15.44:44654) 2023-11-04T01:38:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d1f7fe640 1 -- 172.21.15.44:0/302552261 learned_addr learned my addr 172.21.15.44:0/302552261 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d1effd640 1 --2- 172.21.15.44:0/302552261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d200cde60 0x7f6d20149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d1f7fe640 1 -- 172.21.15.44:0/302552261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d200cde60 msgr2=0x7f6d20149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d1f7fe640 1 --2- 172.21.15.44:0/302552261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d200cde60 0x7f6d20149390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d1f7fe640 1 -- 172.21.15.44:0/302552261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6d200ce240 msgr2=0x7f6d201f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d1f7fe640 1 --2- 172.21.15.44:0/302552261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6d200ce240 0x7f6d201f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d1f7fe640 1 -- 172.21.15.44:0/302552261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d10009400 con 0x7f6d2015daa0 2023-11-04T01:38:25.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.585+0000 7f6d1f7fe640 1 --2- 172.21.15.44:0/302552261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d2015daa0 0x7f6d2015ca10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800c7e0 tx=0x7f6d1800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.586+0000 7f6d1cff9640 1 -- 172.21.15.44:0/302552261 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1800a640 con 0x7f6d2015daa0 2023-11-04T01:38:25.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.586+0000 7f6d1cff9640 1 -- 172.21.15.44:0/302552261 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1800a7c0 con 0x7f6d2015daa0 2023-11-04T01:38:25.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.586+0000 7f6d259ee640 1 -- 172.21.15.44:0/302552261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d201499d0 con 0x7f6d2015daa0 2023-11-04T01:38:25.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.586+0000 7f6d1cff9640 1 -- 172.21.15.44:0/302552261 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1800ab70 con 0x7f6d2015daa0 2023-11-04T01:38:25.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.586+0000 7f6d259ee640 1 -- 172.21.15.44:0/302552261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d20149f90 con 0x7f6d2015daa0 2023-11-04T01:38:25.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.587+0000 7f6d259ee640 1 -- 172.21.15.44:0/302552261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d201475d0 con 0x7f6d2015daa0 2023-11-04T01:38:25.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.587+0000 7f6d1cff9640 1 -- 172.21.15.44:0/302552261 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d1800acd0 con 0x7f6d2015daa0 2023-11-04T01:38:25.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.587+0000 7f6d1cff9640 1 --2- 172.21.15.44:0/302552261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6d0006ae70 0x7f6d0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.588+0000 7f6d1cff9640 1 -- 172.21.15.44:0/302552261 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6d18088e90 con 0x7f6d2015daa0 2023-11-04T01:38:25.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.588+0000 7f6d1effd640 1 --2- 172.21.15.44:0/302552261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6d0006ae70 0x7f6d0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.588+0000 7f6d1effd640 1 --2- 172.21.15.44:0/302552261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6d0006ae70 0x7f6d0006d330 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6d10036000 tx=0x7f6d10008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.592+0000 7f6d1cff9640 1 -- 172.21.15.44:0/302552261 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6d18053ca0 con 0x7f6d2015daa0 2023-11-04T01:38:25.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.763+0000 7f6d259ee640 1 -- 172.21.15.44:0/302552261 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d200d1400 con 0x7f6d0006ae70 2023-11-04T01:38:25.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.772+0000 7f6d1cff9640 1 -- 172.21.15.44:0/302552261 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358817 (secure 0 0 0) 0x7f6d10045400 con 0x7f6d0006ae70 2023-11-04T01:38:25.780 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:25.783 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:38:25.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.776+0000 7f6d259ee640 1 -- 172.21.15.44:0/302552261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6d0006ae70 msgr2=0x7f6d0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.776+0000 7f6d259ee640 1 --2- 172.21.15.44:0/302552261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6d0006ae70 0x7f6d0006d330 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6d10036000 tx=0x7f6d10008030 comp rx=0 tx=0).stop 2023-11-04T01:38:25.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.776+0000 7f6d259ee640 1 -- 172.21.15.44:0/302552261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d2015daa0 msgr2=0x7f6d2015ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.776+0000 7f6d259ee640 1 --2- 172.21.15.44:0/302552261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d2015daa0 0x7f6d2015ca10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800c7e0 tx=0x7f6d1800cca0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.776+0000 7f6d259ee640 1 -- 172.21.15.44:0/302552261 shutdown_connections 2023-11-04T01:38:25.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.776+0000 7f6d259ee640 1 --2- 172.21.15.44:0/302552261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6d0006ae70 0x7f6d0006d330 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.776+0000 7f6d259ee640 1 --2- 172.21.15.44:0/302552261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d2015daa0 0x7f6d2015ca10 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.776+0000 7f6d259ee640 1 --2- 172.21.15.44:0/302552261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6d200ce240 0x7f6d201f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.776+0000 7f6d259ee640 1 --2- 172.21.15.44:0/302552261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d200cde60 0x7f6d20149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.776+0000 7f6d259ee640 1 -- 172.21.15.44:0/302552261 >> 172.21.15.44:0/302552261 conn(0x7f6d20071f30 msgr2=0x7f6d20156530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:25.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.776+0000 7f6d259ee640 1 -- 172.21.15.44:0/302552261 shutdown_connections 2023-11-04T01:38:25.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.776+0000 7f6d259ee640 1 -- 172.21.15.44:0/302552261 wait complete. 2023-11-04T01:38:25.789 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2023-11-04T01:38:24.610033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223352,"kb_used_data":7192,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751368,"statfs":{"total":773094113280,"available":772865400832,"internally_reserved":0,"allocated":7364608,"data_stored":4020651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001098"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763050+0000","last_change":"2023-11-04T01:38:20.763050+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763050+0000","last_undegraded":"2023-11-04T01:38:20.763050+0000","last_fullsized":"2023-11-04T01:38:20.763050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.030266+0000","last_change":"2023-11-04T01:37:36.221026+0000","last_active":"2023-11-04T01:38:19.030266+0000","last_peered":"2023-11-04T01:38:19.030266+0000","last_clean":"2023-11-04T01:38:19.030266+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:38:19.030266+0000","last_undegraded":"2023-11-04T01:38:19.030266+0000","last_fullsized":"2023-11-04T01:38:19.030266+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067716399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766464+0000","last_change":"2023-11-04T01:38:20.766464+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766464+0000","last_undegraded":"2023-11-04T01:38:20.766464+0000","last_fullsized":"2023-11-04T01:38:20.766464+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.531905+0000","last_change":"2023-11-04T01:37:36.229027+0000","last_active":"2023-11-04T01:38:19.531905+0000","last_peered":"2023-11-04T01:38:19.531905+0000","last_clean":"2023-11-04T01:38:19.531905+0000","last_became_active":"2023-11-04T01:37:35.218342+0000","last_became_peered":"2023-11-04T01:37:35.218342+0000","last_unstale":"2023-11-04T01:38:19.531905+0000","last_undegraded":"2023-11-04T01:38:19.531905+0000","last_fullsized":"2023-11-04T01:38:19.531905+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059666400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.768640+0000","last_change":"2023-11-04T01:38:20.768640+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.768640+0000","last_undegraded":"2023-11-04T01:38:20.768640+0000","last_fullsized":"2023-11-04T01:38:20.768640+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775579+0000","last_change":"2023-11-04T01:37:36.222868+0000","last_active":"2023-11-04T01:38:18.775579+0000","last_peered":"2023-11-04T01:38:18.775579+0000","last_clean":"2023-11-04T01:38:18.775579+0000","last_became_active":"2023-11-04T01:37:35.220180+0000","last_became_peered":"2023-11-04T01:37:35.220180+0000","last_unstale":"2023-11-04T01:38:18.775579+0000","last_undegraded":"2023-11-04T01:38:18.775579+0000","last_fullsized":"2023-11-04T01:38:18.775579+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001103574,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.769634+0000","last_change":"2023-11-04T01:38:20.769634+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.769634+0000","last_undegraded":"2023-11-04T01:38:20.769634+0000","last_fullsized":"2023-11-04T01:38:20.769634+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.030071+0000","last_change":"2023-11-04T01:37:36.221053+0000","last_active":"2023-11-04T01:38:19.030071+0000","last_peered":"2023-11-04T01:38:19.030071+0000","last_clean":"2023-11-04T01:38:19.030071+0000","last_became_active":"2023-11-04T01:37:35.227176+0000","last_became_peered":"2023-11-04T01:37:35.227176+0000","last_unstale":"2023-11-04T01:38:19.030071+0000","last_undegraded":"2023-11-04T01:38:19.030071+0000","last_fullsized":"2023-11-04T01:38:19.030071+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000594178,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.769645+0000","last_change":"2023-11-04T01:38:20.769645+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.769645+0000","last_undegraded":"2023-11-04T01:38:20.769645+0000","last_fullsized":"2023-11-04T01:38:20.769645+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775522+0000","last_change":"2023-11-04T01:37:36.221842+0000","last_active":"2023-11-04T01:38:18.775522+0000","last_peered":"2023-11-04T01:38:18.775522+0000","last_clean":"2023-11-04T01:38:18.775522+0000","last_became_active":"2023-11-04T01:37:35.214305+0000","last_became_peered":"2023-11-04T01:37:35.214305+0000","last_unstale":"2023-11-04T01:38:18.775522+0000","last_undegraded":"2023-11-04T01:38:18.775522+0000","last_fullsized":"2023-11-04T01:38:18.775522+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:13:05.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014999690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765665+0000","last_change":"2023-11-04T01:38:20.765665+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765665+0000","last_undegraded":"2023-11-04T01:38:20.765665+0000","last_fullsized":"2023-11-04T01:38:20.765665+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128398+0000","last_change":"2023-11-04T01:37:36.694601+0000","last_active":"2023-11-04T01:38:19.128398+0000","last_peered":"2023-11-04T01:38:19.128398+0000","last_clean":"2023-11-04T01:38:19.128398+0000","last_became_active":"2023-11-04T01:37:35.223746+0000","last_became_peered":"2023-11-04T01:37:35.223746+0000","last_unstale":"2023-11-04T01:38:19.128398+0000","last_undegraded":"2023-11-04T01:38:19.128398+0000","last_fullsized":"2023-11-04T01:38:19.128398+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:35.960485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000555376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765236+0000","last_change":"2023-11-04T01:38:20.765236+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765236+0000","last_undegraded":"2023-11-04T01:38:20.765236+0000","last_fullsized":"2023-11-04T01:38:20.765236+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128424+0000","last_change":"2023-11-04T01:37:36.695075+0000","last_active":"2023-11-04T01:38:19.128424+0000","last_peered":"2023-11-04T01:38:19.128424+0000","last_clean":"2023-11-04T01:38:19.128424+0000","last_became_active":"2023-11-04T01:37:35.221165+0000","last_became_peered":"2023-11-04T01:37:35.221165+0000","last_unstale":"2023-11-04T01:38:19.128424+0000","last_undegraded":"2023-11-04T01:38:19.128424+0000","last_fullsized":"2023-11-04T01:38:19.128424+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:17.958372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072817499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763050+0000","last_change":"2023-11-04T01:38:20.763050+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763050+0000","last_undegraded":"2023-11-04T01:38:20.763050+0000","last_fullsized":"2023-11-04T01:38:20.763050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.541444+0000","last_change":"2023-11-04T01:37:36.221747+0000","last_active":"2023-11-04T01:38:19.541444+0000","last_peered":"2023-11-04T01:38:19.541444+0000","last_clean":"2023-11-04T01:38:19.541444+0000","last_became_active":"2023-11-04T01:37:35.223198+0000","last_became_peered":"2023-11-04T01:37:35.223198+0000","last_unstale":"2023-11-04T01:38:19.541444+0000","last_undegraded":"2023-11-04T01:38:19.541444+0000","last_fullsized":"2023-11-04T01:38:19.541444+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097726499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763287+0000","last_change":"2023-11-04T01:38:20.763287+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763287+0000","last_undegraded":"2023-11-04T01:38:20.763287+0000","last_fullsized":"2023-11-04T01:38:20.763287+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778403+0000","last_change":"2023-11-04T01:37:36.422496+0000","last_active":"2023-11-04T01:38:18.778403+0000","last_peered":"2023-11-04T01:38:18.778403+0000","last_clean":"2023-11-04T01:38:18.778403+0000","last_became_active":"2023-11-04T01:37:35.221763+0000","last_became_peered":"2023-11-04T01:37:35.221763+0000","last_unstale":"2023-11-04T01:38:18.778403+0000","last_undegraded":"2023-11-04T01:38:18.778403+0000","last_fullsized":"2023-11-04T01:38:18.778403+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073676299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.769684+0000","last_change":"2023-11-04T01:38:20.769684+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.769684+0000","last_undegraded":"2023-11-04T01:38:20.769684+0000","last_fullsized":"2023-11-04T01:38:20.769684+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778348+0000","last_change":"2023-11-04T01:37:36.229940+0000","last_active":"2023-11-04T01:38:18.778348+0000","last_peered":"2023-11-04T01:38:18.778348+0000","last_clean":"2023-11-04T01:38:18.778348+0000","last_became_active":"2023-11-04T01:37:35.225121+0000","last_became_peered":"2023-11-04T01:37:35.225121+0000","last_unstale":"2023-11-04T01:38:18.778348+0000","last_undegraded":"2023-11-04T01:38:18.778348+0000","last_fullsized":"2023-11-04T01:38:18.778348+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:12.130671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075648399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765202+0000","last_change":"2023-11-04T01:38:20.765202+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765202+0000","last_undegraded":"2023-11-04T01:38:20.765202+0000","last_fullsized":"2023-11-04T01:38:20.765202+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778310+0000","last_change":"2023-11-04T01:37:36.422801+0000","last_active":"2023-11-04T01:38:18.778310+0000","last_peered":"2023-11-04T01:38:18.778310+0000","last_clean":"2023-11-04T01:38:18.778310+0000","last_became_active":"2023-11-04T01:37:35.217091+0000","last_became_peered":"2023-11-04T01:37:35.217091+0000","last_unstale":"2023-11-04T01:38:18.778310+0000","last_undegraded":"2023-11-04T01:38:18.778310+0000","last_fullsized":"2023-11-04T01:38:18.778310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082211999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765653+0000","last_change":"2023-11-04T01:38:20.765653+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765653+0000","last_undegraded":"2023-11-04T01:38:20.765653+0000","last_fullsized":"2023-11-04T01:38:20.765653+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.541441+0000","last_change":"2023-11-04T01:37:36.222683+0000","last_active":"2023-11-04T01:38:19.541441+0000","last_peered":"2023-11-04T01:38:19.541441+0000","last_clean":"2023-11-04T01:38:19.541441+0000","last_became_active":"2023-11-04T01:37:35.222694+0000","last_became_peered":"2023-11-04T01:37:35.222694+0000","last_unstale":"2023-11-04T01:38:19.541441+0000","last_undegraded":"2023-11-04T01:38:19.541441+0000","last_fullsized":"2023-11-04T01:38:19.541441+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000490194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766274+0000","last_change":"2023-11-04T01:38:20.766274+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766274+0000","last_undegraded":"2023-11-04T01:38:20.766274+0000","last_fullsized":"2023-11-04T01:38:20.766274+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778284+0000","last_change":"2023-11-04T01:37:36.422156+0000","last_active":"2023-11-04T01:38:18.778284+0000","last_peered":"2023-11-04T01:38:18.778284+0000","last_clean":"2023-11-04T01:38:18.778284+0000","last_became_active":"2023-11-04T01:37:35.214925+0000","last_became_peered":"2023-11-04T01:37:35.214925+0000","last_unstale":"2023-11-04T01:38:18.778284+0000","last_undegraded":"2023-11-04T01:38:18.778284+0000","last_fullsized":"2023-11-04T01:38:18.778284+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058029000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763050+0000","last_change":"2023-11-04T01:38:20.763050+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763050+0000","last_undegraded":"2023-11-04T01:38:20.763050+0000","last_fullsized":"2023-11-04T01:38:20.763050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778063+0000","last_change":"2023-11-04T01:37:36.229258+0000","last_active":"2023-11-04T01:38:18.778063+0000","last_peered":"2023-11-04T01:38:18.778063+0000","last_clean":"2023-11-04T01:38:18.778063+0000","last_became_active":"2023-11-04T01:37:35.221720+0000","last_became_peered":"2023-11-04T01:37:35.221720+0000","last_unstale":"2023-11-04T01:38:18.778063+0000","last_undegraded":"2023-11-04T01:38:18.778063+0000","last_fullsized":"2023-11-04T01:38:18.778063+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:09.633236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068644799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766972+0000","last_change":"2023-11-04T01:38:20.766972+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766972+0000","last_undegraded":"2023-11-04T01:38:20.766972+0000","last_fullsized":"2023-11-04T01:38:20.766972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128490+0000","last_change":"2023-11-04T01:37:36.695175+0000","last_active":"2023-11-04T01:38:19.128490+0000","last_peered":"2023-11-04T01:38:19.128490+0000","last_clean":"2023-11-04T01:38:19.128490+0000","last_became_active":"2023-11-04T01:37:35.224473+0000","last_became_peered":"2023-11-04T01:37:35.224473+0000","last_unstale":"2023-11-04T01:38:19.128490+0000","last_undegraded":"2023-11-04T01:38:19.128490+0000","last_fullsized":"2023-11-04T01:38:19.128490+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065377199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765527+0000","last_change":"2023-11-04T01:38:20.765527+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765527+0000","last_undegraded":"2023-11-04T01:38:20.765527+0000","last_fullsized":"2023-11-04T01:38:20.765527+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775529+0000","last_change":"2023-11-04T01:37:36.222100+0000","last_active":"2023-11-04T01:38:18.775529+0000","last_peered":"2023-11-04T01:38:18.775529+0000","last_clean":"2023-11-04T01:38:18.775529+0000","last_became_active":"2023-11-04T01:37:35.219622+0000","last_became_peered":"2023-11-04T01:37:35.219622+0000","last_unstale":"2023-11-04T01:38:18.775529+0000","last_undegraded":"2023-11-04T01:38:18.775529+0000","last_fullsized":"2023-11-04T01:38:18.775529+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:16.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653496,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766356+0000","last_change":"2023-11-04T01:38:20.766356+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766356+0000","last_undegraded":"2023-11-04T01:38:20.766356+0000","last_fullsized":"2023-11-04T01:38:20.766356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775613+0000","last_change":"2023-11-04T01:37:36.222451+0000","last_active":"2023-11-04T01:38:18.775613+0000","last_peered":"2023-11-04T01:38:18.775613+0000","last_clean":"2023-11-04T01:38:18.775613+0000","last_became_active":"2023-11-04T01:37:35.221090+0000","last_became_peered":"2023-11-04T01:37:35.221090+0000","last_unstale":"2023-11-04T01:38:18.775613+0000","last_undegraded":"2023-11-04T01:38:18.775613+0000","last_fullsized":"2023-11-04T01:38:18.775613+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077263799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763061+0000","last_change":"2023-11-04T01:38:20.763061+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763061+0000","last_undegraded":"2023-11-04T01:38:20.763061+0000","last_fullsized":"2023-11-04T01:38:20.763061+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775549+0000","last_change":"2023-11-04T01:37:36.222643+0000","last_active":"2023-11-04T01:38:18.775549+0000","last_peered":"2023-11-04T01:38:18.775549+0000","last_clean":"2023-11-04T01:38:18.775549+0000","last_became_active":"2023-11-04T01:37:35.215534+0000","last_became_peered":"2023-11-04T01:37:35.215534+0000","last_unstale":"2023-11-04T01:38:18.775549+0000","last_undegraded":"2023-11-04T01:38:18.775549+0000","last_fullsized":"2023-11-04T01:38:18.775549+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011110530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.769611+0000","last_change":"2023-11-04T01:38:20.769611+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.769611+0000","last_undegraded":"2023-11-04T01:38:20.769611+0000","last_fullsized":"2023-11-04T01:38:20.769611+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128525+0000","last_change":"2023-11-04T01:37:36.695402+0000","last_active":"2023-11-04T01:38:19.128525+0000","last_peered":"2023-11-04T01:38:19.128525+0000","last_clean":"2023-11-04T01:38:19.128525+0000","last_became_active":"2023-11-04T01:37:35.220346+0000","last_became_peered":"2023-11-04T01:37:35.220346+0000","last_unstale":"2023-11-04T01:38:19.128525+0000","last_undegraded":"2023-11-04T01:38:19.128525+0000","last_fullsized":"2023-11-04T01:38:19.128525+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062230100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763224+0000","last_change":"2023-11-04T01:38:20.763224+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763224+0000","last_undegraded":"2023-11-04T01:38:20.763224+0000","last_fullsized":"2023-11-04T01:38:20.763224+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128999+0000","last_change":"2023-11-04T01:37:36.426315+0000","last_active":"2023-11-04T01:38:19.128999+0000","last_peered":"2023-11-04T01:38:19.128999+0000","last_clean":"2023-11-04T01:38:19.128999+0000","last_became_active":"2023-11-04T01:37:35.223958+0000","last_became_peered":"2023-11-04T01:37:35.223958+0000","last_unstale":"2023-11-04T01:38:19.128999+0000","last_undegraded":"2023-11-04T01:38:19.128999+0000","last_fullsized":"2023-11-04T01:38:19.128999+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:46.733116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025167400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.767031+0000","last_change":"2023-11-04T01:38:20.767031+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.767031+0000","last_undegraded":"2023-11-04T01:38:20.767031+0000","last_fullsized":"2023-11-04T01:38:20.767031+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128421+0000","last_change":"2023-11-04T01:37:36.694540+0000","last_active":"2023-11-04T01:38:19.128421+0000","last_peered":"2023-11-04T01:38:19.128421+0000","last_clean":"2023-11-04T01:38:19.128421+0000","last_became_active":"2023-11-04T01:37:35.225863+0000","last_became_peered":"2023-11-04T01:37:35.225863+0000","last_unstale":"2023-11-04T01:38:19.128421+0000","last_undegraded":"2023-11-04T01:38:19.128421+0000","last_fullsized":"2023-11-04T01:38:19.128421+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:42.654853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042277299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763221+0000","last_change":"2023-11-04T01:38:20.763221+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763221+0000","last_undegraded":"2023-11-04T01:38:20.763221+0000","last_fullsized":"2023-11-04T01:38:20.763221+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128979+0000","last_change":"2023-11-04T01:37:36.426202+0000","last_active":"2023-11-04T01:38:19.128979+0000","last_peered":"2023-11-04T01:38:19.128979+0000","last_clean":"2023-11-04T01:38:19.128979+0000","last_became_active":"2023-11-04T01:37:35.222997+0000","last_became_peered":"2023-11-04T01:37:35.222997+0000","last_unstale":"2023-11-04T01:38:19.128979+0000","last_undegraded":"2023-11-04T01:38:19.128979+0000","last_fullsized":"2023-11-04T01:38:19.128979+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:18.980751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041393700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766362+0000","last_change":"2023-11-04T01:38:20.766362+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766362+0000","last_undegraded":"2023-11-04T01:38:20.766362+0000","last_fullsized":"2023-11-04T01:38:20.766362+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.030089+0000","last_change":"2023-11-04T01:37:36.220713+0000","last_active":"2023-11-04T01:38:19.030089+0000","last_peered":"2023-11-04T01:38:19.030089+0000","last_clean":"2023-11-04T01:38:19.030089+0000","last_became_active":"2023-11-04T01:37:35.220311+0000","last_became_peered":"2023-11-04T01:37:35.220311+0000","last_unstale":"2023-11-04T01:38:19.030089+0000","last_undegraded":"2023-11-04T01:38:19.030089+0000","last_fullsized":"2023-11-04T01:38:19.030089+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062999799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766629+0000","last_change":"2023-11-04T01:38:20.766629+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766629+0000","last_undegraded":"2023-11-04T01:38:20.766629+0000","last_fullsized":"2023-11-04T01:38:20.766629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778191+0000","last_change":"2023-11-04T01:37:36.229580+0000","last_active":"2023-11-04T01:38:18.778191+0000","last_peered":"2023-11-04T01:38:18.778191+0000","last_clean":"2023-11-04T01:38:18.778191+0000","last_became_active":"2023-11-04T01:37:35.220940+0000","last_became_peered":"2023-11-04T01:37:35.220940+0000","last_unstale":"2023-11-04T01:38:18.778191+0000","last_undegraded":"2023-11-04T01:38:18.778191+0000","last_fullsized":"2023-11-04T01:38:18.778191+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:27.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070235600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766880+0000","last_change":"2023-11-04T01:38:20.766880+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766880+0000","last_undegraded":"2023-11-04T01:38:20.766880+0000","last_fullsized":"2023-11-04T01:38:20.766880+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778269+0000","last_change":"2023-11-04T01:37:36.422542+0000","last_active":"2023-11-04T01:38:18.778269+0000","last_peered":"2023-11-04T01:38:18.778269+0000","last_clean":"2023-11-04T01:38:18.778269+0000","last_became_active":"2023-11-04T01:37:35.224836+0000","last_became_peered":"2023-11-04T01:37:35.224836+0000","last_unstale":"2023-11-04T01:38:18.778269+0000","last_undegraded":"2023-11-04T01:38:18.778269+0000","last_fullsized":"2023-11-04T01:38:18.778269+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066982800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766033+0000","last_change":"2023-11-04T01:38:20.766033+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766033+0000","last_undegraded":"2023-11-04T01:38:20.766033+0000","last_fullsized":"2023-11-04T01:38:20.766033+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128510+0000","last_change":"2023-11-04T01:37:36.694868+0000","last_active":"2023-11-04T01:38:19.128510+0000","last_peered":"2023-11-04T01:38:19.128510+0000","last_clean":"2023-11-04T01:38:19.128510+0000","last_became_active":"2023-11-04T01:37:35.221181+0000","last_became_peered":"2023-11-04T01:37:35.221181+0000","last_unstale":"2023-11-04T01:38:19.128510+0000","last_undegraded":"2023-11-04T01:38:19.128510+0000","last_fullsized":"2023-11-04T01:38:19.128510+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046748800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.768293+0000","last_change":"2023-11-04T01:38:20.768293+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.768293+0000","last_undegraded":"2023-11-04T01:38:20.768293+0000","last_fullsized":"2023-11-04T01:38:20.768293+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775617+0000","last_change":"2023-11-04T01:37:36.222930+0000","last_active":"2023-11-04T01:38:18.775617+0000","last_peered":"2023-11-04T01:38:18.775617+0000","last_clean":"2023-11-04T01:38:18.775617+0000","last_became_active":"2023-11-04T01:37:35.220373+0000","last_became_peered":"2023-11-04T01:37:35.220373+0000","last_unstale":"2023-11-04T01:38:18.775617+0000","last_undegraded":"2023-11-04T01:38:18.775617+0000","last_fullsized":"2023-11-04T01:38:18.775617+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074099599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765531+0000","last_change":"2023-11-04T01:38:20.765531+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765531+0000","last_undegraded":"2023-11-04T01:38:20.765531+0000","last_fullsized":"2023-11-04T01:38:20.765531+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.541433+0000","last_change":"2023-11-04T01:37:36.221676+0000","last_active":"2023-11-04T01:38:19.541433+0000","last_peered":"2023-11-04T01:38:19.541433+0000","last_clean":"2023-11-04T01:38:19.541433+0000","last_became_active":"2023-11-04T01:37:35.226996+0000","last_became_peered":"2023-11-04T01:37:35.226996+0000","last_unstale":"2023-11-04T01:38:19.541433+0000","last_undegraded":"2023-11-04T01:38:19.541433+0000","last_fullsized":"2023-11-04T01:38:19.541433+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089115500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766050+0000","last_change":"2023-11-04T01:38:20.766050+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766050+0000","last_undegraded":"2023-11-04T01:38:20.766050+0000","last_fullsized":"2023-11-04T01:38:20.766050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.531896+0000","last_change":"2023-11-04T01:37:36.228535+0000","last_active":"2023-11-04T01:38:19.531896+0000","last_peered":"2023-11-04T01:38:19.531896+0000","last_clean":"2023-11-04T01:38:19.531896+0000","last_became_active":"2023-11-04T01:37:35.221173+0000","last_became_peered":"2023-11-04T01:37:35.221173+0000","last_unstale":"2023-11-04T01:38:19.531896+0000","last_undegraded":"2023-11-04T01:38:19.531896+0000","last_fullsized":"2023-11-04T01:38:19.531896+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049831099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763052+0000","last_change":"2023-11-04T01:38:20.763052+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763052+0000","last_undegraded":"2023-11-04T01:38:20.763052+0000","last_fullsized":"2023-11-04T01:38:20.763052+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778125+0000","last_change":"2023-11-04T01:37:36.229678+0000","last_active":"2023-11-04T01:38:18.778125+0000","last_peered":"2023-11-04T01:38:18.778125+0000","last_clean":"2023-11-04T01:38:18.778125+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:38:18.778125+0000","last_undegraded":"2023-11-04T01:38:18.778125+0000","last_fullsized":"2023-11-04T01:38:18.778125+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:50.484332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.768388+0000","last_change":"2023-11-04T01:38:20.768388+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.768388+0000","last_undegraded":"2023-11-04T01:38:20.768388+0000","last_fullsized":"2023-11-04T01:38:20.768388+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778117+0000","last_change":"2023-11-04T01:37:36.229908+0000","last_active":"2023-11-04T01:38:18.778117+0000","last_peered":"2023-11-04T01:38:18.778117+0000","last_clean":"2023-11-04T01:38:18.778117+0000","last_became_active":"2023-11-04T01:37:35.221822+0000","last_became_peered":"2023-11-04T01:37:35.221822+0000","last_unstale":"2023-11-04T01:38:18.778117+0000","last_undegraded":"2023-11-04T01:38:18.778117+0000","last_fullsized":"2023-11-04T01:38:18.778117+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:11.866738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089270799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765700+0000","last_change":"2023-11-04T01:38:20.765700+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765700+0000","last_undegraded":"2023-11-04T01:38:20.765700+0000","last_fullsized":"2023-11-04T01:38:20.765700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128552+0000","last_change":"2023-11-04T01:37:36.695345+0000","last_active":"2023-11-04T01:38:19.128552+0000","last_peered":"2023-11-04T01:38:19.128552+0000","last_clean":"2023-11-04T01:38:19.128552+0000","last_became_active":"2023-11-04T01:37:35.225441+0000","last_became_peered":"2023-11-04T01:37:35.225441+0000","last_unstale":"2023-11-04T01:38:19.128552+0000","last_undegraded":"2023-11-04T01:38:19.128552+0000","last_fullsized":"2023-11-04T01:38:19.128552+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052758199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":200,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778317+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:38:18.778317+0000","last_peered":"2023-11-04T01:38:18.778317+0000","last_clean":"2023-11-04T01:38:18.778317+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:38:18.778317+0000","last_undegraded":"2023-11-04T01:38:18.778317+0000","last_fullsized":"2023-11-04T01:38:18.778317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":1355776,"data_stored":939806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.503,"15min":0.503},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64000000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.83499999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.745,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.67600000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.375,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.85899999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46300000000000002,"15min":0.45700000000000002},"min":{"1min":0.314,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.501},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.36599999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.32800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.371,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.77500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.45000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.434,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.443,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53400000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.41099999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":1.004,"15min":1.004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.54200000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55100000000000005,"15min":0.54100000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76100000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.55800000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78500000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52200000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79800000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.70599999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65800000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.68100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71399999999999997,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.67900000000000005,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.68200000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":1.24,"15min":1.24},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.42399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64900000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.42799999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72999999999999998,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.497},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67300000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.67200000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.69699999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72299999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.502,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65300000000000002,"5min":0.877,"15min":0.877},"last":0.38300000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75600000000000001,"5min":1.284,"15min":1.284},"last":0.629}]},{"osd":7,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71999999999999997,"5min":0.746,"15min":0.746},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.38700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40400000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.317,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76400000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.746,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.47199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78300000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.433,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":1.022,"15min":1.022},"last":0.69099999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":1.002,"15min":1.002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71699999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":1.127,"15min":1.127},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80200000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77600000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.504},{"interface":"front","average":{"1min":0.629,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.747,"5min":1.079,"15min":1.079},"last":0.79300000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81000000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.629,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":1.093,"15min":1.093},"last":0.71199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.33400000000000002,"15min":0.34000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.49299999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.48399999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.313}]},{"osd":1,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.39700000000000002,"15min":0.40799999999999997},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.44600000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.41799999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.29199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.57699999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.312,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59499999999999997,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61599999999999999,"15min":0.627},"min":{"1min":0.36299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.752,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.622,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.65900000000000003,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80600000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.52400000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79400000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68500000000000005,"15min":0.69699999999999995},"min":{"1min":0.51000000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.752,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.77400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.36099999999999999,"15min":0.371},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.42399999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.36799999999999999,"15min":0.375},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.625,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.28799999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.373},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38200000000000001,"15min":0.38600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55500000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.5,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.443}]},{"osd":4,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65000000000000002,"15min":0.65800000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.79900000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86299999999999999,"5min":1.052,"15min":1.052},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.876,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.67400000000000004,"15min":0.68200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.71799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32700000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.46500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.435}]},{"osd":2,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40200000000000002,"15min":0.40400000000000003},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.58699999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.41499999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58399999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39000000000000001,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.38200000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60699999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":1.02,"15min":1.02},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89700000000000002,"5min":1.089,"15min":1.089},"last":0.64500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92600000000000005,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.754},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92400000000000004,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96699999999999997,"5min":1.153,"15min":1.153},"last":0.63100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1363968,"data_stored":945277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.35299999999999998,"15min":0.35599999999999998},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47099999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34699999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55200000000000005,"5min":0.629,"15min":0.629},"last":0.39000000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59499999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.48899999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.29599999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.28799999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.497,"5min":0.628,"15min":0.628},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65700000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.36599999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.45600000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.48399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77200000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.59699999999999998},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.80600000000000005,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.628}]},{"osd":6,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81999999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84099999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.622},"min":{"1min":0.47099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81699999999999995,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.495,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86499999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.56200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:25.798 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.934+0000 7f6ce5856640 1 Processor -- start 2023-11-04T01:38:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.934+0000 7f6ce5856640 1 -- start start 2023-11-04T01:38:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6ce5856640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6ce0160440 0x7f6ce00b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6ce5856640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ce00b6160 0x7f6ce00b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6ce5856640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ce00cd6e0 0x7f6ce00cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6ce5856640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce00ce3a0 con 0x7f6ce00cd6e0 2023-11-04T01:38:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6ce5856640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce00d1120 con 0x7f6ce0160440 2023-11-04T01:38:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6ce5856640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce00d1400 con 0x7f6ce00b6160 2023-11-04T01:38:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6cdf7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ce00cd6e0 0x7f6ce00cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6cdf7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ce00cd6e0 0x7f6ce00cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44662/0 (socket says 172.21.15.44:44662) 2023-11-04T01:38:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6cdf7fe640 1 -- 172.21.15.44:0/241485026 learned_addr learned my addr 172.21.15.44:0/241485026 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6cde7fc640 1 --2- 172.21.15.44:0/241485026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ce00b6160 0x7f6ce00b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6cdeffd640 1 --2- 172.21.15.44:0/241485026 >> v2:172.21.15.204:3300/0 conn(0x7f6ce0160440 0x7f6ce00b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6cdf7fe640 1 -- 172.21.15.44:0/241485026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ce00b6160 msgr2=0x7f6ce00b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6cdf7fe640 1 --2- 172.21.15.44:0/241485026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ce00b6160 0x7f6ce00b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6cdf7fe640 1 -- 172.21.15.44:0/241485026 >> v2:172.21.15.204:3300/0 conn(0x7f6ce0160440 msgr2=0x7f6ce00b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:25.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6cdf7fe640 1 --2- 172.21.15.44:0/241485026 >> v2:172.21.15.204:3300/0 conn(0x7f6ce0160440 0x7f6ce00b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.935+0000 7f6cdf7fe640 1 -- 172.21.15.44:0/241485026 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce00d16e0 con 0x7f6ce00cd6e0 2023-11-04T01:38:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.936+0000 7f6cdf7fe640 1 --2- 172.21.15.44:0/241485026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce00cd6e0 0x7f6ce00cdb50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00d3f10 tx=0x7f6cd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0368fb21b87e65 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.936+0000 7f6cddffb640 1 -- 172.21.15.44:0/241485026 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8031870 con 0x7f6ce00cd6e0 2023-11-04T01:38:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.936+0000 7f6cddffb640 1 -- 172.21.15.44:0/241485026 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd80319d0 con 0x7f6ce00cd6e0 2023-11-04T01:38:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.936+0000 7f6cddffb640 1 -- 172.21.15.44:0/241485026 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8031d60 con 0x7f6ce00cd6e0 2023-11-04T01:38:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.937+0000 7f6ce5856640 1 -- 172.21.15.44:0/241485026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce00cd6e0 msgr2=0x7f6ce00cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.937+0000 7f6ce5856640 1 --2- 172.21.15.44:0/241485026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce00cd6e0 0x7f6ce00cdb50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00d3f10 tx=0x7f6cd802b910 comp rx=0 tx=0).stop 2023-11-04T01:38:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.937+0000 7f6ce5856640 1 -- 172.21.15.44:0/241485026 shutdown_connections 2023-11-04T01:38:25.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.937+0000 7f6ce5856640 1 --2- 172.21.15.44:0/241485026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce00cd6e0 0x7f6ce00cdb50 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.937+0000 7f6ce5856640 1 --2- 172.21.15.44:0/241485026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ce00b6160 0x7f6ce00b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.937+0000 7f6ce5856640 1 --2- 172.21.15.44:0/241485026 >> v2:172.21.15.204:3300/0 conn(0x7f6ce0160440 0x7f6ce00b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.937+0000 7f6ce5856640 1 -- 172.21.15.44:0/241485026 >> 172.21.15.44:0/241485026 conn(0x7f6ce00cf900 msgr2=0x7f6ce00cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:25.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.937+0000 7f6ce5856640 1 -- 172.21.15.44:0/241485026 shutdown_connections 2023-11-04T01:38:25.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.937+0000 7f6ce5856640 1 -- 172.21.15.44:0/241485026 wait complete. 2023-11-04T01:38:25.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.938+0000 7f6ce5856640 1 Processor -- start 2023-11-04T01:38:25.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.938+0000 7f6ce5856640 1 -- start start 2023-11-04T01:38:25.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6ce5856640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ce00cd6e0 0x7f6ce00b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6ce5856640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0160440 0x7f6ce01f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6ce5856640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ce014d9e0 0x7f6ce00b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6ce5856640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce00b3c90 con 0x7f6ce0160440 2023-11-04T01:38:25.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6ce5856640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce00b3960 con 0x7f6ce00cd6e0 2023-11-04T01:38:25.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6ce5856640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce01f64c0 con 0x7f6ce014d9e0 2023-11-04T01:38:25.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6cde7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0160440 0x7f6ce01f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6cde7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0160440 0x7f6ce01f5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44676/0 (socket says 172.21.15.44:44676) 2023-11-04T01:38:25.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6cde7fc640 1 -- 172.21.15.44:0/210409089 learned_addr learned my addr 172.21.15.44:0/210409089 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:25.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6cdeffd640 1 --2- 172.21.15.44:0/210409089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ce00cd6e0 0x7f6ce00b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6cdf7fe640 1 --2- 172.21.15.44:0/210409089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ce014d9e0 0x7f6ce00b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6cde7fc640 1 -- 172.21.15.44:0/210409089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ce014d9e0 msgr2=0x7f6ce00b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6cde7fc640 1 --2- 172.21.15.44:0/210409089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ce014d9e0 0x7f6ce00b75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6cde7fc640 1 -- 172.21.15.44:0/210409089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ce00cd6e0 msgr2=0x7f6ce00b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6cde7fc640 1 --2- 172.21.15.44:0/210409089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ce00cd6e0 0x7f6ce00b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6cde7fc640 1 -- 172.21.15.44:0/210409089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd80094d0 con 0x7f6ce0160440 2023-11-04T01:38:25.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.939+0000 7f6cdeffd640 1 --2- 172.21.15.44:0/210409089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ce00cd6e0 0x7f6ce00b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:25.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.940+0000 7f6cde7fc640 1 --2- 172.21.15.44:0/210409089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0160440 0x7f6ce01f5c90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400e890 tx=0x7f6cd400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.940+0000 7f6cc7fff640 1 -- 172.21.15.44:0/210409089 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400c940 con 0x7f6ce0160440 2023-11-04T01:38:25.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.940+0000 7f6cc7fff640 1 -- 172.21.15.44:0/210409089 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd400caa0 con 0x7f6ce0160440 2023-11-04T01:38:25.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.940+0000 7f6ce5856640 1 -- 172.21.15.44:0/210409089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce01f67a0 con 0x7f6ce0160440 2023-11-04T01:38:25.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.940+0000 7f6cc7fff640 1 -- 172.21.15.44:0/210409089 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400ce30 con 0x7f6ce0160440 2023-11-04T01:38:25.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.940+0000 7f6ce5856640 1 -- 172.21.15.44:0/210409089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce01f61d0 con 0x7f6ce0160440 2023-11-04T01:38:25.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.941+0000 7f6ce5856640 1 -- 172.21.15.44:0/210409089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce00b3e00 con 0x7f6ce0160440 2023-11-04T01:38:25.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.941+0000 7f6cc7fff640 1 -- 172.21.15.44:0/210409089 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6cd4013470 con 0x7f6ce0160440 2023-11-04T01:38:25.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.942+0000 7f6cc7fff640 1 --2- 172.21.15.44:0/210409089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ccc06aea0 0x7f6ccc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.942+0000 7f6cc7fff640 1 -- 172.21.15.44:0/210409089 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6cd4089af0 con 0x7f6ce0160440 2023-11-04T01:38:25.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.942+0000 7f6cdeffd640 1 --2- 172.21.15.44:0/210409089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ccc06aea0 0x7f6ccc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.943+0000 7f6cdeffd640 1 --2- 172.21.15.44:0/210409089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ccc06aea0 0x7f6ccc06d360 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009fd0 tx=0x7f6cd000b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:25.946+0000 7f6cc7fff640 1 -- 172.21.15.44:0/210409089 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6cd4054860 con 0x7f6ce0160440 2023-11-04T01:38:26.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.118+0000 7f6ce5856640 1 -- 172.21.15.44:0/210409089 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ce00ce090 con 0x7f6ccc06aea0 2023-11-04T01:38:26.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.126+0000 7f6cc7fff640 1 -- 172.21.15.44:0/210409089 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358817 (secure 0 0 0) 0x7f6cd000f050 con 0x7f6ccc06aea0 2023-11-04T01:38:26.132 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:26.134 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:38:26.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.130+0000 7f6ce5856640 1 -- 172.21.15.44:0/210409089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ccc06aea0 msgr2=0x7f6ccc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.130+0000 7f6ce5856640 1 --2- 172.21.15.44:0/210409089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ccc06aea0 0x7f6ccc06d360 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009fd0 tx=0x7f6cd000b040 comp rx=0 tx=0).stop 2023-11-04T01:38:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.130+0000 7f6ce5856640 1 -- 172.21.15.44:0/210409089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0160440 msgr2=0x7f6ce01f5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.130+0000 7f6ce5856640 1 --2- 172.21.15.44:0/210409089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0160440 0x7f6ce01f5c90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400e890 tx=0x7f6cd400ed50 comp rx=0 tx=0).stop 2023-11-04T01:38:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.130+0000 7f6ce5856640 1 -- 172.21.15.44:0/210409089 shutdown_connections 2023-11-04T01:38:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.130+0000 7f6ce5856640 1 --2- 172.21.15.44:0/210409089 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ccc06aea0 0x7f6ccc06d360 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.130+0000 7f6ce5856640 1 --2- 172.21.15.44:0/210409089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ce014d9e0 0x7f6ce00b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.130+0000 7f6ce5856640 1 --2- 172.21.15.44:0/210409089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0160440 0x7f6ce01f5c90 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.130+0000 7f6ce5856640 1 --2- 172.21.15.44:0/210409089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ce00cd6e0 0x7f6ce00b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.130+0000 7f6ce5856640 1 -- 172.21.15.44:0/210409089 >> 172.21.15.44:0/210409089 conn(0x7f6ce00cf900 msgr2=0x7f6ce0156470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.130+0000 7f6ce5856640 1 -- 172.21.15.44:0/210409089 shutdown_connections 2023-11-04T01:38:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.130+0000 7f6ce5856640 1 -- 172.21.15.44:0/210409089 wait complete. 2023-11-04T01:38:26.142 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2023-11-04T01:38:24.610033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223352,"kb_used_data":7192,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751368,"statfs":{"total":773094113280,"available":772865400832,"internally_reserved":0,"allocated":7364608,"data_stored":4020651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001098"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763050+0000","last_change":"2023-11-04T01:38:20.763050+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763050+0000","last_undegraded":"2023-11-04T01:38:20.763050+0000","last_fullsized":"2023-11-04T01:38:20.763050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.030266+0000","last_change":"2023-11-04T01:37:36.221026+0000","last_active":"2023-11-04T01:38:19.030266+0000","last_peered":"2023-11-04T01:38:19.030266+0000","last_clean":"2023-11-04T01:38:19.030266+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:38:19.030266+0000","last_undegraded":"2023-11-04T01:38:19.030266+0000","last_fullsized":"2023-11-04T01:38:19.030266+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067716399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766464+0000","last_change":"2023-11-04T01:38:20.766464+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766464+0000","last_undegraded":"2023-11-04T01:38:20.766464+0000","last_fullsized":"2023-11-04T01:38:20.766464+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.531905+0000","last_change":"2023-11-04T01:37:36.229027+0000","last_active":"2023-11-04T01:38:19.531905+0000","last_peered":"2023-11-04T01:38:19.531905+0000","last_clean":"2023-11-04T01:38:19.531905+0000","last_became_active":"2023-11-04T01:37:35.218342+0000","last_became_peered":"2023-11-04T01:37:35.218342+0000","last_unstale":"2023-11-04T01:38:19.531905+0000","last_undegraded":"2023-11-04T01:38:19.531905+0000","last_fullsized":"2023-11-04T01:38:19.531905+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059666400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.768640+0000","last_change":"2023-11-04T01:38:20.768640+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.768640+0000","last_undegraded":"2023-11-04T01:38:20.768640+0000","last_fullsized":"2023-11-04T01:38:20.768640+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775579+0000","last_change":"2023-11-04T01:37:36.222868+0000","last_active":"2023-11-04T01:38:18.775579+0000","last_peered":"2023-11-04T01:38:18.775579+0000","last_clean":"2023-11-04T01:38:18.775579+0000","last_became_active":"2023-11-04T01:37:35.220180+0000","last_became_peered":"2023-11-04T01:37:35.220180+0000","last_unstale":"2023-11-04T01:38:18.775579+0000","last_undegraded":"2023-11-04T01:38:18.775579+0000","last_fullsized":"2023-11-04T01:38:18.775579+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001103574,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.769634+0000","last_change":"2023-11-04T01:38:20.769634+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.769634+0000","last_undegraded":"2023-11-04T01:38:20.769634+0000","last_fullsized":"2023-11-04T01:38:20.769634+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.030071+0000","last_change":"2023-11-04T01:37:36.221053+0000","last_active":"2023-11-04T01:38:19.030071+0000","last_peered":"2023-11-04T01:38:19.030071+0000","last_clean":"2023-11-04T01:38:19.030071+0000","last_became_active":"2023-11-04T01:37:35.227176+0000","last_became_peered":"2023-11-04T01:37:35.227176+0000","last_unstale":"2023-11-04T01:38:19.030071+0000","last_undegraded":"2023-11-04T01:38:19.030071+0000","last_fullsized":"2023-11-04T01:38:19.030071+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000594178,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.769645+0000","last_change":"2023-11-04T01:38:20.769645+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.769645+0000","last_undegraded":"2023-11-04T01:38:20.769645+0000","last_fullsized":"2023-11-04T01:38:20.769645+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775522+0000","last_change":"2023-11-04T01:37:36.221842+0000","last_active":"2023-11-04T01:38:18.775522+0000","last_peered":"2023-11-04T01:38:18.775522+0000","last_clean":"2023-11-04T01:38:18.775522+0000","last_became_active":"2023-11-04T01:37:35.214305+0000","last_became_peered":"2023-11-04T01:37:35.214305+0000","last_unstale":"2023-11-04T01:38:18.775522+0000","last_undegraded":"2023-11-04T01:38:18.775522+0000","last_fullsized":"2023-11-04T01:38:18.775522+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:13:05.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014999690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765665+0000","last_change":"2023-11-04T01:38:20.765665+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765665+0000","last_undegraded":"2023-11-04T01:38:20.765665+0000","last_fullsized":"2023-11-04T01:38:20.765665+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128398+0000","last_change":"2023-11-04T01:37:36.694601+0000","last_active":"2023-11-04T01:38:19.128398+0000","last_peered":"2023-11-04T01:38:19.128398+0000","last_clean":"2023-11-04T01:38:19.128398+0000","last_became_active":"2023-11-04T01:37:35.223746+0000","last_became_peered":"2023-11-04T01:37:35.223746+0000","last_unstale":"2023-11-04T01:38:19.128398+0000","last_undegraded":"2023-11-04T01:38:19.128398+0000","last_fullsized":"2023-11-04T01:38:19.128398+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:35.960485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000555376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765236+0000","last_change":"2023-11-04T01:38:20.765236+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765236+0000","last_undegraded":"2023-11-04T01:38:20.765236+0000","last_fullsized":"2023-11-04T01:38:20.765236+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128424+0000","last_change":"2023-11-04T01:37:36.695075+0000","last_active":"2023-11-04T01:38:19.128424+0000","last_peered":"2023-11-04T01:38:19.128424+0000","last_clean":"2023-11-04T01:38:19.128424+0000","last_became_active":"2023-11-04T01:37:35.221165+0000","last_became_peered":"2023-11-04T01:37:35.221165+0000","last_unstale":"2023-11-04T01:38:19.128424+0000","last_undegraded":"2023-11-04T01:38:19.128424+0000","last_fullsized":"2023-11-04T01:38:19.128424+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:17.958372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072817499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763050+0000","last_change":"2023-11-04T01:38:20.763050+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763050+0000","last_undegraded":"2023-11-04T01:38:20.763050+0000","last_fullsized":"2023-11-04T01:38:20.763050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.541444+0000","last_change":"2023-11-04T01:37:36.221747+0000","last_active":"2023-11-04T01:38:19.541444+0000","last_peered":"2023-11-04T01:38:19.541444+0000","last_clean":"2023-11-04T01:38:19.541444+0000","last_became_active":"2023-11-04T01:37:35.223198+0000","last_became_peered":"2023-11-04T01:37:35.223198+0000","last_unstale":"2023-11-04T01:38:19.541444+0000","last_undegraded":"2023-11-04T01:38:19.541444+0000","last_fullsized":"2023-11-04T01:38:19.541444+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097726499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763287+0000","last_change":"2023-11-04T01:38:20.763287+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763287+0000","last_undegraded":"2023-11-04T01:38:20.763287+0000","last_fullsized":"2023-11-04T01:38:20.763287+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778403+0000","last_change":"2023-11-04T01:37:36.422496+0000","last_active":"2023-11-04T01:38:18.778403+0000","last_peered":"2023-11-04T01:38:18.778403+0000","last_clean":"2023-11-04T01:38:18.778403+0000","last_became_active":"2023-11-04T01:37:35.221763+0000","last_became_peered":"2023-11-04T01:37:35.221763+0000","last_unstale":"2023-11-04T01:38:18.778403+0000","last_undegraded":"2023-11-04T01:38:18.778403+0000","last_fullsized":"2023-11-04T01:38:18.778403+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073676299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.769684+0000","last_change":"2023-11-04T01:38:20.769684+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.769684+0000","last_undegraded":"2023-11-04T01:38:20.769684+0000","last_fullsized":"2023-11-04T01:38:20.769684+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778348+0000","last_change":"2023-11-04T01:37:36.229940+0000","last_active":"2023-11-04T01:38:18.778348+0000","last_peered":"2023-11-04T01:38:18.778348+0000","last_clean":"2023-11-04T01:38:18.778348+0000","last_became_active":"2023-11-04T01:37:35.225121+0000","last_became_peered":"2023-11-04T01:37:35.225121+0000","last_unstale":"2023-11-04T01:38:18.778348+0000","last_undegraded":"2023-11-04T01:38:18.778348+0000","last_fullsized":"2023-11-04T01:38:18.778348+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:12.130671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075648399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765202+0000","last_change":"2023-11-04T01:38:20.765202+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765202+0000","last_undegraded":"2023-11-04T01:38:20.765202+0000","last_fullsized":"2023-11-04T01:38:20.765202+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778310+0000","last_change":"2023-11-04T01:37:36.422801+0000","last_active":"2023-11-04T01:38:18.778310+0000","last_peered":"2023-11-04T01:38:18.778310+0000","last_clean":"2023-11-04T01:38:18.778310+0000","last_became_active":"2023-11-04T01:37:35.217091+0000","last_became_peered":"2023-11-04T01:37:35.217091+0000","last_unstale":"2023-11-04T01:38:18.778310+0000","last_undegraded":"2023-11-04T01:38:18.778310+0000","last_fullsized":"2023-11-04T01:38:18.778310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082211999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765653+0000","last_change":"2023-11-04T01:38:20.765653+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765653+0000","last_undegraded":"2023-11-04T01:38:20.765653+0000","last_fullsized":"2023-11-04T01:38:20.765653+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.541441+0000","last_change":"2023-11-04T01:37:36.222683+0000","last_active":"2023-11-04T01:38:19.541441+0000","last_peered":"2023-11-04T01:38:19.541441+0000","last_clean":"2023-11-04T01:38:19.541441+0000","last_became_active":"2023-11-04T01:37:35.222694+0000","last_became_peered":"2023-11-04T01:37:35.222694+0000","last_unstale":"2023-11-04T01:38:19.541441+0000","last_undegraded":"2023-11-04T01:38:19.541441+0000","last_fullsized":"2023-11-04T01:38:19.541441+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000490194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766274+0000","last_change":"2023-11-04T01:38:20.766274+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766274+0000","last_undegraded":"2023-11-04T01:38:20.766274+0000","last_fullsized":"2023-11-04T01:38:20.766274+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778284+0000","last_change":"2023-11-04T01:37:36.422156+0000","last_active":"2023-11-04T01:38:18.778284+0000","last_peered":"2023-11-04T01:38:18.778284+0000","last_clean":"2023-11-04T01:38:18.778284+0000","last_became_active":"2023-11-04T01:37:35.214925+0000","last_became_peered":"2023-11-04T01:37:35.214925+0000","last_unstale":"2023-11-04T01:38:18.778284+0000","last_undegraded":"2023-11-04T01:38:18.778284+0000","last_fullsized":"2023-11-04T01:38:18.778284+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058029000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763050+0000","last_change":"2023-11-04T01:38:20.763050+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763050+0000","last_undegraded":"2023-11-04T01:38:20.763050+0000","last_fullsized":"2023-11-04T01:38:20.763050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778063+0000","last_change":"2023-11-04T01:37:36.229258+0000","last_active":"2023-11-04T01:38:18.778063+0000","last_peered":"2023-11-04T01:38:18.778063+0000","last_clean":"2023-11-04T01:38:18.778063+0000","last_became_active":"2023-11-04T01:37:35.221720+0000","last_became_peered":"2023-11-04T01:37:35.221720+0000","last_unstale":"2023-11-04T01:38:18.778063+0000","last_undegraded":"2023-11-04T01:38:18.778063+0000","last_fullsized":"2023-11-04T01:38:18.778063+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:09.633236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068644799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766972+0000","last_change":"2023-11-04T01:38:20.766972+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766972+0000","last_undegraded":"2023-11-04T01:38:20.766972+0000","last_fullsized":"2023-11-04T01:38:20.766972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128490+0000","last_change":"2023-11-04T01:37:36.695175+0000","last_active":"2023-11-04T01:38:19.128490+0000","last_peered":"2023-11-04T01:38:19.128490+0000","last_clean":"2023-11-04T01:38:19.128490+0000","last_became_active":"2023-11-04T01:37:35.224473+0000","last_became_peered":"2023-11-04T01:37:35.224473+0000","last_unstale":"2023-11-04T01:38:19.128490+0000","last_undegraded":"2023-11-04T01:38:19.128490+0000","last_fullsized":"2023-11-04T01:38:19.128490+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065377199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765527+0000","last_change":"2023-11-04T01:38:20.765527+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765527+0000","last_undegraded":"2023-11-04T01:38:20.765527+0000","last_fullsized":"2023-11-04T01:38:20.765527+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775529+0000","last_change":"2023-11-04T01:37:36.222100+0000","last_active":"2023-11-04T01:38:18.775529+0000","last_peered":"2023-11-04T01:38:18.775529+0000","last_clean":"2023-11-04T01:38:18.775529+0000","last_became_active":"2023-11-04T01:37:35.219622+0000","last_became_peered":"2023-11-04T01:37:35.219622+0000","last_unstale":"2023-11-04T01:38:18.775529+0000","last_undegraded":"2023-11-04T01:38:18.775529+0000","last_fullsized":"2023-11-04T01:38:18.775529+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:16.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653496,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766356+0000","last_change":"2023-11-04T01:38:20.766356+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766356+0000","last_undegraded":"2023-11-04T01:38:20.766356+0000","last_fullsized":"2023-11-04T01:38:20.766356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775613+0000","last_change":"2023-11-04T01:37:36.222451+0000","last_active":"2023-11-04T01:38:18.775613+0000","last_peered":"2023-11-04T01:38:18.775613+0000","last_clean":"2023-11-04T01:38:18.775613+0000","last_became_active":"2023-11-04T01:37:35.221090+0000","last_became_peered":"2023-11-04T01:37:35.221090+0000","last_unstale":"2023-11-04T01:38:18.775613+0000","last_undegraded":"2023-11-04T01:38:18.775613+0000","last_fullsized":"2023-11-04T01:38:18.775613+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077263799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763061+0000","last_change":"2023-11-04T01:38:20.763061+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763061+0000","last_undegraded":"2023-11-04T01:38:20.763061+0000","last_fullsized":"2023-11-04T01:38:20.763061+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775549+0000","last_change":"2023-11-04T01:37:36.222643+0000","last_active":"2023-11-04T01:38:18.775549+0000","last_peered":"2023-11-04T01:38:18.775549+0000","last_clean":"2023-11-04T01:38:18.775549+0000","last_became_active":"2023-11-04T01:37:35.215534+0000","last_became_peered":"2023-11-04T01:37:35.215534+0000","last_unstale":"2023-11-04T01:38:18.775549+0000","last_undegraded":"2023-11-04T01:38:18.775549+0000","last_fullsized":"2023-11-04T01:38:18.775549+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011110530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.769611+0000","last_change":"2023-11-04T01:38:20.769611+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.769611+0000","last_undegraded":"2023-11-04T01:38:20.769611+0000","last_fullsized":"2023-11-04T01:38:20.769611+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128525+0000","last_change":"2023-11-04T01:37:36.695402+0000","last_active":"2023-11-04T01:38:19.128525+0000","last_peered":"2023-11-04T01:38:19.128525+0000","last_clean":"2023-11-04T01:38:19.128525+0000","last_became_active":"2023-11-04T01:37:35.220346+0000","last_became_peered":"2023-11-04T01:37:35.220346+0000","last_unstale":"2023-11-04T01:38:19.128525+0000","last_undegraded":"2023-11-04T01:38:19.128525+0000","last_fullsized":"2023-11-04T01:38:19.128525+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062230100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763224+0000","last_change":"2023-11-04T01:38:20.763224+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763224+0000","last_undegraded":"2023-11-04T01:38:20.763224+0000","last_fullsized":"2023-11-04T01:38:20.763224+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128999+0000","last_change":"2023-11-04T01:37:36.426315+0000","last_active":"2023-11-04T01:38:19.128999+0000","last_peered":"2023-11-04T01:38:19.128999+0000","last_clean":"2023-11-04T01:38:19.128999+0000","last_became_active":"2023-11-04T01:37:35.223958+0000","last_became_peered":"2023-11-04T01:37:35.223958+0000","last_unstale":"2023-11-04T01:38:19.128999+0000","last_undegraded":"2023-11-04T01:38:19.128999+0000","last_fullsized":"2023-11-04T01:38:19.128999+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:46.733116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025167400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.767031+0000","last_change":"2023-11-04T01:38:20.767031+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.767031+0000","last_undegraded":"2023-11-04T01:38:20.767031+0000","last_fullsized":"2023-11-04T01:38:20.767031+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128421+0000","last_change":"2023-11-04T01:37:36.694540+0000","last_active":"2023-11-04T01:38:19.128421+0000","last_peered":"2023-11-04T01:38:19.128421+0000","last_clean":"2023-11-04T01:38:19.128421+0000","last_became_active":"2023-11-04T01:37:35.225863+0000","last_became_peered":"2023-11-04T01:37:35.225863+0000","last_unstale":"2023-11-04T01:38:19.128421+0000","last_undegraded":"2023-11-04T01:38:19.128421+0000","last_fullsized":"2023-11-04T01:38:19.128421+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:42.654853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042277299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763221+0000","last_change":"2023-11-04T01:38:20.763221+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763221+0000","last_undegraded":"2023-11-04T01:38:20.763221+0000","last_fullsized":"2023-11-04T01:38:20.763221+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128979+0000","last_change":"2023-11-04T01:37:36.426202+0000","last_active":"2023-11-04T01:38:19.128979+0000","last_peered":"2023-11-04T01:38:19.128979+0000","last_clean":"2023-11-04T01:38:19.128979+0000","last_became_active":"2023-11-04T01:37:35.222997+0000","last_became_peered":"2023-11-04T01:37:35.222997+0000","last_unstale":"2023-11-04T01:38:19.128979+0000","last_undegraded":"2023-11-04T01:38:19.128979+0000","last_fullsized":"2023-11-04T01:38:19.128979+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:18.980751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041393700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766362+0000","last_change":"2023-11-04T01:38:20.766362+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766362+0000","last_undegraded":"2023-11-04T01:38:20.766362+0000","last_fullsized":"2023-11-04T01:38:20.766362+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.030089+0000","last_change":"2023-11-04T01:37:36.220713+0000","last_active":"2023-11-04T01:38:19.030089+0000","last_peered":"2023-11-04T01:38:19.030089+0000","last_clean":"2023-11-04T01:38:19.030089+0000","last_became_active":"2023-11-04T01:37:35.220311+0000","last_became_peered":"2023-11-04T01:37:35.220311+0000","last_unstale":"2023-11-04T01:38:19.030089+0000","last_undegraded":"2023-11-04T01:38:19.030089+0000","last_fullsized":"2023-11-04T01:38:19.030089+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062999799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766629+0000","last_change":"2023-11-04T01:38:20.766629+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766629+0000","last_undegraded":"2023-11-04T01:38:20.766629+0000","last_fullsized":"2023-11-04T01:38:20.766629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778191+0000","last_change":"2023-11-04T01:37:36.229580+0000","last_active":"2023-11-04T01:38:18.778191+0000","last_peered":"2023-11-04T01:38:18.778191+0000","last_clean":"2023-11-04T01:38:18.778191+0000","last_became_active":"2023-11-04T01:37:35.220940+0000","last_became_peered":"2023-11-04T01:37:35.220940+0000","last_unstale":"2023-11-04T01:38:18.778191+0000","last_undegraded":"2023-11-04T01:38:18.778191+0000","last_fullsized":"2023-11-04T01:38:18.778191+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:27.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070235600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766880+0000","last_change":"2023-11-04T01:38:20.766880+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766880+0000","last_undegraded":"2023-11-04T01:38:20.766880+0000","last_fullsized":"2023-11-04T01:38:20.766880+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778269+0000","last_change":"2023-11-04T01:37:36.422542+0000","last_active":"2023-11-04T01:38:18.778269+0000","last_peered":"2023-11-04T01:38:18.778269+0000","last_clean":"2023-11-04T01:38:18.778269+0000","last_became_active":"2023-11-04T01:37:35.224836+0000","last_became_peered":"2023-11-04T01:37:35.224836+0000","last_unstale":"2023-11-04T01:38:18.778269+0000","last_undegraded":"2023-11-04T01:38:18.778269+0000","last_fullsized":"2023-11-04T01:38:18.778269+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066982800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766033+0000","last_change":"2023-11-04T01:38:20.766033+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766033+0000","last_undegraded":"2023-11-04T01:38:20.766033+0000","last_fullsized":"2023-11-04T01:38:20.766033+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128510+0000","last_change":"2023-11-04T01:37:36.694868+0000","last_active":"2023-11-04T01:38:19.128510+0000","last_peered":"2023-11-04T01:38:19.128510+0000","last_clean":"2023-11-04T01:38:19.128510+0000","last_became_active":"2023-11-04T01:37:35.221181+0000","last_became_peered":"2023-11-04T01:37:35.221181+0000","last_unstale":"2023-11-04T01:38:19.128510+0000","last_undegraded":"2023-11-04T01:38:19.128510+0000","last_fullsized":"2023-11-04T01:38:19.128510+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046748800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.768293+0000","last_change":"2023-11-04T01:38:20.768293+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.768293+0000","last_undegraded":"2023-11-04T01:38:20.768293+0000","last_fullsized":"2023-11-04T01:38:20.768293+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775617+0000","last_change":"2023-11-04T01:37:36.222930+0000","last_active":"2023-11-04T01:38:18.775617+0000","last_peered":"2023-11-04T01:38:18.775617+0000","last_clean":"2023-11-04T01:38:18.775617+0000","last_became_active":"2023-11-04T01:37:35.220373+0000","last_became_peered":"2023-11-04T01:37:35.220373+0000","last_unstale":"2023-11-04T01:38:18.775617+0000","last_undegraded":"2023-11-04T01:38:18.775617+0000","last_fullsized":"2023-11-04T01:38:18.775617+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074099599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765531+0000","last_change":"2023-11-04T01:38:20.765531+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765531+0000","last_undegraded":"2023-11-04T01:38:20.765531+0000","last_fullsized":"2023-11-04T01:38:20.765531+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.541433+0000","last_change":"2023-11-04T01:37:36.221676+0000","last_active":"2023-11-04T01:38:19.541433+0000","last_peered":"2023-11-04T01:38:19.541433+0000","last_clean":"2023-11-04T01:38:19.541433+0000","last_became_active":"2023-11-04T01:37:35.226996+0000","last_became_peered":"2023-11-04T01:37:35.226996+0000","last_unstale":"2023-11-04T01:38:19.541433+0000","last_undegraded":"2023-11-04T01:38:19.541433+0000","last_fullsized":"2023-11-04T01:38:19.541433+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089115500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766050+0000","last_change":"2023-11-04T01:38:20.766050+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766050+0000","last_undegraded":"2023-11-04T01:38:20.766050+0000","last_fullsized":"2023-11-04T01:38:20.766050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.531896+0000","last_change":"2023-11-04T01:37:36.228535+0000","last_active":"2023-11-04T01:38:19.531896+0000","last_peered":"2023-11-04T01:38:19.531896+0000","last_clean":"2023-11-04T01:38:19.531896+0000","last_became_active":"2023-11-04T01:37:35.221173+0000","last_became_peered":"2023-11-04T01:37:35.221173+0000","last_unstale":"2023-11-04T01:38:19.531896+0000","last_undegraded":"2023-11-04T01:38:19.531896+0000","last_fullsized":"2023-11-04T01:38:19.531896+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049831099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763052+0000","last_change":"2023-11-04T01:38:20.763052+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763052+0000","last_undegraded":"2023-11-04T01:38:20.763052+0000","last_fullsized":"2023-11-04T01:38:20.763052+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778125+0000","last_change":"2023-11-04T01:37:36.229678+0000","last_active":"2023-11-04T01:38:18.778125+0000","last_peered":"2023-11-04T01:38:18.778125+0000","last_clean":"2023-11-04T01:38:18.778125+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:38:18.778125+0000","last_undegraded":"2023-11-04T01:38:18.778125+0000","last_fullsized":"2023-11-04T01:38:18.778125+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:50.484332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.768388+0000","last_change":"2023-11-04T01:38:20.768388+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.768388+0000","last_undegraded":"2023-11-04T01:38:20.768388+0000","last_fullsized":"2023-11-04T01:38:20.768388+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778117+0000","last_change":"2023-11-04T01:37:36.229908+0000","last_active":"2023-11-04T01:38:18.778117+0000","last_peered":"2023-11-04T01:38:18.778117+0000","last_clean":"2023-11-04T01:38:18.778117+0000","last_became_active":"2023-11-04T01:37:35.221822+0000","last_became_peered":"2023-11-04T01:37:35.221822+0000","last_unstale":"2023-11-04T01:38:18.778117+0000","last_undegraded":"2023-11-04T01:38:18.778117+0000","last_fullsized":"2023-11-04T01:38:18.778117+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:11.866738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089270799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765700+0000","last_change":"2023-11-04T01:38:20.765700+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765700+0000","last_undegraded":"2023-11-04T01:38:20.765700+0000","last_fullsized":"2023-11-04T01:38:20.765700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128552+0000","last_change":"2023-11-04T01:37:36.695345+0000","last_active":"2023-11-04T01:38:19.128552+0000","last_peered":"2023-11-04T01:38:19.128552+0000","last_clean":"2023-11-04T01:38:19.128552+0000","last_became_active":"2023-11-04T01:37:35.225441+0000","last_became_peered":"2023-11-04T01:37:35.225441+0000","last_unstale":"2023-11-04T01:38:19.128552+0000","last_undegraded":"2023-11-04T01:38:19.128552+0000","last_fullsized":"2023-11-04T01:38:19.128552+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052758199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":200,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778317+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:38:18.778317+0000","last_peered":"2023-11-04T01:38:18.778317+0000","last_clean":"2023-11-04T01:38:18.778317+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:38:18.778317+0000","last_undegraded":"2023-11-04T01:38:18.778317+0000","last_fullsized":"2023-11-04T01:38:18.778317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":1355776,"data_stored":939806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.503,"15min":0.503},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64000000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.83499999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.745,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.67600000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.375,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.85899999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46300000000000002,"15min":0.45700000000000002},"min":{"1min":0.314,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.501},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.36599999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.32800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.371,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.77500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.45000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.434,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.443,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53400000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.41099999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":1.004,"15min":1.004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.54200000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55100000000000005,"15min":0.54100000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76100000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.55800000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78500000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52200000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79800000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.70599999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65800000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.68100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71399999999999997,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.67900000000000005,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.68200000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":1.24,"15min":1.24},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.42399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64900000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.42799999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72999999999999998,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.497},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67300000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.67200000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.69699999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72299999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.502,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65300000000000002,"5min":0.877,"15min":0.877},"last":0.38300000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75600000000000001,"5min":1.284,"15min":1.284},"last":0.629}]},{"osd":7,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71999999999999997,"5min":0.746,"15min":0.746},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.38700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40400000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.317,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76400000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.746,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.47199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78300000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.433,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":1.022,"15min":1.022},"last":0.69099999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":1.002,"15min":1.002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71699999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":1.127,"15min":1.127},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80200000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77600000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.504},{"interface":"front","average":{"1min":0.629,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.747,"5min":1.079,"15min":1.079},"last":0.79300000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81000000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.629,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":1.093,"15min":1.093},"last":0.71199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.33400000000000002,"15min":0.34000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.49299999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.48399999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.313}]},{"osd":1,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.39700000000000002,"15min":0.40799999999999997},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.44600000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.41799999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.29199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.57699999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.312,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59499999999999997,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61599999999999999,"15min":0.627},"min":{"1min":0.36299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.752,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.622,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.65900000000000003,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80600000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.52400000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79400000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68500000000000005,"15min":0.69699999999999995},"min":{"1min":0.51000000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.752,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.77400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.36099999999999999,"15min":0.371},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.42399999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.36799999999999999,"15min":0.375},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.625,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.28799999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.373},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38200000000000001,"15min":0.38600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55500000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.5,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.443}]},{"osd":4,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65000000000000002,"15min":0.65800000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.79900000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86299999999999999,"5min":1.052,"15min":1.052},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.876,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.67400000000000004,"15min":0.68200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.71799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32700000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.46500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.435}]},{"osd":2,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40200000000000002,"15min":0.40400000000000003},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.58699999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.41499999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58399999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39000000000000001,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.38200000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60699999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":1.02,"15min":1.02},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89700000000000002,"5min":1.089,"15min":1.089},"last":0.64500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92600000000000005,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.754},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92400000000000004,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96699999999999997,"5min":1.153,"15min":1.153},"last":0.63100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1363968,"data_stored":945277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.35299999999999998,"15min":0.35599999999999998},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47099999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34699999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55200000000000005,"5min":0.629,"15min":0.629},"last":0.39000000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59499999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.48899999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.29599999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.28799999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.497,"5min":0.628,"15min":0.628},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65700000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.36599999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.45600000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.48399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77200000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.59699999999999998},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.80600000000000005,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.628}]},{"osd":6,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81999999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84099999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.622},"min":{"1min":0.47099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81699999999999995,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.495,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86499999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.56200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:26.148 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:26.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.287+0000 7fc068a07640 1 Processor -- start 2023-11-04T01:38:26.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.287+0000 7fc068a07640 1 -- start start 2023-11-04T01:38:26.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.288+0000 7fc068a07640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc06415ce70 0x7fc06406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.288+0000 7fc068a07640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc0640cb5c0 0x7fc0640ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.288+0000 7fc068a07640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06406a120 con 0x7fc06415d250 2023-11-04T01:38:26.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.288+0000 7fc068a07640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0640cdc10 con 0x7fc0640cb5c0 2023-11-04T01:38:26.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.288+0000 7fc068a07640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06406def0 con 0x7fc06415ce70 2023-11-04T01:38:26.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.288+0000 7fc062d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc0640cb5c0 0x7fc0640ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.288+0000 7fc05bfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc06415d250 0x7fc0640c9830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50436/0 (socket says 172.21.15.44:50436) 2023-11-04T01:38:26.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.288+0000 7fc05bfff640 1 -- 172.21.15.44:0/3587748276 learned_addr learned my addr 172.21.15.44:0/3587748276 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:26.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.288+0000 7fc06259c640 1 --2- 172.21.15.44:0/3587748276 >> v2:172.21.15.204:3300/0 conn(0x7fc06415ce70 0x7fc06406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.288+0000 7fc062d9d640 1 -- 172.21.15.44:0/3587748276 >> v2:172.21.15.204:3300/0 conn(0x7fc06415ce70 msgr2=0x7fc06406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:26.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.288+0000 7fc062d9d640 1 --2- 172.21.15.44:0/3587748276 >> v2:172.21.15.204:3300/0 conn(0x7fc06415ce70 0x7fc06406d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.288+0000 7fc062d9d640 1 -- 172.21.15.44:0/3587748276 >> v1:172.21.15.44:6789/0 conn(0x7fc06415d250 legacy=0x7fc0640c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.288+0000 7fc062d9d640 1 -- 172.21.15.44:0/3587748276 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640c9f40 con 0x7fc0640cb5c0 2023-11-04T01:38:26.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.288+0000 7fc06259c640 1 --2- 172.21.15.44:0/3587748276 >> v2:172.21.15.204:3300/0 conn(0x7fc06415ce70 0x7fc06406d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:26.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.289+0000 7fc062d9d640 1 --2- 172.21.15.44:0/3587748276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0640cb5c0 0x7fc0640ccdb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc064065ea0 tx=0x7fc05c02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa40e0bd89cf80c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:26.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.289+0000 7fc061d9b640 1 -- 172.21.15.44:0/3587748276 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c02cc70 con 0x7fc0640cb5c0 2023-11-04T01:38:26.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.289+0000 7fc061d9b640 1 -- 172.21.15.44:0/3587748276 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c02cdd0 con 0x7fc0640cb5c0 2023-11-04T01:38:26.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.289+0000 7fc061d9b640 1 -- 172.21.15.44:0/3587748276 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c034660 con 0x7fc0640cb5c0 2023-11-04T01:38:26.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.289+0000 7fc068a07640 1 -- 172.21.15.44:0/3587748276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0640cb5c0 msgr2=0x7fc0640ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.289+0000 7fc068a07640 1 --2- 172.21.15.44:0/3587748276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0640cb5c0 0x7fc0640ccdb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc064065ea0 tx=0x7fc05c02bec0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.290+0000 7fc068a07640 1 -- 172.21.15.44:0/3587748276 shutdown_connections 2023-11-04T01:38:26.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.290+0000 7fc068a07640 1 --2- 172.21.15.44:0/3587748276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0640cb5c0 0x7fc0640ccdb0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.290+0000 7fc068a07640 1 --2- 172.21.15.44:0/3587748276 >> v2:172.21.15.204:3300/0 conn(0x7fc06415ce70 0x7fc06406d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.290+0000 7fc068a07640 1 -- 172.21.15.44:0/3587748276 >> 172.21.15.44:0/3587748276 conn(0x7fc0640b0cd0 msgr2=0x7fc0640b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:26.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.290+0000 7fc068a07640 1 -- 172.21.15.44:0/3587748276 shutdown_connections 2023-11-04T01:38:26.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.290+0000 7fc068a07640 1 -- 172.21.15.44:0/3587748276 wait complete. 2023-11-04T01:38:26.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.291+0000 7fc068a07640 1 Processor -- start 2023-11-04T01:38:26.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.291+0000 7fc068a07640 1 -- start start 2023-11-04T01:38:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc068a07640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0640cb5c0 0x7fc06414a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc068a07640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc06415ce70 0x7fc0640af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc068a07640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc06415d250 0x7fc0640afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc068a07640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06414a940 con 0x7fc06415d250 2023-11-04T01:38:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc068a07640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0641f34d0 con 0x7fc06415ce70 2023-11-04T01:38:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc068a07640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06414ccc0 con 0x7fc0640cb5c0 2023-11-04T01:38:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc062d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc06415d250 0x7fc0640afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc062d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc06415d250 0x7fc0640afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44702/0 (socket says 172.21.15.44:44702) 2023-11-04T01:38:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc062d9d640 1 -- 172.21.15.44:0/1567655450 learned_addr learned my addr 172.21.15.44:0/1567655450 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc06259c640 1 --2- 172.21.15.44:0/1567655450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0640cb5c0 0x7fc06414a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc05bfff640 1 --2- 172.21.15.44:0/1567655450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc06415ce70 0x7fc0640af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc062d9d640 1 -- 172.21.15.44:0/1567655450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0640cb5c0 msgr2=0x7fc06414a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc062d9d640 1 --2- 172.21.15.44:0/1567655450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0640cb5c0 0x7fc06414a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc062d9d640 1 -- 172.21.15.44:0/1567655450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc06415ce70 msgr2=0x7fc0640af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc062d9d640 1 --2- 172.21.15.44:0/1567655450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc06415ce70 0x7fc0640af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc062d9d640 1 -- 172.21.15.44:0/1567655450 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c009a70 con 0x7fc06415d250 2023-11-04T01:38:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc062d9d640 1 --2- 172.21.15.44:0/1567655450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc06415d250 0x7fc0640afc20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009e80 tx=0x7fc05c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc05affd640 1 -- 172.21.15.44:0/1567655450 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c040650 con 0x7fc06415d250 2023-11-04T01:38:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc05affd640 1 -- 172.21.15.44:0/1567655450 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c0407d0 con 0x7fc06415d250 2023-11-04T01:38:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc05affd640 1 -- 172.21.15.44:0/1567655450 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c040b80 con 0x7fc06415d250 2023-11-04T01:38:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc068a07640 1 -- 172.21.15.44:0/1567655450 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06414cfa0 con 0x7fc06415d250 2023-11-04T01:38:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.292+0000 7fc068a07640 1 -- 172.21.15.44:0/1567655450 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06414d560 con 0x7fc06415d250 2023-11-04T01:38:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.294+0000 7fc068a07640 1 -- 172.21.15.44:0/1567655450 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc064074290 con 0x7fc06415d250 2023-11-04T01:38:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.294+0000 7fc05affd640 1 -- 172.21.15.44:0/1567655450 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc05c040ce0 con 0x7fc06415d250 2023-11-04T01:38:26.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.294+0000 7fc05affd640 1 --2- 172.21.15.44:0/1567655450 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc04406ae70 0x7fc04406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.294+0000 7fc05affd640 1 -- 172.21.15.44:0/1567655450 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc05c0ac730 con 0x7fc06415d250 2023-11-04T01:38:26.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.295+0000 7fc06259c640 1 --2- 172.21.15.44:0/1567655450 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc04406ae70 0x7fc04406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.295+0000 7fc06259c640 1 --2- 172.21.15.44:0/1567655450 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc04406ae70 0x7fc04406d330 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc06406bbf0 tx=0x7fc054008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:26.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.299+0000 7fc05affd640 1 -- 172.21.15.44:0/1567655450 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc05c077540 con 0x7fc06415d250 2023-11-04T01:38:26.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.472+0000 7fc068a07640 1 -- 172.21.15.44:0/1567655450 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc06406a650 con 0x7fc04406ae70 2023-11-04T01:38:26.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.481+0000 7fc05affd640 1 -- 172.21.15.44:0/1567655450 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358817 (secure 0 0 0) 0x7fc05400c040 con 0x7fc04406ae70 2023-11-04T01:38:26.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:26.488 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:38:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.484+0000 7fc068a07640 1 -- 172.21.15.44:0/1567655450 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc04406ae70 msgr2=0x7fc04406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.484+0000 7fc068a07640 1 --2- 172.21.15.44:0/1567655450 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc04406ae70 0x7fc04406d330 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc06406bbf0 tx=0x7fc054008040 comp rx=0 tx=0).stop 2023-11-04T01:38:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.484+0000 7fc068a07640 1 -- 172.21.15.44:0/1567655450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc06415d250 msgr2=0x7fc0640afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.484+0000 7fc068a07640 1 --2- 172.21.15.44:0/1567655450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc06415d250 0x7fc0640afc20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009e80 tx=0x7fc05c004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.484+0000 7fc068a07640 1 -- 172.21.15.44:0/1567655450 shutdown_connections 2023-11-04T01:38:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.484+0000 7fc068a07640 1 --2- 172.21.15.44:0/1567655450 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc04406ae70 0x7fc04406d330 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.484+0000 7fc068a07640 1 --2- 172.21.15.44:0/1567655450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc06415d250 0x7fc0640afc20 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.484+0000 7fc068a07640 1 --2- 172.21.15.44:0/1567655450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc06415ce70 0x7fc0640af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.484+0000 7fc068a07640 1 --2- 172.21.15.44:0/1567655450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0640cb5c0 0x7fc06414a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.484+0000 7fc068a07640 1 -- 172.21.15.44:0/1567655450 >> 172.21.15.44:0/1567655450 conn(0x7fc0640b0cd0 msgr2=0x7fc0640ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.484+0000 7fc068a07640 1 -- 172.21.15.44:0/1567655450 shutdown_connections 2023-11-04T01:38:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.484+0000 7fc068a07640 1 -- 172.21.15.44:0/1567655450 wait complete. 2023-11-04T01:38:26.497 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2023-11-04T01:38:24.610033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223352,"kb_used_data":7192,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751368,"statfs":{"total":773094113280,"available":772865400832,"internally_reserved":0,"allocated":7364608,"data_stored":4020651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001098"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763050+0000","last_change":"2023-11-04T01:38:20.763050+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763050+0000","last_undegraded":"2023-11-04T01:38:20.763050+0000","last_fullsized":"2023-11-04T01:38:20.763050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.030266+0000","last_change":"2023-11-04T01:37:36.221026+0000","last_active":"2023-11-04T01:38:19.030266+0000","last_peered":"2023-11-04T01:38:19.030266+0000","last_clean":"2023-11-04T01:38:19.030266+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:38:19.030266+0000","last_undegraded":"2023-11-04T01:38:19.030266+0000","last_fullsized":"2023-11-04T01:38:19.030266+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067716399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766464+0000","last_change":"2023-11-04T01:38:20.766464+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766464+0000","last_undegraded":"2023-11-04T01:38:20.766464+0000","last_fullsized":"2023-11-04T01:38:20.766464+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.531905+0000","last_change":"2023-11-04T01:37:36.229027+0000","last_active":"2023-11-04T01:38:19.531905+0000","last_peered":"2023-11-04T01:38:19.531905+0000","last_clean":"2023-11-04T01:38:19.531905+0000","last_became_active":"2023-11-04T01:37:35.218342+0000","last_became_peered":"2023-11-04T01:37:35.218342+0000","last_unstale":"2023-11-04T01:38:19.531905+0000","last_undegraded":"2023-11-04T01:38:19.531905+0000","last_fullsized":"2023-11-04T01:38:19.531905+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059666400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.768640+0000","last_change":"2023-11-04T01:38:20.768640+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.768640+0000","last_undegraded":"2023-11-04T01:38:20.768640+0000","last_fullsized":"2023-11-04T01:38:20.768640+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775579+0000","last_change":"2023-11-04T01:37:36.222868+0000","last_active":"2023-11-04T01:38:18.775579+0000","last_peered":"2023-11-04T01:38:18.775579+0000","last_clean":"2023-11-04T01:38:18.775579+0000","last_became_active":"2023-11-04T01:37:35.220180+0000","last_became_peered":"2023-11-04T01:37:35.220180+0000","last_unstale":"2023-11-04T01:38:18.775579+0000","last_undegraded":"2023-11-04T01:38:18.775579+0000","last_fullsized":"2023-11-04T01:38:18.775579+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001103574,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.769634+0000","last_change":"2023-11-04T01:38:20.769634+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.769634+0000","last_undegraded":"2023-11-04T01:38:20.769634+0000","last_fullsized":"2023-11-04T01:38:20.769634+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.030071+0000","last_change":"2023-11-04T01:37:36.221053+0000","last_active":"2023-11-04T01:38:19.030071+0000","last_peered":"2023-11-04T01:38:19.030071+0000","last_clean":"2023-11-04T01:38:19.030071+0000","last_became_active":"2023-11-04T01:37:35.227176+0000","last_became_peered":"2023-11-04T01:37:35.227176+0000","last_unstale":"2023-11-04T01:38:19.030071+0000","last_undegraded":"2023-11-04T01:38:19.030071+0000","last_fullsized":"2023-11-04T01:38:19.030071+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000594178,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.769645+0000","last_change":"2023-11-04T01:38:20.769645+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.769645+0000","last_undegraded":"2023-11-04T01:38:20.769645+0000","last_fullsized":"2023-11-04T01:38:20.769645+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775522+0000","last_change":"2023-11-04T01:37:36.221842+0000","last_active":"2023-11-04T01:38:18.775522+0000","last_peered":"2023-11-04T01:38:18.775522+0000","last_clean":"2023-11-04T01:38:18.775522+0000","last_became_active":"2023-11-04T01:37:35.214305+0000","last_became_peered":"2023-11-04T01:37:35.214305+0000","last_unstale":"2023-11-04T01:38:18.775522+0000","last_undegraded":"2023-11-04T01:38:18.775522+0000","last_fullsized":"2023-11-04T01:38:18.775522+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:13:05.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014999690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765665+0000","last_change":"2023-11-04T01:38:20.765665+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765665+0000","last_undegraded":"2023-11-04T01:38:20.765665+0000","last_fullsized":"2023-11-04T01:38:20.765665+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128398+0000","last_change":"2023-11-04T01:37:36.694601+0000","last_active":"2023-11-04T01:38:19.128398+0000","last_peered":"2023-11-04T01:38:19.128398+0000","last_clean":"2023-11-04T01:38:19.128398+0000","last_became_active":"2023-11-04T01:37:35.223746+0000","last_became_peered":"2023-11-04T01:37:35.223746+0000","last_unstale":"2023-11-04T01:38:19.128398+0000","last_undegraded":"2023-11-04T01:38:19.128398+0000","last_fullsized":"2023-11-04T01:38:19.128398+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:35.960485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000555376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765236+0000","last_change":"2023-11-04T01:38:20.765236+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765236+0000","last_undegraded":"2023-11-04T01:38:20.765236+0000","last_fullsized":"2023-11-04T01:38:20.765236+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128424+0000","last_change":"2023-11-04T01:37:36.695075+0000","last_active":"2023-11-04T01:38:19.128424+0000","last_peered":"2023-11-04T01:38:19.128424+0000","last_clean":"2023-11-04T01:38:19.128424+0000","last_became_active":"2023-11-04T01:37:35.221165+0000","last_became_peered":"2023-11-04T01:37:35.221165+0000","last_unstale":"2023-11-04T01:38:19.128424+0000","last_undegraded":"2023-11-04T01:38:19.128424+0000","last_fullsized":"2023-11-04T01:38:19.128424+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:17.958372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072817499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763050+0000","last_change":"2023-11-04T01:38:20.763050+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763050+0000","last_undegraded":"2023-11-04T01:38:20.763050+0000","last_fullsized":"2023-11-04T01:38:20.763050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.541444+0000","last_change":"2023-11-04T01:37:36.221747+0000","last_active":"2023-11-04T01:38:19.541444+0000","last_peered":"2023-11-04T01:38:19.541444+0000","last_clean":"2023-11-04T01:38:19.541444+0000","last_became_active":"2023-11-04T01:37:35.223198+0000","last_became_peered":"2023-11-04T01:37:35.223198+0000","last_unstale":"2023-11-04T01:38:19.541444+0000","last_undegraded":"2023-11-04T01:38:19.541444+0000","last_fullsized":"2023-11-04T01:38:19.541444+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097726499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763287+0000","last_change":"2023-11-04T01:38:20.763287+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763287+0000","last_undegraded":"2023-11-04T01:38:20.763287+0000","last_fullsized":"2023-11-04T01:38:20.763287+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778403+0000","last_change":"2023-11-04T01:37:36.422496+0000","last_active":"2023-11-04T01:38:18.778403+0000","last_peered":"2023-11-04T01:38:18.778403+0000","last_clean":"2023-11-04T01:38:18.778403+0000","last_became_active":"2023-11-04T01:37:35.221763+0000","last_became_peered":"2023-11-04T01:37:35.221763+0000","last_unstale":"2023-11-04T01:38:18.778403+0000","last_undegraded":"2023-11-04T01:38:18.778403+0000","last_fullsized":"2023-11-04T01:38:18.778403+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073676299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.769684+0000","last_change":"2023-11-04T01:38:20.769684+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.769684+0000","last_undegraded":"2023-11-04T01:38:20.769684+0000","last_fullsized":"2023-11-04T01:38:20.769684+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778348+0000","last_change":"2023-11-04T01:37:36.229940+0000","last_active":"2023-11-04T01:38:18.778348+0000","last_peered":"2023-11-04T01:38:18.778348+0000","last_clean":"2023-11-04T01:38:18.778348+0000","last_became_active":"2023-11-04T01:37:35.225121+0000","last_became_peered":"2023-11-04T01:37:35.225121+0000","last_unstale":"2023-11-04T01:38:18.778348+0000","last_undegraded":"2023-11-04T01:38:18.778348+0000","last_fullsized":"2023-11-04T01:38:18.778348+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:12.130671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075648399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765202+0000","last_change":"2023-11-04T01:38:20.765202+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765202+0000","last_undegraded":"2023-11-04T01:38:20.765202+0000","last_fullsized":"2023-11-04T01:38:20.765202+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778310+0000","last_change":"2023-11-04T01:37:36.422801+0000","last_active":"2023-11-04T01:38:18.778310+0000","last_peered":"2023-11-04T01:38:18.778310+0000","last_clean":"2023-11-04T01:38:18.778310+0000","last_became_active":"2023-11-04T01:37:35.217091+0000","last_became_peered":"2023-11-04T01:37:35.217091+0000","last_unstale":"2023-11-04T01:38:18.778310+0000","last_undegraded":"2023-11-04T01:38:18.778310+0000","last_fullsized":"2023-11-04T01:38:18.778310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082211999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765653+0000","last_change":"2023-11-04T01:38:20.765653+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765653+0000","last_undegraded":"2023-11-04T01:38:20.765653+0000","last_fullsized":"2023-11-04T01:38:20.765653+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.541441+0000","last_change":"2023-11-04T01:37:36.222683+0000","last_active":"2023-11-04T01:38:19.541441+0000","last_peered":"2023-11-04T01:38:19.541441+0000","last_clean":"2023-11-04T01:38:19.541441+0000","last_became_active":"2023-11-04T01:37:35.222694+0000","last_became_peered":"2023-11-04T01:37:35.222694+0000","last_unstale":"2023-11-04T01:38:19.541441+0000","last_undegraded":"2023-11-04T01:38:19.541441+0000","last_fullsized":"2023-11-04T01:38:19.541441+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000490194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766274+0000","last_change":"2023-11-04T01:38:20.766274+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766274+0000","last_undegraded":"2023-11-04T01:38:20.766274+0000","last_fullsized":"2023-11-04T01:38:20.766274+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778284+0000","last_change":"2023-11-04T01:37:36.422156+0000","last_active":"2023-11-04T01:38:18.778284+0000","last_peered":"2023-11-04T01:38:18.778284+0000","last_clean":"2023-11-04T01:38:18.778284+0000","last_became_active":"2023-11-04T01:37:35.214925+0000","last_became_peered":"2023-11-04T01:37:35.214925+0000","last_unstale":"2023-11-04T01:38:18.778284+0000","last_undegraded":"2023-11-04T01:38:18.778284+0000","last_fullsized":"2023-11-04T01:38:18.778284+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058029000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763050+0000","last_change":"2023-11-04T01:38:20.763050+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763050+0000","last_undegraded":"2023-11-04T01:38:20.763050+0000","last_fullsized":"2023-11-04T01:38:20.763050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778063+0000","last_change":"2023-11-04T01:37:36.229258+0000","last_active":"2023-11-04T01:38:18.778063+0000","last_peered":"2023-11-04T01:38:18.778063+0000","last_clean":"2023-11-04T01:38:18.778063+0000","last_became_active":"2023-11-04T01:37:35.221720+0000","last_became_peered":"2023-11-04T01:37:35.221720+0000","last_unstale":"2023-11-04T01:38:18.778063+0000","last_undegraded":"2023-11-04T01:38:18.778063+0000","last_fullsized":"2023-11-04T01:38:18.778063+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:09.633236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068644799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766972+0000","last_change":"2023-11-04T01:38:20.766972+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766972+0000","last_undegraded":"2023-11-04T01:38:20.766972+0000","last_fullsized":"2023-11-04T01:38:20.766972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128490+0000","last_change":"2023-11-04T01:37:36.695175+0000","last_active":"2023-11-04T01:38:19.128490+0000","last_peered":"2023-11-04T01:38:19.128490+0000","last_clean":"2023-11-04T01:38:19.128490+0000","last_became_active":"2023-11-04T01:37:35.224473+0000","last_became_peered":"2023-11-04T01:37:35.224473+0000","last_unstale":"2023-11-04T01:38:19.128490+0000","last_undegraded":"2023-11-04T01:38:19.128490+0000","last_fullsized":"2023-11-04T01:38:19.128490+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065377199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765527+0000","last_change":"2023-11-04T01:38:20.765527+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765527+0000","last_undegraded":"2023-11-04T01:38:20.765527+0000","last_fullsized":"2023-11-04T01:38:20.765527+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775529+0000","last_change":"2023-11-04T01:37:36.222100+0000","last_active":"2023-11-04T01:38:18.775529+0000","last_peered":"2023-11-04T01:38:18.775529+0000","last_clean":"2023-11-04T01:38:18.775529+0000","last_became_active":"2023-11-04T01:37:35.219622+0000","last_became_peered":"2023-11-04T01:37:35.219622+0000","last_unstale":"2023-11-04T01:38:18.775529+0000","last_undegraded":"2023-11-04T01:38:18.775529+0000","last_fullsized":"2023-11-04T01:38:18.775529+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:16.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653496,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766356+0000","last_change":"2023-11-04T01:38:20.766356+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766356+0000","last_undegraded":"2023-11-04T01:38:20.766356+0000","last_fullsized":"2023-11-04T01:38:20.766356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775613+0000","last_change":"2023-11-04T01:37:36.222451+0000","last_active":"2023-11-04T01:38:18.775613+0000","last_peered":"2023-11-04T01:38:18.775613+0000","last_clean":"2023-11-04T01:38:18.775613+0000","last_became_active":"2023-11-04T01:37:35.221090+0000","last_became_peered":"2023-11-04T01:37:35.221090+0000","last_unstale":"2023-11-04T01:38:18.775613+0000","last_undegraded":"2023-11-04T01:38:18.775613+0000","last_fullsized":"2023-11-04T01:38:18.775613+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077263799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763061+0000","last_change":"2023-11-04T01:38:20.763061+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763061+0000","last_undegraded":"2023-11-04T01:38:20.763061+0000","last_fullsized":"2023-11-04T01:38:20.763061+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775549+0000","last_change":"2023-11-04T01:37:36.222643+0000","last_active":"2023-11-04T01:38:18.775549+0000","last_peered":"2023-11-04T01:38:18.775549+0000","last_clean":"2023-11-04T01:38:18.775549+0000","last_became_active":"2023-11-04T01:37:35.215534+0000","last_became_peered":"2023-11-04T01:37:35.215534+0000","last_unstale":"2023-11-04T01:38:18.775549+0000","last_undegraded":"2023-11-04T01:38:18.775549+0000","last_fullsized":"2023-11-04T01:38:18.775549+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011110530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.769611+0000","last_change":"2023-11-04T01:38:20.769611+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.769611+0000","last_undegraded":"2023-11-04T01:38:20.769611+0000","last_fullsized":"2023-11-04T01:38:20.769611+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128525+0000","last_change":"2023-11-04T01:37:36.695402+0000","last_active":"2023-11-04T01:38:19.128525+0000","last_peered":"2023-11-04T01:38:19.128525+0000","last_clean":"2023-11-04T01:38:19.128525+0000","last_became_active":"2023-11-04T01:37:35.220346+0000","last_became_peered":"2023-11-04T01:37:35.220346+0000","last_unstale":"2023-11-04T01:38:19.128525+0000","last_undegraded":"2023-11-04T01:38:19.128525+0000","last_fullsized":"2023-11-04T01:38:19.128525+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062230100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763224+0000","last_change":"2023-11-04T01:38:20.763224+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763224+0000","last_undegraded":"2023-11-04T01:38:20.763224+0000","last_fullsized":"2023-11-04T01:38:20.763224+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128999+0000","last_change":"2023-11-04T01:37:36.426315+0000","last_active":"2023-11-04T01:38:19.128999+0000","last_peered":"2023-11-04T01:38:19.128999+0000","last_clean":"2023-11-04T01:38:19.128999+0000","last_became_active":"2023-11-04T01:37:35.223958+0000","last_became_peered":"2023-11-04T01:37:35.223958+0000","last_unstale":"2023-11-04T01:38:19.128999+0000","last_undegraded":"2023-11-04T01:38:19.128999+0000","last_fullsized":"2023-11-04T01:38:19.128999+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:46.733116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025167400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.767031+0000","last_change":"2023-11-04T01:38:20.767031+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.767031+0000","last_undegraded":"2023-11-04T01:38:20.767031+0000","last_fullsized":"2023-11-04T01:38:20.767031+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128421+0000","last_change":"2023-11-04T01:37:36.694540+0000","last_active":"2023-11-04T01:38:19.128421+0000","last_peered":"2023-11-04T01:38:19.128421+0000","last_clean":"2023-11-04T01:38:19.128421+0000","last_became_active":"2023-11-04T01:37:35.225863+0000","last_became_peered":"2023-11-04T01:37:35.225863+0000","last_unstale":"2023-11-04T01:38:19.128421+0000","last_undegraded":"2023-11-04T01:38:19.128421+0000","last_fullsized":"2023-11-04T01:38:19.128421+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:42.654853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042277299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763221+0000","last_change":"2023-11-04T01:38:20.763221+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763221+0000","last_undegraded":"2023-11-04T01:38:20.763221+0000","last_fullsized":"2023-11-04T01:38:20.763221+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128979+0000","last_change":"2023-11-04T01:37:36.426202+0000","last_active":"2023-11-04T01:38:19.128979+0000","last_peered":"2023-11-04T01:38:19.128979+0000","last_clean":"2023-11-04T01:38:19.128979+0000","last_became_active":"2023-11-04T01:37:35.222997+0000","last_became_peered":"2023-11-04T01:37:35.222997+0000","last_unstale":"2023-11-04T01:38:19.128979+0000","last_undegraded":"2023-11-04T01:38:19.128979+0000","last_fullsized":"2023-11-04T01:38:19.128979+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:18.980751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041393700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766362+0000","last_change":"2023-11-04T01:38:20.766362+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766362+0000","last_undegraded":"2023-11-04T01:38:20.766362+0000","last_fullsized":"2023-11-04T01:38:20.766362+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.030089+0000","last_change":"2023-11-04T01:37:36.220713+0000","last_active":"2023-11-04T01:38:19.030089+0000","last_peered":"2023-11-04T01:38:19.030089+0000","last_clean":"2023-11-04T01:38:19.030089+0000","last_became_active":"2023-11-04T01:37:35.220311+0000","last_became_peered":"2023-11-04T01:37:35.220311+0000","last_unstale":"2023-11-04T01:38:19.030089+0000","last_undegraded":"2023-11-04T01:38:19.030089+0000","last_fullsized":"2023-11-04T01:38:19.030089+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062999799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766629+0000","last_change":"2023-11-04T01:38:20.766629+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766629+0000","last_undegraded":"2023-11-04T01:38:20.766629+0000","last_fullsized":"2023-11-04T01:38:20.766629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778191+0000","last_change":"2023-11-04T01:37:36.229580+0000","last_active":"2023-11-04T01:38:18.778191+0000","last_peered":"2023-11-04T01:38:18.778191+0000","last_clean":"2023-11-04T01:38:18.778191+0000","last_became_active":"2023-11-04T01:37:35.220940+0000","last_became_peered":"2023-11-04T01:37:35.220940+0000","last_unstale":"2023-11-04T01:38:18.778191+0000","last_undegraded":"2023-11-04T01:38:18.778191+0000","last_fullsized":"2023-11-04T01:38:18.778191+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:27.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070235600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766880+0000","last_change":"2023-11-04T01:38:20.766880+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766880+0000","last_undegraded":"2023-11-04T01:38:20.766880+0000","last_fullsized":"2023-11-04T01:38:20.766880+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778269+0000","last_change":"2023-11-04T01:37:36.422542+0000","last_active":"2023-11-04T01:38:18.778269+0000","last_peered":"2023-11-04T01:38:18.778269+0000","last_clean":"2023-11-04T01:38:18.778269+0000","last_became_active":"2023-11-04T01:37:35.224836+0000","last_became_peered":"2023-11-04T01:37:35.224836+0000","last_unstale":"2023-11-04T01:38:18.778269+0000","last_undegraded":"2023-11-04T01:38:18.778269+0000","last_fullsized":"2023-11-04T01:38:18.778269+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066982800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766033+0000","last_change":"2023-11-04T01:38:20.766033+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766033+0000","last_undegraded":"2023-11-04T01:38:20.766033+0000","last_fullsized":"2023-11-04T01:38:20.766033+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128510+0000","last_change":"2023-11-04T01:37:36.694868+0000","last_active":"2023-11-04T01:38:19.128510+0000","last_peered":"2023-11-04T01:38:19.128510+0000","last_clean":"2023-11-04T01:38:19.128510+0000","last_became_active":"2023-11-04T01:37:35.221181+0000","last_became_peered":"2023-11-04T01:37:35.221181+0000","last_unstale":"2023-11-04T01:38:19.128510+0000","last_undegraded":"2023-11-04T01:38:19.128510+0000","last_fullsized":"2023-11-04T01:38:19.128510+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046748800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.768293+0000","last_change":"2023-11-04T01:38:20.768293+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.768293+0000","last_undegraded":"2023-11-04T01:38:20.768293+0000","last_fullsized":"2023-11-04T01:38:20.768293+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.775617+0000","last_change":"2023-11-04T01:37:36.222930+0000","last_active":"2023-11-04T01:38:18.775617+0000","last_peered":"2023-11-04T01:38:18.775617+0000","last_clean":"2023-11-04T01:38:18.775617+0000","last_became_active":"2023-11-04T01:37:35.220373+0000","last_became_peered":"2023-11-04T01:37:35.220373+0000","last_unstale":"2023-11-04T01:38:18.775617+0000","last_undegraded":"2023-11-04T01:38:18.775617+0000","last_fullsized":"2023-11-04T01:38:18.775617+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074099599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765531+0000","last_change":"2023-11-04T01:38:20.765531+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765531+0000","last_undegraded":"2023-11-04T01:38:20.765531+0000","last_fullsized":"2023-11-04T01:38:20.765531+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.541433+0000","last_change":"2023-11-04T01:37:36.221676+0000","last_active":"2023-11-04T01:38:19.541433+0000","last_peered":"2023-11-04T01:38:19.541433+0000","last_clean":"2023-11-04T01:38:19.541433+0000","last_became_active":"2023-11-04T01:37:35.226996+0000","last_became_peered":"2023-11-04T01:37:35.226996+0000","last_unstale":"2023-11-04T01:38:19.541433+0000","last_undegraded":"2023-11-04T01:38:19.541433+0000","last_fullsized":"2023-11-04T01:38:19.541433+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089115500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766050+0000","last_change":"2023-11-04T01:38:20.766050+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766050+0000","last_undegraded":"2023-11-04T01:38:20.766050+0000","last_fullsized":"2023-11-04T01:38:20.766050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.531896+0000","last_change":"2023-11-04T01:37:36.228535+0000","last_active":"2023-11-04T01:38:19.531896+0000","last_peered":"2023-11-04T01:38:19.531896+0000","last_clean":"2023-11-04T01:38:19.531896+0000","last_became_active":"2023-11-04T01:37:35.221173+0000","last_became_peered":"2023-11-04T01:37:35.221173+0000","last_unstale":"2023-11-04T01:38:19.531896+0000","last_undegraded":"2023-11-04T01:38:19.531896+0000","last_fullsized":"2023-11-04T01:38:19.531896+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049831099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.763052+0000","last_change":"2023-11-04T01:38:20.763052+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.763052+0000","last_undegraded":"2023-11-04T01:38:20.763052+0000","last_fullsized":"2023-11-04T01:38:20.763052+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778125+0000","last_change":"2023-11-04T01:37:36.229678+0000","last_active":"2023-11-04T01:38:18.778125+0000","last_peered":"2023-11-04T01:38:18.778125+0000","last_clean":"2023-11-04T01:38:18.778125+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:38:18.778125+0000","last_undegraded":"2023-11-04T01:38:18.778125+0000","last_fullsized":"2023-11-04T01:38:18.778125+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:50.484332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.768388+0000","last_change":"2023-11-04T01:38:20.768388+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.768388+0000","last_undegraded":"2023-11-04T01:38:20.768388+0000","last_fullsized":"2023-11-04T01:38:20.768388+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778117+0000","last_change":"2023-11-04T01:37:36.229908+0000","last_active":"2023-11-04T01:38:18.778117+0000","last_peered":"2023-11-04T01:38:18.778117+0000","last_clean":"2023-11-04T01:38:18.778117+0000","last_became_active":"2023-11-04T01:37:35.221822+0000","last_became_peered":"2023-11-04T01:37:35.221822+0000","last_unstale":"2023-11-04T01:38:18.778117+0000","last_undegraded":"2023-11-04T01:38:18.778117+0000","last_fullsized":"2023-11-04T01:38:18.778117+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:11.866738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089270799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765700+0000","last_change":"2023-11-04T01:38:20.765700+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765700+0000","last_undegraded":"2023-11-04T01:38:20.765700+0000","last_fullsized":"2023-11-04T01:38:20.765700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128552+0000","last_change":"2023-11-04T01:37:36.695345+0000","last_active":"2023-11-04T01:38:19.128552+0000","last_peered":"2023-11-04T01:38:19.128552+0000","last_clean":"2023-11-04T01:38:19.128552+0000","last_became_active":"2023-11-04T01:37:35.225441+0000","last_became_peered":"2023-11-04T01:37:35.225441+0000","last_unstale":"2023-11-04T01:38:19.128552+0000","last_undegraded":"2023-11-04T01:38:19.128552+0000","last_fullsized":"2023-11-04T01:38:19.128552+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052758199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":200,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778317+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:38:18.778317+0000","last_peered":"2023-11-04T01:38:18.778317+0000","last_clean":"2023-11-04T01:38:18.778317+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:38:18.778317+0000","last_undegraded":"2023-11-04T01:38:18.778317+0000","last_fullsized":"2023-11-04T01:38:18.778317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":1355776,"data_stored":939806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.503,"15min":0.503},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64000000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.83499999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.745,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.67600000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.375,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.85899999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46300000000000002,"15min":0.45700000000000002},"min":{"1min":0.314,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.501},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.36599999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.32800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.371,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.77500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.45000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.434,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.443,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53400000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.41099999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":1.004,"15min":1.004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.54200000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55100000000000005,"15min":0.54100000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76100000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.55800000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78500000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52200000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79800000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.70599999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65800000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.68100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71399999999999997,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.67900000000000005,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.68200000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":1.24,"15min":1.24},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.42399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64900000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.42799999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72999999999999998,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.497},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67300000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.67200000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.69699999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72299999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.502,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65300000000000002,"5min":0.877,"15min":0.877},"last":0.38300000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75600000000000001,"5min":1.284,"15min":1.284},"last":0.629}]},{"osd":7,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71999999999999997,"5min":0.746,"15min":0.746},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.38700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40400000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.317,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76400000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.746,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.47199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78300000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.433,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":1.022,"15min":1.022},"last":0.69099999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":1.002,"15min":1.002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71699999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":1.127,"15min":1.127},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80200000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77600000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.504},{"interface":"front","average":{"1min":0.629,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.747,"5min":1.079,"15min":1.079},"last":0.79300000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81000000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.629,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":1.093,"15min":1.093},"last":0.71199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.33400000000000002,"15min":0.34000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.49299999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.48399999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.313}]},{"osd":1,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.39700000000000002,"15min":0.40799999999999997},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.44600000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.41799999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.29199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.57699999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.312,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59499999999999997,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61599999999999999,"15min":0.627},"min":{"1min":0.36299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.752,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.622,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.65900000000000003,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80600000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.52400000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79400000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68500000000000005,"15min":0.69699999999999995},"min":{"1min":0.51000000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.752,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.77400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.36099999999999999,"15min":0.371},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.42399999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.36799999999999999,"15min":0.375},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.625,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.28799999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.373},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38200000000000001,"15min":0.38600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55500000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.5,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.443}]},{"osd":4,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65000000000000002,"15min":0.65800000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.79900000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86299999999999999,"5min":1.052,"15min":1.052},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.876,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.67400000000000004,"15min":0.68200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.71799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32700000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.46500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.435}]},{"osd":2,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40200000000000002,"15min":0.40400000000000003},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.58699999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.41499999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58399999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39000000000000001,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.38200000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60699999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":1.02,"15min":1.02},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89700000000000002,"5min":1.089,"15min":1.089},"last":0.64500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92600000000000005,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.754},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92400000000000004,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96699999999999997,"5min":1.153,"15min":1.153},"last":0.63100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1363968,"data_stored":945277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.35299999999999998,"15min":0.35599999999999998},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47099999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34699999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55200000000000005,"5min":0.629,"15min":0.629},"last":0.39000000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59499999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.48899999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.29599999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.28799999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.497,"5min":0.628,"15min":0.628},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65700000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.36599999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.45600000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.48399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77200000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.59699999999999998},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.80600000000000005,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.628}]},{"osd":6,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81999999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84099999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.622},"min":{"1min":0.47099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81699999999999995,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.495,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86499999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.56200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:26.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-11-04T01:38:26.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-11-04T01:38:26.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-11-04T01:38:26.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-11-04T01:38:26.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-11-04T01:38:26.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-11-04T01:38:26.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-11-04T01:38:26.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-11-04T01:38:26.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-11-04T01:38:26.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-11-04T01:38:26.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-11-04T01:38:26.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-11-04T01:38:26.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-11-04T01:38:26.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-11-04T01:38:26.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-11-04T01:38:26.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-11-04T01:38:26.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-11-04T01:38:26.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-11-04T01:38:26.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-11-04T01:38:26.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-11-04T01:38:26.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-11-04T01:38:26.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-11-04T01:38:26.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-11-04T01:38:26.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-11-04T01:38:26.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-11-04T01:38:26.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-11-04T01:38:26.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-11-04T01:38:26.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-11-04T01:38:26.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-11-04T01:38:26.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-11-04T01:38:26.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-11-04T01:38:26.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-11-04T01:38:26.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-11-04T01:38:26.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-11-04T01:38:26.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.763050+0000', 'last_change': '2023-11-04T01:38:20.763050+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.763050+0000', 'last_undegraded': '2023-11-04T01:38:20.763050+0000', 'last_fullsized': '2023-11-04T01:38:20.763050+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:38:26.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-11-04T01:38:26.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-11-04T01:38:26.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.766464+0000', 'last_change': '2023-11-04T01:38:20.766464+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.766464+0000', 'last_undegraded': '2023-11-04T01:38:20.766464+0000', 'last_fullsized': '2023-11-04T01:38:20.766464+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:38:26.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-11-04T01:38:26.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-11-04T01:38:26.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.768640+0000', 'last_change': '2023-11-04T01:38:20.768640+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.768640+0000', 'last_undegraded': '2023-11-04T01:38:20.768640+0000', 'last_fullsized': '2023-11-04T01:38:20.768640+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:38:26.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-11-04T01:38:26.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-11-04T01:38:26.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.769634+0000', 'last_change': '2023-11-04T01:38:20.769634+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.769634+0000', 'last_undegraded': '2023-11-04T01:38:20.769634+0000', 'last_fullsized': '2023-11-04T01:38:20.769634+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:38:26.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-11-04T01:38:26.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-11-04T01:38:26.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.769645+0000', 'last_change': '2023-11-04T01:38:20.769645+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.769645+0000', 'last_undegraded': '2023-11-04T01:38:20.769645+0000', 'last_fullsized': '2023-11-04T01:38:20.769645+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:38:26.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-11-04T01:38:26.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-11-04T01:38:26.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.765665+0000', 'last_change': '2023-11-04T01:38:20.765665+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.765665+0000', 'last_undegraded': '2023-11-04T01:38:20.765665+0000', 'last_fullsized': '2023-11-04T01:38:20.765665+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:38:26.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-11-04T01:38:26.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-11-04T01:38:26.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.765236+0000', 'last_change': '2023-11-04T01:38:20.765236+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.765236+0000', 'last_undegraded': '2023-11-04T01:38:20.765236+0000', 'last_fullsized': '2023-11-04T01:38:20.765236+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:38:26.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-11-04T01:38:26.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-11-04T01:38:26.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.763050+0000', 'last_change': '2023-11-04T01:38:20.763050+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.763050+0000', 'last_undegraded': '2023-11-04T01:38:20.763050+0000', 'last_fullsized': '2023-11-04T01:38:20.763050+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:38:26.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-11-04T01:38:26.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-11-04T01:38:26.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.763287+0000', 'last_change': '2023-11-04T01:38:20.763287+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.763287+0000', 'last_undegraded': '2023-11-04T01:38:20.763287+0000', 'last_fullsized': '2023-11-04T01:38:20.763287+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:38:26.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-11-04T01:38:26.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-11-04T01:38:26.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.769684+0000', 'last_change': '2023-11-04T01:38:20.769684+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.769684+0000', 'last_undegraded': '2023-11-04T01:38:20.769684+0000', 'last_fullsized': '2023-11-04T01:38:20.769684+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:38:26.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-11-04T01:38:26.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-11-04T01:38:26.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.765202+0000', 'last_change': '2023-11-04T01:38:20.765202+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.765202+0000', 'last_undegraded': '2023-11-04T01:38:20.765202+0000', 'last_fullsized': '2023-11-04T01:38:20.765202+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:38:26.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-11-04T01:38:26.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-11-04T01:38:26.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.765653+0000', 'last_change': '2023-11-04T01:38:20.765653+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.765653+0000', 'last_undegraded': '2023-11-04T01:38:20.765653+0000', 'last_fullsized': '2023-11-04T01:38:20.765653+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:38:26.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-11-04T01:38:26.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-11-04T01:38:26.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.766274+0000', 'last_change': '2023-11-04T01:38:20.766274+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.766274+0000', 'last_undegraded': '2023-11-04T01:38:20.766274+0000', 'last_fullsized': '2023-11-04T01:38:20.766274+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:38:26.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-11-04T01:38:26.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-11-04T01:38:26.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.763050+0000', 'last_change': '2023-11-04T01:38:20.763050+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.763050+0000', 'last_undegraded': '2023-11-04T01:38:20.763050+0000', 'last_fullsized': '2023-11-04T01:38:20.763050+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:38:26.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-11-04T01:38:26.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-11-04T01:38:26.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.766972+0000', 'last_change': '2023-11-04T01:38:20.766972+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.766972+0000', 'last_undegraded': '2023-11-04T01:38:20.766972+0000', 'last_fullsized': '2023-11-04T01:38:20.766972+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:38:26.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-11-04T01:38:26.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-11-04T01:38:26.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.765527+0000', 'last_change': '2023-11-04T01:38:20.765527+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.765527+0000', 'last_undegraded': '2023-11-04T01:38:20.765527+0000', 'last_fullsized': '2023-11-04T01:38:20.765527+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:38:26.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-11-04T01:38:26.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-11-04T01:38:26.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.766356+0000', 'last_change': '2023-11-04T01:38:20.766356+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.766356+0000', 'last_undegraded': '2023-11-04T01:38:20.766356+0000', 'last_fullsized': '2023-11-04T01:38:20.766356+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:38:26.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-11-04T01:38:26.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-11-04T01:38:26.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.763061+0000', 'last_change': '2023-11-04T01:38:20.763061+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.763061+0000', 'last_undegraded': '2023-11-04T01:38:20.763061+0000', 'last_fullsized': '2023-11-04T01:38:20.763061+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:38:26.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-11-04T01:38:26.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-11-04T01:38:26.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.769611+0000', 'last_change': '2023-11-04T01:38:20.769611+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.769611+0000', 'last_undegraded': '2023-11-04T01:38:20.769611+0000', 'last_fullsized': '2023-11-04T01:38:20.769611+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:38:26.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-11-04T01:38:26.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-11-04T01:38:26.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.763224+0000', 'last_change': '2023-11-04T01:38:20.763224+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.763224+0000', 'last_undegraded': '2023-11-04T01:38:20.763224+0000', 'last_fullsized': '2023-11-04T01:38:20.763224+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:38:26.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-11-04T01:38:26.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-11-04T01:38:26.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.767031+0000', 'last_change': '2023-11-04T01:38:20.767031+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.767031+0000', 'last_undegraded': '2023-11-04T01:38:20.767031+0000', 'last_fullsized': '2023-11-04T01:38:20.767031+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:38:26.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-11-04T01:38:26.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-11-04T01:38:26.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.763221+0000', 'last_change': '2023-11-04T01:38:20.763221+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.763221+0000', 'last_undegraded': '2023-11-04T01:38:20.763221+0000', 'last_fullsized': '2023-11-04T01:38:20.763221+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:38:26.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-11-04T01:38:26.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-11-04T01:38:26.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.766362+0000', 'last_change': '2023-11-04T01:38:20.766362+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.766362+0000', 'last_undegraded': '2023-11-04T01:38:20.766362+0000', 'last_fullsized': '2023-11-04T01:38:20.766362+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:38:26.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-11-04T01:38:26.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-11-04T01:38:26.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.766629+0000', 'last_change': '2023-11-04T01:38:20.766629+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.766629+0000', 'last_undegraded': '2023-11-04T01:38:20.766629+0000', 'last_fullsized': '2023-11-04T01:38:20.766629+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:38:26.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-11-04T01:38:26.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-11-04T01:38:26.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.766880+0000', 'last_change': '2023-11-04T01:38:20.766880+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.766880+0000', 'last_undegraded': '2023-11-04T01:38:20.766880+0000', 'last_fullsized': '2023-11-04T01:38:20.766880+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:38:26.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-11-04T01:38:26.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-11-04T01:38:26.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.766033+0000', 'last_change': '2023-11-04T01:38:20.766033+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.766033+0000', 'last_undegraded': '2023-11-04T01:38:20.766033+0000', 'last_fullsized': '2023-11-04T01:38:20.766033+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:38:26.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-11-04T01:38:26.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-11-04T01:38:26.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.768293+0000', 'last_change': '2023-11-04T01:38:20.768293+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.768293+0000', 'last_undegraded': '2023-11-04T01:38:20.768293+0000', 'last_fullsized': '2023-11-04T01:38:20.768293+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:38:26.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-11-04T01:38:26.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-11-04T01:38:26.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.765531+0000', 'last_change': '2023-11-04T01:38:20.765531+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.765531+0000', 'last_undegraded': '2023-11-04T01:38:20.765531+0000', 'last_fullsized': '2023-11-04T01:38:20.765531+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:38:26.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-11-04T01:38:26.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-11-04T01:38:26.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.766050+0000', 'last_change': '2023-11-04T01:38:20.766050+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.766050+0000', 'last_undegraded': '2023-11-04T01:38:20.766050+0000', 'last_fullsized': '2023-11-04T01:38:20.766050+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:38:26.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-11-04T01:38:26.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-11-04T01:38:26.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.763052+0000', 'last_change': '2023-11-04T01:38:20.763052+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.763052+0000', 'last_undegraded': '2023-11-04T01:38:20.763052+0000', 'last_fullsized': '2023-11-04T01:38:20.763052+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:38:26.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-11-04T01:38:26.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-11-04T01:38:26.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.768388+0000', 'last_change': '2023-11-04T01:38:20.768388+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.768388+0000', 'last_undegraded': '2023-11-04T01:38:20.768388+0000', 'last_fullsized': '2023-11-04T01:38:20.768388+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:38:26.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-11-04T01:38:26.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:38:21.759665+0000', 'last_change': '2023-11-04T01:38:21.759665+0000', 'last_active': '2023-11-04T01:38:21.759665+0000', 'last_peered': '2023-11-04T01:38:21.759665+0000', 'last_clean': '2023-11-04T01:38:21.759665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:21.759665+0000', 'last_undegraded': '2023-11-04T01:38:21.759665+0000', 'last_fullsized': '2023-11-04T01:38:21.759665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:21.759665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:38:26.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-11-04T01:38:26.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:38:20.765700+0000', 'last_change': '2023-11-04T01:38:20.765700+0000', 'last_active': '2023-11-04T01:38:20.755236+0000', 'last_peered': '2023-11-04T01:38:20.755236+0000', 'last_clean': '2023-11-04T01:38:20.755236+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:38:20.765700+0000', 'last_undegraded': '2023-11-04T01:38:20.765700+0000', 'last_fullsized': '2023-11-04T01:38:20.765700+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'last_clean_scrub_stamp': '2023-11-04T01:38:20.755236+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:38:26.522 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-04T01:38:26.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.641+0000 7f8d9d98e640 1 Processor -- start 2023-11-04T01:38:26.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.641+0000 7f8d9d98e640 1 -- start start 2023-11-04T01:38:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.642+0000 7f8d9d98e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8d980b2d10 0x7f8d98165820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.642+0000 7f8d9d98e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d980b3c10 con 0x7f8d980cec10 2023-11-04T01:38:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.642+0000 7f8d9d98e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d980cf180 con 0x7f8d9815ac70 2023-11-04T01:38:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.642+0000 7f8d9d98e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d980cf460 con 0x7f8d980b2d10 2023-11-04T01:38:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.642+0000 7f8d977fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8d980b2d10 0x7f8d98165820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.642+0000 7f8d967fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8d980cec10 0x7f8d980b2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50442/0 (socket says 172.21.15.44:50442) 2023-11-04T01:38:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.642+0000 7f8d967fc640 1 -- 172.21.15.44:0/2985351101 learned_addr learned my addr 172.21.15.44:0/2985351101 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.643+0000 7f8d95ffb640 1 -- 172.21.15.44:0/2985351101 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108819414 0 0) 0x7f8d980b3c10 con 0x7f8d980cec10 2023-11-04T01:38:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.643+0000 7f8d95ffb640 1 -- 172.21.15.44:0/2985351101 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d84003520 con 0x7f8d980cec10 2023-11-04T01:38:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.643+0000 7f8d977fe640 1 -- 172.21.15.44:0/2985351101 >> v1:172.21.15.204:6789/0 conn(0x7f8d9815ac70 legacy=0x7f8d980d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.643+0000 7f8d977fe640 1 -- 172.21.15.44:0/2985351101 >> v1:172.21.15.44:6789/0 conn(0x7f8d980cec10 legacy=0x7f8d980b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.643+0000 7f8d977fe640 1 -- 172.21.15.44:0/2985351101 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d980cf740 con 0x7f8d980b2d10 2023-11-04T01:38:26.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.643+0000 7f8d977fe640 1 --2- 172.21.15.44:0/2985351101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d980b2d10 0x7f8d98165820 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f8d88009d90 tx=0x7f8d8802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1264f6dcfd4a79 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:26.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.644+0000 7f8d95ffb640 1 -- 172.21.15.44:0/2985351101 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8802cd00 con 0x7f8d980b2d10 2023-11-04T01:38:26.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.644+0000 7f8d95ffb640 1 -- 172.21.15.44:0/2985351101 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8802ce60 con 0x7f8d980b2d10 2023-11-04T01:38:26.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.644+0000 7f8d95ffb640 1 -- 172.21.15.44:0/2985351101 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d88034660 con 0x7f8d980b2d10 2023-11-04T01:38:26.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.644+0000 7f8d9d98e640 1 -- 172.21.15.44:0/2985351101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d980b2d10 msgr2=0x7f8d98165820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.644+0000 7f8d9d98e640 1 --2- 172.21.15.44:0/2985351101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d980b2d10 0x7f8d98165820 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f8d88009d90 tx=0x7f8d8802bf50 comp rx=0 tx=0).stop 2023-11-04T01:38:26.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.644+0000 7f8d9d98e640 1 -- 172.21.15.44:0/2985351101 shutdown_connections 2023-11-04T01:38:26.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.644+0000 7f8d9d98e640 1 --2- 172.21.15.44:0/2985351101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d980b2d10 0x7f8d98165820 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.644+0000 7f8d9d98e640 1 -- 172.21.15.44:0/2985351101 >> 172.21.15.44:0/2985351101 conn(0x7f8d980cd600 msgr2=0x7f8d980cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:26.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.644+0000 7f8d9d98e640 1 -- 172.21.15.44:0/2985351101 shutdown_connections 2023-11-04T01:38:26.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.644+0000 7f8d9d98e640 1 -- 172.21.15.44:0/2985351101 wait complete. 2023-11-04T01:38:26.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.645+0000 7f8d9d98e640 1 Processor -- start 2023-11-04T01:38:26.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.645+0000 7f8d9d98e640 1 -- start start 2023-11-04T01:38:26.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.646+0000 7f8d9d98e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d980b2d10 0x7f8d981530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.646+0000 7f8d9d98e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d980cec10 0x7f8d9814e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.646+0000 7f8d9d98e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d9815ac70 0x7f8d980c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.646+0000 7f8d9d98e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d98153630 con 0x7f8d980b2d10 2023-11-04T01:38:26.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.646+0000 7f8d9d98e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d98155b10 con 0x7f8d9815ac70 2023-11-04T01:38:26.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.646+0000 7f8d9d98e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d98155df0 con 0x7f8d980cec10 2023-11-04T01:38:26.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.646+0000 7f8d96ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d980b2d10 0x7f8d981530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.646+0000 7f8d96ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d980b2d10 0x7f8d981530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44710/0 (socket says 172.21.15.44:44710) 2023-11-04T01:38:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.646+0000 7f8d96ffd640 1 -- 172.21.15.44:0/578931993 learned_addr learned my addr 172.21.15.44:0/578931993 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.646+0000 7f8d977fe640 1 --2- 172.21.15.44:0/578931993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d9815ac70 0x7f8d980c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.646+0000 7f8d967fc640 1 --2- 172.21.15.44:0/578931993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d980cec10 0x7f8d9814e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.647+0000 7f8d96ffd640 1 -- 172.21.15.44:0/578931993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d980cec10 msgr2=0x7f8d9814e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.647+0000 7f8d96ffd640 1 --2- 172.21.15.44:0/578931993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d980cec10 0x7f8d9814e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.647+0000 7f8d96ffd640 1 -- 172.21.15.44:0/578931993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d9815ac70 msgr2=0x7f8d980c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.647+0000 7f8d96ffd640 1 --2- 172.21.15.44:0/578931993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d9815ac70 0x7f8d980c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.647+0000 7f8d96ffd640 1 -- 172.21.15.44:0/578931993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88009a70 con 0x7f8d980b2d10 2023-11-04T01:38:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.647+0000 7f8d977fe640 1 --2- 172.21.15.44:0/578931993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d9815ac70 0x7f8d980c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.647+0000 7f8d96ffd640 1 --2- 172.21.15.44:0/578931993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d980b2d10 0x7f8d981530f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000c3a0 tx=0x7f8d9000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.647+0000 7f8d8ffff640 1 -- 172.21.15.44:0/578931993 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d900052d0 con 0x7f8d980b2d10 2023-11-04T01:38:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.647+0000 7f8d8ffff640 1 -- 172.21.15.44:0/578931993 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d90005450 con 0x7f8d980b2d10 2023-11-04T01:38:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.647+0000 7f8d8ffff640 1 -- 172.21.15.44:0/578931993 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90003880 con 0x7f8d980b2d10 2023-11-04T01:38:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.647+0000 7f8d9d98e640 1 -- 172.21.15.44:0/578931993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d981560d0 con 0x7f8d980b2d10 2023-11-04T01:38:26.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.647+0000 7f8d9d98e640 1 -- 172.21.15.44:0/578931993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9814f3b0 con 0x7f8d980b2d10 2023-11-04T01:38:26.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.648+0000 7f8d9d98e640 1 -- 172.21.15.44:0/578931993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9815b500 con 0x7f8d980b2d10 2023-11-04T01:38:26.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.648+0000 7f8d8ffff640 1 -- 172.21.15.44:0/578931993 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d900039e0 con 0x7f8d980b2d10 2023-11-04T01:38:26.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.649+0000 7f8d8ffff640 1 --2- 172.21.15.44:0/578931993 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8d7806ae70 0x7f8d7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.649+0000 7f8d8ffff640 1 -- 172.21.15.44:0/578931993 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8d90088f30 con 0x7f8d980b2d10 2023-11-04T01:38:26.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.649+0000 7f8d967fc640 1 --2- 172.21.15.44:0/578931993 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8d7806ae70 0x7f8d7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.650+0000 7f8d967fc640 1 --2- 172.21.15.44:0/578931993 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8d7806ae70 0x7f8d7806d330 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8d9814f640 tx=0x7f8d80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:26.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.653+0000 7f8d8ffff640 1 -- 172.21.15.44:0/578931993 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d90053ca0 con 0x7f8d980b2d10 2023-11-04T01:38:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.898+0000 7f8d9d98e640 1 -- 172.21.15.44:0/578931993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8d980b6b00 con 0x7f8d980b2d10 2023-11-04T01:38:26.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.898+0000 7f8d8ffff640 1 -- 172.21.15.44:0/578931993 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1319 (secure 0 0 0) 0x7f8d90017540 con 0x7f8d980b2d10 2023-11-04T01:38:26.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:26.900 INFO:teuthology.orchestra.run.smithi044.stdout:{"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","health":{"status":"HEALTH_WARN","checks":{"POOL_APP_NOT_ENABLED":{"severity":"HEALTH_WARN","summary":{"message":"1 pool(s) do not have an application enabled","count":1},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":172,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":67,"num_osds":8,"num_up_osds":8,"osd_up_since":1699061745,"num_in_osds":8,"osd_in_since":1699061736,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":98},{"state_name":"unknown","count":24},{"state_name":"creating+peering","count":7}],"num_pgs":129,"num_pools":4,"num_objects":19,"data_bytes":592106,"bytes_used":233205760,"bytes_avail":772860907520,"bytes_total":773094113280,"unknown_pgs_ratio":0.18604651093482971,"inactive_pgs_ratio":0.054263565689325333,"write_bytes_sec":2100,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":31,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6411}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-04T01:37:04.589410+0000","services":{}},"progress_events":{}} 2023-11-04T01:38:26.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.900+0000 7f8d9d98e640 1 -- 172.21.15.44:0/578931993 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8d7806ae70 msgr2=0x7f8d7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.900+0000 7f8d9d98e640 1 --2- 172.21.15.44:0/578931993 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8d7806ae70 0x7f8d7806d330 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8d9814f640 tx=0x7f8d80009040 comp rx=0 tx=0).stop 2023-11-04T01:38:26.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.900+0000 7f8d9d98e640 1 -- 172.21.15.44:0/578931993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d980b2d10 msgr2=0x7f8d981530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.900+0000 7f8d9d98e640 1 --2- 172.21.15.44:0/578931993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d980b2d10 0x7f8d981530f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000c3a0 tx=0x7f8d9000c860 comp rx=0 tx=0).stop 2023-11-04T01:38:26.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.900+0000 7f8d9d98e640 1 -- 172.21.15.44:0/578931993 shutdown_connections 2023-11-04T01:38:26.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.900+0000 7f8d9d98e640 1 --2- 172.21.15.44:0/578931993 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8d7806ae70 0x7f8d7806d330 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.900+0000 7f8d9d98e640 1 --2- 172.21.15.44:0/578931993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d9815ac70 0x7f8d980c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.900+0000 7f8d9d98e640 1 --2- 172.21.15.44:0/578931993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d980cec10 0x7f8d9814e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.900+0000 7f8d9d98e640 1 --2- 172.21.15.44:0/578931993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d980b2d10 0x7f8d981530f0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.900+0000 7f8d9d98e640 1 -- 172.21.15.44:0/578931993 >> 172.21.15.44:0/578931993 conn(0x7f8d980cd600 msgr2=0x7f8d980c7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:26.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.900+0000 7f8d9d98e640 1 -- 172.21.15.44:0/578931993 shutdown_connections 2023-11-04T01:38:26.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:26.900+0000 7f8d9d98e640 1 -- 172.21.15.44:0/578931993 wait complete. 2023-11-04T01:38:26.913 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-04T01:38:26.913 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:27.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.016+0000 7fe08731d640 1 Processor -- start 2023-11-04T01:38:27.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.017+0000 7fe08731d640 1 -- start start 2023-11-04T01:38:27.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.017+0000 7fe08731d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe080160b10 0x7fe080160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.017+0000 7fe08731d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe0800cf160 0x7fe0800cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.017+0000 7fe08731d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08006bf00 con 0x7fe08015ce60 2023-11-04T01:38:27.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.017+0000 7fe08731d640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0800cbde0 con 0x7fe080160b10 2023-11-04T01:38:27.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.017+0000 7fe08731d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0800cfb30 con 0x7fe0800cf160 2023-11-04T01:38:27.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.018+0000 7fe0848b8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe080160b10 0x7fe080160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.018+0000 7fe0848b8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe080160b10 0x7fe080160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44718/0 (socket says 172.21.15.44:44718) 2023-11-04T01:38:27.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.018+0000 7fe0848b8640 1 -- 172.21.15.44:0/1490847636 learned_addr learned my addr 172.21.15.44:0/1490847636 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:27.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.018+0000 7fe0858ba640 1 --2- 172.21.15.44:0/1490847636 >> v2:172.21.15.204:3300/0 conn(0x7fe0800cf160 0x7fe0800cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.018+0000 7fe0848b8640 1 -- 172.21.15.44:0/1490847636 >> v2:172.21.15.204:3300/0 conn(0x7fe0800cf160 msgr2=0x7fe0800cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:27.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.018+0000 7fe0848b8640 1 --2- 172.21.15.44:0/1490847636 >> v2:172.21.15.204:3300/0 conn(0x7fe0800cf160 0x7fe0800cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.018+0000 7fe0848b8640 1 -- 172.21.15.44:0/1490847636 >> v1:172.21.15.204:6789/0 conn(0x7fe08015ce60 legacy=0x7fe08006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:27.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.018+0000 7fe0848b8640 1 -- 172.21.15.44:0/1490847636 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0801615d0 con 0x7fe080160b10 2023-11-04T01:38:27.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.018+0000 7fe0858ba640 1 --2- 172.21.15.44:0/1490847636 >> v2:172.21.15.204:3300/0 conn(0x7fe0800cf160 0x7fe0800cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:27.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.019+0000 7fe0848b8640 1 --2- 172.21.15.44:0/1490847636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe080160b10 0x7fe080160f90 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe0801614d0 tx=0x7fe07002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba54a5912d6bc2a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:27.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.019+0000 7fe077fff640 1 -- 172.21.15.44:0/1490847636 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070031870 con 0x7fe080160b10 2023-11-04T01:38:27.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.019+0000 7fe077fff640 1 -- 172.21.15.44:0/1490847636 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0700319d0 con 0x7fe080160b10 2023-11-04T01:38:27.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.019+0000 7fe077fff640 1 -- 172.21.15.44:0/1490847636 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070031d60 con 0x7fe080160b10 2023-11-04T01:38:27.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.019+0000 7fe08731d640 1 -- 172.21.15.44:0/1490847636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe080160b10 msgr2=0x7fe080160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.019+0000 7fe08731d640 1 --2- 172.21.15.44:0/1490847636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe080160b10 0x7fe080160f90 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe0801614d0 tx=0x7fe07002b910 comp rx=0 tx=0).stop 2023-11-04T01:38:27.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.019+0000 7fe08731d640 1 -- 172.21.15.44:0/1490847636 shutdown_connections 2023-11-04T01:38:27.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.019+0000 7fe08731d640 1 --2- 172.21.15.44:0/1490847636 >> v2:172.21.15.204:3300/0 conn(0x7fe0800cf160 0x7fe0800cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.019+0000 7fe08731d640 1 --2- 172.21.15.44:0/1490847636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe080160b10 0x7fe080160f90 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.019+0000 7fe08731d640 1 -- 172.21.15.44:0/1490847636 >> 172.21.15.44:0/1490847636 conn(0x7fe08006ea90 msgr2=0x7fe08006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:27.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.019+0000 7fe08731d640 1 -- 172.21.15.44:0/1490847636 shutdown_connections 2023-11-04T01:38:27.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.019+0000 7fe08731d640 1 -- 172.21.15.44:0/1490847636 wait complete. 2023-11-04T01:38:27.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.020+0000 7fe08731d640 1 Processor -- start 2023-11-04T01:38:27.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.021+0000 7fe08731d640 1 -- start start 2023-11-04T01:38:27.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.021+0000 7fe08731d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0800cf160 0x7fe08015f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.021+0000 7fe08731d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08015ce60 0x7fe08014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.021+0000 7fe08731d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe080160b10 0x7fe0800b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.021+0000 7fe08731d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800c8d10 con 0x7fe08015ce60 2023-11-04T01:38:27.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.021+0000 7fe08731d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800c8100 con 0x7fe080160b10 2023-11-04T01:38:27.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.021+0000 7fe08731d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800c83e0 con 0x7fe0800cf160 2023-11-04T01:38:27.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.021+0000 7fe0848b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08015ce60 0x7fe08014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.021+0000 7fe0848b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08015ce60 0x7fe08014efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44730/0 (socket says 172.21.15.44:44730) 2023-11-04T01:38:27.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.021+0000 7fe0848b8640 1 -- 172.21.15.44:0/2939150857 learned_addr learned my addr 172.21.15.44:0/2939150857 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:27.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.022+0000 7fe0850b9640 1 --2- 172.21.15.44:0/2939150857 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0800cf160 0x7fe08015f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.022+0000 7fe0858ba640 1 --2- 172.21.15.44:0/2939150857 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe080160b10 0x7fe0800b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.022+0000 7fe0848b8640 1 -- 172.21.15.44:0/2939150857 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0800cf160 msgr2=0x7fe08015f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.022+0000 7fe0848b8640 1 --2- 172.21.15.44:0/2939150857 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0800cf160 0x7fe08015f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.022+0000 7fe0848b8640 1 -- 172.21.15.44:0/2939150857 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe080160b10 msgr2=0x7fe0800b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.022+0000 7fe0848b8640 1 --2- 172.21.15.44:0/2939150857 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe080160b10 0x7fe0800b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.022+0000 7fe0848b8640 1 -- 172.21.15.44:0/2939150857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0700094d0 con 0x7fe08015ce60 2023-11-04T01:38:27.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.022+0000 7fe0858ba640 1 --2- 172.21.15.44:0/2939150857 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe080160b10 0x7fe0800b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:27.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.022+0000 7fe0848b8640 1 --2- 172.21.15.44:0/2939150857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08015ce60 0x7fe08014efb0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe070000c00 tx=0x7fe0700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:27.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.022+0000 7fe075ffb640 1 -- 172.21.15.44:0/2939150857 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070031840 con 0x7fe08015ce60 2023-11-04T01:38:27.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.022+0000 7fe075ffb640 1 -- 172.21.15.44:0/2939150857 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0700443f0 con 0x7fe08015ce60 2023-11-04T01:38:27.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.022+0000 7fe08731d640 1 -- 172.21.15.44:0/2939150857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0800c86c0 con 0x7fe08015ce60 2023-11-04T01:38:27.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.022+0000 7fe075ffb640 1 -- 172.21.15.44:0/2939150857 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0700447a0 con 0x7fe08015ce60 2023-11-04T01:38:27.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.022+0000 7fe08731d640 1 -- 172.21.15.44:0/2939150857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08014f4f0 con 0x7fe08015ce60 2023-11-04T01:38:27.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.023+0000 7fe08731d640 1 -- 172.21.15.44:0/2939150857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0800ce950 con 0x7fe08015ce60 2023-11-04T01:38:27.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.024+0000 7fe075ffb640 1 -- 172.21.15.44:0/2939150857 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe07004d450 con 0x7fe08015ce60 2023-11-04T01:38:27.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.024+0000 7fe075ffb640 1 --2- 172.21.15.44:0/2939150857 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe06406aea0 0x7fe06406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.024+0000 7fe075ffb640 1 -- 172.21.15.44:0/2939150857 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe07002d040 con 0x7fe08015ce60 2023-11-04T01:38:27.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.024+0000 7fe0850b9640 1 --2- 172.21.15.44:0/2939150857 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe06406aea0 0x7fe06406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.025+0000 7fe0850b9640 1 --2- 172.21.15.44:0/2939150857 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe06406aea0 0x7fe06406d360 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe07c006fd0 tx=0x7fe07c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:27.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.028+0000 7fe075ffb640 1 -- 172.21.15.44:0/2939150857 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe0800ce950 con 0x7fe08015ce60 2023-11-04T01:38:27.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.200+0000 7fe08731d640 1 -- 172.21.15.44:0/2939150857 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0800cba00 con 0x7fe06406aea0 2023-11-04T01:38:27.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.210+0000 7fe075ffb640 1 -- 172.21.15.44:0/2939150857 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+366694 (secure 0 0 0) 0x7fe07c00be30 con 0x7fe06406aea0 2023-11-04T01:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:27.218 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:38:27.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.214+0000 7fe08731d640 1 -- 172.21.15.44:0/2939150857 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe06406aea0 msgr2=0x7fe06406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.214+0000 7fe08731d640 1 --2- 172.21.15.44:0/2939150857 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe06406aea0 0x7fe06406d360 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe07c006fd0 tx=0x7fe07c008040 comp rx=0 tx=0).stop 2023-11-04T01:38:27.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.214+0000 7fe08731d640 1 -- 172.21.15.44:0/2939150857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08015ce60 msgr2=0x7fe08014efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.214+0000 7fe08731d640 1 --2- 172.21.15.44:0/2939150857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08015ce60 0x7fe08014efb0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe070000c00 tx=0x7fe0700046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.214+0000 7fe08731d640 1 -- 172.21.15.44:0/2939150857 shutdown_connections 2023-11-04T01:38:27.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.214+0000 7fe08731d640 1 --2- 172.21.15.44:0/2939150857 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe06406aea0 0x7fe06406d360 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.214+0000 7fe08731d640 1 --2- 172.21.15.44:0/2939150857 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe080160b10 0x7fe0800b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.214+0000 7fe08731d640 1 --2- 172.21.15.44:0/2939150857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08015ce60 0x7fe08014efb0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.214+0000 7fe08731d640 1 --2- 172.21.15.44:0/2939150857 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0800cf160 0x7fe08015f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.214+0000 7fe08731d640 1 -- 172.21.15.44:0/2939150857 >> 172.21.15.44:0/2939150857 conn(0x7fe08006ea90 msgr2=0x7fe0800c46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:27.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.214+0000 7fe08731d640 1 -- 172.21.15.44:0/2939150857 shutdown_connections 2023-11-04T01:38:27.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:27.214+0000 7fe08731d640 1 -- 172.21.15.44:0/2939150857 wait complete. 2023-11-04T01:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2023-11-04T01:38:26.610403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592106,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":197,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227740,"kb_used_data":7420,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746980,"statfs":{"total":773094113280,"available":772860907520,"internally_reserved":0,"allocated":7598080,"data_stored":4131588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1738,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.849086"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.833197+0000","last_change":"2023-11-04T01:38:22.799223+0000","last_active":"2023-11-04T01:38:23.833197+0000","last_peered":"2023-11-04T01:38:23.833197+0000","last_clean":"2023-11-04T01:38:23.833197+0000","last_became_active":"2023-11-04T01:38:22.798420+0000","last_became_peered":"2023-11-04T01:38:22.798420+0000","last_unstale":"2023-11-04T01:38:23.833197+0000","last_undegraded":"2023-11-04T01:38:23.833197+0000","last_fullsized":"2023-11-04T01:38:23.833197+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:06.145374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.777164+0000","last_change":"2023-11-04T01:38:22.801287+0000","last_active":"2023-11-04T01:38:23.777164+0000","last_peered":"2023-11-04T01:38:23.777164+0000","last_clean":"2023-11-04T01:38:23.777164+0000","last_became_active":"2023-11-04T01:38:22.800922+0000","last_became_peered":"2023-11-04T01:38:22.800922+0000","last_unstale":"2023-11-04T01:38:23.777164+0000","last_undegraded":"2023-11-04T01:38:23.777164+0000","last_fullsized":"2023-11-04T01:38:23.777164+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:54.814643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.779698+0000","last_change":"2023-11-04T01:38:22.794842+0000","last_active":"2023-11-04T01:38:23.779698+0000","last_peered":"2023-11-04T01:38:23.779698+0000","last_clean":"2023-11-04T01:38:23.779698+0000","last_became_active":"2023-11-04T01:38:22.794570+0000","last_became_peered":"2023-11-04T01:38:22.794570+0000","last_unstale":"2023-11-04T01:38:23.779698+0000","last_undegraded":"2023-11-04T01:38:23.779698+0000","last_fullsized":"2023-11-04T01:38:23.779698+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:46.851802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.832813+0000","last_change":"2023-11-04T01:38:22.799886+0000","last_active":"2023-11-04T01:38:23.832813+0000","last_peered":"2023-11-04T01:38:23.832813+0000","last_clean":"2023-11-04T01:38:23.832813+0000","last_became_active":"2023-11-04T01:38:22.798575+0000","last_became_peered":"2023-11-04T01:38:22.798575+0000","last_unstale":"2023-11-04T01:38:23.832813+0000","last_undegraded":"2023-11-04T01:38:23.832813+0000","last_fullsized":"2023-11-04T01:38:23.832813+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:34.192249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830703+0000","last_change":"2023-11-04T01:38:22.796428+0000","last_active":"2023-11-04T01:38:23.830703+0000","last_peered":"2023-11-04T01:38:23.830703+0000","last_clean":"2023-11-04T01:38:23.830703+0000","last_became_active":"2023-11-04T01:38:22.796146+0000","last_became_peered":"2023-11-04T01:38:22.796146+0000","last_unstale":"2023-11-04T01:38:23.830703+0000","last_undegraded":"2023-11-04T01:38:23.830703+0000","last_fullsized":"2023-11-04T01:38:23.830703+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:59:42.554311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.833129+0000","last_change":"2023-11-04T01:38:22.800467+0000","last_active":"2023-11-04T01:38:23.833129+0000","last_peered":"2023-11-04T01:38:23.833129+0000","last_clean":"2023-11-04T01:38:23.833129+0000","last_became_active":"2023-11-04T01:38:22.799382+0000","last_became_peered":"2023-11-04T01:38:22.799382+0000","last_unstale":"2023-11-04T01:38:23.833129+0000","last_undegraded":"2023-11-04T01:38:23.833129+0000","last_fullsized":"2023-11-04T01:38:23.833129+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:54.808985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.780177+0000","last_change":"2023-11-04T01:38:22.798980+0000","last_active":"2023-11-04T01:38:23.780177+0000","last_peered":"2023-11-04T01:38:23.780177+0000","last_clean":"2023-11-04T01:38:23.780177+0000","last_became_active":"2023-11-04T01:38:22.798365+0000","last_became_peered":"2023-11-04T01:38:22.798365+0000","last_unstale":"2023-11-04T01:38:23.780177+0000","last_undegraded":"2023-11-04T01:38:23.780177+0000","last_fullsized":"2023-11-04T01:38:23.780177+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:32:06.736713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.783121+0000","last_change":"2023-11-04T01:38:22.802210+0000","last_active":"2023-11-04T01:38:23.783121+0000","last_peered":"2023-11-04T01:38:23.783121+0000","last_clean":"2023-11-04T01:38:23.783121+0000","last_became_active":"2023-11-04T01:38:22.800475+0000","last_became_peered":"2023-11-04T01:38:22.800475+0000","last_unstale":"2023-11-04T01:38:23.783121+0000","last_undegraded":"2023-11-04T01:38:23.783121+0000","last_fullsized":"2023-11-04T01:38:23.783121+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:22:52.435471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.777302+0000","last_change":"2023-11-04T01:38:22.802013+0000","last_active":"2023-11-04T01:38:23.777302+0000","last_peered":"2023-11-04T01:38:23.777302+0000","last_clean":"2023-11-04T01:38:23.777302+0000","last_became_active":"2023-11-04T01:38:22.801676+0000","last_became_peered":"2023-11-04T01:38:22.801676+0000","last_unstale":"2023-11-04T01:38:23.777302+0000","last_undegraded":"2023-11-04T01:38:23.777302+0000","last_fullsized":"2023-11-04T01:38:23.777302+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:32.238785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.779775+0000","last_change":"2023-11-04T01:38:22.799716+0000","last_active":"2023-11-04T01:38:23.779775+0000","last_peered":"2023-11-04T01:38:23.779775+0000","last_clean":"2023-11-04T01:38:23.779775+0000","last_became_active":"2023-11-04T01:38:22.799417+0000","last_became_peered":"2023-11-04T01:38:22.799417+0000","last_unstale":"2023-11-04T01:38:23.779775+0000","last_undegraded":"2023-11-04T01:38:23.779775+0000","last_fullsized":"2023-11-04T01:38:23.779775+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:56:09.033790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.782606+0000","last_change":"2023-11-04T01:38:22.798241+0000","last_active":"2023-11-04T01:38:23.782606+0000","last_peered":"2023-11-04T01:38:23.782606+0000","last_clean":"2023-11-04T01:38:23.782606+0000","last_became_active":"2023-11-04T01:38:22.797963+0000","last_became_peered":"2023-11-04T01:38:22.797963+0000","last_unstale":"2023-11-04T01:38:23.782606+0000","last_undegraded":"2023-11-04T01:38:23.782606+0000","last_fullsized":"2023-11-04T01:38:23.782606+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:26.831190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.780282+0000","last_change":"2023-11-04T01:38:22.798808+0000","last_active":"2023-11-04T01:38:23.780282+0000","last_peered":"2023-11-04T01:38:23.780282+0000","last_clean":"2023-11-04T01:38:23.780282+0000","last_became_active":"2023-11-04T01:38:22.798009+0000","last_became_peered":"2023-11-04T01:38:22.798009+0000","last_unstale":"2023-11-04T01:38:23.780282+0000","last_undegraded":"2023-11-04T01:38:23.780282+0000","last_fullsized":"2023-11-04T01:38:23.780282+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:03:42.376421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.777267+0000","last_change":"2023-11-04T01:38:22.801359+0000","last_active":"2023-11-04T01:38:23.777267+0000","last_peered":"2023-11-04T01:38:23.777267+0000","last_clean":"2023-11-04T01:38:23.777267+0000","last_became_active":"2023-11-04T01:38:22.800916+0000","last_became_peered":"2023-11-04T01:38:22.800916+0000","last_unstale":"2023-11-04T01:38:23.777267+0000","last_undegraded":"2023-11-04T01:38:23.777267+0000","last_fullsized":"2023-11-04T01:38:23.777267+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:59.935299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.832866+0000","last_change":"2023-11-04T01:38:22.793003+0000","last_active":"2023-11-04T01:38:23.832866+0000","last_peered":"2023-11-04T01:38:23.832866+0000","last_clean":"2023-11-04T01:38:23.832866+0000","last_became_active":"2023-11-04T01:38:22.792725+0000","last_became_peered":"2023-11-04T01:38:22.792725+0000","last_unstale":"2023-11-04T01:38:23.832866+0000","last_undegraded":"2023-11-04T01:38:23.832866+0000","last_fullsized":"2023-11-04T01:38:23.832866+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:22:52.435471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.782875+0000","last_change":"2023-11-04T01:38:22.784407+0000","last_active":"2023-11-04T01:38:23.782875+0000","last_peered":"2023-11-04T01:38:23.782875+0000","last_clean":"2023-11-04T01:38:23.782875+0000","last_became_active":"2023-11-04T01:38:22.784103+0000","last_became_peered":"2023-11-04T01:38:22.784103+0000","last_unstale":"2023-11-04T01:38:23.782875+0000","last_undegraded":"2023-11-04T01:38:23.782875+0000","last_fullsized":"2023-11-04T01:38:23.782875+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:03.403805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.782769+0000","last_change":"2023-11-04T01:38:22.801810+0000","last_active":"2023-11-04T01:38:23.782769+0000","last_peered":"2023-11-04T01:38:23.782769+0000","last_clean":"2023-11-04T01:38:23.782769+0000","last_became_active":"2023-11-04T01:38:22.800796+0000","last_became_peered":"2023-11-04T01:38:22.800796+0000","last_unstale":"2023-11-04T01:38:23.782769+0000","last_undegraded":"2023-11-04T01:38:23.782769+0000","last_fullsized":"2023-11-04T01:38:23.782769+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:47:57.330922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.783213+0000","last_change":"2023-11-04T01:38:22.794465+0000","last_active":"2023-11-04T01:38:23.783213+0000","last_peered":"2023-11-04T01:38:23.783213+0000","last_clean":"2023-11-04T01:38:23.783213+0000","last_became_active":"2023-11-04T01:38:22.793800+0000","last_became_peered":"2023-11-04T01:38:22.793800+0000","last_unstale":"2023-11-04T01:38:23.783213+0000","last_undegraded":"2023-11-04T01:38:23.783213+0000","last_fullsized":"2023-11-04T01:38:23.783213+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:54.808985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830492+0000","last_change":"2023-11-04T01:38:22.798262+0000","last_active":"2023-11-04T01:38:23.830492+0000","last_peered":"2023-11-04T01:38:23.830492+0000","last_clean":"2023-11-04T01:38:23.830492+0000","last_became_active":"2023-11-04T01:38:22.798017+0000","last_became_peered":"2023-11-04T01:38:22.798017+0000","last_unstale":"2023-11-04T01:38:23.830492+0000","last_undegraded":"2023-11-04T01:38:23.830492+0000","last_fullsized":"2023-11-04T01:38:23.830492+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:12.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.782962+0000","last_change":"2023-11-04T01:38:22.801331+0000","last_active":"2023-11-04T01:38:23.782962+0000","last_peered":"2023-11-04T01:38:23.782962+0000","last_clean":"2023-11-04T01:38:23.782962+0000","last_became_active":"2023-11-04T01:38:22.801062+0000","last_became_peered":"2023-11-04T01:38:22.801062+0000","last_unstale":"2023-11-04T01:38:23.782962+0000","last_undegraded":"2023-11-04T01:38:23.782962+0000","last_fullsized":"2023-11-04T01:38:23.782962+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:34.192249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830241+0000","last_change":"2023-11-04T01:38:22.800816+0000","last_active":"2023-11-04T01:38:23.830241+0000","last_peered":"2023-11-04T01:38:23.830241+0000","last_clean":"2023-11-04T01:38:23.830241+0000","last_became_active":"2023-11-04T01:38:22.800553+0000","last_became_peered":"2023-11-04T01:38:22.800553+0000","last_unstale":"2023-11-04T01:38:23.830241+0000","last_undegraded":"2023-11-04T01:38:23.830241+0000","last_fullsized":"2023-11-04T01:38:23.830241+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:01:35.402167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830514+0000","last_change":"2023-11-04T01:38:22.805387+0000","last_active":"2023-11-04T01:38:23.830514+0000","last_peered":"2023-11-04T01:38:23.830514+0000","last_clean":"2023-11-04T01:38:23.830514+0000","last_became_active":"2023-11-04T01:38:22.804944+0000","last_became_peered":"2023-11-04T01:38:22.804944+0000","last_unstale":"2023-11-04T01:38:23.830514+0000","last_undegraded":"2023-11-04T01:38:23.830514+0000","last_fullsized":"2023-11-04T01:38:23.830514+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:19.630813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.832680+0000","last_change":"2023-11-04T01:38:22.797088+0000","last_active":"2023-11-04T01:38:23.832680+0000","last_peered":"2023-11-04T01:38:23.832680+0000","last_clean":"2023-11-04T01:38:23.832680+0000","last_became_active":"2023-11-04T01:38:22.796658+0000","last_became_peered":"2023-11-04T01:38:22.796658+0000","last_unstale":"2023-11-04T01:38:23.832680+0000","last_undegraded":"2023-11-04T01:38:23.832680+0000","last_fullsized":"2023-11-04T01:38:23.832680+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:03.403805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.779695+0000","last_change":"2023-11-04T01:38:22.792052+0000","last_active":"2023-11-04T01:38:23.779695+0000","last_peered":"2023-11-04T01:38:23.779695+0000","last_clean":"2023-11-04T01:38:23.779695+0000","last_became_active":"2023-11-04T01:38:22.791766+0000","last_became_peered":"2023-11-04T01:38:22.791766+0000","last_unstale":"2023-11-04T01:38:23.779695+0000","last_undegraded":"2023-11-04T01:38:23.779695+0000","last_fullsized":"2023-11-04T01:38:23.779695+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:46:48.655557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"66'8","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.814478+0000","last_change":"2023-11-04T01:38:21.779581+0000","last_active":"2023-11-04T01:38:22.814478+0000","last_peered":"2023-11-04T01:38:22.814478+0000","last_clean":"2023-11-04T01:38:22.814478+0000","last_became_active":"2023-11-04T01:38:21.778750+0000","last_became_peered":"2023-11-04T01:38:21.778750+0000","last_unstale":"2023-11-04T01:38:22.814478+0000","last_undegraded":"2023-11-04T01:38:22.814478+0000","last_fullsized":"2023-11-04T01:38:22.814478+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:31.234356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.780058+0000","last_change":"2023-11-04T01:37:36.221026+0000","last_active":"2023-11-04T01:38:22.780058+0000","last_peered":"2023-11-04T01:38:22.780058+0000","last_clean":"2023-11-04T01:38:22.780058+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:38:22.780058+0000","last_undegraded":"2023-11-04T01:38:22.780058+0000","last_fullsized":"2023-11-04T01:38:22.780058+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067716399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.792469+0000","last_change":"2023-11-04T01:38:21.778896+0000","last_active":"2023-11-04T01:38:22.792469+0000","last_peered":"2023-11-04T01:38:22.792469+0000","last_clean":"2023-11-04T01:38:22.792469+0000","last_became_active":"2023-11-04T01:38:21.778441+0000","last_became_peered":"2023-11-04T01:38:21.778441+0000","last_unstale":"2023-11-04T01:38:22.792469+0000","last_undegraded":"2023-11-04T01:38:22.792469+0000","last_fullsized":"2023-11-04T01:38:22.792469+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:53:41.724804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.792290+0000","last_change":"2023-11-04T01:37:36.229027+0000","last_active":"2023-11-04T01:38:22.792290+0000","last_peered":"2023-11-04T01:38:22.792290+0000","last_clean":"2023-11-04T01:38:22.792290+0000","last_became_active":"2023-11-04T01:37:35.218342+0000","last_became_peered":"2023-11-04T01:37:35.218342+0000","last_unstale":"2023-11-04T01:38:22.792290+0000","last_undegraded":"2023-11-04T01:38:22.792290+0000","last_fullsized":"2023-11-04T01:38:22.792290+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059666400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830528+0000","last_change":"2023-11-04T01:38:22.795880+0000","last_active":"2023-11-04T01:38:23.830528+0000","last_peered":"2023-11-04T01:38:23.830528+0000","last_clean":"2023-11-04T01:38:23.830528+0000","last_became_active":"2023-11-04T01:38:22.795564+0000","last_became_peered":"2023-11-04T01:38:22.795564+0000","last_unstale":"2023-11-04T01:38:23.830528+0000","last_undegraded":"2023-11-04T01:38:23.830528+0000","last_fullsized":"2023-11-04T01:38:23.830528+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:24:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.791807+0000","last_change":"2023-11-04T01:38:21.784835+0000","last_active":"2023-11-04T01:38:22.791807+0000","last_peered":"2023-11-04T01:38:22.791807+0000","last_clean":"2023-11-04T01:38:22.791807+0000","last_became_active":"2023-11-04T01:38:21.784180+0000","last_became_peered":"2023-11-04T01:38:21.784180+0000","last_unstale":"2023-11-04T01:38:22.791807+0000","last_undegraded":"2023-11-04T01:38:22.791807+0000","last_fullsized":"2023-11-04T01:38:22.791807+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:53.209470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.786229+0000","last_change":"2023-11-04T01:37:36.222868+0000","last_active":"2023-11-04T01:38:22.786229+0000","last_peered":"2023-11-04T01:38:22.786229+0000","last_clean":"2023-11-04T01:38:22.786229+0000","last_became_active":"2023-11-04T01:37:35.220180+0000","last_became_peered":"2023-11-04T01:37:35.220180+0000","last_unstale":"2023-11-04T01:38:22.786229+0000","last_undegraded":"2023-11-04T01:38:22.786229+0000","last_fullsized":"2023-11-04T01:38:22.786229+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001103574,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813902+0000","last_change":"2023-11-04T01:38:21.779892+0000","last_active":"2023-11-04T01:38:22.813902+0000","last_peered":"2023-11-04T01:38:22.813902+0000","last_clean":"2023-11-04T01:38:22.813902+0000","last_became_active":"2023-11-04T01:38:21.779593+0000","last_became_peered":"2023-11-04T01:38:21.779593+0000","last_unstale":"2023-11-04T01:38:22.813902+0000","last_undegraded":"2023-11-04T01:38:22.813902+0000","last_fullsized":"2023-11-04T01:38:22.813902+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:52.506126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.780187+0000","last_change":"2023-11-04T01:37:36.221053+0000","last_active":"2023-11-04T01:38:22.780187+0000","last_peered":"2023-11-04T01:38:22.780187+0000","last_clean":"2023-11-04T01:38:22.780187+0000","last_became_active":"2023-11-04T01:37:35.227176+0000","last_became_peered":"2023-11-04T01:37:35.227176+0000","last_unstale":"2023-11-04T01:38:22.780187+0000","last_undegraded":"2023-11-04T01:38:22.780187+0000","last_fullsized":"2023-11-04T01:38:22.780187+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000594178,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.780050+0000","last_change":"2023-11-04T01:38:22.792465+0000","last_active":"2023-11-04T01:38:23.780050+0000","last_peered":"2023-11-04T01:38:23.780050+0000","last_clean":"2023-11-04T01:38:23.780050+0000","last_became_active":"2023-11-04T01:38:22.792194+0000","last_became_peered":"2023-11-04T01:38:22.792194+0000","last_unstale":"2023-11-04T01:38:23.780050+0000","last_undegraded":"2023-11-04T01:38:23.780050+0000","last_fullsized":"2023-11-04T01:38:23.780050+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:58.620973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"66'6","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.814795+0000","last_change":"2023-11-04T01:38:21.784953+0000","last_active":"2023-11-04T01:38:22.814795+0000","last_peered":"2023-11-04T01:38:22.814795+0000","last_clean":"2023-11-04T01:38:22.814795+0000","last_became_active":"2023-11-04T01:38:21.784671+0000","last_became_peered":"2023-11-04T01:38:21.784671+0000","last_unstale":"2023-11-04T01:38:22.814795+0000","last_undegraded":"2023-11-04T01:38:22.814795+0000","last_fullsized":"2023-11-04T01:38:22.814795+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:02:36.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.788287+0000","last_change":"2023-11-04T01:37:36.221842+0000","last_active":"2023-11-04T01:38:22.788287+0000","last_peered":"2023-11-04T01:38:22.788287+0000","last_clean":"2023-11-04T01:38:22.788287+0000","last_became_active":"2023-11-04T01:37:35.214305+0000","last_became_peered":"2023-11-04T01:37:35.214305+0000","last_unstale":"2023-11-04T01:38:22.788287+0000","last_undegraded":"2023-11-04T01:38:22.788287+0000","last_fullsized":"2023-11-04T01:38:22.788287+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:13:05.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014999690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.833212+0000","last_change":"2023-11-04T01:38:22.799711+0000","last_active":"2023-11-04T01:38:23.833212+0000","last_peered":"2023-11-04T01:38:23.833212+0000","last_clean":"2023-11-04T01:38:23.833212+0000","last_became_active":"2023-11-04T01:38:22.798255+0000","last_became_peered":"2023-11-04T01:38:22.798255+0000","last_unstale":"2023-11-04T01:38:23.833212+0000","last_undegraded":"2023-11-04T01:38:23.833212+0000","last_fullsized":"2023-11-04T01:38:23.833212+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:50.775290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765665+0000","last_change":"2023-11-04T01:38:20.765665+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765665+0000","last_undegraded":"2023-11-04T01:38:20.765665+0000","last_fullsized":"2023-11-04T01:38:20.765665+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128398+0000","last_change":"2023-11-04T01:37:36.694601+0000","last_active":"2023-11-04T01:38:19.128398+0000","last_peered":"2023-11-04T01:38:19.128398+0000","last_clean":"2023-11-04T01:38:19.128398+0000","last_became_active":"2023-11-04T01:37:35.223746+0000","last_became_peered":"2023-11-04T01:37:35.223746+0000","last_unstale":"2023-11-04T01:38:19.128398+0000","last_undegraded":"2023-11-04T01:38:19.128398+0000","last_fullsized":"2023-11-04T01:38:19.128398+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:35.960485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000555376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.789342+0000","last_change":"2023-11-04T01:38:21.781376+0000","last_active":"2023-11-04T01:38:22.789342+0000","last_peered":"2023-11-04T01:38:22.789342+0000","last_clean":"2023-11-04T01:38:22.789342+0000","last_became_active":"2023-11-04T01:38:21.781092+0000","last_became_peered":"2023-11-04T01:38:21.781092+0000","last_unstale":"2023-11-04T01:38:22.789342+0000","last_undegraded":"2023-11-04T01:38:22.789342+0000","last_fullsized":"2023-11-04T01:38:22.789342+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:02:36.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128424+0000","last_change":"2023-11-04T01:37:36.695075+0000","last_active":"2023-11-04T01:38:19.128424+0000","last_peered":"2023-11-04T01:38:19.128424+0000","last_clean":"2023-11-04T01:38:19.128424+0000","last_became_active":"2023-11-04T01:37:35.221165+0000","last_became_peered":"2023-11-04T01:37:35.221165+0000","last_unstale":"2023-11-04T01:38:19.128424+0000","last_undegraded":"2023-11-04T01:38:19.128424+0000","last_fullsized":"2023-11-04T01:38:19.128424+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:17.958372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072817499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830649+0000","last_change":"2023-11-04T01:38:22.795282+0000","last_active":"2023-11-04T01:38:23.830649+0000","last_peered":"2023-11-04T01:38:23.830649+0000","last_clean":"2023-11-04T01:38:23.830649+0000","last_became_active":"2023-11-04T01:38:22.794982+0000","last_became_peered":"2023-11-04T01:38:22.794982+0000","last_unstale":"2023-11-04T01:38:23.830649+0000","last_undegraded":"2023-11-04T01:38:23.830649+0000","last_fullsized":"2023-11-04T01:38:23.830649+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:36.853590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.780658+0000","last_change":"2023-11-04T01:38:21.772813+0000","last_active":"2023-11-04T01:38:22.780658+0000","last_peered":"2023-11-04T01:38:22.780658+0000","last_clean":"2023-11-04T01:38:22.780658+0000","last_became_active":"2023-11-04T01:38:21.772538+0000","last_became_peered":"2023-11-04T01:38:21.772538+0000","last_unstale":"2023-11-04T01:38:22.780658+0000","last_undegraded":"2023-11-04T01:38:22.780658+0000","last_fullsized":"2023-11-04T01:38:22.780658+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:58.930870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":40,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.780158+0000","last_change":"2023-11-04T01:37:36.221747+0000","last_active":"2023-11-04T01:38:22.780158+0000","last_peered":"2023-11-04T01:38:22.780158+0000","last_clean":"2023-11-04T01:38:22.780158+0000","last_became_active":"2023-11-04T01:37:35.223198+0000","last_became_peered":"2023-11-04T01:37:35.223198+0000","last_unstale":"2023-11-04T01:38:22.780158+0000","last_undegraded":"2023-11-04T01:38:22.780158+0000","last_fullsized":"2023-11-04T01:38:22.780158+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097726499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.782625+0000","last_change":"2023-11-04T01:38:21.779870+0000","last_active":"2023-11-04T01:38:22.782625+0000","last_peered":"2023-11-04T01:38:22.782625+0000","last_clean":"2023-11-04T01:38:22.782625+0000","last_became_active":"2023-11-04T01:38:21.779617+0000","last_became_peered":"2023-11-04T01:38:21.779617+0000","last_unstale":"2023-11-04T01:38:22.782625+0000","last_undegraded":"2023-11-04T01:38:22.782625+0000","last_fullsized":"2023-11-04T01:38:22.782625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:43.450673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778403+0000","last_change":"2023-11-04T01:37:36.422496+0000","last_active":"2023-11-04T01:38:18.778403+0000","last_peered":"2023-11-04T01:38:18.778403+0000","last_clean":"2023-11-04T01:38:18.778403+0000","last_became_active":"2023-11-04T01:37:35.221763+0000","last_became_peered":"2023-11-04T01:37:35.221763+0000","last_unstale":"2023-11-04T01:38:18.778403+0000","last_undegraded":"2023-11-04T01:38:18.778403+0000","last_fullsized":"2023-11-04T01:38:18.778403+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073676299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.779510+0000","last_change":"2023-11-04T01:38:22.795543+0000","last_active":"2023-11-04T01:38:23.779510+0000","last_peered":"2023-11-04T01:38:23.779510+0000","last_clean":"2023-11-04T01:38:23.779510+0000","last_became_active":"2023-11-04T01:38:22.795280+0000","last_became_peered":"2023-11-04T01:38:22.795280+0000","last_unstale":"2023-11-04T01:38:23.779510+0000","last_undegraded":"2023-11-04T01:38:23.779510+0000","last_fullsized":"2023-11-04T01:38:23.779510+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:43.074702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.779636+0000","last_change":"2023-11-04T01:38:21.786403+0000","last_active":"2023-11-04T01:38:22.779636+0000","last_peered":"2023-11-04T01:38:22.779636+0000","last_clean":"2023-11-04T01:38:22.779636+0000","last_became_active":"2023-11-04T01:38:21.786122+0000","last_became_peered":"2023-11-04T01:38:21.786122+0000","last_unstale":"2023-11-04T01:38:22.779636+0000","last_undegraded":"2023-11-04T01:38:22.779636+0000","last_fullsized":"2023-11-04T01:38:22.779636+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:36.539159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778348+0000","last_change":"2023-11-04T01:37:36.229940+0000","last_active":"2023-11-04T01:38:18.778348+0000","last_peered":"2023-11-04T01:38:18.778348+0000","last_clean":"2023-11-04T01:38:18.778348+0000","last_became_active":"2023-11-04T01:37:35.225121+0000","last_became_peered":"2023-11-04T01:37:35.225121+0000","last_unstale":"2023-11-04T01:38:18.778348+0000","last_undegraded":"2023-11-04T01:38:18.778348+0000","last_fullsized":"2023-11-04T01:38:18.778348+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:12.130671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075648399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.782957+0000","last_change":"2023-11-04T01:38:22.794519+0000","last_active":"2023-11-04T01:38:23.782957+0000","last_peered":"2023-11-04T01:38:23.782957+0000","last_clean":"2023-11-04T01:38:23.782957+0000","last_became_active":"2023-11-04T01:38:22.793831+0000","last_became_peered":"2023-11-04T01:38:22.793831+0000","last_unstale":"2023-11-04T01:38:23.782957+0000","last_undegraded":"2023-11-04T01:38:23.782957+0000","last_fullsized":"2023-11-04T01:38:23.782957+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:03.356308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813592+0000","last_change":"2023-11-04T01:38:21.784160+0000","last_active":"2023-11-04T01:38:22.813592+0000","last_peered":"2023-11-04T01:38:22.813592+0000","last_clean":"2023-11-04T01:38:22.813592+0000","last_became_active":"2023-11-04T01:38:21.782805+0000","last_became_peered":"2023-11-04T01:38:21.782805+0000","last_unstale":"2023-11-04T01:38:22.813592+0000","last_undegraded":"2023-11-04T01:38:22.813592+0000","last_fullsized":"2023-11-04T01:38:22.813592+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:31.234356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778310+0000","last_change":"2023-11-04T01:37:36.422801+0000","last_active":"2023-11-04T01:38:18.778310+0000","last_peered":"2023-11-04T01:38:18.778310+0000","last_clean":"2023-11-04T01:38:18.778310+0000","last_became_active":"2023-11-04T01:37:35.217091+0000","last_became_peered":"2023-11-04T01:37:35.217091+0000","last_unstale":"2023-11-04T01:38:18.778310+0000","last_undegraded":"2023-11-04T01:38:18.778310+0000","last_fullsized":"2023-11-04T01:38:18.778310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082211999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830285+0000","last_change":"2023-11-04T01:38:22.794250+0000","last_active":"2023-11-04T01:38:23.830285+0000","last_peered":"2023-11-04T01:38:23.830285+0000","last_clean":"2023-11-04T01:38:23.830285+0000","last_became_active":"2023-11-04T01:38:22.793734+0000","last_became_peered":"2023-11-04T01:38:22.793734+0000","last_unstale":"2023-11-04T01:38:23.830285+0000","last_undegraded":"2023-11-04T01:38:23.830285+0000","last_fullsized":"2023-11-04T01:38:23.830285+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:44.575251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765653+0000","last_change":"2023-11-04T01:38:20.765653+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765653+0000","last_undegraded":"2023-11-04T01:38:20.765653+0000","last_fullsized":"2023-11-04T01:38:20.765653+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":40,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.781447+0000","last_change":"2023-11-04T01:37:36.222683+0000","last_active":"2023-11-04T01:38:22.781447+0000","last_peered":"2023-11-04T01:38:22.781447+0000","last_clean":"2023-11-04T01:38:22.781447+0000","last_became_active":"2023-11-04T01:37:35.222694+0000","last_became_peered":"2023-11-04T01:37:35.222694+0000","last_unstale":"2023-11-04T01:38:22.781447+0000","last_undegraded":"2023-11-04T01:38:22.781447+0000","last_fullsized":"2023-11-04T01:38:22.781447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000490194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813614+0000","last_change":"2023-11-04T01:38:21.784145+0000","last_active":"2023-11-04T01:38:22.813614+0000","last_peered":"2023-11-04T01:38:22.813614+0000","last_clean":"2023-11-04T01:38:22.813614+0000","last_became_active":"2023-11-04T01:38:21.783207+0000","last_became_peered":"2023-11-04T01:38:21.783207+0000","last_unstale":"2023-11-04T01:38:22.813614+0000","last_undegraded":"2023-11-04T01:38:22.813614+0000","last_fullsized":"2023-11-04T01:38:22.813614+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:52.506126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778284+0000","last_change":"2023-11-04T01:37:36.422156+0000","last_active":"2023-11-04T01:38:18.778284+0000","last_peered":"2023-11-04T01:38:18.778284+0000","last_clean":"2023-11-04T01:38:18.778284+0000","last_became_active":"2023-11-04T01:37:35.214925+0000","last_became_peered":"2023-11-04T01:37:35.214925+0000","last_unstale":"2023-11-04T01:38:18.778284+0000","last_undegraded":"2023-11-04T01:38:18.778284+0000","last_fullsized":"2023-11-04T01:38:18.778284+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058029000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.833105+0000","last_change":"2023-11-04T01:38:22.799043+0000","last_active":"2023-11-04T01:38:23.833105+0000","last_peered":"2023-11-04T01:38:23.833105+0000","last_clean":"2023-11-04T01:38:23.833105+0000","last_became_active":"2023-11-04T01:38:22.798517+0000","last_became_peered":"2023-11-04T01:38:22.798517+0000","last_unstale":"2023-11-04T01:38:23.833105+0000","last_undegraded":"2023-11-04T01:38:23.833105+0000","last_fullsized":"2023-11-04T01:38:23.833105+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:48.333335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.812961+0000","last_change":"2023-11-04T01:38:21.783965+0000","last_active":"2023-11-04T01:38:22.812961+0000","last_peered":"2023-11-04T01:38:22.812961+0000","last_clean":"2023-11-04T01:38:22.812961+0000","last_became_active":"2023-11-04T01:38:21.783696+0000","last_became_peered":"2023-11-04T01:38:21.783696+0000","last_unstale":"2023-11-04T01:38:22.812961+0000","last_undegraded":"2023-11-04T01:38:22.812961+0000","last_fullsized":"2023-11-04T01:38:22.812961+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:48:46.983426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778063+0000","last_change":"2023-11-04T01:37:36.229258+0000","last_active":"2023-11-04T01:38:18.778063+0000","last_peered":"2023-11-04T01:38:18.778063+0000","last_clean":"2023-11-04T01:38:18.778063+0000","last_became_active":"2023-11-04T01:37:35.221720+0000","last_became_peered":"2023-11-04T01:37:35.221720+0000","last_unstale":"2023-11-04T01:38:18.778063+0000","last_undegraded":"2023-11-04T01:38:18.778063+0000","last_fullsized":"2023-11-04T01:38:18.778063+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:09.633236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068644799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.780331+0000","last_change":"2023-11-04T01:38:22.798636+0000","last_active":"2023-11-04T01:38:23.780331+0000","last_peered":"2023-11-04T01:38:23.780331+0000","last_clean":"2023-11-04T01:38:23.780331+0000","last_became_active":"2023-11-04T01:38:22.797632+0000","last_became_peered":"2023-11-04T01:38:22.797632+0000","last_unstale":"2023-11-04T01:38:23.780331+0000","last_undegraded":"2023-11-04T01:38:23.780331+0000","last_fullsized":"2023-11-04T01:38:23.780331+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:35.469589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766972+0000","last_change":"2023-11-04T01:38:20.766972+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766972+0000","last_undegraded":"2023-11-04T01:38:20.766972+0000","last_fullsized":"2023-11-04T01:38:20.766972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128490+0000","last_change":"2023-11-04T01:37:36.695175+0000","last_active":"2023-11-04T01:38:19.128490+0000","last_peered":"2023-11-04T01:38:19.128490+0000","last_clean":"2023-11-04T01:38:19.128490+0000","last_became_active":"2023-11-04T01:37:35.224473+0000","last_became_peered":"2023-11-04T01:37:35.224473+0000","last_unstale":"2023-11-04T01:38:19.128490+0000","last_undegraded":"2023-11-04T01:38:19.128490+0000","last_fullsized":"2023-11-04T01:38:19.128490+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065377199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765527+0000","last_change":"2023-11-04T01:38:20.765527+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765527+0000","last_undegraded":"2023-11-04T01:38:20.765527+0000","last_fullsized":"2023-11-04T01:38:20.765527+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.792601+0000","last_change":"2023-11-04T01:37:36.222100+0000","last_active":"2023-11-04T01:38:22.792601+0000","last_peered":"2023-11-04T01:38:22.792601+0000","last_clean":"2023-11-04T01:38:22.792601+0000","last_became_active":"2023-11-04T01:37:35.219622+0000","last_became_peered":"2023-11-04T01:37:35.219622+0000","last_unstale":"2023-11-04T01:38:22.792601+0000","last_undegraded":"2023-11-04T01:38:22.792601+0000","last_fullsized":"2023-11-04T01:38:22.792601+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:16.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653496,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.832572+0000","last_change":"2023-11-04T01:38:22.799482+0000","last_active":"2023-11-04T01:38:23.832572+0000","last_peered":"2023-11-04T01:38:23.832572+0000","last_clean":"2023-11-04T01:38:23.832572+0000","last_became_active":"2023-11-04T01:38:22.798760+0000","last_became_peered":"2023-11-04T01:38:22.798760+0000","last_unstale":"2023-11-04T01:38:23.832572+0000","last_undegraded":"2023-11-04T01:38:23.832572+0000","last_fullsized":"2023-11-04T01:38:23.832572+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:47:57.330922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.792584+0000","last_change":"2023-11-04T01:38:21.784682+0000","last_active":"2023-11-04T01:38:22.792584+0000","last_peered":"2023-11-04T01:38:22.792584+0000","last_clean":"2023-11-04T01:38:22.792584+0000","last_became_active":"2023-11-04T01:38:21.784421+0000","last_became_peered":"2023-11-04T01:38:21.784421+0000","last_unstale":"2023-11-04T01:38:22.792584+0000","last_undegraded":"2023-11-04T01:38:22.792584+0000","last_fullsized":"2023-11-04T01:38:22.792584+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:58.930870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.786739+0000","last_change":"2023-11-04T01:37:36.222451+0000","last_active":"2023-11-04T01:38:22.786739+0000","last_peered":"2023-11-04T01:38:22.786739+0000","last_clean":"2023-11-04T01:38:22.786739+0000","last_became_active":"2023-11-04T01:37:35.221090+0000","last_became_peered":"2023-11-04T01:37:35.221090+0000","last_unstale":"2023-11-04T01:38:22.786739+0000","last_undegraded":"2023-11-04T01:38:22.786739+0000","last_fullsized":"2023-11-04T01:38:22.786739+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077263799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.776943+0000","last_change":"2023-11-04T01:38:22.784057+0000","last_active":"2023-11-04T01:38:23.776943+0000","last_peered":"2023-11-04T01:38:23.776943+0000","last_clean":"2023-11-04T01:38:23.776943+0000","last_became_active":"2023-11-04T01:38:22.783674+0000","last_became_peered":"2023-11-04T01:38:22.783674+0000","last_unstale":"2023-11-04T01:38:23.776943+0000","last_undegraded":"2023-11-04T01:38:23.776943+0000","last_fullsized":"2023-11-04T01:38:23.776943+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:54.213899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.779854+0000","last_change":"2023-11-04T01:38:21.778357+0000","last_active":"2023-11-04T01:38:22.779854+0000","last_peered":"2023-11-04T01:38:22.779854+0000","last_clean":"2023-11-04T01:38:22.779854+0000","last_became_active":"2023-11-04T01:38:21.778099+0000","last_became_peered":"2023-11-04T01:38:21.778099+0000","last_unstale":"2023-11-04T01:38:22.779854+0000","last_undegraded":"2023-11-04T01:38:22.779854+0000","last_fullsized":"2023-11-04T01:38:22.779854+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:04.983882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.787922+0000","last_change":"2023-11-04T01:37:36.222643+0000","last_active":"2023-11-04T01:38:22.787922+0000","last_peered":"2023-11-04T01:38:22.787922+0000","last_clean":"2023-11-04T01:38:22.787922+0000","last_became_active":"2023-11-04T01:37:35.215534+0000","last_became_peered":"2023-11-04T01:37:35.215534+0000","last_unstale":"2023-11-04T01:38:22.787922+0000","last_undegraded":"2023-11-04T01:38:22.787922+0000","last_fullsized":"2023-11-04T01:38:22.787922+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011110530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.832776+0000","last_change":"2023-11-04T01:38:22.797548+0000","last_active":"2023-11-04T01:38:23.832776+0000","last_peered":"2023-11-04T01:38:23.832776+0000","last_clean":"2023-11-04T01:38:23.832776+0000","last_became_active":"2023-11-04T01:38:22.797276+0000","last_became_peered":"2023-11-04T01:38:22.797276+0000","last_unstale":"2023-11-04T01:38:23.832776+0000","last_undegraded":"2023-11-04T01:38:23.832776+0000","last_fullsized":"2023-11-04T01:38:23.832776+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:03.356308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.779717+0000","last_change":"2023-11-04T01:38:21.786427+0000","last_active":"2023-11-04T01:38:22.779717+0000","last_peered":"2023-11-04T01:38:22.779717+0000","last_clean":"2023-11-04T01:38:22.779717+0000","last_became_active":"2023-11-04T01:38:21.786189+0000","last_became_peered":"2023-11-04T01:38:21.786189+0000","last_unstale":"2023-11-04T01:38:22.779717+0000","last_undegraded":"2023-11-04T01:38:22.779717+0000","last_fullsized":"2023-11-04T01:38:22.779717+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:37.978034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128525+0000","last_change":"2023-11-04T01:37:36.695402+0000","last_active":"2023-11-04T01:38:19.128525+0000","last_peered":"2023-11-04T01:38:19.128525+0000","last_clean":"2023-11-04T01:38:19.128525+0000","last_became_active":"2023-11-04T01:37:35.220346+0000","last_became_peered":"2023-11-04T01:37:35.220346+0000","last_unstale":"2023-11-04T01:38:19.128525+0000","last_undegraded":"2023-11-04T01:38:19.128525+0000","last_fullsized":"2023-11-04T01:38:19.128525+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062230100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.779779+0000","last_change":"2023-11-04T01:38:22.791990+0000","last_active":"2023-11-04T01:38:23.779779+0000","last_peered":"2023-11-04T01:38:23.779779+0000","last_clean":"2023-11-04T01:38:23.779779+0000","last_became_active":"2023-11-04T01:38:22.791702+0000","last_became_peered":"2023-11-04T01:38:22.791702+0000","last_unstale":"2023-11-04T01:38:23.779779+0000","last_undegraded":"2023-11-04T01:38:23.779779+0000","last_fullsized":"2023-11-04T01:38:23.779779+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:58.284803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.782915+0000","last_change":"2023-11-04T01:38:21.780688+0000","last_active":"2023-11-04T01:38:22.782915+0000","last_peered":"2023-11-04T01:38:22.782915+0000","last_clean":"2023-11-04T01:38:22.782915+0000","last_became_active":"2023-11-04T01:38:21.780288+0000","last_became_peered":"2023-11-04T01:38:21.780288+0000","last_unstale":"2023-11-04T01:38:22.782915+0000","last_undegraded":"2023-11-04T01:38:22.782915+0000","last_fullsized":"2023-11-04T01:38:22.782915+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:31:58.780122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":41,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.781258+0000","last_change":"2023-11-04T01:37:36.426315+0000","last_active":"2023-11-04T01:38:22.781258+0000","last_peered":"2023-11-04T01:38:22.781258+0000","last_clean":"2023-11-04T01:38:22.781258+0000","last_became_active":"2023-11-04T01:37:35.223958+0000","last_became_peered":"2023-11-04T01:37:35.223958+0000","last_unstale":"2023-11-04T01:38:22.781258+0000","last_undegraded":"2023-11-04T01:38:22.781258+0000","last_fullsized":"2023-11-04T01:38:22.781258+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:46.733116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025167400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.767031+0000","last_change":"2023-11-04T01:38:20.767031+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.767031+0000","last_undegraded":"2023-11-04T01:38:20.767031+0000","last_fullsized":"2023-11-04T01:38:20.767031+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128421+0000","last_change":"2023-11-04T01:37:36.694540+0000","last_active":"2023-11-04T01:38:19.128421+0000","last_peered":"2023-11-04T01:38:19.128421+0000","last_clean":"2023-11-04T01:38:19.128421+0000","last_became_active":"2023-11-04T01:37:35.225863+0000","last_became_peered":"2023-11-04T01:37:35.225863+0000","last_unstale":"2023-11-04T01:38:19.128421+0000","last_undegraded":"2023-11-04T01:38:19.128421+0000","last_fullsized":"2023-11-04T01:38:19.128421+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:42.654853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042277299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.782315+0000","last_change":"2023-11-04T01:38:21.778593+0000","last_active":"2023-11-04T01:38:22.782315+0000","last_peered":"2023-11-04T01:38:22.782315+0000","last_clean":"2023-11-04T01:38:22.782315+0000","last_became_active":"2023-11-04T01:38:21.778314+0000","last_became_peered":"2023-11-04T01:38:21.778314+0000","last_unstale":"2023-11-04T01:38:22.782315+0000","last_undegraded":"2023-11-04T01:38:22.782315+0000","last_fullsized":"2023-11-04T01:38:22.782315+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:27:35.986692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":41,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.782882+0000","last_change":"2023-11-04T01:37:36.426202+0000","last_active":"2023-11-04T01:38:22.782882+0000","last_peered":"2023-11-04T01:38:22.782882+0000","last_clean":"2023-11-04T01:38:22.782882+0000","last_became_active":"2023-11-04T01:37:35.222997+0000","last_became_peered":"2023-11-04T01:37:35.222997+0000","last_unstale":"2023-11-04T01:38:22.782882+0000","last_undegraded":"2023-11-04T01:38:22.782882+0000","last_fullsized":"2023-11-04T01:38:22.782882+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:18.980751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041393700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830527+0000","last_change":"2023-11-04T01:38:22.796358+0000","last_active":"2023-11-04T01:38:23.830527+0000","last_peered":"2023-11-04T01:38:23.830527+0000","last_clean":"2023-11-04T01:38:23.830527+0000","last_became_active":"2023-11-04T01:38:22.796081+0000","last_became_peered":"2023-11-04T01:38:22.796081+0000","last_unstale":"2023-11-04T01:38:23.830527+0000","last_undegraded":"2023-11-04T01:38:23.830527+0000","last_fullsized":"2023-11-04T01:38:23.830527+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:10.803421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.793743+0000","last_change":"2023-11-04T01:38:21.779951+0000","last_active":"2023-11-04T01:38:22.793743+0000","last_peered":"2023-11-04T01:38:22.793743+0000","last_clean":"2023-11-04T01:38:22.793743+0000","last_became_active":"2023-11-04T01:38:21.779624+0000","last_became_peered":"2023-11-04T01:38:21.779624+0000","last_unstale":"2023-11-04T01:38:22.793743+0000","last_undegraded":"2023-11-04T01:38:22.793743+0000","last_fullsized":"2023-11-04T01:38:22.793743+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:24.442218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.780063+0000","last_change":"2023-11-04T01:37:36.220713+0000","last_active":"2023-11-04T01:38:22.780063+0000","last_peered":"2023-11-04T01:38:22.780063+0000","last_clean":"2023-11-04T01:38:22.780063+0000","last_became_active":"2023-11-04T01:37:35.220311+0000","last_became_peered":"2023-11-04T01:37:35.220311+0000","last_unstale":"2023-11-04T01:38:22.780063+0000","last_undegraded":"2023-11-04T01:38:22.780063+0000","last_fullsized":"2023-11-04T01:38:22.780063+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062999799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813529+0000","last_change":"2023-11-04T01:38:21.782919+0000","last_active":"2023-11-04T01:38:22.813529+0000","last_peered":"2023-11-04T01:38:22.813529+0000","last_clean":"2023-11-04T01:38:22.813529+0000","last_became_active":"2023-11-04T01:38:21.782623+0000","last_became_peered":"2023-11-04T01:38:21.782623+0000","last_unstale":"2023-11-04T01:38:22.813529+0000","last_undegraded":"2023-11-04T01:38:22.813529+0000","last_fullsized":"2023-11-04T01:38:22.813529+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:45.887446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778191+0000","last_change":"2023-11-04T01:37:36.229580+0000","last_active":"2023-11-04T01:38:18.778191+0000","last_peered":"2023-11-04T01:38:18.778191+0000","last_clean":"2023-11-04T01:38:18.778191+0000","last_became_active":"2023-11-04T01:37:35.220940+0000","last_became_peered":"2023-11-04T01:37:35.220940+0000","last_unstale":"2023-11-04T01:38:18.778191+0000","last_undegraded":"2023-11-04T01:38:18.778191+0000","last_fullsized":"2023-11-04T01:38:18.778191+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:27.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070235600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.766880+0000","last_change":"2023-11-04T01:38:20.766880+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.766880+0000","last_undegraded":"2023-11-04T01:38:20.766880+0000","last_fullsized":"2023-11-04T01:38:20.766880+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778269+0000","last_change":"2023-11-04T01:37:36.422542+0000","last_active":"2023-11-04T01:38:18.778269+0000","last_peered":"2023-11-04T01:38:18.778269+0000","last_clean":"2023-11-04T01:38:18.778269+0000","last_became_active":"2023-11-04T01:37:35.224836+0000","last_became_peered":"2023-11-04T01:37:35.224836+0000","last_unstale":"2023-11-04T01:38:18.778269+0000","last_undegraded":"2023-11-04T01:38:18.778269+0000","last_fullsized":"2023-11-04T01:38:18.778269+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066982800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.792922+0000","last_change":"2023-11-04T01:38:21.779620+0000","last_active":"2023-11-04T01:38:22.792922+0000","last_peered":"2023-11-04T01:38:22.792922+0000","last_clean":"2023-11-04T01:38:22.792922+0000","last_became_active":"2023-11-04T01:38:21.779132+0000","last_became_peered":"2023-11-04T01:38:21.779132+0000","last_unstale":"2023-11-04T01:38:22.792922+0000","last_undegraded":"2023-11-04T01:38:22.792922+0000","last_fullsized":"2023-11-04T01:38:22.792922+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:01:18.438613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128510+0000","last_change":"2023-11-04T01:37:36.694868+0000","last_active":"2023-11-04T01:38:19.128510+0000","last_peered":"2023-11-04T01:38:19.128510+0000","last_clean":"2023-11-04T01:38:19.128510+0000","last_became_active":"2023-11-04T01:37:35.221181+0000","last_became_peered":"2023-11-04T01:37:35.221181+0000","last_unstale":"2023-11-04T01:38:19.128510+0000","last_undegraded":"2023-11-04T01:38:19.128510+0000","last_fullsized":"2023-11-04T01:38:19.128510+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046748800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.792462+0000","last_change":"2023-11-04T01:38:21.784340+0000","last_active":"2023-11-04T01:38:22.792462+0000","last_peered":"2023-11-04T01:38:22.792462+0000","last_clean":"2023-11-04T01:38:22.792462+0000","last_became_active":"2023-11-04T01:38:21.782892+0000","last_became_peered":"2023-11-04T01:38:21.782892+0000","last_unstale":"2023-11-04T01:38:22.792462+0000","last_undegraded":"2023-11-04T01:38:22.792462+0000","last_fullsized":"2023-11-04T01:38:22.792462+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:53.810214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.786450+0000","last_change":"2023-11-04T01:37:36.222930+0000","last_active":"2023-11-04T01:38:22.786450+0000","last_peered":"2023-11-04T01:38:22.786450+0000","last_clean":"2023-11-04T01:38:22.786450+0000","last_became_active":"2023-11-04T01:37:35.220373+0000","last_became_peered":"2023-11-04T01:37:35.220373+0000","last_unstale":"2023-11-04T01:38:22.786450+0000","last_undegraded":"2023-11-04T01:38:22.786450+0000","last_fullsized":"2023-11-04T01:38:22.786450+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074099599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.780059+0000","last_change":"2023-11-04T01:38:22.797844+0000","last_active":"2023-11-04T01:38:23.780059+0000","last_peered":"2023-11-04T01:38:23.780059+0000","last_clean":"2023-11-04T01:38:23.780059+0000","last_became_active":"2023-11-04T01:38:22.794852+0000","last_became_peered":"2023-11-04T01:38:22.794852+0000","last_unstale":"2023-11-04T01:38:23.780059+0000","last_undegraded":"2023-11-04T01:38:23.780059+0000","last_fullsized":"2023-11-04T01:38:23.780059+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:28:10.791332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-04T01:38:20.765531+0000","last_change":"2023-11-04T01:38:20.765531+0000","last_active":"2023-11-04T01:38:20.755236+0000","last_peered":"2023-11-04T01:38:20.755236+0000","last_clean":"2023-11-04T01:38:20.755236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:20.765531+0000","last_undegraded":"2023-11-04T01:38:20.765531+0000","last_fullsized":"2023-11-04T01:38:20.765531+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":40,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.779951+0000","last_change":"2023-11-04T01:37:36.221676+0000","last_active":"2023-11-04T01:38:22.779951+0000","last_peered":"2023-11-04T01:38:22.779951+0000","last_clean":"2023-11-04T01:38:22.779951+0000","last_became_active":"2023-11-04T01:37:35.226996+0000","last_became_peered":"2023-11-04T01:37:35.226996+0000","last_unstale":"2023-11-04T01:38:22.779951+0000","last_undegraded":"2023-11-04T01:38:22.779951+0000","last_fullsized":"2023-11-04T01:38:22.779951+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089115500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.777344+0000","last_change":"2023-11-04T01:38:22.796528+0000","last_active":"2023-11-04T01:38:23.777344+0000","last_peered":"2023-11-04T01:38:23.777344+0000","last_clean":"2023-11-04T01:38:23.777344+0000","last_became_active":"2023-11-04T01:38:22.796251+0000","last_became_peered":"2023-11-04T01:38:22.796251+0000","last_unstale":"2023-11-04T01:38:23.777344+0000","last_undegraded":"2023-11-04T01:38:23.777344+0000","last_fullsized":"2023-11-04T01:38:23.777344+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:16.129659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813538+0000","last_change":"2023-11-04T01:38:21.783098+0000","last_active":"2023-11-04T01:38:22.813538+0000","last_peered":"2023-11-04T01:38:22.813538+0000","last_clean":"2023-11-04T01:38:22.813538+0000","last_became_active":"2023-11-04T01:38:21.782731+0000","last_became_peered":"2023-11-04T01:38:21.782731+0000","last_unstale":"2023-11-04T01:38:22.813538+0000","last_undegraded":"2023-11-04T01:38:22.813538+0000","last_fullsized":"2023-11-04T01:38:22.813538+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:30.223290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.786888+0000","last_change":"2023-11-04T01:37:36.228535+0000","last_active":"2023-11-04T01:38:22.786888+0000","last_peered":"2023-11-04T01:38:22.786888+0000","last_clean":"2023-11-04T01:38:22.786888+0000","last_became_active":"2023-11-04T01:37:35.221173+0000","last_became_peered":"2023-11-04T01:37:35.221173+0000","last_unstale":"2023-11-04T01:38:22.786888+0000","last_undegraded":"2023-11-04T01:38:22.786888+0000","last_fullsized":"2023-11-04T01:38:22.786888+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049831099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813970+0000","last_change":"2023-11-04T01:38:21.784307+0000","last_active":"2023-11-04T01:38:22.813970+0000","last_peered":"2023-11-04T01:38:22.813970+0000","last_clean":"2023-11-04T01:38:22.813970+0000","last_became_active":"2023-11-04T01:38:21.784035+0000","last_became_peered":"2023-11-04T01:38:21.784035+0000","last_unstale":"2023-11-04T01:38:22.813970+0000","last_undegraded":"2023-11-04T01:38:22.813970+0000","last_fullsized":"2023-11-04T01:38:22.813970+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:15.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778125+0000","last_change":"2023-11-04T01:37:36.229678+0000","last_active":"2023-11-04T01:38:18.778125+0000","last_peered":"2023-11-04T01:38:18.778125+0000","last_clean":"2023-11-04T01:38:18.778125+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:38:18.778125+0000","last_undegraded":"2023-11-04T01:38:18.778125+0000","last_fullsized":"2023-11-04T01:38:18.778125+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:50.484332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.783162+0000","last_change":"2023-11-04T01:38:22.788507+0000","last_active":"2023-11-04T01:38:23.783162+0000","last_peered":"2023-11-04T01:38:23.783162+0000","last_clean":"2023-11-04T01:38:23.783162+0000","last_became_active":"2023-11-04T01:38:22.788265+0000","last_became_peered":"2023-11-04T01:38:22.788265+0000","last_unstale":"2023-11-04T01:38:23.783162+0000","last_undegraded":"2023-11-04T01:38:23.783162+0000","last_fullsized":"2023-11-04T01:38:23.783162+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:48.333335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813611+0000","last_change":"2023-11-04T01:38:21.784588+0000","last_active":"2023-11-04T01:38:22.813611+0000","last_peered":"2023-11-04T01:38:22.813611+0000","last_clean":"2023-11-04T01:38:22.813611+0000","last_became_active":"2023-11-04T01:38:21.784315+0000","last_became_peered":"2023-11-04T01:38:21.784315+0000","last_unstale":"2023-11-04T01:38:22.813611+0000","last_undegraded":"2023-11-04T01:38:22.813611+0000","last_fullsized":"2023-11-04T01:38:22.813611+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:13.428171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":36,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778117+0000","last_change":"2023-11-04T01:37:36.229908+0000","last_active":"2023-11-04T01:38:18.778117+0000","last_peered":"2023-11-04T01:38:18.778117+0000","last_clean":"2023-11-04T01:38:18.778117+0000","last_became_active":"2023-11-04T01:37:35.221822+0000","last_became_peered":"2023-11-04T01:37:35.221822+0000","last_unstale":"2023-11-04T01:38:18.778117+0000","last_undegraded":"2023-11-04T01:38:18.778117+0000","last_fullsized":"2023-11-04T01:38:18.778117+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:11.866738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089270799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:21.759665+0000","last_change":"2023-11-04T01:38:21.759665+0000","last_active":"2023-11-04T01:38:21.759665+0000","last_peered":"2023-11-04T01:38:21.759665+0000","last_clean":"2023-11-04T01:38:21.759665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:21.759665+0000","last_undegraded":"2023-11-04T01:38:21.759665+0000","last_fullsized":"2023-11-04T01:38:21.759665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813472+0000","last_change":"2023-11-04T01:38:21.784997+0000","last_active":"2023-11-04T01:38:22.813472+0000","last_peered":"2023-11-04T01:38:22.813472+0000","last_clean":"2023-11-04T01:38:22.813472+0000","last_became_active":"2023-11-04T01:38:21.784719+0000","last_became_peered":"2023-11-04T01:38:21.784719+0000","last_unstale":"2023-11-04T01:38:22.813472+0000","last_undegraded":"2023-11-04T01:38:22.813472+0000","last_fullsized":"2023-11-04T01:38:22.813472+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:37.978034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:19.128552+0000","last_change":"2023-11-04T01:37:36.695345+0000","last_active":"2023-11-04T01:38:19.128552+0000","last_peered":"2023-11-04T01:38:19.128552+0000","last_clean":"2023-11-04T01:38:19.128552+0000","last_became_active":"2023-11-04T01:37:35.225441+0000","last_became_peered":"2023-11-04T01:37:35.225441+0000","last_unstale":"2023-11-04T01:38:19.128552+0000","last_undegraded":"2023-11-04T01:38:19.128552+0000","last_fullsized":"2023-11-04T01:38:19.128552+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052758199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":200,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:38:18.778317+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:38:18.778317+0000","last_peered":"2023-11-04T01:38:18.778317+0000","last_clean":"2023-11-04T01:38:18.778317+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:38:18.778317+0000","last_undegraded":"2023-11-04T01:38:18.778317+0000","last_fullsized":"2023-11-04T01:38:18.778317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":80,"acting":80,"num_store_stats":5},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1738,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":1355776,"data_stored":939806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.503,"15min":0.503},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64000000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.83499999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.745,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.67600000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.375,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.85899999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46300000000000002,"15min":0.45700000000000002},"min":{"1min":0.314,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.501},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.36599999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.32800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.371,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.77500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.45000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.434,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":377389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.443,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.41399999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.41099999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":1.004,"15min":1.004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55100000000000005,"15min":0.54100000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76100000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.51400000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78500000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.54100000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79800000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.60999999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65800000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.57999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":377387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71399999999999997,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.67900000000000005,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44600000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":1.24,"15min":1.24},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.42399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64900000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56200000000000006}]},{"osd":2,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72999999999999998,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67300000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.54100000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.67200000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.69699999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.63200000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72299999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.502,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65300000000000002,"5min":0.877,"15min":0.877},"last":0.66200000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75600000000000001,"5min":1.284,"15min":1.284},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71999999999999997,"5min":0.746,"15min":0.746},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.75800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":377367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.38700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39800000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.317,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76400000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.497},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.746,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78300000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.433,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":1.022,"15min":1.022},"last":0.60299999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":1.002,"15min":1.002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71699999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.628}]},{"osd":5,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":1.127,"15min":1.127},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80200000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68799999999999994}]},{"osd":6,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77600000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.747,"5min":1.079,"15min":1.079},"last":0.67300000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81000000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.629,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":1.093,"15min":1.093},"last":0.70099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":355928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.33400000000000002,"15min":0.34000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.49299999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.48399999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.313}]},{"osd":1,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.39700000000000002,"15min":0.40799999999999997},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.44600000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.41799999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.29199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.57699999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.312,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59499999999999997,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61599999999999999,"15min":0.627},"min":{"1min":0.36299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.752,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.622,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.65900000000000003,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80600000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.52400000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79400000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68500000000000005,"15min":0.69699999999999995},"min":{"1min":0.51000000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.752,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.77400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":378909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.36099999999999999,"15min":0.371},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.42399999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.312},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.36799999999999999,"15min":0.375},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.625,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.22900000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38200000000000001,"15min":0.38600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.32500000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55500000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.5,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34000000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65000000000000002,"15min":0.65800000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.504}]},{"osd":5,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86299999999999999,"5min":1.052,"15min":1.052},"last":0.495}]},{"osd":6,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.876,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.67400000000000004,"15min":0.68200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.45600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":379525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32700000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.46500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.372}]},{"osd":2,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40200000000000002,"15min":0.40400000000000003},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.58699999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.38900000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58399999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39000000000000001,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.40400000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58399999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":1.02,"15min":1.02},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89700000000000002,"5min":1.089,"15min":1.089},"last":0.59699999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92600000000000005,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92400000000000004,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96699999999999997,"5min":1.153,"15min":1.153},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1363968,"data_stored":945277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.35299999999999998,"15min":0.35599999999999998},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47099999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34699999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55200000000000005,"5min":0.629,"15min":0.629},"last":0.39000000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59499999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.48899999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.29599999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.28799999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.497,"5min":0.628,"15min":0.628},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65700000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.36599999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.45600000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.48399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77200000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.59699999999999998},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.80600000000000005,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.628}]},{"osd":6,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81999999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84099999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.622},"min":{"1min":0.47099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81699999999999995,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.495,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86499999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.56200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:28.274 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:28.278 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:28.761 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:38:28.759+0000 7fef9dbaf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:38:30.235 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:30.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.352+0000 7f8971289640 1 Processor -- start 2023-11-04T01:38:30.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.352+0000 7f8971289640 1 -- start start 2023-11-04T01:38:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.352+0000 7f8971289640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f896c15bfb0 0x7f896c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.352+0000 7f8971289640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f896c0cd860 0x7f896c0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.352+0000 7f8971289640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896c0cc450 con 0x7f896c15ae40 2023-11-04T01:38:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.352+0000 7f8971289640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896c15f400 con 0x7f896c0cd860 2023-11-04T01:38:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.352+0000 7f8971289640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896c15b220 con 0x7f896c15bfb0 2023-11-04T01:38:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.353+0000 7f896b7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f896c0cd860 0x7f896c0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.353+0000 7f896b7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f896c0cd860 0x7f896c0ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44736/0 (socket says 172.21.15.44:44736) 2023-11-04T01:38:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.353+0000 7f896b7fe640 1 -- 172.21.15.44:0/2681998793 learned_addr learned my addr 172.21.15.44:0/2681998793 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.353+0000 7f896a7fc640 1 --2- 172.21.15.44:0/2681998793 >> v2:172.21.15.204:3300/0 conn(0x7f896c15bfb0 0x7f896c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.353+0000 7f896b7fe640 1 -- 172.21.15.44:0/2681998793 >> v2:172.21.15.204:3300/0 conn(0x7f896c15bfb0 msgr2=0x7f896c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.353+0000 7f896b7fe640 1 --2- 172.21.15.44:0/2681998793 >> v2:172.21.15.204:3300/0 conn(0x7f896c15bfb0 0x7f896c0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.353+0000 7f896b7fe640 1 -- 172.21.15.44:0/2681998793 >> v1:172.21.15.204:6789/0 conn(0x7f896c15ae40 legacy=0x7f896c0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.353+0000 7f896b7fe640 1 -- 172.21.15.44:0/2681998793 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c15f890 con 0x7f896c0cd860 2023-11-04T01:38:30.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.354+0000 7f896b7fe640 1 --2- 172.21.15.44:0/2681998793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0cd860 0x7f896c0ced70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f896c0b05d0 tx=0x7f896402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0187c494eb7eca server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:30.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.354+0000 7f8969ffb640 1 -- 172.21.15.44:0/2681998793 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964031870 con 0x7f896c0cd860 2023-11-04T01:38:30.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.354+0000 7f8969ffb640 1 -- 172.21.15.44:0/2681998793 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89640319d0 con 0x7f896c0cd860 2023-11-04T01:38:30.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.354+0000 7f8969ffb640 1 -- 172.21.15.44:0/2681998793 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964031d60 con 0x7f896c0cd860 2023-11-04T01:38:30.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.354+0000 7f8971289640 1 -- 172.21.15.44:0/2681998793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0cd860 msgr2=0x7f896c0ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.354+0000 7f8971289640 1 --2- 172.21.15.44:0/2681998793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0cd860 0x7f896c0ced70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f896c0b05d0 tx=0x7f896402b910 comp rx=0 tx=0).stop 2023-11-04T01:38:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.354+0000 7f8971289640 1 -- 172.21.15.44:0/2681998793 shutdown_connections 2023-11-04T01:38:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.354+0000 7f8971289640 1 --2- 172.21.15.44:0/2681998793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0cd860 0x7f896c0ced70 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.354+0000 7f8971289640 1 --2- 172.21.15.44:0/2681998793 >> v2:172.21.15.204:3300/0 conn(0x7f896c15bfb0 0x7f896c0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.354+0000 7f8971289640 1 -- 172.21.15.44:0/2681998793 >> 172.21.15.44:0/2681998793 conn(0x7f896c06ea90 msgr2=0x7f896c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.354+0000 7f8971289640 1 -- 172.21.15.44:0/2681998793 shutdown_connections 2023-11-04T01:38:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.354+0000 7f8971289640 1 -- 172.21.15.44:0/2681998793 wait complete. 2023-11-04T01:38:30.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.356+0000 7f8971289640 1 Processor -- start 2023-11-04T01:38:30.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.356+0000 7f8971289640 1 -- start start 2023-11-04T01:38:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f8971289640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0cd860 0x7f896c14edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f8971289640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f896c15ae40 0x7f896c0ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f8971289640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f896c15bfb0 0x7f896c0ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f8971289640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0c9700 con 0x7f896c0cd860 2023-11-04T01:38:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f8971289640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0c8a80 con 0x7f896c15bfb0 2023-11-04T01:38:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f8971289640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0c8d60 con 0x7f896c15ae40 2023-11-04T01:38:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f896affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0cd860 0x7f896c14edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f896affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0cd860 0x7f896c14edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44738/0 (socket says 172.21.15.44:44738) 2023-11-04T01:38:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f896affd640 1 -- 172.21.15.44:0/1717550298 learned_addr learned my addr 172.21.15.44:0/1717550298 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f896b7fe640 1 --2- 172.21.15.44:0/1717550298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f896c15bfb0 0x7f896c0ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f896a7fc640 1 --2- 172.21.15.44:0/1717550298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f896c15ae40 0x7f896c0ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f896affd640 1 -- 172.21.15.44:0/1717550298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f896c15ae40 msgr2=0x7f896c0ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f896affd640 1 --2- 172.21.15.44:0/1717550298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f896c15ae40 0x7f896c0ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f896affd640 1 -- 172.21.15.44:0/1717550298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f896c15bfb0 msgr2=0x7f896c0ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f896affd640 1 --2- 172.21.15.44:0/1717550298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f896c15bfb0 0x7f896c0ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f896affd640 1 -- 172.21.15.44:0/1717550298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89640094d0 con 0x7f896c0cd860 2023-11-04T01:38:30.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f896affd640 1 --2- 172.21.15.44:0/1717550298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0cd860 0x7f896c14edf0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f895c00c7c0 tx=0x7f895c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:30.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f89637fe640 1 -- 172.21.15.44:0/1717550298 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00aa50 con 0x7f896c0cd860 2023-11-04T01:38:30.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f89637fe640 1 -- 172.21.15.44:0/1717550298 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c00abb0 con 0x7f896c0cd860 2023-11-04T01:38:30.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f8971289640 1 -- 172.21.15.44:0/1717550298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896c0c9040 con 0x7f896c0cd860 2023-11-04T01:38:30.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.357+0000 7f89637fe640 1 -- 172.21.15.44:0/1717550298 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c012420 con 0x7f896c0cd860 2023-11-04T01:38:30.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.358+0000 7f8971289640 1 -- 172.21.15.44:0/1717550298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896c14f330 con 0x7f896c0cd860 2023-11-04T01:38:30.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.358+0000 7f8971289640 1 -- 172.21.15.44:0/1717550298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f896c0ce2d0 con 0x7f896c0cd860 2023-11-04T01:38:30.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.359+0000 7f89637fe640 1 -- 172.21.15.44:0/1717550298 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f895c012580 con 0x7f896c0cd860 2023-11-04T01:38:30.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.359+0000 7f89637fe640 1 --2- 172.21.15.44:0/1717550298 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f894c06ae70 0x7f894c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.360+0000 7f89637fe640 1 -- 172.21.15.44:0/1717550298 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f895c089980 con 0x7f896c0cd860 2023-11-04T01:38:30.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.360+0000 7f896a7fc640 1 --2- 172.21.15.44:0/1717550298 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f894c06ae70 0x7f894c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.360+0000 7f896a7fc640 1 --2- 172.21.15.44:0/1717550298 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f894c06ae70 0x7f894c06d330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f896c150360 tx=0x7f8954008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:30.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.364+0000 7f89637fe640 1 -- 172.21.15.44:0/1717550298 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f895c054840 con 0x7f896c0cd860 2023-11-04T01:38:30.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.536+0000 7f8971289640 1 -- 172.21.15.44:0/1717550298 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f896c15edb0 con 0x7f894c06ae70 2023-11-04T01:38:30.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.545+0000 7f89637fe640 1 -- 172.21.15.44:0/1717550298 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370726 (secure 0 0 0) 0x7f89540108a0 con 0x7f894c06ae70 2023-11-04T01:38:30.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:30.554 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:38:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.549+0000 7f8971289640 1 -- 172.21.15.44:0/1717550298 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f894c06ae70 msgr2=0x7f894c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.549+0000 7f8971289640 1 --2- 172.21.15.44:0/1717550298 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f894c06ae70 0x7f894c06d330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f896c150360 tx=0x7f8954008040 comp rx=0 tx=0).stop 2023-11-04T01:38:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.549+0000 7f8971289640 1 -- 172.21.15.44:0/1717550298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0cd860 msgr2=0x7f896c14edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.549+0000 7f8971289640 1 --2- 172.21.15.44:0/1717550298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0cd860 0x7f896c14edf0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f895c00c7c0 tx=0x7f895c00cc80 comp rx=0 tx=0).stop 2023-11-04T01:38:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.549+0000 7f8971289640 1 -- 172.21.15.44:0/1717550298 shutdown_connections 2023-11-04T01:38:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.549+0000 7f8971289640 1 --2- 172.21.15.44:0/1717550298 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f894c06ae70 0x7f894c06d330 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.549+0000 7f8971289640 1 --2- 172.21.15.44:0/1717550298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f896c15bfb0 0x7f896c0ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.549+0000 7f8971289640 1 --2- 172.21.15.44:0/1717550298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f896c15ae40 0x7f896c0ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.549+0000 7f8971289640 1 --2- 172.21.15.44:0/1717550298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0cd860 0x7f896c14edf0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.549+0000 7f8971289640 1 -- 172.21.15.44:0/1717550298 >> 172.21.15.44:0/1717550298 conn(0x7f896c06ea90 msgr2=0x7f896c15c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.549+0000 7f8971289640 1 -- 172.21.15.44:0/1717550298 shutdown_connections 2023-11-04T01:38:30.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.549+0000 7f8971289640 1 -- 172.21.15.44:0/1717550298 wait complete. 2023-11-04T01:38:30.561 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2023-11-04T01:38:28.610924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":247,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227888,"kb_used_data":7556,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746832,"statfs":{"total":773094113280,"available":772860755968,"internally_reserved":0,"allocated":7737344,"data_stored":4202913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.847605"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.831224+0000","last_change":"2023-11-04T01:38:22.803506+0000","last_active":"2023-11-04T01:38:23.831224+0000","last_peered":"2023-11-04T01:38:23.831224+0000","last_clean":"2023-11-04T01:38:23.831224+0000","last_became_active":"2023-11-04T01:38:22.803229+0000","last_became_peered":"2023-11-04T01:38:22.803229+0000","last_unstale":"2023-11-04T01:38:23.831224+0000","last_undegraded":"2023-11-04T01:38:23.831224+0000","last_fullsized":"2023-11-04T01:38:23.831224+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:08:09.979283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.833197+0000","last_change":"2023-11-04T01:38:22.799223+0000","last_active":"2023-11-04T01:38:23.833197+0000","last_peered":"2023-11-04T01:38:23.833197+0000","last_clean":"2023-11-04T01:38:23.833197+0000","last_became_active":"2023-11-04T01:38:22.798420+0000","last_became_peered":"2023-11-04T01:38:22.798420+0000","last_unstale":"2023-11-04T01:38:23.833197+0000","last_undegraded":"2023-11-04T01:38:23.833197+0000","last_fullsized":"2023-11-04T01:38:23.833197+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:06.145374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830670+0000","last_change":"2023-11-04T01:38:22.787017+0000","last_active":"2023-11-04T01:38:23.830670+0000","last_peered":"2023-11-04T01:38:23.830670+0000","last_clean":"2023-11-04T01:38:23.830670+0000","last_became_active":"2023-11-04T01:38:22.786674+0000","last_became_peered":"2023-11-04T01:38:22.786674+0000","last_unstale":"2023-11-04T01:38:23.830670+0000","last_undegraded":"2023-11-04T01:38:23.830670+0000","last_fullsized":"2023-11-04T01:38:23.830670+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:26:12.909238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.777164+0000","last_change":"2023-11-04T01:38:22.801287+0000","last_active":"2023-11-04T01:38:23.777164+0000","last_peered":"2023-11-04T01:38:23.777164+0000","last_clean":"2023-11-04T01:38:23.777164+0000","last_became_active":"2023-11-04T01:38:22.800922+0000","last_became_peered":"2023-11-04T01:38:22.800922+0000","last_unstale":"2023-11-04T01:38:23.777164+0000","last_undegraded":"2023-11-04T01:38:23.777164+0000","last_fullsized":"2023-11-04T01:38:23.777164+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:54.814643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.779698+0000","last_change":"2023-11-04T01:38:22.794842+0000","last_active":"2023-11-04T01:38:23.779698+0000","last_peered":"2023-11-04T01:38:23.779698+0000","last_clean":"2023-11-04T01:38:23.779698+0000","last_became_active":"2023-11-04T01:38:22.794570+0000","last_became_peered":"2023-11-04T01:38:22.794570+0000","last_unstale":"2023-11-04T01:38:23.779698+0000","last_undegraded":"2023-11-04T01:38:23.779698+0000","last_fullsized":"2023-11-04T01:38:23.779698+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:46.851802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.832813+0000","last_change":"2023-11-04T01:38:22.799886+0000","last_active":"2023-11-04T01:38:23.832813+0000","last_peered":"2023-11-04T01:38:23.832813+0000","last_clean":"2023-11-04T01:38:23.832813+0000","last_became_active":"2023-11-04T01:38:22.798575+0000","last_became_peered":"2023-11-04T01:38:22.798575+0000","last_unstale":"2023-11-04T01:38:23.832813+0000","last_undegraded":"2023-11-04T01:38:23.832813+0000","last_fullsized":"2023-11-04T01:38:23.832813+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:34.192249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830703+0000","last_change":"2023-11-04T01:38:22.796428+0000","last_active":"2023-11-04T01:38:23.830703+0000","last_peered":"2023-11-04T01:38:23.830703+0000","last_clean":"2023-11-04T01:38:23.830703+0000","last_became_active":"2023-11-04T01:38:22.796146+0000","last_became_peered":"2023-11-04T01:38:22.796146+0000","last_unstale":"2023-11-04T01:38:23.830703+0000","last_undegraded":"2023-11-04T01:38:23.830703+0000","last_fullsized":"2023-11-04T01:38:23.830703+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:59:42.554311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.833129+0000","last_change":"2023-11-04T01:38:22.800467+0000","last_active":"2023-11-04T01:38:23.833129+0000","last_peered":"2023-11-04T01:38:23.833129+0000","last_clean":"2023-11-04T01:38:23.833129+0000","last_became_active":"2023-11-04T01:38:22.799382+0000","last_became_peered":"2023-11-04T01:38:22.799382+0000","last_unstale":"2023-11-04T01:38:23.833129+0000","last_undegraded":"2023-11-04T01:38:23.833129+0000","last_fullsized":"2023-11-04T01:38:23.833129+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:54.808985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.780177+0000","last_change":"2023-11-04T01:38:22.798980+0000","last_active":"2023-11-04T01:38:23.780177+0000","last_peered":"2023-11-04T01:38:23.780177+0000","last_clean":"2023-11-04T01:38:23.780177+0000","last_became_active":"2023-11-04T01:38:22.798365+0000","last_became_peered":"2023-11-04T01:38:22.798365+0000","last_unstale":"2023-11-04T01:38:23.780177+0000","last_undegraded":"2023-11-04T01:38:23.780177+0000","last_fullsized":"2023-11-04T01:38:23.780177+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:32:06.736713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.783121+0000","last_change":"2023-11-04T01:38:22.802210+0000","last_active":"2023-11-04T01:38:23.783121+0000","last_peered":"2023-11-04T01:38:23.783121+0000","last_clean":"2023-11-04T01:38:23.783121+0000","last_became_active":"2023-11-04T01:38:22.800475+0000","last_became_peered":"2023-11-04T01:38:22.800475+0000","last_unstale":"2023-11-04T01:38:23.783121+0000","last_undegraded":"2023-11-04T01:38:23.783121+0000","last_fullsized":"2023-11-04T01:38:23.783121+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:22:52.435471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830844+0000","last_change":"2023-11-04T01:38:22.798942+0000","last_active":"2023-11-04T01:38:23.830844+0000","last_peered":"2023-11-04T01:38:23.830844+0000","last_clean":"2023-11-04T01:38:23.830844+0000","last_became_active":"2023-11-04T01:38:22.798636+0000","last_became_peered":"2023-11-04T01:38:22.798636+0000","last_unstale":"2023-11-04T01:38:23.830844+0000","last_undegraded":"2023-11-04T01:38:23.830844+0000","last_fullsized":"2023-11-04T01:38:23.830844+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:44.180077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.777302+0000","last_change":"2023-11-04T01:38:22.802013+0000","last_active":"2023-11-04T01:38:23.777302+0000","last_peered":"2023-11-04T01:38:23.777302+0000","last_clean":"2023-11-04T01:38:23.777302+0000","last_became_active":"2023-11-04T01:38:22.801676+0000","last_became_peered":"2023-11-04T01:38:22.801676+0000","last_unstale":"2023-11-04T01:38:23.777302+0000","last_undegraded":"2023-11-04T01:38:23.777302+0000","last_fullsized":"2023-11-04T01:38:23.777302+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:32.238785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830042+0000","last_change":"2023-11-04T01:38:22.799811+0000","last_active":"2023-11-04T01:38:23.830042+0000","last_peered":"2023-11-04T01:38:23.830042+0000","last_clean":"2023-11-04T01:38:23.830042+0000","last_became_active":"2023-11-04T01:38:22.799475+0000","last_became_peered":"2023-11-04T01:38:22.799475+0000","last_unstale":"2023-11-04T01:38:23.830042+0000","last_undegraded":"2023-11-04T01:38:23.830042+0000","last_fullsized":"2023-11-04T01:38:23.830042+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:22.355691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.779775+0000","last_change":"2023-11-04T01:38:22.799716+0000","last_active":"2023-11-04T01:38:23.779775+0000","last_peered":"2023-11-04T01:38:23.779775+0000","last_clean":"2023-11-04T01:38:23.779775+0000","last_became_active":"2023-11-04T01:38:22.799417+0000","last_became_peered":"2023-11-04T01:38:22.799417+0000","last_unstale":"2023-11-04T01:38:23.779775+0000","last_undegraded":"2023-11-04T01:38:23.779775+0000","last_fullsized":"2023-11-04T01:38:23.779775+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:56:09.033790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.829748+0000","last_change":"2023-11-04T01:38:22.791523+0000","last_active":"2023-11-04T01:38:23.829748+0000","last_peered":"2023-11-04T01:38:23.829748+0000","last_clean":"2023-11-04T01:38:23.829748+0000","last_became_active":"2023-11-04T01:38:22.791234+0000","last_became_peered":"2023-11-04T01:38:22.791234+0000","last_unstale":"2023-11-04T01:38:23.829748+0000","last_undegraded":"2023-11-04T01:38:23.829748+0000","last_fullsized":"2023-11-04T01:38:23.829748+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:59:42.554311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.782606+0000","last_change":"2023-11-04T01:38:22.798241+0000","last_active":"2023-11-04T01:38:23.782606+0000","last_peered":"2023-11-04T01:38:23.782606+0000","last_clean":"2023-11-04T01:38:23.782606+0000","last_became_active":"2023-11-04T01:38:22.797963+0000","last_became_peered":"2023-11-04T01:38:22.797963+0000","last_unstale":"2023-11-04T01:38:23.782606+0000","last_undegraded":"2023-11-04T01:38:23.782606+0000","last_fullsized":"2023-11-04T01:38:23.782606+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:26.831190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.780282+0000","last_change":"2023-11-04T01:38:22.798808+0000","last_active":"2023-11-04T01:38:23.780282+0000","last_peered":"2023-11-04T01:38:23.780282+0000","last_clean":"2023-11-04T01:38:23.780282+0000","last_became_active":"2023-11-04T01:38:22.798009+0000","last_became_peered":"2023-11-04T01:38:22.798009+0000","last_unstale":"2023-11-04T01:38:23.780282+0000","last_undegraded":"2023-11-04T01:38:23.780282+0000","last_fullsized":"2023-11-04T01:38:23.780282+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:03:42.376421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.777267+0000","last_change":"2023-11-04T01:38:22.801359+0000","last_active":"2023-11-04T01:38:23.777267+0000","last_peered":"2023-11-04T01:38:23.777267+0000","last_clean":"2023-11-04T01:38:23.777267+0000","last_became_active":"2023-11-04T01:38:22.800916+0000","last_became_peered":"2023-11-04T01:38:22.800916+0000","last_unstale":"2023-11-04T01:38:23.777267+0000","last_undegraded":"2023-11-04T01:38:23.777267+0000","last_fullsized":"2023-11-04T01:38:23.777267+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:59.935299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.832866+0000","last_change":"2023-11-04T01:38:22.793003+0000","last_active":"2023-11-04T01:38:23.832866+0000","last_peered":"2023-11-04T01:38:23.832866+0000","last_clean":"2023-11-04T01:38:23.832866+0000","last_became_active":"2023-11-04T01:38:22.792725+0000","last_became_peered":"2023-11-04T01:38:22.792725+0000","last_unstale":"2023-11-04T01:38:23.832866+0000","last_undegraded":"2023-11-04T01:38:23.832866+0000","last_fullsized":"2023-11-04T01:38:23.832866+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:22:52.435471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830038+0000","last_change":"2023-11-04T01:38:22.797182+0000","last_active":"2023-11-04T01:38:23.830038+0000","last_peered":"2023-11-04T01:38:23.830038+0000","last_clean":"2023-11-04T01:38:23.830038+0000","last_became_active":"2023-11-04T01:38:22.796853+0000","last_became_peered":"2023-11-04T01:38:22.796853+0000","last_unstale":"2023-11-04T01:38:23.830038+0000","last_undegraded":"2023-11-04T01:38:23.830038+0000","last_fullsized":"2023-11-04T01:38:23.830038+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:15.609269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.782875+0000","last_change":"2023-11-04T01:38:22.784407+0000","last_active":"2023-11-04T01:38:23.782875+0000","last_peered":"2023-11-04T01:38:23.782875+0000","last_clean":"2023-11-04T01:38:23.782875+0000","last_became_active":"2023-11-04T01:38:22.784103+0000","last_became_peered":"2023-11-04T01:38:22.784103+0000","last_unstale":"2023-11-04T01:38:23.782875+0000","last_undegraded":"2023-11-04T01:38:23.782875+0000","last_fullsized":"2023-11-04T01:38:23.782875+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:03.403805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.782769+0000","last_change":"2023-11-04T01:38:22.801810+0000","last_active":"2023-11-04T01:38:23.782769+0000","last_peered":"2023-11-04T01:38:23.782769+0000","last_clean":"2023-11-04T01:38:23.782769+0000","last_became_active":"2023-11-04T01:38:22.800796+0000","last_became_peered":"2023-11-04T01:38:22.800796+0000","last_unstale":"2023-11-04T01:38:23.782769+0000","last_undegraded":"2023-11-04T01:38:23.782769+0000","last_fullsized":"2023-11-04T01:38:23.782769+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:47:57.330922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830235+0000","last_change":"2023-11-04T01:38:22.808812+0000","last_active":"2023-11-04T01:38:23.830235+0000","last_peered":"2023-11-04T01:38:23.830235+0000","last_clean":"2023-11-04T01:38:23.830235+0000","last_became_active":"2023-11-04T01:38:22.808564+0000","last_became_peered":"2023-11-04T01:38:22.808564+0000","last_unstale":"2023-11-04T01:38:23.830235+0000","last_undegraded":"2023-11-04T01:38:23.830235+0000","last_fullsized":"2023-11-04T01:38:23.830235+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:36.853590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830107+0000","last_change":"2023-11-04T01:38:22.805939+0000","last_active":"2023-11-04T01:38:23.830107+0000","last_peered":"2023-11-04T01:38:23.830107+0000","last_clean":"2023-11-04T01:38:23.830107+0000","last_became_active":"2023-11-04T01:38:22.802809+0000","last_became_peered":"2023-11-04T01:38:22.802809+0000","last_unstale":"2023-11-04T01:38:23.830107+0000","last_undegraded":"2023-11-04T01:38:23.830107+0000","last_fullsized":"2023-11-04T01:38:23.830107+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:24:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.783213+0000","last_change":"2023-11-04T01:38:22.794465+0000","last_active":"2023-11-04T01:38:23.783213+0000","last_peered":"2023-11-04T01:38:23.783213+0000","last_clean":"2023-11-04T01:38:23.783213+0000","last_became_active":"2023-11-04T01:38:22.793800+0000","last_became_peered":"2023-11-04T01:38:22.793800+0000","last_unstale":"2023-11-04T01:38:23.783213+0000","last_undegraded":"2023-11-04T01:38:23.783213+0000","last_fullsized":"2023-11-04T01:38:23.783213+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:54.808985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830492+0000","last_change":"2023-11-04T01:38:22.798262+0000","last_active":"2023-11-04T01:38:23.830492+0000","last_peered":"2023-11-04T01:38:23.830492+0000","last_clean":"2023-11-04T01:38:23.830492+0000","last_became_active":"2023-11-04T01:38:22.798017+0000","last_became_peered":"2023-11-04T01:38:22.798017+0000","last_unstale":"2023-11-04T01:38:23.830492+0000","last_undegraded":"2023-11-04T01:38:23.830492+0000","last_fullsized":"2023-11-04T01:38:23.830492+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:12.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830634+0000","last_change":"2023-11-04T01:38:22.795441+0000","last_active":"2023-11-04T01:38:23.830634+0000","last_peered":"2023-11-04T01:38:23.830634+0000","last_clean":"2023-11-04T01:38:23.830634+0000","last_became_active":"2023-11-04T01:38:22.795112+0000","last_became_peered":"2023-11-04T01:38:22.795112+0000","last_unstale":"2023-11-04T01:38:23.830634+0000","last_undegraded":"2023-11-04T01:38:23.830634+0000","last_fullsized":"2023-11-04T01:38:23.830634+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:47.927165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.782962+0000","last_change":"2023-11-04T01:38:22.801331+0000","last_active":"2023-11-04T01:38:23.782962+0000","last_peered":"2023-11-04T01:38:23.782962+0000","last_clean":"2023-11-04T01:38:23.782962+0000","last_became_active":"2023-11-04T01:38:22.801062+0000","last_became_peered":"2023-11-04T01:38:22.801062+0000","last_unstale":"2023-11-04T01:38:23.782962+0000","last_undegraded":"2023-11-04T01:38:23.782962+0000","last_fullsized":"2023-11-04T01:38:23.782962+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:27:34.192249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830410+0000","last_change":"2023-11-04T01:38:22.795113+0000","last_active":"2023-11-04T01:38:23.830410+0000","last_peered":"2023-11-04T01:38:23.830410+0000","last_clean":"2023-11-04T01:38:23.830410+0000","last_became_active":"2023-11-04T01:38:22.794472+0000","last_became_peered":"2023-11-04T01:38:22.794472+0000","last_unstale":"2023-11-04T01:38:23.830410+0000","last_undegraded":"2023-11-04T01:38:23.830410+0000","last_fullsized":"2023-11-04T01:38:23.830410+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:06.684897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830241+0000","last_change":"2023-11-04T01:38:22.800816+0000","last_active":"2023-11-04T01:38:23.830241+0000","last_peered":"2023-11-04T01:38:23.830241+0000","last_clean":"2023-11-04T01:38:23.830241+0000","last_became_active":"2023-11-04T01:38:22.800553+0000","last_became_peered":"2023-11-04T01:38:22.800553+0000","last_unstale":"2023-11-04T01:38:23.830241+0000","last_undegraded":"2023-11-04T01:38:23.830241+0000","last_fullsized":"2023-11-04T01:38:23.830241+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:01:35.402167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830514+0000","last_change":"2023-11-04T01:38:22.805387+0000","last_active":"2023-11-04T01:38:23.830514+0000","last_peered":"2023-11-04T01:38:23.830514+0000","last_clean":"2023-11-04T01:38:23.830514+0000","last_became_active":"2023-11-04T01:38:22.804944+0000","last_became_peered":"2023-11-04T01:38:22.804944+0000","last_unstale":"2023-11-04T01:38:23.830514+0000","last_undegraded":"2023-11-04T01:38:23.830514+0000","last_fullsized":"2023-11-04T01:38:23.830514+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:19.630813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.832680+0000","last_change":"2023-11-04T01:38:22.797088+0000","last_active":"2023-11-04T01:38:23.832680+0000","last_peered":"2023-11-04T01:38:23.832680+0000","last_clean":"2023-11-04T01:38:23.832680+0000","last_became_active":"2023-11-04T01:38:22.796658+0000","last_became_peered":"2023-11-04T01:38:22.796658+0000","last_unstale":"2023-11-04T01:38:23.832680+0000","last_undegraded":"2023-11-04T01:38:23.832680+0000","last_fullsized":"2023-11-04T01:38:23.832680+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:03.403805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.779695+0000","last_change":"2023-11-04T01:38:22.792052+0000","last_active":"2023-11-04T01:38:23.779695+0000","last_peered":"2023-11-04T01:38:23.779695+0000","last_clean":"2023-11-04T01:38:23.779695+0000","last_became_active":"2023-11-04T01:38:22.791766+0000","last_became_peered":"2023-11-04T01:38:22.791766+0000","last_unstale":"2023-11-04T01:38:23.779695+0000","last_undegraded":"2023-11-04T01:38:23.779695+0000","last_fullsized":"2023-11-04T01:38:23.779695+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:46:48.655557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"66'8","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.814478+0000","last_change":"2023-11-04T01:38:21.779581+0000","last_active":"2023-11-04T01:38:22.814478+0000","last_peered":"2023-11-04T01:38:22.814478+0000","last_clean":"2023-11-04T01:38:22.814478+0000","last_became_active":"2023-11-04T01:38:21.778750+0000","last_became_peered":"2023-11-04T01:38:21.778750+0000","last_unstale":"2023-11-04T01:38:22.814478+0000","last_undegraded":"2023-11-04T01:38:22.814478+0000","last_fullsized":"2023-11-04T01:38:22.814478+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:31.234356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.780058+0000","last_change":"2023-11-04T01:37:36.221026+0000","last_active":"2023-11-04T01:38:22.780058+0000","last_peered":"2023-11-04T01:38:22.780058+0000","last_clean":"2023-11-04T01:38:22.780058+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:38:22.780058+0000","last_undegraded":"2023-11-04T01:38:22.780058+0000","last_fullsized":"2023-11-04T01:38:22.780058+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067716399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.829790+0000","last_change":"2023-11-04T01:38:22.797454+0000","last_active":"2023-11-04T01:38:23.829790+0000","last_peered":"2023-11-04T01:38:23.829790+0000","last_clean":"2023-11-04T01:38:23.829790+0000","last_became_active":"2023-11-04T01:38:22.797067+0000","last_became_peered":"2023-11-04T01:38:22.797067+0000","last_unstale":"2023-11-04T01:38:23.829790+0000","last_undegraded":"2023-11-04T01:38:23.829790+0000","last_fullsized":"2023-11-04T01:38:23.829790+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:44.180077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.792469+0000","last_change":"2023-11-04T01:38:21.778896+0000","last_active":"2023-11-04T01:38:22.792469+0000","last_peered":"2023-11-04T01:38:22.792469+0000","last_clean":"2023-11-04T01:38:22.792469+0000","last_became_active":"2023-11-04T01:38:21.778441+0000","last_became_peered":"2023-11-04T01:38:21.778441+0000","last_unstale":"2023-11-04T01:38:22.792469+0000","last_undegraded":"2023-11-04T01:38:22.792469+0000","last_fullsized":"2023-11-04T01:38:22.792469+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:53:41.724804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.792290+0000","last_change":"2023-11-04T01:37:36.229027+0000","last_active":"2023-11-04T01:38:22.792290+0000","last_peered":"2023-11-04T01:38:22.792290+0000","last_clean":"2023-11-04T01:38:22.792290+0000","last_became_active":"2023-11-04T01:37:35.218342+0000","last_became_peered":"2023-11-04T01:37:35.218342+0000","last_unstale":"2023-11-04T01:38:22.792290+0000","last_undegraded":"2023-11-04T01:38:22.792290+0000","last_fullsized":"2023-11-04T01:38:22.792290+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059666400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830528+0000","last_change":"2023-11-04T01:38:22.795880+0000","last_active":"2023-11-04T01:38:23.830528+0000","last_peered":"2023-11-04T01:38:23.830528+0000","last_clean":"2023-11-04T01:38:23.830528+0000","last_became_active":"2023-11-04T01:38:22.795564+0000","last_became_peered":"2023-11-04T01:38:22.795564+0000","last_unstale":"2023-11-04T01:38:23.830528+0000","last_undegraded":"2023-11-04T01:38:23.830528+0000","last_fullsized":"2023-11-04T01:38:23.830528+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:24:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.791807+0000","last_change":"2023-11-04T01:38:21.784835+0000","last_active":"2023-11-04T01:38:22.791807+0000","last_peered":"2023-11-04T01:38:22.791807+0000","last_clean":"2023-11-04T01:38:22.791807+0000","last_became_active":"2023-11-04T01:38:21.784180+0000","last_became_peered":"2023-11-04T01:38:21.784180+0000","last_unstale":"2023-11-04T01:38:22.791807+0000","last_undegraded":"2023-11-04T01:38:22.791807+0000","last_fullsized":"2023-11-04T01:38:22.791807+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:53.209470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.786229+0000","last_change":"2023-11-04T01:37:36.222868+0000","last_active":"2023-11-04T01:38:22.786229+0000","last_peered":"2023-11-04T01:38:22.786229+0000","last_clean":"2023-11-04T01:38:22.786229+0000","last_became_active":"2023-11-04T01:37:35.220180+0000","last_became_peered":"2023-11-04T01:37:35.220180+0000","last_unstale":"2023-11-04T01:38:22.786229+0000","last_undegraded":"2023-11-04T01:38:22.786229+0000","last_fullsized":"2023-11-04T01:38:22.786229+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001103574,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830634+0000","last_change":"2023-11-04T01:38:22.804842+0000","last_active":"2023-11-04T01:38:23.830634+0000","last_peered":"2023-11-04T01:38:23.830634+0000","last_clean":"2023-11-04T01:38:23.830634+0000","last_became_active":"2023-11-04T01:38:22.804508+0000","last_became_peered":"2023-11-04T01:38:22.804508+0000","last_unstale":"2023-11-04T01:38:23.830634+0000","last_undegraded":"2023-11-04T01:38:23.830634+0000","last_fullsized":"2023-11-04T01:38:23.830634+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:59:42.554311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813902+0000","last_change":"2023-11-04T01:38:21.779892+0000","last_active":"2023-11-04T01:38:22.813902+0000","last_peered":"2023-11-04T01:38:22.813902+0000","last_clean":"2023-11-04T01:38:22.813902+0000","last_became_active":"2023-11-04T01:38:21.779593+0000","last_became_peered":"2023-11-04T01:38:21.779593+0000","last_unstale":"2023-11-04T01:38:22.813902+0000","last_undegraded":"2023-11-04T01:38:22.813902+0000","last_fullsized":"2023-11-04T01:38:22.813902+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:52.506126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.780187+0000","last_change":"2023-11-04T01:37:36.221053+0000","last_active":"2023-11-04T01:38:22.780187+0000","last_peered":"2023-11-04T01:38:22.780187+0000","last_clean":"2023-11-04T01:38:22.780187+0000","last_became_active":"2023-11-04T01:37:35.227176+0000","last_became_peered":"2023-11-04T01:37:35.227176+0000","last_unstale":"2023-11-04T01:38:22.780187+0000","last_undegraded":"2023-11-04T01:38:22.780187+0000","last_fullsized":"2023-11-04T01:38:22.780187+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000594178,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.780050+0000","last_change":"2023-11-04T01:38:22.792465+0000","last_active":"2023-11-04T01:38:23.780050+0000","last_peered":"2023-11-04T01:38:23.780050+0000","last_clean":"2023-11-04T01:38:23.780050+0000","last_became_active":"2023-11-04T01:38:22.792194+0000","last_became_peered":"2023-11-04T01:38:22.792194+0000","last_unstale":"2023-11-04T01:38:23.780050+0000","last_undegraded":"2023-11-04T01:38:23.780050+0000","last_fullsized":"2023-11-04T01:38:23.780050+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:58.620973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"66'6","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.814795+0000","last_change":"2023-11-04T01:38:21.784953+0000","last_active":"2023-11-04T01:38:22.814795+0000","last_peered":"2023-11-04T01:38:22.814795+0000","last_clean":"2023-11-04T01:38:22.814795+0000","last_became_active":"2023-11-04T01:38:21.784671+0000","last_became_peered":"2023-11-04T01:38:21.784671+0000","last_unstale":"2023-11-04T01:38:22.814795+0000","last_undegraded":"2023-11-04T01:38:22.814795+0000","last_fullsized":"2023-11-04T01:38:22.814795+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:02:36.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.788287+0000","last_change":"2023-11-04T01:37:36.221842+0000","last_active":"2023-11-04T01:38:22.788287+0000","last_peered":"2023-11-04T01:38:22.788287+0000","last_clean":"2023-11-04T01:38:22.788287+0000","last_became_active":"2023-11-04T01:37:35.214305+0000","last_became_peered":"2023-11-04T01:37:35.214305+0000","last_unstale":"2023-11-04T01:38:22.788287+0000","last_undegraded":"2023-11-04T01:38:22.788287+0000","last_fullsized":"2023-11-04T01:38:22.788287+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:13:05.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014999690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.833212+0000","last_change":"2023-11-04T01:38:22.799711+0000","last_active":"2023-11-04T01:38:23.833212+0000","last_peered":"2023-11-04T01:38:23.833212+0000","last_clean":"2023-11-04T01:38:23.833212+0000","last_became_active":"2023-11-04T01:38:22.798255+0000","last_became_peered":"2023-11-04T01:38:22.798255+0000","last_unstale":"2023-11-04T01:38:23.833212+0000","last_undegraded":"2023-11-04T01:38:23.833212+0000","last_fullsized":"2023-11-04T01:38:23.833212+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:50.775290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"66'3","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.805811+0000","last_change":"2023-11-04T01:38:21.782430+0000","last_active":"2023-11-04T01:38:22.805811+0000","last_peered":"2023-11-04T01:38:22.805811+0000","last_clean":"2023-11-04T01:38:22.805811+0000","last_became_active":"2023-11-04T01:38:21.782146+0000","last_became_peered":"2023-11-04T01:38:21.782146+0000","last_unstale":"2023-11-04T01:38:22.805811+0000","last_undegraded":"2023-11-04T01:38:22.805811+0000","last_fullsized":"2023-11-04T01:38:22.805811+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:06.786335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.775761+0000","last_change":"2023-11-04T01:37:36.694601+0000","last_active":"2023-11-04T01:38:22.775761+0000","last_peered":"2023-11-04T01:38:22.775761+0000","last_clean":"2023-11-04T01:38:22.775761+0000","last_became_active":"2023-11-04T01:37:35.223746+0000","last_became_peered":"2023-11-04T01:37:35.223746+0000","last_unstale":"2023-11-04T01:38:22.775761+0000","last_undegraded":"2023-11-04T01:38:22.775761+0000","last_fullsized":"2023-11-04T01:38:22.775761+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:35.960485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000555376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.831330+0000","last_change":"2023-11-04T01:38:22.802385+0000","last_active":"2023-11-04T01:38:23.831330+0000","last_peered":"2023-11-04T01:38:23.831330+0000","last_clean":"2023-11-04T01:38:23.831330+0000","last_became_active":"2023-11-04T01:38:22.802103+0000","last_became_peered":"2023-11-04T01:38:22.802103+0000","last_unstale":"2023-11-04T01:38:23.831330+0000","last_undegraded":"2023-11-04T01:38:23.831330+0000","last_fullsized":"2023-11-04T01:38:23.831330+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:16:55.358200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.789342+0000","last_change":"2023-11-04T01:38:21.781376+0000","last_active":"2023-11-04T01:38:22.789342+0000","last_peered":"2023-11-04T01:38:22.789342+0000","last_clean":"2023-11-04T01:38:22.789342+0000","last_became_active":"2023-11-04T01:38:21.781092+0000","last_became_peered":"2023-11-04T01:38:21.781092+0000","last_unstale":"2023-11-04T01:38:22.789342+0000","last_undegraded":"2023-11-04T01:38:22.789342+0000","last_fullsized":"2023-11-04T01:38:22.789342+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:02:36.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.776370+0000","last_change":"2023-11-04T01:37:36.695075+0000","last_active":"2023-11-04T01:38:22.776370+0000","last_peered":"2023-11-04T01:38:22.776370+0000","last_clean":"2023-11-04T01:38:22.776370+0000","last_became_active":"2023-11-04T01:37:35.221165+0000","last_became_peered":"2023-11-04T01:37:35.221165+0000","last_unstale":"2023-11-04T01:38:22.776370+0000","last_undegraded":"2023-11-04T01:38:22.776370+0000","last_fullsized":"2023-11-04T01:38:22.776370+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:17.958372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072817499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830649+0000","last_change":"2023-11-04T01:38:22.795282+0000","last_active":"2023-11-04T01:38:23.830649+0000","last_peered":"2023-11-04T01:38:23.830649+0000","last_clean":"2023-11-04T01:38:23.830649+0000","last_became_active":"2023-11-04T01:38:22.794982+0000","last_became_peered":"2023-11-04T01:38:22.794982+0000","last_unstale":"2023-11-04T01:38:23.830649+0000","last_undegraded":"2023-11-04T01:38:23.830649+0000","last_fullsized":"2023-11-04T01:38:23.830649+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:36.853590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.780658+0000","last_change":"2023-11-04T01:38:21.772813+0000","last_active":"2023-11-04T01:38:22.780658+0000","last_peered":"2023-11-04T01:38:22.780658+0000","last_clean":"2023-11-04T01:38:22.780658+0000","last_became_active":"2023-11-04T01:38:21.772538+0000","last_became_peered":"2023-11-04T01:38:21.772538+0000","last_unstale":"2023-11-04T01:38:22.780658+0000","last_undegraded":"2023-11-04T01:38:22.780658+0000","last_fullsized":"2023-11-04T01:38:22.780658+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:58.930870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":40,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.780158+0000","last_change":"2023-11-04T01:37:36.221747+0000","last_active":"2023-11-04T01:38:22.780158+0000","last_peered":"2023-11-04T01:38:22.780158+0000","last_clean":"2023-11-04T01:38:22.780158+0000","last_became_active":"2023-11-04T01:37:35.223198+0000","last_became_peered":"2023-11-04T01:37:35.223198+0000","last_unstale":"2023-11-04T01:38:22.780158+0000","last_undegraded":"2023-11-04T01:38:22.780158+0000","last_fullsized":"2023-11-04T01:38:22.780158+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097726499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.829890+0000","last_change":"2023-11-04T01:38:22.797675+0000","last_active":"2023-11-04T01:38:23.829890+0000","last_peered":"2023-11-04T01:38:23.829890+0000","last_clean":"2023-11-04T01:38:23.829890+0000","last_became_active":"2023-11-04T01:38:22.797328+0000","last_became_peered":"2023-11-04T01:38:22.797328+0000","last_unstale":"2023-11-04T01:38:23.829890+0000","last_undegraded":"2023-11-04T01:38:23.829890+0000","last_fullsized":"2023-11-04T01:38:23.829890+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:09.307824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.782625+0000","last_change":"2023-11-04T01:38:21.779870+0000","last_active":"2023-11-04T01:38:22.782625+0000","last_peered":"2023-11-04T01:38:22.782625+0000","last_clean":"2023-11-04T01:38:22.782625+0000","last_became_active":"2023-11-04T01:38:21.779617+0000","last_became_peered":"2023-11-04T01:38:21.779617+0000","last_unstale":"2023-11-04T01:38:22.782625+0000","last_undegraded":"2023-11-04T01:38:22.782625+0000","last_fullsized":"2023-11-04T01:38:22.782625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:43.450673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.789674+0000","last_change":"2023-11-04T01:37:36.422496+0000","last_active":"2023-11-04T01:38:22.789674+0000","last_peered":"2023-11-04T01:38:22.789674+0000","last_clean":"2023-11-04T01:38:22.789674+0000","last_became_active":"2023-11-04T01:37:35.221763+0000","last_became_peered":"2023-11-04T01:37:35.221763+0000","last_unstale":"2023-11-04T01:38:22.789674+0000","last_undegraded":"2023-11-04T01:38:22.789674+0000","last_fullsized":"2023-11-04T01:38:22.789674+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073676299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.779510+0000","last_change":"2023-11-04T01:38:22.795543+0000","last_active":"2023-11-04T01:38:23.779510+0000","last_peered":"2023-11-04T01:38:23.779510+0000","last_clean":"2023-11-04T01:38:23.779510+0000","last_became_active":"2023-11-04T01:38:22.795280+0000","last_became_peered":"2023-11-04T01:38:22.795280+0000","last_unstale":"2023-11-04T01:38:23.779510+0000","last_undegraded":"2023-11-04T01:38:23.779510+0000","last_fullsized":"2023-11-04T01:38:23.779510+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:43.074702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.779636+0000","last_change":"2023-11-04T01:38:21.786403+0000","last_active":"2023-11-04T01:38:22.779636+0000","last_peered":"2023-11-04T01:38:22.779636+0000","last_clean":"2023-11-04T01:38:22.779636+0000","last_became_active":"2023-11-04T01:38:21.786122+0000","last_became_peered":"2023-11-04T01:38:21.786122+0000","last_unstale":"2023-11-04T01:38:22.779636+0000","last_undegraded":"2023-11-04T01:38:22.779636+0000","last_fullsized":"2023-11-04T01:38:22.779636+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:36.539159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":39,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.781834+0000","last_change":"2023-11-04T01:37:36.229940+0000","last_active":"2023-11-04T01:38:22.781834+0000","last_peered":"2023-11-04T01:38:22.781834+0000","last_clean":"2023-11-04T01:38:22.781834+0000","last_became_active":"2023-11-04T01:37:35.225121+0000","last_became_peered":"2023-11-04T01:37:35.225121+0000","last_unstale":"2023-11-04T01:38:22.781834+0000","last_undegraded":"2023-11-04T01:38:22.781834+0000","last_fullsized":"2023-11-04T01:38:22.781834+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:12.130671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075648399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.782957+0000","last_change":"2023-11-04T01:38:22.794519+0000","last_active":"2023-11-04T01:38:23.782957+0000","last_peered":"2023-11-04T01:38:23.782957+0000","last_clean":"2023-11-04T01:38:23.782957+0000","last_became_active":"2023-11-04T01:38:22.793831+0000","last_became_peered":"2023-11-04T01:38:22.793831+0000","last_unstale":"2023-11-04T01:38:23.782957+0000","last_undegraded":"2023-11-04T01:38:23.782957+0000","last_fullsized":"2023-11-04T01:38:23.782957+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:03.356308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813592+0000","last_change":"2023-11-04T01:38:21.784160+0000","last_active":"2023-11-04T01:38:22.813592+0000","last_peered":"2023-11-04T01:38:22.813592+0000","last_clean":"2023-11-04T01:38:22.813592+0000","last_became_active":"2023-11-04T01:38:21.782805+0000","last_became_peered":"2023-11-04T01:38:21.782805+0000","last_unstale":"2023-11-04T01:38:22.813592+0000","last_undegraded":"2023-11-04T01:38:22.813592+0000","last_fullsized":"2023-11-04T01:38:22.813592+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:31.234356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.790959+0000","last_change":"2023-11-04T01:37:36.422801+0000","last_active":"2023-11-04T01:38:22.790959+0000","last_peered":"2023-11-04T01:38:22.790959+0000","last_clean":"2023-11-04T01:38:22.790959+0000","last_became_active":"2023-11-04T01:37:35.217091+0000","last_became_peered":"2023-11-04T01:37:35.217091+0000","last_unstale":"2023-11-04T01:38:22.790959+0000","last_undegraded":"2023-11-04T01:38:22.790959+0000","last_fullsized":"2023-11-04T01:38:22.790959+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082211999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830285+0000","last_change":"2023-11-04T01:38:22.794250+0000","last_active":"2023-11-04T01:38:23.830285+0000","last_peered":"2023-11-04T01:38:23.830285+0000","last_clean":"2023-11-04T01:38:23.830285+0000","last_became_active":"2023-11-04T01:38:22.793734+0000","last_became_peered":"2023-11-04T01:38:22.793734+0000","last_unstale":"2023-11-04T01:38:23.830285+0000","last_undegraded":"2023-11-04T01:38:23.830285+0000","last_fullsized":"2023-11-04T01:38:23.830285+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:44.575251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813098+0000","last_change":"2023-11-04T01:38:21.780310+0000","last_active":"2023-11-04T01:38:22.813098+0000","last_peered":"2023-11-04T01:38:22.813098+0000","last_clean":"2023-11-04T01:38:22.813098+0000","last_became_active":"2023-11-04T01:38:21.779975+0000","last_became_peered":"2023-11-04T01:38:21.779975+0000","last_unstale":"2023-11-04T01:38:22.813098+0000","last_undegraded":"2023-11-04T01:38:22.813098+0000","last_fullsized":"2023-11-04T01:38:22.813098+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:08.019410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":40,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.781447+0000","last_change":"2023-11-04T01:37:36.222683+0000","last_active":"2023-11-04T01:38:22.781447+0000","last_peered":"2023-11-04T01:38:22.781447+0000","last_clean":"2023-11-04T01:38:22.781447+0000","last_became_active":"2023-11-04T01:37:35.222694+0000","last_became_peered":"2023-11-04T01:37:35.222694+0000","last_unstale":"2023-11-04T01:38:22.781447+0000","last_undegraded":"2023-11-04T01:38:22.781447+0000","last_fullsized":"2023-11-04T01:38:22.781447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000490194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830929+0000","last_change":"2023-11-04T01:38:22.806766+0000","last_active":"2023-11-04T01:38:23.830929+0000","last_peered":"2023-11-04T01:38:23.830929+0000","last_clean":"2023-11-04T01:38:23.830929+0000","last_became_active":"2023-11-04T01:38:22.806507+0000","last_became_peered":"2023-11-04T01:38:22.806507+0000","last_unstale":"2023-11-04T01:38:23.830929+0000","last_undegraded":"2023-11-04T01:38:23.830929+0000","last_fullsized":"2023-11-04T01:38:23.830929+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:09.307824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813614+0000","last_change":"2023-11-04T01:38:21.784145+0000","last_active":"2023-11-04T01:38:22.813614+0000","last_peered":"2023-11-04T01:38:22.813614+0000","last_clean":"2023-11-04T01:38:22.813614+0000","last_became_active":"2023-11-04T01:38:21.783207+0000","last_became_peered":"2023-11-04T01:38:21.783207+0000","last_unstale":"2023-11-04T01:38:22.813614+0000","last_undegraded":"2023-11-04T01:38:22.813614+0000","last_fullsized":"2023-11-04T01:38:22.813614+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:52.506126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.787531+0000","last_change":"2023-11-04T01:37:36.422156+0000","last_active":"2023-11-04T01:38:22.787531+0000","last_peered":"2023-11-04T01:38:22.787531+0000","last_clean":"2023-11-04T01:38:22.787531+0000","last_became_active":"2023-11-04T01:37:35.214925+0000","last_became_peered":"2023-11-04T01:37:35.214925+0000","last_unstale":"2023-11-04T01:38:22.787531+0000","last_undegraded":"2023-11-04T01:38:22.787531+0000","last_fullsized":"2023-11-04T01:38:22.787531+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058029000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.833105+0000","last_change":"2023-11-04T01:38:22.799043+0000","last_active":"2023-11-04T01:38:23.833105+0000","last_peered":"2023-11-04T01:38:23.833105+0000","last_clean":"2023-11-04T01:38:23.833105+0000","last_became_active":"2023-11-04T01:38:22.798517+0000","last_became_peered":"2023-11-04T01:38:22.798517+0000","last_unstale":"2023-11-04T01:38:23.833105+0000","last_undegraded":"2023-11-04T01:38:23.833105+0000","last_fullsized":"2023-11-04T01:38:23.833105+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:48.333335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.812961+0000","last_change":"2023-11-04T01:38:21.783965+0000","last_active":"2023-11-04T01:38:22.812961+0000","last_peered":"2023-11-04T01:38:22.812961+0000","last_clean":"2023-11-04T01:38:22.812961+0000","last_became_active":"2023-11-04T01:38:21.783696+0000","last_became_peered":"2023-11-04T01:38:21.783696+0000","last_unstale":"2023-11-04T01:38:22.812961+0000","last_undegraded":"2023-11-04T01:38:22.812961+0000","last_fullsized":"2023-11-04T01:38:22.812961+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:48:46.983426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":39,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.780575+0000","last_change":"2023-11-04T01:37:36.229258+0000","last_active":"2023-11-04T01:38:22.780575+0000","last_peered":"2023-11-04T01:38:22.780575+0000","last_clean":"2023-11-04T01:38:22.780575+0000","last_became_active":"2023-11-04T01:37:35.221720+0000","last_became_peered":"2023-11-04T01:37:35.221720+0000","last_unstale":"2023-11-04T01:38:22.780575+0000","last_undegraded":"2023-11-04T01:38:22.780575+0000","last_fullsized":"2023-11-04T01:38:22.780575+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:09.633236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068644799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.780331+0000","last_change":"2023-11-04T01:38:22.798636+0000","last_active":"2023-11-04T01:38:23.780331+0000","last_peered":"2023-11-04T01:38:23.780331+0000","last_clean":"2023-11-04T01:38:23.780331+0000","last_became_active":"2023-11-04T01:38:22.797632+0000","last_became_peered":"2023-11-04T01:38:22.797632+0000","last_unstale":"2023-11-04T01:38:23.780331+0000","last_undegraded":"2023-11-04T01:38:23.780331+0000","last_fullsized":"2023-11-04T01:38:23.780331+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:35.469589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.806542+0000","last_change":"2023-11-04T01:38:21.777757+0000","last_active":"2023-11-04T01:38:22.806542+0000","last_peered":"2023-11-04T01:38:22.806542+0000","last_clean":"2023-11-04T01:38:22.806542+0000","last_became_active":"2023-11-04T01:38:21.777505+0000","last_became_peered":"2023-11-04T01:38:21.777505+0000","last_unstale":"2023-11-04T01:38:22.806542+0000","last_undegraded":"2023-11-04T01:38:22.806542+0000","last_fullsized":"2023-11-04T01:38:22.806542+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:18.626383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.776486+0000","last_change":"2023-11-04T01:37:36.695175+0000","last_active":"2023-11-04T01:38:22.776486+0000","last_peered":"2023-11-04T01:38:22.776486+0000","last_clean":"2023-11-04T01:38:22.776486+0000","last_became_active":"2023-11-04T01:37:35.224473+0000","last_became_peered":"2023-11-04T01:37:35.224473+0000","last_unstale":"2023-11-04T01:38:22.776486+0000","last_undegraded":"2023-11-04T01:38:22.776486+0000","last_fullsized":"2023-11-04T01:38:22.776486+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065377199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.831192+0000","last_change":"2023-11-04T01:38:22.801508+0000","last_active":"2023-11-04T01:38:23.831192+0000","last_peered":"2023-11-04T01:38:23.831192+0000","last_clean":"2023-11-04T01:38:23.831192+0000","last_became_active":"2023-11-04T01:38:22.801215+0000","last_became_peered":"2023-11-04T01:38:22.801215+0000","last_unstale":"2023-11-04T01:38:23.831192+0000","last_undegraded":"2023-11-04T01:38:23.831192+0000","last_fullsized":"2023-11-04T01:38:23.831192+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:19.786964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"66'4","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.806152+0000","last_change":"2023-11-04T01:38:21.780841+0000","last_active":"2023-11-04T01:38:22.806152+0000","last_peered":"2023-11-04T01:38:22.806152+0000","last_clean":"2023-11-04T01:38:22.806152+0000","last_became_active":"2023-11-04T01:38:21.780546+0000","last_became_peered":"2023-11-04T01:38:21.780546+0000","last_unstale":"2023-11-04T01:38:22.806152+0000","last_undegraded":"2023-11-04T01:38:22.806152+0000","last_fullsized":"2023-11-04T01:38:22.806152+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:09.798992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.792601+0000","last_change":"2023-11-04T01:37:36.222100+0000","last_active":"2023-11-04T01:38:22.792601+0000","last_peered":"2023-11-04T01:38:22.792601+0000","last_clean":"2023-11-04T01:38:22.792601+0000","last_became_active":"2023-11-04T01:37:35.219622+0000","last_became_peered":"2023-11-04T01:37:35.219622+0000","last_unstale":"2023-11-04T01:38:22.792601+0000","last_undegraded":"2023-11-04T01:38:22.792601+0000","last_fullsized":"2023-11-04T01:38:22.792601+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:16.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653496,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.832572+0000","last_change":"2023-11-04T01:38:22.799482+0000","last_active":"2023-11-04T01:38:23.832572+0000","last_peered":"2023-11-04T01:38:23.832572+0000","last_clean":"2023-11-04T01:38:23.832572+0000","last_became_active":"2023-11-04T01:38:22.798760+0000","last_became_peered":"2023-11-04T01:38:22.798760+0000","last_unstale":"2023-11-04T01:38:23.832572+0000","last_undegraded":"2023-11-04T01:38:23.832572+0000","last_fullsized":"2023-11-04T01:38:23.832572+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:47:57.330922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.792584+0000","last_change":"2023-11-04T01:38:21.784682+0000","last_active":"2023-11-04T01:38:22.792584+0000","last_peered":"2023-11-04T01:38:22.792584+0000","last_clean":"2023-11-04T01:38:22.792584+0000","last_became_active":"2023-11-04T01:38:21.784421+0000","last_became_peered":"2023-11-04T01:38:21.784421+0000","last_unstale":"2023-11-04T01:38:22.792584+0000","last_undegraded":"2023-11-04T01:38:22.792584+0000","last_fullsized":"2023-11-04T01:38:22.792584+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:58.930870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.786739+0000","last_change":"2023-11-04T01:37:36.222451+0000","last_active":"2023-11-04T01:38:22.786739+0000","last_peered":"2023-11-04T01:38:22.786739+0000","last_clean":"2023-11-04T01:38:22.786739+0000","last_became_active":"2023-11-04T01:37:35.221090+0000","last_became_peered":"2023-11-04T01:37:35.221090+0000","last_unstale":"2023-11-04T01:38:22.786739+0000","last_undegraded":"2023-11-04T01:38:22.786739+0000","last_fullsized":"2023-11-04T01:38:22.786739+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077263799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.776943+0000","last_change":"2023-11-04T01:38:22.784057+0000","last_active":"2023-11-04T01:38:23.776943+0000","last_peered":"2023-11-04T01:38:23.776943+0000","last_clean":"2023-11-04T01:38:23.776943+0000","last_became_active":"2023-11-04T01:38:22.783674+0000","last_became_peered":"2023-11-04T01:38:22.783674+0000","last_unstale":"2023-11-04T01:38:23.776943+0000","last_undegraded":"2023-11-04T01:38:23.776943+0000","last_fullsized":"2023-11-04T01:38:23.776943+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:54.213899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.779854+0000","last_change":"2023-11-04T01:38:21.778357+0000","last_active":"2023-11-04T01:38:22.779854+0000","last_peered":"2023-11-04T01:38:22.779854+0000","last_clean":"2023-11-04T01:38:22.779854+0000","last_became_active":"2023-11-04T01:38:21.778099+0000","last_became_peered":"2023-11-04T01:38:21.778099+0000","last_unstale":"2023-11-04T01:38:22.779854+0000","last_undegraded":"2023-11-04T01:38:22.779854+0000","last_fullsized":"2023-11-04T01:38:22.779854+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:04.983882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.787922+0000","last_change":"2023-11-04T01:37:36.222643+0000","last_active":"2023-11-04T01:38:22.787922+0000","last_peered":"2023-11-04T01:38:22.787922+0000","last_clean":"2023-11-04T01:38:22.787922+0000","last_became_active":"2023-11-04T01:37:35.215534+0000","last_became_peered":"2023-11-04T01:37:35.215534+0000","last_unstale":"2023-11-04T01:38:22.787922+0000","last_undegraded":"2023-11-04T01:38:22.787922+0000","last_fullsized":"2023-11-04T01:38:22.787922+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011110530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.832776+0000","last_change":"2023-11-04T01:38:22.797548+0000","last_active":"2023-11-04T01:38:23.832776+0000","last_peered":"2023-11-04T01:38:23.832776+0000","last_clean":"2023-11-04T01:38:23.832776+0000","last_became_active":"2023-11-04T01:38:22.797276+0000","last_became_peered":"2023-11-04T01:38:22.797276+0000","last_unstale":"2023-11-04T01:38:23.832776+0000","last_undegraded":"2023-11-04T01:38:23.832776+0000","last_fullsized":"2023-11-04T01:38:23.832776+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:03.356308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.779717+0000","last_change":"2023-11-04T01:38:21.786427+0000","last_active":"2023-11-04T01:38:22.779717+0000","last_peered":"2023-11-04T01:38:22.779717+0000","last_clean":"2023-11-04T01:38:22.779717+0000","last_became_active":"2023-11-04T01:38:21.786189+0000","last_became_peered":"2023-11-04T01:38:21.786189+0000","last_unstale":"2023-11-04T01:38:22.779717+0000","last_undegraded":"2023-11-04T01:38:22.779717+0000","last_fullsized":"2023-11-04T01:38:22.779717+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:37.978034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.776471+0000","last_change":"2023-11-04T01:37:36.695402+0000","last_active":"2023-11-04T01:38:22.776471+0000","last_peered":"2023-11-04T01:38:22.776471+0000","last_clean":"2023-11-04T01:38:22.776471+0000","last_became_active":"2023-11-04T01:37:35.220346+0000","last_became_peered":"2023-11-04T01:37:35.220346+0000","last_unstale":"2023-11-04T01:38:22.776471+0000","last_undegraded":"2023-11-04T01:38:22.776471+0000","last_fullsized":"2023-11-04T01:38:22.776471+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062230100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.779779+0000","last_change":"2023-11-04T01:38:22.791990+0000","last_active":"2023-11-04T01:38:23.779779+0000","last_peered":"2023-11-04T01:38:23.779779+0000","last_clean":"2023-11-04T01:38:23.779779+0000","last_became_active":"2023-11-04T01:38:22.791702+0000","last_became_peered":"2023-11-04T01:38:22.791702+0000","last_unstale":"2023-11-04T01:38:23.779779+0000","last_undegraded":"2023-11-04T01:38:23.779779+0000","last_fullsized":"2023-11-04T01:38:23.779779+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:58.284803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.782915+0000","last_change":"2023-11-04T01:38:21.780688+0000","last_active":"2023-11-04T01:38:22.782915+0000","last_peered":"2023-11-04T01:38:22.782915+0000","last_clean":"2023-11-04T01:38:22.782915+0000","last_became_active":"2023-11-04T01:38:21.780288+0000","last_became_peered":"2023-11-04T01:38:21.780288+0000","last_unstale":"2023-11-04T01:38:22.782915+0000","last_undegraded":"2023-11-04T01:38:22.782915+0000","last_fullsized":"2023-11-04T01:38:22.782915+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:31:58.780122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":41,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.781258+0000","last_change":"2023-11-04T01:37:36.426315+0000","last_active":"2023-11-04T01:38:22.781258+0000","last_peered":"2023-11-04T01:38:22.781258+0000","last_clean":"2023-11-04T01:38:22.781258+0000","last_became_active":"2023-11-04T01:37:35.223958+0000","last_became_peered":"2023-11-04T01:37:35.223958+0000","last_unstale":"2023-11-04T01:38:22.781258+0000","last_undegraded":"2023-11-04T01:38:22.781258+0000","last_fullsized":"2023-11-04T01:38:22.781258+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:46.733116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025167400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.831036+0000","last_change":"2023-11-04T01:38:22.796355+0000","last_active":"2023-11-04T01:38:23.831036+0000","last_peered":"2023-11-04T01:38:23.831036+0000","last_clean":"2023-11-04T01:38:23.831036+0000","last_became_active":"2023-11-04T01:38:22.795924+0000","last_became_peered":"2023-11-04T01:38:22.795924+0000","last_unstale":"2023-11-04T01:38:23.831036+0000","last_undegraded":"2023-11-04T01:38:23.831036+0000","last_fullsized":"2023-11-04T01:38:23.831036+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:22.355691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.776792+0000","last_change":"2023-11-04T01:38:21.775519+0000","last_active":"2023-11-04T01:38:22.776792+0000","last_peered":"2023-11-04T01:38:22.776792+0000","last_clean":"2023-11-04T01:38:22.776792+0000","last_became_active":"2023-11-04T01:38:21.775259+0000","last_became_peered":"2023-11-04T01:38:21.775259+0000","last_unstale":"2023-11-04T01:38:22.776792+0000","last_undegraded":"2023-11-04T01:38:22.776792+0000","last_fullsized":"2023-11-04T01:38:22.776792+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:09.798992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.776795+0000","last_change":"2023-11-04T01:37:36.694540+0000","last_active":"2023-11-04T01:38:22.776795+0000","last_peered":"2023-11-04T01:38:22.776795+0000","last_clean":"2023-11-04T01:38:22.776795+0000","last_became_active":"2023-11-04T01:37:35.225863+0000","last_became_peered":"2023-11-04T01:37:35.225863+0000","last_unstale":"2023-11-04T01:38:22.776795+0000","last_undegraded":"2023-11-04T01:38:22.776795+0000","last_fullsized":"2023-11-04T01:38:22.776795+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:42.654853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042277299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.831000+0000","last_change":"2023-11-04T01:38:22.802446+0000","last_active":"2023-11-04T01:38:23.831000+0000","last_peered":"2023-11-04T01:38:23.831000+0000","last_clean":"2023-11-04T01:38:23.831000+0000","last_became_active":"2023-11-04T01:38:22.802153+0000","last_became_peered":"2023-11-04T01:38:22.802153+0000","last_unstale":"2023-11-04T01:38:23.831000+0000","last_undegraded":"2023-11-04T01:38:23.831000+0000","last_fullsized":"2023-11-04T01:38:23.831000+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:15.609269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.782315+0000","last_change":"2023-11-04T01:38:21.778593+0000","last_active":"2023-11-04T01:38:22.782315+0000","last_peered":"2023-11-04T01:38:22.782315+0000","last_clean":"2023-11-04T01:38:22.782315+0000","last_became_active":"2023-11-04T01:38:21.778314+0000","last_became_peered":"2023-11-04T01:38:21.778314+0000","last_unstale":"2023-11-04T01:38:22.782315+0000","last_undegraded":"2023-11-04T01:38:22.782315+0000","last_fullsized":"2023-11-04T01:38:22.782315+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:27:35.986692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":41,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.782882+0000","last_change":"2023-11-04T01:37:36.426202+0000","last_active":"2023-11-04T01:38:22.782882+0000","last_peered":"2023-11-04T01:38:22.782882+0000","last_clean":"2023-11-04T01:38:22.782882+0000","last_became_active":"2023-11-04T01:37:35.222997+0000","last_became_peered":"2023-11-04T01:37:35.222997+0000","last_unstale":"2023-11-04T01:38:22.782882+0000","last_undegraded":"2023-11-04T01:38:22.782882+0000","last_fullsized":"2023-11-04T01:38:22.782882+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:18.980751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041393700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830527+0000","last_change":"2023-11-04T01:38:22.796358+0000","last_active":"2023-11-04T01:38:23.830527+0000","last_peered":"2023-11-04T01:38:23.830527+0000","last_clean":"2023-11-04T01:38:23.830527+0000","last_became_active":"2023-11-04T01:38:22.796081+0000","last_became_peered":"2023-11-04T01:38:22.796081+0000","last_unstale":"2023-11-04T01:38:23.830527+0000","last_undegraded":"2023-11-04T01:38:23.830527+0000","last_fullsized":"2023-11-04T01:38:23.830527+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:10.803421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.793743+0000","last_change":"2023-11-04T01:38:21.779951+0000","last_active":"2023-11-04T01:38:22.793743+0000","last_peered":"2023-11-04T01:38:22.793743+0000","last_clean":"2023-11-04T01:38:22.793743+0000","last_became_active":"2023-11-04T01:38:21.779624+0000","last_became_peered":"2023-11-04T01:38:21.779624+0000","last_unstale":"2023-11-04T01:38:22.793743+0000","last_undegraded":"2023-11-04T01:38:22.793743+0000","last_fullsized":"2023-11-04T01:38:22.793743+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:24.442218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.780063+0000","last_change":"2023-11-04T01:37:36.220713+0000","last_active":"2023-11-04T01:38:22.780063+0000","last_peered":"2023-11-04T01:38:22.780063+0000","last_clean":"2023-11-04T01:38:22.780063+0000","last_became_active":"2023-11-04T01:37:35.220311+0000","last_became_peered":"2023-11-04T01:37:35.220311+0000","last_unstale":"2023-11-04T01:38:22.780063+0000","last_undegraded":"2023-11-04T01:38:22.780063+0000","last_fullsized":"2023-11-04T01:38:22.780063+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062999799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830340+0000","last_change":"2023-11-04T01:38:22.793242+0000","last_active":"2023-11-04T01:38:23.830340+0000","last_peered":"2023-11-04T01:38:23.830340+0000","last_clean":"2023-11-04T01:38:23.830340+0000","last_became_active":"2023-11-04T01:38:22.792960+0000","last_became_peered":"2023-11-04T01:38:22.792960+0000","last_unstale":"2023-11-04T01:38:23.830340+0000","last_undegraded":"2023-11-04T01:38:23.830340+0000","last_fullsized":"2023-11-04T01:38:23.830340+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:19.786964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813529+0000","last_change":"2023-11-04T01:38:21.782919+0000","last_active":"2023-11-04T01:38:22.813529+0000","last_peered":"2023-11-04T01:38:22.813529+0000","last_clean":"2023-11-04T01:38:22.813529+0000","last_became_active":"2023-11-04T01:38:21.782623+0000","last_became_peered":"2023-11-04T01:38:21.782623+0000","last_unstale":"2023-11-04T01:38:22.813529+0000","last_undegraded":"2023-11-04T01:38:22.813529+0000","last_fullsized":"2023-11-04T01:38:22.813529+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:45.887446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":39,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.781527+0000","last_change":"2023-11-04T01:37:36.229580+0000","last_active":"2023-11-04T01:38:22.781527+0000","last_peered":"2023-11-04T01:38:22.781527+0000","last_clean":"2023-11-04T01:38:22.781527+0000","last_became_active":"2023-11-04T01:37:35.220940+0000","last_became_peered":"2023-11-04T01:37:35.220940+0000","last_unstale":"2023-11-04T01:38:22.781527+0000","last_undegraded":"2023-11-04T01:38:22.781527+0000","last_fullsized":"2023-11-04T01:38:22.781527+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:27.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070235600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830274+0000","last_change":"2023-11-04T01:38:22.798803+0000","last_active":"2023-11-04T01:38:23.830274+0000","last_peered":"2023-11-04T01:38:23.830274+0000","last_clean":"2023-11-04T01:38:23.830274+0000","last_became_active":"2023-11-04T01:38:22.798461+0000","last_became_peered":"2023-11-04T01:38:22.798461+0000","last_unstale":"2023-11-04T01:38:23.830274+0000","last_undegraded":"2023-11-04T01:38:23.830274+0000","last_fullsized":"2023-11-04T01:38:23.830274+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:40.840084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.775847+0000","last_change":"2023-11-04T01:38:21.773808+0000","last_active":"2023-11-04T01:38:22.775847+0000","last_peered":"2023-11-04T01:38:22.775847+0000","last_clean":"2023-11-04T01:38:22.775847+0000","last_became_active":"2023-11-04T01:38:21.773519+0000","last_became_peered":"2023-11-04T01:38:21.773519+0000","last_unstale":"2023-11-04T01:38:22.775847+0000","last_undegraded":"2023-11-04T01:38:22.775847+0000","last_fullsized":"2023-11-04T01:38:22.775847+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:01:18.438613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.789746+0000","last_change":"2023-11-04T01:37:36.422542+0000","last_active":"2023-11-04T01:38:22.789746+0000","last_peered":"2023-11-04T01:38:22.789746+0000","last_clean":"2023-11-04T01:38:22.789746+0000","last_became_active":"2023-11-04T01:37:35.224836+0000","last_became_peered":"2023-11-04T01:37:35.224836+0000","last_unstale":"2023-11-04T01:38:22.789746+0000","last_undegraded":"2023-11-04T01:38:22.789746+0000","last_fullsized":"2023-11-04T01:38:22.789746+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066982800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.829895+0000","last_change":"2023-11-04T01:38:22.801833+0000","last_active":"2023-11-04T01:38:23.829895+0000","last_peered":"2023-11-04T01:38:23.829895+0000","last_clean":"2023-11-04T01:38:23.829895+0000","last_became_active":"2023-11-04T01:38:22.801513+0000","last_became_peered":"2023-11-04T01:38:22.801513+0000","last_unstale":"2023-11-04T01:38:23.829895+0000","last_undegraded":"2023-11-04T01:38:23.829895+0000","last_fullsized":"2023-11-04T01:38:23.829895+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:35.597529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.792922+0000","last_change":"2023-11-04T01:38:21.779620+0000","last_active":"2023-11-04T01:38:22.792922+0000","last_peered":"2023-11-04T01:38:22.792922+0000","last_clean":"2023-11-04T01:38:22.792922+0000","last_became_active":"2023-11-04T01:38:21.779132+0000","last_became_peered":"2023-11-04T01:38:21.779132+0000","last_unstale":"2023-11-04T01:38:22.792922+0000","last_undegraded":"2023-11-04T01:38:22.792922+0000","last_fullsized":"2023-11-04T01:38:22.792922+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:01:18.438613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.776911+0000","last_change":"2023-11-04T01:37:36.694868+0000","last_active":"2023-11-04T01:38:22.776911+0000","last_peered":"2023-11-04T01:38:22.776911+0000","last_clean":"2023-11-04T01:38:22.776911+0000","last_became_active":"2023-11-04T01:37:35.221181+0000","last_became_peered":"2023-11-04T01:37:35.221181+0000","last_unstale":"2023-11-04T01:38:22.776911+0000","last_undegraded":"2023-11-04T01:38:22.776911+0000","last_fullsized":"2023-11-04T01:38:22.776911+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046748800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830543+0000","last_change":"2023-11-04T01:38:22.786394+0000","last_active":"2023-11-04T01:38:23.830543+0000","last_peered":"2023-11-04T01:38:23.830543+0000","last_clean":"2023-11-04T01:38:23.830543+0000","last_became_active":"2023-11-04T01:38:22.786085+0000","last_became_peered":"2023-11-04T01:38:22.786085+0000","last_unstale":"2023-11-04T01:38:23.830543+0000","last_undegraded":"2023-11-04T01:38:23.830543+0000","last_fullsized":"2023-11-04T01:38:23.830543+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:04.613134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.792462+0000","last_change":"2023-11-04T01:38:21.784340+0000","last_active":"2023-11-04T01:38:22.792462+0000","last_peered":"2023-11-04T01:38:22.792462+0000","last_clean":"2023-11-04T01:38:22.792462+0000","last_became_active":"2023-11-04T01:38:21.782892+0000","last_became_peered":"2023-11-04T01:38:21.782892+0000","last_unstale":"2023-11-04T01:38:22.792462+0000","last_undegraded":"2023-11-04T01:38:22.792462+0000","last_fullsized":"2023-11-04T01:38:22.792462+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:53.810214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":35,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.786450+0000","last_change":"2023-11-04T01:37:36.222930+0000","last_active":"2023-11-04T01:38:22.786450+0000","last_peered":"2023-11-04T01:38:22.786450+0000","last_clean":"2023-11-04T01:38:22.786450+0000","last_became_active":"2023-11-04T01:37:35.220373+0000","last_became_peered":"2023-11-04T01:37:35.220373+0000","last_unstale":"2023-11-04T01:38:22.786450+0000","last_undegraded":"2023-11-04T01:38:22.786450+0000","last_fullsized":"2023-11-04T01:38:22.786450+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074099599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.780059+0000","last_change":"2023-11-04T01:38:22.797844+0000","last_active":"2023-11-04T01:38:23.780059+0000","last_peered":"2023-11-04T01:38:23.780059+0000","last_clean":"2023-11-04T01:38:23.780059+0000","last_became_active":"2023-11-04T01:38:22.794852+0000","last_became_peered":"2023-11-04T01:38:22.794852+0000","last_unstale":"2023-11-04T01:38:23.780059+0000","last_undegraded":"2023-11-04T01:38:23.780059+0000","last_fullsized":"2023-11-04T01:38:23.780059+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:28:10.791332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.788212+0000","last_change":"2023-11-04T01:38:21.781112+0000","last_active":"2023-11-04T01:38:22.788212+0000","last_peered":"2023-11-04T01:38:22.788212+0000","last_clean":"2023-11-04T01:38:22.788212+0000","last_became_active":"2023-11-04T01:38:21.780834+0000","last_became_peered":"2023-11-04T01:38:21.780834+0000","last_unstale":"2023-11-04T01:38:22.788212+0000","last_undegraded":"2023-11-04T01:38:22.788212+0000","last_fullsized":"2023-11-04T01:38:22.788212+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:37.310371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":40,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.779951+0000","last_change":"2023-11-04T01:37:36.221676+0000","last_active":"2023-11-04T01:38:22.779951+0000","last_peered":"2023-11-04T01:38:22.779951+0000","last_clean":"2023-11-04T01:38:22.779951+0000","last_became_active":"2023-11-04T01:37:35.226996+0000","last_became_peered":"2023-11-04T01:37:35.226996+0000","last_unstale":"2023-11-04T01:38:22.779951+0000","last_undegraded":"2023-11-04T01:38:22.779951+0000","last_fullsized":"2023-11-04T01:38:22.779951+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089115500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.777344+0000","last_change":"2023-11-04T01:38:22.796528+0000","last_active":"2023-11-04T01:38:23.777344+0000","last_peered":"2023-11-04T01:38:23.777344+0000","last_clean":"2023-11-04T01:38:23.777344+0000","last_became_active":"2023-11-04T01:38:22.796251+0000","last_became_peered":"2023-11-04T01:38:22.796251+0000","last_unstale":"2023-11-04T01:38:23.777344+0000","last_undegraded":"2023-11-04T01:38:23.777344+0000","last_fullsized":"2023-11-04T01:38:23.777344+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:16.129659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813538+0000","last_change":"2023-11-04T01:38:21.783098+0000","last_active":"2023-11-04T01:38:22.813538+0000","last_peered":"2023-11-04T01:38:22.813538+0000","last_clean":"2023-11-04T01:38:22.813538+0000","last_became_active":"2023-11-04T01:38:21.782731+0000","last_became_peered":"2023-11-04T01:38:21.782731+0000","last_unstale":"2023-11-04T01:38:22.813538+0000","last_undegraded":"2023-11-04T01:38:22.813538+0000","last_fullsized":"2023-11-04T01:38:22.813538+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:30.223290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.786888+0000","last_change":"2023-11-04T01:37:36.228535+0000","last_active":"2023-11-04T01:38:22.786888+0000","last_peered":"2023-11-04T01:38:22.786888+0000","last_clean":"2023-11-04T01:38:22.786888+0000","last_became_active":"2023-11-04T01:37:35.221173+0000","last_became_peered":"2023-11-04T01:37:35.221173+0000","last_unstale":"2023-11-04T01:38:22.786888+0000","last_undegraded":"2023-11-04T01:38:22.786888+0000","last_fullsized":"2023-11-04T01:38:22.786888+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049831099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.831310+0000","last_change":"2023-11-04T01:38:22.804123+0000","last_active":"2023-11-04T01:38:23.831310+0000","last_peered":"2023-11-04T01:38:23.831310+0000","last_clean":"2023-11-04T01:38:23.831310+0000","last_became_active":"2023-11-04T01:38:22.803868+0000","last_became_peered":"2023-11-04T01:38:22.803868+0000","last_unstale":"2023-11-04T01:38:23.831310+0000","last_undegraded":"2023-11-04T01:38:23.831310+0000","last_fullsized":"2023-11-04T01:38:23.831310+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:14:27.427196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813970+0000","last_change":"2023-11-04T01:38:21.784307+0000","last_active":"2023-11-04T01:38:22.813970+0000","last_peered":"2023-11-04T01:38:22.813970+0000","last_clean":"2023-11-04T01:38:22.813970+0000","last_became_active":"2023-11-04T01:38:21.784035+0000","last_became_peered":"2023-11-04T01:38:21.784035+0000","last_unstale":"2023-11-04T01:38:22.813970+0000","last_undegraded":"2023-11-04T01:38:22.813970+0000","last_fullsized":"2023-11-04T01:38:22.813970+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:15.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":39,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.782101+0000","last_change":"2023-11-04T01:37:36.229678+0000","last_active":"2023-11-04T01:38:22.782101+0000","last_peered":"2023-11-04T01:38:22.782101+0000","last_clean":"2023-11-04T01:38:22.782101+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:38:22.782101+0000","last_undegraded":"2023-11-04T01:38:22.782101+0000","last_fullsized":"2023-11-04T01:38:22.782101+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:50.484332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.783162+0000","last_change":"2023-11-04T01:38:22.788507+0000","last_active":"2023-11-04T01:38:23.783162+0000","last_peered":"2023-11-04T01:38:23.783162+0000","last_clean":"2023-11-04T01:38:23.783162+0000","last_became_active":"2023-11-04T01:38:22.788265+0000","last_became_peered":"2023-11-04T01:38:22.788265+0000","last_unstale":"2023-11-04T01:38:23.783162+0000","last_undegraded":"2023-11-04T01:38:23.783162+0000","last_fullsized":"2023-11-04T01:38:23.783162+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:48.333335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813611+0000","last_change":"2023-11-04T01:38:21.784588+0000","last_active":"2023-11-04T01:38:22.813611+0000","last_peered":"2023-11-04T01:38:22.813611+0000","last_clean":"2023-11-04T01:38:22.813611+0000","last_became_active":"2023-11-04T01:38:21.784315+0000","last_became_peered":"2023-11-04T01:38:21.784315+0000","last_unstale":"2023-11-04T01:38:22.813611+0000","last_undegraded":"2023-11-04T01:38:22.813611+0000","last_fullsized":"2023-11-04T01:38:22.813611+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:13.428171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":39,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.781620+0000","last_change":"2023-11-04T01:37:36.229908+0000","last_active":"2023-11-04T01:38:22.781620+0000","last_peered":"2023-11-04T01:38:22.781620+0000","last_clean":"2023-11-04T01:38:22.781620+0000","last_became_active":"2023-11-04T01:37:35.221822+0000","last_became_peered":"2023-11-04T01:37:35.221822+0000","last_unstale":"2023-11-04T01:38:22.781620+0000","last_undegraded":"2023-11-04T01:38:22.781620+0000","last_fullsized":"2023-11-04T01:38:22.781620+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:11.866738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089270799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-04T01:38:23.830842+0000","last_change":"2023-11-04T01:38:22.798791+0000","last_active":"2023-11-04T01:38:23.830842+0000","last_peered":"2023-11-04T01:38:23.830842+0000","last_clean":"2023-11-04T01:38:23.830842+0000","last_became_active":"2023-11-04T01:38:22.798540+0000","last_became_peered":"2023-11-04T01:38:22.798540+0000","last_unstale":"2023-11-04T01:38:23.830842+0000","last_undegraded":"2023-11-04T01:38:23.830842+0000","last_fullsized":"2023-11-04T01:38:23.830842+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.759665+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.759665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:15:39.821970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.813472+0000","last_change":"2023-11-04T01:38:21.784997+0000","last_active":"2023-11-04T01:38:22.813472+0000","last_peered":"2023-11-04T01:38:22.813472+0000","last_clean":"2023-11-04T01:38:22.813472+0000","last_became_active":"2023-11-04T01:38:21.784719+0000","last_became_peered":"2023-11-04T01:38:21.784719+0000","last_unstale":"2023-11-04T01:38:22.813472+0000","last_undegraded":"2023-11-04T01:38:22.813472+0000","last_fullsized":"2023-11-04T01:38:22.813472+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.755236+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.755236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:37.978034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.776861+0000","last_change":"2023-11-04T01:37:36.695345+0000","last_active":"2023-11-04T01:38:22.776861+0000","last_peered":"2023-11-04T01:38:22.776861+0000","last_clean":"2023-11-04T01:38:22.776861+0000","last_became_active":"2023-11-04T01:37:35.225441+0000","last_became_peered":"2023-11-04T01:37:35.225441+0000","last_unstale":"2023-11-04T01:38:22.776861+0000","last_undegraded":"2023-11-04T01:38:22.776861+0000","last_fullsized":"2023-11-04T01:38:22.776861+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052758199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":203,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:22.785193+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:38:22.785193+0000","last_peered":"2023-11-04T01:38:22.785193+0000","last_clean":"2023-11-04T01:38:22.785193+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:38:22.785193+0000","last_undegraded":"2023-11-04T01:38:22.785193+0000","last_fullsized":"2023-11-04T01:38:22.785193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28408,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343432,"statfs":{"total":96636764160,"available":96607674368,"internally_reserved":0,"allocated":1413120,"data_stored":968281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.503,"15min":0.503},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64000000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.745,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55800000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.375,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46000000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.71499999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46300000000000002,"15min":0.45700000000000002},"min":{"1min":0.314,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.36599999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58199999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.32800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.371,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.60199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.45000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.434,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":377389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.443,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.41399999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.41099999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":1.004,"15min":1.004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55100000000000005,"15min":0.54100000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76100000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.51400000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78500000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.54100000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79800000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.60999999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65800000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.57999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":377387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71399999999999997,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.67900000000000005,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44600000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":1.24,"15min":1.24},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.42399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64900000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56200000000000006}]},{"osd":2,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72999999999999998,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67300000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.54100000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.67200000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.69699999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.63200000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72299999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.502,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65300000000000002,"5min":0.877,"15min":0.877},"last":0.66200000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75600000000000001,"5min":1.284,"15min":1.284},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:37:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71999999999999997,"5min":0.746,"15min":0.746},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.75800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":377367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.38700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39800000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.317,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76400000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.497},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.746,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78300000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.433,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":1.022,"15min":1.022},"last":0.60299999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":1.002,"15min":1.002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71699999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.628}]},{"osd":5,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.78900000000000003,"5min":1.127,"15min":1.127},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80200000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68799999999999994}]},{"osd":6,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77600000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.747,"5min":1.079,"15min":1.079},"last":0.67300000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81000000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.629,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":1.093,"15min":1.093},"last":0.70099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":377409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.33400000000000002,"15min":0.34000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.49299999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.48399999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.27600000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.39700000000000002,"15min":0.40799999999999997},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.44600000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.318},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.41799999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.29899999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.57699999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.373},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.312,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59499999999999997,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.35599999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61599999999999999,"15min":0.627},"min":{"1min":0.36299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.752,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.504}]},{"osd":5,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.622,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.65900000000000003,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80600000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.56000000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79400000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68500000000000005,"15min":0.69699999999999995},"min":{"1min":0.51000000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.752,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.56999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":378909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.36099999999999999,"15min":0.371},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.42399999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.312},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.36799999999999999,"15min":0.375},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.625,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.22900000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38200000000000001,"15min":0.38600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.32500000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55500000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.5,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34000000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65000000000000002,"15min":0.65800000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.504}]},{"osd":5,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86299999999999999,"5min":1.052,"15min":1.052},"last":0.495}]},{"osd":6,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.876,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.67400000000000004,"15min":0.68200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.45600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":379525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32700000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.46500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.372}]},{"osd":2,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40200000000000002,"15min":0.40400000000000003},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.58699999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.38900000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58399999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39000000000000001,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.40400000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58399999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":1.02,"15min":1.02},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89700000000000002,"5min":1.089,"15min":1.089},"last":0.59699999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92600000000000005,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92400000000000004,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96699999999999997,"5min":1.153,"15min":1.153},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28392,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343448,"statfs":{"total":96636764160,"available":96607690752,"internally_reserved":0,"allocated":1400832,"data_stored":966646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.35299999999999998,"15min":0.35599999999999998},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47099999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34699999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55200000000000005,"5min":0.629,"15min":0.629},"last":0.43099999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59499999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.308},{"interface":"front","average":{"1min":0.378,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.48899999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36199999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.28799999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.497,"5min":0.628,"15min":0.628},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65700000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.45600000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.48399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77200000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.61899999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.59699999999999998},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.80600000000000005,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.66900000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81999999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84099999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65400000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.622},"min":{"1min":0.47099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81699999999999995,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.495,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86499999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:30.568 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:38:30.568 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:38:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.713+0000 7f26fb6f2640 1 Processor -- start 2023-11-04T01:38:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.713+0000 7f26fb6f2640 1 -- start start 2023-11-04T01:38:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.714+0000 7f26fb6f2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f26f40b2d30 0x7f26f406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.714+0000 7f26fb6f2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26f406c1d0 0x7f26f40cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.714+0000 7f26fb6f2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f406ca40 con 0x7f26f4160430 2023-11-04T01:38:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.714+0000 7f26fb6f2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f40cb580 con 0x7f26f40b2d30 2023-11-04T01:38:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.714+0000 7f26fb6f2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f406cd20 con 0x7f26f406c1d0 2023-11-04T01:38:30.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.714+0000 7f26f8c8d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f26f40b2d30 0x7f26f406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.714+0000 7f26f9c8f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26f406c1d0 0x7f26f40cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.714+0000 7f26f948e640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f26f4160430 0x7f26f40b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:57276/0 (socket says 172.21.15.44:57276) 2023-11-04T01:38:30.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.714+0000 7f26f948e640 1 -- 172.21.15.44:0/150489558 learned_addr learned my addr 172.21.15.44:0/150489558 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:30.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.714+0000 7f26f8c8d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f26f40b2d30 0x7f26f406bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:52086/0 (socket says 172.21.15.44:52086) 2023-11-04T01:38:30.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.715+0000 7f26f9c8f640 1 -- 172.21.15.44:0/150489558 >> v2:172.21.15.204:3300/0 conn(0x7f26f40b2d30 msgr2=0x7f26f406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:30.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.715+0000 7f26f9c8f640 1 --2- 172.21.15.44:0/150489558 >> v2:172.21.15.204:3300/0 conn(0x7f26f40b2d30 0x7f26f406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.715+0000 7f26f9c8f640 1 -- 172.21.15.44:0/150489558 >> v1:172.21.15.204:6789/0 conn(0x7f26f4160430 legacy=0x7f26f40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.715+0000 7f26f9c8f640 1 -- 172.21.15.44:0/150489558 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f406d000 con 0x7f26f406c1d0 2023-11-04T01:38:30.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.715+0000 7f26f8c8d640 1 --2- 172.21.15.44:0/150489558 >> v2:172.21.15.204:3300/0 conn(0x7f26f40b2d30 0x7f26f406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.716+0000 7f26f9c8f640 1 --2- 172.21.15.44:0/150489558 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26f406c1d0 0x7f26f40cbcb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f26ec009d90 tx=0x7f26ec02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9cc802a1ab63baf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.716+0000 7f26ebfff640 1 -- 172.21.15.44:0/150489558 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec02cc50 con 0x7f26f406c1d0 2023-11-04T01:38:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.716+0000 7f26ebfff640 1 -- 172.21.15.44:0/150489558 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ec02cdb0 con 0x7f26f406c1d0 2023-11-04T01:38:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.716+0000 7f26ebfff640 1 -- 172.21.15.44:0/150489558 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec034660 con 0x7f26f406c1d0 2023-11-04T01:38:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.716+0000 7f26fb6f2640 1 -- 172.21.15.44:0/150489558 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26f406c1d0 msgr2=0x7f26f40cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.716+0000 7f26fb6f2640 1 --2- 172.21.15.44:0/150489558 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26f406c1d0 0x7f26f40cbcb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f26ec009d90 tx=0x7f26ec02bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.716+0000 7f26fb6f2640 1 -- 172.21.15.44:0/150489558 shutdown_connections 2023-11-04T01:38:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.716+0000 7f26fb6f2640 1 --2- 172.21.15.44:0/150489558 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26f406c1d0 0x7f26f40cbcb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.716+0000 7f26fb6f2640 1 --2- 172.21.15.44:0/150489558 >> v2:172.21.15.204:3300/0 conn(0x7f26f40b2d30 0x7f26f406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.716+0000 7f26fb6f2640 1 -- 172.21.15.44:0/150489558 >> 172.21.15.44:0/150489558 conn(0x7f26f406ea20 msgr2=0x7f26f406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:30.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.716+0000 7f26fb6f2640 1 -- 172.21.15.44:0/150489558 shutdown_connections 2023-11-04T01:38:30.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.716+0000 7f26fb6f2640 1 -- 172.21.15.44:0/150489558 wait complete. 2023-11-04T01:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.717+0000 7f26fb6f2640 1 Processor -- start 2023-11-04T01:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.718+0000 7f26fb6f2640 1 -- start start 2023-11-04T01:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.718+0000 7f26fb6f2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f406c1d0 0x7f26f414f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.718+0000 7f26fb6f2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26f40b2d30 0x7f26f40c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.718+0000 7f26fb6f2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26f4160430 0x7f26f40c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.718+0000 7f26fb6f2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f4152280 con 0x7f26f406c1d0 2023-11-04T01:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.718+0000 7f26fb6f2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f40c47f0 con 0x7f26f4160430 2023-11-04T01:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.718+0000 7f26fb6f2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f40c4ad0 con 0x7f26f40b2d30 2023-11-04T01:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.718+0000 7f26f948e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f406c1d0 0x7f26f414f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.718+0000 7f26f948e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f406c1d0 0x7f26f414f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44740/0 (socket says 172.21.15.44:44740) 2023-11-04T01:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.718+0000 7f26f948e640 1 -- 172.21.15.44:0/3062196172 learned_addr learned my addr 172.21.15.44:0/3062196172 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.719+0000 7f26f8c8d640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26f40b2d30 0x7f26f40c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.719+0000 7f26f9c8f640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26f4160430 0x7f26f40c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.719+0000 7f26f948e640 1 -- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26f40b2d30 msgr2=0x7f26f40c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.719+0000 7f26f948e640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26f40b2d30 0x7f26f40c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.719+0000 7f26f948e640 1 -- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26f4160430 msgr2=0x7f26f40c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.719+0000 7f26f948e640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26f4160430 0x7f26f40c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.719+0000 7f26f948e640 1 -- 172.21.15.44:0/3062196172 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e4009400 con 0x7f26f406c1d0 2023-11-04T01:38:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.719+0000 7f26f9c8f640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26f4160430 0x7f26f40c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.719+0000 7f26f8c8d640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26f40b2d30 0x7f26f40c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.719+0000 7f26f948e640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f406c1d0 0x7f26f414f2d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f26f000c480 tx=0x7f26f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.719+0000 7f26e9ffb640 1 -- 172.21.15.44:0/3062196172 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0005ce0 con 0x7f26f406c1d0 2023-11-04T01:38:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.719+0000 7f26e9ffb640 1 -- 172.21.15.44:0/3062196172 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f0005e40 con 0x7f26f406c1d0 2023-11-04T01:38:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.719+0000 7f26fb6f2640 1 -- 172.21.15.44:0/3062196172 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ec009a70 con 0x7f26f406c1d0 2023-11-04T01:38:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.719+0000 7f26e9ffb640 1 -- 172.21.15.44:0/3062196172 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f00072f0 con 0x7f26f406c1d0 2023-11-04T01:38:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.719+0000 7f26fb6f2640 1 -- 172.21.15.44:0/3062196172 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f40c5090 con 0x7f26f406c1d0 2023-11-04T01:38:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.720+0000 7f26fb6f2640 1 -- 172.21.15.44:0/3062196172 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f4074290 con 0x7f26f406c1d0 2023-11-04T01:38:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.721+0000 7f26e9ffb640 1 -- 172.21.15.44:0/3062196172 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f26f0007510 con 0x7f26f406c1d0 2023-11-04T01:38:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.721+0000 7f26e9ffb640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f26d806ae70 0x7f26d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.721+0000 7f26e9ffb640 1 -- 172.21.15.44:0/3062196172 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f26f0088d40 con 0x7f26f406c1d0 2023-11-04T01:38:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.721+0000 7f26f8c8d640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f26d806ae70 0x7f26d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.722+0000 7f26f8c8d640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f26d806ae70 0x7f26d806d330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f26f40c78f0 tx=0x7f26e4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:30.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.725+0000 7f26e9ffb640 1 -- 172.21.15.44:0/3062196172 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f26f0053c90 con 0x7f26f406c1d0 2023-11-04T01:38:30.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.970+0000 7f26fb6f2640 1 -- 172.21.15.44:0/3062196172 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f26f40b6b20 con 0x7f26f406c1d0 2023-11-04T01:38:30.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.972+0000 7f26e9ffb640 1 -- 172.21.15.44:0/3062196172 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f26f0017020 con 0x7f26f406c1d0 2023-11-04T01:38:30.975 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2023-11-04T01:38:30.975 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDEn0VlmqcrLRAAFCsu/sJUUh45gPboIgq6Dw== 2023-11-04T01:38:30.975 INFO:teuthology.orchestra.run.smithi044.stdout: caps mds = "allow" 2023-11-04T01:38:30.975 INFO:teuthology.orchestra.run.smithi044.stdout: caps mon = "allow r" 2023-11-04T01:38:30.975 INFO:teuthology.orchestra.run.smithi044.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:38:30.975 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2023-11-04T01:38:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.974+0000 7f26fb6f2640 1 -- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f26d806ae70 msgr2=0x7f26d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.974+0000 7f26fb6f2640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f26d806ae70 0x7f26d806d330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f26f40c78f0 tx=0x7f26e4008040 comp rx=0 tx=0).stop 2023-11-04T01:38:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.974+0000 7f26fb6f2640 1 -- 172.21.15.44:0/3062196172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f406c1d0 msgr2=0x7f26f414f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.974+0000 7f26fb6f2640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f406c1d0 0x7f26f414f2d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f26f000c480 tx=0x7f26f000c940 comp rx=0 tx=0).stop 2023-11-04T01:38:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.974+0000 7f26fb6f2640 1 -- 172.21.15.44:0/3062196172 shutdown_connections 2023-11-04T01:38:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.974+0000 7f26fb6f2640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f26d806ae70 0x7f26d806d330 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.974+0000 7f26fb6f2640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26f4160430 0x7f26f40c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.974+0000 7f26fb6f2640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26f40b2d30 0x7f26f40c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.974+0000 7f26fb6f2640 1 --2- 172.21.15.44:0/3062196172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f406c1d0 0x7f26f414f2d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.974+0000 7f26fb6f2640 1 -- 172.21.15.44:0/3062196172 >> 172.21.15.44:0/3062196172 conn(0x7f26f406ea20 msgr2=0x7f26f40cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.975+0000 7f26fb6f2640 1 -- 172.21.15.44:0/3062196172 shutdown_connections 2023-11-04T01:38:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:30.975+0000 7f26fb6f2640 1 -- 172.21.15.44:0/3062196172 wait complete. 2023-11-04T01:38:30.987 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.091+0000 7f7b02f0c640 1 Processor -- start 2023-11-04T01:38:31.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.091+0000 7f7b02f0c640 1 -- start start 2023-11-04T01:38:31.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.092+0000 7f7b02f0c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7afc0ce240 0x7f7afc157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.092+0000 7f7b02f0c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7afc157540 0x7f7afc0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.092+0000 7f7b02f0c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7afc15e000 con 0x7f7afc0cde60 2023-11-04T01:38:31.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.092+0000 7f7b02f0c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7afc15e5c0 con 0x7f7afc0ce240 2023-11-04T01:38:31.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.092+0000 7f7b02f0c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc15e2e0 con 0x7f7afc157540 2023-11-04T01:38:31.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.092+0000 7f7b00ca8640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7afc0cde60 0x7f7afc15d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50458/0 (socket says 172.21.15.44:50458) 2023-11-04T01:38:31.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.092+0000 7f7b00ca8640 1 -- 172.21.15.44:0/281853949 learned_addr learned my addr 172.21.15.44:0/281853949 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:31.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.092+0000 7f7afb7fe640 1 -- 172.21.15.44:0/281853949 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166495103 0 0) 0x7f7afc15e000 con 0x7f7afc0cde60 2023-11-04T01:38:31.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7b014a9640 1 --2- 172.21.15.44:0/281853949 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7afc157540 0x7f7afc0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afb7fe640 1 -- 172.21.15.44:0/281853949 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ae4003520 con 0x7f7afc0cde60 2023-11-04T01:38:31.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afbfff640 1 --2- 172.21.15.44:0/281853949 >> v2:172.21.15.204:3300/0 conn(0x7f7afc0ce240 0x7f7afc157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afb7fe640 1 -- 172.21.15.44:0/281853949 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3302813303 0 0) 0x7f7ae4003520 con 0x7f7afc0cde60 2023-11-04T01:38:31.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afb7fe640 1 -- 172.21.15.44:0/281853949 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7afc157540 msgr2=0x7f7afc0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afb7fe640 1 --2- 172.21.15.44:0/281853949 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7afc157540 0x7f7afc0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afb7fe640 1 -- 172.21.15.44:0/281853949 >> v2:172.21.15.204:3300/0 conn(0x7f7afc0ce240 msgr2=0x7f7afc157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afb7fe640 1 --2- 172.21.15.44:0/281853949 >> v2:172.21.15.204:3300/0 conn(0x7f7afc0ce240 0x7f7afc157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afb7fe640 1 -- 172.21.15.44:0/281853949 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7afc0d1120 con 0x7f7afc0cde60 2023-11-04T01:38:31.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afb7fe640 1 -- 172.21.15.44:0/281853949 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f7aec001670 con 0x7f7afc0cde60 2023-11-04T01:38:31.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afb7fe640 1 -- 172.21.15.44:0/281853949 >> v1:172.21.15.44:6789/0 conn(0x7f7afc0cde60 legacy=0x7f7afc15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afb7fe640 1 --2- 172.21.15.44:0/281853949 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ae4003970 0x7f7ae4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afb7fe640 1 --2- 172.21.15.44:0/281853949 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7afc157540 0x7f7ae40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afb7fe640 1 --2- 172.21.15.44:0/281853949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ae4004d00 0x7f7ae4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afb7fe640 1 -- 172.21.15.44:0/281853949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc15e5c0 con 0x7f7ae4004d00 2023-11-04T01:38:31.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afb7fe640 1 -- 172.21.15.44:0/281853949 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc15e2e0 con 0x7f7ae4003970 2023-11-04T01:38:31.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afb7fe640 1 -- 172.21.15.44:0/281853949 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae400b980 con 0x7f7afc157540 2023-11-04T01:38:31.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7b014a9640 1 --2- 172.21.15.44:0/281853949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ae4004d00 0x7f7ae4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7b00ca8640 1 --2- 172.21.15.44:0/281853949 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ae4003970 0x7f7ae4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7afbfff640 1 --2- 172.21.15.44:0/281853949 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7afc157540 0x7f7ae40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7b014a9640 1 -- 172.21.15.44:0/281853949 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7afc157540 msgr2=0x7f7ae40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7b014a9640 1 --2- 172.21.15.44:0/281853949 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7afc157540 0x7f7ae40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7b014a9640 1 -- 172.21.15.44:0/281853949 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ae4003970 msgr2=0x7f7ae4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7b014a9640 1 --2- 172.21.15.44:0/281853949 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ae4003970 0x7f7ae4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.093+0000 7f7b014a9640 1 -- 172.21.15.44:0/281853949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4003520 con 0x7f7ae4004d00 2023-11-04T01:38:31.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.094+0000 7f7b014a9640 1 --2- 172.21.15.44:0/281853949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ae4004d00 0x7f7ae4005180 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009fc0 tx=0x7f7ae40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5634e821ff07f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:31.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.094+0000 7f7afb7fe640 1 -- 172.21.15.44:0/281853949 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af402cc20 con 0x7f7ae4004d00 2023-11-04T01:38:31.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.094+0000 7f7afb7fe640 1 -- 172.21.15.44:0/281853949 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af400f040 con 0x7f7ae4004d00 2023-11-04T01:38:31.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.094+0000 7f7afb7fe640 1 -- 172.21.15.44:0/281853949 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4034440 con 0x7f7ae4004d00 2023-11-04T01:38:31.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.095+0000 7f7b02f0c640 1 -- 172.21.15.44:0/281853949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ae4004d00 msgr2=0x7f7ae4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.095+0000 7f7b02f0c640 1 --2- 172.21.15.44:0/281853949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ae4004d00 0x7f7ae4005180 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009fc0 tx=0x7f7ae40057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.095+0000 7f7b014a9640 1 -- 172.21.15.44:0/281853949 reap_dead start 2023-11-04T01:38:31.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.095+0000 7f7b02f0c640 1 -- 172.21.15.44:0/281853949 shutdown_connections 2023-11-04T01:38:31.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.095+0000 7f7b02f0c640 1 -- 172.21.15.44:0/281853949 >> 172.21.15.44:0/281853949 conn(0x7f7afc071f30 msgr2=0x7f7afc0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:31.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.095+0000 7f7b02f0c640 1 -- 172.21.15.44:0/281853949 shutdown_connections 2023-11-04T01:38:31.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.095+0000 7f7b02f0c640 1 -- 172.21.15.44:0/281853949 wait complete. 2023-11-04T01:38:31.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.096+0000 7f7b02f0c640 1 Processor -- start 2023-11-04T01:38:31.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.096+0000 7f7b02f0c640 1 -- start start 2023-11-04T01:38:31.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b02f0c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7afc156680 0x7f7afc15a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b02f0c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7afc0cd290 0x7f7afc1f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b02f0c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1f2790 0x7f7afc15b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b02f0c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc1588e0 con 0x7f7afc1f2790 2023-11-04T01:38:31.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b02f0c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc157cd0 con 0x7f7afc156680 2023-11-04T01:38:31.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b02f0c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc157fb0 con 0x7f7afc0cd290 2023-11-04T01:38:31.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b014a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1f2790 0x7f7afc15b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b014a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1f2790 0x7f7afc15b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44756/0 (socket says 172.21.15.44:44756) 2023-11-04T01:38:31.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b014a9640 1 -- 172.21.15.44:0/3081140964 learned_addr learned my addr 172.21.15.44:0/3081140964 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:31.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b00ca8640 1 --2- 172.21.15.44:0/3081140964 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7afc156680 0x7f7afc15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b014a9640 1 -- 172.21.15.44:0/3081140964 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7afc0cd290 msgr2=0x7f7afc1f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b014a9640 1 --2- 172.21.15.44:0/3081140964 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7afc0cd290 0x7f7afc1f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b014a9640 1 -- 172.21.15.44:0/3081140964 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7afc156680 msgr2=0x7f7afc15a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b014a9640 1 --2- 172.21.15.44:0/3081140964 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7afc156680 0x7f7afc15a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b014a9640 1 -- 172.21.15.44:0/3081140964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7afc158290 con 0x7f7afc1f2790 2023-11-04T01:38:31.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.097+0000 7f7b014a9640 1 --2- 172.21.15.44:0/3081140964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1f2790 0x7f7afc15b580 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7af4002230 tx=0x7f7af4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:31.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.098+0000 7f7af97fa640 1 -- 172.21.15.44:0/3081140964 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4043070 con 0x7f7afc1f2790 2023-11-04T01:38:31.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.098+0000 7f7af97fa640 1 -- 172.21.15.44:0/3081140964 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af402de00 con 0x7f7afc1f2790 2023-11-04T01:38:31.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.098+0000 7f7b02f0c640 1 -- 172.21.15.44:0/3081140964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7afc158570 con 0x7f7afc1f2790 2023-11-04T01:38:31.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.098+0000 7f7af97fa640 1 -- 172.21.15.44:0/3081140964 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4034d10 con 0x7f7afc1f2790 2023-11-04T01:38:31.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.098+0000 7f7b02f0c640 1 -- 172.21.15.44:0/3081140964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7afc15a8b0 con 0x7f7afc1f2790 2023-11-04T01:38:31.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.099+0000 7f7b02f0c640 1 -- 172.21.15.44:0/3081140964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7afc158a50 con 0x7f7afc1f2790 2023-11-04T01:38:31.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.099+0000 7f7af97fa640 1 -- 172.21.15.44:0/3081140964 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7af403e440 con 0x7f7afc1f2790 2023-11-04T01:38:31.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.100+0000 7f7af97fa640 1 --2- 172.21.15.44:0/3081140964 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7ae806ae70 0x7f7ae806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.100+0000 7f7af97fa640 1 -- 172.21.15.44:0/3081140964 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7af40ab430 con 0x7f7afc1f2790 2023-11-04T01:38:31.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.100+0000 7f7b00ca8640 1 --2- 172.21.15.44:0/3081140964 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7ae806ae70 0x7f7ae806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.101+0000 7f7b00ca8640 1 --2- 172.21.15.44:0/3081140964 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7ae806ae70 0x7f7ae806d330 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7aec004840 tx=0x7f7aec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:31.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.104+0000 7f7af97fa640 1 -- 172.21.15.44:0/3081140964 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7af4076230 con 0x7f7afc1f2790 2023-11-04T01:38:31.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.319+0000 7f7b02f0c640 1 -- 172.21.15.44:0/3081140964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7afc074290 con 0x7f7afc1f2790 2023-11-04T01:38:31.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.319+0000 7f7af97fa640 1 -- 172.21.15.44:0/3081140964 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f7af4079850 con 0x7f7afc1f2790 2023-11-04T01:38:31.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5543,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/1112718006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1112718006},{"type":"v1","addr":"172.21.15.204:6837","nonce":1112718006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5935,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/719128216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":719128216},{"type":"v1","addr":"172.21.15.204:6836","nonce":719128216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3272698261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3272698261},{"type":"v1","addr":"172.21.15.44:6833","nonce":3272698261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:22.129730+0000","modified":"2023-11-04T01:38:24.137808+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/2413284016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2413284016},{"type":"v1","addr":"172.21.15.44:6835","nonce":2413284016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:38:31.322 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 31 2023-11-04T01:38:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.321+0000 7f7b02f0c640 1 -- 172.21.15.44:0/3081140964 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7ae806ae70 msgr2=0x7f7ae806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.321+0000 7f7b02f0c640 1 --2- 172.21.15.44:0/3081140964 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7ae806ae70 0x7f7ae806d330 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7aec004840 tx=0x7f7aec009040 comp rx=0 tx=0).stop 2023-11-04T01:38:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.321+0000 7f7b02f0c640 1 -- 172.21.15.44:0/3081140964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1f2790 msgr2=0x7f7afc15b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.321+0000 7f7b02f0c640 1 --2- 172.21.15.44:0/3081140964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1f2790 0x7f7afc15b580 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7af4002230 tx=0x7f7af4009750 comp rx=0 tx=0).stop 2023-11-04T01:38:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.321+0000 7f7b02f0c640 1 -- 172.21.15.44:0/3081140964 shutdown_connections 2023-11-04T01:38:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.321+0000 7f7b02f0c640 1 --2- 172.21.15.44:0/3081140964 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7ae806ae70 0x7f7ae806d330 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.321+0000 7f7b02f0c640 1 --2- 172.21.15.44:0/3081140964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1f2790 0x7f7afc15b580 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.321+0000 7f7b02f0c640 1 --2- 172.21.15.44:0/3081140964 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7afc0cd290 0x7f7afc1f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.321+0000 7f7b02f0c640 1 --2- 172.21.15.44:0/3081140964 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7afc156680 0x7f7afc15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.321+0000 7f7b02f0c640 1 -- 172.21.15.44:0/3081140964 >> 172.21.15.44:0/3081140964 conn(0x7f7afc071f30 msgr2=0x7f7afc0d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.321+0000 7f7b02f0c640 1 -- 172.21.15.44:0/3081140964 shutdown_connections 2023-11-04T01:38:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.321+0000 7f7b02f0c640 1 -- 172.21.15.44:0/3081140964 wait complete. 2023-11-04T01:38:31.736 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:38:22.129730+0000', 'modified': '2023-11-04T01:38:24.137808+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6411}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6411': {'gid': 6411, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/2413284016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 2413284016}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 2413284016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:38:31.737 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:38:31.737 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:38:31.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.847+0000 7f2f98768640 1 Processor -- start 2023-11-04T01:38:31.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.847+0000 7f2f98768640 1 -- start start 2023-11-04T01:38:31.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.848+0000 7f2f98768640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2f90160430 0x7f2f900b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.848+0000 7f2f98768640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f900b2fc0 con 0x7f2f9006c3a0 2023-11-04T01:38:31.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.848+0000 7f2f98768640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9006c7d0 con 0x7f2f900b2b60 2023-11-04T01:38:31.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.848+0000 7f2f98768640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f900cb580 con 0x7f2f90160430 2023-11-04T01:38:31.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f96d05640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2f9006c3a0 0x7f2f900cbcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50466/0 (socket says 172.21.15.44:50466) 2023-11-04T01:38:31.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f96d05640 1 -- 172.21.15.44:0/2298776785 learned_addr learned my addr 172.21.15.44:0/2298776785 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:31.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f96504640 1 --2- 172.21.15.44:0/2298776785 >> v2:172.21.15.204:3300/0 conn(0x7f2f90160430 0x7f2f900b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95502640 1 -- 172.21.15.44:0/2298776785 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074309445 0 0) 0x7f2f900b2fc0 con 0x7f2f9006c3a0 2023-11-04T01:38:31.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95502640 1 -- 172.21.15.44:0/2298776785 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f7c003520 con 0x7f2f9006c3a0 2023-11-04T01:38:31.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95502640 1 -- 172.21.15.44:0/2298776785 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1649927785 0 0) 0x7f2f7c003520 con 0x7f2f9006c3a0 2023-11-04T01:38:31.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95502640 1 -- 172.21.15.44:0/2298776785 >> v2:172.21.15.204:3300/0 conn(0x7f2f90160430 msgr2=0x7f2f900b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95502640 1 --2- 172.21.15.44:0/2298776785 >> v2:172.21.15.204:3300/0 conn(0x7f2f90160430 0x7f2f900b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95502640 1 -- 172.21.15.44:0/2298776785 >> v1:172.21.15.204:6789/0 conn(0x7f2f900b2b60 legacy=0x7f2f9006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95502640 1 -- 172.21.15.44:0/2298776785 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9006ca40 con 0x7f2f9006c3a0 2023-11-04T01:38:31.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95502640 1 -- 172.21.15.44:0/2298776785 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f2f8c0019f0 con 0x7f2f9006c3a0 2023-11-04T01:38:31.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95502640 1 -- 172.21.15.44:0/2298776785 >> v1:172.21.15.44:6789/0 conn(0x7f2f9006c3a0 legacy=0x7f2f900cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95502640 1 --2- 172.21.15.44:0/2298776785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f7c003970 0x7f2f7c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95502640 1 --2- 172.21.15.44:0/2298776785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c004370 0x7f2f7c004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95502640 1 --2- 172.21.15.44:0/2298776785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f7c005040 0x7f2f7c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95502640 1 -- 172.21.15.44:0/2298776785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f900cb580 con 0x7f2f7c005040 2023-11-04T01:38:31.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95502640 1 -- 172.21.15.44:0/2298776785 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c00bfa0 con 0x7f2f7c004370 2023-11-04T01:38:31.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95502640 1 -- 172.21.15.44:0/2298776785 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c00c160 con 0x7f2f7c003970 2023-11-04T01:38:31.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f95d03640 1 --2- 172.21.15.44:0/2298776785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c004370 0x7f2f7c004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f96d05640 1 --2- 172.21.15.44:0/2298776785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f7c005040 0x7f2f7c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.849+0000 7f2f96504640 1 --2- 172.21.15.44:0/2298776785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f7c003970 0x7f2f7c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.850+0000 7f2f96d05640 1 -- 172.21.15.44:0/2298776785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f7c003970 msgr2=0x7f2f7c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.850+0000 7f2f96d05640 1 --2- 172.21.15.44:0/2298776785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f7c003970 0x7f2f7c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.850+0000 7f2f96d05640 1 -- 172.21.15.44:0/2298776785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c004370 msgr2=0x7f2f7c004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.850+0000 7f2f96d05640 1 --2- 172.21.15.44:0/2298776785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c004370 0x7f2f7c004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.850+0000 7f2f96d05640 1 -- 172.21.15.44:0/2298776785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c003520 con 0x7f2f7c005040 2023-11-04T01:38:31.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.850+0000 7f2f95d03640 1 --2- 172.21.15.44:0/2298776785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c004370 0x7f2f7c004840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:31.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.850+0000 7f2f96d05640 1 -- 172.21.15.44:0/2298776785 reap_dead start 2023-11-04T01:38:31.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.850+0000 7f2f96d05640 1 --2- 172.21.15.44:0/2298776785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f7c005040 0x7f2f7c00b980 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00a830 tx=0x7f2f7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9375a87ed53e1483 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:31.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.851+0000 7f2f95502640 1 -- 172.21.15.44:0/2298776785 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c02cea0 con 0x7f2f7c005040 2023-11-04T01:38:31.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.851+0000 7f2f95502640 1 -- 172.21.15.44:0/2298776785 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8c02f070 con 0x7f2f7c005040 2023-11-04T01:38:31.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.851+0000 7f2f95502640 1 -- 172.21.15.44:0/2298776785 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c034890 con 0x7f2f7c005040 2023-11-04T01:38:31.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.851+0000 7f2f98768640 1 -- 172.21.15.44:0/2298776785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f7c005040 msgr2=0x7f2f7c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.851+0000 7f2f98768640 1 --2- 172.21.15.44:0/2298776785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f7c005040 0x7f2f7c00b980 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00a830 tx=0x7f2f7c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.851+0000 7f2f98768640 1 -- 172.21.15.44:0/2298776785 shutdown_connections 2023-11-04T01:38:31.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.851+0000 7f2f98768640 1 --2- 172.21.15.44:0/2298776785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f7c005040 0x7f2f7c00b980 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.851+0000 7f2f98768640 1 -- 172.21.15.44:0/2298776785 >> 172.21.15.44:0/2298776785 conn(0x7f2f9006ea20 msgr2=0x7f2f9006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:31.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.851+0000 7f2f98768640 1 -- 172.21.15.44:0/2298776785 shutdown_connections 2023-11-04T01:38:31.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.851+0000 7f2f98768640 1 -- 172.21.15.44:0/2298776785 wait complete. 2023-11-04T01:38:31.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.852+0000 7f2f98768640 1 Processor -- start 2023-11-04T01:38:31.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.852+0000 7f2f98768640 1 -- start start 2023-11-04T01:38:31.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.853+0000 7f2f98768640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c005040 0x7f2f901f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.853+0000 7f2f98768640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f90155e10 0x7f2f9015ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.853+0000 7f2f98768640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f9015c160 0x7f2f9015c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.853+0000 7f2f98768640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90154670 con 0x7f2f9015c160 2023-11-04T01:38:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.853+0000 7f2f98768640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9015cb20 con 0x7f2f7c005040 2023-11-04T01:38:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.853+0000 7f2f98768640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f901f2740 con 0x7f2f90155e10 2023-11-04T01:38:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.853+0000 7f2f96d05640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f9015c160 0x7f2f9015c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.853+0000 7f2f96d05640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f9015c160 0x7f2f9015c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44776/0 (socket says 172.21.15.44:44776) 2023-11-04T01:38:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.853+0000 7f2f96d05640 1 -- 172.21.15.44:0/1564086230 learned_addr learned my addr 172.21.15.44:0/1564086230 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.853+0000 7f2f95d03640 1 --2- 172.21.15.44:0/1564086230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f90155e10 0x7f2f9015ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.853+0000 7f2f96504640 1 --2- 172.21.15.44:0/1564086230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c005040 0x7f2f901f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.854+0000 7f2f96d05640 1 -- 172.21.15.44:0/1564086230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f90155e10 msgr2=0x7f2f9015ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.854+0000 7f2f96d05640 1 --2- 172.21.15.44:0/1564086230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f90155e10 0x7f2f9015ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.854+0000 7f2f96d05640 1 -- 172.21.15.44:0/1564086230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c005040 msgr2=0x7f2f901f2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.854+0000 7f2f96d05640 1 --2- 172.21.15.44:0/1564086230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c005040 0x7f2f901f2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.854+0000 7f2f96d05640 1 -- 172.21.15.44:0/1564086230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9015f320 con 0x7f2f9015c160 2023-11-04T01:38:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.854+0000 7f2f96504640 1 --2- 172.21.15.44:0/1564086230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c005040 0x7f2f901f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:31.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.854+0000 7f2f96d05640 1 --2- 172.21.15.44:0/1564086230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f9015c160 0x7f2f9015c5e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00a830 tx=0x7f2f8c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:31.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.854+0000 7f2f86ffd640 1 -- 172.21.15.44:0/1564086230 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c004d60 con 0x7f2f9015c160 2023-11-04T01:38:31.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.854+0000 7f2f86ffd640 1 -- 172.21.15.44:0/1564086230 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8c02cea0 con 0x7f2f9015c160 2023-11-04T01:38:31.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.854+0000 7f2f98768640 1 -- 172.21.15.44:0/1564086230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9015f550 con 0x7f2f9015c160 2023-11-04T01:38:31.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.854+0000 7f2f86ffd640 1 -- 172.21.15.44:0/1564086230 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c03f670 con 0x7f2f9015c160 2023-11-04T01:38:31.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.854+0000 7f2f98768640 1 -- 172.21.15.44:0/1564086230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f90156840 con 0x7f2f9015c160 2023-11-04T01:38:31.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.856+0000 7f2f86ffd640 1 -- 172.21.15.44:0/1564086230 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f8c031030 con 0x7f2f9015c160 2023-11-04T01:38:31.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.856+0000 7f2f86ffd640 1 --2- 172.21.15.44:0/1564086230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f7406aea0 0x7f2f7406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.856+0000 7f2f86ffd640 1 -- 172.21.15.44:0/1564086230 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2f8c0aacb0 con 0x7f2f9015c160 2023-11-04T01:38:31.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.856+0000 7f2f96504640 1 --2- 172.21.15.44:0/1564086230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f7406aea0 0x7f2f7406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.857+0000 7f2f96504640 1 --2- 172.21.15.44:0/1564086230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f7406aea0 0x7f2f7406d360 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009b40 tx=0x7f2f88008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:31.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.857+0000 7f2f9b3d7740 1 Processor -- start 2023-11-04T01:38:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.857+0000 7f2f9b3d7740 1 -- start start 2023-11-04T01:38:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f9b3d7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55850 0x5586cff28750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f9b3d7740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff55c30 0x5586cff585e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f9b3d7740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff28c90 0x5586cff58b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f9b3d7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586cfe39740 con 0x5586cff55850 2023-11-04T01:38:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f9b3d7740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586cfe9b8d0 con 0x5586cff28c90 2023-11-04T01:38:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f9b3d7740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586cfe98fc0 con 0x5586cff55c30 2023-11-04T01:38:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f96504640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55850 0x5586cff28750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f96504640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55850 0x5586cff28750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44780/0 (socket says 172.21.15.44:44780) 2023-11-04T01:38:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f96504640 1 -- 172.21.15.44:0/4270984245 learned_addr learned my addr 172.21.15.44:0/4270984245 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f95d03640 1 --2- 172.21.15.44:0/4270984245 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff55c30 0x5586cff585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f96d05640 1 --2- 172.21.15.44:0/4270984245 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff28c90 0x5586cff58b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f96504640 1 -- 172.21.15.44:0/4270984245 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff55c30 msgr2=0x5586cff585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f96504640 1 --2- 172.21.15.44:0/4270984245 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff55c30 0x5586cff585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f96504640 1 -- 172.21.15.44:0/4270984245 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff28c90 msgr2=0x5586cff58b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f96504640 1 --2- 172.21.15.44:0/4270984245 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff28c90 0x5586cff58b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f96504640 1 -- 172.21.15.44:0/4270984245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586cfe57ca0 con 0x5586cff55850 2023-11-04T01:38:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.858+0000 7f2f96d05640 1 --2- 172.21.15.44:0/4270984245 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff28c90 0x5586cff58b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.859+0000 7f2f96504640 1 --2- 172.21.15.44:0/4270984245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55850 0x5586cff28750 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2f88014e70 tx=0x7f2f88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1ca0f044a3513d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.859+0000 7f2f73fff640 1 -- 172.21.15.44:0/4270984245 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88016e40 con 0x5586cff55850 2023-11-04T01:38:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.859+0000 7f2f73fff640 1 -- 172.21.15.44:0/4270984245 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88009790 con 0x5586cff55850 2023-11-04T01:38:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.859+0000 7f2f73fff640 1 -- 172.21.15.44:0/4270984245 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88023860 con 0x5586cff55850 2023-11-04T01:38:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.859+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/4270984245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55850 msgr2=0x5586cff28750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.859+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/4270984245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55850 0x5586cff28750 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2f88014e70 tx=0x7f2f88017000 comp rx=0 tx=0).stop 2023-11-04T01:38:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.859+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/4270984245 shutdown_connections 2023-11-04T01:38:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.859+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/4270984245 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff28c90 0x5586cff58b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.859+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/4270984245 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff55c30 0x5586cff585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.859+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/4270984245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55850 0x5586cff28750 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.859+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/4270984245 >> 172.21.15.44:0/4270984245 conn(0x5586cff2aa60 msgr2=0x5586cff735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.859+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/4270984245 shutdown_connections 2023-11-04T01:38:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.859+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/4270984245 wait complete. 2023-11-04T01:38:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.860+0000 7f2f9b3d7740 1 -- start start 2023-11-04T01:38:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.860+0000 7f2f9b3d7740 1 Processor -- start 2023-11-04T01:38:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f9b3d7740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff55850 0x5586cff6aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f9b3d7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55c30 0x5586cff5aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f9b3d7740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff86660 0x5586cff5af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f9b3d7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586cfe948b0 con 0x5586cff55c30 2023-11-04T01:38:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f9b3d7740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586cfe4ec80 con 0x5586cff55850 2023-11-04T01:38:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f9b3d7740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586cfe4e920 con 0x5586cff86660 2023-11-04T01:38:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f9b3d7740 10 client.0 _ll_register_callbacks cb 0x5586cfba6ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:38:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f95d03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55c30 0x5586cff5aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f95d03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55c30 0x5586cff5aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44784/0 (socket says 172.21.15.44:44784) 2023-11-04T01:38:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f95d03640 1 -- 172.21.15.44:0/2719400993 learned_addr learned my addr 172.21.15.44:0/2719400993 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:31.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f95d03640 1 -- 172.21.15.44:0/2719400993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff86660 msgr2=0x5586cff5af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f95d03640 1 --2- 172.21.15.44:0/2719400993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff86660 0x5586cff5af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f95d03640 1 -- 172.21.15.44:0/2719400993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff55850 msgr2=0x5586cff6aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f96504640 1 --2- 172.21.15.44:0/2719400993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff55850 0x5586cff6aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f95d03640 1 --2- 172.21.15.44:0/2719400993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff55850 0x5586cff6aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.861+0000 7f2f95d03640 1 -- 172.21.15.44:0/2719400993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f88014af0 con 0x5586cff55c30 2023-11-04T01:38:31.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f95d03640 1 --2- 172.21.15.44:0/2719400993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55c30 0x5586cff5aa00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f2f80001c90 tx=0x7f2f800039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbffbffbf72ee4ff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:31.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f717fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:38:31.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f717fa640 1 -- 172.21.15.44:0/2719400993 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80007240 con 0x5586cff55c30 2023-11-04T01:38:31.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f717fa640 1 -- 172.21.15.44:0/2719400993 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2f800073a0 con 0x5586cff55c30 2023-11-04T01:38:31.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2719400993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586cfe40bf0 con 0x5586cff55c30 2023-11-04T01:38:31.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f717fa640 1 -- 172.21.15.44:0/2719400993 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f80007560 con 0x5586cff55c30 2023-11-04T01:38:31.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f9b3d7740 10 client.6573 fetch_fsmap learned FSMap version 31 2023-11-04T01:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2719400993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x5586cfe92f30 con 0x5586cff55c30 2023-11-04T01:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f717fa640 1 -- 172.21.15.44:0/2719400993 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f80024070 con 0x5586cff55c30 2023-11-04T01:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f717fa640 1 -- 172.21.15.44:0/2719400993 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 31) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2f80012070 con 0x5586cff55c30 2023-11-04T01:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f9b3d7740 10 client.6573 fetch_fsmap finished waiting for FSMap version 31 2023-11-04T01:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f9b3d7740 10 client.6573 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f9b3d7740 20 client.6573 populate_metadata read hostname 'smithi044' 2023-11-04T01:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/2719400993 >> [v2:172.21.15.44:6834/2413284016,v1:172.21.15.44:6835/2413284016] conn(0x5586cff86f80 0x5586cff87360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f9b3d7740 4 client.6573 mds_command: new command op to 6411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2719400993 --> [v2:172.21.15.44:6834/2413284016,v1:172.21.15.44:6835/2413284016] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5586cfe8d890 con 0x5586cff86f80 2023-11-04T01:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.862+0000 7f2f96504640 1 --2- 172.21.15.44:0/2719400993 >> [v2:172.21.15.44:6834/2413284016,v1:172.21.15.44:6835/2413284016] conn(0x5586cff86f80 0x5586cff87360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.863+0000 7f2f717fa640 10 client.6573 ms_handle_connect on v2:172.21.15.44:6834/2413284016 2023-11-04T01:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.863+0000 7f2f96504640 1 --2- 172.21.15.44:0/2719400993 >> [v2:172.21.15.44:6834/2413284016,v1:172.21.15.44:6835/2413284016] conn(0x5586cff86f80 0x5586cff87360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad119ba589bf6d0e server_cookie=4bdc9b725151db03 in_seq=0 out_seq=0 2023-11-04T01:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.863+0000 7f2f717fa640 1 -- 172.21.15.44:0/2719400993 <== mds.0 v2:172.21.15.44:6834/2413284016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5586cfe8d890 con 0x5586cff86f80 2023-11-04T01:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.863+0000 7f2f717fa640 10 client.6573 handle_command_reply: tid=0 2023-11-04T01:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.863+0000 7f2f9b3d7740 1 client.6573 shutdown 2023-11-04T01:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.863+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2719400993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55c30 msgr2=0x5586cff5aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.863+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/2719400993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55c30 0x5586cff5aa00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f2f80001c90 tx=0x7f2f800039c0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.864+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2719400993 shutdown_connections 2023-11-04T01:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.864+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/2719400993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff86660 0x5586cff5af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.864+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/2719400993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55c30 0x5586cff5aa00 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.864+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/2719400993 >> [v2:172.21.15.44:6834/2413284016,v1:172.21.15.44:6835/2413284016] conn(0x5586cff86f80 0x5586cff87360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.864+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/2719400993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff55850 0x5586cff6aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.864+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2719400993 >> 172.21.15.44:0/2719400993 conn(0x5586cff28c90 msgr2=0x5586cff2c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.864+0000 7f2f717fa640 0 client.6573 ms_handle_reset on v2:172.21.15.44:6834/2413284016 2023-11-04T01:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.864+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2719400993 shutdown_connections 2023-11-04T01:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.864+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2719400993 wait complete. 2023-11-04T01:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.864+0000 7f2f9b3d7740 20 client.6573 trim_cache size 0 max 16384 2023-11-04T01:38:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.879+0000 7f2f9b3d7740 1 Processor -- start 2023-11-04T01:38:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.880+0000 7f2f9b3d7740 1 -- start start 2023-11-04T01:38:31.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.880+0000 7f2f9b3d7740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff55850 0x5586cff27ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.880+0000 7f2f9b3d7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55c30 0x5586cff6ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.880+0000 7f2f9b3d7740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff86660 0x5586cff6cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.880+0000 7f2f9b3d7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586cfe14280 con 0x5586cff55c30 2023-11-04T01:38:31.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.880+0000 7f2f9b3d7740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586cff54560 con 0x5586cff86660 2023-11-04T01:38:31.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.880+0000 7f2f9b3d7740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586cff54760 con 0x5586cff55850 2023-11-04T01:38:31.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.880+0000 7f2f95d03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55c30 0x5586cff6ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.880+0000 7f2f95d03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55c30 0x5586cff6ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44796/0 (socket says 172.21.15.44:44796) 2023-11-04T01:38:31.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.880+0000 7f2f95d03640 1 -- 172.21.15.44:0/3110449079 learned_addr learned my addr 172.21.15.44:0/3110449079 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:31.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f96d05640 1 --2- 172.21.15.44:0/3110449079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff86660 0x5586cff6cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f95d03640 1 -- 172.21.15.44:0/3110449079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff55850 msgr2=0x5586cff27ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f95d03640 1 --2- 172.21.15.44:0/3110449079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff55850 0x5586cff27ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f95d03640 1 -- 172.21.15.44:0/3110449079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff86660 msgr2=0x5586cff6cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f95d03640 1 --2- 172.21.15.44:0/3110449079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff86660 0x5586cff6cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f95d03640 1 -- 172.21.15.44:0/3110449079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586cfe30d10 con 0x5586cff55c30 2023-11-04T01:38:31.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f95d03640 1 --2- 172.21.15.44:0/3110449079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55c30 0x5586cff6ca00 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2f800014e0 tx=0x7f2f80014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0f7391ae9e3f63 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:31.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f84ff9640 1 -- 172.21.15.44:0/3110449079 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800067d0 con 0x5586cff55c30 2023-11-04T01:38:31.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f84ff9640 1 -- 172.21.15.44:0/3110449079 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f80024070 con 0x5586cff55c30 2023-11-04T01:38:31.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f84ff9640 1 -- 172.21.15.44:0/3110449079 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80006930 con 0x5586cff55c30 2023-11-04T01:38:31.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/3110449079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55c30 msgr2=0x5586cff6ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/3110449079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55c30 0x5586cff6ca00 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2f800014e0 tx=0x7f2f80014000 comp rx=0 tx=0).stop 2023-11-04T01:38:31.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/3110449079 shutdown_connections 2023-11-04T01:38:31.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/3110449079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff86660 0x5586cff6cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/3110449079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff55c30 0x5586cff6ca00 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/3110449079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff55850 0x5586cff27ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.881+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/3110449079 >> 172.21.15.44:0/3110449079 conn(0x5586cff28c90 msgr2=0x5586cff23c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:31.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.882+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/3110449079 shutdown_connections 2023-11-04T01:38:31.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.882+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/3110449079 wait complete. 2023-11-04T01:38:31.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.882+0000 7f2f9b3d7740 1 -- start start 2023-11-04T01:38:31.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.882+0000 7f2f9b3d7740 1 Processor -- start 2023-11-04T01:38:31.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.883+0000 7f2f9b3d7740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff55850 0x5586cffdda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.883+0000 7f2f9b3d7740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff55c30 0x5586cff76af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.883+0000 7f2f9b3d7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff86660 0x5586cff77030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.883+0000 7f2f9b3d7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586cffdf6b0 con 0x5586cff86660 2023-11-04T01:38:31.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.883+0000 7f2f9b3d7740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586cff6e390 con 0x5586cff55c30 2023-11-04T01:38:31.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.883+0000 7f2f9b3d7740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586cff6e5e0 con 0x5586cff55850 2023-11-04T01:38:31.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.883+0000 7f2f9b3d7740 10 client.0 _ll_register_callbacks cb 0x7f2f8801a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:38:31.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.883+0000 7f2f96d05640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff86660 0x5586cff77030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.883+0000 7f2f96d05640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff86660 0x5586cff77030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44800/0 (socket says 172.21.15.44:44800) 2023-11-04T01:38:31.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.883+0000 7f2f96d05640 1 -- 172.21.15.44:0/2094671513 learned_addr learned my addr 172.21.15.44:0/2094671513 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:31.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.883+0000 7f2f96504640 1 --2- 172.21.15.44:0/2094671513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff55850 0x5586cffdda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.883+0000 7f2f95d03640 1 --2- 172.21.15.44:0/2094671513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff55c30 0x5586cff76af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f96d05640 1 -- 172.21.15.44:0/2094671513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff55850 msgr2=0x5586cffdda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f96d05640 1 --2- 172.21.15.44:0/2094671513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff55850 0x5586cffdda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f96d05640 1 -- 172.21.15.44:0/2094671513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff55c30 msgr2=0x5586cff76af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f96d05640 1 --2- 172.21.15.44:0/2094671513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff55c30 0x5586cff76af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f96d05640 1 -- 172.21.15.44:0/2094671513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5586cfe92f30 con 0x5586cff86660 2023-11-04T01:38:31.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f96d05640 1 --2- 172.21.15.44:0/2094671513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff86660 0x5586cff77030 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c000f80 tx=0x7f2f8c0793e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582d9bff54043767 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:31.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f717fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:38:31.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f717fa640 1 -- 172.21.15.44:0/2094671513 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c07d830 con 0x5586cff86660 2023-11-04T01:38:31.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f717fa640 1 -- 172.21.15.44:0/2094671513 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2f8c0819e0 con 0x5586cff86660 2023-11-04T01:38:31.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2094671513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f88009790 con 0x5586cff86660 2023-11-04T01:38:31.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f717fa640 1 -- 172.21.15.44:0/2094671513 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f8c00a480 con 0x5586cff86660 2023-11-04T01:38:31.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f9b3d7740 10 client.6579 fetch_fsmap learned FSMap version 31 2023-11-04T01:38:31.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2094671513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x5586cfe56500 con 0x5586cff86660 2023-11-04T01:38:31.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f717fa640 1 -- 172.21.15.44:0/2094671513 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88009790 con 0x5586cff86660 2023-11-04T01:38:31.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f717fa640 1 -- 172.21.15.44:0/2094671513 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 31) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2f8c075ea0 con 0x5586cff86660 2023-11-04T01:38:31.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f9b3d7740 10 client.6579 fetch_fsmap finished waiting for FSMap version 31 2023-11-04T01:38:31.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f9b3d7740 10 client.6579 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:38:31.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f9b3d7740 20 client.6579 populate_metadata read hostname 'smithi044' 2023-11-04T01:38:31.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/2094671513 >> [v2:172.21.15.44:6834/2413284016,v1:172.21.15.44:6835/2413284016] conn(0x5586cff81fd0 0x5586cff823b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f9b3d7740 4 client.6579 mds_command: new command op to 6411 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:38:31.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2094671513 --> [v2:172.21.15.44:6834/2413284016,v1:172.21.15.44:6835/2413284016] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5586cfe8d5b0 con 0x5586cff81fd0 2023-11-04T01:38:31.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.884+0000 7f2f96504640 1 --2- 172.21.15.44:0/2094671513 >> [v2:172.21.15.44:6834/2413284016,v1:172.21.15.44:6835/2413284016] conn(0x5586cff81fd0 0x5586cff823b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f717fa640 10 client.6579 ms_handle_connect on v2:172.21.15.44:6834/2413284016 2023-11-04T01:38:31.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f96504640 1 --2- 172.21.15.44:0/2094671513 >> [v2:172.21.15.44:6834/2413284016,v1:172.21.15.44:6835/2413284016] conn(0x5586cff81fd0 0x5586cff823b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9949b0cb0504ae7 server_cookie=d00bdc29351a04be in_seq=0 out_seq=0 2023-11-04T01:38:31.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f717fa640 1 -- 172.21.15.44:0/2094671513 <== mds.0 v2:172.21.15.44:6834/2413284016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5586cfe8d5b0 con 0x5586cff81fd0 2023-11-04T01:38:31.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f717fa640 10 client.6579 handle_command_reply: tid=0 2023-11-04T01:38:31.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f9b3d7740 1 client.6579 shutdown 2023-11-04T01:38:31.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2094671513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff86660 msgr2=0x5586cff77030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/2094671513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff86660 0x5586cff77030 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c000f80 tx=0x7f2f8c0793e0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2094671513 shutdown_connections 2023-11-04T01:38:31.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/2094671513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586cff86660 0x5586cff77030 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/2094671513 >> [v2:172.21.15.44:6834/2413284016,v1:172.21.15.44:6835/2413284016] conn(0x5586cff81fd0 0x5586cff823b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/2094671513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5586cff55c30 0x5586cff76af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f9b3d7740 1 --2- 172.21.15.44:0/2094671513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5586cff55850 0x5586cffdda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2094671513 >> 172.21.15.44:0/2094671513 conn(0x5586cff28c90 msgr2=0x5586cff6b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:31.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f717fa640 0 client.6579 ms_handle_reset on v2:172.21.15.44:6834/2413284016 2023-11-04T01:38:31.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2094671513 shutdown_connections 2023-11-04T01:38:31.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f9b3d7740 1 -- 172.21.15.44:0/2094671513 wait complete. 2023-11-04T01:38:31.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.885+0000 7f2f9b3d7740 20 client.6579 trim_cache size 0 max 16384 2023-11-04T01:38:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:38:31.895 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:38:31.895 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2023-11-04T01:38:31.895 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6411, 2023-11-04T01:38:31.895 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:38:31.895 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:38:31.895 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:38:31.895 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 9.0990473999999999, 2023-11-04T01:38:31.895 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 31, 2023-11-04T01:38:31.895 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 67, 2023-11-04T01:38:31.895 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 67, 2023-11-04T01:38:31.895 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 14.095605915 2023-11-04T01:38:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:38:31.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.886+0000 7f2f98768640 1 -- 172.21.15.44:0/1564086230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f7406aea0 msgr2=0x7f2f7406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.886+0000 7f2f98768640 1 --2- 172.21.15.44:0/1564086230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f7406aea0 0x7f2f7406d360 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009b40 tx=0x7f2f88008040 comp rx=0 tx=0).stop 2023-11-04T01:38:31.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.886+0000 7f2f98768640 1 -- 172.21.15.44:0/1564086230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f9015c160 msgr2=0x7f2f9015c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.886+0000 7f2f98768640 1 --2- 172.21.15.44:0/1564086230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f9015c160 0x7f2f9015c5e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00a830 tx=0x7f2f8c001d80 comp rx=0 tx=0).stop 2023-11-04T01:38:31.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.886+0000 7f2f98768640 1 -- 172.21.15.44:0/1564086230 shutdown_connections 2023-11-04T01:38:31.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.886+0000 7f2f98768640 1 --2- 172.21.15.44:0/1564086230 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f7406aea0 0x7f2f7406d360 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.886+0000 7f2f98768640 1 --2- 172.21.15.44:0/1564086230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f9015c160 0x7f2f9015c5e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.886+0000 7f2f98768640 1 --2- 172.21.15.44:0/1564086230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f90155e10 0x7f2f9015ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.886+0000 7f2f98768640 1 --2- 172.21.15.44:0/1564086230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c005040 0x7f2f901f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.886+0000 7f2f98768640 1 -- 172.21.15.44:0/1564086230 >> 172.21.15.44:0/1564086230 conn(0x7f2f9006ea20 msgr2=0x7f2f90160810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:31.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.886+0000 7f2f98768640 1 -- 172.21.15.44:0/1564086230 shutdown_connections 2023-11-04T01:38:31.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:31.886+0000 7f2f98768640 1 -- 172.21.15.44:0/1564086230 wait complete. 2023-11-04T01:38:31.898 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:38:32.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.003+0000 7fc296590640 1 Processor -- start 2023-11-04T01:38:32.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.003+0000 7fc296590640 1 -- start start 2023-11-04T01:38:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.004+0000 7fc296590640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc29015ce60 0x7fc29006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.004+0000 7fc296590640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc2900cf160 0x7fc2900cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.004+0000 7fc296590640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2901615d0 con 0x7fc29006bd30 2023-11-04T01:38:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.004+0000 7fc296590640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2900cbde0 con 0x7fc29015ce60 2023-11-04T01:38:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.004+0000 7fc296590640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2900cfb30 con 0x7fc2900cf160 2023-11-04T01:38:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.004+0000 7fc28ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc29015ce60 0x7fc29006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.004+0000 7fc28ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc29015ce60 0x7fc29006b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44810/0 (socket says 172.21.15.44:44810) 2023-11-04T01:38:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.004+0000 7fc28ffff640 1 -- 172.21.15.44:0/272137995 learned_addr learned my addr 172.21.15.44:0/272137995 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.004+0000 7fc294b2d640 1 --2- 172.21.15.44:0/272137995 >> v2:172.21.15.204:3300/0 conn(0x7fc2900cf160 0x7fc2900cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.005+0000 7fc28ffff640 1 -- 172.21.15.44:0/272137995 >> v2:172.21.15.204:3300/0 conn(0x7fc2900cf160 msgr2=0x7fc2900cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.005+0000 7fc28ffff640 1 --2- 172.21.15.44:0/272137995 >> v2:172.21.15.204:3300/0 conn(0x7fc2900cf160 0x7fc2900cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.005+0000 7fc28ffff640 1 -- 172.21.15.44:0/272137995 >> v1:172.21.15.44:6789/0 conn(0x7fc29006bd30 legacy=0x7fc290160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.005+0000 7fc28effd640 1 -- 172.21.15.44:0/272137995 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347405827 0 0) 0x7fc2901615d0 con 0x7fc29006bd30 2023-11-04T01:38:32.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.005+0000 7fc28ffff640 1 -- 172.21.15.44:0/272137995 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2901618b0 con 0x7fc29015ce60 2023-11-04T01:38:32.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.005+0000 7fc28ffff640 1 --2- 172.21.15.44:0/272137995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc29015ce60 0x7fc29006b7f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc29006f7a0 tx=0x7fc28002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c260f4944d31c6a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:32.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.005+0000 7fc28effd640 1 -- 172.21.15.44:0/272137995 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280030860 con 0x7fc29015ce60 2023-11-04T01:38:32.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.005+0000 7fc28effd640 1 -- 172.21.15.44:0/272137995 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2800309c0 con 0x7fc29015ce60 2023-11-04T01:38:32.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.005+0000 7fc28effd640 1 -- 172.21.15.44:0/272137995 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280030d50 con 0x7fc29015ce60 2023-11-04T01:38:32.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.006+0000 7fc296590640 1 -- 172.21.15.44:0/272137995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc29015ce60 msgr2=0x7fc29006b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.006+0000 7fc296590640 1 --2- 172.21.15.44:0/272137995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc29015ce60 0x7fc29006b7f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc29006f7a0 tx=0x7fc28002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.006+0000 7fc296590640 1 -- 172.21.15.44:0/272137995 shutdown_connections 2023-11-04T01:38:32.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.006+0000 7fc296590640 1 --2- 172.21.15.44:0/272137995 >> v2:172.21.15.204:3300/0 conn(0x7fc2900cf160 0x7fc2900cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.006+0000 7fc296590640 1 --2- 172.21.15.44:0/272137995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc29015ce60 0x7fc29006b7f0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.006+0000 7fc296590640 1 -- 172.21.15.44:0/272137995 >> 172.21.15.44:0/272137995 conn(0x7fc29006ea90 msgr2=0x7fc29006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:32.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.006+0000 7fc296590640 1 -- 172.21.15.44:0/272137995 shutdown_connections 2023-11-04T01:38:32.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.006+0000 7fc296590640 1 -- 172.21.15.44:0/272137995 wait complete. 2023-11-04T01:38:32.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.007+0000 7fc296590640 1 Processor -- start 2023-11-04T01:38:32.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.007+0000 7fc296590640 1 -- start start 2023-11-04T01:38:32.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.008+0000 7fc296590640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2900cf160 0x7fc29014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.008+0000 7fc296590640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc29015ce60 0x7fc2900c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.008+0000 7fc296590640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2900ca420 0x7fc29015e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.008+0000 7fc296590640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2900ca8b0 con 0x7fc2900cf160 2023-11-04T01:38:32.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.008+0000 7fc296590640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2901f63d0 con 0x7fc29015ce60 2023-11-04T01:38:32.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.008+0000 7fc296590640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29015f4a0 con 0x7fc2900ca420 2023-11-04T01:38:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.008+0000 7fc28ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2900cf160 0x7fc29014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.008+0000 7fc28ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2900cf160 0x7fc29014df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44812/0 (socket says 172.21.15.44:44812) 2023-11-04T01:38:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.008+0000 7fc28ffff640 1 -- 172.21.15.44:0/1321687569 learned_addr learned my addr 172.21.15.44:0/1321687569 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.009+0000 7fc294b2d640 1 --2- 172.21.15.44:0/1321687569 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2900ca420 0x7fc29015e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.009+0000 7fc28f7fe640 1 --2- 172.21.15.44:0/1321687569 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc29015ce60 0x7fc2900c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.009+0000 7fc28ffff640 1 -- 172.21.15.44:0/1321687569 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2900ca420 msgr2=0x7fc29015e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.009+0000 7fc28ffff640 1 --2- 172.21.15.44:0/1321687569 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2900ca420 0x7fc29015e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.009+0000 7fc28ffff640 1 -- 172.21.15.44:0/1321687569 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc29015ce60 msgr2=0x7fc2900c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.009+0000 7fc28ffff640 1 --2- 172.21.15.44:0/1321687569 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc29015ce60 0x7fc2900c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.009+0000 7fc28ffff640 1 -- 172.21.15.44:0/1321687569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2800094d0 con 0x7fc2900cf160 2023-11-04T01:38:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.009+0000 7fc28f7fe640 1 --2- 172.21.15.44:0/1321687569 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc29015ce60 0x7fc2900c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.009+0000 7fc28ffff640 1 --2- 172.21.15.44:0/1321687569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2900cf160 0x7fc29014df60 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc280000c00 tx=0x7fc280004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.009+0000 7fc28cff9640 1 -- 172.21.15.44:0/1321687569 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280039c90 con 0x7fc2900cf160 2023-11-04T01:38:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.009+0000 7fc28cff9640 1 -- 172.21.15.44:0/1321687569 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc280039df0 con 0x7fc2900cf160 2023-11-04T01:38:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.009+0000 7fc296590640 1 -- 172.21.15.44:0/1321687569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29015f780 con 0x7fc2900cf160 2023-11-04T01:38:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.009+0000 7fc28cff9640 1 -- 172.21.15.44:0/1321687569 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280043620 con 0x7fc2900cf160 2023-11-04T01:38:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.009+0000 7fc296590640 1 -- 172.21.15.44:0/1321687569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29015fd40 con 0x7fc2900cf160 2023-11-04T01:38:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.010+0000 7fc296590640 1 -- 172.21.15.44:0/1321687569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc290074290 con 0x7fc2900cf160 2023-11-04T01:38:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.010+0000 7fc28cff9640 1 -- 172.21.15.44:0/1321687569 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc280043780 con 0x7fc2900cf160 2023-11-04T01:38:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.011+0000 7fc28cff9640 1 --2- 172.21.15.44:0/1321687569 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc27c06ae70 0x7fc27c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.011+0000 7fc28cff9640 1 -- 172.21.15.44:0/1321687569 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc28003e070 con 0x7fc2900cf160 2023-11-04T01:38:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.011+0000 7fc28f7fe640 1 --2- 172.21.15.44:0/1321687569 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc27c06ae70 0x7fc27c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.012+0000 7fc28f7fe640 1 --2- 172.21.15.44:0/1321687569 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc27c06ae70 0x7fc27c06d330 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc2900c98f0 tx=0x7fc284009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:32.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.015+0000 7fc28cff9640 1 -- 172.21.15.44:0/1321687569 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc2800778c0 con 0x7fc2900cf160 2023-11-04T01:38:32.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.230+0000 7fc296590640 1 -- 172.21.15.44:0/1321687569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc29015b650 con 0x7fc2900cf160 2023-11-04T01:38:32.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.230+0000 7fc28cff9640 1 -- 172.21.15.44:0/1321687569 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc28007aee0 con 0x7fc2900cf160 2023-11-04T01:38:32.232 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:38:32.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.232+0000 7fc296590640 1 -- 172.21.15.44:0/1321687569 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc27c06ae70 msgr2=0x7fc27c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.232+0000 7fc296590640 1 --2- 172.21.15.44:0/1321687569 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc27c06ae70 0x7fc27c06d330 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc2900c98f0 tx=0x7fc284009040 comp rx=0 tx=0).stop 2023-11-04T01:38:32.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.232+0000 7fc296590640 1 -- 172.21.15.44:0/1321687569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2900cf160 msgr2=0x7fc29014df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.232+0000 7fc296590640 1 --2- 172.21.15.44:0/1321687569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2900cf160 0x7fc29014df60 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc280000c00 tx=0x7fc280004730 comp rx=0 tx=0).stop 2023-11-04T01:38:32.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.232+0000 7fc296590640 1 -- 172.21.15.44:0/1321687569 shutdown_connections 2023-11-04T01:38:32.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.232+0000 7fc296590640 1 --2- 172.21.15.44:0/1321687569 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc27c06ae70 0x7fc27c06d330 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.232+0000 7fc296590640 1 --2- 172.21.15.44:0/1321687569 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2900ca420 0x7fc29015e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.232+0000 7fc296590640 1 --2- 172.21.15.44:0/1321687569 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc29015ce60 0x7fc2900c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.232+0000 7fc296590640 1 --2- 172.21.15.44:0/1321687569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2900cf160 0x7fc29014df60 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.232+0000 7fc296590640 1 -- 172.21.15.44:0/1321687569 >> 172.21.15.44:0/1321687569 conn(0x7fc29006ea90 msgr2=0x7fc2901608e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:32.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.232+0000 7fc296590640 1 -- 172.21.15.44:0/1321687569 shutdown_connections 2023-11-04T01:38:32.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:32.232+0000 7fc296590640 1 -- 172.21.15.44:0/1321687569 wait complete. 2023-11-04T01:38:32.245 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:38:32.245 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:38:32.245 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2023-11-04T01:38:32.245 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:38:32.245 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:32.246 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:38:32.246 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:38:32.246 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:38:32.246 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:32.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:32.246 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2023-11-04T01:38:32.262 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:38:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:38:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:38:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2023-11-04T01:38:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:32.263 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2023-11-04T01:38:32.263 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2023-11-04T01:38:32.263 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:38:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2023-11-04T01:38:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-04T01:38:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42357sec preferred_lft 42357sec 2023-11-04T01:38:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2023-11-04T01:38:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:32.264 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2023-11-04T01:38:32.264 INFO:teuthology.orchestra.run.smithi044.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:38:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:38:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::9082:77ff:fe28:4353/64 scope link 2023-11-04T01:38:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:38:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::e49d:e3ff:fe56:d068/64 scope link 2023-11-04T01:38:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:38:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether f2:23:83:31:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::f023:83ff:fe31:915/64 scope link 2023-11-04T01:38:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:32.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:32.266 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:38:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:1 2023-11-04T01:38:32.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:32.333 DEBUG:teuthology.orchestra.run.smithi044:> route 2023-11-04T01:38:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2023-11-04T01:38:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:38:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-04T01:38:32.391 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-04T01:38:32.391 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:38:32.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:32.391 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:38:32.391 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:38:32.391 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:38:32.391 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:38:32.391 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:38:32.392 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:38:32.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:32.496 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2023-11-04T01:38:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:38:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:38:32.512 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:32.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:32.512 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2023-11-04T01:38:32.585 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:38:32.586 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:38:32.586 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:32.641 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:32.641 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:38:32.641 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:32.697 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:32.752 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:38:32.752 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:38:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:38:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:38:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:38:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:38:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:38:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:38:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:38:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:38:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:38:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:38:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:38:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:38:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:38:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:38:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:38:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:38:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:38:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:38:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:32.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:32.755 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:38:32.808 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:38:32.809 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:38:32.851 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:38:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:38:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:38:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:38:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:38:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:38:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:38:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:38:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:38:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:38:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:38:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:38:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:38:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:38:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:38:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:38:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:38:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:38:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:38:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:38:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:32.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:32.877 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:38:32.950 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:38:32.947+0000 7fa6e0c64480 -1 init, newargv = 0x563984662a30 newargc=15 2023-11-04T01:38:32.950 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[110872]: starting ceph client 2023-11-04T01:38:32.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[110872]: starting fuse 2023-11-04T01:38:34.030 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:34.051 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:38:34.051 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:38:34.052 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:38:34.052 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:38:34.052 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:38:34.052 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:38:34.052 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:38:34.052 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:38:34.052 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:38:34.052 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:38:34.052 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:38:34.052 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:38:34.052 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:34.053 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:38:34.053 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:38:34.053 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:38:34.053 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:38:34.053 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:34.053 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:38:34.053 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:34.053 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:34.053 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:34.053 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:34.054 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:38:34.054 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:38:34.054 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:34.054 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:34.054 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:34.054 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:34.054 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:38:34.054 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:34.054 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:34.054 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:34.054 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:34.054 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:34.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:34.055 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:38:34.110 INFO:teuthology.orchestra.run.smithi044.stdout:41 2023-11-04T01:38:34.111 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:38:34.111 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:38:34.111 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2023-11-04T01:38:34.111 DEBUG:teuthology.orchestra.run.smithi044:> import re 2023-11-04T01:38:34.111 DEBUG:teuthology.orchestra.run.smithi044:> import os 2023-11-04T01:38:34.111 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2023-11-04T01:38:34.111 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:38:34.111 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2023-11-04T01:38:34.111 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:38:34.112 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2023-11-04T01:38:34.112 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:38:34.112 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:38:34.112 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2023-11-04T01:38:34.112 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2023-11-04T01:38:34.112 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2023-11-04T01:38:34.112 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2023-11-04T01:38:34.112 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:38:34.112 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2023-11-04T01:38:34.112 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:38:34.112 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:38:34.112 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:38:34.112 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2023-11-04T01:38:34.112 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2023-11-04T01:38:34.113 DEBUG:teuthology.orchestra.run.smithi044:> return f 2023-11-04T01:38:34.113 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:38:34.113 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:38:34.113 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2023-11-04T01:38:34.113 DEBUG:teuthology.orchestra.run.smithi044:> ' 2023-11-04T01:38:34.247 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.110872.asok 2023-11-04T01:38:34.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:34.258 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.110872.asok 2023-11-04T01:38:34.258 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:34.259 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.110872.asok status 2023-11-04T01:38:34.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:34.437 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:38:34.437 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2023-11-04T01:38:34.437 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:38:34.437 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:38:34.437 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2023-11-04T01:38:34.437 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2023-11-04T01:38:34.437 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:38:34.437 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "110872", 2023-11-04T01:38:34.437 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2023-11-04T01:38:34.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:34.438 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2023-11-04T01:38:34.438 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2023-11-04T01:38:34.438 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6591, 2023-11-04T01:38:34.438 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2023-11-04T01:38:34.438 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2023-11-04T01:38:34.438 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2023-11-04T01:38:34.438 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 6591 2023-11-04T01:38:34.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:34.438 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:38:34.438 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:38:34.438 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:38:34.438 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1713674129 2023-11-04T01:38:34.439 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:34.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:34.439 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:38:34.439 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:38:34.439 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:38:34.439 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1713674129 2023-11-04T01:38:34.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:34.439 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.6591 192.168.0.1:0/1713674129", 2023-11-04T01:38:34.439 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/1713674129", 2023-11-04T01:38:34.439 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2023-11-04T01:38:34.439 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 31, 2023-11-04T01:38:34.439 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 67, 2023-11-04T01:38:34.439 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:38:34.440 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2023-11-04T01:38:34.440 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2023-11-04T01:38:34.440 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:38:34.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:34.451 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:34.451 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:38:34.451 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:34.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:34.515 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2023-11-04T01:38:34.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:34.522 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:34.522 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:34.522 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:34.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:34.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:34.592 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_data_pool 2023-11-04T01:38:34.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.698+0000 7f6575e90640 1 Processor -- start 2023-11-04T01:38:34.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.699+0000 7f6575e90640 1 -- start start 2023-11-04T01:38:34.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.699+0000 7f6575e90640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6570153e60 0x7f657015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.699+0000 7f6575e90640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f65700cd6d0 0x7f6570161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.699+0000 7f6575e90640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700cde60 con 0x7f65700b4880 2023-11-04T01:38:34.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.699+0000 7f6575e90640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6570160f90 con 0x7f6570153e60 2023-11-04T01:38:34.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.699+0000 7f6575e90640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657015e400 con 0x7f65700cd6d0 2023-11-04T01:38:34.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.699+0000 7f656f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6570153e60 0x7f657015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.699+0000 7f656ffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f65700b4880 0x7f657006b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47024/0 (socket says 172.21.15.44:47024) 2023-11-04T01:38:34.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.700+0000 7f656ffff640 1 -- 172.21.15.44:0/3795098658 learned_addr learned my addr 172.21.15.44:0/3795098658 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:34.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.700+0000 7f656effd640 1 --2- 172.21.15.44:0/3795098658 >> v2:172.21.15.204:3300/0 conn(0x7f65700cd6d0 0x7f6570161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.700+0000 7f656f7fe640 1 -- 172.21.15.44:0/3795098658 >> v2:172.21.15.204:3300/0 conn(0x7f65700cd6d0 msgr2=0x7f6570161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:34.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.700+0000 7f656f7fe640 1 --2- 172.21.15.44:0/3795098658 >> v2:172.21.15.204:3300/0 conn(0x7f65700cd6d0 0x7f6570161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.700+0000 7f656f7fe640 1 -- 172.21.15.44:0/3795098658 >> v1:172.21.15.44:6789/0 conn(0x7f65700b4880 legacy=0x7f657006b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.700+0000 7f656f7fe640 1 -- 172.21.15.44:0/3795098658 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6570161960 con 0x7f6570153e60 2023-11-04T01:38:34.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.700+0000 7f656effd640 1 --2- 172.21.15.44:0/3795098658 >> v2:172.21.15.204:3300/0 conn(0x7f65700cd6d0 0x7f6570161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:34.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.701+0000 7f656f7fe640 1 --2- 172.21.15.44:0/3795098658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6570153e60 0x7f657015dec0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f65700c9e80 tx=0x7f656002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb1635b3120010a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.701+0000 7f656e7fc640 1 -- 172.21.15.44:0/3795098658 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560031830 con 0x7f6570153e60 2023-11-04T01:38:34.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.701+0000 7f656e7fc640 1 -- 172.21.15.44:0/3795098658 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6560031990 con 0x7f6570153e60 2023-11-04T01:38:34.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.701+0000 7f656e7fc640 1 -- 172.21.15.44:0/3795098658 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560031d20 con 0x7f6570153e60 2023-11-04T01:38:34.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.701+0000 7f6575e90640 1 -- 172.21.15.44:0/3795098658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6570153e60 msgr2=0x7f657015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.701+0000 7f6575e90640 1 --2- 172.21.15.44:0/3795098658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6570153e60 0x7f657015dec0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f65700c9e80 tx=0x7f656002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.701+0000 7f6575e90640 1 -- 172.21.15.44:0/3795098658 shutdown_connections 2023-11-04T01:38:34.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.701+0000 7f6575e90640 1 --2- 172.21.15.44:0/3795098658 >> v2:172.21.15.204:3300/0 conn(0x7f65700cd6d0 0x7f6570161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.701+0000 7f6575e90640 1 --2- 172.21.15.44:0/3795098658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6570153e60 0x7f657015dec0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.701+0000 7f6575e90640 1 -- 172.21.15.44:0/3795098658 >> 172.21.15.44:0/3795098658 conn(0x7f65700cf880 msgr2=0x7f65700cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:34.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.701+0000 7f6575e90640 1 -- 172.21.15.44:0/3795098658 shutdown_connections 2023-11-04T01:38:34.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.701+0000 7f6575e90640 1 -- 172.21.15.44:0/3795098658 wait complete. 2023-11-04T01:38:34.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.702+0000 7f6575e90640 1 Processor -- start 2023-11-04T01:38:34.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.703+0000 7f6575e90640 1 -- start start 2023-11-04T01:38:34.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.703+0000 7f6575e90640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65700b4880 0x7f65701f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.703+0000 7f6575e90640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65700cd6d0 0x7f6570152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.703+0000 7f6575e90640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6570153e60 0x7f65700b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.703+0000 7f6575e90640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6570159100 con 0x7f65700cd6d0 2023-11-04T01:38:34.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.703+0000 7f6575e90640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65701f6830 con 0x7f65700b4880 2023-11-04T01:38:34.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.703+0000 7f6575e90640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657015a4c0 con 0x7f6570153e60 2023-11-04T01:38:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f656effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65700cd6d0 0x7f6570152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f656effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65700cd6d0 0x7f6570152390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51664/0 (socket says 172.21.15.44:51664) 2023-11-04T01:38:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f656effd640 1 -- 172.21.15.44:0/2147312160 learned_addr learned my addr 172.21.15.44:0/2147312160 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f656f7fe640 1 --2- 172.21.15.44:0/2147312160 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65700b4880 0x7f65701f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f656ffff640 1 --2- 172.21.15.44:0/2147312160 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6570153e60 0x7f65700b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f656effd640 1 -- 172.21.15.44:0/2147312160 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6570153e60 msgr2=0x7f65700b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f656effd640 1 --2- 172.21.15.44:0/2147312160 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6570153e60 0x7f65700b7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f656effd640 1 -- 172.21.15.44:0/2147312160 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65700b4880 msgr2=0x7f65701f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f656effd640 1 --2- 172.21.15.44:0/2147312160 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65700b4880 0x7f65701f62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f656effd640 1 -- 172.21.15.44:0/2147312160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6560009400 con 0x7f65700cd6d0 2023-11-04T01:38:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f656effd640 1 --2- 172.21.15.44:0/2147312160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65700cd6d0 0x7f6570152390 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f656400c7f0 tx=0x7f656400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f6557fff640 1 -- 172.21.15.44:0/2147312160 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6564007a30 con 0x7f65700cd6d0 2023-11-04T01:38:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f6557fff640 1 -- 172.21.15.44:0/2147312160 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6564007b90 con 0x7f65700cd6d0 2023-11-04T01:38:34.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f6575e90640 1 -- 172.21.15.44:0/2147312160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65700cb8d0 con 0x7f65700cd6d0 2023-11-04T01:38:34.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f6557fff640 1 -- 172.21.15.44:0/2147312160 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656400ce40 con 0x7f65700cd6d0 2023-11-04T01:38:34.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.704+0000 7f6575e90640 1 -- 172.21.15.44:0/2147312160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65701584f0 con 0x7f65700cd6d0 2023-11-04T01:38:34.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.705+0000 7f6575e90640 1 -- 172.21.15.44:0/2147312160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65700cbf70 con 0x7f65700cd6d0 2023-11-04T01:38:34.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.706+0000 7f6557fff640 1 -- 172.21.15.44:0/2147312160 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f65640113f0 con 0x7f65700cd6d0 2023-11-04T01:38:34.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.706+0000 7f6557fff640 1 --2- 172.21.15.44:0/2147312160 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f655c06aea0 0x7f655c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.706+0000 7f6557fff640 1 -- 172.21.15.44:0/2147312160 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f65640898c0 con 0x7f65700cd6d0 2023-11-04T01:38:34.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.706+0000 7f656f7fe640 1 --2- 172.21.15.44:0/2147312160 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f655c06aea0 0x7f655c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.707+0000 7f656f7fe640 1 --2- 172.21.15.44:0/2147312160 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f655c06aea0 0x7f655c06d360 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6560036000 tx=0x7f656003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.710+0000 7f6557fff640 1 -- 172.21.15.44:0/2147312160 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6564054810 con 0x7f65700cd6d0 2023-11-04T01:38:34.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:34.886+0000 7f6575e90640 1 -- 172.21.15.44:0/2147312160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_data_pool"} v 0) v1 -- 0x7f6570074290 con 0x7f65700cd6d0 2023-11-04T01:38:35.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.195+0000 7f6557fff640 1 -- 172.21.15.44:0/2147312160 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_data_pool"}]=0 pool 'test_data_pool' created v68) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6564057e30 con 0x7f65700cd6d0 2023-11-04T01:38:35.197 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'test_data_pool' created 2023-11-04T01:38:35.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.197+0000 7f6575e90640 1 -- 172.21.15.44:0/2147312160 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f655c06aea0 msgr2=0x7f655c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.197+0000 7f6575e90640 1 --2- 172.21.15.44:0/2147312160 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f655c06aea0 0x7f655c06d360 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6560036000 tx=0x7f656003c040 comp rx=0 tx=0).stop 2023-11-04T01:38:35.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.197+0000 7f6575e90640 1 -- 172.21.15.44:0/2147312160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65700cd6d0 msgr2=0x7f6570152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.197+0000 7f6575e90640 1 --2- 172.21.15.44:0/2147312160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65700cd6d0 0x7f6570152390 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f656400c7f0 tx=0x7f656400cbf0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.197+0000 7f6575e90640 1 -- 172.21.15.44:0/2147312160 shutdown_connections 2023-11-04T01:38:35.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.197+0000 7f6575e90640 1 --2- 172.21.15.44:0/2147312160 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f655c06aea0 0x7f655c06d360 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.197+0000 7f6575e90640 1 --2- 172.21.15.44:0/2147312160 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6570153e60 0x7f65700b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.197+0000 7f6575e90640 1 --2- 172.21.15.44:0/2147312160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65700cd6d0 0x7f6570152390 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.197+0000 7f6575e90640 1 --2- 172.21.15.44:0/2147312160 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65700b4880 0x7f65701f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.197+0000 7f6575e90640 1 -- 172.21.15.44:0/2147312160 >> 172.21.15.44:0/2147312160 conn(0x7f65700cf880 msgr2=0x7f65700d25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:35.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.197+0000 7f6575e90640 1 -- 172.21.15.44:0/2147312160 shutdown_connections 2023-11-04T01:38:35.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.197+0000 7f6575e90640 1 -- 172.21.15.44:0/2147312160 wait complete. 2023-11-04T01:38:35.216 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_metadata_pool 2023-11-04T01:38:35.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.323+0000 7f9d65cc2640 1 Processor -- start 2023-11-04T01:38:35.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.323+0000 7f9d65cc2640 1 -- start start 2023-11-04T01:38:35.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.324+0000 7f9d65cc2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d600cdac0 0x7f9d600b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.324+0000 7f9d65cc2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d600d01f0 con 0x7f9d6015af20 2023-11-04T01:38:35.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.324+0000 7f9d65cc2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d600b6a40 con 0x7f9d600b64c0 2023-11-04T01:38:35.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.324+0000 7f9d65cc2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d600cc380 con 0x7f9d600cdac0 2023-11-04T01:38:35.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.324+0000 7f9d5f7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9d6015af20 0x7f9d600cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47032/0 (socket says 172.21.15.44:47032) 2023-11-04T01:38:35.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.324+0000 7f9d5f7fe640 1 -- 172.21.15.44:0/2996883324 learned_addr learned my addr 172.21.15.44:0/2996883324 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:35.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5ffff640 1 --2- 172.21.15.44:0/2996883324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d600cdac0 0x7f9d600b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5e7fc640 1 -- 172.21.15.44:0/2996883324 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902414123 0 0) 0x7f9d600d01f0 con 0x7f9d6015af20 2023-11-04T01:38:35.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5e7fc640 1 -- 172.21.15.44:0/2996883324 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d48003520 con 0x7f9d6015af20 2023-11-04T01:38:35.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5e7fc640 1 -- 172.21.15.44:0/2996883324 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2697754743 0 0) 0x7f9d48003520 con 0x7f9d6015af20 2023-11-04T01:38:35.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5e7fc640 1 -- 172.21.15.44:0/2996883324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d600cdac0 msgr2=0x7f9d600b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:35.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5e7fc640 1 --2- 172.21.15.44:0/2996883324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d600cdac0 0x7f9d600b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5e7fc640 1 -- 172.21.15.44:0/2996883324 >> v1:172.21.15.204:6789/0 conn(0x7f9d600b64c0 legacy=0x7f9d600cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5e7fc640 1 -- 172.21.15.44:0/2996883324 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d600d04b0 con 0x7f9d6015af20 2023-11-04T01:38:35.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5e7fc640 1 -- 172.21.15.44:0/2996883324 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f9d50001690 con 0x7f9d6015af20 2023-11-04T01:38:35.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5e7fc640 1 -- 172.21.15.44:0/2996883324 >> v1:172.21.15.44:6789/0 conn(0x7f9d6015af20 legacy=0x7f9d600cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5e7fc640 1 --2- 172.21.15.44:0/2996883324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d480039a0 0x7f9d48003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5e7fc640 1 --2- 172.21.15.44:0/2996883324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d480047c0 0x7f9d48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5e7fc640 1 --2- 172.21.15.44:0/2996883324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d600cdac0 0x7f9d48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5e7fc640 1 -- 172.21.15.44:0/2996883324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d600cc380 con 0x7f9d480039a0 2023-11-04T01:38:35.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5e7fc640 1 -- 172.21.15.44:0/2996883324 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4800ba30 con 0x7f9d480047c0 2023-11-04T01:38:35.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5e7fc640 1 -- 172.21.15.44:0/2996883324 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4800bbf0 con 0x7f9d600cdac0 2023-11-04T01:38:35.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5f7fe640 1 --2- 172.21.15.44:0/2996883324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d480039a0 0x7f9d48003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5effd640 1 --2- 172.21.15.44:0/2996883324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d480047c0 0x7f9d48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5ffff640 1 --2- 172.21.15.44:0/2996883324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d600cdac0 0x7f9d48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5f7fe640 1 -- 172.21.15.44:0/2996883324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d600cdac0 msgr2=0x7f9d48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:35.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5f7fe640 1 --2- 172.21.15.44:0/2996883324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d600cdac0 0x7f9d48005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5f7fe640 1 -- 172.21.15.44:0/2996883324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d480047c0 msgr2=0x7f9d48004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:35.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.325+0000 7f9d5f7fe640 1 --2- 172.21.15.44:0/2996883324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d480047c0 0x7f9d48004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.326+0000 7f9d5f7fe640 1 -- 172.21.15.44:0/2996883324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d48003520 con 0x7f9d480039a0 2023-11-04T01:38:35.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.326+0000 7f9d5effd640 1 --2- 172.21.15.44:0/2996883324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d480047c0 0x7f9d48004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:35.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.326+0000 7f9d5f7fe640 1 --2- 172.21.15.44:0/2996883324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d480039a0 0x7f9d48003dc0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9d50001eb0 tx=0x7f9d480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef560b063699c1c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.326+0000 7f9d5e7fc640 1 -- 172.21.15.44:0/2996883324 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d50005ad0 con 0x7f9d480039a0 2023-11-04T01:38:35.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.326+0000 7f9d5e7fc640 1 -- 172.21.15.44:0/2996883324 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d50005c30 con 0x7f9d480039a0 2023-11-04T01:38:35.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.326+0000 7f9d5e7fc640 1 -- 172.21.15.44:0/2996883324 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5002c870 con 0x7f9d480039a0 2023-11-04T01:38:35.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.327+0000 7f9d65cc2640 1 -- 172.21.15.44:0/2996883324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d480039a0 msgr2=0x7f9d48003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.327+0000 7f9d65cc2640 1 --2- 172.21.15.44:0/2996883324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d480039a0 0x7f9d48003dc0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9d50001eb0 tx=0x7f9d480057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.327+0000 7f9d5ffff640 1 -- 172.21.15.44:0/2996883324 reap_dead start 2023-11-04T01:38:35.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.327+0000 7f9d65cc2640 1 -- 172.21.15.44:0/2996883324 shutdown_connections 2023-11-04T01:38:35.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.327+0000 7f9d65cc2640 1 -- 172.21.15.44:0/2996883324 >> 172.21.15.44:0/2996883324 conn(0x7f9d6006ea20 msgr2=0x7f9d6006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:35.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.327+0000 7f9d65cc2640 1 -- 172.21.15.44:0/2996883324 shutdown_connections 2023-11-04T01:38:35.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.327+0000 7f9d65cc2640 1 -- 172.21.15.44:0/2996883324 wait complete. 2023-11-04T01:38:35.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.328+0000 7f9d65cc2640 1 Processor -- start 2023-11-04T01:38:35.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.328+0000 7f9d65cc2640 1 -- start start 2023-11-04T01:38:35.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.329+0000 7f9d65cc2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d480039a0 0x7f9d601588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.329+0000 7f9d65cc2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d600c6b10 0x7f9d60150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.329+0000 7f9d65cc2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d600c6f70 0x7f9d601510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.329+0000 7f9d65cc2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6015ba50 con 0x7f9d480039a0 2023-11-04T01:38:35.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.329+0000 7f9d65cc2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d60151600 con 0x7f9d600c6f70 2023-11-04T01:38:35.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.329+0000 7f9d65cc2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6015e690 con 0x7f9d600c6b10 2023-11-04T01:38:35.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.329+0000 7f9d5f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d480039a0 0x7f9d601588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.329+0000 7f9d5f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d480039a0 0x7f9d601588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51676/0 (socket says 172.21.15.44:51676) 2023-11-04T01:38:35.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.329+0000 7f9d5f7fe640 1 -- 172.21.15.44:0/693003499 learned_addr learned my addr 172.21.15.44:0/693003499 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:35.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.329+0000 7f9d5ffff640 1 --2- 172.21.15.44:0/693003499 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d600c6f70 0x7f9d601510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.329+0000 7f9d5effd640 1 --2- 172.21.15.44:0/693003499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d600c6b10 0x7f9d60150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.330+0000 7f9d5f7fe640 1 -- 172.21.15.44:0/693003499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d600c6b10 msgr2=0x7f9d60150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.330+0000 7f9d5f7fe640 1 --2- 172.21.15.44:0/693003499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d600c6b10 0x7f9d60150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.330+0000 7f9d5f7fe640 1 -- 172.21.15.44:0/693003499 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d600c6f70 msgr2=0x7f9d601510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.330+0000 7f9d5f7fe640 1 --2- 172.21.15.44:0/693003499 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d600c6f70 0x7f9d601510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.330+0000 7f9d5f7fe640 1 -- 172.21.15.44:0/693003499 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6015b770 con 0x7f9d480039a0 2023-11-04T01:38:35.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.330+0000 7f9d5f7fe640 1 --2- 172.21.15.44:0/693003499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d480039a0 0x7f9d601588d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9d5002c410 tx=0x7f9d50001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.330+0000 7f9d47fff640 1 -- 172.21.15.44:0/693003499 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d50039070 con 0x7f9d480039a0 2023-11-04T01:38:35.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.330+0000 7f9d47fff640 1 -- 172.21.15.44:0/693003499 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5002cc80 con 0x7f9d480039a0 2023-11-04T01:38:35.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.330+0000 7f9d47fff640 1 -- 172.21.15.44:0/693003499 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5003c040 con 0x7f9d480039a0 2023-11-04T01:38:35.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.330+0000 7f9d65cc2640 1 -- 172.21.15.44:0/693003499 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6015dbb0 con 0x7f9d480039a0 2023-11-04T01:38:35.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.330+0000 7f9d65cc2640 1 -- 172.21.15.44:0/693003499 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6015e170 con 0x7f9d480039a0 2023-11-04T01:38:35.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.331+0000 7f9d65cc2640 1 -- 172.21.15.44:0/693003499 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6015e300 con 0x7f9d480039a0 2023-11-04T01:38:35.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.332+0000 7f9d47fff640 1 -- 172.21.15.44:0/693003499 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d50032070 con 0x7f9d480039a0 2023-11-04T01:38:35.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.332+0000 7f9d47fff640 1 --2- 172.21.15.44:0/693003499 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d4c06ae70 0x7f9d4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.332+0000 7f9d47fff640 1 -- 172.21.15.44:0/693003499 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9d500aad20 con 0x7f9d480039a0 2023-11-04T01:38:35.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.333+0000 7f9d5effd640 1 --2- 172.21.15.44:0/693003499 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d4c06ae70 0x7f9d4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.333+0000 7f9d5effd640 1 --2- 172.21.15.44:0/693003499 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d4c06ae70 0x7f9d4c06d330 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9d60152910 tx=0x7f9d54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.337+0000 7f9d47fff640 1 -- 172.21.15.44:0/693003499 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9d50075ae0 con 0x7f9d480039a0 2023-11-04T01:38:35.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:35.515+0000 7f9d65cc2640 1 -- 172.21.15.44:0/693003499 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_metadata_pool"} v 0) v1 -- 0x7f9d600b60f0 con 0x7f9d480039a0 2023-11-04T01:38:36.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.197+0000 7f9d47fff640 1 -- 172.21.15.44:0/693003499 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_metadata_pool"}]=0 pool 'test_metadata_pool' created v69) v1 ==== 126+0+0 (secure 0 0 0) 0x7f9d50079100 con 0x7f9d480039a0 2023-11-04T01:38:36.199 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'test_metadata_pool' created 2023-11-04T01:38:36.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.200+0000 7f9d65cc2640 1 -- 172.21.15.44:0/693003499 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d4c06ae70 msgr2=0x7f9d4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.200+0000 7f9d65cc2640 1 --2- 172.21.15.44:0/693003499 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d4c06ae70 0x7f9d4c06d330 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9d60152910 tx=0x7f9d54009040 comp rx=0 tx=0).stop 2023-11-04T01:38:36.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.200+0000 7f9d65cc2640 1 -- 172.21.15.44:0/693003499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d480039a0 msgr2=0x7f9d601588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.200+0000 7f9d65cc2640 1 --2- 172.21.15.44:0/693003499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d480039a0 0x7f9d601588d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9d5002c410 tx=0x7f9d50001a20 comp rx=0 tx=0).stop 2023-11-04T01:38:36.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.200+0000 7f9d65cc2640 1 -- 172.21.15.44:0/693003499 shutdown_connections 2023-11-04T01:38:36.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.200+0000 7f9d65cc2640 1 --2- 172.21.15.44:0/693003499 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9d4c06ae70 0x7f9d4c06d330 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.200+0000 7f9d65cc2640 1 --2- 172.21.15.44:0/693003499 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9d600c6f70 0x7f9d601510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.200+0000 7f9d65cc2640 1 --2- 172.21.15.44:0/693003499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9d600c6b10 0x7f9d60150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.200+0000 7f9d65cc2640 1 --2- 172.21.15.44:0/693003499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d480039a0 0x7f9d601588d0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.200+0000 7f9d65cc2640 1 -- 172.21.15.44:0/693003499 >> 172.21.15.44:0/693003499 conn(0x7f9d6006ea20 msgr2=0x7f9d600b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.200+0000 7f9d65cc2640 1 -- 172.21.15.44:0/693003499 shutdown_connections 2023-11-04T01:38:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.200+0000 7f9d65cc2640 1 -- 172.21.15.44:0/693003499 wait complete. 2023-11-04T01:38:36.230 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool mksnap snap4 2023-11-04T01:38:36.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.272+0000 7ff236c1ef40 1 Processor -- start 2023-11-04T01:38:36.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.272+0000 7ff236c1ef40 1 -- start start 2023-11-04T01:38:36.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.272+0000 7ff236c1ef40 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fc408a5e0 0x558fc412ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.272+0000 7ff236c1ef40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558fc409f4a0 0x558fc40a41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.272+0000 7ff236c1ef40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558fc40a2f60 0x558fc40a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff236c1ef40 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc40063b0 con 0x558fc408a5e0 2023-11-04T01:38:36.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff236c1ef40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc3fa0650 con 0x558fc40a2f60 2023-11-04T01:38:36.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff236c1ef40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x558fc3fa02f0 con 0x558fc409f4a0 2023-11-04T01:38:36.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff234720640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fc408a5e0 0x558fc412ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff234720640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fc408a5e0 0x558fc412ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51700/0 (socket says 172.21.15.44:51700) 2023-11-04T01:38:36.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff234720640 1 -- 172.21.15.44:0/4130091214 learned_addr learned my addr 172.21.15.44:0/4130091214 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:36.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff234f21640 1 --2- 172.21.15.44:0/4130091214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558fc40a2f60 0x558fc40a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff233f1f640 1 --2- 172.21.15.44:0/4130091214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558fc409f4a0 0x558fc40a41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff234720640 1 -- 172.21.15.44:0/4130091214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558fc409f4a0 msgr2=0x558fc40a41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff234720640 1 --2- 172.21.15.44:0/4130091214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558fc409f4a0 0x558fc40a41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff234720640 1 -- 172.21.15.44:0/4130091214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558fc40a2f60 msgr2=0x558fc40a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.277 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff234720640 1 --2- 172.21.15.44:0/4130091214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558fc40a2f60 0x558fc40a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff234720640 1 -- 172.21.15.44:0/4130091214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c005de0 con 0x558fc408a5e0 2023-11-04T01:38:36.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff234f21640 1 --2- 172.21.15.44:0/4130091214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558fc40a2f60 0x558fc40a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:36.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff233f1f640 1 --2- 172.21.15.44:0/4130091214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558fc409f4a0 0x558fc40a41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:36.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff234720640 1 --2- 172.21.15.44:0/4130091214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fc408a5e0 0x558fc412ff50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff22400a500 tx=0x7ff22400a9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264fd7726e548932 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff232f1d640 1 -- 172.21.15.44:0/4130091214 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224014070 con 0x558fc408a5e0 2023-11-04T01:38:36.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff232f1d640 1 -- 172.21.15.44:0/4130091214 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff224005020 con 0x558fc408a5e0 2023-11-04T01:38:36.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.273+0000 7ff232f1d640 1 -- 172.21.15.44:0/4130091214 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2240053b0 con 0x558fc408a5e0 2023-11-04T01:38:36.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.274+0000 7ff236c1ef40 1 -- 172.21.15.44:0/4130091214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fc408a5e0 msgr2=0x558fc412ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.274+0000 7ff236c1ef40 1 --2- 172.21.15.44:0/4130091214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fc408a5e0 0x558fc412ff50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff22400a500 tx=0x7ff22400a9c0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.274+0000 7ff236c1ef40 1 -- 172.21.15.44:0/4130091214 shutdown_connections 2023-11-04T01:38:36.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.274+0000 7ff236c1ef40 1 --2- 172.21.15.44:0/4130091214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558fc40a2f60 0x558fc40a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.274+0000 7ff236c1ef40 1 --2- 172.21.15.44:0/4130091214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558fc409f4a0 0x558fc40a41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.274+0000 7ff236c1ef40 1 --2- 172.21.15.44:0/4130091214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fc408a5e0 0x558fc412ff50 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.274+0000 7ff236c1ef40 1 -- 172.21.15.44:0/4130091214 >> 172.21.15.44:0/4130091214 conn(0x558fc4054d20 msgr2=0x558fc4055100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:36.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.274+0000 7ff236c1ef40 1 -- 172.21.15.44:0/4130091214 shutdown_connections 2023-11-04T01:38:36.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.274+0000 7ff236c1ef40 1 -- 172.21.15.44:0/4130091214 wait complete. 2023-11-04T01:38:36.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.275+0000 7ff236c1ef40 1 Processor -- start 2023-11-04T01:38:36.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.275+0000 7ff236c1ef40 1 -- start start 2023-11-04T01:38:36.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.275+0000 7ff236c1ef40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558fc408a5e0 0x558fc411dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.275+0000 7ff236c1ef40 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fc409f4a0 0x558fc4122620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.275+0000 7ff236c1ef40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558fc40a2f60 0x558fc4122b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.275+0000 7ff236c1ef40 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc3f804f0 con 0x558fc409f4a0 2023-11-04T01:38:36.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.275+0000 7ff236c1ef40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc412ff50 con 0x558fc408a5e0 2023-11-04T01:38:36.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.275+0000 7ff236c1ef40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x558fc4126390 con 0x558fc40a2f60 2023-11-04T01:38:36.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.275+0000 7ff233f1f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fc409f4a0 0x558fc4122620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.275+0000 7ff233f1f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fc409f4a0 0x558fc4122620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51710/0 (socket says 172.21.15.44:51710) 2023-11-04T01:38:36.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.275+0000 7ff233f1f640 1 -- 172.21.15.44:0/2539463752 learned_addr learned my addr 172.21.15.44:0/2539463752 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:36.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.276+0000 7ff234f21640 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558fc40a2f60 0x558fc4122b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.276+0000 7ff234720640 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558fc408a5e0 0x558fc411dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.276+0000 7ff233f1f640 1 -- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558fc40a2f60 msgr2=0x558fc4122b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.276+0000 7ff233f1f640 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558fc40a2f60 0x558fc4122b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.276+0000 7ff233f1f640 1 -- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558fc408a5e0 msgr2=0x558fc411dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.276+0000 7ff233f1f640 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558fc408a5e0 0x558fc411dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.276+0000 7ff233f1f640 1 -- 172.21.15.44:0/2539463752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22400a100 con 0x558fc409f4a0 2023-11-04T01:38:36.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.276+0000 7ff234f21640 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558fc40a2f60 0x558fc4122b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:36.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.276+0000 7ff234720640 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558fc408a5e0 0x558fc411dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:36.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.276+0000 7ff233f1f640 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fc409f4a0 0x558fc4122620 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff21c01cde0 tx=0x7ff21c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.276+0000 7ff231f1b640 1 -- 172.21.15.44:0/2539463752 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c052a80 con 0x558fc409f4a0 2023-11-04T01:38:36.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.276+0000 7ff231f1b640 1 -- 172.21.15.44:0/2539463752 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c052be0 con 0x558fc409f4a0 2023-11-04T01:38:36.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.276+0000 7ff236c1ef40 1 -- 172.21.15.44:0/2539463752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558fc3fac780 con 0x558fc409f4a0 2023-11-04T01:38:36.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.276+0000 7ff231f1b640 1 -- 172.21.15.44:0/2539463752 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c05d480 con 0x558fc409f4a0 2023-11-04T01:38:36.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.276+0000 7ff236c1ef40 1 -- 172.21.15.44:0/2539463752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558fc3f9f930 con 0x558fc409f4a0 2023-11-04T01:38:36.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.278+0000 7ff231f1b640 1 -- 172.21.15.44:0/2539463752 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff21c059040 con 0x558fc409f4a0 2023-11-04T01:38:36.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.278+0000 7ff231f1b640 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff214069820 0x7ff21406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.278+0000 7ff231f1b640 1 -- 172.21.15.44:0/2539463752 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7092+0+0 (secure 0 0 0) 0x7ff21c0ca400 con 0x558fc409f4a0 2023-11-04T01:38:36.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.278+0000 7ff236c1ef40 1 -- 172.21.15.44:0/2539463752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- pool_op(create snap pool 12 tid 1 name snap4 v0) v4 -- 0x558fc4010330 con 0x558fc409f4a0 2023-11-04T01:38:36.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.278+0000 7ff234720640 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff214069820 0x7ff21406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:36.279+0000 7ff234720640 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff214069820 0x7ff21406bce0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff22400a420 tx=0x7ff224007030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.204+0000 7ff231f1b640 1 -- 172.21.15.44:0/2539463752 <== mon.0 v2:172.21.15.44:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v70) v1 ==== 43+0+0 (secure 0 0 0) 0x7ff21c057080 con 0x558fc409f4a0 2023-11-04T01:38:37.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.204+0000 7ff231f1b640 1 -- 172.21.15.44:0/2539463752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7ff214073f60 con 0x558fc409f4a0 2023-11-04T01:38:37.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.205+0000 7ff231f1b640 1 -- 172.21.15.44:0/2539463752 <== mon.0 v2:172.21.15.44:3300/0 7 ==== osd_map(70..70 src has 1..70) v4 ==== 718+0+0 (secure 0 0 0) 0x7ff21c099590 con 0x558fc409f4a0 2023-11-04T01:38:37.208 INFO:teuthology.orchestra.run.smithi044.stdout:created pool test_data_pool snap snap4 2023-11-04T01:38:37.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.208+0000 7ff236c1ef40 1 -- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff214069820 msgr2=0x7ff21406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.208+0000 7ff236c1ef40 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff214069820 0x7ff21406bce0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff22400a420 tx=0x7ff224007030 comp rx=0 tx=0).stop 2023-11-04T01:38:37.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.208+0000 7ff236c1ef40 1 -- 172.21.15.44:0/2539463752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fc409f4a0 msgr2=0x558fc4122620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.209+0000 7ff236c1ef40 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fc409f4a0 0x558fc4122620 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff21c01cde0 tx=0x7ff21c002fb0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.210+0000 7ff236c1ef40 1 -- 172.21.15.44:0/2539463752 shutdown_connections 2023-11-04T01:38:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.210+0000 7ff236c1ef40 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff214069820 0x7ff21406bce0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.210+0000 7ff236c1ef40 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558fc40a2f60 0x558fc4122b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.210+0000 7ff236c1ef40 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fc409f4a0 0x558fc4122620 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.210+0000 7ff236c1ef40 1 --2- 172.21.15.44:0/2539463752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558fc408a5e0 0x558fc411dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.210+0000 7ff236c1ef40 1 -- 172.21.15.44:0/2539463752 >> 172.21.15.44:0/2539463752 conn(0x558fc4054d20 msgr2=0x558fc4055100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:37.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.211+0000 7ff236c1ef40 1 -- 172.21.15.44:0/2539463752 shutdown_connections 2023-11-04T01:38:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.211+0000 7ff236c1ef40 1 -- 172.21.15.44:0/2539463752 wait complete. 2023-11-04T01:38:37.222 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testfs test_metadata_pool test_data_pool 2023-11-04T01:38:37.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.336+0000 7f52a831d640 1 Processor -- start 2023-11-04T01:38:37.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.336+0000 7f52a831d640 1 -- start start 2023-11-04T01:38:37.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.337+0000 7f52a831d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f52a0153e60 0x7f52a015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.337+0000 7f52a831d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52a00b4880 0x7f52a00b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.337+0000 7f52a831d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a00cde60 con 0x7f52a00cd6d0 2023-11-04T01:38:37.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.337+0000 7f52a831d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a0160f90 con 0x7f52a0153e60 2023-11-04T01:38:37.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.337+0000 7f52a831d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a00b5200 con 0x7f52a00b4880 2023-11-04T01:38:37.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.337+0000 7f52a58b8640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f52a00cd6d0 0x7f52a0161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47044/0 (socket says 172.21.15.44:47044) 2023-11-04T01:38:37.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.337+0000 7f52a58b8640 1 -- 172.21.15.44:0/3617358240 learned_addr learned my addr 172.21.15.44:0/3617358240 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:37.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a68ba640 1 --2- 172.21.15.44:0/3617358240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52a00b4880 0x7f52a00b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a60b9640 1 --2- 172.21.15.44:0/3617358240 >> v2:172.21.15.204:3300/0 conn(0x7f52a0153e60 0x7f52a015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 -- 172.21.15.44:0/3617358240 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245710718 0 0) 0x7f52a00cde60 con 0x7f52a00cd6d0 2023-11-04T01:38:37.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 -- 172.21.15.44:0/3617358240 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5288003520 con 0x7f52a00cd6d0 2023-11-04T01:38:37.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 -- 172.21.15.44:0/3617358240 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2866390519 0 0) 0x7f5288003520 con 0x7f52a00cd6d0 2023-11-04T01:38:37.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 -- 172.21.15.44:0/3617358240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52a00b4880 msgr2=0x7f52a00b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:37.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 --2- 172.21.15.44:0/3617358240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52a00b4880 0x7f52a00b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 -- 172.21.15.44:0/3617358240 >> v2:172.21.15.204:3300/0 conn(0x7f52a0153e60 msgr2=0x7f52a015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:37.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 --2- 172.21.15.44:0/3617358240 >> v2:172.21.15.204:3300/0 conn(0x7f52a0153e60 0x7f52a015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 -- 172.21.15.44:0/3617358240 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a015e400 con 0x7f52a00cd6d0 2023-11-04T01:38:37.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 -- 172.21.15.44:0/3617358240 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f5294001670 con 0x7f52a00cd6d0 2023-11-04T01:38:37.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a60b9640 1 --2- 172.21.15.44:0/3617358240 >> v2:172.21.15.204:3300/0 conn(0x7f52a0153e60 0x7f52a015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:37.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 -- 172.21.15.44:0/3617358240 >> v1:172.21.15.44:6789/0 conn(0x7f52a00cd6d0 legacy=0x7f52a0161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 --2- 172.21.15.44:0/3617358240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5288003970 0x7f5288003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 --2- 172.21.15.44:0/3617358240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5288004360 0x7f5288004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 --2- 172.21.15.44:0/3617358240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5288004eb0 0x7f528800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 -- 172.21.15.44:0/3617358240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a0160f90 con 0x7f5288004360 2023-11-04T01:38:37.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 -- 172.21.15.44:0/3617358240 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a00b5200 con 0x7f5288004eb0 2023-11-04T01:38:37.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a50b7640 1 -- 172.21.15.44:0/3617358240 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528800bec0 con 0x7f5288003970 2023-11-04T01:38:37.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a68ba640 1 --2- 172.21.15.44:0/3617358240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52a00b4880 0x7f52a00b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:37.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a58b8640 1 --2- 172.21.15.44:0/3617358240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5288004360 0x7f5288004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a60b9640 1 --2- 172.21.15.44:0/3617358240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5288003970 0x7f5288003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a68ba640 1 --2- 172.21.15.44:0/3617358240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5288004eb0 0x7f528800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a58b8640 1 -- 172.21.15.44:0/3617358240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5288003970 msgr2=0x7f5288003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:37.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a58b8640 1 --2- 172.21.15.44:0/3617358240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5288003970 0x7f5288003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.338+0000 7f52a58b8640 1 -- 172.21.15.44:0/3617358240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5288004eb0 msgr2=0x7f528800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:37.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.339+0000 7f52a58b8640 1 --2- 172.21.15.44:0/3617358240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5288004eb0 0x7f528800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.339+0000 7f52a58b8640 1 -- 172.21.15.44:0/3617358240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5288003520 con 0x7f5288004360 2023-11-04T01:38:37.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.339+0000 7f52a58b8640 1 --2- 172.21.15.44:0/3617358240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5288004360 0x7f5288004840 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f529400c210 tx=0x7f52880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226c8466fb1fa162 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.339+0000 7f52a50b7640 1 -- 172.21.15.44:0/3617358240 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5294005ad0 con 0x7f5288004360 2023-11-04T01:38:37.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.339+0000 7f52a50b7640 1 -- 172.21.15.44:0/3617358240 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5294005c50 con 0x7f5288004360 2023-11-04T01:38:37.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.339+0000 7f52a50b7640 1 -- 172.21.15.44:0/3617358240 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529402c890 con 0x7f5288004360 2023-11-04T01:38:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.340+0000 7f52a831d640 1 -- 172.21.15.44:0/3617358240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5288004360 msgr2=0x7f5288004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.340+0000 7f52a831d640 1 --2- 172.21.15.44:0/3617358240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5288004360 0x7f5288004840 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f529400c210 tx=0x7f52880057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.340+0000 7f52a68ba640 1 -- 172.21.15.44:0/3617358240 reap_dead start 2023-11-04T01:38:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.340+0000 7f52a831d640 1 -- 172.21.15.44:0/3617358240 shutdown_connections 2023-11-04T01:38:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.340+0000 7f52a831d640 1 -- 172.21.15.44:0/3617358240 >> 172.21.15.44:0/3617358240 conn(0x7f52a00cf880 msgr2=0x7f52a00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.340+0000 7f52a831d640 1 -- 172.21.15.44:0/3617358240 shutdown_connections 2023-11-04T01:38:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.340+0000 7f52a831d640 1 -- 172.21.15.44:0/3617358240 wait complete. 2023-11-04T01:38:37.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.341+0000 7f52a831d640 1 Processor -- start 2023-11-04T01:38:37.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.341+0000 7f52a831d640 1 -- start start 2023-11-04T01:38:37.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a831d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5288004360 0x7f52a01f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a831d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52a0152e50 0x7f52a00c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a831d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52a00cb360 0x7f52a00c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a831d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a0155b50 con 0x7f5288004360 2023-11-04T01:38:37.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a831d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a0155590 con 0x7f52a0152e50 2023-11-04T01:38:37.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a831d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a0155870 con 0x7f52a00cb360 2023-11-04T01:38:37.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a60b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5288004360 0x7f52a01f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a60b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5288004360 0x7f52a01f66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51720/0 (socket says 172.21.15.44:51720) 2023-11-04T01:38:37.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a60b9640 1 -- 172.21.15.44:0/2449894607 learned_addr learned my addr 172.21.15.44:0/2449894607 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:37.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a68ba640 1 --2- 172.21.15.44:0/2449894607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52a00cb360 0x7f52a00c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a58b8640 1 --2- 172.21.15.44:0/2449894607 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52a0152e50 0x7f52a00c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a60b9640 1 -- 172.21.15.44:0/2449894607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52a00cb360 msgr2=0x7f52a00c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a60b9640 1 --2- 172.21.15.44:0/2449894607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52a00cb360 0x7f52a00c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a60b9640 1 -- 172.21.15.44:0/2449894607 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52a0152e50 msgr2=0x7f52a00c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a60b9640 1 --2- 172.21.15.44:0/2449894607 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52a0152e50 0x7f52a00c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a60b9640 1 -- 172.21.15.44:0/2449894607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a01f5eb0 con 0x7f5288004360 2023-11-04T01:38:37.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.342+0000 7f52a68ba640 1 --2- 172.21.15.44:0/2449894607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52a00cb360 0x7f52a00c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:37.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.343+0000 7f52a60b9640 1 --2- 172.21.15.44:0/2449894607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5288004360 0x7f52a01f66b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f5298011a90 tx=0x7f5298011f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.343+0000 7f529effd640 1 -- 172.21.15.44:0/2449894607 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529800fc10 con 0x7f5288004360 2023-11-04T01:38:37.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.343+0000 7f529effd640 1 -- 172.21.15.44:0/2449894607 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529800fd70 con 0x7f5288004360 2023-11-04T01:38:37.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.343+0000 7f529effd640 1 -- 172.21.15.44:0/2449894607 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529800fee0 con 0x7f5288004360 2023-11-04T01:38:37.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.343+0000 7f52a831d640 1 -- 172.21.15.44:0/2449894607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a01f6190 con 0x7f5288004360 2023-11-04T01:38:37.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.343+0000 7f52a831d640 1 -- 172.21.15.44:0/2449894607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a0154390 con 0x7f5288004360 2023-11-04T01:38:37.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.344+0000 7f52a831d640 1 -- 172.21.15.44:0/2449894607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a01f5d10 con 0x7f5288004360 2023-11-04T01:38:37.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.344+0000 7f529effd640 1 -- 172.21.15.44:0/2449894607 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5298004260 con 0x7f5288004360 2023-11-04T01:38:37.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.345+0000 7f529effd640 1 --2- 172.21.15.44:0/2449894607 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f528c06aea0 0x7f528c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.345+0000 7f529effd640 1 -- 172.21.15.44:0/2449894607 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7131+0+0 (secure 0 0 0) 0x7f529808a240 con 0x7f5288004360 2023-11-04T01:38:37.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.345+0000 7f52a58b8640 1 --2- 172.21.15.44:0/2449894607 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f528c06aea0 0x7f528c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.346+0000 7f52a58b8640 1 --2- 172.21.15.44:0/2449894607 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f528c06aea0 0x7f528c06d360 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5294034000 tx=0x7f5294007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.350+0000 7f529effd640 1 -- 172.21.15.44:0/2449894607 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52a01f5d10 con 0x7f5288004360 2023-11-04T01:38:37.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.563+0000 7f52a831d640 1 -- 172.21.15.44:0/2449894607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"} v 0) v1 -- 0x7f52a01f5d10 con 0x7f5288004360 2023-11-04T01:38:37.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.563+0000 7f529effd640 1 -- 172.21.15.44:0/2449894607 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"}]=-95 pool(12) already has mon-managed snaps; can't attach pool to fs v31) v1 ==== 198+0+0 (secure 0 0 0) 0x7f52a01f5d10 con 0x7f5288004360 2023-11-04T01:38:37.566 INFO:teuthology.orchestra.run.smithi044.stderr:Error ENOTSUP: pool(12) already has mon-managed snaps; can't attach pool to fs 2023-11-04T01:38:37.570 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:38:37.571 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool rmsnap snap4 2023-11-04T01:38:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.610+0000 7f4095e36f40 1 Processor -- start 2023-11-04T01:38:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.610+0000 7f4095e36f40 1 -- start start 2023-11-04T01:38:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.610+0000 7f4095e36f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ba77c0a070 0x55ba77bc56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.610+0000 7f4095e36f40 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba77c0ab10 0x55ba77c8e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.610+0000 7f4095e36f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ba77c9b8e0 0x55ba77bf37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.610+0000 7f4095e36f40 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba77b743b0 con 0x55ba77c0ab10 2023-11-04T01:38:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4095e36f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba77b0e650 con 0x55ba77c9b8e0 2023-11-04T01:38:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4095e36f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba77b0e2f0 con 0x55ba77c0a070 2023-11-04T01:38:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4092926640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba77c0ab10 0x55ba77c8e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4092926640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba77c0ab10 0x55ba77c8e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51750/0 (socket says 172.21.15.44:51750) 2023-11-04T01:38:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4092926640 1 -- 172.21.15.44:0/420773712 learned_addr learned my addr 172.21.15.44:0/420773712 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4093127640 1 --2- 172.21.15.44:0/420773712 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ba77c0a070 0x55ba77bc56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4093928640 1 --2- 172.21.15.44:0/420773712 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ba77c9b8e0 0x55ba77bf37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4092926640 1 -- 172.21.15.44:0/420773712 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ba77c0a070 msgr2=0x55ba77bc56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4092926640 1 --2- 172.21.15.44:0/420773712 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ba77c0a070 0x55ba77bc56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4092926640 1 -- 172.21.15.44:0/420773712 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ba77c9b8e0 msgr2=0x55ba77bf37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4092926640 1 --2- 172.21.15.44:0/420773712 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ba77c9b8e0 0x55ba77bf37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4092926640 1 -- 172.21.15.44:0/420773712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c005d20 con 0x55ba77c0ab10 2023-11-04T01:38:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4093928640 1 --2- 172.21.15.44:0/420773712 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ba77c9b8e0 0x55ba77bf37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4092926640 1 --2- 172.21.15.44:0/420773712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba77c0ab10 0x55ba77c8e4b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f407c001c90 tx=0x7f407c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee70a6a591daa30e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4091924640 1 -- 172.21.15.44:0/420773712 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c00e470 con 0x55ba77c0ab10 2023-11-04T01:38:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4091924640 1 -- 172.21.15.44:0/420773712 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c00e5d0 con 0x55ba77c0ab10 2023-11-04T01:38:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.611+0000 7f4091924640 1 -- 172.21.15.44:0/420773712 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c00e9c0 con 0x55ba77c0ab10 2023-11-04T01:38:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.612+0000 7f4095e36f40 1 -- 172.21.15.44:0/420773712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba77c0ab10 msgr2=0x55ba77c8e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.612+0000 7f4095e36f40 1 --2- 172.21.15.44:0/420773712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba77c0ab10 0x55ba77c8e4b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f407c001c90 tx=0x7f407c00b6c0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.612+0000 7f4095e36f40 1 -- 172.21.15.44:0/420773712 shutdown_connections 2023-11-04T01:38:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.612+0000 7f4095e36f40 1 --2- 172.21.15.44:0/420773712 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ba77c9b8e0 0x55ba77bf37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.612+0000 7f4095e36f40 1 --2- 172.21.15.44:0/420773712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba77c0ab10 0x55ba77c8e4b0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.612+0000 7f4095e36f40 1 --2- 172.21.15.44:0/420773712 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ba77c0a070 0x55ba77bc56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.612+0000 7f4095e36f40 1 -- 172.21.15.44:0/420773712 >> 172.21.15.44:0/420773712 conn(0x55ba77c0c530 msgr2=0x55ba77c91a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.612+0000 7f4095e36f40 1 -- 172.21.15.44:0/420773712 shutdown_connections 2023-11-04T01:38:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.612+0000 7f4095e36f40 1 -- 172.21.15.44:0/420773712 wait complete. 2023-11-04T01:38:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.612+0000 7f4095e36f40 1 Processor -- start 2023-11-04T01:38:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.612+0000 7f4095e36f40 1 -- start start 2023-11-04T01:38:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4095e36f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ba77c0a070 0x55ba77bf1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4095e36f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ba77c0ab10 0x55ba77c0eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4095e36f40 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba77c9b8e0 0x55ba77c0f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4095e36f40 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba77aee4f0 con 0x55ba77c9b8e0 2023-11-04T01:38:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4095e36f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba77c985a0 con 0x55ba77c0a070 2023-11-04T01:38:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4095e36f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba77d2e260 con 0x55ba77c0ab10 2023-11-04T01:38:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4093928640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba77c9b8e0 0x55ba77c0f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4093928640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba77c9b8e0 0x55ba77c0f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51754/0 (socket says 172.21.15.44:51754) 2023-11-04T01:38:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4093928640 1 -- 172.21.15.44:0/4113078814 learned_addr learned my addr 172.21.15.44:0/4113078814 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4092926640 1 --2- 172.21.15.44:0/4113078814 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ba77c0ab10 0x55ba77c0eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4093127640 1 --2- 172.21.15.44:0/4113078814 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ba77c0a070 0x55ba77bf1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4093928640 1 -- 172.21.15.44:0/4113078814 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ba77c0ab10 msgr2=0x55ba77c0eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4093928640 1 --2- 172.21.15.44:0/4113078814 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ba77c0ab10 0x55ba77c0eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4093928640 1 -- 172.21.15.44:0/4113078814 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ba77c0a070 msgr2=0x55ba77bf1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4093928640 1 --2- 172.21.15.44:0/4113078814 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ba77c0a070 0x55ba77bf1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.613+0000 7f4093928640 1 -- 172.21.15.44:0/4113078814 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba77b0d5a0 con 0x55ba77c9b8e0 2023-11-04T01:38:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.614+0000 7f4093928640 1 --2- 172.21.15.44:0/4113078814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba77c9b8e0 0x55ba77c0f060 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f40840081f0 tx=0x7f40840086b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.614+0000 7f4090922640 1 -- 172.21.15.44:0/4113078814 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408400b070 con 0x55ba77c9b8e0 2023-11-04T01:38:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.614+0000 7f4090922640 1 -- 172.21.15.44:0/4113078814 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4084012610 con 0x55ba77c9b8e0 2023-11-04T01:38:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.614+0000 7f4095e36f40 1 -- 172.21.15.44:0/4113078814 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ba77b1a780 con 0x55ba77c9b8e0 2023-11-04T01:38:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.614+0000 7f4090922640 1 -- 172.21.15.44:0/4113078814 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084012980 con 0x55ba77c9b8e0 2023-11-04T01:38:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.614+0000 7f4095e36f40 1 -- 172.21.15.44:0/4113078814 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba77b0d930 con 0x55ba77c9b8e0 2023-11-04T01:38:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.615+0000 7f4090922640 1 -- 172.21.15.44:0/4113078814 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4084012ae0 con 0x55ba77c9b8e0 2023-11-04T01:38:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.616+0000 7f4090922640 1 --2- 172.21.15.44:0/4113078814 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4074069850 0x7f407406bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.616+0000 7f4090922640 1 -- 172.21.15.44:0/4113078814 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7131+0+0 (secure 0 0 0) 0x7f4084088490 con 0x55ba77c9b8e0 2023-11-04T01:38:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.616+0000 7f4093127640 1 --2- 172.21.15.44:0/4113078814 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4074069850 0x7f407406bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.616+0000 7f4095e36f40 1 -- 172.21.15.44:0/4113078814 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- pool_op(delete snap pool 12 tid 1 name snap4 v0) v4 -- 0x55ba77b7e330 con 0x55ba77c9b8e0 2023-11-04T01:38:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:37.616+0000 7f4093127640 1 --2- 172.21.15.44:0/4113078814 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4074069850 0x7f407406bd10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f408c054000 tx=0x7f408c04e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.204+0000 7f4090922640 1 -- 172.21.15.44:0/4113078814 <== mon.0 v2:172.21.15.44:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v71) v1 ==== 43+0+0 (secure 0 0 0) 0x7f40840530d0 con 0x55ba77c9b8e0 2023-11-04T01:38:38.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.204+0000 7f4090922640 1 -- 172.21.15.44:0/4113078814 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f4074073ff0 con 0x55ba77c9b8e0 2023-11-04T01:38:38.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.204+0000 7f4090922640 1 -- 172.21.15.44:0/4113078814 <== mon.0 v2:172.21.15.44:3300/0 7 ==== osd_map(71..71 src has 1..71) v4 ==== 970+0+0 (secure 0 0 0) 0x7f4084008e20 con 0x55ba77c9b8e0 2023-11-04T01:38:38.207 INFO:teuthology.orchestra.run.smithi044.stdout:removed pool test_data_pool snap snap4 2023-11-04T01:38:38.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.204+0000 7f4095e36f40 1 -- 172.21.15.44:0/4113078814 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4074069850 msgr2=0x7f407406bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.204+0000 7f4095e36f40 1 --2- 172.21.15.44:0/4113078814 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4074069850 0x7f407406bd10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f408c054000 tx=0x7f408c04e000 comp rx=0 tx=0).stop 2023-11-04T01:38:38.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.204+0000 7f4095e36f40 1 -- 172.21.15.44:0/4113078814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba77c9b8e0 msgr2=0x55ba77c0f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.205+0000 7f4095e36f40 1 --2- 172.21.15.44:0/4113078814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba77c9b8e0 0x55ba77c0f060 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f40840081f0 tx=0x7f40840086b0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.205+0000 7f4095e36f40 1 -- 172.21.15.44:0/4113078814 shutdown_connections 2023-11-04T01:38:38.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.205+0000 7f4095e36f40 1 --2- 172.21.15.44:0/4113078814 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4074069850 0x7f407406bd10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.205+0000 7f4095e36f40 1 --2- 172.21.15.44:0/4113078814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba77c9b8e0 0x55ba77c0f060 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.205+0000 7f4095e36f40 1 --2- 172.21.15.44:0/4113078814 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ba77c0ab10 0x55ba77c0eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.205+0000 7f4095e36f40 1 --2- 172.21.15.44:0/4113078814 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ba77c0a070 0x55ba77bf1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.205+0000 7f4095e36f40 1 -- 172.21.15.44:0/4113078814 >> 172.21.15.44:0/4113078814 conn(0x55ba77c0c530 msgr2=0x55ba77bc6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:38.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.205+0000 7f4095e36f40 1 -- 172.21.15.44:0/4113078814 shutdown_connections 2023-11-04T01:38:38.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.205+0000 7f4095e36f40 1 -- 172.21.15.44:0/4113078814 wait complete. 2023-11-04T01:38:38.210 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_data_pool 2023-11-04T01:38:38.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.360+0000 7f91b5e7c640 1 Processor -- start 2023-11-04T01:38:38.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.360+0000 7f91b5e7c640 1 -- start start 2023-11-04T01:38:38.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.361+0000 7f91b5e7c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91b00ca0a0 0x7f91b00cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.361+0000 7f91b5e7c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b00caa20 con 0x7f91b00cc300 2023-11-04T01:38:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.361+0000 7f91b5e7c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b00cb230 con 0x7f91b015e3f0 2023-11-04T01:38:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.361+0000 7f91b5e7c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00b3300 con 0x7f91b00ca0a0 2023-11-04T01:38:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.361+0000 7f91affff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f91b00cc300 0x7f91b00b1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47070/0 (socket says 172.21.15.44:47070) 2023-11-04T01:38:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.361+0000 7f91affff640 1 -- 172.21.15.44:0/2324254919 learned_addr learned my addr 172.21.15.44:0/2324254919 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.361+0000 7f91aeffd640 1 --2- 172.21.15.44:0/2324254919 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91b00ca0a0 0x7f91b00cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.361+0000 7f91ae7fc640 1 -- 172.21.15.44:0/2324254919 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528376876 0 0) 0x7f91b00caa20 con 0x7f91b00cc300 2023-11-04T01:38:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.361+0000 7f91ae7fc640 1 -- 172.21.15.44:0/2324254919 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9198003520 con 0x7f91b00cc300 2023-11-04T01:38:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.362+0000 7f91ae7fc640 1 -- 172.21.15.44:0/2324254919 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516544111 0 0) 0x7f91b00cb230 con 0x7f91b015e3f0 2023-11-04T01:38:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.362+0000 7f91aeffd640 1 -- 172.21.15.44:0/2324254919 >> v1:172.21.15.204:6789/0 conn(0x7f91b015e3f0 legacy=0x7f91b00b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.362+0000 7f91aeffd640 1 -- 172.21.15.44:0/2324254919 >> v1:172.21.15.44:6789/0 conn(0x7f91b00cc300 legacy=0x7f91b00b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.362+0000 7f91aeffd640 1 -- 172.21.15.44:0/2324254919 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b00ca530 con 0x7f91b00ca0a0 2023-11-04T01:38:38.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.362+0000 7f91aeffd640 1 --2- 172.21.15.44:0/2324254919 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91b00ca0a0 0x7f91b00cc920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f91a40097d0 tx=0x7f91a402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2187c4082a8f6801 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.363+0000 7f91ae7fc640 1 -- 172.21.15.44:0/2324254919 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4031890 con 0x7f91b00ca0a0 2023-11-04T01:38:38.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.363+0000 7f91ae7fc640 1 -- 172.21.15.44:0/2324254919 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a40319f0 con 0x7f91b00ca0a0 2023-11-04T01:38:38.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.363+0000 7f91ae7fc640 1 -- 172.21.15.44:0/2324254919 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4031d60 con 0x7f91b00ca0a0 2023-11-04T01:38:38.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.363+0000 7f91b5e7c640 1 -- 172.21.15.44:0/2324254919 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91b00ca0a0 msgr2=0x7f91b00cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.363+0000 7f91b5e7c640 1 --2- 172.21.15.44:0/2324254919 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91b00ca0a0 0x7f91b00cc920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f91a40097d0 tx=0x7f91a402b930 comp rx=0 tx=0).stop 2023-11-04T01:38:38.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.363+0000 7f91b5e7c640 1 -- 172.21.15.44:0/2324254919 shutdown_connections 2023-11-04T01:38:38.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.363+0000 7f91b5e7c640 1 --2- 172.21.15.44:0/2324254919 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91b00ca0a0 0x7f91b00cc920 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.363+0000 7f91b5e7c640 1 -- 172.21.15.44:0/2324254919 >> 172.21.15.44:0/2324254919 conn(0x7f91b0071820 msgr2=0x7f91b0071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:38.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.363+0000 7f91b5e7c640 1 -- 172.21.15.44:0/2324254919 shutdown_connections 2023-11-04T01:38:38.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.363+0000 7f91b5e7c640 1 -- 172.21.15.44:0/2324254919 wait complete. 2023-11-04T01:38:38.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.364+0000 7f91b5e7c640 1 Processor -- start 2023-11-04T01:38:38.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.365+0000 7f91b5e7c640 1 -- start start 2023-11-04T01:38:38.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.365+0000 7f91b5e7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91b00cc300 0x7f91b00ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.365+0000 7f91b5e7c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91b015e3f0 0x7f91b01f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.365+0000 7f91b5e7c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91b00cd620 0x7f91b00accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.365+0000 7f91b5e7c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00afa10 con 0x7f91b00cc300 2023-11-04T01:38:38.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.365+0000 7f91b5e7c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b01f26c0 con 0x7f91b015e3f0 2023-11-04T01:38:38.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.365+0000 7f91b5e7c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00ad500 con 0x7f91b00cd620 2023-11-04T01:38:38.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.365+0000 7f91af7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91b00cc300 0x7f91b00ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.365+0000 7f91af7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91b00cc300 0x7f91b00ae100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51764/0 (socket says 172.21.15.44:51764) 2023-11-04T01:38:38.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.365+0000 7f91af7fe640 1 -- 172.21.15.44:0/1385446074 learned_addr learned my addr 172.21.15.44:0/1385446074 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:38.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.366+0000 7f91affff640 1 --2- 172.21.15.44:0/1385446074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91b00cd620 0x7f91b00accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.366+0000 7f91aeffd640 1 --2- 172.21.15.44:0/1385446074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91b015e3f0 0x7f91b01f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.366+0000 7f91af7fe640 1 -- 172.21.15.44:0/1385446074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91b00cd620 msgr2=0x7f91b00accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.366+0000 7f91af7fe640 1 --2- 172.21.15.44:0/1385446074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91b00cd620 0x7f91b00accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.366+0000 7f91af7fe640 1 -- 172.21.15.44:0/1385446074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91b015e3f0 msgr2=0x7f91b01f2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.366+0000 7f91af7fe640 1 --2- 172.21.15.44:0/1385446074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91b015e3f0 0x7f91b01f2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.366+0000 7f91af7fe640 1 -- 172.21.15.44:0/1385446074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a4009400 con 0x7f91b00cc300 2023-11-04T01:38:38.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.366+0000 7f91af7fe640 1 --2- 172.21.15.44:0/1385446074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91b00cc300 0x7f91b00ae100 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f91a000c410 tx=0x7f91a000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.366+0000 7f9197fff640 1 -- 172.21.15.44:0/1385446074 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a00035f0 con 0x7f91b00cc300 2023-11-04T01:38:38.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.366+0000 7f9197fff640 1 -- 172.21.15.44:0/1385446074 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a0003770 con 0x7f91b00cc300 2023-11-04T01:38:38.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.366+0000 7f91b5e7c640 1 -- 172.21.15.44:0/1385446074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b00ad7e0 con 0x7f91b00cc300 2023-11-04T01:38:38.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.366+0000 7f9197fff640 1 -- 172.21.15.44:0/1385446074 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0003b20 con 0x7f91b00cc300 2023-11-04T01:38:38.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.366+0000 7f91b5e7c640 1 -- 172.21.15.44:0/1385446074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b00aff00 con 0x7f91b00cc300 2023-11-04T01:38:38.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.367+0000 7f91b5e7c640 1 -- 172.21.15.44:0/1385446074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b00ad970 con 0x7f91b00cc300 2023-11-04T01:38:38.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.368+0000 7f9197fff640 1 -- 172.21.15.44:0/1385446074 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f91a0003c80 con 0x7f91b00cc300 2023-11-04T01:38:38.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.368+0000 7f9197fff640 1 --2- 172.21.15.44:0/1385446074 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f919c06ae70 0x7f919c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.368+0000 7f9197fff640 1 -- 172.21.15.44:0/1385446074 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f91a0089100 con 0x7f91b00cc300 2023-11-04T01:38:38.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.368+0000 7f91aeffd640 1 --2- 172.21.15.44:0/1385446074 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f919c06ae70 0x7f919c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.369+0000 7f91aeffd640 1 --2- 172.21.15.44:0/1385446074 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f919c06ae70 0x7f919c06d330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f91a4036000 tx=0x7f91a403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.372+0000 7f9197fff640 1 -- 172.21.15.44:0/1385446074 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f91a0053cd0 con 0x7f91b00cc300 2023-11-04T01:38:38.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.549+0000 7f91b5e7c640 1 -- 172.21.15.44:0/1385446074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_data_pool"} v 0) v1 -- 0x7f91b0066160 con 0x7f91b00cc300 2023-11-04T01:38:38.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.549+0000 7f9197fff640 1 -- 172.21.15.44:0/1385446074 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_data_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v71) v1 ==== 296+0+0 (secure 0 0 0) 0x7f91a00572f0 con 0x7f91b00cc300 2023-11-04T01:38:38.552 INFO:teuthology.orchestra.run.smithi044.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:38:38.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:38.557 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_metadata_pool 2023-11-04T01:38:38.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.664+0000 7f2af99f5640 1 Processor -- start 2023-11-04T01:38:38.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.664+0000 7f2af99f5640 1 -- start start 2023-11-04T01:38:38.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.665+0000 7f2af99f5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2af4160430 0x7f2af40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.665+0000 7f2af99f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2af406c3a0 0x7f2af40cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.665+0000 7f2af99f5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af40b2fc0 con 0x7f2af40b2b60 2023-11-04T01:38:38.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.665+0000 7f2af99f5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af40cb580 con 0x7f2af4160430 2023-11-04T01:38:38.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.665+0000 7f2af99f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af406c7f0 con 0x7f2af406c3a0 2023-11-04T01:38:38.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.665+0000 7f2af37fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2af406c3a0 0x7f2af40cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.665+0000 7f2af2ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2af4160430 0x7f2af40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.665+0000 7f2af37fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2af406c3a0 0x7f2af40cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:36042/0 (socket says 172.21.15.44:36042) 2023-11-04T01:38:38.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.665+0000 7f2af37fe640 1 -- 172.21.15.44:0/3485483553 learned_addr learned my addr 172.21.15.44:0/3485483553 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:38.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.665+0000 7f2af27fc640 1 --1- 172.21.15.44:0/3485483553 >> v1:172.21.15.204:6789/0 conn(0x7f2af40b2b60 0x7f2af406bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:44326/0 (socket says 172.21.15.44:44326) 2023-11-04T01:38:38.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.665+0000 7f2af37fe640 1 -- 172.21.15.44:0/3485483553 >> v2:172.21.15.204:3300/0 conn(0x7f2af4160430 msgr2=0x7f2af40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:38.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.665+0000 7f2af37fe640 1 --2- 172.21.15.44:0/3485483553 >> v2:172.21.15.204:3300/0 conn(0x7f2af4160430 0x7f2af40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.665+0000 7f2af37fe640 1 -- 172.21.15.44:0/3485483553 >> v1:172.21.15.204:6789/0 conn(0x7f2af40b2b60 legacy=0x7f2af406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.665+0000 7f2af37fe640 1 -- 172.21.15.44:0/3485483553 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af406ca40 con 0x7f2af406c3a0 2023-11-04T01:38:38.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.665+0000 7f2af2ffd640 1 --2- 172.21.15.44:0/3485483553 >> v2:172.21.15.204:3300/0 conn(0x7f2af4160430 0x7f2af40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.666+0000 7f2af37fe640 1 --2- 172.21.15.44:0/3485483553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2af406c3a0 0x7f2af40cbcb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009e50 tx=0x7f2aec02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de7e849c8e722119 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.666+0000 7f2af1ffb640 1 -- 172.21.15.44:0/3485483553 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec02cb00 con 0x7f2af406c3a0 2023-11-04T01:38:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.666+0000 7f2af1ffb640 1 -- 172.21.15.44:0/3485483553 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec02cc60 con 0x7f2af406c3a0 2023-11-04T01:38:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.667+0000 7f2af1ffb640 1 -- 172.21.15.44:0/3485483553 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec0343f0 con 0x7f2af406c3a0 2023-11-04T01:38:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.667+0000 7f2af99f5640 1 -- 172.21.15.44:0/3485483553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2af406c3a0 msgr2=0x7f2af40cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.667+0000 7f2af99f5640 1 --2- 172.21.15.44:0/3485483553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2af406c3a0 0x7f2af40cbcb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009e50 tx=0x7f2aec02bf60 comp rx=0 tx=0).stop 2023-11-04T01:38:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.667+0000 7f2af99f5640 1 -- 172.21.15.44:0/3485483553 shutdown_connections 2023-11-04T01:38:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.667+0000 7f2af99f5640 1 --2- 172.21.15.44:0/3485483553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2af406c3a0 0x7f2af40cbcb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.667+0000 7f2af99f5640 1 --2- 172.21.15.44:0/3485483553 >> v2:172.21.15.204:3300/0 conn(0x7f2af4160430 0x7f2af40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.667+0000 7f2af99f5640 1 -- 172.21.15.44:0/3485483553 >> 172.21.15.44:0/3485483553 conn(0x7f2af406ea20 msgr2=0x7f2af406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.667+0000 7f2af99f5640 1 -- 172.21.15.44:0/3485483553 shutdown_connections 2023-11-04T01:38:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.667+0000 7f2af99f5640 1 -- 172.21.15.44:0/3485483553 wait complete. 2023-11-04T01:38:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.668+0000 7f2af99f5640 1 Processor -- start 2023-11-04T01:38:38.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.668+0000 7f2af99f5640 1 -- start start 2023-11-04T01:38:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.669+0000 7f2af99f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2af406c3a0 0x7f2af40ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.669+0000 7f2af99f5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2af40b2b60 0x7f2af4148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.669+0000 7f2af99f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2af4160430 0x7f2af415e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.669+0000 7f2af99f5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af40ca330 con 0x7f2af406c3a0 2023-11-04T01:38:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.669+0000 7f2af99f5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af41494e0 con 0x7f2af40b2b60 2023-11-04T01:38:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.669+0000 7f2af99f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af40c96b0 con 0x7f2af4160430 2023-11-04T01:38:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.669+0000 7f2af2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2af406c3a0 0x7f2af40ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.669+0000 7f2af2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2af406c3a0 0x7f2af40ca750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51776/0 (socket says 172.21.15.44:51776) 2023-11-04T01:38:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.669+0000 7f2af2ffd640 1 -- 172.21.15.44:0/2153475796 learned_addr learned my addr 172.21.15.44:0/2153475796 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.669+0000 7f2af27fc640 1 --2- 172.21.15.44:0/2153475796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2af40b2b60 0x7f2af4148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.669+0000 7f2af37fe640 1 --2- 172.21.15.44:0/2153475796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2af4160430 0x7f2af415e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.670+0000 7f2af2ffd640 1 -- 172.21.15.44:0/2153475796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2af4160430 msgr2=0x7f2af415e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.670+0000 7f2af2ffd640 1 --2- 172.21.15.44:0/2153475796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2af4160430 0x7f2af415e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.670+0000 7f2af2ffd640 1 -- 172.21.15.44:0/2153475796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2af40b2b60 msgr2=0x7f2af4148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.670+0000 7f2af2ffd640 1 --2- 172.21.15.44:0/2153475796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2af40b2b60 0x7f2af4148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.670+0000 7f2af2ffd640 1 -- 172.21.15.44:0/2153475796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae4009400 con 0x7f2af406c3a0 2023-11-04T01:38:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.670+0000 7f2af27fc640 1 --2- 172.21.15.44:0/2153475796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2af40b2b60 0x7f2af4148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.670+0000 7f2af2ffd640 1 --2- 172.21.15.44:0/2153475796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2af406c3a0 0x7f2af40ca750 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400ebe0 tx=0x7f2ae400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.670+0000 7f2adbfff640 1 -- 172.21.15.44:0/2153475796 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4009760 con 0x7f2af406c3a0 2023-11-04T01:38:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.670+0000 7f2adbfff640 1 -- 172.21.15.44:0/2153475796 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae400cc30 con 0x7f2af406c3a0 2023-11-04T01:38:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.670+0000 7f2af99f5640 1 -- 172.21.15.44:0/2153475796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec009b30 con 0x7f2af406c3a0 2023-11-04T01:38:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.670+0000 7f2adbfff640 1 -- 172.21.15.44:0/2153475796 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400eee0 con 0x7f2af406c3a0 2023-11-04T01:38:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.670+0000 7f2af99f5640 1 -- 172.21.15.44:0/2153475796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af40c9c70 con 0x7f2af406c3a0 2023-11-04T01:38:38.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.671+0000 7f2af99f5640 1 -- 172.21.15.44:0/2153475796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af4074290 con 0x7f2af406c3a0 2023-11-04T01:38:38.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.671+0000 7f2adbfff640 1 -- 172.21.15.44:0/2153475796 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ae4013470 con 0x7f2af406c3a0 2023-11-04T01:38:38.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.672+0000 7f2adbfff640 1 --2- 172.21.15.44:0/2153475796 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2ae006ae70 0x7f2ae006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.672+0000 7f2adbfff640 1 -- 172.21.15.44:0/2153475796 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f2ae4089db0 con 0x7f2af406c3a0 2023-11-04T01:38:38.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.672+0000 7f2af27fc640 1 --2- 172.21.15.44:0/2153475796 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2ae006ae70 0x7f2ae006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.673+0000 7f2af27fc640 1 --2- 172.21.15.44:0/2153475796 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2ae006ae70 0x7f2ae006d330 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8007fd0 tx=0x7f2ae8007d40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.676+0000 7f2adbfff640 1 -- 172.21.15.44:0/2153475796 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ae4054970 con 0x7f2af406c3a0 2023-11-04T01:38:38.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.855+0000 7f2af99f5640 1 -- 172.21.15.44:0/2153475796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_metadata_pool"} v 0) v1 -- 0x7f2af40b2740 con 0x7f2af406c3a0 2023-11-04T01:38:38.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:38.855+0000 7f2adbfff640 1 -- 172.21.15.44:0/2153475796 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_metadata_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v71) v1 ==== 304+0+0 (secure 0 0 0) 0x7f2ae40170a0 con 0x7f2af406c3a0 2023-11-04T01:38:38.857 INFO:teuthology.orchestra.run.smithi044.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:38:38.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:38.863 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:38:38.863 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:38.914 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:38.968 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:38:38.969 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:38:38.969 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:38.984 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:39.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.128+0000 7f65f4407640 1 Processor -- start 2023-11-04T01:38:39.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.128+0000 7f65f4407640 1 -- start start 2023-11-04T01:38:39.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.129+0000 7f65f4407640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65ec0aec80 0x7f65ec0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.129+0000 7f65f4407640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec0af060 0x7f65ec06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.129+0000 7f65f4407640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ec0b1590 con 0x7f65ec06ef40 2023-11-04T01:38:39.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.129+0000 7f65f4407640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ec155a40 con 0x7f65ec0aec80 2023-11-04T01:38:39.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.129+0000 7f65f4407640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec06a660 con 0x7f65ec0af060 2023-11-04T01:38:39.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.129+0000 7f65f21a3640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65ec0aec80 0x7f65ec0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.129+0000 7f65f29a4640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f65ec06ef40 0x7f65ec0cb7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47078/0 (socket says 172.21.15.44:47078) 2023-11-04T01:38:39.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.129+0000 7f65f29a4640 1 -- 172.21.15.44:0/3275076513 learned_addr learned my addr 172.21.15.44:0/3275076513 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:39.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.129+0000 7f65f21a3640 1 -- 172.21.15.44:0/3275076513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec0af060 msgr2=0x7f65ec06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:39.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.129+0000 7f65f19a2640 1 --2- 172.21.15.44:0/3275076513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec0af060 0x7f65ec06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.130+0000 7f65f21a3640 1 --2- 172.21.15.44:0/3275076513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec0af060 0x7f65ec06a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.130+0000 7f65f21a3640 1 -- 172.21.15.44:0/3275076513 >> v1:172.21.15.44:6789/0 conn(0x7f65ec06ef40 legacy=0x7f65ec0cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.130+0000 7f65f11a1640 1 -- 172.21.15.44:0/3275076513 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8729926 0 0) 0x7f65ec0b1590 con 0x7f65ec06ef40 2023-11-04T01:38:39.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.130+0000 7f65f21a3640 1 -- 172.21.15.44:0/3275076513 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec06a8e0 con 0x7f65ec0aec80 2023-11-04T01:38:39.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.130+0000 7f65f19a2640 1 --2- 172.21.15.44:0/3275076513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec0af060 0x7f65ec06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:39.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.130+0000 7f65f21a3640 1 --2- 172.21.15.44:0/3275076513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0aec80 0x7f65ec0b1fe0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009790 tx=0x7f65e402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61055117c44dd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.130+0000 7f65f11a1640 1 -- 172.21.15.44:0/3275076513 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4031800 con 0x7f65ec0aec80 2023-11-04T01:38:39.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.130+0000 7f65f11a1640 1 -- 172.21.15.44:0/3275076513 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e4031960 con 0x7f65ec0aec80 2023-11-04T01:38:39.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.130+0000 7f65f11a1640 1 -- 172.21.15.44:0/3275076513 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4031cf0 con 0x7f65ec0aec80 2023-11-04T01:38:39.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.131+0000 7f65f4407640 1 -- 172.21.15.44:0/3275076513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0aec80 msgr2=0x7f65ec0b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.131+0000 7f65f4407640 1 --2- 172.21.15.44:0/3275076513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0aec80 0x7f65ec0b1fe0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009790 tx=0x7f65e402b8a0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.131+0000 7f65f4407640 1 -- 172.21.15.44:0/3275076513 shutdown_connections 2023-11-04T01:38:39.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.131+0000 7f65f4407640 1 --2- 172.21.15.44:0/3275076513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec0af060 0x7f65ec06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.131+0000 7f65f4407640 1 --2- 172.21.15.44:0/3275076513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0aec80 0x7f65ec0b1fe0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.131+0000 7f65f4407640 1 -- 172.21.15.44:0/3275076513 >> 172.21.15.44:0/3275076513 conn(0x7f65ec098d40 msgr2=0x7f65ec0cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:39.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.131+0000 7f65f4407640 1 -- 172.21.15.44:0/3275076513 shutdown_connections 2023-11-04T01:38:39.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.131+0000 7f65f4407640 1 -- 172.21.15.44:0/3275076513 wait complete. 2023-11-04T01:38:39.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.132+0000 7f65f4407640 1 Processor -- start 2023-11-04T01:38:39.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.132+0000 7f65f4407640 1 -- start start 2023-11-04T01:38:39.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.133+0000 7f65f4407640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec06ef40 0x7f65ec1f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.133+0000 7f65f4407640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65ec0aec80 0x7f65ec0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.133+0000 7f65f4407640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0af060 0x7f65ec15c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.133+0000 7f65f4407640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec0ceb10 con 0x7f65ec0af060 2023-11-04T01:38:39.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.133+0000 7f65f4407640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec15d050 con 0x7f65ec0aec80 2023-11-04T01:38:39.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.133+0000 7f65f4407640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec1f26c0 con 0x7f65ec06ef40 2023-11-04T01:38:39.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.133+0000 7f65f29a4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0af060 0x7f65ec15c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.133+0000 7f65f29a4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0af060 0x7f65ec15c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51798/0 (socket says 172.21.15.44:51798) 2023-11-04T01:38:39.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.133+0000 7f65f29a4640 1 -- 172.21.15.44:0/3320414742 learned_addr learned my addr 172.21.15.44:0/3320414742 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:39.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.133+0000 7f65f21a3640 1 --2- 172.21.15.44:0/3320414742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec06ef40 0x7f65ec1f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.134+0000 7f65f19a2640 1 --2- 172.21.15.44:0/3320414742 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65ec0aec80 0x7f65ec0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.134+0000 7f65f29a4640 1 -- 172.21.15.44:0/3320414742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec06ef40 msgr2=0x7f65ec1f2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.134+0000 7f65f29a4640 1 --2- 172.21.15.44:0/3320414742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec06ef40 0x7f65ec1f2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.134+0000 7f65f29a4640 1 -- 172.21.15.44:0/3320414742 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65ec0aec80 msgr2=0x7f65ec0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.134+0000 7f65f29a4640 1 --2- 172.21.15.44:0/3320414742 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65ec0aec80 0x7f65ec0cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.134+0000 7f65f29a4640 1 -- 172.21.15.44:0/3320414742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40093a0 con 0x7f65ec0af060 2023-11-04T01:38:39.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.134+0000 7f65f19a2640 1 --2- 172.21.15.44:0/3320414742 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65ec0aec80 0x7f65ec0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:39.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.134+0000 7f65f29a4640 1 --2- 172.21.15.44:0/3320414742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0af060 0x7f65ec15c5f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00c700 tx=0x7f65dc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.134+0000 7f65eaffd640 1 -- 172.21.15.44:0/3320414742 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc00ce10 con 0x7f65ec0af060 2023-11-04T01:38:39.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.134+0000 7f65eaffd640 1 -- 172.21.15.44:0/3320414742 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc00a640 con 0x7f65ec0af060 2023-11-04T01:38:39.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.134+0000 7f65f4407640 1 -- 172.21.15.44:0/3320414742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ec0cdf00 con 0x7f65ec0af060 2023-11-04T01:38:39.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.134+0000 7f65eaffd640 1 -- 172.21.15.44:0/3320414742 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc00aa70 con 0x7f65ec0af060 2023-11-04T01:38:39.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.134+0000 7f65f4407640 1 -- 172.21.15.44:0/3320414742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ec0ce4c0 con 0x7f65ec0af060 2023-11-04T01:38:39.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.135+0000 7f65f4407640 1 -- 172.21.15.44:0/3320414742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ec0cec80 con 0x7f65ec0af060 2023-11-04T01:38:39.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.135+0000 7f65eaffd640 1 -- 172.21.15.44:0/3320414742 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f65dc00abd0 con 0x7f65ec0af060 2023-11-04T01:38:39.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.136+0000 7f65eaffd640 1 --2- 172.21.15.44:0/3320414742 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65d806ae70 0x7f65d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.136+0000 7f65eaffd640 1 -- 172.21.15.44:0/3320414742 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f65dc0893a0 con 0x7f65ec0af060 2023-11-04T01:38:39.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.136+0000 7f65f21a3640 1 --2- 172.21.15.44:0/3320414742 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65d806ae70 0x7f65d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.137+0000 7f65f21a3640 1 --2- 172.21.15.44:0/3320414742 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65d806ae70 0x7f65d806d330 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f65e4036000 tx=0x7f65e4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.140+0000 7f65eaffd640 1 -- 172.21.15.44:0/3320414742 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f65dc053e10 con 0x7f65ec0af060 2023-11-04T01:38:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.319+0000 7f65f4407640 1 -- 172.21.15.44:0/3320414742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65ec074290 con 0x7f65ec0af060 2023-11-04T01:38:39.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.320+0000 7f65eaffd640 1 -- 172.21.15.44:0/3320414742 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+22101 (secure 0 0 0) 0x7f65dc057430 con 0x7f65ec0af060 2023-11-04T01:38:39.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:39.323 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":71,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:38:38.200225+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:20.738739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:21.109334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:39.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.322+0000 7f65f4407640 1 -- 172.21.15.44:0/3320414742 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65d806ae70 msgr2=0x7f65d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.322+0000 7f65f4407640 1 --2- 172.21.15.44:0/3320414742 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65d806ae70 0x7f65d806d330 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f65e4036000 tx=0x7f65e4008030 comp rx=0 tx=0).stop 2023-11-04T01:38:39.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.322+0000 7f65f4407640 1 -- 172.21.15.44:0/3320414742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0af060 msgr2=0x7f65ec15c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.322+0000 7f65f4407640 1 --2- 172.21.15.44:0/3320414742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0af060 0x7f65ec15c5f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00c700 tx=0x7f65dc00cbc0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.323+0000 7f65f4407640 1 -- 172.21.15.44:0/3320414742 shutdown_connections 2023-11-04T01:38:39.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.323+0000 7f65f4407640 1 --2- 172.21.15.44:0/3320414742 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f65d806ae70 0x7f65d806d330 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.323+0000 7f65f4407640 1 --2- 172.21.15.44:0/3320414742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0af060 0x7f65ec15c5f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.323+0000 7f65f4407640 1 --2- 172.21.15.44:0/3320414742 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65ec0aec80 0x7f65ec0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.323+0000 7f65f4407640 1 --2- 172.21.15.44:0/3320414742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65ec06ef40 0x7f65ec1f2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.323+0000 7f65f4407640 1 -- 172.21.15.44:0/3320414742 >> 172.21.15.44:0/3320414742 conn(0x7f65ec098d40 msgr2=0x7f65ec154b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:39.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.323+0000 7f65f4407640 1 -- 172.21.15.44:0/3320414742 shutdown_connections 2023-11-04T01:38:39.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.323+0000 7f65f4407640 1 -- 172.21.15.44:0/3320414742 wait complete. 2023-11-04T01:38:39.335 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:38:20.738739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:38:21.109334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:34.917670+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:35.547044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:39.336 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:39.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.442+0000 7fb1b70d4640 1 Processor -- start 2023-11-04T01:38:39.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.443+0000 7fb1b70d4640 1 -- start start 2023-11-04T01:38:39.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.443+0000 7fb1b70d4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb1b00cd6d0 0x7fb1b0161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.443+0000 7fb1b70d4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b00cde60 con 0x7fb1b00b4880 2023-11-04T01:38:39.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.443+0000 7fb1b70d4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b0160f90 con 0x7fb1b0153e60 2023-11-04T01:38:39.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.443+0000 7fb1b70d4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b0161960 con 0x7fb1b00cd6d0 2023-11-04T01:38:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.443+0000 7fb1b5671640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb1b00b4880 0x7fb1b00d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47082/0 (socket says 172.21.15.44:47082) 2023-11-04T01:38:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.443+0000 7fb1b5671640 1 -- 172.21.15.44:0/814041677 learned_addr learned my addr 172.21.15.44:0/814041677 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1affff640 1 --2- 172.21.15.44:0/814041677 >> v2:172.21.15.204:3300/0 conn(0x7fb1b00cd6d0 0x7fb1b0161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1af7fe640 1 -- 172.21.15.44:0/814041677 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555297853 0 0) 0x7fb1b00cde60 con 0x7fb1b00b4880 2023-11-04T01:38:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1af7fe640 1 -- 172.21.15.44:0/814041677 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb198003520 con 0x7fb1b00b4880 2023-11-04T01:38:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1af7fe640 1 -- 172.21.15.44:0/814041677 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4194219932 0 0) 0x7fb198003520 con 0x7fb1b00b4880 2023-11-04T01:38:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1af7fe640 1 -- 172.21.15.44:0/814041677 >> v2:172.21.15.204:3300/0 conn(0x7fb1b00cd6d0 msgr2=0x7fb1b0161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1af7fe640 1 --2- 172.21.15.44:0/814041677 >> v2:172.21.15.204:3300/0 conn(0x7fb1b00cd6d0 0x7fb1b0161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1af7fe640 1 -- 172.21.15.44:0/814041677 >> v1:172.21.15.204:6789/0 conn(0x7fb1b0153e60 legacy=0x7fb1b015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1af7fe640 1 -- 172.21.15.44:0/814041677 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b00ce090 con 0x7fb1b00b4880 2023-11-04T01:38:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1af7fe640 1 -- 172.21.15.44:0/814041677 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fb1a0001670 con 0x7fb1b00b4880 2023-11-04T01:38:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1af7fe640 1 -- 172.21.15.44:0/814041677 >> v1:172.21.15.44:6789/0 conn(0x7fb1b00b4880 legacy=0x7fb1b00d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1af7fe640 1 --2- 172.21.15.44:0/814041677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb198003970 0x7fb198003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1af7fe640 1 --2- 172.21.15.44:0/814041677 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1980047c0 0x7fb198004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1af7fe640 1 --2- 172.21.15.44:0/814041677 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb198005180 0x7fb19800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1af7fe640 1 -- 172.21.15.44:0/814041677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b0161960 con 0x7fb198003970 2023-11-04T01:38:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1af7fe640 1 -- 172.21.15.44:0/814041677 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19800c020 con 0x7fb198005180 2023-11-04T01:38:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1af7fe640 1 -- 172.21.15.44:0/814041677 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19800c1e0 con 0x7fb1980047c0 2023-11-04T01:38:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1b4e70640 1 --2- 172.21.15.44:0/814041677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb198003970 0x7fb198003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1affff640 1 --2- 172.21.15.44:0/814041677 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1980047c0 0x7fb198004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1b5671640 1 --2- 172.21.15.44:0/814041677 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb198005180 0x7fb19800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1b4e70640 1 -- 172.21.15.44:0/814041677 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1980047c0 msgr2=0x7fb198004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1b4e70640 1 --2- 172.21.15.44:0/814041677 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1980047c0 0x7fb198004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1b4e70640 1 -- 172.21.15.44:0/814041677 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb198005180 msgr2=0x7fb19800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:39.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1b4e70640 1 --2- 172.21.15.44:0/814041677 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb198005180 0x7fb19800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1b4e70640 1 -- 172.21.15.44:0/814041677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198003520 con 0x7fb198003970 2023-11-04T01:38:39.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.444+0000 7fb1b5671640 1 -- 172.21.15.44:0/814041677 reap_dead start 2023-11-04T01:38:39.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.445+0000 7fb1b4e70640 1 --2- 172.21.15.44:0/814041677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb198003970 0x7fb198003d90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8001e50 tx=0x7fb1980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4916025d650a82 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.445+0000 7fb1af7fe640 1 -- 172.21.15.44:0/814041677 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8003b70 con 0x7fb198003970 2023-11-04T01:38:39.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.445+0000 7fb1af7fe640 1 -- 172.21.15.44:0/814041677 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a8003cd0 con 0x7fb198003970 2023-11-04T01:38:39.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.445+0000 7fb1af7fe640 1 -- 172.21.15.44:0/814041677 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8005310 con 0x7fb198003970 2023-11-04T01:38:39.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.446+0000 7fb1b70d4640 1 -- 172.21.15.44:0/814041677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb198003970 msgr2=0x7fb198003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.446+0000 7fb1b70d4640 1 --2- 172.21.15.44:0/814041677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb198003970 0x7fb198003d90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8001e50 tx=0x7fb1980057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.446+0000 7fb1b70d4640 1 -- 172.21.15.44:0/814041677 shutdown_connections 2023-11-04T01:38:39.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.446+0000 7fb1b70d4640 1 --2- 172.21.15.44:0/814041677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb198003970 0x7fb198003d90 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.446+0000 7fb1b70d4640 1 -- 172.21.15.44:0/814041677 >> 172.21.15.44:0/814041677 conn(0x7fb1b00cf880 msgr2=0x7fb1b00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.446+0000 7fb1b70d4640 1 -- 172.21.15.44:0/814041677 shutdown_connections 2023-11-04T01:38:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.446+0000 7fb1b70d4640 1 -- 172.21.15.44:0/814041677 wait complete. 2023-11-04T01:38:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.447+0000 7fb1b70d4640 1 Processor -- start 2023-11-04T01:38:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.447+0000 7fb1b70d4640 1 -- start start 2023-11-04T01:38:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1b70d4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb198003970 0x7fb1b00c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1b70d4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1b00c9ed0 0x7fb1b015ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1b70d4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1b014c930 0x7fb1b014cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1b70d4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00cb110 con 0x7fb1b00c9ed0 2023-11-04T01:38:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1b70d4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00ca490 con 0x7fb1b014c930 2023-11-04T01:38:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1b70d4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00ca770 con 0x7fb198003970 2023-11-04T01:38:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1affff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1b00c9ed0 0x7fb1b015ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1affff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1b00c9ed0 0x7fb1b015ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51814/0 (socket says 172.21.15.44:51814) 2023-11-04T01:38:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1affff640 1 -- 172.21.15.44:0/158305953 learned_addr learned my addr 172.21.15.44:0/158305953 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1b4e70640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb198003970 0x7fb1b00c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1b5671640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1b014c930 0x7fb1b014cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1affff640 1 -- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb198003970 msgr2=0x7fb1b00c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1affff640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb198003970 0x7fb1b00c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1affff640 1 -- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1b014c930 msgr2=0x7fb1b014cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1affff640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1b014c930 0x7fb1b014cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1affff640 1 -- 172.21.15.44:0/158305953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b00caa50 con 0x7fb1b00c9ed0 2023-11-04T01:38:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1b4e70640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb198003970 0x7fb1b00c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.448+0000 7fb1b5671640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1b014c930 0x7fb1b014cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.449+0000 7fb1affff640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1b00c9ed0 0x7fb1b015ed30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40114e0 tx=0x7fb1a40119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.449+0000 7fb1ad7fa640 1 -- 172.21.15.44:0/158305953 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4015870 con 0x7fb1b00c9ed0 2023-11-04T01:38:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.449+0000 7fb1ad7fa640 1 -- 172.21.15.44:0/158305953 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a40159d0 con 0x7fb1b00c9ed0 2023-11-04T01:38:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.449+0000 7fb1b70d4640 1 -- 172.21.15.44:0/158305953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b00cad30 con 0x7fb1b00c9ed0 2023-11-04T01:38:39.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.449+0000 7fb1ad7fa640 1 -- 172.21.15.44:0/158305953 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4015d40 con 0x7fb1b00c9ed0 2023-11-04T01:38:39.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.449+0000 7fb1b70d4640 1 -- 172.21.15.44:0/158305953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b00c96a0 con 0x7fb1b00c9ed0 2023-11-04T01:38:39.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.450+0000 7fb1b70d4640 1 -- 172.21.15.44:0/158305953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b00cb250 con 0x7fb1b00c9ed0 2023-11-04T01:38:39.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.450+0000 7fb1ad7fa640 1 -- 172.21.15.44:0/158305953 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1a4013400 con 0x7fb1b00c9ed0 2023-11-04T01:38:39.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.451+0000 7fb1ad7fa640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb19c06ae70 0x7fb19c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.451+0000 7fb1ad7fa640 1 -- 172.21.15.44:0/158305953 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fb1a4089ff0 con 0x7fb1b00c9ed0 2023-11-04T01:38:39.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.451+0000 7fb1b4e70640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb19c06ae70 0x7fb19c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.452+0000 7fb1b4e70640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb19c06ae70 0x7fb19c06d330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8034000 tx=0x7fb1a8009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.455+0000 7fb1ad7fa640 1 -- 172.21.15.44:0/158305953 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1b00cb250 con 0x7fb1b00c9ed0 2023-11-04T01:38:39.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.629+0000 7fb1b70d4640 1 -- 172.21.15.44:0/158305953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb1b00cb250 con 0x7fb1b00c9ed0 2023-11-04T01:38:39.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.629+0000 7fb1ad7fa640 1 -- 172.21.15.44:0/158305953 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb1b00cb250 con 0x7fb1b00c9ed0 2023-11-04T01:38:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:38:39.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.631+0000 7fb1b70d4640 1 -- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb19c06ae70 msgr2=0x7fb19c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.631+0000 7fb1b70d4640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb19c06ae70 0x7fb19c06d330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8034000 tx=0x7fb1a8009030 comp rx=0 tx=0).stop 2023-11-04T01:38:39.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.631+0000 7fb1b70d4640 1 -- 172.21.15.44:0/158305953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1b00c9ed0 msgr2=0x7fb1b015ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.631+0000 7fb1b70d4640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1b00c9ed0 0x7fb1b015ed30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40114e0 tx=0x7fb1a40119a0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.631+0000 7fb1b70d4640 1 -- 172.21.15.44:0/158305953 shutdown_connections 2023-11-04T01:38:39.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.631+0000 7fb1b70d4640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb19c06ae70 0x7fb19c06d330 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.631+0000 7fb1b70d4640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1b014c930 0x7fb1b014cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.631+0000 7fb1b70d4640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1b00c9ed0 0x7fb1b015ed30 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.631+0000 7fb1b70d4640 1 --2- 172.21.15.44:0/158305953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb198003970 0x7fb1b00c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.631+0000 7fb1b70d4640 1 -- 172.21.15.44:0/158305953 >> 172.21.15.44:0/158305953 conn(0x7fb1b00cf880 msgr2=0x7fb1b015dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:39.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.631+0000 7fb1b70d4640 1 -- 172.21.15.44:0/158305953 shutdown_connections 2023-11-04T01:38:39.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.631+0000 7fb1b70d4640 1 -- 172.21.15.44:0/158305953 wait complete. 2023-11-04T01:38:39.644 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:39.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.751+0000 7f540f0c9640 1 Processor -- start 2023-11-04T01:38:39.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.751+0000 7f540f0c9640 1 -- start start 2023-11-04T01:38:39.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.752+0000 7f540f0c9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f540815e430 0x7f54080cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.752+0000 7f540f0c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54080cf160 0x7f54080cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.752+0000 7f540f0c9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54080d0280 con 0x7f54080d0710 2023-11-04T01:38:39.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.752+0000 7f540f0c9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54080cf670 con 0x7f540815e430 2023-11-04T01:38:39.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.752+0000 7f540f0c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54080cf950 con 0x7f54080cf160 2023-11-04T01:38:39.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.752+0000 7f5407fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54080cf160 0x7f54080cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.752+0000 7f5407fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54080cf160 0x7f54080cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:36074/0 (socket says 172.21.15.44:36074) 2023-11-04T01:38:39.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.752+0000 7f540ce65640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f540815e430 0x7f54080cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.752+0000 7f5407fff640 1 -- 172.21.15.44:0/751517696 learned_addr learned my addr 172.21.15.44:0/751517696 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:39.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.753+0000 7f5407fff640 1 -- 172.21.15.44:0/751517696 >> v2:172.21.15.204:3300/0 conn(0x7f540815e430 msgr2=0x7f54080cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:39.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.753+0000 7f5407fff640 1 --2- 172.21.15.44:0/751517696 >> v2:172.21.15.204:3300/0 conn(0x7f540815e430 0x7f54080cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.753+0000 7f5407fff640 1 -- 172.21.15.44:0/751517696 >> v1:172.21.15.204:6789/0 conn(0x7f54080d0710 legacy=0x7f54080b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.753+0000 7f5407fff640 1 -- 172.21.15.44:0/751517696 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54080cfc30 con 0x7f54080cf160 2023-11-04T01:38:39.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.754+0000 7f5407fff640 1 --2- 172.21.15.44:0/751517696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54080cf160 0x7f54080cd510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009870 tx=0x7f53f802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d017661a20063774 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.754+0000 7f54077fe640 1 -- 172.21.15.44:0/751517696 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f8030840 con 0x7f54080cf160 2023-11-04T01:38:39.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.754+0000 7f54077fe640 1 -- 172.21.15.44:0/751517696 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f80309a0 con 0x7f54080cf160 2023-11-04T01:38:39.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.754+0000 7f54077fe640 1 -- 172.21.15.44:0/751517696 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f8030d30 con 0x7f54080cf160 2023-11-04T01:38:39.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.754+0000 7f540f0c9640 1 -- 172.21.15.44:0/751517696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54080cf160 msgr2=0x7f54080cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.754+0000 7f540f0c9640 1 --2- 172.21.15.44:0/751517696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54080cf160 0x7f54080cd510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009870 tx=0x7f53f802b980 comp rx=0 tx=0).stop 2023-11-04T01:38:39.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.754+0000 7f540f0c9640 1 -- 172.21.15.44:0/751517696 shutdown_connections 2023-11-04T01:38:39.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.754+0000 7f540f0c9640 1 --2- 172.21.15.44:0/751517696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54080cf160 0x7f54080cd510 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.754+0000 7f540f0c9640 1 --2- 172.21.15.44:0/751517696 >> v2:172.21.15.204:3300/0 conn(0x7f540815e430 0x7f54080cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.754+0000 7f540f0c9640 1 -- 172.21.15.44:0/751517696 >> 172.21.15.44:0/751517696 conn(0x7f540806ea20 msgr2=0x7f540806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:39.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.754+0000 7f540f0c9640 1 -- 172.21.15.44:0/751517696 shutdown_connections 2023-11-04T01:38:39.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.754+0000 7f540f0c9640 1 -- 172.21.15.44:0/751517696 wait complete. 2023-11-04T01:38:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.756+0000 7f540f0c9640 1 Processor -- start 2023-11-04T01:38:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.756+0000 7f540f0c9640 1 -- start start 2023-11-04T01:38:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.756+0000 7f540f0c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54080cf160 0x7f540814dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540f0c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54080d0710 0x7f54080ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540f0c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f540815e430 0x7f540815d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540f0c9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540814e190 con 0x7f54080cf160 2023-11-04T01:38:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540f0c9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54080c95f0 con 0x7f540815e430 2023-11-04T01:38:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540f0c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54080c98d0 con 0x7f54080d0710 2023-11-04T01:38:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540ce65640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54080cf160 0x7f540814dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540ce65640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54080cf160 0x7f540814dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51826/0 (socket says 172.21.15.44:51826) 2023-11-04T01:38:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540ce65640 1 -- 172.21.15.44:0/666017129 learned_addr learned my addr 172.21.15.44:0/666017129 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:39.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f5407fff640 1 --2- 172.21.15.44:0/666017129 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54080d0710 0x7f54080ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540d666640 1 --2- 172.21.15.44:0/666017129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f540815e430 0x7f540815d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540ce65640 1 -- 172.21.15.44:0/666017129 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54080d0710 msgr2=0x7f54080ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540ce65640 1 --2- 172.21.15.44:0/666017129 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54080d0710 0x7f54080ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540ce65640 1 -- 172.21.15.44:0/666017129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f540815e430 msgr2=0x7f540815d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540ce65640 1 --2- 172.21.15.44:0/666017129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f540815e430 0x7f540815d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540ce65640 1 -- 172.21.15.44:0/666017129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f80094d0 con 0x7f54080cf160 2023-11-04T01:38:39.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540ce65640 1 --2- 172.21.15.44:0/666017129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54080cf160 0x7f540814dc50 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f540000efc0 tx=0x7f540000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f54057fa640 1 -- 172.21.15.44:0/666017129 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5400014480 con 0x7f54080cf160 2023-11-04T01:38:39.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f54057fa640 1 -- 172.21.15.44:0/666017129 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540000f040 con 0x7f54080cf160 2023-11-04T01:38:39.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540f0c9640 1 -- 172.21.15.44:0/666017129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54080c9bb0 con 0x7f54080cf160 2023-11-04T01:38:39.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f54057fa640 1 -- 172.21.15.44:0/666017129 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5400014800 con 0x7f54080cf160 2023-11-04T01:38:39.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.757+0000 7f540f0c9640 1 -- 172.21.15.44:0/666017129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54080ca170 con 0x7f54080cf160 2023-11-04T01:38:39.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.759+0000 7f540f0c9640 1 -- 172.21.15.44:0/666017129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5408074290 con 0x7f54080cf160 2023-11-04T01:38:39.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.759+0000 7f54057fa640 1 -- 172.21.15.44:0/666017129 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5400014960 con 0x7f54080cf160 2023-11-04T01:38:39.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.759+0000 7f54057fa640 1 --2- 172.21.15.44:0/666017129 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53e806ae70 0x7f53e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.759+0000 7f54057fa640 1 -- 172.21.15.44:0/666017129 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f540008a770 con 0x7f54080cf160 2023-11-04T01:38:39.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.759+0000 7f5407fff640 1 --2- 172.21.15.44:0/666017129 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53e806ae70 0x7f53e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.760+0000 7f5407fff640 1 --2- 172.21.15.44:0/666017129 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53e806ae70 0x7f53e806d330 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f53f8036000 tx=0x7f53f8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.763+0000 7f54057fa640 1 -- 172.21.15.44:0/666017129 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f54000552a0 con 0x7f54080cf160 2023-11-04T01:38:39.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.939+0000 7f540f0c9640 1 -- 172.21.15.44:0/666017129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f54080c7930 con 0x7f54080cf160 2023-11-04T01:38:39.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.940+0000 7f54057fa640 1 -- 172.21.15.44:0/666017129 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v71) v1 ==== 103+0+11 (secure 0 0 0) 0x7f54000588c0 con 0x7f54080cf160 2023-11-04T01:38:39.942 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:39.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.941+0000 7f540f0c9640 1 -- 172.21.15.44:0/666017129 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53e806ae70 msgr2=0x7f53e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.941+0000 7f540f0c9640 1 --2- 172.21.15.44:0/666017129 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53e806ae70 0x7f53e806d330 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f53f8036000 tx=0x7f53f8008030 comp rx=0 tx=0).stop 2023-11-04T01:38:39.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.941+0000 7f540f0c9640 1 -- 172.21.15.44:0/666017129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54080cf160 msgr2=0x7f540814dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.941+0000 7f540f0c9640 1 --2- 172.21.15.44:0/666017129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54080cf160 0x7f540814dc50 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f540000efc0 tx=0x7f540000c490 comp rx=0 tx=0).stop 2023-11-04T01:38:39.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.942+0000 7f540f0c9640 1 -- 172.21.15.44:0/666017129 shutdown_connections 2023-11-04T01:38:39.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.942+0000 7f540f0c9640 1 --2- 172.21.15.44:0/666017129 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53e806ae70 0x7f53e806d330 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.942+0000 7f540f0c9640 1 --2- 172.21.15.44:0/666017129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f540815e430 0x7f540815d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.942+0000 7f540f0c9640 1 --2- 172.21.15.44:0/666017129 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54080d0710 0x7f54080ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.942+0000 7f540f0c9640 1 --2- 172.21.15.44:0/666017129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54080cf160 0x7f540814dc50 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.942+0000 7f540f0c9640 1 -- 172.21.15.44:0/666017129 >> 172.21.15.44:0/666017129 conn(0x7f540806ea20 msgr2=0x7f540815af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:39.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.942+0000 7f540f0c9640 1 -- 172.21.15.44:0/666017129 shutdown_connections 2023-11-04T01:38:39.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:39.942+0000 7f540f0c9640 1 -- 172.21.15.44:0/666017129 wait complete. 2023-11-04T01:38:39.955 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:38:40.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.062+0000 7fb9eb961640 1 Processor -- start 2023-11-04T01:38:40.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.062+0000 7fb9eb961640 1 -- start start 2023-11-04T01:38:40.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9eb961640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9e4160430 0x7fb9e40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9eb961640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb9e406c3a0 0x7fb9e40cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9eb961640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40b2fc0 con 0x7fb9e40b2b60 2023-11-04T01:38:40.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9eb961640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e40cb580 con 0x7fb9e406c3a0 2023-11-04T01:38:40.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9eb961640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e406ca40 con 0x7fb9e4160430 2023-11-04T01:38:40.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9e96fd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9e4160430 0x7fb9e40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9e9efe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb9e406c3a0 0x7fb9e40cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9e96fd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9e4160430 0x7fb9e40b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:36082/0 (socket says 172.21.15.44:36082) 2023-11-04T01:38:40.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9e9efe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb9e406c3a0 0x7fb9e40cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:49670/0 (socket says 172.21.15.44:49670) 2023-11-04T01:38:40.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9e96fd640 1 -- 172.21.15.44:0/1219391768 learned_addr learned my addr 172.21.15.44:0/1219391768 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:40.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9e8efc640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fb9e40b2b60 0x7fb9e406bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:44346/0 (socket says 172.21.15.44:44346) 2023-11-04T01:38:40.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9e9efe640 1 -- 172.21.15.44:0/1219391768 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9e4160430 msgr2=0x7fb9e40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:40.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9e9efe640 1 --2- 172.21.15.44:0/1219391768 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9e4160430 0x7fb9e40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9e9efe640 1 -- 172.21.15.44:0/1219391768 >> v1:172.21.15.204:6789/0 conn(0x7fb9e40b2b60 legacy=0x7fb9e406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9e9efe640 1 -- 172.21.15.44:0/1219391768 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e406c810 con 0x7fb9e406c3a0 2023-11-04T01:38:40.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.063+0000 7fb9e96fd640 1 --2- 172.21.15.44:0/1219391768 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9e4160430 0x7fb9e40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:40.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.064+0000 7fb9e9efe640 1 --2- 172.21.15.44:0/1219391768 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9e406c3a0 0x7fb9e40cbcb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009d90 tx=0x7fb9dc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adc177f5ba520ce2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.064+0000 7fb9dbfff640 1 -- 172.21.15.44:0/1219391768 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc02cc50 con 0x7fb9e406c3a0 2023-11-04T01:38:40.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.065+0000 7fb9dbfff640 1 -- 172.21.15.44:0/1219391768 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc02cdb0 con 0x7fb9e406c3a0 2023-11-04T01:38:40.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.065+0000 7fb9dbfff640 1 -- 172.21.15.44:0/1219391768 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc034660 con 0x7fb9e406c3a0 2023-11-04T01:38:40.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.065+0000 7fb9eb961640 1 -- 172.21.15.44:0/1219391768 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9e406c3a0 msgr2=0x7fb9e40cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.065+0000 7fb9eb961640 1 --2- 172.21.15.44:0/1219391768 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9e406c3a0 0x7fb9e40cbcb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009d90 tx=0x7fb9dc02bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.065+0000 7fb9eb961640 1 -- 172.21.15.44:0/1219391768 shutdown_connections 2023-11-04T01:38:40.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.065+0000 7fb9eb961640 1 --2- 172.21.15.44:0/1219391768 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9e406c3a0 0x7fb9e40cbcb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.065+0000 7fb9eb961640 1 --2- 172.21.15.44:0/1219391768 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9e4160430 0x7fb9e40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.065+0000 7fb9eb961640 1 -- 172.21.15.44:0/1219391768 >> 172.21.15.44:0/1219391768 conn(0x7fb9e406ea20 msgr2=0x7fb9e406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.065+0000 7fb9eb961640 1 -- 172.21.15.44:0/1219391768 shutdown_connections 2023-11-04T01:38:40.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.065+0000 7fb9eb961640 1 -- 172.21.15.44:0/1219391768 wait complete. 2023-11-04T01:38:40.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.066+0000 7fb9eb961640 1 Processor -- start 2023-11-04T01:38:40.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.066+0000 7fb9eb961640 1 -- start start 2023-11-04T01:38:40.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.067+0000 7fb9eb961640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9e406c3a0 0x7fb9e41520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.067+0000 7fb9eb961640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9e40b2b60 0x7fb9e41f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.067+0000 7fb9eb961640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9e4160430 0x7fb9e40ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.067+0000 7fb9eb961640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4152ad0 con 0x7fb9e4160430 2023-11-04T01:38:40.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.067+0000 7fb9eb961640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e41f3790 con 0x7fb9e40b2b60 2023-11-04T01:38:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.067+0000 7fb9eb961640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40c91e0 con 0x7fb9e406c3a0 2023-11-04T01:38:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.067+0000 7fb9e9efe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9e4160430 0x7fb9e40ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.067+0000 7fb9e9efe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9e4160430 0x7fb9e40ccc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51836/0 (socket says 172.21.15.44:51836) 2023-11-04T01:38:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.067+0000 7fb9e9efe640 1 -- 172.21.15.44:0/398482745 learned_addr learned my addr 172.21.15.44:0/398482745 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.067+0000 7fb9e96fd640 1 --2- 172.21.15.44:0/398482745 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9e406c3a0 0x7fb9e41520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.067+0000 7fb9e8efc640 1 --2- 172.21.15.44:0/398482745 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9e40b2b60 0x7fb9e41f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.068+0000 7fb9e9efe640 1 -- 172.21.15.44:0/398482745 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9e406c3a0 msgr2=0x7fb9e41520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.068+0000 7fb9e9efe640 1 --2- 172.21.15.44:0/398482745 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9e406c3a0 0x7fb9e41520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.068+0000 7fb9e9efe640 1 -- 172.21.15.44:0/398482745 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9e40b2b60 msgr2=0x7fb9e41f3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.068+0000 7fb9e9efe640 1 --2- 172.21.15.44:0/398482745 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9e40b2b60 0x7fb9e41f3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.068+0000 7fb9e9efe640 1 -- 172.21.15.44:0/398482745 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e00094d0 con 0x7fb9e4160430 2023-11-04T01:38:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.068+0000 7fb9e9efe640 1 --2- 172.21.15.44:0/398482745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9e4160430 0x7fb9e40ccc00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009eb0 tx=0x7fb9dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.068+0000 7fb9d9ffb640 1 -- 172.21.15.44:0/398482745 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc040650 con 0x7fb9e4160430 2023-11-04T01:38:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.068+0000 7fb9d9ffb640 1 -- 172.21.15.44:0/398482745 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc0407b0 con 0x7fb9e4160430 2023-11-04T01:38:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.068+0000 7fb9eb961640 1 -- 172.21.15.44:0/398482745 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc009a70 con 0x7fb9e4160430 2023-11-04T01:38:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.068+0000 7fb9d9ffb640 1 -- 172.21.15.44:0/398482745 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc040b60 con 0x7fb9e4160430 2023-11-04T01:38:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.068+0000 7fb9eb961640 1 -- 172.21.15.44:0/398482745 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e4152600 con 0x7fb9e4160430 2023-11-04T01:38:40.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.069+0000 7fb9eb961640 1 -- 172.21.15.44:0/398482745 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e4074290 con 0x7fb9e4160430 2023-11-04T01:38:40.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.070+0000 7fb9d9ffb640 1 -- 172.21.15.44:0/398482745 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb9dc040cc0 con 0x7fb9e4160430 2023-11-04T01:38:40.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.070+0000 7fb9d9ffb640 1 --2- 172.21.15.44:0/398482745 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb9c806ae70 0x7fb9c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.070+0000 7fb9d9ffb640 1 -- 172.21.15.44:0/398482745 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fb9dc0ac720 con 0x7fb9e4160430 2023-11-04T01:38:40.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.070+0000 7fb9e96fd640 1 --2- 172.21.15.44:0/398482745 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb9c806ae70 0x7fb9c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.071+0000 7fb9e96fd640 1 --2- 172.21.15.44:0/398482745 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb9c806ae70 0x7fb9c806d330 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40c4950 tx=0x7fb9e0009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.074+0000 7fb9d9ffb640 1 -- 172.21.15.44:0/398482745 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb9dc077490 con 0x7fb9e4160430 2023-11-04T01:38:40.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.249+0000 7fb9eb961640 1 -- 172.21.15.44:0/398482745 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9e40b6b20 con 0x7fb9e4160430 2023-11-04T01:38:40.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.249+0000 7fb9d9ffb640 1 -- 172.21.15.44:0/398482745 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9dc009450 con 0x7fb9e4160430 2023-11-04T01:38:40.251 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:40.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.251+0000 7fb9eb961640 1 -- 172.21.15.44:0/398482745 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb9c806ae70 msgr2=0x7fb9c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.251+0000 7fb9eb961640 1 --2- 172.21.15.44:0/398482745 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb9c806ae70 0x7fb9c806d330 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40c4950 tx=0x7fb9e0009240 comp rx=0 tx=0).stop 2023-11-04T01:38:40.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.251+0000 7fb9eb961640 1 -- 172.21.15.44:0/398482745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9e4160430 msgr2=0x7fb9e40ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.251+0000 7fb9eb961640 1 --2- 172.21.15.44:0/398482745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9e4160430 0x7fb9e40ccc00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009eb0 tx=0x7fb9dc004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:40.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.251+0000 7fb9eb961640 1 -- 172.21.15.44:0/398482745 shutdown_connections 2023-11-04T01:38:40.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.251+0000 7fb9eb961640 1 --2- 172.21.15.44:0/398482745 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb9c806ae70 0x7fb9c806d330 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.251+0000 7fb9eb961640 1 --2- 172.21.15.44:0/398482745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9e4160430 0x7fb9e40ccc00 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.251+0000 7fb9eb961640 1 --2- 172.21.15.44:0/398482745 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9e40b2b60 0x7fb9e41f3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.251+0000 7fb9eb961640 1 --2- 172.21.15.44:0/398482745 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9e406c3a0 0x7fb9e41520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.251+0000 7fb9eb961640 1 -- 172.21.15.44:0/398482745 >> 172.21.15.44:0/398482745 conn(0x7fb9e406ea20 msgr2=0x7fb9e41598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.251+0000 7fb9eb961640 1 -- 172.21.15.44:0/398482745 shutdown_connections 2023-11-04T01:38:40.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.251+0000 7fb9eb961640 1 -- 172.21.15.44:0/398482745 wait complete. 2023-11-04T01:38:40.264 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:38:40.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.370+0000 7f0e4d9cc640 1 Processor -- start 2023-11-04T01:38:40.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.370+0000 7f0e4d9cc640 1 -- start start 2023-11-04T01:38:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.371+0000 7f0e4d9cc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0e4815cfd0 0x7f0e4806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.371+0000 7f0e4d9cc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0e480cf180 0x7f0e48161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.371+0000 7f0e4d9cc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e480cd570 0x7f0e480cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.371+0000 7f0e4d9cc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4815d3b0 con 0x7f0e4815cfd0 2023-11-04T01:38:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.371+0000 7f0e4d9cc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e480cdef0 con 0x7f0e480cf180 2023-11-04T01:38:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.371+0000 7f0e4d9cc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480cea20 con 0x7f0e480cd570 2023-11-04T01:38:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.371+0000 7f0e46ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0e4815cfd0 0x7f0e4806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.371+0000 7f0e46ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0e4815cfd0 0x7f0e4806c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51852/0 (socket says 172.21.15.44:51852) 2023-11-04T01:38:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.371+0000 7f0e46ffd640 1 -- 172.21.15.44:0/1893576480 learned_addr learned my addr 172.21.15.44:0/1893576480 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.372+0000 7f0e467fc640 1 --2- 172.21.15.44:0/1893576480 >> v2:172.21.15.204:3300/0 conn(0x7f0e480cf180 0x7f0e48161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.372+0000 7f0e477fe640 1 --2- 172.21.15.44:0/1893576480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e480cd570 0x7f0e480cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.372+0000 7f0e46ffd640 1 -- 172.21.15.44:0/1893576480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e480cd570 msgr2=0x7f0e480cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.372+0000 7f0e46ffd640 1 --2- 172.21.15.44:0/1893576480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e480cd570 0x7f0e480cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.372+0000 7f0e46ffd640 1 -- 172.21.15.44:0/1893576480 >> v2:172.21.15.204:3300/0 conn(0x7f0e480cf180 msgr2=0x7f0e48161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.372+0000 7f0e46ffd640 1 --2- 172.21.15.44:0/1893576480 >> v2:172.21.15.204:3300/0 conn(0x7f0e480cf180 0x7f0e48161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.372+0000 7f0e46ffd640 1 -- 172.21.15.44:0/1893576480 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e48161980 con 0x7f0e4815cfd0 2023-11-04T01:38:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.372+0000 7f0e467fc640 1 --2- 172.21.15.44:0/1893576480 >> v2:172.21.15.204:3300/0 conn(0x7f0e480cf180 0x7f0e48161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.372+0000 7f0e477fe640 1 --2- 172.21.15.44:0/1893576480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e480cd570 0x7f0e480cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.372+0000 7f0e46ffd640 1 --2- 172.21.15.44:0/1893576480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e4815cfd0 0x7f0e4806c0a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0e4806b0c0 tx=0x7f0e4002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3275f22ff10748ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.373+0000 7f0e45ffb640 1 -- 172.21.15.44:0/1893576480 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e400317d0 con 0x7f0e4815cfd0 2023-11-04T01:38:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.373+0000 7f0e45ffb640 1 -- 172.21.15.44:0/1893576480 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e40031930 con 0x7f0e4815cfd0 2023-11-04T01:38:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.373+0000 7f0e45ffb640 1 -- 172.21.15.44:0/1893576480 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40031cc0 con 0x7f0e4815cfd0 2023-11-04T01:38:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.373+0000 7f0e4d9cc640 1 -- 172.21.15.44:0/1893576480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e4815cfd0 msgr2=0x7f0e4806c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.373+0000 7f0e4d9cc640 1 --2- 172.21.15.44:0/1893576480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e4815cfd0 0x7f0e4806c0a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0e4806b0c0 tx=0x7f0e4002b870 comp rx=0 tx=0).stop 2023-11-04T01:38:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.373+0000 7f0e4d9cc640 1 -- 172.21.15.44:0/1893576480 shutdown_connections 2023-11-04T01:38:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.373+0000 7f0e4d9cc640 1 --2- 172.21.15.44:0/1893576480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e480cd570 0x7f0e480cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.373+0000 7f0e4d9cc640 1 --2- 172.21.15.44:0/1893576480 >> v2:172.21.15.204:3300/0 conn(0x7f0e480cf180 0x7f0e48161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.373+0000 7f0e4d9cc640 1 --2- 172.21.15.44:0/1893576480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e4815cfd0 0x7f0e4806c0a0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.373+0000 7f0e4d9cc640 1 -- 172.21.15.44:0/1893576480 >> 172.21.15.44:0/1893576480 conn(0x7f0e4806ea20 msgr2=0x7f0e4806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.373+0000 7f0e4d9cc640 1 -- 172.21.15.44:0/1893576480 shutdown_connections 2023-11-04T01:38:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.373+0000 7f0e4d9cc640 1 -- 172.21.15.44:0/1893576480 wait complete. 2023-11-04T01:38:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.374+0000 7f0e4d9cc640 1 Processor -- start 2023-11-04T01:38:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.375+0000 7f0e4d9cc640 1 -- start start 2023-11-04T01:38:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.375+0000 7f0e4d9cc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e480cd570 0x7f0e480caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.375+0000 7f0e4d9cc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e4815cfd0 0x7f0e4814f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.375+0000 7f0e4d9cc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e481f2680 0x7f0e4815e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.375+0000 7f0e4d9cc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480c58a0 con 0x7f0e480cd570 2023-11-04T01:38:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.375+0000 7f0e4d9cc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e481f2e60 con 0x7f0e481f2680 2023-11-04T01:38:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.375+0000 7f0e4d9cc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e481f3140 con 0x7f0e4815cfd0 2023-11-04T01:38:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.375+0000 7f0e46ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e480cd570 0x7f0e480caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.375+0000 7f0e46ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e480cd570 0x7f0e480caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51862/0 (socket says 172.21.15.44:51862) 2023-11-04T01:38:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.375+0000 7f0e46ffd640 1 -- 172.21.15.44:0/1487910639 learned_addr learned my addr 172.21.15.44:0/1487910639 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.375+0000 7f0e467fc640 1 --2- 172.21.15.44:0/1487910639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e4815cfd0 0x7f0e4814f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.375+0000 7f0e477fe640 1 --2- 172.21.15.44:0/1487910639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e481f2680 0x7f0e4815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.376+0000 7f0e46ffd640 1 -- 172.21.15.44:0/1487910639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e4815cfd0 msgr2=0x7f0e4814f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.376+0000 7f0e46ffd640 1 --2- 172.21.15.44:0/1487910639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e4815cfd0 0x7f0e4814f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.376+0000 7f0e46ffd640 1 -- 172.21.15.44:0/1487910639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e481f2680 msgr2=0x7f0e4815e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.376+0000 7f0e46ffd640 1 --2- 172.21.15.44:0/1487910639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e481f2680 0x7f0e4815e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.376+0000 7f0e46ffd640 1 -- 172.21.15.44:0/1487910639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e400094d0 con 0x7f0e480cd570 2023-11-04T01:38:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.376+0000 7f0e46ffd640 1 --2- 172.21.15.44:0/1487910639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e480cd570 0x7f0e480caba0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f0e40000c00 tx=0x7f0e400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.376+0000 7f0e2ffff640 1 -- 172.21.15.44:0/1487910639 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e400328f0 con 0x7f0e480cd570 2023-11-04T01:38:40.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.376+0000 7f0e2ffff640 1 -- 172.21.15.44:0/1487910639 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e40032a70 con 0x7f0e480cd570 2023-11-04T01:38:40.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.376+0000 7f0e4d9cc640 1 -- 172.21.15.44:0/1487910639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e481f3420 con 0x7f0e480cd570 2023-11-04T01:38:40.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.376+0000 7f0e2ffff640 1 -- 172.21.15.44:0/1487910639 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40032e20 con 0x7f0e480cd570 2023-11-04T01:38:40.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.376+0000 7f0e4d9cc640 1 -- 172.21.15.44:0/1487910639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4815eb50 con 0x7f0e480cd570 2023-11-04T01:38:40.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.377+0000 7f0e4d9cc640 1 -- 172.21.15.44:0/1487910639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e481f3280 con 0x7f0e480cd570 2023-11-04T01:38:40.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.377+0000 7f0e2ffff640 1 -- 172.21.15.44:0/1487910639 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e40030070 con 0x7f0e480cd570 2023-11-04T01:38:40.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.378+0000 7f0e2ffff640 1 --2- 172.21.15.44:0/1487910639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0e3406ae70 0x7f0e3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.378+0000 7f0e2ffff640 1 -- 172.21.15.44:0/1487910639 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f0e400ab8e0 con 0x7f0e480cd570 2023-11-04T01:38:40.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.378+0000 7f0e467fc640 1 --2- 172.21.15.44:0/1487910639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0e3406ae70 0x7f0e3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.379+0000 7f0e467fc640 1 --2- 172.21.15.44:0/1487910639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0e3406ae70 0x7f0e3406d330 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0e480c4360 tx=0x7f0e3c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.382+0000 7f0e2ffff640 1 -- 172.21.15.44:0/1487910639 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e481f3280 con 0x7f0e480cd570 2023-11-04T01:38:40.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.557+0000 7f0e4d9cc640 1 -- 172.21.15.44:0/1487910639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e481f3280 con 0x7f0e480cd570 2023-11-04T01:38:40.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.558+0000 7f0e2ffff640 1 -- 172.21.15.44:0/1487910639 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0e481f3280 con 0x7f0e480cd570 2023-11-04T01:38:40.560 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:38:40.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.559+0000 7f0e4d9cc640 1 -- 172.21.15.44:0/1487910639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0e3406ae70 msgr2=0x7f0e3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.559+0000 7f0e4d9cc640 1 --2- 172.21.15.44:0/1487910639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0e3406ae70 0x7f0e3406d330 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0e480c4360 tx=0x7f0e3c008040 comp rx=0 tx=0).stop 2023-11-04T01:38:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.559+0000 7f0e4d9cc640 1 -- 172.21.15.44:0/1487910639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e480cd570 msgr2=0x7f0e480caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.559+0000 7f0e4d9cc640 1 --2- 172.21.15.44:0/1487910639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e480cd570 0x7f0e480caba0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f0e40000c00 tx=0x7f0e400046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.560+0000 7f0e4d9cc640 1 -- 172.21.15.44:0/1487910639 shutdown_connections 2023-11-04T01:38:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.560+0000 7f0e4d9cc640 1 --2- 172.21.15.44:0/1487910639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0e3406ae70 0x7f0e3406d330 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.560+0000 7f0e4d9cc640 1 --2- 172.21.15.44:0/1487910639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e481f2680 0x7f0e4815e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.560+0000 7f0e4d9cc640 1 --2- 172.21.15.44:0/1487910639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e4815cfd0 0x7f0e4814f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.560+0000 7f0e4d9cc640 1 --2- 172.21.15.44:0/1487910639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e480cd570 0x7f0e480caba0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.560+0000 7f0e4d9cc640 1 -- 172.21.15.44:0/1487910639 >> 172.21.15.44:0/1487910639 conn(0x7f0e4806ea20 msgr2=0x7f0e48160770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.560+0000 7f0e4d9cc640 1 -- 172.21.15.44:0/1487910639 shutdown_connections 2023-11-04T01:38:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.560+0000 7f0e4d9cc640 1 -- 172.21.15.44:0/1487910639 wait complete. 2023-11-04T01:38:40.572 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:38:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.680+0000 7f8b52733640 1 Processor -- start 2023-11-04T01:38:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.680+0000 7f8b52733640 1 -- start start 2023-11-04T01:38:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.681+0000 7f8b52733640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c160430 0x7f8b4c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.681+0000 7f8b52733640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8b4c06c3a0 0x7f8b4c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.681+0000 7f8b52733640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c0b2fc0 con 0x7f8b4c0b2b60 2023-11-04T01:38:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.681+0000 7f8b52733640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4c0cb580 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.681+0000 7f8b52733640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c06ca40 con 0x7f8b4c160430 2023-11-04T01:38:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.681+0000 7f8b50cd0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8b4c06c3a0 0x7f8b4c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.681+0000 7f8b50cd0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8b4c06c3a0 0x7f8b4c0cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51872/0 (socket says 172.21.15.44:51872) 2023-11-04T01:38:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.681+0000 7f8b50cd0640 1 -- 172.21.15.44:0/906003015 learned_addr learned my addr 172.21.15.44:0/906003015 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.681+0000 7f8b4bfff640 1 --2- 172.21.15.44:0/906003015 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c160430 0x7f8b4c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.681+0000 7f8b50cd0640 1 -- 172.21.15.44:0/906003015 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c160430 msgr2=0x7f8b4c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.681+0000 7f8b50cd0640 1 --2- 172.21.15.44:0/906003015 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c160430 0x7f8b4c0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.681+0000 7f8b50cd0640 1 -- 172.21.15.44:0/906003015 >> v1:172.21.15.204:6789/0 conn(0x7f8b4c0b2b60 legacy=0x7f8b4c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.681+0000 7f8b50cd0640 1 -- 172.21.15.44:0/906003015 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c06c810 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.681+0000 7f8b4bfff640 1 --2- 172.21.15.44:0/906003015 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c160430 0x7f8b4c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.682+0000 7f8b50cd0640 1 --2- 172.21.15.44:0/906003015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b4c06c3a0 0x7f8b4c0cbcb0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8b44009e50 tx=0x7f8b4402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01635c0c3f1da3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.682+0000 7f8b4affd640 1 -- 172.21.15.44:0/906003015 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4402ca70 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.682+0000 7f8b4affd640 1 -- 172.21.15.44:0/906003015 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4402cbd0 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.682+0000 7f8b4affd640 1 -- 172.21.15.44:0/906003015 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440343f0 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.682+0000 7f8b52733640 1 -- 172.21.15.44:0/906003015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b4c06c3a0 msgr2=0x7f8b4c0cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.682+0000 7f8b52733640 1 --2- 172.21.15.44:0/906003015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b4c06c3a0 0x7f8b4c0cbcb0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8b44009e50 tx=0x7f8b4402bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.682+0000 7f8b52733640 1 -- 172.21.15.44:0/906003015 shutdown_connections 2023-11-04T01:38:40.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.682+0000 7f8b52733640 1 --2- 172.21.15.44:0/906003015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b4c06c3a0 0x7f8b4c0cbcb0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.682+0000 7f8b52733640 1 --2- 172.21.15.44:0/906003015 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c160430 0x7f8b4c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.682+0000 7f8b52733640 1 -- 172.21.15.44:0/906003015 >> 172.21.15.44:0/906003015 conn(0x7f8b4c06ea20 msgr2=0x7f8b4c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.683+0000 7f8b52733640 1 -- 172.21.15.44:0/906003015 shutdown_connections 2023-11-04T01:38:40.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.683+0000 7f8b52733640 1 -- 172.21.15.44:0/906003015 wait complete. 2023-11-04T01:38:40.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.684+0000 7f8b52733640 1 Processor -- start 2023-11-04T01:38:40.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.684+0000 7f8b52733640 1 -- start start 2023-11-04T01:38:40.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.684+0000 7f8b52733640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b4c06c3a0 0x7f8b4c15a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b52733640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b4c0b2b60 0x7f8b4c0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b52733640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c160430 0x7f8b4c0c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b52733640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0b4b50 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b52733640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0ced70 con 0x7f8b4c0b2b60 2023-11-04T01:38:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b52733640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0cf050 con 0x7f8b4c160430 2023-11-04T01:38:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b4bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b4c06c3a0 0x7f8b4c15a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b4bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b4c06c3a0 0x7f8b4c15a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51880/0 (socket says 172.21.15.44:51880) 2023-11-04T01:38:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b4bfff640 1 -- 172.21.15.44:0/1079525643 learned_addr learned my addr 172.21.15.44:0/1079525643 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b50cd0640 1 --2- 172.21.15.44:0/1079525643 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c160430 0x7f8b4c0c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b4b7fe640 1 --2- 172.21.15.44:0/1079525643 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b4c0b2b60 0x7f8b4c0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b4bfff640 1 -- 172.21.15.44:0/1079525643 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c160430 msgr2=0x7f8b4c0c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b4bfff640 1 --2- 172.21.15.44:0/1079525643 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c160430 0x7f8b4c0c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b4bfff640 1 -- 172.21.15.44:0/1079525643 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b4c0b2b60 msgr2=0x7f8b4c0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b4bfff640 1 --2- 172.21.15.44:0/1079525643 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b4c0b2b60 0x7f8b4c0ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b4bfff640 1 -- 172.21.15.44:0/1079525643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b44009b30 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b50cd0640 1 --2- 172.21.15.44:0/1079525643 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c160430 0x7f8b4c0c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b4bfff640 1 --2- 172.21.15.44:0/1079525643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b4c06c3a0 0x7f8b4c15a7b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00c7f0 tx=0x7f8b3c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b48ff9640 1 -- 172.21.15.44:0/1079525643 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c007a30 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b48ff9640 1 -- 172.21.15.44:0/1079525643 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c007b90 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b52733640 1 -- 172.21.15.44:0/1079525643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4c0cf330 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b48ff9640 1 -- 172.21.15.44:0/1079525643 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00ce40 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.685+0000 7f8b52733640 1 -- 172.21.15.44:0/1079525643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c15b480 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.686+0000 7f8b52733640 1 -- 172.21.15.44:0/1079525643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4c0cf520 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.687+0000 7f8b48ff9640 1 -- 172.21.15.44:0/1079525643 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b3c0113f0 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.687+0000 7f8b48ff9640 1 --2- 172.21.15.44:0/1079525643 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b3806ae70 0x7f8b3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.687+0000 7f8b48ff9640 1 -- 172.21.15.44:0/1079525643 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f8b3c089cc0 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.688+0000 7f8b4b7fe640 1 --2- 172.21.15.44:0/1079525643 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b3806ae70 0x7f8b3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.688+0000 7f8b4b7fe640 1 --2- 172.21.15.44:0/1079525643 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b3806ae70 0x7f8b3806d330 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0c6960 tx=0x7f8b40009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.691+0000 7f8b48ff9640 1 -- 172.21.15.44:0/1079525643 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8b3c054860 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.867+0000 7f8b52733640 1 -- 172.21.15.44:0/1079525643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f8b4c074290 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.867+0000 7f8b48ff9640 1 -- 172.21.15.44:0/1079525643 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v71) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8b3c01f0a0 con 0x7f8b4c06c3a0 2023-11-04T01:38:40.869 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.869+0000 7f8b52733640 1 -- 172.21.15.44:0/1079525643 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b3806ae70 msgr2=0x7f8b3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.869+0000 7f8b52733640 1 --2- 172.21.15.44:0/1079525643 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b3806ae70 0x7f8b3806d330 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0c6960 tx=0x7f8b40009040 comp rx=0 tx=0).stop 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.869+0000 7f8b52733640 1 -- 172.21.15.44:0/1079525643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b4c06c3a0 msgr2=0x7f8b4c15a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.869+0000 7f8b52733640 1 --2- 172.21.15.44:0/1079525643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b4c06c3a0 0x7f8b4c15a7b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00c7f0 tx=0x7f8b3c00cbf0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.869+0000 7f8b52733640 1 -- 172.21.15.44:0/1079525643 shutdown_connections 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.869+0000 7f8b52733640 1 --2- 172.21.15.44:0/1079525643 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b3806ae70 0x7f8b3806d330 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.869+0000 7f8b52733640 1 --2- 172.21.15.44:0/1079525643 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c160430 0x7f8b4c0c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.869+0000 7f8b52733640 1 --2- 172.21.15.44:0/1079525643 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b4c0b2b60 0x7f8b4c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.869+0000 7f8b52733640 1 --2- 172.21.15.44:0/1079525643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b4c06c3a0 0x7f8b4c15a7b0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.869+0000 7f8b52733640 1 -- 172.21.15.44:0/1079525643 >> 172.21.15.44:0/1079525643 conn(0x7f8b4c06ea20 msgr2=0x7f8b4c15da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.869+0000 7f8b52733640 1 -- 172.21.15.44:0/1079525643 shutdown_connections 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.869+0000 7f8b52733640 1 -- 172.21.15.44:0/1079525643 wait complete. 2023-11-04T01:38:40.882 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:38:40.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.990+0000 7f6575155640 1 Processor -- start 2023-11-04T01:38:40.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.990+0000 7f6575155640 1 -- start start 2023-11-04T01:38:40.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.991+0000 7f6575155640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f657015ad30 0x7f65700adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.991+0000 7f6575155640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6570070e20 0x7f657015e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.991+0000 7f6575155640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700c3900 con 0x7f65700ad730 2023-11-04T01:38:40.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.991+0000 7f6575155640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700ae260 con 0x7f657015ad30 2023-11-04T01:38:40.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.991+0000 7f6575155640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700c3be0 con 0x7f6570070e20 2023-11-04T01:38:40.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.991+0000 7f6567fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f65700ad730 0x7f6570070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47094/0 (socket says 172.21.15.44:47094) 2023-11-04T01:38:40.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.991+0000 7f656ed9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f657015ad30 0x7f65700adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.991+0000 7f6567fff640 1 -- 172.21.15.44:0/1424040912 learned_addr learned my addr 172.21.15.44:0/1424040912 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:40.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.991+0000 7f656f59e640 1 --2- 172.21.15.44:0/1424040912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6570070e20 0x7f657015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.991+0000 7f656ed9d640 1 -- 172.21.15.44:0/1424040912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6570070e20 msgr2=0x7f657015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:40.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.991+0000 7f656ed9d640 1 --2- 172.21.15.44:0/1424040912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6570070e20 0x7f657015e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.991+0000 7f656ed9d640 1 -- 172.21.15.44:0/1424040912 >> v1:172.21.15.44:6789/0 conn(0x7f65700ad730 legacy=0x7f6570070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.991+0000 7f656ed9d640 1 -- 172.21.15.44:0/1424040912 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700c3ec0 con 0x7f657015ad30 2023-11-04T01:38:40.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.991+0000 7f656e59c640 1 -- 172.21.15.44:0/1424040912 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16260033 0 0) 0x7f65700c3900 con 0x7f65700ad730 2023-11-04T01:38:40.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.991+0000 7f656f59e640 1 --2- 172.21.15.44:0/1424040912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6570070e20 0x7f657015e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:40.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.992+0000 7f656ed9d640 1 --2- 172.21.15.44:0/1424040912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f657015ad30 0x7f65700adc80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f65600097a0 tx=0x7f656002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3593165d40f709c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.992+0000 7f656e59c640 1 -- 172.21.15.44:0/1424040912 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656002e070 con 0x7f657015ad30 2023-11-04T01:38:40.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.992+0000 7f656e59c640 1 -- 172.21.15.44:0/1424040912 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65600315a0 con 0x7f657015ad30 2023-11-04T01:38:40.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.992+0000 7f656e59c640 1 -- 172.21.15.44:0/1424040912 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560031930 con 0x7f657015ad30 2023-11-04T01:38:40.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.993+0000 7f6575155640 1 -- 172.21.15.44:0/1424040912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f657015ad30 msgr2=0x7f65700adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.993+0000 7f6575155640 1 --2- 172.21.15.44:0/1424040912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f657015ad30 0x7f65700adc80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f65600097a0 tx=0x7f656002b840 comp rx=0 tx=0).stop 2023-11-04T01:38:40.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.993+0000 7f6575155640 1 -- 172.21.15.44:0/1424040912 shutdown_connections 2023-11-04T01:38:40.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.993+0000 7f6575155640 1 --2- 172.21.15.44:0/1424040912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6570070e20 0x7f657015e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.993+0000 7f6575155640 1 --2- 172.21.15.44:0/1424040912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f657015ad30 0x7f65700adc80 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.993+0000 7f6575155640 1 -- 172.21.15.44:0/1424040912 >> 172.21.15.44:0/1424040912 conn(0x7f65700ce950 msgr2=0x7f65700ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.993+0000 7f6575155640 1 -- 172.21.15.44:0/1424040912 shutdown_connections 2023-11-04T01:38:40.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.993+0000 7f6575155640 1 -- 172.21.15.44:0/1424040912 wait complete. 2023-11-04T01:38:40.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.994+0000 7f6575155640 1 Processor -- start 2023-11-04T01:38:40.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.994+0000 7f6575155640 1 -- start start 2023-11-04T01:38:40.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f6575155640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6570070e20 0x7f65700b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f6575155640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65700ad730 0x7f65701f0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f6575155640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f657015ad30 0x7f65700b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f6575155640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65700b21d0 con 0x7f6570070e20 2023-11-04T01:38:41.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f6575155640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65701f0b80 con 0x7f65700ad730 2023-11-04T01:38:41.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f6575155640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657015c1a0 con 0x7f657015ad30 2023-11-04T01:38:41.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f656ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6570070e20 0x7f65700b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f656ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6570070e20 0x7f65700b1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51906/0 (socket says 172.21.15.44:51906) 2023-11-04T01:38:41.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f656ed9d640 1 -- 172.21.15.44:0/1665892507 learned_addr learned my addr 172.21.15.44:0/1665892507 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:41.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f656ed9d640 1 -- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f657015ad30 msgr2=0x7f65700b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f656f59e640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f657015ad30 0x7f65700b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f6567fff640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65700ad730 0x7f65701f0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f656ed9d640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f657015ad30 0x7f65700b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f656ed9d640 1 -- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65700ad730 msgr2=0x7f65701f0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f656ed9d640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65700ad730 0x7f65701f0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f656ed9d640 1 -- 172.21.15.44:0/1665892507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6560009400 con 0x7f6570070e20 2023-11-04T01:38:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f656f59e640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f657015ad30 0x7f65700b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f6567fff640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65700ad730 0x7f65701f0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f656ed9d640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6570070e20 0x7f65700b1c90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f6560034040 tx=0x7f65600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.995+0000 7f65677fe640 1 -- 172.21.15.44:0/1665892507 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560032840 con 0x7f6570070e20 2023-11-04T01:38:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.996+0000 7f65677fe640 1 -- 172.21.15.44:0/1665892507 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65600329a0 con 0x7f6570070e20 2023-11-04T01:38:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.996+0000 7f6575155640 1 -- 172.21.15.44:0/1665892507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657015bec0 con 0x7f6570070e20 2023-11-04T01:38:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.996+0000 7f65677fe640 1 -- 172.21.15.44:0/1665892507 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560032d50 con 0x7f6570070e20 2023-11-04T01:38:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.996+0000 7f6575155640 1 -- 172.21.15.44:0/1665892507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65700c6e80 con 0x7f6570070e20 2023-11-04T01:38:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.996+0000 7f6575155640 1 -- 172.21.15.44:0/1665892507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6570074290 con 0x7f6570070e20 2023-11-04T01:38:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.997+0000 7f65677fe640 1 -- 172.21.15.44:0/1665892507 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f656004e430 con 0x7f6570070e20 2023-11-04T01:38:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.997+0000 7f65677fe640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f655006ae70 0x7f655006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.997+0000 7f65677fe640 1 -- 172.21.15.44:0/1665892507 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f65600abb20 con 0x7f6570070e20 2023-11-04T01:38:41.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.998+0000 7f6567fff640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f655006ae70 0x7f655006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:40.998+0000 7f6567fff640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f655006ae70 0x7f655006d330 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f657015bab0 tx=0x7f6558009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.001+0000 7f65677fe640 1 -- 172.21.15.44:0/1665892507 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f65600766c0 con 0x7f6570070e20 2023-11-04T01:38:41.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.177+0000 7f6575155640 1 -- 172.21.15.44:0/1665892507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f6570071970 con 0x7f6570070e20 2023-11-04T01:38:41.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.178+0000 7f65677fe640 1 -- 172.21.15.44:0/1665892507 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v71) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6560079ce0 con 0x7f6570070e20 2023-11-04T01:38:41.180 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:41.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.180+0000 7f6575155640 1 -- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f655006ae70 msgr2=0x7f655006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.180+0000 7f6575155640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f655006ae70 0x7f655006d330 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f657015bab0 tx=0x7f6558009040 comp rx=0 tx=0).stop 2023-11-04T01:38:41.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.180+0000 7f6575155640 1 -- 172.21.15.44:0/1665892507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6570070e20 msgr2=0x7f65700b1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.180+0000 7f6575155640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6570070e20 0x7f65700b1c90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f6560034040 tx=0x7f65600046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.180+0000 7f6575155640 1 -- 172.21.15.44:0/1665892507 shutdown_connections 2023-11-04T01:38:41.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.180+0000 7f6575155640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f655006ae70 0x7f655006d330 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.180+0000 7f6575155640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f657015ad30 0x7f65700b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.180+0000 7f6575155640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65700ad730 0x7f65701f0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.180+0000 7f6575155640 1 --2- 172.21.15.44:0/1665892507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6570070e20 0x7f65700b1c90 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.180+0000 7f6575155640 1 -- 172.21.15.44:0/1665892507 >> 172.21.15.44:0/1665892507 conn(0x7f65700ce950 msgr2=0x7f657006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:41.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.180+0000 7f6575155640 1 -- 172.21.15.44:0/1665892507 shutdown_connections 2023-11-04T01:38:41.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.180+0000 7f6575155640 1 -- 172.21.15.44:0/1665892507 wait complete. 2023-11-04T01:38:41.192 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:38:41.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.298+0000 7fb7246af640 1 Processor -- start 2023-11-04T01:38:41.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.298+0000 7fb7246af640 1 -- start start 2023-11-04T01:38:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.299+0000 7fb7246af640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb71c0cd6d0 0x7fb71c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.299+0000 7fb7246af640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c0cde60 con 0x7fb71c153e60 2023-11-04T01:38:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.299+0000 7fb7246af640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c160f90 con 0x7fb71c0b4880 2023-11-04T01:38:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.299+0000 7fb7246af640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71c161960 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.300+0000 7fb721c4a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb71c0cd6d0 0x7fb71c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.300+0000 7fb72244b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb71c153e60 0x7fb71c15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47096/0 (socket says 172.21.15.44:47096) 2023-11-04T01:38:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.300+0000 7fb72244b640 1 -- 172.21.15.44:0/2918326412 learned_addr learned my addr 172.21.15.44:0/2918326412 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:41.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.300+0000 7fb721c4a640 1 -- 172.21.15.44:0/2918326412 >> v1:172.21.15.204:6789/0 conn(0x7fb71c0b4880 legacy=0x7fb71c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.300+0000 7fb721c4a640 1 -- 172.21.15.44:0/2918326412 >> v1:172.21.15.44:6789/0 conn(0x7fb71c153e60 legacy=0x7fb71c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.300+0000 7fb721c4a640 1 -- 172.21.15.44:0/2918326412 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c0ce090 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.300+0000 7fb721449640 1 -- 172.21.15.44:0/2918326412 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004760616 0 0) 0x7fb71c0cde60 con 0x7fb71c153e60 2023-11-04T01:38:41.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.301+0000 7fb721c4a640 1 --2- 172.21.15.44:0/2918326412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cd6d0 0x7fb71c161420 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb7100097a0 tx=0x7fb71002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711ecef1f6cf643b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.301+0000 7fb721449640 1 -- 172.21.15.44:0/2918326412 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710030610 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.301+0000 7fb721449640 1 -- 172.21.15.44:0/2918326412 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb710030770 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.301+0000 7fb721449640 1 -- 172.21.15.44:0/2918326412 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710030b00 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.301+0000 7fb7246af640 1 -- 172.21.15.44:0/2918326412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cd6d0 msgr2=0x7fb71c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.301+0000 7fb7246af640 1 --2- 172.21.15.44:0/2918326412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cd6d0 0x7fb71c161420 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb7100097a0 tx=0x7fb71002b960 comp rx=0 tx=0).stop 2023-11-04T01:38:41.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.301+0000 7fb7246af640 1 -- 172.21.15.44:0/2918326412 shutdown_connections 2023-11-04T01:38:41.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.301+0000 7fb7246af640 1 --2- 172.21.15.44:0/2918326412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cd6d0 0x7fb71c161420 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.301+0000 7fb7246af640 1 -- 172.21.15.44:0/2918326412 >> 172.21.15.44:0/2918326412 conn(0x7fb71c0cf880 msgr2=0x7fb71c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:41.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.301+0000 7fb7246af640 1 -- 172.21.15.44:0/2918326412 shutdown_connections 2023-11-04T01:38:41.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.301+0000 7fb7246af640 1 -- 172.21.15.44:0/2918326412 wait complete. 2023-11-04T01:38:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.303+0000 7fb7246af640 1 Processor -- start 2023-11-04T01:38:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.303+0000 7fb7246af640 1 -- start start 2023-11-04T01:38:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.303+0000 7fb7246af640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb71c0b4880 0x7fb71c0c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.303+0000 7fb7246af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cd6d0 0x7fb71c0c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.303+0000 7fb7246af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb71c153e60 0x7fb71c154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.303+0000 7fb7246af640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c1f3100 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.303+0000 7fb7246af640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c1459a0 con 0x7fb71c0b4880 2023-11-04T01:38:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.303+0000 7fb7246af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c1f3590 con 0x7fb71c153e60 2023-11-04T01:38:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.303+0000 7fb721c4a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cd6d0 0x7fb71c0c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.303+0000 7fb721c4a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cd6d0 0x7fb71c0c6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51912/0 (socket says 172.21.15.44:51912) 2023-11-04T01:38:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.304+0000 7fb721c4a640 1 -- 172.21.15.44:0/1996014426 learned_addr learned my addr 172.21.15.44:0/1996014426 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.304+0000 7fb72244b640 1 --2- 172.21.15.44:0/1996014426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb71c0b4880 0x7fb71c0c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.304+0000 7fb722c4c640 1 --2- 172.21.15.44:0/1996014426 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb71c153e60 0x7fb71c154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.304+0000 7fb721c4a640 1 -- 172.21.15.44:0/1996014426 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb71c153e60 msgr2=0x7fb71c154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.304+0000 7fb721c4a640 1 --2- 172.21.15.44:0/1996014426 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb71c153e60 0x7fb71c154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.304+0000 7fb721c4a640 1 -- 172.21.15.44:0/1996014426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb71c0b4880 msgr2=0x7fb71c0c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.304+0000 7fb721c4a640 1 --2- 172.21.15.44:0/1996014426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb71c0b4880 0x7fb71c0c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.304+0000 7fb721c4a640 1 -- 172.21.15.44:0/1996014426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710009400 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.304+0000 7fb721c4a640 1 --2- 172.21.15.44:0/1996014426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cd6d0 0x7fb71c0c6350 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb7100097a0 tx=0x7fb7100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.304+0000 7fb71affd640 1 -- 172.21.15.44:0/1996014426 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710039c90 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.304+0000 7fb71affd640 1 -- 172.21.15.44:0/1996014426 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71003f040 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.304+0000 7fb7246af640 1 -- 172.21.15.44:0/1996014426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71c1f27d0 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.304+0000 7fb71affd640 1 -- 172.21.15.44:0/1996014426 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710004030 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.304+0000 7fb7246af640 1 -- 172.21.15.44:0/1996014426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71c1f2d90 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.305+0000 7fb7246af640 1 -- 172.21.15.44:0/1996014426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c1f2f20 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.306+0000 7fb71affd640 1 -- 172.21.15.44:0/1996014426 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb710004190 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.306+0000 7fb71affd640 1 --2- 172.21.15.44:0/1996014426 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb70806ae70 0x7fb70806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.306+0000 7fb71affd640 1 -- 172.21.15.44:0/1996014426 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fb7100abd50 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.306+0000 7fb72244b640 1 --2- 172.21.15.44:0/1996014426 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb70806ae70 0x7fb70806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.307+0000 7fb72244b640 1 --2- 172.21.15.44:0/1996014426 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb70806ae70 0x7fb70806d330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb714000f60 tx=0x7fb714007e40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.310+0000 7fb71affd640 1 -- 172.21.15.44:0/1996014426 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb710076990 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.499+0000 7fb7246af640 1 -- 172.21.15.44:0/1996014426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb71c066920 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.499+0000 7fb71affd640 1 -- 172.21.15.44:0/1996014426 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb710079fb0 con 0x7fb71c0cd6d0 2023-11-04T01:38:41.501 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2023-11-04T01:38:41.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.501+0000 7fb7246af640 1 -- 172.21.15.44:0/1996014426 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb70806ae70 msgr2=0x7fb70806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.501+0000 7fb7246af640 1 --2- 172.21.15.44:0/1996014426 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb70806ae70 0x7fb70806d330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb714000f60 tx=0x7fb714007e40 comp rx=0 tx=0).stop 2023-11-04T01:38:41.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.501+0000 7fb7246af640 1 -- 172.21.15.44:0/1996014426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cd6d0 msgr2=0x7fb71c0c6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.501+0000 7fb7246af640 1 --2- 172.21.15.44:0/1996014426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cd6d0 0x7fb71c0c6350 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb7100097a0 tx=0x7fb7100046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.501+0000 7fb7246af640 1 -- 172.21.15.44:0/1996014426 shutdown_connections 2023-11-04T01:38:41.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.501+0000 7fb7246af640 1 --2- 172.21.15.44:0/1996014426 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb70806ae70 0x7fb70806d330 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.501+0000 7fb7246af640 1 --2- 172.21.15.44:0/1996014426 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb71c153e60 0x7fb71c154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.501+0000 7fb7246af640 1 --2- 172.21.15.44:0/1996014426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb71c0cd6d0 0x7fb71c0c6350 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.501+0000 7fb7246af640 1 --2- 172.21.15.44:0/1996014426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb71c0b4880 0x7fb71c0c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.501+0000 7fb7246af640 1 -- 172.21.15.44:0/1996014426 >> 172.21.15.44:0/1996014426 conn(0x7fb71c0cf880 msgr2=0x7fb71c15b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:41.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.501+0000 7fb7246af640 1 -- 172.21.15.44:0/1996014426 shutdown_connections 2023-11-04T01:38:41.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.501+0000 7fb7246af640 1 -- 172.21.15.44:0/1996014426 wait complete. 2023-11-04T01:38:41.513 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2023-11-04T01:38:41.514 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:41.514 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:41.577 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[110872]: fuse finished with error 0 and tester_r 0 2023-11-04T01:38:41.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:41.582 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:38:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:41.585 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:38:41.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:41.586 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:38:41.602 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:38:41.602 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:41.621 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:41.622 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:38:41.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:41.622 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:38:41.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:41.680 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:38:41.680 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:38:41.680 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:41.696 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:41.696 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:38:41.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:41.696 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:38:41.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:41.751 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:38:41.753 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:38:41.753 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:41.774 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:41.774 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:38:41.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:41.774 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:38:41.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:41.832 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:38:41.832 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:41.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.937+0000 7fdcb2c7c640 1 Processor -- start 2023-11-04T01:38:41.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.937+0000 7fdcb2c7c640 1 -- start start 2023-11-04T01:38:41.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.937+0000 7fdcb2c7c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdcac15ad80 0x7fdcac06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.937+0000 7fdcb2c7c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdcac0b42c0 0x7fdcac0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.937+0000 7fdcb2c7c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcac06cd00 con 0x7fdcac0c9c40 2023-11-04T01:38:41.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.937+0000 7fdcb2c7c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac0ca020 con 0x7fdcac15ad80 2023-11-04T01:38:41.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.937+0000 7fdcb2c7c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac06cfa0 con 0x7fdcac0b42c0 2023-11-04T01:38:41.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.938+0000 7fdcb0a18640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdcac15ad80 0x7fdcac06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.938+0000 7fdcb0a18640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdcac15ad80 0x7fdcac06c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51918/0 (socket says 172.21.15.44:51918) 2023-11-04T01:38:41.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.938+0000 7fdcb0a18640 1 -- 172.21.15.44:0/3652821617 learned_addr learned my addr 172.21.15.44:0/3652821617 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:41.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.938+0000 7fdcabfff640 1 --2- 172.21.15.44:0/3652821617 >> v2:172.21.15.204:3300/0 conn(0x7fdcac0b42c0 0x7fdcac0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.938+0000 7fdcb0a18640 1 -- 172.21.15.44:0/3652821617 >> v2:172.21.15.204:3300/0 conn(0x7fdcac0b42c0 msgr2=0x7fdcac0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:41.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.938+0000 7fdcb0a18640 1 --2- 172.21.15.44:0/3652821617 >> v2:172.21.15.204:3300/0 conn(0x7fdcac0b42c0 0x7fdcac0c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.938+0000 7fdcb0a18640 1 -- 172.21.15.44:0/3652821617 >> v1:172.21.15.204:6789/0 conn(0x7fdcac0c9c40 legacy=0x7fdcac070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:41.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.938+0000 7fdcb0a18640 1 -- 172.21.15.44:0/3652821617 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac06d280 con 0x7fdcac15ad80 2023-11-04T01:38:41.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.939+0000 7fdcb0a18640 1 --2- 172.21.15.44:0/3652821617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcac15ad80 0x7fdcac06c7c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0b4ac0 tx=0x7fdc9c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6027853407db85 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.939+0000 7fdcab7fe640 1 -- 172.21.15.44:0/3652821617 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c030840 con 0x7fdcac15ad80 2023-11-04T01:38:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.939+0000 7fdcab7fe640 1 -- 172.21.15.44:0/3652821617 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c0309a0 con 0x7fdcac15ad80 2023-11-04T01:38:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.939+0000 7fdcab7fe640 1 -- 172.21.15.44:0/3652821617 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c030d30 con 0x7fdcac15ad80 2023-11-04T01:38:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.939+0000 7fdcb2c7c640 1 -- 172.21.15.44:0/3652821617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcac15ad80 msgr2=0x7fdcac06c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.939+0000 7fdcb2c7c640 1 --2- 172.21.15.44:0/3652821617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcac15ad80 0x7fdcac06c7c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0b4ac0 tx=0x7fdc9c02b980 comp rx=0 tx=0).stop 2023-11-04T01:38:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.939+0000 7fdcb2c7c640 1 -- 172.21.15.44:0/3652821617 shutdown_connections 2023-11-04T01:38:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.939+0000 7fdcb2c7c640 1 --2- 172.21.15.44:0/3652821617 >> v2:172.21.15.204:3300/0 conn(0x7fdcac0b42c0 0x7fdcac0c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.939+0000 7fdcb2c7c640 1 --2- 172.21.15.44:0/3652821617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcac15ad80 0x7fdcac06c7c0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.939+0000 7fdcb2c7c640 1 -- 172.21.15.44:0/3652821617 >> 172.21.15.44:0/3652821617 conn(0x7fdcac0ce950 msgr2=0x7fdcac0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.939+0000 7fdcb2c7c640 1 -- 172.21.15.44:0/3652821617 shutdown_connections 2023-11-04T01:38:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.939+0000 7fdcb2c7c640 1 -- 172.21.15.44:0/3652821617 wait complete. 2023-11-04T01:38:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.941+0000 7fdcb2c7c640 1 Processor -- start 2023-11-04T01:38:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.941+0000 7fdcb2c7c640 1 -- start start 2023-11-04T01:38:41.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.941+0000 7fdcb2c7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcac0b42c0 0x7fdcac0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.941+0000 7fdcb2c7c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdcac0c9c40 0x7fdcac1468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.941+0000 7fdcb2c7c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdcac15ad80 0x7fdcac150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.941+0000 7fdcb2c7c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0c7930 con 0x7fdcac0b42c0 2023-11-04T01:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.941+0000 7fdcb2c7c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac15be50 con 0x7fdcac15ad80 2023-11-04T01:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.941+0000 7fdcb2c7c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac146e30 con 0x7fdcac0c9c40 2023-11-04T01:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdcb0a18640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcac0b42c0 0x7fdcac0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdcb0a18640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcac0b42c0 0x7fdcac0c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51934/0 (socket says 172.21.15.44:51934) 2023-11-04T01:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdcb0a18640 1 -- 172.21.15.44:0/1973907284 learned_addr learned my addr 172.21.15.44:0/1973907284 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdcabfff640 1 --2- 172.21.15.44:0/1973907284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdcac0c9c40 0x7fdcac1468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdcb1219640 1 --2- 172.21.15.44:0/1973907284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdcac15ad80 0x7fdcac150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdcb0a18640 1 -- 172.21.15.44:0/1973907284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdcac0c9c40 msgr2=0x7fdcac1468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdcb0a18640 1 --2- 172.21.15.44:0/1973907284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdcac0c9c40 0x7fdcac1468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdcb0a18640 1 -- 172.21.15.44:0/1973907284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdcac15ad80 msgr2=0x7fdcac150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdcb0a18640 1 --2- 172.21.15.44:0/1973907284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdcac15ad80 0x7fdcac150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdcb0a18640 1 -- 172.21.15.44:0/1973907284 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c0094d0 con 0x7fdcac0b42c0 2023-11-04T01:38:41.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdcabfff640 1 --2- 172.21.15.44:0/1973907284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdcac0c9c40 0x7fdcac1468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:41.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdcb0a18640 1 --2- 172.21.15.44:0/1973907284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcac0b42c0 0x7fdcac0c73f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c000c00 tx=0x7fdc9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdca97fa640 1 -- 172.21.15.44:0/1973907284 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c039a90 con 0x7fdcac0b42c0 2023-11-04T01:38:41.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdca97fa640 1 -- 172.21.15.44:0/1973907284 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c039bf0 con 0x7fdcac0b42c0 2023-11-04T01:38:41.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdca97fa640 1 -- 172.21.15.44:0/1973907284 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c0433f0 con 0x7fdcac0b42c0 2023-11-04T01:38:41.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdcb2c7c640 1 -- 172.21.15.44:0/1973907284 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac0c7b60 con 0x7fdcac0b42c0 2023-11-04T01:38:41.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.942+0000 7fdcb2c7c640 1 -- 172.21.15.44:0/1973907284 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac0c8120 con 0x7fdcac0b42c0 2023-11-04T01:38:41.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.943+0000 7fdcb2c7c640 1 -- 172.21.15.44:0/1973907284 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac1503f0 con 0x7fdcac0b42c0 2023-11-04T01:38:41.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.944+0000 7fdca97fa640 1 -- 172.21.15.44:0/1973907284 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc9c042390 con 0x7fdcac0b42c0 2023-11-04T01:38:41.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.944+0000 7fdca97fa640 1 --2- 172.21.15.44:0/1973907284 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdc8c06ae70 0x7fdc8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.944+0000 7fdca97fa640 1 -- 172.21.15.44:0/1973907284 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fdc9c0ac010 con 0x7fdcac0b42c0 2023-11-04T01:38:41.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.945+0000 7fdcabfff640 1 --2- 172.21.15.44:0/1973907284 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdc8c06ae70 0x7fdc8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.945+0000 7fdcabfff640 1 --2- 172.21.15.44:0/1973907284 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdc8c06ae70 0x7fdc8c06d330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdcac150050 tx=0x7fdc94008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:41.949+0000 7fdca97fa640 1 -- 172.21.15.44:0/1973907284 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdcac1503f0 con 0x7fdcac0b42c0 2023-11-04T01:38:42.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.159+0000 7fdcb2c7c640 1 -- 172.21.15.44:0/1973907284 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcac1503f0 con 0x7fdcac0b42c0 2023-11-04T01:38:42.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.160+0000 7fdca97fa640 1 -- 172.21.15.44:0/1973907284 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fdcac1503f0 con 0x7fdcac0b42c0 2023-11-04T01:38:42.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:42.162 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5543,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/1112718006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1112718006},{"type":"v1","addr":"172.21.15.204:6837","nonce":1112718006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5935,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/719128216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":719128216},{"type":"v1","addr":"172.21.15.204:6836","nonce":719128216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3272698261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3272698261},{"type":"v1","addr":"172.21.15.44:6833","nonce":3272698261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:22.129730+0000","modified":"2023-11-04T01:38:24.137808+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/2413284016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2413284016},{"type":"v1","addr":"172.21.15.44:6835","nonce":2413284016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:38:42.162 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 31 2023-11-04T01:38:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.162+0000 7fdcb2c7c640 1 -- 172.21.15.44:0/1973907284 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdc8c06ae70 msgr2=0x7fdc8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.162+0000 7fdcb2c7c640 1 --2- 172.21.15.44:0/1973907284 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdc8c06ae70 0x7fdc8c06d330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdcac150050 tx=0x7fdc94008040 comp rx=0 tx=0).stop 2023-11-04T01:38:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.162+0000 7fdcb2c7c640 1 -- 172.21.15.44:0/1973907284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcac0b42c0 msgr2=0x7fdcac0c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.162+0000 7fdcb2c7c640 1 --2- 172.21.15.44:0/1973907284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcac0b42c0 0x7fdcac0c73f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c000c00 tx=0x7fdc9c004730 comp rx=0 tx=0).stop 2023-11-04T01:38:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.162+0000 7fdcb2c7c640 1 -- 172.21.15.44:0/1973907284 shutdown_connections 2023-11-04T01:38:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.162+0000 7fdcb2c7c640 1 --2- 172.21.15.44:0/1973907284 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdc8c06ae70 0x7fdc8c06d330 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.162+0000 7fdcb2c7c640 1 --2- 172.21.15.44:0/1973907284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdcac15ad80 0x7fdcac150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.162+0000 7fdcb2c7c640 1 --2- 172.21.15.44:0/1973907284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdcac0c9c40 0x7fdcac1468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.162+0000 7fdcb2c7c640 1 --2- 172.21.15.44:0/1973907284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcac0b42c0 0x7fdcac0c73f0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.162+0000 7fdcb2c7c640 1 -- 172.21.15.44:0/1973907284 >> 172.21.15.44:0/1973907284 conn(0x7fdcac0ce950 msgr2=0x7fdcac0afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:42.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.162+0000 7fdcb2c7c640 1 -- 172.21.15.44:0/1973907284 shutdown_connections 2023-11-04T01:38:42.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.162+0000 7fdcb2c7c640 1 -- 172.21.15.44:0/1973907284 wait complete. 2023-11-04T01:38:42.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:42.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.279+0000 7f08c85fc640 1 Processor -- start 2023-11-04T01:38:42.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.279+0000 7f08c85fc640 1 -- start start 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.280+0000 7f08c85fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f08c00cde60 0x7f08c015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.280+0000 7f08c85fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f08c00ce240 0x7f08c00d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.280+0000 7f08c85fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c015e000 con 0x7f08c015daa0 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.280+0000 7f08c85fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c015e5c0 con 0x7f08c00cde60 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.280+0000 7f08c85fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c015e2e0 con 0x7f08c00ce240 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.280+0000 7f08c6398640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f08c00cde60 0x7f08c015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.280+0000 7f08c6398640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f08c00cde60 0x7f08c015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51946/0 (socket says 172.21.15.44:51946) 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.280+0000 7f08c6398640 1 -- 172.21.15.44:0/269977098 learned_addr learned my addr 172.21.15.44:0/269977098 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.280+0000 7f08c6b99640 1 --2- 172.21.15.44:0/269977098 >> v2:172.21.15.204:3300/0 conn(0x7f08c00ce240 0x7f08c00d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.281+0000 7f08c6398640 1 -- 172.21.15.44:0/269977098 >> v2:172.21.15.204:3300/0 conn(0x7f08c00ce240 msgr2=0x7f08c00d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.281+0000 7f08c6398640 1 --2- 172.21.15.44:0/269977098 >> v2:172.21.15.204:3300/0 conn(0x7f08c00ce240 0x7f08c00d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.281+0000 7f08c6398640 1 -- 172.21.15.44:0/269977098 >> v1:172.21.15.204:6789/0 conn(0x7f08c015daa0 legacy=0x7f08c0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.284 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.281+0000 7f08c6398640 1 -- 172.21.15.44:0/269977098 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c00d1120 con 0x7f08c00cde60 2023-11-04T01:38:42.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.281+0000 7f08c6398640 1 --2- 172.21.15.44:0/269977098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08c00cde60 0x7f08c015d560 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f08c00cf2e0 tx=0x7f08b802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8abb8cdf934f70f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.282+0000 7f08c5396640 1 -- 172.21.15.44:0/269977098 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8030860 con 0x7f08c00cde60 2023-11-04T01:38:42.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.282+0000 7f08c5396640 1 -- 172.21.15.44:0/269977098 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b80309c0 con 0x7f08c00cde60 2023-11-04T01:38:42.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.282+0000 7f08c5396640 1 -- 172.21.15.44:0/269977098 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8030d50 con 0x7f08c00cde60 2023-11-04T01:38:42.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.282+0000 7f08c85fc640 1 -- 172.21.15.44:0/269977098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08c00cde60 msgr2=0x7f08c015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.282+0000 7f08c85fc640 1 --2- 172.21.15.44:0/269977098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08c00cde60 0x7f08c015d560 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f08c00cf2e0 tx=0x7f08b802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.282+0000 7f08c85fc640 1 -- 172.21.15.44:0/269977098 shutdown_connections 2023-11-04T01:38:42.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.282+0000 7f08c85fc640 1 --2- 172.21.15.44:0/269977098 >> v2:172.21.15.204:3300/0 conn(0x7f08c00ce240 0x7f08c00d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.282+0000 7f08c85fc640 1 --2- 172.21.15.44:0/269977098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08c00cde60 0x7f08c015d560 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.282+0000 7f08c85fc640 1 -- 172.21.15.44:0/269977098 >> 172.21.15.44:0/269977098 conn(0x7f08c0071f30 msgr2=0x7f08c00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:42.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.282+0000 7f08c85fc640 1 -- 172.21.15.44:0/269977098 shutdown_connections 2023-11-04T01:38:42.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.282+0000 7f08c85fc640 1 -- 172.21.15.44:0/269977098 wait complete. 2023-11-04T01:38:42.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.283+0000 7f08c85fc640 1 Processor -- start 2023-11-04T01:38:42.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.283+0000 7f08c85fc640 1 -- start start 2023-11-04T01:38:42.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.284+0000 7f08c85fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08c00cde60 0x7f08c01554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.284+0000 7f08c85fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08c00ce240 0x7f08c01f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.284+0000 7f08c85fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08c015daa0 0x7f08c01e7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.284+0000 7f08c85fc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c0155a10 con 0x7f08c00ce240 2023-11-04T01:38:42.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.284+0000 7f08c85fc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c01f6870 con 0x7f08c00cde60 2023-11-04T01:38:42.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.284+0000 7f08c85fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c0145360 con 0x7f08c015daa0 2023-11-04T01:38:42.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.284+0000 7f08c5b97640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08c00ce240 0x7f08c01f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.284+0000 7f08c5b97640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08c00ce240 0x7f08c01f6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51960/0 (socket says 172.21.15.44:51960) 2023-11-04T01:38:42.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.284+0000 7f08c5b97640 1 -- 172.21.15.44:0/1210143210 learned_addr learned my addr 172.21.15.44:0/1210143210 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:42.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.284+0000 7f08c6398640 1 --2- 172.21.15.44:0/1210143210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08c00cde60 0x7f08c01554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.284+0000 7f08c6b99640 1 --2- 172.21.15.44:0/1210143210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08c015daa0 0x7f08c01e7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.285+0000 7f08c5b97640 1 -- 172.21.15.44:0/1210143210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08c015daa0 msgr2=0x7f08c01e7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.285+0000 7f08c5b97640 1 --2- 172.21.15.44:0/1210143210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08c015daa0 0x7f08c01e7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.285+0000 7f08c5b97640 1 -- 172.21.15.44:0/1210143210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08c00cde60 msgr2=0x7f08c01554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.285+0000 7f08c5b97640 1 --2- 172.21.15.44:0/1210143210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08c00cde60 0x7f08c01554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.285+0000 7f08c5b97640 1 -- 172.21.15.44:0/1210143210 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80094d0 con 0x7f08c00ce240 2023-11-04T01:38:42.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.285+0000 7f08c6398640 1 --2- 172.21.15.44:0/1210143210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08c00cde60 0x7f08c01554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:42.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.285+0000 7f08c5b97640 1 --2- 172.21.15.44:0/1210143210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08c00ce240 0x7f08c01f6330 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f08b400c3c0 tx=0x7f08b400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.285+0000 7f08beffd640 1 -- 172.21.15.44:0/1210143210 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b40052d0 con 0x7f08c00ce240 2023-11-04T01:38:42.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.285+0000 7f08beffd640 1 -- 172.21.15.44:0/1210143210 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b4005450 con 0x7f08c00ce240 2023-11-04T01:38:42.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.285+0000 7f08beffd640 1 -- 172.21.15.44:0/1210143210 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4003830 con 0x7f08c00ce240 2023-11-04T01:38:42.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.285+0000 7f08c85fc640 1 -- 172.21.15.44:0/1210143210 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c0145640 con 0x7f08c00ce240 2023-11-04T01:38:42.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.285+0000 7f08c85fc640 1 -- 172.21.15.44:0/1210143210 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c0145c00 con 0x7f08c00ce240 2023-11-04T01:38:42.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.286+0000 7f08c85fc640 1 -- 172.21.15.44:0/1210143210 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c0074290 con 0x7f08c00ce240 2023-11-04T01:38:42.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.286+0000 7f08beffd640 1 -- 172.21.15.44:0/1210143210 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08b4003990 con 0x7f08c00ce240 2023-11-04T01:38:42.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.287+0000 7f08beffd640 1 --2- 172.21.15.44:0/1210143210 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f08ac06ae70 0x7f08ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.287+0000 7f08beffd640 1 -- 172.21.15.44:0/1210143210 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f08b40890a0 con 0x7f08c00ce240 2023-11-04T01:38:42.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.287+0000 7f08c6398640 1 --2- 172.21.15.44:0/1210143210 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f08ac06ae70 0x7f08ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.288+0000 7f08c6398640 1 --2- 172.21.15.44:0/1210143210 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f08ac06ae70 0x7f08ac06d330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f08b8036000 tx=0x7f08b8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.291+0000 7f08beffd640 1 -- 172.21.15.44:0/1210143210 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08b4053bb0 con 0x7f08c00ce240 2023-11-04T01:38:42.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.469+0000 7f08c85fc640 1 -- 172.21.15.44:0/1210143210 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08c0072e70 con 0x7f08c00ce240 2023-11-04T01:38:42.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.470+0000 7f08beffd640 1 -- 172.21.15.44:0/1210143210 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+22101 (secure 0 0 0) 0x7f08b40571d0 con 0x7f08c00ce240 2023-11-04T01:38:42.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:42.473 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":71,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:38:38.200225+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:20.738739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:21.109334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:42.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.472+0000 7f08c85fc640 1 -- 172.21.15.44:0/1210143210 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f08ac06ae70 msgr2=0x7f08ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.472+0000 7f08c85fc640 1 --2- 172.21.15.44:0/1210143210 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f08ac06ae70 0x7f08ac06d330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f08b8036000 tx=0x7f08b8008030 comp rx=0 tx=0).stop 2023-11-04T01:38:42.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.472+0000 7f08c85fc640 1 -- 172.21.15.44:0/1210143210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08c00ce240 msgr2=0x7f08c01f6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.472+0000 7f08c85fc640 1 --2- 172.21.15.44:0/1210143210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08c00ce240 0x7f08c01f6330 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f08b400c3c0 tx=0x7f08b400c880 comp rx=0 tx=0).stop 2023-11-04T01:38:42.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.472+0000 7f08c85fc640 1 -- 172.21.15.44:0/1210143210 shutdown_connections 2023-11-04T01:38:42.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.472+0000 7f08c85fc640 1 --2- 172.21.15.44:0/1210143210 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f08ac06ae70 0x7f08ac06d330 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.472+0000 7f08c85fc640 1 --2- 172.21.15.44:0/1210143210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08c015daa0 0x7f08c01e7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.472+0000 7f08c85fc640 1 --2- 172.21.15.44:0/1210143210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08c00ce240 0x7f08c01f6330 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.472+0000 7f08c85fc640 1 --2- 172.21.15.44:0/1210143210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08c00cde60 0x7f08c01554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.472+0000 7f08c85fc640 1 -- 172.21.15.44:0/1210143210 >> 172.21.15.44:0/1210143210 conn(0x7f08c0071f30 msgr2=0x7f08c00b6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:42.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.472+0000 7f08c85fc640 1 -- 172.21.15.44:0/1210143210 shutdown_connections 2023-11-04T01:38:42.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.472+0000 7f08c85fc640 1 -- 172.21.15.44:0/1210143210 wait complete. 2023-11-04T01:38:42.485 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:38:20.738739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:38:21.109334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:34.917670+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:35.547044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:42.486 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:42.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.592+0000 7f6183597640 1 Processor -- start 2023-11-04T01:38:42.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.593+0000 7f6183597640 1 -- start start 2023-11-04T01:38:42.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.593+0000 7f6183597640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f617c153e60 0x7f617c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.593+0000 7f6183597640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f617c0cd6d0 0x7f617c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.593+0000 7f6183597640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f617c0b4880 0x7f617c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.593+0000 7f6183597640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617c0cde60 con 0x7f617c0cd6d0 2023-11-04T01:38:42.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.593+0000 7f6183597640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617c160f90 con 0x7f617c0b4880 2023-11-04T01:38:42.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.593+0000 7f6183597640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0b5200 con 0x7f617c153e60 2023-11-04T01:38:42.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.593+0000 7f6180b32640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f617c0cd6d0 0x7f617c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.594+0000 7f6180b32640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f617c0cd6d0 0x7f617c161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37954/0 (socket says 172.21.15.44:37954) 2023-11-04T01:38:42.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.594+0000 7f6180b32640 1 -- 172.21.15.44:0/1487749031 learned_addr learned my addr 172.21.15.44:0/1487749031 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:42.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.594+0000 7f6181b34640 1 --2- 172.21.15.44:0/1487749031 >> v2:172.21.15.204:3300/0 conn(0x7f617c0b4880 0x7f617c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.594+0000 7f6181333640 1 --2- 172.21.15.44:0/1487749031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f617c153e60 0x7f617c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.594+0000 7f6180b32640 1 -- 172.21.15.44:0/1487749031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f617c153e60 msgr2=0x7f617c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:42.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.594+0000 7f6180b32640 1 --2- 172.21.15.44:0/1487749031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f617c153e60 0x7f617c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.594+0000 7f6180b32640 1 -- 172.21.15.44:0/1487749031 >> v2:172.21.15.204:3300/0 conn(0x7f617c0b4880 msgr2=0x7f617c0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:42.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.594+0000 7f6180b32640 1 --2- 172.21.15.44:0/1487749031 >> v2:172.21.15.204:3300/0 conn(0x7f617c0b4880 0x7f617c0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.594+0000 7f6180b32640 1 -- 172.21.15.44:0/1487749031 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c15e400 con 0x7f617c0cd6d0 2023-11-04T01:38:42.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.594+0000 7f6181333640 1 --2- 172.21.15.44:0/1487749031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f617c153e60 0x7f617c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:42.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.595+0000 7f6180b32640 1 --2- 172.21.15.44:0/1487749031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f617c0cd6d0 0x7f617c161420 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f617c0c9e50 tx=0x7f616c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1787e22fd6064baa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.595+0000 7f6173fff640 1 -- 172.21.15.44:0/1487749031 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c031860 con 0x7f617c0cd6d0 2023-11-04T01:38:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.595+0000 7f6173fff640 1 -- 172.21.15.44:0/1487749031 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c0319c0 con 0x7f617c0cd6d0 2023-11-04T01:38:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.595+0000 7f6173fff640 1 -- 172.21.15.44:0/1487749031 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c031d50 con 0x7f617c0cd6d0 2023-11-04T01:38:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.595+0000 7f6183597640 1 -- 172.21.15.44:0/1487749031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f617c0cd6d0 msgr2=0x7f617c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.595+0000 7f6183597640 1 --2- 172.21.15.44:0/1487749031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f617c0cd6d0 0x7f617c161420 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f617c0c9e50 tx=0x7f616c02b900 comp rx=0 tx=0).stop 2023-11-04T01:38:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.595+0000 7f6183597640 1 -- 172.21.15.44:0/1487749031 shutdown_connections 2023-11-04T01:38:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.595+0000 7f6183597640 1 --2- 172.21.15.44:0/1487749031 >> v2:172.21.15.204:3300/0 conn(0x7f617c0b4880 0x7f617c0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.595+0000 7f6183597640 1 --2- 172.21.15.44:0/1487749031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f617c0cd6d0 0x7f617c161420 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.595+0000 7f6183597640 1 --2- 172.21.15.44:0/1487749031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f617c153e60 0x7f617c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.595+0000 7f6183597640 1 -- 172.21.15.44:0/1487749031 >> 172.21.15.44:0/1487749031 conn(0x7f617c0cf880 msgr2=0x7f617c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.595+0000 7f6183597640 1 -- 172.21.15.44:0/1487749031 shutdown_connections 2023-11-04T01:38:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.595+0000 7f6183597640 1 -- 172.21.15.44:0/1487749031 wait complete. 2023-11-04T01:38:42.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.596+0000 7f6183597640 1 Processor -- start 2023-11-04T01:38:42.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.597+0000 7f6183597640 1 -- start start 2023-11-04T01:38:42.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.597+0000 7f6183597640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f617c0b4880 0x7f617c150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.597+0000 7f6183597640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f617c0cd6d0 0x7f617c1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.597+0000 7f6183597640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f617c153e60 0x7f617c159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.597+0000 7f6183597640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0b6100 con 0x7f617c0b4880 2023-11-04T01:38:42.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.597+0000 7f6183597640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c158a10 con 0x7f617c0cd6d0 2023-11-04T01:38:42.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.597+0000 7f6183597640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c158cf0 con 0x7f617c153e60 2023-11-04T01:38:42.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.597+0000 7f6181333640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f617c0b4880 0x7f617c150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.597+0000 7f6181333640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f617c0b4880 0x7f617c150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37964/0 (socket says 172.21.15.44:37964) 2023-11-04T01:38:42.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.597+0000 7f6181333640 1 -- 172.21.15.44:0/3176409736 learned_addr learned my addr 172.21.15.44:0/3176409736 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:42.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.598+0000 7f6181b34640 1 --2- 172.21.15.44:0/3176409736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f617c153e60 0x7f617c159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.598+0000 7f6180b32640 1 --2- 172.21.15.44:0/3176409736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f617c0cd6d0 0x7f617c1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.598+0000 7f6181333640 1 -- 172.21.15.44:0/3176409736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f617c153e60 msgr2=0x7f617c159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.598+0000 7f6181333640 1 --2- 172.21.15.44:0/3176409736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f617c153e60 0x7f617c159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.598+0000 7f6181333640 1 -- 172.21.15.44:0/3176409736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f617c0cd6d0 msgr2=0x7f617c1569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.598+0000 7f6181333640 1 --2- 172.21.15.44:0/3176409736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f617c0cd6d0 0x7f617c1569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.598+0000 7f6181333640 1 -- 172.21.15.44:0/3176409736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0094d0 con 0x7f617c0b4880 2023-11-04T01:38:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.598+0000 7f6181333640 1 --2- 172.21.15.44:0/3176409736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f617c0b4880 0x7f617c150300 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f617800d7d0 tx=0x7f617800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.598+0000 7f6171ffb640 1 -- 172.21.15.44:0/3176409736 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6178004030 con 0x7f617c0b4880 2023-11-04T01:38:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.598+0000 7f6171ffb640 1 -- 172.21.15.44:0/3176409736 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6178004190 con 0x7f617c0b4880 2023-11-04T01:38:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.598+0000 7f6171ffb640 1 -- 172.21.15.44:0/3176409736 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6178004520 con 0x7f617c0b4880 2023-11-04T01:38:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.598+0000 7f6183597640 1 -- 172.21.15.44:0/3176409736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c158fd0 con 0x7f617c0b4880 2023-11-04T01:38:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.598+0000 7f6183597640 1 -- 172.21.15.44:0/3176409736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c156f00 con 0x7f617c0b4880 2023-11-04T01:38:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.599+0000 7f6183597640 1 -- 172.21.15.44:0/3176409736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c074290 con 0x7f617c0b4880 2023-11-04T01:38:42.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.600+0000 7f6171ffb640 1 -- 172.21.15.44:0/3176409736 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61780096a0 con 0x7f617c0b4880 2023-11-04T01:38:42.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.600+0000 7f6171ffb640 1 --2- 172.21.15.44:0/3176409736 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f616006ae70 0x7f616006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.600+0000 7f6171ffb640 1 -- 172.21.15.44:0/3176409736 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f6178089cd0 con 0x7f617c0b4880 2023-11-04T01:38:42.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.600+0000 7f6180b32640 1 --2- 172.21.15.44:0/3176409736 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f616006ae70 0x7f616006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.601+0000 7f6180b32640 1 --2- 172.21.15.44:0/3176409736 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f616006ae70 0x7f616006d330 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f616c036000 tx=0x7f616c03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.604+0000 7f6171ffb640 1 -- 172.21.15.44:0/3176409736 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6178054870 con 0x7f617c0b4880 2023-11-04T01:38:42.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.782+0000 7f6183597640 1 -- 172.21.15.44:0/3176409736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f617c0d0b80 con 0x7f617c0b4880 2023-11-04T01:38:42.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.783+0000 7f6171ffb640 1 -- 172.21.15.44:0/3176409736 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6178057e90 con 0x7f617c0b4880 2023-11-04T01:38:42.785 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:38:42.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.785+0000 7f6183597640 1 -- 172.21.15.44:0/3176409736 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f616006ae70 msgr2=0x7f616006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.785+0000 7f6183597640 1 --2- 172.21.15.44:0/3176409736 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f616006ae70 0x7f616006d330 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f616c036000 tx=0x7f616c03c040 comp rx=0 tx=0).stop 2023-11-04T01:38:42.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.785+0000 7f6183597640 1 -- 172.21.15.44:0/3176409736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f617c0b4880 msgr2=0x7f617c150300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.785+0000 7f6183597640 1 --2- 172.21.15.44:0/3176409736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f617c0b4880 0x7f617c150300 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f617800d7d0 tx=0x7f617800dc90 comp rx=0 tx=0).stop 2023-11-04T01:38:42.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.785+0000 7f6183597640 1 -- 172.21.15.44:0/3176409736 shutdown_connections 2023-11-04T01:38:42.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.785+0000 7f6183597640 1 --2- 172.21.15.44:0/3176409736 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f616006ae70 0x7f616006d330 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.785+0000 7f6183597640 1 --2- 172.21.15.44:0/3176409736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f617c153e60 0x7f617c159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.785+0000 7f6183597640 1 --2- 172.21.15.44:0/3176409736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f617c0cd6d0 0x7f617c1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.785+0000 7f6183597640 1 --2- 172.21.15.44:0/3176409736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f617c0b4880 0x7f617c150300 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.785+0000 7f6183597640 1 -- 172.21.15.44:0/3176409736 >> 172.21.15.44:0/3176409736 conn(0x7f617c0cf880 msgr2=0x7f617c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:42.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.785+0000 7f6183597640 1 -- 172.21.15.44:0/3176409736 shutdown_connections 2023-11-04T01:38:42.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.785+0000 7f6183597640 1 -- 172.21.15.44:0/3176409736 wait complete. 2023-11-04T01:38:42.798 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:42.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.904+0000 7ff2aeea2640 1 Processor -- start 2023-11-04T01:38:42.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.904+0000 7ff2aeea2640 1 -- start start 2023-11-04T01:38:42.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.905+0000 7ff2aeea2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff2a8153e60 0x7ff2a815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.905+0000 7ff2aeea2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff2a80cd6d0 0x7ff2a8161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.905+0000 7ff2aeea2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2a80b4880 0x7ff2a80b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.905+0000 7ff2aeea2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a80cde60 con 0x7ff2a80cd6d0 2023-11-04T01:38:42.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.905+0000 7ff2aeea2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a80b5220 con 0x7ff2a8153e60 2023-11-04T01:38:42.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.905+0000 7ff2aeea2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a8160f90 con 0x7ff2a80b4880 2023-11-04T01:38:42.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.905+0000 7ff2a7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff2a80cd6d0 0x7ff2a8161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.905+0000 7ff2a7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff2a80cd6d0 0x7ff2a8161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37976/0 (socket says 172.21.15.44:37976) 2023-11-04T01:38:42.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.905+0000 7ff2a7fff640 1 -- 172.21.15.44:0/1693297214 learned_addr learned my addr 172.21.15.44:0/1693297214 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:42.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.906+0000 7ff2ad43f640 1 --2- 172.21.15.44:0/1693297214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2a80b4880 0x7ff2a80b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.906+0000 7ff2acc3e640 1 --2- 172.21.15.44:0/1693297214 >> v2:172.21.15.204:3300/0 conn(0x7ff2a8153e60 0x7ff2a815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.906+0000 7ff2a7fff640 1 -- 172.21.15.44:0/1693297214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2a80b4880 msgr2=0x7ff2a80b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:42.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.906+0000 7ff2a7fff640 1 --2- 172.21.15.44:0/1693297214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2a80b4880 0x7ff2a80b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.906+0000 7ff2a7fff640 1 -- 172.21.15.44:0/1693297214 >> v2:172.21.15.204:3300/0 conn(0x7ff2a8153e60 msgr2=0x7ff2a815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:42.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.906+0000 7ff2a7fff640 1 --2- 172.21.15.44:0/1693297214 >> v2:172.21.15.204:3300/0 conn(0x7ff2a8153e60 0x7ff2a815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.906+0000 7ff2a7fff640 1 -- 172.21.15.44:0/1693297214 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a815e400 con 0x7ff2a80cd6d0 2023-11-04T01:38:42.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.906+0000 7ff2a7fff640 1 --2- 172.21.15.44:0/1693297214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a80cd6d0 0x7ff2a8161420 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7ff2a808abe0 tx=0x7ff29c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1164046d356507c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.907+0000 7ff2a77fe640 1 -- 172.21.15.44:0/1693297214 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c031640 con 0x7ff2a80cd6d0 2023-11-04T01:38:42.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.907+0000 7ff2a77fe640 1 -- 172.21.15.44:0/1693297214 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c0317a0 con 0x7ff2a80cd6d0 2023-11-04T01:38:42.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.907+0000 7ff2a77fe640 1 -- 172.21.15.44:0/1693297214 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c031b30 con 0x7ff2a80cd6d0 2023-11-04T01:38:42.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.907+0000 7ff2aeea2640 1 -- 172.21.15.44:0/1693297214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a80cd6d0 msgr2=0x7ff2a8161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.907+0000 7ff2aeea2640 1 --2- 172.21.15.44:0/1693297214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a80cd6d0 0x7ff2a8161420 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7ff2a808abe0 tx=0x7ff29c02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.907+0000 7ff2aeea2640 1 -- 172.21.15.44:0/1693297214 shutdown_connections 2023-11-04T01:38:42.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.907+0000 7ff2aeea2640 1 --2- 172.21.15.44:0/1693297214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2a80b4880 0x7ff2a80b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.907+0000 7ff2aeea2640 1 --2- 172.21.15.44:0/1693297214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a80cd6d0 0x7ff2a8161420 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.907+0000 7ff2aeea2640 1 --2- 172.21.15.44:0/1693297214 >> v2:172.21.15.204:3300/0 conn(0x7ff2a8153e60 0x7ff2a815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.907+0000 7ff2aeea2640 1 -- 172.21.15.44:0/1693297214 >> 172.21.15.44:0/1693297214 conn(0x7ff2a80cf880 msgr2=0x7ff2a80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:42.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.907+0000 7ff2aeea2640 1 -- 172.21.15.44:0/1693297214 shutdown_connections 2023-11-04T01:38:42.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.907+0000 7ff2aeea2640 1 -- 172.21.15.44:0/1693297214 wait complete. 2023-11-04T01:38:42.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.908+0000 7ff2aeea2640 1 Processor -- start 2023-11-04T01:38:42.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.908+0000 7ff2aeea2640 1 -- start start 2023-11-04T01:38:42.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.909+0000 7ff2aeea2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2a80b4880 0x7ff2a81e7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.909+0000 7ff2aeea2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2a80cd6d0 0x7ff2a8157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.909+0000 7ff2aeea2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a8153e60 0x7ff2a81580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.909+0000 7ff2aeea2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a81e8d50 con 0x7ff2a8153e60 2023-11-04T01:38:42.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.909+0000 7ff2aeea2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a81e80d0 con 0x7ff2a80cd6d0 2023-11-04T01:38:42.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.909+0000 7ff2aeea2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a81e83b0 con 0x7ff2a80b4880 2023-11-04T01:38:42.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.909+0000 7ff2ad43f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a8153e60 0x7ff2a81580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.909+0000 7ff2ad43f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a8153e60 0x7ff2a81580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37990/0 (socket says 172.21.15.44:37990) 2023-11-04T01:38:42.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.909+0000 7ff2ad43f640 1 -- 172.21.15.44:0/1336469916 learned_addr learned my addr 172.21.15.44:0/1336469916 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:42.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.909+0000 7ff2a7fff640 1 --2- 172.21.15.44:0/1336469916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2a80cd6d0 0x7ff2a8157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.909+0000 7ff2acc3e640 1 --2- 172.21.15.44:0/1336469916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2a80b4880 0x7ff2a81e7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.910+0000 7ff2ad43f640 1 -- 172.21.15.44:0/1336469916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2a80b4880 msgr2=0x7ff2a81e7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.910+0000 7ff2ad43f640 1 --2- 172.21.15.44:0/1336469916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2a80b4880 0x7ff2a81e7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.910+0000 7ff2ad43f640 1 -- 172.21.15.44:0/1336469916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2a80cd6d0 msgr2=0x7ff2a8157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.910+0000 7ff2ad43f640 1 --2- 172.21.15.44:0/1336469916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2a80cd6d0 0x7ff2a8157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.910+0000 7ff2ad43f640 1 -- 172.21.15.44:0/1336469916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c0094d0 con 0x7ff2a8153e60 2023-11-04T01:38:42.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.910+0000 7ff2ad43f640 1 --2- 172.21.15.44:0/1336469916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a8153e60 0x7ff2a81580b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff29800d800 tx=0x7ff29800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.910+0000 7ff2a57fa640 1 -- 172.21.15.44:0/1336469916 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980096c0 con 0x7ff2a8153e60 2023-11-04T01:38:42.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.910+0000 7ff2a57fa640 1 -- 172.21.15.44:0/1336469916 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff298009840 con 0x7ff2a8153e60 2023-11-04T01:38:42.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.910+0000 7ff2aeea2640 1 -- 172.21.15.44:0/1336469916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a81e8690 con 0x7ff2a8153e60 2023-11-04T01:38:42.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.910+0000 7ff2a57fa640 1 -- 172.21.15.44:0/1336469916 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298009bf0 con 0x7ff2a8153e60 2023-11-04T01:38:42.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.910+0000 7ff2aeea2640 1 -- 172.21.15.44:0/1336469916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a81e9170 con 0x7ff2a8153e60 2023-11-04T01:38:42.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.911+0000 7ff2aeea2640 1 -- 172.21.15.44:0/1336469916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a81579e0 con 0x7ff2a8153e60 2023-11-04T01:38:42.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.912+0000 7ff2a57fa640 1 -- 172.21.15.44:0/1336469916 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff298009d50 con 0x7ff2a8153e60 2023-11-04T01:38:42.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.912+0000 7ff2a57fa640 1 --2- 172.21.15.44:0/1336469916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff29406aea0 0x7ff29406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.912+0000 7ff2a57fa640 1 -- 172.21.15.44:0/1336469916 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7ff298089e80 con 0x7ff2a8153e60 2023-11-04T01:38:42.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.912+0000 7ff2acc3e640 1 --2- 172.21.15.44:0/1336469916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff29406aea0 0x7ff29406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.913+0000 7ff2acc3e640 1 --2- 172.21.15.44:0/1336469916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff29406aea0 0x7ff29406d360 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0003aa0 tx=0x7ff2a0009830 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:42.916+0000 7ff2a57fa640 1 -- 172.21.15.44:0/1336469916 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff2980549b0 con 0x7ff2a8153e60 2023-11-04T01:38:43.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.090+0000 7ff2aeea2640 1 -- 172.21.15.44:0/1336469916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7ff2a81e8e90 con 0x7ff2a8153e60 2023-11-04T01:38:43.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.090+0000 7ff2a57fa640 1 -- 172.21.15.44:0/1336469916 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v71) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff2a81e8e90 con 0x7ff2a8153e60 2023-11-04T01:38:43.093 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:43.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.092+0000 7ff2aeea2640 1 -- 172.21.15.44:0/1336469916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff29406aea0 msgr2=0x7ff29406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.092+0000 7ff2aeea2640 1 --2- 172.21.15.44:0/1336469916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff29406aea0 0x7ff29406d360 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0003aa0 tx=0x7ff2a0009830 comp rx=0 tx=0).stop 2023-11-04T01:38:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.092+0000 7ff2aeea2640 1 -- 172.21.15.44:0/1336469916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a8153e60 msgr2=0x7ff2a81580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.092+0000 7ff2aeea2640 1 --2- 172.21.15.44:0/1336469916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a8153e60 0x7ff2a81580b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff29800d800 tx=0x7ff29800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.092+0000 7ff2aeea2640 1 -- 172.21.15.44:0/1336469916 shutdown_connections 2023-11-04T01:38:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.092+0000 7ff2aeea2640 1 --2- 172.21.15.44:0/1336469916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff29406aea0 0x7ff29406d360 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.092+0000 7ff2aeea2640 1 --2- 172.21.15.44:0/1336469916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a8153e60 0x7ff2a81580b0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.092+0000 7ff2aeea2640 1 --2- 172.21.15.44:0/1336469916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2a80cd6d0 0x7ff2a8157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.092+0000 7ff2aeea2640 1 --2- 172.21.15.44:0/1336469916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2a80b4880 0x7ff2a81e7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.092+0000 7ff2aeea2640 1 -- 172.21.15.44:0/1336469916 >> 172.21.15.44:0/1336469916 conn(0x7ff2a80cf880 msgr2=0x7ff2a80d25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.092+0000 7ff2aeea2640 1 -- 172.21.15.44:0/1336469916 shutdown_connections 2023-11-04T01:38:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.092+0000 7ff2aeea2640 1 -- 172.21.15.44:0/1336469916 wait complete. 2023-11-04T01:38:43.105 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:38:43.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.212+0000 7fd3f55e2640 1 Processor -- start 2023-11-04T01:38:43.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.212+0000 7fd3f55e2640 1 -- start start 2023-11-04T01:38:43.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.213+0000 7fd3f55e2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3f0070ff0 0x7fd3f00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.213+0000 7fd3f55e2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd3f0066000 0x7fd3f006a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.213+0000 7fd3f55e2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f00c9bf0 con 0x7fd3f015d1b0 2023-11-04T01:38:43.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.213+0000 7fd3f55e2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f00cd890 con 0x7fd3f0066000 2023-11-04T01:38:43.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.213+0000 7fd3f55e2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00cdb30 con 0x7fd3f0070ff0 2023-11-04T01:38:43.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.213+0000 7fd3ee7fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd3f015d1b0 0x7fd3f00713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37406/0 (socket says 172.21.15.44:37406) 2023-11-04T01:38:43.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.213+0000 7fd3ee7fc640 1 -- 172.21.15.44:0/1157548687 learned_addr learned my addr 172.21.15.44:0/1157548687 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:43.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.213+0000 7fd3ef7fe640 1 --2- 172.21.15.44:0/1157548687 >> v2:172.21.15.204:3300/0 conn(0x7fd3f0066000 0x7fd3f006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.213+0000 7fd3edffb640 1 -- 172.21.15.44:0/1157548687 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213497128 0 0) 0x7fd3f00c9bf0 con 0x7fd3f015d1b0 2023-11-04T01:38:43.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.213+0000 7fd3eeffd640 1 --2- 172.21.15.44:0/1157548687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3f0070ff0 0x7fd3f00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.213+0000 7fd3edffb640 1 -- 172.21.15.44:0/1157548687 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3dc003520 con 0x7fd3f015d1b0 2023-11-04T01:38:43.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3edffb640 1 -- 172.21.15.44:0/1157548687 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1102625670 0 0) 0x7fd3dc003520 con 0x7fd3f015d1b0 2023-11-04T01:38:43.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3edffb640 1 -- 172.21.15.44:0/1157548687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3f0070ff0 msgr2=0x7fd3f00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:43.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3edffb640 1 --2- 172.21.15.44:0/1157548687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3f0070ff0 0x7fd3f00cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3edffb640 1 -- 172.21.15.44:0/1157548687 >> v2:172.21.15.204:3300/0 conn(0x7fd3f0066000 msgr2=0x7fd3f006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:43.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3edffb640 1 --2- 172.21.15.44:0/1157548687 >> v2:172.21.15.204:3300/0 conn(0x7fd3f0066000 0x7fd3f006a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3edffb640 1 -- 172.21.15.44:0/1157548687 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f00cde10 con 0x7fd3f015d1b0 2023-11-04T01:38:43.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3edffb640 1 -- 172.21.15.44:0/1157548687 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fd3d8001670 con 0x7fd3f015d1b0 2023-11-04T01:38:43.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3edffb640 1 -- 172.21.15.44:0/1157548687 >> v1:172.21.15.44:6789/0 conn(0x7fd3f015d1b0 legacy=0x7fd3f00713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3edffb640 1 --2- 172.21.15.44:0/1157548687 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3dc003970 0x7fd3dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3edffb640 1 --2- 172.21.15.44:0/1157548687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3dc0047c0 0x7fd3dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3edffb640 1 --2- 172.21.15.44:0/1157548687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3f0070ff0 0x7fd3dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3edffb640 1 -- 172.21.15.44:0/1157548687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00cd890 con 0x7fd3dc0047c0 2023-11-04T01:38:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3edffb640 1 -- 172.21.15.44:0/1157548687 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00cdb30 con 0x7fd3dc003970 2023-11-04T01:38:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3edffb640 1 -- 172.21.15.44:0/1157548687 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc00b980 con 0x7fd3f0070ff0 2023-11-04T01:38:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3ee7fc640 1 --2- 172.21.15.44:0/1157548687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3dc0047c0 0x7fd3dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3eeffd640 1 --2- 172.21.15.44:0/1157548687 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3dc003970 0x7fd3dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3ef7fe640 1 --2- 172.21.15.44:0/1157548687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3f0070ff0 0x7fd3dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3ee7fc640 1 -- 172.21.15.44:0/1157548687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3f0070ff0 msgr2=0x7fd3dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3ee7fc640 1 --2- 172.21.15.44:0/1157548687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3f0070ff0 0x7fd3dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3ee7fc640 1 -- 172.21.15.44:0/1157548687 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3dc003970 msgr2=0x7fd3dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3ee7fc640 1 --2- 172.21.15.44:0/1157548687 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3dc003970 0x7fd3dc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.214+0000 7fd3ee7fc640 1 -- 172.21.15.44:0/1157548687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc003520 con 0x7fd3dc0047c0 2023-11-04T01:38:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.215+0000 7fd3ee7fc640 1 --2- 172.21.15.44:0/1157548687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3dc0047c0 0x7fd3dc004c40 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800c290 tx=0x7fd3dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa18d2afdf3923d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.215+0000 7fd3edffb640 1 -- 172.21.15.44:0/1157548687 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8005ad0 con 0x7fd3dc0047c0 2023-11-04T01:38:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.215+0000 7fd3edffb640 1 -- 172.21.15.44:0/1157548687 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d8005c30 con 0x7fd3dc0047c0 2023-11-04T01:38:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.215+0000 7fd3edffb640 1 -- 172.21.15.44:0/1157548687 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d802c8d0 con 0x7fd3dc0047c0 2023-11-04T01:38:43.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.215+0000 7fd3f55e2640 1 -- 172.21.15.44:0/1157548687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3dc0047c0 msgr2=0x7fd3dc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.215+0000 7fd3f55e2640 1 --2- 172.21.15.44:0/1157548687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3dc0047c0 0x7fd3dc004c40 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800c290 tx=0x7fd3dc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.215+0000 7fd3ef7fe640 1 -- 172.21.15.44:0/1157548687 reap_dead start 2023-11-04T01:38:43.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.215+0000 7fd3f55e2640 1 -- 172.21.15.44:0/1157548687 shutdown_connections 2023-11-04T01:38:43.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.215+0000 7fd3f55e2640 1 -- 172.21.15.44:0/1157548687 >> 172.21.15.44:0/1157548687 conn(0x7fd3f00cbc90 msgr2=0x7fd3f00cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:43.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.216+0000 7fd3f55e2640 1 -- 172.21.15.44:0/1157548687 shutdown_connections 2023-11-04T01:38:43.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.216+0000 7fd3f55e2640 1 -- 172.21.15.44:0/1157548687 wait complete. 2023-11-04T01:38:43.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.217+0000 7fd3f55e2640 1 Processor -- start 2023-11-04T01:38:43.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.217+0000 7fd3f55e2640 1 -- start start 2023-11-04T01:38:43.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3f55e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3dc0047c0 0x7fd3f00c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3f55e2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3f00c7ce0 0x7fd3f00c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3f55e2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3f015bb10 0x7fd3f015bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3f55e2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f0159650 con 0x7fd3dc0047c0 2023-11-04T01:38:43.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3f55e2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f01f33d0 con 0x7fd3f015bb10 2023-11-04T01:38:43.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3f55e2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f01f2850 con 0x7fd3f00c7ce0 2023-11-04T01:38:43.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3eeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3dc0047c0 0x7fd3f00c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3eeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3dc0047c0 0x7fd3f00c2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38018/0 (socket says 172.21.15.44:38018) 2023-11-04T01:38:43.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3eeffd640 1 -- 172.21.15.44:0/39939244 learned_addr learned my addr 172.21.15.44:0/39939244 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:43.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3eeffd640 1 -- 172.21.15.44:0/39939244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3f00c7ce0 msgr2=0x7fd3f00c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3eeffd640 1 --2- 172.21.15.44:0/39939244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3f00c7ce0 0x7fd3f00c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3eeffd640 1 -- 172.21.15.44:0/39939244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3f015bb10 msgr2=0x7fd3f015bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3eeffd640 1 --2- 172.21.15.44:0/39939244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3f015bb10 0x7fd3f015bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3eeffd640 1 -- 172.21.15.44:0/39939244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f01f2b30 con 0x7fd3dc0047c0 2023-11-04T01:38:43.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3eeffd640 1 --2- 172.21.15.44:0/39939244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3dc0047c0 0x7fd3f00c2d40 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80118e0 tx=0x7fd3e8011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3e77fe640 1 -- 172.21.15.44:0/39939244 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e800fa70 con 0x7fd3dc0047c0 2023-11-04T01:38:43.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3e77fe640 1 -- 172.21.15.44:0/39939244 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e800fbd0 con 0x7fd3dc0047c0 2023-11-04T01:38:43.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3e77fe640 1 -- 172.21.15.44:0/39939244 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8014440 con 0x7fd3dc0047c0 2023-11-04T01:38:43.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3f55e2640 1 -- 172.21.15.44:0/39939244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f01f2e10 con 0x7fd3dc0047c0 2023-11-04T01:38:43.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.218+0000 7fd3f55e2640 1 -- 172.21.15.44:0/39939244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f00c3280 con 0x7fd3dc0047c0 2023-11-04T01:38:43.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.219+0000 7fd3f55e2640 1 -- 172.21.15.44:0/39939244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f0074290 con 0x7fd3dc0047c0 2023-11-04T01:38:43.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.220+0000 7fd3e77fe640 1 -- 172.21.15.44:0/39939244 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3e80145a0 con 0x7fd3dc0047c0 2023-11-04T01:38:43.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.220+0000 7fd3e77fe640 1 --2- 172.21.15.44:0/39939244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3d006aea0 0x7fd3d006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.220+0000 7fd3e77fe640 1 -- 172.21.15.44:0/39939244 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fd3e808a3a0 con 0x7fd3dc0047c0 2023-11-04T01:38:43.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.221+0000 7fd3ee7fc640 1 --2- 172.21.15.44:0/39939244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3d006aea0 0x7fd3d006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.221+0000 7fd3ee7fc640 1 --2- 172.21.15.44:0/39939244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3d006aea0 0x7fd3d006d360 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8034000 tx=0x7fd3d802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.225+0000 7fd3e77fe640 1 -- 172.21.15.44:0/39939244 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd3e8054e20 con 0x7fd3dc0047c0 2023-11-04T01:38:43.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.399+0000 7fd3f55e2640 1 -- 172.21.15.44:0/39939244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3f0066570 con 0x7fd3dc0047c0 2023-11-04T01:38:43.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.400+0000 7fd3e77fe640 1 -- 172.21.15.44:0/39939244 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd3e8058440 con 0x7fd3dc0047c0 2023-11-04T01:38:43.402 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:43.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.402+0000 7fd3f55e2640 1 -- 172.21.15.44:0/39939244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3d006aea0 msgr2=0x7fd3d006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.402+0000 7fd3f55e2640 1 --2- 172.21.15.44:0/39939244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3d006aea0 0x7fd3d006d360 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8034000 tx=0x7fd3d802e000 comp rx=0 tx=0).stop 2023-11-04T01:38:43.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.402+0000 7fd3f55e2640 1 -- 172.21.15.44:0/39939244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3dc0047c0 msgr2=0x7fd3f00c2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.402+0000 7fd3f55e2640 1 --2- 172.21.15.44:0/39939244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3dc0047c0 0x7fd3f00c2d40 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80118e0 tx=0x7fd3e8011da0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.402+0000 7fd3f55e2640 1 -- 172.21.15.44:0/39939244 shutdown_connections 2023-11-04T01:38:43.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.402+0000 7fd3f55e2640 1 --2- 172.21.15.44:0/39939244 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3d006aea0 0x7fd3d006d360 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.402+0000 7fd3f55e2640 1 --2- 172.21.15.44:0/39939244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3f015bb10 0x7fd3f015bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.402+0000 7fd3f55e2640 1 --2- 172.21.15.44:0/39939244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3f00c7ce0 0x7fd3f00c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.402+0000 7fd3f55e2640 1 --2- 172.21.15.44:0/39939244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3dc0047c0 0x7fd3f00c2d40 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.402+0000 7fd3f55e2640 1 -- 172.21.15.44:0/39939244 >> 172.21.15.44:0/39939244 conn(0x7fd3f00cbc90 msgr2=0x7fd3f015d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:43.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.402+0000 7fd3f55e2640 1 -- 172.21.15.44:0/39939244 shutdown_connections 2023-11-04T01:38:43.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.402+0000 7fd3f55e2640 1 -- 172.21.15.44:0/39939244 wait complete. 2023-11-04T01:38:43.415 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:38:43.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.521+0000 7ffa1c015640 1 Processor -- start 2023-11-04T01:38:43.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.522+0000 7ffa1c015640 1 -- start start 2023-11-04T01:38:43.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.522+0000 7ffa1c015640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ffa14153e60 0x7ffa1415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.522+0000 7ffa1c015640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa140cd6d0 0x7ffa14161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.522+0000 7ffa1c015640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa140cde60 con 0x7ffa140b4880 2023-11-04T01:38:43.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.522+0000 7ffa1c015640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa14160f90 con 0x7ffa14153e60 2023-11-04T01:38:43.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.522+0000 7ffa1c015640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1415e400 con 0x7ffa140cd6d0 2023-11-04T01:38:43.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.523+0000 7ffa1a5b2640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ffa140b4880 0x7ffa140b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37412/0 (socket says 172.21.15.44:37412) 2023-11-04T01:38:43.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.523+0000 7ffa1a5b2640 1 -- 172.21.15.44:0/3655438673 learned_addr learned my addr 172.21.15.44:0/3655438673 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.523+0000 7ffa19db1640 1 --2- 172.21.15.44:0/3655438673 >> v2:172.21.15.204:3300/0 conn(0x7ffa14153e60 0x7ffa1415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.523+0000 7ffa195b0640 1 --2- 172.21.15.44:0/3655438673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa140cd6d0 0x7ffa14161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.523+0000 7ffa18daf640 1 -- 172.21.15.44:0/3655438673 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405832227 0 0) 0x7ffa140cde60 con 0x7ffa140b4880 2023-11-04T01:38:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.523+0000 7ffa18daf640 1 -- 172.21.15.44:0/3655438673 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa00003520 con 0x7ffa140b4880 2023-11-04T01:38:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.523+0000 7ffa195b0640 1 -- 172.21.15.44:0/3655438673 >> v2:172.21.15.204:3300/0 conn(0x7ffa14153e60 msgr2=0x7ffa1415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.523+0000 7ffa195b0640 1 --2- 172.21.15.44:0/3655438673 >> v2:172.21.15.204:3300/0 conn(0x7ffa14153e60 0x7ffa1415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.523+0000 7ffa195b0640 1 -- 172.21.15.44:0/3655438673 >> v1:172.21.15.44:6789/0 conn(0x7ffa140b4880 legacy=0x7ffa140b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.523+0000 7ffa195b0640 1 -- 172.21.15.44:0/3655438673 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa14161960 con 0x7ffa140cd6d0 2023-11-04T01:38:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.523+0000 7ffa19db1640 1 --2- 172.21.15.44:0/3655438673 >> v2:172.21.15.204:3300/0 conn(0x7ffa14153e60 0x7ffa1415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:43.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.524+0000 7ffa195b0640 1 --2- 172.21.15.44:0/3655438673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa140cd6d0 0x7ffa14161420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa040097a0 tx=0x7ffa0402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23a2aa048a061aa7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.524+0000 7ffa18daf640 1 -- 172.21.15.44:0/3655438673 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04031830 con 0x7ffa140cd6d0 2023-11-04T01:38:43.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.524+0000 7ffa18daf640 1 -- 172.21.15.44:0/3655438673 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04031990 con 0x7ffa140cd6d0 2023-11-04T01:38:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.524+0000 7ffa18daf640 1 -- 172.21.15.44:0/3655438673 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04031d00 con 0x7ffa140cd6d0 2023-11-04T01:38:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.525+0000 7ffa1c015640 1 -- 172.21.15.44:0/3655438673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa140cd6d0 msgr2=0x7ffa14161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.525+0000 7ffa1c015640 1 --2- 172.21.15.44:0/3655438673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa140cd6d0 0x7ffa14161420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa040097a0 tx=0x7ffa0402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.525+0000 7ffa1c015640 1 -- 172.21.15.44:0/3655438673 shutdown_connections 2023-11-04T01:38:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.525+0000 7ffa1c015640 1 --2- 172.21.15.44:0/3655438673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa140cd6d0 0x7ffa14161420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.525+0000 7ffa1c015640 1 --2- 172.21.15.44:0/3655438673 >> v2:172.21.15.204:3300/0 conn(0x7ffa14153e60 0x7ffa1415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.525+0000 7ffa1c015640 1 -- 172.21.15.44:0/3655438673 >> 172.21.15.44:0/3655438673 conn(0x7ffa140cf880 msgr2=0x7ffa140cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.525+0000 7ffa1c015640 1 -- 172.21.15.44:0/3655438673 shutdown_connections 2023-11-04T01:38:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.525+0000 7ffa1c015640 1 -- 172.21.15.44:0/3655438673 wait complete. 2023-11-04T01:38:43.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.526+0000 7ffa1c015640 1 Processor -- start 2023-11-04T01:38:43.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.526+0000 7ffa1c015640 1 -- start start 2023-11-04T01:38:43.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa1c015640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa140b4880 0x7ffa141f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa1c015640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa140cd6d0 0x7ffa1415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa1c015640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffa14153e60 0x7ffa141f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa1c015640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1415a880 con 0x7ffa140cd6d0 2023-11-04T01:38:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa1c015640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa14158cd0 con 0x7ffa14153e60 2023-11-04T01:38:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa1c015640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa14154370 con 0x7ffa140b4880 2023-11-04T01:38:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa195b0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa140cd6d0 0x7ffa1415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa195b0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa140cd6d0 0x7ffa1415a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38024/0 (socket says 172.21.15.44:38024) 2023-11-04T01:38:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa195b0640 1 -- 172.21.15.44:0/3742457929 learned_addr learned my addr 172.21.15.44:0/3742457929 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa19db1640 1 --2- 172.21.15.44:0/3742457929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa140b4880 0x7ffa141f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa1a5b2640 1 --2- 172.21.15.44:0/3742457929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffa14153e60 0x7ffa141f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa195b0640 1 -- 172.21.15.44:0/3742457929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa140b4880 msgr2=0x7ffa141f6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa195b0640 1 --2- 172.21.15.44:0/3742457929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa140b4880 0x7ffa141f6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa195b0640 1 -- 172.21.15.44:0/3742457929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffa14153e60 msgr2=0x7ffa141f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa195b0640 1 --2- 172.21.15.44:0/3742457929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffa14153e60 0x7ffa141f5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa195b0640 1 -- 172.21.15.44:0/3742457929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa10009400 con 0x7ffa140cd6d0 2023-11-04T01:38:43.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa195b0640 1 --2- 172.21.15.44:0/3742457929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa140cd6d0 0x7ffa1415a340 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ffa040098c0 tx=0x7ffa040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.527+0000 7ffa0a7fc640 1 -- 172.21.15.44:0/3742457929 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0403a630 con 0x7ffa140cd6d0 2023-11-04T01:38:43.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.528+0000 7ffa0a7fc640 1 -- 172.21.15.44:0/3742457929 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0403a790 con 0x7ffa140cd6d0 2023-11-04T01:38:43.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.528+0000 7ffa1c015640 1 -- 172.21.15.44:0/3742457929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa04009400 con 0x7ffa140cd6d0 2023-11-04T01:38:43.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.528+0000 7ffa0a7fc640 1 -- 172.21.15.44:0/3742457929 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0403ab40 con 0x7ffa140cd6d0 2023-11-04T01:38:43.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.528+0000 7ffa1c015640 1 -- 172.21.15.44:0/3742457929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa14158f20 con 0x7ffa140cd6d0 2023-11-04T01:38:43.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.529+0000 7ffa1c015640 1 -- 172.21.15.44:0/3742457929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa14074290 con 0x7ffa140cd6d0 2023-11-04T01:38:43.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.529+0000 7ffa0a7fc640 1 -- 172.21.15.44:0/3742457929 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa0403aca0 con 0x7ffa140cd6d0 2023-11-04T01:38:43.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.529+0000 7ffa0a7fc640 1 --2- 172.21.15.44:0/3742457929 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff9f806ae70 0x7ff9f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.530+0000 7ffa0a7fc640 1 -- 172.21.15.44:0/3742457929 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7ffa040ab9b0 con 0x7ffa140cd6d0 2023-11-04T01:38:43.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.530+0000 7ffa19db1640 1 --2- 172.21.15.44:0/3742457929 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff9f806ae70 0x7ff9f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.530+0000 7ffa19db1640 1 --2- 172.21.15.44:0/3742457929 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff9f806ae70 0x7ff9f806d330 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009ae0 tx=0x7ffa10008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.534+0000 7ffa0a7fc640 1 -- 172.21.15.44:0/3742457929 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffa040765d0 con 0x7ffa140cd6d0 2023-11-04T01:38:43.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.708+0000 7ffa1c015640 1 -- 172.21.15.44:0/3742457929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa140d0b80 con 0x7ffa140cd6d0 2023-11-04T01:38:43.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.709+0000 7ffa0a7fc640 1 -- 172.21.15.44:0/3742457929 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffa04035020 con 0x7ffa140cd6d0 2023-11-04T01:38:43.711 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:38:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.711+0000 7ffa1c015640 1 -- 172.21.15.44:0/3742457929 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff9f806ae70 msgr2=0x7ff9f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.711+0000 7ffa1c015640 1 --2- 172.21.15.44:0/3742457929 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff9f806ae70 0x7ff9f806d330 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009ae0 tx=0x7ffa10008040 comp rx=0 tx=0).stop 2023-11-04T01:38:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.711+0000 7ffa1c015640 1 -- 172.21.15.44:0/3742457929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa140cd6d0 msgr2=0x7ffa1415a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.711+0000 7ffa1c015640 1 --2- 172.21.15.44:0/3742457929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa140cd6d0 0x7ffa1415a340 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ffa040098c0 tx=0x7ffa040046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.711+0000 7ffa1c015640 1 -- 172.21.15.44:0/3742457929 shutdown_connections 2023-11-04T01:38:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.711+0000 7ffa1c015640 1 --2- 172.21.15.44:0/3742457929 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff9f806ae70 0x7ff9f806d330 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.711+0000 7ffa1c015640 1 --2- 172.21.15.44:0/3742457929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffa14153e60 0x7ffa141f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.711+0000 7ffa1c015640 1 --2- 172.21.15.44:0/3742457929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa140cd6d0 0x7ffa1415a340 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.711+0000 7ffa1c015640 1 --2- 172.21.15.44:0/3742457929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa140b4880 0x7ffa141f6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.711+0000 7ffa1c015640 1 -- 172.21.15.44:0/3742457929 >> 172.21.15.44:0/3742457929 conn(0x7ffa140cf880 msgr2=0x7ffa140d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:43.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.711+0000 7ffa1c015640 1 -- 172.21.15.44:0/3742457929 shutdown_connections 2023-11-04T01:38:43.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.711+0000 7ffa1c015640 1 -- 172.21.15.44:0/3742457929 wait complete. 2023-11-04T01:38:43.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:38:43.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.831+0000 7fd830eec640 1 Processor -- start 2023-11-04T01:38:43.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.831+0000 7fd830eec640 1 -- start start 2023-11-04T01:38:43.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.831+0000 7fd830eec640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd82c0ca0a0 0x7fd82c0cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.831+0000 7fd830eec640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd82c0cc300 0x7fd82c0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.831+0000 7fd830eec640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82c0caa20 con 0x7fd82c15e3f0 2023-11-04T01:38:43.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.831+0000 7fd830eec640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82c0b3300 con 0x7fd82c0cc300 2023-11-04T01:38:43.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.831+0000 7fd830eec640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c0cb230 con 0x7fd82c0ca0a0 2023-11-04T01:38:43.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.832+0000 7fd82ad9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd82c0cc300 0x7fd82c0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.832+0000 7fd82a59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd82c15e3f0 0x7fd82c0b2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37422/0 (socket says 172.21.15.44:37422) 2023-11-04T01:38:43.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.832+0000 7fd82a59c640 1 -- 172.21.15.44:0/2001001148 learned_addr learned my addr 172.21.15.44:0/2001001148 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:43.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.832+0000 7fd823fff640 1 --2- 172.21.15.44:0/2001001148 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd82c0ca0a0 0x7fd82c0cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.832+0000 7fd82ad9d640 1 -- 172.21.15.44:0/2001001148 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd82c0ca0a0 msgr2=0x7fd82c0cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:43.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.832+0000 7fd82ad9d640 1 --2- 172.21.15.44:0/2001001148 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd82c0ca0a0 0x7fd82c0cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.832+0000 7fd82ad9d640 1 -- 172.21.15.44:0/2001001148 >> v1:172.21.15.44:6789/0 conn(0x7fd82c15e3f0 legacy=0x7fd82c0b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.832+0000 7fd82ad9d640 1 -- 172.21.15.44:0/2001001148 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c0ca530 con 0x7fd82c0cc300 2023-11-04T01:38:43.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.832+0000 7fd829d9b640 1 -- 172.21.15.44:0/2001001148 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949613537 0 0) 0x7fd82c0caa20 con 0x7fd82c15e3f0 2023-11-04T01:38:43.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.833+0000 7fd82ad9d640 1 --2- 172.21.15.44:0/2001001148 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd82c0cc300 0x7fd82c0cce60 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd824009d90 tx=0x7fd82402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6ffe0f7b62b609 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.833+0000 7fd829d9b640 1 -- 172.21.15.44:0/2001001148 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82402cc50 con 0x7fd82c0cc300 2023-11-04T01:38:43.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.833+0000 7fd829d9b640 1 -- 172.21.15.44:0/2001001148 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82402cdb0 con 0x7fd82c0cc300 2023-11-04T01:38:43.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.833+0000 7fd829d9b640 1 -- 172.21.15.44:0/2001001148 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824034660 con 0x7fd82c0cc300 2023-11-04T01:38:43.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.833+0000 7fd830eec640 1 -- 172.21.15.44:0/2001001148 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd82c0cc300 msgr2=0x7fd82c0cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.833+0000 7fd830eec640 1 --2- 172.21.15.44:0/2001001148 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd82c0cc300 0x7fd82c0cce60 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd824009d90 tx=0x7fd82402bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.833+0000 7fd830eec640 1 -- 172.21.15.44:0/2001001148 shutdown_connections 2023-11-04T01:38:43.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.833+0000 7fd830eec640 1 --2- 172.21.15.44:0/2001001148 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd82c0cc300 0x7fd82c0cce60 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.833+0000 7fd830eec640 1 --2- 172.21.15.44:0/2001001148 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd82c0ca0a0 0x7fd82c0cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.833+0000 7fd830eec640 1 -- 172.21.15.44:0/2001001148 >> 172.21.15.44:0/2001001148 conn(0x7fd82c071820 msgr2=0x7fd82c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:43.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.833+0000 7fd830eec640 1 -- 172.21.15.44:0/2001001148 shutdown_connections 2023-11-04T01:38:43.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.833+0000 7fd830eec640 1 -- 172.21.15.44:0/2001001148 wait complete. 2023-11-04T01:38:43.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.835+0000 7fd830eec640 1 Processor -- start 2023-11-04T01:38:43.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.835+0000 7fd830eec640 1 -- start start 2023-11-04T01:38:43.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.835+0000 7fd830eec640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd82c0cc300 0x7fd82c150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.835+0000 7fd830eec640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd82c15e3f0 0x7fd82c1f1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.835+0000 7fd830eec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd82c0c9580 0x7fd82c0b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.835+0000 7fd830eec640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c0af450 con 0x7fd82c0c9580 2023-11-04T01:38:43.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.835+0000 7fd830eec640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c1f1680 con 0x7fd82c15e3f0 2023-11-04T01:38:43.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.835+0000 7fd830eec640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c0af6a0 con 0x7fd82c0cc300 2023-11-04T01:38:43.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd82ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd82c0c9580 0x7fd82c0b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd82ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd82c0c9580 0x7fd82c0b0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38052/0 (socket says 172.21.15.44:38052) 2023-11-04T01:38:43.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd82ad9d640 1 -- 172.21.15.44:0/3989883126 learned_addr learned my addr 172.21.15.44:0/3989883126 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:43.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd823fff640 1 --2- 172.21.15.44:0/3989883126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd82c15e3f0 0x7fd82c1f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd82a59c640 1 --2- 172.21.15.44:0/3989883126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd82c0cc300 0x7fd82c150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd82ad9d640 1 -- 172.21.15.44:0/3989883126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd82c0cc300 msgr2=0x7fd82c150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd82ad9d640 1 --2- 172.21.15.44:0/3989883126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd82c0cc300 0x7fd82c150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd82ad9d640 1 -- 172.21.15.44:0/3989883126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd82c15e3f0 msgr2=0x7fd82c1f1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd82ad9d640 1 --2- 172.21.15.44:0/3989883126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd82c15e3f0 0x7fd82c1f1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd82ad9d640 1 -- 172.21.15.44:0/3989883126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd824009a70 con 0x7fd82c0c9580 2023-11-04T01:38:43.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd82ad9d640 1 --2- 172.21.15.44:0/3989883126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd82c0c9580 0x7fd82c0b0740 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd824009eb0 tx=0x7fd824004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd822ffd640 1 -- 172.21.15.44:0/3989883126 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824040650 con 0x7fd82c0c9580 2023-11-04T01:38:43.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd822ffd640 1 -- 172.21.15.44:0/3989883126 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8240407d0 con 0x7fd82c0c9580 2023-11-04T01:38:43.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd830eec640 1 -- 172.21.15.44:0/3989883126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82c0af980 con 0x7fd82c0c9580 2023-11-04T01:38:43.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd822ffd640 1 -- 172.21.15.44:0/3989883126 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824040b80 con 0x7fd82c0c9580 2023-11-04T01:38:43.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.836+0000 7fd830eec640 1 -- 172.21.15.44:0/3989883126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82c0aff40 con 0x7fd82c0c9580 2023-11-04T01:38:43.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.837+0000 7fd830eec640 1 -- 172.21.15.44:0/3989883126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82c15b430 con 0x7fd82c0c9580 2023-11-04T01:38:43.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.838+0000 7fd822ffd640 1 -- 172.21.15.44:0/3989883126 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd824040ce0 con 0x7fd82c0c9580 2023-11-04T01:38:43.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.838+0000 7fd822ffd640 1 --2- 172.21.15.44:0/3989883126 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd80c06ae70 0x7fd80c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.838+0000 7fd822ffd640 1 -- 172.21.15.44:0/3989883126 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fd8240ac7e0 con 0x7fd82c0c9580 2023-11-04T01:38:43.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.839+0000 7fd82a59c640 1 --2- 172.21.15.44:0/3989883126 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd80c06ae70 0x7fd80c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.839+0000 7fd82a59c640 1 --2- 172.21.15.44:0/3989883126 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd80c06ae70 0x7fd80c06d330 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd81c007fd0 tx=0x7fd81c007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:43.842+0000 7fd822ffd640 1 -- 172.21.15.44:0/3989883126 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd824077430 con 0x7fd82c0c9580 2023-11-04T01:38:44.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.016+0000 7fd830eec640 1 -- 172.21.15.44:0/3989883126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fd82c074290 con 0x7fd82c0c9580 2023-11-04T01:38:44.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.017+0000 7fd822ffd640 1 -- 172.21.15.44:0/3989883126 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v71) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd82407aa50 con 0x7fd82c0c9580 2023-11-04T01:38:44.019 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.019+0000 7fd830eec640 1 -- 172.21.15.44:0/3989883126 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd80c06ae70 msgr2=0x7fd80c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.019+0000 7fd830eec640 1 --2- 172.21.15.44:0/3989883126 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd80c06ae70 0x7fd80c06d330 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd81c007fd0 tx=0x7fd81c007de0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.019+0000 7fd830eec640 1 -- 172.21.15.44:0/3989883126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd82c0c9580 msgr2=0x7fd82c0b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.019+0000 7fd830eec640 1 --2- 172.21.15.44:0/3989883126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd82c0c9580 0x7fd82c0b0740 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd824009eb0 tx=0x7fd824004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.019+0000 7fd830eec640 1 -- 172.21.15.44:0/3989883126 shutdown_connections 2023-11-04T01:38:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.019+0000 7fd830eec640 1 --2- 172.21.15.44:0/3989883126 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd80c06ae70 0x7fd80c06d330 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.019+0000 7fd830eec640 1 --2- 172.21.15.44:0/3989883126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd82c0c9580 0x7fd82c0b0740 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.019+0000 7fd830eec640 1 --2- 172.21.15.44:0/3989883126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd82c15e3f0 0x7fd82c1f1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.019+0000 7fd830eec640 1 --2- 172.21.15.44:0/3989883126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd82c0cc300 0x7fd82c150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.019+0000 7fd830eec640 1 -- 172.21.15.44:0/3989883126 >> 172.21.15.44:0/3989883126 conn(0x7fd82c071820 msgr2=0x7fd82c15bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:44.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.019+0000 7fd830eec640 1 -- 172.21.15.44:0/3989883126 shutdown_connections 2023-11-04T01:38:44.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.019+0000 7fd830eec640 1 -- 172.21.15.44:0/3989883126 wait complete. 2023-11-04T01:38:44.032 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:38:44.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.139+0000 7f84fd80e640 1 Processor -- start 2023-11-04T01:38:44.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.139+0000 7f84fd80e640 1 -- start start 2023-11-04T01:38:44.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.140+0000 7f84fd80e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f84f8153e60 0x7f84f815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.140+0000 7f84fd80e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f84f80b4880 0x7f84f80b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.140+0000 7f84fd80e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f80cde60 con 0x7f84f80cd6d0 2023-11-04T01:38:44.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.140+0000 7f84fd80e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f8160f90 con 0x7f84f80b4880 2023-11-04T01:38:44.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.140+0000 7f84fd80e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f80b5200 con 0x7f84f8153e60 2023-11-04T01:38:44.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.140+0000 7f84f77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f84f80b4880 0x7f84f80b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.140+0000 7f84f77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f84f80b4880 0x7f84f80b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38058/0 (socket says 172.21.15.44:38058) 2023-11-04T01:38:44.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.140+0000 7f84f77fe640 1 -- 172.21.15.44:0/3698014211 learned_addr learned my addr 172.21.15.44:0/3698014211 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:44.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.140+0000 7f84f6ffd640 1 --2- 172.21.15.44:0/3698014211 >> v2:172.21.15.204:3300/0 conn(0x7f84f8153e60 0x7f84f815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.140+0000 7f84f77fe640 1 -- 172.21.15.44:0/3698014211 >> v2:172.21.15.204:3300/0 conn(0x7f84f8153e60 msgr2=0x7f84f815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:44.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.140+0000 7f84f77fe640 1 --2- 172.21.15.44:0/3698014211 >> v2:172.21.15.204:3300/0 conn(0x7f84f8153e60 0x7f84f815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.140+0000 7f84f77fe640 1 -- 172.21.15.44:0/3698014211 >> v1:172.21.15.204:6789/0 conn(0x7f84f80cd6d0 legacy=0x7f84f8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:44.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.140+0000 7f84f77fe640 1 -- 172.21.15.44:0/3698014211 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f815e400 con 0x7f84f80b4880 2023-11-04T01:38:44.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.140+0000 7f84f6ffd640 1 --2- 172.21.15.44:0/3698014211 >> v2:172.21.15.204:3300/0 conn(0x7f84f8153e60 0x7f84f815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:44.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.141+0000 7f84f77fe640 1 --2- 172.21.15.44:0/3698014211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f80b4880 0x7f84f80b4cc0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f84f808abe0 tx=0x7f84e802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430481942d9d7c1f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.141+0000 7f84f5ffb640 1 -- 172.21.15.44:0/3698014211 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e802cb20 con 0x7f84f80b4880 2023-11-04T01:38:44.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.141+0000 7f84f5ffb640 1 -- 172.21.15.44:0/3698014211 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e802cc80 con 0x7f84f80b4880 2023-11-04T01:38:44.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.141+0000 7f84f5ffb640 1 -- 172.21.15.44:0/3698014211 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e80343f0 con 0x7f84f80b4880 2023-11-04T01:38:44.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.142+0000 7f84fd80e640 1 -- 172.21.15.44:0/3698014211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f80b4880 msgr2=0x7f84f80b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.142+0000 7f84fd80e640 1 --2- 172.21.15.44:0/3698014211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f80b4880 0x7f84f80b4cc0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f84f808abe0 tx=0x7f84e802bf80 comp rx=0 tx=0).stop 2023-11-04T01:38:44.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.142+0000 7f84fd80e640 1 -- 172.21.15.44:0/3698014211 shutdown_connections 2023-11-04T01:38:44.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.142+0000 7f84fd80e640 1 --2- 172.21.15.44:0/3698014211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f80b4880 0x7f84f80b4cc0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.142+0000 7f84fd80e640 1 --2- 172.21.15.44:0/3698014211 >> v2:172.21.15.204:3300/0 conn(0x7f84f8153e60 0x7f84f815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.142+0000 7f84fd80e640 1 -- 172.21.15.44:0/3698014211 >> 172.21.15.44:0/3698014211 conn(0x7f84f80cf880 msgr2=0x7f84f80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:44.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.142+0000 7f84fd80e640 1 -- 172.21.15.44:0/3698014211 shutdown_connections 2023-11-04T01:38:44.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.142+0000 7f84fd80e640 1 -- 172.21.15.44:0/3698014211 wait complete. 2023-11-04T01:38:44.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.143+0000 7f84fd80e640 1 Processor -- start 2023-11-04T01:38:44.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.143+0000 7f84fd80e640 1 -- start start 2023-11-04T01:38:44.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84fd80e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84f80b4880 0x7f84f814c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84fd80e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84f80cd6d0 0x7f84f8156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84fd80e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f8153e60 0x7f84f8156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84fd80e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f814c870 con 0x7f84f8153e60 2023-11-04T01:38:44.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84fd80e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f815f360 con 0x7f84f80cd6d0 2023-11-04T01:38:44.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84fd80e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f815e7e0 con 0x7f84f80b4880 2023-11-04T01:38:44.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84f77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f8153e60 0x7f84f8156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84f77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f8153e60 0x7f84f8156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38060/0 (socket says 172.21.15.44:38060) 2023-11-04T01:38:44.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84f77fe640 1 -- 172.21.15.44:0/2351987091 learned_addr learned my addr 172.21.15.44:0/2351987091 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:44.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84f77fe640 1 -- 172.21.15.44:0/2351987091 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84f80b4880 msgr2=0x7f84f814c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84f77fe640 1 --2- 172.21.15.44:0/2351987091 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84f80b4880 0x7f84f814c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84f67fc640 1 --2- 172.21.15.44:0/2351987091 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84f80cd6d0 0x7f84f8156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84f77fe640 1 -- 172.21.15.44:0/2351987091 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84f80cd6d0 msgr2=0x7f84f8156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84f77fe640 1 --2- 172.21.15.44:0/2351987091 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84f80cd6d0 0x7f84f8156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84f77fe640 1 -- 172.21.15.44:0/2351987091 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e8009b30 con 0x7f84f8153e60 2023-11-04T01:38:44.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.144+0000 7f84f67fc640 1 --2- 172.21.15.44:0/2351987091 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84f80cd6d0 0x7f84f8156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:44.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.145+0000 7f84f77fe640 1 --2- 172.21.15.44:0/2351987091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f8153e60 0x7f84f8156950 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f84e8036040 tx=0x7f84e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.145+0000 7f84effff640 1 -- 172.21.15.44:0/2351987091 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e8007e70 con 0x7f84f8153e60 2023-11-04T01:38:44.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.145+0000 7f84effff640 1 -- 172.21.15.44:0/2351987091 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e8009510 con 0x7f84f8153e60 2023-11-04T01:38:44.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.145+0000 7f84fd80e640 1 -- 172.21.15.44:0/2351987091 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f815eac0 con 0x7f84f8153e60 2023-11-04T01:38:44.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.145+0000 7f84effff640 1 -- 172.21.15.44:0/2351987091 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e803e690 con 0x7f84f8153e60 2023-11-04T01:38:44.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.145+0000 7f84fd80e640 1 -- 172.21.15.44:0/2351987091 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f815f080 con 0x7f84f8153e60 2023-11-04T01:38:44.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.146+0000 7f84fd80e640 1 -- 172.21.15.44:0/2351987091 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f80d0700 con 0x7f84f8153e60 2023-11-04T01:38:44.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.146+0000 7f84effff640 1 -- 172.21.15.44:0/2351987091 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f84e803e7f0 con 0x7f84f8153e60 2023-11-04T01:38:44.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.147+0000 7f84effff640 1 --2- 172.21.15.44:0/2351987091 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f84d806ae70 0x7f84d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.147+0000 7f84effff640 1 -- 172.21.15.44:0/2351987091 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f84e80ac6f0 con 0x7f84f8153e60 2023-11-04T01:38:44.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.147+0000 7f84f6ffd640 1 --2- 172.21.15.44:0/2351987091 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f84d806ae70 0x7f84d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.147+0000 7f84f6ffd640 1 --2- 172.21.15.44:0/2351987091 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f84d806ae70 0x7f84d806d330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f84f0006fd0 tx=0x7f84f0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.151+0000 7f84effff640 1 -- 172.21.15.44:0/2351987091 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f84e8077290 con 0x7f84f8153e60 2023-11-04T01:38:44.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.329+0000 7f84fd80e640 1 -- 172.21.15.44:0/2351987091 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f84f8074290 con 0x7f84f8153e60 2023-11-04T01:38:44.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.329+0000 7f84effff640 1 -- 172.21.15.44:0/2351987091 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v72) v1 ==== 107+0+11 (secure 0 0 0) 0x7f84e807a8b0 con 0x7f84f8153e60 2023-11-04T01:38:44.331 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:44.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.331+0000 7f84fd80e640 1 -- 172.21.15.44:0/2351987091 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f84d806ae70 msgr2=0x7f84d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.331+0000 7f84fd80e640 1 --2- 172.21.15.44:0/2351987091 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f84d806ae70 0x7f84d806d330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f84f0006fd0 tx=0x7f84f0008040 comp rx=0 tx=0).stop 2023-11-04T01:38:44.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.331+0000 7f84fd80e640 1 -- 172.21.15.44:0/2351987091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f8153e60 msgr2=0x7f84f8156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.331+0000 7f84fd80e640 1 --2- 172.21.15.44:0/2351987091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f8153e60 0x7f84f8156950 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f84e8036040 tx=0x7f84e8004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:44.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.331+0000 7f84fd80e640 1 -- 172.21.15.44:0/2351987091 shutdown_connections 2023-11-04T01:38:44.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.331+0000 7f84fd80e640 1 --2- 172.21.15.44:0/2351987091 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f84d806ae70 0x7f84d806d330 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.331+0000 7f84fd80e640 1 --2- 172.21.15.44:0/2351987091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f8153e60 0x7f84f8156950 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.331+0000 7f84fd80e640 1 --2- 172.21.15.44:0/2351987091 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84f80cd6d0 0x7f84f8156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.331+0000 7f84fd80e640 1 --2- 172.21.15.44:0/2351987091 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84f80b4880 0x7f84f814c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.331+0000 7f84fd80e640 1 -- 172.21.15.44:0/2351987091 >> 172.21.15.44:0/2351987091 conn(0x7f84f80cf880 msgr2=0x7f84f80d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:44.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.331+0000 7f84fd80e640 1 -- 172.21.15.44:0/2351987091 shutdown_connections 2023-11-04T01:38:44.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.331+0000 7f84fd80e640 1 -- 172.21.15.44:0/2351987091 wait complete. 2023-11-04T01:38:44.345 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:44.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.448+0000 7ff56cee5640 1 Processor -- start 2023-11-04T01:38:44.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.448+0000 7ff56cee5640 1 -- start start 2023-11-04T01:38:44.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.449+0000 7ff56cee5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff5680cde60 0x7ff56815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.449+0000 7ff56cee5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff56815daa0 0x7ff568157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.449+0000 7ff56cee5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5680ce240 0x7ff568157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.449+0000 7ff56cee5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56815e5c0 con 0x7ff5680cde60 2023-11-04T01:38:44.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.449+0000 7ff56cee5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff568157a80 con 0x7ff56815daa0 2023-11-04T01:38:44.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.449+0000 7ff56cee5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56815e000 con 0x7ff5680ce240 2023-11-04T01:38:44.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.449+0000 7ff56659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff5680cde60 0x7ff56815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.449+0000 7ff56659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff5680cde60 0x7ff56815d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38076/0 (socket says 172.21.15.44:38076) 2023-11-04T01:38:44.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.449+0000 7ff56659c640 1 -- 172.21.15.44:0/4169522005 learned_addr learned my addr 172.21.15.44:0/4169522005 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:44.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.450+0000 7ff566d9d640 1 --2- 172.21.15.44:0/4169522005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5680ce240 0x7ff568157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.450+0000 7ff565d9b640 1 --2- 172.21.15.44:0/4169522005 >> v2:172.21.15.204:3300/0 conn(0x7ff56815daa0 0x7ff568157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.450+0000 7ff56659c640 1 -- 172.21.15.44:0/4169522005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5680ce240 msgr2=0x7ff568157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:44.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.450+0000 7ff56659c640 1 --2- 172.21.15.44:0/4169522005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5680ce240 0x7ff568157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.450+0000 7ff56659c640 1 -- 172.21.15.44:0/4169522005 >> v2:172.21.15.204:3300/0 conn(0x7ff56815daa0 msgr2=0x7ff568157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:44.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.450+0000 7ff56659c640 1 --2- 172.21.15.44:0/4169522005 >> v2:172.21.15.204:3300/0 conn(0x7ff56815daa0 0x7ff568157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.450+0000 7ff56659c640 1 -- 172.21.15.44:0/4169522005 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56815e2e0 con 0x7ff5680cde60 2023-11-04T01:38:44.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.450+0000 7ff56659c640 1 --2- 172.21.15.44:0/4169522005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5680cde60 0x7ff56815d560 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ff5680cf5f0 tx=0x7ff55802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a63218d7af082d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.451+0000 7ff56559a640 1 -- 172.21.15.44:0/4169522005 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558031870 con 0x7ff5680cde60 2023-11-04T01:38:44.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.451+0000 7ff56559a640 1 -- 172.21.15.44:0/4169522005 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5580319d0 con 0x7ff5680cde60 2023-11-04T01:38:44.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.451+0000 7ff56559a640 1 -- 172.21.15.44:0/4169522005 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558031d60 con 0x7ff5680cde60 2023-11-04T01:38:44.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.451+0000 7ff56cee5640 1 -- 172.21.15.44:0/4169522005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5680cde60 msgr2=0x7ff56815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.451+0000 7ff56cee5640 1 --2- 172.21.15.44:0/4169522005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5680cde60 0x7ff56815d560 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ff5680cf5f0 tx=0x7ff55802b910 comp rx=0 tx=0).stop 2023-11-04T01:38:44.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.451+0000 7ff56cee5640 1 -- 172.21.15.44:0/4169522005 shutdown_connections 2023-11-04T01:38:44.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.451+0000 7ff56cee5640 1 --2- 172.21.15.44:0/4169522005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5680ce240 0x7ff568157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.451+0000 7ff56cee5640 1 --2- 172.21.15.44:0/4169522005 >> v2:172.21.15.204:3300/0 conn(0x7ff56815daa0 0x7ff568157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.451+0000 7ff56cee5640 1 --2- 172.21.15.44:0/4169522005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5680cde60 0x7ff56815d560 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.451+0000 7ff56cee5640 1 -- 172.21.15.44:0/4169522005 >> 172.21.15.44:0/4169522005 conn(0x7ff568071f30 msgr2=0x7ff5680cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:44.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.451+0000 7ff56cee5640 1 -- 172.21.15.44:0/4169522005 shutdown_connections 2023-11-04T01:38:44.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.451+0000 7ff56cee5640 1 -- 172.21.15.44:0/4169522005 wait complete. 2023-11-04T01:38:44.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.453+0000 7ff56cee5640 1 Processor -- start 2023-11-04T01:38:44.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.453+0000 7ff56cee5640 1 -- start start 2023-11-04T01:38:44.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.453+0000 7ff56cee5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5680cde60 0x7ff56814b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.453+0000 7ff56cee5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5680ce240 0x7ff5681f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.453+0000 7ff56cee5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56815daa0 0x7ff568148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.453+0000 7ff56cee5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56815c4a0 con 0x7ff56815daa0 2023-11-04T01:38:44.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.453+0000 7ff56cee5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5681f5da0 con 0x7ff5680cde60 2023-11-04T01:38:44.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.453+0000 7ff56cee5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56814be60 con 0x7ff5680ce240 2023-11-04T01:38:44.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff566d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56815daa0 0x7ff568148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff566d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56815daa0 0x7ff568148e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38082/0 (socket says 172.21.15.44:38082) 2023-11-04T01:38:44.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff566d9d640 1 -- 172.21.15.44:0/1499091100 learned_addr learned my addr 172.21.15.44:0/1499091100 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:44.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff565d9b640 1 --2- 172.21.15.44:0/1499091100 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5680ce240 0x7ff5681f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff56659c640 1 --2- 172.21.15.44:0/1499091100 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5680cde60 0x7ff56814b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff566d9d640 1 -- 172.21.15.44:0/1499091100 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5680ce240 msgr2=0x7ff5681f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff566d9d640 1 --2- 172.21.15.44:0/1499091100 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5680ce240 0x7ff5681f2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff566d9d640 1 -- 172.21.15.44:0/1499091100 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5680cde60 msgr2=0x7ff56814b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff566d9d640 1 --2- 172.21.15.44:0/1499091100 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5680cde60 0x7ff56814b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff566d9d640 1 -- 172.21.15.44:0/1499091100 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5580094d0 con 0x7ff56815daa0 2023-11-04T01:38:44.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff566d9d640 1 --2- 172.21.15.44:0/1499091100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56815daa0 0x7ff568148e80 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff560007e60 tx=0x7ff56000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff55effd640 1 -- 172.21.15.44:0/1499091100 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560014420 con 0x7ff56815daa0 2023-11-04T01:38:44.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff55effd640 1 -- 172.21.15.44:0/1499091100 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff560014580 con 0x7ff56815daa0 2023-11-04T01:38:44.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff56cee5640 1 -- 172.21.15.44:0/1499091100 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff568159e20 con 0x7ff56815daa0 2023-11-04T01:38:44.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff55effd640 1 -- 172.21.15.44:0/1499091100 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560014930 con 0x7ff56815daa0 2023-11-04T01:38:44.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.454+0000 7ff56cee5640 1 -- 172.21.15.44:0/1499091100 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56815c9d0 con 0x7ff56815daa0 2023-11-04T01:38:44.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.455+0000 7ff56cee5640 1 -- 172.21.15.44:0/1499091100 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff568074290 con 0x7ff56815daa0 2023-11-04T01:38:44.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.456+0000 7ff55effd640 1 -- 172.21.15.44:0/1499091100 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff560014a90 con 0x7ff56815daa0 2023-11-04T01:38:44.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.456+0000 7ff55effd640 1 --2- 172.21.15.44:0/1499091100 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff54806ae70 0x7ff54806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.456+0000 7ff55effd640 1 -- 172.21.15.44:0/1499091100 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7120+0+0 (secure 0 0 0) 0x7ff56008a4b0 con 0x7ff56815daa0 2023-11-04T01:38:44.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.456+0000 7ff56659c640 1 --2- 172.21.15.44:0/1499091100 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff54806ae70 0x7ff54806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.457+0000 7ff56659c640 1 --2- 172.21.15.44:0/1499091100 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff54806ae70 0x7ff54806d330 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff558036000 tx=0x7ff55803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.460+0000 7ff55effd640 1 -- 172.21.15.44:0/1499091100 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff560054ff0 con 0x7ff56815daa0 2023-11-04T01:38:44.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.677+0000 7ff56cee5640 1 -- 172.21.15.44:0/1499091100 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff56815a1f0 con 0x7ff56815daa0 2023-11-04T01:38:44.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.678+0000 7ff55effd640 1 -- 172.21.15.44:0/1499091100 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4918 (secure 0 0 0) 0x7ff560058610 con 0x7ff56815daa0 2023-11-04T01:38:44.680 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:44.680 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5543,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/1112718006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1112718006},{"type":"v1","addr":"172.21.15.204:6837","nonce":1112718006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5935,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/719128216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":719128216},{"type":"v1","addr":"172.21.15.204:6836","nonce":719128216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3272698261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3272698261},{"type":"v1","addr":"172.21.15.44:6833","nonce":3272698261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:22.129730+0000","modified":"2023-11-04T01:38:24.137808+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/2413284016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2413284016},{"type":"v1","addr":"172.21.15.44:6835","nonce":2413284016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:38:44.680 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 31 2023-11-04T01:38:44.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.680+0000 7ff56cee5640 1 -- 172.21.15.44:0/1499091100 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff54806ae70 msgr2=0x7ff54806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.680+0000 7ff56cee5640 1 --2- 172.21.15.44:0/1499091100 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff54806ae70 0x7ff54806d330 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff558036000 tx=0x7ff55803c040 comp rx=0 tx=0).stop 2023-11-04T01:38:44.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.680+0000 7ff56cee5640 1 -- 172.21.15.44:0/1499091100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56815daa0 msgr2=0x7ff568148e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.680+0000 7ff56cee5640 1 --2- 172.21.15.44:0/1499091100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56815daa0 0x7ff568148e80 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff560007e60 tx=0x7ff56000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.680+0000 7ff56cee5640 1 -- 172.21.15.44:0/1499091100 shutdown_connections 2023-11-04T01:38:44.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.680+0000 7ff56cee5640 1 --2- 172.21.15.44:0/1499091100 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff54806ae70 0x7ff54806d330 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.680+0000 7ff56cee5640 1 --2- 172.21.15.44:0/1499091100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56815daa0 0x7ff568148e80 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.680+0000 7ff56cee5640 1 --2- 172.21.15.44:0/1499091100 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5680ce240 0x7ff5681f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.680+0000 7ff56cee5640 1 --2- 172.21.15.44:0/1499091100 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5680cde60 0x7ff56814b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.680+0000 7ff56cee5640 1 -- 172.21.15.44:0/1499091100 >> 172.21.15.44:0/1499091100 conn(0x7ff568071f30 msgr2=0x7ff5680b7880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:44.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.680+0000 7ff56cee5640 1 -- 172.21.15.44:0/1499091100 shutdown_connections 2023-11-04T01:38:44.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.680+0000 7ff56cee5640 1 -- 172.21.15.44:0/1499091100 wait complete. 2023-11-04T01:38:44.693 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:44.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.797+0000 7ff846bb6640 1 Processor -- start 2023-11-04T01:38:44.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.797+0000 7ff846bb6640 1 -- start start 2023-11-04T01:38:44.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff846bb6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff84015ce60 0x7ff84006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff846bb6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff84006bd30 0x7ff840160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff846bb6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff840161050 0x7ff8400cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff846bb6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8400cbde0 con 0x7ff84006bd30 2023-11-04T01:38:44.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff846bb6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8401615d0 con 0x7ff84015ce60 2023-11-04T01:38:44.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff846bb6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8401618b0 con 0x7ff840161050 2023-11-04T01:38:44.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff83ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff84006bd30 0x7ff840160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff83ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff84006bd30 0x7ff840160b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38084/0 (socket says 172.21.15.44:38084) 2023-11-04T01:38:44.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff83ffff640 1 -- 172.21.15.44:0/2815811141 learned_addr learned my addr 172.21.15.44:0/2815811141 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff844952640 1 --2- 172.21.15.44:0/2815811141 >> v2:172.21.15.204:3300/0 conn(0x7ff84015ce60 0x7ff84006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff845153640 1 --2- 172.21.15.44:0/2815811141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff840161050 0x7ff8400cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff83ffff640 1 -- 172.21.15.44:0/2815811141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff840161050 msgr2=0x7ff8400cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff83ffff640 1 --2- 172.21.15.44:0/2815811141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff840161050 0x7ff8400cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff83ffff640 1 -- 172.21.15.44:0/2815811141 >> v2:172.21.15.204:3300/0 conn(0x7ff84015ce60 msgr2=0x7ff84006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff83ffff640 1 --2- 172.21.15.44:0/2815811141 >> v2:172.21.15.204:3300/0 conn(0x7ff84015ce60 0x7ff84006b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff83ffff640 1 -- 172.21.15.44:0/2815811141 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8400cba00 con 0x7ff84006bd30 2023-11-04T01:38:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.798+0000 7ff845153640 1 --2- 172.21.15.44:0/2815811141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff840161050 0x7ff8400cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.799+0000 7ff83ffff640 1 --2- 172.21.15.44:0/2815811141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84006bd30 0x7ff840160b10 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff84006e960 tx=0x7ff82c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d109795c45da0c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.799+0000 7ff83f7fe640 1 -- 172.21.15.44:0/2815811141 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c031870 con 0x7ff84006bd30 2023-11-04T01:38:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.799+0000 7ff83f7fe640 1 -- 172.21.15.44:0/2815811141 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c0319d0 con 0x7ff84006bd30 2023-11-04T01:38:44.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.799+0000 7ff83f7fe640 1 -- 172.21.15.44:0/2815811141 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c031d60 con 0x7ff84006bd30 2023-11-04T01:38:44.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.800+0000 7ff846bb6640 1 -- 172.21.15.44:0/2815811141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84006bd30 msgr2=0x7ff840160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.800+0000 7ff846bb6640 1 --2- 172.21.15.44:0/2815811141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84006bd30 0x7ff840160b10 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff84006e960 tx=0x7ff82c02b910 comp rx=0 tx=0).stop 2023-11-04T01:38:44.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.800+0000 7ff846bb6640 1 -- 172.21.15.44:0/2815811141 shutdown_connections 2023-11-04T01:38:44.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.800+0000 7ff846bb6640 1 --2- 172.21.15.44:0/2815811141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff840161050 0x7ff8400cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.800+0000 7ff846bb6640 1 --2- 172.21.15.44:0/2815811141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84006bd30 0x7ff840160b10 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.800+0000 7ff846bb6640 1 --2- 172.21.15.44:0/2815811141 >> v2:172.21.15.204:3300/0 conn(0x7ff84015ce60 0x7ff84006b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.800+0000 7ff846bb6640 1 -- 172.21.15.44:0/2815811141 >> 172.21.15.44:0/2815811141 conn(0x7ff84006ea90 msgr2=0x7ff84006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.800+0000 7ff846bb6640 1 -- 172.21.15.44:0/2815811141 shutdown_connections 2023-11-04T01:38:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.800+0000 7ff846bb6640 1 -- 172.21.15.44:0/2815811141 wait complete. 2023-11-04T01:38:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.801+0000 7ff846bb6640 1 Processor -- start 2023-11-04T01:38:44.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.801+0000 7ff846bb6640 1 -- start start 2023-11-04T01:38:44.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff846bb6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84015ce60 0x7ff8401f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff846bb6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff840161050 0x7ff8400c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff846bb6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff84015fe50 0x7ff8400b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff846bb6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400c92e0 con 0x7ff84015ce60 2023-11-04T01:38:44.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff846bb6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400c8a40 con 0x7ff840161050 2023-11-04T01:38:44.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff846bb6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400c8d20 con 0x7ff84015fe50 2023-11-04T01:38:44.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff844952640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84015ce60 0x7ff8401f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff844952640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84015ce60 0x7ff8401f22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38096/0 (socket says 172.21.15.44:38096) 2023-11-04T01:38:44.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff844952640 1 -- 172.21.15.44:0/2461943731 learned_addr learned my addr 172.21.15.44:0/2461943731 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:44.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff845153640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff84015fe50 0x7ff8400b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff83ffff640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff840161050 0x7ff8400c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff844952640 1 -- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff84015fe50 msgr2=0x7ff8400b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff844952640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff84015fe50 0x7ff8400b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff844952640 1 -- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff840161050 msgr2=0x7ff8400c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff844952640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff840161050 0x7ff8400c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff844952640 1 -- 172.21.15.44:0/2461943731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0094d0 con 0x7ff84015ce60 2023-11-04T01:38:44.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff845153640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff84015fe50 0x7ff8400b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:44.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff83ffff640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff840161050 0x7ff8400c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:44.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.802+0000 7ff844952640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84015ce60 0x7ff8401f22b0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff83400d800 tx=0x7ff83400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.803+0000 7ff83d7fa640 1 -- 172.21.15.44:0/2461943731 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340096a0 con 0x7ff84015ce60 2023-11-04T01:38:44.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.803+0000 7ff83d7fa640 1 -- 172.21.15.44:0/2461943731 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff834009800 con 0x7ff84015ce60 2023-11-04T01:38:44.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.803+0000 7ff83d7fa640 1 -- 172.21.15.44:0/2461943731 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834009b90 con 0x7ff84015ce60 2023-11-04T01:38:44.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.803+0000 7ff846bb6640 1 -- 172.21.15.44:0/2461943731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8400c9000 con 0x7ff84015ce60 2023-11-04T01:38:44.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.803+0000 7ff846bb6640 1 -- 172.21.15.44:0/2461943731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8400c8680 con 0x7ff84015ce60 2023-11-04T01:38:44.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.804+0000 7ff846bb6640 1 -- 172.21.15.44:0/2461943731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff840074290 con 0x7ff84015ce60 2023-11-04T01:38:44.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.804+0000 7ff83d7fa640 1 -- 172.21.15.44:0/2461943731 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff834009cf0 con 0x7ff84015ce60 2023-11-04T01:38:44.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.805+0000 7ff83d7fa640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff82406ae70 0x7ff82406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.805+0000 7ff83d7fa640 1 -- 172.21.15.44:0/2461943731 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7120+0+0 (secure 0 0 0) 0x7ff83408a010 con 0x7ff84015ce60 2023-11-04T01:38:44.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.805+0000 7ff83ffff640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff82406ae70 0x7ff82406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.805+0000 7ff83ffff640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff82406ae70 0x7ff82406d330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff82c036000 tx=0x7ff82c03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.809+0000 7ff83d7fa640 1 -- 172.21.15.44:0/2461943731 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff834054b40 con 0x7ff84015ce60 2023-11-04T01:38:44.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.986+0000 7ff846bb6640 1 -- 172.21.15.44:0/2461943731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8400c7f20 con 0x7ff84015ce60 2023-11-04T01:38:44.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.987+0000 7ff83d7fa640 1 -- 172.21.15.44:0/2461943731 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+22057 (secure 0 0 0) 0x7ff83400b440 con 0x7ff84015ce60 2023-11-04T01:38:44.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:44.990 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":72,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:38:44.189352+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:20.738739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:21.109334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:44.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.989+0000 7ff846bb6640 1 -- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff82406ae70 msgr2=0x7ff82406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.989+0000 7ff846bb6640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff82406ae70 0x7ff82406d330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff82c036000 tx=0x7ff82c03c040 comp rx=0 tx=0).stop 2023-11-04T01:38:44.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.989+0000 7ff846bb6640 1 -- 172.21.15.44:0/2461943731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84015ce60 msgr2=0x7ff8401f22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.989+0000 7ff846bb6640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84015ce60 0x7ff8401f22b0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff83400d800 tx=0x7ff83400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.989+0000 7ff846bb6640 1 -- 172.21.15.44:0/2461943731 shutdown_connections 2023-11-04T01:38:44.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.989+0000 7ff846bb6640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff82406ae70 0x7ff82406d330 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.989+0000 7ff846bb6640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff84015fe50 0x7ff8400b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.989+0000 7ff846bb6640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff840161050 0x7ff8400c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.989+0000 7ff846bb6640 1 --2- 172.21.15.44:0/2461943731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84015ce60 0x7ff8401f22b0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.989+0000 7ff846bb6640 1 -- 172.21.15.44:0/2461943731 >> 172.21.15.44:0/2461943731 conn(0x7ff84006ea90 msgr2=0x7ff8400c6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:44.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.989+0000 7ff846bb6640 1 -- 172.21.15.44:0/2461943731 shutdown_connections 2023-11-04T01:38:44.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:44.989+0000 7ff846bb6640 1 -- 172.21.15.44:0/2461943731 wait complete. 2023-11-04T01:38:45.003 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:38:45.003 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:45.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.107+0000 7f475e44b640 1 Processor -- start 2023-11-04T01:38:45.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.107+0000 7f475e44b640 1 -- start start 2023-11-04T01:38:45.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.107+0000 7f475e44b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4758159c70 0x7f47580ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.108+0000 7f475e44b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f47580b0ae0 0x7f475815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.108+0000 7f475e44b640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47580b4110 con 0x7f475806db20 2023-11-04T01:38:45.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.108+0000 7f475e44b640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47580b49b0 con 0x7f47580b0ae0 2023-11-04T01:38:45.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.108+0000 7f475e44b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47580b43f0 con 0x7f4758159c70 2023-11-04T01:38:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.108+0000 7f475c9e8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f47580b0ae0 0x7f475815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.108+0000 7f47577fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f475806db20 0x7f47580b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37426/0 (socket says 172.21.15.44:37426) 2023-11-04T01:38:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.108+0000 7f47577fe640 1 -- 172.21.15.44:0/4137640159 learned_addr learned my addr 172.21.15.44:0/4137640159 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.108+0000 7f4757fff640 1 --2- 172.21.15.44:0/4137640159 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4758159c70 0x7f47580ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.108+0000 7f475c9e8640 1 -- 172.21.15.44:0/4137640159 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4758159c70 msgr2=0x7f47580ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.108+0000 7f475c9e8640 1 --2- 172.21.15.44:0/4137640159 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4758159c70 0x7f47580ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.108+0000 7f475c9e8640 1 -- 172.21.15.44:0/4137640159 >> v1:172.21.15.44:6789/0 conn(0x7f475806db20 legacy=0x7f47580b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.108+0000 7f4756ffd640 1 -- 172.21.15.44:0/4137640159 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352797746 0 0) 0x7f47580b4110 con 0x7f475806db20 2023-11-04T01:38:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.108+0000 7f475c9e8640 1 -- 172.21.15.44:0/4137640159 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47580b46d0 con 0x7f47580b0ae0 2023-11-04T01:38:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.108+0000 7f4757fff640 1 --2- 172.21.15.44:0/4137640159 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4758159c70 0x7f47580ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.109+0000 7f475c9e8640 1 --2- 172.21.15.44:0/4137640159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47580b0ae0 0x7f475815d7d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f4750009d90 tx=0x7f475002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efd5d565c01026a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.109+0000 7f4756ffd640 1 -- 172.21.15.44:0/4137640159 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475002cc50 con 0x7f47580b0ae0 2023-11-04T01:38:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.109+0000 7f4756ffd640 1 -- 172.21.15.44:0/4137640159 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475002cdb0 con 0x7f47580b0ae0 2023-11-04T01:38:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.109+0000 7f4756ffd640 1 -- 172.21.15.44:0/4137640159 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750034660 con 0x7f47580b0ae0 2023-11-04T01:38:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.110+0000 7f475e44b640 1 -- 172.21.15.44:0/4137640159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47580b0ae0 msgr2=0x7f475815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.110+0000 7f475e44b640 1 --2- 172.21.15.44:0/4137640159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47580b0ae0 0x7f475815d7d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f4750009d90 tx=0x7f475002bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.110+0000 7f475e44b640 1 -- 172.21.15.44:0/4137640159 shutdown_connections 2023-11-04T01:38:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.110+0000 7f475e44b640 1 --2- 172.21.15.44:0/4137640159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47580b0ae0 0x7f475815d7d0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.110+0000 7f475e44b640 1 --2- 172.21.15.44:0/4137640159 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4758159c70 0x7f47580ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.110+0000 7f475e44b640 1 -- 172.21.15.44:0/4137640159 >> 172.21.15.44:0/4137640159 conn(0x7f47580ce950 msgr2=0x7f47580ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.110+0000 7f475e44b640 1 -- 172.21.15.44:0/4137640159 shutdown_connections 2023-11-04T01:38:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.110+0000 7f475e44b640 1 -- 172.21.15.44:0/4137640159 wait complete. 2023-11-04T01:38:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.111+0000 7f475e44b640 1 Processor -- start 2023-11-04T01:38:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.111+0000 7f475e44b640 1 -- start start 2023-11-04T01:38:45.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475e44b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f475806db20 0x7f47580a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475e44b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47580b0ae0 0x7f47581f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475e44b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4758159c70 0x7f47581577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475e44b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47580ab1e0 con 0x7f4758159c70 2023-11-04T01:38:45.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475e44b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47580aa560 con 0x7f47580b0ae0 2023-11-04T01:38:45.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475e44b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47580aa840 con 0x7f475806db20 2023-11-04T01:38:45.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475c9e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4758159c70 0x7f47581577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475c9e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4758159c70 0x7f47581577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38110/0 (socket says 172.21.15.44:38110) 2023-11-04T01:38:45.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475c9e8640 1 -- 172.21.15.44:0/3056859088 learned_addr learned my addr 172.21.15.44:0/3056859088 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:45.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f4757fff640 1 --2- 172.21.15.44:0/3056859088 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f475806db20 0x7f47580a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f47577fe640 1 --2- 172.21.15.44:0/3056859088 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47580b0ae0 0x7f47581f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475c9e8640 1 -- 172.21.15.44:0/3056859088 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f475806db20 msgr2=0x7f47580a9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475c9e8640 1 --2- 172.21.15.44:0/3056859088 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f475806db20 0x7f47580a9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475c9e8640 1 -- 172.21.15.44:0/3056859088 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47580b0ae0 msgr2=0x7f47581f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475c9e8640 1 --2- 172.21.15.44:0/3056859088 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47580b0ae0 0x7f47581f3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475c9e8640 1 -- 172.21.15.44:0/3056859088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4750009a70 con 0x7f4758159c70 2023-11-04T01:38:45.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475c9e8640 1 --2- 172.21.15.44:0/3056859088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4758159c70 0x7f47581577c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f4750009eb0 tx=0x7f4750004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f4754ff9640 1 -- 172.21.15.44:0/3056859088 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475003f420 con 0x7f4758159c70 2023-11-04T01:38:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f4754ff9640 1 -- 172.21.15.44:0/3056859088 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475003f580 con 0x7f4758159c70 2023-11-04T01:38:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f475e44b640 1 -- 172.21.15.44:0/3056859088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47580aab20 con 0x7f4758159c70 2023-11-04T01:38:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.112+0000 7f4754ff9640 1 -- 172.21.15.44:0/3056859088 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475003f8f0 con 0x7f4758159c70 2023-11-04T01:38:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.113+0000 7f475e44b640 1 -- 172.21.15.44:0/3056859088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47580aa150 con 0x7f4758159c70 2023-11-04T01:38:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.113+0000 7f475e44b640 1 -- 172.21.15.44:0/3056859088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47580ab320 con 0x7f4758159c70 2023-11-04T01:38:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.114+0000 7f4754ff9640 1 -- 172.21.15.44:0/3056859088 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f475003fa50 con 0x7f4758159c70 2023-11-04T01:38:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.114+0000 7f4754ff9640 1 --2- 172.21.15.44:0/3056859088 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f474406ae70 0x7f474406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.114+0000 7f4754ff9640 1 -- 172.21.15.44:0/3056859088 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f47500ac9f0 con 0x7f4758159c70 2023-11-04T01:38:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.115+0000 7f4757fff640 1 --2- 172.21.15.44:0/3056859088 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f474406ae70 0x7f474406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.115+0000 7f4757fff640 1 --2- 172.21.15.44:0/3056859088 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f474406ae70 0x7f474406d330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f474800d8b0 tx=0x7f4748008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.119+0000 7f4754ff9640 1 -- 172.21.15.44:0/3056859088 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47580ab320 con 0x7f4758159c70 2023-11-04T01:38:45.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.332+0000 7f475e44b640 1 -- 172.21.15.44:0/3056859088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47580ab320 con 0x7f4758159c70 2023-11-04T01:38:45.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.333+0000 7f4754ff9640 1 -- 172.21.15.44:0/3056859088 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f47580ab320 con 0x7f4758159c70 2023-11-04T01:38:45.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:45.335 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5543,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/1112718006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1112718006},{"type":"v1","addr":"172.21.15.204:6837","nonce":1112718006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5935,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/719128216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":719128216},{"type":"v1","addr":"172.21.15.204:6836","nonce":719128216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3272698261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3272698261},{"type":"v1","addr":"172.21.15.44:6833","nonce":3272698261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:22.129730+0000","modified":"2023-11-04T01:38:24.137808+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/2413284016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2413284016},{"type":"v1","addr":"172.21.15.44:6835","nonce":2413284016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:38:45.335 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 31 2023-11-04T01:38:45.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.334+0000 7f475e44b640 1 -- 172.21.15.44:0/3056859088 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f474406ae70 msgr2=0x7f474406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.334+0000 7f475e44b640 1 --2- 172.21.15.44:0/3056859088 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f474406ae70 0x7f474406d330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f474800d8b0 tx=0x7f4748008040 comp rx=0 tx=0).stop 2023-11-04T01:38:45.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.334+0000 7f475e44b640 1 -- 172.21.15.44:0/3056859088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4758159c70 msgr2=0x7f47581577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.334+0000 7f475e44b640 1 --2- 172.21.15.44:0/3056859088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4758159c70 0x7f47581577c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f4750009eb0 tx=0x7f4750004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:45.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.335+0000 7f475e44b640 1 -- 172.21.15.44:0/3056859088 shutdown_connections 2023-11-04T01:38:45.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.335+0000 7f475e44b640 1 --2- 172.21.15.44:0/3056859088 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f474406ae70 0x7f474406d330 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.335+0000 7f475e44b640 1 --2- 172.21.15.44:0/3056859088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4758159c70 0x7f47581577c0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.335+0000 7f475e44b640 1 --2- 172.21.15.44:0/3056859088 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47580b0ae0 0x7f47581f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.335+0000 7f475e44b640 1 --2- 172.21.15.44:0/3056859088 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f475806db20 0x7f47580a9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.335+0000 7f475e44b640 1 -- 172.21.15.44:0/3056859088 >> 172.21.15.44:0/3056859088 conn(0x7f47580ce950 msgr2=0x7f47580b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:45.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.335+0000 7f475e44b640 1 -- 172.21.15.44:0/3056859088 shutdown_connections 2023-11-04T01:38:45.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.335+0000 7f475e44b640 1 -- 172.21.15.44:0/3056859088 wait complete. 2023-11-04T01:38:45.347 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:45.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.451+0000 7fe03792c640 1 Processor -- start 2023-11-04T01:38:45.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.451+0000 7fe03792c640 1 -- start start 2023-11-04T01:38:45.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.452+0000 7fe03792c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03015ce60 0x7fe03006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.452+0000 7fe03792c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe0300cf160 0x7fe0300cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.452+0000 7fe03792c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0301615d0 con 0x7fe03006bd30 2023-11-04T01:38:45.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.452+0000 7fe03792c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0300cbde0 con 0x7fe0300cf160 2023-11-04T01:38:45.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.452+0000 7fe03792c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0300cfb50 con 0x7fe03015ce60 2023-11-04T01:38:45.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.452+0000 7fe0356c8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03015ce60 0x7fe03006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.453+0000 7fe035ec9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe0300cf160 0x7fe0300cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.453+0000 7fe0356c8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03015ce60 0x7fe03006b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:57584/0 (socket says 172.21.15.44:57584) 2023-11-04T01:38:45.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.453+0000 7fe035ec9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe0300cf160 0x7fe0300cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:59046/0 (socket says 172.21.15.44:59046) 2023-11-04T01:38:45.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.453+0000 7fe0356c8640 1 -- 172.21.15.44:0/58036751 learned_addr learned my addr 172.21.15.44:0/58036751 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:45.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.453+0000 7fe034ec7640 1 --1- 172.21.15.44:0/58036751 >> v1:172.21.15.204:6789/0 conn(0x7fe03006bd30 0x7fe030160b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:55670/0 (socket says 172.21.15.44:55670) 2023-11-04T01:38:45.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.453+0000 7fe0356c8640 1 -- 172.21.15.44:0/58036751 >> v2:172.21.15.204:3300/0 conn(0x7fe0300cf160 msgr2=0x7fe0300cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:45.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.453+0000 7fe0356c8640 1 --2- 172.21.15.44:0/58036751 >> v2:172.21.15.204:3300/0 conn(0x7fe0300cf160 0x7fe0300cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.453+0000 7fe0356c8640 1 -- 172.21.15.44:0/58036751 >> v1:172.21.15.204:6789/0 conn(0x7fe03006bd30 legacy=0x7fe030160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.453+0000 7fe0356c8640 1 -- 172.21.15.44:0/58036751 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0301618b0 con 0x7fe03015ce60 2023-11-04T01:38:45.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.453+0000 7fe035ec9640 1 --2- 172.21.15.44:0/58036751 >> v2:172.21.15.204:3300/0 conn(0x7fe0300cf160 0x7fe0300cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:45.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.454+0000 7fe0356c8640 1 --2- 172.21.15.44:0/58036751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03015ce60 0x7fe03006b7f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe020009e50 tx=0x7fe02002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=354a588672cb2457 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.454+0000 7fe02ffff640 1 -- 172.21.15.44:0/58036751 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02002cb00 con 0x7fe03015ce60 2023-11-04T01:38:45.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.454+0000 7fe02ffff640 1 -- 172.21.15.44:0/58036751 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02002cc60 con 0x7fe03015ce60 2023-11-04T01:38:45.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.454+0000 7fe02ffff640 1 -- 172.21.15.44:0/58036751 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0200343f0 con 0x7fe03015ce60 2023-11-04T01:38:45.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.455+0000 7fe03792c640 1 -- 172.21.15.44:0/58036751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03015ce60 msgr2=0x7fe03006b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.455+0000 7fe03792c640 1 --2- 172.21.15.44:0/58036751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03015ce60 0x7fe03006b7f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe020009e50 tx=0x7fe02002bf60 comp rx=0 tx=0).stop 2023-11-04T01:38:45.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.455+0000 7fe03792c640 1 -- 172.21.15.44:0/58036751 shutdown_connections 2023-11-04T01:38:45.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.455+0000 7fe03792c640 1 --2- 172.21.15.44:0/58036751 >> v2:172.21.15.204:3300/0 conn(0x7fe0300cf160 0x7fe0300cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.455+0000 7fe03792c640 1 --2- 172.21.15.44:0/58036751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03015ce60 0x7fe03006b7f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.455+0000 7fe03792c640 1 -- 172.21.15.44:0/58036751 >> 172.21.15.44:0/58036751 conn(0x7fe03006ea90 msgr2=0x7fe03006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:45.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.455+0000 7fe03792c640 1 -- 172.21.15.44:0/58036751 shutdown_connections 2023-11-04T01:38:45.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.455+0000 7fe03792c640 1 -- 172.21.15.44:0/58036751 wait complete. 2023-11-04T01:38:45.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.456+0000 7fe03792c640 1 Processor -- start 2023-11-04T01:38:45.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.456+0000 7fe03792c640 1 -- start start 2023-11-04T01:38:45.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe03792c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300cf160 0x7fe0301f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe03792c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03015ce60 0x7fe0300cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe03792c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0300b5550 0x7fe03014cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe03792c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03015e4f0 con 0x7fe0300cf160 2023-11-04T01:38:45.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe03792c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03015e790 con 0x7fe0300b5550 2023-11-04T01:38:45.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe03792c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03015ea70 con 0x7fe03015ce60 2023-11-04T01:38:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe0356c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300cf160 0x7fe0301f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe0356c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300cf160 0x7fe0301f3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38124/0 (socket says 172.21.15.44:38124) 2023-11-04T01:38:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe0356c8640 1 -- 172.21.15.44:0/3541781782 learned_addr learned my addr 172.21.15.44:0/3541781782 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe035ec9640 1 --2- 172.21.15.44:0/3541781782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0300b5550 0x7fe03014cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe034ec7640 1 --2- 172.21.15.44:0/3541781782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03015ce60 0x7fe0300cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe0356c8640 1 -- 172.21.15.44:0/3541781782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03015ce60 msgr2=0x7fe0300cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe0356c8640 1 --2- 172.21.15.44:0/3541781782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03015ce60 0x7fe0300cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe0356c8640 1 -- 172.21.15.44:0/3541781782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0300b5550 msgr2=0x7fe03014cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe0356c8640 1 --2- 172.21.15.44:0/3541781782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0300b5550 0x7fe03014cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe0356c8640 1 -- 172.21.15.44:0/3541781782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe028009400 con 0x7fe0300cf160 2023-11-04T01:38:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.457+0000 7fe0356c8640 1 --2- 172.21.15.44:0/3541781782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300cf160 0x7fe0301f3ae0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe020000f80 tx=0x7fe020004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.458+0000 7fe02dffb640 1 -- 172.21.15.44:0/3541781782 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe020009510 con 0x7fe0300cf160 2023-11-04T01:38:45.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.458+0000 7fe02dffb640 1 -- 172.21.15.44:0/3541781782 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02003e450 con 0x7fe0300cf160 2023-11-04T01:38:45.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.458+0000 7fe02dffb640 1 -- 172.21.15.44:0/3541781782 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02003e800 con 0x7fe0300cf160 2023-11-04T01:38:45.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.458+0000 7fe03792c640 1 -- 172.21.15.44:0/3541781782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe020009b30 con 0x7fe0300cf160 2023-11-04T01:38:45.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.458+0000 7fe03792c640 1 -- 172.21.15.44:0/3541781782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03015f030 con 0x7fe0300cf160 2023-11-04T01:38:45.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.459+0000 7fe03792c640 1 -- 172.21.15.44:0/3541781782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe030074290 con 0x7fe0300cf160 2023-11-04T01:38:45.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.459+0000 7fe02dffb640 1 -- 172.21.15.44:0/3541781782 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe02003e960 con 0x7fe0300cf160 2023-11-04T01:38:45.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.460+0000 7fe02dffb640 1 --2- 172.21.15.44:0/3541781782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe01c06ae70 0x7fe01c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.460+0000 7fe02dffb640 1 -- 172.21.15.44:0/3541781782 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fe0200ac8b0 con 0x7fe0300cf160 2023-11-04T01:38:45.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.460+0000 7fe034ec7640 1 --2- 172.21.15.44:0/3541781782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe01c06ae70 0x7fe01c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.460+0000 7fe034ec7640 1 --2- 172.21.15.44:0/3541781782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe01c06ae70 0x7fe01c06d330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe0300cd740 tx=0x7fe024007c80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.464+0000 7fe02dffb640 1 -- 172.21.15.44:0/3541781782 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe020077510 con 0x7fe0300cf160 2023-11-04T01:38:45.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.675+0000 7fe03792c640 1 -- 172.21.15.44:0/3541781782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe03006b3e0 con 0x7fe0300cf160 2023-11-04T01:38:45.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.676+0000 7fe02dffb640 1 -- 172.21.15.44:0/3541781782 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fe02007ab30 con 0x7fe0300cf160 2023-11-04T01:38:45.679 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:45.679 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5543,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/1112718006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1112718006},{"type":"v1","addr":"172.21.15.204:6837","nonce":1112718006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5935,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/719128216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":719128216},{"type":"v1","addr":"172.21.15.204:6836","nonce":719128216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3272698261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3272698261},{"type":"v1","addr":"172.21.15.44:6833","nonce":3272698261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:22.129730+0000","modified":"2023-11-04T01:38:24.137808+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/2413284016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2413284016},{"type":"v1","addr":"172.21.15.44:6835","nonce":2413284016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:38:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 31 2023-11-04T01:38:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.678+0000 7fe03792c640 1 -- 172.21.15.44:0/3541781782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe01c06ae70 msgr2=0x7fe01c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.678+0000 7fe03792c640 1 --2- 172.21.15.44:0/3541781782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe01c06ae70 0x7fe01c06d330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe0300cd740 tx=0x7fe024007c80 comp rx=0 tx=0).stop 2023-11-04T01:38:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.678+0000 7fe03792c640 1 -- 172.21.15.44:0/3541781782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300cf160 msgr2=0x7fe0301f3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.678+0000 7fe03792c640 1 --2- 172.21.15.44:0/3541781782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300cf160 0x7fe0301f3ae0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe020000f80 tx=0x7fe020004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.678+0000 7fe03792c640 1 -- 172.21.15.44:0/3541781782 shutdown_connections 2023-11-04T01:38:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.678+0000 7fe03792c640 1 --2- 172.21.15.44:0/3541781782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe01c06ae70 0x7fe01c06d330 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.678+0000 7fe03792c640 1 --2- 172.21.15.44:0/3541781782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0300b5550 0x7fe03014cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.678+0000 7fe03792c640 1 --2- 172.21.15.44:0/3541781782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03015ce60 0x7fe0300cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.678+0000 7fe03792c640 1 --2- 172.21.15.44:0/3541781782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0300cf160 0x7fe0301f3ae0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.678+0000 7fe03792c640 1 -- 172.21.15.44:0/3541781782 >> 172.21.15.44:0/3541781782 conn(0x7fe03006ea90 msgr2=0x7fe0300c5510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:45.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.678+0000 7fe03792c640 1 -- 172.21.15.44:0/3541781782 shutdown_connections 2023-11-04T01:38:45.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.678+0000 7fe03792c640 1 -- 172.21.15.44:0/3541781782 wait complete. 2023-11-04T01:38:45.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:45.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.795+0000 7f3b3ab3c640 1 Processor -- start 2023-11-04T01:38:45.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.795+0000 7f3b3ab3c640 1 -- start start 2023-11-04T01:38:45.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.796+0000 7f3b3ab3c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b340ce240 0x7f3b34157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.796+0000 7f3b3ab3c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3b34157540 0x7f3b340d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.796+0000 7f3b3ab3c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3415e000 con 0x7f3b340cde60 2023-11-04T01:38:45.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.796+0000 7f3b3ab3c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3415e5c0 con 0x7f3b34157540 2023-11-04T01:38:45.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.796+0000 7f3b3ab3c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3415e2e0 con 0x7f3b340ce240 2023-11-04T01:38:45.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.796+0000 7f3b390d9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3b34157540 0x7f3b340d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.796+0000 7f3b388d8640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3b340cde60 0x7f3b3415d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37438/0 (socket says 172.21.15.44:37438) 2023-11-04T01:38:45.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.796+0000 7f3b390d9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3b34157540 0x7f3b340d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38136/0 (socket says 172.21.15.44:38136) 2023-11-04T01:38:45.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.796+0000 7f3b388d8640 1 -- 172.21.15.44:0/1690596676 learned_addr learned my addr 172.21.15.44:0/1690596676 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:45.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.797+0000 7f3b33fff640 1 --2- 172.21.15.44:0/1690596676 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b340ce240 0x7f3b34157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.797+0000 7f3b390d9640 1 -- 172.21.15.44:0/1690596676 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b340ce240 msgr2=0x7f3b34157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:45.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.797+0000 7f3b390d9640 1 --2- 172.21.15.44:0/1690596676 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b340ce240 0x7f3b34157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.797+0000 7f3b390d9640 1 -- 172.21.15.44:0/1690596676 >> v1:172.21.15.44:6789/0 conn(0x7f3b340cde60 legacy=0x7f3b3415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.797+0000 7f3b390d9640 1 -- 172.21.15.44:0/1690596676 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b340d1120 con 0x7f3b34157540 2023-11-04T01:38:45.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.797+0000 7f3b337fe640 1 -- 172.21.15.44:0/1690596676 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795512713 0 0) 0x7f3b3415e000 con 0x7f3b340cde60 2023-11-04T01:38:45.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.798+0000 7f3b390d9640 1 --2- 172.21.15.44:0/1690596676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b34157540 0x7f3b340d1920 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f3b240097a0 tx=0x7f3b2402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f97e6a99cf26fac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.798+0000 7f3b337fe640 1 -- 172.21.15.44:0/1690596676 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24031830 con 0x7f3b34157540 2023-11-04T01:38:45.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.798+0000 7f3b337fe640 1 -- 172.21.15.44:0/1690596676 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b24031990 con 0x7f3b34157540 2023-11-04T01:38:45.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.798+0000 7f3b337fe640 1 -- 172.21.15.44:0/1690596676 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24031d20 con 0x7f3b34157540 2023-11-04T01:38:45.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.798+0000 7f3b3ab3c640 1 -- 172.21.15.44:0/1690596676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b34157540 msgr2=0x7f3b340d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.798+0000 7f3b3ab3c640 1 --2- 172.21.15.44:0/1690596676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b34157540 0x7f3b340d1920 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f3b240097a0 tx=0x7f3b2402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.798+0000 7f3b3ab3c640 1 -- 172.21.15.44:0/1690596676 shutdown_connections 2023-11-04T01:38:45.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.798+0000 7f3b3ab3c640 1 --2- 172.21.15.44:0/1690596676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b34157540 0x7f3b340d1920 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.798+0000 7f3b3ab3c640 1 --2- 172.21.15.44:0/1690596676 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b340ce240 0x7f3b34157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.798+0000 7f3b3ab3c640 1 -- 172.21.15.44:0/1690596676 >> 172.21.15.44:0/1690596676 conn(0x7f3b34071f30 msgr2=0x7f3b340cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:45.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.798+0000 7f3b3ab3c640 1 -- 172.21.15.44:0/1690596676 shutdown_connections 2023-11-04T01:38:45.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.798+0000 7f3b3ab3c640 1 -- 172.21.15.44:0/1690596676 wait complete. 2023-11-04T01:38:45.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.799+0000 7f3b3ab3c640 1 Processor -- start 2023-11-04T01:38:45.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.799+0000 7f3b3ab3c640 1 -- start start 2023-11-04T01:38:45.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.800+0000 7f3b3ab3c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b340cde60 0x7f3b341f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.800+0000 7f3b3ab3c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b340ce240 0x7f3b34149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.800+0000 7f3b3ab3c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b34157540 0x7f3b340cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.800+0000 7f3b3ab3c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b341f36b0 con 0x7f3b340ce240 2023-11-04T01:38:45.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.800+0000 7f3b3ab3c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340c7a40 con 0x7f3b340cde60 2023-11-04T01:38:45.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.800+0000 7f3b3ab3c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340c6e30 con 0x7f3b34157540 2023-11-04T01:38:45.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.800+0000 7f3b33fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b340ce240 0x7f3b34149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.800+0000 7f3b33fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b340ce240 0x7f3b34149190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38146/0 (socket says 172.21.15.44:38146) 2023-11-04T01:38:45.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.800+0000 7f3b33fff640 1 -- 172.21.15.44:0/1678462360 learned_addr learned my addr 172.21.15.44:0/1678462360 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:45.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.801+0000 7f3b390d9640 1 --2- 172.21.15.44:0/1678462360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b34157540 0x7f3b340cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.801+0000 7f3b388d8640 1 --2- 172.21.15.44:0/1678462360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b340cde60 0x7f3b341f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.801+0000 7f3b33fff640 1 -- 172.21.15.44:0/1678462360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b34157540 msgr2=0x7f3b340cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.801+0000 7f3b33fff640 1 --2- 172.21.15.44:0/1678462360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b34157540 0x7f3b340cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.801+0000 7f3b33fff640 1 -- 172.21.15.44:0/1678462360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b340cde60 msgr2=0x7f3b341f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.801+0000 7f3b33fff640 1 --2- 172.21.15.44:0/1678462360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b340cde60 0x7f3b341f3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.801+0000 7f3b33fff640 1 -- 172.21.15.44:0/1678462360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b24009400 con 0x7f3b340ce240 2023-11-04T01:38:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.801+0000 7f3b388d8640 1 --2- 172.21.15.44:0/1678462360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b340cde60 0x7f3b341f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.801+0000 7f3b33fff640 1 --2- 172.21.15.44:0/1678462360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b340ce240 0x7f3b34149190 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00e9b0 tx=0x7f3b1c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.801+0000 7f3b317fa640 1 -- 172.21.15.44:0/1678462360 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c009670 con 0x7f3b340ce240 2023-11-04T01:38:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.801+0000 7f3b317fa640 1 -- 172.21.15.44:0/1678462360 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c00c9a0 con 0x7f3b340ce240 2023-11-04T01:38:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.801+0000 7f3b3ab3c640 1 -- 172.21.15.44:0/1678462360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b340c7110 con 0x7f3b340ce240 2023-11-04T01:38:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.801+0000 7f3b317fa640 1 -- 172.21.15.44:0/1678462360 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c00cd50 con 0x7f3b340ce240 2023-11-04T01:38:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.801+0000 7f3b3ab3c640 1 -- 172.21.15.44:0/1678462360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b340c76d0 con 0x7f3b340ce240 2023-11-04T01:38:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.802+0000 7f3b3ab3c640 1 -- 172.21.15.44:0/1678462360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b34074290 con 0x7f3b340ce240 2023-11-04T01:38:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.803+0000 7f3b317fa640 1 -- 172.21.15.44:0/1678462360 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b1c013470 con 0x7f3b340ce240 2023-11-04T01:38:45.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.803+0000 7f3b317fa640 1 --2- 172.21.15.44:0/1678462360 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b1406ae70 0x7f3b1406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.803+0000 7f3b317fa640 1 -- 172.21.15.44:0/1678462360 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f3b1c089da0 con 0x7f3b340ce240 2023-11-04T01:38:45.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.803+0000 7f3b388d8640 1 --2- 172.21.15.44:0/1678462360 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b1406ae70 0x7f3b1406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.804+0000 7f3b388d8640 1 --2- 172.21.15.44:0/1678462360 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b1406ae70 0x7f3b1406d330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0012e0 tx=0x7f3b2c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.807+0000 7f3b317fa640 1 -- 172.21.15.44:0/1678462360 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b1c0548d0 con 0x7f3b340ce240 2023-11-04T01:38:45.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.985+0000 7f3b3ab3c640 1 -- 172.21.15.44:0/1678462360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b340d3d00 con 0x7f3b340ce240 2023-11-04T01:38:45.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.987+0000 7f3b317fa640 1 -- 172.21.15.44:0/1678462360 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+22057 (secure 0 0 0) 0x7f3b1c017090 con 0x7f3b340ce240 2023-11-04T01:38:45.989 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:45.989 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":72,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:38:44.189352+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:20.738739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:21.109334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.989+0000 7f3b3ab3c640 1 -- 172.21.15.44:0/1678462360 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b1406ae70 msgr2=0x7f3b1406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.989+0000 7f3b3ab3c640 1 --2- 172.21.15.44:0/1678462360 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b1406ae70 0x7f3b1406d330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0012e0 tx=0x7f3b2c009040 comp rx=0 tx=0).stop 2023-11-04T01:38:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.989+0000 7f3b3ab3c640 1 -- 172.21.15.44:0/1678462360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b340ce240 msgr2=0x7f3b34149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.989+0000 7f3b3ab3c640 1 --2- 172.21.15.44:0/1678462360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b340ce240 0x7f3b34149190 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00e9b0 tx=0x7f3b1c00ee70 comp rx=0 tx=0).stop 2023-11-04T01:38:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.989+0000 7f3b3ab3c640 1 -- 172.21.15.44:0/1678462360 shutdown_connections 2023-11-04T01:38:45.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.989+0000 7f3b3ab3c640 1 --2- 172.21.15.44:0/1678462360 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b1406ae70 0x7f3b1406d330 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.989+0000 7f3b3ab3c640 1 --2- 172.21.15.44:0/1678462360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b34157540 0x7f3b340cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.989+0000 7f3b3ab3c640 1 --2- 172.21.15.44:0/1678462360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b340ce240 0x7f3b34149190 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.989+0000 7f3b3ab3c640 1 --2- 172.21.15.44:0/1678462360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b340cde60 0x7f3b341f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.989+0000 7f3b3ab3c640 1 -- 172.21.15.44:0/1678462360 >> 172.21.15.44:0/1678462360 conn(0x7f3b34071f30 msgr2=0x7f3b34072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:45.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.989+0000 7f3b3ab3c640 1 -- 172.21.15.44:0/1678462360 shutdown_connections 2023-11-04T01:38:45.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:45.989+0000 7f3b3ab3c640 1 -- 172.21.15.44:0/1678462360 wait complete. 2023-11-04T01:38:46.002 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:38:46.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.107+0000 7f38941d7640 1 Processor -- start 2023-11-04T01:38:46.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.108+0000 7f38941d7640 1 -- start start 2023-11-04T01:38:46.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.108+0000 7f38941d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f388c0cdc20 0x7f388c165950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f38941d7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f388c0d0280 con 0x7f388c15e430 2023-11-04T01:38:46.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f38941d7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f388c0cf670 con 0x7f388c0d0710 2023-11-04T01:38:46.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f38941d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388c0cf950 con 0x7f388c0cdc20 2023-11-04T01:38:46.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3891f73640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f388c15e430 0x7f388c0cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37448/0 (socket says 172.21.15.44:37448) 2023-11-04T01:38:46.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3891f73640 1 -- 172.21.15.44:0/1919570304 learned_addr learned my addr 172.21.15.44:0/1919570304 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:46.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3892774640 1 --2- 172.21.15.44:0/1919570304 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f388c0cdc20 0x7f388c165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3890f71640 1 -- 172.21.15.44:0/1919570304 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92382029 0 0) 0x7f388c0d0280 con 0x7f388c15e430 2023-11-04T01:38:46.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3890f71640 1 -- 172.21.15.44:0/1919570304 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3878003520 con 0x7f388c15e430 2023-11-04T01:38:46.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3890f71640 1 -- 172.21.15.44:0/1919570304 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3478549726 0 0) 0x7f3878003520 con 0x7f388c15e430 2023-11-04T01:38:46.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3890f71640 1 -- 172.21.15.44:0/1919570304 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f388c0cdc20 msgr2=0x7f388c165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:46.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3890f71640 1 --2- 172.21.15.44:0/1919570304 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f388c0cdc20 0x7f388c165950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3890f71640 1 -- 172.21.15.44:0/1919570304 >> v1:172.21.15.204:6789/0 conn(0x7f388c0d0710 legacy=0x7f388c0cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3890f71640 1 -- 172.21.15.44:0/1919570304 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c0cfc30 con 0x7f388c15e430 2023-11-04T01:38:46.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3890f71640 1 -- 172.21.15.44:0/1919570304 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f3888001670 con 0x7f388c15e430 2023-11-04T01:38:46.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3890f71640 1 -- 172.21.15.44:0/1919570304 >> v1:172.21.15.44:6789/0 conn(0x7f388c15e430 legacy=0x7f388c0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3890f71640 1 --2- 172.21.15.44:0/1919570304 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f388c0cdc20 0x7f38780039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3890f71640 1 --2- 172.21.15.44:0/1919570304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3878003f20 0x7f38780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3890f71640 1 --2- 172.21.15.44:0/1919570304 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3878004d00 0x7f3878005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3890f71640 1 -- 172.21.15.44:0/1919570304 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c0cf950 con 0x7f3878003f20 2023-11-04T01:38:46.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3890f71640 1 -- 172.21.15.44:0/1919570304 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387800ba60 con 0x7f3878004d00 2023-11-04T01:38:46.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3890f71640 1 -- 172.21.15.44:0/1919570304 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387800bc20 con 0x7f388c0cdc20 2023-11-04T01:38:46.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.109+0000 7f3891772640 1 --2- 172.21.15.44:0/1919570304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3878003f20 0x7f38780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.110+0000 7f3891f73640 1 --2- 172.21.15.44:0/1919570304 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f388c0cdc20 0x7f38780039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.110+0000 7f3892774640 1 --2- 172.21.15.44:0/1919570304 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3878004d00 0x7f3878005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.110+0000 7f3891772640 1 -- 172.21.15.44:0/1919570304 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f388c0cdc20 msgr2=0x7f38780039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:46.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.110+0000 7f3891772640 1 --2- 172.21.15.44:0/1919570304 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f388c0cdc20 0x7f38780039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.110+0000 7f3891772640 1 -- 172.21.15.44:0/1919570304 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3878004d00 msgr2=0x7f3878005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:46.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.110+0000 7f3891772640 1 --2- 172.21.15.44:0/1919570304 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3878004d00 0x7f3878005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.110+0000 7f3891772640 1 -- 172.21.15.44:0/1919570304 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3878003520 con 0x7f3878003f20 2023-11-04T01:38:46.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.111+0000 7f3891772640 1 --2- 172.21.15.44:0/1919570304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3878003f20 0x7f38780047c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f387c001750 tx=0x7f38780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd422001cb81ba06 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.111+0000 7f3890f71640 1 -- 172.21.15.44:0/1919570304 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c0052d0 con 0x7f3878003f20 2023-11-04T01:38:46.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.111+0000 7f3890f71640 1 -- 172.21.15.44:0/1919570304 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387c02e050 con 0x7f3878003f20 2023-11-04T01:38:46.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.111+0000 7f3890f71640 1 -- 172.21.15.44:0/1919570304 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c003830 con 0x7f3878003f20 2023-11-04T01:38:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.111+0000 7f38941d7640 1 -- 172.21.15.44:0/1919570304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3878003f20 msgr2=0x7f38780047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.111+0000 7f38941d7640 1 --2- 172.21.15.44:0/1919570304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3878003f20 0x7f38780047c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f387c001750 tx=0x7f38780057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.111+0000 7f3892774640 1 -- 172.21.15.44:0/1919570304 reap_dead start 2023-11-04T01:38:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.111+0000 7f38941d7640 1 -- 172.21.15.44:0/1919570304 shutdown_connections 2023-11-04T01:38:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.111+0000 7f38941d7640 1 -- 172.21.15.44:0/1919570304 >> 172.21.15.44:0/1919570304 conn(0x7f388c06ea20 msgr2=0x7f388c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.111+0000 7f38941d7640 1 -- 172.21.15.44:0/1919570304 shutdown_connections 2023-11-04T01:38:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.111+0000 7f38941d7640 1 -- 172.21.15.44:0/1919570304 wait complete. 2023-11-04T01:38:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.112+0000 7f38941d7640 1 Processor -- start 2023-11-04T01:38:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.112+0000 7f38941d7640 1 -- start start 2023-11-04T01:38:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.113+0000 7f38941d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3878003f20 0x7f388c1e4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.113+0000 7f38941d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f388c1f6200 0x7f388c06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.113+0000 7f38941d7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f388c1f6660 0x7f388c06cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.113+0000 7f38941d7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c1e38c0 con 0x7f388c1f6200 2023-11-04T01:38:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.113+0000 7f38941d7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c1e3ba0 con 0x7f388c1f6660 2023-11-04T01:38:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.113+0000 7f38941d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388c1e3e80 con 0x7f3878003f20 2023-11-04T01:38:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.113+0000 7f3891772640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f388c1f6200 0x7f388c06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.113+0000 7f3891772640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f388c1f6200 0x7f388c06c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38166/0 (socket says 172.21.15.44:38166) 2023-11-04T01:38:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.113+0000 7f3891772640 1 -- 172.21.15.44:0/1590642483 learned_addr learned my addr 172.21.15.44:0/1590642483 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.113+0000 7f3891f73640 1 --2- 172.21.15.44:0/1590642483 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3878003f20 0x7f388c1e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.113+0000 7f3892774640 1 --2- 172.21.15.44:0/1590642483 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f388c1f6660 0x7f388c06cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.114+0000 7f3891772640 1 -- 172.21.15.44:0/1590642483 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3878003f20 msgr2=0x7f388c1e4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.114+0000 7f3891772640 1 --2- 172.21.15.44:0/1590642483 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3878003f20 0x7f388c1e4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.114+0000 7f3891772640 1 -- 172.21.15.44:0/1590642483 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f388c1f6660 msgr2=0x7f388c06cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.114+0000 7f3891772640 1 --2- 172.21.15.44:0/1590642483 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f388c1f6660 0x7f388c06cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.114+0000 7f3891772640 1 -- 172.21.15.44:0/1590642483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c1e4160 con 0x7f388c1f6200 2023-11-04T01:38:46.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.114+0000 7f3891772640 1 --2- 172.21.15.44:0/1590642483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f388c1f6200 0x7f388c06c9a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f387c008fd0 tx=0x7f387c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.114+0000 7f38827fc640 1 -- 172.21.15.44:0/1590642483 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c0076c0 con 0x7f388c1f6200 2023-11-04T01:38:46.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.114+0000 7f38827fc640 1 -- 172.21.15.44:0/1590642483 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387c007a30 con 0x7f388c1f6200 2023-11-04T01:38:46.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.114+0000 7f38941d7640 1 -- 172.21.15.44:0/1590642483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388c1e4440 con 0x7f388c1f6200 2023-11-04T01:38:46.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.114+0000 7f38827fc640 1 -- 172.21.15.44:0/1590642483 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c006c00 con 0x7f388c1f6200 2023-11-04T01:38:46.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.114+0000 7f38941d7640 1 -- 172.21.15.44:0/1590642483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f388c1e35b0 con 0x7f388c1f6200 2023-11-04T01:38:46.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.115+0000 7f38941d7640 1 -- 172.21.15.44:0/1590642483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388c074290 con 0x7f388c1f6200 2023-11-04T01:38:46.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.115+0000 7f38827fc640 1 -- 172.21.15.44:0/1590642483 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f387c0035f0 con 0x7f388c1f6200 2023-11-04T01:38:46.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.116+0000 7f38827fc640 1 --2- 172.21.15.44:0/1590642483 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f387006aea0 0x7f387006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.116+0000 7f38827fc640 1 -- 172.21.15.44:0/1590642483 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f387c0abb60 con 0x7f388c1f6200 2023-11-04T01:38:46.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.116+0000 7f3891f73640 1 --2- 172.21.15.44:0/1590642483 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f387006aea0 0x7f387006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.117+0000 7f3891f73640 1 --2- 172.21.15.44:0/1590642483 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f387006aea0 0x7f387006d360 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3888001c10 tx=0x7f3888001b20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.120+0000 7f38827fc640 1 -- 172.21.15.44:0/1590642483 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f387c076740 con 0x7f388c1f6200 2023-11-04T01:38:46.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.334+0000 7f38941d7640 1 -- 172.21.15.44:0/1590642483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f388c1e3fc0 con 0x7f388c1f6200 2023-11-04T01:38:46.336 INFO:tasks.ceph.mon.a.smithi044.stderr:2023-11-04T01:38:46.334+0000 7fd852594640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:38:46.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.335+0000 7f38827fc640 1 -- 172.21.15.44:0/1590642483 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7f388c1e3fc0 con 0x7f388c1f6200 2023-11-04T01:38:46.337 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:38:46.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.338+0000 7f38941d7640 1 -- 172.21.15.44:0/1590642483 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f387006aea0 msgr2=0x7f387006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.338+0000 7f38941d7640 1 --2- 172.21.15.44:0/1590642483 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f387006aea0 0x7f387006d360 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3888001c10 tx=0x7f3888001b20 comp rx=0 tx=0).stop 2023-11-04T01:38:46.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.338+0000 7f38941d7640 1 -- 172.21.15.44:0/1590642483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f388c1f6200 msgr2=0x7f388c06c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.338+0000 7f38941d7640 1 --2- 172.21.15.44:0/1590642483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f388c1f6200 0x7f388c06c9a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f387c008fd0 tx=0x7f387c001120 comp rx=0 tx=0).stop 2023-11-04T01:38:46.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.339+0000 7f38941d7640 1 -- 172.21.15.44:0/1590642483 shutdown_connections 2023-11-04T01:38:46.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.339+0000 7f38941d7640 1 --2- 172.21.15.44:0/1590642483 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f387006aea0 0x7f387006d360 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.339+0000 7f38941d7640 1 --2- 172.21.15.44:0/1590642483 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f388c1f6660 0x7f388c06cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.339+0000 7f38941d7640 1 --2- 172.21.15.44:0/1590642483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f388c1f6200 0x7f388c06c9a0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.339+0000 7f38941d7640 1 --2- 172.21.15.44:0/1590642483 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3878003f20 0x7f388c1e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.339+0000 7f38941d7640 1 -- 172.21.15.44:0/1590642483 >> 172.21.15.44:0/1590642483 conn(0x7f388c06ea20 msgr2=0x7f388c0b3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:46.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.339+0000 7f38941d7640 1 -- 172.21.15.44:0/1590642483 shutdown_connections 2023-11-04T01:38:46.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.339+0000 7f38941d7640 1 -- 172.21.15.44:0/1590642483 wait complete. 2023-11-04T01:38:46.342 INFO:tasks.ceph.mds.a.smithi044.stderr: -834> 2023-11-04T01:38:28.759+0000 7fef9dbaf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:38:46.355 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:38:46.369 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2023-11-04T01:38:46.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.462+0000 7f86f3aa2640 1 Processor -- start 2023-11-04T01:38:46.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.463+0000 7f86f3aa2640 1 -- start start 2023-11-04T01:38:46.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.463+0000 7f86f3aa2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86ec0cd6d0 0x7f86ec161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.463+0000 7f86f3aa2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ec0cde60 con 0x7f86ec0b4880 2023-11-04T01:38:46.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.463+0000 7f86f3aa2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ec160f90 con 0x7f86ec153e60 2023-11-04T01:38:46.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.463+0000 7f86f3aa2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec161960 con 0x7f86ec0cd6d0 2023-11-04T01:38:46.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f203f640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f86ec0b4880 0x7f86ec0b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37472/0 (socket says 172.21.15.44:37472) 2023-11-04T01:38:46.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f203f640 1 -- 172.21.15.44:0/3303990896 learned_addr learned my addr 172.21.15.44:0/3303990896 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:46.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f103d640 1 --2- 172.21.15.44:0/3303990896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86ec0cd6d0 0x7f86ec161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f083c640 1 -- 172.21.15.44:0/3303990896 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686189201 0 0) 0x7f86ec0cde60 con 0x7f86ec0b4880 2023-11-04T01:38:46.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f083c640 1 -- 172.21.15.44:0/3303990896 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86d4003520 con 0x7f86ec0b4880 2023-11-04T01:38:46.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f083c640 1 -- 172.21.15.44:0/3303990896 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2287214370 0 0) 0x7f86d4003520 con 0x7f86ec0b4880 2023-11-04T01:38:46.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f083c640 1 -- 172.21.15.44:0/3303990896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86ec0cd6d0 msgr2=0x7f86ec161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:46.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f083c640 1 --2- 172.21.15.44:0/3303990896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86ec0cd6d0 0x7f86ec161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f083c640 1 -- 172.21.15.44:0/3303990896 >> v1:172.21.15.204:6789/0 conn(0x7f86ec153e60 legacy=0x7f86ec15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f083c640 1 -- 172.21.15.44:0/3303990896 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec0ce090 con 0x7f86ec0b4880 2023-11-04T01:38:46.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f083c640 1 -- 172.21.15.44:0/3303990896 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f86dc0019f0 con 0x7f86ec0b4880 2023-11-04T01:38:46.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f083c640 1 -- 172.21.15.44:0/3303990896 >> v1:172.21.15.44:6789/0 conn(0x7f86ec0b4880 legacy=0x7f86ec0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f083c640 1 --2- 172.21.15.44:0/3303990896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86ec0cd6d0 0x7f86d40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f083c640 1 --2- 172.21.15.44:0/3303990896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86d4003f20 0x7f86d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f083c640 1 --2- 172.21.15.44:0/3303990896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86d4004d00 0x7f86d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f083c640 1 -- 172.21.15.44:0/3303990896 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec161960 con 0x7f86d4004d00 2023-11-04T01:38:46.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f083c640 1 -- 172.21.15.44:0/3303990896 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d400ba60 con 0x7f86d4003f20 2023-11-04T01:38:46.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f083c640 1 -- 172.21.15.44:0/3303990896 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d400bc20 con 0x7f86ec0cd6d0 2023-11-04T01:38:46.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f203f640 1 --2- 172.21.15.44:0/3303990896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86d4004d00 0x7f86d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.464+0000 7f86f183e640 1 --2- 172.21.15.44:0/3303990896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86ec0cd6d0 0x7f86d40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.465+0000 7f86f103d640 1 --2- 172.21.15.44:0/3303990896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86d4003f20 0x7f86d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.465+0000 7f86f203f640 1 -- 172.21.15.44:0/3303990896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86ec0cd6d0 msgr2=0x7f86d40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:46.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.465+0000 7f86f203f640 1 --2- 172.21.15.44:0/3303990896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86ec0cd6d0 0x7f86d40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.465+0000 7f86f203f640 1 -- 172.21.15.44:0/3303990896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86d4003f20 msgr2=0x7f86d40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:46.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.465+0000 7f86f203f640 1 --2- 172.21.15.44:0/3303990896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86d4003f20 0x7f86d40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.465+0000 7f86f203f640 1 -- 172.21.15.44:0/3303990896 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d4003520 con 0x7f86d4004d00 2023-11-04T01:38:46.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.465+0000 7f86f103d640 1 --2- 172.21.15.44:0/3303990896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86d4003f20 0x7f86d40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:46.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.465+0000 7f86f203f640 1 --2- 172.21.15.44:0/3303990896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86d4004d00 0x7f86d4005180 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00a820 tx=0x7f86d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6953d6b2594cdc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.466+0000 7f86f083c640 1 -- 172.21.15.44:0/3303990896 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0072d0 con 0x7f86d4004d00 2023-11-04T01:38:46.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.466+0000 7f86f083c640 1 -- 172.21.15.44:0/3303990896 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc02f070 con 0x7f86d4004d00 2023-11-04T01:38:46.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.466+0000 7f86f083c640 1 -- 172.21.15.44:0/3303990896 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0076f0 con 0x7f86d4004d00 2023-11-04T01:38:46.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.466+0000 7f86f3aa2640 1 -- 172.21.15.44:0/3303990896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86d4004d00 msgr2=0x7f86d4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.466+0000 7f86f3aa2640 1 --2- 172.21.15.44:0/3303990896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86d4004d00 0x7f86d4005180 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00a820 tx=0x7f86d40057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.466+0000 7f86f203f640 1 -- 172.21.15.44:0/3303990896 reap_dead start 2023-11-04T01:38:46.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.466+0000 7f86f3aa2640 1 -- 172.21.15.44:0/3303990896 shutdown_connections 2023-11-04T01:38:46.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.466+0000 7f86f3aa2640 1 -- 172.21.15.44:0/3303990896 >> 172.21.15.44:0/3303990896 conn(0x7f86ec0cf880 msgr2=0x7f86ec0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:46.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.466+0000 7f86f3aa2640 1 -- 172.21.15.44:0/3303990896 shutdown_connections 2023-11-04T01:38:46.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.466+0000 7f86f3aa2640 1 -- 172.21.15.44:0/3303990896 wait complete. 2023-11-04T01:38:46.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.467+0000 7f86f3aa2640 1 Processor -- start 2023-11-04T01:38:46.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.467+0000 7f86f3aa2640 1 -- start start 2023-11-04T01:38:46.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f3aa2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86ec0c8d70 0x7f86ec0cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f3aa2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86ec0c9150 0x7f86ec0cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f3aa2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86ec0c52c0 0x7f86ec0c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f3aa2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0c5c80 con 0x7f86ec0c8d70 2023-11-04T01:38:46.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f3aa2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0ccc30 con 0x7f86ec0c9150 2023-11-04T01:38:46.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f3aa2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0cc670 con 0x7f86ec0c52c0 2023-11-04T01:38:46.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f183e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86ec0c8d70 0x7f86ec0cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f183e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86ec0c8d70 0x7f86ec0cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38204/0 (socket says 172.21.15.44:38204) 2023-11-04T01:38:46.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f183e640 1 -- 172.21.15.44:0/1028892131 learned_addr learned my addr 172.21.15.44:0/1028892131 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:46.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f203f640 1 --2- 172.21.15.44:0/1028892131 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86ec0c52c0 0x7f86ec0c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f103d640 1 --2- 172.21.15.44:0/1028892131 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86ec0c9150 0x7f86ec0cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f183e640 1 -- 172.21.15.44:0/1028892131 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86ec0c52c0 msgr2=0x7f86ec0c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f183e640 1 --2- 172.21.15.44:0/1028892131 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86ec0c52c0 0x7f86ec0c5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f183e640 1 -- 172.21.15.44:0/1028892131 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86ec0c9150 msgr2=0x7f86ec0cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f183e640 1 --2- 172.21.15.44:0/1028892131 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86ec0c9150 0x7f86ec0cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f183e640 1 -- 172.21.15.44:0/1028892131 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec0cc950 con 0x7f86ec0c8d70 2023-11-04T01:38:46.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.468+0000 7f86f203f640 1 --2- 172.21.15.44:0/1028892131 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86ec0c52c0 0x7f86ec0c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:46.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.469+0000 7f86f183e640 1 --2- 172.21.15.44:0/1028892131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86ec0c8d70 0x7f86ec0cba20 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f86e400f820 tx=0x7f86e400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.469+0000 7f86ea7fc640 1 -- 172.21.15.44:0/1028892131 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e40050d0 con 0x7f86ec0c8d70 2023-11-04T01:38:46.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.469+0000 7f86ea7fc640 1 -- 172.21.15.44:0/1028892131 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e4005230 con 0x7f86ec0c8d70 2023-11-04T01:38:46.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.469+0000 7f86ea7fc640 1 -- 172.21.15.44:0/1028892131 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e400d730 con 0x7f86ec0c8d70 2023-11-04T01:38:46.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.469+0000 7f86f3aa2640 1 -- 172.21.15.44:0/1028892131 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ec1545d0 con 0x7f86ec0c8d70 2023-11-04T01:38:46.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.469+0000 7f86f3aa2640 1 -- 172.21.15.44:0/1028892131 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec1f6000 con 0x7f86ec0c8d70 2023-11-04T01:38:46.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.470+0000 7f86f3aa2640 1 -- 172.21.15.44:0/1028892131 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ec074290 con 0x7f86ec0c8d70 2023-11-04T01:38:46.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.470+0000 7f86ea7fc640 1 -- 172.21.15.44:0/1028892131 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f86e400d890 con 0x7f86ec0c8d70 2023-11-04T01:38:46.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.471+0000 7f86ea7fc640 1 --2- 172.21.15.44:0/1028892131 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f86d806aea0 0x7f86d806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.471+0000 7f86ea7fc640 1 -- 172.21.15.44:0/1028892131 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f86e4089b70 con 0x7f86ec0c8d70 2023-11-04T01:38:46.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.471+0000 7f86f103d640 1 --2- 172.21.15.44:0/1028892131 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f86d806aea0 0x7f86d806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.472+0000 7f86f103d640 1 --2- 172.21.15.44:0/1028892131 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f86d806aea0 0x7f86d806d360 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0c9830 tx=0x7f86e0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.475+0000 7f86ea7fc640 1 -- 172.21.15.44:0/1028892131 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f86e4054660 con 0x7f86ec0c8d70 2023-11-04T01:38:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:46.687+0000 7f86f3aa2640 1 -- 172.21.15.44:0/1028892131 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f86ec0d0b80 con 0x7f86ec0c8d70 2023-11-04T01:38:47.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.343+0000 7f86ea7fc640 1 -- 172.21.15.44:0/1028892131 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f86e4057c80 con 0x7f86ec0c8d70 2023-11-04T01:38:47.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.345+0000 7f86f3aa2640 1 -- 172.21.15.44:0/1028892131 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f86d806aea0 msgr2=0x7f86d806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.345+0000 7f86f3aa2640 1 --2- 172.21.15.44:0/1028892131 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f86d806aea0 0x7f86d806d360 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0c9830 tx=0x7f86e0008040 comp rx=0 tx=0).stop 2023-11-04T01:38:47.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.345+0000 7f86f3aa2640 1 -- 172.21.15.44:0/1028892131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86ec0c8d70 msgr2=0x7f86ec0cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.346+0000 7f86f3aa2640 1 --2- 172.21.15.44:0/1028892131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86ec0c8d70 0x7f86ec0cba20 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f86e400f820 tx=0x7f86e400fce0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.346+0000 7f86f3aa2640 1 -- 172.21.15.44:0/1028892131 shutdown_connections 2023-11-04T01:38:47.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.346+0000 7f86f3aa2640 1 --2- 172.21.15.44:0/1028892131 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f86d806aea0 0x7f86d806d360 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.346+0000 7f86f3aa2640 1 --2- 172.21.15.44:0/1028892131 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86ec0c52c0 0x7f86ec0c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.346+0000 7f86f3aa2640 1 --2- 172.21.15.44:0/1028892131 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86ec0c9150 0x7f86ec0cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.346+0000 7f86f3aa2640 1 --2- 172.21.15.44:0/1028892131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86ec0c8d70 0x7f86ec0cba20 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.346+0000 7f86f3aa2640 1 -- 172.21.15.44:0/1028892131 >> 172.21.15.44:0/1028892131 conn(0x7f86ec0cf880 msgr2=0x7f86ec0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:47.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.346+0000 7f86f3aa2640 1 -- 172.21.15.44:0/1028892131 shutdown_connections 2023-11-04T01:38:47.349 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.346+0000 7f86f3aa2640 1 -- 172.21.15.44:0/1028892131 wait complete. 2023-11-04T01:38:47.360 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:38:47.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.514+0000 7f0a5334c640 1 Processor -- start 2023-11-04T01:38:47.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.514+0000 7f0a5334c640 1 -- start start 2023-11-04T01:38:47.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.515+0000 7f0a5334c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0a4c15d910 0x7f0a4c0d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.515+0000 7f0a5334c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a4c0d1320 con 0x7f0a4c15d4b0 2023-11-04T01:38:47.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.515+0000 7f0a5334c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a4c15df10 con 0x7f0a4c0cd9f0 2023-11-04T01:38:47.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.515+0000 7f0a5334c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4c15e4d0 con 0x7f0a4c15d910 2023-11-04T01:38:47.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.515+0000 7f0a518e9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0a4c15d910 0x7f0a4c0d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.515+0000 7f0a508e7640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0a4c15d4b0 0x7f0a4c0d17b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37480/0 (socket says 172.21.15.44:37480) 2023-11-04T01:38:47.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.515+0000 7f0a508e7640 1 -- 172.21.15.44:0/3739916611 learned_addr learned my addr 172.21.15.44:0/3739916611 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:47.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.515+0000 7f0a518e9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0a4c15d910 0x7f0a4c0d1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38216/0 (socket says 172.21.15.44:38216) 2023-11-04T01:38:47.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.516+0000 7f0a518e9640 1 -- 172.21.15.44:0/3739916611 >> v1:172.21.15.204:6789/0 conn(0x7f0a4c0cd9f0 legacy=0x7f0a4c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.516+0000 7f0a4bfff640 1 -- 172.21.15.44:0/3739916611 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258613097 0 0) 0x7f0a4c0d1320 con 0x7f0a4c15d4b0 2023-11-04T01:38:47.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.516+0000 7f0a518e9640 1 -- 172.21.15.44:0/3739916611 >> v1:172.21.15.44:6789/0 conn(0x7f0a4c15d4b0 legacy=0x7f0a4c0d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.516+0000 7f0a518e9640 1 -- 172.21.15.44:0/3739916611 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c15e1f0 con 0x7f0a4c15d910 2023-11-04T01:38:47.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.516+0000 7f0a518e9640 1 --2- 172.21.15.44:0/3739916611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a4c15d910 0x7f0a4c0d1ec0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009dc0 tx=0x7f0a3c02bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3afa8d1542e508 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.517+0000 7f0a4bfff640 1 -- 172.21.15.44:0/3739916611 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c02cd60 con 0x7f0a4c15d910 2023-11-04T01:38:47.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.517+0000 7f0a4bfff640 1 -- 172.21.15.44:0/3739916611 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c034440 con 0x7f0a4c15d910 2023-11-04T01:38:47.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.517+0000 7f0a4bfff640 1 -- 172.21.15.44:0/3739916611 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c0347d0 con 0x7f0a4c15d910 2023-11-04T01:38:47.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.517+0000 7f0a5334c640 1 -- 172.21.15.44:0/3739916611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a4c15d910 msgr2=0x7f0a4c0d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.517+0000 7f0a5334c640 1 --2- 172.21.15.44:0/3739916611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a4c15d910 0x7f0a4c0d1ec0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009dc0 tx=0x7f0a3c02bfb0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.517+0000 7f0a5334c640 1 -- 172.21.15.44:0/3739916611 shutdown_connections 2023-11-04T01:38:47.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.517+0000 7f0a5334c640 1 --2- 172.21.15.44:0/3739916611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a4c15d910 0x7f0a4c0d1ec0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.517+0000 7f0a5334c640 1 -- 172.21.15.44:0/3739916611 >> 172.21.15.44:0/3739916611 conn(0x7f0a4c071c40 msgr2=0x7f0a4c072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.517+0000 7f0a5334c640 1 -- 172.21.15.44:0/3739916611 shutdown_connections 2023-11-04T01:38:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.517+0000 7f0a5334c640 1 -- 172.21.15.44:0/3739916611 wait complete. 2023-11-04T01:38:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.518+0000 7f0a5334c640 1 Processor -- start 2023-11-04T01:38:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.518+0000 7f0a5334c640 1 -- start start 2023-11-04T01:38:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.519+0000 7f0a5334c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0a4c0cd9f0 0x7f0a4c1efdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.519+0000 7f0a5334c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0a4c15d4b0 0x7f0a4c0cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.519+0000 7f0a5334c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a4c15d910 0x7f0a4c0d1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.519+0000 7f0a5334c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c1f2b80 con 0x7f0a4c15d910 2023-11-04T01:38:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.519+0000 7f0a5334c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c1f2e20 con 0x7f0a4c0cd9f0 2023-11-04T01:38:47.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.519+0000 7f0a5334c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c1f3100 con 0x7f0a4c15d4b0 2023-11-04T01:38:47.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.519+0000 7f0a518e9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a4c15d910 0x7f0a4c0d1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.519+0000 7f0a518e9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a4c15d910 0x7f0a4c0d1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38230/0 (socket says 172.21.15.44:38230) 2023-11-04T01:38:47.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.519+0000 7f0a518e9640 1 -- 172.21.15.44:0/1176766265 learned_addr learned my addr 172.21.15.44:0/1176766265 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:47.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.519+0000 7f0a508e7640 1 --2- 172.21.15.44:0/1176766265 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0a4c15d4b0 0x7f0a4c0cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.519+0000 7f0a510e8640 1 --2- 172.21.15.44:0/1176766265 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0a4c0cd9f0 0x7f0a4c1efdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.520+0000 7f0a518e9640 1 -- 172.21.15.44:0/1176766265 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0a4c15d4b0 msgr2=0x7f0a4c0cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.520+0000 7f0a518e9640 1 --2- 172.21.15.44:0/1176766265 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0a4c15d4b0 0x7f0a4c0cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.520+0000 7f0a518e9640 1 -- 172.21.15.44:0/1176766265 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0a4c0cd9f0 msgr2=0x7f0a4c1efdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.520+0000 7f0a518e9640 1 --2- 172.21.15.44:0/1176766265 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0a4c0cd9f0 0x7f0a4c1efdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.520+0000 7f0a518e9640 1 -- 172.21.15.44:0/1176766265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c009a70 con 0x7f0a4c15d910 2023-11-04T01:38:47.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.520+0000 7f0a518e9640 1 --2- 172.21.15.44:0/1176766265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a4c15d910 0x7f0a4c0d1e90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c037040 tx=0x7f0a3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.520+0000 7f0a49ffb640 1 -- 172.21.15.44:0/1176766265 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c040650 con 0x7f0a4c15d910 2023-11-04T01:38:47.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.520+0000 7f0a49ffb640 1 -- 172.21.15.44:0/1176766265 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c0407b0 con 0x7f0a4c15d910 2023-11-04T01:38:47.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.520+0000 7f0a5334c640 1 -- 172.21.15.44:0/1176766265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4c1f33e0 con 0x7f0a4c15d910 2023-11-04T01:38:47.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.520+0000 7f0a49ffb640 1 -- 172.21.15.44:0/1176766265 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c040b40 con 0x7f0a4c15d910 2023-11-04T01:38:47.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.520+0000 7f0a5334c640 1 -- 172.21.15.44:0/1176766265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c1f0330 con 0x7f0a4c15d910 2023-11-04T01:38:47.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.521+0000 7f0a5334c640 1 -- 172.21.15.44:0/1176766265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4c1f3900 con 0x7f0a4c15d910 2023-11-04T01:38:47.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.521+0000 7f0a49ffb640 1 -- 172.21.15.44:0/1176766265 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a3c040ca0 con 0x7f0a4c15d910 2023-11-04T01:38:47.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.522+0000 7f0a49ffb640 1 --2- 172.21.15.44:0/1176766265 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0a3806ae70 0x7f0a3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.522+0000 7f0a49ffb640 1 -- 172.21.15.44:0/1176766265 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f0a3c0acae0 con 0x7f0a4c15d910 2023-11-04T01:38:47.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.522+0000 7f0a510e8640 1 --2- 172.21.15.44:0/1176766265 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0a3806ae70 0x7f0a3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.523+0000 7f0a510e8640 1 --2- 172.21.15.44:0/1176766265 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0a3806ae70 0x7f0a3806d330 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0a44000f60 tx=0x7f0a44009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.526+0000 7f0a49ffb640 1 -- 172.21.15.44:0/1176766265 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0a4c1f3900 con 0x7f0a4c15d910 2023-11-04T01:38:47.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:47.701+0000 7f0a5334c640 1 -- 172.21.15.44:0/1176766265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0a4c1f3900 con 0x7f0a4c15d910 2023-11-04T01:38:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.345+0000 7f0a49ffb640 1 -- 172.21.15.44:0/1176766265 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0a4c1f3900 con 0x7f0a4c15d910 2023-11-04T01:38:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:38:48.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.349+0000 7f0a5334c640 1 -- 172.21.15.44:0/1176766265 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0a3806ae70 msgr2=0x7f0a3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.349+0000 7f0a5334c640 1 --2- 172.21.15.44:0/1176766265 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0a3806ae70 0x7f0a3806d330 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0a44000f60 tx=0x7f0a44009040 comp rx=0 tx=0).stop 2023-11-04T01:38:48.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.349+0000 7f0a5334c640 1 -- 172.21.15.44:0/1176766265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a4c15d910 msgr2=0x7f0a4c0d1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.349+0000 7f0a5334c640 1 --2- 172.21.15.44:0/1176766265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a4c15d910 0x7f0a4c0d1e90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c037040 tx=0x7f0a3c004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:48.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.349+0000 7f0a5334c640 1 -- 172.21.15.44:0/1176766265 shutdown_connections 2023-11-04T01:38:48.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.349+0000 7f0a5334c640 1 --2- 172.21.15.44:0/1176766265 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0a3806ae70 0x7f0a3806d330 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.349+0000 7f0a5334c640 1 --2- 172.21.15.44:0/1176766265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a4c15d910 0x7f0a4c0d1e90 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.349+0000 7f0a5334c640 1 --2- 172.21.15.44:0/1176766265 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0a4c15d4b0 0x7f0a4c0cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.349+0000 7f0a5334c640 1 --2- 172.21.15.44:0/1176766265 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0a4c0cd9f0 0x7f0a4c1efdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.349+0000 7f0a5334c640 1 -- 172.21.15.44:0/1176766265 >> 172.21.15.44:0/1176766265 conn(0x7f0a4c071c40 msgr2=0x7f0a4c1600f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.349+0000 7f0a5334c640 1 -- 172.21.15.44:0/1176766265 shutdown_connections 2023-11-04T01:38:48.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.349+0000 7f0a5334c640 1 -- 172.21.15.44:0/1176766265 wait complete. 2023-11-04T01:38:48.364 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:38:48.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.474+0000 7fd3885a9640 1 Processor -- start 2023-11-04T01:38:48.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.474+0000 7fd3885a9640 1 -- start start 2023-11-04T01:38:48.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.475+0000 7fd3885a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd38015d1b0 0x7fd3800ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.475+0000 7fd3885a9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd380161870 con 0x7fd3800cecf0 2023-11-04T01:38:48.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.475+0000 7fd3885a9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd380160c60 con 0x7fd3800cdc50 2023-11-04T01:38:48.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.475+0000 7fd3885a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd380160f40 con 0x7fd38015d1b0 2023-11-04T01:38:48.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.475+0000 7fd385b44640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd3800cecf0 0x7fd3800cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37482/0 (socket says 172.21.15.44:37482) 2023-11-04T01:38:48.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.475+0000 7fd385b44640 1 -- 172.21.15.44:0/2810521340 learned_addr learned my addr 172.21.15.44:0/2810521340 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.475+0000 7fd386345640 1 --2- 172.21.15.44:0/2810521340 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd38015d1b0 0x7fd3800ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073403996 0 0) 0x7fd380161870 con 0x7fd3800cecf0 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd36c003520 con 0x7fd3800cecf0 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625469276 0 0) 0x7fd380160c60 con 0x7fd3800cdc50 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd380161870 con 0x7fd3800cdc50 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3616432583 0 0) 0x7fd36c003520 con 0x7fd3800cecf0 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd38015d1b0 msgr2=0x7fd3800ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 --2- 172.21.15.44:0/2810521340 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd38015d1b0 0x7fd3800ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 >> v1:172.21.15.204:6789/0 conn(0x7fd3800cdc50 legacy=0x7fd38015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380161220 con 0x7fd3800cecf0 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fd370001670 con 0x7fd3800cecf0 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 >> v1:172.21.15.44:6789/0 conn(0x7fd3800cecf0 legacy=0x7fd3800cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 --2- 172.21.15.44:0/2810521340 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd36c003b30 0x7fd36c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 --2- 172.21.15.44:0/2810521340 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd38015d1b0 0x7fd36c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 --2- 172.21.15.44:0/2810521340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36c004d00 0x7fd36c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd380160f40 con 0x7fd36c004d00 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c00ba30 con 0x7fd36c003b30 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c00bba0 con 0x7fd38015d1b0 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd386b46640 1 --2- 172.21.15.44:0/2810521340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36c004d00 0x7fd36c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd385b44640 1 --2- 172.21.15.44:0/2810521340 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd38015d1b0 0x7fd36c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd386345640 1 --2- 172.21.15.44:0/2810521340 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd36c003b30 0x7fd36c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd386b46640 1 -- 172.21.15.44:0/2810521340 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd38015d1b0 msgr2=0x7fd36c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd386b46640 1 --2- 172.21.15.44:0/2810521340 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd38015d1b0 0x7fd36c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd386b46640 1 -- 172.21.15.44:0/2810521340 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd36c003b30 msgr2=0x7fd36c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd386b46640 1 --2- 172.21.15.44:0/2810521340 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd36c003b30 0x7fd36c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.476+0000 7fd386b46640 1 -- 172.21.15.44:0/2810521340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c003520 con 0x7fd36c004d00 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.477+0000 7fd386b46640 1 --2- 172.21.15.44:0/2810521340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36c004d00 0x7fd36c005180 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd38008a010 tx=0x7fd36c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64225cfe87c1c73 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.477+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0052d0 con 0x7fd36c004d00 2023-11-04T01:38:48.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.477+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c005430 con 0x7fd36c004d00 2023-11-04T01:38:48.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.477+0000 7fd385343640 1 -- 172.21.15.44:0/2810521340 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c003810 con 0x7fd36c004d00 2023-11-04T01:38:48.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.478+0000 7fd3885a9640 1 -- 172.21.15.44:0/2810521340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36c004d00 msgr2=0x7fd36c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.478+0000 7fd3885a9640 1 --2- 172.21.15.44:0/2810521340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36c004d00 0x7fd36c005180 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd38008a010 tx=0x7fd36c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.478+0000 7fd386b46640 1 -- 172.21.15.44:0/2810521340 reap_dead start 2023-11-04T01:38:48.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.478+0000 7fd3885a9640 1 -- 172.21.15.44:0/2810521340 shutdown_connections 2023-11-04T01:38:48.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.478+0000 7fd3885a9640 1 -- 172.21.15.44:0/2810521340 >> 172.21.15.44:0/2810521340 conn(0x7fd38006ea20 msgr2=0x7fd38006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.478+0000 7fd3885a9640 1 -- 172.21.15.44:0/2810521340 shutdown_connections 2023-11-04T01:38:48.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.478+0000 7fd3885a9640 1 -- 172.21.15.44:0/2810521340 wait complete. 2023-11-04T01:38:48.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.479+0000 7fd3885a9640 1 Processor -- start 2023-11-04T01:38:48.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.479+0000 7fd3885a9640 1 -- start start 2023-11-04T01:38:48.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.480+0000 7fd3885a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36c004d00 0x7fd3800b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.480+0000 7fd3885a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3800b2d50 0x7fd3801f3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.480+0000 7fd3885a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3801f3740 0x7fd3801f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.480+0000 7fd3885a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800b31d0 con 0x7fd36c004d00 2023-11-04T01:38:48.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.480+0000 7fd3885a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38015faa0 con 0x7fd3800b2d50 2023-11-04T01:38:48.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.480+0000 7fd3885a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38015ea00 con 0x7fd3801f3740 2023-11-04T01:38:48.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.480+0000 7fd386345640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36c004d00 0x7fd3800b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.480+0000 7fd386345640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36c004d00 0x7fd3800b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38244/0 (socket says 172.21.15.44:38244) 2023-11-04T01:38:48.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.480+0000 7fd386345640 1 -- 172.21.15.44:0/3872223429 learned_addr learned my addr 172.21.15.44:0/3872223429 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:48.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.480+0000 7fd386345640 1 -- 172.21.15.44:0/3872223429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3801f3740 msgr2=0x7fd3801f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.480+0000 7fd386345640 1 --2- 172.21.15.44:0/3872223429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3801f3740 0x7fd3801f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.480+0000 7fd386345640 1 -- 172.21.15.44:0/3872223429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3800b2d50 msgr2=0x7fd3801f3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.480+0000 7fd386345640 1 --2- 172.21.15.44:0/3872223429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3800b2d50 0x7fd3801f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.480+0000 7fd386345640 1 -- 172.21.15.44:0/3872223429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38015ece0 con 0x7fd36c004d00 2023-11-04T01:38:48.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.480+0000 7fd386345640 1 --2- 172.21.15.44:0/3872223429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36c004d00 0x7fd3800b2810 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd378011e30 tx=0x7fd37800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.481+0000 7fd376ffd640 1 -- 172.21.15.44:0/3872223429 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37800e040 con 0x7fd36c004d00 2023-11-04T01:38:48.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.481+0000 7fd376ffd640 1 -- 172.21.15.44:0/3872223429 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37800f040 con 0x7fd36c004d00 2023-11-04T01:38:48.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.481+0000 7fd3885a9640 1 -- 172.21.15.44:0/3872223429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38015efc0 con 0x7fd36c004d00 2023-11-04T01:38:48.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.481+0000 7fd376ffd640 1 -- 172.21.15.44:0/3872223429 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378009c00 con 0x7fd36c004d00 2023-11-04T01:38:48.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.481+0000 7fd3885a9640 1 -- 172.21.15.44:0/3872223429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38015f580 con 0x7fd36c004d00 2023-11-04T01:38:48.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.481+0000 7fd3885a9640 1 -- 172.21.15.44:0/3872223429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38004e490 con 0x7fd36c004d00 2023-11-04T01:38:48.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.482+0000 7fd376ffd640 1 -- 172.21.15.44:0/3872223429 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd378015850 con 0x7fd36c004d00 2023-11-04T01:38:48.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.482+0000 7fd376ffd640 1 --2- 172.21.15.44:0/3872223429 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd36406ae70 0x7fd36406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.482+0000 7fd376ffd640 1 -- 172.21.15.44:0/3872223429 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6740+0+0 (secure 0 0 0) 0x7fd37808a8e0 con 0x7fd36c004d00 2023-11-04T01:38:48.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.483+0000 7fd385b44640 1 --2- 172.21.15.44:0/3872223429 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd36406ae70 0x7fd36406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.483+0000 7fd385b44640 1 --2- 172.21.15.44:0/3872223429 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd36406ae70 0x7fd36406d330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd3800b6b30 tx=0x7fd370001470 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.487+0000 7fd376ffd640 1 -- 172.21.15.44:0/3872223429 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd378055580 con 0x7fd36c004d00 2023-11-04T01:38:48.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:48.666+0000 7fd3885a9640 1 -- 172.21.15.44:0/3872223429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd38006b370 con 0x7fd36c004d00 2023-11-04T01:38:49.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.351+0000 7fd376ffd640 1 -- 172.21.15.44:0/3872223429 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd378058ba0 con 0x7fd36c004d00 2023-11-04T01:38:49.353 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2023-11-04T01:38:49.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.355+0000 7fd3885a9640 1 -- 172.21.15.44:0/3872223429 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd36406ae70 msgr2=0x7fd36406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.355+0000 7fd3885a9640 1 --2- 172.21.15.44:0/3872223429 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd36406ae70 0x7fd36406d330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd3800b6b30 tx=0x7fd370001470 comp rx=0 tx=0).stop 2023-11-04T01:38:49.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.355+0000 7fd3885a9640 1 -- 172.21.15.44:0/3872223429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36c004d00 msgr2=0x7fd3800b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.355+0000 7fd3885a9640 1 --2- 172.21.15.44:0/3872223429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36c004d00 0x7fd3800b2810 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd378011e30 tx=0x7fd37800f580 comp rx=0 tx=0).stop 2023-11-04T01:38:49.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.355+0000 7fd3885a9640 1 -- 172.21.15.44:0/3872223429 shutdown_connections 2023-11-04T01:38:49.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.355+0000 7fd3885a9640 1 --2- 172.21.15.44:0/3872223429 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd36406ae70 0x7fd36406d330 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.355+0000 7fd3885a9640 1 --2- 172.21.15.44:0/3872223429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3801f3740 0x7fd3801f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.355+0000 7fd3885a9640 1 --2- 172.21.15.44:0/3872223429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3800b2d50 0x7fd3801f3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.355+0000 7fd3885a9640 1 --2- 172.21.15.44:0/3872223429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36c004d00 0x7fd3800b2810 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.355+0000 7fd3885a9640 1 -- 172.21.15.44:0/3872223429 >> 172.21.15.44:0/3872223429 conn(0x7fd38006ea20 msgr2=0x7fd3800c98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:49.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.355+0000 7fd3885a9640 1 -- 172.21.15.44:0/3872223429 shutdown_connections 2023-11-04T01:38:49.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.355+0000 7fd3885a9640 1 -- 172.21.15.44:0/3872223429 wait complete. 2023-11-04T01:38:49.371 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:38:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.482+0000 7fcad604f640 1 Processor -- start 2023-11-04T01:38:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.482+0000 7fcad604f640 1 -- start start 2023-11-04T01:38:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.482+0000 7fcad604f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcad00cd6d0 0x7fcad0161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.482+0000 7fcad604f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad00cde60 con 0x7fcad0153e60 2023-11-04T01:38:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.482+0000 7fcad604f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad0160f90 con 0x7fcad00b4880 2023-11-04T01:38:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.482+0000 7fcad604f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad0161960 con 0x7fcad00cd6d0 2023-11-04T01:38:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.483+0000 7fcacf7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcad0153e60 0x7fcad015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37484/0 (socket says 172.21.15.44:37484) 2023-11-04T01:38:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.483+0000 7fcacf7fe640 1 -- 172.21.15.44:0/2151201336 learned_addr learned my addr 172.21.15.44:0/2151201336 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.483+0000 7fcaceffd640 1 --2- 172.21.15.44:0/2151201336 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcad00cd6d0 0x7fcad0161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.483+0000 7fcace7fc640 1 -- 172.21.15.44:0/2151201336 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162974985 0 0) 0x7fcad00cde60 con 0x7fcad0153e60 2023-11-04T01:38:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.483+0000 7fcace7fc640 1 -- 172.21.15.44:0/2151201336 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcab8003520 con 0x7fcad0153e60 2023-11-04T01:38:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.483+0000 7fcace7fc640 1 -- 172.21.15.44:0/2151201336 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650096912 0 0) 0x7fcad0160f90 con 0x7fcad00b4880 2023-11-04T01:38:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.483+0000 7fcace7fc640 1 -- 172.21.15.44:0/2151201336 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad00cde60 con 0x7fcad00b4880 2023-11-04T01:38:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.483+0000 7fcace7fc640 1 -- 172.21.15.44:0/2151201336 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2288084532 0 0) 0x7fcab8003520 con 0x7fcad0153e60 2023-11-04T01:38:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.483+0000 7fcaceffd640 1 -- 172.21.15.44:0/2151201336 >> v1:172.21.15.204:6789/0 conn(0x7fcad00b4880 legacy=0x7fcad00b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.483+0000 7fcaceffd640 1 -- 172.21.15.44:0/2151201336 >> v1:172.21.15.44:6789/0 conn(0x7fcad0153e60 legacy=0x7fcad015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.483+0000 7fcaceffd640 1 -- 172.21.15.44:0/2151201336 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad00ce090 con 0x7fcad00cd6d0 2023-11-04T01:38:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.484+0000 7fcaceffd640 1 --2- 172.21.15.44:0/2151201336 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcad00cd6d0 0x7fcad0161420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcac40097d0 tx=0x7fcac402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=436657c8da824530 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.484+0000 7fcace7fc640 1 -- 172.21.15.44:0/2151201336 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0001670 con 0x7fcad00cd6d0 2023-11-04T01:38:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.484+0000 7fcace7fc640 1 -- 172.21.15.44:0/2151201336 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac402e050 con 0x7fcad00cd6d0 2023-11-04T01:38:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.484+0000 7fcace7fc640 1 -- 172.21.15.44:0/2151201336 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4030730 con 0x7fcad00cd6d0 2023-11-04T01:38:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.485+0000 7fcad604f640 1 -- 172.21.15.44:0/2151201336 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcad00cd6d0 msgr2=0x7fcad0161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.485+0000 7fcad604f640 1 --2- 172.21.15.44:0/2151201336 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcad00cd6d0 0x7fcad0161420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcac40097d0 tx=0x7fcac402b800 comp rx=0 tx=0).stop 2023-11-04T01:38:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.485+0000 7fcad604f640 1 -- 172.21.15.44:0/2151201336 shutdown_connections 2023-11-04T01:38:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.485+0000 7fcad604f640 1 --2- 172.21.15.44:0/2151201336 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcad00cd6d0 0x7fcad0161420 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.485+0000 7fcad604f640 1 -- 172.21.15.44:0/2151201336 >> 172.21.15.44:0/2151201336 conn(0x7fcad00cf880 msgr2=0x7fcad00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.485+0000 7fcad604f640 1 -- 172.21.15.44:0/2151201336 shutdown_connections 2023-11-04T01:38:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.485+0000 7fcad604f640 1 -- 172.21.15.44:0/2151201336 wait complete. 2023-11-04T01:38:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.486+0000 7fcad604f640 1 Processor -- start 2023-11-04T01:38:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.486+0000 7fcad604f640 1 -- start start 2023-11-04T01:38:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcad604f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00b4880 0x7fcad0156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcad604f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcad00cd6d0 0x7fcad01f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcad604f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcad0153e60 0x7fcad00c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcad604f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad0142120 con 0x7fcad00b4880 2023-11-04T01:38:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcad604f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad0142400 con 0x7fcad0153e60 2023-11-04T01:38:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcad604f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad01426e0 con 0x7fcad00cd6d0 2023-11-04T01:38:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcacf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00b4880 0x7fcad0156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcacf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00b4880 0x7fcad0156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38256/0 (socket says 172.21.15.44:38256) 2023-11-04T01:38:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcacf7fe640 1 -- 172.21.15.44:0/2278553166 learned_addr learned my addr 172.21.15.44:0/2278553166 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcaceffd640 1 --2- 172.21.15.44:0/2278553166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcad00cd6d0 0x7fcad01f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcacffff640 1 --2- 172.21.15.44:0/2278553166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcad0153e60 0x7fcad00c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcacf7fe640 1 -- 172.21.15.44:0/2278553166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcad00cd6d0 msgr2=0x7fcad01f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcacf7fe640 1 --2- 172.21.15.44:0/2278553166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcad00cd6d0 0x7fcad01f3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcacf7fe640 1 -- 172.21.15.44:0/2278553166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcad0153e60 msgr2=0x7fcad00c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcacf7fe640 1 --2- 172.21.15.44:0/2278553166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcad0153e60 0x7fcad00c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcacf7fe640 1 -- 172.21.15.44:0/2278553166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac4009400 con 0x7fcad00b4880 2023-11-04T01:38:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.487+0000 7fcacf7fe640 1 --2- 172.21.15.44:0/2278553166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00b4880 0x7fcad0156c40 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fcac000c780 tx=0x7fcac000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.488+0000 7fcab7fff640 1 -- 172.21.15.44:0/2278553166 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0005ad0 con 0x7fcad00b4880 2023-11-04T01:38:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.488+0000 7fcab7fff640 1 -- 172.21.15.44:0/2278553166 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac0005c30 con 0x7fcad00b4880 2023-11-04T01:38:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.488+0000 7fcad604f640 1 -- 172.21.15.44:0/2278553166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad01429c0 con 0x7fcad00b4880 2023-11-04T01:38:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.488+0000 7fcab7fff640 1 -- 172.21.15.44:0/2278553166 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0007070 con 0x7fcad00b4880 2023-11-04T01:38:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.488+0000 7fcad604f640 1 -- 172.21.15.44:0/2278553166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad01f2ca0 con 0x7fcad00b4880 2023-11-04T01:38:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.488+0000 7fcad604f640 1 -- 172.21.15.44:0/2278553166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad0142ee0 con 0x7fcad00b4880 2023-11-04T01:38:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.489+0000 7fcab7fff640 1 -- 172.21.15.44:0/2278553166 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcac00071d0 con 0x7fcad00b4880 2023-11-04T01:38:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.489+0000 7fcab7fff640 1 --2- 172.21.15.44:0/2278553166 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcabc06ae70 0x7fcabc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.490+0000 7fcab7fff640 1 -- 172.21.15.44:0/2278553166 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fcac0088e90 con 0x7fcad00b4880 2023-11-04T01:38:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.490+0000 7fcaceffd640 1 --2- 172.21.15.44:0/2278553166 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcabc06ae70 0x7fcabc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.490+0000 7fcaceffd640 1 --2- 172.21.15.44:0/2278553166 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcabc06ae70 0x7fcabc06d330 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcac4034000 tx=0x7fcac4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:49.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.494+0000 7fcab7fff640 1 -- 172.21.15.44:0/2278553166 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcad0142ee0 con 0x7fcad00b4880 2023-11-04T01:38:49.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.669+0000 7fcad604f640 1 -- 172.21.15.44:0/2278553166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcad0142ee0 con 0x7fcad00b4880 2023-11-04T01:38:49.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.672+0000 7fcab7fff640 1 -- 172.21.15.44:0/2278553166 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcad0142ee0 con 0x7fcad00b4880 2023-11-04T01:38:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.674+0000 7fcad604f640 1 -- 172.21.15.44:0/2278553166 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcabc06ae70 msgr2=0x7fcabc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.674+0000 7fcad604f640 1 --2- 172.21.15.44:0/2278553166 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcabc06ae70 0x7fcabc06d330 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcac4034000 tx=0x7fcac4008030 comp rx=0 tx=0).stop 2023-11-04T01:38:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.674+0000 7fcad604f640 1 -- 172.21.15.44:0/2278553166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00b4880 msgr2=0x7fcad0156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.674+0000 7fcad604f640 1 --2- 172.21.15.44:0/2278553166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00b4880 0x7fcad0156c40 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fcac000c780 tx=0x7fcac000cc40 comp rx=0 tx=0).stop 2023-11-04T01:38:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.674+0000 7fcad604f640 1 -- 172.21.15.44:0/2278553166 shutdown_connections 2023-11-04T01:38:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.674+0000 7fcad604f640 1 --2- 172.21.15.44:0/2278553166 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcabc06ae70 0x7fcabc06d330 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.674+0000 7fcad604f640 1 --2- 172.21.15.44:0/2278553166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcad0153e60 0x7fcad00c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.674+0000 7fcad604f640 1 --2- 172.21.15.44:0/2278553166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcad00cd6d0 0x7fcad01f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.674+0000 7fcad604f640 1 --2- 172.21.15.44:0/2278553166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00b4880 0x7fcad0156c40 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.674+0000 7fcad604f640 1 -- 172.21.15.44:0/2278553166 >> 172.21.15.44:0/2278553166 conn(0x7fcad00cf880 msgr2=0x7fcad00d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.674+0000 7fcad604f640 1 -- 172.21.15.44:0/2278553166 shutdown_connections 2023-11-04T01:38:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.674+0000 7fcad604f640 1 -- 172.21.15.44:0/2278553166 wait complete. 2023-11-04T01:38:49.687 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-11-04T01:38:49.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.791+0000 7f45b74da640 1 Processor -- start 2023-11-04T01:38:49.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.791+0000 7f45b74da640 1 -- start start 2023-11-04T01:38:49.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.791+0000 7f45b74da640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f45b0159c70 0x7f45b00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.791+0000 7f45b74da640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f45b00b0ae0 0x7f45b015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.791+0000 7f45b74da640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b00b4110 con 0x7f45b006db20 2023-11-04T01:38:49.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.791+0000 7f45b74da640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b00b49b0 con 0x7f45b0159c70 2023-11-04T01:38:49.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.791+0000 7f45b74da640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b00b43f0 con 0x7f45b00b0ae0 2023-11-04T01:38:49.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.792+0000 7f45b5276640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f45b0159c70 0x7f45b00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:49.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.792+0000 7f45b5276640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f45b0159c70 0x7f45b00ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38260/0 (socket says 172.21.15.44:38260) 2023-11-04T01:38:49.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.792+0000 7f45b5276640 1 -- 172.21.15.44:0/3346769379 learned_addr learned my addr 172.21.15.44:0/3346769379 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:49.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.792+0000 7f45b5276640 1 -- 172.21.15.44:0/3346769379 >> v2:172.21.15.204:3300/0 conn(0x7f45b00b0ae0 msgr2=0x7f45b015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:49.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.792+0000 7f45b5276640 1 --2- 172.21.15.44:0/3346769379 >> v2:172.21.15.204:3300/0 conn(0x7f45b00b0ae0 0x7f45b015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.792+0000 7f45b5276640 1 -- 172.21.15.44:0/3346769379 >> v1:172.21.15.204:6789/0 conn(0x7f45b006db20 legacy=0x7f45b00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:49.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.792+0000 7f45b5276640 1 -- 172.21.15.44:0/3346769379 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b00b46d0 con 0x7f45b0159c70 2023-11-04T01:38:49.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.793+0000 7f45b5276640 1 --2- 172.21.15.44:0/3346769379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b0159c70 0x7f45b00ce370 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f45b00c5910 tx=0x7f45ac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd2fe8f0d41c5ac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:49.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.793+0000 7f45a7fff640 1 -- 172.21.15.44:0/3346769379 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac031870 con 0x7f45b0159c70 2023-11-04T01:38:49.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.793+0000 7f45a7fff640 1 -- 172.21.15.44:0/3346769379 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac0319d0 con 0x7f45b0159c70 2023-11-04T01:38:49.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.793+0000 7f45a7fff640 1 -- 172.21.15.44:0/3346769379 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac031d60 con 0x7f45b0159c70 2023-11-04T01:38:49.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.793+0000 7f45b74da640 1 -- 172.21.15.44:0/3346769379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b0159c70 msgr2=0x7f45b00ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.793+0000 7f45b74da640 1 --2- 172.21.15.44:0/3346769379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b0159c70 0x7f45b00ce370 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f45b00c5910 tx=0x7f45ac02b910 comp rx=0 tx=0).stop 2023-11-04T01:38:49.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.793+0000 7f45b74da640 1 -- 172.21.15.44:0/3346769379 shutdown_connections 2023-11-04T01:38:49.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.793+0000 7f45b74da640 1 --2- 172.21.15.44:0/3346769379 >> v2:172.21.15.204:3300/0 conn(0x7f45b00b0ae0 0x7f45b015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.793+0000 7f45b74da640 1 --2- 172.21.15.44:0/3346769379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b0159c70 0x7f45b00ce370 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.793+0000 7f45b74da640 1 -- 172.21.15.44:0/3346769379 >> 172.21.15.44:0/3346769379 conn(0x7f45b00ce950 msgr2=0x7f45b00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:49.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.793+0000 7f45b74da640 1 -- 172.21.15.44:0/3346769379 shutdown_connections 2023-11-04T01:38:49.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.793+0000 7f45b74da640 1 -- 172.21.15.44:0/3346769379 wait complete. 2023-11-04T01:38:49.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.795+0000 7f45b74da640 1 Processor -- start 2023-11-04T01:38:49.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.795+0000 7f45b74da640 1 -- start start 2023-11-04T01:38:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.795+0000 7f45b74da640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b006db20 0x7f45b00c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.795+0000 7f45b74da640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45b00b0ae0 0x7f45b0157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.795+0000 7f45b74da640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45b0159c70 0x7f45b0150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.795+0000 7f45b74da640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b01431a0 con 0x7f45b006db20 2023-11-04T01:38:49.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.795+0000 7f45b74da640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b0151400 con 0x7f45b0159c70 2023-11-04T01:38:49.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.795+0000 7f45b74da640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b01516a0 con 0x7f45b00b0ae0 2023-11-04T01:38:49.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.795+0000 7f45b5276640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b006db20 0x7f45b00c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:49.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.795+0000 7f45b5276640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b006db20 0x7f45b00c4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38262/0 (socket says 172.21.15.44:38262) 2023-11-04T01:38:49.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.796+0000 7f45b5276640 1 -- 172.21.15.44:0/1808355427 learned_addr learned my addr 172.21.15.44:0/1808355427 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:49.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.796+0000 7f45b4a75640 1 --2- 172.21.15.44:0/1808355427 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45b00b0ae0 0x7f45b0157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:49.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.796+0000 7f45b5a77640 1 --2- 172.21.15.44:0/1808355427 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45b0159c70 0x7f45b0150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:49.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.796+0000 7f45b5276640 1 -- 172.21.15.44:0/1808355427 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45b00b0ae0 msgr2=0x7f45b0157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.796+0000 7f45b5276640 1 --2- 172.21.15.44:0/1808355427 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45b00b0ae0 0x7f45b0157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.796+0000 7f45b5276640 1 -- 172.21.15.44:0/1808355427 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45b0159c70 msgr2=0x7f45b0150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.796+0000 7f45b5276640 1 --2- 172.21.15.44:0/1808355427 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45b0159c70 0x7f45b0150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.796+0000 7f45b5276640 1 -- 172.21.15.44:0/1808355427 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac0094d0 con 0x7f45b006db20 2023-11-04T01:38:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.796+0000 7f45b5276640 1 --2- 172.21.15.44:0/1808355427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b006db20 0x7f45b00c4e60 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f45ac000c00 tx=0x7f45ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.796+0000 7f45a5ffb640 1 -- 172.21.15.44:0/1808355427 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac03ad10 con 0x7f45b006db20 2023-11-04T01:38:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.796+0000 7f45a5ffb640 1 -- 172.21.15.44:0/1808355427 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac03ae70 con 0x7f45b006db20 2023-11-04T01:38:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.796+0000 7f45b74da640 1 -- 172.21.15.44:0/1808355427 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b0151980 con 0x7f45b006db20 2023-11-04T01:38:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.796+0000 7f45a5ffb640 1 -- 172.21.15.44:0/1808355427 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac044610 con 0x7f45b006db20 2023-11-04T01:38:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.796+0000 7f45b74da640 1 -- 172.21.15.44:0/1808355427 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b0152920 con 0x7f45b006db20 2023-11-04T01:38:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.797+0000 7f45b74da640 1 -- 172.21.15.44:0/1808355427 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b0151ea0 con 0x7f45b006db20 2023-11-04T01:38:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.798+0000 7f45a5ffb640 1 -- 172.21.15.44:0/1808355427 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45ac04d450 con 0x7f45b006db20 2023-11-04T01:38:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.798+0000 7f45a5ffb640 1 --2- 172.21.15.44:0/1808355427 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f459406ae70 0x7f459406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.798+0000 7f45a5ffb640 1 -- 172.21.15.44:0/1808355427 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f45ac02d040 con 0x7f45b006db20 2023-11-04T01:38:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.798+0000 7f45b4a75640 1 --2- 172.21.15.44:0/1808355427 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f459406ae70 0x7f459406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.799+0000 7f45b4a75640 1 --2- 172.21.15.44:0/1808355427 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f459406ae70 0x7f459406d330 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f45b0154920 tx=0x7f45a0009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:49.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:49.802+0000 7f45a5ffb640 1 -- 172.21.15.44:0/1808355427 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f45b0151ea0 con 0x7f45b006db20 2023-11-04T01:38:50.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.053+0000 7f45b74da640 1 -- 172.21.15.44:0/1808355427 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7f45b0152780 con 0x7f45b006db20 2023-11-04T01:38:50.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.353+0000 7f45a5ffb640 1 -- 172.21.15.44:0/1808355427 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v182) v1 ==== 173+0+0 (secure 0 0 0) 0x7f45b0152780 con 0x7f45b006db20 2023-11-04T01:38:50.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.355+0000 7f45b74da640 1 -- 172.21.15.44:0/1808355427 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f459406ae70 msgr2=0x7f459406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.355+0000 7f45b74da640 1 --2- 172.21.15.44:0/1808355427 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f459406ae70 0x7f459406d330 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f45b0154920 tx=0x7f45a0009060 comp rx=0 tx=0).stop 2023-11-04T01:38:50.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.355+0000 7f45b74da640 1 -- 172.21.15.44:0/1808355427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b006db20 msgr2=0x7f45b00c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.355+0000 7f45b74da640 1 --2- 172.21.15.44:0/1808355427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b006db20 0x7f45b00c4e60 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f45ac000c00 tx=0x7f45ac0046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.355+0000 7f45b74da640 1 -- 172.21.15.44:0/1808355427 shutdown_connections 2023-11-04T01:38:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.355+0000 7f45b74da640 1 --2- 172.21.15.44:0/1808355427 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f459406ae70 0x7f459406d330 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.355+0000 7f45b74da640 1 --2- 172.21.15.44:0/1808355427 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45b0159c70 0x7f45b0150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.355+0000 7f45b74da640 1 --2- 172.21.15.44:0/1808355427 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45b00b0ae0 0x7f45b0157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.355+0000 7f45b74da640 1 --2- 172.21.15.44:0/1808355427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b006db20 0x7f45b00c4e60 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.355+0000 7f45b74da640 1 -- 172.21.15.44:0/1808355427 >> 172.21.15.44:0/1808355427 conn(0x7f45b00ce950 msgr2=0x7f45b015b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.355+0000 7f45b74da640 1 -- 172.21.15.44:0/1808355427 shutdown_connections 2023-11-04T01:38:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.355+0000 7f45b74da640 1 -- 172.21.15.44:0/1808355427 wait complete. 2023-11-04T01:38:50.368 INFO:tasks.cephfs_test_runner:Test that using a pool with snaps for fs creation fails ... ok 2023-11-04T01:38:50.369 INFO:tasks.cephfs_test_runner:Starting test: test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots) Check whether 'allow_new_snaps' setting works 2023-11-04T01:38:50.369 INFO:tasks.cephfs_test_runner:test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:38:50.369 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:50.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.475+0000 7f0f0ac2d640 1 Processor -- start 2023-11-04T01:38:50.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.475+0000 7f0f0ac2d640 1 -- start start 2023-11-04T01:38:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f0ac2d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f0415ad80 0x7f0f040abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f0ac2d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f0406a1b0 0x7f0f0406b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f0ac2d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0f040c9a40 0x7f0f040c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f0ac2d640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f040ca430 con 0x7f0f0406a1b0 2023-11-04T01:38:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f0ac2d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0406cf60 con 0x7f0f040c9a40 2023-11-04T01:38:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f0ac2d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040ac390 con 0x7f0f0415ad80 2023-11-04T01:38:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f03fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f0406a1b0 0x7f0f0406b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f03fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f0406a1b0 0x7f0f0406b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38274/0 (socket says 172.21.15.44:38274) 2023-11-04T01:38:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f03fff640 1 -- 172.21.15.44:0/1566678068 learned_addr learned my addr 172.21.15.44:0/1566678068 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f091ca640 1 --2- 172.21.15.44:0/1566678068 >> v2:172.21.15.204:3300/0 conn(0x7f0f040c9a40 0x7f0f040c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f089c9640 1 --2- 172.21.15.44:0/1566678068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f0415ad80 0x7f0f040abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f03fff640 1 -- 172.21.15.44:0/1566678068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f0415ad80 msgr2=0x7f0f040abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f03fff640 1 --2- 172.21.15.44:0/1566678068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f0415ad80 0x7f0f040abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f03fff640 1 -- 172.21.15.44:0/1566678068 >> v2:172.21.15.204:3300/0 conn(0x7f0f040c9a40 msgr2=0x7f0f040c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f03fff640 1 --2- 172.21.15.44:0/1566678068 >> v2:172.21.15.204:3300/0 conn(0x7f0f040c9a40 0x7f0f040c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.476+0000 7f0f03fff640 1 -- 172.21.15.44:0/1566678068 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0415b160 con 0x7f0f0406a1b0 2023-11-04T01:38:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.477+0000 7f0f03fff640 1 --2- 172.21.15.44:0/1566678068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f0406a1b0 0x7f0f0406b010 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f0f04066030 tx=0x7f0ef002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2530ccb3b8dbafd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:50.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.477+0000 7f0f037fe640 1 -- 172.21.15.44:0/1566678068 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0031870 con 0x7f0f0406a1b0 2023-11-04T01:38:50.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.477+0000 7f0f037fe640 1 -- 172.21.15.44:0/1566678068 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef00319d0 con 0x7f0f0406a1b0 2023-11-04T01:38:50.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.477+0000 7f0f037fe640 1 -- 172.21.15.44:0/1566678068 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0031d60 con 0x7f0f0406a1b0 2023-11-04T01:38:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.478+0000 7f0f0ac2d640 1 -- 172.21.15.44:0/1566678068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f0406a1b0 msgr2=0x7f0f0406b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.478+0000 7f0f0ac2d640 1 --2- 172.21.15.44:0/1566678068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f0406a1b0 0x7f0f0406b010 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f0f04066030 tx=0x7f0ef002b910 comp rx=0 tx=0).stop 2023-11-04T01:38:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.478+0000 7f0f0ac2d640 1 -- 172.21.15.44:0/1566678068 shutdown_connections 2023-11-04T01:38:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.478+0000 7f0f0ac2d640 1 --2- 172.21.15.44:0/1566678068 >> v2:172.21.15.204:3300/0 conn(0x7f0f040c9a40 0x7f0f040c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.478+0000 7f0f0ac2d640 1 --2- 172.21.15.44:0/1566678068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f0406a1b0 0x7f0f0406b010 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.478+0000 7f0f0ac2d640 1 --2- 172.21.15.44:0/1566678068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f0415ad80 0x7f0f040abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.478+0000 7f0f0ac2d640 1 -- 172.21.15.44:0/1566678068 >> 172.21.15.44:0/1566678068 conn(0x7f0f040b0cd0 msgr2=0x7f0f040b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.478+0000 7f0f0ac2d640 1 -- 172.21.15.44:0/1566678068 shutdown_connections 2023-11-04T01:38:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.478+0000 7f0f0ac2d640 1 -- 172.21.15.44:0/1566678068 wait complete. 2023-11-04T01:38:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.479+0000 7f0f0ac2d640 1 Processor -- start 2023-11-04T01:38:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.479+0000 7f0f0ac2d640 1 -- start start 2023-11-04T01:38:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f0ac2d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f0406a1b0 0x7f0f04158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f0ac2d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f040c9a40 0x7f0f04156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f0ac2d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f0415ad80 0x7f0f041f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f0ac2d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f04157d90 con 0x7f0f0406a1b0 2023-11-04T01:38:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f0ac2d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f04157180 con 0x7f0f040c9a40 2023-11-04T01:38:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f0ac2d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f04157460 con 0x7f0f0415ad80 2023-11-04T01:38:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f089c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f0406a1b0 0x7f0f04158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f089c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f0406a1b0 0x7f0f04158220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38282/0 (socket says 172.21.15.44:38282) 2023-11-04T01:38:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f089c9640 1 -- 172.21.15.44:0/1221930147 learned_addr learned my addr 172.21.15.44:0/1221930147 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f03fff640 1 --2- 172.21.15.44:0/1221930147 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f040c9a40 0x7f0f04156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f091ca640 1 --2- 172.21.15.44:0/1221930147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f0415ad80 0x7f0f041f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f089c9640 1 -- 172.21.15.44:0/1221930147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f0415ad80 msgr2=0x7f0f041f0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f089c9640 1 --2- 172.21.15.44:0/1221930147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f0415ad80 0x7f0f041f0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f089c9640 1 -- 172.21.15.44:0/1221930147 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f040c9a40 msgr2=0x7f0f04156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f089c9640 1 --2- 172.21.15.44:0/1221930147 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f040c9a40 0x7f0f04156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f089c9640 1 -- 172.21.15.44:0/1221930147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef00094d0 con 0x7f0f0406a1b0 2023-11-04T01:38:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.480+0000 7f0f089c9640 1 --2- 172.21.15.44:0/1221930147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f0406a1b0 0x7f0f04158220 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f0ef800d5f0 tx=0x7f0ef800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.481+0000 7f0f017fa640 1 -- 172.21.15.44:0/1221930147 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80125f0 con 0x7f0f0406a1b0 2023-11-04T01:38:50.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.481+0000 7f0f017fa640 1 -- 172.21.15.44:0/1221930147 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef8012750 con 0x7f0f0406a1b0 2023-11-04T01:38:50.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.481+0000 7f0f017fa640 1 -- 172.21.15.44:0/1221930147 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8012b00 con 0x7f0f0406a1b0 2023-11-04T01:38:50.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.481+0000 7f0f0ac2d640 1 -- 172.21.15.44:0/1221930147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f04157740 con 0x7f0f0406a1b0 2023-11-04T01:38:50.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.481+0000 7f0f0ac2d640 1 -- 172.21.15.44:0/1221930147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f04158760 con 0x7f0f0406a1b0 2023-11-04T01:38:50.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.482+0000 7f0f0ac2d640 1 -- 172.21.15.44:0/1221930147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f04074290 con 0x7f0f0406a1b0 2023-11-04T01:38:50.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.482+0000 7f0f017fa640 1 -- 172.21.15.44:0/1221930147 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ef8012c60 con 0x7f0f0406a1b0 2023-11-04T01:38:50.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.482+0000 7f0f017fa640 1 --2- 172.21.15.44:0/1221930147 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ee806ae70 0x7f0ee806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.482+0000 7f0f017fa640 1 -- 172.21.15.44:0/1221930147 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f0ef8089b80 con 0x7f0f0406a1b0 2023-11-04T01:38:50.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.483+0000 7f0f03fff640 1 --2- 172.21.15.44:0/1221930147 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ee806ae70 0x7f0ee806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.483+0000 7f0f03fff640 1 --2- 172.21.15.44:0/1221930147 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ee806ae70 0x7f0ee806d330 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0036000 tx=0x7f0ef003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:50.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.487+0000 7f0f017fa640 1 -- 172.21.15.44:0/1221930147 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ef8054b00 con 0x7f0f0406a1b0 2023-11-04T01:38:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.663+0000 7f0f0ac2d640 1 -- 172.21.15.44:0/1221930147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f0415f7f0 con 0x7f0f0406a1b0 2023-11-04T01:38:50.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.664+0000 7f0f017fa640 1 -- 172.21.15.44:0/1221930147 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18432 (secure 0 0 0) 0x7f0ef8058120 con 0x7f0f0406a1b0 2023-11-04T01:38:50.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:50.666 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":75,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:38:49.346608+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/2413284016":"2023-11-05T01:38:46.335565+0000","172.21.15.44:6834/2413284016":"2023-11-05T01:38:46.335565+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.666+0000 7f0f0ac2d640 1 -- 172.21.15.44:0/1221930147 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ee806ae70 msgr2=0x7f0ee806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.666+0000 7f0f0ac2d640 1 --2- 172.21.15.44:0/1221930147 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ee806ae70 0x7f0ee806d330 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0036000 tx=0x7f0ef003c040 comp rx=0 tx=0).stop 2023-11-04T01:38:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.666+0000 7f0f0ac2d640 1 -- 172.21.15.44:0/1221930147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f0406a1b0 msgr2=0x7f0f04158220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.666+0000 7f0f0ac2d640 1 --2- 172.21.15.44:0/1221930147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f0406a1b0 0x7f0f04158220 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f0ef800d5f0 tx=0x7f0ef800dab0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.666+0000 7f0f0ac2d640 1 -- 172.21.15.44:0/1221930147 shutdown_connections 2023-11-04T01:38:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.666+0000 7f0f0ac2d640 1 --2- 172.21.15.44:0/1221930147 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ee806ae70 0x7f0ee806d330 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.666+0000 7f0f0ac2d640 1 --2- 172.21.15.44:0/1221930147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f0415ad80 0x7f0f041f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.666+0000 7f0f0ac2d640 1 --2- 172.21.15.44:0/1221930147 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f040c9a40 0x7f0f04156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.666+0000 7f0f0ac2d640 1 --2- 172.21.15.44:0/1221930147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f0406a1b0 0x7f0f04158220 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.666+0000 7f0f0ac2d640 1 -- 172.21.15.44:0/1221930147 >> 172.21.15.44:0/1221930147 conn(0x7f0f040b0cd0 msgr2=0x7f0f04155200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:50.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.666+0000 7f0f0ac2d640 1 -- 172.21.15.44:0/1221930147 shutdown_connections 2023-11-04T01:38:50.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.666+0000 7f0f0ac2d640 1 -- 172.21.15.44:0/1221930147 wait complete. 2023-11-04T01:38:50.679 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:34.917670+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:35.547044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:50.679 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:50.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.786+0000 7f3651c64640 1 Processor -- start 2023-11-04T01:38:50.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.786+0000 7f3651c64640 1 -- start start 2023-11-04T01:38:50.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f3651c64640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f364c160430 0x7f364c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f3651c64640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f364c06c3a0 0x7f364c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f3651c64640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364c0b2fc0 con 0x7f364c0b2b60 2023-11-04T01:38:50.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f3651c64640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364c0cb580 con 0x7f364c06c3a0 2023-11-04T01:38:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f3651c64640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364c06ca40 con 0x7f364c160430 2023-11-04T01:38:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364affd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f364c0b2b60 0x7f364c06bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37496/0 (socket says 172.21.15.44:37496) 2023-11-04T01:38:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364affd640 1 -- 172.21.15.44:0/873690056 learned_addr learned my addr 172.21.15.44:0/873690056 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 -- 172.21.15.44:0/873690056 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948618536 0 0) 0x7f364c0b2fc0 con 0x7f364c0b2b60 2023-11-04T01:38:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364b7fe640 1 --2- 172.21.15.44:0/873690056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f364c160430 0x7f364c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364bfff640 1 --2- 172.21.15.44:0/873690056 >> v2:172.21.15.204:3300/0 conn(0x7f364c06c3a0 0x7f364c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 -- 172.21.15.44:0/873690056 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3634003520 con 0x7f364c0b2b60 2023-11-04T01:38:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 -- 172.21.15.44:0/873690056 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3593915343 0 0) 0x7f3634003520 con 0x7f364c0b2b60 2023-11-04T01:38:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 -- 172.21.15.44:0/873690056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f364c160430 msgr2=0x7f364c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 --2- 172.21.15.44:0/873690056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f364c160430 0x7f364c0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 -- 172.21.15.44:0/873690056 >> v2:172.21.15.204:3300/0 conn(0x7f364c06c3a0 msgr2=0x7f364c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 --2- 172.21.15.44:0/873690056 >> v2:172.21.15.204:3300/0 conn(0x7f364c06c3a0 0x7f364c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 -- 172.21.15.44:0/873690056 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c06c810 con 0x7f364c0b2b60 2023-11-04T01:38:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 -- 172.21.15.44:0/873690056 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f3640001670 con 0x7f364c0b2b60 2023-11-04T01:38:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 -- 172.21.15.44:0/873690056 >> v1:172.21.15.44:6789/0 conn(0x7f364c0b2b60 legacy=0x7f364c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 --2- 172.21.15.44:0/873690056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3634003970 0x7f3634003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 --2- 172.21.15.44:0/873690056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f364c160430 0x7f36340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 --2- 172.21.15.44:0/873690056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3634004d00 0x7f3634005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 -- 172.21.15.44:0/873690056 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c0cb580 con 0x7f3634003970 2023-11-04T01:38:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 -- 172.21.15.44:0/873690056 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c06ca40 con 0x7f3634004d00 2023-11-04T01:38:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.787+0000 7f364a7fc640 1 -- 172.21.15.44:0/873690056 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363400b980 con 0x7f364c160430 2023-11-04T01:38:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.788+0000 7f364b7fe640 1 --2- 172.21.15.44:0/873690056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3634003970 0x7f3634003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.788+0000 7f364affd640 1 --2- 172.21.15.44:0/873690056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f364c160430 0x7f36340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.788+0000 7f364bfff640 1 --2- 172.21.15.44:0/873690056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3634004d00 0x7f3634005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.788+0000 7f364b7fe640 1 -- 172.21.15.44:0/873690056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f364c160430 msgr2=0x7f36340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:50.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.788+0000 7f364b7fe640 1 --2- 172.21.15.44:0/873690056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f364c160430 0x7f36340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.788+0000 7f364b7fe640 1 -- 172.21.15.44:0/873690056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3634004d00 msgr2=0x7f3634005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:50.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.788+0000 7f364b7fe640 1 --2- 172.21.15.44:0/873690056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3634004d00 0x7f3634005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.788+0000 7f364b7fe640 1 -- 172.21.15.44:0/873690056 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3634003520 con 0x7f3634003970 2023-11-04T01:38:50.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.788+0000 7f364affd640 1 --2- 172.21.15.44:0/873690056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f364c160430 0x7f36340047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:50.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.789+0000 7f364b7fe640 1 --2- 172.21.15.44:0/873690056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3634003970 0x7f3634003d90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f363c009ac0 tx=0x7f36340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917648c5137038b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:50.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.789+0000 7f364a7fc640 1 -- 172.21.15.44:0/873690056 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c02c6b0 con 0x7f3634003970 2023-11-04T01:38:50.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.789+0000 7f364a7fc640 1 -- 172.21.15.44:0/873690056 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c02c810 con 0x7f3634003970 2023-11-04T01:38:50.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.789+0000 7f364a7fc640 1 -- 172.21.15.44:0/873690056 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c02cba0 con 0x7f3634003970 2023-11-04T01:38:50.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.789+0000 7f3651c64640 1 -- 172.21.15.44:0/873690056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3634003970 msgr2=0x7f3634003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.789+0000 7f3651c64640 1 --2- 172.21.15.44:0/873690056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3634003970 0x7f3634003d90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f363c009ac0 tx=0x7f36340057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.789+0000 7f364bfff640 1 -- 172.21.15.44:0/873690056 reap_dead start 2023-11-04T01:38:50.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.789+0000 7f3651c64640 1 -- 172.21.15.44:0/873690056 shutdown_connections 2023-11-04T01:38:50.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.789+0000 7f3651c64640 1 -- 172.21.15.44:0/873690056 >> 172.21.15.44:0/873690056 conn(0x7f364c06ea20 msgr2=0x7f364c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:50.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.789+0000 7f3651c64640 1 -- 172.21.15.44:0/873690056 shutdown_connections 2023-11-04T01:38:50.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.789+0000 7f3651c64640 1 -- 172.21.15.44:0/873690056 wait complete. 2023-11-04T01:38:50.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.790+0000 7f3651c64640 1 Processor -- start 2023-11-04T01:38:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.791+0000 7f3651c64640 1 -- start start 2023-11-04T01:38:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.791+0000 7f3651c64640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3634003970 0x7f364c15db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.791+0000 7f3651c64640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f364c15c180 0x7f364c0b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.791+0000 7f3651c64640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c0c8da0 0x7f364c0c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.791+0000 7f3651c64640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c0c9770 con 0x7f364c0c8da0 2023-11-04T01:38:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.791+0000 7f3651c64640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c15e0c0 con 0x7f3634003970 2023-11-04T01:38:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.791+0000 7f3651c64640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364c15d270 con 0x7f364c15c180 2023-11-04T01:38:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.791+0000 7f364bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c0c8da0 0x7f364c0c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.792+0000 7f364bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c0c8da0 0x7f364c0c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38306/0 (socket says 172.21.15.44:38306) 2023-11-04T01:38:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.792+0000 7f364bfff640 1 -- 172.21.15.44:0/2138164980 learned_addr learned my addr 172.21.15.44:0/2138164980 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.792+0000 7f364b7fe640 1 --2- 172.21.15.44:0/2138164980 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3634003970 0x7f364c15db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.792+0000 7f364affd640 1 --2- 172.21.15.44:0/2138164980 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f364c15c180 0x7f364c0b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.792+0000 7f364bfff640 1 -- 172.21.15.44:0/2138164980 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f364c15c180 msgr2=0x7f364c0b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.792+0000 7f364bfff640 1 --2- 172.21.15.44:0/2138164980 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f364c15c180 0x7f364c0b5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.792+0000 7f364bfff640 1 -- 172.21.15.44:0/2138164980 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3634003970 msgr2=0x7f364c15db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.792+0000 7f364bfff640 1 --2- 172.21.15.44:0/2138164980 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3634003970 0x7f364c15db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.792+0000 7f364bfff640 1 -- 172.21.15.44:0/2138164980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c15c6f0 con 0x7f364c0c8da0 2023-11-04T01:38:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.792+0000 7f364bfff640 1 --2- 172.21.15.44:0/2138164980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c0c8da0 0x7f364c0c9230 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f364c06f5f0 tx=0x7f36440115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.792+0000 7f3633fff640 1 -- 172.21.15.44:0/2138164980 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364400e070 con 0x7f364c0c8da0 2023-11-04T01:38:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.792+0000 7f3633fff640 1 -- 172.21.15.44:0/2138164980 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3644011e10 con 0x7f364c0c8da0 2023-11-04T01:38:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.792+0000 7f3651c64640 1 -- 172.21.15.44:0/2138164980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364c15c9d0 con 0x7f364c0c8da0 2023-11-04T01:38:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.792+0000 7f3633fff640 1 -- 172.21.15.44:0/2138164980 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644003990 con 0x7f364c0c8da0 2023-11-04T01:38:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.792+0000 7f3651c64640 1 -- 172.21.15.44:0/2138164980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364c15cf90 con 0x7f364c0c8da0 2023-11-04T01:38:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.793+0000 7f3651c64640 1 -- 172.21.15.44:0/2138164980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364c074290 con 0x7f364c0c8da0 2023-11-04T01:38:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.794+0000 7f3633fff640 1 -- 172.21.15.44:0/2138164980 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3644003af0 con 0x7f364c0c8da0 2023-11-04T01:38:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.794+0000 7f3633fff640 1 --2- 172.21.15.44:0/2138164980 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f363806aea0 0x7f363806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.794+0000 7f3633fff640 1 -- 172.21.15.44:0/2138164980 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f364408a040 con 0x7f364c0c8da0 2023-11-04T01:38:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.794+0000 7f364b7fe640 1 --2- 172.21.15.44:0/2138164980 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f363806aea0 0x7f363806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.795+0000 7f364b7fe640 1 --2- 172.21.15.44:0/2138164980 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f363806aea0 0x7f363806d360 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f363c036000 tx=0x7f363c030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.798+0000 7f3633fff640 1 -- 172.21.15.44:0/2138164980 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3644054e80 con 0x7f364c0c8da0 2023-11-04T01:38:50.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.972+0000 7f3651c64640 1 -- 172.21.15.44:0/2138164980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f364c1f2f50 con 0x7f364c0c8da0 2023-11-04T01:38:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.973+0000 7f3633fff640 1 -- 172.21.15.44:0/2138164980 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36440584a0 con 0x7f364c0c8da0 2023-11-04T01:38:50.975 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:38:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.974+0000 7f3651c64640 1 -- 172.21.15.44:0/2138164980 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f363806aea0 msgr2=0x7f363806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.974+0000 7f3651c64640 1 --2- 172.21.15.44:0/2138164980 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f363806aea0 0x7f363806d360 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f363c036000 tx=0x7f363c030000 comp rx=0 tx=0).stop 2023-11-04T01:38:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.974+0000 7f3651c64640 1 -- 172.21.15.44:0/2138164980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c0c8da0 msgr2=0x7f364c0c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.974+0000 7f3651c64640 1 --2- 172.21.15.44:0/2138164980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c0c8da0 0x7f364c0c9230 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f364c06f5f0 tx=0x7f36440115a0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.975+0000 7f3651c64640 1 -- 172.21.15.44:0/2138164980 shutdown_connections 2023-11-04T01:38:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.975+0000 7f3651c64640 1 --2- 172.21.15.44:0/2138164980 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f363806aea0 0x7f363806d360 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.975+0000 7f3651c64640 1 --2- 172.21.15.44:0/2138164980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c0c8da0 0x7f364c0c9230 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.975+0000 7f3651c64640 1 --2- 172.21.15.44:0/2138164980 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f364c15c180 0x7f364c0b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.975+0000 7f3651c64640 1 --2- 172.21.15.44:0/2138164980 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3634003970 0x7f364c15db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.975+0000 7f3651c64640 1 -- 172.21.15.44:0/2138164980 >> 172.21.15.44:0/2138164980 conn(0x7f364c06ea20 msgr2=0x7f364c072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.975+0000 7f3651c64640 1 -- 172.21.15.44:0/2138164980 shutdown_connections 2023-11-04T01:38:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:50.975+0000 7f3651c64640 1 -- 172.21.15.44:0/2138164980 wait complete. 2023-11-04T01:38:50.987 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:51.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.094+0000 7f45388d4640 1 Processor -- start 2023-11-04T01:38:51.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.094+0000 7f45388d4640 1 -- start start 2023-11-04T01:38:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.095+0000 7f45388d4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4534160430 0x7f45340b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.095+0000 7f45388d4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f453406c3a0 0x7f45340cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.095+0000 7f45388d4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45340b2fc0 con 0x7f45340b2b60 2023-11-04T01:38:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.095+0000 7f45388d4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45340cb580 con 0x7f453406c3a0 2023-11-04T01:38:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.095+0000 7f45388d4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453406ca40 con 0x7f4534160430 2023-11-04T01:38:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.095+0000 7f4531d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f45340b2b60 0x7f453406bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37502/0 (socket says 172.21.15.44:37502) 2023-11-04T01:38:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.095+0000 7f4531d9b640 1 -- 172.21.15.44:0/3064260767 learned_addr learned my addr 172.21.15.44:0/3064260767 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f4532d9d640 1 --2- 172.21.15.44:0/3064260767 >> v2:172.21.15.204:3300/0 conn(0x7f453406c3a0 0x7f45340cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453259c640 1 --2- 172.21.15.44:0/3064260767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4534160430 0x7f45340b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 -- 172.21.15.44:0/3064260767 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344980173 0 0) 0x7f45340b2fc0 con 0x7f45340b2b60 2023-11-04T01:38:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 -- 172.21.15.44:0/3064260767 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4520003520 con 0x7f45340b2b60 2023-11-04T01:38:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 -- 172.21.15.44:0/3064260767 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2255267615 0 0) 0x7f4520003520 con 0x7f45340b2b60 2023-11-04T01:38:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 -- 172.21.15.44:0/3064260767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4534160430 msgr2=0x7f45340b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 --2- 172.21.15.44:0/3064260767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4534160430 0x7f45340b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 -- 172.21.15.44:0/3064260767 >> v2:172.21.15.204:3300/0 conn(0x7f453406c3a0 msgr2=0x7f45340cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 --2- 172.21.15.44:0/3064260767 >> v2:172.21.15.204:3300/0 conn(0x7f453406c3a0 0x7f45340cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 -- 172.21.15.44:0/3064260767 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453406c810 con 0x7f45340b2b60 2023-11-04T01:38:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 -- 172.21.15.44:0/3064260767 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f451c001670 con 0x7f45340b2b60 2023-11-04T01:38:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 -- 172.21.15.44:0/3064260767 >> v1:172.21.15.44:6789/0 conn(0x7f45340b2b60 legacy=0x7f453406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 --2- 172.21.15.44:0/3064260767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4520003970 0x7f4520003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 --2- 172.21.15.44:0/3064260767 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45200047c0 0x7f4520004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 --2- 172.21.15.44:0/3064260767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4534160430 0x7f4520005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 -- 172.21.15.44:0/3064260767 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45340cb580 con 0x7f4520003970 2023-11-04T01:38:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 -- 172.21.15.44:0/3064260767 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453406ca40 con 0x7f45200047c0 2023-11-04T01:38:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453159a640 1 -- 172.21.15.44:0/3064260767 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452000b980 con 0x7f4534160430 2023-11-04T01:38:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453259c640 1 --2- 172.21.15.44:0/3064260767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4520003970 0x7f4520003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f4531d9b640 1 --2- 172.21.15.44:0/3064260767 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45200047c0 0x7f4520004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f4532d9d640 1 --2- 172.21.15.44:0/3064260767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4534160430 0x7f4520005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453259c640 1 -- 172.21.15.44:0/3064260767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4534160430 msgr2=0x7f4520005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453259c640 1 --2- 172.21.15.44:0/3064260767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4534160430 0x7f4520005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453259c640 1 -- 172.21.15.44:0/3064260767 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45200047c0 msgr2=0x7f4520004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453259c640 1 --2- 172.21.15.44:0/3064260767 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45200047c0 0x7f4520004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.096+0000 7f453259c640 1 -- 172.21.15.44:0/3064260767 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4520003520 con 0x7f4520003970 2023-11-04T01:38:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.097+0000 7f453259c640 1 --2- 172.21.15.44:0/3064260767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4520003970 0x7f4520003d90 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f452c009ac0 tx=0x7f45200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277ff3c564bb3368 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.097+0000 7f453159a640 1 -- 172.21.15.44:0/3064260767 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c02c6b0 con 0x7f4520003970 2023-11-04T01:38:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.097+0000 7f453159a640 1 -- 172.21.15.44:0/3064260767 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c02c810 con 0x7f4520003970 2023-11-04T01:38:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.097+0000 7f453159a640 1 -- 172.21.15.44:0/3064260767 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c02cba0 con 0x7f4520003970 2023-11-04T01:38:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.098+0000 7f45388d4640 1 -- 172.21.15.44:0/3064260767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4520003970 msgr2=0x7f4520003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.098+0000 7f45388d4640 1 --2- 172.21.15.44:0/3064260767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4520003970 0x7f4520003d90 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f452c009ac0 tx=0x7f45200057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.098+0000 7f4532d9d640 1 -- 172.21.15.44:0/3064260767 reap_dead start 2023-11-04T01:38:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.098+0000 7f45388d4640 1 -- 172.21.15.44:0/3064260767 shutdown_connections 2023-11-04T01:38:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.098+0000 7f45388d4640 1 -- 172.21.15.44:0/3064260767 >> 172.21.15.44:0/3064260767 conn(0x7f453406ea20 msgr2=0x7f453406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.098+0000 7f45388d4640 1 -- 172.21.15.44:0/3064260767 shutdown_connections 2023-11-04T01:38:51.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.098+0000 7f45388d4640 1 -- 172.21.15.44:0/3064260767 wait complete. 2023-11-04T01:38:51.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.099+0000 7f45388d4640 1 Processor -- start 2023-11-04T01:38:51.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.099+0000 7f45388d4640 1 -- start start 2023-11-04T01:38:51.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.100+0000 7f45388d4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4520003970 0x7f4534156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.100+0000 7f45388d4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4534152080 0x7f45340b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.100+0000 7f45388d4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4534157910 0x7f4534148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.100+0000 7f45388d4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4534156680 con 0x7f4520003970 2023-11-04T01:38:51.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.100+0000 7f45388d4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4534152900 con 0x7f4534152080 2023-11-04T01:38:51.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.100+0000 7f45388d4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4534157480 con 0x7f4534157910 2023-11-04T01:38:51.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.100+0000 7f453259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4520003970 0x7f4534156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.100+0000 7f453259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4520003970 0x7f4534156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38326/0 (socket says 172.21.15.44:38326) 2023-11-04T01:38:51.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.100+0000 7f453259c640 1 -- 172.21.15.44:0/4019699995 learned_addr learned my addr 172.21.15.44:0/4019699995 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:51.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.100+0000 7f453259c640 1 -- 172.21.15.44:0/4019699995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4534157910 msgr2=0x7f4534148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.100+0000 7f453259c640 1 --2- 172.21.15.44:0/4019699995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4534157910 0x7f4534148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.100+0000 7f453259c640 1 -- 172.21.15.44:0/4019699995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4534152080 msgr2=0x7f45340b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.100+0000 7f453259c640 1 --2- 172.21.15.44:0/4019699995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4534152080 0x7f45340b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.100+0000 7f453259c640 1 -- 172.21.15.44:0/4019699995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4534156870 con 0x7f4520003970 2023-11-04T01:38:51.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.101+0000 7f453259c640 1 --2- 172.21.15.44:0/4019699995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4520003970 0x7f4534156140 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f452c037040 tx=0x7f452c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.101+0000 7f452affd640 1 -- 172.21.15.44:0/4019699995 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c003810 con 0x7f4520003970 2023-11-04T01:38:51.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.101+0000 7f452affd640 1 -- 172.21.15.44:0/4019699995 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c003970 con 0x7f4520003970 2023-11-04T01:38:51.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.101+0000 7f45388d4640 1 -- 172.21.15.44:0/4019699995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4534156b50 con 0x7f4520003970 2023-11-04T01:38:51.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.101+0000 7f452affd640 1 -- 172.21.15.44:0/4019699995 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c003ce0 con 0x7f4520003970 2023-11-04T01:38:51.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.101+0000 7f45388d4640 1 -- 172.21.15.44:0/4019699995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4534157110 con 0x7f4520003970 2023-11-04T01:38:51.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.102+0000 7f45388d4640 1 -- 172.21.15.44:0/4019699995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4534074290 con 0x7f4520003970 2023-11-04T01:38:51.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.102+0000 7f452affd640 1 -- 172.21.15.44:0/4019699995 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f452c034440 con 0x7f4520003970 2023-11-04T01:38:51.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.103+0000 7f452affd640 1 --2- 172.21.15.44:0/4019699995 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f451406ae70 0x7f451406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.103+0000 7f452affd640 1 -- 172.21.15.44:0/4019699995 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f452c0ab7a0 con 0x7f4520003970 2023-11-04T01:38:51.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.103+0000 7f4531d9b640 1 --2- 172.21.15.44:0/4019699995 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f451406ae70 0x7f451406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.104+0000 7f4531d9b640 1 --2- 172.21.15.44:0/4019699995 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f451406ae70 0x7f451406d330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f451c0079d0 tx=0x7f451c007960 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.107+0000 7f452affd640 1 -- 172.21.15.44:0/4019699995 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f452c076680 con 0x7f4520003970 2023-11-04T01:38:51.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.280+0000 7f45388d4640 1 -- 172.21.15.44:0/4019699995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f45340b6b20 con 0x7f4520003970 2023-11-04T01:38:51.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.281+0000 7f452affd640 1 -- 172.21.15.44:0/4019699995 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v75) v1 ==== 103+0+11 (secure 0 0 0) 0x7f452c0044e0 con 0x7f4520003970 2023-11-04T01:38:51.283 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:51.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.282+0000 7f45388d4640 1 -- 172.21.15.44:0/4019699995 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f451406ae70 msgr2=0x7f451406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.282+0000 7f45388d4640 1 --2- 172.21.15.44:0/4019699995 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f451406ae70 0x7f451406d330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f451c0079d0 tx=0x7f451c007960 comp rx=0 tx=0).stop 2023-11-04T01:38:51.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.282+0000 7f45388d4640 1 -- 172.21.15.44:0/4019699995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4520003970 msgr2=0x7f4534156140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.282+0000 7f45388d4640 1 --2- 172.21.15.44:0/4019699995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4520003970 0x7f4534156140 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f452c037040 tx=0x7f452c004730 comp rx=0 tx=0).stop 2023-11-04T01:38:51.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.283+0000 7f45388d4640 1 -- 172.21.15.44:0/4019699995 shutdown_connections 2023-11-04T01:38:51.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.283+0000 7f45388d4640 1 --2- 172.21.15.44:0/4019699995 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f451406ae70 0x7f451406d330 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.283+0000 7f45388d4640 1 --2- 172.21.15.44:0/4019699995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4534157910 0x7f4534148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.283+0000 7f45388d4640 1 --2- 172.21.15.44:0/4019699995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4534152080 0x7f45340b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.283+0000 7f45388d4640 1 --2- 172.21.15.44:0/4019699995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4520003970 0x7f4534156140 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.283+0000 7f45388d4640 1 -- 172.21.15.44:0/4019699995 >> 172.21.15.44:0/4019699995 conn(0x7f453406ea20 msgr2=0x7f4534072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:51.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.283+0000 7f45388d4640 1 -- 172.21.15.44:0/4019699995 shutdown_connections 2023-11-04T01:38:51.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.283+0000 7f45388d4640 1 -- 172.21.15.44:0/4019699995 wait complete. 2023-11-04T01:38:51.295 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:38:51.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.402+0000 7f8fd0a26640 1 Processor -- start 2023-11-04T01:38:51.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.403+0000 7f8fd0a26640 1 -- start start 2023-11-04T01:38:51.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.403+0000 7f8fd0a26640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fcc153e60 0x7f8fcc15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.403+0000 7f8fd0a26640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8fcc0cd6d0 0x7f8fcc161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.403+0000 7f8fd0a26640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8fcc0b4880 0x7f8fcc0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.403+0000 7f8fd0a26640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fcc0cde60 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.403+0000 7f8fd0a26640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fcc160f90 con 0x7f8fcc0b4880 2023-11-04T01:38:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.403+0000 7f8fd0a26640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0b5200 con 0x7f8fcc153e60 2023-11-04T01:38:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.403+0000 7f8fc3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8fcc0cd6d0 0x7f8fcc161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.403+0000 7f8fc3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8fcc0cd6d0 0x7f8fcc161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38336/0 (socket says 172.21.15.44:38336) 2023-11-04T01:38:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.403+0000 7f8fc3fff640 1 -- 172.21.15.44:0/222791499 learned_addr learned my addr 172.21.15.44:0/222791499 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.404+0000 7f8fcad9d640 1 --2- 172.21.15.44:0/222791499 >> v2:172.21.15.204:3300/0 conn(0x7f8fcc0b4880 0x7f8fcc0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.404+0000 7f8fca59c640 1 --2- 172.21.15.44:0/222791499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fcc153e60 0x7f8fcc15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.404+0000 7f8fc3fff640 1 -- 172.21.15.44:0/222791499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fcc153e60 msgr2=0x7f8fcc15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.404+0000 7f8fc3fff640 1 --2- 172.21.15.44:0/222791499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fcc153e60 0x7f8fcc15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.404+0000 7f8fc3fff640 1 -- 172.21.15.44:0/222791499 >> v2:172.21.15.204:3300/0 conn(0x7f8fcc0b4880 msgr2=0x7f8fcc0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.404+0000 7f8fc3fff640 1 --2- 172.21.15.44:0/222791499 >> v2:172.21.15.204:3300/0 conn(0x7f8fcc0b4880 0x7f8fcc0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.404+0000 7f8fc3fff640 1 -- 172.21.15.44:0/222791499 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc15e400 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.404+0000 7f8fcad9d640 1 --2- 172.21.15.44:0/222791499 >> v2:172.21.15.204:3300/0 conn(0x7f8fcc0b4880 0x7f8fcc0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.404+0000 7f8fc3fff640 1 --2- 172.21.15.44:0/222791499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc0cd6d0 0x7f8fcc161420 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0c9e50 tx=0x7f8fb402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5696fe21cbb23b3f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.405+0000 7f8fc9d9b640 1 -- 172.21.15.44:0/222791499 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4031870 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.405+0000 7f8fc9d9b640 1 -- 172.21.15.44:0/222791499 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb40319d0 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.405+0000 7f8fc9d9b640 1 -- 172.21.15.44:0/222791499 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4031d60 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.405+0000 7f8fd0a26640 1 -- 172.21.15.44:0/222791499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc0cd6d0 msgr2=0x7f8fcc161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.405+0000 7f8fd0a26640 1 --2- 172.21.15.44:0/222791499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc0cd6d0 0x7f8fcc161420 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0c9e50 tx=0x7f8fb402b910 comp rx=0 tx=0).stop 2023-11-04T01:38:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.405+0000 7f8fd0a26640 1 -- 172.21.15.44:0/222791499 shutdown_connections 2023-11-04T01:38:51.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.405+0000 7f8fd0a26640 1 --2- 172.21.15.44:0/222791499 >> v2:172.21.15.204:3300/0 conn(0x7f8fcc0b4880 0x7f8fcc0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.405+0000 7f8fd0a26640 1 --2- 172.21.15.44:0/222791499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc0cd6d0 0x7f8fcc161420 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.405+0000 7f8fd0a26640 1 --2- 172.21.15.44:0/222791499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fcc153e60 0x7f8fcc15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.405+0000 7f8fd0a26640 1 -- 172.21.15.44:0/222791499 >> 172.21.15.44:0/222791499 conn(0x7f8fcc0cf880 msgr2=0x7f8fcc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:51.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.405+0000 7f8fd0a26640 1 -- 172.21.15.44:0/222791499 shutdown_connections 2023-11-04T01:38:51.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.405+0000 7f8fd0a26640 1 -- 172.21.15.44:0/222791499 wait complete. 2023-11-04T01:38:51.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fd0a26640 1 Processor -- start 2023-11-04T01:38:51.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fd0a26640 1 -- start start 2023-11-04T01:38:51.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fd0a26640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fcc0b4880 0x7f8fcc154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fd0a26640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc0cd6d0 0x7f8fcc0cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fd0a26640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fcc153e60 0x7f8fcc156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fd0a26640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc155bd0 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fd0a26640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0cc860 con 0x7f8fcc153e60 2023-11-04T01:38:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fd0a26640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc155330 con 0x7f8fcc0b4880 2023-11-04T01:38:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fc3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc0cd6d0 0x7f8fcc0cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fc3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc0cd6d0 0x7f8fcc0cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38338/0 (socket says 172.21.15.44:38338) 2023-11-04T01:38:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fc3fff640 1 -- 172.21.15.44:0/1301767681 learned_addr learned my addr 172.21.15.44:0/1301767681 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fca59c640 1 --2- 172.21.15.44:0/1301767681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fcc0b4880 0x7f8fcc154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fcad9d640 1 --2- 172.21.15.44:0/1301767681 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fcc153e60 0x7f8fcc156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fc3fff640 1 -- 172.21.15.44:0/1301767681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fcc0b4880 msgr2=0x7f8fcc154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fc3fff640 1 --2- 172.21.15.44:0/1301767681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fcc0b4880 0x7f8fcc154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fc3fff640 1 -- 172.21.15.44:0/1301767681 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fcc153e60 msgr2=0x7f8fcc156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fc3fff640 1 --2- 172.21.15.44:0/1301767681 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fcc153e60 0x7f8fcc156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fc3fff640 1 -- 172.21.15.44:0/1301767681 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40094d0 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fc3fff640 1 --2- 172.21.15.44:0/1301767681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc0cd6d0 0x7f8fcc0cc320 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f8fb402b950 tx=0x7f8fb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fc2ffd640 1 -- 172.21.15.44:0/1301767681 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4031860 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fc2ffd640 1 -- 172.21.15.44:0/1301767681 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb40443f0 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fd0a26640 1 -- 172.21.15.44:0/1301767681 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fcc155610 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fc2ffd640 1 -- 172.21.15.44:0/1301767681 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40447a0 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.408+0000 7f8fd0a26640 1 -- 172.21.15.44:0/1301767681 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc158360 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.409+0000 7f8fd0a26640 1 -- 172.21.15.44:0/1301767681 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fcc074290 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.410+0000 7f8fc2ffd640 1 -- 172.21.15.44:0/1301767681 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8fb404d450 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.410+0000 7f8fc2ffd640 1 --2- 172.21.15.44:0/1301767681 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8fac06ae70 0x7f8fac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.410+0000 7f8fc2ffd640 1 -- 172.21.15.44:0/1301767681 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f8fb402d040 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.410+0000 7f8fca59c640 1 --2- 172.21.15.44:0/1301767681 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8fac06ae70 0x7f8fac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.411+0000 7f8fca59c640 1 --2- 172.21.15.44:0/1301767681 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8fac06ae70 0x7f8fac06d330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc156b70 tx=0x7f8fbc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.415+0000 7f8fc2ffd640 1 -- 172.21.15.44:0/1301767681 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8fb4076d90 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.593+0000 7f8fd0a26640 1 -- 172.21.15.44:0/1301767681 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f8fcc0d0b80 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.594+0000 7f8fc2ffd640 1 -- 172.21.15.44:0/1301767681 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v75) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8fb4035070 con 0x7f8fcc0cd6d0 2023-11-04T01:38:51.596 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:51.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.595+0000 7f8fd0a26640 1 -- 172.21.15.44:0/1301767681 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8fac06ae70 msgr2=0x7f8fac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.595+0000 7f8fd0a26640 1 --2- 172.21.15.44:0/1301767681 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8fac06ae70 0x7f8fac06d330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc156b70 tx=0x7f8fbc008040 comp rx=0 tx=0).stop 2023-11-04T01:38:51.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.595+0000 7f8fd0a26640 1 -- 172.21.15.44:0/1301767681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc0cd6d0 msgr2=0x7f8fcc0cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.595+0000 7f8fd0a26640 1 --2- 172.21.15.44:0/1301767681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc0cd6d0 0x7f8fcc0cc320 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f8fb402b950 tx=0x7f8fb40046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.595+0000 7f8fd0a26640 1 -- 172.21.15.44:0/1301767681 shutdown_connections 2023-11-04T01:38:51.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.595+0000 7f8fd0a26640 1 --2- 172.21.15.44:0/1301767681 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8fac06ae70 0x7f8fac06d330 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.595+0000 7f8fd0a26640 1 --2- 172.21.15.44:0/1301767681 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fcc153e60 0x7f8fcc156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.595+0000 7f8fd0a26640 1 --2- 172.21.15.44:0/1301767681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc0cd6d0 0x7f8fcc0cc320 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.595+0000 7f8fd0a26640 1 --2- 172.21.15.44:0/1301767681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fcc0b4880 0x7f8fcc154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.595+0000 7f8fd0a26640 1 -- 172.21.15.44:0/1301767681 >> 172.21.15.44:0/1301767681 conn(0x7f8fcc0cf880 msgr2=0x7f8fcc0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:51.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.596+0000 7f8fd0a26640 1 -- 172.21.15.44:0/1301767681 shutdown_connections 2023-11-04T01:38:51.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.596+0000 7f8fd0a26640 1 -- 172.21.15.44:0/1301767681 wait complete. 2023-11-04T01:38:51.608 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:38:51.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.715+0000 7fe2e2978640 1 Processor -- start 2023-11-04T01:38:51.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.716+0000 7fe2e2978640 1 -- start start 2023-11-04T01:38:51.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.716+0000 7fe2e2978640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2dc153e60 0x7fe2dc15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.716+0000 7fe2e2978640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe2dc0cd6d0 0x7fe2dc161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.716+0000 7fe2e2978640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc0cde60 con 0x7fe2dc0b4880 2023-11-04T01:38:51.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.716+0000 7fe2e2978640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc160f90 con 0x7fe2dc0cd6d0 2023-11-04T01:38:51.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.716+0000 7fe2e2978640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc15e400 con 0x7fe2dc153e60 2023-11-04T01:38:51.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.717+0000 7fe2e0f15640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe2dc0b4880 0x7fe2dc06b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37506/0 (socket says 172.21.15.44:37506) 2023-11-04T01:38:51.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.717+0000 7fe2e0f15640 1 -- 172.21.15.44:0/4178627759 learned_addr learned my addr 172.21.15.44:0/4178627759 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:51.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.717+0000 7fe2db7fe640 1 --2- 172.21.15.44:0/4178627759 >> v2:172.21.15.204:3300/0 conn(0x7fe2dc0cd6d0 0x7fe2dc161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.717+0000 7fe2dbfff640 1 --2- 172.21.15.44:0/4178627759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2dc153e60 0x7fe2dc15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.717+0000 7fe2daffd640 1 -- 172.21.15.44:0/4178627759 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500328930 0 0) 0x7fe2dc0cde60 con 0x7fe2dc0b4880 2023-11-04T01:38:51.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.717+0000 7fe2daffd640 1 -- 172.21.15.44:0/4178627759 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2c4003520 con 0x7fe2dc0b4880 2023-11-04T01:38:51.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.717+0000 7fe2dbfff640 1 -- 172.21.15.44:0/4178627759 >> v2:172.21.15.204:3300/0 conn(0x7fe2dc0cd6d0 msgr2=0x7fe2dc161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:51.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.717+0000 7fe2dbfff640 1 --2- 172.21.15.44:0/4178627759 >> v2:172.21.15.204:3300/0 conn(0x7fe2dc0cd6d0 0x7fe2dc161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.717+0000 7fe2dbfff640 1 -- 172.21.15.44:0/4178627759 >> v1:172.21.15.44:6789/0 conn(0x7fe2dc0b4880 legacy=0x7fe2dc06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.717+0000 7fe2dbfff640 1 -- 172.21.15.44:0/4178627759 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc161960 con 0x7fe2dc153e60 2023-11-04T01:38:51.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.717+0000 7fe2db7fe640 1 --2- 172.21.15.44:0/4178627759 >> v2:172.21.15.204:3300/0 conn(0x7fe2dc0cd6d0 0x7fe2dc161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:51.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.718+0000 7fe2dbfff640 1 --2- 172.21.15.44:0/4178627759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2dc153e60 0x7fe2dc15dec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0097a0 tx=0x7fe2cc02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=695996aacc008117 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.718+0000 7fe2daffd640 1 -- 172.21.15.44:0/4178627759 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc02d040 con 0x7fe2dc153e60 2023-11-04T01:38:51.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.718+0000 7fe2daffd640 1 -- 172.21.15.44:0/4178627759 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc031810 con 0x7fe2dc153e60 2023-11-04T01:38:51.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.718+0000 7fe2daffd640 1 -- 172.21.15.44:0/4178627759 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc031ba0 con 0x7fe2dc153e60 2023-11-04T01:38:51.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.718+0000 7fe2e2978640 1 -- 172.21.15.44:0/4178627759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2dc153e60 msgr2=0x7fe2dc15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.718+0000 7fe2e2978640 1 --2- 172.21.15.44:0/4178627759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2dc153e60 0x7fe2dc15dec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0097a0 tx=0x7fe2cc02b8b0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.719+0000 7fe2e2978640 1 -- 172.21.15.44:0/4178627759 shutdown_connections 2023-11-04T01:38:51.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.719+0000 7fe2e2978640 1 --2- 172.21.15.44:0/4178627759 >> v2:172.21.15.204:3300/0 conn(0x7fe2dc0cd6d0 0x7fe2dc161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.719+0000 7fe2e2978640 1 --2- 172.21.15.44:0/4178627759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2dc153e60 0x7fe2dc15dec0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.719+0000 7fe2e2978640 1 -- 172.21.15.44:0/4178627759 >> 172.21.15.44:0/4178627759 conn(0x7fe2dc0cf880 msgr2=0x7fe2dc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.719+0000 7fe2e2978640 1 -- 172.21.15.44:0/4178627759 shutdown_connections 2023-11-04T01:38:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.719+0000 7fe2e2978640 1 -- 172.21.15.44:0/4178627759 wait complete. 2023-11-04T01:38:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.721+0000 7fe2e2978640 1 Processor -- start 2023-11-04T01:38:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.721+0000 7fe2e2978640 1 -- start start 2023-11-04T01:38:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e2978640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe2dc0b4880 0x7fe2dc0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e2978640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2dc0cd6d0 0x7fe2dc150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e2978640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2dc153e60 0x7fe2dc156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e2978640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0cce50 con 0x7fe2dc153e60 2023-11-04T01:38:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e2978640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc155b20 con 0x7fe2dc0b4880 2023-11-04T01:38:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e2978640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc154c50 con 0x7fe2dc0cd6d0 2023-11-04T01:38:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e0f15640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2dc153e60 0x7fe2dc156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e0f15640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2dc153e60 0x7fe2dc156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38350/0 (socket says 172.21.15.44:38350) 2023-11-04T01:38:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e0f15640 1 -- 172.21.15.44:0/4043856458 learned_addr learned my addr 172.21.15.44:0/4043856458 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2dbfff640 1 --2- 172.21.15.44:0/4043856458 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe2dc0b4880 0x7fe2dc0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2db7fe640 1 --2- 172.21.15.44:0/4043856458 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2dc0cd6d0 0x7fe2dc150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e0f15640 1 -- 172.21.15.44:0/4043856458 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2dc0cd6d0 msgr2=0x7fe2dc150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e0f15640 1 --2- 172.21.15.44:0/4043856458 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2dc0cd6d0 0x7fe2dc150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e0f15640 1 -- 172.21.15.44:0/4043856458 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe2dc0b4880 msgr2=0x7fe2dc0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e0f15640 1 --2- 172.21.15.44:0/4043856458 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe2dc0b4880 0x7fe2dc0cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e0f15640 1 -- 172.21.15.44:0/4043856458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d0009400 con 0x7fe2dc153e60 2023-11-04T01:38:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e0f15640 1 --2- 172.21.15.44:0/4043856458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2dc153e60 0x7fe2dc156280 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400cb70 tx=0x7fe2d400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2d8ff9640 1 -- 172.21.15.44:0/4043856458 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400ace0 con 0x7fe2dc153e60 2023-11-04T01:38:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2d8ff9640 1 -- 172.21.15.44:0/4043856458 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d400ae40 con 0x7fe2dc153e60 2023-11-04T01:38:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e2978640 1 -- 172.21.15.44:0/4043856458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc009400 con 0x7fe2dc153e60 2023-11-04T01:38:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2d8ff9640 1 -- 172.21.15.44:0/4043856458 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4012620 con 0x7fe2dc153e60 2023-11-04T01:38:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e2978640 1 -- 172.21.15.44:0/4043856458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc155180 con 0x7fe2dc153e60 2023-11-04T01:38:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.722+0000 7fe2e2978640 1 -- 172.21.15.44:0/4043856458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc0c9ed0 con 0x7fe2dc153e60 2023-11-04T01:38:51.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.723+0000 7fe2d8ff9640 1 -- 172.21.15.44:0/4043856458 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe2d4007070 con 0x7fe2dc153e60 2023-11-04T01:38:51.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.723+0000 7fe2d8ff9640 1 --2- 172.21.15.44:0/4043856458 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe2c806ae70 0x7fe2c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.723+0000 7fe2d8ff9640 1 -- 172.21.15.44:0/4043856458 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fe2d4089730 con 0x7fe2dc153e60 2023-11-04T01:38:51.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.724+0000 7fe2dbfff640 1 --2- 172.21.15.44:0/4043856458 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe2c806ae70 0x7fe2c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.724+0000 7fe2dbfff640 1 --2- 172.21.15.44:0/4043856458 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe2c806ae70 0x7fe2c806d330 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc036000 tx=0x7fe2cc03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.727+0000 7fe2d8ff9640 1 -- 172.21.15.44:0/4043856458 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2dc0c9ed0 con 0x7fe2dc153e60 2023-11-04T01:38:51.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.904+0000 7fe2e2978640 1 -- 172.21.15.44:0/4043856458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fe2dc0c9ed0 con 0x7fe2dc153e60 2023-11-04T01:38:51.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.904+0000 7fe2d8ff9640 1 -- 172.21.15.44:0/4043856458 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v75) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe2d4017020 con 0x7fe2dc153e60 2023-11-04T01:38:51.906 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:51.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.907+0000 7fe2e2978640 1 -- 172.21.15.44:0/4043856458 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe2c806ae70 msgr2=0x7fe2c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.907+0000 7fe2e2978640 1 --2- 172.21.15.44:0/4043856458 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe2c806ae70 0x7fe2c806d330 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc036000 tx=0x7fe2cc03c040 comp rx=0 tx=0).stop 2023-11-04T01:38:51.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.907+0000 7fe2e2978640 1 -- 172.21.15.44:0/4043856458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2dc153e60 msgr2=0x7fe2dc156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.907+0000 7fe2e2978640 1 --2- 172.21.15.44:0/4043856458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2dc153e60 0x7fe2dc156280 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400cb70 tx=0x7fe2d400a430 comp rx=0 tx=0).stop 2023-11-04T01:38:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.907+0000 7fe2e2978640 1 -- 172.21.15.44:0/4043856458 shutdown_connections 2023-11-04T01:38:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.907+0000 7fe2e2978640 1 --2- 172.21.15.44:0/4043856458 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe2c806ae70 0x7fe2c806d330 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.907+0000 7fe2e2978640 1 --2- 172.21.15.44:0/4043856458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2dc153e60 0x7fe2dc156280 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.907+0000 7fe2e2978640 1 --2- 172.21.15.44:0/4043856458 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2dc0cd6d0 0x7fe2dc150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.907+0000 7fe2e2978640 1 --2- 172.21.15.44:0/4043856458 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe2dc0b4880 0x7fe2dc0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.907+0000 7fe2e2978640 1 -- 172.21.15.44:0/4043856458 >> 172.21.15.44:0/4043856458 conn(0x7fe2dc0cf880 msgr2=0x7fe2dc15e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.907+0000 7fe2e2978640 1 -- 172.21.15.44:0/4043856458 shutdown_connections 2023-11-04T01:38:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:51.907+0000 7fe2e2978640 1 -- 172.21.15.44:0/4043856458 wait complete. 2023-11-04T01:38:51.919 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config' 2023-11-04T01:38:52.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.024+0000 7f1e7266f640 1 Processor -- start 2023-11-04T01:38:52.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.024+0000 7f1e7266f640 1 -- start start 2023-11-04T01:38:52.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.024+0000 7f1e7266f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1e6c15ae70 0x7f1e6c15f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.024+0000 7f1e7266f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1e6c06d720 0x7f1e6c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.024+0000 7f1e7266f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c0cab30 con 0x7f1e6c0c99b0 2023-11-04T01:38:52.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.024+0000 7f1e7266f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c0b5110 con 0x7f1e6c06d720 2023-11-04T01:38:52.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.024+0000 7f1e7266f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c15f820 con 0x7f1e6c15ae70 2023-11-04T01:38:52.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.024+0000 7f1e70c0c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1e6c06d720 0x7f1e6c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.024+0000 7f1e70c0c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1e6c06d720 0x7f1e6c06a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38364/0 (socket says 172.21.15.44:38364) 2023-11-04T01:38:52.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.024+0000 7f1e70c0c640 1 -- 172.21.15.44:0/3882492013 learned_addr learned my addr 172.21.15.44:0/3882492013 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:52.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.024+0000 7f1e6bfff640 1 --2- 172.21.15.44:0/3882492013 >> v2:172.21.15.204:3300/0 conn(0x7f1e6c15ae70 0x7f1e6c15f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.024+0000 7f1e70c0c640 1 -- 172.21.15.44:0/3882492013 >> v2:172.21.15.204:3300/0 conn(0x7f1e6c15ae70 msgr2=0x7f1e6c15f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:52.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.024+0000 7f1e70c0c640 1 --2- 172.21.15.44:0/3882492013 >> v2:172.21.15.204:3300/0 conn(0x7f1e6c15ae70 0x7f1e6c15f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.024+0000 7f1e70c0c640 1 -- 172.21.15.44:0/3882492013 >> v1:172.21.15.204:6789/0 conn(0x7f1e6c0c99b0 legacy=0x7f1e6c06d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:52.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.024+0000 7f1e70c0c640 1 -- 172.21.15.44:0/3882492013 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c0c9eb0 con 0x7f1e6c06d720 2023-11-04T01:38:52.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.025+0000 7f1e70c0c640 1 --2- 172.21.15.44:0/3882492013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c06d720 0x7f1e6c06a8d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c06e020 tx=0x7f1e6402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924906072733b49e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:52.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.025+0000 7f1e6affd640 1 -- 172.21.15.44:0/3882492013 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6402cb20 con 0x7f1e6c06d720 2023-11-04T01:38:52.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.025+0000 7f1e6affd640 1 -- 172.21.15.44:0/3882492013 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6402cc80 con 0x7f1e6c06d720 2023-11-04T01:38:52.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.025+0000 7f1e6affd640 1 -- 172.21.15.44:0/3882492013 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e640343f0 con 0x7f1e6c06d720 2023-11-04T01:38:52.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.026+0000 7f1e7266f640 1 -- 172.21.15.44:0/3882492013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c06d720 msgr2=0x7f1e6c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.026+0000 7f1e7266f640 1 --2- 172.21.15.44:0/3882492013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c06d720 0x7f1e6c06a8d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c06e020 tx=0x7f1e6402bf80 comp rx=0 tx=0).stop 2023-11-04T01:38:52.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.026+0000 7f1e7266f640 1 -- 172.21.15.44:0/3882492013 shutdown_connections 2023-11-04T01:38:52.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.026+0000 7f1e7266f640 1 --2- 172.21.15.44:0/3882492013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c06d720 0x7f1e6c06a8d0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.026+0000 7f1e7266f640 1 --2- 172.21.15.44:0/3882492013 >> v2:172.21.15.204:3300/0 conn(0x7f1e6c15ae70 0x7f1e6c15f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.026+0000 7f1e7266f640 1 -- 172.21.15.44:0/3882492013 >> 172.21.15.44:0/3882492013 conn(0x7f1e6c0cf4b0 msgr2=0x7f1e6c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:52.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.026+0000 7f1e7266f640 1 -- 172.21.15.44:0/3882492013 shutdown_connections 2023-11-04T01:38:52.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.026+0000 7f1e7266f640 1 -- 172.21.15.44:0/3882492013 wait complete. 2023-11-04T01:38:52.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.027+0000 7f1e7266f640 1 Processor -- start 2023-11-04T01:38:52.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.027+0000 7f1e7266f640 1 -- start start 2023-11-04T01:38:52.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e7266f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e6c06d720 0x7f1e6c14f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e7266f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e6c0c99b0 0x7f1e6c15e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e7266f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c15ae70 0x7f1e6c15edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e7266f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c1f1090 con 0x7f1e6c15ae70 2023-11-04T01:38:52.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e7266f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c15f440 con 0x7f1e6c06d720 2023-11-04T01:38:52.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e7266f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c1f09d0 con 0x7f1e6c0c99b0 2023-11-04T01:38:52.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e70c0c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c15ae70 0x7f1e6c15edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e70c0c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c15ae70 0x7f1e6c15edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38366/0 (socket says 172.21.15.44:38366) 2023-11-04T01:38:52.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e70c0c640 1 -- 172.21.15.44:0/291396718 learned_addr learned my addr 172.21.15.44:0/291396718 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:52.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e70c0c640 1 -- 172.21.15.44:0/291396718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e6c0c99b0 msgr2=0x7f1e6c15e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e6b7fe640 1 --2- 172.21.15.44:0/291396718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e6c0c99b0 0x7f1e6c15e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e6bfff640 1 --2- 172.21.15.44:0/291396718 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e6c06d720 0x7f1e6c14f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e70c0c640 1 --2- 172.21.15.44:0/291396718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e6c0c99b0 0x7f1e6c15e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e70c0c640 1 -- 172.21.15.44:0/291396718 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e6c06d720 msgr2=0x7f1e6c14f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e70c0c640 1 --2- 172.21.15.44:0/291396718 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e6c06d720 0x7f1e6c14f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.028+0000 7f1e70c0c640 1 -- 172.21.15.44:0/291396718 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e64009b30 con 0x7f1e6c15ae70 2023-11-04T01:38:52.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.029+0000 7f1e70c0c640 1 --2- 172.21.15.44:0/291396718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c15ae70 0x7f1e6c15edc0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1e64036040 tx=0x7f1e64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:52.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.029+0000 7f1e68ff9640 1 -- 172.21.15.44:0/291396718 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64009510 con 0x7f1e6c15ae70 2023-11-04T01:38:52.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.029+0000 7f1e68ff9640 1 -- 172.21.15.44:0/291396718 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e64007e50 con 0x7f1e6c15ae70 2023-11-04T01:38:52.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.029+0000 7f1e7266f640 1 -- 172.21.15.44:0/291396718 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c1f0cb0 con 0x7f1e6c15ae70 2023-11-04T01:38:52.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.029+0000 7f1e68ff9640 1 -- 172.21.15.44:0/291396718 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6403e670 con 0x7f1e6c15ae70 2023-11-04T01:38:52.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.029+0000 7f1e7266f640 1 -- 172.21.15.44:0/291396718 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6c155600 con 0x7f1e6c15ae70 2023-11-04T01:38:52.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.030+0000 7f1e7266f640 1 -- 172.21.15.44:0/291396718 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6c1f11d0 con 0x7f1e6c15ae70 2023-11-04T01:38:52.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.030+0000 7f1e68ff9640 1 -- 172.21.15.44:0/291396718 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e6403e7d0 con 0x7f1e6c15ae70 2023-11-04T01:38:52.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.031+0000 7f1e68ff9640 1 --2- 172.21.15.44:0/291396718 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1e5806ae70 0x7f1e5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.031+0000 7f1e68ff9640 1 -- 172.21.15.44:0/291396718 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f1e640ac3a0 con 0x7f1e6c15ae70 2023-11-04T01:38:52.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.031+0000 7f1e6bfff640 1 --2- 172.21.15.44:0/291396718 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1e5806ae70 0x7f1e5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.031+0000 7f1e6bfff640 1 --2- 172.21.15.44:0/291396718 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1e5806ae70 0x7f1e5806d330 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1e60006fd0 tx=0x7f1e60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:52.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.035+0000 7f1e68ff9640 1 -- 172.21.15.44:0/291396718 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1e64077270 con 0x7f1e6c15ae70 2023-11-04T01:38:52.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.281+0000 7f1e7266f640 1 -- 172.21.15.44:0/291396718 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]} v 0) v1 -- 0x7f1e6c074290 con 0x7f1e6c15ae70 2023-11-04T01:38:52.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.361+0000 7f1e68ff9640 1 -- 172.21.15.44:0/291396718 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]}]=0 v184) v1 ==== 151+0+0 (secure 0 0 0) 0x7f1e6407a890 con 0x7f1e6c15ae70 2023-11-04T01:38:52.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.363+0000 7f1e7266f640 1 -- 172.21.15.44:0/291396718 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1e5806ae70 msgr2=0x7f1e5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.363+0000 7f1e7266f640 1 --2- 172.21.15.44:0/291396718 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1e5806ae70 0x7f1e5806d330 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1e60006fd0 tx=0x7f1e60008040 comp rx=0 tx=0).stop 2023-11-04T01:38:52.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.363+0000 7f1e7266f640 1 -- 172.21.15.44:0/291396718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c15ae70 msgr2=0x7f1e6c15edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.363+0000 7f1e7266f640 1 --2- 172.21.15.44:0/291396718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c15ae70 0x7f1e6c15edc0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1e64036040 tx=0x7f1e64004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:52.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.363+0000 7f1e7266f640 1 -- 172.21.15.44:0/291396718 shutdown_connections 2023-11-04T01:38:52.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.363+0000 7f1e7266f640 1 --2- 172.21.15.44:0/291396718 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1e5806ae70 0x7f1e5806d330 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.363+0000 7f1e7266f640 1 --2- 172.21.15.44:0/291396718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c15ae70 0x7f1e6c15edc0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.363+0000 7f1e7266f640 1 --2- 172.21.15.44:0/291396718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e6c0c99b0 0x7f1e6c15e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.363+0000 7f1e7266f640 1 --2- 172.21.15.44:0/291396718 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e6c06d720 0x7f1e6c14f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.363+0000 7f1e7266f640 1 -- 172.21.15.44:0/291396718 >> 172.21.15.44:0/291396718 conn(0x7f1e6c0cf4b0 msgr2=0x7f1e6c0c90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:52.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.363+0000 7f1e7266f640 1 -- 172.21.15.44:0/291396718 shutdown_connections 2023-11-04T01:38:52.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.363+0000 7f1e7266f640 1 -- 172.21.15.44:0/291396718 wait complete. 2023-11-04T01:38:52.375 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:38:52.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.483+0000 7f472aad4640 1 Processor -- start 2023-11-04T01:38:52.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.484+0000 7f472aad4640 1 -- start start 2023-11-04T01:38:52.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.484+0000 7f472aad4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f472415d1b0 0x7f47240cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.484+0000 7f472aad4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47240c9bf0 con 0x7f4724066000 2023-11-04T01:38:52.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.484+0000 7f472aad4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47240cd890 con 0x7f4724070ff0 2023-11-04T01:38:52.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.484+0000 7f472aad4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47240cdb30 con 0x7f472415d1b0 2023-11-04T01:38:52.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.484+0000 7f4729071640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4724066000 0x7f472406a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37518/0 (socket says 172.21.15.44:37518) 2023-11-04T01:38:52.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.484+0000 7f4729071640 1 -- 172.21.15.44:0/3830985657 learned_addr learned my addr 172.21.15.44:0/3830985657 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f4723fff640 1 --2- 172.21.15.44:0/3830985657 >> v2:172.21.15.204:3300/0 conn(0x7f472415d1b0 0x7f47240cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f47237fe640 1 -- 172.21.15.44:0/3830985657 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134225079 0 0) 0x7f47240c9bf0 con 0x7f4724066000 2023-11-04T01:38:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f47237fe640 1 -- 172.21.15.44:0/3830985657 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4714003520 con 0x7f4724066000 2023-11-04T01:38:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f47237fe640 1 -- 172.21.15.44:0/3830985657 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3226585052 0 0) 0x7f4714003520 con 0x7f4724066000 2023-11-04T01:38:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f47237fe640 1 -- 172.21.15.44:0/3830985657 >> v2:172.21.15.204:3300/0 conn(0x7f472415d1b0 msgr2=0x7f47240cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f47237fe640 1 --2- 172.21.15.44:0/3830985657 >> v2:172.21.15.204:3300/0 conn(0x7f472415d1b0 0x7f47240cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f47237fe640 1 -- 172.21.15.44:0/3830985657 >> v1:172.21.15.204:6789/0 conn(0x7f4724070ff0 legacy=0x7f47240713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f47237fe640 1 -- 172.21.15.44:0/3830985657 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47240cde10 con 0x7f4724066000 2023-11-04T01:38:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f47237fe640 1 -- 172.21.15.44:0/3830985657 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f471c0019f0 con 0x7f4724066000 2023-11-04T01:38:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f47237fe640 1 -- 172.21.15.44:0/3830985657 >> v1:172.21.15.44:6789/0 conn(0x7f4724066000 legacy=0x7f472406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f47237fe640 1 --2- 172.21.15.44:0/3830985657 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4714003970 0x7f4714003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f47237fe640 1 --2- 172.21.15.44:0/3830985657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140047c0 0x7f4714004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f47237fe640 1 --2- 172.21.15.44:0/3830985657 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4714005180 0x7f471400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f47237fe640 1 -- 172.21.15.44:0/3830985657 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240cdb30 con 0x7f47140047c0 2023-11-04T01:38:52.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f47237fe640 1 -- 172.21.15.44:0/3830985657 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471400c020 con 0x7f4714005180 2023-11-04T01:38:52.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f47237fe640 1 -- 172.21.15.44:0/3830985657 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471400c1e0 con 0x7f4714003970 2023-11-04T01:38:52.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f4723fff640 1 --2- 172.21.15.44:0/3830985657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140047c0 0x7f4714004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f4729071640 1 --2- 172.21.15.44:0/3830985657 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4714005180 0x7f471400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.485+0000 7f4728870640 1 --2- 172.21.15.44:0/3830985657 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4714003970 0x7f4714003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.486+0000 7f4723fff640 1 -- 172.21.15.44:0/3830985657 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4714003970 msgr2=0x7f4714003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:52.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.486+0000 7f4723fff640 1 --2- 172.21.15.44:0/3830985657 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4714003970 0x7f4714003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.486+0000 7f4723fff640 1 -- 172.21.15.44:0/3830985657 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4714005180 msgr2=0x7f471400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:52.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.486+0000 7f4723fff640 1 --2- 172.21.15.44:0/3830985657 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4714005180 0x7f471400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.486+0000 7f4729071640 1 -- 172.21.15.44:0/3830985657 reap_dead start 2023-11-04T01:38:52.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.486+0000 7f4723fff640 1 -- 172.21.15.44:0/3830985657 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4714003520 con 0x7f47140047c0 2023-11-04T01:38:52.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.486+0000 7f4728870640 1 --2- 172.21.15.44:0/3830985657 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4714003970 0x7f4714003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:52.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.486+0000 7f4723fff640 1 --2- 172.21.15.44:0/3830985657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140047c0 0x7f4714004c40 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f4710009a90 tx=0x7f47140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a124adc7d98a04a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:52.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.486+0000 7f47237fe640 1 -- 172.21.15.44:0/3830985657 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471002c680 con 0x7f47140047c0 2023-11-04T01:38:52.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.486+0000 7f47237fe640 1 -- 172.21.15.44:0/3830985657 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471002c7e0 con 0x7f47140047c0 2023-11-04T01:38:52.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.486+0000 7f47237fe640 1 -- 172.21.15.44:0/3830985657 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471002cb70 con 0x7f47140047c0 2023-11-04T01:38:52.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.487+0000 7f472aad4640 1 -- 172.21.15.44:0/3830985657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140047c0 msgr2=0x7f4714004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.487+0000 7f472aad4640 1 --2- 172.21.15.44:0/3830985657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140047c0 0x7f4714004c40 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f4710009a90 tx=0x7f47140057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.487+0000 7f472aad4640 1 -- 172.21.15.44:0/3830985657 shutdown_connections 2023-11-04T01:38:52.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.487+0000 7f472aad4640 1 --2- 172.21.15.44:0/3830985657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140047c0 0x7f4714004c40 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.487+0000 7f472aad4640 1 -- 172.21.15.44:0/3830985657 >> 172.21.15.44:0/3830985657 conn(0x7f47240cbc90 msgr2=0x7f47240cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:52.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.487+0000 7f472aad4640 1 -- 172.21.15.44:0/3830985657 shutdown_connections 2023-11-04T01:38:52.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.487+0000 7f472aad4640 1 -- 172.21.15.44:0/3830985657 wait complete. 2023-11-04T01:38:52.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.488+0000 7f472aad4640 1 Processor -- start 2023-11-04T01:38:52.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.488+0000 7f472aad4640 1 -- start start 2023-11-04T01:38:52.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f472aad4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140047c0 0x7f472415f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f472aad4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4724152450 0x7f47241444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f472aad4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47240c92c0 0x7f47240ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f472aad4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240c8ea0 con 0x7f47140047c0 2023-11-04T01:38:52.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f472aad4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240c82d0 con 0x7f47240c92c0 2023-11-04T01:38:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f472aad4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472415fa70 con 0x7f4724152450 2023-11-04T01:38:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f4728870640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140047c0 0x7f472415f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f4728870640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140047c0 0x7f472415f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38386/0 (socket says 172.21.15.44:38386) 2023-11-04T01:38:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f4728870640 1 -- 172.21.15.44:0/747230299 learned_addr learned my addr 172.21.15.44:0/747230299 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f4729071640 1 --2- 172.21.15.44:0/747230299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47240c92c0 0x7f47240ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f4723fff640 1 --2- 172.21.15.44:0/747230299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4724152450 0x7f47241444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f4728870640 1 -- 172.21.15.44:0/747230299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4724152450 msgr2=0x7f47241444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f4728870640 1 --2- 172.21.15.44:0/747230299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4724152450 0x7f47241444d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f4728870640 1 -- 172.21.15.44:0/747230299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47240c92c0 msgr2=0x7f47240ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f4728870640 1 --2- 172.21.15.44:0/747230299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47240c92c0 0x7f47240ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.489+0000 7f4728870640 1 -- 172.21.15.44:0/747230299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472415f7d0 con 0x7f47140047c0 2023-11-04T01:38:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.490+0000 7f4728870640 1 --2- 172.21.15.44:0/747230299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140047c0 0x7f472415f290 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f471800e4b0 tx=0x7f471800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.490+0000 7f47217fa640 1 -- 172.21.15.44:0/747230299 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718017070 con 0x7f47140047c0 2023-11-04T01:38:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.490+0000 7f47217fa640 1 -- 172.21.15.44:0/747230299 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4718007e90 con 0x7f47140047c0 2023-11-04T01:38:52.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.490+0000 7f472aad4640 1 -- 172.21.15.44:0/747230299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47240c8500 con 0x7f47140047c0 2023-11-04T01:38:52.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.490+0000 7f47217fa640 1 -- 172.21.15.44:0/747230299 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47180052e0 con 0x7f47140047c0 2023-11-04T01:38:52.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.490+0000 7f472aad4640 1 -- 172.21.15.44:0/747230299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47240c8ac0 con 0x7f47140047c0 2023-11-04T01:38:52.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.491+0000 7f472aad4640 1 -- 172.21.15.44:0/747230299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47240c9110 con 0x7f47140047c0 2023-11-04T01:38:52.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.491+0000 7f47217fa640 1 -- 172.21.15.44:0/747230299 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4718007020 con 0x7f47140047c0 2023-11-04T01:38:52.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.492+0000 7f47217fa640 1 --2- 172.21.15.44:0/747230299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f470806ae70 0x7f470806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.492+0000 7f47217fa640 1 -- 172.21.15.44:0/747230299 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f4718088ea0 con 0x7f47140047c0 2023-11-04T01:38:52.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.492+0000 7f4723fff640 1 --2- 172.21.15.44:0/747230299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f470806ae70 0x7f470806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.493+0000 7f4723fff640 1 --2- 172.21.15.44:0/747230299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f470806ae70 0x7f470806d330 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4710036000 tx=0x7f4710030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:52.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.496+0000 7f47217fa640 1 -- 172.21.15.44:0/747230299 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4718053ce0 con 0x7f47140047c0 2023-11-04T01:38:52.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.672+0000 7f472aad4640 1 -- 172.21.15.44:0/747230299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f47240c8c80 con 0x7f47140047c0 2023-11-04T01:38:52.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.675+0000 7f47217fa640 1 -- 172.21.15.44:0/747230299 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v17)=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4718057300 con 0x7f47140047c0 2023-11-04T01:38:52.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.677+0000 7f472aad4640 1 -- 172.21.15.44:0/747230299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f470806ae70 msgr2=0x7f470806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.677+0000 7f472aad4640 1 --2- 172.21.15.44:0/747230299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f470806ae70 0x7f470806d330 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4710036000 tx=0x7f4710030000 comp rx=0 tx=0).stop 2023-11-04T01:38:52.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.677+0000 7f472aad4640 1 -- 172.21.15.44:0/747230299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140047c0 msgr2=0x7f472415f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.677+0000 7f472aad4640 1 --2- 172.21.15.44:0/747230299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140047c0 0x7f472415f290 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f471800e4b0 tx=0x7f471800e970 comp rx=0 tx=0).stop 2023-11-04T01:38:52.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.677+0000 7f472aad4640 1 -- 172.21.15.44:0/747230299 shutdown_connections 2023-11-04T01:38:52.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.677+0000 7f472aad4640 1 --2- 172.21.15.44:0/747230299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f470806ae70 0x7f470806d330 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.677+0000 7f472aad4640 1 --2- 172.21.15.44:0/747230299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47240c92c0 0x7f47240ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.677+0000 7f472aad4640 1 --2- 172.21.15.44:0/747230299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4724152450 0x7f47241444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.677+0000 7f472aad4640 1 --2- 172.21.15.44:0/747230299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140047c0 0x7f472415f290 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.677+0000 7f472aad4640 1 -- 172.21.15.44:0/747230299 >> 172.21.15.44:0/747230299 conn(0x7f47240cbc90 msgr2=0x7f472415d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:52.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.677+0000 7f472aad4640 1 -- 172.21.15.44:0/747230299 shutdown_connections 2023-11-04T01:38:52.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.677+0000 7f472aad4640 1 -- 172.21.15.44:0/747230299 wait complete. 2023-11-04T01:38:52.689 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:38:52.689 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:52.734 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:52.777 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:38:52.777 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:38:52.778 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:52.793 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:52.793 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:38:52.793 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:52.835 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:52.835 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:38:52.835 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:52.850 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:52.850 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:38:52.850 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:52.891 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:52.891 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:38:52.892 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:52.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.996+0000 7f7b7d1b6640 1 Processor -- start 2023-11-04T01:38:52.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.996+0000 7f7b7d1b6640 1 -- start start 2023-11-04T01:38:52.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.997+0000 7f7b7d1b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b780cde60 0x7f7b7815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.997+0000 7f7b7d1b6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7b7815daa0 0x7f7b78157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.997+0000 7f7b7d1b6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7815e000 con 0x7f7b780ce240 2023-11-04T01:38:52.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.997+0000 7f7b7d1b6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7815e5c0 con 0x7f7b7815daa0 2023-11-04T01:38:53.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.997+0000 7f7b7d1b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7815e2e0 con 0x7f7b780cde60 2023-11-04T01:38:53.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.997+0000 7f7b7659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7b7815daa0 0x7f7b78157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.997+0000 7f7b7759e640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7b780ce240 0x7f7b7806b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59198/0 (socket says 172.21.15.44:59198) 2023-11-04T01:38:53.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.997+0000 7f7b7759e640 1 -- 172.21.15.44:0/2438358898 learned_addr learned my addr 172.21.15.44:0/2438358898 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:53.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.997+0000 7f7b76d9d640 1 --2- 172.21.15.44:0/2438358898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b780cde60 0x7f7b7815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.998+0000 7f7b7659c640 1 -- 172.21.15.44:0/2438358898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b780cde60 msgr2=0x7f7b7815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.998+0000 7f7b7659c640 1 --2- 172.21.15.44:0/2438358898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b780cde60 0x7f7b7815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.998+0000 7f7b7659c640 1 -- 172.21.15.44:0/2438358898 >> v1:172.21.15.44:6789/0 conn(0x7f7b780ce240 legacy=0x7f7b7806b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.998+0000 7f7b7659c640 1 -- 172.21.15.44:0/2438358898 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b780d1120 con 0x7f7b7815daa0 2023-11-04T01:38:53.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.998+0000 7f7b76d9d640 1 --2- 172.21.15.44:0/2438358898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b780cde60 0x7f7b7815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:53.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.998+0000 7f7b7659c640 1 --2- 172.21.15.44:0/2438358898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b7815daa0 0x7f7b78157000 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0097a0 tx=0x7f7b6c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691d8f7a02f89b55 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.998+0000 7f7b75d9b640 1 -- 172.21.15.44:0/2438358898 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c02d040 con 0x7f7b7815daa0 2023-11-04T01:38:53.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.998+0000 7f7b75d9b640 1 -- 172.21.15.44:0/2438358898 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c031810 con 0x7f7b7815daa0 2023-11-04T01:38:53.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.998+0000 7f7b75d9b640 1 -- 172.21.15.44:0/2438358898 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c031ba0 con 0x7f7b7815daa0 2023-11-04T01:38:53.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.999+0000 7f7b7d1b6640 1 -- 172.21.15.44:0/2438358898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b7815daa0 msgr2=0x7f7b78157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.999+0000 7f7b7d1b6640 1 --2- 172.21.15.44:0/2438358898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b7815daa0 0x7f7b78157000 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0097a0 tx=0x7f7b6c02b8b0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.999+0000 7f7b7d1b6640 1 -- 172.21.15.44:0/2438358898 shutdown_connections 2023-11-04T01:38:53.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.999+0000 7f7b7d1b6640 1 --2- 172.21.15.44:0/2438358898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b7815daa0 0x7f7b78157000 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.999+0000 7f7b7d1b6640 1 --2- 172.21.15.44:0/2438358898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b780cde60 0x7f7b7815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.999+0000 7f7b7d1b6640 1 -- 172.21.15.44:0/2438358898 >> 172.21.15.44:0/2438358898 conn(0x7f7b78071f30 msgr2=0x7f7b780cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:53.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.999+0000 7f7b7d1b6640 1 -- 172.21.15.44:0/2438358898 shutdown_connections 2023-11-04T01:38:53.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:52.999+0000 7f7b7d1b6640 1 -- 172.21.15.44:0/2438358898 wait complete. 2023-11-04T01:38:53.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.000+0000 7f7b7d1b6640 1 Processor -- start 2023-11-04T01:38:53.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.001+0000 7f7b7d1b6640 1 -- start start 2023-11-04T01:38:53.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.001+0000 7f7b7d1b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b780cde60 0x7f7b781516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.001+0000 7f7b7d1b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b780ce240 0x7f7b7815c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.001+0000 7f7b7d1b6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b7815daa0 0x7f7b781548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.001+0000 7f7b7d1b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b781f2bc0 con 0x7f7b780ce240 2023-11-04T01:38:53.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.001+0000 7f7b7d1b6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b781f2ea0 con 0x7f7b7815daa0 2023-11-04T01:38:53.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.001+0000 7f7b7d1b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b781f3180 con 0x7f7b780cde60 2023-11-04T01:38:53.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.001+0000 7f7b7659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b780ce240 0x7f7b7815c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.001+0000 7f7b7659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b780ce240 0x7f7b7815c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39290/0 (socket says 172.21.15.44:39290) 2023-11-04T01:38:53.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.001+0000 7f7b7659c640 1 -- 172.21.15.44:0/417391234 learned_addr learned my addr 172.21.15.44:0/417391234 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:53.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.001+0000 7f7b76d9d640 1 --2- 172.21.15.44:0/417391234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b780cde60 0x7f7b781516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.002+0000 7f7b7759e640 1 --2- 172.21.15.44:0/417391234 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b7815daa0 0x7f7b781548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.002+0000 7f7b7659c640 1 -- 172.21.15.44:0/417391234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b780cde60 msgr2=0x7f7b781516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.002+0000 7f7b7659c640 1 --2- 172.21.15.44:0/417391234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b780cde60 0x7f7b781516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.002+0000 7f7b7659c640 1 -- 172.21.15.44:0/417391234 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b7815daa0 msgr2=0x7f7b781548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.002+0000 7f7b7659c640 1 --2- 172.21.15.44:0/417391234 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b7815daa0 0x7f7b781548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.002+0000 7f7b7659c640 1 -- 172.21.15.44:0/417391234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c009400 con 0x7f7b780ce240 2023-11-04T01:38:53.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.002+0000 7f7b7659c640 1 --2- 172.21.15.44:0/417391234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b780ce240 0x7f7b7815c7d0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c000c00 tx=0x7f7b6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.002+0000 7f7b5f7fe640 1 -- 172.21.15.44:0/417391234 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c03ad60 con 0x7f7b780ce240 2023-11-04T01:38:53.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.002+0000 7f7b5f7fe640 1 -- 172.21.15.44:0/417391234 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c0443f0 con 0x7f7b780ce240 2023-11-04T01:38:53.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.002+0000 7f7b5f7fe640 1 -- 172.21.15.44:0/417391234 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0447a0 con 0x7f7b780ce240 2023-11-04T01:38:53.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.002+0000 7f7b7d1b6640 1 -- 172.21.15.44:0/417391234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b781f3460 con 0x7f7b780ce240 2023-11-04T01:38:53.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.002+0000 7f7b7d1b6640 1 -- 172.21.15.44:0/417391234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b78151c00 con 0x7f7b780ce240 2023-11-04T01:38:53.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.003+0000 7f7b7d1b6640 1 -- 172.21.15.44:0/417391234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b781f3980 con 0x7f7b780ce240 2023-11-04T01:38:53.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.004+0000 7f7b5f7fe640 1 -- 172.21.15.44:0/417391234 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b6c04d450 con 0x7f7b780ce240 2023-11-04T01:38:53.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.004+0000 7f7b5f7fe640 1 --2- 172.21.15.44:0/417391234 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7b6406ae70 0x7f7b6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.004+0000 7f7b5f7fe640 1 -- 172.21.15.44:0/417391234 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f7b6c0aba80 con 0x7f7b780ce240 2023-11-04T01:38:53.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.005+0000 7f7b76d9d640 1 --2- 172.21.15.44:0/417391234 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7b6406ae70 0x7f7b6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.005+0000 7f7b76d9d640 1 --2- 172.21.15.44:0/417391234 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7b6406ae70 0x7f7b6406d330 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000ab60 tx=0x7f7b70008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.009+0000 7f7b5f7fe640 1 -- 172.21.15.44:0/417391234 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b781f3980 con 0x7f7b780ce240 2023-11-04T01:38:53.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.222+0000 7f7b7d1b6640 1 -- 172.21.15.44:0/417391234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b781f3980 con 0x7f7b780ce240 2023-11-04T01:38:53.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.223+0000 7f7b5f7fe640 1 -- 172.21.15.44:0/417391234 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f7b781f3980 con 0x7f7b780ce240 2023-11-04T01:38:53.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:53.224 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5543,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/1112718006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1112718006},{"type":"v1","addr":"172.21.15.204:6837","nonce":1112718006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5935,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/719128216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":719128216},{"type":"v1","addr":"172.21.15.204:6836","nonce":719128216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3272698261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3272698261},{"type":"v1","addr":"172.21.15.44:6833","nonce":3272698261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6792,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4199497138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4199497138},{"type":"v1","addr":"172.21.15.44:6835","nonce":4199497138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[]} 2023-11-04T01:38:53.224 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2023-11-04T01:38:53.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.224+0000 7f7b7d1b6640 1 -- 172.21.15.44:0/417391234 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7b6406ae70 msgr2=0x7f7b6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.224+0000 7f7b7d1b6640 1 --2- 172.21.15.44:0/417391234 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7b6406ae70 0x7f7b6406d330 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000ab60 tx=0x7f7b70008040 comp rx=0 tx=0).stop 2023-11-04T01:38:53.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.224+0000 7f7b7d1b6640 1 -- 172.21.15.44:0/417391234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b780ce240 msgr2=0x7f7b7815c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.224+0000 7f7b7d1b6640 1 --2- 172.21.15.44:0/417391234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b780ce240 0x7f7b7815c7d0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c000c00 tx=0x7f7b6c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.224+0000 7f7b7d1b6640 1 -- 172.21.15.44:0/417391234 shutdown_connections 2023-11-04T01:38:53.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.224+0000 7f7b7d1b6640 1 --2- 172.21.15.44:0/417391234 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7b6406ae70 0x7f7b6406d330 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.224+0000 7f7b7d1b6640 1 --2- 172.21.15.44:0/417391234 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b7815daa0 0x7f7b781548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.224+0000 7f7b7d1b6640 1 --2- 172.21.15.44:0/417391234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b780ce240 0x7f7b7815c7d0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.224+0000 7f7b7d1b6640 1 --2- 172.21.15.44:0/417391234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b780cde60 0x7f7b781516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.224+0000 7f7b7d1b6640 1 -- 172.21.15.44:0/417391234 >> 172.21.15.44:0/417391234 conn(0x7f7b78071f30 msgr2=0x7f7b780b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:53.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.224+0000 7f7b7d1b6640 1 -- 172.21.15.44:0/417391234 shutdown_connections 2023-11-04T01:38:53.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.225+0000 7f7b7d1b6640 1 -- 172.21.15.44:0/417391234 wait complete. 2023-11-04T01:38:53.236 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:38:53.236 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:38:53.237 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:38:53.237 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:53.237 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:38:53.237 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:38:53.237 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:38:53.237 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:53.238 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:38:53.238 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:38:53.238 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:38:53.238 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:53.238 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:38:53.238 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:38:53.238 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:38:53.239 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:53.247 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:38:53.247 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:38:53.248 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:38:53.248 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:38:53.249 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:38:53.250 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:38:53.250 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:38:53.251 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:38:53.289 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:38:53.290 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:53.290 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:38:53.290 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:53.293 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:38:53.293 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:53.293 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:38:53.294 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:53.294 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:38:53.371 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2023-11-04T01:38:53.372 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2023-11-04T01:38:53.376 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2023-11-04T01:38:53.377 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2023-11-04T01:38:53.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.404+0000 7fe94232c640 1 Processor -- start 2023-11-04T01:38:53.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.404+0000 7fe94232c640 1 -- start start 2023-11-04T01:38:53.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.405+0000 7fe94232c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe93c153e60 0x7fe93c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.405+0000 7fe94232c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe93c0cd6d0 0x7fe93c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.405+0000 7fe94232c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe93c0cde60 con 0x7fe93c0b4880 2023-11-04T01:38:53.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.405+0000 7fe94232c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93c160f90 con 0x7fe93c0cd6d0 2023-11-04T01:38:53.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.405+0000 7fe94232c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c15e400 con 0x7fe93c153e60 2023-11-04T01:38:53.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.405+0000 7fe93b7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe93c0cd6d0 0x7fe93c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.405+0000 7fe93bfff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe93c153e60 0x7fe93c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.405+0000 7fe9408c9640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fe93c0b4880 0x7fe93c06b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:58572/0 (socket says 172.21.15.44:58572) 2023-11-04T01:38:53.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.405+0000 7fe93bfff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe93c153e60 0x7fe93c15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:52780/0 (socket says 172.21.15.44:52780) 2023-11-04T01:38:53.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.405+0000 7fe9408c9640 1 -- 172.21.15.44:0/2974211385 learned_addr learned my addr 172.21.15.44:0/2974211385 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:53.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.405+0000 7fe93b7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe93c0cd6d0 0x7fe93c161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:42268/0 (socket says 172.21.15.44:42268) 2023-11-04T01:38:53.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.406+0000 7fe93bfff640 1 -- 172.21.15.44:0/2974211385 >> v2:172.21.15.204:3300/0 conn(0x7fe93c0cd6d0 msgr2=0x7fe93c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.406+0000 7fe93bfff640 1 --2- 172.21.15.44:0/2974211385 >> v2:172.21.15.204:3300/0 conn(0x7fe93c0cd6d0 0x7fe93c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.406+0000 7fe93bfff640 1 -- 172.21.15.44:0/2974211385 >> v1:172.21.15.204:6789/0 conn(0x7fe93c0b4880 legacy=0x7fe93c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.406+0000 7fe93bfff640 1 -- 172.21.15.44:0/2974211385 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c161960 con 0x7fe93c153e60 2023-11-04T01:38:53.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.406+0000 7fe93affd640 1 -- 172.21.15.44:0/2974211385 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125901312 0 0) 0x7fe93c0cde60 con 0x7fe93c0b4880 2023-11-04T01:38:53.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.406+0000 7fe93b7fe640 1 --2- 172.21.15.44:0/2974211385 >> v2:172.21.15.204:3300/0 conn(0x7fe93c0cd6d0 0x7fe93c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:53.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.407+0000 7fe93bfff640 1 --2- 172.21.15.44:0/2974211385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe93c153e60 0x7fe93c15dec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe9300097a0 tx=0x7fe93002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b9ac7a3cee70fc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.407+0000 7fe93affd640 1 -- 172.21.15.44:0/2974211385 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe930031830 con 0x7fe93c153e60 2023-11-04T01:38:53.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.407+0000 7fe93affd640 1 -- 172.21.15.44:0/2974211385 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe930031990 con 0x7fe93c153e60 2023-11-04T01:38:53.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.407+0000 7fe93affd640 1 -- 172.21.15.44:0/2974211385 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe930031d20 con 0x7fe93c153e60 2023-11-04T01:38:53.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.407+0000 7fe94232c640 1 -- 172.21.15.44:0/2974211385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe93c153e60 msgr2=0x7fe93c15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.407+0000 7fe94232c640 1 --2- 172.21.15.44:0/2974211385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe93c153e60 0x7fe93c15dec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe9300097a0 tx=0x7fe93002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.407+0000 7fe94232c640 1 -- 172.21.15.44:0/2974211385 shutdown_connections 2023-11-04T01:38:53.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.407+0000 7fe94232c640 1 --2- 172.21.15.44:0/2974211385 >> v2:172.21.15.204:3300/0 conn(0x7fe93c0cd6d0 0x7fe93c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.407+0000 7fe94232c640 1 --2- 172.21.15.44:0/2974211385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe93c153e60 0x7fe93c15dec0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.407+0000 7fe94232c640 1 -- 172.21.15.44:0/2974211385 >> 172.21.15.44:0/2974211385 conn(0x7fe93c0cf880 msgr2=0x7fe93c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:53.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.407+0000 7fe94232c640 1 -- 172.21.15.44:0/2974211385 shutdown_connections 2023-11-04T01:38:53.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.407+0000 7fe94232c640 1 -- 172.21.15.44:0/2974211385 wait complete. 2023-11-04T01:38:53.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.408+0000 7fe94232c640 1 Processor -- start 2023-11-04T01:38:53.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.409+0000 7fe94232c640 1 -- start start 2023-11-04T01:38:53.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.409+0000 7fe94232c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe93c0b4880 0x7fe93c1efec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.409+0000 7fe94232c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe93c0cd6d0 0x7fe93c0c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.409+0000 7fe94232c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe93c153e60 0x7fe93c1f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.409+0000 7fe94232c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c0c6a90 con 0x7fe93c153e60 2023-11-04T01:38:53.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.409+0000 7fe94232c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c1f0400 con 0x7fe93c0b4880 2023-11-04T01:38:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.409+0000 7fe94232c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c1569f0 con 0x7fe93c0cd6d0 2023-11-04T01:38:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe9408c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe93c153e60 0x7fe93c1f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe93bfff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe93c0b4880 0x7fe93c1efec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe93b7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe93c0cd6d0 0x7fe93c0c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe9408c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe93c153e60 0x7fe93c1f5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39324/0 (socket says 172.21.15.44:39324) 2023-11-04T01:38:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe9408c9640 1 -- 172.21.15.44:0/1586129841 learned_addr learned my addr 172.21.15.44:0/1586129841 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe93bfff640 1 -- 172.21.15.44:0/1586129841 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe93c0cd6d0 msgr2=0x7fe93c0c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe93bfff640 1 --2- 172.21.15.44:0/1586129841 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe93c0cd6d0 0x7fe93c0c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe93bfff640 1 -- 172.21.15.44:0/1586129841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe93c153e60 msgr2=0x7fe93c1f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe93bfff640 1 --2- 172.21.15.44:0/1586129841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe93c153e60 0x7fe93c1f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe93bfff640 1 -- 172.21.15.44:0/1586129841 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c009400 con 0x7fe93c0b4880 2023-11-04T01:38:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe9408c9640 1 --2- 172.21.15.44:0/1586129841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe93c153e60 0x7fe93c1f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe93bfff640 1 --2- 172.21.15.44:0/1586129841 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe93c0b4880 0x7fe93c1efec0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe930033000 tx=0x7fe9300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe938ff9640 1 -- 172.21.15.44:0/1586129841 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93003a8f0 con 0x7fe93c0b4880 2023-11-04T01:38:53.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe938ff9640 1 -- 172.21.15.44:0/1586129841 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93003aa70 con 0x7fe93c0b4880 2023-11-04T01:38:53.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe94232c640 1 -- 172.21.15.44:0/1586129841 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe930009400 con 0x7fe93c0b4880 2023-11-04T01:38:53.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe938ff9640 1 -- 172.21.15.44:0/1586129841 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93003ae20 con 0x7fe93c0b4880 2023-11-04T01:38:53.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.410+0000 7fe94232c640 1 -- 172.21.15.44:0/1586129841 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93c156150 con 0x7fe93c0b4880 2023-11-04T01:38:53.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.411+0000 7fe94232c640 1 -- 172.21.15.44:0/1586129841 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93c074290 con 0x7fe93c0b4880 2023-11-04T01:38:53.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.412+0000 7fe938ff9640 1 -- 172.21.15.44:0/1586129841 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe93004d440 con 0x7fe93c0b4880 2023-11-04T01:38:53.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.412+0000 7fe938ff9640 1 --2- 172.21.15.44:0/1586129841 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe92806ae70 0x7fe92806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.412+0000 7fe938ff9640 1 -- 172.21.15.44:0/1586129841 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fe9300ab7e0 con 0x7fe93c0b4880 2023-11-04T01:38:53.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.412+0000 7fe93b7fe640 1 --2- 172.21.15.44:0/1586129841 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe92806ae70 0x7fe92806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.413+0000 7fe93b7fe640 1 --2- 172.21.15.44:0/1586129841 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe92806ae70 0x7fe92806d330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0cd370 tx=0x7fe92c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.417+0000 7fe938ff9640 1 -- 172.21.15.44:0/1586129841 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe930076670 con 0x7fe93c0b4880 2023-11-04T01:38:53.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:38:53.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:38:53.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-04T01:38:53.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-04T01:38:53.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:53.603+0000 7fe94232c640 1 -- 172.21.15.44:0/1586129841 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe93c15e5a0 con 0x7fe93c0b4880 2023-11-04T01:38:55.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.220+0000 7fe938ff9640 1 -- 172.21.15.44:0/1586129841 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v80) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe9300a9e60 con 0x7fe93c0b4880 2023-11-04T01:38:55.222 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2023-11-04T01:38:55.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.224+0000 7fe94232c640 1 -- 172.21.15.44:0/1586129841 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe92806ae70 msgr2=0x7fe92806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.224+0000 7fe94232c640 1 --2- 172.21.15.44:0/1586129841 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe92806ae70 0x7fe92806d330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0cd370 tx=0x7fe92c009190 comp rx=0 tx=0).stop 2023-11-04T01:38:55.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.224+0000 7fe94232c640 1 -- 172.21.15.44:0/1586129841 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe93c0b4880 msgr2=0x7fe93c1efec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.224+0000 7fe94232c640 1 --2- 172.21.15.44:0/1586129841 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe93c0b4880 0x7fe93c1efec0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe930033000 tx=0x7fe9300046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.224+0000 7fe94232c640 1 -- 172.21.15.44:0/1586129841 shutdown_connections 2023-11-04T01:38:55.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.224+0000 7fe94232c640 1 --2- 172.21.15.44:0/1586129841 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe92806ae70 0x7fe92806d330 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.224+0000 7fe94232c640 1 --2- 172.21.15.44:0/1586129841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe93c153e60 0x7fe93c1f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.224+0000 7fe94232c640 1 --2- 172.21.15.44:0/1586129841 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe93c0cd6d0 0x7fe93c0c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.224+0000 7fe94232c640 1 --2- 172.21.15.44:0/1586129841 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe93c0b4880 0x7fe93c1efec0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.224+0000 7fe94232c640 1 -- 172.21.15.44:0/1586129841 >> 172.21.15.44:0/1586129841 conn(0x7fe93c0cf880 msgr2=0x7fe93c15e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.224+0000 7fe94232c640 1 -- 172.21.15.44:0/1586129841 shutdown_connections 2023-11-04T01:38:55.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.224+0000 7fe94232c640 1 -- 172.21.15.44:0/1586129841 wait complete. 2023-11-04T01:38:55.239 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:38:55.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.352+0000 7f15698d4640 1 Processor -- start 2023-11-04T01:38:55.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.352+0000 7f15698d4640 1 -- start start 2023-11-04T01:38:55.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.353+0000 7f15698d4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f156415ad80 0x7f156406c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.353+0000 7f15698d4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f15640c9e10 0x7f15640b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.353+0000 7f15698d4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156406cd00 con 0x7f15640b42c0 2023-11-04T01:38:55.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.353+0000 7f15698d4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156406cfa0 con 0x7f15640c9e10 2023-11-04T01:38:55.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.353+0000 7f15698d4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156406d280 con 0x7f156415ad80 2023-11-04T01:38:55.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.353+0000 7f15637fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f15640c9e10 0x7f15640b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.353+0000 7f15637fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f15640c9e10 0x7f15640b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39330/0 (socket says 172.21.15.44:39330) 2023-11-04T01:38:55.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.353+0000 7f15637fe640 1 -- 172.21.15.44:0/2228392194 learned_addr learned my addr 172.21.15.44:0/2228392194 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:55.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.353+0000 7f1562ffd640 1 --2- 172.21.15.44:0/2228392194 >> v2:172.21.15.204:3300/0 conn(0x7f156415ad80 0x7f156406c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.353+0000 7f15637fe640 1 -- 172.21.15.44:0/2228392194 >> v2:172.21.15.204:3300/0 conn(0x7f156415ad80 msgr2=0x7f156406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.353+0000 7f15637fe640 1 --2- 172.21.15.44:0/2228392194 >> v2:172.21.15.204:3300/0 conn(0x7f156415ad80 0x7f156406c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.353+0000 7f15637fe640 1 -- 172.21.15.44:0/2228392194 >> v1:172.21.15.204:6789/0 conn(0x7f15640b42c0 legacy=0x7f15640c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.353+0000 7f15637fe640 1 -- 172.21.15.44:0/2228392194 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156406d560 con 0x7f15640c9e10 2023-11-04T01:38:55.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.354+0000 7f15637fe640 1 --2- 172.21.15.44:0/2228392194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15640c9e10 0x7f15640b1a40 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f15640b4ac0 tx=0x7f155c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c1455ec65fbc88 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.354+0000 7f1561ffb640 1 -- 172.21.15.44:0/2228392194 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c02cbb0 con 0x7f15640c9e10 2023-11-04T01:38:55.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.354+0000 7f1561ffb640 1 -- 172.21.15.44:0/2228392194 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c02cd10 con 0x7f15640c9e10 2023-11-04T01:38:55.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.354+0000 7f1561ffb640 1 -- 172.21.15.44:0/2228392194 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c034610 con 0x7f15640c9e10 2023-11-04T01:38:55.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.355+0000 7f15698d4640 1 -- 172.21.15.44:0/2228392194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15640c9e10 msgr2=0x7f15640b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.355+0000 7f15698d4640 1 --2- 172.21.15.44:0/2228392194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15640c9e10 0x7f15640b1a40 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f15640b4ac0 tx=0x7f155c02c010 comp rx=0 tx=0).stop 2023-11-04T01:38:55.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.355+0000 7f15698d4640 1 -- 172.21.15.44:0/2228392194 shutdown_connections 2023-11-04T01:38:55.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.355+0000 7f15698d4640 1 --2- 172.21.15.44:0/2228392194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15640c9e10 0x7f15640b1a40 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.355+0000 7f15698d4640 1 --2- 172.21.15.44:0/2228392194 >> v2:172.21.15.204:3300/0 conn(0x7f156415ad80 0x7f156406c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.355+0000 7f15698d4640 1 -- 172.21.15.44:0/2228392194 >> 172.21.15.44:0/2228392194 conn(0x7f15640ce950 msgr2=0x7f15640ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.355+0000 7f15698d4640 1 -- 172.21.15.44:0/2228392194 shutdown_connections 2023-11-04T01:38:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.355+0000 7f15698d4640 1 -- 172.21.15.44:0/2228392194 wait complete. 2023-11-04T01:38:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.356+0000 7f15698d4640 1 Processor -- start 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.356+0000 7f15698d4640 1 -- start start 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.357+0000 7f15698d4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15640b42c0 0x7f15641f05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.357+0000 7f15698d4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15640c9e10 0x7f156414bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.357+0000 7f15698d4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f156415ad80 0x7f156415c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.357+0000 7f15698d4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156415ccb0 con 0x7f156415ad80 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.357+0000 7f15698d4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156415cf90 con 0x7f15640c9e10 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.357+0000 7f15698d4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15640c5990 con 0x7f15640b42c0 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.357+0000 7f15637fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f156415ad80 0x7f156415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.357+0000 7f15637fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f156415ad80 0x7f156415c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39336/0 (socket says 172.21.15.44:39336) 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.357+0000 7f15637fe640 1 -- 172.21.15.44:0/2312225916 learned_addr learned my addr 172.21.15.44:0/2312225916 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.357+0000 7f1562ffd640 1 --2- 172.21.15.44:0/2312225916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15640b42c0 0x7f15641f05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.357+0000 7f15627fc640 1 --2- 172.21.15.44:0/2312225916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15640c9e10 0x7f156414bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.358+0000 7f15637fe640 1 -- 172.21.15.44:0/2312225916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15640b42c0 msgr2=0x7f15641f05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.358+0000 7f15637fe640 1 --2- 172.21.15.44:0/2312225916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15640b42c0 0x7f15641f05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.358+0000 7f15637fe640 1 -- 172.21.15.44:0/2312225916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15640c9e10 msgr2=0x7f156414bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.358+0000 7f15637fe640 1 --2- 172.21.15.44:0/2312225916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15640c9e10 0x7f156414bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.358+0000 7f15637fe640 1 -- 172.21.15.44:0/2312225916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c009b30 con 0x7f156415ad80 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.358+0000 7f15627fc640 1 --2- 172.21.15.44:0/2312225916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15640c9e10 0x7f156414bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.358+0000 7f15637fe640 1 --2- 172.21.15.44:0/2312225916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f156415ad80 0x7f156415c1b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f155c036040 tx=0x7f155c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.358+0000 7f154bfff640 1 -- 172.21.15.44:0/2312225916 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c009510 con 0x7f156415ad80 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.358+0000 7f154bfff640 1 -- 172.21.15.44:0/2312225916 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c03e450 con 0x7f156415ad80 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.358+0000 7f15698d4640 1 -- 172.21.15.44:0/2312225916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15640c5c70 con 0x7f156415ad80 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.358+0000 7f154bfff640 1 -- 172.21.15.44:0/2312225916 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c03e800 con 0x7f156415ad80 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.358+0000 7f15698d4640 1 -- 172.21.15.44:0/2312225916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156415de40 con 0x7f156415ad80 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.359+0000 7f15698d4640 1 -- 172.21.15.44:0/2312225916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15640c6190 con 0x7f156415ad80 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.359+0000 7f154bfff640 1 -- 172.21.15.44:0/2312225916 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f155c03e960 con 0x7f156415ad80 2023-11-04T01:38:55.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.360+0000 7f154bfff640 1 --2- 172.21.15.44:0/2312225916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f155006aea0 0x7f155006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.360+0000 7f154bfff640 1 -- 172.21.15.44:0/2312225916 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f155c0ac580 con 0x7f156415ad80 2023-11-04T01:38:55.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.360+0000 7f1562ffd640 1 --2- 172.21.15.44:0/2312225916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f155006aea0 0x7f155006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.361+0000 7f1562ffd640 1 --2- 172.21.15.44:0/2312225916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f155006aea0 0x7f155006d360 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1554006fd0 tx=0x7f1554008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.364+0000 7f154bfff640 1 -- 172.21.15.44:0/2312225916 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f15640c6190 con 0x7f156415ad80 2023-11-04T01:38:55.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.606+0000 7f15698d4640 1 -- 172.21.15.44:0/2312225916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f15640c6190 con 0x7f156415ad80 2023-11-04T01:38:55.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.607+0000 7f154bfff640 1 -- 172.21.15.44:0/2312225916 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f15640c6190 con 0x7f156415ad80 2023-11-04T01:38:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:55.608 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:38:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2023-11-04T01:38:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2023-11-04T01:38:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0Vldrw2ExAA5cS9IfcK2l8SXaZdWm4f8g==", 2023-11-04T01:38:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:38:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:38:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2023-11-04T01:38:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlOogfIRAAYEw/sXZBXk/GJOrnBTA7xg==", 2023-11-04T01:38:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:38:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:38:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2023-11-04T01:38:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlDPc/GxAA32BghmM85xfJ14TjYFtNRw==", 2023-11-04T01:38:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:38:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:38:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2023-11-04T01:38:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlYpOSKBAAVivyMFmzkREyWWFObAwKHw==", 2023-11-04T01:38:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:38:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:38:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2023-11-04T01:38:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDIn0VlTfR3ExAAt6S9NmZfuM9CoPfVNGkhmA==", 2023-11-04T01:38:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2023-11-04T01:38:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDLn0VlqkLfExAABN3cHR+cDXm0tN4tpWR+0w==", 2023-11-04T01:38:55.614 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.614 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:55.614 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:55.615 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:55.615 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.615 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2023-11-04T01:38:55.615 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDOn0Vl9JO/EhAAuC0w9vFxOiRs7Tm3UZHVXg==", 2023-11-04T01:38:55.615 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.615 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:55.615 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:55.615 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:55.616 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.616 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2023-11-04T01:38:55.616 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDRn0VlKSy2EhAAerLDC/nZsTK5KdG+Q1Ycow==", 2023-11-04T01:38:55.616 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.616 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:55.616 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:55.616 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:55.616 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.617 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2023-11-04T01:38:55.617 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDXn0Vl9FINGxAA5lLkwH709SJ00yfxB6MCaw==", 2023-11-04T01:38:55.617 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.617 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:55.617 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:55.617 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:55.617 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.618 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2023-11-04T01:38:55.618 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDan0Vlo5v3GRAA/ZGOqGFMxQuGirRMadC+9Q==", 2023-11-04T01:38:55.618 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.618 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:55.618 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:55.618 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:55.618 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.618 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2023-11-04T01:38:55.618 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDdn0Vl+q9GGBAA7obGN4GMa7glnpuDSQKV2g==", 2023-11-04T01:38:55.619 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.619 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:55.619 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:55.619 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:55.619 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.619 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2023-11-04T01:38:55.619 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDgn0VlbLVCFxAANjcDDYPfWCNGQF1twWc35w==", 2023-11-04T01:38:55.619 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.620 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:55.620 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:38:55.620 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:55.620 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.620 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2023-11-04T01:38:55.620 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlmqcrLRAAFCsu/sJUUh45gPboIgq6Dw==", 2023-11-04T01:38:55.620 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.621 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:55.621 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow r", 2023-11-04T01:38:55.621 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:38:55.621 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.621 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2023-11-04T01:38:55.621 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlSFWINBAAAvkXSoHilQ3GXBE61Tvx2w==", 2023-11-04T01:38:55.621 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.621 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:55.621 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:38:55.622 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:38:55.622 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:38:55.622 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.622 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2023-11-04T01:38:55.622 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0Vlcp71MBAAkYQz0CUf7LY9WIvX0mXzKg==", 2023-11-04T01:38:55.622 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.622 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:55.622 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:38:55.623 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:38:55.623 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:38:55.623 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.623 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2023-11-04T01:38:55.623 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0Vl08lCOhAAQxQts3txc7gsu8txLGzouA==", 2023-11-04T01:38:55.623 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.623 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:38:55.623 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:38:55.624 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:38:55.624 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:38:55.624 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.624 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2023-11-04T01:38:55.624 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDDn0VlgZZFMBAA94xTIAij5lx9yGEyPDd/SQ==", 2023-11-04T01:38:55.624 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.624 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2023-11-04T01:38:55.624 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:38:55.624 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:38:55.625 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:55.625 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.625 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2023-11-04T01:38:55.625 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlSeFMDxAAwW0lbfxAbIKPgPCkJD1FMg==", 2023-11-04T01:38:55.625 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.625 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2023-11-04T01:38:55.625 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2023-11-04T01:38:55.625 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:55.626 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:55.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:55.626 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2023-11-04T01:38:55.626 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlX+8eCxAAuBbLfpXHKHIIDc4zo9Insw==", 2023-11-04T01:38:55.626 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:38:55.626 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2023-11-04T01:38:55.626 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2023-11-04T01:38:55.626 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:38:55.626 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.626 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:55.627 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2023-11-04T01:38:55.627 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:38:55.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.608+0000 7f15698d4640 1 -- 172.21.15.44:0/2312225916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f155006aea0 msgr2=0x7f155006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.608+0000 7f15698d4640 1 --2- 172.21.15.44:0/2312225916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f155006aea0 0x7f155006d360 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1554006fd0 tx=0x7f1554008040 comp rx=0 tx=0).stop 2023-11-04T01:38:55.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.608+0000 7f15698d4640 1 -- 172.21.15.44:0/2312225916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f156415ad80 msgr2=0x7f156415c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.608+0000 7f15698d4640 1 --2- 172.21.15.44:0/2312225916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f156415ad80 0x7f156415c1b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f155c036040 tx=0x7f155c004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:55.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.608+0000 7f15698d4640 1 -- 172.21.15.44:0/2312225916 shutdown_connections 2023-11-04T01:38:55.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.608+0000 7f15698d4640 1 --2- 172.21.15.44:0/2312225916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f155006aea0 0x7f155006d360 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.609+0000 7f15698d4640 1 --2- 172.21.15.44:0/2312225916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f156415ad80 0x7f156415c1b0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.609+0000 7f15698d4640 1 --2- 172.21.15.44:0/2312225916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15640c9e10 0x7f156414bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.609+0000 7f15698d4640 1 --2- 172.21.15.44:0/2312225916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15640b42c0 0x7f15641f05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.609+0000 7f15698d4640 1 -- 172.21.15.44:0/2312225916 >> 172.21.15.44:0/2312225916 conn(0x7f15640ce950 msgr2=0x7f15640b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.609+0000 7f15698d4640 1 -- 172.21.15.44:0/2312225916 shutdown_connections 2023-11-04T01:38:55.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.609+0000 7f15698d4640 1 -- 172.21.15.44:0/2312225916 wait complete. 2023-11-04T01:38:55.630 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:55.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.735+0000 7f94b372c640 1 Processor -- start 2023-11-04T01:38:55.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.735+0000 7f94b372c640 1 -- start start 2023-11-04T01:38:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.736+0000 7f94b372c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f94ac15ce70 0x7f94ac06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.736+0000 7f94b372c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f94ac15d250 0x7f94ac0c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.736+0000 7f94b372c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac06a120 con 0x7f94ac0c9d70 2023-11-04T01:38:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.736+0000 7f94b372c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac0cdc10 con 0x7f94ac15ce70 2023-11-04T01:38:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.736+0000 7f94b372c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac06def0 con 0x7f94ac15d250 2023-11-04T01:38:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.736+0000 7f94b14c8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f94ac15ce70 0x7f94ac06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.736+0000 7f94b1cc9640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f94ac0c9d70 0x7f94ac0ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59214/0 (socket says 172.21.15.44:59214) 2023-11-04T01:38:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.736+0000 7f94b1cc9640 1 -- 172.21.15.44:0/1663627966 learned_addr learned my addr 172.21.15.44:0/1663627966 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.736+0000 7f94b0cc7640 1 --2- 172.21.15.44:0/1663627966 >> v2:172.21.15.204:3300/0 conn(0x7f94ac15d250 0x7f94ac0c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.736+0000 7f94b14c8640 1 -- 172.21.15.44:0/1663627966 >> v2:172.21.15.204:3300/0 conn(0x7f94ac15d250 msgr2=0x7f94ac0c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.736+0000 7f94b14c8640 1 --2- 172.21.15.44:0/1663627966 >> v2:172.21.15.204:3300/0 conn(0x7f94ac15d250 0x7f94ac0c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.736+0000 7f94b14c8640 1 -- 172.21.15.44:0/1663627966 >> v1:172.21.15.44:6789/0 conn(0x7f94ac0c9d70 legacy=0x7f94ac0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.736+0000 7f94b14c8640 1 -- 172.21.15.44:0/1663627966 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac06a370 con 0x7f94ac15ce70 2023-11-04T01:38:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.736+0000 7f94a3fff640 1 -- 172.21.15.44:0/1663627966 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214419385 0 0) 0x7f94ac06a120 con 0x7f94ac0c9d70 2023-11-04T01:38:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.737+0000 7f94b14c8640 1 --2- 172.21.15.44:0/1663627966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac15ce70 0x7f94ac06d9b0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0d02c0 tx=0x7f94a802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7b75b394edacdc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.737+0000 7f94a3fff640 1 -- 172.21.15.44:0/1663627966 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a802cc80 con 0x7f94ac15ce70 2023-11-04T01:38:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.737+0000 7f94a3fff640 1 -- 172.21.15.44:0/1663627966 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a802cde0 con 0x7f94ac15ce70 2023-11-04T01:38:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.737+0000 7f94a3fff640 1 -- 172.21.15.44:0/1663627966 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8034660 con 0x7f94ac15ce70 2023-11-04T01:38:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.738+0000 7f94b372c640 1 -- 172.21.15.44:0/1663627966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac15ce70 msgr2=0x7f94ac06d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.738+0000 7f94b372c640 1 --2- 172.21.15.44:0/1663627966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac15ce70 0x7f94ac06d9b0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0d02c0 tx=0x7f94a802bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.738+0000 7f94b372c640 1 -- 172.21.15.44:0/1663627966 shutdown_connections 2023-11-04T01:38:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.738+0000 7f94b372c640 1 --2- 172.21.15.44:0/1663627966 >> v2:172.21.15.204:3300/0 conn(0x7f94ac15d250 0x7f94ac0c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.738+0000 7f94b372c640 1 --2- 172.21.15.44:0/1663627966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac15ce70 0x7f94ac06d9b0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.738+0000 7f94b372c640 1 -- 172.21.15.44:0/1663627966 >> 172.21.15.44:0/1663627966 conn(0x7f94ac0b0cd0 msgr2=0x7f94ac0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.738+0000 7f94b372c640 1 -- 172.21.15.44:0/1663627966 shutdown_connections 2023-11-04T01:38:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.738+0000 7f94b372c640 1 -- 172.21.15.44:0/1663627966 wait complete. 2023-11-04T01:38:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.739+0000 7f94b372c640 1 Processor -- start 2023-11-04T01:38:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.739+0000 7f94b372c640 1 -- start start 2023-11-04T01:38:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b372c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94ac15ce70 0x7f94ac154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b372c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac15d250 0x7f94ac0c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b372c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94ac152590 0x7f94ac152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b372c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac152f80 con 0x7f94ac15d250 2023-11-04T01:38:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b372c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0c7540 con 0x7f94ac152590 2023-11-04T01:38:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b372c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0c6c30 con 0x7f94ac15ce70 2023-11-04T01:38:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b0cc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac15d250 0x7f94ac0c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b0cc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac15d250 0x7f94ac0c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39360/0 (socket says 172.21.15.44:39360) 2023-11-04T01:38:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b0cc7640 1 -- 172.21.15.44:0/1291651503 learned_addr learned my addr 172.21.15.44:0/1291651503 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b14c8640 1 --2- 172.21.15.44:0/1291651503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94ac15ce70 0x7f94ac154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b1cc9640 1 --2- 172.21.15.44:0/1291651503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94ac152590 0x7f94ac152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b0cc7640 1 -- 172.21.15.44:0/1291651503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94ac15ce70 msgr2=0x7f94ac154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b0cc7640 1 --2- 172.21.15.44:0/1291651503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94ac15ce70 0x7f94ac154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b0cc7640 1 -- 172.21.15.44:0/1291651503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94ac152590 msgr2=0x7f94ac152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b0cc7640 1 --2- 172.21.15.44:0/1291651503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94ac152590 0x7f94ac152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.740+0000 7f94b0cc7640 1 -- 172.21.15.44:0/1291651503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a8009a70 con 0x7f94ac15d250 2023-11-04T01:38:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.741+0000 7f94b0cc7640 1 --2- 172.21.15.44:0/1291651503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac15d250 0x7f94ac0c62b0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f949c00d5d0 tx=0x7f949c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.741+0000 7f94a1ffb640 1 -- 172.21.15.44:0/1291651503 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c004240 con 0x7f94ac15d250 2023-11-04T01:38:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.741+0000 7f94a1ffb640 1 -- 172.21.15.44:0/1291651503 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c0043a0 con 0x7f94ac15d250 2023-11-04T01:38:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.741+0000 7f94b372c640 1 -- 172.21.15.44:0/1291651503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ac0c6f10 con 0x7f94ac15d250 2023-11-04T01:38:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.741+0000 7f94a1ffb640 1 -- 172.21.15.44:0/1291651503 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c003830 con 0x7f94ac15d250 2023-11-04T01:38:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.741+0000 7f94b372c640 1 -- 172.21.15.44:0/1291651503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ac0c71f0 con 0x7f94ac15d250 2023-11-04T01:38:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.742+0000 7f94b372c640 1 -- 172.21.15.44:0/1291651503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ac074290 con 0x7f94ac15d250 2023-11-04T01:38:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.743+0000 7f94a1ffb640 1 -- 172.21.15.44:0/1291651503 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f949c003990 con 0x7f94ac15d250 2023-11-04T01:38:55.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.743+0000 7f94a1ffb640 1 --2- 172.21.15.44:0/1291651503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f949006ae70 0x7f949006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.743+0000 7f94a1ffb640 1 -- 172.21.15.44:0/1291651503 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f949c0898d0 con 0x7f94ac15d250 2023-11-04T01:38:55.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.743+0000 7f94b14c8640 1 --2- 172.21.15.44:0/1291651503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f949006ae70 0x7f949006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.744+0000 7f94b14c8640 1 --2- 172.21.15.44:0/1291651503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f949006ae70 0x7f949006d330 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f94a8036000 tx=0x7f94a8030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.747+0000 7f94a1ffb640 1 -- 172.21.15.44:0/1291651503 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f949c054820 con 0x7f94ac15d250 2023-11-04T01:38:55.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.924+0000 7f94b372c640 1 -- 172.21.15.44:0/1291651503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94ac06e3f0 con 0x7f94ac15d250 2023-11-04T01:38:55.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.925+0000 7f94a1ffb640 1 -- 172.21.15.44:0/1291651503 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18303 (secure 0 0 0) 0x7f949c057e40 con 0x7f94ac15d250 2023-11-04T01:38:55.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:55.927 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":80,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:38:55.214036+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:55.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.927+0000 7f94b372c640 1 -- 172.21.15.44:0/1291651503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f949006ae70 msgr2=0x7f949006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.927+0000 7f94b372c640 1 --2- 172.21.15.44:0/1291651503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f949006ae70 0x7f949006d330 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f94a8036000 tx=0x7f94a8030000 comp rx=0 tx=0).stop 2023-11-04T01:38:55.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.927+0000 7f94b372c640 1 -- 172.21.15.44:0/1291651503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac15d250 msgr2=0x7f94ac0c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.927+0000 7f94b372c640 1 --2- 172.21.15.44:0/1291651503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac15d250 0x7f94ac0c62b0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f949c00d5d0 tx=0x7f949c00da90 comp rx=0 tx=0).stop 2023-11-04T01:38:55.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.927+0000 7f94b372c640 1 -- 172.21.15.44:0/1291651503 shutdown_connections 2023-11-04T01:38:55.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.927+0000 7f94b372c640 1 --2- 172.21.15.44:0/1291651503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f949006ae70 0x7f949006d330 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.927+0000 7f94b372c640 1 --2- 172.21.15.44:0/1291651503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94ac152590 0x7f94ac152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.927+0000 7f94b372c640 1 --2- 172.21.15.44:0/1291651503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac15d250 0x7f94ac0c62b0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.927+0000 7f94b372c640 1 --2- 172.21.15.44:0/1291651503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94ac15ce70 0x7f94ac154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.927+0000 7f94b372c640 1 -- 172.21.15.44:0/1291651503 >> 172.21.15.44:0/1291651503 conn(0x7f94ac0b0cd0 msgr2=0x7f94ac0aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.927+0000 7f94b372c640 1 -- 172.21.15.44:0/1291651503 shutdown_connections 2023-11-04T01:38:55.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:55.927+0000 7f94b372c640 1 -- 172.21.15.44:0/1291651503 wait complete. 2023-11-04T01:38:55.940 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:34.917670+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:35.547044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:55.940 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:56.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.048+0000 7f920a087640 1 Processor -- start 2023-11-04T01:38:56.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.048+0000 7f920a087640 1 -- start start 2023-11-04T01:38:56.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.049+0000 7f920a087640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9204066000 0x7f92040cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.049+0000 7f920a087640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92040c9bf0 con 0x7f920415d1b0 2023-11-04T01:38:56.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.049+0000 7f920a087640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92040cd890 con 0x7f9204070ff0 2023-11-04T01:38:56.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.049+0000 7f920a087640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92040cdb30 con 0x7f9204066000 2023-11-04T01:38:56.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.049+0000 7f9202ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f920415d1b0 0x7f920406a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59224/0 (socket says 172.21.15.44:59224) 2023-11-04T01:38:56.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.049+0000 7f9202ffd640 1 -- 172.21.15.44:0/289964725 learned_addr learned my addr 172.21.15.44:0/289964725 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:56.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.049+0000 7f9203fff640 1 --2- 172.21.15.44:0/289964725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9204066000 0x7f92040cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.049+0000 7f92027fc640 1 -- 172.21.15.44:0/289964725 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447058862 0 0) 0x7f92040c9bf0 con 0x7f920415d1b0 2023-11-04T01:38:56.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.049+0000 7f92027fc640 1 -- 172.21.15.44:0/289964725 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91ec003520 con 0x7f920415d1b0 2023-11-04T01:38:56.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.050+0000 7f92027fc640 1 -- 172.21.15.44:0/289964725 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156587465 0 0) 0x7f92040cd890 con 0x7f9204070ff0 2023-11-04T01:38:56.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.050+0000 7f9203fff640 1 -- 172.21.15.44:0/289964725 >> v1:172.21.15.204:6789/0 conn(0x7f9204070ff0 legacy=0x7f92040713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.050+0000 7f9203fff640 1 -- 172.21.15.44:0/289964725 >> v1:172.21.15.44:6789/0 conn(0x7f920415d1b0 legacy=0x7f920406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.050+0000 7f9203fff640 1 -- 172.21.15.44:0/289964725 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92040cde10 con 0x7f9204066000 2023-11-04T01:38:56.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.050+0000 7f9203fff640 1 --2- 172.21.15.44:0/289964725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9204066000 0x7f92040cb4e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009dc0 tx=0x7f91fc02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79c2b76656243c45 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.051+0000 7f92027fc640 1 -- 172.21.15.44:0/289964725 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc02ccd0 con 0x7f9204066000 2023-11-04T01:38:56.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.051+0000 7f92027fc640 1 -- 172.21.15.44:0/289964725 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc02ce30 con 0x7f9204066000 2023-11-04T01:38:56.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.051+0000 7f92027fc640 1 -- 172.21.15.44:0/289964725 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc034660 con 0x7f9204066000 2023-11-04T01:38:56.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.051+0000 7f920a087640 1 -- 172.21.15.44:0/289964725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9204066000 msgr2=0x7f92040cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.051+0000 7f920a087640 1 --2- 172.21.15.44:0/289964725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9204066000 0x7f92040cb4e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009dc0 tx=0x7f91fc02bf20 comp rx=0 tx=0).stop 2023-11-04T01:38:56.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.051+0000 7f920a087640 1 -- 172.21.15.44:0/289964725 shutdown_connections 2023-11-04T01:38:56.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.051+0000 7f920a087640 1 --2- 172.21.15.44:0/289964725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9204066000 0x7f92040cb4e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.051+0000 7f920a087640 1 -- 172.21.15.44:0/289964725 >> 172.21.15.44:0/289964725 conn(0x7f92040cbc90 msgr2=0x7f92040cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:56.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.051+0000 7f920a087640 1 -- 172.21.15.44:0/289964725 shutdown_connections 2023-11-04T01:38:56.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.051+0000 7f920a087640 1 -- 172.21.15.44:0/289964725 wait complete. 2023-11-04T01:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.052+0000 7f920a087640 1 Processor -- start 2023-11-04T01:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.053+0000 7f920a087640 1 -- start start 2023-11-04T01:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.053+0000 7f920a087640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9204066000 0x7f92041517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.053+0000 7f920a087640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9204070ff0 0x7f9204160dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.053+0000 7f920a087640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f920415d1b0 0x7f9204161310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.053+0000 7f920a087640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920415b550 con 0x7f920415d1b0 2023-11-04T01:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.053+0000 7f920a087640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920415a940 con 0x7f9204066000 2023-11-04T01:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.053+0000 7f920a087640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920415ac20 con 0x7f9204070ff0 2023-11-04T01:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f9203fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f920415d1b0 0x7f9204161310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f9203fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f920415d1b0 0x7f9204161310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39362/0 (socket says 172.21.15.44:39362) 2023-11-04T01:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f9203fff640 1 -- 172.21.15.44:0/2045396842 learned_addr learned my addr 172.21.15.44:0/2045396842 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f92037fe640 1 --2- 172.21.15.44:0/2045396842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9204066000 0x7f92041517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f9202ffd640 1 --2- 172.21.15.44:0/2045396842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9204070ff0 0x7f9204160dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f9203fff640 1 -- 172.21.15.44:0/2045396842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9204070ff0 msgr2=0x7f9204160dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f9203fff640 1 --2- 172.21.15.44:0/2045396842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9204070ff0 0x7f9204160dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f9203fff640 1 -- 172.21.15.44:0/2045396842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9204066000 msgr2=0x7f92041517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f9203fff640 1 --2- 172.21.15.44:0/2045396842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9204066000 0x7f92041517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f9203fff640 1 -- 172.21.15.44:0/2045396842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc009a70 con 0x7f920415d1b0 2023-11-04T01:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f9202ffd640 1 --2- 172.21.15.44:0/2045396842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9204070ff0 0x7f9204160dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f9203fff640 1 --2- 172.21.15.44:0/2045396842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f920415d1b0 0x7f9204161310 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f91fc02c530 tx=0x7f91fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f91ebfff640 1 -- 172.21.15.44:0/2045396842 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc03e610 con 0x7f920415d1b0 2023-11-04T01:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f91ebfff640 1 -- 172.21.15.44:0/2045396842 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc03e770 con 0x7f920415d1b0 2023-11-04T01:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f920a087640 1 -- 172.21.15.44:0/2045396842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920415af00 con 0x7f920415d1b0 2023-11-04T01:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f91ebfff640 1 -- 172.21.15.44:0/2045396842 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc03eb20 con 0x7f920415d1b0 2023-11-04T01:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.054+0000 7f920a087640 1 -- 172.21.15.44:0/2045396842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920415f130 con 0x7f920415d1b0 2023-11-04T01:38:56.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.055+0000 7f920a087640 1 -- 172.21.15.44:0/2045396842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f920415b6c0 con 0x7f920415d1b0 2023-11-04T01:38:56.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.056+0000 7f91ebfff640 1 -- 172.21.15.44:0/2045396842 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f91fc03b050 con 0x7f920415d1b0 2023-11-04T01:38:56.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.056+0000 7f91ebfff640 1 --2- 172.21.15.44:0/2045396842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f91f006ae70 0x7f91f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.056+0000 7f91ebfff640 1 -- 172.21.15.44:0/2045396842 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f91fc0ac150 con 0x7f920415d1b0 2023-11-04T01:38:56.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.056+0000 7f92037fe640 1 --2- 172.21.15.44:0/2045396842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f91f006ae70 0x7f91f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.057+0000 7f92037fe640 1 --2- 172.21.15.44:0/2045396842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f91f006ae70 0x7f91f006d330 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f91f4007fd0 tx=0x7f91f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.060+0000 7f91ebfff640 1 -- 172.21.15.44:0/2045396842 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f91fc076ff0 con 0x7f920415d1b0 2023-11-04T01:38:56.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.237+0000 7f920a087640 1 -- 172.21.15.44:0/2045396842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9204074290 con 0x7f920415d1b0 2023-11-04T01:38:56.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.237+0000 7f91ebfff640 1 -- 172.21.15.44:0/2045396842 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91fc009450 con 0x7f920415d1b0 2023-11-04T01:38:56.238 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:38:56.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.239+0000 7f920a087640 1 -- 172.21.15.44:0/2045396842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f91f006ae70 msgr2=0x7f91f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.239+0000 7f920a087640 1 --2- 172.21.15.44:0/2045396842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f91f006ae70 0x7f91f006d330 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f91f4007fd0 tx=0x7f91f4009040 comp rx=0 tx=0).stop 2023-11-04T01:38:56.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.239+0000 7f920a087640 1 -- 172.21.15.44:0/2045396842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f920415d1b0 msgr2=0x7f9204161310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.239+0000 7f920a087640 1 --2- 172.21.15.44:0/2045396842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f920415d1b0 0x7f9204161310 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f91fc02c530 tx=0x7f91fc004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:56.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.239+0000 7f920a087640 1 -- 172.21.15.44:0/2045396842 shutdown_connections 2023-11-04T01:38:56.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.239+0000 7f920a087640 1 --2- 172.21.15.44:0/2045396842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f91f006ae70 0x7f91f006d330 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.239+0000 7f920a087640 1 --2- 172.21.15.44:0/2045396842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f920415d1b0 0x7f9204161310 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.239+0000 7f920a087640 1 --2- 172.21.15.44:0/2045396842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9204070ff0 0x7f9204160dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.239+0000 7f920a087640 1 --2- 172.21.15.44:0/2045396842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9204066000 0x7f92041517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.239+0000 7f920a087640 1 -- 172.21.15.44:0/2045396842 >> 172.21.15.44:0/2045396842 conn(0x7f92040cbc90 msgr2=0x7f92040c9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:56.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.239+0000 7f920a087640 1 -- 172.21.15.44:0/2045396842 shutdown_connections 2023-11-04T01:38:56.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.239+0000 7f920a087640 1 -- 172.21.15.44:0/2045396842 wait complete. 2023-11-04T01:38:56.251 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:56.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.358+0000 7f3b7c1b6640 1 Processor -- start 2023-11-04T01:38:56.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.359+0000 7f3b7c1b6640 1 -- start start 2023-11-04T01:38:56.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.359+0000 7f3b7c1b6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3b740cd6d0 0x7f3b74161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.359+0000 7f3b7c1b6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3b740b4880 0x7f3b740b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.359+0000 7f3b7c1b6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b740cde60 con 0x7f3b74153e60 2023-11-04T01:38:56.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.359+0000 7f3b7c1b6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b74160f90 con 0x7f3b740cd6d0 2023-11-04T01:38:56.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.359+0000 7f3b7c1b6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b74161960 con 0x7f3b740b4880 2023-11-04T01:38:56.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.360+0000 7f3b79751640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3b740cd6d0 0x7f3b74161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.360+0000 7f3b79f52640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3b74153e60 0x7f3b7415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59232/0 (socket says 172.21.15.44:59232) 2023-11-04T01:38:56.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.360+0000 7f3b79f52640 1 -- 172.21.15.44:0/1372184684 learned_addr learned my addr 172.21.15.44:0/1372184684 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:56.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.360+0000 7f3b7a753640 1 --2- 172.21.15.44:0/1372184684 >> v2:172.21.15.204:3300/0 conn(0x7f3b740b4880 0x7f3b740b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.360+0000 7f3b79751640 1 -- 172.21.15.44:0/1372184684 >> v2:172.21.15.204:3300/0 conn(0x7f3b740b4880 msgr2=0x7f3b740b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:56.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.360+0000 7f3b79751640 1 --2- 172.21.15.44:0/1372184684 >> v2:172.21.15.204:3300/0 conn(0x7f3b740b4880 0x7f3b740b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.360+0000 7f3b79751640 1 -- 172.21.15.44:0/1372184684 >> v1:172.21.15.44:6789/0 conn(0x7f3b74153e60 legacy=0x7f3b7415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.360+0000 7f3b79751640 1 -- 172.21.15.44:0/1372184684 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b740b5220 con 0x7f3b740cd6d0 2023-11-04T01:38:56.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.361+0000 7f3b79751640 1 --2- 172.21.15.44:0/1372184684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b740cd6d0 0x7f3b74161420 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f3b740b8f40 tx=0x7f3b6402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca30107b0a6c9ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.361+0000 7f3b78f50640 1 -- 172.21.15.44:0/1372184684 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64031830 con 0x7f3b740cd6d0 2023-11-04T01:38:56.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.361+0000 7f3b78f50640 1 -- 172.21.15.44:0/1372184684 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b64031990 con 0x7f3b740cd6d0 2023-11-04T01:38:56.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.361+0000 7f3b78f50640 1 -- 172.21.15.44:0/1372184684 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64031d20 con 0x7f3b740cd6d0 2023-11-04T01:38:56.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.361+0000 7f3b7c1b6640 1 -- 172.21.15.44:0/1372184684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b740cd6d0 msgr2=0x7f3b74161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.361+0000 7f3b7c1b6640 1 --2- 172.21.15.44:0/1372184684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b740cd6d0 0x7f3b74161420 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f3b740b8f40 tx=0x7f3b6402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.361+0000 7f3b7c1b6640 1 -- 172.21.15.44:0/1372184684 shutdown_connections 2023-11-04T01:38:56.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.361+0000 7f3b7c1b6640 1 --2- 172.21.15.44:0/1372184684 >> v2:172.21.15.204:3300/0 conn(0x7f3b740b4880 0x7f3b740b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.361+0000 7f3b7c1b6640 1 --2- 172.21.15.44:0/1372184684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b740cd6d0 0x7f3b74161420 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.361+0000 7f3b7c1b6640 1 -- 172.21.15.44:0/1372184684 >> 172.21.15.44:0/1372184684 conn(0x7f3b740cf880 msgr2=0x7f3b740cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:56.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.361+0000 7f3b7c1b6640 1 -- 172.21.15.44:0/1372184684 shutdown_connections 2023-11-04T01:38:56.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.361+0000 7f3b7c1b6640 1 -- 172.21.15.44:0/1372184684 wait complete. 2023-11-04T01:38:56.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.363+0000 7f3b7c1b6640 1 Processor -- start 2023-11-04T01:38:56.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.363+0000 7f3b7c1b6640 1 -- start start 2023-11-04T01:38:56.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.363+0000 7f3b7c1b6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b740b4880 0x7f3b74145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.363+0000 7f3b7c1b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b740cd6d0 0x7f3b740c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.363+0000 7f3b7c1b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b74153e60 0x7f3b74158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.363+0000 7f3b7c1b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b74159fe0 con 0x7f3b74153e60 2023-11-04T01:38:56.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.363+0000 7f3b7c1b6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b740c65c0 con 0x7f3b740b4880 2023-11-04T01:38:56.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.363+0000 7f3b7c1b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b74159100 con 0x7f3b740cd6d0 2023-11-04T01:38:56.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.363+0000 7f3b7a753640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b74153e60 0x7f3b74158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.363+0000 7f3b7a753640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b74153e60 0x7f3b74158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39382/0 (socket says 172.21.15.44:39382) 2023-11-04T01:38:56.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.363+0000 7f3b7a753640 1 -- 172.21.15.44:0/3766040392 learned_addr learned my addr 172.21.15.44:0/3766040392 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:56.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.364+0000 7f3b79f52640 1 --2- 172.21.15.44:0/3766040392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b740b4880 0x7f3b74145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.364+0000 7f3b79751640 1 --2- 172.21.15.44:0/3766040392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b740cd6d0 0x7f3b740c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.364+0000 7f3b7a753640 1 -- 172.21.15.44:0/3766040392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b740cd6d0 msgr2=0x7f3b740c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.364+0000 7f3b7a753640 1 --2- 172.21.15.44:0/3766040392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b740cd6d0 0x7f3b740c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.364+0000 7f3b7a753640 1 -- 172.21.15.44:0/3766040392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b740b4880 msgr2=0x7f3b74145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.364+0000 7f3b7a753640 1 --2- 172.21.15.44:0/3766040392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b740b4880 0x7f3b74145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.364+0000 7f3b7a753640 1 -- 172.21.15.44:0/3766040392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b64009400 con 0x7f3b74153e60 2023-11-04T01:38:56.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.364+0000 7f3b7a753640 1 --2- 172.21.15.44:0/3766040392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b74153e60 0x7f3b74158bc0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c007e40 tx=0x7f3b6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.364+0000 7f3b6a7fc640 1 -- 172.21.15.44:0/3766040392 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c014620 con 0x7f3b74153e60 2023-11-04T01:38:56.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.364+0000 7f3b6a7fc640 1 -- 172.21.15.44:0/3766040392 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c0147a0 con 0x7f3b74153e60 2023-11-04T01:38:56.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.364+0000 7f3b7c1b6640 1 -- 172.21.15.44:0/3766040392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b74159360 con 0x7f3b74153e60 2023-11-04T01:38:56.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.364+0000 7f3b6a7fc640 1 -- 172.21.15.44:0/3766040392 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c014b50 con 0x7f3b74153e60 2023-11-04T01:38:56.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.364+0000 7f3b7c1b6640 1 -- 172.21.15.44:0/3766040392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b74159920 con 0x7f3b74153e60 2023-11-04T01:38:56.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.365+0000 7f3b7c1b6640 1 -- 172.21.15.44:0/3766040392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7415a120 con 0x7f3b74153e60 2023-11-04T01:38:56.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.366+0000 7f3b6a7fc640 1 -- 172.21.15.44:0/3766040392 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b6c014cb0 con 0x7f3b74153e60 2023-11-04T01:38:56.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.366+0000 7f3b6a7fc640 1 --2- 172.21.15.44:0/3766040392 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b5806ae70 0x7f3b5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.366+0000 7f3b6a7fc640 1 -- 172.21.15.44:0/3766040392 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f3b6c08a0f0 con 0x7f3b74153e60 2023-11-04T01:38:56.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.366+0000 7f3b79f52640 1 --2- 172.21.15.44:0/3766040392 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b5806ae70 0x7f3b5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.367+0000 7f3b79f52640 1 --2- 172.21.15.44:0/3766040392 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b5806ae70 0x7f3b5806d330 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3b70005880 tx=0x7f3b70009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.370+0000 7f3b6a7fc640 1 -- 172.21.15.44:0/3766040392 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b7415a120 con 0x7f3b74153e60 2023-11-04T01:38:56.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.544+0000 7f3b7c1b6640 1 -- 172.21.15.44:0/3766040392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f3b7415a120 con 0x7f3b74153e60 2023-11-04T01:38:56.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.545+0000 7f3b6a7fc640 1 -- 172.21.15.44:0/3766040392 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v80) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3b7415a120 con 0x7f3b74153e60 2023-11-04T01:38:56.546 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:56.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.547+0000 7f3b7c1b6640 1 -- 172.21.15.44:0/3766040392 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b5806ae70 msgr2=0x7f3b5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.547+0000 7f3b7c1b6640 1 --2- 172.21.15.44:0/3766040392 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b5806ae70 0x7f3b5806d330 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3b70005880 tx=0x7f3b70009040 comp rx=0 tx=0).stop 2023-11-04T01:38:56.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.547+0000 7f3b7c1b6640 1 -- 172.21.15.44:0/3766040392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b74153e60 msgr2=0x7f3b74158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.547+0000 7f3b7c1b6640 1 --2- 172.21.15.44:0/3766040392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b74153e60 0x7f3b74158bc0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c007e40 tx=0x7f3b6c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.547+0000 7f3b7c1b6640 1 -- 172.21.15.44:0/3766040392 shutdown_connections 2023-11-04T01:38:56.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.547+0000 7f3b7c1b6640 1 --2- 172.21.15.44:0/3766040392 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b5806ae70 0x7f3b5806d330 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.547+0000 7f3b7c1b6640 1 --2- 172.21.15.44:0/3766040392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b74153e60 0x7f3b74158bc0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.547+0000 7f3b7c1b6640 1 --2- 172.21.15.44:0/3766040392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b740cd6d0 0x7f3b740c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.547+0000 7f3b7c1b6640 1 --2- 172.21.15.44:0/3766040392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b740b4880 0x7f3b74145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.547+0000 7f3b7c1b6640 1 -- 172.21.15.44:0/3766040392 >> 172.21.15.44:0/3766040392 conn(0x7f3b740cf880 msgr2=0x7f3b7415fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:56.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.547+0000 7f3b7c1b6640 1 -- 172.21.15.44:0/3766040392 shutdown_connections 2023-11-04T01:38:56.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.547+0000 7f3b7c1b6640 1 -- 172.21.15.44:0/3766040392 wait complete. 2023-11-04T01:38:56.559 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:38:56.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.667+0000 7fc7d2100640 1 Processor -- start 2023-11-04T01:38:56.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.667+0000 7fc7d2100640 1 -- start start 2023-11-04T01:38:56.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7d2100640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc7cc1605b0 0x7fc7cc0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7d2100640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc7cc0b1a40 0x7fc7cc06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7d2100640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc0ca560 0x7fc7cc06a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7d2100640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7cc160990 con 0x7fc7cc1605b0 2023-11-04T01:38:56.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7d2100640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7cc0cc7c0 con 0x7fc7cc0b1a40 2023-11-04T01:38:56.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7d2100640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0cd750 con 0x7fc7cc0ca560 2023-11-04T01:38:56.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc7cc1605b0 0x7fc7cc0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc7cc1605b0 0x7fc7cc0ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39384/0 (socket says 172.21.15.44:39384) 2023-11-04T01:38:56.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/976638767 learned_addr learned my addr 172.21.15.44:0/976638767 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:56.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/976638767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc0ca560 msgr2=0x7fc7cc06a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:56.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7cbfff640 1 --2- 172.21.15.44:0/976638767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc0ca560 0x7fc7cc06a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7caffd640 1 --2- 172.21.15.44:0/976638767 >> v2:172.21.15.204:3300/0 conn(0x7fc7cc0b1a40 0x7fc7cc06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7cb7fe640 1 --2- 172.21.15.44:0/976638767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc0ca560 0x7fc7cc06a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/976638767 >> v2:172.21.15.204:3300/0 conn(0x7fc7cc0b1a40 msgr2=0x7fc7cc06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:56.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7cb7fe640 1 --2- 172.21.15.44:0/976638767 >> v2:172.21.15.204:3300/0 conn(0x7fc7cc0b1a40 0x7fc7cc06a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/976638767 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc0cc4e0 con 0x7fc7cc1605b0 2023-11-04T01:38:56.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.668+0000 7fc7caffd640 1 --2- 172.21.15.44:0/976638767 >> v2:172.21.15.204:3300/0 conn(0x7fc7cc0b1a40 0x7fc7cc06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:56.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.669+0000 7fc7cb7fe640 1 --2- 172.21.15.44:0/976638767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc1605b0 0x7fc7cc0ccbc0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc067540 tx=0x7fc7bc02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc35009986aaf6f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.669+0000 7fc7ca7fc640 1 -- 172.21.15.44:0/976638767 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc031750 con 0x7fc7cc1605b0 2023-11-04T01:38:56.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.669+0000 7fc7ca7fc640 1 -- 172.21.15.44:0/976638767 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc0318b0 con 0x7fc7cc1605b0 2023-11-04T01:38:56.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.669+0000 7fc7ca7fc640 1 -- 172.21.15.44:0/976638767 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc031c40 con 0x7fc7cc1605b0 2023-11-04T01:38:56.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.670+0000 7fc7d2100640 1 -- 172.21.15.44:0/976638767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc1605b0 msgr2=0x7fc7cc0ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.670+0000 7fc7d2100640 1 --2- 172.21.15.44:0/976638767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc1605b0 0x7fc7cc0ccbc0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc067540 tx=0x7fc7bc02b7f0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.670+0000 7fc7d2100640 1 -- 172.21.15.44:0/976638767 shutdown_connections 2023-11-04T01:38:56.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.670+0000 7fc7d2100640 1 --2- 172.21.15.44:0/976638767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc0ca560 0x7fc7cc06a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.670+0000 7fc7d2100640 1 --2- 172.21.15.44:0/976638767 >> v2:172.21.15.204:3300/0 conn(0x7fc7cc0b1a40 0x7fc7cc06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.670+0000 7fc7d2100640 1 --2- 172.21.15.44:0/976638767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc1605b0 0x7fc7cc0ccbc0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.670+0000 7fc7d2100640 1 -- 172.21.15.44:0/976638767 >> 172.21.15.44:0/976638767 conn(0x7fc7cc071820 msgr2=0x7fc7cc071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:56.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.670+0000 7fc7d2100640 1 -- 172.21.15.44:0/976638767 shutdown_connections 2023-11-04T01:38:56.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.670+0000 7fc7d2100640 1 -- 172.21.15.44:0/976638767 wait complete. 2023-11-04T01:38:56.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.671+0000 7fc7d2100640 1 Processor -- start 2023-11-04T01:38:56.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.671+0000 7fc7d2100640 1 -- start start 2023-11-04T01:38:56.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7d2100640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0ca560 0x7fc7cc15b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7d2100640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc1605b0 0x7fc7cc0c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7d2100640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc0c7060 0x7fc7cc0adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7d2100640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0b29c0 con 0x7fc7cc0ca560 2023-11-04T01:38:56.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7d2100640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0b2670 con 0x7fc7cc0c7060 2023-11-04T01:38:56.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7d2100640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0c7570 con 0x7fc7cc1605b0 2023-11-04T01:38:56.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7cb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0ca560 0x7fc7cc15b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7cb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0ca560 0x7fc7cc15b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39390/0 (socket says 172.21.15.44:39390) 2023-11-04T01:38:56.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/1446465648 learned_addr learned my addr 172.21.15.44:0/1446465648 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:56.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7caffd640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc1605b0 0x7fc7cc0c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7cbfff640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc0c7060 0x7fc7cc0adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc1605b0 msgr2=0x7fc7cc0c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7cb7fe640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc1605b0 0x7fc7cc0c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc0c7060 msgr2=0x7fc7cc0adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7cb7fe640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc0c7060 0x7fc7cc0adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/1446465648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc0094d0 con 0x7fc7cc0ca560 2023-11-04T01:38:56.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7cbfff640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc0c7060 0x7fc7cc0adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:56.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7caffd640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc1605b0 0x7fc7cc0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:56.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.672+0000 7fc7cb7fe640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0ca560 0x7fc7cc15b560 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc000c00 tx=0x7fc7bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.673+0000 7fc7b3fff640 1 -- 172.21.15.44:0/1446465648 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc033c80 con 0x7fc7cc0ca560 2023-11-04T01:38:56.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.673+0000 7fc7b3fff640 1 -- 172.21.15.44:0/1446465648 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc033e00 con 0x7fc7cc0ca560 2023-11-04T01:38:56.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.673+0000 7fc7d2100640 1 -- 172.21.15.44:0/1446465648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7cc0c7850 con 0x7fc7cc0ca560 2023-11-04T01:38:56.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.673+0000 7fc7b3fff640 1 -- 172.21.15.44:0/1446465648 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc03c640 con 0x7fc7cc0ca560 2023-11-04T01:38:56.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.673+0000 7fc7d2100640 1 -- 172.21.15.44:0/1446465648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7cc15baa0 con 0x7fc7cc0ca560 2023-11-04T01:38:56.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.674+0000 7fc7d2100640 1 -- 172.21.15.44:0/1446465648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7cc0672a0 con 0x7fc7cc0ca560 2023-11-04T01:38:56.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.674+0000 7fc7b3fff640 1 -- 172.21.15.44:0/1446465648 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7bc03a040 con 0x7fc7cc0ca560 2023-11-04T01:38:56.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.674+0000 7fc7b3fff640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7b806ae70 0x7fc7b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.674+0000 7fc7b3fff640 1 -- 172.21.15.44:0/1446465648 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6240+0+0 (secure 0 0 0) 0x7fc7bc0ab520 con 0x7fc7cc0ca560 2023-11-04T01:38:56.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.675+0000 7fc7caffd640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7b806ae70 0x7fc7b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.675+0000 7fc7caffd640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7b806ae70 0x7fc7b806d330 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0af140 tx=0x7fc7c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.679+0000 7fc7b3fff640 1 -- 172.21.15.44:0/1446465648 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7bc0764e0 con 0x7fc7cc0ca560 2023-11-04T01:38:56.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.852+0000 7fc7d2100640 1 -- 172.21.15.44:0/1446465648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fc7cc074290 con 0x7fc7cc0ca560 2023-11-04T01:38:56.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.853+0000 7fc7b3fff640 1 -- 172.21.15.44:0/1446465648 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v80) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc7bc038020 con 0x7fc7cc0ca560 2023-11-04T01:38:56.854 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:56.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.855+0000 7fc7d2100640 1 -- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7b806ae70 msgr2=0x7fc7b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.855+0000 7fc7d2100640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7b806ae70 0x7fc7b806d330 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0af140 tx=0x7fc7c0008040 comp rx=0 tx=0).stop 2023-11-04T01:38:56.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.855+0000 7fc7d2100640 1 -- 172.21.15.44:0/1446465648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0ca560 msgr2=0x7fc7cc15b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.855+0000 7fc7d2100640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0ca560 0x7fc7cc15b560 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc000c00 tx=0x7fc7bc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.855+0000 7fc7d2100640 1 -- 172.21.15.44:0/1446465648 shutdown_connections 2023-11-04T01:38:56.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.855+0000 7fc7d2100640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7b806ae70 0x7fc7b806d330 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.855+0000 7fc7d2100640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc0c7060 0x7fc7cc0adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.855+0000 7fc7d2100640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc1605b0 0x7fc7cc0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.855+0000 7fc7d2100640 1 --2- 172.21.15.44:0/1446465648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0ca560 0x7fc7cc15b560 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.855+0000 7fc7d2100640 1 -- 172.21.15.44:0/1446465648 >> 172.21.15.44:0/1446465648 conn(0x7fc7cc071820 msgr2=0x7fc7cc06a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:56.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.855+0000 7fc7d2100640 1 -- 172.21.15.44:0/1446465648 shutdown_connections 2023-11-04T01:38:56.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.855+0000 7fc7d2100640 1 -- 172.21.15.44:0/1446465648 wait complete. 2023-11-04T01:38:56.867 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:38:56.976 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.975+0000 7f4376894640 1 Processor -- start 2023-11-04T01:38:56.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.975+0000 7f4376894640 1 -- start start 2023-11-04T01:38:56.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.976+0000 7f4376894640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f43700b2d30 0x7f437006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.976+0000 7f4376894640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f437006c1d0 0x7f43700cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.976+0000 7f4376894640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437006ca40 con 0x7f4370160430 2023-11-04T01:38:56.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.976+0000 7f4376894640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43700cb580 con 0x7f437006c1d0 2023-11-04T01:38:56.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.976+0000 7f4376894640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437006cd20 con 0x7f43700b2d30 2023-11-04T01:38:56.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.976+0000 7f4374e31640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f437006c1d0 0x7f43700cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.976+0000 7f4374e31640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f437006c1d0 0x7f43700cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39402/0 (socket says 172.21.15.44:39402) 2023-11-04T01:38:56.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.976+0000 7f4374e31640 1 -- 172.21.15.44:0/1691854535 learned_addr learned my addr 172.21.15.44:0/1691854535 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:56.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.976+0000 7f436f7fe640 1 --2- 172.21.15.44:0/1691854535 >> v2:172.21.15.204:3300/0 conn(0x7f43700b2d30 0x7f437006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.976+0000 7f4374e31640 1 -- 172.21.15.44:0/1691854535 >> v2:172.21.15.204:3300/0 conn(0x7f43700b2d30 msgr2=0x7f437006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:56.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.976+0000 7f4374e31640 1 --2- 172.21.15.44:0/1691854535 >> v2:172.21.15.204:3300/0 conn(0x7f43700b2d30 0x7f437006bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.976+0000 7f4374e31640 1 -- 172.21.15.44:0/1691854535 >> v1:172.21.15.204:6789/0 conn(0x7f4370160430 legacy=0x7f43700b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:56.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.976+0000 7f4374e31640 1 -- 172.21.15.44:0/1691854535 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437006d000 con 0x7f437006c1d0 2023-11-04T01:38:56.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.977+0000 7f4374e31640 1 --2- 172.21.15.44:0/1691854535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f437006c1d0 0x7f43700cbcb0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f4368009e50 tx=0x7f436802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3dd70ba2ed9a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.980 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.977+0000 7f436effd640 1 -- 172.21.15.44:0/1691854535 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436802ca80 con 0x7f437006c1d0 2023-11-04T01:38:56.980 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.977+0000 7f436effd640 1 -- 172.21.15.44:0/1691854535 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436802cbe0 con 0x7f437006c1d0 2023-11-04T01:38:56.980 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.977+0000 7f436effd640 1 -- 172.21.15.44:0/1691854535 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43680343f0 con 0x7f437006c1d0 2023-11-04T01:38:56.980 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.978+0000 7f4376894640 1 -- 172.21.15.44:0/1691854535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f437006c1d0 msgr2=0x7f43700cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.980 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.978+0000 7f4376894640 1 --2- 172.21.15.44:0/1691854535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f437006c1d0 0x7f43700cbcb0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f4368009e50 tx=0x7f436802bee0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.978+0000 7f4376894640 1 -- 172.21.15.44:0/1691854535 shutdown_connections 2023-11-04T01:38:56.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.978+0000 7f4376894640 1 --2- 172.21.15.44:0/1691854535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f437006c1d0 0x7f43700cbcb0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.978+0000 7f4376894640 1 --2- 172.21.15.44:0/1691854535 >> v2:172.21.15.204:3300/0 conn(0x7f43700b2d30 0x7f437006bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.978+0000 7f4376894640 1 -- 172.21.15.44:0/1691854535 >> 172.21.15.44:0/1691854535 conn(0x7f437006ea20 msgr2=0x7f437006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:56.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.978+0000 7f4376894640 1 -- 172.21.15.44:0/1691854535 shutdown_connections 2023-11-04T01:38:56.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.978+0000 7f4376894640 1 -- 172.21.15.44:0/1691854535 wait complete. 2023-11-04T01:38:56.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.979+0000 7f4376894640 1 Processor -- start 2023-11-04T01:38:56.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.979+0000 7f4376894640 1 -- start start 2023-11-04T01:38:56.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.980+0000 7f4376894640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f437006c1d0 0x7f43700c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.980+0000 7f4376894640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43700b2d30 0x7f43700b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.980+0000 7f4376894640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4370160430 0x7f43700b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.980+0000 7f4376894640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43700c9330 con 0x7f437006c1d0 2023-11-04T01:38:56.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.980+0000 7f4376894640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43700c8550 con 0x7f4370160430 2023-11-04T01:38:56.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.980+0000 7f4376894640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43700c8830 con 0x7f43700b2d30 2023-11-04T01:38:56.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.980+0000 7f436ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f437006c1d0 0x7f43700c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.980+0000 7f436ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f437006c1d0 0x7f43700c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39418/0 (socket says 172.21.15.44:39418) 2023-11-04T01:38:56.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.980+0000 7f436ffff640 1 -- 172.21.15.44:0/1629912507 learned_addr learned my addr 172.21.15.44:0/1629912507 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:56.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.980+0000 7f436f7fe640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43700b2d30 0x7f43700b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.981+0000 7f4374e31640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4370160430 0x7f43700b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.981+0000 7f436ffff640 1 -- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43700b2d30 msgr2=0x7f43700b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.981+0000 7f436ffff640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43700b2d30 0x7f43700b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.981+0000 7f436ffff640 1 -- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4370160430 msgr2=0x7f43700b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.981+0000 7f436ffff640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4370160430 0x7f43700b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.981+0000 7f436ffff640 1 -- 172.21.15.44:0/1629912507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4368009b30 con 0x7f437006c1d0 2023-11-04T01:38:56.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.981+0000 7f436f7fe640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43700b2d30 0x7f43700b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:56.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.981+0000 7f4374e31640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4370160430 0x7f43700b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:56.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.981+0000 7f436ffff640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f437006c1d0 0x7f43700c7c70 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f436400b3f0 tx=0x7f436400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.981+0000 7f436cff9640 1 -- 172.21.15.44:0/1629912507 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364011830 con 0x7f437006c1d0 2023-11-04T01:38:56.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.981+0000 7f436cff9640 1 -- 172.21.15.44:0/1629912507 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4364011990 con 0x7f437006c1d0 2023-11-04T01:38:56.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.981+0000 7f436cff9640 1 -- 172.21.15.44:0/1629912507 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364011d40 con 0x7f437006c1d0 2023-11-04T01:38:56.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.981+0000 7f4376894640 1 -- 172.21.15.44:0/1629912507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43700c8b10 con 0x7f437006c1d0 2023-11-04T01:38:56.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.981+0000 7f4376894640 1 -- 172.21.15.44:0/1629912507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43700c81b0 con 0x7f437006c1d0 2023-11-04T01:38:56.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.982+0000 7f4376894640 1 -- 172.21.15.44:0/1629912507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43700c97c0 con 0x7f437006c1d0 2023-11-04T01:38:56.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.982+0000 7f436cff9640 1 -- 172.21.15.44:0/1629912507 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f436401a400 con 0x7f437006c1d0 2023-11-04T01:38:56.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.983+0000 7f436cff9640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f435c06ae70 0x7f435c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.983+0000 7f436cff9640 1 -- 172.21.15.44:0/1629912507 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f43640895d0 con 0x7f437006c1d0 2023-11-04T01:38:56.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.983+0000 7f436f7fe640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f435c06ae70 0x7f435c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.984+0000 7f436f7fe640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f435c06ae70 0x7f435c06d330 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f43700b5ec0 tx=0x7f4360008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:56.987+0000 7f436cff9640 1 -- 172.21.15.44:0/1629912507 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f43700c97c0 con 0x7f437006c1d0 2023-11-04T01:38:57.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.163+0000 7f4376894640 1 -- 172.21.15.44:0/1629912507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f43700cb790 con 0x7f437006c1d0 2023-11-04T01:38:57.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.164+0000 7f436cff9640 1 -- 172.21.15.44:0/1629912507 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v80) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4364054500 con 0x7f437006c1d0 2023-11-04T01:38:57.166 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:38:57.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.166+0000 7f4376894640 1 -- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f435c06ae70 msgr2=0x7f435c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.166+0000 7f4376894640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f435c06ae70 0x7f435c06d330 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f43700b5ec0 tx=0x7f4360008040 comp rx=0 tx=0).stop 2023-11-04T01:38:57.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.166+0000 7f4376894640 1 -- 172.21.15.44:0/1629912507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f437006c1d0 msgr2=0x7f43700c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.166+0000 7f4376894640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f437006c1d0 0x7f43700c7c70 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f436400b3f0 tx=0x7f436400b8b0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.166+0000 7f4376894640 1 -- 172.21.15.44:0/1629912507 shutdown_connections 2023-11-04T01:38:57.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.166+0000 7f4376894640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f435c06ae70 0x7f435c06d330 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.166+0000 7f4376894640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4370160430 0x7f43700b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.166+0000 7f4376894640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43700b2d30 0x7f43700b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.166+0000 7f4376894640 1 --2- 172.21.15.44:0/1629912507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f437006c1d0 0x7f43700c7c70 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.166+0000 7f4376894640 1 -- 172.21.15.44:0/1629912507 >> 172.21.15.44:0/1629912507 conn(0x7f437006ea20 msgr2=0x7f43700cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:57.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.166+0000 7f4376894640 1 -- 172.21.15.44:0/1629912507 shutdown_connections 2023-11-04T01:38:57.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.166+0000 7f4376894640 1 -- 172.21.15.44:0/1629912507 wait complete. 2023-11-04T01:38:57.177 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:38:57.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.282+0000 7f3a0640e640 1 Processor -- start 2023-11-04T01:38:57.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.282+0000 7f3a0640e640 1 -- start start 2023-11-04T01:38:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.283+0000 7f3a0640e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a000c9e10 0x7f3a001659e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.283+0000 7f3a0640e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0006cfa0 con 0x7f3a000b42c0 2023-11-04T01:38:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.283+0000 7f3a0640e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0006d280 con 0x7f3a0015ad80 2023-11-04T01:38:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.283+0000 7f3a0640e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0006d560 con 0x7f3a000c9e10 2023-11-04T01:38:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.283+0000 7f39ff7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3a000b42c0 0x7f3a000c9700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59238/0 (socket says 172.21.15.44:59238) 2023-11-04T01:38:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.283+0000 7f39ff7fe640 1 -- 172.21.15.44:0/3401343408 learned_addr learned my addr 172.21.15.44:0/3401343408 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.283+0000 7f3a049ab640 1 --2- 172.21.15.44:0/3401343408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a000c9e10 0x7f3a001659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39feffd640 1 -- 172.21.15.44:0/3401343408 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877213938 0 0) 0x7f3a0006cfa0 con 0x7f3a000b42c0 2023-11-04T01:38:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39feffd640 1 -- 172.21.15.44:0/3401343408 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39e8003520 con 0x7f3a000b42c0 2023-11-04T01:38:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39feffd640 1 -- 172.21.15.44:0/3401343408 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4129945847 0 0) 0x7f39e8003520 con 0x7f3a000b42c0 2023-11-04T01:38:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39feffd640 1 -- 172.21.15.44:0/3401343408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a000c9e10 msgr2=0x7f3a001659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39feffd640 1 --2- 172.21.15.44:0/3401343408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a000c9e10 0x7f3a001659e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39feffd640 1 -- 172.21.15.44:0/3401343408 >> v1:172.21.15.204:6789/0 conn(0x7f3a0015ad80 legacy=0x7f3a0006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39feffd640 1 -- 172.21.15.44:0/3401343408 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0006d840 con 0x7f3a000b42c0 2023-11-04T01:38:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39feffd640 1 -- 172.21.15.44:0/3401343408 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f39f0001670 con 0x7f3a000b42c0 2023-11-04T01:38:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39feffd640 1 -- 172.21.15.44:0/3401343408 >> v1:172.21.15.44:6789/0 conn(0x7f3a000b42c0 legacy=0x7f3a000c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39feffd640 1 --2- 172.21.15.44:0/3401343408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39e80039a0 0x7f39e8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39feffd640 1 --2- 172.21.15.44:0/3401343408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e8004350 0x7f39e8004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39feffd640 1 --2- 172.21.15.44:0/3401343408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a000c9e10 0x7f39e8005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39feffd640 1 -- 172.21.15.44:0/3401343408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0006d560 con 0x7f39e8004350 2023-11-04T01:38:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39feffd640 1 -- 172.21.15.44:0/3401343408 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e800b9b0 con 0x7f39e80039a0 2023-11-04T01:38:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39feffd640 1 -- 172.21.15.44:0/3401343408 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e800bb70 con 0x7f3a000c9e10 2023-11-04T01:38:57.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39ff7fe640 1 --2- 172.21.15.44:0/3401343408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e8004350 0x7f39e8004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39fffff640 1 --2- 172.21.15.44:0/3401343408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39e80039a0 0x7f39e8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f3a049ab640 1 --2- 172.21.15.44:0/3401343408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a000c9e10 0x7f39e8005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39ff7fe640 1 -- 172.21.15.44:0/3401343408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a000c9e10 msgr2=0x7f39e8005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:57.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39ff7fe640 1 --2- 172.21.15.44:0/3401343408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a000c9e10 0x7f39e8005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39ff7fe640 1 -- 172.21.15.44:0/3401343408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39e80039a0 msgr2=0x7f39e8003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:57.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39ff7fe640 1 --2- 172.21.15.44:0/3401343408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39e80039a0 0x7f39e8003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39ff7fe640 1 -- 172.21.15.44:0/3401343408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e8003520 con 0x7f39e8004350 2023-11-04T01:38:57.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f3a049ab640 1 --2- 172.21.15.44:0/3401343408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a000c9e10 0x7f39e8005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:57.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.284+0000 7f39fffff640 1 --2- 172.21.15.44:0/3401343408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39e80039a0 0x7f39e8003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:57.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.285+0000 7f39ff7fe640 1 --2- 172.21.15.44:0/3401343408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e8004350 0x7f39e8004820 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f39f000c190 tx=0x7f39e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb7569b28536b3e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:57.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.285+0000 7f39feffd640 1 -- 172.21.15.44:0/3401343408 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f0005ad0 con 0x7f39e8004350 2023-11-04T01:38:57.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.285+0000 7f39feffd640 1 -- 172.21.15.44:0/3401343408 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f0005c50 con 0x7f39e8004350 2023-11-04T01:38:57.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.285+0000 7f39feffd640 1 -- 172.21.15.44:0/3401343408 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f002c850 con 0x7f39e8004350 2023-11-04T01:38:57.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.286+0000 7f3a0640e640 1 -- 172.21.15.44:0/3401343408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e8004350 msgr2=0x7f39e8004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.286+0000 7f3a0640e640 1 --2- 172.21.15.44:0/3401343408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e8004350 0x7f39e8004820 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f39f000c190 tx=0x7f39e80057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.286+0000 7f3a049ab640 1 -- 172.21.15.44:0/3401343408 reap_dead start 2023-11-04T01:38:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.286+0000 7f3a0640e640 1 -- 172.21.15.44:0/3401343408 shutdown_connections 2023-11-04T01:38:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.286+0000 7f3a0640e640 1 -- 172.21.15.44:0/3401343408 >> 172.21.15.44:0/3401343408 conn(0x7f3a000ce950 msgr2=0x7f3a000ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.286+0000 7f3a0640e640 1 -- 172.21.15.44:0/3401343408 shutdown_connections 2023-11-04T01:38:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.286+0000 7f3a0640e640 1 -- 172.21.15.44:0/3401343408 wait complete. 2023-11-04T01:38:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.287+0000 7f3a0640e640 1 Processor -- start 2023-11-04T01:38:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.287+0000 7f3a0640e640 1 -- start start 2023-11-04T01:38:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f3a0640e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39e8004350 0x7f3a0014cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f3a0640e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a000b2cf0 0x7f3a000c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f3a0640e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a000c7e10 0x7f3a000c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f3a0640e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a000cc490 con 0x7f3a000b2cf0 2023-11-04T01:38:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f3a0640e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0014d280 con 0x7f3a000c7e10 2023-11-04T01:38:57.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f3a0640e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a000c82b0 con 0x7f39e8004350 2023-11-04T01:38:57.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f39ff7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a000b2cf0 0x7f3a000c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f39ff7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a000b2cf0 0x7f3a000c78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39442/0 (socket says 172.21.15.44:39442) 2023-11-04T01:38:57.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f39ff7fe640 1 -- 172.21.15.44:0/352531840 learned_addr learned my addr 172.21.15.44:0/352531840 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:57.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f39fffff640 1 --2- 172.21.15.44:0/352531840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39e8004350 0x7f3a0014cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f39ff7fe640 1 -- 172.21.15.44:0/352531840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39e8004350 msgr2=0x7f3a0014cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f39ff7fe640 1 --2- 172.21.15.44:0/352531840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39e8004350 0x7f3a0014cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f39ff7fe640 1 -- 172.21.15.44:0/352531840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a000c7e10 msgr2=0x7f3a000c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f3a049ab640 1 --2- 172.21.15.44:0/352531840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a000c7e10 0x7f3a000c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f39ff7fe640 1 --2- 172.21.15.44:0/352531840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a000c7e10 0x7f3a000c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f39ff7fe640 1 -- 172.21.15.44:0/352531840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a000c8590 con 0x7f3a000b2cf0 2023-11-04T01:38:57.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.288+0000 7f39ff7fe640 1 --2- 172.21.15.44:0/352531840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a000b2cf0 0x7f3a000c78d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f39f002c3f0 tx=0x7f39f0001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:57.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.289+0000 7f39fcff9640 1 -- 172.21.15.44:0/352531840 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f0039030 con 0x7f3a000b2cf0 2023-11-04T01:38:57.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.289+0000 7f39fcff9640 1 -- 172.21.15.44:0/352531840 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f002cc60 con 0x7f3a000b2cf0 2023-11-04T01:38:57.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.289+0000 7f3a0640e640 1 -- 172.21.15.44:0/352531840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a000c8870 con 0x7f3a000b2cf0 2023-11-04T01:38:57.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.289+0000 7f39fcff9640 1 -- 172.21.15.44:0/352531840 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f003c040 con 0x7f3a000b2cf0 2023-11-04T01:38:57.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.289+0000 7f3a0640e640 1 -- 172.21.15.44:0/352531840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a000c5ed0 con 0x7f3a000b2cf0 2023-11-04T01:38:57.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.290+0000 7f3a0640e640 1 -- 172.21.15.44:0/352531840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0015e2f0 con 0x7f3a000b2cf0 2023-11-04T01:38:57.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.290+0000 7f39fcff9640 1 -- 172.21.15.44:0/352531840 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f39f0032070 con 0x7f3a000b2cf0 2023-11-04T01:38:57.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.290+0000 7f39fcff9640 1 --2- 172.21.15.44:0/352531840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f39ec06ae70 0x7f39ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.291+0000 7f39fcff9640 1 -- 172.21.15.44:0/352531840 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f39f00aab70 con 0x7f3a000b2cf0 2023-11-04T01:38:57.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.291+0000 7f39fffff640 1 --2- 172.21.15.44:0/352531840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f39ec06ae70 0x7f39ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.291+0000 7f39fffff640 1 --2- 172.21.15.44:0/352531840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f39ec06ae70 0x7f39ec06d330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f39f40016b0 tx=0x7f39f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:57.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.295+0000 7f39fcff9640 1 -- 172.21.15.44:0/352531840 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39f0075aa0 con 0x7f3a000b2cf0 2023-11-04T01:38:57.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.472+0000 7f3a0640e640 1 -- 172.21.15.44:0/352531840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3a00074290 con 0x7f3a000b2cf0 2023-11-04T01:38:57.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.473+0000 7f39fcff9640 1 -- 172.21.15.44:0/352531840 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+287 (secure 0 0 0) 0x7f39f00790c0 con 0x7f3a000b2cf0 2023-11-04T01:38:57.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:38:57.474 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2023-11-04T01:38:57.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:57.474 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2023-11-04T01:38:57.474 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2023-11-04T01:38:57.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:57.475 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:57.475 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 7, 2023-11-04T01:38:57.475 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": "snap-test-pool" 2023-11-04T01:38:57.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:57.475 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:57.475 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 12, 2023-11-04T01:38:57.475 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": "test_data_pool" 2023-11-04T01:38:57.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:38:57.475 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:38:57.475 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 13, 2023-11-04T01:38:57.475 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": "test_metadata_pool" 2023-11-04T01:38:57.475 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:38:57.476 INFO:teuthology.orchestra.run.smithi044.stdout:] 2023-11-04T01:38:57.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.475+0000 7f3a0640e640 1 -- 172.21.15.44:0/352531840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f39ec06ae70 msgr2=0x7f39ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.475+0000 7f3a0640e640 1 --2- 172.21.15.44:0/352531840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f39ec06ae70 0x7f39ec06d330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f39f40016b0 tx=0x7f39f4009040 comp rx=0 tx=0).stop 2023-11-04T01:38:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.475+0000 7f3a0640e640 1 -- 172.21.15.44:0/352531840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a000b2cf0 msgr2=0x7f3a000c78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.475+0000 7f3a0640e640 1 --2- 172.21.15.44:0/352531840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a000b2cf0 0x7f3a000c78d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f39f002c3f0 tx=0x7f39f0001980 comp rx=0 tx=0).stop 2023-11-04T01:38:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.475+0000 7f3a0640e640 1 -- 172.21.15.44:0/352531840 shutdown_connections 2023-11-04T01:38:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.475+0000 7f3a0640e640 1 --2- 172.21.15.44:0/352531840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f39ec06ae70 0x7f39ec06d330 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.475+0000 7f3a0640e640 1 --2- 172.21.15.44:0/352531840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a000c7e10 0x7f3a000c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.475+0000 7f3a0640e640 1 --2- 172.21.15.44:0/352531840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a000b2cf0 0x7f3a000c78d0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.475+0000 7f3a0640e640 1 --2- 172.21.15.44:0/352531840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39e8004350 0x7f3a0014cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.475+0000 7f3a0640e640 1 -- 172.21.15.44:0/352531840 >> 172.21.15.44:0/352531840 conn(0x7f3a000ce950 msgr2=0x7f3a0015a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.475+0000 7f3a0640e640 1 -- 172.21.15.44:0/352531840 shutdown_connections 2023-11-04T01:38:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.475+0000 7f3a0640e640 1 -- 172.21.15.44:0/352531840 wait complete. 2023-11-04T01:38:57.486 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:38:57.487 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:38:57.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.595+0000 7f19bae34640 1 Processor -- start 2023-11-04T01:38:57.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.595+0000 7f19bae34640 1 -- start start 2023-11-04T01:38:57.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.596+0000 7f19bae34640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19b415f510 0x7f19b40cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.596+0000 7f19bae34640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f19b406dd50 0x7f19b40cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.596+0000 7f19bae34640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b40cbbd0 con 0x7f19b4151ea0 2023-11-04T01:38:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.596+0000 7f19bae34640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b415c0d0 con 0x7f19b406dd50 2023-11-04T01:38:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.596+0000 7f19bae34640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b406cf90 con 0x7f19b415f510 2023-11-04T01:38:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.596+0000 7f19b93d1640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f19b406dd50 0x7f19b40cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.596+0000 7f19b93d1640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f19b406dd50 0x7f19b40cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39446/0 (socket says 172.21.15.44:39446) 2023-11-04T01:38:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.596+0000 7f19b93d1640 1 -- 172.21.15.44:0/3548530251 learned_addr learned my addr 172.21.15.44:0/3548530251 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.596+0000 7f19b3fff640 1 --2- 172.21.15.44:0/3548530251 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19b415f510 0x7f19b40cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.596+0000 7f19b93d1640 1 -- 172.21.15.44:0/3548530251 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19b415f510 msgr2=0x7f19b40cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.596+0000 7f19b93d1640 1 --2- 172.21.15.44:0/3548530251 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19b415f510 0x7f19b40cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.596+0000 7f19b93d1640 1 -- 172.21.15.44:0/3548530251 >> v1:172.21.15.204:6789/0 conn(0x7f19b4151ea0 legacy=0x7f19b415b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.596+0000 7f19b93d1640 1 -- 172.21.15.44:0/3548530251 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b406d270 con 0x7f19b406dd50 2023-11-04T01:38:57.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.597+0000 7f19b93d1640 1 --2- 172.21.15.44:0/3548530251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b406dd50 0x7f19b40cb690 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009e50 tx=0x7f19ac02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcc96b23a414544 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:57.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.597+0000 7f19b37fe640 1 -- 172.21.15.44:0/3548530251 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac02cb00 con 0x7f19b406dd50 2023-11-04T01:38:57.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.597+0000 7f19b37fe640 1 -- 172.21.15.44:0/3548530251 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac02cc60 con 0x7f19b406dd50 2023-11-04T01:38:57.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.597+0000 7f19b37fe640 1 -- 172.21.15.44:0/3548530251 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0343f0 con 0x7f19b406dd50 2023-11-04T01:38:57.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.598+0000 7f19bae34640 1 -- 172.21.15.44:0/3548530251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b406dd50 msgr2=0x7f19b40cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.598+0000 7f19bae34640 1 --2- 172.21.15.44:0/3548530251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b406dd50 0x7f19b40cb690 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009e50 tx=0x7f19ac02bf60 comp rx=0 tx=0).stop 2023-11-04T01:38:57.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.598+0000 7f19bae34640 1 -- 172.21.15.44:0/3548530251 shutdown_connections 2023-11-04T01:38:57.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.598+0000 7f19bae34640 1 --2- 172.21.15.44:0/3548530251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b406dd50 0x7f19b40cb690 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.598+0000 7f19bae34640 1 --2- 172.21.15.44:0/3548530251 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19b415f510 0x7f19b40cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.600 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.598+0000 7f19bae34640 1 -- 172.21.15.44:0/3548530251 >> 172.21.15.44:0/3548530251 conn(0x7f19b40b05d0 msgr2=0x7f19b40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:57.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.598+0000 7f19bae34640 1 -- 172.21.15.44:0/3548530251 shutdown_connections 2023-11-04T01:38:57.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.598+0000 7f19bae34640 1 -- 172.21.15.44:0/3548530251 wait complete. 2023-11-04T01:38:57.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.599+0000 7f19bae34640 1 Processor -- start 2023-11-04T01:38:57.601 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.599+0000 7f19bae34640 1 -- start start 2023-11-04T01:38:57.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.600+0000 7f19bae34640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19b406dd50 0x7f19b414c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.600+0000 7f19bae34640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19b4151ea0 0x7f19b40c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.600+0000 7f19bae34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b415f510 0x7f19b40c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.600+0000 7f19bae34640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40c8850 con 0x7f19b415f510 2023-11-04T01:38:57.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.600+0000 7f19bae34640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40c8570 con 0x7f19b4151ea0 2023-11-04T01:38:57.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.600+0000 7f19bae34640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40b1790 con 0x7f19b406dd50 2023-11-04T01:38:57.603 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.600+0000 7f19b93d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b415f510 0x7f19b40c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.600+0000 7f19b93d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b415f510 0x7f19b40c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39462/0 (socket says 172.21.15.44:39462) 2023-11-04T01:38:57.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.600+0000 7f19b93d1640 1 -- 172.21.15.44:0/674349789 learned_addr learned my addr 172.21.15.44:0/674349789 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:57.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.600+0000 7f19b93d1640 1 -- 172.21.15.44:0/674349789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19b406dd50 msgr2=0x7f19b414c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.600+0000 7f19b93d1640 1 --2- 172.21.15.44:0/674349789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19b406dd50 0x7f19b414c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.600+0000 7f19b93d1640 1 -- 172.21.15.44:0/674349789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19b4151ea0 msgr2=0x7f19b40c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.600+0000 7f19b93d1640 1 --2- 172.21.15.44:0/674349789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19b4151ea0 0x7f19b40c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.600+0000 7f19b93d1640 1 -- 172.21.15.44:0/674349789 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac009b30 con 0x7f19b415f510 2023-11-04T01:38:57.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.601+0000 7f19b93d1640 1 --2- 172.21.15.44:0/674349789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b415f510 0x7f19b40c7f40 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009e50 tx=0x7f19ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:57.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.601+0000 7f19b17fa640 1 -- 172.21.15.44:0/674349789 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac009510 con 0x7f19b415f510 2023-11-04T01:38:57.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.601+0000 7f19b17fa640 1 -- 172.21.15.44:0/674349789 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac03e450 con 0x7f19b415f510 2023-11-04T01:38:57.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.601+0000 7f19bae34640 1 -- 172.21.15.44:0/674349789 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b40b1a70 con 0x7f19b415f510 2023-11-04T01:38:57.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.601+0000 7f19b17fa640 1 -- 172.21.15.44:0/674349789 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac03e800 con 0x7f19b415f510 2023-11-04T01:38:57.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.601+0000 7f19bae34640 1 -- 172.21.15.44:0/674349789 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b40c6da0 con 0x7f19b415f510 2023-11-04T01:38:57.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.602+0000 7f19bae34640 1 -- 172.21.15.44:0/674349789 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b40b1f90 con 0x7f19b415f510 2023-11-04T01:38:57.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.602+0000 7f19b17fa640 1 -- 172.21.15.44:0/674349789 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19ac03e960 con 0x7f19b415f510 2023-11-04T01:38:57.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.603+0000 7f19b17fa640 1 --2- 172.21.15.44:0/674349789 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f19a006ae70 0x7f19a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.603+0000 7f19b17fa640 1 -- 172.21.15.44:0/674349789 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f19ac0ac4c0 con 0x7f19b415f510 2023-11-04T01:38:57.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.603+0000 7f19b8bd0640 1 --2- 172.21.15.44:0/674349789 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f19a006ae70 0x7f19a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.604+0000 7f19b8bd0640 1 --2- 172.21.15.44:0/674349789 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f19a006ae70 0x7f19a006d330 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f19a4000f60 tx=0x7f19a40079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:57.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.607+0000 7f19b17fa640 1 -- 172.21.15.44:0/674349789 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f19b40b1f90 con 0x7f19b415f510 2023-11-04T01:38:57.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:57.785+0000 7f19bae34640 1 -- 172.21.15.44:0/674349789 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f19b40b1f90 con 0x7f19b415f510 2023-11-04T01:38:58.338 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:58.341 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:58.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.393+0000 7f19b17fa640 1 -- 172.21.15.44:0/674349789 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 138+0+0 (secure 0 0 0) 0x7f19b40b1f90 con 0x7f19b415f510 2023-11-04T01:38:58.395 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2023-11-04T01:38:58.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.396+0000 7f19bae34640 1 -- 172.21.15.44:0/674349789 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f19a006ae70 msgr2=0x7f19a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.396+0000 7f19bae34640 1 --2- 172.21.15.44:0/674349789 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f19a006ae70 0x7f19a006d330 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f19a4000f60 tx=0x7f19a40079b0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.396+0000 7f19bae34640 1 -- 172.21.15.44:0/674349789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b415f510 msgr2=0x7f19b40c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.396+0000 7f19bae34640 1 --2- 172.21.15.44:0/674349789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b415f510 0x7f19b40c7f40 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009e50 tx=0x7f19ac004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:58.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.396+0000 7f19bae34640 1 -- 172.21.15.44:0/674349789 shutdown_connections 2023-11-04T01:38:58.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.396+0000 7f19bae34640 1 --2- 172.21.15.44:0/674349789 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f19a006ae70 0x7f19a006d330 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.396+0000 7f19bae34640 1 --2- 172.21.15.44:0/674349789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b415f510 0x7f19b40c7f40 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.396+0000 7f19bae34640 1 --2- 172.21.15.44:0/674349789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19b4151ea0 0x7f19b40c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.396+0000 7f19bae34640 1 --2- 172.21.15.44:0/674349789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19b406dd50 0x7f19b414c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.396+0000 7f19bae34640 1 -- 172.21.15.44:0/674349789 >> 172.21.15.44:0/674349789 conn(0x7f19b40b05d0 msgr2=0x7f19b40c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:58.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.396+0000 7f19bae34640 1 -- 172.21.15.44:0/674349789 shutdown_connections 2023-11-04T01:38:58.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.396+0000 7f19bae34640 1 -- 172.21.15.44:0/674349789 wait complete. 2023-11-04T01:38:58.413 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:38:58.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.527+0000 7f208a10c640 1 Processor -- start 2023-11-04T01:38:58.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.528+0000 7f208a10c640 1 -- start start 2023-11-04T01:38:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.528+0000 7f208a10c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f20840cd6d0 0x7f2084161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.528+0000 7f208a10c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f20840b4880 0x7f20840b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.528+0000 7f208a10c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20840cde60 con 0x7f2084153e60 2023-11-04T01:38:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.528+0000 7f208a10c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2084160f90 con 0x7f20840b4880 2023-11-04T01:38:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.528+0000 7f208a10c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2084161960 con 0x7f20840cd6d0 2023-11-04T01:38:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.529+0000 7f2083fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f20840b4880 0x7f20840b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.529+0000 7f20837fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2084153e60 0x7f208415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59254/0 (socket says 172.21.15.44:59254) 2023-11-04T01:38:58.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.529+0000 7f20837fe640 1 -- 172.21.15.44:0/1446984619 learned_addr learned my addr 172.21.15.44:0/1446984619 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:58.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.529+0000 7f2082ffd640 1 --2- 172.21.15.44:0/1446984619 >> v2:172.21.15.204:3300/0 conn(0x7f20840cd6d0 0x7f2084161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.529+0000 7f2083fff640 1 -- 172.21.15.44:0/1446984619 >> v2:172.21.15.204:3300/0 conn(0x7f20840cd6d0 msgr2=0x7f2084161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:58.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.529+0000 7f2083fff640 1 --2- 172.21.15.44:0/1446984619 >> v2:172.21.15.204:3300/0 conn(0x7f20840cd6d0 0x7f2084161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.529+0000 7f2083fff640 1 -- 172.21.15.44:0/1446984619 >> v1:172.21.15.44:6789/0 conn(0x7f2084153e60 legacy=0x7f208415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.529+0000 7f2083fff640 1 -- 172.21.15.44:0/1446984619 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20840b5220 con 0x7f20840b4880 2023-11-04T01:38:58.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.529+0000 7f20827fc640 1 -- 172.21.15.44:0/1446984619 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549076259 0 0) 0x7f20840cde60 con 0x7f2084153e60 2023-11-04T01:38:58.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.530+0000 7f2083fff640 1 --2- 172.21.15.44:0/1446984619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840b4880 0x7f20840b4ce0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f20840c9e80 tx=0x7f207c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766bb030564b813c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.530+0000 7f20827fc640 1 -- 172.21.15.44:0/1446984619 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c02cc80 con 0x7f20840b4880 2023-11-04T01:38:58.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.530+0000 7f20827fc640 1 -- 172.21.15.44:0/1446984619 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c02cde0 con 0x7f20840b4880 2023-11-04T01:38:58.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.530+0000 7f20827fc640 1 -- 172.21.15.44:0/1446984619 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c034660 con 0x7f20840b4880 2023-11-04T01:38:58.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.530+0000 7f208a10c640 1 -- 172.21.15.44:0/1446984619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840b4880 msgr2=0x7f20840b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.530+0000 7f208a10c640 1 --2- 172.21.15.44:0/1446984619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840b4880 0x7f20840b4ce0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f20840c9e80 tx=0x7f207c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.530+0000 7f208a10c640 1 -- 172.21.15.44:0/1446984619 shutdown_connections 2023-11-04T01:38:58.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.530+0000 7f208a10c640 1 --2- 172.21.15.44:0/1446984619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840b4880 0x7f20840b4ce0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.530+0000 7f208a10c640 1 --2- 172.21.15.44:0/1446984619 >> v2:172.21.15.204:3300/0 conn(0x7f20840cd6d0 0x7f2084161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.530+0000 7f208a10c640 1 -- 172.21.15.44:0/1446984619 >> 172.21.15.44:0/1446984619 conn(0x7f20840cf880 msgr2=0x7f20840cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:58.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.530+0000 7f208a10c640 1 -- 172.21.15.44:0/1446984619 shutdown_connections 2023-11-04T01:38:58.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.530+0000 7f208a10c640 1 -- 172.21.15.44:0/1446984619 wait complete. 2023-11-04T01:38:58.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.532+0000 7f208a10c640 1 Processor -- start 2023-11-04T01:38:58.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.532+0000 7f208a10c640 1 -- start start 2023-11-04T01:38:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.532+0000 7f208a10c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840b4880 0x7f20840b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.532+0000 7f208a10c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20840cd6d0 0x7f20840c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.532+0000 7f208a10c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2084153e60 0x7f20840ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.532+0000 7f208a10c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20840c9340 con 0x7f20840b4880 2023-11-04T01:38:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.532+0000 7f208a10c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20840cb250 con 0x7f2084153e60 2023-11-04T01:38:58.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.532+0000 7f208a10c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20840b71c0 con 0x7f20840cd6d0 2023-11-04T01:38:58.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f20837fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840b4880 0x7f20840b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f20837fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840b4880 0x7f20840b7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39478/0 (socket says 172.21.15.44:39478) 2023-11-04T01:38:58.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f20837fe640 1 -- 172.21.15.44:0/1253677126 learned_addr learned my addr 172.21.15.44:0/1253677126 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:58.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f2083fff640 1 --2- 172.21.15.44:0/1253677126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2084153e60 0x7f20840ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f2082ffd640 1 --2- 172.21.15.44:0/1253677126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20840cd6d0 0x7f20840c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f20837fe640 1 -- 172.21.15.44:0/1253677126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20840cd6d0 msgr2=0x7f20840c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f20837fe640 1 --2- 172.21.15.44:0/1253677126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20840cd6d0 0x7f20840c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f20837fe640 1 -- 172.21.15.44:0/1253677126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2084153e60 msgr2=0x7f20840ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f20837fe640 1 --2- 172.21.15.44:0/1253677126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2084153e60 0x7f20840ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f20837fe640 1 -- 172.21.15.44:0/1253677126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c009a70 con 0x7f20840b4880 2023-11-04T01:38:58.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f20837fe640 1 --2- 172.21.15.44:0/1253677126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840b4880 0x7f20840b7f80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f207400c430 tx=0x7f207400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f206bfff640 1 -- 172.21.15.44:0/1253677126 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20740074e0 con 0x7f20840b4880 2023-11-04T01:38:58.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f206bfff640 1 -- 172.21.15.44:0/1253677126 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2074007660 con 0x7f20840b4880 2023-11-04T01:38:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f208a10c640 1 -- 172.21.15.44:0/1253677126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20840b74a0 con 0x7f20840b4880 2023-11-04T01:38:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f206bfff640 1 -- 172.21.15.44:0/1253677126 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074004a20 con 0x7f20840b4880 2023-11-04T01:38:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.533+0000 7f208a10c640 1 -- 172.21.15.44:0/1253677126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20840b7a60 con 0x7f20840b4880 2023-11-04T01:38:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.534+0000 7f208a10c640 1 -- 172.21.15.44:0/1253677126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20840b7c80 con 0x7f20840b4880 2023-11-04T01:38:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.535+0000 7f206bfff640 1 -- 172.21.15.44:0/1253677126 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2074004b80 con 0x7f20840b4880 2023-11-04T01:38:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.535+0000 7f206bfff640 1 --2- 172.21.15.44:0/1253677126 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f207006ae70 0x7f207006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.535+0000 7f206bfff640 1 -- 172.21.15.44:0/1253677126 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6610+0+0 (secure 0 0 0) 0x7f2074089810 con 0x7f20840b4880 2023-11-04T01:38:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.535+0000 7f2082ffd640 1 --2- 172.21.15.44:0/1253677126 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f207006ae70 0x7f207006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.536+0000 7f2082ffd640 1 --2- 172.21.15.44:0/1253677126 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f207006ae70 0x7f207006d330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f208415a560 tx=0x7f2078008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.540+0000 7f206bfff640 1 -- 172.21.15.44:0/1253677126 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20740544b0 con 0x7f20840b4880 2023-11-04T01:38:58.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:58.717+0000 7f208a10c640 1 -- 172.21.15.44:0/1253677126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2084074290 con 0x7f20840b4880 2023-11-04T01:38:59.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.401+0000 7f206bfff640 1 -- 172.21.15.44:0/1253677126 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2074057ad0 con 0x7f20840b4880 2023-11-04T01:38:59.402 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2023-11-04T01:38:59.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.404+0000 7f208a10c640 1 -- 172.21.15.44:0/1253677126 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f207006ae70 msgr2=0x7f207006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.404+0000 7f208a10c640 1 --2- 172.21.15.44:0/1253677126 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f207006ae70 0x7f207006d330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f208415a560 tx=0x7f2078008040 comp rx=0 tx=0).stop 2023-11-04T01:38:59.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.404+0000 7f208a10c640 1 -- 172.21.15.44:0/1253677126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840b4880 msgr2=0x7f20840b7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.404+0000 7f208a10c640 1 --2- 172.21.15.44:0/1253677126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840b4880 0x7f20840b7f80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f207400c430 tx=0x7f207400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.405+0000 7f208a10c640 1 -- 172.21.15.44:0/1253677126 shutdown_connections 2023-11-04T01:38:59.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.405+0000 7f208a10c640 1 --2- 172.21.15.44:0/1253677126 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f207006ae70 0x7f207006d330 secure :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f208415a560 tx=0x7f2078008040 comp rx=0 tx=0).stop 2023-11-04T01:38:59.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.405+0000 7f208a10c640 1 --2- 172.21.15.44:0/1253677126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2084153e60 0x7f20840ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.405+0000 7f208a10c640 1 --2- 172.21.15.44:0/1253677126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20840cd6d0 0x7f20840c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.405+0000 7f208a10c640 1 --2- 172.21.15.44:0/1253677126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20840b4880 0x7f20840b7f80 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.405+0000 7f208a10c640 1 -- 172.21.15.44:0/1253677126 >> 172.21.15.44:0/1253677126 conn(0x7f20840cf880 msgr2=0x7f208415afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:59.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.406+0000 7f208a10c640 1 -- 172.21.15.44:0/1253677126 shutdown_connections 2023-11-04T01:38:59.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.406+0000 7f208a10c640 1 -- 172.21.15.44:0/1253677126 wait complete. 2023-11-04T01:38:59.435 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:38:59.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.548+0000 7ff3b1ed4640 1 Processor -- start 2023-11-04T01:38:59.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.548+0000 7ff3b1ed4640 1 -- start start 2023-11-04T01:38:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.549+0000 7ff3b1ed4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff3ac159300 0x7ff3ac06b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.549+0000 7ff3b1ed4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff3ac0ccde0 0x7ff3ac0cd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.549+0000 7ff3b1ed4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ac0cd750 con 0x7ff3ac070ff0 2023-11-04T01:38:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.549+0000 7ff3b1ed4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ac071e30 con 0x7ff3ac0ccde0 2023-11-04T01:38:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.549+0000 7ff3b1ed4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ac071590 con 0x7ff3ac159300 2023-11-04T01:38:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.549+0000 7ff3abfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff3ac0ccde0 0x7ff3ac0cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.549+0000 7ff3aaffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff3ac070ff0 0x7ff3ac15d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59264/0 (socket says 172.21.15.44:59264) 2023-11-04T01:38:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.549+0000 7ff3aaffd640 1 -- 172.21.15.44:0/2816342363 learned_addr learned my addr 172.21.15.44:0/2816342363 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:38:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.549+0000 7ff3abfff640 1 -- 172.21.15.44:0/2816342363 >> v2:172.21.15.204:3300/0 conn(0x7ff3ac159300 msgr2=0x7ff3ac06b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.549+0000 7ff3ab7fe640 1 --2- 172.21.15.44:0/2816342363 >> v2:172.21.15.204:3300/0 conn(0x7ff3ac159300 0x7ff3ac06b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.549+0000 7ff3abfff640 1 --2- 172.21.15.44:0/2816342363 >> v2:172.21.15.204:3300/0 conn(0x7ff3ac159300 0x7ff3ac06b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.549+0000 7ff3abfff640 1 -- 172.21.15.44:0/2816342363 >> v1:172.21.15.44:6789/0 conn(0x7ff3ac070ff0 legacy=0x7ff3ac15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.549+0000 7ff3abfff640 1 -- 172.21.15.44:0/2816342363 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ac071870 con 0x7ff3ac0ccde0 2023-11-04T01:38:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.549+0000 7ff3aa7fc640 1 -- 172.21.15.44:0/2816342363 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635374544 0 0) 0x7ff3ac0cd750 con 0x7ff3ac070ff0 2023-11-04T01:38:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.549+0000 7ff3ab7fe640 1 --2- 172.21.15.44:0/2816342363 >> v2:172.21.15.204:3300/0 conn(0x7ff3ac159300 0x7ff3ac06b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.550+0000 7ff3abfff640 1 --2- 172.21.15.44:0/2816342363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3ac0ccde0 0x7ff3ac0cd210 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac06c3b0 tx=0x7ff3a402cfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564a71c689bed5fd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.550+0000 7ff3aa7fc640 1 -- 172.21.15.44:0/2816342363 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a402db60 con 0x7ff3ac0ccde0 2023-11-04T01:38:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.550+0000 7ff3aa7fc640 1 -- 172.21.15.44:0/2816342363 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a402dcc0 con 0x7ff3ac0ccde0 2023-11-04T01:38:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.550+0000 7ff3aa7fc640 1 -- 172.21.15.44:0/2816342363 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4008660 con 0x7ff3ac0ccde0 2023-11-04T01:38:59.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.551+0000 7ff3b1ed4640 1 -- 172.21.15.44:0/2816342363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3ac0ccde0 msgr2=0x7ff3ac0cd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.551+0000 7ff3b1ed4640 1 --2- 172.21.15.44:0/2816342363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3ac0ccde0 0x7ff3ac0cd210 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac06c3b0 tx=0x7ff3a402cfc0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.551+0000 7ff3b1ed4640 1 -- 172.21.15.44:0/2816342363 shutdown_connections 2023-11-04T01:38:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.551+0000 7ff3b1ed4640 1 --2- 172.21.15.44:0/2816342363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3ac0ccde0 0x7ff3ac0cd210 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.551+0000 7ff3b1ed4640 1 --2- 172.21.15.44:0/2816342363 >> v2:172.21.15.204:3300/0 conn(0x7ff3ac159300 0x7ff3ac06b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.551+0000 7ff3b1ed4640 1 -- 172.21.15.44:0/2816342363 >> 172.21.15.44:0/2816342363 conn(0x7ff3ac0cbc90 msgr2=0x7ff3ac0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.551+0000 7ff3b1ed4640 1 -- 172.21.15.44:0/2816342363 shutdown_connections 2023-11-04T01:38:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.551+0000 7ff3b1ed4640 1 -- 172.21.15.44:0/2816342363 wait complete. 2023-11-04T01:38:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.552+0000 7ff3b1ed4640 1 Processor -- start 2023-11-04T01:38:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.552+0000 7ff3b1ed4640 1 -- start start 2023-11-04T01:38:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3b1ed4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3ac070ff0 0x7ff3ac1588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3b1ed4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3ac0ccde0 0x7ff3ac0c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3b1ed4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3ac159300 0x7ff3ac0c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3b1ed4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac1f3580 con 0x7ff3ac159300 2023-11-04T01:38:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3b1ed4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0acff0 con 0x7ff3ac0ccde0 2023-11-04T01:38:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3b1ed4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0c7220 con 0x7ff3ac070ff0 2023-11-04T01:38:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3abfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3ac159300 0x7ff3ac0c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3abfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3ac159300 0x7ff3ac0c59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39490/0 (socket says 172.21.15.44:39490) 2023-11-04T01:38:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3abfff640 1 -- 172.21.15.44:0/1109070235 learned_addr learned my addr 172.21.15.44:0/1109070235 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:38:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3ab7fe640 1 --2- 172.21.15.44:0/1109070235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3ac070ff0 0x7ff3ac1588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3aaffd640 1 --2- 172.21.15.44:0/1109070235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3ac0ccde0 0x7ff3ac0c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3abfff640 1 -- 172.21.15.44:0/1109070235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3ac070ff0 msgr2=0x7ff3ac1588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3abfff640 1 --2- 172.21.15.44:0/1109070235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3ac070ff0 0x7ff3ac1588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3abfff640 1 -- 172.21.15.44:0/1109070235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3ac0ccde0 msgr2=0x7ff3ac0c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3abfff640 1 --2- 172.21.15.44:0/1109070235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3ac0ccde0 0x7ff3ac0c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3abfff640 1 -- 172.21.15.44:0/1109070235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a400ab80 con 0x7ff3ac159300 2023-11-04T01:38:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.553+0000 7ff3aaffd640 1 --2- 172.21.15.44:0/1109070235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3ac0ccde0 0x7ff3ac0c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.554+0000 7ff3abfff640 1 --2- 172.21.15.44:0/1109070235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3ac159300 0x7ff3ac0c59f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4037040 tx=0x7ff3a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.554+0000 7ff393fff640 1 -- 172.21.15.44:0/1109070235 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4040470 con 0x7ff3ac159300 2023-11-04T01:38:59.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.554+0000 7ff393fff640 1 -- 172.21.15.44:0/1109070235 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a40405d0 con 0x7ff3ac159300 2023-11-04T01:38:59.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.554+0000 7ff3b1ed4640 1 -- 172.21.15.44:0/1109070235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ac0c6460 con 0x7ff3ac159300 2023-11-04T01:38:59.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.554+0000 7ff393fff640 1 -- 172.21.15.44:0/1109070235 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4040980 con 0x7ff3ac159300 2023-11-04T01:38:59.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.554+0000 7ff3b1ed4640 1 -- 172.21.15.44:0/1109070235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ac0c6a20 con 0x7ff3ac159300 2023-11-04T01:38:59.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.555+0000 7ff3b1ed4640 1 -- 172.21.15.44:0/1109070235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ac074290 con 0x7ff3ac159300 2023-11-04T01:38:59.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.555+0000 7ff393fff640 1 -- 172.21.15.44:0/1109070235 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3a4040ae0 con 0x7ff3ac159300 2023-11-04T01:38:59.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.556+0000 7ff393fff640 1 --2- 172.21.15.44:0/1109070235 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff39806ae70 0x7ff39806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.556+0000 7ff393fff640 1 -- 172.21.15.44:0/1109070235 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6992+0+0 (secure 0 0 0) 0x7ff3a40acb10 con 0x7ff3ac159300 2023-11-04T01:38:59.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.556+0000 7ff3ab7fe640 1 --2- 172.21.15.44:0/1109070235 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff39806ae70 0x7ff39806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.557+0000 7ff3ab7fe640 1 --2- 172.21.15.44:0/1109070235 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff39806ae70 0x7ff39806d330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac15cb20 tx=0x7ff39c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.560+0000 7ff393fff640 1 -- 172.21.15.44:0/1109070235 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3a40776c0 con 0x7ff3ac159300 2023-11-04T01:38:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:38:59.772+0000 7ff3b1ed4640 1 -- 172.21.15.44:0/1109070235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff3ac0ccb30 con 0x7ff3ac159300 2023-11-04T01:39:00.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:39:00.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:39:00.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-04T01:39:00.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-04T01:39:00.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.403+0000 7ff393fff640 1 -- 172.21.15.44:0/1109070235 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v35) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff3a407ace0 con 0x7ff3ac159300 2023-11-04T01:39:00.404 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 14 and data pool 15 2023-11-04T01:39:00.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.409+0000 7ff3b1ed4640 1 -- 172.21.15.44:0/1109070235 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff39806ae70 msgr2=0x7ff39806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.409+0000 7ff3b1ed4640 1 --2- 172.21.15.44:0/1109070235 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff39806ae70 0x7ff39806d330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac15cb20 tx=0x7ff39c008040 comp rx=0 tx=0).stop 2023-11-04T01:39:00.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.409+0000 7ff3b1ed4640 1 -- 172.21.15.44:0/1109070235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3ac159300 msgr2=0x7ff3ac0c59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.409+0000 7ff3b1ed4640 1 --2- 172.21.15.44:0/1109070235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3ac159300 0x7ff3ac0c59f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4037040 tx=0x7ff3a4004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:00.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.412+0000 7ff3b1ed4640 1 -- 172.21.15.44:0/1109070235 shutdown_connections 2023-11-04T01:39:00.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.412+0000 7ff3b1ed4640 1 --2- 172.21.15.44:0/1109070235 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff39806ae70 0x7ff39806d330 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.412+0000 7ff3b1ed4640 1 --2- 172.21.15.44:0/1109070235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3ac159300 0x7ff3ac0c59f0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.412+0000 7ff3b1ed4640 1 --2- 172.21.15.44:0/1109070235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3ac0ccde0 0x7ff3ac0c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.412+0000 7ff3b1ed4640 1 --2- 172.21.15.44:0/1109070235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3ac070ff0 0x7ff3ac1588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.412+0000 7ff3b1ed4640 1 -- 172.21.15.44:0/1109070235 >> 172.21.15.44:0/1109070235 conn(0x7ff3ac0cbc90 msgr2=0x7ff3ac06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:00.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.419+0000 7ff3b1ed4640 1 -- 172.21.15.44:0/1109070235 shutdown_connections 2023-11-04T01:39:00.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.421+0000 7ff3b1ed4640 1 -- 172.21.15.44:0/1109070235 wait complete. 2023-11-04T01:39:00.444 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:00.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.554+0000 7fe1d4589640 1 Processor -- start 2023-11-04T01:39:00.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.554+0000 7fe1d4589640 1 -- start start 2023-11-04T01:39:00.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d4589640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1cc15ce70 0x7fe1cc06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d4589640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe1cc15d250 0x7fe1cc0c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d4589640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe1cc0c9d70 0x7fe1cc0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d4589640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc0cdc10 con 0x7fe1cc15d250 2023-11-04T01:39:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d4589640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc06a120 con 0x7fe1cc0c9d70 2023-11-04T01:39:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d4589640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc06def0 con 0x7fe1cc15ce70 2023-11-04T01:39:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d1b24640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe1cc15d250 0x7fe1cc0c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d1b24640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe1cc15d250 0x7fe1cc0c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39504/0 (socket says 172.21.15.44:39504) 2023-11-04T01:39:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d1b24640 1 -- 172.21.15.44:0/100189634 learned_addr learned my addr 172.21.15.44:0/100189634 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d2325640 1 --2- 172.21.15.44:0/100189634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1cc15ce70 0x7fe1cc06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d2b26640 1 --2- 172.21.15.44:0/100189634 >> v2:172.21.15.204:3300/0 conn(0x7fe1cc0c9d70 0x7fe1cc0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d1b24640 1 -- 172.21.15.44:0/100189634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1cc15ce70 msgr2=0x7fe1cc06d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d1b24640 1 --2- 172.21.15.44:0/100189634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1cc15ce70 0x7fe1cc06d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d1b24640 1 -- 172.21.15.44:0/100189634 >> v2:172.21.15.204:3300/0 conn(0x7fe1cc0c9d70 msgr2=0x7fe1cc0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d1b24640 1 --2- 172.21.15.44:0/100189634 >> v2:172.21.15.204:3300/0 conn(0x7fe1cc0c9d70 0x7fe1cc0ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d1b24640 1 -- 172.21.15.44:0/100189634 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc06a370 con 0x7fe1cc15d250 2023-11-04T01:39:00.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d2325640 1 --2- 172.21.15.44:0/100189634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1cc15ce70 0x7fe1cc06d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:00.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.555+0000 7fe1d2b26640 1 --2- 172.21.15.44:0/100189634 >> v2:172.21.15.204:3300/0 conn(0x7fe1cc0c9d70 0x7fe1cc0ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.556+0000 7fe1d1b24640 1 --2- 172.21.15.44:0/100189634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1cc15d250 0x7fe1cc0c9830 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc066630 tx=0x7fe1bc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc96d358f1d485a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.556+0000 7fe1d1323640 1 -- 172.21.15.44:0/100189634 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc031860 con 0x7fe1cc15d250 2023-11-04T01:39:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.556+0000 7fe1d1323640 1 -- 172.21.15.44:0/100189634 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc0319c0 con 0x7fe1cc15d250 2023-11-04T01:39:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.556+0000 7fe1d1323640 1 -- 172.21.15.44:0/100189634 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc031d50 con 0x7fe1cc15d250 2023-11-04T01:39:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.557+0000 7fe1d4589640 1 -- 172.21.15.44:0/100189634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1cc15d250 msgr2=0x7fe1cc0c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.557+0000 7fe1d4589640 1 --2- 172.21.15.44:0/100189634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1cc15d250 0x7fe1cc0c9830 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc066630 tx=0x7fe1bc02b900 comp rx=0 tx=0).stop 2023-11-04T01:39:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.557+0000 7fe1d4589640 1 -- 172.21.15.44:0/100189634 shutdown_connections 2023-11-04T01:39:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.557+0000 7fe1d4589640 1 --2- 172.21.15.44:0/100189634 >> v2:172.21.15.204:3300/0 conn(0x7fe1cc0c9d70 0x7fe1cc0ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.557+0000 7fe1d4589640 1 --2- 172.21.15.44:0/100189634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1cc15d250 0x7fe1cc0c9830 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.557+0000 7fe1d4589640 1 --2- 172.21.15.44:0/100189634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1cc15ce70 0x7fe1cc06d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.557+0000 7fe1d4589640 1 -- 172.21.15.44:0/100189634 >> 172.21.15.44:0/100189634 conn(0x7fe1cc0b0cd0 msgr2=0x7fe1cc0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.557+0000 7fe1d4589640 1 -- 172.21.15.44:0/100189634 shutdown_connections 2023-11-04T01:39:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.557+0000 7fe1d4589640 1 -- 172.21.15.44:0/100189634 wait complete. 2023-11-04T01:39:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.558+0000 7fe1d4589640 1 Processor -- start 2023-11-04T01:39:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.558+0000 7fe1d4589640 1 -- start start 2023-11-04T01:39:00.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d4589640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1cc15ce70 0x7fe1cc1f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d4589640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1cc15d250 0x7fe1cc149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d4589640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1cc0c4990 0x7fe1cc0c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d4589640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0c5360 con 0x7fe1cc15ce70 2023-11-04T01:39:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d4589640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0c74d0 con 0x7fe1cc15d250 2023-11-04T01:39:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d4589640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0c7720 con 0x7fe1cc0c4990 2023-11-04T01:39:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d2325640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1cc15ce70 0x7fe1cc1f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d2325640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1cc15ce70 0x7fe1cc1f2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39516/0 (socket says 172.21.15.44:39516) 2023-11-04T01:39:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d2325640 1 -- 172.21.15.44:0/2508178905 learned_addr learned my addr 172.21.15.44:0/2508178905 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d1b24640 1 --2- 172.21.15.44:0/2508178905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1cc15d250 0x7fe1cc149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d2b26640 1 --2- 172.21.15.44:0/2508178905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1cc0c4990 0x7fe1cc0c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d2325640 1 -- 172.21.15.44:0/2508178905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1cc0c4990 msgr2=0x7fe1cc0c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d2325640 1 --2- 172.21.15.44:0/2508178905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1cc0c4990 0x7fe1cc0c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d2325640 1 -- 172.21.15.44:0/2508178905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1cc15d250 msgr2=0x7fe1cc149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d2325640 1 --2- 172.21.15.44:0/2508178905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1cc15d250 0x7fe1cc149590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d2325640 1 -- 172.21.15.44:0/2508178905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc0094d0 con 0x7fe1cc15ce70 2023-11-04T01:39:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d2b26640 1 --2- 172.21.15.44:0/2508178905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1cc0c4990 0x7fe1cc0c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d2325640 1 --2- 172.21.15.44:0/2508178905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1cc15ce70 0x7fe1cc1f2cb0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800c7f0 tx=0x7fe1c800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1c2ffd640 1 -- 172.21.15.44:0/2508178905 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8007a30 con 0x7fe1cc15ce70 2023-11-04T01:39:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1c2ffd640 1 -- 172.21.15.44:0/2508178905 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c8007b90 con 0x7fe1cc15ce70 2023-11-04T01:39:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1d4589640 1 -- 172.21.15.44:0/2508178905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc0c7a00 con 0x7fe1cc15ce70 2023-11-04T01:39:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.559+0000 7fe1c2ffd640 1 -- 172.21.15.44:0/2508178905 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800ce40 con 0x7fe1cc15ce70 2023-11-04T01:39:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.560+0000 7fe1d4589640 1 -- 172.21.15.44:0/2508178905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc0c7fc0 con 0x7fe1cc15ce70 2023-11-04T01:39:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.560+0000 7fe1d4589640 1 -- 172.21.15.44:0/2508178905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc0c6080 con 0x7fe1cc15ce70 2023-11-04T01:39:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.561+0000 7fe1c2ffd640 1 -- 172.21.15.44:0/2508178905 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe1c80113f0 con 0x7fe1cc15ce70 2023-11-04T01:39:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.561+0000 7fe1c2ffd640 1 --2- 172.21.15.44:0/2508178905 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe1b006ae70 0x7fe1b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.562+0000 7fe1c2ffd640 1 -- 172.21.15.44:0/2508178905 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fe1c8089e00 con 0x7fe1cc15ce70 2023-11-04T01:39:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.562+0000 7fe1d1b24640 1 --2- 172.21.15.44:0/2508178905 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe1b006ae70 0x7fe1b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.562+0000 7fe1d1b24640 1 --2- 172.21.15.44:0/2508178905 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe1b006ae70 0x7fe1b006d330 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc036000 tx=0x7fe1bc03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:00.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.566+0000 7fe1c2ffd640 1 -- 172.21.15.44:0/2508178905 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe1c8054810 con 0x7fe1cc15ce70 2023-11-04T01:39:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.742+0000 7fe1d4589640 1 -- 172.21.15.44:0/2508178905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1cc074290 con 0x7fe1cc15ce70 2023-11-04T01:39:00.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.743+0000 7fe1c2ffd640 1 -- 172.21.15.44:0/2508178905 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+21966 (secure 0 0 0) 0x7fe1c801f020 con 0x7fe1cc15ce70 2023-11-04T01:39:00.745 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:00.745 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":83,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:38:59.773184+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:57.815488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:58.748063+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:00.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.745+0000 7fe1d4589640 1 -- 172.21.15.44:0/2508178905 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe1b006ae70 msgr2=0x7fe1b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.745+0000 7fe1d4589640 1 --2- 172.21.15.44:0/2508178905 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe1b006ae70 0x7fe1b006d330 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc036000 tx=0x7fe1bc03c040 comp rx=0 tx=0).stop 2023-11-04T01:39:00.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.745+0000 7fe1d4589640 1 -- 172.21.15.44:0/2508178905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1cc15ce70 msgr2=0x7fe1cc1f2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.745+0000 7fe1d4589640 1 --2- 172.21.15.44:0/2508178905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1cc15ce70 0x7fe1cc1f2cb0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800c7f0 tx=0x7fe1c800cbf0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.745+0000 7fe1d4589640 1 -- 172.21.15.44:0/2508178905 shutdown_connections 2023-11-04T01:39:00.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.745+0000 7fe1d4589640 1 --2- 172.21.15.44:0/2508178905 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe1b006ae70 0x7fe1b006d330 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.745+0000 7fe1d4589640 1 --2- 172.21.15.44:0/2508178905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1cc0c4990 0x7fe1cc0c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.745+0000 7fe1d4589640 1 --2- 172.21.15.44:0/2508178905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1cc15d250 0x7fe1cc149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.745+0000 7fe1d4589640 1 --2- 172.21.15.44:0/2508178905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1cc15ce70 0x7fe1cc1f2cb0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.745+0000 7fe1d4589640 1 -- 172.21.15.44:0/2508178905 >> 172.21.15.44:0/2508178905 conn(0x7fe1cc0b0cd0 msgr2=0x7fe1cc0ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:00.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.745+0000 7fe1d4589640 1 -- 172.21.15.44:0/2508178905 shutdown_connections 2023-11-04T01:39:00.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.745+0000 7fe1d4589640 1 -- 172.21.15.44:0/2508178905 wait complete. 2023-11-04T01:39:00.757 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:00.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.863+0000 7f84adf3c640 1 Processor -- start 2023-11-04T01:39:00.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.863+0000 7f84adf3c640 1 -- start start 2023-11-04T01:39:00.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.864+0000 7f84adf3c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f84a815ab70 0x7f84a80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.864+0000 7f84adf3c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84a806a830 0x7f84a80ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.864+0000 7f84adf3c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a806d310 con 0x7f84a806eba0 2023-11-04T01:39:00.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.864+0000 7f84adf3c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a80cba70 con 0x7f84a815ab70 2023-11-04T01:39:00.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.864+0000 7f84adf3c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a8161c50 con 0x7f84a806a830 2023-11-04T01:39:00.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.864+0000 7f84a77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f84a815ab70 0x7f84a80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.864+0000 7f84a77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f84a815ab70 0x7f84a80cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39518/0 (socket says 172.21.15.44:39518) 2023-11-04T01:39:00.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.864+0000 7f84a77fe640 1 -- 172.21.15.44:0/3197883816 learned_addr learned my addr 172.21.15.44:0/3197883816 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:00.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.864+0000 7f84a7fff640 1 --2- 172.21.15.44:0/3197883816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84a806a830 0x7f84a80ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.864+0000 7f84a77fe640 1 -- 172.21.15.44:0/3197883816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84a806a830 msgr2=0x7f84a80ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:00.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.864+0000 7f84a77fe640 1 --2- 172.21.15.44:0/3197883816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84a806a830 0x7f84a80ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.864+0000 7f84a77fe640 1 -- 172.21.15.44:0/3197883816 >> v1:172.21.15.204:6789/0 conn(0x7f84a806eba0 legacy=0x7f84a806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.864+0000 7f84a77fe640 1 -- 172.21.15.44:0/3197883816 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a815d860 con 0x7f84a815ab70 2023-11-04T01:39:00.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.864+0000 7f84a7fff640 1 --2- 172.21.15.44:0/3197883816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84a806a830 0x7f84a80ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:00.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.865+0000 7f84a77fe640 1 --2- 172.21.15.44:0/3197883816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a815ab70 0x7f84a80cbea0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f8490009850 tx=0x7f849002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0b5cb935bc1991 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:00.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.865+0000 7f84a67fc640 1 -- 172.21.15.44:0/3197883816 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490004230 con 0x7f84a815ab70 2023-11-04T01:39:00.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.865+0000 7f84a67fc640 1 -- 172.21.15.44:0/3197883816 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8490004390 con 0x7f84a815ab70 2023-11-04T01:39:00.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.865+0000 7f84a67fc640 1 -- 172.21.15.44:0/3197883816 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490031830 con 0x7f84a815ab70 2023-11-04T01:39:00.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.866+0000 7f84adf3c640 1 -- 172.21.15.44:0/3197883816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a815ab70 msgr2=0x7f84a80cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.866+0000 7f84adf3c640 1 --2- 172.21.15.44:0/3197883816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a815ab70 0x7f84a80cbea0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f8490009850 tx=0x7f849002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.866+0000 7f84adf3c640 1 -- 172.21.15.44:0/3197883816 shutdown_connections 2023-11-04T01:39:00.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.866+0000 7f84adf3c640 1 --2- 172.21.15.44:0/3197883816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84a806a830 0x7f84a80ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.866+0000 7f84adf3c640 1 --2- 172.21.15.44:0/3197883816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a815ab70 0x7f84a80cbea0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.866+0000 7f84adf3c640 1 -- 172.21.15.44:0/3197883816 >> 172.21.15.44:0/3197883816 conn(0x7f84a8098d40 msgr2=0x7f84a80cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:00.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.866+0000 7f84adf3c640 1 -- 172.21.15.44:0/3197883816 shutdown_connections 2023-11-04T01:39:00.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.866+0000 7f84adf3c640 1 -- 172.21.15.44:0/3197883816 wait complete. 2023-11-04T01:39:00.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.867+0000 7f84adf3c640 1 Processor -- start 2023-11-04T01:39:00.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.867+0000 7f84adf3c640 1 -- start start 2023-11-04T01:39:00.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84adf3c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84a806a830 0x7f84a8155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84adf3c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84a806eba0 0x7f84a8155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84adf3c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a815ab70 0x7f84a815ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84adf3c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80c45f0 con 0x7f84a815ab70 2023-11-04T01:39:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84adf3c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80c39e0 con 0x7f84a806a830 2023-11-04T01:39:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84adf3c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80c3cc0 con 0x7f84a806eba0 2023-11-04T01:39:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84a7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a815ab70 0x7f84a815ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84a7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a815ab70 0x7f84a815ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39534/0 (socket says 172.21.15.44:39534) 2023-11-04T01:39:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84a7fff640 1 -- 172.21.15.44:0/2380573817 learned_addr learned my addr 172.21.15.44:0/2380573817 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84a77fe640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84a806a830 0x7f84a8155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84a6ffd640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84a806eba0 0x7f84a8155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84a7fff640 1 -- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84a806eba0 msgr2=0x7f84a8155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84a7fff640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84a806eba0 0x7f84a8155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84a7fff640 1 -- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84a806a830 msgr2=0x7f84a8155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84a7fff640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84a806a830 0x7f84a8155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84a7fff640 1 -- 172.21.15.44:0/2380573817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490009460 con 0x7f84a815ab70 2023-11-04T01:39:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84a77fe640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84a806a830 0x7f84a8155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84a6ffd640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84a806eba0 0x7f84a8155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.868+0000 7f84a7fff640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a815ab70 0x7f84a815ed40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f84a0007e60 tx=0x7f84a000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.869+0000 7f849ffff640 1 -- 172.21.15.44:0/2380573817 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0015600 con 0x7f84a815ab70 2023-11-04T01:39:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.869+0000 7f849ffff640 1 -- 172.21.15.44:0/2380573817 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a000f040 con 0x7f84a815ab70 2023-11-04T01:39:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.869+0000 7f84adf3c640 1 -- 172.21.15.44:0/2380573817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a80c3fa0 con 0x7f84a815ab70 2023-11-04T01:39:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.869+0000 7f849ffff640 1 -- 172.21.15.44:0/2380573817 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a00159a0 con 0x7f84a815ab70 2023-11-04T01:39:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.869+0000 7f84adf3c640 1 -- 172.21.15.44:0/2380573817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a8155850 con 0x7f84a815ab70 2023-11-04T01:39:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.870+0000 7f84adf3c640 1 -- 172.21.15.44:0/2380573817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a80c4760 con 0x7f84a815ab70 2023-11-04T01:39:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.870+0000 7f849ffff640 1 -- 172.21.15.44:0/2380573817 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f84a001e3b0 con 0x7f84a815ab70 2023-11-04T01:39:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.870+0000 7f849ffff640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f848806ae70 0x7f848806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.871+0000 7f849ffff640 1 -- 172.21.15.44:0/2380573817 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f84a0089de0 con 0x7f84a815ab70 2023-11-04T01:39:00.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.871+0000 7f84a77fe640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f848806ae70 0x7f848806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.871+0000 7f84a77fe640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f848806ae70 0x7f848806d330 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8490035000 tx=0x7f8490008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:00.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:00.875+0000 7f849ffff640 1 -- 172.21.15.44:0/2380573817 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f84a00549b0 con 0x7f84a815ab70 2023-11-04T01:39:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.050+0000 7f84adf3c640 1 -- 172.21.15.44:0/2380573817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84a8074290 con 0x7f84a815ab70 2023-11-04T01:39:01.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.052+0000 7f849ffff640 1 -- 172.21.15.44:0/2380573817 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+21966 (secure 0 0 0) 0x7f84a001a090 con 0x7f84a815ab70 2023-11-04T01:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":83,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:38:59.773184+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:57.815488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:58.748063+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.054+0000 7f84adf3c640 1 -- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f848806ae70 msgr2=0x7f848806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.054+0000 7f84adf3c640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f848806ae70 0x7f848806d330 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8490035000 tx=0x7f8490008030 comp rx=0 tx=0).stop 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.054+0000 7f84adf3c640 1 -- 172.21.15.44:0/2380573817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a815ab70 msgr2=0x7f84a815ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.054+0000 7f84adf3c640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a815ab70 0x7f84a815ed40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f84a0007e60 tx=0x7f84a000d4a0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.054+0000 7f84adf3c640 1 -- 172.21.15.44:0/2380573817 shutdown_connections 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.054+0000 7f84adf3c640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f848806ae70 0x7f848806d330 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.054+0000 7f84adf3c640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a815ab70 0x7f84a815ed40 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.054+0000 7f84adf3c640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84a806eba0 0x7f84a8155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.054+0000 7f84adf3c640 1 --2- 172.21.15.44:0/2380573817 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84a806a830 0x7f84a8155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.054+0000 7f84adf3c640 1 -- 172.21.15.44:0/2380573817 >> 172.21.15.44:0/2380573817 conn(0x7f84a8098d40 msgr2=0x7f84a806a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:01.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.054+0000 7f84adf3c640 1 -- 172.21.15.44:0/2380573817 shutdown_connections 2023-11-04T01:39:01.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.054+0000 7f84adf3c640 1 -- 172.21.15.44:0/2380573817 wait complete. 2023-11-04T01:39:01.066 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:39:01.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.173+0000 7f832edb6640 1 Processor -- start 2023-11-04T01:39:01.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.173+0000 7f832edb6640 1 -- start start 2023-11-04T01:39:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.174+0000 7f832edb6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8328159c00 0x7f83280cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.174+0000 7f832edb6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f83280c48e0 0x7f83280c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.174+0000 7f832edb6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280adac0 0x7f83280adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.174+0000 7f832edb6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83280c52d0 con 0x7f83280c48e0 2023-11-04T01:39:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.174+0000 7f832edb6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832815aff0 con 0x7f8328159c00 2023-11-04T01:39:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.174+0000 7f832edb6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832815a3e0 con 0x7f83280adac0 2023-11-04T01:39:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.174+0000 7f8327fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f83280c48e0 0x7f83280c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.174+0000 7f8327fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f83280c48e0 0x7f83280c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39536/0 (socket says 172.21.15.44:39536) 2023-11-04T01:39:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.174+0000 7f8327fff640 1 -- 172.21.15.44:0/3056066231 learned_addr learned my addr 172.21.15.44:0/3056066231 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.175+0000 7f832cb52640 1 --2- 172.21.15.44:0/3056066231 >> v2:172.21.15.204:3300/0 conn(0x7f8328159c00 0x7f83280cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.175+0000 7f832d353640 1 --2- 172.21.15.44:0/3056066231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280adac0 0x7f83280adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.175+0000 7f8327fff640 1 -- 172.21.15.44:0/3056066231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280adac0 msgr2=0x7f83280adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.175+0000 7f8327fff640 1 --2- 172.21.15.44:0/3056066231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280adac0 0x7f83280adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.175+0000 7f8327fff640 1 -- 172.21.15.44:0/3056066231 >> v2:172.21.15.204:3300/0 conn(0x7f8328159c00 msgr2=0x7f83280cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.175+0000 7f8327fff640 1 --2- 172.21.15.44:0/3056066231 >> v2:172.21.15.204:3300/0 conn(0x7f8328159c00 0x7f83280cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.175+0000 7f8327fff640 1 -- 172.21.15.44:0/3056066231 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832815a6c0 con 0x7f83280c48e0 2023-11-04T01:39:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.175+0000 7f832d353640 1 --2- 172.21.15.44:0/3056066231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280adac0 0x7f83280adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.175+0000 7f8327fff640 1 --2- 172.21.15.44:0/3056066231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83280c48e0 0x7f83280c4d90 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f83280cc4d0 tx=0x7f831802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57400b32fe3fb5d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.176+0000 7f83277fe640 1 -- 172.21.15.44:0/3056066231 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831802ca70 con 0x7f83280c48e0 2023-11-04T01:39:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.176+0000 7f83277fe640 1 -- 172.21.15.44:0/3056066231 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831802cbd0 con 0x7f83280c48e0 2023-11-04T01:39:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.176+0000 7f83277fe640 1 -- 172.21.15.44:0/3056066231 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180343f0 con 0x7f83280c48e0 2023-11-04T01:39:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.176+0000 7f832edb6640 1 -- 172.21.15.44:0/3056066231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83280c48e0 msgr2=0x7f83280c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.176+0000 7f832edb6640 1 --2- 172.21.15.44:0/3056066231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83280c48e0 0x7f83280c4d90 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f83280cc4d0 tx=0x7f831802bed0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.176+0000 7f832edb6640 1 -- 172.21.15.44:0/3056066231 shutdown_connections 2023-11-04T01:39:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.176+0000 7f832edb6640 1 --2- 172.21.15.44:0/3056066231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280adac0 0x7f83280adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.176+0000 7f832edb6640 1 --2- 172.21.15.44:0/3056066231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83280c48e0 0x7f83280c4d90 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.176+0000 7f832edb6640 1 --2- 172.21.15.44:0/3056066231 >> v2:172.21.15.204:3300/0 conn(0x7f8328159c00 0x7f83280cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.176+0000 7f832edb6640 1 -- 172.21.15.44:0/3056066231 >> 172.21.15.44:0/3056066231 conn(0x7f83280ce950 msgr2=0x7f83280ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.176+0000 7f832edb6640 1 -- 172.21.15.44:0/3056066231 shutdown_connections 2023-11-04T01:39:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.176+0000 7f832edb6640 1 -- 172.21.15.44:0/3056066231 wait complete. 2023-11-04T01:39:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.177+0000 7f832edb6640 1 Processor -- start 2023-11-04T01:39:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.177+0000 7f832edb6640 1 -- start start 2023-11-04T01:39:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.178+0000 7f832edb6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83280adac0 0x7f83281546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.178+0000 7f832edb6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280c48e0 0x7f83280c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.178+0000 7f832edb6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8328159c00 0x7f83280ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.178+0000 7f832edb6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83281f1b00 con 0x7f8328159c00 2023-11-04T01:39:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.178+0000 7f832edb6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83281f1da0 con 0x7f83280adac0 2023-11-04T01:39:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.178+0000 7f832edb6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83281f2080 con 0x7f83280c48e0 2023-11-04T01:39:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.178+0000 7f832d353640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8328159c00 0x7f83280ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.178+0000 7f832d353640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8328159c00 0x7f83280ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39542/0 (socket says 172.21.15.44:39542) 2023-11-04T01:39:01.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.178+0000 7f832d353640 1 -- 172.21.15.44:0/1792888117 learned_addr learned my addr 172.21.15.44:0/1792888117 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:01.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.179+0000 7f8327fff640 1 --2- 172.21.15.44:0/1792888117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280c48e0 0x7f83280c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.179+0000 7f832cb52640 1 --2- 172.21.15.44:0/1792888117 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83280adac0 0x7f83281546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.179+0000 7f832d353640 1 -- 172.21.15.44:0/1792888117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280c48e0 msgr2=0x7f83280c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.179+0000 7f832d353640 1 --2- 172.21.15.44:0/1792888117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280c48e0 0x7f83280c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.179+0000 7f832d353640 1 -- 172.21.15.44:0/1792888117 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83280adac0 msgr2=0x7f83281546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.179+0000 7f832d353640 1 --2- 172.21.15.44:0/1792888117 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83280adac0 0x7f83281546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.179+0000 7f832d353640 1 -- 172.21.15.44:0/1792888117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8318009b30 con 0x7f8328159c00 2023-11-04T01:39:01.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.179+0000 7f832d353640 1 --2- 172.21.15.44:0/1792888117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8328159c00 0x7f83280ac740 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f831000e9f0 tx=0x7f831000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:01.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.179+0000 7f83257fa640 1 -- 172.21.15.44:0/1792888117 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310004440 con 0x7f8328159c00 2023-11-04T01:39:01.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.179+0000 7f83257fa640 1 -- 172.21.15.44:0/1792888117 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310009950 con 0x7f8328159c00 2023-11-04T01:39:01.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.179+0000 7f832edb6640 1 -- 172.21.15.44:0/1792888117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83281f2360 con 0x7f8328159c00 2023-11-04T01:39:01.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.179+0000 7f83257fa640 1 -- 172.21.15.44:0/1792888117 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310009ce0 con 0x7f8328159c00 2023-11-04T01:39:01.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.179+0000 7f832edb6640 1 -- 172.21.15.44:0/1792888117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83281f2880 con 0x7f8328159c00 2023-11-04T01:39:01.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.180+0000 7f832edb6640 1 -- 172.21.15.44:0/1792888117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83281f25a0 con 0x7f8328159c00 2023-11-04T01:39:01.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.180+0000 7f83257fa640 1 -- 172.21.15.44:0/1792888117 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8310003610 con 0x7f8328159c00 2023-11-04T01:39:01.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.181+0000 7f83257fa640 1 --2- 172.21.15.44:0/1792888117 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f830806ae70 0x7f830806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.181+0000 7f83257fa640 1 -- 172.21.15.44:0/1792888117 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f8310014070 con 0x7f8328159c00 2023-11-04T01:39:01.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.181+0000 7f832cb52640 1 --2- 172.21.15.44:0/1792888117 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f830806ae70 0x7f830806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.182+0000 7f832cb52640 1 --2- 172.21.15.44:0/1792888117 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f830806ae70 0x7f830806d330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8320006fd0 tx=0x7f8320008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:01.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.185+0000 7f83257fa640 1 -- 172.21.15.44:0/1792888117 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f83281f25a0 con 0x7f8328159c00 2023-11-04T01:39:01.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.399+0000 7f832edb6640 1 -- 172.21.15.44:0/1792888117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f83281f25a0 con 0x7f8328159c00 2023-11-04T01:39:01.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.417+0000 7f83257fa640 1 -- 172.21.15.44:0/1792888117 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 118+0+0 (secure 0 0 0) 0x7f83281f25a0 con 0x7f8328159c00 2023-11-04T01:39:01.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.420+0000 7f832edb6640 1 -- 172.21.15.44:0/1792888117 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f830806ae70 msgr2=0x7f830806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.420+0000 7f832edb6640 1 --2- 172.21.15.44:0/1792888117 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f830806ae70 0x7f830806d330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8320006fd0 tx=0x7f8320008040 comp rx=0 tx=0).stop 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.420+0000 7f832edb6640 1 -- 172.21.15.44:0/1792888117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8328159c00 msgr2=0x7f83280ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.420+0000 7f832edb6640 1 --2- 172.21.15.44:0/1792888117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8328159c00 0x7f83280ac740 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f831000e9f0 tx=0x7f831000eeb0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.420+0000 7f832edb6640 1 -- 172.21.15.44:0/1792888117 shutdown_connections 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.420+0000 7f832edb6640 1 --2- 172.21.15.44:0/1792888117 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f830806ae70 0x7f830806d330 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.420+0000 7f832edb6640 1 --2- 172.21.15.44:0/1792888117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8328159c00 0x7f83280ac740 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.420+0000 7f832edb6640 1 --2- 172.21.15.44:0/1792888117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280c48e0 0x7f83280c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.420+0000 7f832edb6640 1 --2- 172.21.15.44:0/1792888117 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83280adac0 0x7f83281546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.420+0000 7f832edb6640 1 -- 172.21.15.44:0/1792888117 >> 172.21.15.44:0/1792888117 conn(0x7f83280ce950 msgr2=0x7f832806dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.421+0000 7f832edb6640 1 -- 172.21.15.44:0/1792888117 shutdown_connections 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.421+0000 7f832edb6640 1 -- 172.21.15.44:0/1792888117 wait complete. 2023-11-04T01:39:01.433 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:39:01.433 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:39:01.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.541+0000 7fc9bfc6f640 1 Processor -- start 2023-11-04T01:39:01.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.541+0000 7fc9bfc6f640 1 -- start start 2023-11-04T01:39:01.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.542+0000 7fc9bfc6f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc9b80b1a40 0x7fc9b80ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.542+0000 7fc9bfc6f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc9b806a830 0x7fc9b80cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.542+0000 7fc9bfc6f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b8160990 con 0x7fc9b81605b0 2023-11-04T01:39:01.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.542+0000 7fc9bfc6f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b80cc7c0 con 0x7fc9b80b1a40 2023-11-04T01:39:01.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.542+0000 7fc9bfc6f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b80cd750 con 0x7fc9b806a830 2023-11-04T01:39:01.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.542+0000 7fc9bd20a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc9b80b1a40 0x7fc9b80ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.542+0000 7fc9bd20a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc9b80b1a40 0x7fc9b80ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39558/0 (socket says 172.21.15.44:39558) 2023-11-04T01:39:01.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.542+0000 7fc9bd20a640 1 -- 172.21.15.44:0/576200356 learned_addr learned my addr 172.21.15.44:0/576200356 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:01.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.542+0000 7fc9be20c640 1 --2- 172.21.15.44:0/576200356 >> v2:172.21.15.204:3300/0 conn(0x7fc9b806a830 0x7fc9b80cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.543+0000 7fc9bd20a640 1 -- 172.21.15.44:0/576200356 >> v2:172.21.15.204:3300/0 conn(0x7fc9b806a830 msgr2=0x7fc9b80cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:01.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.543+0000 7fc9bd20a640 1 --2- 172.21.15.44:0/576200356 >> v2:172.21.15.204:3300/0 conn(0x7fc9b806a830 0x7fc9b80cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.543+0000 7fc9bd20a640 1 -- 172.21.15.44:0/576200356 >> v1:172.21.15.204:6789/0 conn(0x7fc9b81605b0 legacy=0x7fc9b806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.543+0000 7fc9bd20a640 1 -- 172.21.15.44:0/576200356 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b80cc4e0 con 0x7fc9b80b1a40 2023-11-04T01:39:01.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.543+0000 7fc9bd20a640 1 --2- 172.21.15.44:0/576200356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b80b1a40 0x7fc9b80ccbc0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80c6aa0 tx=0x7fc9ac02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b67d5b22e5f91de server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:01.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.543+0000 7fc9bca09640 1 -- 172.21.15.44:0/576200356 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0317e0 con 0x7fc9b80b1a40 2023-11-04T01:39:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.543+0000 7fc9bca09640 1 -- 172.21.15.44:0/576200356 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac031940 con 0x7fc9b80b1a40 2023-11-04T01:39:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.543+0000 7fc9bca09640 1 -- 172.21.15.44:0/576200356 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac031cd0 con 0x7fc9b80b1a40 2023-11-04T01:39:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.544+0000 7fc9bfc6f640 1 -- 172.21.15.44:0/576200356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b80b1a40 msgr2=0x7fc9b80ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.544+0000 7fc9bfc6f640 1 --2- 172.21.15.44:0/576200356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b80b1a40 0x7fc9b80ccbc0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80c6aa0 tx=0x7fc9ac02b880 comp rx=0 tx=0).stop 2023-11-04T01:39:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.544+0000 7fc9bfc6f640 1 -- 172.21.15.44:0/576200356 shutdown_connections 2023-11-04T01:39:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.544+0000 7fc9bfc6f640 1 --2- 172.21.15.44:0/576200356 >> v2:172.21.15.204:3300/0 conn(0x7fc9b806a830 0x7fc9b80cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.544+0000 7fc9bfc6f640 1 --2- 172.21.15.44:0/576200356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b80b1a40 0x7fc9b80ccbc0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.544+0000 7fc9bfc6f640 1 -- 172.21.15.44:0/576200356 >> 172.21.15.44:0/576200356 conn(0x7fc9b8071820 msgr2=0x7fc9b8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.544+0000 7fc9bfc6f640 1 -- 172.21.15.44:0/576200356 shutdown_connections 2023-11-04T01:39:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.544+0000 7fc9bfc6f640 1 -- 172.21.15.44:0/576200356 wait complete. 2023-11-04T01:39:01.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.545+0000 7fc9bfc6f640 1 Processor -- start 2023-11-04T01:39:01.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.545+0000 7fc9bfc6f640 1 -- start start 2023-11-04T01:39:01.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bfc6f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b806a830 0x7fc9b80b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bfc6f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b81605b0 0x7fc9b815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bfc6f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9b80b4fb0 0x7fc9b815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bfc6f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b815b790 con 0x7fc9b806a830 2023-11-04T01:39:01.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bfc6f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80c9520 con 0x7fc9b80b4fb0 2023-11-04T01:39:01.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bfc6f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80c9800 con 0x7fc9b81605b0 2023-11-04T01:39:01.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bda0b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b806a830 0x7fc9b80b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bda0b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b806a830 0x7fc9b80b4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39570/0 (socket says 172.21.15.44:39570) 2023-11-04T01:39:01.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bda0b640 1 -- 172.21.15.44:0/2852722821 learned_addr learned my addr 172.21.15.44:0/2852722821 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:01.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bd20a640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b81605b0 0x7fc9b815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9be20c640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9b80b4fb0 0x7fc9b815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bda0b640 1 -- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b81605b0 msgr2=0x7fc9b815ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bda0b640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b81605b0 0x7fc9b815ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bda0b640 1 -- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9b80b4fb0 msgr2=0x7fc9b815b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bda0b640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9b80b4fb0 0x7fc9b815b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bda0b640 1 -- 172.21.15.44:0/2852722821 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac0094d0 con 0x7fc9b806a830 2023-11-04T01:39:01.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9be20c640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9b80b4fb0 0x7fc9b815b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:01.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.546+0000 7fc9bd20a640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b81605b0 0x7fc9b815ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:01.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.547+0000 7fc9bda0b640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b806a830 0x7fc9b80b4a70 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000c400 tx=0x7fc9b000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:01.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.547+0000 7fc9b67fc640 1 -- 172.21.15.44:0/2852722821 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00052d0 con 0x7fc9b806a830 2023-11-04T01:39:01.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.547+0000 7fc9b67fc640 1 -- 172.21.15.44:0/2852722821 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b0005430 con 0x7fc9b806a830 2023-11-04T01:39:01.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.547+0000 7fc9bfc6f640 1 -- 172.21.15.44:0/2852722821 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b80b4270 con 0x7fc9b806a830 2023-11-04T01:39:01.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.547+0000 7fc9b67fc640 1 -- 172.21.15.44:0/2852722821 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0003830 con 0x7fc9b806a830 2023-11-04T01:39:01.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.547+0000 7fc9bfc6f640 1 -- 172.21.15.44:0/2852722821 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b80ac180 con 0x7fc9b806a830 2023-11-04T01:39:01.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.548+0000 7fc9bfc6f640 1 -- 172.21.15.44:0/2852722821 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b80672a0 con 0x7fc9b806a830 2023-11-04T01:39:01.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.548+0000 7fc9b67fc640 1 -- 172.21.15.44:0/2852722821 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc9b0003990 con 0x7fc9b806a830 2023-11-04T01:39:01.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.549+0000 7fc9b67fc640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc9a406ae70 0x7fc9a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.549+0000 7fc9b67fc640 1 -- 172.21.15.44:0/2852722821 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fc9b0089180 con 0x7fc9b806a830 2023-11-04T01:39:01.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.549+0000 7fc9bd20a640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc9a406ae70 0x7fc9a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.550+0000 7fc9bd20a640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc9a406ae70 0x7fc9a406d330 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac036000 tx=0x7fc9ac03d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:01.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.553+0000 7fc9b67fc640 1 -- 172.21.15.44:0/2852722821 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc9b0053c20 con 0x7fc9b806a830 2023-11-04T01:39:01.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:01.765+0000 7fc9bfc6f640 1 -- 172.21.15.44:0/2852722821 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc9b80b40d0 con 0x7fc9b806a830 2023-11-04T01:39:02.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.423+0000 7fc9b67fc640 1 -- 172.21.15.44:0/2852722821 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v37) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc9b80b40d0 con 0x7fc9b806a830 2023-11-04T01:39:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.426+0000 7fc9bfc6f640 1 -- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc9a406ae70 msgr2=0x7fc9a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.426+0000 7fc9bfc6f640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc9a406ae70 0x7fc9a406d330 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac036000 tx=0x7fc9ac03d040 comp rx=0 tx=0).stop 2023-11-04T01:39:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.426+0000 7fc9bfc6f640 1 -- 172.21.15.44:0/2852722821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b806a830 msgr2=0x7fc9b80b4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.426+0000 7fc9bfc6f640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b806a830 0x7fc9b80b4a70 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000c400 tx=0x7fc9b000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.426+0000 7fc9bfc6f640 1 -- 172.21.15.44:0/2852722821 shutdown_connections 2023-11-04T01:39:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.426+0000 7fc9bfc6f640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc9a406ae70 0x7fc9a406d330 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.426+0000 7fc9bfc6f640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9b80b4fb0 0x7fc9b815b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.426+0000 7fc9bfc6f640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b81605b0 0x7fc9b815ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.426+0000 7fc9bfc6f640 1 --2- 172.21.15.44:0/2852722821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b806a830 0x7fc9b80b4a70 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.426+0000 7fc9bfc6f640 1 -- 172.21.15.44:0/2852722821 >> 172.21.15.44:0/2852722821 conn(0x7fc9b8071820 msgr2=0x7fc9b80b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.427+0000 7fc9bfc6f640 1 -- 172.21.15.44:0/2852722821 shutdown_connections 2023-11-04T01:39:02.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.427+0000 7fc9bfc6f640 1 -- 172.21.15.44:0/2852722821 wait complete. 2023-11-04T01:39:02.441 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:39:02.441 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:02.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.552+0000 7faafd087640 1 Processor -- start 2023-11-04T01:39:02.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.552+0000 7faafd087640 1 -- start start 2023-11-04T01:39:02.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.553+0000 7faafd087640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaf80b42c0 0x7faaf80c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.553+0000 7faafd087640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf80ca090 con 0x7faaf80c9c40 2023-11-04T01:39:02.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.553+0000 7faafd087640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf806cfa0 con 0x7faaf815ad80 2023-11-04T01:39:02.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.553+0000 7faafd087640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf806d280 con 0x7faaf80b42c0 2023-11-04T01:39:02.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.553+0000 7faaf759e640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7faaf80c9c40 0x7faaf80b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59712/0 (socket says 172.21.15.44:59712) 2023-11-04T01:39:02.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.553+0000 7faaf759e640 1 -- 172.21.15.44:0/1333536939 learned_addr learned my addr 172.21.15.44:0/1333536939 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:02.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.553+0000 7faaf659c640 1 --2- 172.21.15.44:0/1333536939 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaf80b42c0 0x7faaf80c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.553+0000 7faaf5d9b640 1 -- 172.21.15.44:0/1333536939 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232557398 0 0) 0x7faaf0001490 con 0x7faaf80c9c40 2023-11-04T01:39:02.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.553+0000 7faaf5d9b640 1 -- 172.21.15.44:0/1333536939 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faae0003520 con 0x7faaf80c9c40 2023-11-04T01:39:02.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.553+0000 7faaf5d9b640 1 -- 172.21.15.44:0/1333536939 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2451701827 0 0) 0x7faae0003520 con 0x7faaf80c9c40 2023-11-04T01:39:02.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf5d9b640 1 -- 172.21.15.44:0/1333536939 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaf80b42c0 msgr2=0x7faaf80c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:02.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf5d9b640 1 --2- 172.21.15.44:0/1333536939 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaf80b42c0 0x7faaf80c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf5d9b640 1 -- 172.21.15.44:0/1333536939 >> v1:172.21.15.204:6789/0 conn(0x7faaf815ad80 legacy=0x7faaf806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf5d9b640 1 -- 172.21.15.44:0/1333536939 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf806d560 con 0x7faaf80c9c40 2023-11-04T01:39:02.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf5d9b640 1 -- 172.21.15.44:0/1333536939 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7faaf0001b80 con 0x7faaf80c9c40 2023-11-04T01:39:02.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf5d9b640 1 -- 172.21.15.44:0/1333536939 >> v1:172.21.15.44:6789/0 conn(0x7faaf80c9c40 legacy=0x7faaf80b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf5d9b640 1 --2- 172.21.15.44:0/1333536939 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faae00039a0 0x7faae0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf5d9b640 1 --2- 172.21.15.44:0/1333536939 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaf80b42c0 0x7faae00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf5d9b640 1 --2- 172.21.15.44:0/1333536939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faae0004d00 0x7faae0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf5d9b640 1 -- 172.21.15.44:0/1333536939 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf806d280 con 0x7faae0004d00 2023-11-04T01:39:02.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf5d9b640 1 -- 172.21.15.44:0/1333536939 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae000b980 con 0x7faae00039a0 2023-11-04T01:39:02.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf5d9b640 1 -- 172.21.15.44:0/1333536939 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae000bb40 con 0x7faaf80b42c0 2023-11-04T01:39:02.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf759e640 1 --2- 172.21.15.44:0/1333536939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faae0004d00 0x7faae0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf659c640 1 --2- 172.21.15.44:0/1333536939 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaf80b42c0 0x7faae00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf6d9d640 1 --2- 172.21.15.44:0/1333536939 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faae00039a0 0x7faae0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf759e640 1 -- 172.21.15.44:0/1333536939 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaf80b42c0 msgr2=0x7faae00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:02.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf759e640 1 --2- 172.21.15.44:0/1333536939 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaf80b42c0 0x7faae00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf759e640 1 -- 172.21.15.44:0/1333536939 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faae00039a0 msgr2=0x7faae0003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:02.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf759e640 1 --2- 172.21.15.44:0/1333536939 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faae00039a0 0x7faae0003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf759e640 1 -- 172.21.15.44:0/1333536939 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae0003520 con 0x7faae0004d00 2023-11-04T01:39:02.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf6d9d640 1 --2- 172.21.15.44:0/1333536939 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faae00039a0 0x7faae0003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:02.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.554+0000 7faaf659c640 1 --2- 172.21.15.44:0/1333536939 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaf80b42c0 0x7faae00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:02.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.555+0000 7faaf759e640 1 --2- 172.21.15.44:0/1333536939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faae0004d00 0x7faae0005180 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7faaf000a840 tx=0x7faae00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b43e992a2614ac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.555+0000 7faaf5d9b640 1 -- 172.21.15.44:0/1333536939 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf002cea0 con 0x7faae0004d00 2023-11-04T01:39:02.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.555+0000 7faaf5d9b640 1 -- 172.21.15.44:0/1333536939 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf002f070 con 0x7faae0004d00 2023-11-04T01:39:02.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.555+0000 7faaf5d9b640 1 -- 172.21.15.44:0/1333536939 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0034890 con 0x7faae0004d00 2023-11-04T01:39:02.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.555+0000 7faafd087640 1 -- 172.21.15.44:0/1333536939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faae0004d00 msgr2=0x7faae0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.555+0000 7faafd087640 1 --2- 172.21.15.44:0/1333536939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faae0004d00 0x7faae0005180 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7faaf000a840 tx=0x7faae00057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.555+0000 7faaf759e640 1 -- 172.21.15.44:0/1333536939 reap_dead start 2023-11-04T01:39:02.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.555+0000 7faafd087640 1 -- 172.21.15.44:0/1333536939 shutdown_connections 2023-11-04T01:39:02.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.555+0000 7faafd087640 1 -- 172.21.15.44:0/1333536939 >> 172.21.15.44:0/1333536939 conn(0x7faaf80ce950 msgr2=0x7faaf80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:02.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.556+0000 7faafd087640 1 -- 172.21.15.44:0/1333536939 shutdown_connections 2023-11-04T01:39:02.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.556+0000 7faafd087640 1 -- 172.21.15.44:0/1333536939 wait complete. 2023-11-04T01:39:02.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.557+0000 7faafd087640 1 Processor -- start 2023-11-04T01:39:02.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.557+0000 7faafd087640 1 -- start start 2023-11-04T01:39:02.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faafd087640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faae0004d00 0x7faaf8148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faafd087640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaf815c360 0x7faaf81e7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faafd087640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faaf81e7d40 0x7faaf815cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faafd087640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf81e81f0 con 0x7faae0004d00 2023-11-04T01:39:02.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faafd087640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf815b300 con 0x7faaf81e7d40 2023-11-04T01:39:02.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faafd087640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf815b5a0 con 0x7faaf815c360 2023-11-04T01:39:02.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faaf6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faae0004d00 0x7faaf8148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faaf6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faae0004d00 0x7faaf8148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55282/0 (socket says 172.21.15.44:55282) 2023-11-04T01:39:02.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faaf6d9d640 1 -- 172.21.15.44:0/2621707954 learned_addr learned my addr 172.21.15.44:0/2621707954 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:02.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faaf659c640 1 --2- 172.21.15.44:0/2621707954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaf815c360 0x7faaf81e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faaf759e640 1 --2- 172.21.15.44:0/2621707954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faaf81e7d40 0x7faaf815cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faaf6d9d640 1 -- 172.21.15.44:0/2621707954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaf815c360 msgr2=0x7faaf81e7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faaf6d9d640 1 --2- 172.21.15.44:0/2621707954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaf815c360 0x7faaf81e7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faaf6d9d640 1 -- 172.21.15.44:0/2621707954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faaf81e7d40 msgr2=0x7faaf815cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faaf6d9d640 1 --2- 172.21.15.44:0/2621707954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faaf81e7d40 0x7faaf815cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faaf6d9d640 1 -- 172.21.15.44:0/2621707954 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf815b880 con 0x7faae0004d00 2023-11-04T01:39:02.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.558+0000 7faaf6d9d640 1 --2- 172.21.15.44:0/2621707954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faae0004d00 0x7faaf8148e70 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7faae800e5d0 tx=0x7faae800ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.559+0000 7faadf7fe640 1 -- 172.21.15.44:0/2621707954 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80052e0 con 0x7faae0004d00 2023-11-04T01:39:02.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.559+0000 7faadf7fe640 1 -- 172.21.15.44:0/2621707954 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae8005440 con 0x7faae0004d00 2023-11-04T01:39:02.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.559+0000 7faafd087640 1 -- 172.21.15.44:0/2621707954 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf815bb60 con 0x7faae0004d00 2023-11-04T01:39:02.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.559+0000 7faadf7fe640 1 -- 172.21.15.44:0/2621707954 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8003810 con 0x7faae0004d00 2023-11-04T01:39:02.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.559+0000 7faafd087640 1 -- 172.21.15.44:0/2621707954 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf81493b0 con 0x7faae0004d00 2023-11-04T01:39:02.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.560+0000 7faafd087640 1 -- 172.21.15.44:0/2621707954 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf815c080 con 0x7faae0004d00 2023-11-04T01:39:02.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.560+0000 7faadf7fe640 1 -- 172.21.15.44:0/2621707954 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faae8003970 con 0x7faae0004d00 2023-11-04T01:39:02.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.561+0000 7faadf7fe640 1 --2- 172.21.15.44:0/2621707954 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faae406ae70 0x7faae406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.561+0000 7faadf7fe640 1 -- 172.21.15.44:0/2621707954 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7faae8089a90 con 0x7faae0004d00 2023-11-04T01:39:02.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.561+0000 7faaf659c640 1 --2- 172.21.15.44:0/2621707954 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faae406ae70 0x7faae406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.561+0000 7faaf659c640 1 --2- 172.21.15.44:0/2621707954 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faae406ae70 0x7faae406d330 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faaf81e83c0 tx=0x7faaec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.565+0000 7faadf7fe640 1 -- 172.21.15.44:0/2621707954 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faaf815c080 con 0x7faae0004d00 2023-11-04T01:39:02.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.783+0000 7faafd087640 1 -- 172.21.15.44:0/2621707954 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faaf815c080 con 0x7faae0004d00 2023-11-04T01:39:02.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.783+0000 7faadf7fe640 1 -- 172.21.15.44:0/2621707954 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4915 (secure 0 0 0) 0x7faaf815c080 con 0x7faae0004d00 2023-11-04T01:39:02.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:02.785 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/257114874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":257114874},{"type":"v1","addr":"172.21.15.204:6835","nonce":257114874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6292,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2084651129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":2084651129},{"type":"v1","addr":"172.21.15.204:6837","nonce":2084651129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1688550253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1688550253},{"type":"v1","addr":"172.21.15.44:6834","nonce":1688550253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:59.773482+0000","modified":"2023-11-04T01:39:01.766460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6891},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6891":{"gid":6891,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/364976049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":364976049},{"type":"v1","addr":"172.21.15.44:6835","nonce":364976049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:39:02.785 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 37 2023-11-04T01:39:02.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.785+0000 7faafd087640 1 -- 172.21.15.44:0/2621707954 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faae406ae70 msgr2=0x7faae406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.785+0000 7faafd087640 1 --2- 172.21.15.44:0/2621707954 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faae406ae70 0x7faae406d330 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faaf81e83c0 tx=0x7faaec008040 comp rx=0 tx=0).stop 2023-11-04T01:39:02.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.785+0000 7faafd087640 1 -- 172.21.15.44:0/2621707954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faae0004d00 msgr2=0x7faaf8148e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.785+0000 7faafd087640 1 --2- 172.21.15.44:0/2621707954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faae0004d00 0x7faaf8148e70 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7faae800e5d0 tx=0x7faae800ea90 comp rx=0 tx=0).stop 2023-11-04T01:39:02.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.785+0000 7faafd087640 1 -- 172.21.15.44:0/2621707954 shutdown_connections 2023-11-04T01:39:02.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.785+0000 7faafd087640 1 --2- 172.21.15.44:0/2621707954 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faae406ae70 0x7faae406d330 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.785+0000 7faafd087640 1 --2- 172.21.15.44:0/2621707954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faaf81e7d40 0x7faaf815cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.785+0000 7faafd087640 1 --2- 172.21.15.44:0/2621707954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaf815c360 0x7faaf81e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.785+0000 7faafd087640 1 --2- 172.21.15.44:0/2621707954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faae0004d00 0x7faaf8148e70 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.785+0000 7faafd087640 1 -- 172.21.15.44:0/2621707954 >> 172.21.15.44:0/2621707954 conn(0x7faaf80ce950 msgr2=0x7faaf8072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:02.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.786+0000 7faafd087640 1 -- 172.21.15.44:0/2621707954 shutdown_connections 2023-11-04T01:39:02.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.786+0000 7faafd087640 1 -- 172.21.15.44:0/2621707954 wait complete. 2023-11-04T01:39:02.797 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:02.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.901+0000 7f1fddfa9640 1 Processor -- start 2023-11-04T01:39:02.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.901+0000 7f1fddfa9640 1 -- start start 2023-11-04T01:39:02.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.902+0000 7f1fddfa9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1fd80ce240 0x7f1fd8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.902+0000 7f1fddfa9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd8157540 0x7f1fd80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.902+0000 7f1fddfa9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd815e000 con 0x7f1fd80cde60 2023-11-04T01:39:02.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.902+0000 7f1fddfa9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd815e5c0 con 0x7f1fd80ce240 2023-11-04T01:39:02.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.902+0000 7f1fddfa9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd815e2e0 con 0x7f1fd8157540 2023-11-04T01:39:02.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.903+0000 7f1fd7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd8157540 0x7f1fd80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.903+0000 7f1fd6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1fd80ce240 0x7f1fd8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.903+0000 7f1fd7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd8157540 0x7f1fd80d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:57554/0 (socket says 172.21.15.44:57554) 2023-11-04T01:39:02.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.903+0000 7f1fd7fff640 1 -- 172.21.15.44:0/3394637063 learned_addr learned my addr 172.21.15.44:0/3394637063 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:02.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.903+0000 7f1fd7fff640 1 -- 172.21.15.44:0/3394637063 >> v2:172.21.15.204:3300/0 conn(0x7f1fd80ce240 msgr2=0x7f1fd8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:02.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.903+0000 7f1fd7fff640 1 --2- 172.21.15.44:0/3394637063 >> v2:172.21.15.204:3300/0 conn(0x7f1fd80ce240 0x7f1fd8157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.903+0000 7f1fd7fff640 1 -- 172.21.15.44:0/3394637063 >> v1:172.21.15.204:6789/0 conn(0x7f1fd80cde60 legacy=0x7f1fd815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.903+0000 7f1fd7fff640 1 -- 172.21.15.44:0/3394637063 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd80d1120 con 0x7f1fd8157540 2023-11-04T01:39:02.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.903+0000 7f1fd6ffd640 1 --2- 172.21.15.44:0/3394637063 >> v2:172.21.15.204:3300/0 conn(0x7f1fd80ce240 0x7f1fd8157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:02.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.904+0000 7f1fd7fff640 1 --2- 172.21.15.44:0/3394637063 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd8157540 0x7f1fd80d1920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0009e50 tx=0x7f1fd002bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5497a0f98b3591fd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.904+0000 7f1fd67fc640 1 -- 172.21.15.44:0/3394637063 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd002c8c0 con 0x7f1fd8157540 2023-11-04T01:39:02.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.904+0000 7f1fd67fc640 1 -- 172.21.15.44:0/3394637063 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd002ca20 con 0x7f1fd8157540 2023-11-04T01:39:02.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.904+0000 7f1fd67fc640 1 -- 172.21.15.44:0/3394637063 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd002cdb0 con 0x7f1fd8157540 2023-11-04T01:39:02.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.904+0000 7f1fddfa9640 1 -- 172.21.15.44:0/3394637063 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd8157540 msgr2=0x7f1fd80d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.904+0000 7f1fddfa9640 1 --2- 172.21.15.44:0/3394637063 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd8157540 0x7f1fd80d1920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0009e50 tx=0x7f1fd002bda0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.905+0000 7f1fddfa9640 1 -- 172.21.15.44:0/3394637063 shutdown_connections 2023-11-04T01:39:02.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.905+0000 7f1fddfa9640 1 --2- 172.21.15.44:0/3394637063 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd8157540 0x7f1fd80d1920 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.905+0000 7f1fddfa9640 1 --2- 172.21.15.44:0/3394637063 >> v2:172.21.15.204:3300/0 conn(0x7f1fd80ce240 0x7f1fd8157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.905+0000 7f1fddfa9640 1 -- 172.21.15.44:0/3394637063 >> 172.21.15.44:0/3394637063 conn(0x7f1fd8071f30 msgr2=0x7f1fd80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:02.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.905+0000 7f1fddfa9640 1 -- 172.21.15.44:0/3394637063 shutdown_connections 2023-11-04T01:39:02.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.905+0000 7f1fddfa9640 1 -- 172.21.15.44:0/3394637063 wait complete. 2023-11-04T01:39:02.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.906+0000 7f1fddfa9640 1 Processor -- start 2023-11-04T01:39:02.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.906+0000 7f1fddfa9640 1 -- start start 2023-11-04T01:39:02.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fddfa9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd80cde60 0x7f1fd814c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fddfa9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fd80ce240 0x7f1fd815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fddfa9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd8157540 0x7f1fd815cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fddfa9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd80cc9e0 con 0x7f1fd8157540 2023-11-04T01:39:02.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fddfa9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8157c60 con 0x7f1fd80ce240 2023-11-04T01:39:02.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fddfa9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8157f40 con 0x7f1fd80cde60 2023-11-04T01:39:02.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fd7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd8157540 0x7f1fd815cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fd7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd8157540 0x7f1fd815cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55290/0 (socket says 172.21.15.44:55290) 2023-11-04T01:39:02.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fd7fff640 1 -- 172.21.15.44:0/3604494894 learned_addr learned my addr 172.21.15.44:0/3604494894 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:02.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fd77fe640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd80cde60 0x7f1fd814c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fd6ffd640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fd80ce240 0x7f1fd815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fd7fff640 1 -- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd80cde60 msgr2=0x7f1fd814c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fd7fff640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd80cde60 0x7f1fd814c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fd7fff640 1 -- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fd80ce240 msgr2=0x7f1fd815c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fd7fff640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fd80ce240 0x7f1fd815c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fd7fff640 1 -- 172.21.15.44:0/3604494894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc009400 con 0x7f1fd8157540 2023-11-04T01:39:02.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fd77fe640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd80cde60 0x7f1fd814c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:02.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fd6ffd640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fd80ce240 0x7f1fd815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:02.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.907+0000 7f1fd7fff640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd8157540 0x7f1fd815cc50 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0009e50 tx=0x7f1fd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.908+0000 7f1fbffff640 1 -- 172.21.15.44:0/3604494894 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0009510 con 0x7f1fd8157540 2023-11-04T01:39:02.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.908+0000 7f1fbffff640 1 -- 172.21.15.44:0/3604494894 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd0007a30 con 0x7f1fd8157540 2023-11-04T01:39:02.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.908+0000 7f1fddfa9640 1 -- 172.21.15.44:0/3604494894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd0009b30 con 0x7f1fd8157540 2023-11-04T01:39:02.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.908+0000 7f1fbffff640 1 -- 172.21.15.44:0/3604494894 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0007de0 con 0x7f1fd8157540 2023-11-04T01:39:02.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.908+0000 7f1fddfa9640 1 -- 172.21.15.44:0/3604494894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd8158500 con 0x7f1fd8157540 2023-11-04T01:39:02.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.908+0000 7f1fddfa9640 1 -- 172.21.15.44:0/3604494894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd8074290 con 0x7f1fd8157540 2023-11-04T01:39:02.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.909+0000 7f1fbffff640 1 -- 172.21.15.44:0/3604494894 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1fd003e450 con 0x7f1fd8157540 2023-11-04T01:39:02.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.909+0000 7f1fbffff640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1fc406ae70 0x7f1fc406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.909+0000 7f1fbffff640 1 -- 172.21.15.44:0/3604494894 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f1fd00ac340 con 0x7f1fd8157540 2023-11-04T01:39:02.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.910+0000 7f1fd77fe640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1fc406ae70 0x7f1fc406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.910+0000 7f1fd77fe640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1fc406ae70 0x7f1fc406d330 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8007fd0 tx=0x7f1fc8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:02.913+0000 7f1fbffff640 1 -- 172.21.15.44:0/3604494894 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1fd0076f10 con 0x7f1fd8157540 2023-11-04T01:39:03.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.089+0000 7f1fddfa9640 1 -- 172.21.15.44:0/3604494894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fd80b7280 con 0x7f1fd8157540 2023-11-04T01:39:03.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.091+0000 7f1fbffff640 1 -- 172.21.15.44:0/3604494894 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+21953 (secure 0 0 0) 0x7f1fd007a530 con 0x7f1fd8157540 2023-11-04T01:39:03.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:03.093 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":84,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:39:01.413720+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:57.815488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:58.748063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:03.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.093+0000 7f1fddfa9640 1 -- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1fc406ae70 msgr2=0x7f1fc406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.093+0000 7f1fddfa9640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1fc406ae70 0x7f1fc406d330 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8007fd0 tx=0x7f1fc8009040 comp rx=0 tx=0).stop 2023-11-04T01:39:03.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.093+0000 7f1fddfa9640 1 -- 172.21.15.44:0/3604494894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd8157540 msgr2=0x7f1fd815cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.093+0000 7f1fddfa9640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd8157540 0x7f1fd815cc50 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0009e50 tx=0x7f1fd0004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:03.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.093+0000 7f1fddfa9640 1 -- 172.21.15.44:0/3604494894 shutdown_connections 2023-11-04T01:39:03.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.093+0000 7f1fddfa9640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1fc406ae70 0x7f1fc406d330 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.093+0000 7f1fddfa9640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd8157540 0x7f1fd815cc50 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.093+0000 7f1fddfa9640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fd80ce240 0x7f1fd815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.093+0000 7f1fddfa9640 1 --2- 172.21.15.44:0/3604494894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1fd80cde60 0x7f1fd814c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.093+0000 7f1fddfa9640 1 -- 172.21.15.44:0/3604494894 >> 172.21.15.44:0/3604494894 conn(0x7f1fd8071f30 msgr2=0x7f1fd80d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.093+0000 7f1fddfa9640 1 -- 172.21.15.44:0/3604494894 shutdown_connections 2023-11-04T01:39:03.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.093+0000 7f1fddfa9640 1 -- 172.21.15.44:0/3604494894 wait complete. 2023-11-04T01:39:03.106 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:39:03.106 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:39:03.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.210+0000 7f045c47c640 1 Processor -- start 2023-11-04T01:39:03.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.210+0000 7f045c47c640 1 -- start start 2023-11-04T01:39:03.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f045c47c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f045415ae40 0x7f045415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f045c47c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04540cda30 0x7f04540ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f045c47c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04540cc450 con 0x7f04540cbc00 2023-11-04T01:39:03.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f045c47c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045415f400 con 0x7f04540cda30 2023-11-04T01:39:03.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f045c47c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045415b220 con 0x7f045415ae40 2023-11-04T01:39:03.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f045aa19640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04540cda30 0x7f04540ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f0459a17640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f04540cbc00 0x7f04540cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59714/0 (socket says 172.21.15.44:59714) 2023-11-04T01:39:03.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f045aa19640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04540cda30 0x7f04540ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55304/0 (socket says 172.21.15.44:55304) 2023-11-04T01:39:03.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f0459a17640 1 -- 172.21.15.44:0/3994377551 learned_addr learned my addr 172.21.15.44:0/3994377551 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:03.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f045a218640 1 --2- 172.21.15.44:0/3994377551 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f045415ae40 0x7f045415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f045aa19640 1 -- 172.21.15.44:0/3994377551 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f045415ae40 msgr2=0x7f045415bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:03.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f045aa19640 1 --2- 172.21.15.44:0/3994377551 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f045415ae40 0x7f045415bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f045aa19640 1 -- 172.21.15.44:0/3994377551 >> v1:172.21.15.44:6789/0 conn(0x7f04540cbc00 legacy=0x7f04540cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f045aa19640 1 -- 172.21.15.44:0/3994377551 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045415f890 con 0x7f04540cda30 2023-11-04T01:39:03.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f0459216640 1 -- 172.21.15.44:0/3994377551 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958841060 0 0) 0x7f0448001110 con 0x7f04540cbc00 2023-11-04T01:39:03.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.211+0000 7f045a218640 1 --2- 172.21.15.44:0/3994377551 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f045415ae40 0x7f045415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:03.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.212+0000 7f045aa19640 1 --2- 172.21.15.44:0/3994377551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04540cda30 0x7f04540ced70 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0444009d90 tx=0x7f044402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82986ae03ec1d640 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.212+0000 7f0459216640 1 -- 172.21.15.44:0/3994377551 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044402cc50 con 0x7f04540cda30 2023-11-04T01:39:03.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.212+0000 7f0459216640 1 -- 172.21.15.44:0/3994377551 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044402cdb0 con 0x7f04540cda30 2023-11-04T01:39:03.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.212+0000 7f0459216640 1 -- 172.21.15.44:0/3994377551 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444034660 con 0x7f04540cda30 2023-11-04T01:39:03.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.213+0000 7f045c47c640 1 -- 172.21.15.44:0/3994377551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04540cda30 msgr2=0x7f04540ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.213+0000 7f045c47c640 1 --2- 172.21.15.44:0/3994377551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04540cda30 0x7f04540ced70 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0444009d90 tx=0x7f044402bea0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.213+0000 7f045c47c640 1 -- 172.21.15.44:0/3994377551 shutdown_connections 2023-11-04T01:39:03.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.213+0000 7f045c47c640 1 --2- 172.21.15.44:0/3994377551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04540cda30 0x7f04540ced70 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.213+0000 7f045c47c640 1 --2- 172.21.15.44:0/3994377551 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f045415ae40 0x7f045415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.219 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.213+0000 7f045c47c640 1 -- 172.21.15.44:0/3994377551 >> 172.21.15.44:0/3994377551 conn(0x7f045406ea90 msgr2=0x7f045406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.213+0000 7f045c47c640 1 -- 172.21.15.44:0/3994377551 shutdown_connections 2023-11-04T01:39:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.213+0000 7f045c47c640 1 -- 172.21.15.44:0/3994377551 wait complete. 2023-11-04T01:39:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.214+0000 7f045c47c640 1 Processor -- start 2023-11-04T01:39:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.214+0000 7f045c47c640 1 -- start start 2023-11-04T01:39:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f045c47c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04540cbc00 0x7f04541f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f045c47c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04540cda30 0x7f045406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f045c47c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f045415ae40 0x7f04540c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f045c47c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04541f3000 con 0x7f045415ae40 2023-11-04T01:39:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f045c47c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04540c7320 con 0x7f04540cbc00 2023-11-04T01:39:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f045c47c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04540c4fd0 con 0x7f04540cda30 2023-11-04T01:39:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f045aa19640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f045415ae40 0x7f04540c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f045aa19640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f045415ae40 0x7f04540c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55306/0 (socket says 172.21.15.44:55306) 2023-11-04T01:39:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f045aa19640 1 -- 172.21.15.44:0/2796619881 learned_addr learned my addr 172.21.15.44:0/2796619881 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f0459a17640 1 --2- 172.21.15.44:0/2796619881 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04540cda30 0x7f045406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f045a218640 1 --2- 172.21.15.44:0/2796619881 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04540cbc00 0x7f04541f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f045aa19640 1 -- 172.21.15.44:0/2796619881 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04540cda30 msgr2=0x7f045406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f045aa19640 1 --2- 172.21.15.44:0/2796619881 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04540cda30 0x7f045406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f045aa19640 1 -- 172.21.15.44:0/2796619881 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04540cbc00 msgr2=0x7f04541f2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f045aa19640 1 --2- 172.21.15.44:0/2796619881 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04540cbc00 0x7f04541f2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.215+0000 7f045aa19640 1 -- 172.21.15.44:0/2796619881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0444009a70 con 0x7f045415ae40 2023-11-04T01:39:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.216+0000 7f045aa19640 1 --2- 172.21.15.44:0/2796619881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f045415ae40 0x7f04540c99e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f0444009d90 tx=0x7f0444004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.216+0000 7f0452ffd640 1 -- 172.21.15.44:0/2796619881 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444040650 con 0x7f045415ae40 2023-11-04T01:39:03.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.216+0000 7f0452ffd640 1 -- 172.21.15.44:0/2796619881 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04440407d0 con 0x7f045415ae40 2023-11-04T01:39:03.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.216+0000 7f045c47c640 1 -- 172.21.15.44:0/2796619881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04540c52b0 con 0x7f045415ae40 2023-11-04T01:39:03.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.216+0000 7f0452ffd640 1 -- 172.21.15.44:0/2796619881 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444040b80 con 0x7f045415ae40 2023-11-04T01:39:03.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.216+0000 7f045c47c640 1 -- 172.21.15.44:0/2796619881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04540c5870 con 0x7f045415ae40 2023-11-04T01:39:03.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.217+0000 7f045c47c640 1 -- 172.21.15.44:0/2796619881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04540ce2d0 con 0x7f045415ae40 2023-11-04T01:39:03.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.217+0000 7f0452ffd640 1 -- 172.21.15.44:0/2796619881 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0444040ce0 con 0x7f045415ae40 2023-11-04T01:39:03.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.218+0000 7f0452ffd640 1 --2- 172.21.15.44:0/2796619881 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f044006ae70 0x7f044006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.218+0000 7f0452ffd640 1 -- 172.21.15.44:0/2796619881 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f04440ac9e0 con 0x7f045415ae40 2023-11-04T01:39:03.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.218+0000 7f045a218640 1 --2- 172.21.15.44:0/2796619881 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f044006ae70 0x7f044006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.218+0000 7f045a218640 1 --2- 172.21.15.44:0/2796619881 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f044006ae70 0x7f044006d330 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f044c00a950 tx=0x7f044c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.222+0000 7f0452ffd640 1 -- 172.21.15.44:0/2796619881 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0444077520 con 0x7f045415ae40 2023-11-04T01:39:03.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.395+0000 7f045c47c640 1 -- 172.21.15.44:0/2796619881 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f045415edb0 con 0x7f044006ae70 2023-11-04T01:39:03.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.409+0000 7f0452ffd640 1 -- 172.21.15.44:0/2796619881 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+532239 (secure 0 0 0) 0x7f044c00c050 con 0x7f044006ae70 2023-11-04T01:39:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:03.420 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:39:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.413+0000 7f045c47c640 1 -- 172.21.15.44:0/2796619881 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f044006ae70 msgr2=0x7f044006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.413+0000 7f045c47c640 1 --2- 172.21.15.44:0/2796619881 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f044006ae70 0x7f044006d330 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f044c00a950 tx=0x7f044c008040 comp rx=0 tx=0).stop 2023-11-04T01:39:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.413+0000 7f045c47c640 1 -- 172.21.15.44:0/2796619881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f045415ae40 msgr2=0x7f04540c99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.413+0000 7f045c47c640 1 --2- 172.21.15.44:0/2796619881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f045415ae40 0x7f04540c99e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f0444009d90 tx=0x7f0444004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.413+0000 7f045c47c640 1 -- 172.21.15.44:0/2796619881 shutdown_connections 2023-11-04T01:39:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.413+0000 7f045c47c640 1 --2- 172.21.15.44:0/2796619881 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f044006ae70 0x7f044006d330 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.413+0000 7f045c47c640 1 --2- 172.21.15.44:0/2796619881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f045415ae40 0x7f04540c99e0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.413+0000 7f045c47c640 1 --2- 172.21.15.44:0/2796619881 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04540cda30 0x7f045406c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.413+0000 7f045c47c640 1 --2- 172.21.15.44:0/2796619881 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04540cbc00 0x7f04541f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.413+0000 7f045c47c640 1 -- 172.21.15.44:0/2796619881 >> 172.21.15.44:0/2796619881 conn(0x7f045406ea90 msgr2=0x7f0454072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.413+0000 7f045c47c640 1 -- 172.21.15.44:0/2796619881 shutdown_connections 2023-11-04T01:39:03.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.413+0000 7f045c47c640 1 -- 172.21.15.44:0/2796619881 wait complete. 2023-11-04T01:39:03.426 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2023-11-04T01:39:02.620152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242004,"kb_used_data":9168,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754732716,"statfs":{"total":773094113280,"available":772846301184,"internally_reserved":0,"allocated":9388032,"data_stored":5135460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.224866"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.428223+0000","last_change":"2023-11-04T01:39:00.424498+0000","last_active":"2023-11-04T01:39:00.428223+0000","last_peered":"2023-11-04T01:39:00.428223+0000","last_clean":"2023-11-04T01:39:00.428223+0000","last_became_active":"2023-11-04T01:39:00.424185+0000","last_became_peered":"2023-11-04T01:39:00.424185+0000","last_unstale":"2023-11-04T01:39:00.428223+0000","last_undegraded":"2023-11-04T01:39:00.428223+0000","last_fullsized":"2023-11-04T01:39:00.428223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:42.248048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431186+0000","last_change":"2023-11-04T01:39:00.424793+0000","last_active":"2023-11-04T01:39:00.431186+0000","last_peered":"2023-11-04T01:39:00.431186+0000","last_clean":"2023-11-04T01:39:00.431186+0000","last_became_active":"2023-11-04T01:39:00.424510+0000","last_became_peered":"2023-11-04T01:39:00.424510+0000","last_unstale":"2023-11-04T01:39:00.431186+0000","last_undegraded":"2023-11-04T01:39:00.431186+0000","last_fullsized":"2023-11-04T01:39:00.431186+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:51:07.158686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.425265+0000","last_change":"2023-11-04T01:39:00.423018+0000","last_active":"2023-11-04T01:39:00.425265+0000","last_peered":"2023-11-04T01:39:00.425265+0000","last_clean":"2023-11-04T01:39:00.425265+0000","last_became_active":"2023-11-04T01:39:00.422718+0000","last_became_peered":"2023-11-04T01:39:00.422718+0000","last_unstale":"2023-11-04T01:39:00.425265+0000","last_undegraded":"2023-11-04T01:39:00.425265+0000","last_fullsized":"2023-11-04T01:39:00.425265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:44.319812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420609+0000","last_change":"2023-11-04T01:39:00.438628+0000","last_active":"2023-11-04T01:39:01.420609+0000","last_peered":"2023-11-04T01:39:01.420609+0000","last_clean":"2023-11-04T01:39:01.420609+0000","last_became_active":"2023-11-04T01:39:00.438362+0000","last_became_peered":"2023-11-04T01:39:00.438362+0000","last_unstale":"2023-11-04T01:39:01.420609+0000","last_undegraded":"2023-11-04T01:39:01.420609+0000","last_fullsized":"2023-11-04T01:39:01.420609+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:37.854987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.419834+0000","last_change":"2023-11-04T01:39:00.417653+0000","last_active":"2023-11-04T01:39:00.419834+0000","last_peered":"2023-11-04T01:39:00.419834+0000","last_clean":"2023-11-04T01:39:00.419834+0000","last_became_active":"2023-11-04T01:39:00.416907+0000","last_became_peered":"2023-11-04T01:39:00.416907+0000","last_unstale":"2023-11-04T01:39:00.419834+0000","last_undegraded":"2023-11-04T01:39:00.419834+0000","last_fullsized":"2023-11-04T01:39:00.419834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:23.696731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421571+0000","last_change":"2023-11-04T01:39:00.420998+0000","last_active":"2023-11-04T01:39:01.421571+0000","last_peered":"2023-11-04T01:39:01.421571+0000","last_clean":"2023-11-04T01:39:01.421571+0000","last_became_active":"2023-11-04T01:39:00.420212+0000","last_became_peered":"2023-11-04T01:39:00.420212+0000","last_unstale":"2023-11-04T01:39:01.421571+0000","last_undegraded":"2023-11-04T01:39:01.421571+0000","last_fullsized":"2023-11-04T01:39:01.421571+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:14.222198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421147+0000","last_change":"2023-11-04T01:39:00.420579+0000","last_active":"2023-11-04T01:39:01.421147+0000","last_peered":"2023-11-04T01:39:01.421147+0000","last_clean":"2023-11-04T01:39:01.421147+0000","last_became_active":"2023-11-04T01:39:00.420286+0000","last_became_peered":"2023-11-04T01:39:00.420286+0000","last_unstale":"2023-11-04T01:39:01.421147+0000","last_undegraded":"2023-11-04T01:39:01.421147+0000","last_fullsized":"2023-11-04T01:39:01.421147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:30.348064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431203+0000","last_change":"2023-11-04T01:39:00.424116+0000","last_active":"2023-11-04T01:39:00.431203+0000","last_peered":"2023-11-04T01:39:00.431203+0000","last_clean":"2023-11-04T01:39:00.431203+0000","last_became_active":"2023-11-04T01:39:00.423548+0000","last_became_peered":"2023-11-04T01:39:00.423548+0000","last_unstale":"2023-11-04T01:39:00.431203+0000","last_undegraded":"2023-11-04T01:39:00.431203+0000","last_fullsized":"2023-11-04T01:39:00.431203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:30.348064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429408+0000","last_change":"2023-11-04T01:39:00.422536+0000","last_active":"2023-11-04T01:39:00.429408+0000","last_peered":"2023-11-04T01:39:00.429408+0000","last_clean":"2023-11-04T01:39:00.429408+0000","last_became_active":"2023-11-04T01:39:00.422203+0000","last_became_peered":"2023-11-04T01:39:00.422203+0000","last_unstale":"2023-11-04T01:39:00.429408+0000","last_undegraded":"2023-11-04T01:39:00.429408+0000","last_fullsized":"2023-11-04T01:39:00.429408+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:41:47.794169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439176+0000","last_change":"2023-11-04T01:39:00.434982+0000","last_active":"2023-11-04T01:39:00.439176+0000","last_peered":"2023-11-04T01:39:00.439176+0000","last_clean":"2023-11-04T01:39:00.439176+0000","last_became_active":"2023-11-04T01:39:00.434745+0000","last_became_peered":"2023-11-04T01:39:00.434745+0000","last_unstale":"2023-11-04T01:39:00.439176+0000","last_undegraded":"2023-11-04T01:39:00.439176+0000","last_fullsized":"2023-11-04T01:39:00.439176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:59.848826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421585+0000","last_change":"2023-11-04T01:39:00.423795+0000","last_active":"2023-11-04T01:39:01.421585+0000","last_peered":"2023-11-04T01:39:01.421585+0000","last_clean":"2023-11-04T01:39:01.421585+0000","last_became_active":"2023-11-04T01:39:00.423296+0000","last_became_peered":"2023-11-04T01:39:00.423296+0000","last_unstale":"2023-11-04T01:39:01.421585+0000","last_undegraded":"2023-11-04T01:39:01.421585+0000","last_fullsized":"2023-11-04T01:39:01.421585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:08.909292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439466+0000","last_change":"2023-11-04T01:39:00.435239+0000","last_active":"2023-11-04T01:39:00.439466+0000","last_peered":"2023-11-04T01:39:00.439466+0000","last_clean":"2023-11-04T01:39:00.439466+0000","last_became_active":"2023-11-04T01:39:00.434975+0000","last_became_peered":"2023-11-04T01:39:00.434975+0000","last_unstale":"2023-11-04T01:39:00.439466+0000","last_undegraded":"2023-11-04T01:39:00.439466+0000","last_fullsized":"2023-11-04T01:39:00.439466+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:57:38.121294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420546+0000","last_change":"2023-11-04T01:39:00.417655+0000","last_active":"2023-11-04T01:39:01.420546+0000","last_peered":"2023-11-04T01:39:01.420546+0000","last_clean":"2023-11-04T01:39:01.420546+0000","last_became_active":"2023-11-04T01:39:00.417371+0000","last_became_peered":"2023-11-04T01:39:00.417371+0000","last_unstale":"2023-11-04T01:39:01.420546+0000","last_undegraded":"2023-11-04T01:39:01.420546+0000","last_fullsized":"2023-11-04T01:39:01.420546+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:35.272381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422010+0000","last_change":"2023-11-04T01:39:00.437659+0000","last_active":"2023-11-04T01:39:01.422010+0000","last_peered":"2023-11-04T01:39:01.422010+0000","last_clean":"2023-11-04T01:39:01.422010+0000","last_became_active":"2023-11-04T01:39:00.437338+0000","last_became_peered":"2023-11-04T01:39:00.437338+0000","last_unstale":"2023-11-04T01:39:01.422010+0000","last_undegraded":"2023-11-04T01:39:01.422010+0000","last_fullsized":"2023-11-04T01:39:01.422010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:57.265727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420136+0000","last_change":"2023-11-04T01:39:00.420616+0000","last_active":"2023-11-04T01:39:01.420136+0000","last_peered":"2023-11-04T01:39:01.420136+0000","last_clean":"2023-11-04T01:39:01.420136+0000","last_became_active":"2023-11-04T01:39:00.420347+0000","last_became_peered":"2023-11-04T01:39:00.420347+0000","last_unstale":"2023-11-04T01:39:01.420136+0000","last_undegraded":"2023-11-04T01:39:01.420136+0000","last_fullsized":"2023-11-04T01:39:01.420136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:14.222198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421025+0000","last_change":"2023-11-04T01:39:00.428234+0000","last_active":"2023-11-04T01:39:01.421025+0000","last_peered":"2023-11-04T01:39:01.421025+0000","last_clean":"2023-11-04T01:39:01.421025+0000","last_became_active":"2023-11-04T01:39:00.427960+0000","last_became_peered":"2023-11-04T01:39:00.427960+0000","last_unstale":"2023-11-04T01:39:01.421025+0000","last_undegraded":"2023-11-04T01:39:01.421025+0000","last_fullsized":"2023-11-04T01:39:01.421025+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:05:48.460556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431166+0000","last_change":"2023-11-04T01:39:00.425258+0000","last_active":"2023-11-04T01:39:00.431166+0000","last_peered":"2023-11-04T01:39:00.431166+0000","last_clean":"2023-11-04T01:39:00.431166+0000","last_became_active":"2023-11-04T01:39:00.424904+0000","last_became_peered":"2023-11-04T01:39:00.424904+0000","last_unstale":"2023-11-04T01:39:00.431166+0000","last_undegraded":"2023-11-04T01:39:00.431166+0000","last_fullsized":"2023-11-04T01:39:00.431166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:57.706472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420608+0000","last_change":"2023-11-04T01:39:00.439726+0000","last_active":"2023-11-04T01:39:01.420608+0000","last_peered":"2023-11-04T01:39:01.420608+0000","last_clean":"2023-11-04T01:39:01.420608+0000","last_became_active":"2023-11-04T01:39:00.439400+0000","last_became_peered":"2023-11-04T01:39:00.439400+0000","last_unstale":"2023-11-04T01:39:01.420608+0000","last_undegraded":"2023-11-04T01:39:01.420608+0000","last_fullsized":"2023-11-04T01:39:01.420608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:36.514256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422517+0000","last_change":"2023-11-04T01:39:00.441280+0000","last_active":"2023-11-04T01:39:01.422517+0000","last_peered":"2023-11-04T01:39:01.422517+0000","last_clean":"2023-11-04T01:39:01.422517+0000","last_became_active":"2023-11-04T01:39:00.441011+0000","last_became_peered":"2023-11-04T01:39:00.441011+0000","last_unstale":"2023-11-04T01:39:01.422517+0000","last_undegraded":"2023-11-04T01:39:01.422517+0000","last_fullsized":"2023-11-04T01:39:01.422517+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:53.244184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429245+0000","last_change":"2023-11-04T01:39:00.424806+0000","last_active":"2023-11-04T01:39:00.429245+0000","last_peered":"2023-11-04T01:39:00.429245+0000","last_clean":"2023-11-04T01:39:00.429245+0000","last_became_active":"2023-11-04T01:39:00.423582+0000","last_became_peered":"2023-11-04T01:39:00.423582+0000","last_unstale":"2023-11-04T01:39:00.429245+0000","last_undegraded":"2023-11-04T01:39:00.429245+0000","last_fullsized":"2023-11-04T01:39:00.429245+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:49:23.027369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422163+0000","last_change":"2023-11-04T01:39:00.433180+0000","last_active":"2023-11-04T01:39:01.422163+0000","last_peered":"2023-11-04T01:39:01.422163+0000","last_clean":"2023-11-04T01:39:01.422163+0000","last_became_active":"2023-11-04T01:39:00.432845+0000","last_became_peered":"2023-11-04T01:39:00.432845+0000","last_unstale":"2023-11-04T01:39:01.422163+0000","last_undegraded":"2023-11-04T01:39:01.422163+0000","last_fullsized":"2023-11-04T01:39:01.422163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:25:06.334795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.430977+0000","last_change":"2023-11-04T01:39:00.424498+0000","last_active":"2023-11-04T01:39:00.430977+0000","last_peered":"2023-11-04T01:39:00.430977+0000","last_clean":"2023-11-04T01:39:00.430977+0000","last_became_active":"2023-11-04T01:39:00.424196+0000","last_became_peered":"2023-11-04T01:39:00.424196+0000","last_unstale":"2023-11-04T01:39:00.430977+0000","last_undegraded":"2023-11-04T01:39:00.430977+0000","last_fullsized":"2023-11-04T01:39:00.430977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:36.514256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.430446+0000","last_change":"2023-11-04T01:39:00.423607+0000","last_active":"2023-11-04T01:39:00.430446+0000","last_peered":"2023-11-04T01:39:00.430446+0000","last_clean":"2023-11-04T01:39:00.430446+0000","last_became_active":"2023-11-04T01:39:00.423295+0000","last_became_peered":"2023-11-04T01:39:00.423295+0000","last_unstale":"2023-11-04T01:39:00.430446+0000","last_undegraded":"2023-11-04T01:39:00.430446+0000","last_fullsized":"2023-11-04T01:39:00.430446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:05:48.460556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421197+0000","last_change":"2023-11-04T01:39:00.430809+0000","last_active":"2023-11-04T01:39:01.421197+0000","last_peered":"2023-11-04T01:39:01.421197+0000","last_clean":"2023-11-04T01:39:01.421197+0000","last_became_active":"2023-11-04T01:39:00.430492+0000","last_became_peered":"2023-11-04T01:39:00.430492+0000","last_unstale":"2023-11-04T01:39:01.421197+0000","last_undegraded":"2023-11-04T01:39:01.421197+0000","last_fullsized":"2023-11-04T01:39:01.421197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:57.706472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431484+0000","last_change":"2023-11-04T01:39:00.427038+0000","last_active":"2023-11-04T01:39:00.431484+0000","last_peered":"2023-11-04T01:39:00.431484+0000","last_clean":"2023-11-04T01:39:00.431484+0000","last_became_active":"2023-11-04T01:39:00.426575+0000","last_became_peered":"2023-11-04T01:39:00.426575+0000","last_unstale":"2023-11-04T01:39:00.431484+0000","last_undegraded":"2023-11-04T01:39:00.431484+0000","last_fullsized":"2023-11-04T01:39:00.431484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:14:45.191864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431223+0000","last_change":"2023-11-04T01:39:00.427457+0000","last_active":"2023-11-04T01:39:00.431223+0000","last_peered":"2023-11-04T01:39:00.431223+0000","last_clean":"2023-11-04T01:39:00.431223+0000","last_became_active":"2023-11-04T01:39:00.427180+0000","last_became_peered":"2023-11-04T01:39:00.427180+0000","last_unstale":"2023-11-04T01:39:00.431223+0000","last_undegraded":"2023-11-04T01:39:00.431223+0000","last_fullsized":"2023-11-04T01:39:00.431223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:34.227542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421720+0000","last_change":"2023-11-04T01:39:00.434480+0000","last_active":"2023-11-04T01:39:01.421720+0000","last_peered":"2023-11-04T01:39:01.421720+0000","last_clean":"2023-11-04T01:39:01.421720+0000","last_became_active":"2023-11-04T01:39:00.434205+0000","last_became_peered":"2023-11-04T01:39:00.434205+0000","last_unstale":"2023-11-04T01:39:01.421720+0000","last_undegraded":"2023-11-04T01:39:01.421720+0000","last_fullsized":"2023-11-04T01:39:01.421720+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:37.854987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.420089+0000","last_change":"2023-11-04T01:39:00.417968+0000","last_active":"2023-11-04T01:39:00.420089+0000","last_peered":"2023-11-04T01:39:00.420089+0000","last_clean":"2023-11-04T01:39:00.420089+0000","last_became_active":"2023-11-04T01:39:00.417671+0000","last_became_peered":"2023-11-04T01:39:00.417671+0000","last_unstale":"2023-11-04T01:39:00.420089+0000","last_undegraded":"2023-11-04T01:39:00.420089+0000","last_fullsized":"2023-11-04T01:39:00.420089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:12.584632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431115+0000","last_change":"2023-11-04T01:39:00.427305+0000","last_active":"2023-11-04T01:39:00.431115+0000","last_peered":"2023-11-04T01:39:00.431115+0000","last_clean":"2023-11-04T01:39:00.431115+0000","last_became_active":"2023-11-04T01:39:00.426989+0000","last_became_peered":"2023-11-04T01:39:00.426989+0000","last_unstale":"2023-11-04T01:39:00.431115+0000","last_undegraded":"2023-11-04T01:39:00.431115+0000","last_fullsized":"2023-11-04T01:39:00.431115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:08.909292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422268+0000","last_change":"2023-11-04T01:39:00.441983+0000","last_active":"2023-11-04T01:39:01.422268+0000","last_peered":"2023-11-04T01:39:01.422268+0000","last_clean":"2023-11-04T01:39:01.422268+0000","last_became_active":"2023-11-04T01:39:00.441663+0000","last_became_peered":"2023-11-04T01:39:00.441663+0000","last_unstale":"2023-11-04T01:39:01.422268+0000","last_undegraded":"2023-11-04T01:39:01.422268+0000","last_fullsized":"2023-11-04T01:39:01.422268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:00:20.189226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420348+0000","last_change":"2023-11-04T01:39:00.418390+0000","last_active":"2023-11-04T01:39:01.420348+0000","last_peered":"2023-11-04T01:39:01.420348+0000","last_clean":"2023-11-04T01:39:01.420348+0000","last_became_active":"2023-11-04T01:39:00.418126+0000","last_became_peered":"2023-11-04T01:39:00.418126+0000","last_unstale":"2023-11-04T01:39:01.420348+0000","last_undegraded":"2023-11-04T01:39:01.420348+0000","last_fullsized":"2023-11-04T01:39:01.420348+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:08.909292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.432875+0000","last_change":"2023-11-04T01:39:00.428920+0000","last_active":"2023-11-04T01:39:00.432875+0000","last_peered":"2023-11-04T01:39:00.432875+0000","last_clean":"2023-11-04T01:39:00.432875+0000","last_became_active":"2023-11-04T01:39:00.428653+0000","last_became_peered":"2023-11-04T01:39:00.428653+0000","last_unstale":"2023-11-04T01:39:00.432875+0000","last_undegraded":"2023-11-04T01:39:00.432875+0000","last_fullsized":"2023-11-04T01:39:00.432875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:26:50.544152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421875+0000","last_change":"2023-11-04T01:39:00.427672+0000","last_active":"2023-11-04T01:39:01.421875+0000","last_peered":"2023-11-04T01:39:01.421875+0000","last_clean":"2023-11-04T01:39:01.421875+0000","last_became_active":"2023-11-04T01:39:00.427385+0000","last_became_peered":"2023-11-04T01:39:00.427385+0000","last_unstale":"2023-11-04T01:39:01.421875+0000","last_undegraded":"2023-11-04T01:39:01.421875+0000","last_fullsized":"2023-11-04T01:39:01.421875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:36.514256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"83'6","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.443582+0000","last_change":"2023-11-04T01:38:59.421177+0000","last_active":"2023-11-04T01:39:00.443582+0000","last_peered":"2023-11-04T01:39:00.443582+0000","last_clean":"2023-11-04T01:39:00.443582+0000","last_became_active":"2023-11-04T01:38:59.418001+0000","last_became_peered":"2023-11-04T01:38:59.418001+0000","last_unstale":"2023-11-04T01:39:00.443582+0000","last_undegraded":"2023-11-04T01:39:00.443582+0000","last_fullsized":"2023-11-04T01:39:00.443582+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:40.638512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.421083+0000","last_change":"2023-11-04T01:38:37.214290+0000","last_active":"2023-11-04T01:38:59.421083+0000","last_peered":"2023-11-04T01:38:59.421083+0000","last_clean":"2023-11-04T01:38:59.421083+0000","last_became_active":"2023-11-04T01:38:37.213993+0000","last_became_peered":"2023-11-04T01:38:37.213993+0000","last_unstale":"2023-11-04T01:38:59.421083+0000","last_undegraded":"2023-11-04T01:38:59.421083+0000","last_fullsized":"2023-11-04T01:38:59.421083+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:15:54.258509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.409761+0000","last_change":"2023-11-04T01:38:38.208281+0000","last_active":"2023-11-04T01:38:59.409761+0000","last_peered":"2023-11-04T01:38:59.409761+0000","last_clean":"2023-11-04T01:38:59.409761+0000","last_became_active":"2023-11-04T01:38:36.209307+0000","last_became_peered":"2023-11-04T01:38:36.209307+0000","last_unstale":"2023-11-04T01:38:59.409761+0000","last_undegraded":"2023-11-04T01:38:59.409761+0000","last_fullsized":"2023-11-04T01:38:59.409761+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:15:53.251943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072090299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.409942+0000","last_change":"2023-11-04T01:37:36.221026+0000","last_active":"2023-11-04T01:38:59.409942+0000","last_peered":"2023-11-04T01:38:59.409942+0000","last_clean":"2023-11-04T01:38:59.409942+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:38:59.409942+0000","last_undegraded":"2023-11-04T01:38:59.409942+0000","last_fullsized":"2023-11-04T01:38:59.409942+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067716399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431554+0000","last_change":"2023-11-04T01:39:00.426688+0000","last_active":"2023-11-04T01:39:00.431554+0000","last_peered":"2023-11-04T01:39:00.431554+0000","last_clean":"2023-11-04T01:39:00.431554+0000","last_became_active":"2023-11-04T01:39:00.426282+0000","last_became_peered":"2023-11-04T01:39:00.426282+0000","last_unstale":"2023-11-04T01:39:00.431554+0000","last_undegraded":"2023-11-04T01:39:00.431554+0000","last_fullsized":"2023-11-04T01:39:00.431554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:59.727129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"83'3","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422037+0000","last_change":"2023-11-04T01:38:59.422902+0000","last_active":"2023-11-04T01:39:01.422037+0000","last_peered":"2023-11-04T01:39:01.422037+0000","last_clean":"2023-11-04T01:39:01.422037+0000","last_became_active":"2023-11-04T01:38:59.422599+0000","last_became_peered":"2023-11-04T01:38:59.422599+0000","last_unstale":"2023-11-04T01:39:01.422037+0000","last_undegraded":"2023-11-04T01:39:01.422037+0000","last_fullsized":"2023-11-04T01:39:01.422037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:35.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.408179+0000","last_change":"2023-11-04T01:38:37.212669+0000","last_active":"2023-11-04T01:39:00.408179+0000","last_peered":"2023-11-04T01:39:00.408179+0000","last_clean":"2023-11-04T01:39:00.408179+0000","last_became_active":"2023-11-04T01:38:37.212373+0000","last_became_peered":"2023-11-04T01:38:37.212373+0000","last_unstale":"2023-11-04T01:39:00.408179+0000","last_undegraded":"2023-11-04T01:39:00.408179+0000","last_fullsized":"2023-11-04T01:39:00.408179+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:00.498355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411326+0000","last_change":"2023-11-04T01:38:38.208516+0000","last_active":"2023-11-04T01:38:59.411326+0000","last_peered":"2023-11-04T01:38:59.411326+0000","last_clean":"2023-11-04T01:38:59.411326+0000","last_became_active":"2023-11-04T01:38:36.216993+0000","last_became_peered":"2023-11-04T01:38:36.216993+0000","last_unstale":"2023-11-04T01:38:59.411326+0000","last_undegraded":"2023-11-04T01:38:59.411326+0000","last_fullsized":"2023-11-04T01:38:59.411326+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:26:26.339210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095343999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.421082+0000","last_change":"2023-11-04T01:37:36.229027+0000","last_active":"2023-11-04T01:38:59.421082+0000","last_peered":"2023-11-04T01:38:59.421082+0000","last_clean":"2023-11-04T01:38:59.421082+0000","last_became_active":"2023-11-04T01:37:35.218342+0000","last_became_peered":"2023-11-04T01:37:35.218342+0000","last_unstale":"2023-11-04T01:38:59.421082+0000","last_undegraded":"2023-11-04T01:38:59.421082+0000","last_fullsized":"2023-11-04T01:38:59.421082+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059666400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431664+0000","last_change":"2023-11-04T01:39:00.427443+0000","last_active":"2023-11-04T01:39:00.431664+0000","last_peered":"2023-11-04T01:39:00.431664+0000","last_clean":"2023-11-04T01:39:00.431664+0000","last_became_active":"2023-11-04T01:39:00.427106+0000","last_became_peered":"2023-11-04T01:39:00.427106+0000","last_unstale":"2023-11-04T01:39:00.431664+0000","last_undegraded":"2023-11-04T01:39:00.431664+0000","last_fullsized":"2023-11-04T01:39:00.431664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:43.900683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420692+0000","last_change":"2023-11-04T01:38:59.419968+0000","last_active":"2023-11-04T01:39:01.420692+0000","last_peered":"2023-11-04T01:39:01.420692+0000","last_clean":"2023-11-04T01:39:01.420692+0000","last_became_active":"2023-11-04T01:38:59.419701+0000","last_became_peered":"2023-11-04T01:38:59.419701+0000","last_unstale":"2023-11-04T01:39:01.420692+0000","last_undegraded":"2023-11-04T01:39:01.420692+0000","last_fullsized":"2023-11-04T01:39:01.420692+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:13.597141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.410966+0000","last_change":"2023-11-04T01:38:37.215194+0000","last_active":"2023-11-04T01:38:59.410966+0000","last_peered":"2023-11-04T01:38:59.410966+0000","last_clean":"2023-11-04T01:38:59.410966+0000","last_became_active":"2023-11-04T01:38:37.214889+0000","last_became_peered":"2023-11-04T01:38:37.214889+0000","last_unstale":"2023-11-04T01:38:59.410966+0000","last_undegraded":"2023-11-04T01:38:59.410966+0000","last_fullsized":"2023-11-04T01:38:59.410966+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:03:06.059941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.420900+0000","last_change":"2023-11-04T01:38:38.457859+0000","last_active":"2023-11-04T01:38:59.420900+0000","last_peered":"2023-11-04T01:38:59.420900+0000","last_clean":"2023-11-04T01:38:59.420900+0000","last_became_active":"2023-11-04T01:38:36.220887+0000","last_became_peered":"2023-11-04T01:38:36.220887+0000","last_unstale":"2023-11-04T01:38:59.420900+0000","last_undegraded":"2023-11-04T01:38:59.420900+0000","last_fullsized":"2023-11-04T01:38:59.420900+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:26:26.339210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072014699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411661+0000","last_change":"2023-11-04T01:37:36.222868+0000","last_active":"2023-11-04T01:38:59.411661+0000","last_peered":"2023-11-04T01:38:59.411661+0000","last_clean":"2023-11-04T01:38:59.411661+0000","last_became_active":"2023-11-04T01:37:35.220180+0000","last_became_peered":"2023-11-04T01:37:35.220180+0000","last_unstale":"2023-11-04T01:38:59.411661+0000","last_undegraded":"2023-11-04T01:38:59.411661+0000","last_fullsized":"2023-11-04T01:38:59.411661+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001103574,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.433760+0000","last_change":"2023-11-04T01:39:00.429365+0000","last_active":"2023-11-04T01:39:00.433760+0000","last_peered":"2023-11-04T01:39:00.433760+0000","last_clean":"2023-11-04T01:39:00.433760+0000","last_became_active":"2023-11-04T01:39:00.429019+0000","last_became_peered":"2023-11-04T01:39:00.429019+0000","last_unstale":"2023-11-04T01:39:00.433760+0000","last_undegraded":"2023-11-04T01:39:00.433760+0000","last_fullsized":"2023-11-04T01:39:00.433760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:47.417595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.412310+0000","last_change":"2023-11-04T01:38:59.426775+0000","last_active":"2023-11-04T01:39:00.412310+0000","last_peered":"2023-11-04T01:39:00.412310+0000","last_clean":"2023-11-04T01:39:00.412310+0000","last_became_active":"2023-11-04T01:38:59.426482+0000","last_became_peered":"2023-11-04T01:38:59.426482+0000","last_unstale":"2023-11-04T01:39:00.412310+0000","last_undegraded":"2023-11-04T01:39:00.412310+0000","last_fullsized":"2023-11-04T01:39:00.412310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:24.556798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404133+0000","last_change":"2023-11-04T01:38:37.213107+0000","last_active":"2023-11-04T01:38:59.404133+0000","last_peered":"2023-11-04T01:38:59.404133+0000","last_clean":"2023-11-04T01:38:59.404133+0000","last_became_active":"2023-11-04T01:38:37.212801+0000","last_became_peered":"2023-11-04T01:38:37.212801+0000","last_unstale":"2023-11-04T01:38:59.404133+0000","last_undegraded":"2023-11-04T01:38:59.404133+0000","last_fullsized":"2023-11-04T01:38:59.404133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:57:14.922918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.412279+0000","last_change":"2023-11-04T01:38:38.208125+0000","last_active":"2023-11-04T01:38:59.412279+0000","last_peered":"2023-11-04T01:38:59.412279+0000","last_clean":"2023-11-04T01:38:59.412279+0000","last_became_active":"2023-11-04T01:38:36.219549+0000","last_became_peered":"2023-11-04T01:38:36.219549+0000","last_unstale":"2023-11-04T01:38:59.412279+0000","last_undegraded":"2023-11-04T01:38:59.412279+0000","last_fullsized":"2023-11-04T01:38:59.412279+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:01.357137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769686,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411076+0000","last_change":"2023-11-04T01:37:36.221053+0000","last_active":"2023-11-04T01:38:59.411076+0000","last_peered":"2023-11-04T01:38:59.411076+0000","last_clean":"2023-11-04T01:38:59.411076+0000","last_became_active":"2023-11-04T01:37:35.227176+0000","last_became_peered":"2023-11-04T01:37:35.227176+0000","last_unstale":"2023-11-04T01:38:59.411076+0000","last_undegraded":"2023-11-04T01:38:59.411076+0000","last_fullsized":"2023-11-04T01:38:59.411076+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000594178,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421981+0000","last_change":"2023-11-04T01:39:00.430191+0000","last_active":"2023-11-04T01:39:01.421981+0000","last_peered":"2023-11-04T01:39:01.421981+0000","last_clean":"2023-11-04T01:39:01.421981+0000","last_became_active":"2023-11-04T01:39:00.429453+0000","last_became_peered":"2023-11-04T01:39:00.429453+0000","last_unstale":"2023-11-04T01:39:01.421981+0000","last_undegraded":"2023-11-04T01:39:01.421981+0000","last_fullsized":"2023-11-04T01:39:01.421981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:50.550892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"83'8","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.440471+0000","last_change":"2023-11-04T01:38:59.419630+0000","last_active":"2023-11-04T01:39:00.440471+0000","last_peered":"2023-11-04T01:39:00.440471+0000","last_clean":"2023-11-04T01:39:00.440471+0000","last_became_active":"2023-11-04T01:38:59.419359+0000","last_became_peered":"2023-11-04T01:38:59.419359+0000","last_unstale":"2023-11-04T01:39:00.440471+0000","last_undegraded":"2023-11-04T01:39:00.440471+0000","last_fullsized":"2023-11-04T01:39:00.440471+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:16.451603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.406903+0000","last_change":"2023-11-04T01:38:37.215477+0000","last_active":"2023-11-04T01:39:00.406903+0000","last_peered":"2023-11-04T01:39:00.406903+0000","last_clean":"2023-11-04T01:39:00.406903+0000","last_became_active":"2023-11-04T01:38:37.215166+0000","last_became_peered":"2023-11-04T01:38:37.215166+0000","last_unstale":"2023-11-04T01:39:00.406903+0000","last_undegraded":"2023-11-04T01:39:00.406903+0000","last_fullsized":"2023-11-04T01:39:00.406903+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:22.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407041+0000","last_change":"2023-11-04T01:38:38.636546+0000","last_active":"2023-11-04T01:39:00.407041+0000","last_peered":"2023-11-04T01:39:00.407041+0000","last_clean":"2023-11-04T01:39:00.407041+0000","last_became_active":"2023-11-04T01:38:36.224162+0000","last_became_peered":"2023-11-04T01:38:36.224162+0000","last_unstale":"2023-11-04T01:39:00.407041+0000","last_undegraded":"2023-11-04T01:39:00.407041+0000","last_fullsized":"2023-11-04T01:39:00.407041+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:17.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062552400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411356+0000","last_change":"2023-11-04T01:37:36.221842+0000","last_active":"2023-11-04T01:38:59.411356+0000","last_peered":"2023-11-04T01:38:59.411356+0000","last_clean":"2023-11-04T01:38:59.411356+0000","last_became_active":"2023-11-04T01:37:35.214305+0000","last_became_peered":"2023-11-04T01:37:35.214305+0000","last_unstale":"2023-11-04T01:38:59.411356+0000","last_undegraded":"2023-11-04T01:38:59.411356+0000","last_fullsized":"2023-11-04T01:38:59.411356+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:13:05.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014999690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429310+0000","last_change":"2023-11-04T01:39:00.422832+0000","last_active":"2023-11-04T01:39:00.429310+0000","last_peered":"2023-11-04T01:39:00.429310+0000","last_clean":"2023-11-04T01:39:00.429310+0000","last_became_active":"2023-11-04T01:39:00.422573+0000","last_became_peered":"2023-11-04T01:39:00.422573+0000","last_unstale":"2023-11-04T01:39:00.429310+0000","last_undegraded":"2023-11-04T01:39:00.429310+0000","last_fullsized":"2023-11-04T01:39:00.429310+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:54:37.955807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.414893+0000","last_change":"2023-11-04T01:38:59.421773+0000","last_active":"2023-11-04T01:39:00.414893+0000","last_peered":"2023-11-04T01:39:00.414893+0000","last_clean":"2023-11-04T01:39:00.414893+0000","last_became_active":"2023-11-04T01:38:59.421115+0000","last_became_peered":"2023-11-04T01:38:59.421115+0000","last_unstale":"2023-11-04T01:39:00.414893+0000","last_undegraded":"2023-11-04T01:39:00.414893+0000","last_fullsized":"2023-11-04T01:39:00.414893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:05.315814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.403588+0000","last_change":"2023-11-04T01:38:37.216543+0000","last_active":"2023-11-04T01:38:59.403588+0000","last_peered":"2023-11-04T01:38:59.403588+0000","last_clean":"2023-11-04T01:38:59.403588+0000","last_became_active":"2023-11-04T01:38:37.216259+0000","last_became_peered":"2023-11-04T01:38:37.216259+0000","last_unstale":"2023-11-04T01:38:59.403588+0000","last_undegraded":"2023-11-04T01:38:59.403588+0000","last_fullsized":"2023-11-04T01:38:59.403588+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:20.702307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.410542+0000","last_change":"2023-11-04T01:38:38.205278+0000","last_active":"2023-11-04T01:38:59.410542+0000","last_peered":"2023-11-04T01:38:59.410542+0000","last_clean":"2023-11-04T01:38:59.410542+0000","last_became_active":"2023-11-04T01:38:36.220833+0000","last_became_peered":"2023-11-04T01:38:36.220833+0000","last_unstale":"2023-11-04T01:38:59.410542+0000","last_undegraded":"2023-11-04T01:38:59.410542+0000","last_fullsized":"2023-11-04T01:38:59.410542+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:26.345951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065079199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.403526+0000","last_change":"2023-11-04T01:37:36.694601+0000","last_active":"2023-11-04T01:38:59.403526+0000","last_peered":"2023-11-04T01:38:59.403526+0000","last_clean":"2023-11-04T01:38:59.403526+0000","last_became_active":"2023-11-04T01:37:35.223746+0000","last_became_peered":"2023-11-04T01:37:35.223746+0000","last_unstale":"2023-11-04T01:38:59.403526+0000","last_undegraded":"2023-11-04T01:38:59.403526+0000","last_fullsized":"2023-11-04T01:38:59.403526+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:35.960485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000555376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439910+0000","last_change":"2023-11-04T01:39:00.438512+0000","last_active":"2023-11-04T01:39:00.439910+0000","last_peered":"2023-11-04T01:39:00.439910+0000","last_clean":"2023-11-04T01:39:00.439910+0000","last_became_active":"2023-11-04T01:39:00.438080+0000","last_became_peered":"2023-11-04T01:39:00.438080+0000","last_unstale":"2023-11-04T01:39:00.439910+0000","last_undegraded":"2023-11-04T01:39:00.439910+0000","last_fullsized":"2023-11-04T01:39:00.439910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:42:11.513720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422122+0000","last_change":"2023-11-04T01:38:59.426296+0000","last_active":"2023-11-04T01:39:01.422122+0000","last_peered":"2023-11-04T01:39:01.422122+0000","last_clean":"2023-11-04T01:39:01.422122+0000","last_became_active":"2023-11-04T01:38:59.425971+0000","last_became_peered":"2023-11-04T01:38:59.425971+0000","last_unstale":"2023-11-04T01:39:01.422122+0000","last_undegraded":"2023-11-04T01:39:01.422122+0000","last_fullsized":"2023-11-04T01:39:01.422122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:02.076280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.409559+0000","last_change":"2023-11-04T01:38:37.216913+0000","last_active":"2023-11-04T01:38:59.409559+0000","last_peered":"2023-11-04T01:38:59.409559+0000","last_clean":"2023-11-04T01:38:59.409559+0000","last_became_active":"2023-11-04T01:38:37.216657+0000","last_became_peered":"2023-11-04T01:38:37.216657+0000","last_unstale":"2023-11-04T01:38:59.409559+0000","last_undegraded":"2023-11-04T01:38:59.409559+0000","last_fullsized":"2023-11-04T01:38:59.409559+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:01:49.838705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.403421+0000","last_change":"2023-11-04T01:38:38.410908+0000","last_active":"2023-11-04T01:38:59.403421+0000","last_peered":"2023-11-04T01:38:59.403421+0000","last_clean":"2023-11-04T01:38:59.403421+0000","last_became_active":"2023-11-04T01:38:36.215279+0000","last_became_peered":"2023-11-04T01:38:36.215279+0000","last_unstale":"2023-11-04T01:38:59.403421+0000","last_undegraded":"2023-11-04T01:38:59.403421+0000","last_fullsized":"2023-11-04T01:38:59.403421+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:58.822427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067743000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404360+0000","last_change":"2023-11-04T01:37:36.695075+0000","last_active":"2023-11-04T01:38:59.404360+0000","last_peered":"2023-11-04T01:38:59.404360+0000","last_clean":"2023-11-04T01:38:59.404360+0000","last_became_active":"2023-11-04T01:37:35.221165+0000","last_became_peered":"2023-11-04T01:37:35.221165+0000","last_unstale":"2023-11-04T01:38:59.404360+0000","last_undegraded":"2023-11-04T01:38:59.404360+0000","last_fullsized":"2023-11-04T01:38:59.404360+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:17.958372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072817499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420757+0000","last_change":"2023-11-04T01:39:00.415473+0000","last_active":"2023-11-04T01:39:01.420757+0000","last_peered":"2023-11-04T01:39:01.420757+0000","last_clean":"2023-11-04T01:39:01.420757+0000","last_became_active":"2023-11-04T01:39:00.415174+0000","last_became_peered":"2023-11-04T01:39:00.415174+0000","last_unstale":"2023-11-04T01:39:01.420757+0000","last_undegraded":"2023-11-04T01:39:01.420757+0000","last_fullsized":"2023-11-04T01:39:01.420757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:01:16.581681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"83'2","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422262+0000","last_change":"2023-11-04T01:38:59.427272+0000","last_active":"2023-11-04T01:39:01.422262+0000","last_peered":"2023-11-04T01:39:01.422262+0000","last_clean":"2023-11-04T01:39:01.422262+0000","last_became_active":"2023-11-04T01:38:59.426804+0000","last_became_peered":"2023-11-04T01:38:59.426804+0000","last_unstale":"2023-11-04T01:39:01.422262+0000","last_undegraded":"2023-11-04T01:39:01.422262+0000","last_fullsized":"2023-11-04T01:39:01.422262+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:27.404923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.410113+0000","last_change":"2023-11-04T01:38:37.216633+0000","last_active":"2023-11-04T01:38:59.410113+0000","last_peered":"2023-11-04T01:38:59.410113+0000","last_clean":"2023-11-04T01:38:59.410113+0000","last_became_active":"2023-11-04T01:38:37.216349+0000","last_became_peered":"2023-11-04T01:38:37.216349+0000","last_unstale":"2023-11-04T01:38:59.410113+0000","last_undegraded":"2023-11-04T01:38:59.410113+0000","last_fullsized":"2023-11-04T01:38:59.410113+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:39.883185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.420487+0000","last_change":"2023-11-04T01:38:38.457913+0000","last_active":"2023-11-04T01:38:59.420487+0000","last_peered":"2023-11-04T01:38:59.420487+0000","last_clean":"2023-11-04T01:38:59.420487+0000","last_became_active":"2023-11-04T01:38:36.212852+0000","last_became_peered":"2023-11-04T01:38:36.212852+0000","last_unstale":"2023-11-04T01:38:59.420487+0000","last_undegraded":"2023-11-04T01:38:59.420487+0000","last_fullsized":"2023-11-04T01:38:59.420487+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:17.912252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048391299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413339+0000","last_change":"2023-11-04T01:37:36.221747+0000","last_active":"2023-11-04T01:38:59.413339+0000","last_peered":"2023-11-04T01:38:59.413339+0000","last_clean":"2023-11-04T01:38:59.413339+0000","last_became_active":"2023-11-04T01:37:35.223198+0000","last_became_peered":"2023-11-04T01:37:35.223198+0000","last_unstale":"2023-11-04T01:38:59.413339+0000","last_undegraded":"2023-11-04T01:38:59.413339+0000","last_fullsized":"2023-11-04T01:38:59.413339+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097726499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429314+0000","last_change":"2023-11-04T01:39:00.425919+0000","last_active":"2023-11-04T01:39:00.429314+0000","last_peered":"2023-11-04T01:39:00.429314+0000","last_clean":"2023-11-04T01:39:00.429314+0000","last_became_active":"2023-11-04T01:39:00.425588+0000","last_became_peered":"2023-11-04T01:39:00.425588+0000","last_unstale":"2023-11-04T01:39:00.429314+0000","last_undegraded":"2023-11-04T01:39:00.429314+0000","last_fullsized":"2023-11-04T01:39:00.429314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:26.999543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.434939+0000","last_change":"2023-11-04T01:38:59.417466+0000","last_active":"2023-11-04T01:39:00.434939+0000","last_peered":"2023-11-04T01:39:00.434939+0000","last_clean":"2023-11-04T01:39:00.434939+0000","last_became_active":"2023-11-04T01:38:59.417003+0000","last_became_peered":"2023-11-04T01:38:59.417003+0000","last_unstale":"2023-11-04T01:39:00.434939+0000","last_undegraded":"2023-11-04T01:39:00.434939+0000","last_fullsized":"2023-11-04T01:39:00.434939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:25.699719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411556+0000","last_change":"2023-11-04T01:38:37.215329+0000","last_active":"2023-11-04T01:38:59.411556+0000","last_peered":"2023-11-04T01:38:59.411556+0000","last_clean":"2023-11-04T01:38:59.411556+0000","last_became_active":"2023-11-04T01:38:37.215049+0000","last_became_peered":"2023-11-04T01:38:37.215049+0000","last_unstale":"2023-11-04T01:38:59.411556+0000","last_undegraded":"2023-11-04T01:38:59.411556+0000","last_fullsized":"2023-11-04T01:38:59.411556+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:22.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413001+0000","last_change":"2023-11-04T01:38:38.207112+0000","last_active":"2023-11-04T01:38:59.413001+0000","last_peered":"2023-11-04T01:38:59.413001+0000","last_clean":"2023-11-04T01:38:59.413001+0000","last_became_active":"2023-11-04T01:38:36.213142+0000","last_became_peered":"2023-11-04T01:38:36.213142+0000","last_unstale":"2023-11-04T01:38:59.413001+0000","last_undegraded":"2023-11-04T01:38:59.413001+0000","last_fullsized":"2023-11-04T01:38:59.413001+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:49.027502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069641099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.408223+0000","last_change":"2023-11-04T01:37:36.422496+0000","last_active":"2023-11-04T01:39:00.408223+0000","last_peered":"2023-11-04T01:39:00.408223+0000","last_clean":"2023-11-04T01:39:00.408223+0000","last_became_active":"2023-11-04T01:37:35.221763+0000","last_became_peered":"2023-11-04T01:37:35.221763+0000","last_unstale":"2023-11-04T01:39:00.408223+0000","last_undegraded":"2023-11-04T01:39:00.408223+0000","last_fullsized":"2023-11-04T01:39:00.408223+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073676299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439931+0000","last_change":"2023-11-04T01:39:00.438851+0000","last_active":"2023-11-04T01:39:00.439931+0000","last_peered":"2023-11-04T01:39:00.439931+0000","last_clean":"2023-11-04T01:39:00.439931+0000","last_became_active":"2023-11-04T01:39:00.438580+0000","last_became_peered":"2023-11-04T01:39:00.438580+0000","last_unstale":"2023-11-04T01:39:00.439931+0000","last_undegraded":"2023-11-04T01:39:00.439931+0000","last_fullsized":"2023-11-04T01:39:00.439931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:54:13.232443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.437514+0000","last_change":"2023-11-04T01:38:59.423503+0000","last_active":"2023-11-04T01:39:00.437514+0000","last_peered":"2023-11-04T01:39:00.437514+0000","last_clean":"2023-11-04T01:39:00.437514+0000","last_became_active":"2023-11-04T01:38:59.422981+0000","last_became_peered":"2023-11-04T01:38:59.422981+0000","last_unstale":"2023-11-04T01:39:00.437514+0000","last_undegraded":"2023-11-04T01:39:00.437514+0000","last_fullsized":"2023-11-04T01:39:00.437514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:18.773223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.412849+0000","last_change":"2023-11-04T01:38:37.217518+0000","last_active":"2023-11-04T01:38:59.412849+0000","last_peered":"2023-11-04T01:38:59.412849+0000","last_clean":"2023-11-04T01:38:59.412849+0000","last_became_active":"2023-11-04T01:38:37.216984+0000","last_became_peered":"2023-11-04T01:38:37.216984+0000","last_unstale":"2023-11-04T01:38:59.412849+0000","last_undegraded":"2023-11-04T01:38:59.412849+0000","last_fullsized":"2023-11-04T01:38:59.412849+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:55.276622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411245+0000","last_change":"2023-11-04T01:38:38.208679+0000","last_active":"2023-11-04T01:38:59.411245+0000","last_peered":"2023-11-04T01:38:59.411245+0000","last_clean":"2023-11-04T01:38:59.411245+0000","last_became_active":"2023-11-04T01:38:36.213713+0000","last_became_peered":"2023-11-04T01:38:36.213713+0000","last_unstale":"2023-11-04T01:38:59.411245+0000","last_undegraded":"2023-11-04T01:38:59.411245+0000","last_fullsized":"2023-11-04T01:38:59.411245+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:17.912252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099153900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407692+0000","last_change":"2023-11-04T01:37:36.229940+0000","last_active":"2023-11-04T01:39:00.407692+0000","last_peered":"2023-11-04T01:39:00.407692+0000","last_clean":"2023-11-04T01:39:00.407692+0000","last_became_active":"2023-11-04T01:37:35.225121+0000","last_became_peered":"2023-11-04T01:37:35.225121+0000","last_unstale":"2023-11-04T01:39:00.407692+0000","last_undegraded":"2023-11-04T01:39:00.407692+0000","last_fullsized":"2023-11-04T01:39:00.407692+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:12.130671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075648399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420709+0000","last_change":"2023-11-04T01:39:00.419753+0000","last_active":"2023-11-04T01:39:01.420709+0000","last_peered":"2023-11-04T01:39:01.420709+0000","last_clean":"2023-11-04T01:39:01.420709+0000","last_became_active":"2023-11-04T01:39:00.419504+0000","last_became_peered":"2023-11-04T01:39:00.419504+0000","last_unstale":"2023-11-04T01:39:01.420709+0000","last_undegraded":"2023-11-04T01:39:01.420709+0000","last_fullsized":"2023-11-04T01:39:01.420709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:19.778505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"83'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421845+0000","last_change":"2023-11-04T01:38:59.426128+0000","last_active":"2023-11-04T01:39:01.421845+0000","last_peered":"2023-11-04T01:39:01.421845+0000","last_clean":"2023-11-04T01:39:01.421845+0000","last_became_active":"2023-11-04T01:38:59.425839+0000","last_became_peered":"2023-11-04T01:38:59.425839+0000","last_unstale":"2023-11-04T01:39:01.421845+0000","last_undegraded":"2023-11-04T01:39:01.421845+0000","last_fullsized":"2023-11-04T01:39:01.421845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:58.721847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407956+0000","last_change":"2023-11-04T01:38:37.216659+0000","last_active":"2023-11-04T01:39:00.407956+0000","last_peered":"2023-11-04T01:39:00.407956+0000","last_clean":"2023-11-04T01:39:00.407956+0000","last_became_active":"2023-11-04T01:38:37.216367+0000","last_became_peered":"2023-11-04T01:38:37.216367+0000","last_unstale":"2023-11-04T01:39:00.407956+0000","last_undegraded":"2023-11-04T01:39:00.407956+0000","last_fullsized":"2023-11-04T01:39:00.407956+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:05:01.957845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404354+0000","last_change":"2023-11-04T01:38:38.411751+0000","last_active":"2023-11-04T01:38:59.404354+0000","last_peered":"2023-11-04T01:38:59.404354+0000","last_clean":"2023-11-04T01:38:59.404354+0000","last_became_active":"2023-11-04T01:38:36.220709+0000","last_became_peered":"2023-11-04T01:38:36.220709+0000","last_unstale":"2023-11-04T01:38:59.404354+0000","last_undegraded":"2023-11-04T01:38:59.404354+0000","last_fullsized":"2023-11-04T01:38:59.404354+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:17.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075331200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407425+0000","last_change":"2023-11-04T01:37:36.422801+0000","last_active":"2023-11-04T01:39:00.407425+0000","last_peered":"2023-11-04T01:39:00.407425+0000","last_clean":"2023-11-04T01:39:00.407425+0000","last_became_active":"2023-11-04T01:37:35.217091+0000","last_became_peered":"2023-11-04T01:37:35.217091+0000","last_unstale":"2023-11-04T01:39:00.407425+0000","last_undegraded":"2023-11-04T01:39:00.407425+0000","last_fullsized":"2023-11-04T01:39:00.407425+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082211999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422819+0000","last_change":"2023-11-04T01:39:00.432878+0000","last_active":"2023-11-04T01:39:01.422819+0000","last_peered":"2023-11-04T01:39:01.422819+0000","last_clean":"2023-11-04T01:39:01.422819+0000","last_became_active":"2023-11-04T01:39:00.432527+0000","last_became_peered":"2023-11-04T01:39:00.432527+0000","last_unstale":"2023-11-04T01:39:01.422819+0000","last_undegraded":"2023-11-04T01:39:01.422819+0000","last_fullsized":"2023-11-04T01:39:01.422819+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:57.421878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"83'4","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.433038+0000","last_change":"2023-11-04T01:38:59.418993+0000","last_active":"2023-11-04T01:39:00.433038+0000","last_peered":"2023-11-04T01:39:00.433038+0000","last_clean":"2023-11-04T01:39:00.433038+0000","last_became_active":"2023-11-04T01:38:59.418719+0000","last_became_peered":"2023-11-04T01:38:59.418719+0000","last_unstale":"2023-11-04T01:39:00.433038+0000","last_undegraded":"2023-11-04T01:39:00.433038+0000","last_fullsized":"2023-11-04T01:39:00.433038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:23.908584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413550+0000","last_change":"2023-11-04T01:38:37.218855+0000","last_active":"2023-11-04T01:38:59.413550+0000","last_peered":"2023-11-04T01:38:59.413550+0000","last_clean":"2023-11-04T01:38:59.413550+0000","last_became_active":"2023-11-04T01:38:37.218475+0000","last_became_peered":"2023-11-04T01:38:37.218475+0000","last_unstale":"2023-11-04T01:38:59.413550+0000","last_undegraded":"2023-11-04T01:38:59.413550+0000","last_fullsized":"2023-11-04T01:38:59.413550+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:36.735726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404958+0000","last_change":"2023-11-04T01:38:38.411851+0000","last_active":"2023-11-04T01:38:59.404958+0000","last_peered":"2023-11-04T01:38:59.404958+0000","last_clean":"2023-11-04T01:38:59.404958+0000","last_became_active":"2023-11-04T01:38:36.220767+0000","last_became_peered":"2023-11-04T01:38:36.220767+0000","last_unstale":"2023-11-04T01:38:59.404958+0000","last_undegraded":"2023-11-04T01:38:59.404958+0000","last_fullsized":"2023-11-04T01:38:59.404958+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:42.712180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010894240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413114+0000","last_change":"2023-11-04T01:37:36.222683+0000","last_active":"2023-11-04T01:38:59.413114+0000","last_peered":"2023-11-04T01:38:59.413114+0000","last_clean":"2023-11-04T01:38:59.413114+0000","last_became_active":"2023-11-04T01:37:35.222694+0000","last_became_peered":"2023-11-04T01:37:35.222694+0000","last_unstale":"2023-11-04T01:38:59.413114+0000","last_undegraded":"2023-11-04T01:38:59.413114+0000","last_fullsized":"2023-11-04T01:38:59.413114+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000490194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429535+0000","last_change":"2023-11-04T01:39:00.425421+0000","last_active":"2023-11-04T01:39:00.429535+0000","last_peered":"2023-11-04T01:39:00.429535+0000","last_clean":"2023-11-04T01:39:00.429535+0000","last_became_active":"2023-11-04T01:39:00.424898+0000","last_became_peered":"2023-11-04T01:39:00.424898+0000","last_unstale":"2023-11-04T01:39:00.429535+0000","last_undegraded":"2023-11-04T01:39:00.429535+0000","last_fullsized":"2023-11-04T01:39:00.429535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:36.960488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.413655+0000","last_change":"2023-11-04T01:38:59.416958+0000","last_active":"2023-11-04T01:39:00.413655+0000","last_peered":"2023-11-04T01:39:00.413655+0000","last_clean":"2023-11-04T01:39:00.413655+0000","last_became_active":"2023-11-04T01:38:59.416663+0000","last_became_peered":"2023-11-04T01:38:59.416663+0000","last_unstale":"2023-11-04T01:39:00.413655+0000","last_undegraded":"2023-11-04T01:39:00.413655+0000","last_fullsized":"2023-11-04T01:39:00.413655+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:41.111912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.409811+0000","last_change":"2023-11-04T01:38:37.210833+0000","last_active":"2023-11-04T01:38:59.409811+0000","last_peered":"2023-11-04T01:38:59.409811+0000","last_clean":"2023-11-04T01:38:59.409811+0000","last_became_active":"2023-11-04T01:38:37.210565+0000","last_became_peered":"2023-11-04T01:38:37.210565+0000","last_unstale":"2023-11-04T01:38:59.409811+0000","last_undegraded":"2023-11-04T01:38:59.409811+0000","last_fullsized":"2023-11-04T01:38:59.409811+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:14:41.863734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413196+0000","last_change":"2023-11-04T01:38:38.206088+0000","last_active":"2023-11-04T01:38:59.413196+0000","last_peered":"2023-11-04T01:38:59.413196+0000","last_clean":"2023-11-04T01:38:59.413196+0000","last_became_active":"2023-11-04T01:38:36.220921+0000","last_became_peered":"2023-11-04T01:38:36.220921+0000","last_unstale":"2023-11-04T01:38:59.413196+0000","last_undegraded":"2023-11-04T01:38:59.413196+0000","last_fullsized":"2023-11-04T01:38:59.413196+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:33.216936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091997800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407249+0000","last_change":"2023-11-04T01:37:36.422156+0000","last_active":"2023-11-04T01:39:00.407249+0000","last_peered":"2023-11-04T01:39:00.407249+0000","last_clean":"2023-11-04T01:39:00.407249+0000","last_became_active":"2023-11-04T01:37:35.214925+0000","last_became_peered":"2023-11-04T01:37:35.214925+0000","last_unstale":"2023-11-04T01:39:00.407249+0000","last_undegraded":"2023-11-04T01:39:00.407249+0000","last_fullsized":"2023-11-04T01:39:00.407249+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058029000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420102+0000","last_change":"2023-11-04T01:39:00.431788+0000","last_active":"2023-11-04T01:39:01.420102+0000","last_peered":"2023-11-04T01:39:01.420102+0000","last_clean":"2023-11-04T01:39:01.420102+0000","last_became_active":"2023-11-04T01:39:00.431502+0000","last_became_peered":"2023-11-04T01:39:00.431502+0000","last_unstale":"2023-11-04T01:39:01.420102+0000","last_undegraded":"2023-11-04T01:39:01.420102+0000","last_fullsized":"2023-11-04T01:39:01.420102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:57.706472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.410814+0000","last_change":"2023-11-04T01:38:59.418298+0000","last_active":"2023-11-04T01:39:00.410814+0000","last_peered":"2023-11-04T01:39:00.410814+0000","last_clean":"2023-11-04T01:39:00.410814+0000","last_became_active":"2023-11-04T01:38:59.417757+0000","last_became_peered":"2023-11-04T01:38:59.417757+0000","last_unstale":"2023-11-04T01:39:00.410814+0000","last_undegraded":"2023-11-04T01:39:00.410814+0000","last_fullsized":"2023-11-04T01:39:00.410814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:27.568981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411355+0000","last_change":"2023-11-04T01:38:37.217048+0000","last_active":"2023-11-04T01:38:59.411355+0000","last_peered":"2023-11-04T01:38:59.411355+0000","last_clean":"2023-11-04T01:38:59.411355+0000","last_became_active":"2023-11-04T01:38:37.216763+0000","last_became_peered":"2023-11-04T01:38:37.216763+0000","last_unstale":"2023-11-04T01:38:59.411355+0000","last_undegraded":"2023-11-04T01:38:59.411355+0000","last_fullsized":"2023-11-04T01:38:59.411355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:59.011790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.409891+0000","last_change":"2023-11-04T01:38:38.206767+0000","last_active":"2023-11-04T01:38:59.409891+0000","last_peered":"2023-11-04T01:38:59.409891+0000","last_clean":"2023-11-04T01:38:59.409891+0000","last_became_active":"2023-11-04T01:38:36.221413+0000","last_became_peered":"2023-11-04T01:38:36.221413+0000","last_unstale":"2023-11-04T01:38:59.409891+0000","last_undegraded":"2023-11-04T01:38:59.409891+0000","last_fullsized":"2023-11-04T01:38:59.409891+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:08.788172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000941179,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.406355+0000","last_change":"2023-11-04T01:37:36.229258+0000","last_active":"2023-11-04T01:39:00.406355+0000","last_peered":"2023-11-04T01:39:00.406355+0000","last_clean":"2023-11-04T01:39:00.406355+0000","last_became_active":"2023-11-04T01:37:35.221720+0000","last_became_peered":"2023-11-04T01:37:35.221720+0000","last_unstale":"2023-11-04T01:39:00.406355+0000","last_undegraded":"2023-11-04T01:39:00.406355+0000","last_fullsized":"2023-11-04T01:39:00.406355+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:09.633236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068644799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421678+0000","last_change":"2023-11-04T01:39:00.417648+0000","last_active":"2023-11-04T01:39:01.421678+0000","last_peered":"2023-11-04T01:39:01.421678+0000","last_clean":"2023-11-04T01:39:01.421678+0000","last_became_active":"2023-11-04T01:39:00.417390+0000","last_became_peered":"2023-11-04T01:39:00.417390+0000","last_unstale":"2023-11-04T01:39:01.421678+0000","last_undegraded":"2023-11-04T01:39:01.421678+0000","last_fullsized":"2023-11-04T01:39:01.421678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:35.272381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.434657+0000","last_change":"2023-11-04T01:38:59.416768+0000","last_active":"2023-11-04T01:39:00.434657+0000","last_peered":"2023-11-04T01:39:00.434657+0000","last_clean":"2023-11-04T01:39:00.434657+0000","last_became_active":"2023-11-04T01:38:59.416491+0000","last_became_peered":"2023-11-04T01:38:59.416491+0000","last_unstale":"2023-11-04T01:39:00.434657+0000","last_undegraded":"2023-11-04T01:39:00.434657+0000","last_fullsized":"2023-11-04T01:39:00.434657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:06.157777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.406847+0000","last_change":"2023-11-04T01:38:37.214917+0000","last_active":"2023-11-04T01:39:00.406847+0000","last_peered":"2023-11-04T01:39:00.406847+0000","last_clean":"2023-11-04T01:39:00.406847+0000","last_became_active":"2023-11-04T01:38:37.214649+0000","last_became_peered":"2023-11-04T01:38:37.214649+0000","last_unstale":"2023-11-04T01:39:00.406847+0000","last_undegraded":"2023-11-04T01:39:00.406847+0000","last_fullsized":"2023-11-04T01:39:00.406847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:43.122719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.410191+0000","last_change":"2023-11-04T01:38:38.205229+0000","last_active":"2023-11-04T01:38:59.410191+0000","last_peered":"2023-11-04T01:38:59.410191+0000","last_clean":"2023-11-04T01:38:59.410191+0000","last_became_active":"2023-11-04T01:38:36.213122+0000","last_became_peered":"2023-11-04T01:38:36.213122+0000","last_unstale":"2023-11-04T01:38:59.410191+0000","last_undegraded":"2023-11-04T01:38:59.410191+0000","last_fullsized":"2023-11-04T01:38:59.410191+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:24.233394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000519342,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404451+0000","last_change":"2023-11-04T01:37:36.695175+0000","last_active":"2023-11-04T01:38:59.404451+0000","last_peered":"2023-11-04T01:38:59.404451+0000","last_clean":"2023-11-04T01:38:59.404451+0000","last_became_active":"2023-11-04T01:37:35.224473+0000","last_became_peered":"2023-11-04T01:37:35.224473+0000","last_unstale":"2023-11-04T01:38:59.404451+0000","last_undegraded":"2023-11-04T01:38:59.404451+0000","last_fullsized":"2023-11-04T01:38:59.404451+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065377199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429423+0000","last_change":"2023-11-04T01:39:00.427939+0000","last_active":"2023-11-04T01:39:00.429423+0000","last_peered":"2023-11-04T01:39:00.429423+0000","last_clean":"2023-11-04T01:39:00.429423+0000","last_became_active":"2023-11-04T01:39:00.427678+0000","last_became_peered":"2023-11-04T01:39:00.427678+0000","last_unstale":"2023-11-04T01:39:00.429423+0000","last_undegraded":"2023-11-04T01:39:00.429423+0000","last_fullsized":"2023-11-04T01:39:00.429423+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:06.321096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.441204+0000","last_change":"2023-11-04T01:38:59.420481+0000","last_active":"2023-11-04T01:39:00.441204+0000","last_peered":"2023-11-04T01:39:00.441204+0000","last_clean":"2023-11-04T01:39:00.441204+0000","last_became_active":"2023-11-04T01:38:59.420210+0000","last_became_peered":"2023-11-04T01:38:59.420210+0000","last_unstale":"2023-11-04T01:39:00.441204+0000","last_undegraded":"2023-11-04T01:39:00.441204+0000","last_fullsized":"2023-11-04T01:39:00.441204+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:39:14.134960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.406699+0000","last_change":"2023-11-04T01:38:37.214806+0000","last_active":"2023-11-04T01:39:00.406699+0000","last_peered":"2023-11-04T01:39:00.406699+0000","last_clean":"2023-11-04T01:39:00.406699+0000","last_became_active":"2023-11-04T01:38:37.214511+0000","last_became_peered":"2023-11-04T01:38:37.214511+0000","last_unstale":"2023-11-04T01:39:00.406699+0000","last_undegraded":"2023-11-04T01:39:00.406699+0000","last_fullsized":"2023-11-04T01:39:00.406699+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:48.315344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.403413+0000","last_change":"2023-11-04T01:38:38.411265+0000","last_active":"2023-11-04T01:38:59.403413+0000","last_peered":"2023-11-04T01:38:59.403413+0000","last_clean":"2023-11-04T01:38:59.403413+0000","last_became_active":"2023-11-04T01:38:36.216615+0000","last_became_peered":"2023-11-04T01:38:36.216615+0000","last_unstale":"2023-11-04T01:38:59.403413+0000","last_undegraded":"2023-11-04T01:38:59.403413+0000","last_fullsized":"2023-11-04T01:38:59.403413+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:02.794601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095689400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.409421+0000","last_change":"2023-11-04T01:37:36.222100+0000","last_active":"2023-11-04T01:38:59.409421+0000","last_peered":"2023-11-04T01:38:59.409421+0000","last_clean":"2023-11-04T01:38:59.409421+0000","last_became_active":"2023-11-04T01:37:35.219622+0000","last_became_peered":"2023-11-04T01:37:35.219622+0000","last_unstale":"2023-11-04T01:38:59.409421+0000","last_undegraded":"2023-11-04T01:38:59.409421+0000","last_fullsized":"2023-11-04T01:38:59.409421+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:16.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653496,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429443+0000","last_change":"2023-11-04T01:39:00.423450+0000","last_active":"2023-11-04T01:39:00.429443+0000","last_peered":"2023-11-04T01:39:00.429443+0000","last_clean":"2023-11-04T01:39:00.429443+0000","last_became_active":"2023-11-04T01:39:00.423001+0000","last_became_peered":"2023-11-04T01:39:00.423001+0000","last_unstale":"2023-11-04T01:39:00.429443+0000","last_undegraded":"2023-11-04T01:39:00.429443+0000","last_fullsized":"2023-11-04T01:39:00.429443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:57.295246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.410218+0000","last_change":"2023-11-04T01:38:59.421732+0000","last_active":"2023-11-04T01:39:00.410218+0000","last_peered":"2023-11-04T01:39:00.410218+0000","last_clean":"2023-11-04T01:39:00.410218+0000","last_became_active":"2023-11-04T01:38:59.421471+0000","last_became_peered":"2023-11-04T01:38:59.421471+0000","last_unstale":"2023-11-04T01:39:00.410218+0000","last_undegraded":"2023-11-04T01:39:00.410218+0000","last_fullsized":"2023-11-04T01:39:00.410218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:37:01.401481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407343+0000","last_change":"2023-11-04T01:38:37.217077+0000","last_active":"2023-11-04T01:39:00.407343+0000","last_peered":"2023-11-04T01:39:00.407343+0000","last_clean":"2023-11-04T01:39:00.407343+0000","last_became_active":"2023-11-04T01:38:37.216746+0000","last_became_peered":"2023-11-04T01:38:37.216746+0000","last_unstale":"2023-11-04T01:39:00.407343+0000","last_undegraded":"2023-11-04T01:39:00.407343+0000","last_fullsized":"2023-11-04T01:39:00.407343+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:59.828993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.410985+0000","last_change":"2023-11-04T01:38:38.205823+0000","last_active":"2023-11-04T01:38:59.410985+0000","last_peered":"2023-11-04T01:38:59.410985+0000","last_clean":"2023-11-04T01:38:59.410985+0000","last_became_active":"2023-11-04T01:38:36.218347+0000","last_became_peered":"2023-11-04T01:38:36.218347+0000","last_unstale":"2023-11-04T01:38:59.410985+0000","last_undegraded":"2023-11-04T01:38:59.410985+0000","last_fullsized":"2023-11-04T01:38:59.410985+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:24:42.129853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042101900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.412412+0000","last_change":"2023-11-04T01:37:36.222451+0000","last_active":"2023-11-04T01:38:59.412412+0000","last_peered":"2023-11-04T01:38:59.412412+0000","last_clean":"2023-11-04T01:38:59.412412+0000","last_became_active":"2023-11-04T01:37:35.221090+0000","last_became_peered":"2023-11-04T01:37:35.221090+0000","last_unstale":"2023-11-04T01:38:59.412412+0000","last_undegraded":"2023-11-04T01:38:59.412412+0000","last_fullsized":"2023-11-04T01:38:59.412412+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077263799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439143+0000","last_change":"2023-11-04T01:39:00.435357+0000","last_active":"2023-11-04T01:39:00.439143+0000","last_peered":"2023-11-04T01:39:00.439143+0000","last_clean":"2023-11-04T01:39:00.439143+0000","last_became_active":"2023-11-04T01:39:00.435090+0000","last_became_peered":"2023-11-04T01:39:00.435090+0000","last_unstale":"2023-11-04T01:39:00.439143+0000","last_undegraded":"2023-11-04T01:39:00.439143+0000","last_fullsized":"2023-11-04T01:39:00.439143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:59.934103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.415591+0000","last_change":"2023-11-04T01:38:59.417278+0000","last_active":"2023-11-04T01:39:00.415591+0000","last_peered":"2023-11-04T01:39:00.415591+0000","last_clean":"2023-11-04T01:39:00.415591+0000","last_became_active":"2023-11-04T01:38:59.416428+0000","last_became_peered":"2023-11-04T01:38:59.416428+0000","last_unstale":"2023-11-04T01:39:00.415591+0000","last_undegraded":"2023-11-04T01:39:00.415591+0000","last_fullsized":"2023-11-04T01:39:00.415591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:01:15.576400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.412931+0000","last_change":"2023-11-04T01:38:37.212670+0000","last_active":"2023-11-04T01:38:59.412931+0000","last_peered":"2023-11-04T01:38:59.412931+0000","last_clean":"2023-11-04T01:38:59.412931+0000","last_became_active":"2023-11-04T01:38:37.212044+0000","last_became_peered":"2023-11-04T01:38:37.212044+0000","last_unstale":"2023-11-04T01:38:59.412931+0000","last_undegraded":"2023-11-04T01:38:59.412931+0000","last_fullsized":"2023-11-04T01:38:59.412931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:23.460377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411776+0000","last_change":"2023-11-04T01:38:38.205885+0000","last_active":"2023-11-04T01:38:59.411776+0000","last_peered":"2023-11-04T01:38:59.411776+0000","last_clean":"2023-11-04T01:38:59.411776+0000","last_became_active":"2023-11-04T01:38:36.218439+0000","last_became_peered":"2023-11-04T01:38:36.218439+0000","last_unstale":"2023-11-04T01:38:59.411776+0000","last_undegraded":"2023-11-04T01:38:59.411776+0000","last_fullsized":"2023-11-04T01:38:59.411776+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:50.283563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039456400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413712+0000","last_change":"2023-11-04T01:37:36.222643+0000","last_active":"2023-11-04T01:38:59.413712+0000","last_peered":"2023-11-04T01:38:59.413712+0000","last_clean":"2023-11-04T01:38:59.413712+0000","last_became_active":"2023-11-04T01:37:35.215534+0000","last_became_peered":"2023-11-04T01:37:35.215534+0000","last_unstale":"2023-11-04T01:38:59.413712+0000","last_undegraded":"2023-11-04T01:38:59.413712+0000","last_fullsized":"2023-11-04T01:38:59.413712+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011110530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439883+0000","last_change":"2023-11-04T01:39:00.438402+0000","last_active":"2023-11-04T01:39:00.439883+0000","last_peered":"2023-11-04T01:39:00.439883+0000","last_clean":"2023-11-04T01:39:00.439883+0000","last_became_active":"2023-11-04T01:39:00.438094+0000","last_became_peered":"2023-11-04T01:39:00.438094+0000","last_unstale":"2023-11-04T01:39:00.439883+0000","last_undegraded":"2023-11-04T01:39:00.439883+0000","last_fullsized":"2023-11-04T01:39:00.439883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:18.474998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.417634+0000","last_change":"2023-11-04T01:38:59.424830+0000","last_active":"2023-11-04T01:39:00.417634+0000","last_peered":"2023-11-04T01:39:00.417634+0000","last_clean":"2023-11-04T01:39:00.417634+0000","last_became_active":"2023-11-04T01:38:59.424329+0000","last_became_peered":"2023-11-04T01:38:59.424329+0000","last_unstale":"2023-11-04T01:39:00.417634+0000","last_undegraded":"2023-11-04T01:39:00.417634+0000","last_fullsized":"2023-11-04T01:39:00.417634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:39:04.054090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411137+0000","last_change":"2023-11-04T01:38:37.214797+0000","last_active":"2023-11-04T01:38:59.411137+0000","last_peered":"2023-11-04T01:38:59.411137+0000","last_clean":"2023-11-04T01:38:59.411137+0000","last_became_active":"2023-11-04T01:38:37.214465+0000","last_became_peered":"2023-11-04T01:38:37.214465+0000","last_unstale":"2023-11-04T01:38:59.411137+0000","last_undegraded":"2023-11-04T01:38:59.411137+0000","last_fullsized":"2023-11-04T01:38:59.411137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:36.735726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413640+0000","last_change":"2023-11-04T01:38:38.207798+0000","last_active":"2023-11-04T01:38:59.413640+0000","last_peered":"2023-11-04T01:38:59.413640+0000","last_clean":"2023-11-04T01:38:59.413640+0000","last_became_active":"2023-11-04T01:38:36.213815+0000","last_became_peered":"2023-11-04T01:38:36.213815+0000","last_unstale":"2023-11-04T01:38:59.413640+0000","last_undegraded":"2023-11-04T01:38:59.413640+0000","last_fullsized":"2023-11-04T01:38:59.413640+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:54.270056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092951700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404641+0000","last_change":"2023-11-04T01:37:36.695402+0000","last_active":"2023-11-04T01:38:59.404641+0000","last_peered":"2023-11-04T01:38:59.404641+0000","last_clean":"2023-11-04T01:38:59.404641+0000","last_became_active":"2023-11-04T01:37:35.220346+0000","last_became_peered":"2023-11-04T01:37:35.220346+0000","last_unstale":"2023-11-04T01:38:59.404641+0000","last_undegraded":"2023-11-04T01:38:59.404641+0000","last_fullsized":"2023-11-04T01:38:59.404641+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062230100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431206+0000","last_change":"2023-11-04T01:39:00.424968+0000","last_active":"2023-11-04T01:39:00.431206+0000","last_peered":"2023-11-04T01:39:00.431206+0000","last_clean":"2023-11-04T01:39:00.431206+0000","last_became_active":"2023-11-04T01:39:00.424678+0000","last_became_peered":"2023-11-04T01:39:00.424678+0000","last_unstale":"2023-11-04T01:39:00.431206+0000","last_undegraded":"2023-11-04T01:39:00.431206+0000","last_fullsized":"2023-11-04T01:39:00.431206+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:27:37.631870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431991+0000","last_change":"2023-11-04T01:38:59.424623+0000","last_active":"2023-11-04T01:39:00.431991+0000","last_peered":"2023-11-04T01:39:00.431991+0000","last_clean":"2023-11-04T01:39:00.431991+0000","last_became_active":"2023-11-04T01:38:59.424341+0000","last_became_peered":"2023-11-04T01:38:59.424341+0000","last_unstale":"2023-11-04T01:39:00.431991+0000","last_undegraded":"2023-11-04T01:39:00.431991+0000","last_fullsized":"2023-11-04T01:39:00.431991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:24.664171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413698+0000","last_change":"2023-11-04T01:38:37.216420+0000","last_active":"2023-11-04T01:38:59.413698+0000","last_peered":"2023-11-04T01:38:59.413698+0000","last_clean":"2023-11-04T01:38:59.413698+0000","last_became_active":"2023-11-04T01:38:37.216145+0000","last_became_peered":"2023-11-04T01:38:37.216145+0000","last_unstale":"2023-11-04T01:38:59.413698+0000","last_undegraded":"2023-11-04T01:38:59.413698+0000","last_fullsized":"2023-11-04T01:38:59.413698+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:19.049672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.412199+0000","last_change":"2023-11-04T01:38:38.207981+0000","last_active":"2023-11-04T01:38:59.412199+0000","last_peered":"2023-11-04T01:38:59.412199+0000","last_clean":"2023-11-04T01:38:59.412199+0000","last_became_active":"2023-11-04T01:38:36.213518+0000","last_became_peered":"2023-11-04T01:38:36.213518+0000","last_unstale":"2023-11-04T01:38:59.412199+0000","last_undegraded":"2023-11-04T01:38:59.412199+0000","last_fullsized":"2023-11-04T01:38:59.412199+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:20.114870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000824821,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":55,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.417727+0000","last_change":"2023-11-04T01:37:36.426315+0000","last_active":"2023-11-04T01:39:00.417727+0000","last_peered":"2023-11-04T01:39:00.417727+0000","last_clean":"2023-11-04T01:39:00.417727+0000","last_became_active":"2023-11-04T01:37:35.223958+0000","last_became_peered":"2023-11-04T01:37:35.223958+0000","last_unstale":"2023-11-04T01:39:00.417727+0000","last_undegraded":"2023-11-04T01:39:00.417727+0000","last_fullsized":"2023-11-04T01:39:00.417727+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:46.733116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025167400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.420816+0000","last_change":"2023-11-04T01:39:00.417393+0000","last_active":"2023-11-04T01:39:00.420816+0000","last_peered":"2023-11-04T01:39:00.420816+0000","last_clean":"2023-11-04T01:39:00.420816+0000","last_became_active":"2023-11-04T01:39:00.417116+0000","last_became_peered":"2023-11-04T01:39:00.417116+0000","last_unstale":"2023-11-04T01:39:00.420816+0000","last_undegraded":"2023-11-04T01:39:00.420816+0000","last_fullsized":"2023-11-04T01:39:00.420816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:29.863391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421847+0000","last_change":"2023-11-04T01:38:59.422737+0000","last_active":"2023-11-04T01:39:01.421847+0000","last_peered":"2023-11-04T01:39:01.421847+0000","last_clean":"2023-11-04T01:39:01.421847+0000","last_became_active":"2023-11-04T01:38:59.422446+0000","last_became_peered":"2023-11-04T01:38:59.422446+0000","last_unstale":"2023-11-04T01:39:01.421847+0000","last_undegraded":"2023-11-04T01:39:01.421847+0000","last_fullsized":"2023-11-04T01:39:01.421847+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:19.358866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404122+0000","last_change":"2023-11-04T01:38:37.214483+0000","last_active":"2023-11-04T01:38:59.404122+0000","last_peered":"2023-11-04T01:38:59.404122+0000","last_clean":"2023-11-04T01:38:59.404122+0000","last_became_active":"2023-11-04T01:38:37.214116+0000","last_became_peered":"2023-11-04T01:38:37.214116+0000","last_unstale":"2023-11-04T01:38:59.404122+0000","last_undegraded":"2023-11-04T01:38:59.404122+0000","last_fullsized":"2023-11-04T01:38:59.404122+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:41:24.595793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413270+0000","last_change":"2023-11-04T01:38:38.206897+0000","last_active":"2023-11-04T01:38:59.413270+0000","last_peered":"2023-11-04T01:38:59.413270+0000","last_clean":"2023-11-04T01:38:59.413270+0000","last_became_active":"2023-11-04T01:38:36.220906+0000","last_became_peered":"2023-11-04T01:38:36.220906+0000","last_unstale":"2023-11-04T01:38:59.413270+0000","last_undegraded":"2023-11-04T01:38:59.413270+0000","last_fullsized":"2023-11-04T01:38:59.413270+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:08:23.409256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001547536,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.403509+0000","last_change":"2023-11-04T01:37:36.694540+0000","last_active":"2023-11-04T01:38:59.403509+0000","last_peered":"2023-11-04T01:38:59.403509+0000","last_clean":"2023-11-04T01:38:59.403509+0000","last_became_active":"2023-11-04T01:37:35.225863+0000","last_became_peered":"2023-11-04T01:37:35.225863+0000","last_unstale":"2023-11-04T01:38:59.403509+0000","last_undegraded":"2023-11-04T01:38:59.403509+0000","last_fullsized":"2023-11-04T01:38:59.403509+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:42.654853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042277299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422173+0000","last_change":"2023-11-04T01:39:00.437354+0000","last_active":"2023-11-04T01:39:01.422173+0000","last_peered":"2023-11-04T01:39:01.422173+0000","last_clean":"2023-11-04T01:39:01.422173+0000","last_became_active":"2023-11-04T01:39:00.437069+0000","last_became_peered":"2023-11-04T01:39:00.437069+0000","last_unstale":"2023-11-04T01:39:01.422173+0000","last_undegraded":"2023-11-04T01:39:01.422173+0000","last_fullsized":"2023-11-04T01:39:01.422173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:14.488505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420221+0000","last_change":"2023-11-04T01:38:59.421874+0000","last_active":"2023-11-04T01:39:01.420221+0000","last_peered":"2023-11-04T01:39:01.420221+0000","last_clean":"2023-11-04T01:39:01.420221+0000","last_became_active":"2023-11-04T01:38:59.421598+0000","last_became_peered":"2023-11-04T01:38:59.421598+0000","last_unstale":"2023-11-04T01:39:01.420221+0000","last_undegraded":"2023-11-04T01:39:01.420221+0000","last_fullsized":"2023-11-04T01:39:01.420221+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:59.261370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.420807+0000","last_change":"2023-11-04T01:38:37.213554+0000","last_active":"2023-11-04T01:38:59.420807+0000","last_peered":"2023-11-04T01:38:59.420807+0000","last_clean":"2023-11-04T01:38:59.420807+0000","last_became_active":"2023-11-04T01:38:37.213233+0000","last_became_peered":"2023-11-04T01:38:37.213233+0000","last_unstale":"2023-11-04T01:38:59.420807+0000","last_undegraded":"2023-11-04T01:38:59.420807+0000","last_fullsized":"2023-11-04T01:38:59.420807+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:19.049672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404287+0000","last_change":"2023-11-04T01:38:38.411573+0000","last_active":"2023-11-04T01:38:59.404287+0000","last_peered":"2023-11-04T01:38:59.404287+0000","last_clean":"2023-11-04T01:38:59.404287+0000","last_became_active":"2023-11-04T01:38:36.217578+0000","last_became_peered":"2023-11-04T01:38:36.217578+0000","last_unstale":"2023-11-04T01:38:59.404287+0000","last_undegraded":"2023-11-04T01:38:59.404287+0000","last_fullsized":"2023-11-04T01:38:59.404287+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:42.116154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067089600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":55,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.422759+0000","last_change":"2023-11-04T01:37:36.426202+0000","last_active":"2023-11-04T01:39:00.422759+0000","last_peered":"2023-11-04T01:39:00.422759+0000","last_clean":"2023-11-04T01:39:00.422759+0000","last_became_active":"2023-11-04T01:37:35.222997+0000","last_became_peered":"2023-11-04T01:37:35.222997+0000","last_unstale":"2023-11-04T01:39:00.422759+0000","last_undegraded":"2023-11-04T01:39:00.422759+0000","last_fullsized":"2023-11-04T01:39:00.422759+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:18.980751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041393700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429316+0000","last_change":"2023-11-04T01:39:00.426203+0000","last_active":"2023-11-04T01:39:00.429316+0000","last_peered":"2023-11-04T01:39:00.429316+0000","last_clean":"2023-11-04T01:39:00.429316+0000","last_became_active":"2023-11-04T01:39:00.424053+0000","last_became_peered":"2023-11-04T01:39:00.424053+0000","last_unstale":"2023-11-04T01:39:00.429316+0000","last_undegraded":"2023-11-04T01:39:00.429316+0000","last_fullsized":"2023-11-04T01:39:00.429316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:05:25.156222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.410037+0000","last_change":"2023-11-04T01:38:59.422815+0000","last_active":"2023-11-04T01:39:00.410037+0000","last_peered":"2023-11-04T01:39:00.410037+0000","last_clean":"2023-11-04T01:39:00.410037+0000","last_became_active":"2023-11-04T01:38:59.422525+0000","last_became_peered":"2023-11-04T01:38:59.422525+0000","last_unstale":"2023-11-04T01:39:00.410037+0000","last_undegraded":"2023-11-04T01:39:00.410037+0000","last_fullsized":"2023-11-04T01:39:00.410037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:25:12.681388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411083+0000","last_change":"2023-11-04T01:38:37.215851+0000","last_active":"2023-11-04T01:38:59.411083+0000","last_peered":"2023-11-04T01:38:59.411083+0000","last_clean":"2023-11-04T01:38:59.411083+0000","last_became_active":"2023-11-04T01:38:37.215502+0000","last_became_peered":"2023-11-04T01:38:37.215502+0000","last_unstale":"2023-11-04T01:38:59.411083+0000","last_undegraded":"2023-11-04T01:38:59.411083+0000","last_fullsized":"2023-11-04T01:38:59.411083+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:22.227302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411755+0000","last_change":"2023-11-04T01:38:38.206372+0000","last_active":"2023-11-04T01:38:59.411755+0000","last_peered":"2023-11-04T01:38:59.411755+0000","last_clean":"2023-11-04T01:38:59.411755+0000","last_became_active":"2023-11-04T01:38:36.211612+0000","last_became_peered":"2023-11-04T01:38:36.211612+0000","last_unstale":"2023-11-04T01:38:59.411755+0000","last_undegraded":"2023-11-04T01:38:59.411755+0000","last_fullsized":"2023-11-04T01:38:59.411755+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:35.785664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015171970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.410613+0000","last_change":"2023-11-04T01:37:36.220713+0000","last_active":"2023-11-04T01:38:59.410613+0000","last_peered":"2023-11-04T01:38:59.410613+0000","last_clean":"2023-11-04T01:38:59.410613+0000","last_became_active":"2023-11-04T01:37:35.220311+0000","last_became_peered":"2023-11-04T01:37:35.220311+0000","last_unstale":"2023-11-04T01:38:59.410613+0000","last_undegraded":"2023-11-04T01:38:59.410613+0000","last_fullsized":"2023-11-04T01:38:59.410613+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062999799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422423+0000","last_change":"2023-11-04T01:39:00.436564+0000","last_active":"2023-11-04T01:39:01.422423+0000","last_peered":"2023-11-04T01:39:01.422423+0000","last_clean":"2023-11-04T01:39:01.422423+0000","last_became_active":"2023-11-04T01:39:00.433140+0000","last_became_peered":"2023-11-04T01:39:00.433140+0000","last_unstale":"2023-11-04T01:39:01.422423+0000","last_undegraded":"2023-11-04T01:39:01.422423+0000","last_fullsized":"2023-11-04T01:39:01.422423+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:49:21.814992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.413252+0000","last_change":"2023-11-04T01:38:59.415829+0000","last_active":"2023-11-04T01:39:00.413252+0000","last_peered":"2023-11-04T01:39:00.413252+0000","last_clean":"2023-11-04T01:39:00.413252+0000","last_became_active":"2023-11-04T01:38:59.415395+0000","last_became_peered":"2023-11-04T01:38:59.415395+0000","last_unstale":"2023-11-04T01:39:00.413252+0000","last_undegraded":"2023-11-04T01:39:00.413252+0000","last_fullsized":"2023-11-04T01:39:00.413252+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:36.849706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407673+0000","last_change":"2023-11-04T01:38:37.216051+0000","last_active":"2023-11-04T01:39:00.407673+0000","last_peered":"2023-11-04T01:39:00.407673+0000","last_clean":"2023-11-04T01:39:00.407673+0000","last_became_active":"2023-11-04T01:38:37.215779+0000","last_became_peered":"2023-11-04T01:38:37.215779+0000","last_unstale":"2023-11-04T01:39:00.407673+0000","last_undegraded":"2023-11-04T01:39:00.407673+0000","last_fullsized":"2023-11-04T01:39:00.407673+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:38:51.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411159+0000","last_change":"2023-11-04T01:38:38.207161+0000","last_active":"2023-11-04T01:38:59.411159+0000","last_peered":"2023-11-04T01:38:59.411159+0000","last_clean":"2023-11-04T01:38:59.411159+0000","last_became_active":"2023-11-04T01:38:36.215721+0000","last_became_peered":"2023-11-04T01:38:36.215721+0000","last_unstale":"2023-11-04T01:38:59.411159+0000","last_undegraded":"2023-11-04T01:38:59.411159+0000","last_fullsized":"2023-11-04T01:38:59.411159+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:49.027502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046667399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407246+0000","last_change":"2023-11-04T01:37:36.229580+0000","last_active":"2023-11-04T01:39:00.407246+0000","last_peered":"2023-11-04T01:39:00.407246+0000","last_clean":"2023-11-04T01:39:00.407246+0000","last_became_active":"2023-11-04T01:37:35.220940+0000","last_became_peered":"2023-11-04T01:37:35.220940+0000","last_unstale":"2023-11-04T01:39:00.407246+0000","last_undegraded":"2023-11-04T01:39:00.407246+0000","last_fullsized":"2023-11-04T01:39:00.407246+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:27.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070235600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422180+0000","last_change":"2023-11-04T01:39:00.423552+0000","last_active":"2023-11-04T01:39:01.422180+0000","last_peered":"2023-11-04T01:39:01.422180+0000","last_clean":"2023-11-04T01:39:01.422180+0000","last_became_active":"2023-11-04T01:39:00.422946+0000","last_became_peered":"2023-11-04T01:39:00.422946+0000","last_unstale":"2023-11-04T01:39:01.422180+0000","last_undegraded":"2023-11-04T01:39:01.422180+0000","last_fullsized":"2023-11-04T01:39:01.422180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:19.778505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.416362+0000","last_change":"2023-11-04T01:38:59.417281+0000","last_active":"2023-11-04T01:39:00.416362+0000","last_peered":"2023-11-04T01:39:00.416362+0000","last_clean":"2023-11-04T01:39:00.416362+0000","last_became_active":"2023-11-04T01:38:59.416632+0000","last_became_peered":"2023-11-04T01:38:59.416632+0000","last_unstale":"2023-11-04T01:39:00.416362+0000","last_undegraded":"2023-11-04T01:39:00.416362+0000","last_fullsized":"2023-11-04T01:39:00.416362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:41.851253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411485+0000","last_change":"2023-11-04T01:38:37.214340+0000","last_active":"2023-11-04T01:38:59.411485+0000","last_peered":"2023-11-04T01:38:59.411485+0000","last_clean":"2023-11-04T01:38:59.411485+0000","last_became_active":"2023-11-04T01:38:37.214056+0000","last_became_peered":"2023-11-04T01:38:37.214056+0000","last_unstale":"2023-11-04T01:38:59.411485+0000","last_undegraded":"2023-11-04T01:38:59.411485+0000","last_fullsized":"2023-11-04T01:38:59.411485+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:38:51.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404740+0000","last_change":"2023-11-04T01:38:38.411617+0000","last_active":"2023-11-04T01:38:59.404740+0000","last_peered":"2023-11-04T01:38:59.404740+0000","last_clean":"2023-11-04T01:38:59.404740+0000","last_became_active":"2023-11-04T01:38:36.222201+0000","last_became_peered":"2023-11-04T01:38:36.222201+0000","last_unstale":"2023-11-04T01:38:59.404740+0000","last_undegraded":"2023-11-04T01:38:59.404740+0000","last_fullsized":"2023-11-04T01:38:59.404740+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:01.464511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064531400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.408304+0000","last_change":"2023-11-04T01:37:36.422542+0000","last_active":"2023-11-04T01:39:00.408304+0000","last_peered":"2023-11-04T01:39:00.408304+0000","last_clean":"2023-11-04T01:39:00.408304+0000","last_became_active":"2023-11-04T01:37:35.224836+0000","last_became_peered":"2023-11-04T01:37:35.224836+0000","last_unstale":"2023-11-04T01:39:00.408304+0000","last_undegraded":"2023-11-04T01:39:00.408304+0000","last_fullsized":"2023-11-04T01:39:00.408304+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066982800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.423949+0000","last_change":"2023-11-04T01:39:00.421851+0000","last_active":"2023-11-04T01:39:00.423949+0000","last_peered":"2023-11-04T01:39:00.423949+0000","last_clean":"2023-11-04T01:39:00.423949+0000","last_became_active":"2023-11-04T01:39:00.421601+0000","last_became_peered":"2023-11-04T01:39:00.421601+0000","last_unstale":"2023-11-04T01:39:00.423949+0000","last_undegraded":"2023-11-04T01:39:00.423949+0000","last_fullsized":"2023-11-04T01:39:00.423949+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:23.696731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.432047+0000","last_change":"2023-11-04T01:38:59.425101+0000","last_active":"2023-11-04T01:39:00.432047+0000","last_peered":"2023-11-04T01:39:00.432047+0000","last_clean":"2023-11-04T01:39:00.432047+0000","last_became_active":"2023-11-04T01:38:59.424466+0000","last_became_peered":"2023-11-04T01:38:59.424466+0000","last_unstale":"2023-11-04T01:39:00.432047+0000","last_undegraded":"2023-11-04T01:39:00.432047+0000","last_fullsized":"2023-11-04T01:39:00.432047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:59.261370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407348+0000","last_change":"2023-11-04T01:38:37.214695+0000","last_active":"2023-11-04T01:39:00.407348+0000","last_peered":"2023-11-04T01:39:00.407348+0000","last_clean":"2023-11-04T01:39:00.407348+0000","last_became_active":"2023-11-04T01:38:37.214378+0000","last_became_peered":"2023-11-04T01:38:37.214378+0000","last_unstale":"2023-11-04T01:39:00.407348+0000","last_undegraded":"2023-11-04T01:39:00.407348+0000","last_fullsized":"2023-11-04T01:39:00.407348+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:54:14.757431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411408+0000","last_change":"2023-11-04T01:38:38.208722+0000","last_active":"2023-11-04T01:38:59.411408+0000","last_peered":"2023-11-04T01:38:59.411408+0000","last_clean":"2023-11-04T01:38:59.411408+0000","last_became_active":"2023-11-04T01:38:36.213352+0000","last_became_peered":"2023-11-04T01:38:36.213352+0000","last_unstale":"2023-11-04T01:38:59.411408+0000","last_undegraded":"2023-11-04T01:38:59.411408+0000","last_fullsized":"2023-11-04T01:38:59.411408+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:47.308778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082430899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404456+0000","last_change":"2023-11-04T01:37:36.694868+0000","last_active":"2023-11-04T01:38:59.404456+0000","last_peered":"2023-11-04T01:38:59.404456+0000","last_clean":"2023-11-04T01:38:59.404456+0000","last_became_active":"2023-11-04T01:37:35.221181+0000","last_became_peered":"2023-11-04T01:37:35.221181+0000","last_unstale":"2023-11-04T01:38:59.404456+0000","last_undegraded":"2023-11-04T01:38:59.404456+0000","last_fullsized":"2023-11-04T01:38:59.404456+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046748800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431464+0000","last_change":"2023-11-04T01:39:00.426840+0000","last_active":"2023-11-04T01:39:00.431464+0000","last_peered":"2023-11-04T01:39:00.431464+0000","last_clean":"2023-11-04T01:39:00.431464+0000","last_became_active":"2023-11-04T01:39:00.425908+0000","last_became_peered":"2023-11-04T01:39:00.425908+0000","last_unstale":"2023-11-04T01:39:00.431464+0000","last_undegraded":"2023-11-04T01:39:00.431464+0000","last_fullsized":"2023-11-04T01:39:00.431464+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:43.326364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439038+0000","last_change":"2023-11-04T01:38:59.427160+0000","last_active":"2023-11-04T01:39:00.439038+0000","last_peered":"2023-11-04T01:39:00.439038+0000","last_clean":"2023-11-04T01:39:00.439038+0000","last_became_active":"2023-11-04T01:38:59.426820+0000","last_became_peered":"2023-11-04T01:38:59.426820+0000","last_unstale":"2023-11-04T01:39:00.439038+0000","last_undegraded":"2023-11-04T01:39:00.439038+0000","last_fullsized":"2023-11-04T01:39:00.439038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:24.664171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411057+0000","last_change":"2023-11-04T01:38:37.213179+0000","last_active":"2023-11-04T01:38:59.411057+0000","last_peered":"2023-11-04T01:38:59.411057+0000","last_clean":"2023-11-04T01:38:59.411057+0000","last_became_active":"2023-11-04T01:38:37.212784+0000","last_became_peered":"2023-11-04T01:38:37.212784+0000","last_unstale":"2023-11-04T01:38:59.411057+0000","last_undegraded":"2023-11-04T01:38:59.411057+0000","last_fullsized":"2023-11-04T01:38:59.411057+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:22.227302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404248+0000","last_change":"2023-11-04T01:38:38.411421+0000","last_active":"2023-11-04T01:38:59.404248+0000","last_peered":"2023-11-04T01:38:59.404248+0000","last_clean":"2023-11-04T01:38:59.404248+0000","last_became_active":"2023-11-04T01:38:36.218508+0000","last_became_peered":"2023-11-04T01:38:36.218508+0000","last_unstale":"2023-11-04T01:38:59.404248+0000","last_undegraded":"2023-11-04T01:38:59.404248+0000","last_fullsized":"2023-11-04T01:38:59.404248+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:47:59.491789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085522699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411754+0000","last_change":"2023-11-04T01:37:36.222930+0000","last_active":"2023-11-04T01:38:59.411754+0000","last_peered":"2023-11-04T01:38:59.411754+0000","last_clean":"2023-11-04T01:38:59.411754+0000","last_became_active":"2023-11-04T01:37:35.220373+0000","last_became_peered":"2023-11-04T01:37:35.220373+0000","last_unstale":"2023-11-04T01:38:59.411754+0000","last_undegraded":"2023-11-04T01:38:59.411754+0000","last_fullsized":"2023-11-04T01:38:59.411754+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074099599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439181+0000","last_change":"2023-11-04T01:39:00.434870+0000","last_active":"2023-11-04T01:39:00.439181+0000","last_peered":"2023-11-04T01:39:00.439181+0000","last_clean":"2023-11-04T01:39:00.439181+0000","last_became_active":"2023-11-04T01:39:00.434615+0000","last_became_peered":"2023-11-04T01:39:00.434615+0000","last_unstale":"2023-11-04T01:39:00.439181+0000","last_undegraded":"2023-11-04T01:39:00.439181+0000","last_fullsized":"2023-11-04T01:39:00.439181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:56.540138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.411854+0000","last_change":"2023-11-04T01:38:59.419072+0000","last_active":"2023-11-04T01:39:00.411854+0000","last_peered":"2023-11-04T01:39:00.411854+0000","last_clean":"2023-11-04T01:39:00.411854+0000","last_became_active":"2023-11-04T01:38:59.418764+0000","last_became_peered":"2023-11-04T01:38:59.418764+0000","last_unstale":"2023-11-04T01:39:00.411854+0000","last_undegraded":"2023-11-04T01:39:00.411854+0000","last_fullsized":"2023-11-04T01:39:00.411854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:13.216916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.420659+0000","last_change":"2023-11-04T01:38:37.212376+0000","last_active":"2023-11-04T01:38:59.420659+0000","last_peered":"2023-11-04T01:38:59.420659+0000","last_clean":"2023-11-04T01:38:59.420659+0000","last_became_active":"2023-11-04T01:38:37.211932+0000","last_became_peered":"2023-11-04T01:38:37.211932+0000","last_unstale":"2023-11-04T01:38:59.420659+0000","last_undegraded":"2023-11-04T01:38:59.420659+0000","last_fullsized":"2023-11-04T01:38:59.420659+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:02.363703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.423233+0000","last_change":"2023-11-04T01:38:38.247627+0000","last_active":"2023-11-04T01:39:00.423233+0000","last_peered":"2023-11-04T01:39:00.423233+0000","last_clean":"2023-11-04T01:39:00.423233+0000","last_became_active":"2023-11-04T01:38:36.218231+0000","last_became_peered":"2023-11-04T01:38:36.218231+0000","last_unstale":"2023-11-04T01:39:00.423233+0000","last_undegraded":"2023-11-04T01:39:00.423233+0000","last_fullsized":"2023-11-04T01:39:00.423233+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:52.412436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010241499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.412495+0000","last_change":"2023-11-04T01:37:36.221676+0000","last_active":"2023-11-04T01:38:59.412495+0000","last_peered":"2023-11-04T01:38:59.412495+0000","last_clean":"2023-11-04T01:38:59.412495+0000","last_became_active":"2023-11-04T01:37:35.226996+0000","last_became_peered":"2023-11-04T01:37:35.226996+0000","last_unstale":"2023-11-04T01:38:59.412495+0000","last_undegraded":"2023-11-04T01:38:59.412495+0000","last_fullsized":"2023-11-04T01:38:59.412495+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089115500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421883+0000","last_change":"2023-11-04T01:39:00.437737+0000","last_active":"2023-11-04T01:39:01.421883+0000","last_peered":"2023-11-04T01:39:01.421883+0000","last_clean":"2023-11-04T01:39:01.421883+0000","last_became_active":"2023-11-04T01:39:00.437378+0000","last_became_peered":"2023-11-04T01:39:00.437378+0000","last_unstale":"2023-11-04T01:39:01.421883+0000","last_undegraded":"2023-11-04T01:39:01.421883+0000","last_fullsized":"2023-11-04T01:39:01.421883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:54:22.210166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.412674+0000","last_change":"2023-11-04T01:38:59.425462+0000","last_active":"2023-11-04T01:39:00.412674+0000","last_peered":"2023-11-04T01:39:00.412674+0000","last_clean":"2023-11-04T01:39:00.412674+0000","last_became_active":"2023-11-04T01:38:59.425198+0000","last_became_peered":"2023-11-04T01:38:59.425198+0000","last_unstale":"2023-11-04T01:39:00.412674+0000","last_undegraded":"2023-11-04T01:39:00.412674+0000","last_fullsized":"2023-11-04T01:39:00.412674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:40.638512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.423317+0000","last_change":"2023-11-04T01:38:37.212816+0000","last_active":"2023-11-04T01:39:00.423317+0000","last_peered":"2023-11-04T01:39:00.423317+0000","last_clean":"2023-11-04T01:39:00.423317+0000","last_became_active":"2023-11-04T01:38:37.212512+0000","last_became_peered":"2023-11-04T01:38:37.212512+0000","last_unstale":"2023-11-04T01:39:00.423317+0000","last_undegraded":"2023-11-04T01:39:00.423317+0000","last_fullsized":"2023-11-04T01:39:00.423317+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:07.947093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407641+0000","last_change":"2023-11-04T01:38:38.636602+0000","last_active":"2023-11-04T01:39:00.407641+0000","last_peered":"2023-11-04T01:39:00.407641+0000","last_clean":"2023-11-04T01:39:00.407641+0000","last_became_active":"2023-11-04T01:38:36.213670+0000","last_became_peered":"2023-11-04T01:38:36.213670+0000","last_unstale":"2023-11-04T01:39:00.407641+0000","last_undegraded":"2023-11-04T01:39:00.407641+0000","last_fullsized":"2023-11-04T01:39:00.407641+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:42.712180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056085900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.419922+0000","last_change":"2023-11-04T01:37:36.228535+0000","last_active":"2023-11-04T01:38:59.419922+0000","last_peered":"2023-11-04T01:38:59.419922+0000","last_clean":"2023-11-04T01:38:59.419922+0000","last_became_active":"2023-11-04T01:37:35.221173+0000","last_became_peered":"2023-11-04T01:37:35.221173+0000","last_unstale":"2023-11-04T01:38:59.419922+0000","last_undegraded":"2023-11-04T01:38:59.419922+0000","last_fullsized":"2023-11-04T01:38:59.419922+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049831099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422493+0000","last_change":"2023-11-04T01:39:00.433707+0000","last_active":"2023-11-04T01:39:01.422493+0000","last_peered":"2023-11-04T01:39:01.422493+0000","last_clean":"2023-11-04T01:39:01.422493+0000","last_became_active":"2023-11-04T01:39:00.433467+0000","last_became_peered":"2023-11-04T01:39:00.433467+0000","last_unstale":"2023-11-04T01:39:01.422493+0000","last_undegraded":"2023-11-04T01:39:01.422493+0000","last_fullsized":"2023-11-04T01:39:01.422493+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:46.942739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.412963+0000","last_change":"2023-11-04T01:38:59.424724+0000","last_active":"2023-11-04T01:39:00.412963+0000","last_peered":"2023-11-04T01:39:00.412963+0000","last_clean":"2023-11-04T01:39:00.412963+0000","last_became_active":"2023-11-04T01:38:59.424295+0000","last_became_peered":"2023-11-04T01:38:59.424295+0000","last_unstale":"2023-11-04T01:39:00.412963+0000","last_undegraded":"2023-11-04T01:39:00.412963+0000","last_fullsized":"2023-11-04T01:39:00.412963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:05:05.911840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.420375+0000","last_change":"2023-11-04T01:38:37.214627+0000","last_active":"2023-11-04T01:38:59.420375+0000","last_peered":"2023-11-04T01:38:59.420375+0000","last_clean":"2023-11-04T01:38:59.420375+0000","last_became_active":"2023-11-04T01:38:37.214336+0000","last_became_peered":"2023-11-04T01:38:37.214336+0000","last_unstale":"2023-11-04T01:38:59.420375+0000","last_undegraded":"2023-11-04T01:38:59.420375+0000","last_fullsized":"2023-11-04T01:38:59.420375+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:21.121436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.406214+0000","last_change":"2023-11-04T01:38:38.635992+0000","last_active":"2023-11-04T01:39:00.406214+0000","last_peered":"2023-11-04T01:39:00.406214+0000","last_clean":"2023-11-04T01:39:00.406214+0000","last_became_active":"2023-11-04T01:38:36.215694+0000","last_became_peered":"2023-11-04T01:38:36.215694+0000","last_unstale":"2023-11-04T01:39:00.406214+0000","last_undegraded":"2023-11-04T01:39:00.406214+0000","last_fullsized":"2023-11-04T01:39:00.406214+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:01.464511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036495599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407723+0000","last_change":"2023-11-04T01:37:36.229678+0000","last_active":"2023-11-04T01:39:00.407723+0000","last_peered":"2023-11-04T01:39:00.407723+0000","last_clean":"2023-11-04T01:39:00.407723+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:39:00.407723+0000","last_undegraded":"2023-11-04T01:39:00.407723+0000","last_fullsized":"2023-11-04T01:39:00.407723+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:50.484332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422038+0000","last_change":"2023-11-04T01:39:00.436759+0000","last_active":"2023-11-04T01:39:01.422038+0000","last_peered":"2023-11-04T01:39:01.422038+0000","last_clean":"2023-11-04T01:39:01.422038+0000","last_became_active":"2023-11-04T01:39:00.436299+0000","last_became_peered":"2023-11-04T01:39:00.436299+0000","last_unstale":"2023-11-04T01:39:01.422038+0000","last_undegraded":"2023-11-04T01:39:01.422038+0000","last_fullsized":"2023-11-04T01:39:01.422038+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:48.438336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.436475+0000","last_change":"2023-11-04T01:38:59.423620+0000","last_active":"2023-11-04T01:39:00.436475+0000","last_peered":"2023-11-04T01:39:00.436475+0000","last_clean":"2023-11-04T01:39:00.436475+0000","last_became_active":"2023-11-04T01:38:59.423351+0000","last_became_peered":"2023-11-04T01:38:59.423351+0000","last_unstale":"2023-11-04T01:39:00.436475+0000","last_undegraded":"2023-11-04T01:39:00.436475+0000","last_fullsized":"2023-11-04T01:39:00.436475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:34.267099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.422610+0000","last_change":"2023-11-04T01:38:37.212620+0000","last_active":"2023-11-04T01:39:00.422610+0000","last_peered":"2023-11-04T01:39:00.422610+0000","last_clean":"2023-11-04T01:39:00.422610+0000","last_became_active":"2023-11-04T01:38:37.212294+0000","last_became_peered":"2023-11-04T01:38:37.212294+0000","last_unstale":"2023-11-04T01:39:00.422610+0000","last_undegraded":"2023-11-04T01:39:00.422610+0000","last_fullsized":"2023-11-04T01:39:00.422610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:02.424394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.414228+0000","last_change":"2023-11-04T01:38:38.246984+0000","last_active":"2023-11-04T01:39:00.414228+0000","last_peered":"2023-11-04T01:39:00.414228+0000","last_clean":"2023-11-04T01:39:00.414228+0000","last_became_active":"2023-11-04T01:38:36.211685+0000","last_became_peered":"2023-11-04T01:38:36.211685+0000","last_unstale":"2023-11-04T01:39:00.414228+0000","last_undegraded":"2023-11-04T01:39:00.414228+0000","last_fullsized":"2023-11-04T01:39:00.414228+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:50.973560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051504199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407341+0000","last_change":"2023-11-04T01:37:36.229908+0000","last_active":"2023-11-04T01:39:00.407341+0000","last_peered":"2023-11-04T01:39:00.407341+0000","last_clean":"2023-11-04T01:39:00.407341+0000","last_became_active":"2023-11-04T01:37:35.221822+0000","last_became_peered":"2023-11-04T01:37:35.221822+0000","last_unstale":"2023-11-04T01:39:00.407341+0000","last_undegraded":"2023-11-04T01:39:00.407341+0000","last_fullsized":"2023-11-04T01:39:00.407341+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:11.866738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089270799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422808+0000","last_change":"2023-11-04T01:39:00.434378+0000","last_active":"2023-11-04T01:39:01.422808+0000","last_peered":"2023-11-04T01:39:01.422808+0000","last_clean":"2023-11-04T01:39:01.422808+0000","last_became_active":"2023-11-04T01:39:00.434060+0000","last_became_peered":"2023-11-04T01:39:00.434060+0000","last_unstale":"2023-11-04T01:39:01.422808+0000","last_undegraded":"2023-11-04T01:39:01.422808+0000","last_fullsized":"2023-11-04T01:39:01.422808+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:59.990606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"83'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421785+0000","last_change":"2023-11-04T01:38:59.423453+0000","last_active":"2023-11-04T01:39:01.421785+0000","last_peered":"2023-11-04T01:39:01.421785+0000","last_clean":"2023-11-04T01:39:01.421785+0000","last_became_active":"2023-11-04T01:38:59.423211+0000","last_became_peered":"2023-11-04T01:38:59.423211+0000","last_unstale":"2023-11-04T01:39:01.421785+0000","last_undegraded":"2023-11-04T01:39:01.421785+0000","last_fullsized":"2023-11-04T01:39:01.421785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:58.843544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.410347+0000","last_change":"2023-11-04T01:38:37.215184+0000","last_active":"2023-11-04T01:38:59.410347+0000","last_peered":"2023-11-04T01:38:59.410347+0000","last_clean":"2023-11-04T01:38:59.410347+0000","last_became_active":"2023-11-04T01:38:37.214888+0000","last_became_peered":"2023-11-04T01:38:37.214888+0000","last_unstale":"2023-11-04T01:38:59.410347+0000","last_undegraded":"2023-11-04T01:38:59.410347+0000","last_fullsized":"2023-11-04T01:38:59.410347+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:34.067351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.408179+0000","last_change":"2023-11-04T01:38:38.637027+0000","last_active":"2023-11-04T01:39:00.408179+0000","last_peered":"2023-11-04T01:39:00.408179+0000","last_clean":"2023-11-04T01:39:00.408179+0000","last_became_active":"2023-11-04T01:38:36.221149+0000","last_became_peered":"2023-11-04T01:38:36.221149+0000","last_unstale":"2023-11-04T01:39:00.408179+0000","last_undegraded":"2023-11-04T01:39:00.408179+0000","last_fullsized":"2023-11-04T01:39:00.408179+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:12.755546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045543500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404885+0000","last_change":"2023-11-04T01:37:36.695345+0000","last_active":"2023-11-04T01:38:59.404885+0000","last_peered":"2023-11-04T01:38:59.404885+0000","last_clean":"2023-11-04T01:38:59.404885+0000","last_became_active":"2023-11-04T01:37:35.225441+0000","last_became_peered":"2023-11-04T01:37:35.225441+0000","last_unstale":"2023-11-04T01:38:59.404885+0000","last_undegraded":"2023-11-04T01:38:59.404885+0000","last_fullsized":"2023-11-04T01:38:59.404885+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052758199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":218,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407825+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:39:00.407825+0000","last_peered":"2023-11-04T01:39:00.407825+0000","last_clean":"2023-11-04T01:39:00.407825+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:39:00.407825+0000","last_undegraded":"2023-11-04T01:39:00.407825+0000","last_fullsized":"2023-11-04T01:39:00.407825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1630208,"data_stored":1091068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.65800000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.503,"15min":0.503},"min":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.53600000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.51500000000000001},"min":{"1min":0.41199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76900000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.39100000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.434},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72999999999999998,"5min":0.745,"15min":0.745},"last":0.47899999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56599999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.55400000000000005}]},{"osd":4,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.45800000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72399999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.50900000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.34399999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77100000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.35099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88700000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61399999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83899999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.35999999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.35999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":493557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89600000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.63700000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74199999999999999,"5min":1.004,"15min":1.004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79800000000000004,"5min":1.085,"15min":1.085},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81499999999999995,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84899999999999998,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.60399999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73699999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96199999999999997,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.313,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77800000000000002,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.373,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86499999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.441}]},{"osd":5,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73799999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83099999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.65800000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69199999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.63500000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79600000000000004,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.71099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":492975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.86399999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.63200000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77700000000000002,"5min":1.24,"15min":1.24},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82899999999999996,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.55900000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79200000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.83599999999999997,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.53800000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.41399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.434,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.71699999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.502,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73899999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.504,"15min":0.50600000000000001},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82199999999999995,"5min":0.877,"15min":0.877},"last":0.73399999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70799999999999996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.751},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80600000000000005,"5min":1.284,"15min":1.284},"last":0.79900000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72599999999999998,"5min":0.746,"15min":0.746},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.77200000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.82399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":494641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.501,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.253,"15min":0.253},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.36199999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.437}]},{"osd":1,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.38700000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70599999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72799999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.41499999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.51400000000000001,"15min":0.498},"min":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.752,"5min":1.022,"15min":1.022},"last":0.47399999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.44800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66700000000000004,"5min":1.002,"15min":1.002},"last":0.376},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.39900000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.501,"15min":0.48599999999999999},"min":{"1min":0.36499999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":1.127,"15min":1.127},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77000000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.34899999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55200000000000005,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.80500000000000005,"5min":1.079,"15min":1.079},"last":0.33000000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.038,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63800000000000001,"15min":0.629},"min":{"1min":0.40000000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.45400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":494539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.248,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.248},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.221},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.28999999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.40799999999999997},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.40799999999999997},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.94799999999999995,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.31}]},{"osd":2,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.371},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44900000000000001,"15min":0.46700000000000003},"min":{"1min":0.34999999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59199999999999997,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.622,"15min":0.64200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83699999999999997,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.623,"15min":0.63},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83299999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.45000000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68000000000000005,"15min":0.69499999999999995},"min":{"1min":0.51400000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.87,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1019904,"data_stored":492939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.35299999999999998,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.19,"15min":0.19},"max":{"1min":0.60399999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35299999999999998,"15min":0.37},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.49399999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.39500000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36299999999999999,"15min":0.36699999999999999},"min":{"1min":0.255,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.5,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.42499999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51500000000000001,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.36399999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.876,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.627,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79900000000000004,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.55000000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70199999999999996,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.628,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.81200000000000006,"5min":1.052,"15min":1.052},"last":0.51400000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82099999999999995,"5min":1.393,"15min":1.393},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80200000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.79300000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72799999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.65100000000000002,"15min":0.67400000000000004},"min":{"1min":0.42299999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71799999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":492905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32700000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.36799999999999999,"15min":0.379},"min":{"1min":0.22,"5min":0.192,"15min":0.192},"max":{"1min":0.496,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.315}]},{"osd":2,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33600000000000002,"15min":0.33100000000000002},"min":{"1min":0.26700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.44,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51500000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.33400000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42199999999999999,"15min":0.42899999999999999},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54100000000000004,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52800000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70199999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.40899999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78100000000000003,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59499999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.72299999999999998,"5min":1.02,"15min":1.02},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81399999999999995,"5min":1.089,"15min":1.089},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.623,"15min":0.629},"min":{"1min":0.441,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80000000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.755,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.52700000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86599999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.64000000000000001},"min":{"1min":0.44700000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82799999999999996,"5min":1.153,"15min":1.153},"last":0.54500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32760,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339080,"statfs":{"total":96636764160,"available":96603217920,"internally_reserved":0,"allocated":1609728,"data_stored":1082836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34899999999999998,"15min":0.35499999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.55400000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.222},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.27000000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57999999999999996,"5min":0.629,"15min":0.629},"last":0.34100000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.36199999999999999,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51800000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.39400000000000002,"15min":0.40200000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53900000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.30099999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.379,"15min":0.38800000000000001},"min":{"1min":0.27400000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52200000000000002,"5min":0.628,"15min":0.628},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40000000000000002,"15min":0.40100000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.59599999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.24299999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94899999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59899999999999998,"15min":0.58299999999999996},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85599999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.47699999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.98299999999999998,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.46500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.48299999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91000000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.45600000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.622},"min":{"1min":0.46100000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92200000000000004,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.628},"min":{"1min":0.499,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85899999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.44600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:39:03.435 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:39:03.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.570+0000 7ff99680e640 1 Processor -- start 2023-11-04T01:39:03.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.570+0000 7ff99680e640 1 -- start start 2023-11-04T01:39:03.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.571+0000 7ff99680e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff99015ce60 0x7ff99006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.571+0000 7ff99680e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff9900cf160 0x7ff9900cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.571+0000 7ff99680e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9901615d0 con 0x7ff99006bd30 2023-11-04T01:39:03.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.571+0000 7ff99680e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9900cbde0 con 0x7ff9900cf160 2023-11-04T01:39:03.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.571+0000 7ff99680e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9900cfb30 con 0x7ff99015ce60 2023-11-04T01:39:03.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.571+0000 7ff994dab640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff9900cf160 0x7ff9900cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.571+0000 7ff994dab640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff9900cf160 0x7ff9900cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55312/0 (socket says 172.21.15.44:55312) 2023-11-04T01:39:03.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.571+0000 7ff994dab640 1 -- 172.21.15.44:0/2148623966 learned_addr learned my addr 172.21.15.44:0/2148623966 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:03.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.571+0000 7ff98ffff640 1 --2- 172.21.15.44:0/2148623966 >> v2:172.21.15.204:3300/0 conn(0x7ff99015ce60 0x7ff99006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.571+0000 7ff994dab640 1 -- 172.21.15.44:0/2148623966 >> v2:172.21.15.204:3300/0 conn(0x7ff99015ce60 msgr2=0x7ff99006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:03.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.571+0000 7ff994dab640 1 --2- 172.21.15.44:0/2148623966 >> v2:172.21.15.204:3300/0 conn(0x7ff99015ce60 0x7ff99006b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.571+0000 7ff994dab640 1 -- 172.21.15.44:0/2148623966 >> v1:172.21.15.204:6789/0 conn(0x7ff99006bd30 legacy=0x7ff990160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:03.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.571+0000 7ff994dab640 1 -- 172.21.15.44:0/2148623966 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9901618b0 con 0x7ff9900cf160 2023-11-04T01:39:03.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.571+0000 7ff98ffff640 1 --2- 172.21.15.44:0/2148623966 >> v2:172.21.15.204:3300/0 conn(0x7ff99015ce60 0x7ff99006b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:03.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.572+0000 7ff994dab640 1 --2- 172.21.15.44:0/2148623966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9900cf160 0x7ff9900cf5f0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7ff99006e960 tx=0x7ff98802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73134e5824ad6bb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.572+0000 7ff98effd640 1 -- 172.21.15.44:0/2148623966 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98802ca80 con 0x7ff9900cf160 2023-11-04T01:39:03.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.572+0000 7ff98effd640 1 -- 172.21.15.44:0/2148623966 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98802cbe0 con 0x7ff9900cf160 2023-11-04T01:39:03.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.572+0000 7ff98effd640 1 -- 172.21.15.44:0/2148623966 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9880343f0 con 0x7ff9900cf160 2023-11-04T01:39:03.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.573+0000 7ff99680e640 1 -- 172.21.15.44:0/2148623966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9900cf160 msgr2=0x7ff9900cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.573+0000 7ff99680e640 1 --2- 172.21.15.44:0/2148623966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9900cf160 0x7ff9900cf5f0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7ff99006e960 tx=0x7ff98802bee0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.573+0000 7ff99680e640 1 -- 172.21.15.44:0/2148623966 shutdown_connections 2023-11-04T01:39:03.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.573+0000 7ff99680e640 1 --2- 172.21.15.44:0/2148623966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9900cf160 0x7ff9900cf5f0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.573+0000 7ff99680e640 1 --2- 172.21.15.44:0/2148623966 >> v2:172.21.15.204:3300/0 conn(0x7ff99015ce60 0x7ff99006b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.573+0000 7ff99680e640 1 -- 172.21.15.44:0/2148623966 >> 172.21.15.44:0/2148623966 conn(0x7ff99006ea90 msgr2=0x7ff99006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.573+0000 7ff99680e640 1 -- 172.21.15.44:0/2148623966 shutdown_connections 2023-11-04T01:39:03.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.573+0000 7ff99680e640 1 -- 172.21.15.44:0/2148623966 wait complete. 2023-11-04T01:39:03.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.574+0000 7ff99680e640 1 Processor -- start 2023-11-04T01:39:03.577 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.574+0000 7ff99680e640 1 -- start start 2023-11-04T01:39:03.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.575+0000 7ff99680e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9900cf160 0x7ff99014fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.575+0000 7ff99680e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff99015ce60 0x7ff99015a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.575+0000 7ff99680e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9900c9af0 0x7ff99015ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.575+0000 7ff99680e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9900c8a50 con 0x7ff9900cf160 2023-11-04T01:39:03.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.575+0000 7ff99680e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9900c8d30 con 0x7ff99015ce60 2023-11-04T01:39:03.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.575+0000 7ff99680e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9900c9010 con 0x7ff9900c9af0 2023-11-04T01:39:03.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.575+0000 7ff98ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9900cf160 0x7ff99014fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.575+0000 7ff98ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9900cf160 0x7ff99014fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55314/0 (socket says 172.21.15.44:55314) 2023-11-04T01:39:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.575+0000 7ff98ffff640 1 -- 172.21.15.44:0/3327197127 learned_addr learned my addr 172.21.15.44:0/3327197127 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.575+0000 7ff98ffff640 1 -- 172.21.15.44:0/3327197127 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9900c9af0 msgr2=0x7ff99015ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.575+0000 7ff98ffff640 1 --2- 172.21.15.44:0/3327197127 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9900c9af0 0x7ff99015ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.575+0000 7ff98ffff640 1 -- 172.21.15.44:0/3327197127 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff99015ce60 msgr2=0x7ff99015a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.575+0000 7ff98ffff640 1 --2- 172.21.15.44:0/3327197127 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff99015ce60 0x7ff99015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.575+0000 7ff98ffff640 1 -- 172.21.15.44:0/3327197127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff988009b30 con 0x7ff9900cf160 2023-11-04T01:39:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.576+0000 7ff98ffff640 1 --2- 172.21.15.44:0/3327197127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9900cf160 0x7ff99014fe00 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7ff98400c7f0 tx=0x7ff98400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.576+0000 7ff98cff9640 1 -- 172.21.15.44:0/3327197127 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984007a30 con 0x7ff9900cf160 2023-11-04T01:39:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.576+0000 7ff98cff9640 1 -- 172.21.15.44:0/3327197127 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff984007b90 con 0x7ff9900cf160 2023-11-04T01:39:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.576+0000 7ff99680e640 1 -- 172.21.15.44:0/3327197127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9900c92f0 con 0x7ff9900cf160 2023-11-04T01:39:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.576+0000 7ff98cff9640 1 -- 172.21.15.44:0/3327197127 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98400ce40 con 0x7ff9900cf160 2023-11-04T01:39:03.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.576+0000 7ff99680e640 1 -- 172.21.15.44:0/3327197127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff990150340 con 0x7ff9900cf160 2023-11-04T01:39:03.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.577+0000 7ff99680e640 1 -- 172.21.15.44:0/3327197127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9900c9810 con 0x7ff9900cf160 2023-11-04T01:39:03.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.577+0000 7ff98cff9640 1 -- 172.21.15.44:0/3327197127 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9840113f0 con 0x7ff9900cf160 2023-11-04T01:39:03.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.578+0000 7ff98cff9640 1 --2- 172.21.15.44:0/3327197127 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff97c06ae70 0x7ff97c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.578+0000 7ff98cff9640 1 -- 172.21.15.44:0/3327197127 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7ff984089d70 con 0x7ff9900cf160 2023-11-04T01:39:03.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.578+0000 7ff98f7fe640 1 --2- 172.21.15.44:0/3327197127 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff97c06ae70 0x7ff97c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.579+0000 7ff98f7fe640 1 --2- 172.21.15.44:0/3327197127 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff97c06ae70 0x7ff97c06d330 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff980006fd0 tx=0x7ff980006bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.582+0000 7ff98cff9640 1 -- 172.21.15.44:0/3327197127 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9900c9810 con 0x7ff9900cf160 2023-11-04T01:39:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.756+0000 7ff99680e640 1 -- 172.21.15.44:0/3327197127 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9900ce970 con 0x7ff97c06ae70 2023-11-04T01:39:03.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.769+0000 7ff98cff9640 1 -- 172.21.15.44:0/3327197127 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+532239 (secure 0 0 0) 0x7ff980013430 con 0x7ff97c06ae70 2023-11-04T01:39:03.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:03.780 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:39:03.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.773+0000 7ff99680e640 1 -- 172.21.15.44:0/3327197127 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff97c06ae70 msgr2=0x7ff97c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.773+0000 7ff99680e640 1 --2- 172.21.15.44:0/3327197127 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff97c06ae70 0x7ff97c06d330 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff980006fd0 tx=0x7ff980006bc0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.773+0000 7ff99680e640 1 -- 172.21.15.44:0/3327197127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9900cf160 msgr2=0x7ff99014fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.773+0000 7ff99680e640 1 --2- 172.21.15.44:0/3327197127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9900cf160 0x7ff99014fe00 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7ff98400c7f0 tx=0x7ff98400cbf0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.773+0000 7ff99680e640 1 -- 172.21.15.44:0/3327197127 shutdown_connections 2023-11-04T01:39:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.773+0000 7ff99680e640 1 --2- 172.21.15.44:0/3327197127 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff97c06ae70 0x7ff97c06d330 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.773+0000 7ff99680e640 1 --2- 172.21.15.44:0/3327197127 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9900c9af0 0x7ff99015ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.773+0000 7ff99680e640 1 --2- 172.21.15.44:0/3327197127 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff99015ce60 0x7ff99015a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.773+0000 7ff99680e640 1 --2- 172.21.15.44:0/3327197127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9900cf160 0x7ff99014fe00 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.773+0000 7ff99680e640 1 -- 172.21.15.44:0/3327197127 >> 172.21.15.44:0/3327197127 conn(0x7ff99006ea90 msgr2=0x7ff99006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.773+0000 7ff99680e640 1 -- 172.21.15.44:0/3327197127 shutdown_connections 2023-11-04T01:39:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.773+0000 7ff99680e640 1 -- 172.21.15.44:0/3327197127 wait complete. 2023-11-04T01:39:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2023-11-04T01:39:02.620152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242004,"kb_used_data":9168,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754732716,"statfs":{"total":773094113280,"available":772846301184,"internally_reserved":0,"allocated":9388032,"data_stored":5135460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.224866"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.428223+0000","last_change":"2023-11-04T01:39:00.424498+0000","last_active":"2023-11-04T01:39:00.428223+0000","last_peered":"2023-11-04T01:39:00.428223+0000","last_clean":"2023-11-04T01:39:00.428223+0000","last_became_active":"2023-11-04T01:39:00.424185+0000","last_became_peered":"2023-11-04T01:39:00.424185+0000","last_unstale":"2023-11-04T01:39:00.428223+0000","last_undegraded":"2023-11-04T01:39:00.428223+0000","last_fullsized":"2023-11-04T01:39:00.428223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:42.248048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431186+0000","last_change":"2023-11-04T01:39:00.424793+0000","last_active":"2023-11-04T01:39:00.431186+0000","last_peered":"2023-11-04T01:39:00.431186+0000","last_clean":"2023-11-04T01:39:00.431186+0000","last_became_active":"2023-11-04T01:39:00.424510+0000","last_became_peered":"2023-11-04T01:39:00.424510+0000","last_unstale":"2023-11-04T01:39:00.431186+0000","last_undegraded":"2023-11-04T01:39:00.431186+0000","last_fullsized":"2023-11-04T01:39:00.431186+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:51:07.158686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.425265+0000","last_change":"2023-11-04T01:39:00.423018+0000","last_active":"2023-11-04T01:39:00.425265+0000","last_peered":"2023-11-04T01:39:00.425265+0000","last_clean":"2023-11-04T01:39:00.425265+0000","last_became_active":"2023-11-04T01:39:00.422718+0000","last_became_peered":"2023-11-04T01:39:00.422718+0000","last_unstale":"2023-11-04T01:39:00.425265+0000","last_undegraded":"2023-11-04T01:39:00.425265+0000","last_fullsized":"2023-11-04T01:39:00.425265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:44.319812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420609+0000","last_change":"2023-11-04T01:39:00.438628+0000","last_active":"2023-11-04T01:39:01.420609+0000","last_peered":"2023-11-04T01:39:01.420609+0000","last_clean":"2023-11-04T01:39:01.420609+0000","last_became_active":"2023-11-04T01:39:00.438362+0000","last_became_peered":"2023-11-04T01:39:00.438362+0000","last_unstale":"2023-11-04T01:39:01.420609+0000","last_undegraded":"2023-11-04T01:39:01.420609+0000","last_fullsized":"2023-11-04T01:39:01.420609+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:37.854987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.419834+0000","last_change":"2023-11-04T01:39:00.417653+0000","last_active":"2023-11-04T01:39:00.419834+0000","last_peered":"2023-11-04T01:39:00.419834+0000","last_clean":"2023-11-04T01:39:00.419834+0000","last_became_active":"2023-11-04T01:39:00.416907+0000","last_became_peered":"2023-11-04T01:39:00.416907+0000","last_unstale":"2023-11-04T01:39:00.419834+0000","last_undegraded":"2023-11-04T01:39:00.419834+0000","last_fullsized":"2023-11-04T01:39:00.419834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:23.696731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421571+0000","last_change":"2023-11-04T01:39:00.420998+0000","last_active":"2023-11-04T01:39:01.421571+0000","last_peered":"2023-11-04T01:39:01.421571+0000","last_clean":"2023-11-04T01:39:01.421571+0000","last_became_active":"2023-11-04T01:39:00.420212+0000","last_became_peered":"2023-11-04T01:39:00.420212+0000","last_unstale":"2023-11-04T01:39:01.421571+0000","last_undegraded":"2023-11-04T01:39:01.421571+0000","last_fullsized":"2023-11-04T01:39:01.421571+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:14.222198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421147+0000","last_change":"2023-11-04T01:39:00.420579+0000","last_active":"2023-11-04T01:39:01.421147+0000","last_peered":"2023-11-04T01:39:01.421147+0000","last_clean":"2023-11-04T01:39:01.421147+0000","last_became_active":"2023-11-04T01:39:00.420286+0000","last_became_peered":"2023-11-04T01:39:00.420286+0000","last_unstale":"2023-11-04T01:39:01.421147+0000","last_undegraded":"2023-11-04T01:39:01.421147+0000","last_fullsized":"2023-11-04T01:39:01.421147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:30.348064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431203+0000","last_change":"2023-11-04T01:39:00.424116+0000","last_active":"2023-11-04T01:39:00.431203+0000","last_peered":"2023-11-04T01:39:00.431203+0000","last_clean":"2023-11-04T01:39:00.431203+0000","last_became_active":"2023-11-04T01:39:00.423548+0000","last_became_peered":"2023-11-04T01:39:00.423548+0000","last_unstale":"2023-11-04T01:39:00.431203+0000","last_undegraded":"2023-11-04T01:39:00.431203+0000","last_fullsized":"2023-11-04T01:39:00.431203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:30.348064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429408+0000","last_change":"2023-11-04T01:39:00.422536+0000","last_active":"2023-11-04T01:39:00.429408+0000","last_peered":"2023-11-04T01:39:00.429408+0000","last_clean":"2023-11-04T01:39:00.429408+0000","last_became_active":"2023-11-04T01:39:00.422203+0000","last_became_peered":"2023-11-04T01:39:00.422203+0000","last_unstale":"2023-11-04T01:39:00.429408+0000","last_undegraded":"2023-11-04T01:39:00.429408+0000","last_fullsized":"2023-11-04T01:39:00.429408+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:41:47.794169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439176+0000","last_change":"2023-11-04T01:39:00.434982+0000","last_active":"2023-11-04T01:39:00.439176+0000","last_peered":"2023-11-04T01:39:00.439176+0000","last_clean":"2023-11-04T01:39:00.439176+0000","last_became_active":"2023-11-04T01:39:00.434745+0000","last_became_peered":"2023-11-04T01:39:00.434745+0000","last_unstale":"2023-11-04T01:39:00.439176+0000","last_undegraded":"2023-11-04T01:39:00.439176+0000","last_fullsized":"2023-11-04T01:39:00.439176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:59.848826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421585+0000","last_change":"2023-11-04T01:39:00.423795+0000","last_active":"2023-11-04T01:39:01.421585+0000","last_peered":"2023-11-04T01:39:01.421585+0000","last_clean":"2023-11-04T01:39:01.421585+0000","last_became_active":"2023-11-04T01:39:00.423296+0000","last_became_peered":"2023-11-04T01:39:00.423296+0000","last_unstale":"2023-11-04T01:39:01.421585+0000","last_undegraded":"2023-11-04T01:39:01.421585+0000","last_fullsized":"2023-11-04T01:39:01.421585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:08.909292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439466+0000","last_change":"2023-11-04T01:39:00.435239+0000","last_active":"2023-11-04T01:39:00.439466+0000","last_peered":"2023-11-04T01:39:00.439466+0000","last_clean":"2023-11-04T01:39:00.439466+0000","last_became_active":"2023-11-04T01:39:00.434975+0000","last_became_peered":"2023-11-04T01:39:00.434975+0000","last_unstale":"2023-11-04T01:39:00.439466+0000","last_undegraded":"2023-11-04T01:39:00.439466+0000","last_fullsized":"2023-11-04T01:39:00.439466+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:57:38.121294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420546+0000","last_change":"2023-11-04T01:39:00.417655+0000","last_active":"2023-11-04T01:39:01.420546+0000","last_peered":"2023-11-04T01:39:01.420546+0000","last_clean":"2023-11-04T01:39:01.420546+0000","last_became_active":"2023-11-04T01:39:00.417371+0000","last_became_peered":"2023-11-04T01:39:00.417371+0000","last_unstale":"2023-11-04T01:39:01.420546+0000","last_undegraded":"2023-11-04T01:39:01.420546+0000","last_fullsized":"2023-11-04T01:39:01.420546+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:35.272381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422010+0000","last_change":"2023-11-04T01:39:00.437659+0000","last_active":"2023-11-04T01:39:01.422010+0000","last_peered":"2023-11-04T01:39:01.422010+0000","last_clean":"2023-11-04T01:39:01.422010+0000","last_became_active":"2023-11-04T01:39:00.437338+0000","last_became_peered":"2023-11-04T01:39:00.437338+0000","last_unstale":"2023-11-04T01:39:01.422010+0000","last_undegraded":"2023-11-04T01:39:01.422010+0000","last_fullsized":"2023-11-04T01:39:01.422010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:57.265727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420136+0000","last_change":"2023-11-04T01:39:00.420616+0000","last_active":"2023-11-04T01:39:01.420136+0000","last_peered":"2023-11-04T01:39:01.420136+0000","last_clean":"2023-11-04T01:39:01.420136+0000","last_became_active":"2023-11-04T01:39:00.420347+0000","last_became_peered":"2023-11-04T01:39:00.420347+0000","last_unstale":"2023-11-04T01:39:01.420136+0000","last_undegraded":"2023-11-04T01:39:01.420136+0000","last_fullsized":"2023-11-04T01:39:01.420136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:14.222198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421025+0000","last_change":"2023-11-04T01:39:00.428234+0000","last_active":"2023-11-04T01:39:01.421025+0000","last_peered":"2023-11-04T01:39:01.421025+0000","last_clean":"2023-11-04T01:39:01.421025+0000","last_became_active":"2023-11-04T01:39:00.427960+0000","last_became_peered":"2023-11-04T01:39:00.427960+0000","last_unstale":"2023-11-04T01:39:01.421025+0000","last_undegraded":"2023-11-04T01:39:01.421025+0000","last_fullsized":"2023-11-04T01:39:01.421025+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:05:48.460556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431166+0000","last_change":"2023-11-04T01:39:00.425258+0000","last_active":"2023-11-04T01:39:00.431166+0000","last_peered":"2023-11-04T01:39:00.431166+0000","last_clean":"2023-11-04T01:39:00.431166+0000","last_became_active":"2023-11-04T01:39:00.424904+0000","last_became_peered":"2023-11-04T01:39:00.424904+0000","last_unstale":"2023-11-04T01:39:00.431166+0000","last_undegraded":"2023-11-04T01:39:00.431166+0000","last_fullsized":"2023-11-04T01:39:00.431166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:57.706472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420608+0000","last_change":"2023-11-04T01:39:00.439726+0000","last_active":"2023-11-04T01:39:01.420608+0000","last_peered":"2023-11-04T01:39:01.420608+0000","last_clean":"2023-11-04T01:39:01.420608+0000","last_became_active":"2023-11-04T01:39:00.439400+0000","last_became_peered":"2023-11-04T01:39:00.439400+0000","last_unstale":"2023-11-04T01:39:01.420608+0000","last_undegraded":"2023-11-04T01:39:01.420608+0000","last_fullsized":"2023-11-04T01:39:01.420608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:36.514256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422517+0000","last_change":"2023-11-04T01:39:00.441280+0000","last_active":"2023-11-04T01:39:01.422517+0000","last_peered":"2023-11-04T01:39:01.422517+0000","last_clean":"2023-11-04T01:39:01.422517+0000","last_became_active":"2023-11-04T01:39:00.441011+0000","last_became_peered":"2023-11-04T01:39:00.441011+0000","last_unstale":"2023-11-04T01:39:01.422517+0000","last_undegraded":"2023-11-04T01:39:01.422517+0000","last_fullsized":"2023-11-04T01:39:01.422517+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:53.244184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429245+0000","last_change":"2023-11-04T01:39:00.424806+0000","last_active":"2023-11-04T01:39:00.429245+0000","last_peered":"2023-11-04T01:39:00.429245+0000","last_clean":"2023-11-04T01:39:00.429245+0000","last_became_active":"2023-11-04T01:39:00.423582+0000","last_became_peered":"2023-11-04T01:39:00.423582+0000","last_unstale":"2023-11-04T01:39:00.429245+0000","last_undegraded":"2023-11-04T01:39:00.429245+0000","last_fullsized":"2023-11-04T01:39:00.429245+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:49:23.027369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422163+0000","last_change":"2023-11-04T01:39:00.433180+0000","last_active":"2023-11-04T01:39:01.422163+0000","last_peered":"2023-11-04T01:39:01.422163+0000","last_clean":"2023-11-04T01:39:01.422163+0000","last_became_active":"2023-11-04T01:39:00.432845+0000","last_became_peered":"2023-11-04T01:39:00.432845+0000","last_unstale":"2023-11-04T01:39:01.422163+0000","last_undegraded":"2023-11-04T01:39:01.422163+0000","last_fullsized":"2023-11-04T01:39:01.422163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:25:06.334795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.430977+0000","last_change":"2023-11-04T01:39:00.424498+0000","last_active":"2023-11-04T01:39:00.430977+0000","last_peered":"2023-11-04T01:39:00.430977+0000","last_clean":"2023-11-04T01:39:00.430977+0000","last_became_active":"2023-11-04T01:39:00.424196+0000","last_became_peered":"2023-11-04T01:39:00.424196+0000","last_unstale":"2023-11-04T01:39:00.430977+0000","last_undegraded":"2023-11-04T01:39:00.430977+0000","last_fullsized":"2023-11-04T01:39:00.430977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:36.514256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.430446+0000","last_change":"2023-11-04T01:39:00.423607+0000","last_active":"2023-11-04T01:39:00.430446+0000","last_peered":"2023-11-04T01:39:00.430446+0000","last_clean":"2023-11-04T01:39:00.430446+0000","last_became_active":"2023-11-04T01:39:00.423295+0000","last_became_peered":"2023-11-04T01:39:00.423295+0000","last_unstale":"2023-11-04T01:39:00.430446+0000","last_undegraded":"2023-11-04T01:39:00.430446+0000","last_fullsized":"2023-11-04T01:39:00.430446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:05:48.460556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421197+0000","last_change":"2023-11-04T01:39:00.430809+0000","last_active":"2023-11-04T01:39:01.421197+0000","last_peered":"2023-11-04T01:39:01.421197+0000","last_clean":"2023-11-04T01:39:01.421197+0000","last_became_active":"2023-11-04T01:39:00.430492+0000","last_became_peered":"2023-11-04T01:39:00.430492+0000","last_unstale":"2023-11-04T01:39:01.421197+0000","last_undegraded":"2023-11-04T01:39:01.421197+0000","last_fullsized":"2023-11-04T01:39:01.421197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:57.706472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431484+0000","last_change":"2023-11-04T01:39:00.427038+0000","last_active":"2023-11-04T01:39:00.431484+0000","last_peered":"2023-11-04T01:39:00.431484+0000","last_clean":"2023-11-04T01:39:00.431484+0000","last_became_active":"2023-11-04T01:39:00.426575+0000","last_became_peered":"2023-11-04T01:39:00.426575+0000","last_unstale":"2023-11-04T01:39:00.431484+0000","last_undegraded":"2023-11-04T01:39:00.431484+0000","last_fullsized":"2023-11-04T01:39:00.431484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:14:45.191864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431223+0000","last_change":"2023-11-04T01:39:00.427457+0000","last_active":"2023-11-04T01:39:00.431223+0000","last_peered":"2023-11-04T01:39:00.431223+0000","last_clean":"2023-11-04T01:39:00.431223+0000","last_became_active":"2023-11-04T01:39:00.427180+0000","last_became_peered":"2023-11-04T01:39:00.427180+0000","last_unstale":"2023-11-04T01:39:00.431223+0000","last_undegraded":"2023-11-04T01:39:00.431223+0000","last_fullsized":"2023-11-04T01:39:00.431223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:34.227542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421720+0000","last_change":"2023-11-04T01:39:00.434480+0000","last_active":"2023-11-04T01:39:01.421720+0000","last_peered":"2023-11-04T01:39:01.421720+0000","last_clean":"2023-11-04T01:39:01.421720+0000","last_became_active":"2023-11-04T01:39:00.434205+0000","last_became_peered":"2023-11-04T01:39:00.434205+0000","last_unstale":"2023-11-04T01:39:01.421720+0000","last_undegraded":"2023-11-04T01:39:01.421720+0000","last_fullsized":"2023-11-04T01:39:01.421720+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:37.854987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.420089+0000","last_change":"2023-11-04T01:39:00.417968+0000","last_active":"2023-11-04T01:39:00.420089+0000","last_peered":"2023-11-04T01:39:00.420089+0000","last_clean":"2023-11-04T01:39:00.420089+0000","last_became_active":"2023-11-04T01:39:00.417671+0000","last_became_peered":"2023-11-04T01:39:00.417671+0000","last_unstale":"2023-11-04T01:39:00.420089+0000","last_undegraded":"2023-11-04T01:39:00.420089+0000","last_fullsized":"2023-11-04T01:39:00.420089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:12.584632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431115+0000","last_change":"2023-11-04T01:39:00.427305+0000","last_active":"2023-11-04T01:39:00.431115+0000","last_peered":"2023-11-04T01:39:00.431115+0000","last_clean":"2023-11-04T01:39:00.431115+0000","last_became_active":"2023-11-04T01:39:00.426989+0000","last_became_peered":"2023-11-04T01:39:00.426989+0000","last_unstale":"2023-11-04T01:39:00.431115+0000","last_undegraded":"2023-11-04T01:39:00.431115+0000","last_fullsized":"2023-11-04T01:39:00.431115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:08.909292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422268+0000","last_change":"2023-11-04T01:39:00.441983+0000","last_active":"2023-11-04T01:39:01.422268+0000","last_peered":"2023-11-04T01:39:01.422268+0000","last_clean":"2023-11-04T01:39:01.422268+0000","last_became_active":"2023-11-04T01:39:00.441663+0000","last_became_peered":"2023-11-04T01:39:00.441663+0000","last_unstale":"2023-11-04T01:39:01.422268+0000","last_undegraded":"2023-11-04T01:39:01.422268+0000","last_fullsized":"2023-11-04T01:39:01.422268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:00:20.189226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420348+0000","last_change":"2023-11-04T01:39:00.418390+0000","last_active":"2023-11-04T01:39:01.420348+0000","last_peered":"2023-11-04T01:39:01.420348+0000","last_clean":"2023-11-04T01:39:01.420348+0000","last_became_active":"2023-11-04T01:39:00.418126+0000","last_became_peered":"2023-11-04T01:39:00.418126+0000","last_unstale":"2023-11-04T01:39:01.420348+0000","last_undegraded":"2023-11-04T01:39:01.420348+0000","last_fullsized":"2023-11-04T01:39:01.420348+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:08.909292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.432875+0000","last_change":"2023-11-04T01:39:00.428920+0000","last_active":"2023-11-04T01:39:00.432875+0000","last_peered":"2023-11-04T01:39:00.432875+0000","last_clean":"2023-11-04T01:39:00.432875+0000","last_became_active":"2023-11-04T01:39:00.428653+0000","last_became_peered":"2023-11-04T01:39:00.428653+0000","last_unstale":"2023-11-04T01:39:00.432875+0000","last_undegraded":"2023-11-04T01:39:00.432875+0000","last_fullsized":"2023-11-04T01:39:00.432875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:26:50.544152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421875+0000","last_change":"2023-11-04T01:39:00.427672+0000","last_active":"2023-11-04T01:39:01.421875+0000","last_peered":"2023-11-04T01:39:01.421875+0000","last_clean":"2023-11-04T01:39:01.421875+0000","last_became_active":"2023-11-04T01:39:00.427385+0000","last_became_peered":"2023-11-04T01:39:00.427385+0000","last_unstale":"2023-11-04T01:39:01.421875+0000","last_undegraded":"2023-11-04T01:39:01.421875+0000","last_fullsized":"2023-11-04T01:39:01.421875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:36.514256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"83'6","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.443582+0000","last_change":"2023-11-04T01:38:59.421177+0000","last_active":"2023-11-04T01:39:00.443582+0000","last_peered":"2023-11-04T01:39:00.443582+0000","last_clean":"2023-11-04T01:39:00.443582+0000","last_became_active":"2023-11-04T01:38:59.418001+0000","last_became_peered":"2023-11-04T01:38:59.418001+0000","last_unstale":"2023-11-04T01:39:00.443582+0000","last_undegraded":"2023-11-04T01:39:00.443582+0000","last_fullsized":"2023-11-04T01:39:00.443582+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:40.638512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.421083+0000","last_change":"2023-11-04T01:38:37.214290+0000","last_active":"2023-11-04T01:38:59.421083+0000","last_peered":"2023-11-04T01:38:59.421083+0000","last_clean":"2023-11-04T01:38:59.421083+0000","last_became_active":"2023-11-04T01:38:37.213993+0000","last_became_peered":"2023-11-04T01:38:37.213993+0000","last_unstale":"2023-11-04T01:38:59.421083+0000","last_undegraded":"2023-11-04T01:38:59.421083+0000","last_fullsized":"2023-11-04T01:38:59.421083+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:15:54.258509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.409761+0000","last_change":"2023-11-04T01:38:38.208281+0000","last_active":"2023-11-04T01:38:59.409761+0000","last_peered":"2023-11-04T01:38:59.409761+0000","last_clean":"2023-11-04T01:38:59.409761+0000","last_became_active":"2023-11-04T01:38:36.209307+0000","last_became_peered":"2023-11-04T01:38:36.209307+0000","last_unstale":"2023-11-04T01:38:59.409761+0000","last_undegraded":"2023-11-04T01:38:59.409761+0000","last_fullsized":"2023-11-04T01:38:59.409761+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:15:53.251943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072090299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.409942+0000","last_change":"2023-11-04T01:37:36.221026+0000","last_active":"2023-11-04T01:38:59.409942+0000","last_peered":"2023-11-04T01:38:59.409942+0000","last_clean":"2023-11-04T01:38:59.409942+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:38:59.409942+0000","last_undegraded":"2023-11-04T01:38:59.409942+0000","last_fullsized":"2023-11-04T01:38:59.409942+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067716399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431554+0000","last_change":"2023-11-04T01:39:00.426688+0000","last_active":"2023-11-04T01:39:00.431554+0000","last_peered":"2023-11-04T01:39:00.431554+0000","last_clean":"2023-11-04T01:39:00.431554+0000","last_became_active":"2023-11-04T01:39:00.426282+0000","last_became_peered":"2023-11-04T01:39:00.426282+0000","last_unstale":"2023-11-04T01:39:00.431554+0000","last_undegraded":"2023-11-04T01:39:00.431554+0000","last_fullsized":"2023-11-04T01:39:00.431554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:59.727129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"83'3","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422037+0000","last_change":"2023-11-04T01:38:59.422902+0000","last_active":"2023-11-04T01:39:01.422037+0000","last_peered":"2023-11-04T01:39:01.422037+0000","last_clean":"2023-11-04T01:39:01.422037+0000","last_became_active":"2023-11-04T01:38:59.422599+0000","last_became_peered":"2023-11-04T01:38:59.422599+0000","last_unstale":"2023-11-04T01:39:01.422037+0000","last_undegraded":"2023-11-04T01:39:01.422037+0000","last_fullsized":"2023-11-04T01:39:01.422037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:35.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.408179+0000","last_change":"2023-11-04T01:38:37.212669+0000","last_active":"2023-11-04T01:39:00.408179+0000","last_peered":"2023-11-04T01:39:00.408179+0000","last_clean":"2023-11-04T01:39:00.408179+0000","last_became_active":"2023-11-04T01:38:37.212373+0000","last_became_peered":"2023-11-04T01:38:37.212373+0000","last_unstale":"2023-11-04T01:39:00.408179+0000","last_undegraded":"2023-11-04T01:39:00.408179+0000","last_fullsized":"2023-11-04T01:39:00.408179+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:00.498355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411326+0000","last_change":"2023-11-04T01:38:38.208516+0000","last_active":"2023-11-04T01:38:59.411326+0000","last_peered":"2023-11-04T01:38:59.411326+0000","last_clean":"2023-11-04T01:38:59.411326+0000","last_became_active":"2023-11-04T01:38:36.216993+0000","last_became_peered":"2023-11-04T01:38:36.216993+0000","last_unstale":"2023-11-04T01:38:59.411326+0000","last_undegraded":"2023-11-04T01:38:59.411326+0000","last_fullsized":"2023-11-04T01:38:59.411326+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:26:26.339210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095343999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.421082+0000","last_change":"2023-11-04T01:37:36.229027+0000","last_active":"2023-11-04T01:38:59.421082+0000","last_peered":"2023-11-04T01:38:59.421082+0000","last_clean":"2023-11-04T01:38:59.421082+0000","last_became_active":"2023-11-04T01:37:35.218342+0000","last_became_peered":"2023-11-04T01:37:35.218342+0000","last_unstale":"2023-11-04T01:38:59.421082+0000","last_undegraded":"2023-11-04T01:38:59.421082+0000","last_fullsized":"2023-11-04T01:38:59.421082+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059666400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431664+0000","last_change":"2023-11-04T01:39:00.427443+0000","last_active":"2023-11-04T01:39:00.431664+0000","last_peered":"2023-11-04T01:39:00.431664+0000","last_clean":"2023-11-04T01:39:00.431664+0000","last_became_active":"2023-11-04T01:39:00.427106+0000","last_became_peered":"2023-11-04T01:39:00.427106+0000","last_unstale":"2023-11-04T01:39:00.431664+0000","last_undegraded":"2023-11-04T01:39:00.431664+0000","last_fullsized":"2023-11-04T01:39:00.431664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:43.900683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420692+0000","last_change":"2023-11-04T01:38:59.419968+0000","last_active":"2023-11-04T01:39:01.420692+0000","last_peered":"2023-11-04T01:39:01.420692+0000","last_clean":"2023-11-04T01:39:01.420692+0000","last_became_active":"2023-11-04T01:38:59.419701+0000","last_became_peered":"2023-11-04T01:38:59.419701+0000","last_unstale":"2023-11-04T01:39:01.420692+0000","last_undegraded":"2023-11-04T01:39:01.420692+0000","last_fullsized":"2023-11-04T01:39:01.420692+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:13.597141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.410966+0000","last_change":"2023-11-04T01:38:37.215194+0000","last_active":"2023-11-04T01:38:59.410966+0000","last_peered":"2023-11-04T01:38:59.410966+0000","last_clean":"2023-11-04T01:38:59.410966+0000","last_became_active":"2023-11-04T01:38:37.214889+0000","last_became_peered":"2023-11-04T01:38:37.214889+0000","last_unstale":"2023-11-04T01:38:59.410966+0000","last_undegraded":"2023-11-04T01:38:59.410966+0000","last_fullsized":"2023-11-04T01:38:59.410966+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:03:06.059941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.420900+0000","last_change":"2023-11-04T01:38:38.457859+0000","last_active":"2023-11-04T01:38:59.420900+0000","last_peered":"2023-11-04T01:38:59.420900+0000","last_clean":"2023-11-04T01:38:59.420900+0000","last_became_active":"2023-11-04T01:38:36.220887+0000","last_became_peered":"2023-11-04T01:38:36.220887+0000","last_unstale":"2023-11-04T01:38:59.420900+0000","last_undegraded":"2023-11-04T01:38:59.420900+0000","last_fullsized":"2023-11-04T01:38:59.420900+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:26:26.339210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072014699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411661+0000","last_change":"2023-11-04T01:37:36.222868+0000","last_active":"2023-11-04T01:38:59.411661+0000","last_peered":"2023-11-04T01:38:59.411661+0000","last_clean":"2023-11-04T01:38:59.411661+0000","last_became_active":"2023-11-04T01:37:35.220180+0000","last_became_peered":"2023-11-04T01:37:35.220180+0000","last_unstale":"2023-11-04T01:38:59.411661+0000","last_undegraded":"2023-11-04T01:38:59.411661+0000","last_fullsized":"2023-11-04T01:38:59.411661+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001103574,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.433760+0000","last_change":"2023-11-04T01:39:00.429365+0000","last_active":"2023-11-04T01:39:00.433760+0000","last_peered":"2023-11-04T01:39:00.433760+0000","last_clean":"2023-11-04T01:39:00.433760+0000","last_became_active":"2023-11-04T01:39:00.429019+0000","last_became_peered":"2023-11-04T01:39:00.429019+0000","last_unstale":"2023-11-04T01:39:00.433760+0000","last_undegraded":"2023-11-04T01:39:00.433760+0000","last_fullsized":"2023-11-04T01:39:00.433760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:47.417595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.412310+0000","last_change":"2023-11-04T01:38:59.426775+0000","last_active":"2023-11-04T01:39:00.412310+0000","last_peered":"2023-11-04T01:39:00.412310+0000","last_clean":"2023-11-04T01:39:00.412310+0000","last_became_active":"2023-11-04T01:38:59.426482+0000","last_became_peered":"2023-11-04T01:38:59.426482+0000","last_unstale":"2023-11-04T01:39:00.412310+0000","last_undegraded":"2023-11-04T01:39:00.412310+0000","last_fullsized":"2023-11-04T01:39:00.412310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:24.556798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404133+0000","last_change":"2023-11-04T01:38:37.213107+0000","last_active":"2023-11-04T01:38:59.404133+0000","last_peered":"2023-11-04T01:38:59.404133+0000","last_clean":"2023-11-04T01:38:59.404133+0000","last_became_active":"2023-11-04T01:38:37.212801+0000","last_became_peered":"2023-11-04T01:38:37.212801+0000","last_unstale":"2023-11-04T01:38:59.404133+0000","last_undegraded":"2023-11-04T01:38:59.404133+0000","last_fullsized":"2023-11-04T01:38:59.404133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:57:14.922918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.412279+0000","last_change":"2023-11-04T01:38:38.208125+0000","last_active":"2023-11-04T01:38:59.412279+0000","last_peered":"2023-11-04T01:38:59.412279+0000","last_clean":"2023-11-04T01:38:59.412279+0000","last_became_active":"2023-11-04T01:38:36.219549+0000","last_became_peered":"2023-11-04T01:38:36.219549+0000","last_unstale":"2023-11-04T01:38:59.412279+0000","last_undegraded":"2023-11-04T01:38:59.412279+0000","last_fullsized":"2023-11-04T01:38:59.412279+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:01.357137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769686,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411076+0000","last_change":"2023-11-04T01:37:36.221053+0000","last_active":"2023-11-04T01:38:59.411076+0000","last_peered":"2023-11-04T01:38:59.411076+0000","last_clean":"2023-11-04T01:38:59.411076+0000","last_became_active":"2023-11-04T01:37:35.227176+0000","last_became_peered":"2023-11-04T01:37:35.227176+0000","last_unstale":"2023-11-04T01:38:59.411076+0000","last_undegraded":"2023-11-04T01:38:59.411076+0000","last_fullsized":"2023-11-04T01:38:59.411076+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000594178,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421981+0000","last_change":"2023-11-04T01:39:00.430191+0000","last_active":"2023-11-04T01:39:01.421981+0000","last_peered":"2023-11-04T01:39:01.421981+0000","last_clean":"2023-11-04T01:39:01.421981+0000","last_became_active":"2023-11-04T01:39:00.429453+0000","last_became_peered":"2023-11-04T01:39:00.429453+0000","last_unstale":"2023-11-04T01:39:01.421981+0000","last_undegraded":"2023-11-04T01:39:01.421981+0000","last_fullsized":"2023-11-04T01:39:01.421981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:50.550892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"83'8","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.440471+0000","last_change":"2023-11-04T01:38:59.419630+0000","last_active":"2023-11-04T01:39:00.440471+0000","last_peered":"2023-11-04T01:39:00.440471+0000","last_clean":"2023-11-04T01:39:00.440471+0000","last_became_active":"2023-11-04T01:38:59.419359+0000","last_became_peered":"2023-11-04T01:38:59.419359+0000","last_unstale":"2023-11-04T01:39:00.440471+0000","last_undegraded":"2023-11-04T01:39:00.440471+0000","last_fullsized":"2023-11-04T01:39:00.440471+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:16.451603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.406903+0000","last_change":"2023-11-04T01:38:37.215477+0000","last_active":"2023-11-04T01:39:00.406903+0000","last_peered":"2023-11-04T01:39:00.406903+0000","last_clean":"2023-11-04T01:39:00.406903+0000","last_became_active":"2023-11-04T01:38:37.215166+0000","last_became_peered":"2023-11-04T01:38:37.215166+0000","last_unstale":"2023-11-04T01:39:00.406903+0000","last_undegraded":"2023-11-04T01:39:00.406903+0000","last_fullsized":"2023-11-04T01:39:00.406903+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:22.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407041+0000","last_change":"2023-11-04T01:38:38.636546+0000","last_active":"2023-11-04T01:39:00.407041+0000","last_peered":"2023-11-04T01:39:00.407041+0000","last_clean":"2023-11-04T01:39:00.407041+0000","last_became_active":"2023-11-04T01:38:36.224162+0000","last_became_peered":"2023-11-04T01:38:36.224162+0000","last_unstale":"2023-11-04T01:39:00.407041+0000","last_undegraded":"2023-11-04T01:39:00.407041+0000","last_fullsized":"2023-11-04T01:39:00.407041+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:17.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062552400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411356+0000","last_change":"2023-11-04T01:37:36.221842+0000","last_active":"2023-11-04T01:38:59.411356+0000","last_peered":"2023-11-04T01:38:59.411356+0000","last_clean":"2023-11-04T01:38:59.411356+0000","last_became_active":"2023-11-04T01:37:35.214305+0000","last_became_peered":"2023-11-04T01:37:35.214305+0000","last_unstale":"2023-11-04T01:38:59.411356+0000","last_undegraded":"2023-11-04T01:38:59.411356+0000","last_fullsized":"2023-11-04T01:38:59.411356+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:13:05.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014999690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429310+0000","last_change":"2023-11-04T01:39:00.422832+0000","last_active":"2023-11-04T01:39:00.429310+0000","last_peered":"2023-11-04T01:39:00.429310+0000","last_clean":"2023-11-04T01:39:00.429310+0000","last_became_active":"2023-11-04T01:39:00.422573+0000","last_became_peered":"2023-11-04T01:39:00.422573+0000","last_unstale":"2023-11-04T01:39:00.429310+0000","last_undegraded":"2023-11-04T01:39:00.429310+0000","last_fullsized":"2023-11-04T01:39:00.429310+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:54:37.955807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.414893+0000","last_change":"2023-11-04T01:38:59.421773+0000","last_active":"2023-11-04T01:39:00.414893+0000","last_peered":"2023-11-04T01:39:00.414893+0000","last_clean":"2023-11-04T01:39:00.414893+0000","last_became_active":"2023-11-04T01:38:59.421115+0000","last_became_peered":"2023-11-04T01:38:59.421115+0000","last_unstale":"2023-11-04T01:39:00.414893+0000","last_undegraded":"2023-11-04T01:39:00.414893+0000","last_fullsized":"2023-11-04T01:39:00.414893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:05.315814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.403588+0000","last_change":"2023-11-04T01:38:37.216543+0000","last_active":"2023-11-04T01:38:59.403588+0000","last_peered":"2023-11-04T01:38:59.403588+0000","last_clean":"2023-11-04T01:38:59.403588+0000","last_became_active":"2023-11-04T01:38:37.216259+0000","last_became_peered":"2023-11-04T01:38:37.216259+0000","last_unstale":"2023-11-04T01:38:59.403588+0000","last_undegraded":"2023-11-04T01:38:59.403588+0000","last_fullsized":"2023-11-04T01:38:59.403588+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:20.702307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.410542+0000","last_change":"2023-11-04T01:38:38.205278+0000","last_active":"2023-11-04T01:38:59.410542+0000","last_peered":"2023-11-04T01:38:59.410542+0000","last_clean":"2023-11-04T01:38:59.410542+0000","last_became_active":"2023-11-04T01:38:36.220833+0000","last_became_peered":"2023-11-04T01:38:36.220833+0000","last_unstale":"2023-11-04T01:38:59.410542+0000","last_undegraded":"2023-11-04T01:38:59.410542+0000","last_fullsized":"2023-11-04T01:38:59.410542+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:26.345951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065079199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.403526+0000","last_change":"2023-11-04T01:37:36.694601+0000","last_active":"2023-11-04T01:38:59.403526+0000","last_peered":"2023-11-04T01:38:59.403526+0000","last_clean":"2023-11-04T01:38:59.403526+0000","last_became_active":"2023-11-04T01:37:35.223746+0000","last_became_peered":"2023-11-04T01:37:35.223746+0000","last_unstale":"2023-11-04T01:38:59.403526+0000","last_undegraded":"2023-11-04T01:38:59.403526+0000","last_fullsized":"2023-11-04T01:38:59.403526+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:35.960485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000555376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439910+0000","last_change":"2023-11-04T01:39:00.438512+0000","last_active":"2023-11-04T01:39:00.439910+0000","last_peered":"2023-11-04T01:39:00.439910+0000","last_clean":"2023-11-04T01:39:00.439910+0000","last_became_active":"2023-11-04T01:39:00.438080+0000","last_became_peered":"2023-11-04T01:39:00.438080+0000","last_unstale":"2023-11-04T01:39:00.439910+0000","last_undegraded":"2023-11-04T01:39:00.439910+0000","last_fullsized":"2023-11-04T01:39:00.439910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:42:11.513720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422122+0000","last_change":"2023-11-04T01:38:59.426296+0000","last_active":"2023-11-04T01:39:01.422122+0000","last_peered":"2023-11-04T01:39:01.422122+0000","last_clean":"2023-11-04T01:39:01.422122+0000","last_became_active":"2023-11-04T01:38:59.425971+0000","last_became_peered":"2023-11-04T01:38:59.425971+0000","last_unstale":"2023-11-04T01:39:01.422122+0000","last_undegraded":"2023-11-04T01:39:01.422122+0000","last_fullsized":"2023-11-04T01:39:01.422122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:02.076280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.409559+0000","last_change":"2023-11-04T01:38:37.216913+0000","last_active":"2023-11-04T01:38:59.409559+0000","last_peered":"2023-11-04T01:38:59.409559+0000","last_clean":"2023-11-04T01:38:59.409559+0000","last_became_active":"2023-11-04T01:38:37.216657+0000","last_became_peered":"2023-11-04T01:38:37.216657+0000","last_unstale":"2023-11-04T01:38:59.409559+0000","last_undegraded":"2023-11-04T01:38:59.409559+0000","last_fullsized":"2023-11-04T01:38:59.409559+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:01:49.838705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.403421+0000","last_change":"2023-11-04T01:38:38.410908+0000","last_active":"2023-11-04T01:38:59.403421+0000","last_peered":"2023-11-04T01:38:59.403421+0000","last_clean":"2023-11-04T01:38:59.403421+0000","last_became_active":"2023-11-04T01:38:36.215279+0000","last_became_peered":"2023-11-04T01:38:36.215279+0000","last_unstale":"2023-11-04T01:38:59.403421+0000","last_undegraded":"2023-11-04T01:38:59.403421+0000","last_fullsized":"2023-11-04T01:38:59.403421+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:58.822427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067743000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404360+0000","last_change":"2023-11-04T01:37:36.695075+0000","last_active":"2023-11-04T01:38:59.404360+0000","last_peered":"2023-11-04T01:38:59.404360+0000","last_clean":"2023-11-04T01:38:59.404360+0000","last_became_active":"2023-11-04T01:37:35.221165+0000","last_became_peered":"2023-11-04T01:37:35.221165+0000","last_unstale":"2023-11-04T01:38:59.404360+0000","last_undegraded":"2023-11-04T01:38:59.404360+0000","last_fullsized":"2023-11-04T01:38:59.404360+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:17.958372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072817499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420757+0000","last_change":"2023-11-04T01:39:00.415473+0000","last_active":"2023-11-04T01:39:01.420757+0000","last_peered":"2023-11-04T01:39:01.420757+0000","last_clean":"2023-11-04T01:39:01.420757+0000","last_became_active":"2023-11-04T01:39:00.415174+0000","last_became_peered":"2023-11-04T01:39:00.415174+0000","last_unstale":"2023-11-04T01:39:01.420757+0000","last_undegraded":"2023-11-04T01:39:01.420757+0000","last_fullsized":"2023-11-04T01:39:01.420757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:01:16.581681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"83'2","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422262+0000","last_change":"2023-11-04T01:38:59.427272+0000","last_active":"2023-11-04T01:39:01.422262+0000","last_peered":"2023-11-04T01:39:01.422262+0000","last_clean":"2023-11-04T01:39:01.422262+0000","last_became_active":"2023-11-04T01:38:59.426804+0000","last_became_peered":"2023-11-04T01:38:59.426804+0000","last_unstale":"2023-11-04T01:39:01.422262+0000","last_undegraded":"2023-11-04T01:39:01.422262+0000","last_fullsized":"2023-11-04T01:39:01.422262+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:27.404923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.410113+0000","last_change":"2023-11-04T01:38:37.216633+0000","last_active":"2023-11-04T01:38:59.410113+0000","last_peered":"2023-11-04T01:38:59.410113+0000","last_clean":"2023-11-04T01:38:59.410113+0000","last_became_active":"2023-11-04T01:38:37.216349+0000","last_became_peered":"2023-11-04T01:38:37.216349+0000","last_unstale":"2023-11-04T01:38:59.410113+0000","last_undegraded":"2023-11-04T01:38:59.410113+0000","last_fullsized":"2023-11-04T01:38:59.410113+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:39.883185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.420487+0000","last_change":"2023-11-04T01:38:38.457913+0000","last_active":"2023-11-04T01:38:59.420487+0000","last_peered":"2023-11-04T01:38:59.420487+0000","last_clean":"2023-11-04T01:38:59.420487+0000","last_became_active":"2023-11-04T01:38:36.212852+0000","last_became_peered":"2023-11-04T01:38:36.212852+0000","last_unstale":"2023-11-04T01:38:59.420487+0000","last_undegraded":"2023-11-04T01:38:59.420487+0000","last_fullsized":"2023-11-04T01:38:59.420487+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:17.912252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048391299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413339+0000","last_change":"2023-11-04T01:37:36.221747+0000","last_active":"2023-11-04T01:38:59.413339+0000","last_peered":"2023-11-04T01:38:59.413339+0000","last_clean":"2023-11-04T01:38:59.413339+0000","last_became_active":"2023-11-04T01:37:35.223198+0000","last_became_peered":"2023-11-04T01:37:35.223198+0000","last_unstale":"2023-11-04T01:38:59.413339+0000","last_undegraded":"2023-11-04T01:38:59.413339+0000","last_fullsized":"2023-11-04T01:38:59.413339+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097726499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429314+0000","last_change":"2023-11-04T01:39:00.425919+0000","last_active":"2023-11-04T01:39:00.429314+0000","last_peered":"2023-11-04T01:39:00.429314+0000","last_clean":"2023-11-04T01:39:00.429314+0000","last_became_active":"2023-11-04T01:39:00.425588+0000","last_became_peered":"2023-11-04T01:39:00.425588+0000","last_unstale":"2023-11-04T01:39:00.429314+0000","last_undegraded":"2023-11-04T01:39:00.429314+0000","last_fullsized":"2023-11-04T01:39:00.429314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:26.999543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.434939+0000","last_change":"2023-11-04T01:38:59.417466+0000","last_active":"2023-11-04T01:39:00.434939+0000","last_peered":"2023-11-04T01:39:00.434939+0000","last_clean":"2023-11-04T01:39:00.434939+0000","last_became_active":"2023-11-04T01:38:59.417003+0000","last_became_peered":"2023-11-04T01:38:59.417003+0000","last_unstale":"2023-11-04T01:39:00.434939+0000","last_undegraded":"2023-11-04T01:39:00.434939+0000","last_fullsized":"2023-11-04T01:39:00.434939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:25.699719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411556+0000","last_change":"2023-11-04T01:38:37.215329+0000","last_active":"2023-11-04T01:38:59.411556+0000","last_peered":"2023-11-04T01:38:59.411556+0000","last_clean":"2023-11-04T01:38:59.411556+0000","last_became_active":"2023-11-04T01:38:37.215049+0000","last_became_peered":"2023-11-04T01:38:37.215049+0000","last_unstale":"2023-11-04T01:38:59.411556+0000","last_undegraded":"2023-11-04T01:38:59.411556+0000","last_fullsized":"2023-11-04T01:38:59.411556+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:22.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413001+0000","last_change":"2023-11-04T01:38:38.207112+0000","last_active":"2023-11-04T01:38:59.413001+0000","last_peered":"2023-11-04T01:38:59.413001+0000","last_clean":"2023-11-04T01:38:59.413001+0000","last_became_active":"2023-11-04T01:38:36.213142+0000","last_became_peered":"2023-11-04T01:38:36.213142+0000","last_unstale":"2023-11-04T01:38:59.413001+0000","last_undegraded":"2023-11-04T01:38:59.413001+0000","last_fullsized":"2023-11-04T01:38:59.413001+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:49.027502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069641099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.408223+0000","last_change":"2023-11-04T01:37:36.422496+0000","last_active":"2023-11-04T01:39:00.408223+0000","last_peered":"2023-11-04T01:39:00.408223+0000","last_clean":"2023-11-04T01:39:00.408223+0000","last_became_active":"2023-11-04T01:37:35.221763+0000","last_became_peered":"2023-11-04T01:37:35.221763+0000","last_unstale":"2023-11-04T01:39:00.408223+0000","last_undegraded":"2023-11-04T01:39:00.408223+0000","last_fullsized":"2023-11-04T01:39:00.408223+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073676299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439931+0000","last_change":"2023-11-04T01:39:00.438851+0000","last_active":"2023-11-04T01:39:00.439931+0000","last_peered":"2023-11-04T01:39:00.439931+0000","last_clean":"2023-11-04T01:39:00.439931+0000","last_became_active":"2023-11-04T01:39:00.438580+0000","last_became_peered":"2023-11-04T01:39:00.438580+0000","last_unstale":"2023-11-04T01:39:00.439931+0000","last_undegraded":"2023-11-04T01:39:00.439931+0000","last_fullsized":"2023-11-04T01:39:00.439931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:54:13.232443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.437514+0000","last_change":"2023-11-04T01:38:59.423503+0000","last_active":"2023-11-04T01:39:00.437514+0000","last_peered":"2023-11-04T01:39:00.437514+0000","last_clean":"2023-11-04T01:39:00.437514+0000","last_became_active":"2023-11-04T01:38:59.422981+0000","last_became_peered":"2023-11-04T01:38:59.422981+0000","last_unstale":"2023-11-04T01:39:00.437514+0000","last_undegraded":"2023-11-04T01:39:00.437514+0000","last_fullsized":"2023-11-04T01:39:00.437514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:18.773223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.412849+0000","last_change":"2023-11-04T01:38:37.217518+0000","last_active":"2023-11-04T01:38:59.412849+0000","last_peered":"2023-11-04T01:38:59.412849+0000","last_clean":"2023-11-04T01:38:59.412849+0000","last_became_active":"2023-11-04T01:38:37.216984+0000","last_became_peered":"2023-11-04T01:38:37.216984+0000","last_unstale":"2023-11-04T01:38:59.412849+0000","last_undegraded":"2023-11-04T01:38:59.412849+0000","last_fullsized":"2023-11-04T01:38:59.412849+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:55.276622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411245+0000","last_change":"2023-11-04T01:38:38.208679+0000","last_active":"2023-11-04T01:38:59.411245+0000","last_peered":"2023-11-04T01:38:59.411245+0000","last_clean":"2023-11-04T01:38:59.411245+0000","last_became_active":"2023-11-04T01:38:36.213713+0000","last_became_peered":"2023-11-04T01:38:36.213713+0000","last_unstale":"2023-11-04T01:38:59.411245+0000","last_undegraded":"2023-11-04T01:38:59.411245+0000","last_fullsized":"2023-11-04T01:38:59.411245+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:17.912252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099153900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407692+0000","last_change":"2023-11-04T01:37:36.229940+0000","last_active":"2023-11-04T01:39:00.407692+0000","last_peered":"2023-11-04T01:39:00.407692+0000","last_clean":"2023-11-04T01:39:00.407692+0000","last_became_active":"2023-11-04T01:37:35.225121+0000","last_became_peered":"2023-11-04T01:37:35.225121+0000","last_unstale":"2023-11-04T01:39:00.407692+0000","last_undegraded":"2023-11-04T01:39:00.407692+0000","last_fullsized":"2023-11-04T01:39:00.407692+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:12.130671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075648399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420709+0000","last_change":"2023-11-04T01:39:00.419753+0000","last_active":"2023-11-04T01:39:01.420709+0000","last_peered":"2023-11-04T01:39:01.420709+0000","last_clean":"2023-11-04T01:39:01.420709+0000","last_became_active":"2023-11-04T01:39:00.419504+0000","last_became_peered":"2023-11-04T01:39:00.419504+0000","last_unstale":"2023-11-04T01:39:01.420709+0000","last_undegraded":"2023-11-04T01:39:01.420709+0000","last_fullsized":"2023-11-04T01:39:01.420709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:19.778505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"83'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421845+0000","last_change":"2023-11-04T01:38:59.426128+0000","last_active":"2023-11-04T01:39:01.421845+0000","last_peered":"2023-11-04T01:39:01.421845+0000","last_clean":"2023-11-04T01:39:01.421845+0000","last_became_active":"2023-11-04T01:38:59.425839+0000","last_became_peered":"2023-11-04T01:38:59.425839+0000","last_unstale":"2023-11-04T01:39:01.421845+0000","last_undegraded":"2023-11-04T01:39:01.421845+0000","last_fullsized":"2023-11-04T01:39:01.421845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:58.721847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407956+0000","last_change":"2023-11-04T01:38:37.216659+0000","last_active":"2023-11-04T01:39:00.407956+0000","last_peered":"2023-11-04T01:39:00.407956+0000","last_clean":"2023-11-04T01:39:00.407956+0000","last_became_active":"2023-11-04T01:38:37.216367+0000","last_became_peered":"2023-11-04T01:38:37.216367+0000","last_unstale":"2023-11-04T01:39:00.407956+0000","last_undegraded":"2023-11-04T01:39:00.407956+0000","last_fullsized":"2023-11-04T01:39:00.407956+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:05:01.957845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404354+0000","last_change":"2023-11-04T01:38:38.411751+0000","last_active":"2023-11-04T01:38:59.404354+0000","last_peered":"2023-11-04T01:38:59.404354+0000","last_clean":"2023-11-04T01:38:59.404354+0000","last_became_active":"2023-11-04T01:38:36.220709+0000","last_became_peered":"2023-11-04T01:38:36.220709+0000","last_unstale":"2023-11-04T01:38:59.404354+0000","last_undegraded":"2023-11-04T01:38:59.404354+0000","last_fullsized":"2023-11-04T01:38:59.404354+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:17.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075331200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407425+0000","last_change":"2023-11-04T01:37:36.422801+0000","last_active":"2023-11-04T01:39:00.407425+0000","last_peered":"2023-11-04T01:39:00.407425+0000","last_clean":"2023-11-04T01:39:00.407425+0000","last_became_active":"2023-11-04T01:37:35.217091+0000","last_became_peered":"2023-11-04T01:37:35.217091+0000","last_unstale":"2023-11-04T01:39:00.407425+0000","last_undegraded":"2023-11-04T01:39:00.407425+0000","last_fullsized":"2023-11-04T01:39:00.407425+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082211999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422819+0000","last_change":"2023-11-04T01:39:00.432878+0000","last_active":"2023-11-04T01:39:01.422819+0000","last_peered":"2023-11-04T01:39:01.422819+0000","last_clean":"2023-11-04T01:39:01.422819+0000","last_became_active":"2023-11-04T01:39:00.432527+0000","last_became_peered":"2023-11-04T01:39:00.432527+0000","last_unstale":"2023-11-04T01:39:01.422819+0000","last_undegraded":"2023-11-04T01:39:01.422819+0000","last_fullsized":"2023-11-04T01:39:01.422819+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:57.421878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"83'4","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.433038+0000","last_change":"2023-11-04T01:38:59.418993+0000","last_active":"2023-11-04T01:39:00.433038+0000","last_peered":"2023-11-04T01:39:00.433038+0000","last_clean":"2023-11-04T01:39:00.433038+0000","last_became_active":"2023-11-04T01:38:59.418719+0000","last_became_peered":"2023-11-04T01:38:59.418719+0000","last_unstale":"2023-11-04T01:39:00.433038+0000","last_undegraded":"2023-11-04T01:39:00.433038+0000","last_fullsized":"2023-11-04T01:39:00.433038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:23.908584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413550+0000","last_change":"2023-11-04T01:38:37.218855+0000","last_active":"2023-11-04T01:38:59.413550+0000","last_peered":"2023-11-04T01:38:59.413550+0000","last_clean":"2023-11-04T01:38:59.413550+0000","last_became_active":"2023-11-04T01:38:37.218475+0000","last_became_peered":"2023-11-04T01:38:37.218475+0000","last_unstale":"2023-11-04T01:38:59.413550+0000","last_undegraded":"2023-11-04T01:38:59.413550+0000","last_fullsized":"2023-11-04T01:38:59.413550+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:36.735726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404958+0000","last_change":"2023-11-04T01:38:38.411851+0000","last_active":"2023-11-04T01:38:59.404958+0000","last_peered":"2023-11-04T01:38:59.404958+0000","last_clean":"2023-11-04T01:38:59.404958+0000","last_became_active":"2023-11-04T01:38:36.220767+0000","last_became_peered":"2023-11-04T01:38:36.220767+0000","last_unstale":"2023-11-04T01:38:59.404958+0000","last_undegraded":"2023-11-04T01:38:59.404958+0000","last_fullsized":"2023-11-04T01:38:59.404958+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:42.712180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010894240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413114+0000","last_change":"2023-11-04T01:37:36.222683+0000","last_active":"2023-11-04T01:38:59.413114+0000","last_peered":"2023-11-04T01:38:59.413114+0000","last_clean":"2023-11-04T01:38:59.413114+0000","last_became_active":"2023-11-04T01:37:35.222694+0000","last_became_peered":"2023-11-04T01:37:35.222694+0000","last_unstale":"2023-11-04T01:38:59.413114+0000","last_undegraded":"2023-11-04T01:38:59.413114+0000","last_fullsized":"2023-11-04T01:38:59.413114+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000490194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429535+0000","last_change":"2023-11-04T01:39:00.425421+0000","last_active":"2023-11-04T01:39:00.429535+0000","last_peered":"2023-11-04T01:39:00.429535+0000","last_clean":"2023-11-04T01:39:00.429535+0000","last_became_active":"2023-11-04T01:39:00.424898+0000","last_became_peered":"2023-11-04T01:39:00.424898+0000","last_unstale":"2023-11-04T01:39:00.429535+0000","last_undegraded":"2023-11-04T01:39:00.429535+0000","last_fullsized":"2023-11-04T01:39:00.429535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:36.960488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.413655+0000","last_change":"2023-11-04T01:38:59.416958+0000","last_active":"2023-11-04T01:39:00.413655+0000","last_peered":"2023-11-04T01:39:00.413655+0000","last_clean":"2023-11-04T01:39:00.413655+0000","last_became_active":"2023-11-04T01:38:59.416663+0000","last_became_peered":"2023-11-04T01:38:59.416663+0000","last_unstale":"2023-11-04T01:39:00.413655+0000","last_undegraded":"2023-11-04T01:39:00.413655+0000","last_fullsized":"2023-11-04T01:39:00.413655+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:41.111912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.409811+0000","last_change":"2023-11-04T01:38:37.210833+0000","last_active":"2023-11-04T01:38:59.409811+0000","last_peered":"2023-11-04T01:38:59.409811+0000","last_clean":"2023-11-04T01:38:59.409811+0000","last_became_active":"2023-11-04T01:38:37.210565+0000","last_became_peered":"2023-11-04T01:38:37.210565+0000","last_unstale":"2023-11-04T01:38:59.409811+0000","last_undegraded":"2023-11-04T01:38:59.409811+0000","last_fullsized":"2023-11-04T01:38:59.409811+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:14:41.863734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413196+0000","last_change":"2023-11-04T01:38:38.206088+0000","last_active":"2023-11-04T01:38:59.413196+0000","last_peered":"2023-11-04T01:38:59.413196+0000","last_clean":"2023-11-04T01:38:59.413196+0000","last_became_active":"2023-11-04T01:38:36.220921+0000","last_became_peered":"2023-11-04T01:38:36.220921+0000","last_unstale":"2023-11-04T01:38:59.413196+0000","last_undegraded":"2023-11-04T01:38:59.413196+0000","last_fullsized":"2023-11-04T01:38:59.413196+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:33.216936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091997800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407249+0000","last_change":"2023-11-04T01:37:36.422156+0000","last_active":"2023-11-04T01:39:00.407249+0000","last_peered":"2023-11-04T01:39:00.407249+0000","last_clean":"2023-11-04T01:39:00.407249+0000","last_became_active":"2023-11-04T01:37:35.214925+0000","last_became_peered":"2023-11-04T01:37:35.214925+0000","last_unstale":"2023-11-04T01:39:00.407249+0000","last_undegraded":"2023-11-04T01:39:00.407249+0000","last_fullsized":"2023-11-04T01:39:00.407249+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058029000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420102+0000","last_change":"2023-11-04T01:39:00.431788+0000","last_active":"2023-11-04T01:39:01.420102+0000","last_peered":"2023-11-04T01:39:01.420102+0000","last_clean":"2023-11-04T01:39:01.420102+0000","last_became_active":"2023-11-04T01:39:00.431502+0000","last_became_peered":"2023-11-04T01:39:00.431502+0000","last_unstale":"2023-11-04T01:39:01.420102+0000","last_undegraded":"2023-11-04T01:39:01.420102+0000","last_fullsized":"2023-11-04T01:39:01.420102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:57.706472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.410814+0000","last_change":"2023-11-04T01:38:59.418298+0000","last_active":"2023-11-04T01:39:00.410814+0000","last_peered":"2023-11-04T01:39:00.410814+0000","last_clean":"2023-11-04T01:39:00.410814+0000","last_became_active":"2023-11-04T01:38:59.417757+0000","last_became_peered":"2023-11-04T01:38:59.417757+0000","last_unstale":"2023-11-04T01:39:00.410814+0000","last_undegraded":"2023-11-04T01:39:00.410814+0000","last_fullsized":"2023-11-04T01:39:00.410814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:27.568981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411355+0000","last_change":"2023-11-04T01:38:37.217048+0000","last_active":"2023-11-04T01:38:59.411355+0000","last_peered":"2023-11-04T01:38:59.411355+0000","last_clean":"2023-11-04T01:38:59.411355+0000","last_became_active":"2023-11-04T01:38:37.216763+0000","last_became_peered":"2023-11-04T01:38:37.216763+0000","last_unstale":"2023-11-04T01:38:59.411355+0000","last_undegraded":"2023-11-04T01:38:59.411355+0000","last_fullsized":"2023-11-04T01:38:59.411355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:59.011790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.409891+0000","last_change":"2023-11-04T01:38:38.206767+0000","last_active":"2023-11-04T01:38:59.409891+0000","last_peered":"2023-11-04T01:38:59.409891+0000","last_clean":"2023-11-04T01:38:59.409891+0000","last_became_active":"2023-11-04T01:38:36.221413+0000","last_became_peered":"2023-11-04T01:38:36.221413+0000","last_unstale":"2023-11-04T01:38:59.409891+0000","last_undegraded":"2023-11-04T01:38:59.409891+0000","last_fullsized":"2023-11-04T01:38:59.409891+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:08.788172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000941179,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.406355+0000","last_change":"2023-11-04T01:37:36.229258+0000","last_active":"2023-11-04T01:39:00.406355+0000","last_peered":"2023-11-04T01:39:00.406355+0000","last_clean":"2023-11-04T01:39:00.406355+0000","last_became_active":"2023-11-04T01:37:35.221720+0000","last_became_peered":"2023-11-04T01:37:35.221720+0000","last_unstale":"2023-11-04T01:39:00.406355+0000","last_undegraded":"2023-11-04T01:39:00.406355+0000","last_fullsized":"2023-11-04T01:39:00.406355+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:09.633236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068644799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421678+0000","last_change":"2023-11-04T01:39:00.417648+0000","last_active":"2023-11-04T01:39:01.421678+0000","last_peered":"2023-11-04T01:39:01.421678+0000","last_clean":"2023-11-04T01:39:01.421678+0000","last_became_active":"2023-11-04T01:39:00.417390+0000","last_became_peered":"2023-11-04T01:39:00.417390+0000","last_unstale":"2023-11-04T01:39:01.421678+0000","last_undegraded":"2023-11-04T01:39:01.421678+0000","last_fullsized":"2023-11-04T01:39:01.421678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:35.272381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.434657+0000","last_change":"2023-11-04T01:38:59.416768+0000","last_active":"2023-11-04T01:39:00.434657+0000","last_peered":"2023-11-04T01:39:00.434657+0000","last_clean":"2023-11-04T01:39:00.434657+0000","last_became_active":"2023-11-04T01:38:59.416491+0000","last_became_peered":"2023-11-04T01:38:59.416491+0000","last_unstale":"2023-11-04T01:39:00.434657+0000","last_undegraded":"2023-11-04T01:39:00.434657+0000","last_fullsized":"2023-11-04T01:39:00.434657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:06.157777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.406847+0000","last_change":"2023-11-04T01:38:37.214917+0000","last_active":"2023-11-04T01:39:00.406847+0000","last_peered":"2023-11-04T01:39:00.406847+0000","last_clean":"2023-11-04T01:39:00.406847+0000","last_became_active":"2023-11-04T01:38:37.214649+0000","last_became_peered":"2023-11-04T01:38:37.214649+0000","last_unstale":"2023-11-04T01:39:00.406847+0000","last_undegraded":"2023-11-04T01:39:00.406847+0000","last_fullsized":"2023-11-04T01:39:00.406847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:43.122719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.410191+0000","last_change":"2023-11-04T01:38:38.205229+0000","last_active":"2023-11-04T01:38:59.410191+0000","last_peered":"2023-11-04T01:38:59.410191+0000","last_clean":"2023-11-04T01:38:59.410191+0000","last_became_active":"2023-11-04T01:38:36.213122+0000","last_became_peered":"2023-11-04T01:38:36.213122+0000","last_unstale":"2023-11-04T01:38:59.410191+0000","last_undegraded":"2023-11-04T01:38:59.410191+0000","last_fullsized":"2023-11-04T01:38:59.410191+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:24.233394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000519342,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404451+0000","last_change":"2023-11-04T01:37:36.695175+0000","last_active":"2023-11-04T01:38:59.404451+0000","last_peered":"2023-11-04T01:38:59.404451+0000","last_clean":"2023-11-04T01:38:59.404451+0000","last_became_active":"2023-11-04T01:37:35.224473+0000","last_became_peered":"2023-11-04T01:37:35.224473+0000","last_unstale":"2023-11-04T01:38:59.404451+0000","last_undegraded":"2023-11-04T01:38:59.404451+0000","last_fullsized":"2023-11-04T01:38:59.404451+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065377199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429423+0000","last_change":"2023-11-04T01:39:00.427939+0000","last_active":"2023-11-04T01:39:00.429423+0000","last_peered":"2023-11-04T01:39:00.429423+0000","last_clean":"2023-11-04T01:39:00.429423+0000","last_became_active":"2023-11-04T01:39:00.427678+0000","last_became_peered":"2023-11-04T01:39:00.427678+0000","last_unstale":"2023-11-04T01:39:00.429423+0000","last_undegraded":"2023-11-04T01:39:00.429423+0000","last_fullsized":"2023-11-04T01:39:00.429423+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:06.321096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.441204+0000","last_change":"2023-11-04T01:38:59.420481+0000","last_active":"2023-11-04T01:39:00.441204+0000","last_peered":"2023-11-04T01:39:00.441204+0000","last_clean":"2023-11-04T01:39:00.441204+0000","last_became_active":"2023-11-04T01:38:59.420210+0000","last_became_peered":"2023-11-04T01:38:59.420210+0000","last_unstale":"2023-11-04T01:39:00.441204+0000","last_undegraded":"2023-11-04T01:39:00.441204+0000","last_fullsized":"2023-11-04T01:39:00.441204+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:39:14.134960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.406699+0000","last_change":"2023-11-04T01:38:37.214806+0000","last_active":"2023-11-04T01:39:00.406699+0000","last_peered":"2023-11-04T01:39:00.406699+0000","last_clean":"2023-11-04T01:39:00.406699+0000","last_became_active":"2023-11-04T01:38:37.214511+0000","last_became_peered":"2023-11-04T01:38:37.214511+0000","last_unstale":"2023-11-04T01:39:00.406699+0000","last_undegraded":"2023-11-04T01:39:00.406699+0000","last_fullsized":"2023-11-04T01:39:00.406699+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:48.315344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.403413+0000","last_change":"2023-11-04T01:38:38.411265+0000","last_active":"2023-11-04T01:38:59.403413+0000","last_peered":"2023-11-04T01:38:59.403413+0000","last_clean":"2023-11-04T01:38:59.403413+0000","last_became_active":"2023-11-04T01:38:36.216615+0000","last_became_peered":"2023-11-04T01:38:36.216615+0000","last_unstale":"2023-11-04T01:38:59.403413+0000","last_undegraded":"2023-11-04T01:38:59.403413+0000","last_fullsized":"2023-11-04T01:38:59.403413+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:02.794601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095689400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.409421+0000","last_change":"2023-11-04T01:37:36.222100+0000","last_active":"2023-11-04T01:38:59.409421+0000","last_peered":"2023-11-04T01:38:59.409421+0000","last_clean":"2023-11-04T01:38:59.409421+0000","last_became_active":"2023-11-04T01:37:35.219622+0000","last_became_peered":"2023-11-04T01:37:35.219622+0000","last_unstale":"2023-11-04T01:38:59.409421+0000","last_undegraded":"2023-11-04T01:38:59.409421+0000","last_fullsized":"2023-11-04T01:38:59.409421+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:16.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653496,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429443+0000","last_change":"2023-11-04T01:39:00.423450+0000","last_active":"2023-11-04T01:39:00.429443+0000","last_peered":"2023-11-04T01:39:00.429443+0000","last_clean":"2023-11-04T01:39:00.429443+0000","last_became_active":"2023-11-04T01:39:00.423001+0000","last_became_peered":"2023-11-04T01:39:00.423001+0000","last_unstale":"2023-11-04T01:39:00.429443+0000","last_undegraded":"2023-11-04T01:39:00.429443+0000","last_fullsized":"2023-11-04T01:39:00.429443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:57.295246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.410218+0000","last_change":"2023-11-04T01:38:59.421732+0000","last_active":"2023-11-04T01:39:00.410218+0000","last_peered":"2023-11-04T01:39:00.410218+0000","last_clean":"2023-11-04T01:39:00.410218+0000","last_became_active":"2023-11-04T01:38:59.421471+0000","last_became_peered":"2023-11-04T01:38:59.421471+0000","last_unstale":"2023-11-04T01:39:00.410218+0000","last_undegraded":"2023-11-04T01:39:00.410218+0000","last_fullsized":"2023-11-04T01:39:00.410218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:37:01.401481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407343+0000","last_change":"2023-11-04T01:38:37.217077+0000","last_active":"2023-11-04T01:39:00.407343+0000","last_peered":"2023-11-04T01:39:00.407343+0000","last_clean":"2023-11-04T01:39:00.407343+0000","last_became_active":"2023-11-04T01:38:37.216746+0000","last_became_peered":"2023-11-04T01:38:37.216746+0000","last_unstale":"2023-11-04T01:39:00.407343+0000","last_undegraded":"2023-11-04T01:39:00.407343+0000","last_fullsized":"2023-11-04T01:39:00.407343+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:59.828993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.410985+0000","last_change":"2023-11-04T01:38:38.205823+0000","last_active":"2023-11-04T01:38:59.410985+0000","last_peered":"2023-11-04T01:38:59.410985+0000","last_clean":"2023-11-04T01:38:59.410985+0000","last_became_active":"2023-11-04T01:38:36.218347+0000","last_became_peered":"2023-11-04T01:38:36.218347+0000","last_unstale":"2023-11-04T01:38:59.410985+0000","last_undegraded":"2023-11-04T01:38:59.410985+0000","last_fullsized":"2023-11-04T01:38:59.410985+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:24:42.129853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042101900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.412412+0000","last_change":"2023-11-04T01:37:36.222451+0000","last_active":"2023-11-04T01:38:59.412412+0000","last_peered":"2023-11-04T01:38:59.412412+0000","last_clean":"2023-11-04T01:38:59.412412+0000","last_became_active":"2023-11-04T01:37:35.221090+0000","last_became_peered":"2023-11-04T01:37:35.221090+0000","last_unstale":"2023-11-04T01:38:59.412412+0000","last_undegraded":"2023-11-04T01:38:59.412412+0000","last_fullsized":"2023-11-04T01:38:59.412412+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077263799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439143+0000","last_change":"2023-11-04T01:39:00.435357+0000","last_active":"2023-11-04T01:39:00.439143+0000","last_peered":"2023-11-04T01:39:00.439143+0000","last_clean":"2023-11-04T01:39:00.439143+0000","last_became_active":"2023-11-04T01:39:00.435090+0000","last_became_peered":"2023-11-04T01:39:00.435090+0000","last_unstale":"2023-11-04T01:39:00.439143+0000","last_undegraded":"2023-11-04T01:39:00.439143+0000","last_fullsized":"2023-11-04T01:39:00.439143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:59.934103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.415591+0000","last_change":"2023-11-04T01:38:59.417278+0000","last_active":"2023-11-04T01:39:00.415591+0000","last_peered":"2023-11-04T01:39:00.415591+0000","last_clean":"2023-11-04T01:39:00.415591+0000","last_became_active":"2023-11-04T01:38:59.416428+0000","last_became_peered":"2023-11-04T01:38:59.416428+0000","last_unstale":"2023-11-04T01:39:00.415591+0000","last_undegraded":"2023-11-04T01:39:00.415591+0000","last_fullsized":"2023-11-04T01:39:00.415591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:01:15.576400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.412931+0000","last_change":"2023-11-04T01:38:37.212670+0000","last_active":"2023-11-04T01:38:59.412931+0000","last_peered":"2023-11-04T01:38:59.412931+0000","last_clean":"2023-11-04T01:38:59.412931+0000","last_became_active":"2023-11-04T01:38:37.212044+0000","last_became_peered":"2023-11-04T01:38:37.212044+0000","last_unstale":"2023-11-04T01:38:59.412931+0000","last_undegraded":"2023-11-04T01:38:59.412931+0000","last_fullsized":"2023-11-04T01:38:59.412931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:23.460377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411776+0000","last_change":"2023-11-04T01:38:38.205885+0000","last_active":"2023-11-04T01:38:59.411776+0000","last_peered":"2023-11-04T01:38:59.411776+0000","last_clean":"2023-11-04T01:38:59.411776+0000","last_became_active":"2023-11-04T01:38:36.218439+0000","last_became_peered":"2023-11-04T01:38:36.218439+0000","last_unstale":"2023-11-04T01:38:59.411776+0000","last_undegraded":"2023-11-04T01:38:59.411776+0000","last_fullsized":"2023-11-04T01:38:59.411776+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:50.283563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039456400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413712+0000","last_change":"2023-11-04T01:37:36.222643+0000","last_active":"2023-11-04T01:38:59.413712+0000","last_peered":"2023-11-04T01:38:59.413712+0000","last_clean":"2023-11-04T01:38:59.413712+0000","last_became_active":"2023-11-04T01:37:35.215534+0000","last_became_peered":"2023-11-04T01:37:35.215534+0000","last_unstale":"2023-11-04T01:38:59.413712+0000","last_undegraded":"2023-11-04T01:38:59.413712+0000","last_fullsized":"2023-11-04T01:38:59.413712+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011110530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439883+0000","last_change":"2023-11-04T01:39:00.438402+0000","last_active":"2023-11-04T01:39:00.439883+0000","last_peered":"2023-11-04T01:39:00.439883+0000","last_clean":"2023-11-04T01:39:00.439883+0000","last_became_active":"2023-11-04T01:39:00.438094+0000","last_became_peered":"2023-11-04T01:39:00.438094+0000","last_unstale":"2023-11-04T01:39:00.439883+0000","last_undegraded":"2023-11-04T01:39:00.439883+0000","last_fullsized":"2023-11-04T01:39:00.439883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:18.474998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.417634+0000","last_change":"2023-11-04T01:38:59.424830+0000","last_active":"2023-11-04T01:39:00.417634+0000","last_peered":"2023-11-04T01:39:00.417634+0000","last_clean":"2023-11-04T01:39:00.417634+0000","last_became_active":"2023-11-04T01:38:59.424329+0000","last_became_peered":"2023-11-04T01:38:59.424329+0000","last_unstale":"2023-11-04T01:39:00.417634+0000","last_undegraded":"2023-11-04T01:39:00.417634+0000","last_fullsized":"2023-11-04T01:39:00.417634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:39:04.054090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411137+0000","last_change":"2023-11-04T01:38:37.214797+0000","last_active":"2023-11-04T01:38:59.411137+0000","last_peered":"2023-11-04T01:38:59.411137+0000","last_clean":"2023-11-04T01:38:59.411137+0000","last_became_active":"2023-11-04T01:38:37.214465+0000","last_became_peered":"2023-11-04T01:38:37.214465+0000","last_unstale":"2023-11-04T01:38:59.411137+0000","last_undegraded":"2023-11-04T01:38:59.411137+0000","last_fullsized":"2023-11-04T01:38:59.411137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:36.735726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413640+0000","last_change":"2023-11-04T01:38:38.207798+0000","last_active":"2023-11-04T01:38:59.413640+0000","last_peered":"2023-11-04T01:38:59.413640+0000","last_clean":"2023-11-04T01:38:59.413640+0000","last_became_active":"2023-11-04T01:38:36.213815+0000","last_became_peered":"2023-11-04T01:38:36.213815+0000","last_unstale":"2023-11-04T01:38:59.413640+0000","last_undegraded":"2023-11-04T01:38:59.413640+0000","last_fullsized":"2023-11-04T01:38:59.413640+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:54.270056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092951700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404641+0000","last_change":"2023-11-04T01:37:36.695402+0000","last_active":"2023-11-04T01:38:59.404641+0000","last_peered":"2023-11-04T01:38:59.404641+0000","last_clean":"2023-11-04T01:38:59.404641+0000","last_became_active":"2023-11-04T01:37:35.220346+0000","last_became_peered":"2023-11-04T01:37:35.220346+0000","last_unstale":"2023-11-04T01:38:59.404641+0000","last_undegraded":"2023-11-04T01:38:59.404641+0000","last_fullsized":"2023-11-04T01:38:59.404641+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062230100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431206+0000","last_change":"2023-11-04T01:39:00.424968+0000","last_active":"2023-11-04T01:39:00.431206+0000","last_peered":"2023-11-04T01:39:00.431206+0000","last_clean":"2023-11-04T01:39:00.431206+0000","last_became_active":"2023-11-04T01:39:00.424678+0000","last_became_peered":"2023-11-04T01:39:00.424678+0000","last_unstale":"2023-11-04T01:39:00.431206+0000","last_undegraded":"2023-11-04T01:39:00.431206+0000","last_fullsized":"2023-11-04T01:39:00.431206+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:27:37.631870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431991+0000","last_change":"2023-11-04T01:38:59.424623+0000","last_active":"2023-11-04T01:39:00.431991+0000","last_peered":"2023-11-04T01:39:00.431991+0000","last_clean":"2023-11-04T01:39:00.431991+0000","last_became_active":"2023-11-04T01:38:59.424341+0000","last_became_peered":"2023-11-04T01:38:59.424341+0000","last_unstale":"2023-11-04T01:39:00.431991+0000","last_undegraded":"2023-11-04T01:39:00.431991+0000","last_fullsized":"2023-11-04T01:39:00.431991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:24.664171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413698+0000","last_change":"2023-11-04T01:38:37.216420+0000","last_active":"2023-11-04T01:38:59.413698+0000","last_peered":"2023-11-04T01:38:59.413698+0000","last_clean":"2023-11-04T01:38:59.413698+0000","last_became_active":"2023-11-04T01:38:37.216145+0000","last_became_peered":"2023-11-04T01:38:37.216145+0000","last_unstale":"2023-11-04T01:38:59.413698+0000","last_undegraded":"2023-11-04T01:38:59.413698+0000","last_fullsized":"2023-11-04T01:38:59.413698+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:19.049672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.412199+0000","last_change":"2023-11-04T01:38:38.207981+0000","last_active":"2023-11-04T01:38:59.412199+0000","last_peered":"2023-11-04T01:38:59.412199+0000","last_clean":"2023-11-04T01:38:59.412199+0000","last_became_active":"2023-11-04T01:38:36.213518+0000","last_became_peered":"2023-11-04T01:38:36.213518+0000","last_unstale":"2023-11-04T01:38:59.412199+0000","last_undegraded":"2023-11-04T01:38:59.412199+0000","last_fullsized":"2023-11-04T01:38:59.412199+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:20.114870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000824821,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":55,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.417727+0000","last_change":"2023-11-04T01:37:36.426315+0000","last_active":"2023-11-04T01:39:00.417727+0000","last_peered":"2023-11-04T01:39:00.417727+0000","last_clean":"2023-11-04T01:39:00.417727+0000","last_became_active":"2023-11-04T01:37:35.223958+0000","last_became_peered":"2023-11-04T01:37:35.223958+0000","last_unstale":"2023-11-04T01:39:00.417727+0000","last_undegraded":"2023-11-04T01:39:00.417727+0000","last_fullsized":"2023-11-04T01:39:00.417727+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:46.733116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025167400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.420816+0000","last_change":"2023-11-04T01:39:00.417393+0000","last_active":"2023-11-04T01:39:00.420816+0000","last_peered":"2023-11-04T01:39:00.420816+0000","last_clean":"2023-11-04T01:39:00.420816+0000","last_became_active":"2023-11-04T01:39:00.417116+0000","last_became_peered":"2023-11-04T01:39:00.417116+0000","last_unstale":"2023-11-04T01:39:00.420816+0000","last_undegraded":"2023-11-04T01:39:00.420816+0000","last_fullsized":"2023-11-04T01:39:00.420816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:29.863391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421847+0000","last_change":"2023-11-04T01:38:59.422737+0000","last_active":"2023-11-04T01:39:01.421847+0000","last_peered":"2023-11-04T01:39:01.421847+0000","last_clean":"2023-11-04T01:39:01.421847+0000","last_became_active":"2023-11-04T01:38:59.422446+0000","last_became_peered":"2023-11-04T01:38:59.422446+0000","last_unstale":"2023-11-04T01:39:01.421847+0000","last_undegraded":"2023-11-04T01:39:01.421847+0000","last_fullsized":"2023-11-04T01:39:01.421847+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:19.358866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404122+0000","last_change":"2023-11-04T01:38:37.214483+0000","last_active":"2023-11-04T01:38:59.404122+0000","last_peered":"2023-11-04T01:38:59.404122+0000","last_clean":"2023-11-04T01:38:59.404122+0000","last_became_active":"2023-11-04T01:38:37.214116+0000","last_became_peered":"2023-11-04T01:38:37.214116+0000","last_unstale":"2023-11-04T01:38:59.404122+0000","last_undegraded":"2023-11-04T01:38:59.404122+0000","last_fullsized":"2023-11-04T01:38:59.404122+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:41:24.595793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.413270+0000","last_change":"2023-11-04T01:38:38.206897+0000","last_active":"2023-11-04T01:38:59.413270+0000","last_peered":"2023-11-04T01:38:59.413270+0000","last_clean":"2023-11-04T01:38:59.413270+0000","last_became_active":"2023-11-04T01:38:36.220906+0000","last_became_peered":"2023-11-04T01:38:36.220906+0000","last_unstale":"2023-11-04T01:38:59.413270+0000","last_undegraded":"2023-11-04T01:38:59.413270+0000","last_fullsized":"2023-11-04T01:38:59.413270+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:08:23.409256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001547536,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.403509+0000","last_change":"2023-11-04T01:37:36.694540+0000","last_active":"2023-11-04T01:38:59.403509+0000","last_peered":"2023-11-04T01:38:59.403509+0000","last_clean":"2023-11-04T01:38:59.403509+0000","last_became_active":"2023-11-04T01:37:35.225863+0000","last_became_peered":"2023-11-04T01:37:35.225863+0000","last_unstale":"2023-11-04T01:38:59.403509+0000","last_undegraded":"2023-11-04T01:38:59.403509+0000","last_fullsized":"2023-11-04T01:38:59.403509+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:42.654853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042277299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422173+0000","last_change":"2023-11-04T01:39:00.437354+0000","last_active":"2023-11-04T01:39:01.422173+0000","last_peered":"2023-11-04T01:39:01.422173+0000","last_clean":"2023-11-04T01:39:01.422173+0000","last_became_active":"2023-11-04T01:39:00.437069+0000","last_became_peered":"2023-11-04T01:39:00.437069+0000","last_unstale":"2023-11-04T01:39:01.422173+0000","last_undegraded":"2023-11-04T01:39:01.422173+0000","last_fullsized":"2023-11-04T01:39:01.422173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:14.488505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.420221+0000","last_change":"2023-11-04T01:38:59.421874+0000","last_active":"2023-11-04T01:39:01.420221+0000","last_peered":"2023-11-04T01:39:01.420221+0000","last_clean":"2023-11-04T01:39:01.420221+0000","last_became_active":"2023-11-04T01:38:59.421598+0000","last_became_peered":"2023-11-04T01:38:59.421598+0000","last_unstale":"2023-11-04T01:39:01.420221+0000","last_undegraded":"2023-11-04T01:39:01.420221+0000","last_fullsized":"2023-11-04T01:39:01.420221+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:59.261370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.420807+0000","last_change":"2023-11-04T01:38:37.213554+0000","last_active":"2023-11-04T01:38:59.420807+0000","last_peered":"2023-11-04T01:38:59.420807+0000","last_clean":"2023-11-04T01:38:59.420807+0000","last_became_active":"2023-11-04T01:38:37.213233+0000","last_became_peered":"2023-11-04T01:38:37.213233+0000","last_unstale":"2023-11-04T01:38:59.420807+0000","last_undegraded":"2023-11-04T01:38:59.420807+0000","last_fullsized":"2023-11-04T01:38:59.420807+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:19.049672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404287+0000","last_change":"2023-11-04T01:38:38.411573+0000","last_active":"2023-11-04T01:38:59.404287+0000","last_peered":"2023-11-04T01:38:59.404287+0000","last_clean":"2023-11-04T01:38:59.404287+0000","last_became_active":"2023-11-04T01:38:36.217578+0000","last_became_peered":"2023-11-04T01:38:36.217578+0000","last_unstale":"2023-11-04T01:38:59.404287+0000","last_undegraded":"2023-11-04T01:38:59.404287+0000","last_fullsized":"2023-11-04T01:38:59.404287+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:42.116154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067089600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":55,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.422759+0000","last_change":"2023-11-04T01:37:36.426202+0000","last_active":"2023-11-04T01:39:00.422759+0000","last_peered":"2023-11-04T01:39:00.422759+0000","last_clean":"2023-11-04T01:39:00.422759+0000","last_became_active":"2023-11-04T01:37:35.222997+0000","last_became_peered":"2023-11-04T01:37:35.222997+0000","last_unstale":"2023-11-04T01:39:00.422759+0000","last_undegraded":"2023-11-04T01:39:00.422759+0000","last_fullsized":"2023-11-04T01:39:00.422759+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:18.980751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041393700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.429316+0000","last_change":"2023-11-04T01:39:00.426203+0000","last_active":"2023-11-04T01:39:00.429316+0000","last_peered":"2023-11-04T01:39:00.429316+0000","last_clean":"2023-11-04T01:39:00.429316+0000","last_became_active":"2023-11-04T01:39:00.424053+0000","last_became_peered":"2023-11-04T01:39:00.424053+0000","last_unstale":"2023-11-04T01:39:00.429316+0000","last_undegraded":"2023-11-04T01:39:00.429316+0000","last_fullsized":"2023-11-04T01:39:00.429316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:05:25.156222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.410037+0000","last_change":"2023-11-04T01:38:59.422815+0000","last_active":"2023-11-04T01:39:00.410037+0000","last_peered":"2023-11-04T01:39:00.410037+0000","last_clean":"2023-11-04T01:39:00.410037+0000","last_became_active":"2023-11-04T01:38:59.422525+0000","last_became_peered":"2023-11-04T01:38:59.422525+0000","last_unstale":"2023-11-04T01:39:00.410037+0000","last_undegraded":"2023-11-04T01:39:00.410037+0000","last_fullsized":"2023-11-04T01:39:00.410037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:25:12.681388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411083+0000","last_change":"2023-11-04T01:38:37.215851+0000","last_active":"2023-11-04T01:38:59.411083+0000","last_peered":"2023-11-04T01:38:59.411083+0000","last_clean":"2023-11-04T01:38:59.411083+0000","last_became_active":"2023-11-04T01:38:37.215502+0000","last_became_peered":"2023-11-04T01:38:37.215502+0000","last_unstale":"2023-11-04T01:38:59.411083+0000","last_undegraded":"2023-11-04T01:38:59.411083+0000","last_fullsized":"2023-11-04T01:38:59.411083+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:22.227302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411755+0000","last_change":"2023-11-04T01:38:38.206372+0000","last_active":"2023-11-04T01:38:59.411755+0000","last_peered":"2023-11-04T01:38:59.411755+0000","last_clean":"2023-11-04T01:38:59.411755+0000","last_became_active":"2023-11-04T01:38:36.211612+0000","last_became_peered":"2023-11-04T01:38:36.211612+0000","last_unstale":"2023-11-04T01:38:59.411755+0000","last_undegraded":"2023-11-04T01:38:59.411755+0000","last_fullsized":"2023-11-04T01:38:59.411755+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:35.785664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015171970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.410613+0000","last_change":"2023-11-04T01:37:36.220713+0000","last_active":"2023-11-04T01:38:59.410613+0000","last_peered":"2023-11-04T01:38:59.410613+0000","last_clean":"2023-11-04T01:38:59.410613+0000","last_became_active":"2023-11-04T01:37:35.220311+0000","last_became_peered":"2023-11-04T01:37:35.220311+0000","last_unstale":"2023-11-04T01:38:59.410613+0000","last_undegraded":"2023-11-04T01:38:59.410613+0000","last_fullsized":"2023-11-04T01:38:59.410613+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062999799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422423+0000","last_change":"2023-11-04T01:39:00.436564+0000","last_active":"2023-11-04T01:39:01.422423+0000","last_peered":"2023-11-04T01:39:01.422423+0000","last_clean":"2023-11-04T01:39:01.422423+0000","last_became_active":"2023-11-04T01:39:00.433140+0000","last_became_peered":"2023-11-04T01:39:00.433140+0000","last_unstale":"2023-11-04T01:39:01.422423+0000","last_undegraded":"2023-11-04T01:39:01.422423+0000","last_fullsized":"2023-11-04T01:39:01.422423+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:49:21.814992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.413252+0000","last_change":"2023-11-04T01:38:59.415829+0000","last_active":"2023-11-04T01:39:00.413252+0000","last_peered":"2023-11-04T01:39:00.413252+0000","last_clean":"2023-11-04T01:39:00.413252+0000","last_became_active":"2023-11-04T01:38:59.415395+0000","last_became_peered":"2023-11-04T01:38:59.415395+0000","last_unstale":"2023-11-04T01:39:00.413252+0000","last_undegraded":"2023-11-04T01:39:00.413252+0000","last_fullsized":"2023-11-04T01:39:00.413252+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:36.849706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407673+0000","last_change":"2023-11-04T01:38:37.216051+0000","last_active":"2023-11-04T01:39:00.407673+0000","last_peered":"2023-11-04T01:39:00.407673+0000","last_clean":"2023-11-04T01:39:00.407673+0000","last_became_active":"2023-11-04T01:38:37.215779+0000","last_became_peered":"2023-11-04T01:38:37.215779+0000","last_unstale":"2023-11-04T01:39:00.407673+0000","last_undegraded":"2023-11-04T01:39:00.407673+0000","last_fullsized":"2023-11-04T01:39:00.407673+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:38:51.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411159+0000","last_change":"2023-11-04T01:38:38.207161+0000","last_active":"2023-11-04T01:38:59.411159+0000","last_peered":"2023-11-04T01:38:59.411159+0000","last_clean":"2023-11-04T01:38:59.411159+0000","last_became_active":"2023-11-04T01:38:36.215721+0000","last_became_peered":"2023-11-04T01:38:36.215721+0000","last_unstale":"2023-11-04T01:38:59.411159+0000","last_undegraded":"2023-11-04T01:38:59.411159+0000","last_fullsized":"2023-11-04T01:38:59.411159+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:49.027502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046667399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407246+0000","last_change":"2023-11-04T01:37:36.229580+0000","last_active":"2023-11-04T01:39:00.407246+0000","last_peered":"2023-11-04T01:39:00.407246+0000","last_clean":"2023-11-04T01:39:00.407246+0000","last_became_active":"2023-11-04T01:37:35.220940+0000","last_became_peered":"2023-11-04T01:37:35.220940+0000","last_unstale":"2023-11-04T01:39:00.407246+0000","last_undegraded":"2023-11-04T01:39:00.407246+0000","last_fullsized":"2023-11-04T01:39:00.407246+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:27.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070235600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422180+0000","last_change":"2023-11-04T01:39:00.423552+0000","last_active":"2023-11-04T01:39:01.422180+0000","last_peered":"2023-11-04T01:39:01.422180+0000","last_clean":"2023-11-04T01:39:01.422180+0000","last_became_active":"2023-11-04T01:39:00.422946+0000","last_became_peered":"2023-11-04T01:39:00.422946+0000","last_unstale":"2023-11-04T01:39:01.422180+0000","last_undegraded":"2023-11-04T01:39:01.422180+0000","last_fullsized":"2023-11-04T01:39:01.422180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:19.778505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.416362+0000","last_change":"2023-11-04T01:38:59.417281+0000","last_active":"2023-11-04T01:39:00.416362+0000","last_peered":"2023-11-04T01:39:00.416362+0000","last_clean":"2023-11-04T01:39:00.416362+0000","last_became_active":"2023-11-04T01:38:59.416632+0000","last_became_peered":"2023-11-04T01:38:59.416632+0000","last_unstale":"2023-11-04T01:39:00.416362+0000","last_undegraded":"2023-11-04T01:39:00.416362+0000","last_fullsized":"2023-11-04T01:39:00.416362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:41.851253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411485+0000","last_change":"2023-11-04T01:38:37.214340+0000","last_active":"2023-11-04T01:38:59.411485+0000","last_peered":"2023-11-04T01:38:59.411485+0000","last_clean":"2023-11-04T01:38:59.411485+0000","last_became_active":"2023-11-04T01:38:37.214056+0000","last_became_peered":"2023-11-04T01:38:37.214056+0000","last_unstale":"2023-11-04T01:38:59.411485+0000","last_undegraded":"2023-11-04T01:38:59.411485+0000","last_fullsized":"2023-11-04T01:38:59.411485+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:38:51.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404740+0000","last_change":"2023-11-04T01:38:38.411617+0000","last_active":"2023-11-04T01:38:59.404740+0000","last_peered":"2023-11-04T01:38:59.404740+0000","last_clean":"2023-11-04T01:38:59.404740+0000","last_became_active":"2023-11-04T01:38:36.222201+0000","last_became_peered":"2023-11-04T01:38:36.222201+0000","last_unstale":"2023-11-04T01:38:59.404740+0000","last_undegraded":"2023-11-04T01:38:59.404740+0000","last_fullsized":"2023-11-04T01:38:59.404740+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:01.464511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064531400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.408304+0000","last_change":"2023-11-04T01:37:36.422542+0000","last_active":"2023-11-04T01:39:00.408304+0000","last_peered":"2023-11-04T01:39:00.408304+0000","last_clean":"2023-11-04T01:39:00.408304+0000","last_became_active":"2023-11-04T01:37:35.224836+0000","last_became_peered":"2023-11-04T01:37:35.224836+0000","last_unstale":"2023-11-04T01:39:00.408304+0000","last_undegraded":"2023-11-04T01:39:00.408304+0000","last_fullsized":"2023-11-04T01:39:00.408304+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066982800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.423949+0000","last_change":"2023-11-04T01:39:00.421851+0000","last_active":"2023-11-04T01:39:00.423949+0000","last_peered":"2023-11-04T01:39:00.423949+0000","last_clean":"2023-11-04T01:39:00.423949+0000","last_became_active":"2023-11-04T01:39:00.421601+0000","last_became_peered":"2023-11-04T01:39:00.421601+0000","last_unstale":"2023-11-04T01:39:00.423949+0000","last_undegraded":"2023-11-04T01:39:00.423949+0000","last_fullsized":"2023-11-04T01:39:00.423949+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:23.696731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.432047+0000","last_change":"2023-11-04T01:38:59.425101+0000","last_active":"2023-11-04T01:39:00.432047+0000","last_peered":"2023-11-04T01:39:00.432047+0000","last_clean":"2023-11-04T01:39:00.432047+0000","last_became_active":"2023-11-04T01:38:59.424466+0000","last_became_peered":"2023-11-04T01:38:59.424466+0000","last_unstale":"2023-11-04T01:39:00.432047+0000","last_undegraded":"2023-11-04T01:39:00.432047+0000","last_fullsized":"2023-11-04T01:39:00.432047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:59.261370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407348+0000","last_change":"2023-11-04T01:38:37.214695+0000","last_active":"2023-11-04T01:39:00.407348+0000","last_peered":"2023-11-04T01:39:00.407348+0000","last_clean":"2023-11-04T01:39:00.407348+0000","last_became_active":"2023-11-04T01:38:37.214378+0000","last_became_peered":"2023-11-04T01:38:37.214378+0000","last_unstale":"2023-11-04T01:39:00.407348+0000","last_undegraded":"2023-11-04T01:39:00.407348+0000","last_fullsized":"2023-11-04T01:39:00.407348+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:54:14.757431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411408+0000","last_change":"2023-11-04T01:38:38.208722+0000","last_active":"2023-11-04T01:38:59.411408+0000","last_peered":"2023-11-04T01:38:59.411408+0000","last_clean":"2023-11-04T01:38:59.411408+0000","last_became_active":"2023-11-04T01:38:36.213352+0000","last_became_peered":"2023-11-04T01:38:36.213352+0000","last_unstale":"2023-11-04T01:38:59.411408+0000","last_undegraded":"2023-11-04T01:38:59.411408+0000","last_fullsized":"2023-11-04T01:38:59.411408+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:47.308778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082430899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404456+0000","last_change":"2023-11-04T01:37:36.694868+0000","last_active":"2023-11-04T01:38:59.404456+0000","last_peered":"2023-11-04T01:38:59.404456+0000","last_clean":"2023-11-04T01:38:59.404456+0000","last_became_active":"2023-11-04T01:37:35.221181+0000","last_became_peered":"2023-11-04T01:37:35.221181+0000","last_unstale":"2023-11-04T01:38:59.404456+0000","last_undegraded":"2023-11-04T01:38:59.404456+0000","last_fullsized":"2023-11-04T01:38:59.404456+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046748800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.431464+0000","last_change":"2023-11-04T01:39:00.426840+0000","last_active":"2023-11-04T01:39:00.431464+0000","last_peered":"2023-11-04T01:39:00.431464+0000","last_clean":"2023-11-04T01:39:00.431464+0000","last_became_active":"2023-11-04T01:39:00.425908+0000","last_became_peered":"2023-11-04T01:39:00.425908+0000","last_unstale":"2023-11-04T01:39:00.431464+0000","last_undegraded":"2023-11-04T01:39:00.431464+0000","last_fullsized":"2023-11-04T01:39:00.431464+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:43.326364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439038+0000","last_change":"2023-11-04T01:38:59.427160+0000","last_active":"2023-11-04T01:39:00.439038+0000","last_peered":"2023-11-04T01:39:00.439038+0000","last_clean":"2023-11-04T01:39:00.439038+0000","last_became_active":"2023-11-04T01:38:59.426820+0000","last_became_peered":"2023-11-04T01:38:59.426820+0000","last_unstale":"2023-11-04T01:39:00.439038+0000","last_undegraded":"2023-11-04T01:39:00.439038+0000","last_fullsized":"2023-11-04T01:39:00.439038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:24.664171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411057+0000","last_change":"2023-11-04T01:38:37.213179+0000","last_active":"2023-11-04T01:38:59.411057+0000","last_peered":"2023-11-04T01:38:59.411057+0000","last_clean":"2023-11-04T01:38:59.411057+0000","last_became_active":"2023-11-04T01:38:37.212784+0000","last_became_peered":"2023-11-04T01:38:37.212784+0000","last_unstale":"2023-11-04T01:38:59.411057+0000","last_undegraded":"2023-11-04T01:38:59.411057+0000","last_fullsized":"2023-11-04T01:38:59.411057+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:22.227302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404248+0000","last_change":"2023-11-04T01:38:38.411421+0000","last_active":"2023-11-04T01:38:59.404248+0000","last_peered":"2023-11-04T01:38:59.404248+0000","last_clean":"2023-11-04T01:38:59.404248+0000","last_became_active":"2023-11-04T01:38:36.218508+0000","last_became_peered":"2023-11-04T01:38:36.218508+0000","last_unstale":"2023-11-04T01:38:59.404248+0000","last_undegraded":"2023-11-04T01:38:59.404248+0000","last_fullsized":"2023-11-04T01:38:59.404248+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:47:59.491789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085522699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.411754+0000","last_change":"2023-11-04T01:37:36.222930+0000","last_active":"2023-11-04T01:38:59.411754+0000","last_peered":"2023-11-04T01:38:59.411754+0000","last_clean":"2023-11-04T01:38:59.411754+0000","last_became_active":"2023-11-04T01:37:35.220373+0000","last_became_peered":"2023-11-04T01:37:35.220373+0000","last_unstale":"2023-11-04T01:38:59.411754+0000","last_undegraded":"2023-11-04T01:38:59.411754+0000","last_fullsized":"2023-11-04T01:38:59.411754+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074099599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.439181+0000","last_change":"2023-11-04T01:39:00.434870+0000","last_active":"2023-11-04T01:39:00.439181+0000","last_peered":"2023-11-04T01:39:00.439181+0000","last_clean":"2023-11-04T01:39:00.439181+0000","last_became_active":"2023-11-04T01:39:00.434615+0000","last_became_peered":"2023-11-04T01:39:00.434615+0000","last_unstale":"2023-11-04T01:39:00.439181+0000","last_undegraded":"2023-11-04T01:39:00.439181+0000","last_fullsized":"2023-11-04T01:39:00.439181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:56.540138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.411854+0000","last_change":"2023-11-04T01:38:59.419072+0000","last_active":"2023-11-04T01:39:00.411854+0000","last_peered":"2023-11-04T01:39:00.411854+0000","last_clean":"2023-11-04T01:39:00.411854+0000","last_became_active":"2023-11-04T01:38:59.418764+0000","last_became_peered":"2023-11-04T01:38:59.418764+0000","last_unstale":"2023-11-04T01:39:00.411854+0000","last_undegraded":"2023-11-04T01:39:00.411854+0000","last_fullsized":"2023-11-04T01:39:00.411854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:13.216916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.420659+0000","last_change":"2023-11-04T01:38:37.212376+0000","last_active":"2023-11-04T01:38:59.420659+0000","last_peered":"2023-11-04T01:38:59.420659+0000","last_clean":"2023-11-04T01:38:59.420659+0000","last_became_active":"2023-11-04T01:38:37.211932+0000","last_became_peered":"2023-11-04T01:38:37.211932+0000","last_unstale":"2023-11-04T01:38:59.420659+0000","last_undegraded":"2023-11-04T01:38:59.420659+0000","last_fullsized":"2023-11-04T01:38:59.420659+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:02.363703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.423233+0000","last_change":"2023-11-04T01:38:38.247627+0000","last_active":"2023-11-04T01:39:00.423233+0000","last_peered":"2023-11-04T01:39:00.423233+0000","last_clean":"2023-11-04T01:39:00.423233+0000","last_became_active":"2023-11-04T01:38:36.218231+0000","last_became_peered":"2023-11-04T01:38:36.218231+0000","last_unstale":"2023-11-04T01:39:00.423233+0000","last_undegraded":"2023-11-04T01:39:00.423233+0000","last_fullsized":"2023-11-04T01:39:00.423233+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:52.412436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010241499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.412495+0000","last_change":"2023-11-04T01:37:36.221676+0000","last_active":"2023-11-04T01:38:59.412495+0000","last_peered":"2023-11-04T01:38:59.412495+0000","last_clean":"2023-11-04T01:38:59.412495+0000","last_became_active":"2023-11-04T01:37:35.226996+0000","last_became_peered":"2023-11-04T01:37:35.226996+0000","last_unstale":"2023-11-04T01:38:59.412495+0000","last_undegraded":"2023-11-04T01:38:59.412495+0000","last_fullsized":"2023-11-04T01:38:59.412495+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089115500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421883+0000","last_change":"2023-11-04T01:39:00.437737+0000","last_active":"2023-11-04T01:39:01.421883+0000","last_peered":"2023-11-04T01:39:01.421883+0000","last_clean":"2023-11-04T01:39:01.421883+0000","last_became_active":"2023-11-04T01:39:00.437378+0000","last_became_peered":"2023-11-04T01:39:00.437378+0000","last_unstale":"2023-11-04T01:39:01.421883+0000","last_undegraded":"2023-11-04T01:39:01.421883+0000","last_fullsized":"2023-11-04T01:39:01.421883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:54:22.210166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.412674+0000","last_change":"2023-11-04T01:38:59.425462+0000","last_active":"2023-11-04T01:39:00.412674+0000","last_peered":"2023-11-04T01:39:00.412674+0000","last_clean":"2023-11-04T01:39:00.412674+0000","last_became_active":"2023-11-04T01:38:59.425198+0000","last_became_peered":"2023-11-04T01:38:59.425198+0000","last_unstale":"2023-11-04T01:39:00.412674+0000","last_undegraded":"2023-11-04T01:39:00.412674+0000","last_fullsized":"2023-11-04T01:39:00.412674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:40.638512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.423317+0000","last_change":"2023-11-04T01:38:37.212816+0000","last_active":"2023-11-04T01:39:00.423317+0000","last_peered":"2023-11-04T01:39:00.423317+0000","last_clean":"2023-11-04T01:39:00.423317+0000","last_became_active":"2023-11-04T01:38:37.212512+0000","last_became_peered":"2023-11-04T01:38:37.212512+0000","last_unstale":"2023-11-04T01:39:00.423317+0000","last_undegraded":"2023-11-04T01:39:00.423317+0000","last_fullsized":"2023-11-04T01:39:00.423317+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:07.947093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407641+0000","last_change":"2023-11-04T01:38:38.636602+0000","last_active":"2023-11-04T01:39:00.407641+0000","last_peered":"2023-11-04T01:39:00.407641+0000","last_clean":"2023-11-04T01:39:00.407641+0000","last_became_active":"2023-11-04T01:38:36.213670+0000","last_became_peered":"2023-11-04T01:38:36.213670+0000","last_unstale":"2023-11-04T01:39:00.407641+0000","last_undegraded":"2023-11-04T01:39:00.407641+0000","last_fullsized":"2023-11-04T01:39:00.407641+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:42.712180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056085900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.419922+0000","last_change":"2023-11-04T01:37:36.228535+0000","last_active":"2023-11-04T01:38:59.419922+0000","last_peered":"2023-11-04T01:38:59.419922+0000","last_clean":"2023-11-04T01:38:59.419922+0000","last_became_active":"2023-11-04T01:37:35.221173+0000","last_became_peered":"2023-11-04T01:37:35.221173+0000","last_unstale":"2023-11-04T01:38:59.419922+0000","last_undegraded":"2023-11-04T01:38:59.419922+0000","last_fullsized":"2023-11-04T01:38:59.419922+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049831099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422493+0000","last_change":"2023-11-04T01:39:00.433707+0000","last_active":"2023-11-04T01:39:01.422493+0000","last_peered":"2023-11-04T01:39:01.422493+0000","last_clean":"2023-11-04T01:39:01.422493+0000","last_became_active":"2023-11-04T01:39:00.433467+0000","last_became_peered":"2023-11-04T01:39:00.433467+0000","last_unstale":"2023-11-04T01:39:01.422493+0000","last_undegraded":"2023-11-04T01:39:01.422493+0000","last_fullsized":"2023-11-04T01:39:01.422493+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:46.942739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.412963+0000","last_change":"2023-11-04T01:38:59.424724+0000","last_active":"2023-11-04T01:39:00.412963+0000","last_peered":"2023-11-04T01:39:00.412963+0000","last_clean":"2023-11-04T01:39:00.412963+0000","last_became_active":"2023-11-04T01:38:59.424295+0000","last_became_peered":"2023-11-04T01:38:59.424295+0000","last_unstale":"2023-11-04T01:39:00.412963+0000","last_undegraded":"2023-11-04T01:39:00.412963+0000","last_fullsized":"2023-11-04T01:39:00.412963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:05:05.911840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.420375+0000","last_change":"2023-11-04T01:38:37.214627+0000","last_active":"2023-11-04T01:38:59.420375+0000","last_peered":"2023-11-04T01:38:59.420375+0000","last_clean":"2023-11-04T01:38:59.420375+0000","last_became_active":"2023-11-04T01:38:37.214336+0000","last_became_peered":"2023-11-04T01:38:37.214336+0000","last_unstale":"2023-11-04T01:38:59.420375+0000","last_undegraded":"2023-11-04T01:38:59.420375+0000","last_fullsized":"2023-11-04T01:38:59.420375+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:21.121436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.406214+0000","last_change":"2023-11-04T01:38:38.635992+0000","last_active":"2023-11-04T01:39:00.406214+0000","last_peered":"2023-11-04T01:39:00.406214+0000","last_clean":"2023-11-04T01:39:00.406214+0000","last_became_active":"2023-11-04T01:38:36.215694+0000","last_became_peered":"2023-11-04T01:38:36.215694+0000","last_unstale":"2023-11-04T01:39:00.406214+0000","last_undegraded":"2023-11-04T01:39:00.406214+0000","last_fullsized":"2023-11-04T01:39:00.406214+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:01.464511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036495599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407723+0000","last_change":"2023-11-04T01:37:36.229678+0000","last_active":"2023-11-04T01:39:00.407723+0000","last_peered":"2023-11-04T01:39:00.407723+0000","last_clean":"2023-11-04T01:39:00.407723+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:39:00.407723+0000","last_undegraded":"2023-11-04T01:39:00.407723+0000","last_fullsized":"2023-11-04T01:39:00.407723+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:50.484332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422038+0000","last_change":"2023-11-04T01:39:00.436759+0000","last_active":"2023-11-04T01:39:01.422038+0000","last_peered":"2023-11-04T01:39:01.422038+0000","last_clean":"2023-11-04T01:39:01.422038+0000","last_became_active":"2023-11-04T01:39:00.436299+0000","last_became_peered":"2023-11-04T01:39:00.436299+0000","last_unstale":"2023-11-04T01:39:01.422038+0000","last_undegraded":"2023-11-04T01:39:01.422038+0000","last_fullsized":"2023-11-04T01:39:01.422038+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:48.438336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.436475+0000","last_change":"2023-11-04T01:38:59.423620+0000","last_active":"2023-11-04T01:39:00.436475+0000","last_peered":"2023-11-04T01:39:00.436475+0000","last_clean":"2023-11-04T01:39:00.436475+0000","last_became_active":"2023-11-04T01:38:59.423351+0000","last_became_peered":"2023-11-04T01:38:59.423351+0000","last_unstale":"2023-11-04T01:39:00.436475+0000","last_undegraded":"2023-11-04T01:39:00.436475+0000","last_fullsized":"2023-11-04T01:39:00.436475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:34.267099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.422610+0000","last_change":"2023-11-04T01:38:37.212620+0000","last_active":"2023-11-04T01:39:00.422610+0000","last_peered":"2023-11-04T01:39:00.422610+0000","last_clean":"2023-11-04T01:39:00.422610+0000","last_became_active":"2023-11-04T01:38:37.212294+0000","last_became_peered":"2023-11-04T01:38:37.212294+0000","last_unstale":"2023-11-04T01:39:00.422610+0000","last_undegraded":"2023-11-04T01:39:00.422610+0000","last_fullsized":"2023-11-04T01:39:00.422610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:02.424394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.414228+0000","last_change":"2023-11-04T01:38:38.246984+0000","last_active":"2023-11-04T01:39:00.414228+0000","last_peered":"2023-11-04T01:39:00.414228+0000","last_clean":"2023-11-04T01:39:00.414228+0000","last_became_active":"2023-11-04T01:38:36.211685+0000","last_became_peered":"2023-11-04T01:38:36.211685+0000","last_unstale":"2023-11-04T01:39:00.414228+0000","last_undegraded":"2023-11-04T01:39:00.414228+0000","last_fullsized":"2023-11-04T01:39:00.414228+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:50.973560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051504199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407341+0000","last_change":"2023-11-04T01:37:36.229908+0000","last_active":"2023-11-04T01:39:00.407341+0000","last_peered":"2023-11-04T01:39:00.407341+0000","last_clean":"2023-11-04T01:39:00.407341+0000","last_became_active":"2023-11-04T01:37:35.221822+0000","last_became_peered":"2023-11-04T01:37:35.221822+0000","last_unstale":"2023-11-04T01:39:00.407341+0000","last_undegraded":"2023-11-04T01:39:00.407341+0000","last_fullsized":"2023-11-04T01:39:00.407341+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:11.866738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089270799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.422808+0000","last_change":"2023-11-04T01:39:00.434378+0000","last_active":"2023-11-04T01:39:01.422808+0000","last_peered":"2023-11-04T01:39:01.422808+0000","last_clean":"2023-11-04T01:39:01.422808+0000","last_became_active":"2023-11-04T01:39:00.434060+0000","last_became_peered":"2023-11-04T01:39:00.434060+0000","last_unstale":"2023-11-04T01:39:01.422808+0000","last_undegraded":"2023-11-04T01:39:01.422808+0000","last_fullsized":"2023-11-04T01:39:01.422808+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.394580+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.394580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:59.990606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"83'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-04T01:39:01.421785+0000","last_change":"2023-11-04T01:38:59.423453+0000","last_active":"2023-11-04T01:39:01.421785+0000","last_peered":"2023-11-04T01:39:01.421785+0000","last_clean":"2023-11-04T01:39:01.421785+0000","last_became_active":"2023-11-04T01:38:59.423211+0000","last_became_peered":"2023-11-04T01:38:59.423211+0000","last_unstale":"2023-11-04T01:39:01.421785+0000","last_undegraded":"2023-11-04T01:39:01.421785+0000","last_fullsized":"2023-11-04T01:39:01.421785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.389298+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.389298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:58.843544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.410347+0000","last_change":"2023-11-04T01:38:37.215184+0000","last_active":"2023-11-04T01:38:59.410347+0000","last_peered":"2023-11-04T01:38:59.410347+0000","last_clean":"2023-11-04T01:38:59.410347+0000","last_became_active":"2023-11-04T01:38:37.214888+0000","last_became_peered":"2023-11-04T01:38:37.214888+0000","last_unstale":"2023-11-04T01:38:59.410347+0000","last_undegraded":"2023-11-04T01:38:59.410347+0000","last_fullsized":"2023-11-04T01:38:59.410347+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:34.067351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.408179+0000","last_change":"2023-11-04T01:38:38.637027+0000","last_active":"2023-11-04T01:39:00.408179+0000","last_peered":"2023-11-04T01:39:00.408179+0000","last_clean":"2023-11-04T01:39:00.408179+0000","last_became_active":"2023-11-04T01:38:36.221149+0000","last_became_peered":"2023-11-04T01:38:36.221149+0000","last_unstale":"2023-11-04T01:39:00.408179+0000","last_undegraded":"2023-11-04T01:39:00.408179+0000","last_fullsized":"2023-11-04T01:39:00.408179+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:12.755546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045543500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:38:59.404885+0000","last_change":"2023-11-04T01:37:36.695345+0000","last_active":"2023-11-04T01:38:59.404885+0000","last_peered":"2023-11-04T01:38:59.404885+0000","last_clean":"2023-11-04T01:38:59.404885+0000","last_became_active":"2023-11-04T01:37:35.225441+0000","last_became_peered":"2023-11-04T01:37:35.225441+0000","last_unstale":"2023-11-04T01:38:59.404885+0000","last_undegraded":"2023-11-04T01:38:59.404885+0000","last_fullsized":"2023-11-04T01:38:59.404885+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052758199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":218,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-04T01:39:00.407825+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:39:00.407825+0000","last_peered":"2023-11-04T01:39:00.407825+0000","last_clean":"2023-11-04T01:39:00.407825+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:39:00.407825+0000","last_undegraded":"2023-11-04T01:39:00.407825+0000","last_fullsized":"2023-11-04T01:39:00.407825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1630208,"data_stored":1091068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.65800000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.503,"15min":0.503},"min":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.53600000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.51500000000000001},"min":{"1min":0.41199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76900000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.39100000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.434},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72999999999999998,"5min":0.745,"15min":0.745},"last":0.47899999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56599999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.55400000000000005}]},{"osd":4,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.45800000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72399999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.50900000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.34399999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77100000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.35099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88700000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61399999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83899999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.35999999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.35999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":493557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89600000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.63700000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74199999999999999,"5min":1.004,"15min":1.004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79800000000000004,"5min":1.085,"15min":1.085},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81499999999999995,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84899999999999998,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.60399999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73699999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96199999999999997,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.313,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77800000000000002,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.373,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86499999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.441}]},{"osd":5,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73799999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83099999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.65800000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69199999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.63500000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79600000000000004,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.71099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":492975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.86399999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.63200000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77700000000000002,"5min":1.24,"15min":1.24},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82899999999999996,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.55900000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79200000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.83599999999999997,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.53800000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.41399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.434,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.71699999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.502,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73899999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.504,"15min":0.50600000000000001},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82199999999999995,"5min":0.877,"15min":0.877},"last":0.73399999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70799999999999996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.751},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80600000000000005,"5min":1.284,"15min":1.284},"last":0.79900000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72599999999999998,"5min":0.746,"15min":0.746},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.77200000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.82399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":494641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.501,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.253,"15min":0.253},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.36199999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.437}]},{"osd":1,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.38700000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70599999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72799999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.41499999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.51400000000000001,"15min":0.498},"min":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.752,"5min":1.022,"15min":1.022},"last":0.47399999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.44800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66700000000000004,"5min":1.002,"15min":1.002},"last":0.376},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.39900000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.501,"15min":0.48599999999999999},"min":{"1min":0.36499999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":1.127,"15min":1.127},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77000000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.34899999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55200000000000005,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.80500000000000005,"5min":1.079,"15min":1.079},"last":0.33000000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.038,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63800000000000001,"15min":0.629},"min":{"1min":0.40000000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.45400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":494539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.248,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.248},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.221},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.28999999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.40799999999999997},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.40799999999999997},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.94799999999999995,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.31}]},{"osd":2,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.371},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44900000000000001,"15min":0.46700000000000003},"min":{"1min":0.34999999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59199999999999997,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.622,"15min":0.64200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83699999999999997,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.623,"15min":0.63},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83299999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.45000000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68000000000000005,"15min":0.69499999999999995},"min":{"1min":0.51400000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.87,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1019904,"data_stored":492939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.35299999999999998,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.19,"15min":0.19},"max":{"1min":0.60399999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35299999999999998,"15min":0.37},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.49399999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.39500000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36299999999999999,"15min":0.36699999999999999},"min":{"1min":0.255,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.5,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.42499999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51500000000000001,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.36399999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.876,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.627,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79900000000000004,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.55000000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70199999999999996,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.628,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.81200000000000006,"5min":1.052,"15min":1.052},"last":0.51400000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82099999999999995,"5min":1.393,"15min":1.393},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80200000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.79300000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72799999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.65100000000000002,"15min":0.67400000000000004},"min":{"1min":0.42299999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71799999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":492905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32700000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.36799999999999999,"15min":0.379},"min":{"1min":0.22,"5min":0.192,"15min":0.192},"max":{"1min":0.496,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.315}]},{"osd":2,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33600000000000002,"15min":0.33100000000000002},"min":{"1min":0.26700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.44,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51500000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.33400000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42199999999999999,"15min":0.42899999999999999},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54100000000000004,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52800000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70199999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.40899999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78100000000000003,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59499999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.72299999999999998,"5min":1.02,"15min":1.02},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81399999999999995,"5min":1.089,"15min":1.089},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.623,"15min":0.629},"min":{"1min":0.441,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80000000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.755,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.52700000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86599999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.64000000000000001},"min":{"1min":0.44700000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82799999999999996,"5min":1.153,"15min":1.153},"last":0.54500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32760,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339080,"statfs":{"total":96636764160,"available":96603217920,"internally_reserved":0,"allocated":1609728,"data_stored":1082836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34899999999999998,"15min":0.35499999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.55400000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.222},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.27000000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57999999999999996,"5min":0.629,"15min":0.629},"last":0.34100000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.36199999999999999,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51800000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.39400000000000002,"15min":0.40200000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53900000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.30099999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.379,"15min":0.38800000000000001},"min":{"1min":0.27400000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52200000000000002,"5min":0.628,"15min":0.628},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40000000000000002,"15min":0.40100000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.59599999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.24299999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94899999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59899999999999998,"15min":0.58299999999999996},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85599999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.47699999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.98299999999999998,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.46500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.48299999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91000000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.45600000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.622},"min":{"1min":0.46100000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92200000000000004,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.628},"min":{"1min":0.499,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85899999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.44600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:39:03.793 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:39:03.794 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:39:03.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.937+0000 7f00fddc0640 1 Processor -- start 2023-11-04T01:39:03.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.937+0000 7f00fddc0640 1 -- start start 2023-11-04T01:39:03.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00fddc0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f00f80cd6d0 0x7f00f8161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00fddc0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f80cde60 con 0x7f00f8153e60 2023-11-04T01:39:03.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00fddc0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f8160f90 con 0x7f00f80b4880 2023-11-04T01:39:03.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00fddc0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f8161960 con 0x7f00f80cd6d0 2023-11-04T01:39:03.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00f77fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f00f8153e60 0x7f00f815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59722/0 (socket says 172.21.15.44:59722) 2023-11-04T01:39:03.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00f77fe640 1 -- 172.21.15.44:0/2866507632 learned_addr learned my addr 172.21.15.44:0/2866507632 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:03.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00f67fc640 1 -- 172.21.15.44:0/2866507632 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116742267 0 0) 0x7f00f80cde60 con 0x7f00f8153e60 2023-11-04T01:39:03.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00f67fc640 1 -- 172.21.15.44:0/2866507632 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00e0003520 con 0x7f00f8153e60 2023-11-04T01:39:03.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00f6ffd640 1 --2- 172.21.15.44:0/2866507632 >> v2:172.21.15.204:3300/0 conn(0x7f00f80cd6d0 0x7f00f8161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00f67fc640 1 -- 172.21.15.44:0/2866507632 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2573588938 0 0) 0x7f00e0003520 con 0x7f00f8153e60 2023-11-04T01:39:03.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00f67fc640 1 -- 172.21.15.44:0/2866507632 >> v2:172.21.15.204:3300/0 conn(0x7f00f80cd6d0 msgr2=0x7f00f8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:03.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00f67fc640 1 --2- 172.21.15.44:0/2866507632 >> v2:172.21.15.204:3300/0 conn(0x7f00f80cd6d0 0x7f00f8161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00f67fc640 1 -- 172.21.15.44:0/2866507632 >> v1:172.21.15.204:6789/0 conn(0x7f00f80b4880 legacy=0x7f00f80d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00f67fc640 1 -- 172.21.15.44:0/2866507632 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80ce090 con 0x7f00f8153e60 2023-11-04T01:39:03.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00f67fc640 1 -- 172.21.15.44:0/2866507632 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f00e8001670 con 0x7f00f8153e60 2023-11-04T01:39:03.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.938+0000 7f00f67fc640 1 -- 172.21.15.44:0/2866507632 >> v1:172.21.15.44:6789/0 conn(0x7f00f8153e60 legacy=0x7f00f815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f67fc640 1 --2- 172.21.15.44:0/2866507632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e0003970 0x7f00e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f67fc640 1 --2- 172.21.15.44:0/2866507632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00047c0 0x7f00e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f67fc640 1 --2- 172.21.15.44:0/2866507632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00e0005180 0x7f00e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f67fc640 1 -- 172.21.15.44:0/2866507632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f8161960 con 0x7f00e00047c0 2023-11-04T01:39:03.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f67fc640 1 -- 172.21.15.44:0/2866507632 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e000c0d0 con 0x7f00e0003970 2023-11-04T01:39:03.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f67fc640 1 -- 172.21.15.44:0/2866507632 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e000c290 con 0x7f00e0005180 2023-11-04T01:39:03.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f6ffd640 1 --2- 172.21.15.44:0/2866507632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00047c0 0x7f00e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f77fe640 1 --2- 172.21.15.44:0/2866507632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e0003970 0x7f00e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f7fff640 1 --2- 172.21.15.44:0/2866507632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00e0005180 0x7f00e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f6ffd640 1 -- 172.21.15.44:0/2866507632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00e0005180 msgr2=0x7f00e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:03.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f6ffd640 1 --2- 172.21.15.44:0/2866507632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00e0005180 0x7f00e000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f6ffd640 1 -- 172.21.15.44:0/2866507632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e0003970 msgr2=0x7f00e0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:03.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f6ffd640 1 --2- 172.21.15.44:0/2866507632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e0003970 0x7f00e0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f6ffd640 1 -- 172.21.15.44:0/2866507632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e0003520 con 0x7f00e00047c0 2023-11-04T01:39:03.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f7fff640 1 --2- 172.21.15.44:0/2866507632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00e0005180 0x7f00e000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:03.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.939+0000 7f00f7fff640 1 -- 172.21.15.44:0/2866507632 reap_dead start 2023-11-04T01:39:03.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.940+0000 7f00f6ffd640 1 --2- 172.21.15.44:0/2866507632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00047c0 0x7f00e0004c40 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00ba30 tx=0x7f00e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7399f27db198513f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.940+0000 7f00f67fc640 1 -- 172.21.15.44:0/2866507632 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec032640 con 0x7f00e00047c0 2023-11-04T01:39:03.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.940+0000 7f00f67fc640 1 -- 172.21.15.44:0/2866507632 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec0327a0 con 0x7f00e00047c0 2023-11-04T01:39:03.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.940+0000 7f00f67fc640 1 -- 172.21.15.44:0/2866507632 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec032b30 con 0x7f00e00047c0 2023-11-04T01:39:03.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.940+0000 7f00fddc0640 1 -- 172.21.15.44:0/2866507632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00047c0 msgr2=0x7f00e0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.940+0000 7f00fddc0640 1 --2- 172.21.15.44:0/2866507632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00047c0 0x7f00e0004c40 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00ba30 tx=0x7f00e00057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.940+0000 7f00fddc0640 1 -- 172.21.15.44:0/2866507632 shutdown_connections 2023-11-04T01:39:03.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.940+0000 7f00fddc0640 1 --2- 172.21.15.44:0/2866507632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00047c0 0x7f00e0004c40 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.940+0000 7f00fddc0640 1 -- 172.21.15.44:0/2866507632 >> 172.21.15.44:0/2866507632 conn(0x7f00f80cf880 msgr2=0x7f00f80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.940+0000 7f00fddc0640 1 -- 172.21.15.44:0/2866507632 shutdown_connections 2023-11-04T01:39:03.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.941+0000 7f00fddc0640 1 -- 172.21.15.44:0/2866507632 wait complete. 2023-11-04T01:39:03.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.942+0000 7f00fddc0640 1 Processor -- start 2023-11-04T01:39:03.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.942+0000 7f00fddc0640 1 -- start start 2023-11-04T01:39:03.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00fddc0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00047c0 0x7f00f80b8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00fddc0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00f813f9b0 0x7f00f813f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00fddc0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f80b7300 0x7f00f813cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00fddc0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80b6010 con 0x7f00e00047c0 2023-11-04T01:39:03.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00fddc0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80b6260 con 0x7f00f80b7300 2023-11-04T01:39:03.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00fddc0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80b6540 con 0x7f00f813f9b0 2023-11-04T01:39:03.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00f77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00047c0 0x7f00f80b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00f77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00047c0 0x7f00f80b8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55324/0 (socket says 172.21.15.44:55324) 2023-11-04T01:39:03.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00f77fe640 1 -- 172.21.15.44:0/3784288357 learned_addr learned my addr 172.21.15.44:0/3784288357 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:03.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00f6ffd640 1 --2- 172.21.15.44:0/3784288357 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00f813f9b0 0x7f00f813f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00f7fff640 1 --2- 172.21.15.44:0/3784288357 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f80b7300 0x7f00f813cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00f77fe640 1 -- 172.21.15.44:0/3784288357 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00f813f9b0 msgr2=0x7f00f813f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00f77fe640 1 --2- 172.21.15.44:0/3784288357 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00f813f9b0 0x7f00f813f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00f77fe640 1 -- 172.21.15.44:0/3784288357 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f80b7300 msgr2=0x7f00f813cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00f77fe640 1 --2- 172.21.15.44:0/3784288357 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f80b7300 0x7f00f813cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00f77fe640 1 -- 172.21.15.44:0/3784288357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80b6820 con 0x7f00e00047c0 2023-11-04T01:39:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00f7fff640 1 --2- 172.21.15.44:0/3784288357 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f80b7300 0x7f00f813cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00f77fe640 1 --2- 172.21.15.44:0/3784288357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00047c0 0x7f00f80b8100 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f00e80072c0 tx=0x7f00e8007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00dffff640 1 -- 172.21.15.44:0/3784288357 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800f8e0 con 0x7f00e00047c0 2023-11-04T01:39:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00dffff640 1 -- 172.21.15.44:0/3784288357 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e800fa40 con 0x7f00e00047c0 2023-11-04T01:39:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00dffff640 1 -- 172.21.15.44:0/3784288357 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800fdf0 con 0x7f00e00047c0 2023-11-04T01:39:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00fddc0640 1 -- 172.21.15.44:0/3784288357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f80b6b00 con 0x7f00e00047c0 2023-11-04T01:39:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.943+0000 7f00fddc0640 1 -- 172.21.15.44:0/3784288357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f813f540 con 0x7f00e00047c0 2023-11-04T01:39:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.944+0000 7f00fddc0640 1 -- 172.21.15.44:0/3784288357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f813f6d0 con 0x7f00e00047c0 2023-11-04T01:39:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.945+0000 7f00dffff640 1 -- 172.21.15.44:0/3784288357 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f00e801d460 con 0x7f00e00047c0 2023-11-04T01:39:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.945+0000 7f00dffff640 1 --2- 172.21.15.44:0/3784288357 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00e406ae70 0x7f00e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.945+0000 7f00dffff640 1 -- 172.21.15.44:0/3784288357 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f00e8089d80 con 0x7f00e00047c0 2023-11-04T01:39:03.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.945+0000 7f00f6ffd640 1 --2- 172.21.15.44:0/3784288357 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00e406ae70 0x7f00e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.946+0000 7f00f6ffd640 1 --2- 172.21.15.44:0/3784288357 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00e406ae70 0x7f00e406d330 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00ba00 tx=0x7f00ec03d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:03.949+0000 7f00dffff640 1 -- 172.21.15.44:0/3784288357 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00e80548c0 con 0x7f00e00047c0 2023-11-04T01:39:04.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.192+0000 7f00fddc0640 1 -- 172.21.15.44:0/3784288357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f00f80b7020 con 0x7f00e00047c0 2023-11-04T01:39:04.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.197+0000 7f00dffff640 1 -- 172.21.15.44:0/3784288357 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f00f80b7020 con 0x7f00e00047c0 2023-11-04T01:39:04.199 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2023-11-04T01:39:04.199 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDEn0VlmqcrLRAAFCsu/sJUUh45gPboIgq6Dw== 2023-11-04T01:39:04.199 INFO:teuthology.orchestra.run.smithi044.stdout: caps mds = "allow" 2023-11-04T01:39:04.199 INFO:teuthology.orchestra.run.smithi044.stdout: caps mon = "allow r" 2023-11-04T01:39:04.199 INFO:teuthology.orchestra.run.smithi044.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:39:04.199 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2023-11-04T01:39:04.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.199+0000 7f00fddc0640 1 -- 172.21.15.44:0/3784288357 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00e406ae70 msgr2=0x7f00e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.199+0000 7f00fddc0640 1 --2- 172.21.15.44:0/3784288357 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00e406ae70 0x7f00e406d330 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00ba00 tx=0x7f00ec03d040 comp rx=0 tx=0).stop 2023-11-04T01:39:04.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.199+0000 7f00fddc0640 1 -- 172.21.15.44:0/3784288357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00047c0 msgr2=0x7f00f80b8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.199+0000 7f00fddc0640 1 --2- 172.21.15.44:0/3784288357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00047c0 0x7f00f80b8100 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f00e80072c0 tx=0x7f00e8007780 comp rx=0 tx=0).stop 2023-11-04T01:39:04.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.199+0000 7f00fddc0640 1 -- 172.21.15.44:0/3784288357 shutdown_connections 2023-11-04T01:39:04.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.199+0000 7f00fddc0640 1 --2- 172.21.15.44:0/3784288357 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00e406ae70 0x7f00e406d330 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.199+0000 7f00fddc0640 1 --2- 172.21.15.44:0/3784288357 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f80b7300 0x7f00f813cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.199+0000 7f00fddc0640 1 --2- 172.21.15.44:0/3784288357 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00f813f9b0 0x7f00f813f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.199+0000 7f00fddc0640 1 --2- 172.21.15.44:0/3784288357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00047c0 0x7f00f80b8100 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.199+0000 7f00fddc0640 1 -- 172.21.15.44:0/3784288357 >> 172.21.15.44:0/3784288357 conn(0x7f00f80cf880 msgr2=0x7f00f815afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:04.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.199+0000 7f00fddc0640 1 -- 172.21.15.44:0/3784288357 shutdown_connections 2023-11-04T01:39:04.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.199+0000 7f00fddc0640 1 -- 172.21.15.44:0/3784288357 wait complete. 2023-11-04T01:39:04.212 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:04.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.315+0000 7f030cb97640 1 Processor -- start 2023-11-04T01:39:04.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.316+0000 7f030cb97640 1 -- start start 2023-11-04T01:39:04.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.316+0000 7f030cb97640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03080cde60 0x7f030815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.316+0000 7f030cb97640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f030815daa0 0x7f0308157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.316+0000 7f030cb97640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030815e000 con 0x7f03080ce240 2023-11-04T01:39:04.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.316+0000 7f030cb97640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030815e5c0 con 0x7f030815daa0 2023-11-04T01:39:04.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.316+0000 7f030cb97640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030815e2e0 con 0x7f03080cde60 2023-11-04T01:39:04.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.316+0000 7f0306d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f03080ce240 0x7f030806b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59734/0 (socket says 172.21.15.44:59734) 2023-11-04T01:39:04.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.317+0000 7f0306d9d640 1 -- 172.21.15.44:0/3345058384 learned_addr learned my addr 172.21.15.44:0/3345058384 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:04.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.317+0000 7f030659c640 1 --2- 172.21.15.44:0/3345058384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03080cde60 0x7f030815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.317+0000 7f02fffff640 1 --2- 172.21.15.44:0/3345058384 >> v2:172.21.15.204:3300/0 conn(0x7f030815daa0 0x7f0308157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.317+0000 7f0305d9b640 1 -- 172.21.15.44:0/3345058384 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765998074 0 0) 0x7f030815e000 con 0x7f03080ce240 2023-11-04T01:39:04.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.317+0000 7f0305d9b640 1 -- 172.21.15.44:0/3345058384 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02f4003520 con 0x7f03080ce240 2023-11-04T01:39:04.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.317+0000 7f0305d9b640 1 -- 172.21.15.44:0/3345058384 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3615166580 0 0) 0x7f02f4003520 con 0x7f03080ce240 2023-11-04T01:39:04.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.317+0000 7f030659c640 1 -- 172.21.15.44:0/3345058384 >> v2:172.21.15.204:3300/0 conn(0x7f030815daa0 msgr2=0x7f0308157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:04.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.317+0000 7f030659c640 1 --2- 172.21.15.44:0/3345058384 >> v2:172.21.15.204:3300/0 conn(0x7f030815daa0 0x7f0308157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.317+0000 7f030659c640 1 -- 172.21.15.44:0/3345058384 >> v1:172.21.15.44:6789/0 conn(0x7f03080ce240 legacy=0x7f030806b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.317+0000 7f030659c640 1 -- 172.21.15.44:0/3345058384 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03080d1120 con 0x7f03080cde60 2023-11-04T01:39:04.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.318+0000 7f030659c640 1 --2- 172.21.15.44:0/3345058384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03080cde60 0x7f030815d560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f02f80097a0 tx=0x7f02f802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=963f70bae508acb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.318+0000 7f0305d9b640 1 -- 172.21.15.44:0/3345058384 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03000019f0 con 0x7f03080cde60 2023-11-04T01:39:04.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.318+0000 7f0305d9b640 1 -- 172.21.15.44:0/3345058384 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f802e050 con 0x7f03080cde60 2023-11-04T01:39:04.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.318+0000 7f0305d9b640 1 -- 172.21.15.44:0/3345058384 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8030710 con 0x7f03080cde60 2023-11-04T01:39:04.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.319+0000 7f030cb97640 1 -- 172.21.15.44:0/3345058384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03080cde60 msgr2=0x7f030815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.319+0000 7f030cb97640 1 --2- 172.21.15.44:0/3345058384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03080cde60 0x7f030815d560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f02f80097a0 tx=0x7f02f802b790 comp rx=0 tx=0).stop 2023-11-04T01:39:04.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.319+0000 7f030cb97640 1 -- 172.21.15.44:0/3345058384 shutdown_connections 2023-11-04T01:39:04.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.319+0000 7f030cb97640 1 --2- 172.21.15.44:0/3345058384 >> v2:172.21.15.204:3300/0 conn(0x7f030815daa0 0x7f0308157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.319+0000 7f030cb97640 1 --2- 172.21.15.44:0/3345058384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03080cde60 0x7f030815d560 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.319+0000 7f030cb97640 1 -- 172.21.15.44:0/3345058384 >> 172.21.15.44:0/3345058384 conn(0x7f0308071f30 msgr2=0x7f03080cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:04.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.319+0000 7f030cb97640 1 -- 172.21.15.44:0/3345058384 shutdown_connections 2023-11-04T01:39:04.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.319+0000 7f030cb97640 1 -- 172.21.15.44:0/3345058384 wait complete. 2023-11-04T01:39:04.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.320+0000 7f030cb97640 1 Processor -- start 2023-11-04T01:39:04.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.320+0000 7f030cb97640 1 -- start start 2023-11-04T01:39:04.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f030cb97640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03080cde60 0x7f03080b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f030cb97640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03080ce240 0x7f03080c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f030cb97640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f030815daa0 0x7f03080c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f030cb97640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03080c9ef0 con 0x7f03080ce240 2023-11-04T01:39:04.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f030cb97640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03081f6710 con 0x7f03080cde60 2023-11-04T01:39:04.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f030cb97640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03081f5b00 con 0x7f030815daa0 2023-11-04T01:39:04.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f02fffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03080ce240 0x7f03080c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f02fffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03080ce240 0x7f03080c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55326/0 (socket says 172.21.15.44:55326) 2023-11-04T01:39:04.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f02fffff640 1 -- 172.21.15.44:0/1582053818 learned_addr learned my addr 172.21.15.44:0/1582053818 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:04.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f030659c640 1 --2- 172.21.15.44:0/1582053818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03080cde60 0x7f03080b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f0306d9d640 1 --2- 172.21.15.44:0/1582053818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f030815daa0 0x7f03080c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f02fffff640 1 -- 172.21.15.44:0/1582053818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f030815daa0 msgr2=0x7f03080c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f02fffff640 1 --2- 172.21.15.44:0/1582053818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f030815daa0 0x7f03080c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f02fffff640 1 -- 172.21.15.44:0/1582053818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03080cde60 msgr2=0x7f03080b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f02fffff640 1 --2- 172.21.15.44:0/1582053818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03080cde60 0x7f03080b6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f02fffff640 1 -- 172.21.15.44:0/1582053818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f8009400 con 0x7f03080ce240 2023-11-04T01:39:04.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f02fffff640 1 --2- 172.21.15.44:0/1582053818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03080ce240 0x7f03080c6c10 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f02f000e870 tx=0x7f02f000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f02feffd640 1 -- 172.21.15.44:0/1582053818 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f00094f0 con 0x7f03080ce240 2023-11-04T01:39:04.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.321+0000 7f02feffd640 1 -- 172.21.15.44:0/1582053818 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f000c940 con 0x7f03080ce240 2023-11-04T01:39:04.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.322+0000 7f030cb97640 1 -- 172.21.15.44:0/1582053818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03081f5de0 con 0x7f03080ce240 2023-11-04T01:39:04.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.322+0000 7f02feffd640 1 -- 172.21.15.44:0/1582053818 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f000ccf0 con 0x7f03080ce240 2023-11-04T01:39:04.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.322+0000 7f030cb97640 1 -- 172.21.15.44:0/1582053818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03081f63a0 con 0x7f03080ce240 2023-11-04T01:39:04.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.322+0000 7f030cb97640 1 -- 172.21.15.44:0/1582053818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03081f68c0 con 0x7f03080ce240 2023-11-04T01:39:04.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.323+0000 7f02feffd640 1 -- 172.21.15.44:0/1582053818 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f02f0013470 con 0x7f03080ce240 2023-11-04T01:39:04.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.323+0000 7f02feffd640 1 --2- 172.21.15.44:0/1582053818 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f02e806ae70 0x7f02e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.323+0000 7f02feffd640 1 -- 172.21.15.44:0/1582053818 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f02f0089f20 con 0x7f03080ce240 2023-11-04T01:39:04.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.324+0000 7f030659c640 1 --2- 172.21.15.44:0/1582053818 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f02e806ae70 0x7f02e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.324+0000 7f030659c640 1 --2- 172.21.15.44:0/1582053818 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f02e806ae70 0x7f02e806d330 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f02f8034000 tx=0x7f02f802f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.328+0000 7f02feffd640 1 -- 172.21.15.44:0/1582053818 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02f0054af0 con 0x7f03080ce240 2023-11-04T01:39:04.384 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:39:04.382+0000 7ff7040dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:39:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.541+0000 7f030cb97640 1 -- 172.21.15.44:0/1582053818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0308074290 con 0x7f03080ce240 2023-11-04T01:39:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.541+0000 7f02feffd640 1 -- 172.21.15.44:0/1582053818 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f02f0017090 con 0x7f03080ce240 2023-11-04T01:39:04.543 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:04.544 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/257114874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":257114874},{"type":"v1","addr":"172.21.15.204:6835","nonce":257114874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6292,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2084651129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":2084651129},{"type":"v1","addr":"172.21.15.204:6837","nonce":2084651129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1688550253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1688550253},{"type":"v1","addr":"172.21.15.44:6834","nonce":1688550253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:59.773482+0000","modified":"2023-11-04T01:39:01.766460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6891},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6891":{"gid":6891,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/364976049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":364976049},{"type":"v1","addr":"172.21.15.44:6835","nonce":364976049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:39:04.544 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 37 2023-11-04T01:39:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.543+0000 7f030cb97640 1 -- 172.21.15.44:0/1582053818 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f02e806ae70 msgr2=0x7f02e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.543+0000 7f030cb97640 1 --2- 172.21.15.44:0/1582053818 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f02e806ae70 0x7f02e806d330 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f02f8034000 tx=0x7f02f802f000 comp rx=0 tx=0).stop 2023-11-04T01:39:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.543+0000 7f030cb97640 1 -- 172.21.15.44:0/1582053818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03080ce240 msgr2=0x7f03080c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.543+0000 7f030cb97640 1 --2- 172.21.15.44:0/1582053818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03080ce240 0x7f03080c6c10 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f02f000e870 tx=0x7f02f000ed30 comp rx=0 tx=0).stop 2023-11-04T01:39:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.543+0000 7f030cb97640 1 -- 172.21.15.44:0/1582053818 shutdown_connections 2023-11-04T01:39:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.543+0000 7f030cb97640 1 --2- 172.21.15.44:0/1582053818 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f02e806ae70 0x7f02e806d330 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.543+0000 7f030cb97640 1 --2- 172.21.15.44:0/1582053818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f030815daa0 0x7f03080c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.543+0000 7f030cb97640 1 --2- 172.21.15.44:0/1582053818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03080ce240 0x7f03080c6c10 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.543+0000 7f030cb97640 1 --2- 172.21.15.44:0/1582053818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03080cde60 0x7f03080b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.543+0000 7f030cb97640 1 -- 172.21.15.44:0/1582053818 >> 172.21.15.44:0/1582053818 conn(0x7f0308071f30 msgr2=0x7f0308156480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.543+0000 7f030cb97640 1 -- 172.21.15.44:0/1582053818 shutdown_connections 2023-11-04T01:39:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:04.543+0000 7f030cb97640 1 -- 172.21.15.44:0/1582053818 wait complete. 2023-11-04T01:39:04.958 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:38:59.773482+0000', 'modified': '2023-11-04T01:39:01.766460+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6891}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6891': {'gid': 6891, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/364976049', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 364976049}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 364976049}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:39:04.958 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:39:04.958 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:39:05.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.066+0000 7efda4407640 1 Processor -- start 2023-11-04T01:39:05.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.066+0000 7efda4407640 1 -- start start 2023-11-04T01:39:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.067+0000 7efda4407640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efd9c15ad30 0x7efd9c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.067+0000 7efda4407640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efd9c070e20 0x7efd9c15e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.067+0000 7efda4407640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd9c0c3900 con 0x7efd9c0ad730 2023-11-04T01:39:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.067+0000 7efda4407640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd9c0ae260 con 0x7efd9c15ad30 2023-11-04T01:39:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.067+0000 7efda4407640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd9c0c3be0 con 0x7efd9c070e20 2023-11-04T01:39:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.067+0000 7efda21a3640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efd9c15ad30 0x7efd9c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.067+0000 7efda19a2640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efd9c0ad730 0x7efd9c070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59740/0 (socket says 172.21.15.44:59740) 2023-11-04T01:39:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.067+0000 7efda19a2640 1 -- 172.21.15.44:0/230460922 learned_addr learned my addr 172.21.15.44:0/230460922 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:05.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.067+0000 7efda21a3640 1 -- 172.21.15.44:0/230460922 >> v2:172.21.15.204:3300/0 conn(0x7efd9c070e20 msgr2=0x7efd9c15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.067+0000 7efda29a4640 1 --2- 172.21.15.44:0/230460922 >> v2:172.21.15.204:3300/0 conn(0x7efd9c070e20 0x7efd9c15e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.067+0000 7efda11a1640 1 -- 172.21.15.44:0/230460922 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791431051 0 0) 0x7efd9c0c3900 con 0x7efd9c0ad730 2023-11-04T01:39:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.067+0000 7efda21a3640 1 --2- 172.21.15.44:0/230460922 >> v2:172.21.15.204:3300/0 conn(0x7efd9c070e20 0x7efd9c15e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.067+0000 7efda21a3640 1 -- 172.21.15.44:0/230460922 >> v1:172.21.15.44:6789/0 conn(0x7efd9c0ad730 legacy=0x7efd9c070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.067+0000 7efda21a3640 1 -- 172.21.15.44:0/230460922 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c0c3ec0 con 0x7efd9c15ad30 2023-11-04T01:39:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.067+0000 7efda29a4640 1 --2- 172.21.15.44:0/230460922 >> v2:172.21.15.204:3300/0 conn(0x7efd9c070e20 0x7efd9c15e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.068+0000 7efda21a3640 1 --2- 172.21.15.44:0/230460922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c15ad30 0x7efd9c0adc80 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0cf9e0 tx=0x7efd9802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd108c6a9edd498 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.068+0000 7efda11a1640 1 -- 172.21.15.44:0/230460922 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9802e070 con 0x7efd9c15ad30 2023-11-04T01:39:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.068+0000 7efda11a1640 1 -- 172.21.15.44:0/230460922 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd980315a0 con 0x7efd9c15ad30 2023-11-04T01:39:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.068+0000 7efda11a1640 1 -- 172.21.15.44:0/230460922 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98031930 con 0x7efd9c15ad30 2023-11-04T01:39:05.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.068+0000 7efda4407640 1 -- 172.21.15.44:0/230460922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c15ad30 msgr2=0x7efd9c0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.068+0000 7efda4407640 1 --2- 172.21.15.44:0/230460922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c15ad30 0x7efd9c0adc80 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0cf9e0 tx=0x7efd9802b840 comp rx=0 tx=0).stop 2023-11-04T01:39:05.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.069+0000 7efda4407640 1 -- 172.21.15.44:0/230460922 shutdown_connections 2023-11-04T01:39:05.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.069+0000 7efda4407640 1 --2- 172.21.15.44:0/230460922 >> v2:172.21.15.204:3300/0 conn(0x7efd9c070e20 0x7efd9c15e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.069+0000 7efda4407640 1 --2- 172.21.15.44:0/230460922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c15ad30 0x7efd9c0adc80 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.069+0000 7efda4407640 1 -- 172.21.15.44:0/230460922 >> 172.21.15.44:0/230460922 conn(0x7efd9c0ce950 msgr2=0x7efd9c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.069+0000 7efda4407640 1 -- 172.21.15.44:0/230460922 shutdown_connections 2023-11-04T01:39:05.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.069+0000 7efda4407640 1 -- 172.21.15.44:0/230460922 wait complete. 2023-11-04T01:39:05.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.070+0000 7efda4407640 1 Processor -- start 2023-11-04T01:39:05.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.070+0000 7efda4407640 1 -- start start 2023-11-04T01:39:05.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.070+0000 7efda4407640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd9c070e20 0x7efd9c0b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.070+0000 7efda4407640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c0ad730 0x7efd9c13a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda4407640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd9c15ad30 0x7efd9c139a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda4407640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c0b17f0 con 0x7efd9c0ad730 2023-11-04T01:39:05.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda4407640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c157c70 con 0x7efd9c070e20 2023-11-04T01:39:05.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda4407640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c157f50 con 0x7efd9c15ad30 2023-11-04T01:39:05.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda19a2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c0ad730 0x7efd9c13a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda19a2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c0ad730 0x7efd9c13a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55334/0 (socket says 172.21.15.44:55334) 2023-11-04T01:39:05.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda19a2640 1 -- 172.21.15.44:0/3050986974 learned_addr learned my addr 172.21.15.44:0/3050986974 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:05.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda29a4640 1 --2- 172.21.15.44:0/3050986974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd9c15ad30 0x7efd9c139a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda21a3640 1 --2- 172.21.15.44:0/3050986974 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd9c070e20 0x7efd9c0b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda19a2640 1 -- 172.21.15.44:0/3050986974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd9c15ad30 msgr2=0x7efd9c139a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda19a2640 1 --2- 172.21.15.44:0/3050986974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd9c15ad30 0x7efd9c139a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda19a2640 1 -- 172.21.15.44:0/3050986974 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd9c070e20 msgr2=0x7efd9c0b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda19a2640 1 --2- 172.21.15.44:0/3050986974 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd9c070e20 0x7efd9c0b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda19a2640 1 -- 172.21.15.44:0/3050986974 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd98009400 con 0x7efd9c0ad730 2023-11-04T01:39:05.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda19a2640 1 --2- 172.21.15.44:0/3050986974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c0ad730 0x7efd9c13a490 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00c4d0 tx=0x7efd8c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efd92ffd640 1 -- 172.21.15.44:0/3050986974 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c0074e0 con 0x7efd9c0ad730 2023-11-04T01:39:05.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efd92ffd640 1 -- 172.21.15.44:0/3050986974 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8c007660 con 0x7efd9c0ad730 2023-11-04T01:39:05.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda4407640 1 -- 172.21.15.44:0/3050986974 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9c158230 con 0x7efd9c0ad730 2023-11-04T01:39:05.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efd92ffd640 1 -- 172.21.15.44:0/3050986974 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c004a20 con 0x7efd9c0ad730 2023-11-04T01:39:05.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.071+0000 7efda4407640 1 -- 172.21.15.44:0/3050986974 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9c13a9d0 con 0x7efd9c0ad730 2023-11-04T01:39:05.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.073+0000 7efd92ffd640 1 -- 172.21.15.44:0/3050986974 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd8c004b80 con 0x7efd9c0ad730 2023-11-04T01:39:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.073+0000 7efd92ffd640 1 --2- 172.21.15.44:0/3050986974 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efd8006ae70 0x7efd8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.073+0000 7efd92ffd640 1 -- 172.21.15.44:0/3050986974 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7efd8c0890b0 con 0x7efd9c0ad730 2023-11-04T01:39:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.073+0000 7efda21a3640 1 --2- 172.21.15.44:0/3050986974 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efd8006ae70 0x7efd8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.074+0000 7efda21a3640 1 --2- 172.21.15.44:0/3050986974 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efd8006ae70 0x7efd8006d330 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efd98036000 tx=0x7efd9803d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.074+0000 7efda6f97740 1 Processor -- start 2023-11-04T01:39:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.075+0000 7efda6f97740 1 -- start start 2023-11-04T01:39:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.075+0000 7efda6f97740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c81984750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.075+0000 7efda6f97740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819b1c30 0x559c819b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.075+0000 7efda6f97740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c81984c90 0x559c819b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.075+0000 7efda6f97740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c81895740 con 0x559c819b1850 2023-11-04T01:39:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.075+0000 7efda6f97740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c818f78d0 con 0x559c819b1c30 2023-11-04T01:39:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.075+0000 7efda6f97740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c818f4fc0 con 0x559c81984c90 2023-11-04T01:39:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.075+0000 7efda21a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c81984750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.075+0000 7efda21a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c81984750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55346/0 (socket says 172.21.15.44:55346) 2023-11-04T01:39:05.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.075+0000 7efda21a3640 1 -- 172.21.15.44:0/1606575406 learned_addr learned my addr 172.21.15.44:0/1606575406 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:05.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.076+0000 7efda29a4640 1 --2- 172.21.15.44:0/1606575406 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c81984c90 0x559c819b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.076+0000 7efda19a2640 1 --2- 172.21.15.44:0/1606575406 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819b1c30 0x559c819b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.076+0000 7efda21a3640 1 -- 172.21.15.44:0/1606575406 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c81984c90 msgr2=0x559c819b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.076+0000 7efda21a3640 1 --2- 172.21.15.44:0/1606575406 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c81984c90 0x559c819b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.076+0000 7efda21a3640 1 -- 172.21.15.44:0/1606575406 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819b1c30 msgr2=0x559c819b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.076+0000 7efda21a3640 1 --2- 172.21.15.44:0/1606575406 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819b1c30 0x559c819b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.076+0000 7efda21a3640 1 -- 172.21.15.44:0/1606575406 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c818b3ca0 con 0x559c819b1850 2023-11-04T01:39:05.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.076+0000 7efda19a2640 1 --2- 172.21.15.44:0/1606575406 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819b1c30 0x559c819b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:05.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.076+0000 7efda21a3640 1 --2- 172.21.15.44:0/1606575406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c81984750 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7efd9802be50 tx=0x7efd98030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2964da0492efa65 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.076+0000 7efd7ffff640 1 -- 172.21.15.44:0/1606575406 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9804b070 con 0x559c819b1850 2023-11-04T01:39:05.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.076+0000 7efd7ffff640 1 -- 172.21.15.44:0/1606575406 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd98032e50 con 0x559c819b1850 2023-11-04T01:39:05.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.076+0000 7efd7ffff640 1 -- 172.21.15.44:0/1606575406 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98031ee0 con 0x559c819b1850 2023-11-04T01:39:05.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.077+0000 7efda6f97740 1 -- 172.21.15.44:0/1606575406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 msgr2=0x559c81984750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.077+0000 7efda6f97740 1 --2- 172.21.15.44:0/1606575406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c81984750 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7efd9802be50 tx=0x7efd98030000 comp rx=0 tx=0).stop 2023-11-04T01:39:05.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.077+0000 7efda6f97740 1 -- 172.21.15.44:0/1606575406 shutdown_connections 2023-11-04T01:39:05.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.077+0000 7efda6f97740 1 --2- 172.21.15.44:0/1606575406 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c81984c90 0x559c819b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.077+0000 7efda6f97740 1 --2- 172.21.15.44:0/1606575406 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819b1c30 0x559c819b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.077+0000 7efda6f97740 1 --2- 172.21.15.44:0/1606575406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c81984750 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.077+0000 7efda6f97740 1 -- 172.21.15.44:0/1606575406 >> 172.21.15.44:0/1606575406 conn(0x559c81986a60 msgr2=0x559c819cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.077+0000 7efda6f97740 1 -- 172.21.15.44:0/1606575406 shutdown_connections 2023-11-04T01:39:05.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.077+0000 7efda6f97740 1 -- 172.21.15.44:0/1606575406 wait complete. 2023-11-04T01:39:05.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.077+0000 7efda6f97740 1 -- start start 2023-11-04T01:39:05.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.077+0000 7efda6f97740 1 Processor -- start 2023-11-04T01:39:05.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.078+0000 7efda6f97740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c819c9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.078+0000 7efda6f97740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c819b1c30 0x559c819cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.078+0000 7efda6f97740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819ce090 0x559c819b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.078+0000 7efda6f97740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c818f08b0 con 0x559c819b1850 2023-11-04T01:39:05.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.078+0000 7efda6f97740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c818aac80 con 0x559c819ce090 2023-11-04T01:39:05.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.078+0000 7efda6f97740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c818aa920 con 0x559c819b1c30 2023-11-04T01:39:05.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.078+0000 7efda6f97740 10 client.0 _ll_register_callbacks cb 0x559c81602ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:05.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.078+0000 7efda21a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c819c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efda21a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c819c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55352/0 (socket says 172.21.15.44:55352) 2023-11-04T01:39:05.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efda21a3640 1 -- 172.21.15.44:0/3656674617 learned_addr learned my addr 172.21.15.44:0/3656674617 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:05.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efda19a2640 1 --2- 172.21.15.44:0/3656674617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c819b1c30 0x559c819cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efda29a4640 1 --2- 172.21.15.44:0/3656674617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819ce090 0x559c819b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efda21a3640 1 -- 172.21.15.44:0/3656674617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c819b1c30 msgr2=0x559c819cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efda21a3640 1 --2- 172.21.15.44:0/3656674617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c819b1c30 0x559c819cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efda21a3640 1 -- 172.21.15.44:0/3656674617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819ce090 msgr2=0x559c819b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efda21a3640 1 --2- 172.21.15.44:0/3656674617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819ce090 0x559c819b6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efda21a3640 1 -- 172.21.15.44:0/3656674617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9c0c3ec0 con 0x559c819b1850 2023-11-04T01:39:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efda21a3640 1 --2- 172.21.15.44:0/3656674617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c819c9640 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7efd98009890 tx=0x7efd98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d88c04083eb0147 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efd7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:39:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efd7d7fa640 1 -- 172.21.15.44:0/3656674617 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9804b040 con 0x559c819b1850 2023-11-04T01:39:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efda6f97740 1 -- 172.21.15.44:0/3656674617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c8189cbf0 con 0x559c819b1850 2023-11-04T01:39:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efd7d7fa640 1 -- 172.21.15.44:0/3656674617 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7efd98040070 con 0x559c819b1850 2023-11-04T01:39:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efd7d7fa640 1 -- 172.21.15.44:0/3656674617 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd98050bb0 con 0x559c819b1850 2023-11-04T01:39:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efda6f97740 10 client.7047 fetch_fsmap learned FSMap version 37 2023-11-04T01:39:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efda6f97740 1 -- 172.21.15.44:0/3656674617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x559c818eef30 con 0x559c819b1850 2023-11-04T01:39:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.079+0000 7efd7d7fa640 1 -- 172.21.15.44:0/3656674617 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c8189cbf0 con 0x559c819b1850 2023-11-04T01:39:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.080+0000 7efd7d7fa640 1 -- 172.21.15.44:0/3656674617 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 37) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efd98050d10 con 0x559c819b1850 2023-11-04T01:39:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.080+0000 7efda6f97740 10 client.7047 fetch_fsmap finished waiting for FSMap version 37 2023-11-04T01:39:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.080+0000 7efda6f97740 10 client.7047 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:39:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.080+0000 7efda6f97740 20 client.7047 populate_metadata read hostname 'smithi044' 2023-11-04T01:39:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.080+0000 7efda6f97740 1 --2- 172.21.15.44:0/3656674617 >> [v2:172.21.15.44:6833/364976049,v1:172.21.15.44:6835/364976049] conn(0x559c819cbd30 0x559c819c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.080+0000 7efda6f97740 4 client.7047 mds_command: new command op to 6891 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:39:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.080+0000 7efda6f97740 1 -- 172.21.15.44:0/3656674617 --> [v2:172.21.15.44:6833/364976049,v1:172.21.15.44:6835/364976049] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c818e9890 con 0x559c819cbd30 2023-11-04T01:39:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.080+0000 7efda19a2640 1 --2- 172.21.15.44:0/3656674617 >> [v2:172.21.15.44:6833/364976049,v1:172.21.15.44:6835/364976049] conn(0x559c819cbd30 0x559c819c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.080+0000 7efd7d7fa640 10 client.7047 ms_handle_connect on v2:172.21.15.44:6833/364976049 2023-11-04T01:39:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.080+0000 7efda19a2640 1 --2- 172.21.15.44:0/3656674617 >> [v2:172.21.15.44:6833/364976049,v1:172.21.15.44:6835/364976049] conn(0x559c819cbd30 0x559c819c9bc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff3c7c54bb1f4784 server_cookie=b9e08fdf248bc0f6 in_seq=0 out_seq=0 2023-11-04T01:39:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.081+0000 7efd7d7fa640 1 -- 172.21.15.44:0/3656674617 <== mds.0 v2:172.21.15.44:6833/364976049 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559c818e9890 con 0x559c819cbd30 2023-11-04T01:39:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.081+0000 7efd7d7fa640 10 client.7047 handle_command_reply: tid=0 2023-11-04T01:39:05.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.081+0000 7efda6f97740 1 client.7047 shutdown 2023-11-04T01:39:05.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.081+0000 7efda6f97740 1 -- 172.21.15.44:0/3656674617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 msgr2=0x559c819c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.081+0000 7efda6f97740 1 --2- 172.21.15.44:0/3656674617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c819c9640 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7efd98009890 tx=0x7efd98004730 comp rx=0 tx=0).stop 2023-11-04T01:39:05.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.081+0000 7efda6f97740 1 -- 172.21.15.44:0/3656674617 shutdown_connections 2023-11-04T01:39:05.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.081+0000 7efda6f97740 1 --2- 172.21.15.44:0/3656674617 >> [v2:172.21.15.44:6833/364976049,v1:172.21.15.44:6835/364976049] conn(0x559c819cbd30 0x559c819c9bc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.081+0000 7efda6f97740 1 --2- 172.21.15.44:0/3656674617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819ce090 0x559c819b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.081+0000 7efda6f97740 1 --2- 172.21.15.44:0/3656674617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c819b1c30 0x559c819cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.081+0000 7efd7d7fa640 0 client.7047 ms_handle_reset on v2:172.21.15.44:6833/364976049 2023-11-04T01:39:05.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.081+0000 7efda6f97740 1 --2- 172.21.15.44:0/3656674617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c819c9640 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.081+0000 7efda6f97740 1 -- 172.21.15.44:0/3656674617 >> 172.21.15.44:0/3656674617 conn(0x559c81984c90 msgr2=0x559c819b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.081+0000 7efda6f97740 1 -- 172.21.15.44:0/3656674617 shutdown_connections 2023-11-04T01:39:05.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.081+0000 7efda6f97740 1 -- 172.21.15.44:0/3656674617 wait complete. 2023-11-04T01:39:05.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.081+0000 7efda6f97740 20 client.7047 trim_cache size 0 max 16384 2023-11-04T01:39:05.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.097+0000 7efda6f97740 1 Processor -- start 2023-11-04T01:39:05.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.097+0000 7efda6f97740 1 -- start start 2023-11-04T01:39:05.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.098+0000 7efda6f97740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c819b1850 0x559c819b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.098+0000 7efda6f97740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1c30 0x559c819cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.098+0000 7efda6f97740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819ce090 0x559c819d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.098+0000 7efda6f97740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c81870280 con 0x559c819b1c30 2023-11-04T01:39:05.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.098+0000 7efda6f97740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c81983fa0 con 0x559c819ce090 2023-11-04T01:39:05.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.098+0000 7efda6f97740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c81988570 con 0x559c819b1850 2023-11-04T01:39:05.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.098+0000 7efda19a2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1c30 0x559c819cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.098+0000 7efda19a2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1c30 0x559c819cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55360/0 (socket says 172.21.15.44:55360) 2023-11-04T01:39:05.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.098+0000 7efda19a2640 1 -- 172.21.15.44:0/3451119601 learned_addr learned my addr 172.21.15.44:0/3451119601 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:05.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.098+0000 7efda19a2640 1 -- 172.21.15.44:0/3451119601 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c819b1850 msgr2=0x559c819b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.098+0000 7efda19a2640 1 --2- 172.21.15.44:0/3451119601 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c819b1850 0x559c819b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.098+0000 7efda19a2640 1 -- 172.21.15.44:0/3451119601 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819ce090 msgr2=0x559c819d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.098+0000 7efda19a2640 1 --2- 172.21.15.44:0/3451119601 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819ce090 0x559c819d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.098+0000 7efda19a2640 1 -- 172.21.15.44:0/3451119601 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c8188cd10 con 0x559c819b1c30 2023-11-04T01:39:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.099+0000 7efda19a2640 1 --2- 172.21.15.44:0/3451119601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1c30 0x559c819cfca0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7efd8c001120 tx=0x7efd8c086f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9c69facd72c7b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.099+0000 7efd90dff640 1 -- 172.21.15.44:0/3451119601 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c05fbb0 con 0x559c819b1c30 2023-11-04T01:39:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.099+0000 7efd90dff640 1 -- 172.21.15.44:0/3451119601 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8c0559f0 con 0x559c819b1c30 2023-11-04T01:39:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.099+0000 7efd90dff640 1 -- 172.21.15.44:0/3451119601 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c053fc0 con 0x559c819b1c30 2023-11-04T01:39:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.099+0000 7efda6f97740 1 -- 172.21.15.44:0/3451119601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1c30 msgr2=0x559c819cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.099+0000 7efda6f97740 1 --2- 172.21.15.44:0/3451119601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1c30 0x559c819cfca0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7efd8c001120 tx=0x7efd8c086f40 comp rx=0 tx=0).stop 2023-11-04T01:39:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.099+0000 7efda6f97740 1 -- 172.21.15.44:0/3451119601 shutdown_connections 2023-11-04T01:39:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.099+0000 7efda6f97740 1 --2- 172.21.15.44:0/3451119601 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819ce090 0x559c819d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.099+0000 7efda6f97740 1 --2- 172.21.15.44:0/3451119601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1c30 0x559c819cfca0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.099+0000 7efda6f97740 1 --2- 172.21.15.44:0/3451119601 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c819b1850 0x559c819b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.099+0000 7efda6f97740 1 -- 172.21.15.44:0/3451119601 >> 172.21.15.44:0/3451119601 conn(0x559c81984c90 msgr2=0x559c819b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.099+0000 7efda6f97740 1 -- 172.21.15.44:0/3451119601 shutdown_connections 2023-11-04T01:39:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.099+0000 7efda6f97740 1 -- 172.21.15.44:0/3451119601 wait complete. 2023-11-04T01:39:05.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.100+0000 7efda6f97740 1 -- start start 2023-11-04T01:39:05.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.100+0000 7efda6f97740 1 Processor -- start 2023-11-04T01:39:05.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda6f97740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c819cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda6f97740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819b1c30 0x559c819d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda6f97740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c819ce090 0x559c819c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda6f97740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c819e2960 con 0x559c819b1850 2023-11-04T01:39:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda6f97740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c819ca680 con 0x559c819b1c30 2023-11-04T01:39:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda6f97740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c81988820 con 0x559c819ce090 2023-11-04T01:39:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda6f97740 10 client.0 _ll_register_callbacks cb 0x7efd98009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda21a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c819cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda21a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c819cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55362/0 (socket says 172.21.15.44:55362) 2023-11-04T01:39:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda21a3640 1 -- 172.21.15.44:0/3202212291 learned_addr learned my addr 172.21.15.44:0/3202212291 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda29a4640 1 --2- 172.21.15.44:0/3202212291 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c819ce090 0x559c819c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda19a2640 1 --2- 172.21.15.44:0/3202212291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819b1c30 0x559c819d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda21a3640 1 -- 172.21.15.44:0/3202212291 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c819ce090 msgr2=0x559c819c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda21a3640 1 --2- 172.21.15.44:0/3202212291 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c819ce090 0x559c819c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda21a3640 1 -- 172.21.15.44:0/3202212291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819b1c30 msgr2=0x559c819d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda21a3640 1 --2- 172.21.15.44:0/3202212291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819b1c30 0x559c819d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.101+0000 7efda21a3640 1 -- 172.21.15.44:0/3202212291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9c13a9d0 con 0x559c819b1850 2023-11-04T01:39:05.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efda21a3640 1 --2- 172.21.15.44:0/3202212291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c819cfca0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7efd9805bc90 tx=0x7efd980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa676d462f087b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efd7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:39:05.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efd7d7fa640 1 -- 172.21.15.44:0/3202212291 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9804b030 con 0x559c819b1850 2023-11-04T01:39:05.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efd7d7fa640 1 -- 172.21.15.44:0/3202212291 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7efd98040070 con 0x559c819b1850 2023-11-04T01:39:05.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efda6f97740 1 -- 172.21.15.44:0/3202212291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd98032e50 con 0x559c819b1850 2023-11-04T01:39:05.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efd7d7fa640 1 -- 172.21.15.44:0/3202212291 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd9805be70 con 0x559c819b1850 2023-11-04T01:39:05.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efda6f97740 10 client.7053 fetch_fsmap learned FSMap version 37 2023-11-04T01:39:05.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efda6f97740 1 -- 172.21.15.44:0/3202212291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x559c818b2500 con 0x559c819b1850 2023-11-04T01:39:05.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efd7d7fa640 1 -- 172.21.15.44:0/3202212291 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd98032e50 con 0x559c819b1850 2023-11-04T01:39:05.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efd7d7fa640 1 -- 172.21.15.44:0/3202212291 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 37) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efd98050bb0 con 0x559c819b1850 2023-11-04T01:39:05.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efda6f97740 10 client.7053 fetch_fsmap finished waiting for FSMap version 37 2023-11-04T01:39:05.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efda6f97740 10 client.7053 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:39:05.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efda6f97740 20 client.7053 populate_metadata read hostname 'smithi044' 2023-11-04T01:39:05.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efda6f97740 1 --2- 172.21.15.44:0/3202212291 >> [v2:172.21.15.44:6833/364976049,v1:172.21.15.44:6835/364976049] conn(0x559c819c9990 0x559c819c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efda6f97740 4 client.7053 mds_command: new command op to 6891 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:39:05.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efda6f97740 1 -- 172.21.15.44:0/3202212291 --> [v2:172.21.15.44:6833/364976049,v1:172.21.15.44:6835/364976049] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559c818e95b0 con 0x559c819c9990 2023-11-04T01:39:05.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.102+0000 7efda19a2640 1 --2- 172.21.15.44:0/3202212291 >> [v2:172.21.15.44:6833/364976049,v1:172.21.15.44:6835/364976049] conn(0x559c819c9990 0x559c819c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efd7d7fa640 10 client.7053 ms_handle_connect on v2:172.21.15.44:6833/364976049 2023-11-04T01:39:05.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efda19a2640 1 --2- 172.21.15.44:0/3202212291 >> [v2:172.21.15.44:6833/364976049,v1:172.21.15.44:6835/364976049] conn(0x559c819c9990 0x559c819c9d70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99e8c7fe9ba3b621 server_cookie=8677b0e71e21ad3f in_seq=0 out_seq=0 2023-11-04T01:39:05.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efd7d7fa640 1 -- 172.21.15.44:0/3202212291 <== mds.0 v2:172.21.15.44:6833/364976049 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x559c818e95b0 con 0x559c819c9990 2023-11-04T01:39:05.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efd7d7fa640 10 client.7053 handle_command_reply: tid=0 2023-11-04T01:39:05.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efda6f97740 1 client.7053 shutdown 2023-11-04T01:39:05.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efda6f97740 1 -- 172.21.15.44:0/3202212291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 msgr2=0x559c819cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efda6f97740 1 --2- 172.21.15.44:0/3202212291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c819cfca0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7efd9805bc90 tx=0x7efd980046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efda6f97740 1 -- 172.21.15.44:0/3202212291 shutdown_connections 2023-11-04T01:39:05.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efda6f97740 1 --2- 172.21.15.44:0/3202212291 >> [v2:172.21.15.44:6833/364976049,v1:172.21.15.44:6835/364976049] conn(0x559c819c9990 0x559c819c9d70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efda6f97740 1 --2- 172.21.15.44:0/3202212291 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559c819ce090 0x559c819c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efda6f97740 1 --2- 172.21.15.44:0/3202212291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559c819b1c30 0x559c819d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efda6f97740 1 --2- 172.21.15.44:0/3202212291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c819b1850 0x559c819cfca0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efd7d7fa640 0 client.7053 ms_handle_reset on v2:172.21.15.44:6833/364976049 2023-11-04T01:39:05.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efda6f97740 1 -- 172.21.15.44:0/3202212291 >> 172.21.15.44:0/3202212291 conn(0x559c81984c90 msgr2=0x559c819d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efda6f97740 1 -- 172.21.15.44:0/3202212291 shutdown_connections 2023-11-04T01:39:05.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efda6f97740 1 -- 172.21.15.44:0/3202212291 wait complete. 2023-11-04T01:39:05.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.103+0000 7efda6f97740 20 client.7053 trim_cache size 0 max 16384 2023-11-04T01:39:05.112 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:39:05.112 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:39:05.112 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2023-11-04T01:39:05.112 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6891, 2023-11-04T01:39:05.112 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:39:05.112 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:39:05.112 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:39:05.112 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 4.700447327, 2023-11-04T01:39:05.112 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 37, 2023-11-04T01:39:05.113 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 84, 2023-11-04T01:39:05.113 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 84, 2023-11-04T01:39:05.113 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 11.730852107 2023-11-04T01:39:05.113 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:39:05.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.104+0000 7efda4407640 1 -- 172.21.15.44:0/3050986974 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efd8006ae70 msgr2=0x7efd8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.104+0000 7efda4407640 1 --2- 172.21.15.44:0/3050986974 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efd8006ae70 0x7efd8006d330 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efd98036000 tx=0x7efd9803d040 comp rx=0 tx=0).stop 2023-11-04T01:39:05.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.104+0000 7efda4407640 1 -- 172.21.15.44:0/3050986974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c0ad730 msgr2=0x7efd9c13a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.104+0000 7efda4407640 1 --2- 172.21.15.44:0/3050986974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c0ad730 0x7efd9c13a490 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00c4d0 tx=0x7efd8c00c990 comp rx=0 tx=0).stop 2023-11-04T01:39:05.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.104+0000 7efda4407640 1 -- 172.21.15.44:0/3050986974 shutdown_connections 2023-11-04T01:39:05.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.104+0000 7efda4407640 1 --2- 172.21.15.44:0/3050986974 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efd8006ae70 0x7efd8006d330 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.104+0000 7efda4407640 1 --2- 172.21.15.44:0/3050986974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd9c15ad30 0x7efd9c139a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.104+0000 7efda4407640 1 --2- 172.21.15.44:0/3050986974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c0ad730 0x7efd9c13a490 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.104+0000 7efda4407640 1 --2- 172.21.15.44:0/3050986974 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd9c070e20 0x7efd9c0b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.104+0000 7efda4407640 1 -- 172.21.15.44:0/3050986974 >> 172.21.15.44:0/3050986974 conn(0x7efd9c0ce950 msgr2=0x7efd9c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.104+0000 7efda4407640 1 -- 172.21.15.44:0/3050986974 shutdown_connections 2023-11-04T01:39:05.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.104+0000 7efda4407640 1 -- 172.21.15.44:0/3050986974 wait complete. 2023-11-04T01:39:05.116 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:39:05.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.220+0000 7f1a875f5640 1 Processor -- start 2023-11-04T01:39:05.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.221+0000 7f1a875f5640 1 -- start start 2023-11-04T01:39:05.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.221+0000 7f1a875f5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1a800cde60 0x7f1a8015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.221+0000 7f1a875f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a8015daa0 0x7f1a80157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.221+0000 7f1a875f5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8015e000 con 0x7f1a800ce240 2023-11-04T01:39:05.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.221+0000 7f1a875f5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8015e5c0 con 0x7f1a800cde60 2023-11-04T01:39:05.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.221+0000 7f1a875f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8015e2e0 con 0x7f1a8015daa0 2023-11-04T01:39:05.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.222+0000 7f1a85391640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1a800cde60 0x7f1a8015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.222+0000 7f1a85b92640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1a800ce240 0x7f1a8006b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59744/0 (socket says 172.21.15.44:59744) 2023-11-04T01:39:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.222+0000 7f1a85b92640 1 -- 172.21.15.44:0/886478824 learned_addr learned my addr 172.21.15.44:0/886478824 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.222+0000 7f1a84b90640 1 --2- 172.21.15.44:0/886478824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a8015daa0 0x7f1a80157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.222+0000 7f1a85391640 1 -- 172.21.15.44:0/886478824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a8015daa0 msgr2=0x7f1a80157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.222+0000 7f1a85391640 1 --2- 172.21.15.44:0/886478824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a8015daa0 0x7f1a80157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.222+0000 7f1a85391640 1 -- 172.21.15.44:0/886478824 >> v1:172.21.15.44:6789/0 conn(0x7f1a800ce240 legacy=0x7f1a8006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.222+0000 7f1a7ffff640 1 -- 172.21.15.44:0/886478824 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513358383 0 0) 0x7f1a8015e000 con 0x7f1a800ce240 2023-11-04T01:39:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.222+0000 7f1a85391640 1 -- 172.21.15.44:0/886478824 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a800d1120 con 0x7f1a800cde60 2023-11-04T01:39:05.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.223+0000 7f1a85391640 1 --2- 172.21.15.44:0/886478824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a800cde60 0x7f1a8015d560 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f1a780097a0 tx=0x7f1a7802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c49ce62920ba0a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.223+0000 7f1a7ffff640 1 -- 172.21.15.44:0/886478824 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a78031830 con 0x7f1a800cde60 2023-11-04T01:39:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.223+0000 7f1a7ffff640 1 -- 172.21.15.44:0/886478824 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a78031990 con 0x7f1a800cde60 2023-11-04T01:39:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.223+0000 7f1a7ffff640 1 -- 172.21.15.44:0/886478824 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a78031d20 con 0x7f1a800cde60 2023-11-04T01:39:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.223+0000 7f1a875f5640 1 -- 172.21.15.44:0/886478824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a800cde60 msgr2=0x7f1a8015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.223+0000 7f1a875f5640 1 --2- 172.21.15.44:0/886478824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a800cde60 0x7f1a8015d560 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f1a780097a0 tx=0x7f1a7802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.223+0000 7f1a875f5640 1 -- 172.21.15.44:0/886478824 shutdown_connections 2023-11-04T01:39:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.223+0000 7f1a875f5640 1 --2- 172.21.15.44:0/886478824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a8015daa0 0x7f1a80157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.223+0000 7f1a875f5640 1 --2- 172.21.15.44:0/886478824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a800cde60 0x7f1a8015d560 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.223+0000 7f1a875f5640 1 -- 172.21.15.44:0/886478824 >> 172.21.15.44:0/886478824 conn(0x7f1a80071f30 msgr2=0x7f1a800cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.223+0000 7f1a875f5640 1 -- 172.21.15.44:0/886478824 shutdown_connections 2023-11-04T01:39:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.223+0000 7f1a875f5640 1 -- 172.21.15.44:0/886478824 wait complete. 2023-11-04T01:39:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.225+0000 7f1a875f5640 1 Processor -- start 2023-11-04T01:39:05.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.225+0000 7f1a875f5640 1 -- start start 2023-11-04T01:39:05.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.225+0000 7f1a875f5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a800cde60 0x7f1a80149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.225+0000 7f1a875f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a800ce240 0x7f1a801f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.225+0000 7f1a875f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a8015daa0 0x7f1a8015ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.225+0000 7f1a875f5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a80147490 con 0x7f1a8015daa0 2023-11-04T01:39:05.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.225+0000 7f1a875f5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801f5da0 con 0x7f1a800cde60 2023-11-04T01:39:05.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.225+0000 7f1a875f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a80148b60 con 0x7f1a800ce240 2023-11-04T01:39:05.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.225+0000 7f1a85b92640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a8015daa0 0x7f1a8015ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a85b92640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a8015daa0 0x7f1a8015ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55376/0 (socket says 172.21.15.44:55376) 2023-11-04T01:39:05.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a85b92640 1 -- 172.21.15.44:0/3542419335 learned_addr learned my addr 172.21.15.44:0/3542419335 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:05.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a84b90640 1 --2- 172.21.15.44:0/3542419335 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a800ce240 0x7f1a801f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a85391640 1 --2- 172.21.15.44:0/3542419335 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a800cde60 0x7f1a80149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a85b92640 1 -- 172.21.15.44:0/3542419335 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a800ce240 msgr2=0x7f1a801f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a85b92640 1 --2- 172.21.15.44:0/3542419335 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a800ce240 0x7f1a801f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a85b92640 1 -- 172.21.15.44:0/3542419335 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a800cde60 msgr2=0x7f1a80149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a85b92640 1 --2- 172.21.15.44:0/3542419335 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a800cde60 0x7f1a80149390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a85b92640 1 -- 172.21.15.44:0/3542419335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a78009400 con 0x7f1a8015daa0 2023-11-04T01:39:05.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a84b90640 1 --2- 172.21.15.44:0/3542419335 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a800ce240 0x7f1a801f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:05.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a85b92640 1 --2- 172.21.15.44:0/3542419335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a8015daa0 0x7f1a8015ca10 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000c7e0 tx=0x7f1a7000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a7dffb640 1 -- 172.21.15.44:0/3542419335 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000a640 con 0x7f1a8015daa0 2023-11-04T01:39:05.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a7dffb640 1 -- 172.21.15.44:0/3542419335 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7000a7c0 con 0x7f1a8015daa0 2023-11-04T01:39:05.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a875f5640 1 -- 172.21.15.44:0/3542419335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a801499d0 con 0x7f1a8015daa0 2023-11-04T01:39:05.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a7dffb640 1 -- 172.21.15.44:0/3542419335 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000ab70 con 0x7f1a8015daa0 2023-11-04T01:39:05.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.226+0000 7f1a875f5640 1 -- 172.21.15.44:0/3542419335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a80149f90 con 0x7f1a8015daa0 2023-11-04T01:39:05.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.227+0000 7f1a875f5640 1 -- 172.21.15.44:0/3542419335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a801475d0 con 0x7f1a8015daa0 2023-11-04T01:39:05.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.228+0000 7f1a7dffb640 1 -- 172.21.15.44:0/3542419335 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a7000acd0 con 0x7f1a8015daa0 2023-11-04T01:39:05.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.228+0000 7f1a7dffb640 1 --2- 172.21.15.44:0/3542419335 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a6c06ae70 0x7f1a6c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.228+0000 7f1a7dffb640 1 -- 172.21.15.44:0/3542419335 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f1a70089160 con 0x7f1a8015daa0 2023-11-04T01:39:05.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.228+0000 7f1a85391640 1 --2- 172.21.15.44:0/3542419335 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a6c06ae70 0x7f1a6c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.229+0000 7f1a85391640 1 --2- 172.21.15.44:0/3542419335 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a6c06ae70 0x7f1a6c06d330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1a78036000 tx=0x7f1a7803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.232+0000 7f1a7dffb640 1 -- 172.21.15.44:0/3542419335 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a70053ca0 con 0x7f1a8015daa0 2023-11-04T01:39:05.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.446+0000 7f1a875f5640 1 -- 172.21.15.44:0/3542419335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1a80074290 con 0x7f1a8015daa0 2023-11-04T01:39:05.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.447+0000 7f1a7dffb640 1 -- 172.21.15.44:0/3542419335 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1a70018070 con 0x7f1a8015daa0 2023-11-04T01:39:05.449 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:39:05.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.449+0000 7f1a875f5640 1 -- 172.21.15.44:0/3542419335 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a6c06ae70 msgr2=0x7f1a6c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.449+0000 7f1a875f5640 1 --2- 172.21.15.44:0/3542419335 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a6c06ae70 0x7f1a6c06d330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1a78036000 tx=0x7f1a7803c040 comp rx=0 tx=0).stop 2023-11-04T01:39:05.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.449+0000 7f1a875f5640 1 -- 172.21.15.44:0/3542419335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a8015daa0 msgr2=0x7f1a8015ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.449+0000 7f1a875f5640 1 --2- 172.21.15.44:0/3542419335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a8015daa0 0x7f1a8015ca10 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000c7e0 tx=0x7f1a7000cca0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.449+0000 7f1a875f5640 1 -- 172.21.15.44:0/3542419335 shutdown_connections 2023-11-04T01:39:05.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.449+0000 7f1a875f5640 1 --2- 172.21.15.44:0/3542419335 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a6c06ae70 0x7f1a6c06d330 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.449+0000 7f1a875f5640 1 --2- 172.21.15.44:0/3542419335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a8015daa0 0x7f1a8015ca10 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.449+0000 7f1a875f5640 1 --2- 172.21.15.44:0/3542419335 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a800ce240 0x7f1a801f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.449+0000 7f1a875f5640 1 --2- 172.21.15.44:0/3542419335 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a800cde60 0x7f1a80149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.449+0000 7f1a875f5640 1 -- 172.21.15.44:0/3542419335 >> 172.21.15.44:0/3542419335 conn(0x7f1a80071f30 msgr2=0x7f1a80156530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.449+0000 7f1a875f5640 1 -- 172.21.15.44:0/3542419335 shutdown_connections 2023-11-04T01:39:05.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:05.449+0000 7f1a875f5640 1 -- 172.21.15.44:0/3542419335 wait complete. 2023-11-04T01:39:05.461 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:39:05.461 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:39:05.462 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2023-11-04T01:39:05.462 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:39:05.462 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:05.462 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:39:05.462 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:39:05.462 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:39:05.462 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:39:05.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:05.463 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2023-11-04T01:39:05.478 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:39:05.479 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:39:05.479 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:39:05.479 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:05.479 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2023-11-04T01:39:05.479 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:05.479 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:39:05.479 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:05.479 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2023-11-04T01:39:05.479 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:39:05.479 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:05.479 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42324sec preferred_lft 42324sec 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi044.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:39:05.481 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:05.481 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::9082:77ff:fe28:4353/64 scope link 2023-11-04T01:39:05.481 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:05.481 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:39:05.481 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:05.481 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::e49d:e3ff:fe56:d068/64 scope link 2023-11-04T01:39:05.481 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:05.481 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:39:05.481 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether f2:23:83:31:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:05.481 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::f023:83ff:fe31:915/64 scope link 2023-11-04T01:39:05.481 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:05.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:05.482 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:39:05.548 INFO:teuthology.orchestra.run.smithi044.stdout:1 2023-11-04T01:39:05.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:05.549 DEBUG:teuthology.orchestra.run.smithi044:> route 2023-11-04T01:39:05.606 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2023-11-04T01:39:05.606 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:39:05.606 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-04T01:39:05.606 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-04T01:39:05.606 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:39:05.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:05.606 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:39:05.607 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:39:05.607 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:39:05.607 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:39:05.607 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:39:05.607 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:39:05.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:05.712 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2023-11-04T01:39:05.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:39:05.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:39:05.727 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:39:05.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:05.727 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2023-11-04T01:39:05.798 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:39:05.798 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:39:05.798 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:39:05.853 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:39:05.853 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:05.908 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:39:05.963 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:39:05.964 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:39:05.964 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:39:05.964 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:39:05.964 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:39:05.964 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:39:05.964 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:39:05.964 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:39:05.964 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:39:05.964 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:39:05.964 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:39:05.964 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:39:05.964 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:39:05.964 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:39:05.965 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:39:05.965 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:39:05.965 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:39:05.965 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:39:05.965 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:39:05.965 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:39:05.965 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:39:05.965 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:39:05.965 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:39:05.965 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:39:05.965 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:39:05.965 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:39:05.965 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:39:05.966 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:39:05.966 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:39:05.966 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:39:05.966 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:05.966 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:05.966 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:05.966 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:05.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:05.966 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:39:06.019 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:39:06.019 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:39:06.061 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:39:06.077 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:39:06.077 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:39:06.077 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:39:06.077 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:39:06.077 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:39:06.077 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:39:06.077 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:39:06.077 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:39:06.077 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:39:06.078 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:39:06.078 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:39:06.078 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:39:06.078 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:39:06.078 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:39:06.078 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:39:06.078 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:39:06.078 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:39:06.078 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:39:06.078 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:39:06.078 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:39:06.078 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:39:06.079 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:39:06.079 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:39:06.079 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:39:06.079 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:39:06.079 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:39:06.079 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:39:06.079 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:39:06.079 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:39:06.079 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:39:06.079 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:06.079 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:06.079 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:06.079 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:06.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:06.080 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:39:06.160 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:39:06.158+0000 7f043fa0f480 -1 init, newargv = 0x558701aaddf0 newargc=15 2023-11-04T01:39:06.160 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[114283]: starting ceph client 2023-11-04T01:39:06.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[114283]: starting fuse 2023-11-04T01:39:07.233 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:39:07.253 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:39:07.254 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:39:07.254 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:39:07.254 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:39:07.254 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:39:07.254 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:39:07.254 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:39:07.254 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:39:07.254 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:39:07.254 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:39:07.254 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:39:07.255 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:39:07.255 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:39:07.255 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:39:07.255 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:39:07.255 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:39:07.255 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:39:07.255 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:39:07.255 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:39:07.255 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:39:07.255 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:39:07.255 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:39:07.255 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:39:07.255 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:39:07.256 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:39:07.256 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:39:07.256 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:39:07.256 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:39:07.256 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:39:07.256 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:39:07.256 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:07.256 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:07.256 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:07.256 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:07.256 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:07.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:07.257 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:39:07.312 INFO:teuthology.orchestra.run.smithi044.stdout:41 2023-11-04T01:39:07.312 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:39:07.313 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:39:07.313 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2023-11-04T01:39:07.313 DEBUG:teuthology.orchestra.run.smithi044:> import re 2023-11-04T01:39:07.313 DEBUG:teuthology.orchestra.run.smithi044:> import os 2023-11-04T01:39:07.313 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2023-11-04T01:39:07.313 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:39:07.313 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2023-11-04T01:39:07.313 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:39:07.313 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2023-11-04T01:39:07.313 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:39:07.313 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:39:07.314 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2023-11-04T01:39:07.314 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2023-11-04T01:39:07.314 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2023-11-04T01:39:07.314 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2023-11-04T01:39:07.314 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:39:07.314 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2023-11-04T01:39:07.314 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:39:07.314 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:39:07.314 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:39:07.314 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2023-11-04T01:39:07.314 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2023-11-04T01:39:07.314 DEBUG:teuthology.orchestra.run.smithi044:> return f 2023-11-04T01:39:07.314 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:39:07.315 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:39:07.315 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2023-11-04T01:39:07.315 DEBUG:teuthology.orchestra.run.smithi044:> ' 2023-11-04T01:39:07.449 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.114283.asok 2023-11-04T01:39:07.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:07.461 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.114283.asok 2023-11-04T01:39:07.461 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:07.461 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.114283.asok status 2023-11-04T01:39:07.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:07.639 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:39:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2023-11-04T01:39:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:39:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:39:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2023-11-04T01:39:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2023-11-04T01:39:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:39:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "114283", 2023-11-04T01:39:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2023-11-04T01:39:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2023-11-04T01:39:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2023-11-04T01:39:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7068, 2023-11-04T01:39:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2023-11-04T01:39:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2023-11-04T01:39:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2023-11-04T01:39:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 7068 2023-11-04T01:39:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:39:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:39:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:39:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1255263745 2023-11-04T01:39:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:39:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:39:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:39:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1255263745 2023-11-04T01:39:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.7068 192.168.0.1:0/1255263745", 2023-11-04T01:39:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/1255263745", 2023-11-04T01:39:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2023-11-04T01:39:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 37, 2023-11-04T01:39:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 84, 2023-11-04T01:39:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:39:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2023-11-04T01:39:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2023-11-04T01:39:07.642 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:39:07.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:07.653 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:07.653 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:39:07.653 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:07.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:07.717 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2023-11-04T01:39:07.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:07.724 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:07.724 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:07.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:07.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:07.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:07.795 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_snaps_per_dir 2023-11-04T01:39:07.913 INFO:teuthology.orchestra.run.smithi044.stdout:{"mds_max_snaps_per_dir":"100"} 2023-11-04T01:39:07.914 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_snaps_per_dir": "100" } 2023-11-04T01:39:07.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:07.914 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps) 2023-11-04T01:39:07.935 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps false --yes-i-really-mean-it 2023-11-04T01:39:08.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.084+0000 7ffa97207640 1 Processor -- start 2023-11-04T01:39:08.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.084+0000 7ffa97207640 1 -- start start 2023-11-04T01:39:08.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.084+0000 7ffa97207640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa90159be0 0x7ffa900c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.084+0000 7ffa97207640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ffa900ade40 0x7ffa900c3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.084+0000 7ffa97207640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa900c5890 con 0x7ffa9015e420 2023-11-04T01:39:08.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.084+0000 7ffa97207640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa900cd8e0 con 0x7ffa900ade40 2023-11-04T01:39:08.087 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.084+0000 7ffa97207640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900cdbc0 con 0x7ffa90159be0 2023-11-04T01:39:08.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.085+0000 7ffa8ffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ffa9015e420 0x7ffa900ad730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59752/0 (socket says 172.21.15.44:59752) 2023-11-04T01:39:08.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.085+0000 7ffa8ffff640 1 -- 172.21.15.44:0/2426654574 learned_addr learned my addr 172.21.15.44:0/2426654574 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:08.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.085+0000 7ffa94fa3640 1 --2- 172.21.15.44:0/2426654574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa90159be0 0x7ffa900c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.085+0000 7ffa957a4640 1 --2- 172.21.15.44:0/2426654574 >> v2:172.21.15.204:3300/0 conn(0x7ffa900ade40 0x7ffa900c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.085+0000 7ffa8f7fe640 1 -- 172.21.15.44:0/2426654574 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254084297 0 0) 0x7ffa900c5890 con 0x7ffa9015e420 2023-11-04T01:39:08.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.085+0000 7ffa8f7fe640 1 -- 172.21.15.44:0/2426654574 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa80003520 con 0x7ffa9015e420 2023-11-04T01:39:08.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.085+0000 7ffa94fa3640 1 -- 172.21.15.44:0/2426654574 >> v2:172.21.15.204:3300/0 conn(0x7ffa900ade40 msgr2=0x7ffa900c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:08.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.085+0000 7ffa94fa3640 1 --2- 172.21.15.44:0/2426654574 >> v2:172.21.15.204:3300/0 conn(0x7ffa900ade40 0x7ffa900c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.085+0000 7ffa94fa3640 1 -- 172.21.15.44:0/2426654574 >> v1:172.21.15.44:6789/0 conn(0x7ffa9015e420 legacy=0x7ffa900ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.085+0000 7ffa94fa3640 1 -- 172.21.15.44:0/2426654574 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa900cdea0 con 0x7ffa90159be0 2023-11-04T01:39:08.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.086+0000 7ffa94fa3640 1 --2- 172.21.15.44:0/2426654574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa90159be0 0x7ffa900c4f60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffa840097a0 tx=0x7ffa8402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=509896cf61491fc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.086+0000 7ffa8f7fe640 1 -- 172.21.15.44:0/2426654574 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8402e070 con 0x7ffa90159be0 2023-11-04T01:39:08.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.086+0000 7ffa8f7fe640 1 -- 172.21.15.44:0/2426654574 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa840315a0 con 0x7ffa90159be0 2023-11-04T01:39:08.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.086+0000 7ffa8f7fe640 1 -- 172.21.15.44:0/2426654574 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa84031910 con 0x7ffa90159be0 2023-11-04T01:39:08.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.087+0000 7ffa97207640 1 -- 172.21.15.44:0/2426654574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa90159be0 msgr2=0x7ffa900c4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.087+0000 7ffa97207640 1 --2- 172.21.15.44:0/2426654574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa90159be0 0x7ffa900c4f60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffa840097a0 tx=0x7ffa8402b840 comp rx=0 tx=0).stop 2023-11-04T01:39:08.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.087+0000 7ffa97207640 1 -- 172.21.15.44:0/2426654574 shutdown_connections 2023-11-04T01:39:08.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.087+0000 7ffa97207640 1 --2- 172.21.15.44:0/2426654574 >> v2:172.21.15.204:3300/0 conn(0x7ffa900ade40 0x7ffa900c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.087+0000 7ffa97207640 1 --2- 172.21.15.44:0/2426654574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa90159be0 0x7ffa900c4f60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.087+0000 7ffa97207640 1 -- 172.21.15.44:0/2426654574 >> 172.21.15.44:0/2426654574 conn(0x7ffa900b05d0 msgr2=0x7ffa900b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:08.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.087+0000 7ffa97207640 1 -- 172.21.15.44:0/2426654574 shutdown_connections 2023-11-04T01:39:08.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.087+0000 7ffa97207640 1 -- 172.21.15.44:0/2426654574 wait complete. 2023-11-04T01:39:08.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.088+0000 7ffa97207640 1 Processor -- start 2023-11-04T01:39:08.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.088+0000 7ffa97207640 1 -- start start 2023-11-04T01:39:08.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa97207640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa900ade40 0x7ffa9014f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa97207640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffa90159be0 0x7ffa900c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa97207640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa9015e420 0x7ffa900cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa97207640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa90150060 con 0x7ffa9015e420 2023-11-04T01:39:08.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa97207640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900c8230 con 0x7ffa90159be0 2023-11-04T01:39:08.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa97207640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900c5c30 con 0x7ffa900ade40 2023-11-04T01:39:08.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa957a4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa9015e420 0x7ffa900cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa957a4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa9015e420 0x7ffa900cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55390/0 (socket says 172.21.15.44:55390) 2023-11-04T01:39:08.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa957a4640 1 -- 172.21.15.44:0/4196363119 learned_addr learned my addr 172.21.15.44:0/4196363119 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:08.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa94fa3640 1 --2- 172.21.15.44:0/4196363119 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa900ade40 0x7ffa9014f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa8ffff640 1 --2- 172.21.15.44:0/4196363119 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffa90159be0 0x7ffa900c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa957a4640 1 -- 172.21.15.44:0/4196363119 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa900ade40 msgr2=0x7ffa9014f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa957a4640 1 --2- 172.21.15.44:0/4196363119 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa900ade40 0x7ffa9014f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa957a4640 1 -- 172.21.15.44:0/4196363119 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffa90159be0 msgr2=0x7ffa900c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa957a4640 1 --2- 172.21.15.44:0/4196363119 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffa90159be0 0x7ffa900c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa957a4640 1 -- 172.21.15.44:0/4196363119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa84009400 con 0x7ffa9015e420 2023-11-04T01:39:08.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa94fa3640 1 --2- 172.21.15.44:0/4196363119 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa900ade40 0x7ffa9014f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:08.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.089+0000 7ffa957a4640 1 --2- 172.21.15.44:0/4196363119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa9015e420 0x7ffa900cc830 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009d30 tx=0x7ffa8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.090+0000 7ffa8d7fa640 1 -- 172.21.15.44:0/4196363119 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88009ba0 con 0x7ffa9015e420 2023-11-04T01:39:08.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.090+0000 7ffa8d7fa640 1 -- 172.21.15.44:0/4196363119 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8800f040 con 0x7ffa9015e420 2023-11-04T01:39:08.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.090+0000 7ffa8d7fa640 1 -- 172.21.15.44:0/4196363119 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880146c0 con 0x7ffa9015e420 2023-11-04T01:39:08.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.090+0000 7ffa97207640 1 -- 172.21.15.44:0/4196363119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa900c7f50 con 0x7ffa9015e420 2023-11-04T01:39:08.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.090+0000 7ffa97207640 1 -- 172.21.15.44:0/4196363119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa900c61b0 con 0x7ffa9015e420 2023-11-04T01:39:08.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.090+0000 7ffa97207640 1 -- 172.21.15.44:0/4196363119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa900c63d0 con 0x7ffa9015e420 2023-11-04T01:39:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.091+0000 7ffa8d7fa640 1 -- 172.21.15.44:0/4196363119 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa88014820 con 0x7ffa9015e420 2023-11-04T01:39:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.091+0000 7ffa8d7fa640 1 --2- 172.21.15.44:0/4196363119 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffa7406ae70 0x7ffa7406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.092+0000 7ffa8d7fa640 1 -- 172.21.15.44:0/4196363119 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7ffa8808a690 con 0x7ffa9015e420 2023-11-04T01:39:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.092+0000 7ffa94fa3640 1 --2- 172.21.15.44:0/4196363119 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffa7406ae70 0x7ffa7406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.092+0000 7ffa94fa3640 1 --2- 172.21.15.44:0/4196363119 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffa7406ae70 0x7ffa7406d330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ffa84036000 tx=0x7ffa84008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.096+0000 7ffa8d7fa640 1 -- 172.21.15.44:0/4196363119 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffa880551b0 con 0x7ffa9015e420 2023-11-04T01:39:08.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.309+0000 7ffa97207640 1 -- 172.21.15.44:0/4196363119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ffa9004e490 con 0x7ffa9015e420 2023-11-04T01:39:08.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.438+0000 7ffa8d7fa640 1 -- 172.21.15.44:0/4196363119 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true}]=0 disabled new snapshots v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7ffa880587d0 con 0x7ffa9015e420 2023-11-04T01:39:08.440 INFO:teuthology.orchestra.run.smithi044.stderr:disabled new snapshots 2023-11-04T01:39:08.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.440+0000 7ffa97207640 1 -- 172.21.15.44:0/4196363119 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffa7406ae70 msgr2=0x7ffa7406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.440+0000 7ffa97207640 1 --2- 172.21.15.44:0/4196363119 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffa7406ae70 0x7ffa7406d330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ffa84036000 tx=0x7ffa84008030 comp rx=0 tx=0).stop 2023-11-04T01:39:08.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.440+0000 7ffa97207640 1 -- 172.21.15.44:0/4196363119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa9015e420 msgr2=0x7ffa900cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.440+0000 7ffa97207640 1 --2- 172.21.15.44:0/4196363119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa9015e420 0x7ffa900cc830 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009d30 tx=0x7ffa8800c490 comp rx=0 tx=0).stop 2023-11-04T01:39:08.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.440+0000 7ffa97207640 1 -- 172.21.15.44:0/4196363119 shutdown_connections 2023-11-04T01:39:08.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.440+0000 7ffa97207640 1 --2- 172.21.15.44:0/4196363119 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffa7406ae70 0x7ffa7406d330 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.440+0000 7ffa97207640 1 --2- 172.21.15.44:0/4196363119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa9015e420 0x7ffa900cc830 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.440+0000 7ffa97207640 1 --2- 172.21.15.44:0/4196363119 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffa90159be0 0x7ffa900c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.440+0000 7ffa97207640 1 --2- 172.21.15.44:0/4196363119 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffa900ade40 0x7ffa9014f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.440+0000 7ffa97207640 1 -- 172.21.15.44:0/4196363119 >> 172.21.15.44:0/4196363119 conn(0x7ffa900b05d0 msgr2=0x7ffa900c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:08.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.440+0000 7ffa97207640 1 -- 172.21.15.44:0/4196363119 shutdown_connections 2023-11-04T01:39:08.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.440+0000 7ffa97207640 1 -- 172.21.15.44:0/4196363119 wait complete. 2023-11-04T01:39:08.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:08.453 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-11-04T01:39:08.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:08.471 INFO:teuthology.orchestra.run.smithi044.stderr:mkdir: cannot create directory ‘test-allow-snaps/.snap/snap00’: Operation not permitted 2023-11-04T01:39:08.471 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-11-04T01:39:08.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.619+0000 7f4998383640 1 Processor -- start 2023-11-04T01:39:08.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.620+0000 7f4998383640 1 -- start start 2023-11-04T01:39:08.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.620+0000 7f4998383640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499015e590 0x7f499006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.620+0000 7f4998383640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f49900ca0a0 0x7f499006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.620+0000 7f4998383640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49900ae890 con 0x7f499006a660 2023-11-04T01:39:08.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.620+0000 7f4998383640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49900ca9b0 con 0x7f49900ca0a0 2023-11-04T01:39:08.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.620+0000 7f4998383640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49900cac90 con 0x7f499015e590 2023-11-04T01:39:08.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.621+0000 7f499591e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f49900ca0a0 0x7f499006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.621+0000 7f499611f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499015e590 0x7f499006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.621+0000 7f499611f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499015e590 0x7f499006fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:57722/0 (socket says 172.21.15.44:57722) 2023-11-04T01:39:08.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.621+0000 7f499591e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f49900ca0a0 0x7f499006a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:39874/0 (socket says 172.21.15.44:39874) 2023-11-04T01:39:08.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.621+0000 7f499611f640 1 -- 172.21.15.44:0/2156790087 learned_addr learned my addr 172.21.15.44:0/2156790087 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:08.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.621+0000 7f4996920640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f499006a660 0x7f49900cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:55200/0 (socket says 172.21.15.44:55200) 2023-11-04T01:39:08.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.621+0000 7f499611f640 1 -- 172.21.15.44:0/2156790087 >> v2:172.21.15.204:3300/0 conn(0x7f49900ca0a0 msgr2=0x7f499006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:08.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.621+0000 7f499611f640 1 --2- 172.21.15.44:0/2156790087 >> v2:172.21.15.204:3300/0 conn(0x7f49900ca0a0 0x7f499006a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.621+0000 7f499611f640 1 -- 172.21.15.44:0/2156790087 >> v1:172.21.15.204:6789/0 conn(0x7f499006a660 legacy=0x7f49900cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.621+0000 7f499611f640 1 -- 172.21.15.44:0/2156790087 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49900c6900 con 0x7f499015e590 2023-11-04T01:39:08.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.621+0000 7f499591e640 1 --2- 172.21.15.44:0/2156790087 >> v2:172.21.15.204:3300/0 conn(0x7f49900ca0a0 0x7f499006a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:08.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.622+0000 7f499611f640 1 --2- 172.21.15.44:0/2156790087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499015e590 0x7f499006fcd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4988009870 tx=0x7f498802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65b5288a9a1e481b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.622+0000 7f499511d640 1 -- 172.21.15.44:0/2156790087 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988031640 con 0x7f499015e590 2023-11-04T01:39:08.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.622+0000 7f499511d640 1 -- 172.21.15.44:0/2156790087 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49880317a0 con 0x7f499015e590 2023-11-04T01:39:08.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.622+0000 7f499511d640 1 -- 172.21.15.44:0/2156790087 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988031b30 con 0x7f499015e590 2023-11-04T01:39:08.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.623+0000 7f4998383640 1 -- 172.21.15.44:0/2156790087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499015e590 msgr2=0x7f499006fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.623+0000 7f4998383640 1 --2- 172.21.15.44:0/2156790087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499015e590 0x7f499006fcd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4988009870 tx=0x7f498802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.623+0000 7f4998383640 1 -- 172.21.15.44:0/2156790087 shutdown_connections 2023-11-04T01:39:08.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.623+0000 7f4998383640 1 --2- 172.21.15.44:0/2156790087 >> v2:172.21.15.204:3300/0 conn(0x7f49900ca0a0 0x7f499006a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.623+0000 7f4998383640 1 --2- 172.21.15.44:0/2156790087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f499015e590 0x7f499006fcd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.623+0000 7f4998383640 1 -- 172.21.15.44:0/2156790087 >> 172.21.15.44:0/2156790087 conn(0x7f499006d820 msgr2=0x7f499006dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:08.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.623+0000 7f4998383640 1 -- 172.21.15.44:0/2156790087 shutdown_connections 2023-11-04T01:39:08.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.623+0000 7f4998383640 1 -- 172.21.15.44:0/2156790087 wait complete. 2023-11-04T01:39:08.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.624+0000 7f4998383640 1 Processor -- start 2023-11-04T01:39:08.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.624+0000 7f4998383640 1 -- start start 2023-11-04T01:39:08.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f4998383640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f499006a660 0x7f49901502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f4998383640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49900ca0a0 0x7f49900c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f4998383640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499015e590 0x7f49900c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f4998383640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49901562a0 con 0x7f499015e590 2023-11-04T01:39:08.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f4998383640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4990157000 con 0x7f499006a660 2023-11-04T01:39:08.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f4998383640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49901572e0 con 0x7f49900ca0a0 2023-11-04T01:39:08.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f4996920640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499015e590 0x7f49900c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f4996920640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499015e590 0x7f49900c55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55392/0 (socket says 172.21.15.44:55392) 2023-11-04T01:39:08.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f4996920640 1 -- 172.21.15.44:0/2230452811 learned_addr learned my addr 172.21.15.44:0/2230452811 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:08.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f499611f640 1 --2- 172.21.15.44:0/2230452811 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f499006a660 0x7f49901502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f499591e640 1 --2- 172.21.15.44:0/2230452811 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49900ca0a0 0x7f49900c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f4996920640 1 -- 172.21.15.44:0/2230452811 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49900ca0a0 msgr2=0x7f49900c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f4996920640 1 --2- 172.21.15.44:0/2230452811 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49900ca0a0 0x7f49900c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f4996920640 1 -- 172.21.15.44:0/2230452811 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f499006a660 msgr2=0x7f49901502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f4996920640 1 --2- 172.21.15.44:0/2230452811 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f499006a660 0x7f49901502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.625+0000 7f4996920640 1 -- 172.21.15.44:0/2230452811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4984009400 con 0x7f499015e590 2023-11-04T01:39:08.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.626+0000 7f4996920640 1 --2- 172.21.15.44:0/2230452811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499015e590 0x7f49900c55e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f498000c730 tx=0x7f498000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.626+0000 7f498effd640 1 -- 172.21.15.44:0/2230452811 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498000ce40 con 0x7f499015e590 2023-11-04T01:39:08.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.626+0000 7f498effd640 1 -- 172.21.15.44:0/2230452811 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498000a640 con 0x7f499015e590 2023-11-04T01:39:08.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.626+0000 7f4998383640 1 -- 172.21.15.44:0/2230452811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49880094d0 con 0x7f499015e590 2023-11-04T01:39:08.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.626+0000 7f498effd640 1 -- 172.21.15.44:0/2230452811 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498000a9f0 con 0x7f499015e590 2023-11-04T01:39:08.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.626+0000 7f4998383640 1 -- 172.21.15.44:0/2230452811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4990155f30 con 0x7f499015e590 2023-11-04T01:39:08.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.627+0000 7f4998383640 1 -- 172.21.15.44:0/2230452811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4990156410 con 0x7f499015e590 2023-11-04T01:39:08.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.627+0000 7f498effd640 1 -- 172.21.15.44:0/2230452811 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f498000ab50 con 0x7f499015e590 2023-11-04T01:39:08.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.628+0000 7f498effd640 1 --2- 172.21.15.44:0/2230452811 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f497c06ae70 0x7f497c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.628+0000 7f498effd640 1 -- 172.21.15.44:0/2230452811 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f4980089150 con 0x7f499015e590 2023-11-04T01:39:08.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.628+0000 7f499611f640 1 --2- 172.21.15.44:0/2230452811 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f497c06ae70 0x7f497c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.628+0000 7f499611f640 1 --2- 172.21.15.44:0/2230452811 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f497c06ae70 0x7f497c06d330 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4988036000 tx=0x7f498803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.632+0000 7f498effd640 1 -- 172.21.15.44:0/2230452811 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4980053dd0 con 0x7f499015e590 2023-11-04T01:39:08.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:08.843+0000 7f4998383640 1 -- 172.21.15.44:0/2230452811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f499004e490 con 0x7f499015e590 2023-11-04T01:39:09.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.449+0000 7f498effd640 1 -- 172.21.15.44:0/2230452811 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v39) v1 ==== 167+0+0 (secure 0 0 0) 0x7f49800573f0 con 0x7f499015e590 2023-11-04T01:39:09.451 INFO:teuthology.orchestra.run.smithi044.stderr:enabled new snapshots 2023-11-04T01:39:09.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.451+0000 7f4998383640 1 -- 172.21.15.44:0/2230452811 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f497c06ae70 msgr2=0x7f497c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.451+0000 7f4998383640 1 --2- 172.21.15.44:0/2230452811 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f497c06ae70 0x7f497c06d330 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4988036000 tx=0x7f498803c040 comp rx=0 tx=0).stop 2023-11-04T01:39:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.451+0000 7f4998383640 1 -- 172.21.15.44:0/2230452811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499015e590 msgr2=0x7f49900c55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.451+0000 7f4998383640 1 --2- 172.21.15.44:0/2230452811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499015e590 0x7f49900c55e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f498000c730 tx=0x7f498000cbf0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.451+0000 7f4998383640 1 -- 172.21.15.44:0/2230452811 shutdown_connections 2023-11-04T01:39:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.451+0000 7f4998383640 1 --2- 172.21.15.44:0/2230452811 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f497c06ae70 0x7f497c06d330 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.451+0000 7f4998383640 1 --2- 172.21.15.44:0/2230452811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499015e590 0x7f49900c55e0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.451+0000 7f4998383640 1 --2- 172.21.15.44:0/2230452811 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49900ca0a0 0x7f49900c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.451+0000 7f4998383640 1 --2- 172.21.15.44:0/2230452811 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f499006a660 0x7f49901502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.451+0000 7f4998383640 1 -- 172.21.15.44:0/2230452811 >> 172.21.15.44:0/2230452811 conn(0x7f499006d820 msgr2=0x7f49900cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.451+0000 7f4998383640 1 -- 172.21.15.44:0/2230452811 shutdown_connections 2023-11-04T01:39:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.451+0000 7f4998383640 1 -- 172.21.15.44:0/2230452811 wait complete. 2023-11-04T01:39:09.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:09.466 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-11-04T01:39:09.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:09.490 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps/.snap/snap00) 2023-11-04T01:39:09.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:09.556 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps) 2023-11-04T01:39:09.617 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:39:09.617 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:39:09.709 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:39:09.751 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:39:09.751 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:39:09.752 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:09.768 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:09.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.918+0000 7ffbf5be7640 1 Processor -- start 2023-11-04T01:39:09.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.918+0000 7ffbf5be7640 1 -- start start 2023-11-04T01:39:09.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.919+0000 7ffbf5be7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ffbf00b0ae0 0x7ffbf00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.919+0000 7ffbf5be7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbf006db20 0x7ffbf015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.919+0000 7ffbf5be7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbf00b4110 con 0x7ffbf0159c70 2023-11-04T01:39:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.919+0000 7ffbf5be7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbf00b49b0 con 0x7ffbf00b0ae0 2023-11-04T01:39:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.919+0000 7ffbf5be7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf00b43f0 con 0x7ffbf006db20 2023-11-04T01:39:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.919+0000 7ffbeffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbf006db20 0x7ffbf015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.919+0000 7ffbeeffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ffbf00b0ae0 0x7ffbf00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.919+0000 7ffbeffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbf006db20 0x7ffbf015d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:57736/0 (socket says 172.21.15.44:57736) 2023-11-04T01:39:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.919+0000 7ffbeffff640 1 -- 172.21.15.44:0/3980364387 learned_addr learned my addr 172.21.15.44:0/3980364387 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.920+0000 7ffbeffff640 1 -- 172.21.15.44:0/3980364387 >> v2:172.21.15.204:3300/0 conn(0x7ffbf00b0ae0 msgr2=0x7ffbf00ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:09.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.920+0000 7ffbeffff640 1 --2- 172.21.15.44:0/3980364387 >> v2:172.21.15.204:3300/0 conn(0x7ffbf00b0ae0 0x7ffbf00ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.920+0000 7ffbeffff640 1 -- 172.21.15.44:0/3980364387 >> v1:172.21.15.204:6789/0 conn(0x7ffbf0159c70 legacy=0x7ffbf00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.920+0000 7ffbeffff640 1 -- 172.21.15.44:0/3980364387 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbf00b46d0 con 0x7ffbf006db20 2023-11-04T01:39:09.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.920+0000 7ffbeeffd640 1 --2- 172.21.15.44:0/3980364387 >> v2:172.21.15.204:3300/0 conn(0x7ffbf00b0ae0 0x7ffbf00ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:09.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.920+0000 7ffbeffff640 1 --2- 172.21.15.44:0/3980364387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbf006db20 0x7ffbf015d7d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffbe8009e50 tx=0x7ffbe802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5796d55180c3be80 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.921+0000 7ffbee7fc640 1 -- 172.21.15.44:0/3980364387 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe802cb00 con 0x7ffbf006db20 2023-11-04T01:39:09.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.921+0000 7ffbee7fc640 1 -- 172.21.15.44:0/3980364387 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe802cc60 con 0x7ffbf006db20 2023-11-04T01:39:09.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.921+0000 7ffbee7fc640 1 -- 172.21.15.44:0/3980364387 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe80343f0 con 0x7ffbf006db20 2023-11-04T01:39:09.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.921+0000 7ffbf5be7640 1 -- 172.21.15.44:0/3980364387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbf006db20 msgr2=0x7ffbf015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.921+0000 7ffbf5be7640 1 --2- 172.21.15.44:0/3980364387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbf006db20 0x7ffbf015d7d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffbe8009e50 tx=0x7ffbe802bf60 comp rx=0 tx=0).stop 2023-11-04T01:39:09.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.921+0000 7ffbf5be7640 1 -- 172.21.15.44:0/3980364387 shutdown_connections 2023-11-04T01:39:09.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.921+0000 7ffbf5be7640 1 --2- 172.21.15.44:0/3980364387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbf006db20 0x7ffbf015d7d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.921+0000 7ffbf5be7640 1 --2- 172.21.15.44:0/3980364387 >> v2:172.21.15.204:3300/0 conn(0x7ffbf00b0ae0 0x7ffbf00ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.921+0000 7ffbf5be7640 1 -- 172.21.15.44:0/3980364387 >> 172.21.15.44:0/3980364387 conn(0x7ffbf00ce950 msgr2=0x7ffbf00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:09.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.921+0000 7ffbf5be7640 1 -- 172.21.15.44:0/3980364387 shutdown_connections 2023-11-04T01:39:09.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.921+0000 7ffbf5be7640 1 -- 172.21.15.44:0/3980364387 wait complete. 2023-11-04T01:39:09.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.923+0000 7ffbf5be7640 1 Processor -- start 2023-11-04T01:39:09.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.923+0000 7ffbf5be7640 1 -- start start 2023-11-04T01:39:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.923+0000 7ffbf5be7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf006db20 0x7ffbf01f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbf5be7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbf00b0ae0 0x7ffbf00a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbf5be7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbf0159c70 0x7ffbf00a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbf5be7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf01f4a90 con 0x7ffbf006db20 2023-11-04T01:39:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbf5be7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf00a7970 con 0x7ffbf0159c70 2023-11-04T01:39:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbf5be7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf00a7c50 con 0x7ffbf00b0ae0 2023-11-04T01:39:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbef7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf006db20 0x7ffbf01f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbef7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf006db20 0x7ffbf01f4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55394/0 (socket says 172.21.15.44:55394) 2023-11-04T01:39:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbef7fe640 1 -- 172.21.15.44:0/1063719078 learned_addr learned my addr 172.21.15.44:0/1063719078 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbeeffd640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbf00b0ae0 0x7ffbf00a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbeffff640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbf0159c70 0x7ffbf00a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbef7fe640 1 -- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbf00b0ae0 msgr2=0x7ffbf00a8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbef7fe640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbf00b0ae0 0x7ffbf00a8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbef7fe640 1 -- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbf0159c70 msgr2=0x7ffbf00a90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbef7fe640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbf0159c70 0x7ffbf00a90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbef7fe640 1 -- 172.21.15.44:0/1063719078 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe4009400 con 0x7ffbf006db20 2023-11-04T01:39:09.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbeeffd640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbf00b0ae0 0x7ffbf00a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:09.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbeffff640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbf0159c70 0x7ffbf00a90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:09.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbef7fe640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf006db20 0x7ffbf01f4550 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7ffbe000c400 tx=0x7ffbe000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbd7fff640 1 -- 172.21.15.44:0/1063719078 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe00052d0 con 0x7ffbf006db20 2023-11-04T01:39:09.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbd7fff640 1 -- 172.21.15.44:0/1063719078 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe0005430 con 0x7ffbf006db20 2023-11-04T01:39:09.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbf5be7640 1 -- 172.21.15.44:0/1063719078 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe8009b30 con 0x7ffbf006db20 2023-11-04T01:39:09.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbd7fff640 1 -- 172.21.15.44:0/1063719078 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0003830 con 0x7ffbf006db20 2023-11-04T01:39:09.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.924+0000 7ffbf5be7640 1 -- 172.21.15.44:0/1063719078 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbf00a8210 con 0x7ffbf006db20 2023-11-04T01:39:09.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.925+0000 7ffbf5be7640 1 -- 172.21.15.44:0/1063719078 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbf0074290 con 0x7ffbf006db20 2023-11-04T01:39:09.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.926+0000 7ffbd7fff640 1 -- 172.21.15.44:0/1063719078 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffbe0003990 con 0x7ffbf006db20 2023-11-04T01:39:09.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.926+0000 7ffbd7fff640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffbdc06ae70 0x7ffbdc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.927+0000 7ffbd7fff640 1 -- 172.21.15.44:0/1063719078 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7ffbe0089190 con 0x7ffbf006db20 2023-11-04T01:39:09.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.927+0000 7ffbeeffd640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffbdc06ae70 0x7ffbdc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.927+0000 7ffbeeffd640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffbdc06ae70 0x7ffbdc06d330 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ffbf006c9c0 tx=0x7ffbe4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:09.931+0000 7ffbd7fff640 1 -- 172.21.15.44:0/1063719078 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffbe0053c40 con 0x7ffbf006db20 2023-11-04T01:39:10.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.110+0000 7ffbf5be7640 1 -- 172.21.15.44:0/1063719078 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffbf006d3f0 con 0x7ffbf006db20 2023-11-04T01:39:10.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.112+0000 7ffbd7fff640 1 -- 172.21.15.44:0/1063719078 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+21953 (secure 0 0 0) 0x7ffbe0074e60 con 0x7ffbf006db20 2023-11-04T01:39:10.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:10.114 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":84,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:39:01.413720+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:57.815488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:58.748063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:10.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.114+0000 7ffbf5be7640 1 -- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffbdc06ae70 msgr2=0x7ffbdc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.114+0000 7ffbf5be7640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffbdc06ae70 0x7ffbdc06d330 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ffbf006c9c0 tx=0x7ffbe4008040 comp rx=0 tx=0).stop 2023-11-04T01:39:10.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.114+0000 7ffbf5be7640 1 -- 172.21.15.44:0/1063719078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf006db20 msgr2=0x7ffbf01f4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.114+0000 7ffbf5be7640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf006db20 0x7ffbf01f4550 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7ffbe000c400 tx=0x7ffbe000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.114+0000 7ffbf5be7640 1 -- 172.21.15.44:0/1063719078 shutdown_connections 2023-11-04T01:39:10.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.114+0000 7ffbf5be7640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffbdc06ae70 0x7ffbdc06d330 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.114+0000 7ffbf5be7640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbf0159c70 0x7ffbf00a90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.114+0000 7ffbf5be7640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbf00b0ae0 0x7ffbf00a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.114+0000 7ffbf5be7640 1 --2- 172.21.15.44:0/1063719078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf006db20 0x7ffbf01f4550 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.114+0000 7ffbf5be7640 1 -- 172.21.15.44:0/1063719078 >> 172.21.15.44:0/1063719078 conn(0x7ffbf00ce950 msgr2=0x7ffbf00cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:10.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.114+0000 7ffbf5be7640 1 -- 172.21.15.44:0/1063719078 shutdown_connections 2023-11-04T01:39:10.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.114+0000 7ffbf5be7640 1 -- 172.21.15.44:0/1063719078 wait complete. 2023-11-04T01:39:10.128 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:34.917670+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:35.547044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:38:57.815488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:38:58.748063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:10.128 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:10.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.236+0000 7f3bed19e640 1 Processor -- start 2023-11-04T01:39:10.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.236+0000 7f3bed19e640 1 -- start start 2023-11-04T01:39:10.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.237+0000 7f3bed19e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3be815ce60 0x7f3be80b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.237+0000 7f3bed19e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be80cdc20 con 0x7f3be80cfbf0 2023-11-04T01:39:10.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.237+0000 7f3bed19e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be80cdf00 con 0x7f3be8161540 2023-11-04T01:39:10.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.237+0000 7f3bed19e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be80ce4c0 con 0x7f3be815ce60 2023-11-04T01:39:10.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.237+0000 7f3bec99d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3be80cfbf0 0x7f3be80d14c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59768/0 (socket says 172.21.15.44:59768) 2023-11-04T01:39:10.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.237+0000 7f3bec99d640 1 -- 172.21.15.44:0/589599961 learned_addr learned my addr 172.21.15.44:0/589599961 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:10.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.237+0000 7f3be6ffd640 1 -- 172.21.15.44:0/589599961 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869240845 0 0) 0x7f3be80cdc20 con 0x7f3be80cfbf0 2023-11-04T01:39:10.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.237+0000 7f3be6ffd640 1 -- 172.21.15.44:0/589599961 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bd0003520 con 0x7f3be80cfbf0 2023-11-04T01:39:10.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.237+0000 7f3be7fff640 1 --2- 172.21.15.44:0/589599961 >> v2:172.21.15.204:3300/0 conn(0x7f3be815ce60 0x7f3be80b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be6ffd640 1 -- 172.21.15.44:0/589599961 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1059995874 0 0) 0x7f3bd0003520 con 0x7f3be80cfbf0 2023-11-04T01:39:10.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be6ffd640 1 -- 172.21.15.44:0/589599961 >> v2:172.21.15.204:3300/0 conn(0x7f3be815ce60 msgr2=0x7f3be80b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:10.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be6ffd640 1 --2- 172.21.15.44:0/589599961 >> v2:172.21.15.204:3300/0 conn(0x7f3be815ce60 0x7f3be80b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be6ffd640 1 -- 172.21.15.44:0/589599961 >> v1:172.21.15.204:6789/0 conn(0x7f3be8161540 legacy=0x7f3be80cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:10.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be6ffd640 1 -- 172.21.15.44:0/589599961 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be80ce1e0 con 0x7f3be80cfbf0 2023-11-04T01:39:10.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be6ffd640 1 -- 172.21.15.44:0/589599961 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f3be00019f0 con 0x7f3be80cfbf0 2023-11-04T01:39:10.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be6ffd640 1 -- 172.21.15.44:0/589599961 >> v1:172.21.15.44:6789/0 conn(0x7f3be80cfbf0 legacy=0x7f3be80d14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be6ffd640 1 --2- 172.21.15.44:0/589599961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bd0003970 0x7f3bd0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be6ffd640 1 --2- 172.21.15.44:0/589599961 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3bd00047c0 0x7f3bd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be6ffd640 1 --2- 172.21.15.44:0/589599961 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3bd0005180 0x7f3bd000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be6ffd640 1 -- 172.21.15.44:0/589599961 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd000c080 con 0x7f3bd0003970 2023-11-04T01:39:10.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be6ffd640 1 -- 172.21.15.44:0/589599961 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd000c1f0 con 0x7f3bd0005180 2023-11-04T01:39:10.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be6ffd640 1 -- 172.21.15.44:0/589599961 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd000c3b0 con 0x7f3bd00047c0 2023-11-04T01:39:10.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be7fff640 1 --2- 172.21.15.44:0/589599961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bd0003970 0x7f3bd0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3bec99d640 1 --2- 172.21.15.44:0/589599961 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3bd0005180 0x7f3bd000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be77fe640 1 --2- 172.21.15.44:0/589599961 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3bd00047c0 0x7f3bd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be7fff640 1 -- 172.21.15.44:0/589599961 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3bd00047c0 msgr2=0x7f3bd0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:10.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be7fff640 1 --2- 172.21.15.44:0/589599961 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3bd00047c0 0x7f3bd0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be7fff640 1 -- 172.21.15.44:0/589599961 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3bd0005180 msgr2=0x7f3bd000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:10.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be7fff640 1 --2- 172.21.15.44:0/589599961 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3bd0005180 0x7f3bd000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be7fff640 1 -- 172.21.15.44:0/589599961 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd0003520 con 0x7f3bd0003970 2023-11-04T01:39:10.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3bec99d640 1 -- 172.21.15.44:0/589599961 reap_dead start 2023-11-04T01:39:10.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.238+0000 7f3be77fe640 1 --2- 172.21.15.44:0/589599961 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3bd00047c0 0x7f3bd0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:10.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.239+0000 7f3be7fff640 1 --2- 172.21.15.44:0/589599961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bd0003970 0x7f3bd0003d70 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00ba00 tx=0x7f3bd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7af6d35dd9afd37 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.239+0000 7f3be6ffd640 1 -- 172.21.15.44:0/589599961 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc032620 con 0x7f3bd0003970 2023-11-04T01:39:10.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.239+0000 7f3be6ffd640 1 -- 172.21.15.44:0/589599961 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc032780 con 0x7f3bd0003970 2023-11-04T01:39:10.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.239+0000 7f3be6ffd640 1 -- 172.21.15.44:0/589599961 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc032b10 con 0x7f3bd0003970 2023-11-04T01:39:10.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.239+0000 7f3bed19e640 1 -- 172.21.15.44:0/589599961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bd0003970 msgr2=0x7f3bd0003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.239+0000 7f3bed19e640 1 --2- 172.21.15.44:0/589599961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bd0003970 0x7f3bd0003d70 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00ba00 tx=0x7f3bd00057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.240+0000 7f3bed19e640 1 -- 172.21.15.44:0/589599961 shutdown_connections 2023-11-04T01:39:10.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.240+0000 7f3bed19e640 1 --2- 172.21.15.44:0/589599961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bd0003970 0x7f3bd0003d70 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.240+0000 7f3bed19e640 1 -- 172.21.15.44:0/589599961 >> 172.21.15.44:0/589599961 conn(0x7f3be806b4c0 msgr2=0x7f3be806b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:10.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.240+0000 7f3bed19e640 1 -- 172.21.15.44:0/589599961 shutdown_connections 2023-11-04T01:39:10.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.240+0000 7f3bed19e640 1 -- 172.21.15.44:0/589599961 wait complete. 2023-11-04T01:39:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.241+0000 7f3bed19e640 1 Processor -- start 2023-11-04T01:39:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.241+0000 7f3bed19e640 1 -- start start 2023-11-04T01:39:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3bed19e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bd0003970 0x7f3be815ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3bed19e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3be8154020 0x7f3be81544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3bed19e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3be81f2970 0x7f3be81f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3bed19e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be81e71a0 con 0x7f3bd0003970 2023-11-04T01:39:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3bed19e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be81f3700 con 0x7f3be8154020 2023-11-04T01:39:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3bed19e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be81549e0 con 0x7f3be81f2970 2023-11-04T01:39:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3be7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bd0003970 0x7f3be815ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3be7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bd0003970 0x7f3be815ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55414/0 (socket says 172.21.15.44:55414) 2023-11-04T01:39:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3be7fff640 1 -- 172.21.15.44:0/2594904940 learned_addr learned my addr 172.21.15.44:0/2594904940 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3bec99d640 1 --2- 172.21.15.44:0/2594904940 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3be81f2970 0x7f3be81f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3be7fff640 1 -- 172.21.15.44:0/2594904940 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3be81f2970 msgr2=0x7f3be81f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3be7fff640 1 --2- 172.21.15.44:0/2594904940 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3be81f2970 0x7f3be81f2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3be77fe640 1 --2- 172.21.15.44:0/2594904940 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3be8154020 0x7f3be81544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3be7fff640 1 -- 172.21.15.44:0/2594904940 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3be8154020 msgr2=0x7f3be81544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3be7fff640 1 --2- 172.21.15.44:0/2594904940 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3be8154020 0x7f3be81544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3be7fff640 1 -- 172.21.15.44:0/2594904940 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be81e6870 con 0x7f3bd0003970 2023-11-04T01:39:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.242+0000 7f3bec99d640 1 --2- 172.21.15.44:0/2594904940 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3be81f2970 0x7f3be81f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.243+0000 7f3be7fff640 1 --2- 172.21.15.44:0/2594904940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bd0003970 0x7f3be815ac60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00bb20 tx=0x7f3bdc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.243+0000 7f3be4ff9640 1 -- 172.21.15.44:0/2594904940 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc03b420 con 0x7f3bd0003970 2023-11-04T01:39:10.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.243+0000 7f3be4ff9640 1 -- 172.21.15.44:0/2594904940 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc03b580 con 0x7f3bd0003970 2023-11-04T01:39:10.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.243+0000 7f3be4ff9640 1 -- 172.21.15.44:0/2594904940 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc03b930 con 0x7f3bd0003970 2023-11-04T01:39:10.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.243+0000 7f3bed19e640 1 -- 172.21.15.44:0/2594904940 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be81e6b50 con 0x7f3bd0003970 2023-11-04T01:39:10.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.243+0000 7f3bed19e640 1 -- 172.21.15.44:0/2594904940 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be81f3310 con 0x7f3bd0003970 2023-11-04T01:39:10.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.244+0000 7f3bed19e640 1 -- 172.21.15.44:0/2594904940 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be804ece0 con 0x7f3bd0003970 2023-11-04T01:39:10.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.244+0000 7f3be4ff9640 1 -- 172.21.15.44:0/2594904940 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3bdc03ba90 con 0x7f3bd0003970 2023-11-04T01:39:10.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.245+0000 7f3be4ff9640 1 --2- 172.21.15.44:0/2594904940 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3bd406aea0 0x7f3bd406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.245+0000 7f3be4ff9640 1 -- 172.21.15.44:0/2594904940 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f3bdc0ab790 con 0x7f3bd0003970 2023-11-04T01:39:10.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.245+0000 7f3be77fe640 1 --2- 172.21.15.44:0/2594904940 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3bd406aea0 0x7f3bd406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.245+0000 7f3be77fe640 1 --2- 172.21.15.44:0/2594904940 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3bd406aea0 0x7f3bd406d360 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3be80b19d0 tx=0x7f3bd8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.249+0000 7f3be4ff9640 1 -- 172.21.15.44:0/2594904940 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3bdc0762d0 con 0x7f3bd0003970 2023-11-04T01:39:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.424+0000 7f3bed19e640 1 -- 172.21.15.44:0/2594904940 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3be80cda00 con 0x7f3bd0003970 2023-11-04T01:39:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.424+0000 7f3be4ff9640 1 -- 172.21.15.44:0/2594904940 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3bdc03bd40 con 0x7f3bd0003970 2023-11-04T01:39:10.426 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:39:10.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.426+0000 7f3bed19e640 1 -- 172.21.15.44:0/2594904940 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3bd406aea0 msgr2=0x7f3bd406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.426+0000 7f3bed19e640 1 --2- 172.21.15.44:0/2594904940 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3bd406aea0 0x7f3bd406d360 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3be80b19d0 tx=0x7f3bd8009040 comp rx=0 tx=0).stop 2023-11-04T01:39:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.426+0000 7f3bed19e640 1 -- 172.21.15.44:0/2594904940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bd0003970 msgr2=0x7f3be815ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.426+0000 7f3bed19e640 1 --2- 172.21.15.44:0/2594904940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bd0003970 0x7f3be815ac60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00bb20 tx=0x7f3bdc004730 comp rx=0 tx=0).stop 2023-11-04T01:39:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.426+0000 7f3bed19e640 1 -- 172.21.15.44:0/2594904940 shutdown_connections 2023-11-04T01:39:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.426+0000 7f3bed19e640 1 --2- 172.21.15.44:0/2594904940 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3bd406aea0 0x7f3bd406d360 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.426+0000 7f3bed19e640 1 --2- 172.21.15.44:0/2594904940 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3be81f2970 0x7f3be81f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.426+0000 7f3bed19e640 1 --2- 172.21.15.44:0/2594904940 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3be8154020 0x7f3be81544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.426+0000 7f3bed19e640 1 --2- 172.21.15.44:0/2594904940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bd0003970 0x7f3be815ac60 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.426+0000 7f3bed19e640 1 -- 172.21.15.44:0/2594904940 >> 172.21.15.44:0/2594904940 conn(0x7f3be806b4c0 msgr2=0x7f3be80b75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.426+0000 7f3bed19e640 1 -- 172.21.15.44:0/2594904940 shutdown_connections 2023-11-04T01:39:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.426+0000 7f3bed19e640 1 -- 172.21.15.44:0/2594904940 wait complete. 2023-11-04T01:39:10.439 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:39:10.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.545+0000 7fb5c5e83640 1 Processor -- start 2023-11-04T01:39:10.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.545+0000 7fb5c5e83640 1 -- start start 2023-11-04T01:39:10.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.546+0000 7fb5c5e83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5c0159c00 0x7fb5c00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.546+0000 7fb5c5e83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb5c00c48e0 0x7fb5c00c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.546+0000 7fb5c5e83640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c015aff0 con 0x7fb5c00adac0 2023-11-04T01:39:10.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.546+0000 7fb5c5e83640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c00c52a0 con 0x7fb5c00c48e0 2023-11-04T01:39:10.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.546+0000 7fb5c5e83640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c015a3e0 con 0x7fb5c0159c00 2023-11-04T01:39:10.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.546+0000 7fb5beffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb5c00c48e0 0x7fb5c00c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.546+0000 7fb5bffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb5c00adac0 0x7fb5c00adef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59778/0 (socket says 172.21.15.44:59778) 2023-11-04T01:39:10.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.546+0000 7fb5bffff640 1 -- 172.21.15.44:0/2876641579 learned_addr learned my addr 172.21.15.44:0/2876641579 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:10.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.547+0000 7fb5beffd640 1 -- 172.21.15.44:0/2876641579 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5c0159c00 msgr2=0x7fb5c00cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:10.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.547+0000 7fb5bf7fe640 1 --2- 172.21.15.44:0/2876641579 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5c0159c00 0x7fb5c00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.547+0000 7fb5beffd640 1 --2- 172.21.15.44:0/2876641579 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5c0159c00 0x7fb5c00cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.547+0000 7fb5beffd640 1 -- 172.21.15.44:0/2876641579 >> v1:172.21.15.44:6789/0 conn(0x7fb5c00adac0 legacy=0x7fb5c00adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.547+0000 7fb5be7fc640 1 -- 172.21.15.44:0/2876641579 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121893508 0 0) 0x7fb5c015aff0 con 0x7fb5c00adac0 2023-11-04T01:39:10.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.547+0000 7fb5beffd640 1 -- 172.21.15.44:0/2876641579 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c015a6c0 con 0x7fb5c00c48e0 2023-11-04T01:39:10.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.547+0000 7fb5bf7fe640 1 --2- 172.21.15.44:0/2876641579 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5c0159c00 0x7fb5c00cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:10.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.547+0000 7fb5beffd640 1 --2- 172.21.15.44:0/2876641579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5c00c48e0 0x7fb5c00c4d60 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40097a0 tx=0x7fb5b402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c8e127ad4ba642 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.548+0000 7fb5be7fc640 1 -- 172.21.15.44:0/2876641579 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b402d040 con 0x7fb5c00c48e0 2023-11-04T01:39:10.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.548+0000 7fb5be7fc640 1 -- 172.21.15.44:0/2876641579 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b4031810 con 0x7fb5c00c48e0 2023-11-04T01:39:10.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.548+0000 7fb5be7fc640 1 -- 172.21.15.44:0/2876641579 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4031ba0 con 0x7fb5c00c48e0 2023-11-04T01:39:10.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.548+0000 7fb5c5e83640 1 -- 172.21.15.44:0/2876641579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5c00c48e0 msgr2=0x7fb5c00c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.548+0000 7fb5c5e83640 1 --2- 172.21.15.44:0/2876641579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5c00c48e0 0x7fb5c00c4d60 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40097a0 tx=0x7fb5b402b8b0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.548+0000 7fb5c5e83640 1 -- 172.21.15.44:0/2876641579 shutdown_connections 2023-11-04T01:39:10.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.548+0000 7fb5c5e83640 1 --2- 172.21.15.44:0/2876641579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5c00c48e0 0x7fb5c00c4d60 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.548+0000 7fb5c5e83640 1 --2- 172.21.15.44:0/2876641579 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5c0159c00 0x7fb5c00cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.548+0000 7fb5c5e83640 1 -- 172.21.15.44:0/2876641579 >> 172.21.15.44:0/2876641579 conn(0x7fb5c00ce950 msgr2=0x7fb5c00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:10.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.548+0000 7fb5c5e83640 1 -- 172.21.15.44:0/2876641579 shutdown_connections 2023-11-04T01:39:10.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.548+0000 7fb5c5e83640 1 -- 172.21.15.44:0/2876641579 wait complete. 2023-11-04T01:39:10.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.549+0000 7fb5c5e83640 1 Processor -- start 2023-11-04T01:39:10.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.550+0000 7fb5c5e83640 1 -- start start 2023-11-04T01:39:10.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.550+0000 7fb5c5e83640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5c00adac0 0x7fb5c0140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.550+0000 7fb5c5e83640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5c00c48e0 0x7fb5c0147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.550+0000 7fb5c5e83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5c0159c00 0x7fb5c00c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.550+0000 7fb5c5e83640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c01493d0 con 0x7fb5c00c48e0 2023-11-04T01:39:10.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.550+0000 7fb5c5e83640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0148330 con 0x7fb5c00adac0 2023-11-04T01:39:10.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.550+0000 7fb5c5e83640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0148610 con 0x7fb5c0159c00 2023-11-04T01:39:10.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.550+0000 7fb5beffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5c00c48e0 0x7fb5c0147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.550+0000 7fb5beffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5c00c48e0 0x7fb5c0147a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55422/0 (socket says 172.21.15.44:55422) 2023-11-04T01:39:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.550+0000 7fb5beffd640 1 -- 172.21.15.44:0/2876424817 learned_addr learned my addr 172.21.15.44:0/2876424817 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.551+0000 7fb5bffff640 1 --2- 172.21.15.44:0/2876424817 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5c0159c00 0x7fb5c00c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.551+0000 7fb5bf7fe640 1 --2- 172.21.15.44:0/2876424817 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5c00adac0 0x7fb5c0140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.551+0000 7fb5beffd640 1 -- 172.21.15.44:0/2876424817 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5c0159c00 msgr2=0x7fb5c00c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.551+0000 7fb5beffd640 1 --2- 172.21.15.44:0/2876424817 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5c0159c00 0x7fb5c00c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.551+0000 7fb5beffd640 1 -- 172.21.15.44:0/2876424817 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5c00adac0 msgr2=0x7fb5c0140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.551+0000 7fb5beffd640 1 --2- 172.21.15.44:0/2876424817 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5c00adac0 0x7fb5c0140870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.551+0000 7fb5beffd640 1 -- 172.21.15.44:0/2876424817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b4009400 con 0x7fb5c00c48e0 2023-11-04T01:39:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.551+0000 7fb5bffff640 1 --2- 172.21.15.44:0/2876424817 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5c0159c00 0x7fb5c00c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.551+0000 7fb5beffd640 1 --2- 172.21.15.44:0/2876424817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5c00c48e0 0x7fb5c0147a00 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40098c0 tx=0x7fb5b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.551+0000 7fb5a7fff640 1 -- 172.21.15.44:0/2876424817 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b403ad60 con 0x7fb5c00c48e0 2023-11-04T01:39:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.551+0000 7fb5a7fff640 1 -- 172.21.15.44:0/2876424817 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b4044400 con 0x7fb5c00c48e0 2023-11-04T01:39:10.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.551+0000 7fb5a7fff640 1 -- 172.21.15.44:0/2876424817 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b40447b0 con 0x7fb5c00c48e0 2023-11-04T01:39:10.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.551+0000 7fb5c5e83640 1 -- 172.21.15.44:0/2876424817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c01488f0 con 0x7fb5c00c48e0 2023-11-04T01:39:10.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.551+0000 7fb5c5e83640 1 -- 172.21.15.44:0/2876424817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c0148eb0 con 0x7fb5c00c48e0 2023-11-04T01:39:10.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.552+0000 7fb5c5e83640 1 -- 172.21.15.44:0/2876424817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c0074290 con 0x7fb5c00c48e0 2023-11-04T01:39:10.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.553+0000 7fb5a7fff640 1 -- 172.21.15.44:0/2876424817 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb5b404d440 con 0x7fb5c00c48e0 2023-11-04T01:39:10.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.553+0000 7fb5a7fff640 1 --2- 172.21.15.44:0/2876424817 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb5ac06ae70 0x7fb5ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.553+0000 7fb5a7fff640 1 -- 172.21.15.44:0/2876424817 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fb5b40ac030 con 0x7fb5c00c48e0 2023-11-04T01:39:10.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.553+0000 7fb5bf7fe640 1 --2- 172.21.15.44:0/2876424817 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb5ac06ae70 0x7fb5ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.554+0000 7fb5bf7fe640 1 --2- 172.21.15.44:0/2876424817 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb5ac06ae70 0x7fb5ac06d330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0008850 tx=0x7fb5b0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.557+0000 7fb5a7fff640 1 -- 172.21.15.44:0/2876424817 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb5b4076b70 con 0x7fb5c00c48e0 2023-11-04T01:39:10.734 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.732+0000 7fb5c5e83640 1 -- 172.21.15.44:0/2876424817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fb5c015d3a0 con 0x7fb5c00c48e0 2023-11-04T01:39:10.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.733+0000 7fb5a7fff640 1 -- 172.21.15.44:0/2876424817 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v84) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb5b407a190 con 0x7fb5c00c48e0 2023-11-04T01:39:10.735 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:39:10.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.734+0000 7fb5c5e83640 1 -- 172.21.15.44:0/2876424817 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb5ac06ae70 msgr2=0x7fb5ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.734+0000 7fb5c5e83640 1 --2- 172.21.15.44:0/2876424817 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb5ac06ae70 0x7fb5ac06d330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0008850 tx=0x7fb5b0008040 comp rx=0 tx=0).stop 2023-11-04T01:39:10.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.734+0000 7fb5c5e83640 1 -- 172.21.15.44:0/2876424817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5c00c48e0 msgr2=0x7fb5c0147a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.734+0000 7fb5c5e83640 1 --2- 172.21.15.44:0/2876424817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5c00c48e0 0x7fb5c0147a00 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40098c0 tx=0x7fb5b40046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.735+0000 7fb5c5e83640 1 -- 172.21.15.44:0/2876424817 shutdown_connections 2023-11-04T01:39:10.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.735+0000 7fb5c5e83640 1 --2- 172.21.15.44:0/2876424817 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb5ac06ae70 0x7fb5ac06d330 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.735+0000 7fb5c5e83640 1 --2- 172.21.15.44:0/2876424817 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5c0159c00 0x7fb5c00c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.735+0000 7fb5c5e83640 1 --2- 172.21.15.44:0/2876424817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5c00c48e0 0x7fb5c0147a00 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.735+0000 7fb5c5e83640 1 --2- 172.21.15.44:0/2876424817 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5c00adac0 0x7fb5c0140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.735+0000 7fb5c5e83640 1 -- 172.21.15.44:0/2876424817 >> 172.21.15.44:0/2876424817 conn(0x7fb5c00ce950 msgr2=0x7fb5c014f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:10.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.735+0000 7fb5c5e83640 1 -- 172.21.15.44:0/2876424817 shutdown_connections 2023-11-04T01:39:10.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.735+0000 7fb5c5e83640 1 -- 172.21.15.44:0/2876424817 wait complete. 2023-11-04T01:39:10.747 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:39:10.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.854+0000 7fb865fa9640 1 Processor -- start 2023-11-04T01:39:10.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.854+0000 7fb865fa9640 1 -- start start 2023-11-04T01:39:10.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.854+0000 7fb865fa9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb860160430 0x7fb8600b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.855+0000 7fb865fa9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8600b2b60 0x7fb86006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.855+0000 7fb865fa9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8600b2fc0 con 0x7fb86006c1d0 2023-11-04T01:39:10.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.855+0000 7fb865fa9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8600cb580 con 0x7fb860160430 2023-11-04T01:39:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.855+0000 7fb865fa9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86006ca40 con 0x7fb8600b2b60 2023-11-04T01:39:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.855+0000 7fb85ffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb86006c1d0 0x7fb860160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59794/0 (socket says 172.21.15.44:59794) 2023-11-04T01:39:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.855+0000 7fb85f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb860160430 0x7fb8600b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.855+0000 7fb85ffff640 1 -- 172.21.15.44:0/3722383543 learned_addr learned my addr 172.21.15.44:0/3722383543 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.855+0000 7fb85effd640 1 --2- 172.21.15.44:0/3722383543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8600b2b60 0x7fb86006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.855+0000 7fb85f7fe640 1 -- 172.21.15.44:0/3722383543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8600b2b60 msgr2=0x7fb86006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.855+0000 7fb85f7fe640 1 --2- 172.21.15.44:0/3722383543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8600b2b60 0x7fb86006bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.855+0000 7fb85f7fe640 1 -- 172.21.15.44:0/3722383543 >> v1:172.21.15.44:6789/0 conn(0x7fb86006c1d0 legacy=0x7fb860160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.855+0000 7fb85f7fe640 1 -- 172.21.15.44:0/3722383543 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86006cd20 con 0x7fb860160430 2023-11-04T01:39:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.855+0000 7fb85e7fc640 1 -- 172.21.15.44:0/3722383543 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730740689 0 0) 0x7fb8600b2fc0 con 0x7fb86006c1d0 2023-11-04T01:39:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.855+0000 7fb85effd640 1 --2- 172.21.15.44:0/3722383543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8600b2b60 0x7fb86006bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:10.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.856+0000 7fb85f7fe640 1 --2- 172.21.15.44:0/3722383543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860160430 0x7fb8600b2620 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fb8540097a0 tx=0x7fb85402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1dbfa519aeeb16 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.856+0000 7fb85e7fc640 1 -- 172.21.15.44:0/3722383543 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854031830 con 0x7fb860160430 2023-11-04T01:39:10.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.856+0000 7fb85e7fc640 1 -- 172.21.15.44:0/3722383543 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb854031990 con 0x7fb860160430 2023-11-04T01:39:10.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.856+0000 7fb85e7fc640 1 -- 172.21.15.44:0/3722383543 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854031d20 con 0x7fb860160430 2023-11-04T01:39:10.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.856+0000 7fb865fa9640 1 -- 172.21.15.44:0/3722383543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860160430 msgr2=0x7fb8600b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.856+0000 7fb865fa9640 1 --2- 172.21.15.44:0/3722383543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860160430 0x7fb8600b2620 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fb8540097a0 tx=0x7fb85402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.856+0000 7fb865fa9640 1 -- 172.21.15.44:0/3722383543 shutdown_connections 2023-11-04T01:39:10.860 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.856+0000 7fb865fa9640 1 --2- 172.21.15.44:0/3722383543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8600b2b60 0x7fb86006bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.856+0000 7fb865fa9640 1 --2- 172.21.15.44:0/3722383543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860160430 0x7fb8600b2620 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.856+0000 7fb865fa9640 1 -- 172.21.15.44:0/3722383543 >> 172.21.15.44:0/3722383543 conn(0x7fb86006ea20 msgr2=0x7fb86006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:10.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.857+0000 7fb865fa9640 1 -- 172.21.15.44:0/3722383543 shutdown_connections 2023-11-04T01:39:10.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.857+0000 7fb865fa9640 1 -- 172.21.15.44:0/3722383543 wait complete. 2023-11-04T01:39:10.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.858+0000 7fb865fa9640 1 Processor -- start 2023-11-04T01:39:10.861 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.858+0000 7fb865fa9640 1 -- start start 2023-11-04T01:39:10.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb865fa9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb86006c1d0 0x7fb8600c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb865fa9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8600b2b60 0x7fb8600b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb865fa9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860160430 0x7fb8600b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb865fa9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600b4a60 con 0x7fb860160430 2023-11-04T01:39:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb865fa9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600b3e50 con 0x7fb86006c1d0 2023-11-04T01:39:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb865fa9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600b4130 con 0x7fb8600b2b60 2023-11-04T01:39:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb85ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860160430 0x7fb8600b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb85ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860160430 0x7fb8600b5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55448/0 (socket says 172.21.15.44:55448) 2023-11-04T01:39:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb85ffff640 1 -- 172.21.15.44:0/857760303 learned_addr learned my addr 172.21.15.44:0/857760303 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb85effd640 1 --2- 172.21.15.44:0/857760303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8600b2b60 0x7fb8600b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb85f7fe640 1 --2- 172.21.15.44:0/857760303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb86006c1d0 0x7fb8600c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb85ffff640 1 -- 172.21.15.44:0/857760303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8600b2b60 msgr2=0x7fb8600b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb85ffff640 1 --2- 172.21.15.44:0/857760303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8600b2b60 0x7fb8600b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb85ffff640 1 -- 172.21.15.44:0/857760303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb86006c1d0 msgr2=0x7fb8600c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb85ffff640 1 --2- 172.21.15.44:0/857760303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb86006c1d0 0x7fb8600c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb85ffff640 1 -- 172.21.15.44:0/857760303 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb854009400 con 0x7fb860160430 2023-11-04T01:39:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb85f7fe640 1 --2- 172.21.15.44:0/857760303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb86006c1d0 0x7fb8600c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.859+0000 7fb85ffff640 1 --2- 172.21.15.44:0/857760303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860160430 0x7fb8600b5e50 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c7e0 tx=0x7fb85800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.860+0000 7fb847fff640 1 -- 172.21.15.44:0/857760303 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800a640 con 0x7fb860160430 2023-11-04T01:39:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.860+0000 7fb847fff640 1 -- 172.21.15.44:0/857760303 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85800a7c0 con 0x7fb860160430 2023-11-04T01:39:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.860+0000 7fb865fa9640 1 -- 172.21.15.44:0/857760303 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8600b4410 con 0x7fb860160430 2023-11-04T01:39:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.860+0000 7fb847fff640 1 -- 172.21.15.44:0/857760303 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800ab70 con 0x7fb860160430 2023-11-04T01:39:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.860+0000 7fb865fa9640 1 -- 172.21.15.44:0/857760303 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8600b6390 con 0x7fb860160430 2023-11-04T01:39:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.861+0000 7fb865fa9640 1 -- 172.21.15.44:0/857760303 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb860074290 con 0x7fb860160430 2023-11-04T01:39:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.861+0000 7fb847fff640 1 -- 172.21.15.44:0/857760303 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb85800acd0 con 0x7fb860160430 2023-11-04T01:39:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.861+0000 7fb847fff640 1 --2- 172.21.15.44:0/857760303 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb84c06ae70 0x7fb84c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.862+0000 7fb847fff640 1 -- 172.21.15.44:0/857760303 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fb8580893e0 con 0x7fb860160430 2023-11-04T01:39:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.862+0000 7fb85f7fe640 1 --2- 172.21.15.44:0/857760303 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb84c06ae70 0x7fb84c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.862+0000 7fb85f7fe640 1 --2- 172.21.15.44:0/857760303 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb84c06ae70 0x7fb84c06d330 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb854036000 tx=0x7fb85403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:10.866+0000 7fb847fff640 1 -- 172.21.15.44:0/857760303 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb858053f30 con 0x7fb860160430 2023-11-04T01:39:11.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.041+0000 7fb865fa9640 1 -- 172.21.15.44:0/857760303 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fb8600b6b20 con 0x7fb860160430 2023-11-04T01:39:11.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.041+0000 7fb847fff640 1 -- 172.21.15.44:0/857760303 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v84) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb858057550 con 0x7fb860160430 2023-11-04T01:39:11.044 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:39:11.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.043+0000 7fb865fa9640 1 -- 172.21.15.44:0/857760303 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb84c06ae70 msgr2=0x7fb84c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.043+0000 7fb865fa9640 1 --2- 172.21.15.44:0/857760303 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb84c06ae70 0x7fb84c06d330 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb854036000 tx=0x7fb85403c040 comp rx=0 tx=0).stop 2023-11-04T01:39:11.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.043+0000 7fb865fa9640 1 -- 172.21.15.44:0/857760303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860160430 msgr2=0x7fb8600b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.043+0000 7fb865fa9640 1 --2- 172.21.15.44:0/857760303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860160430 0x7fb8600b5e50 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c7e0 tx=0x7fb85800cca0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.043+0000 7fb865fa9640 1 -- 172.21.15.44:0/857760303 shutdown_connections 2023-11-04T01:39:11.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.043+0000 7fb865fa9640 1 --2- 172.21.15.44:0/857760303 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb84c06ae70 0x7fb84c06d330 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.043+0000 7fb865fa9640 1 --2- 172.21.15.44:0/857760303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860160430 0x7fb8600b5e50 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.043+0000 7fb865fa9640 1 --2- 172.21.15.44:0/857760303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8600b2b60 0x7fb8600b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.043+0000 7fb865fa9640 1 --2- 172.21.15.44:0/857760303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb86006c1d0 0x7fb8600c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.043+0000 7fb865fa9640 1 -- 172.21.15.44:0/857760303 >> 172.21.15.44:0/857760303 conn(0x7fb86006ea20 msgr2=0x7fb8600b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:11.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.043+0000 7fb865fa9640 1 -- 172.21.15.44:0/857760303 shutdown_connections 2023-11-04T01:39:11.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.044+0000 7fb865fa9640 1 -- 172.21.15.44:0/857760303 wait complete. 2023-11-04T01:39:11.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:39:11.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.162+0000 7f1c744a9640 1 Processor -- start 2023-11-04T01:39:11.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.162+0000 7f1c744a9640 1 -- start start 2023-11-04T01:39:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.163+0000 7f1c744a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c6c153e60 0x7f1c6c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.163+0000 7f1c744a9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1c6c0b4880 0x7f1c6c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.163+0000 7f1c744a9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c0cde60 con 0x7f1c6c0cd6d0 2023-11-04T01:39:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.163+0000 7f1c744a9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6c0b5230 con 0x7f1c6c0b4880 2023-11-04T01:39:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.163+0000 7f1c744a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c160f90 con 0x7f1c6c153e60 2023-11-04T01:39:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.163+0000 7f1c71a44640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1c6c0cd6d0 0x7f1c6c161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59802/0 (socket says 172.21.15.44:59802) 2023-11-04T01:39:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71a44640 1 -- 172.21.15.44:0/248824716 learned_addr learned my addr 172.21.15.44:0/248824716 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c72245640 1 --2- 172.21.15.44:0/248824716 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c6c153e60 0x7f1c6c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 -- 172.21.15.44:0/248824716 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050237843 0 0) 0x7f1c6c0cde60 con 0x7f1c6c0cd6d0 2023-11-04T01:39:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 -- 172.21.15.44:0/248824716 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c58003520 con 0x7f1c6c0cd6d0 2023-11-04T01:39:11.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c72a46640 1 --2- 172.21.15.44:0/248824716 >> v2:172.21.15.204:3300/0 conn(0x7f1c6c0b4880 0x7f1c6c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 -- 172.21.15.44:0/248824716 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 661866740 0 0) 0x7f1c58003520 con 0x7f1c6c0cd6d0 2023-11-04T01:39:11.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 -- 172.21.15.44:0/248824716 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c6c153e60 msgr2=0x7f1c6c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:11.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 --2- 172.21.15.44:0/248824716 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c6c153e60 0x7f1c6c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 -- 172.21.15.44:0/248824716 >> v2:172.21.15.204:3300/0 conn(0x7f1c6c0b4880 msgr2=0x7f1c6c0b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:11.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 --2- 172.21.15.44:0/248824716 >> v2:172.21.15.204:3300/0 conn(0x7f1c6c0b4880 0x7f1c6c0b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 -- 172.21.15.44:0/248824716 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c15e400 con 0x7f1c6c0cd6d0 2023-11-04T01:39:11.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 -- 172.21.15.44:0/248824716 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f1c5c001670 con 0x7f1c6c0cd6d0 2023-11-04T01:39:11.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 -- 172.21.15.44:0/248824716 >> v1:172.21.15.44:6789/0 conn(0x7f1c6c0cd6d0 legacy=0x7f1c6c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 --2- 172.21.15.44:0/248824716 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c58003970 0x7f1c58003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 --2- 172.21.15.44:0/248824716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c580047c0 0x7f1c58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 --2- 172.21.15.44:0/248824716 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c6c153e60 0x7f1c58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 -- 172.21.15.44:0/248824716 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0b5230 con 0x7f1c580047c0 2023-11-04T01:39:11.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 -- 172.21.15.44:0/248824716 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c160f90 con 0x7f1c58003970 2023-11-04T01:39:11.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71243640 1 -- 172.21.15.44:0/248824716 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5800b980 con 0x7f1c6c153e60 2023-11-04T01:39:11.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c71a44640 1 --2- 172.21.15.44:0/248824716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c580047c0 0x7f1c58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c72245640 1 --2- 172.21.15.44:0/248824716 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c58003970 0x7f1c58003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.164+0000 7f1c72a46640 1 --2- 172.21.15.44:0/248824716 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c6c153e60 0x7f1c58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.165+0000 7f1c71a44640 1 -- 172.21.15.44:0/248824716 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c6c153e60 msgr2=0x7f1c58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:11.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.165+0000 7f1c71a44640 1 --2- 172.21.15.44:0/248824716 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c6c153e60 0x7f1c58005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.165+0000 7f1c71a44640 1 -- 172.21.15.44:0/248824716 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c58003970 msgr2=0x7f1c58003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:11.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.165+0000 7f1c71a44640 1 --2- 172.21.15.44:0/248824716 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c58003970 0x7f1c58003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.165+0000 7f1c71a44640 1 -- 172.21.15.44:0/248824716 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c58003520 con 0x7f1c580047c0 2023-11-04T01:39:11.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.165+0000 7f1c71a44640 1 --2- 172.21.15.44:0/248824716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c580047c0 0x7f1c58004c40 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00c210 tx=0x7f1c580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6230d745604835e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:11.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.165+0000 7f1c71243640 1 -- 172.21.15.44:0/248824716 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c005ad0 con 0x7f1c580047c0 2023-11-04T01:39:11.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.165+0000 7f1c71243640 1 -- 172.21.15.44:0/248824716 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c005c50 con 0x7f1c580047c0 2023-11-04T01:39:11.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.165+0000 7f1c71243640 1 -- 172.21.15.44:0/248824716 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c02c890 con 0x7f1c580047c0 2023-11-04T01:39:11.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.166+0000 7f1c744a9640 1 -- 172.21.15.44:0/248824716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c580047c0 msgr2=0x7f1c58004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.166+0000 7f1c744a9640 1 --2- 172.21.15.44:0/248824716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c580047c0 0x7f1c58004c40 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00c210 tx=0x7f1c580057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.166+0000 7f1c72a46640 1 -- 172.21.15.44:0/248824716 reap_dead start 2023-11-04T01:39:11.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.166+0000 7f1c744a9640 1 -- 172.21.15.44:0/248824716 shutdown_connections 2023-11-04T01:39:11.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.166+0000 7f1c744a9640 1 -- 172.21.15.44:0/248824716 >> 172.21.15.44:0/248824716 conn(0x7f1c6c0cf880 msgr2=0x7f1c6c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:11.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.166+0000 7f1c744a9640 1 -- 172.21.15.44:0/248824716 shutdown_connections 2023-11-04T01:39:11.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.166+0000 7f1c744a9640 1 -- 172.21.15.44:0/248824716 wait complete. 2023-11-04T01:39:11.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.167+0000 7f1c744a9640 1 Processor -- start 2023-11-04T01:39:11.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.167+0000 7f1c744a9640 1 -- start start 2023-11-04T01:39:11.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c744a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c580047c0 0x7f1c6c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c744a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c6c154c50 0x7f1c6c1529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c744a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c6c1565e0 0x7f1c6c156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c744a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c15c760 con 0x7f1c580047c0 2023-11-04T01:39:11.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c744a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c1550b0 con 0x7f1c6c154c50 2023-11-04T01:39:11.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c744a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c153670 con 0x7f1c6c1565e0 2023-11-04T01:39:11.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c72245640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c580047c0 0x7f1c6c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c72245640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c580047c0 0x7f1c6c0c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55480/0 (socket says 172.21.15.44:55480) 2023-11-04T01:39:11.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c72245640 1 -- 172.21.15.44:0/2522883712 learned_addr learned my addr 172.21.15.44:0/2522883712 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:11.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c72a46640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c6c1565e0 0x7f1c6c156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c72245640 1 -- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c6c1565e0 msgr2=0x7f1c6c156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c71a44640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c6c154c50 0x7f1c6c1529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c72245640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c6c1565e0 0x7f1c6c156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c72245640 1 -- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c6c154c50 msgr2=0x7f1c6c1529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c72245640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c6c154c50 0x7f1c6c1529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.168+0000 7f1c72245640 1 -- 172.21.15.44:0/2522883712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c156150 con 0x7f1c580047c0 2023-11-04T01:39:11.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.169+0000 7f1c72a46640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c6c1565e0 0x7f1c6c156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:11.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.169+0000 7f1c71a44640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c6c154c50 0x7f1c6c1529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:11.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.169+0000 7f1c72245640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c580047c0 0x7f1c6c0c9ed0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f1c680118e0 tx=0x7f1c68011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:11.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.169+0000 7f1c62ffd640 1 -- 172.21.15.44:0/2522883712 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6800faf0 con 0x7f1c580047c0 2023-11-04T01:39:11.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.169+0000 7f1c62ffd640 1 -- 172.21.15.44:0/2522883712 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6800fc50 con 0x7f1c580047c0 2023-11-04T01:39:11.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.169+0000 7f1c744a9640 1 -- 172.21.15.44:0/2522883712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c1552a0 con 0x7f1c580047c0 2023-11-04T01:39:11.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.169+0000 7f1c62ffd640 1 -- 172.21.15.44:0/2522883712 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68014440 con 0x7f1c580047c0 2023-11-04T01:39:11.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.169+0000 7f1c744a9640 1 -- 172.21.15.44:0/2522883712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c155580 con 0x7f1c580047c0 2023-11-04T01:39:11.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.170+0000 7f1c744a9640 1 -- 172.21.15.44:0/2522883712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c155c10 con 0x7f1c580047c0 2023-11-04T01:39:11.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.170+0000 7f1c62ffd640 1 -- 172.21.15.44:0/2522883712 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c6801d400 con 0x7f1c580047c0 2023-11-04T01:39:11.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.171+0000 7f1c62ffd640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1c5006aea0 0x7f1c5006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.171+0000 7f1c62ffd640 1 -- 172.21.15.44:0/2522883712 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f1c6808a350 con 0x7f1c580047c0 2023-11-04T01:39:11.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.171+0000 7f1c71a44640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1c5006aea0 0x7f1c5006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.171+0000 7f1c71a44640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1c5006aea0 0x7f1c5006d360 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c034000 tx=0x7f1c5c007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:11.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.175+0000 7f1c62ffd640 1 -- 172.21.15.44:0/2522883712 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c68054e90 con 0x7f1c580047c0 2023-11-04T01:39:11.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.351+0000 7f1c744a9640 1 -- 172.21.15.44:0/2522883712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f1c6c074290 con 0x7f1c580047c0 2023-11-04T01:39:11.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.351+0000 7f1c62ffd640 1 -- 172.21.15.44:0/2522883712 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1c680584b0 con 0x7f1c580047c0 2023-11-04T01:39:11.353 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:39:11.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.353+0000 7f1c744a9640 1 -- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1c5006aea0 msgr2=0x7f1c5006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.353+0000 7f1c744a9640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1c5006aea0 0x7f1c5006d360 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c034000 tx=0x7f1c5c007000 comp rx=0 tx=0).stop 2023-11-04T01:39:11.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.353+0000 7f1c744a9640 1 -- 172.21.15.44:0/2522883712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c580047c0 msgr2=0x7f1c6c0c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.353+0000 7f1c744a9640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c580047c0 0x7f1c6c0c9ed0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f1c680118e0 tx=0x7f1c68011da0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.353+0000 7f1c744a9640 1 -- 172.21.15.44:0/2522883712 shutdown_connections 2023-11-04T01:39:11.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.353+0000 7f1c744a9640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1c5006aea0 0x7f1c5006d360 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.353+0000 7f1c744a9640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c6c1565e0 0x7f1c6c156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.353+0000 7f1c744a9640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c6c154c50 0x7f1c6c1529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.353+0000 7f1c744a9640 1 --2- 172.21.15.44:0/2522883712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c580047c0 0x7f1c6c0c9ed0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.353+0000 7f1c744a9640 1 -- 172.21.15.44:0/2522883712 >> 172.21.15.44:0/2522883712 conn(0x7f1c6c0cf880 msgr2=0x7f1c6c15e800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:11.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.353+0000 7f1c744a9640 1 -- 172.21.15.44:0/2522883712 shutdown_connections 2023-11-04T01:39:11.356 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.353+0000 7f1c744a9640 1 -- 172.21.15.44:0/2522883712 wait complete. 2023-11-04T01:39:11.366 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:39:11.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.473+0000 7fe22c0f3640 1 Processor -- start 2023-11-04T01:39:11.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.473+0000 7fe22c0f3640 1 -- start start 2023-11-04T01:39:11.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe22c0f3640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe2240d0710 0x7fe2240cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe22c0f3640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2240d0280 con 0x7fe2240cda50 2023-11-04T01:39:11.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe22c0f3640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2240cf670 con 0x7fe22415e430 2023-11-04T01:39:11.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe22c0f3640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2240cf950 con 0x7fe2240d0710 2023-11-04T01:39:11.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe22a690640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe2240cda50 0x7fe2240b3d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59808/0 (socket says 172.21.15.44:59808) 2023-11-04T01:39:11.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe22a690640 1 -- 172.21.15.44:0/1386237327 learned_addr learned my addr 172.21.15.44:0/1386237327 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:11.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe228e8d640 1 -- 172.21.15.44:0/1386237327 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287845512 0 0) 0x7fe2240d0280 con 0x7fe2240cda50 2023-11-04T01:39:11.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe22968e640 1 --2- 172.21.15.44:0/1386237327 >> v2:172.21.15.204:3300/0 conn(0x7fe2240d0710 0x7fe2240cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe228e8d640 1 -- 172.21.15.44:0/1386237327 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe210003520 con 0x7fe2240cda50 2023-11-04T01:39:11.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe228e8d640 1 -- 172.21.15.44:0/1386237327 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1026051078 0 0) 0x7fe210003520 con 0x7fe2240cda50 2023-11-04T01:39:11.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe228e8d640 1 -- 172.21.15.44:0/1386237327 >> v2:172.21.15.204:3300/0 conn(0x7fe2240d0710 msgr2=0x7fe2240cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:11.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe228e8d640 1 --2- 172.21.15.44:0/1386237327 >> v2:172.21.15.204:3300/0 conn(0x7fe2240d0710 0x7fe2240cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe228e8d640 1 -- 172.21.15.44:0/1386237327 >> v1:172.21.15.204:6789/0 conn(0x7fe22415e430 legacy=0x7fe2240cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe228e8d640 1 -- 172.21.15.44:0/1386237327 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2240cfc30 con 0x7fe2240cda50 2023-11-04T01:39:11.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe228e8d640 1 -- 172.21.15.44:0/1386237327 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fe21c0019f0 con 0x7fe2240cda50 2023-11-04T01:39:11.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe228e8d640 1 -- 172.21.15.44:0/1386237327 >> v1:172.21.15.44:6789/0 conn(0x7fe2240cda50 legacy=0x7fe2240b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe228e8d640 1 --2- 172.21.15.44:0/1386237327 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe210003970 0x7fe210003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe228e8d640 1 --2- 172.21.15.44:0/1386237327 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe2100047c0 0x7fe210004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe228e8d640 1 --2- 172.21.15.44:0/1386237327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe210005180 0x7fe21000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe228e8d640 1 -- 172.21.15.44:0/1386237327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2240cf950 con 0x7fe210005180 2023-11-04T01:39:11.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe228e8d640 1 -- 172.21.15.44:0/1386237327 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21000c020 con 0x7fe2100047c0 2023-11-04T01:39:11.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.474+0000 7fe228e8d640 1 -- 172.21.15.44:0/1386237327 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21000c1e0 con 0x7fe210003970 2023-11-04T01:39:11.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.475+0000 7fe22a690640 1 --2- 172.21.15.44:0/1386237327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe210005180 0x7fe21000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.475+0000 7fe22968e640 1 --2- 172.21.15.44:0/1386237327 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe2100047c0 0x7fe210004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.475+0000 7fe229e8f640 1 --2- 172.21.15.44:0/1386237327 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe210003970 0x7fe210003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.475+0000 7fe22a690640 1 -- 172.21.15.44:0/1386237327 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe210003970 msgr2=0x7fe210003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:11.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.475+0000 7fe22a690640 1 --2- 172.21.15.44:0/1386237327 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe210003970 0x7fe210003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.475+0000 7fe22a690640 1 -- 172.21.15.44:0/1386237327 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe2100047c0 msgr2=0x7fe210004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:11.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.475+0000 7fe22a690640 1 --2- 172.21.15.44:0/1386237327 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe2100047c0 0x7fe210004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.475+0000 7fe22a690640 1 -- 172.21.15.44:0/1386237327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe210003520 con 0x7fe210005180 2023-11-04T01:39:11.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.475+0000 7fe22a690640 1 -- 172.21.15.44:0/1386237327 reap_dead start 2023-11-04T01:39:11.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.476+0000 7fe22a690640 1 --2- 172.21.15.44:0/1386237327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe210005180 0x7fe21000b980 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00a830 tx=0x7fe2100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e33f46191149407 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:11.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.476+0000 7fe228e8d640 1 -- 172.21.15.44:0/1386237327 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0072d0 con 0x7fe210005180 2023-11-04T01:39:11.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.476+0000 7fe228e8d640 1 -- 172.21.15.44:0/1386237327 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c02f070 con 0x7fe210005180 2023-11-04T01:39:11.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.476+0000 7fe228e8d640 1 -- 172.21.15.44:0/1386237327 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0076b0 con 0x7fe210005180 2023-11-04T01:39:11.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.476+0000 7fe22c0f3640 1 -- 172.21.15.44:0/1386237327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe210005180 msgr2=0x7fe21000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.476+0000 7fe22c0f3640 1 --2- 172.21.15.44:0/1386237327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe210005180 0x7fe21000b980 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00a830 tx=0x7fe2100057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.476+0000 7fe22c0f3640 1 -- 172.21.15.44:0/1386237327 shutdown_connections 2023-11-04T01:39:11.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.476+0000 7fe22c0f3640 1 --2- 172.21.15.44:0/1386237327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe210005180 0x7fe21000b980 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.476+0000 7fe22c0f3640 1 -- 172.21.15.44:0/1386237327 >> 172.21.15.44:0/1386237327 conn(0x7fe22406ea20 msgr2=0x7fe22406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:11.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.476+0000 7fe22c0f3640 1 -- 172.21.15.44:0/1386237327 shutdown_connections 2023-11-04T01:39:11.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.476+0000 7fe22c0f3640 1 -- 172.21.15.44:0/1386237327 wait complete. 2023-11-04T01:39:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.477+0000 7fe22c0f3640 1 Processor -- start 2023-11-04T01:39:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.478+0000 7fe22c0f3640 1 -- start start 2023-11-04T01:39:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.478+0000 7fe22c0f3640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe210005180 0x7fe22414ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.478+0000 7fe22c0f3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2241f38b0 0x7fe2241f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.478+0000 7fe22c0f3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2240c7c70 0x7fe2240c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.478+0000 7fe22c0f3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2240b0e40 con 0x7fe2241f38b0 2023-11-04T01:39:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.478+0000 7fe22c0f3640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2240c8630 con 0x7fe210005180 2023-11-04T01:39:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.478+0000 7fe22c0f3640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2240b3590 con 0x7fe2240c7c70 2023-11-04T01:39:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.478+0000 7fe22968e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2241f38b0 0x7fe2241f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.478+0000 7fe22968e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2241f38b0 0x7fe2241f3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55494/0 (socket says 172.21.15.44:55494) 2023-11-04T01:39:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.478+0000 7fe22968e640 1 -- 172.21.15.44:0/2845933096 learned_addr learned my addr 172.21.15.44:0/2845933096 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.478+0000 7fe22a690640 1 --2- 172.21.15.44:0/2845933096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2240c7c70 0x7fe2240c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.478+0000 7fe229e8f640 1 --2- 172.21.15.44:0/2845933096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe210005180 0x7fe22414ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.479+0000 7fe22968e640 1 -- 172.21.15.44:0/2845933096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2240c7c70 msgr2=0x7fe2240c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.479+0000 7fe22968e640 1 --2- 172.21.15.44:0/2845933096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2240c7c70 0x7fe2240c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.479+0000 7fe22968e640 1 -- 172.21.15.44:0/2845933096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe210005180 msgr2=0x7fe22414ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.479+0000 7fe22968e640 1 --2- 172.21.15.44:0/2845933096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe210005180 0x7fe22414ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.479+0000 7fe22968e640 1 -- 172.21.15.44:0/2845933096 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2241f4350 con 0x7fe2241f38b0 2023-11-04T01:39:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.479+0000 7fe229e8f640 1 --2- 172.21.15.44:0/2845933096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe210005180 0x7fe22414ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.479+0000 7fe22968e640 1 --2- 172.21.15.44:0/2845933096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2241f38b0 0x7fe2241f3d30 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe2140118e0 tx=0x7fe214011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.479+0000 7fe21a7fc640 1 -- 172.21.15.44:0/2845933096 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21400faf0 con 0x7fe2241f38b0 2023-11-04T01:39:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.479+0000 7fe21a7fc640 1 -- 172.21.15.44:0/2845933096 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21400fc50 con 0x7fe2241f38b0 2023-11-04T01:39:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.479+0000 7fe22c0f3640 1 -- 172.21.15.44:0/2845933096 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2241f4630 con 0x7fe2241f38b0 2023-11-04T01:39:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.479+0000 7fe21a7fc640 1 -- 172.21.15.44:0/2845933096 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214014440 con 0x7fe2241f38b0 2023-11-04T01:39:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.479+0000 7fe22c0f3640 1 -- 172.21.15.44:0/2845933096 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2240b1330 con 0x7fe2241f38b0 2023-11-04T01:39:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.480+0000 7fe22c0f3640 1 -- 172.21.15.44:0/2845933096 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe224074290 con 0x7fe2241f38b0 2023-11-04T01:39:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.480+0000 7fe21a7fc640 1 -- 172.21.15.44:0/2845933096 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe2140145a0 con 0x7fe2241f38b0 2023-11-04T01:39:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.481+0000 7fe21a7fc640 1 --2- 172.21.15.44:0/2845933096 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe20806ae70 0x7fe20806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.481+0000 7fe21a7fc640 1 -- 172.21.15.44:0/2845933096 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fe21408a440 con 0x7fe2241f38b0 2023-11-04T01:39:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.481+0000 7fe229e8f640 1 --2- 172.21.15.44:0/2845933096 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe20806ae70 0x7fe20806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.481+0000 7fe229e8f640 1 --2- 172.21.15.44:0/2845933096 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe20806ae70 0x7fe20806d330 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe220005580 tx=0x7fe220009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:11.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.485+0000 7fe21a7fc640 1 -- 172.21.15.44:0/2845933096 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe214054f80 con 0x7fe2241f38b0 2023-11-04T01:39:11.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.658+0000 7fe22c0f3640 1 -- 172.21.15.44:0/2845933096 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe22415bc70 con 0x7fe2241f38b0 2023-11-04T01:39:11.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.659+0000 7fe21a7fc640 1 -- 172.21.15.44:0/2845933096 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe2140585a0 con 0x7fe2241f38b0 2023-11-04T01:39:11.661 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:39:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.661+0000 7fe22c0f3640 1 -- 172.21.15.44:0/2845933096 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe20806ae70 msgr2=0x7fe20806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.661+0000 7fe22c0f3640 1 --2- 172.21.15.44:0/2845933096 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe20806ae70 0x7fe20806d330 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe220005580 tx=0x7fe220009040 comp rx=0 tx=0).stop 2023-11-04T01:39:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.661+0000 7fe22c0f3640 1 -- 172.21.15.44:0/2845933096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2241f38b0 msgr2=0x7fe2241f3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.661+0000 7fe22c0f3640 1 --2- 172.21.15.44:0/2845933096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2241f38b0 0x7fe2241f3d30 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe2140118e0 tx=0x7fe214011da0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.661+0000 7fe22c0f3640 1 -- 172.21.15.44:0/2845933096 shutdown_connections 2023-11-04T01:39:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.661+0000 7fe22c0f3640 1 --2- 172.21.15.44:0/2845933096 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe20806ae70 0x7fe20806d330 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.661+0000 7fe22c0f3640 1 --2- 172.21.15.44:0/2845933096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe2240c7c70 0x7fe2240c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.661+0000 7fe22c0f3640 1 --2- 172.21.15.44:0/2845933096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2241f38b0 0x7fe2241f3d30 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.661+0000 7fe22c0f3640 1 --2- 172.21.15.44:0/2845933096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe210005180 0x7fe22414ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.661+0000 7fe22c0f3640 1 -- 172.21.15.44:0/2845933096 >> 172.21.15.44:0/2845933096 conn(0x7fe22406ea20 msgr2=0x7fe224157970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:11.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.661+0000 7fe22c0f3640 1 -- 172.21.15.44:0/2845933096 shutdown_connections 2023-11-04T01:39:11.664 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.661+0000 7fe22c0f3640 1 -- 172.21.15.44:0/2845933096 wait complete. 2023-11-04T01:39:11.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:39:11.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.780+0000 7f401f3d7640 1 Processor -- start 2023-11-04T01:39:11.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.780+0000 7f401f3d7640 1 -- start start 2023-11-04T01:39:11.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.781+0000 7f401f3d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4018153e60 0x7f401815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.781+0000 7f401f3d7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f40180cd6d0 0x7f4018161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.781+0000 7f401f3d7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f40180b4880 0x7f40180b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.781+0000 7f401f3d7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40180cde60 con 0x7f40180cd6d0 2023-11-04T01:39:11.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.781+0000 7f401f3d7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4018160f90 con 0x7f40180b4880 2023-11-04T01:39:11.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.781+0000 7f401f3d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40180b5200 con 0x7f4018153e60 2023-11-04T01:39:11.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.781+0000 7f401c972640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f40180cd6d0 0x7f4018161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.781+0000 7f401c972640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f40180cd6d0 0x7f4018161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55498/0 (socket says 172.21.15.44:55498) 2023-11-04T01:39:11.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.781+0000 7f401c972640 1 -- 172.21.15.44:0/3139781882 learned_addr learned my addr 172.21.15.44:0/3139781882 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:11.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.781+0000 7f401c972640 1 -- 172.21.15.44:0/3139781882 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4018153e60 msgr2=0x7f401815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:11.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.781+0000 7f401c972640 1 --2- 172.21.15.44:0/3139781882 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4018153e60 0x7f401815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.781+0000 7f401c972640 1 -- 172.21.15.44:0/3139781882 >> v2:172.21.15.204:3300/0 conn(0x7f40180b4880 msgr2=0x7f40180b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:11.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.781+0000 7f401c972640 1 --2- 172.21.15.44:0/3139781882 >> v2:172.21.15.204:3300/0 conn(0x7f40180b4880 0x7f40180b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.781+0000 7f401c972640 1 -- 172.21.15.44:0/3139781882 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401815e400 con 0x7f40180cd6d0 2023-11-04T01:39:11.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.782+0000 7f401c972640 1 --2- 172.21.15.44:0/3139781882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40180cd6d0 0x7f4018161420 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f40180c9e50 tx=0x7f400802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d91f4909c623b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:11.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.782+0000 7f400ffff640 1 -- 172.21.15.44:0/3139781882 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008031870 con 0x7f40180cd6d0 2023-11-04T01:39:11.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.782+0000 7f400ffff640 1 -- 172.21.15.44:0/3139781882 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40080319d0 con 0x7f40180cd6d0 2023-11-04T01:39:11.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.782+0000 7f400ffff640 1 -- 172.21.15.44:0/3139781882 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008031d60 con 0x7f40180cd6d0 2023-11-04T01:39:11.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.782+0000 7f401f3d7640 1 -- 172.21.15.44:0/3139781882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40180cd6d0 msgr2=0x7f4018161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.782+0000 7f401f3d7640 1 --2- 172.21.15.44:0/3139781882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40180cd6d0 0x7f4018161420 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f40180c9e50 tx=0x7f400802b910 comp rx=0 tx=0).stop 2023-11-04T01:39:11.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.782+0000 7f401f3d7640 1 -- 172.21.15.44:0/3139781882 shutdown_connections 2023-11-04T01:39:11.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.782+0000 7f401f3d7640 1 --2- 172.21.15.44:0/3139781882 >> v2:172.21.15.204:3300/0 conn(0x7f40180b4880 0x7f40180b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.782+0000 7f401f3d7640 1 --2- 172.21.15.44:0/3139781882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40180cd6d0 0x7f4018161420 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.782+0000 7f401f3d7640 1 --2- 172.21.15.44:0/3139781882 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4018153e60 0x7f401815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.782+0000 7f401f3d7640 1 -- 172.21.15.44:0/3139781882 >> 172.21.15.44:0/3139781882 conn(0x7f40180cf880 msgr2=0x7f40180cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:11.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.783+0000 7f401f3d7640 1 -- 172.21.15.44:0/3139781882 shutdown_connections 2023-11-04T01:39:11.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.783+0000 7f401f3d7640 1 -- 172.21.15.44:0/3139781882 wait complete. 2023-11-04T01:39:11.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.784+0000 7f401f3d7640 1 Processor -- start 2023-11-04T01:39:11.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.784+0000 7f401f3d7640 1 -- start start 2023-11-04T01:39:11.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.784+0000 7f401f3d7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40180b4880 0x7f40180c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.784+0000 7f401f3d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40180cd6d0 0x7f4018158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.784+0000 7f401f3d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4018153e60 0x7f4018159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.784+0000 7f401f3d7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40181538f0 con 0x7f40180cd6d0 2023-11-04T01:39:11.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.784+0000 7f401f3d7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401815f0c0 con 0x7f40180b4880 2023-11-04T01:39:11.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.784+0000 7f401f3d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40180c9790 con 0x7f4018153e60 2023-11-04T01:39:11.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f401c972640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40180cd6d0 0x7f4018158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f401c972640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40180cd6d0 0x7f4018158cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55508/0 (socket says 172.21.15.44:55508) 2023-11-04T01:39:11.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f401c972640 1 -- 172.21.15.44:0/508219109 learned_addr learned my addr 172.21.15.44:0/508219109 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:11.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f401d173640 1 --2- 172.21.15.44:0/508219109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40180b4880 0x7f40180c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f401d974640 1 --2- 172.21.15.44:0/508219109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4018153e60 0x7f4018159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f401c972640 1 -- 172.21.15.44:0/508219109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4018153e60 msgr2=0x7f4018159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f401c972640 1 --2- 172.21.15.44:0/508219109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4018153e60 0x7f4018159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f401c972640 1 -- 172.21.15.44:0/508219109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40180b4880 msgr2=0x7f40180c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f401c972640 1 --2- 172.21.15.44:0/508219109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40180b4880 0x7f40180c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f401c972640 1 -- 172.21.15.44:0/508219109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40080094d0 con 0x7f40180cd6d0 2023-11-04T01:39:11.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f401c972640 1 --2- 172.21.15.44:0/508219109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40180cd6d0 0x7f4018158cf0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f400802b950 tx=0x7f40080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:11.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f400dffb640 1 -- 172.21.15.44:0/508219109 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400803ad10 con 0x7f40180cd6d0 2023-11-04T01:39:11.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f400dffb640 1 -- 172.21.15.44:0/508219109 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400803ae70 con 0x7f40180cd6d0 2023-11-04T01:39:11.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f400dffb640 1 -- 172.21.15.44:0/508219109 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008044610 con 0x7f40180cd6d0 2023-11-04T01:39:11.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f401f3d7640 1 -- 172.21.15.44:0/508219109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40180c9510 con 0x7f40180cd6d0 2023-11-04T01:39:11.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.785+0000 7f401f3d7640 1 -- 172.21.15.44:0/508219109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40180c7430 con 0x7f40180cd6d0 2023-11-04T01:39:11.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.787+0000 7f401f3d7640 1 -- 172.21.15.44:0/508219109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4018074290 con 0x7f40180cd6d0 2023-11-04T01:39:11.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.787+0000 7f400dffb640 1 -- 172.21.15.44:0/508219109 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4008044770 con 0x7f40180cd6d0 2023-11-04T01:39:11.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.787+0000 7f400dffb640 1 --2- 172.21.15.44:0/508219109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3ffc06ae70 0x7f3ffc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.787+0000 7f400dffb640 1 -- 172.21.15.44:0/508219109 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f400802d040 con 0x7f40180cd6d0 2023-11-04T01:39:11.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.788+0000 7f401d173640 1 --2- 172.21.15.44:0/508219109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3ffc06ae70 0x7f3ffc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.788+0000 7f401d173640 1 --2- 172.21.15.44:0/508219109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3ffc06ae70 0x7f3ffc06d330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4018160b20 tx=0x7f4014008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:11.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.792+0000 7f400dffb640 1 -- 172.21.15.44:0/508219109 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4008076f90 con 0x7f40180cd6d0 2023-11-04T01:39:11.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.968+0000 7f401f3d7640 1 -- 172.21.15.44:0/508219109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40180b4fe0 con 0x7f40180cd6d0 2023-11-04T01:39:11.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.968+0000 7f400dffb640 1 -- 172.21.15.44:0/508219109 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f400807a5b0 con 0x7f40180cd6d0 2023-11-04T01:39:11.970 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:39:11.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.970+0000 7f401f3d7640 1 -- 172.21.15.44:0/508219109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3ffc06ae70 msgr2=0x7f3ffc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.970+0000 7f401f3d7640 1 --2- 172.21.15.44:0/508219109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3ffc06ae70 0x7f3ffc06d330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4018160b20 tx=0x7f4014008040 comp rx=0 tx=0).stop 2023-11-04T01:39:11.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.970+0000 7f401f3d7640 1 -- 172.21.15.44:0/508219109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40180cd6d0 msgr2=0x7f4018158cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.970+0000 7f401f3d7640 1 --2- 172.21.15.44:0/508219109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40180cd6d0 0x7f4018158cf0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f400802b950 tx=0x7f40080046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.970+0000 7f401f3d7640 1 -- 172.21.15.44:0/508219109 shutdown_connections 2023-11-04T01:39:11.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.970+0000 7f401f3d7640 1 --2- 172.21.15.44:0/508219109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3ffc06ae70 0x7f3ffc06d330 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.970+0000 7f401f3d7640 1 --2- 172.21.15.44:0/508219109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4018153e60 0x7f4018159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.970+0000 7f401f3d7640 1 --2- 172.21.15.44:0/508219109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40180cd6d0 0x7f4018158cf0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.970+0000 7f401f3d7640 1 --2- 172.21.15.44:0/508219109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40180b4880 0x7f40180c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.970+0000 7f401f3d7640 1 -- 172.21.15.44:0/508219109 >> 172.21.15.44:0/508219109 conn(0x7f40180cf880 msgr2=0x7f40180d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:11.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.970+0000 7f401f3d7640 1 -- 172.21.15.44:0/508219109 shutdown_connections 2023-11-04T01:39:11.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:11.970+0000 7f401f3d7640 1 -- 172.21.15.44:0/508219109 wait complete. 2023-11-04T01:39:11.983 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:39:12.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.087+0000 7fbdb9b90640 1 Processor -- start 2023-11-04T01:39:12.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.087+0000 7fbdb9b90640 1 -- start start 2023-11-04T01:39:12.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.088+0000 7fbdb9b90640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbdb4153e60 0x7fbdb415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.088+0000 7fbdb9b90640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbdb40cd6d0 0x7fbdb4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.088+0000 7fbdb9b90640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40b4880 0x7fbdb40b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.088+0000 7fbdb9b90640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb40cde60 con 0x7fbdb40cd6d0 2023-11-04T01:39:12.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.088+0000 7fbdb9b90640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb40b5220 con 0x7fbdb4153e60 2023-11-04T01:39:12.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.088+0000 7fbdb9b90640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb4160f90 con 0x7fbdb40b4880 2023-11-04T01:39:12.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.088+0000 7fbdb2ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbdb40cd6d0 0x7fbdb4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.088+0000 7fbdb2ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbdb40cd6d0 0x7fbdb4161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55510/0 (socket says 172.21.15.44:55510) 2023-11-04T01:39:12.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.088+0000 7fbdb2ffd640 1 -- 172.21.15.44:0/3566483535 learned_addr learned my addr 172.21.15.44:0/3566483535 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:12.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.089+0000 7fbdb3fff640 1 --2- 172.21.15.44:0/3566483535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40b4880 0x7fbdb40b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.089+0000 7fbdb2ffd640 1 -- 172.21.15.44:0/3566483535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40b4880 msgr2=0x7fbdb40b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:12.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.089+0000 7fbdb37fe640 1 --2- 172.21.15.44:0/3566483535 >> v2:172.21.15.204:3300/0 conn(0x7fbdb4153e60 0x7fbdb415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.089+0000 7fbdb2ffd640 1 --2- 172.21.15.44:0/3566483535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40b4880 0x7fbdb40b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.089+0000 7fbdb2ffd640 1 -- 172.21.15.44:0/3566483535 >> v2:172.21.15.204:3300/0 conn(0x7fbdb4153e60 msgr2=0x7fbdb415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:12.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.089+0000 7fbdb2ffd640 1 --2- 172.21.15.44:0/3566483535 >> v2:172.21.15.204:3300/0 conn(0x7fbdb4153e60 0x7fbdb415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.089+0000 7fbdb2ffd640 1 -- 172.21.15.44:0/3566483535 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb415e400 con 0x7fbdb40cd6d0 2023-11-04T01:39:12.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.089+0000 7fbdb37fe640 1 --2- 172.21.15.44:0/3566483535 >> v2:172.21.15.204:3300/0 conn(0x7fbdb4153e60 0x7fbdb415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:12.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.089+0000 7fbdb2ffd640 1 --2- 172.21.15.44:0/3566483535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb40cd6d0 0x7fbdb4161420 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fbdb408abe0 tx=0x7fbda802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7daa6c7088ed44d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:12.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.090+0000 7fbdb27fc640 1 -- 172.21.15.44:0/3566483535 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8031640 con 0x7fbdb40cd6d0 2023-11-04T01:39:12.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.090+0000 7fbdb27fc640 1 -- 172.21.15.44:0/3566483535 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda80317a0 con 0x7fbdb40cd6d0 2023-11-04T01:39:12.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.090+0000 7fbdb27fc640 1 -- 172.21.15.44:0/3566483535 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8031b30 con 0x7fbdb40cd6d0 2023-11-04T01:39:12.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.090+0000 7fbdb9b90640 1 -- 172.21.15.44:0/3566483535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb40cd6d0 msgr2=0x7fbdb4161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.090+0000 7fbdb9b90640 1 --2- 172.21.15.44:0/3566483535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb40cd6d0 0x7fbdb4161420 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fbdb408abe0 tx=0x7fbda802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.090+0000 7fbdb9b90640 1 -- 172.21.15.44:0/3566483535 shutdown_connections 2023-11-04T01:39:12.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.090+0000 7fbdb9b90640 1 --2- 172.21.15.44:0/3566483535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40b4880 0x7fbdb40b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.090+0000 7fbdb9b90640 1 --2- 172.21.15.44:0/3566483535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb40cd6d0 0x7fbdb4161420 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.090+0000 7fbdb9b90640 1 --2- 172.21.15.44:0/3566483535 >> v2:172.21.15.204:3300/0 conn(0x7fbdb4153e60 0x7fbdb415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.090+0000 7fbdb9b90640 1 -- 172.21.15.44:0/3566483535 >> 172.21.15.44:0/3566483535 conn(0x7fbdb40cf880 msgr2=0x7fbdb40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:12.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.090+0000 7fbdb9b90640 1 -- 172.21.15.44:0/3566483535 shutdown_connections 2023-11-04T01:39:12.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.090+0000 7fbdb9b90640 1 -- 172.21.15.44:0/3566483535 wait complete. 2023-11-04T01:39:12.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.091+0000 7fbdb9b90640 1 Processor -- start 2023-11-04T01:39:12.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.092+0000 7fbdb9b90640 1 -- start start 2023-11-04T01:39:12.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.092+0000 7fbdb9b90640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb40b4880 0x7fbdb40c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.092+0000 7fbdb9b90640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40cd6d0 0x7fbdb40c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.092+0000 7fbdb9b90640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdb4153e60 0x7fbdb41f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.092+0000 7fbdb9b90640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb4158bc0 con 0x7fbdb40b4880 2023-11-04T01:39:12.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.092+0000 7fbdb9b90640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40c9740 con 0x7fbdb4153e60 2023-11-04T01:39:12.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.092+0000 7fbdb9b90640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40cca10 con 0x7fbdb40cd6d0 2023-11-04T01:39:12.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.092+0000 7fbdb37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb40b4880 0x7fbdb40c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.092+0000 7fbdb37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb40b4880 0x7fbdb40c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55522/0 (socket says 172.21.15.44:55522) 2023-11-04T01:39:12.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.092+0000 7fbdb37fe640 1 -- 172.21.15.44:0/596396600 learned_addr learned my addr 172.21.15.44:0/596396600 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:12.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.093+0000 7fbdb2ffd640 1 --2- 172.21.15.44:0/596396600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40cd6d0 0x7fbdb40c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.093+0000 7fbdb37fe640 1 -- 172.21.15.44:0/596396600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40cd6d0 msgr2=0x7fbdb40c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.093+0000 7fbdb37fe640 1 --2- 172.21.15.44:0/596396600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40cd6d0 0x7fbdb40c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.093+0000 7fbdb37fe640 1 -- 172.21.15.44:0/596396600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdb4153e60 msgr2=0x7fbdb41f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.093+0000 7fbdb3fff640 1 --2- 172.21.15.44:0/596396600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdb4153e60 0x7fbdb41f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.093+0000 7fbdb37fe640 1 --2- 172.21.15.44:0/596396600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdb4153e60 0x7fbdb41f5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.093+0000 7fbdb37fe640 1 -- 172.21.15.44:0/596396600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80094d0 con 0x7fbdb40b4880 2023-11-04T01:39:12.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.093+0000 7fbdb37fe640 1 --2- 172.21.15.44:0/596396600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb40b4880 0x7fbdb40c9200 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fbda400c7f0 tx=0x7fbda400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:12.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.093+0000 7fbd9bfff640 1 -- 172.21.15.44:0/596396600 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4007820 con 0x7fbdb40b4880 2023-11-04T01:39:12.097 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.093+0000 7fbd9bfff640 1 -- 172.21.15.44:0/596396600 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4007980 con 0x7fbdb40b4880 2023-11-04T01:39:12.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.093+0000 7fbd9bfff640 1 -- 172.21.15.44:0/596396600 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4007cf0 con 0x7fbdb40b4880 2023-11-04T01:39:12.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.093+0000 7fbdb9b90640 1 -- 172.21.15.44:0/596396600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb40cccf0 con 0x7fbdb40b4880 2023-11-04T01:39:12.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.093+0000 7fbdb9b90640 1 -- 172.21.15.44:0/596396600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb4158e10 con 0x7fbdb40b4880 2023-11-04T01:39:12.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.094+0000 7fbdb9b90640 1 -- 172.21.15.44:0/596396600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb40cd210 con 0x7fbdb40b4880 2023-11-04T01:39:12.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.095+0000 7fbd9bfff640 1 -- 172.21.15.44:0/596396600 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbda40113f0 con 0x7fbdb40b4880 2023-11-04T01:39:12.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.095+0000 7fbd9bfff640 1 --2- 172.21.15.44:0/596396600 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbda006ae70 0x7fbda006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.095+0000 7fbd9bfff640 1 -- 172.21.15.44:0/596396600 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fbda4089e30 con 0x7fbdb40b4880 2023-11-04T01:39:12.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.095+0000 7fbdb2ffd640 1 --2- 172.21.15.44:0/596396600 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbda006ae70 0x7fbda006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.096+0000 7fbdb2ffd640 1 --2- 172.21.15.44:0/596396600 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbda006ae70 0x7fbda006d330 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbda8036000 tx=0x7fbda803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:12.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.099+0000 7fbd9bfff640 1 -- 172.21.15.44:0/596396600 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbda4054a00 con 0x7fbdb40b4880 2023-11-04T01:39:12.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.285+0000 7fbdb9b90640 1 -- 172.21.15.44:0/596396600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbdb4074290 con 0x7fbdb40b4880 2023-11-04T01:39:12.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.286+0000 7fbd9bfff640 1 -- 172.21.15.44:0/596396600 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v84) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbda401f080 con 0x7fbdb40b4880 2023-11-04T01:39:12.288 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2023-11-04T01:39:12.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.288+0000 7fbdb9b90640 1 -- 172.21.15.44:0/596396600 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbda006ae70 msgr2=0x7fbda006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.288+0000 7fbdb9b90640 1 --2- 172.21.15.44:0/596396600 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbda006ae70 0x7fbda006d330 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbda8036000 tx=0x7fbda803c040 comp rx=0 tx=0).stop 2023-11-04T01:39:12.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.288+0000 7fbdb9b90640 1 -- 172.21.15.44:0/596396600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb40b4880 msgr2=0x7fbdb40c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.288+0000 7fbdb9b90640 1 --2- 172.21.15.44:0/596396600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb40b4880 0x7fbdb40c9200 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fbda400c7f0 tx=0x7fbda400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.288+0000 7fbdb9b90640 1 -- 172.21.15.44:0/596396600 shutdown_connections 2023-11-04T01:39:12.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.288+0000 7fbdb9b90640 1 --2- 172.21.15.44:0/596396600 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbda006ae70 0x7fbda006d330 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.288+0000 7fbdb9b90640 1 --2- 172.21.15.44:0/596396600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdb4153e60 0x7fbdb41f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.288+0000 7fbdb9b90640 1 --2- 172.21.15.44:0/596396600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40cd6d0 0x7fbdb40c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.288+0000 7fbdb9b90640 1 --2- 172.21.15.44:0/596396600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb40b4880 0x7fbdb40c9200 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.288+0000 7fbdb9b90640 1 -- 172.21.15.44:0/596396600 >> 172.21.15.44:0/596396600 conn(0x7fbdb40cf880 msgr2=0x7fbdb40d25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:12.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.288+0000 7fbdb9b90640 1 -- 172.21.15.44:0/596396600 shutdown_connections 2023-11-04T01:39:12.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.288+0000 7fbdb9b90640 1 -- 172.21.15.44:0/596396600 wait complete. 2023-11-04T01:39:12.300 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2023-11-04T01:39:12.300 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:12.301 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:12.364 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[114283]: fuse finished with error 0 and tester_r 0 2023-11-04T01:39:12.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:12.371 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:39:12.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:12.371 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:39:12.372 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:39:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:12.387 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:39:12.387 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:12.405 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:39:12.405 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:39:12.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:12.406 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:39:12.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:12.463 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:39:12.464 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:39:12.464 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:12.479 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:39:12.479 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:39:12.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:12.479 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:39:12.534 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:12.535 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:39:12.535 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:39:12.535 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:12.552 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:39:12.552 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:39:12.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:12.552 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:39:12.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:12.609 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:39:12.609 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:12.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.714+0000 7fe84c765640 1 Processor -- start 2023-11-04T01:39:12.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.714+0000 7fe84c765640 1 -- start start 2023-11-04T01:39:12.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.715+0000 7fe84c765640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe844159c70 0x7fe8440ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.715+0000 7fe84c765640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8440b0ae0 0x7fe84415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.715+0000 7fe84c765640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8440b4110 con 0x7fe84406db20 2023-11-04T01:39:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.715+0000 7fe84c765640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8440b49b0 con 0x7fe844159c70 2023-11-04T01:39:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.715+0000 7fe84c765640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440b43f0 con 0x7fe8440b0ae0 2023-11-04T01:39:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.715+0000 7fe84a501640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe844159c70 0x7fe8440ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.715+0000 7fe849d00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe84406db20 0x7fe8440b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37632/0 (socket says 172.21.15.44:37632) 2023-11-04T01:39:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.715+0000 7fe849d00640 1 -- 172.21.15.44:0/264730097 learned_addr learned my addr 172.21.15.44:0/264730097 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.715+0000 7fe84ad02640 1 --2- 172.21.15.44:0/264730097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8440b0ae0 0x7fe84415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.715+0000 7fe84a501640 1 -- 172.21.15.44:0/264730097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8440b0ae0 msgr2=0x7fe84415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.715+0000 7fe84a501640 1 --2- 172.21.15.44:0/264730097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8440b0ae0 0x7fe84415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.716+0000 7fe84a501640 1 -- 172.21.15.44:0/264730097 >> v1:172.21.15.44:6789/0 conn(0x7fe84406db20 legacy=0x7fe8440b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.716+0000 7fe84a501640 1 -- 172.21.15.44:0/264730097 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8440b46d0 con 0x7fe844159c70 2023-11-04T01:39:12.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.716+0000 7fe8494ff640 1 -- 172.21.15.44:0/264730097 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583271718 0 0) 0x7fe8440b4110 con 0x7fe84406db20 2023-11-04T01:39:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.716+0000 7fe84a501640 1 --2- 172.21.15.44:0/264730097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe844159c70 0x7fe8440ce370 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fe834009d90 tx=0x7fe83402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ad90fdcb5e3a49 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.716+0000 7fe8494ff640 1 -- 172.21.15.44:0/264730097 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83402cc50 con 0x7fe844159c70 2023-11-04T01:39:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.716+0000 7fe8494ff640 1 -- 172.21.15.44:0/264730097 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83402cdb0 con 0x7fe844159c70 2023-11-04T01:39:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.716+0000 7fe8494ff640 1 -- 172.21.15.44:0/264730097 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834034660 con 0x7fe844159c70 2023-11-04T01:39:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.717+0000 7fe84c765640 1 -- 172.21.15.44:0/264730097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe844159c70 msgr2=0x7fe8440ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.717+0000 7fe84c765640 1 --2- 172.21.15.44:0/264730097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe844159c70 0x7fe8440ce370 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fe834009d90 tx=0x7fe83402bea0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.717+0000 7fe84c765640 1 -- 172.21.15.44:0/264730097 shutdown_connections 2023-11-04T01:39:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.717+0000 7fe84c765640 1 --2- 172.21.15.44:0/264730097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8440b0ae0 0x7fe84415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.717+0000 7fe84c765640 1 --2- 172.21.15.44:0/264730097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe844159c70 0x7fe8440ce370 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.717+0000 7fe84c765640 1 -- 172.21.15.44:0/264730097 >> 172.21.15.44:0/264730097 conn(0x7fe8440ce950 msgr2=0x7fe8440ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:12.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.717+0000 7fe84c765640 1 -- 172.21.15.44:0/264730097 shutdown_connections 2023-11-04T01:39:12.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.717+0000 7fe84c765640 1 -- 172.21.15.44:0/264730097 wait complete. 2023-11-04T01:39:12.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.718+0000 7fe84c765640 1 Processor -- start 2023-11-04T01:39:12.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.718+0000 7fe84c765640 1 -- start start 2023-11-04T01:39:12.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.719+0000 7fe84c765640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe84406db20 0x7fe8441491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.719+0000 7fe84c765640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8440b0ae0 0x7fe8440ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.719+0000 7fe84c765640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe844159c70 0x7fe8440ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.719+0000 7fe84c765640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84414a6b0 con 0x7fe8440b0ae0 2023-11-04T01:39:12.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.719+0000 7fe84c765640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe844149a30 con 0x7fe844159c70 2023-11-04T01:39:12.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.719+0000 7fe84c765640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe844149d10 con 0x7fe84406db20 2023-11-04T01:39:12.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.719+0000 7fe849d00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8440b0ae0 0x7fe8440ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.719+0000 7fe849d00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8440b0ae0 0x7fe8440ae240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55122/0 (socket says 172.21.15.44:55122) 2023-11-04T01:39:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.719+0000 7fe849d00640 1 -- 172.21.15.44:0/3184293215 learned_addr learned my addr 172.21.15.44:0/3184293215 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.719+0000 7fe84a501640 1 --2- 172.21.15.44:0/3184293215 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe84406db20 0x7fe8441491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.719+0000 7fe84ad02640 1 --2- 172.21.15.44:0/3184293215 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe844159c70 0x7fe8440ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.720+0000 7fe849d00640 1 -- 172.21.15.44:0/3184293215 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe84406db20 msgr2=0x7fe8441491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.720+0000 7fe849d00640 1 --2- 172.21.15.44:0/3184293215 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe84406db20 0x7fe8441491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.720+0000 7fe849d00640 1 -- 172.21.15.44:0/3184293215 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe844159c70 msgr2=0x7fe8440ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.720+0000 7fe849d00640 1 --2- 172.21.15.44:0/3184293215 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe844159c70 0x7fe8440ac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.720+0000 7fe849d00640 1 -- 172.21.15.44:0/3184293215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe834009a70 con 0x7fe8440b0ae0 2023-11-04T01:39:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.720+0000 7fe849d00640 1 --2- 172.21.15.44:0/3184293215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8440b0ae0 0x7fe8440ae240 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe83800c4d0 tx=0x7fe83800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.720+0000 7fe842ffd640 1 -- 172.21.15.44:0/3184293215 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8380074e0 con 0x7fe8440b0ae0 2023-11-04T01:39:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.720+0000 7fe842ffd640 1 -- 172.21.15.44:0/3184293215 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe838007660 con 0x7fe8440b0ae0 2023-11-04T01:39:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.720+0000 7fe84c765640 1 -- 172.21.15.44:0/3184293215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe844149ff0 con 0x7fe8440b0ae0 2023-11-04T01:39:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.720+0000 7fe842ffd640 1 -- 172.21.15.44:0/3184293215 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe838004a20 con 0x7fe8440b0ae0 2023-11-04T01:39:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.720+0000 7fe84c765640 1 -- 172.21.15.44:0/3184293215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8440ae780 con 0x7fe8440b0ae0 2023-11-04T01:39:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.721+0000 7fe84c765640 1 -- 172.21.15.44:0/3184293215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe844074290 con 0x7fe8440b0ae0 2023-11-04T01:39:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.721+0000 7fe842ffd640 1 -- 172.21.15.44:0/3184293215 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe838004b80 con 0x7fe8440b0ae0 2023-11-04T01:39:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.722+0000 7fe842ffd640 1 --2- 172.21.15.44:0/3184293215 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe83006ae70 0x7fe83006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.722+0000 7fe842ffd640 1 -- 172.21.15.44:0/3184293215 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fe838088f80 con 0x7fe8440b0ae0 2023-11-04T01:39:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.722+0000 7fe84a501640 1 --2- 172.21.15.44:0/3184293215 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe83006ae70 0x7fe83006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.723+0000 7fe84a501640 1 --2- 172.21.15.44:0/3184293215 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe83006ae70 0x7fe83006d330 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe834036000 tx=0x7fe834030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:12.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.726+0000 7fe842ffd640 1 -- 172.21.15.44:0/3184293215 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe8380bbca0 con 0x7fe8440b0ae0 2023-11-04T01:39:12.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.937+0000 7fe84c765640 1 -- 172.21.15.44:0/3184293215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe84406d3f0 con 0x7fe8440b0ae0 2023-11-04T01:39:12.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.937+0000 7fe842ffd640 1 -- 172.21.15.44:0/3184293215 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4915 (secure 0 0 0) 0x7fe838018020 con 0x7fe8440b0ae0 2023-11-04T01:39:12.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:12.940 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/257114874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":257114874},{"type":"v1","addr":"172.21.15.204:6835","nonce":257114874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6292,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2084651129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":2084651129},{"type":"v1","addr":"172.21.15.204:6837","nonce":2084651129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1688550253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1688550253},{"type":"v1","addr":"172.21.15.44:6834","nonce":1688550253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:38:59.773482+0000","modified":"2023-11-04T01:39:08.845246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6891},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6891":{"gid":6891,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/364976049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":364976049},{"type":"v1","addr":"172.21.15.44:6835","nonce":364976049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:39:12.940 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 39 2023-11-04T01:39:12.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.939+0000 7fe84c765640 1 -- 172.21.15.44:0/3184293215 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe83006ae70 msgr2=0x7fe83006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.939+0000 7fe84c765640 1 --2- 172.21.15.44:0/3184293215 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe83006ae70 0x7fe83006d330 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe834036000 tx=0x7fe834030000 comp rx=0 tx=0).stop 2023-11-04T01:39:12.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.939+0000 7fe84c765640 1 -- 172.21.15.44:0/3184293215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8440b0ae0 msgr2=0x7fe8440ae240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.939+0000 7fe84c765640 1 --2- 172.21.15.44:0/3184293215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8440b0ae0 0x7fe8440ae240 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe83800c4d0 tx=0x7fe83800c990 comp rx=0 tx=0).stop 2023-11-04T01:39:12.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.939+0000 7fe84c765640 1 -- 172.21.15.44:0/3184293215 shutdown_connections 2023-11-04T01:39:12.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.939+0000 7fe84c765640 1 --2- 172.21.15.44:0/3184293215 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe83006ae70 0x7fe83006d330 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.939+0000 7fe84c765640 1 --2- 172.21.15.44:0/3184293215 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe844159c70 0x7fe8440ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.939+0000 7fe84c765640 1 --2- 172.21.15.44:0/3184293215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8440b0ae0 0x7fe8440ae240 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.939+0000 7fe84c765640 1 --2- 172.21.15.44:0/3184293215 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe84406db20 0x7fe8441491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.939+0000 7fe84c765640 1 -- 172.21.15.44:0/3184293215 >> 172.21.15.44:0/3184293215 conn(0x7fe8440ce950 msgr2=0x7fe8440cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:12.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.939+0000 7fe84c765640 1 -- 172.21.15.44:0/3184293215 shutdown_connections 2023-11-04T01:39:12.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:12.939+0000 7fe84c765640 1 -- 172.21.15.44:0/3184293215 wait complete. 2023-11-04T01:39:12.954 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:13.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.058+0000 7f0800090640 1 Processor -- start 2023-11-04T01:39:13.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.058+0000 7f0800090640 1 -- start start 2023-11-04T01:39:13.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.059+0000 7f0800090640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f07f80aec80 0x7f07f80b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.059+0000 7f0800090640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f80b1590 con 0x7f07f80af060 2023-11-04T01:39:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.059+0000 7f0800090640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f806a8e0 con 0x7f07f806ef40 2023-11-04T01:39:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.059+0000 7f0800090640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f8155a40 con 0x7f07f80aec80 2023-11-04T01:39:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.059+0000 7f07fde2c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f07f80aec80 0x7f07f80b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.059+0000 7f07fde2c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f07f80aec80 0x7f07f80b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55134/0 (socket says 172.21.15.44:55134) 2023-11-04T01:39:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.059+0000 7f07fde2c640 1 -- 172.21.15.44:0/1827781216 learned_addr learned my addr 172.21.15.44:0/1827781216 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.059+0000 7f07fd62b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f07f80af060 0x7f07f806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37636/0 (socket says 172.21.15.44:37636) 2023-11-04T01:39:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.059+0000 7f07fce2a640 1 -- 172.21.15.44:0/1827781216 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18466109 0 0) 0x7f07f80b1590 con 0x7f07f80af060 2023-11-04T01:39:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.059+0000 7f07fce2a640 1 -- 172.21.15.44:0/1827781216 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e0003520 con 0x7f07f80af060 2023-11-04T01:39:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.059+0000 7f07fde2c640 1 -- 172.21.15.44:0/1827781216 >> v1:172.21.15.204:6789/0 conn(0x7f07f806ef40 legacy=0x7f07f80cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.059+0000 7f07fde2c640 1 -- 172.21.15.44:0/1827781216 >> v1:172.21.15.44:6789/0 conn(0x7f07f80af060 legacy=0x7f07f806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.060+0000 7f07fde2c640 1 -- 172.21.15.44:0/1827781216 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f80b1800 con 0x7f07f80aec80 2023-11-04T01:39:13.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.060+0000 7f07fde2c640 1 --2- 172.21.15.44:0/1827781216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f80aec80 0x7f07f80b1fe0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009ea0 tx=0x7f07e802c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1279cfbf2c851ed0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.060+0000 7f07fce2a640 1 -- 172.21.15.44:0/1827781216 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e802cbf0 con 0x7f07f80aec80 2023-11-04T01:39:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.060+0000 7f07fce2a640 1 -- 172.21.15.44:0/1827781216 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e802cd50 con 0x7f07f80aec80 2023-11-04T01:39:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.060+0000 7f07fce2a640 1 -- 172.21.15.44:0/1827781216 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8034610 con 0x7f07f80aec80 2023-11-04T01:39:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.061+0000 7f0800090640 1 -- 172.21.15.44:0/1827781216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f80aec80 msgr2=0x7f07f80b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.061+0000 7f0800090640 1 --2- 172.21.15.44:0/1827781216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f80aec80 0x7f07f80b1fe0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009ea0 tx=0x7f07e802c050 comp rx=0 tx=0).stop 2023-11-04T01:39:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.061+0000 7f0800090640 1 -- 172.21.15.44:0/1827781216 shutdown_connections 2023-11-04T01:39:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.061+0000 7f0800090640 1 --2- 172.21.15.44:0/1827781216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f80aec80 0x7f07f80b1fe0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.061+0000 7f0800090640 1 -- 172.21.15.44:0/1827781216 >> 172.21.15.44:0/1827781216 conn(0x7f07f8098d40 msgr2=0x7f07f80cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.061+0000 7f0800090640 1 -- 172.21.15.44:0/1827781216 shutdown_connections 2023-11-04T01:39:13.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.061+0000 7f0800090640 1 -- 172.21.15.44:0/1827781216 wait complete. 2023-11-04T01:39:13.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.062+0000 7f0800090640 1 Processor -- start 2023-11-04T01:39:13.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.062+0000 7f0800090640 1 -- start start 2023-11-04T01:39:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f0800090640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f806ef40 0x7f07f81f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f0800090640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07f80aec80 0x7f07f81f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f0800090640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f80af060 0x7f07f80c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f0800090640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80c9240 con 0x7f07f80af060 2023-11-04T01:39:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f0800090640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f815f4e0 con 0x7f07f80aec80 2023-11-04T01:39:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f0800090640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80c8f60 con 0x7f07f806ef40 2023-11-04T01:39:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f07fe62d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f80af060 0x7f07f80c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f07fe62d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f80af060 0x7f07f80c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55138/0 (socket says 172.21.15.44:55138) 2023-11-04T01:39:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f07fe62d640 1 -- 172.21.15.44:0/2279889770 learned_addr learned my addr 172.21.15.44:0/2279889770 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f07fd62b640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07f80aec80 0x7f07f81f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f07fde2c640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f806ef40 0x7f07f81f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f07fe62d640 1 -- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f806ef40 msgr2=0x7f07f81f3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f07fe62d640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f806ef40 0x7f07f81f3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f07fe62d640 1 -- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07f80aec80 msgr2=0x7f07f81f4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f07fe62d640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07f80aec80 0x7f07f81f4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f07fe62d640 1 -- 172.21.15.44:0/2279889770 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e8009b30 con 0x7f07f80af060 2023-11-04T01:39:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f07fd62b640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07f80aec80 0x7f07f81f4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.063+0000 7f07fde2c640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f806ef40 0x7f07f81f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.064+0000 7f07fe62d640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f80af060 0x7f07f80c8250 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f07f0001eb0 tx=0x7f07f000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.064+0000 7f07f67fc640 1 -- 172.21.15.44:0/2279889770 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f00052d0 con 0x7f07f80af060 2023-11-04T01:39:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.064+0000 7f07f67fc640 1 -- 172.21.15.44:0/2279889770 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f0005430 con 0x7f07f80af060 2023-11-04T01:39:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.064+0000 7f07f67fc640 1 -- 172.21.15.44:0/2279889770 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0003810 con 0x7f07f80af060 2023-11-04T01:39:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.064+0000 7f0800090640 1 -- 172.21.15.44:0/2279889770 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f80ac990 con 0x7f07f80af060 2023-11-04T01:39:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.064+0000 7f0800090640 1 -- 172.21.15.44:0/2279889770 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f80acf50 con 0x7f07f80af060 2023-11-04T01:39:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.065+0000 7f0800090640 1 -- 172.21.15.44:0/2279889770 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f80ad160 con 0x7f07f80af060 2023-11-04T01:39:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.065+0000 7f07f67fc640 1 -- 172.21.15.44:0/2279889770 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f07f0003970 con 0x7f07f80af060 2023-11-04T01:39:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.066+0000 7f07f67fc640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f07e406ae70 0x7f07e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.066+0000 7f07f67fc640 1 -- 172.21.15.44:0/2279889770 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f07f0089130 con 0x7f07f80af060 2023-11-04T01:39:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.066+0000 7f07fde2c640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f07e406ae70 0x7f07e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.067+0000 7f07fde2c640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f07e406ae70 0x7f07e406d330 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f07e8035000 tx=0x7f07e8030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.070+0000 7f07f67fc640 1 -- 172.21.15.44:0/2279889770 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07f0053c60 con 0x7f07f80af060 2023-11-04T01:39:13.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.246+0000 7f0800090640 1 -- 172.21.15.44:0/2279889770 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07f8074290 con 0x7f07f80af060 2023-11-04T01:39:13.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.247+0000 7f07f67fc640 1 -- 172.21.15.44:0/2279889770 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+21953 (secure 0 0 0) 0x7f07f0057280 con 0x7f07f80af060 2023-11-04T01:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:13.249 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":84,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:39:01.413720+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:57.815488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:58.748063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.249+0000 7f0800090640 1 -- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f07e406ae70 msgr2=0x7f07e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.249+0000 7f0800090640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f07e406ae70 0x7f07e406d330 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f07e8035000 tx=0x7f07e8030000 comp rx=0 tx=0).stop 2023-11-04T01:39:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.249+0000 7f0800090640 1 -- 172.21.15.44:0/2279889770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f80af060 msgr2=0x7f07f80c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.249+0000 7f0800090640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f80af060 0x7f07f80c8250 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f07f0001eb0 tx=0x7f07f000c890 comp rx=0 tx=0).stop 2023-11-04T01:39:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.249+0000 7f0800090640 1 -- 172.21.15.44:0/2279889770 shutdown_connections 2023-11-04T01:39:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.249+0000 7f0800090640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f07e406ae70 0x7f07e406d330 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.249+0000 7f0800090640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f80af060 0x7f07f80c8250 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.249+0000 7f0800090640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07f80aec80 0x7f07f81f4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.249+0000 7f0800090640 1 --2- 172.21.15.44:0/2279889770 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f806ef40 0x7f07f81f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.249+0000 7f0800090640 1 -- 172.21.15.44:0/2279889770 >> 172.21.15.44:0/2279889770 conn(0x7f07f8098d40 msgr2=0x7f07f80cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:13.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.249+0000 7f0800090640 1 -- 172.21.15.44:0/2279889770 shutdown_connections 2023-11-04T01:39:13.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.249+0000 7f0800090640 1 -- 172.21.15.44:0/2279889770 wait complete. 2023-11-04T01:39:13.262 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:34.917670+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:35.547044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:38:57.815488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:38:58.748063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:13.263 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:13.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.369+0000 7fbd27376640 1 Processor -- start 2023-11-04T01:39:13.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.370+0000 7fbd27376640 1 -- start start 2023-11-04T01:39:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.370+0000 7fbd27376640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbd20153e60 0x7fbd2015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.370+0000 7fbd27376640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbd200cd6d0 0x7fbd20161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.370+0000 7fbd27376640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd200b4880 0x7fbd200b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.370+0000 7fbd27376640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd200cde60 con 0x7fbd20153e60 2023-11-04T01:39:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.370+0000 7fbd27376640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd200b5220 con 0x7fbd200cd6d0 2023-11-04T01:39:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.370+0000 7fbd27376640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20160f90 con 0x7fbd200b4880 2023-11-04T01:39:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.370+0000 7fbd25112640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbd20153e60 0x7fbd2015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.370+0000 7fbd25112640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbd20153e60 0x7fbd2015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55146/0 (socket says 172.21.15.44:55146) 2023-11-04T01:39:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.370+0000 7fbd25112640 1 -- 172.21.15.44:0/2782657028 learned_addr learned my addr 172.21.15.44:0/2782657028 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.371+0000 7fbd25913640 1 --2- 172.21.15.44:0/2782657028 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd200b4880 0x7fbd200b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.371+0000 7fbd24911640 1 --2- 172.21.15.44:0/2782657028 >> v2:172.21.15.204:3300/0 conn(0x7fbd200cd6d0 0x7fbd20161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.371+0000 7fbd25112640 1 -- 172.21.15.44:0/2782657028 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd200b4880 msgr2=0x7fbd200b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:13.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.371+0000 7fbd25112640 1 --2- 172.21.15.44:0/2782657028 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd200b4880 0x7fbd200b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.371+0000 7fbd25112640 1 -- 172.21.15.44:0/2782657028 >> v2:172.21.15.204:3300/0 conn(0x7fbd200cd6d0 msgr2=0x7fbd20161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.371+0000 7fbd25112640 1 --2- 172.21.15.44:0/2782657028 >> v2:172.21.15.204:3300/0 conn(0x7fbd200cd6d0 0x7fbd20161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.371+0000 7fbd25112640 1 -- 172.21.15.44:0/2782657028 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2015e400 con 0x7fbd20153e60 2023-11-04T01:39:13.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.371+0000 7fbd25913640 1 --2- 172.21.15.44:0/2782657028 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd200b4880 0x7fbd200b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:13.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.371+0000 7fbd25112640 1 --2- 172.21.15.44:0/2782657028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd20153e60 0x7fbd2015dec0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fbd200c9e80 tx=0x7fbd1802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f57a64b497112e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.372+0000 7fbd17fff640 1 -- 172.21.15.44:0/2782657028 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18031640 con 0x7fbd20153e60 2023-11-04T01:39:13.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.372+0000 7fbd17fff640 1 -- 172.21.15.44:0/2782657028 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd180317a0 con 0x7fbd20153e60 2023-11-04T01:39:13.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.372+0000 7fbd17fff640 1 -- 172.21.15.44:0/2782657028 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18031b30 con 0x7fbd20153e60 2023-11-04T01:39:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.372+0000 7fbd27376640 1 -- 172.21.15.44:0/2782657028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd20153e60 msgr2=0x7fbd2015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.372+0000 7fbd27376640 1 --2- 172.21.15.44:0/2782657028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd20153e60 0x7fbd2015dec0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fbd200c9e80 tx=0x7fbd1802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.372+0000 7fbd27376640 1 -- 172.21.15.44:0/2782657028 shutdown_connections 2023-11-04T01:39:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.372+0000 7fbd27376640 1 --2- 172.21.15.44:0/2782657028 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd200b4880 0x7fbd200b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.372+0000 7fbd27376640 1 --2- 172.21.15.44:0/2782657028 >> v2:172.21.15.204:3300/0 conn(0x7fbd200cd6d0 0x7fbd20161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.372+0000 7fbd27376640 1 --2- 172.21.15.44:0/2782657028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd20153e60 0x7fbd2015dec0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.372+0000 7fbd27376640 1 -- 172.21.15.44:0/2782657028 >> 172.21.15.44:0/2782657028 conn(0x7fbd200cf880 msgr2=0x7fbd200cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.372+0000 7fbd27376640 1 -- 172.21.15.44:0/2782657028 shutdown_connections 2023-11-04T01:39:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.372+0000 7fbd27376640 1 -- 172.21.15.44:0/2782657028 wait complete. 2023-11-04T01:39:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.373+0000 7fbd27376640 1 Processor -- start 2023-11-04T01:39:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.374+0000 7fbd27376640 1 -- start start 2023-11-04T01:39:13.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.374+0000 7fbd27376640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd200b4880 0x7fbd200b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.374+0000 7fbd27376640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd200cd6d0 0x7fbd200b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.374+0000 7fbd27376640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd20153e60 0x7fbd200c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.374+0000 7fbd27376640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd200c8b00 con 0x7fbd20153e60 2023-11-04T01:39:13.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.374+0000 7fbd27376640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2014a660 con 0x7fbd200b4880 2023-11-04T01:39:13.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.374+0000 7fbd27376640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2014dc70 con 0x7fbd200cd6d0 2023-11-04T01:39:13.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.375+0000 7fbd25913640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd20153e60 0x7fbd200c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.375+0000 7fbd25913640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd20153e60 0x7fbd200c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55160/0 (socket says 172.21.15.44:55160) 2023-11-04T01:39:13.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.375+0000 7fbd25913640 1 -- 172.21.15.44:0/1315715135 learned_addr learned my addr 172.21.15.44:0/1315715135 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:13.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.375+0000 7fbd25112640 1 --2- 172.21.15.44:0/1315715135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd200b4880 0x7fbd200b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.375+0000 7fbd24911640 1 --2- 172.21.15.44:0/1315715135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd200cd6d0 0x7fbd200b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.375+0000 7fbd25913640 1 -- 172.21.15.44:0/1315715135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd200cd6d0 msgr2=0x7fbd200b7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.375+0000 7fbd25913640 1 --2- 172.21.15.44:0/1315715135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd200cd6d0 0x7fbd200b7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.375+0000 7fbd25913640 1 -- 172.21.15.44:0/1315715135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd200b4880 msgr2=0x7fbd200b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.375+0000 7fbd25913640 1 --2- 172.21.15.44:0/1315715135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd200b4880 0x7fbd200b78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.375+0000 7fbd25913640 1 -- 172.21.15.44:0/1315715135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd180094d0 con 0x7fbd20153e60 2023-11-04T01:39:13.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.375+0000 7fbd25913640 1 --2- 172.21.15.44:0/1315715135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd20153e60 0x7fbd200c9ed0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c007e10 tx=0x7fbd1c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.375+0000 7fbd15ffb640 1 -- 172.21.15.44:0/1315715135 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c003b90 con 0x7fbd20153e60 2023-11-04T01:39:13.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.375+0000 7fbd15ffb640 1 -- 172.21.15.44:0/1315715135 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c00f040 con 0x7fbd20153e60 2023-11-04T01:39:13.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.375+0000 7fbd15ffb640 1 -- 172.21.15.44:0/1315715135 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c00de80 con 0x7fbd20153e60 2023-11-04T01:39:13.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.375+0000 7fbd27376640 1 -- 172.21.15.44:0/1315715135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2014df10 con 0x7fbd20153e60 2023-11-04T01:39:13.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.376+0000 7fbd27376640 1 -- 172.21.15.44:0/1315715135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd200cca90 con 0x7fbd20153e60 2023-11-04T01:39:13.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.377+0000 7fbd27376640 1 -- 172.21.15.44:0/1315715135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd200cdcd0 con 0x7fbd20153e60 2023-11-04T01:39:13.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.377+0000 7fbd15ffb640 1 -- 172.21.15.44:0/1315715135 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd1c004030 con 0x7fbd20153e60 2023-11-04T01:39:13.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.377+0000 7fbd15ffb640 1 --2- 172.21.15.44:0/1315715135 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbd0406ae70 0x7fbd0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.377+0000 7fbd15ffb640 1 -- 172.21.15.44:0/1315715135 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fbd1c089e70 con 0x7fbd20153e60 2023-11-04T01:39:13.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.378+0000 7fbd25112640 1 --2- 172.21.15.44:0/1315715135 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbd0406ae70 0x7fbd0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.378+0000 7fbd25112640 1 --2- 172.21.15.44:0/1315715135 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbd0406ae70 0x7fbd0406d330 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbd18036000 tx=0x7fbd1803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.382+0000 7fbd15ffb640 1 -- 172.21.15.44:0/1315715135 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd1c0549d0 con 0x7fbd20153e60 2023-11-04T01:39:13.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.559+0000 7fbd27376640 1 -- 172.21.15.44:0/1315715135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd20074290 con 0x7fbd20153e60 2023-11-04T01:39:13.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.559+0000 7fbd15ffb640 1 -- 172.21.15.44:0/1315715135 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd1c01a020 con 0x7fbd20153e60 2023-11-04T01:39:13.562 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:39:13.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.561+0000 7fbd27376640 1 -- 172.21.15.44:0/1315715135 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbd0406ae70 msgr2=0x7fbd0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.561+0000 7fbd27376640 1 --2- 172.21.15.44:0/1315715135 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbd0406ae70 0x7fbd0406d330 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbd18036000 tx=0x7fbd1803c040 comp rx=0 tx=0).stop 2023-11-04T01:39:13.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.561+0000 7fbd27376640 1 -- 172.21.15.44:0/1315715135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd20153e60 msgr2=0x7fbd200c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.561+0000 7fbd27376640 1 --2- 172.21.15.44:0/1315715135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd20153e60 0x7fbd200c9ed0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c007e10 tx=0x7fbd1c00d4a0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.561+0000 7fbd27376640 1 -- 172.21.15.44:0/1315715135 shutdown_connections 2023-11-04T01:39:13.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.561+0000 7fbd27376640 1 --2- 172.21.15.44:0/1315715135 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbd0406ae70 0x7fbd0406d330 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.561+0000 7fbd27376640 1 --2- 172.21.15.44:0/1315715135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd20153e60 0x7fbd200c9ed0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.561+0000 7fbd27376640 1 --2- 172.21.15.44:0/1315715135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd200cd6d0 0x7fbd200b7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.561+0000 7fbd27376640 1 --2- 172.21.15.44:0/1315715135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd200b4880 0x7fbd200b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.561+0000 7fbd27376640 1 -- 172.21.15.44:0/1315715135 >> 172.21.15.44:0/1315715135 conn(0x7fbd200cf880 msgr2=0x7fbd200c9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:13.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.561+0000 7fbd27376640 1 -- 172.21.15.44:0/1315715135 shutdown_connections 2023-11-04T01:39:13.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.561+0000 7fbd27376640 1 -- 172.21.15.44:0/1315715135 wait complete. 2023-11-04T01:39:13.574 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:39:13.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.682+0000 7f8821832640 1 Processor -- start 2023-11-04T01:39:13.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.682+0000 7f8821832640 1 -- start start 2023-11-04T01:39:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.682+0000 7f8821832640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f881c0b2d30 0x7f881c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.682+0000 7f8821832640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881c06ca40 con 0x7f881c160430 2023-11-04T01:39:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.682+0000 7f8821832640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881c06cd20 con 0x7f881c06c1d0 2023-11-04T01:39:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.683+0000 7f8821832640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881c0cb580 con 0x7f881c0b2d30 2023-11-04T01:39:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.683+0000 7f8813fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f881c0b2d30 0x7f881c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.683+0000 7f8813fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f881c0b2d30 0x7f881c06bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55170/0 (socket says 172.21.15.44:55170) 2023-11-04T01:39:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.683+0000 7f8813fff640 1 -- 172.21.15.44:0/1598083741 learned_addr learned my addr 172.21.15.44:0/1598083741 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:13.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.683+0000 7f881affd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f881c160430 0x7f881c0b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37648/0 (socket says 172.21.15.44:37648) 2023-11-04T01:39:13.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.683+0000 7f8813fff640 1 -- 172.21.15.44:0/1598083741 >> v1:172.21.15.204:6789/0 conn(0x7f881c06c1d0 legacy=0x7f881c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:13.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.683+0000 7f8813fff640 1 -- 172.21.15.44:0/1598083741 >> v1:172.21.15.44:6789/0 conn(0x7f881c160430 legacy=0x7f881c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.683+0000 7f8813fff640 1 -- 172.21.15.44:0/1598083741 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c06d000 con 0x7f881c0b2d30 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.684+0000 7f8813fff640 1 --2- 172.21.15.44:0/1598083741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f881c0b2d30 0x7f881c06bc90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f88040098a0 tx=0x7f880402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea425ec42db17315 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.684+0000 7f881a7fc640 1 -- 172.21.15.44:0/1598083741 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804030840 con 0x7f881c0b2d30 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.684+0000 7f881a7fc640 1 -- 172.21.15.44:0/1598083741 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88040309a0 con 0x7f881c0b2d30 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.684+0000 7f881a7fc640 1 -- 172.21.15.44:0/1598083741 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804030d30 con 0x7f881c0b2d30 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.684+0000 7f8821832640 1 -- 172.21.15.44:0/1598083741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f881c0b2d30 msgr2=0x7f881c06bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.684+0000 7f8821832640 1 --2- 172.21.15.44:0/1598083741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f881c0b2d30 0x7f881c06bc90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f88040098a0 tx=0x7f880402b980 comp rx=0 tx=0).stop 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.684+0000 7f8821832640 1 -- 172.21.15.44:0/1598083741 shutdown_connections 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.684+0000 7f8821832640 1 --2- 172.21.15.44:0/1598083741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f881c0b2d30 0x7f881c06bc90 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.684+0000 7f8821832640 1 -- 172.21.15.44:0/1598083741 >> 172.21.15.44:0/1598083741 conn(0x7f881c06ea20 msgr2=0x7f881c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:13.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.685+0000 7f8821832640 1 -- 172.21.15.44:0/1598083741 shutdown_connections 2023-11-04T01:39:13.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.685+0000 7f8821832640 1 -- 172.21.15.44:0/1598083741 wait complete. 2023-11-04T01:39:13.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.686+0000 7f8821832640 1 Processor -- start 2023-11-04T01:39:13.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.686+0000 7f8821832640 1 -- start start 2023-11-04T01:39:13.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.686+0000 7f8821832640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f881c06c1d0 0x7f881c1f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.686+0000 7f8821832640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f881c0b2d30 0x7f881c0b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.686+0000 7f8821832640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f881c160430 0x7f881c0c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.686+0000 7f8821832640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c0c7c70 con 0x7f881c160430 2023-11-04T01:39:13.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.686+0000 7f8821832640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c1f68c0 con 0x7f881c06c1d0 2023-11-04T01:39:13.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.686+0000 7f8821832640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c1f6ba0 con 0x7f881c0b2d30 2023-11-04T01:39:13.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.686+0000 7f881b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f881c160430 0x7f881c0c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.687+0000 7f881b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f881c160430 0x7f881c0c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55174/0 (socket says 172.21.15.44:55174) 2023-11-04T01:39:13.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.687+0000 7f881b7fe640 1 -- 172.21.15.44:0/981176284 learned_addr learned my addr 172.21.15.44:0/981176284 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:13.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.687+0000 7f881affd640 1 --2- 172.21.15.44:0/981176284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f881c06c1d0 0x7f881c1f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.687+0000 7f8813fff640 1 --2- 172.21.15.44:0/981176284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f881c0b2d30 0x7f881c0b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.687+0000 7f881b7fe640 1 -- 172.21.15.44:0/981176284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f881c0b2d30 msgr2=0x7f881c0b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.687+0000 7f881b7fe640 1 --2- 172.21.15.44:0/981176284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f881c0b2d30 0x7f881c0b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.687+0000 7f881b7fe640 1 -- 172.21.15.44:0/981176284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f881c06c1d0 msgr2=0x7f881c1f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.687+0000 7f881b7fe640 1 --2- 172.21.15.44:0/981176284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f881c06c1d0 0x7f881c1f6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.687+0000 7f881b7fe640 1 -- 172.21.15.44:0/981176284 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88040094d0 con 0x7f881c160430 2023-11-04T01:39:13.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.687+0000 7f881b7fe640 1 --2- 172.21.15.44:0/981176284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f881c160430 0x7f881c0c8430 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f881400c780 tx=0x7f881400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.687+0000 7f8818ff9640 1 -- 172.21.15.44:0/981176284 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8814004b60 con 0x7f881c160430 2023-11-04T01:39:13.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.687+0000 7f8818ff9640 1 -- 172.21.15.44:0/981176284 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881400ce90 con 0x7f881c160430 2023-11-04T01:39:13.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.687+0000 7f8818ff9640 1 -- 172.21.15.44:0/981176284 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881400a850 con 0x7f881c160430 2023-11-04T01:39:13.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.687+0000 7f8821832640 1 -- 172.21.15.44:0/981176284 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c1f6e80 con 0x7f881c160430 2023-11-04T01:39:13.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.687+0000 7f8821832640 1 -- 172.21.15.44:0/981176284 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c1f65b0 con 0x7f881c160430 2023-11-04T01:39:13.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.688+0000 7f8821832640 1 -- 172.21.15.44:0/981176284 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881c0c8150 con 0x7f881c160430 2023-11-04T01:39:13.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.689+0000 7f8818ff9640 1 -- 172.21.15.44:0/981176284 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f881400a9b0 con 0x7f881c160430 2023-11-04T01:39:13.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.689+0000 7f8818ff9640 1 --2- 172.21.15.44:0/981176284 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87fc06aea0 0x7f87fc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.689+0000 7f8818ff9640 1 -- 172.21.15.44:0/981176284 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f8814089bc0 con 0x7f881c160430 2023-11-04T01:39:13.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.689+0000 7f881affd640 1 --2- 172.21.15.44:0/981176284 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87fc06aea0 0x7f87fc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.690+0000 7f881affd640 1 --2- 172.21.15.44:0/981176284 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87fc06aea0 0x7f87fc06d360 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f880c000f60 tx=0x7f880c000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.693+0000 7f8818ff9640 1 -- 172.21.15.44:0/981176284 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f881c0c8150 con 0x7f881c160430 2023-11-04T01:39:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.867+0000 7f8821832640 1 -- 172.21.15.44:0/981176284 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f881c0c8150 con 0x7f881c160430 2023-11-04T01:39:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.867+0000 7f8818ff9640 1 -- 172.21.15.44:0/981176284 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v85) v1 ==== 103+0+11 (secure 0 0 0) 0x7f881c0c8150 con 0x7f881c160430 2023-11-04T01:39:13.869 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:39:13.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.869+0000 7f8821832640 1 -- 172.21.15.44:0/981176284 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87fc06aea0 msgr2=0x7f87fc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.869+0000 7f8821832640 1 --2- 172.21.15.44:0/981176284 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87fc06aea0 0x7f87fc06d360 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f880c000f60 tx=0x7f880c000ed0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.869+0000 7f8821832640 1 -- 172.21.15.44:0/981176284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f881c160430 msgr2=0x7f881c0c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.869+0000 7f8821832640 1 --2- 172.21.15.44:0/981176284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f881c160430 0x7f881c0c8430 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f881400c780 tx=0x7f881400cc40 comp rx=0 tx=0).stop 2023-11-04T01:39:13.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.869+0000 7f8821832640 1 -- 172.21.15.44:0/981176284 shutdown_connections 2023-11-04T01:39:13.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.869+0000 7f8821832640 1 --2- 172.21.15.44:0/981176284 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87fc06aea0 0x7f87fc06d360 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.869+0000 7f8821832640 1 --2- 172.21.15.44:0/981176284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f881c160430 0x7f881c0c8430 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.869+0000 7f8821832640 1 --2- 172.21.15.44:0/981176284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f881c0b2d30 0x7f881c0b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.869+0000 7f8821832640 1 --2- 172.21.15.44:0/981176284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f881c06c1d0 0x7f881c1f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.869+0000 7f8821832640 1 -- 172.21.15.44:0/981176284 >> 172.21.15.44:0/981176284 conn(0x7f881c06ea20 msgr2=0x7f881c0cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:13.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.869+0000 7f8821832640 1 -- 172.21.15.44:0/981176284 shutdown_connections 2023-11-04T01:39:13.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.869+0000 7f8821832640 1 -- 172.21.15.44:0/981176284 wait complete. 2023-11-04T01:39:13.882 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:39:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.989+0000 7fcc3ffce640 1 Processor -- start 2023-11-04T01:39:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.989+0000 7fcc3ffce640 1 -- start start 2023-11-04T01:39:13.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.990+0000 7fcc3ffce640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcc380cd6d0 0x7fcc38161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.990+0000 7fcc3ffce640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc380b4880 0x7fcc380b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.990+0000 7fcc3ffce640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc380cde60 con 0x7fcc38153e60 2023-11-04T01:39:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.990+0000 7fcc3ffce640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc38160f90 con 0x7fcc380cd6d0 2023-11-04T01:39:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.990+0000 7fcc3ffce640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc38161960 con 0x7fcc380b4880 2023-11-04T01:39:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.990+0000 7fcc3d569640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcc380cd6d0 0x7fcc38161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.990+0000 7fcc3dd6a640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcc38153e60 0x7fcc3815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37658/0 (socket says 172.21.15.44:37658) 2023-11-04T01:39:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.990+0000 7fcc3dd6a640 1 -- 172.21.15.44:0/1847780607 learned_addr learned my addr 172.21.15.44:0/1847780607 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.990+0000 7fcc3d569640 1 -- 172.21.15.44:0/1847780607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc380b4880 msgr2=0x7fcc380b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.990+0000 7fcc3e56b640 1 --2- 172.21.15.44:0/1847780607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc380b4880 0x7fcc380b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.991+0000 7fcc3d569640 1 --2- 172.21.15.44:0/1847780607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc380b4880 0x7fcc380b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.991+0000 7fcc3cd68640 1 -- 172.21.15.44:0/1847780607 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764463447 0 0) 0x7fcc380cde60 con 0x7fcc38153e60 2023-11-04T01:39:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.991+0000 7fcc3d569640 1 -- 172.21.15.44:0/1847780607 >> v1:172.21.15.44:6789/0 conn(0x7fcc38153e60 legacy=0x7fcc3815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.991+0000 7fcc3d569640 1 -- 172.21.15.44:0/1847780607 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc380b5220 con 0x7fcc380cd6d0 2023-11-04T01:39:13.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.991+0000 7fcc3e56b640 1 --2- 172.21.15.44:0/1847780607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc380b4880 0x7fcc380b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:13.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.991+0000 7fcc3d569640 1 --2- 172.21.15.44:0/1847780607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc380cd6d0 0x7fcc38161420 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0097a0 tx=0x7fcc2c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5068aeb6cfab7efa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.991+0000 7fcc3cd68640 1 -- 172.21.15.44:0/1847780607 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c031830 con 0x7fcc380cd6d0 2023-11-04T01:39:13.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.991+0000 7fcc3cd68640 1 -- 172.21.15.44:0/1847780607 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c031990 con 0x7fcc380cd6d0 2023-11-04T01:39:13.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.991+0000 7fcc3cd68640 1 -- 172.21.15.44:0/1847780607 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c031d20 con 0x7fcc380cd6d0 2023-11-04T01:39:13.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.992+0000 7fcc3ffce640 1 -- 172.21.15.44:0/1847780607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc380cd6d0 msgr2=0x7fcc38161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.992+0000 7fcc3ffce640 1 --2- 172.21.15.44:0/1847780607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc380cd6d0 0x7fcc38161420 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0097a0 tx=0x7fcc2c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.995 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.992+0000 7fcc3ffce640 1 -- 172.21.15.44:0/1847780607 shutdown_connections 2023-11-04T01:39:13.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.992+0000 7fcc3ffce640 1 --2- 172.21.15.44:0/1847780607 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc380b4880 0x7fcc380b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.992+0000 7fcc3ffce640 1 --2- 172.21.15.44:0/1847780607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc380cd6d0 0x7fcc38161420 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.992+0000 7fcc3ffce640 1 -- 172.21.15.44:0/1847780607 >> 172.21.15.44:0/1847780607 conn(0x7fcc380cf880 msgr2=0x7fcc380cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:13.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.992+0000 7fcc3ffce640 1 -- 172.21.15.44:0/1847780607 shutdown_connections 2023-11-04T01:39:13.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.992+0000 7fcc3ffce640 1 -- 172.21.15.44:0/1847780607 wait complete. 2023-11-04T01:39:13.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.993+0000 7fcc3ffce640 1 Processor -- start 2023-11-04T01:39:13.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.993+0000 7fcc3ffce640 1 -- start start 2023-11-04T01:39:13.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3ffce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc380b4880 0x7fcc38153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3ffce640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc380cd6d0 0x7fcc380cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3ffce640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc38153e60 0x7fcc3815f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3ffce640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3815a7f0 con 0x7fcc380b4880 2023-11-04T01:39:13.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3ffce640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc38154240 con 0x7fcc38153e60 2023-11-04T01:39:13.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3ffce640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc381f2780 con 0x7fcc380cd6d0 2023-11-04T01:39:13.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3dd6a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc380b4880 0x7fcc38153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3dd6a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc380b4880 0x7fcc38153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55202/0 (socket says 172.21.15.44:55202) 2023-11-04T01:39:13.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3dd6a640 1 -- 172.21.15.44:0/686109353 learned_addr learned my addr 172.21.15.44:0/686109353 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:13.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3d569640 1 --2- 172.21.15.44:0/686109353 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc380cd6d0 0x7fcc380cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3e56b640 1 --2- 172.21.15.44:0/686109353 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc38153e60 0x7fcc3815f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3dd6a640 1 -- 172.21.15.44:0/686109353 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc380cd6d0 msgr2=0x7fcc380cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3dd6a640 1 --2- 172.21.15.44:0/686109353 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc380cd6d0 0x7fcc380cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3dd6a640 1 -- 172.21.15.44:0/686109353 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc38153e60 msgr2=0x7fcc3815f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3dd6a640 1 --2- 172.21.15.44:0/686109353 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc38153e60 0x7fcc3815f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3dd6a640 1 -- 172.21.15.44:0/686109353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c009400 con 0x7fcc380b4880 2023-11-04T01:39:13.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.994+0000 7fcc3e56b640 1 --2- 172.21.15.44:0/686109353 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc38153e60 0x7fcc3815f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:13.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.995+0000 7fcc3dd6a640 1 --2- 172.21.15.44:0/686109353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc380b4880 0x7fcc38153170 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000c430 tx=0x7fcc3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.995+0000 7fcc367fc640 1 -- 172.21.15.44:0/686109353 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc300074e0 con 0x7fcc380b4880 2023-11-04T01:39:13.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.995+0000 7fcc367fc640 1 -- 172.21.15.44:0/686109353 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc30007660 con 0x7fcc380b4880 2023-11-04T01:39:13.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.995+0000 7fcc3ffce640 1 -- 172.21.15.44:0/686109353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc381f2a60 con 0x7fcc380b4880 2023-11-04T01:39:13.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.995+0000 7fcc367fc640 1 -- 172.21.15.44:0/686109353 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30004a20 con 0x7fcc380b4880 2023-11-04T01:39:13.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.995+0000 7fcc3ffce640 1 -- 172.21.15.44:0/686109353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc381f3020 con 0x7fcc380b4880 2023-11-04T01:39:14.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.996+0000 7fcc3ffce640 1 -- 172.21.15.44:0/686109353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc38074290 con 0x7fcc380b4880 2023-11-04T01:39:14.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.996+0000 7fcc367fc640 1 -- 172.21.15.44:0/686109353 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc30004b80 con 0x7fcc380b4880 2023-11-04T01:39:14.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.996+0000 7fcc367fc640 1 --2- 172.21.15.44:0/686109353 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcc2406ae70 0x7fcc2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.997+0000 7fcc367fc640 1 -- 172.21.15.44:0/686109353 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fcc300899e0 con 0x7fcc380b4880 2023-11-04T01:39:14.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.997+0000 7fcc3d569640 1 --2- 172.21.15.44:0/686109353 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcc2406ae70 0x7fcc2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:13.997+0000 7fcc3d569640 1 --2- 172.21.15.44:0/686109353 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcc2406ae70 0x7fcc2406d330 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c036000 tx=0x7fcc2c03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.001+0000 7fcc367fc640 1 -- 172.21.15.44:0/686109353 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcc300544f0 con 0x7fcc380b4880 2023-11-04T01:39:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.181+0000 7fcc3ffce640 1 -- 172.21.15.44:0/686109353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fcc380d0b80 con 0x7fcc380b4880 2023-11-04T01:39:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.181+0000 7fcc367fc640 1 -- 172.21.15.44:0/686109353 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v85) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcc30057b10 con 0x7fcc380b4880 2023-11-04T01:39:14.184 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.184+0000 7fcc3ffce640 1 -- 172.21.15.44:0/686109353 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcc2406ae70 msgr2=0x7fcc2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.184+0000 7fcc3ffce640 1 --2- 172.21.15.44:0/686109353 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcc2406ae70 0x7fcc2406d330 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c036000 tx=0x7fcc2c03c040 comp rx=0 tx=0).stop 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.184+0000 7fcc3ffce640 1 -- 172.21.15.44:0/686109353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc380b4880 msgr2=0x7fcc38153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.184+0000 7fcc3ffce640 1 --2- 172.21.15.44:0/686109353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc380b4880 0x7fcc38153170 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000c430 tx=0x7fcc3000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.184+0000 7fcc3ffce640 1 -- 172.21.15.44:0/686109353 shutdown_connections 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.184+0000 7fcc3ffce640 1 --2- 172.21.15.44:0/686109353 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcc2406ae70 0x7fcc2406d330 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.184+0000 7fcc3ffce640 1 --2- 172.21.15.44:0/686109353 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc38153e60 0x7fcc3815f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.184+0000 7fcc3ffce640 1 --2- 172.21.15.44:0/686109353 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc380cd6d0 0x7fcc380cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.184+0000 7fcc3ffce640 1 --2- 172.21.15.44:0/686109353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc380b4880 0x7fcc38153170 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.184+0000 7fcc3ffce640 1 -- 172.21.15.44:0/686109353 >> 172.21.15.44:0/686109353 conn(0x7fcc380cf880 msgr2=0x7fcc380d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.184+0000 7fcc3ffce640 1 -- 172.21.15.44:0/686109353 shutdown_connections 2023-11-04T01:39:14.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.184+0000 7fcc3ffce640 1 -- 172.21.15.44:0/686109353 wait complete. 2023-11-04T01:39:14.197 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:39:14.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.306+0000 7fea5e0ec640 1 Processor -- start 2023-11-04T01:39:14.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.306+0000 7fea5e0ec640 1 -- start start 2023-11-04T01:39:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.306+0000 7fea5e0ec640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fea580cd6d0 0x7fea58161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.306+0000 7fea5e0ec640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea580b4880 0x7fea580b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.306+0000 7fea5e0ec640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea580cde60 con 0x7fea58153e60 2023-11-04T01:39:14.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.306+0000 7fea5e0ec640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea58160f90 con 0x7fea580cd6d0 2023-11-04T01:39:14.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.306+0000 7fea5e0ec640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea58161960 con 0x7fea580b4880 2023-11-04T01:39:14.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.307+0000 7fea577fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fea58153e60 0x7fea5815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37668/0 (socket says 172.21.15.44:37668) 2023-11-04T01:39:14.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.307+0000 7fea577fe640 1 -- 172.21.15.44:0/3519637170 learned_addr learned my addr 172.21.15.44:0/3519637170 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:14.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.307+0000 7fea57fff640 1 --2- 172.21.15.44:0/3519637170 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea580b4880 0x7fea580b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.307+0000 7fea56ffd640 1 --2- 172.21.15.44:0/3519637170 >> v2:172.21.15.204:3300/0 conn(0x7fea580cd6d0 0x7fea58161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.307+0000 7fea567fc640 1 -- 172.21.15.44:0/3519637170 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14464442 0 0) 0x7fea580cde60 con 0x7fea58153e60 2023-11-04T01:39:14.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.307+0000 7fea567fc640 1 -- 172.21.15.44:0/3519637170 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea40003520 con 0x7fea58153e60 2023-11-04T01:39:14.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.307+0000 7fea567fc640 1 -- 172.21.15.44:0/3519637170 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3962212364 0 0) 0x7fea40003520 con 0x7fea58153e60 2023-11-04T01:39:14.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.307+0000 7fea56ffd640 1 -- 172.21.15.44:0/3519637170 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea580b4880 msgr2=0x7fea580b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:14.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.307+0000 7fea56ffd640 1 --2- 172.21.15.44:0/3519637170 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea580b4880 0x7fea580b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.307+0000 7fea56ffd640 1 -- 172.21.15.44:0/3519637170 >> v1:172.21.15.44:6789/0 conn(0x7fea58153e60 legacy=0x7fea5815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.307+0000 7fea56ffd640 1 -- 172.21.15.44:0/3519637170 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea580b5220 con 0x7fea580cd6d0 2023-11-04T01:39:14.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.307+0000 7fea57fff640 1 --2- 172.21.15.44:0/3519637170 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea580b4880 0x7fea580b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:14.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.308+0000 7fea56ffd640 1 --2- 172.21.15.44:0/3519637170 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea580cd6d0 0x7fea58161420 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0097a0 tx=0x7fea4c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=199cc4859fe1bca9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.308+0000 7fea567fc640 1 -- 172.21.15.44:0/3519637170 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea48001670 con 0x7fea580cd6d0 2023-11-04T01:39:14.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.308+0000 7fea567fc640 1 -- 172.21.15.44:0/3519637170 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c02e050 con 0x7fea580cd6d0 2023-11-04T01:39:14.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.308+0000 7fea567fc640 1 -- 172.21.15.44:0/3519637170 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c030710 con 0x7fea580cd6d0 2023-11-04T01:39:14.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.309+0000 7fea5e0ec640 1 -- 172.21.15.44:0/3519637170 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea580cd6d0 msgr2=0x7fea58161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.309+0000 7fea5e0ec640 1 --2- 172.21.15.44:0/3519637170 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea580cd6d0 0x7fea58161420 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0097a0 tx=0x7fea4c02b790 comp rx=0 tx=0).stop 2023-11-04T01:39:14.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.309+0000 7fea5e0ec640 1 -- 172.21.15.44:0/3519637170 shutdown_connections 2023-11-04T01:39:14.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.309+0000 7fea5e0ec640 1 --2- 172.21.15.44:0/3519637170 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea580b4880 0x7fea580b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.309+0000 7fea5e0ec640 1 --2- 172.21.15.44:0/3519637170 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea580cd6d0 0x7fea58161420 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.309+0000 7fea5e0ec640 1 -- 172.21.15.44:0/3519637170 >> 172.21.15.44:0/3519637170 conn(0x7fea580cf880 msgr2=0x7fea580cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.309+0000 7fea5e0ec640 1 -- 172.21.15.44:0/3519637170 shutdown_connections 2023-11-04T01:39:14.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.309+0000 7fea5e0ec640 1 -- 172.21.15.44:0/3519637170 wait complete. 2023-11-04T01:39:14.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.310+0000 7fea5e0ec640 1 Processor -- start 2023-11-04T01:39:14.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.310+0000 7fea5e0ec640 1 -- start start 2023-11-04T01:39:14.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea5e0ec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea580b4880 0x7fea58158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea5e0ec640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea580cd6d0 0x7fea58159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea5e0ec640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea58153e60 0x7fea58152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea5e0ec640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea58159f50 con 0x7fea580b4880 2023-11-04T01:39:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea5e0ec640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5815a420 con 0x7fea580cd6d0 2023-11-04T01:39:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea5e0ec640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea581587a0 con 0x7fea58153e60 2023-11-04T01:39:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea577fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea580b4880 0x7fea58158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea577fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea580b4880 0x7fea58158130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55206/0 (socket says 172.21.15.44:55206) 2023-11-04T01:39:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea577fe640 1 -- 172.21.15.44:0/3394417823 learned_addr learned my addr 172.21.15.44:0/3394417823 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea56ffd640 1 --2- 172.21.15.44:0/3394417823 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea580cd6d0 0x7fea58159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea57fff640 1 --2- 172.21.15.44:0/3394417823 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea58153e60 0x7fea58152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea577fe640 1 -- 172.21.15.44:0/3394417823 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea58153e60 msgr2=0x7fea58152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea577fe640 1 --2- 172.21.15.44:0/3394417823 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea58153e60 0x7fea58152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea577fe640 1 -- 172.21.15.44:0/3394417823 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea580cd6d0 msgr2=0x7fea58159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea577fe640 1 --2- 172.21.15.44:0/3394417823 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea580cd6d0 0x7fea58159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.311+0000 7fea577fe640 1 -- 172.21.15.44:0/3394417823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea50009a70 con 0x7fea580b4880 2023-11-04T01:39:14.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.312+0000 7fea577fe640 1 --2- 172.21.15.44:0/3394417823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea580b4880 0x7fea58158130 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fea4800c750 tx=0x7fea4800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.312+0000 7fea3ffff640 1 -- 172.21.15.44:0/3394417823 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea48005ad0 con 0x7fea580b4880 2023-11-04T01:39:14.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.312+0000 7fea3ffff640 1 -- 172.21.15.44:0/3394417823 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea48005c30 con 0x7fea580b4880 2023-11-04T01:39:14.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.312+0000 7fea5e0ec640 1 -- 172.21.15.44:0/3394417823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4c009400 con 0x7fea580b4880 2023-11-04T01:39:14.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.312+0000 7fea3ffff640 1 -- 172.21.15.44:0/3394417823 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea48007070 con 0x7fea580b4880 2023-11-04T01:39:14.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.312+0000 7fea5e0ec640 1 -- 172.21.15.44:0/3394417823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea58158d60 con 0x7fea580b4880 2023-11-04T01:39:14.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.313+0000 7fea5e0ec640 1 -- 172.21.15.44:0/3394417823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea58074290 con 0x7fea580b4880 2023-11-04T01:39:14.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.313+0000 7fea3ffff640 1 -- 172.21.15.44:0/3394417823 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea480071d0 con 0x7fea580b4880 2023-11-04T01:39:14.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.314+0000 7fea3ffff640 1 --2- 172.21.15.44:0/3394417823 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fea4406ae70 0x7fea4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.314+0000 7fea3ffff640 1 -- 172.21.15.44:0/3394417823 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fea48089370 con 0x7fea580b4880 2023-11-04T01:39:14.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.314+0000 7fea56ffd640 1 --2- 172.21.15.44:0/3394417823 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fea4406ae70 0x7fea4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.314+0000 7fea56ffd640 1 --2- 172.21.15.44:0/3394417823 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fea4406ae70 0x7fea4406d330 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fea4c034000 tx=0x7fea4c02f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.318+0000 7fea3ffff640 1 -- 172.21.15.44:0/3394417823 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fea48053e90 con 0x7fea580b4880 2023-11-04T01:39:14.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.492+0000 7fea5e0ec640 1 -- 172.21.15.44:0/3394417823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fea580d0b80 con 0x7fea580b4880 2023-11-04T01:39:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.493+0000 7fea3ffff640 1 -- 172.21.15.44:0/3394417823 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fea480574b0 con 0x7fea580b4880 2023-11-04T01:39:14.495 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:39:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.495+0000 7fea5e0ec640 1 -- 172.21.15.44:0/3394417823 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fea4406ae70 msgr2=0x7fea4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.495+0000 7fea5e0ec640 1 --2- 172.21.15.44:0/3394417823 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fea4406ae70 0x7fea4406d330 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fea4c034000 tx=0x7fea4c02f000 comp rx=0 tx=0).stop 2023-11-04T01:39:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.495+0000 7fea5e0ec640 1 -- 172.21.15.44:0/3394417823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea580b4880 msgr2=0x7fea58158130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.495+0000 7fea5e0ec640 1 --2- 172.21.15.44:0/3394417823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea580b4880 0x7fea58158130 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fea4800c750 tx=0x7fea4800cc10 comp rx=0 tx=0).stop 2023-11-04T01:39:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.495+0000 7fea5e0ec640 1 -- 172.21.15.44:0/3394417823 shutdown_connections 2023-11-04T01:39:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.495+0000 7fea5e0ec640 1 --2- 172.21.15.44:0/3394417823 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fea4406ae70 0x7fea4406d330 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.495+0000 7fea5e0ec640 1 --2- 172.21.15.44:0/3394417823 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea58153e60 0x7fea58152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.495+0000 7fea5e0ec640 1 --2- 172.21.15.44:0/3394417823 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea580cd6d0 0x7fea58159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.495+0000 7fea5e0ec640 1 --2- 172.21.15.44:0/3394417823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea580b4880 0x7fea58158130 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.495+0000 7fea5e0ec640 1 -- 172.21.15.44:0/3394417823 >> 172.21.15.44:0/3394417823 conn(0x7fea580cf880 msgr2=0x7fea580d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.495+0000 7fea5e0ec640 1 -- 172.21.15.44:0/3394417823 shutdown_connections 2023-11-04T01:39:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.495+0000 7fea5e0ec640 1 -- 172.21.15.44:0/3394417823 wait complete. 2023-11-04T01:39:14.508 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:39:14.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.614+0000 7fd4ee0c2640 1 Processor -- start 2023-11-04T01:39:14.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.614+0000 7fd4ee0c2640 1 -- start start 2023-11-04T01:39:14.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4ee0c2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4e8160430 0x7fd4e80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4ee0c2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd4e806c3a0 0x7fd4e80cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4ee0c2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e80b2fc0 con 0x7fd4e80b2b60 2023-11-04T01:39:14.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4ee0c2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e80cb580 con 0x7fd4e806c3a0 2023-11-04T01:39:14.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4ee0c2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e806ca40 con 0x7fd4e8160430 2023-11-04T01:39:14.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4e7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd4e806c3a0 0x7fd4e80cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4e7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd4e806c3a0 0x7fd4e80cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55208/0 (socket says 172.21.15.44:55208) 2023-11-04T01:39:14.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4e6ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd4e80b2b60 0x7fd4e806bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37680/0 (socket says 172.21.15.44:37680) 2023-11-04T01:39:14.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4e7fff640 1 -- 172.21.15.44:0/889659667 learned_addr learned my addr 172.21.15.44:0/889659667 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:14.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4e77fe640 1 --2- 172.21.15.44:0/889659667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4e8160430 0x7fd4e80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4e7fff640 1 -- 172.21.15.44:0/889659667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4e8160430 msgr2=0x7fd4e80b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:14.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4e7fff640 1 --2- 172.21.15.44:0/889659667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4e8160430 0x7fd4e80b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4e7fff640 1 -- 172.21.15.44:0/889659667 >> v1:172.21.15.44:6789/0 conn(0x7fd4e80b2b60 legacy=0x7fd4e806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4e7fff640 1 -- 172.21.15.44:0/889659667 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e806c810 con 0x7fd4e806c3a0 2023-11-04T01:39:14.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4e67fc640 1 -- 172.21.15.44:0/889659667 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348274232 0 0) 0x7fd4e80b2fc0 con 0x7fd4e80b2b60 2023-11-04T01:39:14.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.615+0000 7fd4e77fe640 1 --2- 172.21.15.44:0/889659667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4e8160430 0x7fd4e80b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:14.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.616+0000 7fd4e7fff640 1 --2- 172.21.15.44:0/889659667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4e806c3a0 0x7fd4e80cbcb0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009e50 tx=0x7fd4e002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910ae0fa7e489ee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.616+0000 7fd4e67fc640 1 -- 172.21.15.44:0/889659667 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e002cb00 con 0x7fd4e806c3a0 2023-11-04T01:39:14.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.616+0000 7fd4e67fc640 1 -- 172.21.15.44:0/889659667 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e002cc60 con 0x7fd4e806c3a0 2023-11-04T01:39:14.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.616+0000 7fd4e67fc640 1 -- 172.21.15.44:0/889659667 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e00343f0 con 0x7fd4e806c3a0 2023-11-04T01:39:14.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.617+0000 7fd4ee0c2640 1 -- 172.21.15.44:0/889659667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4e806c3a0 msgr2=0x7fd4e80cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.617+0000 7fd4ee0c2640 1 --2- 172.21.15.44:0/889659667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4e806c3a0 0x7fd4e80cbcb0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009e50 tx=0x7fd4e002bf60 comp rx=0 tx=0).stop 2023-11-04T01:39:14.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.617+0000 7fd4ee0c2640 1 -- 172.21.15.44:0/889659667 shutdown_connections 2023-11-04T01:39:14.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.617+0000 7fd4ee0c2640 1 --2- 172.21.15.44:0/889659667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4e806c3a0 0x7fd4e80cbcb0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.617+0000 7fd4ee0c2640 1 --2- 172.21.15.44:0/889659667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4e8160430 0x7fd4e80b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.617+0000 7fd4ee0c2640 1 -- 172.21.15.44:0/889659667 >> 172.21.15.44:0/889659667 conn(0x7fd4e806ea20 msgr2=0x7fd4e806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.617+0000 7fd4ee0c2640 1 -- 172.21.15.44:0/889659667 shutdown_connections 2023-11-04T01:39:14.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.617+0000 7fd4ee0c2640 1 -- 172.21.15.44:0/889659667 wait complete. 2023-11-04T01:39:14.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.618+0000 7fd4ee0c2640 1 Processor -- start 2023-11-04T01:39:14.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.618+0000 7fd4ee0c2640 1 -- start start 2023-11-04T01:39:14.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4ee0c2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4e806c3a0 0x7fd4e81f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4ee0c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4e80b2b60 0x7fd4e80ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4ee0c2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4e8160430 0x7fd4e80cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4ee0c2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80c9cc0 con 0x7fd4e80b2b60 2023-11-04T01:39:14.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4ee0c2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80c9fa0 con 0x7fd4e806c3a0 2023-11-04T01:39:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4ee0c2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80ca280 con 0x7fd4e8160430 2023-11-04T01:39:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4e6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4e80b2b60 0x7fd4e80ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4e6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4e80b2b60 0x7fd4e80ccc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55222/0 (socket says 172.21.15.44:55222) 2023-11-04T01:39:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4e6ffd640 1 -- 172.21.15.44:0/2133269758 learned_addr learned my addr 172.21.15.44:0/2133269758 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4e7fff640 1 --2- 172.21.15.44:0/2133269758 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4e8160430 0x7fd4e80cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4e6ffd640 1 -- 172.21.15.44:0/2133269758 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4e8160430 msgr2=0x7fd4e80cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4e6ffd640 1 --2- 172.21.15.44:0/2133269758 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4e8160430 0x7fd4e80cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4e77fe640 1 --2- 172.21.15.44:0/2133269758 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4e806c3a0 0x7fd4e81f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4e6ffd640 1 -- 172.21.15.44:0/2133269758 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4e806c3a0 msgr2=0x7fd4e81f1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4e6ffd640 1 --2- 172.21.15.44:0/2133269758 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4e806c3a0 0x7fd4e81f1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4e6ffd640 1 -- 172.21.15.44:0/2133269758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e0009b30 con 0x7fd4e80b2b60 2023-11-04T01:39:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4e77fe640 1 --2- 172.21.15.44:0/2133269758 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4e806c3a0 0x7fd4e81f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.619+0000 7fd4e6ffd640 1 --2- 172.21.15.44:0/2133269758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4e80b2b60 0x7fd4e80ccc00 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c4d0 tx=0x7fd4dc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.620+0000 7fd4cffff640 1 -- 172.21.15.44:0/2133269758 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0074e0 con 0x7fd4e80b2b60 2023-11-04T01:39:14.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.620+0000 7fd4cffff640 1 -- 172.21.15.44:0/2133269758 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc007660 con 0x7fd4e80b2b60 2023-11-04T01:39:14.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.620+0000 7fd4ee0c2640 1 -- 172.21.15.44:0/2133269758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e80ca560 con 0x7fd4e80b2b60 2023-11-04T01:39:14.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.620+0000 7fd4cffff640 1 -- 172.21.15.44:0/2133269758 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc004a20 con 0x7fd4e80b2b60 2023-11-04T01:39:14.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.620+0000 7fd4ee0c2640 1 -- 172.21.15.44:0/2133269758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e80c9000 con 0x7fd4e80b2b60 2023-11-04T01:39:14.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.621+0000 7fd4ee0c2640 1 -- 172.21.15.44:0/2133269758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e806d400 con 0x7fd4e80b2b60 2023-11-04T01:39:14.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.621+0000 7fd4cffff640 1 -- 172.21.15.44:0/2133269758 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4dc004b80 con 0x7fd4e80b2b60 2023-11-04T01:39:14.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.622+0000 7fd4cffff640 1 --2- 172.21.15.44:0/2133269758 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd4d406ae70 0x7fd4d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.622+0000 7fd4cffff640 1 -- 172.21.15.44:0/2133269758 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fd4dc0890e0 con 0x7fd4e80b2b60 2023-11-04T01:39:14.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.622+0000 7fd4e77fe640 1 --2- 172.21.15.44:0/2133269758 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd4d406ae70 0x7fd4d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.622+0000 7fd4e77fe640 1 --2- 172.21.15.44:0/2133269758 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd4d406ae70 0x7fd4d406d330 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8006fd0 tx=0x7fd4d8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.626+0000 7fd4cffff640 1 -- 172.21.15.44:0/2133269758 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd4dc053bf0 con 0x7fd4e80b2b60 2023-11-04T01:39:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.800+0000 7fd4ee0c2640 1 -- 172.21.15.44:0/2133269758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4e8074290 con 0x7fd4e80b2b60 2023-11-04T01:39:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.800+0000 7fd4cffff640 1 -- 172.21.15.44:0/2133269758 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd4dc018020 con 0x7fd4e80b2b60 2023-11-04T01:39:14.802 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:39:14.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.802+0000 7fd4ee0c2640 1 -- 172.21.15.44:0/2133269758 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd4d406ae70 msgr2=0x7fd4d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.802+0000 7fd4ee0c2640 1 --2- 172.21.15.44:0/2133269758 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd4d406ae70 0x7fd4d406d330 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8006fd0 tx=0x7fd4d8008040 comp rx=0 tx=0).stop 2023-11-04T01:39:14.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.802+0000 7fd4ee0c2640 1 -- 172.21.15.44:0/2133269758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4e80b2b60 msgr2=0x7fd4e80ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.802+0000 7fd4ee0c2640 1 --2- 172.21.15.44:0/2133269758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4e80b2b60 0x7fd4e80ccc00 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c4d0 tx=0x7fd4dc00c990 comp rx=0 tx=0).stop 2023-11-04T01:39:14.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.802+0000 7fd4ee0c2640 1 -- 172.21.15.44:0/2133269758 shutdown_connections 2023-11-04T01:39:14.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.802+0000 7fd4ee0c2640 1 --2- 172.21.15.44:0/2133269758 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd4d406ae70 0x7fd4d406d330 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.802+0000 7fd4ee0c2640 1 --2- 172.21.15.44:0/2133269758 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4e8160430 0x7fd4e80cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.802+0000 7fd4ee0c2640 1 --2- 172.21.15.44:0/2133269758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4e80b2b60 0x7fd4e80ccc00 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.802+0000 7fd4ee0c2640 1 --2- 172.21.15.44:0/2133269758 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4e806c3a0 0x7fd4e81f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.802+0000 7fd4ee0c2640 1 -- 172.21.15.44:0/2133269758 >> 172.21.15.44:0/2133269758 conn(0x7fd4e806ea20 msgr2=0x7fd4e815cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.802+0000 7fd4ee0c2640 1 -- 172.21.15.44:0/2133269758 shutdown_connections 2023-11-04T01:39:14.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.802+0000 7fd4ee0c2640 1 -- 172.21.15.44:0/2133269758 wait complete. 2023-11-04T01:39:14.815 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:39:14.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.922+0000 7f4408397640 1 Processor -- start 2023-11-04T01:39:14.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.922+0000 7f4408397640 1 -- start start 2023-11-04T01:39:14.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.923+0000 7f4408397640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44000b2d30 0x7f440006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.923+0000 7f4408397640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440006ca40 con 0x7f4400160430 2023-11-04T01:39:14.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.923+0000 7f4408397640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440006cd20 con 0x7f440006c1d0 2023-11-04T01:39:14.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.923+0000 7f4408397640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44000cb580 con 0x7f44000b2d30 2023-11-04T01:39:14.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.923+0000 7f4406133640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4400160430 0x7f44000b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37688/0 (socket says 172.21.15.44:37688) 2023-11-04T01:39:14.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.923+0000 7f4406133640 1 -- 172.21.15.44:0/1789446959 learned_addr learned my addr 172.21.15.44:0/1789446959 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:14.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.923+0000 7f4405932640 1 --2- 172.21.15.44:0/1789446959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44000b2d30 0x7f440006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.923+0000 7f4405131640 1 -- 172.21.15.44:0/1789446959 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425024024 0 0) 0x7f440006ca40 con 0x7f4400160430 2023-11-04T01:39:14.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.923+0000 7f4405131640 1 -- 172.21.15.44:0/1789446959 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43ec003520 con 0x7f4400160430 2023-11-04T01:39:14.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.923+0000 7f4405131640 1 -- 172.21.15.44:0/1789446959 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709341343 0 0) 0x7f440006cd20 con 0x7f440006c1d0 2023-11-04T01:39:14.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.923+0000 7f4405131640 1 -- 172.21.15.44:0/1789446959 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f440006ca40 con 0x7f440006c1d0 2023-11-04T01:39:14.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.923+0000 7f4405932640 1 -- 172.21.15.44:0/1789446959 >> v1:172.21.15.204:6789/0 conn(0x7f440006c1d0 legacy=0x7f44000cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.923+0000 7f4405932640 1 -- 172.21.15.44:0/1789446959 >> v1:172.21.15.44:6789/0 conn(0x7f4400160430 legacy=0x7f44000b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.923+0000 7f4405131640 1 -- 172.21.15.44:0/1789446959 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2292078496 0 0) 0x7f43ec003520 con 0x7f4400160430 2023-11-04T01:39:14.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.923+0000 7f4405932640 1 -- 172.21.15.44:0/1789446959 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440006d000 con 0x7f44000b2d30 2023-11-04T01:39:14.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.924+0000 7f4405932640 1 --2- 172.21.15.44:0/1789446959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44000b2d30 0x7f440006bc90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f43f00097d0 tx=0x7f43f002b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50a1131abb576e76 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.924+0000 7f4405131640 1 -- 172.21.15.44:0/1789446959 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc001670 con 0x7f44000b2d30 2023-11-04T01:39:14.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.924+0000 7f4405131640 1 -- 172.21.15.44:0/1789446959 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f002e050 con 0x7f44000b2d30 2023-11-04T01:39:14.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.924+0000 7f4405131640 1 -- 172.21.15.44:0/1789446959 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0030710 con 0x7f44000b2d30 2023-11-04T01:39:14.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.925+0000 7f4408397640 1 -- 172.21.15.44:0/1789446959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44000b2d30 msgr2=0x7f440006bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.925+0000 7f4408397640 1 --2- 172.21.15.44:0/1789446959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44000b2d30 0x7f440006bc90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f43f00097d0 tx=0x7f43f002b800 comp rx=0 tx=0).stop 2023-11-04T01:39:14.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.925+0000 7f4408397640 1 -- 172.21.15.44:0/1789446959 shutdown_connections 2023-11-04T01:39:14.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.925+0000 7f4408397640 1 --2- 172.21.15.44:0/1789446959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44000b2d30 0x7f440006bc90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.925+0000 7f4408397640 1 -- 172.21.15.44:0/1789446959 >> 172.21.15.44:0/1789446959 conn(0x7f440006ea20 msgr2=0x7f440006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.925+0000 7f4408397640 1 -- 172.21.15.44:0/1789446959 shutdown_connections 2023-11-04T01:39:14.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.925+0000 7f4408397640 1 -- 172.21.15.44:0/1789446959 wait complete. 2023-11-04T01:39:14.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.926+0000 7f4408397640 1 Processor -- start 2023-11-04T01:39:14.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.926+0000 7f4408397640 1 -- start start 2023-11-04T01:39:14.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4408397640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f440006c1d0 0x7f44001519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4408397640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44000b2d30 0x7f44000c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4408397640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4400160430 0x7f44000c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4408397640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44000c4c10 con 0x7f4400160430 2023-11-04T01:39:14.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4408397640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44000c6700 con 0x7f440006c1d0 2023-11-04T01:39:14.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4408397640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4400151f10 con 0x7f44000b2d30 2023-11-04T01:39:14.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4406934640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4400160430 0x7f44000c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4406934640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4400160430 0x7f44000c5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55234/0 (socket says 172.21.15.44:55234) 2023-11-04T01:39:14.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4406934640 1 -- 172.21.15.44:0/2389433299 learned_addr learned my addr 172.21.15.44:0/2389433299 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:14.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4405932640 1 --2- 172.21.15.44:0/2389433299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44000b2d30 0x7f44000c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4406133640 1 --2- 172.21.15.44:0/2389433299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f440006c1d0 0x7f44001519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4406934640 1 -- 172.21.15.44:0/2389433299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44000b2d30 msgr2=0x7f44000c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4406934640 1 --2- 172.21.15.44:0/2389433299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44000b2d30 0x7f44000c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4406934640 1 -- 172.21.15.44:0/2389433299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f440006c1d0 msgr2=0x7f44001519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4406934640 1 --2- 172.21.15.44:0/2389433299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f440006c1d0 0x7f44001519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4406934640 1 -- 172.21.15.44:0/2389433299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f0009400 con 0x7f4400160430 2023-11-04T01:39:14.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.927+0000 7f4405932640 1 --2- 172.21.15.44:0/2389433299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44000b2d30 0x7f44000c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:14.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.928+0000 7f4406934640 1 --2- 172.21.15.44:0/2389433299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4400160430 0x7f44000c5030 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f43f800c7c0 tx=0x7f43f800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.928+0000 7f43f6ffd640 1 -- 172.21.15.44:0/2389433299 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f8003b70 con 0x7f4400160430 2023-11-04T01:39:14.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.928+0000 7f43f6ffd640 1 -- 172.21.15.44:0/2389433299 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f8003cd0 con 0x7f4400160430 2023-11-04T01:39:14.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.928+0000 7f4408397640 1 -- 172.21.15.44:0/2389433299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44000c86f0 con 0x7f4400160430 2023-11-04T01:39:14.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.928+0000 7f43f6ffd640 1 -- 172.21.15.44:0/2389433299 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f800aa50 con 0x7f4400160430 2023-11-04T01:39:14.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.928+0000 7f4408397640 1 -- 172.21.15.44:0/2389433299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44000c4830 con 0x7f4400160430 2023-11-04T01:39:14.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.929+0000 7f4408397640 1 -- 172.21.15.44:0/2389433299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44000c4d50 con 0x7f4400160430 2023-11-04T01:39:14.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.929+0000 7f43f6ffd640 1 -- 172.21.15.44:0/2389433299 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f43f800abb0 con 0x7f4400160430 2023-11-04T01:39:14.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.929+0000 7f43f6ffd640 1 --2- 172.21.15.44:0/2389433299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f43e406ae70 0x7f43e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.930+0000 7f43f6ffd640 1 -- 172.21.15.44:0/2389433299 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f43f8089a40 con 0x7f4400160430 2023-11-04T01:39:14.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.930+0000 7f4406133640 1 --2- 172.21.15.44:0/2389433299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f43e406ae70 0x7f43e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.930+0000 7f4406133640 1 --2- 172.21.15.44:0/2389433299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f43e406ae70 0x7f43e406d330 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0011e0 tx=0x7f43fc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:14.934+0000 7f43f6ffd640 1 -- 172.21.15.44:0/2389433299 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f44000c4d50 con 0x7f4400160430 2023-11-04T01:39:15.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.108+0000 7f4408397640 1 -- 172.21.15.44:0/2389433299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44000c4d50 con 0x7f4400160430 2023-11-04T01:39:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.109+0000 7f43f6ffd640 1 -- 172.21.15.44:0/2389433299 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44000c4d50 con 0x7f4400160430 2023-11-04T01:39:15.111 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:39:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.111+0000 7f4408397640 1 -- 172.21.15.44:0/2389433299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f43e406ae70 msgr2=0x7f43e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.111+0000 7f4408397640 1 --2- 172.21.15.44:0/2389433299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f43e406ae70 0x7f43e406d330 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0011e0 tx=0x7f43fc009040 comp rx=0 tx=0).stop 2023-11-04T01:39:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.111+0000 7f4408397640 1 -- 172.21.15.44:0/2389433299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4400160430 msgr2=0x7f44000c5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.111+0000 7f4408397640 1 --2- 172.21.15.44:0/2389433299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4400160430 0x7f44000c5030 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f43f800c7c0 tx=0x7f43f800cc80 comp rx=0 tx=0).stop 2023-11-04T01:39:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.111+0000 7f4408397640 1 -- 172.21.15.44:0/2389433299 shutdown_connections 2023-11-04T01:39:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.111+0000 7f4408397640 1 --2- 172.21.15.44:0/2389433299 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f43e406ae70 0x7f43e406d330 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.111+0000 7f4408397640 1 --2- 172.21.15.44:0/2389433299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4400160430 0x7f44000c5030 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.111+0000 7f4408397640 1 --2- 172.21.15.44:0/2389433299 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44000b2d30 0x7f44000c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.111+0000 7f4408397640 1 --2- 172.21.15.44:0/2389433299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f440006c1d0 0x7f44001519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.111+0000 7f4408397640 1 -- 172.21.15.44:0/2389433299 >> 172.21.15.44:0/2389433299 conn(0x7f440006ea20 msgr2=0x7f44000cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.111+0000 7f4408397640 1 -- 172.21.15.44:0/2389433299 shutdown_connections 2023-11-04T01:39:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.111+0000 7f4408397640 1 -- 172.21.15.44:0/2389433299 wait complete. 2023-11-04T01:39:15.125 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:15.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.229+0000 7f519c5fb640 1 Processor -- start 2023-11-04T01:39:15.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.229+0000 7f519c5fb640 1 -- start start 2023-11-04T01:39:15.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.230+0000 7f519c5fb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f519415d250 0x7f51940c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.230+0000 7f519c5fb640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519406a120 con 0x7f519415ce70 2023-11-04T01:39:15.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.230+0000 7f519c5fb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519406a370 con 0x7f51940c9d70 2023-11-04T01:39:15.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.230+0000 7f519c5fb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51940cdc10 con 0x7f519415d250 2023-11-04T01:39:15.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.230+0000 7f519a397640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f519415ce70 0x7f519406d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37700/0 (socket says 172.21.15.44:37700) 2023-11-04T01:39:15.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.230+0000 7f519a397640 1 -- 172.21.15.44:0/960590924 learned_addr learned my addr 172.21.15.44:0/960590924 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:15.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.230+0000 7f5199b96640 1 --2- 172.21.15.44:0/960590924 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f519415d250 0x7f51940c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.230+0000 7f5199395640 1 -- 172.21.15.44:0/960590924 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162603705 0 0) 0x7f519406a120 con 0x7f519415ce70 2023-11-04T01:39:15.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.230+0000 7f5199395640 1 -- 172.21.15.44:0/960590924 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5180003520 con 0x7f519415ce70 2023-11-04T01:39:15.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.231+0000 7f5199b96640 1 -- 172.21.15.44:0/960590924 >> v1:172.21.15.204:6789/0 conn(0x7f51940c9d70 legacy=0x7f51940ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.231+0000 7f5199395640 1 -- 172.21.15.44:0/960590924 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993035039 0 0) 0x7f519406a370 con 0x7f51940c9d70 2023-11-04T01:39:15.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.231+0000 7f5199b96640 1 -- 172.21.15.44:0/960590924 >> v1:172.21.15.44:6789/0 conn(0x7f519415ce70 legacy=0x7f519406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.231+0000 7f5199b96640 1 -- 172.21.15.44:0/960590924 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519406a650 con 0x7f519415d250 2023-11-04T01:39:15.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.231+0000 7f5199b96640 1 --2- 172.21.15.44:0/960590924 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f519415d250 0x7f51940c9830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f51840097d0 tx=0x7f518402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36791b64380713ba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.232+0000 7f5199395640 1 -- 172.21.15.44:0/960590924 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5184031890 con 0x7f519415d250 2023-11-04T01:39:15.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.232+0000 7f5199395640 1 -- 172.21.15.44:0/960590924 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51840319f0 con 0x7f519415d250 2023-11-04T01:39:15.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.232+0000 7f5199395640 1 -- 172.21.15.44:0/960590924 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5184031d80 con 0x7f519415d250 2023-11-04T01:39:15.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.232+0000 7f519c5fb640 1 -- 172.21.15.44:0/960590924 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f519415d250 msgr2=0x7f51940c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.232+0000 7f519c5fb640 1 --2- 172.21.15.44:0/960590924 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f519415d250 0x7f51940c9830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f51840097d0 tx=0x7f518402b930 comp rx=0 tx=0).stop 2023-11-04T01:39:15.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.232+0000 7f519c5fb640 1 -- 172.21.15.44:0/960590924 shutdown_connections 2023-11-04T01:39:15.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.232+0000 7f519c5fb640 1 --2- 172.21.15.44:0/960590924 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f519415d250 0x7f51940c9830 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.232+0000 7f519c5fb640 1 -- 172.21.15.44:0/960590924 >> 172.21.15.44:0/960590924 conn(0x7f51940b0cd0 msgr2=0x7f51940b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:15.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.232+0000 7f519c5fb640 1 -- 172.21.15.44:0/960590924 shutdown_connections 2023-11-04T01:39:15.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.232+0000 7f519c5fb640 1 -- 172.21.15.44:0/960590924 wait complete. 2023-11-04T01:39:15.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.233+0000 7f519c5fb640 1 Processor -- start 2023-11-04T01:39:15.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.233+0000 7f519c5fb640 1 -- start start 2023-11-04T01:39:15.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.234+0000 7f519c5fb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f519415ce70 0x7f51940c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.234+0000 7f519c5fb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f519415d250 0x7f519414b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.234+0000 7f519c5fb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51940c4040 0x7f51941e3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.234+0000 7f519c5fb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51941e3770 con 0x7f51940c4040 2023-11-04T01:39:15.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.234+0000 7f519c5fb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51940c2fa0 con 0x7f519415d250 2023-11-04T01:39:15.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.234+0000 7f519c5fb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51940c3280 con 0x7f519415ce70 2023-11-04T01:39:15.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.234+0000 7f519ab98640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51940c4040 0x7f51941e3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.234+0000 7f519ab98640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51940c4040 0x7f51941e3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55238/0 (socket says 172.21.15.44:55238) 2023-11-04T01:39:15.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.234+0000 7f519ab98640 1 -- 172.21.15.44:0/3969877076 learned_addr learned my addr 172.21.15.44:0/3969877076 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:15.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.234+0000 7f519a397640 1 --2- 172.21.15.44:0/3969877076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f519415ce70 0x7f51940c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.234+0000 7f5199b96640 1 --2- 172.21.15.44:0/3969877076 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f519415d250 0x7f519414b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.235+0000 7f519ab98640 1 -- 172.21.15.44:0/3969877076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f519415ce70 msgr2=0x7f51940c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.235+0000 7f519ab98640 1 --2- 172.21.15.44:0/3969877076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f519415ce70 0x7f51940c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.235+0000 7f519ab98640 1 -- 172.21.15.44:0/3969877076 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f519415d250 msgr2=0x7f519414b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.235+0000 7f519ab98640 1 --2- 172.21.15.44:0/3969877076 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f519415d250 0x7f519414b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.235+0000 7f519ab98640 1 -- 172.21.15.44:0/3969877076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5184009400 con 0x7f51940c4040 2023-11-04T01:39:15.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.235+0000 7f519ab98640 1 --2- 172.21.15.44:0/3969877076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51940c4040 0x7f51941e3230 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f5190001560 tx=0x7f519000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.235+0000 7f518affd640 1 -- 172.21.15.44:0/3969877076 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190003da0 con 0x7f51940c4040 2023-11-04T01:39:15.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.235+0000 7f518affd640 1 -- 172.21.15.44:0/3969877076 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5190005070 con 0x7f51940c4040 2023-11-04T01:39:15.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.235+0000 7f519c5fb640 1 -- 172.21.15.44:0/3969877076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51940c3560 con 0x7f51940c4040 2023-11-04T01:39:15.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.235+0000 7f518affd640 1 -- 172.21.15.44:0/3969877076 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190005420 con 0x7f51940c4040 2023-11-04T01:39:15.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.235+0000 7f519c5fb640 1 -- 172.21.15.44:0/3969877076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51940c3b20 con 0x7f51940c4040 2023-11-04T01:39:15.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.236+0000 7f519c5fb640 1 -- 172.21.15.44:0/3969877076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51940c3d10 con 0x7f51940c4040 2023-11-04T01:39:15.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.237+0000 7f518affd640 1 -- 172.21.15.44:0/3969877076 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5190005580 con 0x7f51940c4040 2023-11-04T01:39:15.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.237+0000 7f518affd640 1 --2- 172.21.15.44:0/3969877076 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f517806aea0 0x7f517806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.237+0000 7f518affd640 1 -- 172.21.15.44:0/3969877076 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f51900894f0 con 0x7f51940c4040 2023-11-04T01:39:15.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.237+0000 7f519a397640 1 --2- 172.21.15.44:0/3969877076 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f517806aea0 0x7f517806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.238+0000 7f519a397640 1 --2- 172.21.15.44:0/3969877076 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f517806aea0 0x7f517806d360 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f518c005880 tx=0x7f518c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.241+0000 7f518affd640 1 -- 172.21.15.44:0/3969877076 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5190053f70 con 0x7f51940c4040 2023-11-04T01:39:15.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.455+0000 7f519c5fb640 1 -- 172.21.15.44:0/3969877076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5194074290 con 0x7f51940c4040 2023-11-04T01:39:15.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.455+0000 7f518affd640 1 -- 172.21.15.44:0/3969877076 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f5190017020 con 0x7f51940c4040 2023-11-04T01:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:15.457 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/257114874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":257114874},{"type":"v1","addr":"172.21.15.204:6835","nonce":257114874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6292,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2084651129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":2084651129},{"type":"v1","addr":"172.21.15.204:6837","nonce":2084651129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1688550253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1688550253},{"type":"v1","addr":"172.21.15.44:6834","nonce":1688550253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:38:59.773482+0000","modified":"2023-11-04T01:39:08.845246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6891},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6891":{"gid":6891,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/364976049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":364976049},{"type":"v1","addr":"172.21.15.44:6835","nonce":364976049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:39:15.458 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 39 2023-11-04T01:39:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.457+0000 7f519c5fb640 1 -- 172.21.15.44:0/3969877076 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f517806aea0 msgr2=0x7f517806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.457+0000 7f519c5fb640 1 --2- 172.21.15.44:0/3969877076 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f517806aea0 0x7f517806d360 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f518c005880 tx=0x7f518c009040 comp rx=0 tx=0).stop 2023-11-04T01:39:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.457+0000 7f519c5fb640 1 -- 172.21.15.44:0/3969877076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51940c4040 msgr2=0x7f51941e3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.457+0000 7f519c5fb640 1 --2- 172.21.15.44:0/3969877076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51940c4040 0x7f51941e3230 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f5190001560 tx=0x7f519000cc70 comp rx=0 tx=0).stop 2023-11-04T01:39:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.457+0000 7f519c5fb640 1 -- 172.21.15.44:0/3969877076 shutdown_connections 2023-11-04T01:39:15.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.457+0000 7f519c5fb640 1 --2- 172.21.15.44:0/3969877076 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f517806aea0 0x7f517806d360 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.457+0000 7f519c5fb640 1 --2- 172.21.15.44:0/3969877076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51940c4040 0x7f51941e3230 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.457+0000 7f519c5fb640 1 --2- 172.21.15.44:0/3969877076 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f519415d250 0x7f519414b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.457+0000 7f519c5fb640 1 --2- 172.21.15.44:0/3969877076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f519415ce70 0x7f51940c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.457+0000 7f519c5fb640 1 -- 172.21.15.44:0/3969877076 >> 172.21.15.44:0/3969877076 conn(0x7f51940b0cd0 msgr2=0x7f51940b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:15.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.457+0000 7f519c5fb640 1 -- 172.21.15.44:0/3969877076 shutdown_connections 2023-11-04T01:39:15.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.457+0000 7f519c5fb640 1 -- 172.21.15.44:0/3969877076 wait complete. 2023-11-04T01:39:15.470 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:15.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.574+0000 7fe4b7abb640 1 Processor -- start 2023-11-04T01:39:15.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.574+0000 7fe4b7abb640 1 -- start start 2023-11-04T01:39:15.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.575+0000 7fe4b7abb640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe4b00cde60 0x7fe4b015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.575+0000 7fe4b7abb640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4b015daa0 0x7fe4b0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.575+0000 7fe4b7abb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4b00ce240 0x7fe4b0157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.575+0000 7fe4b7abb640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b015e5c0 con 0x7fe4b015daa0 2023-11-04T01:39:15.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.575+0000 7fe4b7abb640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b0157a80 con 0x7fe4b00cde60 2023-11-04T01:39:15.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.575+0000 7fe4b7abb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b015e000 con 0x7fe4b00ce240 2023-11-04T01:39:15.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.575+0000 7fe4b5056640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4b015daa0 0x7fe4b0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.575+0000 7fe4b5056640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4b015daa0 0x7fe4b0157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55254/0 (socket says 172.21.15.44:55254) 2023-11-04T01:39:15.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.575+0000 7fe4b5056640 1 -- 172.21.15.44:0/4003169102 learned_addr learned my addr 172.21.15.44:0/4003169102 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:15.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.576+0000 7fe4b6058640 1 --2- 172.21.15.44:0/4003169102 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4b00ce240 0x7fe4b0157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.576+0000 7fe4b5857640 1 --2- 172.21.15.44:0/4003169102 >> v2:172.21.15.204:3300/0 conn(0x7fe4b00cde60 0x7fe4b015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.576+0000 7fe4b5056640 1 -- 172.21.15.44:0/4003169102 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4b00ce240 msgr2=0x7fe4b0157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:15.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.576+0000 7fe4b5056640 1 --2- 172.21.15.44:0/4003169102 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4b00ce240 0x7fe4b0157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.576+0000 7fe4b5056640 1 -- 172.21.15.44:0/4003169102 >> v2:172.21.15.204:3300/0 conn(0x7fe4b00cde60 msgr2=0x7fe4b015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:15.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.576+0000 7fe4b5056640 1 --2- 172.21.15.44:0/4003169102 >> v2:172.21.15.204:3300/0 conn(0x7fe4b00cde60 0x7fe4b015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.576+0000 7fe4b5056640 1 -- 172.21.15.44:0/4003169102 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b015e2e0 con 0x7fe4b015daa0 2023-11-04T01:39:15.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.576+0000 7fe4b5857640 1 --2- 172.21.15.44:0/4003169102 >> v2:172.21.15.204:3300/0 conn(0x7fe4b00cde60 0x7fe4b015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:15.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.577+0000 7fe4b5056640 1 --2- 172.21.15.44:0/4003169102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b015daa0 0x7fe4b0157000 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00b5550 tx=0x7fe4a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25389aaeb984ed2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.577+0000 7fe4b4855640 1 -- 172.21.15.44:0/4003169102 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4031870 con 0x7fe4b015daa0 2023-11-04T01:39:15.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.577+0000 7fe4b4855640 1 -- 172.21.15.44:0/4003169102 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a40319d0 con 0x7fe4b015daa0 2023-11-04T01:39:15.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.577+0000 7fe4b4855640 1 -- 172.21.15.44:0/4003169102 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4031d60 con 0x7fe4b015daa0 2023-11-04T01:39:15.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.577+0000 7fe4b7abb640 1 -- 172.21.15.44:0/4003169102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b015daa0 msgr2=0x7fe4b0157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.577+0000 7fe4b7abb640 1 --2- 172.21.15.44:0/4003169102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b015daa0 0x7fe4b0157000 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00b5550 tx=0x7fe4a402b910 comp rx=0 tx=0).stop 2023-11-04T01:39:15.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.577+0000 7fe4b7abb640 1 -- 172.21.15.44:0/4003169102 shutdown_connections 2023-11-04T01:39:15.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.577+0000 7fe4b7abb640 1 --2- 172.21.15.44:0/4003169102 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4b00ce240 0x7fe4b0157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.577+0000 7fe4b7abb640 1 --2- 172.21.15.44:0/4003169102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b015daa0 0x7fe4b0157000 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.577+0000 7fe4b7abb640 1 --2- 172.21.15.44:0/4003169102 >> v2:172.21.15.204:3300/0 conn(0x7fe4b00cde60 0x7fe4b015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.577+0000 7fe4b7abb640 1 -- 172.21.15.44:0/4003169102 >> 172.21.15.44:0/4003169102 conn(0x7fe4b0071f30 msgr2=0x7fe4b00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:15.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.577+0000 7fe4b7abb640 1 -- 172.21.15.44:0/4003169102 shutdown_connections 2023-11-04T01:39:15.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.577+0000 7fe4b7abb640 1 -- 172.21.15.44:0/4003169102 wait complete. 2023-11-04T01:39:15.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.579+0000 7fe4b7abb640 1 Processor -- start 2023-11-04T01:39:15.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.579+0000 7fe4b7abb640 1 -- start start 2023-11-04T01:39:15.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.579+0000 7fe4b7abb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4b00cde60 0x7fe4b0159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.579+0000 7fe4b7abb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4b00ce240 0x7fe4b0150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.579+0000 7fe4b7abb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b015daa0 0x7fe4b015c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.579+0000 7fe4b7abb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b0158cb0 con 0x7fe4b015daa0 2023-11-04T01:39:15.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.579+0000 7fe4b7abb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b01580a0 con 0x7fe4b00cde60 2023-11-04T01:39:15.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.579+0000 7fe4b7abb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b0158380 con 0x7fe4b00ce240 2023-11-04T01:39:15.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.579+0000 7fe4b6058640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b015daa0 0x7fe4b015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.579+0000 7fe4b6058640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b015daa0 0x7fe4b015c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55268/0 (socket says 172.21.15.44:55268) 2023-11-04T01:39:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.579+0000 7fe4b6058640 1 -- 172.21.15.44:0/156915040 learned_addr learned my addr 172.21.15.44:0/156915040 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.580+0000 7fe4b5857640 1 --2- 172.21.15.44:0/156915040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4b00cde60 0x7fe4b0159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.580+0000 7fe4b5056640 1 --2- 172.21.15.44:0/156915040 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4b00ce240 0x7fe4b0150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.580+0000 7fe4b6058640 1 -- 172.21.15.44:0/156915040 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4b00ce240 msgr2=0x7fe4b0150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.580+0000 7fe4b6058640 1 --2- 172.21.15.44:0/156915040 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4b00ce240 0x7fe4b0150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.580+0000 7fe4b6058640 1 -- 172.21.15.44:0/156915040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4b00cde60 msgr2=0x7fe4b0159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.580+0000 7fe4b6058640 1 --2- 172.21.15.44:0/156915040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4b00cde60 0x7fe4b0159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.580+0000 7fe4b6058640 1 -- 172.21.15.44:0/156915040 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a40094d0 con 0x7fe4b015daa0 2023-11-04T01:39:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.580+0000 7fe4b6058640 1 --2- 172.21.15.44:0/156915040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b015daa0 0x7fe4b015c320 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0007e30 tx=0x7fe4a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.580+0000 7fe4ae7fc640 1 -- 172.21.15.44:0/156915040 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0014620 con 0x7fe4b015daa0 2023-11-04T01:39:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.580+0000 7fe4ae7fc640 1 -- 172.21.15.44:0/156915040 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a000ee90 con 0x7fe4b015daa0 2023-11-04T01:39:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.580+0000 7fe4b7abb640 1 -- 172.21.15.44:0/156915040 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b0158660 con 0x7fe4b015daa0 2023-11-04T01:39:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.580+0000 7fe4ae7fc640 1 -- 172.21.15.44:0/156915040 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00149c0 con 0x7fe4b015daa0 2023-11-04T01:39:15.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.580+0000 7fe4b7abb640 1 -- 172.21.15.44:0/156915040 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b0150b60 con 0x7fe4b015daa0 2023-11-04T01:39:15.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.581+0000 7fe4b7abb640 1 -- 172.21.15.44:0/156915040 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b0158e20 con 0x7fe4b015daa0 2023-11-04T01:39:15.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.581+0000 7fe4ae7fc640 1 -- 172.21.15.44:0/156915040 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4a0014b20 con 0x7fe4b015daa0 2023-11-04T01:39:15.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.582+0000 7fe4ae7fc640 1 --2- 172.21.15.44:0/156915040 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe49c06ae70 0x7fe49c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.582+0000 7fe4ae7fc640 1 -- 172.21.15.44:0/156915040 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fe4a008a5a0 con 0x7fe4b015daa0 2023-11-04T01:39:15.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.582+0000 7fe4b5857640 1 --2- 172.21.15.44:0/156915040 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe49c06ae70 0x7fe49c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.583+0000 7fe4b5857640 1 --2- 172.21.15.44:0/156915040 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe49c06ae70 0x7fe49c06d330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00b4af0 tx=0x7fe4a8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.586+0000 7fe4ae7fc640 1 -- 172.21.15.44:0/156915040 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4a00550b0 con 0x7fe4b015daa0 2023-11-04T01:39:15.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.766+0000 7fe4b7abb640 1 -- 172.21.15.44:0/156915040 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4b0150cf0 con 0x7fe4b015daa0 2023-11-04T01:39:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.768+0000 7fe4ae7fc640 1 -- 172.21.15.44:0/156915040 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22063 (secure 0 0 0) 0x7fe4a00586d0 con 0x7fe4b015daa0 2023-11-04T01:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:15.770 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":85,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:39:13.457321+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:57.815488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:58.748063+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":85,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:15.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.770+0000 7fe4b7abb640 1 -- 172.21.15.44:0/156915040 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe49c06ae70 msgr2=0x7fe49c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.770+0000 7fe4b7abb640 1 --2- 172.21.15.44:0/156915040 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe49c06ae70 0x7fe49c06d330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00b4af0 tx=0x7fe4a8008040 comp rx=0 tx=0).stop 2023-11-04T01:39:15.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.770+0000 7fe4b7abb640 1 -- 172.21.15.44:0/156915040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b015daa0 msgr2=0x7fe4b015c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.770+0000 7fe4b7abb640 1 --2- 172.21.15.44:0/156915040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b015daa0 0x7fe4b015c320 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0007e30 tx=0x7fe4a000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.770+0000 7fe4b7abb640 1 -- 172.21.15.44:0/156915040 shutdown_connections 2023-11-04T01:39:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.770+0000 7fe4b7abb640 1 --2- 172.21.15.44:0/156915040 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe49c06ae70 0x7fe49c06d330 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.770+0000 7fe4b7abb640 1 --2- 172.21.15.44:0/156915040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b015daa0 0x7fe4b015c320 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.770+0000 7fe4b7abb640 1 --2- 172.21.15.44:0/156915040 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4b00ce240 0x7fe4b0150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.770+0000 7fe4b7abb640 1 --2- 172.21.15.44:0/156915040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4b00cde60 0x7fe4b0159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.770+0000 7fe4b7abb640 1 -- 172.21.15.44:0/156915040 >> 172.21.15.44:0/156915040 conn(0x7fe4b0071f30 msgr2=0x7fe4b0156530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.770+0000 7fe4b7abb640 1 -- 172.21.15.44:0/156915040 shutdown_connections 2023-11-04T01:39:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.770+0000 7fe4b7abb640 1 -- 172.21.15.44:0/156915040 wait complete. 2023-11-04T01:39:15.783 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:39:15.783 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:15.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.888+0000 7fe423056640 1 Processor -- start 2023-11-04T01:39:15.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.888+0000 7fe423056640 1 -- start start 2023-11-04T01:39:15.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.889+0000 7fe423056640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe41c0cde60 0x7fe41c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.889+0000 7fe423056640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe41c15daa0 0x7fe41c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.889+0000 7fe423056640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe41c0ce240 0x7fe41c157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.889+0000 7fe423056640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c15e5c0 con 0x7fe41c0ce240 2023-11-04T01:39:15.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.889+0000 7fe423056640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c157a80 con 0x7fe41c15daa0 2023-11-04T01:39:15.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.889+0000 7fe423056640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c15e000 con 0x7fe41c0cde60 2023-11-04T01:39:15.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.889+0000 7fe4215f3640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe41c0ce240 0x7fe41c157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.889+0000 7fe4215f3640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe41c0ce240 0x7fe41c157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55272/0 (socket says 172.21.15.44:55272) 2023-11-04T01:39:15.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.889+0000 7fe4215f3640 1 -- 172.21.15.44:0/2144732354 learned_addr learned my addr 172.21.15.44:0/2144732354 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:15.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.890+0000 7fe420df2640 1 --2- 172.21.15.44:0/2144732354 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe41c0cde60 0x7fe41c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.890+0000 7fe41bfff640 1 --2- 172.21.15.44:0/2144732354 >> v2:172.21.15.204:3300/0 conn(0x7fe41c15daa0 0x7fe41c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.890+0000 7fe4215f3640 1 -- 172.21.15.44:0/2144732354 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe41c0cde60 msgr2=0x7fe41c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.890+0000 7fe4215f3640 1 --2- 172.21.15.44:0/2144732354 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe41c0cde60 0x7fe41c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.890+0000 7fe4215f3640 1 -- 172.21.15.44:0/2144732354 >> v2:172.21.15.204:3300/0 conn(0x7fe41c15daa0 msgr2=0x7fe41c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.890+0000 7fe4215f3640 1 --2- 172.21.15.44:0/2144732354 >> v2:172.21.15.204:3300/0 conn(0x7fe41c15daa0 0x7fe41c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.890+0000 7fe4215f3640 1 -- 172.21.15.44:0/2144732354 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c15e2e0 con 0x7fe41c0ce240 2023-11-04T01:39:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.890+0000 7fe41bfff640 1 --2- 172.21.15.44:0/2144732354 >> v2:172.21.15.204:3300/0 conn(0x7fe41c15daa0 0x7fe41c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.890+0000 7fe4215f3640 1 --2- 172.21.15.44:0/2144732354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe41c0ce240 0x7fe41c157540 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fe41c06c7c0 tx=0x7fe41402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3a2f56190c06ac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.891+0000 7fe41b7fe640 1 -- 172.21.15.44:0/2144732354 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41402ca70 con 0x7fe41c0ce240 2023-11-04T01:39:15.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.891+0000 7fe41b7fe640 1 -- 172.21.15.44:0/2144732354 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41402cbd0 con 0x7fe41c0ce240 2023-11-04T01:39:15.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.891+0000 7fe41b7fe640 1 -- 172.21.15.44:0/2144732354 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4140343f0 con 0x7fe41c0ce240 2023-11-04T01:39:15.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.891+0000 7fe423056640 1 -- 172.21.15.44:0/2144732354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe41c0ce240 msgr2=0x7fe41c157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.891+0000 7fe423056640 1 --2- 172.21.15.44:0/2144732354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe41c0ce240 0x7fe41c157540 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fe41c06c7c0 tx=0x7fe41402bed0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.891+0000 7fe423056640 1 -- 172.21.15.44:0/2144732354 shutdown_connections 2023-11-04T01:39:15.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.891+0000 7fe423056640 1 --2- 172.21.15.44:0/2144732354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe41c0ce240 0x7fe41c157540 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.891+0000 7fe423056640 1 --2- 172.21.15.44:0/2144732354 >> v2:172.21.15.204:3300/0 conn(0x7fe41c15daa0 0x7fe41c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.891+0000 7fe423056640 1 --2- 172.21.15.44:0/2144732354 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe41c0cde60 0x7fe41c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.891+0000 7fe423056640 1 -- 172.21.15.44:0/2144732354 >> 172.21.15.44:0/2144732354 conn(0x7fe41c071f30 msgr2=0x7fe41c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:15.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.891+0000 7fe423056640 1 -- 172.21.15.44:0/2144732354 shutdown_connections 2023-11-04T01:39:15.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.891+0000 7fe423056640 1 -- 172.21.15.44:0/2144732354 wait complete. 2023-11-04T01:39:15.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.892+0000 7fe423056640 1 Processor -- start 2023-11-04T01:39:15.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.892+0000 7fe423056640 1 -- start start 2023-11-04T01:39:15.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.893+0000 7fe423056640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe41c0cde60 0x7fe41c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.893+0000 7fe423056640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe41c0ce240 0x7fe41c15c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.893+0000 7fe423056640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe41c15daa0 0x7fe41c15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.893+0000 7fe423056640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0cc7f0 con 0x7fe41c0ce240 2023-11-04T01:39:15.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.893+0000 7fe423056640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c15cab0 con 0x7fe41c15daa0 2023-11-04T01:39:15.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.893+0000 7fe423056640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0cbb70 con 0x7fe41c0cde60 2023-11-04T01:39:15.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.893+0000 7fe41bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe41c0ce240 0x7fe41c15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.893+0000 7fe41bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe41c0ce240 0x7fe41c15c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55276/0 (socket says 172.21.15.44:55276) 2023-11-04T01:39:15.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.893+0000 7fe41bfff640 1 -- 172.21.15.44:0/165452468 learned_addr learned my addr 172.21.15.44:0/165452468 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:15.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.894+0000 7fe420df2640 1 --2- 172.21.15.44:0/165452468 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe41c0cde60 0x7fe41c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.894+0000 7fe4215f3640 1 --2- 172.21.15.44:0/165452468 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe41c15daa0 0x7fe41c15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.894+0000 7fe41bfff640 1 -- 172.21.15.44:0/165452468 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe41c0cde60 msgr2=0x7fe41c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.894+0000 7fe41bfff640 1 --2- 172.21.15.44:0/165452468 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe41c0cde60 0x7fe41c0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.894+0000 7fe41bfff640 1 -- 172.21.15.44:0/165452468 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe41c15daa0 msgr2=0x7fe41c15a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.894+0000 7fe41bfff640 1 --2- 172.21.15.44:0/165452468 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe41c15daa0 0x7fe41c15a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.894+0000 7fe41bfff640 1 -- 172.21.15.44:0/165452468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe414009b30 con 0x7fe41c0ce240 2023-11-04T01:39:15.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.894+0000 7fe4215f3640 1 --2- 172.21.15.44:0/165452468 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe41c15daa0 0x7fe41c15a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:15.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.894+0000 7fe41bfff640 1 --2- 172.21.15.44:0/165452468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe41c0ce240 0x7fe41c15c570 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe41000c820 tx=0x7fe41000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.894+0000 7fe4197fa640 1 -- 172.21.15.44:0/165452468 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410007a30 con 0x7fe41c0ce240 2023-11-04T01:39:15.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.894+0000 7fe4197fa640 1 -- 172.21.15.44:0/165452468 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe410007b90 con 0x7fe41c0ce240 2023-11-04T01:39:15.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.894+0000 7fe423056640 1 -- 172.21.15.44:0/165452468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c0cbe50 con 0x7fe41c0ce240 2023-11-04T01:39:15.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.894+0000 7fe4197fa640 1 -- 172.21.15.44:0/165452468 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000ce10 con 0x7fe41c0ce240 2023-11-04T01:39:15.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.894+0000 7fe423056640 1 -- 172.21.15.44:0/165452468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c0cc410 con 0x7fe41c0ce240 2023-11-04T01:39:15.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.895+0000 7fe423056640 1 -- 172.21.15.44:0/165452468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c074290 con 0x7fe41c0ce240 2023-11-04T01:39:15.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.895+0000 7fe4197fa640 1 -- 172.21.15.44:0/165452468 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4100113f0 con 0x7fe41c0ce240 2023-11-04T01:39:15.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.896+0000 7fe4197fa640 1 --2- 172.21.15.44:0/165452468 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe40806ae70 0x7fe40806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.896+0000 7fe4197fa640 1 -- 172.21.15.44:0/165452468 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fe410089c40 con 0x7fe41c0ce240 2023-11-04T01:39:15.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.896+0000 7fe420df2640 1 --2- 172.21.15.44:0/165452468 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe40806ae70 0x7fe40806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.897+0000 7fe420df2640 1 --2- 172.21.15.44:0/165452468 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe40806ae70 0x7fe40806d330 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe40c006fd0 tx=0x7fe40c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:15.900+0000 7fe4197fa640 1 -- 172.21.15.44:0/165452468 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4100547e0 con 0x7fe41c0ce240 2023-11-04T01:39:16.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.112+0000 7fe423056640 1 -- 172.21.15.44:0/165452468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe41c0b85a0 con 0x7fe41c0ce240 2023-11-04T01:39:16.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.112+0000 7fe4197fa640 1 -- 172.21.15.44:0/165452468 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4915 (secure 0 0 0) 0x7fe41001f090 con 0x7fe41c0ce240 2023-11-04T01:39:16.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:16.114 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/257114874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":257114874},{"type":"v1","addr":"172.21.15.204:6835","nonce":257114874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6292,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2084651129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":2084651129},{"type":"v1","addr":"172.21.15.204:6837","nonce":2084651129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1688550253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1688550253},{"type":"v1","addr":"172.21.15.44:6834","nonce":1688550253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:38:59.773482+0000","modified":"2023-11-04T01:39:08.845246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6891},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6891":{"gid":6891,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/364976049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":364976049},{"type":"v1","addr":"172.21.15.44:6835","nonce":364976049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:39:16.115 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 39 2023-11-04T01:39:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.114+0000 7fe423056640 1 -- 172.21.15.44:0/165452468 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe40806ae70 msgr2=0x7fe40806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.114+0000 7fe423056640 1 --2- 172.21.15.44:0/165452468 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe40806ae70 0x7fe40806d330 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe40c006fd0 tx=0x7fe40c008040 comp rx=0 tx=0).stop 2023-11-04T01:39:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.114+0000 7fe423056640 1 -- 172.21.15.44:0/165452468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe41c0ce240 msgr2=0x7fe41c15c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.114+0000 7fe423056640 1 --2- 172.21.15.44:0/165452468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe41c0ce240 0x7fe41c15c570 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe41000c820 tx=0x7fe41000cce0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.114+0000 7fe423056640 1 -- 172.21.15.44:0/165452468 shutdown_connections 2023-11-04T01:39:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.114+0000 7fe423056640 1 --2- 172.21.15.44:0/165452468 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe40806ae70 0x7fe40806d330 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.114+0000 7fe423056640 1 --2- 172.21.15.44:0/165452468 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe41c15daa0 0x7fe41c15a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.114+0000 7fe423056640 1 --2- 172.21.15.44:0/165452468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe41c0ce240 0x7fe41c15c570 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.114+0000 7fe423056640 1 --2- 172.21.15.44:0/165452468 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe41c0cde60 0x7fe41c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.114+0000 7fe423056640 1 -- 172.21.15.44:0/165452468 >> 172.21.15.44:0/165452468 conn(0x7fe41c071f30 msgr2=0x7fe41c0d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.114+0000 7fe423056640 1 -- 172.21.15.44:0/165452468 shutdown_connections 2023-11-04T01:39:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.114+0000 7fe423056640 1 -- 172.21.15.44:0/165452468 wait complete. 2023-11-04T01:39:16.127 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:16.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.233+0000 7f419d56c640 1 Processor -- start 2023-11-04T01:39:16.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.233+0000 7f419d56c640 1 -- start start 2023-11-04T01:39:16.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.234+0000 7f419d56c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f41980b2870 0x7f419806ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.234+0000 7f419d56c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41980cd170 0x7f4198161570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.234+0000 7f419d56c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4198161ab0 con 0x7f41980b2c50 2023-11-04T01:39:16.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.234+0000 7f419d56c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419806ccd0 con 0x7f41980b2870 2023-11-04T01:39:16.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.234+0000 7f419d56c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419806c050 con 0x7f41980cd170 2023-11-04T01:39:16.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.234+0000 7f4196ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f41980b2870 0x7f419806ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.234+0000 7f41967fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f41980b2c50 0x7f41980cca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37708/0 (socket says 172.21.15.44:37708) 2023-11-04T01:39:16.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.234+0000 7f41967fc640 1 -- 172.21.15.44:0/2888923986 learned_addr learned my addr 172.21.15.44:0/2888923986 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:16.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.234+0000 7f41977fe640 1 --2- 172.21.15.44:0/2888923986 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41980cd170 0x7f4198161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.234+0000 7f4196ffd640 1 -- 172.21.15.44:0/2888923986 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41980cd170 msgr2=0x7f4198161570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:16.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.234+0000 7f4196ffd640 1 --2- 172.21.15.44:0/2888923986 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41980cd170 0x7f4198161570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.234+0000 7f4196ffd640 1 -- 172.21.15.44:0/2888923986 >> v1:172.21.15.44:6789/0 conn(0x7f41980b2c50 legacy=0x7f41980cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.234+0000 7f4195ffb640 1 -- 172.21.15.44:0/2888923986 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149089871 0 0) 0x7f418c001110 con 0x7f41980b2c50 2023-11-04T01:39:16.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.234+0000 7f4196ffd640 1 -- 172.21.15.44:0/2888923986 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419806c330 con 0x7f41980b2870 2023-11-04T01:39:16.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.234+0000 7f41977fe640 1 --2- 172.21.15.44:0/2888923986 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41980cd170 0x7f4198161570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:16.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.235+0000 7f4196ffd640 1 --2- 172.21.15.44:0/2888923986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41980b2870 0x7f419806ba00 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f4188009790 tx=0x7f418802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a543a8b56999e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.235+0000 7f4195ffb640 1 -- 172.21.15.44:0/2888923986 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41880316f0 con 0x7f41980b2870 2023-11-04T01:39:16.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.235+0000 7f4195ffb640 1 -- 172.21.15.44:0/2888923986 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4188031850 con 0x7f41980b2870 2023-11-04T01:39:16.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.235+0000 7f4195ffb640 1 -- 172.21.15.44:0/2888923986 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188031be0 con 0x7f41980b2870 2023-11-04T01:39:16.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.236+0000 7f419d56c640 1 -- 172.21.15.44:0/2888923986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41980b2870 msgr2=0x7f419806ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.236+0000 7f419d56c640 1 --2- 172.21.15.44:0/2888923986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41980b2870 0x7f419806ba00 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f4188009790 tx=0x7f418802b790 comp rx=0 tx=0).stop 2023-11-04T01:39:16.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.236+0000 7f419d56c640 1 -- 172.21.15.44:0/2888923986 shutdown_connections 2023-11-04T01:39:16.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.236+0000 7f419d56c640 1 --2- 172.21.15.44:0/2888923986 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41980cd170 0x7f4198161570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.236+0000 7f419d56c640 1 --2- 172.21.15.44:0/2888923986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41980b2870 0x7f419806ba00 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.236+0000 7f419d56c640 1 -- 172.21.15.44:0/2888923986 >> 172.21.15.44:0/2888923986 conn(0x7f41980cd600 msgr2=0x7f41980cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.236+0000 7f419d56c640 1 -- 172.21.15.44:0/2888923986 shutdown_connections 2023-11-04T01:39:16.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.236+0000 7f419d56c640 1 -- 172.21.15.44:0/2888923986 wait complete. 2023-11-04T01:39:16.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.237+0000 7f419d56c640 1 Processor -- start 2023-11-04T01:39:16.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.237+0000 7f419d56c640 1 -- start start 2023-11-04T01:39:16.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f419d56c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41980b2870 0x7f4198159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f419d56c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41980b2c50 0x7f419815c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f419d56c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41980cd170 0x7f41981f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f419d56c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41981f3c60 con 0x7f41980b2870 2023-11-04T01:39:16.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f419d56c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41981f33c0 con 0x7f41980cd170 2023-11-04T01:39:16.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f419d56c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41981f36a0 con 0x7f41980b2c50 2023-11-04T01:39:16.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f4196ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41980b2870 0x7f4198159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f4196ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41980b2870 0x7f4198159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55308/0 (socket says 172.21.15.44:55308) 2023-11-04T01:39:16.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f4196ffd640 1 -- 172.21.15.44:0/1561819807 learned_addr learned my addr 172.21.15.44:0/1561819807 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:16.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f41967fc640 1 --2- 172.21.15.44:0/1561819807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41980b2c50 0x7f419815c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f41977fe640 1 --2- 172.21.15.44:0/1561819807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41980cd170 0x7f41981f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f4196ffd640 1 -- 172.21.15.44:0/1561819807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41980b2c50 msgr2=0x7f419815c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f4196ffd640 1 --2- 172.21.15.44:0/1561819807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41980b2c50 0x7f419815c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f4196ffd640 1 -- 172.21.15.44:0/1561819807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41980cd170 msgr2=0x7f41981f2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f4196ffd640 1 --2- 172.21.15.44:0/1561819807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41980cd170 0x7f41981f2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.238+0000 7f4196ffd640 1 -- 172.21.15.44:0/1561819807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41880093a0 con 0x7f41980b2870 2023-11-04T01:39:16.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.239+0000 7f4196ffd640 1 --2- 172.21.15.44:0/1561819807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41980b2870 0x7f4198159310 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f4188000c00 tx=0x7f41880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.239+0000 7f417f7fe640 1 -- 172.21.15.44:0/1561819807 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188034890 con 0x7f41980b2870 2023-11-04T01:39:16.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.239+0000 7f417f7fe640 1 -- 172.21.15.44:0/1561819807 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41880349f0 con 0x7f41980b2870 2023-11-04T01:39:16.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.239+0000 7f419d56c640 1 -- 172.21.15.44:0/1561819807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41981f3980 con 0x7f41980b2870 2023-11-04T01:39:16.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.239+0000 7f417f7fe640 1 -- 172.21.15.44:0/1561819807 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188034da0 con 0x7f41980b2870 2023-11-04T01:39:16.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.239+0000 7f419d56c640 1 -- 172.21.15.44:0/1561819807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41981f3040 con 0x7f41980b2870 2023-11-04T01:39:16.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.240+0000 7f419d56c640 1 -- 172.21.15.44:0/1561819807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4198066920 con 0x7f41980b2870 2023-11-04T01:39:16.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.240+0000 7f417f7fe640 1 -- 172.21.15.44:0/1561819807 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f418803b040 con 0x7f41980b2870 2023-11-04T01:39:16.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.241+0000 7f417f7fe640 1 --2- 172.21.15.44:0/1561819807 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f418406ae70 0x7f418406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.241+0000 7f417f7fe640 1 -- 172.21.15.44:0/1561819807 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f41880ab550 con 0x7f41980b2870 2023-11-04T01:39:16.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.241+0000 7f41967fc640 1 --2- 172.21.15.44:0/1561819807 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f418406ae70 0x7f418406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.241+0000 7f41967fc640 1 --2- 172.21.15.44:0/1561819807 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f418406ae70 0x7f418406d330 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f41980cac20 tx=0x7f418c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.245+0000 7f417f7fe640 1 -- 172.21.15.44:0/1561819807 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4188075fc0 con 0x7f41980b2870 2023-11-04T01:39:16.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.460+0000 7f419d56c640 1 -- 172.21.15.44:0/1561819807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41980674e0 con 0x7f41980b2870 2023-11-04T01:39:16.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.460+0000 7f417f7fe640 1 -- 172.21.15.44:0/1561819807 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f41880795e0 con 0x7f41980b2870 2023-11-04T01:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:16.462 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/257114874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":257114874},{"type":"v1","addr":"172.21.15.204:6835","nonce":257114874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6292,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2084651129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":2084651129},{"type":"v1","addr":"172.21.15.204:6837","nonce":2084651129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1688550253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1688550253},{"type":"v1","addr":"172.21.15.44:6834","nonce":1688550253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:38:59.773482+0000","modified":"2023-11-04T01:39:08.845246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6891},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6891":{"gid":6891,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/364976049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":364976049},{"type":"v1","addr":"172.21.15.44:6835","nonce":364976049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:39:16.463 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 39 2023-11-04T01:39:16.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.462+0000 7f419d56c640 1 -- 172.21.15.44:0/1561819807 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f418406ae70 msgr2=0x7f418406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.462+0000 7f419d56c640 1 --2- 172.21.15.44:0/1561819807 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f418406ae70 0x7f418406d330 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f41980cac20 tx=0x7f418c009040 comp rx=0 tx=0).stop 2023-11-04T01:39:16.464 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.462+0000 7f419d56c640 1 -- 172.21.15.44:0/1561819807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41980b2870 msgr2=0x7f4198159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.462+0000 7f419d56c640 1 --2- 172.21.15.44:0/1561819807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41980b2870 0x7f4198159310 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f4188000c00 tx=0x7f41880046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.462+0000 7f419d56c640 1 -- 172.21.15.44:0/1561819807 shutdown_connections 2023-11-04T01:39:16.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.462+0000 7f419d56c640 1 --2- 172.21.15.44:0/1561819807 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f418406ae70 0x7f418406d330 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.462+0000 7f419d56c640 1 --2- 172.21.15.44:0/1561819807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41980cd170 0x7f41981f2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.462+0000 7f419d56c640 1 --2- 172.21.15.44:0/1561819807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41980b2c50 0x7f419815c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.462+0000 7f419d56c640 1 --2- 172.21.15.44:0/1561819807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41980b2870 0x7f4198159310 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.462+0000 7f419d56c640 1 -- 172.21.15.44:0/1561819807 >> 172.21.15.44:0/1561819807 conn(0x7f41980cd600 msgr2=0x7f41980cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.462+0000 7f419d56c640 1 -- 172.21.15.44:0/1561819807 shutdown_connections 2023-11-04T01:39:16.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.462+0000 7f419d56c640 1 -- 172.21.15.44:0/1561819807 wait complete. 2023-11-04T01:39:16.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:16.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.579+0000 7ff4a1e07640 1 Processor -- start 2023-11-04T01:39:16.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.580+0000 7ff4a1e07640 1 -- start start 2023-11-04T01:39:16.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.580+0000 7ff4a1e07640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff49c0b6160 0x7ff49c0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.580+0000 7ff4a1e07640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49c0ce3a0 con 0x7ff49c160440 2023-11-04T01:39:16.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.580+0000 7ff4a1e07640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49c0d1120 con 0x7ff49c0b5010 2023-11-04T01:39:16.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.580+0000 7ff4a1e07640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49c0d1400 con 0x7ff49c0b6160 2023-11-04T01:39:16.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.580+0000 7ff49affd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff49c0b6160 0x7ff49c0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.580+0000 7ff49b7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff49c160440 0x7ff49c0b4900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37716/0 (socket says 172.21.15.44:37716) 2023-11-04T01:39:16.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.580+0000 7ff49b7fe640 1 -- 172.21.15.44:0/144738751 learned_addr learned my addr 172.21.15.44:0/144738751 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:16.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.581+0000 7ff49affd640 1 -- 172.21.15.44:0/144738751 >> v1:172.21.15.204:6789/0 conn(0x7ff49c0b5010 legacy=0x7ff49c0d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:16.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.581+0000 7ff49affd640 1 -- 172.21.15.44:0/144738751 >> v1:172.21.15.44:6789/0 conn(0x7ff49c160440 legacy=0x7ff49c0b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.581+0000 7ff49affd640 1 -- 172.21.15.44:0/144738751 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c0d16e0 con 0x7ff49c0b6160 2023-11-04T01:39:16.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.581+0000 7ff49affd640 1 --2- 172.21.15.44:0/144738751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c0b6160 0x7ff49c0cd6e0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff4900097a0 tx=0x7ff49002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c89cb7a02febf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.582+0000 7ff49a7fc640 1 -- 172.21.15.44:0/144738751 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490031830 con 0x7ff49c0b6160 2023-11-04T01:39:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.582+0000 7ff49a7fc640 1 -- 172.21.15.44:0/144738751 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff490031990 con 0x7ff49c0b6160 2023-11-04T01:39:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.582+0000 7ff49a7fc640 1 -- 172.21.15.44:0/144738751 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490031d20 con 0x7ff49c0b6160 2023-11-04T01:39:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.582+0000 7ff4a1e07640 1 -- 172.21.15.44:0/144738751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c0b6160 msgr2=0x7ff49c0cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.582+0000 7ff4a1e07640 1 --2- 172.21.15.44:0/144738751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c0b6160 0x7ff49c0cd6e0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff4900097a0 tx=0x7ff49002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.582+0000 7ff4a1e07640 1 -- 172.21.15.44:0/144738751 shutdown_connections 2023-11-04T01:39:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.582+0000 7ff4a1e07640 1 --2- 172.21.15.44:0/144738751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c0b6160 0x7ff49c0cd6e0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.582+0000 7ff4a1e07640 1 -- 172.21.15.44:0/144738751 >> 172.21.15.44:0/144738751 conn(0x7ff49c0cf900 msgr2=0x7ff49c0cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.582+0000 7ff4a1e07640 1 -- 172.21.15.44:0/144738751 shutdown_connections 2023-11-04T01:39:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.582+0000 7ff4a1e07640 1 -- 172.21.15.44:0/144738751 wait complete. 2023-11-04T01:39:16.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.583+0000 7ff4a1e07640 1 Processor -- start 2023-11-04T01:39:16.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.584+0000 7ff4a1e07640 1 -- start start 2023-11-04T01:39:16.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.584+0000 7ff4a1e07640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c0b5010 0x7ff49c0c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.584+0000 7ff4a1e07640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff49c160440 0x7ff49c0d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.584+0000 7ff4a1e07640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff49c0d24c0 0x7ff49c0c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.584+0000 7ff4a1e07640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0d2970 con 0x7ff49c0b5010 2023-11-04T01:39:16.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.584+0000 7ff4a1e07640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0b6550 con 0x7ff49c160440 2023-11-04T01:39:16.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.584+0000 7ff4a1e07640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0b6830 con 0x7ff49c0d24c0 2023-11-04T01:39:16.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.584+0000 7ff49b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c0b5010 0x7ff49c0c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.584+0000 7ff49b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c0b5010 0x7ff49c0c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55328/0 (socket says 172.21.15.44:55328) 2023-11-04T01:39:16.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.584+0000 7ff49b7fe640 1 -- 172.21.15.44:0/1268698468 learned_addr learned my addr 172.21.15.44:0/1268698468 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:16.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.585+0000 7ff49b7fe640 1 -- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff49c0d24c0 msgr2=0x7ff49c0c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.585+0000 7ff49affd640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff49c160440 0x7ff49c0d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.585+0000 7ff49bfff640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff49c0d24c0 0x7ff49c0c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.585+0000 7ff49b7fe640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff49c0d24c0 0x7ff49c0c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.585+0000 7ff49b7fe640 1 -- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff49c160440 msgr2=0x7ff49c0d1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.585+0000 7ff49b7fe640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff49c160440 0x7ff49c0d1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.585+0000 7ff49b7fe640 1 -- 172.21.15.44:0/1268698468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff490009400 con 0x7ff49c0b5010 2023-11-04T01:39:16.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.585+0000 7ff49bfff640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff49c0d24c0 0x7ff49c0c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:16.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.585+0000 7ff49affd640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff49c160440 0x7ff49c0d1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:16.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.585+0000 7ff49b7fe640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c0b5010 0x7ff49c0c9390 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00c400 tx=0x7ff48c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.585+0000 7ff483fff640 1 -- 172.21.15.44:0/1268698468 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c005ce0 con 0x7ff49c0b5010 2023-11-04T01:39:16.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.585+0000 7ff483fff640 1 -- 172.21.15.44:0/1268698468 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c005e40 con 0x7ff49c0b5010 2023-11-04T01:39:16.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.585+0000 7ff483fff640 1 -- 172.21.15.44:0/1268698468 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c007310 con 0x7ff49c0b5010 2023-11-04T01:39:16.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.585+0000 7ff4a1e07640 1 -- 172.21.15.44:0/1268698468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49c0b6b10 con 0x7ff49c0b5010 2023-11-04T01:39:16.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.585+0000 7ff4a1e07640 1 -- 172.21.15.44:0/1268698468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c0b70d0 con 0x7ff49c0b5010 2023-11-04T01:39:16.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.586+0000 7ff4a1e07640 1 -- 172.21.15.44:0/1268698468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49c074290 con 0x7ff49c0b5010 2023-11-04T01:39:16.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.587+0000 7ff483fff640 1 -- 172.21.15.44:0/1268698468 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff48c007470 con 0x7ff49c0b5010 2023-11-04T01:39:16.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.587+0000 7ff483fff640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff48806ae70 0x7ff48806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.587+0000 7ff483fff640 1 -- 172.21.15.44:0/1268698468 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7148+0+0 (secure 0 0 0) 0x7ff48c089150 con 0x7ff49c0b5010 2023-11-04T01:39:16.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.587+0000 7ff49affd640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff48806ae70 0x7ff48806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.588+0000 7ff49affd640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff48806ae70 0x7ff48806d330 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff490036000 tx=0x7ff490008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.591+0000 7ff483fff640 1 -- 172.21.15.44:0/1268698468 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff48c053c60 con 0x7ff49c0b5010 2023-11-04T01:39:16.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.770+0000 7ff4a1e07640 1 -- 172.21.15.44:0/1268698468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff49c0c6750 con 0x7ff49c0b5010 2023-11-04T01:39:16.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.772+0000 7ff483fff640 1 -- 172.21.15.44:0/1268698468 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22063 (secure 0 0 0) 0x7ff48c057280 con 0x7ff49c0b5010 2023-11-04T01:39:16.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:16.774 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":85,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:39:13.457321+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:57.815488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:58.748063+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":85,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.774+0000 7ff4a1e07640 1 -- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff48806ae70 msgr2=0x7ff48806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.774+0000 7ff4a1e07640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff48806ae70 0x7ff48806d330 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff490036000 tx=0x7ff490008030 comp rx=0 tx=0).stop 2023-11-04T01:39:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.774+0000 7ff4a1e07640 1 -- 172.21.15.44:0/1268698468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c0b5010 msgr2=0x7ff49c0c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.774+0000 7ff4a1e07640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c0b5010 0x7ff49c0c9390 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00c400 tx=0x7ff48c00c8c0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.774+0000 7ff4a1e07640 1 -- 172.21.15.44:0/1268698468 shutdown_connections 2023-11-04T01:39:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.774+0000 7ff4a1e07640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff48806ae70 0x7ff48806d330 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.774+0000 7ff4a1e07640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff49c0d24c0 0x7ff49c0c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.774+0000 7ff4a1e07640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff49c160440 0x7ff49c0d1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.774+0000 7ff4a1e07640 1 --2- 172.21.15.44:0/1268698468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c0b5010 0x7ff49c0c9390 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.774+0000 7ff4a1e07640 1 -- 172.21.15.44:0/1268698468 >> 172.21.15.44:0/1268698468 conn(0x7ff49c0cf900 msgr2=0x7ff49c15e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.774+0000 7ff4a1e07640 1 -- 172.21.15.44:0/1268698468 shutdown_connections 2023-11-04T01:39:16.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.774+0000 7ff4a1e07640 1 -- 172.21.15.44:0/1268698468 wait complete. 2023-11-04T01:39:16.787 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:39:16.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.892+0000 7f1096733640 1 Processor -- start 2023-11-04T01:39:16.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.892+0000 7f1096733640 1 -- start start 2023-11-04T01:39:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.893+0000 7f1096733640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f109015ad40 0x7f109006b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.893+0000 7f1096733640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f10900c9b60 0x7f1090070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.893+0000 7f1096733640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1090065df0 con 0x7f109015b120 2023-11-04T01:39:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.893+0000 7f1096733640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109006bc40 con 0x7f10900c9b60 2023-11-04T01:39:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.893+0000 7f1096733640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1090066040 con 0x7f109015ad40 2023-11-04T01:39:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.893+0000 7f1094cd0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f10900c9b60 0x7f1090070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.893+0000 7f1094cd0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f10900c9b60 0x7f1090070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55342/0 (socket says 172.21.15.44:55342) 2023-11-04T01:39:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.893+0000 7f1094cd0640 1 -- 172.21.15.44:0/3236026742 learned_addr learned my addr 172.21.15.44:0/3236026742 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.893+0000 7f108ffff640 1 --2- 172.21.15.44:0/3236026742 >> v2:172.21.15.204:3300/0 conn(0x7f109015ad40 0x7f109006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.893+0000 7f1094cd0640 1 -- 172.21.15.44:0/3236026742 >> v2:172.21.15.204:3300/0 conn(0x7f109015ad40 msgr2=0x7f109006b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.893+0000 7f1094cd0640 1 --2- 172.21.15.44:0/3236026742 >> v2:172.21.15.204:3300/0 conn(0x7f109015ad40 0x7f109006b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.893+0000 7f1094cd0640 1 -- 172.21.15.44:0/3236026742 >> v1:172.21.15.204:6789/0 conn(0x7f109015b120 legacy=0x7f109015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.893+0000 7f1094cd0640 1 -- 172.21.15.44:0/3236026742 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1090066320 con 0x7f10900c9b60 2023-11-04T01:39:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.894+0000 7f1094cd0640 1 --2- 172.21.15.44:0/3236026742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10900c9b60 0x7f1090070ff0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f109006e030 tx=0x7f108802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33437f96dbcdde88 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.894+0000 7f108effd640 1 -- 172.21.15.44:0/3236026742 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108802cb20 con 0x7f10900c9b60 2023-11-04T01:39:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.894+0000 7f108effd640 1 -- 172.21.15.44:0/3236026742 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108802cc80 con 0x7f10900c9b60 2023-11-04T01:39:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.894+0000 7f108effd640 1 -- 172.21.15.44:0/3236026742 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880343f0 con 0x7f10900c9b60 2023-11-04T01:39:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.895+0000 7f1096733640 1 -- 172.21.15.44:0/3236026742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10900c9b60 msgr2=0x7f1090070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.895+0000 7f1096733640 1 --2- 172.21.15.44:0/3236026742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10900c9b60 0x7f1090070ff0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f109006e030 tx=0x7f108802bf80 comp rx=0 tx=0).stop 2023-11-04T01:39:16.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.895+0000 7f1096733640 1 -- 172.21.15.44:0/3236026742 shutdown_connections 2023-11-04T01:39:16.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.895+0000 7f1096733640 1 --2- 172.21.15.44:0/3236026742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10900c9b60 0x7f1090070ff0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.895+0000 7f1096733640 1 --2- 172.21.15.44:0/3236026742 >> v2:172.21.15.204:3300/0 conn(0x7f109015ad40 0x7f109006b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.895+0000 7f1096733640 1 -- 172.21.15.44:0/3236026742 >> 172.21.15.44:0/3236026742 conn(0x7f10900cbc90 msgr2=0x7f10900cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.895+0000 7f1096733640 1 -- 172.21.15.44:0/3236026742 shutdown_connections 2023-11-04T01:39:16.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.895+0000 7f1096733640 1 -- 172.21.15.44:0/3236026742 wait complete. 2023-11-04T01:39:16.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.896+0000 7f1096733640 1 Processor -- start 2023-11-04T01:39:16.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.896+0000 7f1096733640 1 -- start start 2023-11-04T01:39:16.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.897+0000 7f1096733640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10900c9b60 0x7f10900cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.897+0000 7f1096733640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f109015ad40 0x7f10900ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.897+0000 7f1096733640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015b120 0x7f10900c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.897+0000 7f1096733640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900c3dc0 con 0x7f10900c9b60 2023-11-04T01:39:16.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.897+0000 7f1096733640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900c31b0 con 0x7f109015ad40 2023-11-04T01:39:16.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.897+0000 7f1096733640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10900c3490 con 0x7f109015b120 2023-11-04T01:39:16.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.897+0000 7f108ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10900c9b60 0x7f10900cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.897+0000 7f108ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10900c9b60 0x7f10900cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55354/0 (socket says 172.21.15.44:55354) 2023-11-04T01:39:16.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.897+0000 7f108ffff640 1 -- 172.21.15.44:0/1045871214 learned_addr learned my addr 172.21.15.44:0/1045871214 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:16.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.897+0000 7f1094cd0640 1 --2- 172.21.15.44:0/1045871214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015b120 0x7f10900c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.897+0000 7f108f7fe640 1 --2- 172.21.15.44:0/1045871214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f109015ad40 0x7f10900ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.898+0000 7f108ffff640 1 -- 172.21.15.44:0/1045871214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015b120 msgr2=0x7f10900c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.898+0000 7f108ffff640 1 --2- 172.21.15.44:0/1045871214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015b120 0x7f10900c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.898+0000 7f108ffff640 1 -- 172.21.15.44:0/1045871214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f109015ad40 msgr2=0x7f10900ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.898+0000 7f108ffff640 1 --2- 172.21.15.44:0/1045871214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f109015ad40 0x7f10900ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.898+0000 7f108ffff640 1 -- 172.21.15.44:0/1045871214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1088009b30 con 0x7f10900c9b60 2023-11-04T01:39:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.898+0000 7f108ffff640 1 --2- 172.21.15.44:0/1045871214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10900c9b60 0x7f10900cdd50 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f108400d800 tx=0x7f108400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.898+0000 7f108cff9640 1 -- 172.21.15.44:0/1045871214 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108400b6c0 con 0x7f10900c9b60 2023-11-04T01:39:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.898+0000 7f108cff9640 1 -- 172.21.15.44:0/1045871214 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108400b840 con 0x7f10900c9b60 2023-11-04T01:39:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.898+0000 7f108cff9640 1 -- 172.21.15.44:0/1045871214 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108400bbf0 con 0x7f10900c9b60 2023-11-04T01:39:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.898+0000 7f1096733640 1 -- 172.21.15.44:0/1045871214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10900c3770 con 0x7f10900c9b60 2023-11-04T01:39:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.898+0000 7f1096733640 1 -- 172.21.15.44:0/1045871214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10900ce290 con 0x7f10900c9b60 2023-11-04T01:39:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.899+0000 7f1096733640 1 -- 172.21.15.44:0/1045871214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1090074290 con 0x7f10900c9b60 2023-11-04T01:39:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.899+0000 7f108cff9640 1 -- 172.21.15.44:0/1045871214 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f108400bd50 con 0x7f10900c9b60 2023-11-04T01:39:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.900+0000 7f108cff9640 1 --2- 172.21.15.44:0/1045871214 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f107c06ae70 0x7f107c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.900+0000 7f108cff9640 1 -- 172.21.15.44:0/1045871214 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f108408a170 con 0x7f10900c9b60 2023-11-04T01:39:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.900+0000 7f108f7fe640 1 --2- 172.21.15.44:0/1045871214 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f107c06ae70 0x7f107c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.900+0000 7f108f7fe640 1 --2- 172.21.15.44:0/1045871214 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f107c06ae70 0x7f107c06d330 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f10901f5e50 tx=0x7f1080009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:16.904+0000 7f108cff9640 1 -- 172.21.15.44:0/1045871214 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1084054c80 con 0x7f10900c9b60 2023-11-04T01:39:17.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.120+0000 7f1096733640 1 -- 172.21.15.44:0/1045871214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f10900ccac0 con 0x7f10900c9b60 2023-11-04T01:39:17.122 INFO:tasks.ceph.mon.a.smithi044.stderr:2023-11-04T01:39:17.121+0000 7fd852594640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:39:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.122+0000 7f108cff9640 1 -- 172.21.15.44:0/1045871214 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7f10840582a0 con 0x7f10900c9b60 2023-11-04T01:39:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:39:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.125+0000 7f1096733640 1 -- 172.21.15.44:0/1045871214 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f107c06ae70 msgr2=0x7f107c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.125+0000 7f1096733640 1 --2- 172.21.15.44:0/1045871214 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f107c06ae70 0x7f107c06d330 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f10901f5e50 tx=0x7f1080009040 comp rx=0 tx=0).stop 2023-11-04T01:39:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.125+0000 7f1096733640 1 -- 172.21.15.44:0/1045871214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10900c9b60 msgr2=0x7f10900cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.125+0000 7f1096733640 1 --2- 172.21.15.44:0/1045871214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10900c9b60 0x7f10900cdd50 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f108400d800 tx=0x7f108400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.125+0000 7f1096733640 1 -- 172.21.15.44:0/1045871214 shutdown_connections 2023-11-04T01:39:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.125+0000 7f1096733640 1 --2- 172.21.15.44:0/1045871214 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f107c06ae70 0x7f107c06d330 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.125+0000 7f1096733640 1 --2- 172.21.15.44:0/1045871214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015b120 0x7f10900c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.125+0000 7f1096733640 1 --2- 172.21.15.44:0/1045871214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f109015ad40 0x7f10900ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.125+0000 7f1096733640 1 --2- 172.21.15.44:0/1045871214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10900c9b60 0x7f10900cdd50 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.125+0000 7f1096733640 1 -- 172.21.15.44:0/1045871214 >> 172.21.15.44:0/1045871214 conn(0x7f10900cbc90 msgr2=0x7f10900afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.125+0000 7f1096733640 1 -- 172.21.15.44:0/1045871214 shutdown_connections 2023-11-04T01:39:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.125+0000 7f1096733640 1 -- 172.21.15.44:0/1045871214 wait complete. 2023-11-04T01:39:17.129 INFO:tasks.ceph.mds.a.smithi044.stderr: -2687> 2023-11-04T01:39:04.382+0000 7ff7040dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:39:17.139 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:39:17.157 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2023-11-04T01:39:17.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.248+0000 7ff3db04b640 1 Processor -- start 2023-11-04T01:39:17.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.248+0000 7ff3db04b640 1 -- start start 2023-11-04T01:39:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.249+0000 7ff3db04b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff3d4160430 0x7ff3d40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.249+0000 7ff3db04b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3d406c3a0 0x7ff3d40cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.249+0000 7ff3db04b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d40b2fc0 con 0x7ff3d40b2b60 2023-11-04T01:39:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.249+0000 7ff3db04b640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d40cb580 con 0x7ff3d4160430 2023-11-04T01:39:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.249+0000 7ff3db04b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d406c7f0 con 0x7ff3d406c3a0 2023-11-04T01:39:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.249+0000 7ff3d8de7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff3d4160430 0x7ff3d40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.249+0000 7ff3d8de7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff3d4160430 0x7ff3d40b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55370/0 (socket says 172.21.15.44:55370) 2023-11-04T01:39:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.249+0000 7ff3d8de7640 1 -- 172.21.15.44:0/3207275764 learned_addr learned my addr 172.21.15.44:0/3207275764 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.249+0000 7ff3d95e8640 1 --2- 172.21.15.44:0/3207275764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3d406c3a0 0x7ff3d40cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.250+0000 7ff3d8de7640 1 -- 172.21.15.44:0/3207275764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3d406c3a0 msgr2=0x7ff3d40cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:17.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.250+0000 7ff3d8de7640 1 --2- 172.21.15.44:0/3207275764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3d406c3a0 0x7ff3d40cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.250+0000 7ff3d8de7640 1 -- 172.21.15.44:0/3207275764 >> v1:172.21.15.204:6789/0 conn(0x7ff3d40b2b60 legacy=0x7ff3d406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.250+0000 7ff3d8de7640 1 -- 172.21.15.44:0/3207275764 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d406ca40 con 0x7ff3d4160430 2023-11-04T01:39:17.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.251+0000 7ff3d8de7640 1 --2- 172.21.15.44:0/3207275764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d4160430 0x7ff3d40b2620 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009870 tx=0x7ff3c402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aedc39e03d491b4d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:17.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.251+0000 7ff3d37fe640 1 -- 172.21.15.44:0/3207275764 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4030840 con 0x7ff3d4160430 2023-11-04T01:39:17.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.251+0000 7ff3d37fe640 1 -- 172.21.15.44:0/3207275764 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c40309a0 con 0x7ff3d4160430 2023-11-04T01:39:17.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.251+0000 7ff3d37fe640 1 -- 172.21.15.44:0/3207275764 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4030d30 con 0x7ff3d4160430 2023-11-04T01:39:17.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.252+0000 7ff3db04b640 1 -- 172.21.15.44:0/3207275764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d4160430 msgr2=0x7ff3d40b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.252+0000 7ff3db04b640 1 --2- 172.21.15.44:0/3207275764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d4160430 0x7ff3d40b2620 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009870 tx=0x7ff3c402b980 comp rx=0 tx=0).stop 2023-11-04T01:39:17.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.252+0000 7ff3db04b640 1 -- 172.21.15.44:0/3207275764 shutdown_connections 2023-11-04T01:39:17.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.252+0000 7ff3db04b640 1 --2- 172.21.15.44:0/3207275764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3d406c3a0 0x7ff3d40cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.252+0000 7ff3db04b640 1 --2- 172.21.15.44:0/3207275764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d4160430 0x7ff3d40b2620 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.252+0000 7ff3db04b640 1 -- 172.21.15.44:0/3207275764 >> 172.21.15.44:0/3207275764 conn(0x7ff3d406ea20 msgr2=0x7ff3d406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:17.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.252+0000 7ff3db04b640 1 -- 172.21.15.44:0/3207275764 shutdown_connections 2023-11-04T01:39:17.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.252+0000 7ff3db04b640 1 -- 172.21.15.44:0/3207275764 wait complete. 2023-11-04T01:39:17.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.253+0000 7ff3db04b640 1 Processor -- start 2023-11-04T01:39:17.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.253+0000 7ff3db04b640 1 -- start start 2023-11-04T01:39:17.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3db04b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3d406c3a0 0x7ff3d41f32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3db04b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3d40b2b60 0x7ff3d40c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3db04b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d4160430 0x7ff3d40ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3db04b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40c50b0 con 0x7ff3d4160430 2023-11-04T01:39:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3db04b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40c4710 con 0x7ff3d406c3a0 2023-11-04T01:39:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3db04b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40c49f0 con 0x7ff3d40b2b60 2023-11-04T01:39:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3d95e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d4160430 0x7ff3d40ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3d95e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d4160430 0x7ff3d40ca380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55386/0 (socket says 172.21.15.44:55386) 2023-11-04T01:39:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3d95e8640 1 -- 172.21.15.44:0/1891951608 learned_addr learned my addr 172.21.15.44:0/1891951608 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3d3fff640 1 --2- 172.21.15.44:0/1891951608 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3d40b2b60 0x7ff3d40c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3d95e8640 1 -- 172.21.15.44:0/1891951608 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3d40b2b60 msgr2=0x7ff3d40c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3d95e8640 1 --2- 172.21.15.44:0/1891951608 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3d40b2b60 0x7ff3d40c9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3d8de7640 1 --2- 172.21.15.44:0/1891951608 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3d406c3a0 0x7ff3d41f32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3d95e8640 1 -- 172.21.15.44:0/1891951608 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3d406c3a0 msgr2=0x7ff3d41f32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3d95e8640 1 --2- 172.21.15.44:0/1891951608 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3d406c3a0 0x7ff3d41f32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.254+0000 7ff3d95e8640 1 -- 172.21.15.44:0/1891951608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c40094d0 con 0x7ff3d4160430 2023-11-04T01:39:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.255+0000 7ff3d95e8640 1 --2- 172.21.15.44:0/1891951608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d4160430 0x7ff3d40ca380 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00efc0 tx=0x7ff3cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.255+0000 7ff3d17fa640 1 -- 172.21.15.44:0/1891951608 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc014480 con 0x7ff3d4160430 2023-11-04T01:39:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.255+0000 7ff3d17fa640 1 -- 172.21.15.44:0/1891951608 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc00f040 con 0x7ff3d4160430 2023-11-04T01:39:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.255+0000 7ff3d17fa640 1 -- 172.21.15.44:0/1891951608 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc014820 con 0x7ff3d4160430 2023-11-04T01:39:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.255+0000 7ff3db04b640 1 -- 172.21.15.44:0/1891951608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d40c4cd0 con 0x7ff3d4160430 2023-11-04T01:39:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.255+0000 7ff3db04b640 1 -- 172.21.15.44:0/1891951608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d415dba0 con 0x7ff3d4160430 2023-11-04T01:39:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.256+0000 7ff3db04b640 1 -- 172.21.15.44:0/1891951608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d40c51f0 con 0x7ff3d4160430 2023-11-04T01:39:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.256+0000 7ff3d17fa640 1 -- 172.21.15.44:0/1891951608 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3cc014980 con 0x7ff3d4160430 2023-11-04T01:39:17.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.257+0000 7ff3d17fa640 1 --2- 172.21.15.44:0/1891951608 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff3c006ae70 0x7ff3c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.257+0000 7ff3d17fa640 1 -- 172.21.15.44:0/1891951608 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7206+0+0 (secure 0 0 0) 0x7ff3cc08a860 con 0x7ff3d4160430 2023-11-04T01:39:17.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.257+0000 7ff3d8de7640 1 --2- 172.21.15.44:0/1891951608 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff3c006ae70 0x7ff3c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.257+0000 7ff3d8de7640 1 --2- 172.21.15.44:0/1891951608 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff3c006ae70 0x7ff3c006d330 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4036000 tx=0x7ff3c403b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:17.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.261+0000 7ff3d17fa640 1 -- 172.21.15.44:0/1891951608 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3d40c51f0 con 0x7ff3d4160430 2023-11-04T01:39:17.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:17.474+0000 7ff3db04b640 1 -- 172.21.15.44:0/1891951608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff3d40c51f0 con 0x7ff3d4160430 2023-11-04T01:39:18.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.123+0000 7ff3d17fa640 1 -- 172.21.15.44:0/1891951608 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff3d40c51f0 con 0x7ff3d4160430 2023-11-04T01:39:18.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.126+0000 7ff3db04b640 1 -- 172.21.15.44:0/1891951608 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff3c006ae70 msgr2=0x7ff3c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.126+0000 7ff3db04b640 1 --2- 172.21.15.44:0/1891951608 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff3c006ae70 0x7ff3c006d330 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4036000 tx=0x7ff3c403b040 comp rx=0 tx=0).stop 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.126+0000 7ff3db04b640 1 -- 172.21.15.44:0/1891951608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d4160430 msgr2=0x7ff3d40ca380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.126+0000 7ff3db04b640 1 --2- 172.21.15.44:0/1891951608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d4160430 0x7ff3d40ca380 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00efc0 tx=0x7ff3cc00c490 comp rx=0 tx=0).stop 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.126+0000 7ff3db04b640 1 -- 172.21.15.44:0/1891951608 shutdown_connections 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.126+0000 7ff3db04b640 1 --2- 172.21.15.44:0/1891951608 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff3c006ae70 0x7ff3c006d330 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.126+0000 7ff3db04b640 1 --2- 172.21.15.44:0/1891951608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d4160430 0x7ff3d40ca380 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.126+0000 7ff3db04b640 1 --2- 172.21.15.44:0/1891951608 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3d40b2b60 0x7ff3d40c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.126+0000 7ff3db04b640 1 --2- 172.21.15.44:0/1891951608 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3d406c3a0 0x7ff3d41f32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.126+0000 7ff3db04b640 1 -- 172.21.15.44:0/1891951608 >> 172.21.15.44:0/1891951608 conn(0x7ff3d406ea20 msgr2=0x7ff3d40afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.126+0000 7ff3db04b640 1 -- 172.21.15.44:0/1891951608 shutdown_connections 2023-11-04T01:39:18.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.126+0000 7ff3db04b640 1 -- 172.21.15.44:0/1891951608 wait complete. 2023-11-04T01:39:18.142 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:39:18.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.298+0000 7f4b84cb4640 1 Processor -- start 2023-11-04T01:39:18.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.298+0000 7f4b84cb4640 1 -- start start 2023-11-04T01:39:18.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.299+0000 7f4b84cb4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4b800cd9f0 0x7f4b800cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.299+0000 7f4b84cb4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b800d1320 con 0x7f4b800d27c0 2023-11-04T01:39:18.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.299+0000 7f4b84cb4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b800b5600 con 0x7f4b8015d4b0 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.299+0000 7f4b84cb4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8015e4d0 con 0x7f4b800cd9f0 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.299+0000 7f4b7e59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4b800cd9f0 0x7f4b800cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.299+0000 7f4b7ed9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4b800d27c0 0x7f4b800b4ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37732/0 (socket says 172.21.15.44:37732) 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.299+0000 7f4b7ed9d640 1 -- 172.21.15.44:0/629119392 learned_addr learned my addr 172.21.15.44:0/629119392 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.299+0000 7f4b7e59c640 1 -- 172.21.15.44:0/629119392 >> v1:172.21.15.204:6789/0 conn(0x7f4b8015d4b0 legacy=0x7f4b800b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.299+0000 7f4b7e59c640 1 -- 172.21.15.44:0/629119392 >> v1:172.21.15.44:6789/0 conn(0x7f4b800d27c0 legacy=0x7f4b800b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.299+0000 7f4b7e59c640 1 -- 172.21.15.44:0/629119392 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800ce310 con 0x7f4b800cd9f0 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.299+0000 7f4b7d59a640 1 -- 172.21.15.44:0/629119392 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128172526 0 0) 0x7f4b800d1320 con 0x7f4b800d27c0 2023-11-04T01:39:18.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.300+0000 7f4b7e59c640 1 --2- 172.21.15.44:0/629119392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b800cd9f0 0x7f4b800cddd0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f4b700097d0 tx=0x7f4b7002b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93ce838b6741d45 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.300+0000 7f4b7d59a640 1 -- 172.21.15.44:0/629119392 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70030890 con 0x7f4b800cd9f0 2023-11-04T01:39:18.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.300+0000 7f4b7d59a640 1 -- 172.21.15.44:0/629119392 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b700309f0 con 0x7f4b800cd9f0 2023-11-04T01:39:18.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.300+0000 7f4b7d59a640 1 -- 172.21.15.44:0/629119392 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70030d80 con 0x7f4b800cd9f0 2023-11-04T01:39:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.301+0000 7f4b84cb4640 1 -- 172.21.15.44:0/629119392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b800cd9f0 msgr2=0x7f4b800cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.301+0000 7f4b84cb4640 1 --2- 172.21.15.44:0/629119392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b800cd9f0 0x7f4b800cddd0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f4b700097d0 tx=0x7f4b7002b9d0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.301+0000 7f4b84cb4640 1 -- 172.21.15.44:0/629119392 shutdown_connections 2023-11-04T01:39:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.301+0000 7f4b84cb4640 1 --2- 172.21.15.44:0/629119392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b800cd9f0 0x7f4b800cddd0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.301+0000 7f4b84cb4640 1 -- 172.21.15.44:0/629119392 >> 172.21.15.44:0/629119392 conn(0x7f4b80071c40 msgr2=0x7f4b80072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.301+0000 7f4b84cb4640 1 -- 172.21.15.44:0/629119392 shutdown_connections 2023-11-04T01:39:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.301+0000 7f4b84cb4640 1 -- 172.21.15.44:0/629119392 wait complete. 2023-11-04T01:39:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.302+0000 7f4b84cb4640 1 Processor -- start 2023-11-04T01:39:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.302+0000 7f4b84cb4640 1 -- start start 2023-11-04T01:39:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.303+0000 7f4b84cb4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800cd9f0 0x7f4b80157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.303+0000 7f4b84cb4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b800d27c0 0x7f4b800c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.303+0000 7f4b84cb4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b8015d4b0 0x7f4b800cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.303+0000 7f4b84cb4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b80146b00 con 0x7f4b800d27c0 2023-11-04T01:39:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.303+0000 7f4b84cb4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800c9470 con 0x7f4b800cd9f0 2023-11-04T01:39:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.303+0000 7f4b84cb4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b80145ec0 con 0x7f4b8015d4b0 2023-11-04T01:39:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.303+0000 7f4b7dd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b800d27c0 0x7f4b800c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.303+0000 7f4b7dd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b800d27c0 0x7f4b800c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55404/0 (socket says 172.21.15.44:55404) 2023-11-04T01:39:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.303+0000 7f4b7dd9b640 1 -- 172.21.15.44:0/291409432 learned_addr learned my addr 172.21.15.44:0/291409432 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.304+0000 7f4b7ed9d640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b8015d4b0 0x7f4b800cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.304+0000 7f4b7e59c640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800cd9f0 0x7f4b80157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.304+0000 7f4b7dd9b640 1 -- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b8015d4b0 msgr2=0x7f4b800cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.304+0000 7f4b7dd9b640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b8015d4b0 0x7f4b800cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.304+0000 7f4b7dd9b640 1 -- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800cd9f0 msgr2=0x7f4b80157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.304+0000 7f4b7dd9b640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800cd9f0 0x7f4b80157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.304+0000 7f4b7dd9b640 1 -- 172.21.15.44:0/291409432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b70009400 con 0x7f4b800d27c0 2023-11-04T01:39:18.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.304+0000 7f4b7ed9d640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b8015d4b0 0x7f4b800cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:18.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.304+0000 7f4b7e59c640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800cd9f0 0x7f4b80157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:18.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.304+0000 7f4b7dd9b640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b800d27c0 0x7f4b800c8f30 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400c450 tx=0x7f4b7400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.304+0000 7f4b6effd640 1 -- 172.21.15.44:0/291409432 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b740052d0 con 0x7f4b800d27c0 2023-11-04T01:39:18.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.304+0000 7f4b6effd640 1 -- 172.21.15.44:0/291409432 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b74005430 con 0x7f4b800d27c0 2023-11-04T01:39:18.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.304+0000 7f4b6effd640 1 -- 172.21.15.44:0/291409432 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74012870 con 0x7f4b800d27c0 2023-11-04T01:39:18.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.304+0000 7f4b84cb4640 1 -- 172.21.15.44:0/291409432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b80146160 con 0x7f4b800d27c0 2023-11-04T01:39:18.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.304+0000 7f4b84cb4640 1 -- 172.21.15.44:0/291409432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b80146720 con 0x7f4b800d27c0 2023-11-04T01:39:18.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.305+0000 7f4b84cb4640 1 -- 172.21.15.44:0/291409432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b80146c40 con 0x7f4b800d27c0 2023-11-04T01:39:18.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.305+0000 7f4b6effd640 1 -- 172.21.15.44:0/291409432 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b740129d0 con 0x7f4b800d27c0 2023-11-04T01:39:18.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.306+0000 7f4b6effd640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4b6006ae70 0x7f4b6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.306+0000 7f4b6effd640 1 -- 172.21.15.44:0/291409432 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f4b740896a0 con 0x7f4b800d27c0 2023-11-04T01:39:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.306+0000 7f4b7e59c640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4b6006ae70 0x7f4b6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.307+0000 7f4b7e59c640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4b6006ae70 0x7f4b6006d330 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4b70036000 tx=0x7f4b7003b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.310+0000 7f4b6effd640 1 -- 172.21.15.44:0/291409432 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4b80146c40 con 0x7f4b800d27c0 2023-11-04T01:39:18.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:18.487+0000 7f4b84cb4640 1 -- 172.21.15.44:0/291409432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4b80146c40 con 0x7f4b800d27c0 2023-11-04T01:39:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.196+0000 7f4b6effd640 1 -- 172.21.15.44:0/291409432 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4b80146c40 con 0x7f4b800d27c0 2023-11-04T01:39:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:39:19.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.202+0000 7f4b84cb4640 1 -- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4b6006ae70 msgr2=0x7f4b6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.202+0000 7f4b84cb4640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4b6006ae70 0x7f4b6006d330 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4b70036000 tx=0x7f4b7003b040 comp rx=0 tx=0).stop 2023-11-04T01:39:19.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.202+0000 7f4b84cb4640 1 -- 172.21.15.44:0/291409432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b800d27c0 msgr2=0x7f4b800c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.202+0000 7f4b84cb4640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b800d27c0 0x7f4b800c8f30 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400c450 tx=0x7f4b7400c910 comp rx=0 tx=0).stop 2023-11-04T01:39:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.203+0000 7f4b84cb4640 1 -- 172.21.15.44:0/291409432 shutdown_connections 2023-11-04T01:39:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.203+0000 7f4b84cb4640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4b6006ae70 0x7f4b6006d330 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.203+0000 7f4b84cb4640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b8015d4b0 0x7f4b800cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.203+0000 7f4b84cb4640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b800d27c0 0x7f4b800c8f30 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.203+0000 7f4b84cb4640 1 --2- 172.21.15.44:0/291409432 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800cd9f0 0x7f4b80157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.203+0000 7f4b84cb4640 1 -- 172.21.15.44:0/291409432 >> 172.21.15.44:0/291409432 conn(0x7f4b80071c40 msgr2=0x7f4b80072020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.203+0000 7f4b84cb4640 1 -- 172.21.15.44:0/291409432 shutdown_connections 2023-11-04T01:39:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.203+0000 7f4b84cb4640 1 -- 172.21.15.44:0/291409432 wait complete. 2023-11-04T01:39:19.219 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:39:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.334+0000 7f43b9ce7640 1 Processor -- start 2023-11-04T01:39:19.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.335+0000 7f43b9ce7640 1 -- start start 2023-11-04T01:39:19.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.335+0000 7f43b9ce7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43b40cd9f0 0x7f43b40cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.335+0000 7f43b9ce7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f43b415d4b0 0x7f43b415d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.335+0000 7f43b9ce7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f43b40b47e0 0x7f43b40b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.335+0000 7f43b9ce7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b415e4d0 con 0x7f43b415d4b0 2023-11-04T01:39:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.335+0000 7f43b9ce7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b40d1320 con 0x7f43b40b47e0 2023-11-04T01:39:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.335+0000 7f43b9ce7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b40ce310 con 0x7f43b40cd9f0 2023-11-04T01:39:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.336+0000 7f43b2ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f43b415d4b0 0x7f43b415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.336+0000 7f43b2ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f43b415d4b0 0x7f43b415d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55406/0 (socket says 172.21.15.44:55406) 2023-11-04T01:39:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.336+0000 7f43b2ffd640 1 -- 172.21.15.44:0/1930832791 learned_addr learned my addr 172.21.15.44:0/1930832791 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.336+0000 7f43b37fe640 1 --2- 172.21.15.44:0/1930832791 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43b40cd9f0 0x7f43b40cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.336+0000 7f43b3fff640 1 --2- 172.21.15.44:0/1930832791 >> v2:172.21.15.204:3300/0 conn(0x7f43b40b47e0 0x7f43b40b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.336+0000 7f43b2ffd640 1 -- 172.21.15.44:0/1930832791 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43b40cd9f0 msgr2=0x7f43b40cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.336+0000 7f43b2ffd640 1 --2- 172.21.15.44:0/1930832791 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43b40cd9f0 0x7f43b40cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.336+0000 7f43b2ffd640 1 -- 172.21.15.44:0/1930832791 >> v2:172.21.15.204:3300/0 conn(0x7f43b40b47e0 msgr2=0x7f43b40b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.336+0000 7f43b2ffd640 1 --2- 172.21.15.44:0/1930832791 >> v2:172.21.15.204:3300/0 conn(0x7f43b40b47e0 0x7f43b40b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.336+0000 7f43b2ffd640 1 -- 172.21.15.44:0/1930832791 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b415df10 con 0x7f43b415d4b0 2023-11-04T01:39:19.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.336+0000 7f43b3fff640 1 --2- 172.21.15.44:0/1930832791 >> v2:172.21.15.204:3300/0 conn(0x7f43b40b47e0 0x7f43b40b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:19.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.337+0000 7f43b2ffd640 1 --2- 172.21.15.44:0/1930832791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b415d4b0 0x7f43b415d910 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f43b40cd670 tx=0x7f439c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df1bbe09b0534e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.337+0000 7f43b27fc640 1 -- 172.21.15.44:0/1930832791 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c030860 con 0x7f43b415d4b0 2023-11-04T01:39:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.337+0000 7f43b27fc640 1 -- 172.21.15.44:0/1930832791 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c0309c0 con 0x7f43b415d4b0 2023-11-04T01:39:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.337+0000 7f43b27fc640 1 -- 172.21.15.44:0/1930832791 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c030d50 con 0x7f43b415d4b0 2023-11-04T01:39:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.337+0000 7f43b9ce7640 1 -- 172.21.15.44:0/1930832791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b415d4b0 msgr2=0x7f43b415d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.337+0000 7f43b9ce7640 1 --2- 172.21.15.44:0/1930832791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b415d4b0 0x7f43b415d910 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f43b40cd670 tx=0x7f439c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.337+0000 7f43b9ce7640 1 -- 172.21.15.44:0/1930832791 shutdown_connections 2023-11-04T01:39:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.337+0000 7f43b9ce7640 1 --2- 172.21.15.44:0/1930832791 >> v2:172.21.15.204:3300/0 conn(0x7f43b40b47e0 0x7f43b40b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.337+0000 7f43b9ce7640 1 --2- 172.21.15.44:0/1930832791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b415d4b0 0x7f43b415d910 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.337+0000 7f43b9ce7640 1 --2- 172.21.15.44:0/1930832791 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43b40cd9f0 0x7f43b40cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.337+0000 7f43b9ce7640 1 -- 172.21.15.44:0/1930832791 >> 172.21.15.44:0/1930832791 conn(0x7f43b4071c40 msgr2=0x7f43b4072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.338+0000 7f43b9ce7640 1 -- 172.21.15.44:0/1930832791 shutdown_connections 2023-11-04T01:39:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.338+0000 7f43b9ce7640 1 -- 172.21.15.44:0/1930832791 wait complete. 2023-11-04T01:39:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.339+0000 7f43b9ce7640 1 Processor -- start 2023-11-04T01:39:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.339+0000 7f43b9ce7640 1 -- start start 2023-11-04T01:39:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b9ce7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43b40b47e0 0x7f43b4159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b9ce7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40cd9f0 0x7f43b4147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b9ce7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43b415d4b0 0x7f43b4148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b9ce7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b4157510 con 0x7f43b40cd9f0 2023-11-04T01:39:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b9ce7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b40c7e50 con 0x7f43b415d4b0 2023-11-04T01:39:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b9ce7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b4159b90 con 0x7f43b40b47e0 2023-11-04T01:39:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40cd9f0 0x7f43b4147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40cd9f0 0x7f43b4147860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55420/0 (socket says 172.21.15.44:55420) 2023-11-04T01:39:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b2ffd640 1 -- 172.21.15.44:0/4040435269 learned_addr learned my addr 172.21.15.44:0/4040435269 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b37fe640 1 --2- 172.21.15.44:0/4040435269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43b40b47e0 0x7f43b4159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b3fff640 1 --2- 172.21.15.44:0/4040435269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43b415d4b0 0x7f43b4148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b2ffd640 1 -- 172.21.15.44:0/4040435269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43b40b47e0 msgr2=0x7f43b4159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b2ffd640 1 --2- 172.21.15.44:0/4040435269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43b40b47e0 0x7f43b4159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b2ffd640 1 -- 172.21.15.44:0/4040435269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43b415d4b0 msgr2=0x7f43b4148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b2ffd640 1 --2- 172.21.15.44:0/4040435269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43b415d4b0 0x7f43b4148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b2ffd640 1 -- 172.21.15.44:0/4040435269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c0094d0 con 0x7f43b40cd9f0 2023-11-04T01:39:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b3fff640 1 --2- 172.21.15.44:0/4040435269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43b415d4b0 0x7f43b4148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b2ffd640 1 --2- 172.21.15.44:0/4040435269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40cd9f0 0x7f43b4147860 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f439c02b9e0 tx=0x7f439c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43abfff640 1 -- 172.21.15.44:0/4040435269 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c030850 con 0x7f43b40cd9f0 2023-11-04T01:39:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43abfff640 1 -- 172.21.15.44:0/4040435269 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c039d90 con 0x7f43b40cd9f0 2023-11-04T01:39:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b9ce7640 1 -- 172.21.15.44:0/4040435269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b40cc990 con 0x7f43b40cd9f0 2023-11-04T01:39:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43abfff640 1 -- 172.21.15.44:0/4040435269 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c043650 con 0x7f43b40cd9f0 2023-11-04T01:39:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.340+0000 7f43b9ce7640 1 -- 172.21.15.44:0/4040435269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b40c83d0 con 0x7f43b40cd9f0 2023-11-04T01:39:19.346 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.341+0000 7f43b9ce7640 1 -- 172.21.15.44:0/4040435269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b40d2780 con 0x7f43b40cd9f0 2023-11-04T01:39:19.346 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.342+0000 7f43abfff640 1 -- 172.21.15.44:0/4040435269 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f439c04c3b0 con 0x7f43b40cd9f0 2023-11-04T01:39:19.346 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.342+0000 7f43abfff640 1 --2- 172.21.15.44:0/4040435269 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f439406ae70 0x7f439406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.347 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.342+0000 7f43abfff640 1 -- 172.21.15.44:0/4040435269 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6768+0+0 (secure 0 0 0) 0x7f439c0abfb0 con 0x7f43b40cd9f0 2023-11-04T01:39:19.347 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.343+0000 7f43b37fe640 1 --2- 172.21.15.44:0/4040435269 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f439406ae70 0x7f439406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.347 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.343+0000 7f43b37fe640 1 --2- 172.21.15.44:0/4040435269 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f439406ae70 0x7f439406d330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f43b40cf7e0 tx=0x7f43a4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:19.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.346+0000 7f43abfff640 1 -- 172.21.15.44:0/4040435269 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f439c076cd0 con 0x7f43b40cd9f0 2023-11-04T01:39:19.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:19.524+0000 7f43b9ce7640 1 -- 172.21.15.44:0/4040435269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f43b404e490 con 0x7f43b40cd9f0 2023-11-04T01:39:20.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.488+0000 7f43abfff640 1 -- 172.21.15.44:0/4040435269 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) v1 ==== 169+0+0 (secure 0 0 0) 0x7f439c07a2f0 con 0x7f43b40cd9f0 2023-11-04T01:39:20.491 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2023-11-04T01:39:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.492+0000 7f43b9ce7640 1 -- 172.21.15.44:0/4040435269 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f439406ae70 msgr2=0x7f439406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.493+0000 7f43b9ce7640 1 --2- 172.21.15.44:0/4040435269 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f439406ae70 0x7f439406d330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f43b40cf7e0 tx=0x7f43a4008040 comp rx=0 tx=0).stop 2023-11-04T01:39:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.493+0000 7f43b9ce7640 1 -- 172.21.15.44:0/4040435269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40cd9f0 msgr2=0x7f43b4147860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.493+0000 7f43b9ce7640 1 --2- 172.21.15.44:0/4040435269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40cd9f0 0x7f43b4147860 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f439c02b9e0 tx=0x7f439c004730 comp rx=0 tx=0).stop 2023-11-04T01:39:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.493+0000 7f43b9ce7640 1 -- 172.21.15.44:0/4040435269 shutdown_connections 2023-11-04T01:39:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.493+0000 7f43b9ce7640 1 --2- 172.21.15.44:0/4040435269 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f439406ae70 0x7f439406d330 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.493+0000 7f43b9ce7640 1 --2- 172.21.15.44:0/4040435269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43b415d4b0 0x7f43b4148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.493+0000 7f43b9ce7640 1 --2- 172.21.15.44:0/4040435269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40cd9f0 0x7f43b4147860 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.493+0000 7f43b9ce7640 1 --2- 172.21.15.44:0/4040435269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43b40b47e0 0x7f43b4159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.493+0000 7f43b9ce7640 1 -- 172.21.15.44:0/4040435269 >> 172.21.15.44:0/4040435269 conn(0x7f43b4071c40 msgr2=0x7f43b40b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:20.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.494+0000 7f43b9ce7640 1 -- 172.21.15.44:0/4040435269 shutdown_connections 2023-11-04T01:39:20.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.494+0000 7f43b9ce7640 1 -- 172.21.15.44:0/4040435269 wait complete. 2023-11-04T01:39:20.510 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:39:20.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.622+0000 7fd1d5efc640 1 Processor -- start 2023-11-04T01:39:20.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.623+0000 7fd1d5efc640 1 -- start start 2023-11-04T01:39:20.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.623+0000 7fd1d5efc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd1d0153e60 0x7fd1d015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.623+0000 7fd1d5efc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d00cde60 con 0x7fd1d00b4880 2023-11-04T01:39:20.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.623+0000 7fd1d5efc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d0160f90 con 0x7fd1d00cd6d0 2023-11-04T01:39:20.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.623+0000 7fd1d5efc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d015e400 con 0x7fd1d0153e60 2023-11-04T01:39:20.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.624+0000 7fd1cf7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd1d0153e60 0x7fd1d015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.624+0000 7fd1cffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd1d00b4880 0x7fd1d00d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37746/0 (socket says 172.21.15.44:37746) 2023-11-04T01:39:20.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.624+0000 7fd1cffff640 1 -- 172.21.15.44:0/2249953138 learned_addr learned my addr 172.21.15.44:0/2249953138 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:20.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.624+0000 7fd1cf7fe640 1 -- 172.21.15.44:0/2249953138 >> v1:172.21.15.204:6789/0 conn(0x7fd1d00cd6d0 legacy=0x7fd1d0161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:20.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.624+0000 7fd1cf7fe640 1 -- 172.21.15.44:0/2249953138 >> v1:172.21.15.44:6789/0 conn(0x7fd1d00b4880 legacy=0x7fd1d00d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.624+0000 7fd1ce7fc640 1 -- 172.21.15.44:0/2249953138 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803307158 0 0) 0x7fd1d00cde60 con 0x7fd1d00b4880 2023-11-04T01:39:20.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.624+0000 7fd1cf7fe640 1 -- 172.21.15.44:0/2249953138 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d00ce090 con 0x7fd1d0153e60 2023-11-04T01:39:20.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.625+0000 7fd1cf7fe640 1 --2- 172.21.15.44:0/2249953138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d0153e60 0x7fd1d015dec0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00097a0 tx=0x7fd1c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee22847c7fd3034 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:20.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.625+0000 7fd1ce7fc640 1 -- 172.21.15.44:0/2249953138 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0031830 con 0x7fd1d0153e60 2023-11-04T01:39:20.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.625+0000 7fd1ce7fc640 1 -- 172.21.15.44:0/2249953138 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c0031990 con 0x7fd1d0153e60 2023-11-04T01:39:20.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.625+0000 7fd1ce7fc640 1 -- 172.21.15.44:0/2249953138 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0031d20 con 0x7fd1d0153e60 2023-11-04T01:39:20.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.625+0000 7fd1d5efc640 1 -- 172.21.15.44:0/2249953138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d0153e60 msgr2=0x7fd1d015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.625+0000 7fd1d5efc640 1 --2- 172.21.15.44:0/2249953138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d0153e60 0x7fd1d015dec0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00097a0 tx=0x7fd1c002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.626+0000 7fd1d5efc640 1 -- 172.21.15.44:0/2249953138 shutdown_connections 2023-11-04T01:39:20.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.626+0000 7fd1d5efc640 1 --2- 172.21.15.44:0/2249953138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d0153e60 0x7fd1d015dec0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.626+0000 7fd1d5efc640 1 -- 172.21.15.44:0/2249953138 >> 172.21.15.44:0/2249953138 conn(0x7fd1d00cf880 msgr2=0x7fd1d00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:20.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.626+0000 7fd1d5efc640 1 -- 172.21.15.44:0/2249953138 shutdown_connections 2023-11-04T01:39:20.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.626+0000 7fd1d5efc640 1 -- 172.21.15.44:0/2249953138 wait complete. 2023-11-04T01:39:20.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.627+0000 7fd1d5efc640 1 Processor -- start 2023-11-04T01:39:20.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.627+0000 7fd1d5efc640 1 -- start start 2023-11-04T01:39:20.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1d5efc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd1d00b4880 0x7fd1d01f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1d5efc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d00cd6d0 0x7fd1d00cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1d5efc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd1d0153e60 0x7fd1d01f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1d5efc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00cc220 con 0x7fd1d00cd6d0 2023-11-04T01:39:20.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1d5efc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d01570d0 con 0x7fd1d00b4880 2023-11-04T01:39:20.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1d5efc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00c6aa0 con 0x7fd1d0153e60 2023-11-04T01:39:20.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1ceffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d00cd6d0 0x7fd1d00cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1ceffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d00cd6d0 0x7fd1d00cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55438/0 (socket says 172.21.15.44:55438) 2023-11-04T01:39:20.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1ceffd640 1 -- 172.21.15.44:0/490880674 learned_addr learned my addr 172.21.15.44:0/490880674 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:20.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1ceffd640 1 -- 172.21.15.44:0/490880674 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd1d0153e60 msgr2=0x7fd1d01f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1ceffd640 1 --2- 172.21.15.44:0/490880674 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd1d0153e60 0x7fd1d01f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1ceffd640 1 -- 172.21.15.44:0/490880674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd1d00b4880 msgr2=0x7fd1d01f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1cf7fe640 1 --2- 172.21.15.44:0/490880674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd1d00b4880 0x7fd1d01f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1ceffd640 1 --2- 172.21.15.44:0/490880674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd1d00b4880 0x7fd1d01f3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1ceffd640 1 -- 172.21.15.44:0/490880674 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c0009400 con 0x7fd1d00cd6d0 2023-11-04T01:39:20.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1ceffd640 1 --2- 172.21.15.44:0/490880674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d00cd6d0 0x7fd1d00cb840 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400c400 tx=0x7fd1c400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:20.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1b7fff640 1 -- 172.21.15.44:0/490880674 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40035f0 con 0x7fd1d00cd6d0 2023-11-04T01:39:20.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1b7fff640 1 -- 172.21.15.44:0/490880674 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c4003750 con 0x7fd1d00cd6d0 2023-11-04T01:39:20.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1b7fff640 1 -- 172.21.15.44:0/490880674 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4003b40 con 0x7fd1d00cd6d0 2023-11-04T01:39:20.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.628+0000 7fd1d5efc640 1 -- 172.21.15.44:0/490880674 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d00c6d80 con 0x7fd1d00cd6d0 2023-11-04T01:39:20.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.629+0000 7fd1d5efc640 1 -- 172.21.15.44:0/490880674 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d00c7340 con 0x7fd1d00cd6d0 2023-11-04T01:39:20.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.630+0000 7fd1d5efc640 1 -- 172.21.15.44:0/490880674 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d0074290 con 0x7fd1d00cd6d0 2023-11-04T01:39:20.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.630+0000 7fd1b7fff640 1 -- 172.21.15.44:0/490880674 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd1c4003ca0 con 0x7fd1d00cd6d0 2023-11-04T01:39:20.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.630+0000 7fd1b7fff640 1 --2- 172.21.15.44:0/490880674 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd1bc06ae70 0x7fd1bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.631+0000 7fd1b7fff640 1 -- 172.21.15.44:0/490880674 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fd1c4088a30 con 0x7fd1d00cd6d0 2023-11-04T01:39:20.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.631+0000 7fd1cf7fe640 1 --2- 172.21.15.44:0/490880674 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd1bc06ae70 0x7fd1bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.631+0000 7fd1cf7fe640 1 --2- 172.21.15.44:0/490880674 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd1bc06ae70 0x7fd1bc06d330 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0036000 tx=0x7fd1c003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:20.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.635+0000 7fd1b7fff640 1 -- 172.21.15.44:0/490880674 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd1c4053920 con 0x7fd1d00cd6d0 2023-11-04T01:39:20.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.809+0000 7fd1d5efc640 1 -- 172.21.15.44:0/490880674 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd1d00c66b0 con 0x7fd1d00cd6d0 2023-11-04T01:39:20.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.812+0000 7fd1b7fff640 1 -- 172.21.15.44:0/490880674 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd1c4056f40 con 0x7fd1d00cd6d0 2023-11-04T01:39:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.814+0000 7fd1d5efc640 1 -- 172.21.15.44:0/490880674 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd1bc06ae70 msgr2=0x7fd1bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.814+0000 7fd1d5efc640 1 --2- 172.21.15.44:0/490880674 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd1bc06ae70 0x7fd1bc06d330 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0036000 tx=0x7fd1c003c040 comp rx=0 tx=0).stop 2023-11-04T01:39:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.814+0000 7fd1d5efc640 1 -- 172.21.15.44:0/490880674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d00cd6d0 msgr2=0x7fd1d00cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.814+0000 7fd1d5efc640 1 --2- 172.21.15.44:0/490880674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d00cd6d0 0x7fd1d00cb840 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400c400 tx=0x7fd1c400c8c0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.814+0000 7fd1d5efc640 1 -- 172.21.15.44:0/490880674 shutdown_connections 2023-11-04T01:39:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.814+0000 7fd1d5efc640 1 --2- 172.21.15.44:0/490880674 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd1bc06ae70 0x7fd1bc06d330 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.814+0000 7fd1d5efc640 1 --2- 172.21.15.44:0/490880674 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd1d0153e60 0x7fd1d01f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.814+0000 7fd1d5efc640 1 --2- 172.21.15.44:0/490880674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d00cd6d0 0x7fd1d00cb840 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.814+0000 7fd1d5efc640 1 --2- 172.21.15.44:0/490880674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd1d00b4880 0x7fd1d01f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.814+0000 7fd1d5efc640 1 -- 172.21.15.44:0/490880674 >> 172.21.15.44:0/490880674 conn(0x7fd1d00cf880 msgr2=0x7fd1d00d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:20.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.815+0000 7fd1d5efc640 1 -- 172.21.15.44:0/490880674 shutdown_connections 2023-11-04T01:39:20.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.815+0000 7fd1d5efc640 1 -- 172.21.15.44:0/490880674 wait complete. 2023-11-04T01:39:20.827 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config' 2023-11-04T01:39:20.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.931+0000 7f6f420e5640 1 Processor -- start 2023-11-04T01:39:20.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.931+0000 7f6f420e5640 1 -- start start 2023-11-04T01:39:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.932+0000 7f6f420e5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6f3c0cda30 0x7f6f3c165ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.932+0000 7f6f420e5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c0cc450 con 0x7f6f3c15ae40 2023-11-04T01:39:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.932+0000 7f6f420e5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c15f400 con 0x7f6f3c15bfb0 2023-11-04T01:39:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.932+0000 7f6f420e5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c15b220 con 0x7f6f3c0cda30 2023-11-04T01:39:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.932+0000 7f6f3bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6f3c0cda30 0x7f6f3c165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.932+0000 7f6f3b7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6f3c15ae40 0x7f6f3c0cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37750/0 (socket says 172.21.15.44:37750) 2023-11-04T01:39:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.932+0000 7f6f3b7fe640 1 -- 172.21.15.44:0/1060658341 learned_addr learned my addr 172.21.15.44:0/1060658341 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.932+0000 7f6f3bfff640 1 -- 172.21.15.44:0/1060658341 >> v1:172.21.15.204:6789/0 conn(0x7f6f3c15bfb0 legacy=0x7f6f3c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.932+0000 7f6f3bfff640 1 -- 172.21.15.44:0/1060658341 >> v1:172.21.15.44:6789/0 conn(0x7f6f3c15ae40 legacy=0x7f6f3c0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.932+0000 7f6f3bfff640 1 -- 172.21.15.44:0/1060658341 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c15f890 con 0x7f6f3c0cda30 2023-11-04T01:39:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.932+0000 7f6f3a7fc640 1 -- 172.21.15.44:0/1060658341 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222857772 0 0) 0x7f6f2c001110 con 0x7f6f3c15ae40 2023-11-04T01:39:20.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.933+0000 7f6f3bfff640 1 --2- 172.21.15.44:0/1060658341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f3c0cda30 0x7f6f3c165ce0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f6f34009d90 tx=0x7f6f3402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296f3e42e704f62b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:20.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.933+0000 7f6f3a7fc640 1 -- 172.21.15.44:0/1060658341 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3402cc60 con 0x7f6f3c0cda30 2023-11-04T01:39:20.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.933+0000 7f6f3a7fc640 1 -- 172.21.15.44:0/1060658341 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3402cdc0 con 0x7f6f3c0cda30 2023-11-04T01:39:20.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.933+0000 7f6f3a7fc640 1 -- 172.21.15.44:0/1060658341 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f34034660 con 0x7f6f3c0cda30 2023-11-04T01:39:20.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.934+0000 7f6f420e5640 1 -- 172.21.15.44:0/1060658341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f3c0cda30 msgr2=0x7f6f3c165ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.934+0000 7f6f420e5640 1 --2- 172.21.15.44:0/1060658341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f3c0cda30 0x7f6f3c165ce0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f6f34009d90 tx=0x7f6f3402beb0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.934+0000 7f6f420e5640 1 -- 172.21.15.44:0/1060658341 shutdown_connections 2023-11-04T01:39:20.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.934+0000 7f6f420e5640 1 --2- 172.21.15.44:0/1060658341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f3c0cda30 0x7f6f3c165ce0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.934+0000 7f6f420e5640 1 -- 172.21.15.44:0/1060658341 >> 172.21.15.44:0/1060658341 conn(0x7f6f3c06ea90 msgr2=0x7f6f3c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:20.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.934+0000 7f6f420e5640 1 -- 172.21.15.44:0/1060658341 shutdown_connections 2023-11-04T01:39:20.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.934+0000 7f6f420e5640 1 -- 172.21.15.44:0/1060658341 wait complete. 2023-11-04T01:39:20.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.935+0000 7f6f420e5640 1 Processor -- start 2023-11-04T01:39:20.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.935+0000 7f6f420e5640 1 -- start start 2023-11-04T01:39:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f420e5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6f3c0cda30 0x7f6f3c0b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f420e5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f3c15ae40 0x7f6f3c141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f420e5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f3c15bfb0 0x7f6f3c141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f420e5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c1424a0 con 0x7f6f3c15ae40 2023-11-04T01:39:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f420e5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c0c46b0 con 0x7f6f3c0cda30 2023-11-04T01:39:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f420e5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c0c4f50 con 0x7f6f3c15bfb0 2023-11-04T01:39:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f3affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f3c15ae40 0x7f6f3c141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f3affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f3c15ae40 0x7f6f3c141a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55454/0 (socket says 172.21.15.44:55454) 2023-11-04T01:39:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f3affd640 1 -- 172.21.15.44:0/3580467780 learned_addr learned my addr 172.21.15.44:0/3580467780 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f3b7fe640 1 --2- 172.21.15.44:0/3580467780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6f3c0cda30 0x7f6f3c0b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f3bfff640 1 --2- 172.21.15.44:0/3580467780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f3c15bfb0 0x7f6f3c141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f3affd640 1 -- 172.21.15.44:0/3580467780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f3c15bfb0 msgr2=0x7f6f3c141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f3affd640 1 --2- 172.21.15.44:0/3580467780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f3c15bfb0 0x7f6f3c141f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f3affd640 1 -- 172.21.15.44:0/3580467780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6f3c0cda30 msgr2=0x7f6f3c0b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f3affd640 1 --2- 172.21.15.44:0/3580467780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6f3c0cda30 0x7f6f3c0b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f3affd640 1 -- 172.21.15.44:0/3580467780 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f34009a70 con 0x7f6f3c15ae40 2023-11-04T01:39:20.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.936+0000 7f6f3b7fe640 1 --2- 172.21.15.44:0/3580467780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6f3c0cda30 0x7f6f3c0b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:20.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.937+0000 7f6f3affd640 1 --2- 172.21.15.44:0/3580467780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f3c15ae40 0x7f6f3c141a20 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000b420 tx=0x7f6f3000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:20.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.937+0000 7f6f23fff640 1 -- 172.21.15.44:0/3580467780 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30011830 con 0x7f6f3c15ae40 2023-11-04T01:39:20.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.937+0000 7f6f23fff640 1 -- 172.21.15.44:0/3580467780 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f30011990 con 0x7f6f3c15ae40 2023-11-04T01:39:20.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.937+0000 7f6f420e5640 1 -- 172.21.15.44:0/3580467780 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3c152950 con 0x7f6f3c15ae40 2023-11-04T01:39:20.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.937+0000 7f6f23fff640 1 -- 172.21.15.44:0/3580467780 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30011d40 con 0x7f6f3c15ae40 2023-11-04T01:39:20.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.937+0000 7f6f420e5640 1 -- 172.21.15.44:0/3580467780 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3c0c4be0 con 0x7f6f3c15ae40 2023-11-04T01:39:20.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.938+0000 7f6f420e5640 1 -- 172.21.15.44:0/3580467780 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3c0ce2d0 con 0x7f6f3c15ae40 2023-11-04T01:39:20.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.938+0000 7f6f23fff640 1 -- 172.21.15.44:0/3580467780 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f3001b460 con 0x7f6f3c15ae40 2023-11-04T01:39:20.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.939+0000 7f6f23fff640 1 --2- 172.21.15.44:0/3580467780 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6f2806ae70 0x7f6f2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.939+0000 7f6f23fff640 1 -- 172.21.15.44:0/3580467780 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f6f30089480 con 0x7f6f3c15ae40 2023-11-04T01:39:20.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.939+0000 7f6f3b7fe640 1 --2- 172.21.15.44:0/3580467780 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6f2806ae70 0x7f6f2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.939+0000 7f6f3b7fe640 1 --2- 172.21.15.44:0/3580467780 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6f2806ae70 0x7f6f2806d330 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c000f60 tx=0x7f6f2c007a50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:20.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:20.943+0000 7f6f23fff640 1 -- 172.21.15.44:0/3580467780 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f300542c0 con 0x7f6f3c15ae40 2023-11-04T01:39:21.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.185+0000 7f6f420e5640 1 -- 172.21.15.44:0/3580467780 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]} v 0) v1 -- 0x7f6f3c074290 con 0x7f6f3c15ae40 2023-11-04T01:39:21.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.490+0000 7f6f23fff640 1 -- 172.21.15.44:0/3580467780 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]}]=0 v212) v1 ==== 148+0+0 (secure 0 0 0) 0x7f6f300578e0 con 0x7f6f3c15ae40 2023-11-04T01:39:21.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.493+0000 7f6f420e5640 1 -- 172.21.15.44:0/3580467780 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6f2806ae70 msgr2=0x7f6f2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.493+0000 7f6f420e5640 1 --2- 172.21.15.44:0/3580467780 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6f2806ae70 0x7f6f2806d330 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c000f60 tx=0x7f6f2c007a50 comp rx=0 tx=0).stop 2023-11-04T01:39:21.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.493+0000 7f6f420e5640 1 -- 172.21.15.44:0/3580467780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f3c15ae40 msgr2=0x7f6f3c141a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.493+0000 7f6f420e5640 1 --2- 172.21.15.44:0/3580467780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f3c15ae40 0x7f6f3c141a20 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000b420 tx=0x7f6f3000b8e0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.493+0000 7f6f420e5640 1 -- 172.21.15.44:0/3580467780 shutdown_connections 2023-11-04T01:39:21.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.493+0000 7f6f420e5640 1 --2- 172.21.15.44:0/3580467780 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6f2806ae70 0x7f6f2806d330 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.493+0000 7f6f420e5640 1 --2- 172.21.15.44:0/3580467780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f3c15bfb0 0x7f6f3c141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.493+0000 7f6f420e5640 1 --2- 172.21.15.44:0/3580467780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f3c15ae40 0x7f6f3c141a20 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.493+0000 7f6f420e5640 1 --2- 172.21.15.44:0/3580467780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6f3c0cda30 0x7f6f3c0b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.493+0000 7f6f420e5640 1 -- 172.21.15.44:0/3580467780 >> 172.21.15.44:0/3580467780 conn(0x7f6f3c06ea90 msgr2=0x7f6f3c0cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:21.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.493+0000 7f6f420e5640 1 -- 172.21.15.44:0/3580467780 shutdown_connections 2023-11-04T01:39:21.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.493+0000 7f6f420e5640 1 -- 172.21.15.44:0/3580467780 wait complete. 2023-11-04T01:39:21.507 INFO:tasks.cephfs_test_runner:Check whether 'allow_new_snaps' setting works ... ok 2023-11-04T01:39:21.507 INFO:tasks.cephfs_test_runner:Starting test: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) check snaptable transcation 2023-11-04T01:39:21.507 INFO:tasks.cephfs_test_runner:test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:39:21.508 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:21.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.620+0000 7f7104190640 1 Processor -- start 2023-11-04T01:39:21.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.620+0000 7f7104190640 1 -- start start 2023-11-04T01:39:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.621+0000 7f7104190640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f70fc0cde60 0x7f70fc15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.621+0000 7f7104190640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc15e000 con 0x7f70fc15daa0 2023-11-04T01:39:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.621+0000 7f7104190640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc15e2e0 con 0x7f70fc0ce240 2023-11-04T01:39:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.621+0000 7f7104190640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc15e5c0 con 0x7f70fc0cde60 2023-11-04T01:39:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.621+0000 7f710172b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f70fc15daa0 0x7f70fc157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37752/0 (socket says 172.21.15.44:37752) 2023-11-04T01:39:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.621+0000 7f710172b640 1 -- 172.21.15.44:0/4070417133 learned_addr learned my addr 172.21.15.44:0/4070417133 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.621+0000 7f7101f2c640 1 --2- 172.21.15.44:0/4070417133 >> v2:172.21.15.204:3300/0 conn(0x7f70fc0cde60 0x7f70fc15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7100f2a640 1 -- 172.21.15.44:0/4070417133 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437662989 0 0) 0x7f70fc15e000 con 0x7f70fc15daa0 2023-11-04T01:39:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7100f2a640 1 -- 172.21.15.44:0/4070417133 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e8003520 con 0x7f70fc15daa0 2023-11-04T01:39:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7100f2a640 1 -- 172.21.15.44:0/4070417133 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 819927152 0 0) 0x7f70e8003520 con 0x7f70fc15daa0 2023-11-04T01:39:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7100f2a640 1 -- 172.21.15.44:0/4070417133 >> v2:172.21.15.204:3300/0 conn(0x7f70fc0cde60 msgr2=0x7f70fc15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7100f2a640 1 --2- 172.21.15.44:0/4070417133 >> v2:172.21.15.204:3300/0 conn(0x7f70fc0cde60 0x7f70fc15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7100f2a640 1 -- 172.21.15.44:0/4070417133 >> v1:172.21.15.204:6789/0 conn(0x7f70fc0ce240 legacy=0x7f70fc0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7100f2a640 1 -- 172.21.15.44:0/4070417133 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0d1120 con 0x7f70fc15daa0 2023-11-04T01:39:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7100f2a640 1 -- 172.21.15.44:0/4070417133 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f70ec001670 con 0x7f70fc15daa0 2023-11-04T01:39:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7100f2a640 1 -- 172.21.15.44:0/4070417133 >> v1:172.21.15.44:6789/0 conn(0x7f70fc15daa0 legacy=0x7f70fc157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7100f2a640 1 --2- 172.21.15.44:0/4070417133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70e8003970 0x7f70e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7100f2a640 1 --2- 172.21.15.44:0/4070417133 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70e80047c0 0x7f70e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7100f2a640 1 --2- 172.21.15.44:0/4070417133 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70e8005180 0x7f70e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7100f2a640 1 -- 172.21.15.44:0/4070417133 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc15e5c0 con 0x7f70e8003970 2023-11-04T01:39:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7100f2a640 1 -- 172.21.15.44:0/4070417133 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e800c020 con 0x7f70e80047c0 2023-11-04T01:39:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7100f2a640 1 -- 172.21.15.44:0/4070417133 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e800c1e0 con 0x7f70e8005180 2023-11-04T01:39:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7101f2c640 1 --2- 172.21.15.44:0/4070417133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70e8003970 0x7f70e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f710172b640 1 --2- 172.21.15.44:0/4070417133 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70e80047c0 0x7f70e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f710272d640 1 --2- 172.21.15.44:0/4070417133 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70e8005180 0x7f70e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7101f2c640 1 -- 172.21.15.44:0/4070417133 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70e8005180 msgr2=0x7f70e800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7101f2c640 1 --2- 172.21.15.44:0/4070417133 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70e8005180 0x7f70e800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7101f2c640 1 -- 172.21.15.44:0/4070417133 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70e80047c0 msgr2=0x7f70e8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7101f2c640 1 --2- 172.21.15.44:0/4070417133 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70e80047c0 0x7f70e8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f7101f2c640 1 -- 172.21.15.44:0/4070417133 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e8003520 con 0x7f70e8003970 2023-11-04T01:39:21.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f710272d640 1 -- 172.21.15.44:0/4070417133 reap_dead start 2023-11-04T01:39:21.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.622+0000 7f710172b640 1 --2- 172.21.15.44:0/4070417133 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70e80047c0 0x7f70e8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:21.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.623+0000 7f7101f2c640 1 --2- 172.21.15.44:0/4070417133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70e8003970 0x7f70e8003d90 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009ac0 tx=0x7f70e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5a7afddd1afd04 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:21.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.623+0000 7f7100f2a640 1 -- 172.21.15.44:0/4070417133 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f802c6b0 con 0x7f70e8003970 2023-11-04T01:39:21.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.623+0000 7f7100f2a640 1 -- 172.21.15.44:0/4070417133 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f802c810 con 0x7f70e8003970 2023-11-04T01:39:21.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.623+0000 7f7100f2a640 1 -- 172.21.15.44:0/4070417133 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f802cba0 con 0x7f70e8003970 2023-11-04T01:39:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.624+0000 7f7104190640 1 -- 172.21.15.44:0/4070417133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70e8003970 msgr2=0x7f70e8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.624+0000 7f7104190640 1 --2- 172.21.15.44:0/4070417133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70e8003970 0x7f70e8003d90 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009ac0 tx=0x7f70e80057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.624+0000 7f7104190640 1 -- 172.21.15.44:0/4070417133 shutdown_connections 2023-11-04T01:39:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.624+0000 7f7104190640 1 --2- 172.21.15.44:0/4070417133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70e8003970 0x7f70e8003d90 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.624+0000 7f7104190640 1 -- 172.21.15.44:0/4070417133 >> 172.21.15.44:0/4070417133 conn(0x7f70fc071f30 msgr2=0x7f70fc0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.624+0000 7f7104190640 1 -- 172.21.15.44:0/4070417133 shutdown_connections 2023-11-04T01:39:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.624+0000 7f7104190640 1 -- 172.21.15.44:0/4070417133 wait complete. 2023-11-04T01:39:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.625+0000 7f7104190640 1 Processor -- start 2023-11-04T01:39:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.625+0000 7f7104190640 1 -- start start 2023-11-04T01:39:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f7104190640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70e8003970 0x7f70fc0d3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f7104190640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70fc1f63e0 0x7f70fc1f6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f7104190640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70fc15b960 0x7f70fc15bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f7104190640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc158da0 con 0x7f70fc1f63e0 2023-11-04T01:39:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f7104190640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc15c320 con 0x7f70e8003970 2023-11-04T01:39:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f7104190640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc1f6ea0 con 0x7f70fc15b960 2023-11-04T01:39:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f710172b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70fc1f63e0 0x7f70fc1f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f710172b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70fc1f63e0 0x7f70fc1f6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55470/0 (socket says 172.21.15.44:55470) 2023-11-04T01:39:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f710172b640 1 -- 172.21.15.44:0/1964021090 learned_addr learned my addr 172.21.15.44:0/1964021090 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f7101f2c640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70e8003970 0x7f70fc0d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f710172b640 1 -- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70fc15b960 msgr2=0x7f70fc15bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f710272d640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70fc15b960 0x7f70fc15bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f710172b640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70fc15b960 0x7f70fc15bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f710172b640 1 -- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70e8003970 msgr2=0x7f70fc0d3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f710172b640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70e8003970 0x7f70fc0d3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f710172b640 1 -- 172.21.15.44:0/1964021090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc1f7180 con 0x7f70fc1f63e0 2023-11-04T01:39:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f7101f2c640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70e8003970 0x7f70fc0d3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f710272d640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70fc15b960 0x7f70fc15bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.626+0000 7f710172b640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70fc1f63e0 0x7f70fc1f6860 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0017a0 tx=0x7f70ec00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.627+0000 7f70f27fc640 1 -- 172.21.15.44:0/1964021090 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00ee00 con 0x7f70fc1f63e0 2023-11-04T01:39:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.627+0000 7f70f27fc640 1 -- 172.21.15.44:0/1964021090 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec00c870 con 0x7f70fc1f63e0 2023-11-04T01:39:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.627+0000 7f7104190640 1 -- 172.21.15.44:0/1964021090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc158fb0 con 0x7f70fc1f63e0 2023-11-04T01:39:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.627+0000 7f70f27fc640 1 -- 172.21.15.44:0/1964021090 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00cc00 con 0x7f70fc1f63e0 2023-11-04T01:39:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.627+0000 7f7104190640 1 -- 172.21.15.44:0/1964021090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc14e8e0 con 0x7f70fc1f63e0 2023-11-04T01:39:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.628+0000 7f7104190640 1 -- 172.21.15.44:0/1964021090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc1f7370 con 0x7f70fc1f63e0 2023-11-04T01:39:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.628+0000 7f70f27fc640 1 -- 172.21.15.44:0/1964021090 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70ec01d460 con 0x7f70fc1f63e0 2023-11-04T01:39:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.628+0000 7f70f27fc640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f70e006aea0 0x7f70e006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.629+0000 7f70f27fc640 1 -- 172.21.15.44:0/1964021090 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f70ec0896b0 con 0x7f70fc1f63e0 2023-11-04T01:39:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.629+0000 7f7101f2c640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f70e006aea0 0x7f70e006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.629+0000 7f7101f2c640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f70e006aea0 0x7f70e006d360 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f70f8036000 tx=0x7f70f8030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.633+0000 7f70f27fc640 1 -- 172.21.15.44:0/1964021090 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70fc1f7370 con 0x7f70fc1f63e0 2023-11-04T01:39:21.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.809+0000 7f7104190640 1 -- 172.21.15.44:0/1964021090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70fc1594d0 con 0x7f70fc1f63e0 2023-11-04T01:39:21.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.810+0000 7f70f27fc640 1 -- 172.21.15.44:0/1964021090 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+18430 (secure 0 0 0) 0x7f70fc1594d0 con 0x7f70fc1f63e0 2023-11-04T01:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:21.812 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":88,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:39:20.484887+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/364976049":"2023-11-05T01:39:17.121986+0000","172.21.15.44:6833/364976049":"2023-11-05T01:39:17.121986+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.812+0000 7f7104190640 1 -- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f70e006aea0 msgr2=0x7f70e006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.812+0000 7f7104190640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f70e006aea0 0x7f70e006d360 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f70f8036000 tx=0x7f70f8030000 comp rx=0 tx=0).stop 2023-11-04T01:39:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.812+0000 7f7104190640 1 -- 172.21.15.44:0/1964021090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70fc1f63e0 msgr2=0x7f70fc1f6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.812+0000 7f7104190640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70fc1f63e0 0x7f70fc1f6860 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0017a0 tx=0x7f70ec00ec10 comp rx=0 tx=0).stop 2023-11-04T01:39:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.812+0000 7f7104190640 1 -- 172.21.15.44:0/1964021090 shutdown_connections 2023-11-04T01:39:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.812+0000 7f7104190640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f70e006aea0 0x7f70e006d360 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.812+0000 7f7104190640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70fc15b960 0x7f70fc15bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.812+0000 7f7104190640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70fc1f63e0 0x7f70fc1f6860 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.812+0000 7f7104190640 1 --2- 172.21.15.44:0/1964021090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70e8003970 0x7f70fc0d3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.812+0000 7f7104190640 1 -- 172.21.15.44:0/1964021090 >> 172.21.15.44:0/1964021090 conn(0x7f70fc071f30 msgr2=0x7f70fc0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.812+0000 7f7104190640 1 -- 172.21.15.44:0/1964021090 shutdown_connections 2023-11-04T01:39:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.812+0000 7f7104190640 1 -- 172.21.15.44:0/1964021090 wait complete. 2023-11-04T01:39:21.825 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:34.917670+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:35.547044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:21.825 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:21.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.932+0000 7fe3c1b05640 1 Processor -- start 2023-11-04T01:39:21.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.932+0000 7fe3c1b05640 1 -- start start 2023-11-04T01:39:21.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.933+0000 7fe3c1b05640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe3bc1605b0 0x7fe3bc0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.933+0000 7fe3c1b05640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3bc160990 con 0x7fe3bc0b1a40 2023-11-04T01:39:21.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.933+0000 7fe3c1b05640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3bc0cc7c0 con 0x7fe3bc06a830 2023-11-04T01:39:21.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.933+0000 7fe3c1b05640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3bc0cd750 con 0x7fe3bc1605b0 2023-11-04T01:39:21.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.933+0000 7fe3bb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe3bc1605b0 0x7fe3bc0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.933+0000 7fe3baffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe3bc0b1a40 0x7fe3bc06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37768/0 (socket says 172.21.15.44:37768) 2023-11-04T01:39:21.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.933+0000 7fe3baffd640 1 -- 172.21.15.44:0/3454510624 learned_addr learned my addr 172.21.15.44:0/3454510624 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.933+0000 7fe3bb7fe640 1 -- 172.21.15.44:0/3454510624 >> v1:172.21.15.204:6789/0 conn(0x7fe3bc06a830 legacy=0x7fe3bc0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.933+0000 7fe3bb7fe640 1 -- 172.21.15.44:0/3454510624 >> v1:172.21.15.44:6789/0 conn(0x7fe3bc0b1a40 legacy=0x7fe3bc06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.933+0000 7fe3bb7fe640 1 -- 172.21.15.44:0/3454510624 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3bc0cc4e0 con 0x7fe3bc1605b0 2023-11-04T01:39:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.933+0000 7fe3ba7fc640 1 -- 172.21.15.44:0/3454510624 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280208775 0 0) 0x7fe3bc160990 con 0x7fe3bc0b1a40 2023-11-04T01:39:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.934+0000 7fe3bb7fe640 1 --2- 172.21.15.44:0/3454510624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3bc1605b0 0x7fe3bc0ccbc0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac0097a0 tx=0x7fe3ac02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bae1dd939af1ad server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.934+0000 7fe3ba7fc640 1 -- 172.21.15.44:0/3454510624 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac02f050 con 0x7fe3bc1605b0 2023-11-04T01:39:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.934+0000 7fe3ba7fc640 1 -- 172.21.15.44:0/3454510624 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac031700 con 0x7fe3bc1605b0 2023-11-04T01:39:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.934+0000 7fe3ba7fc640 1 -- 172.21.15.44:0/3454510624 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac031a90 con 0x7fe3bc1605b0 2023-11-04T01:39:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.935+0000 7fe3c1b05640 1 -- 172.21.15.44:0/3454510624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3bc1605b0 msgr2=0x7fe3bc0ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.935+0000 7fe3c1b05640 1 --2- 172.21.15.44:0/3454510624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3bc1605b0 0x7fe3bc0ccbc0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac0097a0 tx=0x7fe3ac02b7a0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.935+0000 7fe3c1b05640 1 -- 172.21.15.44:0/3454510624 shutdown_connections 2023-11-04T01:39:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.935+0000 7fe3c1b05640 1 --2- 172.21.15.44:0/3454510624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3bc1605b0 0x7fe3bc0ccbc0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.935+0000 7fe3c1b05640 1 -- 172.21.15.44:0/3454510624 >> 172.21.15.44:0/3454510624 conn(0x7fe3bc071820 msgr2=0x7fe3bc071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.935+0000 7fe3c1b05640 1 -- 172.21.15.44:0/3454510624 shutdown_connections 2023-11-04T01:39:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.935+0000 7fe3c1b05640 1 -- 172.21.15.44:0/3454510624 wait complete. 2023-11-04T01:39:21.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.936+0000 7fe3c1b05640 1 Processor -- start 2023-11-04T01:39:21.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.936+0000 7fe3c1b05640 1 -- start start 2023-11-04T01:39:21.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3c1b05640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3bc06a830 0x7fe3bc0ad730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3c1b05640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3bc1605b0 0x7fe3bc15d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3c1b05640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3bc15f5b0 0x7fe3bc0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3c1b05640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3bc0b32d0 con 0x7fe3bc06a830 2023-11-04T01:39:21.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3c1b05640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3bc0b2670 con 0x7fe3bc15f5b0 2023-11-04T01:39:21.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3c1b05640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3bc0b2930 con 0x7fe3bc1605b0 2023-11-04T01:39:21.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3bb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3bc06a830 0x7fe3bc0ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3bb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3bc06a830 0x7fe3bc0ad730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55492/0 (socket says 172.21.15.44:55492) 2023-11-04T01:39:21.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3bb7fe640 1 -- 172.21.15.44:0/3832072963 learned_addr learned my addr 172.21.15.44:0/3832072963 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:21.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3baffd640 1 --2- 172.21.15.44:0/3832072963 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3bc1605b0 0x7fe3bc15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3bbfff640 1 --2- 172.21.15.44:0/3832072963 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3bc15f5b0 0x7fe3bc0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3bb7fe640 1 -- 172.21.15.44:0/3832072963 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3bc1605b0 msgr2=0x7fe3bc15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3bb7fe640 1 --2- 172.21.15.44:0/3832072963 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3bc1605b0 0x7fe3bc15d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3bb7fe640 1 -- 172.21.15.44:0/3832072963 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3bc15f5b0 msgr2=0x7fe3bc0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3bb7fe640 1 --2- 172.21.15.44:0/3832072963 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3bc15f5b0 0x7fe3bc0b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3bb7fe640 1 -- 172.21.15.44:0/3832072963 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac009400 con 0x7fe3bc06a830 2023-11-04T01:39:21.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.937+0000 7fe3bb7fe640 1 --2- 172.21.15.44:0/3832072963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3bc06a830 0x7fe3bc0ad730 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac0098c0 tx=0x7fe3ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:21.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.938+0000 7fe3a3fff640 1 -- 172.21.15.44:0/3832072963 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac033c30 con 0x7fe3bc06a830 2023-11-04T01:39:21.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.938+0000 7fe3a3fff640 1 -- 172.21.15.44:0/3832072963 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac033d90 con 0x7fe3bc06a830 2023-11-04T01:39:21.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.938+0000 7fe3c1b05640 1 -- 172.21.15.44:0/3832072963 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3bc0b2c10 con 0x7fe3bc06a830 2023-11-04T01:39:21.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.938+0000 7fe3a3fff640 1 -- 172.21.15.44:0/3832072963 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac03c640 con 0x7fe3bc06a830 2023-11-04T01:39:21.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.938+0000 7fe3c1b05640 1 -- 172.21.15.44:0/3832072963 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3bc0b4d60 con 0x7fe3bc06a830 2023-11-04T01:39:21.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.939+0000 7fe3c1b05640 1 -- 172.21.15.44:0/3832072963 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3bc0672a0 con 0x7fe3bc06a830 2023-11-04T01:39:21.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.939+0000 7fe3a3fff640 1 -- 172.21.15.44:0/3832072963 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe3ac03a040 con 0x7fe3bc06a830 2023-11-04T01:39:21.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.939+0000 7fe3a3fff640 1 --2- 172.21.15.44:0/3832072963 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe3a806ae70 0x7fe3a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.940+0000 7fe3a3fff640 1 -- 172.21.15.44:0/3832072963 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fe3ac0ab330 con 0x7fe3bc06a830 2023-11-04T01:39:21.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.940+0000 7fe3baffd640 1 --2- 172.21.15.44:0/3832072963 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe3a806ae70 0x7fe3a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.940+0000 7fe3baffd640 1 --2- 172.21.15.44:0/3832072963 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe3a806ae70 0x7fe3a806d330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0b4ad0 tx=0x7fe3b0007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:21.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:21.944+0000 7fe3a3fff640 1 -- 172.21.15.44:0/3832072963 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe3ac076230 con 0x7fe3bc06a830 2023-11-04T01:39:22.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.118+0000 7fe3c1b05640 1 -- 172.21.15.44:0/3832072963 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3bc0b3540 con 0x7fe3bc06a830 2023-11-04T01:39:22.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.118+0000 7fe3a3fff640 1 -- 172.21.15.44:0/3832072963 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe3ac03c7a0 con 0x7fe3bc06a830 2023-11-04T01:39:22.121 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:39:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.120+0000 7fe3c1b05640 1 -- 172.21.15.44:0/3832072963 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe3a806ae70 msgr2=0x7fe3a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.120+0000 7fe3c1b05640 1 --2- 172.21.15.44:0/3832072963 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe3a806ae70 0x7fe3a806d330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0b4ad0 tx=0x7fe3b0007de0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.120+0000 7fe3c1b05640 1 -- 172.21.15.44:0/3832072963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3bc06a830 msgr2=0x7fe3bc0ad730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.120+0000 7fe3c1b05640 1 --2- 172.21.15.44:0/3832072963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3bc06a830 0x7fe3bc0ad730 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac0098c0 tx=0x7fe3ac0046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.120+0000 7fe3c1b05640 1 -- 172.21.15.44:0/3832072963 shutdown_connections 2023-11-04T01:39:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.120+0000 7fe3c1b05640 1 --2- 172.21.15.44:0/3832072963 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe3a806ae70 0x7fe3a806d330 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.120+0000 7fe3c1b05640 1 --2- 172.21.15.44:0/3832072963 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe3bc15f5b0 0x7fe3bc0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.120+0000 7fe3c1b05640 1 --2- 172.21.15.44:0/3832072963 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe3bc1605b0 0x7fe3bc15d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.120+0000 7fe3c1b05640 1 --2- 172.21.15.44:0/3832072963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3bc06a830 0x7fe3bc0ad730 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.120+0000 7fe3c1b05640 1 -- 172.21.15.44:0/3832072963 >> 172.21.15.44:0/3832072963 conn(0x7fe3bc071820 msgr2=0x7fe3bc0af540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:22.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.121+0000 7fe3c1b05640 1 -- 172.21.15.44:0/3832072963 shutdown_connections 2023-11-04T01:39:22.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.121+0000 7fe3c1b05640 1 -- 172.21.15.44:0/3832072963 wait complete. 2023-11-04T01:39:22.133 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:39:22.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.240+0000 7f947c294640 1 Processor -- start 2023-11-04T01:39:22.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.240+0000 7f947c294640 1 -- start start 2023-11-04T01:39:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.241+0000 7f947c294640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9474153e60 0x7f947415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.241+0000 7f947c294640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f94740cd6d0 0x7f9474161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.241+0000 7f947c294640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94740cde60 con 0x7f94740b4880 2023-11-04T01:39:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.241+0000 7f947c294640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9474160f90 con 0x7f94740cd6d0 2023-11-04T01:39:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.241+0000 7f947c294640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947415e400 con 0x7f9474153e60 2023-11-04T01:39:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.241+0000 7f947982f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f94740cd6d0 0x7f9474161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.241+0000 7f947982f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f94740cd6d0 0x7f9474161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55506/0 (socket says 172.21.15.44:55506) 2023-11-04T01:39:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.241+0000 7f947982f640 1 -- 172.21.15.44:0/3426984083 learned_addr learned my addr 172.21.15.44:0/3426984083 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.242+0000 7f947a030640 1 --2- 172.21.15.44:0/3426984083 >> v2:172.21.15.204:3300/0 conn(0x7f9474153e60 0x7f947415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.242+0000 7f947982f640 1 -- 172.21.15.44:0/3426984083 >> v2:172.21.15.204:3300/0 conn(0x7f9474153e60 msgr2=0x7f947415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.242+0000 7f947982f640 1 --2- 172.21.15.44:0/3426984083 >> v2:172.21.15.204:3300/0 conn(0x7f9474153e60 0x7f947415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.242+0000 7f947982f640 1 -- 172.21.15.44:0/3426984083 >> v1:172.21.15.204:6789/0 conn(0x7f94740b4880 legacy=0x7f947406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.242+0000 7f947982f640 1 -- 172.21.15.44:0/3426984083 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9474161960 con 0x7f94740cd6d0 2023-11-04T01:39:22.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.242+0000 7f947982f640 1 --2- 172.21.15.44:0/3426984083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94740cd6d0 0x7f9474161420 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f947408abe0 tx=0x7f946802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86a964119b62044 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:22.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.243+0000 7f947902e640 1 -- 172.21.15.44:0/3426984083 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468030860 con 0x7f94740cd6d0 2023-11-04T01:39:22.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.243+0000 7f947902e640 1 -- 172.21.15.44:0/3426984083 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94680309c0 con 0x7f94740cd6d0 2023-11-04T01:39:22.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.243+0000 7f947902e640 1 -- 172.21.15.44:0/3426984083 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468030d50 con 0x7f94740cd6d0 2023-11-04T01:39:22.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.243+0000 7f947c294640 1 -- 172.21.15.44:0/3426984083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94740cd6d0 msgr2=0x7f9474161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.243+0000 7f947c294640 1 --2- 172.21.15.44:0/3426984083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94740cd6d0 0x7f9474161420 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f947408abe0 tx=0x7f946802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.243+0000 7f947c294640 1 -- 172.21.15.44:0/3426984083 shutdown_connections 2023-11-04T01:39:22.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.243+0000 7f947c294640 1 --2- 172.21.15.44:0/3426984083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94740cd6d0 0x7f9474161420 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.243+0000 7f947c294640 1 --2- 172.21.15.44:0/3426984083 >> v2:172.21.15.204:3300/0 conn(0x7f9474153e60 0x7f947415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.243+0000 7f947c294640 1 -- 172.21.15.44:0/3426984083 >> 172.21.15.44:0/3426984083 conn(0x7f94740cf880 msgr2=0x7f94740cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:22.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.243+0000 7f947c294640 1 -- 172.21.15.44:0/3426984083 shutdown_connections 2023-11-04T01:39:22.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.243+0000 7f947c294640 1 -- 172.21.15.44:0/3426984083 wait complete. 2023-11-04T01:39:22.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.244+0000 7f947c294640 1 Processor -- start 2023-11-04T01:39:22.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.244+0000 7f947c294640 1 -- start start 2023-11-04T01:39:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.245+0000 7f947c294640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94740b4880 0x7f9474152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.245+0000 7f947c294640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94740cd6d0 0x7f94740ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.245+0000 7f947c294640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9474153e60 0x7f94740ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.245+0000 7f947c294640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9474157a10 con 0x7f94740b4880 2023-11-04T01:39:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.245+0000 7f947c294640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9474151cd0 con 0x7f9474153e60 2023-11-04T01:39:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.245+0000 7f947c294640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9474150de0 con 0x7f94740cd6d0 2023-11-04T01:39:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.245+0000 7f947a030640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94740b4880 0x7f9474152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.245+0000 7f947a030640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94740b4880 0x7f9474152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55514/0 (socket says 172.21.15.44:55514) 2023-11-04T01:39:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.245+0000 7f947a030640 1 -- 172.21.15.44:0/4135300876 learned_addr learned my addr 172.21.15.44:0/4135300876 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.245+0000 7f947a831640 1 --2- 172.21.15.44:0/4135300876 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9474153e60 0x7f94740ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.245+0000 7f947982f640 1 --2- 172.21.15.44:0/4135300876 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94740cd6d0 0x7f94740ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.246+0000 7f947a030640 1 -- 172.21.15.44:0/4135300876 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94740cd6d0 msgr2=0x7f94740ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.246+0000 7f947a030640 1 --2- 172.21.15.44:0/4135300876 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94740cd6d0 0x7f94740ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.246+0000 7f947a030640 1 -- 172.21.15.44:0/4135300876 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9474153e60 msgr2=0x7f94740ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.246+0000 7f947a030640 1 --2- 172.21.15.44:0/4135300876 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9474153e60 0x7f94740ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.246+0000 7f947a030640 1 -- 172.21.15.44:0/4135300876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94680094d0 con 0x7f94740b4880 2023-11-04T01:39:22.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.246+0000 7f947a030640 1 --2- 172.21.15.44:0/4135300876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94740b4880 0x7f9474152160 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f9464007e40 tx=0x7f946400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:22.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.246+0000 7f9472ffd640 1 -- 172.21.15.44:0/4135300876 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464014620 con 0x7f94740b4880 2023-11-04T01:39:22.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.246+0000 7f9472ffd640 1 -- 172.21.15.44:0/4135300876 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946400ee90 con 0x7f94740b4880 2023-11-04T01:39:22.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.246+0000 7f9472ffd640 1 -- 172.21.15.44:0/4135300876 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94640149c0 con 0x7f94740b4880 2023-11-04T01:39:22.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.246+0000 7f947c294640 1 -- 172.21.15.44:0/4135300876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94741510c0 con 0x7f94740b4880 2023-11-04T01:39:22.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.246+0000 7f947c294640 1 -- 172.21.15.44:0/4135300876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9474151680 con 0x7f94740b4880 2023-11-04T01:39:22.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.247+0000 7f947c294640 1 -- 172.21.15.44:0/4135300876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9474074290 con 0x7f94740b4880 2023-11-04T01:39:22.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.247+0000 7f9472ffd640 1 -- 172.21.15.44:0/4135300876 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9464014b20 con 0x7f94740b4880 2023-11-04T01:39:22.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.248+0000 7f9472ffd640 1 --2- 172.21.15.44:0/4135300876 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f946006ae70 0x7f946006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.248+0000 7f9472ffd640 1 -- 172.21.15.44:0/4135300876 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f946408a1c0 con 0x7f94740b4880 2023-11-04T01:39:22.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.248+0000 7f947982f640 1 --2- 172.21.15.44:0/4135300876 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f946006ae70 0x7f946006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.248+0000 7f947982f640 1 --2- 172.21.15.44:0/4135300876 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f946006ae70 0x7f946006d330 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9468036000 tx=0x7f9468008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:22.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.252+0000 7f9472ffd640 1 -- 172.21.15.44:0/4135300876 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9464055000 con 0x7f94740b4880 2023-11-04T01:39:22.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.429+0000 7f947c294640 1 -- 172.21.15.44:0/4135300876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f94740d1d00 con 0x7f94740b4880 2023-11-04T01:39:22.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.429+0000 7f9472ffd640 1 -- 172.21.15.44:0/4135300876 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9464058620 con 0x7f94740b4880 2023-11-04T01:39:22.431 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:39:22.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.431+0000 7f947c294640 1 -- 172.21.15.44:0/4135300876 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f946006ae70 msgr2=0x7f946006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.431+0000 7f947c294640 1 --2- 172.21.15.44:0/4135300876 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f946006ae70 0x7f946006d330 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9468036000 tx=0x7f9468008030 comp rx=0 tx=0).stop 2023-11-04T01:39:22.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.431+0000 7f947c294640 1 -- 172.21.15.44:0/4135300876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94740b4880 msgr2=0x7f9474152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.431+0000 7f947c294640 1 --2- 172.21.15.44:0/4135300876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94740b4880 0x7f9474152160 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f9464007e40 tx=0x7f946400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.431+0000 7f947c294640 1 -- 172.21.15.44:0/4135300876 shutdown_connections 2023-11-04T01:39:22.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.431+0000 7f947c294640 1 --2- 172.21.15.44:0/4135300876 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f946006ae70 0x7f946006d330 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.431+0000 7f947c294640 1 --2- 172.21.15.44:0/4135300876 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9474153e60 0x7f94740ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.431+0000 7f947c294640 1 --2- 172.21.15.44:0/4135300876 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94740cd6d0 0x7f94740ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.431+0000 7f947c294640 1 --2- 172.21.15.44:0/4135300876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94740b4880 0x7f9474152160 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.431+0000 7f947c294640 1 -- 172.21.15.44:0/4135300876 >> 172.21.15.44:0/4135300876 conn(0x7f94740cf880 msgr2=0x7f94740d2530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:22.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.431+0000 7f947c294640 1 -- 172.21.15.44:0/4135300876 shutdown_connections 2023-11-04T01:39:22.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.431+0000 7f947c294640 1 -- 172.21.15.44:0/4135300876 wait complete. 2023-11-04T01:39:22.444 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:39:22.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.551+0000 7ff5bb361640 1 Processor -- start 2023-11-04T01:39:22.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.552+0000 7ff5bb361640 1 -- start start 2023-11-04T01:39:22.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.552+0000 7ff5bb361640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5b40cd6d0 0x7ff5b4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.552+0000 7ff5bb361640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b40cde60 con 0x7ff5b40b4880 2023-11-04T01:39:22.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.552+0000 7ff5bb361640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b4160f90 con 0x7ff5b4153e60 2023-11-04T01:39:22.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.552+0000 7ff5bb361640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b4161960 con 0x7ff5b40cd6d0 2023-11-04T01:39:22.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.552+0000 7ff5b98fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff5b40b4880 0x7ff5b40b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33076/0 (socket says 172.21.15.44:33076) 2023-11-04T01:39:22.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.552+0000 7ff5b98fe640 1 -- 172.21.15.44:0/3779925524 learned_addr learned my addr 172.21.15.44:0/3779925524 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:22.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.553+0000 7ff5b88fc640 1 --2- 172.21.15.44:0/3779925524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5b40cd6d0 0x7ff5b4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.553+0000 7ff5b3fff640 1 -- 172.21.15.44:0/3779925524 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296582031 0 0) 0x7ff5b40cde60 con 0x7ff5b40b4880 2023-11-04T01:39:22.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.553+0000 7ff5b3fff640 1 -- 172.21.15.44:0/3779925524 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff59c003520 con 0x7ff5b40b4880 2023-11-04T01:39:22.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.553+0000 7ff5b3fff640 1 -- 172.21.15.44:0/3779925524 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170787935 0 0) 0x7ff5b4160f90 con 0x7ff5b4153e60 2023-11-04T01:39:22.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.553+0000 7ff5b3fff640 1 -- 172.21.15.44:0/3779925524 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5b40cde60 con 0x7ff5b4153e60 2023-11-04T01:39:22.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.553+0000 7ff5b3fff640 1 -- 172.21.15.44:0/3779925524 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2471144153 0 0) 0x7ff59c003520 con 0x7ff5b40b4880 2023-11-04T01:39:22.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.553+0000 7ff5b88fc640 1 -- 172.21.15.44:0/3779925524 >> v1:172.21.15.204:6789/0 conn(0x7ff5b4153e60 legacy=0x7ff5b415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.553+0000 7ff5b88fc640 1 -- 172.21.15.44:0/3779925524 >> v1:172.21.15.44:6789/0 conn(0x7ff5b40b4880 legacy=0x7ff5b40b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.553+0000 7ff5b88fc640 1 -- 172.21.15.44:0/3779925524 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b40ce090 con 0x7ff5b40cd6d0 2023-11-04T01:39:22.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.554+0000 7ff5b88fc640 1 --2- 172.21.15.44:0/3779925524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5b40cd6d0 0x7ff5b4161420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80097d0 tx=0x7ff5a802b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7f6e2380323dcac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:22.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.554+0000 7ff5b3fff640 1 -- 172.21.15.44:0/3779925524 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40019f0 con 0x7ff5b40cd6d0 2023-11-04T01:39:22.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.554+0000 7ff5b3fff640 1 -- 172.21.15.44:0/3779925524 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a802e050 con 0x7ff5b40cd6d0 2023-11-04T01:39:22.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.554+0000 7ff5b3fff640 1 -- 172.21.15.44:0/3779925524 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8030730 con 0x7ff5b40cd6d0 2023-11-04T01:39:22.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.554+0000 7ff5bb361640 1 -- 172.21.15.44:0/3779925524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5b40cd6d0 msgr2=0x7ff5b4161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.554+0000 7ff5bb361640 1 --2- 172.21.15.44:0/3779925524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5b40cd6d0 0x7ff5b4161420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80097d0 tx=0x7ff5a802b800 comp rx=0 tx=0).stop 2023-11-04T01:39:22.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.555+0000 7ff5bb361640 1 -- 172.21.15.44:0/3779925524 shutdown_connections 2023-11-04T01:39:22.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.555+0000 7ff5bb361640 1 --2- 172.21.15.44:0/3779925524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5b40cd6d0 0x7ff5b4161420 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.555+0000 7ff5bb361640 1 -- 172.21.15.44:0/3779925524 >> 172.21.15.44:0/3779925524 conn(0x7ff5b40cf880 msgr2=0x7ff5b40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:22.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.555+0000 7ff5bb361640 1 -- 172.21.15.44:0/3779925524 shutdown_connections 2023-11-04T01:39:22.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.555+0000 7ff5bb361640 1 -- 172.21.15.44:0/3779925524 wait complete. 2023-11-04T01:39:22.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.556+0000 7ff5bb361640 1 Processor -- start 2023-11-04T01:39:22.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.556+0000 7ff5bb361640 1 -- start start 2023-11-04T01:39:22.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.556+0000 7ff5bb361640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5b40b4880 0x7ff5b4145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.556+0000 7ff5bb361640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5b40cd6d0 0x7ff5b41571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5bb361640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5b4153e60 0x7ff5b4157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5bb361640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b4145bc0 con 0x7ff5b4153e60 2023-11-04T01:39:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5bb361640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b4157730 con 0x7ff5b40b4880 2023-11-04T01:39:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5bb361640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b4159e60 con 0x7ff5b40cd6d0 2023-11-04T01:39:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5b98fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5b4153e60 0x7ff5b4157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5b98fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5b4153e60 0x7ff5b4157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60710/0 (socket says 172.21.15.44:60710) 2023-11-04T01:39:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5b98fe640 1 -- 172.21.15.44:0/886542486 learned_addr learned my addr 172.21.15.44:0/886542486 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5b88fc640 1 --2- 172.21.15.44:0/886542486 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5b40cd6d0 0x7ff5b41571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5b90fd640 1 --2- 172.21.15.44:0/886542486 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5b40b4880 0x7ff5b4145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5b98fe640 1 -- 172.21.15.44:0/886542486 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5b40cd6d0 msgr2=0x7ff5b41571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5b98fe640 1 --2- 172.21.15.44:0/886542486 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5b40cd6d0 0x7ff5b41571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5b98fe640 1 -- 172.21.15.44:0/886542486 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5b40b4880 msgr2=0x7ff5b4145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5b98fe640 1 --2- 172.21.15.44:0/886542486 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5b40b4880 0x7ff5b4145680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5b98fe640 1 -- 172.21.15.44:0/886542486 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a8009400 con 0x7ff5b4153e60 2023-11-04T01:39:22.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5b98fe640 1 --2- 172.21.15.44:0/886542486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5b4153e60 0x7ff5b4157b70 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4001fa0 tx=0x7ff5a400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:22.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5b1ffb640 1 -- 172.21.15.44:0/886542486 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4012400 con 0x7ff5b4153e60 2023-11-04T01:39:22.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5b1ffb640 1 -- 172.21.15.44:0/886542486 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4012560 con 0x7ff5b4153e60 2023-11-04T01:39:22.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5bb361640 1 -- 172.21.15.44:0/886542486 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b415a140 con 0x7ff5b4153e60 2023-11-04T01:39:22.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.557+0000 7ff5b1ffb640 1 -- 172.21.15.44:0/886542486 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4012910 con 0x7ff5b4153e60 2023-11-04T01:39:22.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.558+0000 7ff5bb361640 1 -- 172.21.15.44:0/886542486 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b415a700 con 0x7ff5b4153e60 2023-11-04T01:39:22.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.559+0000 7ff5bb361640 1 -- 172.21.15.44:0/886542486 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b40cdc70 con 0x7ff5b4153e60 2023-11-04T01:39:22.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.559+0000 7ff5b1ffb640 1 -- 172.21.15.44:0/886542486 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5a4012a70 con 0x7ff5b4153e60 2023-11-04T01:39:22.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.559+0000 7ff5b1ffb640 1 --2- 172.21.15.44:0/886542486 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff5a006aea0 0x7ff5a006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.559+0000 7ff5b1ffb640 1 -- 172.21.15.44:0/886542486 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6326+0+0 (secure 0 0 0) 0x7ff5a4089fe0 con 0x7ff5b4153e60 2023-11-04T01:39:22.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.559+0000 7ff5b90fd640 1 --2- 172.21.15.44:0/886542486 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff5a006aea0 0x7ff5a006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.560+0000 7ff5b90fd640 1 --2- 172.21.15.44:0/886542486 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff5a006aea0 0x7ff5a006d360 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0011e0 tx=0x7ff5ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:22.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.563+0000 7ff5b1ffb640 1 -- 172.21.15.44:0/886542486 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff5a4054f60 con 0x7ff5b4153e60 2023-11-04T01:39:22.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.740+0000 7ff5bb361640 1 -- 172.21.15.44:0/886542486 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7ff5b4074290 con 0x7ff5b4153e60 2023-11-04T01:39:22.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.741+0000 7ff5b1ffb640 1 -- 172.21.15.44:0/886542486 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff5a4058580 con 0x7ff5b4153e60 2023-11-04T01:39:22.743 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:39:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.743+0000 7ff5bb361640 1 -- 172.21.15.44:0/886542486 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff5a006aea0 msgr2=0x7ff5a006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.743+0000 7ff5bb361640 1 --2- 172.21.15.44:0/886542486 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff5a006aea0 0x7ff5a006d360 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0011e0 tx=0x7ff5ac009040 comp rx=0 tx=0).stop 2023-11-04T01:39:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.743+0000 7ff5bb361640 1 -- 172.21.15.44:0/886542486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5b4153e60 msgr2=0x7ff5b4157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.743+0000 7ff5bb361640 1 --2- 172.21.15.44:0/886542486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5b4153e60 0x7ff5b4157b70 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4001fa0 tx=0x7ff5a400a430 comp rx=0 tx=0).stop 2023-11-04T01:39:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.743+0000 7ff5bb361640 1 -- 172.21.15.44:0/886542486 shutdown_connections 2023-11-04T01:39:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.743+0000 7ff5bb361640 1 --2- 172.21.15.44:0/886542486 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff5a006aea0 0x7ff5a006d360 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.743+0000 7ff5bb361640 1 --2- 172.21.15.44:0/886542486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5b4153e60 0x7ff5b4157b70 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.743+0000 7ff5bb361640 1 --2- 172.21.15.44:0/886542486 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5b40cd6d0 0x7ff5b41571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.743+0000 7ff5bb361640 1 --2- 172.21.15.44:0/886542486 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5b40b4880 0x7ff5b4145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.743+0000 7ff5bb361640 1 -- 172.21.15.44:0/886542486 >> 172.21.15.44:0/886542486 conn(0x7ff5b40cf880 msgr2=0x7ff5b415afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:22.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.743+0000 7ff5bb361640 1 -- 172.21.15.44:0/886542486 shutdown_connections 2023-11-04T01:39:22.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.743+0000 7ff5bb361640 1 -- 172.21.15.44:0/886542486 wait complete. 2023-11-04T01:39:22.755 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:39:22.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.863+0000 7f731d8e0640 1 Processor -- start 2023-11-04T01:39:22.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.863+0000 7f731d8e0640 1 -- start start 2023-11-04T01:39:22.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.864+0000 7f731d8e0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f73180ca0a0 0x7f73180cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.864+0000 7f731d8e0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f73180cc300 0x7f73180cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.864+0000 7f731d8e0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73180caa20 con 0x7f731815e3f0 2023-11-04T01:39:22.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.864+0000 7f731d8e0640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73180b3300 con 0x7f73180cc300 2023-11-04T01:39:22.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.864+0000 7f731d8e0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73180cb230 con 0x7f73180ca0a0 2023-11-04T01:39:22.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.864+0000 7f73177fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f73180cc300 0x7f73180cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.864+0000 7f7316ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f731815e3f0 0x7f73180b2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33080/0 (socket says 172.21.15.44:33080) 2023-11-04T01:39:22.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.864+0000 7f7316ffd640 1 -- 172.21.15.44:0/63418533 learned_addr learned my addr 172.21.15.44:0/63418533 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:22.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.864+0000 7f73167fc640 1 --2- 172.21.15.44:0/63418533 >> v2:172.21.15.204:3300/0 conn(0x7f73180ca0a0 0x7f73180cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.864+0000 7f73177fe640 1 -- 172.21.15.44:0/63418533 >> v2:172.21.15.204:3300/0 conn(0x7f73180ca0a0 msgr2=0x7f73180cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:22.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.864+0000 7f73177fe640 1 --2- 172.21.15.44:0/63418533 >> v2:172.21.15.204:3300/0 conn(0x7f73180ca0a0 0x7f73180cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.864+0000 7f73177fe640 1 -- 172.21.15.44:0/63418533 >> v1:172.21.15.44:6789/0 conn(0x7f731815e3f0 legacy=0x7f73180b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.864+0000 7f73177fe640 1 -- 172.21.15.44:0/63418533 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73180ca530 con 0x7f73180cc300 2023-11-04T01:39:22.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.864+0000 7f7315ffb640 1 -- 172.21.15.44:0/63418533 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881890736 0 0) 0x7f73180caa20 con 0x7f731815e3f0 2023-11-04T01:39:22.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.865+0000 7f73177fe640 1 --2- 172.21.15.44:0/63418533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73180cc300 0x7f73180cce60 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f73180d0b50 tx=0x7f731002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405c7fa97011aa77 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:22.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.865+0000 7f7315ffb640 1 -- 172.21.15.44:0/63418533 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731002cc80 con 0x7f73180cc300 2023-11-04T01:39:22.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.865+0000 7f7315ffb640 1 -- 172.21.15.44:0/63418533 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731002cde0 con 0x7f73180cc300 2023-11-04T01:39:22.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.865+0000 7f7315ffb640 1 -- 172.21.15.44:0/63418533 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7310034660 con 0x7f73180cc300 2023-11-04T01:39:22.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.866+0000 7f731d8e0640 1 -- 172.21.15.44:0/63418533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73180cc300 msgr2=0x7f73180cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.866+0000 7f731d8e0640 1 --2- 172.21.15.44:0/63418533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73180cc300 0x7f73180cce60 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f73180d0b50 tx=0x7f731002bed0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.866+0000 7f731d8e0640 1 -- 172.21.15.44:0/63418533 shutdown_connections 2023-11-04T01:39:22.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.866+0000 7f731d8e0640 1 --2- 172.21.15.44:0/63418533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73180cc300 0x7f73180cce60 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.866+0000 7f731d8e0640 1 --2- 172.21.15.44:0/63418533 >> v2:172.21.15.204:3300/0 conn(0x7f73180ca0a0 0x7f73180cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.866+0000 7f731d8e0640 1 -- 172.21.15.44:0/63418533 >> 172.21.15.44:0/63418533 conn(0x7f7318071820 msgr2=0x7f7318071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:22.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.866+0000 7f731d8e0640 1 -- 172.21.15.44:0/63418533 shutdown_connections 2023-11-04T01:39:22.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.866+0000 7f731d8e0640 1 -- 172.21.15.44:0/63418533 wait complete. 2023-11-04T01:39:22.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.867+0000 7f731d8e0640 1 Processor -- start 2023-11-04T01:39:22.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.867+0000 7f731d8e0640 1 -- start start 2023-11-04T01:39:22.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f731d8e0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73180cc300 0x7f7318159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f731d8e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731815e3f0 0x7f73181e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f731d8e0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73181e4e00 0x7f731814f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f731d8e0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7318158100 con 0x7f731815e3f0 2023-11-04T01:39:22.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f731d8e0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73180c9850 con 0x7f73181e4e00 2023-11-04T01:39:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f731d8e0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73180c8f20 con 0x7f73180cc300 2023-11-04T01:39:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f73167fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731815e3f0 0x7f73181e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f73167fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731815e3f0 0x7f73181e48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60732/0 (socket says 172.21.15.44:60732) 2023-11-04T01:39:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f73167fc640 1 -- 172.21.15.44:0/1131658209 learned_addr learned my addr 172.21.15.44:0/1131658209 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f73177fe640 1 --2- 172.21.15.44:0/1131658209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73181e4e00 0x7f731814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f7316ffd640 1 --2- 172.21.15.44:0/1131658209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73180cc300 0x7f7318159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f73167fc640 1 -- 172.21.15.44:0/1131658209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73180cc300 msgr2=0x7f7318159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f73167fc640 1 --2- 172.21.15.44:0/1131658209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73180cc300 0x7f7318159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f73167fc640 1 -- 172.21.15.44:0/1131658209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73181e4e00 msgr2=0x7f731814f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f73167fc640 1 --2- 172.21.15.44:0/1131658209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73181e4e00 0x7f731814f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.868+0000 7f73167fc640 1 -- 172.21.15.44:0/1131658209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7310009a70 con 0x7f731815e3f0 2023-11-04T01:39:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.869+0000 7f73167fc640 1 --2- 172.21.15.44:0/1131658209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731815e3f0 0x7f73181e48c0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f730c00d800 tx=0x7f730c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.869+0000 7f72fffff640 1 -- 172.21.15.44:0/1131658209 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c00b6c0 con 0x7f731815e3f0 2023-11-04T01:39:22.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.869+0000 7f72fffff640 1 -- 172.21.15.44:0/1131658209 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c00b820 con 0x7f731815e3f0 2023-11-04T01:39:22.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.869+0000 7f731d8e0640 1 -- 172.21.15.44:0/1131658209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73180c9200 con 0x7f731815e3f0 2023-11-04T01:39:22.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.869+0000 7f72fffff640 1 -- 172.21.15.44:0/1131658209 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c00bbb0 con 0x7f731815e3f0 2023-11-04T01:39:22.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.869+0000 7f731d8e0640 1 -- 172.21.15.44:0/1131658209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73180c8bd0 con 0x7f731815e3f0 2023-11-04T01:39:22.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.870+0000 7f731d8e0640 1 -- 172.21.15.44:0/1131658209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7318158270 con 0x7f731815e3f0 2023-11-04T01:39:22.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.870+0000 7f72fffff640 1 -- 172.21.15.44:0/1131658209 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f730c00bd10 con 0x7f731815e3f0 2023-11-04T01:39:22.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.871+0000 7f72fffff640 1 --2- 172.21.15.44:0/1131658209 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f730406ae70 0x7f730406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.871+0000 7f72fffff640 1 -- 172.21.15.44:0/1131658209 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f730c089df0 con 0x7f731815e3f0 2023-11-04T01:39:22.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.871+0000 7f7316ffd640 1 --2- 172.21.15.44:0/1131658209 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f730406ae70 0x7f730406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.872+0000 7f7316ffd640 1 --2- 172.21.15.44:0/1131658209 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f730406ae70 0x7f730406d330 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7308000f60 tx=0x7f7308009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:22.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:22.875+0000 7f72fffff640 1 -- 172.21.15.44:0/1131658209 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7318158270 con 0x7f731815e3f0 2023-11-04T01:39:23.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.050+0000 7f731d8e0640 1 -- 172.21.15.44:0/1131658209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f7318158270 con 0x7f731815e3f0 2023-11-04T01:39:23.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.051+0000 7f72fffff640 1 -- 172.21.15.44:0/1131658209 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v88) v1 ==== 107+0+11 (secure 0 0 0) 0x7f7318158270 con 0x7f731815e3f0 2023-11-04T01:39:23.053 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:39:23.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.052+0000 7f731d8e0640 1 -- 172.21.15.44:0/1131658209 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f730406ae70 msgr2=0x7f730406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.052+0000 7f731d8e0640 1 --2- 172.21.15.44:0/1131658209 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f730406ae70 0x7f730406d330 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7308000f60 tx=0x7f7308009040 comp rx=0 tx=0).stop 2023-11-04T01:39:23.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.052+0000 7f731d8e0640 1 -- 172.21.15.44:0/1131658209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731815e3f0 msgr2=0x7f73181e48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.052+0000 7f731d8e0640 1 --2- 172.21.15.44:0/1131658209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731815e3f0 0x7f73181e48c0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f730c00d800 tx=0x7f730c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.052+0000 7f731d8e0640 1 -- 172.21.15.44:0/1131658209 shutdown_connections 2023-11-04T01:39:23.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.052+0000 7f731d8e0640 1 --2- 172.21.15.44:0/1131658209 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f730406ae70 0x7f730406d330 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.052+0000 7f731d8e0640 1 --2- 172.21.15.44:0/1131658209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73181e4e00 0x7f731814f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.052+0000 7f731d8e0640 1 --2- 172.21.15.44:0/1131658209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731815e3f0 0x7f73181e48c0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.052+0000 7f731d8e0640 1 --2- 172.21.15.44:0/1131658209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73180cc300 0x7f7318159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.052+0000 7f731d8e0640 1 -- 172.21.15.44:0/1131658209 >> 172.21.15.44:0/1131658209 conn(0x7f7318071820 msgr2=0x7f73180b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:23.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.053+0000 7f731d8e0640 1 -- 172.21.15.44:0/1131658209 shutdown_connections 2023-11-04T01:39:23.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.053+0000 7f731d8e0640 1 -- 172.21.15.44:0/1131658209 wait complete. 2023-11-04T01:39:23.065 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable' 2023-11-04T01:39:23.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.169+0000 7fe04920e640 1 Processor -- start 2023-11-04T01:39:23.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.169+0000 7fe04920e640 1 -- start start 2023-11-04T01:39:23.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.170+0000 7fe04920e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe0440cd880 0x7fe0440cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.170+0000 7fe04920e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04415d730 con 0x7fe04415d2a0 2023-11-04T01:39:23.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.170+0000 7fe04920e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04415d9a0 con 0x7fe0440ce160 2023-11-04T01:39:23.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.170+0000 7fe04920e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04415e340 con 0x7fe0440cd880 2023-11-04T01:39:23.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.170+0000 7fe04259c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe04415d2a0 0x7fe0440ce540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33094/0 (socket says 172.21.15.44:33094) 2023-11-04T01:39:23.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.170+0000 7fe04259c640 1 -- 172.21.15.44:0/4079993586 learned_addr learned my addr 172.21.15.44:0/4079993586 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:23.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.170+0000 7fe04359e640 1 --2- 172.21.15.44:0/4079993586 >> v2:172.21.15.204:3300/0 conn(0x7fe0440cd880 0x7fe0440cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.170+0000 7fe041d9b640 1 -- 172.21.15.44:0/4079993586 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984658094 0 0) 0x7fe04415d730 con 0x7fe04415d2a0 2023-11-04T01:39:23.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.170+0000 7fe041d9b640 1 -- 172.21.15.44:0/4079993586 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe02c003520 con 0x7fe04415d2a0 2023-11-04T01:39:23.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.170+0000 7fe04359e640 1 -- 172.21.15.44:0/4079993586 >> v1:172.21.15.204:6789/0 conn(0x7fe0440ce160 legacy=0x7fe044161620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.170+0000 7fe04359e640 1 -- 172.21.15.44:0/4079993586 >> v1:172.21.15.44:6789/0 conn(0x7fe04415d2a0 legacy=0x7fe0440ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.170+0000 7fe041d9b640 1 -- 172.21.15.44:0/4079993586 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491330123 0 0) 0x7fe04415d9a0 con 0x7fe0440ce160 2023-11-04T01:39:23.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.170+0000 7fe04359e640 1 -- 172.21.15.44:0/4079993586 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04415dc80 con 0x7fe0440cd880 2023-11-04T01:39:23.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.171+0000 7fe04359e640 1 --2- 172.21.15.44:0/4079993586 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0440cd880 0x7fe0440cb6a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009d90 tx=0x7fe03c02bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b78e26d0cd10167 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.171+0000 7fe041d9b640 1 -- 172.21.15.44:0/4079993586 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038001670 con 0x7fe0440cd880 2023-11-04T01:39:23.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.171+0000 7fe041d9b640 1 -- 172.21.15.44:0/4079993586 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c02c7d0 con 0x7fe0440cd880 2023-11-04T01:39:23.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.171+0000 7fe041d9b640 1 -- 172.21.15.44:0/4079993586 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c02cb60 con 0x7fe0440cd880 2023-11-04T01:39:23.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.172+0000 7fe04920e640 1 -- 172.21.15.44:0/4079993586 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0440cd880 msgr2=0x7fe0440cb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.172+0000 7fe04920e640 1 --2- 172.21.15.44:0/4079993586 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0440cd880 0x7fe0440cb6a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009d90 tx=0x7fe03c02bca0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.172+0000 7fe04920e640 1 -- 172.21.15.44:0/4079993586 shutdown_connections 2023-11-04T01:39:23.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.172+0000 7fe04920e640 1 --2- 172.21.15.44:0/4079993586 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0440cd880 0x7fe0440cb6a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.172+0000 7fe04920e640 1 -- 172.21.15.44:0/4079993586 >> 172.21.15.44:0/4079993586 conn(0x7fe0440cc5b0 msgr2=0x7fe0440cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:23.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.172+0000 7fe04920e640 1 -- 172.21.15.44:0/4079993586 shutdown_connections 2023-11-04T01:39:23.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.172+0000 7fe04920e640 1 -- 172.21.15.44:0/4079993586 wait complete. 2023-11-04T01:39:23.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.173+0000 7fe04920e640 1 Processor -- start 2023-11-04T01:39:23.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.173+0000 7fe04920e640 1 -- start start 2023-11-04T01:39:23.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.174+0000 7fe04920e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0440cd880 0x7fe0441570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.174+0000 7fe04920e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0440ce160 0x7fe0440b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.174+0000 7fe04920e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0440b3ed0 0x7fe044157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.174+0000 7fe04920e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe044159ef0 con 0x7fe0440b3ed0 2023-11-04T01:39:23.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.174+0000 7fe04920e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440b28f0 con 0x7fe0440ce160 2023-11-04T01:39:23.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.174+0000 7fe04920e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440b2bd0 con 0x7fe0440cd880 2023-11-04T01:39:23.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.174+0000 7fe04359e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0440b3ed0 0x7fe044157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.174+0000 7fe04359e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0440b3ed0 0x7fe044157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60738/0 (socket says 172.21.15.44:60738) 2023-11-04T01:39:23.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.174+0000 7fe04359e640 1 -- 172.21.15.44:0/3943602555 learned_addr learned my addr 172.21.15.44:0/3943602555 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:23.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.174+0000 7fe04259c640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0440ce160 0x7fe0440b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.174+0000 7fe042d9d640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0440cd880 0x7fe0441570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.175+0000 7fe04359e640 1 -- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0440cd880 msgr2=0x7fe0441570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.175+0000 7fe04359e640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0440cd880 0x7fe0441570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.175+0000 7fe04359e640 1 -- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0440ce160 msgr2=0x7fe0440b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.175+0000 7fe04359e640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0440ce160 0x7fe0440b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.175+0000 7fe04359e640 1 -- 172.21.15.44:0/3943602555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c009a70 con 0x7fe0440b3ed0 2023-11-04T01:39:23.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.175+0000 7fe04259c640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0440ce160 0x7fe0440b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:23.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.175+0000 7fe042d9d640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0440cd880 0x7fe0441570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:23.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.175+0000 7fe04359e640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0440b3ed0 0x7fe044157640 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009d90 tx=0x7fe03c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.175+0000 7fe02b7fe640 1 -- 172.21.15.44:0/3943602555 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c034c00 con 0x7fe0440b3ed0 2023-11-04T01:39:23.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.175+0000 7fe02b7fe640 1 -- 172.21.15.44:0/3943602555 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c034d80 con 0x7fe0440b3ed0 2023-11-04T01:39:23.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.175+0000 7fe04920e640 1 -- 172.21.15.44:0/3943602555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0440b2eb0 con 0x7fe0440b3ed0 2023-11-04T01:39:23.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.175+0000 7fe02b7fe640 1 -- 172.21.15.44:0/3943602555 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c003bd0 con 0x7fe0440b3ed0 2023-11-04T01:39:23.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.175+0000 7fe04920e640 1 -- 172.21.15.44:0/3943602555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0440b3470 con 0x7fe0440b3ed0 2023-11-04T01:39:23.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.176+0000 7fe04920e640 1 -- 172.21.15.44:0/3943602555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0440b3660 con 0x7fe0440b3ed0 2023-11-04T01:39:23.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.177+0000 7fe02b7fe640 1 -- 172.21.15.44:0/3943602555 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe03c03b050 con 0x7fe0440b3ed0 2023-11-04T01:39:23.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.177+0000 7fe02b7fe640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe03006aea0 0x7fe03006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.177+0000 7fe02b7fe640 1 -- 172.21.15.44:0/3943602555 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fe03c0aba70 con 0x7fe0440b3ed0 2023-11-04T01:39:23.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.177+0000 7fe042d9d640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe03006aea0 0x7fe03006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.178+0000 7fe042d9d640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe03006aea0 0x7fe03006d360 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe034000fb0 tx=0x7fe034009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.181+0000 7fe02b7fe640 1 -- 172.21.15.44:0/3943602555 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe03c076a60 con 0x7fe0440b3ed0 2023-11-04T01:39:23.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.423+0000 7fe04920e640 1 -- 172.21.15.44:0/3943602555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]} v 0) v1 -- 0x7fe044074290 con 0x7fe0440b3ed0 2023-11-04T01:39:23.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.496+0000 7fe02b7fe640 1 -- 172.21.15.44:0/3943602555 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]}]=0 v214) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe03c04d0d0 con 0x7fe0440b3ed0 2023-11-04T01:39:23.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.498+0000 7fe04920e640 1 -- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe03006aea0 msgr2=0x7fe03006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.498+0000 7fe04920e640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe03006aea0 0x7fe03006d360 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe034000fb0 tx=0x7fe034009040 comp rx=0 tx=0).stop 2023-11-04T01:39:23.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.498+0000 7fe04920e640 1 -- 172.21.15.44:0/3943602555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0440b3ed0 msgr2=0x7fe044157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.498+0000 7fe04920e640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0440b3ed0 0x7fe044157640 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009d90 tx=0x7fe03c004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:23.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.498+0000 7fe04920e640 1 -- 172.21.15.44:0/3943602555 shutdown_connections 2023-11-04T01:39:23.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.498+0000 7fe04920e640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe03006aea0 0x7fe03006d360 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.498+0000 7fe04920e640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0440b3ed0 0x7fe044157640 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.498+0000 7fe04920e640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0440ce160 0x7fe0440b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.498+0000 7fe04920e640 1 --2- 172.21.15.44:0/3943602555 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0440cd880 0x7fe0441570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.498+0000 7fe04920e640 1 -- 172.21.15.44:0/3943602555 >> 172.21.15.44:0/3943602555 conn(0x7fe0440cc5b0 msgr2=0x7fe0440ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:23.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.498+0000 7fe04920e640 1 -- 172.21.15.44:0/3943602555 shutdown_connections 2023-11-04T01:39:23.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.498+0000 7fe04920e640 1 -- 172.21.15.44:0/3943602555 wait complete. 2023-11-04T01:39:23.511 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:39:23.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.618+0000 7fc8260a9640 1 Processor -- start 2023-11-04T01:39:23.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.618+0000 7fc8260a9640 1 -- start start 2023-11-04T01:39:23.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.618+0000 7fc8260a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc82015ad30 0x7fc8200adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.618+0000 7fc8260a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8200ad730 0x7fc820070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.618+0000 7fc8260a9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc820070c50 0x7fc8200c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.618+0000 7fc8260a9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8200ae260 con 0x7fc82015ad30 2023-11-04T01:39:23.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.618+0000 7fc8260a9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8200710e0 con 0x7fc820070c50 2023-11-04T01:39:23.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.618+0000 7fc8260a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8200c3900 con 0x7fc8200ad730 2023-11-04T01:39:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.619+0000 7fc81f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc82015ad30 0x7fc8200adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.619+0000 7fc81f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc82015ad30 0x7fc8200adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60746/0 (socket says 172.21.15.44:60746) 2023-11-04T01:39:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.619+0000 7fc81f7fe640 1 -- 172.21.15.44:0/94477521 learned_addr learned my addr 172.21.15.44:0/94477521 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.619+0000 7fc81f7fe640 1 -- 172.21.15.44:0/94477521 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8200ad730 msgr2=0x7fc820070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.619+0000 7fc81f7fe640 1 --2- 172.21.15.44:0/94477521 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8200ad730 0x7fc820070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.619+0000 7fc81f7fe640 1 -- 172.21.15.44:0/94477521 >> v2:172.21.15.204:3300/0 conn(0x7fc820070c50 msgr2=0x7fc8200c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.619+0000 7fc81ffff640 1 --2- 172.21.15.44:0/94477521 >> v2:172.21.15.204:3300/0 conn(0x7fc820070c50 0x7fc8200c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.619+0000 7fc81f7fe640 1 --2- 172.21.15.44:0/94477521 >> v2:172.21.15.204:3300/0 conn(0x7fc820070c50 0x7fc8200c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.619+0000 7fc81f7fe640 1 -- 172.21.15.44:0/94477521 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8200c3be0 con 0x7fc82015ad30 2023-11-04T01:39:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.619+0000 7fc81ffff640 1 --2- 172.21.15.44:0/94477521 >> v2:172.21.15.204:3300/0 conn(0x7fc820070c50 0x7fc8200c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.620+0000 7fc81f7fe640 1 --2- 172.21.15.44:0/94477521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc82015ad30 0x7fc8200adc80 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fc810009870 tx=0x7fc81002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7395ea31202e83f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.620+0000 7fc81e7fc640 1 -- 172.21.15.44:0/94477521 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8100317c0 con 0x7fc82015ad30 2023-11-04T01:39:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.620+0000 7fc81e7fc640 1 -- 172.21.15.44:0/94477521 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc810031920 con 0x7fc82015ad30 2023-11-04T01:39:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.620+0000 7fc81e7fc640 1 -- 172.21.15.44:0/94477521 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810031cb0 con 0x7fc82015ad30 2023-11-04T01:39:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.620+0000 7fc8260a9640 1 -- 172.21.15.44:0/94477521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc82015ad30 msgr2=0x7fc8200adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.620+0000 7fc8260a9640 1 --2- 172.21.15.44:0/94477521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc82015ad30 0x7fc8200adc80 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fc810009870 tx=0x7fc81002b860 comp rx=0 tx=0).stop 2023-11-04T01:39:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.620+0000 7fc8260a9640 1 -- 172.21.15.44:0/94477521 shutdown_connections 2023-11-04T01:39:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.620+0000 7fc8260a9640 1 --2- 172.21.15.44:0/94477521 >> v2:172.21.15.204:3300/0 conn(0x7fc820070c50 0x7fc8200c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.620+0000 7fc8260a9640 1 --2- 172.21.15.44:0/94477521 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8200ad730 0x7fc820070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.620+0000 7fc8260a9640 1 --2- 172.21.15.44:0/94477521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc82015ad30 0x7fc8200adc80 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.620+0000 7fc8260a9640 1 -- 172.21.15.44:0/94477521 >> 172.21.15.44:0/94477521 conn(0x7fc8200ce950 msgr2=0x7fc8200ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.621+0000 7fc8260a9640 1 -- 172.21.15.44:0/94477521 shutdown_connections 2023-11-04T01:39:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.621+0000 7fc8260a9640 1 -- 172.21.15.44:0/94477521 wait complete. 2023-11-04T01:39:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.622+0000 7fc8260a9640 1 Processor -- start 2023-11-04T01:39:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.622+0000 7fc8260a9640 1 -- start start 2023-11-04T01:39:23.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc8260a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc820070c50 0x7fc8201ef9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc8260a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8200ad730 0x7fc820155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc8260a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc82015ad30 0x7fc820155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc8260a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8200b2990 con 0x7fc8200ad730 2023-11-04T01:39:23.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc8260a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8200c7e30 con 0x7fc820070c50 2023-11-04T01:39:23.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc8260a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8200c7590 con 0x7fc82015ad30 2023-11-04T01:39:23.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc81effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8200ad730 0x7fc820155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc81effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8200ad730 0x7fc820155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60758/0 (socket says 172.21.15.44:60758) 2023-11-04T01:39:23.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc81effd640 1 -- 172.21.15.44:0/1970029360 learned_addr learned my addr 172.21.15.44:0/1970029360 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:23.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc81f7fe640 1 --2- 172.21.15.44:0/1970029360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc820070c50 0x7fc8201ef9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc81ffff640 1 --2- 172.21.15.44:0/1970029360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc82015ad30 0x7fc820155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc81effd640 1 -- 172.21.15.44:0/1970029360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc82015ad30 msgr2=0x7fc820155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc81effd640 1 --2- 172.21.15.44:0/1970029360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc82015ad30 0x7fc820155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc81effd640 1 -- 172.21.15.44:0/1970029360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc820070c50 msgr2=0x7fc8201ef9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc81effd640 1 --2- 172.21.15.44:0/1970029360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc820070c50 0x7fc8201ef9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc81effd640 1 -- 172.21.15.44:0/1970029360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8100094d0 con 0x7fc8200ad730 2023-11-04T01:39:23.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc81effd640 1 --2- 172.21.15.44:0/1970029360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8200ad730 0x7fc820155a20 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc81400b4a0 tx=0x7fc81400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc807fff640 1 -- 172.21.15.44:0/1970029360 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc814010610 con 0x7fc8200ad730 2023-11-04T01:39:23.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc807fff640 1 -- 172.21.15.44:0/1970029360 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc814010770 con 0x7fc8200ad730 2023-11-04T01:39:23.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc8260a9640 1 -- 172.21.15.44:0/1970029360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8200c7870 con 0x7fc8200ad730 2023-11-04T01:39:23.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.623+0000 7fc807fff640 1 -- 172.21.15.44:0/1970029360 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc814010b20 con 0x7fc8200ad730 2023-11-04T01:39:23.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.624+0000 7fc8260a9640 1 -- 172.21.15.44:0/1970029360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8201eff10 con 0x7fc8200ad730 2023-11-04T01:39:23.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.625+0000 7fc8260a9640 1 -- 172.21.15.44:0/1970029360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8200b2ad0 con 0x7fc8200ad730 2023-11-04T01:39:23.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.625+0000 7fc807fff640 1 -- 172.21.15.44:0/1970029360 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc814010c80 con 0x7fc8200ad730 2023-11-04T01:39:23.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.625+0000 7fc807fff640 1 --2- 172.21.15.44:0/1970029360 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc80c06aea0 0x7fc80c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.625+0000 7fc807fff640 1 -- 172.21.15.44:0/1970029360 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fc814089310 con 0x7fc8200ad730 2023-11-04T01:39:23.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.626+0000 7fc81f7fe640 1 --2- 172.21.15.44:0/1970029360 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc80c06aea0 0x7fc80c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.626+0000 7fc81f7fe640 1 --2- 172.21.15.44:0/1970029360 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc80c06aea0 0x7fc80c06d360 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc810036000 tx=0x7fc81003d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.630+0000 7fc807fff640 1 -- 172.21.15.44:0/1970029360 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc8200b2ad0 con 0x7fc8200ad730 2023-11-04T01:39:23.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.809+0000 7fc8260a9640 1 -- 172.21.15.44:0/1970029360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc8200b2ad0 con 0x7fc8200ad730 2023-11-04T01:39:23.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.812+0000 7fc807fff640 1 -- 172.21.15.44:0/1970029360 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v19)=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc8200b2ad0 con 0x7fc8200ad730 2023-11-04T01:39:23.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.814+0000 7fc8260a9640 1 -- 172.21.15.44:0/1970029360 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc80c06aea0 msgr2=0x7fc80c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.814+0000 7fc8260a9640 1 --2- 172.21.15.44:0/1970029360 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc80c06aea0 0x7fc80c06d360 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc810036000 tx=0x7fc81003d040 comp rx=0 tx=0).stop 2023-11-04T01:39:23.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.814+0000 7fc8260a9640 1 -- 172.21.15.44:0/1970029360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8200ad730 msgr2=0x7fc820155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.814+0000 7fc8260a9640 1 --2- 172.21.15.44:0/1970029360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8200ad730 0x7fc820155a20 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc81400b4a0 tx=0x7fc81400b960 comp rx=0 tx=0).stop 2023-11-04T01:39:23.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.814+0000 7fc8260a9640 1 -- 172.21.15.44:0/1970029360 shutdown_connections 2023-11-04T01:39:23.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.814+0000 7fc8260a9640 1 --2- 172.21.15.44:0/1970029360 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc80c06aea0 0x7fc80c06d360 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.814+0000 7fc8260a9640 1 --2- 172.21.15.44:0/1970029360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc82015ad30 0x7fc820155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.814+0000 7fc8260a9640 1 --2- 172.21.15.44:0/1970029360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8200ad730 0x7fc820155a20 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.814+0000 7fc8260a9640 1 --2- 172.21.15.44:0/1970029360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc820070c50 0x7fc8201ef9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.814+0000 7fc8260a9640 1 -- 172.21.15.44:0/1970029360 >> 172.21.15.44:0/1970029360 conn(0x7fc8200ce950 msgr2=0x7fc8200af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:23.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.814+0000 7fc8260a9640 1 -- 172.21.15.44:0/1970029360 shutdown_connections 2023-11-04T01:39:23.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:23.814+0000 7fc8260a9640 1 -- 172.21.15.44:0/1970029360 wait complete. 2023-11-04T01:39:23.827 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:39:23.827 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:39:23.867 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:39:23.907 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:39:23.907 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:39:23.907 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:23.923 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:39:23.923 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:39:23.923 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:23.965 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:39:23.966 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:39:23.966 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:23.981 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:39:23.981 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:39:23.981 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:24.022 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:39:24.023 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:39:24.023 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:24.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.127+0000 7f5228d55640 1 Processor -- start 2023-11-04T01:39:24.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.127+0000 7f5228d55640 1 -- start start 2023-11-04T01:39:24.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.127+0000 7f5228d55640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f52240ce240 0x7f5224157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.127+0000 7f5228d55640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522415e000 con 0x7f5224157540 2023-11-04T01:39:24.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.127+0000 7f5228d55640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522415e2e0 con 0x7f52240cde60 2023-11-04T01:39:24.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.127+0000 7f5228d55640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522415e5c0 con 0x7f52240ce240 2023-11-04T01:39:24.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5222d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5224157540 0x7f52240d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33108/0 (socket says 172.21.15.44:33108) 2023-11-04T01:39:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5222d9d640 1 -- 172.21.15.44:0/1000533091 learned_addr learned my addr 172.21.15.44:0/1000533091 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f521bfff640 1 --2- 172.21.15.44:0/1000533091 >> v2:172.21.15.204:3300/0 conn(0x7f52240ce240 0x7f5224157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5221d9b640 1 -- 172.21.15.44:0/1000533091 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055765299 0 0) 0x7f522415e000 con 0x7f5224157540 2023-11-04T01:39:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5221d9b640 1 -- 172.21.15.44:0/1000533091 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5210003520 con 0x7f5224157540 2023-11-04T01:39:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5221d9b640 1 -- 172.21.15.44:0/1000533091 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3590034343 0 0) 0x7f5210003520 con 0x7f5224157540 2023-11-04T01:39:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5221d9b640 1 -- 172.21.15.44:0/1000533091 >> v2:172.21.15.204:3300/0 conn(0x7f52240ce240 msgr2=0x7f5224157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5221d9b640 1 --2- 172.21.15.44:0/1000533091 >> v2:172.21.15.204:3300/0 conn(0x7f52240ce240 0x7f5224157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5221d9b640 1 -- 172.21.15.44:0/1000533091 >> v1:172.21.15.204:6789/0 conn(0x7f52240cde60 legacy=0x7f522415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5221d9b640 1 -- 172.21.15.44:0/1000533091 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52240d1120 con 0x7f5224157540 2023-11-04T01:39:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5221d9b640 1 -- 172.21.15.44:0/1000533091 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f521c0019f0 con 0x7f5224157540 2023-11-04T01:39:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5221d9b640 1 -- 172.21.15.44:0/1000533091 >> v1:172.21.15.44:6789/0 conn(0x7f5224157540 legacy=0x7f52240d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5221d9b640 1 --2- 172.21.15.44:0/1000533091 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5210003970 0x7f5210003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5221d9b640 1 --2- 172.21.15.44:0/1000533091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52100047c0 0x7f5210004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5221d9b640 1 --2- 172.21.15.44:0/1000533091 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5210005180 0x7f521000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5221d9b640 1 -- 172.21.15.44:0/1000533091 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522415e5c0 con 0x7f52100047c0 2023-11-04T01:39:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5221d9b640 1 -- 172.21.15.44:0/1000533091 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521000c020 con 0x7f5210003970 2023-11-04T01:39:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5221d9b640 1 -- 172.21.15.44:0/1000533091 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521000c1e0 con 0x7f5210005180 2023-11-04T01:39:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f521bfff640 1 --2- 172.21.15.44:0/1000533091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52100047c0 0x7f5210004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f522259c640 1 --2- 172.21.15.44:0/1000533091 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5210003970 0x7f5210003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f5222d9d640 1 --2- 172.21.15.44:0/1000533091 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5210005180 0x7f521000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f521bfff640 1 -- 172.21.15.44:0/1000533091 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5210005180 msgr2=0x7f521000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.128+0000 7f521bfff640 1 --2- 172.21.15.44:0/1000533091 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5210005180 0x7f521000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.129+0000 7f521bfff640 1 -- 172.21.15.44:0/1000533091 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5210003970 msgr2=0x7f5210003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.129+0000 7f521bfff640 1 --2- 172.21.15.44:0/1000533091 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5210003970 0x7f5210003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.129+0000 7f521bfff640 1 -- 172.21.15.44:0/1000533091 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5210003520 con 0x7f52100047c0 2023-11-04T01:39:24.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.129+0000 7f5222d9d640 1 -- 172.21.15.44:0/1000533091 reap_dead start 2023-11-04T01:39:24.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.129+0000 7f522259c640 1 --2- 172.21.15.44:0/1000533091 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5210003970 0x7f5210003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:24.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.129+0000 7f521bfff640 1 --2- 172.21.15.44:0/1000533091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52100047c0 0x7f5210004c40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f520c009ac0 tx=0x7f52100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b29712fcee707dc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.129+0000 7f5221d9b640 1 -- 172.21.15.44:0/1000533091 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c02c6b0 con 0x7f52100047c0 2023-11-04T01:39:24.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.129+0000 7f5221d9b640 1 -- 172.21.15.44:0/1000533091 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c02c810 con 0x7f52100047c0 2023-11-04T01:39:24.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.129+0000 7f5221d9b640 1 -- 172.21.15.44:0/1000533091 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c02cba0 con 0x7f52100047c0 2023-11-04T01:39:24.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.130+0000 7f5228d55640 1 -- 172.21.15.44:0/1000533091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52100047c0 msgr2=0x7f5210004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.130+0000 7f5228d55640 1 --2- 172.21.15.44:0/1000533091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52100047c0 0x7f5210004c40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f520c009ac0 tx=0x7f52100057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.130+0000 7f5228d55640 1 -- 172.21.15.44:0/1000533091 shutdown_connections 2023-11-04T01:39:24.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.130+0000 7f5228d55640 1 --2- 172.21.15.44:0/1000533091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52100047c0 0x7f5210004c40 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.130+0000 7f5228d55640 1 -- 172.21.15.44:0/1000533091 >> 172.21.15.44:0/1000533091 conn(0x7f5224071f30 msgr2=0x7f52240cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.130+0000 7f5228d55640 1 -- 172.21.15.44:0/1000533091 shutdown_connections 2023-11-04T01:39:24.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.130+0000 7f5228d55640 1 -- 172.21.15.44:0/1000533091 wait complete. 2023-11-04T01:39:24.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.131+0000 7f5228d55640 1 Processor -- start 2023-11-04T01:39:24.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.131+0000 7f5228d55640 1 -- start start 2023-11-04T01:39:24.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.132+0000 7f5228d55640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52100047c0 0x7f52241469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.132+0000 7f5228d55640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f522415c690 0x7f5224144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.132+0000 7f5228d55640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52241454a0 0x7f52240c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.132+0000 7f5228d55640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52241465c0 con 0x7f52241454a0 2023-11-04T01:39:24.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.132+0000 7f5228d55640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522415cb10 con 0x7f522415c690 2023-11-04T01:39:24.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.132+0000 7f5228d55640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52241f2720 con 0x7f52100047c0 2023-11-04T01:39:24.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.132+0000 7f5222d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52241454a0 0x7f52240c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.132+0000 7f5222d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52241454a0 0x7f52240c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60776/0 (socket says 172.21.15.44:60776) 2023-11-04T01:39:24.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.132+0000 7f5222d9d640 1 -- 172.21.15.44:0/2845483559 learned_addr learned my addr 172.21.15.44:0/2845483559 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:24.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.132+0000 7f522259c640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52100047c0 0x7f52241469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.132+0000 7f521bfff640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f522415c690 0x7f5224144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.133+0000 7f5222d9d640 1 -- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52100047c0 msgr2=0x7f52241469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.133+0000 7f5222d9d640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52100047c0 0x7f52241469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.133+0000 7f5222d9d640 1 -- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f522415c690 msgr2=0x7f5224144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.133+0000 7f5222d9d640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f522415c690 0x7f5224144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.133+0000 7f5222d9d640 1 -- 172.21.15.44:0/2845483559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5224145940 con 0x7f52241454a0 2023-11-04T01:39:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.133+0000 7f521bfff640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f522415c690 0x7f5224144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.133+0000 7f522259c640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52100047c0 0x7f52241469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.133+0000 7f5222d9d640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52241454a0 0x7f52240c82d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f52240cf5c0 tx=0x7f521c007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.133+0000 7f521affd640 1 -- 172.21.15.44:0/2845483559 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c00ea40 con 0x7f52241454a0 2023-11-04T01:39:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.133+0000 7f521affd640 1 -- 172.21.15.44:0/2845483559 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c00eba0 con 0x7f52241454a0 2023-11-04T01:39:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.133+0000 7f521affd640 1 -- 172.21.15.44:0/2845483559 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c013420 con 0x7f52241454a0 2023-11-04T01:39:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.133+0000 7f5228d55640 1 -- 172.21.15.44:0/2845483559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5224145c20 con 0x7f52241454a0 2023-11-04T01:39:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.133+0000 7f5228d55640 1 -- 172.21.15.44:0/2845483559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52241461e0 con 0x7f52241454a0 2023-11-04T01:39:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.134+0000 7f5228d55640 1 -- 172.21.15.44:0/2845483559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5224146700 con 0x7f52241454a0 2023-11-04T01:39:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.134+0000 7f521affd640 1 -- 172.21.15.44:0/2845483559 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f521c013580 con 0x7f52241454a0 2023-11-04T01:39:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.135+0000 7f521affd640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f520406ae70 0x7f520406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.135+0000 7f521affd640 1 -- 172.21.15.44:0/2845483559 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f521c089b30 con 0x7f52241454a0 2023-11-04T01:39:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.135+0000 7f522259c640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f520406ae70 0x7f520406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.136+0000 7f522259c640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f520406ae70 0x7f520406d330 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5214000c00 tx=0x7f5214009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.139+0000 7f521affd640 1 -- 172.21.15.44:0/2845483559 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5224146700 con 0x7f52241454a0 2023-11-04T01:39:24.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.355+0000 7f5228d55640 1 -- 172.21.15.44:0/2845483559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5224146700 con 0x7f52241454a0 2023-11-04T01:39:24.357 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.355+0000 7f521affd640 1 -- 172.21.15.44:0/2845483559 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f5224146700 con 0x7f52241454a0 2023-11-04T01:39:24.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:24.358 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/257114874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":257114874},{"type":"v1","addr":"172.21.15.204:6835","nonce":257114874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6292,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2084651129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":2084651129},{"type":"v1","addr":"172.21.15.204:6837","nonce":2084651129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1688550253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1688550253},{"type":"v1","addr":"172.21.15.44:6834","nonce":1688550253}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":7239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2281056600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2281056600},{"type":"v1","addr":"172.21.15.44:6835","nonce":2281056600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[]} 2023-11-04T01:39:24.358 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 41 2023-11-04T01:39:24.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.357+0000 7f5228d55640 1 -- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f520406ae70 msgr2=0x7f520406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.357+0000 7f5228d55640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f520406ae70 0x7f520406d330 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5214000c00 tx=0x7f5214009040 comp rx=0 tx=0).stop 2023-11-04T01:39:24.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.357+0000 7f5228d55640 1 -- 172.21.15.44:0/2845483559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52241454a0 msgr2=0x7f52240c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.357+0000 7f5228d55640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52241454a0 0x7f52240c82d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f52240cf5c0 tx=0x7f521c007af0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.357+0000 7f5228d55640 1 -- 172.21.15.44:0/2845483559 shutdown_connections 2023-11-04T01:39:24.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.357+0000 7f5228d55640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f520406ae70 0x7f520406d330 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.357+0000 7f5228d55640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52241454a0 0x7f52240c82d0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.357+0000 7f5228d55640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f522415c690 0x7f5224144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.357+0000 7f5228d55640 1 --2- 172.21.15.44:0/2845483559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52100047c0 0x7f52241469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.357+0000 7f5228d55640 1 -- 172.21.15.44:0/2845483559 >> 172.21.15.44:0/2845483559 conn(0x7f5224071f30 msgr2=0x7f52240d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.357+0000 7f5228d55640 1 -- 172.21.15.44:0/2845483559 shutdown_connections 2023-11-04T01:39:24.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.357+0000 7f5228d55640 1 -- 172.21.15.44:0/2845483559 wait complete. 2023-11-04T01:39:24.371 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:39:24.371 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:39:24.371 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:39:24.371 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:24.371 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:39:24.371 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:39:24.372 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:39:24.372 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:24.372 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:39:24.372 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:39:24.372 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:39:24.372 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:24.372 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:39:24.372 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:39:24.373 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:39:24.373 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:24.380 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:39:24.380 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:39:24.382 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:39:24.382 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:39:24.388 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:39:24.388 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:39:24.389 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:39:24.389 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:39:24.424 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:39:24.424 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:24.425 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:39:24.426 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:24.431 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:39:24.431 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:24.432 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:39:24.432 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:24.432 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:39:24.506 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2023-11-04T01:39:24.506 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2023-11-04T01:39:24.514 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2023-11-04T01:39:24.515 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2023-11-04T01:39:24.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.542+0000 7f3d68325640 1 Processor -- start 2023-11-04T01:39:24.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.542+0000 7f3d68325640 1 -- start start 2023-11-04T01:39:24.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.543+0000 7f3d68325640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3d60153e60 0x7f3d6015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.543+0000 7f3d68325640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3d600b4880 0x7f3d600b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.543+0000 7f3d68325640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d600cde60 con 0x7f3d600cd6d0 2023-11-04T01:39:24.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.543+0000 7f3d68325640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d60160f90 con 0x7f3d600b4880 2023-11-04T01:39:24.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.543+0000 7f3d68325640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d600b5200 con 0x7f3d60153e60 2023-11-04T01:39:24.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.543+0000 7f3d668c2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3d600b4880 0x7f3d600b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.543+0000 7f3d668c2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3d600b4880 0x7f3d600b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60810/0 (socket says 172.21.15.44:60810) 2023-11-04T01:39:24.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.543+0000 7f3d668c2640 1 -- 172.21.15.44:0/2640852434 learned_addr learned my addr 172.21.15.44:0/2640852434 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:24.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.543+0000 7f3d660c1640 1 --2- 172.21.15.44:0/2640852434 >> v2:172.21.15.204:3300/0 conn(0x7f3d60153e60 0x7f3d6015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.544+0000 7f3d668c2640 1 -- 172.21.15.44:0/2640852434 >> v2:172.21.15.204:3300/0 conn(0x7f3d60153e60 msgr2=0x7f3d6015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.544+0000 7f3d668c2640 1 --2- 172.21.15.44:0/2640852434 >> v2:172.21.15.204:3300/0 conn(0x7f3d60153e60 0x7f3d6015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.544+0000 7f3d668c2640 1 -- 172.21.15.44:0/2640852434 >> v1:172.21.15.204:6789/0 conn(0x7f3d600cd6d0 legacy=0x7f3d60161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.544+0000 7f3d668c2640 1 -- 172.21.15.44:0/2640852434 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6015e400 con 0x7f3d600b4880 2023-11-04T01:39:24.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.544+0000 7f3d668c2640 1 --2- 172.21.15.44:0/2640852434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d600b4880 0x7f3d600b4cc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f3d6008abe0 tx=0x7f3d5802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f453dd158a66460 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.545+0000 7f3d650bf640 1 -- 172.21.15.44:0/2640852434 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5802cb20 con 0x7f3d600b4880 2023-11-04T01:39:24.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.545+0000 7f3d650bf640 1 -- 172.21.15.44:0/2640852434 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5802cc80 con 0x7f3d600b4880 2023-11-04T01:39:24.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.545+0000 7f3d650bf640 1 -- 172.21.15.44:0/2640852434 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d580343f0 con 0x7f3d600b4880 2023-11-04T01:39:24.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.545+0000 7f3d68325640 1 -- 172.21.15.44:0/2640852434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d600b4880 msgr2=0x7f3d600b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.545+0000 7f3d68325640 1 --2- 172.21.15.44:0/2640852434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d600b4880 0x7f3d600b4cc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f3d6008abe0 tx=0x7f3d5802bf80 comp rx=0 tx=0).stop 2023-11-04T01:39:24.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.545+0000 7f3d68325640 1 -- 172.21.15.44:0/2640852434 shutdown_connections 2023-11-04T01:39:24.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.545+0000 7f3d68325640 1 --2- 172.21.15.44:0/2640852434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d600b4880 0x7f3d600b4cc0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.545+0000 7f3d68325640 1 --2- 172.21.15.44:0/2640852434 >> v2:172.21.15.204:3300/0 conn(0x7f3d60153e60 0x7f3d6015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.545+0000 7f3d68325640 1 -- 172.21.15.44:0/2640852434 >> 172.21.15.44:0/2640852434 conn(0x7f3d600cf880 msgr2=0x7f3d600cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.545+0000 7f3d68325640 1 -- 172.21.15.44:0/2640852434 shutdown_connections 2023-11-04T01:39:24.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.545+0000 7f3d68325640 1 -- 172.21.15.44:0/2640852434 wait complete. 2023-11-04T01:39:24.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.546+0000 7f3d68325640 1 Processor -- start 2023-11-04T01:39:24.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.546+0000 7f3d68325640 1 -- start start 2023-11-04T01:39:24.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.547+0000 7f3d68325640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d600b4880 0x7f3d60159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.547+0000 7f3d68325640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d600cd6d0 0x7f3d60142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.547+0000 7f3d68325640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d60153e60 0x7f3d60143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.547+0000 7f3d68325640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d60159870 con 0x7f3d600cd6d0 2023-11-04T01:39:24.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.547+0000 7f3d68325640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d60158c60 con 0x7f3d60153e60 2023-11-04T01:39:24.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.547+0000 7f3d68325640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d60158f40 con 0x7f3d600b4880 2023-11-04T01:39:24.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.547+0000 7f3d658c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d600cd6d0 0x7f3d60142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.547+0000 7f3d658c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d600cd6d0 0x7f3d60142fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60818/0 (socket says 172.21.15.44:60818) 2023-11-04T01:39:24.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.547+0000 7f3d658c0640 1 -- 172.21.15.44:0/3175654854 learned_addr learned my addr 172.21.15.44:0/3175654854 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:24.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.547+0000 7f3d660c1640 1 --2- 172.21.15.44:0/3175654854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d600b4880 0x7f3d60159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.547+0000 7f3d668c2640 1 --2- 172.21.15.44:0/3175654854 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d60153e60 0x7f3d60143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.548+0000 7f3d658c0640 1 -- 172.21.15.44:0/3175654854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d600b4880 msgr2=0x7f3d60159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.548+0000 7f3d658c0640 1 --2- 172.21.15.44:0/3175654854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d600b4880 0x7f3d60159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.548+0000 7f3d658c0640 1 -- 172.21.15.44:0/3175654854 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d60153e60 msgr2=0x7f3d60143520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.548+0000 7f3d658c0640 1 --2- 172.21.15.44:0/3175654854 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d60153e60 0x7f3d60143520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.548+0000 7f3d658c0640 1 -- 172.21.15.44:0/3175654854 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d58009b30 con 0x7f3d600cd6d0 2023-11-04T01:39:24.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.548+0000 7f3d658c0640 1 --2- 172.21.15.44:0/3175654854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d600cd6d0 0x7f3d60142fe0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000c400 tx=0x7f3d5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.548+0000 7f3d56ffd640 1 -- 172.21.15.44:0/3175654854 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d500052d0 con 0x7f3d600cd6d0 2023-11-04T01:39:24.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.548+0000 7f3d56ffd640 1 -- 172.21.15.44:0/3175654854 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50005430 con 0x7f3d600cd6d0 2023-11-04T01:39:24.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.548+0000 7f3d56ffd640 1 -- 172.21.15.44:0/3175654854 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50003830 con 0x7f3d600cd6d0 2023-11-04T01:39:24.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.548+0000 7f3d68325640 1 -- 172.21.15.44:0/3175654854 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d60159220 con 0x7f3d600cd6d0 2023-11-04T01:39:24.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.548+0000 7f3d68325640 1 -- 172.21.15.44:0/3175654854 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d60153380 con 0x7f3d600cd6d0 2023-11-04T01:39:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.549+0000 7f3d68325640 1 -- 172.21.15.44:0/3175654854 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d600d2150 con 0x7f3d600cd6d0 2023-11-04T01:39:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.549+0000 7f3d56ffd640 1 -- 172.21.15.44:0/3175654854 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d50003990 con 0x7f3d600cd6d0 2023-11-04T01:39:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.550+0000 7f3d56ffd640 1 --2- 172.21.15.44:0/3175654854 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d4406ae70 0x7f3d4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.550+0000 7f3d56ffd640 1 -- 172.21.15.44:0/3175654854 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f3d50088e00 con 0x7f3d600cd6d0 2023-11-04T01:39:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.550+0000 7f3d660c1640 1 --2- 172.21.15.44:0/3175654854 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d4406ae70 0x7f3d4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.551+0000 7f3d660c1640 1 --2- 172.21.15.44:0/3175654854 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d4406ae70 0x7f3d4406d330 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009aa0 tx=0x7f3d5c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.554+0000 7f3d56ffd640 1 -- 172.21.15.44:0/3175654854 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d50053cf0 con 0x7f3d600cd6d0 2023-11-04T01:39:24.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:24.746+0000 7f3d68325640 1 -- 172.21.15.44:0/3175654854 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3d600d06e0 con 0x7f3d600cd6d0 2023-11-04T01:39:25.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.512+0000 7f3d56ffd640 1 -- 172.21.15.44:0/3175654854 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v90) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3d50017080 con 0x7f3d600cd6d0 2023-11-04T01:39:25.514 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2023-11-04T01:39:25.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.515+0000 7f3d68325640 1 -- 172.21.15.44:0/3175654854 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d4406ae70 msgr2=0x7f3d4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.515+0000 7f3d68325640 1 --2- 172.21.15.44:0/3175654854 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d4406ae70 0x7f3d4406d330 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009aa0 tx=0x7f3d5c009190 comp rx=0 tx=0).stop 2023-11-04T01:39:25.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.515+0000 7f3d68325640 1 -- 172.21.15.44:0/3175654854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d600cd6d0 msgr2=0x7f3d60142fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.515+0000 7f3d68325640 1 --2- 172.21.15.44:0/3175654854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d600cd6d0 0x7f3d60142fe0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000c400 tx=0x7f3d5000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.515+0000 7f3d68325640 1 -- 172.21.15.44:0/3175654854 shutdown_connections 2023-11-04T01:39:25.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.515+0000 7f3d68325640 1 --2- 172.21.15.44:0/3175654854 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d4406ae70 0x7f3d4406d330 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.515+0000 7f3d68325640 1 --2- 172.21.15.44:0/3175654854 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d60153e60 0x7f3d60143520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.515+0000 7f3d68325640 1 --2- 172.21.15.44:0/3175654854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d600cd6d0 0x7f3d60142fe0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.515+0000 7f3d68325640 1 --2- 172.21.15.44:0/3175654854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d600b4880 0x7f3d60159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.516+0000 7f3d68325640 1 -- 172.21.15.44:0/3175654854 >> 172.21.15.44:0/3175654854 conn(0x7f3d600cf880 msgr2=0x7f3d600d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:25.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.516+0000 7f3d68325640 1 -- 172.21.15.44:0/3175654854 shutdown_connections 2023-11-04T01:39:25.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.516+0000 7f3d68325640 1 -- 172.21.15.44:0/3175654854 wait complete. 2023-11-04T01:39:25.532 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:39:25.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.643+0000 7fbd021ce640 1 Processor -- start 2023-11-04T01:39:25.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.643+0000 7fbd021ce640 1 -- start start 2023-11-04T01:39:25.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.644+0000 7fbd021ce640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbcfc15ae40 0x7fbcfc15bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.644+0000 7fbd021ce640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbcfc0cbc00 0x7fbcfc0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.644+0000 7fbd021ce640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcfc0cc450 con 0x7fbcfc0cd860 2023-11-04T01:39:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.644+0000 7fbd021ce640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcfc15f400 con 0x7fbcfc15ae40 2023-11-04T01:39:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.644+0000 7fbd021ce640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcfc15b220 con 0x7fbcfc0cbc00 2023-11-04T01:39:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.644+0000 7fbcfb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbcfc15ae40 0x7fbcfc15bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.644+0000 7fbcfb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbcfc15ae40 0x7fbcfc15bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60832/0 (socket says 172.21.15.44:60832) 2023-11-04T01:39:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.644+0000 7fbcfb7fe640 1 -- 172.21.15.44:0/3944605105 learned_addr learned my addr 172.21.15.44:0/3944605105 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.644+0000 7fbcfaffd640 1 --2- 172.21.15.44:0/3944605105 >> v2:172.21.15.204:3300/0 conn(0x7fbcfc0cbc00 0x7fbcfc0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.644+0000 7fbcfb7fe640 1 -- 172.21.15.44:0/3944605105 >> v2:172.21.15.204:3300/0 conn(0x7fbcfc0cbc00 msgr2=0x7fbcfc0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.644+0000 7fbcfb7fe640 1 --2- 172.21.15.44:0/3944605105 >> v2:172.21.15.204:3300/0 conn(0x7fbcfc0cbc00 0x7fbcfc0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.644+0000 7fbcfb7fe640 1 -- 172.21.15.44:0/3944605105 >> v1:172.21.15.204:6789/0 conn(0x7fbcfc0cd860 legacy=0x7fbcfc0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.644+0000 7fbcfb7fe640 1 -- 172.21.15.44:0/3944605105 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc15f890 con 0x7fbcfc15ae40 2023-11-04T01:39:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.645+0000 7fbcfb7fe640 1 --2- 172.21.15.44:0/3944605105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc15ae40 0x7fbcfc15bfb0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0b05d0 tx=0x7fbcec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d717caa059942104 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.645+0000 7fbcfa7fc640 1 -- 172.21.15.44:0/3944605105 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec031870 con 0x7fbcfc15ae40 2023-11-04T01:39:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.645+0000 7fbcfa7fc640 1 -- 172.21.15.44:0/3944605105 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec0319d0 con 0x7fbcfc15ae40 2023-11-04T01:39:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.645+0000 7fbcfa7fc640 1 -- 172.21.15.44:0/3944605105 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec031d60 con 0x7fbcfc15ae40 2023-11-04T01:39:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.646+0000 7fbd021ce640 1 -- 172.21.15.44:0/3944605105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc15ae40 msgr2=0x7fbcfc15bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.646+0000 7fbd021ce640 1 --2- 172.21.15.44:0/3944605105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc15ae40 0x7fbcfc15bfb0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0b05d0 tx=0x7fbcec02b910 comp rx=0 tx=0).stop 2023-11-04T01:39:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.646+0000 7fbd021ce640 1 -- 172.21.15.44:0/3944605105 shutdown_connections 2023-11-04T01:39:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.646+0000 7fbd021ce640 1 --2- 172.21.15.44:0/3944605105 >> v2:172.21.15.204:3300/0 conn(0x7fbcfc0cbc00 0x7fbcfc0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.646+0000 7fbd021ce640 1 --2- 172.21.15.44:0/3944605105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc15ae40 0x7fbcfc15bfb0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.646+0000 7fbd021ce640 1 -- 172.21.15.44:0/3944605105 >> 172.21.15.44:0/3944605105 conn(0x7fbcfc06ea90 msgr2=0x7fbcfc06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.646+0000 7fbd021ce640 1 -- 172.21.15.44:0/3944605105 shutdown_connections 2023-11-04T01:39:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.646+0000 7fbd021ce640 1 -- 172.21.15.44:0/3944605105 wait complete. 2023-11-04T01:39:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.647+0000 7fbd021ce640 1 Processor -- start 2023-11-04T01:39:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.647+0000 7fbd021ce640 1 -- start start 2023-11-04T01:39:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.648+0000 7fbd021ce640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcfc0cbc00 0x7fbcfc0c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.648+0000 7fbd021ce640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcfc0cd860 0x7fbcfc154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.648+0000 7fbd021ce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc15ae40 0x7fbcfc0c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.648+0000 7fbd021ce640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc1f1630 con 0x7fbcfc15ae40 2023-11-04T01:39:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.648+0000 7fbd021ce640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc1f1910 con 0x7fbcfc0cd860 2023-11-04T01:39:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.648+0000 7fbd021ce640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc1546a0 con 0x7fbcfc0cbc00 2023-11-04T01:39:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.648+0000 7fbcfbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc15ae40 0x7fbcfc0c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.648+0000 7fbcfbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc15ae40 0x7fbcfc0c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60848/0 (socket says 172.21.15.44:60848) 2023-11-04T01:39:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.648+0000 7fbcfbfff640 1 -- 172.21.15.44:0/13874086 learned_addr learned my addr 172.21.15.44:0/13874086 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.648+0000 7fbcfb7fe640 1 --2- 172.21.15.44:0/13874086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcfc0cbc00 0x7fbcfc0c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.648+0000 7fbcfaffd640 1 --2- 172.21.15.44:0/13874086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcfc0cd860 0x7fbcfc154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.648+0000 7fbcfbfff640 1 -- 172.21.15.44:0/13874086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcfc0cbc00 msgr2=0x7fbcfc0c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.648+0000 7fbcfbfff640 1 --2- 172.21.15.44:0/13874086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcfc0cbc00 0x7fbcfc0c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.648+0000 7fbcfbfff640 1 -- 172.21.15.44:0/13874086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcfc0cd860 msgr2=0x7fbcfc154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.648+0000 7fbcfbfff640 1 --2- 172.21.15.44:0/13874086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcfc0cd860 0x7fbcfc154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.649+0000 7fbcfbfff640 1 -- 172.21.15.44:0/13874086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcec0094d0 con 0x7fbcfc15ae40 2023-11-04T01:39:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.649+0000 7fbcfbfff640 1 --2- 172.21.15.44:0/13874086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc15ae40 0x7fbcfc0c4450 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400c780 tx=0x7fbcf400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.649+0000 7fbce3fff640 1 -- 172.21.15.44:0/13874086 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4003d80 con 0x7fbcfc15ae40 2023-11-04T01:39:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.649+0000 7fbce3fff640 1 -- 172.21.15.44:0/13874086 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf400ce90 con 0x7fbcfc15ae40 2023-11-04T01:39:25.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.649+0000 7fbd021ce640 1 -- 172.21.15.44:0/13874086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcfc154980 con 0x7fbcfc15ae40 2023-11-04T01:39:25.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.649+0000 7fbce3fff640 1 -- 172.21.15.44:0/13874086 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf40052b0 con 0x7fbcfc15ae40 2023-11-04T01:39:25.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.649+0000 7fbd021ce640 1 -- 172.21.15.44:0/13874086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcfc0c72a0 con 0x7fbcfc15ae40 2023-11-04T01:39:25.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.650+0000 7fbd021ce640 1 -- 172.21.15.44:0/13874086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcfc0ce2d0 con 0x7fbcfc15ae40 2023-11-04T01:39:25.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.650+0000 7fbce3fff640 1 -- 172.21.15.44:0/13874086 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbcf4005410 con 0x7fbcfc15ae40 2023-11-04T01:39:25.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.651+0000 7fbce3fff640 1 --2- 172.21.15.44:0/13874086 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbce806ae70 0x7fbce806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.651+0000 7fbce3fff640 1 -- 172.21.15.44:0/13874086 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6240+0+0 (secure 0 0 0) 0x7fbcf40890a0 con 0x7fbcfc15ae40 2023-11-04T01:39:25.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.651+0000 7fbcfb7fe640 1 --2- 172.21.15.44:0/13874086 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbce806ae70 0x7fbce806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.652+0000 7fbcfb7fe640 1 --2- 172.21.15.44:0/13874086 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbce806ae70 0x7fbce806d330 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbcec036000 tx=0x7fbcec03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:25.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.655+0000 7fbce3fff640 1 -- 172.21.15.44:0/13874086 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbcf4053f40 con 0x7fbcfc15ae40 2023-11-04T01:39:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.896+0000 7fbd021ce640 1 -- 172.21.15.44:0/13874086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbcfc154bc0 con 0x7fbcfc15ae40 2023-11-04T01:39:25.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.897+0000 7fbce3fff640 1 -- 172.21.15.44:0/13874086 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fbcfc154bc0 con 0x7fbcfc15ae40 2023-11-04T01:39:25.899 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:25.899 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:39:25.899 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2023-11-04T01:39:25.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.899 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2023-11-04T01:39:25.899 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0Vldrw2ExAA5cS9IfcK2l8SXaZdWm4f8g==", 2023-11-04T01:39:25.899 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.899 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:39:25.900 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:39:25.900 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:39:25.900 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:39:25.900 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.900 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2023-11-04T01:39:25.900 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlOogfIRAAYEw/sXZBXk/GJOrnBTA7xg==", 2023-11-04T01:39:25.900 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.900 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:39:25.900 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:39:25.900 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:39:25.900 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:39:25.900 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.901 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2023-11-04T01:39:25.901 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlDPc/GxAA32BghmM85xfJ14TjYFtNRw==", 2023-11-04T01:39:25.901 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.901 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:39:25.901 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:39:25.901 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:39:25.901 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:39:25.901 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.901 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2023-11-04T01:39:25.901 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlYpOSKBAAVivyMFmzkREyWWFObAwKHw==", 2023-11-04T01:39:25.902 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.902 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:39:25.902 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:39:25.902 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:39:25.902 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:39:25.902 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.902 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2023-11-04T01:39:25.902 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDIn0VlTfR3ExAAt6S9NmZfuM9CoPfVNGkhmA==", 2023-11-04T01:39:25.902 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.902 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:25.902 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:39:25.903 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:39:25.903 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.903 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2023-11-04T01:39:25.903 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDLn0VlqkLfExAABN3cHR+cDXm0tN4tpWR+0w==", 2023-11-04T01:39:25.903 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.903 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:25.903 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:39:25.903 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:39:25.903 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.904 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2023-11-04T01:39:25.904 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDOn0Vl9JO/EhAAuC0w9vFxOiRs7Tm3UZHVXg==", 2023-11-04T01:39:25.904 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.904 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:25.904 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:39:25.904 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:39:25.904 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.904 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2023-11-04T01:39:25.904 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDRn0VlKSy2EhAAerLDC/nZsTK5KdG+Q1Ycow==", 2023-11-04T01:39:25.904 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.904 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:25.904 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:39:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:39:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2023-11-04T01:39:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDXn0Vl9FINGxAA5lLkwH709SJ00yfxB6MCaw==", 2023-11-04T01:39:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:39:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:39:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2023-11-04T01:39:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDan0Vlo5v3GRAA/ZGOqGFMxQuGirRMadC+9Q==", 2023-11-04T01:39:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:39:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:39:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2023-11-04T01:39:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDdn0Vl+q9GGBAA7obGN4GMa7glnpuDSQKV2g==", 2023-11-04T01:39:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:39:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:39:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2023-11-04T01:39:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDgn0VlbLVCFxAANjcDDYPfWCNGQF1twWc35w==", 2023-11-04T01:39:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2023-11-04T01:39:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:39:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2023-11-04T01:39:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlmqcrLRAAFCsu/sJUUh45gPboIgq6Dw==", 2023-11-04T01:39:25.908 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.908 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:39:25.908 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow r", 2023-11-04T01:39:25.908 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:39:25.908 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.908 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2023-11-04T01:39:25.908 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlSFWINBAAAvkXSoHilQ3GXBE61Tvx2w==", 2023-11-04T01:39:25.908 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.908 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:39:25.908 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:39:25.908 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:39:25.908 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:39:25.908 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.909 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2023-11-04T01:39:25.909 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0Vlcp71MBAAkYQz0CUf7LY9WIvX0mXzKg==", 2023-11-04T01:39:25.909 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.909 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:39:25.909 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:39:25.909 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:39:25.909 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:39:25.909 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.909 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2023-11-04T01:39:25.909 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0Vl08lCOhAAQxQts3txc7gsu8txLGzouA==", 2023-11-04T01:39:25.910 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.910 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2023-11-04T01:39:25.910 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2023-11-04T01:39:25.910 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2023-11-04T01:39:25.910 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2023-11-04T01:39:25.910 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.910 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2023-11-04T01:39:25.910 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDDn0VlgZZFMBAA94xTIAij5lx9yGEyPDd/SQ==", 2023-11-04T01:39:25.910 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.910 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2023-11-04T01:39:25.910 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2023-11-04T01:39:25.911 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2023-11-04T01:39:25.911 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:39:25.911 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.911 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2023-11-04T01:39:25.911 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlSeFMDxAAwW0lbfxAbIKPgPCkJD1FMg==", 2023-11-04T01:39:25.911 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.911 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2023-11-04T01:39:25.911 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2023-11-04T01:39:25.911 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:39:25.911 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:25.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:25.911 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2023-11-04T01:39:25.912 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDEn0VlX+8eCxAAuBbLfpXHKHIIDc4zo9Insw==", 2023-11-04T01:39:25.912 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2023-11-04T01:39:25.912 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2023-11-04T01:39:25.912 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2023-11-04T01:39:25.912 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2023-11-04T01:39:25.912 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.912 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:25.912 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2023-11-04T01:39:25.912 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:39:25.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.898+0000 7fbd021ce640 1 -- 172.21.15.44:0/13874086 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbce806ae70 msgr2=0x7fbce806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.898+0000 7fbd021ce640 1 --2- 172.21.15.44:0/13874086 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbce806ae70 0x7fbce806d330 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbcec036000 tx=0x7fbcec03c040 comp rx=0 tx=0).stop 2023-11-04T01:39:25.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.898+0000 7fbd021ce640 1 -- 172.21.15.44:0/13874086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc15ae40 msgr2=0x7fbcfc0c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.898+0000 7fbd021ce640 1 --2- 172.21.15.44:0/13874086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc15ae40 0x7fbcfc0c4450 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400c780 tx=0x7fbcf400cc40 comp rx=0 tx=0).stop 2023-11-04T01:39:25.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.898+0000 7fbd021ce640 1 -- 172.21.15.44:0/13874086 shutdown_connections 2023-11-04T01:39:25.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.898+0000 7fbd021ce640 1 --2- 172.21.15.44:0/13874086 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbce806ae70 0x7fbce806d330 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.898+0000 7fbd021ce640 1 --2- 172.21.15.44:0/13874086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc15ae40 0x7fbcfc0c4450 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.898+0000 7fbd021ce640 1 --2- 172.21.15.44:0/13874086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcfc0cd860 0x7fbcfc154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.898+0000 7fbd021ce640 1 --2- 172.21.15.44:0/13874086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcfc0cbc00 0x7fbcfc0c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.898+0000 7fbd021ce640 1 -- 172.21.15.44:0/13874086 >> 172.21.15.44:0/13874086 conn(0x7fbcfc06ea90 msgr2=0x7fbcfc15d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:25.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.899+0000 7fbd021ce640 1 -- 172.21.15.44:0/13874086 shutdown_connections 2023-11-04T01:39:25.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:25.899+0000 7fbd021ce640 1 -- 172.21.15.44:0/13874086 wait complete. 2023-11-04T01:39:25.915 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:26.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.019+0000 7f2eb8f5e640 1 Processor -- start 2023-11-04T01:39:26.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.019+0000 7f2eb8f5e640 1 -- start start 2023-11-04T01:39:26.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.020+0000 7f2eb8f5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2eb40cde60 0x7f2eb415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.020+0000 7f2eb8f5e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2eb415daa0 0x7f2eb4157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.020+0000 7f2eb8f5e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb415e000 con 0x7f2eb40ce240 2023-11-04T01:39:26.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.020+0000 7f2eb8f5e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb415e5c0 con 0x7f2eb415daa0 2023-11-04T01:39:26.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.020+0000 7f2eb8f5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb415e2e0 con 0x7f2eb40cde60 2023-11-04T01:39:26.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.020+0000 7f2eb1d9b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2eb415daa0 0x7f2eb4157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.020+0000 7f2eb259c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2eb40cde60 0x7f2eb415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.020+0000 7f2eb2d9d640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f2eb40ce240 0x7f2eb406b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:42578/0 (socket says 172.21.15.44:42578) 2023-11-04T01:39:26.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.020+0000 7f2eb2d9d640 1 -- 172.21.15.44:0/3206709042 learned_addr learned my addr 172.21.15.44:0/3206709042 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:26.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.020+0000 7f2eb159a640 1 -- 172.21.15.44:0/3206709042 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321240485 0 0) 0x7f2eb415e000 con 0x7f2eb40ce240 2023-11-04T01:39:26.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.020+0000 7f2eb159a640 1 -- 172.21.15.44:0/3206709042 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e9c003520 con 0x7f2eb40ce240 2023-11-04T01:39:26.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.020+0000 7f2eb259c640 1 -- 172.21.15.44:0/3206709042 >> v2:172.21.15.204:3300/0 conn(0x7f2eb415daa0 msgr2=0x7f2eb4157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:26.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.021+0000 7f2eb259c640 1 --2- 172.21.15.44:0/3206709042 >> v2:172.21.15.204:3300/0 conn(0x7f2eb415daa0 0x7f2eb4157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.021+0000 7f2eb259c640 1 -- 172.21.15.44:0/3206709042 >> v1:172.21.15.204:6789/0 conn(0x7f2eb40ce240 legacy=0x7f2eb406b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.021+0000 7f2eb259c640 1 -- 172.21.15.44:0/3206709042 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb40d1120 con 0x7f2eb40cde60 2023-11-04T01:39:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.021+0000 7f2eb1d9b640 1 --2- 172.21.15.44:0/3206709042 >> v2:172.21.15.204:3300/0 conn(0x7f2eb415daa0 0x7f2eb4157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.021+0000 7f2eb259c640 1 --2- 172.21.15.44:0/3206709042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2eb40cde60 0x7f2eb415d560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40097a0 tx=0x7f2ea402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb35dc68ad5e3e93 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.022+0000 7f2eb159a640 1 -- 172.21.15.44:0/3206709042 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea402d040 con 0x7f2eb40cde60 2023-11-04T01:39:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.022+0000 7f2eb159a640 1 -- 172.21.15.44:0/3206709042 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea4031810 con 0x7f2eb40cde60 2023-11-04T01:39:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.022+0000 7f2eb159a640 1 -- 172.21.15.44:0/3206709042 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4031b80 con 0x7f2eb40cde60 2023-11-04T01:39:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.022+0000 7f2eb8f5e640 1 -- 172.21.15.44:0/3206709042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2eb40cde60 msgr2=0x7f2eb415d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.022+0000 7f2eb8f5e640 1 --2- 172.21.15.44:0/3206709042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2eb40cde60 0x7f2eb415d560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40097a0 tx=0x7f2ea402b8b0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.022+0000 7f2eb8f5e640 1 -- 172.21.15.44:0/3206709042 shutdown_connections 2023-11-04T01:39:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.022+0000 7f2eb8f5e640 1 --2- 172.21.15.44:0/3206709042 >> v2:172.21.15.204:3300/0 conn(0x7f2eb415daa0 0x7f2eb4157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.022+0000 7f2eb8f5e640 1 --2- 172.21.15.44:0/3206709042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2eb40cde60 0x7f2eb415d560 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.022+0000 7f2eb8f5e640 1 -- 172.21.15.44:0/3206709042 >> 172.21.15.44:0/3206709042 conn(0x7f2eb4071f30 msgr2=0x7f2eb40cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.022+0000 7f2eb8f5e640 1 -- 172.21.15.44:0/3206709042 shutdown_connections 2023-11-04T01:39:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.022+0000 7f2eb8f5e640 1 -- 172.21.15.44:0/3206709042 wait complete. 2023-11-04T01:39:26.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.023+0000 7f2eb8f5e640 1 Processor -- start 2023-11-04T01:39:26.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.024+0000 7f2eb8f5e640 1 -- start start 2023-11-04T01:39:26.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.024+0000 7f2eb8f5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2eb40cde60 0x7f2eb415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.024+0000 7f2eb8f5e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2eb40ce240 0x7f2eb4158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.024+0000 7f2eb8f5e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2eb415daa0 0x7f2eb40cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.024+0000 7f2eb8f5e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb41590d0 con 0x7f2eb40ce240 2023-11-04T01:39:26.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.024+0000 7f2eb8f5e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40cc870 con 0x7f2eb415daa0 2023-11-04T01:39:26.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.024+0000 7f2eb8f5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40cb290 con 0x7f2eb40cde60 2023-11-04T01:39:26.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.024+0000 7f2eb1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2eb40ce240 0x7f2eb4158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.024+0000 7f2eb1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2eb40ce240 0x7f2eb4158b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60850/0 (socket says 172.21.15.44:60850) 2023-11-04T01:39:26.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.024+0000 7f2eb1d9b640 1 -- 172.21.15.44:0/2909680776 learned_addr learned my addr 172.21.15.44:0/2909680776 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:26.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.025+0000 7f2eb259c640 1 --2- 172.21.15.44:0/2909680776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2eb40cde60 0x7f2eb415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.025+0000 7f2eb2d9d640 1 --2- 172.21.15.44:0/2909680776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2eb415daa0 0x7f2eb40cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.025+0000 7f2eb1d9b640 1 -- 172.21.15.44:0/2909680776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2eb40cde60 msgr2=0x7f2eb415a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.025+0000 7f2eb1d9b640 1 --2- 172.21.15.44:0/2909680776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2eb40cde60 0x7f2eb415a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.025+0000 7f2eb1d9b640 1 -- 172.21.15.44:0/2909680776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2eb415daa0 msgr2=0x7f2eb40cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.025+0000 7f2eb1d9b640 1 --2- 172.21.15.44:0/2909680776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2eb415daa0 0x7f2eb40cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.025+0000 7f2eb1d9b640 1 -- 172.21.15.44:0/2909680776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea8009400 con 0x7f2eb40ce240 2023-11-04T01:39:26.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.025+0000 7f2eb1d9b640 1 --2- 172.21.15.44:0/2909680776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2eb40ce240 0x7f2eb4158b90 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800e960 tx=0x7f2ea800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.025+0000 7f2ea2ffd640 1 -- 172.21.15.44:0/2909680776 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea800ca00 con 0x7f2eb40ce240 2023-11-04T01:39:26.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.025+0000 7f2ea2ffd640 1 -- 172.21.15.44:0/2909680776 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea800cb60 con 0x7f2eb40ce240 2023-11-04T01:39:26.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.025+0000 7f2eb8f5e640 1 -- 172.21.15.44:0/2909680776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea4009400 con 0x7f2eb40ce240 2023-11-04T01:39:26.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.025+0000 7f2ea2ffd640 1 -- 172.21.15.44:0/2909680776 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8013470 con 0x7f2eb40ce240 2023-11-04T01:39:26.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.025+0000 7f2eb8f5e640 1 -- 172.21.15.44:0/2909680776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb40cb850 con 0x7f2eb40ce240 2023-11-04T01:39:26.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.026+0000 7f2eb8f5e640 1 -- 172.21.15.44:0/2909680776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb4074290 con 0x7f2eb40ce240 2023-11-04T01:39:26.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.027+0000 7f2ea2ffd640 1 -- 172.21.15.44:0/2909680776 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ea80135d0 con 0x7f2eb40ce240 2023-11-04T01:39:26.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.027+0000 7f2ea2ffd640 1 --2- 172.21.15.44:0/2909680776 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2e9406aea0 0x7f2e9406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.027+0000 7f2ea2ffd640 1 -- 172.21.15.44:0/2909680776 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f2ea8089aa0 con 0x7f2eb40ce240 2023-11-04T01:39:26.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.027+0000 7f2eb259c640 1 --2- 172.21.15.44:0/2909680776 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2e9406aea0 0x7f2e9406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.028+0000 7f2eb259c640 1 --2- 172.21.15.44:0/2909680776 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2e9406aea0 0x7f2e9406d360 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4036000 tx=0x7f2ea403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.031+0000 7f2ea2ffd640 1 -- 172.21.15.44:0/2909680776 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ea80548c0 con 0x7f2eb40ce240 2023-11-04T01:39:26.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.209+0000 7f2eb8f5e640 1 -- 172.21.15.44:0/2909680776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2eb40c91f0 con 0x7f2eb40ce240 2023-11-04T01:39:26.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.211+0000 7f2ea2ffd640 1 -- 172.21.15.44:0/2909680776 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+18303 (secure 0 0 0) 0x7f2ea8057ee0 con 0x7f2eb40ce240 2023-11-04T01:39:26.213 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:26.213 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":92,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:39:25.524329+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.212+0000 7f2eb8f5e640 1 -- 172.21.15.44:0/2909680776 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2e9406aea0 msgr2=0x7f2e9406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.212+0000 7f2eb8f5e640 1 --2- 172.21.15.44:0/2909680776 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2e9406aea0 0x7f2e9406d360 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4036000 tx=0x7f2ea403c040 comp rx=0 tx=0).stop 2023-11-04T01:39:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.212+0000 7f2eb8f5e640 1 -- 172.21.15.44:0/2909680776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2eb40ce240 msgr2=0x7f2eb4158b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.212+0000 7f2eb8f5e640 1 --2- 172.21.15.44:0/2909680776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2eb40ce240 0x7f2eb4158b90 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800e960 tx=0x7f2ea800ee20 comp rx=0 tx=0).stop 2023-11-04T01:39:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.212+0000 7f2eb8f5e640 1 -- 172.21.15.44:0/2909680776 shutdown_connections 2023-11-04T01:39:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.212+0000 7f2eb8f5e640 1 --2- 172.21.15.44:0/2909680776 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2e9406aea0 0x7f2e9406d360 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.212+0000 7f2eb8f5e640 1 --2- 172.21.15.44:0/2909680776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2eb415daa0 0x7f2eb40cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.212+0000 7f2eb8f5e640 1 --2- 172.21.15.44:0/2909680776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2eb40ce240 0x7f2eb4158b90 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.212+0000 7f2eb8f5e640 1 --2- 172.21.15.44:0/2909680776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2eb40cde60 0x7f2eb415a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.212+0000 7f2eb8f5e640 1 -- 172.21.15.44:0/2909680776 >> 172.21.15.44:0/2909680776 conn(0x7f2eb4071f30 msgr2=0x7f2eb40c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:26.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.213+0000 7f2eb8f5e640 1 -- 172.21.15.44:0/2909680776 shutdown_connections 2023-11-04T01:39:26.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.213+0000 7f2eb8f5e640 1 -- 172.21.15.44:0/2909680776 wait complete. 2023-11-04T01:39:26.225 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:34.917670+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:35.547044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:26.226 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:26.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.334+0000 7f5a9713c640 1 Processor -- start 2023-11-04T01:39:26.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.334+0000 7f5a9713c640 1 -- start start 2023-11-04T01:39:26.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.335+0000 7f5a9713c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a90153e60 0x7f5a9015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.335+0000 7f5a9713c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5a900cd6d0 0x7f5a90161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.335+0000 7f5a9713c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a900cde60 con 0x7f5a900b4880 2023-11-04T01:39:26.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.335+0000 7f5a9713c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a90160f90 con 0x7f5a900cd6d0 2023-11-04T01:39:26.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.335+0000 7f5a9713c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9015e400 con 0x7f5a90153e60 2023-11-04T01:39:26.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.335+0000 7f5a8ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5a900cd6d0 0x7f5a90161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.335+0000 7f5a8ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5a900cd6d0 0x7f5a90161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60862/0 (socket says 172.21.15.44:60862) 2023-11-04T01:39:26.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.335+0000 7f5a8ffff640 1 -- 172.21.15.44:0/904588429 learned_addr learned my addr 172.21.15.44:0/904588429 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:26.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.335+0000 7f5a94ed8640 1 --2- 172.21.15.44:0/904588429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a90153e60 0x7f5a9015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.335+0000 7f5a8ffff640 1 -- 172.21.15.44:0/904588429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a90153e60 msgr2=0x7f5a9015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:26.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.335+0000 7f5a8ffff640 1 --2- 172.21.15.44:0/904588429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a90153e60 0x7f5a9015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.335+0000 7f5a8ffff640 1 -- 172.21.15.44:0/904588429 >> v1:172.21.15.204:6789/0 conn(0x7f5a900b4880 legacy=0x7f5a9006b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:26.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.335+0000 7f5a8ffff640 1 -- 172.21.15.44:0/904588429 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a90161960 con 0x7f5a900cd6d0 2023-11-04T01:39:26.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.336+0000 7f5a8ffff640 1 --2- 172.21.15.44:0/904588429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a900cd6d0 0x7f5a90161420 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f5a84009870 tx=0x7f5a8402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6667a034a1229dd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.336+0000 7f5a8f7fe640 1 -- 172.21.15.44:0/904588429 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a84031640 con 0x7f5a900cd6d0 2023-11-04T01:39:26.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.336+0000 7f5a8f7fe640 1 -- 172.21.15.44:0/904588429 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a840317a0 con 0x7f5a900cd6d0 2023-11-04T01:39:26.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.336+0000 7f5a8f7fe640 1 -- 172.21.15.44:0/904588429 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a84031b30 con 0x7f5a900cd6d0 2023-11-04T01:39:26.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.337+0000 7f5a9713c640 1 -- 172.21.15.44:0/904588429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a900cd6d0 msgr2=0x7f5a90161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.337+0000 7f5a9713c640 1 --2- 172.21.15.44:0/904588429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a900cd6d0 0x7f5a90161420 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f5a84009870 tx=0x7f5a8402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.337+0000 7f5a9713c640 1 -- 172.21.15.44:0/904588429 shutdown_connections 2023-11-04T01:39:26.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.337+0000 7f5a9713c640 1 --2- 172.21.15.44:0/904588429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a900cd6d0 0x7f5a90161420 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.337+0000 7f5a9713c640 1 --2- 172.21.15.44:0/904588429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a90153e60 0x7f5a9015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.337+0000 7f5a9713c640 1 -- 172.21.15.44:0/904588429 >> 172.21.15.44:0/904588429 conn(0x7f5a900cf880 msgr2=0x7f5a900cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:26.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.337+0000 7f5a9713c640 1 -- 172.21.15.44:0/904588429 shutdown_connections 2023-11-04T01:39:26.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.337+0000 7f5a9713c640 1 -- 172.21.15.44:0/904588429 wait complete. 2023-11-04T01:39:26.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.338+0000 7f5a9713c640 1 Processor -- start 2023-11-04T01:39:26.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.338+0000 7f5a9713c640 1 -- start start 2023-11-04T01:39:26.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.339+0000 7f5a9713c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a900b4880 0x7f5a90156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.339+0000 7f5a9713c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a900cd6d0 0x7f5a901533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.339+0000 7f5a9713c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a90153e60 0x7f5a90155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.339+0000 7f5a9713c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a901e7230 con 0x7f5a900b4880 2023-11-04T01:39:26.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.339+0000 7f5a9713c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9015a420 con 0x7f5a900cd6d0 2023-11-04T01:39:26.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.339+0000 7f5a9713c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a901e6900 con 0x7f5a90153e60 2023-11-04T01:39:26.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.339+0000 7f5a94ed8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a900b4880 0x7f5a90156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.339+0000 7f5a94ed8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a900b4880 0x7f5a90156d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60872/0 (socket says 172.21.15.44:60872) 2023-11-04T01:39:26.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.339+0000 7f5a94ed8640 1 -- 172.21.15.44:0/831870945 learned_addr learned my addr 172.21.15.44:0/831870945 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:26.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.339+0000 7f5a94ed8640 1 -- 172.21.15.44:0/831870945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a90153e60 msgr2=0x7f5a90155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.339+0000 7f5a94ed8640 1 --2- 172.21.15.44:0/831870945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a90153e60 0x7f5a90155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.339+0000 7f5a94ed8640 1 -- 172.21.15.44:0/831870945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a900cd6d0 msgr2=0x7f5a901533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.339+0000 7f5a94ed8640 1 --2- 172.21.15.44:0/831870945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a900cd6d0 0x7f5a901533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.339+0000 7f5a94ed8640 1 -- 172.21.15.44:0/831870945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a840094d0 con 0x7f5a900b4880 2023-11-04T01:39:26.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.340+0000 7f5a94ed8640 1 --2- 172.21.15.44:0/831870945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a900b4880 0x7f5a90156d70 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000d5f0 tx=0x7f5a8000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.340+0000 7f5a8d7fa640 1 -- 172.21.15.44:0/831870945 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a800125f0 con 0x7f5a900b4880 2023-11-04T01:39:26.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.340+0000 7f5a8d7fa640 1 -- 172.21.15.44:0/831870945 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a80012750 con 0x7f5a900b4880 2023-11-04T01:39:26.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.340+0000 7f5a9713c640 1 -- 172.21.15.44:0/831870945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a901e6be0 con 0x7f5a900b4880 2023-11-04T01:39:26.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.340+0000 7f5a8d7fa640 1 -- 172.21.15.44:0/831870945 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a80012ae0 con 0x7f5a900b4880 2023-11-04T01:39:26.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.340+0000 7f5a9713c640 1 -- 172.21.15.44:0/831870945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a901564f0 con 0x7f5a900b4880 2023-11-04T01:39:26.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.341+0000 7f5a9713c640 1 -- 172.21.15.44:0/831870945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a90074290 con 0x7f5a900b4880 2023-11-04T01:39:26.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.341+0000 7f5a8d7fa640 1 -- 172.21.15.44:0/831870945 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a80012c40 con 0x7f5a900b4880 2023-11-04T01:39:26.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.342+0000 7f5a8d7fa640 1 --2- 172.21.15.44:0/831870945 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a7c06aea0 0x7f5a7c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.342+0000 7f5a8d7fa640 1 -- 172.21.15.44:0/831870945 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f5a80089c80 con 0x7f5a900b4880 2023-11-04T01:39:26.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.342+0000 7f5a8ffff640 1 --2- 172.21.15.44:0/831870945 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a7c06aea0 0x7f5a7c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.345 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.343+0000 7f5a8ffff640 1 --2- 172.21.15.44:0/831870945 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a7c06aea0 0x7f5a7c06d360 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5a84036000 tx=0x7f5a84030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.347 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.346+0000 7f5a8d7fa640 1 -- 172.21.15.44:0/831870945 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a80054bb0 con 0x7f5a900b4880 2023-11-04T01:39:26.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.526+0000 7f5a9713c640 1 -- 172.21.15.44:0/831870945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a900b83b0 con 0x7f5a900b4880 2023-11-04T01:39:26.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.526+0000 7f5a8d7fa640 1 -- 172.21.15.44:0/831870945 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a800581d0 con 0x7f5a900b4880 2023-11-04T01:39:26.528 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:39:26.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.528+0000 7f5a9713c640 1 -- 172.21.15.44:0/831870945 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a7c06aea0 msgr2=0x7f5a7c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.528+0000 7f5a9713c640 1 --2- 172.21.15.44:0/831870945 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a7c06aea0 0x7f5a7c06d360 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5a84036000 tx=0x7f5a84030000 comp rx=0 tx=0).stop 2023-11-04T01:39:26.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.528+0000 7f5a9713c640 1 -- 172.21.15.44:0/831870945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a900b4880 msgr2=0x7f5a90156d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.528+0000 7f5a9713c640 1 --2- 172.21.15.44:0/831870945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a900b4880 0x7f5a90156d70 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000d5f0 tx=0x7f5a8000dab0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.528+0000 7f5a9713c640 1 -- 172.21.15.44:0/831870945 shutdown_connections 2023-11-04T01:39:26.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.528+0000 7f5a9713c640 1 --2- 172.21.15.44:0/831870945 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a7c06aea0 0x7f5a7c06d360 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.528+0000 7f5a9713c640 1 --2- 172.21.15.44:0/831870945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a90153e60 0x7f5a90155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.528+0000 7f5a9713c640 1 --2- 172.21.15.44:0/831870945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a900cd6d0 0x7f5a901533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.528+0000 7f5a9713c640 1 --2- 172.21.15.44:0/831870945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a900b4880 0x7f5a90156d70 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.528+0000 7f5a9713c640 1 -- 172.21.15.44:0/831870945 >> 172.21.15.44:0/831870945 conn(0x7f5a900cf880 msgr2=0x7f5a900d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:26.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.529+0000 7f5a9713c640 1 -- 172.21.15.44:0/831870945 shutdown_connections 2023-11-04T01:39:26.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.529+0000 7f5a9713c640 1 -- 172.21.15.44:0/831870945 wait complete. 2023-11-04T01:39:26.541 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:39:26.650 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.649+0000 7f93d3426640 1 Processor -- start 2023-11-04T01:39:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.649+0000 7f93d3426640 1 -- start start 2023-11-04T01:39:26.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.650+0000 7f93d3426640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f93cc160430 0x7f93cc0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.650+0000 7f93d3426640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93cc0b2b60 0x7f93cc06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.650+0000 7f93d3426640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93cc0b2fc0 con 0x7f93cc06c1d0 2023-11-04T01:39:26.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.650+0000 7f93d3426640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93cc0cb580 con 0x7f93cc160430 2023-11-04T01:39:26.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.650+0000 7f93d3426640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc06ca40 con 0x7f93cc0b2b60 2023-11-04T01:39:26.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.650+0000 7f93d11c2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f93cc160430 0x7f93cc0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.650+0000 7f93d11c2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f93cc160430 0x7f93cc0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60880/0 (socket says 172.21.15.44:60880) 2023-11-04T01:39:26.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.650+0000 7f93d11c2640 1 -- 172.21.15.44:0/1443760583 learned_addr learned my addr 172.21.15.44:0/1443760583 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:26.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.650+0000 7f93d09c1640 1 --2- 172.21.15.44:0/1443760583 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93cc0b2b60 0x7f93cc06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.650+0000 7f93d11c2640 1 -- 172.21.15.44:0/1443760583 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93cc0b2b60 msgr2=0x7f93cc06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:26.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.650+0000 7f93d11c2640 1 --2- 172.21.15.44:0/1443760583 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93cc0b2b60 0x7f93cc06bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.650+0000 7f93d11c2640 1 -- 172.21.15.44:0/1443760583 >> v1:172.21.15.204:6789/0 conn(0x7f93cc06c1d0 legacy=0x7f93cc160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.650+0000 7f93d11c2640 1 -- 172.21.15.44:0/1443760583 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc06cd20 con 0x7f93cc160430 2023-11-04T01:39:26.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.650+0000 7f93d09c1640 1 --2- 172.21.15.44:0/1443760583 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93cc0b2b60 0x7f93cc06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:26.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.651+0000 7f93d11c2640 1 --2- 172.21.15.44:0/1443760583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93cc160430 0x7f93cc0b2620 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009e50 tx=0x7f93c402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e366e8bf64ff5e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.651+0000 7f93cbfff640 1 -- 172.21.15.44:0/1443760583 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c402cb00 con 0x7f93cc160430 2023-11-04T01:39:26.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.651+0000 7f93cbfff640 1 -- 172.21.15.44:0/1443760583 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c402cc60 con 0x7f93cc160430 2023-11-04T01:39:26.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.651+0000 7f93cbfff640 1 -- 172.21.15.44:0/1443760583 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40343f0 con 0x7f93cc160430 2023-11-04T01:39:26.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.651+0000 7f93d3426640 1 -- 172.21.15.44:0/1443760583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93cc160430 msgr2=0x7f93cc0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.651+0000 7f93d3426640 1 --2- 172.21.15.44:0/1443760583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93cc160430 0x7f93cc0b2620 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009e50 tx=0x7f93c402bf60 comp rx=0 tx=0).stop 2023-11-04T01:39:26.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.652+0000 7f93d3426640 1 -- 172.21.15.44:0/1443760583 shutdown_connections 2023-11-04T01:39:26.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.652+0000 7f93d3426640 1 --2- 172.21.15.44:0/1443760583 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93cc0b2b60 0x7f93cc06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.652+0000 7f93d3426640 1 --2- 172.21.15.44:0/1443760583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93cc160430 0x7f93cc0b2620 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.652+0000 7f93d3426640 1 -- 172.21.15.44:0/1443760583 >> 172.21.15.44:0/1443760583 conn(0x7f93cc06ea20 msgr2=0x7f93cc06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:26.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.652+0000 7f93d3426640 1 -- 172.21.15.44:0/1443760583 shutdown_connections 2023-11-04T01:39:26.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.652+0000 7f93d3426640 1 -- 172.21.15.44:0/1443760583 wait complete. 2023-11-04T01:39:26.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.653+0000 7f93d3426640 1 Processor -- start 2023-11-04T01:39:26.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.653+0000 7f93d3426640 1 -- start start 2023-11-04T01:39:26.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.653+0000 7f93d3426640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93cc06c1d0 0x7f93cc151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d3426640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93cc0b2b60 0x7f93cc0c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d3426640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93cc160430 0x7f93cc15c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d3426640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0b3bb0 con 0x7f93cc160430 2023-11-04T01:39:26.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d3426640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0b3e90 con 0x7f93cc06c1d0 2023-11-04T01:39:26.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d3426640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0b4170 con 0x7f93cc0b2b60 2023-11-04T01:39:26.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d19c3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93cc160430 0x7f93cc15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d19c3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93cc160430 0x7f93cc15c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60892/0 (socket says 172.21.15.44:60892) 2023-11-04T01:39:26.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d19c3640 1 -- 172.21.15.44:0/1529389329 learned_addr learned my addr 172.21.15.44:0/1529389329 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:26.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d11c2640 1 --2- 172.21.15.44:0/1529389329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93cc06c1d0 0x7f93cc151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d09c1640 1 --2- 172.21.15.44:0/1529389329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93cc0b2b60 0x7f93cc0c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d19c3640 1 -- 172.21.15.44:0/1529389329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93cc0b2b60 msgr2=0x7f93cc0c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d19c3640 1 --2- 172.21.15.44:0/1529389329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93cc0b2b60 0x7f93cc0c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d19c3640 1 -- 172.21.15.44:0/1529389329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93cc06c1d0 msgr2=0x7f93cc151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d19c3640 1 --2- 172.21.15.44:0/1529389329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93cc06c1d0 0x7f93cc151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d19c3640 1 -- 172.21.15.44:0/1529389329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c4009b30 con 0x7f93cc160430 2023-11-04T01:39:26.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d09c1640 1 --2- 172.21.15.44:0/1529389329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93cc0b2b60 0x7f93cc0c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:26.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d19c3640 1 --2- 172.21.15.44:0/1529389329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93cc160430 0x7f93cc15c630 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f93bc001eb0 tx=0x7f93bc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93c9ffb640 1 -- 172.21.15.44:0/1529389329 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc0052d0 con 0x7f93cc160430 2023-11-04T01:39:26.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93c9ffb640 1 -- 172.21.15.44:0/1529389329 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93bc005430 con 0x7f93cc160430 2023-11-04T01:39:26.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93c9ffb640 1 -- 172.21.15.44:0/1529389329 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc003810 con 0x7f93cc160430 2023-11-04T01:39:26.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.654+0000 7f93d3426640 1 -- 172.21.15.44:0/1529389329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93cc0b4450 con 0x7f93cc160430 2023-11-04T01:39:26.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.655+0000 7f93d3426640 1 -- 172.21.15.44:0/1529389329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93cc15cb70 con 0x7f93cc160430 2023-11-04T01:39:26.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.655+0000 7f93d3426640 1 -- 172.21.15.44:0/1529389329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93cc0b4640 con 0x7f93cc160430 2023-11-04T01:39:26.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.656+0000 7f93c9ffb640 1 -- 172.21.15.44:0/1529389329 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f93bc003970 con 0x7f93cc160430 2023-11-04T01:39:26.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.656+0000 7f93c9ffb640 1 --2- 172.21.15.44:0/1529389329 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f93b806ae70 0x7f93b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.656+0000 7f93c9ffb640 1 -- 172.21.15.44:0/1529389329 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f93bc088d10 con 0x7f93cc160430 2023-11-04T01:39:26.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.657+0000 7f93d11c2640 1 --2- 172.21.15.44:0/1529389329 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f93b806ae70 0x7f93b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.657+0000 7f93d11c2640 1 --2- 172.21.15.44:0/1529389329 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f93b806ae70 0x7f93b806d330 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f93c4035000 tx=0x7f93c4030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.661+0000 7f93c9ffb640 1 -- 172.21.15.44:0/1529389329 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f93bc053c60 con 0x7f93cc160430 2023-11-04T01:39:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.836+0000 7f93d3426640 1 -- 172.21.15.44:0/1529389329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f93cc0b3cf0 con 0x7f93cc160430 2023-11-04T01:39:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.837+0000 7f93c9ffb640 1 -- 172.21.15.44:0/1529389329 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7f93cc0b3cf0 con 0x7f93cc160430 2023-11-04T01:39:26.839 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:39:26.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.839+0000 7f93d3426640 1 -- 172.21.15.44:0/1529389329 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f93b806ae70 msgr2=0x7f93b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.839+0000 7f93d3426640 1 --2- 172.21.15.44:0/1529389329 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f93b806ae70 0x7f93b806d330 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f93c4035000 tx=0x7f93c4030000 comp rx=0 tx=0).stop 2023-11-04T01:39:26.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.839+0000 7f93d3426640 1 -- 172.21.15.44:0/1529389329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93cc160430 msgr2=0x7f93cc15c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.839+0000 7f93d3426640 1 --2- 172.21.15.44:0/1529389329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93cc160430 0x7f93cc15c630 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f93bc001eb0 tx=0x7f93bc00c890 comp rx=0 tx=0).stop 2023-11-04T01:39:26.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.839+0000 7f93d3426640 1 -- 172.21.15.44:0/1529389329 shutdown_connections 2023-11-04T01:39:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.839+0000 7f93d3426640 1 --2- 172.21.15.44:0/1529389329 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f93b806ae70 0x7f93b806d330 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.839+0000 7f93d3426640 1 --2- 172.21.15.44:0/1529389329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93cc160430 0x7f93cc15c630 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.839+0000 7f93d3426640 1 --2- 172.21.15.44:0/1529389329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93cc0b2b60 0x7f93cc0c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.839+0000 7f93d3426640 1 --2- 172.21.15.44:0/1529389329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93cc06c1d0 0x7f93cc151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.839+0000 7f93d3426640 1 -- 172.21.15.44:0/1529389329 >> 172.21.15.44:0/1529389329 conn(0x7f93cc06ea20 msgr2=0x7f93cc159ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.839+0000 7f93d3426640 1 -- 172.21.15.44:0/1529389329 shutdown_connections 2023-11-04T01:39:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.839+0000 7f93d3426640 1 -- 172.21.15.44:0/1529389329 wait complete. 2023-11-04T01:39:26.851 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:39:26.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.959+0000 7f52862a9640 1 Processor -- start 2023-11-04T01:39:26.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.959+0000 7f52862a9640 1 -- start start 2023-11-04T01:39:26.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.959+0000 7f52862a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5280153e60 0x7f528015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.959+0000 7f52862a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52800cd6d0 0x7f5280161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.959+0000 7f52862a9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52800cde60 con 0x7f52800b4880 2023-11-04T01:39:26.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.959+0000 7f52862a9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5280160f90 con 0x7f5280153e60 2023-11-04T01:39:26.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.959+0000 7f52862a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528015e400 con 0x7f52800cd6d0 2023-11-04T01:39:26.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.960+0000 7f527ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5280153e60 0x7f528015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.960+0000 7f527ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5280153e60 0x7f528015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60900/0 (socket says 172.21.15.44:60900) 2023-11-04T01:39:26.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.960+0000 7f5284846640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f52800b4880 0x7f52800b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33142/0 (socket says 172.21.15.44:33142) 2023-11-04T01:39:26.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.960+0000 7f527ffff640 1 -- 172.21.15.44:0/6909550 learned_addr learned my addr 172.21.15.44:0/6909550 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:26.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.960+0000 7f527f7fe640 1 --2- 172.21.15.44:0/6909550 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52800cd6d0 0x7f5280161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.960+0000 7f527ffff640 1 -- 172.21.15.44:0/6909550 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52800cd6d0 msgr2=0x7f5280161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.960+0000 7f527ffff640 1 --2- 172.21.15.44:0/6909550 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52800cd6d0 0x7f5280161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.960+0000 7f527ffff640 1 -- 172.21.15.44:0/6909550 >> v1:172.21.15.44:6789/0 conn(0x7f52800b4880 legacy=0x7f52800b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.960+0000 7f527effd640 1 -- 172.21.15.44:0/6909550 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390500255 0 0) 0x7f52800cde60 con 0x7f52800b4880 2023-11-04T01:39:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.960+0000 7f527ffff640 1 -- 172.21.15.44:0/6909550 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5280161960 con 0x7f5280153e60 2023-11-04T01:39:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.960+0000 7f527f7fe640 1 --2- 172.21.15.44:0/6909550 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52800cd6d0 0x7f5280161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.961+0000 7f527ffff640 1 --2- 172.21.15.44:0/6909550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5280153e60 0x7f528015dec0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f5270009870 tx=0x7f527002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d24e0efabc4e975 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.961+0000 7f527effd640 1 -- 172.21.15.44:0/6909550 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5270030840 con 0x7f5280153e60 2023-11-04T01:39:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.961+0000 7f527effd640 1 -- 172.21.15.44:0/6909550 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52700309a0 con 0x7f5280153e60 2023-11-04T01:39:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.961+0000 7f527effd640 1 -- 172.21.15.44:0/6909550 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5270030d30 con 0x7f5280153e60 2023-11-04T01:39:26.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.961+0000 7f52862a9640 1 -- 172.21.15.44:0/6909550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5280153e60 msgr2=0x7f528015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.961+0000 7f52862a9640 1 --2- 172.21.15.44:0/6909550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5280153e60 0x7f528015dec0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f5270009870 tx=0x7f527002b980 comp rx=0 tx=0).stop 2023-11-04T01:39:26.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.961+0000 7f52862a9640 1 -- 172.21.15.44:0/6909550 shutdown_connections 2023-11-04T01:39:26.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.961+0000 7f52862a9640 1 --2- 172.21.15.44:0/6909550 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52800cd6d0 0x7f5280161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.961+0000 7f52862a9640 1 --2- 172.21.15.44:0/6909550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5280153e60 0x7f528015dec0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.961+0000 7f52862a9640 1 -- 172.21.15.44:0/6909550 >> 172.21.15.44:0/6909550 conn(0x7f52800cf880 msgr2=0x7f52800cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:26.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.961+0000 7f52862a9640 1 -- 172.21.15.44:0/6909550 shutdown_connections 2023-11-04T01:39:26.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.961+0000 7f52862a9640 1 -- 172.21.15.44:0/6909550 wait complete. 2023-11-04T01:39:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.963+0000 7f52862a9640 1 Processor -- start 2023-11-04T01:39:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.963+0000 7f52862a9640 1 -- start start 2023-11-04T01:39:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.963+0000 7f52862a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52800b4880 0x7f528014fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.963+0000 7f52862a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52800cd6d0 0x7f5280156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.963+0000 7f52862a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5280153e60 0x7f52800d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.963+0000 7f52862a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5280150130 con 0x7f5280153e60 2023-11-04T01:39:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.963+0000 7f52862a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52800cd050 con 0x7f52800b4880 2023-11-04T01:39:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.963+0000 7f52862a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52801557b0 con 0x7f52800cd6d0 2023-11-04T01:39:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f5284846640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5280153e60 0x7f52800d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f5284846640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5280153e60 0x7f52800d2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60910/0 (socket says 172.21.15.44:60910) 2023-11-04T01:39:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f5284846640 1 -- 172.21.15.44:0/872994915 learned_addr learned my addr 172.21.15.44:0/872994915 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f527ffff640 1 --2- 172.21.15.44:0/872994915 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52800b4880 0x7f528014fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f527f7fe640 1 --2- 172.21.15.44:0/872994915 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52800cd6d0 0x7f5280156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f5284846640 1 -- 172.21.15.44:0/872994915 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52800cd6d0 msgr2=0x7f5280156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f5284846640 1 --2- 172.21.15.44:0/872994915 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52800cd6d0 0x7f5280156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f5284846640 1 -- 172.21.15.44:0/872994915 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52800b4880 msgr2=0x7f528014fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f5284846640 1 --2- 172.21.15.44:0/872994915 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52800b4880 0x7f528014fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f5284846640 1 -- 172.21.15.44:0/872994915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52700094d0 con 0x7f5280153e60 2023-11-04T01:39:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f527f7fe640 1 --2- 172.21.15.44:0/872994915 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52800cd6d0 0x7f5280156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f5284846640 1 --2- 172.21.15.44:0/872994915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5280153e60 0x7f52800d2de0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f527800c810 tx=0x7f527800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f527cff9640 1 -- 172.21.15.44:0/872994915 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527800a640 con 0x7f5280153e60 2023-11-04T01:39:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f527cff9640 1 -- 172.21.15.44:0/872994915 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527800a7c0 con 0x7f5280153e60 2023-11-04T01:39:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f52862a9640 1 -- 172.21.15.44:0/872994915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5280155a20 con 0x7f5280153e60 2023-11-04T01:39:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f527cff9640 1 -- 172.21.15.44:0/872994915 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527800ab70 con 0x7f5280153e60 2023-11-04T01:39:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.964+0000 7f52862a9640 1 -- 172.21.15.44:0/872994915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52800c8830 con 0x7f5280153e60 2023-11-04T01:39:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.965+0000 7f52862a9640 1 -- 172.21.15.44:0/872994915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5280156220 con 0x7f5280153e60 2023-11-04T01:39:26.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.966+0000 7f527cff9640 1 -- 172.21.15.44:0/872994915 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f527800acd0 con 0x7f5280153e60 2023-11-04T01:39:26.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.966+0000 7f527cff9640 1 --2- 172.21.15.44:0/872994915 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f526c06ae70 0x7f526c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.966+0000 7f527cff9640 1 -- 172.21.15.44:0/872994915 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f5278089030 con 0x7f5280153e60 2023-11-04T01:39:26.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.966+0000 7f527ffff640 1 --2- 172.21.15.44:0/872994915 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f526c06ae70 0x7f526c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.967+0000 7f527ffff640 1 --2- 172.21.15.44:0/872994915 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f526c06ae70 0x7f526c06d330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5270036000 tx=0x7f527003b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:26.971+0000 7f527cff9640 1 -- 172.21.15.44:0/872994915 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5280156220 con 0x7f5280153e60 2023-11-04T01:39:27.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.146+0000 7f52862a9640 1 -- 172.21.15.44:0/872994915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f5280156220 con 0x7f5280153e60 2023-11-04T01:39:27.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.146+0000 7f527cff9640 1 -- 172.21.15.44:0/872994915 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5280156220 con 0x7f5280153e60 2023-11-04T01:39:27.148 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:39:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.148+0000 7f52862a9640 1 -- 172.21.15.44:0/872994915 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f526c06ae70 msgr2=0x7f526c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.148+0000 7f52862a9640 1 --2- 172.21.15.44:0/872994915 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f526c06ae70 0x7f526c06d330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5270036000 tx=0x7f527003b040 comp rx=0 tx=0).stop 2023-11-04T01:39:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.148+0000 7f52862a9640 1 -- 172.21.15.44:0/872994915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5280153e60 msgr2=0x7f52800d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.148+0000 7f52862a9640 1 --2- 172.21.15.44:0/872994915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5280153e60 0x7f52800d2de0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f527800c810 tx=0x7f527800ccd0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.148+0000 7f52862a9640 1 -- 172.21.15.44:0/872994915 shutdown_connections 2023-11-04T01:39:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.148+0000 7f52862a9640 1 --2- 172.21.15.44:0/872994915 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f526c06ae70 0x7f526c06d330 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.148+0000 7f52862a9640 1 --2- 172.21.15.44:0/872994915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5280153e60 0x7f52800d2de0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.148+0000 7f52862a9640 1 --2- 172.21.15.44:0/872994915 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52800cd6d0 0x7f5280156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.148+0000 7f52862a9640 1 --2- 172.21.15.44:0/872994915 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52800b4880 0x7f528014fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.148+0000 7f52862a9640 1 -- 172.21.15.44:0/872994915 >> 172.21.15.44:0/872994915 conn(0x7f52800cf880 msgr2=0x7f528015e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.149+0000 7f52862a9640 1 -- 172.21.15.44:0/872994915 shutdown_connections 2023-11-04T01:39:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.149+0000 7f52862a9640 1 -- 172.21.15.44:0/872994915 wait complete. 2023-11-04T01:39:27.161 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:39:27.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.269+0000 7f36794af640 1 Processor -- start 2023-11-04T01:39:27.272 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.269+0000 7f36794af640 1 -- start start 2023-11-04T01:39:27.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.270+0000 7f36794af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f367415cfd0 0x7f367406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.270+0000 7f36794af640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f36740cd570 0x7f36740cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.270+0000 7f36794af640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36740cdf20 con 0x7f36740cf180 2023-11-04T01:39:27.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.270+0000 7f36794af640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367415d3b0 con 0x7f36740cd570 2023-11-04T01:39:27.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.270+0000 7f36794af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36740cea20 con 0x7f367415cfd0 2023-11-04T01:39:27.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.270+0000 7f36737fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f36740cd570 0x7f36740cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.270+0000 7f36727fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f36740cf180 0x7f3674161440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33158/0 (socket says 172.21.15.44:33158) 2023-11-04T01:39:27.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.270+0000 7f36727fc640 1 -- 172.21.15.44:0/282352844 learned_addr learned my addr 172.21.15.44:0/282352844 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:27.273 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.270+0000 7f36737fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f36740cd570 0x7f36740cd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60916/0 (socket says 172.21.15.44:60916) 2023-11-04T01:39:27.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.270+0000 7f3672ffd640 1 --2- 172.21.15.44:0/282352844 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f367415cfd0 0x7f367406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.271+0000 7f36737fe640 1 -- 172.21.15.44:0/282352844 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f367415cfd0 msgr2=0x7f367406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.271+0000 7f36737fe640 1 --2- 172.21.15.44:0/282352844 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f367415cfd0 0x7f367406c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.271+0000 7f36737fe640 1 -- 172.21.15.44:0/282352844 >> v1:172.21.15.44:6789/0 conn(0x7f36740cf180 legacy=0x7f3674161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.274 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.271+0000 7f36737fe640 1 -- 172.21.15.44:0/282352844 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36740cf610 con 0x7f36740cd570 2023-11-04T01:39:27.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.271+0000 7f36737fe640 1 --2- 172.21.15.44:0/282352844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36740cd570 0x7f36740cd9e0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f3664009d90 tx=0x7f366402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc596dc4d51c696 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.272+0000 7f3671ffb640 1 -- 172.21.15.44:0/282352844 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366402cbc0 con 0x7f36740cd570 2023-11-04T01:39:27.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.272+0000 7f3671ffb640 1 -- 172.21.15.44:0/282352844 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366402cd20 con 0x7f36740cd570 2023-11-04T01:39:27.275 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.272+0000 7f3671ffb640 1 -- 172.21.15.44:0/282352844 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664034660 con 0x7f36740cd570 2023-11-04T01:39:27.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.272+0000 7f36794af640 1 -- 172.21.15.44:0/282352844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36740cd570 msgr2=0x7f36740cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.272+0000 7f36794af640 1 --2- 172.21.15.44:0/282352844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36740cd570 0x7f36740cd9e0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f3664009d90 tx=0x7f366402be10 comp rx=0 tx=0).stop 2023-11-04T01:39:27.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.272+0000 7f36794af640 1 -- 172.21.15.44:0/282352844 shutdown_connections 2023-11-04T01:39:27.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.272+0000 7f36794af640 1 --2- 172.21.15.44:0/282352844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36740cd570 0x7f36740cd9e0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.272+0000 7f36794af640 1 --2- 172.21.15.44:0/282352844 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f367415cfd0 0x7f367406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.272+0000 7f36794af640 1 -- 172.21.15.44:0/282352844 >> 172.21.15.44:0/282352844 conn(0x7f367406ea20 msgr2=0x7f367406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.272+0000 7f36794af640 1 -- 172.21.15.44:0/282352844 shutdown_connections 2023-11-04T01:39:27.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.272+0000 7f36794af640 1 -- 172.21.15.44:0/282352844 wait complete. 2023-11-04T01:39:27.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.273+0000 7f36794af640 1 Processor -- start 2023-11-04T01:39:27.276 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.274+0000 7f36794af640 1 -- start start 2023-11-04T01:39:27.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.274+0000 7f36794af640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36740cd570 0x7f36741f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.274+0000 7f36794af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367415cfd0 0x7f36740b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.274+0000 7f36794af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36740c46d0 0x7f367415f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.274+0000 7f36794af640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36740c5770 con 0x7f367415cfd0 2023-11-04T01:39:27.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.274+0000 7f36794af640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36740c4b60 con 0x7f36740cd570 2023-11-04T01:39:27.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.274+0000 7f36794af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36740c4e40 con 0x7f36740c46d0 2023-11-04T01:39:27.278 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.274+0000 7f36727fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367415cfd0 0x7f36740b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.274+0000 7f36727fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367415cfd0 0x7f36740b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60932/0 (socket says 172.21.15.44:60932) 2023-11-04T01:39:27.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.274+0000 7f36727fc640 1 -- 172.21.15.44:0/3952303578 learned_addr learned my addr 172.21.15.44:0/3952303578 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:27.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.275+0000 7f36737fe640 1 --2- 172.21.15.44:0/3952303578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36740c46d0 0x7f367415f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.275+0000 7f3672ffd640 1 --2- 172.21.15.44:0/3952303578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36740cd570 0x7f36741f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.275+0000 7f36727fc640 1 -- 172.21.15.44:0/3952303578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36740c46d0 msgr2=0x7f367415f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.275+0000 7f36727fc640 1 --2- 172.21.15.44:0/3952303578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36740c46d0 0x7f367415f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.275+0000 7f36727fc640 1 -- 172.21.15.44:0/3952303578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36740cd570 msgr2=0x7f36741f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.275+0000 7f36727fc640 1 --2- 172.21.15.44:0/3952303578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36740cd570 0x7f36741f2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.275+0000 7f36727fc640 1 -- 172.21.15.44:0/3952303578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3664009a70 con 0x7f367415cfd0 2023-11-04T01:39:27.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.275+0000 7f36727fc640 1 --2- 172.21.15.44:0/3952303578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367415cfd0 0x7f36740b54e0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f365c00c480 tx=0x7f365c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.279 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.275+0000 7f366b7fe640 1 -- 172.21.15.44:0/3952303578 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c005ce0 con 0x7f367415cfd0 2023-11-04T01:39:27.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.275+0000 7f366b7fe640 1 -- 172.21.15.44:0/3952303578 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c005e40 con 0x7f367415cfd0 2023-11-04T01:39:27.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.275+0000 7f366b7fe640 1 -- 172.21.15.44:0/3952303578 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c0072f0 con 0x7f367415cfd0 2023-11-04T01:39:27.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.275+0000 7f36794af640 1 -- 172.21.15.44:0/3952303578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36740c5120 con 0x7f367415cfd0 2023-11-04T01:39:27.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.275+0000 7f36794af640 1 -- 172.21.15.44:0/3952303578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36740b5a20 con 0x7f367415cfd0 2023-11-04T01:39:27.280 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.276+0000 7f36794af640 1 -- 172.21.15.44:0/3952303578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36740b5ca0 con 0x7f367415cfd0 2023-11-04T01:39:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.277+0000 7f366b7fe640 1 -- 172.21.15.44:0/3952303578 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f365c007510 con 0x7f367415cfd0 2023-11-04T01:39:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.277+0000 7f366b7fe640 1 --2- 172.21.15.44:0/3952303578 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f365406ae70 0x7f365406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.277+0000 7f366b7fe640 1 -- 172.21.15.44:0/3952303578 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f365c088ae0 con 0x7f367415cfd0 2023-11-04T01:39:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.277+0000 7f3672ffd640 1 --2- 172.21.15.44:0/3952303578 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f365406ae70 0x7f365406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.278+0000 7f3672ffd640 1 --2- 172.21.15.44:0/3952303578 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f365406ae70 0x7f365406d330 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f366c006fd0 tx=0x7f366c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.281+0000 7f366b7fe640 1 -- 172.21.15.44:0/3952303578 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f365c053ac0 con 0x7f367415cfd0 2023-11-04T01:39:27.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.456+0000 7f36794af640 1 -- 172.21.15.44:0/3952303578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f36740cdf20 con 0x7f367415cfd0 2023-11-04T01:39:27.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.456+0000 7f366b7fe640 1 -- 172.21.15.44:0/3952303578 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7f36740cdf20 con 0x7f367415cfd0 2023-11-04T01:39:27.458 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:39:27.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.458+0000 7f36794af640 1 -- 172.21.15.44:0/3952303578 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f365406ae70 msgr2=0x7f365406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.458+0000 7f36794af640 1 --2- 172.21.15.44:0/3952303578 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f365406ae70 0x7f365406d330 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f366c006fd0 tx=0x7f366c008040 comp rx=0 tx=0).stop 2023-11-04T01:39:27.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.458+0000 7f36794af640 1 -- 172.21.15.44:0/3952303578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367415cfd0 msgr2=0x7f36740b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.458+0000 7f36794af640 1 --2- 172.21.15.44:0/3952303578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367415cfd0 0x7f36740b54e0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f365c00c480 tx=0x7f365c00c940 comp rx=0 tx=0).stop 2023-11-04T01:39:27.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.458+0000 7f36794af640 1 -- 172.21.15.44:0/3952303578 shutdown_connections 2023-11-04T01:39:27.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.458+0000 7f36794af640 1 --2- 172.21.15.44:0/3952303578 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f365406ae70 0x7f365406d330 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.458+0000 7f36794af640 1 --2- 172.21.15.44:0/3952303578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36740c46d0 0x7f367415f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.458+0000 7f36794af640 1 --2- 172.21.15.44:0/3952303578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367415cfd0 0x7f36740b54e0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.458+0000 7f36794af640 1 --2- 172.21.15.44:0/3952303578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36740cd570 0x7f36741f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.458+0000 7f36794af640 1 -- 172.21.15.44:0/3952303578 >> 172.21.15.44:0/3952303578 conn(0x7f367406ea20 msgr2=0x7f367406c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.458+0000 7f36794af640 1 -- 172.21.15.44:0/3952303578 shutdown_connections 2023-11-04T01:39:27.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.458+0000 7f36794af640 1 -- 172.21.15.44:0/3952303578 wait complete. 2023-11-04T01:39:27.471 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:39:27.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.576+0000 7f8f1810f640 1 Processor -- start 2023-11-04T01:39:27.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.576+0000 7f8f1810f640 1 -- start start 2023-11-04T01:39:27.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f1810f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8f1015ce70 0x7f8f1006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f1810f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f100cb5c0 0x7f8f100ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f1810f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1006a120 con 0x7f8f1015d250 2023-11-04T01:39:27.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f1810f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f100cdc10 con 0x7f8f1015ce70 2023-11-04T01:39:27.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f1810f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1006def0 con 0x7f8f100cb5c0 2023-11-04T01:39:27.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f156aa640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8f1015d250 0x7f8f100c9830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33174/0 (socket says 172.21.15.44:33174) 2023-11-04T01:39:27.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f156aa640 1 -- 172.21.15.44:0/2290523864 learned_addr learned my addr 172.21.15.44:0/2290523864 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:27.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f15eab640 1 --2- 172.21.15.44:0/2290523864 >> v2:172.21.15.204:3300/0 conn(0x7f8f1015ce70 0x7f8f1006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f166ac640 1 --2- 172.21.15.44:0/2290523864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f100cb5c0 0x7f8f100ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f14ea9640 1 -- 172.21.15.44:0/2290523864 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459426773 0 0) 0x7f8f1006a120 con 0x7f8f1015d250 2023-11-04T01:39:27.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f14ea9640 1 -- 172.21.15.44:0/2290523864 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8efc003520 con 0x7f8f1015d250 2023-11-04T01:39:27.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f14ea9640 1 -- 172.21.15.44:0/2290523864 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3175476451 0 0) 0x7f8efc003520 con 0x7f8f1015d250 2023-11-04T01:39:27.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f14ea9640 1 -- 172.21.15.44:0/2290523864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f100cb5c0 msgr2=0x7f8f100ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f14ea9640 1 --2- 172.21.15.44:0/2290523864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f100cb5c0 0x7f8f100ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f14ea9640 1 -- 172.21.15.44:0/2290523864 >> v2:172.21.15.204:3300/0 conn(0x7f8f1015ce70 msgr2=0x7f8f1006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f14ea9640 1 --2- 172.21.15.44:0/2290523864 >> v2:172.21.15.204:3300/0 conn(0x7f8f1015ce70 0x7f8f1006d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f14ea9640 1 -- 172.21.15.44:0/2290523864 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f100c9f40 con 0x7f8f1015d250 2023-11-04T01:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.577+0000 7f8f14ea9640 1 -- 172.21.15.44:0/2290523864 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f8f00001670 con 0x7f8f1015d250 2023-11-04T01:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f14ea9640 1 -- 172.21.15.44:0/2290523864 >> v1:172.21.15.44:6789/0 conn(0x7f8f1015d250 legacy=0x7f8f100c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f14ea9640 1 --2- 172.21.15.44:0/2290523864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8efc003970 0x7f8efc003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f14ea9640 1 --2- 172.21.15.44:0/2290523864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8efc0047c0 0x7f8efc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f14ea9640 1 --2- 172.21.15.44:0/2290523864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f100cb5c0 0x7f8efc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f14ea9640 1 -- 172.21.15.44:0/2290523864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f100cdc10 con 0x7f8efc0047c0 2023-11-04T01:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f14ea9640 1 -- 172.21.15.44:0/2290523864 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1006def0 con 0x7f8efc003970 2023-11-04T01:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f14ea9640 1 -- 172.21.15.44:0/2290523864 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc00b980 con 0x7f8f100cb5c0 2023-11-04T01:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f156aa640 1 --2- 172.21.15.44:0/2290523864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8efc0047c0 0x7f8efc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f15eab640 1 --2- 172.21.15.44:0/2290523864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8efc003970 0x7f8efc003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f166ac640 1 --2- 172.21.15.44:0/2290523864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f100cb5c0 0x7f8efc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f156aa640 1 -- 172.21.15.44:0/2290523864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f100cb5c0 msgr2=0x7f8efc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f156aa640 1 --2- 172.21.15.44:0/2290523864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f100cb5c0 0x7f8efc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f156aa640 1 -- 172.21.15.44:0/2290523864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8efc003970 msgr2=0x7f8efc003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f156aa640 1 --2- 172.21.15.44:0/2290523864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8efc003970 0x7f8efc003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f156aa640 1 -- 172.21.15.44:0/2290523864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc003520 con 0x7f8efc0047c0 2023-11-04T01:39:27.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.578+0000 7f8f15eab640 1 --2- 172.21.15.44:0/2290523864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8efc003970 0x7f8efc003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:27.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.579+0000 7f8f156aa640 1 --2- 172.21.15.44:0/2290523864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8efc0047c0 0x7f8efc004c40 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000c210 tx=0x7f8efc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d093ebfbfc9d9f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.579+0000 7f8f14ea9640 1 -- 172.21.15.44:0/2290523864 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00005ad0 con 0x7f8efc0047c0 2023-11-04T01:39:27.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.579+0000 7f8f14ea9640 1 -- 172.21.15.44:0/2290523864 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f00005c30 con 0x7f8efc0047c0 2023-11-04T01:39:27.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.579+0000 7f8f14ea9640 1 -- 172.21.15.44:0/2290523864 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0002c8c0 con 0x7f8efc0047c0 2023-11-04T01:39:27.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.579+0000 7f8f1810f640 1 -- 172.21.15.44:0/2290523864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8efc0047c0 msgr2=0x7f8efc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.579+0000 7f8f1810f640 1 --2- 172.21.15.44:0/2290523864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8efc0047c0 0x7f8efc004c40 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000c210 tx=0x7f8efc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.579+0000 7f8f166ac640 1 -- 172.21.15.44:0/2290523864 reap_dead start 2023-11-04T01:39:27.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.579+0000 7f8f1810f640 1 -- 172.21.15.44:0/2290523864 shutdown_connections 2023-11-04T01:39:27.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.579+0000 7f8f1810f640 1 -- 172.21.15.44:0/2290523864 >> 172.21.15.44:0/2290523864 conn(0x7f8f100b0cd0 msgr2=0x7f8f100b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.579+0000 7f8f1810f640 1 -- 172.21.15.44:0/2290523864 shutdown_connections 2023-11-04T01:39:27.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.580+0000 7f8f1810f640 1 -- 172.21.15.44:0/2290523864 wait complete. 2023-11-04T01:39:27.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.581+0000 7f8f1810f640 1 Processor -- start 2023-11-04T01:39:27.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.581+0000 7f8f1810f640 1 -- start start 2023-11-04T01:39:27.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.581+0000 7f8f1810f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8efc0047c0 0x7f8f100c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.581+0000 7f8f1810f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f10151950 0x7f8f100c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.581+0000 7f8f1810f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f101f6180 0x7f8f101f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.581+0000 7f8f1810f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f101f6b40 con 0x7f8f101f6180 2023-11-04T01:39:27.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.581+0000 7f8f1810f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f101e5780 con 0x7f8f10151950 2023-11-04T01:39:27.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.581+0000 7f8f1810f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f101e5a60 con 0x7f8efc0047c0 2023-11-04T01:39:27.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f166ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f101f6180 0x7f8f101f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f166ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f101f6180 0x7f8f101f6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60948/0 (socket says 172.21.15.44:60948) 2023-11-04T01:39:27.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f166ac640 1 -- 172.21.15.44:0/1448816947 learned_addr learned my addr 172.21.15.44:0/1448816947 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:27.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f15eab640 1 --2- 172.21.15.44:0/1448816947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8efc0047c0 0x7f8f100c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f156aa640 1 --2- 172.21.15.44:0/1448816947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f10151950 0x7f8f100c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f166ac640 1 -- 172.21.15.44:0/1448816947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8efc0047c0 msgr2=0x7f8f100c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f166ac640 1 --2- 172.21.15.44:0/1448816947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8efc0047c0 0x7f8f100c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f166ac640 1 -- 172.21.15.44:0/1448816947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f10151950 msgr2=0x7f8f100c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f166ac640 1 --2- 172.21.15.44:0/1448816947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f10151950 0x7f8f100c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f166ac640 1 -- 172.21.15.44:0/1448816947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f101e5d40 con 0x7f8f101f6180 2023-11-04T01:39:27.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f166ac640 1 --2- 172.21.15.44:0/1448816947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f101f6180 0x7f8f101f6600 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f8f100c97c0 tx=0x7f8f080115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f067fc640 1 -- 172.21.15.44:0/1448816947 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0800e070 con 0x7f8f101f6180 2023-11-04T01:39:27.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f067fc640 1 -- 172.21.15.44:0/1448816947 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f08011e10 con 0x7f8f101f6180 2023-11-04T01:39:27.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f1810f640 1 -- 172.21.15.44:0/1448816947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f101e6020 con 0x7f8f101f6180 2023-11-04T01:39:27.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f067fc640 1 -- 172.21.15.44:0/1448816947 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08003990 con 0x7f8f101f6180 2023-11-04T01:39:27.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.582+0000 7f8f1810f640 1 -- 172.21.15.44:0/1448816947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f100c67f0 con 0x7f8f101f6180 2023-11-04T01:39:27.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.583+0000 7f8f1810f640 1 -- 172.21.15.44:0/1448816947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f10074290 con 0x7f8f101f6180 2023-11-04T01:39:27.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.584+0000 7f8f067fc640 1 -- 172.21.15.44:0/1448816947 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8f08003af0 con 0x7f8f101f6180 2023-11-04T01:39:27.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.584+0000 7f8f067fc640 1 --2- 172.21.15.44:0/1448816947 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8ef406aea0 0x7f8ef406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.584+0000 7f8f067fc640 1 -- 172.21.15.44:0/1448816947 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f8f08089c40 con 0x7f8f101f6180 2023-11-04T01:39:27.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.584+0000 7f8f15eab640 1 --2- 172.21.15.44:0/1448816947 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8ef406aea0 0x7f8ef406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.585+0000 7f8f15eab640 1 --2- 172.21.15.44:0/1448816947 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8ef406aea0 0x7f8ef406d360 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c006f80 tx=0x7f8f0c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.588+0000 7f8f067fc640 1 -- 172.21.15.44:0/1448816947 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f08054b90 con 0x7f8f101f6180 2023-11-04T01:39:27.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.766+0000 7f8f1810f640 1 -- 172.21.15.44:0/1448816947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8f100b10b0 con 0x7f8f101f6180 2023-11-04T01:39:27.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.766+0000 7f8f067fc640 1 -- 172.21.15.44:0/1448816947 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v92) v1 ==== 84+0+287 (secure 0 0 0) 0x7f8f080581b0 con 0x7f8f101f6180 2023-11-04T01:39:27.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:27.769 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2023-11-04T01:39:27.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:27.769 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2023-11-04T01:39:27.769 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2023-11-04T01:39:27.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:27.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:27.769 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 7, 2023-11-04T01:39:27.769 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": "snap-test-pool" 2023-11-04T01:39:27.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:27.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:27.770 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 12, 2023-11-04T01:39:27.770 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": "test_data_pool" 2023-11-04T01:39:27.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:27.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2023-11-04T01:39:27.770 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 13, 2023-11-04T01:39:27.770 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": "test_metadata_pool" 2023-11-04T01:39:27.770 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:27.770 INFO:teuthology.orchestra.run.smithi044.stdout:] 2023-11-04T01:39:27.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.768+0000 7f8f1810f640 1 -- 172.21.15.44:0/1448816947 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8ef406aea0 msgr2=0x7f8ef406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.768+0000 7f8f1810f640 1 --2- 172.21.15.44:0/1448816947 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8ef406aea0 0x7f8ef406d360 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c006f80 tx=0x7f8f0c008040 comp rx=0 tx=0).stop 2023-11-04T01:39:27.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.768+0000 7f8f1810f640 1 -- 172.21.15.44:0/1448816947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f101f6180 msgr2=0x7f8f101f6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.768+0000 7f8f1810f640 1 --2- 172.21.15.44:0/1448816947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f101f6180 0x7f8f101f6600 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f8f100c97c0 tx=0x7f8f080115a0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.768+0000 7f8f1810f640 1 -- 172.21.15.44:0/1448816947 shutdown_connections 2023-11-04T01:39:27.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.768+0000 7f8f1810f640 1 --2- 172.21.15.44:0/1448816947 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8ef406aea0 0x7f8ef406d360 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.768+0000 7f8f1810f640 1 --2- 172.21.15.44:0/1448816947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f101f6180 0x7f8f101f6600 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.768+0000 7f8f1810f640 1 --2- 172.21.15.44:0/1448816947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f10151950 0x7f8f100c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.768+0000 7f8f1810f640 1 --2- 172.21.15.44:0/1448816947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8efc0047c0 0x7f8f100c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.768+0000 7f8f1810f640 1 -- 172.21.15.44:0/1448816947 >> 172.21.15.44:0/1448816947 conn(0x7f8f100b0cd0 msgr2=0x7f8f1015c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.768+0000 7f8f1810f640 1 -- 172.21.15.44:0/1448816947 shutdown_connections 2023-11-04T01:39:27.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.768+0000 7f8f1810f640 1 -- 172.21.15.44:0/1448816947 wait complete. 2023-11-04T01:39:27.781 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:39:27.781 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:39:27.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.889+0000 7fba6cfa9640 1 Processor -- start 2023-11-04T01:39:27.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.889+0000 7fba6cfa9640 1 -- start start 2023-11-04T01:39:27.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.889+0000 7fba6cfa9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba6815e420 0x7fba680ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.890+0000 7fba6cfa9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba680c5890 con 0x7fba680adc70 2023-11-04T01:39:27.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.890+0000 7fba6cfa9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba680cd8e0 con 0x7fba68159be0 2023-11-04T01:39:27.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.890+0000 7fba6cfa9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba680ae100 con 0x7fba6815e420 2023-11-04T01:39:27.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.890+0000 7fba66d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fba680adc70 0x7fba680c3840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33176/0 (socket says 172.21.15.44:33176) 2023-11-04T01:39:27.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.890+0000 7fba66d9d640 1 -- 172.21.15.44:0/55768552 learned_addr learned my addr 172.21.15.44:0/55768552 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:27.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.890+0000 7fba5dd9b640 1 --2- 172.21.15.44:0/55768552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba6815e420 0x7fba680ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.890+0000 7fba65d9b640 1 -- 172.21.15.44:0/55768552 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942241786 0 0) 0x7fba680c5890 con 0x7fba680adc70 2023-11-04T01:39:27.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.890+0000 7fba65d9b640 1 -- 172.21.15.44:0/55768552 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba54003520 con 0x7fba680adc70 2023-11-04T01:39:27.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.890+0000 7fba65d9b640 1 -- 172.21.15.44:0/55768552 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668307310 0 0) 0x7fba680cd8e0 con 0x7fba68159be0 2023-11-04T01:39:27.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.890+0000 7fba65d9b640 1 -- 172.21.15.44:0/55768552 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba680c5890 con 0x7fba68159be0 2023-11-04T01:39:27.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.890+0000 7fba65d9b640 1 -- 172.21.15.44:0/55768552 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3966830544 0 0) 0x7fba54003520 con 0x7fba680adc70 2023-11-04T01:39:27.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.890+0000 7fba5dd9b640 1 -- 172.21.15.44:0/55768552 >> v1:172.21.15.204:6789/0 conn(0x7fba68159be0 legacy=0x7fba680c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.890+0000 7fba5dd9b640 1 -- 172.21.15.44:0/55768552 >> v1:172.21.15.44:6789/0 conn(0x7fba680adc70 legacy=0x7fba680c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.890+0000 7fba5dd9b640 1 -- 172.21.15.44:0/55768552 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba680cdbc0 con 0x7fba6815e420 2023-11-04T01:39:27.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.891+0000 7fba5dd9b640 1 --2- 172.21.15.44:0/55768552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba6815e420 0x7fba680ad730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba500097d0 tx=0x7fba5002b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3db46b4da910b124 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.891+0000 7fba65d9b640 1 -- 172.21.15.44:0/55768552 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600019f0 con 0x7fba6815e420 2023-11-04T01:39:27.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.891+0000 7fba65d9b640 1 -- 172.21.15.44:0/55768552 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5002e050 con 0x7fba6815e420 2023-11-04T01:39:27.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.891+0000 7fba65d9b640 1 -- 172.21.15.44:0/55768552 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50030710 con 0x7fba6815e420 2023-11-04T01:39:27.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.892+0000 7fba6cfa9640 1 -- 172.21.15.44:0/55768552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba6815e420 msgr2=0x7fba680ad730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.892+0000 7fba6cfa9640 1 --2- 172.21.15.44:0/55768552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba6815e420 0x7fba680ad730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba500097d0 tx=0x7fba5002b770 comp rx=0 tx=0).stop 2023-11-04T01:39:27.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.892+0000 7fba6cfa9640 1 -- 172.21.15.44:0/55768552 shutdown_connections 2023-11-04T01:39:27.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.892+0000 7fba6cfa9640 1 --2- 172.21.15.44:0/55768552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba6815e420 0x7fba680ad730 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.892+0000 7fba6cfa9640 1 -- 172.21.15.44:0/55768552 >> 172.21.15.44:0/55768552 conn(0x7fba680b05d0 msgr2=0x7fba680b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.892+0000 7fba6cfa9640 1 -- 172.21.15.44:0/55768552 shutdown_connections 2023-11-04T01:39:27.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.892+0000 7fba6cfa9640 1 -- 172.21.15.44:0/55768552 wait complete. 2023-11-04T01:39:27.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.893+0000 7fba6cfa9640 1 Processor -- start 2023-11-04T01:39:27.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.893+0000 7fba6cfa9640 1 -- start start 2023-11-04T01:39:27.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.894+0000 7fba6cfa9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba680adc70 0x7fba680ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.894+0000 7fba6cfa9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba68159be0 0x7fba681f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.894+0000 7fba6cfa9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba6815e420 0x7fba68159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.894+0000 7fba6cfa9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba68157540 con 0x7fba68159be0 2023-11-04T01:39:27.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.894+0000 7fba6cfa9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba681f68d0 con 0x7fba680adc70 2023-11-04T01:39:27.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.894+0000 7fba6cfa9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba680abeb0 con 0x7fba6815e420 2023-11-04T01:39:27.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.894+0000 7fba5dd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba68159be0 0x7fba681f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.894+0000 7fba5dd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba68159be0 0x7fba681f6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60958/0 (socket says 172.21.15.44:60958) 2023-11-04T01:39:27.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.894+0000 7fba5dd9b640 1 -- 172.21.15.44:0/401393656 learned_addr learned my addr 172.21.15.44:0/401393656 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:27.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.895+0000 7fba66d9d640 1 --2- 172.21.15.44:0/401393656 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba6815e420 0x7fba68159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.895+0000 7fba6659c640 1 --2- 172.21.15.44:0/401393656 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba680adc70 0x7fba680ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.895+0000 7fba5dd9b640 1 -- 172.21.15.44:0/401393656 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba6815e420 msgr2=0x7fba68159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.895+0000 7fba5dd9b640 1 --2- 172.21.15.44:0/401393656 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba6815e420 0x7fba68159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.895+0000 7fba5dd9b640 1 -- 172.21.15.44:0/401393656 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba680adc70 msgr2=0x7fba680ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.895+0000 7fba5dd9b640 1 --2- 172.21.15.44:0/401393656 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba680adc70 0x7fba680ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.895+0000 7fba5dd9b640 1 -- 172.21.15.44:0/401393656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba50009400 con 0x7fba68159be0 2023-11-04T01:39:27.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.895+0000 7fba66d9d640 1 --2- 172.21.15.44:0/401393656 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba6815e420 0x7fba68159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:27.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.895+0000 7fba5dd9b640 1 --2- 172.21.15.44:0/401393656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba68159be0 0x7fba681f6390 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fba5002b7b0 tx=0x7fba500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.895+0000 7fba5f7fe640 1 -- 172.21.15.44:0/401393656 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50006e10 con 0x7fba68159be0 2023-11-04T01:39:27.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.895+0000 7fba5f7fe640 1 -- 172.21.15.44:0/401393656 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5003c620 con 0x7fba68159be0 2023-11-04T01:39:27.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.895+0000 7fba5f7fe640 1 -- 172.21.15.44:0/401393656 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5003c9f0 con 0x7fba68159be0 2023-11-04T01:39:27.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.895+0000 7fba6cfa9640 1 -- 172.21.15.44:0/401393656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba680ac190 con 0x7fba68159be0 2023-11-04T01:39:27.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.895+0000 7fba6cfa9640 1 -- 172.21.15.44:0/401393656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba681571d0 con 0x7fba68159be0 2023-11-04T01:39:27.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.896+0000 7fba6cfa9640 1 -- 172.21.15.44:0/401393656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba68157360 con 0x7fba68159be0 2023-11-04T01:39:27.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.897+0000 7fba5f7fe640 1 -- 172.21.15.44:0/401393656 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba50039070 con 0x7fba68159be0 2023-11-04T01:39:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.897+0000 7fba5f7fe640 1 --2- 172.21.15.44:0/401393656 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fba4806ae70 0x7fba4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.897+0000 7fba5f7fe640 1 -- 172.21.15.44:0/401393656 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6240+0+0 (secure 0 0 0) 0x7fba500aadf0 con 0x7fba68159be0 2023-11-04T01:39:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.897+0000 7fba6659c640 1 --2- 172.21.15.44:0/401393656 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fba4806ae70 0x7fba4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.898+0000 7fba6659c640 1 --2- 172.21.15.44:0/401393656 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fba4806ae70 0x7fba4806d330 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fba58001650 tx=0x7fba58009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:27.901+0000 7fba5f7fe640 1 -- 172.21.15.44:0/401393656 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fba50075d20 con 0x7fba68159be0 2023-11-04T01:39:28.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.078+0000 7fba6cfa9640 1 -- 172.21.15.44:0/401393656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fba681576f0 con 0x7fba68159be0 2023-11-04T01:39:28.419 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:28.421 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:28.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.518+0000 7fba5f7fe640 1 -- 172.21.15.44:0/401393656 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v93) v1 ==== 138+0+0 (secure 0 0 0) 0x7fba681576f0 con 0x7fba68159be0 2023-11-04T01:39:28.521 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2023-11-04T01:39:28.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.521+0000 7fba6cfa9640 1 -- 172.21.15.44:0/401393656 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fba4806ae70 msgr2=0x7fba4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:28.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.521+0000 7fba6cfa9640 1 --2- 172.21.15.44:0/401393656 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fba4806ae70 0x7fba4806d330 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fba58001650 tx=0x7fba58009040 comp rx=0 tx=0).stop 2023-11-04T01:39:28.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.521+0000 7fba6cfa9640 1 -- 172.21.15.44:0/401393656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba68159be0 msgr2=0x7fba681f6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:28.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.521+0000 7fba6cfa9640 1 --2- 172.21.15.44:0/401393656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba68159be0 0x7fba681f6390 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fba5002b7b0 tx=0x7fba500046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:28.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.521+0000 7fba6cfa9640 1 -- 172.21.15.44:0/401393656 shutdown_connections 2023-11-04T01:39:28.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.521+0000 7fba6cfa9640 1 --2- 172.21.15.44:0/401393656 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fba4806ae70 0x7fba4806d330 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:28.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.521+0000 7fba6cfa9640 1 --2- 172.21.15.44:0/401393656 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba6815e420 0x7fba68159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:28.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.521+0000 7fba6cfa9640 1 --2- 172.21.15.44:0/401393656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba68159be0 0x7fba681f6390 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:28.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.521+0000 7fba6cfa9640 1 --2- 172.21.15.44:0/401393656 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba680adc70 0x7fba680ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:28.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.521+0000 7fba6cfa9640 1 -- 172.21.15.44:0/401393656 >> 172.21.15.44:0/401393656 conn(0x7fba680b05d0 msgr2=0x7fba680c4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:28.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.521+0000 7fba6cfa9640 1 -- 172.21.15.44:0/401393656 shutdown_connections 2023-11-04T01:39:28.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.521+0000 7fba6cfa9640 1 -- 172.21.15.44:0/401393656 wait complete. 2023-11-04T01:39:28.539 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:39:28.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.651+0000 7fc75784f640 1 Processor -- start 2023-11-04T01:39:28.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.651+0000 7fc75784f640 1 -- start start 2023-11-04T01:39:28.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.652+0000 7fc75784f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7500b2d30 0x7fc75006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:28.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.652+0000 7fc75784f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc75006c1d0 0x7fc7500cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:28.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.652+0000 7fc75784f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75006ca40 con 0x7fc750160430 2023-11-04T01:39:28.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.652+0000 7fc75784f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7500cb580 con 0x7fc75006c1d0 2023-11-04T01:39:28.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.652+0000 7fc75784f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75006cd20 con 0x7fc7500b2d30 2023-11-04T01:39:28.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.652+0000 7fc7555eb640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc750160430 0x7fc7500b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33186/0 (socket says 172.21.15.44:33186) 2023-11-04T01:39:28.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.652+0000 7fc7555eb640 1 -- 172.21.15.44:0/3332682742 learned_addr learned my addr 172.21.15.44:0/3332682742 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:28.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.652+0000 7fc755dec640 1 --2- 172.21.15.44:0/3332682742 >> v2:172.21.15.204:3300/0 conn(0x7fc75006c1d0 0x7fc7500cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:28.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.652+0000 7fc754dea640 1 --2- 172.21.15.44:0/3332682742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7500b2d30 0x7fc75006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:28.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.653+0000 7fc74ffff640 1 -- 172.21.15.44:0/3332682742 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299510312 0 0) 0x7fc75006ca40 con 0x7fc750160430 2023-11-04T01:39:28.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.653+0000 7fc74ffff640 1 -- 172.21.15.44:0/3332682742 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc738003520 con 0x7fc750160430 2023-11-04T01:39:28.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.653+0000 7fc754dea640 1 -- 172.21.15.44:0/3332682742 >> v2:172.21.15.204:3300/0 conn(0x7fc75006c1d0 msgr2=0x7fc7500cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:28.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.653+0000 7fc754dea640 1 --2- 172.21.15.44:0/3332682742 >> v2:172.21.15.204:3300/0 conn(0x7fc75006c1d0 0x7fc7500cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:28.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.653+0000 7fc754dea640 1 -- 172.21.15.44:0/3332682742 >> v1:172.21.15.44:6789/0 conn(0x7fc750160430 legacy=0x7fc7500b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:28.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.653+0000 7fc74ffff640 1 -- 172.21.15.44:0/3332682742 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2006299658 0 0) 0x7fc738003520 con 0x7fc750160430 2023-11-04T01:39:28.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.653+0000 7fc754dea640 1 -- 172.21.15.44:0/3332682742 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75006d000 con 0x7fc7500b2d30 2023-11-04T01:39:28.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.654+0000 7fc754dea640 1 --2- 172.21.15.44:0/3332682742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7500b2d30 0x7fc75006bc90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc7440097a0 tx=0x7fc74402b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5506cb920e23ec04 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:28.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.654+0000 7fc74ffff640 1 -- 172.21.15.44:0/3332682742 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748001670 con 0x7fc7500b2d30 2023-11-04T01:39:28.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.654+0000 7fc74ffff640 1 -- 172.21.15.44:0/3332682742 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74402e050 con 0x7fc7500b2d30 2023-11-04T01:39:28.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.654+0000 7fc74ffff640 1 -- 172.21.15.44:0/3332682742 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744030730 con 0x7fc7500b2d30 2023-11-04T01:39:28.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.654+0000 7fc75784f640 1 -- 172.21.15.44:0/3332682742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7500b2d30 msgr2=0x7fc75006bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:28.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.654+0000 7fc75784f640 1 --2- 172.21.15.44:0/3332682742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7500b2d30 0x7fc75006bc90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc7440097a0 tx=0x7fc74402b790 comp rx=0 tx=0).stop 2023-11-04T01:39:28.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.654+0000 7fc75784f640 1 -- 172.21.15.44:0/3332682742 shutdown_connections 2023-11-04T01:39:28.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.654+0000 7fc75784f640 1 --2- 172.21.15.44:0/3332682742 >> v2:172.21.15.204:3300/0 conn(0x7fc75006c1d0 0x7fc7500cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:28.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.654+0000 7fc75784f640 1 --2- 172.21.15.44:0/3332682742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7500b2d30 0x7fc75006bc90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:28.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.654+0000 7fc75784f640 1 -- 172.21.15.44:0/3332682742 >> 172.21.15.44:0/3332682742 conn(0x7fc75006ea20 msgr2=0x7fc75006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:28.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.655+0000 7fc75784f640 1 -- 172.21.15.44:0/3332682742 shutdown_connections 2023-11-04T01:39:28.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.655+0000 7fc75784f640 1 -- 172.21.15.44:0/3332682742 wait complete. 2023-11-04T01:39:28.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.656+0000 7fc75784f640 1 Processor -- start 2023-11-04T01:39:28.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.656+0000 7fc75784f640 1 -- start start 2023-11-04T01:39:28.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.656+0000 7fc75784f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc75006c1d0 0x7fc750151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:28.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.656+0000 7fc75784f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7500b2d30 0x7fc75015b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:28.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.656+0000 7fc75784f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc750160430 0x7fc7500cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.656+0000 7fc75784f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc750152730 con 0x7fc75006c1d0 2023-11-04T01:39:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.656+0000 7fc75784f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500c9bf0 con 0x7fc750160430 2023-11-04T01:39:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.656+0000 7fc75784f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500c9e70 con 0x7fc7500b2d30 2023-11-04T01:39:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc7555eb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc75006c1d0 0x7fc750151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc7555eb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc75006c1d0 0x7fc750151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60964/0 (socket says 172.21.15.44:60964) 2023-11-04T01:39:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc7555eb640 1 -- 172.21.15.44:0/1521829239 learned_addr learned my addr 172.21.15.44:0/1521829239 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc754dea640 1 --2- 172.21.15.44:0/1521829239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7500b2d30 0x7fc75015b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc755dec640 1 --2- 172.21.15.44:0/1521829239 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc750160430 0x7fc7500cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc7555eb640 1 -- 172.21.15.44:0/1521829239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7500b2d30 msgr2=0x7fc75015b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc7555eb640 1 --2- 172.21.15.44:0/1521829239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7500b2d30 0x7fc75015b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc7555eb640 1 -- 172.21.15.44:0/1521829239 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc750160430 msgr2=0x7fc7500cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:28.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc7555eb640 1 --2- 172.21.15.44:0/1521829239 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc750160430 0x7fc7500cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc7555eb640 1 -- 172.21.15.44:0/1521829239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744009400 con 0x7fc75006c1d0 2023-11-04T01:39:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc755dec640 1 --2- 172.21.15.44:0/1521829239 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc750160430 0x7fc7500cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc7555eb640 1 --2- 172.21.15.44:0/1521829239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc75006c1d0 0x7fc750151e40 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c750 tx=0x7fc74800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc74dffb640 1 -- 172.21.15.44:0/1521829239 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748005ad0 con 0x7fc75006c1d0 2023-11-04T01:39:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc74dffb640 1 -- 172.21.15.44:0/1521829239 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc748005c50 con 0x7fc75006c1d0 2023-11-04T01:39:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc75784f640 1 -- 172.21.15.44:0/1521829239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7500ca150 con 0x7fc75006c1d0 2023-11-04T01:39:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc74dffb640 1 -- 172.21.15.44:0/1521829239 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748007070 con 0x7fc75006c1d0 2023-11-04T01:39:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.657+0000 7fc75784f640 1 -- 172.21.15.44:0/1521829239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7500ca710 con 0x7fc75006c1d0 2023-11-04T01:39:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.659+0000 7fc75784f640 1 -- 172.21.15.44:0/1521829239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc750074290 con 0x7fc75006c1d0 2023-11-04T01:39:28.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.659+0000 7fc74dffb640 1 -- 172.21.15.44:0/1521829239 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7480071d0 con 0x7fc75006c1d0 2023-11-04T01:39:28.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.660+0000 7fc74dffb640 1 --2- 172.21.15.44:0/1521829239 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc73c06ae70 0x7fc73c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:28.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.660+0000 7fc74dffb640 1 -- 172.21.15.44:0/1521829239 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6610+0+0 (secure 0 0 0) 0x7fc748089680 con 0x7fc75006c1d0 2023-11-04T01:39:28.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.660+0000 7fc754dea640 1 --2- 172.21.15.44:0/1521829239 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc73c06ae70 0x7fc73c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:28.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.661+0000 7fc754dea640 1 --2- 172.21.15.44:0/1521829239 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc73c06ae70 0x7fc73c06d330 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc744034000 tx=0x7fc74402f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:28.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.664+0000 7fc74dffb640 1 -- 172.21.15.44:0/1521829239 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc748054320 con 0x7fc75006c1d0 2023-11-04T01:39:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:28.840+0000 7fc75784f640 1 -- 172.21.15.44:0/1521829239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc75015da00 con 0x7fc75006c1d0 2023-11-04T01:39:29.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.522+0000 7fc74dffb640 1 -- 172.21.15.44:0/1521829239 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v94) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc748057940 con 0x7fc75006c1d0 2023-11-04T01:39:29.524 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2023-11-04T01:39:29.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.527+0000 7fc75784f640 1 -- 172.21.15.44:0/1521829239 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc73c06ae70 msgr2=0x7fc73c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:29.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.527+0000 7fc75784f640 1 --2- 172.21.15.44:0/1521829239 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc73c06ae70 0x7fc73c06d330 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc744034000 tx=0x7fc74402f000 comp rx=0 tx=0).stop 2023-11-04T01:39:29.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.527+0000 7fc75784f640 1 -- 172.21.15.44:0/1521829239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc75006c1d0 msgr2=0x7fc750151e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:29.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.527+0000 7fc75784f640 1 --2- 172.21.15.44:0/1521829239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc75006c1d0 0x7fc750151e40 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c750 tx=0x7fc74800cc10 comp rx=0 tx=0).stop 2023-11-04T01:39:29.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.528+0000 7fc75784f640 1 -- 172.21.15.44:0/1521829239 shutdown_connections 2023-11-04T01:39:29.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.528+0000 7fc75784f640 1 --2- 172.21.15.44:0/1521829239 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc73c06ae70 0x7fc73c06d330 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:29.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.528+0000 7fc75784f640 1 --2- 172.21.15.44:0/1521829239 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc750160430 0x7fc7500cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:29.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.528+0000 7fc75784f640 1 --2- 172.21.15.44:0/1521829239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7500b2d30 0x7fc75015b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:29.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.528+0000 7fc75784f640 1 --2- 172.21.15.44:0/1521829239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc75006c1d0 0x7fc750151e40 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:29.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.528+0000 7fc75784f640 1 -- 172.21.15.44:0/1521829239 >> 172.21.15.44:0/1521829239 conn(0x7fc75006ea20 msgr2=0x7fc7500b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:29.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.531+0000 7fc75784f640 1 -- 172.21.15.44:0/1521829239 shutdown_connections 2023-11-04T01:39:29.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.539+0000 7fc75784f640 1 -- 172.21.15.44:0/1521829239 wait complete. 2023-11-04T01:39:29.559 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:39:29.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.669+0000 7fa43186f640 1 Processor -- start 2023-11-04T01:39:29.672 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.669+0000 7fa43186f640 1 -- start start 2023-11-04T01:39:29.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.670+0000 7fa43186f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa42c15af20 0x7fa42c0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:29.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.670+0000 7fa43186f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa42c0cd3b0 0x7fa42c0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:29.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.670+0000 7fa43186f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c0cdd40 con 0x7fa42c0b64c0 2023-11-04T01:39:29.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.670+0000 7fa43186f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0cc380 con 0x7fa42c0cd3b0 2023-11-04T01:39:29.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.670+0000 7fa43186f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0d01f0 con 0x7fa42c15af20 2023-11-04T01:39:29.673 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.670+0000 7fa42b7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa42c0cd3b0 0x7fa42c0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:29.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.670+0000 7fa42b7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa42c0cd3b0 0x7fa42c0cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60966/0 (socket says 172.21.15.44:60966) 2023-11-04T01:39:29.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.670+0000 7fa42b7fe640 1 -- 172.21.15.44:0/4156380460 learned_addr learned my addr 172.21.15.44:0/4156380460 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:29.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.671+0000 7fa42affd640 1 --2- 172.21.15.44:0/4156380460 >> v2:172.21.15.204:3300/0 conn(0x7fa42c15af20 0x7fa42c0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:29.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.671+0000 7fa42b7fe640 1 -- 172.21.15.44:0/4156380460 >> v2:172.21.15.204:3300/0 conn(0x7fa42c15af20 msgr2=0x7fa42c0b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:29.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.671+0000 7fa42b7fe640 1 --2- 172.21.15.44:0/4156380460 >> v2:172.21.15.204:3300/0 conn(0x7fa42c15af20 0x7fa42c0b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:29.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.671+0000 7fa42b7fe640 1 -- 172.21.15.44:0/4156380460 >> v1:172.21.15.204:6789/0 conn(0x7fa42c0b64c0 legacy=0x7fa42c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:29.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.671+0000 7fa42b7fe640 1 -- 172.21.15.44:0/4156380460 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c0b6a40 con 0x7fa42c0cd3b0 2023-11-04T01:39:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.671+0000 7fa42b7fe640 1 --2- 172.21.15.44:0/4156380460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa42c0cd3b0 0x7fa42c0cd800 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0b3760 tx=0x7fa41c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c960435f7850b728 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.672+0000 7fa429ffb640 1 -- 172.21.15.44:0/4156380460 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c02cb20 con 0x7fa42c0cd3b0 2023-11-04T01:39:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.672+0000 7fa429ffb640 1 -- 172.21.15.44:0/4156380460 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c02cc80 con 0x7fa42c0cd3b0 2023-11-04T01:39:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.672+0000 7fa429ffb640 1 -- 172.21.15.44:0/4156380460 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c0343f0 con 0x7fa42c0cd3b0 2023-11-04T01:39:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.672+0000 7fa43186f640 1 -- 172.21.15.44:0/4156380460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa42c0cd3b0 msgr2=0x7fa42c0cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.672+0000 7fa43186f640 1 --2- 172.21.15.44:0/4156380460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa42c0cd3b0 0x7fa42c0cd800 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0b3760 tx=0x7fa41c02bf80 comp rx=0 tx=0).stop 2023-11-04T01:39:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.672+0000 7fa43186f640 1 -- 172.21.15.44:0/4156380460 shutdown_connections 2023-11-04T01:39:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.672+0000 7fa43186f640 1 --2- 172.21.15.44:0/4156380460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa42c0cd3b0 0x7fa42c0cd800 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.672+0000 7fa43186f640 1 --2- 172.21.15.44:0/4156380460 >> v2:172.21.15.204:3300/0 conn(0x7fa42c15af20 0x7fa42c0b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.672+0000 7fa43186f640 1 -- 172.21.15.44:0/4156380460 >> 172.21.15.44:0/4156380460 conn(0x7fa42c06ea20 msgr2=0x7fa42c06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.672+0000 7fa43186f640 1 -- 172.21.15.44:0/4156380460 shutdown_connections 2023-11-04T01:39:29.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.672+0000 7fa43186f640 1 -- 172.21.15.44:0/4156380460 wait complete. 2023-11-04T01:39:29.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.673+0000 7fa43186f640 1 Processor -- start 2023-11-04T01:39:29.677 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.674+0000 7fa43186f640 1 -- start start 2023-11-04T01:39:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.674+0000 7fa43186f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa42c0b64c0 0x7fa42c0b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.674+0000 7fa43186f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa42c0cd3b0 0x7fa42c158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.674+0000 7fa43186f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa42c15af20 0x7fa42c1585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.674+0000 7fa43186f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c157220 con 0x7fa42c15af20 2023-11-04T01:39:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.674+0000 7fa43186f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c156610 con 0x7fa42c0cd3b0 2023-11-04T01:39:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.674+0000 7fa43186f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c1568f0 con 0x7fa42c0b64c0 2023-11-04T01:39:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.674+0000 7fa42b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa42c15af20 0x7fa42c1585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.674+0000 7fa42b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa42c15af20 0x7fa42c1585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60976/0 (socket says 172.21.15.44:60976) 2023-11-04T01:39:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.674+0000 7fa42b7fe640 1 -- 172.21.15.44:0/1964763425 learned_addr learned my addr 172.21.15.44:0/1964763425 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.675+0000 7fa42a7fc640 1 --2- 172.21.15.44:0/1964763425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa42c0cd3b0 0x7fa42c158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.675+0000 7fa42affd640 1 --2- 172.21.15.44:0/1964763425 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa42c0b64c0 0x7fa42c0b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.675+0000 7fa42b7fe640 1 -- 172.21.15.44:0/1964763425 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa42c0b64c0 msgr2=0x7fa42c0b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.675+0000 7fa42b7fe640 1 --2- 172.21.15.44:0/1964763425 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa42c0b64c0 0x7fa42c0b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.675+0000 7fa42b7fe640 1 -- 172.21.15.44:0/1964763425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa42c0cd3b0 msgr2=0x7fa42c158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.675+0000 7fa42b7fe640 1 --2- 172.21.15.44:0/1964763425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa42c0cd3b0 0x7fa42c158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.675+0000 7fa42b7fe640 1 -- 172.21.15.44:0/1964763425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c009b30 con 0x7fa42c15af20 2023-11-04T01:39:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.675+0000 7fa42b7fe640 1 --2- 172.21.15.44:0/1964763425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa42c15af20 0x7fa42c1585c0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fa41c036040 tx=0x7fa41c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.675+0000 7fa423fff640 1 -- 172.21.15.44:0/1964763425 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c009510 con 0x7fa42c15af20 2023-11-04T01:39:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.675+0000 7fa423fff640 1 -- 172.21.15.44:0/1964763425 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c02c920 con 0x7fa42c15af20 2023-11-04T01:39:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.675+0000 7fa423fff640 1 -- 172.21.15.44:0/1964763425 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c03e690 con 0x7fa42c15af20 2023-11-04T01:39:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.675+0000 7fa43186f640 1 -- 172.21.15.44:0/1964763425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c156bd0 con 0x7fa42c15af20 2023-11-04T01:39:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.675+0000 7fa43186f640 1 -- 172.21.15.44:0/1964763425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c0b3400 con 0x7fa42c15af20 2023-11-04T01:39:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.676+0000 7fa43186f640 1 -- 172.21.15.44:0/1964763425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c157390 con 0x7fa42c15af20 2023-11-04T01:39:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.677+0000 7fa423fff640 1 -- 172.21.15.44:0/1964763425 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa41c03e7f0 con 0x7fa42c15af20 2023-11-04T01:39:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.677+0000 7fa423fff640 1 --2- 172.21.15.44:0/1964763425 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa40c06aea0 0x7fa40c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.677+0000 7fa423fff640 1 -- 172.21.15.44:0/1964763425 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6992+0+0 (secure 0 0 0) 0x7fa41c0ac450 con 0x7fa42c15af20 2023-11-04T01:39:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.677+0000 7fa42affd640 1 --2- 172.21.15.44:0/1964763425 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa40c06aea0 0x7fa40c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.678+0000 7fa42affd640 1 --2- 172.21.15.44:0/1964763425 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa40c06aea0 0x7fa40c06d360 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0b2d70 tx=0x7fa424009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:29.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.682+0000 7fa423fff640 1 -- 172.21.15.44:0/1964763425 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa41c0770b0 con 0x7fa42c15af20 2023-11-04T01:39:29.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:29.918+0000 7fa43186f640 1 -- 172.21.15.44:0/1964763425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa42c0b60a0 con 0x7fa42c15af20 2023-11-04T01:39:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.550+0000 7fa423fff640 1 -- 172.21.15.44:0/1964763425 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa41c07a6d0 con 0x7fa42c15af20 2023-11-04T01:39:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 16 and data pool 17 2023-11-04T01:39:30.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.553+0000 7fa43186f640 1 -- 172.21.15.44:0/1964763425 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa40c06aea0 msgr2=0x7fa40c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.553+0000 7fa43186f640 1 --2- 172.21.15.44:0/1964763425 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa40c06aea0 0x7fa40c06d360 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0b2d70 tx=0x7fa424009190 comp rx=0 tx=0).stop 2023-11-04T01:39:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.553+0000 7fa43186f640 1 -- 172.21.15.44:0/1964763425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa42c15af20 msgr2=0x7fa42c1585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.553+0000 7fa43186f640 1 --2- 172.21.15.44:0/1964763425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa42c15af20 0x7fa42c1585c0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fa41c036040 tx=0x7fa41c004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.554+0000 7fa43186f640 1 -- 172.21.15.44:0/1964763425 shutdown_connections 2023-11-04T01:39:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.554+0000 7fa43186f640 1 --2- 172.21.15.44:0/1964763425 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa40c06aea0 0x7fa40c06d360 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.554+0000 7fa43186f640 1 --2- 172.21.15.44:0/1964763425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa42c15af20 0x7fa42c1585c0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.554+0000 7fa43186f640 1 --2- 172.21.15.44:0/1964763425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa42c0cd3b0 0x7fa42c158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.554+0000 7fa43186f640 1 --2- 172.21.15.44:0/1964763425 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa42c0b64c0 0x7fa42c0b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.554+0000 7fa43186f640 1 -- 172.21.15.44:0/1964763425 >> 172.21.15.44:0/1964763425 conn(0x7fa42c06ea20 msgr2=0x7fa42c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.554+0000 7fa43186f640 1 -- 172.21.15.44:0/1964763425 shutdown_connections 2023-11-04T01:39:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.554+0000 7fa43186f640 1 -- 172.21.15.44:0/1964763425 wait complete. 2023-11-04T01:39:30.582 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:30.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.695+0000 7f0b22339640 1 Processor -- start 2023-11-04T01:39:30.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.695+0000 7f0b22339640 1 -- start start 2023-11-04T01:39:30.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b22339640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0b1c15bfb0 0x7f0b1c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b22339640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1c0cc450 con 0x7f0b1c0cd860 2023-11-04T01:39:30.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b22339640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1c15f400 con 0x7f0b1c15ae40 2023-11-04T01:39:30.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b22339640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1c15b220 con 0x7f0b1c15bfb0 2023-11-04T01:39:30.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b208d6640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0b1c0cd860 0x7f0b1c0ced70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33192/0 (socket says 172.21.15.44:33192) 2023-11-04T01:39:30.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b208d6640 1 -- 172.21.15.44:0/358135425 learned_addr learned my addr 172.21.15.44:0/358135425 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:30.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1b7fe640 1 --2- 172.21.15.44:0/358135425 >> v2:172.21.15.204:3300/0 conn(0x7f0b1c15bfb0 0x7f0b1c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146384864 0 0) 0x7f0b14001490 con 0x7f0b1c0cd860 2023-11-04T01:39:30.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b04003520 con 0x7f0b1c0cd860 2023-11-04T01:39:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669775824 0 0) 0x7f0b1c15f400 con 0x7f0b1c15ae40 2023-11-04T01:39:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b14001490 con 0x7f0b1c15ae40 2023-11-04T01:39:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1565487613 0 0) 0x7f0b04003520 con 0x7f0b1c0cd860 2023-11-04T01:39:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 >> v2:172.21.15.204:3300/0 conn(0x7f0b1c15bfb0 msgr2=0x7f0b1c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 --2- 172.21.15.44:0/358135425 >> v2:172.21.15.204:3300/0 conn(0x7f0b1c15bfb0 0x7f0b1c0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 >> v1:172.21.15.204:6789/0 conn(0x7f0b1c15ae40 legacy=0x7f0b1c0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c15f890 con 0x7f0b1c0cd860 2023-11-04T01:39:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f0b14001b80 con 0x7f0b1c0cd860 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 >> v1:172.21.15.44:6789/0 conn(0x7f0b1c0cd860 legacy=0x7f0b1c0ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 --2- 172.21.15.44:0/358135425 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b04003b00 0x7f0b04003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 --2- 172.21.15.44:0/358135425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b040047c0 0x7f0b04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 --2- 172.21.15.44:0/358135425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b04005180 0x7f0b0400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c15b220 con 0x7f0b04005180 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.696+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0400c000 con 0x7f0b040047c0 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.697+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0400c1c0 con 0x7f0b04003b00 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.697+0000 7f0b208d6640 1 --2- 172.21.15.44:0/358135425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b04005180 0x7f0b0400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.697+0000 7f0b1bfff640 1 --2- 172.21.15.44:0/358135425 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b04003b00 0x7f0b04003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.697+0000 7f0b1b7fe640 1 --2- 172.21.15.44:0/358135425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b040047c0 0x7f0b04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.697+0000 7f0b208d6640 1 -- 172.21.15.44:0/358135425 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b04003b00 msgr2=0x7f0b04003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.697+0000 7f0b208d6640 1 --2- 172.21.15.44:0/358135425 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b04003b00 0x7f0b04003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.697+0000 7f0b208d6640 1 -- 172.21.15.44:0/358135425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b040047c0 msgr2=0x7f0b04004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.697+0000 7f0b208d6640 1 --2- 172.21.15.44:0/358135425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b040047c0 0x7f0b04004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.697+0000 7f0b208d6640 1 -- 172.21.15.44:0/358135425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b04003520 con 0x7f0b04005180 2023-11-04T01:39:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.697+0000 7f0b1b7fe640 1 --2- 172.21.15.44:0/358135425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b040047c0 0x7f0b04004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.698+0000 7f0b208d6640 1 -- 172.21.15.44:0/358135425 reap_dead start 2023-11-04T01:39:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.698+0000 7f0b208d6640 1 --2- 172.21.15.44:0/358135425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b04005180 0x7f0b0400b980 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400a790 tx=0x7f0b040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d1b3bee99ac352 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.698+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14034630 con 0x7f0b04005180 2023-11-04T01:39:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.698+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1402f070 con 0x7f0b04005180 2023-11-04T01:39:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.698+0000 7f0b1affd640 1 -- 172.21.15.44:0/358135425 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b140349f0 con 0x7f0b04005180 2023-11-04T01:39:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.698+0000 7f0b22339640 1 -- 172.21.15.44:0/358135425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b04005180 msgr2=0x7f0b0400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.698+0000 7f0b22339640 1 --2- 172.21.15.44:0/358135425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b04005180 0x7f0b0400b980 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400a790 tx=0x7f0b040057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.698+0000 7f0b22339640 1 -- 172.21.15.44:0/358135425 shutdown_connections 2023-11-04T01:39:30.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.698+0000 7f0b22339640 1 --2- 172.21.15.44:0/358135425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b04005180 0x7f0b0400b980 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.698+0000 7f0b22339640 1 -- 172.21.15.44:0/358135425 >> 172.21.15.44:0/358135425 conn(0x7f0b1c06ea90 msgr2=0x7f0b1c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:30.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.698+0000 7f0b22339640 1 -- 172.21.15.44:0/358135425 shutdown_connections 2023-11-04T01:39:30.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.698+0000 7f0b22339640 1 -- 172.21.15.44:0/358135425 wait complete. 2023-11-04T01:39:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.700+0000 7f0b22339640 1 Processor -- start 2023-11-04T01:39:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.700+0000 7f0b22339640 1 -- start start 2023-11-04T01:39:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.700+0000 7f0b22339640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b04005180 0x7f0b1c06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.700+0000 7f0b22339640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b1c152ae0 0x7f0b1c0c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.700+0000 7f0b22339640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b1c0c5280 0x7f0b1c0c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.700+0000 7f0b22339640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c06c290 con 0x7f0b1c0c5280 2023-11-04T01:39:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.700+0000 7f0b22339640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c06cbf0 con 0x7f0b04005180 2023-11-04T01:39:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.700+0000 7f0b22339640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c06b610 con 0x7f0b1c152ae0 2023-11-04T01:39:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b208d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b1c0c5280 0x7f0b1c0c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b208d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b1c0c5280 0x7f0b1c0c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60984/0 (socket says 172.21.15.44:60984) 2023-11-04T01:39:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b208d6640 1 -- 172.21.15.44:0/1900354696 learned_addr learned my addr 172.21.15.44:0/1900354696 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b1b7fe640 1 --2- 172.21.15.44:0/1900354696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b1c152ae0 0x7f0b1c0c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b1bfff640 1 --2- 172.21.15.44:0/1900354696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b04005180 0x7f0b1c06c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b208d6640 1 -- 172.21.15.44:0/1900354696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b1c152ae0 msgr2=0x7f0b1c0c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b208d6640 1 --2- 172.21.15.44:0/1900354696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b1c152ae0 0x7f0b1c0c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b208d6640 1 -- 172.21.15.44:0/1900354696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b04005180 msgr2=0x7f0b1c06c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b208d6640 1 --2- 172.21.15.44:0/1900354696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b04005180 0x7f0b1c06c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b208d6640 1 -- 172.21.15.44:0/1900354696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c06b8f0 con 0x7f0b1c0c5280 2023-11-04T01:39:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b208d6640 1 --2- 172.21.15.44:0/1900354696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b1c0c5280 0x7f0b1c0c69e0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400a790 tx=0x7f0b14001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b18ff9640 1 -- 172.21.15.44:0/1900354696 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14034430 con 0x7f0b1c0c5280 2023-11-04T01:39:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b18ff9640 1 -- 172.21.15.44:0/1900354696 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b14034590 con 0x7f0b1c0c5280 2023-11-04T01:39:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b22339640 1 -- 172.21.15.44:0/1900354696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1c06bbd0 con 0x7f0b1c0c5280 2023-11-04T01:39:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b18ff9640 1 -- 172.21.15.44:0/1900354696 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14034900 con 0x7f0b1c0c5280 2023-11-04T01:39:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.701+0000 7f0b22339640 1 -- 172.21.15.44:0/1900354696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1c06b230 con 0x7f0b1c0c5280 2023-11-04T01:39:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.702+0000 7f0b22339640 1 -- 172.21.15.44:0/1900354696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1c0ce2d0 con 0x7f0b1c0c5280 2023-11-04T01:39:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.703+0000 7f0b18ff9640 1 -- 172.21.15.44:0/1900354696 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b14031030 con 0x7f0b1c0c5280 2023-11-04T01:39:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.703+0000 7f0b18ff9640 1 --2- 172.21.15.44:0/1900354696 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0b0806aea0 0x7f0b0806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.703+0000 7f0b18ff9640 1 -- 172.21.15.44:0/1900354696 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f0b140ab5f0 con 0x7f0b1c0c5280 2023-11-04T01:39:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.703+0000 7f0b1bfff640 1 --2- 172.21.15.44:0/1900354696 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0b0806aea0 0x7f0b0806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.704+0000 7f0b1bfff640 1 --2- 172.21.15.44:0/1900354696 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0b0806aea0 0x7f0b0806d360 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0b10000c00 tx=0x7f0b10009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.708+0000 7f0b18ff9640 1 -- 172.21.15.44:0/1900354696 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b140761c0 con 0x7f0b1c0c5280 2023-11-04T01:39:30.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.884+0000 7f0b22339640 1 -- 172.21.15.44:0/1900354696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b1c0ce2d0 con 0x7f0b1c0c5280 2023-11-04T01:39:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.885+0000 7f0b18ff9640 1 -- 172.21.15.44:0/1900354696 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+21974 (secure 0 0 0) 0x7f0b140797e0 con 0x7f0b1c0c5280 2023-11-04T01:39:30.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:30.888 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":95,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:39:29.920286+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:28.109628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:28.871834+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:30.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.887+0000 7f0b22339640 1 -- 172.21.15.44:0/1900354696 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0b0806aea0 msgr2=0x7f0b0806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.887+0000 7f0b22339640 1 --2- 172.21.15.44:0/1900354696 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0b0806aea0 0x7f0b0806d360 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0b10000c00 tx=0x7f0b10009040 comp rx=0 tx=0).stop 2023-11-04T01:39:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.887+0000 7f0b22339640 1 -- 172.21.15.44:0/1900354696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b1c0c5280 msgr2=0x7f0b1c0c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.887+0000 7f0b22339640 1 --2- 172.21.15.44:0/1900354696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b1c0c5280 0x7f0b1c0c69e0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400a790 tx=0x7f0b14001e90 comp rx=0 tx=0).stop 2023-11-04T01:39:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.887+0000 7f0b22339640 1 -- 172.21.15.44:0/1900354696 shutdown_connections 2023-11-04T01:39:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.887+0000 7f0b22339640 1 --2- 172.21.15.44:0/1900354696 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0b0806aea0 0x7f0b0806d360 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.887+0000 7f0b22339640 1 --2- 172.21.15.44:0/1900354696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b1c0c5280 0x7f0b1c0c69e0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.887+0000 7f0b22339640 1 --2- 172.21.15.44:0/1900354696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b1c152ae0 0x7f0b1c0c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.887+0000 7f0b22339640 1 --2- 172.21.15.44:0/1900354696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b04005180 0x7f0b1c06c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.887+0000 7f0b22339640 1 -- 172.21.15.44:0/1900354696 >> 172.21.15.44:0/1900354696 conn(0x7f0b1c06ea90 msgr2=0x7f0b1c0d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.887+0000 7f0b22339640 1 -- 172.21.15.44:0/1900354696 shutdown_connections 2023-11-04T01:39:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:30.887+0000 7f0b22339640 1 -- 172.21.15.44:0/1900354696 wait complete. 2023-11-04T01:39:30.900 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:31.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.005+0000 7f4f6d305640 1 Processor -- start 2023-11-04T01:39:31.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.005+0000 7f4f6d305640 1 -- start start 2023-11-04T01:39:31.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.005+0000 7f4f6d305640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4f6815ad80 0x7f4f680abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.005+0000 7f4f6d305640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6806a1b0 0x7f4f6806b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.005+0000 7f4f6d305640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6806cf60 con 0x7f4f680c9a40 2023-11-04T01:39:31.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.005+0000 7f4f6d305640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f680ac390 con 0x7f4f6815ad80 2023-11-04T01:39:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.005+0000 7f4f6d305640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6815b160 con 0x7f4f6806a1b0 2023-11-04T01:39:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.006+0000 7f4f66ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4f6815ad80 0x7f4f680abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.006+0000 7f4f667fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6806a1b0 0x7f4f6806b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.006+0000 7f4f677fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f4f680c9a40 0x7f4f6806dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:42630/0 (socket says 172.21.15.44:42630) 2023-11-04T01:39:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.006+0000 7f4f677fe640 1 -- 172.21.15.44:0/1073710439 learned_addr learned my addr 172.21.15.44:0/1073710439 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.006+0000 7f4f66ffd640 1 -- 172.21.15.44:0/1073710439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6806a1b0 msgr2=0x7f4f6806b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.006+0000 7f4f66ffd640 1 --2- 172.21.15.44:0/1073710439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6806a1b0 0x7f4f6806b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.006+0000 7f4f66ffd640 1 -- 172.21.15.44:0/1073710439 >> v1:172.21.15.204:6789/0 conn(0x7f4f680c9a40 legacy=0x7f4f6806dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.006+0000 7f4f65ffb640 1 -- 172.21.15.44:0/1073710439 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933971448 0 0) 0x7f4f6806cf60 con 0x7f4f680c9a40 2023-11-04T01:39:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.006+0000 7f4f66ffd640 1 -- 172.21.15.44:0/1073710439 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6806b9b0 con 0x7f4f6815ad80 2023-11-04T01:39:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.006+0000 7f4f667fc640 1 --2- 172.21.15.44:0/1073710439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6806a1b0 0x7f4f6806b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:31.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.007+0000 7f4f66ffd640 1 --2- 172.21.15.44:0/1073710439 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6815ad80 0x7f4f680abe50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009d90 tx=0x7f4f5802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ff2fba4732b033 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.007+0000 7f4f65ffb640 1 -- 172.21.15.44:0/1073710439 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5802cc50 con 0x7f4f6815ad80 2023-11-04T01:39:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.007+0000 7f4f65ffb640 1 -- 172.21.15.44:0/1073710439 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5802cdb0 con 0x7f4f6815ad80 2023-11-04T01:39:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.007+0000 7f4f65ffb640 1 -- 172.21.15.44:0/1073710439 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f58034660 con 0x7f4f6815ad80 2023-11-04T01:39:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.008+0000 7f4f6d305640 1 -- 172.21.15.44:0/1073710439 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6815ad80 msgr2=0x7f4f680abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.008+0000 7f4f6d305640 1 --2- 172.21.15.44:0/1073710439 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6815ad80 0x7f4f680abe50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009d90 tx=0x7f4f5802bea0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.008+0000 7f4f6d305640 1 -- 172.21.15.44:0/1073710439 shutdown_connections 2023-11-04T01:39:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.008+0000 7f4f6d305640 1 --2- 172.21.15.44:0/1073710439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6806a1b0 0x7f4f6806b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.008+0000 7f4f6d305640 1 --2- 172.21.15.44:0/1073710439 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6815ad80 0x7f4f680abe50 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.008+0000 7f4f6d305640 1 -- 172.21.15.44:0/1073710439 >> 172.21.15.44:0/1073710439 conn(0x7f4f680b0cd0 msgr2=0x7f4f680b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.008+0000 7f4f6d305640 1 -- 172.21.15.44:0/1073710439 shutdown_connections 2023-11-04T01:39:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.008+0000 7f4f6d305640 1 -- 172.21.15.44:0/1073710439 wait complete. 2023-11-04T01:39:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.009+0000 7f4f6d305640 1 Processor -- start 2023-11-04T01:39:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.009+0000 7f4f6d305640 1 -- start start 2023-11-04T01:39:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f6d305640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6806a1b0 0x7f4f680c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f6d305640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f680c9a40 0x7f4f6814ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f6d305640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6815ad80 0x7f4f681f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f6d305640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6814c930 con 0x7f4f680c9a40 2023-11-04T01:39:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f6d305640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6814e810 con 0x7f4f6806a1b0 2023-11-04T01:39:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f6d305640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6814c120 con 0x7f4f6815ad80 2023-11-04T01:39:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f667fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f680c9a40 0x7f4f6814ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f667fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f680c9a40 0x7f4f6814ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60992/0 (socket says 172.21.15.44:60992) 2023-11-04T01:39:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f667fc640 1 -- 172.21.15.44:0/1489397872 learned_addr learned my addr 172.21.15.44:0/1489397872 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f677fe640 1 --2- 172.21.15.44:0/1489397872 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6815ad80 0x7f4f681f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f66ffd640 1 --2- 172.21.15.44:0/1489397872 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6806a1b0 0x7f4f680c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f667fc640 1 -- 172.21.15.44:0/1489397872 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6815ad80 msgr2=0x7f4f681f0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f667fc640 1 --2- 172.21.15.44:0/1489397872 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6815ad80 0x7f4f681f0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f667fc640 1 -- 172.21.15.44:0/1489397872 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6806a1b0 msgr2=0x7f4f680c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f667fc640 1 --2- 172.21.15.44:0/1489397872 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6806a1b0 0x7f4f680c3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.010+0000 7f4f667fc640 1 -- 172.21.15.44:0/1489397872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c009400 con 0x7f4f680c9a40 2023-11-04T01:39:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.011+0000 7f4f667fc640 1 --2- 172.21.15.44:0/1489397872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f680c9a40 0x7f4f6814ef40 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00e9b0 tx=0x7f4f5c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.011+0000 7f4f4f7fe640 1 -- 172.21.15.44:0/1489397872 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c00ca00 con 0x7f4f680c9a40 2023-11-04T01:39:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.011+0000 7f4f4f7fe640 1 -- 172.21.15.44:0/1489397872 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c00cb60 con 0x7f4f680c9a40 2023-11-04T01:39:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.011+0000 7f4f6d305640 1 -- 172.21.15.44:0/1489397872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f58009a70 con 0x7f4f680c9a40 2023-11-04T01:39:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.011+0000 7f4f4f7fe640 1 -- 172.21.15.44:0/1489397872 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c013470 con 0x7f4f680c9a40 2023-11-04T01:39:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.011+0000 7f4f6d305640 1 -- 172.21.15.44:0/1489397872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6814f480 con 0x7f4f680c9a40 2023-11-04T01:39:31.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.012+0000 7f4f6d305640 1 -- 172.21.15.44:0/1489397872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f68074290 con 0x7f4f680c9a40 2023-11-04T01:39:31.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.012+0000 7f4f4f7fe640 1 -- 172.21.15.44:0/1489397872 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f5c0135d0 con 0x7f4f680c9a40 2023-11-04T01:39:31.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.013+0000 7f4f4f7fe640 1 --2- 172.21.15.44:0/1489397872 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f5406ae70 0x7f4f5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.013+0000 7f4f4f7fe640 1 -- 172.21.15.44:0/1489397872 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f4f5c089a70 con 0x7f4f680c9a40 2023-11-04T01:39:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.013+0000 7f4f66ffd640 1 --2- 172.21.15.44:0/1489397872 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f5406ae70 0x7f4f5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.014+0000 7f4f66ffd640 1 --2- 172.21.15.44:0/1489397872 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f5406ae70 0x7f4f5406d330 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4f58036000 tx=0x7f4f58030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:31.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.017+0000 7f4f4f7fe640 1 -- 172.21.15.44:0/1489397872 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f5c054640 con 0x7f4f680c9a40 2023-11-04T01:39:31.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.192+0000 7f4f6d305640 1 -- 172.21.15.44:0/1489397872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f681f0640 con 0x7f4f680c9a40 2023-11-04T01:39:31.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.194+0000 7f4f4f7fe640 1 -- 172.21.15.44:0/1489397872 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+21974 (secure 0 0 0) 0x7f4f5c057c60 con 0x7f4f680c9a40 2023-11-04T01:39:31.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:31.196 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":95,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:39:29.920286+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:28.109628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:28.871834+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:31.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.196+0000 7f4f6d305640 1 -- 172.21.15.44:0/1489397872 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f5406ae70 msgr2=0x7f4f5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.196+0000 7f4f6d305640 1 --2- 172.21.15.44:0/1489397872 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f5406ae70 0x7f4f5406d330 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4f58036000 tx=0x7f4f58030000 comp rx=0 tx=0).stop 2023-11-04T01:39:31.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.196+0000 7f4f6d305640 1 -- 172.21.15.44:0/1489397872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f680c9a40 msgr2=0x7f4f6814ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.196+0000 7f4f6d305640 1 --2- 172.21.15.44:0/1489397872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f680c9a40 0x7f4f6814ef40 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00e9b0 tx=0x7f4f5c00ee70 comp rx=0 tx=0).stop 2023-11-04T01:39:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.196+0000 7f4f6d305640 1 -- 172.21.15.44:0/1489397872 shutdown_connections 2023-11-04T01:39:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.196+0000 7f4f6d305640 1 --2- 172.21.15.44:0/1489397872 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f5406ae70 0x7f4f5406d330 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.196+0000 7f4f6d305640 1 --2- 172.21.15.44:0/1489397872 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6815ad80 0x7f4f681f0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.196+0000 7f4f6d305640 1 --2- 172.21.15.44:0/1489397872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f680c9a40 0x7f4f6814ef40 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.196+0000 7f4f6d305640 1 --2- 172.21.15.44:0/1489397872 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6806a1b0 0x7f4f680c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.196+0000 7f4f6d305640 1 -- 172.21.15.44:0/1489397872 >> 172.21.15.44:0/1489397872 conn(0x7f4f680b0cd0 msgr2=0x7f4f680c24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.196+0000 7f4f6d305640 1 -- 172.21.15.44:0/1489397872 shutdown_connections 2023-11-04T01:39:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.196+0000 7f4f6d305640 1 -- 172.21.15.44:0/1489397872 wait complete. 2023-11-04T01:39:31.209 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:39:31.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.316+0000 7f1a54087640 1 Processor -- start 2023-11-04T01:39:31.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.316+0000 7f1a54087640 1 -- start start 2023-11-04T01:39:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.317+0000 7f1a54087640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1a4c153e60 0x7f1a4c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.317+0000 7f1a54087640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a4c0b4880 0x7f1a4c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.317+0000 7f1a54087640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c0cde60 con 0x7f1a4c0cd6d0 2023-11-04T01:39:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.317+0000 7f1a54087640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4c160f90 con 0x7f1a4c153e60 2023-11-04T01:39:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.317+0000 7f1a54087640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c0b5200 con 0x7f1a4c0b4880 2023-11-04T01:39:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.318+0000 7f1a52624640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a4c0b4880 0x7f1a4c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.318+0000 7f1a51e23640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1a4c153e60 0x7f1a4c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.318+0000 7f1a51e23640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1a4c153e60 0x7f1a4c15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:40918/0 (socket says 172.21.15.44:40918) 2023-11-04T01:39:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.318+0000 7f1a51622640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f1a4c0cd6d0 0x7f1a4c161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:42636/0 (socket says 172.21.15.44:42636) 2023-11-04T01:39:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.318+0000 7f1a51e23640 1 -- 172.21.15.44:0/1751713412 learned_addr learned my addr 172.21.15.44:0/1751713412 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.318+0000 7f1a51e23640 1 -- 172.21.15.44:0/1751713412 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a4c0b4880 msgr2=0x7f1a4c0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.318+0000 7f1a51e23640 1 --2- 172.21.15.44:0/1751713412 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a4c0b4880 0x7f1a4c0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.318+0000 7f1a51e23640 1 -- 172.21.15.44:0/1751713412 >> v1:172.21.15.204:6789/0 conn(0x7f1a4c0cd6d0 legacy=0x7f1a4c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.318+0000 7f1a51e23640 1 -- 172.21.15.44:0/1751713412 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c15e400 con 0x7f1a4c153e60 2023-11-04T01:39:31.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.319+0000 7f1a51e23640 1 --2- 172.21.15.44:0/1751713412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a4c153e60 0x7f1a4c15dec0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009e50 tx=0x7f1a3c02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a830d1df9984c2d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:31.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.319+0000 7f1a50e21640 1 -- 172.21.15.44:0/1751713412 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c02cb00 con 0x7f1a4c153e60 2023-11-04T01:39:31.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.319+0000 7f1a50e21640 1 -- 172.21.15.44:0/1751713412 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c02cc60 con 0x7f1a4c153e60 2023-11-04T01:39:31.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.319+0000 7f1a50e21640 1 -- 172.21.15.44:0/1751713412 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0343f0 con 0x7f1a4c153e60 2023-11-04T01:39:31.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.320+0000 7f1a54087640 1 -- 172.21.15.44:0/1751713412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a4c153e60 msgr2=0x7f1a4c15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.320+0000 7f1a54087640 1 --2- 172.21.15.44:0/1751713412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a4c153e60 0x7f1a4c15dec0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009e50 tx=0x7f1a3c02bf60 comp rx=0 tx=0).stop 2023-11-04T01:39:31.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.320+0000 7f1a54087640 1 -- 172.21.15.44:0/1751713412 shutdown_connections 2023-11-04T01:39:31.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.320+0000 7f1a54087640 1 --2- 172.21.15.44:0/1751713412 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a4c0b4880 0x7f1a4c0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.320+0000 7f1a54087640 1 --2- 172.21.15.44:0/1751713412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a4c153e60 0x7f1a4c15dec0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.320+0000 7f1a54087640 1 -- 172.21.15.44:0/1751713412 >> 172.21.15.44:0/1751713412 conn(0x7f1a4c0cf880 msgr2=0x7f1a4c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.320+0000 7f1a54087640 1 -- 172.21.15.44:0/1751713412 shutdown_connections 2023-11-04T01:39:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.320+0000 7f1a54087640 1 -- 172.21.15.44:0/1751713412 wait complete. 2023-11-04T01:39:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.321+0000 7f1a54087640 1 Processor -- start 2023-11-04T01:39:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.321+0000 7f1a54087640 1 -- start start 2023-11-04T01:39:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a54087640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a4c0b4880 0x7f1a4c152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a54087640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a4c0cd6d0 0x7f1a4c15a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a54087640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a4c153e60 0x7f1a4c0cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a54087640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c1551e0 con 0x7f1a4c0b4880 2023-11-04T01:39:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a54087640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c157f00 con 0x7f1a4c153e60 2023-11-04T01:39:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a54087640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c1581e0 con 0x7f1a4c0cd6d0 2023-11-04T01:39:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a51e23640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a4c0b4880 0x7f1a4c152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a51e23640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a4c0b4880 0x7f1a4c152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32770/0 (socket says 172.21.15.44:32770) 2023-11-04T01:39:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a51e23640 1 -- 172.21.15.44:0/1050434058 learned_addr learned my addr 172.21.15.44:0/1050434058 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a51622640 1 --2- 172.21.15.44:0/1050434058 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a4c0cd6d0 0x7f1a4c15a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a52624640 1 --2- 172.21.15.44:0/1050434058 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a4c153e60 0x7f1a4c0cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a51e23640 1 -- 172.21.15.44:0/1050434058 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a4c0cd6d0 msgr2=0x7f1a4c15a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a51e23640 1 --2- 172.21.15.44:0/1050434058 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a4c0cd6d0 0x7f1a4c15a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a51e23640 1 -- 172.21.15.44:0/1050434058 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a4c153e60 msgr2=0x7f1a4c0cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a51e23640 1 --2- 172.21.15.44:0/1050434058 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a4c153e60 0x7f1a4c0cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a51e23640 1 -- 172.21.15.44:0/1050434058 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c009b30 con 0x7f1a4c0b4880 2023-11-04T01:39:31.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a51e23640 1 --2- 172.21.15.44:0/1050434058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a4c0b4880 0x7f1a4c152c20 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c036040 tx=0x7f1a3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:31.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a4a7fc640 1 -- 172.21.15.44:0/1050434058 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c009510 con 0x7f1a4c0b4880 2023-11-04T01:39:31.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a4a7fc640 1 -- 172.21.15.44:0/1050434058 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c03e450 con 0x7f1a4c0b4880 2023-11-04T01:39:31.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a54087640 1 -- 172.21.15.44:0/1050434058 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4c1584c0 con 0x7f1a4c0b4880 2023-11-04T01:39:31.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.322+0000 7f1a4a7fc640 1 -- 172.21.15.44:0/1050434058 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c03e800 con 0x7f1a4c0b4880 2023-11-04T01:39:31.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.323+0000 7f1a54087640 1 -- 172.21.15.44:0/1050434058 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4c15af20 con 0x7f1a4c0b4880 2023-11-04T01:39:31.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.324+0000 7f1a54087640 1 -- 172.21.15.44:0/1050434058 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4c15b110 con 0x7f1a4c0b4880 2023-11-04T01:39:31.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.324+0000 7f1a4a7fc640 1 -- 172.21.15.44:0/1050434058 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a3c03e960 con 0x7f1a4c0b4880 2023-11-04T01:39:31.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.324+0000 7f1a4a7fc640 1 --2- 172.21.15.44:0/1050434058 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a3806ae70 0x7f1a3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.325+0000 7f1a4a7fc640 1 -- 172.21.15.44:0/1050434058 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f1a3c0ac780 con 0x7f1a4c0b4880 2023-11-04T01:39:31.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.325+0000 7f1a51622640 1 --2- 172.21.15.44:0/1050434058 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a3806ae70 0x7f1a3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.325+0000 7f1a51622640 1 --2- 172.21.15.44:0/1050434058 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a3806ae70 0x7f1a3806d330 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0d3750 tx=0x7f1a40000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:31.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.329+0000 7f1a4a7fc640 1 -- 172.21.15.44:0/1050434058 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a3c077370 con 0x7f1a4c0b4880 2023-11-04T01:39:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.541+0000 7f1a54087640 1 -- 172.21.15.44:0/1050434058 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1a4c074290 con 0x7f1a4c0b4880 2023-11-04T01:39:31.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.568+0000 7f1a4a7fc640 1 -- 172.21.15.44:0/1050434058 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1a3c07a990 con 0x7f1a4c0b4880 2023-11-04T01:39:31.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.571+0000 7f1a54087640 1 -- 172.21.15.44:0/1050434058 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a3806ae70 msgr2=0x7f1a3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.571+0000 7f1a54087640 1 --2- 172.21.15.44:0/1050434058 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a3806ae70 0x7f1a3806d330 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0d3750 tx=0x7f1a40000ed0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.571+0000 7f1a54087640 1 -- 172.21.15.44:0/1050434058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a4c0b4880 msgr2=0x7f1a4c152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.571+0000 7f1a54087640 1 --2- 172.21.15.44:0/1050434058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a4c0b4880 0x7f1a4c152c20 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c036040 tx=0x7f1a3c004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.571+0000 7f1a54087640 1 -- 172.21.15.44:0/1050434058 shutdown_connections 2023-11-04T01:39:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.571+0000 7f1a54087640 1 --2- 172.21.15.44:0/1050434058 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1a3806ae70 0x7f1a3806d330 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.571+0000 7f1a54087640 1 --2- 172.21.15.44:0/1050434058 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a4c153e60 0x7f1a4c0cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.571+0000 7f1a54087640 1 --2- 172.21.15.44:0/1050434058 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a4c0cd6d0 0x7f1a4c15a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.571+0000 7f1a54087640 1 --2- 172.21.15.44:0/1050434058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a4c0b4880 0x7f1a4c152c20 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.571+0000 7f1a54087640 1 -- 172.21.15.44:0/1050434058 >> 172.21.15.44:0/1050434058 conn(0x7f1a4c0cf880 msgr2=0x7f1a4c15f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.571+0000 7f1a54087640 1 -- 172.21.15.44:0/1050434058 shutdown_connections 2023-11-04T01:39:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.572+0000 7f1a54087640 1 -- 172.21.15.44:0/1050434058 wait complete. 2023-11-04T01:39:31.584 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:39:31.584 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:39:31.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.692+0000 7f0f4f2af640 1 Processor -- start 2023-11-04T01:39:31.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.692+0000 7f0f4f2af640 1 -- start start 2023-11-04T01:39:31.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.693+0000 7f0f4f2af640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f48070ff0 0x7f0f480cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.693+0000 7f0f4f2af640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f480c9bf0 con 0x7f0f48066000 2023-11-04T01:39:31.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.693+0000 7f0f4f2af640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f480cd890 con 0x7f0f4815d1b0 2023-11-04T01:39:31.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.693+0000 7f0f4f2af640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f480cdb30 con 0x7f0f48070ff0 2023-11-04T01:39:31.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.693+0000 7f0f4d04b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f48070ff0 0x7f0f480cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.693+0000 7f0f4d84c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0f48066000 0x7f0f4806a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33202/0 (socket says 172.21.15.44:33202) 2023-11-04T01:39:31.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.693+0000 7f0f4d84c640 1 -- 172.21.15.44:0/941450779 learned_addr learned my addr 172.21.15.44:0/941450779 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:31.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.693+0000 7f0f4d04b640 1 -- 172.21.15.44:0/941450779 >> v1:172.21.15.204:6789/0 conn(0x7f0f4815d1b0 legacy=0x7f0f480713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:31.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.693+0000 7f0f4d04b640 1 -- 172.21.15.44:0/941450779 >> v1:172.21.15.44:6789/0 conn(0x7f0f48066000 legacy=0x7f0f4806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.693+0000 7f0f4d04b640 1 -- 172.21.15.44:0/941450779 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f480cde10 con 0x7f0f48070ff0 2023-11-04T01:39:31.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.693+0000 7f0f3ffff640 1 -- 172.21.15.44:0/941450779 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511939278 0 0) 0x7f0f480c9bf0 con 0x7f0f48066000 2023-11-04T01:39:31.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.694+0000 7f0f4d04b640 1 --2- 172.21.15.44:0/941450779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48070ff0 0x7f0f480cb4e0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f0f440097a0 tx=0x7f0f4402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada6ccb48cfa48fd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:31.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.694+0000 7f0f3ffff640 1 -- 172.21.15.44:0/941450779 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44031830 con 0x7f0f48070ff0 2023-11-04T01:39:31.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.694+0000 7f0f3ffff640 1 -- 172.21.15.44:0/941450779 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f44031990 con 0x7f0f48070ff0 2023-11-04T01:39:31.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.694+0000 7f0f3ffff640 1 -- 172.21.15.44:0/941450779 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44031d20 con 0x7f0f48070ff0 2023-11-04T01:39:31.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.695+0000 7f0f4f2af640 1 -- 172.21.15.44:0/941450779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48070ff0 msgr2=0x7f0f480cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.695+0000 7f0f4f2af640 1 --2- 172.21.15.44:0/941450779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48070ff0 0x7f0f480cb4e0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f0f440097a0 tx=0x7f0f4402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.695+0000 7f0f4f2af640 1 -- 172.21.15.44:0/941450779 shutdown_connections 2023-11-04T01:39:31.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.695+0000 7f0f4f2af640 1 --2- 172.21.15.44:0/941450779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48070ff0 0x7f0f480cb4e0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.695+0000 7f0f4f2af640 1 -- 172.21.15.44:0/941450779 >> 172.21.15.44:0/941450779 conn(0x7f0f480cbc90 msgr2=0x7f0f480cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:31.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.695+0000 7f0f4f2af640 1 -- 172.21.15.44:0/941450779 shutdown_connections 2023-11-04T01:39:31.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.695+0000 7f0f4f2af640 1 -- 172.21.15.44:0/941450779 wait complete. 2023-11-04T01:39:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.696+0000 7f0f4f2af640 1 Processor -- start 2023-11-04T01:39:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.696+0000 7f0f4f2af640 1 -- start start 2023-11-04T01:39:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4f2af640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f48066000 0x7f0f480c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4f2af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f48070ff0 0x7f0f480afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4f2af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4815d1b0 0x7f0f480b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4f2af640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f481f3a30 con 0x7f0f4815d1b0 2023-11-04T01:39:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4f2af640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f480b3de0 con 0x7f0f48066000 2023-11-04T01:39:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4f2af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f480b40c0 con 0x7f0f48070ff0 2023-11-04T01:39:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4d84c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4815d1b0 0x7f0f480b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4d84c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4815d1b0 0x7f0f480b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32792/0 (socket says 172.21.15.44:32792) 2023-11-04T01:39:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4d84c640 1 -- 172.21.15.44:0/191261222 learned_addr learned my addr 172.21.15.44:0/191261222 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4d04b640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f48066000 0x7f0f480c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4c84a640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f48070ff0 0x7f0f480afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4d84c640 1 -- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f48070ff0 msgr2=0x7f0f480afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4d84c640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f48070ff0 0x7f0f480afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4d84c640 1 -- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f48066000 msgr2=0x7f0f480c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4d84c640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f48066000 0x7f0f480c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4d84c640 1 -- 172.21.15.44:0/191261222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f44009400 con 0x7f0f4815d1b0 2023-11-04T01:39:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4d04b640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f48066000 0x7f0f480c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4c84a640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f48070ff0 0x7f0f480afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f4d84c640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4815d1b0 0x7f0f480b02c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c780 tx=0x7f0f4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.697+0000 7f0f3dffb640 1 -- 172.21.15.44:0/191261222 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4000ce90 con 0x7f0f4815d1b0 2023-11-04T01:39:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.698+0000 7f0f3dffb640 1 -- 172.21.15.44:0/191261222 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4000a640 con 0x7f0f4815d1b0 2023-11-04T01:39:31.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.698+0000 7f0f4f2af640 1 -- 172.21.15.44:0/191261222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f480b43a0 con 0x7f0f4815d1b0 2023-11-04T01:39:31.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.698+0000 7f0f3dffb640 1 -- 172.21.15.44:0/191261222 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4000a9d0 con 0x7f0f4815d1b0 2023-11-04T01:39:31.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.698+0000 7f0f4f2af640 1 -- 172.21.15.44:0/191261222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f480c92e0 con 0x7f0f4815d1b0 2023-11-04T01:39:31.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.699+0000 7f0f4f2af640 1 -- 172.21.15.44:0/191261222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f481f3ba0 con 0x7f0f4815d1b0 2023-11-04T01:39:31.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.699+0000 7f0f3dffb640 1 -- 172.21.15.44:0/191261222 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f4000ab30 con 0x7f0f4815d1b0 2023-11-04T01:39:31.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.699+0000 7f0f3dffb640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0f2c06ae70 0x7f0f2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:31.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.700+0000 7f0f3dffb640 1 -- 172.21.15.44:0/191261222 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f0f40089000 con 0x7f0f4815d1b0 2023-11-04T01:39:31.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.700+0000 7f0f4d04b640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0f2c06ae70 0x7f0f2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:31.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.700+0000 7f0f4d04b640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0f2c06ae70 0x7f0f2c06d330 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0f44036000 tx=0x7f0f4403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:31.705 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.704+0000 7f0f3dffb640 1 -- 172.21.15.44:0/191261222 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f40053bd0 con 0x7f0f4815d1b0 2023-11-04T01:39:31.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:31.917+0000 7f0f4f2af640 1 -- 172.21.15.44:0/191261222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0f48074290 con 0x7f0f4815d1b0 2023-11-04T01:39:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.573+0000 7f0f3dffb640 1 -- 172.21.15.44:0/191261222 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0f40018020 con 0x7f0f4815d1b0 2023-11-04T01:39:32.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.576+0000 7f0f4f2af640 1 -- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0f2c06ae70 msgr2=0x7f0f2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.576+0000 7f0f4f2af640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0f2c06ae70 0x7f0f2c06d330 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0f44036000 tx=0x7f0f4403c040 comp rx=0 tx=0).stop 2023-11-04T01:39:32.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.576+0000 7f0f4f2af640 1 -- 172.21.15.44:0/191261222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4815d1b0 msgr2=0x7f0f480b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.576+0000 7f0f4f2af640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4815d1b0 0x7f0f480b02c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c780 tx=0x7f0f4000cc40 comp rx=0 tx=0).stop 2023-11-04T01:39:32.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.576+0000 7f0f4f2af640 1 -- 172.21.15.44:0/191261222 shutdown_connections 2023-11-04T01:39:32.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.576+0000 7f0f4f2af640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0f2c06ae70 0x7f0f2c06d330 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.576+0000 7f0f4f2af640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4815d1b0 0x7f0f480b02c0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.576+0000 7f0f4f2af640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0f48070ff0 0x7f0f480afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.576+0000 7f0f4f2af640 1 --2- 172.21.15.44:0/191261222 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0f48066000 0x7f0f480c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.576+0000 7f0f4f2af640 1 -- 172.21.15.44:0/191261222 >> 172.21.15.44:0/191261222 conn(0x7f0f480cbc90 msgr2=0x7f0f48160830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.576+0000 7f0f4f2af640 1 -- 172.21.15.44:0/191261222 shutdown_connections 2023-11-04T01:39:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.576+0000 7f0f4f2af640 1 -- 172.21.15.44:0/191261222 wait complete. 2023-11-04T01:39:32.590 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:39:32.590 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:32.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.697+0000 7f23682c2640 1 Processor -- start 2023-11-04T01:39:32.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.697+0000 7f23682c2640 1 -- start start 2023-11-04T01:39:32.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.698+0000 7f23682c2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f236015d250 0x7f23600c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.698+0000 7f23682c2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f23600c9d70 0x7f23600ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.698+0000 7f23682c2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236006a120 con 0x7f236015ce70 2023-11-04T01:39:32.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.698+0000 7f23682c2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23600cdc10 con 0x7f236015d250 2023-11-04T01:39:32.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.698+0000 7f23682c2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236006a370 con 0x7f23600c9d70 2023-11-04T01:39:32.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.698+0000 7f236585d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f236015d250 0x7f23600c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.698+0000 7f236585d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f236015d250 0x7f23600c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32830/0 (socket says 172.21.15.44:32830) 2023-11-04T01:39:32.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.698+0000 7f236585d640 1 -- 172.21.15.44:0/883112219 learned_addr learned my addr 172.21.15.44:0/883112219 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:32.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.698+0000 7f236685f640 1 --2- 172.21.15.44:0/883112219 >> v2:172.21.15.204:3300/0 conn(0x7f23600c9d70 0x7f23600ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.699+0000 7f236585d640 1 -- 172.21.15.44:0/883112219 >> v2:172.21.15.204:3300/0 conn(0x7f23600c9d70 msgr2=0x7f23600ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:32.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.699+0000 7f236585d640 1 --2- 172.21.15.44:0/883112219 >> v2:172.21.15.204:3300/0 conn(0x7f23600c9d70 0x7f23600ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.699+0000 7f236585d640 1 -- 172.21.15.44:0/883112219 >> v1:172.21.15.204:6789/0 conn(0x7f236015ce70 legacy=0x7f236006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.699+0000 7f236585d640 1 -- 172.21.15.44:0/883112219 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236006a650 con 0x7f236015d250 2023-11-04T01:39:32.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.699+0000 7f236585d640 1 --2- 172.21.15.44:0/883112219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236015d250 0x7f23600c9830 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f236009cee0 tx=0x7f235402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87289d4cda64ee6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:32.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.700+0000 7f236505c640 1 -- 172.21.15.44:0/883112219 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354030860 con 0x7f236015d250 2023-11-04T01:39:32.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.700+0000 7f236505c640 1 -- 172.21.15.44:0/883112219 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23540309c0 con 0x7f236015d250 2023-11-04T01:39:32.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.700+0000 7f236505c640 1 -- 172.21.15.44:0/883112219 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354030d50 con 0x7f236015d250 2023-11-04T01:39:32.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.700+0000 7f23682c2640 1 -- 172.21.15.44:0/883112219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236015d250 msgr2=0x7f23600c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.700+0000 7f23682c2640 1 --2- 172.21.15.44:0/883112219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236015d250 0x7f23600c9830 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f236009cee0 tx=0x7f235402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.700+0000 7f23682c2640 1 -- 172.21.15.44:0/883112219 shutdown_connections 2023-11-04T01:39:32.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.700+0000 7f23682c2640 1 --2- 172.21.15.44:0/883112219 >> v2:172.21.15.204:3300/0 conn(0x7f23600c9d70 0x7f23600ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.700+0000 7f23682c2640 1 --2- 172.21.15.44:0/883112219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236015d250 0x7f23600c9830 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.700+0000 7f23682c2640 1 -- 172.21.15.44:0/883112219 >> 172.21.15.44:0/883112219 conn(0x7f23600b0cd0 msgr2=0x7f23600b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:32.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.700+0000 7f23682c2640 1 -- 172.21.15.44:0/883112219 shutdown_connections 2023-11-04T01:39:32.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.700+0000 7f23682c2640 1 -- 172.21.15.44:0/883112219 wait complete. 2023-11-04T01:39:32.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.701+0000 7f23682c2640 1 Processor -- start 2023-11-04T01:39:32.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.701+0000 7f23682c2640 1 -- start start 2023-11-04T01:39:32.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.702+0000 7f23682c2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f236015ce70 0x7f23601e2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.702+0000 7f23682c2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f236015d250 0x7f236014d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.702+0000 7f23682c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236015a4d0 0x7f23601f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.702+0000 7f23682c2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23600b0190 con 0x7f236015a4d0 2023-11-04T01:39:32.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.702+0000 7f23682c2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23601e2400 con 0x7f236015d250 2023-11-04T01:39:32.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.702+0000 7f23682c2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23601e3250 con 0x7f236015ce70 2023-11-04T01:39:32.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.702+0000 7f236685f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236015a4d0 0x7f23601f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.702+0000 7f236685f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236015a4d0 0x7f23601f6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32838/0 (socket says 172.21.15.44:32838) 2023-11-04T01:39:32.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.702+0000 7f236685f640 1 -- 172.21.15.44:0/378013189 learned_addr learned my addr 172.21.15.44:0/378013189 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:32.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.702+0000 7f236585d640 1 --2- 172.21.15.44:0/378013189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f236015d250 0x7f236014d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.702+0000 7f236605e640 1 --2- 172.21.15.44:0/378013189 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f236015ce70 0x7f23601e2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.703+0000 7f236685f640 1 -- 172.21.15.44:0/378013189 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f236015ce70 msgr2=0x7f23601e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.703+0000 7f236685f640 1 --2- 172.21.15.44:0/378013189 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f236015ce70 0x7f23601e2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.703+0000 7f236685f640 1 -- 172.21.15.44:0/378013189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f236015d250 msgr2=0x7f236014d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.703+0000 7f236685f640 1 --2- 172.21.15.44:0/378013189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f236015d250 0x7f236014d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.703+0000 7f236685f640 1 -- 172.21.15.44:0/378013189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23540094d0 con 0x7f236015a4d0 2023-11-04T01:39:32.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.703+0000 7f236685f640 1 --2- 172.21.15.44:0/378013189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236015a4d0 0x7f23601f6710 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f235800d5d0 tx=0x7f235800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:32.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.703+0000 7f235effd640 1 -- 172.21.15.44:0/378013189 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23580125f0 con 0x7f236015a4d0 2023-11-04T01:39:32.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.703+0000 7f235effd640 1 -- 172.21.15.44:0/378013189 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2358012750 con 0x7f236015a4d0 2023-11-04T01:39:32.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.703+0000 7f23682c2640 1 -- 172.21.15.44:0/378013189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23601e26a0 con 0x7f236015a4d0 2023-11-04T01:39:32.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.703+0000 7f235effd640 1 -- 172.21.15.44:0/378013189 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358012b00 con 0x7f236015a4d0 2023-11-04T01:39:32.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.703+0000 7f23682c2640 1 -- 172.21.15.44:0/378013189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23601f61f0 con 0x7f236015a4d0 2023-11-04T01:39:32.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.704+0000 7f23682c2640 1 -- 172.21.15.44:0/378013189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2360074290 con 0x7f236015a4d0 2023-11-04T01:39:32.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.704+0000 7f235effd640 1 -- 172.21.15.44:0/378013189 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2358012c60 con 0x7f236015a4d0 2023-11-04T01:39:32.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.705+0000 7f235effd640 1 --2- 172.21.15.44:0/378013189 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f234c06ae70 0x7f234c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.705+0000 7f235effd640 1 -- 172.21.15.44:0/378013189 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f2358089ee0 con 0x7f236015a4d0 2023-11-04T01:39:32.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.705+0000 7f236605e640 1 --2- 172.21.15.44:0/378013189 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f234c06ae70 0x7f234c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.706+0000 7f236605e640 1 --2- 172.21.15.44:0/378013189 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f234c06ae70 0x7f234c06d330 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f23500012e0 tx=0x7f2350009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:32.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.709+0000 7f235effd640 1 -- 172.21.15.44:0/378013189 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2358054b60 con 0x7f236015a4d0 2023-11-04T01:39:32.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.921+0000 7f23682c2640 1 -- 172.21.15.44:0/378013189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2360066170 con 0x7f236015a4d0 2023-11-04T01:39:32.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.922+0000 7f235effd640 1 -- 172.21.15.44:0/378013189 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f2358058180 con 0x7f236015a4d0 2023-11-04T01:39:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:39:31.919462+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6836/2461924520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2461924520},{"type":"v1","addr":"172.21.15.204:6836","nonce":2461924520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:32.924 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 46 2023-11-04T01:39:32.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.924+0000 7f23682c2640 1 -- 172.21.15.44:0/378013189 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f234c06ae70 msgr2=0x7f234c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.924+0000 7f23682c2640 1 --2- 172.21.15.44:0/378013189 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f234c06ae70 0x7f234c06d330 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f23500012e0 tx=0x7f2350009040 comp rx=0 tx=0).stop 2023-11-04T01:39:32.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.924+0000 7f23682c2640 1 -- 172.21.15.44:0/378013189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236015a4d0 msgr2=0x7f23601f6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.924+0000 7f23682c2640 1 --2- 172.21.15.44:0/378013189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236015a4d0 0x7f23601f6710 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f235800d5d0 tx=0x7f235800da90 comp rx=0 tx=0).stop 2023-11-04T01:39:32.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.924+0000 7f23682c2640 1 -- 172.21.15.44:0/378013189 shutdown_connections 2023-11-04T01:39:32.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.924+0000 7f23682c2640 1 --2- 172.21.15.44:0/378013189 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f234c06ae70 0x7f234c06d330 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.924+0000 7f23682c2640 1 --2- 172.21.15.44:0/378013189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236015a4d0 0x7f23601f6710 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.924+0000 7f23682c2640 1 --2- 172.21.15.44:0/378013189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f236015d250 0x7f236014d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.924+0000 7f23682c2640 1 --2- 172.21.15.44:0/378013189 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f236015ce70 0x7f23601e2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.924+0000 7f23682c2640 1 -- 172.21.15.44:0/378013189 >> 172.21.15.44:0/378013189 conn(0x7f23600b0cd0 msgr2=0x7f23600ad470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:32.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.924+0000 7f23682c2640 1 -- 172.21.15.44:0/378013189 shutdown_connections 2023-11-04T01:39:32.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:32.924+0000 7f23682c2640 1 -- 172.21.15.44:0/378013189 wait complete. 2023-11-04T01:39:32.936 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:33.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.040+0000 7f9ba6990640 1 Processor -- start 2023-11-04T01:39:33.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.040+0000 7f9ba6990640 1 -- start start 2023-11-04T01:39:33.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.041+0000 7f9ba6990640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ba00b0ae0 0x7f9ba00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.041+0000 7f9ba6990640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ba006db20 0x7f9ba015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.041+0000 7f9ba6990640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba00b4110 con 0x7f9ba0159c70 2023-11-04T01:39:33.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.041+0000 7f9ba6990640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba00b49b0 con 0x7f9ba006db20 2023-11-04T01:39:33.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.041+0000 7f9ba6990640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba00b43f0 con 0x7f9ba00b0ae0 2023-11-04T01:39:33.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.041+0000 7f9ba4f2d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ba006db20 0x7f9ba015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.041+0000 7f9ba4f2d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ba006db20 0x7f9ba015d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32842/0 (socket says 172.21.15.44:32842) 2023-11-04T01:39:33.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.041+0000 7f9ba4f2d640 1 -- 172.21.15.44:0/3242640767 learned_addr learned my addr 172.21.15.44:0/3242640767 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:33.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.041+0000 7f9b9f7fe640 1 --2- 172.21.15.44:0/3242640767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ba00b0ae0 0x7f9ba00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.041+0000 7f9ba4f2d640 1 -- 172.21.15.44:0/3242640767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ba00b0ae0 msgr2=0x7f9ba00ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:33.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.041+0000 7f9ba4f2d640 1 --2- 172.21.15.44:0/3242640767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ba00b0ae0 0x7f9ba00ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.041+0000 7f9ba4f2d640 1 -- 172.21.15.44:0/3242640767 >> v1:172.21.15.204:6789/0 conn(0x7f9ba0159c70 legacy=0x7f9ba00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:33.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.041+0000 7f9ba4f2d640 1 -- 172.21.15.44:0/3242640767 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba00b46d0 con 0x7f9ba006db20 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.042+0000 7f9ba4f2d640 1 --2- 172.21.15.44:0/3242640767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ba006db20 0x7f9ba015d7d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800d150 tx=0x7f9b9802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47451f9e792a8f05 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.042+0000 7f9b9effd640 1 -- 172.21.15.44:0/3242640767 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9802ea80 con 0x7f9ba006db20 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.042+0000 7f9b9effd640 1 -- 172.21.15.44:0/3242640767 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9802ebe0 con 0x7f9ba006db20 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.042+0000 7f9b9effd640 1 -- 172.21.15.44:0/3242640767 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98009600 con 0x7f9ba006db20 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.043+0000 7f9ba6990640 1 -- 172.21.15.44:0/3242640767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ba006db20 msgr2=0x7f9ba015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.043+0000 7f9ba6990640 1 --2- 172.21.15.44:0/3242640767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ba006db20 0x7f9ba015d7d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800d150 tx=0x7f9b9802e0e0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.043+0000 7f9ba6990640 1 -- 172.21.15.44:0/3242640767 shutdown_connections 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.043+0000 7f9ba6990640 1 --2- 172.21.15.44:0/3242640767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ba006db20 0x7f9ba015d7d0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.043+0000 7f9ba6990640 1 --2- 172.21.15.44:0/3242640767 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ba00b0ae0 0x7f9ba00ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.043+0000 7f9ba6990640 1 -- 172.21.15.44:0/3242640767 >> 172.21.15.44:0/3242640767 conn(0x7f9ba00ce950 msgr2=0x7f9ba00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.043+0000 7f9ba6990640 1 -- 172.21.15.44:0/3242640767 shutdown_connections 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.043+0000 7f9ba6990640 1 -- 172.21.15.44:0/3242640767 wait complete. 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.044+0000 7f9ba6990640 1 Processor -- start 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.044+0000 7f9ba6990640 1 -- start start 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9ba6990640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ba006db20 0x7f9ba01539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9ba6990640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ba00b0ae0 0x7f9ba00b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9ba6990640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ba0159c70 0x7f9ba00b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9ba6990640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba00ae810 con 0x7f9ba006db20 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9ba6990640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba00afac0 con 0x7f9ba0159c70 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9ba6990640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba00aea20 con 0x7f9ba00b0ae0 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9b9ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ba006db20 0x7f9ba01539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9b9ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ba006db20 0x7f9ba01539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32856/0 (socket says 172.21.15.44:32856) 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9b9ffff640 1 -- 172.21.15.44:0/1232706 learned_addr learned my addr 172.21.15.44:0/1232706 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9ba4f2d640 1 --2- 172.21.15.44:0/1232706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ba0159c70 0x7f9ba00b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9b9f7fe640 1 --2- 172.21.15.44:0/1232706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ba00b0ae0 0x7f9ba00b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9b9ffff640 1 -- 172.21.15.44:0/1232706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ba00b0ae0 msgr2=0x7f9ba00b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9b9ffff640 1 --2- 172.21.15.44:0/1232706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ba00b0ae0 0x7f9ba00b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9b9ffff640 1 -- 172.21.15.44:0/1232706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ba0159c70 msgr2=0x7f9ba00b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9b9ffff640 1 --2- 172.21.15.44:0/1232706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ba0159c70 0x7f9ba00b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.045+0000 7f9b9ffff640 1 -- 172.21.15.44:0/1232706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9800bd40 con 0x7f9ba006db20 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.046+0000 7f9b9ffff640 1 --2- 172.21.15.44:0/1232706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ba006db20 0x7f9ba01539d0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400b3f0 tx=0x7f9b9400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.046+0000 7f9b9cff9640 1 -- 172.21.15.44:0/1232706 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94011830 con 0x7f9ba006db20 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.046+0000 7f9b9cff9640 1 -- 172.21.15.44:0/1232706 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b94011990 con 0x7f9ba006db20 2023-11-04T01:39:33.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.046+0000 7f9b9cff9640 1 -- 172.21.15.44:0/1232706 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94011d40 con 0x7f9ba006db20 2023-11-04T01:39:33.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.046+0000 7f9ba6990640 1 -- 172.21.15.44:0/1232706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba00aed00 con 0x7f9ba006db20 2023-11-04T01:39:33.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.046+0000 7f9ba6990640 1 -- 172.21.15.44:0/1232706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba00af2c0 con 0x7f9ba006db20 2023-11-04T01:39:33.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.047+0000 7f9ba6990640 1 -- 172.21.15.44:0/1232706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba0074290 con 0x7f9ba006db20 2023-11-04T01:39:33.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.047+0000 7f9b9cff9640 1 -- 172.21.15.44:0/1232706 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b9401a400 con 0x7f9ba006db20 2023-11-04T01:39:33.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.048+0000 7f9b9cff9640 1 --2- 172.21.15.44:0/1232706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9b8c06ae70 0x7f9b8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.048+0000 7f9b9cff9640 1 -- 172.21.15.44:0/1232706 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f9b940899c0 con 0x7f9ba006db20 2023-11-04T01:39:33.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.048+0000 7f9b9f7fe640 1 --2- 172.21.15.44:0/1232706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9b8c06ae70 0x7f9b8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.049+0000 7f9b9f7fe640 1 --2- 172.21.15.44:0/1232706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9b8c06ae70 0x7f9b8c06d330 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9b90006fd0 tx=0x7f9b90008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.052+0000 7f9b9cff9640 1 -- 172.21.15.44:0/1232706 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9b94054500 con 0x7f9ba006db20 2023-11-04T01:39:33.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.232+0000 7f9ba6990640 1 -- 172.21.15.44:0/1232706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ba006d3f0 con 0x7f9ba006db20 2023-11-04T01:39:33.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.234+0000 7f9b9cff9640 1 -- 172.21.15.44:0/1232706 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+21961 (secure 0 0 0) 0x7f9b94057b20 con 0x7f9ba006db20 2023-11-04T01:39:33.236 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:33.236 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":96,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:39:31.563196+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:28.109628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:28.871834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:33.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.236+0000 7f9ba6990640 1 -- 172.21.15.44:0/1232706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9b8c06ae70 msgr2=0x7f9b8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.236+0000 7f9ba6990640 1 --2- 172.21.15.44:0/1232706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9b8c06ae70 0x7f9b8c06d330 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9b90006fd0 tx=0x7f9b90008040 comp rx=0 tx=0).stop 2023-11-04T01:39:33.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.236+0000 7f9ba6990640 1 -- 172.21.15.44:0/1232706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ba006db20 msgr2=0x7f9ba01539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.236+0000 7f9ba6990640 1 --2- 172.21.15.44:0/1232706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ba006db20 0x7f9ba01539d0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400b3f0 tx=0x7f9b9400b8b0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.236+0000 7f9ba6990640 1 -- 172.21.15.44:0/1232706 shutdown_connections 2023-11-04T01:39:33.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.236+0000 7f9ba6990640 1 --2- 172.21.15.44:0/1232706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9b8c06ae70 0x7f9b8c06d330 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.236+0000 7f9ba6990640 1 --2- 172.21.15.44:0/1232706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ba0159c70 0x7f9ba00b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.236+0000 7f9ba6990640 1 --2- 172.21.15.44:0/1232706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ba00b0ae0 0x7f9ba00b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.236+0000 7f9ba6990640 1 --2- 172.21.15.44:0/1232706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ba006db20 0x7f9ba01539d0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.236+0000 7f9ba6990640 1 -- 172.21.15.44:0/1232706 >> 172.21.15.44:0/1232706 conn(0x7f9ba00ce950 msgr2=0x7f9ba00cbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.236+0000 7f9ba6990640 1 -- 172.21.15.44:0/1232706 shutdown_connections 2023-11-04T01:39:33.240 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.236+0000 7f9ba6990640 1 -- 172.21.15.44:0/1232706 wait complete. 2023-11-04T01:39:33.249 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:39:33.249 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:39:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.353+0000 7f5131de2640 1 Processor -- start 2023-11-04T01:39:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.353+0000 7f5131de2640 1 -- start start 2023-11-04T01:39:33.358 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f5131de2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f512c15ce60 0x7f512c06b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f5131de2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f512c06bd30 0x7f512c160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f5131de2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f512c1615d0 con 0x7f512c161050 2023-11-04T01:39:33.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f5131de2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512c0cbde0 con 0x7f512c06bd30 2023-11-04T01:39:33.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f5131de2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512c1618b0 con 0x7f512c15ce60 2023-11-04T01:39:33.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f512bfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f512c161050 0x7f512c0cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43950/0 (socket says 172.21.15.44:43950) 2023-11-04T01:39:33.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f512bfff640 1 -- 172.21.15.44:0/2247283209 learned_addr learned my addr 172.21.15.44:0/2247283209 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:33.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f512a7fc640 1 -- 172.21.15.44:0/2247283209 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377589655 0 0) 0x7f512c1615d0 con 0x7f512c161050 2023-11-04T01:39:33.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f512b7fe640 1 --2- 172.21.15.44:0/2247283209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f512c15ce60 0x7f512c06b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f512affd640 1 --2- 172.21.15.44:0/2247283209 >> v2:172.21.15.204:3300/0 conn(0x7f512c06bd30 0x7f512c160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f512a7fc640 1 -- 172.21.15.44:0/2247283209 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5114003520 con 0x7f512c161050 2023-11-04T01:39:33.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f512a7fc640 1 -- 172.21.15.44:0/2247283209 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3505682261 0 0) 0x7f5114003520 con 0x7f512c161050 2023-11-04T01:39:33.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f512a7fc640 1 -- 172.21.15.44:0/2247283209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f512c15ce60 msgr2=0x7f512c06b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:33.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f512a7fc640 1 --2- 172.21.15.44:0/2247283209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f512c15ce60 0x7f512c06b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f512a7fc640 1 -- 172.21.15.44:0/2247283209 >> v2:172.21.15.204:3300/0 conn(0x7f512c06bd30 msgr2=0x7f512c160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:33.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f512a7fc640 1 --2- 172.21.15.44:0/2247283209 >> v2:172.21.15.204:3300/0 conn(0x7f512c06bd30 0x7f512c160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f512a7fc640 1 -- 172.21.15.44:0/2247283209 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c0cba00 con 0x7f512c161050 2023-11-04T01:39:33.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.354+0000 7f512a7fc640 1 -- 172.21.15.44:0/2247283209 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f51240019f0 con 0x7f512c161050 2023-11-04T01:39:33.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512a7fc640 1 -- 172.21.15.44:0/2247283209 >> v1:172.21.15.44:6789/0 conn(0x7f512c161050 legacy=0x7f512c0cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512a7fc640 1 --2- 172.21.15.44:0/2247283209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5114003970 0x7f5114003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512a7fc640 1 --2- 172.21.15.44:0/2247283209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f51140047c0 0x7f5114004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512a7fc640 1 --2- 172.21.15.44:0/2247283209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f512c15ce60 0x7f5114005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512a7fc640 1 -- 172.21.15.44:0/2247283209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c0cbde0 con 0x7f5114003970 2023-11-04T01:39:33.360 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512a7fc640 1 -- 172.21.15.44:0/2247283209 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c1618b0 con 0x7f51140047c0 2023-11-04T01:39:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512a7fc640 1 -- 172.21.15.44:0/2247283209 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511400ba30 con 0x7f512c15ce60 2023-11-04T01:39:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512b7fe640 1 --2- 172.21.15.44:0/2247283209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5114003970 0x7f5114003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512bfff640 1 --2- 172.21.15.44:0/2247283209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f512c15ce60 0x7f5114005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512affd640 1 --2- 172.21.15.44:0/2247283209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f51140047c0 0x7f5114004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512b7fe640 1 -- 172.21.15.44:0/2247283209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f512c15ce60 msgr2=0x7f5114005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512b7fe640 1 --2- 172.21.15.44:0/2247283209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f512c15ce60 0x7f5114005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512b7fe640 1 -- 172.21.15.44:0/2247283209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f51140047c0 msgr2=0x7f5114004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512b7fe640 1 --2- 172.21.15.44:0/2247283209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f51140047c0 0x7f5114004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512b7fe640 1 -- 172.21.15.44:0/2247283209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5114003520 con 0x7f5114003970 2023-11-04T01:39:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.355+0000 7f512bfff640 1 --2- 172.21.15.44:0/2247283209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f512c15ce60 0x7f5114005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.356+0000 7f512b7fe640 1 --2- 172.21.15.44:0/2247283209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5114003970 0x7f5114003d90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f511c00ba00 tx=0x7f51140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff2844ab5cfc2d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.356+0000 7f512a7fc640 1 -- 172.21.15.44:0/2247283209 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0325f0 con 0x7f5114003970 2023-11-04T01:39:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.356+0000 7f512a7fc640 1 -- 172.21.15.44:0/2247283209 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c032750 con 0x7f5114003970 2023-11-04T01:39:33.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.356+0000 7f512a7fc640 1 -- 172.21.15.44:0/2247283209 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c032ae0 con 0x7f5114003970 2023-11-04T01:39:33.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.356+0000 7f5131de2640 1 -- 172.21.15.44:0/2247283209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5114003970 msgr2=0x7f5114003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.356+0000 7f5131de2640 1 --2- 172.21.15.44:0/2247283209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5114003970 0x7f5114003d90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f511c00ba00 tx=0x7f51140057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.356+0000 7f512bfff640 1 -- 172.21.15.44:0/2247283209 reap_dead start 2023-11-04T01:39:33.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.356+0000 7f5131de2640 1 -- 172.21.15.44:0/2247283209 shutdown_connections 2023-11-04T01:39:33.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.356+0000 7f5131de2640 1 -- 172.21.15.44:0/2247283209 >> 172.21.15.44:0/2247283209 conn(0x7f512c06ea90 msgr2=0x7f512c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.356+0000 7f5131de2640 1 -- 172.21.15.44:0/2247283209 shutdown_connections 2023-11-04T01:39:33.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.356+0000 7f5131de2640 1 -- 172.21.15.44:0/2247283209 wait complete. 2023-11-04T01:39:33.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.358+0000 7f5131de2640 1 Processor -- start 2023-11-04T01:39:33.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.358+0000 7f5131de2640 1 -- start start 2023-11-04T01:39:33.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.358+0000 7f5131de2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5114003970 0x7f512c0b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.358+0000 7f5131de2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f512c1f6910 0x7f512c0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.358+0000 7f5131de2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f512c0ca580 0x7f512c0cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.358+0000 7f5131de2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c0cae90 con 0x7f5114003970 2023-11-04T01:39:33.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.358+0000 7f5131de2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c1f64f0 con 0x7f512c0ca580 2023-11-04T01:39:33.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.358+0000 7f5131de2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512c150420 con 0x7f512c1f6910 2023-11-04T01:39:33.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f512b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5114003970 0x7f512c0b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f512b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5114003970 0x7f512c0b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32866/0 (socket says 172.21.15.44:32866) 2023-11-04T01:39:33.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f512b7fe640 1 -- 172.21.15.44:0/1479020417 learned_addr learned my addr 172.21.15.44:0/1479020417 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:33.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f512bfff640 1 --2- 172.21.15.44:0/1479020417 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f512c0ca580 0x7f512c0cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f512affd640 1 --2- 172.21.15.44:0/1479020417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f512c1f6910 0x7f512c0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f512b7fe640 1 -- 172.21.15.44:0/1479020417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f512c1f6910 msgr2=0x7f512c0ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f512b7fe640 1 --2- 172.21.15.44:0/1479020417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f512c1f6910 0x7f512c0ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f512b7fe640 1 -- 172.21.15.44:0/1479020417 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f512c0ca580 msgr2=0x7f512c0cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f512b7fe640 1 --2- 172.21.15.44:0/1479020417 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f512c0ca580 0x7f512c0cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f512b7fe640 1 -- 172.21.15.44:0/1479020417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c0cabb0 con 0x7f5114003970 2023-11-04T01:39:33.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f512bfff640 1 --2- 172.21.15.44:0/1479020417 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f512c0ca580 0x7f512c0cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:33.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f512b7fe640 1 --2- 172.21.15.44:0/1479020417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5114003970 0x7f512c0b5770 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f511c00bb20 tx=0x7f511c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f5113fff640 1 -- 172.21.15.44:0/1479020417 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c03ca80 con 0x7f5114003970 2023-11-04T01:39:33.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f5113fff640 1 -- 172.21.15.44:0/1479020417 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c03cbe0 con 0x7f5114003970 2023-11-04T01:39:33.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f5131de2640 1 -- 172.21.15.44:0/1479020417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512c1f5e30 con 0x7f5114003970 2023-11-04T01:39:33.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f5113fff640 1 -- 172.21.15.44:0/1479020417 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0463f0 con 0x7f5114003970 2023-11-04T01:39:33.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.359+0000 7f5131de2640 1 -- 172.21.15.44:0/1479020417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512c0b5cb0 con 0x7f5114003970 2023-11-04T01:39:33.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.360+0000 7f5131de2640 1 -- 172.21.15.44:0/1479020417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512c1f6760 con 0x7f5114003970 2023-11-04T01:39:33.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.361+0000 7f5113fff640 1 -- 172.21.15.44:0/1479020417 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f511c04f450 con 0x7f5114003970 2023-11-04T01:39:33.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.361+0000 7f5113fff640 1 --2- 172.21.15.44:0/1479020417 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f511806aea0 0x7f511806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.361+0000 7f5113fff640 1 -- 172.21.15.44:0/1479020417 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f511c0ac160 con 0x7f5114003970 2023-11-04T01:39:33.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.361+0000 7f512affd640 1 --2- 172.21.15.44:0/1479020417 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f511806aea0 0x7f511806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.362+0000 7f512affd640 1 --2- 172.21.15.44:0/1479020417 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f511806aea0 0x7f511806d360 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f512c0b6ad0 tx=0x7f5120008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.366+0000 7f5113fff640 1 -- 172.21.15.44:0/1479020417 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f511c076d30 con 0x7f5114003970 2023-11-04T01:39:33.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.537+0000 7f5131de2640 1 -- 172.21.15.44:0/1479020417 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f512c0b5ea0 con 0x7f511806aea0 2023-11-04T01:39:33.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.551+0000 7f5113fff640 1 -- 172.21.15.44:0/1479020417 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+532208 (secure 0 0 0) 0x7f512c0b5ea0 con 0x7f511806aea0 2023-11-04T01:39:33.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:33.563 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:39:33.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.555+0000 7f5131de2640 1 -- 172.21.15.44:0/1479020417 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f511806aea0 msgr2=0x7f511806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.555+0000 7f5131de2640 1 --2- 172.21.15.44:0/1479020417 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f511806aea0 0x7f511806d360 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f512c0b6ad0 tx=0x7f5120008040 comp rx=0 tx=0).stop 2023-11-04T01:39:33.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.555+0000 7f5131de2640 1 -- 172.21.15.44:0/1479020417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5114003970 msgr2=0x7f512c0b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.555+0000 7f5131de2640 1 --2- 172.21.15.44:0/1479020417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5114003970 0x7f512c0b5770 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f511c00bb20 tx=0x7f511c004730 comp rx=0 tx=0).stop 2023-11-04T01:39:33.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.555+0000 7f5131de2640 1 -- 172.21.15.44:0/1479020417 shutdown_connections 2023-11-04T01:39:33.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.555+0000 7f5131de2640 1 --2- 172.21.15.44:0/1479020417 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f511806aea0 0x7f511806d360 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.555+0000 7f5131de2640 1 --2- 172.21.15.44:0/1479020417 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f512c0ca580 0x7f512c0cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.555+0000 7f5131de2640 1 --2- 172.21.15.44:0/1479020417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f512c1f6910 0x7f512c0ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.555+0000 7f5131de2640 1 --2- 172.21.15.44:0/1479020417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5114003970 0x7f512c0b5770 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.555+0000 7f5131de2640 1 -- 172.21.15.44:0/1479020417 >> 172.21.15.44:0/1479020417 conn(0x7f512c06ea90 msgr2=0x7f512c0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.555+0000 7f5131de2640 1 -- 172.21.15.44:0/1479020417 shutdown_connections 2023-11-04T01:39:33.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.555+0000 7f5131de2640 1 -- 172.21.15.44:0/1479020417 wait complete. 2023-11-04T01:39:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2023-11-04T01:39:32.628646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":318,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251524,"kb_used_data":10372,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754723196,"statfs":{"total":773094113280,"available":772836552704,"internally_reserved":0,"allocated":10620928,"data_stored":5817889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.107286"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572768+0000","last_change":"2023-11-04T01:39:30.585362+0000","last_active":"2023-11-04T01:39:31.572768+0000","last_peered":"2023-11-04T01:39:31.572768+0000","last_clean":"2023-11-04T01:39:31.572768+0000","last_became_active":"2023-11-04T01:39:30.585068+0000","last_became_peered":"2023-11-04T01:39:30.585068+0000","last_unstale":"2023-11-04T01:39:31.572768+0000","last_undegraded":"2023-11-04T01:39:31.572768+0000","last_fullsized":"2023-11-04T01:39:31.572768+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:32:48.588740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577533+0000","last_change":"2023-11-04T01:39:30.582169+0000","last_active":"2023-11-04T01:39:31.577533+0000","last_peered":"2023-11-04T01:39:31.577533+0000","last_clean":"2023-11-04T01:39:31.577533+0000","last_became_active":"2023-11-04T01:39:30.581958+0000","last_became_peered":"2023-11-04T01:39:30.581958+0000","last_unstale":"2023-11-04T01:39:31.577533+0000","last_undegraded":"2023-11-04T01:39:31.577533+0000","last_fullsized":"2023-11-04T01:39:31.577533+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:31.706032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.579974+0000","last_change":"2023-11-04T01:39:30.576736+0000","last_active":"2023-11-04T01:39:30.579974+0000","last_peered":"2023-11-04T01:39:30.579974+0000","last_clean":"2023-11-04T01:39:30.579974+0000","last_became_active":"2023-11-04T01:39:30.576483+0000","last_became_peered":"2023-11-04T01:39:30.576483+0000","last_unstale":"2023-11-04T01:39:30.579974+0000","last_undegraded":"2023-11-04T01:39:30.579974+0000","last_fullsized":"2023-11-04T01:39:30.579974+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:25.110950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572128+0000","last_change":"2023-11-04T01:39:30.578531+0000","last_active":"2023-11-04T01:39:31.572128+0000","last_peered":"2023-11-04T01:39:31.572128+0000","last_clean":"2023-11-04T01:39:31.572128+0000","last_became_active":"2023-11-04T01:39:30.578245+0000","last_became_peered":"2023-11-04T01:39:30.578245+0000","last_unstale":"2023-11-04T01:39:31.572128+0000","last_undegraded":"2023-11-04T01:39:31.572128+0000","last_fullsized":"2023-11-04T01:39:31.572128+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:19.881803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568316+0000","last_change":"2023-11-04T01:39:30.567183+0000","last_active":"2023-11-04T01:39:30.568316+0000","last_peered":"2023-11-04T01:39:30.568316+0000","last_clean":"2023-11-04T01:39:30.568316+0000","last_became_active":"2023-11-04T01:39:30.566916+0000","last_became_peered":"2023-11-04T01:39:30.566916+0000","last_unstale":"2023-11-04T01:39:30.568316+0000","last_undegraded":"2023-11-04T01:39:30.568316+0000","last_fullsized":"2023-11-04T01:39:30.568316+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:05:37.042583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.587916+0000","last_change":"2023-11-04T01:39:30.580607+0000","last_active":"2023-11-04T01:39:30.587916+0000","last_peered":"2023-11-04T01:39:30.587916+0000","last_clean":"2023-11-04T01:39:30.587916+0000","last_became_active":"2023-11-04T01:39:30.580336+0000","last_became_peered":"2023-11-04T01:39:30.580336+0000","last_unstale":"2023-11-04T01:39:30.587916+0000","last_undegraded":"2023-11-04T01:39:30.587916+0000","last_fullsized":"2023-11-04T01:39:30.587916+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:16:27.831933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.580871+0000","last_change":"2023-11-04T01:39:30.576294+0000","last_active":"2023-11-04T01:39:30.580871+0000","last_peered":"2023-11-04T01:39:30.580871+0000","last_clean":"2023-11-04T01:39:30.580871+0000","last_became_active":"2023-11-04T01:39:30.576024+0000","last_became_peered":"2023-11-04T01:39:30.576024+0000","last_unstale":"2023-11-04T01:39:30.580871+0000","last_undegraded":"2023-11-04T01:39:30.580871+0000","last_fullsized":"2023-11-04T01:39:30.580871+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:01:46.707142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.581719+0000","last_change":"2023-11-04T01:39:30.579369+0000","last_active":"2023-11-04T01:39:30.581719+0000","last_peered":"2023-11-04T01:39:30.581719+0000","last_clean":"2023-11-04T01:39:30.581719+0000","last_became_active":"2023-11-04T01:39:30.579093+0000","last_became_peered":"2023-11-04T01:39:30.579093+0000","last_unstale":"2023-11-04T01:39:30.581719+0000","last_undegraded":"2023-11-04T01:39:30.581719+0000","last_fullsized":"2023-11-04T01:39:30.581719+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:51.308463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572782+0000","last_change":"2023-11-04T01:39:30.581195+0000","last_active":"2023-11-04T01:39:31.572782+0000","last_peered":"2023-11-04T01:39:31.572782+0000","last_clean":"2023-11-04T01:39:31.572782+0000","last_became_active":"2023-11-04T01:39:30.580923+0000","last_became_peered":"2023-11-04T01:39:30.580923+0000","last_unstale":"2023-11-04T01:39:31.572782+0000","last_undegraded":"2023-11-04T01:39:31.572782+0000","last_fullsized":"2023-11-04T01:39:31.572782+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:00:49.615521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572595+0000","last_change":"2023-11-04T01:39:30.579536+0000","last_active":"2023-11-04T01:39:31.572595+0000","last_peered":"2023-11-04T01:39:31.572595+0000","last_clean":"2023-11-04T01:39:31.572595+0000","last_became_active":"2023-11-04T01:39:30.579253+0000","last_became_peered":"2023-11-04T01:39:30.579253+0000","last_unstale":"2023-11-04T01:39:31.572595+0000","last_undegraded":"2023-11-04T01:39:31.572595+0000","last_fullsized":"2023-11-04T01:39:31.572595+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:52:22.129094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577618+0000","last_change":"2023-11-04T01:39:30.572555+0000","last_active":"2023-11-04T01:39:31.577618+0000","last_peered":"2023-11-04T01:39:31.577618+0000","last_clean":"2023-11-04T01:39:31.577618+0000","last_became_active":"2023-11-04T01:39:30.572085+0000","last_became_peered":"2023-11-04T01:39:30.572085+0000","last_unstale":"2023-11-04T01:39:31.577618+0000","last_undegraded":"2023-11-04T01:39:31.577618+0000","last_fullsized":"2023-11-04T01:39:31.577618+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:44.642753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572197+0000","last_change":"2023-11-04T01:39:30.577804+0000","last_active":"2023-11-04T01:39:31.572197+0000","last_peered":"2023-11-04T01:39:31.572197+0000","last_clean":"2023-11-04T01:39:31.572197+0000","last_became_active":"2023-11-04T01:39:30.571723+0000","last_became_peered":"2023-11-04T01:39:30.571723+0000","last_unstale":"2023-11-04T01:39:31.572197+0000","last_undegraded":"2023-11-04T01:39:31.572197+0000","last_fullsized":"2023-11-04T01:39:31.572197+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:05.290759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.570342+0000","last_change":"2023-11-04T01:39:30.569380+0000","last_active":"2023-11-04T01:39:30.570342+0000","last_peered":"2023-11-04T01:39:30.570342+0000","last_clean":"2023-11-04T01:39:30.570342+0000","last_became_active":"2023-11-04T01:39:30.568998+0000","last_became_peered":"2023-11-04T01:39:30.568998+0000","last_unstale":"2023-11-04T01:39:30.570342+0000","last_undegraded":"2023-11-04T01:39:30.570342+0000","last_fullsized":"2023-11-04T01:39:30.570342+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:03.210760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.581201+0000","last_change":"2023-11-04T01:39:30.578529+0000","last_active":"2023-11-04T01:39:30.581201+0000","last_peered":"2023-11-04T01:39:30.581201+0000","last_clean":"2023-11-04T01:39:30.581201+0000","last_became_active":"2023-11-04T01:39:30.578236+0000","last_became_peered":"2023-11-04T01:39:30.578236+0000","last_unstale":"2023-11-04T01:39:30.581201+0000","last_undegraded":"2023-11-04T01:39:30.581201+0000","last_fullsized":"2023-11-04T01:39:30.581201+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:31.706032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.587960+0000","last_change":"2023-11-04T01:39:30.581242+0000","last_active":"2023-11-04T01:39:30.587960+0000","last_peered":"2023-11-04T01:39:30.587960+0000","last_clean":"2023-11-04T01:39:30.587960+0000","last_became_active":"2023-11-04T01:39:30.580939+0000","last_became_peered":"2023-11-04T01:39:30.580939+0000","last_unstale":"2023-11-04T01:39:30.587960+0000","last_undegraded":"2023-11-04T01:39:30.587960+0000","last_fullsized":"2023-11-04T01:39:30.587960+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:44.347659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571619+0000","last_change":"2023-11-04T01:39:30.581106+0000","last_active":"2023-11-04T01:39:31.571619+0000","last_peered":"2023-11-04T01:39:31.571619+0000","last_clean":"2023-11-04T01:39:31.571619+0000","last_became_active":"2023-11-04T01:39:30.580616+0000","last_became_peered":"2023-11-04T01:39:30.580616+0000","last_unstale":"2023-11-04T01:39:31.571619+0000","last_undegraded":"2023-11-04T01:39:31.571619+0000","last_fullsized":"2023-11-04T01:39:31.571619+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:12.840762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577891+0000","last_change":"2023-11-04T01:39:30.572105+0000","last_active":"2023-11-04T01:39:31.577891+0000","last_peered":"2023-11-04T01:39:31.577891+0000","last_clean":"2023-11-04T01:39:31.577891+0000","last_became_active":"2023-11-04T01:39:30.571824+0000","last_became_peered":"2023-11-04T01:39:30.571824+0000","last_unstale":"2023-11-04T01:39:31.577891+0000","last_undegraded":"2023-11-04T01:39:31.577891+0000","last_fullsized":"2023-11-04T01:39:31.577891+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:03.210760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578222+0000","last_change":"2023-11-04T01:39:30.570102+0000","last_active":"2023-11-04T01:39:31.578222+0000","last_peered":"2023-11-04T01:39:31.578222+0000","last_clean":"2023-11-04T01:39:31.578222+0000","last_became_active":"2023-11-04T01:39:30.569836+0000","last_became_peered":"2023-11-04T01:39:30.569836+0000","last_unstale":"2023-11-04T01:39:31.578222+0000","last_undegraded":"2023-11-04T01:39:31.578222+0000","last_fullsized":"2023-11-04T01:39:31.578222+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:40:14.060014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.570316+0000","last_change":"2023-11-04T01:39:30.569375+0000","last_active":"2023-11-04T01:39:30.570316+0000","last_peered":"2023-11-04T01:39:30.570316+0000","last_clean":"2023-11-04T01:39:30.570316+0000","last_became_active":"2023-11-04T01:39:30.568698+0000","last_became_peered":"2023-11-04T01:39:30.568698+0000","last_unstale":"2023-11-04T01:39:30.570316+0000","last_undegraded":"2023-11-04T01:39:30.570316+0000","last_fullsized":"2023-11-04T01:39:30.570316+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:01.522652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577485+0000","last_change":"2023-11-04T01:39:30.574949+0000","last_active":"2023-11-04T01:39:31.577485+0000","last_peered":"2023-11-04T01:39:31.577485+0000","last_clean":"2023-11-04T01:39:31.577485+0000","last_became_active":"2023-11-04T01:39:30.574639+0000","last_became_peered":"2023-11-04T01:39:30.574639+0000","last_unstale":"2023-11-04T01:39:31.577485+0000","last_undegraded":"2023-11-04T01:39:31.577485+0000","last_fullsized":"2023-11-04T01:39:31.577485+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:51.308463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577945+0000","last_change":"2023-11-04T01:39:30.567683+0000","last_active":"2023-11-04T01:39:31.577945+0000","last_peered":"2023-11-04T01:39:31.577945+0000","last_clean":"2023-11-04T01:39:31.577945+0000","last_became_active":"2023-11-04T01:39:30.567378+0000","last_became_peered":"2023-11-04T01:39:30.567378+0000","last_unstale":"2023-11-04T01:39:31.577945+0000","last_undegraded":"2023-11-04T01:39:31.577945+0000","last_fullsized":"2023-11-04T01:39:31.577945+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:43:20.772009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.578962+0000","last_change":"2023-11-04T01:39:30.572757+0000","last_active":"2023-11-04T01:39:30.578962+0000","last_peered":"2023-11-04T01:39:30.578962+0000","last_clean":"2023-11-04T01:39:30.578962+0000","last_became_active":"2023-11-04T01:39:30.572465+0000","last_became_peered":"2023-11-04T01:39:30.572465+0000","last_unstale":"2023-11-04T01:39:30.578962+0000","last_undegraded":"2023-11-04T01:39:30.578962+0000","last_fullsized":"2023-11-04T01:39:30.578962+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:25.110950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577114+0000","last_change":"2023-11-04T01:39:30.575856+0000","last_active":"2023-11-04T01:39:31.577114+0000","last_peered":"2023-11-04T01:39:31.577114+0000","last_clean":"2023-11-04T01:39:31.577114+0000","last_became_active":"2023-11-04T01:39:30.575589+0000","last_became_peered":"2023-11-04T01:39:30.575589+0000","last_unstale":"2023-11-04T01:39:31.577114+0000","last_undegraded":"2023-11-04T01:39:31.577114+0000","last_fullsized":"2023-11-04T01:39:31.577114+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:53:22.128780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.578675+0000","last_change":"2023-11-04T01:39:30.569749+0000","last_active":"2023-11-04T01:39:30.578675+0000","last_peered":"2023-11-04T01:39:30.578675+0000","last_clean":"2023-11-04T01:39:30.578675+0000","last_became_active":"2023-11-04T01:39:30.569469+0000","last_became_peered":"2023-11-04T01:39:30.569469+0000","last_unstale":"2023-11-04T01:39:30.578675+0000","last_undegraded":"2023-11-04T01:39:30.578675+0000","last_fullsized":"2023-11-04T01:39:30.578675+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:03.210760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578403+0000","last_change":"2023-11-04T01:39:30.571477+0000","last_active":"2023-11-04T01:39:31.578403+0000","last_peered":"2023-11-04T01:39:31.578403+0000","last_clean":"2023-11-04T01:39:31.578403+0000","last_became_active":"2023-11-04T01:39:30.571210+0000","last_became_peered":"2023-11-04T01:39:30.571210+0000","last_unstale":"2023-11-04T01:39:31.578403+0000","last_undegraded":"2023-11-04T01:39:31.578403+0000","last_fullsized":"2023-11-04T01:39:31.578403+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:35.599627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572624+0000","last_change":"2023-11-04T01:39:30.586198+0000","last_active":"2023-11-04T01:39:31.572624+0000","last_peered":"2023-11-04T01:39:31.572624+0000","last_clean":"2023-11-04T01:39:31.572624+0000","last_became_active":"2023-11-04T01:39:30.585875+0000","last_became_peered":"2023-11-04T01:39:30.585875+0000","last_unstale":"2023-11-04T01:39:31.572624+0000","last_undegraded":"2023-11-04T01:39:31.572624+0000","last_fullsized":"2023-11-04T01:39:31.572624+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:02:14.968027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.593142+0000","last_change":"2023-11-04T01:39:30.590435+0000","last_active":"2023-11-04T01:39:30.593142+0000","last_peered":"2023-11-04T01:39:30.593142+0000","last_clean":"2023-11-04T01:39:30.593142+0000","last_became_active":"2023-11-04T01:39:30.590094+0000","last_became_peered":"2023-11-04T01:39:30.590094+0000","last_unstale":"2023-11-04T01:39:30.593142+0000","last_undegraded":"2023-11-04T01:39:30.593142+0000","last_fullsized":"2023-11-04T01:39:30.593142+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:49.903966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.578732+0000","last_change":"2023-11-04T01:39:30.572507+0000","last_active":"2023-11-04T01:39:30.578732+0000","last_peered":"2023-11-04T01:39:30.578732+0000","last_clean":"2023-11-04T01:39:30.578732+0000","last_became_active":"2023-11-04T01:39:30.572204+0000","last_became_peered":"2023-11-04T01:39:30.572204+0000","last_unstale":"2023-11-04T01:39:30.578732+0000","last_undegraded":"2023-11-04T01:39:30.578732+0000","last_fullsized":"2023-11-04T01:39:30.578732+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:31.247096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577970+0000","last_change":"2023-11-04T01:39:30.575457+0000","last_active":"2023-11-04T01:39:31.577970+0000","last_peered":"2023-11-04T01:39:31.577970+0000","last_clean":"2023-11-04T01:39:31.577970+0000","last_became_active":"2023-11-04T01:39:30.575146+0000","last_became_peered":"2023-11-04T01:39:30.575146+0000","last_unstale":"2023-11-04T01:39:31.577970+0000","last_undegraded":"2023-11-04T01:39:31.577970+0000","last_fullsized":"2023-11-04T01:39:31.577970+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:31:15.596258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.581289+0000","last_change":"2023-11-04T01:39:30.578080+0000","last_active":"2023-11-04T01:39:30.581289+0000","last_peered":"2023-11-04T01:39:30.581289+0000","last_clean":"2023-11-04T01:39:30.581289+0000","last_became_active":"2023-11-04T01:39:30.577777+0000","last_became_peered":"2023-11-04T01:39:30.577777+0000","last_unstale":"2023-11-04T01:39:30.581289+0000","last_undegraded":"2023-11-04T01:39:30.581289+0000","last_fullsized":"2023-11-04T01:39:30.581289+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:07.980448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571680+0000","last_change":"2023-11-04T01:39:30.577308+0000","last_active":"2023-11-04T01:39:31.571680+0000","last_peered":"2023-11-04T01:39:31.571680+0000","last_clean":"2023-11-04T01:39:31.571680+0000","last_became_active":"2023-11-04T01:39:30.573415+0000","last_became_peered":"2023-11-04T01:39:30.573415+0000","last_unstale":"2023-11-04T01:39:31.571680+0000","last_undegraded":"2023-11-04T01:39:31.571680+0000","last_fullsized":"2023-11-04T01:39:31.571680+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:20.933186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.587885+0000","last_change":"2023-11-04T01:39:30.580310+0000","last_active":"2023-11-04T01:39:30.587885+0000","last_peered":"2023-11-04T01:39:30.587885+0000","last_clean":"2023-11-04T01:39:30.587885+0000","last_became_active":"2023-11-04T01:39:30.578604+0000","last_became_peered":"2023-11-04T01:39:30.578604+0000","last_unstale":"2023-11-04T01:39:30.587885+0000","last_undegraded":"2023-11-04T01:39:30.587885+0000","last_fullsized":"2023-11-04T01:39:30.587885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:41.422338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571905+0000","last_change":"2023-11-04T01:39:30.573065+0000","last_active":"2023-11-04T01:39:31.571905+0000","last_peered":"2023-11-04T01:39:31.571905+0000","last_clean":"2023-11-04T01:39:31.571905+0000","last_became_active":"2023-11-04T01:39:30.572486+0000","last_became_peered":"2023-11-04T01:39:30.572486+0000","last_unstale":"2023-11-04T01:39:31.571905+0000","last_undegraded":"2023-11-04T01:39:31.571905+0000","last_fullsized":"2023-11-04T01:39:31.571905+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:19.551093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.559229+0000","last_change":"2023-11-04T01:39:29.546066+0000","last_active":"2023-11-04T01:39:30.559229+0000","last_peered":"2023-11-04T01:39:30.559229+0000","last_clean":"2023-11-04T01:39:30.559229+0000","last_became_active":"2023-11-04T01:39:29.545797+0000","last_became_peered":"2023-11-04T01:39:29.545797+0000","last_unstale":"2023-11-04T01:39:30.559229+0000","last_undegraded":"2023-11-04T01:39:30.559229+0000","last_fullsized":"2023-11-04T01:39:30.559229+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:55:12.450290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534284+0000","last_change":"2023-11-04T01:38:37.214290+0000","last_active":"2023-11-04T01:39:29.534284+0000","last_peered":"2023-11-04T01:39:29.534284+0000","last_clean":"2023-11-04T01:39:29.534284+0000","last_became_active":"2023-11-04T01:38:37.213993+0000","last_became_peered":"2023-11-04T01:38:37.213993+0000","last_unstale":"2023-11-04T01:39:29.534284+0000","last_undegraded":"2023-11-04T01:39:29.534284+0000","last_fullsized":"2023-11-04T01:39:29.534284+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:15:54.258509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.565552+0000","last_change":"2023-11-04T01:38:38.208281+0000","last_active":"2023-11-04T01:39:30.565552+0000","last_peered":"2023-11-04T01:39:30.565552+0000","last_clean":"2023-11-04T01:39:30.565552+0000","last_became_active":"2023-11-04T01:38:36.209307+0000","last_became_peered":"2023-11-04T01:38:36.209307+0000","last_unstale":"2023-11-04T01:39:30.565552+0000","last_undegraded":"2023-11-04T01:39:30.565552+0000","last_fullsized":"2023-11-04T01:39:30.565552+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:15:53.251943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072090299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534466+0000","last_change":"2023-11-04T01:37:36.221026+0000","last_active":"2023-11-04T01:39:29.534466+0000","last_peered":"2023-11-04T01:39:29.534466+0000","last_clean":"2023-11-04T01:39:29.534466+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:39:29.534466+0000","last_undegraded":"2023-11-04T01:39:29.534466+0000","last_fullsized":"2023-11-04T01:39:29.534466+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067716399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.570392+0000","last_change":"2023-11-04T01:39:30.569449+0000","last_active":"2023-11-04T01:39:30.570392+0000","last_peered":"2023-11-04T01:39:30.570392+0000","last_clean":"2023-11-04T01:39:30.570392+0000","last_became_active":"2023-11-04T01:39:30.569164+0000","last_became_peered":"2023-11-04T01:39:30.569164+0000","last_unstale":"2023-11-04T01:39:30.570392+0000","last_undegraded":"2023-11-04T01:39:30.570392+0000","last_fullsized":"2023-11-04T01:39:30.570392+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:44.642753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.591502+0000","last_change":"2023-11-04T01:39:29.545417+0000","last_active":"2023-11-04T01:39:30.591502+0000","last_peered":"2023-11-04T01:39:30.591502+0000","last_clean":"2023-11-04T01:39:30.591502+0000","last_became_active":"2023-11-04T01:39:29.544550+0000","last_became_peered":"2023-11-04T01:39:29.544550+0000","last_unstale":"2023-11-04T01:39:30.591502+0000","last_undegraded":"2023-11-04T01:39:30.591502+0000","last_fullsized":"2023-11-04T01:39:30.591502+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:04.396307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533198+0000","last_change":"2023-11-04T01:38:37.212669+0000","last_active":"2023-11-04T01:39:29.533198+0000","last_peered":"2023-11-04T01:39:29.533198+0000","last_clean":"2023-11-04T01:39:29.533198+0000","last_became_active":"2023-11-04T01:38:37.212373+0000","last_became_peered":"2023-11-04T01:38:37.212373+0000","last_unstale":"2023-11-04T01:39:29.533198+0000","last_undegraded":"2023-11-04T01:39:29.533198+0000","last_fullsized":"2023-11-04T01:39:29.533198+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:00.498355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568439+0000","last_change":"2023-11-04T01:38:38.208516+0000","last_active":"2023-11-04T01:39:30.568439+0000","last_peered":"2023-11-04T01:39:30.568439+0000","last_clean":"2023-11-04T01:39:30.568439+0000","last_became_active":"2023-11-04T01:38:36.216993+0000","last_became_peered":"2023-11-04T01:38:36.216993+0000","last_unstale":"2023-11-04T01:39:30.568439+0000","last_undegraded":"2023-11-04T01:39:30.568439+0000","last_fullsized":"2023-11-04T01:39:30.568439+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:26:26.339210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095343999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":58,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536757+0000","last_change":"2023-11-04T01:37:36.229027+0000","last_active":"2023-11-04T01:39:29.536757+0000","last_peered":"2023-11-04T01:39:29.536757+0000","last_clean":"2023-11-04T01:39:29.536757+0000","last_became_active":"2023-11-04T01:37:35.218342+0000","last_became_peered":"2023-11-04T01:37:35.218342+0000","last_unstale":"2023-11-04T01:39:29.536757+0000","last_undegraded":"2023-11-04T01:39:29.536757+0000","last_fullsized":"2023-11-04T01:39:29.536757+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059666400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.588268+0000","last_change":"2023-11-04T01:39:30.584324+0000","last_active":"2023-11-04T01:39:30.588268+0000","last_peered":"2023-11-04T01:39:30.588268+0000","last_clean":"2023-11-04T01:39:30.588268+0000","last_became_active":"2023-11-04T01:39:30.584046+0000","last_became_peered":"2023-11-04T01:39:30.584046+0000","last_unstale":"2023-11-04T01:39:30.588268+0000","last_undegraded":"2023-11-04T01:39:30.588268+0000","last_fullsized":"2023-11-04T01:39:30.588268+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:43:20.772009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571705+0000","last_change":"2023-11-04T01:39:29.533740+0000","last_active":"2023-11-04T01:39:31.571705+0000","last_peered":"2023-11-04T01:39:31.571705+0000","last_clean":"2023-11-04T01:39:31.571705+0000","last_became_active":"2023-11-04T01:39:29.533439+0000","last_became_peered":"2023-11-04T01:39:29.533439+0000","last_unstale":"2023-11-04T01:39:31.571705+0000","last_undegraded":"2023-11-04T01:39:31.571705+0000","last_fullsized":"2023-11-04T01:39:31.571705+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:39.309551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557514+0000","last_change":"2023-11-04T01:38:37.215194+0000","last_active":"2023-11-04T01:39:30.557514+0000","last_peered":"2023-11-04T01:39:30.557514+0000","last_clean":"2023-11-04T01:39:30.557514+0000","last_became_active":"2023-11-04T01:38:37.214889+0000","last_became_peered":"2023-11-04T01:38:37.214889+0000","last_unstale":"2023-11-04T01:39:30.557514+0000","last_undegraded":"2023-11-04T01:39:30.557514+0000","last_fullsized":"2023-11-04T01:39:30.557514+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:03:06.059941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536647+0000","last_change":"2023-11-04T01:38:38.457859+0000","last_active":"2023-11-04T01:39:29.536647+0000","last_peered":"2023-11-04T01:39:29.536647+0000","last_clean":"2023-11-04T01:39:29.536647+0000","last_became_active":"2023-11-04T01:38:36.220887+0000","last_became_peered":"2023-11-04T01:38:36.220887+0000","last_unstale":"2023-11-04T01:39:29.536647+0000","last_undegraded":"2023-11-04T01:39:29.536647+0000","last_fullsized":"2023-11-04T01:39:29.536647+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:26:26.339210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072014699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568111+0000","last_change":"2023-11-04T01:37:36.222868+0000","last_active":"2023-11-04T01:39:30.568111+0000","last_peered":"2023-11-04T01:39:30.568111+0000","last_clean":"2023-11-04T01:39:30.568111+0000","last_became_active":"2023-11-04T01:37:35.220180+0000","last_became_peered":"2023-11-04T01:37:35.220180+0000","last_unstale":"2023-11-04T01:39:30.568111+0000","last_undegraded":"2023-11-04T01:39:30.568111+0000","last_fullsized":"2023-11-04T01:39:30.568111+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001103574,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.586362+0000","last_change":"2023-11-04T01:39:30.581829+0000","last_active":"2023-11-04T01:39:30.586362+0000","last_peered":"2023-11-04T01:39:30.586362+0000","last_clean":"2023-11-04T01:39:30.586362+0000","last_became_active":"2023-11-04T01:39:30.581548+0000","last_became_peered":"2023-11-04T01:39:30.581548+0000","last_unstale":"2023-11-04T01:39:30.586362+0000","last_undegraded":"2023-11-04T01:39:30.586362+0000","last_fullsized":"2023-11-04T01:39:30.586362+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:36:29.434930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.570431+0000","last_change":"2023-11-04T01:39:29.544359+0000","last_active":"2023-11-04T01:39:30.570431+0000","last_peered":"2023-11-04T01:39:30.570431+0000","last_clean":"2023-11-04T01:39:30.570431+0000","last_became_active":"2023-11-04T01:39:29.544054+0000","last_became_peered":"2023-11-04T01:39:29.544054+0000","last_unstale":"2023-11-04T01:39:30.570431+0000","last_undegraded":"2023-11-04T01:39:30.570431+0000","last_fullsized":"2023-11-04T01:39:30.570431+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:04:05.638181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":32,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.564432+0000","last_change":"2023-11-04T01:38:37.213107+0000","last_active":"2023-11-04T01:39:30.564432+0000","last_peered":"2023-11-04T01:39:30.564432+0000","last_clean":"2023-11-04T01:39:30.564432+0000","last_became_active":"2023-11-04T01:38:37.212801+0000","last_became_peered":"2023-11-04T01:38:37.212801+0000","last_unstale":"2023-11-04T01:39:30.564432+0000","last_undegraded":"2023-11-04T01:39:30.564432+0000","last_fullsized":"2023-11-04T01:39:30.564432+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:57:14.922918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.566323+0000","last_change":"2023-11-04T01:38:38.208125+0000","last_active":"2023-11-04T01:39:30.566323+0000","last_peered":"2023-11-04T01:39:30.566323+0000","last_clean":"2023-11-04T01:39:30.566323+0000","last_became_active":"2023-11-04T01:38:36.219549+0000","last_became_peered":"2023-11-04T01:38:36.219549+0000","last_unstale":"2023-11-04T01:39:30.566323+0000","last_undegraded":"2023-11-04T01:39:30.566323+0000","last_fullsized":"2023-11-04T01:39:30.566323+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:01.357137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769686,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536311+0000","last_change":"2023-11-04T01:37:36.221053+0000","last_active":"2023-11-04T01:39:29.536311+0000","last_peered":"2023-11-04T01:39:29.536311+0000","last_clean":"2023-11-04T01:39:29.536311+0000","last_became_active":"2023-11-04T01:37:35.227176+0000","last_became_peered":"2023-11-04T01:37:35.227176+0000","last_unstale":"2023-11-04T01:39:29.536311+0000","last_undegraded":"2023-11-04T01:39:29.536311+0000","last_fullsized":"2023-11-04T01:39:29.536311+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000594178,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.593121+0000","last_change":"2023-11-04T01:39:30.590102+0000","last_active":"2023-11-04T01:39:30.593121+0000","last_peered":"2023-11-04T01:39:30.593121+0000","last_clean":"2023-11-04T01:39:30.593121+0000","last_became_active":"2023-11-04T01:39:30.589819+0000","last_became_peered":"2023-11-04T01:39:30.589819+0000","last_unstale":"2023-11-04T01:39:30.593121+0000","last_undegraded":"2023-11-04T01:39:30.593121+0000","last_fullsized":"2023-11-04T01:39:30.593121+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:06:18.586017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.580822+0000","last_change":"2023-11-04T01:39:29.541582+0000","last_active":"2023-11-04T01:39:30.580822+0000","last_peered":"2023-11-04T01:39:30.580822+0000","last_clean":"2023-11-04T01:39:30.580822+0000","last_became_active":"2023-11-04T01:39:29.541294+0000","last_became_peered":"2023-11-04T01:39:29.541294+0000","last_unstale":"2023-11-04T01:39:30.580822+0000","last_undegraded":"2023-11-04T01:39:30.580822+0000","last_fullsized":"2023-11-04T01:39:30.580822+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:28.972752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533567+0000","last_change":"2023-11-04T01:38:37.215477+0000","last_active":"2023-11-04T01:39:29.533567+0000","last_peered":"2023-11-04T01:39:29.533567+0000","last_clean":"2023-11-04T01:39:29.533567+0000","last_became_active":"2023-11-04T01:38:37.215166+0000","last_became_peered":"2023-11-04T01:38:37.215166+0000","last_unstale":"2023-11-04T01:39:29.533567+0000","last_undegraded":"2023-11-04T01:39:29.533567+0000","last_fullsized":"2023-11-04T01:39:29.533567+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:22.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533677+0000","last_change":"2023-11-04T01:38:38.636546+0000","last_active":"2023-11-04T01:39:29.533677+0000","last_peered":"2023-11-04T01:39:29.533677+0000","last_clean":"2023-11-04T01:39:29.533677+0000","last_became_active":"2023-11-04T01:38:36.224162+0000","last_became_peered":"2023-11-04T01:38:36.224162+0000","last_unstale":"2023-11-04T01:39:29.533677+0000","last_undegraded":"2023-11-04T01:39:29.533677+0000","last_fullsized":"2023-11-04T01:39:29.533677+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:17.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062552400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568569+0000","last_change":"2023-11-04T01:37:36.221842+0000","last_active":"2023-11-04T01:39:30.568569+0000","last_peered":"2023-11-04T01:39:30.568569+0000","last_clean":"2023-11-04T01:39:30.568569+0000","last_became_active":"2023-11-04T01:37:35.214305+0000","last_became_peered":"2023-11-04T01:37:35.214305+0000","last_unstale":"2023-11-04T01:39:30.568569+0000","last_undegraded":"2023-11-04T01:39:30.568569+0000","last_fullsized":"2023-11-04T01:39:30.568569+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:13:05.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014999690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.578073+0000","last_change":"2023-11-04T01:39:30.576110+0000","last_active":"2023-11-04T01:39:30.578073+0000","last_peered":"2023-11-04T01:39:30.578073+0000","last_clean":"2023-11-04T01:39:30.578073+0000","last_became_active":"2023-11-04T01:39:30.575414+0000","last_became_peered":"2023-11-04T01:39:30.575414+0000","last_unstale":"2023-11-04T01:39:30.578073+0000","last_undegraded":"2023-11-04T01:39:30.578073+0000","last_fullsized":"2023-11-04T01:39:30.578073+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:53.822192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"95'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572877+0000","last_change":"2023-11-04T01:39:29.542129+0000","last_active":"2023-11-04T01:39:31.572877+0000","last_peered":"2023-11-04T01:39:31.572877+0000","last_clean":"2023-11-04T01:39:31.572877+0000","last_became_active":"2023-11-04T01:39:29.541708+0000","last_became_peered":"2023-11-04T01:39:29.541708+0000","last_unstale":"2023-11-04T01:39:31.572877+0000","last_undegraded":"2023-11-04T01:39:31.572877+0000","last_fullsized":"2023-11-04T01:39:31.572877+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:08.542870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":32,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.567445+0000","last_change":"2023-11-04T01:38:37.216543+0000","last_active":"2023-11-04T01:39:30.567445+0000","last_peered":"2023-11-04T01:39:30.567445+0000","last_clean":"2023-11-04T01:39:30.567445+0000","last_became_active":"2023-11-04T01:38:37.216259+0000","last_became_peered":"2023-11-04T01:38:37.216259+0000","last_unstale":"2023-11-04T01:39:30.567445+0000","last_undegraded":"2023-11-04T01:39:30.567445+0000","last_fullsized":"2023-11-04T01:39:30.567445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:20.702307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534632+0000","last_change":"2023-11-04T01:38:38.205278+0000","last_active":"2023-11-04T01:39:29.534632+0000","last_peered":"2023-11-04T01:39:29.534632+0000","last_clean":"2023-11-04T01:39:29.534632+0000","last_became_active":"2023-11-04T01:38:36.220833+0000","last_became_peered":"2023-11-04T01:38:36.220833+0000","last_unstale":"2023-11-04T01:39:29.534632+0000","last_undegraded":"2023-11-04T01:39:29.534632+0000","last_fullsized":"2023-11-04T01:39:29.534632+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:26.345951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065079199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.562937+0000","last_change":"2023-11-04T01:37:36.694601+0000","last_active":"2023-11-04T01:39:30.562937+0000","last_peered":"2023-11-04T01:39:30.562937+0000","last_clean":"2023-11-04T01:39:30.562937+0000","last_became_active":"2023-11-04T01:37:35.223746+0000","last_became_peered":"2023-11-04T01:37:35.223746+0000","last_unstale":"2023-11-04T01:39:30.562937+0000","last_undegraded":"2023-11-04T01:39:30.562937+0000","last_fullsized":"2023-11-04T01:39:30.562937+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:35.960485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000555376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.579935+0000","last_change":"2023-11-04T01:39:30.572911+0000","last_active":"2023-11-04T01:39:30.579935+0000","last_peered":"2023-11-04T01:39:30.579935+0000","last_clean":"2023-11-04T01:39:30.579935+0000","last_became_active":"2023-11-04T01:39:30.572651+0000","last_became_peered":"2023-11-04T01:39:30.572651+0000","last_unstale":"2023-11-04T01:39:30.579935+0000","last_undegraded":"2023-11-04T01:39:30.579935+0000","last_fullsized":"2023-11-04T01:39:30.579935+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:37.400454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.561491+0000","last_change":"2023-11-04T01:39:29.545852+0000","last_active":"2023-11-04T01:39:30.561491+0000","last_peered":"2023-11-04T01:39:30.561491+0000","last_clean":"2023-11-04T01:39:30.561491+0000","last_became_active":"2023-11-04T01:39:29.545618+0000","last_became_peered":"2023-11-04T01:39:29.545618+0000","last_unstale":"2023-11-04T01:39:30.561491+0000","last_undegraded":"2023-11-04T01:39:30.561491+0000","last_fullsized":"2023-11-04T01:39:30.561491+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:16:26.830398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533894+0000","last_change":"2023-11-04T01:38:37.216913+0000","last_active":"2023-11-04T01:39:29.533894+0000","last_peered":"2023-11-04T01:39:29.533894+0000","last_clean":"2023-11-04T01:39:29.533894+0000","last_became_active":"2023-11-04T01:38:37.216657+0000","last_became_peered":"2023-11-04T01:38:37.216657+0000","last_unstale":"2023-11-04T01:39:29.533894+0000","last_undegraded":"2023-11-04T01:39:29.533894+0000","last_fullsized":"2023-11-04T01:39:29.533894+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:01:49.838705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.562861+0000","last_change":"2023-11-04T01:38:38.410908+0000","last_active":"2023-11-04T01:39:30.562861+0000","last_peered":"2023-11-04T01:39:30.562861+0000","last_clean":"2023-11-04T01:39:30.562861+0000","last_became_active":"2023-11-04T01:38:36.215279+0000","last_became_peered":"2023-11-04T01:38:36.215279+0000","last_unstale":"2023-11-04T01:39:30.562861+0000","last_undegraded":"2023-11-04T01:39:30.562861+0000","last_fullsized":"2023-11-04T01:39:30.562861+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:58.822427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067743000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568520+0000","last_change":"2023-11-04T01:37:36.695075+0000","last_active":"2023-11-04T01:39:30.568520+0000","last_peered":"2023-11-04T01:39:30.568520+0000","last_clean":"2023-11-04T01:39:30.568520+0000","last_became_active":"2023-11-04T01:37:35.221165+0000","last_became_peered":"2023-11-04T01:37:35.221165+0000","last_unstale":"2023-11-04T01:39:30.568520+0000","last_undegraded":"2023-11-04T01:39:30.568520+0000","last_fullsized":"2023-11-04T01:39:30.568520+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:17.958372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072817499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.579950+0000","last_change":"2023-11-04T01:39:30.575848+0000","last_active":"2023-11-04T01:39:30.579950+0000","last_peered":"2023-11-04T01:39:30.579950+0000","last_clean":"2023-11-04T01:39:30.579950+0000","last_became_active":"2023-11-04T01:39:30.575579+0000","last_became_peered":"2023-11-04T01:39:30.575579+0000","last_unstale":"2023-11-04T01:39:30.579950+0000","last_undegraded":"2023-11-04T01:39:30.579950+0000","last_fullsized":"2023-11-04T01:39:30.579950+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:31:15.596258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"95'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578456+0000","last_change":"2023-11-04T01:39:29.538688+0000","last_active":"2023-11-04T01:39:31.578456+0000","last_peered":"2023-11-04T01:39:31.578456+0000","last_clean":"2023-11-04T01:39:31.578456+0000","last_became_active":"2023-11-04T01:39:29.538406+0000","last_became_peered":"2023-11-04T01:39:29.538406+0000","last_unstale":"2023-11-04T01:39:31.578456+0000","last_undegraded":"2023-11-04T01:39:31.578456+0000","last_fullsized":"2023-11-04T01:39:31.578456+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:24.109415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533592+0000","last_change":"2023-11-04T01:38:37.216633+0000","last_active":"2023-11-04T01:39:29.533592+0000","last_peered":"2023-11-04T01:39:29.533592+0000","last_clean":"2023-11-04T01:39:29.533592+0000","last_became_active":"2023-11-04T01:38:37.216349+0000","last_became_peered":"2023-11-04T01:38:37.216349+0000","last_unstale":"2023-11-04T01:39:29.533592+0000","last_undegraded":"2023-11-04T01:39:29.533592+0000","last_fullsized":"2023-11-04T01:39:29.533592+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:39.883185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536557+0000","last_change":"2023-11-04T01:38:38.457913+0000","last_active":"2023-11-04T01:39:29.536557+0000","last_peered":"2023-11-04T01:39:29.536557+0000","last_clean":"2023-11-04T01:39:29.536557+0000","last_became_active":"2023-11-04T01:38:36.212852+0000","last_became_peered":"2023-11-04T01:38:36.212852+0000","last_unstale":"2023-11-04T01:39:29.536557+0000","last_undegraded":"2023-11-04T01:39:29.536557+0000","last_fullsized":"2023-11-04T01:39:29.536557+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:17.912252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048391299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557419+0000","last_change":"2023-11-04T01:37:36.221747+0000","last_active":"2023-11-04T01:39:30.557419+0000","last_peered":"2023-11-04T01:39:30.557419+0000","last_clean":"2023-11-04T01:39:30.557419+0000","last_became_active":"2023-11-04T01:37:35.223198+0000","last_became_peered":"2023-11-04T01:37:35.223198+0000","last_unstale":"2023-11-04T01:39:30.557419+0000","last_undegraded":"2023-11-04T01:39:30.557419+0000","last_fullsized":"2023-11-04T01:39:30.557419+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097726499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577350+0000","last_change":"2023-11-04T01:39:30.568306+0000","last_active":"2023-11-04T01:39:31.577350+0000","last_peered":"2023-11-04T01:39:31.577350+0000","last_clean":"2023-11-04T01:39:31.577350+0000","last_became_active":"2023-11-04T01:39:30.568034+0000","last_became_peered":"2023-11-04T01:39:30.568034+0000","last_unstale":"2023-11-04T01:39:31.577350+0000","last_undegraded":"2023-11-04T01:39:31.577350+0000","last_fullsized":"2023-11-04T01:39:31.577350+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:36:29.434930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577081+0000","last_change":"2023-11-04T01:39:29.538731+0000","last_active":"2023-11-04T01:39:31.577081+0000","last_peered":"2023-11-04T01:39:31.577081+0000","last_clean":"2023-11-04T01:39:31.577081+0000","last_became_active":"2023-11-04T01:39:29.538328+0000","last_became_peered":"2023-11-04T01:39:29.538328+0000","last_unstale":"2023-11-04T01:39:31.577081+0000","last_undegraded":"2023-11-04T01:39:31.577081+0000","last_fullsized":"2023-11-04T01:39:31.577081+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:46:31.287816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568030+0000","last_change":"2023-11-04T01:38:37.215329+0000","last_active":"2023-11-04T01:39:30.568030+0000","last_peered":"2023-11-04T01:39:30.568030+0000","last_clean":"2023-11-04T01:39:30.568030+0000","last_became_active":"2023-11-04T01:38:37.215049+0000","last_became_peered":"2023-11-04T01:38:37.215049+0000","last_unstale":"2023-11-04T01:39:30.568030+0000","last_undegraded":"2023-11-04T01:39:30.568030+0000","last_fullsized":"2023-11-04T01:39:30.568030+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:22.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557911+0000","last_change":"2023-11-04T01:38:38.207112+0000","last_active":"2023-11-04T01:39:30.557911+0000","last_peered":"2023-11-04T01:39:30.557911+0000","last_clean":"2023-11-04T01:39:30.557911+0000","last_became_active":"2023-11-04T01:38:36.213142+0000","last_became_peered":"2023-11-04T01:38:36.213142+0000","last_unstale":"2023-11-04T01:39:30.557911+0000","last_undegraded":"2023-11-04T01:39:30.557911+0000","last_fullsized":"2023-11-04T01:39:30.557911+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:49.027502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069641099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536742+0000","last_change":"2023-11-04T01:37:36.422496+0000","last_active":"2023-11-04T01:39:29.536742+0000","last_peered":"2023-11-04T01:39:29.536742+0000","last_clean":"2023-11-04T01:39:29.536742+0000","last_became_active":"2023-11-04T01:37:35.221763+0000","last_became_peered":"2023-11-04T01:37:35.221763+0000","last_unstale":"2023-11-04T01:39:29.536742+0000","last_undegraded":"2023-11-04T01:39:29.536742+0000","last_fullsized":"2023-11-04T01:39:29.536742+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073676299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577132+0000","last_change":"2023-11-04T01:39:30.569560+0000","last_active":"2023-11-04T01:39:31.577132+0000","last_peered":"2023-11-04T01:39:31.577132+0000","last_clean":"2023-11-04T01:39:31.577132+0000","last_became_active":"2023-11-04T01:39:30.569314+0000","last_became_peered":"2023-11-04T01:39:30.569314+0000","last_unstale":"2023-11-04T01:39:31.577132+0000","last_undegraded":"2023-11-04T01:39:31.577132+0000","last_fullsized":"2023-11-04T01:39:31.577132+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:52:54.759196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.561560+0000","last_change":"2023-11-04T01:39:29.539969+0000","last_active":"2023-11-04T01:39:30.561560+0000","last_peered":"2023-11-04T01:39:30.561560+0000","last_clean":"2023-11-04T01:39:30.561560+0000","last_became_active":"2023-11-04T01:39:29.539687+0000","last_became_peered":"2023-11-04T01:39:29.539687+0000","last_unstale":"2023-11-04T01:39:30.561560+0000","last_undegraded":"2023-11-04T01:39:30.561560+0000","last_fullsized":"2023-11-04T01:39:30.561560+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:43.346124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557816+0000","last_change":"2023-11-04T01:38:37.217518+0000","last_active":"2023-11-04T01:39:30.557816+0000","last_peered":"2023-11-04T01:39:30.557816+0000","last_clean":"2023-11-04T01:39:30.557816+0000","last_became_active":"2023-11-04T01:38:37.216984+0000","last_became_peered":"2023-11-04T01:38:37.216984+0000","last_unstale":"2023-11-04T01:39:30.557816+0000","last_undegraded":"2023-11-04T01:39:30.557816+0000","last_fullsized":"2023-11-04T01:39:30.557816+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:55.276622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.566984+0000","last_change":"2023-11-04T01:38:38.208679+0000","last_active":"2023-11-04T01:39:30.566984+0000","last_peered":"2023-11-04T01:39:30.566984+0000","last_clean":"2023-11-04T01:39:30.566984+0000","last_became_active":"2023-11-04T01:38:36.213713+0000","last_became_peered":"2023-11-04T01:38:36.213713+0000","last_unstale":"2023-11-04T01:39:30.566984+0000","last_undegraded":"2023-11-04T01:39:30.566984+0000","last_fullsized":"2023-11-04T01:39:30.566984+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:17.912252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099153900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535120+0000","last_change":"2023-11-04T01:37:36.229940+0000","last_active":"2023-11-04T01:39:29.535120+0000","last_peered":"2023-11-04T01:39:29.535120+0000","last_clean":"2023-11-04T01:39:29.535120+0000","last_became_active":"2023-11-04T01:37:35.225121+0000","last_became_peered":"2023-11-04T01:37:35.225121+0000","last_unstale":"2023-11-04T01:39:29.535120+0000","last_undegraded":"2023-11-04T01:39:29.535120+0000","last_fullsized":"2023-11-04T01:39:29.535120+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:12.130671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075648399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571752+0000","last_change":"2023-11-04T01:39:30.581872+0000","last_active":"2023-11-04T01:39:31.571752+0000","last_peered":"2023-11-04T01:39:31.571752+0000","last_clean":"2023-11-04T01:39:31.571752+0000","last_became_active":"2023-11-04T01:39:30.581588+0000","last_became_peered":"2023-11-04T01:39:30.581588+0000","last_unstale":"2023-11-04T01:39:31.571752+0000","last_undegraded":"2023-11-04T01:39:31.571752+0000","last_fullsized":"2023-11-04T01:39:31.571752+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:58.382822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571756+0000","last_change":"2023-11-04T01:39:29.535238+0000","last_active":"2023-11-04T01:39:31.571756+0000","last_peered":"2023-11-04T01:39:31.571756+0000","last_clean":"2023-11-04T01:39:31.571756+0000","last_became_active":"2023-11-04T01:39:29.534977+0000","last_became_peered":"2023-11-04T01:39:29.534977+0000","last_unstale":"2023-11-04T01:39:31.571756+0000","last_undegraded":"2023-11-04T01:39:31.571756+0000","last_fullsized":"2023-11-04T01:39:31.571756+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:36.823441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535878+0000","last_change":"2023-11-04T01:38:37.216659+0000","last_active":"2023-11-04T01:39:29.535878+0000","last_peered":"2023-11-04T01:39:29.535878+0000","last_clean":"2023-11-04T01:39:29.535878+0000","last_became_active":"2023-11-04T01:38:37.216367+0000","last_became_peered":"2023-11-04T01:38:37.216367+0000","last_unstale":"2023-11-04T01:39:29.535878+0000","last_undegraded":"2023-11-04T01:39:29.535878+0000","last_fullsized":"2023-11-04T01:39:29.535878+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:05:01.957845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.564626+0000","last_change":"2023-11-04T01:38:38.411751+0000","last_active":"2023-11-04T01:39:30.564626+0000","last_peered":"2023-11-04T01:39:30.564626+0000","last_clean":"2023-11-04T01:39:30.564626+0000","last_became_active":"2023-11-04T01:38:36.220709+0000","last_became_peered":"2023-11-04T01:38:36.220709+0000","last_unstale":"2023-11-04T01:39:30.564626+0000","last_undegraded":"2023-11-04T01:39:30.564626+0000","last_fullsized":"2023-11-04T01:39:30.564626+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:17.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075331200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535405+0000","last_change":"2023-11-04T01:37:36.422801+0000","last_active":"2023-11-04T01:39:29.535405+0000","last_peered":"2023-11-04T01:39:29.535405+0000","last_clean":"2023-11-04T01:39:29.535405+0000","last_became_active":"2023-11-04T01:37:35.217091+0000","last_became_peered":"2023-11-04T01:37:35.217091+0000","last_unstale":"2023-11-04T01:39:29.535405+0000","last_undegraded":"2023-11-04T01:39:29.535405+0000","last_fullsized":"2023-11-04T01:39:29.535405+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082211999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.577840+0000","last_change":"2023-11-04T01:39:30.570303+0000","last_active":"2023-11-04T01:39:30.577840+0000","last_peered":"2023-11-04T01:39:30.577840+0000","last_clean":"2023-11-04T01:39:30.577840+0000","last_became_active":"2023-11-04T01:39:30.570023+0000","last_became_peered":"2023-11-04T01:39:30.570023+0000","last_unstale":"2023-11-04T01:39:30.577840+0000","last_undegraded":"2023-11-04T01:39:30.577840+0000","last_fullsized":"2023-11-04T01:39:30.577840+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:40:14.060014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.558821+0000","last_change":"2023-11-04T01:39:29.546506+0000","last_active":"2023-11-04T01:39:30.558821+0000","last_peered":"2023-11-04T01:39:30.558821+0000","last_clean":"2023-11-04T01:39:30.558821+0000","last_became_active":"2023-11-04T01:39:29.546217+0000","last_became_peered":"2023-11-04T01:39:29.546217+0000","last_unstale":"2023-11-04T01:39:30.558821+0000","last_undegraded":"2023-11-04T01:39:30.558821+0000","last_fullsized":"2023-11-04T01:39:30.558821+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:28.851054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.567446+0000","last_change":"2023-11-04T01:38:37.218855+0000","last_active":"2023-11-04T01:39:30.567446+0000","last_peered":"2023-11-04T01:39:30.567446+0000","last_clean":"2023-11-04T01:39:30.567446+0000","last_became_active":"2023-11-04T01:38:37.218475+0000","last_became_peered":"2023-11-04T01:38:37.218475+0000","last_unstale":"2023-11-04T01:39:30.567446+0000","last_undegraded":"2023-11-04T01:39:30.567446+0000","last_fullsized":"2023-11-04T01:39:30.567446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:36.735726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.564699+0000","last_change":"2023-11-04T01:38:38.411851+0000","last_active":"2023-11-04T01:39:30.564699+0000","last_peered":"2023-11-04T01:39:30.564699+0000","last_clean":"2023-11-04T01:39:30.564699+0000","last_became_active":"2023-11-04T01:38:36.220767+0000","last_became_peered":"2023-11-04T01:38:36.220767+0000","last_unstale":"2023-11-04T01:39:30.564699+0000","last_undegraded":"2023-11-04T01:39:30.564699+0000","last_fullsized":"2023-11-04T01:39:30.564699+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:42.712180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010894240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557974+0000","last_change":"2023-11-04T01:37:36.222683+0000","last_active":"2023-11-04T01:39:30.557974+0000","last_peered":"2023-11-04T01:39:30.557974+0000","last_clean":"2023-11-04T01:39:30.557974+0000","last_became_active":"2023-11-04T01:37:35.222694+0000","last_became_peered":"2023-11-04T01:37:35.222694+0000","last_unstale":"2023-11-04T01:39:30.557974+0000","last_undegraded":"2023-11-04T01:39:30.557974+0000","last_fullsized":"2023-11-04T01:39:30.557974+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000490194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572906+0000","last_change":"2023-11-04T01:39:30.571231+0000","last_active":"2023-11-04T01:39:31.572906+0000","last_peered":"2023-11-04T01:39:31.572906+0000","last_clean":"2023-11-04T01:39:31.572906+0000","last_became_active":"2023-11-04T01:39:30.570955+0000","last_became_peered":"2023-11-04T01:39:30.570955+0000","last_unstale":"2023-11-04T01:39:31.572906+0000","last_undegraded":"2023-11-04T01:39:31.572906+0000","last_fullsized":"2023-11-04T01:39:31.572906+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:16:24.560163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578449+0000","last_change":"2023-11-04T01:39:29.543347+0000","last_active":"2023-11-04T01:39:31.578449+0000","last_peered":"2023-11-04T01:39:31.578449+0000","last_clean":"2023-11-04T01:39:31.578449+0000","last_became_active":"2023-11-04T01:39:29.542884+0000","last_became_peered":"2023-11-04T01:39:29.542884+0000","last_unstale":"2023-11-04T01:39:31.578449+0000","last_undegraded":"2023-11-04T01:39:31.578449+0000","last_fullsized":"2023-11-04T01:39:31.578449+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:00.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557449+0000","last_change":"2023-11-04T01:38:37.210833+0000","last_active":"2023-11-04T01:39:30.557449+0000","last_peered":"2023-11-04T01:39:30.557449+0000","last_clean":"2023-11-04T01:39:30.557449+0000","last_became_active":"2023-11-04T01:38:37.210565+0000","last_became_peered":"2023-11-04T01:38:37.210565+0000","last_unstale":"2023-11-04T01:39:30.557449+0000","last_undegraded":"2023-11-04T01:39:30.557449+0000","last_fullsized":"2023-11-04T01:39:30.557449+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:14:41.863734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557335+0000","last_change":"2023-11-04T01:38:38.206088+0000","last_active":"2023-11-04T01:39:30.557335+0000","last_peered":"2023-11-04T01:39:30.557335+0000","last_clean":"2023-11-04T01:39:30.557335+0000","last_became_active":"2023-11-04T01:38:36.220921+0000","last_became_peered":"2023-11-04T01:38:36.220921+0000","last_unstale":"2023-11-04T01:39:30.557335+0000","last_undegraded":"2023-11-04T01:39:30.557335+0000","last_fullsized":"2023-11-04T01:39:30.557335+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:33.216936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091997800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.532770+0000","last_change":"2023-11-04T01:37:36.422156+0000","last_active":"2023-11-04T01:39:29.532770+0000","last_peered":"2023-11-04T01:39:29.532770+0000","last_clean":"2023-11-04T01:39:29.532770+0000","last_became_active":"2023-11-04T01:37:35.214925+0000","last_became_peered":"2023-11-04T01:37:35.214925+0000","last_unstale":"2023-11-04T01:39:29.532770+0000","last_undegraded":"2023-11-04T01:39:29.532770+0000","last_fullsized":"2023-11-04T01:39:29.532770+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058029000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578100+0000","last_change":"2023-11-04T01:39:30.587498+0000","last_active":"2023-11-04T01:39:31.578100+0000","last_peered":"2023-11-04T01:39:31.578100+0000","last_clean":"2023-11-04T01:39:31.578100+0000","last_became_active":"2023-11-04T01:39:30.587180+0000","last_became_peered":"2023-11-04T01:39:30.587180+0000","last_unstale":"2023-11-04T01:39:31.578100+0000","last_undegraded":"2023-11-04T01:39:31.578100+0000","last_fullsized":"2023-11-04T01:39:31.578100+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:37.400454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.589771+0000","last_change":"2023-11-04T01:39:29.543373+0000","last_active":"2023-11-04T01:39:30.589771+0000","last_peered":"2023-11-04T01:39:30.589771+0000","last_clean":"2023-11-04T01:39:30.589771+0000","last_became_active":"2023-11-04T01:39:29.543104+0000","last_became_peered":"2023-11-04T01:39:29.543104+0000","last_unstale":"2023-11-04T01:39:30.589771+0000","last_undegraded":"2023-11-04T01:39:30.589771+0000","last_fullsized":"2023-11-04T01:39:30.589771+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:01.229091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533914+0000","last_change":"2023-11-04T01:38:37.217048+0000","last_active":"2023-11-04T01:39:29.533914+0000","last_peered":"2023-11-04T01:39:29.533914+0000","last_clean":"2023-11-04T01:39:29.533914+0000","last_became_active":"2023-11-04T01:38:37.216763+0000","last_became_peered":"2023-11-04T01:38:37.216763+0000","last_unstale":"2023-11-04T01:39:29.533914+0000","last_undegraded":"2023-11-04T01:39:29.533914+0000","last_fullsized":"2023-11-04T01:39:29.533914+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:59.011790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557541+0000","last_change":"2023-11-04T01:38:38.206767+0000","last_active":"2023-11-04T01:39:30.557541+0000","last_peered":"2023-11-04T01:39:30.557541+0000","last_clean":"2023-11-04T01:39:30.557541+0000","last_became_active":"2023-11-04T01:38:36.221413+0000","last_became_peered":"2023-11-04T01:38:36.221413+0000","last_unstale":"2023-11-04T01:39:30.557541+0000","last_undegraded":"2023-11-04T01:39:30.557541+0000","last_fullsized":"2023-11-04T01:39:30.557541+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:08.788172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000941179,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536042+0000","last_change":"2023-11-04T01:37:36.229258+0000","last_active":"2023-11-04T01:39:29.536042+0000","last_peered":"2023-11-04T01:39:29.536042+0000","last_clean":"2023-11-04T01:39:29.536042+0000","last_became_active":"2023-11-04T01:37:35.221720+0000","last_became_peered":"2023-11-04T01:37:35.221720+0000","last_unstale":"2023-11-04T01:39:29.536042+0000","last_undegraded":"2023-11-04T01:39:29.536042+0000","last_fullsized":"2023-11-04T01:39:29.536042+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:09.633236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068644799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578342+0000","last_change":"2023-11-04T01:39:30.587310+0000","last_active":"2023-11-04T01:39:31.578342+0000","last_peered":"2023-11-04T01:39:31.578342+0000","last_clean":"2023-11-04T01:39:31.578342+0000","last_became_active":"2023-11-04T01:39:30.587047+0000","last_became_peered":"2023-11-04T01:39:30.587047+0000","last_unstale":"2023-11-04T01:39:31.578342+0000","last_undegraded":"2023-11-04T01:39:31.578342+0000","last_fullsized":"2023-11-04T01:39:31.578342+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:02.230626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.556775+0000","last_change":"2023-11-04T01:39:29.547432+0000","last_active":"2023-11-04T01:39:30.556775+0000","last_peered":"2023-11-04T01:39:30.556775+0000","last_clean":"2023-11-04T01:39:30.556775+0000","last_became_active":"2023-11-04T01:39:29.546379+0000","last_became_peered":"2023-11-04T01:39:29.546379+0000","last_unstale":"2023-11-04T01:39:30.556775+0000","last_undegraded":"2023-11-04T01:39:30.556775+0000","last_fullsized":"2023-11-04T01:39:30.556775+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:00.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535445+0000","last_change":"2023-11-04T01:38:37.214917+0000","last_active":"2023-11-04T01:39:29.535445+0000","last_peered":"2023-11-04T01:39:29.535445+0000","last_clean":"2023-11-04T01:39:29.535445+0000","last_became_active":"2023-11-04T01:38:37.214649+0000","last_became_peered":"2023-11-04T01:38:37.214649+0000","last_unstale":"2023-11-04T01:39:29.535445+0000","last_undegraded":"2023-11-04T01:39:29.535445+0000","last_fullsized":"2023-11-04T01:39:29.535445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:43.122719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534326+0000","last_change":"2023-11-04T01:38:38.205229+0000","last_active":"2023-11-04T01:39:29.534326+0000","last_peered":"2023-11-04T01:39:29.534326+0000","last_clean":"2023-11-04T01:39:29.534326+0000","last_became_active":"2023-11-04T01:38:36.213122+0000","last_became_peered":"2023-11-04T01:38:36.213122+0000","last_unstale":"2023-11-04T01:39:29.534326+0000","last_undegraded":"2023-11-04T01:39:29.534326+0000","last_fullsized":"2023-11-04T01:39:29.534326+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:24.233394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000519342,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568417+0000","last_change":"2023-11-04T01:37:36.695175+0000","last_active":"2023-11-04T01:39:30.568417+0000","last_peered":"2023-11-04T01:39:30.568417+0000","last_clean":"2023-11-04T01:39:30.568417+0000","last_became_active":"2023-11-04T01:37:35.224473+0000","last_became_peered":"2023-11-04T01:37:35.224473+0000","last_unstale":"2023-11-04T01:39:30.568417+0000","last_undegraded":"2023-11-04T01:39:30.568417+0000","last_fullsized":"2023-11-04T01:39:30.568417+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065377199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572253+0000","last_change":"2023-11-04T01:39:30.582467+0000","last_active":"2023-11-04T01:39:31.572253+0000","last_peered":"2023-11-04T01:39:31.572253+0000","last_clean":"2023-11-04T01:39:31.572253+0000","last_became_active":"2023-11-04T01:39:30.582160+0000","last_became_peered":"2023-11-04T01:39:30.582160+0000","last_unstale":"2023-11-04T01:39:31.572253+0000","last_undegraded":"2023-11-04T01:39:31.572253+0000","last_fullsized":"2023-11-04T01:39:31.572253+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:25:07.765536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572531+0000","last_change":"2023-11-04T01:39:29.536547+0000","last_active":"2023-11-04T01:39:31.572531+0000","last_peered":"2023-11-04T01:39:31.572531+0000","last_clean":"2023-11-04T01:39:31.572531+0000","last_became_active":"2023-11-04T01:39:29.536239+0000","last_became_peered":"2023-11-04T01:39:29.536239+0000","last_unstale":"2023-11-04T01:39:31.572531+0000","last_undegraded":"2023-11-04T01:39:31.572531+0000","last_fullsized":"2023-11-04T01:39:31.572531+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:07.611046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534104+0000","last_change":"2023-11-04T01:38:37.214806+0000","last_active":"2023-11-04T01:39:29.534104+0000","last_peered":"2023-11-04T01:39:29.534104+0000","last_clean":"2023-11-04T01:39:29.534104+0000","last_became_active":"2023-11-04T01:38:37.214511+0000","last_became_peered":"2023-11-04T01:38:37.214511+0000","last_unstale":"2023-11-04T01:39:29.534104+0000","last_undegraded":"2023-11-04T01:39:29.534104+0000","last_fullsized":"2023-11-04T01:39:29.534104+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:48.315344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.562588+0000","last_change":"2023-11-04T01:38:38.411265+0000","last_active":"2023-11-04T01:39:30.562588+0000","last_peered":"2023-11-04T01:39:30.562588+0000","last_clean":"2023-11-04T01:39:30.562588+0000","last_became_active":"2023-11-04T01:38:36.216615+0000","last_became_peered":"2023-11-04T01:38:36.216615+0000","last_unstale":"2023-11-04T01:39:30.562588+0000","last_undegraded":"2023-11-04T01:39:30.562588+0000","last_fullsized":"2023-11-04T01:39:30.562588+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:02.794601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095689400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.565947+0000","last_change":"2023-11-04T01:37:36.222100+0000","last_active":"2023-11-04T01:39:30.565947+0000","last_peered":"2023-11-04T01:39:30.565947+0000","last_clean":"2023-11-04T01:39:30.565947+0000","last_became_active":"2023-11-04T01:37:35.219622+0000","last_became_peered":"2023-11-04T01:37:35.219622+0000","last_unstale":"2023-11-04T01:39:30.565947+0000","last_undegraded":"2023-11-04T01:39:30.565947+0000","last_fullsized":"2023-11-04T01:39:30.565947+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:16.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653496,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578238+0000","last_change":"2023-11-04T01:39:30.582221+0000","last_active":"2023-11-04T01:39:31.578238+0000","last_peered":"2023-11-04T01:39:31.578238+0000","last_clean":"2023-11-04T01:39:31.578238+0000","last_became_active":"2023-11-04T01:39:30.581939+0000","last_became_peered":"2023-11-04T01:39:30.581939+0000","last_unstale":"2023-11-04T01:39:31.578238+0000","last_undegraded":"2023-11-04T01:39:31.578238+0000","last_fullsized":"2023-11-04T01:39:31.578238+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:01.522652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.582053+0000","last_change":"2023-11-04T01:39:29.539955+0000","last_active":"2023-11-04T01:39:30.582053+0000","last_peered":"2023-11-04T01:39:30.582053+0000","last_clean":"2023-11-04T01:39:30.582053+0000","last_became_active":"2023-11-04T01:39:29.539702+0000","last_became_peered":"2023-11-04T01:39:29.539702+0000","last_unstale":"2023-11-04T01:39:30.582053+0000","last_undegraded":"2023-11-04T01:39:30.582053+0000","last_fullsized":"2023-11-04T01:39:30.582053+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:40:13.058479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535330+0000","last_change":"2023-11-04T01:38:37.217077+0000","last_active":"2023-11-04T01:39:29.535330+0000","last_peered":"2023-11-04T01:39:29.535330+0000","last_clean":"2023-11-04T01:39:29.535330+0000","last_became_active":"2023-11-04T01:38:37.216746+0000","last_became_peered":"2023-11-04T01:38:37.216746+0000","last_unstale":"2023-11-04T01:39:29.535330+0000","last_undegraded":"2023-11-04T01:39:29.535330+0000","last_fullsized":"2023-11-04T01:39:29.535330+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:59.828993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535142+0000","last_change":"2023-11-04T01:38:38.205823+0000","last_active":"2023-11-04T01:39:29.535142+0000","last_peered":"2023-11-04T01:39:29.535142+0000","last_clean":"2023-11-04T01:39:29.535142+0000","last_became_active":"2023-11-04T01:38:36.218347+0000","last_became_peered":"2023-11-04T01:38:36.218347+0000","last_unstale":"2023-11-04T01:39:29.535142+0000","last_undegraded":"2023-11-04T01:39:29.535142+0000","last_fullsized":"2023-11-04T01:39:29.535142+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:24:42.129853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042101900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.566448+0000","last_change":"2023-11-04T01:37:36.222451+0000","last_active":"2023-11-04T01:39:30.566448+0000","last_peered":"2023-11-04T01:39:30.566448+0000","last_clean":"2023-11-04T01:39:30.566448+0000","last_became_active":"2023-11-04T01:37:35.221090+0000","last_became_peered":"2023-11-04T01:37:35.221090+0000","last_unstale":"2023-11-04T01:39:30.566448+0000","last_undegraded":"2023-11-04T01:39:30.566448+0000","last_fullsized":"2023-11-04T01:39:30.566448+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077263799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571737+0000","last_change":"2023-11-04T01:39:30.567977+0000","last_active":"2023-11-04T01:39:31.571737+0000","last_peered":"2023-11-04T01:39:31.571737+0000","last_clean":"2023-11-04T01:39:31.571737+0000","last_became_active":"2023-11-04T01:39:30.567662+0000","last_became_peered":"2023-11-04T01:39:30.567662+0000","last_unstale":"2023-11-04T01:39:31.571737+0000","last_undegraded":"2023-11-04T01:39:31.571737+0000","last_fullsized":"2023-11-04T01:39:31.571737+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:39:57.076382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.587201+0000","last_change":"2023-11-04T01:39:29.549461+0000","last_active":"2023-11-04T01:39:30.587201+0000","last_peered":"2023-11-04T01:39:30.587201+0000","last_clean":"2023-11-04T01:39:30.587201+0000","last_became_active":"2023-11-04T01:39:29.549188+0000","last_became_peered":"2023-11-04T01:39:29.549188+0000","last_unstale":"2023-11-04T01:39:30.587201+0000","last_undegraded":"2023-11-04T01:39:30.587201+0000","last_fullsized":"2023-11-04T01:39:30.587201+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:59.471990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557733+0000","last_change":"2023-11-04T01:38:37.212670+0000","last_active":"2023-11-04T01:39:30.557733+0000","last_peered":"2023-11-04T01:39:30.557733+0000","last_clean":"2023-11-04T01:39:30.557733+0000","last_became_active":"2023-11-04T01:38:37.212044+0000","last_became_peered":"2023-11-04T01:38:37.212044+0000","last_unstale":"2023-11-04T01:39:30.557733+0000","last_undegraded":"2023-11-04T01:39:30.557733+0000","last_fullsized":"2023-11-04T01:39:30.557733+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:23.460377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534871+0000","last_change":"2023-11-04T01:38:38.205885+0000","last_active":"2023-11-04T01:39:29.534871+0000","last_peered":"2023-11-04T01:39:29.534871+0000","last_clean":"2023-11-04T01:39:29.534871+0000","last_became_active":"2023-11-04T01:38:36.218439+0000","last_became_peered":"2023-11-04T01:38:36.218439+0000","last_unstale":"2023-11-04T01:39:29.534871+0000","last_undegraded":"2023-11-04T01:39:29.534871+0000","last_fullsized":"2023-11-04T01:39:29.534871+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:50.283563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039456400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.567701+0000","last_change":"2023-11-04T01:37:36.222643+0000","last_active":"2023-11-04T01:39:30.567701+0000","last_peered":"2023-11-04T01:39:30.567701+0000","last_clean":"2023-11-04T01:39:30.567701+0000","last_became_active":"2023-11-04T01:37:35.215534+0000","last_became_peered":"2023-11-04T01:37:35.215534+0000","last_unstale":"2023-11-04T01:39:30.567701+0000","last_undegraded":"2023-11-04T01:39:30.567701+0000","last_fullsized":"2023-11-04T01:39:30.567701+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011110530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.580891+0000","last_change":"2023-11-04T01:39:30.576294+0000","last_active":"2023-11-04T01:39:30.580891+0000","last_peered":"2023-11-04T01:39:30.580891+0000","last_clean":"2023-11-04T01:39:30.580891+0000","last_became_active":"2023-11-04T01:39:30.576061+0000","last_became_peered":"2023-11-04T01:39:30.576061+0000","last_unstale":"2023-11-04T01:39:30.580891+0000","last_undegraded":"2023-11-04T01:39:30.580891+0000","last_fullsized":"2023-11-04T01:39:30.580891+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:49.903966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571799+0000","last_change":"2023-11-04T01:39:29.539024+0000","last_active":"2023-11-04T01:39:31.571799+0000","last_peered":"2023-11-04T01:39:31.571799+0000","last_clean":"2023-11-04T01:39:31.571799+0000","last_became_active":"2023-11-04T01:39:29.538758+0000","last_became_peered":"2023-11-04T01:39:29.538758+0000","last_unstale":"2023-11-04T01:39:31.571799+0000","last_undegraded":"2023-11-04T01:39:31.571799+0000","last_fullsized":"2023-11-04T01:39:31.571799+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:25:55.522457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557588+0000","last_change":"2023-11-04T01:38:37.214797+0000","last_active":"2023-11-04T01:39:30.557588+0000","last_peered":"2023-11-04T01:39:30.557588+0000","last_clean":"2023-11-04T01:39:30.557588+0000","last_became_active":"2023-11-04T01:38:37.214465+0000","last_became_peered":"2023-11-04T01:38:37.214465+0000","last_unstale":"2023-11-04T01:39:30.557588+0000","last_undegraded":"2023-11-04T01:39:30.557588+0000","last_fullsized":"2023-11-04T01:39:30.557588+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:36.735726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.567543+0000","last_change":"2023-11-04T01:38:38.207798+0000","last_active":"2023-11-04T01:39:30.567543+0000","last_peered":"2023-11-04T01:39:30.567543+0000","last_clean":"2023-11-04T01:39:30.567543+0000","last_became_active":"2023-11-04T01:38:36.213815+0000","last_became_peered":"2023-11-04T01:38:36.213815+0000","last_unstale":"2023-11-04T01:39:30.567543+0000","last_undegraded":"2023-11-04T01:39:30.567543+0000","last_fullsized":"2023-11-04T01:39:30.567543+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:54.270056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092951700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.572397+0000","last_change":"2023-11-04T01:37:36.695402+0000","last_active":"2023-11-04T01:39:30.572397+0000","last_peered":"2023-11-04T01:39:30.572397+0000","last_clean":"2023-11-04T01:39:30.572397+0000","last_became_active":"2023-11-04T01:37:35.220346+0000","last_became_peered":"2023-11-04T01:37:35.220346+0000","last_unstale":"2023-11-04T01:39:30.572397+0000","last_undegraded":"2023-11-04T01:39:30.572397+0000","last_fullsized":"2023-11-04T01:39:30.572397+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062230100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571664+0000","last_change":"2023-11-04T01:39:30.579031+0000","last_active":"2023-11-04T01:39:31.571664+0000","last_peered":"2023-11-04T01:39:31.571664+0000","last_clean":"2023-11-04T01:39:31.571664+0000","last_became_active":"2023-11-04T01:39:30.578754+0000","last_became_peered":"2023-11-04T01:39:30.578754+0000","last_unstale":"2023-11-04T01:39:31.571664+0000","last_undegraded":"2023-11-04T01:39:31.571664+0000","last_fullsized":"2023-11-04T01:39:31.571664+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:39.952106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577067+0000","last_change":"2023-11-04T01:39:29.541705+0000","last_active":"2023-11-04T01:39:31.577067+0000","last_peered":"2023-11-04T01:39:31.577067+0000","last_clean":"2023-11-04T01:39:31.577067+0000","last_became_active":"2023-11-04T01:39:29.541422+0000","last_became_peered":"2023-11-04T01:39:29.541422+0000","last_unstale":"2023-11-04T01:39:31.577067+0000","last_undegraded":"2023-11-04T01:39:31.577067+0000","last_fullsized":"2023-11-04T01:39:31.577067+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:07.088325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.567618+0000","last_change":"2023-11-04T01:38:37.216420+0000","last_active":"2023-11-04T01:39:30.567618+0000","last_peered":"2023-11-04T01:39:30.567618+0000","last_clean":"2023-11-04T01:39:30.567618+0000","last_became_active":"2023-11-04T01:38:37.216145+0000","last_became_peered":"2023-11-04T01:38:37.216145+0000","last_unstale":"2023-11-04T01:39:30.567618+0000","last_undegraded":"2023-11-04T01:39:30.567618+0000","last_fullsized":"2023-11-04T01:39:30.567618+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:19.049672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.566257+0000","last_change":"2023-11-04T01:38:38.207981+0000","last_active":"2023-11-04T01:39:30.566257+0000","last_peered":"2023-11-04T01:39:30.566257+0000","last_clean":"2023-11-04T01:39:30.566257+0000","last_became_active":"2023-11-04T01:38:36.213518+0000","last_became_peered":"2023-11-04T01:38:36.213518+0000","last_unstale":"2023-11-04T01:39:30.566257+0000","last_undegraded":"2023-11-04T01:39:30.566257+0000","last_fullsized":"2023-11-04T01:39:30.566257+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:20.114870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000824821,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":66,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.540923+0000","last_change":"2023-11-04T01:37:36.426315+0000","last_active":"2023-11-04T01:39:29.540923+0000","last_peered":"2023-11-04T01:39:29.540923+0000","last_clean":"2023-11-04T01:39:29.540923+0000","last_became_active":"2023-11-04T01:37:35.223958+0000","last_became_peered":"2023-11-04T01:37:35.223958+0000","last_unstale":"2023-11-04T01:39:29.540923+0000","last_undegraded":"2023-11-04T01:39:29.540923+0000","last_fullsized":"2023-11-04T01:39:29.540923+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:46.733116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025167400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578937+0000","last_change":"2023-11-04T01:39:30.578518+0000","last_active":"2023-11-04T01:39:31.578937+0000","last_peered":"2023-11-04T01:39:31.578937+0000","last_clean":"2023-11-04T01:39:31.578937+0000","last_became_active":"2023-11-04T01:39:30.578240+0000","last_became_peered":"2023-11-04T01:39:30.578240+0000","last_unstale":"2023-11-04T01:39:31.578937+0000","last_undegraded":"2023-11-04T01:39:31.578937+0000","last_fullsized":"2023-11-04T01:39:31.578937+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:31.247096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.581103+0000","last_change":"2023-11-04T01:39:29.541937+0000","last_active":"2023-11-04T01:39:30.581103+0000","last_peered":"2023-11-04T01:39:30.581103+0000","last_clean":"2023-11-04T01:39:30.581103+0000","last_became_active":"2023-11-04T01:39:29.541613+0000","last_became_peered":"2023-11-04T01:39:29.541613+0000","last_unstale":"2023-11-04T01:39:30.581103+0000","last_undegraded":"2023-11-04T01:39:30.581103+0000","last_fullsized":"2023-11-04T01:39:30.581103+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:43:19.770473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":32,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568321+0000","last_change":"2023-11-04T01:38:37.214483+0000","last_active":"2023-11-04T01:39:30.568321+0000","last_peered":"2023-11-04T01:39:30.568321+0000","last_clean":"2023-11-04T01:39:30.568321+0000","last_became_active":"2023-11-04T01:38:37.214116+0000","last_became_peered":"2023-11-04T01:38:37.214116+0000","last_unstale":"2023-11-04T01:39:30.568321+0000","last_undegraded":"2023-11-04T01:39:30.568321+0000","last_fullsized":"2023-11-04T01:39:30.568321+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:41:24.595793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557353+0000","last_change":"2023-11-04T01:38:38.206897+0000","last_active":"2023-11-04T01:39:30.557353+0000","last_peered":"2023-11-04T01:39:30.557353+0000","last_clean":"2023-11-04T01:39:30.557353+0000","last_became_active":"2023-11-04T01:38:36.220906+0000","last_became_peered":"2023-11-04T01:38:36.220906+0000","last_unstale":"2023-11-04T01:39:30.557353+0000","last_undegraded":"2023-11-04T01:39:30.557353+0000","last_fullsized":"2023-11-04T01:39:30.557353+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:08:23.409256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001547536,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.562756+0000","last_change":"2023-11-04T01:37:36.694540+0000","last_active":"2023-11-04T01:39:30.562756+0000","last_peered":"2023-11-04T01:39:30.562756+0000","last_clean":"2023-11-04T01:39:30.562756+0000","last_became_active":"2023-11-04T01:37:35.225863+0000","last_became_peered":"2023-11-04T01:37:35.225863+0000","last_unstale":"2023-11-04T01:39:30.562756+0000","last_undegraded":"2023-11-04T01:39:30.562756+0000","last_fullsized":"2023-11-04T01:39:30.562756+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:42.654853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042277299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.591146+0000","last_change":"2023-11-04T01:39:30.589381+0000","last_active":"2023-11-04T01:39:30.591146+0000","last_peered":"2023-11-04T01:39:30.591146+0000","last_clean":"2023-11-04T01:39:30.591146+0000","last_became_active":"2023-11-04T01:39:30.589088+0000","last_became_peered":"2023-11-04T01:39:30.589088+0000","last_unstale":"2023-11-04T01:39:30.591146+0000","last_undegraded":"2023-11-04T01:39:30.591146+0000","last_fullsized":"2023-11-04T01:39:30.591146+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:07.980448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"95'4","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.578866+0000","last_change":"2023-11-04T01:39:29.540095+0000","last_active":"2023-11-04T01:39:30.578866+0000","last_peered":"2023-11-04T01:39:30.578866+0000","last_clean":"2023-11-04T01:39:30.578866+0000","last_became_active":"2023-11-04T01:39:29.539794+0000","last_became_peered":"2023-11-04T01:39:29.539794+0000","last_unstale":"2023-11-04T01:39:30.578866+0000","last_undegraded":"2023-11-04T01:39:30.578866+0000","last_fullsized":"2023-11-04T01:39:30.578866+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:04:05.638181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.537163+0000","last_change":"2023-11-04T01:38:37.213554+0000","last_active":"2023-11-04T01:39:29.537163+0000","last_peered":"2023-11-04T01:39:29.537163+0000","last_clean":"2023-11-04T01:39:29.537163+0000","last_became_active":"2023-11-04T01:38:37.213233+0000","last_became_peered":"2023-11-04T01:38:37.213233+0000","last_unstale":"2023-11-04T01:39:29.537163+0000","last_undegraded":"2023-11-04T01:39:29.537163+0000","last_fullsized":"2023-11-04T01:39:29.537163+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:19.049672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568311+0000","last_change":"2023-11-04T01:38:38.411573+0000","last_active":"2023-11-04T01:39:30.568311+0000","last_peered":"2023-11-04T01:39:30.568311+0000","last_clean":"2023-11-04T01:39:30.568311+0000","last_became_active":"2023-11-04T01:38:36.217578+0000","last_became_peered":"2023-11-04T01:38:36.217578+0000","last_unstale":"2023-11-04T01:39:30.568311+0000","last_undegraded":"2023-11-04T01:39:30.568311+0000","last_fullsized":"2023-11-04T01:39:30.568311+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:42.116154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067089600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":66,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.538875+0000","last_change":"2023-11-04T01:37:36.426202+0000","last_active":"2023-11-04T01:39:29.538875+0000","last_peered":"2023-11-04T01:39:29.538875+0000","last_clean":"2023-11-04T01:39:29.538875+0000","last_became_active":"2023-11-04T01:37:35.222997+0000","last_became_peered":"2023-11-04T01:37:35.222997+0000","last_unstale":"2023-11-04T01:39:29.538875+0000","last_undegraded":"2023-11-04T01:39:29.538875+0000","last_fullsized":"2023-11-04T01:39:29.538875+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:18.980751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041393700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.579955+0000","last_change":"2023-11-04T01:39:30.576086+0000","last_active":"2023-11-04T01:39:30.579955+0000","last_peered":"2023-11-04T01:39:30.579955+0000","last_clean":"2023-11-04T01:39:30.579955+0000","last_became_active":"2023-11-04T01:39:30.575252+0000","last_became_peered":"2023-11-04T01:39:30.575252+0000","last_unstale":"2023-11-04T01:39:30.579955+0000","last_undegraded":"2023-11-04T01:39:30.579955+0000","last_fullsized":"2023-11-04T01:39:30.579955+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:35.599627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.588321+0000","last_change":"2023-11-04T01:39:29.548137+0000","last_active":"2023-11-04T01:39:30.588321+0000","last_peered":"2023-11-04T01:39:30.588321+0000","last_clean":"2023-11-04T01:39:30.588321+0000","last_became_active":"2023-11-04T01:39:29.547824+0000","last_became_peered":"2023-11-04T01:39:29.547824+0000","last_unstale":"2023-11-04T01:39:30.588321+0000","last_undegraded":"2023-11-04T01:39:30.588321+0000","last_fullsized":"2023-11-04T01:39:30.588321+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:58.987317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.564773+0000","last_change":"2023-11-04T01:38:37.215851+0000","last_active":"2023-11-04T01:39:30.564773+0000","last_peered":"2023-11-04T01:39:30.564773+0000","last_clean":"2023-11-04T01:39:30.564773+0000","last_became_active":"2023-11-04T01:38:37.215502+0000","last_became_peered":"2023-11-04T01:38:37.215502+0000","last_unstale":"2023-11-04T01:39:30.564773+0000","last_undegraded":"2023-11-04T01:39:30.564773+0000","last_fullsized":"2023-11-04T01:39:30.564773+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:22.227302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.556384+0000","last_change":"2023-11-04T01:38:38.206372+0000","last_active":"2023-11-04T01:39:30.556384+0000","last_peered":"2023-11-04T01:39:30.556384+0000","last_clean":"2023-11-04T01:39:30.556384+0000","last_became_active":"2023-11-04T01:38:36.211612+0000","last_became_peered":"2023-11-04T01:38:36.211612+0000","last_unstale":"2023-11-04T01:39:30.556384+0000","last_undegraded":"2023-11-04T01:39:30.556384+0000","last_fullsized":"2023-11-04T01:39:30.556384+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:35.785664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015171970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534732+0000","last_change":"2023-11-04T01:37:36.220713+0000","last_active":"2023-11-04T01:39:29.534732+0000","last_peered":"2023-11-04T01:39:29.534732+0000","last_clean":"2023-11-04T01:39:29.534732+0000","last_became_active":"2023-11-04T01:37:35.220311+0000","last_became_peered":"2023-11-04T01:37:35.220311+0000","last_unstale":"2023-11-04T01:39:29.534732+0000","last_undegraded":"2023-11-04T01:39:29.534732+0000","last_fullsized":"2023-11-04T01:39:29.534732+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062999799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.587714+0000","last_change":"2023-11-04T01:39:30.578876+0000","last_active":"2023-11-04T01:39:30.587714+0000","last_peered":"2023-11-04T01:39:30.587714+0000","last_clean":"2023-11-04T01:39:30.587714+0000","last_became_active":"2023-11-04T01:39:30.578572+0000","last_became_peered":"2023-11-04T01:39:30.578572+0000","last_unstale":"2023-11-04T01:39:30.587714+0000","last_undegraded":"2023-11-04T01:39:30.587714+0000","last_fullsized":"2023-11-04T01:39:30.587714+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:00.473526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.588604+0000","last_change":"2023-11-04T01:39:29.548234+0000","last_active":"2023-11-04T01:39:30.588604+0000","last_peered":"2023-11-04T01:39:30.588604+0000","last_clean":"2023-11-04T01:39:30.588604+0000","last_became_active":"2023-11-04T01:39:29.547923+0000","last_became_peered":"2023-11-04T01:39:29.547923+0000","last_unstale":"2023-11-04T01:39:30.588604+0000","last_undegraded":"2023-11-04T01:39:30.588604+0000","last_fullsized":"2023-11-04T01:39:30.588604+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:26.419171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534180+0000","last_change":"2023-11-04T01:38:37.216051+0000","last_active":"2023-11-04T01:39:29.534180+0000","last_peered":"2023-11-04T01:39:29.534180+0000","last_clean":"2023-11-04T01:39:29.534180+0000","last_became_active":"2023-11-04T01:38:37.215779+0000","last_became_peered":"2023-11-04T01:38:37.215779+0000","last_unstale":"2023-11-04T01:39:29.534180+0000","last_undegraded":"2023-11-04T01:39:29.534180+0000","last_fullsized":"2023-11-04T01:39:29.534180+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:38:51.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.564847+0000","last_change":"2023-11-04T01:38:38.207161+0000","last_active":"2023-11-04T01:39:30.564847+0000","last_peered":"2023-11-04T01:39:30.564847+0000","last_clean":"2023-11-04T01:39:30.564847+0000","last_became_active":"2023-11-04T01:38:36.215721+0000","last_became_peered":"2023-11-04T01:38:36.215721+0000","last_unstale":"2023-11-04T01:39:30.564847+0000","last_undegraded":"2023-11-04T01:39:30.564847+0000","last_fullsized":"2023-11-04T01:39:30.564847+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:49.027502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046667399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533875+0000","last_change":"2023-11-04T01:37:36.229580+0000","last_active":"2023-11-04T01:39:29.533875+0000","last_peered":"2023-11-04T01:39:29.533875+0000","last_clean":"2023-11-04T01:39:29.533875+0000","last_became_active":"2023-11-04T01:37:35.220940+0000","last_became_peered":"2023-11-04T01:37:35.220940+0000","last_unstale":"2023-11-04T01:39:29.533875+0000","last_undegraded":"2023-11-04T01:39:29.533875+0000","last_fullsized":"2023-11-04T01:39:29.533875+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:27.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070235600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.578631+0000","last_change":"2023-11-04T01:39:30.571831+0000","last_active":"2023-11-04T01:39:30.578631+0000","last_peered":"2023-11-04T01:39:30.578631+0000","last_clean":"2023-11-04T01:39:30.578631+0000","last_became_active":"2023-11-04T01:39:30.571107+0000","last_became_peered":"2023-11-04T01:39:30.571107+0000","last_unstale":"2023-11-04T01:39:30.578631+0000","last_undegraded":"2023-11-04T01:39:30.578631+0000","last_fullsized":"2023-11-04T01:39:30.578631+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:27.749912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578320+0000","last_change":"2023-11-04T01:39:29.541825+0000","last_active":"2023-11-04T01:39:31.578320+0000","last_peered":"2023-11-04T01:39:31.578320+0000","last_clean":"2023-11-04T01:39:31.578320+0000","last_became_active":"2023-11-04T01:39:29.541568+0000","last_became_peered":"2023-11-04T01:39:29.541568+0000","last_unstale":"2023-11-04T01:39:31.578320+0000","last_undegraded":"2023-11-04T01:39:31.578320+0000","last_fullsized":"2023-11-04T01:39:31.578320+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:34.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.567942+0000","last_change":"2023-11-04T01:38:37.214340+0000","last_active":"2023-11-04T01:39:30.567942+0000","last_peered":"2023-11-04T01:39:30.567942+0000","last_clean":"2023-11-04T01:39:30.567942+0000","last_became_active":"2023-11-04T01:38:37.214056+0000","last_became_peered":"2023-11-04T01:38:37.214056+0000","last_unstale":"2023-11-04T01:39:30.567942+0000","last_undegraded":"2023-11-04T01:39:30.567942+0000","last_fullsized":"2023-11-04T01:39:30.567942+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:38:51.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568996+0000","last_change":"2023-11-04T01:38:38.411617+0000","last_active":"2023-11-04T01:39:30.568996+0000","last_peered":"2023-11-04T01:39:30.568996+0000","last_clean":"2023-11-04T01:39:30.568996+0000","last_became_active":"2023-11-04T01:38:36.222201+0000","last_became_peered":"2023-11-04T01:38:36.222201+0000","last_unstale":"2023-11-04T01:39:30.568996+0000","last_undegraded":"2023-11-04T01:39:30.568996+0000","last_fullsized":"2023-11-04T01:39:30.568996+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:01.464511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064531400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536114+0000","last_change":"2023-11-04T01:37:36.422542+0000","last_active":"2023-11-04T01:39:29.536114+0000","last_peered":"2023-11-04T01:39:29.536114+0000","last_clean":"2023-11-04T01:39:29.536114+0000","last_became_active":"2023-11-04T01:37:35.224836+0000","last_became_peered":"2023-11-04T01:37:35.224836+0000","last_unstale":"2023-11-04T01:39:29.536114+0000","last_undegraded":"2023-11-04T01:39:29.536114+0000","last_fullsized":"2023-11-04T01:39:29.536114+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066982800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.575903+0000","last_change":"2023-11-04T01:39:30.568784+0000","last_active":"2023-11-04T01:39:30.575903+0000","last_peered":"2023-11-04T01:39:30.575903+0000","last_clean":"2023-11-04T01:39:30.575903+0000","last_became_active":"2023-11-04T01:39:30.568446+0000","last_became_peered":"2023-11-04T01:39:30.568446+0000","last_unstale":"2023-11-04T01:39:30.575903+0000","last_undegraded":"2023-11-04T01:39:30.575903+0000","last_fullsized":"2023-11-04T01:39:30.575903+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:35.599627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.588118+0000","last_change":"2023-11-04T01:39:29.538768+0000","last_active":"2023-11-04T01:39:30.588118+0000","last_peered":"2023-11-04T01:39:30.588118+0000","last_clean":"2023-11-04T01:39:30.588118+0000","last_became_active":"2023-11-04T01:39:29.538480+0000","last_became_peered":"2023-11-04T01:39:29.538480+0000","last_unstale":"2023-11-04T01:39:30.588118+0000","last_undegraded":"2023-11-04T01:39:30.588118+0000","last_fullsized":"2023-11-04T01:39:30.588118+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:38.033218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.532893+0000","last_change":"2023-11-04T01:38:37.214695+0000","last_active":"2023-11-04T01:39:29.532893+0000","last_peered":"2023-11-04T01:39:29.532893+0000","last_clean":"2023-11-04T01:39:29.532893+0000","last_became_active":"2023-11-04T01:38:37.214378+0000","last_became_peered":"2023-11-04T01:38:37.214378+0000","last_unstale":"2023-11-04T01:39:29.532893+0000","last_undegraded":"2023-11-04T01:39:29.532893+0000","last_fullsized":"2023-11-04T01:39:29.532893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:54:14.757431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.567828+0000","last_change":"2023-11-04T01:38:38.208722+0000","last_active":"2023-11-04T01:39:30.567828+0000","last_peered":"2023-11-04T01:39:30.567828+0000","last_clean":"2023-11-04T01:39:30.567828+0000","last_became_active":"2023-11-04T01:38:36.213352+0000","last_became_peered":"2023-11-04T01:38:36.213352+0000","last_unstale":"2023-11-04T01:39:30.567828+0000","last_undegraded":"2023-11-04T01:39:30.567828+0000","last_fullsized":"2023-11-04T01:39:30.567828+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:47.308778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082430899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.564714+0000","last_change":"2023-11-04T01:37:36.694868+0000","last_active":"2023-11-04T01:39:30.564714+0000","last_peered":"2023-11-04T01:39:30.564714+0000","last_clean":"2023-11-04T01:39:30.564714+0000","last_became_active":"2023-11-04T01:37:35.221181+0000","last_became_peered":"2023-11-04T01:37:35.221181+0000","last_unstale":"2023-11-04T01:39:30.564714+0000","last_undegraded":"2023-11-04T01:39:30.564714+0000","last_fullsized":"2023-11-04T01:39:30.564714+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046748800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.575898+0000","last_change":"2023-11-04T01:39:30.567036+0000","last_active":"2023-11-04T01:39:30.575898+0000","last_peered":"2023-11-04T01:39:30.575898+0000","last_clean":"2023-11-04T01:39:30.575898+0000","last_became_active":"2023-11-04T01:39:30.566748+0000","last_became_peered":"2023-11-04T01:39:30.566748+0000","last_unstale":"2023-11-04T01:39:30.575898+0000","last_undegraded":"2023-11-04T01:39:30.575898+0000","last_fullsized":"2023-11-04T01:39:30.575898+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:37.400454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"95'8","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.591054+0000","last_change":"2023-11-04T01:39:29.548402+0000","last_active":"2023-11-04T01:39:30.591054+0000","last_peered":"2023-11-04T01:39:30.591054+0000","last_clean":"2023-11-04T01:39:30.591054+0000","last_became_active":"2023-11-04T01:39:29.548105+0000","last_became_peered":"2023-11-04T01:39:29.548105+0000","last_unstale":"2023-11-04T01:39:30.591054+0000","last_undegraded":"2023-11-04T01:39:30.591054+0000","last_fullsized":"2023-11-04T01:39:30.591054+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:10.767719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557535+0000","last_change":"2023-11-04T01:38:37.213179+0000","last_active":"2023-11-04T01:39:30.557535+0000","last_peered":"2023-11-04T01:39:30.557535+0000","last_clean":"2023-11-04T01:39:30.557535+0000","last_became_active":"2023-11-04T01:38:37.212784+0000","last_became_peered":"2023-11-04T01:38:37.212784+0000","last_unstale":"2023-11-04T01:39:30.557535+0000","last_undegraded":"2023-11-04T01:39:30.557535+0000","last_fullsized":"2023-11-04T01:39:30.557535+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:22.227302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.564521+0000","last_change":"2023-11-04T01:38:38.411421+0000","last_active":"2023-11-04T01:39:30.564521+0000","last_peered":"2023-11-04T01:39:30.564521+0000","last_clean":"2023-11-04T01:39:30.564521+0000","last_became_active":"2023-11-04T01:38:36.218508+0000","last_became_peered":"2023-11-04T01:38:36.218508+0000","last_unstale":"2023-11-04T01:39:30.564521+0000","last_undegraded":"2023-11-04T01:39:30.564521+0000","last_fullsized":"2023-11-04T01:39:30.564521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:47:59.491789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085522699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568185+0000","last_change":"2023-11-04T01:37:36.222930+0000","last_active":"2023-11-04T01:39:30.568185+0000","last_peered":"2023-11-04T01:39:30.568185+0000","last_clean":"2023-11-04T01:39:30.568185+0000","last_became_active":"2023-11-04T01:37:35.220373+0000","last_became_peered":"2023-11-04T01:37:35.220373+0000","last_unstale":"2023-11-04T01:39:30.568185+0000","last_undegraded":"2023-11-04T01:39:30.568185+0000","last_fullsized":"2023-11-04T01:39:30.568185+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074099599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578859+0000","last_change":"2023-11-04T01:39:30.587377+0000","last_active":"2023-11-04T01:39:31.578859+0000","last_peered":"2023-11-04T01:39:31.578859+0000","last_clean":"2023-11-04T01:39:31.578859+0000","last_became_active":"2023-11-04T01:39:30.587083+0000","last_became_peered":"2023-11-04T01:39:30.587083+0000","last_unstale":"2023-11-04T01:39:31.578859+0000","last_undegraded":"2023-11-04T01:39:31.578859+0000","last_fullsized":"2023-11-04T01:39:31.578859+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:57.784358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557386+0000","last_change":"2023-11-04T01:39:29.544325+0000","last_active":"2023-11-04T01:39:30.557386+0000","last_peered":"2023-11-04T01:39:30.557386+0000","last_clean":"2023-11-04T01:39:30.557386+0000","last_became_active":"2023-11-04T01:39:29.544065+0000","last_became_peered":"2023-11-04T01:39:29.544065+0000","last_unstale":"2023-11-04T01:39:30.557386+0000","last_undegraded":"2023-11-04T01:39:30.557386+0000","last_fullsized":"2023-11-04T01:39:30.557386+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:56.782823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534405+0000","last_change":"2023-11-04T01:38:37.212376+0000","last_active":"2023-11-04T01:39:29.534405+0000","last_peered":"2023-11-04T01:39:29.534405+0000","last_clean":"2023-11-04T01:39:29.534405+0000","last_became_active":"2023-11-04T01:38:37.211932+0000","last_became_peered":"2023-11-04T01:38:37.211932+0000","last_unstale":"2023-11-04T01:39:29.534405+0000","last_undegraded":"2023-11-04T01:39:29.534405+0000","last_fullsized":"2023-11-04T01:39:29.534405+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:02.363703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.539695+0000","last_change":"2023-11-04T01:38:38.247627+0000","last_active":"2023-11-04T01:39:29.539695+0000","last_peered":"2023-11-04T01:39:29.539695+0000","last_clean":"2023-11-04T01:39:29.539695+0000","last_became_active":"2023-11-04T01:38:36.218231+0000","last_became_peered":"2023-11-04T01:38:36.218231+0000","last_unstale":"2023-11-04T01:39:29.539695+0000","last_undegraded":"2023-11-04T01:39:29.539695+0000","last_fullsized":"2023-11-04T01:39:29.539695+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:52.412436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010241499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557146+0000","last_change":"2023-11-04T01:37:36.221676+0000","last_active":"2023-11-04T01:39:30.557146+0000","last_peered":"2023-11-04T01:39:30.557146+0000","last_clean":"2023-11-04T01:39:30.557146+0000","last_became_active":"2023-11-04T01:37:35.226996+0000","last_became_peered":"2023-11-04T01:37:35.226996+0000","last_unstale":"2023-11-04T01:39:30.557146+0000","last_undegraded":"2023-11-04T01:39:30.557146+0000","last_fullsized":"2023-11-04T01:39:30.557146+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089115500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.581408+0000","last_change":"2023-11-04T01:39:30.579934+0000","last_active":"2023-11-04T01:39:30.581408+0000","last_peered":"2023-11-04T01:39:30.581408+0000","last_clean":"2023-11-04T01:39:30.581408+0000","last_became_active":"2023-11-04T01:39:30.579675+0000","last_became_peered":"2023-11-04T01:39:30.579675+0000","last_unstale":"2023-11-04T01:39:30.581408+0000","last_undegraded":"2023-11-04T01:39:30.581408+0000","last_fullsized":"2023-11-04T01:39:30.581408+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:39.034753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.558017+0000","last_change":"2023-11-04T01:39:29.546285+0000","last_active":"2023-11-04T01:39:30.558017+0000","last_peered":"2023-11-04T01:39:30.558017+0000","last_clean":"2023-11-04T01:39:30.558017+0000","last_became_active":"2023-11-04T01:39:29.545903+0000","last_became_peered":"2023-11-04T01:39:29.545903+0000","last_unstale":"2023-11-04T01:39:30.558017+0000","last_undegraded":"2023-11-04T01:39:30.558017+0000","last_fullsized":"2023-11-04T01:39:30.558017+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:41.708558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.539672+0000","last_change":"2023-11-04T01:38:37.212816+0000","last_active":"2023-11-04T01:39:29.539672+0000","last_peered":"2023-11-04T01:39:29.539672+0000","last_clean":"2023-11-04T01:39:29.539672+0000","last_became_active":"2023-11-04T01:38:37.212512+0000","last_became_peered":"2023-11-04T01:38:37.212512+0000","last_unstale":"2023-11-04T01:39:29.539672+0000","last_undegraded":"2023-11-04T01:39:29.539672+0000","last_fullsized":"2023-11-04T01:39:29.539672+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:07.947093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.532527+0000","last_change":"2023-11-04T01:38:38.636602+0000","last_active":"2023-11-04T01:39:29.532527+0000","last_peered":"2023-11-04T01:39:29.532527+0000","last_clean":"2023-11-04T01:39:29.532527+0000","last_became_active":"2023-11-04T01:38:36.213670+0000","last_became_peered":"2023-11-04T01:38:36.213670+0000","last_unstale":"2023-11-04T01:39:29.532527+0000","last_undegraded":"2023-11-04T01:39:29.532527+0000","last_fullsized":"2023-11-04T01:39:29.532527+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:42.712180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056085900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":58,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535904+0000","last_change":"2023-11-04T01:37:36.228535+0000","last_active":"2023-11-04T01:39:29.535904+0000","last_peered":"2023-11-04T01:39:29.535904+0000","last_clean":"2023-11-04T01:39:29.535904+0000","last_became_active":"2023-11-04T01:37:35.221173+0000","last_became_peered":"2023-11-04T01:37:35.221173+0000","last_unstale":"2023-11-04T01:39:29.535904+0000","last_undegraded":"2023-11-04T01:39:29.535904+0000","last_fullsized":"2023-11-04T01:39:29.535904+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049831099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.581335+0000","last_change":"2023-11-04T01:39:30.579519+0000","last_active":"2023-11-04T01:39:30.581335+0000","last_peered":"2023-11-04T01:39:30.581335+0000","last_clean":"2023-11-04T01:39:30.581335+0000","last_became_active":"2023-11-04T01:39:30.579250+0000","last_became_peered":"2023-11-04T01:39:30.579250+0000","last_unstale":"2023-11-04T01:39:30.581335+0000","last_undegraded":"2023-11-04T01:39:30.581335+0000","last_fullsized":"2023-11-04T01:39:30.581335+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:05.397842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"95'6","reported_seq":18,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572253+0000","last_change":"2023-11-04T01:39:29.538954+0000","last_active":"2023-11-04T01:39:31.572253+0000","last_peered":"2023-11-04T01:39:31.572253+0000","last_clean":"2023-11-04T01:39:31.572253+0000","last_became_active":"2023-11-04T01:39:29.538689+0000","last_became_peered":"2023-11-04T01:39:29.538689+0000","last_unstale":"2023-11-04T01:39:31.572253+0000","last_undegraded":"2023-11-04T01:39:31.572253+0000","last_fullsized":"2023-11-04T01:39:31.572253+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:40.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536424+0000","last_change":"2023-11-04T01:38:37.214627+0000","last_active":"2023-11-04T01:39:29.536424+0000","last_peered":"2023-11-04T01:39:29.536424+0000","last_clean":"2023-11-04T01:39:29.536424+0000","last_became_active":"2023-11-04T01:38:37.214336+0000","last_became_peered":"2023-11-04T01:38:37.214336+0000","last_unstale":"2023-11-04T01:39:29.536424+0000","last_undegraded":"2023-11-04T01:39:29.536424+0000","last_fullsized":"2023-11-04T01:39:29.536424+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:21.121436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535964+0000","last_change":"2023-11-04T01:38:38.635992+0000","last_active":"2023-11-04T01:39:29.535964+0000","last_peered":"2023-11-04T01:39:29.535964+0000","last_clean":"2023-11-04T01:39:29.535964+0000","last_became_active":"2023-11-04T01:38:36.215694+0000","last_became_peered":"2023-11-04T01:38:36.215694+0000","last_unstale":"2023-11-04T01:39:29.535964+0000","last_undegraded":"2023-11-04T01:39:29.535964+0000","last_fullsized":"2023-11-04T01:39:29.535964+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:01.464511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036495599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.532626+0000","last_change":"2023-11-04T01:37:36.229678+0000","last_active":"2023-11-04T01:39:29.532626+0000","last_peered":"2023-11-04T01:39:29.532626+0000","last_clean":"2023-11-04T01:39:29.532626+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:39:29.532626+0000","last_undegraded":"2023-11-04T01:39:29.532626+0000","last_fullsized":"2023-11-04T01:39:29.532626+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:50.484332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.577078+0000","last_change":"2023-11-04T01:39:30.566300+0000","last_active":"2023-11-04T01:39:30.577078+0000","last_peered":"2023-11-04T01:39:30.577078+0000","last_clean":"2023-11-04T01:39:30.577078+0000","last_became_active":"2023-11-04T01:39:30.565992+0000","last_became_peered":"2023-11-04T01:39:30.565992+0000","last_unstale":"2023-11-04T01:39:30.577078+0000","last_undegraded":"2023-11-04T01:39:30.577078+0000","last_fullsized":"2023-11-04T01:39:30.577078+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:51:25.094779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"95'3","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572431+0000","last_change":"2023-11-04T01:39:29.537541+0000","last_active":"2023-11-04T01:39:31.572431+0000","last_peered":"2023-11-04T01:39:31.572431+0000","last_clean":"2023-11-04T01:39:31.572431+0000","last_became_active":"2023-11-04T01:39:29.537267+0000","last_became_peered":"2023-11-04T01:39:29.537267+0000","last_unstale":"2023-11-04T01:39:31.572431+0000","last_undegraded":"2023-11-04T01:39:31.572431+0000","last_fullsized":"2023-11-04T01:39:31.572431+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:44.703854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.538712+0000","last_change":"2023-11-04T01:38:37.212620+0000","last_active":"2023-11-04T01:39:29.538712+0000","last_peered":"2023-11-04T01:39:29.538712+0000","last_clean":"2023-11-04T01:39:29.538712+0000","last_became_active":"2023-11-04T01:38:37.212294+0000","last_became_peered":"2023-11-04T01:38:37.212294+0000","last_unstale":"2023-11-04T01:39:29.538712+0000","last_undegraded":"2023-11-04T01:39:29.538712+0000","last_fullsized":"2023-11-04T01:39:29.538712+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:02.424394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.538964+0000","last_change":"2023-11-04T01:38:38.246984+0000","last_active":"2023-11-04T01:39:29.538964+0000","last_peered":"2023-11-04T01:39:29.538964+0000","last_clean":"2023-11-04T01:39:29.538964+0000","last_became_active":"2023-11-04T01:38:36.211685+0000","last_became_peered":"2023-11-04T01:38:36.211685+0000","last_unstale":"2023-11-04T01:39:29.538964+0000","last_undegraded":"2023-11-04T01:39:29.538964+0000","last_fullsized":"2023-11-04T01:39:29.538964+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:50.973560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051504199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533951+0000","last_change":"2023-11-04T01:37:36.229908+0000","last_active":"2023-11-04T01:39:29.533951+0000","last_peered":"2023-11-04T01:39:29.533951+0000","last_clean":"2023-11-04T01:39:29.533951+0000","last_became_active":"2023-11-04T01:37:35.221822+0000","last_became_peered":"2023-11-04T01:37:35.221822+0000","last_unstale":"2023-11-04T01:39:29.533951+0000","last_undegraded":"2023-11-04T01:39:29.533951+0000","last_fullsized":"2023-11-04T01:39:29.533951+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:11.866738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089270799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.578697+0000","last_change":"2023-11-04T01:39:30.570401+0000","last_active":"2023-11-04T01:39:30.578697+0000","last_peered":"2023-11-04T01:39:30.578697+0000","last_clean":"2023-11-04T01:39:30.578697+0000","last_became_active":"2023-11-04T01:39:30.570139+0000","last_became_peered":"2023-11-04T01:39:30.570139+0000","last_unstale":"2023-11-04T01:39:30.578697+0000","last_undegraded":"2023-11-04T01:39:30.578697+0000","last_fullsized":"2023-11-04T01:39:30.578697+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:31:15.596258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.566063+0000","last_change":"2023-11-04T01:39:29.543847+0000","last_active":"2023-11-04T01:39:30.566063+0000","last_peered":"2023-11-04T01:39:30.566063+0000","last_clean":"2023-11-04T01:39:30.566063+0000","last_became_active":"2023-11-04T01:39:29.543583+0000","last_became_peered":"2023-11-04T01:39:29.543583+0000","last_unstale":"2023-11-04T01:39:30.566063+0000","last_undegraded":"2023-11-04T01:39:30.566063+0000","last_fullsized":"2023-11-04T01:39:30.566063+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:54.037791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533919+0000","last_change":"2023-11-04T01:38:37.215184+0000","last_active":"2023-11-04T01:39:29.533919+0000","last_peered":"2023-11-04T01:39:29.533919+0000","last_clean":"2023-11-04T01:39:29.533919+0000","last_became_active":"2023-11-04T01:38:37.214888+0000","last_became_peered":"2023-11-04T01:38:37.214888+0000","last_unstale":"2023-11-04T01:39:29.533919+0000","last_undegraded":"2023-11-04T01:39:29.533919+0000","last_fullsized":"2023-11-04T01:39:29.533919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:34.067351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535959+0000","last_change":"2023-11-04T01:38:38.637027+0000","last_active":"2023-11-04T01:39:29.535959+0000","last_peered":"2023-11-04T01:39:29.535959+0000","last_clean":"2023-11-04T01:39:29.535959+0000","last_became_active":"2023-11-04T01:38:36.221149+0000","last_became_peered":"2023-11-04T01:38:36.221149+0000","last_unstale":"2023-11-04T01:39:29.535959+0000","last_undegraded":"2023-11-04T01:39:29.535959+0000","last_fullsized":"2023-11-04T01:39:29.535959+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:12.755546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045543500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.569131+0000","last_change":"2023-11-04T01:37:36.695345+0000","last_active":"2023-11-04T01:39:30.569131+0000","last_peered":"2023-11-04T01:39:30.569131+0000","last_clean":"2023-11-04T01:39:30.569131+0000","last_became_active":"2023-11-04T01:37:35.225441+0000","last_became_peered":"2023-11-04T01:37:35.225441+0000","last_unstale":"2023-11-04T01:39:30.569131+0000","last_undegraded":"2023-11-04T01:39:30.569131+0000","last_fullsized":"2023-11-04T01:39:30.569131+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052758199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":227,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534361+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:39:29.534361+0000","last_peered":"2023-11-04T01:39:29.534361+0000","last_clean":"2023-11-04T01:39:29.534361+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:39:29.534361+0000","last_undegraded":"2023-11-04T01:39:29.534361+0000","last_fullsized":"2023-11-04T01:39:29.534361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1773568,"data_stored":1170153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.65800000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.503,"15min":0.503},"min":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65400000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.51500000000000001},"min":{"1min":0.41199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76900000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.73899999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.39100000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72999999999999998,"5min":0.745,"15min":0.745},"last":0.83599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56599999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72299999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.45800000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72399999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.628}]},{"osd":5,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.34399999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77100000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.35099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88700000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.82099999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83899999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.35999999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.77000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1175552,"data_stored":579239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89600000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.628}]},{"osd":1,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74199999999999999,"5min":1.004,"15min":1.004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79800000000000004,"5min":1.085,"15min":1.085},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81499999999999995,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84899999999999998,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67800000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73699999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96199999999999997,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.73799999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.313,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77800000000000002,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.752},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.373,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86499999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.69899999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73799999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83099999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.45700000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69199999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.63500000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79600000000000004,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.77900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":579773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.86399999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.44},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77700000000000002,"5min":1.24,"15min":1.24},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82899999999999996,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79200000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.83599999999999997,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.503}]},{"osd":3,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.41399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.434,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.502,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73899999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.504,"15min":0.50600000000000001},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82199999999999995,"5min":0.877,"15min":0.877},"last":0.39900000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70799999999999996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80600000000000005,"5min":1.284,"15min":1.284},"last":0.56699999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72599999999999998,"5min":0.746,"15min":0.746},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.77200000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.46000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1171456,"data_stored":579169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.501,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.253,"15min":0.253},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.63},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.36199999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.61399999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.38700000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70599999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72799999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.51400000000000001,"15min":0.498},"min":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.752,"5min":1.022,"15min":1.022},"last":0.66500000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.44800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66700000000000004,"5min":1.002,"15min":1.002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.57199999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.501,"15min":0.48599999999999999},"min":{"1min":0.36499999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":1.127,"15min":1.127},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77000000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55200000000000005,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.80500000000000005,"5min":1.079,"15min":1.079},"last":0.70499999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.038,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63800000000000001,"15min":0.629},"min":{"1min":0.40000000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.72199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1187840,"data_stored":580851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.248,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.221},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.39300000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.40799999999999997},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.40799999999999997},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.94799999999999995,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.27300000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44900000000000001,"15min":0.46700000000000003},"min":{"1min":0.34999999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59199999999999997,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.378}]},{"osd":4,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.622},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.622,"15min":0.64200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83699999999999997,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.58299999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.623,"15min":0.63},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83299999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.56200000000000006}]},{"osd":7,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.45000000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68000000000000005,"15min":0.69499999999999995},"min":{"1min":0.51400000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.87,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.60999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1171456,"data_stored":579169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.35299999999999998,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.19,"15min":0.19},"max":{"1min":0.60399999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35299999999999998,"15min":0.37},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.49399999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.32800000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36299999999999999,"15min":0.36699999999999999},"min":{"1min":0.255,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.5,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.318},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51500000000000001,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.36799999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.876,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.44},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.627,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79900000000000004,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.45400000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70199999999999996,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.628,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.81200000000000006,"5min":1.052,"15min":1.052},"last":0.38}]},{"osd":6,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82099999999999995,"5min":1.393,"15min":1.393},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80200000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.46700000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72799999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.65100000000000002,"15min":0.67400000000000004},"min":{"1min":0.42299999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71799999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.42899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1179648,"data_stored":579293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32700000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.5},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.36799999999999999,"15min":0.379},"min":{"1min":0.22,"5min":0.192,"15min":0.192},"max":{"1min":0.496,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33600000000000002,"15min":0.33100000000000002},"min":{"1min":0.26700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.44,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.37,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51500000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40999999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42199999999999999,"15min":0.42899999999999999},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54100000000000004,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.375,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52800000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.38100000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70199999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.40899999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78100000000000003,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.72299999999999998,"5min":1.02,"15min":1.02},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81399999999999995,"5min":1.089,"15min":1.089},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.623,"15min":0.629},"min":{"1min":0.441,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80000000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.755,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86599999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.64000000000000001},"min":{"1min":0.44700000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82799999999999996,"5min":1.153,"15min":1.153},"last":0.52900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1781760,"data_stored":1170242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34899999999999998,"15min":0.35499999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.55400000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.27000000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57999999999999996,"5min":0.629,"15min":0.629},"last":0.27000000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.36199999999999999,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51800000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.39400000000000002,"15min":0.40200000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53900000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.38900000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.379,"15min":0.38800000000000001},"min":{"1min":0.27400000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52200000000000002,"5min":0.628,"15min":0.628},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40000000000000002,"15min":0.40100000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.59599999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.32600000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94899999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59899999999999998,"15min":0.58299999999999996},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85599999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.98299999999999998,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.55600000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.48299999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91000000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.622},"min":{"1min":0.46100000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92200000000000004,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.628},"min":{"1min":0.499,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85899999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:39:33.576 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:39:33.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.712+0000 7feac0ec9640 1 Processor -- start 2023-11-04T01:39:33.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.712+0000 7feac0ec9640 1 -- start start 2023-11-04T01:39:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.712+0000 7feac0ec9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7feabc15ce60 0x7feabc06b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.712+0000 7feac0ec9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feabc06bd30 0x7feabc160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.712+0000 7feac0ec9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feabc1615d0 con 0x7feabc161050 2023-11-04T01:39:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.712+0000 7feac0ec9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feabc0cbde0 con 0x7feabc15ce60 2023-11-04T01:39:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.712+0000 7feac0ec9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc1618b0 con 0x7feabc06bd30 2023-11-04T01:39:33.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.713+0000 7feab3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feabc06bd30 0x7feabc160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.713+0000 7feaba59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7feabc15ce60 0x7feabc06b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.713+0000 7feaba59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7feabc15ce60 0x7feabc06b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:39822/0 (socket says 172.21.15.44:39822) 2023-11-04T01:39:33.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.713+0000 7feaba59c640 1 -- 172.21.15.44:0/3979282522 learned_addr learned my addr 172.21.15.44:0/3979282522 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:33.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.713+0000 7feab3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feabc06bd30 0x7feabc160b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:41948/0 (socket says 172.21.15.44:41948) 2023-11-04T01:39:33.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.713+0000 7feabad9d640 1 --1- 172.21.15.44:0/3979282522 >> v1:172.21.15.204:6789/0 conn(0x7feabc161050 0x7feabc0cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:44514/0 (socket says 172.21.15.44:44514) 2023-11-04T01:39:33.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.713+0000 7feaba59c640 1 -- 172.21.15.44:0/3979282522 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feabc06bd30 msgr2=0x7feabc160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:33.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.713+0000 7feaba59c640 1 --2- 172.21.15.44:0/3979282522 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feabc06bd30 0x7feabc160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.713+0000 7feaba59c640 1 -- 172.21.15.44:0/3979282522 >> v1:172.21.15.204:6789/0 conn(0x7feabc161050 legacy=0x7feabc0cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.713+0000 7feaba59c640 1 -- 172.21.15.44:0/3979282522 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc0cba00 con 0x7feabc15ce60 2023-11-04T01:39:33.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.713+0000 7feab3fff640 1 --2- 172.21.15.44:0/3979282522 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feabc06bd30 0x7feabc160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:33.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.714+0000 7feaba59c640 1 --2- 172.21.15.44:0/3979282522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feabc15ce60 0x7feabc06b7f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7feaac009870 tx=0x7feaac02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb98224cb38a70f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.714+0000 7feab9d9b640 1 -- 172.21.15.44:0/3979282522 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac030840 con 0x7feabc15ce60 2023-11-04T01:39:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.714+0000 7feab9d9b640 1 -- 172.21.15.44:0/3979282522 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac0309a0 con 0x7feabc15ce60 2023-11-04T01:39:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.714+0000 7feab9d9b640 1 -- 172.21.15.44:0/3979282522 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac030d30 con 0x7feabc15ce60 2023-11-04T01:39:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.715+0000 7feac0ec9640 1 -- 172.21.15.44:0/3979282522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feabc15ce60 msgr2=0x7feabc06b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.715+0000 7feac0ec9640 1 --2- 172.21.15.44:0/3979282522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feabc15ce60 0x7feabc06b7f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7feaac009870 tx=0x7feaac02b980 comp rx=0 tx=0).stop 2023-11-04T01:39:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.715+0000 7feac0ec9640 1 -- 172.21.15.44:0/3979282522 shutdown_connections 2023-11-04T01:39:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.715+0000 7feac0ec9640 1 --2- 172.21.15.44:0/3979282522 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feabc06bd30 0x7feabc160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.715+0000 7feac0ec9640 1 --2- 172.21.15.44:0/3979282522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feabc15ce60 0x7feabc06b7f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.715+0000 7feac0ec9640 1 -- 172.21.15.44:0/3979282522 >> 172.21.15.44:0/3979282522 conn(0x7feabc06ea90 msgr2=0x7feabc06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.715+0000 7feac0ec9640 1 -- 172.21.15.44:0/3979282522 shutdown_connections 2023-11-04T01:39:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.715+0000 7feac0ec9640 1 -- 172.21.15.44:0/3979282522 wait complete. 2023-11-04T01:39:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.716+0000 7feac0ec9640 1 Processor -- start 2023-11-04T01:39:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.716+0000 7feac0ec9640 1 -- start start 2023-11-04T01:39:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feac0ec9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feabc15ce60 0x7feabc0b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feac0ec9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feabc161050 0x7feabc156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feac0ec9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feabc0b59c0 0x7feabc0c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feac0ec9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0b2150 con 0x7feabc161050 2023-11-04T01:39:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feac0ec9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0b23a0 con 0x7feabc0b59c0 2023-11-04T01:39:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feac0ec9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0b2680 con 0x7feabc15ce60 2023-11-04T01:39:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feab3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feabc161050 0x7feabc156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feab3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feabc161050 0x7feabc156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32876/0 (socket says 172.21.15.44:32876) 2023-11-04T01:39:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feab3fff640 1 -- 172.21.15.44:0/3880061782 learned_addr learned my addr 172.21.15.44:0/3880061782 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feaba59c640 1 --2- 172.21.15.44:0/3880061782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feabc15ce60 0x7feabc0b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feabad9d640 1 --2- 172.21.15.44:0/3880061782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feabc0b59c0 0x7feabc0c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feab3fff640 1 -- 172.21.15.44:0/3880061782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feabc15ce60 msgr2=0x7feabc0b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feab3fff640 1 --2- 172.21.15.44:0/3880061782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feabc15ce60 0x7feabc0b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feab3fff640 1 -- 172.21.15.44:0/3880061782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feabc0b59c0 msgr2=0x7feabc0c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feab3fff640 1 --2- 172.21.15.44:0/3880061782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feabc0b59c0 0x7feabc0c46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.717+0000 7feab3fff640 1 -- 172.21.15.44:0/3880061782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa4009400 con 0x7feabc161050 2023-11-04T01:39:33.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.718+0000 7feab3fff640 1 --2- 172.21.15.44:0/3880061782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feabc161050 0x7feabc156de0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7feaa400e960 tx=0x7feaa400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.718+0000 7feab2ffd640 1 -- 172.21.15.44:0/3880061782 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa400ca00 con 0x7feabc161050 2023-11-04T01:39:33.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.718+0000 7feab2ffd640 1 -- 172.21.15.44:0/3880061782 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa400cb60 con 0x7feabc161050 2023-11-04T01:39:33.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.718+0000 7feac0ec9640 1 -- 172.21.15.44:0/3880061782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac0094d0 con 0x7feabc161050 2023-11-04T01:39:33.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.718+0000 7feab2ffd640 1 -- 172.21.15.44:0/3880061782 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4013470 con 0x7feabc161050 2023-11-04T01:39:33.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.718+0000 7feac0ec9640 1 -- 172.21.15.44:0/3880061782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feabc157700 con 0x7feabc161050 2023-11-04T01:39:33.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.719+0000 7feac0ec9640 1 -- 172.21.15.44:0/3880061782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feabc0c87f0 con 0x7feabc161050 2023-11-04T01:39:33.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.719+0000 7feab2ffd640 1 -- 172.21.15.44:0/3880061782 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feaa40135d0 con 0x7feabc161050 2023-11-04T01:39:33.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.720+0000 7feab2ffd640 1 --2- 172.21.15.44:0/3880061782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fea9c06aea0 0x7fea9c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.720+0000 7feab2ffd640 1 -- 172.21.15.44:0/3880061782 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7092+0+0 (secure 0 0 0) 0x7feaa4089d70 con 0x7feabc161050 2023-11-04T01:39:33.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.720+0000 7feaba59c640 1 --2- 172.21.15.44:0/3880061782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fea9c06aea0 0x7fea9c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.720+0000 7feaba59c640 1 --2- 172.21.15.44:0/3880061782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fea9c06aea0 0x7fea9c06d360 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7feaac036000 tx=0x7feaac008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.724+0000 7feab2ffd640 1 -- 172.21.15.44:0/3880061782 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feabc0c87f0 con 0x7feabc161050 2023-11-04T01:39:33.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.896+0000 7feac0ec9640 1 -- 172.21.15.44:0/3880061782 --> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feabc0cb6b0 con 0x7fea9c06aea0 2023-11-04T01:39:33.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.909+0000 7feab2ffd640 1 -- 172.21.15.44:0/3880061782 <== mgr.4108 v2:172.21.15.204:6832/2251630012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+532208 (secure 0 0 0) 0x7feaac044470 con 0x7fea9c06aea0 2023-11-04T01:39:33.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:33.920 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.913+0000 7feac0ec9640 1 -- 172.21.15.44:0/3880061782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fea9c06aea0 msgr2=0x7fea9c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.913+0000 7feac0ec9640 1 --2- 172.21.15.44:0/3880061782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fea9c06aea0 0x7fea9c06d360 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7feaac036000 tx=0x7feaac008030 comp rx=0 tx=0).stop 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.913+0000 7feac0ec9640 1 -- 172.21.15.44:0/3880061782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feabc161050 msgr2=0x7feabc156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.913+0000 7feac0ec9640 1 --2- 172.21.15.44:0/3880061782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feabc161050 0x7feabc156de0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7feaa400e960 tx=0x7feaa400ee20 comp rx=0 tx=0).stop 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.913+0000 7feac0ec9640 1 -- 172.21.15.44:0/3880061782 shutdown_connections 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.913+0000 7feac0ec9640 1 --2- 172.21.15.44:0/3880061782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fea9c06aea0 0x7fea9c06d360 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.913+0000 7feac0ec9640 1 --2- 172.21.15.44:0/3880061782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feabc0b59c0 0x7feabc0c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.913+0000 7feac0ec9640 1 --2- 172.21.15.44:0/3880061782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feabc161050 0x7feabc156de0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.913+0000 7feac0ec9640 1 --2- 172.21.15.44:0/3880061782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feabc15ce60 0x7feabc0b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.913+0000 7feac0ec9640 1 -- 172.21.15.44:0/3880061782 >> 172.21.15.44:0/3880061782 conn(0x7feabc06ea90 msgr2=0x7feabc0c52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.913+0000 7feac0ec9640 1 -- 172.21.15.44:0/3880061782 shutdown_connections 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:33.913+0000 7feac0ec9640 1 -- 172.21.15.44:0/3880061782 wait complete. 2023-11-04T01:39:33.926 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2023-11-04T01:39:32.628646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":318,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251524,"kb_used_data":10372,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754723196,"statfs":{"total":773094113280,"available":772836552704,"internally_reserved":0,"allocated":10620928,"data_stored":5817889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.107286"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572768+0000","last_change":"2023-11-04T01:39:30.585362+0000","last_active":"2023-11-04T01:39:31.572768+0000","last_peered":"2023-11-04T01:39:31.572768+0000","last_clean":"2023-11-04T01:39:31.572768+0000","last_became_active":"2023-11-04T01:39:30.585068+0000","last_became_peered":"2023-11-04T01:39:30.585068+0000","last_unstale":"2023-11-04T01:39:31.572768+0000","last_undegraded":"2023-11-04T01:39:31.572768+0000","last_fullsized":"2023-11-04T01:39:31.572768+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:32:48.588740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577533+0000","last_change":"2023-11-04T01:39:30.582169+0000","last_active":"2023-11-04T01:39:31.577533+0000","last_peered":"2023-11-04T01:39:31.577533+0000","last_clean":"2023-11-04T01:39:31.577533+0000","last_became_active":"2023-11-04T01:39:30.581958+0000","last_became_peered":"2023-11-04T01:39:30.581958+0000","last_unstale":"2023-11-04T01:39:31.577533+0000","last_undegraded":"2023-11-04T01:39:31.577533+0000","last_fullsized":"2023-11-04T01:39:31.577533+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:31.706032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.579974+0000","last_change":"2023-11-04T01:39:30.576736+0000","last_active":"2023-11-04T01:39:30.579974+0000","last_peered":"2023-11-04T01:39:30.579974+0000","last_clean":"2023-11-04T01:39:30.579974+0000","last_became_active":"2023-11-04T01:39:30.576483+0000","last_became_peered":"2023-11-04T01:39:30.576483+0000","last_unstale":"2023-11-04T01:39:30.579974+0000","last_undegraded":"2023-11-04T01:39:30.579974+0000","last_fullsized":"2023-11-04T01:39:30.579974+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:25.110950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572128+0000","last_change":"2023-11-04T01:39:30.578531+0000","last_active":"2023-11-04T01:39:31.572128+0000","last_peered":"2023-11-04T01:39:31.572128+0000","last_clean":"2023-11-04T01:39:31.572128+0000","last_became_active":"2023-11-04T01:39:30.578245+0000","last_became_peered":"2023-11-04T01:39:30.578245+0000","last_unstale":"2023-11-04T01:39:31.572128+0000","last_undegraded":"2023-11-04T01:39:31.572128+0000","last_fullsized":"2023-11-04T01:39:31.572128+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:19.881803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568316+0000","last_change":"2023-11-04T01:39:30.567183+0000","last_active":"2023-11-04T01:39:30.568316+0000","last_peered":"2023-11-04T01:39:30.568316+0000","last_clean":"2023-11-04T01:39:30.568316+0000","last_became_active":"2023-11-04T01:39:30.566916+0000","last_became_peered":"2023-11-04T01:39:30.566916+0000","last_unstale":"2023-11-04T01:39:30.568316+0000","last_undegraded":"2023-11-04T01:39:30.568316+0000","last_fullsized":"2023-11-04T01:39:30.568316+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:05:37.042583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.587916+0000","last_change":"2023-11-04T01:39:30.580607+0000","last_active":"2023-11-04T01:39:30.587916+0000","last_peered":"2023-11-04T01:39:30.587916+0000","last_clean":"2023-11-04T01:39:30.587916+0000","last_became_active":"2023-11-04T01:39:30.580336+0000","last_became_peered":"2023-11-04T01:39:30.580336+0000","last_unstale":"2023-11-04T01:39:30.587916+0000","last_undegraded":"2023-11-04T01:39:30.587916+0000","last_fullsized":"2023-11-04T01:39:30.587916+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:16:27.831933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.580871+0000","last_change":"2023-11-04T01:39:30.576294+0000","last_active":"2023-11-04T01:39:30.580871+0000","last_peered":"2023-11-04T01:39:30.580871+0000","last_clean":"2023-11-04T01:39:30.580871+0000","last_became_active":"2023-11-04T01:39:30.576024+0000","last_became_peered":"2023-11-04T01:39:30.576024+0000","last_unstale":"2023-11-04T01:39:30.580871+0000","last_undegraded":"2023-11-04T01:39:30.580871+0000","last_fullsized":"2023-11-04T01:39:30.580871+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:01:46.707142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.581719+0000","last_change":"2023-11-04T01:39:30.579369+0000","last_active":"2023-11-04T01:39:30.581719+0000","last_peered":"2023-11-04T01:39:30.581719+0000","last_clean":"2023-11-04T01:39:30.581719+0000","last_became_active":"2023-11-04T01:39:30.579093+0000","last_became_peered":"2023-11-04T01:39:30.579093+0000","last_unstale":"2023-11-04T01:39:30.581719+0000","last_undegraded":"2023-11-04T01:39:30.581719+0000","last_fullsized":"2023-11-04T01:39:30.581719+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:51.308463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572782+0000","last_change":"2023-11-04T01:39:30.581195+0000","last_active":"2023-11-04T01:39:31.572782+0000","last_peered":"2023-11-04T01:39:31.572782+0000","last_clean":"2023-11-04T01:39:31.572782+0000","last_became_active":"2023-11-04T01:39:30.580923+0000","last_became_peered":"2023-11-04T01:39:30.580923+0000","last_unstale":"2023-11-04T01:39:31.572782+0000","last_undegraded":"2023-11-04T01:39:31.572782+0000","last_fullsized":"2023-11-04T01:39:31.572782+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:00:49.615521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572595+0000","last_change":"2023-11-04T01:39:30.579536+0000","last_active":"2023-11-04T01:39:31.572595+0000","last_peered":"2023-11-04T01:39:31.572595+0000","last_clean":"2023-11-04T01:39:31.572595+0000","last_became_active":"2023-11-04T01:39:30.579253+0000","last_became_peered":"2023-11-04T01:39:30.579253+0000","last_unstale":"2023-11-04T01:39:31.572595+0000","last_undegraded":"2023-11-04T01:39:31.572595+0000","last_fullsized":"2023-11-04T01:39:31.572595+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:52:22.129094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577618+0000","last_change":"2023-11-04T01:39:30.572555+0000","last_active":"2023-11-04T01:39:31.577618+0000","last_peered":"2023-11-04T01:39:31.577618+0000","last_clean":"2023-11-04T01:39:31.577618+0000","last_became_active":"2023-11-04T01:39:30.572085+0000","last_became_peered":"2023-11-04T01:39:30.572085+0000","last_unstale":"2023-11-04T01:39:31.577618+0000","last_undegraded":"2023-11-04T01:39:31.577618+0000","last_fullsized":"2023-11-04T01:39:31.577618+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:44.642753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572197+0000","last_change":"2023-11-04T01:39:30.577804+0000","last_active":"2023-11-04T01:39:31.572197+0000","last_peered":"2023-11-04T01:39:31.572197+0000","last_clean":"2023-11-04T01:39:31.572197+0000","last_became_active":"2023-11-04T01:39:30.571723+0000","last_became_peered":"2023-11-04T01:39:30.571723+0000","last_unstale":"2023-11-04T01:39:31.572197+0000","last_undegraded":"2023-11-04T01:39:31.572197+0000","last_fullsized":"2023-11-04T01:39:31.572197+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:05.290759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.570342+0000","last_change":"2023-11-04T01:39:30.569380+0000","last_active":"2023-11-04T01:39:30.570342+0000","last_peered":"2023-11-04T01:39:30.570342+0000","last_clean":"2023-11-04T01:39:30.570342+0000","last_became_active":"2023-11-04T01:39:30.568998+0000","last_became_peered":"2023-11-04T01:39:30.568998+0000","last_unstale":"2023-11-04T01:39:30.570342+0000","last_undegraded":"2023-11-04T01:39:30.570342+0000","last_fullsized":"2023-11-04T01:39:30.570342+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:03.210760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.581201+0000","last_change":"2023-11-04T01:39:30.578529+0000","last_active":"2023-11-04T01:39:30.581201+0000","last_peered":"2023-11-04T01:39:30.581201+0000","last_clean":"2023-11-04T01:39:30.581201+0000","last_became_active":"2023-11-04T01:39:30.578236+0000","last_became_peered":"2023-11-04T01:39:30.578236+0000","last_unstale":"2023-11-04T01:39:30.581201+0000","last_undegraded":"2023-11-04T01:39:30.581201+0000","last_fullsized":"2023-11-04T01:39:30.581201+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:31.706032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.587960+0000","last_change":"2023-11-04T01:39:30.581242+0000","last_active":"2023-11-04T01:39:30.587960+0000","last_peered":"2023-11-04T01:39:30.587960+0000","last_clean":"2023-11-04T01:39:30.587960+0000","last_became_active":"2023-11-04T01:39:30.580939+0000","last_became_peered":"2023-11-04T01:39:30.580939+0000","last_unstale":"2023-11-04T01:39:30.587960+0000","last_undegraded":"2023-11-04T01:39:30.587960+0000","last_fullsized":"2023-11-04T01:39:30.587960+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:44.347659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571619+0000","last_change":"2023-11-04T01:39:30.581106+0000","last_active":"2023-11-04T01:39:31.571619+0000","last_peered":"2023-11-04T01:39:31.571619+0000","last_clean":"2023-11-04T01:39:31.571619+0000","last_became_active":"2023-11-04T01:39:30.580616+0000","last_became_peered":"2023-11-04T01:39:30.580616+0000","last_unstale":"2023-11-04T01:39:31.571619+0000","last_undegraded":"2023-11-04T01:39:31.571619+0000","last_fullsized":"2023-11-04T01:39:31.571619+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:12.840762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577891+0000","last_change":"2023-11-04T01:39:30.572105+0000","last_active":"2023-11-04T01:39:31.577891+0000","last_peered":"2023-11-04T01:39:31.577891+0000","last_clean":"2023-11-04T01:39:31.577891+0000","last_became_active":"2023-11-04T01:39:30.571824+0000","last_became_peered":"2023-11-04T01:39:30.571824+0000","last_unstale":"2023-11-04T01:39:31.577891+0000","last_undegraded":"2023-11-04T01:39:31.577891+0000","last_fullsized":"2023-11-04T01:39:31.577891+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:03.210760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578222+0000","last_change":"2023-11-04T01:39:30.570102+0000","last_active":"2023-11-04T01:39:31.578222+0000","last_peered":"2023-11-04T01:39:31.578222+0000","last_clean":"2023-11-04T01:39:31.578222+0000","last_became_active":"2023-11-04T01:39:30.569836+0000","last_became_peered":"2023-11-04T01:39:30.569836+0000","last_unstale":"2023-11-04T01:39:31.578222+0000","last_undegraded":"2023-11-04T01:39:31.578222+0000","last_fullsized":"2023-11-04T01:39:31.578222+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:40:14.060014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.570316+0000","last_change":"2023-11-04T01:39:30.569375+0000","last_active":"2023-11-04T01:39:30.570316+0000","last_peered":"2023-11-04T01:39:30.570316+0000","last_clean":"2023-11-04T01:39:30.570316+0000","last_became_active":"2023-11-04T01:39:30.568698+0000","last_became_peered":"2023-11-04T01:39:30.568698+0000","last_unstale":"2023-11-04T01:39:30.570316+0000","last_undegraded":"2023-11-04T01:39:30.570316+0000","last_fullsized":"2023-11-04T01:39:30.570316+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:01.522652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577485+0000","last_change":"2023-11-04T01:39:30.574949+0000","last_active":"2023-11-04T01:39:31.577485+0000","last_peered":"2023-11-04T01:39:31.577485+0000","last_clean":"2023-11-04T01:39:31.577485+0000","last_became_active":"2023-11-04T01:39:30.574639+0000","last_became_peered":"2023-11-04T01:39:30.574639+0000","last_unstale":"2023-11-04T01:39:31.577485+0000","last_undegraded":"2023-11-04T01:39:31.577485+0000","last_fullsized":"2023-11-04T01:39:31.577485+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:51.308463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577945+0000","last_change":"2023-11-04T01:39:30.567683+0000","last_active":"2023-11-04T01:39:31.577945+0000","last_peered":"2023-11-04T01:39:31.577945+0000","last_clean":"2023-11-04T01:39:31.577945+0000","last_became_active":"2023-11-04T01:39:30.567378+0000","last_became_peered":"2023-11-04T01:39:30.567378+0000","last_unstale":"2023-11-04T01:39:31.577945+0000","last_undegraded":"2023-11-04T01:39:31.577945+0000","last_fullsized":"2023-11-04T01:39:31.577945+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:43:20.772009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.578962+0000","last_change":"2023-11-04T01:39:30.572757+0000","last_active":"2023-11-04T01:39:30.578962+0000","last_peered":"2023-11-04T01:39:30.578962+0000","last_clean":"2023-11-04T01:39:30.578962+0000","last_became_active":"2023-11-04T01:39:30.572465+0000","last_became_peered":"2023-11-04T01:39:30.572465+0000","last_unstale":"2023-11-04T01:39:30.578962+0000","last_undegraded":"2023-11-04T01:39:30.578962+0000","last_fullsized":"2023-11-04T01:39:30.578962+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:25.110950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577114+0000","last_change":"2023-11-04T01:39:30.575856+0000","last_active":"2023-11-04T01:39:31.577114+0000","last_peered":"2023-11-04T01:39:31.577114+0000","last_clean":"2023-11-04T01:39:31.577114+0000","last_became_active":"2023-11-04T01:39:30.575589+0000","last_became_peered":"2023-11-04T01:39:30.575589+0000","last_unstale":"2023-11-04T01:39:31.577114+0000","last_undegraded":"2023-11-04T01:39:31.577114+0000","last_fullsized":"2023-11-04T01:39:31.577114+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:53:22.128780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.578675+0000","last_change":"2023-11-04T01:39:30.569749+0000","last_active":"2023-11-04T01:39:30.578675+0000","last_peered":"2023-11-04T01:39:30.578675+0000","last_clean":"2023-11-04T01:39:30.578675+0000","last_became_active":"2023-11-04T01:39:30.569469+0000","last_became_peered":"2023-11-04T01:39:30.569469+0000","last_unstale":"2023-11-04T01:39:30.578675+0000","last_undegraded":"2023-11-04T01:39:30.578675+0000","last_fullsized":"2023-11-04T01:39:30.578675+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:03.210760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578403+0000","last_change":"2023-11-04T01:39:30.571477+0000","last_active":"2023-11-04T01:39:31.578403+0000","last_peered":"2023-11-04T01:39:31.578403+0000","last_clean":"2023-11-04T01:39:31.578403+0000","last_became_active":"2023-11-04T01:39:30.571210+0000","last_became_peered":"2023-11-04T01:39:30.571210+0000","last_unstale":"2023-11-04T01:39:31.578403+0000","last_undegraded":"2023-11-04T01:39:31.578403+0000","last_fullsized":"2023-11-04T01:39:31.578403+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:35.599627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572624+0000","last_change":"2023-11-04T01:39:30.586198+0000","last_active":"2023-11-04T01:39:31.572624+0000","last_peered":"2023-11-04T01:39:31.572624+0000","last_clean":"2023-11-04T01:39:31.572624+0000","last_became_active":"2023-11-04T01:39:30.585875+0000","last_became_peered":"2023-11-04T01:39:30.585875+0000","last_unstale":"2023-11-04T01:39:31.572624+0000","last_undegraded":"2023-11-04T01:39:31.572624+0000","last_fullsized":"2023-11-04T01:39:31.572624+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:02:14.968027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.593142+0000","last_change":"2023-11-04T01:39:30.590435+0000","last_active":"2023-11-04T01:39:30.593142+0000","last_peered":"2023-11-04T01:39:30.593142+0000","last_clean":"2023-11-04T01:39:30.593142+0000","last_became_active":"2023-11-04T01:39:30.590094+0000","last_became_peered":"2023-11-04T01:39:30.590094+0000","last_unstale":"2023-11-04T01:39:30.593142+0000","last_undegraded":"2023-11-04T01:39:30.593142+0000","last_fullsized":"2023-11-04T01:39:30.593142+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:49.903966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.578732+0000","last_change":"2023-11-04T01:39:30.572507+0000","last_active":"2023-11-04T01:39:30.578732+0000","last_peered":"2023-11-04T01:39:30.578732+0000","last_clean":"2023-11-04T01:39:30.578732+0000","last_became_active":"2023-11-04T01:39:30.572204+0000","last_became_peered":"2023-11-04T01:39:30.572204+0000","last_unstale":"2023-11-04T01:39:30.578732+0000","last_undegraded":"2023-11-04T01:39:30.578732+0000","last_fullsized":"2023-11-04T01:39:30.578732+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:31.247096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577970+0000","last_change":"2023-11-04T01:39:30.575457+0000","last_active":"2023-11-04T01:39:31.577970+0000","last_peered":"2023-11-04T01:39:31.577970+0000","last_clean":"2023-11-04T01:39:31.577970+0000","last_became_active":"2023-11-04T01:39:30.575146+0000","last_became_peered":"2023-11-04T01:39:30.575146+0000","last_unstale":"2023-11-04T01:39:31.577970+0000","last_undegraded":"2023-11-04T01:39:31.577970+0000","last_fullsized":"2023-11-04T01:39:31.577970+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:31:15.596258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.581289+0000","last_change":"2023-11-04T01:39:30.578080+0000","last_active":"2023-11-04T01:39:30.581289+0000","last_peered":"2023-11-04T01:39:30.581289+0000","last_clean":"2023-11-04T01:39:30.581289+0000","last_became_active":"2023-11-04T01:39:30.577777+0000","last_became_peered":"2023-11-04T01:39:30.577777+0000","last_unstale":"2023-11-04T01:39:30.581289+0000","last_undegraded":"2023-11-04T01:39:30.581289+0000","last_fullsized":"2023-11-04T01:39:30.581289+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:07.980448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571680+0000","last_change":"2023-11-04T01:39:30.577308+0000","last_active":"2023-11-04T01:39:31.571680+0000","last_peered":"2023-11-04T01:39:31.571680+0000","last_clean":"2023-11-04T01:39:31.571680+0000","last_became_active":"2023-11-04T01:39:30.573415+0000","last_became_peered":"2023-11-04T01:39:30.573415+0000","last_unstale":"2023-11-04T01:39:31.571680+0000","last_undegraded":"2023-11-04T01:39:31.571680+0000","last_fullsized":"2023-11-04T01:39:31.571680+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:20.933186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.587885+0000","last_change":"2023-11-04T01:39:30.580310+0000","last_active":"2023-11-04T01:39:30.587885+0000","last_peered":"2023-11-04T01:39:30.587885+0000","last_clean":"2023-11-04T01:39:30.587885+0000","last_became_active":"2023-11-04T01:39:30.578604+0000","last_became_peered":"2023-11-04T01:39:30.578604+0000","last_unstale":"2023-11-04T01:39:30.587885+0000","last_undegraded":"2023-11-04T01:39:30.587885+0000","last_fullsized":"2023-11-04T01:39:30.587885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:41.422338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571905+0000","last_change":"2023-11-04T01:39:30.573065+0000","last_active":"2023-11-04T01:39:31.571905+0000","last_peered":"2023-11-04T01:39:31.571905+0000","last_clean":"2023-11-04T01:39:31.571905+0000","last_became_active":"2023-11-04T01:39:30.572486+0000","last_became_peered":"2023-11-04T01:39:30.572486+0000","last_unstale":"2023-11-04T01:39:31.571905+0000","last_undegraded":"2023-11-04T01:39:31.571905+0000","last_fullsized":"2023-11-04T01:39:31.571905+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:19.551093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.559229+0000","last_change":"2023-11-04T01:39:29.546066+0000","last_active":"2023-11-04T01:39:30.559229+0000","last_peered":"2023-11-04T01:39:30.559229+0000","last_clean":"2023-11-04T01:39:30.559229+0000","last_became_active":"2023-11-04T01:39:29.545797+0000","last_became_peered":"2023-11-04T01:39:29.545797+0000","last_unstale":"2023-11-04T01:39:30.559229+0000","last_undegraded":"2023-11-04T01:39:30.559229+0000","last_fullsized":"2023-11-04T01:39:30.559229+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:55:12.450290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534284+0000","last_change":"2023-11-04T01:38:37.214290+0000","last_active":"2023-11-04T01:39:29.534284+0000","last_peered":"2023-11-04T01:39:29.534284+0000","last_clean":"2023-11-04T01:39:29.534284+0000","last_became_active":"2023-11-04T01:38:37.213993+0000","last_became_peered":"2023-11-04T01:38:37.213993+0000","last_unstale":"2023-11-04T01:39:29.534284+0000","last_undegraded":"2023-11-04T01:39:29.534284+0000","last_fullsized":"2023-11-04T01:39:29.534284+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:15:54.258509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.565552+0000","last_change":"2023-11-04T01:38:38.208281+0000","last_active":"2023-11-04T01:39:30.565552+0000","last_peered":"2023-11-04T01:39:30.565552+0000","last_clean":"2023-11-04T01:39:30.565552+0000","last_became_active":"2023-11-04T01:38:36.209307+0000","last_became_peered":"2023-11-04T01:38:36.209307+0000","last_unstale":"2023-11-04T01:39:30.565552+0000","last_undegraded":"2023-11-04T01:39:30.565552+0000","last_fullsized":"2023-11-04T01:39:30.565552+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:15:53.251943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072090299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534466+0000","last_change":"2023-11-04T01:37:36.221026+0000","last_active":"2023-11-04T01:39:29.534466+0000","last_peered":"2023-11-04T01:39:29.534466+0000","last_clean":"2023-11-04T01:39:29.534466+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:39:29.534466+0000","last_undegraded":"2023-11-04T01:39:29.534466+0000","last_fullsized":"2023-11-04T01:39:29.534466+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067716399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.570392+0000","last_change":"2023-11-04T01:39:30.569449+0000","last_active":"2023-11-04T01:39:30.570392+0000","last_peered":"2023-11-04T01:39:30.570392+0000","last_clean":"2023-11-04T01:39:30.570392+0000","last_became_active":"2023-11-04T01:39:30.569164+0000","last_became_peered":"2023-11-04T01:39:30.569164+0000","last_unstale":"2023-11-04T01:39:30.570392+0000","last_undegraded":"2023-11-04T01:39:30.570392+0000","last_fullsized":"2023-11-04T01:39:30.570392+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:44.642753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.591502+0000","last_change":"2023-11-04T01:39:29.545417+0000","last_active":"2023-11-04T01:39:30.591502+0000","last_peered":"2023-11-04T01:39:30.591502+0000","last_clean":"2023-11-04T01:39:30.591502+0000","last_became_active":"2023-11-04T01:39:29.544550+0000","last_became_peered":"2023-11-04T01:39:29.544550+0000","last_unstale":"2023-11-04T01:39:30.591502+0000","last_undegraded":"2023-11-04T01:39:30.591502+0000","last_fullsized":"2023-11-04T01:39:30.591502+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:04.396307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533198+0000","last_change":"2023-11-04T01:38:37.212669+0000","last_active":"2023-11-04T01:39:29.533198+0000","last_peered":"2023-11-04T01:39:29.533198+0000","last_clean":"2023-11-04T01:39:29.533198+0000","last_became_active":"2023-11-04T01:38:37.212373+0000","last_became_peered":"2023-11-04T01:38:37.212373+0000","last_unstale":"2023-11-04T01:39:29.533198+0000","last_undegraded":"2023-11-04T01:39:29.533198+0000","last_fullsized":"2023-11-04T01:39:29.533198+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:00.498355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568439+0000","last_change":"2023-11-04T01:38:38.208516+0000","last_active":"2023-11-04T01:39:30.568439+0000","last_peered":"2023-11-04T01:39:30.568439+0000","last_clean":"2023-11-04T01:39:30.568439+0000","last_became_active":"2023-11-04T01:38:36.216993+0000","last_became_peered":"2023-11-04T01:38:36.216993+0000","last_unstale":"2023-11-04T01:39:30.568439+0000","last_undegraded":"2023-11-04T01:39:30.568439+0000","last_fullsized":"2023-11-04T01:39:30.568439+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:26:26.339210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095343999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":58,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536757+0000","last_change":"2023-11-04T01:37:36.229027+0000","last_active":"2023-11-04T01:39:29.536757+0000","last_peered":"2023-11-04T01:39:29.536757+0000","last_clean":"2023-11-04T01:39:29.536757+0000","last_became_active":"2023-11-04T01:37:35.218342+0000","last_became_peered":"2023-11-04T01:37:35.218342+0000","last_unstale":"2023-11-04T01:39:29.536757+0000","last_undegraded":"2023-11-04T01:39:29.536757+0000","last_fullsized":"2023-11-04T01:39:29.536757+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059666400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.588268+0000","last_change":"2023-11-04T01:39:30.584324+0000","last_active":"2023-11-04T01:39:30.588268+0000","last_peered":"2023-11-04T01:39:30.588268+0000","last_clean":"2023-11-04T01:39:30.588268+0000","last_became_active":"2023-11-04T01:39:30.584046+0000","last_became_peered":"2023-11-04T01:39:30.584046+0000","last_unstale":"2023-11-04T01:39:30.588268+0000","last_undegraded":"2023-11-04T01:39:30.588268+0000","last_fullsized":"2023-11-04T01:39:30.588268+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:43:20.772009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571705+0000","last_change":"2023-11-04T01:39:29.533740+0000","last_active":"2023-11-04T01:39:31.571705+0000","last_peered":"2023-11-04T01:39:31.571705+0000","last_clean":"2023-11-04T01:39:31.571705+0000","last_became_active":"2023-11-04T01:39:29.533439+0000","last_became_peered":"2023-11-04T01:39:29.533439+0000","last_unstale":"2023-11-04T01:39:31.571705+0000","last_undegraded":"2023-11-04T01:39:31.571705+0000","last_fullsized":"2023-11-04T01:39:31.571705+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:39.309551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557514+0000","last_change":"2023-11-04T01:38:37.215194+0000","last_active":"2023-11-04T01:39:30.557514+0000","last_peered":"2023-11-04T01:39:30.557514+0000","last_clean":"2023-11-04T01:39:30.557514+0000","last_became_active":"2023-11-04T01:38:37.214889+0000","last_became_peered":"2023-11-04T01:38:37.214889+0000","last_unstale":"2023-11-04T01:39:30.557514+0000","last_undegraded":"2023-11-04T01:39:30.557514+0000","last_fullsized":"2023-11-04T01:39:30.557514+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:03:06.059941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536647+0000","last_change":"2023-11-04T01:38:38.457859+0000","last_active":"2023-11-04T01:39:29.536647+0000","last_peered":"2023-11-04T01:39:29.536647+0000","last_clean":"2023-11-04T01:39:29.536647+0000","last_became_active":"2023-11-04T01:38:36.220887+0000","last_became_peered":"2023-11-04T01:38:36.220887+0000","last_unstale":"2023-11-04T01:39:29.536647+0000","last_undegraded":"2023-11-04T01:39:29.536647+0000","last_fullsized":"2023-11-04T01:39:29.536647+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:26:26.339210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072014699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568111+0000","last_change":"2023-11-04T01:37:36.222868+0000","last_active":"2023-11-04T01:39:30.568111+0000","last_peered":"2023-11-04T01:39:30.568111+0000","last_clean":"2023-11-04T01:39:30.568111+0000","last_became_active":"2023-11-04T01:37:35.220180+0000","last_became_peered":"2023-11-04T01:37:35.220180+0000","last_unstale":"2023-11-04T01:39:30.568111+0000","last_undegraded":"2023-11-04T01:39:30.568111+0000","last_fullsized":"2023-11-04T01:39:30.568111+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001103574,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.586362+0000","last_change":"2023-11-04T01:39:30.581829+0000","last_active":"2023-11-04T01:39:30.586362+0000","last_peered":"2023-11-04T01:39:30.586362+0000","last_clean":"2023-11-04T01:39:30.586362+0000","last_became_active":"2023-11-04T01:39:30.581548+0000","last_became_peered":"2023-11-04T01:39:30.581548+0000","last_unstale":"2023-11-04T01:39:30.586362+0000","last_undegraded":"2023-11-04T01:39:30.586362+0000","last_fullsized":"2023-11-04T01:39:30.586362+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:36:29.434930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.570431+0000","last_change":"2023-11-04T01:39:29.544359+0000","last_active":"2023-11-04T01:39:30.570431+0000","last_peered":"2023-11-04T01:39:30.570431+0000","last_clean":"2023-11-04T01:39:30.570431+0000","last_became_active":"2023-11-04T01:39:29.544054+0000","last_became_peered":"2023-11-04T01:39:29.544054+0000","last_unstale":"2023-11-04T01:39:30.570431+0000","last_undegraded":"2023-11-04T01:39:30.570431+0000","last_fullsized":"2023-11-04T01:39:30.570431+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:04:05.638181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":32,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.564432+0000","last_change":"2023-11-04T01:38:37.213107+0000","last_active":"2023-11-04T01:39:30.564432+0000","last_peered":"2023-11-04T01:39:30.564432+0000","last_clean":"2023-11-04T01:39:30.564432+0000","last_became_active":"2023-11-04T01:38:37.212801+0000","last_became_peered":"2023-11-04T01:38:37.212801+0000","last_unstale":"2023-11-04T01:39:30.564432+0000","last_undegraded":"2023-11-04T01:39:30.564432+0000","last_fullsized":"2023-11-04T01:39:30.564432+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:57:14.922918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.566323+0000","last_change":"2023-11-04T01:38:38.208125+0000","last_active":"2023-11-04T01:39:30.566323+0000","last_peered":"2023-11-04T01:39:30.566323+0000","last_clean":"2023-11-04T01:39:30.566323+0000","last_became_active":"2023-11-04T01:38:36.219549+0000","last_became_peered":"2023-11-04T01:38:36.219549+0000","last_unstale":"2023-11-04T01:39:30.566323+0000","last_undegraded":"2023-11-04T01:39:30.566323+0000","last_fullsized":"2023-11-04T01:39:30.566323+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:01.357137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769686,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536311+0000","last_change":"2023-11-04T01:37:36.221053+0000","last_active":"2023-11-04T01:39:29.536311+0000","last_peered":"2023-11-04T01:39:29.536311+0000","last_clean":"2023-11-04T01:39:29.536311+0000","last_became_active":"2023-11-04T01:37:35.227176+0000","last_became_peered":"2023-11-04T01:37:35.227176+0000","last_unstale":"2023-11-04T01:39:29.536311+0000","last_undegraded":"2023-11-04T01:39:29.536311+0000","last_fullsized":"2023-11-04T01:39:29.536311+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000594178,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.593121+0000","last_change":"2023-11-04T01:39:30.590102+0000","last_active":"2023-11-04T01:39:30.593121+0000","last_peered":"2023-11-04T01:39:30.593121+0000","last_clean":"2023-11-04T01:39:30.593121+0000","last_became_active":"2023-11-04T01:39:30.589819+0000","last_became_peered":"2023-11-04T01:39:30.589819+0000","last_unstale":"2023-11-04T01:39:30.593121+0000","last_undegraded":"2023-11-04T01:39:30.593121+0000","last_fullsized":"2023-11-04T01:39:30.593121+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:06:18.586017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.580822+0000","last_change":"2023-11-04T01:39:29.541582+0000","last_active":"2023-11-04T01:39:30.580822+0000","last_peered":"2023-11-04T01:39:30.580822+0000","last_clean":"2023-11-04T01:39:30.580822+0000","last_became_active":"2023-11-04T01:39:29.541294+0000","last_became_peered":"2023-11-04T01:39:29.541294+0000","last_unstale":"2023-11-04T01:39:30.580822+0000","last_undegraded":"2023-11-04T01:39:30.580822+0000","last_fullsized":"2023-11-04T01:39:30.580822+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:28.972752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533567+0000","last_change":"2023-11-04T01:38:37.215477+0000","last_active":"2023-11-04T01:39:29.533567+0000","last_peered":"2023-11-04T01:39:29.533567+0000","last_clean":"2023-11-04T01:39:29.533567+0000","last_became_active":"2023-11-04T01:38:37.215166+0000","last_became_peered":"2023-11-04T01:38:37.215166+0000","last_unstale":"2023-11-04T01:39:29.533567+0000","last_undegraded":"2023-11-04T01:39:29.533567+0000","last_fullsized":"2023-11-04T01:39:29.533567+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:22.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533677+0000","last_change":"2023-11-04T01:38:38.636546+0000","last_active":"2023-11-04T01:39:29.533677+0000","last_peered":"2023-11-04T01:39:29.533677+0000","last_clean":"2023-11-04T01:39:29.533677+0000","last_became_active":"2023-11-04T01:38:36.224162+0000","last_became_peered":"2023-11-04T01:38:36.224162+0000","last_unstale":"2023-11-04T01:39:29.533677+0000","last_undegraded":"2023-11-04T01:39:29.533677+0000","last_fullsized":"2023-11-04T01:39:29.533677+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:17.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062552400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568569+0000","last_change":"2023-11-04T01:37:36.221842+0000","last_active":"2023-11-04T01:39:30.568569+0000","last_peered":"2023-11-04T01:39:30.568569+0000","last_clean":"2023-11-04T01:39:30.568569+0000","last_became_active":"2023-11-04T01:37:35.214305+0000","last_became_peered":"2023-11-04T01:37:35.214305+0000","last_unstale":"2023-11-04T01:39:30.568569+0000","last_undegraded":"2023-11-04T01:39:30.568569+0000","last_fullsized":"2023-11-04T01:39:30.568569+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:13:05.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014999690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.578073+0000","last_change":"2023-11-04T01:39:30.576110+0000","last_active":"2023-11-04T01:39:30.578073+0000","last_peered":"2023-11-04T01:39:30.578073+0000","last_clean":"2023-11-04T01:39:30.578073+0000","last_became_active":"2023-11-04T01:39:30.575414+0000","last_became_peered":"2023-11-04T01:39:30.575414+0000","last_unstale":"2023-11-04T01:39:30.578073+0000","last_undegraded":"2023-11-04T01:39:30.578073+0000","last_fullsized":"2023-11-04T01:39:30.578073+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:53.822192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"95'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572877+0000","last_change":"2023-11-04T01:39:29.542129+0000","last_active":"2023-11-04T01:39:31.572877+0000","last_peered":"2023-11-04T01:39:31.572877+0000","last_clean":"2023-11-04T01:39:31.572877+0000","last_became_active":"2023-11-04T01:39:29.541708+0000","last_became_peered":"2023-11-04T01:39:29.541708+0000","last_unstale":"2023-11-04T01:39:31.572877+0000","last_undegraded":"2023-11-04T01:39:31.572877+0000","last_fullsized":"2023-11-04T01:39:31.572877+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:08.542870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":32,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.567445+0000","last_change":"2023-11-04T01:38:37.216543+0000","last_active":"2023-11-04T01:39:30.567445+0000","last_peered":"2023-11-04T01:39:30.567445+0000","last_clean":"2023-11-04T01:39:30.567445+0000","last_became_active":"2023-11-04T01:38:37.216259+0000","last_became_peered":"2023-11-04T01:38:37.216259+0000","last_unstale":"2023-11-04T01:39:30.567445+0000","last_undegraded":"2023-11-04T01:39:30.567445+0000","last_fullsized":"2023-11-04T01:39:30.567445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:20.702307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534632+0000","last_change":"2023-11-04T01:38:38.205278+0000","last_active":"2023-11-04T01:39:29.534632+0000","last_peered":"2023-11-04T01:39:29.534632+0000","last_clean":"2023-11-04T01:39:29.534632+0000","last_became_active":"2023-11-04T01:38:36.220833+0000","last_became_peered":"2023-11-04T01:38:36.220833+0000","last_unstale":"2023-11-04T01:39:29.534632+0000","last_undegraded":"2023-11-04T01:39:29.534632+0000","last_fullsized":"2023-11-04T01:39:29.534632+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:26.345951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065079199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.562937+0000","last_change":"2023-11-04T01:37:36.694601+0000","last_active":"2023-11-04T01:39:30.562937+0000","last_peered":"2023-11-04T01:39:30.562937+0000","last_clean":"2023-11-04T01:39:30.562937+0000","last_became_active":"2023-11-04T01:37:35.223746+0000","last_became_peered":"2023-11-04T01:37:35.223746+0000","last_unstale":"2023-11-04T01:39:30.562937+0000","last_undegraded":"2023-11-04T01:39:30.562937+0000","last_fullsized":"2023-11-04T01:39:30.562937+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:35.960485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000555376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.579935+0000","last_change":"2023-11-04T01:39:30.572911+0000","last_active":"2023-11-04T01:39:30.579935+0000","last_peered":"2023-11-04T01:39:30.579935+0000","last_clean":"2023-11-04T01:39:30.579935+0000","last_became_active":"2023-11-04T01:39:30.572651+0000","last_became_peered":"2023-11-04T01:39:30.572651+0000","last_unstale":"2023-11-04T01:39:30.579935+0000","last_undegraded":"2023-11-04T01:39:30.579935+0000","last_fullsized":"2023-11-04T01:39:30.579935+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:37.400454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.561491+0000","last_change":"2023-11-04T01:39:29.545852+0000","last_active":"2023-11-04T01:39:30.561491+0000","last_peered":"2023-11-04T01:39:30.561491+0000","last_clean":"2023-11-04T01:39:30.561491+0000","last_became_active":"2023-11-04T01:39:29.545618+0000","last_became_peered":"2023-11-04T01:39:29.545618+0000","last_unstale":"2023-11-04T01:39:30.561491+0000","last_undegraded":"2023-11-04T01:39:30.561491+0000","last_fullsized":"2023-11-04T01:39:30.561491+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:16:26.830398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533894+0000","last_change":"2023-11-04T01:38:37.216913+0000","last_active":"2023-11-04T01:39:29.533894+0000","last_peered":"2023-11-04T01:39:29.533894+0000","last_clean":"2023-11-04T01:39:29.533894+0000","last_became_active":"2023-11-04T01:38:37.216657+0000","last_became_peered":"2023-11-04T01:38:37.216657+0000","last_unstale":"2023-11-04T01:39:29.533894+0000","last_undegraded":"2023-11-04T01:39:29.533894+0000","last_fullsized":"2023-11-04T01:39:29.533894+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:01:49.838705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.562861+0000","last_change":"2023-11-04T01:38:38.410908+0000","last_active":"2023-11-04T01:39:30.562861+0000","last_peered":"2023-11-04T01:39:30.562861+0000","last_clean":"2023-11-04T01:39:30.562861+0000","last_became_active":"2023-11-04T01:38:36.215279+0000","last_became_peered":"2023-11-04T01:38:36.215279+0000","last_unstale":"2023-11-04T01:39:30.562861+0000","last_undegraded":"2023-11-04T01:39:30.562861+0000","last_fullsized":"2023-11-04T01:39:30.562861+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:58.822427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067743000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568520+0000","last_change":"2023-11-04T01:37:36.695075+0000","last_active":"2023-11-04T01:39:30.568520+0000","last_peered":"2023-11-04T01:39:30.568520+0000","last_clean":"2023-11-04T01:39:30.568520+0000","last_became_active":"2023-11-04T01:37:35.221165+0000","last_became_peered":"2023-11-04T01:37:35.221165+0000","last_unstale":"2023-11-04T01:39:30.568520+0000","last_undegraded":"2023-11-04T01:39:30.568520+0000","last_fullsized":"2023-11-04T01:39:30.568520+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:17.958372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072817499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.579950+0000","last_change":"2023-11-04T01:39:30.575848+0000","last_active":"2023-11-04T01:39:30.579950+0000","last_peered":"2023-11-04T01:39:30.579950+0000","last_clean":"2023-11-04T01:39:30.579950+0000","last_became_active":"2023-11-04T01:39:30.575579+0000","last_became_peered":"2023-11-04T01:39:30.575579+0000","last_unstale":"2023-11-04T01:39:30.579950+0000","last_undegraded":"2023-11-04T01:39:30.579950+0000","last_fullsized":"2023-11-04T01:39:30.579950+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:31:15.596258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"95'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578456+0000","last_change":"2023-11-04T01:39:29.538688+0000","last_active":"2023-11-04T01:39:31.578456+0000","last_peered":"2023-11-04T01:39:31.578456+0000","last_clean":"2023-11-04T01:39:31.578456+0000","last_became_active":"2023-11-04T01:39:29.538406+0000","last_became_peered":"2023-11-04T01:39:29.538406+0000","last_unstale":"2023-11-04T01:39:31.578456+0000","last_undegraded":"2023-11-04T01:39:31.578456+0000","last_fullsized":"2023-11-04T01:39:31.578456+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:24.109415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533592+0000","last_change":"2023-11-04T01:38:37.216633+0000","last_active":"2023-11-04T01:39:29.533592+0000","last_peered":"2023-11-04T01:39:29.533592+0000","last_clean":"2023-11-04T01:39:29.533592+0000","last_became_active":"2023-11-04T01:38:37.216349+0000","last_became_peered":"2023-11-04T01:38:37.216349+0000","last_unstale":"2023-11-04T01:39:29.533592+0000","last_undegraded":"2023-11-04T01:39:29.533592+0000","last_fullsized":"2023-11-04T01:39:29.533592+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:39.883185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536557+0000","last_change":"2023-11-04T01:38:38.457913+0000","last_active":"2023-11-04T01:39:29.536557+0000","last_peered":"2023-11-04T01:39:29.536557+0000","last_clean":"2023-11-04T01:39:29.536557+0000","last_became_active":"2023-11-04T01:38:36.212852+0000","last_became_peered":"2023-11-04T01:38:36.212852+0000","last_unstale":"2023-11-04T01:39:29.536557+0000","last_undegraded":"2023-11-04T01:39:29.536557+0000","last_fullsized":"2023-11-04T01:39:29.536557+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:17.912252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048391299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557419+0000","last_change":"2023-11-04T01:37:36.221747+0000","last_active":"2023-11-04T01:39:30.557419+0000","last_peered":"2023-11-04T01:39:30.557419+0000","last_clean":"2023-11-04T01:39:30.557419+0000","last_became_active":"2023-11-04T01:37:35.223198+0000","last_became_peered":"2023-11-04T01:37:35.223198+0000","last_unstale":"2023-11-04T01:39:30.557419+0000","last_undegraded":"2023-11-04T01:39:30.557419+0000","last_fullsized":"2023-11-04T01:39:30.557419+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097726499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577350+0000","last_change":"2023-11-04T01:39:30.568306+0000","last_active":"2023-11-04T01:39:31.577350+0000","last_peered":"2023-11-04T01:39:31.577350+0000","last_clean":"2023-11-04T01:39:31.577350+0000","last_became_active":"2023-11-04T01:39:30.568034+0000","last_became_peered":"2023-11-04T01:39:30.568034+0000","last_unstale":"2023-11-04T01:39:31.577350+0000","last_undegraded":"2023-11-04T01:39:31.577350+0000","last_fullsized":"2023-11-04T01:39:31.577350+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:36:29.434930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577081+0000","last_change":"2023-11-04T01:39:29.538731+0000","last_active":"2023-11-04T01:39:31.577081+0000","last_peered":"2023-11-04T01:39:31.577081+0000","last_clean":"2023-11-04T01:39:31.577081+0000","last_became_active":"2023-11-04T01:39:29.538328+0000","last_became_peered":"2023-11-04T01:39:29.538328+0000","last_unstale":"2023-11-04T01:39:31.577081+0000","last_undegraded":"2023-11-04T01:39:31.577081+0000","last_fullsized":"2023-11-04T01:39:31.577081+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:46:31.287816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568030+0000","last_change":"2023-11-04T01:38:37.215329+0000","last_active":"2023-11-04T01:39:30.568030+0000","last_peered":"2023-11-04T01:39:30.568030+0000","last_clean":"2023-11-04T01:39:30.568030+0000","last_became_active":"2023-11-04T01:38:37.215049+0000","last_became_peered":"2023-11-04T01:38:37.215049+0000","last_unstale":"2023-11-04T01:39:30.568030+0000","last_undegraded":"2023-11-04T01:39:30.568030+0000","last_fullsized":"2023-11-04T01:39:30.568030+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:22.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557911+0000","last_change":"2023-11-04T01:38:38.207112+0000","last_active":"2023-11-04T01:39:30.557911+0000","last_peered":"2023-11-04T01:39:30.557911+0000","last_clean":"2023-11-04T01:39:30.557911+0000","last_became_active":"2023-11-04T01:38:36.213142+0000","last_became_peered":"2023-11-04T01:38:36.213142+0000","last_unstale":"2023-11-04T01:39:30.557911+0000","last_undegraded":"2023-11-04T01:39:30.557911+0000","last_fullsized":"2023-11-04T01:39:30.557911+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:49.027502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069641099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536742+0000","last_change":"2023-11-04T01:37:36.422496+0000","last_active":"2023-11-04T01:39:29.536742+0000","last_peered":"2023-11-04T01:39:29.536742+0000","last_clean":"2023-11-04T01:39:29.536742+0000","last_became_active":"2023-11-04T01:37:35.221763+0000","last_became_peered":"2023-11-04T01:37:35.221763+0000","last_unstale":"2023-11-04T01:39:29.536742+0000","last_undegraded":"2023-11-04T01:39:29.536742+0000","last_fullsized":"2023-11-04T01:39:29.536742+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073676299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577132+0000","last_change":"2023-11-04T01:39:30.569560+0000","last_active":"2023-11-04T01:39:31.577132+0000","last_peered":"2023-11-04T01:39:31.577132+0000","last_clean":"2023-11-04T01:39:31.577132+0000","last_became_active":"2023-11-04T01:39:30.569314+0000","last_became_peered":"2023-11-04T01:39:30.569314+0000","last_unstale":"2023-11-04T01:39:31.577132+0000","last_undegraded":"2023-11-04T01:39:31.577132+0000","last_fullsized":"2023-11-04T01:39:31.577132+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:52:54.759196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.561560+0000","last_change":"2023-11-04T01:39:29.539969+0000","last_active":"2023-11-04T01:39:30.561560+0000","last_peered":"2023-11-04T01:39:30.561560+0000","last_clean":"2023-11-04T01:39:30.561560+0000","last_became_active":"2023-11-04T01:39:29.539687+0000","last_became_peered":"2023-11-04T01:39:29.539687+0000","last_unstale":"2023-11-04T01:39:30.561560+0000","last_undegraded":"2023-11-04T01:39:30.561560+0000","last_fullsized":"2023-11-04T01:39:30.561560+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:43.346124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557816+0000","last_change":"2023-11-04T01:38:37.217518+0000","last_active":"2023-11-04T01:39:30.557816+0000","last_peered":"2023-11-04T01:39:30.557816+0000","last_clean":"2023-11-04T01:39:30.557816+0000","last_became_active":"2023-11-04T01:38:37.216984+0000","last_became_peered":"2023-11-04T01:38:37.216984+0000","last_unstale":"2023-11-04T01:39:30.557816+0000","last_undegraded":"2023-11-04T01:39:30.557816+0000","last_fullsized":"2023-11-04T01:39:30.557816+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:55.276622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.566984+0000","last_change":"2023-11-04T01:38:38.208679+0000","last_active":"2023-11-04T01:39:30.566984+0000","last_peered":"2023-11-04T01:39:30.566984+0000","last_clean":"2023-11-04T01:39:30.566984+0000","last_became_active":"2023-11-04T01:38:36.213713+0000","last_became_peered":"2023-11-04T01:38:36.213713+0000","last_unstale":"2023-11-04T01:39:30.566984+0000","last_undegraded":"2023-11-04T01:39:30.566984+0000","last_fullsized":"2023-11-04T01:39:30.566984+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:17.912252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099153900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535120+0000","last_change":"2023-11-04T01:37:36.229940+0000","last_active":"2023-11-04T01:39:29.535120+0000","last_peered":"2023-11-04T01:39:29.535120+0000","last_clean":"2023-11-04T01:39:29.535120+0000","last_became_active":"2023-11-04T01:37:35.225121+0000","last_became_peered":"2023-11-04T01:37:35.225121+0000","last_unstale":"2023-11-04T01:39:29.535120+0000","last_undegraded":"2023-11-04T01:39:29.535120+0000","last_fullsized":"2023-11-04T01:39:29.535120+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:12.130671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075648399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571752+0000","last_change":"2023-11-04T01:39:30.581872+0000","last_active":"2023-11-04T01:39:31.571752+0000","last_peered":"2023-11-04T01:39:31.571752+0000","last_clean":"2023-11-04T01:39:31.571752+0000","last_became_active":"2023-11-04T01:39:30.581588+0000","last_became_peered":"2023-11-04T01:39:30.581588+0000","last_unstale":"2023-11-04T01:39:31.571752+0000","last_undegraded":"2023-11-04T01:39:31.571752+0000","last_fullsized":"2023-11-04T01:39:31.571752+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:58.382822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571756+0000","last_change":"2023-11-04T01:39:29.535238+0000","last_active":"2023-11-04T01:39:31.571756+0000","last_peered":"2023-11-04T01:39:31.571756+0000","last_clean":"2023-11-04T01:39:31.571756+0000","last_became_active":"2023-11-04T01:39:29.534977+0000","last_became_peered":"2023-11-04T01:39:29.534977+0000","last_unstale":"2023-11-04T01:39:31.571756+0000","last_undegraded":"2023-11-04T01:39:31.571756+0000","last_fullsized":"2023-11-04T01:39:31.571756+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:36.823441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535878+0000","last_change":"2023-11-04T01:38:37.216659+0000","last_active":"2023-11-04T01:39:29.535878+0000","last_peered":"2023-11-04T01:39:29.535878+0000","last_clean":"2023-11-04T01:39:29.535878+0000","last_became_active":"2023-11-04T01:38:37.216367+0000","last_became_peered":"2023-11-04T01:38:37.216367+0000","last_unstale":"2023-11-04T01:39:29.535878+0000","last_undegraded":"2023-11-04T01:39:29.535878+0000","last_fullsized":"2023-11-04T01:39:29.535878+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:05:01.957845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.564626+0000","last_change":"2023-11-04T01:38:38.411751+0000","last_active":"2023-11-04T01:39:30.564626+0000","last_peered":"2023-11-04T01:39:30.564626+0000","last_clean":"2023-11-04T01:39:30.564626+0000","last_became_active":"2023-11-04T01:38:36.220709+0000","last_became_peered":"2023-11-04T01:38:36.220709+0000","last_unstale":"2023-11-04T01:39:30.564626+0000","last_undegraded":"2023-11-04T01:39:30.564626+0000","last_fullsized":"2023-11-04T01:39:30.564626+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:17.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075331200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535405+0000","last_change":"2023-11-04T01:37:36.422801+0000","last_active":"2023-11-04T01:39:29.535405+0000","last_peered":"2023-11-04T01:39:29.535405+0000","last_clean":"2023-11-04T01:39:29.535405+0000","last_became_active":"2023-11-04T01:37:35.217091+0000","last_became_peered":"2023-11-04T01:37:35.217091+0000","last_unstale":"2023-11-04T01:39:29.535405+0000","last_undegraded":"2023-11-04T01:39:29.535405+0000","last_fullsized":"2023-11-04T01:39:29.535405+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082211999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.577840+0000","last_change":"2023-11-04T01:39:30.570303+0000","last_active":"2023-11-04T01:39:30.577840+0000","last_peered":"2023-11-04T01:39:30.577840+0000","last_clean":"2023-11-04T01:39:30.577840+0000","last_became_active":"2023-11-04T01:39:30.570023+0000","last_became_peered":"2023-11-04T01:39:30.570023+0000","last_unstale":"2023-11-04T01:39:30.577840+0000","last_undegraded":"2023-11-04T01:39:30.577840+0000","last_fullsized":"2023-11-04T01:39:30.577840+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:40:14.060014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.558821+0000","last_change":"2023-11-04T01:39:29.546506+0000","last_active":"2023-11-04T01:39:30.558821+0000","last_peered":"2023-11-04T01:39:30.558821+0000","last_clean":"2023-11-04T01:39:30.558821+0000","last_became_active":"2023-11-04T01:39:29.546217+0000","last_became_peered":"2023-11-04T01:39:29.546217+0000","last_unstale":"2023-11-04T01:39:30.558821+0000","last_undegraded":"2023-11-04T01:39:30.558821+0000","last_fullsized":"2023-11-04T01:39:30.558821+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:28.851054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.567446+0000","last_change":"2023-11-04T01:38:37.218855+0000","last_active":"2023-11-04T01:39:30.567446+0000","last_peered":"2023-11-04T01:39:30.567446+0000","last_clean":"2023-11-04T01:39:30.567446+0000","last_became_active":"2023-11-04T01:38:37.218475+0000","last_became_peered":"2023-11-04T01:38:37.218475+0000","last_unstale":"2023-11-04T01:39:30.567446+0000","last_undegraded":"2023-11-04T01:39:30.567446+0000","last_fullsized":"2023-11-04T01:39:30.567446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:36.735726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.564699+0000","last_change":"2023-11-04T01:38:38.411851+0000","last_active":"2023-11-04T01:39:30.564699+0000","last_peered":"2023-11-04T01:39:30.564699+0000","last_clean":"2023-11-04T01:39:30.564699+0000","last_became_active":"2023-11-04T01:38:36.220767+0000","last_became_peered":"2023-11-04T01:38:36.220767+0000","last_unstale":"2023-11-04T01:39:30.564699+0000","last_undegraded":"2023-11-04T01:39:30.564699+0000","last_fullsized":"2023-11-04T01:39:30.564699+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:42.712180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010894240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557974+0000","last_change":"2023-11-04T01:37:36.222683+0000","last_active":"2023-11-04T01:39:30.557974+0000","last_peered":"2023-11-04T01:39:30.557974+0000","last_clean":"2023-11-04T01:39:30.557974+0000","last_became_active":"2023-11-04T01:37:35.222694+0000","last_became_peered":"2023-11-04T01:37:35.222694+0000","last_unstale":"2023-11-04T01:39:30.557974+0000","last_undegraded":"2023-11-04T01:39:30.557974+0000","last_fullsized":"2023-11-04T01:39:30.557974+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:56.996374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000490194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572906+0000","last_change":"2023-11-04T01:39:30.571231+0000","last_active":"2023-11-04T01:39:31.572906+0000","last_peered":"2023-11-04T01:39:31.572906+0000","last_clean":"2023-11-04T01:39:31.572906+0000","last_became_active":"2023-11-04T01:39:30.570955+0000","last_became_peered":"2023-11-04T01:39:30.570955+0000","last_unstale":"2023-11-04T01:39:31.572906+0000","last_undegraded":"2023-11-04T01:39:31.572906+0000","last_fullsized":"2023-11-04T01:39:31.572906+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:16:24.560163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578449+0000","last_change":"2023-11-04T01:39:29.543347+0000","last_active":"2023-11-04T01:39:31.578449+0000","last_peered":"2023-11-04T01:39:31.578449+0000","last_clean":"2023-11-04T01:39:31.578449+0000","last_became_active":"2023-11-04T01:39:29.542884+0000","last_became_peered":"2023-11-04T01:39:29.542884+0000","last_unstale":"2023-11-04T01:39:31.578449+0000","last_undegraded":"2023-11-04T01:39:31.578449+0000","last_fullsized":"2023-11-04T01:39:31.578449+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:00.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557449+0000","last_change":"2023-11-04T01:38:37.210833+0000","last_active":"2023-11-04T01:39:30.557449+0000","last_peered":"2023-11-04T01:39:30.557449+0000","last_clean":"2023-11-04T01:39:30.557449+0000","last_became_active":"2023-11-04T01:38:37.210565+0000","last_became_peered":"2023-11-04T01:38:37.210565+0000","last_unstale":"2023-11-04T01:39:30.557449+0000","last_undegraded":"2023-11-04T01:39:30.557449+0000","last_fullsized":"2023-11-04T01:39:30.557449+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:14:41.863734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557335+0000","last_change":"2023-11-04T01:38:38.206088+0000","last_active":"2023-11-04T01:39:30.557335+0000","last_peered":"2023-11-04T01:39:30.557335+0000","last_clean":"2023-11-04T01:39:30.557335+0000","last_became_active":"2023-11-04T01:38:36.220921+0000","last_became_peered":"2023-11-04T01:38:36.220921+0000","last_unstale":"2023-11-04T01:39:30.557335+0000","last_undegraded":"2023-11-04T01:39:30.557335+0000","last_fullsized":"2023-11-04T01:39:30.557335+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:33.216936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091997800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.532770+0000","last_change":"2023-11-04T01:37:36.422156+0000","last_active":"2023-11-04T01:39:29.532770+0000","last_peered":"2023-11-04T01:39:29.532770+0000","last_clean":"2023-11-04T01:39:29.532770+0000","last_became_active":"2023-11-04T01:37:35.214925+0000","last_became_peered":"2023-11-04T01:37:35.214925+0000","last_unstale":"2023-11-04T01:39:29.532770+0000","last_undegraded":"2023-11-04T01:39:29.532770+0000","last_fullsized":"2023-11-04T01:39:29.532770+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058029000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578100+0000","last_change":"2023-11-04T01:39:30.587498+0000","last_active":"2023-11-04T01:39:31.578100+0000","last_peered":"2023-11-04T01:39:31.578100+0000","last_clean":"2023-11-04T01:39:31.578100+0000","last_became_active":"2023-11-04T01:39:30.587180+0000","last_became_peered":"2023-11-04T01:39:30.587180+0000","last_unstale":"2023-11-04T01:39:31.578100+0000","last_undegraded":"2023-11-04T01:39:31.578100+0000","last_fullsized":"2023-11-04T01:39:31.578100+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:37.400454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.589771+0000","last_change":"2023-11-04T01:39:29.543373+0000","last_active":"2023-11-04T01:39:30.589771+0000","last_peered":"2023-11-04T01:39:30.589771+0000","last_clean":"2023-11-04T01:39:30.589771+0000","last_became_active":"2023-11-04T01:39:29.543104+0000","last_became_peered":"2023-11-04T01:39:29.543104+0000","last_unstale":"2023-11-04T01:39:30.589771+0000","last_undegraded":"2023-11-04T01:39:30.589771+0000","last_fullsized":"2023-11-04T01:39:30.589771+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:01.229091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533914+0000","last_change":"2023-11-04T01:38:37.217048+0000","last_active":"2023-11-04T01:39:29.533914+0000","last_peered":"2023-11-04T01:39:29.533914+0000","last_clean":"2023-11-04T01:39:29.533914+0000","last_became_active":"2023-11-04T01:38:37.216763+0000","last_became_peered":"2023-11-04T01:38:37.216763+0000","last_unstale":"2023-11-04T01:39:29.533914+0000","last_undegraded":"2023-11-04T01:39:29.533914+0000","last_fullsized":"2023-11-04T01:39:29.533914+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:59.011790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557541+0000","last_change":"2023-11-04T01:38:38.206767+0000","last_active":"2023-11-04T01:39:30.557541+0000","last_peered":"2023-11-04T01:39:30.557541+0000","last_clean":"2023-11-04T01:39:30.557541+0000","last_became_active":"2023-11-04T01:38:36.221413+0000","last_became_peered":"2023-11-04T01:38:36.221413+0000","last_unstale":"2023-11-04T01:39:30.557541+0000","last_undegraded":"2023-11-04T01:39:30.557541+0000","last_fullsized":"2023-11-04T01:39:30.557541+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:08.788172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000941179,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536042+0000","last_change":"2023-11-04T01:37:36.229258+0000","last_active":"2023-11-04T01:39:29.536042+0000","last_peered":"2023-11-04T01:39:29.536042+0000","last_clean":"2023-11-04T01:39:29.536042+0000","last_became_active":"2023-11-04T01:37:35.221720+0000","last_became_peered":"2023-11-04T01:37:35.221720+0000","last_unstale":"2023-11-04T01:39:29.536042+0000","last_undegraded":"2023-11-04T01:39:29.536042+0000","last_fullsized":"2023-11-04T01:39:29.536042+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:09.633236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068644799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578342+0000","last_change":"2023-11-04T01:39:30.587310+0000","last_active":"2023-11-04T01:39:31.578342+0000","last_peered":"2023-11-04T01:39:31.578342+0000","last_clean":"2023-11-04T01:39:31.578342+0000","last_became_active":"2023-11-04T01:39:30.587047+0000","last_became_peered":"2023-11-04T01:39:30.587047+0000","last_unstale":"2023-11-04T01:39:31.578342+0000","last_undegraded":"2023-11-04T01:39:31.578342+0000","last_fullsized":"2023-11-04T01:39:31.578342+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:02.230626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.556775+0000","last_change":"2023-11-04T01:39:29.547432+0000","last_active":"2023-11-04T01:39:30.556775+0000","last_peered":"2023-11-04T01:39:30.556775+0000","last_clean":"2023-11-04T01:39:30.556775+0000","last_became_active":"2023-11-04T01:39:29.546379+0000","last_became_peered":"2023-11-04T01:39:29.546379+0000","last_unstale":"2023-11-04T01:39:30.556775+0000","last_undegraded":"2023-11-04T01:39:30.556775+0000","last_fullsized":"2023-11-04T01:39:30.556775+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:00.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535445+0000","last_change":"2023-11-04T01:38:37.214917+0000","last_active":"2023-11-04T01:39:29.535445+0000","last_peered":"2023-11-04T01:39:29.535445+0000","last_clean":"2023-11-04T01:39:29.535445+0000","last_became_active":"2023-11-04T01:38:37.214649+0000","last_became_peered":"2023-11-04T01:38:37.214649+0000","last_unstale":"2023-11-04T01:39:29.535445+0000","last_undegraded":"2023-11-04T01:39:29.535445+0000","last_fullsized":"2023-11-04T01:39:29.535445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:43.122719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534326+0000","last_change":"2023-11-04T01:38:38.205229+0000","last_active":"2023-11-04T01:39:29.534326+0000","last_peered":"2023-11-04T01:39:29.534326+0000","last_clean":"2023-11-04T01:39:29.534326+0000","last_became_active":"2023-11-04T01:38:36.213122+0000","last_became_peered":"2023-11-04T01:38:36.213122+0000","last_unstale":"2023-11-04T01:39:29.534326+0000","last_undegraded":"2023-11-04T01:39:29.534326+0000","last_fullsized":"2023-11-04T01:39:29.534326+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:24.233394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000519342,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568417+0000","last_change":"2023-11-04T01:37:36.695175+0000","last_active":"2023-11-04T01:39:30.568417+0000","last_peered":"2023-11-04T01:39:30.568417+0000","last_clean":"2023-11-04T01:39:30.568417+0000","last_became_active":"2023-11-04T01:37:35.224473+0000","last_became_peered":"2023-11-04T01:37:35.224473+0000","last_unstale":"2023-11-04T01:39:30.568417+0000","last_undegraded":"2023-11-04T01:39:30.568417+0000","last_fullsized":"2023-11-04T01:39:30.568417+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065377199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572253+0000","last_change":"2023-11-04T01:39:30.582467+0000","last_active":"2023-11-04T01:39:31.572253+0000","last_peered":"2023-11-04T01:39:31.572253+0000","last_clean":"2023-11-04T01:39:31.572253+0000","last_became_active":"2023-11-04T01:39:30.582160+0000","last_became_peered":"2023-11-04T01:39:30.582160+0000","last_unstale":"2023-11-04T01:39:31.572253+0000","last_undegraded":"2023-11-04T01:39:31.572253+0000","last_fullsized":"2023-11-04T01:39:31.572253+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:25:07.765536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572531+0000","last_change":"2023-11-04T01:39:29.536547+0000","last_active":"2023-11-04T01:39:31.572531+0000","last_peered":"2023-11-04T01:39:31.572531+0000","last_clean":"2023-11-04T01:39:31.572531+0000","last_became_active":"2023-11-04T01:39:29.536239+0000","last_became_peered":"2023-11-04T01:39:29.536239+0000","last_unstale":"2023-11-04T01:39:31.572531+0000","last_undegraded":"2023-11-04T01:39:31.572531+0000","last_fullsized":"2023-11-04T01:39:31.572531+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:07.611046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534104+0000","last_change":"2023-11-04T01:38:37.214806+0000","last_active":"2023-11-04T01:39:29.534104+0000","last_peered":"2023-11-04T01:39:29.534104+0000","last_clean":"2023-11-04T01:39:29.534104+0000","last_became_active":"2023-11-04T01:38:37.214511+0000","last_became_peered":"2023-11-04T01:38:37.214511+0000","last_unstale":"2023-11-04T01:39:29.534104+0000","last_undegraded":"2023-11-04T01:39:29.534104+0000","last_fullsized":"2023-11-04T01:39:29.534104+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:48.315344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.562588+0000","last_change":"2023-11-04T01:38:38.411265+0000","last_active":"2023-11-04T01:39:30.562588+0000","last_peered":"2023-11-04T01:39:30.562588+0000","last_clean":"2023-11-04T01:39:30.562588+0000","last_became_active":"2023-11-04T01:38:36.216615+0000","last_became_peered":"2023-11-04T01:38:36.216615+0000","last_unstale":"2023-11-04T01:39:30.562588+0000","last_undegraded":"2023-11-04T01:39:30.562588+0000","last_fullsized":"2023-11-04T01:39:30.562588+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:02.794601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095689400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.565947+0000","last_change":"2023-11-04T01:37:36.222100+0000","last_active":"2023-11-04T01:39:30.565947+0000","last_peered":"2023-11-04T01:39:30.565947+0000","last_clean":"2023-11-04T01:39:30.565947+0000","last_became_active":"2023-11-04T01:37:35.219622+0000","last_became_peered":"2023-11-04T01:37:35.219622+0000","last_unstale":"2023-11-04T01:39:30.565947+0000","last_undegraded":"2023-11-04T01:39:30.565947+0000","last_fullsized":"2023-11-04T01:39:30.565947+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:16.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653496,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578238+0000","last_change":"2023-11-04T01:39:30.582221+0000","last_active":"2023-11-04T01:39:31.578238+0000","last_peered":"2023-11-04T01:39:31.578238+0000","last_clean":"2023-11-04T01:39:31.578238+0000","last_became_active":"2023-11-04T01:39:30.581939+0000","last_became_peered":"2023-11-04T01:39:30.581939+0000","last_unstale":"2023-11-04T01:39:31.578238+0000","last_undegraded":"2023-11-04T01:39:31.578238+0000","last_fullsized":"2023-11-04T01:39:31.578238+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:01.522652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.582053+0000","last_change":"2023-11-04T01:39:29.539955+0000","last_active":"2023-11-04T01:39:30.582053+0000","last_peered":"2023-11-04T01:39:30.582053+0000","last_clean":"2023-11-04T01:39:30.582053+0000","last_became_active":"2023-11-04T01:39:29.539702+0000","last_became_peered":"2023-11-04T01:39:29.539702+0000","last_unstale":"2023-11-04T01:39:30.582053+0000","last_undegraded":"2023-11-04T01:39:30.582053+0000","last_fullsized":"2023-11-04T01:39:30.582053+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:40:13.058479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535330+0000","last_change":"2023-11-04T01:38:37.217077+0000","last_active":"2023-11-04T01:39:29.535330+0000","last_peered":"2023-11-04T01:39:29.535330+0000","last_clean":"2023-11-04T01:39:29.535330+0000","last_became_active":"2023-11-04T01:38:37.216746+0000","last_became_peered":"2023-11-04T01:38:37.216746+0000","last_unstale":"2023-11-04T01:39:29.535330+0000","last_undegraded":"2023-11-04T01:39:29.535330+0000","last_fullsized":"2023-11-04T01:39:29.535330+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:59.828993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535142+0000","last_change":"2023-11-04T01:38:38.205823+0000","last_active":"2023-11-04T01:39:29.535142+0000","last_peered":"2023-11-04T01:39:29.535142+0000","last_clean":"2023-11-04T01:39:29.535142+0000","last_became_active":"2023-11-04T01:38:36.218347+0000","last_became_peered":"2023-11-04T01:38:36.218347+0000","last_unstale":"2023-11-04T01:39:29.535142+0000","last_undegraded":"2023-11-04T01:39:29.535142+0000","last_fullsized":"2023-11-04T01:39:29.535142+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:24:42.129853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042101900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.566448+0000","last_change":"2023-11-04T01:37:36.222451+0000","last_active":"2023-11-04T01:39:30.566448+0000","last_peered":"2023-11-04T01:39:30.566448+0000","last_clean":"2023-11-04T01:39:30.566448+0000","last_became_active":"2023-11-04T01:37:35.221090+0000","last_became_peered":"2023-11-04T01:37:35.221090+0000","last_unstale":"2023-11-04T01:39:30.566448+0000","last_undegraded":"2023-11-04T01:39:30.566448+0000","last_fullsized":"2023-11-04T01:39:30.566448+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077263799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571737+0000","last_change":"2023-11-04T01:39:30.567977+0000","last_active":"2023-11-04T01:39:31.571737+0000","last_peered":"2023-11-04T01:39:31.571737+0000","last_clean":"2023-11-04T01:39:31.571737+0000","last_became_active":"2023-11-04T01:39:30.567662+0000","last_became_peered":"2023-11-04T01:39:30.567662+0000","last_unstale":"2023-11-04T01:39:31.571737+0000","last_undegraded":"2023-11-04T01:39:31.571737+0000","last_fullsized":"2023-11-04T01:39:31.571737+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:39:57.076382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.587201+0000","last_change":"2023-11-04T01:39:29.549461+0000","last_active":"2023-11-04T01:39:30.587201+0000","last_peered":"2023-11-04T01:39:30.587201+0000","last_clean":"2023-11-04T01:39:30.587201+0000","last_became_active":"2023-11-04T01:39:29.549188+0000","last_became_peered":"2023-11-04T01:39:29.549188+0000","last_unstale":"2023-11-04T01:39:30.587201+0000","last_undegraded":"2023-11-04T01:39:30.587201+0000","last_fullsized":"2023-11-04T01:39:30.587201+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:59.471990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557733+0000","last_change":"2023-11-04T01:38:37.212670+0000","last_active":"2023-11-04T01:39:30.557733+0000","last_peered":"2023-11-04T01:39:30.557733+0000","last_clean":"2023-11-04T01:39:30.557733+0000","last_became_active":"2023-11-04T01:38:37.212044+0000","last_became_peered":"2023-11-04T01:38:37.212044+0000","last_unstale":"2023-11-04T01:39:30.557733+0000","last_undegraded":"2023-11-04T01:39:30.557733+0000","last_fullsized":"2023-11-04T01:39:30.557733+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:23.460377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534871+0000","last_change":"2023-11-04T01:38:38.205885+0000","last_active":"2023-11-04T01:39:29.534871+0000","last_peered":"2023-11-04T01:39:29.534871+0000","last_clean":"2023-11-04T01:39:29.534871+0000","last_became_active":"2023-11-04T01:38:36.218439+0000","last_became_peered":"2023-11-04T01:38:36.218439+0000","last_unstale":"2023-11-04T01:39:29.534871+0000","last_undegraded":"2023-11-04T01:39:29.534871+0000","last_fullsized":"2023-11-04T01:39:29.534871+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:50.283563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039456400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.567701+0000","last_change":"2023-11-04T01:37:36.222643+0000","last_active":"2023-11-04T01:39:30.567701+0000","last_peered":"2023-11-04T01:39:30.567701+0000","last_clean":"2023-11-04T01:39:30.567701+0000","last_became_active":"2023-11-04T01:37:35.215534+0000","last_became_peered":"2023-11-04T01:37:35.215534+0000","last_unstale":"2023-11-04T01:39:30.567701+0000","last_undegraded":"2023-11-04T01:39:30.567701+0000","last_fullsized":"2023-11-04T01:39:30.567701+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011110530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.580891+0000","last_change":"2023-11-04T01:39:30.576294+0000","last_active":"2023-11-04T01:39:30.580891+0000","last_peered":"2023-11-04T01:39:30.580891+0000","last_clean":"2023-11-04T01:39:30.580891+0000","last_became_active":"2023-11-04T01:39:30.576061+0000","last_became_peered":"2023-11-04T01:39:30.576061+0000","last_unstale":"2023-11-04T01:39:30.580891+0000","last_undegraded":"2023-11-04T01:39:30.580891+0000","last_fullsized":"2023-11-04T01:39:30.580891+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:49.903966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571799+0000","last_change":"2023-11-04T01:39:29.539024+0000","last_active":"2023-11-04T01:39:31.571799+0000","last_peered":"2023-11-04T01:39:31.571799+0000","last_clean":"2023-11-04T01:39:31.571799+0000","last_became_active":"2023-11-04T01:39:29.538758+0000","last_became_peered":"2023-11-04T01:39:29.538758+0000","last_unstale":"2023-11-04T01:39:31.571799+0000","last_undegraded":"2023-11-04T01:39:31.571799+0000","last_fullsized":"2023-11-04T01:39:31.571799+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:25:55.522457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557588+0000","last_change":"2023-11-04T01:38:37.214797+0000","last_active":"2023-11-04T01:39:30.557588+0000","last_peered":"2023-11-04T01:39:30.557588+0000","last_clean":"2023-11-04T01:39:30.557588+0000","last_became_active":"2023-11-04T01:38:37.214465+0000","last_became_peered":"2023-11-04T01:38:37.214465+0000","last_unstale":"2023-11-04T01:39:30.557588+0000","last_undegraded":"2023-11-04T01:39:30.557588+0000","last_fullsized":"2023-11-04T01:39:30.557588+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:36.735726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.567543+0000","last_change":"2023-11-04T01:38:38.207798+0000","last_active":"2023-11-04T01:39:30.567543+0000","last_peered":"2023-11-04T01:39:30.567543+0000","last_clean":"2023-11-04T01:39:30.567543+0000","last_became_active":"2023-11-04T01:38:36.213815+0000","last_became_peered":"2023-11-04T01:38:36.213815+0000","last_unstale":"2023-11-04T01:39:30.567543+0000","last_undegraded":"2023-11-04T01:39:30.567543+0000","last_fullsized":"2023-11-04T01:39:30.567543+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:54.270056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092951700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.572397+0000","last_change":"2023-11-04T01:37:36.695402+0000","last_active":"2023-11-04T01:39:30.572397+0000","last_peered":"2023-11-04T01:39:30.572397+0000","last_clean":"2023-11-04T01:39:30.572397+0000","last_became_active":"2023-11-04T01:37:35.220346+0000","last_became_peered":"2023-11-04T01:37:35.220346+0000","last_unstale":"2023-11-04T01:39:30.572397+0000","last_undegraded":"2023-11-04T01:39:30.572397+0000","last_fullsized":"2023-11-04T01:39:30.572397+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:42.331692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062230100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.571664+0000","last_change":"2023-11-04T01:39:30.579031+0000","last_active":"2023-11-04T01:39:31.571664+0000","last_peered":"2023-11-04T01:39:31.571664+0000","last_clean":"2023-11-04T01:39:31.571664+0000","last_became_active":"2023-11-04T01:39:30.578754+0000","last_became_peered":"2023-11-04T01:39:30.578754+0000","last_unstale":"2023-11-04T01:39:31.571664+0000","last_undegraded":"2023-11-04T01:39:31.571664+0000","last_fullsized":"2023-11-04T01:39:31.571664+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:39.952106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.577067+0000","last_change":"2023-11-04T01:39:29.541705+0000","last_active":"2023-11-04T01:39:31.577067+0000","last_peered":"2023-11-04T01:39:31.577067+0000","last_clean":"2023-11-04T01:39:31.577067+0000","last_became_active":"2023-11-04T01:39:29.541422+0000","last_became_peered":"2023-11-04T01:39:29.541422+0000","last_unstale":"2023-11-04T01:39:31.577067+0000","last_undegraded":"2023-11-04T01:39:31.577067+0000","last_fullsized":"2023-11-04T01:39:31.577067+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:07.088325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.567618+0000","last_change":"2023-11-04T01:38:37.216420+0000","last_active":"2023-11-04T01:39:30.567618+0000","last_peered":"2023-11-04T01:39:30.567618+0000","last_clean":"2023-11-04T01:39:30.567618+0000","last_became_active":"2023-11-04T01:38:37.216145+0000","last_became_peered":"2023-11-04T01:38:37.216145+0000","last_unstale":"2023-11-04T01:39:30.567618+0000","last_undegraded":"2023-11-04T01:39:30.567618+0000","last_fullsized":"2023-11-04T01:39:30.567618+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:19.049672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.566257+0000","last_change":"2023-11-04T01:38:38.207981+0000","last_active":"2023-11-04T01:39:30.566257+0000","last_peered":"2023-11-04T01:39:30.566257+0000","last_clean":"2023-11-04T01:39:30.566257+0000","last_became_active":"2023-11-04T01:38:36.213518+0000","last_became_peered":"2023-11-04T01:38:36.213518+0000","last_unstale":"2023-11-04T01:39:30.566257+0000","last_undegraded":"2023-11-04T01:39:30.566257+0000","last_fullsized":"2023-11-04T01:39:30.566257+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:20.114870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000824821,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":66,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.540923+0000","last_change":"2023-11-04T01:37:36.426315+0000","last_active":"2023-11-04T01:39:29.540923+0000","last_peered":"2023-11-04T01:39:29.540923+0000","last_clean":"2023-11-04T01:39:29.540923+0000","last_became_active":"2023-11-04T01:37:35.223958+0000","last_became_peered":"2023-11-04T01:37:35.223958+0000","last_unstale":"2023-11-04T01:39:29.540923+0000","last_undegraded":"2023-11-04T01:39:29.540923+0000","last_fullsized":"2023-11-04T01:39:29.540923+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:46.733116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025167400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578937+0000","last_change":"2023-11-04T01:39:30.578518+0000","last_active":"2023-11-04T01:39:31.578937+0000","last_peered":"2023-11-04T01:39:31.578937+0000","last_clean":"2023-11-04T01:39:31.578937+0000","last_became_active":"2023-11-04T01:39:30.578240+0000","last_became_peered":"2023-11-04T01:39:30.578240+0000","last_unstale":"2023-11-04T01:39:31.578937+0000","last_undegraded":"2023-11-04T01:39:31.578937+0000","last_fullsized":"2023-11-04T01:39:31.578937+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:31.247096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.581103+0000","last_change":"2023-11-04T01:39:29.541937+0000","last_active":"2023-11-04T01:39:30.581103+0000","last_peered":"2023-11-04T01:39:30.581103+0000","last_clean":"2023-11-04T01:39:30.581103+0000","last_became_active":"2023-11-04T01:39:29.541613+0000","last_became_peered":"2023-11-04T01:39:29.541613+0000","last_unstale":"2023-11-04T01:39:30.581103+0000","last_undegraded":"2023-11-04T01:39:30.581103+0000","last_fullsized":"2023-11-04T01:39:30.581103+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:43:19.770473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":32,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568321+0000","last_change":"2023-11-04T01:38:37.214483+0000","last_active":"2023-11-04T01:39:30.568321+0000","last_peered":"2023-11-04T01:39:30.568321+0000","last_clean":"2023-11-04T01:39:30.568321+0000","last_became_active":"2023-11-04T01:38:37.214116+0000","last_became_peered":"2023-11-04T01:38:37.214116+0000","last_unstale":"2023-11-04T01:39:30.568321+0000","last_undegraded":"2023-11-04T01:39:30.568321+0000","last_fullsized":"2023-11-04T01:39:30.568321+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:41:24.595793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557353+0000","last_change":"2023-11-04T01:38:38.206897+0000","last_active":"2023-11-04T01:39:30.557353+0000","last_peered":"2023-11-04T01:39:30.557353+0000","last_clean":"2023-11-04T01:39:30.557353+0000","last_became_active":"2023-11-04T01:38:36.220906+0000","last_became_peered":"2023-11-04T01:38:36.220906+0000","last_unstale":"2023-11-04T01:39:30.557353+0000","last_undegraded":"2023-11-04T01:39:30.557353+0000","last_fullsized":"2023-11-04T01:39:30.557353+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:08:23.409256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001547536,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.562756+0000","last_change":"2023-11-04T01:37:36.694540+0000","last_active":"2023-11-04T01:39:30.562756+0000","last_peered":"2023-11-04T01:39:30.562756+0000","last_clean":"2023-11-04T01:39:30.562756+0000","last_became_active":"2023-11-04T01:37:35.225863+0000","last_became_peered":"2023-11-04T01:37:35.225863+0000","last_unstale":"2023-11-04T01:39:30.562756+0000","last_undegraded":"2023-11-04T01:39:30.562756+0000","last_fullsized":"2023-11-04T01:39:30.562756+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:42.654853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042277299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.591146+0000","last_change":"2023-11-04T01:39:30.589381+0000","last_active":"2023-11-04T01:39:30.591146+0000","last_peered":"2023-11-04T01:39:30.591146+0000","last_clean":"2023-11-04T01:39:30.591146+0000","last_became_active":"2023-11-04T01:39:30.589088+0000","last_became_peered":"2023-11-04T01:39:30.589088+0000","last_unstale":"2023-11-04T01:39:30.591146+0000","last_undegraded":"2023-11-04T01:39:30.591146+0000","last_fullsized":"2023-11-04T01:39:30.591146+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:07.980448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"95'4","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.578866+0000","last_change":"2023-11-04T01:39:29.540095+0000","last_active":"2023-11-04T01:39:30.578866+0000","last_peered":"2023-11-04T01:39:30.578866+0000","last_clean":"2023-11-04T01:39:30.578866+0000","last_became_active":"2023-11-04T01:39:29.539794+0000","last_became_peered":"2023-11-04T01:39:29.539794+0000","last_unstale":"2023-11-04T01:39:30.578866+0000","last_undegraded":"2023-11-04T01:39:30.578866+0000","last_fullsized":"2023-11-04T01:39:30.578866+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:04:05.638181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.537163+0000","last_change":"2023-11-04T01:38:37.213554+0000","last_active":"2023-11-04T01:39:29.537163+0000","last_peered":"2023-11-04T01:39:29.537163+0000","last_clean":"2023-11-04T01:39:29.537163+0000","last_became_active":"2023-11-04T01:38:37.213233+0000","last_became_peered":"2023-11-04T01:38:37.213233+0000","last_unstale":"2023-11-04T01:39:29.537163+0000","last_undegraded":"2023-11-04T01:39:29.537163+0000","last_fullsized":"2023-11-04T01:39:29.537163+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:19.049672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568311+0000","last_change":"2023-11-04T01:38:38.411573+0000","last_active":"2023-11-04T01:39:30.568311+0000","last_peered":"2023-11-04T01:39:30.568311+0000","last_clean":"2023-11-04T01:39:30.568311+0000","last_became_active":"2023-11-04T01:38:36.217578+0000","last_became_peered":"2023-11-04T01:38:36.217578+0000","last_unstale":"2023-11-04T01:39:30.568311+0000","last_undegraded":"2023-11-04T01:39:30.568311+0000","last_fullsized":"2023-11-04T01:39:30.568311+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:42.116154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067089600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":66,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.538875+0000","last_change":"2023-11-04T01:37:36.426202+0000","last_active":"2023-11-04T01:39:29.538875+0000","last_peered":"2023-11-04T01:39:29.538875+0000","last_clean":"2023-11-04T01:39:29.538875+0000","last_became_active":"2023-11-04T01:37:35.222997+0000","last_became_peered":"2023-11-04T01:37:35.222997+0000","last_unstale":"2023-11-04T01:39:29.538875+0000","last_undegraded":"2023-11-04T01:39:29.538875+0000","last_fullsized":"2023-11-04T01:39:29.538875+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:18.980751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041393700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.579955+0000","last_change":"2023-11-04T01:39:30.576086+0000","last_active":"2023-11-04T01:39:30.579955+0000","last_peered":"2023-11-04T01:39:30.579955+0000","last_clean":"2023-11-04T01:39:30.579955+0000","last_became_active":"2023-11-04T01:39:30.575252+0000","last_became_peered":"2023-11-04T01:39:30.575252+0000","last_unstale":"2023-11-04T01:39:30.579955+0000","last_undegraded":"2023-11-04T01:39:30.579955+0000","last_fullsized":"2023-11-04T01:39:30.579955+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:35.599627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.588321+0000","last_change":"2023-11-04T01:39:29.548137+0000","last_active":"2023-11-04T01:39:30.588321+0000","last_peered":"2023-11-04T01:39:30.588321+0000","last_clean":"2023-11-04T01:39:30.588321+0000","last_became_active":"2023-11-04T01:39:29.547824+0000","last_became_peered":"2023-11-04T01:39:29.547824+0000","last_unstale":"2023-11-04T01:39:30.588321+0000","last_undegraded":"2023-11-04T01:39:30.588321+0000","last_fullsized":"2023-11-04T01:39:30.588321+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:58.987317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.564773+0000","last_change":"2023-11-04T01:38:37.215851+0000","last_active":"2023-11-04T01:39:30.564773+0000","last_peered":"2023-11-04T01:39:30.564773+0000","last_clean":"2023-11-04T01:39:30.564773+0000","last_became_active":"2023-11-04T01:38:37.215502+0000","last_became_peered":"2023-11-04T01:38:37.215502+0000","last_unstale":"2023-11-04T01:39:30.564773+0000","last_undegraded":"2023-11-04T01:39:30.564773+0000","last_fullsized":"2023-11-04T01:39:30.564773+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:22.227302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.556384+0000","last_change":"2023-11-04T01:38:38.206372+0000","last_active":"2023-11-04T01:39:30.556384+0000","last_peered":"2023-11-04T01:39:30.556384+0000","last_clean":"2023-11-04T01:39:30.556384+0000","last_became_active":"2023-11-04T01:38:36.211612+0000","last_became_peered":"2023-11-04T01:38:36.211612+0000","last_unstale":"2023-11-04T01:39:30.556384+0000","last_undegraded":"2023-11-04T01:39:30.556384+0000","last_fullsized":"2023-11-04T01:39:30.556384+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:35.785664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015171970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534732+0000","last_change":"2023-11-04T01:37:36.220713+0000","last_active":"2023-11-04T01:39:29.534732+0000","last_peered":"2023-11-04T01:39:29.534732+0000","last_clean":"2023-11-04T01:39:29.534732+0000","last_became_active":"2023-11-04T01:37:35.220311+0000","last_became_peered":"2023-11-04T01:37:35.220311+0000","last_unstale":"2023-11-04T01:39:29.534732+0000","last_undegraded":"2023-11-04T01:39:29.534732+0000","last_fullsized":"2023-11-04T01:39:29.534732+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:57.202106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062999799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.587714+0000","last_change":"2023-11-04T01:39:30.578876+0000","last_active":"2023-11-04T01:39:30.587714+0000","last_peered":"2023-11-04T01:39:30.587714+0000","last_clean":"2023-11-04T01:39:30.587714+0000","last_became_active":"2023-11-04T01:39:30.578572+0000","last_became_peered":"2023-11-04T01:39:30.578572+0000","last_unstale":"2023-11-04T01:39:30.587714+0000","last_undegraded":"2023-11-04T01:39:30.587714+0000","last_fullsized":"2023-11-04T01:39:30.587714+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:00.473526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.588604+0000","last_change":"2023-11-04T01:39:29.548234+0000","last_active":"2023-11-04T01:39:30.588604+0000","last_peered":"2023-11-04T01:39:30.588604+0000","last_clean":"2023-11-04T01:39:30.588604+0000","last_became_active":"2023-11-04T01:39:29.547923+0000","last_became_peered":"2023-11-04T01:39:29.547923+0000","last_unstale":"2023-11-04T01:39:30.588604+0000","last_undegraded":"2023-11-04T01:39:30.588604+0000","last_fullsized":"2023-11-04T01:39:30.588604+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:26.419171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534180+0000","last_change":"2023-11-04T01:38:37.216051+0000","last_active":"2023-11-04T01:39:29.534180+0000","last_peered":"2023-11-04T01:39:29.534180+0000","last_clean":"2023-11-04T01:39:29.534180+0000","last_became_active":"2023-11-04T01:38:37.215779+0000","last_became_peered":"2023-11-04T01:38:37.215779+0000","last_unstale":"2023-11-04T01:39:29.534180+0000","last_undegraded":"2023-11-04T01:39:29.534180+0000","last_fullsized":"2023-11-04T01:39:29.534180+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:38:51.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.564847+0000","last_change":"2023-11-04T01:38:38.207161+0000","last_active":"2023-11-04T01:39:30.564847+0000","last_peered":"2023-11-04T01:39:30.564847+0000","last_clean":"2023-11-04T01:39:30.564847+0000","last_became_active":"2023-11-04T01:38:36.215721+0000","last_became_peered":"2023-11-04T01:38:36.215721+0000","last_unstale":"2023-11-04T01:39:30.564847+0000","last_undegraded":"2023-11-04T01:39:30.564847+0000","last_fullsized":"2023-11-04T01:39:30.564847+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:49.027502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046667399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533875+0000","last_change":"2023-11-04T01:37:36.229580+0000","last_active":"2023-11-04T01:39:29.533875+0000","last_peered":"2023-11-04T01:39:29.533875+0000","last_clean":"2023-11-04T01:39:29.533875+0000","last_became_active":"2023-11-04T01:37:35.220940+0000","last_became_peered":"2023-11-04T01:37:35.220940+0000","last_unstale":"2023-11-04T01:39:29.533875+0000","last_undegraded":"2023-11-04T01:39:29.533875+0000","last_fullsized":"2023-11-04T01:39:29.533875+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:27.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070235600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.578631+0000","last_change":"2023-11-04T01:39:30.571831+0000","last_active":"2023-11-04T01:39:30.578631+0000","last_peered":"2023-11-04T01:39:30.578631+0000","last_clean":"2023-11-04T01:39:30.578631+0000","last_became_active":"2023-11-04T01:39:30.571107+0000","last_became_peered":"2023-11-04T01:39:30.571107+0000","last_unstale":"2023-11-04T01:39:30.578631+0000","last_undegraded":"2023-11-04T01:39:30.578631+0000","last_fullsized":"2023-11-04T01:39:30.578631+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:27.749912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578320+0000","last_change":"2023-11-04T01:39:29.541825+0000","last_active":"2023-11-04T01:39:31.578320+0000","last_peered":"2023-11-04T01:39:31.578320+0000","last_clean":"2023-11-04T01:39:31.578320+0000","last_became_active":"2023-11-04T01:39:29.541568+0000","last_became_peered":"2023-11-04T01:39:29.541568+0000","last_unstale":"2023-11-04T01:39:31.578320+0000","last_undegraded":"2023-11-04T01:39:31.578320+0000","last_fullsized":"2023-11-04T01:39:31.578320+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:34.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.567942+0000","last_change":"2023-11-04T01:38:37.214340+0000","last_active":"2023-11-04T01:39:30.567942+0000","last_peered":"2023-11-04T01:39:30.567942+0000","last_clean":"2023-11-04T01:39:30.567942+0000","last_became_active":"2023-11-04T01:38:37.214056+0000","last_became_peered":"2023-11-04T01:38:37.214056+0000","last_unstale":"2023-11-04T01:39:30.567942+0000","last_undegraded":"2023-11-04T01:39:30.567942+0000","last_fullsized":"2023-11-04T01:39:30.567942+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:38:51.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568996+0000","last_change":"2023-11-04T01:38:38.411617+0000","last_active":"2023-11-04T01:39:30.568996+0000","last_peered":"2023-11-04T01:39:30.568996+0000","last_clean":"2023-11-04T01:39:30.568996+0000","last_became_active":"2023-11-04T01:38:36.222201+0000","last_became_peered":"2023-11-04T01:38:36.222201+0000","last_unstale":"2023-11-04T01:39:30.568996+0000","last_undegraded":"2023-11-04T01:39:30.568996+0000","last_fullsized":"2023-11-04T01:39:30.568996+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:01.464511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064531400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536114+0000","last_change":"2023-11-04T01:37:36.422542+0000","last_active":"2023-11-04T01:39:29.536114+0000","last_peered":"2023-11-04T01:39:29.536114+0000","last_clean":"2023-11-04T01:39:29.536114+0000","last_became_active":"2023-11-04T01:37:35.224836+0000","last_became_peered":"2023-11-04T01:37:35.224836+0000","last_unstale":"2023-11-04T01:39:29.536114+0000","last_undegraded":"2023-11-04T01:39:29.536114+0000","last_fullsized":"2023-11-04T01:39:29.536114+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:51.667871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066982800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.575903+0000","last_change":"2023-11-04T01:39:30.568784+0000","last_active":"2023-11-04T01:39:30.575903+0000","last_peered":"2023-11-04T01:39:30.575903+0000","last_clean":"2023-11-04T01:39:30.575903+0000","last_became_active":"2023-11-04T01:39:30.568446+0000","last_became_peered":"2023-11-04T01:39:30.568446+0000","last_unstale":"2023-11-04T01:39:30.575903+0000","last_undegraded":"2023-11-04T01:39:30.575903+0000","last_fullsized":"2023-11-04T01:39:30.575903+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:35.599627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.588118+0000","last_change":"2023-11-04T01:39:29.538768+0000","last_active":"2023-11-04T01:39:30.588118+0000","last_peered":"2023-11-04T01:39:30.588118+0000","last_clean":"2023-11-04T01:39:30.588118+0000","last_became_active":"2023-11-04T01:39:29.538480+0000","last_became_peered":"2023-11-04T01:39:29.538480+0000","last_unstale":"2023-11-04T01:39:30.588118+0000","last_undegraded":"2023-11-04T01:39:30.588118+0000","last_fullsized":"2023-11-04T01:39:30.588118+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:38.033218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.532893+0000","last_change":"2023-11-04T01:38:37.214695+0000","last_active":"2023-11-04T01:39:29.532893+0000","last_peered":"2023-11-04T01:39:29.532893+0000","last_clean":"2023-11-04T01:39:29.532893+0000","last_became_active":"2023-11-04T01:38:37.214378+0000","last_became_peered":"2023-11-04T01:38:37.214378+0000","last_unstale":"2023-11-04T01:39:29.532893+0000","last_undegraded":"2023-11-04T01:39:29.532893+0000","last_fullsized":"2023-11-04T01:39:29.532893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:54:14.757431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.567828+0000","last_change":"2023-11-04T01:38:38.208722+0000","last_active":"2023-11-04T01:39:30.567828+0000","last_peered":"2023-11-04T01:39:30.567828+0000","last_clean":"2023-11-04T01:39:30.567828+0000","last_became_active":"2023-11-04T01:38:36.213352+0000","last_became_peered":"2023-11-04T01:38:36.213352+0000","last_unstale":"2023-11-04T01:39:30.567828+0000","last_undegraded":"2023-11-04T01:39:30.567828+0000","last_fullsized":"2023-11-04T01:39:30.567828+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:47.308778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082430899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.564714+0000","last_change":"2023-11-04T01:37:36.694868+0000","last_active":"2023-11-04T01:39:30.564714+0000","last_peered":"2023-11-04T01:39:30.564714+0000","last_clean":"2023-11-04T01:39:30.564714+0000","last_became_active":"2023-11-04T01:37:35.221181+0000","last_became_peered":"2023-11-04T01:37:35.221181+0000","last_unstale":"2023-11-04T01:39:30.564714+0000","last_undegraded":"2023-11-04T01:39:30.564714+0000","last_fullsized":"2023-11-04T01:39:30.564714+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:30:58.881201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046748800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.575898+0000","last_change":"2023-11-04T01:39:30.567036+0000","last_active":"2023-11-04T01:39:30.575898+0000","last_peered":"2023-11-04T01:39:30.575898+0000","last_clean":"2023-11-04T01:39:30.575898+0000","last_became_active":"2023-11-04T01:39:30.566748+0000","last_became_peered":"2023-11-04T01:39:30.566748+0000","last_unstale":"2023-11-04T01:39:30.575898+0000","last_undegraded":"2023-11-04T01:39:30.575898+0000","last_fullsized":"2023-11-04T01:39:30.575898+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:37.400454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"95'8","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.591054+0000","last_change":"2023-11-04T01:39:29.548402+0000","last_active":"2023-11-04T01:39:30.591054+0000","last_peered":"2023-11-04T01:39:30.591054+0000","last_clean":"2023-11-04T01:39:30.591054+0000","last_became_active":"2023-11-04T01:39:29.548105+0000","last_became_peered":"2023-11-04T01:39:29.548105+0000","last_unstale":"2023-11-04T01:39:30.591054+0000","last_undegraded":"2023-11-04T01:39:30.591054+0000","last_fullsized":"2023-11-04T01:39:30.591054+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:10.767719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557535+0000","last_change":"2023-11-04T01:38:37.213179+0000","last_active":"2023-11-04T01:39:30.557535+0000","last_peered":"2023-11-04T01:39:30.557535+0000","last_clean":"2023-11-04T01:39:30.557535+0000","last_became_active":"2023-11-04T01:38:37.212784+0000","last_became_peered":"2023-11-04T01:38:37.212784+0000","last_unstale":"2023-11-04T01:39:30.557535+0000","last_undegraded":"2023-11-04T01:39:30.557535+0000","last_fullsized":"2023-11-04T01:39:30.557535+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:22.227302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.564521+0000","last_change":"2023-11-04T01:38:38.411421+0000","last_active":"2023-11-04T01:39:30.564521+0000","last_peered":"2023-11-04T01:39:30.564521+0000","last_clean":"2023-11-04T01:39:30.564521+0000","last_became_active":"2023-11-04T01:38:36.218508+0000","last_became_peered":"2023-11-04T01:38:36.218508+0000","last_unstale":"2023-11-04T01:39:30.564521+0000","last_undegraded":"2023-11-04T01:39:30.564521+0000","last_fullsized":"2023-11-04T01:39:30.564521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:47:59.491789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085522699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.568185+0000","last_change":"2023-11-04T01:37:36.222930+0000","last_active":"2023-11-04T01:39:30.568185+0000","last_peered":"2023-11-04T01:39:30.568185+0000","last_clean":"2023-11-04T01:39:30.568185+0000","last_became_active":"2023-11-04T01:37:35.220373+0000","last_became_peered":"2023-11-04T01:37:35.220373+0000","last_unstale":"2023-11-04T01:39:30.568185+0000","last_undegraded":"2023-11-04T01:39:30.568185+0000","last_fullsized":"2023-11-04T01:39:30.568185+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:54.213932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074099599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.578859+0000","last_change":"2023-11-04T01:39:30.587377+0000","last_active":"2023-11-04T01:39:31.578859+0000","last_peered":"2023-11-04T01:39:31.578859+0000","last_clean":"2023-11-04T01:39:31.578859+0000","last_became_active":"2023-11-04T01:39:30.587083+0000","last_became_peered":"2023-11-04T01:39:30.587083+0000","last_unstale":"2023-11-04T01:39:31.578859+0000","last_undegraded":"2023-11-04T01:39:31.578859+0000","last_fullsized":"2023-11-04T01:39:31.578859+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:57.784358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557386+0000","last_change":"2023-11-04T01:39:29.544325+0000","last_active":"2023-11-04T01:39:30.557386+0000","last_peered":"2023-11-04T01:39:30.557386+0000","last_clean":"2023-11-04T01:39:30.557386+0000","last_became_active":"2023-11-04T01:39:29.544065+0000","last_became_peered":"2023-11-04T01:39:29.544065+0000","last_unstale":"2023-11-04T01:39:30.557386+0000","last_undegraded":"2023-11-04T01:39:30.557386+0000","last_fullsized":"2023-11-04T01:39:30.557386+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:56.782823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534405+0000","last_change":"2023-11-04T01:38:37.212376+0000","last_active":"2023-11-04T01:39:29.534405+0000","last_peered":"2023-11-04T01:39:29.534405+0000","last_clean":"2023-11-04T01:39:29.534405+0000","last_became_active":"2023-11-04T01:38:37.211932+0000","last_became_peered":"2023-11-04T01:38:37.211932+0000","last_unstale":"2023-11-04T01:39:29.534405+0000","last_undegraded":"2023-11-04T01:39:29.534405+0000","last_fullsized":"2023-11-04T01:39:29.534405+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:02.363703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.539695+0000","last_change":"2023-11-04T01:38:38.247627+0000","last_active":"2023-11-04T01:39:29.539695+0000","last_peered":"2023-11-04T01:39:29.539695+0000","last_clean":"2023-11-04T01:39:29.539695+0000","last_became_active":"2023-11-04T01:38:36.218231+0000","last_became_peered":"2023-11-04T01:38:36.218231+0000","last_unstale":"2023-11-04T01:39:29.539695+0000","last_undegraded":"2023-11-04T01:39:29.539695+0000","last_fullsized":"2023-11-04T01:39:29.539695+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:52.412436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010241499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.557146+0000","last_change":"2023-11-04T01:37:36.221676+0000","last_active":"2023-11-04T01:39:30.557146+0000","last_peered":"2023-11-04T01:39:30.557146+0000","last_clean":"2023-11-04T01:39:30.557146+0000","last_became_active":"2023-11-04T01:37:35.226996+0000","last_became_peered":"2023-11-04T01:37:35.226996+0000","last_unstale":"2023-11-04T01:39:30.557146+0000","last_undegraded":"2023-11-04T01:39:30.557146+0000","last_fullsized":"2023-11-04T01:39:30.557146+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:29.984292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089115500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.581408+0000","last_change":"2023-11-04T01:39:30.579934+0000","last_active":"2023-11-04T01:39:30.581408+0000","last_peered":"2023-11-04T01:39:30.581408+0000","last_clean":"2023-11-04T01:39:30.581408+0000","last_became_active":"2023-11-04T01:39:30.579675+0000","last_became_peered":"2023-11-04T01:39:30.579675+0000","last_unstale":"2023-11-04T01:39:30.581408+0000","last_undegraded":"2023-11-04T01:39:30.581408+0000","last_fullsized":"2023-11-04T01:39:30.581408+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:39.034753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.558017+0000","last_change":"2023-11-04T01:39:29.546285+0000","last_active":"2023-11-04T01:39:30.558017+0000","last_peered":"2023-11-04T01:39:30.558017+0000","last_clean":"2023-11-04T01:39:30.558017+0000","last_became_active":"2023-11-04T01:39:29.545903+0000","last_became_peered":"2023-11-04T01:39:29.545903+0000","last_unstale":"2023-11-04T01:39:30.558017+0000","last_undegraded":"2023-11-04T01:39:30.558017+0000","last_fullsized":"2023-11-04T01:39:30.558017+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:41.708558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.539672+0000","last_change":"2023-11-04T01:38:37.212816+0000","last_active":"2023-11-04T01:39:29.539672+0000","last_peered":"2023-11-04T01:39:29.539672+0000","last_clean":"2023-11-04T01:39:29.539672+0000","last_became_active":"2023-11-04T01:38:37.212512+0000","last_became_peered":"2023-11-04T01:38:37.212512+0000","last_unstale":"2023-11-04T01:39:29.539672+0000","last_undegraded":"2023-11-04T01:39:29.539672+0000","last_fullsized":"2023-11-04T01:39:29.539672+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:07.947093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.532527+0000","last_change":"2023-11-04T01:38:38.636602+0000","last_active":"2023-11-04T01:39:29.532527+0000","last_peered":"2023-11-04T01:39:29.532527+0000","last_clean":"2023-11-04T01:39:29.532527+0000","last_became_active":"2023-11-04T01:38:36.213670+0000","last_became_peered":"2023-11-04T01:38:36.213670+0000","last_unstale":"2023-11-04T01:39:29.532527+0000","last_undegraded":"2023-11-04T01:39:29.532527+0000","last_fullsized":"2023-11-04T01:39:29.532527+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:42.712180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056085900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":58,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535904+0000","last_change":"2023-11-04T01:37:36.228535+0000","last_active":"2023-11-04T01:39:29.535904+0000","last_peered":"2023-11-04T01:39:29.535904+0000","last_clean":"2023-11-04T01:39:29.535904+0000","last_became_active":"2023-11-04T01:37:35.221173+0000","last_became_peered":"2023-11-04T01:37:35.221173+0000","last_unstale":"2023-11-04T01:39:29.535904+0000","last_undegraded":"2023-11-04T01:39:29.535904+0000","last_fullsized":"2023-11-04T01:39:29.535904+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049831099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.581335+0000","last_change":"2023-11-04T01:39:30.579519+0000","last_active":"2023-11-04T01:39:30.581335+0000","last_peered":"2023-11-04T01:39:30.581335+0000","last_clean":"2023-11-04T01:39:30.581335+0000","last_became_active":"2023-11-04T01:39:30.579250+0000","last_became_peered":"2023-11-04T01:39:30.579250+0000","last_unstale":"2023-11-04T01:39:30.581335+0000","last_undegraded":"2023-11-04T01:39:30.581335+0000","last_fullsized":"2023-11-04T01:39:30.581335+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:05.397842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"95'6","reported_seq":18,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572253+0000","last_change":"2023-11-04T01:39:29.538954+0000","last_active":"2023-11-04T01:39:31.572253+0000","last_peered":"2023-11-04T01:39:31.572253+0000","last_clean":"2023-11-04T01:39:31.572253+0000","last_became_active":"2023-11-04T01:39:29.538689+0000","last_became_peered":"2023-11-04T01:39:29.538689+0000","last_unstale":"2023-11-04T01:39:31.572253+0000","last_undegraded":"2023-11-04T01:39:31.572253+0000","last_fullsized":"2023-11-04T01:39:31.572253+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:40.062430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.536424+0000","last_change":"2023-11-04T01:38:37.214627+0000","last_active":"2023-11-04T01:39:29.536424+0000","last_peered":"2023-11-04T01:39:29.536424+0000","last_clean":"2023-11-04T01:39:29.536424+0000","last_became_active":"2023-11-04T01:38:37.214336+0000","last_became_peered":"2023-11-04T01:38:37.214336+0000","last_unstale":"2023-11-04T01:39:29.536424+0000","last_undegraded":"2023-11-04T01:39:29.536424+0000","last_fullsized":"2023-11-04T01:39:29.536424+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:21.121436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535964+0000","last_change":"2023-11-04T01:38:38.635992+0000","last_active":"2023-11-04T01:39:29.535964+0000","last_peered":"2023-11-04T01:39:29.535964+0000","last_clean":"2023-11-04T01:39:29.535964+0000","last_became_active":"2023-11-04T01:38:36.215694+0000","last_became_peered":"2023-11-04T01:38:36.215694+0000","last_unstale":"2023-11-04T01:39:29.535964+0000","last_undegraded":"2023-11-04T01:39:29.535964+0000","last_fullsized":"2023-11-04T01:39:29.535964+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:01.464511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036495599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.532626+0000","last_change":"2023-11-04T01:37:36.229678+0000","last_active":"2023-11-04T01:39:29.532626+0000","last_peered":"2023-11-04T01:39:29.532626+0000","last_clean":"2023-11-04T01:39:29.532626+0000","last_became_active":"2023-11-04T01:37:35.222676+0000","last_became_peered":"2023-11-04T01:37:35.222676+0000","last_unstale":"2023-11-04T01:39:29.532626+0000","last_undegraded":"2023-11-04T01:39:29.532626+0000","last_fullsized":"2023-11-04T01:39:29.532626+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:50.484332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.577078+0000","last_change":"2023-11-04T01:39:30.566300+0000","last_active":"2023-11-04T01:39:30.577078+0000","last_peered":"2023-11-04T01:39:30.577078+0000","last_clean":"2023-11-04T01:39:30.577078+0000","last_became_active":"2023-11-04T01:39:30.565992+0000","last_became_peered":"2023-11-04T01:39:30.565992+0000","last_unstale":"2023-11-04T01:39:30.577078+0000","last_undegraded":"2023-11-04T01:39:30.577078+0000","last_fullsized":"2023-11-04T01:39:30.577078+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:51:25.094779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"95'3","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-04T01:39:31.572431+0000","last_change":"2023-11-04T01:39:29.537541+0000","last_active":"2023-11-04T01:39:31.572431+0000","last_peered":"2023-11-04T01:39:31.572431+0000","last_clean":"2023-11-04T01:39:31.572431+0000","last_became_active":"2023-11-04T01:39:29.537267+0000","last_became_peered":"2023-11-04T01:39:29.537267+0000","last_unstale":"2023-11-04T01:39:31.572431+0000","last_undegraded":"2023-11-04T01:39:31.572431+0000","last_fullsized":"2023-11-04T01:39:31.572431+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:44.703854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.538712+0000","last_change":"2023-11-04T01:38:37.212620+0000","last_active":"2023-11-04T01:39:29.538712+0000","last_peered":"2023-11-04T01:39:29.538712+0000","last_clean":"2023-11-04T01:39:29.538712+0000","last_became_active":"2023-11-04T01:38:37.212294+0000","last_became_peered":"2023-11-04T01:38:37.212294+0000","last_unstale":"2023-11-04T01:39:29.538712+0000","last_undegraded":"2023-11-04T01:39:29.538712+0000","last_fullsized":"2023-11-04T01:39:29.538712+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:02.424394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.538964+0000","last_change":"2023-11-04T01:38:38.246984+0000","last_active":"2023-11-04T01:39:29.538964+0000","last_peered":"2023-11-04T01:39:29.538964+0000","last_clean":"2023-11-04T01:39:29.538964+0000","last_became_active":"2023-11-04T01:38:36.211685+0000","last_became_peered":"2023-11-04T01:38:36.211685+0000","last_unstale":"2023-11-04T01:39:29.538964+0000","last_undegraded":"2023-11-04T01:39:29.538964+0000","last_fullsized":"2023-11-04T01:39:29.538964+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:50.973560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051504199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533951+0000","last_change":"2023-11-04T01:37:36.229908+0000","last_active":"2023-11-04T01:39:29.533951+0000","last_peered":"2023-11-04T01:39:29.533951+0000","last_clean":"2023-11-04T01:39:29.533951+0000","last_became_active":"2023-11-04T01:37:35.221822+0000","last_became_peered":"2023-11-04T01:37:35.221822+0000","last_unstale":"2023-11-04T01:39:29.533951+0000","last_undegraded":"2023-11-04T01:39:29.533951+0000","last_fullsized":"2023-11-04T01:39:29.533951+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:11.866738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089270799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.578697+0000","last_change":"2023-11-04T01:39:30.570401+0000","last_active":"2023-11-04T01:39:30.578697+0000","last_peered":"2023-11-04T01:39:30.578697+0000","last_clean":"2023-11-04T01:39:30.578697+0000","last_became_active":"2023-11-04T01:39:30.570139+0000","last_became_peered":"2023-11-04T01:39:30.570139+0000","last_unstale":"2023-11-04T01:39:30.578697+0000","last_undegraded":"2023-11-04T01:39:30.578697+0000","last_fullsized":"2023-11-04T01:39:30.578697+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:29.520041+0000","last_clean_scrub_stamp":"2023-11-04T01:39:29.520041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:31:15.596258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.566063+0000","last_change":"2023-11-04T01:39:29.543847+0000","last_active":"2023-11-04T01:39:30.566063+0000","last_peered":"2023-11-04T01:39:30.566063+0000","last_clean":"2023-11-04T01:39:30.566063+0000","last_became_active":"2023-11-04T01:39:29.543583+0000","last_became_peered":"2023-11-04T01:39:29.543583+0000","last_unstale":"2023-11-04T01:39:30.566063+0000","last_undegraded":"2023-11-04T01:39:30.566063+0000","last_fullsized":"2023-11-04T01:39:30.566063+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:28.518505+0000","last_clean_scrub_stamp":"2023-11-04T01:39:28.518505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:06:54.037791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.533919+0000","last_change":"2023-11-04T01:38:37.215184+0000","last_active":"2023-11-04T01:39:29.533919+0000","last_peered":"2023-11-04T01:39:29.533919+0000","last_clean":"2023-11-04T01:39:29.533919+0000","last_became_active":"2023-11-04T01:38:37.214888+0000","last_became_peered":"2023-11-04T01:38:37.214888+0000","last_unstale":"2023-11-04T01:39:29.533919+0000","last_undegraded":"2023-11-04T01:39:29.533919+0000","last_fullsized":"2023-11-04T01:39:29.533919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:36.196203+0000","last_clean_scrub_stamp":"2023-11-04T01:38:36.196203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:34.067351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.535959+0000","last_change":"2023-11-04T01:38:38.637027+0000","last_active":"2023-11-04T01:39:29.535959+0000","last_peered":"2023-11-04T01:39:29.535959+0000","last_clean":"2023-11-04T01:39:29.535959+0000","last_became_active":"2023-11-04T01:38:36.221149+0000","last_became_peered":"2023-11-04T01:38:36.221149+0000","last_unstale":"2023-11-04T01:39:29.535959+0000","last_undegraded":"2023-11-04T01:39:29.535959+0000","last_fullsized":"2023-11-04T01:39:29.535959+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:35.189638+0000","last_clean_scrub_stamp":"2023-11-04T01:38:35.189638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:12.755546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045543500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:30.569131+0000","last_change":"2023-11-04T01:37:36.695345+0000","last_active":"2023-11-04T01:39:30.569131+0000","last_peered":"2023-11-04T01:39:30.569131+0000","last_clean":"2023-11-04T01:39:30.569131+0000","last_became_active":"2023-11-04T01:37:35.225441+0000","last_became_peered":"2023-11-04T01:37:35.225441+0000","last_unstale":"2023-11-04T01:39:30.569131+0000","last_undegraded":"2023-11-04T01:39:30.569131+0000","last_fullsized":"2023-11-04T01:39:30.569131+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:34.202944+0000","last_clean_scrub_stamp":"2023-11-04T01:37:34.202944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:47.623989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052758199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":227,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:29.534361+0000","last_change":"2023-11-04T01:35:47.769691+0000","last_active":"2023-11-04T01:39:29.534361+0000","last_peered":"2023-11-04T01:39:29.534361+0000","last_clean":"2023-11-04T01:39:29.534361+0000","last_became_active":"2023-11-04T01:35:47.768854+0000","last_became_peered":"2023-11-04T01:35:47.768854+0000","last_unstale":"2023-11-04T01:39:29.534361+0000","last_undegraded":"2023-11-04T01:39:29.534361+0000","last_fullsized":"2023-11-04T01:39:29.534361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:46.628845+0000","last_clean_scrub_stamp":"2023-11-04T01:35:46.628845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:47.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1773568,"data_stored":1170153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.65800000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.503,"15min":0.503},"min":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65400000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.51500000000000001},"min":{"1min":0.41199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76900000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.73899999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.39100000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72999999999999998,"5min":0.745,"15min":0.745},"last":0.83599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56599999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72299999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.45800000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72399999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.628}]},{"osd":5,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.34399999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77100000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.35099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88700000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.82099999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83899999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.35999999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.77000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1175552,"data_stored":579239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89600000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.628}]},{"osd":1,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74199999999999999,"5min":1.004,"15min":1.004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79800000000000004,"5min":1.085,"15min":1.085},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81499999999999995,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84899999999999998,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67800000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73699999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96199999999999997,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.73799999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.313,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77800000000000002,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.752},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.373,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86499999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.69899999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73799999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83099999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.45700000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69199999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.63500000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79600000000000004,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.77900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":579773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.86399999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.44},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77700000000000002,"5min":1.24,"15min":1.24},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82899999999999996,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79200000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.83599999999999997,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.503}]},{"osd":3,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.41399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.434,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.502,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73899999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.504,"15min":0.50600000000000001},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82199999999999995,"5min":0.877,"15min":0.877},"last":0.39900000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70799999999999996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80600000000000005,"5min":1.284,"15min":1.284},"last":0.56699999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72599999999999998,"5min":0.746,"15min":0.746},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.77200000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.46000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1171456,"data_stored":579169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.501,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.253,"15min":0.253},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.63},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.36199999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.61399999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.38700000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70599999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72799999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.51400000000000001,"15min":0.498},"min":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.752,"5min":1.022,"15min":1.022},"last":0.66500000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.44800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66700000000000004,"5min":1.002,"15min":1.002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.57199999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.501,"15min":0.48599999999999999},"min":{"1min":0.36499999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":1.127,"15min":1.127},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77000000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55200000000000005,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.80500000000000005,"5min":1.079,"15min":1.079},"last":0.70499999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.038,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63800000000000001,"15min":0.629},"min":{"1min":0.40000000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.72199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1187840,"data_stored":580851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.248,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.221},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.39300000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.40799999999999997},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.40799999999999997},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.94799999999999995,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.27300000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44900000000000001,"15min":0.46700000000000003},"min":{"1min":0.34999999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59199999999999997,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.378}]},{"osd":4,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.622},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.622,"15min":0.64200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83699999999999997,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.58299999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.623,"15min":0.63},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83299999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.56200000000000006}]},{"osd":7,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.45000000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68000000000000005,"15min":0.69499999999999995},"min":{"1min":0.51400000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.87,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.60999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1171456,"data_stored":579169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.35299999999999998,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.19,"15min":0.19},"max":{"1min":0.60399999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35299999999999998,"15min":0.37},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.49399999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.32800000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36299999999999999,"15min":0.36699999999999999},"min":{"1min":0.255,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.5,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.318},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51500000000000001,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.36799999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.876,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.44},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.627,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79900000000000004,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.45400000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70199999999999996,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.628,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.81200000000000006,"5min":1.052,"15min":1.052},"last":0.38}]},{"osd":6,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82099999999999995,"5min":1.393,"15min":1.393},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80200000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.46700000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72799999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.65100000000000002,"15min":0.67400000000000004},"min":{"1min":0.42299999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71799999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.42899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1179648,"data_stored":579293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32700000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.5},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.36799999999999999,"15min":0.379},"min":{"1min":0.22,"5min":0.192,"15min":0.192},"max":{"1min":0.496,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33600000000000002,"15min":0.33100000000000002},"min":{"1min":0.26700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.44,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.37,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51500000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40999999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42199999999999999,"15min":0.42899999999999999},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54100000000000004,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.375,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52800000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.38100000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70199999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.40899999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78100000000000003,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.72299999999999998,"5min":1.02,"15min":1.02},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81399999999999995,"5min":1.089,"15min":1.089},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.623,"15min":0.629},"min":{"1min":0.441,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80000000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.755,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86599999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.64000000000000001},"min":{"1min":0.44700000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82799999999999996,"5min":1.153,"15min":1.153},"last":0.52900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1781760,"data_stored":1170242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34899999999999998,"15min":0.35499999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.55400000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.27000000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57999999999999996,"5min":0.629,"15min":0.629},"last":0.27000000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.36199999999999999,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51800000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.39400000000000002,"15min":0.40200000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53900000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.38900000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.379,"15min":0.38800000000000001},"min":{"1min":0.27400000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52200000000000002,"5min":0.628,"15min":0.628},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40000000000000002,"15min":0.40100000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.59599999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.32600000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94899999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59899999999999998,"15min":0.58299999999999996},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85599999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.98299999999999998,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.55600000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.48299999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91000000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.622},"min":{"1min":0.46100000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92200000000000004,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.628},"min":{"1min":0.499,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85899999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:39:33.934 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:39:33.934 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:39:34.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.078+0000 7fbfa4fa5640 1 Processor -- start 2023-11-04T01:39:34.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.078+0000 7fbfa4fa5640 1 -- start start 2023-11-04T01:39:34.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.079+0000 7fbfa4fa5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbfa0160430 0x7fbfa00b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.079+0000 7fbfa4fa5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa00b2fc0 con 0x7fbfa00b2b60 2023-11-04T01:39:34.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.079+0000 7fbfa4fa5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa006c7d0 con 0x7fbfa006c3a0 2023-11-04T01:39:34.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.079+0000 7fbfa4fa5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa00cb580 con 0x7fbfa0160430 2023-11-04T01:39:34.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.079+0000 7fbf9dd9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbfa00b2b60 0x7fbfa006bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43960/0 (socket says 172.21.15.44:43960) 2023-11-04T01:39:34.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.079+0000 7fbf9dd9b640 1 -- 172.21.15.44:0/1600646598 learned_addr learned my addr 172.21.15.44:0/1600646598 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:34.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.079+0000 7fbf9d59a640 1 -- 172.21.15.44:0/1600646598 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830989334 0 0) 0x7fbfa00b2fc0 con 0x7fbfa00b2b60 2023-11-04T01:39:34.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.079+0000 7fbf9d59a640 1 -- 172.21.15.44:0/1600646598 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf8c003520 con 0x7fbfa00b2b60 2023-11-04T01:39:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.079+0000 7fbf9e59c640 1 --2- 172.21.15.44:0/1600646598 >> v2:172.21.15.204:3300/0 conn(0x7fbfa0160430 0x7fbfa00b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9d59a640 1 -- 172.21.15.44:0/1600646598 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2693605752 0 0) 0x7fbf8c003520 con 0x7fbfa00b2b60 2023-11-04T01:39:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9d59a640 1 -- 172.21.15.44:0/1600646598 >> v2:172.21.15.204:3300/0 conn(0x7fbfa0160430 msgr2=0x7fbfa00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9d59a640 1 --2- 172.21.15.44:0/1600646598 >> v2:172.21.15.204:3300/0 conn(0x7fbfa0160430 0x7fbfa00b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9d59a640 1 -- 172.21.15.44:0/1600646598 >> v1:172.21.15.204:6789/0 conn(0x7fbfa006c3a0 legacy=0x7fbfa00cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9d59a640 1 -- 172.21.15.44:0/1600646598 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa006ca40 con 0x7fbfa00b2b60 2023-11-04T01:39:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9d59a640 1 -- 172.21.15.44:0/1600646598 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fbf88001670 con 0x7fbfa00b2b60 2023-11-04T01:39:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9d59a640 1 -- 172.21.15.44:0/1600646598 >> v1:172.21.15.44:6789/0 conn(0x7fbfa00b2b60 legacy=0x7fbfa006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9d59a640 1 --2- 172.21.15.44:0/1600646598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf8c003970 0x7fbf8c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9d59a640 1 --2- 172.21.15.44:0/1600646598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf8c0047c0 0x7fbf8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9d59a640 1 --2- 172.21.15.44:0/1600646598 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf8c005180 0x7fbf8c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9d59a640 1 -- 172.21.15.44:0/1600646598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa00cb580 con 0x7fbf8c003970 2023-11-04T01:39:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9d59a640 1 -- 172.21.15.44:0/1600646598 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c00c020 con 0x7fbf8c005180 2023-11-04T01:39:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9d59a640 1 -- 172.21.15.44:0/1600646598 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c00c1e0 con 0x7fbf8c0047c0 2023-11-04T01:39:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9e59c640 1 --2- 172.21.15.44:0/1600646598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf8c003970 0x7fbf8c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9dd9b640 1 --2- 172.21.15.44:0/1600646598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf8c0047c0 0x7fbf8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9ed9d640 1 --2- 172.21.15.44:0/1600646598 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf8c005180 0x7fbf8c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9e59c640 1 -- 172.21.15.44:0/1600646598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf8c0047c0 msgr2=0x7fbf8c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9e59c640 1 --2- 172.21.15.44:0/1600646598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf8c0047c0 0x7fbf8c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9e59c640 1 -- 172.21.15.44:0/1600646598 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf8c005180 msgr2=0x7fbf8c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9e59c640 1 --2- 172.21.15.44:0/1600646598 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf8c005180 0x7fbf8c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9ed9d640 1 -- 172.21.15.44:0/1600646598 reap_dead start 2023-11-04T01:39:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9e59c640 1 -- 172.21.15.44:0/1600646598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c003520 con 0x7fbf8c003970 2023-11-04T01:39:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.080+0000 7fbf9dd9b640 1 --2- 172.21.15.44:0/1600646598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf8c0047c0 0x7fbf8c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.081+0000 7fbf9e59c640 1 --2- 172.21.15.44:0/1600646598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf8c003970 0x7fbf8c003d90 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009ac0 tx=0x7fbf8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb0abacd2eeebee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.081+0000 7fbf9d59a640 1 -- 172.21.15.44:0/1600646598 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9802c6b0 con 0x7fbf8c003970 2023-11-04T01:39:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.081+0000 7fbf9d59a640 1 -- 172.21.15.44:0/1600646598 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9802c810 con 0x7fbf8c003970 2023-11-04T01:39:34.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.081+0000 7fbf9d59a640 1 -- 172.21.15.44:0/1600646598 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9802cba0 con 0x7fbf8c003970 2023-11-04T01:39:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.082+0000 7fbfa4fa5640 1 -- 172.21.15.44:0/1600646598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf8c003970 msgr2=0x7fbf8c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.082+0000 7fbfa4fa5640 1 --2- 172.21.15.44:0/1600646598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf8c003970 0x7fbf8c003d90 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009ac0 tx=0x7fbf8c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.082+0000 7fbfa4fa5640 1 -- 172.21.15.44:0/1600646598 shutdown_connections 2023-11-04T01:39:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.082+0000 7fbfa4fa5640 1 --2- 172.21.15.44:0/1600646598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf8c003970 0x7fbf8c003d90 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.082+0000 7fbfa4fa5640 1 -- 172.21.15.44:0/1600646598 >> 172.21.15.44:0/1600646598 conn(0x7fbfa006ea20 msgr2=0x7fbfa006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.082+0000 7fbfa4fa5640 1 -- 172.21.15.44:0/1600646598 shutdown_connections 2023-11-04T01:39:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.082+0000 7fbfa4fa5640 1 -- 172.21.15.44:0/1600646598 wait complete. 2023-11-04T01:39:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.083+0000 7fbfa4fa5640 1 Processor -- start 2023-11-04T01:39:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.083+0000 7fbfa4fa5640 1 -- start start 2023-11-04T01:39:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbfa4fa5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf8c003970 0x7fbfa00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbfa4fa5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbfa00b37c0 0x7fbfa015e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbfa4fa5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbfa01f1f60 0x7fbfa00b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbfa4fa5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa00b3d80 con 0x7fbf8c003970 2023-11-04T01:39:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbfa4fa5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa00b4060 con 0x7fbfa01f1f60 2023-11-04T01:39:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbfa4fa5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa00b4340 con 0x7fbfa00b37c0 2023-11-04T01:39:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbf9e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf8c003970 0x7fbfa00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbf9e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf8c003970 0x7fbfa00b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32898/0 (socket says 172.21.15.44:32898) 2023-11-04T01:39:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbf9e59c640 1 -- 172.21.15.44:0/1244047254 learned_addr learned my addr 172.21.15.44:0/1244047254 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbf9dd9b640 1 --2- 172.21.15.44:0/1244047254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbfa00b37c0 0x7fbfa015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbf9ed9d640 1 --2- 172.21.15.44:0/1244047254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbfa01f1f60 0x7fbfa00b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbf9e59c640 1 -- 172.21.15.44:0/1244047254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbfa00b37c0 msgr2=0x7fbfa015e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbf9e59c640 1 --2- 172.21.15.44:0/1244047254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbfa00b37c0 0x7fbfa015e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbf9e59c640 1 -- 172.21.15.44:0/1244047254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbfa01f1f60 msgr2=0x7fbfa00b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbf9e59c640 1 --2- 172.21.15.44:0/1244047254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbfa01f1f60 0x7fbfa00b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.084+0000 7fbf9e59c640 1 -- 172.21.15.44:0/1244047254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa00b4620 con 0x7fbf8c003970 2023-11-04T01:39:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.085+0000 7fbf9e59c640 1 --2- 172.21.15.44:0/1244047254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf8c003970 0x7fbfa00b4e20 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009ac0 tx=0x7fbf98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.085+0000 7fbf96ffd640 1 -- 172.21.15.44:0/1244047254 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98003810 con 0x7fbf8c003970 2023-11-04T01:39:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.085+0000 7fbf96ffd640 1 -- 172.21.15.44:0/1244047254 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf98003970 con 0x7fbf8c003970 2023-11-04T01:39:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.085+0000 7fbfa4fa5640 1 -- 172.21.15.44:0/1244047254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa00b4900 con 0x7fbf8c003970 2023-11-04T01:39:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.085+0000 7fbf96ffd640 1 -- 172.21.15.44:0/1244047254 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98003d00 con 0x7fbf8c003970 2023-11-04T01:39:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.085+0000 7fbfa4fa5640 1 -- 172.21.15.44:0/1244047254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa01f23e0 con 0x7fbf8c003970 2023-11-04T01:39:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.086+0000 7fbfa4fa5640 1 -- 172.21.15.44:0/1244047254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa01f2570 con 0x7fbf8c003970 2023-11-04T01:39:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.086+0000 7fbf96ffd640 1 -- 172.21.15.44:0/1244047254 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf98040450 con 0x7fbf8c003970 2023-11-04T01:39:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.087+0000 7fbf96ffd640 1 --2- 172.21.15.44:0/1244047254 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf8006aea0 0x7fbf8006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.087+0000 7fbf96ffd640 1 -- 172.21.15.44:0/1244047254 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fbf980abea0 con 0x7fbf8c003970 2023-11-04T01:39:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.087+0000 7fbf9dd9b640 1 --2- 172.21.15.44:0/1244047254 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf8006aea0 0x7fbf8006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.087+0000 7fbf9dd9b640 1 --2- 172.21.15.44:0/1244047254 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf8006aea0 0x7fbf8006d360 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbf88001eb0 tx=0x7fbf88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.091+0000 7fbf96ffd640 1 -- 172.21.15.44:0/1244047254 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbf98076b00 con 0x7fbf8c003970 2023-11-04T01:39:34.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.335+0000 7fbfa4fa5640 1 -- 172.21.15.44:0/1244047254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbfa0074290 con 0x7fbf8c003970 2023-11-04T01:39:34.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.337+0000 7fbf96ffd640 1 -- 172.21.15.44:0/1244047254 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7fbf980440b0 con 0x7fbf8c003970 2023-11-04T01:39:34.339 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2023-11-04T01:39:34.339 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDEn0VlmqcrLRAAFCsu/sJUUh45gPboIgq6Dw== 2023-11-04T01:39:34.339 INFO:teuthology.orchestra.run.smithi044.stdout: caps mds = "allow" 2023-11-04T01:39:34.339 INFO:teuthology.orchestra.run.smithi044.stdout: caps mon = "allow r" 2023-11-04T01:39:34.339 INFO:teuthology.orchestra.run.smithi044.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:39:34.339 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2023-11-04T01:39:34.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.339+0000 7fbfa4fa5640 1 -- 172.21.15.44:0/1244047254 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf8006aea0 msgr2=0x7fbf8006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.339+0000 7fbfa4fa5640 1 --2- 172.21.15.44:0/1244047254 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf8006aea0 0x7fbf8006d360 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbf88001eb0 tx=0x7fbf88009040 comp rx=0 tx=0).stop 2023-11-04T01:39:34.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.339+0000 7fbfa4fa5640 1 -- 172.21.15.44:0/1244047254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf8c003970 msgr2=0x7fbfa00b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.339+0000 7fbfa4fa5640 1 --2- 172.21.15.44:0/1244047254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf8c003970 0x7fbfa00b4e20 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009ac0 tx=0x7fbf98004730 comp rx=0 tx=0).stop 2023-11-04T01:39:34.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.339+0000 7fbfa4fa5640 1 -- 172.21.15.44:0/1244047254 shutdown_connections 2023-11-04T01:39:34.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.339+0000 7fbfa4fa5640 1 --2- 172.21.15.44:0/1244047254 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf8006aea0 0x7fbf8006d360 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.339+0000 7fbfa4fa5640 1 --2- 172.21.15.44:0/1244047254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbfa01f1f60 0x7fbfa00b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.339+0000 7fbfa4fa5640 1 --2- 172.21.15.44:0/1244047254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbfa00b37c0 0x7fbfa015e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.339+0000 7fbfa4fa5640 1 --2- 172.21.15.44:0/1244047254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf8c003970 0x7fbfa00b4e20 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.339+0000 7fbfa4fa5640 1 -- 172.21.15.44:0/1244047254 >> 172.21.15.44:0/1244047254 conn(0x7fbfa006ea20 msgr2=0x7fbfa015a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.339+0000 7fbfa4fa5640 1 -- 172.21.15.44:0/1244047254 shutdown_connections 2023-11-04T01:39:34.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.339+0000 7fbfa4fa5640 1 -- 172.21.15.44:0/1244047254 wait complete. 2023-11-04T01:39:34.352 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:34.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.456+0000 7f4490a64640 1 Processor -- start 2023-11-04T01:39:34.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.456+0000 7f4490a64640 1 -- start start 2023-11-04T01:39:34.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.457+0000 7f4490a64640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f448c159c70 0x7f448c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.457+0000 7f4490a64640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448c0b4110 con 0x7f448c0b0ae0 2023-11-04T01:39:34.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.457+0000 7f4490a64640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448c0b43f0 con 0x7f448c06db20 2023-11-04T01:39:34.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.457+0000 7f4490a64640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448c0b49b0 con 0x7f448c159c70 2023-11-04T01:39:34.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.457+0000 7f448a59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f448c159c70 0x7f448c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.457+0000 7f448ad9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f448c0b0ae0 0x7f448c15d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43966/0 (socket says 172.21.15.44:43966) 2023-11-04T01:39:34.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.457+0000 7f448ad9d640 1 -- 172.21.15.44:0/210125816 learned_addr learned my addr 172.21.15.44:0/210125816 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:34.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.458+0000 7f448a59c640 1 -- 172.21.15.44:0/210125816 >> v1:172.21.15.204:6789/0 conn(0x7f448c06db20 legacy=0x7f448c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.458+0000 7f448a59c640 1 -- 172.21.15.44:0/210125816 >> v1:172.21.15.44:6789/0 conn(0x7f448c0b0ae0 legacy=0x7f448c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.458+0000 7f448a59c640 1 -- 172.21.15.44:0/210125816 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c0b46d0 con 0x7f448c159c70 2023-11-04T01:39:34.461 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.458+0000 7f448959a640 1 -- 172.21.15.44:0/210125816 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565889771 0 0) 0x7f448c0b4110 con 0x7f448c0b0ae0 2023-11-04T01:39:34.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.458+0000 7f448a59c640 1 --2- 172.21.15.44:0/210125816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f448c159c70 0x7f448c0ce370 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f44840097a0 tx=0x7f448402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf118da3d695e00 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.459+0000 7f448959a640 1 -- 172.21.15.44:0/210125816 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484030610 con 0x7f448c159c70 2023-11-04T01:39:34.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.459+0000 7f448959a640 1 -- 172.21.15.44:0/210125816 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4484030770 con 0x7f448c159c70 2023-11-04T01:39:34.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.459+0000 7f448959a640 1 -- 172.21.15.44:0/210125816 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484030b00 con 0x7f448c159c70 2023-11-04T01:39:34.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.459+0000 7f4490a64640 1 -- 172.21.15.44:0/210125816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f448c159c70 msgr2=0x7f448c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.459+0000 7f4490a64640 1 --2- 172.21.15.44:0/210125816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f448c159c70 0x7f448c0ce370 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f44840097a0 tx=0x7f448402b960 comp rx=0 tx=0).stop 2023-11-04T01:39:34.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.459+0000 7f4490a64640 1 -- 172.21.15.44:0/210125816 shutdown_connections 2023-11-04T01:39:34.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.459+0000 7f4490a64640 1 --2- 172.21.15.44:0/210125816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f448c159c70 0x7f448c0ce370 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.459+0000 7f4490a64640 1 -- 172.21.15.44:0/210125816 >> 172.21.15.44:0/210125816 conn(0x7f448c0ce950 msgr2=0x7f448c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.459+0000 7f4490a64640 1 -- 172.21.15.44:0/210125816 shutdown_connections 2023-11-04T01:39:34.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.459+0000 7f4490a64640 1 -- 172.21.15.44:0/210125816 wait complete. 2023-11-04T01:39:34.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.461+0000 7f4490a64640 1 Processor -- start 2023-11-04T01:39:34.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.461+0000 7f4490a64640 1 -- start start 2023-11-04T01:39:34.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.461+0000 7f4490a64640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f448c06db20 0x7f448c070980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.461+0000 7f4490a64640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f448c0b0ae0 0x7f448c155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.461+0000 7f4490a64640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f448c159c70 0x7f448c14ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.461+0000 7f4490a64640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c0b0280 con 0x7f448c159c70 2023-11-04T01:39:34.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.461+0000 7f4490a64640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c1f6ea0 con 0x7f448c06db20 2023-11-04T01:39:34.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.461+0000 7f4490a64640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c1f6290 con 0x7f448c0b0ae0 2023-11-04T01:39:34.467 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.461+0000 7f448ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f448c159c70 0x7f448c14ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.461+0000 7f448ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f448c159c70 0x7f448c14ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32914/0 (socket says 172.21.15.44:32914) 2023-11-04T01:39:34.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.461+0000 7f448ad9d640 1 -- 172.21.15.44:0/835293026 learned_addr learned my addr 172.21.15.44:0/835293026 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:34.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.462+0000 7f448a59c640 1 --2- 172.21.15.44:0/835293026 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f448c06db20 0x7f448c070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.462+0000 7f4489d9b640 1 --2- 172.21.15.44:0/835293026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f448c0b0ae0 0x7f448c155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.462+0000 7f448ad9d640 1 -- 172.21.15.44:0/835293026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f448c0b0ae0 msgr2=0x7f448c155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.462+0000 7f448ad9d640 1 --2- 172.21.15.44:0/835293026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f448c0b0ae0 0x7f448c155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.462+0000 7f448ad9d640 1 -- 172.21.15.44:0/835293026 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f448c06db20 msgr2=0x7f448c070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.462+0000 7f448ad9d640 1 --2- 172.21.15.44:0/835293026 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f448c06db20 0x7f448c070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.462+0000 7f448ad9d640 1 -- 172.21.15.44:0/835293026 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4484009400 con 0x7f448c159c70 2023-11-04T01:39:34.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.462+0000 7f448a59c640 1 --2- 172.21.15.44:0/835293026 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f448c06db20 0x7f448c070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:34.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.462+0000 7f448ad9d640 1 --2- 172.21.15.44:0/835293026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f448c159c70 0x7f448c14ea50 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c780 tx=0x7f447c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.462+0000 7f4482ffd640 1 -- 172.21.15.44:0/835293026 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00ce90 con 0x7f448c159c70 2023-11-04T01:39:34.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.462+0000 7f4482ffd640 1 -- 172.21.15.44:0/835293026 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c00a640 con 0x7f448c159c70 2023-11-04T01:39:34.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.462+0000 7f4490a64640 1 -- 172.21.15.44:0/835293026 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448c1f6570 con 0x7f448c159c70 2023-11-04T01:39:34.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.462+0000 7f4482ffd640 1 -- 172.21.15.44:0/835293026 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00aa70 con 0x7f448c159c70 2023-11-04T01:39:34.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.462+0000 7f4490a64640 1 -- 172.21.15.44:0/835293026 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448c1f6b30 con 0x7f448c159c70 2023-11-04T01:39:34.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.463+0000 7f4490a64640 1 -- 172.21.15.44:0/835293026 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448c150cd0 con 0x7f448c159c70 2023-11-04T01:39:34.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.464+0000 7f4482ffd640 1 -- 172.21.15.44:0/835293026 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f447c00abd0 con 0x7f448c159c70 2023-11-04T01:39:34.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.464+0000 7f4482ffd640 1 --2- 172.21.15.44:0/835293026 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f446c06ae70 0x7f446c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.464+0000 7f4482ffd640 1 -- 172.21.15.44:0/835293026 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f447c089400 con 0x7f448c159c70 2023-11-04T01:39:34.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.464+0000 7f448a59c640 1 --2- 172.21.15.44:0/835293026 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f446c06ae70 0x7f446c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.465+0000 7f448a59c640 1 --2- 172.21.15.44:0/835293026 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f446c06ae70 0x7f446c06d330 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4484036000 tx=0x7f4484008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.468+0000 7f4482ffd640 1 -- 172.21.15.44:0/835293026 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f448c150cd0 con 0x7f448c159c70 2023-11-04T01:39:34.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.678+0000 7f4490a64640 1 -- 172.21.15.44:0/835293026 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f448c150cd0 con 0x7f448c159c70 2023-11-04T01:39:34.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.679+0000 7f4482ffd640 1 -- 172.21.15.44:0/835293026 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f448c150cd0 con 0x7f448c159c70 2023-11-04T01:39:34.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:34.681 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:39:31.919462+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6836/2461924520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2461924520},{"type":"v1","addr":"172.21.15.204:6836","nonce":2461924520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:34.681 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 46 2023-11-04T01:39:34.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.681+0000 7f4490a64640 1 -- 172.21.15.44:0/835293026 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f446c06ae70 msgr2=0x7f446c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.681+0000 7f4490a64640 1 --2- 172.21.15.44:0/835293026 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f446c06ae70 0x7f446c06d330 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4484036000 tx=0x7f4484008030 comp rx=0 tx=0).stop 2023-11-04T01:39:34.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.681+0000 7f4490a64640 1 -- 172.21.15.44:0/835293026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f448c159c70 msgr2=0x7f448c14ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.681+0000 7f4490a64640 1 --2- 172.21.15.44:0/835293026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f448c159c70 0x7f448c14ea50 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c780 tx=0x7f447c00cc40 comp rx=0 tx=0).stop 2023-11-04T01:39:34.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.681+0000 7f4490a64640 1 -- 172.21.15.44:0/835293026 shutdown_connections 2023-11-04T01:39:34.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.681+0000 7f4490a64640 1 --2- 172.21.15.44:0/835293026 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f446c06ae70 0x7f446c06d330 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.681+0000 7f4490a64640 1 --2- 172.21.15.44:0/835293026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f448c159c70 0x7f448c14ea50 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.681+0000 7f4490a64640 1 --2- 172.21.15.44:0/835293026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f448c0b0ae0 0x7f448c155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.681+0000 7f4490a64640 1 --2- 172.21.15.44:0/835293026 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f448c06db20 0x7f448c070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.681+0000 7f4490a64640 1 -- 172.21.15.44:0/835293026 >> 172.21.15.44:0/835293026 conn(0x7f448c0ce950 msgr2=0x7f448c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.681+0000 7f4490a64640 1 -- 172.21.15.44:0/835293026 shutdown_connections 2023-11-04T01:39:34.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:34.681+0000 7f4490a64640 1 -- 172.21.15.44:0/835293026 wait complete. 2023-11-04T01:39:35.097 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:39:29.920595+0000', 'modified': '2023-11-04T01:39:31.919462+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7359}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7359': {'gid': 7359, 'name': 'd', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.204:6836/2461924520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6834', 'nonce': 2461924520}, {'type': 'v1', 'addr': '172.21.15.204:6836', 'nonce': 2461924520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:39:35.097 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:39:35.098 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:39:35.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.207+0000 7f6115d9e640 1 Processor -- start 2023-11-04T01:39:35.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.207+0000 7f6115d9e640 1 -- start start 2023-11-04T01:39:35.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.208+0000 7f6115d9e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6110153e60 0x7f611015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.208+0000 7f6115d9e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f61100b4880 0x7f61100b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.208+0000 7f6115d9e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61100cde60 con 0x7f61100cd6d0 2023-11-04T01:39:35.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.208+0000 7f6115d9e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6110160f90 con 0x7f6110153e60 2023-11-04T01:39:35.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.208+0000 7f6115d9e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61100b5200 con 0x7f61100b4880 2023-11-04T01:39:35.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.208+0000 7f610f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6110153e60 0x7f611015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.208+0000 7f610f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6110153e60 0x7f611015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32920/0 (socket says 172.21.15.44:32920) 2023-11-04T01:39:35.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.208+0000 7f610f7fe640 1 -- 172.21.15.44:0/965679191 learned_addr learned my addr 172.21.15.44:0/965679191 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:35.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.209+0000 7f610ffff640 1 --2- 172.21.15.44:0/965679191 >> v2:172.21.15.204:3300/0 conn(0x7f61100b4880 0x7f61100b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.209+0000 7f610f7fe640 1 -- 172.21.15.44:0/965679191 >> v2:172.21.15.204:3300/0 conn(0x7f61100b4880 msgr2=0x7f61100b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.209+0000 7f610f7fe640 1 --2- 172.21.15.44:0/965679191 >> v2:172.21.15.204:3300/0 conn(0x7f61100b4880 0x7f61100b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.209+0000 7f610f7fe640 1 -- 172.21.15.44:0/965679191 >> v1:172.21.15.204:6789/0 conn(0x7f61100cd6d0 legacy=0x7f6110161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.209+0000 7f610f7fe640 1 -- 172.21.15.44:0/965679191 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611015e400 con 0x7f6110153e60 2023-11-04T01:39:35.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.209+0000 7f610ffff640 1 --2- 172.21.15.44:0/965679191 >> v2:172.21.15.204:3300/0 conn(0x7f61100b4880 0x7f61100b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:35.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.209+0000 7f610f7fe640 1 --2- 172.21.15.44:0/965679191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6110153e60 0x7f611015dec0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f61100b8f40 tx=0x7f610002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430ec48070d39861 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.210+0000 7f610e7fc640 1 -- 172.21.15.44:0/965679191 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100031870 con 0x7f6110153e60 2023-11-04T01:39:35.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.210+0000 7f610e7fc640 1 -- 172.21.15.44:0/965679191 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61000319d0 con 0x7f6110153e60 2023-11-04T01:39:35.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.210+0000 7f610e7fc640 1 -- 172.21.15.44:0/965679191 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100031d60 con 0x7f6110153e60 2023-11-04T01:39:35.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.210+0000 7f6115d9e640 1 -- 172.21.15.44:0/965679191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6110153e60 msgr2=0x7f611015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.210+0000 7f6115d9e640 1 --2- 172.21.15.44:0/965679191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6110153e60 0x7f611015dec0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f61100b8f40 tx=0x7f610002b910 comp rx=0 tx=0).stop 2023-11-04T01:39:35.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.210+0000 7f6115d9e640 1 -- 172.21.15.44:0/965679191 shutdown_connections 2023-11-04T01:39:35.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.210+0000 7f6115d9e640 1 --2- 172.21.15.44:0/965679191 >> v2:172.21.15.204:3300/0 conn(0x7f61100b4880 0x7f61100b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.210+0000 7f6115d9e640 1 --2- 172.21.15.44:0/965679191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6110153e60 0x7f611015dec0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.210+0000 7f6115d9e640 1 -- 172.21.15.44:0/965679191 >> 172.21.15.44:0/965679191 conn(0x7f61100cf880 msgr2=0x7f61100cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.210+0000 7f6115d9e640 1 -- 172.21.15.44:0/965679191 shutdown_connections 2023-11-04T01:39:35.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.210+0000 7f6115d9e640 1 -- 172.21.15.44:0/965679191 wait complete. 2023-11-04T01:39:35.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.211+0000 7f6115d9e640 1 Processor -- start 2023-11-04T01:39:35.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.212+0000 7f6115d9e640 1 -- start start 2023-11-04T01:39:35.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.212+0000 7f6115d9e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61100b4880 0x7f6110150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.212+0000 7f6115d9e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61100cd6d0 0x7f61100c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.212+0000 7f6115d9e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6110153e60 0x7f61100ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.212+0000 7f6115d9e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6110150560 con 0x7f61100b4880 2023-11-04T01:39:35.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.212+0000 7f6115d9e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6110150a70 con 0x7f6110153e60 2023-11-04T01:39:35.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.212+0000 7f6115d9e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61100caab0 con 0x7f61100cd6d0 2023-11-04T01:39:35.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.212+0000 7f610f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61100b4880 0x7f6110150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.213+0000 7f610f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61100b4880 0x7f6110150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32926/0 (socket says 172.21.15.44:32926) 2023-11-04T01:39:35.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.213+0000 7f610f7fe640 1 -- 172.21.15.44:0/3595144305 learned_addr learned my addr 172.21.15.44:0/3595144305 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:35.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.213+0000 7f610effd640 1 --2- 172.21.15.44:0/3595144305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61100cd6d0 0x7f61100c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.216 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.213+0000 7f610ffff640 1 --2- 172.21.15.44:0/3595144305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6110153e60 0x7f61100ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.213+0000 7f610f7fe640 1 -- 172.21.15.44:0/3595144305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61100cd6d0 msgr2=0x7f61100c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.213+0000 7f610f7fe640 1 --2- 172.21.15.44:0/3595144305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61100cd6d0 0x7f61100c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.213+0000 7f610f7fe640 1 -- 172.21.15.44:0/3595144305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6110153e60 msgr2=0x7f61100ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.213+0000 7f610f7fe640 1 --2- 172.21.15.44:0/3595144305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6110153e60 0x7f61100ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.213+0000 7f610f7fe640 1 -- 172.21.15.44:0/3595144305 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61000094d0 con 0x7f61100b4880 2023-11-04T01:39:35.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.213+0000 7f610f7fe640 1 --2- 172.21.15.44:0/3595144305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61100b4880 0x7f6110150020 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f6100000c00 tx=0x7f61000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.213+0000 7f60f7fff640 1 -- 172.21.15.44:0/3595144305 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100031840 con 0x7f61100b4880 2023-11-04T01:39:35.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.213+0000 7f60f7fff640 1 -- 172.21.15.44:0/3595144305 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61000443f0 con 0x7f61100b4880 2023-11-04T01:39:35.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.213+0000 7f6115d9e640 1 -- 172.21.15.44:0/3595144305 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61100cad90 con 0x7f61100b4880 2023-11-04T01:39:35.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.213+0000 7f60f7fff640 1 -- 172.21.15.44:0/3595144305 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61000447a0 con 0x7f61100b4880 2023-11-04T01:39:35.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.213+0000 7f6115d9e640 1 -- 172.21.15.44:0/3595144305 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61100cb350 con 0x7f61100b4880 2023-11-04T01:39:35.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.215+0000 7f60f7fff640 1 -- 172.21.15.44:0/3595144305 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f610004d450 con 0x7f61100b4880 2023-11-04T01:39:35.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.215+0000 7f60f7fff640 1 --2- 172.21.15.44:0/3595144305 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f60fc06ae70 0x7f60fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.216+0000 7f60f7fff640 1 -- 172.21.15.44:0/3595144305 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f610002d040 con 0x7f61100b4880 2023-11-04T01:39:35.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.216+0000 7f610effd640 1 --2- 172.21.15.44:0/3595144305 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f60fc06ae70 0x7f60fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.216+0000 7f6118a0c740 1 Processor -- start 2023-11-04T01:39:35.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.216+0000 7f6118a0c740 1 -- start start 2023-11-04T01:39:35.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.217+0000 7f610effd640 1 --2- 172.21.15.44:0/3595144305 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f60fc06ae70 0x7f60fc06d330 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f611015cc40 tx=0x7f6104007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.217+0000 7f6118a0c740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b2876850 0x5641b2849750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.217+0000 7f6118a0c740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b2876c30 0x5641b28795e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.217+0000 7f6118a0c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2849c90 0x5641b2879b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.217+0000 7f6118a0c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b275a740 con 0x5641b2849c90 2023-11-04T01:39:35.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.217+0000 7f6118a0c740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b27bc8d0 con 0x5641b2876850 2023-11-04T01:39:35.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.217+0000 7f6118a0c740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641b27b9fc0 con 0x5641b2876c30 2023-11-04T01:39:35.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.218+0000 7f610ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2849c90 0x5641b2879b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.218+0000 7f610f7fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b2876850 0x5641b2849750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.218+0000 7f610ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2849c90 0x5641b2879b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32938/0 (socket says 172.21.15.44:32938) 2023-11-04T01:39:35.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.218+0000 7f610ffff640 1 -- 172.21.15.44:0/3818436435 learned_addr learned my addr 172.21.15.44:0/3818436435 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:35.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.218+0000 7f610effd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b2876c30 0x5641b28795e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.218+0000 7f610ffff640 1 -- 172.21.15.44:0/3818436435 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b2876c30 msgr2=0x5641b28795e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.218+0000 7f610ffff640 1 --2- 172.21.15.44:0/3818436435 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b2876c30 0x5641b28795e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.218+0000 7f610ffff640 1 -- 172.21.15.44:0/3818436435 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b2876850 msgr2=0x5641b2849750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.218+0000 7f610ffff640 1 --2- 172.21.15.44:0/3818436435 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b2876850 0x5641b2849750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.218+0000 7f610ffff640 1 -- 172.21.15.44:0/3818436435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641b2778ca0 con 0x5641b2849c90 2023-11-04T01:39:35.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.218+0000 7f610ffff640 1 --2- 172.21.15.44:0/3818436435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2849c90 0x5641b2879b20 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f610800d590 tx=0x7f6108007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb47114620878f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.218+0000 7f60f57fa640 1 -- 172.21.15.44:0/3818436435 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108012070 con 0x5641b2849c90 2023-11-04T01:39:35.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.218+0000 7f60f57fa640 1 -- 172.21.15.44:0/3818436435 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610800c850 con 0x5641b2849c90 2023-11-04T01:39:35.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.218+0000 7f60f57fa640 1 -- 172.21.15.44:0/3818436435 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610800cc00 con 0x5641b2849c90 2023-11-04T01:39:35.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.219+0000 7f6118a0c740 1 -- 172.21.15.44:0/3818436435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2849c90 msgr2=0x5641b2879b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.219+0000 7f6118a0c740 1 --2- 172.21.15.44:0/3818436435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2849c90 0x5641b2879b20 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f610800d590 tx=0x7f6108007f90 comp rx=0 tx=0).stop 2023-11-04T01:39:35.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.219+0000 7f6118a0c740 1 -- 172.21.15.44:0/3818436435 shutdown_connections 2023-11-04T01:39:35.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.219+0000 7f6118a0c740 1 --2- 172.21.15.44:0/3818436435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2849c90 0x5641b2879b20 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.219+0000 7f6118a0c740 1 --2- 172.21.15.44:0/3818436435 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b2876c30 0x5641b28795e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.219+0000 7f6118a0c740 1 --2- 172.21.15.44:0/3818436435 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b2876850 0x5641b2849750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.219+0000 7f6118a0c740 1 -- 172.21.15.44:0/3818436435 >> 172.21.15.44:0/3818436435 conn(0x5641b284ba60 msgr2=0x5641b28945e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.219+0000 7f6118a0c740 1 -- 172.21.15.44:0/3818436435 shutdown_connections 2023-11-04T01:39:35.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.219+0000 7f6118a0c740 1 -- 172.21.15.44:0/3818436435 wait complete. 2023-11-04T01:39:35.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.219+0000 7f6118a0c740 1 -- start start 2023-11-04T01:39:35.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.220+0000 7f6118a0c740 1 Processor -- start 2023-11-04T01:39:35.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.220+0000 7f6118a0c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b288b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.220+0000 7f6118a0c740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b2876c30 0x5641b28784b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.220+0000 7f6118a0c740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b28789f0 0x5641b2860470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.220+0000 7f6118a0c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b27b58b0 con 0x5641b2876850 2023-11-04T01:39:35.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.220+0000 7f6118a0c740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b276fc80 con 0x5641b2876c30 2023-11-04T01:39:35.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.220+0000 7f6118a0c740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641b276f920 con 0x5641b28789f0 2023-11-04T01:39:35.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.220+0000 7f6118a0c740 10 client.0 _ll_register_callbacks cb 0x5641b24c7ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:35.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.220+0000 7f610f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b288b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.220+0000 7f610f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b288b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32940/0 (socket says 172.21.15.44:32940) 2023-11-04T01:39:35.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.220+0000 7f610f7fe640 1 -- 172.21.15.44:0/1416789233 learned_addr learned my addr 172.21.15.44:0/1416789233 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:35.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.221+0000 7f610effd640 1 --2- 172.21.15.44:0/1416789233 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b2876c30 0x5641b28784b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.221+0000 7f610ffff640 1 --2- 172.21.15.44:0/1416789233 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b28789f0 0x5641b2860470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.221+0000 7f610f7fe640 1 -- 172.21.15.44:0/1416789233 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b28789f0 msgr2=0x5641b2860470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.221+0000 7f610f7fe640 1 --2- 172.21.15.44:0/1416789233 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b28789f0 0x5641b2860470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.221+0000 7f610f7fe640 1 -- 172.21.15.44:0/1416789233 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b2876c30 msgr2=0x5641b28784b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.221+0000 7f610f7fe640 1 --2- 172.21.15.44:0/1416789233 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b2876c30 0x5641b28784b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.221+0000 7f610f7fe640 1 -- 172.21.15.44:0/1416789233 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6108007d70 con 0x5641b2876850 2023-11-04T01:39:35.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.221+0000 7f610f7fe640 1 --2- 172.21.15.44:0/1416789233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b288b500 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f6100076f60 tx=0x7f610007ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864e2e8b546cea7c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.221+0000 7f60ee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:39:35.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.221+0000 7f60ee7fc640 1 -- 172.21.15.44:0/1416789233 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61000a6020 con 0x5641b2876850 2023-11-04T01:39:35.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.221+0000 7f60ee7fc640 1 -- 172.21.15.44:0/1416789233 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f6100078ec0 con 0x5641b2876850 2023-11-04T01:39:35.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.221+0000 7f6118a0c740 1 -- 172.21.15.44:0/1416789233 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641b2761bf0 con 0x5641b2876850 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.221+0000 7f60ee7fc640 1 -- 172.21.15.44:0/1416789233 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6100092180 con 0x5641b2876850 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.222+0000 7f6118a0c740 10 client.7500 fetch_fsmap learned FSMap version 46 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.222+0000 7f6118a0c740 1 -- 172.21.15.44:0/1416789233 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x5641b27b3f30 con 0x5641b2876850 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.222+0000 7f60ee7fc640 1 -- 172.21.15.44:0/1416789233 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641b2761bf0 con 0x5641b2876850 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.222+0000 7f60ee7fc640 1 -- 172.21.15.44:0/1416789233 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6100082820 con 0x5641b2876850 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.222+0000 7f6118a0c740 10 client.7500 fetch_fsmap finished waiting for FSMap version 46 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.222+0000 7f6118a0c740 10 client.7500 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.222+0000 7f6118a0c740 20 client.7500 populate_metadata read hostname 'smithi044' 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.222+0000 7f6118a0c740 1 --2- 172.21.15.44:0/1416789233 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x5641b2862c20 0x5641b2863130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.222+0000 7f6118a0c740 4 client.7500 mds_command: new command op to 7359 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.222+0000 7f6118a0c740 1 -- 172.21.15.44:0/1416789233 --> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641b27ae890 con 0x5641b2862c20 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.222+0000 7f610effd640 1 --2- 172.21.15.44:0/1416789233 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x5641b2862c20 0x5641b2863130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.223+0000 7f610effd640 1 --2- 172.21.15.44:0/1416789233 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x5641b2862c20 0x5641b2863130 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=475bb6dd8f178452 server_cookie=b6ee4dadd2a54721 in_seq=0 out_seq=0 2023-11-04T01:39:35.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.223+0000 7f60ee7fc640 10 client.7500 ms_handle_connect on v2:172.21.15.204:6834/2461924520 2023-11-04T01:39:35.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.224+0000 7f60ee7fc640 1 -- 172.21.15.44:0/1416789233 <== mds.0 v2:172.21.15.204:6834/2461924520 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5641b27ae890 con 0x5641b2862c20 2023-11-04T01:39:35.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.224+0000 7f60ee7fc640 10 client.7500 handle_command_reply: tid=0 2023-11-04T01:39:35.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.224+0000 7f6118a0c740 1 client.7500 shutdown 2023-11-04T01:39:35.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.224+0000 7f6118a0c740 1 -- 172.21.15.44:0/1416789233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 msgr2=0x5641b288b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.224+0000 7f6118a0c740 1 --2- 172.21.15.44:0/1416789233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b288b500 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f6100076f60 tx=0x7f610007ebc0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.224+0000 7f6118a0c740 1 -- 172.21.15.44:0/1416789233 shutdown_connections 2023-11-04T01:39:35.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.224+0000 7f6118a0c740 1 --2- 172.21.15.44:0/1416789233 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x5641b2862c20 0x5641b2863130 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.224+0000 7f6118a0c740 1 --2- 172.21.15.44:0/1416789233 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b28789f0 0x5641b2860470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.224+0000 7f6118a0c740 1 --2- 172.21.15.44:0/1416789233 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b2876c30 0x5641b28784b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.224+0000 7f6118a0c740 1 --2- 172.21.15.44:0/1416789233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b288b500 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.224+0000 7f60ee7fc640 0 client.7500 ms_handle_reset on v2:172.21.15.204:6834/2461924520 2023-11-04T01:39:35.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.224+0000 7f6118a0c740 1 -- 172.21.15.44:0/1416789233 >> 172.21.15.44:0/1416789233 conn(0x5641b2849c90 msgr2=0x5641b284d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.224+0000 7f6118a0c740 1 -- 172.21.15.44:0/1416789233 shutdown_connections 2023-11-04T01:39:35.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.224+0000 7f6118a0c740 1 -- 172.21.15.44:0/1416789233 wait complete. 2023-11-04T01:39:35.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.224+0000 7f6118a0c740 20 client.7500 trim_cache size 0 max 16384 2023-11-04T01:39:35.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.240+0000 7f6118a0c740 1 Processor -- start 2023-11-04T01:39:35.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.240+0000 7f6118a0c740 1 -- start start 2023-11-04T01:39:35.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f6118a0c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b2889f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f6118a0c740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b2876c30 0x5641b284d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f6118a0c740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b28789f0 0x5641b28a6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f6118a0c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b2735280 con 0x5641b2876850 2023-11-04T01:39:35.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f6118a0c740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b284d480 con 0x5641b28789f0 2023-11-04T01:39:35.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f6118a0c740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641b28b7400 con 0x5641b2876c30 2023-11-04T01:39:35.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f610f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b2889f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f610f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b2889f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32950/0 (socket says 172.21.15.44:32950) 2023-11-04T01:39:35.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f610f7fe640 1 -- 172.21.15.44:0/2898645673 learned_addr learned my addr 172.21.15.44:0/2898645673 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:35.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f610ffff640 1 --2- 172.21.15.44:0/2898645673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b28789f0 0x5641b28a6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f610effd640 1 --2- 172.21.15.44:0/2898645673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b2876c30 0x5641b284d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f610f7fe640 1 -- 172.21.15.44:0/2898645673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b2876c30 msgr2=0x5641b284d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f610f7fe640 1 --2- 172.21.15.44:0/2898645673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b2876c30 0x5641b284d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f610f7fe640 1 -- 172.21.15.44:0/2898645673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b28789f0 msgr2=0x5641b28a6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f610f7fe640 1 --2- 172.21.15.44:0/2898645673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b28789f0 0x5641b28a6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.241+0000 7f610f7fe640 1 -- 172.21.15.44:0/2898645673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641b2751d10 con 0x5641b2876850 2023-11-04T01:39:35.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.242+0000 7f610f7fe640 1 --2- 172.21.15.44:0/2898645673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b2889f70 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f6100077480 tx=0x7f6100046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7903b83de495cb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.242+0000 7f60f5ffb640 1 -- 172.21.15.44:0/2898645673 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61000a6070 con 0x5641b2876850 2023-11-04T01:39:35.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.242+0000 7f60f5ffb640 1 -- 172.21.15.44:0/2898645673 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6100078ec0 con 0x5641b2876850 2023-11-04T01:39:35.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.242+0000 7f60f5ffb640 1 -- 172.21.15.44:0/2898645673 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610007aa60 con 0x5641b2876850 2023-11-04T01:39:35.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.242+0000 7f6118a0c740 1 -- 172.21.15.44:0/2898645673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 msgr2=0x5641b2889f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.242+0000 7f6118a0c740 1 --2- 172.21.15.44:0/2898645673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b2889f70 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f6100077480 tx=0x7f6100046000 comp rx=0 tx=0).stop 2023-11-04T01:39:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.242+0000 7f6118a0c740 1 -- 172.21.15.44:0/2898645673 shutdown_connections 2023-11-04T01:39:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.242+0000 7f6118a0c740 1 --2- 172.21.15.44:0/2898645673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b28789f0 0x5641b28a6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.242+0000 7f6118a0c740 1 --2- 172.21.15.44:0/2898645673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b2876c30 0x5641b284d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.242+0000 7f6118a0c740 1 --2- 172.21.15.44:0/2898645673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b2889f70 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.242+0000 7f6118a0c740 1 -- 172.21.15.44:0/2898645673 >> 172.21.15.44:0/2898645673 conn(0x5641b2849c90 msgr2=0x5641b2849540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.242+0000 7f6118a0c740 1 -- 172.21.15.44:0/2898645673 shutdown_connections 2023-11-04T01:39:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.243+0000 7f6118a0c740 1 -- 172.21.15.44:0/2898645673 wait complete. 2023-11-04T01:39:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.243+0000 7f6118a0c740 1 -- start start 2023-11-04T01:39:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.243+0000 7f6118a0c740 1 Processor -- start 2023-11-04T01:39:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f6118a0c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b285f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f6118a0c740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b2876c30 0x5641b2871270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f6118a0c740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b28789f0 0x5641b28717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f6118a0c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b288a680 con 0x5641b2876850 2023-11-04T01:39:35.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f6118a0c740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b2879660 con 0x5641b2876c30 2023-11-04T01:39:35.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f6118a0c740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641b284fe70 con 0x5641b28789f0 2023-11-04T01:39:35.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f6118a0c740 10 client.0 _ll_register_callbacks cb 0x7f6108007b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:35.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f610f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b285f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f610f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b285f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32960/0 (socket says 172.21.15.44:32960) 2023-11-04T01:39:35.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f610f7fe640 1 -- 172.21.15.44:0/735135397 learned_addr learned my addr 172.21.15.44:0/735135397 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:35.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f610effd640 1 --2- 172.21.15.44:0/735135397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b2876c30 0x5641b2871270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f610ffff640 1 --2- 172.21.15.44:0/735135397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b28789f0 0x5641b28717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f610f7fe640 1 -- 172.21.15.44:0/735135397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b28789f0 msgr2=0x5641b28717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f610f7fe640 1 --2- 172.21.15.44:0/735135397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b28789f0 0x5641b28717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f610f7fe640 1 -- 172.21.15.44:0/735135397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b2876c30 msgr2=0x5641b2871270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f610f7fe640 1 --2- 172.21.15.44:0/735135397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b2876c30 0x5641b2871270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f610f7fe640 1 -- 172.21.15.44:0/735135397 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6108007d70 con 0x5641b2876850 2023-11-04T01:39:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f610ffff640 1 --2- 172.21.15.44:0/735135397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b28789f0 0x5641b28717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f610f7fe640 1 --2- 172.21.15.44:0/735135397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b285f4a0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f6100077480 tx=0x7f61000aa040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa78657ae2eaa17 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.244+0000 7f60ee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:39:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.245+0000 7f60ee7fc640 1 -- 172.21.15.44:0/735135397 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61000a6070 con 0x5641b2876850 2023-11-04T01:39:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.245+0000 7f60ee7fc640 1 -- 172.21.15.44:0/735135397 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f610007aa60 con 0x5641b2876850 2023-11-04T01:39:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.245+0000 7f6118a0c740 1 -- 172.21.15.44:0/735135397 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f610800c850 con 0x5641b2876850 2023-11-04T01:39:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.245+0000 7f60ee7fc640 1 -- 172.21.15.44:0/735135397 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6100092180 con 0x5641b2876850 2023-11-04T01:39:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.245+0000 7f6118a0c740 10 client.7506 fetch_fsmap learned FSMap version 46 2023-11-04T01:39:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.245+0000 7f6118a0c740 1 -- 172.21.15.44:0/735135397 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x5641b2777500 con 0x5641b2876850 2023-11-04T01:39:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.245+0000 7f60ee7fc640 1 -- 172.21.15.44:0/735135397 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6100088080 con 0x5641b2876850 2023-11-04T01:39:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.245+0000 7f60ee7fc640 1 -- 172.21.15.44:0/735135397 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f61000799c0 con 0x5641b2876850 2023-11-04T01:39:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.245+0000 7f6118a0c740 10 client.7506 fetch_fsmap finished waiting for FSMap version 46 2023-11-04T01:39:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.245+0000 7f6118a0c740 10 client.7506 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:39:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.245+0000 7f6118a0c740 20 client.7506 populate_metadata read hostname 'smithi044' 2023-11-04T01:39:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.245+0000 7f6118a0c740 1 --2- 172.21.15.44:0/735135397 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x5641b2876170 0x5641b2902c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.245+0000 7f6118a0c740 4 client.7506 mds_command: new command op to 7359 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:39:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.245+0000 7f6118a0c740 1 -- 172.21.15.44:0/735135397 --> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5641b27ae5b0 con 0x5641b2876170 2023-11-04T01:39:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.245+0000 7f610effd640 1 --2- 172.21.15.44:0/735135397 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x5641b2876170 0x5641b2902c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f60ee7fc640 10 client.7506 ms_handle_connect on v2:172.21.15.204:6834/2461924520 2023-11-04T01:39:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f610effd640 1 --2- 172.21.15.44:0/735135397 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x5641b2876170 0x5641b2902c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=643e13de3e1e073d server_cookie=80aaaddd8850ea0d in_seq=0 out_seq=0 2023-11-04T01:39:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f60ee7fc640 1 -- 172.21.15.44:0/735135397 <== mds.0 v2:172.21.15.204:6834/2461924520 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5641b27ae5b0 con 0x5641b2876170 2023-11-04T01:39:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f60ee7fc640 10 client.7506 handle_command_reply: tid=0 2023-11-04T01:39:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f6118a0c740 1 client.7506 shutdown 2023-11-04T01:39:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f6118a0c740 1 -- 172.21.15.44:0/735135397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 msgr2=0x5641b285f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f6118a0c740 1 --2- 172.21.15.44:0/735135397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b285f4a0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f6100077480 tx=0x7f61000aa040 comp rx=0 tx=0).stop 2023-11-04T01:39:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f6118a0c740 1 -- 172.21.15.44:0/735135397 shutdown_connections 2023-11-04T01:39:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f6118a0c740 1 --2- 172.21.15.44:0/735135397 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x5641b2876170 0x5641b2902c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f6118a0c740 1 --2- 172.21.15.44:0/735135397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5641b28789f0 0x5641b28717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f6118a0c740 1 --2- 172.21.15.44:0/735135397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5641b2876c30 0x5641b2871270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f6118a0c740 1 --2- 172.21.15.44:0/735135397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641b2876850 0x5641b285f4a0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f6118a0c740 1 -- 172.21.15.44:0/735135397 >> 172.21.15.44:0/735135397 conn(0x5641b2849c90 msgr2=0x5641b2889f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f60ee7fc640 0 client.7506 ms_handle_reset on v2:172.21.15.204:6834/2461924520 2023-11-04T01:39:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f6118a0c740 1 -- 172.21.15.44:0/735135397 shutdown_connections 2023-11-04T01:39:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f6118a0c740 1 -- 172.21.15.44:0/735135397 wait complete. 2023-11-04T01:39:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.246+0000 7f6118a0c740 20 client.7506 trim_cache size 0 max 16384 2023-11-04T01:39:35.255 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:39:35.255 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:39:35.255 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2023-11-04T01:39:35.255 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7359, 2023-11-04T01:39:35.255 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:39:35.255 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:39:35.255 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:39:35.255 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 4.6948731510000004, 2023-11-04T01:39:35.255 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 46, 2023-11-04T01:39:35.255 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 96, 2023-11-04T01:39:35.255 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 96, 2023-11-04T01:39:35.255 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 10.731456088 2023-11-04T01:39:35.255 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:39:35.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.247+0000 7f6115d9e640 1 -- 172.21.15.44:0/3595144305 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f60fc06ae70 msgr2=0x7f60fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.247+0000 7f6115d9e640 1 --2- 172.21.15.44:0/3595144305 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f60fc06ae70 0x7f60fc06d330 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f611015cc40 tx=0x7f6104007e30 comp rx=0 tx=0).stop 2023-11-04T01:39:35.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.247+0000 7f6115d9e640 1 -- 172.21.15.44:0/3595144305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61100b4880 msgr2=0x7f6110150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.247+0000 7f6115d9e640 1 --2- 172.21.15.44:0/3595144305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61100b4880 0x7f6110150020 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f6100000c00 tx=0x7f61000046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.247+0000 7f6115d9e640 1 -- 172.21.15.44:0/3595144305 shutdown_connections 2023-11-04T01:39:35.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.247+0000 7f6115d9e640 1 --2- 172.21.15.44:0/3595144305 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f60fc06ae70 0x7f60fc06d330 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.247+0000 7f6115d9e640 1 --2- 172.21.15.44:0/3595144305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6110153e60 0x7f61100ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.247+0000 7f6115d9e640 1 --2- 172.21.15.44:0/3595144305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61100cd6d0 0x7f61100c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.247+0000 7f6115d9e640 1 --2- 172.21.15.44:0/3595144305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61100b4880 0x7f6110150020 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.247+0000 7f6115d9e640 1 -- 172.21.15.44:0/3595144305 >> 172.21.15.44:0/3595144305 conn(0x7f61100cf880 msgr2=0x7f611015ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.247+0000 7f6115d9e640 1 -- 172.21.15.44:0/3595144305 shutdown_connections 2023-11-04T01:39:35.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.247+0000 7f6115d9e640 1 -- 172.21.15.44:0/3595144305 wait complete. 2023-11-04T01:39:35.259 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:39:35.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.363+0000 7fd3d85b6640 1 Processor -- start 2023-11-04T01:39:35.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.363+0000 7fd3d85b6640 1 -- start start 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.364+0000 7fd3d85b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3d015ce60 0x7fd3d006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.364+0000 7fd3d85b6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd3d006bd30 0x7fd3d0160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.364+0000 7fd3d85b6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d01615d0 con 0x7fd3d0161050 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.364+0000 7fd3d85b6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d00cbde0 con 0x7fd3d006bd30 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.364+0000 7fd3d85b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d01618b0 con 0x7fd3d015ce60 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.364+0000 7fd3d5b51640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd3d006bd30 0x7fd3d0160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.364+0000 7fd3d6b53640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd3d0161050 0x7fd3d00cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43972/0 (socket says 172.21.15.44:43972) 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.364+0000 7fd3d6b53640 1 -- 172.21.15.44:0/4137114500 learned_addr learned my addr 172.21.15.44:0/4137114500 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.364+0000 7fd3d6352640 1 --2- 172.21.15.44:0/4137114500 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3d015ce60 0x7fd3d006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.364+0000 7fd3d5350640 1 -- 172.21.15.44:0/4137114500 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735400498 0 0) 0x7fd3d01615d0 con 0x7fd3d0161050 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.365+0000 7fd3d5350640 1 -- 172.21.15.44:0/4137114500 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3b8003520 con 0x7fd3d0161050 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.365+0000 7fd3d5b51640 1 -- 172.21.15.44:0/4137114500 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3d015ce60 msgr2=0x7fd3d006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.365+0000 7fd3d5b51640 1 --2- 172.21.15.44:0/4137114500 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3d015ce60 0x7fd3d006b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.365+0000 7fd3d5b51640 1 -- 172.21.15.44:0/4137114500 >> v1:172.21.15.44:6789/0 conn(0x7fd3d0161050 legacy=0x7fd3d00cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.365+0000 7fd3d5b51640 1 -- 172.21.15.44:0/4137114500 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d00cba00 con 0x7fd3d006bd30 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.365+0000 7fd3d6352640 1 --2- 172.21.15.44:0/4137114500 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3d015ce60 0x7fd3d006b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.365+0000 7fd3d5b51640 1 --2- 172.21.15.44:0/4137114500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3d006bd30 0x7fd3d0160b10 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40097a0 tx=0x7fd3c402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b62b7a3ce849da server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.365+0000 7fd3d5350640 1 -- 172.21.15.44:0/4137114500 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4031830 con 0x7fd3d006bd30 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.366+0000 7fd3d5350640 1 -- 172.21.15.44:0/4137114500 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c4031990 con 0x7fd3d006bd30 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.366+0000 7fd3d5350640 1 -- 172.21.15.44:0/4137114500 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4031d20 con 0x7fd3d006bd30 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.366+0000 7fd3d85b6640 1 -- 172.21.15.44:0/4137114500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3d006bd30 msgr2=0x7fd3d0160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.366+0000 7fd3d85b6640 1 --2- 172.21.15.44:0/4137114500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3d006bd30 0x7fd3d0160b10 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40097a0 tx=0x7fd3c402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.366+0000 7fd3d85b6640 1 -- 172.21.15.44:0/4137114500 shutdown_connections 2023-11-04T01:39:35.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.366+0000 7fd3d85b6640 1 --2- 172.21.15.44:0/4137114500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3d006bd30 0x7fd3d0160b10 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.366+0000 7fd3d85b6640 1 --2- 172.21.15.44:0/4137114500 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3d015ce60 0x7fd3d006b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.366+0000 7fd3d85b6640 1 -- 172.21.15.44:0/4137114500 >> 172.21.15.44:0/4137114500 conn(0x7fd3d006ea90 msgr2=0x7fd3d006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.366+0000 7fd3d85b6640 1 -- 172.21.15.44:0/4137114500 shutdown_connections 2023-11-04T01:39:35.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.366+0000 7fd3d85b6640 1 -- 172.21.15.44:0/4137114500 wait complete. 2023-11-04T01:39:35.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.367+0000 7fd3d85b6640 1 Processor -- start 2023-11-04T01:39:35.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.367+0000 7fd3d85b6640 1 -- start start 2023-11-04T01:39:35.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.368+0000 7fd3d85b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3d015ce60 0x7fd3d015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.368+0000 7fd3d85b6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3d0161050 0x7fd3d015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.368+0000 7fd3d85b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3d00b5300 0x7fd3d00b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.368+0000 7fd3d85b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d00b5cd0 con 0x7fd3d015ce60 2023-11-04T01:39:35.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.368+0000 7fd3d85b6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d015d5c0 con 0x7fd3d0161050 2023-11-04T01:39:35.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.368+0000 7fd3d85b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d015d810 con 0x7fd3d00b5300 2023-11-04T01:39:35.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.368+0000 7fd3d6352640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3d015ce60 0x7fd3d015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.368+0000 7fd3d6352640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3d015ce60 0x7fd3d015fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32972/0 (socket says 172.21.15.44:32972) 2023-11-04T01:39:35.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.368+0000 7fd3d6352640 1 -- 172.21.15.44:0/1423738556 learned_addr learned my addr 172.21.15.44:0/1423738556 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:35.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.368+0000 7fd3d6352640 1 -- 172.21.15.44:0/1423738556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3d00b5300 msgr2=0x7fd3d00b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.368+0000 7fd3d6352640 1 --2- 172.21.15.44:0/1423738556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3d00b5300 0x7fd3d00b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.368+0000 7fd3d6352640 1 -- 172.21.15.44:0/1423738556 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3d0161050 msgr2=0x7fd3d015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.368+0000 7fd3d6352640 1 --2- 172.21.15.44:0/1423738556 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3d0161050 0x7fd3d015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.368+0000 7fd3d6352640 1 -- 172.21.15.44:0/1423738556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c4009400 con 0x7fd3d015ce60 2023-11-04T01:39:35.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.369+0000 7fd3d6352640 1 --2- 172.21.15.44:0/1423738556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3d015ce60 0x7fd3d015fe20 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800c7f0 tx=0x7fd3c800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.369+0000 7fd3ceffd640 1 -- 172.21.15.44:0/1423738556 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8007a30 con 0x7fd3d015ce60 2023-11-04T01:39:35.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.369+0000 7fd3ceffd640 1 -- 172.21.15.44:0/1423738556 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c8007b90 con 0x7fd3d015ce60 2023-11-04T01:39:35.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.369+0000 7fd3d85b6640 1 -- 172.21.15.44:0/1423738556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d015daf0 con 0x7fd3d015ce60 2023-11-04T01:39:35.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.369+0000 7fd3ceffd640 1 -- 172.21.15.44:0/1423738556 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c800ce40 con 0x7fd3d015ce60 2023-11-04T01:39:35.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.369+0000 7fd3d85b6640 1 -- 172.21.15.44:0/1423738556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d015e0b0 con 0x7fd3d015ce60 2023-11-04T01:39:35.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.370+0000 7fd3d85b6640 1 -- 172.21.15.44:0/1423738556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d0074290 con 0x7fd3d015ce60 2023-11-04T01:39:35.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.370+0000 7fd3ceffd640 1 -- 172.21.15.44:0/1423738556 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3c80113f0 con 0x7fd3d015ce60 2023-11-04T01:39:35.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.371+0000 7fd3ceffd640 1 --2- 172.21.15.44:0/1423738556 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3bc06ae70 0x7fd3bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.371+0000 7fd3ceffd640 1 -- 172.21.15.44:0/1423738556 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fd3c8089d70 con 0x7fd3d015ce60 2023-11-04T01:39:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.371+0000 7fd3d5b51640 1 --2- 172.21.15.44:0/1423738556 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3bc06ae70 0x7fd3bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.371+0000 7fd3d5b51640 1 --2- 172.21.15.44:0/1423738556 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3bc06ae70 0x7fd3bc06d330 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4036000 tx=0x7fd3c4030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.375+0000 7fd3ceffd640 1 -- 172.21.15.44:0/1423738556 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd3c80548b0 con 0x7fd3d015ce60 2023-11-04T01:39:35.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.585+0000 7fd3d85b6640 1 -- 172.21.15.44:0/1423738556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd3d00b50e0 con 0x7fd3d015ce60 2023-11-04T01:39:35.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.586+0000 7fd3ceffd640 1 -- 172.21.15.44:0/1423738556 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd3c801f070 con 0x7fd3d015ce60 2023-11-04T01:39:35.588 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:39:35.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.587+0000 7fd3d85b6640 1 -- 172.21.15.44:0/1423738556 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3bc06ae70 msgr2=0x7fd3bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.588+0000 7fd3d85b6640 1 --2- 172.21.15.44:0/1423738556 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3bc06ae70 0x7fd3bc06d330 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4036000 tx=0x7fd3c4030000 comp rx=0 tx=0).stop 2023-11-04T01:39:35.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.588+0000 7fd3d85b6640 1 -- 172.21.15.44:0/1423738556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3d015ce60 msgr2=0x7fd3d015fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.588+0000 7fd3d85b6640 1 --2- 172.21.15.44:0/1423738556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3d015ce60 0x7fd3d015fe20 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800c7f0 tx=0x7fd3c800cbf0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.588+0000 7fd3d85b6640 1 -- 172.21.15.44:0/1423738556 shutdown_connections 2023-11-04T01:39:35.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.588+0000 7fd3d85b6640 1 --2- 172.21.15.44:0/1423738556 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd3bc06ae70 0x7fd3bc06d330 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.588+0000 7fd3d85b6640 1 --2- 172.21.15.44:0/1423738556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3d00b5300 0x7fd3d00b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.588+0000 7fd3d85b6640 1 --2- 172.21.15.44:0/1423738556 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3d0161050 0x7fd3d015e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.588+0000 7fd3d85b6640 1 --2- 172.21.15.44:0/1423738556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3d015ce60 0x7fd3d015fe20 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.588+0000 7fd3d85b6640 1 -- 172.21.15.44:0/1423738556 >> 172.21.15.44:0/1423738556 conn(0x7fd3d006ea90 msgr2=0x7fd3d00b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.588+0000 7fd3d85b6640 1 -- 172.21.15.44:0/1423738556 shutdown_connections 2023-11-04T01:39:35.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:35.588+0000 7fd3d85b6640 1 -- 172.21.15.44:0/1423738556 wait complete. 2023-11-04T01:39:35.600 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:39:35.600 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:39:35.600 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2023-11-04T01:39:35.600 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:39:35.600 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:35.600 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:39:35.600 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:39:35.601 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:39:35.601 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:39:35.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:35.601 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2023-11-04T01:39:35.617 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:39:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:39:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:39:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2023-11-04T01:39:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:35.617 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:39:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42294sec preferred_lft 42294sec 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi044.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::9082:77ff:fe28:4353/64 scope link 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:35.620 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::e49d:e3ff:fe56:d068/64 scope link 2023-11-04T01:39:35.620 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:35.620 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:39:35.620 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether f2:23:83:31:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:35.620 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::f023:83ff:fe31:915/64 scope link 2023-11-04T01:39:35.620 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:35.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:35.620 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:39:35.686 INFO:teuthology.orchestra.run.smithi044.stdout:1 2023-11-04T01:39:35.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:35.689 DEBUG:teuthology.orchestra.run.smithi044:> route 2023-11-04T01:39:35.744 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2023-11-04T01:39:35.745 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:39:35.745 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-04T01:39:35.745 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-04T01:39:35.745 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:39:35.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:35.745 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:39:35.746 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:39:35.746 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:39:35.746 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:39:35.746 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:39:35.746 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:39:35.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:35.851 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2023-11-04T01:39:35.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:39:35.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:39:35.867 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:39:35.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:35.867 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2023-11-04T01:39:35.937 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:39:35.937 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:39:35.937 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:35.992 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:39:35.992 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:39:35.993 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:36.048 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:39:36.104 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:39:36.104 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:39:36.104 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:39:36.104 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:39:36.104 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:39:36.104 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:39:36.104 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:39:36.104 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:39:36.104 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:39:36.104 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:39:36.104 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:39:36.105 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:39:36.105 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:39:36.105 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:39:36.105 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:39:36.105 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:39:36.105 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:39:36.105 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:39:36.105 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:39:36.105 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:39:36.105 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:39:36.105 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:39:36.105 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:39:36.105 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:39:36.106 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:39:36.106 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:39:36.106 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:39:36.106 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:39:36.106 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:39:36.106 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:39:36.106 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:36.106 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:36.106 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:36.106 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:36.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:36.107 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:39:36.159 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:39:36.159 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:39:36.202 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:39:36.218 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:39:36.218 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:39:36.218 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:39:36.218 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:39:36.218 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:39:36.218 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:39:36.218 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:39:36.219 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:39:36.219 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:39:36.219 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:39:36.219 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:39:36.219 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:39:36.219 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:39:36.219 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:39:36.219 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:39:36.219 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:39:36.219 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:39:36.219 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:39:36.219 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:39:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:39:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:39:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:39:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:39:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:39:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:39:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:39:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:39:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:39:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:39:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:39:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:36.221 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:36.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:36.221 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:39:36.301 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:39:36.299+0000 7f4dd0252480 -1 init, newargv = 0x55ccd5c409f0 newargc=15 2023-11-04T01:39:36.301 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[117603]: starting ceph client 2023-11-04T01:39:36.305 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[117603]: starting fuse 2023-11-04T01:39:36.520 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:39:36.518+0000 7f039a264640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:39:37.375 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:39:37.395 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:39:37.395 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:39:37.395 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:39:37.395 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:39:37.395 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:39:37.395 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:39:37.395 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:39:37.395 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:39:37.395 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:39:37.395 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:39:37.395 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:39:37.396 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:39:37.396 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:39:37.396 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:39:37.396 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:39:37.396 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:39:37.396 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:39:37.396 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:39:37.396 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:39:37.396 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:39:37.396 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:39:37.396 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:39:37.396 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:39:37.396 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:39:37.397 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:39:37.397 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:39:37.397 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:39:37.397 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:39:37.397 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:39:37.397 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:39:37.397 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:37.397 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:37.397 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:37.397 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:37.397 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:37.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:37.398 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:39:37.457 INFO:teuthology.orchestra.run.smithi044.stdout:41 2023-11-04T01:39:37.458 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:39:37.458 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:39:37.458 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2023-11-04T01:39:37.458 DEBUG:teuthology.orchestra.run.smithi044:> import re 2023-11-04T01:39:37.458 DEBUG:teuthology.orchestra.run.smithi044:> import os 2023-11-04T01:39:37.458 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2023-11-04T01:39:37.458 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:39:37.458 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2023-11-04T01:39:37.459 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:39:37.459 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2023-11-04T01:39:37.459 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:39:37.459 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:39:37.459 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2023-11-04T01:39:37.459 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2023-11-04T01:39:37.459 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2023-11-04T01:39:37.459 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2023-11-04T01:39:37.459 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:39:37.459 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2023-11-04T01:39:37.459 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:39:37.459 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:39:37.459 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:39:37.459 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2023-11-04T01:39:37.460 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2023-11-04T01:39:37.460 DEBUG:teuthology.orchestra.run.smithi044:> return f 2023-11-04T01:39:37.460 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:39:37.460 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:39:37.460 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2023-11-04T01:39:37.460 DEBUG:teuthology.orchestra.run.smithi044:> ' 2023-11-04T01:39:37.594 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.117603.asok 2023-11-04T01:39:37.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:37.605 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.117603.asok 2023-11-04T01:39:37.605 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:37.605 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.117603.asok status 2023-11-04T01:39:37.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:37.783 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:39:37.783 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2023-11-04T01:39:37.784 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:39:37.784 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:39:37.784 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2023-11-04T01:39:37.784 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2023-11-04T01:39:37.784 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:39:37.784 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "117603", 2023-11-04T01:39:37.784 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2023-11-04T01:39:37.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:37.784 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2023-11-04T01:39:37.784 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2023-11-04T01:39:37.784 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7521, 2023-11-04T01:39:37.784 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2023-11-04T01:39:37.784 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2023-11-04T01:39:37.785 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2023-11-04T01:39:37.785 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 7521 2023-11-04T01:39:37.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:37.785 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:39:37.785 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:39:37.785 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:39:37.785 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 780133444 2023-11-04T01:39:37.785 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:39:37.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:37.785 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:39:37.785 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:39:37.785 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:39:37.785 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 780133444 2023-11-04T01:39:37.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:39:37.786 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.7521 192.168.0.1:0/780133444", 2023-11-04T01:39:37.786 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/780133444", 2023-11-04T01:39:37.786 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2023-11-04T01:39:37.786 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 46, 2023-11-04T01:39:37.786 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 96, 2023-11-04T01:39:37.786 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:39:37.786 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2023-11-04T01:39:37.786 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2023-11-04T01:39:37.786 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:39:37.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:37.798 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:37.798 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:39:37.798 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:37.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:37.862 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2023-11-04T01:39:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:37.869 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:37.869 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:37.869 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:37.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:37.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:37.940 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_snaps_per_dir 2023-11-04T01:39:38.058 INFO:teuthology.orchestra.run.smithi044.stdout:{"mds_max_snaps_per_dir":"100"} 2023-11-04T01:39:38.058 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_snaps_per_dir": "100" } 2023-11-04T01:39:38.059 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-11-04T01:39:38.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.167+0000 7f87dc897640 1 Processor -- start 2023-11-04T01:39:38.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.167+0000 7f87dc897640 1 -- start start 2023-11-04T01:39:38.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87dc897640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f87d8151ea0 0x7f87d815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87dc897640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87d815f510 0x7f87d80cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87dc897640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f87d806dd50 0x7f87d80cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87dc897640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d80cbbd0 con 0x7f87d8151ea0 2023-11-04T01:39:38.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87dc897640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d806cf90 con 0x7f87d806dd50 2023-11-04T01:39:38.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87dc897640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d806d270 con 0x7f87d815f510 2023-11-04T01:39:38.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87d659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f87d8151ea0 0x7f87d815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87d659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f87d8151ea0 0x7f87d815b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32984/0 (socket says 172.21.15.44:32984) 2023-11-04T01:39:38.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87d659c640 1 -- 172.21.15.44:0/3143262329 learned_addr learned my addr 172.21.15.44:0/3143262329 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:38.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87cffff640 1 --2- 172.21.15.44:0/3143262329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87d815f510 0x7f87d80cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87d6d9d640 1 --2- 172.21.15.44:0/3143262329 >> v2:172.21.15.204:3300/0 conn(0x7f87d806dd50 0x7f87d80cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87d659c640 1 -- 172.21.15.44:0/3143262329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87d815f510 msgr2=0x7f87d80cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:38.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87d659c640 1 --2- 172.21.15.44:0/3143262329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87d815f510 0x7f87d80cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87d659c640 1 -- 172.21.15.44:0/3143262329 >> v2:172.21.15.204:3300/0 conn(0x7f87d806dd50 msgr2=0x7f87d80cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:38.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87d659c640 1 --2- 172.21.15.44:0/3143262329 >> v2:172.21.15.204:3300/0 conn(0x7f87d806dd50 0x7f87d80cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.168+0000 7f87d659c640 1 -- 172.21.15.44:0/3143262329 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d806d550 con 0x7f87d8151ea0 2023-11-04T01:39:38.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.169+0000 7f87d659c640 1 --2- 172.21.15.44:0/3143262329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d8151ea0 0x7f87d815b9c0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f87d80ce870 tx=0x7f87c802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c03c09624a42466 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:38.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.169+0000 7f87d5d9b640 1 -- 172.21.15.44:0/3143262329 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c8031870 con 0x7f87d8151ea0 2023-11-04T01:39:38.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.169+0000 7f87d5d9b640 1 -- 172.21.15.44:0/3143262329 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c80319d0 con 0x7f87d8151ea0 2023-11-04T01:39:38.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.169+0000 7f87d5d9b640 1 -- 172.21.15.44:0/3143262329 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c8031d60 con 0x7f87d8151ea0 2023-11-04T01:39:38.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.170+0000 7f87dc897640 1 -- 172.21.15.44:0/3143262329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d8151ea0 msgr2=0x7f87d815b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.170+0000 7f87dc897640 1 --2- 172.21.15.44:0/3143262329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d8151ea0 0x7f87d815b9c0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f87d80ce870 tx=0x7f87c802b910 comp rx=0 tx=0).stop 2023-11-04T01:39:38.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.170+0000 7f87dc897640 1 -- 172.21.15.44:0/3143262329 shutdown_connections 2023-11-04T01:39:38.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.170+0000 7f87dc897640 1 --2- 172.21.15.44:0/3143262329 >> v2:172.21.15.204:3300/0 conn(0x7f87d806dd50 0x7f87d80cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.170+0000 7f87dc897640 1 --2- 172.21.15.44:0/3143262329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87d815f510 0x7f87d80cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.170+0000 7f87dc897640 1 --2- 172.21.15.44:0/3143262329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d8151ea0 0x7f87d815b9c0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.170+0000 7f87dc897640 1 -- 172.21.15.44:0/3143262329 >> 172.21.15.44:0/3143262329 conn(0x7f87d80b05d0 msgr2=0x7f87d80b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:38.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.170+0000 7f87dc897640 1 -- 172.21.15.44:0/3143262329 shutdown_connections 2023-11-04T01:39:38.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.170+0000 7f87dc897640 1 -- 172.21.15.44:0/3143262329 wait complete. 2023-11-04T01:39:38.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.171+0000 7f87dc897640 1 Processor -- start 2023-11-04T01:39:38.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.171+0000 7f87dc897640 1 -- start start 2023-11-04T01:39:38.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87dc897640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87d806dd50 0x7f87d81f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87dc897640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d8151ea0 0x7f87d80c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87dc897640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87d815f510 0x7f87d80c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87dc897640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d81f6c60 con 0x7f87d8151ea0 2023-11-04T01:39:38.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87dc897640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d80b2ae0 con 0x7f87d806dd50 2023-11-04T01:39:38.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87dc897640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d81f60e0 con 0x7f87d815f510 2023-11-04T01:39:38.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87cffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d8151ea0 0x7f87d80c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87cffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d8151ea0 0x7f87d80c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32996/0 (socket says 172.21.15.44:32996) 2023-11-04T01:39:38.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87cffff640 1 -- 172.21.15.44:0/674145804 learned_addr learned my addr 172.21.15.44:0/674145804 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:38.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87d6d9d640 1 --2- 172.21.15.44:0/674145804 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87d815f510 0x7f87d80c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87d659c640 1 --2- 172.21.15.44:0/674145804 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87d806dd50 0x7f87d81f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87cffff640 1 -- 172.21.15.44:0/674145804 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87d815f510 msgr2=0x7f87d80c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87cffff640 1 --2- 172.21.15.44:0/674145804 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87d815f510 0x7f87d80c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87cffff640 1 -- 172.21.15.44:0/674145804 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87d806dd50 msgr2=0x7f87d81f1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87cffff640 1 --2- 172.21.15.44:0/674145804 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87d806dd50 0x7f87d81f1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87cffff640 1 -- 172.21.15.44:0/674145804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c80094d0 con 0x7f87d8151ea0 2023-11-04T01:39:38.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.172+0000 7f87cffff640 1 --2- 172.21.15.44:0/674145804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d8151ea0 0x7f87d80c9810 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f87c000d5f0 tx=0x7f87c000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:38.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.173+0000 7f87ceffd640 1 -- 172.21.15.44:0/674145804 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c00125f0 con 0x7f87d8151ea0 2023-11-04T01:39:38.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.173+0000 7f87ceffd640 1 -- 172.21.15.44:0/674145804 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c0012750 con 0x7f87d8151ea0 2023-11-04T01:39:38.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.173+0000 7f87dc897640 1 -- 172.21.15.44:0/674145804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d81f63c0 con 0x7f87d8151ea0 2023-11-04T01:39:38.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.173+0000 7f87ceffd640 1 -- 172.21.15.44:0/674145804 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0012b00 con 0x7f87d8151ea0 2023-11-04T01:39:38.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.173+0000 7f87dc897640 1 -- 172.21.15.44:0/674145804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d81f6980 con 0x7f87d8151ea0 2023-11-04T01:39:38.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.174+0000 7f87dc897640 1 -- 172.21.15.44:0/674145804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d815bec0 con 0x7f87d8151ea0 2023-11-04T01:39:38.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.174+0000 7f87ceffd640 1 -- 172.21.15.44:0/674145804 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87c0012c60 con 0x7f87d8151ea0 2023-11-04T01:39:38.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.174+0000 7f87ceffd640 1 --2- 172.21.15.44:0/674145804 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87b806ae70 0x7f87b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.175+0000 7f87ceffd640 1 -- 172.21.15.44:0/674145804 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f87c008a0e0 con 0x7f87d8151ea0 2023-11-04T01:39:38.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.175+0000 7f87d659c640 1 --2- 172.21.15.44:0/674145804 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87b806ae70 0x7f87b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.175+0000 7f87d659c640 1 --2- 172.21.15.44:0/674145804 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87b806ae70 0x7f87b806d330 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f87c8036000 tx=0x7f87c803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:38.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.179+0000 7f87ceffd640 1 -- 172.21.15.44:0/674145804 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f87c0054b80 con 0x7f87d8151ea0 2023-11-04T01:39:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:38.392+0000 7f87dc897640 1 -- 172.21.15.44:0/674145804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f87d804e490 con 0x7f87d8151ea0 2023-11-04T01:39:39.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.349+0000 7f87ceffd640 1 -- 172.21.15.44:0/674145804 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v47) v1 ==== 167+0+0 (secure 0 0 0) 0x7f87c00581a0 con 0x7f87d8151ea0 2023-11-04T01:39:39.351 INFO:teuthology.orchestra.run.smithi044.stderr:enabled new snapshots 2023-11-04T01:39:39.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.352+0000 7f87dc897640 1 -- 172.21.15.44:0/674145804 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87b806ae70 msgr2=0x7f87b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:39.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.352+0000 7f87dc897640 1 --2- 172.21.15.44:0/674145804 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87b806ae70 0x7f87b806d330 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f87c8036000 tx=0x7f87c803c040 comp rx=0 tx=0).stop 2023-11-04T01:39:39.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.352+0000 7f87dc897640 1 -- 172.21.15.44:0/674145804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d8151ea0 msgr2=0x7f87d80c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:39.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.352+0000 7f87dc897640 1 --2- 172.21.15.44:0/674145804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d8151ea0 0x7f87d80c9810 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f87c000d5f0 tx=0x7f87c000dab0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.352+0000 7f87dc897640 1 -- 172.21.15.44:0/674145804 shutdown_connections 2023-11-04T01:39:39.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.352+0000 7f87dc897640 1 --2- 172.21.15.44:0/674145804 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87b806ae70 0x7f87b806d330 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.352+0000 7f87dc897640 1 --2- 172.21.15.44:0/674145804 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87d815f510 0x7f87d80c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.352+0000 7f87dc897640 1 --2- 172.21.15.44:0/674145804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d8151ea0 0x7f87d80c9810 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.352+0000 7f87dc897640 1 --2- 172.21.15.44:0/674145804 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87d806dd50 0x7f87d81f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.352+0000 7f87dc897640 1 -- 172.21.15.44:0/674145804 >> 172.21.15.44:0/674145804 conn(0x7f87d80b05d0 msgr2=0x7f87d8070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:39.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.352+0000 7f87dc897640 1 -- 172.21.15.44:0/674145804 shutdown_connections 2023-11-04T01:39:39.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.352+0000 7f87dc897640 1 -- 172.21.15.44:0/674145804 wait complete. 2023-11-04T01:39:39.367 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2023-11-04T01:39:39.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.480+0000 7fd5b8f61640 1 Processor -- start 2023-11-04T01:39:39.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.480+0000 7fd5b8f61640 1 -- start start 2023-11-04T01:39:39.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.481+0000 7fd5b8f61640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd5b40c4ff0 0x7fd5b40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:39.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.481+0000 7fd5b8f61640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd5b40adac0 0x7fd5b40adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:39.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.481+0000 7fd5b8f61640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b415aff0 con 0x7fd5b4159c00 2023-11-04T01:39:39.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.481+0000 7fd5b8f61640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b40ae460 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.481+0000 7fd5b8f61640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b415a3e0 con 0x7fd5b40adac0 2023-11-04T01:39:39.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.481+0000 7fd5b1d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd5b40c4ff0 0x7fd5b40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:39.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.481+0000 7fd5b259c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd5b4159c00 0x7fd5b40c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43982/0 (socket says 172.21.15.44:43982) 2023-11-04T01:39:39.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.481+0000 7fd5b259c640 1 -- 172.21.15.44:0/3328299597 learned_addr learned my addr 172.21.15.44:0/3328299597 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:39.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.481+0000 7fd5b2d9d640 1 --2- 172.21.15.44:0/3328299597 >> v2:172.21.15.204:3300/0 conn(0x7fd5b40adac0 0x7fd5b40adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:39.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.481+0000 7fd5b1d9b640 1 -- 172.21.15.44:0/3328299597 >> v2:172.21.15.204:3300/0 conn(0x7fd5b40adac0 msgr2=0x7fd5b40adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:39.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.481+0000 7fd5b1d9b640 1 --2- 172.21.15.44:0/3328299597 >> v2:172.21.15.204:3300/0 conn(0x7fd5b40adac0 0x7fd5b40adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.481+0000 7fd5b1d9b640 1 -- 172.21.15.44:0/3328299597 >> v1:172.21.15.44:6789/0 conn(0x7fd5b4159c00 legacy=0x7fd5b40c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:39.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.481+0000 7fd5b1d9b640 1 -- 172.21.15.44:0/3328299597 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b415a6c0 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.481+0000 7fd5b159a640 1 -- 172.21.15.44:0/3328299597 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95187897 0 0) 0x7fd5b415aff0 con 0x7fd5b4159c00 2023-11-04T01:39:39.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.481+0000 7fd5b2d9d640 1 --2- 172.21.15.44:0/3328299597 >> v2:172.21.15.204:3300/0 conn(0x7fd5b40adac0 0x7fd5b40adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:39.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.482+0000 7fd5b1d9b640 1 --2- 172.21.15.44:0/3328299597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5b40c4ff0 0x7fd5b40cc890 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40c59a0 tx=0x7fd59c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2964e6b8997788b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:39.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.482+0000 7fd5b159a640 1 -- 172.21.15.44:0/3328299597 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c031830 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.482+0000 7fd5b159a640 1 -- 172.21.15.44:0/3328299597 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c031990 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.482+0000 7fd5b159a640 1 -- 172.21.15.44:0/3328299597 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c031d20 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.483+0000 7fd5b8f61640 1 -- 172.21.15.44:0/3328299597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5b40c4ff0 msgr2=0x7fd5b40cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:39.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.483+0000 7fd5b8f61640 1 --2- 172.21.15.44:0/3328299597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5b40c4ff0 0x7fd5b40cc890 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40c59a0 tx=0x7fd59c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.483+0000 7fd5b8f61640 1 -- 172.21.15.44:0/3328299597 shutdown_connections 2023-11-04T01:39:39.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.483+0000 7fd5b8f61640 1 --2- 172.21.15.44:0/3328299597 >> v2:172.21.15.204:3300/0 conn(0x7fd5b40adac0 0x7fd5b40adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.483+0000 7fd5b8f61640 1 --2- 172.21.15.44:0/3328299597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5b40c4ff0 0x7fd5b40cc890 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.483+0000 7fd5b8f61640 1 -- 172.21.15.44:0/3328299597 >> 172.21.15.44:0/3328299597 conn(0x7fd5b40ce950 msgr2=0x7fd5b40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:39.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.483+0000 7fd5b8f61640 1 -- 172.21.15.44:0/3328299597 shutdown_connections 2023-11-04T01:39:39.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.483+0000 7fd5b8f61640 1 -- 172.21.15.44:0/3328299597 wait complete. 2023-11-04T01:39:39.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.484+0000 7fd5b8f61640 1 Processor -- start 2023-11-04T01:39:39.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.485+0000 7fd5b8f61640 1 -- start start 2023-11-04T01:39:39.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.485+0000 7fd5b8f61640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd5b40adac0 0x7fd5b4144190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:39.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.485+0000 7fd5b8f61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5b40c4ff0 0x7fd5b41efc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:39.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.485+0000 7fd5b8f61640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd5b4159c00 0x7fd5b41f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:39.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.485+0000 7fd5b8f61640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b41f4710 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.485+0000 7fd5b8f61640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b41450f0 con 0x7fd5b4159c00 2023-11-04T01:39:39.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.485+0000 7fd5b8f61640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4144850 con 0x7fd5b40adac0 2023-11-04T01:39:39.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.485+0000 7fd5b1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5b40c4ff0 0x7fd5b41efc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:39.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.485+0000 7fd5b1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5b40c4ff0 0x7fd5b41efc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33010/0 (socket says 172.21.15.44:33010) 2023-11-04T01:39:39.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.485+0000 7fd5b1d9b640 1 -- 172.21.15.44:0/709449053 learned_addr learned my addr 172.21.15.44:0/709449053 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:39.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.486+0000 7fd5b2d9d640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd5b4159c00 0x7fd5b41f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:39.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.486+0000 7fd5b1d9b640 1 -- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd5b40adac0 msgr2=0x7fd5b4144190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:39.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.486+0000 7fd5b259c640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd5b40adac0 0x7fd5b4144190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:39.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.486+0000 7fd5b1d9b640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd5b40adac0 0x7fd5b4144190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.486+0000 7fd5b1d9b640 1 -- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd5b4159c00 msgr2=0x7fd5b41f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:39.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.486+0000 7fd5b1d9b640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd5b4159c00 0x7fd5b41f41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.486+0000 7fd5b1d9b640 1 -- 172.21.15.44:0/709449053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c009400 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.486+0000 7fd5b2d9d640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd5b4159c00 0x7fd5b41f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:39.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.486+0000 7fd5b259c640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd5b40adac0 0x7fd5b4144190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:39.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.486+0000 7fd5b1d9b640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5b40c4ff0 0x7fd5b41efc80 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fd59c009890 tx=0x7fd59c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:39.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.486+0000 7fd5aaffd640 1 -- 172.21.15.44:0/709449053 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c03ba70 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.486+0000 7fd5aaffd640 1 -- 172.21.15.44:0/709449053 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c03bbf0 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.486+0000 7fd5b8f61640 1 -- 172.21.15.44:0/709449053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b4144b30 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.486+0000 7fd5aaffd640 1 -- 172.21.15.44:0/709449053 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c045400 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.486+0000 7fd5b8f61640 1 -- 172.21.15.44:0/709449053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b4142260 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.487+0000 7fd5b8f61640 1 -- 172.21.15.44:0/709449053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b4074290 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.488+0000 7fd5aaffd640 1 -- 172.21.15.44:0/709449053 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd59c04e440 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.488+0000 7fd5aaffd640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd59406ae70 0x7fd59406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:39.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.488+0000 7fd5aaffd640 1 -- 172.21.15.44:0/709449053 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fd59c0abed0 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.488+0000 7fd5b259c640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd59406ae70 0x7fd59406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:39.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.489+0000 7fd5b259c640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd59406ae70 0x7fd59406d330 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4007fd0 tx=0x7fd5a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:39.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.493+0000 7fd5aaffd640 1 -- 172.21.15.44:0/709449053 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd59c076a20 con 0x7fd5b40c4ff0 2023-11-04T01:39:39.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:39.706+0000 7fd5b8f61640 1 -- 172.21.15.44:0/709449053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fd5b40725c0 con 0x7fd5b40c4ff0 2023-11-04T01:39:40.359 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.357+0000 7fd5aaffd640 1 -- 172.21.15.44:0/709449053 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v48) v1 ==== 105+0+0 (secure 0 0 0) 0x7fd59c07a040 con 0x7fd5b40c4ff0 2023-11-04T01:39:40.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.361+0000 7fd5b8f61640 1 -- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd59406ae70 msgr2=0x7fd59406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.361+0000 7fd5b8f61640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd59406ae70 0x7fd59406d330 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4007fd0 tx=0x7fd5a4009040 comp rx=0 tx=0).stop 2023-11-04T01:39:40.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.361+0000 7fd5b8f61640 1 -- 172.21.15.44:0/709449053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5b40c4ff0 msgr2=0x7fd5b41efc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.361+0000 7fd5b8f61640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5b40c4ff0 0x7fd5b41efc80 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fd59c009890 tx=0x7fd59c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.361+0000 7fd5b8f61640 1 -- 172.21.15.44:0/709449053 shutdown_connections 2023-11-04T01:39:40.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.361+0000 7fd5b8f61640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd59406ae70 0x7fd59406d330 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.361+0000 7fd5b8f61640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd5b4159c00 0x7fd5b41f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.361+0000 7fd5b8f61640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5b40c4ff0 0x7fd5b41efc80 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.361+0000 7fd5b8f61640 1 --2- 172.21.15.44:0/709449053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd5b40adac0 0x7fd5b4144190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.361+0000 7fd5b8f61640 1 -- 172.21.15.44:0/709449053 >> 172.21.15.44:0/709449053 conn(0x7fd5b40ce950 msgr2=0x7fd5b40709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:40.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.361+0000 7fd5b8f61640 1 -- 172.21.15.44:0/709449053 shutdown_connections 2023-11-04T01:39:40.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.362+0000 7fd5b8f61640 1 -- 172.21.15.44:0/709449053 wait complete. 2023-11-04T01:39:40.383 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:40.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.492+0000 7f2b45caf640 1 Processor -- start 2023-11-04T01:39:40.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.492+0000 7f2b45caf640 1 -- start start 2023-11-04T01:39:40.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.493+0000 7f2b45caf640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2b40159c70 0x7f2b400ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.493+0000 7f2b45caf640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2b4006db20 0x7f2b400b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.493+0000 7f2b45caf640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b400b4110 con 0x7f2b400b0910 2023-11-04T01:39:40.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.493+0000 7f2b45caf640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b400b49b0 con 0x7f2b40159c70 2023-11-04T01:39:40.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.493+0000 7f2b45caf640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b400b0da0 con 0x7f2b4006db20 2023-11-04T01:39:40.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.493+0000 7f2b3f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2b40159c70 0x7f2b400ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.493+0000 7f2b3f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2b40159c70 0x7f2b400ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33016/0 (socket says 172.21.15.44:33016) 2023-11-04T01:39:40.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.493+0000 7f2b3f7fe640 1 -- 172.21.15.44:0/835543720 learned_addr learned my addr 172.21.15.44:0/835543720 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:40.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.493+0000 7f2b3effd640 1 --2- 172.21.15.44:0/835543720 >> v2:172.21.15.204:3300/0 conn(0x7f2b4006db20 0x7f2b400b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.493+0000 7f2b3f7fe640 1 -- 172.21.15.44:0/835543720 >> v2:172.21.15.204:3300/0 conn(0x7f2b4006db20 msgr2=0x7f2b400b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:40.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.493+0000 7f2b3f7fe640 1 --2- 172.21.15.44:0/835543720 >> v2:172.21.15.204:3300/0 conn(0x7f2b4006db20 0x7f2b400b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.493+0000 7f2b3f7fe640 1 -- 172.21.15.44:0/835543720 >> v1:172.21.15.204:6789/0 conn(0x7f2b400b0910 legacy=0x7f2b4015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.493+0000 7f2b3f7fe640 1 -- 172.21.15.44:0/835543720 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b400b43f0 con 0x7f2b40159c70 2023-11-04T01:39:40.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.494+0000 7f2b3f7fe640 1 --2- 172.21.15.44:0/835543720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b40159c70 0x7f2b400ce370 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f2b400cf800 tx=0x7f2b3002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c052e41403f00d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:40.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.494+0000 7f2b3e7fc640 1 -- 172.21.15.44:0/835543720 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b30030860 con 0x7f2b40159c70 2023-11-04T01:39:40.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.494+0000 7f2b3e7fc640 1 -- 172.21.15.44:0/835543720 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b300309c0 con 0x7f2b40159c70 2023-11-04T01:39:40.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.494+0000 7f2b3e7fc640 1 -- 172.21.15.44:0/835543720 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b30030d50 con 0x7f2b40159c70 2023-11-04T01:39:40.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.495+0000 7f2b45caf640 1 -- 172.21.15.44:0/835543720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b40159c70 msgr2=0x7f2b400ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.495+0000 7f2b45caf640 1 --2- 172.21.15.44:0/835543720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b40159c70 0x7f2b400ce370 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f2b400cf800 tx=0x7f2b3002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.495+0000 7f2b45caf640 1 -- 172.21.15.44:0/835543720 shutdown_connections 2023-11-04T01:39:40.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.495+0000 7f2b45caf640 1 --2- 172.21.15.44:0/835543720 >> v2:172.21.15.204:3300/0 conn(0x7f2b4006db20 0x7f2b400b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.495+0000 7f2b45caf640 1 --2- 172.21.15.44:0/835543720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b40159c70 0x7f2b400ce370 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.495+0000 7f2b45caf640 1 -- 172.21.15.44:0/835543720 >> 172.21.15.44:0/835543720 conn(0x7f2b400ce950 msgr2=0x7f2b400ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:40.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.495+0000 7f2b45caf640 1 -- 172.21.15.44:0/835543720 shutdown_connections 2023-11-04T01:39:40.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.495+0000 7f2b45caf640 1 -- 172.21.15.44:0/835543720 wait complete. 2023-11-04T01:39:40.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.496+0000 7f2b45caf640 1 Processor -- start 2023-11-04T01:39:40.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.496+0000 7f2b45caf640 1 -- start start 2023-11-04T01:39:40.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b45caf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b4006db20 0x7f2b400ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b45caf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b400b0910 0x7f2b400cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b45caf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b40159c70 0x7f2b40150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b45caf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4014eaa0 con 0x7f2b40159c70 2023-11-04T01:39:40.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b45caf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4014e200 con 0x7f2b4006db20 2023-11-04T01:39:40.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b45caf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4014e4e0 con 0x7f2b400b0910 2023-11-04T01:39:40.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b3ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b40159c70 0x7f2b40150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b3ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b40159c70 0x7f2b40150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33026/0 (socket says 172.21.15.44:33026) 2023-11-04T01:39:40.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b3ffff640 1 -- 172.21.15.44:0/2582528202 learned_addr learned my addr 172.21.15.44:0/2582528202 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:40.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b3f7fe640 1 --2- 172.21.15.44:0/2582528202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b4006db20 0x7f2b400ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b3effd640 1 --2- 172.21.15.44:0/2582528202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b400b0910 0x7f2b400cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b3ffff640 1 -- 172.21.15.44:0/2582528202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b400b0910 msgr2=0x7f2b400cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b3ffff640 1 --2- 172.21.15.44:0/2582528202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b400b0910 0x7f2b400cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b3ffff640 1 -- 172.21.15.44:0/2582528202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b4006db20 msgr2=0x7f2b400ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b3ffff640 1 --2- 172.21.15.44:0/2582528202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b4006db20 0x7f2b400ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b3ffff640 1 -- 172.21.15.44:0/2582528202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b300094d0 con 0x7f2b40159c70 2023-11-04T01:39:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b3ffff640 1 --2- 172.21.15.44:0/2582528202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b40159c70 0x7f2b40150440 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800c7a0 tx=0x7f2b3800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.497+0000 7f2b27fff640 1 -- 172.21.15.44:0/2582528202 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b38003b70 con 0x7f2b40159c70 2023-11-04T01:39:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.498+0000 7f2b27fff640 1 -- 172.21.15.44:0/2582528202 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b38003cf0 con 0x7f2b40159c70 2023-11-04T01:39:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.498+0000 7f2b45caf640 1 -- 172.21.15.44:0/2582528202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4014e7c0 con 0x7f2b40159c70 2023-11-04T01:39:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.498+0000 7f2b27fff640 1 -- 172.21.15.44:0/2582528202 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b38003ea0 con 0x7f2b40159c70 2023-11-04T01:39:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.498+0000 7f2b45caf640 1 -- 172.21.15.44:0/2582528202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b40152020 con 0x7f2b40159c70 2023-11-04T01:39:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.499+0000 7f2b45caf640 1 -- 172.21.15.44:0/2582528202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b400c5c70 con 0x7f2b40159c70 2023-11-04T01:39:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.499+0000 7f2b27fff640 1 -- 172.21.15.44:0/2582528202 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b3800aa90 con 0x7f2b40159c70 2023-11-04T01:39:40.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.499+0000 7f2b27fff640 1 --2- 172.21.15.44:0/2582528202 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2b2c06ae70 0x7f2b2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.500+0000 7f2b27fff640 1 -- 172.21.15.44:0/2582528202 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f2b38089ab0 con 0x7f2b40159c70 2023-11-04T01:39:40.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.500+0000 7f2b3f7fe640 1 --2- 172.21.15.44:0/2582528202 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2b2c06ae70 0x7f2b2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.500+0000 7f2b3f7fe640 1 --2- 172.21.15.44:0/2582528202 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2b2c06ae70 0x7f2b2c06d330 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2b30036000 tx=0x7f2b30008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:40.505 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.504+0000 7f2b27fff640 1 -- 172.21.15.44:0/2582528202 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2b400c5c70 con 0x7f2b40159c70 2023-11-04T01:39:40.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.715+0000 7f2b45caf640 1 -- 172.21.15.44:0/2582528202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b400c5c70 con 0x7f2b40159c70 2023-11-04T01:39:40.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.716+0000 7f2b27fff640 1 -- 172.21.15.44:0/2582528202 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f2b400c5c70 con 0x7f2b40159c70 2023-11-04T01:39:40.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:40.718 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:39:40.363805+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:creating","state_seq":1,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6836/2461924520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2461924520},{"type":"v1","addr":"172.21.15.204:6836","nonce":2461924520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:40.718 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 49 2023-11-04T01:39:40.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.718+0000 7f2b45caf640 1 -- 172.21.15.44:0/2582528202 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2b2c06ae70 msgr2=0x7f2b2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.718+0000 7f2b45caf640 1 --2- 172.21.15.44:0/2582528202 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2b2c06ae70 0x7f2b2c06d330 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2b30036000 tx=0x7f2b30008030 comp rx=0 tx=0).stop 2023-11-04T01:39:40.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.718+0000 7f2b45caf640 1 -- 172.21.15.44:0/2582528202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b40159c70 msgr2=0x7f2b40150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.718+0000 7f2b45caf640 1 --2- 172.21.15.44:0/2582528202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b40159c70 0x7f2b40150440 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800c7a0 tx=0x7f2b3800cc60 comp rx=0 tx=0).stop 2023-11-04T01:39:40.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.718+0000 7f2b45caf640 1 -- 172.21.15.44:0/2582528202 shutdown_connections 2023-11-04T01:39:40.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.718+0000 7f2b45caf640 1 --2- 172.21.15.44:0/2582528202 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2b2c06ae70 0x7f2b2c06d330 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.718+0000 7f2b45caf640 1 --2- 172.21.15.44:0/2582528202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b40159c70 0x7f2b40150440 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.718+0000 7f2b45caf640 1 --2- 172.21.15.44:0/2582528202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b400b0910 0x7f2b400cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.718+0000 7f2b45caf640 1 --2- 172.21.15.44:0/2582528202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b4006db20 0x7f2b400ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.718+0000 7f2b45caf640 1 -- 172.21.15.44:0/2582528202 >> 172.21.15.44:0/2582528202 conn(0x7f2b400ce950 msgr2=0x7f2b400ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.718+0000 7f2b45caf640 1 -- 172.21.15.44:0/2582528202 shutdown_connections 2023-11-04T01:39:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:40.718+0000 7f2b45caf640 1 -- 172.21.15.44:0/2582528202 wait complete. 2023-11-04T01:39:41.135 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:29.920595+0000', 'modified': '2023-11-04T01:39:40.363805+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7359, 'mds_1': 7344}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7344': {'gid': 7344, 'name': 'c', 'rank': 1, 'incarnation': 49, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.44:6834/2069525699', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 2069525699}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 2069525699}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7359': {'gid': 7359, 'name': 'd', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.204:6836/2461924520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6834', 'nonce': 2461924520}, {'type': 'v1', 'addr': '172.21.15.204:6836', 'nonce': 2461924520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:39:41.135 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7344:up:creating 2023-11-04T01:39:41.520 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:39:41.518+0000 7f039a264640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:39:42.136 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:42.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.253+0000 7f2f40390640 1 Processor -- start 2023-11-04T01:39:42.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.253+0000 7f2f40390640 1 -- start start 2023-11-04T01:39:42.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.254+0000 7f2f40390640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f3815ce60 0x7f2f3806b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.254+0000 7f2f40390640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2f3806bd30 0x7f2f38160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.254+0000 7f2f40390640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f381615d0 con 0x7f2f38161050 2023-11-04T01:39:42.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.254+0000 7f2f40390640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f380cbde0 con 0x7f2f3806bd30 2023-11-04T01:39:42.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.254+0000 7f2f40390640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f381618b0 con 0x7f2f3815ce60 2023-11-04T01:39:42.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.254+0000 7f2f3d92b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2f3806bd30 0x7f2f38160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.254+0000 7f2f3d92b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2f3806bd30 0x7f2f38160b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33034/0 (socket says 172.21.15.44:33034) 2023-11-04T01:39:42.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.254+0000 7f2f3d92b640 1 -- 172.21.15.44:0/1162168541 learned_addr learned my addr 172.21.15.44:0/1162168541 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:42.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.254+0000 7f2f3e92d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2f38161050 0x7f2f380cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43986/0 (socket says 172.21.15.44:43986) 2023-11-04T01:39:42.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.254+0000 7f2f3e12c640 1 --2- 172.21.15.44:0/1162168541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f3815ce60 0x7f2f3806b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.255+0000 7f2f3d92b640 1 -- 172.21.15.44:0/1162168541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f3815ce60 msgr2=0x7f2f3806b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:42.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.255+0000 7f2f3d92b640 1 --2- 172.21.15.44:0/1162168541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f3815ce60 0x7f2f3806b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.255+0000 7f2f3d92b640 1 -- 172.21.15.44:0/1162168541 >> v1:172.21.15.44:6789/0 conn(0x7f2f38161050 legacy=0x7f2f380cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.255+0000 7f2f3d92b640 1 -- 172.21.15.44:0/1162168541 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f380cba00 con 0x7f2f3806bd30 2023-11-04T01:39:42.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.255+0000 7f2f3d92b640 1 --2- 172.21.15.44:0/1162168541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f3806bd30 0x7f2f38160b10 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f2f28009870 tx=0x7f2f2802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62392bc625eea63b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.255+0000 7f2f3d12a640 1 -- 172.21.15.44:0/1162168541 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28004230 con 0x7f2f3806bd30 2023-11-04T01:39:42.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.256+0000 7f2f3d12a640 1 -- 172.21.15.44:0/1162168541 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2802e050 con 0x7f2f3806bd30 2023-11-04T01:39:42.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.256+0000 7f2f3d12a640 1 -- 172.21.15.44:0/1162168541 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28003610 con 0x7f2f3806bd30 2023-11-04T01:39:42.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.256+0000 7f2f40390640 1 -- 172.21.15.44:0/1162168541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f3806bd30 msgr2=0x7f2f38160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.256+0000 7f2f40390640 1 --2- 172.21.15.44:0/1162168541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f3806bd30 0x7f2f38160b10 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f2f28009870 tx=0x7f2f2802b7e0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.256+0000 7f2f40390640 1 -- 172.21.15.44:0/1162168541 shutdown_connections 2023-11-04T01:39:42.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.256+0000 7f2f40390640 1 --2- 172.21.15.44:0/1162168541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f3806bd30 0x7f2f38160b10 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.256+0000 7f2f40390640 1 --2- 172.21.15.44:0/1162168541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f3815ce60 0x7f2f3806b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.256+0000 7f2f40390640 1 -- 172.21.15.44:0/1162168541 >> 172.21.15.44:0/1162168541 conn(0x7f2f3806ea90 msgr2=0x7f2f3806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.256+0000 7f2f40390640 1 -- 172.21.15.44:0/1162168541 shutdown_connections 2023-11-04T01:39:42.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.256+0000 7f2f40390640 1 -- 172.21.15.44:0/1162168541 wait complete. 2023-11-04T01:39:42.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.257+0000 7f2f40390640 1 Processor -- start 2023-11-04T01:39:42.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.258+0000 7f2f40390640 1 -- start start 2023-11-04T01:39:42.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.258+0000 7f2f40390640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f3815ce60 0x7f2f3814ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.258+0000 7f2f40390640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f38161050 0x7f2f380b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.258+0000 7f2f40390640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f38159ed0 0x7f2f380b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.258+0000 7f2f40390640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f38150440 con 0x7f2f3815ce60 2023-11-04T01:39:42.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.258+0000 7f2f40390640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380b0f70 con 0x7f2f38159ed0 2023-11-04T01:39:42.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.258+0000 7f2f40390640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380b1250 con 0x7f2f38161050 2023-11-04T01:39:42.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.258+0000 7f2f3e12c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f3815ce60 0x7f2f3814ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.258+0000 7f2f3e12c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f3815ce60 0x7f2f3814ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33044/0 (socket says 172.21.15.44:33044) 2023-11-04T01:39:42.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.258+0000 7f2f3e12c640 1 -- 172.21.15.44:0/143427833 learned_addr learned my addr 172.21.15.44:0/143427833 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:42.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.259+0000 7f2f3d92b640 1 --2- 172.21.15.44:0/143427833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f38161050 0x7f2f380b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.259+0000 7f2f3e92d640 1 --2- 172.21.15.44:0/143427833 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f38159ed0 0x7f2f380b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.259+0000 7f2f3e12c640 1 -- 172.21.15.44:0/143427833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f38161050 msgr2=0x7f2f380b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.259+0000 7f2f3e12c640 1 --2- 172.21.15.44:0/143427833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f38161050 0x7f2f380b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.259+0000 7f2f3e12c640 1 -- 172.21.15.44:0/143427833 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f38159ed0 msgr2=0x7f2f380b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.259+0000 7f2f3e12c640 1 --2- 172.21.15.44:0/143427833 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f38159ed0 0x7f2f380b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.259+0000 7f2f3e12c640 1 -- 172.21.15.44:0/143427833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f280094d0 con 0x7f2f3815ce60 2023-11-04T01:39:42.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.259+0000 7f2f3e92d640 1 --2- 172.21.15.44:0/143427833 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f38159ed0 0x7f2f380b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:42.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.259+0000 7f2f3e12c640 1 --2- 172.21.15.44:0/143427833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f3815ce60 0x7f2f3814ff00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400d800 tx=0x7f2f3400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.259+0000 7f2f2effd640 1 -- 172.21.15.44:0/143427833 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3400b6c0 con 0x7f2f3815ce60 2023-11-04T01:39:42.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.259+0000 7f2f2effd640 1 -- 172.21.15.44:0/143427833 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3400b820 con 0x7f2f3815ce60 2023-11-04T01:39:42.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.259+0000 7f2f40390640 1 -- 172.21.15.44:0/143427833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f380b1530 con 0x7f2f3815ce60 2023-11-04T01:39:42.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.259+0000 7f2f2effd640 1 -- 172.21.15.44:0/143427833 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3400bbb0 con 0x7f2f3815ce60 2023-11-04T01:39:42.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.259+0000 7f2f40390640 1 -- 172.21.15.44:0/143427833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f380b1af0 con 0x7f2f3815ce60 2023-11-04T01:39:42.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.260+0000 7f2f40390640 1 -- 172.21.15.44:0/143427833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f380b1c80 con 0x7f2f3815ce60 2023-11-04T01:39:42.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.261+0000 7f2f2effd640 1 -- 172.21.15.44:0/143427833 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f3400bd10 con 0x7f2f3815ce60 2023-11-04T01:39:42.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.261+0000 7f2f2effd640 1 --2- 172.21.15.44:0/143427833 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f1c06ae70 0x7f2f1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.261+0000 7f2f2effd640 1 -- 172.21.15.44:0/143427833 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f2f3408a150 con 0x7f2f3815ce60 2023-11-04T01:39:42.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.262+0000 7f2f3d92b640 1 --2- 172.21.15.44:0/143427833 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f1c06ae70 0x7f2f1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.262+0000 7f2f3d92b640 1 --2- 172.21.15.44:0/143427833 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f1c06ae70 0x7f2f1c06d330 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2f28034000 tx=0x7f2f28008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.266+0000 7f2f2effd640 1 -- 172.21.15.44:0/143427833 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f34054c60 con 0x7f2f3815ce60 2023-11-04T01:39:42.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.479+0000 7f2f40390640 1 -- 172.21.15.44:0/143427833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f38074290 con 0x7f2f3815ce60 2023-11-04T01:39:42.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.479+0000 7f2f2effd640 1 -- 172.21.15.44:0/143427833 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f2f34058280 con 0x7f2f3815ce60 2023-11-04T01:39:42.481 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:42.482 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:39:40.381738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6836/2461924520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2461924520},{"type":"v1","addr":"172.21.15.204:6836","nonce":2461924520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:42.482 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 50 2023-11-04T01:39:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.481+0000 7f2f40390640 1 -- 172.21.15.44:0/143427833 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f1c06ae70 msgr2=0x7f2f1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.481+0000 7f2f40390640 1 --2- 172.21.15.44:0/143427833 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f1c06ae70 0x7f2f1c06d330 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2f28034000 tx=0x7f2f28008030 comp rx=0 tx=0).stop 2023-11-04T01:39:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.481+0000 7f2f40390640 1 -- 172.21.15.44:0/143427833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f3815ce60 msgr2=0x7f2f3814ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.481+0000 7f2f40390640 1 --2- 172.21.15.44:0/143427833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f3815ce60 0x7f2f3814ff00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400d800 tx=0x7f2f3400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.481+0000 7f2f40390640 1 -- 172.21.15.44:0/143427833 shutdown_connections 2023-11-04T01:39:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.481+0000 7f2f40390640 1 --2- 172.21.15.44:0/143427833 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f1c06ae70 0x7f2f1c06d330 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.481+0000 7f2f40390640 1 --2- 172.21.15.44:0/143427833 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f38159ed0 0x7f2f380b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.481+0000 7f2f40390640 1 --2- 172.21.15.44:0/143427833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f38161050 0x7f2f380b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.481+0000 7f2f40390640 1 --2- 172.21.15.44:0/143427833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f3815ce60 0x7f2f3814ff00 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.481+0000 7f2f40390640 1 -- 172.21.15.44:0/143427833 >> 172.21.15.44:0/143427833 conn(0x7f2f3806ea90 msgr2=0x7f2f3806c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.481+0000 7f2f40390640 1 -- 172.21.15.44:0/143427833 shutdown_connections 2023-11-04T01:39:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:42.481+0000 7f2f40390640 1 -- 172.21.15.44:0/143427833 wait complete. 2023-11-04T01:39:42.896 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:29.920595+0000', 'modified': '2023-11-04T01:39:40.381738+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7359, 'mds_1': 7344}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7344': {'gid': 7344, 'name': 'c', 'rank': 1, 'incarnation': 49, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.44:6834/2069525699', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 2069525699}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 2069525699}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7359': {'gid': 7359, 'name': 'd', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.204:6836/2461924520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6834', 'nonce': 2461924520}, {'type': 'v1', 'addr': '172.21.15.204:6836', 'nonce': 2461924520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:39:42.897 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:39:42.897 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:39:43.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.004+0000 7f6ef421a640 1 Processor -- start 2023-11-04T01:39:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.005+0000 7f6ef421a640 1 -- start start 2023-11-04T01:39:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.005+0000 7f6ef421a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6eec153e60 0x7f6eec15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.005+0000 7f6ef421a640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eec0cde60 con 0x7f6eec0b4880 2023-11-04T01:39:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.005+0000 7f6ef421a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eec160f90 con 0x7f6eec0cd6d0 2023-11-04T01:39:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.005+0000 7f6ef421a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eec15e400 con 0x7f6eec153e60 2023-11-04T01:39:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef27b7640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6eec0b4880 0x7f6eec0d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52842/0 (socket says 172.21.15.44:52842) 2023-11-04T01:39:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef27b7640 1 -- 172.21.15.44:0/4092705600 learned_addr learned my addr 172.21.15.44:0/4092705600 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/4092705600 >> v2:172.21.15.204:3300/0 conn(0x7f6eec153e60 0x7f6eec15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354507269 0 0) 0x7f6eec0cde60 con 0x7f6eec0b4880 2023-11-04T01:39:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ed8003520 con 0x7f6eec0b4880 2023-11-04T01:39:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632315879 0 0) 0x7f6eec160f90 con 0x7f6eec0cd6d0 2023-11-04T01:39:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eec0cde60 con 0x7f6eec0cd6d0 2023-11-04T01:39:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1826308930 0 0) 0x7f6ed8003520 con 0x7f6eec0b4880 2023-11-04T01:39:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 >> v2:172.21.15.204:3300/0 conn(0x7f6eec153e60 msgr2=0x7f6eec15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 --2- 172.21.15.44:0/4092705600 >> v2:172.21.15.204:3300/0 conn(0x7f6eec153e60 0x7f6eec15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 >> v1:172.21.15.204:6789/0 conn(0x7f6eec0cd6d0 legacy=0x7f6eec161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec0ce090 con 0x7f6eec0b4880 2023-11-04T01:39:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f6ee80019f0 con 0x7f6eec0b4880 2023-11-04T01:39:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/4092705600 >> v2:172.21.15.204:3300/0 conn(0x7f6eec153e60 0x7f6eec15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 >> v1:172.21.15.44:6789/0 conn(0x7f6eec0b4880 legacy=0x7f6eec0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 --2- 172.21.15.44:0/4092705600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ed8003b00 0x7f6ed8003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 --2- 172.21.15.44:0/4092705600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ed80047c0 0x7f6ed8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 --2- 172.21.15.44:0/4092705600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ed8005180 0x7f6ed800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec15e400 con 0x7f6ed8003b00 2023-11-04T01:39:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed800c000 con 0x7f6ed80047c0 2023-11-04T01:39:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed800c1c0 con 0x7f6ed8005180 2023-11-04T01:39:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.006+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/4092705600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ed8003b00 0x7f6ed8003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.007+0000 7f6ef17b5640 1 --2- 172.21.15.44:0/4092705600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ed80047c0 0x7f6ed8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.007+0000 7f6ef27b7640 1 --2- 172.21.15.44:0/4092705600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ed8005180 0x7f6ed800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.007+0000 7f6ef1fb6640 1 -- 172.21.15.44:0/4092705600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ed8005180 msgr2=0x7f6ed800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.007+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/4092705600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ed8005180 0x7f6ed800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.007+0000 7f6ef1fb6640 1 -- 172.21.15.44:0/4092705600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ed80047c0 msgr2=0x7f6ed8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.007+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/4092705600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ed80047c0 0x7f6ed8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.007+0000 7f6ef1fb6640 1 -- 172.21.15.44:0/4092705600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed8003520 con 0x7f6ed8003b00 2023-11-04T01:39:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.007+0000 7f6ef27b7640 1 -- 172.21.15.44:0/4092705600 reap_dead start 2023-11-04T01:39:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.007+0000 7f6ef17b5640 1 --2- 172.21.15.44:0/4092705600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ed80047c0 0x7f6ed8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.007+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/4092705600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ed8003b00 0x7f6ed8003f00 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009c90 tx=0x7f6ed80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7caa7587436c17ca server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.008+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee402c910 con 0x7f6ed8003b00 2023-11-04T01:39:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.008+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee402ca70 con 0x7f6ed8003b00 2023-11-04T01:39:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.008+0000 7f6ef0fb4640 1 -- 172.21.15.44:0/4092705600 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee402ce60 con 0x7f6ed8003b00 2023-11-04T01:39:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.008+0000 7f6ef421a640 1 -- 172.21.15.44:0/4092705600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ed8003b00 msgr2=0x7f6ed8003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.008+0000 7f6ef421a640 1 --2- 172.21.15.44:0/4092705600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ed8003b00 0x7f6ed8003f00 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009c90 tx=0x7f6ed80057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.008+0000 7f6ef421a640 1 -- 172.21.15.44:0/4092705600 shutdown_connections 2023-11-04T01:39:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.008+0000 7f6ef421a640 1 --2- 172.21.15.44:0/4092705600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ed8003b00 0x7f6ed8003f00 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.008+0000 7f6ef421a640 1 -- 172.21.15.44:0/4092705600 >> 172.21.15.44:0/4092705600 conn(0x7f6eec0cf880 msgr2=0x7f6eec0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.008+0000 7f6ef421a640 1 -- 172.21.15.44:0/4092705600 shutdown_connections 2023-11-04T01:39:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.008+0000 7f6ef421a640 1 -- 172.21.15.44:0/4092705600 wait complete. 2023-11-04T01:39:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.009+0000 7f6ef421a640 1 Processor -- start 2023-11-04T01:39:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.009+0000 7f6ef421a640 1 -- start start 2023-11-04T01:39:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.010+0000 7f6ef421a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ed8003b00 0x7f6eec141df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.010+0000 7f6ef421a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6eec1f65e0 0x7f6eec0c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.010+0000 7f6ef421a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6eec155bd0 0x7f6eec15ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.010+0000 7f6ef421a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec154670 con 0x7f6eec1f65e0 2023-11-04T01:39:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.010+0000 7f6ef421a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec1423d0 con 0x7f6ed8003b00 2023-11-04T01:39:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.010+0000 7f6ef421a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec1426b0 con 0x7f6eec155bd0 2023-11-04T01:39:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.010+0000 7f6ef17b5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6eec1f65e0 0x7f6eec0c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.010+0000 7f6ef17b5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6eec1f65e0 0x7f6eec0c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58340/0 (socket says 172.21.15.44:58340) 2023-11-04T01:39:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.010+0000 7f6ef17b5640 1 -- 172.21.15.44:0/484812132 learned_addr learned my addr 172.21.15.44:0/484812132 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.010+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/484812132 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ed8003b00 0x7f6eec141df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.010+0000 7f6ef27b7640 1 --2- 172.21.15.44:0/484812132 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6eec155bd0 0x7f6eec15ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.011+0000 7f6ef17b5640 1 -- 172.21.15.44:0/484812132 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6eec155bd0 msgr2=0x7f6eec15ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.011+0000 7f6ef17b5640 1 --2- 172.21.15.44:0/484812132 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6eec155bd0 0x7f6eec15ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.011+0000 7f6ef17b5640 1 -- 172.21.15.44:0/484812132 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ed8003b00 msgr2=0x7f6eec141df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.011+0000 7f6ef17b5640 1 --2- 172.21.15.44:0/484812132 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ed8003b00 0x7f6eec141df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.011+0000 7f6ef17b5640 1 -- 172.21.15.44:0/484812132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec142990 con 0x7f6eec1f65e0 2023-11-04T01:39:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.011+0000 7f6ef17b5640 1 --2- 172.21.15.44:0/484812132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6eec1f65e0 0x7f6eec0c5820 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00e550 tx=0x7f6edc00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.011+0000 7f6ee27fc640 1 -- 172.21.15.44:0/484812132 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc017070 con 0x7f6eec1f65e0 2023-11-04T01:39:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.011+0000 7f6ee27fc640 1 -- 172.21.15.44:0/484812132 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc0052e0 con 0x7f6eec1f65e0 2023-11-04T01:39:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.011+0000 7f6ee27fc640 1 -- 172.21.15.44:0/484812132 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc005490 con 0x7f6eec1f65e0 2023-11-04T01:39:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.011+0000 7f6ef421a640 1 -- 172.21.15.44:0/484812132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eec1f6a60 con 0x7f6eec1f65e0 2023-11-04T01:39:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.011+0000 7f6ef421a640 1 -- 172.21.15.44:0/484812132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eec0c5d60 con 0x7f6eec1f65e0 2023-11-04T01:39:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.012+0000 7f6ee27fc640 1 -- 172.21.15.44:0/484812132 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6edc007020 con 0x7f6eec1f65e0 2023-11-04T01:39:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.013+0000 7f6ee27fc640 1 --2- 172.21.15.44:0/484812132 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ed006ae70 0x7f6ed006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.013+0000 7f6ee27fc640 1 -- 172.21.15.44:0/484812132 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f6edc0892d0 con 0x7f6eec1f65e0 2023-11-04T01:39:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.013+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/484812132 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ed006ae70 0x7f6ed006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.014+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/484812132 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ed006ae70 0x7f6ed006d330 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4036000 tx=0x7f6ee4030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.014+0000 7f6ef6dab740 1 Processor -- start 2023-11-04T01:39:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.014+0000 7f6ef6dab740 1 -- start start 2023-11-04T01:39:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef6dab740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83850 0x562599b56750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef6dab740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b83c30 0x562599b865e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef6dab740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b56c90 0x562599b86b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef6dab740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x562599a67740 con 0x562599b83850 2023-11-04T01:39:43.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef6dab740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x562599ac98d0 con 0x562599b83c30 2023-11-04T01:39:43.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef6dab740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x562599ac6fc0 con 0x562599b56c90 2023-11-04T01:39:43.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef1fb6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83850 0x562599b56750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef1fb6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83850 0x562599b56750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58354/0 (socket says 172.21.15.44:58354) 2023-11-04T01:39:43.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef1fb6640 1 -- 172.21.15.44:0/1138136222 learned_addr learned my addr 172.21.15.44:0/1138136222 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:43.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef17b5640 1 --2- 172.21.15.44:0/1138136222 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b83c30 0x562599b865e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef27b7640 1 --2- 172.21.15.44:0/1138136222 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b56c90 0x562599b86b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef1fb6640 1 -- 172.21.15.44:0/1138136222 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b56c90 msgr2=0x562599b86b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/1138136222 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b56c90 0x562599b86b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef1fb6640 1 -- 172.21.15.44:0/1138136222 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b83c30 msgr2=0x562599b865e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/1138136222 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b83c30 0x562599b865e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef1fb6640 1 -- 172.21.15.44:0/1138136222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562599a85ca0 con 0x562599b83850 2023-11-04T01:39:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef27b7640 1 --2- 172.21.15.44:0/1138136222 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b56c90 0x562599b86b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/1138136222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83850 0x562599b56750 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009ab0 tx=0x7f6ee402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cb4e968dfd0517 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ecf7fe640 1 -- 172.21.15.44:0/1138136222 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee403fbd0 con 0x562599b83850 2023-11-04T01:39:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ecf7fe640 1 -- 172.21.15.44:0/1138136222 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee403fd30 con 0x562599b83850 2023-11-04T01:39:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.015+0000 7f6ecf7fe640 1 -- 172.21.15.44:0/1138136222 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee403fea0 con 0x562599b83850 2023-11-04T01:39:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.016+0000 7f6ef6dab740 1 -- 172.21.15.44:0/1138136222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83850 msgr2=0x562599b56750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.016+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/1138136222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83850 0x562599b56750 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009ab0 tx=0x7f6ee402e000 comp rx=0 tx=0).stop 2023-11-04T01:39:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.016+0000 7f6ef6dab740 1 -- 172.21.15.44:0/1138136222 shutdown_connections 2023-11-04T01:39:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.016+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/1138136222 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b56c90 0x562599b86b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.016+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/1138136222 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b83c30 0x562599b865e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.016+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/1138136222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83850 0x562599b56750 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.016+0000 7f6ef6dab740 1 -- 172.21.15.44:0/1138136222 >> 172.21.15.44:0/1138136222 conn(0x562599b58a60 msgr2=0x562599ba15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.016+0000 7f6ef6dab740 1 -- 172.21.15.44:0/1138136222 shutdown_connections 2023-11-04T01:39:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.016+0000 7f6ef6dab740 1 -- 172.21.15.44:0/1138136222 wait complete. 2023-11-04T01:39:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.017+0000 7f6ef6dab740 1 -- start start 2023-11-04T01:39:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.017+0000 7f6ef6dab740 1 Processor -- start 2023-11-04T01:39:43.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef6dab740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83850 0x562599b888a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef6dab740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b83c30 0x562599ba17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef6dab740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b77f80 0x562599b9f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef6dab740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x562599ac28b0 con 0x562599b83850 2023-11-04T01:39:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef6dab740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x562599a7cc80 con 0x562599b83c30 2023-11-04T01:39:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef6dab740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x562599a7c920 con 0x562599b77f80 2023-11-04T01:39:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef6dab740 10 client.0 _ll_register_callbacks cb 0x5625997d4ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef1fb6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83850 0x562599b888a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef1fb6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83850 0x562599b888a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58358/0 (socket says 172.21.15.44:58358) 2023-11-04T01:39:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef1fb6640 1 -- 172.21.15.44:0/2512759116 learned_addr learned my addr 172.21.15.44:0/2512759116 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef17b5640 1 --2- 172.21.15.44:0/2512759116 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b83c30 0x562599ba17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef27b7640 1 --2- 172.21.15.44:0/2512759116 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b77f80 0x562599b9f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef1fb6640 1 -- 172.21.15.44:0/2512759116 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b77f80 msgr2=0x562599b9f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/2512759116 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b77f80 0x562599b9f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef1fb6640 1 -- 172.21.15.44:0/2512759116 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b83c30 msgr2=0x562599ba17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/2512759116 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b83c30 0x562599ba17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef1fb6640 1 -- 172.21.15.44:0/2512759116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed8003520 con 0x562599b83850 2023-11-04T01:39:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef17b5640 1 --2- 172.21.15.44:0/2512759116 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b83c30 0x562599ba17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/2512759116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83850 0x562599b888a0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009c60 tx=0x7f6ee40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbe434b61728837 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.018+0000 7f6eccff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:39:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.019+0000 7f6eccff9640 1 -- 172.21.15.44:0/2512759116 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee403fea0 con 0x562599b83850 2023-11-04T01:39:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.019+0000 7f6eccff9640 1 -- 172.21.15.44:0/2512759116 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f6ee4006250 con 0x562599b83850 2023-11-04T01:39:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.019+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2512759116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562599a6ebf0 con 0x562599b83850 2023-11-04T01:39:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.019+0000 7f6eccff9640 1 -- 172.21.15.44:0/2512759116 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ee4006410 con 0x562599b83850 2023-11-04T01:39:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.019+0000 7f6ef6dab740 10 client.7563 fetch_fsmap learned FSMap version 50 2023-11-04T01:39:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.019+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2512759116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x562599ac0f30 con 0x562599b83850 2023-11-04T01:39:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.019+0000 7f6eccff9640 1 -- 172.21.15.44:0/2512759116 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562599a6ebf0 con 0x562599b83850 2023-11-04T01:39:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.019+0000 7f6eccff9640 1 -- 172.21.15.44:0/2512759116 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 50) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6ee4006570 con 0x562599b83850 2023-11-04T01:39:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.019+0000 7f6ef6dab740 10 client.7563 fetch_fsmap finished waiting for FSMap version 50 2023-11-04T01:39:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.019+0000 7f6ef6dab740 10 client.7563 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:39:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.019+0000 7f6ef6dab740 20 client.7563 populate_metadata read hostname 'smithi044' 2023-11-04T01:39:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.019+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/2512759116 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x562599bb57a0 0x562599bbf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.019+0000 7f6ef6dab740 4 client.7563 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:39:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.019+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2512759116 --> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562599abb890 con 0x562599bb57a0 2023-11-04T01:39:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.019+0000 7f6ef17b5640 1 --2- 172.21.15.44:0/2512759116 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x562599bb57a0 0x562599bbf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6ef17b5640 1 --2- 172.21.15.44:0/2512759116 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x562599bb57a0 0x562599bbf040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f8d63a538de496c server_cookie=d297dca895d4b30 in_seq=0 out_seq=0 2023-11-04T01:39:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6eccff9640 10 client.7563 ms_handle_connect on v2:172.21.15.44:6832/2069525699 2023-11-04T01:39:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6eccff9640 1 -- 172.21.15.44:0/2512759116 <== mds.1 v2:172.21.15.44:6832/2069525699 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562599abb890 con 0x562599bb57a0 2023-11-04T01:39:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6eccff9640 10 client.7563 handle_command_reply: tid=0 2023-11-04T01:39:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6ef6dab740 1 client.7563 shutdown 2023-11-04T01:39:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2512759116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83850 msgr2=0x562599b888a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/2512759116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83850 0x562599b888a0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009c60 tx=0x7f6ee40046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2512759116 shutdown_connections 2023-11-04T01:39:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/2512759116 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x562599bb57a0 0x562599bbf040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/2512759116 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b77f80 0x562599b9f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/2512759116 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b83c30 0x562599ba17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/2512759116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83850 0x562599b888a0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2512759116 >> 172.21.15.44:0/2512759116 conn(0x562599b56c90 msgr2=0x562599ba2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6eccff9640 0 client.7563 ms_handle_reset on v2:172.21.15.44:6832/2069525699 2023-11-04T01:39:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2512759116 shutdown_connections 2023-11-04T01:39:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.020+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2512759116 wait complete. 2023-11-04T01:39:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.021+0000 7f6ef6dab740 20 client.7563 trim_cache size 0 max 16384 2023-11-04T01:39:43.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.036+0000 7f6ef6dab740 1 Processor -- start 2023-11-04T01:39:43.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.036+0000 7f6ef6dab740 1 -- start start 2023-11-04T01:39:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.037+0000 7f6ef6dab740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b77f80 0x562599ba2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.037+0000 7f6ef6dab740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b83850 0x562599b9b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.037+0000 7f6ef6dab740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b83c30 0x562599b9bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.037+0000 7f6ef6dab740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x562599a42280 con 0x562599b77f80 2023-11-04T01:39:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.037+0000 7f6ef6dab740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x562599b89860 con 0x562599b83c30 2023-11-04T01:39:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.037+0000 7f6ef6dab740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x562599b82bc0 con 0x562599b83850 2023-11-04T01:39:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.037+0000 7f6ef1fb6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b77f80 0x562599ba2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.037+0000 7f6ef1fb6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b77f80 0x562599ba2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58372/0 (socket says 172.21.15.44:58372) 2023-11-04T01:39:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.037+0000 7f6ef1fb6640 1 -- 172.21.15.44:0/4101811761 learned_addr learned my addr 172.21.15.44:0/4101811761 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.037+0000 7f6ef1fb6640 1 -- 172.21.15.44:0/4101811761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b83850 msgr2=0x562599b9b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.037+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/4101811761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b83850 0x562599b9b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.037+0000 7f6ef1fb6640 1 -- 172.21.15.44:0/4101811761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b83c30 msgr2=0x562599b9bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.037+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/4101811761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b83c30 0x562599b9bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.037+0000 7f6ef1fb6640 1 -- 172.21.15.44:0/4101811761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562599a5ed10 con 0x562599b77f80 2023-11-04T01:39:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.038+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/4101811761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b77f80 0x562599ba2a40 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009ab0 tx=0x7f6ee4042070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f7871e4fb2b4fc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.038+0000 7f6ecffff640 1 -- 172.21.15.44:0/4101811761 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee403fea0 con 0x562599b77f80 2023-11-04T01:39:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.038+0000 7f6ecffff640 1 -- 172.21.15.44:0/4101811761 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee4006170 con 0x562599b77f80 2023-11-04T01:39:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.038+0000 7f6ecffff640 1 -- 172.21.15.44:0/4101811761 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4006520 con 0x562599b77f80 2023-11-04T01:39:43.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.038+0000 7f6ef6dab740 1 -- 172.21.15.44:0/4101811761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b77f80 msgr2=0x562599ba2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.038+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/4101811761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b77f80 0x562599ba2a40 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009ab0 tx=0x7f6ee4042070 comp rx=0 tx=0).stop 2023-11-04T01:39:43.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.038+0000 7f6ef6dab740 1 -- 172.21.15.44:0/4101811761 shutdown_connections 2023-11-04T01:39:43.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.038+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/4101811761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b83c30 0x562599b9bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.038+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/4101811761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b83850 0x562599b9b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.038+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/4101811761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b77f80 0x562599ba2a40 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.038+0000 7f6ef6dab740 1 -- 172.21.15.44:0/4101811761 >> 172.21.15.44:0/4101811761 conn(0x562599b56c90 msgr2=0x562599b5d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.038+0000 7f6ef6dab740 1 -- 172.21.15.44:0/4101811761 shutdown_connections 2023-11-04T01:39:43.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.038+0000 7f6ef6dab740 1 -- 172.21.15.44:0/4101811761 wait complete. 2023-11-04T01:39:43.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.039+0000 7f6ef6dab740 1 -- start start 2023-11-04T01:39:43.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.039+0000 7f6ef6dab740 1 Processor -- start 2023-11-04T01:39:43.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef6dab740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b77f80 0x562599bb37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef6dab740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b83850 0x562599b86120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef6dab740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83c30 0x562599bc3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef6dab740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x562599bb41d0 con 0x562599b83c30 2023-11-04T01:39:43.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef6dab740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x562599bb3d00 con 0x562599b77f80 2023-11-04T01:39:43.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef6dab740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x562599b9bf00 con 0x562599b83850 2023-11-04T01:39:43.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef6dab740 10 client.0 _ll_register_callbacks cb 0x7f6ee4037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:43.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef27b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83c30 0x562599bc3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef27b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83c30 0x562599bc3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58380/0 (socket says 172.21.15.44:58380) 2023-11-04T01:39:43.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef27b7640 1 -- 172.21.15.44:0/2499878147 learned_addr learned my addr 172.21.15.44:0/2499878147 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:43.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/2499878147 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b77f80 0x562599bb37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef17b5640 1 --2- 172.21.15.44:0/2499878147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b83850 0x562599b86120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef27b7640 1 -- 172.21.15.44:0/2499878147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b83850 msgr2=0x562599b86120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef27b7640 1 --2- 172.21.15.44:0/2499878147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b83850 0x562599b86120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef27b7640 1 -- 172.21.15.44:0/2499878147 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b77f80 msgr2=0x562599bb37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef27b7640 1 --2- 172.21.15.44:0/2499878147 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b77f80 0x562599bb37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef27b7640 1 -- 172.21.15.44:0/2499878147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562599ac0f30 con 0x562599b83c30 2023-11-04T01:39:43.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.040+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/2499878147 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b77f80 0x562599bb37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:43.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6ef27b7640 1 --2- 172.21.15.44:0/2499878147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83c30 0x562599bc3060 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8001d40 tx=0x7f6ee80076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4625b80f14182fe3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6eccff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:39:43.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6eccff9640 1 -- 172.21.15.44:0/2499878147 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8015820 con 0x562599b83c30 2023-11-04T01:39:43.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6eccff9640 1 -- 172.21.15.44:0/2499878147 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f6ee8015980 con 0x562599b83c30 2023-11-04T01:39:43.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2499878147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ee403fd30 con 0x562599b83c30 2023-11-04T01:39:43.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6eccff9640 1 -- 172.21.15.44:0/2499878147 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ee8015b40 con 0x562599b83c30 2023-11-04T01:39:43.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6ef6dab740 10 client.7569 fetch_fsmap learned FSMap version 50 2023-11-04T01:39:43.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2499878147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x562599a84500 con 0x562599b83c30 2023-11-04T01:39:43.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6eccff9640 1 -- 172.21.15.44:0/2499878147 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee403fd30 con 0x562599b83c30 2023-11-04T01:39:43.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6eccff9640 1 -- 172.21.15.44:0/2499878147 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 50) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6ee8015ca0 con 0x562599b83c30 2023-11-04T01:39:43.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6ef6dab740 10 client.7569 fetch_fsmap finished waiting for FSMap version 50 2023-11-04T01:39:43.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6ef6dab740 10 client.7569 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:39:43.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6ef6dab740 20 client.7569 populate_metadata read hostname 'smithi044' 2023-11-04T01:39:43.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/2499878147 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x562599bc35a0 0x562599b873c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6ef6dab740 4 client.7569 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:39:43.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2499878147 --> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562599abb5b0 con 0x562599bc35a0 2023-11-04T01:39:43.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.041+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/2499878147 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x562599bc35a0 0x562599b873c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6ef1fb6640 1 --2- 172.21.15.44:0/2499878147 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x562599bc35a0 0x562599b873c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=76d6371ff8231164 server_cookie=9ebf067e238d0a72 in_seq=0 out_seq=0 2023-11-04T01:39:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6eccff9640 10 client.7569 ms_handle_connect on v2:172.21.15.44:6832/2069525699 2023-11-04T01:39:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6eccff9640 1 -- 172.21.15.44:0/2499878147 <== mds.1 v2:172.21.15.44:6832/2069525699 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x562599abb5b0 con 0x562599bc35a0 2023-11-04T01:39:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6eccff9640 10 client.7569 handle_command_reply: tid=0 2023-11-04T01:39:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6ef6dab740 1 client.7569 shutdown 2023-11-04T01:39:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2499878147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83c30 msgr2=0x562599bc3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/2499878147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83c30 0x562599bc3060 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8001d40 tx=0x7f6ee80076c0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2499878147 shutdown_connections 2023-11-04T01:39:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/2499878147 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x562599bc35a0 0x562599b873c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/2499878147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562599b83c30 0x562599bc3060 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/2499878147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562599b83850 0x562599b86120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6ef6dab740 1 --2- 172.21.15.44:0/2499878147 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562599b77f80 0x562599bb37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6eccff9640 0 client.7569 ms_handle_reset on v2:172.21.15.44:6832/2069525699 2023-11-04T01:39:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2499878147 >> 172.21.15.44:0/2499878147 conn(0x562599b56c90 msgr2=0x562599b9b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2499878147 shutdown_connections 2023-11-04T01:39:43.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6ef6dab740 1 -- 172.21.15.44:0/2499878147 wait complete. 2023-11-04T01:39:43.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.042+0000 7f6ef6dab740 20 client.7569 trim_cache size 0 max 16384 2023-11-04T01:39:43.051 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:39:43.051 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:39:43.051 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 1, 2023-11-04T01:39:43.052 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7344, 2023-11-04T01:39:43.052 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:39:43.052 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:39:43.052 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:39:43.052 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 2.6767514979999998, 2023-11-04T01:39:43.052 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 50, 2023-11-04T01:39:43.052 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 98, 2023-11-04T01:39:43.052 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 98, 2023-11-04T01:39:43.052 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 18.536089471 2023-11-04T01:39:43.052 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:39:43.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.043+0000 7f6ef421a640 1 -- 172.21.15.44:0/484812132 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ed006ae70 msgr2=0x7f6ed006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.043+0000 7f6ef421a640 1 --2- 172.21.15.44:0/484812132 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ed006ae70 0x7f6ed006d330 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4036000 tx=0x7f6ee4030000 comp rx=0 tx=0).stop 2023-11-04T01:39:43.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.043+0000 7f6ef421a640 1 -- 172.21.15.44:0/484812132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6eec1f65e0 msgr2=0x7f6eec0c5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.043+0000 7f6ef421a640 1 --2- 172.21.15.44:0/484812132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6eec1f65e0 0x7f6eec0c5820 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00e550 tx=0x7f6edc00ea10 comp rx=0 tx=0).stop 2023-11-04T01:39:43.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.043+0000 7f6ef421a640 1 -- 172.21.15.44:0/484812132 shutdown_connections 2023-11-04T01:39:43.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.043+0000 7f6ef421a640 1 --2- 172.21.15.44:0/484812132 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6ed006ae70 0x7f6ed006d330 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.043+0000 7f6ef421a640 1 --2- 172.21.15.44:0/484812132 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6eec155bd0 0x7f6eec15ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.043+0000 7f6ef421a640 1 --2- 172.21.15.44:0/484812132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6eec1f65e0 0x7f6eec0c5820 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.043+0000 7f6ef421a640 1 --2- 172.21.15.44:0/484812132 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ed8003b00 0x7f6eec141df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.043+0000 7f6ef421a640 1 -- 172.21.15.44:0/484812132 >> 172.21.15.44:0/484812132 conn(0x7f6eec0cf880 msgr2=0x7f6eec0b8480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.043+0000 7f6ef421a640 1 -- 172.21.15.44:0/484812132 shutdown_connections 2023-11-04T01:39:43.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.043+0000 7f6ef421a640 1 -- 172.21.15.44:0/484812132 wait complete. 2023-11-04T01:39:43.055 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:39:43.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.160+0000 7f1f4d475640 1 Processor -- start 2023-11-04T01:39:43.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.160+0000 7f1f4d475640 1 -- start start 2023-11-04T01:39:43.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.161+0000 7f1f4d475640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1f480d0710 0x7f1f480cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.161+0000 7f1f4d475640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f480d0280 con 0x7f1f480cda50 2023-11-04T01:39:43.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.161+0000 7f1f4d475640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f480cf670 con 0x7f1f4815e430 2023-11-04T01:39:43.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.161+0000 7f1f4d475640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f480cf950 con 0x7f1f480d0710 2023-11-04T01:39:43.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.161+0000 7f1f477fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1f480cda50 0x7f1f480b3d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52848/0 (socket says 172.21.15.44:52848) 2023-11-04T01:39:43.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.161+0000 7f1f477fe640 1 -- 172.21.15.44:0/1001478371 learned_addr learned my addr 172.21.15.44:0/1001478371 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:43.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.161+0000 7f1f45ffb640 1 -- 172.21.15.44:0/1001478371 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209461225 0 0) 0x7f1f480d0280 con 0x7f1f480cda50 2023-11-04T01:39:43.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.161+0000 7f1f45ffb640 1 -- 172.21.15.44:0/1001478371 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f34003520 con 0x7f1f480cda50 2023-11-04T01:39:43.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.161+0000 7f1f467fc640 1 --2- 172.21.15.44:0/1001478371 >> v2:172.21.15.204:3300/0 conn(0x7f1f480d0710 0x7f1f480cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.161+0000 7f1f45ffb640 1 -- 172.21.15.44:0/1001478371 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2708535065 0 0) 0x7f1f34003520 con 0x7f1f480cda50 2023-11-04T01:39:43.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f45ffb640 1 -- 172.21.15.44:0/1001478371 >> v2:172.21.15.204:3300/0 conn(0x7f1f480d0710 msgr2=0x7f1f480cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f45ffb640 1 --2- 172.21.15.44:0/1001478371 >> v2:172.21.15.204:3300/0 conn(0x7f1f480d0710 0x7f1f480cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f45ffb640 1 -- 172.21.15.44:0/1001478371 >> v1:172.21.15.204:6789/0 conn(0x7f1f4815e430 legacy=0x7f1f480cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f45ffb640 1 -- 172.21.15.44:0/1001478371 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f480cfc30 con 0x7f1f480cda50 2023-11-04T01:39:43.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f45ffb640 1 -- 172.21.15.44:0/1001478371 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f1f380019f0 con 0x7f1f480cda50 2023-11-04T01:39:43.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f45ffb640 1 -- 172.21.15.44:0/1001478371 >> v1:172.21.15.44:6789/0 conn(0x7f1f480cda50 legacy=0x7f1f480b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f45ffb640 1 --2- 172.21.15.44:0/1001478371 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f34003970 0x7f1f34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f45ffb640 1 --2- 172.21.15.44:0/1001478371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f340047c0 0x7f1f34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f45ffb640 1 --2- 172.21.15.44:0/1001478371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f34005180 0x7f1f3400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f45ffb640 1 -- 172.21.15.44:0/1001478371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f480cf950 con 0x7f1f34005180 2023-11-04T01:39:43.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f45ffb640 1 -- 172.21.15.44:0/1001478371 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3400c020 con 0x7f1f34003970 2023-11-04T01:39:43.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f45ffb640 1 -- 172.21.15.44:0/1001478371 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3400c1e0 con 0x7f1f340047c0 2023-11-04T01:39:43.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f477fe640 1 --2- 172.21.15.44:0/1001478371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f34005180 0x7f1f3400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f46ffd640 1 --2- 172.21.15.44:0/1001478371 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f34003970 0x7f1f34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f467fc640 1 --2- 172.21.15.44:0/1001478371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f340047c0 0x7f1f34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f477fe640 1 -- 172.21.15.44:0/1001478371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f340047c0 msgr2=0x7f1f34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f477fe640 1 --2- 172.21.15.44:0/1001478371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f340047c0 0x7f1f34004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f477fe640 1 -- 172.21.15.44:0/1001478371 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f34003970 msgr2=0x7f1f34003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f477fe640 1 --2- 172.21.15.44:0/1001478371 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f34003970 0x7f1f34003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.162+0000 7f1f477fe640 1 -- 172.21.15.44:0/1001478371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f34003520 con 0x7f1f34005180 2023-11-04T01:39:43.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.163+0000 7f1f477fe640 1 -- 172.21.15.44:0/1001478371 reap_dead start 2023-11-04T01:39:43.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.163+0000 7f1f477fe640 1 --2- 172.21.15.44:0/1001478371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f34005180 0x7f1f3400b980 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800a830 tx=0x7f1f340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2db0dce6b998cf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.163+0000 7f1f45ffb640 1 -- 172.21.15.44:0/1001478371 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380072d0 con 0x7f1f34005180 2023-11-04T01:39:43.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.163+0000 7f1f45ffb640 1 -- 172.21.15.44:0/1001478371 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3802f070 con 0x7f1f34005180 2023-11-04T01:39:43.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.163+0000 7f1f45ffb640 1 -- 172.21.15.44:0/1001478371 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380076b0 con 0x7f1f34005180 2023-11-04T01:39:43.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.163+0000 7f1f4d475640 1 -- 172.21.15.44:0/1001478371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f34005180 msgr2=0x7f1f3400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.163+0000 7f1f4d475640 1 --2- 172.21.15.44:0/1001478371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f34005180 0x7f1f3400b980 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800a830 tx=0x7f1f340057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.164+0000 7f1f4d475640 1 -- 172.21.15.44:0/1001478371 shutdown_connections 2023-11-04T01:39:43.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.164+0000 7f1f4d475640 1 --2- 172.21.15.44:0/1001478371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f34005180 0x7f1f3400b980 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.164+0000 7f1f4d475640 1 -- 172.21.15.44:0/1001478371 >> 172.21.15.44:0/1001478371 conn(0x7f1f4806ea20 msgr2=0x7f1f4806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.164+0000 7f1f4d475640 1 -- 172.21.15.44:0/1001478371 shutdown_connections 2023-11-04T01:39:43.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.164+0000 7f1f4d475640 1 -- 172.21.15.44:0/1001478371 wait complete. 2023-11-04T01:39:43.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.165+0000 7f1f4d475640 1 Processor -- start 2023-11-04T01:39:43.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.165+0000 7f1f4d475640 1 -- start start 2023-11-04T01:39:43.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f4d475640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f34005180 0x7f1f481561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f4d475640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f480c7c70 0x7f1f481559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f4d475640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f481592e0 0x7f1f48159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f4d475640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f48159ca0 con 0x7f1f480c7c70 2023-11-04T01:39:43.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f4d475640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f48156a00 con 0x7f1f34005180 2023-11-04T01:39:43.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f4d475640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f48156ce0 con 0x7f1f481592e0 2023-11-04T01:39:43.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f467fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f480c7c70 0x7f1f481559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f467fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f480c7c70 0x7f1f481559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58394/0 (socket says 172.21.15.44:58394) 2023-11-04T01:39:43.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f467fc640 1 -- 172.21.15.44:0/934599278 learned_addr learned my addr 172.21.15.44:0/934599278 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:43.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f46ffd640 1 --2- 172.21.15.44:0/934599278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f34005180 0x7f1f481561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f477fe640 1 --2- 172.21.15.44:0/934599278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f481592e0 0x7f1f48159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f467fc640 1 -- 172.21.15.44:0/934599278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f481592e0 msgr2=0x7f1f48159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f467fc640 1 --2- 172.21.15.44:0/934599278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f481592e0 0x7f1f48159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f467fc640 1 -- 172.21.15.44:0/934599278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f34005180 msgr2=0x7f1f481561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f467fc640 1 --2- 172.21.15.44:0/934599278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f34005180 0x7f1f481561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f467fc640 1 -- 172.21.15.44:0/934599278 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f48156fc0 con 0x7f1f480c7c70 2023-11-04T01:39:43.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f467fc640 1 --2- 172.21.15.44:0/934599278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f480c7c70 0x7f1f481559d0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f1f300118e0 tx=0x7f1f30011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f3f7fe640 1 -- 172.21.15.44:0/934599278 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3000faf0 con 0x7f1f480c7c70 2023-11-04T01:39:43.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f3f7fe640 1 -- 172.21.15.44:0/934599278 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3000fc50 con 0x7f1f480c7c70 2023-11-04T01:39:43.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f4d475640 1 -- 172.21.15.44:0/934599278 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f481572a0 con 0x7f1f480c7c70 2023-11-04T01:39:43.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.166+0000 7f1f3f7fe640 1 -- 172.21.15.44:0/934599278 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f30014440 con 0x7f1f480c7c70 2023-11-04T01:39:43.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.167+0000 7f1f4d475640 1 -- 172.21.15.44:0/934599278 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f481566f0 con 0x7f1f480c7c70 2023-11-04T01:39:43.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.168+0000 7f1f3f7fe640 1 -- 172.21.15.44:0/934599278 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f3001d400 con 0x7f1f480c7c70 2023-11-04T01:39:43.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.169+0000 7f1f3f7fe640 1 --2- 172.21.15.44:0/934599278 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1f2806aea0 0x7f1f2806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.169+0000 7f1f3f7fe640 1 -- 172.21.15.44:0/934599278 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f1f3008a500 con 0x7f1f480c7c70 2023-11-04T01:39:43.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.169+0000 7f1f46ffd640 1 --2- 172.21.15.44:0/934599278 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1f2806aea0 0x7f1f2806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.170+0000 7f1f50009740 1 Processor -- start 2023-11-04T01:39:43.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.170+0000 7f1f46ffd640 1 --2- 172.21.15.44:0/934599278 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1f2806aea0 0x7f1f2806d360 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1f40000c00 tx=0x7f1f40009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.170+0000 7f1f50009740 1 -- start start 2023-11-04T01:39:43.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.170+0000 7f1f50009740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31560850 0x55de31533750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.170+0000 7f1f50009740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560c30 0x55de315635e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.170+0000 7f1f50009740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31533c90 0x55de31563b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.179 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.170+0000 7f1f50009740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de31444740 con 0x55de31533c90 2023-11-04T01:39:43.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.170+0000 7f1f50009740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de314a68d0 con 0x55de31560c30 2023-11-04T01:39:43.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.170+0000 7f1f50009740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de314a3fc0 con 0x55de31560850 2023-11-04T01:39:43.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.171+0000 7f1f477fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31533c90 0x55de31563b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.171+0000 7f1f477fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31533c90 0x55de31563b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58400/0 (socket says 172.21.15.44:58400) 2023-11-04T01:39:43.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.171+0000 7f1f477fe640 1 -- 172.21.15.44:0/2007801575 learned_addr learned my addr 172.21.15.44:0/2007801575 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:43.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.171+0000 7f1f46ffd640 1 --2- 172.21.15.44:0/2007801575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31560850 0x55de31533750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.171+0000 7f1f467fc640 1 --2- 172.21.15.44:0/2007801575 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560c30 0x55de315635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.171+0000 7f1f477fe640 1 -- 172.21.15.44:0/2007801575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31560850 msgr2=0x55de31533750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.171+0000 7f1f477fe640 1 --2- 172.21.15.44:0/2007801575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31560850 0x55de31533750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.171+0000 7f1f477fe640 1 -- 172.21.15.44:0/2007801575 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560c30 msgr2=0x55de315635e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.171+0000 7f1f477fe640 1 --2- 172.21.15.44:0/2007801575 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560c30 0x55de315635e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.171+0000 7f1f477fe640 1 -- 172.21.15.44:0/2007801575 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de31462ca0 con 0x55de31533c90 2023-11-04T01:39:43.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.171+0000 7f1f477fe640 1 --2- 172.21.15.44:0/2007801575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31533c90 0x55de31563b20 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f1f3802cc40 tx=0x7f1f3802f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f653925b7810efc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.171+0000 7f1f3cff9640 1 -- 172.21.15.44:0/2007801575 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380019b0 con 0x55de31533c90 2023-11-04T01:39:43.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.171+0000 7f1f3cff9640 1 -- 172.21.15.44:0/2007801575 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f38001250 con 0x55de31533c90 2023-11-04T01:39:43.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.171+0000 7f1f3cff9640 1 -- 172.21.15.44:0/2007801575 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f38004d60 con 0x55de31533c90 2023-11-04T01:39:43.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.172+0000 7f1f50009740 1 -- 172.21.15.44:0/2007801575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31533c90 msgr2=0x55de31563b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.172+0000 7f1f50009740 1 --2- 172.21.15.44:0/2007801575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31533c90 0x55de31563b20 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f1f3802cc40 tx=0x7f1f3802f000 comp rx=0 tx=0).stop 2023-11-04T01:39:43.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.172+0000 7f1f50009740 1 -- 172.21.15.44:0/2007801575 shutdown_connections 2023-11-04T01:39:43.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.172+0000 7f1f50009740 1 --2- 172.21.15.44:0/2007801575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31533c90 0x55de31563b20 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.172+0000 7f1f50009740 1 --2- 172.21.15.44:0/2007801575 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560c30 0x55de315635e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.172+0000 7f1f50009740 1 --2- 172.21.15.44:0/2007801575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31560850 0x55de31533750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.172+0000 7f1f50009740 1 -- 172.21.15.44:0/2007801575 >> 172.21.15.44:0/2007801575 conn(0x55de31535a60 msgr2=0x55de3157e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.172+0000 7f1f50009740 1 -- 172.21.15.44:0/2007801575 shutdown_connections 2023-11-04T01:39:43.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.172+0000 7f1f50009740 1 -- 172.21.15.44:0/2007801575 wait complete. 2023-11-04T01:39:43.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.173+0000 7f1f50009740 1 -- start start 2023-11-04T01:39:43.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.173+0000 7f1f50009740 1 Processor -- start 2023-11-04T01:39:43.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.173+0000 7f1f50009740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560850 0x55de31578ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.173+0000 7f1f50009740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560c30 0x55de3158e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.173+0000 7f1f50009740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 0x55de3158e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.173+0000 7f1f50009740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de3149f8b0 con 0x55de31560850 2023-11-04T01:39:43.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.173+0000 7f1f50009740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de31459c80 con 0x55de31560c30 2023-11-04T01:39:43.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.173+0000 7f1f50009740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de31459920 con 0x55de31554dd0 2023-11-04T01:39:43.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.173+0000 7f1f50009740 10 client.0 _ll_register_callbacks cb 0x55de311b1ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:43.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.173+0000 7f1f46ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560850 0x55de31578ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f46ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560850 0x55de31578ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58416/0 (socket says 172.21.15.44:58416) 2023-11-04T01:39:43.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f46ffd640 1 -- 172.21.15.44:0/865641348 learned_addr learned my addr 172.21.15.44:0/865641348 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:43.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f467fc640 1 --2- 172.21.15.44:0/865641348 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560c30 0x55de3158e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f477fe640 1 --2- 172.21.15.44:0/865641348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 0x55de3158e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f46ffd640 1 -- 172.21.15.44:0/865641348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 msgr2=0x55de3158e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f46ffd640 1 --2- 172.21.15.44:0/865641348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 0x55de3158e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f46ffd640 1 -- 172.21.15.44:0/865641348 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560c30 msgr2=0x55de3158e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f46ffd640 1 --2- 172.21.15.44:0/865641348 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560c30 0x55de3158e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f46ffd640 1 -- 172.21.15.44:0/865641348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f34003520 con 0x55de31560850 2023-11-04T01:39:43.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f46ffd640 1 --2- 172.21.15.44:0/865641348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560850 0x55de31578ed0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f1f40015510 tx=0x7f1f40001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9551cded06083237 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:39:43.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f25ffb640 1 -- 172.21.15.44:0/865641348 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f400145e0 con 0x55de31560850 2023-11-04T01:39:43.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f25ffb640 1 -- 172.21.15.44:0/865641348 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f1f4001d070 con 0x55de31560850 2023-11-04T01:39:43.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f50009740 1 -- 172.21.15.44:0/865641348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de3144bbf0 con 0x55de31560850 2023-11-04T01:39:43.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f25ffb640 1 -- 172.21.15.44:0/865641348 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f40014740 con 0x55de31560850 2023-11-04T01:39:43.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f50009740 10 client.7581 fetch_fsmap learned FSMap version 50 2023-11-04T01:39:43.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.174+0000 7f1f50009740 1 -- 172.21.15.44:0/865641348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55de3149df30 con 0x55de31560850 2023-11-04T01:39:43.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.175+0000 7f1f25ffb640 1 -- 172.21.15.44:0/865641348 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55de3144bbf0 con 0x55de31560850 2023-11-04T01:39:43.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.175+0000 7f1f25ffb640 1 -- 172.21.15.44:0/865641348 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 50) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f1f400148a0 con 0x55de31560850 2023-11-04T01:39:43.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.175+0000 7f1f50009740 10 client.7581 fetch_fsmap finished waiting for FSMap version 50 2023-11-04T01:39:43.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.175+0000 7f1f50009740 10 client.7581 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:39:43.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.175+0000 7f1f50009740 20 client.7581 populate_metadata read hostname 'smithi044' 2023-11-04T01:39:43.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.175+0000 7f1f50009740 1 --2- 172.21.15.44:0/865641348 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x55de31599ad0 0x55de3159bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.175+0000 7f1f50009740 4 client.7581 mds_command: new command op to 7359 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:39:43.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.175+0000 7f1f50009740 1 -- 172.21.15.44:0/865641348 --> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de31498890 con 0x55de31599ad0 2023-11-04T01:39:43.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.175+0000 7f1f467fc640 1 --2- 172.21.15.44:0/865641348 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x55de31599ad0 0x55de3159bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.175+0000 7f1f25ffb640 10 client.7581 ms_handle_connect on v2:172.21.15.204:6834/2461924520 2023-11-04T01:39:43.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.175+0000 7f1f467fc640 1 --2- 172.21.15.44:0/865641348 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x55de31599ad0 0x55de3159bec0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b9354431cb5a66c server_cookie=4bf01fd6d3b58da4 in_seq=0 out_seq=0 2023-11-04T01:39:43.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.176+0000 7f1f25ffb640 1 -- 172.21.15.44:0/865641348 <== mds.0 v2:172.21.15.204:6834/2461924520 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55de31498890 con 0x55de31599ad0 2023-11-04T01:39:43.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.176+0000 7f1f25ffb640 10 client.7581 handle_command_reply: tid=0 2023-11-04T01:39:43.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.176+0000 7f1f50009740 1 client.7581 shutdown 2023-11-04T01:39:43.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.176+0000 7f1f50009740 1 -- 172.21.15.44:0/865641348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560850 msgr2=0x55de31578ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.176+0000 7f1f50009740 1 --2- 172.21.15.44:0/865641348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560850 0x55de31578ed0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f1f40015510 tx=0x7f1f40001120 comp rx=0 tx=0).stop 2023-11-04T01:39:43.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.176+0000 7f1f50009740 1 -- 172.21.15.44:0/865641348 shutdown_connections 2023-11-04T01:39:43.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.176+0000 7f1f50009740 1 --2- 172.21.15.44:0/865641348 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x55de31599ad0 0x55de3159bec0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.176+0000 7f1f50009740 1 --2- 172.21.15.44:0/865641348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 0x55de3158e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.176+0000 7f1f25ffb640 0 client.7581 ms_handle_reset on v2:172.21.15.204:6834/2461924520 2023-11-04T01:39:43.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.176+0000 7f1f50009740 1 --2- 172.21.15.44:0/865641348 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560c30 0x55de3158e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.176+0000 7f1f50009740 1 --2- 172.21.15.44:0/865641348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560850 0x55de31578ed0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.176+0000 7f1f50009740 1 -- 172.21.15.44:0/865641348 >> 172.21.15.44:0/865641348 conn(0x55de31533c90 msgr2=0x55de315822f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.176+0000 7f1f50009740 1 -- 172.21.15.44:0/865641348 shutdown_connections 2023-11-04T01:39:43.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.176+0000 7f1f50009740 1 -- 172.21.15.44:0/865641348 wait complete. 2023-11-04T01:39:43.185 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.176+0000 7f1f50009740 20 client.7581 trim_cache size 0 max 16384 2023-11-04T01:39:43.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.192+0000 7f1f50009740 1 Processor -- start 2023-11-04T01:39:43.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.192+0000 7f1f50009740 1 -- start start 2023-11-04T01:39:43.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f50009740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 0x55de31575360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f50009740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560850 0x55de3152ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f50009740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560c30 0x55de31537540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f50009740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de3141f280 con 0x55de31560c30 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f50009740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de3146b7e0 con 0x55de31560850 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f50009740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de3143e150 con 0x55de31554dd0 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f477fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560c30 0x55de31537540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f477fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560c30 0x55de31537540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58426/0 (socket says 172.21.15.44:58426) 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f477fe640 1 -- 172.21.15.44:0/2372603641 learned_addr learned my addr 172.21.15.44:0/2372603641 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f46ffd640 1 --2- 172.21.15.44:0/2372603641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 0x55de31575360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f467fc640 1 --2- 172.21.15.44:0/2372603641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560850 0x55de3152ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f477fe640 1 -- 172.21.15.44:0/2372603641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 msgr2=0x55de31575360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f477fe640 1 --2- 172.21.15.44:0/2372603641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 0x55de31575360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f477fe640 1 -- 172.21.15.44:0/2372603641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560850 msgr2=0x55de3152ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f477fe640 1 --2- 172.21.15.44:0/2372603641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560850 0x55de3152ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f477fe640 1 -- 172.21.15.44:0/2372603641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de3143bd10 con 0x55de31560c30 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f46ffd640 1 --2- 172.21.15.44:0/2372603641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 0x55de31575360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f467fc640 1 --2- 172.21.15.44:0/2372603641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560850 0x55de3152ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f477fe640 1 --2- 172.21.15.44:0/2372603641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560c30 0x55de31537540 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f1f38000f80 tx=0x7f1f38030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2642575502b7de server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f3d7fa640 1 -- 172.21.15.44:0/2372603641 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f38001a70 con 0x55de31560c30 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f3d7fa640 1 -- 172.21.15.44:0/2372603641 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f38004b60 con 0x55de31560c30 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.193+0000 7f1f3d7fa640 1 -- 172.21.15.44:0/2372603641 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3803f480 con 0x55de31560c30 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.194+0000 7f1f50009740 1 -- 172.21.15.44:0/2372603641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560c30 msgr2=0x55de31537540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.194+0000 7f1f50009740 1 --2- 172.21.15.44:0/2372603641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560c30 0x55de31537540 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f1f38000f80 tx=0x7f1f38030000 comp rx=0 tx=0).stop 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.194+0000 7f1f50009740 1 -- 172.21.15.44:0/2372603641 shutdown_connections 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.194+0000 7f1f50009740 1 --2- 172.21.15.44:0/2372603641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560c30 0x55de31537540 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.194+0000 7f1f50009740 1 --2- 172.21.15.44:0/2372603641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560850 0x55de3152ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.194+0000 7f1f50009740 1 --2- 172.21.15.44:0/2372603641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 0x55de31575360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.194+0000 7f1f50009740 1 -- 172.21.15.44:0/2372603641 >> 172.21.15.44:0/2372603641 conn(0x55de31533c90 msgr2=0x55de3155f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.194+0000 7f1f50009740 1 -- 172.21.15.44:0/2372603641 shutdown_connections 2023-11-04T01:39:43.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.194+0000 7f1f50009740 1 -- 172.21.15.44:0/2372603641 wait complete. 2023-11-04T01:39:43.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.194+0000 7f1f50009740 1 -- start start 2023-11-04T01:39:43.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.195+0000 7f1f50009740 1 Processor -- start 2023-11-04T01:39:43.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.195+0000 7f1f50009740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 0x55de3155fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.195+0000 7f1f50009740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560850 0x55de315755a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.195+0000 7f1f50009740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560c30 0x55de315e6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.195+0000 7f1f50009740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de31554480 con 0x55de31560c30 2023-11-04T01:39:43.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.195+0000 7f1f50009740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de315e0a80 con 0x55de31560850 2023-11-04T01:39:43.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.195+0000 7f1f50009740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de315389f0 con 0x55de31554dd0 2023-11-04T01:39:43.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.195+0000 7f1f50009740 10 client.0 _ll_register_callbacks cb 0x7f1f340046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:43.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.195+0000 7f1f477fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560c30 0x55de315e6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.195+0000 7f1f477fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560c30 0x55de315e6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58428/0 (socket says 172.21.15.44:58428) 2023-11-04T01:39:43.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.195+0000 7f1f477fe640 1 -- 172.21.15.44:0/131668229 learned_addr learned my addr 172.21.15.44:0/131668229 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:43.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f46ffd640 1 --2- 172.21.15.44:0/131668229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 0x55de3155fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f467fc640 1 --2- 172.21.15.44:0/131668229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560850 0x55de315755a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f477fe640 1 -- 172.21.15.44:0/131668229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 msgr2=0x55de3155fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f477fe640 1 --2- 172.21.15.44:0/131668229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 0x55de3155fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f477fe640 1 -- 172.21.15.44:0/131668229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560850 msgr2=0x55de315755a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f477fe640 1 --2- 172.21.15.44:0/131668229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560850 0x55de315755a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f477fe640 1 -- 172.21.15.44:0/131668229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de31462ca0 con 0x55de31560c30 2023-11-04T01:39:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f477fe640 1 --2- 172.21.15.44:0/131668229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560c30 0x55de315e6840 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800a950 tx=0x7f1f38009050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3449f260f4686bf9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:39:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f25ffb640 1 -- 172.21.15.44:0/131668229 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f38001a70 con 0x55de31560c30 2023-11-04T01:39:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f50009740 1 -- 172.21.15.44:0/131668229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f38001250 con 0x55de31560c30 2023-11-04T01:39:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f25ffb640 1 -- 172.21.15.44:0/131668229 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f1f38004e10 con 0x55de31560c30 2023-11-04T01:39:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f25ffb640 1 -- 172.21.15.44:0/131668229 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f3803f480 con 0x55de31560c30 2023-11-04T01:39:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f50009740 10 client.7587 fetch_fsmap learned FSMap version 50 2023-11-04T01:39:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f50009740 1 -- 172.21.15.44:0/131668229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55de31461500 con 0x55de31560c30 2023-11-04T01:39:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.196+0000 7f1f25ffb640 1 -- 172.21.15.44:0/131668229 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f38001250 con 0x55de31560c30 2023-11-04T01:39:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.197+0000 7f1f25ffb640 1 -- 172.21.15.44:0/131668229 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 50) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f1f3803f5e0 con 0x55de31560c30 2023-11-04T01:39:43.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.197+0000 7f1f50009740 10 client.7587 fetch_fsmap finished waiting for FSMap version 50 2023-11-04T01:39:43.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.197+0000 7f1f50009740 10 client.7587 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:39:43.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.197+0000 7f1f50009740 20 client.7587 populate_metadata read hostname 'smithi044' 2023-11-04T01:39:43.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.197+0000 7f1f50009740 1 --2- 172.21.15.44:0/131668229 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x55de315d23f0 0x55de315d27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.197+0000 7f1f50009740 4 client.7587 mds_command: new command op to 7359 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:39:43.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.197+0000 7f1f50009740 1 -- 172.21.15.44:0/131668229 --> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55de314985b0 con 0x55de315d23f0 2023-11-04T01:39:43.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.197+0000 7f1f46ffd640 1 --2- 172.21.15.44:0/131668229 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x55de315d23f0 0x55de315d27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.197+0000 7f1f46ffd640 1 --2- 172.21.15.44:0/131668229 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x55de315d23f0 0x55de315d27d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d39c94f84b81a2e2 server_cookie=9170daa84a85cef0 in_seq=0 out_seq=0 2023-11-04T01:39:43.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.197+0000 7f1f25ffb640 10 client.7587 ms_handle_connect on v2:172.21.15.204:6834/2461924520 2023-11-04T01:39:43.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.197+0000 7f1f25ffb640 1 -- 172.21.15.44:0/131668229 <== mds.0 v2:172.21.15.204:6834/2461924520 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55de314985b0 con 0x55de315d23f0 2023-11-04T01:39:43.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.197+0000 7f1f25ffb640 10 client.7587 handle_command_reply: tid=0 2023-11-04T01:39:43.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.197+0000 7f1f50009740 1 client.7587 shutdown 2023-11-04T01:39:43.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f50009740 1 -- 172.21.15.44:0/131668229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560c30 msgr2=0x55de315e6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f50009740 1 --2- 172.21.15.44:0/131668229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560c30 0x55de315e6840 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800a950 tx=0x7f1f38009050 comp rx=0 tx=0).stop 2023-11-04T01:39:43.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f50009740 1 -- 172.21.15.44:0/131668229 shutdown_connections 2023-11-04T01:39:43.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f50009740 1 --2- 172.21.15.44:0/131668229 >> [v2:172.21.15.204:6834/2461924520,v1:172.21.15.204:6836/2461924520] conn(0x55de315d23f0 0x55de315d27d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f50009740 1 --2- 172.21.15.44:0/131668229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de31560c30 0x55de315e6840 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f50009740 1 --2- 172.21.15.44:0/131668229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55de31560850 0x55de315755a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f25ffb640 0 client.7587 ms_handle_reset on v2:172.21.15.204:6834/2461924520 2023-11-04T01:39:43.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f50009740 1 --2- 172.21.15.44:0/131668229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55de31554dd0 0x55de3155fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f50009740 1 -- 172.21.15.44:0/131668229 >> 172.21.15.44:0/131668229 conn(0x55de31533c90 msgr2=0x55de31577ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f50009740 1 -- 172.21.15.44:0/131668229 shutdown_connections 2023-11-04T01:39:43.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f50009740 1 -- 172.21.15.44:0/131668229 wait complete. 2023-11-04T01:39:43.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f50009740 20 client.7587 trim_cache size 0 max 16384 2023-11-04T01:39:43.207 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:39:43.207 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:39:43.207 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2023-11-04T01:39:43.207 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7359, 2023-11-04T01:39:43.207 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:39:43.207 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:39:43.207 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:39:43.207 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 12.646433500000001, 2023-11-04T01:39:43.207 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 50, 2023-11-04T01:39:43.207 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 98, 2023-11-04T01:39:43.207 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 98, 2023-11-04T01:39:43.207 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 18.683016042999999 2023-11-04T01:39:43.208 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:39:43.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f4d475640 1 -- 172.21.15.44:0/934599278 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1f2806aea0 msgr2=0x7f1f2806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f4d475640 1 --2- 172.21.15.44:0/934599278 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1f2806aea0 0x7f1f2806d360 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1f40000c00 tx=0x7f1f40009040 comp rx=0 tx=0).stop 2023-11-04T01:39:43.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f4d475640 1 -- 172.21.15.44:0/934599278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f480c7c70 msgr2=0x7f1f481559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f4d475640 1 --2- 172.21.15.44:0/934599278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f480c7c70 0x7f1f481559d0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f1f300118e0 tx=0x7f1f30011da0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f4d475640 1 -- 172.21.15.44:0/934599278 shutdown_connections 2023-11-04T01:39:43.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f4d475640 1 --2- 172.21.15.44:0/934599278 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1f2806aea0 0x7f1f2806d360 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f4d475640 1 --2- 172.21.15.44:0/934599278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f481592e0 0x7f1f48159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f4d475640 1 --2- 172.21.15.44:0/934599278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f480c7c70 0x7f1f481559d0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f4d475640 1 --2- 172.21.15.44:0/934599278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f34005180 0x7f1f481561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f4d475640 1 -- 172.21.15.44:0/934599278 >> 172.21.15.44:0/934599278 conn(0x7f1f4806ea20 msgr2=0x7f1f48157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f4d475640 1 -- 172.21.15.44:0/934599278 shutdown_connections 2023-11-04T01:39:43.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.198+0000 7f1f4d475640 1 -- 172.21.15.44:0/934599278 wait complete. 2023-11-04T01:39:43.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:43.211 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/dir) 2023-11-04T01:39:43.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:43.233 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1) 2023-11-04T01:39:43.292 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:43.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.436+0000 7f5caba26640 1 Processor -- start 2023-11-04T01:39:43.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.437+0000 7f5caba26640 1 -- start start 2023-11-04T01:39:43.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.437+0000 7f5caba26640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ca40cde60 0x7f5ca415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.437+0000 7f5caba26640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5ca415daa0 0x7f5ca4157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.437+0000 7f5caba26640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca415e000 con 0x7f5ca40ce240 2023-11-04T01:39:43.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.437+0000 7f5caba26640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca415e5c0 con 0x7f5ca415daa0 2023-11-04T01:39:43.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.437+0000 7f5caba26640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca415e2e0 con 0x7f5ca40cde60 2023-11-04T01:39:43.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.438+0000 7f5ca97c2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ca40cde60 0x7f5ca415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.438+0000 7f5ca8fc1640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5ca415daa0 0x7f5ca4157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.438+0000 7f5ca97c2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ca40cde60 0x7f5ca415d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:52124/0 (socket says 172.21.15.44:52124) 2023-11-04T01:39:43.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.438+0000 7f5ca97c2640 1 -- 172.21.15.44:0/2794490212 learned_addr learned my addr 172.21.15.44:0/2794490212 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:43.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.438+0000 7f5ca9fc3640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f5ca40ce240 0x7f5ca406b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:47450/0 (socket says 172.21.15.44:47450) 2023-11-04T01:39:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.438+0000 7f5ca8fc1640 1 -- 172.21.15.44:0/2794490212 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ca40cde60 msgr2=0x7f5ca415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.438+0000 7f5ca8fc1640 1 --2- 172.21.15.44:0/2794490212 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ca40cde60 0x7f5ca415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.438+0000 7f5ca8fc1640 1 -- 172.21.15.44:0/2794490212 >> v1:172.21.15.204:6789/0 conn(0x7f5ca40ce240 legacy=0x7f5ca406b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.438+0000 7f5c9bfff640 1 -- 172.21.15.44:0/2794490212 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253968736 0 0) 0x7f5ca415e000 con 0x7f5ca40ce240 2023-11-04T01:39:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.438+0000 7f5ca8fc1640 1 -- 172.21.15.44:0/2794490212 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca40d1120 con 0x7f5ca415daa0 2023-11-04T01:39:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.439+0000 7f5ca8fc1640 1 --2- 172.21.15.44:0/2794490212 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ca415daa0 0x7f5ca4157000 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5c940097a0 tx=0x7f5c9402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3df597ef15be3c96 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.439+0000 7f5c9bfff640 1 -- 172.21.15.44:0/2794490212 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94031830 con 0x7f5ca415daa0 2023-11-04T01:39:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.439+0000 7f5c9bfff640 1 -- 172.21.15.44:0/2794490212 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c94031990 con 0x7f5ca415daa0 2023-11-04T01:39:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.439+0000 7f5c9bfff640 1 -- 172.21.15.44:0/2794490212 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94031d20 con 0x7f5ca415daa0 2023-11-04T01:39:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.440+0000 7f5caba26640 1 -- 172.21.15.44:0/2794490212 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ca415daa0 msgr2=0x7f5ca4157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.440+0000 7f5caba26640 1 --2- 172.21.15.44:0/2794490212 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ca415daa0 0x7f5ca4157000 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5c940097a0 tx=0x7f5c9402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.440+0000 7f5caba26640 1 -- 172.21.15.44:0/2794490212 shutdown_connections 2023-11-04T01:39:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.440+0000 7f5caba26640 1 --2- 172.21.15.44:0/2794490212 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ca415daa0 0x7f5ca4157000 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.440+0000 7f5caba26640 1 --2- 172.21.15.44:0/2794490212 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ca40cde60 0x7f5ca415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.440+0000 7f5caba26640 1 -- 172.21.15.44:0/2794490212 >> 172.21.15.44:0/2794490212 conn(0x7f5ca4071f30 msgr2=0x7f5ca40cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.440+0000 7f5caba26640 1 -- 172.21.15.44:0/2794490212 shutdown_connections 2023-11-04T01:39:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.440+0000 7f5caba26640 1 -- 172.21.15.44:0/2794490212 wait complete. 2023-11-04T01:39:43.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.441+0000 7f5caba26640 1 Processor -- start 2023-11-04T01:39:43.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.441+0000 7f5caba26640 1 -- start start 2023-11-04T01:39:43.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5caba26640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ca40cde60 0x7f5ca40c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5caba26640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ca40ce240 0x7f5ca414df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5caba26640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ca415daa0 0x7f5ca414e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5caba26640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca41f2610 con 0x7f5ca415daa0 2023-11-04T01:39:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5caba26640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca41f35e0 con 0x7f5ca40cde60 2023-11-04T01:39:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5caba26640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40cd6e0 con 0x7f5ca40ce240 2023-11-04T01:39:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5ca9fc3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ca415daa0 0x7f5ca414e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5ca9fc3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ca415daa0 0x7f5ca414e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58434/0 (socket says 172.21.15.44:58434) 2023-11-04T01:39:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5ca9fc3640 1 -- 172.21.15.44:0/1974485707 learned_addr learned my addr 172.21.15.44:0/1974485707 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5ca97c2640 1 --2- 172.21.15.44:0/1974485707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ca40cde60 0x7f5ca40c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5ca8fc1640 1 --2- 172.21.15.44:0/1974485707 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ca40ce240 0x7f5ca414df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5ca9fc3640 1 -- 172.21.15.44:0/1974485707 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ca40ce240 msgr2=0x7f5ca414df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5ca9fc3640 1 --2- 172.21.15.44:0/1974485707 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ca40ce240 0x7f5ca414df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5ca9fc3640 1 -- 172.21.15.44:0/1974485707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ca40cde60 msgr2=0x7f5ca40c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5ca9fc3640 1 --2- 172.21.15.44:0/1974485707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ca40cde60 0x7f5ca40c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5ca9fc3640 1 -- 172.21.15.44:0/1974485707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c94009400 con 0x7f5ca415daa0 2023-11-04T01:39:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5ca9fc3640 1 --2- 172.21.15.44:0/1974485707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ca415daa0 0x7f5ca414e4d0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00c7d0 tx=0x7f5c9c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.442+0000 7f5c99ffb640 1 -- 172.21.15.44:0/1974485707 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00a5e0 con 0x7f5ca415daa0 2023-11-04T01:39:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.443+0000 7f5c99ffb640 1 -- 172.21.15.44:0/1974485707 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c00a740 con 0x7f5ca415daa0 2023-11-04T01:39:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.443+0000 7f5caba26640 1 -- 172.21.15.44:0/1974485707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca41f2820 con 0x7f5ca415daa0 2023-11-04T01:39:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.443+0000 7f5c99ffb640 1 -- 172.21.15.44:0/1974485707 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00ab30 con 0x7f5ca415daa0 2023-11-04T01:39:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.443+0000 7f5caba26640 1 -- 172.21.15.44:0/1974485707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca41f2de0 con 0x7f5ca415daa0 2023-11-04T01:39:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.444+0000 7f5caba26640 1 -- 172.21.15.44:0/1974485707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca4074290 con 0x7f5ca415daa0 2023-11-04T01:39:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.444+0000 7f5c99ffb640 1 -- 172.21.15.44:0/1974485707 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c9c00ac90 con 0x7f5ca415daa0 2023-11-04T01:39:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.444+0000 7f5c99ffb640 1 --2- 172.21.15.44:0/1974485707 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5c8806ae70 0x7f5c8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.444+0000 7f5c99ffb640 1 -- 172.21.15.44:0/1974485707 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f5c9c0892f0 con 0x7f5ca415daa0 2023-11-04T01:39:43.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.445+0000 7f5ca97c2640 1 --2- 172.21.15.44:0/1974485707 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5c8806ae70 0x7f5c8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.445+0000 7f5ca97c2640 1 --2- 172.21.15.44:0/1974485707 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5c8806ae70 0x7f5c8806d330 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5ca415c610 tx=0x7f5ca0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.448+0000 7f5c99ffb640 1 -- 172.21.15.44:0/1974485707 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5c9c053e00 con 0x7f5ca415daa0 2023-11-04T01:39:43.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.663+0000 7f5caba26640 1 -- 172.21.15.44:0/1974485707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ca40d1ff0 con 0x7f5ca415daa0 2023-11-04T01:39:43.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.664+0000 7f5c99ffb640 1 -- 172.21.15.44:0/1974485707 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f5c9c057420 con 0x7f5ca415daa0 2023-11-04T01:39:43.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:43.666 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:39:40.381738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6836/2461924520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2461924520},{"type":"v1","addr":"172.21.15.204:6836","nonce":2461924520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:43.666 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 50 2023-11-04T01:39:43.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.666+0000 7f5caba26640 1 -- 172.21.15.44:0/1974485707 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5c8806ae70 msgr2=0x7f5c8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.666+0000 7f5caba26640 1 --2- 172.21.15.44:0/1974485707 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5c8806ae70 0x7f5c8806d330 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5ca415c610 tx=0x7f5ca0008040 comp rx=0 tx=0).stop 2023-11-04T01:39:43.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.666+0000 7f5caba26640 1 -- 172.21.15.44:0/1974485707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ca415daa0 msgr2=0x7f5ca414e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.666+0000 7f5caba26640 1 --2- 172.21.15.44:0/1974485707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ca415daa0 0x7f5ca414e4d0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00c7d0 tx=0x7f5c9c00cc90 comp rx=0 tx=0).stop 2023-11-04T01:39:43.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.666+0000 7f5caba26640 1 -- 172.21.15.44:0/1974485707 shutdown_connections 2023-11-04T01:39:43.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.666+0000 7f5caba26640 1 --2- 172.21.15.44:0/1974485707 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5c8806ae70 0x7f5c8806d330 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.666+0000 7f5caba26640 1 --2- 172.21.15.44:0/1974485707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ca415daa0 0x7f5ca414e4d0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.666+0000 7f5caba26640 1 --2- 172.21.15.44:0/1974485707 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ca40ce240 0x7f5ca414df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.666+0000 7f5caba26640 1 --2- 172.21.15.44:0/1974485707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ca40cde60 0x7f5ca40c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.666+0000 7f5caba26640 1 -- 172.21.15.44:0/1974485707 >> 172.21.15.44:0/1974485707 conn(0x7f5ca4071f30 msgr2=0x7f5ca40d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.666+0000 7f5caba26640 1 -- 172.21.15.44:0/1974485707 shutdown_connections 2023-11-04T01:39:43.669 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:43.666+0000 7f5caba26640 1 -- 172.21.15.44:0/1974485707 wait complete. 2023-11-04T01:39:43.678 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-11-04T01:39:43.799 INFO:teuthology.orchestra.run.smithi044.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:39:43.800 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:39:43.800 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:39:45.801 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:45.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.917+0000 7f3db1c64640 1 Processor -- start 2023-11-04T01:39:45.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.917+0000 7f3db1c64640 1 -- start start 2023-11-04T01:39:45.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.918+0000 7f3db1c64640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3dac0cde60 0x7f3dac15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.918+0000 7f3db1c64640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dac15e000 con 0x7f3dac15daa0 2023-11-04T01:39:45.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.918+0000 7f3db1c64640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dac15e2e0 con 0x7f3dac0ce240 2023-11-04T01:39:45.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.918+0000 7f3db1c64640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dac15e5c0 con 0x7f3dac0cde60 2023-11-04T01:39:45.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.918+0000 7f3daaffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3dac15daa0 0x7f3dac157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52864/0 (socket says 172.21.15.44:52864) 2023-11-04T01:39:45.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.918+0000 7f3daaffd640 1 -- 172.21.15.44:0/240811276 learned_addr learned my addr 172.21.15.44:0/240811276 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:45.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3dab7fe640 1 --2- 172.21.15.44:0/240811276 >> v2:172.21.15.204:3300/0 conn(0x7f3dac0cde60 0x7f3dac15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daa7fc640 1 -- 172.21.15.44:0/240811276 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696149124 0 0) 0x7f3dac15e000 con 0x7f3dac15daa0 2023-11-04T01:39:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daa7fc640 1 -- 172.21.15.44:0/240811276 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d94003520 con 0x7f3dac15daa0 2023-11-04T01:39:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daa7fc640 1 -- 172.21.15.44:0/240811276 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1653710938 0 0) 0x7f3d94003520 con 0x7f3dac15daa0 2023-11-04T01:39:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daa7fc640 1 -- 172.21.15.44:0/240811276 >> v2:172.21.15.204:3300/0 conn(0x7f3dac0cde60 msgr2=0x7f3dac15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daa7fc640 1 --2- 172.21.15.44:0/240811276 >> v2:172.21.15.204:3300/0 conn(0x7f3dac0cde60 0x7f3dac15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daa7fc640 1 -- 172.21.15.44:0/240811276 >> v1:172.21.15.204:6789/0 conn(0x7f3dac0ce240 legacy=0x7f3dac0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daa7fc640 1 -- 172.21.15.44:0/240811276 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac0d1120 con 0x7f3dac15daa0 2023-11-04T01:39:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daa7fc640 1 -- 172.21.15.44:0/240811276 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f3da0001670 con 0x7f3dac15daa0 2023-11-04T01:39:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daa7fc640 1 -- 172.21.15.44:0/240811276 >> v1:172.21.15.44:6789/0 conn(0x7f3dac15daa0 legacy=0x7f3dac157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daa7fc640 1 --2- 172.21.15.44:0/240811276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d94003970 0x7f3d94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daa7fc640 1 --2- 172.21.15.44:0/240811276 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d940047c0 0x7f3d94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daa7fc640 1 --2- 172.21.15.44:0/240811276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d94005180 0x7f3d9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daa7fc640 1 -- 172.21.15.44:0/240811276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac15e5c0 con 0x7f3d94005180 2023-11-04T01:39:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daa7fc640 1 -- 172.21.15.44:0/240811276 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9400c020 con 0x7f3d94003970 2023-11-04T01:39:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daa7fc640 1 -- 172.21.15.44:0/240811276 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9400c1e0 con 0x7f3d940047c0 2023-11-04T01:39:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3dabfff640 1 --2- 172.21.15.44:0/240811276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d94005180 0x7f3d9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3dab7fe640 1 --2- 172.21.15.44:0/240811276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d94003970 0x7f3d94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3daaffd640 1 --2- 172.21.15.44:0/240811276 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d940047c0 0x7f3d94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3dabfff640 1 -- 172.21.15.44:0/240811276 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d940047c0 msgr2=0x7f3d94004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3dabfff640 1 --2- 172.21.15.44:0/240811276 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d940047c0 0x7f3d94004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3dabfff640 1 -- 172.21.15.44:0/240811276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d94003970 msgr2=0x7f3d94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.919+0000 7f3dabfff640 1 --2- 172.21.15.44:0/240811276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d94003970 0x7f3d94003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.920+0000 7f3dabfff640 1 -- 172.21.15.44:0/240811276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d94003520 con 0x7f3d94005180 2023-11-04T01:39:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.920+0000 7f3dabfff640 1 -- 172.21.15.44:0/240811276 reap_dead start 2023-11-04T01:39:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.920+0000 7f3dabfff640 1 --2- 172.21.15.44:0/240811276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d94005180 0x7f3d9400b980 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f3da4001e20 tx=0x7f3d940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398d10505220a71a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.920+0000 7f3daa7fc640 1 -- 172.21.15.44:0/240811276 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4003b70 con 0x7f3d94005180 2023-11-04T01:39:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.920+0000 7f3daa7fc640 1 -- 172.21.15.44:0/240811276 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da4003cd0 con 0x7f3d94005180 2023-11-04T01:39:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.920+0000 7f3daa7fc640 1 -- 172.21.15.44:0/240811276 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4005310 con 0x7f3d94005180 2023-11-04T01:39:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.921+0000 7f3db1c64640 1 -- 172.21.15.44:0/240811276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d94005180 msgr2=0x7f3d9400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.921+0000 7f3db1c64640 1 --2- 172.21.15.44:0/240811276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d94005180 0x7f3d9400b980 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f3da4001e20 tx=0x7f3d940057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.921+0000 7f3db1c64640 1 -- 172.21.15.44:0/240811276 shutdown_connections 2023-11-04T01:39:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.921+0000 7f3db1c64640 1 --2- 172.21.15.44:0/240811276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d94005180 0x7f3d9400b980 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.921+0000 7f3db1c64640 1 -- 172.21.15.44:0/240811276 >> 172.21.15.44:0/240811276 conn(0x7f3dac071f30 msgr2=0x7f3dac0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.921+0000 7f3db1c64640 1 -- 172.21.15.44:0/240811276 shutdown_connections 2023-11-04T01:39:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.921+0000 7f3db1c64640 1 -- 172.21.15.44:0/240811276 wait complete. 2023-11-04T01:39:45.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.922+0000 7f3db1c64640 1 Processor -- start 2023-11-04T01:39:45.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.922+0000 7f3db1c64640 1 -- start start 2023-11-04T01:39:45.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.923+0000 7f3db1c64640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d94005180 0x7f3dac0cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.923+0000 7f3db1c64640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dac0cc610 0x7f3dac1f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.923+0000 7f3db1c64640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac1e3730 0x7f3dac0aa790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.923+0000 7f3db1c64640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac1f6a90 con 0x7f3dac0cc610 2023-11-04T01:39:45.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.923+0000 7f3db1c64640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac0cca90 con 0x7f3d94005180 2023-11-04T01:39:45.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.923+0000 7f3db1c64640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac1f67f0 con 0x7f3dac1e3730 2023-11-04T01:39:45.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.923+0000 7f3daaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dac0cc610 0x7f3dac1f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.923+0000 7f3daaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dac0cc610 0x7f3dac1f62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58456/0 (socket says 172.21.15.44:58456) 2023-11-04T01:39:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.923+0000 7f3daaffd640 1 -- 172.21.15.44:0/4272910864 learned_addr learned my addr 172.21.15.44:0/4272910864 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.923+0000 7f3dabfff640 1 --2- 172.21.15.44:0/4272910864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac1e3730 0x7f3dac0aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.924+0000 7f3dab7fe640 1 --2- 172.21.15.44:0/4272910864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d94005180 0x7f3dac0cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.924+0000 7f3daaffd640 1 -- 172.21.15.44:0/4272910864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac1e3730 msgr2=0x7f3dac0aa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.924+0000 7f3daaffd640 1 --2- 172.21.15.44:0/4272910864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac1e3730 0x7f3dac0aa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.924+0000 7f3daaffd640 1 -- 172.21.15.44:0/4272910864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d94005180 msgr2=0x7f3dac0cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.924+0000 7f3daaffd640 1 --2- 172.21.15.44:0/4272910864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d94005180 0x7f3dac0cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.924+0000 7f3daaffd640 1 -- 172.21.15.44:0/4272910864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac0cb850 con 0x7f3dac0cc610 2023-11-04T01:39:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.924+0000 7f3dabfff640 1 --2- 172.21.15.44:0/4272910864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac1e3730 0x7f3dac0aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.924+0000 7f3daaffd640 1 --2- 172.21.15.44:0/4272910864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dac0cc610 0x7f3dac1f62b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f3da000e780 tx=0x7f3da000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.924+0000 7f3d93fff640 1 -- 172.21.15.44:0/4272910864 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da000c660 con 0x7f3dac0cc610 2023-11-04T01:39:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.924+0000 7f3d93fff640 1 -- 172.21.15.44:0/4272910864 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da000c7e0 con 0x7f3dac0cc610 2023-11-04T01:39:45.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.924+0000 7f3d93fff640 1 -- 172.21.15.44:0/4272910864 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da000cb90 con 0x7f3dac0cc610 2023-11-04T01:39:45.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.924+0000 7f3db1c64640 1 -- 172.21.15.44:0/4272910864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dac0cbb30 con 0x7f3dac0cc610 2023-11-04T01:39:45.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.924+0000 7f3db1c64640 1 -- 172.21.15.44:0/4272910864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dac0cc0f0 con 0x7f3dac0cc610 2023-11-04T01:39:45.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.925+0000 7f3db1c64640 1 -- 172.21.15.44:0/4272910864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dac074290 con 0x7f3dac0cc610 2023-11-04T01:39:45.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.926+0000 7f3d93fff640 1 -- 172.21.15.44:0/4272910864 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3da000ccf0 con 0x7f3dac0cc610 2023-11-04T01:39:45.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.926+0000 7f3d93fff640 1 --2- 172.21.15.44:0/4272910864 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d9806ae70 0x7f3d9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.926+0000 7f3d93fff640 1 -- 172.21.15.44:0/4272910864 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f3da0089a70 con 0x7f3dac0cc610 2023-11-04T01:39:45.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.926+0000 7f3dab7fe640 1 --2- 172.21.15.44:0/4272910864 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d9806ae70 0x7f3d9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.927+0000 7f3dab7fe640 1 --2- 172.21.15.44:0/4272910864 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d9806ae70 0x7f3d9806d330 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009b40 tx=0x7f3d9c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:45.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:45.930+0000 7f3d93fff640 1 -- 172.21.15.44:0/4272910864 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3da0054580 con 0x7f3dac0cc610 2023-11-04T01:39:46.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:46.143+0000 7f3db1c64640 1 -- 172.21.15.44:0/4272910864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3dac0c94d0 con 0x7f3dac0cc610 2023-11-04T01:39:46.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:46.143+0000 7f3d93fff640 1 -- 172.21.15.44:0/4272910864 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f3da0057ba0 con 0x7f3dac0cc610 2023-11-04T01:39:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:46.146 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:39:40.381738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6836/2461924520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2461924520},{"type":"v1","addr":"172.21.15.204:6836","nonce":2461924520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:46.146 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 50 2023-11-04T01:39:46.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:46.145+0000 7f3db1c64640 1 -- 172.21.15.44:0/4272910864 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d9806ae70 msgr2=0x7f3d9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:46.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:46.145+0000 7f3db1c64640 1 --2- 172.21.15.44:0/4272910864 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d9806ae70 0x7f3d9806d330 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009b40 tx=0x7f3d9c009190 comp rx=0 tx=0).stop 2023-11-04T01:39:46.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:46.145+0000 7f3db1c64640 1 -- 172.21.15.44:0/4272910864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dac0cc610 msgr2=0x7f3dac1f62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:46.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:46.145+0000 7f3db1c64640 1 --2- 172.21.15.44:0/4272910864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dac0cc610 0x7f3dac1f62b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f3da000e780 tx=0x7f3da000eb80 comp rx=0 tx=0).stop 2023-11-04T01:39:46.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:46.146+0000 7f3db1c64640 1 -- 172.21.15.44:0/4272910864 shutdown_connections 2023-11-04T01:39:46.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:46.146+0000 7f3db1c64640 1 --2- 172.21.15.44:0/4272910864 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3d9806ae70 0x7f3d9806d330 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:46.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:46.146+0000 7f3db1c64640 1 --2- 172.21.15.44:0/4272910864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dac1e3730 0x7f3dac0aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:46.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:46.146+0000 7f3db1c64640 1 --2- 172.21.15.44:0/4272910864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dac0cc610 0x7f3dac1f62b0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:46.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:46.146+0000 7f3db1c64640 1 --2- 172.21.15.44:0/4272910864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d94005180 0x7f3dac0cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:46.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:46.146+0000 7f3db1c64640 1 -- 172.21.15.44:0/4272910864 >> 172.21.15.44:0/4272910864 conn(0x7f3dac071f30 msgr2=0x7f3dac0b80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:46.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:46.146+0000 7f3db1c64640 1 -- 172.21.15.44:0/4272910864 shutdown_connections 2023-11-04T01:39:46.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:46.146+0000 7f3db1c64640 1 -- 172.21.15.44:0/4272910864 wait complete. 2023-11-04T01:39:46.158 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-11-04T01:39:46.278 INFO:teuthology.orchestra.run.smithi044.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:39:46.279 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:39:46.279 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:39:48.280 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:48.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.396+0000 7f7c74497640 1 Processor -- start 2023-11-04T01:39:48.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.396+0000 7f7c74497640 1 -- start start 2023-11-04T01:39:48.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.397+0000 7f7c74497640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7c6c0ce240 0x7f7c6c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.397+0000 7f7c74497640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c15e000 con 0x7f7c6c157540 2023-11-04T01:39:48.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.397+0000 7f7c74497640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c15e2e0 con 0x7f7c6c0cde60 2023-11-04T01:39:48.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.397+0000 7f7c74497640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6c15e5c0 con 0x7f7c6c0ce240 2023-11-04T01:39:48.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.397+0000 7f7c71a32640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7c6c0ce240 0x7f7c6c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.397+0000 7f7c72a34640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7c6c157540 0x7f7c6c0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52878/0 (socket says 172.21.15.44:52878) 2023-11-04T01:39:48.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.397+0000 7f7c72a34640 1 -- 172.21.15.44:0/786743914 learned_addr learned my addr 172.21.15.44:0/786743914 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:48.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.397+0000 7f7c71a32640 1 -- 172.21.15.44:0/786743914 >> v1:172.21.15.204:6789/0 conn(0x7f7c6c0cde60 legacy=0x7f7c6c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:48.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.397+0000 7f7c71231640 1 -- 172.21.15.44:0/786743914 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698273642 0 0) 0x7f7c6c15e000 con 0x7f7c6c157540 2023-11-04T01:39:48.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.397+0000 7f7c71a32640 1 -- 172.21.15.44:0/786743914 >> v1:172.21.15.44:6789/0 conn(0x7f7c6c157540 legacy=0x7f7c6c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.397+0000 7f7c71a32640 1 -- 172.21.15.44:0/786743914 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c0d1120 con 0x7f7c6c0ce240 2023-11-04T01:39:48.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.398+0000 7f7c71a32640 1 --2- 172.21.15.44:0/786743914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c6c0ce240 0x7f7c6c157000 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0097a0 tx=0x7f7c5c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e433592a3d91cc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:48.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.398+0000 7f7c71231640 1 -- 172.21.15.44:0/786743914 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c030610 con 0x7f7c6c0ce240 2023-11-04T01:39:48.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.398+0000 7f7c71231640 1 -- 172.21.15.44:0/786743914 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c030770 con 0x7f7c6c0ce240 2023-11-04T01:39:48.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.398+0000 7f7c71231640 1 -- 172.21.15.44:0/786743914 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c030b00 con 0x7f7c6c0ce240 2023-11-04T01:39:48.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.399+0000 7f7c74497640 1 -- 172.21.15.44:0/786743914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c6c0ce240 msgr2=0x7f7c6c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.399+0000 7f7c74497640 1 --2- 172.21.15.44:0/786743914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c6c0ce240 0x7f7c6c157000 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0097a0 tx=0x7f7c5c02b960 comp rx=0 tx=0).stop 2023-11-04T01:39:48.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.399+0000 7f7c74497640 1 -- 172.21.15.44:0/786743914 shutdown_connections 2023-11-04T01:39:48.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.399+0000 7f7c74497640 1 --2- 172.21.15.44:0/786743914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c6c0ce240 0x7f7c6c157000 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.399+0000 7f7c74497640 1 -- 172.21.15.44:0/786743914 >> 172.21.15.44:0/786743914 conn(0x7f7c6c071f30 msgr2=0x7f7c6c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:48.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.399+0000 7f7c74497640 1 -- 172.21.15.44:0/786743914 shutdown_connections 2023-11-04T01:39:48.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.399+0000 7f7c74497640 1 -- 172.21.15.44:0/786743914 wait complete. 2023-11-04T01:39:48.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.400+0000 7f7c74497640 1 Processor -- start 2023-11-04T01:39:48.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.400+0000 7f7c74497640 1 -- start start 2023-11-04T01:39:48.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c74497640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c6c0cde60 0x7f7c6c14b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c74497640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c6c0ce240 0x7f7c6c14db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c74497640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c6c157540 0x7f7c6c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c74497640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c14b910 con 0x7f7c6c157540 2023-11-04T01:39:48.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c74497640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c14d6b0 con 0x7f7c6c0cde60 2023-11-04T01:39:48.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c74497640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c14caa0 con 0x7f7c6c0ce240 2023-11-04T01:39:48.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c72a34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c6c157540 0x7f7c6c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c72a34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c6c157540 0x7f7c6c0cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58470/0 (socket says 172.21.15.44:58470) 2023-11-04T01:39:48.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c72a34640 1 -- 172.21.15.44:0/2815980218 learned_addr learned my addr 172.21.15.44:0/2815980218 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:48.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c72233640 1 --2- 172.21.15.44:0/2815980218 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c6c0cde60 0x7f7c6c14b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c71a32640 1 --2- 172.21.15.44:0/2815980218 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c6c0ce240 0x7f7c6c14db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c72a34640 1 -- 172.21.15.44:0/2815980218 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c6c0ce240 msgr2=0x7f7c6c14db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c72a34640 1 --2- 172.21.15.44:0/2815980218 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c6c0ce240 0x7f7c6c14db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c72a34640 1 -- 172.21.15.44:0/2815980218 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c6c0cde60 msgr2=0x7f7c6c14b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c72a34640 1 --2- 172.21.15.44:0/2815980218 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c6c0cde60 0x7f7c6c14b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c72a34640 1 -- 172.21.15.44:0/2815980218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c009400 con 0x7f7c6c157540 2023-11-04T01:39:48.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c71a32640 1 --2- 172.21.15.44:0/2815980218 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c6c0ce240 0x7f7c6c14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:48.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.401+0000 7f7c72a34640 1 --2- 172.21.15.44:0/2815980218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c6c157540 0x7f7c6c0cc0c0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f7c64001eb0 tx=0x7f7c6400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:48.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.402+0000 7f7c62ffd640 1 -- 172.21.15.44:0/2815980218 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c640074e0 con 0x7f7c6c157540 2023-11-04T01:39:48.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.402+0000 7f7c62ffd640 1 -- 172.21.15.44:0/2815980218 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c64007640 con 0x7f7c6c157540 2023-11-04T01:39:48.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.402+0000 7f7c74497640 1 -- 172.21.15.44:0/2815980218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c14cd80 con 0x7f7c6c157540 2023-11-04T01:39:48.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.402+0000 7f7c62ffd640 1 -- 172.21.15.44:0/2815980218 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64004a00 con 0x7f7c6c157540 2023-11-04T01:39:48.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.402+0000 7f7c74497640 1 -- 172.21.15.44:0/2815980218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6c14d340 con 0x7f7c6c157540 2023-11-04T01:39:48.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.403+0000 7f7c74497640 1 -- 172.21.15.44:0/2815980218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6c14d820 con 0x7f7c6c157540 2023-11-04T01:39:48.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.403+0000 7f7c62ffd640 1 -- 172.21.15.44:0/2815980218 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c64004b60 con 0x7f7c6c157540 2023-11-04T01:39:48.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.403+0000 7f7c62ffd640 1 --2- 172.21.15.44:0/2815980218 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c5006ae70 0x7f7c5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.404+0000 7f7c62ffd640 1 -- 172.21.15.44:0/2815980218 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f7c64089920 con 0x7f7c6c157540 2023-11-04T01:39:48.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.404+0000 7f7c72233640 1 --2- 172.21.15.44:0/2815980218 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c5006ae70 0x7f7c5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.404+0000 7f7c72233640 1 --2- 172.21.15.44:0/2815980218 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c5006ae70 0x7f7c5006d330 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7c680012e0 tx=0x7f7c68009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:48.409 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.408+0000 7f7c62ffd640 1 -- 172.21.15.44:0/2815980218 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c64057f50 con 0x7f7c6c157540 2023-11-04T01:39:48.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.622+0000 7f7c74497640 1 -- 172.21.15.44:0/2815980218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c6c074290 con 0x7f7c6c157540 2023-11-04T01:39:48.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.623+0000 7f7c62ffd640 1 -- 172.21.15.44:0/2815980218 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f7c64057ae0 con 0x7f7c6c157540 2023-11-04T01:39:48.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:48.625 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:39:40.381738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6836/2461924520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2461924520},{"type":"v1","addr":"172.21.15.204:6836","nonce":2461924520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:48.626 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 50 2023-11-04T01:39:48.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.625+0000 7f7c74497640 1 -- 172.21.15.44:0/2815980218 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c5006ae70 msgr2=0x7f7c5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.625+0000 7f7c74497640 1 --2- 172.21.15.44:0/2815980218 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c5006ae70 0x7f7c5006d330 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7c680012e0 tx=0x7f7c68009040 comp rx=0 tx=0).stop 2023-11-04T01:39:48.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.625+0000 7f7c74497640 1 -- 172.21.15.44:0/2815980218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c6c157540 msgr2=0x7f7c6c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.625+0000 7f7c74497640 1 --2- 172.21.15.44:0/2815980218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c6c157540 0x7f7c6c0cc0c0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f7c64001eb0 tx=0x7f7c6400c870 comp rx=0 tx=0).stop 2023-11-04T01:39:48.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.625+0000 7f7c74497640 1 -- 172.21.15.44:0/2815980218 shutdown_connections 2023-11-04T01:39:48.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.625+0000 7f7c74497640 1 --2- 172.21.15.44:0/2815980218 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7c5006ae70 0x7f7c5006d330 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.625+0000 7f7c74497640 1 --2- 172.21.15.44:0/2815980218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c6c157540 0x7f7c6c0cc0c0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.625+0000 7f7c74497640 1 --2- 172.21.15.44:0/2815980218 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c6c0ce240 0x7f7c6c14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.625+0000 7f7c74497640 1 --2- 172.21.15.44:0/2815980218 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c6c0cde60 0x7f7c6c14b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.625+0000 7f7c74497640 1 -- 172.21.15.44:0/2815980218 >> 172.21.15.44:0/2815980218 conn(0x7f7c6c071f30 msgr2=0x7f7c6c0cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:48.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.625+0000 7f7c74497640 1 -- 172.21.15.44:0/2815980218 shutdown_connections 2023-11-04T01:39:48.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:48.625+0000 7f7c74497640 1 -- 172.21.15.44:0/2815980218 wait complete. 2023-11-04T01:39:48.638 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-11-04T01:39:48.758 INFO:teuthology.orchestra.run.smithi044.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:39:48.758 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:39:48.758 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:39:50.760 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:50.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.877+0000 7f0dd4ac9640 1 Processor -- start 2023-11-04T01:39:50.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.877+0000 7f0dd4ac9640 1 -- start start 2023-11-04T01:39:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.878+0000 7f0dd4ac9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0dd00cb5c0 0x7f0dd00ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.878+0000 7f0dd4ac9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd006a120 con 0x7f0dd015ce70 2023-11-04T01:39:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.878+0000 7f0dd4ac9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd00c9f40 con 0x7f0dd015d250 2023-11-04T01:39:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.878+0000 7f0dd4ac9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00cdc10 con 0x7f0dd00cb5c0 2023-11-04T01:39:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.878+0000 7f0dce59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0dd015ce70 0x7f0dd006d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52882/0 (socket says 172.21.15.44:52882) 2023-11-04T01:39:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.878+0000 7f0dce59c640 1 -- 172.21.15.44:0/1866460635 learned_addr learned my addr 172.21.15.44:0/1866460635 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.878+0000 7f0dcd59a640 1 -- 172.21.15.44:0/1866460635 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416801154 0 0) 0x7f0dd006a120 con 0x7f0dd015ce70 2023-11-04T01:39:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.878+0000 7f0dcd59a640 1 -- 172.21.15.44:0/1866460635 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db8003520 con 0x7f0dd015ce70 2023-11-04T01:39:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.878+0000 7f0dced9d640 1 --2- 172.21.15.44:0/1866460635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0dd00cb5c0 0x7f0dd00ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.878+0000 7f0dcd59a640 1 -- 172.21.15.44:0/1866460635 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 871271278 0 0) 0x7f0db8003520 con 0x7f0dd015ce70 2023-11-04T01:39:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.878+0000 7f0dcd59a640 1 -- 172.21.15.44:0/1866460635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0dd00cb5c0 msgr2=0x7f0dd00ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.878+0000 7f0dcd59a640 1 --2- 172.21.15.44:0/1866460635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0dd00cb5c0 0x7f0dd00ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.878+0000 7f0dcd59a640 1 -- 172.21.15.44:0/1866460635 >> v1:172.21.15.204:6789/0 conn(0x7f0dd015d250 legacy=0x7f0dd00c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dcd59a640 1 -- 172.21.15.44:0/1866460635 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd006a370 con 0x7f0dd015ce70 2023-11-04T01:39:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dcd59a640 1 -- 172.21.15.44:0/1866460635 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f0dc0001670 con 0x7f0dd015ce70 2023-11-04T01:39:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dced9d640 1 --2- 172.21.15.44:0/1866460635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0dd00cb5c0 0x7f0dd00ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dcd59a640 1 -- 172.21.15.44:0/1866460635 >> v1:172.21.15.44:6789/0 conn(0x7f0dd015ce70 legacy=0x7f0dd006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dcd59a640 1 --2- 172.21.15.44:0/1866460635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0db80039a0 0x7f0db8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dcd59a640 1 --2- 172.21.15.44:0/1866460635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0db80047c0 0x7f0db8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dcd59a640 1 --2- 172.21.15.44:0/1866460635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0dd00cb5c0 0x7f0db8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dcd59a640 1 -- 172.21.15.44:0/1866460635 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00cdc10 con 0x7f0db80047c0 2023-11-04T01:39:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dcd59a640 1 -- 172.21.15.44:0/1866460635 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db800bab0 con 0x7f0db80039a0 2023-11-04T01:39:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dcd59a640 1 -- 172.21.15.44:0/1866460635 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db800bc70 con 0x7f0dd00cb5c0 2023-11-04T01:39:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dcdd9b640 1 --2- 172.21.15.44:0/1866460635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0db80047c0 0x7f0db8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dce59c640 1 --2- 172.21.15.44:0/1866460635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0db80039a0 0x7f0db8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dced9d640 1 --2- 172.21.15.44:0/1866460635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0dd00cb5c0 0x7f0db8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dcdd9b640 1 -- 172.21.15.44:0/1866460635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0dd00cb5c0 msgr2=0x7f0db8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dcdd9b640 1 --2- 172.21.15.44:0/1866460635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0dd00cb5c0 0x7f0db8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dcdd9b640 1 -- 172.21.15.44:0/1866460635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0db80039a0 msgr2=0x7f0db8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dcdd9b640 1 --2- 172.21.15.44:0/1866460635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0db80039a0 0x7f0db8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dcdd9b640 1 -- 172.21.15.44:0/1866460635 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db8003520 con 0x7f0db80047c0 2023-11-04T01:39:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dce59c640 1 --2- 172.21.15.44:0/1866460635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0db80039a0 0x7f0db8003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.879+0000 7f0dced9d640 1 --2- 172.21.15.44:0/1866460635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0dd00cb5c0 0x7f0db8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.880+0000 7f0dcdd9b640 1 --2- 172.21.15.44:0/1866460635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0db80047c0 0x7f0db8004c40 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4001720 tx=0x7f0db80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6b40847704d5ae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.880+0000 7f0dcd59a640 1 -- 172.21.15.44:0/1866460635 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc40052d0 con 0x7f0db80047c0 2023-11-04T01:39:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.880+0000 7f0dcd59a640 1 -- 172.21.15.44:0/1866460635 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc402e050 con 0x7f0db80047c0 2023-11-04T01:39:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.880+0000 7f0dcd59a640 1 -- 172.21.15.44:0/1866460635 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc40035f0 con 0x7f0db80047c0 2023-11-04T01:39:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.881+0000 7f0dd4ac9640 1 -- 172.21.15.44:0/1866460635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0db80047c0 msgr2=0x7f0db8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.881+0000 7f0dd4ac9640 1 --2- 172.21.15.44:0/1866460635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0db80047c0 0x7f0db8004c40 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4001720 tx=0x7f0db80057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.881+0000 7f0dced9d640 1 -- 172.21.15.44:0/1866460635 reap_dead start 2023-11-04T01:39:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.881+0000 7f0dd4ac9640 1 -- 172.21.15.44:0/1866460635 shutdown_connections 2023-11-04T01:39:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.881+0000 7f0dd4ac9640 1 -- 172.21.15.44:0/1866460635 >> 172.21.15.44:0/1866460635 conn(0x7f0dd00b0cd0 msgr2=0x7f0dd00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.881+0000 7f0dd4ac9640 1 -- 172.21.15.44:0/1866460635 shutdown_connections 2023-11-04T01:39:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.881+0000 7f0dd4ac9640 1 -- 172.21.15.44:0/1866460635 wait complete. 2023-11-04T01:39:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.882+0000 7f0dd4ac9640 1 Processor -- start 2023-11-04T01:39:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.882+0000 7f0dd4ac9640 1 -- start start 2023-11-04T01:39:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dd4ac9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0db80047c0 0x7f0dd01f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dd4ac9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0dd01e47c0 0x7f0dd01f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dd4ac9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0dd00b0120 0x7f0dd01f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dd4ac9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd01e4f30 con 0x7f0db80047c0 2023-11-04T01:39:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dd4ac9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd01e4c50 con 0x7f0dd00b0120 2023-11-04T01:39:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dd4ac9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00af640 con 0x7f0dd01e47c0 2023-11-04T01:39:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dce59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0db80047c0 0x7f0dd01f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dce59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0db80047c0 0x7f0dd01f2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58488/0 (socket says 172.21.15.44:58488) 2023-11-04T01:39:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dce59c640 1 -- 172.21.15.44:0/2591380001 learned_addr learned my addr 172.21.15.44:0/2591380001 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dce59c640 1 -- 172.21.15.44:0/2591380001 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0dd01e47c0 msgr2=0x7f0dd01f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dced9d640 1 --2- 172.21.15.44:0/2591380001 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0dd00b0120 0x7f0dd01f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dcdd9b640 1 --2- 172.21.15.44:0/2591380001 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0dd01e47c0 0x7f0dd01f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dce59c640 1 --2- 172.21.15.44:0/2591380001 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0dd01e47c0 0x7f0dd01f6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dce59c640 1 -- 172.21.15.44:0/2591380001 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0dd00b0120 msgr2=0x7f0dd01f6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dce59c640 1 --2- 172.21.15.44:0/2591380001 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0dd00b0120 0x7f0dd01f6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.883+0000 7f0dce59c640 1 -- 172.21.15.44:0/2591380001 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd00af920 con 0x7f0db80047c0 2023-11-04T01:39:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.884+0000 7f0dce59c640 1 --2- 172.21.15.44:0/2591380001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0db80047c0 0x7f0dd01f2560 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000e7f0 tx=0x7f0dc000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.884+0000 7f0dbeffd640 1 -- 172.21.15.44:0/2591380001 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000c8d0 con 0x7f0db80047c0 2023-11-04T01:39:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.884+0000 7f0dbeffd640 1 -- 172.21.15.44:0/2591380001 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc000ca30 con 0x7f0db80047c0 2023-11-04T01:39:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.884+0000 7f0dd4ac9640 1 -- 172.21.15.44:0/2591380001 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd00afc00 con 0x7f0db80047c0 2023-11-04T01:39:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.884+0000 7f0dbeffd640 1 -- 172.21.15.44:0/2591380001 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000cda0 con 0x7f0db80047c0 2023-11-04T01:39:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.884+0000 7f0dd4ac9640 1 -- 172.21.15.44:0/2591380001 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd01f2aa0 con 0x7f0db80047c0 2023-11-04T01:39:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.885+0000 7f0dd4ac9640 1 -- 172.21.15.44:0/2591380001 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd00afe40 con 0x7f0db80047c0 2023-11-04T01:39:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.885+0000 7f0dbeffd640 1 -- 172.21.15.44:0/2591380001 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0dc001d460 con 0x7f0db80047c0 2023-11-04T01:39:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.886+0000 7f0dbeffd640 1 --2- 172.21.15.44:0/2591380001 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0db006ae70 0x7f0db006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.886+0000 7f0dbeffd640 1 -- 172.21.15.44:0/2591380001 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f0dc0089b20 con 0x7f0db80047c0 2023-11-04T01:39:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.886+0000 7f0dcdd9b640 1 --2- 172.21.15.44:0/2591380001 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0db006ae70 0x7f0db006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.886+0000 7f0dcdd9b640 1 --2- 172.21.15.44:0/2591380001 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0db006ae70 0x7f0db006d330 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4033000 tx=0x7f0dc4009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:50.890+0000 7f0dbeffd640 1 -- 172.21.15.44:0/2591380001 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0dd00afe40 con 0x7f0db80047c0 2023-11-04T01:39:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.100+0000 7f0dd4ac9640 1 -- 172.21.15.44:0/2591380001 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0dd00afe40 con 0x7f0db80047c0 2023-11-04T01:39:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.100+0000 7f0dbeffd640 1 -- 172.21.15.44:0/2591380001 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f0dd00afe40 con 0x7f0db80047c0 2023-11-04T01:39:51.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:51.103 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:39:49.519335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6836/2461924520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2461924520},{"type":"v1","addr":"172.21.15.204:6836","nonce":2461924520}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 51 2023-11-04T01:39:51.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.102+0000 7f0dd4ac9640 1 -- 172.21.15.44:0/2591380001 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0db006ae70 msgr2=0x7f0db006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.102+0000 7f0dd4ac9640 1 --2- 172.21.15.44:0/2591380001 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0db006ae70 0x7f0db006d330 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4033000 tx=0x7f0dc4009030 comp rx=0 tx=0).stop 2023-11-04T01:39:51.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.102+0000 7f0dd4ac9640 1 -- 172.21.15.44:0/2591380001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0db80047c0 msgr2=0x7f0dd01f2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.102+0000 7f0dd4ac9640 1 --2- 172.21.15.44:0/2591380001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0db80047c0 0x7f0dd01f2560 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000e7f0 tx=0x7f0dc000ecb0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.102+0000 7f0dd4ac9640 1 -- 172.21.15.44:0/2591380001 shutdown_connections 2023-11-04T01:39:51.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.102+0000 7f0dd4ac9640 1 --2- 172.21.15.44:0/2591380001 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0db006ae70 0x7f0db006d330 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.102+0000 7f0dd4ac9640 1 --2- 172.21.15.44:0/2591380001 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0dd00b0120 0x7f0dd01f6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.102+0000 7f0dd4ac9640 1 --2- 172.21.15.44:0/2591380001 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0dd01e47c0 0x7f0dd01f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.102+0000 7f0dd4ac9640 1 --2- 172.21.15.44:0/2591380001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0db80047c0 0x7f0dd01f2560 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.102+0000 7f0dd4ac9640 1 -- 172.21.15.44:0/2591380001 >> 172.21.15.44:0/2591380001 conn(0x7f0dd00b0cd0 msgr2=0x7f0dd00b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:51.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.102+0000 7f0dd4ac9640 1 -- 172.21.15.44:0/2591380001 shutdown_connections 2023-11-04T01:39:51.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.102+0000 7f0dd4ac9640 1 -- 172.21.15.44:0/2591380001 wait complete. 2023-11-04T01:39:51.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-11-04T01:39:51.236 INFO:teuthology.orchestra.run.smithi044.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"8","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-11-04T01:39:51.236 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "8" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:39:51.237 INFO:tasks.cephfs.cephfs_test_case:[('/d1', 1)] =?= [('/d1', 1)] 2023-11-04T01:39:51.237 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:39:51.361 INFO:teuthology.orchestra.run.smithi204.stdout:{"last_snap":1,"last_created":1,"last_destroyed":1,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:39:51.361 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 1, "last_destroyed": 1, "last_snap": 1, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:39:51.361 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=1 2023-11-04T01:39:51.361 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:51.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.468+0000 7fd25cb61640 1 Processor -- start 2023-11-04T01:39:51.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.468+0000 7fd25cb61640 1 -- start start 2023-11-04T01:39:51.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.469+0000 7fd25cb61640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd25806a830 0x7fd2580cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.469+0000 7fd25cb61640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd25806eba0 0x7fd2580ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.469+0000 7fd25cb61640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd25806d310 con 0x7fd25815ab70 2023-11-04T01:39:51.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.469+0000 7fd25cb61640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2580cba70 con 0x7fd25806a830 2023-11-04T01:39:51.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.469+0000 7fd25cb61640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd258161c50 con 0x7fd25806eba0 2023-11-04T01:39:51.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.470+0000 7fd255d9b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd25806a830 0x7fd2580cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.470+0000 7fd256d9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd25806eba0 0x7fd2580ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.470+0000 7fd25659c640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fd25815ab70 0x7fd25806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:47488/0 (socket says 172.21.15.44:47488) 2023-11-04T01:39:51.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.470+0000 7fd25659c640 1 -- 172.21.15.44:0/3672135409 learned_addr learned my addr 172.21.15.44:0/3672135409 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:51.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.470+0000 7fd255d9b640 1 -- 172.21.15.44:0/3672135409 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd25806eba0 msgr2=0x7fd2580ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:51.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.470+0000 7fd255d9b640 1 --2- 172.21.15.44:0/3672135409 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd25806eba0 0x7fd2580ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.470+0000 7fd255d9b640 1 -- 172.21.15.44:0/3672135409 >> v1:172.21.15.204:6789/0 conn(0x7fd25815ab70 legacy=0x7fd25806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.470+0000 7fd255d9b640 1 -- 172.21.15.44:0/3672135409 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25815d860 con 0x7fd25806a830 2023-11-04T01:39:51.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.470+0000 7fd25559a640 1 -- 172.21.15.44:0/3672135409 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981989741 0 0) 0x7fd25806d310 con 0x7fd25815ab70 2023-11-04T01:39:51.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.471+0000 7fd255d9b640 1 --2- 172.21.15.44:0/3672135409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd25806a830 0x7fd2580cbea0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd2480097c0 tx=0x7fd24802b800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aa8436a8f23bbc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.471+0000 7fd25559a640 1 -- 172.21.15.44:0/3672135409 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248031760 con 0x7fd25806a830 2023-11-04T01:39:51.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.471+0000 7fd25559a640 1 -- 172.21.15.44:0/3672135409 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2480318c0 con 0x7fd25806a830 2023-11-04T01:39:51.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.471+0000 7fd25559a640 1 -- 172.21.15.44:0/3672135409 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248031c50 con 0x7fd25806a830 2023-11-04T01:39:51.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.471+0000 7fd25cb61640 1 -- 172.21.15.44:0/3672135409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd25806a830 msgr2=0x7fd2580cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.471+0000 7fd25cb61640 1 --2- 172.21.15.44:0/3672135409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd25806a830 0x7fd2580cbea0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd2480097c0 tx=0x7fd24802b800 comp rx=0 tx=0).stop 2023-11-04T01:39:51.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.472+0000 7fd25cb61640 1 -- 172.21.15.44:0/3672135409 shutdown_connections 2023-11-04T01:39:51.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.472+0000 7fd25cb61640 1 --2- 172.21.15.44:0/3672135409 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd25806eba0 0x7fd2580ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.472+0000 7fd25cb61640 1 --2- 172.21.15.44:0/3672135409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd25806a830 0x7fd2580cbea0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.472+0000 7fd25cb61640 1 -- 172.21.15.44:0/3672135409 >> 172.21.15.44:0/3672135409 conn(0x7fd258098d40 msgr2=0x7fd2580cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:51.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.472+0000 7fd25cb61640 1 -- 172.21.15.44:0/3672135409 shutdown_connections 2023-11-04T01:39:51.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.472+0000 7fd25cb61640 1 -- 172.21.15.44:0/3672135409 wait complete. 2023-11-04T01:39:51.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.473+0000 7fd25cb61640 1 Processor -- start 2023-11-04T01:39:51.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.473+0000 7fd25cb61640 1 -- start start 2023-11-04T01:39:51.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd25cb61640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd25806a830 0x7fd258157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd25cb61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd25806eba0 0x7fd2580c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd25cb61640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd25815ab70 0x7fd2580b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd25cb61640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2581f29f0 con 0x7fd25806eba0 2023-11-04T01:39:51.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd25cb61640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2581f2c90 con 0x7fd25815ab70 2023-11-04T01:39:51.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd25cb61640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2581f2f70 con 0x7fd25806a830 2023-11-04T01:39:51.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd255d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd25806eba0 0x7fd2580c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd255d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd25806eba0 0x7fd2580c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58496/0 (socket says 172.21.15.44:58496) 2023-11-04T01:39:51.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd255d9b640 1 -- 172.21.15.44:0/3900673292 learned_addr learned my addr 172.21.15.44:0/3900673292 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:51.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd256d9d640 1 --2- 172.21.15.44:0/3900673292 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd25815ab70 0x7fd2580b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd25659c640 1 --2- 172.21.15.44:0/3900673292 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd25806a830 0x7fd258157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd255d9b640 1 -- 172.21.15.44:0/3900673292 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd25806a830 msgr2=0x7fd258157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd255d9b640 1 --2- 172.21.15.44:0/3900673292 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd25806a830 0x7fd258157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd255d9b640 1 -- 172.21.15.44:0/3900673292 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd25815ab70 msgr2=0x7fd2580b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd255d9b640 1 --2- 172.21.15.44:0/3900673292 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd25815ab70 0x7fd2580b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd255d9b640 1 -- 172.21.15.44:0/3900673292 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2480093a0 con 0x7fd25806eba0 2023-11-04T01:39:51.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd255d9b640 1 --2- 172.21.15.44:0/3900673292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd25806eba0 0x7fd2580c5580 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fd248000c00 tx=0x7fd2480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.474+0000 7fd246ffd640 1 -- 172.21.15.44:0/3900673292 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248004230 con 0x7fd25806eba0 2023-11-04T01:39:51.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.475+0000 7fd246ffd640 1 -- 172.21.15.44:0/3900673292 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd248004390 con 0x7fd25806eba0 2023-11-04T01:39:51.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.475+0000 7fd25cb61640 1 -- 172.21.15.44:0/3900673292 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2581f3250 con 0x7fd25806eba0 2023-11-04T01:39:51.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.475+0000 7fd246ffd640 1 -- 172.21.15.44:0/3900673292 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248005bd0 con 0x7fd25806eba0 2023-11-04T01:39:51.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.475+0000 7fd25cb61640 1 -- 172.21.15.44:0/3900673292 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd258157770 con 0x7fd25806eba0 2023-11-04T01:39:51.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.476+0000 7fd25cb61640 1 -- 172.21.15.44:0/3900673292 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2581f3770 con 0x7fd25806eba0 2023-11-04T01:39:51.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.476+0000 7fd246ffd640 1 -- 172.21.15.44:0/3900673292 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd248003610 con 0x7fd25806eba0 2023-11-04T01:39:51.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.476+0000 7fd246ffd640 1 --2- 172.21.15.44:0/3900673292 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd23806ae70 0x7fd23806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.476+0000 7fd246ffd640 1 -- 172.21.15.44:0/3900673292 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7fd24802f050 con 0x7fd25806eba0 2023-11-04T01:39:51.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.477+0000 7fd25659c640 1 --2- 172.21.15.44:0/3900673292 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd23806ae70 0x7fd23806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.477+0000 7fd25659c640 1 --2- 172.21.15.44:0/3900673292 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd23806ae70 0x7fd23806d330 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd24c000fb0 tx=0x7fd24c007ce0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.481+0000 7fd246ffd640 1 -- 172.21.15.44:0/3900673292 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd2581f3770 con 0x7fd25806eba0 2023-11-04T01:39:51.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.692+0000 7fd25cb61640 1 -- 172.21.15.44:0/3900673292 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2581f3770 con 0x7fd25806eba0 2023-11-04T01:39:51.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.693+0000 7fd246ffd640 1 -- 172.21.15.44:0/3900673292 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fd2581f3770 con 0x7fd25806eba0 2023-11-04T01:39:51.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:51.695 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:39:49.519335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6836/2461924520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2461924520},{"type":"v1","addr":"172.21.15.204:6836","nonce":2461924520}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:51.695 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 51 2023-11-04T01:39:51.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.694+0000 7fd25cb61640 1 -- 172.21.15.44:0/3900673292 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd23806ae70 msgr2=0x7fd23806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.695+0000 7fd25cb61640 1 --2- 172.21.15.44:0/3900673292 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd23806ae70 0x7fd23806d330 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd24c000fb0 tx=0x7fd24c007ce0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.695+0000 7fd25cb61640 1 -- 172.21.15.44:0/3900673292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd25806eba0 msgr2=0x7fd2580c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.695+0000 7fd25cb61640 1 --2- 172.21.15.44:0/3900673292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd25806eba0 0x7fd2580c5580 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fd248000c00 tx=0x7fd2480046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.695+0000 7fd25cb61640 1 -- 172.21.15.44:0/3900673292 shutdown_connections 2023-11-04T01:39:51.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.695+0000 7fd25cb61640 1 --2- 172.21.15.44:0/3900673292 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd23806ae70 0x7fd23806d330 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.695+0000 7fd25cb61640 1 --2- 172.21.15.44:0/3900673292 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd25815ab70 0x7fd2580b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.695+0000 7fd25cb61640 1 --2- 172.21.15.44:0/3900673292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd25806eba0 0x7fd2580c5580 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.695+0000 7fd25cb61640 1 --2- 172.21.15.44:0/3900673292 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd25806a830 0x7fd258157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.695+0000 7fd25cb61640 1 -- 172.21.15.44:0/3900673292 >> 172.21.15.44:0/3900673292 conn(0x7fd258098d40 msgr2=0x7fd25806a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:51.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.695+0000 7fd25cb61640 1 -- 172.21.15.44:0/3900673292 shutdown_connections 2023-11-04T01:39:51.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.695+0000 7fd25cb61640 1 -- 172.21.15.44:0/3900673292 wait complete. 2023-11-04T01:39:51.707 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:39:51.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.813+0000 7f9a42821640 1 Processor -- start 2023-11-04T01:39:51.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.813+0000 7f9a42821640 1 -- start start 2023-11-04T01:39:51.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.814+0000 7f9a42821640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a3c153e60 0x7f9a3c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.814+0000 7f9a42821640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9a3c0cd6d0 0x7f9a3c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.814+0000 7f9a42821640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3c0cde60 con 0x7f9a3c0b4880 2023-11-04T01:39:51.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.814+0000 7f9a42821640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3c160f90 con 0x7f9a3c0cd6d0 2023-11-04T01:39:51.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.814+0000 7f9a42821640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c15e400 con 0x7f9a3c153e60 2023-11-04T01:39:51.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.814+0000 7f9a3b7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9a3c0cd6d0 0x7f9a3c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.814+0000 7f9a40dbe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9a3c0b4880 0x7f9a3c06b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52896/0 (socket says 172.21.15.44:52896) 2023-11-04T01:39:51.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.814+0000 7f9a40dbe640 1 -- 172.21.15.44:0/3893744 learned_addr learned my addr 172.21.15.44:0/3893744 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:51.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.814+0000 7f9a3b7fe640 1 -- 172.21.15.44:0/3893744 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a3c153e60 msgr2=0x7f9a3c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:51.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.814+0000 7f9a3b7fe640 1 --2- 172.21.15.44:0/3893744 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a3c153e60 0x7f9a3c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.814+0000 7f9a3b7fe640 1 -- 172.21.15.44:0/3893744 >> v1:172.21.15.44:6789/0 conn(0x7f9a3c0b4880 legacy=0x7f9a3c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.814+0000 7f9a3b7fe640 1 -- 172.21.15.44:0/3893744 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c161960 con 0x7f9a3c0cd6d0 2023-11-04T01:39:51.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.814+0000 7f9a3affd640 1 -- 172.21.15.44:0/3893744 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740877713 0 0) 0x7f9a3c0cde60 con 0x7f9a3c0b4880 2023-11-04T01:39:51.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.815+0000 7f9a3b7fe640 1 --2- 172.21.15.44:0/3893744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a3c0cd6d0 0x7f9a3c161420 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0097a0 tx=0x7f9a2c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8585cf9211e9530 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.815+0000 7f9a3affd640 1 -- 172.21.15.44:0/3893744 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c031830 con 0x7f9a3c0cd6d0 2023-11-04T01:39:51.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.815+0000 7f9a3affd640 1 -- 172.21.15.44:0/3893744 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c031990 con 0x7f9a3c0cd6d0 2023-11-04T01:39:51.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.815+0000 7f9a3affd640 1 -- 172.21.15.44:0/3893744 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c031d20 con 0x7f9a3c0cd6d0 2023-11-04T01:39:51.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.815+0000 7f9a42821640 1 -- 172.21.15.44:0/3893744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a3c0cd6d0 msgr2=0x7f9a3c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.815+0000 7f9a42821640 1 --2- 172.21.15.44:0/3893744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a3c0cd6d0 0x7f9a3c161420 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0097a0 tx=0x7f9a2c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.816+0000 7f9a42821640 1 -- 172.21.15.44:0/3893744 shutdown_connections 2023-11-04T01:39:51.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.816+0000 7f9a42821640 1 --2- 172.21.15.44:0/3893744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a3c0cd6d0 0x7f9a3c161420 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.816+0000 7f9a42821640 1 --2- 172.21.15.44:0/3893744 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a3c153e60 0x7f9a3c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.816+0000 7f9a42821640 1 -- 172.21.15.44:0/3893744 >> 172.21.15.44:0/3893744 conn(0x7f9a3c0cf880 msgr2=0x7f9a3c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:51.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.816+0000 7f9a42821640 1 -- 172.21.15.44:0/3893744 shutdown_connections 2023-11-04T01:39:51.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.816+0000 7f9a42821640 1 -- 172.21.15.44:0/3893744 wait complete. 2023-11-04T01:39:51.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.817+0000 7f9a42821640 1 Processor -- start 2023-11-04T01:39:51.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.817+0000 7f9a42821640 1 -- start start 2023-11-04T01:39:51.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a42821640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a3c0b4880 0x7f9a3c0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a42821640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a3c0cd6d0 0x7f9a3c154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a42821640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a3c153e60 0x7f9a3c0c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a42821640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c154e20 con 0x7f9a3c0cd6d0 2023-11-04T01:39:51.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a42821640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c1f4320 con 0x7f9a3c153e60 2023-11-04T01:39:51.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a42821640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c154b40 con 0x7f9a3c0b4880 2023-11-04T01:39:51.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a3b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a3c0cd6d0 0x7f9a3c154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a3b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a3c0cd6d0 0x7f9a3c154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58518/0 (socket says 172.21.15.44:58518) 2023-11-04T01:39:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a3b7fe640 1 -- 172.21.15.44:0/1909579135 learned_addr learned my addr 172.21.15.44:0/1909579135 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a40dbe640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a3c153e60 0x7f9a3c0c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a3bfff640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a3c0b4880 0x7f9a3c0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a3b7fe640 1 -- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a3c0b4880 msgr2=0x7f9a3c0c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a3b7fe640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a3c0b4880 0x7f9a3c0c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a3b7fe640 1 -- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a3c153e60 msgr2=0x7f9a3c0c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a3b7fe640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a3c153e60 0x7f9a3c0c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a3b7fe640 1 -- 172.21.15.44:0/1909579135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c009400 con 0x7f9a3c0cd6d0 2023-11-04T01:39:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a40dbe640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a3c153e60 0x7f9a3c0c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a3bfff640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a3c0b4880 0x7f9a3c0c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a3b7fe640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a3c0cd6d0 0x7f9a3c154240 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0098c0 tx=0x7f9a2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.818+0000 7f9a38ff9640 1 -- 172.21.15.44:0/1909579135 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c03ba70 con 0x7f9a3c0cd6d0 2023-11-04T01:39:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.819+0000 7f9a38ff9640 1 -- 172.21.15.44:0/1909579135 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c03bbd0 con 0x7f9a3c0cd6d0 2023-11-04T01:39:51.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.819+0000 7f9a42821640 1 -- 172.21.15.44:0/1909579135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3c1f3c60 con 0x7f9a3c0cd6d0 2023-11-04T01:39:51.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.819+0000 7f9a38ff9640 1 -- 172.21.15.44:0/1909579135 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0453f0 con 0x7f9a3c0cd6d0 2023-11-04T01:39:51.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.819+0000 7f9a42821640 1 -- 172.21.15.44:0/1909579135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3c0c65b0 con 0x7f9a3c0cd6d0 2023-11-04T01:39:51.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.820+0000 7f9a42821640 1 -- 172.21.15.44:0/1909579135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3c1f3ac0 con 0x7f9a3c0cd6d0 2023-11-04T01:39:51.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.820+0000 7f9a38ff9640 1 -- 172.21.15.44:0/1909579135 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a2c04e450 con 0x7f9a3c0cd6d0 2023-11-04T01:39:51.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.820+0000 7f9a38ff9640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9a2806aea0 0x7f9a2806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.821+0000 7f9a38ff9640 1 -- 172.21.15.44:0/1909579135 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f9a2c0abe00 con 0x7f9a3c0cd6d0 2023-11-04T01:39:51.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.821+0000 7f9a3bfff640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9a2806aea0 0x7f9a2806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.821+0000 7f9a3bfff640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9a2806aea0 0x7f9a2806d360 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000a870 tx=0x7f9a30008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:51.825+0000 7f9a38ff9640 1 -- 172.21.15.44:0/1909579135 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9a3c1f3ac0 con 0x7f9a3c0cd6d0 2023-11-04T01:39:52.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.070+0000 7f9a42821640 1 -- 172.21.15.44:0/1909579135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f9a3c1f4460 con 0x7f9a3c0cd6d0 2023-11-04T01:39:52.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.402+0000 7f9a38ff9640 1 -- 172.21.15.44:0/1909579135 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7359 v52) v1 ==== 112+0+0 (secure 0 0 0) 0x7f9a3c1f4460 con 0x7f9a3c0cd6d0 2023-11-04T01:39:52.405 INFO:teuthology.orchestra.run.smithi044.stderr:freezing mds.7359 2023-11-04T01:39:52.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.405+0000 7f9a42821640 1 -- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9a2806aea0 msgr2=0x7f9a2806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.405+0000 7f9a42821640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9a2806aea0 0x7f9a2806d360 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000a870 tx=0x7f9a30008040 comp rx=0 tx=0).stop 2023-11-04T01:39:52.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.405+0000 7f9a42821640 1 -- 172.21.15.44:0/1909579135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a3c0cd6d0 msgr2=0x7f9a3c154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.405+0000 7f9a42821640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a3c0cd6d0 0x7f9a3c154240 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0098c0 tx=0x7f9a2c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.405+0000 7f9a42821640 1 -- 172.21.15.44:0/1909579135 shutdown_connections 2023-11-04T01:39:52.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.405+0000 7f9a42821640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9a2806aea0 0x7f9a2806d360 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.405+0000 7f9a42821640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a3c153e60 0x7f9a3c0c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.405+0000 7f9a42821640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a3c0cd6d0 0x7f9a3c154240 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.405+0000 7f9a42821640 1 --2- 172.21.15.44:0/1909579135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a3c0b4880 0x7f9a3c0c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.405+0000 7f9a42821640 1 -- 172.21.15.44:0/1909579135 >> 172.21.15.44:0/1909579135 conn(0x7f9a3c0cf880 msgr2=0x7f9a3c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:52.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.405+0000 7f9a42821640 1 -- 172.21.15.44:0/1909579135 shutdown_connections 2023-11-04T01:39:52.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.405+0000 7f9a42821640 1 -- 172.21.15.44:0/1909579135 wait complete. 2023-11-04T01:39:52.418 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json config set mds_kill_mdstable_at 1 2023-11-04T01:39:52.542 INFO:teuthology.orchestra.run.smithi204.stdout:{"success":"mds_kill_mdstable_at = '1' (not observed, change may require restart) "} 2023-11-04T01:39:52.543 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '1' (not observed, change may require restart) " } 2023-11-04T01:39:52.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:52.543 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s11) 2023-11-04T01:39:52.546 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:39:52.564 INFO:tasks.ceph.mds.d.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f039ca69640 time 2023-11-04T01:39:52.563857+0000 2023-11-04T01:39:52.564 INFO:tasks.ceph.mds.d.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:39:52.565 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:52.565 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03a256efaf] 2023-11-04T01:39:52.565 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03a256f16d] 2023-11-04T01:39:52.565 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559bc95ba254] 2023-11-04T01:39:52.565 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559bc934d0a9] 2023-11-04T01:39:52.565 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559bc934fb2b] 2023-11-04T01:39:52.565 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559bc935001c] 2023-11-04T01:39:52.565 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559bc9339325] 2023-11-04T01:39:52.565 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f03a275ff9a] 2023-11-04T01:39:52.565 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03a27f1741] 2023-11-04T01:39:52.565 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f03a1c9f802] 2023-11-04T01:39:52.566 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f03a1c3f450] 2023-11-04T01:39:52.566 INFO:tasks.ceph.mds.d.smithi204.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:39:52.566 INFO:tasks.ceph.mds.d.smithi204.stderr: in thread 7f039ca69640 thread_name:ms_dispatch 2023-11-04T01:39:52.566 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:39:52.563+0000 7f039ca69640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f039ca69640 time 2023-11-04T01:39:52.563857+0000 2023-11-04T01:39:52.566 INFO:tasks.ceph.mds.d.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:39:52.566 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:39:52.566 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:52.566 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03a256efaf] 2023-11-04T01:39:52.566 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03a256f16d] 2023-11-04T01:39:52.566 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559bc95ba254] 2023-11-04T01:39:52.566 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559bc934d0a9] 2023-11-04T01:39:52.566 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559bc934fb2b] 2023-11-04T01:39:52.566 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559bc935001c] 2023-11-04T01:39:52.567 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559bc9339325] 2023-11-04T01:39:52.567 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f03a275ff9a] 2023-11-04T01:39:52.567 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03a27f1741] 2023-11-04T01:39:52.567 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f03a1c9f802] 2023-11-04T01:39:52.567 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f03a1c3f450] 2023-11-04T01:39:52.567 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:39:52.567 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:52.567 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f03a1c54db0] 2023-11-04T01:39:52.568 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f03a1ca154c] 2023-11-04T01:39:52.568 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: raise() 2023-11-04T01:39:52.568 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: abort() 2023-11-04T01:39:52.568 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03a256f009] 2023-11-04T01:39:52.568 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03a256f16d] 2023-11-04T01:39:52.568 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559bc95ba254] 2023-11-04T01:39:52.568 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559bc934d0a9] 2023-11-04T01:39:52.568 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559bc934fb2b] 2023-11-04T01:39:52.568 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559bc935001c] 2023-11-04T01:39:52.568 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559bc9339325] 2023-11-04T01:39:52.568 INFO:tasks.ceph.mds.d.smithi204.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f03a275ff9a] 2023-11-04T01:39:52.568 INFO:tasks.ceph.mds.d.smithi204.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03a27f1741] 2023-11-04T01:39:52.568 INFO:tasks.ceph.mds.d.smithi204.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f03a1c9f802] 2023-11-04T01:39:52.569 INFO:tasks.ceph.mds.d.smithi204.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f03a1c3f450] 2023-11-04T01:39:52.569 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:39:52.564+0000 7f039ca69640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:39:52.569 INFO:tasks.ceph.mds.d.smithi204.stderr: in thread 7f039ca69640 thread_name:ms_dispatch 2023-11-04T01:39:52.569 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:39:52.569 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:52.569 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f03a1c54db0] 2023-11-04T01:39:52.569 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f03a1ca154c] 2023-11-04T01:39:52.569 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: raise() 2023-11-04T01:39:52.569 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: abort() 2023-11-04T01:39:52.569 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03a256f009] 2023-11-04T01:39:52.569 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03a256f16d] 2023-11-04T01:39:52.569 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559bc95ba254] 2023-11-04T01:39:52.569 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559bc934d0a9] 2023-11-04T01:39:52.569 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559bc934fb2b] 2023-11-04T01:39:52.570 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559bc935001c] 2023-11-04T01:39:52.570 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559bc9339325] 2023-11-04T01:39:52.570 INFO:tasks.ceph.mds.d.smithi204.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f03a275ff9a] 2023-11-04T01:39:52.570 INFO:tasks.ceph.mds.d.smithi204.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03a27f1741] 2023-11-04T01:39:52.570 INFO:tasks.ceph.mds.d.smithi204.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f03a1c9f802] 2023-11-04T01:39:52.570 INFO:tasks.ceph.mds.d.smithi204.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f03a1c3f450] 2023-11-04T01:39:52.570 INFO:tasks.ceph.mds.d.smithi204.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:39:52.570 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:39:52.571 INFO:tasks.ceph.mds.d.smithi204.stderr: -2403> 2023-11-04T01:39:36.518+0000 7f039a264640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:39:52.571 INFO:tasks.ceph.mds.d.smithi204.stderr: -2032> 2023-11-04T01:39:41.518+0000 7f039a264640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:39:52.571 INFO:tasks.ceph.mds.d.smithi204.stderr: -1> 2023-11-04T01:39:52.563+0000 7f039ca69640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f039ca69640 time 2023-11-04T01:39:52.563857+0000 2023-11-04T01:39:52.571 INFO:tasks.ceph.mds.d.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:39:52.572 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:39:52.572 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:52.572 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03a256efaf] 2023-11-04T01:39:52.572 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03a256f16d] 2023-11-04T01:39:52.572 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559bc95ba254] 2023-11-04T01:39:52.572 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559bc934d0a9] 2023-11-04T01:39:52.572 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559bc934fb2b] 2023-11-04T01:39:52.572 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559bc935001c] 2023-11-04T01:39:52.572 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559bc9339325] 2023-11-04T01:39:52.572 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f03a275ff9a] 2023-11-04T01:39:52.572 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03a27f1741] 2023-11-04T01:39:52.572 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f03a1c9f802] 2023-11-04T01:39:52.572 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f03a1c3f450] 2023-11-04T01:39:52.573 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:39:52.573 INFO:tasks.ceph.mds.d.smithi204.stderr: 0> 2023-11-04T01:39:52.564+0000 7f039ca69640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:39:52.573 INFO:tasks.ceph.mds.d.smithi204.stderr: in thread 7f039ca69640 thread_name:ms_dispatch 2023-11-04T01:39:52.573 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:39:52.573 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:52.573 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f03a1c54db0] 2023-11-04T01:39:52.573 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f03a1ca154c] 2023-11-04T01:39:52.573 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: raise() 2023-11-04T01:39:52.573 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: abort() 2023-11-04T01:39:52.573 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03a256f009] 2023-11-04T01:39:52.573 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03a256f16d] 2023-11-04T01:39:52.573 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559bc95ba254] 2023-11-04T01:39:52.574 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559bc934d0a9] 2023-11-04T01:39:52.574 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559bc934fb2b] 2023-11-04T01:39:52.574 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559bc935001c] 2023-11-04T01:39:52.574 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559bc9339325] 2023-11-04T01:39:52.574 INFO:tasks.ceph.mds.d.smithi204.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f03a275ff9a] 2023-11-04T01:39:52.574 INFO:tasks.ceph.mds.d.smithi204.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03a27f1741] 2023-11-04T01:39:52.574 INFO:tasks.ceph.mds.d.smithi204.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f03a1c9f802] 2023-11-04T01:39:52.574 INFO:tasks.ceph.mds.d.smithi204.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f03a1c3f450] 2023-11-04T01:39:52.574 INFO:tasks.ceph.mds.d.smithi204.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:39:52.574 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:39:52.575 INFO:tasks.ceph.mds.d.smithi204.stderr: -2403> 2023-11-04T01:39:36.518+0000 7f039a264640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:39:52.575 INFO:tasks.ceph.mds.d.smithi204.stderr: -2032> 2023-11-04T01:39:41.518+0000 7f039a264640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:39:52.576 INFO:tasks.ceph.mds.d.smithi204.stderr: -1> 2023-11-04T01:39:52.563+0000 7f039ca69640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f039ca69640 time 2023-11-04T01:39:52.563857+0000 2023-11-04T01:39:52.576 INFO:tasks.ceph.mds.d.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:39:52.576 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:39:52.576 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:52.576 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03a256efaf] 2023-11-04T01:39:52.576 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03a256f16d] 2023-11-04T01:39:52.577 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559bc95ba254] 2023-11-04T01:39:52.577 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559bc934d0a9] 2023-11-04T01:39:52.577 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559bc934fb2b] 2023-11-04T01:39:52.577 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559bc935001c] 2023-11-04T01:39:52.577 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559bc9339325] 2023-11-04T01:39:52.577 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f03a275ff9a] 2023-11-04T01:39:52.577 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03a27f1741] 2023-11-04T01:39:52.577 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f03a1c9f802] 2023-11-04T01:39:52.577 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f03a1c3f450] 2023-11-04T01:39:52.577 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:39:52.577 INFO:tasks.ceph.mds.d.smithi204.stderr: 0> 2023-11-04T01:39:52.564+0000 7f039ca69640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:39:52.577 INFO:tasks.ceph.mds.d.smithi204.stderr: in thread 7f039ca69640 thread_name:ms_dispatch 2023-11-04T01:39:52.577 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:39:52.577 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:52.578 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f03a1c54db0] 2023-11-04T01:39:52.578 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f03a1ca154c] 2023-11-04T01:39:52.578 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: raise() 2023-11-04T01:39:52.578 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: abort() 2023-11-04T01:39:52.578 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03a256f009] 2023-11-04T01:39:52.578 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03a256f16d] 2023-11-04T01:39:52.578 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559bc95ba254] 2023-11-04T01:39:52.578 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559bc934d0a9] 2023-11-04T01:39:52.578 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559bc934fb2b] 2023-11-04T01:39:52.578 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559bc935001c] 2023-11-04T01:39:52.578 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559bc9339325] 2023-11-04T01:39:52.578 INFO:tasks.ceph.mds.d.smithi204.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f03a275ff9a] 2023-11-04T01:39:52.578 INFO:tasks.ceph.mds.d.smithi204.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03a27f1741] 2023-11-04T01:39:52.579 INFO:tasks.ceph.mds.d.smithi204.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f03a1c9f802] 2023-11-04T01:39:52.579 INFO:tasks.ceph.mds.d.smithi204.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f03a1c3f450] 2023-11-04T01:39:52.579 INFO:tasks.ceph.mds.d.smithi204.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:39:52.579 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:39:52.702 INFO:teuthology.orchestra.run.smithi044.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:39:52.703 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:39:52.703 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:52.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.807+0000 7f85fb61a640 1 Processor -- start 2023-11-04T01:39:52.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.807+0000 7f85fb61a640 1 -- start start 2023-11-04T01:39:52.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.808+0000 7f85fb61a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85f415ce60 0x7f85f406b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.808+0000 7f85fb61a640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f41615d0 con 0x7f85f406bd30 2023-11-04T01:39:52.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.808+0000 7f85fb61a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f41618b0 con 0x7f85f40cf160 2023-11-04T01:39:52.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.808+0000 7f85fb61a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f40cbde0 con 0x7f85f415ce60 2023-11-04T01:39:52.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.808+0000 7f85f8bb5640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f85f406bd30 0x7f85f4160b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45988/0 (socket says 172.21.15.44:45988) 2023-11-04T01:39:52.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.808+0000 7f85f8bb5640 1 -- 172.21.15.44:0/212730536 learned_addr learned my addr 172.21.15.44:0/212730536 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:39:52.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.808+0000 7f85f93b6640 1 --2- 172.21.15.44:0/212730536 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85f415ce60 0x7f85f406b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.808+0000 7f85ebfff640 1 -- 172.21.15.44:0/212730536 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927088730 0 0) 0x7f85f41615d0 con 0x7f85f406bd30 2023-11-04T01:39:52.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.808+0000 7f85ebfff640 1 -- 172.21.15.44:0/212730536 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85e0003520 con 0x7f85f406bd30 2023-11-04T01:39:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.808+0000 7f85ebfff640 1 -- 172.21.15.44:0/212730536 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368842793 0 0) 0x7f85f41618b0 con 0x7f85f40cf160 2023-11-04T01:39:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.808+0000 7f85ebfff640 1 -- 172.21.15.44:0/212730536 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85f41615d0 con 0x7f85f40cf160 2023-11-04T01:39:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.808+0000 7f85f93b6640 1 -- 172.21.15.44:0/212730536 >> v1:172.21.15.204:6789/0 conn(0x7f85f40cf160 legacy=0x7f85f40cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.808+0000 7f85f93b6640 1 -- 172.21.15.44:0/212730536 >> v1:172.21.15.44:6789/0 conn(0x7f85f406bd30 legacy=0x7f85f4160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.808+0000 7f85ebfff640 1 -- 172.21.15.44:0/212730536 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 43690373 0 0) 0x7f85e0003520 con 0x7f85f406bd30 2023-11-04T01:39:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.808+0000 7f85f93b6640 1 -- 172.21.15.44:0/212730536 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f40cba00 con 0x7f85f415ce60 2023-11-04T01:39:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.809+0000 7f85f93b6640 1 --2- 172.21.15.44:0/212730536 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85f415ce60 0x7f85f406b7f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85f00097d0 tx=0x7f85f002b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a298cfedb2955720 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.809+0000 7f85ebfff640 1 -- 172.21.15.44:0/212730536 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4001670 con 0x7f85f415ce60 2023-11-04T01:39:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.809+0000 7f85ebfff640 1 -- 172.21.15.44:0/212730536 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f002e050 con 0x7f85f415ce60 2023-11-04T01:39:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.810+0000 7f85ebfff640 1 -- 172.21.15.44:0/212730536 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0030710 con 0x7f85f415ce60 2023-11-04T01:39:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.810+0000 7f85fb61a640 1 -- 172.21.15.44:0/212730536 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85f415ce60 msgr2=0x7f85f406b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.810+0000 7f85fb61a640 1 --2- 172.21.15.44:0/212730536 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85f415ce60 0x7f85f406b7f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85f00097d0 tx=0x7f85f002b800 comp rx=0 tx=0).stop 2023-11-04T01:39:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.810+0000 7f85fb61a640 1 -- 172.21.15.44:0/212730536 shutdown_connections 2023-11-04T01:39:52.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.810+0000 7f85fb61a640 1 --2- 172.21.15.44:0/212730536 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85f415ce60 0x7f85f406b7f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.810+0000 7f85fb61a640 1 -- 172.21.15.44:0/212730536 >> 172.21.15.44:0/212730536 conn(0x7f85f406ea90 msgr2=0x7f85f406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:52.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.810+0000 7f85fb61a640 1 -- 172.21.15.44:0/212730536 shutdown_connections 2023-11-04T01:39:52.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.810+0000 7f85fb61a640 1 -- 172.21.15.44:0/212730536 wait complete. 2023-11-04T01:39:52.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.811+0000 7f85fb61a640 1 Processor -- start 2023-11-04T01:39:52.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.811+0000 7f85fb61a640 1 -- start start 2023-11-04T01:39:52.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.812+0000 7f85fb61a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85f40cf160 0x7f85f415eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.812+0000 7f85fb61a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85f415ce60 0x7f85f41f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.812+0000 7f85fb61a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85f415f1e0 0x7f85f41f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.812+0000 7f85fb61a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f414ab90 con 0x7f85f415ce60 2023-11-04T01:39:52.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.812+0000 7f85fb61a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f414b350 con 0x7f85f415f1e0 2023-11-04T01:39:52.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.812+0000 7f85fb61a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f415fc40 con 0x7f85f40cf160 2023-11-04T01:39:52.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.812+0000 7f85f8bb5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85f415ce60 0x7f85f41f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.812+0000 7f85f8bb5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85f415ce60 0x7f85f41f5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44768/0 (socket says 172.21.15.44:44768) 2023-11-04T01:39:52.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.812+0000 7f85f8bb5640 1 -- 172.21.15.44:0/3519615953 learned_addr learned my addr 172.21.15.44:0/3519615953 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:52.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.812+0000 7f85f8bb5640 1 -- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85f40cf160 msgr2=0x7f85f415eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.812+0000 7f85f9bb7640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85f415f1e0 0x7f85f41f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.812+0000 7f85f93b6640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85f40cf160 0x7f85f415eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.813+0000 7f85f8bb5640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85f40cf160 0x7f85f415eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.813+0000 7f85f8bb5640 1 -- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85f415f1e0 msgr2=0x7f85f41f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.813+0000 7f85f8bb5640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85f415f1e0 0x7f85f41f61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.813+0000 7f85f8bb5640 1 -- 172.21.15.44:0/3519615953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f0009400 con 0x7f85f415ce60 2023-11-04T01:39:52.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.813+0000 7f85f9bb7640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85f415f1e0 0x7f85f41f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:52.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.813+0000 7f85f93b6640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85f40cf160 0x7f85f415eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:52.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.813+0000 7f85f8bb5640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85f415ce60 0x7f85f41f5c60 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c750 tx=0x7f85e400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:52.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.813+0000 7f85e9ffb640 1 -- 172.21.15.44:0/3519615953 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4005ad0 con 0x7f85f415ce60 2023-11-04T01:39:52.819 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.813+0000 7f85e9ffb640 1 -- 172.21.15.44:0/3519615953 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e4005c30 con 0x7f85f415ce60 2023-11-04T01:39:52.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.813+0000 7f85fb61a640 1 -- 172.21.15.44:0/3519615953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f415f680 con 0x7f85f415ce60 2023-11-04T01:39:52.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.813+0000 7f85e9ffb640 1 -- 172.21.15.44:0/3519615953 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4007070 con 0x7f85f415ce60 2023-11-04T01:39:52.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.813+0000 7f85fb61a640 1 -- 172.21.15.44:0/3519615953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f414af70 con 0x7f85f415ce60 2023-11-04T01:39:52.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.814+0000 7f85fb61a640 1 -- 172.21.15.44:0/3519615953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f414add0 con 0x7f85f415ce60 2023-11-04T01:39:52.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.814+0000 7f85e9ffb640 1 -- 172.21.15.44:0/3519615953 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f85e40071d0 con 0x7f85f415ce60 2023-11-04T01:39:52.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.815+0000 7f85e9ffb640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85d806ae70 0x7f85d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.815+0000 7f85e9ffb640 1 -- 172.21.15.44:0/3519615953 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f85e4089270 con 0x7f85f415ce60 2023-11-04T01:39:52.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.815+0000 7f85f93b6640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85d806ae70 0x7f85d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.816+0000 7f85f93b6640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85d806ae70 0x7f85d806d330 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f85f0034000 tx=0x7f85f0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:52.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:52.819+0000 7f85e9ffb640 1 -- 172.21.15.44:0/3519615953 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f85f414add0 con 0x7f85f415ce60 2023-11-04T01:39:52.932 INFO:tasks.ceph.mds.d.smithi204.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:39:53.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:53.030+0000 7f85fb61a640 1 -- 172.21.15.44:0/3519615953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85f414add0 con 0x7f85f415ce60 2023-11-04T01:39:53.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:53.031+0000 7f85e9ffb640 1 -- 172.21.15.44:0/3519615953 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f85f414add0 con 0x7f85f415ce60 2023-11-04T01:39:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:53.033 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:39:52.071527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6836/2461924520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2461924520},{"type":"v1","addr":"172.21.15.204:6836","nonce":2461924520}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:53.033 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 52 2023-11-04T01:39:53.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:53.033+0000 7f85fb61a640 1 -- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85d806ae70 msgr2=0x7f85d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:53.033+0000 7f85fb61a640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85d806ae70 0x7f85d806d330 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f85f0034000 tx=0x7f85f0008030 comp rx=0 tx=0).stop 2023-11-04T01:39:53.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:53.033+0000 7f85fb61a640 1 -- 172.21.15.44:0/3519615953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85f415ce60 msgr2=0x7f85f41f5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:53.033+0000 7f85fb61a640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85f415ce60 0x7f85f41f5c60 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c750 tx=0x7f85e400cc10 comp rx=0 tx=0).stop 2023-11-04T01:39:53.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:53.033+0000 7f85fb61a640 1 -- 172.21.15.44:0/3519615953 shutdown_connections 2023-11-04T01:39:53.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:53.033+0000 7f85fb61a640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85d806ae70 0x7f85d806d330 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:53.033+0000 7f85fb61a640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85f415f1e0 0x7f85f41f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:53.033+0000 7f85fb61a640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85f415ce60 0x7f85f41f5c60 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:53.033+0000 7f85fb61a640 1 --2- 172.21.15.44:0/3519615953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85f40cf160 0x7f85f415eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:53.033+0000 7f85fb61a640 1 -- 172.21.15.44:0/3519615953 >> 172.21.15.44:0/3519615953 conn(0x7f85f406ea90 msgr2=0x7f85f40c46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:53.033+0000 7f85fb61a640 1 -- 172.21.15.44:0/3519615953 shutdown_connections 2023-11-04T01:39:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:53.033+0000 7f85fb61a640 1 -- 172.21.15.44:0/3519615953 wait complete. 2023-11-04T01:39:53.045 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:39:53.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-04T01:39:58.046 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.164+0000 7fcc26ba5640 1 Processor -- start 2023-11-04T01:39:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.164+0000 7fcc26ba5640 1 -- start start 2023-11-04T01:39:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.165+0000 7fcc26ba5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc2015ce60 0x7fcc2006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.165+0000 7fcc26ba5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcc200cf160 0x7fcc200cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.165+0000 7fcc26ba5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc201615d0 con 0x7fcc2006bd30 2023-11-04T01:39:58.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.165+0000 7fcc26ba5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc200cbde0 con 0x7fcc200cf160 2023-11-04T01:39:58.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.165+0000 7fcc26ba5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc200cfb50 con 0x7fcc2015ce60 2023-11-04T01:39:58.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.165+0000 7fcc24941640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc2015ce60 0x7fcc2006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.165+0000 7fcc25142640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcc200cf160 0x7fcc200cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.165+0000 7fcc24941640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc2015ce60 0x7fcc2006b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:55288/0 (socket says 172.21.15.44:55288) 2023-11-04T01:39:58.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.165+0000 7fcc24941640 1 -- 172.21.15.44:0/1480105732 learned_addr learned my addr 172.21.15.44:0/1480105732 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:58.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.165+0000 7fcc1ffff640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fcc2006bd30 0x7fcc20160b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:37214/0 (socket says 172.21.15.44:37214) 2023-11-04T01:39:58.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.166+0000 7fcc24941640 1 -- 172.21.15.44:0/1480105732 >> v2:172.21.15.204:3300/0 conn(0x7fcc200cf160 msgr2=0x7fcc200cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:58.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.166+0000 7fcc24941640 1 --2- 172.21.15.44:0/1480105732 >> v2:172.21.15.204:3300/0 conn(0x7fcc200cf160 0x7fcc200cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.166+0000 7fcc24941640 1 -- 172.21.15.44:0/1480105732 >> v1:172.21.15.204:6789/0 conn(0x7fcc2006bd30 legacy=0x7fcc20160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.166+0000 7fcc24941640 1 -- 172.21.15.44:0/1480105732 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc201618b0 con 0x7fcc2015ce60 2023-11-04T01:39:58.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.166+0000 7fcc1f7fe640 1 -- 172.21.15.44:0/1480105732 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852124700 0 0) 0x7fcc201615d0 con 0x7fcc2006bd30 2023-11-04T01:39:58.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.166+0000 7fcc24941640 1 --2- 172.21.15.44:0/1480105732 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc2015ce60 0x7fcc2006b7f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009870 tx=0x7fcc1402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9095f14305cf6638 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.167+0000 7fcc1f7fe640 1 -- 172.21.15.44:0/1480105732 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14030840 con 0x7fcc2015ce60 2023-11-04T01:39:58.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.167+0000 7fcc1f7fe640 1 -- 172.21.15.44:0/1480105732 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc140309a0 con 0x7fcc2015ce60 2023-11-04T01:39:58.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.167+0000 7fcc1f7fe640 1 -- 172.21.15.44:0/1480105732 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14030d30 con 0x7fcc2015ce60 2023-11-04T01:39:58.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.167+0000 7fcc26ba5640 1 -- 172.21.15.44:0/1480105732 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc2015ce60 msgr2=0x7fcc2006b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.167+0000 7fcc26ba5640 1 --2- 172.21.15.44:0/1480105732 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc2015ce60 0x7fcc2006b7f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009870 tx=0x7fcc1402b980 comp rx=0 tx=0).stop 2023-11-04T01:39:58.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.167+0000 7fcc26ba5640 1 -- 172.21.15.44:0/1480105732 shutdown_connections 2023-11-04T01:39:58.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.167+0000 7fcc26ba5640 1 --2- 172.21.15.44:0/1480105732 >> v2:172.21.15.204:3300/0 conn(0x7fcc200cf160 0x7fcc200cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.167+0000 7fcc26ba5640 1 --2- 172.21.15.44:0/1480105732 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc2015ce60 0x7fcc2006b7f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.167+0000 7fcc26ba5640 1 -- 172.21.15.44:0/1480105732 >> 172.21.15.44:0/1480105732 conn(0x7fcc2006ea90 msgr2=0x7fcc2006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:58.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.167+0000 7fcc26ba5640 1 -- 172.21.15.44:0/1480105732 shutdown_connections 2023-11-04T01:39:58.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.167+0000 7fcc26ba5640 1 -- 172.21.15.44:0/1480105732 wait complete. 2023-11-04T01:39:58.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.168+0000 7fcc26ba5640 1 Processor -- start 2023-11-04T01:39:58.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.169+0000 7fcc26ba5640 1 -- start start 2023-11-04T01:39:58.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.169+0000 7fcc26ba5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc200cf160 0x7fcc2015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.169+0000 7fcc26ba5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc2015ce60 0x7fcc201f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.169+0000 7fcc26ba5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc2015f060 0x7fcc201f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.169+0000 7fcc26ba5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc201f3b70 con 0x7fcc2015ce60 2023-11-04T01:39:58.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.169+0000 7fcc26ba5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2015e4a0 con 0x7fcc200cf160 2023-11-04T01:39:58.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.169+0000 7fcc26ba5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2015e780 con 0x7fcc2015f060 2023-11-04T01:39:58.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc1ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc2015ce60 0x7fcc201f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc1ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc2015ce60 0x7fcc201f23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44772/0 (socket says 172.21.15.44:44772) 2023-11-04T01:39:58.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc1ffff640 1 -- 172.21.15.44:0/4149155286 learned_addr learned my addr 172.21.15.44:0/4149155286 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:39:58.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc24941640 1 --2- 172.21.15.44:0/4149155286 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc200cf160 0x7fcc2015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc25142640 1 --2- 172.21.15.44:0/4149155286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc2015f060 0x7fcc201f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc1ffff640 1 -- 172.21.15.44:0/4149155286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc2015f060 msgr2=0x7fcc201f2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc1ffff640 1 --2- 172.21.15.44:0/4149155286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc2015f060 0x7fcc201f2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc1ffff640 1 -- 172.21.15.44:0/4149155286 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc200cf160 msgr2=0x7fcc2015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc1ffff640 1 --2- 172.21.15.44:0/4149155286 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc200cf160 0x7fcc2015dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc1ffff640 1 -- 172.21.15.44:0/4149155286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc140094d0 con 0x7fcc2015ce60 2023-11-04T01:39:58.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc1ffff640 1 --2- 172.21.15.44:0/4149155286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc2015ce60 0x7fcc201f23e0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00c4d0 tx=0x7fcc0c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc1d7fa640 1 -- 172.21.15.44:0/4149155286 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c0074e0 con 0x7fcc2015ce60 2023-11-04T01:39:58.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc1d7fa640 1 -- 172.21.15.44:0/4149155286 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0c007660 con 0x7fcc2015ce60 2023-11-04T01:39:58.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc26ba5640 1 -- 172.21.15.44:0/4149155286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2015ea60 con 0x7fcc2015ce60 2023-11-04T01:39:58.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc1d7fa640 1 -- 172.21.15.44:0/4149155286 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c004a20 con 0x7fcc2015ce60 2023-11-04T01:39:58.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.170+0000 7fcc26ba5640 1 -- 172.21.15.44:0/4149155286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc201f2e60 con 0x7fcc2015ce60 2023-11-04T01:39:58.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.171+0000 7fcc26ba5640 1 -- 172.21.15.44:0/4149155286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc201f3920 con 0x7fcc2015ce60 2023-11-04T01:39:58.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.172+0000 7fcc1d7fa640 1 -- 172.21.15.44:0/4149155286 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc0c004b80 con 0x7fcc2015ce60 2023-11-04T01:39:58.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.172+0000 7fcc1d7fa640 1 --2- 172.21.15.44:0/4149155286 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcc0406aea0 0x7fcc0406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.173+0000 7fcc1d7fa640 1 -- 172.21.15.44:0/4149155286 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7fcc0c088fc0 con 0x7fcc2015ce60 2023-11-04T01:39:58.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.173+0000 7fcc24941640 1 --2- 172.21.15.44:0/4149155286 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcc0406aea0 0x7fcc0406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.173+0000 7fcc24941640 1 --2- 172.21.15.44:0/4149155286 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcc0406aea0 0x7fcc0406d360 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fcc14036000 tx=0x7fcc14008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.178 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.177+0000 7fcc1d7fa640 1 -- 172.21.15.44:0/4149155286 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcc0c0bbca0 con 0x7fcc2015ce60 2023-11-04T01:39:58.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.388+0000 7fcc26ba5640 1 -- 172.21.15.44:0/4149155286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc20074290 con 0x7fcc2015ce60 2023-11-04T01:39:58.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.389+0000 7fcc1d7fa640 1 -- 172.21.15.44:0/4149155286 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fcc0c018020 con 0x7fcc2015ce60 2023-11-04T01:39:58.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:39:58.391 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:39:52.071527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6836/2461924520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2461924520},{"type":"v1","addr":"172.21.15.204:6836","nonce":2461924520}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:58.391 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 52 2023-11-04T01:39:58.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.391+0000 7fcc26ba5640 1 -- 172.21.15.44:0/4149155286 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcc0406aea0 msgr2=0x7fcc0406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.391+0000 7fcc26ba5640 1 --2- 172.21.15.44:0/4149155286 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcc0406aea0 0x7fcc0406d360 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fcc14036000 tx=0x7fcc14008030 comp rx=0 tx=0).stop 2023-11-04T01:39:58.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.391+0000 7fcc26ba5640 1 -- 172.21.15.44:0/4149155286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc2015ce60 msgr2=0x7fcc201f23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.391+0000 7fcc26ba5640 1 --2- 172.21.15.44:0/4149155286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc2015ce60 0x7fcc201f23e0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00c4d0 tx=0x7fcc0c00c990 comp rx=0 tx=0).stop 2023-11-04T01:39:58.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.391+0000 7fcc26ba5640 1 -- 172.21.15.44:0/4149155286 shutdown_connections 2023-11-04T01:39:58.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.391+0000 7fcc26ba5640 1 --2- 172.21.15.44:0/4149155286 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcc0406aea0 0x7fcc0406d360 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.391+0000 7fcc26ba5640 1 --2- 172.21.15.44:0/4149155286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc2015f060 0x7fcc201f2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.391+0000 7fcc26ba5640 1 --2- 172.21.15.44:0/4149155286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc2015ce60 0x7fcc201f23e0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.391+0000 7fcc26ba5640 1 --2- 172.21.15.44:0/4149155286 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc200cf160 0x7fcc2015dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.391+0000 7fcc26ba5640 1 -- 172.21.15.44:0/4149155286 >> 172.21.15.44:0/4149155286 conn(0x7fcc2006ea90 msgr2=0x7fcc201608e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:58.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.391+0000 7fcc26ba5640 1 -- 172.21.15.44:0/4149155286 shutdown_connections 2023-11-04T01:39:58.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:39:58.391+0000 7fcc26ba5640 1 -- 172.21.15.44:0/4149155286 wait complete. 2023-11-04T01:39:58.403 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:39:58.535 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:58.538 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:00.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-11-04T01:40:03.405 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:03.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.524+0000 7ff6f17a5640 1 Processor -- start 2023-11-04T01:40:03.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.524+0000 7ff6f17a5640 1 -- start start 2023-11-04T01:40:03.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.525+0000 7ff6f17a5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff6ec0b0ae0 0x7ff6ec0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.525+0000 7ff6f17a5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ec0b4110 con 0x7ff6ec159c70 2023-11-04T01:40:03.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.525+0000 7ff6f17a5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ec0b43f0 con 0x7ff6ec06db20 2023-11-04T01:40:03.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.525+0000 7ff6f17a5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ec0b49b0 con 0x7ff6ec0b0ae0 2023-11-04T01:40:03.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.525+0000 7ff6ea7fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff6ec0b0ae0 0x7ff6ec0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.525+0000 7ff6eaffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff6ec159c70 0x7ff6ec0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57860/0 (socket says 172.21.15.44:57860) 2023-11-04T01:40:03.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.525+0000 7ff6eaffd640 1 -- 172.21.15.44:0/3002458516 learned_addr learned my addr 172.21.15.44:0/3002458516 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:03.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.525+0000 7ff6ea7fc640 1 -- 172.21.15.44:0/3002458516 >> v1:172.21.15.204:6789/0 conn(0x7ff6ec06db20 legacy=0x7ff6ec15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.525+0000 7ff6ea7fc640 1 -- 172.21.15.44:0/3002458516 >> v1:172.21.15.44:6789/0 conn(0x7ff6ec159c70 legacy=0x7ff6ec0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.525+0000 7ff6ea7fc640 1 -- 172.21.15.44:0/3002458516 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec0b46d0 con 0x7ff6ec0b0ae0 2023-11-04T01:40:03.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.526+0000 7ff6ea7fc640 1 --2- 172.21.15.44:0/3002458516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6ec0b0ae0 0x7ff6ec0ce370 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00097a0 tx=0x7ff6e002dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78af6b97a6c5a5fa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.526+0000 7ff6e9ffb640 1 -- 172.21.15.44:0/3002458516 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e002f8a0 con 0x7ff6ec0b0ae0 2023-11-04T01:40:03.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.526+0000 7ff6e9ffb640 1 -- 172.21.15.44:0/3002458516 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e002fa00 con 0x7ff6ec0b0ae0 2023-11-04T01:40:03.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.526+0000 7ff6e9ffb640 1 -- 172.21.15.44:0/3002458516 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e002fd90 con 0x7ff6ec0b0ae0 2023-11-04T01:40:03.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.527+0000 7ff6f17a5640 1 -- 172.21.15.44:0/3002458516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6ec0b0ae0 msgr2=0x7ff6ec0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.527+0000 7ff6f17a5640 1 --2- 172.21.15.44:0/3002458516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6ec0b0ae0 0x7ff6ec0ce370 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00097a0 tx=0x7ff6e002dae0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.527+0000 7ff6f17a5640 1 -- 172.21.15.44:0/3002458516 shutdown_connections 2023-11-04T01:40:03.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.527+0000 7ff6f17a5640 1 --2- 172.21.15.44:0/3002458516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6ec0b0ae0 0x7ff6ec0ce370 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.527+0000 7ff6f17a5640 1 -- 172.21.15.44:0/3002458516 >> 172.21.15.44:0/3002458516 conn(0x7ff6ec0ce950 msgr2=0x7ff6ec0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.527+0000 7ff6f17a5640 1 -- 172.21.15.44:0/3002458516 shutdown_connections 2023-11-04T01:40:03.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.527+0000 7ff6f17a5640 1 -- 172.21.15.44:0/3002458516 wait complete. 2023-11-04T01:40:03.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.528+0000 7ff6f17a5640 1 Processor -- start 2023-11-04T01:40:03.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.528+0000 7ff6f17a5640 1 -- start start 2023-11-04T01:40:03.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.529+0000 7ff6f17a5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6ec06db20 0x7ff6ec0ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.529+0000 7ff6f17a5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6ec0b0ae0 0x7ff6ec1f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.529+0000 7ff6f17a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6ec159c70 0x7ff6ec14f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.529+0000 7ff6f17a5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec0ac8c0 con 0x7ff6ec159c70 2023-11-04T01:40:03.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.529+0000 7ff6f17a5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec1f2c70 con 0x7ff6ec0b0ae0 2023-11-04T01:40:03.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.529+0000 7ff6f17a5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec1f2f00 con 0x7ff6ec06db20 2023-11-04T01:40:03.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.529+0000 7ff6eb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6ec159c70 0x7ff6ec14f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.529+0000 7ff6eb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6ec159c70 0x7ff6ec14f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59006/0 (socket says 172.21.15.44:59006) 2023-11-04T01:40:03.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.529+0000 7ff6eb7fe640 1 -- 172.21.15.44:0/675509782 learned_addr learned my addr 172.21.15.44:0/675509782 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:03.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.530+0000 7ff6eb7fe640 1 -- 172.21.15.44:0/675509782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6ec06db20 msgr2=0x7ff6ec0ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.530+0000 7ff6eb7fe640 1 --2- 172.21.15.44:0/675509782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6ec06db20 0x7ff6ec0ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.530+0000 7ff6eb7fe640 1 -- 172.21.15.44:0/675509782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6ec0b0ae0 msgr2=0x7ff6ec1f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.530+0000 7ff6ea7fc640 1 --2- 172.21.15.44:0/675509782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6ec0b0ae0 0x7ff6ec1f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.530+0000 7ff6eb7fe640 1 --2- 172.21.15.44:0/675509782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6ec0b0ae0 0x7ff6ec1f2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.530+0000 7ff6eb7fe640 1 -- 172.21.15.44:0/675509782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0009400 con 0x7ff6ec159c70 2023-11-04T01:40:03.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.530+0000 7ff6eb7fe640 1 --2- 172.21.15.44:0/675509782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6ec159c70 0x7ff6ec14f080 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400c780 tx=0x7ff6e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.530+0000 7ff6d37fe640 1 -- 172.21.15.44:0/675509782 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4004b60 con 0x7ff6ec159c70 2023-11-04T01:40:03.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.530+0000 7ff6d37fe640 1 -- 172.21.15.44:0/675509782 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e400ce90 con 0x7ff6ec159c70 2023-11-04T01:40:03.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.530+0000 7ff6f17a5640 1 -- 172.21.15.44:0/675509782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ec1f31e0 con 0x7ff6ec159c70 2023-11-04T01:40:03.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.530+0000 7ff6d37fe640 1 -- 172.21.15.44:0/675509782 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e400a850 con 0x7ff6ec159c70 2023-11-04T01:40:03.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.530+0000 7ff6f17a5640 1 -- 172.21.15.44:0/675509782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ec1f37a0 con 0x7ff6ec159c70 2023-11-04T01:40:03.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.531+0000 7ff6f17a5640 1 -- 172.21.15.44:0/675509782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ec1f3990 con 0x7ff6ec159c70 2023-11-04T01:40:03.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.531+0000 7ff6d37fe640 1 -- 172.21.15.44:0/675509782 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6e400a9b0 con 0x7ff6ec159c70 2023-11-04T01:40:03.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.532+0000 7ff6d37fe640 1 --2- 172.21.15.44:0/675509782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6d806ae70 0x7ff6d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.532+0000 7ff6d37fe640 1 -- 172.21.15.44:0/675509782 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7ff6e4089d90 con 0x7ff6ec159c70 2023-11-04T01:40:03.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.532+0000 7ff6eaffd640 1 --2- 172.21.15.44:0/675509782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6d806ae70 0x7ff6d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.533+0000 7ff6eaffd640 1 --2- 172.21.15.44:0/675509782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6d806ae70 0x7ff6d806d330 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc000f60 tx=0x7ff6dc007a80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.536+0000 7ff6d37fe640 1 -- 172.21.15.44:0/675509782 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff6e40548a0 con 0x7ff6ec159c70 2023-11-04T01:40:03.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.748+0000 7ff6f17a5640 1 -- 172.21.15.44:0/675509782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6ec074290 con 0x7ff6ec159c70 2023-11-04T01:40:03.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.748+0000 7ff6d37fe640 1 -- 172.21.15.44:0/675509782 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4933 (secure 0 0 0) 0x7ff6e4057ec0 con 0x7ff6ec159c70 2023-11-04T01:40:03.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:03.750 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:39:52.071527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6836/2461924520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2461924520},{"type":"v1","addr":"172.21.15.204:6836","nonce":2461924520}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 52 2023-11-04T01:40:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.750+0000 7ff6f17a5640 1 -- 172.21.15.44:0/675509782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6d806ae70 msgr2=0x7ff6d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.750+0000 7ff6f17a5640 1 --2- 172.21.15.44:0/675509782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6d806ae70 0x7ff6d806d330 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc000f60 tx=0x7ff6dc007a80 comp rx=0 tx=0).stop 2023-11-04T01:40:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.750+0000 7ff6f17a5640 1 -- 172.21.15.44:0/675509782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6ec159c70 msgr2=0x7ff6ec14f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.750+0000 7ff6f17a5640 1 --2- 172.21.15.44:0/675509782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6ec159c70 0x7ff6ec14f080 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400c780 tx=0x7ff6e400cc40 comp rx=0 tx=0).stop 2023-11-04T01:40:03.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.750+0000 7ff6f17a5640 1 -- 172.21.15.44:0/675509782 shutdown_connections 2023-11-04T01:40:03.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.750+0000 7ff6f17a5640 1 --2- 172.21.15.44:0/675509782 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6d806ae70 0x7ff6d806d330 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.750+0000 7ff6f17a5640 1 --2- 172.21.15.44:0/675509782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6ec159c70 0x7ff6ec14f080 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.750+0000 7ff6f17a5640 1 --2- 172.21.15.44:0/675509782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6ec0b0ae0 0x7ff6ec1f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.750+0000 7ff6f17a5640 1 --2- 172.21.15.44:0/675509782 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6ec06db20 0x7ff6ec0ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.750+0000 7ff6f17a5640 1 -- 172.21.15.44:0/675509782 >> 172.21.15.44:0/675509782 conn(0x7ff6ec0ce950 msgr2=0x7ff6ec0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.750+0000 7ff6f17a5640 1 -- 172.21.15.44:0/675509782 shutdown_connections 2023-11-04T01:40:03.754 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:03.750+0000 7ff6f17a5640 1 -- 172.21.15.44:0/675509782 wait complete. 2023-11-04T01:40:03.762 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:06.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~13s 2023-11-04T01:40:08.763 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:08.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.881+0000 7fdadce89640 1 Processor -- start 2023-11-04T01:40:08.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.882+0000 7fdadce89640 1 -- start start 2023-11-04T01:40:08.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.882+0000 7fdadce89640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdad815ce70 0x7fdad806d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.882+0000 7fdadce89640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad806a120 con 0x7fdad815d250 2023-11-04T01:40:08.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.882+0000 7fdadce89640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad806def0 con 0x7fdad80cb5c0 2023-11-04T01:40:08.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.882+0000 7fdadce89640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad80cdc10 con 0x7fdad815ce70 2023-11-04T01:40:08.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad5d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdad815d250 0x7fdad80c9830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57872/0 (socket says 172.21.15.44:57872) 2023-11-04T01:40:08.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad5d9b640 1 -- 172.21.15.44:0/1081197989 learned_addr learned my addr 172.21.15.44:0/1081197989 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:08.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad659c640 1 --2- 172.21.15.44:0/1081197989 >> v2:172.21.15.204:3300/0 conn(0x7fdad815ce70 0x7fdad806d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad559a640 1 -- 172.21.15.44:0/1081197989 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175982546 0 0) 0x7fdad806a120 con 0x7fdad815d250 2023-11-04T01:40:08.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad559a640 1 -- 172.21.15.44:0/1081197989 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac0003520 con 0x7fdad815d250 2023-11-04T01:40:08.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad559a640 1 -- 172.21.15.44:0/1081197989 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1539707273 0 0) 0x7fdac0003520 con 0x7fdad815d250 2023-11-04T01:40:08.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad559a640 1 -- 172.21.15.44:0/1081197989 >> v2:172.21.15.204:3300/0 conn(0x7fdad815ce70 msgr2=0x7fdad806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:08.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad559a640 1 --2- 172.21.15.44:0/1081197989 >> v2:172.21.15.204:3300/0 conn(0x7fdad815ce70 0x7fdad806d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad559a640 1 -- 172.21.15.44:0/1081197989 >> v1:172.21.15.204:6789/0 conn(0x7fdad80cb5c0 legacy=0x7fdad80ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad559a640 1 -- 172.21.15.44:0/1081197989 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad80c9f40 con 0x7fdad815d250 2023-11-04T01:40:08.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad559a640 1 -- 172.21.15.44:0/1081197989 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fdacc001670 con 0x7fdad815d250 2023-11-04T01:40:08.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad559a640 1 -- 172.21.15.44:0/1081197989 >> v1:172.21.15.44:6789/0 conn(0x7fdad815d250 legacy=0x7fdad80c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad559a640 1 --2- 172.21.15.44:0/1081197989 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdac0003970 0x7fdac0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad559a640 1 --2- 172.21.15.44:0/1081197989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdac00047c0 0x7fdac0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad559a640 1 --2- 172.21.15.44:0/1081197989 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdac0005180 0x7fdac000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad559a640 1 -- 172.21.15.44:0/1081197989 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad80cdc10 con 0x7fdac00047c0 2023-11-04T01:40:08.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad559a640 1 -- 172.21.15.44:0/1081197989 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac000c020 con 0x7fdac0005180 2023-11-04T01:40:08.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.883+0000 7fdad559a640 1 -- 172.21.15.44:0/1081197989 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac000c1e0 con 0x7fdac0003970 2023-11-04T01:40:08.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.884+0000 7fdad5d9b640 1 --2- 172.21.15.44:0/1081197989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdac00047c0 0x7fdac0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.884+0000 7fdad6d9d640 1 --2- 172.21.15.44:0/1081197989 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdac0005180 0x7fdac000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.884+0000 7fdad659c640 1 --2- 172.21.15.44:0/1081197989 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdac0003970 0x7fdac0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.884+0000 7fdad5d9b640 1 -- 172.21.15.44:0/1081197989 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdac0003970 msgr2=0x7fdac0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:08.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.884+0000 7fdad5d9b640 1 --2- 172.21.15.44:0/1081197989 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdac0003970 0x7fdac0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.884+0000 7fdad5d9b640 1 -- 172.21.15.44:0/1081197989 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdac0005180 msgr2=0x7fdac000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:08.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.884+0000 7fdad5d9b640 1 --2- 172.21.15.44:0/1081197989 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdac0005180 0x7fdac000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.884+0000 7fdad5d9b640 1 -- 172.21.15.44:0/1081197989 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac0003520 con 0x7fdac00047c0 2023-11-04T01:40:08.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.884+0000 7fdad6d9d640 1 -- 172.21.15.44:0/1081197989 reap_dead start 2023-11-04T01:40:08.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.885+0000 7fdad5d9b640 1 --2- 172.21.15.44:0/1081197989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdac00047c0 0x7fdac0004c40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fdacc007fd0 tx=0x7fdac00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36eed3481727a675 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:08.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.885+0000 7fdad559a640 1 -- 172.21.15.44:0/1081197989 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc005ad0 con 0x7fdac00047c0 2023-11-04T01:40:08.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.885+0000 7fdad559a640 1 -- 172.21.15.44:0/1081197989 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc005c30 con 0x7fdac00047c0 2023-11-04T01:40:08.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.885+0000 7fdad559a640 1 -- 172.21.15.44:0/1081197989 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc02cab0 con 0x7fdac00047c0 2023-11-04T01:40:08.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.885+0000 7fdadce89640 1 -- 172.21.15.44:0/1081197989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdac00047c0 msgr2=0x7fdac0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.885+0000 7fdadce89640 1 --2- 172.21.15.44:0/1081197989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdac00047c0 0x7fdac0004c40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fdacc007fd0 tx=0x7fdac00057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.886+0000 7fdadce89640 1 -- 172.21.15.44:0/1081197989 shutdown_connections 2023-11-04T01:40:08.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.886+0000 7fdadce89640 1 --2- 172.21.15.44:0/1081197989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdac00047c0 0x7fdac0004c40 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.886+0000 7fdadce89640 1 -- 172.21.15.44:0/1081197989 >> 172.21.15.44:0/1081197989 conn(0x7fdad80b0cd0 msgr2=0x7fdad80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:08.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.886+0000 7fdadce89640 1 -- 172.21.15.44:0/1081197989 shutdown_connections 2023-11-04T01:40:08.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.886+0000 7fdadce89640 1 -- 172.21.15.44:0/1081197989 wait complete. 2023-11-04T01:40:08.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.887+0000 7fdadce89640 1 Processor -- start 2023-11-04T01:40:08.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.887+0000 7fdadce89640 1 -- start start 2023-11-04T01:40:08.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdadce89640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdac00047c0 0x7fdad81588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdadce89640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdad8157a50 0x7fdad8158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdadce89640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad8155390 0x7fdad8155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdadce89640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad8155d60 con 0x7fdac00047c0 2023-11-04T01:40:08.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdadce89640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad80c7cb0 con 0x7fdad8157a50 2023-11-04T01:40:08.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdadce89640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad80c70a0 con 0x7fdad8155390 2023-11-04T01:40:08.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdad659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdac00047c0 0x7fdad81588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdad659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdac00047c0 0x7fdad81588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59022/0 (socket says 172.21.15.44:59022) 2023-11-04T01:40:08.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdad659c640 1 -- 172.21.15.44:0/695261462 learned_addr learned my addr 172.21.15.44:0/695261462 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:08.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdad6d9d640 1 --2- 172.21.15.44:0/695261462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad8155390 0x7fdad8155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdad5d9b640 1 --2- 172.21.15.44:0/695261462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdad8157a50 0x7fdad8158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdad659c640 1 -- 172.21.15.44:0/695261462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad8155390 msgr2=0x7fdad8155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdad659c640 1 --2- 172.21.15.44:0/695261462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad8155390 0x7fdad8155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdad659c640 1 -- 172.21.15.44:0/695261462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdad8157a50 msgr2=0x7fdad8158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdad659c640 1 --2- 172.21.15.44:0/695261462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdad8157a50 0x7fdad8158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdad659c640 1 -- 172.21.15.44:0/695261462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad80c7380 con 0x7fdac00047c0 2023-11-04T01:40:08.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdad6d9d640 1 --2- 172.21.15.44:0/695261462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad8155390 0x7fdad8155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:08.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.888+0000 7fdad659c640 1 --2- 172.21.15.44:0/695261462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdac00047c0 0x7fdad81588d0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fdad0011a70 tx=0x7fdad0011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:08.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.889+0000 7fdac6ffd640 1 -- 172.21.15.44:0/695261462 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad0009680 con 0x7fdac00047c0 2023-11-04T01:40:08.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.889+0000 7fdac6ffd640 1 -- 172.21.15.44:0/695261462 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad000fb50 con 0x7fdac00047c0 2023-11-04T01:40:08.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.889+0000 7fdadce89640 1 -- 172.21.15.44:0/695261462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad80c7660 con 0x7fdac00047c0 2023-11-04T01:40:08.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.889+0000 7fdac6ffd640 1 -- 172.21.15.44:0/695261462 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad000fee0 con 0x7fdac00047c0 2023-11-04T01:40:08.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.889+0000 7fdadce89640 1 -- 172.21.15.44:0/695261462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad80c6cc0 con 0x7fdac00047c0 2023-11-04T01:40:08.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.890+0000 7fdadce89640 1 -- 172.21.15.44:0/695261462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad8074290 con 0x7fdac00047c0 2023-11-04T01:40:08.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.890+0000 7fdac6ffd640 1 -- 172.21.15.44:0/695261462 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdad0014440 con 0x7fdac00047c0 2023-11-04T01:40:08.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.891+0000 7fdac6ffd640 1 --2- 172.21.15.44:0/695261462 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdab806aea0 0x7fdab806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.891+0000 7fdac6ffd640 1 -- 172.21.15.44:0/695261462 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7fdad008a4e0 con 0x7fdac00047c0 2023-11-04T01:40:08.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.891+0000 7fdad5d9b640 1 --2- 172.21.15.44:0/695261462 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdab806aea0 0x7fdab806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.892+0000 7fdad5d9b640 1 --2- 172.21.15.44:0/695261462 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdab806aea0 0x7fdab806d360 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdacc034000 tx=0x7fdacc009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:08.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:08.895+0000 7fdac6ffd640 1 -- 172.21.15.44:0/695261462 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdad0054ff0 con 0x7fdac00047c0 2023-11-04T01:40:09.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:09.105+0000 7fdadce89640 1 -- 172.21.15.44:0/695261462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdad8066170 con 0x7fdac00047c0 2023-11-04T01:40:09.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:09.105+0000 7fdac6ffd640 1 -- 172.21.15.44:0/695261462 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fdad0058610 con 0x7fdac00047c0 2023-11-04T01:40:09.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:09.106 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:39:52.071527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6836/2461924520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2461924520},{"type":"v1","addr":"172.21.15.204:6836","nonce":2461924520}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:09.107 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 52 2023-11-04T01:40:09.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:09.107+0000 7fdadce89640 1 -- 172.21.15.44:0/695261462 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdab806aea0 msgr2=0x7fdab806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:09.107+0000 7fdadce89640 1 --2- 172.21.15.44:0/695261462 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdab806aea0 0x7fdab806d360 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdacc034000 tx=0x7fdacc009030 comp rx=0 tx=0).stop 2023-11-04T01:40:09.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:09.107+0000 7fdadce89640 1 -- 172.21.15.44:0/695261462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdac00047c0 msgr2=0x7fdad81588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:09.107+0000 7fdadce89640 1 --2- 172.21.15.44:0/695261462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdac00047c0 0x7fdad81588d0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fdad0011a70 tx=0x7fdad0011f30 comp rx=0 tx=0).stop 2023-11-04T01:40:09.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:09.107+0000 7fdadce89640 1 -- 172.21.15.44:0/695261462 shutdown_connections 2023-11-04T01:40:09.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:09.107+0000 7fdadce89640 1 --2- 172.21.15.44:0/695261462 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdab806aea0 0x7fdab806d360 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:09.107+0000 7fdadce89640 1 --2- 172.21.15.44:0/695261462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdad8155390 0x7fdad8155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:09.107+0000 7fdadce89640 1 --2- 172.21.15.44:0/695261462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdad8157a50 0x7fdad8158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:09.107+0000 7fdadce89640 1 --2- 172.21.15.44:0/695261462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdac00047c0 0x7fdad81588d0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:09.107+0000 7fdadce89640 1 -- 172.21.15.44:0/695261462 >> 172.21.15.44:0/695261462 conn(0x7fdad80b0cd0 msgr2=0x7fdad80ca130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:09.107+0000 7fdadce89640 1 -- 172.21.15.44:0/695261462 shutdown_connections 2023-11-04T01:40:09.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:09.107+0000 7fdadce89640 1 -- 172.21.15.44:0/695261462 wait complete. 2023-11-04T01:40:09.119 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:13.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~20s 2023-11-04T01:40:14.120 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:14.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.239+0000 7fb7f9df5640 1 Processor -- start 2023-11-04T01:40:14.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.239+0000 7fb7f9df5640 1 -- start start 2023-11-04T01:40:14.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.239+0000 7fb7f9df5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7f40ce370 0x7fb7f406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.239+0000 7fb7f9df5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f406e060 con 0x7fb7f40b0ae0 2023-11-04T01:40:14.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.239+0000 7fb7f9df5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f40b4110 con 0x7fb7f4159c70 2023-11-04T01:40:14.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.239+0000 7fb7f9df5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f40b49b0 con 0x7fb7f40ce370 2023-11-04T01:40:14.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.240+0000 7fb7f3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7f40ce370 0x7fb7f406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.240+0000 7fb7f2ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb7f40b0ae0 0x7fb7f415d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41308/0 (socket says 172.21.15.44:41308) 2023-11-04T01:40:14.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.240+0000 7fb7f2ffd640 1 -- 172.21.15.44:0/1261844239 learned_addr learned my addr 172.21.15.44:0/1261844239 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:14.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.240+0000 7fb7f3fff640 1 -- 172.21.15.44:0/1261844239 >> v1:172.21.15.204:6789/0 conn(0x7fb7f4159c70 legacy=0x7fb7f40b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.240+0000 7fb7f3fff640 1 -- 172.21.15.44:0/1261844239 >> v1:172.21.15.44:6789/0 conn(0x7fb7f40b0ae0 legacy=0x7fb7f415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.240+0000 7fb7f3fff640 1 -- 172.21.15.44:0/1261844239 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f40b43f0 con 0x7fb7f40ce370 2023-11-04T01:40:14.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.241+0000 7fb7f3fff640 1 --2- 172.21.15.44:0/1261844239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f40ce370 0x7fb7f406db20 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fb7f406e1f0 tx=0x7fb7ec02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8834528e2560de4d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.241+0000 7fb7f27fc640 1 -- 172.21.15.44:0/1261844239 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec02cce0 con 0x7fb7f40ce370 2023-11-04T01:40:14.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.241+0000 7fb7f27fc640 1 -- 172.21.15.44:0/1261844239 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec02ce40 con 0x7fb7f40ce370 2023-11-04T01:40:14.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.241+0000 7fb7f27fc640 1 -- 172.21.15.44:0/1261844239 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec034660 con 0x7fb7f40ce370 2023-11-04T01:40:14.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.241+0000 7fb7f9df5640 1 -- 172.21.15.44:0/1261844239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f40ce370 msgr2=0x7fb7f406db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.241+0000 7fb7f9df5640 1 --2- 172.21.15.44:0/1261844239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f40ce370 0x7fb7f406db20 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fb7f406e1f0 tx=0x7fb7ec02bf30 comp rx=0 tx=0).stop 2023-11-04T01:40:14.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.241+0000 7fb7f9df5640 1 -- 172.21.15.44:0/1261844239 shutdown_connections 2023-11-04T01:40:14.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.241+0000 7fb7f9df5640 1 --2- 172.21.15.44:0/1261844239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f40ce370 0x7fb7f406db20 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.242+0000 7fb7f9df5640 1 -- 172.21.15.44:0/1261844239 >> 172.21.15.44:0/1261844239 conn(0x7fb7f40ce950 msgr2=0x7fb7f40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.242+0000 7fb7f9df5640 1 -- 172.21.15.44:0/1261844239 shutdown_connections 2023-11-04T01:40:14.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.242+0000 7fb7f9df5640 1 -- 172.21.15.44:0/1261844239 wait complete. 2023-11-04T01:40:14.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.243+0000 7fb7f9df5640 1 Processor -- start 2023-11-04T01:40:14.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.243+0000 7fb7f9df5640 1 -- start start 2023-11-04T01:40:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f9df5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7f40b0ae0 0x7fb7f40c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f9df5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7f40ce370 0x7fb7f40c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f9df5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f4159c70 0x7fb7f4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f9df5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40ce7e0 con 0x7fb7f4159c70 2023-11-04T01:40:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f9df5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f415a180 con 0x7fb7f40b0ae0 2023-11-04T01:40:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f9df5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f415a460 con 0x7fb7f40ce370 2023-11-04T01:40:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f4159c70 0x7fb7f4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f4159c70 0x7fb7f4070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48108/0 (socket says 172.21.15.44:48108) 2023-11-04T01:40:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f3fff640 1 -- 172.21.15.44:0/2605946261 learned_addr learned my addr 172.21.15.44:0/2605946261 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f37fe640 1 --2- 172.21.15.44:0/2605946261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7f40b0ae0 0x7fb7f40c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f2ffd640 1 --2- 172.21.15.44:0/2605946261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7f40ce370 0x7fb7f40c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f3fff640 1 -- 172.21.15.44:0/2605946261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7f40ce370 msgr2=0x7fb7f40c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f3fff640 1 --2- 172.21.15.44:0/2605946261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7f40ce370 0x7fb7f40c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f3fff640 1 -- 172.21.15.44:0/2605946261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7f40b0ae0 msgr2=0x7fb7f40c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f3fff640 1 --2- 172.21.15.44:0/2605946261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7f40b0ae0 0x7fb7f40c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.244+0000 7fb7f3fff640 1 -- 172.21.15.44:0/2605946261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec009a70 con 0x7fb7f4159c70 2023-11-04T01:40:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.245+0000 7fb7f3fff640 1 --2- 172.21.15.44:0/2605946261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f4159c70 0x7fb7f4070630 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009d60 tx=0x7fb7ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.245+0000 7fb7dbfff640 1 -- 172.21.15.44:0/2605946261 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec03d600 con 0x7fb7f4159c70 2023-11-04T01:40:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.245+0000 7fb7dbfff640 1 -- 172.21.15.44:0/2605946261 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec03d760 con 0x7fb7f4159c70 2023-11-04T01:40:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.245+0000 7fb7f9df5640 1 -- 172.21.15.44:0/2605946261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f415a740 con 0x7fb7f4159c70 2023-11-04T01:40:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.245+0000 7fb7dbfff640 1 -- 172.21.15.44:0/2605946261 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec03db10 con 0x7fb7f4159c70 2023-11-04T01:40:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.245+0000 7fb7f9df5640 1 -- 172.21.15.44:0/2605946261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f415ad00 con 0x7fb7f4159c70 2023-11-04T01:40:14.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.246+0000 7fb7f9df5640 1 -- 172.21.15.44:0/2605946261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f415aef0 con 0x7fb7f4159c70 2023-11-04T01:40:14.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.246+0000 7fb7dbfff640 1 -- 172.21.15.44:0/2605946261 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb7ec03b040 con 0x7fb7f4159c70 2023-11-04T01:40:14.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.247+0000 7fb7dbfff640 1 --2- 172.21.15.44:0/2605946261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb7e006ae70 0x7fb7e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.247+0000 7fb7dbfff640 1 -- 172.21.15.44:0/2605946261 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7fb7ec0abe10 con 0x7fb7f4159c70 2023-11-04T01:40:14.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.247+0000 7fb7f37fe640 1 --2- 172.21.15.44:0/2605946261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb7e006ae70 0x7fb7e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.248+0000 7fb7f37fe640 1 --2- 172.21.15.44:0/2605946261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb7e006ae70 0x7fb7e006d330 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4000f60 tx=0x7fb7e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.251+0000 7fb7dbfff640 1 -- 172.21.15.44:0/2605946261 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb7ec076a70 con 0x7fb7f4159c70 2023-11-04T01:40:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.467+0000 7fb7f9df5640 1 -- 172.21.15.44:0/2605946261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7f4074290 con 0x7fb7f4159c70 2023-11-04T01:40:14.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.468+0000 7fb7dbfff640 1 -- 172.21.15.44:0/2605946261 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4981 (secure 0 0 0) 0x7fb7ec039090 con 0x7fb7f4159c70 2023-11-04T01:40:14.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:14.470 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:09.206118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6836/2461924520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2461924520},{"type":"v1","addr":"172.21.15.204:6836","nonce":2461924520}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:40:09.206118+0000","export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:14.470 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 53 2023-11-04T01:40:14.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.470+0000 7fb7f9df5640 1 -- 172.21.15.44:0/2605946261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb7e006ae70 msgr2=0x7fb7e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.470+0000 7fb7f9df5640 1 --2- 172.21.15.44:0/2605946261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb7e006ae70 0x7fb7e006d330 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4000f60 tx=0x7fb7e4009040 comp rx=0 tx=0).stop 2023-11-04T01:40:14.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.470+0000 7fb7f9df5640 1 -- 172.21.15.44:0/2605946261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f4159c70 msgr2=0x7fb7f4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.470+0000 7fb7f9df5640 1 --2- 172.21.15.44:0/2605946261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f4159c70 0x7fb7f4070630 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009d60 tx=0x7fb7ec004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:14.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.470+0000 7fb7f9df5640 1 -- 172.21.15.44:0/2605946261 shutdown_connections 2023-11-04T01:40:14.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.470+0000 7fb7f9df5640 1 --2- 172.21.15.44:0/2605946261 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb7e006ae70 0x7fb7e006d330 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.470+0000 7fb7f9df5640 1 --2- 172.21.15.44:0/2605946261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f4159c70 0x7fb7f4070630 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.470+0000 7fb7f9df5640 1 --2- 172.21.15.44:0/2605946261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7f40ce370 0x7fb7f40c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.470+0000 7fb7f9df5640 1 --2- 172.21.15.44:0/2605946261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7f40b0ae0 0x7fb7f40c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.470+0000 7fb7f9df5640 1 -- 172.21.15.44:0/2605946261 >> 172.21.15.44:0/2605946261 conn(0x7fb7f40ce950 msgr2=0x7fb7f40cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.470+0000 7fb7f9df5640 1 -- 172.21.15.44:0/2605946261 shutdown_connections 2023-11-04T01:40:14.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.470+0000 7fb7f9df5640 1 -- 172.21.15.44:0/2605946261 wait complete. 2023-11-04T01:40:14.482 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-04T01:40:14.483 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:40:14.514 INFO:teuthology.orchestra.run.smithi204.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:40:14.515 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:40:14.516 DEBUG:teuthology.orchestra.run.smithi204:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:40:14.590 INFO:teuthology.orchestra.run.smithi204.stdout:1699061992.126448.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i d', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:40:14.592 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699061992.126448.core'] 2023-11-04T01:40:14.592 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699061992.126448.core, deleting it 2023-11-04T01:40:14.592 DEBUG:teuthology.orchestra.run.smithi204:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699061992.126448.core 2023-11-04T01:40:14.663 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:40:14.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.769+0000 7f5be050c640 1 Processor -- start 2023-11-04T01:40:14.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.770+0000 7f5be050c640 1 -- start start 2023-11-04T01:40:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.770+0000 7f5be050c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bd8160430 0x7f5bd80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.770+0000 7f5be050c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5bd806c3a0 0x7f5bd80cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.770+0000 7f5be050c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd80b2fc0 con 0x7f5bd80b2b60 2023-11-04T01:40:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.770+0000 7f5be050c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd80cb580 con 0x7f5bd806c3a0 2023-11-04T01:40:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.770+0000 7f5be050c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd806ca40 con 0x7f5bd8160430 2023-11-04T01:40:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.771+0000 7f5bdeaa9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5bd806c3a0 0x7f5bd80cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.771+0000 7f5bdeaa9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5bd806c3a0 0x7f5bd80cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48122/0 (socket says 172.21.15.44:48122) 2023-11-04T01:40:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.771+0000 7f5bdeaa9640 1 -- 172.21.15.44:0/4062305193 learned_addr learned my addr 172.21.15.44:0/4062305193 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.771+0000 7f5bde2a8640 1 --2- 172.21.15.44:0/4062305193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bd8160430 0x7f5bd80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.771+0000 7f5bdeaa9640 1 -- 172.21.15.44:0/4062305193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bd8160430 msgr2=0x7f5bd80b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.771+0000 7f5bdeaa9640 1 --2- 172.21.15.44:0/4062305193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bd8160430 0x7f5bd80b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.771+0000 7f5bdeaa9640 1 -- 172.21.15.44:0/4062305193 >> v1:172.21.15.204:6789/0 conn(0x7f5bd80b2b60 legacy=0x7f5bd806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.771+0000 7f5bdeaa9640 1 -- 172.21.15.44:0/4062305193 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd806c810 con 0x7f5bd806c3a0 2023-11-04T01:40:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.771+0000 7f5bde2a8640 1 --2- 172.21.15.44:0/4062305193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bd8160430 0x7f5bd80b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.772+0000 7f5bdeaa9640 1 --2- 172.21.15.44:0/4062305193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bd806c3a0 0x7f5bd80cbcb0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009e50 tx=0x7f5bd002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a80b9c5e8485ed9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.772+0000 7f5bdd2a6640 1 -- 172.21.15.44:0/4062305193 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd002cb00 con 0x7f5bd806c3a0 2023-11-04T01:40:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.772+0000 7f5bdd2a6640 1 -- 172.21.15.44:0/4062305193 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd002cc60 con 0x7f5bd806c3a0 2023-11-04T01:40:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.772+0000 7f5bdd2a6640 1 -- 172.21.15.44:0/4062305193 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00343f0 con 0x7f5bd806c3a0 2023-11-04T01:40:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.772+0000 7f5be050c640 1 -- 172.21.15.44:0/4062305193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bd806c3a0 msgr2=0x7f5bd80cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.772+0000 7f5be050c640 1 --2- 172.21.15.44:0/4062305193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bd806c3a0 0x7f5bd80cbcb0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009e50 tx=0x7f5bd002bf60 comp rx=0 tx=0).stop 2023-11-04T01:40:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.772+0000 7f5be050c640 1 -- 172.21.15.44:0/4062305193 shutdown_connections 2023-11-04T01:40:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.772+0000 7f5be050c640 1 --2- 172.21.15.44:0/4062305193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bd806c3a0 0x7f5bd80cbcb0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.772+0000 7f5be050c640 1 --2- 172.21.15.44:0/4062305193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bd8160430 0x7f5bd80b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.772+0000 7f5be050c640 1 -- 172.21.15.44:0/4062305193 >> 172.21.15.44:0/4062305193 conn(0x7f5bd806ea20 msgr2=0x7f5bd806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.772+0000 7f5be050c640 1 -- 172.21.15.44:0/4062305193 shutdown_connections 2023-11-04T01:40:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.773+0000 7f5be050c640 1 -- 172.21.15.44:0/4062305193 wait complete. 2023-11-04T01:40:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.774+0000 7f5be050c640 1 Processor -- start 2023-11-04T01:40:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.774+0000 7f5be050c640 1 -- start start 2023-11-04T01:40:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.774+0000 7f5be050c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bd806c3a0 0x7f5bd80c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.774+0000 7f5be050c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bd80b2b60 0x7f5bd80b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.774+0000 7f5be050c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5bd8160430 0x7f5bd8151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.774+0000 7f5be050c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd815b8e0 con 0x7f5bd80b2b60 2023-11-04T01:40:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.774+0000 7f5be050c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd8152460 con 0x7f5bd8160430 2023-11-04T01:40:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.774+0000 7f5be050c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80b4e30 con 0x7f5bd806c3a0 2023-11-04T01:40:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5bddaa7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bd80b2b60 0x7f5bd80b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5bde2a8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bd806c3a0 0x7f5bd80c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5bde2a8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bd806c3a0 0x7f5bd80c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:34376/0 (socket says 172.21.15.44:34376) 2023-11-04T01:40:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5bde2a8640 1 -- 172.21.15.44:0/309361722 learned_addr learned my addr 172.21.15.44:0/309361722 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5bddaa7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bd80b2b60 0x7f5bd80b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48138/0 (socket says 172.21.15.44:48138) 2023-11-04T01:40:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5bdeaa9640 1 --2- 172.21.15.44:0/309361722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5bd8160430 0x7f5bd8151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5bddaa7640 1 -- 172.21.15.44:0/309361722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bd806c3a0 msgr2=0x7f5bd80c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5bddaa7640 1 --2- 172.21.15.44:0/309361722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bd806c3a0 0x7f5bd80c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5bddaa7640 1 -- 172.21.15.44:0/309361722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5bd8160430 msgr2=0x7f5bd8151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5bddaa7640 1 --2- 172.21.15.44:0/309361722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5bd8160430 0x7f5bd8151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5bddaa7640 1 -- 172.21.15.44:0/309361722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd0009b30 con 0x7f5bd80b2b60 2023-11-04T01:40:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5bddaa7640 1 --2- 172.21.15.44:0/309361722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bd80b2b60 0x7f5bd80b4750 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800c390 tx=0x7f5bc800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5bceffd640 1 -- 172.21.15.44:0/309361722 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc80052d0 con 0x7f5bd80b2b60 2023-11-04T01:40:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5bceffd640 1 -- 172.21.15.44:0/309361722 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc8005430 con 0x7f5bd80b2b60 2023-11-04T01:40:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5bceffd640 1 -- 172.21.15.44:0/309361722 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8003830 con 0x7f5bd80b2b60 2023-11-04T01:40:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5be050c640 1 -- 172.21.15.44:0/309361722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd80b5110 con 0x7f5bd80b2b60 2023-11-04T01:40:14.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.775+0000 7f5be050c640 1 -- 172.21.15.44:0/309361722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd80b56d0 con 0x7f5bd80b2b60 2023-11-04T01:40:14.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.776+0000 7f5be050c640 1 -- 172.21.15.44:0/309361722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd8066920 con 0x7f5bd80b2b60 2023-11-04T01:40:14.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.777+0000 7f5bceffd640 1 -- 172.21.15.44:0/309361722 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5bc8003990 con 0x7f5bd80b2b60 2023-11-04T01:40:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.777+0000 7f5bceffd640 1 --2- 172.21.15.44:0/309361722 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5bbc06ae70 0x7f5bbc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.777+0000 7f5bceffd640 1 -- 172.21.15.44:0/309361722 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f5bc8089060 con 0x7f5bd80b2b60 2023-11-04T01:40:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.777+0000 7f5bde2a8640 1 --2- 172.21.15.44:0/309361722 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5bbc06ae70 0x7f5bbc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.778+0000 7f5bde2a8640 1 --2- 172.21.15.44:0/309361722 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5bbc06ae70 0x7f5bbc06d330 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4006d40 tx=0x7f5bd4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:14.782+0000 7f5bceffd640 1 -- 172.21.15.44:0/309361722 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5bc8053c20 con 0x7f5bd80b2b60 2023-11-04T01:40:15.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.030+0000 7f5be050c640 1 -- 172.21.15.44:0/309361722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f5bd8074290 con 0x7f5bd80b2b60 2023-11-04T01:40:15.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.032+0000 7f5bceffd640 1 -- 172.21.15.44:0/309361722 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7359 v54) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5bc8057240 con 0x7f5bd80b2b60 2023-11-04T01:40:15.034 INFO:teuthology.orchestra.run.smithi044.stderr:failed mds gid 7359 2023-11-04T01:40:15.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.034+0000 7f5be050c640 1 -- 172.21.15.44:0/309361722 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5bbc06ae70 msgr2=0x7f5bbc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.034+0000 7f5be050c640 1 --2- 172.21.15.44:0/309361722 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5bbc06ae70 0x7f5bbc06d330 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4006d40 tx=0x7f5bd4008040 comp rx=0 tx=0).stop 2023-11-04T01:40:15.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.034+0000 7f5be050c640 1 -- 172.21.15.44:0/309361722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bd80b2b60 msgr2=0x7f5bd80b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.034+0000 7f5be050c640 1 --2- 172.21.15.44:0/309361722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bd80b2b60 0x7f5bd80b4750 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800c390 tx=0x7f5bc800c850 comp rx=0 tx=0).stop 2023-11-04T01:40:15.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.034+0000 7f5be050c640 1 -- 172.21.15.44:0/309361722 shutdown_connections 2023-11-04T01:40:15.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.034+0000 7f5be050c640 1 --2- 172.21.15.44:0/309361722 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5bbc06ae70 0x7f5bbc06d330 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.034+0000 7f5be050c640 1 --2- 172.21.15.44:0/309361722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5bd8160430 0x7f5bd8151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.034+0000 7f5be050c640 1 --2- 172.21.15.44:0/309361722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bd80b2b60 0x7f5bd80b4750 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.034+0000 7f5be050c640 1 --2- 172.21.15.44:0/309361722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5bd806c3a0 0x7f5bd80c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.034+0000 7f5be050c640 1 -- 172.21.15.44:0/309361722 >> 172.21.15.44:0/309361722 conn(0x7f5bd806ea20 msgr2=0x7f5bd80b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:15.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.034+0000 7f5be050c640 1 -- 172.21.15.44:0/309361722 shutdown_connections 2023-11-04T01:40:15.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.034+0000 7f5be050c640 1 -- 172.21.15.44:0/309361722 wait complete. 2023-11-04T01:40:15.051 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:40:15.051 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:40:15.051 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:40:15.051 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:15.051 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:40:15.051 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi204 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-11-04T01:40:15.052 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:40:15.052 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:40:15.054 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:40:15.055 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:15.131 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2023-11-04T01:40:15.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.159+0000 7f8a71b9e640 1 Processor -- start 2023-11-04T01:40:15.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.159+0000 7f8a71b9e640 1 -- start start 2023-11-04T01:40:15.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.159+0000 7f8a71b9e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8a6c159c70 0x7f8a6c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.159+0000 7f8a71b9e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8a6c0b0ae0 0x7f8a6c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.159+0000 7f8a71b9e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6c0b4110 con 0x7f8a6c06db20 2023-11-04T01:40:15.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.159+0000 7f8a71b9e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6c0b49b0 con 0x7f8a6c159c70 2023-11-04T01:40:15.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.159+0000 7f8a71b9e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6c0b43f0 con 0x7f8a6c0b0ae0 2023-11-04T01:40:15.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.160+0000 7f8a6b7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8a6c159c70 0x7f8a6c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.160+0000 7f8a6affd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8a6c06db20 0x7f8a6c0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41316/0 (socket says 172.21.15.44:41316) 2023-11-04T01:40:15.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.160+0000 7f8a6affd640 1 -- 172.21.15.44:0/2045301685 learned_addr learned my addr 172.21.15.44:0/2045301685 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:15.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.160+0000 7f8a6b7fe640 1 -- 172.21.15.44:0/2045301685 >> v2:172.21.15.204:3300/0 conn(0x7f8a6c0b0ae0 msgr2=0x7f8a6c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:15.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.160+0000 7f8a6bfff640 1 --2- 172.21.15.44:0/2045301685 >> v2:172.21.15.204:3300/0 conn(0x7f8a6c0b0ae0 0x7f8a6c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.160+0000 7f8a6b7fe640 1 --2- 172.21.15.44:0/2045301685 >> v2:172.21.15.204:3300/0 conn(0x7f8a6c0b0ae0 0x7f8a6c15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.160+0000 7f8a6b7fe640 1 -- 172.21.15.44:0/2045301685 >> v1:172.21.15.44:6789/0 conn(0x7f8a6c06db20 legacy=0x7f8a6c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.160+0000 7f8a6a7fc640 1 -- 172.21.15.44:0/2045301685 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200860099 0 0) 0x7f8a6c0b4110 con 0x7f8a6c06db20 2023-11-04T01:40:15.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.160+0000 7f8a6b7fe640 1 -- 172.21.15.44:0/2045301685 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0b46d0 con 0x7f8a6c159c70 2023-11-04T01:40:15.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.160+0000 7f8a6bfff640 1 --2- 172.21.15.44:0/2045301685 >> v2:172.21.15.204:3300/0 conn(0x7f8a6c0b0ae0 0x7f8a6c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:15.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.161+0000 7f8a6b7fe640 1 --2- 172.21.15.44:0/2045301685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c159c70 0x7f8a6c0ce370 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0c5910 tx=0x7f8a5c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34480381f69d4281 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:15.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.161+0000 7f8a6a7fc640 1 -- 172.21.15.44:0/2045301685 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c031830 con 0x7f8a6c159c70 2023-11-04T01:40:15.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.161+0000 7f8a6a7fc640 1 -- 172.21.15.44:0/2045301685 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c031990 con 0x7f8a6c159c70 2023-11-04T01:40:15.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.161+0000 7f8a6a7fc640 1 -- 172.21.15.44:0/2045301685 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c031d20 con 0x7f8a6c159c70 2023-11-04T01:40:15.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.161+0000 7f8a71b9e640 1 -- 172.21.15.44:0/2045301685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c159c70 msgr2=0x7f8a6c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.161+0000 7f8a71b9e640 1 --2- 172.21.15.44:0/2045301685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c159c70 0x7f8a6c0ce370 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0c5910 tx=0x7f8a5c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.161+0000 7f8a71b9e640 1 -- 172.21.15.44:0/2045301685 shutdown_connections 2023-11-04T01:40:15.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.161+0000 7f8a71b9e640 1 --2- 172.21.15.44:0/2045301685 >> v2:172.21.15.204:3300/0 conn(0x7f8a6c0b0ae0 0x7f8a6c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.161+0000 7f8a71b9e640 1 --2- 172.21.15.44:0/2045301685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c159c70 0x7f8a6c0ce370 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.161+0000 7f8a71b9e640 1 -- 172.21.15.44:0/2045301685 >> 172.21.15.44:0/2045301685 conn(0x7f8a6c0ce950 msgr2=0x7f8a6c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:15.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.161+0000 7f8a71b9e640 1 -- 172.21.15.44:0/2045301685 shutdown_connections 2023-11-04T01:40:15.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.161+0000 7f8a71b9e640 1 -- 172.21.15.44:0/2045301685 wait complete. 2023-11-04T01:40:15.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.162+0000 7f8a71b9e640 1 Processor -- start 2023-11-04T01:40:15.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.163+0000 7f8a71b9e640 1 -- start start 2023-11-04T01:40:15.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.163+0000 7f8a71b9e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8a6c06db20 0x7f8a6c0c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.163+0000 7f8a71b9e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0b0ae0 0x7f8a6c148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.163+0000 7f8a71b9e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a6c159c70 0x7f8a6c1507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.163+0000 7f8a71b9e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c157220 con 0x7f8a6c0b0ae0 2023-11-04T01:40:15.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.163+0000 7f8a71b9e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c156bd0 con 0x7f8a6c06db20 2023-11-04T01:40:15.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.163+0000 7f8a71b9e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c1492d0 con 0x7f8a6c159c70 2023-11-04T01:40:15.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.163+0000 7f8a6affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0b0ae0 0x7f8a6c148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.164+0000 7f8a6affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0b0ae0 0x7f8a6c148d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48158/0 (socket says 172.21.15.44:48158) 2023-11-04T01:40:15.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.164+0000 7f8a6affd640 1 -- 172.21.15.44:0/2366515928 learned_addr learned my addr 172.21.15.44:0/2366515928 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:15.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.164+0000 7f8a6b7fe640 1 --2- 172.21.15.44:0/2366515928 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8a6c06db20 0x7f8a6c0c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.164+0000 7f8a6bfff640 1 --2- 172.21.15.44:0/2366515928 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a6c159c70 0x7f8a6c1507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.164+0000 7f8a6affd640 1 -- 172.21.15.44:0/2366515928 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a6c159c70 msgr2=0x7f8a6c1507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.164+0000 7f8a6affd640 1 --2- 172.21.15.44:0/2366515928 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a6c159c70 0x7f8a6c1507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.164+0000 7f8a6affd640 1 -- 172.21.15.44:0/2366515928 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8a6c06db20 msgr2=0x7f8a6c0c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.164+0000 7f8a6affd640 1 --2- 172.21.15.44:0/2366515928 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8a6c06db20 0x7f8a6c0c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.164+0000 7f8a6affd640 1 -- 172.21.15.44:0/2366515928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c009400 con 0x7f8a6c0b0ae0 2023-11-04T01:40:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.164+0000 7f8a6affd640 1 --2- 172.21.15.44:0/2366515928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0b0ae0 0x7f8a6c148d90 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000c430 tx=0x7f8a6000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.164+0000 7f8a53fff640 1 -- 172.21.15.44:0/2366515928 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a600074e0 con 0x7f8a6c0b0ae0 2023-11-04T01:40:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.164+0000 7f8a53fff640 1 -- 172.21.15.44:0/2366515928 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a60007660 con 0x7f8a6c0b0ae0 2023-11-04T01:40:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.164+0000 7f8a71b9e640 1 -- 172.21.15.44:0/2366515928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6c14fbf0 con 0x7f8a6c0b0ae0 2023-11-04T01:40:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.164+0000 7f8a53fff640 1 -- 172.21.15.44:0/2366515928 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a60004a20 con 0x7f8a6c0b0ae0 2023-11-04T01:40:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.164+0000 7f8a71b9e640 1 -- 172.21.15.44:0/2366515928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6c156e40 con 0x7f8a6c0b0ae0 2023-11-04T01:40:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.165+0000 7f8a71b9e640 1 -- 172.21.15.44:0/2366515928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6c157360 con 0x7f8a6c0b0ae0 2023-11-04T01:40:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.166+0000 7f8a53fff640 1 -- 172.21.15.44:0/2366515928 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a60004b80 con 0x7f8a6c0b0ae0 2023-11-04T01:40:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.166+0000 7f8a53fff640 1 --2- 172.21.15.44:0/2366515928 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8a5806aea0 0x7f8a5806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.166+0000 7f8a53fff640 1 -- 172.21.15.44:0/2366515928 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f8a60089990 con 0x7f8a6c0b0ae0 2023-11-04T01:40:15.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.166+0000 7f8a6b7fe640 1 --2- 172.21.15.44:0/2366515928 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8a5806aea0 0x7f8a5806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.167+0000 7f8a6b7fe640 1 --2- 172.21.15.44:0/2366515928 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8a5806aea0 0x7f8a5806d360 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c036000 tx=0x7f8a5c03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:15.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.170+0000 7f8a53fff640 1 -- 172.21.15.44:0/2366515928 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8a6c157360 con 0x7f8a6c0b0ae0 2023-11-04T01:40:15.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.383+0000 7f8a71b9e640 1 -- 172.21.15.44:0/2366515928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a6c157360 con 0x7f8a6c0b0ae0 2023-11-04T01:40:15.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.383+0000 7f8a53fff640 1 -- 172.21.15.44:0/2366515928 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4139 (secure 0 0 0) 0x7f8a6c157360 con 0x7f8a6c0b0ae0 2023-11-04T01:40:15.386 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:15.386 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:15.038890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6562,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6562":{"gid":6562,"name":"a","rank":0,"incarnation":55,"state":"up:replay","state_seq":1,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:15.386 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 55 2023-11-04T01:40:15.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.385+0000 7f8a71b9e640 1 -- 172.21.15.44:0/2366515928 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8a5806aea0 msgr2=0x7f8a5806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.385+0000 7f8a71b9e640 1 --2- 172.21.15.44:0/2366515928 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8a5806aea0 0x7f8a5806d360 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c036000 tx=0x7f8a5c03c040 comp rx=0 tx=0).stop 2023-11-04T01:40:15.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.385+0000 7f8a71b9e640 1 -- 172.21.15.44:0/2366515928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0b0ae0 msgr2=0x7f8a6c148d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.385+0000 7f8a71b9e640 1 --2- 172.21.15.44:0/2366515928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0b0ae0 0x7f8a6c148d90 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000c430 tx=0x7f8a6000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.385+0000 7f8a71b9e640 1 -- 172.21.15.44:0/2366515928 shutdown_connections 2023-11-04T01:40:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.385+0000 7f8a71b9e640 1 --2- 172.21.15.44:0/2366515928 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8a5806aea0 0x7f8a5806d360 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.385+0000 7f8a71b9e640 1 --2- 172.21.15.44:0/2366515928 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a6c159c70 0x7f8a6c1507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.385+0000 7f8a71b9e640 1 --2- 172.21.15.44:0/2366515928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0b0ae0 0x7f8a6c148d90 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.385+0000 7f8a71b9e640 1 --2- 172.21.15.44:0/2366515928 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8a6c06db20 0x7f8a6c0c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.385+0000 7f8a71b9e640 1 -- 172.21.15.44:0/2366515928 >> 172.21.15.44:0/2366515928 conn(0x7f8a6c0ce950 msgr2=0x7f8a6c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.385+0000 7f8a71b9e640 1 -- 172.21.15.44:0/2366515928 shutdown_connections 2023-11-04T01:40:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:15.385+0000 7f8a71b9e640 1 -- 172.21.15.44:0/2366515928 wait complete. 2023-11-04T01:40:15.398 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:40:20.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-04T01:40:20.399 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:20.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.516+0000 7f876d8e0640 1 Processor -- start 2023-11-04T01:40:20.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.516+0000 7f876d8e0640 1 -- start start 2023-11-04T01:40:20.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.517+0000 7f876d8e0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f87680cde60 0x7f876815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.517+0000 7f876d8e0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f87680ce240 0x7f87680d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.517+0000 7f876d8e0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876815e000 con 0x7f876815daa0 2023-11-04T01:40:20.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.517+0000 7f876d8e0640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876815e5c0 con 0x7f87680cde60 2023-11-04T01:40:20.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.517+0000 7f876d8e0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876815e2e0 con 0x7f87680ce240 2023-11-04T01:40:20.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.517+0000 7f8766ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f87680cde60 0x7f876815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.517+0000 7f87667fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f876815daa0 0x7f8768157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41332/0 (socket says 172.21.15.44:41332) 2023-11-04T01:40:20.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.517+0000 7f8766ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f87680cde60 0x7f876815d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48174/0 (socket says 172.21.15.44:48174) 2023-11-04T01:40:20.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.517+0000 7f87667fc640 1 -- 172.21.15.44:0/1043428332 learned_addr learned my addr 172.21.15.44:0/1043428332 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:20.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.518+0000 7f87677fe640 1 --2- 172.21.15.44:0/1043428332 >> v2:172.21.15.204:3300/0 conn(0x7f87680ce240 0x7f87680d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.518+0000 7f8766ffd640 1 -- 172.21.15.44:0/1043428332 >> v2:172.21.15.204:3300/0 conn(0x7f87680ce240 msgr2=0x7f87680d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:20.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.518+0000 7f8766ffd640 1 --2- 172.21.15.44:0/1043428332 >> v2:172.21.15.204:3300/0 conn(0x7f87680ce240 0x7f87680d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.518+0000 7f8766ffd640 1 -- 172.21.15.44:0/1043428332 >> v1:172.21.15.44:6789/0 conn(0x7f876815daa0 legacy=0x7f8768157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.518+0000 7f8765ffb640 1 -- 172.21.15.44:0/1043428332 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781371505 0 0) 0x7f876815e000 con 0x7f876815daa0 2023-11-04T01:40:20.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.518+0000 7f8766ffd640 1 -- 172.21.15.44:0/1043428332 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87680d1120 con 0x7f87680cde60 2023-11-04T01:40:20.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.518+0000 7f87677fe640 1 --2- 172.21.15.44:0/1043428332 >> v2:172.21.15.204:3300/0 conn(0x7f87680ce240 0x7f87680d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:20.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.518+0000 7f8766ffd640 1 --2- 172.21.15.44:0/1043428332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87680cde60 0x7f876815d560 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f87680cf2e0 tx=0x7f876002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1478e69fc8fab9b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.522 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:40:20.519+0000 7fb2a6cea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:20.522 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:40:20.519+0000 7fb2a6cea640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:20.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.519+0000 7f8765ffb640 1 -- 172.21.15.44:0/1043428332 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760031830 con 0x7f87680cde60 2023-11-04T01:40:20.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.519+0000 7f8765ffb640 1 -- 172.21.15.44:0/1043428332 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8760031990 con 0x7f87680cde60 2023-11-04T01:40:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.519+0000 7f8765ffb640 1 -- 172.21.15.44:0/1043428332 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760031d20 con 0x7f87680cde60 2023-11-04T01:40:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.519+0000 7f876d8e0640 1 -- 172.21.15.44:0/1043428332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87680cde60 msgr2=0x7f876815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.519+0000 7f876d8e0640 1 --2- 172.21.15.44:0/1043428332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87680cde60 0x7f876815d560 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f87680cf2e0 tx=0x7f876002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.519+0000 7f876d8e0640 1 -- 172.21.15.44:0/1043428332 shutdown_connections 2023-11-04T01:40:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.519+0000 7f876d8e0640 1 --2- 172.21.15.44:0/1043428332 >> v2:172.21.15.204:3300/0 conn(0x7f87680ce240 0x7f87680d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.519+0000 7f876d8e0640 1 --2- 172.21.15.44:0/1043428332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87680cde60 0x7f876815d560 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.519+0000 7f876d8e0640 1 -- 172.21.15.44:0/1043428332 >> 172.21.15.44:0/1043428332 conn(0x7f8768071f30 msgr2=0x7f87680cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.519+0000 7f876d8e0640 1 -- 172.21.15.44:0/1043428332 shutdown_connections 2023-11-04T01:40:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.519+0000 7f876d8e0640 1 -- 172.21.15.44:0/1043428332 wait complete. 2023-11-04T01:40:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.520+0000 7f876d8e0640 1 Processor -- start 2023-11-04T01:40:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.521+0000 7f876d8e0640 1 -- start start 2023-11-04T01:40:20.525 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.521+0000 7f876d8e0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87680cde60 0x7f87681543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.521+0000 7f876d8e0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87680ce240 0x7f87680b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.521+0000 7f876d8e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f876815daa0 0x7f876815c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.521+0000 7f876d8e0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8768158150 con 0x7f876815daa0 2023-11-04T01:40:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.521+0000 7f876d8e0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8768158430 con 0x7f87680ce240 2023-11-04T01:40:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.521+0000 7f876d8e0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8768158710 con 0x7f87680cde60 2023-11-04T01:40:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f87677fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f876815daa0 0x7f876815c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f87677fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f876815daa0 0x7f876815c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48178/0 (socket says 172.21.15.44:48178) 2023-11-04T01:40:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f87677fe640 1 -- 172.21.15.44:0/499678169 learned_addr learned my addr 172.21.15.44:0/499678169 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f87667fc640 1 --2- 172.21.15.44:0/499678169 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87680ce240 0x7f87680b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f8766ffd640 1 --2- 172.21.15.44:0/499678169 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87680cde60 0x7f87681543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f87677fe640 1 -- 172.21.15.44:0/499678169 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87680cde60 msgr2=0x7f87681543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f87677fe640 1 --2- 172.21.15.44:0/499678169 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87680cde60 0x7f87681543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f87677fe640 1 -- 172.21.15.44:0/499678169 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87680ce240 msgr2=0x7f87680b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f87677fe640 1 --2- 172.21.15.44:0/499678169 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87680ce240 0x7f87680b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f87677fe640 1 -- 172.21.15.44:0/499678169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760009400 con 0x7f876815daa0 2023-11-04T01:40:20.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f87677fe640 1 --2- 172.21.15.44:0/499678169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f876815daa0 0x7f876815c170 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f875800cea0 tx=0x7f875800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f875ffff640 1 -- 172.21.15.44:0/499678169 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8758003b90 con 0x7f876815daa0 2023-11-04T01:40:20.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f875ffff640 1 -- 172.21.15.44:0/499678169 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8758003d10 con 0x7f876815daa0 2023-11-04T01:40:20.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f875ffff640 1 -- 172.21.15.44:0/499678169 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8758004260 con 0x7f876815daa0 2023-11-04T01:40:20.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f876d8e0640 1 -- 172.21.15.44:0/499678169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87681589f0 con 0x7f876815daa0 2023-11-04T01:40:20.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.522+0000 7f876d8e0640 1 -- 172.21.15.44:0/499678169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87681548f0 con 0x7f876815daa0 2023-11-04T01:40:20.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.523+0000 7f876d8e0640 1 -- 172.21.15.44:0/499678169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8768158f10 con 0x7f876815daa0 2023-11-04T01:40:20.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.524+0000 7f875ffff640 1 -- 172.21.15.44:0/499678169 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87580043c0 con 0x7f876815daa0 2023-11-04T01:40:20.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.524+0000 7f875ffff640 1 --2- 172.21.15.44:0/499678169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f874806ae70 0x7f874806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.525+0000 7f875ffff640 1 -- 172.21.15.44:0/499678169 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f875808a490 con 0x7f876815daa0 2023-11-04T01:40:20.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.525+0000 7f8766ffd640 1 --2- 172.21.15.44:0/499678169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f874806ae70 0x7f874806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.525+0000 7f8766ffd640 1 --2- 172.21.15.44:0/499678169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f874806ae70 0x7f874806d330 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8760036000 tx=0x7f876003e040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.529+0000 7f875ffff640 1 -- 172.21.15.44:0/499678169 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8758054ff0 con 0x7f876815daa0 2023-11-04T01:40:20.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.741+0000 7f876d8e0640 1 -- 172.21.15.44:0/499678169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8768074290 con 0x7f876815daa0 2023-11-04T01:40:20.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.742+0000 7f875ffff640 1 -- 172.21.15.44:0/499678169 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f8758058610 con 0x7f876815daa0 2023-11-04T01:40:20.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:20.744 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":59,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6820,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:18.052966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6562,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6562":{"gid":6562,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":17,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:20.744 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 59 2023-11-04T01:40:20.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.743+0000 7f876d8e0640 1 -- 172.21.15.44:0/499678169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f874806ae70 msgr2=0x7f874806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.743+0000 7f876d8e0640 1 --2- 172.21.15.44:0/499678169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f874806ae70 0x7f874806d330 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8760036000 tx=0x7f876003e040 comp rx=0 tx=0).stop 2023-11-04T01:40:20.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.744+0000 7f876d8e0640 1 -- 172.21.15.44:0/499678169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f876815daa0 msgr2=0x7f876815c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.744+0000 7f876d8e0640 1 --2- 172.21.15.44:0/499678169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f876815daa0 0x7f876815c170 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f875800cea0 tx=0x7f875800cf90 comp rx=0 tx=0).stop 2023-11-04T01:40:20.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.744+0000 7f876d8e0640 1 -- 172.21.15.44:0/499678169 shutdown_connections 2023-11-04T01:40:20.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.744+0000 7f876d8e0640 1 --2- 172.21.15.44:0/499678169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f874806ae70 0x7f874806d330 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.744+0000 7f876d8e0640 1 --2- 172.21.15.44:0/499678169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f876815daa0 0x7f876815c170 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.744+0000 7f876d8e0640 1 --2- 172.21.15.44:0/499678169 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87680ce240 0x7f87680b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.744+0000 7f876d8e0640 1 --2- 172.21.15.44:0/499678169 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87680cde60 0x7f87681543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.744+0000 7f876d8e0640 1 -- 172.21.15.44:0/499678169 >> 172.21.15.44:0/499678169 conn(0x7f8768071f30 msgr2=0x7f87680d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:20.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.744+0000 7f876d8e0640 1 -- 172.21.15.44:0/499678169 shutdown_connections 2023-11-04T01:40:20.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.744+0000 7f876d8e0640 1 -- 172.21.15.44:0/499678169 wait complete. 2023-11-04T01:40:20.756 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:40:20.756 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:20.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.860+0000 7fbff7d4c640 1 Processor -- start 2023-11-04T01:40:20.862 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.860+0000 7fbff7d4c640 1 -- start start 2023-11-04T01:40:20.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.861+0000 7fbff7d4c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbff0159c70 0x7fbff00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.861+0000 7fbff7d4c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbff006db20 0x7fbff00b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.864 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.861+0000 7fbff7d4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff00b0910 0x7fbff015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.861+0000 7fbff7d4c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff00b49b0 con 0x7fbff006db20 2023-11-04T01:40:20.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.861+0000 7fbff7d4c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff00b0da0 con 0x7fbff0159c70 2023-11-04T01:40:20.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.861+0000 7fbff7d4c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff00b4110 con 0x7fbff00b0910 2023-11-04T01:40:20.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.861+0000 7fbff52e7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbff006db20 0x7fbff00b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.861+0000 7fbff52e7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbff006db20 0x7fbff00b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48184/0 (socket says 172.21.15.44:48184) 2023-11-04T01:40:20.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.861+0000 7fbff52e7640 1 -- 172.21.15.44:0/1447489061 learned_addr learned my addr 172.21.15.44:0/1447489061 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:20.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.862+0000 7fbff5ae8640 1 --2- 172.21.15.44:0/1447489061 >> v2:172.21.15.204:3300/0 conn(0x7fbff0159c70 0x7fbff00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.862+0000 7fbff62e9640 1 --2- 172.21.15.44:0/1447489061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff00b0910 0x7fbff015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.862+0000 7fbff52e7640 1 -- 172.21.15.44:0/1447489061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff00b0910 msgr2=0x7fbff015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:20.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.862+0000 7fbff52e7640 1 --2- 172.21.15.44:0/1447489061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff00b0910 0x7fbff015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.865 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.862+0000 7fbff52e7640 1 -- 172.21.15.44:0/1447489061 >> v2:172.21.15.204:3300/0 conn(0x7fbff0159c70 msgr2=0x7fbff00ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:20.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.862+0000 7fbff52e7640 1 --2- 172.21.15.44:0/1447489061 >> v2:172.21.15.204:3300/0 conn(0x7fbff0159c70 0x7fbff00ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.862+0000 7fbff52e7640 1 -- 172.21.15.44:0/1447489061 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff00b43f0 con 0x7fbff006db20 2023-11-04T01:40:20.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.862+0000 7fbff52e7640 1 --2- 172.21.15.44:0/1447489061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbff006db20 0x7fbff00b03d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fbff00cc440 tx=0x7fbfe402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1884310abc9dd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.863+0000 7fbff4ae6640 1 -- 172.21.15.44:0/1447489061 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe402ee90 con 0x7fbff006db20 2023-11-04T01:40:20.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.863+0000 7fbff4ae6640 1 -- 172.21.15.44:0/1447489061 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe4036440 con 0x7fbff006db20 2023-11-04T01:40:20.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.863+0000 7fbff4ae6640 1 -- 172.21.15.44:0/1447489061 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40367d0 con 0x7fbff006db20 2023-11-04T01:40:20.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.863+0000 7fbff7d4c640 1 -- 172.21.15.44:0/1447489061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbff006db20 msgr2=0x7fbff00b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.863+0000 7fbff7d4c640 1 --2- 172.21.15.44:0/1447489061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbff006db20 0x7fbff00b03d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fbff00cc440 tx=0x7fbfe402e0e0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.863+0000 7fbff7d4c640 1 -- 172.21.15.44:0/1447489061 shutdown_connections 2023-11-04T01:40:20.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.863+0000 7fbff7d4c640 1 --2- 172.21.15.44:0/1447489061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff00b0910 0x7fbff015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.863+0000 7fbff7d4c640 1 --2- 172.21.15.44:0/1447489061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbff006db20 0x7fbff00b03d0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.863+0000 7fbff7d4c640 1 --2- 172.21.15.44:0/1447489061 >> v2:172.21.15.204:3300/0 conn(0x7fbff0159c70 0x7fbff00ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.863+0000 7fbff7d4c640 1 -- 172.21.15.44:0/1447489061 >> 172.21.15.44:0/1447489061 conn(0x7fbff00ce950 msgr2=0x7fbff00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:20.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.863+0000 7fbff7d4c640 1 -- 172.21.15.44:0/1447489061 shutdown_connections 2023-11-04T01:40:20.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.863+0000 7fbff7d4c640 1 -- 172.21.15.44:0/1447489061 wait complete. 2023-11-04T01:40:20.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.864+0000 7fbff7d4c640 1 Processor -- start 2023-11-04T01:40:20.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.864+0000 7fbff7d4c640 1 -- start start 2023-11-04T01:40:20.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.865+0000 7fbff7d4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff006db20 0x7fbff01f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.865+0000 7fbff7d4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbff00b0910 0x7fbff00ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.865+0000 7fbff7d4c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbff0159c70 0x7fbff0156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.865+0000 7fbff7d4c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff01f3180 con 0x7fbff00b0910 2023-11-04T01:40:20.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.865+0000 7fbff7d4c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff00ad630 con 0x7fbff0159c70 2023-11-04T01:40:20.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.865+0000 7fbff7d4c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff01f3c10 con 0x7fbff006db20 2023-11-04T01:40:20.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.865+0000 7fbff52e7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbff00b0910 0x7fbff00ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.865+0000 7fbff52e7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbff00b0910 0x7fbff00ad0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48198/0 (socket says 172.21.15.44:48198) 2023-11-04T01:40:20.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.865+0000 7fbff52e7640 1 -- 172.21.15.44:0/2905256079 learned_addr learned my addr 172.21.15.44:0/2905256079 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:20.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.865+0000 7fbff5ae8640 1 --2- 172.21.15.44:0/2905256079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff006db20 0x7fbff01f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.865+0000 7fbff62e9640 1 --2- 172.21.15.44:0/2905256079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbff0159c70 0x7fbff0156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.866+0000 7fbff52e7640 1 -- 172.21.15.44:0/2905256079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff006db20 msgr2=0x7fbff01f2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.866+0000 7fbff52e7640 1 --2- 172.21.15.44:0/2905256079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff006db20 0x7fbff01f2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.866+0000 7fbff52e7640 1 -- 172.21.15.44:0/2905256079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbff0159c70 msgr2=0x7fbff0156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.866+0000 7fbff52e7640 1 --2- 172.21.15.44:0/2905256079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbff0159c70 0x7fbff0156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.866+0000 7fbff52e7640 1 -- 172.21.15.44:0/2905256079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe400b770 con 0x7fbff00b0910 2023-11-04T01:40:20.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.866+0000 7fbff5ae8640 1 --2- 172.21.15.44:0/2905256079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff006db20 0x7fbff01f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:20.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.866+0000 7fbff52e7640 1 --2- 172.21.15.44:0/2905256079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbff00b0910 0x7fbff00ad0f0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fbfe402e120 tx=0x7fbfe40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.866+0000 7fbfee7fc640 1 -- 172.21.15.44:0/2905256079 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4034850 con 0x7fbff00b0910 2023-11-04T01:40:20.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.866+0000 7fbfee7fc640 1 -- 172.21.15.44:0/2905256079 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe40349b0 con 0x7fbff00b0910 2023-11-04T01:40:20.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.866+0000 7fbff7d4c640 1 -- 172.21.15.44:0/2905256079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff01f3370 con 0x7fbff00b0910 2023-11-04T01:40:20.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.866+0000 7fbfee7fc640 1 -- 172.21.15.44:0/2905256079 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4034d60 con 0x7fbff00b0910 2023-11-04T01:40:20.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.866+0000 7fbff7d4c640 1 -- 172.21.15.44:0/2905256079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff01f3930 con 0x7fbff00b0910 2023-11-04T01:40:20.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.867+0000 7fbff7d4c640 1 -- 172.21.15.44:0/2905256079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff0074290 con 0x7fbff00b0910 2023-11-04T01:40:20.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.867+0000 7fbfee7fc640 1 -- 172.21.15.44:0/2905256079 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbfe40403e0 con 0x7fbff00b0910 2023-11-04T01:40:20.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.868+0000 7fbfee7fc640 1 --2- 172.21.15.44:0/2905256079 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbfdc06ae70 0x7fbfdc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.868+0000 7fbfee7fc640 1 -- 172.21.15.44:0/2905256079 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7fbfe40ac060 con 0x7fbff00b0910 2023-11-04T01:40:20.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.868+0000 7fbff5ae8640 1 --2- 172.21.15.44:0/2905256079 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbfdc06ae70 0x7fbfdc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.869+0000 7fbff5ae8640 1 --2- 172.21.15.44:0/2905256079 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbfdc06ae70 0x7fbfdc06d330 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8006fd0 tx=0x7fbfe8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.874 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:20.872+0000 7fbfee7fc640 1 -- 172.21.15.44:0/2905256079 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbfe40deca0 con 0x7fbff00b0910 2023-11-04T01:40:21.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.083+0000 7fbff7d4c640 1 -- 172.21.15.44:0/2905256079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbff006d3f0 con 0x7fbff00b0910 2023-11-04T01:40:21.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.084+0000 7fbfee7fc640 1 -- 172.21.15.44:0/2905256079 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4934 (secure 0 0 0) 0x7fbfe403b090 con 0x7fbff00b0910 2023-11-04T01:40:21.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:21.086 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":59,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6820,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:18.052966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6562,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6562":{"gid":6562,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":17,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:21.087 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 59 2023-11-04T01:40:21.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.086+0000 7fbff7d4c640 1 -- 172.21.15.44:0/2905256079 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbfdc06ae70 msgr2=0x7fbfdc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.086+0000 7fbff7d4c640 1 --2- 172.21.15.44:0/2905256079 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbfdc06ae70 0x7fbfdc06d330 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8006fd0 tx=0x7fbfe8008040 comp rx=0 tx=0).stop 2023-11-04T01:40:21.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.086+0000 7fbff7d4c640 1 -- 172.21.15.44:0/2905256079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbff00b0910 msgr2=0x7fbff00ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.086+0000 7fbff7d4c640 1 --2- 172.21.15.44:0/2905256079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbff00b0910 0x7fbff00ad0f0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fbfe402e120 tx=0x7fbfe40046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.086+0000 7fbff7d4c640 1 -- 172.21.15.44:0/2905256079 shutdown_connections 2023-11-04T01:40:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.086+0000 7fbff7d4c640 1 --2- 172.21.15.44:0/2905256079 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbfdc06ae70 0x7fbfdc06d330 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.086+0000 7fbff7d4c640 1 --2- 172.21.15.44:0/2905256079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbff0159c70 0x7fbff0156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.086+0000 7fbff7d4c640 1 --2- 172.21.15.44:0/2905256079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbff00b0910 0x7fbff00ad0f0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.086+0000 7fbff7d4c640 1 --2- 172.21.15.44:0/2905256079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff006db20 0x7fbff01f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.086+0000 7fbff7d4c640 1 -- 172.21.15.44:0/2905256079 >> 172.21.15.44:0/2905256079 conn(0x7fbff00ce950 msgr2=0x7fbff00b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.086+0000 7fbff7d4c640 1 -- 172.21.15.44:0/2905256079 shutdown_connections 2023-11-04T01:40:21.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.086+0000 7fbff7d4c640 1 -- 172.21.15.44:0/2905256079 wait complete. 2023-11-04T01:40:21.502 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:29.920595+0000', 'modified': '2023-11-04T01:40:18.052966+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 99, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6562, 'mds_1': 7344}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6562': {'gid': 6562, 'name': 'a', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.44:6835/2252282753', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 2252282753}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 2252282753}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7344': {'gid': 7344, 'name': 'c', 'rank': 1, 'incarnation': 49, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.44:6834/2069525699', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 2069525699}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 2069525699}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:40:21.502 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:40:21.502 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:40:21.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.612+0000 7f53280a9640 1 Processor -- start 2023-11-04T01:40:21.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.613+0000 7f53280a9640 1 -- start start 2023-11-04T01:40:21.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.613+0000 7f53280a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5320153e60 0x7f532015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.613+0000 7f53280a9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f53200b4880 0x7f53200b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.613+0000 7f53280a9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53200cde60 con 0x7f53200cd6d0 2023-11-04T01:40:21.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.613+0000 7f53280a9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5320160f90 con 0x7f5320153e60 2023-11-04T01:40:21.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.613+0000 7f53280a9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53200b5200 con 0x7f53200b4880 2023-11-04T01:40:21.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.614+0000 7f5325e45640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5320153e60 0x7f532015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.614+0000 7f5325e45640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5320153e60 0x7f532015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48208/0 (socket says 172.21.15.44:48208) 2023-11-04T01:40:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.614+0000 7f5325e45640 1 -- 172.21.15.44:0/1308497939 learned_addr learned my addr 172.21.15.44:0/1308497939 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.614+0000 7f5326646640 1 --2- 172.21.15.44:0/1308497939 >> v2:172.21.15.204:3300/0 conn(0x7f53200b4880 0x7f53200b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.614+0000 7f5325e45640 1 -- 172.21.15.44:0/1308497939 >> v2:172.21.15.204:3300/0 conn(0x7f53200b4880 msgr2=0x7f53200b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.614+0000 7f5325e45640 1 --2- 172.21.15.44:0/1308497939 >> v2:172.21.15.204:3300/0 conn(0x7f53200b4880 0x7f53200b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.614+0000 7f5325e45640 1 -- 172.21.15.44:0/1308497939 >> v1:172.21.15.204:6789/0 conn(0x7f53200cd6d0 legacy=0x7f5320161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.614+0000 7f5325e45640 1 -- 172.21.15.44:0/1308497939 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532015e400 con 0x7f5320153e60 2023-11-04T01:40:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.615+0000 7f5325e45640 1 --2- 172.21.15.44:0/1308497939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320153e60 0x7f532015dec0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f53200b8f40 tx=0x7f531c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3419a7a63035625f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.615+0000 7f5324e43640 1 -- 172.21.15.44:0/1308497939 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c031870 con 0x7f5320153e60 2023-11-04T01:40:21.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.615+0000 7f5324e43640 1 -- 172.21.15.44:0/1308497939 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c0319d0 con 0x7f5320153e60 2023-11-04T01:40:21.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.615+0000 7f5324e43640 1 -- 172.21.15.44:0/1308497939 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c031d60 con 0x7f5320153e60 2023-11-04T01:40:21.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.615+0000 7f53280a9640 1 -- 172.21.15.44:0/1308497939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320153e60 msgr2=0x7f532015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.615+0000 7f53280a9640 1 --2- 172.21.15.44:0/1308497939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320153e60 0x7f532015dec0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f53200b8f40 tx=0x7f531c02b910 comp rx=0 tx=0).stop 2023-11-04T01:40:21.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.615+0000 7f53280a9640 1 -- 172.21.15.44:0/1308497939 shutdown_connections 2023-11-04T01:40:21.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.615+0000 7f53280a9640 1 --2- 172.21.15.44:0/1308497939 >> v2:172.21.15.204:3300/0 conn(0x7f53200b4880 0x7f53200b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.615+0000 7f53280a9640 1 --2- 172.21.15.44:0/1308497939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320153e60 0x7f532015dec0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.615+0000 7f53280a9640 1 -- 172.21.15.44:0/1308497939 >> 172.21.15.44:0/1308497939 conn(0x7f53200cf880 msgr2=0x7f53200cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.616+0000 7f53280a9640 1 -- 172.21.15.44:0/1308497939 shutdown_connections 2023-11-04T01:40:21.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.616+0000 7f53280a9640 1 -- 172.21.15.44:0/1308497939 wait complete. 2023-11-04T01:40:21.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.617+0000 7f53280a9640 1 Processor -- start 2023-11-04T01:40:21.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.617+0000 7f53280a9640 1 -- start start 2023-11-04T01:40:21.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.617+0000 7f53280a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53200b4880 0x7f532014f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.617+0000 7f53280a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53200cd6d0 0x7f5320157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.617+0000 7f53280a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320153e60 0x7f53201f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.617+0000 7f53280a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532014f930 con 0x7f5320153e60 2023-11-04T01:40:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.617+0000 7f53280a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53201f6e30 con 0x7f53200b4880 2023-11-04T01:40:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.617+0000 7f53280a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53201f6b50 con 0x7f53200cd6d0 2023-11-04T01:40:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f5326646640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320153e60 0x7f53201f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f5326646640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320153e60 0x7f53201f5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48224/0 (socket says 172.21.15.44:48224) 2023-11-04T01:40:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f5326646640 1 -- 172.21.15.44:0/2600940775 learned_addr learned my addr 172.21.15.44:0/2600940775 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f5325644640 1 --2- 172.21.15.44:0/2600940775 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53200cd6d0 0x7f5320157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f5325e45640 1 --2- 172.21.15.44:0/2600940775 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53200b4880 0x7f532014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f5326646640 1 -- 172.21.15.44:0/2600940775 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53200cd6d0 msgr2=0x7f5320157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f5326646640 1 --2- 172.21.15.44:0/2600940775 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53200cd6d0 0x7f5320157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f5326646640 1 -- 172.21.15.44:0/2600940775 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53200b4880 msgr2=0x7f532014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f5326646640 1 --2- 172.21.15.44:0/2600940775 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53200b4880 0x7f532014f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f5326646640 1 -- 172.21.15.44:0/2600940775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c0094d0 con 0x7f5320153e60 2023-11-04T01:40:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f5326646640 1 --2- 172.21.15.44:0/2600940775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320153e60 0x7f53201f5fe0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f531800cd70 tx=0x7f531800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f53167fc640 1 -- 172.21.15.44:0/2600940775 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318003b90 con 0x7f5320153e60 2023-11-04T01:40:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f53167fc640 1 -- 172.21.15.44:0/2600940775 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5318003cf0 con 0x7f5320153e60 2023-11-04T01:40:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f53280a9640 1 -- 172.21.15.44:0/2600940775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532015b020 con 0x7f5320153e60 2023-11-04T01:40:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f53167fc640 1 -- 172.21.15.44:0/2600940775 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318004240 con 0x7f5320153e60 2023-11-04T01:40:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.618+0000 7f53280a9640 1 -- 172.21.15.44:0/2600940775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532015b5e0 con 0x7f5320153e60 2023-11-04T01:40:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.620+0000 7f53167fc640 1 -- 172.21.15.44:0/2600940775 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53180043a0 con 0x7f5320153e60 2023-11-04T01:40:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.620+0000 7f53167fc640 1 --2- 172.21.15.44:0/2600940775 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f530406ae70 0x7f530406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.620+0000 7f53167fc640 1 -- 172.21.15.44:0/2600940775 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f5318012070 con 0x7f5320153e60 2023-11-04T01:40:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.621+0000 7f5325e45640 1 --2- 172.21.15.44:0/2600940775 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f530406ae70 0x7f530406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.621+0000 7f5325e45640 1 --2- 172.21.15.44:0/2600940775 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f530406ae70 0x7f530406d330 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f531c036000 tx=0x7f531c03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.621+0000 7f532ac3b740 1 Processor -- start 2023-11-04T01:40:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.621+0000 7f532ac3b740 1 -- start start 2023-11-04T01:40:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.622+0000 7f532ac3b740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa609850 0x5566fa5dc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.622+0000 7f532ac3b740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa609c30 0x5566fa60c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.622+0000 7f532ac3b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa5dcc90 0x5566fa60cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.622+0000 7f532ac3b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566fa4ed740 con 0x5566fa5dcc90 2023-11-04T01:40:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.622+0000 7f532ac3b740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566fa54f8d0 con 0x5566fa609c30 2023-11-04T01:40:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.622+0000 7f532ac3b740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5566fa54cfc0 con 0x5566fa609850 2023-11-04T01:40:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.622+0000 7f5326646640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa5dcc90 0x5566fa60cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.622+0000 7f5326646640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa5dcc90 0x5566fa60cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48226/0 (socket says 172.21.15.44:48226) 2023-11-04T01:40:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.622+0000 7f5326646640 1 -- 172.21.15.44:0/3957284162 learned_addr learned my addr 172.21.15.44:0/3957284162 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.622+0000 7f5325e45640 1 --2- 172.21.15.44:0/3957284162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa609850 0x5566fa5dc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.622+0000 7f5325644640 1 --2- 172.21.15.44:0/3957284162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa609c30 0x5566fa60c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.623+0000 7f5326646640 1 -- 172.21.15.44:0/3957284162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa609850 msgr2=0x5566fa5dc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.623+0000 7f5326646640 1 --2- 172.21.15.44:0/3957284162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa609850 0x5566fa5dc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.623+0000 7f5326646640 1 -- 172.21.15.44:0/3957284162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa609c30 msgr2=0x5566fa60c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.623+0000 7f5326646640 1 --2- 172.21.15.44:0/3957284162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa609c30 0x5566fa60c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.623+0000 7f5326646640 1 -- 172.21.15.44:0/3957284162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566fa50bca0 con 0x5566fa5dcc90 2023-11-04T01:40:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.623+0000 7f5326646640 1 --2- 172.21.15.44:0/3957284162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa5dcc90 0x5566fa60cb20 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f53180609f0 tx=0x7f5318004650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9f2d4a8433aada server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.623+0000 7f53037fe640 1 -- 172.21.15.44:0/3957284162 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531805cd70 con 0x5566fa5dcc90 2023-11-04T01:40:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.623+0000 7f53037fe640 1 -- 172.21.15.44:0/3957284162 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5318060f20 con 0x5566fa5dcc90 2023-11-04T01:40:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.623+0000 7f53037fe640 1 -- 172.21.15.44:0/3957284162 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53180553e0 con 0x5566fa5dcc90 2023-11-04T01:40:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.623+0000 7f532ac3b740 1 -- 172.21.15.44:0/3957284162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa5dcc90 msgr2=0x5566fa60cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.623+0000 7f532ac3b740 1 --2- 172.21.15.44:0/3957284162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa5dcc90 0x5566fa60cb20 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f53180609f0 tx=0x7f5318004650 comp rx=0 tx=0).stop 2023-11-04T01:40:21.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.624+0000 7f532ac3b740 1 -- 172.21.15.44:0/3957284162 shutdown_connections 2023-11-04T01:40:21.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.624+0000 7f532ac3b740 1 --2- 172.21.15.44:0/3957284162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa5dcc90 0x5566fa60cb20 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.624+0000 7f532ac3b740 1 --2- 172.21.15.44:0/3957284162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa609c30 0x5566fa60c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.624+0000 7f532ac3b740 1 --2- 172.21.15.44:0/3957284162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa609850 0x5566fa5dc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.624+0000 7f532ac3b740 1 -- 172.21.15.44:0/3957284162 >> 172.21.15.44:0/3957284162 conn(0x5566fa5dea60 msgr2=0x5566fa6275e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.624+0000 7f532ac3b740 1 -- 172.21.15.44:0/3957284162 shutdown_connections 2023-11-04T01:40:21.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.624+0000 7f532ac3b740 1 -- 172.21.15.44:0/3957284162 wait complete. 2023-11-04T01:40:21.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.624+0000 7f532ac3b740 1 -- start start 2023-11-04T01:40:21.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.624+0000 7f532ac3b740 1 Processor -- start 2023-11-04T01:40:21.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.625+0000 7f532ac3b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609850 0x5566fa5f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.625+0000 7f532ac3b740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa609c30 0x5566fa604500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.625+0000 7f532ac3b740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa604a40 0x5566fa6023c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.625+0000 7f532ac3b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566fa5488b0 con 0x5566fa609850 2023-11-04T01:40:21.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.625+0000 7f532ac3b740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566fa502c80 con 0x5566fa604a40 2023-11-04T01:40:21.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.625+0000 7f532ac3b740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5566fa502920 con 0x5566fa609c30 2023-11-04T01:40:21.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.625+0000 7f532ac3b740 10 client.0 _ll_register_callbacks cb 0x5566fa25aac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:21.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.625+0000 7f5325e45640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609850 0x5566fa5f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.625+0000 7f5325e45640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609850 0x5566fa5f3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48238/0 (socket says 172.21.15.44:48238) 2023-11-04T01:40:21.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.625+0000 7f5325e45640 1 -- 172.21.15.44:0/334206257 learned_addr learned my addr 172.21.15.44:0/334206257 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:21.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.625+0000 7f5325644640 1 --2- 172.21.15.44:0/334206257 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa609c30 0x5566fa604500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.625+0000 7f5326646640 1 --2- 172.21.15.44:0/334206257 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa604a40 0x5566fa6023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.626+0000 7f5325e45640 1 -- 172.21.15.44:0/334206257 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa609c30 msgr2=0x5566fa604500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.626+0000 7f5325e45640 1 --2- 172.21.15.44:0/334206257 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa609c30 0x5566fa604500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.626+0000 7f5325e45640 1 -- 172.21.15.44:0/334206257 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa604a40 msgr2=0x5566fa6023c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.626+0000 7f5325e45640 1 --2- 172.21.15.44:0/334206257 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa604a40 0x5566fa6023c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.626+0000 7f5325e45640 1 -- 172.21.15.44:0/334206257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532015b5e0 con 0x5566fa609850 2023-11-04T01:40:21.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.626+0000 7f5325e45640 1 --2- 172.21.15.44:0/334206257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609850 0x5566fa5f3b10 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f531c009930 tx=0x7f531c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a70425c3676058 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.626+0000 7f5300ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:40:21.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.626+0000 7f5300ff9640 1 -- 172.21.15.44:0/334206257 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c03adb0 con 0x5566fa609850 2023-11-04T01:40:21.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.626+0000 7f5300ff9640 1 -- 172.21.15.44:0/334206257 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f531c04a050 con 0x5566fa609850 2023-11-04T01:40:21.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.626+0000 7f532ac3b740 1 -- 172.21.15.44:0/334206257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5566fa4f4bf0 con 0x5566fa609850 2023-11-04T01:40:21.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.626+0000 7f5300ff9640 1 -- 172.21.15.44:0/334206257 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f531c051470 con 0x5566fa609850 2023-11-04T01:40:21.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.626+0000 7f532ac3b740 10 client.7707 fetch_fsmap learned FSMap version 59 2023-11-04T01:40:21.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.626+0000 7f532ac3b740 1 -- 172.21.15.44:0/334206257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x5566fa546f30 con 0x5566fa609850 2023-11-04T01:40:21.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.626+0000 7f5300ff9640 1 -- 172.21.15.44:0/334206257 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5566fa4f4bf0 con 0x5566fa609850 2023-11-04T01:40:21.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.626+0000 7f5300ff9640 1 -- 172.21.15.44:0/334206257 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 59) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f531c043050 con 0x5566fa609850 2023-11-04T01:40:21.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.627+0000 7f532ac3b740 10 client.7707 fetch_fsmap finished waiting for FSMap version 59 2023-11-04T01:40:21.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.627+0000 7f532ac3b740 10 client.7707 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:40:21.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.627+0000 7f532ac3b740 20 client.7707 populate_metadata read hostname 'smithi044' 2023-11-04T01:40:21.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.627+0000 7f532ac3b740 1 --2- 172.21.15.44:0/334206257 >> [v2:172.21.15.44:6833/2252282753,v1:172.21.15.44:6835/2252282753] conn(0x5566fa63b1b0 0x5566fa60b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.627+0000 7f532ac3b740 4 client.7707 mds_command: new command op to 6562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:21.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.627+0000 7f532ac3b740 1 -- 172.21.15.44:0/334206257 --> [v2:172.21.15.44:6833/2252282753,v1:172.21.15.44:6835/2252282753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5566fa541890 con 0x5566fa63b1b0 2023-11-04T01:40:21.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.627+0000 7f5325644640 1 --2- 172.21.15.44:0/334206257 >> [v2:172.21.15.44:6833/2252282753,v1:172.21.15.44:6835/2252282753] conn(0x5566fa63b1b0 0x5566fa60b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.627+0000 7f5300ff9640 10 client.7707 ms_handle_connect on v2:172.21.15.44:6833/2252282753 2023-11-04T01:40:21.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.627+0000 7f5325644640 1 --2- 172.21.15.44:0/334206257 >> [v2:172.21.15.44:6833/2252282753,v1:172.21.15.44:6835/2252282753] conn(0x5566fa63b1b0 0x5566fa60b070 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=288a0a27db19d2cc server_cookie=7982c8f38ca475c5 in_seq=0 out_seq=0 2023-11-04T01:40:21.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.628+0000 7f5300ff9640 1 -- 172.21.15.44:0/334206257 <== mds.0 v2:172.21.15.44:6833/2252282753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5566fa541890 con 0x5566fa63b1b0 2023-11-04T01:40:21.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.628+0000 7f5300ff9640 10 client.7707 handle_command_reply: tid=0 2023-11-04T01:40:21.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.628+0000 7f532ac3b740 1 client.7707 shutdown 2023-11-04T01:40:21.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.628+0000 7f532ac3b740 1 -- 172.21.15.44:0/334206257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609850 msgr2=0x5566fa5f3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.628+0000 7f532ac3b740 1 --2- 172.21.15.44:0/334206257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609850 0x5566fa5f3b10 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f531c009930 tx=0x7f531c004730 comp rx=0 tx=0).stop 2023-11-04T01:40:21.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.628+0000 7f532ac3b740 1 -- 172.21.15.44:0/334206257 shutdown_connections 2023-11-04T01:40:21.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.628+0000 7f532ac3b740 1 --2- 172.21.15.44:0/334206257 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa604a40 0x5566fa6023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.628+0000 7f532ac3b740 1 --2- 172.21.15.44:0/334206257 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa609c30 0x5566fa604500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.628+0000 7f532ac3b740 1 --2- 172.21.15.44:0/334206257 >> [v2:172.21.15.44:6833/2252282753,v1:172.21.15.44:6835/2252282753] conn(0x5566fa63b1b0 0x5566fa60b070 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.628+0000 7f532ac3b740 1 --2- 172.21.15.44:0/334206257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609850 0x5566fa5f3b10 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.628+0000 7f5300ff9640 0 client.7707 ms_handle_reset on v2:172.21.15.44:6833/2252282753 2023-11-04T01:40:21.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.628+0000 7f532ac3b740 1 -- 172.21.15.44:0/334206257 >> 172.21.15.44:0/334206257 conn(0x5566fa5dcc90 msgr2=0x5566fa5e06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.628+0000 7f532ac3b740 1 -- 172.21.15.44:0/334206257 shutdown_connections 2023-11-04T01:40:21.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.628+0000 7f532ac3b740 1 -- 172.21.15.44:0/334206257 wait complete. 2023-11-04T01:40:21.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.628+0000 7f532ac3b740 20 client.7707 trim_cache size 0 max 16384 2023-11-04T01:40:21.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.644+0000 7f532ac3b740 1 Processor -- start 2023-11-04T01:40:21.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.644+0000 7f532ac3b740 1 -- start start 2023-11-04T01:40:21.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f532ac3b740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa604a40 0x5566fa5e2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f532ac3b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609850 0x5566fa60f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f532ac3b740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa609c30 0x5566fa5db4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f532ac3b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566fa60a380 con 0x5566fa609850 2023-11-04T01:40:21.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f532ac3b740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566fa4c8280 con 0x5566fa604a40 2023-11-04T01:40:21.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f532ac3b740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5566fa62a8a0 con 0x5566fa609c30 2023-11-04T01:40:21.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f5325644640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609850 0x5566fa60f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f5325644640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609850 0x5566fa60f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48254/0 (socket says 172.21.15.44:48254) 2023-11-04T01:40:21.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f5325644640 1 -- 172.21.15.44:0/1454301462 learned_addr learned my addr 172.21.15.44:0/1454301462 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:21.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f5325e45640 1 --2- 172.21.15.44:0/1454301462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa604a40 0x5566fa5e2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f5326646640 1 --2- 172.21.15.44:0/1454301462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa609c30 0x5566fa5db4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f5325644640 1 -- 172.21.15.44:0/1454301462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa609c30 msgr2=0x5566fa5db4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f5325644640 1 --2- 172.21.15.44:0/1454301462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa609c30 0x5566fa5db4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f5325644640 1 -- 172.21.15.44:0/1454301462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa604a40 msgr2=0x5566fa5e2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f5325644640 1 --2- 172.21.15.44:0/1454301462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa604a40 0x5566fa5e2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f5325644640 1 -- 172.21.15.44:0/1454301462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566fa4e4d10 con 0x5566fa609850 2023-11-04T01:40:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f5325644640 1 --2- 172.21.15.44:0/1454301462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609850 0x5566fa60f850 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f5320161b30 tx=0x7f5310007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e011499b9dad916c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f5303fff640 1 -- 172.21.15.44:0/1454301462 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531001b040 con 0x5566fa609850 2023-11-04T01:40:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f5303fff640 1 -- 172.21.15.44:0/1454301462 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310022070 con 0x5566fa609850 2023-11-04T01:40:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.645+0000 7f5303fff640 1 -- 172.21.15.44:0/1454301462 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531001e5f0 con 0x5566fa609850 2023-11-04T01:40:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.646+0000 7f532ac3b740 1 -- 172.21.15.44:0/1454301462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609850 msgr2=0x5566fa60f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.646+0000 7f532ac3b740 1 --2- 172.21.15.44:0/1454301462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609850 0x5566fa60f850 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f5320161b30 tx=0x7f5310007e30 comp rx=0 tx=0).stop 2023-11-04T01:40:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.646+0000 7f532ac3b740 1 -- 172.21.15.44:0/1454301462 shutdown_connections 2023-11-04T01:40:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.646+0000 7f532ac3b740 1 --2- 172.21.15.44:0/1454301462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa609c30 0x5566fa5db4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.646+0000 7f532ac3b740 1 --2- 172.21.15.44:0/1454301462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609850 0x5566fa60f850 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.646+0000 7f532ac3b740 1 --2- 172.21.15.44:0/1454301462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa604a40 0x5566fa5e2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.646+0000 7f532ac3b740 1 -- 172.21.15.44:0/1454301462 >> 172.21.15.44:0/1454301462 conn(0x5566fa5dcc90 msgr2=0x5566fa5d7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.646+0000 7f532ac3b740 1 -- 172.21.15.44:0/1454301462 shutdown_connections 2023-11-04T01:40:21.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.646+0000 7f532ac3b740 1 -- 172.21.15.44:0/1454301462 wait complete. 2023-11-04T01:40:21.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.646+0000 7f532ac3b740 1 -- start start 2023-11-04T01:40:21.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.646+0000 7f532ac3b740 1 Processor -- start 2023-11-04T01:40:21.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.647+0000 7f532ac3b740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa604a40 0x5566fa68c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.647+0000 7f532ac3b740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa609850 0x5566fa60c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.647+0000 7f532ac3b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609c30 0x5566fa60cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.647+0000 7f532ac3b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566fa692610 con 0x5566fa609c30 2023-11-04T01:40:21.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.647+0000 7f532ac3b740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566fa603af0 con 0x5566fa609850 2023-11-04T01:40:21.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.647+0000 7f532ac3b740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5566fa603200 con 0x5566fa604a40 2023-11-04T01:40:21.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.647+0000 7f532ac3b740 10 client.0 _ll_register_callbacks cb 0x7f5318058aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:21.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.647+0000 7f5326646640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609c30 0x5566fa60cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.647+0000 7f5326646640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609c30 0x5566fa60cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48260/0 (socket says 172.21.15.44:48260) 2023-11-04T01:40:21.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.647+0000 7f5326646640 1 -- 172.21.15.44:0/2688665049 learned_addr learned my addr 172.21.15.44:0/2688665049 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:21.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f5325644640 1 --2- 172.21.15.44:0/2688665049 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa609850 0x5566fa60c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f5325e45640 1 --2- 172.21.15.44:0/2688665049 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa604a40 0x5566fa68c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f5326646640 1 -- 172.21.15.44:0/2688665049 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa604a40 msgr2=0x5566fa68c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f5326646640 1 --2- 172.21.15.44:0/2688665049 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa604a40 0x5566fa68c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f5326646640 1 -- 172.21.15.44:0/2688665049 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa609850 msgr2=0x5566fa60c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f5326646640 1 --2- 172.21.15.44:0/2688665049 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa609850 0x5566fa60c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f5326646640 1 -- 172.21.15.44:0/2688665049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5310004f60 con 0x5566fa609c30 2023-11-04T01:40:21.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f5325e45640 1 --2- 172.21.15.44:0/2688665049 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa604a40 0x5566fa68c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:21.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f5326646640 1 --2- 172.21.15.44:0/2688665049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609c30 0x5566fa60cde0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f53180551d0 tx=0x7f531808a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fcf4c3405fd9ce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f5300ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:40:21.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f5300ff9640 1 -- 172.21.15.44:0/2688665049 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531808a2b0 con 0x5566fa609c30 2023-11-04T01:40:21.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f5300ff9640 1 -- 172.21.15.44:0/2688665049 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f531805cd70 con 0x5566fa609c30 2023-11-04T01:40:21.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f532ac3b740 1 -- 172.21.15.44:0/2688665049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5566fa6285c0 con 0x5566fa609c30 2023-11-04T01:40:21.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f5300ff9640 1 -- 172.21.15.44:0/2688665049 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5318055010 con 0x5566fa609c30 2023-11-04T01:40:21.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f532ac3b740 10 client.7713 fetch_fsmap learned FSMap version 59 2023-11-04T01:40:21.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f532ac3b740 1 -- 172.21.15.44:0/2688665049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x5566fa50a500 con 0x5566fa609c30 2023-11-04T01:40:21.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f5300ff9640 1 -- 172.21.15.44:0/2688665049 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5566fa6285c0 con 0x5566fa609c30 2023-11-04T01:40:21.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f5300ff9640 1 -- 172.21.15.44:0/2688665049 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 59) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f531801d060 con 0x5566fa609c30 2023-11-04T01:40:21.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f532ac3b740 10 client.7713 fetch_fsmap finished waiting for FSMap version 59 2023-11-04T01:40:21.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f532ac3b740 10 client.7713 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:40:21.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f532ac3b740 20 client.7713 populate_metadata read hostname 'smithi044' 2023-11-04T01:40:21.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f532ac3b740 1 --2- 172.21.15.44:0/2688665049 >> [v2:172.21.15.44:6833/2252282753,v1:172.21.15.44:6835/2252282753] conn(0x5566fa600930 0x5566fa600d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f532ac3b740 4 client.7713 mds_command: new command op to 6562 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:21.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.648+0000 7f532ac3b740 1 -- 172.21.15.44:0/2688665049 --> [v2:172.21.15.44:6833/2252282753,v1:172.21.15.44:6835/2252282753] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f5318060f20 con 0x5566fa600930 2023-11-04T01:40:21.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f5325e45640 1 --2- 172.21.15.44:0/2688665049 >> [v2:172.21.15.44:6833/2252282753,v1:172.21.15.44:6835/2252282753] conn(0x5566fa600930 0x5566fa600d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f5300ff9640 10 client.7713 ms_handle_connect on v2:172.21.15.44:6833/2252282753 2023-11-04T01:40:21.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f5325e45640 1 --2- 172.21.15.44:0/2688665049 >> [v2:172.21.15.44:6833/2252282753,v1:172.21.15.44:6835/2252282753] conn(0x5566fa600930 0x5566fa600d10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e95cf14584581019 server_cookie=81e493f003c8e428 in_seq=0 out_seq=0 2023-11-04T01:40:21.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f5300ff9640 1 -- 172.21.15.44:0/2688665049 <== mds.0 v2:172.21.15.44:6833/2252282753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f5318060f20 con 0x5566fa600930 2023-11-04T01:40:21.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f5300ff9640 10 client.7713 handle_command_reply: tid=0 2023-11-04T01:40:21.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f532ac3b740 1 client.7713 shutdown 2023-11-04T01:40:21.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f532ac3b740 1 -- 172.21.15.44:0/2688665049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609c30 msgr2=0x5566fa60cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f532ac3b740 1 --2- 172.21.15.44:0/2688665049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609c30 0x5566fa60cde0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f53180551d0 tx=0x7f531808a040 comp rx=0 tx=0).stop 2023-11-04T01:40:21.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f532ac3b740 1 -- 172.21.15.44:0/2688665049 shutdown_connections 2023-11-04T01:40:21.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f532ac3b740 1 --2- 172.21.15.44:0/2688665049 >> [v2:172.21.15.44:6833/2252282753,v1:172.21.15.44:6835/2252282753] conn(0x5566fa600930 0x5566fa600d10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f532ac3b740 1 --2- 172.21.15.44:0/2688665049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa609c30 0x5566fa60cde0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f532ac3b740 1 --2- 172.21.15.44:0/2688665049 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5566fa609850 0x5566fa60c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f5300ff9640 0 client.7713 ms_handle_reset on v2:172.21.15.44:6833/2252282753 2023-11-04T01:40:21.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f532ac3b740 1 --2- 172.21.15.44:0/2688665049 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5566fa604a40 0x5566fa68c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f532ac3b740 1 -- 172.21.15.44:0/2688665049 >> 172.21.15.44:0/2688665049 conn(0x5566fa5dcc90 msgr2=0x5566fa5e2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f532ac3b740 1 -- 172.21.15.44:0/2688665049 shutdown_connections 2023-11-04T01:40:21.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.649+0000 7f532ac3b740 1 -- 172.21.15.44:0/2688665049 wait complete. 2023-11-04T01:40:21.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.650+0000 7f532ac3b740 20 client.7713 trim_cache size 0 max 16384 2023-11-04T01:40:21.663 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:40:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:40:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2023-11-04T01:40:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6562, 2023-11-04T01:40:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:40:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:40:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:40:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 6.6081432009999999, 2023-11-04T01:40:21.663 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 59, 2023-11-04T01:40:21.664 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 99, 2023-11-04T01:40:21.664 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 99, 2023-11-04T01:40:21.664 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 57.142868403000001 2023-11-04T01:40:21.664 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:40:21.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.650+0000 7f53280a9640 1 -- 172.21.15.44:0/2600940775 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f530406ae70 msgr2=0x7f530406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.650+0000 7f53280a9640 1 --2- 172.21.15.44:0/2600940775 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f530406ae70 0x7f530406d330 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f531c036000 tx=0x7f531c03c040 comp rx=0 tx=0).stop 2023-11-04T01:40:21.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.650+0000 7f53280a9640 1 -- 172.21.15.44:0/2600940775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320153e60 msgr2=0x7f53201f5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.665 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.650+0000 7f53280a9640 1 --2- 172.21.15.44:0/2600940775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320153e60 0x7f53201f5fe0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f531800cd70 tx=0x7f531800a660 comp rx=0 tx=0).stop 2023-11-04T01:40:21.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.650+0000 7f53280a9640 1 -- 172.21.15.44:0/2600940775 shutdown_connections 2023-11-04T01:40:21.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.650+0000 7f53280a9640 1 --2- 172.21.15.44:0/2600940775 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f530406ae70 0x7f530406d330 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.650+0000 7f53280a9640 1 --2- 172.21.15.44:0/2600940775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320153e60 0x7f53201f5fe0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.650+0000 7f53280a9640 1 --2- 172.21.15.44:0/2600940775 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53200cd6d0 0x7f5320157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.650+0000 7f53280a9640 1 --2- 172.21.15.44:0/2600940775 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53200b4880 0x7f532014f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.650+0000 7f53280a9640 1 -- 172.21.15.44:0/2600940775 >> 172.21.15.44:0/2600940775 conn(0x7f53200cf880 msgr2=0x7f532015ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.650+0000 7f53280a9640 1 -- 172.21.15.44:0/2600940775 shutdown_connections 2023-11-04T01:40:21.666 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.650+0000 7f53280a9640 1 -- 172.21.15.44:0/2600940775 wait complete. 2023-11-04T01:40:21.666 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:40:21.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.772+0000 7f6c80ca9640 1 Processor -- start 2023-11-04T01:40:21.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.772+0000 7f6c80ca9640 1 -- start start 2023-11-04T01:40:21.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.772+0000 7f6c80ca9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c160430 0x7f6c7c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.772+0000 7f6c80ca9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6c7c0b2b60 0x7f6c7c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.772+0000 7f6c80ca9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6c7c06c1d0 0x7f6c7c160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.772+0000 7f6c80ca9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c0cb580 con 0x7f6c7c06c1d0 2023-11-04T01:40:21.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.772+0000 7f6c80ca9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c0b2fc0 con 0x7f6c7c0b2b60 2023-11-04T01:40:21.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.772+0000 7f6c80ca9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c06ca40 con 0x7f6c7c160430 2023-11-04T01:40:21.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.773+0000 7f6c7ad9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6c7c06c1d0 0x7f6c7c160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.773+0000 7f6c7ad9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6c7c06c1d0 0x7f6c7c160b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48266/0 (socket says 172.21.15.44:48266) 2023-11-04T01:40:21.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.773+0000 7f6c7ad9d640 1 -- 172.21.15.44:0/3725307171 learned_addr learned my addr 172.21.15.44:0/3725307171 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:21.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.773+0000 7f6c7ad9d640 1 -- 172.21.15.44:0/3725307171 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c160430 msgr2=0x7f6c7c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.773+0000 7f6c73fff640 1 --2- 172.21.15.44:0/3725307171 >> v2:172.21.15.204:3300/0 conn(0x7f6c7c0b2b60 0x7f6c7c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.773+0000 7f6c7a59c640 1 --2- 172.21.15.44:0/3725307171 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c160430 0x7f6c7c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.773+0000 7f6c7ad9d640 1 --2- 172.21.15.44:0/3725307171 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c160430 0x7f6c7c0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.773+0000 7f6c7ad9d640 1 -- 172.21.15.44:0/3725307171 >> v2:172.21.15.204:3300/0 conn(0x7f6c7c0b2b60 msgr2=0x7f6c7c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.773+0000 7f6c7ad9d640 1 --2- 172.21.15.44:0/3725307171 >> v2:172.21.15.204:3300/0 conn(0x7f6c7c0b2b60 0x7f6c7c06bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.773+0000 7f6c7ad9d640 1 -- 172.21.15.44:0/3725307171 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c06cd20 con 0x7f6c7c06c1d0 2023-11-04T01:40:21.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.773+0000 7f6c7a59c640 1 --2- 172.21.15.44:0/3725307171 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c160430 0x7f6c7c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:21.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.773+0000 7f6c73fff640 1 --2- 172.21.15.44:0/3725307171 >> v2:172.21.15.204:3300/0 conn(0x7f6c7c0b2b60 0x7f6c7c06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:21.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.774+0000 7f6c7ad9d640 1 --2- 172.21.15.44:0/3725307171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c7c06c1d0 0x7f6c7c160b20 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c06e4c0 tx=0x7f6c7402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac624f6e2312fdcf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.774+0000 7f6c79d9b640 1 -- 172.21.15.44:0/3725307171 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7402ca70 con 0x7f6c7c06c1d0 2023-11-04T01:40:21.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.774+0000 7f6c79d9b640 1 -- 172.21.15.44:0/3725307171 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7402cbd0 con 0x7f6c7c06c1d0 2023-11-04T01:40:21.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.774+0000 7f6c79d9b640 1 -- 172.21.15.44:0/3725307171 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c740343f0 con 0x7f6c7c06c1d0 2023-11-04T01:40:21.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.774+0000 7f6c80ca9640 1 -- 172.21.15.44:0/3725307171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c7c06c1d0 msgr2=0x7f6c7c160b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.774+0000 7f6c80ca9640 1 --2- 172.21.15.44:0/3725307171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c7c06c1d0 0x7f6c7c160b20 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c06e4c0 tx=0x7f6c7402bed0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.774+0000 7f6c80ca9640 1 -- 172.21.15.44:0/3725307171 shutdown_connections 2023-11-04T01:40:21.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.774+0000 7f6c80ca9640 1 --2- 172.21.15.44:0/3725307171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c7c06c1d0 0x7f6c7c160b20 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.774+0000 7f6c80ca9640 1 --2- 172.21.15.44:0/3725307171 >> v2:172.21.15.204:3300/0 conn(0x7f6c7c0b2b60 0x7f6c7c06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.774+0000 7f6c80ca9640 1 --2- 172.21.15.44:0/3725307171 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c160430 0x7f6c7c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.774+0000 7f6c80ca9640 1 -- 172.21.15.44:0/3725307171 >> 172.21.15.44:0/3725307171 conn(0x7f6c7c06ea20 msgr2=0x7f6c7c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.774+0000 7f6c80ca9640 1 -- 172.21.15.44:0/3725307171 shutdown_connections 2023-11-04T01:40:21.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.774+0000 7f6c80ca9640 1 -- 172.21.15.44:0/3725307171 wait complete. 2023-11-04T01:40:21.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.776+0000 7f6c80ca9640 1 Processor -- start 2023-11-04T01:40:21.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.776+0000 7f6c80ca9640 1 -- start start 2023-11-04T01:40:21.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.776+0000 7f6c80ca9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c06c1d0 0x7f6c7c1f65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.776+0000 7f6c80ca9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c7c0b2b60 0x7f6c7c0d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.776+0000 7f6c80ca9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c7c160430 0x7f6c7c0d1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.776+0000 7f6c80ca9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c1f3270 con 0x7f6c7c0b2b60 2023-11-04T01:40:21.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.776+0000 7f6c80ca9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c1f3700 con 0x7f6c7c160430 2023-11-04T01:40:21.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.776+0000 7f6c80ca9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c1f2940 con 0x7f6c7c06c1d0 2023-11-04T01:40:21.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c73fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c7c0b2b60 0x7f6c7c0d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c73fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c7c0b2b60 0x7f6c7c0d0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48276/0 (socket says 172.21.15.44:48276) 2023-11-04T01:40:21.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c73fff640 1 -- 172.21.15.44:0/1471650811 learned_addr learned my addr 172.21.15.44:0/1471650811 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:21.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c7a59c640 1 --2- 172.21.15.44:0/1471650811 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c06c1d0 0x7f6c7c1f65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c7ad9d640 1 --2- 172.21.15.44:0/1471650811 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c7c160430 0x7f6c7c0d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c73fff640 1 -- 172.21.15.44:0/1471650811 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c06c1d0 msgr2=0x7f6c7c1f65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c73fff640 1 --2- 172.21.15.44:0/1471650811 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c06c1d0 0x7f6c7c1f65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c73fff640 1 -- 172.21.15.44:0/1471650811 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c7c160430 msgr2=0x7f6c7c0d1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c73fff640 1 --2- 172.21.15.44:0/1471650811 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c7c160430 0x7f6c7c0d1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c73fff640 1 -- 172.21.15.44:0/1471650811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c74009b30 con 0x7f6c7c0b2b60 2023-11-04T01:40:21.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c73fff640 1 --2- 172.21.15.44:0/1471650811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c7c0b2b60 0x7f6c7c0d0b30 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400c7c0 tx=0x7f6c6400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c72ffd640 1 -- 172.21.15.44:0/1471650811 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64007a30 con 0x7f6c7c0b2b60 2023-11-04T01:40:21.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c80ca9640 1 -- 172.21.15.44:0/1471650811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c1f2c20 con 0x7f6c7c0b2b60 2023-11-04T01:40:21.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c72ffd640 1 -- 172.21.15.44:0/1471650811 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c64007b90 con 0x7f6c7c0b2b60 2023-11-04T01:40:21.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c72ffd640 1 -- 172.21.15.44:0/1471650811 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6400ce70 con 0x7f6c7c0b2b60 2023-11-04T01:40:21.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.777+0000 7f6c80ca9640 1 -- 172.21.15.44:0/1471650811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c154570 con 0x7f6c7c0b2b60 2023-11-04T01:40:21.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.779+0000 7f6c72ffd640 1 -- 172.21.15.44:0/1471650811 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c640113f0 con 0x7f6c7c0b2b60 2023-11-04T01:40:21.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.780+0000 7f6c72ffd640 1 --2- 172.21.15.44:0/1471650811 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6c5c06aea0 0x7f6c5c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.780+0000 7f6c72ffd640 1 -- 172.21.15.44:0/1471650811 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f6c64089d40 con 0x7f6c7c0b2b60 2023-11-04T01:40:21.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.780+0000 7f6c7a59c640 1 --2- 172.21.15.44:0/1471650811 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6c5c06aea0 0x7f6c5c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.780+0000 7f6c83839740 1 Processor -- start 2023-11-04T01:40:21.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.780+0000 7f6c7a59c640 1 --2- 172.21.15.44:0/1471650811 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6c5c06aea0 0x7f6c5c06d360 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0d1740 tx=0x7f6c6c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.781+0000 7f6c83839740 1 -- start start 2023-11-04T01:40:21.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.781+0000 7f6c83839740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49c850 0x5617da46f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.781+0000 7f6c83839740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da49cc30 0x5617da49f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.781+0000 7f6c83839740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da46fc90 0x5617da49fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.781+0000 7f6c83839740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617da380740 con 0x5617da46fc90 2023-11-04T01:40:21.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.781+0000 7f6c83839740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617da3e28d0 con 0x5617da49c850 2023-11-04T01:40:21.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.781+0000 7f6c83839740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5617da3dffc0 con 0x5617da49cc30 2023-11-04T01:40:21.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.781+0000 7f6c7ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da46fc90 0x5617da49fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.781+0000 7f6c7ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da46fc90 0x5617da49fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48284/0 (socket says 172.21.15.44:48284) 2023-11-04T01:40:21.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.781+0000 7f6c7ad9d640 1 -- 172.21.15.44:0/2337300141 learned_addr learned my addr 172.21.15.44:0/2337300141 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.782+0000 7f6c73fff640 1 --2- 172.21.15.44:0/2337300141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da49cc30 0x5617da49f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.782+0000 7f6c7a59c640 1 --2- 172.21.15.44:0/2337300141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49c850 0x5617da46f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.782+0000 7f6c7ad9d640 1 -- 172.21.15.44:0/2337300141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da49cc30 msgr2=0x5617da49f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.782+0000 7f6c7ad9d640 1 --2- 172.21.15.44:0/2337300141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da49cc30 0x5617da49f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.782+0000 7f6c7ad9d640 1 -- 172.21.15.44:0/2337300141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49c850 msgr2=0x5617da46f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.782+0000 7f6c7ad9d640 1 --2- 172.21.15.44:0/2337300141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49c850 0x5617da46f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.782+0000 7f6c7ad9d640 1 -- 172.21.15.44:0/2337300141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617da39eca0 con 0x5617da46fc90 2023-11-04T01:40:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.782+0000 7f6c7ad9d640 1 --2- 172.21.15.44:0/2337300141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da46fc90 0x5617da49fb20 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f6c7402bf10 tx=0x7f6c7402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a0487dfb6ecbd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.782+0000 7f6c5bfff640 1 -- 172.21.15.44:0/2337300141 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7403f440 con 0x5617da46fc90 2023-11-04T01:40:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.782+0000 7f6c5bfff640 1 -- 172.21.15.44:0/2337300141 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7403f5a0 con 0x5617da46fc90 2023-11-04T01:40:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.782+0000 7f6c5bfff640 1 -- 172.21.15.44:0/2337300141 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7403f910 con 0x5617da46fc90 2023-11-04T01:40:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.783+0000 7f6c83839740 1 -- 172.21.15.44:0/2337300141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da46fc90 msgr2=0x5617da49fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.783+0000 7f6c83839740 1 --2- 172.21.15.44:0/2337300141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da46fc90 0x5617da49fb20 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f6c7402bf10 tx=0x7f6c7402e000 comp rx=0 tx=0).stop 2023-11-04T01:40:21.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.783+0000 7f6c83839740 1 -- 172.21.15.44:0/2337300141 shutdown_connections 2023-11-04T01:40:21.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.783+0000 7f6c83839740 1 --2- 172.21.15.44:0/2337300141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da46fc90 0x5617da49fb20 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.783+0000 7f6c83839740 1 --2- 172.21.15.44:0/2337300141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da49cc30 0x5617da49f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.783+0000 7f6c83839740 1 --2- 172.21.15.44:0/2337300141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49c850 0x5617da46f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.783+0000 7f6c83839740 1 -- 172.21.15.44:0/2337300141 >> 172.21.15.44:0/2337300141 conn(0x5617da471a60 msgr2=0x5617da4ba5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.783+0000 7f6c83839740 1 -- 172.21.15.44:0/2337300141 shutdown_connections 2023-11-04T01:40:21.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.783+0000 7f6c83839740 1 -- 172.21.15.44:0/2337300141 wait complete. 2023-11-04T01:40:21.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.783+0000 7f6c83839740 1 -- start start 2023-11-04T01:40:21.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.783+0000 7f6c83839740 1 Processor -- start 2023-11-04T01:40:21.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.784+0000 7f6c83839740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da49c850 0x5617da4cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.784+0000 7f6c83839740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49cc30 0x5617da49b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.784+0000 7f6c83839740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da4bb070 0x5617da4976e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.784+0000 7f6c83839740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617da3db8b0 con 0x5617da49c850 2023-11-04T01:40:21.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.784+0000 7f6c83839740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617da395c80 con 0x5617da49cc30 2023-11-04T01:40:21.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.784+0000 7f6c83839740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5617da395920 con 0x5617da4bb070 2023-11-04T01:40:21.795 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.784+0000 7f6c83839740 10 client.0 _ll_register_callbacks cb 0x5617da0edac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:21.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.784+0000 7f6c7a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da49c850 0x5617da4cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.784+0000 7f6c7a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da49c850 0x5617da4cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48292/0 (socket says 172.21.15.44:48292) 2023-11-04T01:40:21.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.784+0000 7f6c7a59c640 1 -- 172.21.15.44:0/1803855395 learned_addr learned my addr 172.21.15.44:0/1803855395 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:21.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.784+0000 7f6c73fff640 1 --2- 172.21.15.44:0/1803855395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49cc30 0x5617da49b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c7ad9d640 1 --2- 172.21.15.44:0/1803855395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da4bb070 0x5617da4976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c7a59c640 1 -- 172.21.15.44:0/1803855395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da4bb070 msgr2=0x5617da4976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c7a59c640 1 --2- 172.21.15.44:0/1803855395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da4bb070 0x5617da4976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c7a59c640 1 -- 172.21.15.44:0/1803855395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49cc30 msgr2=0x5617da49b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c7a59c640 1 --2- 172.21.15.44:0/1803855395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49cc30 0x5617da49b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c7a59c640 1 -- 172.21.15.44:0/1803855395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c06cd20 con 0x5617da49c850 2023-11-04T01:40:21.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c7a59c640 1 --2- 172.21.15.44:0/1803855395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da49c850 0x5617da4cb440 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00ff60 tx=0x7f6c6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fb87846511ca4e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c597fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:40:21.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c597fa640 1 -- 172.21.15.44:0/1803855395 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c013870 con 0x5617da49c850 2023-11-04T01:40:21.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c597fa640 1 -- 172.21.15.44:0/1803855395 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f6c6c0139d0 con 0x5617da49c850 2023-11-04T01:40:21.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c83839740 1 -- 172.21.15.44:0/1803855395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5617da387bf0 con 0x5617da49c850 2023-11-04T01:40:21.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c597fa640 1 -- 172.21.15.44:0/1803855395 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c6c013b90 con 0x5617da49c850 2023-11-04T01:40:21.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c83839740 10 client.7725 fetch_fsmap learned FSMap version 59 2023-11-04T01:40:21.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c83839740 1 -- 172.21.15.44:0/1803855395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x5617da3d9f30 con 0x5617da49c850 2023-11-04T01:40:21.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c597fa640 1 -- 172.21.15.44:0/1803855395 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5617da387bf0 con 0x5617da49c850 2023-11-04T01:40:21.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.785+0000 7f6c597fa640 1 -- 172.21.15.44:0/1803855395 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 59) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6c6c011040 con 0x5617da49c850 2023-11-04T01:40:21.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.786+0000 7f6c83839740 10 client.7725 fetch_fsmap finished waiting for FSMap version 59 2023-11-04T01:40:21.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.786+0000 7f6c83839740 10 client.7725 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:40:21.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.786+0000 7f6c83839740 20 client.7725 populate_metadata read hostname 'smithi044' 2023-11-04T01:40:21.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.786+0000 7f6c83839740 1 --2- 172.21.15.44:0/1803855395 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x5617da4a1950 0x5617da4a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.786+0000 7f6c83839740 4 client.7725 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:21.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.786+0000 7f6c83839740 1 -- 172.21.15.44:0/1803855395 --> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5617da3d4890 con 0x5617da4a1950 2023-11-04T01:40:21.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.786+0000 7f6c73fff640 1 --2- 172.21.15.44:0/1803855395 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x5617da4a1950 0x5617da4a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.786+0000 7f6c73fff640 1 --2- 172.21.15.44:0/1803855395 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x5617da4a1950 0x5617da4a1d30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=87c77d6254d7037 server_cookie=78f45659fed2c854 in_seq=0 out_seq=0 2023-11-04T01:40:21.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.786+0000 7f6c597fa640 10 client.7725 ms_handle_connect on v2:172.21.15.44:6832/2069525699 2023-11-04T01:40:21.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.786+0000 7f6c597fa640 1 -- 172.21.15.44:0/1803855395 <== mds.1 v2:172.21.15.44:6832/2069525699 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5617da3d4890 con 0x5617da4a1950 2023-11-04T01:40:21.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.786+0000 7f6c597fa640 10 client.7725 handle_command_reply: tid=0 2023-11-04T01:40:21.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.787+0000 7f6c83839740 1 client.7725 shutdown 2023-11-04T01:40:21.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.787+0000 7f6c83839740 1 -- 172.21.15.44:0/1803855395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da49c850 msgr2=0x5617da4cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.787+0000 7f6c83839740 1 --2- 172.21.15.44:0/1803855395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da49c850 0x5617da4cb440 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00ff60 tx=0x7f6c6c004730 comp rx=0 tx=0).stop 2023-11-04T01:40:21.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.787+0000 7f6c83839740 1 -- 172.21.15.44:0/1803855395 shutdown_connections 2023-11-04T01:40:21.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.787+0000 7f6c83839740 1 --2- 172.21.15.44:0/1803855395 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x5617da4a1950 0x5617da4a1d30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.787+0000 7f6c83839740 1 --2- 172.21.15.44:0/1803855395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da4bb070 0x5617da4976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.787+0000 7f6c83839740 1 --2- 172.21.15.44:0/1803855395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49cc30 0x5617da49b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.787+0000 7f6c597fa640 0 client.7725 ms_handle_reset on v2:172.21.15.44:6832/2069525699 2023-11-04T01:40:21.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.787+0000 7f6c83839740 1 --2- 172.21.15.44:0/1803855395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da49c850 0x5617da4cb440 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.787+0000 7f6c83839740 1 -- 172.21.15.44:0/1803855395 >> 172.21.15.44:0/1803855395 conn(0x5617da46fc90 msgr2=0x5617da473770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.787+0000 7f6c83839740 1 -- 172.21.15.44:0/1803855395 shutdown_connections 2023-11-04T01:40:21.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.787+0000 7f6c83839740 1 -- 172.21.15.44:0/1803855395 wait complete. 2023-11-04T01:40:21.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.787+0000 7f6c83839740 20 client.7725 trim_cache size 0 max 16384 2023-11-04T01:40:21.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.803+0000 7f6c83839740 1 Processor -- start 2023-11-04T01:40:21.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.803+0000 7f6c83839740 1 -- start start 2023-11-04T01:40:21.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.803+0000 7f6c83839740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49c850 0x5617da4a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.803+0000 7f6c83839740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da49cc30 0x5617da46e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.803+0000 7f6c83839740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da4bb070 0x5617da46ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.803+0000 7f6c83839740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617da35b280 con 0x5617da49cc30 2023-11-04T01:40:21.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.803+0000 7f6c83839740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617da46af30 con 0x5617da49c850 2023-11-04T01:40:21.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.803+0000 7f6c83839740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5617da46ad30 con 0x5617da4bb070 2023-11-04T01:40:21.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.803+0000 7f6c73fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da49cc30 0x5617da46e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.803+0000 7f6c73fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da49cc30 0x5617da46e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48296/0 (socket says 172.21.15.44:48296) 2023-11-04T01:40:21.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.803+0000 7f6c73fff640 1 -- 172.21.15.44:0/904119154 learned_addr learned my addr 172.21.15.44:0/904119154 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:21.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c73fff640 1 -- 172.21.15.44:0/904119154 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da4bb070 msgr2=0x5617da46ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c73fff640 1 --2- 172.21.15.44:0/904119154 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da4bb070 0x5617da46ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c73fff640 1 -- 172.21.15.44:0/904119154 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49c850 msgr2=0x5617da4a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c73fff640 1 --2- 172.21.15.44:0/904119154 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49c850 0x5617da4a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c73fff640 1 -- 172.21.15.44:0/904119154 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617da377d10 con 0x5617da49cc30 2023-11-04T01:40:21.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c73fff640 1 --2- 172.21.15.44:0/904119154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da49cc30 0x5617da46e4f0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f6c640548f0 tx=0x7f6c64087aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5358c12c8282f874 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c70ff9640 1 -- 172.21.15.44:0/904119154 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64087ce0 con 0x5617da49cc30 2023-11-04T01:40:21.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c70ff9640 1 -- 172.21.15.44:0/904119154 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c640567e0 con 0x5617da49cc30 2023-11-04T01:40:21.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c70ff9640 1 -- 172.21.15.44:0/904119154 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6405c120 con 0x5617da49cc30 2023-11-04T01:40:21.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c83839740 1 -- 172.21.15.44:0/904119154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da49cc30 msgr2=0x5617da46e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c83839740 1 --2- 172.21.15.44:0/904119154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da49cc30 0x5617da46e4f0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f6c640548f0 tx=0x7f6c64087aa0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c83839740 1 -- 172.21.15.44:0/904119154 shutdown_connections 2023-11-04T01:40:21.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c83839740 1 --2- 172.21.15.44:0/904119154 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da4bb070 0x5617da46ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c83839740 1 --2- 172.21.15.44:0/904119154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da49cc30 0x5617da46e4f0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c83839740 1 --2- 172.21.15.44:0/904119154 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49c850 0x5617da4a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c83839740 1 -- 172.21.15.44:0/904119154 >> 172.21.15.44:0/904119154 conn(0x5617da46fc90 msgr2=0x5617da4dd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c83839740 1 -- 172.21.15.44:0/904119154 shutdown_connections 2023-11-04T01:40:21.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.804+0000 7f6c83839740 1 -- 172.21.15.44:0/904119154 wait complete. 2023-11-04T01:40:21.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.805+0000 7f6c83839740 1 -- start start 2023-11-04T01:40:21.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.805+0000 7f6c83839740 1 Processor -- start 2023-11-04T01:40:21.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.806+0000 7f6c83839740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49c850 0x5617da51b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.806+0000 7f6c83839740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da49cc30 0x5617da4a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.806+0000 7f6c83839740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da4bb070 0x5617da49f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.806+0000 7f6c83839740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617da51bc60 con 0x5617da4bb070 2023-11-04T01:40:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.806+0000 7f6c83839740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617da527010 con 0x5617da49c850 2023-11-04T01:40:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.806+0000 7f6c83839740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5617da4a11b0 con 0x5617da49cc30 2023-11-04T01:40:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.806+0000 7f6c83839740 10 client.0 _ll_register_callbacks cb 0x7f6c74009510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.806+0000 7f6c7ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da4bb070 0x5617da49f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.806+0000 7f6c7ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da4bb070 0x5617da49f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48300/0 (socket says 172.21.15.44:48300) 2023-11-04T01:40:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.806+0000 7f6c7ad9d640 1 -- 172.21.15.44:0/225094182 learned_addr learned my addr 172.21.15.44:0/225094182 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.806+0000 7f6c7ad9d640 1 -- 172.21.15.44:0/225094182 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da49cc30 msgr2=0x5617da4a04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.806+0000 7f6c7ad9d640 1 --2- 172.21.15.44:0/225094182 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da49cc30 0x5617da4a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.806+0000 7f6c7ad9d640 1 -- 172.21.15.44:0/225094182 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49c850 msgr2=0x5617da51b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.806+0000 7f6c7ad9d640 1 --2- 172.21.15.44:0/225094182 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49c850 0x5617da51b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.806+0000 7f6c7ad9d640 1 -- 172.21.15.44:0/225094182 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c154570 con 0x5617da4bb070 2023-11-04T01:40:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c7ad9d640 1 --2- 172.21.15.44:0/225094182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da4bb070 0x5617da49f300 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009f40 tx=0x7f6c74004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3ef1b873e6bd4a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c597fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:40:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c597fa640 1 -- 172.21.15.44:0/225094182 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74051070 con 0x5617da4bb070 2023-11-04T01:40:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c597fa640 1 -- 172.21.15.44:0/225094182 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f6c7403fb50 con 0x5617da4bb070 2023-11-04T01:40:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c83839740 1 -- 172.21.15.44:0/225094182 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c7403f5a0 con 0x5617da4bb070 2023-11-04T01:40:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c597fa640 1 -- 172.21.15.44:0/225094182 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c7403f440 con 0x5617da4bb070 2023-11-04T01:40:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c83839740 10 client.7731 fetch_fsmap learned FSMap version 59 2023-11-04T01:40:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c83839740 1 -- 172.21.15.44:0/225094182 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x5617da39d500 con 0x5617da4bb070 2023-11-04T01:40:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c597fa640 1 -- 172.21.15.44:0/225094182 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7403f5a0 con 0x5617da4bb070 2023-11-04T01:40:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c597fa640 1 -- 172.21.15.44:0/225094182 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 59) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6c74054020 con 0x5617da4bb070 2023-11-04T01:40:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c83839740 10 client.7731 fetch_fsmap finished waiting for FSMap version 59 2023-11-04T01:40:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c83839740 10 client.7731 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:40:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c83839740 20 client.7731 populate_metadata read hostname 'smithi044' 2023-11-04T01:40:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c83839740 1 --2- 172.21.15.44:0/225094182 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x5617da526050 0x5617da526430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c83839740 4 client.7731 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c83839740 1 -- 172.21.15.44:0/225094182 --> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5617da3d45b0 con 0x5617da526050 2023-11-04T01:40:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.807+0000 7f6c7a59c640 1 --2- 172.21.15.44:0/225094182 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x5617da526050 0x5617da526430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c597fa640 10 client.7731 ms_handle_connect on v2:172.21.15.44:6832/2069525699 2023-11-04T01:40:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c7a59c640 1 --2- 172.21.15.44:0/225094182 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x5617da526050 0x5617da526430 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=19266be4ee51baa5 server_cookie=38a7abd5ad66eb46 in_seq=0 out_seq=0 2023-11-04T01:40:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c597fa640 1 -- 172.21.15.44:0/225094182 <== mds.1 v2:172.21.15.44:6832/2069525699 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5617da3d45b0 con 0x5617da526050 2023-11-04T01:40:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c597fa640 10 client.7731 handle_command_reply: tid=0 2023-11-04T01:40:21.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c83839740 1 client.7731 shutdown 2023-11-04T01:40:21.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c83839740 1 -- 172.21.15.44:0/225094182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da4bb070 msgr2=0x5617da49f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c83839740 1 --2- 172.21.15.44:0/225094182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da4bb070 0x5617da49f300 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009f40 tx=0x7f6c74004ab0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c83839740 1 -- 172.21.15.44:0/225094182 shutdown_connections 2023-11-04T01:40:21.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c83839740 1 --2- 172.21.15.44:0/225094182 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x5617da526050 0x5617da526430 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c83839740 1 --2- 172.21.15.44:0/225094182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da4bb070 0x5617da49f300 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c83839740 1 --2- 172.21.15.44:0/225094182 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617da49cc30 0x5617da4a04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c597fa640 0 client.7731 ms_handle_reset on v2:172.21.15.44:6832/2069525699 2023-11-04T01:40:21.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c83839740 1 --2- 172.21.15.44:0/225094182 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617da49c850 0x5617da51b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c83839740 1 -- 172.21.15.44:0/225094182 >> 172.21.15.44:0/225094182 conn(0x5617da46fc90 msgr2=0x5617da473560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c83839740 1 -- 172.21.15.44:0/225094182 shutdown_connections 2023-11-04T01:40:21.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c83839740 1 -- 172.21.15.44:0/225094182 wait complete. 2023-11-04T01:40:21.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.808+0000 7f6c83839740 20 client.7731 trim_cache size 0 max 16384 2023-11-04T01:40:21.818 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:40:21.818 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:40:21.818 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 1, 2023-11-04T01:40:21.818 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7344, 2023-11-04T01:40:21.818 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:40:21.818 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:40:21.818 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:40:21.818 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 41.442759574, 2023-11-04T01:40:21.819 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 59, 2023-11-04T01:40:21.819 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 99, 2023-11-04T01:40:21.819 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 99, 2023-11-04T01:40:21.819 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 57.302097625999998 2023-11-04T01:40:21.819 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:40:21.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.809+0000 7f6c80ca9640 1 -- 172.21.15.44:0/1471650811 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6c5c06aea0 msgr2=0x7f6c5c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.809+0000 7f6c80ca9640 1 --2- 172.21.15.44:0/1471650811 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6c5c06aea0 0x7f6c5c06d360 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0d1740 tx=0x7f6c6c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:21.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.809+0000 7f6c80ca9640 1 -- 172.21.15.44:0/1471650811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c7c0b2b60 msgr2=0x7f6c7c0d0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.809+0000 7f6c80ca9640 1 --2- 172.21.15.44:0/1471650811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c7c0b2b60 0x7f6c7c0d0b30 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400c7c0 tx=0x7f6c6400cc80 comp rx=0 tx=0).stop 2023-11-04T01:40:21.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.809+0000 7f6c80ca9640 1 -- 172.21.15.44:0/1471650811 shutdown_connections 2023-11-04T01:40:21.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.809+0000 7f6c80ca9640 1 --2- 172.21.15.44:0/1471650811 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f6c5c06aea0 0x7f6c5c06d360 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.809+0000 7f6c80ca9640 1 --2- 172.21.15.44:0/1471650811 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c7c160430 0x7f6c7c0d1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.809+0000 7f6c80ca9640 1 --2- 172.21.15.44:0/1471650811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c7c0b2b60 0x7f6c7c0d0b30 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.809+0000 7f6c80ca9640 1 --2- 172.21.15.44:0/1471650811 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c06c1d0 0x7f6c7c1f65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.809+0000 7f6c80ca9640 1 -- 172.21.15.44:0/1471650811 >> 172.21.15.44:0/1471650811 conn(0x7f6c7c06ea20 msgr2=0x7f6c7c0ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.809+0000 7f6c80ca9640 1 -- 172.21.15.44:0/1471650811 shutdown_connections 2023-11-04T01:40:21.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.809+0000 7f6c80ca9640 1 -- 172.21.15.44:0/1471650811 wait complete. 2023-11-04T01:40:21.823 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:21.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.927+0000 7fee4ca1a640 1 Processor -- start 2023-11-04T01:40:21.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.927+0000 7fee4ca1a640 1 -- start start 2023-11-04T01:40:21.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.928+0000 7fee4ca1a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee4815bfb0 0x7fee480cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.928+0000 7fee4ca1a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fee480cd860 0x7fee480ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.928+0000 7fee4ca1a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee480cc450 con 0x7fee4815ae40 2023-11-04T01:40:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.928+0000 7fee4ca1a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4815f400 con 0x7fee480cd860 2023-11-04T01:40:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.928+0000 7fee4ca1a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4815b220 con 0x7fee4815bfb0 2023-11-04T01:40:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.928+0000 7fee46d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fee480cd860 0x7fee480ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.928+0000 7fee46d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fee480cd860 0x7fee480ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48310/0 (socket says 172.21.15.44:48310) 2023-11-04T01:40:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.928+0000 7fee46d9d640 1 -- 172.21.15.44:0/4180615709 learned_addr learned my addr 172.21.15.44:0/4180615709 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.928+0000 7fee45d9b640 1 --2- 172.21.15.44:0/4180615709 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee4815bfb0 0x7fee480cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.929+0000 7fee46d9d640 1 -- 172.21.15.44:0/4180615709 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee4815bfb0 msgr2=0x7fee480cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.929+0000 7fee46d9d640 1 --2- 172.21.15.44:0/4180615709 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee4815bfb0 0x7fee480cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.929+0000 7fee46d9d640 1 -- 172.21.15.44:0/4180615709 >> v1:172.21.15.204:6789/0 conn(0x7fee4815ae40 legacy=0x7fee480cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.929+0000 7fee46d9d640 1 -- 172.21.15.44:0/4180615709 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4815f890 con 0x7fee480cd860 2023-11-04T01:40:21.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.929+0000 7fee46d9d640 1 --2- 172.21.15.44:0/4180615709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee480cd860 0x7fee480ced70 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fee38009e50 tx=0x7fee3802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd2e1ba487b85e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.929+0000 7fee4559a640 1 -- 172.21.15.44:0/4180615709 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3802cb00 con 0x7fee480cd860 2023-11-04T01:40:21.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.930+0000 7fee4559a640 1 -- 172.21.15.44:0/4180615709 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3802cc60 con 0x7fee480cd860 2023-11-04T01:40:21.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.930+0000 7fee4559a640 1 -- 172.21.15.44:0/4180615709 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee380343f0 con 0x7fee480cd860 2023-11-04T01:40:21.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.930+0000 7fee4ca1a640 1 -- 172.21.15.44:0/4180615709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee480cd860 msgr2=0x7fee480ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.930+0000 7fee4ca1a640 1 --2- 172.21.15.44:0/4180615709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee480cd860 0x7fee480ced70 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fee38009e50 tx=0x7fee3802bf60 comp rx=0 tx=0).stop 2023-11-04T01:40:21.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.930+0000 7fee4ca1a640 1 -- 172.21.15.44:0/4180615709 shutdown_connections 2023-11-04T01:40:21.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.930+0000 7fee4ca1a640 1 --2- 172.21.15.44:0/4180615709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee480cd860 0x7fee480ced70 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.930+0000 7fee4ca1a640 1 --2- 172.21.15.44:0/4180615709 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee4815bfb0 0x7fee480cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.930+0000 7fee4ca1a640 1 -- 172.21.15.44:0/4180615709 >> 172.21.15.44:0/4180615709 conn(0x7fee4806ea90 msgr2=0x7fee4806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.930+0000 7fee4ca1a640 1 -- 172.21.15.44:0/4180615709 shutdown_connections 2023-11-04T01:40:21.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.930+0000 7fee4ca1a640 1 -- 172.21.15.44:0/4180615709 wait complete. 2023-11-04T01:40:21.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.931+0000 7fee4ca1a640 1 Processor -- start 2023-11-04T01:40:21.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.931+0000 7fee4ca1a640 1 -- start start 2023-11-04T01:40:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.932+0000 7fee4ca1a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee480cd860 0x7fee480c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.932+0000 7fee4ca1a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee4815ae40 0x7fee480b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.932+0000 7fee4ca1a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee4815bfb0 0x7fee480b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.932+0000 7fee4ca1a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee480c8b40 con 0x7fee4815bfb0 2023-11-04T01:40:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.932+0000 7fee4ca1a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee480b2900 con 0x7fee4815ae40 2023-11-04T01:40:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.932+0000 7fee4ca1a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee480b2b80 con 0x7fee480cd860 2023-11-04T01:40:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.932+0000 7fee46d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee4815bfb0 0x7fee480b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.932+0000 7fee46d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee4815bfb0 0x7fee480b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48324/0 (socket says 172.21.15.44:48324) 2023-11-04T01:40:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.932+0000 7fee46d9d640 1 -- 172.21.15.44:0/3137266879 learned_addr learned my addr 172.21.15.44:0/3137266879 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.933+0000 7fee46d9d640 1 -- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee480cd860 msgr2=0x7fee480c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.933+0000 7fee4659c640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee480cd860 0x7fee480c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.933+0000 7fee45d9b640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee4815ae40 0x7fee480b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.933+0000 7fee46d9d640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee480cd860 0x7fee480c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.933+0000 7fee46d9d640 1 -- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee4815ae40 msgr2=0x7fee480b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.933+0000 7fee46d9d640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee4815ae40 0x7fee480b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.933+0000 7fee46d9d640 1 -- 172.21.15.44:0/3137266879 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee38009b30 con 0x7fee4815bfb0 2023-11-04T01:40:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.933+0000 7fee4659c640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee480cd860 0x7fee480c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.933+0000 7fee45d9b640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee4815ae40 0x7fee480b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.933+0000 7fee46d9d640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee4815bfb0 0x7fee480b0600 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fee38009e50 tx=0x7fee38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.933+0000 7fee3effd640 1 -- 172.21.15.44:0/3137266879 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38009510 con 0x7fee4815bfb0 2023-11-04T01:40:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.933+0000 7fee3effd640 1 -- 172.21.15.44:0/3137266879 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3803e450 con 0x7fee4815bfb0 2023-11-04T01:40:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.933+0000 7fee4ca1a640 1 -- 172.21.15.44:0/3137266879 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee480b2e60 con 0x7fee4815bfb0 2023-11-04T01:40:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.933+0000 7fee3effd640 1 -- 172.21.15.44:0/3137266879 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3803e800 con 0x7fee4815bfb0 2023-11-04T01:40:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.933+0000 7fee4ca1a640 1 -- 172.21.15.44:0/3137266879 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee480c90a0 con 0x7fee4815bfb0 2023-11-04T01:40:21.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.934+0000 7fee4ca1a640 1 -- 172.21.15.44:0/3137266879 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee480ce2d0 con 0x7fee4815bfb0 2023-11-04T01:40:21.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.935+0000 7fee3effd640 1 -- 172.21.15.44:0/3137266879 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee3803e960 con 0x7fee4815bfb0 2023-11-04T01:40:21.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.935+0000 7fee3effd640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fee2806ae70 0x7fee2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.935+0000 7fee3effd640 1 -- 172.21.15.44:0/3137266879 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7fee380ac930 con 0x7fee4815bfb0 2023-11-04T01:40:21.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.935+0000 7fee4659c640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fee2806ae70 0x7fee2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.936+0000 7fee4659c640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fee2806ae70 0x7fee2806d330 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fee40000f60 tx=0x7fee40009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:21.939+0000 7fee3effd640 1 -- 172.21.15.44:0/3137266879 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fee380773e0 con 0x7fee4815bfb0 2023-11-04T01:40:22.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.153+0000 7fee4ca1a640 1 -- 172.21.15.44:0/3137266879 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee480c9290 con 0x7fee4815bfb0 2023-11-04T01:40:22.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.154+0000 7fee3effd640 1 -- 172.21.15.44:0/3137266879 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4934 (secure 0 0 0) 0x7fee3807aa00 con 0x7fee4815bfb0 2023-11-04T01:40:22.156 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:22.156 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":59,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6820,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:18.052966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6562,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6562":{"gid":6562,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":17,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:22.156 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 59 2023-11-04T01:40:22.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.156+0000 7fee4ca1a640 1 -- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fee2806ae70 msgr2=0x7fee2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.156+0000 7fee4ca1a640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fee2806ae70 0x7fee2806d330 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fee40000f60 tx=0x7fee40009040 comp rx=0 tx=0).stop 2023-11-04T01:40:22.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.156+0000 7fee4ca1a640 1 -- 172.21.15.44:0/3137266879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee4815bfb0 msgr2=0x7fee480b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.156+0000 7fee4ca1a640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee4815bfb0 0x7fee480b0600 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fee38009e50 tx=0x7fee38004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:22.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.156+0000 7fee4ca1a640 1 -- 172.21.15.44:0/3137266879 shutdown_connections 2023-11-04T01:40:22.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.156+0000 7fee4ca1a640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fee2806ae70 0x7fee2806d330 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.156+0000 7fee4ca1a640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee4815bfb0 0x7fee480b0600 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.156+0000 7fee4ca1a640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee4815ae40 0x7fee480b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.156+0000 7fee4ca1a640 1 --2- 172.21.15.44:0/3137266879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee480cd860 0x7fee480c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.156+0000 7fee4ca1a640 1 -- 172.21.15.44:0/3137266879 >> 172.21.15.44:0/3137266879 conn(0x7fee4806ea90 msgr2=0x7fee480ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:22.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.156+0000 7fee4ca1a640 1 -- 172.21.15.44:0/3137266879 shutdown_connections 2023-11-04T01:40:22.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.156+0000 7fee4ca1a640 1 -- 172.21.15.44:0/3137266879 wait complete. 2023-11-04T01:40:22.168 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:40:22.288 INFO:teuthology.orchestra.run.smithi044.stdout:{"last_snap":2,"last_created":2,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:39:52.563500+0000","name":"s11","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:40:22.289 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 2, "last_destroyed": 1, "last_snap": 2, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:39:52.563500+0000" } ] } 2023-11-04T01:40:22.289 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:40:22.290 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=2 2023-11-04T01:40:22.290 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:22.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.395+0000 7f7126e26640 1 Processor -- start 2023-11-04T01:40:22.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.395+0000 7f7126e26640 1 -- start start 2023-11-04T01:40:22.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.396+0000 7f7126e26640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f712015ae40 0x7f712015bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.396+0000 7f7126e26640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f71200cbc00 0x7f71200cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.396+0000 7f7126e26640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71200cc450 con 0x7f71200cd860 2023-11-04T01:40:22.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.396+0000 7f7126e26640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712015f400 con 0x7f712015ae40 2023-11-04T01:40:22.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.396+0000 7f7126e26640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712015b220 con 0x7f71200cbc00 2023-11-04T01:40:22.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.396+0000 7f7124bc2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f712015ae40 0x7f712015bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.396+0000 7f71253c3640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f71200cd860 0x7f71200b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41336/0 (socket says 172.21.15.44:41336) 2023-11-04T01:40:22.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.396+0000 7f71253c3640 1 -- 172.21.15.44:0/893352431 learned_addr learned my addr 172.21.15.44:0/893352431 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:22.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.396+0000 7f7117fff640 1 --2- 172.21.15.44:0/893352431 >> v2:172.21.15.204:3300/0 conn(0x7f71200cbc00 0x7f71200cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.396+0000 7f7124bc2640 1 -- 172.21.15.44:0/893352431 >> v2:172.21.15.204:3300/0 conn(0x7f71200cbc00 msgr2=0x7f71200cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:22.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.396+0000 7f7124bc2640 1 --2- 172.21.15.44:0/893352431 >> v2:172.21.15.204:3300/0 conn(0x7f71200cbc00 0x7f71200cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.396+0000 7f7124bc2640 1 -- 172.21.15.44:0/893352431 >> v1:172.21.15.44:6789/0 conn(0x7f71200cd860 legacy=0x7f71200b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.396+0000 7f71177fe640 1 -- 172.21.15.44:0/893352431 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551800867 0 0) 0x7f7118001490 con 0x7f71200cd860 2023-11-04T01:40:22.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.396+0000 7f7124bc2640 1 -- 172.21.15.44:0/893352431 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712015f890 con 0x7f712015ae40 2023-11-04T01:40:22.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.396+0000 7f7117fff640 1 --2- 172.21.15.44:0/893352431 >> v2:172.21.15.204:3300/0 conn(0x7f71200cbc00 0x7f71200cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:22.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.397+0000 7f7124bc2640 1 --2- 172.21.15.44:0/893352431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f712015ae40 0x7f712015bfb0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f71200b05d0 tx=0x7f711c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94600adc097b579 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:22.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.397+0000 7f71177fe640 1 -- 172.21.15.44:0/893352431 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c031830 con 0x7f712015ae40 2023-11-04T01:40:22.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.397+0000 7f71177fe640 1 -- 172.21.15.44:0/893352431 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c031990 con 0x7f712015ae40 2023-11-04T01:40:22.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.397+0000 7f71177fe640 1 -- 172.21.15.44:0/893352431 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c031d20 con 0x7f712015ae40 2023-11-04T01:40:22.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.398+0000 7f7126e26640 1 -- 172.21.15.44:0/893352431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f712015ae40 msgr2=0x7f712015bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.398+0000 7f7126e26640 1 --2- 172.21.15.44:0/893352431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f712015ae40 0x7f712015bfb0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f71200b05d0 tx=0x7f711c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.398+0000 7f7126e26640 1 -- 172.21.15.44:0/893352431 shutdown_connections 2023-11-04T01:40:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.398+0000 7f7126e26640 1 --2- 172.21.15.44:0/893352431 >> v2:172.21.15.204:3300/0 conn(0x7f71200cbc00 0x7f71200cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.398+0000 7f7126e26640 1 --2- 172.21.15.44:0/893352431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f712015ae40 0x7f712015bfb0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.398+0000 7f7126e26640 1 -- 172.21.15.44:0/893352431 >> 172.21.15.44:0/893352431 conn(0x7f712006ea90 msgr2=0x7f712006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.398+0000 7f7126e26640 1 -- 172.21.15.44:0/893352431 shutdown_connections 2023-11-04T01:40:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.398+0000 7f7126e26640 1 -- 172.21.15.44:0/893352431 wait complete. 2023-11-04T01:40:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.399+0000 7f7126e26640 1 Processor -- start 2023-11-04T01:40:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.399+0000 7f7126e26640 1 -- start start 2023-11-04T01:40:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7126e26640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71200cbc00 0x7f7120157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7126e26640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71200cd860 0x7f71200b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7126e26640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f712015ae40 0x7f71200c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7126e26640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71201e5440 con 0x7f71200cbc00 2023-11-04T01:40:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7126e26640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71200c7c70 con 0x7f71200cd860 2023-11-04T01:40:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7126e26640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71201e5620 con 0x7f712015ae40 2023-11-04T01:40:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7124bc2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71200cbc00 0x7f7120157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7124bc2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71200cbc00 0x7f7120157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48350/0 (socket says 172.21.15.44:48350) 2023-11-04T01:40:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7124bc2640 1 -- 172.21.15.44:0/1463391098 learned_addr learned my addr 172.21.15.44:0/1463391098 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f71253c3640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f712015ae40 0x7f71200c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7117fff640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71200cd860 0x7f71200b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7124bc2640 1 -- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f712015ae40 msgr2=0x7f71200c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7124bc2640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f712015ae40 0x7f71200c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7124bc2640 1 -- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71200cd860 msgr2=0x7f71200b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7124bc2640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71200cd860 0x7f71200b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7124bc2640 1 -- 172.21.15.44:0/1463391098 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c009400 con 0x7f71200cbc00 2023-11-04T01:40:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7117fff640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71200cd860 0x7f71200b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f71253c3640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f712015ae40 0x7f71200c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f7124bc2640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71200cbc00 0x7f7120157830 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f711c000c00 tx=0x7f711c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f71157fa640 1 -- 172.21.15.44:0/1463391098 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c03aa60 con 0x7f71200cbc00 2023-11-04T01:40:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.400+0000 7f71157fa640 1 -- 172.21.15.44:0/1463391098 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c03abe0 con 0x7f71200cbc00 2023-11-04T01:40:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.401+0000 7f71157fa640 1 -- 172.21.15.44:0/1463391098 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c0443f0 con 0x7f71200cbc00 2023-11-04T01:40:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.401+0000 7f7126e26640 1 -- 172.21.15.44:0/1463391098 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71201e5900 con 0x7f71200cbc00 2023-11-04T01:40:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.401+0000 7f7126e26640 1 -- 172.21.15.44:0/1463391098 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71201e5ec0 con 0x7f71200cbc00 2023-11-04T01:40:22.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.402+0000 7f7126e26640 1 -- 172.21.15.44:0/1463391098 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71200ce2d0 con 0x7f71200cbc00 2023-11-04T01:40:22.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.402+0000 7f71157fa640 1 -- 172.21.15.44:0/1463391098 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f711c04d450 con 0x7f71200cbc00 2023-11-04T01:40:22.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.402+0000 7f71157fa640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f710c06ae70 0x7f710c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.403+0000 7f71157fa640 1 -- 172.21.15.44:0/1463391098 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f711c0abd80 con 0x7f71200cbc00 2023-11-04T01:40:22.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.403+0000 7f7117fff640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f710c06ae70 0x7f710c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.403+0000 7f7117fff640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f710c06ae70 0x7f710c06d330 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f71200cf320 tx=0x7f7110008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:22.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.407+0000 7f71157fa640 1 -- 172.21.15.44:0/1463391098 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f711c0768c0 con 0x7f71200cbc00 2023-11-04T01:40:22.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.617+0000 7f7126e26640 1 -- 172.21.15.44:0/1463391098 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7120074290 con 0x7f71200cbc00 2023-11-04T01:40:22.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.618+0000 7f71157fa640 1 -- 172.21.15.44:0/1463391098 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f711c035070 con 0x7f71200cbc00 2023-11-04T01:40:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:22.620 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":59,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6820,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:18.052966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6562,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6562":{"gid":6562,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":17,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:22.620 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 59 2023-11-04T01:40:22.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.620+0000 7f7126e26640 1 -- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f710c06ae70 msgr2=0x7f710c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.620+0000 7f7126e26640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f710c06ae70 0x7f710c06d330 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f71200cf320 tx=0x7f7110008040 comp rx=0 tx=0).stop 2023-11-04T01:40:22.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.620+0000 7f7126e26640 1 -- 172.21.15.44:0/1463391098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71200cbc00 msgr2=0x7f7120157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.620+0000 7f7126e26640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71200cbc00 0x7f7120157830 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f711c000c00 tx=0x7f711c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.620+0000 7f7126e26640 1 -- 172.21.15.44:0/1463391098 shutdown_connections 2023-11-04T01:40:22.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.620+0000 7f7126e26640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f710c06ae70 0x7f710c06d330 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.620+0000 7f7126e26640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f712015ae40 0x7f71200c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.620+0000 7f7126e26640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71200cd860 0x7f71200b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.620+0000 7f7126e26640 1 --2- 172.21.15.44:0/1463391098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71200cbc00 0x7f7120157830 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.620+0000 7f7126e26640 1 -- 172.21.15.44:0/1463391098 >> 172.21.15.44:0/1463391098 conn(0x7f712006ea90 msgr2=0x7f71200b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:22.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.620+0000 7f7126e26640 1 -- 172.21.15.44:0/1463391098 shutdown_connections 2023-11-04T01:40:22.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.620+0000 7f7126e26640 1 -- 172.21.15.44:0/1463391098 wait complete. 2023-11-04T01:40:22.633 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:40:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.739+0000 7fc0b16fc640 1 Processor -- start 2023-11-04T01:40:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.739+0000 7fc0b16fc640 1 -- start start 2023-11-04T01:40:22.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.740+0000 7fc0b16fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc0ac1605b0 0x7fc0ac0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.740+0000 7fc0b16fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc0ac06a830 0x7fc0ac0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.742 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.740+0000 7fc0b16fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0ac160990 con 0x7fc0ac0b1a40 2023-11-04T01:40:22.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.740+0000 7fc0b16fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ac0cc7c0 con 0x7fc0ac1605b0 2023-11-04T01:40:22.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.740+0000 7fc0b16fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ac0cd750 con 0x7fc0ac06a830 2023-11-04T01:40:22.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.740+0000 7fc0aaffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc0ac1605b0 0x7fc0ac0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.740+0000 7fc0aa7fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc0ac0b1a40 0x7fc0ac06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:53900/0 (socket says 172.21.15.44:53900) 2023-11-04T01:40:22.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.740+0000 7fc0aa7fc640 1 -- 172.21.15.44:0/4077427239 learned_addr learned my addr 172.21.15.44:0/4077427239 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:22.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.740+0000 7fc0ab7fe640 1 --2- 172.21.15.44:0/4077427239 >> v2:172.21.15.204:3300/0 conn(0x7fc0ac06a830 0x7fc0ac0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.740+0000 7fc0aaffd640 1 -- 172.21.15.44:0/4077427239 >> v2:172.21.15.204:3300/0 conn(0x7fc0ac06a830 msgr2=0x7fc0ac0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:22.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.740+0000 7fc0aaffd640 1 --2- 172.21.15.44:0/4077427239 >> v2:172.21.15.204:3300/0 conn(0x7fc0ac06a830 0x7fc0ac0cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.740+0000 7fc0aaffd640 1 -- 172.21.15.44:0/4077427239 >> v1:172.21.15.44:6789/0 conn(0x7fc0ac0b1a40 legacy=0x7fc0ac06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.740+0000 7fc0aaffd640 1 -- 172.21.15.44:0/4077427239 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac0cc4e0 con 0x7fc0ac1605b0 2023-11-04T01:40:22.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.740+0000 7fc0ab7fe640 1 --2- 172.21.15.44:0/4077427239 >> v2:172.21.15.204:3300/0 conn(0x7fc0ac06a830 0x7fc0ac0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.741+0000 7fc0aaffd640 1 --2- 172.21.15.44:0/4077427239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0ac1605b0 0x7fc0ac0ccbc0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac0c6aa0 tx=0x7fc09c02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7cdeeaa62abfcb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.741+0000 7fc0a9ffb640 1 -- 172.21.15.44:0/4077427239 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c031710 con 0x7fc0ac1605b0 2023-11-04T01:40:22.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.741+0000 7fc0a9ffb640 1 -- 172.21.15.44:0/4077427239 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c02f050 con 0x7fc0ac1605b0 2023-11-04T01:40:22.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.741+0000 7fc0a9ffb640 1 -- 172.21.15.44:0/4077427239 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c031a90 con 0x7fc0ac1605b0 2023-11-04T01:40:22.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.742+0000 7fc0b16fc640 1 -- 172.21.15.44:0/4077427239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0ac1605b0 msgr2=0x7fc0ac0ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.742+0000 7fc0b16fc640 1 --2- 172.21.15.44:0/4077427239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0ac1605b0 0x7fc0ac0ccbc0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac0c6aa0 tx=0x7fc09c02b7b0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.742+0000 7fc0b16fc640 1 -- 172.21.15.44:0/4077427239 shutdown_connections 2023-11-04T01:40:22.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.742+0000 7fc0b16fc640 1 --2- 172.21.15.44:0/4077427239 >> v2:172.21.15.204:3300/0 conn(0x7fc0ac06a830 0x7fc0ac0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.742+0000 7fc0b16fc640 1 --2- 172.21.15.44:0/4077427239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0ac1605b0 0x7fc0ac0ccbc0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.742+0000 7fc0b16fc640 1 -- 172.21.15.44:0/4077427239 >> 172.21.15.44:0/4077427239 conn(0x7fc0ac071820 msgr2=0x7fc0ac071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:22.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.742+0000 7fc0b16fc640 1 -- 172.21.15.44:0/4077427239 shutdown_connections 2023-11-04T01:40:22.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.742+0000 7fc0b16fc640 1 -- 172.21.15.44:0/4077427239 wait complete. 2023-11-04T01:40:22.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.743+0000 7fc0b16fc640 1 Processor -- start 2023-11-04T01:40:22.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.743+0000 7fc0b16fc640 1 -- start start 2023-11-04T01:40:22.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0b16fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc0ac06a830 0x7fc0ac15aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0b16fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0ac1605b0 0x7fc0ac15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0b16fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0ac0b2670 0x7fc0ac0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0b16fc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac0c6b20 con 0x7fc0ac0b2670 2023-11-04T01:40:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0b16fc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac0b3680 con 0x7fc0ac06a830 2023-11-04T01:40:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0b16fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac0b2b00 con 0x7fc0ac1605b0 2023-11-04T01:40:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0ab7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0ac0b2670 0x7fc0ac0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0ab7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0ac0b2670 0x7fc0ac0b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49876/0 (socket says 172.21.15.44:49876) 2023-11-04T01:40:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0ab7fe640 1 -- 172.21.15.44:0/3135568680 learned_addr learned my addr 172.21.15.44:0/3135568680 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0aaffd640 1 --2- 172.21.15.44:0/3135568680 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc0ac06a830 0x7fc0ac15aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0aa7fc640 1 --2- 172.21.15.44:0/3135568680 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0ac1605b0 0x7fc0ac15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0ab7fe640 1 -- 172.21.15.44:0/3135568680 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0ac1605b0 msgr2=0x7fc0ac15b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0ab7fe640 1 --2- 172.21.15.44:0/3135568680 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0ac1605b0 0x7fc0ac15b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0ab7fe640 1 -- 172.21.15.44:0/3135568680 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc0ac06a830 msgr2=0x7fc0ac15aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0ab7fe640 1 --2- 172.21.15.44:0/3135568680 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc0ac06a830 0x7fc0ac15aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0ab7fe640 1 -- 172.21.15.44:0/3135568680 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c009400 con 0x7fc0ac0b2670 2023-11-04T01:40:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0aa7fc640 1 --2- 172.21.15.44:0/3135568680 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0ac1605b0 0x7fc0ac15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.744+0000 7fc0ab7fe640 1 --2- 172.21.15.44:0/3135568680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0ac0b2670 0x7fc0ac0b0530 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400cd50 tx=0x7fc0a400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.745+0000 7fc0937fe640 1 -- 172.21.15.44:0/3135568680 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400f680 con 0x7fc0ac0b2670 2023-11-04T01:40:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.745+0000 7fc0937fe640 1 -- 172.21.15.44:0/3135568680 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a400f800 con 0x7fc0ac0b2670 2023-11-04T01:40:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.745+0000 7fc0b16fc640 1 -- 172.21.15.44:0/3135568680 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ac0b2de0 con 0x7fc0ac0b2670 2023-11-04T01:40:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.745+0000 7fc0937fe640 1 -- 172.21.15.44:0/3135568680 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400fbb0 con 0x7fc0ac0b2670 2023-11-04T01:40:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.745+0000 7fc0b16fc640 1 -- 172.21.15.44:0/3135568680 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ac0b33a0 con 0x7fc0ac0b2670 2023-11-04T01:40:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.746+0000 7fc0b16fc640 1 -- 172.21.15.44:0/3135568680 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ac0672a0 con 0x7fc0ac0b2670 2023-11-04T01:40:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.746+0000 7fc0937fe640 1 -- 172.21.15.44:0/3135568680 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc0a400b040 con 0x7fc0ac0b2670 2023-11-04T01:40:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.746+0000 7fc0937fe640 1 --2- 172.21.15.44:0/3135568680 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc09806aea0 0x7fc09806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.747+0000 7fc0937fe640 1 -- 172.21.15.44:0/3135568680 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7fc0a408a5f0 con 0x7fc0ac0b2670 2023-11-04T01:40:22.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.747+0000 7fc0aaffd640 1 --2- 172.21.15.44:0/3135568680 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc09806aea0 0x7fc09806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.747+0000 7fc0aaffd640 1 --2- 172.21.15.44:0/3135568680 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc09806aea0 0x7fc09806d360 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc09c035000 tx=0x7fc09c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:22.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.751+0000 7fc0937fe640 1 -- 172.21.15.44:0/3135568680 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc0a4055090 con 0x7fc0ac0b2670 2023-11-04T01:40:23.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:22.998+0000 7fc0b16fc640 1 -- 172.21.15.44:0/3135568680 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7fc0ac0b3fc0 con 0x7fc0ac0b2670 2023-11-04T01:40:23.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.063+0000 7fc0937fe640 1 -- 172.21.15.44:0/3135568680 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.6562 v60) v1 ==== 112+0+0 (secure 0 0 0) 0x7fc0ac0b3fc0 con 0x7fc0ac0b2670 2023-11-04T01:40:23.065 INFO:teuthology.orchestra.run.smithi044.stderr:freezing mds.6562 2023-11-04T01:40:23.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.065+0000 7fc0b16fc640 1 -- 172.21.15.44:0/3135568680 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc09806aea0 msgr2=0x7fc09806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.065+0000 7fc0b16fc640 1 --2- 172.21.15.44:0/3135568680 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc09806aea0 0x7fc09806d360 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc09c035000 tx=0x7fc09c008030 comp rx=0 tx=0).stop 2023-11-04T01:40:23.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.065+0000 7fc0b16fc640 1 -- 172.21.15.44:0/3135568680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0ac0b2670 msgr2=0x7fc0ac0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.065+0000 7fc0b16fc640 1 --2- 172.21.15.44:0/3135568680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0ac0b2670 0x7fc0ac0b0530 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400cd50 tx=0x7fc0a400a650 comp rx=0 tx=0).stop 2023-11-04T01:40:23.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.065+0000 7fc0b16fc640 1 -- 172.21.15.44:0/3135568680 shutdown_connections 2023-11-04T01:40:23.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.065+0000 7fc0b16fc640 1 --2- 172.21.15.44:0/3135568680 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc09806aea0 0x7fc09806d360 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.065+0000 7fc0b16fc640 1 --2- 172.21.15.44:0/3135568680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0ac0b2670 0x7fc0ac0b0530 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.065+0000 7fc0b16fc640 1 --2- 172.21.15.44:0/3135568680 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0ac1605b0 0x7fc0ac15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.065+0000 7fc0b16fc640 1 --2- 172.21.15.44:0/3135568680 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc0ac06a830 0x7fc0ac15aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.065+0000 7fc0b16fc640 1 -- 172.21.15.44:0/3135568680 >> 172.21.15.44:0/3135568680 conn(0x7fc0ac071820 msgr2=0x7fc0ac0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:23.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.065+0000 7fc0b16fc640 1 -- 172.21.15.44:0/3135568680 shutdown_connections 2023-11-04T01:40:23.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.065+0000 7fc0b16fc640 1 -- 172.21.15.44:0/3135568680 wait complete. 2023-11-04T01:40:23.078 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_kill_mdstable_at 2 2023-11-04T01:40:23.196 INFO:teuthology.orchestra.run.smithi044.stdout:{"success":"mds_kill_mdstable_at = '2' (not observed, change may require restart) "} 2023-11-04T01:40:23.197 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '2' (not observed, change may require restart) " } 2023-11-04T01:40:23.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:23.197 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s12) 2023-11-04T01:40:23.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:40:23.217 INFO:tasks.ceph.mds.a.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fb2a34e3640 time 2023-11-04T01:40:23.217043+0000 2023-11-04T01:40:23.217 INFO:tasks.ceph.mds.a.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:40:23.219 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:23.220 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb2aef6efaf] 2023-11-04T01:40:23.220 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb2aef6f16d] 2023-11-04T01:40:23.220 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x564ea5d419ce] 2023-11-04T01:40:23.220 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: (MDSContext::complete(int)+0x5c) [0x564ea5d71bcc] 2023-11-04T01:40:23.220 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x564ea5d7ab0c] 2023-11-04T01:40:23.220 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x564ea5d7ac63] 2023-11-04T01:40:23.220 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fb2af0164a5] 2023-11-04T01:40:23.220 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fb2ae69f802] 2023-11-04T01:40:23.220 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fb2ae63f450] 2023-11-04T01:40:23.220 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:40:23.216+0000 7fb2a34e3640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fb2a34e3640 time 2023-11-04T01:40:23.217043+0000 2023-11-04T01:40:23.220 INFO:tasks.ceph.mds.a.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:40:23.221 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:40:23.221 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:23.221 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb2aef6efaf] 2023-11-04T01:40:23.221 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb2aef6f16d] 2023-11-04T01:40:23.221 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x564ea5d419ce] 2023-11-04T01:40:23.221 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: (MDSContext::complete(int)+0x5c) [0x564ea5d71bcc] 2023-11-04T01:40:23.221 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x564ea5d7ab0c] 2023-11-04T01:40:23.221 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x564ea5d7ac63] 2023-11-04T01:40:23.221 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fb2af0164a5] 2023-11-04T01:40:23.221 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fb2ae69f802] 2023-11-04T01:40:23.221 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fb2ae63f450] 2023-11-04T01:40:23.221 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:40:23.221 INFO:tasks.ceph.mds.a.smithi044.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:40:23.221 INFO:tasks.ceph.mds.a.smithi044.stderr: in thread 7fb2a34e3640 thread_name:MR_Finisher 2023-11-04T01:40:23.222 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:23.222 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fb2ae654db0] 2023-11-04T01:40:23.222 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fb2ae6a154c] 2023-11-04T01:40:23.222 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: raise() 2023-11-04T01:40:23.222 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: abort() 2023-11-04T01:40:23.222 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb2aef6f009] 2023-11-04T01:40:23.222 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb2aef6f16d] 2023-11-04T01:40:23.222 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x564ea5d419ce] 2023-11-04T01:40:23.222 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (MDSContext::complete(int)+0x5c) [0x564ea5d71bcc] 2023-11-04T01:40:23.222 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x564ea5d7ab0c] 2023-11-04T01:40:23.222 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x564ea5d7ac63] 2023-11-04T01:40:23.222 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fb2af0164a5] 2023-11-04T01:40:23.223 INFO:tasks.ceph.mds.a.smithi044.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fb2ae69f802] 2023-11-04T01:40:23.223 INFO:tasks.ceph.mds.a.smithi044.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fb2ae63f450] 2023-11-04T01:40:23.223 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:40:23.217+0000 7fb2a34e3640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:23.223 INFO:tasks.ceph.mds.a.smithi044.stderr: in thread 7fb2a34e3640 thread_name:MR_Finisher 2023-11-04T01:40:23.223 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:40:23.223 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:23.223 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fb2ae654db0] 2023-11-04T01:40:23.223 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fb2ae6a154c] 2023-11-04T01:40:23.223 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: raise() 2023-11-04T01:40:23.223 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: abort() 2023-11-04T01:40:23.223 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb2aef6f009] 2023-11-04T01:40:23.223 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb2aef6f16d] 2023-11-04T01:40:23.223 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x564ea5d419ce] 2023-11-04T01:40:23.224 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (MDSContext::complete(int)+0x5c) [0x564ea5d71bcc] 2023-11-04T01:40:23.224 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x564ea5d7ab0c] 2023-11-04T01:40:23.224 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x564ea5d7ac63] 2023-11-04T01:40:23.224 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fb2af0164a5] 2023-11-04T01:40:23.224 INFO:tasks.ceph.mds.a.smithi044.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fb2ae69f802] 2023-11-04T01:40:23.224 INFO:tasks.ceph.mds.a.smithi044.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fb2ae63f450] 2023-11-04T01:40:23.224 INFO:tasks.ceph.mds.a.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:23.224 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:40:23.225 INFO:tasks.ceph.mds.a.smithi044.stderr: -209> 2023-11-04T01:40:20.519+0000 7fb2a6cea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:23.225 INFO:tasks.ceph.mds.a.smithi044.stderr: -207> 2023-11-04T01:40:20.519+0000 7fb2a6cea640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:23.225 INFO:tasks.ceph.mds.a.smithi044.stderr: -1> 2023-11-04T01:40:23.216+0000 7fb2a34e3640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fb2a34e3640 time 2023-11-04T01:40:23.217043+0000 2023-11-04T01:40:23.225 INFO:tasks.ceph.mds.a.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:40:23.225 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:40:23.225 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:23.225 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb2aef6efaf] 2023-11-04T01:40:23.225 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb2aef6f16d] 2023-11-04T01:40:23.225 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x564ea5d419ce] 2023-11-04T01:40:23.225 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: (MDSContext::complete(int)+0x5c) [0x564ea5d71bcc] 2023-11-04T01:40:23.225 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x564ea5d7ab0c] 2023-11-04T01:40:23.225 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x564ea5d7ac63] 2023-11-04T01:40:23.226 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fb2af0164a5] 2023-11-04T01:40:23.226 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fb2ae69f802] 2023-11-04T01:40:23.226 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fb2ae63f450] 2023-11-04T01:40:23.226 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:40:23.226 INFO:tasks.ceph.mds.a.smithi044.stderr: 0> 2023-11-04T01:40:23.217+0000 7fb2a34e3640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:23.226 INFO:tasks.ceph.mds.a.smithi044.stderr: in thread 7fb2a34e3640 thread_name:MR_Finisher 2023-11-04T01:40:23.226 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:40:23.226 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:23.226 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fb2ae654db0] 2023-11-04T01:40:23.226 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fb2ae6a154c] 2023-11-04T01:40:23.226 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: raise() 2023-11-04T01:40:23.226 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: abort() 2023-11-04T01:40:23.227 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb2aef6f009] 2023-11-04T01:40:23.227 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb2aef6f16d] 2023-11-04T01:40:23.227 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x564ea5d419ce] 2023-11-04T01:40:23.227 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (MDSContext::complete(int)+0x5c) [0x564ea5d71bcc] 2023-11-04T01:40:23.227 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x564ea5d7ab0c] 2023-11-04T01:40:23.227 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x564ea5d7ac63] 2023-11-04T01:40:23.227 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fb2af0164a5] 2023-11-04T01:40:23.227 INFO:tasks.ceph.mds.a.smithi044.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fb2ae69f802] 2023-11-04T01:40:23.227 INFO:tasks.ceph.mds.a.smithi044.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fb2ae63f450] 2023-11-04T01:40:23.227 INFO:tasks.ceph.mds.a.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:23.227 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:40:23.228 INFO:tasks.ceph.mds.a.smithi044.stderr: -209> 2023-11-04T01:40:20.519+0000 7fb2a6cea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:23.228 INFO:tasks.ceph.mds.a.smithi044.stderr: -207> 2023-11-04T01:40:20.519+0000 7fb2a6cea640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:23.228 INFO:tasks.ceph.mds.a.smithi044.stderr: -1> 2023-11-04T01:40:23.216+0000 7fb2a34e3640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fb2a34e3640 time 2023-11-04T01:40:23.217043+0000 2023-11-04T01:40:23.228 INFO:tasks.ceph.mds.a.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:40:23.228 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:40:23.228 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:23.228 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb2aef6efaf] 2023-11-04T01:40:23.228 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb2aef6f16d] 2023-11-04T01:40:23.228 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x564ea5d419ce] 2023-11-04T01:40:23.228 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: (MDSContext::complete(int)+0x5c) [0x564ea5d71bcc] 2023-11-04T01:40:23.228 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x564ea5d7ab0c] 2023-11-04T01:40:23.229 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x564ea5d7ac63] 2023-11-04T01:40:23.229 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fb2af0164a5] 2023-11-04T01:40:23.229 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fb2ae69f802] 2023-11-04T01:40:23.229 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fb2ae63f450] 2023-11-04T01:40:23.229 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:40:23.229 INFO:tasks.ceph.mds.a.smithi044.stderr: 0> 2023-11-04T01:40:23.217+0000 7fb2a34e3640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:23.229 INFO:tasks.ceph.mds.a.smithi044.stderr: in thread 7fb2a34e3640 thread_name:MR_Finisher 2023-11-04T01:40:23.229 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:40:23.229 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:23.229 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fb2ae654db0] 2023-11-04T01:40:23.229 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fb2ae6a154c] 2023-11-04T01:40:23.229 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: raise() 2023-11-04T01:40:23.230 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: abort() 2023-11-04T01:40:23.230 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb2aef6f009] 2023-11-04T01:40:23.230 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb2aef6f16d] 2023-11-04T01:40:23.230 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x564ea5d419ce] 2023-11-04T01:40:23.230 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (MDSContext::complete(int)+0x5c) [0x564ea5d71bcc] 2023-11-04T01:40:23.230 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x564ea5d7ab0c] 2023-11-04T01:40:23.230 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x564ea5d7ac63] 2023-11-04T01:40:23.230 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fb2af0164a5] 2023-11-04T01:40:23.231 INFO:tasks.ceph.mds.a.smithi044.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fb2ae69f802] 2023-11-04T01:40:23.231 INFO:tasks.ceph.mds.a.smithi044.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fb2ae63f450] 2023-11-04T01:40:23.231 INFO:tasks.ceph.mds.a.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:23.231 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:40:23.331 INFO:teuthology.orchestra.run.smithi044.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:40:23.332 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:40:23.332 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:23.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.476+0000 7f74acbb6640 1 Processor -- start 2023-11-04T01:40:23.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.476+0000 7f74acbb6640 1 -- start start 2023-11-04T01:40:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.477+0000 7f74acbb6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f74a815bfb0 0x7f74a80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.477+0000 7f74acbb6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f74a80cd860 0x7f74a80ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.477+0000 7f74acbb6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a80cc450 con 0x7f74a815ae40 2023-11-04T01:40:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.477+0000 7f74acbb6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a815f400 con 0x7f74a815bfb0 2023-11-04T01:40:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.477+0000 7f74acbb6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a815b220 con 0x7f74a80cd860 2023-11-04T01:40:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.477+0000 7f74a5d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f74a815bfb0 0x7f74a80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.477+0000 7f74a5d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f74a815bfb0 0x7f74a80cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49890/0 (socket says 172.21.15.44:49890) 2023-11-04T01:40:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.477+0000 7f74a5d9b640 1 -- 172.21.15.44:0/3863805174 learned_addr learned my addr 172.21.15.44:0/3863805174 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.477+0000 7f74a6d9d640 1 --2- 172.21.15.44:0/3863805174 >> v2:172.21.15.204:3300/0 conn(0x7f74a80cd860 0x7f74a80ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.478+0000 7f74a5d9b640 1 -- 172.21.15.44:0/3863805174 >> v2:172.21.15.204:3300/0 conn(0x7f74a80cd860 msgr2=0x7f74a80ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:23.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.478+0000 7f74a5d9b640 1 --2- 172.21.15.44:0/3863805174 >> v2:172.21.15.204:3300/0 conn(0x7f74a80cd860 0x7f74a80ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.478+0000 7f74a5d9b640 1 -- 172.21.15.44:0/3863805174 >> v1:172.21.15.204:6789/0 conn(0x7f74a815ae40 legacy=0x7f74a80cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.478+0000 7f74a5d9b640 1 -- 172.21.15.44:0/3863805174 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a815f890 con 0x7f74a815bfb0 2023-11-04T01:40:23.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.478+0000 7f74a5d9b640 1 --2- 172.21.15.44:0/3863805174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a815bfb0 0x7f74a80cd320 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f74a80ce5c0 tx=0x7f749002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8354961c4298a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.478+0000 7f74a559a640 1 -- 172.21.15.44:0/3863805174 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490030860 con 0x7f74a815bfb0 2023-11-04T01:40:23.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.479+0000 7f74a559a640 1 -- 172.21.15.44:0/3863805174 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74900309c0 con 0x7f74a815bfb0 2023-11-04T01:40:23.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.479+0000 7f74a559a640 1 -- 172.21.15.44:0/3863805174 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490030d50 con 0x7f74a815bfb0 2023-11-04T01:40:23.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.479+0000 7f74acbb6640 1 -- 172.21.15.44:0/3863805174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a815bfb0 msgr2=0x7f74a80cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.479+0000 7f74acbb6640 1 --2- 172.21.15.44:0/3863805174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a815bfb0 0x7f74a80cd320 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f74a80ce5c0 tx=0x7f749002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.479+0000 7f74acbb6640 1 -- 172.21.15.44:0/3863805174 shutdown_connections 2023-11-04T01:40:23.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.479+0000 7f74acbb6640 1 --2- 172.21.15.44:0/3863805174 >> v2:172.21.15.204:3300/0 conn(0x7f74a80cd860 0x7f74a80ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.479+0000 7f74acbb6640 1 --2- 172.21.15.44:0/3863805174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a815bfb0 0x7f74a80cd320 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.479+0000 7f74acbb6640 1 -- 172.21.15.44:0/3863805174 >> 172.21.15.44:0/3863805174 conn(0x7f74a806ea90 msgr2=0x7f74a806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:23.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.479+0000 7f74acbb6640 1 -- 172.21.15.44:0/3863805174 shutdown_connections 2023-11-04T01:40:23.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.479+0000 7f74acbb6640 1 -- 172.21.15.44:0/3863805174 wait complete. 2023-11-04T01:40:23.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.481+0000 7f74acbb6640 1 Processor -- start 2023-11-04T01:40:23.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.481+0000 7f74acbb6640 1 -- start start 2023-11-04T01:40:23.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.481+0000 7f74acbb6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74a80cd860 0x7f74a80c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.481+0000 7f74acbb6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a815ae40 0x7f74a80c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.481+0000 7f74acbb6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74a815bfb0 0x7f74a80cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.481+0000 7f74acbb6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80c8860 con 0x7f74a815ae40 2023-11-04T01:40:23.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.481+0000 7f74acbb6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80c3dc0 con 0x7f74a815bfb0 2023-11-04T01:40:23.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.481+0000 7f74acbb6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80c7c70 con 0x7f74a80cd860 2023-11-04T01:40:23.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.481+0000 7f74a5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a815ae40 0x7f74a80c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.481+0000 7f74a5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a815ae40 0x7f74a80c3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49892/0 (socket says 172.21.15.44:49892) 2023-11-04T01:40:23.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.481+0000 7f74a5d9b640 1 -- 172.21.15.44:0/808925166 learned_addr learned my addr 172.21.15.44:0/808925166 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:23.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.482+0000 7f74a659c640 1 --2- 172.21.15.44:0/808925166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74a80cd860 0x7f74a80c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.482+0000 7f74a6d9d640 1 --2- 172.21.15.44:0/808925166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74a815bfb0 0x7f74a80cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.482+0000 7f74a5d9b640 1 -- 172.21.15.44:0/808925166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74a80cd860 msgr2=0x7f74a80c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.482+0000 7f74a5d9b640 1 --2- 172.21.15.44:0/808925166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74a80cd860 0x7f74a80c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.482+0000 7f74a5d9b640 1 -- 172.21.15.44:0/808925166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74a815bfb0 msgr2=0x7f74a80cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.482+0000 7f74a5d9b640 1 --2- 172.21.15.44:0/808925166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74a815bfb0 0x7f74a80cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.482+0000 7f74a5d9b640 1 -- 172.21.15.44:0/808925166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74900094d0 con 0x7f74a815ae40 2023-11-04T01:40:23.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.482+0000 7f74a5d9b640 1 --2- 172.21.15.44:0/808925166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a815ae40 0x7f74a80c3880 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f749002b9e0 tx=0x7f74900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.482+0000 7f749effd640 1 -- 172.21.15.44:0/808925166 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749003e070 con 0x7f74a815ae40 2023-11-04T01:40:23.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.482+0000 7f749effd640 1 -- 172.21.15.44:0/808925166 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7490039a60 con 0x7f74a815ae40 2023-11-04T01:40:23.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.482+0000 7f74acbb6640 1 -- 172.21.15.44:0/808925166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a80c7ec0 con 0x7f74a815ae40 2023-11-04T01:40:23.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.482+0000 7f749effd640 1 -- 172.21.15.44:0/808925166 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490039df0 con 0x7f74a815ae40 2023-11-04T01:40:23.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.482+0000 7f74acbb6640 1 -- 172.21.15.44:0/808925166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a80c8480 con 0x7f74a815ae40 2023-11-04T01:40:23.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.483+0000 7f74acbb6640 1 -- 172.21.15.44:0/808925166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a80ce2d0 con 0x7f74a815ae40 2023-11-04T01:40:23.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.484+0000 7f749effd640 1 -- 172.21.15.44:0/808925166 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f749004b400 con 0x7f74a815ae40 2023-11-04T01:40:23.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.484+0000 7f749effd640 1 --2- 172.21.15.44:0/808925166 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f748806aea0 0x7f748806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.484+0000 7f749effd640 1 -- 172.21.15.44:0/808925166 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f74900ac0b0 con 0x7f74a815ae40 2023-11-04T01:40:23.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.485+0000 7f74a659c640 1 --2- 172.21.15.44:0/808925166 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f748806aea0 0x7f748806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.485+0000 7f74a659c640 1 --2- 172.21.15.44:0/808925166 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f748806aea0 0x7f748806d360 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f74a0000f60 tx=0x7f74a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.489+0000 7f749effd640 1 -- 172.21.15.44:0/808925166 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7490076ca0 con 0x7f74a815ae40 2023-11-04T01:40:23.565 INFO:tasks.ceph.mds.a.smithi044.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:40:23.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.702+0000 7f74acbb6640 1 -- 172.21.15.44:0/808925166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74a80c89a0 con 0x7f74a815ae40 2023-11-04T01:40:23.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.702+0000 7f749effd640 1 -- 172.21.15.44:0/808925166 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f7490034020 con 0x7f74a815ae40 2023-11-04T01:40:23.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:23.705 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6820,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:22.999863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6562,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6562":{"gid":6562,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":17,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 60 2023-11-04T01:40:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.704+0000 7f74acbb6640 1 -- 172.21.15.44:0/808925166 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f748806aea0 msgr2=0x7f748806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.704+0000 7f74acbb6640 1 --2- 172.21.15.44:0/808925166 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f748806aea0 0x7f748806d360 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f74a0000f60 tx=0x7f74a0009040 comp rx=0 tx=0).stop 2023-11-04T01:40:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.704+0000 7f74acbb6640 1 -- 172.21.15.44:0/808925166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a815ae40 msgr2=0x7f74a80c3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.704+0000 7f74acbb6640 1 --2- 172.21.15.44:0/808925166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a815ae40 0x7f74a80c3880 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f749002b9e0 tx=0x7f74900046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.704+0000 7f74acbb6640 1 -- 172.21.15.44:0/808925166 shutdown_connections 2023-11-04T01:40:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.704+0000 7f74acbb6640 1 --2- 172.21.15.44:0/808925166 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f748806aea0 0x7f748806d360 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.704+0000 7f74acbb6640 1 --2- 172.21.15.44:0/808925166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74a815bfb0 0x7f74a80cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.704+0000 7f74acbb6640 1 --2- 172.21.15.44:0/808925166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74a815ae40 0x7f74a80c3880 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.704+0000 7f74acbb6640 1 --2- 172.21.15.44:0/808925166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74a80cd860 0x7f74a80c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.704+0000 7f74acbb6640 1 -- 172.21.15.44:0/808925166 >> 172.21.15.44:0/808925166 conn(0x7f74a806ea90 msgr2=0x7f74a8158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.704+0000 7f74acbb6640 1 -- 172.21.15.44:0/808925166 shutdown_connections 2023-11-04T01:40:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:23.704+0000 7f74acbb6640 1 -- 172.21.15.44:0/808925166 wait complete. 2023-11-04T01:40:23.717 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:26.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:40:28.708 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:28.711 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:28.717 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:28.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.864+0000 7f21e5d83640 1 Processor -- start 2023-11-04T01:40:28.866 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.864+0000 7f21e5d83640 1 -- start start 2023-11-04T01:40:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.865+0000 7f21e5d83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e0157710 0x7f21e0167b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.865+0000 7f21e5d83640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e015e000 con 0x7f21e00ce240 2023-11-04T01:40:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.865+0000 7f21e5d83640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e015e2e0 con 0x7f21e00cde60 2023-11-04T01:40:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.865+0000 7f21e5d83640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e015e5c0 con 0x7f21e0157710 2023-11-04T01:40:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.865+0000 7f21deffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f21e00ce240 0x7f21e0157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:53916/0 (socket says 172.21.15.44:53916) 2023-11-04T01:40:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.865+0000 7f21deffd640 1 -- 172.21.15.44:0/2977553792 learned_addr learned my addr 172.21.15.44:0/2977553792 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.865+0000 7f21dffff640 1 --2- 172.21.15.44:0/2977553792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e0157710 0x7f21e0167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.865+0000 7f21de7fc640 1 -- 172.21.15.44:0/2977553792 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291574107 0 0) 0x7f21e015e000 con 0x7f21e00ce240 2023-11-04T01:40:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.865+0000 7f21de7fc640 1 -- 172.21.15.44:0/2977553792 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21c8003520 con 0x7f21e00ce240 2023-11-04T01:40:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.865+0000 7f21de7fc640 1 -- 172.21.15.44:0/2977553792 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 620367668 0 0) 0x7f21c8003520 con 0x7f21e00ce240 2023-11-04T01:40:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.865+0000 7f21de7fc640 1 -- 172.21.15.44:0/2977553792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e0157710 msgr2=0x7f21e0167b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.865+0000 7f21de7fc640 1 --2- 172.21.15.44:0/2977553792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e0157710 0x7f21e0167b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.865+0000 7f21de7fc640 1 -- 172.21.15.44:0/2977553792 >> v1:172.21.15.204:6789/0 conn(0x7f21e00cde60 legacy=0x7f21e015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.865+0000 7f21de7fc640 1 -- 172.21.15.44:0/2977553792 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e00d1120 con 0x7f21e00ce240 2023-11-04T01:40:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21de7fc640 1 -- 172.21.15.44:0/2977553792 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f21d4001670 con 0x7f21e00ce240 2023-11-04T01:40:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21de7fc640 1 -- 172.21.15.44:0/2977553792 >> v1:172.21.15.44:6789/0 conn(0x7f21e00ce240 legacy=0x7f21e0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21de7fc640 1 --2- 172.21.15.44:0/2977553792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e0157710 0x7f21c80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21de7fc640 1 --2- 172.21.15.44:0/2977553792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8003ee0 0x7f21c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21de7fc640 1 --2- 172.21.15.44:0/2977553792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21c8004d00 0x7f21c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21de7fc640 1 -- 172.21.15.44:0/2977553792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e015e5c0 con 0x7f21c8003ee0 2023-11-04T01:40:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21de7fc640 1 -- 172.21.15.44:0/2977553792 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c800b9e0 con 0x7f21c8004d00 2023-11-04T01:40:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21de7fc640 1 -- 172.21.15.44:0/2977553792 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c800bba0 con 0x7f21e0157710 2023-11-04T01:40:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21deffd640 1 --2- 172.21.15.44:0/2977553792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8003ee0 0x7f21c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21df7fe640 1 --2- 172.21.15.44:0/2977553792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e0157710 0x7f21c80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21dffff640 1 --2- 172.21.15.44:0/2977553792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21c8004d00 0x7f21c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21deffd640 1 -- 172.21.15.44:0/2977553792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e0157710 msgr2=0x7f21c80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21deffd640 1 --2- 172.21.15.44:0/2977553792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e0157710 0x7f21c80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21deffd640 1 -- 172.21.15.44:0/2977553792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21c8004d00 msgr2=0x7f21c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21deffd640 1 --2- 172.21.15.44:0/2977553792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21c8004d00 0x7f21c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.866+0000 7f21deffd640 1 -- 172.21.15.44:0/2977553792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c8003520 con 0x7f21c8003ee0 2023-11-04T01:40:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.867+0000 7f21deffd640 1 --2- 172.21.15.44:0/2977553792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8003ee0 0x7f21c80047c0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f21d400c210 tx=0x7f21c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909ecd77110da949 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.867+0000 7f21de7fc640 1 -- 172.21.15.44:0/2977553792 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4005ad0 con 0x7f21c8003ee0 2023-11-04T01:40:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.867+0000 7f21de7fc640 1 -- 172.21.15.44:0/2977553792 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d4005c50 con 0x7f21c8003ee0 2023-11-04T01:40:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.867+0000 7f21de7fc640 1 -- 172.21.15.44:0/2977553792 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d402c810 con 0x7f21c8003ee0 2023-11-04T01:40:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.867+0000 7f21e5d83640 1 -- 172.21.15.44:0/2977553792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8003ee0 msgr2=0x7f21c80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.867+0000 7f21e5d83640 1 --2- 172.21.15.44:0/2977553792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8003ee0 0x7f21c80047c0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f21d400c210 tx=0x7f21c80057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.867+0000 7f21dffff640 1 -- 172.21.15.44:0/2977553792 reap_dead start 2023-11-04T01:40:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.867+0000 7f21e5d83640 1 -- 172.21.15.44:0/2977553792 shutdown_connections 2023-11-04T01:40:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.867+0000 7f21e5d83640 1 -- 172.21.15.44:0/2977553792 >> 172.21.15.44:0/2977553792 conn(0x7f21e0071f30 msgr2=0x7f21e00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.868+0000 7f21e5d83640 1 -- 172.21.15.44:0/2977553792 shutdown_connections 2023-11-04T01:40:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.868+0000 7f21e5d83640 1 -- 172.21.15.44:0/2977553792 wait complete. 2023-11-04T01:40:28.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.869+0000 7f21e5d83640 1 Processor -- start 2023-11-04T01:40:28.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.869+0000 7f21e5d83640 1 -- start start 2023-11-04T01:40:28.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21e5d83640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8003ee0 0x7f21e01561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21e5d83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e015bc70 0x7f21e015c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21e5d83640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21e0157be0 0x7f21e0158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21e5d83640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e01585d0 con 0x7f21c8003ee0 2023-11-04T01:40:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21e5d83640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e015c630 con 0x7f21e0157be0 2023-11-04T01:40:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21e5d83640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e01f2cf0 con 0x7f21e015bc70 2023-11-04T01:40:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21df7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8003ee0 0x7f21e01561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21df7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8003ee0 0x7f21e01561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49916/0 (socket says 172.21.15.44:49916) 2023-11-04T01:40:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21df7fe640 1 -- 172.21.15.44:0/574490101 learned_addr learned my addr 172.21.15.44:0/574490101 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21dffff640 1 --2- 172.21.15.44:0/574490101 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21e0157be0 0x7f21e0158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21deffd640 1 --2- 172.21.15.44:0/574490101 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e015bc70 0x7f21e015c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21df7fe640 1 -- 172.21.15.44:0/574490101 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e015bc70 msgr2=0x7f21e015c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21df7fe640 1 --2- 172.21.15.44:0/574490101 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e015bc70 0x7f21e015c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21df7fe640 1 -- 172.21.15.44:0/574490101 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21e0157be0 msgr2=0x7f21e0158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21df7fe640 1 --2- 172.21.15.44:0/574490101 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21e0157be0 0x7f21e0158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21df7fe640 1 -- 172.21.15.44:0/574490101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e01587c0 con 0x7f21c8003ee0 2023-11-04T01:40:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21deffd640 1 --2- 172.21.15.44:0/574490101 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e015bc70 0x7f21e015c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21df7fe640 1 --2- 172.21.15.44:0/574490101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8003ee0 0x7f21e01561d0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f21d000f7c0 tx=0x7f21d000fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21c7fff640 1 -- 172.21.15.44:0/574490101 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d000fe70 con 0x7f21c8003ee0 2023-11-04T01:40:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21c7fff640 1 -- 172.21.15.44:0/574490101 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d00052e0 con 0x7f21c8003ee0 2023-11-04T01:40:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21e5d83640 1 -- 172.21.15.44:0/574490101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e0158aa0 con 0x7f21c8003ee0 2023-11-04T01:40:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.870+0000 7f21c7fff640 1 -- 172.21.15.44:0/574490101 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d000d910 con 0x7f21c8003ee0 2023-11-04T01:40:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.871+0000 7f21e5d83640 1 -- 172.21.15.44:0/574490101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e0159060 con 0x7f21c8003ee0 2023-11-04T01:40:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.871+0000 7f21e5d83640 1 -- 172.21.15.44:0/574490101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e00b6e40 con 0x7f21c8003ee0 2023-11-04T01:40:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.872+0000 7f21c7fff640 1 -- 172.21.15.44:0/574490101 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21d000da70 con 0x7f21c8003ee0 2023-11-04T01:40:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.872+0000 7f21c7fff640 1 --2- 172.21.15.44:0/574490101 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21cc06aea0 0x7f21cc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.872+0000 7f21c7fff640 1 -- 172.21.15.44:0/574490101 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f21d0089c60 con 0x7f21c8003ee0 2023-11-04T01:40:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.873+0000 7f21deffd640 1 --2- 172.21.15.44:0/574490101 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21cc06aea0 0x7f21cc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.873+0000 7f21deffd640 1 --2- 172.21.15.44:0/574490101 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21cc06aea0 0x7f21cc06d360 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f21d4034000 tx=0x7f21d4009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:28.877+0000 7f21c7fff640 1 -- 172.21.15.44:0/574490101 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21d0054670 con 0x7f21c8003ee0 2023-11-04T01:40:29.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:29.088+0000 7f21e5d83640 1 -- 172.21.15.44:0/574490101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21e00c9370 con 0x7f21c8003ee0 2023-11-04T01:40:29.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:29.089+0000 7f21c7fff640 1 -- 172.21.15.44:0/574490101 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f21d0057c90 con 0x7f21c8003ee0 2023-11-04T01:40:29.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:29.091 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6820,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:22.999863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6562,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6562":{"gid":6562,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":17,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:29.092 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 60 2023-11-04T01:40:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:29.091+0000 7f21e5d83640 1 -- 172.21.15.44:0/574490101 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21cc06aea0 msgr2=0x7f21cc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:29.091+0000 7f21e5d83640 1 --2- 172.21.15.44:0/574490101 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21cc06aea0 0x7f21cc06d360 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f21d4034000 tx=0x7f21d4009030 comp rx=0 tx=0).stop 2023-11-04T01:40:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:29.091+0000 7f21e5d83640 1 -- 172.21.15.44:0/574490101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8003ee0 msgr2=0x7f21e01561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:29.091+0000 7f21e5d83640 1 --2- 172.21.15.44:0/574490101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8003ee0 0x7f21e01561d0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f21d000f7c0 tx=0x7f21d000fc80 comp rx=0 tx=0).stop 2023-11-04T01:40:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:29.091+0000 7f21e5d83640 1 -- 172.21.15.44:0/574490101 shutdown_connections 2023-11-04T01:40:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:29.091+0000 7f21e5d83640 1 --2- 172.21.15.44:0/574490101 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f21cc06aea0 0x7f21cc06d360 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:29.091+0000 7f21e5d83640 1 --2- 172.21.15.44:0/574490101 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21e0157be0 0x7f21e0158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:29.091+0000 7f21e5d83640 1 --2- 172.21.15.44:0/574490101 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21e015bc70 0x7f21e015c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:29.091+0000 7f21e5d83640 1 --2- 172.21.15.44:0/574490101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21c8003ee0 0x7f21e01561d0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:29.091+0000 7f21e5d83640 1 -- 172.21.15.44:0/574490101 >> 172.21.15.44:0/574490101 conn(0x7f21e0071f30 msgr2=0x7f21e00b6730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:29.091+0000 7f21e5d83640 1 -- 172.21.15.44:0/574490101 shutdown_connections 2023-11-04T01:40:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:29.091+0000 7f21e5d83640 1 -- 172.21.15.44:0/574490101 wait complete. 2023-11-04T01:40:29.104 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:33.548 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-04T01:40:34.105 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:34.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.222+0000 7f3e72ad4640 1 Processor -- start 2023-11-04T01:40:34.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.223+0000 7f3e72ad4640 1 -- start start 2023-11-04T01:40:34.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.223+0000 7f3e72ad4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3e6c0cde60 0x7f3e6c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.223+0000 7f3e72ad4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3e6c15daa0 0x7f3e6c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.223+0000 7f3e72ad4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e6c15e000 con 0x7f3e6c0ce240 2023-11-04T01:40:34.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.223+0000 7f3e72ad4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6c15e5c0 con 0x7f3e6c0cde60 2023-11-04T01:40:34.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.223+0000 7f3e72ad4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6c15e2e0 con 0x7f3e6c15daa0 2023-11-04T01:40:34.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.223+0000 7f3e70870640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3e6c0cde60 0x7f3e6c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.223+0000 7f3e71071640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3e6c0ce240 0x7f3e6c06b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49430/0 (socket says 172.21.15.44:49430) 2023-11-04T01:40:34.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.223+0000 7f3e71071640 1 -- 172.21.15.44:0/2051185475 learned_addr learned my addr 172.21.15.44:0/2051185475 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:34.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.224+0000 7f3e6bfff640 1 --2- 172.21.15.44:0/2051185475 >> v2:172.21.15.204:3300/0 conn(0x7f3e6c15daa0 0x7f3e6c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.224+0000 7f3e70870640 1 -- 172.21.15.44:0/2051185475 >> v2:172.21.15.204:3300/0 conn(0x7f3e6c15daa0 msgr2=0x7f3e6c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:34.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.224+0000 7f3e70870640 1 --2- 172.21.15.44:0/2051185475 >> v2:172.21.15.204:3300/0 conn(0x7f3e6c15daa0 0x7f3e6c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.224+0000 7f3e70870640 1 -- 172.21.15.44:0/2051185475 >> v1:172.21.15.44:6789/0 conn(0x7f3e6c0ce240 legacy=0x7f3e6c06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.224+0000 7f3e6b7fe640 1 -- 172.21.15.44:0/2051185475 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121951094 0 0) 0x7f3e6c15e000 con 0x7f3e6c0ce240 2023-11-04T01:40:34.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.224+0000 7f3e70870640 1 -- 172.21.15.44:0/2051185475 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c0d1120 con 0x7f3e6c0cde60 2023-11-04T01:40:34.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.224+0000 7f3e6bfff640 1 --2- 172.21.15.44:0/2051185475 >> v2:172.21.15.204:3300/0 conn(0x7f3e6c15daa0 0x7f3e6c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:34.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.225+0000 7f3e70870640 1 --2- 172.21.15.44:0/2051185475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e6c0cde60 0x7f3e6c15d560 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0cf5f0 tx=0x7f3e5c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5f5cbbde07b31 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:34.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.225+0000 7f3e6b7fe640 1 -- 172.21.15.44:0/2051185475 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c031830 con 0x7f3e6c0cde60 2023-11-04T01:40:34.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.225+0000 7f3e6b7fe640 1 -- 172.21.15.44:0/2051185475 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c031990 con 0x7f3e6c0cde60 2023-11-04T01:40:34.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.225+0000 7f3e6b7fe640 1 -- 172.21.15.44:0/2051185475 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c031d20 con 0x7f3e6c0cde60 2023-11-04T01:40:34.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.225+0000 7f3e72ad4640 1 -- 172.21.15.44:0/2051185475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e6c0cde60 msgr2=0x7f3e6c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.225+0000 7f3e72ad4640 1 --2- 172.21.15.44:0/2051185475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e6c0cde60 0x7f3e6c15d560 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0cf5f0 tx=0x7f3e5c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.225+0000 7f3e72ad4640 1 -- 172.21.15.44:0/2051185475 shutdown_connections 2023-11-04T01:40:34.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.225+0000 7f3e72ad4640 1 --2- 172.21.15.44:0/2051185475 >> v2:172.21.15.204:3300/0 conn(0x7f3e6c15daa0 0x7f3e6c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.225+0000 7f3e72ad4640 1 --2- 172.21.15.44:0/2051185475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e6c0cde60 0x7f3e6c15d560 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.225+0000 7f3e72ad4640 1 -- 172.21.15.44:0/2051185475 >> 172.21.15.44:0/2051185475 conn(0x7f3e6c071f30 msgr2=0x7f3e6c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:34.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.225+0000 7f3e72ad4640 1 -- 172.21.15.44:0/2051185475 shutdown_connections 2023-11-04T01:40:34.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.225+0000 7f3e72ad4640 1 -- 172.21.15.44:0/2051185475 wait complete. 2023-11-04T01:40:34.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.227+0000 7f3e72ad4640 1 Processor -- start 2023-11-04T01:40:34.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.227+0000 7f3e72ad4640 1 -- start start 2023-11-04T01:40:34.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e72ad4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e6c0cde60 0x7f3e6c1f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e72ad4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e6c0ce240 0x7f3e6c159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e72ad4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3e6c15daa0 0x7f3e6c0cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e72ad4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c15a760 con 0x7f3e6c0cde60 2023-11-04T01:40:34.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e72ad4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c1f6090 con 0x7f3e6c15daa0 2023-11-04T01:40:34.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e72ad4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c159b50 con 0x7f3e6c0ce240 2023-11-04T01:40:34.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e70870640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e6c0cde60 0x7f3e6c1f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e70870640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e6c0cde60 0x7f3e6c1f5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53098/0 (socket says 172.21.15.44:53098) 2023-11-04T01:40:34.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e70870640 1 -- 172.21.15.44:0/2449576109 learned_addr learned my addr 172.21.15.44:0/2449576109 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:34.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e71071640 1 --2- 172.21.15.44:0/2449576109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3e6c15daa0 0x7f3e6c0cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e6bfff640 1 --2- 172.21.15.44:0/2449576109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e6c0ce240 0x7f3e6c159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e70870640 1 -- 172.21.15.44:0/2449576109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e6c0ce240 msgr2=0x7f3e6c159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e70870640 1 --2- 172.21.15.44:0/2449576109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e6c0ce240 0x7f3e6c159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e70870640 1 -- 172.21.15.44:0/2449576109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3e6c15daa0 msgr2=0x7f3e6c0cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e70870640 1 --2- 172.21.15.44:0/2449576109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3e6c15daa0 0x7f3e6c0cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e70870640 1 -- 172.21.15.44:0/2449576109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c009400 con 0x7f3e6c0cde60 2023-11-04T01:40:34.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e6bfff640 1 --2- 172.21.15.44:0/2449576109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e6c0ce240 0x7f3e6c159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:34.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.228+0000 7f3e70870640 1 --2- 172.21.15.44:0/2449576109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e6c0cde60 0x7f3e6c1f5b50 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009890 tx=0x7f3e5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:34.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.230+0000 7f3e697fa640 1 -- 172.21.15.44:0/2449576109 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c03ba70 con 0x7f3e6c0cde60 2023-11-04T01:40:34.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.230+0000 7f3e697fa640 1 -- 172.21.15.44:0/2449576109 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c03bbd0 con 0x7f3e6c0cde60 2023-11-04T01:40:34.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.230+0000 7f3e72ad4640 1 -- 172.21.15.44:0/2449576109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6c159e30 con 0x7f3e6c0cde60 2023-11-04T01:40:34.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.230+0000 7f3e697fa640 1 -- 172.21.15.44:0/2449576109 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c0453f0 con 0x7f3e6c0cde60 2023-11-04T01:40:34.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.230+0000 7f3e72ad4640 1 -- 172.21.15.44:0/2449576109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6c15a3f0 con 0x7f3e6c0cde60 2023-11-04T01:40:34.233 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.231+0000 7f3e72ad4640 1 -- 172.21.15.44:0/2449576109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6c074290 con 0x7f3e6c0cde60 2023-11-04T01:40:34.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.232+0000 7f3e697fa640 1 -- 172.21.15.44:0/2449576109 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e5c045550 con 0x7f3e6c0cde60 2023-11-04T01:40:34.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.232+0000 7f3e697fa640 1 --2- 172.21.15.44:0/2449576109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3e5806ae70 0x7f3e5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.232+0000 7f3e697fa640 1 -- 172.21.15.44:0/2449576109 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f3e5c0abd90 con 0x7f3e6c0cde60 2023-11-04T01:40:34.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.232+0000 7f3e6bfff640 1 --2- 172.21.15.44:0/2449576109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3e5806ae70 0x7f3e5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.233+0000 7f3e6bfff640 1 --2- 172.21.15.44:0/2449576109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3e5806ae70 0x7f3e5806d330 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0d2c70 tx=0x7f3e60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:34.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.237+0000 7f3e697fa640 1 -- 172.21.15.44:0/2449576109 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3e5c076980 con 0x7f3e6c0cde60 2023-11-04T01:40:34.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.449+0000 7f3e72ad4640 1 -- 172.21.15.44:0/2449576109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e6c0b5720 con 0x7f3e6c0cde60 2023-11-04T01:40:34.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.450+0000 7f3e697fa640 1 -- 172.21.15.44:0/2449576109 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f3e5c035090 con 0x7f3e6c0cde60 2023-11-04T01:40:34.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:34.452 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6820,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:22.999863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6562,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6562":{"gid":6562,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":17,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:34.452 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 60 2023-11-04T01:40:34.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.452+0000 7f3e72ad4640 1 -- 172.21.15.44:0/2449576109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3e5806ae70 msgr2=0x7f3e5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.452+0000 7f3e72ad4640 1 --2- 172.21.15.44:0/2449576109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3e5806ae70 0x7f3e5806d330 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0d2c70 tx=0x7f3e60008040 comp rx=0 tx=0).stop 2023-11-04T01:40:34.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.452+0000 7f3e72ad4640 1 -- 172.21.15.44:0/2449576109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e6c0cde60 msgr2=0x7f3e6c1f5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.452+0000 7f3e72ad4640 1 --2- 172.21.15.44:0/2449576109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e6c0cde60 0x7f3e6c1f5b50 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009890 tx=0x7f3e5c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.452+0000 7f3e72ad4640 1 -- 172.21.15.44:0/2449576109 shutdown_connections 2023-11-04T01:40:34.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.452+0000 7f3e72ad4640 1 --2- 172.21.15.44:0/2449576109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3e5806ae70 0x7f3e5806d330 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.452+0000 7f3e72ad4640 1 --2- 172.21.15.44:0/2449576109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3e6c15daa0 0x7f3e6c0cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.452+0000 7f3e72ad4640 1 --2- 172.21.15.44:0/2449576109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e6c0ce240 0x7f3e6c159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.452+0000 7f3e72ad4640 1 --2- 172.21.15.44:0/2449576109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e6c0cde60 0x7f3e6c1f5b50 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.452+0000 7f3e72ad4640 1 -- 172.21.15.44:0/2449576109 >> 172.21.15.44:0/2449576109 conn(0x7f3e6c071f30 msgr2=0x7f3e6c0c8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:34.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.452+0000 7f3e72ad4640 1 -- 172.21.15.44:0/2449576109 shutdown_connections 2023-11-04T01:40:34.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:34.452+0000 7f3e72ad4640 1 -- 172.21.15.44:0/2449576109 wait complete. 2023-11-04T01:40:34.464 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:39.466 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:39.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.583+0000 7f35760d4640 1 Processor -- start 2023-11-04T01:40:39.585 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.583+0000 7f35760d4640 1 -- start start 2023-11-04T01:40:39.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.584+0000 7f35760d4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f357015ae40 0x7f357015bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.584+0000 7f35760d4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f35700cda30 0x7f35700ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.584+0000 7f35760d4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35700cc450 con 0x7f35700cbc00 2023-11-04T01:40:39.586 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.584+0000 7f35760d4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357015f400 con 0x7f357015ae40 2023-11-04T01:40:39.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.584+0000 7f35760d4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357015b220 con 0x7f35700cda30 2023-11-04T01:40:39.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.584+0000 7f356f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f357015ae40 0x7f357015bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.584+0000 7f356f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f357015ae40 0x7f357015bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53104/0 (socket says 172.21.15.44:53104) 2023-11-04T01:40:39.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.584+0000 7f356f7fe640 1 -- 172.21.15.44:0/2899269534 learned_addr learned my addr 172.21.15.44:0/2899269534 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:39.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.584+0000 7f356ffff640 1 --2- 172.21.15.44:0/2899269534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f35700cda30 0x7f35700ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.584+0000 7f356f7fe640 1 -- 172.21.15.44:0/2899269534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f35700cda30 msgr2=0x7f35700ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:39.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.584+0000 7f356f7fe640 1 --2- 172.21.15.44:0/2899269534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f35700cda30 0x7f35700ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.584+0000 7f356f7fe640 1 -- 172.21.15.44:0/2899269534 >> v1:172.21.15.204:6789/0 conn(0x7f35700cbc00 legacy=0x7f35700cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.587 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.584+0000 7f356f7fe640 1 -- 172.21.15.44:0/2899269534 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357015f890 con 0x7f357015ae40 2023-11-04T01:40:39.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.585+0000 7f356f7fe640 1 --2- 172.21.15.44:0/2899269534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357015ae40 0x7f357015bfb0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f3560009870 tx=0x7f356002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8b090c79d577e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.585+0000 7f356e7fc640 1 -- 172.21.15.44:0/2899269534 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3560030840 con 0x7f357015ae40 2023-11-04T01:40:39.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.585+0000 7f356e7fc640 1 -- 172.21.15.44:0/2899269534 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35600309a0 con 0x7f357015ae40 2023-11-04T01:40:39.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.585+0000 7f356e7fc640 1 -- 172.21.15.44:0/2899269534 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3560030d30 con 0x7f357015ae40 2023-11-04T01:40:39.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.586+0000 7f35760d4640 1 -- 172.21.15.44:0/2899269534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357015ae40 msgr2=0x7f357015bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.586+0000 7f35760d4640 1 --2- 172.21.15.44:0/2899269534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357015ae40 0x7f357015bfb0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f3560009870 tx=0x7f356002b980 comp rx=0 tx=0).stop 2023-11-04T01:40:39.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.586+0000 7f35760d4640 1 -- 172.21.15.44:0/2899269534 shutdown_connections 2023-11-04T01:40:39.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.586+0000 7f35760d4640 1 --2- 172.21.15.44:0/2899269534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f35700cda30 0x7f35700ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.586+0000 7f35760d4640 1 --2- 172.21.15.44:0/2899269534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f357015ae40 0x7f357015bfb0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.586+0000 7f35760d4640 1 -- 172.21.15.44:0/2899269534 >> 172.21.15.44:0/2899269534 conn(0x7f357006ea90 msgr2=0x7f357006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:39.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.586+0000 7f35760d4640 1 -- 172.21.15.44:0/2899269534 shutdown_connections 2023-11-04T01:40:39.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.586+0000 7f35760d4640 1 -- 172.21.15.44:0/2899269534 wait complete. 2023-11-04T01:40:39.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.587+0000 7f35760d4640 1 Processor -- start 2023-11-04T01:40:39.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.588+0000 7f35760d4640 1 -- start start 2023-11-04T01:40:39.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.588+0000 7f35760d4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f35700cbc00 0x7f35700c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.588+0000 7f35760d4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35700cda30 0x7f357014f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.588+0000 7f35760d4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f357015ae40 0x7f3570158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.588+0000 7f35760d4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35700c5bf0 con 0x7f35700cda30 2023-11-04T01:40:39.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.588+0000 7f35760d4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35700c5e40 con 0x7f357015ae40 2023-11-04T01:40:39.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.588+0000 7f35760d4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35700c6120 con 0x7f35700cbc00 2023-11-04T01:40:39.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.588+0000 7f356effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35700cda30 0x7f357014f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.588+0000 7f356effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35700cda30 0x7f357014f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53116/0 (socket says 172.21.15.44:53116) 2023-11-04T01:40:39.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.588+0000 7f356effd640 1 -- 172.21.15.44:0/3988098763 learned_addr learned my addr 172.21.15.44:0/3988098763 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:39.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.589+0000 7f356ffff640 1 --2- 172.21.15.44:0/3988098763 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f357015ae40 0x7f3570158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.589+0000 7f356f7fe640 1 --2- 172.21.15.44:0/3988098763 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f35700cbc00 0x7f35700c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.589+0000 7f356effd640 1 -- 172.21.15.44:0/3988098763 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f35700cbc00 msgr2=0x7f35700c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.589+0000 7f356effd640 1 --2- 172.21.15.44:0/3988098763 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f35700cbc00 0x7f35700c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.589+0000 7f356effd640 1 -- 172.21.15.44:0/3988098763 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f357015ae40 msgr2=0x7f3570158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.589+0000 7f356effd640 1 --2- 172.21.15.44:0/3988098763 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f357015ae40 0x7f3570158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.589+0000 7f356effd640 1 -- 172.21.15.44:0/3988098763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35600094d0 con 0x7f35700cda30 2023-11-04T01:40:39.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.589+0000 7f356effd640 1 --2- 172.21.15.44:0/3988098763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35700cda30 0x7f357014f090 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f356400c450 tx=0x7f356400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.589+0000 7f3557fff640 1 -- 172.21.15.44:0/3988098763 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35640052d0 con 0x7f35700cda30 2023-11-04T01:40:39.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.589+0000 7f3557fff640 1 -- 172.21.15.44:0/3988098763 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3564005430 con 0x7f35700cda30 2023-11-04T01:40:39.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.589+0000 7f35760d4640 1 -- 172.21.15.44:0/3988098763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35700c6400 con 0x7f35700cda30 2023-11-04T01:40:39.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.589+0000 7f3557fff640 1 -- 172.21.15.44:0/3988098763 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564012870 con 0x7f35700cda30 2023-11-04T01:40:39.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.589+0000 7f35760d4640 1 -- 172.21.15.44:0/3988098763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35700c7140 con 0x7f35700cda30 2023-11-04T01:40:39.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.590+0000 7f35760d4640 1 -- 172.21.15.44:0/3988098763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35700ce2d0 con 0x7f35700cda30 2023-11-04T01:40:39.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.591+0000 7f3557fff640 1 -- 172.21.15.44:0/3988098763 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f35640129d0 con 0x7f35700cda30 2023-11-04T01:40:39.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.591+0000 7f3557fff640 1 --2- 172.21.15.44:0/3988098763 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f355c06ae70 0x7f355c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.591+0000 7f3557fff640 1 -- 172.21.15.44:0/3988098763 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f35640895c0 con 0x7f35700cda30 2023-11-04T01:40:39.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.591+0000 7f356f7fe640 1 --2- 172.21.15.44:0/3988098763 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f355c06ae70 0x7f355c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.592+0000 7f356f7fe640 1 --2- 172.21.15.44:0/3988098763 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f355c06ae70 0x7f355c06d330 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3560036000 tx=0x7f356003b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.596+0000 7f3557fff640 1 -- 172.21.15.44:0/3988098763 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3564054070 con 0x7f35700cda30 2023-11-04T01:40:39.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.807+0000 7f35760d4640 1 -- 172.21.15.44:0/3988098763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35700c6920 con 0x7f35700cda30 2023-11-04T01:40:39.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.808+0000 7f3557fff640 1 -- 172.21.15.44:0/3988098763 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4982 (secure 0 0 0) 0x7f35700c6920 con 0x7f35700cda30 2023-11-04T01:40:39.810 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:39.810 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6820,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:39.212071+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6562,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6562":{"gid":6562,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":17,"addr":"172.21.15.44:6835/2252282753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2252282753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2252282753}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:40:39.212071+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:39.811 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 61 2023-11-04T01:40:39.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.810+0000 7f35760d4640 1 -- 172.21.15.44:0/3988098763 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f355c06ae70 msgr2=0x7f355c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.810+0000 7f35760d4640 1 --2- 172.21.15.44:0/3988098763 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f355c06ae70 0x7f355c06d330 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3560036000 tx=0x7f356003b040 comp rx=0 tx=0).stop 2023-11-04T01:40:39.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.810+0000 7f35760d4640 1 -- 172.21.15.44:0/3988098763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35700cda30 msgr2=0x7f357014f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.810+0000 7f35760d4640 1 --2- 172.21.15.44:0/3988098763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35700cda30 0x7f357014f090 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f356400c450 tx=0x7f356400c910 comp rx=0 tx=0).stop 2023-11-04T01:40:39.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.810+0000 7f35760d4640 1 -- 172.21.15.44:0/3988098763 shutdown_connections 2023-11-04T01:40:39.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.810+0000 7f35760d4640 1 --2- 172.21.15.44:0/3988098763 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f355c06ae70 0x7f355c06d330 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.810+0000 7f35760d4640 1 --2- 172.21.15.44:0/3988098763 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f357015ae40 0x7f3570158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.810+0000 7f35760d4640 1 --2- 172.21.15.44:0/3988098763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35700cda30 0x7f357014f090 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.810+0000 7f35760d4640 1 --2- 172.21.15.44:0/3988098763 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f35700cbc00 0x7f35700c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.810+0000 7f35760d4640 1 -- 172.21.15.44:0/3988098763 >> 172.21.15.44:0/3988098763 conn(0x7f357006ea90 msgr2=0x7f35700b62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:39.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.810+0000 7f35760d4640 1 -- 172.21.15.44:0/3988098763 shutdown_connections 2023-11-04T01:40:39.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:39.810+0000 7f35760d4640 1 -- 172.21.15.44:0/3988098763 wait complete. 2023-11-04T01:40:39.823 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:40:39.823 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:40:39.852 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:40:39.853 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:40:39.854 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:40:39.927 INFO:teuthology.orchestra.run.smithi044.stdout:1699062023.116337.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:40:39.929 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062023.116337.core'] 2023-11-04T01:40:39.929 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062023.116337.core, deleting it 2023-11-04T01:40:39.929 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062023.116337.core 2023-11-04T01:40:40.002 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:40:40.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.147+0000 7f536cf00640 1 Processor -- start 2023-11-04T01:40:40.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.147+0000 7f536cf00640 1 -- start start 2023-11-04T01:40:40.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.148+0000 7f536cf00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f53680b4880 0x7f53680b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.148+0000 7f536cf00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53680cde60 con 0x7f5368153e60 2023-11-04T01:40:40.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.148+0000 7f536cf00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5368160f90 con 0x7f53680cd6d0 2023-11-04T01:40:40.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.148+0000 7f536cf00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53680b5200 con 0x7f53680b4880 2023-11-04T01:40:40.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.148+0000 7f536659c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5368153e60 0x7f536815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49434/0 (socket says 172.21.15.44:49434) 2023-11-04T01:40:40.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.148+0000 7f536659c640 1 -- 172.21.15.44:0/90191485 learned_addr learned my addr 172.21.15.44:0/90191485 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:40.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536559a640 1 -- 172.21.15.44:0/90191485 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933590834 0 0) 0x7f53680cde60 con 0x7f5368153e60 2023-11-04T01:40:40.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536559a640 1 -- 172.21.15.44:0/90191485 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5354003520 con 0x7f5368153e60 2023-11-04T01:40:40.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f5366d9d640 1 --2- 172.21.15.44:0/90191485 >> v2:172.21.15.204:3300/0 conn(0x7f53680b4880 0x7f53680b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536559a640 1 -- 172.21.15.44:0/90191485 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1934388934 0 0) 0x7f5354003520 con 0x7f5368153e60 2023-11-04T01:40:40.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536559a640 1 -- 172.21.15.44:0/90191485 >> v2:172.21.15.204:3300/0 conn(0x7f53680b4880 msgr2=0x7f53680b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:40.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536559a640 1 --2- 172.21.15.44:0/90191485 >> v2:172.21.15.204:3300/0 conn(0x7f53680b4880 0x7f53680b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536559a640 1 -- 172.21.15.44:0/90191485 >> v1:172.21.15.204:6789/0 conn(0x7f53680cd6d0 legacy=0x7f5368161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536559a640 1 -- 172.21.15.44:0/90191485 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53680ce090 con 0x7f5368153e60 2023-11-04T01:40:40.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536559a640 1 -- 172.21.15.44:0/90191485 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f5360001670 con 0x7f5368153e60 2023-11-04T01:40:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536559a640 1 -- 172.21.15.44:0/90191485 >> v1:172.21.15.44:6789/0 conn(0x7f5368153e60 legacy=0x7f536815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536559a640 1 --2- 172.21.15.44:0/90191485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5354003970 0x7f5354003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536559a640 1 --2- 172.21.15.44:0/90191485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53540047c0 0x7f5354004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536559a640 1 --2- 172.21.15.44:0/90191485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5354005180 0x7f535400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536559a640 1 -- 172.21.15.44:0/90191485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680b5200 con 0x7f53540047c0 2023-11-04T01:40:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536559a640 1 -- 172.21.15.44:0/90191485 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535400c020 con 0x7f5354003970 2023-11-04T01:40:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536559a640 1 -- 172.21.15.44:0/90191485 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535400c1e0 con 0x7f5354005180 2023-11-04T01:40:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f5365d9b640 1 --2- 172.21.15.44:0/90191485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53540047c0 0x7f5354004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f536659c640 1 --2- 172.21.15.44:0/90191485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5354003970 0x7f5354003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f5366d9d640 1 --2- 172.21.15.44:0/90191485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5354005180 0x7f535400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f5365d9b640 1 -- 172.21.15.44:0/90191485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5354005180 msgr2=0x7f535400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f5365d9b640 1 --2- 172.21.15.44:0/90191485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5354005180 0x7f535400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f5365d9b640 1 -- 172.21.15.44:0/90191485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5354003970 msgr2=0x7f5354003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f5365d9b640 1 --2- 172.21.15.44:0/90191485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5354003970 0x7f5354003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f5365d9b640 1 -- 172.21.15.44:0/90191485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5354003520 con 0x7f53540047c0 2023-11-04T01:40:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.149+0000 7f5366d9d640 1 --2- 172.21.15.44:0/90191485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5354005180 0x7f535400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.150+0000 7f5366d9d640 1 -- 172.21.15.44:0/90191485 reap_dead start 2023-11-04T01:40:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.150+0000 7f5365d9b640 1 --2- 172.21.15.44:0/90191485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53540047c0 0x7f5354004c40 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f5350001720 tx=0x7f53540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd68b2d0f3c8069a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.150+0000 7f536559a640 1 -- 172.21.15.44:0/90191485 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53500052d0 con 0x7f53540047c0 2023-11-04T01:40:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.150+0000 7f536559a640 1 -- 172.21.15.44:0/90191485 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535002e050 con 0x7f53540047c0 2023-11-04T01:40:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.150+0000 7f536559a640 1 -- 172.21.15.44:0/90191485 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350003830 con 0x7f53540047c0 2023-11-04T01:40:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.151+0000 7f536cf00640 1 -- 172.21.15.44:0/90191485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53540047c0 msgr2=0x7f5354004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.151+0000 7f536cf00640 1 --2- 172.21.15.44:0/90191485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53540047c0 0x7f5354004c40 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f5350001720 tx=0x7f53540057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.151+0000 7f536cf00640 1 -- 172.21.15.44:0/90191485 shutdown_connections 2023-11-04T01:40:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.151+0000 7f536cf00640 1 --2- 172.21.15.44:0/90191485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53540047c0 0x7f5354004c40 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.151+0000 7f536cf00640 1 -- 172.21.15.44:0/90191485 >> 172.21.15.44:0/90191485 conn(0x7f53680cf880 msgr2=0x7f53680cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.151+0000 7f536cf00640 1 -- 172.21.15.44:0/90191485 shutdown_connections 2023-11-04T01:40:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.151+0000 7f536cf00640 1 -- 172.21.15.44:0/90191485 wait complete. 2023-11-04T01:40:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.152+0000 7f536cf00640 1 Processor -- start 2023-11-04T01:40:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.152+0000 7f536cf00640 1 -- start start 2023-11-04T01:40:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f536cf00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53540047c0 0x7f53681597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f536cf00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f536815f7b0 0x7f536815fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f536cf00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53681f5cd0 0x7f53681f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f536cf00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53681593b0 con 0x7f53540047c0 2023-11-04T01:40:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f536cf00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680c8b80 con 0x7f53681f5cd0 2023-11-04T01:40:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f536cf00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5368160170 con 0x7f536815f7b0 2023-11-04T01:40:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f536659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53540047c0 0x7f53681597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f536659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53540047c0 0x7f53681597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53130/0 (socket says 172.21.15.44:53130) 2023-11-04T01:40:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f536659c640 1 -- 172.21.15.44:0/2753558525 learned_addr learned my addr 172.21.15.44:0/2753558525 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f5366d9d640 1 --2- 172.21.15.44:0/2753558525 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53681f5cd0 0x7f53681f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f5365d9b640 1 --2- 172.21.15.44:0/2753558525 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f536815f7b0 0x7f536815fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f536659c640 1 -- 172.21.15.44:0/2753558525 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f536815f7b0 msgr2=0x7f536815fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f536659c640 1 --2- 172.21.15.44:0/2753558525 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f536815f7b0 0x7f536815fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f536659c640 1 -- 172.21.15.44:0/2753558525 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53681f5cd0 msgr2=0x7f53681f6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f536659c640 1 --2- 172.21.15.44:0/2753558525 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53681f5cd0 0x7f53681f6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f536659c640 1 -- 172.21.15.44:0/2753558525 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53681f6bc0 con 0x7f53540047c0 2023-11-04T01:40:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.153+0000 7f5365d9b640 1 --2- 172.21.15.44:0/2753558525 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f536815f7b0 0x7f536815fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.154+0000 7f536659c640 1 --2- 172.21.15.44:0/2753558525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53540047c0 0x7f53681597d0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f53600072c0 tx=0x7f5360007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.154+0000 7f535effd640 1 -- 172.21.15.44:0/2753558525 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536000f860 con 0x7f53540047c0 2023-11-04T01:40:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.154+0000 7f535effd640 1 -- 172.21.15.44:0/2753558525 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536000fa00 con 0x7f53540047c0 2023-11-04T01:40:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.154+0000 7f536cf00640 1 -- 172.21.15.44:0/2753558525 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53681f6690 con 0x7f53540047c0 2023-11-04T01:40:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.154+0000 7f535effd640 1 -- 172.21.15.44:0/2753558525 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536000fdb0 con 0x7f53540047c0 2023-11-04T01:40:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.154+0000 7f536cf00640 1 -- 172.21.15.44:0/2753558525 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5368158cf0 con 0x7f53540047c0 2023-11-04T01:40:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.155+0000 7f536cf00640 1 -- 172.21.15.44:0/2753558525 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53681594f0 con 0x7f53540047c0 2023-11-04T01:40:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.155+0000 7f535effd640 1 -- 172.21.15.44:0/2753558525 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f536001d460 con 0x7f53540047c0 2023-11-04T01:40:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.156+0000 7f535effd640 1 --2- 172.21.15.44:0/2753558525 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f534806ae70 0x7f534806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.156+0000 7f535effd640 1 -- 172.21.15.44:0/2753558525 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f5360089c60 con 0x7f53540047c0 2023-11-04T01:40:40.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.156+0000 7f5365d9b640 1 --2- 172.21.15.44:0/2753558525 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f534806ae70 0x7f534806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.156+0000 7f5365d9b640 1 --2- 172.21.15.44:0/2753558525 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f534806ae70 0x7f534806d330 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5350033000 tx=0x7f5350009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.162 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2023-11-04T01:40:40.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.160+0000 7f535effd640 1 -- 172.21.15.44:0/2753558525 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53681594f0 con 0x7f53540047c0 2023-11-04T01:40:40.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.406+0000 7f536cf00640 1 -- 172.21.15.44:0/2753558525 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f53681594f0 con 0x7f53540047c0 2023-11-04T01:40:40.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.408+0000 7f535effd640 1 -- 172.21.15.44:0/2753558525 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 6562 v62) v1 ==== 97+0+0 (secure 0 0 0) 0x7f53681594f0 con 0x7f53540047c0 2023-11-04T01:40:40.410 INFO:teuthology.orchestra.run.smithi044.stderr:failed mds gid 6562 2023-11-04T01:40:40.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.411+0000 7f536cf00640 1 -- 172.21.15.44:0/2753558525 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f534806ae70 msgr2=0x7f534806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.411+0000 7f536cf00640 1 --2- 172.21.15.44:0/2753558525 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f534806ae70 0x7f534806d330 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5350033000 tx=0x7f5350009030 comp rx=0 tx=0).stop 2023-11-04T01:40:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.411+0000 7f536cf00640 1 -- 172.21.15.44:0/2753558525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53540047c0 msgr2=0x7f53681597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.411+0000 7f536cf00640 1 --2- 172.21.15.44:0/2753558525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53540047c0 0x7f53681597d0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f53600072c0 tx=0x7f5360007780 comp rx=0 tx=0).stop 2023-11-04T01:40:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.411+0000 7f536cf00640 1 -- 172.21.15.44:0/2753558525 shutdown_connections 2023-11-04T01:40:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.411+0000 7f536cf00640 1 --2- 172.21.15.44:0/2753558525 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f534806ae70 0x7f534806d330 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.412+0000 7f536cf00640 1 --2- 172.21.15.44:0/2753558525 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53681f5cd0 0x7f53681f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.412+0000 7f536cf00640 1 --2- 172.21.15.44:0/2753558525 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f536815f7b0 0x7f536815fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.412+0000 7f536cf00640 1 --2- 172.21.15.44:0/2753558525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53540047c0 0x7f53681597d0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.412+0000 7f536cf00640 1 -- 172.21.15.44:0/2753558525 >> 172.21.15.44:0/2753558525 conn(0x7f53680cf880 msgr2=0x7f53680d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:40.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.412+0000 7f536cf00640 1 -- 172.21.15.44:0/2753558525 shutdown_connections 2023-11-04T01:40:40.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.412+0000 7f536cf00640 1 -- 172.21.15.44:0/2753558525 wait complete. 2023-11-04T01:40:40.427 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:40:40.428 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:40:40.428 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:40:40.428 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:40.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:40:40.428 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:40:40.428 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:40:40.429 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:40:40.431 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:40:40.431 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:40.512 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2023-11-04T01:40:40.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.535+0000 7f8970e83640 1 Processor -- start 2023-11-04T01:40:40.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.535+0000 7f8970e83640 1 -- start start 2023-11-04T01:40:40.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.536+0000 7f8970e83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f896c157710 0x7f896c167b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.536+0000 7f8970e83640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896c15e000 con 0x7f896c0ce240 2023-11-04T01:40:40.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.536+0000 7f8970e83640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896c15e2e0 con 0x7f896c0cde60 2023-11-04T01:40:40.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.536+0000 7f8970e83640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896c15e5c0 con 0x7f896c157710 2023-11-04T01:40:40.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.536+0000 7f896ad9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f896c157710 0x7f896c167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.536+0000 7f8969d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f896c0ce240 0x7f896c157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49456/0 (socket says 172.21.15.44:49456) 2023-11-04T01:40:40.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.537+0000 7f8969d9b640 1 -- 172.21.15.44:0/464390111 learned_addr learned my addr 172.21.15.44:0/464390111 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:40.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.537+0000 7f896ad9d640 1 -- 172.21.15.44:0/464390111 >> v1:172.21.15.204:6789/0 conn(0x7f896c0cde60 legacy=0x7f896c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.537+0000 7f896ad9d640 1 -- 172.21.15.44:0/464390111 >> v1:172.21.15.44:6789/0 conn(0x7f896c0ce240 legacy=0x7f896c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.537+0000 7f896ad9d640 1 -- 172.21.15.44:0/464390111 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c0d1120 con 0x7f896c157710 2023-11-04T01:40:40.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.538+0000 7f896ad9d640 1 --2- 172.21.15.44:0/464390111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c157710 0x7f896c167b90 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f8964009d90 tx=0x7f896402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d814e8db293bef7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.538+0000 7f896959a640 1 -- 172.21.15.44:0/464390111 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896402cd00 con 0x7f896c157710 2023-11-04T01:40:40.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.538+0000 7f896959a640 1 -- 172.21.15.44:0/464390111 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896402ce60 con 0x7f896c157710 2023-11-04T01:40:40.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.538+0000 7f896959a640 1 -- 172.21.15.44:0/464390111 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964034660 con 0x7f896c157710 2023-11-04T01:40:40.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.538+0000 7f8970e83640 1 -- 172.21.15.44:0/464390111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c157710 msgr2=0x7f896c167b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.538+0000 7f8970e83640 1 --2- 172.21.15.44:0/464390111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c157710 0x7f896c167b90 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f8964009d90 tx=0x7f896402bf50 comp rx=0 tx=0).stop 2023-11-04T01:40:40.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.538+0000 7f8970e83640 1 -- 172.21.15.44:0/464390111 shutdown_connections 2023-11-04T01:40:40.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.538+0000 7f8970e83640 1 --2- 172.21.15.44:0/464390111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c157710 0x7f896c167b90 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.538+0000 7f8970e83640 1 -- 172.21.15.44:0/464390111 >> 172.21.15.44:0/464390111 conn(0x7f896c071f30 msgr2=0x7f896c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:40.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.538+0000 7f8970e83640 1 -- 172.21.15.44:0/464390111 shutdown_connections 2023-11-04T01:40:40.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.538+0000 7f8970e83640 1 -- 172.21.15.44:0/464390111 wait complete. 2023-11-04T01:40:40.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.540+0000 7f8970e83640 1 Processor -- start 2023-11-04T01:40:40.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.540+0000 7f8970e83640 1 -- start start 2023-11-04T01:40:40.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.540+0000 7f8970e83640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f896c0cde60 0x7f896c156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.540+0000 7f8970e83640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0ce240 0x7f896c159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.540+0000 7f8970e83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f896c157710 0x7f896c0cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.540+0000 7f8970e83640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c1f2620 con 0x7f896c0ce240 2023-11-04T01:40:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.540+0000 7f8970e83640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c15a7b0 con 0x7f896c0cde60 2023-11-04T01:40:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.540+0000 7f8970e83640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c15aa90 con 0x7f896c157710 2023-11-04T01:40:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.540+0000 7f8969d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0ce240 0x7f896c159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.540+0000 7f8969d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0ce240 0x7f896c159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53182/0 (socket says 172.21.15.44:53182) 2023-11-04T01:40:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.540+0000 7f8969d9b640 1 -- 172.21.15.44:0/1483346250 learned_addr learned my addr 172.21.15.44:0/1483346250 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.541+0000 7f896a59c640 1 --2- 172.21.15.44:0/1483346250 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f896c0cde60 0x7f896c156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.541+0000 7f896ad9d640 1 --2- 172.21.15.44:0/1483346250 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f896c157710 0x7f896c0cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.541+0000 7f8969d9b640 1 -- 172.21.15.44:0/1483346250 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f896c157710 msgr2=0x7f896c0cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.541+0000 7f8969d9b640 1 --2- 172.21.15.44:0/1483346250 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f896c157710 0x7f896c0cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.541+0000 7f8969d9b640 1 -- 172.21.15.44:0/1483346250 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f896c0cde60 msgr2=0x7f896c156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.541+0000 7f8969d9b640 1 --2- 172.21.15.44:0/1483346250 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f896c0cde60 0x7f896c156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.541+0000 7f8969d9b640 1 -- 172.21.15.44:0/1483346250 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8964009a70 con 0x7f896c0ce240 2023-11-04T01:40:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.541+0000 7f896ad9d640 1 --2- 172.21.15.44:0/1483346250 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f896c157710 0x7f896c0cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.541+0000 7f8969d9b640 1 --2- 172.21.15.44:0/1483346250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0ce240 0x7f896c159cf0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f896000c4a0 tx=0x7f896000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.541+0000 7f895affd640 1 -- 172.21.15.44:0/1483346250 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8960005ce0 con 0x7f896c0ce240 2023-11-04T01:40:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.541+0000 7f895affd640 1 -- 172.21.15.44:0/1483346250 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8960005e40 con 0x7f896c0ce240 2023-11-04T01:40:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.541+0000 7f8970e83640 1 -- 172.21.15.44:0/1483346250 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896c15ad70 con 0x7f896c0ce240 2023-11-04T01:40:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.541+0000 7f895affd640 1 -- 172.21.15.44:0/1483346250 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8960007270 con 0x7f896c0ce240 2023-11-04T01:40:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.541+0000 7f8970e83640 1 -- 172.21.15.44:0/1483346250 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896c1598c0 con 0x7f896c0ce240 2023-11-04T01:40:40.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.542+0000 7f8970e83640 1 -- 172.21.15.44:0/1483346250 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f896c074290 con 0x7f896c0ce240 2023-11-04T01:40:40.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.543+0000 7f895affd640 1 -- 172.21.15.44:0/1483346250 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8960007490 con 0x7f896c0ce240 2023-11-04T01:40:40.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.543+0000 7f895affd640 1 --2- 172.21.15.44:0/1483346250 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f894c06ae70 0x7f894c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.543+0000 7f895affd640 1 -- 172.21.15.44:0/1483346250 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7f8960089110 con 0x7f896c0ce240 2023-11-04T01:40:40.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.543+0000 7f896a59c640 1 --2- 172.21.15.44:0/1483346250 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f894c06ae70 0x7f894c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.544+0000 7f896a59c640 1 --2- 172.21.15.44:0/1483346250 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f894c06ae70 0x7f894c06d330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f895c000f60 tx=0x7f895c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.547+0000 7f895affd640 1 -- 172.21.15.44:0/1483346250 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8960053ba0 con 0x7f896c0ce240 2023-11-04T01:40:40.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.764+0000 7f8970e83640 1 -- 172.21.15.44:0/1483346250 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f896c0ceae0 con 0x7f896c0ce240 2023-11-04T01:40:40.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.765+0000 7f895affd640 1 -- 172.21.15.44:0/1483346250 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4143 (secure 0 0 0) 0x7f89600571c0 con 0x7f896c0ce240 2023-11-04T01:40:40.767 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:40.767 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:40.412986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6820,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6820":{"gid":6820,"name":"d","rank":0,"incarnation":63,"state":"up:replay","state_seq":1,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:40.767 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 63 2023-11-04T01:40:40.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.767+0000 7f8970e83640 1 -- 172.21.15.44:0/1483346250 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f894c06ae70 msgr2=0x7f894c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.767+0000 7f8970e83640 1 --2- 172.21.15.44:0/1483346250 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f894c06ae70 0x7f894c06d330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f895c000f60 tx=0x7f895c009040 comp rx=0 tx=0).stop 2023-11-04T01:40:40.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.767+0000 7f8970e83640 1 -- 172.21.15.44:0/1483346250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0ce240 msgr2=0x7f896c159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.767+0000 7f8970e83640 1 --2- 172.21.15.44:0/1483346250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0ce240 0x7f896c159cf0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f896000c4a0 tx=0x7f896000c960 comp rx=0 tx=0).stop 2023-11-04T01:40:40.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.767+0000 7f8970e83640 1 -- 172.21.15.44:0/1483346250 shutdown_connections 2023-11-04T01:40:40.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.767+0000 7f8970e83640 1 --2- 172.21.15.44:0/1483346250 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f894c06ae70 0x7f894c06d330 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.767+0000 7f8970e83640 1 --2- 172.21.15.44:0/1483346250 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f896c157710 0x7f896c0cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.767+0000 7f8970e83640 1 --2- 172.21.15.44:0/1483346250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f896c0ce240 0x7f896c159cf0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.767+0000 7f8970e83640 1 --2- 172.21.15.44:0/1483346250 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f896c0cde60 0x7f896c156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.767+0000 7f8970e83640 1 -- 172.21.15.44:0/1483346250 >> 172.21.15.44:0/1483346250 conn(0x7f896c071f30 msgr2=0x7f896c0b6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:40.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.767+0000 7f8970e83640 1 -- 172.21.15.44:0/1483346250 shutdown_connections 2023-11-04T01:40:40.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:40.767+0000 7f8970e83640 1 -- 172.21.15.44:0/1483346250 wait complete. 2023-11-04T01:40:40.779 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:40:45.780 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:45.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.897+0000 7f75e107c640 1 Processor -- start 2023-11-04T01:40:45.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.897+0000 7f75e107c640 1 -- start start 2023-11-04T01:40:45.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.898+0000 7f75e107c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75dc160b10 0x7f75dc160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.898+0000 7f75e107c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f75dc0cf160 0x7f75dc0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.898+0000 7f75e107c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75dc06bf00 con 0x7f75dc15ce60 2023-11-04T01:40:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.898+0000 7f75e107c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75dc0cbde0 con 0x7f75dc0cf160 2023-11-04T01:40:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.898+0000 7f75e107c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc0cfb30 con 0x7f75dc160b10 2023-11-04T01:40:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.898+0000 7f75db59e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f75dc0cf160 0x7f75dc0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.898+0000 7f75db59e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f75dc0cf160 0x7f75dc0cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48000/0 (socket says 172.21.15.44:48000) 2023-11-04T01:40:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.898+0000 7f75db59e640 1 -- 172.21.15.44:0/2429959721 learned_addr learned my addr 172.21.15.44:0/2429959721 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.898+0000 7f75db59e640 1 -- 172.21.15.44:0/2429959721 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75dc160b10 msgr2=0x7f75dc160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.898+0000 7f75da59c640 1 --2- 172.21.15.44:0/2429959721 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75dc160b10 0x7f75dc160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.898+0000 7f75db59e640 1 --2- 172.21.15.44:0/2429959721 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75dc160b10 0x7f75dc160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.898+0000 7f75db59e640 1 -- 172.21.15.44:0/2429959721 >> v1:172.21.15.204:6789/0 conn(0x7f75dc15ce60 legacy=0x7f75dc06b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:45.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.898+0000 7f75db59e640 1 -- 172.21.15.44:0/2429959721 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc1615d0 con 0x7f75dc0cf160 2023-11-04T01:40:45.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.898+0000 7f75da59c640 1 --2- 172.21.15.44:0/2429959721 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75dc160b10 0x7f75dc160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:45.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.899+0000 7f75db59e640 1 --2- 172.21.15.44:0/2429959721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75dc0cf160 0x7f75dc0cf5f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009e50 tx=0x7f75d402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85478d782415a0f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.899+0000 7f75d9d9b640 1 -- 172.21.15.44:0/2429959721 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d402ca70 con 0x7f75dc0cf160 2023-11-04T01:40:45.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.899+0000 7f75d9d9b640 1 -- 172.21.15.44:0/2429959721 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d402cbd0 con 0x7f75dc0cf160 2023-11-04T01:40:45.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.899+0000 7f75d9d9b640 1 -- 172.21.15.44:0/2429959721 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d40343f0 con 0x7f75dc0cf160 2023-11-04T01:40:45.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.900+0000 7f75e107c640 1 -- 172.21.15.44:0/2429959721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75dc0cf160 msgr2=0x7f75dc0cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.900+0000 7f75e107c640 1 --2- 172.21.15.44:0/2429959721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75dc0cf160 0x7f75dc0cf5f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009e50 tx=0x7f75d402bed0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.900+0000 7f75e107c640 1 -- 172.21.15.44:0/2429959721 shutdown_connections 2023-11-04T01:40:45.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.900+0000 7f75e107c640 1 --2- 172.21.15.44:0/2429959721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75dc0cf160 0x7f75dc0cf5f0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.900+0000 7f75e107c640 1 --2- 172.21.15.44:0/2429959721 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75dc160b10 0x7f75dc160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.900+0000 7f75e107c640 1 -- 172.21.15.44:0/2429959721 >> 172.21.15.44:0/2429959721 conn(0x7f75dc06ea90 msgr2=0x7f75dc06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:45.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.900+0000 7f75e107c640 1 -- 172.21.15.44:0/2429959721 shutdown_connections 2023-11-04T01:40:45.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.900+0000 7f75e107c640 1 -- 172.21.15.44:0/2429959721 wait complete. 2023-11-04T01:40:45.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.901+0000 7f75e107c640 1 Processor -- start 2023-11-04T01:40:45.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.901+0000 7f75e107c640 1 -- start start 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.902+0000 7f75e107c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75dc0cf160 0x7f75dc1f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.902+0000 7f75e107c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75dc15ce60 0x7f75dc1f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.902+0000 7f75e107c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75dc160b10 0x7f75dc153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.902+0000 7f75e107c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc153f20 con 0x7f75dc15ce60 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.902+0000 7f75e107c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc15d3e0 con 0x7f75dc0cf160 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.902+0000 7f75e107c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc15d6c0 con 0x7f75dc160b10 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.902+0000 7f75da59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75dc15ce60 0x7f75dc1f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.902+0000 7f75da59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75dc15ce60 0x7f75dc1f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48002/0 (socket says 172.21.15.44:48002) 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.902+0000 7f75da59c640 1 -- 172.21.15.44:0/2901475534 learned_addr learned my addr 172.21.15.44:0/2901475534 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.903+0000 7f75db59e640 1 --2- 172.21.15.44:0/2901475534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75dc160b10 0x7f75dc153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.903+0000 7f75dad9d640 1 --2- 172.21.15.44:0/2901475534 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75dc0cf160 0x7f75dc1f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.903+0000 7f75da59c640 1 -- 172.21.15.44:0/2901475534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75dc160b10 msgr2=0x7f75dc153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.903+0000 7f75da59c640 1 --2- 172.21.15.44:0/2901475534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75dc160b10 0x7f75dc153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.903+0000 7f75da59c640 1 -- 172.21.15.44:0/2901475534 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75dc0cf160 msgr2=0x7f75dc1f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.903+0000 7f75da59c640 1 --2- 172.21.15.44:0/2901475534 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75dc0cf160 0x7f75dc1f3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.903+0000 7f75da59c640 1 -- 172.21.15.44:0/2901475534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d4009b30 con 0x7f75dc15ce60 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.903+0000 7f75db59e640 1 --2- 172.21.15.44:0/2901475534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75dc160b10 0x7f75dc153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.903+0000 7f75da59c640 1 --2- 172.21.15.44:0/2901475534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75dc15ce60 0x7f75dc1f5a50 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f75d000c7f0 tx=0x7f75d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.903+0000 7f75c37fe640 1 -- 172.21.15.44:0/2901475534 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0007820 con 0x7f75dc15ce60 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.903+0000 7f75c37fe640 1 -- 172.21.15.44:0/2901475534 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d0007980 con 0x7f75dc15ce60 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.903+0000 7f75e107c640 1 -- 172.21.15.44:0/2901475534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75dc15d9a0 con 0x7f75dc15ce60 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.903+0000 7f75c37fe640 1 -- 172.21.15.44:0/2901475534 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0007cf0 con 0x7f75dc15ce60 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.903+0000 7f75e107c640 1 -- 172.21.15.44:0/2901475534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75dc153b80 con 0x7f75dc15ce60 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.904+0000 7f75e107c640 1 -- 172.21.15.44:0/2901475534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75dc15d240 con 0x7f75dc15ce60 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.905+0000 7f75c37fe640 1 -- 172.21.15.44:0/2901475534 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f75d00113f0 con 0x7f75dc15ce60 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.905+0000 7f75c37fe640 1 --2- 172.21.15.44:0/2901475534 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f75c806ae70 0x7f75c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.905+0000 7f75c37fe640 1 -- 172.21.15.44:0/2901475534 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7f75d0089f70 con 0x7f75dc15ce60 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.905+0000 7f75dad9d640 1 --2- 172.21.15.44:0/2901475534 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f75c806ae70 0x7f75c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.906+0000 7f75dad9d640 1 --2- 172.21.15.44:0/2901475534 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f75c806ae70 0x7f75c806d330 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f75cc006fd0 tx=0x7f75cc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:45.909+0000 7f75c37fe640 1 -- 172.21.15.44:0/2901475534 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f75d00bcca0 con 0x7f75dc15ce60 2023-11-04T01:40:46.051 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:40:46.050+0000 7f55b941c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:46.051 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:40:46.050+0000 7f55b941c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:46.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.121+0000 7f75e107c640 1 -- 172.21.15.44:0/2901475534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75dc074290 con 0x7f75dc15ce60 2023-11-04T01:40:46.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.122+0000 7f75c37fe640 1 -- 172.21.15.44:0/2901475534 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f75d001f090 con 0x7f75dc15ce60 2023-11-04T01:40:46.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:46.124 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7797,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:43.430226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6820,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6820":{"gid":6820,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:46.124 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 67 2023-11-04T01:40:46.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.124+0000 7f75e107c640 1 -- 172.21.15.44:0/2901475534 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f75c806ae70 msgr2=0x7f75c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.124+0000 7f75e107c640 1 --2- 172.21.15.44:0/2901475534 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f75c806ae70 0x7f75c806d330 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f75cc006fd0 tx=0x7f75cc008040 comp rx=0 tx=0).stop 2023-11-04T01:40:46.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.124+0000 7f75e107c640 1 -- 172.21.15.44:0/2901475534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75dc15ce60 msgr2=0x7f75dc1f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.124+0000 7f75e107c640 1 --2- 172.21.15.44:0/2901475534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75dc15ce60 0x7f75dc1f5a50 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f75d000c7f0 tx=0x7f75d000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.124+0000 7f75e107c640 1 -- 172.21.15.44:0/2901475534 shutdown_connections 2023-11-04T01:40:46.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.124+0000 7f75e107c640 1 --2- 172.21.15.44:0/2901475534 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f75c806ae70 0x7f75c806d330 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.124+0000 7f75e107c640 1 --2- 172.21.15.44:0/2901475534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75dc160b10 0x7f75dc153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.124+0000 7f75e107c640 1 --2- 172.21.15.44:0/2901475534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75dc15ce60 0x7f75dc1f5a50 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.124+0000 7f75e107c640 1 --2- 172.21.15.44:0/2901475534 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75dc0cf160 0x7f75dc1f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.124+0000 7f75e107c640 1 -- 172.21.15.44:0/2901475534 >> 172.21.15.44:0/2901475534 conn(0x7f75dc06ea90 msgr2=0x7f75dc072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.124+0000 7f75e107c640 1 -- 172.21.15.44:0/2901475534 shutdown_connections 2023-11-04T01:40:46.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.124+0000 7f75e107c640 1 -- 172.21.15.44:0/2901475534 wait complete. 2023-11-04T01:40:46.138 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:40:46.138 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:46.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.243+0000 7f52467b6640 1 Processor -- start 2023-11-04T01:40:46.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.243+0000 7f52467b6640 1 -- start start 2023-11-04T01:40:46.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.244+0000 7f52467b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f524015ad80 0x7f52400abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.244+0000 7f52467b6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f524006a1b0 0x7f524006b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.244+0000 7f52467b6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524006cf60 con 0x7f52400c9a40 2023-11-04T01:40:46.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.244+0000 7f52467b6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52400ac390 con 0x7f524006a1b0 2023-11-04T01:40:46.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.244+0000 7f52467b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524015b160 con 0x7f524015ad80 2023-11-04T01:40:46.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.244+0000 7f523f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f524006a1b0 0x7f524006b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.244+0000 7f523f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f524006a1b0 0x7f524006b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48004/0 (socket says 172.21.15.44:48004) 2023-11-04T01:40:46.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.244+0000 7f523f7fe640 1 -- 172.21.15.44:0/3613481438 learned_addr learned my addr 172.21.15.44:0/3613481438 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:46.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.244+0000 7f523ffff640 1 --2- 172.21.15.44:0/3613481438 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f524015ad80 0x7f52400abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.244+0000 7f523f7fe640 1 -- 172.21.15.44:0/3613481438 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f524015ad80 msgr2=0x7f52400abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:46.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.244+0000 7f523f7fe640 1 --2- 172.21.15.44:0/3613481438 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f524015ad80 0x7f52400abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.244+0000 7f523f7fe640 1 -- 172.21.15.44:0/3613481438 >> v1:172.21.15.204:6789/0 conn(0x7f52400c9a40 legacy=0x7f524006dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:46.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.244+0000 7f523f7fe640 1 -- 172.21.15.44:0/3613481438 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524006b9b0 con 0x7f524006a1b0 2023-11-04T01:40:46.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.245+0000 7f523f7fe640 1 --2- 172.21.15.44:0/3613481438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f524006a1b0 0x7f524006b010 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f5234009870 tx=0x7f523402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22945a71e9661ce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.245+0000 7f523effd640 1 -- 172.21.15.44:0/3613481438 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234031640 con 0x7f524006a1b0 2023-11-04T01:40:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.245+0000 7f523effd640 1 -- 172.21.15.44:0/3613481438 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52340317a0 con 0x7f524006a1b0 2023-11-04T01:40:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.245+0000 7f523effd640 1 -- 172.21.15.44:0/3613481438 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234031b30 con 0x7f524006a1b0 2023-11-04T01:40:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.246+0000 7f52467b6640 1 -- 172.21.15.44:0/3613481438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f524006a1b0 msgr2=0x7f524006b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.246+0000 7f52467b6640 1 --2- 172.21.15.44:0/3613481438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f524006a1b0 0x7f524006b010 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f5234009870 tx=0x7f523402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.246+0000 7f52467b6640 1 -- 172.21.15.44:0/3613481438 shutdown_connections 2023-11-04T01:40:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.246+0000 7f52467b6640 1 --2- 172.21.15.44:0/3613481438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f524006a1b0 0x7f524006b010 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.246+0000 7f52467b6640 1 --2- 172.21.15.44:0/3613481438 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f524015ad80 0x7f52400abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.246+0000 7f52467b6640 1 -- 172.21.15.44:0/3613481438 >> 172.21.15.44:0/3613481438 conn(0x7f52400b0cd0 msgr2=0x7f52400b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.246+0000 7f52467b6640 1 -- 172.21.15.44:0/3613481438 shutdown_connections 2023-11-04T01:40:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.246+0000 7f52467b6640 1 -- 172.21.15.44:0/3613481438 wait complete. 2023-11-04T01:40:46.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.247+0000 7f52467b6640 1 Processor -- start 2023-11-04T01:40:46.250 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.247+0000 7f52467b6640 1 -- start start 2023-11-04T01:40:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f52467b6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f524006a1b0 0x7f52400c1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f52467b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52400c9a40 0x7f52400cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f52467b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f524015ad80 0x7f524014c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f52467b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52400cdd10 con 0x7f524015ad80 2023-11-04T01:40:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f52467b6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52400cdff0 con 0x7f524006a1b0 2023-11-04T01:40:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f52467b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52400ce2d0 con 0x7f52400c9a40 2023-11-04T01:40:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f5244d53640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f524015ad80 0x7f524014c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f5244d53640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f524015ad80 0x7f524014c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48020/0 (socket says 172.21.15.44:48020) 2023-11-04T01:40:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f5244d53640 1 -- 172.21.15.44:0/4115705522 learned_addr learned my addr 172.21.15.44:0/4115705522 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f523ffff640 1 --2- 172.21.15.44:0/4115705522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f524006a1b0 0x7f52400c1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f523f7fe640 1 --2- 172.21.15.44:0/4115705522 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52400c9a40 0x7f52400cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f5244d53640 1 -- 172.21.15.44:0/4115705522 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52400c9a40 msgr2=0x7f52400cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f5244d53640 1 --2- 172.21.15.44:0/4115705522 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52400c9a40 0x7f52400cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f5244d53640 1 -- 172.21.15.44:0/4115705522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f524006a1b0 msgr2=0x7f52400c1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f5244d53640 1 --2- 172.21.15.44:0/4115705522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f524006a1b0 0x7f52400c1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f5244d53640 1 -- 172.21.15.44:0/4115705522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52340094d0 con 0x7f524015ad80 2023-11-04T01:40:46.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.248+0000 7f5244d53640 1 --2- 172.21.15.44:0/4115705522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f524015ad80 0x7f524014c290 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f523800c780 tx=0x7f523800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.249+0000 7f523cff9640 1 -- 172.21.15.44:0/4115705522 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238004b60 con 0x7f524015ad80 2023-11-04T01:40:46.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.249+0000 7f523cff9640 1 -- 172.21.15.44:0/4115705522 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523800ce90 con 0x7f524015ad80 2023-11-04T01:40:46.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.249+0000 7f523cff9640 1 -- 172.21.15.44:0/4115705522 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523800a850 con 0x7f524015ad80 2023-11-04T01:40:46.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.249+0000 7f52467b6640 1 -- 172.21.15.44:0/4115705522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52400ce5b0 con 0x7f524015ad80 2023-11-04T01:40:46.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.249+0000 7f52467b6640 1 -- 172.21.15.44:0/4115705522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52400c1f60 con 0x7f524015ad80 2023-11-04T01:40:46.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.250+0000 7f52467b6640 1 -- 172.21.15.44:0/4115705522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52400cead0 con 0x7f524015ad80 2023-11-04T01:40:46.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.250+0000 7f523cff9640 1 -- 172.21.15.44:0/4115705522 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f523800a9b0 con 0x7f524015ad80 2023-11-04T01:40:46.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.251+0000 7f523cff9640 1 --2- 172.21.15.44:0/4115705522 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f522c06ae70 0x7f522c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.251+0000 7f523cff9640 1 -- 172.21.15.44:0/4115705522 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7f5238089d90 con 0x7f524015ad80 2023-11-04T01:40:46.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.251+0000 7f523ffff640 1 --2- 172.21.15.44:0/4115705522 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f522c06ae70 0x7f522c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.251+0000 7f523ffff640 1 --2- 172.21.15.44:0/4115705522 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f522c06ae70 0x7f522c06d330 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5230006fd0 tx=0x7f5230008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.255+0000 7f523cff9640 1 -- 172.21.15.44:0/4115705522 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52400cead0 con 0x7f524015ad80 2023-11-04T01:40:46.469 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.467+0000 7f52467b6640 1 -- 172.21.15.44:0/4115705522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52400cead0 con 0x7f524015ad80 2023-11-04T01:40:46.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.468+0000 7f523cff9640 1 -- 172.21.15.44:0/4115705522 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f52400cead0 con 0x7f524015ad80 2023-11-04T01:40:46.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:46.470 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7797,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:43.430226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6820,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6820":{"gid":6820,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:46.470 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 67 2023-11-04T01:40:46.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.470+0000 7f52467b6640 1 -- 172.21.15.44:0/4115705522 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f522c06ae70 msgr2=0x7f522c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.470+0000 7f52467b6640 1 --2- 172.21.15.44:0/4115705522 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f522c06ae70 0x7f522c06d330 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5230006fd0 tx=0x7f5230008040 comp rx=0 tx=0).stop 2023-11-04T01:40:46.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.470+0000 7f52467b6640 1 -- 172.21.15.44:0/4115705522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f524015ad80 msgr2=0x7f524014c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.470+0000 7f52467b6640 1 --2- 172.21.15.44:0/4115705522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f524015ad80 0x7f524014c290 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f523800c780 tx=0x7f523800cc40 comp rx=0 tx=0).stop 2023-11-04T01:40:46.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.470+0000 7f52467b6640 1 -- 172.21.15.44:0/4115705522 shutdown_connections 2023-11-04T01:40:46.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.470+0000 7f52467b6640 1 --2- 172.21.15.44:0/4115705522 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f522c06ae70 0x7f522c06d330 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.470+0000 7f52467b6640 1 --2- 172.21.15.44:0/4115705522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f524015ad80 0x7f524014c290 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.470+0000 7f52467b6640 1 --2- 172.21.15.44:0/4115705522 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52400c9a40 0x7f52400cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.470+0000 7f52467b6640 1 --2- 172.21.15.44:0/4115705522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f524006a1b0 0x7f52400c1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.470+0000 7f52467b6640 1 -- 172.21.15.44:0/4115705522 >> 172.21.15.44:0/4115705522 conn(0x7f52400b0cd0 msgr2=0x7f52400ac560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.470+0000 7f52467b6640 1 -- 172.21.15.44:0/4115705522 shutdown_connections 2023-11-04T01:40:46.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.470+0000 7f52467b6640 1 -- 172.21.15.44:0/4115705522 wait complete. 2023-11-04T01:40:46.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:40:46.886 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:29.920595+0000', 'modified': '2023-11-04T01:40:43.430226+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 100, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6820, 'mds_1': 7344}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6820': {'gid': 6820, 'name': 'd', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.204:6836/3065829953', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6834', 'nonce': 3065829953}, {'type': 'v1', 'addr': '172.21.15.204:6836', 'nonce': 3065829953}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7344': {'gid': 7344, 'name': 'c', 'rank': 1, 'incarnation': 49, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.44:6834/2069525699', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 2069525699}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 2069525699}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:40:46.887 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:40:46.887 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:40:46.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.995+0000 7fa53ba58640 1 Processor -- start 2023-11-04T01:40:46.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.995+0000 7fa53ba58640 1 -- start start 2023-11-04T01:40:46.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.996+0000 7fa53ba58640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa534070ff0 0x7fa5340cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.996+0000 7fa53ba58640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5340c9bf0 con 0x7fa53415d1b0 2023-11-04T01:40:46.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.996+0000 7fa53ba58640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5340cd890 con 0x7fa534066000 2023-11-04T01:40:46.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.996+0000 7fa53ba58640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5340cdb30 con 0x7fa534070ff0 2023-11-04T01:40:46.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.996+0000 7fa5397f4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa534070ff0 0x7fa5340cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.996+0000 7fa538ff3640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa53415d1b0 0x7fa5340713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48806/0 (socket says 172.21.15.44:48806) 2023-11-04T01:40:46.998 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.996+0000 7fa538ff3640 1 -- 172.21.15.44:0/1998957010 learned_addr learned my addr 172.21.15.44:0/1998957010 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:46.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.996+0000 7fa5397f4640 1 -- 172.21.15.44:0/1998957010 >> v1:172.21.15.204:6789/0 conn(0x7fa534066000 legacy=0x7fa53406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:46.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.996+0000 7fa5397f4640 1 -- 172.21.15.44:0/1998957010 >> v1:172.21.15.44:6789/0 conn(0x7fa53415d1b0 legacy=0x7fa5340713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.996+0000 7fa5397f4640 1 -- 172.21.15.44:0/1998957010 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5340cde10 con 0x7fa534070ff0 2023-11-04T01:40:47.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.997+0000 7fa5397f4640 1 --2- 172.21.15.44:0/1998957010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa534070ff0 0x7fa5340cb4e0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fa5240097a0 tx=0x7fa52402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f5c358440223f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.997+0000 7fa52bfff640 1 -- 172.21.15.44:0/1998957010 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524031830 con 0x7fa534070ff0 2023-11-04T01:40:47.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.997+0000 7fa52bfff640 1 -- 172.21.15.44:0/1998957010 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa524031990 con 0x7fa534070ff0 2023-11-04T01:40:47.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.997+0000 7fa52bfff640 1 -- 172.21.15.44:0/1998957010 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524031d20 con 0x7fa534070ff0 2023-11-04T01:40:47.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.998+0000 7fa53ba58640 1 -- 172.21.15.44:0/1998957010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa534070ff0 msgr2=0x7fa5340cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.998+0000 7fa53ba58640 1 --2- 172.21.15.44:0/1998957010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa534070ff0 0x7fa5340cb4e0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fa5240097a0 tx=0x7fa52402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.998+0000 7fa53ba58640 1 -- 172.21.15.44:0/1998957010 shutdown_connections 2023-11-04T01:40:47.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.998+0000 7fa53ba58640 1 --2- 172.21.15.44:0/1998957010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa534070ff0 0x7fa5340cb4e0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.998+0000 7fa53ba58640 1 -- 172.21.15.44:0/1998957010 >> 172.21.15.44:0/1998957010 conn(0x7fa5340cbc90 msgr2=0x7fa5340cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.998+0000 7fa53ba58640 1 -- 172.21.15.44:0/1998957010 shutdown_connections 2023-11-04T01:40:47.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.998+0000 7fa53ba58640 1 -- 172.21.15.44:0/1998957010 wait complete. 2023-11-04T01:40:47.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.999+0000 7fa53ba58640 1 Processor -- start 2023-11-04T01:40:47.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:46.999+0000 7fa53ba58640 1 -- start start 2023-11-04T01:40:47.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa53ba58640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa534066000 0x7fa5340c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa53ba58640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa534070ff0 0x7fa5341516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa53ba58640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa53415d1b0 0x7fa5340c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa53ba58640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340c7880 con 0x7fa53415d1b0 2023-11-04T01:40:47.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa53ba58640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340c8250 con 0x7fa534070ff0 2023-11-04T01:40:47.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa53ba58640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa534151c10 con 0x7fa534066000 2023-11-04T01:40:47.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa539ff5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa53415d1b0 0x7fa5340c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa539ff5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa53415d1b0 0x7fa5340c6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48026/0 (socket says 172.21.15.44:48026) 2023-11-04T01:40:47.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa539ff5640 1 -- 172.21.15.44:0/131937796 learned_addr learned my addr 172.21.15.44:0/131937796 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:47.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa538ff3640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa534070ff0 0x7fa5341516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa5397f4640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa534066000 0x7fa5340c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa539ff5640 1 -- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa534066000 msgr2=0x7fa5340c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa539ff5640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa534066000 0x7fa5340c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa539ff5640 1 -- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa534070ff0 msgr2=0x7fa5341516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa539ff5640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa534070ff0 0x7fa5341516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa539ff5640 1 -- 172.21.15.44:0/131937796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa524009400 con 0x7fa53415d1b0 2023-11-04T01:40:47.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa538ff3640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa534070ff0 0x7fa5341516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:47.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa5397f4640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa534066000 0x7fa5340c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:47.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa539ff5640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa53415d1b0 0x7fa5340c6390 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00b9a0 tx=0x7fa52c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.000+0000 7fa529ffb640 1 -- 172.21.15.44:0/131937796 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c00cba0 con 0x7fa53415d1b0 2023-11-04T01:40:47.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.001+0000 7fa529ffb640 1 -- 172.21.15.44:0/131937796 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c00cd00 con 0x7fa53415d1b0 2023-11-04T01:40:47.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.001+0000 7fa53ba58640 1 -- 172.21.15.44:0/131937796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5340c6c70 con 0x7fa53415d1b0 2023-11-04T01:40:47.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.001+0000 7fa529ffb640 1 -- 172.21.15.44:0/131937796 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c014680 con 0x7fa53415d1b0 2023-11-04T01:40:47.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.001+0000 7fa53ba58640 1 -- 172.21.15.44:0/131937796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5340c7230 con 0x7fa53415d1b0 2023-11-04T01:40:47.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.002+0000 7fa529ffb640 1 -- 172.21.15.44:0/131937796 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa52c01d3b0 con 0x7fa53415d1b0 2023-11-04T01:40:47.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.003+0000 7fa529ffb640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa51806aea0 0x7fa51806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.003+0000 7fa529ffb640 1 -- 172.21.15.44:0/131937796 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7fa52c089a80 con 0x7fa53415d1b0 2023-11-04T01:40:47.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.003+0000 7fa5397f4640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa51806aea0 0x7fa51806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.004+0000 7fa53e5e1740 1 Processor -- start 2023-11-04T01:40:47.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.004+0000 7fa5397f4640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa51806aea0 0x7fa51806d360 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa524036000 tx=0x7fa524008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.004+0000 7fa53e5e1740 1 -- start start 2023-11-04T01:40:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.004+0000 7fa53e5e1740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954bdb850 0x564954bae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.004+0000 7fa53e5e1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdbc30 0x564954bde5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.004+0000 7fa53e5e1740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954baec90 0x564954bdeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.004+0000 7fa53e5e1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x564954abf740 con 0x564954bdbc30 2023-11-04T01:40:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.004+0000 7fa53e5e1740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x564954b218d0 con 0x564954bdb850 2023-11-04T01:40:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.004+0000 7fa53e5e1740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x564954b1efc0 con 0x564954baec90 2023-11-04T01:40:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.004+0000 7fa538ff3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdbc30 0x564954bde5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.004+0000 7fa538ff3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdbc30 0x564954bde5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48034/0 (socket says 172.21.15.44:48034) 2023-11-04T01:40:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.004+0000 7fa538ff3640 1 -- 172.21.15.44:0/3993095190 learned_addr learned my addr 172.21.15.44:0/3993095190 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.004+0000 7fa5397f4640 1 --2- 172.21.15.44:0/3993095190 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954bdb850 0x564954bae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.005+0000 7fa539ff5640 1 --2- 172.21.15.44:0/3993095190 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954baec90 0x564954bdeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.005+0000 7fa538ff3640 1 -- 172.21.15.44:0/3993095190 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954baec90 msgr2=0x564954bdeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.005+0000 7fa538ff3640 1 --2- 172.21.15.44:0/3993095190 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954baec90 0x564954bdeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.005+0000 7fa538ff3640 1 -- 172.21.15.44:0/3993095190 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954bdb850 msgr2=0x564954bae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.005+0000 7fa538ff3640 1 --2- 172.21.15.44:0/3993095190 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954bdb850 0x564954bae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.005+0000 7fa538ff3640 1 -- 172.21.15.44:0/3993095190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564954addca0 con 0x564954bdbc30 2023-11-04T01:40:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.005+0000 7fa539ff5640 1 --2- 172.21.15.44:0/3993095190 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954baec90 0x564954bdeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.005+0000 7fa538ff3640 1 --2- 172.21.15.44:0/3993095190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdbc30 0x564954bde5e0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fa5300015b0 tx=0x7fa530001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d857782bcbcaaf1f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.005+0000 7fa51effd640 1 -- 172.21.15.44:0/3993095190 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53000b070 con 0x564954bdbc30 2023-11-04T01:40:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.005+0000 7fa51effd640 1 -- 172.21.15.44:0/3993095190 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa530005ab0 con 0x564954bdbc30 2023-11-04T01:40:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.005+0000 7fa51effd640 1 -- 172.21.15.44:0/3993095190 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530005e40 con 0x564954bdbc30 2023-11-04T01:40:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.006+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3993095190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdbc30 msgr2=0x564954bde5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.006+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/3993095190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdbc30 0x564954bde5e0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fa5300015b0 tx=0x7fa530001a70 comp rx=0 tx=0).stop 2023-11-04T01:40:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.006+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3993095190 shutdown_connections 2023-11-04T01:40:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.006+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/3993095190 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954baec90 0x564954bdeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.006+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/3993095190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdbc30 0x564954bde5e0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.006+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/3993095190 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954bdb850 0x564954bae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.006+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3993095190 >> 172.21.15.44:0/3993095190 conn(0x564954bb0a60 msgr2=0x564954bf95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.006+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3993095190 shutdown_connections 2023-11-04T01:40:47.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.006+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3993095190 wait complete. 2023-11-04T01:40:47.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.006+0000 7fa53e5e1740 1 -- start start 2023-11-04T01:40:47.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.006+0000 7fa53e5e1740 1 Processor -- start 2023-11-04T01:40:47.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.007+0000 7fa53e5e1740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954bdb850 0x564954be1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.007+0000 7fa53e5e1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdbc30 0x564954bf3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.007+0000 7fa53e5e1740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954bc9560 0x564954bf4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.007+0000 7fa53e5e1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x564954b1a8b0 con 0x564954bdbc30 2023-11-04T01:40:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.007+0000 7fa53e5e1740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x564954ad4c80 con 0x564954bc9560 2023-11-04T01:40:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.007+0000 7fa53e5e1740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x564954ad4920 con 0x564954bdb850 2023-11-04T01:40:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.007+0000 7fa53e5e1740 10 client.0 _ll_register_callbacks cb 0x56495482cac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.007+0000 7fa538ff3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdbc30 0x564954bf3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.007+0000 7fa538ff3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdbc30 0x564954bf3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48040/0 (socket says 172.21.15.44:48040) 2023-11-04T01:40:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.007+0000 7fa538ff3640 1 -- 172.21.15.44:0/132618906 learned_addr learned my addr 172.21.15.44:0/132618906 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.008+0000 7fa5397f4640 1 --2- 172.21.15.44:0/132618906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954bdb850 0x564954be1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.008+0000 7fa539ff5640 1 --2- 172.21.15.44:0/132618906 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954bc9560 0x564954bf4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.008+0000 7fa538ff3640 1 -- 172.21.15.44:0/132618906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954bdb850 msgr2=0x564954be1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.008+0000 7fa538ff3640 1 --2- 172.21.15.44:0/132618906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954bdb850 0x564954be1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.008+0000 7fa538ff3640 1 -- 172.21.15.44:0/132618906 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954bc9560 msgr2=0x564954bf4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.008+0000 7fa538ff3640 1 --2- 172.21.15.44:0/132618906 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954bc9560 0x564954bf4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.008+0000 7fa538ff3640 1 -- 172.21.15.44:0/132618906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5340c9bf0 con 0x564954bdbc30 2023-11-04T01:40:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.008+0000 7fa538ff3640 1 --2- 172.21.15.44:0/132618906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdbc30 0x564954bf3c10 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fa530012000 tx=0x7fa530000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d34586eba64c9e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.008+0000 7fa513fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:40:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.008+0000 7fa513fff640 1 -- 172.21.15.44:0/132618906 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530007690 con 0x564954bdbc30 2023-11-04T01:40:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.008+0000 7fa53e5e1740 1 -- 172.21.15.44:0/132618906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564954ac6bf0 con 0x564954bdbc30 2023-11-04T01:40:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.008+0000 7fa513fff640 1 -- 172.21.15.44:0/132618906 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7fa53000d730 con 0x564954bdbc30 2023-11-04T01:40:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.008+0000 7fa513fff640 1 -- 172.21.15.44:0/132618906 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa53000d8f0 con 0x564954bdbc30 2023-11-04T01:40:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.008+0000 7fa53e5e1740 10 client.7833 fetch_fsmap learned FSMap version 67 2023-11-04T01:40:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.008+0000 7fa53e5e1740 1 -- 172.21.15.44:0/132618906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x564954b18f30 con 0x564954bdbc30 2023-11-04T01:40:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.009+0000 7fa513fff640 1 -- 172.21.15.44:0/132618906 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564954ac6bf0 con 0x564954bdbc30 2023-11-04T01:40:47.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.009+0000 7fa513fff640 1 -- 172.21.15.44:0/132618906 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 67) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa53000da50 con 0x564954bdbc30 2023-11-04T01:40:47.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.009+0000 7fa53e5e1740 10 client.7833 fetch_fsmap finished waiting for FSMap version 67 2023-11-04T01:40:47.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.009+0000 7fa53e5e1740 10 client.7833 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:40:47.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.009+0000 7fa53e5e1740 20 client.7833 populate_metadata read hostname 'smithi044' 2023-11-04T01:40:47.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.009+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/132618906 >> [v2:172.21.15.204:6834/3065829953,v1:172.21.15.204:6836/3065829953] conn(0x564954bcbae0 0x564954bcbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.009+0000 7fa53e5e1740 4 client.7833 mds_command: new command op to 6820 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:47.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.009+0000 7fa53e5e1740 1 -- 172.21.15.44:0/132618906 --> [v2:172.21.15.204:6834/3065829953,v1:172.21.15.204:6836/3065829953] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564954b13890 con 0x564954bcbae0 2023-11-04T01:40:47.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.009+0000 7fa5397f4640 1 --2- 172.21.15.44:0/132618906 >> [v2:172.21.15.204:6834/3065829953,v1:172.21.15.204:6836/3065829953] conn(0x564954bcbae0 0x564954bcbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.009+0000 7fa5397f4640 1 --2- 172.21.15.44:0/132618906 >> [v2:172.21.15.204:6834/3065829953,v1:172.21.15.204:6836/3065829953] conn(0x564954bcbae0 0x564954bcbec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4b0affa65237891 server_cookie=48887b2fce7e3b3a in_seq=0 out_seq=0 2023-11-04T01:40:47.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.009+0000 7fa513fff640 10 client.7833 ms_handle_connect on v2:172.21.15.204:6834/3065829953 2023-11-04T01:40:47.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.010+0000 7fa513fff640 1 -- 172.21.15.44:0/132618906 <== mds.0 v2:172.21.15.204:6834/3065829953 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564954b13890 con 0x564954bcbae0 2023-11-04T01:40:47.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.010+0000 7fa513fff640 10 client.7833 handle_command_reply: tid=0 2023-11-04T01:40:47.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.010+0000 7fa53e5e1740 1 client.7833 shutdown 2023-11-04T01:40:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.010+0000 7fa53e5e1740 1 -- 172.21.15.44:0/132618906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdbc30 msgr2=0x564954bf3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.010+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/132618906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdbc30 0x564954bf3c10 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fa530012000 tx=0x7fa530000ed0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.010+0000 7fa53e5e1740 1 -- 172.21.15.44:0/132618906 shutdown_connections 2023-11-04T01:40:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.010+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/132618906 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954bc9560 0x564954bf4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.010+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/132618906 >> [v2:172.21.15.204:6834/3065829953,v1:172.21.15.204:6836/3065829953] conn(0x564954bcbae0 0x564954bcbec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.010+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/132618906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdbc30 0x564954bf3c10 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.010+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/132618906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954bdb850 0x564954be1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.010+0000 7fa53e5e1740 1 -- 172.21.15.44:0/132618906 >> 172.21.15.44:0/132618906 conn(0x564954baec90 msgr2=0x564954bb26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.010+0000 7fa513fff640 0 client.7833 ms_handle_reset on v2:172.21.15.204:6834/3065829953 2023-11-04T01:40:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.010+0000 7fa53e5e1740 1 -- 172.21.15.44:0/132618906 shutdown_connections 2023-11-04T01:40:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.010+0000 7fa53e5e1740 1 -- 172.21.15.44:0/132618906 wait complete. 2023-11-04T01:40:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.011+0000 7fa53e5e1740 20 client.7833 trim_cache size 0 max 16384 2023-11-04T01:40:47.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.026+0000 7fa53e5e1740 1 Processor -- start 2023-11-04T01:40:47.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.026+0000 7fa53e5e1740 1 -- start start 2023-11-04T01:40:47.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa53e5e1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdb850 0x564954bb4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa53e5e1740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954bdbc30 0x564954bde020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa53e5e1740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954c1c330 0x564954bde560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa53e5e1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x564954a9a280 con 0x564954bdb850 2023-11-04T01:40:47.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa53e5e1740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x564954baf2a0 con 0x564954bdbc30 2023-11-04T01:40:47.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa53e5e1740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x564954bdb080 con 0x564954c1c330 2023-11-04T01:40:47.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa5397f4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdb850 0x564954bb4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa5397f4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdb850 0x564954bb4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48048/0 (socket says 172.21.15.44:48048) 2023-11-04T01:40:47.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa5397f4640 1 -- 172.21.15.44:0/3047829513 learned_addr learned my addr 172.21.15.44:0/3047829513 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:47.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa5397f4640 1 -- 172.21.15.44:0/3047829513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954c1c330 msgr2=0x564954bde560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa5397f4640 1 --2- 172.21.15.44:0/3047829513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954c1c330 0x564954bde560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa5397f4640 1 -- 172.21.15.44:0/3047829513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954bdbc30 msgr2=0x564954bde020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa5397f4640 1 --2- 172.21.15.44:0/3047829513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954bdbc30 0x564954bde020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa5397f4640 1 -- 172.21.15.44:0/3047829513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564954ab6d10 con 0x564954bdb850 2023-11-04T01:40:47.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa5397f4640 1 --2- 172.21.15.44:0/3047829513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdb850 0x564954bb4920 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa524009890 tx=0x7fa524030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26f65f05560f15d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa51f7fe640 1 -- 172.21.15.44:0/3047829513 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524047ea0 con 0x564954bdb850 2023-11-04T01:40:47.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa51f7fe640 1 -- 172.21.15.44:0/3047829513 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52404d040 con 0x564954bdb850 2023-11-04T01:40:47.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.027+0000 7fa51f7fe640 1 -- 172.21.15.44:0/3047829513 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52404c040 con 0x564954bdb850 2023-11-04T01:40:47.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.028+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3047829513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdb850 msgr2=0x564954bb4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.028+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/3047829513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdb850 0x564954bb4920 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa524009890 tx=0x7fa524030000 comp rx=0 tx=0).stop 2023-11-04T01:40:47.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.028+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3047829513 shutdown_connections 2023-11-04T01:40:47.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.028+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/3047829513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954c1c330 0x564954bde560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.028+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/3047829513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954bdbc30 0x564954bde020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.028+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/3047829513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdb850 0x564954bb4920 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.028+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3047829513 >> 172.21.15.44:0/3047829513 conn(0x564954baec90 msgr2=0x564954ba9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.028+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3047829513 shutdown_connections 2023-11-04T01:40:47.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.028+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3047829513 wait complete. 2023-11-04T01:40:47.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.029+0000 7fa53e5e1740 1 -- start start 2023-11-04T01:40:47.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.029+0000 7fa53e5e1740 1 Processor -- start 2023-11-04T01:40:47.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.029+0000 7fa53e5e1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdb850 0x564954bc82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa53e5e1740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954bdbc30 0x564954c63a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa53e5e1740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954c1c330 0x564954bb34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa53e5e1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x564954c0c390 con 0x564954bdb850 2023-11-04T01:40:47.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa53e5e1740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x564954bb4c50 con 0x564954c1c330 2023-11-04T01:40:47.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa53e5e1740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x564954bf3e10 con 0x564954bdbc30 2023-11-04T01:40:47.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa53e5e1740 10 client.0 _ll_register_callbacks cb 0x7fa530007eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:47.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa5397f4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdb850 0x564954bc82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa5397f4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdb850 0x564954bc82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48058/0 (socket says 172.21.15.44:48058) 2023-11-04T01:40:47.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa5397f4640 1 -- 172.21.15.44:0/3553410200 learned_addr learned my addr 172.21.15.44:0/3553410200 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:47.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa538ff3640 1 --2- 172.21.15.44:0/3553410200 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954bdbc30 0x564954c63a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa539ff5640 1 --2- 172.21.15.44:0/3553410200 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954c1c330 0x564954bb34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa5397f4640 1 -- 172.21.15.44:0/3553410200 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954bdbc30 msgr2=0x564954c63a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa5397f4640 1 --2- 172.21.15.44:0/3553410200 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954bdbc30 0x564954c63a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa5397f4640 1 -- 172.21.15.44:0/3553410200 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954c1c330 msgr2=0x564954bb34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa5397f4640 1 --2- 172.21.15.44:0/3553410200 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954c1c330 0x564954bb34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa5397f4640 1 -- 172.21.15.44:0/3553410200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5340cde10 con 0x564954bdb850 2023-11-04T01:40:47.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa539ff5640 1 --2- 172.21.15.44:0/3553410200 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954c1c330 0x564954bb34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:47.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa5397f4640 1 --2- 172.21.15.44:0/3553410200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdb850 0x564954bc82b0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fa5240467a0 tx=0x7fa524004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efaf59fa03beb842 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa513fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:40:47.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa513fff640 1 -- 172.21.15.44:0/3553410200 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52404c040 con 0x564954bdb850 2023-11-04T01:40:47.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa513fff640 1 -- 172.21.15.44:0/3553410200 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7fa5240541f0 con 0x564954bdb850 2023-11-04T01:40:47.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3553410200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa530005ab0 con 0x564954bdb850 2023-11-04T01:40:47.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa513fff640 1 -- 172.21.15.44:0/3553410200 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa52403f070 con 0x564954bdb850 2023-11-04T01:40:47.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa53e5e1740 10 client.7839 fetch_fsmap learned FSMap version 67 2023-11-04T01:40:47.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.030+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3553410200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x564954adc500 con 0x564954bdb850 2023-11-04T01:40:47.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.031+0000 7fa513fff640 1 -- 172.21.15.44:0/3553410200 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa530005ab0 con 0x564954bdb850 2023-11-04T01:40:47.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.031+0000 7fa513fff640 1 -- 172.21.15.44:0/3553410200 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 67) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa52405b030 con 0x564954bdb850 2023-11-04T01:40:47.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.031+0000 7fa53e5e1740 10 client.7839 fetch_fsmap finished waiting for FSMap version 67 2023-11-04T01:40:47.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.031+0000 7fa53e5e1740 10 client.7839 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:40:47.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.031+0000 7fa53e5e1740 20 client.7839 populate_metadata read hostname 'smithi044' 2023-11-04T01:40:47.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.031+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/3553410200 >> [v2:172.21.15.204:6834/3065829953,v1:172.21.15.204:6836/3065829953] conn(0x564954c12940 0x564954c12d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.031+0000 7fa53e5e1740 4 client.7839 mds_command: new command op to 6820 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:47.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.031+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3553410200 --> [v2:172.21.15.204:6834/3065829953,v1:172.21.15.204:6836/3065829953] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564954b135b0 con 0x564954c12940 2023-11-04T01:40:47.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.031+0000 7fa538ff3640 1 --2- 172.21.15.44:0/3553410200 >> [v2:172.21.15.204:6834/3065829953,v1:172.21.15.204:6836/3065829953] conn(0x564954c12940 0x564954c12d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.031+0000 7fa538ff3640 1 --2- 172.21.15.44:0/3553410200 >> [v2:172.21.15.204:6834/3065829953,v1:172.21.15.204:6836/3065829953] conn(0x564954c12940 0x564954c12d20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5178ed3e71f2b6 server_cookie=45a6a06b66426df8 in_seq=0 out_seq=0 2023-11-04T01:40:47.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.031+0000 7fa513fff640 10 client.7839 ms_handle_connect on v2:172.21.15.204:6834/3065829953 2023-11-04T01:40:47.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa513fff640 1 -- 172.21.15.44:0/3553410200 <== mds.0 v2:172.21.15.204:6834/3065829953 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x564954b135b0 con 0x564954c12940 2023-11-04T01:40:47.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa513fff640 10 client.7839 handle_command_reply: tid=0 2023-11-04T01:40:47.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa53e5e1740 1 client.7839 shutdown 2023-11-04T01:40:47.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3553410200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdb850 msgr2=0x564954bc82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/3553410200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdb850 0x564954bc82b0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fa5240467a0 tx=0x7fa524004730 comp rx=0 tx=0).stop 2023-11-04T01:40:47.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3553410200 shutdown_connections 2023-11-04T01:40:47.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/3553410200 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564954c1c330 0x564954bb34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/3553410200 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564954bdbc30 0x564954c63a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/3553410200 >> [v2:172.21.15.204:6834/3065829953,v1:172.21.15.204:6836/3065829953] conn(0x564954c12940 0x564954c12d20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa53e5e1740 1 --2- 172.21.15.44:0/3553410200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564954bdb850 0x564954bc82b0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3553410200 >> 172.21.15.44:0/3553410200 conn(0x564954baec90 msgr2=0x564954bde020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa513fff640 0 client.7839 ms_handle_reset on v2:172.21.15.204:6834/3065829953 2023-11-04T01:40:47.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3553410200 shutdown_connections 2023-11-04T01:40:47.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa53e5e1740 1 -- 172.21.15.44:0/3553410200 wait complete. 2023-11-04T01:40:47.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa53e5e1740 20 client.7839 trim_cache size 0 max 16384 2023-11-04T01:40:47.042 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:40:47.043 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:40:47.043 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2023-11-04T01:40:47.043 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6820, 2023-11-04T01:40:47.043 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:40:47.043 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:40:47.043 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:40:47.043 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 6.6171080800000004, 2023-11-04T01:40:47.043 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 67, 2023-11-04T01:40:47.043 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 100, 2023-11-04T01:40:47.043 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 100, 2023-11-04T01:40:47.043 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 31.900759392000001 2023-11-04T01:40:47.043 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:40:47.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.032+0000 7fa53ba58640 1 -- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa51806aea0 msgr2=0x7fa51806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.033+0000 7fa53ba58640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa51806aea0 0x7fa51806d360 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa524036000 tx=0x7fa524008030 comp rx=0 tx=0).stop 2023-11-04T01:40:47.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.033+0000 7fa53ba58640 1 -- 172.21.15.44:0/131937796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa53415d1b0 msgr2=0x7fa5340c6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.033+0000 7fa53ba58640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa53415d1b0 0x7fa5340c6390 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00b9a0 tx=0x7fa52c00be60 comp rx=0 tx=0).stop 2023-11-04T01:40:47.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.033+0000 7fa53ba58640 1 -- 172.21.15.44:0/131937796 shutdown_connections 2023-11-04T01:40:47.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.033+0000 7fa53ba58640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa51806aea0 0x7fa51806d360 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.033+0000 7fa53ba58640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa53415d1b0 0x7fa5340c6390 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.033+0000 7fa53ba58640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa534070ff0 0x7fa5341516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.033+0000 7fa53ba58640 1 --2- 172.21.15.44:0/131937796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa534066000 0x7fa5340c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.033+0000 7fa53ba58640 1 -- 172.21.15.44:0/131937796 >> 172.21.15.44:0/131937796 conn(0x7fa5340cbc90 msgr2=0x7fa534160830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.033+0000 7fa53ba58640 1 -- 172.21.15.44:0/131937796 shutdown_connections 2023-11-04T01:40:47.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.033+0000 7fa53ba58640 1 -- 172.21.15.44:0/131937796 wait complete. 2023-11-04T01:40:47.046 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:40:47.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.151+0000 7f8b5fc34640 1 Processor -- start 2023-11-04T01:40:47.153 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.151+0000 7f8b5fc34640 1 -- start start 2023-11-04T01:40:47.154 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.152+0000 7f8b5fc34640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8b5815e3f0 0x7f8b580b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.152+0000 7f8b5fc34640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8b580ca0a0 0x7f8b580cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.152+0000 7f8b5fc34640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b580caa20 con 0x7f8b580cc300 2023-11-04T01:40:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.152+0000 7f8b5fc34640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b580cb230 con 0x7f8b580ca0a0 2023-11-04T01:40:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.152+0000 7f8b5fc34640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b580ca530 con 0x7f8b5815e3f0 2023-11-04T01:40:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.152+0000 7f8b5d1cf640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8b580ca0a0 0x7f8b580cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.152+0000 7f8b5e1d1640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8b580cc300 0x7f8b580b1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48820/0 (socket says 172.21.15.44:48820) 2023-11-04T01:40:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.152+0000 7f8b5e1d1640 1 -- 172.21.15.44:0/976846602 learned_addr learned my addr 172.21.15.44:0/976846602 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.153+0000 7f8b5d9d0640 1 --2- 172.21.15.44:0/976846602 >> v2:172.21.15.204:3300/0 conn(0x7f8b5815e3f0 0x7f8b580b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.153+0000 7f8b5d1cf640 1 -- 172.21.15.44:0/976846602 >> v2:172.21.15.204:3300/0 conn(0x7f8b5815e3f0 msgr2=0x7f8b580b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.153+0000 7f8b5d1cf640 1 --2- 172.21.15.44:0/976846602 >> v2:172.21.15.204:3300/0 conn(0x7f8b5815e3f0 0x7f8b580b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.153+0000 7f8b5d1cf640 1 -- 172.21.15.44:0/976846602 >> v1:172.21.15.44:6789/0 conn(0x7f8b580cc300 legacy=0x7f8b580b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.153+0000 7f8b5c9ce640 1 -- 172.21.15.44:0/976846602 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938268319 0 0) 0x7f8b580caa20 con 0x7f8b580cc300 2023-11-04T01:40:47.156 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.153+0000 7f8b5d1cf640 1 -- 172.21.15.44:0/976846602 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b580cac70 con 0x7f8b580ca0a0 2023-11-04T01:40:47.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.153+0000 7f8b5d1cf640 1 --2- 172.21.15.44:0/976846602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b580ca0a0 0x7f8b580cc920 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8b580b5bc0 tx=0x7f8b4c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7273d9a25e0f949 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.154+0000 7f8b5c9ce640 1 -- 172.21.15.44:0/976846602 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c031830 con 0x7f8b580ca0a0 2023-11-04T01:40:47.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.154+0000 7f8b5c9ce640 1 -- 172.21.15.44:0/976846602 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4c031990 con 0x7f8b580ca0a0 2023-11-04T01:40:47.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.154+0000 7f8b5c9ce640 1 -- 172.21.15.44:0/976846602 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c031d20 con 0x7f8b580ca0a0 2023-11-04T01:40:47.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.154+0000 7f8b5fc34640 1 -- 172.21.15.44:0/976846602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b580ca0a0 msgr2=0x7f8b580cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.154+0000 7f8b5fc34640 1 --2- 172.21.15.44:0/976846602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b580ca0a0 0x7f8b580cc920 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8b580b5bc0 tx=0x7f8b4c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.154+0000 7f8b5fc34640 1 -- 172.21.15.44:0/976846602 shutdown_connections 2023-11-04T01:40:47.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.154+0000 7f8b5fc34640 1 --2- 172.21.15.44:0/976846602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b580ca0a0 0x7f8b580cc920 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.154+0000 7f8b5fc34640 1 --2- 172.21.15.44:0/976846602 >> v2:172.21.15.204:3300/0 conn(0x7f8b5815e3f0 0x7f8b580b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.154+0000 7f8b5fc34640 1 -- 172.21.15.44:0/976846602 >> 172.21.15.44:0/976846602 conn(0x7f8b58071820 msgr2=0x7f8b58071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.154+0000 7f8b5fc34640 1 -- 172.21.15.44:0/976846602 shutdown_connections 2023-11-04T01:40:47.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.154+0000 7f8b5fc34640 1 -- 172.21.15.44:0/976846602 wait complete. 2023-11-04T01:40:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.155+0000 7f8b5fc34640 1 Processor -- start 2023-11-04T01:40:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.155+0000 7f8b5fc34640 1 -- start start 2023-11-04T01:40:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.156+0000 7f8b5fc34640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b580cc300 0x7f8b580c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.156+0000 7f8b5fc34640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b5815e3f0 0x7f8b580ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.156+0000 7f8b5fc34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b580acf60 0x7f8b580c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.156+0000 7f8b5fc34640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b580ada90 con 0x7f8b580acf60 2023-11-04T01:40:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.156+0000 7f8b5fc34640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b580ad4d0 con 0x7f8b5815e3f0 2023-11-04T01:40:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.156+0000 7f8b5fc34640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b580ad7b0 con 0x7f8b580cc300 2023-11-04T01:40:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.156+0000 7f8b5e1d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b580acf60 0x7f8b580c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.156+0000 7f8b5e1d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b580acf60 0x7f8b580c7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48078/0 (socket says 172.21.15.44:48078) 2023-11-04T01:40:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.156+0000 7f8b5e1d1640 1 -- 172.21.15.44:0/3686218260 learned_addr learned my addr 172.21.15.44:0/3686218260 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.156+0000 7f8b5d1cf640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b5815e3f0 0x7f8b580ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.156+0000 7f8b5d9d0640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b580cc300 0x7f8b580c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.156+0000 7f8b5e1d1640 1 -- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b580cc300 msgr2=0x7f8b580c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.157+0000 7f8b5e1d1640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b580cc300 0x7f8b580c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.157+0000 7f8b5e1d1640 1 -- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b5815e3f0 msgr2=0x7f8b580ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.157+0000 7f8b5e1d1640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b5815e3f0 0x7f8b580ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.157+0000 7f8b5e1d1640 1 -- 172.21.15.44:0/3686218260 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c009400 con 0x7f8b580acf60 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.157+0000 7f8b5d1cf640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b5815e3f0 0x7f8b580ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.157+0000 7f8b5d9d0640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b580cc300 0x7f8b580c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.157+0000 7f8b5e1d1640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b580acf60 0x7f8b580c7490 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800c7e0 tx=0x7f8b4800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.157+0000 7f8b567fc640 1 -- 172.21.15.44:0/3686218260 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4800a640 con 0x7f8b580acf60 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.157+0000 7f8b567fc640 1 -- 172.21.15.44:0/3686218260 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4800a7c0 con 0x7f8b580acf60 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.157+0000 7f8b567fc640 1 -- 172.21.15.44:0/3686218260 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4800ab70 con 0x7f8b580acf60 2023-11-04T01:40:47.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.157+0000 7f8b5fc34640 1 -- 172.21.15.44:0/3686218260 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b580aba10 con 0x7f8b580acf60 2023-11-04T01:40:47.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.157+0000 7f8b5fc34640 1 -- 172.21.15.44:0/3686218260 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b580c9910 con 0x7f8b580acf60 2023-11-04T01:40:47.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.159+0000 7f8b567fc640 1 -- 172.21.15.44:0/3686218260 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b4800acd0 con 0x7f8b580acf60 2023-11-04T01:40:47.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.159+0000 7f8b567fc640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b4406aea0 0x7f8b4406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.159+0000 7f8b567fc640 1 -- 172.21.15.44:0/3686218260 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7f8b48089050 con 0x7f8b580acf60 2023-11-04T01:40:47.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.159+0000 7f8b5d9d0640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b4406aea0 0x7f8b4406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.160+0000 7f8b5d9d0640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b4406aea0 0x7f8b4406d360 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8b50006fd0 tx=0x7f8b50008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.160+0000 7f8b627c8740 1 Processor -- start 2023-11-04T01:40:47.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.160+0000 7f8b627c8740 1 -- start start 2023-11-04T01:40:47.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b627c8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35850 0x55d8f5d08750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b627c8740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d35c30 0x55d8f5d385e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b627c8740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d08c90 0x55d8f5d38b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b627c8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f5c19740 con 0x55d8f5d35850 2023-11-04T01:40:47.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b627c8740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f5c7b8d0 con 0x55d8f5d35c30 2023-11-04T01:40:47.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b627c8740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8f5c78fc0 con 0x55d8f5d08c90 2023-11-04T01:40:47.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b5d9d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35850 0x55d8f5d08750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b5d9d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35850 0x55d8f5d08750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48092/0 (socket says 172.21.15.44:48092) 2023-11-04T01:40:47.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b5d9d0640 1 -- 172.21.15.44:0/3043801006 learned_addr learned my addr 172.21.15.44:0/3043801006 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:47.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b5e1d1640 1 --2- 172.21.15.44:0/3043801006 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d08c90 0x55d8f5d38b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b5d1cf640 1 --2- 172.21.15.44:0/3043801006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d35c30 0x55d8f5d385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b5d9d0640 1 -- 172.21.15.44:0/3043801006 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d08c90 msgr2=0x55d8f5d38b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b5d9d0640 1 --2- 172.21.15.44:0/3043801006 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d08c90 0x55d8f5d38b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b5d9d0640 1 -- 172.21.15.44:0/3043801006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d35c30 msgr2=0x55d8f5d385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b5d9d0640 1 --2- 172.21.15.44:0/3043801006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d35c30 0x55d8f5d385e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b5d9d0640 1 -- 172.21.15.44:0/3043801006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8f5c37ca0 con 0x55d8f5d35850 2023-11-04T01:40:47.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.161+0000 7f8b5d9d0640 1 --2- 172.21.15.44:0/3043801006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35850 0x55d8f5d08750 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f8b50004380 tx=0x7f8b50011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a262feb198f52791 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.162+0000 7f8b3f7fe640 1 -- 172.21.15.44:0/3043801006 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5001d070 con 0x55d8f5d35850 2023-11-04T01:40:47.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.162+0000 7f8b3f7fe640 1 -- 172.21.15.44:0/3043801006 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b500043b0 con 0x55d8f5d35850 2023-11-04T01:40:47.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.162+0000 7f8b3f7fe640 1 -- 172.21.15.44:0/3043801006 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50004520 con 0x55d8f5d35850 2023-11-04T01:40:47.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.162+0000 7f8b627c8740 1 -- 172.21.15.44:0/3043801006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35850 msgr2=0x55d8f5d08750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.162+0000 7f8b627c8740 1 --2- 172.21.15.44:0/3043801006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35850 0x55d8f5d08750 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f8b50004380 tx=0x7f8b50011000 comp rx=0 tx=0).stop 2023-11-04T01:40:47.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.162+0000 7f8b627c8740 1 -- 172.21.15.44:0/3043801006 shutdown_connections 2023-11-04T01:40:47.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.162+0000 7f8b627c8740 1 --2- 172.21.15.44:0/3043801006 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d08c90 0x55d8f5d38b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.162+0000 7f8b627c8740 1 --2- 172.21.15.44:0/3043801006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d35c30 0x55d8f5d385e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.162+0000 7f8b627c8740 1 --2- 172.21.15.44:0/3043801006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35850 0x55d8f5d08750 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.162+0000 7f8b627c8740 1 -- 172.21.15.44:0/3043801006 >> 172.21.15.44:0/3043801006 conn(0x55d8f5d0aa60 msgr2=0x55d8f5d535e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.162+0000 7f8b627c8740 1 -- 172.21.15.44:0/3043801006 shutdown_connections 2023-11-04T01:40:47.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.162+0000 7f8b627c8740 1 -- 172.21.15.44:0/3043801006 wait complete. 2023-11-04T01:40:47.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.163+0000 7f8b627c8740 1 -- start start 2023-11-04T01:40:47.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.163+0000 7f8b627c8740 1 Processor -- start 2023-11-04T01:40:47.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b627c8740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d35850 0x55d8f5d535f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b627c8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35c30 0x55d8f5d50f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b627c8740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d514c0 0x55d8f5d4d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b627c8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f5c748b0 con 0x55d8f5d35c30 2023-11-04T01:40:47.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b627c8740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f5c2ec80 con 0x55d8f5d35850 2023-11-04T01:40:47.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b627c8740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8f5c2e920 con 0x55d8f5d514c0 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b627c8740 10 client.0 _ll_register_callbacks cb 0x55d8f5986ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b5d1cf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35c30 0x55d8f5d50f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b5d1cf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35c30 0x55d8f5d50f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48106/0 (socket says 172.21.15.44:48106) 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b5d1cf640 1 -- 172.21.15.44:0/3273919841 learned_addr learned my addr 172.21.15.44:0/3273919841 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b5d1cf640 1 -- 172.21.15.44:0/3273919841 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d514c0 msgr2=0x55d8f5d4d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b5d1cf640 1 --2- 172.21.15.44:0/3273919841 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d514c0 0x55d8f5d4d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b5d1cf640 1 -- 172.21.15.44:0/3273919841 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d35850 msgr2=0x55d8f5d535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b5d1cf640 1 --2- 172.21.15.44:0/3273919841 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d35850 0x55d8f5d535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b5d1cf640 1 -- 172.21.15.44:0/3273919841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b50004030 con 0x55d8f5d35c30 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b5d1cf640 1 --2- 172.21.15.44:0/3273919841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35c30 0x55d8f5d50f80 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c02bee0 tx=0x7f8b4c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb0d0c365f2dfc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.164+0000 7f8b3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.165+0000 7f8b3cff9640 1 -- 172.21.15.44:0/3273919841 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c048070 con 0x55d8f5d35c30 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.165+0000 7f8b3cff9640 1 -- 172.21.15.44:0/3273919841 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7f8b4c03a6f0 con 0x55d8f5d35c30 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.165+0000 7f8b627c8740 1 -- 172.21.15.44:0/3273919841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8f5c20bf0 con 0x55d8f5d35c30 2023-11-04T01:40:47.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.165+0000 7f8b3cff9640 1 -- 172.21.15.44:0/3273919841 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b4c03a8b0 con 0x55d8f5d35c30 2023-11-04T01:40:47.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.165+0000 7f8b627c8740 10 client.7854 fetch_fsmap learned FSMap version 67 2023-11-04T01:40:47.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.165+0000 7f8b627c8740 1 -- 172.21.15.44:0/3273919841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55d8f5c72f30 con 0x55d8f5d35c30 2023-11-04T01:40:47.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.165+0000 7f8b3cff9640 1 -- 172.21.15.44:0/3273919841 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8f5c20bf0 con 0x55d8f5d35c30 2023-11-04T01:40:47.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.165+0000 7f8b3cff9640 1 -- 172.21.15.44:0/3273919841 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 67) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f8b4c04b020 con 0x55d8f5d35c30 2023-11-04T01:40:47.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.165+0000 7f8b627c8740 10 client.7854 fetch_fsmap finished waiting for FSMap version 67 2023-11-04T01:40:47.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.165+0000 7f8b627c8740 10 client.7854 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:40:47.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.165+0000 7f8b627c8740 20 client.7854 populate_metadata read hostname 'smithi044' 2023-11-04T01:40:47.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.165+0000 7f8b627c8740 1 --2- 172.21.15.44:0/3273919841 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x55d8f5d25c20 0x55d8f5d26000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.165+0000 7f8b627c8740 4 client.7854 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:47.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.165+0000 7f8b627c8740 1 -- 172.21.15.44:0/3273919841 --> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8f5c6d890 con 0x55d8f5d25c20 2023-11-04T01:40:47.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.165+0000 7f8b5d9d0640 1 --2- 172.21.15.44:0/3273919841 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x55d8f5d25c20 0x55d8f5d26000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b5d9d0640 1 --2- 172.21.15.44:0/3273919841 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x55d8f5d25c20 0x55d8f5d26000 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=877d9dae72023677 server_cookie=cf152a5330ca19e5 in_seq=0 out_seq=0 2023-11-04T01:40:47.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b3cff9640 10 client.7854 ms_handle_connect on v2:172.21.15.44:6832/2069525699 2023-11-04T01:40:47.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b3cff9640 1 -- 172.21.15.44:0/3273919841 <== mds.1 v2:172.21.15.44:6832/2069525699 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d8f5c6d890 con 0x55d8f5d25c20 2023-11-04T01:40:47.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b3cff9640 10 client.7854 handle_command_reply: tid=0 2023-11-04T01:40:47.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b627c8740 1 client.7854 shutdown 2023-11-04T01:40:47.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b627c8740 1 -- 172.21.15.44:0/3273919841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35c30 msgr2=0x55d8f5d50f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b627c8740 1 --2- 172.21.15.44:0/3273919841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35c30 0x55d8f5d50f80 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c02bee0 tx=0x7f8b4c02e000 comp rx=0 tx=0).stop 2023-11-04T01:40:47.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b627c8740 1 -- 172.21.15.44:0/3273919841 shutdown_connections 2023-11-04T01:40:47.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b627c8740 1 --2- 172.21.15.44:0/3273919841 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x55d8f5d25c20 0x55d8f5d26000 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b627c8740 1 --2- 172.21.15.44:0/3273919841 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d514c0 0x55d8f5d4d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b627c8740 1 --2- 172.21.15.44:0/3273919841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35c30 0x55d8f5d50f80 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b3cff9640 0 client.7854 ms_handle_reset on v2:172.21.15.44:6832/2069525699 2023-11-04T01:40:47.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b627c8740 1 --2- 172.21.15.44:0/3273919841 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d35850 0x55d8f5d535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b627c8740 1 -- 172.21.15.44:0/3273919841 >> 172.21.15.44:0/3273919841 conn(0x55d8f5d08c90 msgr2=0x55d8f5d074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b627c8740 1 -- 172.21.15.44:0/3273919841 shutdown_connections 2023-11-04T01:40:47.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.166+0000 7f8b627c8740 1 -- 172.21.15.44:0/3273919841 wait complete. 2023-11-04T01:40:47.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.167+0000 7f8b627c8740 20 client.7854 trim_cache size 0 max 16384 2023-11-04T01:40:47.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.182+0000 7f8b627c8740 1 Processor -- start 2023-11-04T01:40:47.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.182+0000 7f8b627c8740 1 -- start start 2023-11-04T01:40:47.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b627c8740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d35850 0x55d8f5d25270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b627c8740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d35c30 0x55d8f5d22ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b627c8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d514c0 0x55d8f5d23020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b627c8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f5bf4280 con 0x55d8f5d514c0 2023-11-04T01:40:47.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b627c8740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f5d3c530 con 0x55d8f5d35850 2023-11-04T01:40:47.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b627c8740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8f5d0ef50 con 0x55d8f5d35c30 2023-11-04T01:40:47.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b5e1d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d514c0 0x55d8f5d23020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b5e1d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d514c0 0x55d8f5d23020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48114/0 (socket says 172.21.15.44:48114) 2023-11-04T01:40:47.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b5e1d1640 1 -- 172.21.15.44:0/2598094011 learned_addr learned my addr 172.21.15.44:0/2598094011 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:47.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b5d9d0640 1 --2- 172.21.15.44:0/2598094011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d35850 0x55d8f5d25270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b5e1d1640 1 -- 172.21.15.44:0/2598094011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d35c30 msgr2=0x55d8f5d22ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b5d1cf640 1 --2- 172.21.15.44:0/2598094011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d35c30 0x55d8f5d22ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b5e1d1640 1 --2- 172.21.15.44:0/2598094011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d35c30 0x55d8f5d22ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b5e1d1640 1 -- 172.21.15.44:0/2598094011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d35850 msgr2=0x55d8f5d25270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b5e1d1640 1 --2- 172.21.15.44:0/2598094011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d35850 0x55d8f5d25270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b5e1d1640 1 -- 172.21.15.44:0/2598094011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8f5c10d10 con 0x55d8f5d514c0 2023-11-04T01:40:47.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.183+0000 7f8b5d9d0640 1 --2- 172.21.15.44:0/2598094011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d35850 0x55d8f5d25270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:47.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.184+0000 7f8b5e1d1640 1 --2- 172.21.15.44:0/2598094011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d514c0 0x55d8f5d23020 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800a430 tx=0x7f8b48009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92712aa73d8c6cad server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.184+0000 7f8b3ffff640 1 -- 172.21.15.44:0/2598094011 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4805fb00 con 0x55d8f5d514c0 2023-11-04T01:40:47.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.184+0000 7f8b3ffff640 1 -- 172.21.15.44:0/2598094011 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b48055ba0 con 0x55d8f5d514c0 2023-11-04T01:40:47.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.184+0000 7f8b3ffff640 1 -- 172.21.15.44:0/2598094011 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4805f670 con 0x55d8f5d514c0 2023-11-04T01:40:47.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.184+0000 7f8b627c8740 1 -- 172.21.15.44:0/2598094011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d514c0 msgr2=0x55d8f5d23020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.184+0000 7f8b627c8740 1 --2- 172.21.15.44:0/2598094011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d514c0 0x55d8f5d23020 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800a430 tx=0x7f8b48009040 comp rx=0 tx=0).stop 2023-11-04T01:40:47.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.184+0000 7f8b627c8740 1 -- 172.21.15.44:0/2598094011 shutdown_connections 2023-11-04T01:40:47.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.184+0000 7f8b627c8740 1 --2- 172.21.15.44:0/2598094011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d514c0 0x55d8f5d23020 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.184+0000 7f8b627c8740 1 --2- 172.21.15.44:0/2598094011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d35c30 0x55d8f5d22ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.184+0000 7f8b627c8740 1 --2- 172.21.15.44:0/2598094011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d35850 0x55d8f5d25270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.184+0000 7f8b627c8740 1 -- 172.21.15.44:0/2598094011 >> 172.21.15.44:0/2598094011 conn(0x55d8f5d08c90 msgr2=0x55d8f5d03c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.184+0000 7f8b627c8740 1 -- 172.21.15.44:0/2598094011 shutdown_connections 2023-11-04T01:40:47.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.184+0000 7f8b627c8740 1 -- 172.21.15.44:0/2598094011 wait complete. 2023-11-04T01:40:47.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.185+0000 7f8b627c8740 1 -- start start 2023-11-04T01:40:47.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.185+0000 7f8b627c8740 1 Processor -- start 2023-11-04T01:40:47.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b627c8740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d35850 0x55d8f5d25400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b627c8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35c30 0x55d8f5d518a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b627c8740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d514c0 0x55d8f5d51de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b627c8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f5d725d0 con 0x55d8f5d35c30 2023-11-04T01:40:47.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b627c8740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f5dbf8e0 con 0x55d8f5d514c0 2023-11-04T01:40:47.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b627c8740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8f5d219a0 con 0x55d8f5d35850 2023-11-04T01:40:47.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b627c8740 10 client.0 _ll_register_callbacks cb 0x7f8b50009200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:47.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b5d1cf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35c30 0x55d8f5d518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b5d1cf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35c30 0x55d8f5d518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48130/0 (socket says 172.21.15.44:48130) 2023-11-04T01:40:47.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b5d1cf640 1 -- 172.21.15.44:0/4263622511 learned_addr learned my addr 172.21.15.44:0/4263622511 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:47.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b5d1cf640 1 -- 172.21.15.44:0/4263622511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d35850 msgr2=0x55d8f5d25400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b5d1cf640 1 --2- 172.21.15.44:0/4263622511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d35850 0x55d8f5d25400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b5d1cf640 1 -- 172.21.15.44:0/4263622511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d514c0 msgr2=0x55d8f5d51de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b5d1cf640 1 --2- 172.21.15.44:0/4263622511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d514c0 0x55d8f5d51de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b5d1cf640 1 -- 172.21.15.44:0/4263622511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b580c9910 con 0x55d8f5d35c30 2023-11-04T01:40:47.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b5d1cf640 1 --2- 172.21.15.44:0/4263622511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35c30 0x55d8f5d518a0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c02bee0 tx=0x7f8b4c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a667e4ff468ace server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:40:47.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.186+0000 7f8b3cff9640 1 -- 172.21.15.44:0/4263622511 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c05a070 con 0x55d8f5d35c30 2023-11-04T01:40:47.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b3cff9640 1 -- 172.21.15.44:0/4263622511 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7f8b4c000e40 con 0x55d8f5d35c30 2023-11-04T01:40:47.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b627c8740 1 -- 172.21.15.44:0/4263622511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b500043b0 con 0x55d8f5d35c30 2023-11-04T01:40:47.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b3cff9640 1 -- 172.21.15.44:0/4263622511 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b4c048070 con 0x55d8f5d35c30 2023-11-04T01:40:47.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b627c8740 10 client.7860 fetch_fsmap learned FSMap version 67 2023-11-04T01:40:47.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b627c8740 1 -- 172.21.15.44:0/4263622511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55d8f5c36500 con 0x55d8f5d35c30 2023-11-04T01:40:47.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b3cff9640 1 -- 172.21.15.44:0/4263622511 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b500043b0 con 0x55d8f5d35c30 2023-11-04T01:40:47.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b3cff9640 1 -- 172.21.15.44:0/4263622511 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 67) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f8b4c05d020 con 0x55d8f5d35c30 2023-11-04T01:40:47.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b627c8740 10 client.7860 fetch_fsmap finished waiting for FSMap version 67 2023-11-04T01:40:47.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b627c8740 10 client.7860 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:40:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b627c8740 20 client.7860 populate_metadata read hostname 'smithi044' 2023-11-04T01:40:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b627c8740 1 --2- 172.21.15.44:0/4263622511 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x55d8f5d0dc10 0x55d8f5dbe530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b627c8740 4 client.7860 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b627c8740 1 -- 172.21.15.44:0/4263622511 --> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d8f5c6d5b0 con 0x55d8f5d0dc10 2023-11-04T01:40:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b5d9d0640 1 --2- 172.21.15.44:0/4263622511 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x55d8f5d0dc10 0x55d8f5dbe530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b3cff9640 10 client.7860 ms_handle_connect on v2:172.21.15.44:6832/2069525699 2023-11-04T01:40:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.187+0000 7f8b5d9d0640 1 --2- 172.21.15.44:0/4263622511 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x55d8f5d0dc10 0x55d8f5dbe530 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=200ce6b55dc9f37e server_cookie=a4ce8623d259a700 in_seq=0 out_seq=0 2023-11-04T01:40:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b3cff9640 1 -- 172.21.15.44:0/4263622511 <== mds.1 v2:172.21.15.44:6832/2069525699 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55d8f5c6d5b0 con 0x55d8f5d0dc10 2023-11-04T01:40:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b3cff9640 10 client.7860 handle_command_reply: tid=0 2023-11-04T01:40:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b627c8740 1 client.7860 shutdown 2023-11-04T01:40:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b627c8740 1 -- 172.21.15.44:0/4263622511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35c30 msgr2=0x55d8f5d518a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b627c8740 1 --2- 172.21.15.44:0/4263622511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35c30 0x55d8f5d518a0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c02bee0 tx=0x7f8b4c004730 comp rx=0 tx=0).stop 2023-11-04T01:40:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b627c8740 1 -- 172.21.15.44:0/4263622511 shutdown_connections 2023-11-04T01:40:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b627c8740 1 --2- 172.21.15.44:0/4263622511 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x55d8f5d0dc10 0x55d8f5dbe530 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b627c8740 1 --2- 172.21.15.44:0/4263622511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d8f5d514c0 0x55d8f5d51de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b3cff9640 0 client.7860 ms_handle_reset on v2:172.21.15.44:6832/2069525699 2023-11-04T01:40:47.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b627c8740 1 --2- 172.21.15.44:0/4263622511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8f5d35c30 0x55d8f5d518a0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b627c8740 1 --2- 172.21.15.44:0/4263622511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d8f5d35850 0x55d8f5d25400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b627c8740 1 -- 172.21.15.44:0/4263622511 >> 172.21.15.44:0/4263622511 conn(0x55d8f5d08c90 msgr2=0x55d8f5d3ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b627c8740 1 -- 172.21.15.44:0/4263622511 shutdown_connections 2023-11-04T01:40:47.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b627c8740 1 -- 172.21.15.44:0/4263622511 wait complete. 2023-11-04T01:40:47.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b627c8740 20 client.7860 trim_cache size 0 max 16384 2023-11-04T01:40:47.196 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:40:47.196 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:40:47.197 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 1, 2023-11-04T01:40:47.197 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7344, 2023-11-04T01:40:47.197 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:40:47.197 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:40:47.197 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:40:47.197 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 66.822541874999999, 2023-11-04T01:40:47.197 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 67, 2023-11-04T01:40:47.197 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 100, 2023-11-04T01:40:47.197 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 100, 2023-11-04T01:40:47.197 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 82.681881449000002 2023-11-04T01:40:47.197 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:40:47.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b5fc34640 1 -- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b4406aea0 msgr2=0x7f8b4406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b5fc34640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b4406aea0 0x7f8b4406d360 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8b50006fd0 tx=0x7f8b50008040 comp rx=0 tx=0).stop 2023-11-04T01:40:47.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b5fc34640 1 -- 172.21.15.44:0/3686218260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b580acf60 msgr2=0x7f8b580c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b5fc34640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b580acf60 0x7f8b580c7490 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800c7e0 tx=0x7f8b4800cca0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b5fc34640 1 -- 172.21.15.44:0/3686218260 shutdown_connections 2023-11-04T01:40:47.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b5fc34640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b4406aea0 0x7f8b4406d360 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b5fc34640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b580acf60 0x7f8b580c7490 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b5fc34640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b5815e3f0 0x7f8b580ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b5fc34640 1 --2- 172.21.15.44:0/3686218260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b580cc300 0x7f8b580c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.188+0000 7f8b5fc34640 1 -- 172.21.15.44:0/3686218260 >> 172.21.15.44:0/3686218260 conn(0x7f8b58071820 msgr2=0x7f8b580cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.189+0000 7f8b5fc34640 1 -- 172.21.15.44:0/3686218260 shutdown_connections 2023-11-04T01:40:47.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.189+0000 7f8b5fc34640 1 -- 172.21.15.44:0/3686218260 wait complete. 2023-11-04T01:40:47.203 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:47.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.307+0000 7fc7e91a9640 1 Processor -- start 2023-11-04T01:40:47.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.307+0000 7fc7e91a9640 1 -- start start 2023-11-04T01:40:47.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e91a9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc7e4160b10 0x7fc7e4160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e91a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7e40cf160 0x7fc7e40cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e91a9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e406bf00 con 0x7fc7e415ce60 2023-11-04T01:40:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e91a9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e40cbde0 con 0x7fc7e4160b10 2023-11-04T01:40:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e91a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e40cfb30 con 0x7fc7e40cf160 2023-11-04T01:40:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e2d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc7e415ce60 0x7fc7e406b7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48824/0 (socket says 172.21.15.44:48824) 2023-11-04T01:40:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e2d9d640 1 -- 172.21.15.44:0/1765936316 learned_addr learned my addr 172.21.15.44:0/1765936316 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e1d9b640 1 -- 172.21.15.44:0/1765936316 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376563556 0 0) 0x7fc7e406bf00 con 0x7fc7e415ce60 2023-11-04T01:40:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e1d9b640 1 -- 172.21.15.44:0/1765936316 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7cc003520 con 0x7fc7e415ce60 2023-11-04T01:40:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e359e640 1 --2- 172.21.15.44:0/1765936316 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7e40cf160 0x7fc7e40cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e259c640 1 --2- 172.21.15.44:0/1765936316 >> v2:172.21.15.204:3300/0 conn(0x7fc7e4160b10 0x7fc7e4160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e1d9b640 1 -- 172.21.15.44:0/1765936316 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2239132947 0 0) 0x7fc7cc003520 con 0x7fc7e415ce60 2023-11-04T01:40:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e1d9b640 1 -- 172.21.15.44:0/1765936316 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7e40cf160 msgr2=0x7fc7e40cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e1d9b640 1 --2- 172.21.15.44:0/1765936316 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7e40cf160 0x7fc7e40cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e1d9b640 1 -- 172.21.15.44:0/1765936316 >> v2:172.21.15.204:3300/0 conn(0x7fc7e4160b10 msgr2=0x7fc7e4160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e1d9b640 1 --2- 172.21.15.44:0/1765936316 >> v2:172.21.15.204:3300/0 conn(0x7fc7e4160b10 0x7fc7e4160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e1d9b640 1 -- 172.21.15.44:0/1765936316 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e41615d0 con 0x7fc7e415ce60 2023-11-04T01:40:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.308+0000 7fc7e1d9b640 1 -- 172.21.15.44:0/1765936316 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fc7d40019f0 con 0x7fc7e415ce60 2023-11-04T01:40:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.309+0000 7fc7e1d9b640 1 -- 172.21.15.44:0/1765936316 >> v1:172.21.15.44:6789/0 conn(0x7fc7e415ce60 legacy=0x7fc7e406b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.309+0000 7fc7e1d9b640 1 --2- 172.21.15.44:0/1765936316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc003970 0x7fc7cc003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.309+0000 7fc7e1d9b640 1 --2- 172.21.15.44:0/1765936316 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc004320 0x7fc7cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.309+0000 7fc7e1d9b640 1 --2- 172.21.15.44:0/1765936316 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7e40cf160 0x7fc7cc004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.309+0000 7fc7e1d9b640 1 -- 172.21.15.44:0/1765936316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e40cbde0 con 0x7fc7cc003970 2023-11-04T01:40:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.309+0000 7fc7e1d9b640 1 -- 172.21.15.44:0/1765936316 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e40cfb30 con 0x7fc7cc004320 2023-11-04T01:40:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.309+0000 7fc7e1d9b640 1 -- 172.21.15.44:0/1765936316 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc00b980 con 0x7fc7e40cf160 2023-11-04T01:40:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.309+0000 7fc7e2d9d640 1 --2- 172.21.15.44:0/1765936316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc003970 0x7fc7cc003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.309+0000 7fc7e259c640 1 --2- 172.21.15.44:0/1765936316 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc004320 0x7fc7cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.309+0000 7fc7e359e640 1 --2- 172.21.15.44:0/1765936316 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7e40cf160 0x7fc7cc004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.309+0000 7fc7e2d9d640 1 -- 172.21.15.44:0/1765936316 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7e40cf160 msgr2=0x7fc7cc004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.309+0000 7fc7e2d9d640 1 --2- 172.21.15.44:0/1765936316 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7e40cf160 0x7fc7cc004ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.309+0000 7fc7e2d9d640 1 -- 172.21.15.44:0/1765936316 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc004320 msgr2=0x7fc7cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.309+0000 7fc7e2d9d640 1 --2- 172.21.15.44:0/1765936316 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc004320 0x7fc7cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.309+0000 7fc7e2d9d640 1 -- 172.21.15.44:0/1765936316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc003520 con 0x7fc7cc003970 2023-11-04T01:40:47.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.310+0000 7fc7e2d9d640 1 --2- 172.21.15.44:0/1765936316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc003970 0x7fc7cc003d50 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4005af0 tx=0x7fc7cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e512704eaa5f3f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.310+0000 7fc7e1d9b640 1 -- 172.21.15.44:0/1765936316 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d402d830 con 0x7fc7cc003970 2023-11-04T01:40:47.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.310+0000 7fc7e1d9b640 1 -- 172.21.15.44:0/1765936316 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d402d990 con 0x7fc7cc003970 2023-11-04T01:40:47.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.310+0000 7fc7e1d9b640 1 -- 172.21.15.44:0/1765936316 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d402dd40 con 0x7fc7cc003970 2023-11-04T01:40:47.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.310+0000 7fc7e91a9640 1 -- 172.21.15.44:0/1765936316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc003970 msgr2=0x7fc7cc003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.310+0000 7fc7e91a9640 1 --2- 172.21.15.44:0/1765936316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc003970 0x7fc7cc003d50 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4005af0 tx=0x7fc7cc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.310+0000 7fc7e359e640 1 -- 172.21.15.44:0/1765936316 reap_dead start 2023-11-04T01:40:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.310+0000 7fc7e91a9640 1 -- 172.21.15.44:0/1765936316 shutdown_connections 2023-11-04T01:40:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.310+0000 7fc7e91a9640 1 -- 172.21.15.44:0/1765936316 >> 172.21.15.44:0/1765936316 conn(0x7fc7e406ea90 msgr2=0x7fc7e406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.310+0000 7fc7e91a9640 1 -- 172.21.15.44:0/1765936316 shutdown_connections 2023-11-04T01:40:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.311+0000 7fc7e91a9640 1 -- 172.21.15.44:0/1765936316 wait complete. 2023-11-04T01:40:47.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.312+0000 7fc7e91a9640 1 Processor -- start 2023-11-04T01:40:47.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.312+0000 7fc7e91a9640 1 -- start start 2023-11-04T01:40:47.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.313+0000 7fc7e91a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc003970 0x7fc7e415af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.313+0000 7fc7e91a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e40c93f0 0x7fc7e415e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.313+0000 7fc7e91a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7e415e990 0x7fc7e415f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.313+0000 7fc7e91a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e415eea0 con 0x7fc7e40c93f0 2023-11-04T01:40:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.313+0000 7fc7e91a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e40b49b0 con 0x7fc7cc003970 2023-11-04T01:40:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.313+0000 7fc7e91a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e40b4c90 con 0x7fc7e415e990 2023-11-04T01:40:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.313+0000 7fc7e259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e40c93f0 0x7fc7e415e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.313+0000 7fc7e259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e40c93f0 0x7fc7e415e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48154/0 (socket says 172.21.15.44:48154) 2023-11-04T01:40:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.313+0000 7fc7e259c640 1 -- 172.21.15.44:0/3780159740 learned_addr learned my addr 172.21.15.44:0/3780159740 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.313+0000 7fc7e259c640 1 -- 172.21.15.44:0/3780159740 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7e415e990 msgr2=0x7fc7e415f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.313+0000 7fc7e259c640 1 --2- 172.21.15.44:0/3780159740 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7e415e990 0x7fc7e415f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.313+0000 7fc7e259c640 1 -- 172.21.15.44:0/3780159740 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc003970 msgr2=0x7fc7e415af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.313+0000 7fc7e259c640 1 --2- 172.21.15.44:0/3780159740 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc003970 0x7fc7e415af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.313+0000 7fc7e259c640 1 -- 172.21.15.44:0/3780159740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e40b4f70 con 0x7fc7e40c93f0 2023-11-04T01:40:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.313+0000 7fc7e259c640 1 --2- 172.21.15.44:0/3780159740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e40c93f0 0x7fc7e415e450 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8011960 tx=0x7fc7d8011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.314+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/3780159740 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8004240 con 0x7fc7e40c93f0 2023-11-04T01:40:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.314+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/3780159740 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d80043a0 con 0x7fc7e40c93f0 2023-11-04T01:40:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.314+0000 7fc7e91a9640 1 -- 172.21.15.44:0/3780159740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e40b5250 con 0x7fc7e40c93f0 2023-11-04T01:40:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.314+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/3780159740 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d800fa20 con 0x7fc7e40c93f0 2023-11-04T01:40:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.314+0000 7fc7e91a9640 1 -- 172.21.15.44:0/3780159740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e415b470 con 0x7fc7e40c93f0 2023-11-04T01:40:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.315+0000 7fc7e91a9640 1 -- 172.21.15.44:0/3780159740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e4074290 con 0x7fc7e40c93f0 2023-11-04T01:40:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.315+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/3780159740 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7d800fb80 con 0x7fc7e40c93f0 2023-11-04T01:40:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.316+0000 7fc7cb7fe640 1 --2- 172.21.15.44:0/3780159740 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7d006ae70 0x7fc7d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.316+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/3780159740 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7fc7d808a120 con 0x7fc7e40c93f0 2023-11-04T01:40:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.316+0000 7fc7e2d9d640 1 --2- 172.21.15.44:0/3780159740 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7d006ae70 0x7fc7d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.316+0000 7fc7e2d9d640 1 --2- 172.21.15.44:0/3780159740 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7d006ae70 0x7fc7d006d330 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4005ac0 tx=0x7fc7d402f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.320+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/3780159740 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7d8054c10 con 0x7fc7e40c93f0 2023-11-04T01:40:47.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.533+0000 7fc7e91a9640 1 -- 172.21.15.44:0/3780159740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7e406b3e0 con 0x7fc7e40c93f0 2023-11-04T01:40:47.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.534+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/3780159740 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fc7d8058230 con 0x7fc7e40c93f0 2023-11-04T01:40:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:47.536 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7797,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:43.430226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6820,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6820":{"gid":6820,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:47.536 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 67 2023-11-04T01:40:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.535+0000 7fc7e91a9640 1 -- 172.21.15.44:0/3780159740 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7d006ae70 msgr2=0x7fc7d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.535+0000 7fc7e91a9640 1 --2- 172.21.15.44:0/3780159740 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7d006ae70 0x7fc7d006d330 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4005ac0 tx=0x7fc7d402f000 comp rx=0 tx=0).stop 2023-11-04T01:40:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.535+0000 7fc7e91a9640 1 -- 172.21.15.44:0/3780159740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e40c93f0 msgr2=0x7fc7e415e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.535+0000 7fc7e91a9640 1 --2- 172.21.15.44:0/3780159740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e40c93f0 0x7fc7e415e450 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8011960 tx=0x7fc7d8011e20 comp rx=0 tx=0).stop 2023-11-04T01:40:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.535+0000 7fc7e91a9640 1 -- 172.21.15.44:0/3780159740 shutdown_connections 2023-11-04T01:40:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.535+0000 7fc7e91a9640 1 --2- 172.21.15.44:0/3780159740 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7d006ae70 0x7fc7d006d330 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.535+0000 7fc7e91a9640 1 --2- 172.21.15.44:0/3780159740 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7e415e990 0x7fc7e415f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.535+0000 7fc7e91a9640 1 --2- 172.21.15.44:0/3780159740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e40c93f0 0x7fc7e415e450 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.535+0000 7fc7e91a9640 1 --2- 172.21.15.44:0/3780159740 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc003970 0x7fc7e415af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.536+0000 7fc7e91a9640 1 -- 172.21.15.44:0/3780159740 >> 172.21.15.44:0/3780159740 conn(0x7fc7e406ea90 msgr2=0x7fc7e40c6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.536+0000 7fc7e91a9640 1 -- 172.21.15.44:0/3780159740 shutdown_connections 2023-11-04T01:40:47.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.536+0000 7fc7e91a9640 1 -- 172.21.15.44:0/3780159740 wait complete. 2023-11-04T01:40:47.548 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:40:47.672 INFO:teuthology.orchestra.run.smithi204.stdout:{"last_snap":3,"last_created":3,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:39:52.563500+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:40:23.215578+0000","name":"s12","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:40:47.672 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 3, "last_destroyed": 1, "last_snap": 3, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:39:52.563500+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:40:23.215578+0000" } ] } 2023-11-04T01:40:47.672 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:40:47.673 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=5 2023-11-04T01:40:47.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:47.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.776+0000 7f08436c2640 1 Processor -- start 2023-11-04T01:40:47.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.776+0000 7f08436c2640 1 -- start start 2023-11-04T01:40:47.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.777+0000 7f08436c2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f083c0ce240 0x7f083c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.777+0000 7f08436c2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083c15e000 con 0x7f083c157540 2023-11-04T01:40:47.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.777+0000 7f08436c2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083c15e2e0 con 0x7f083c0cde60 2023-11-04T01:40:47.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.777+0000 7f08436c2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083c15e5c0 con 0x7f083c0ce240 2023-11-04T01:40:47.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.777+0000 7f0841c5f640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f083c157540 0x7f083c0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48832/0 (socket says 172.21.15.44:48832) 2023-11-04T01:40:47.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.777+0000 7f0841c5f640 1 -- 172.21.15.44:0/1638646768 learned_addr learned my addr 172.21.15.44:0/1638646768 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:47.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.778+0000 7f0840c5d640 1 --2- 172.21.15.44:0/1638646768 >> v2:172.21.15.204:3300/0 conn(0x7f083c0ce240 0x7f083c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.778+0000 7f083bfff640 1 -- 172.21.15.44:0/1638646768 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399973909 0 0) 0x7f083c15e000 con 0x7f083c157540 2023-11-04T01:40:47.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.778+0000 7f083bfff640 1 -- 172.21.15.44:0/1638646768 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0824003520 con 0x7f083c157540 2023-11-04T01:40:47.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.778+0000 7f0840c5d640 1 -- 172.21.15.44:0/1638646768 >> v1:172.21.15.204:6789/0 conn(0x7f083c0cde60 legacy=0x7f083c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.778+0000 7f083bfff640 1 -- 172.21.15.44:0/1638646768 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118797146 0 0) 0x7f083c15e2e0 con 0x7f083c0cde60 2023-11-04T01:40:47.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.778+0000 7f0840c5d640 1 -- 172.21.15.44:0/1638646768 >> v1:172.21.15.44:6789/0 conn(0x7f083c157540 legacy=0x7f083c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.778+0000 7f0840c5d640 1 -- 172.21.15.44:0/1638646768 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c0d1120 con 0x7f083c0ce240 2023-11-04T01:40:47.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.779+0000 7f0840c5d640 1 --2- 172.21.15.44:0/1638646768 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f083c0ce240 0x7f083c157000 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f08300097a0 tx=0x7f083002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=babe1005bd26807a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.779+0000 7f083bfff640 1 -- 172.21.15.44:0/1638646768 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830030610 con 0x7f083c0ce240 2023-11-04T01:40:47.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.779+0000 7f083bfff640 1 -- 172.21.15.44:0/1638646768 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0830030770 con 0x7f083c0ce240 2023-11-04T01:40:47.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.779+0000 7f083bfff640 1 -- 172.21.15.44:0/1638646768 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830030b00 con 0x7f083c0ce240 2023-11-04T01:40:47.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.779+0000 7f08436c2640 1 -- 172.21.15.44:0/1638646768 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f083c0ce240 msgr2=0x7f083c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.779+0000 7f08436c2640 1 --2- 172.21.15.44:0/1638646768 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f083c0ce240 0x7f083c157000 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f08300097a0 tx=0x7f083002b960 comp rx=0 tx=0).stop 2023-11-04T01:40:47.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.779+0000 7f08436c2640 1 -- 172.21.15.44:0/1638646768 shutdown_connections 2023-11-04T01:40:47.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.779+0000 7f08436c2640 1 --2- 172.21.15.44:0/1638646768 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f083c0ce240 0x7f083c157000 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.779+0000 7f08436c2640 1 -- 172.21.15.44:0/1638646768 >> 172.21.15.44:0/1638646768 conn(0x7f083c071f30 msgr2=0x7f083c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.780+0000 7f08436c2640 1 -- 172.21.15.44:0/1638646768 shutdown_connections 2023-11-04T01:40:47.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.780+0000 7f08436c2640 1 -- 172.21.15.44:0/1638646768 wait complete. 2023-11-04T01:40:47.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.781+0000 7f08436c2640 1 Processor -- start 2023-11-04T01:40:47.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.781+0000 7f08436c2640 1 -- start start 2023-11-04T01:40:47.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.781+0000 7f08436c2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f083c0cde60 0x7f083c0cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.781+0000 7f08436c2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f083c0ce240 0x7f083c0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.781+0000 7f08436c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f083c157540 0x7f083c1f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.781+0000 7f08436c2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c0b4610 con 0x7f083c157540 2023-11-04T01:40:47.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.781+0000 7f08436c2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c1f35e0 con 0x7f083c0cde60 2023-11-04T01:40:47.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.781+0000 7f08436c2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083c0cc9b0 con 0x7f083c0ce240 2023-11-04T01:40:47.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f0841c5f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f083c157540 0x7f083c1f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f0841c5f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f083c157540 0x7f083c1f30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48168/0 (socket says 172.21.15.44:48168) 2023-11-04T01:40:47.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f084145e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f083c0cde60 0x7f083c0cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f0841c5f640 1 -- 172.21.15.44:0/3408656169 learned_addr learned my addr 172.21.15.44:0/3408656169 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:47.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f0840c5d640 1 --2- 172.21.15.44:0/3408656169 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f083c0ce240 0x7f083c0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f0841c5f640 1 -- 172.21.15.44:0/3408656169 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f083c0ce240 msgr2=0x7f083c0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f0841c5f640 1 --2- 172.21.15.44:0/3408656169 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f083c0ce240 0x7f083c0b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f0841c5f640 1 -- 172.21.15.44:0/3408656169 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f083c0cde60 msgr2=0x7f083c0cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f0841c5f640 1 --2- 172.21.15.44:0/3408656169 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f083c0cde60 0x7f083c0cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f0841c5f640 1 -- 172.21.15.44:0/3408656169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0830009400 con 0x7f083c157540 2023-11-04T01:40:47.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f084145e640 1 --2- 172.21.15.44:0/3408656169 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f083c0cde60 0x7f083c0cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:47.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f0841c5f640 1 --2- 172.21.15.44:0/3408656169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f083c157540 0x7f083c1f30a0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f083400c390 tx=0x7f083400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f0839ffb640 1 -- 172.21.15.44:0/3408656169 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0834005ce0 con 0x7f083c157540 2023-11-04T01:40:47.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f0839ffb640 1 -- 172.21.15.44:0/3408656169 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0834005e40 con 0x7f083c157540 2023-11-04T01:40:47.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f08436c2640 1 -- 172.21.15.44:0/3408656169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083c0cc110 con 0x7f083c157540 2023-11-04T01:40:47.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.782+0000 7f0839ffb640 1 -- 172.21.15.44:0/3408656169 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0834007310 con 0x7f083c157540 2023-11-04T01:40:47.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.783+0000 7f08436c2640 1 -- 172.21.15.44:0/3408656169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083c0cc6d0 con 0x7f083c157540 2023-11-04T01:40:47.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.784+0000 7f08436c2640 1 -- 172.21.15.44:0/3408656169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f083c0d0950 con 0x7f083c157540 2023-11-04T01:40:47.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.784+0000 7f0839ffb640 1 -- 172.21.15.44:0/3408656169 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0834007470 con 0x7f083c157540 2023-11-04T01:40:47.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.784+0000 7f0839ffb640 1 --2- 172.21.15.44:0/3408656169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f082806ae70 0x7f082806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.785+0000 7f0839ffb640 1 -- 172.21.15.44:0/3408656169 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7f08340891e0 con 0x7f083c157540 2023-11-04T01:40:47.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.785+0000 7f084145e640 1 --2- 172.21.15.44:0/3408656169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f082806ae70 0x7f082806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.785+0000 7f084145e640 1 --2- 172.21.15.44:0/3408656169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f082806ae70 0x7f082806d330 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f082c0012e0 tx=0x7f082c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:47.789+0000 7f0839ffb640 1 -- 172.21.15.44:0/3408656169 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0834053ce0 con 0x7f083c157540 2023-11-04T01:40:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.001+0000 7f08436c2640 1 -- 172.21.15.44:0/3408656169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f083c074290 con 0x7f083c157540 2023-11-04T01:40:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.001+0000 7f0839ffb640 1 -- 172.21.15.44:0/3408656169 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f0834057300 con 0x7f083c157540 2023-11-04T01:40:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:48.004 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7797,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:43.430226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6820,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6820":{"gid":6820,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:48.004 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 67 2023-11-04T01:40:48.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.003+0000 7f08436c2640 1 -- 172.21.15.44:0/3408656169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f082806ae70 msgr2=0x7f082806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.003+0000 7f08436c2640 1 --2- 172.21.15.44:0/3408656169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f082806ae70 0x7f082806d330 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f082c0012e0 tx=0x7f082c009040 comp rx=0 tx=0).stop 2023-11-04T01:40:48.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.003+0000 7f08436c2640 1 -- 172.21.15.44:0/3408656169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f083c157540 msgr2=0x7f083c1f30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.003+0000 7f08436c2640 1 --2- 172.21.15.44:0/3408656169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f083c157540 0x7f083c1f30a0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f083400c390 tx=0x7f083400c850 comp rx=0 tx=0).stop 2023-11-04T01:40:48.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.003+0000 7f08436c2640 1 -- 172.21.15.44:0/3408656169 shutdown_connections 2023-11-04T01:40:48.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.003+0000 7f08436c2640 1 --2- 172.21.15.44:0/3408656169 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f082806ae70 0x7f082806d330 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.003+0000 7f08436c2640 1 --2- 172.21.15.44:0/3408656169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f083c157540 0x7f083c1f30a0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.003+0000 7f08436c2640 1 --2- 172.21.15.44:0/3408656169 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f083c0ce240 0x7f083c0b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.003+0000 7f08436c2640 1 --2- 172.21.15.44:0/3408656169 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f083c0cde60 0x7f083c0cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.003+0000 7f08436c2640 1 -- 172.21.15.44:0/3408656169 >> 172.21.15.44:0/3408656169 conn(0x7f083c071f30 msgr2=0x7f083c0cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:48.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.003+0000 7f08436c2640 1 -- 172.21.15.44:0/3408656169 shutdown_connections 2023-11-04T01:40:48.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.003+0000 7f08436c2640 1 -- 172.21.15.44:0/3408656169 wait complete. 2023-11-04T01:40:48.016 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:40:48.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.121+0000 7f783c516640 1 Processor -- start 2023-11-04T01:40:48.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.121+0000 7f783c516640 1 -- start start 2023-11-04T01:40:48.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.122+0000 7f783c516640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7834153e60 0x7f783415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.122+0000 7f783c516640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f78340cd6d0 0x7f7834161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.122+0000 7f783c516640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78340cde60 con 0x7f78340b4880 2023-11-04T01:40:48.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.122+0000 7f783c516640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7834160f90 con 0x7f78340cd6d0 2023-11-04T01:40:48.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.122+0000 7f783c516640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783415e400 con 0x7f7834153e60 2023-11-04T01:40:48.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.123+0000 7f783a2b2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7834153e60 0x7f783415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.123+0000 7f7839ab1640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f78340cd6d0 0x7f7834161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.123+0000 7f783aab3640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f78340b4880 0x7f783406b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:47866/0 (socket says 172.21.15.44:47866) 2023-11-04T01:40:48.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.123+0000 7f783a2b2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7834153e60 0x7f783415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:58428/0 (socket says 172.21.15.44:58428) 2023-11-04T01:40:48.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.123+0000 7f783aab3640 1 -- 172.21.15.44:0/245664736 learned_addr learned my addr 172.21.15.44:0/245664736 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:48.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.123+0000 7f7839ab1640 1 -- 172.21.15.44:0/245664736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7834153e60 msgr2=0x7f783415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:48.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.123+0000 7f7839ab1640 1 --2- 172.21.15.44:0/245664736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7834153e60 0x7f783415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.123+0000 7f7839ab1640 1 -- 172.21.15.44:0/245664736 >> v1:172.21.15.204:6789/0 conn(0x7f78340b4880 legacy=0x7f783406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.123+0000 7f7839ab1640 1 -- 172.21.15.44:0/245664736 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7834161960 con 0x7f78340cd6d0 2023-11-04T01:40:48.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.123+0000 7f78392b0640 1 -- 172.21.15.44:0/245664736 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359754717 0 0) 0x7f78340cde60 con 0x7f78340b4880 2023-11-04T01:40:48.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.124+0000 7f7839ab1640 1 --2- 172.21.15.44:0/245664736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78340cd6d0 0x7f7834161420 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f78240097a0 tx=0x7f782402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48c4f2f8d144b692 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.124+0000 7f78392b0640 1 -- 172.21.15.44:0/245664736 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824031830 con 0x7f78340cd6d0 2023-11-04T01:40:48.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.124+0000 7f78392b0640 1 -- 172.21.15.44:0/245664736 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7824031990 con 0x7f78340cd6d0 2023-11-04T01:40:48.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.124+0000 7f78392b0640 1 -- 172.21.15.44:0/245664736 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824031d20 con 0x7f78340cd6d0 2023-11-04T01:40:48.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.125+0000 7f783c516640 1 -- 172.21.15.44:0/245664736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78340cd6d0 msgr2=0x7f7834161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.125+0000 7f783c516640 1 --2- 172.21.15.44:0/245664736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78340cd6d0 0x7f7834161420 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f78240097a0 tx=0x7f782402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.125+0000 7f783c516640 1 -- 172.21.15.44:0/245664736 shutdown_connections 2023-11-04T01:40:48.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.125+0000 7f783c516640 1 --2- 172.21.15.44:0/245664736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78340cd6d0 0x7f7834161420 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.125+0000 7f783c516640 1 --2- 172.21.15.44:0/245664736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7834153e60 0x7f783415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.125+0000 7f783c516640 1 -- 172.21.15.44:0/245664736 >> 172.21.15.44:0/245664736 conn(0x7f78340cf880 msgr2=0x7f78340cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:48.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.125+0000 7f783c516640 1 -- 172.21.15.44:0/245664736 shutdown_connections 2023-11-04T01:40:48.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.125+0000 7f783c516640 1 -- 172.21.15.44:0/245664736 wait complete. 2023-11-04T01:40:48.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.126+0000 7f783c516640 1 Processor -- start 2023-11-04T01:40:48.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.126+0000 7f783c516640 1 -- start start 2023-11-04T01:40:48.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783c516640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78340b4880 0x7f78341f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783c516640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78340cd6d0 0x7f7834154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783c516640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7834153e60 0x7f7834158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783c516640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78341f2870 con 0x7f7834153e60 2023-11-04T01:40:48.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783c516640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78340c6ca0 con 0x7f78340cd6d0 2023-11-04T01:40:48.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783c516640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7834154780 con 0x7f78340b4880 2023-11-04T01:40:48.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783aab3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7834153e60 0x7f7834158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783aab3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7834153e60 0x7f7834158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48176/0 (socket says 172.21.15.44:48176) 2023-11-04T01:40:48.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783aab3640 1 -- 172.21.15.44:0/899287271 learned_addr learned my addr 172.21.15.44:0/899287271 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:48.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783a2b2640 1 --2- 172.21.15.44:0/899287271 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78340b4880 0x7f78341f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f7839ab1640 1 --2- 172.21.15.44:0/899287271 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78340cd6d0 0x7f7834154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783aab3640 1 -- 172.21.15.44:0/899287271 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78340b4880 msgr2=0x7f78341f2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783aab3640 1 --2- 172.21.15.44:0/899287271 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78340b4880 0x7f78341f2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783aab3640 1 -- 172.21.15.44:0/899287271 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78340cd6d0 msgr2=0x7f7834154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783aab3640 1 --2- 172.21.15.44:0/899287271 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78340cd6d0 0x7f7834154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783aab3640 1 -- 172.21.15.44:0/899287271 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7824009400 con 0x7f7834153e60 2023-11-04T01:40:48.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783aab3640 1 --2- 172.21.15.44:0/899287271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7834153e60 0x7f7834158580 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f782c00c810 tx=0x7f782c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f782affd640 1 -- 172.21.15.44:0/899287271 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c00a640 con 0x7f7834153e60 2023-11-04T01:40:48.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f782affd640 1 -- 172.21.15.44:0/899287271 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782c00a7c0 con 0x7f7834153e60 2023-11-04T01:40:48.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f783c516640 1 -- 172.21.15.44:0/899287271 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78340c7ad0 con 0x7f7834153e60 2023-11-04T01:40:48.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.127+0000 7f782affd640 1 -- 172.21.15.44:0/899287271 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c00ab70 con 0x7f7834153e60 2023-11-04T01:40:48.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.128+0000 7f783c516640 1 -- 172.21.15.44:0/899287271 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78340c8090 con 0x7f7834153e60 2023-11-04T01:40:48.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.129+0000 7f783c516640 1 -- 172.21.15.44:0/899287271 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7834074290 con 0x7f7834153e60 2023-11-04T01:40:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.129+0000 7f782affd640 1 -- 172.21.15.44:0/899287271 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f782c00acd0 con 0x7f7834153e60 2023-11-04T01:40:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.129+0000 7f782affd640 1 --2- 172.21.15.44:0/899287271 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f781806ae70 0x7f781806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.129+0000 7f782affd640 1 -- 172.21.15.44:0/899287271 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7f782c0893b0 con 0x7f7834153e60 2023-11-04T01:40:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.130+0000 7f783a2b2640 1 --2- 172.21.15.44:0/899287271 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f781806ae70 0x7f781806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.130+0000 7f783a2b2640 1 --2- 172.21.15.44:0/899287271 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f781806ae70 0x7f781806d330 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7830009aa0 tx=0x7f7830009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.134+0000 7f782affd640 1 -- 172.21.15.44:0/899287271 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f782c053f50 con 0x7f7834153e60 2023-11-04T01:40:48.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.377+0000 7f783c516640 1 -- 172.21.15.44:0/899287271 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f7834157580 con 0x7f7834153e60 2023-11-04T01:40:48.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.455+0000 7f782affd640 1 -- 172.21.15.44:0/899287271 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.6820 v68) v1 ==== 112+0+0 (secure 0 0 0) 0x7f782c057570 con 0x7f7834153e60 2023-11-04T01:40:48.457 INFO:teuthology.orchestra.run.smithi044.stderr:freezing mds.6820 2023-11-04T01:40:48.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.457+0000 7f783c516640 1 -- 172.21.15.44:0/899287271 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f781806ae70 msgr2=0x7f781806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.457+0000 7f783c516640 1 --2- 172.21.15.44:0/899287271 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f781806ae70 0x7f781806d330 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7830009aa0 tx=0x7f7830009190 comp rx=0 tx=0).stop 2023-11-04T01:40:48.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.457+0000 7f783c516640 1 -- 172.21.15.44:0/899287271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7834153e60 msgr2=0x7f7834158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.457+0000 7f783c516640 1 --2- 172.21.15.44:0/899287271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7834153e60 0x7f7834158580 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f782c00c810 tx=0x7f782c00ccd0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.458+0000 7f783c516640 1 -- 172.21.15.44:0/899287271 shutdown_connections 2023-11-04T01:40:48.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.458+0000 7f783c516640 1 --2- 172.21.15.44:0/899287271 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f781806ae70 0x7f781806d330 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.458+0000 7f783c516640 1 --2- 172.21.15.44:0/899287271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7834153e60 0x7f7834158580 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.458+0000 7f783c516640 1 --2- 172.21.15.44:0/899287271 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78340cd6d0 0x7f7834154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.458+0000 7f783c516640 1 --2- 172.21.15.44:0/899287271 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78340b4880 0x7f78341f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.458+0000 7f783c516640 1 -- 172.21.15.44:0/899287271 >> 172.21.15.44:0/899287271 conn(0x7f78340cf880 msgr2=0x7f783415e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:48.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.458+0000 7f783c516640 1 -- 172.21.15.44:0/899287271 shutdown_connections 2023-11-04T01:40:48.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.458+0000 7f783c516640 1 -- 172.21.15.44:0/899287271 wait complete. 2023-11-04T01:40:48.470 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json config set mds_kill_mdstable_at 5 2023-11-04T01:40:48.589 INFO:teuthology.orchestra.run.smithi204.stdout:{"success":"mds_kill_mdstable_at = '5' (not observed, change may require restart) "} 2023-11-04T01:40:48.590 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '5' (not observed, change may require restart) " } 2023-11-04T01:40:48.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:48.590 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s15) 2023-11-04T01:40:48.594 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:40:48.612 INFO:tasks.ceph.mds.d.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f55bbc21640 time 2023-11-04T01:40:48.611909+0000 2023-11-04T01:40:48.612 INFO:tasks.ceph.mds.d.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:40:48.613 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:48.614 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f55c176efaf] 2023-11-04T01:40:48.614 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f55c176f16d] 2023-11-04T01:40:48.614 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a929032187] 2023-11-04T01:40:48.614 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a928dc10a9] 2023-11-04T01:40:48.614 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a928dc3b2b] 2023-11-04T01:40:48.614 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a928dc401c] 2023-11-04T01:40:48.614 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a928dad325] 2023-11-04T01:40:48.614 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f55c195ff9a] 2023-11-04T01:40:48.614 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f55c19f1741] 2023-11-04T01:40:48.614 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f55c0e9f802] 2023-11-04T01:40:48.614 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f55c0e3f450] 2023-11-04T01:40:48.614 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:40:48.611+0000 7f55bbc21640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f55bbc21640 time 2023-11-04T01:40:48.611909+0000 2023-11-04T01:40:48.615 INFO:tasks.ceph.mds.d.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:40:48.615 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:40:48.615 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:48.615 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f55c176efaf] 2023-11-04T01:40:48.615 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f55c176f16d] 2023-11-04T01:40:48.615 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a929032187] 2023-11-04T01:40:48.615 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a928dc10a9] 2023-11-04T01:40:48.615 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a928dc3b2b] 2023-11-04T01:40:48.615 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a928dc401c] 2023-11-04T01:40:48.615 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a928dad325] 2023-11-04T01:40:48.615 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f55c195ff9a] 2023-11-04T01:40:48.615 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f55c19f1741] 2023-11-04T01:40:48.615 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f55c0e9f802] 2023-11-04T01:40:48.615 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f55c0e3f450] 2023-11-04T01:40:48.616 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:40:48.616 INFO:tasks.ceph.mds.d.smithi204.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:40:48.616 INFO:tasks.ceph.mds.d.smithi204.stderr: in thread 7f55bbc21640 thread_name:ms_dispatch 2023-11-04T01:40:48.616 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:48.616 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f55c0e54db0] 2023-11-04T01:40:48.616 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f55c0ea154c] 2023-11-04T01:40:48.616 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: raise() 2023-11-04T01:40:48.616 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: abort() 2023-11-04T01:40:48.616 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f55c176f009] 2023-11-04T01:40:48.616 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f55c176f16d] 2023-11-04T01:40:48.616 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a929032187] 2023-11-04T01:40:48.616 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a928dc10a9] 2023-11-04T01:40:48.616 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a928dc3b2b] 2023-11-04T01:40:48.617 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a928dc401c] 2023-11-04T01:40:48.617 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a928dad325] 2023-11-04T01:40:48.617 INFO:tasks.ceph.mds.d.smithi204.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f55c195ff9a] 2023-11-04T01:40:48.617 INFO:tasks.ceph.mds.d.smithi204.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f55c19f1741] 2023-11-04T01:40:48.617 INFO:tasks.ceph.mds.d.smithi204.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f55c0e9f802] 2023-11-04T01:40:48.617 INFO:tasks.ceph.mds.d.smithi204.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f55c0e3f450] 2023-11-04T01:40:48.617 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:40:48.612+0000 7f55bbc21640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:48.617 INFO:tasks.ceph.mds.d.smithi204.stderr: in thread 7f55bbc21640 thread_name:ms_dispatch 2023-11-04T01:40:48.617 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:40:48.617 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:48.617 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f55c0e54db0] 2023-11-04T01:40:48.617 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f55c0ea154c] 2023-11-04T01:40:48.617 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: raise() 2023-11-04T01:40:48.617 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: abort() 2023-11-04T01:40:48.618 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f55c176f009] 2023-11-04T01:40:48.618 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f55c176f16d] 2023-11-04T01:40:48.618 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a929032187] 2023-11-04T01:40:48.618 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a928dc10a9] 2023-11-04T01:40:48.618 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a928dc3b2b] 2023-11-04T01:40:48.618 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a928dc401c] 2023-11-04T01:40:48.618 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a928dad325] 2023-11-04T01:40:48.618 INFO:tasks.ceph.mds.d.smithi204.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f55c195ff9a] 2023-11-04T01:40:48.618 INFO:tasks.ceph.mds.d.smithi204.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f55c19f1741] 2023-11-04T01:40:48.618 INFO:tasks.ceph.mds.d.smithi204.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f55c0e9f802] 2023-11-04T01:40:48.618 INFO:tasks.ceph.mds.d.smithi204.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f55c0e3f450] 2023-11-04T01:40:48.618 INFO:tasks.ceph.mds.d.smithi204.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:48.619 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:40:48.620 INFO:tasks.ceph.mds.d.smithi204.stderr: -196> 2023-11-04T01:40:46.050+0000 7f55b941c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:48.620 INFO:tasks.ceph.mds.d.smithi204.stderr: -194> 2023-11-04T01:40:46.050+0000 7f55b941c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:48.620 INFO:tasks.ceph.mds.d.smithi204.stderr: -1> 2023-11-04T01:40:48.611+0000 7f55bbc21640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f55bbc21640 time 2023-11-04T01:40:48.611909+0000 2023-11-04T01:40:48.620 INFO:tasks.ceph.mds.d.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:40:48.620 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:40:48.620 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:48.620 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f55c176efaf] 2023-11-04T01:40:48.620 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f55c176f16d] 2023-11-04T01:40:48.620 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a929032187] 2023-11-04T01:40:48.620 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a928dc10a9] 2023-11-04T01:40:48.621 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a928dc3b2b] 2023-11-04T01:40:48.621 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a928dc401c] 2023-11-04T01:40:48.621 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a928dad325] 2023-11-04T01:40:48.621 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f55c195ff9a] 2023-11-04T01:40:48.621 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f55c19f1741] 2023-11-04T01:40:48.621 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f55c0e9f802] 2023-11-04T01:40:48.621 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f55c0e3f450] 2023-11-04T01:40:48.621 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:40:48.621 INFO:tasks.ceph.mds.d.smithi204.stderr: 0> 2023-11-04T01:40:48.612+0000 7f55bbc21640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:48.621 INFO:tasks.ceph.mds.d.smithi204.stderr: in thread 7f55bbc21640 thread_name:ms_dispatch 2023-11-04T01:40:48.621 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:40:48.621 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:48.621 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f55c0e54db0] 2023-11-04T01:40:48.622 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f55c0ea154c] 2023-11-04T01:40:48.622 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: raise() 2023-11-04T01:40:48.622 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: abort() 2023-11-04T01:40:48.622 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f55c176f009] 2023-11-04T01:40:48.622 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f55c176f16d] 2023-11-04T01:40:48.622 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a929032187] 2023-11-04T01:40:48.622 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a928dc10a9] 2023-11-04T01:40:48.622 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a928dc3b2b] 2023-11-04T01:40:48.622 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a928dc401c] 2023-11-04T01:40:48.622 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a928dad325] 2023-11-04T01:40:48.622 INFO:tasks.ceph.mds.d.smithi204.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f55c195ff9a] 2023-11-04T01:40:48.622 INFO:tasks.ceph.mds.d.smithi204.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f55c19f1741] 2023-11-04T01:40:48.623 INFO:tasks.ceph.mds.d.smithi204.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f55c0e9f802] 2023-11-04T01:40:48.623 INFO:tasks.ceph.mds.d.smithi204.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f55c0e3f450] 2023-11-04T01:40:48.623 INFO:tasks.ceph.mds.d.smithi204.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:48.623 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:40:48.623 INFO:tasks.ceph.mds.d.smithi204.stderr: -196> 2023-11-04T01:40:46.050+0000 7f55b941c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:48.623 INFO:tasks.ceph.mds.d.smithi204.stderr: -194> 2023-11-04T01:40:46.050+0000 7f55b941c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:48.623 INFO:tasks.ceph.mds.d.smithi204.stderr: -1> 2023-11-04T01:40:48.611+0000 7f55bbc21640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f55bbc21640 time 2023-11-04T01:40:48.611909+0000 2023-11-04T01:40:48.623 INFO:tasks.ceph.mds.d.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:40:48.623 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:40:48.623 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:48.623 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f55c176efaf] 2023-11-04T01:40:48.624 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f55c176f16d] 2023-11-04T01:40:48.624 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a929032187] 2023-11-04T01:40:48.624 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a928dc10a9] 2023-11-04T01:40:48.624 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a928dc3b2b] 2023-11-04T01:40:48.624 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a928dc401c] 2023-11-04T01:40:48.624 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a928dad325] 2023-11-04T01:40:48.624 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f55c195ff9a] 2023-11-04T01:40:48.624 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f55c19f1741] 2023-11-04T01:40:48.624 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f55c0e9f802] 2023-11-04T01:40:48.624 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f55c0e3f450] 2023-11-04T01:40:48.624 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:40:48.624 INFO:tasks.ceph.mds.d.smithi204.stderr: 0> 2023-11-04T01:40:48.612+0000 7f55bbc21640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:48.624 INFO:tasks.ceph.mds.d.smithi204.stderr: in thread 7f55bbc21640 thread_name:ms_dispatch 2023-11-04T01:40:48.625 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:40:48.625 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:48.625 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f55c0e54db0] 2023-11-04T01:40:48.625 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f55c0ea154c] 2023-11-04T01:40:48.625 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: raise() 2023-11-04T01:40:48.625 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: abort() 2023-11-04T01:40:48.625 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f55c176f009] 2023-11-04T01:40:48.625 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f55c176f16d] 2023-11-04T01:40:48.625 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a929032187] 2023-11-04T01:40:48.625 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a928dc10a9] 2023-11-04T01:40:48.625 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a928dc3b2b] 2023-11-04T01:40:48.625 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a928dc401c] 2023-11-04T01:40:48.625 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a928dad325] 2023-11-04T01:40:48.626 INFO:tasks.ceph.mds.d.smithi204.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f55c195ff9a] 2023-11-04T01:40:48.626 INFO:tasks.ceph.mds.d.smithi204.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f55c19f1741] 2023-11-04T01:40:48.626 INFO:tasks.ceph.mds.d.smithi204.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f55c0e9f802] 2023-11-04T01:40:48.626 INFO:tasks.ceph.mds.d.smithi204.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f55c0e3f450] 2023-11-04T01:40:48.626 INFO:tasks.ceph.mds.d.smithi204.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:48.626 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:40:48.724 INFO:teuthology.orchestra.run.smithi044.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:40:48.724 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:40:48.725 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:48.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.828+0000 7f0efcb01640 1 Processor -- start 2023-11-04T01:40:48.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.828+0000 7f0efcb01640 1 -- start start 2023-11-04T01:40:48.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.829+0000 7f0efcb01640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0ef80ce240 0x7f0ef8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.829+0000 7f0efcb01640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ef8157540 0x7f0ef80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.829+0000 7f0efcb01640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef815e000 con 0x7f0ef80cde60 2023-11-04T01:40:48.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.829+0000 7f0efcb01640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef815e5c0 con 0x7f0ef80ce240 2023-11-04T01:40:48.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.829+0000 7f0efcb01640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef815e2e0 con 0x7f0ef8157540 2023-11-04T01:40:48.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.830+0000 7f0ef5d9b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0ef80ce240 0x7f0ef8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.830+0000 7f0ef659c640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f0ef80cde60 0x7f0ef815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:47882/0 (socket says 172.21.15.44:47882) 2023-11-04T01:40:48.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.830+0000 7f0ef6d9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ef8157540 0x7f0ef80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.830+0000 7f0ef659c640 1 -- 172.21.15.44:0/2336905856 learned_addr learned my addr 172.21.15.44:0/2336905856 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:40:48.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.830+0000 7f0ef559a640 1 -- 172.21.15.44:0/2336905856 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682616770 0 0) 0x7f0ef815e000 con 0x7f0ef80cde60 2023-11-04T01:40:48.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.830+0000 7f0ef559a640 1 -- 172.21.15.44:0/2336905856 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ee4003520 con 0x7f0ef80cde60 2023-11-04T01:40:48.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.830+0000 7f0ef6d9d640 1 -- 172.21.15.44:0/2336905856 >> v2:172.21.15.204:3300/0 conn(0x7f0ef80ce240 msgr2=0x7f0ef8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:48.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.830+0000 7f0ef6d9d640 1 --2- 172.21.15.44:0/2336905856 >> v2:172.21.15.204:3300/0 conn(0x7f0ef80ce240 0x7f0ef8157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.830+0000 7f0ef6d9d640 1 -- 172.21.15.44:0/2336905856 >> v1:172.21.15.204:6789/0 conn(0x7f0ef80cde60 legacy=0x7f0ef815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.830+0000 7f0ef6d9d640 1 -- 172.21.15.44:0/2336905856 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef80d1120 con 0x7f0ef8157540 2023-11-04T01:40:48.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.830+0000 7f0ef5d9b640 1 --2- 172.21.15.44:0/2336905856 >> v2:172.21.15.204:3300/0 conn(0x7f0ef80ce240 0x7f0ef8157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:48.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.831+0000 7f0ef6d9d640 1 --2- 172.21.15.44:0/2336905856 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ef8157540 0x7f0ef80d1920 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009d90 tx=0x7f0ee802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=642dd91b6b5b41ce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.831+0000 7f0ef559a640 1 -- 172.21.15.44:0/2336905856 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee802cc50 con 0x7f0ef8157540 2023-11-04T01:40:48.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.831+0000 7f0ef559a640 1 -- 172.21.15.44:0/2336905856 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee802cdb0 con 0x7f0ef8157540 2023-11-04T01:40:48.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.831+0000 7f0ef559a640 1 -- 172.21.15.44:0/2336905856 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8034660 con 0x7f0ef8157540 2023-11-04T01:40:48.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.831+0000 7f0efcb01640 1 -- 172.21.15.44:0/2336905856 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ef8157540 msgr2=0x7f0ef80d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.831+0000 7f0efcb01640 1 --2- 172.21.15.44:0/2336905856 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ef8157540 0x7f0ef80d1920 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009d90 tx=0x7f0ee802bea0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.832+0000 7f0efcb01640 1 -- 172.21.15.44:0/2336905856 shutdown_connections 2023-11-04T01:40:48.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.832+0000 7f0efcb01640 1 --2- 172.21.15.44:0/2336905856 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ef8157540 0x7f0ef80d1920 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.832+0000 7f0efcb01640 1 --2- 172.21.15.44:0/2336905856 >> v2:172.21.15.204:3300/0 conn(0x7f0ef80ce240 0x7f0ef8157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.832+0000 7f0efcb01640 1 -- 172.21.15.44:0/2336905856 >> 172.21.15.44:0/2336905856 conn(0x7f0ef8071f30 msgr2=0x7f0ef80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:48.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.832+0000 7f0efcb01640 1 -- 172.21.15.44:0/2336905856 shutdown_connections 2023-11-04T01:40:48.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.832+0000 7f0efcb01640 1 -- 172.21.15.44:0/2336905856 wait complete. 2023-11-04T01:40:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.833+0000 7f0efcb01640 1 Processor -- start 2023-11-04T01:40:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.833+0000 7f0efcb01640 1 -- start start 2023-11-04T01:40:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0efcb01640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ef80cde60 0x7f0ef814d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0efcb01640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ef80ce240 0x7f0ef815c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0efcb01640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef8157540 0x7f0ef814a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0efcb01640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80cba80 con 0x7f0ef8157540 2023-11-04T01:40:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0efcb01640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80cc600 con 0x7f0ef80ce240 2023-11-04T01:40:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0efcb01640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef815c840 con 0x7f0ef80cde60 2023-11-04T01:40:48.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0ef6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef8157540 0x7f0ef814a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0ef6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef8157540 0x7f0ef814a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48190/0 (socket says 172.21.15.44:48190) 2023-11-04T01:40:48.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0ef6d9d640 1 -- 172.21.15.44:0/1516739149 learned_addr learned my addr 172.21.15.44:0/1516739149 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:48.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0ef5d9b640 1 --2- 172.21.15.44:0/1516739149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ef80ce240 0x7f0ef815c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0ef659c640 1 --2- 172.21.15.44:0/1516739149 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ef80cde60 0x7f0ef814d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0ef6d9d640 1 -- 172.21.15.44:0/1516739149 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ef80cde60 msgr2=0x7f0ef814d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0ef6d9d640 1 --2- 172.21.15.44:0/1516739149 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ef80cde60 0x7f0ef814d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0ef6d9d640 1 -- 172.21.15.44:0/1516739149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ef80ce240 msgr2=0x7f0ef815c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0ef6d9d640 1 --2- 172.21.15.44:0/1516739149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ef80ce240 0x7f0ef815c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0ef6d9d640 1 -- 172.21.15.44:0/1516739149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee0009400 con 0x7f0ef8157540 2023-11-04T01:40:48.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0ef5d9b640 1 --2- 172.21.15.44:0/1516739149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ef80ce240 0x7f0ef815c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:48.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.834+0000 7f0ef6d9d640 1 --2- 172.21.15.44:0/1516739149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef8157540 0x7f0ef814a1a0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009eb0 tx=0x7f0ee8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.835+0000 7f0eeeffd640 1 -- 172.21.15.44:0/1516739149 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee803e610 con 0x7f0ef8157540 2023-11-04T01:40:48.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.835+0000 7f0eeeffd640 1 -- 172.21.15.44:0/1516739149 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee803e770 con 0x7f0ef8157540 2023-11-04T01:40:48.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.835+0000 7f0efcb01640 1 -- 172.21.15.44:0/1516739149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee8009a70 con 0x7f0ef8157540 2023-11-04T01:40:48.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.835+0000 7f0eeeffd640 1 -- 172.21.15.44:0/1516739149 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee803eb60 con 0x7f0ef8157540 2023-11-04T01:40:48.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.835+0000 7f0efcb01640 1 -- 172.21.15.44:0/1516739149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef80cbfb0 con 0x7f0ef8157540 2023-11-04T01:40:48.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.836+0000 7f0efcb01640 1 -- 172.21.15.44:0/1516739149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef8074290 con 0x7f0ef8157540 2023-11-04T01:40:48.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.836+0000 7f0eeeffd640 1 -- 172.21.15.44:0/1516739149 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ee803b050 con 0x7f0ef8157540 2023-11-04T01:40:48.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.836+0000 7f0eeeffd640 1 --2- 172.21.15.44:0/1516739149 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ed806ae70 0x7f0ed806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.836+0000 7f0eeeffd640 1 -- 172.21.15.44:0/1516739149 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7f0ee80abe10 con 0x7f0ef8157540 2023-11-04T01:40:48.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.837+0000 7f0ef659c640 1 --2- 172.21.15.44:0/1516739149 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ed806ae70 0x7f0ed806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.837+0000 7f0ef659c640 1 --2- 172.21.15.44:0/1516739149 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ed806ae70 0x7f0ed806d330 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0005880 tx=0x7f0ef0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:48.840+0000 7f0eeeffd640 1 -- 172.21.15.44:0/1516739149 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ee80af030 con 0x7f0ef8157540 2023-11-04T01:40:48.958 INFO:tasks.ceph.mds.d.smithi204.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:40:49.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:49.052+0000 7f0efcb01640 1 -- 172.21.15.44:0/1516739149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ef80b8880 con 0x7f0ef8157540 2023-11-04T01:40:49.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:49.052+0000 7f0eeeffd640 1 -- 172.21.15.44:0/1516739149 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f0ee8039090 con 0x7f0ef8157540 2023-11-04T01:40:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:49.054 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7797,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:48.378657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6820,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6820":{"gid":6820,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:49.055 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 68 2023-11-04T01:40:49.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:49.054+0000 7f0efcb01640 1 -- 172.21.15.44:0/1516739149 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ed806ae70 msgr2=0x7f0ed806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:49.054+0000 7f0efcb01640 1 --2- 172.21.15.44:0/1516739149 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ed806ae70 0x7f0ed806d330 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0005880 tx=0x7f0ef0009040 comp rx=0 tx=0).stop 2023-11-04T01:40:49.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:49.054+0000 7f0efcb01640 1 -- 172.21.15.44:0/1516739149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef8157540 msgr2=0x7f0ef814a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:49.054+0000 7f0efcb01640 1 --2- 172.21.15.44:0/1516739149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef8157540 0x7f0ef814a1a0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009eb0 tx=0x7f0ee8004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:49.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:49.054+0000 7f0efcb01640 1 -- 172.21.15.44:0/1516739149 shutdown_connections 2023-11-04T01:40:49.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:49.054+0000 7f0efcb01640 1 --2- 172.21.15.44:0/1516739149 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ed806ae70 0x7f0ed806d330 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:49.054+0000 7f0efcb01640 1 --2- 172.21.15.44:0/1516739149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef8157540 0x7f0ef814a1a0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:49.054+0000 7f0efcb01640 1 --2- 172.21.15.44:0/1516739149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ef80ce240 0x7f0ef815c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:49.054+0000 7f0efcb01640 1 --2- 172.21.15.44:0/1516739149 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ef80cde60 0x7f0ef814d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:49.054+0000 7f0efcb01640 1 -- 172.21.15.44:0/1516739149 >> 172.21.15.44:0/1516739149 conn(0x7f0ef8071f30 msgr2=0x7f0ef80b7070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:49.054+0000 7f0efcb01640 1 -- 172.21.15.44:0/1516739149 shutdown_connections 2023-11-04T01:40:49.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:49.054+0000 7f0efcb01640 1 -- 172.21.15.44:0/1516739149 wait complete. 2023-11-04T01:40:49.067 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:53.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-04T01:40:54.067 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:54.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.184+0000 7fb1f68a9640 1 Processor -- start 2023-11-04T01:40:54.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.184+0000 7fb1f68a9640 1 -- start start 2023-11-04T01:40:54.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.185+0000 7fb1f68a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb1f0160b10 0x7fb1f0160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.185+0000 7fb1f68a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1f00cf160 0x7fb1f00cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.185+0000 7fb1f68a9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f006bf00 con 0x7fb1f015ce60 2023-11-04T01:40:54.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.185+0000 7fb1f68a9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f00cbde0 con 0x7fb1f0160b10 2023-11-04T01:40:54.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.185+0000 7fb1f68a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f00cfb30 con 0x7fb1f00cf160 2023-11-04T01:40:54.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.185+0000 7fb1ef7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb1f0160b10 0x7fb1f0160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.185+0000 7fb1ef7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb1f0160b10 0x7fb1f0160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42022/0 (socket says 172.21.15.44:42022) 2023-11-04T01:40:54.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.185+0000 7fb1ef7fe640 1 -- 172.21.15.44:0/3650298914 learned_addr learned my addr 172.21.15.44:0/3650298914 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:54.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.185+0000 7fb1f4e46640 1 --2- 172.21.15.44:0/3650298914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1f00cf160 0x7fb1f00cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.186+0000 7fb1ef7fe640 1 -- 172.21.15.44:0/3650298914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1f00cf160 msgr2=0x7fb1f00cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:54.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.186+0000 7fb1ef7fe640 1 --2- 172.21.15.44:0/3650298914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1f00cf160 0x7fb1f00cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.186+0000 7fb1ef7fe640 1 -- 172.21.15.44:0/3650298914 >> v1:172.21.15.204:6789/0 conn(0x7fb1f015ce60 legacy=0x7fb1f006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.186+0000 7fb1ef7fe640 1 -- 172.21.15.44:0/3650298914 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f01615d0 con 0x7fb1f0160b10 2023-11-04T01:40:54.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.186+0000 7fb1ef7fe640 1 --2- 172.21.15.44:0/3650298914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1f0160b10 0x7fb1f0160f90 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009870 tx=0x7fb1e402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9ef38c509505d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:54.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.186+0000 7fb1eeffd640 1 -- 172.21.15.44:0/3650298914 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4031640 con 0x7fb1f0160b10 2023-11-04T01:40:54.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.187+0000 7fb1eeffd640 1 -- 172.21.15.44:0/3650298914 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e40317a0 con 0x7fb1f0160b10 2023-11-04T01:40:54.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.187+0000 7fb1eeffd640 1 -- 172.21.15.44:0/3650298914 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4031b30 con 0x7fb1f0160b10 2023-11-04T01:40:54.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.187+0000 7fb1f68a9640 1 -- 172.21.15.44:0/3650298914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1f0160b10 msgr2=0x7fb1f0160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.187+0000 7fb1f68a9640 1 --2- 172.21.15.44:0/3650298914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1f0160b10 0x7fb1f0160f90 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009870 tx=0x7fb1e402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.187+0000 7fb1f68a9640 1 -- 172.21.15.44:0/3650298914 shutdown_connections 2023-11-04T01:40:54.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.187+0000 7fb1f68a9640 1 --2- 172.21.15.44:0/3650298914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1f00cf160 0x7fb1f00cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.187+0000 7fb1f68a9640 1 --2- 172.21.15.44:0/3650298914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1f0160b10 0x7fb1f0160f90 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.187+0000 7fb1f68a9640 1 -- 172.21.15.44:0/3650298914 >> 172.21.15.44:0/3650298914 conn(0x7fb1f006ea90 msgr2=0x7fb1f006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:54.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.187+0000 7fb1f68a9640 1 -- 172.21.15.44:0/3650298914 shutdown_connections 2023-11-04T01:40:54.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.187+0000 7fb1f68a9640 1 -- 172.21.15.44:0/3650298914 wait complete. 2023-11-04T01:40:54.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.188+0000 7fb1f68a9640 1 Processor -- start 2023-11-04T01:40:54.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.189+0000 7fb1f68a9640 1 -- start start 2023-11-04T01:40:54.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.189+0000 7fb1f68a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1f00cf160 0x7fb1f0156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.189+0000 7fb1f68a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1f015ce60 0x7fb1f00b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.189+0000 7fb1f68a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1f0160b10 0x7fb1f00b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.189+0000 7fb1f68a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f01f6400 con 0x7fb1f0160b10 2023-11-04T01:40:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.189+0000 7fb1f68a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f01f66e0 con 0x7fb1f00cf160 2023-11-04T01:40:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.189+0000 7fb1f68a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f01f69c0 con 0x7fb1f015ce60 2023-11-04T01:40:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.189+0000 7fb1f4e46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1f0160b10 0x7fb1f00b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.189+0000 7fb1f4e46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1f0160b10 0x7fb1f00b1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42028/0 (socket says 172.21.15.44:42028) 2023-11-04T01:40:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.189+0000 7fb1f4e46640 1 -- 172.21.15.44:0/1657033300 learned_addr learned my addr 172.21.15.44:0/1657033300 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.190+0000 7fb1ef7fe640 1 --2- 172.21.15.44:0/1657033300 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1f015ce60 0x7fb1f00b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.190+0000 7fb1effff640 1 --2- 172.21.15.44:0/1657033300 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1f00cf160 0x7fb1f0156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.190+0000 7fb1f4e46640 1 -- 172.21.15.44:0/1657033300 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1f015ce60 msgr2=0x7fb1f00b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.190+0000 7fb1f4e46640 1 --2- 172.21.15.44:0/1657033300 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1f015ce60 0x7fb1f00b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.190+0000 7fb1f4e46640 1 -- 172.21.15.44:0/1657033300 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1f00cf160 msgr2=0x7fb1f0156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.190+0000 7fb1f4e46640 1 --2- 172.21.15.44:0/1657033300 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1f00cf160 0x7fb1f0156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.190+0000 7fb1f4e46640 1 -- 172.21.15.44:0/1657033300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e40094d0 con 0x7fb1f0160b10 2023-11-04T01:40:54.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.190+0000 7fb1f4e46640 1 --2- 172.21.15.44:0/1657033300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1f0160b10 0x7fb1f00b1cc0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8007e60 tx=0x7fb1e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:54.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.190+0000 7fb1ecff9640 1 -- 172.21.15.44:0/1657033300 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8014420 con 0x7fb1f0160b10 2023-11-04T01:40:54.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.190+0000 7fb1ecff9640 1 -- 172.21.15.44:0/1657033300 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e80145a0 con 0x7fb1f0160b10 2023-11-04T01:40:54.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.190+0000 7fb1f68a9640 1 -- 172.21.15.44:0/1657033300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f01f6ca0 con 0x7fb1f0160b10 2023-11-04T01:40:54.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.190+0000 7fb1ecff9640 1 -- 172.21.15.44:0/1657033300 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8014950 con 0x7fb1f0160b10 2023-11-04T01:40:54.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.190+0000 7fb1f68a9640 1 -- 172.21.15.44:0/1657033300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f01f6040 con 0x7fb1f0160b10 2023-11-04T01:40:54.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.191+0000 7fb1f68a9640 1 -- 172.21.15.44:0/1657033300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f00c9880 con 0x7fb1f0160b10 2023-11-04T01:40:54.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.192+0000 7fb1ecff9640 1 -- 172.21.15.44:0/1657033300 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1e8014ab0 con 0x7fb1f0160b10 2023-11-04T01:40:54.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.192+0000 7fb1ecff9640 1 --2- 172.21.15.44:0/1657033300 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb1dc06ae70 0x7fb1dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.192+0000 7fb1ecff9640 1 -- 172.21.15.44:0/1657033300 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7fb1e808a350 con 0x7fb1f0160b10 2023-11-04T01:40:54.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.192+0000 7fb1effff640 1 --2- 172.21.15.44:0/1657033300 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb1dc06ae70 0x7fb1dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.193+0000 7fb1effff640 1 --2- 172.21.15.44:0/1657033300 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb1dc06ae70 0x7fb1dc06d330 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00017b0 tx=0x7fb1e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:54.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.196+0000 7fb1ecff9640 1 -- 172.21.15.44:0/1657033300 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1f00c9880 con 0x7fb1f0160b10 2023-11-04T01:40:54.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.411+0000 7fb1f68a9640 1 -- 172.21.15.44:0/1657033300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1f00c9880 con 0x7fb1f0160b10 2023-11-04T01:40:54.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.411+0000 7fb1ecff9640 1 -- 172.21.15.44:0/1657033300 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fb1f00c9880 con 0x7fb1f0160b10 2023-11-04T01:40:54.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:54.413 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7797,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:48.378657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6820,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6820":{"gid":6820,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:54.414 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 68 2023-11-04T01:40:54.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.413+0000 7fb1f68a9640 1 -- 172.21.15.44:0/1657033300 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb1dc06ae70 msgr2=0x7fb1dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.413+0000 7fb1f68a9640 1 --2- 172.21.15.44:0/1657033300 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb1dc06ae70 0x7fb1dc06d330 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00017b0 tx=0x7fb1e0009040 comp rx=0 tx=0).stop 2023-11-04T01:40:54.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.413+0000 7fb1f68a9640 1 -- 172.21.15.44:0/1657033300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1f0160b10 msgr2=0x7fb1f00b1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.413+0000 7fb1f68a9640 1 --2- 172.21.15.44:0/1657033300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1f0160b10 0x7fb1f00b1cc0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8007e60 tx=0x7fb1e800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.413+0000 7fb1f68a9640 1 -- 172.21.15.44:0/1657033300 shutdown_connections 2023-11-04T01:40:54.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.413+0000 7fb1f68a9640 1 --2- 172.21.15.44:0/1657033300 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb1dc06ae70 0x7fb1dc06d330 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.413+0000 7fb1f68a9640 1 --2- 172.21.15.44:0/1657033300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1f0160b10 0x7fb1f00b1cc0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.413+0000 7fb1f68a9640 1 --2- 172.21.15.44:0/1657033300 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1f015ce60 0x7fb1f00b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.413+0000 7fb1f68a9640 1 --2- 172.21.15.44:0/1657033300 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1f00cf160 0x7fb1f0156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.413+0000 7fb1f68a9640 1 -- 172.21.15.44:0/1657033300 >> 172.21.15.44:0/1657033300 conn(0x7fb1f006ea90 msgr2=0x7fb1f00c46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:54.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.413+0000 7fb1f68a9640 1 -- 172.21.15.44:0/1657033300 shutdown_connections 2023-11-04T01:40:54.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:54.413+0000 7fb1f68a9640 1 -- 172.21.15.44:0/1657033300 wait complete. 2023-11-04T01:40:54.426 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:58.832 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:58.835 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:59.426 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.544+0000 7fc7486fc640 1 Processor -- start 2023-11-04T01:40:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.544+0000 7fc7486fc640 1 -- start start 2023-11-04T01:40:59.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.545+0000 7fc7486fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc74015ad80 0x7fc7400abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.545+0000 7fc7486fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc7400c9a40 0x7fc7400c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.545+0000 7fc7486fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74006b720 con 0x7fc74006a1b0 2023-11-04T01:40:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.545+0000 7fc7486fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7400ca430 con 0x7fc7400c9a40 2023-11-04T01:40:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.545+0000 7fc7486fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74006cf60 con 0x7fc74015ad80 2023-11-04T01:40:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.545+0000 7fc746c99640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc7400c9a40 0x7fc7400c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.545+0000 7fc746c99640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc7400c9a40 0x7fc7400c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42034/0 (socket says 172.21.15.44:42034) 2023-11-04T01:40:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.545+0000 7fc746c99640 1 -- 172.21.15.44:0/1822115013 learned_addr learned my addr 172.21.15.44:0/1822115013 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.545+0000 7fc746498640 1 --2- 172.21.15.44:0/1822115013 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc74015ad80 0x7fc7400abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.545+0000 7fc746c99640 1 -- 172.21.15.44:0/1822115013 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc74015ad80 msgr2=0x7fc7400abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.545+0000 7fc746c99640 1 --2- 172.21.15.44:0/1822115013 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc74015ad80 0x7fc7400abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.545+0000 7fc746c99640 1 -- 172.21.15.44:0/1822115013 >> v1:172.21.15.204:6789/0 conn(0x7fc74006a1b0 legacy=0x7fc74006b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.545+0000 7fc746c99640 1 -- 172.21.15.44:0/1822115013 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7400ac390 con 0x7fc7400c9a40 2023-11-04T01:40:59.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.546+0000 7fc746c99640 1 --2- 172.21.15.44:0/1822115013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7400c9a40 0x7fc7400c9ef0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fc738009e50 tx=0x7fc73802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd8c7a044d54f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.546+0000 7fc745496640 1 -- 172.21.15.44:0/1822115013 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73802cb00 con 0x7fc7400c9a40 2023-11-04T01:40:59.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.546+0000 7fc745496640 1 -- 172.21.15.44:0/1822115013 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73802cc60 con 0x7fc7400c9a40 2023-11-04T01:40:59.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.546+0000 7fc745496640 1 -- 172.21.15.44:0/1822115013 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7380343f0 con 0x7fc7400c9a40 2023-11-04T01:40:59.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.547+0000 7fc7486fc640 1 -- 172.21.15.44:0/1822115013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7400c9a40 msgr2=0x7fc7400c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.547+0000 7fc7486fc640 1 --2- 172.21.15.44:0/1822115013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7400c9a40 0x7fc7400c9ef0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fc738009e50 tx=0x7fc73802bf60 comp rx=0 tx=0).stop 2023-11-04T01:40:59.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.547+0000 7fc7486fc640 1 -- 172.21.15.44:0/1822115013 shutdown_connections 2023-11-04T01:40:59.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.547+0000 7fc7486fc640 1 --2- 172.21.15.44:0/1822115013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7400c9a40 0x7fc7400c9ef0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.547+0000 7fc7486fc640 1 --2- 172.21.15.44:0/1822115013 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc74015ad80 0x7fc7400abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.547+0000 7fc7486fc640 1 -- 172.21.15.44:0/1822115013 >> 172.21.15.44:0/1822115013 conn(0x7fc7400b0cd0 msgr2=0x7fc7400b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:59.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.547+0000 7fc7486fc640 1 -- 172.21.15.44:0/1822115013 shutdown_connections 2023-11-04T01:40:59.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.547+0000 7fc7486fc640 1 -- 172.21.15.44:0/1822115013 wait complete. 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.548+0000 7fc7486fc640 1 Processor -- start 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.548+0000 7fc7486fc640 1 -- start start 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc7486fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74006a1b0 0x7fc74014dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc7486fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7400c9a40 0x7fc7400af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc7486fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc74015ad80 0x7fc7400af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc7486fc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400c8e40 con 0x7fc74006a1b0 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc7486fc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400c8230 con 0x7fc74015ad80 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc7486fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400c8510 con 0x7fc7400c9a40 2023-11-04T01:40:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc746498640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74006a1b0 0x7fc74014dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc746498640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74006a1b0 0x7fc74014dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42038/0 (socket says 172.21.15.44:42038) 2023-11-04T01:40:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc746498640 1 -- 172.21.15.44:0/1971860163 learned_addr learned my addr 172.21.15.44:0/1971860163 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:40:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc746c99640 1 --2- 172.21.15.44:0/1971860163 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc74015ad80 0x7fc7400af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc745c97640 1 --2- 172.21.15.44:0/1971860163 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7400c9a40 0x7fc7400af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc746498640 1 -- 172.21.15.44:0/1971860163 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7400c9a40 msgr2=0x7fc7400af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc746498640 1 --2- 172.21.15.44:0/1971860163 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7400c9a40 0x7fc7400af460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc746498640 1 -- 172.21.15.44:0/1971860163 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc74015ad80 msgr2=0x7fc7400af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc746498640 1 --2- 172.21.15.44:0/1971860163 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc74015ad80 0x7fc7400af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.549+0000 7fc746498640 1 -- 172.21.15.44:0/1971860163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc738009b30 con 0x7fc74006a1b0 2023-11-04T01:40:59.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.550+0000 7fc746498640 1 --2- 172.21.15.44:0/1971860163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74006a1b0 0x7fc74014dd80 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00d800 tx=0x7fc73c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.550+0000 7fc736ffd640 1 -- 172.21.15.44:0/1971860163 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00b6c0 con 0x7fc74006a1b0 2023-11-04T01:40:59.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.550+0000 7fc736ffd640 1 -- 172.21.15.44:0/1971860163 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c00b820 con 0x7fc74006a1b0 2023-11-04T01:40:59.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.550+0000 7fc736ffd640 1 -- 172.21.15.44:0/1971860163 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00bbb0 con 0x7fc74006a1b0 2023-11-04T01:40:59.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.550+0000 7fc7486fc640 1 -- 172.21.15.44:0/1971860163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7400c87f0 con 0x7fc74006a1b0 2023-11-04T01:40:59.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.550+0000 7fc7486fc640 1 -- 172.21.15.44:0/1971860163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74014e2c0 con 0x7fc74006a1b0 2023-11-04T01:40:59.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.551+0000 7fc7486fc640 1 -- 172.21.15.44:0/1971860163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc740156fd0 con 0x7fc74006a1b0 2023-11-04T01:40:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.551+0000 7fc736ffd640 1 -- 172.21.15.44:0/1971860163 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc73c00bd10 con 0x7fc74006a1b0 2023-11-04T01:40:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.552+0000 7fc736ffd640 1 --2- 172.21.15.44:0/1971860163 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc72406aea0 0x7fc72406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.552+0000 7fc736ffd640 1 -- 172.21.15.44:0/1971860163 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7fc73c08a170 con 0x7fc74006a1b0 2023-11-04T01:40:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.552+0000 7fc745c97640 1 --2- 172.21.15.44:0/1971860163 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc72406aea0 0x7fc72406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.553+0000 7fc745c97640 1 --2- 172.21.15.44:0/1971860163 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc72406aea0 0x7fc72406d360 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc7400cd090 tx=0x7fc730009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.556+0000 7fc736ffd640 1 -- 172.21.15.44:0/1971860163 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc73c054bd0 con 0x7fc74006a1b0 2023-11-04T01:40:59.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.767+0000 7fc7486fc640 1 -- 172.21.15.44:0/1971860163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc740074290 con 0x7fc74006a1b0 2023-11-04T01:40:59.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.768+0000 7fc736ffd640 1 -- 172.21.15.44:0/1971860163 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fc73c0581f0 con 0x7fc74006a1b0 2023-11-04T01:40:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:40:59.770 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7797,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:40:48.378657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6820,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6820":{"gid":6820,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:59.770 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 68 2023-11-04T01:40:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.770+0000 7fc7486fc640 1 -- 172.21.15.44:0/1971860163 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc72406aea0 msgr2=0x7fc72406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.770+0000 7fc7486fc640 1 --2- 172.21.15.44:0/1971860163 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc72406aea0 0x7fc72406d360 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc7400cd090 tx=0x7fc730009040 comp rx=0 tx=0).stop 2023-11-04T01:40:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.770+0000 7fc7486fc640 1 -- 172.21.15.44:0/1971860163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74006a1b0 msgr2=0x7fc74014dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.770+0000 7fc7486fc640 1 --2- 172.21.15.44:0/1971860163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74006a1b0 0x7fc74014dd80 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00d800 tx=0x7fc73c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.770+0000 7fc7486fc640 1 -- 172.21.15.44:0/1971860163 shutdown_connections 2023-11-04T01:40:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.770+0000 7fc7486fc640 1 --2- 172.21.15.44:0/1971860163 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc72406aea0 0x7fc72406d360 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.770+0000 7fc7486fc640 1 --2- 172.21.15.44:0/1971860163 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc74015ad80 0x7fc7400af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.770+0000 7fc7486fc640 1 --2- 172.21.15.44:0/1971860163 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7400c9a40 0x7fc7400af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.770+0000 7fc7486fc640 1 --2- 172.21.15.44:0/1971860163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74006a1b0 0x7fc74014dd80 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.770+0000 7fc7486fc640 1 -- 172.21.15.44:0/1971860163 >> 172.21.15.44:0/1971860163 conn(0x7fc7400b0cd0 msgr2=0x7fc7401e7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.770+0000 7fc7486fc640 1 -- 172.21.15.44:0/1971860163 shutdown_connections 2023-11-04T01:40:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:40:59.770+0000 7fc7486fc640 1 -- 172.21.15.44:0/1971860163 wait complete. 2023-11-04T01:40:59.782 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:00.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-11-04T01:41:04.783 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:04.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.900+0000 7f0d1a31d640 1 Processor -- start 2023-11-04T01:41:04.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.900+0000 7f0d1a31d640 1 -- start start 2023-11-04T01:41:04.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.900+0000 7f0d1a31d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d140b0ae0 0x7f0d140ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.900+0000 7f0d1a31d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d140b4110 con 0x7f0d14159c70 2023-11-04T01:41:04.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.900+0000 7f0d1a31d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d140b43f0 con 0x7f0d1406db20 2023-11-04T01:41:04.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.900+0000 7f0d1a31d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d140b49b0 con 0x7f0d140b0ae0 2023-11-04T01:41:04.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.901+0000 7f0d13fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0d14159c70 0x7f0d140b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44146/0 (socket says 172.21.15.44:44146) 2023-11-04T01:41:04.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.901+0000 7f0d13fff640 1 -- 172.21.15.44:0/2796016645 learned_addr learned my addr 172.21.15.44:0/2796016645 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:04.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.901+0000 7f0d137fe640 1 --2- 172.21.15.44:0/2796016645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d140b0ae0 0x7f0d140ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.901+0000 7f0d12ffd640 1 -- 172.21.15.44:0/2796016645 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627210069 0 0) 0x7f0d140b4110 con 0x7f0d14159c70 2023-11-04T01:41:04.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.901+0000 7f0d12ffd640 1 -- 172.21.15.44:0/2796016645 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cfc003520 con 0x7f0d14159c70 2023-11-04T01:41:04.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.901+0000 7f0d12ffd640 1 -- 172.21.15.44:0/2796016645 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461898691 0 0) 0x7f0d140b43f0 con 0x7f0d1406db20 2023-11-04T01:41:04.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.901+0000 7f0d12ffd640 1 -- 172.21.15.44:0/2796016645 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d140b4110 con 0x7f0d1406db20 2023-11-04T01:41:04.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.901+0000 7f0d137fe640 1 -- 172.21.15.44:0/2796016645 >> v1:172.21.15.204:6789/0 conn(0x7f0d1406db20 legacy=0x7f0d1415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.901+0000 7f0d137fe640 1 -- 172.21.15.44:0/2796016645 >> v1:172.21.15.44:6789/0 conn(0x7f0d14159c70 legacy=0x7f0d140b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.901+0000 7f0d137fe640 1 -- 172.21.15.44:0/2796016645 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d140b46d0 con 0x7f0d140b0ae0 2023-11-04T01:41:04.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.902+0000 7f0d137fe640 1 --2- 172.21.15.44:0/2796016645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d140b0ae0 0x7f0d140ce370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0d040097d0 tx=0x7f0d0402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb961c9bea0bdce2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.902+0000 7f0d12ffd640 1 -- 172.21.15.44:0/2796016645 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04031890 con 0x7f0d140b0ae0 2023-11-04T01:41:04.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.902+0000 7f0d12ffd640 1 -- 172.21.15.44:0/2796016645 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d040319f0 con 0x7f0d140b0ae0 2023-11-04T01:41:04.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.902+0000 7f0d12ffd640 1 -- 172.21.15.44:0/2796016645 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04031d80 con 0x7f0d140b0ae0 2023-11-04T01:41:04.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.903+0000 7f0d1a31d640 1 -- 172.21.15.44:0/2796016645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d140b0ae0 msgr2=0x7f0d140ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.903+0000 7f0d1a31d640 1 --2- 172.21.15.44:0/2796016645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d140b0ae0 0x7f0d140ce370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0d040097d0 tx=0x7f0d0402b930 comp rx=0 tx=0).stop 2023-11-04T01:41:04.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.903+0000 7f0d1a31d640 1 -- 172.21.15.44:0/2796016645 shutdown_connections 2023-11-04T01:41:04.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.903+0000 7f0d1a31d640 1 --2- 172.21.15.44:0/2796016645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d140b0ae0 0x7f0d140ce370 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.903+0000 7f0d1a31d640 1 -- 172.21.15.44:0/2796016645 >> 172.21.15.44:0/2796016645 conn(0x7f0d140ce950 msgr2=0x7f0d140ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:04.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.903+0000 7f0d1a31d640 1 -- 172.21.15.44:0/2796016645 shutdown_connections 2023-11-04T01:41:04.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.903+0000 7f0d1a31d640 1 -- 172.21.15.44:0/2796016645 wait complete. 2023-11-04T01:41:04.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.904+0000 7f0d1a31d640 1 Processor -- start 2023-11-04T01:41:04.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.904+0000 7f0d1a31d640 1 -- start start 2023-11-04T01:41:04.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.905+0000 7f0d1a31d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d1406db20 0x7f0d14147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.905+0000 7f0d1a31d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d140b0ae0 0x7f0d1415c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.905+0000 7f0d1a31d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d14159c70 0x7f0d140706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.905+0000 7f0d1a31d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d141498c0 con 0x7f0d140b0ae0 2023-11-04T01:41:04.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.905+0000 7f0d1a31d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d141489c0 con 0x7f0d1406db20 2023-11-04T01:41:04.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.905+0000 7f0d1a31d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d140abb80 con 0x7f0d14159c70 2023-11-04T01:41:04.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.905+0000 7f0d137fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d140b0ae0 0x7f0d1415c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.905+0000 7f0d137fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d140b0ae0 0x7f0d1415c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55292/0 (socket says 172.21.15.44:55292) 2023-11-04T01:41:04.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.905+0000 7f0d137fe640 1 -- 172.21.15.44:0/2903070663 learned_addr learned my addr 172.21.15.44:0/2903070663 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:04.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.905+0000 7f0d188ba640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d14159c70 0x7f0d140706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.905+0000 7f0d13fff640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d1406db20 0x7f0d14147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.906+0000 7f0d137fe640 1 -- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d14159c70 msgr2=0x7f0d140706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.906+0000 7f0d137fe640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d14159c70 0x7f0d140706f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.906+0000 7f0d137fe640 1 -- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d1406db20 msgr2=0x7f0d14147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.906+0000 7f0d137fe640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d1406db20 0x7f0d14147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.906+0000 7f0d137fe640 1 -- 172.21.15.44:0/2903070663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d04009400 con 0x7f0d140b0ae0 2023-11-04T01:41:04.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.906+0000 7f0d188ba640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d14159c70 0x7f0d140706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:04.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.906+0000 7f0d13fff640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d1406db20 0x7f0d14147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:04.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.906+0000 7f0d137fe640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d140b0ae0 0x7f0d1415c780 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f0d0402bf40 tx=0x7f0d040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.906+0000 7f0d10ff9640 1 -- 172.21.15.44:0/2903070663 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0403bbf0 con 0x7f0d140b0ae0 2023-11-04T01:41:04.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.906+0000 7f0d10ff9640 1 -- 172.21.15.44:0/2903070663 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0403bd50 con 0x7f0d140b0ae0 2023-11-04T01:41:04.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.906+0000 7f0d1a31d640 1 -- 172.21.15.44:0/2903070663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d14148c40 con 0x7f0d140b0ae0 2023-11-04T01:41:04.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.906+0000 7f0d10ff9640 1 -- 172.21.15.44:0/2903070663 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04045630 con 0x7f0d140b0ae0 2023-11-04T01:41:04.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.906+0000 7f0d1a31d640 1 -- 172.21.15.44:0/2903070663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d14149200 con 0x7f0d140b0ae0 2023-11-04T01:41:04.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.907+0000 7f0d1a31d640 1 -- 172.21.15.44:0/2903070663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d14149a00 con 0x7f0d140b0ae0 2023-11-04T01:41:04.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.907+0000 7f0d10ff9640 1 -- 172.21.15.44:0/2903070663 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d0404e450 con 0x7f0d140b0ae0 2023-11-04T01:41:04.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.908+0000 7f0d10ff9640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0d0006ae70 0x7f0d0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.908+0000 7f0d10ff9640 1 -- 172.21.15.44:0/2903070663 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7f0d040ac2d0 con 0x7f0d140b0ae0 2023-11-04T01:41:04.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.908+0000 7f0d13fff640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0d0006ae70 0x7f0d0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.909+0000 7f0d13fff640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0d0006ae70 0x7f0d0006d330 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0d08007fd0 tx=0x7f0d08009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:04.912+0000 7f0d10ff9640 1 -- 172.21.15.44:0/2903070663 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d14149a00 con 0x7f0d140b0ae0 2023-11-04T01:41:05.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.126+0000 7f0d1a31d640 1 -- 172.21.15.44:0/2903070663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d14149a00 con 0x7f0d140b0ae0 2023-11-04T01:41:05.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.127+0000 7f0d10ff9640 1 -- 172.21.15.44:0/2903070663 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4983 (secure 0 0 0) 0x7f0d14149a00 con 0x7f0d140b0ae0 2023-11-04T01:41:05.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:05.129 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":69,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7797,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:04.217323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6820,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6820":{"gid":6820,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3065829953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3065829953},{"type":"v1","addr":"172.21.15.204:6836","nonce":3065829953}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:41:04.217323+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 69 2023-11-04T01:41:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.129+0000 7f0d1a31d640 1 -- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0d0006ae70 msgr2=0x7f0d0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.129+0000 7f0d1a31d640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0d0006ae70 0x7f0d0006d330 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0d08007fd0 tx=0x7f0d08009040 comp rx=0 tx=0).stop 2023-11-04T01:41:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.129+0000 7f0d1a31d640 1 -- 172.21.15.44:0/2903070663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d140b0ae0 msgr2=0x7f0d1415c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.129+0000 7f0d1a31d640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d140b0ae0 0x7f0d1415c780 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f0d0402bf40 tx=0x7f0d040046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.129+0000 7f0d1a31d640 1 -- 172.21.15.44:0/2903070663 shutdown_connections 2023-11-04T01:41:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.129+0000 7f0d1a31d640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0d0006ae70 0x7f0d0006d330 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.129+0000 7f0d1a31d640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d14159c70 0x7f0d140706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.129+0000 7f0d1a31d640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d140b0ae0 0x7f0d1415c780 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.129+0000 7f0d1a31d640 1 --2- 172.21.15.44:0/2903070663 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d1406db20 0x7f0d14147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.129+0000 7f0d1a31d640 1 -- 172.21.15.44:0/2903070663 >> 172.21.15.44:0/2903070663 conn(0x7f0d140ce950 msgr2=0x7f0d14158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.129+0000 7f0d1a31d640 1 -- 172.21.15.44:0/2903070663 shutdown_connections 2023-11-04T01:41:05.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.129+0000 7f0d1a31d640 1 -- 172.21.15.44:0/2903070663 wait complete. 2023-11-04T01:41:05.141 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:41:05.141 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:41:05.172 INFO:teuthology.orchestra.run.smithi204.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:41:05.173 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:41:05.173 DEBUG:teuthology.orchestra.run.smithi204:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:41:05.247 INFO:teuthology.orchestra.run.smithi204.stdout:1699062048.126652.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i d', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:41:05.249 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062048.126652.core'] 2023-11-04T01:41:05.249 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062048.126652.core, deleting it 2023-11-04T01:41:05.250 DEBUG:teuthology.orchestra.run.smithi204:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062048.126652.core 2023-11-04T01:41:05.321 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:41:05.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.427+0000 7f8fa454c640 1 Processor -- start 2023-11-04T01:41:05.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.427+0000 7f8fa454c640 1 -- start start 2023-11-04T01:41:05.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.428+0000 7f8fa454c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8f9c160430 0x7f8f9c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.428+0000 7f8fa454c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8f9c0b2b60 0x7f8f9c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.428+0000 7f8fa454c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9c0b2fc0 con 0x7f8f9c06c1d0 2023-11-04T01:41:05.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.428+0000 7f8fa454c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9c0cb580 con 0x7f8f9c0b2b60 2023-11-04T01:41:05.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.428+0000 7f8fa454c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9c06ca40 con 0x7f8f9c160430 2023-11-04T01:41:05.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.428+0000 7f8fa1ae7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8f9c0b2b60 0x7f8f9c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.428+0000 7f8fa1ae7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8f9c0b2b60 0x7f8f9c06bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55302/0 (socket says 172.21.15.44:55302) 2023-11-04T01:41:05.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.428+0000 7f8fa1ae7640 1 -- 172.21.15.44:0/1876293602 learned_addr learned my addr 172.21.15.44:0/1876293602 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:05.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.428+0000 7f8fa1ae7640 1 -- 172.21.15.44:0/1876293602 >> v2:172.21.15.204:3300/0 conn(0x7f8f9c160430 msgr2=0x7f8f9c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:05.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.428+0000 7f8fa1ae7640 1 --2- 172.21.15.44:0/1876293602 >> v2:172.21.15.204:3300/0 conn(0x7f8f9c160430 0x7f8f9c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.428+0000 7f8fa1ae7640 1 -- 172.21.15.44:0/1876293602 >> v1:172.21.15.204:6789/0 conn(0x7f8f9c06c1d0 legacy=0x7f8f9c160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:05.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.428+0000 7f8fa1ae7640 1 -- 172.21.15.44:0/1876293602 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c06cd20 con 0x7f8f9c0b2b60 2023-11-04T01:41:05.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.429+0000 7f8fa1ae7640 1 --2- 172.21.15.44:0/1876293602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c0b2b60 0x7f8f9c06bc90 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c06f6d0 tx=0x7f8f9002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306fb6c72ad35f81 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.429+0000 7f8fa12e6640 1 -- 172.21.15.44:0/1876293602 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f90031870 con 0x7f8f9c0b2b60 2023-11-04T01:41:05.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.429+0000 7f8fa12e6640 1 -- 172.21.15.44:0/1876293602 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f900319d0 con 0x7f8f9c0b2b60 2023-11-04T01:41:05.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.429+0000 7f8fa12e6640 1 -- 172.21.15.44:0/1876293602 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f90031d60 con 0x7f8f9c0b2b60 2023-11-04T01:41:05.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.430+0000 7f8fa454c640 1 -- 172.21.15.44:0/1876293602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c0b2b60 msgr2=0x7f8f9c06bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.430+0000 7f8fa454c640 1 --2- 172.21.15.44:0/1876293602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c0b2b60 0x7f8f9c06bc90 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c06f6d0 tx=0x7f8f9002b910 comp rx=0 tx=0).stop 2023-11-04T01:41:05.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.430+0000 7f8fa454c640 1 -- 172.21.15.44:0/1876293602 shutdown_connections 2023-11-04T01:41:05.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.430+0000 7f8fa454c640 1 --2- 172.21.15.44:0/1876293602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c0b2b60 0x7f8f9c06bc90 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.430+0000 7f8fa454c640 1 --2- 172.21.15.44:0/1876293602 >> v2:172.21.15.204:3300/0 conn(0x7f8f9c160430 0x7f8f9c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.430+0000 7f8fa454c640 1 -- 172.21.15.44:0/1876293602 >> 172.21.15.44:0/1876293602 conn(0x7f8f9c06ea20 msgr2=0x7f8f9c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.430+0000 7f8fa454c640 1 -- 172.21.15.44:0/1876293602 shutdown_connections 2023-11-04T01:41:05.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.430+0000 7f8fa454c640 1 -- 172.21.15.44:0/1876293602 wait complete. 2023-11-04T01:41:05.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.431+0000 7f8fa454c640 1 Processor -- start 2023-11-04T01:41:05.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.431+0000 7f8fa454c640 1 -- start start 2023-11-04T01:41:05.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa454c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f9c06c1d0 0x7f8f9c15a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa454c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f9c0b2b60 0x7f8f9c0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa454c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c160430 0x7f8f9c0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa454c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0b5130 con 0x7f8f9c160430 2023-11-04T01:41:05.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa454c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0b3d60 con 0x7f8f9c06c1d0 2023-11-04T01:41:05.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa454c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0b37c0 con 0x7f8f9c0b2b60 2023-11-04T01:41:05.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa2ae9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c160430 0x7f8f9c0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa2ae9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c160430 0x7f8f9c0b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55316/0 (socket says 172.21.15.44:55316) 2023-11-04T01:41:05.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa2ae9640 1 -- 172.21.15.44:0/2395810545 learned_addr learned my addr 172.21.15.44:0/2395810545 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:05.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa22e8640 1 --2- 172.21.15.44:0/2395810545 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f9c06c1d0 0x7f8f9c15a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa1ae7640 1 --2- 172.21.15.44:0/2395810545 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f9c0b2b60 0x7f8f9c0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa2ae9640 1 -- 172.21.15.44:0/2395810545 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f9c0b2b60 msgr2=0x7f8f9c0b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa2ae9640 1 --2- 172.21.15.44:0/2395810545 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f9c0b2b60 0x7f8f9c0b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa2ae9640 1 -- 172.21.15.44:0/2395810545 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f9c06c1d0 msgr2=0x7f8f9c15a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa2ae9640 1 --2- 172.21.15.44:0/2395810545 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f9c06c1d0 0x7f8f9c15a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa2ae9640 1 -- 172.21.15.44:0/2395810545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f900094d0 con 0x7f8f9c160430 2023-11-04T01:41:05.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.432+0000 7f8fa22e8640 1 --2- 172.21.15.44:0/2395810545 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f9c06c1d0 0x7f8f9c15a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:05.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.433+0000 7f8fa2ae9640 1 --2- 172.21.15.44:0/2395810545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c160430 0x7f8f9c0b1e20 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c390 tx=0x7f8f8c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.433+0000 7f8f9affd640 1 -- 172.21.15.44:0/2395810545 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c0035f0 con 0x7f8f9c160430 2023-11-04T01:41:05.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.433+0000 7f8f9affd640 1 -- 172.21.15.44:0/2395810545 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c003750 con 0x7f8f9c160430 2023-11-04T01:41:05.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.433+0000 7f8fa454c640 1 -- 172.21.15.44:0/2395810545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9c0b3a80 con 0x7f8f9c160430 2023-11-04T01:41:05.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.433+0000 7f8f9affd640 1 -- 172.21.15.44:0/2395810545 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c003b00 con 0x7f8f9c160430 2023-11-04T01:41:05.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.433+0000 7f8fa454c640 1 -- 172.21.15.44:0/2395810545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9c0b4930 con 0x7f8f9c160430 2023-11-04T01:41:05.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.434+0000 7f8fa454c640 1 -- 172.21.15.44:0/2395810545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9c074290 con 0x7f8f9c160430 2023-11-04T01:41:05.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.434+0000 7f8f9affd640 1 -- 172.21.15.44:0/2395810545 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8f8c003c60 con 0x7f8f9c160430 2023-11-04T01:41:05.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.434+0000 7f8f9affd640 1 --2- 172.21.15.44:0/2395810545 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f8806ae70 0x7f8f8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.435+0000 7f8f9affd640 1 -- 172.21.15.44:0/2395810545 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7322+0+0 (secure 0 0 0) 0x7f8f8c088ef0 con 0x7f8f9c160430 2023-11-04T01:41:05.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.435+0000 7f8fa22e8640 1 --2- 172.21.15.44:0/2395810545 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f8806ae70 0x7f8f8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.435+0000 7f8fa22e8640 1 --2- 172.21.15.44:0/2395810545 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f8806ae70 0x7f8f8806d330 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009fa0 tx=0x7f8f94009570 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.439+0000 7f8f9affd640 1 -- 172.21.15.44:0/2395810545 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f8c053940 con 0x7f8f9c160430 2023-11-04T01:41:05.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.690+0000 7f8fa454c640 1 -- 172.21.15.44:0/2395810545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f8f9c0af990 con 0x7f8f9c160430 2023-11-04T01:41:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.694+0000 7f8f9affd640 1 -- 172.21.15.44:0/2395810545 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 6820 v70) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8f8c017090 con 0x7f8f9c160430 2023-11-04T01:41:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:failed mds gid 6820 2023-11-04T01:41:05.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.695+0000 7f8fa454c640 1 -- 172.21.15.44:0/2395810545 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f8806ae70 msgr2=0x7f8f8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.695+0000 7f8fa454c640 1 --2- 172.21.15.44:0/2395810545 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f8806ae70 0x7f8f8806d330 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009fa0 tx=0x7f8f94009570 comp rx=0 tx=0).stop 2023-11-04T01:41:05.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.695+0000 7f8fa454c640 1 -- 172.21.15.44:0/2395810545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c160430 msgr2=0x7f8f9c0b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.695+0000 7f8fa454c640 1 --2- 172.21.15.44:0/2395810545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c160430 0x7f8f9c0b1e20 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c390 tx=0x7f8f8c00c850 comp rx=0 tx=0).stop 2023-11-04T01:41:05.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.695+0000 7f8fa454c640 1 -- 172.21.15.44:0/2395810545 shutdown_connections 2023-11-04T01:41:05.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.695+0000 7f8fa454c640 1 --2- 172.21.15.44:0/2395810545 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f8806ae70 0x7f8f8806d330 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.695+0000 7f8fa454c640 1 --2- 172.21.15.44:0/2395810545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c160430 0x7f8f9c0b1e20 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.695+0000 7f8fa454c640 1 --2- 172.21.15.44:0/2395810545 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f9c0b2b60 0x7f8f9c0b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.695+0000 7f8fa454c640 1 --2- 172.21.15.44:0/2395810545 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f9c06c1d0 0x7f8f9c15a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.695+0000 7f8fa454c640 1 -- 172.21.15.44:0/2395810545 >> 172.21.15.44:0/2395810545 conn(0x7f8f9c06ea20 msgr2=0x7f8f9c0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.696+0000 7f8fa454c640 1 -- 172.21.15.44:0/2395810545 shutdown_connections 2023-11-04T01:41:05.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.696+0000 7f8fa454c640 1 -- 172.21.15.44:0/2395810545 wait complete. 2023-11-04T01:41:05.712 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:41:05.712 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:41:05.712 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:41:05.712 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:05.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:05.713 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi204 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-11-04T01:41:05.713 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:41:05.713 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:41:05.715 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:41:05.716 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:05.796 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2023-11-04T01:41:05.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.820+0000 7faded010640 1 Processor -- start 2023-11-04T01:41:05.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.820+0000 7faded010640 1 -- start start 2023-11-04T01:41:05.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7faded010640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fade8159c70 0x7fade80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7faded010640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade80b4110 con 0x7fade806db20 2023-11-04T01:41:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7faded010640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade80b43f0 con 0x7fade80b0ae0 2023-11-04T01:41:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7faded010640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade80b49b0 con 0x7fade8159c70 2023-11-04T01:41:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7faddffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fade806db20 0x7fade80b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44162/0 (socket says 172.21.15.44:44162) 2023-11-04T01:41:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7faddffff640 1 -- 172.21.15.44:0/2590426764 learned_addr learned my addr 172.21.15.44:0/2590426764 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade659c640 1 -- 172.21.15.44:0/2590426764 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709130123 0 0) 0x7fade80b4110 con 0x7fade806db20 2023-11-04T01:41:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade659c640 1 -- 172.21.15.44:0/2590426764 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadd4005730 con 0x7fade806db20 2023-11-04T01:41:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade6d9d640 1 --2- 172.21.15.44:0/2590426764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fade8159c70 0x7fade80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade659c640 1 -- 172.21.15.44:0/2590426764 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3984583074 0 0) 0x7fadd4005730 con 0x7fade806db20 2023-11-04T01:41:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade659c640 1 -- 172.21.15.44:0/2590426764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fade8159c70 msgr2=0x7fade80ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade659c640 1 --2- 172.21.15.44:0/2590426764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fade8159c70 0x7fade80ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade659c640 1 -- 172.21.15.44:0/2590426764 >> v1:172.21.15.204:6789/0 conn(0x7fade80b0ae0 legacy=0x7fade815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade659c640 1 -- 172.21.15.44:0/2590426764 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade80b46d0 con 0x7fade806db20 2023-11-04T01:41:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade659c640 1 -- 172.21.15.44:0/2590426764 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fadd0001670 con 0x7fade806db20 2023-11-04T01:41:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade6d9d640 1 --2- 172.21.15.44:0/2590426764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fade8159c70 0x7fade80ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade659c640 1 -- 172.21.15.44:0/2590426764 >> v1:172.21.15.44:6789/0 conn(0x7fade806db20 legacy=0x7fade80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade659c640 1 --2- 172.21.15.44:0/2590426764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fade8159c70 0x7fadd4005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade659c640 1 --2- 172.21.15.44:0/2590426764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadd40061f0 0x7fadd40069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade659c640 1 --2- 172.21.15.44:0/2590426764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadd4006f10 0x7fadd4007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade659c640 1 -- 172.21.15.44:0/2590426764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade80b49b0 con 0x7fadd4006f10 2023-11-04T01:41:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade659c640 1 -- 172.21.15.44:0/2590426764 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd400dd50 con 0x7fadd40061f0 2023-11-04T01:41:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.821+0000 7fade659c640 1 -- 172.21.15.44:0/2590426764 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd400df10 con 0x7fade8159c70 2023-11-04T01:41:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.822+0000 7fade759e640 1 --2- 172.21.15.44:0/2590426764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadd4006f10 0x7fadd4007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.822+0000 7fade6d9d640 1 --2- 172.21.15.44:0/2590426764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fade8159c70 0x7fadd4005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.822+0000 7faddffff640 1 --2- 172.21.15.44:0/2590426764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadd40061f0 0x7fadd40069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.822+0000 7fade759e640 1 -- 172.21.15.44:0/2590426764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fade8159c70 msgr2=0x7fadd4005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:05.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.822+0000 7fade759e640 1 --2- 172.21.15.44:0/2590426764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fade8159c70 0x7fadd4005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.822+0000 7fade759e640 1 -- 172.21.15.44:0/2590426764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadd40061f0 msgr2=0x7fadd40069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:05.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.822+0000 7fade759e640 1 --2- 172.21.15.44:0/2590426764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadd40061f0 0x7fadd40069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.822+0000 7fade759e640 1 -- 172.21.15.44:0/2590426764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd4005730 con 0x7fadd4006f10 2023-11-04T01:41:05.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.822+0000 7faddffff640 1 --2- 172.21.15.44:0/2590426764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadd40061f0 0x7fadd40069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:05.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.823+0000 7fade759e640 1 --2- 172.21.15.44:0/2590426764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadd4006f10 0x7fadd4007390 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fade0001e50 tx=0x7fadd4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c37d01db7a3ee75 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.823+0000 7fade659c640 1 -- 172.21.15.44:0/2590426764 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0003b70 con 0x7fadd4006f10 2023-11-04T01:41:05.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.823+0000 7fade659c640 1 -- 172.21.15.44:0/2590426764 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade0003cd0 con 0x7fadd4006f10 2023-11-04T01:41:05.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.823+0000 7fade659c640 1 -- 172.21.15.44:0/2590426764 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0005310 con 0x7fadd4006f10 2023-11-04T01:41:05.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.823+0000 7faded010640 1 -- 172.21.15.44:0/2590426764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadd4006f10 msgr2=0x7fadd4007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.823+0000 7faded010640 1 --2- 172.21.15.44:0/2590426764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadd4006f10 0x7fadd4007390 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fade0001e50 tx=0x7fadd4007a00 comp rx=0 tx=0).stop 2023-11-04T01:41:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.823+0000 7fade759e640 1 -- 172.21.15.44:0/2590426764 reap_dead start 2023-11-04T01:41:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.823+0000 7faded010640 1 -- 172.21.15.44:0/2590426764 shutdown_connections 2023-11-04T01:41:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.823+0000 7faded010640 1 -- 172.21.15.44:0/2590426764 >> 172.21.15.44:0/2590426764 conn(0x7fade80ce950 msgr2=0x7fade80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.823+0000 7faded010640 1 -- 172.21.15.44:0/2590426764 shutdown_connections 2023-11-04T01:41:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.823+0000 7faded010640 1 -- 172.21.15.44:0/2590426764 wait complete. 2023-11-04T01:41:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.825+0000 7faded010640 1 Processor -- start 2023-11-04T01:41:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.825+0000 7faded010640 1 -- start start 2023-11-04T01:41:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.825+0000 7faded010640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadd4006f10 0x7fade81468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.825+0000 7faded010640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fade80c4bf0 0x7fade80a9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.825+0000 7faded010640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fade80aa0d0 0x7fade81ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.825+0000 7faded010640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade80aa550 con 0x7fade80c4bf0 2023-11-04T01:41:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.825+0000 7faded010640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade80c6b10 con 0x7fade80aa0d0 2023-11-04T01:41:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.825+0000 7faded010640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade8146df0 con 0x7fadd4006f10 2023-11-04T01:41:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.825+0000 7faddffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fade80c4bf0 0x7fade80a9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.825+0000 7faddffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fade80c4bf0 0x7fade80a9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55332/0 (socket says 172.21.15.44:55332) 2023-11-04T01:41:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.825+0000 7faddffff640 1 -- 172.21.15.44:0/2268564771 learned_addr learned my addr 172.21.15.44:0/2268564771 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.826+0000 7fade6d9d640 1 --2- 172.21.15.44:0/2268564771 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadd4006f10 0x7fade81468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.826+0000 7fade759e640 1 --2- 172.21.15.44:0/2268564771 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fade80aa0d0 0x7fade81ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.826+0000 7faddffff640 1 -- 172.21.15.44:0/2268564771 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadd4006f10 msgr2=0x7fade81468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.826+0000 7faddffff640 1 --2- 172.21.15.44:0/2268564771 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadd4006f10 0x7fade81468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.826+0000 7faddffff640 1 -- 172.21.15.44:0/2268564771 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fade80aa0d0 msgr2=0x7fade81ee4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.826+0000 7faddffff640 1 --2- 172.21.15.44:0/2268564771 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fade80aa0d0 0x7fade81ee4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.826+0000 7faddffff640 1 -- 172.21.15.44:0/2268564771 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade81ef250 con 0x7fade80c4bf0 2023-11-04T01:41:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.826+0000 7faddffff640 1 --2- 172.21.15.44:0/2268564771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fade80c4bf0 0x7fade80a9b90 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fadd000e7d0 tx=0x7fadd000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.826+0000 7faddf7fe640 1 -- 172.21.15.44:0/2268564771 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000eee0 con 0x7fade80c4bf0 2023-11-04T01:41:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.826+0000 7faddf7fe640 1 -- 172.21.15.44:0/2268564771 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd000c8d0 con 0x7fade80c4bf0 2023-11-04T01:41:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.826+0000 7faded010640 1 -- 172.21.15.44:0/2268564771 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade80c6d60 con 0x7fade80c4bf0 2023-11-04T01:41:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.826+0000 7faddf7fe640 1 -- 172.21.15.44:0/2268564771 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000cc60 con 0x7fade80c4bf0 2023-11-04T01:41:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.826+0000 7faded010640 1 -- 172.21.15.44:0/2268564771 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade80c7320 con 0x7fade80c4bf0 2023-11-04T01:41:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.827+0000 7faded010640 1 -- 172.21.15.44:0/2268564771 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade8074290 con 0x7fade80c4bf0 2023-11-04T01:41:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.827+0000 7faddf7fe640 1 -- 172.21.15.44:0/2268564771 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fadd001d460 con 0x7fade80c4bf0 2023-11-04T01:41:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.828+0000 7faddf7fe640 1 --2- 172.21.15.44:0/2268564771 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fadc806ae70 0x7fadc806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.828+0000 7faddf7fe640 1 -- 172.21.15.44:0/2268564771 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7fadd0089c80 con 0x7fade80c4bf0 2023-11-04T01:41:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.828+0000 7fade6d9d640 1 --2- 172.21.15.44:0/2268564771 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fadc806ae70 0x7fadc806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.829+0000 7fade6d9d640 1 --2- 172.21.15.44:0/2268564771 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fadc806ae70 0x7fadc806d330 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fadd8006fd0 tx=0x7fadd8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:05.832+0000 7faddf7fe640 1 -- 172.21.15.44:0/2268564771 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fadd0058120 con 0x7fade80c4bf0 2023-11-04T01:41:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:06.051+0000 7faded010640 1 -- 172.21.15.44:0/2268564771 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fade806d840 con 0x7fade80c4bf0 2023-11-04T01:41:06.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:06.051+0000 7faddf7fe640 1 -- 172.21.15.44:0/2268564771 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4140 (secure 0 0 0) 0x7fadd0057cb0 con 0x7fade80c4bf0 2023-11-04T01:41:06.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:06.077 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":71,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:05.700655+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7797,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7797":{"gid":7797,"name":"a","rank":0,"incarnation":71,"state":"up:replay","state_seq":1,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:06.078 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 71 2023-11-04T01:41:06.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:06.053+0000 7faded010640 1 -- 172.21.15.44:0/2268564771 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fadc806ae70 msgr2=0x7fadc806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:06.053+0000 7faded010640 1 --2- 172.21.15.44:0/2268564771 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fadc806ae70 0x7fadc806d330 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fadd8006fd0 tx=0x7fadd8008040 comp rx=0 tx=0).stop 2023-11-04T01:41:06.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:06.053+0000 7faded010640 1 -- 172.21.15.44:0/2268564771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fade80c4bf0 msgr2=0x7fade80a9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:06.053+0000 7faded010640 1 --2- 172.21.15.44:0/2268564771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fade80c4bf0 0x7fade80a9b90 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fadd000e7d0 tx=0x7fadd000ec90 comp rx=0 tx=0).stop 2023-11-04T01:41:06.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:06.053+0000 7faded010640 1 -- 172.21.15.44:0/2268564771 shutdown_connections 2023-11-04T01:41:06.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:06.053+0000 7faded010640 1 --2- 172.21.15.44:0/2268564771 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fadc806ae70 0x7fadc806d330 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:06.053+0000 7faded010640 1 --2- 172.21.15.44:0/2268564771 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fade80aa0d0 0x7fade81ee4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:06.053+0000 7faded010640 1 --2- 172.21.15.44:0/2268564771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fade80c4bf0 0x7fade80a9b90 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:06.053+0000 7faded010640 1 --2- 172.21.15.44:0/2268564771 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadd4006f10 0x7fade81468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:06.053+0000 7faded010640 1 -- 172.21.15.44:0/2268564771 >> 172.21.15.44:0/2268564771 conn(0x7fade80ce950 msgr2=0x7fade80cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:06.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:06.053+0000 7faded010640 1 -- 172.21.15.44:0/2268564771 shutdown_connections 2023-11-04T01:41:06.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:06.053+0000 7faded010640 1 -- 172.21.15.44:0/2268564771 wait complete. 2023-11-04T01:41:06.079 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:41:06.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-04T01:41:11.080 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:11.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.197+0000 7f5fffc44640 1 Processor -- start 2023-11-04T01:41:11.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.197+0000 7f5fffc44640 1 -- start start 2023-11-04T01:41:11.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5fffc44640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ff80ce370 0x7f5ff806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5fffc44640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff806e060 con 0x7f5ff80b0ae0 2023-11-04T01:41:11.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5fffc44640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff80b4110 con 0x7f5ff8159c70 2023-11-04T01:41:11.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5fffc44640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80b49b0 con 0x7f5ff80ce370 2023-11-04T01:41:11.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5ffd1df640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5ff80b0ae0 0x7f5ff815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44178/0 (socket says 172.21.15.44:44178) 2023-11-04T01:41:11.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5ffd1df640 1 -- 172.21.15.44:0/1667716246 learned_addr learned my addr 172.21.15.44:0/1667716246 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:11.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5ffe1e1640 1 --2- 172.21.15.44:0/1667716246 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ff80ce370 0x7f5ff806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994040456 0 0) 0x7f5ff806e060 con 0x7f5ff80b0ae0 2023-11-04T01:41:11.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe4003520 con 0x7f5ff80b0ae0 2023-11-04T01:41:11.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942793159 0 0) 0x7f5ff80b4110 con 0x7f5ff8159c70 2023-11-04T01:41:11.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff806e060 con 0x7f5ff8159c70 2023-11-04T01:41:11.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3000846784 0 0) 0x7f5fe4003520 con 0x7f5ff80b0ae0 2023-11-04T01:41:11.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ff80ce370 msgr2=0x7f5ff806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:11.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5ffc9de640 1 --2- 172.21.15.44:0/1667716246 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ff80ce370 0x7f5ff806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 >> v1:172.21.15.204:6789/0 conn(0x7f5ff8159c70 legacy=0x7f5ff80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.198+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff80b43f0 con 0x7f5ff80b0ae0 2023-11-04T01:41:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f5fe8001670 con 0x7f5ff80b0ae0 2023-11-04T01:41:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 >> v1:172.21.15.44:6789/0 conn(0x7f5ff80b0ae0 legacy=0x7f5ff815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffc9de640 1 --2- 172.21.15.44:0/1667716246 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ff80ce370 0x7f5fe4003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffc9de640 1 --2- 172.21.15.44:0/1667716246 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fe4004070 0x7f5fe40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffc9de640 1 --2- 172.21.15.44:0/1667716246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe4004d00 0x7f5fe4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80b49b0 con 0x7f5fe4004d00 2023-11-04T01:41:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe400ba30 con 0x7f5fe4004070 2023-11-04T01:41:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe400bbf0 con 0x7f5ff80ce370 2023-11-04T01:41:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffe1e1640 1 --2- 172.21.15.44:0/1667716246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe4004d00 0x7f5fe4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffd1df640 1 --2- 172.21.15.44:0/1667716246 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fe4004070 0x7f5fe40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffd9e0640 1 --2- 172.21.15.44:0/1667716246 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ff80ce370 0x7f5fe4003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffe1e1640 1 -- 172.21.15.44:0/1667716246 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ff80ce370 msgr2=0x7f5fe4003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffe1e1640 1 --2- 172.21.15.44:0/1667716246 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ff80ce370 0x7f5fe4003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffe1e1640 1 -- 172.21.15.44:0/1667716246 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fe4004070 msgr2=0x7f5fe40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:11.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffe1e1640 1 --2- 172.21.15.44:0/1667716246 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fe4004070 0x7f5fe40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.199+0000 7f5ffe1e1640 1 -- 172.21.15.44:0/1667716246 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe4003520 con 0x7f5fe4004d00 2023-11-04T01:41:11.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.200+0000 7f5ffe1e1640 1 --2- 172.21.15.44:0/1667716246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe4004d00 0x7f5fe4005180 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009fc0 tx=0x7f5fe40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4bfe460518b655 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.200+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff002cc20 con 0x7f5fe4004d00 2023-11-04T01:41:11.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.200+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff000f040 con 0x7f5fe4004d00 2023-11-04T01:41:11.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.200+0000 7f5ffc9de640 1 -- 172.21.15.44:0/1667716246 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0034440 con 0x7f5fe4004d00 2023-11-04T01:41:11.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.201+0000 7f5fffc44640 1 -- 172.21.15.44:0/1667716246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe4004d00 msgr2=0x7f5fe4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.201+0000 7f5fffc44640 1 --2- 172.21.15.44:0/1667716246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe4004d00 0x7f5fe4005180 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009fc0 tx=0x7f5fe40057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.201+0000 7f5ffe1e1640 1 -- 172.21.15.44:0/1667716246 reap_dead start 2023-11-04T01:41:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.201+0000 7f5fffc44640 1 -- 172.21.15.44:0/1667716246 shutdown_connections 2023-11-04T01:41:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.201+0000 7f5fffc44640 1 -- 172.21.15.44:0/1667716246 >> 172.21.15.44:0/1667716246 conn(0x7f5ff80ce950 msgr2=0x7f5ff80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.201+0000 7f5fffc44640 1 -- 172.21.15.44:0/1667716246 shutdown_connections 2023-11-04T01:41:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.201+0000 7f5fffc44640 1 -- 172.21.15.44:0/1667716246 wait complete. 2023-11-04T01:41:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.202+0000 7f5fffc44640 1 Processor -- start 2023-11-04T01:41:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.202+0000 7f5fffc44640 1 -- start start 2023-11-04T01:41:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5fffc44640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe4004d00 0x7f5ff815cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5fffc44640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ff814fcd0 0x7f5ff814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5fffc44640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ff8153bc0 0x7f5ff8154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5fffc44640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff8154590 con 0x7f5fe4004d00 2023-11-04T01:41:11.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5fffc44640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff815d130 con 0x7f5ff814fcd0 2023-11-04T01:41:11.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5fffc44640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff815b760 con 0x7f5ff8153bc0 2023-11-04T01:41:11.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5ffd9e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe4004d00 0x7f5ff815cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5ffd9e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe4004d00 0x7f5ff815cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55352/0 (socket says 172.21.15.44:55352) 2023-11-04T01:41:11.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5ffd9e0640 1 -- 172.21.15.44:0/117341644 learned_addr learned my addr 172.21.15.44:0/117341644 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:11.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5ffd1df640 1 --2- 172.21.15.44:0/117341644 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ff814fcd0 0x7f5ff814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5ffe1e1640 1 --2- 172.21.15.44:0/117341644 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ff8153bc0 0x7f5ff8154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5ffd9e0640 1 -- 172.21.15.44:0/117341644 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ff8153bc0 msgr2=0x7f5ff8154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5ffd9e0640 1 --2- 172.21.15.44:0/117341644 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ff8153bc0 0x7f5ff8154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5ffd9e0640 1 -- 172.21.15.44:0/117341644 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ff814fcd0 msgr2=0x7f5ff814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5ffd9e0640 1 --2- 172.21.15.44:0/117341644 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ff814fcd0 0x7f5ff814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.203+0000 7f5ffd9e0640 1 -- 172.21.15.44:0/117341644 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff815ba40 con 0x7f5fe4004d00 2023-11-04T01:41:11.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.204+0000 7f5ffd9e0640 1 --2- 172.21.15.44:0/117341644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe4004d00 0x7f5ff815cbf0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400f8b0 tx=0x7f5ff400fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.204+0000 7f5fee7fc640 1 -- 172.21.15.44:0/117341644 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4001560 con 0x7f5fe4004d00 2023-11-04T01:41:11.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.204+0000 7f5fee7fc640 1 -- 172.21.15.44:0/117341644 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff40052e0 con 0x7f5fe4004d00 2023-11-04T01:41:11.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.204+0000 7f5fffc44640 1 -- 172.21.15.44:0/117341644 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff815bd20 con 0x7f5fe4004d00 2023-11-04T01:41:11.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.204+0000 7f5fee7fc640 1 -- 172.21.15.44:0/117341644 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff400d970 con 0x7f5fe4004d00 2023-11-04T01:41:11.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.204+0000 7f5fffc44640 1 -- 172.21.15.44:0/117341644 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff815c2e0 con 0x7f5fe4004d00 2023-11-04T01:41:11.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.205+0000 7f5fffc44640 1 -- 172.21.15.44:0/117341644 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff80c6b10 con 0x7f5fe4004d00 2023-11-04T01:41:11.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.205+0000 7f5fee7fc640 1 -- 172.21.15.44:0/117341644 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ff400dad0 con 0x7f5fe4004d00 2023-11-04T01:41:11.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.206+0000 7f5fee7fc640 1 --2- 172.21.15.44:0/117341644 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5fdc06ae70 0x7f5fdc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.206+0000 7f5fee7fc640 1 -- 172.21.15.44:0/117341644 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7f5ff4089ce0 con 0x7f5fe4004d00 2023-11-04T01:41:11.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.206+0000 7f5ffd1df640 1 --2- 172.21.15.44:0/117341644 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5fdc06ae70 0x7f5fdc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.207+0000 7f5ffd1df640 1 --2- 172.21.15.44:0/117341644 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5fdc06ae70 0x7f5fdc06d330 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5ff81536c0 tx=0x7f5fe8000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.210+0000 7f5fee7fc640 1 -- 172.21.15.44:0/117341644 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5ff80c6b10 con 0x7f5fe4004d00 2023-11-04T01:41:11.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.423+0000 7f5fffc44640 1 -- 172.21.15.44:0/117341644 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ff80c6b10 con 0x7f5fe4004d00 2023-11-04T01:41:11.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.423+0000 7f5fee7fc640 1 -- 172.21.15.44:0/117341644 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f5ff80c6b10 con 0x7f5fe4004d00 2023-11-04T01:41:11.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:11.426 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":75,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:08.717313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7797,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7797":{"gid":7797,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":11,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 75 2023-11-04T01:41:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.425+0000 7f5fffc44640 1 -- 172.21.15.44:0/117341644 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5fdc06ae70 msgr2=0x7f5fdc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.425+0000 7f5fffc44640 1 --2- 172.21.15.44:0/117341644 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5fdc06ae70 0x7f5fdc06d330 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5ff81536c0 tx=0x7f5fe8000ed0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.425+0000 7f5fffc44640 1 -- 172.21.15.44:0/117341644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe4004d00 msgr2=0x7f5ff815cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.425+0000 7f5fffc44640 1 --2- 172.21.15.44:0/117341644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe4004d00 0x7f5ff815cbf0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400f8b0 tx=0x7f5ff400fd70 comp rx=0 tx=0).stop 2023-11-04T01:41:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.425+0000 7f5fffc44640 1 -- 172.21.15.44:0/117341644 shutdown_connections 2023-11-04T01:41:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.425+0000 7f5fffc44640 1 --2- 172.21.15.44:0/117341644 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5fdc06ae70 0x7f5fdc06d330 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.425+0000 7f5fffc44640 1 --2- 172.21.15.44:0/117341644 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ff8153bc0 0x7f5ff8154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.425+0000 7f5fffc44640 1 --2- 172.21.15.44:0/117341644 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ff814fcd0 0x7f5ff814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.425+0000 7f5fffc44640 1 --2- 172.21.15.44:0/117341644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe4004d00 0x7f5ff815cbf0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.425+0000 7f5fffc44640 1 -- 172.21.15.44:0/117341644 >> 172.21.15.44:0/117341644 conn(0x7f5ff80ce950 msgr2=0x7f5ff80b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.425+0000 7f5fffc44640 1 -- 172.21.15.44:0/117341644 shutdown_connections 2023-11-04T01:41:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.425+0000 7f5fffc44640 1 -- 172.21.15.44:0/117341644 wait complete. 2023-11-04T01:41:11.429 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:41:11.427+0000 7f2afb1b3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:11.429 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:41:11.427+0000 7f2afb1b3640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:11.438 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:41:11.438 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:11.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.543+0000 7f8d1634c640 1 Processor -- start 2023-11-04T01:41:11.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.543+0000 7f8d1634c640 1 -- start start 2023-11-04T01:41:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.543+0000 7f8d1634c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8d100cde60 0x7f8d1015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.543+0000 7f8d1634c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d100ce240 0x7f8d100d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.543+0000 7f8d1634c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1015e000 con 0x7f8d1015daa0 2023-11-04T01:41:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.543+0000 7f8d1634c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1015e5c0 con 0x7f8d100cde60 2023-11-04T01:41:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.543+0000 7f8d1634c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1015e2e0 con 0x7f8d100ce240 2023-11-04T01:41:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.544+0000 7f8d0ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8d100cde60 0x7f8d1015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.544+0000 7f8d0f7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8d1015daa0 0x7f8d10157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44192/0 (socket says 172.21.15.44:44192) 2023-11-04T01:41:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.544+0000 7f8d0f7fe640 1 -- 172.21.15.44:0/3219145845 learned_addr learned my addr 172.21.15.44:0/3219145845 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.544+0000 7f8d148e9640 1 --2- 172.21.15.44:0/3219145845 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d100ce240 0x7f8d100d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.544+0000 7f8d0ffff640 1 -- 172.21.15.44:0/3219145845 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d100ce240 msgr2=0x7f8d100d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.544+0000 7f8d0ffff640 1 --2- 172.21.15.44:0/3219145845 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d100ce240 0x7f8d100d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.544+0000 7f8d0ffff640 1 -- 172.21.15.44:0/3219145845 >> v1:172.21.15.44:6789/0 conn(0x7f8d1015daa0 legacy=0x7f8d10157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.544+0000 7f8d0effd640 1 -- 172.21.15.44:0/3219145845 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996068590 0 0) 0x7f8d1015e000 con 0x7f8d1015daa0 2023-11-04T01:41:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.544+0000 7f8d0ffff640 1 -- 172.21.15.44:0/3219145845 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d100d1120 con 0x7f8d100cde60 2023-11-04T01:41:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.544+0000 7f8d148e9640 1 --2- 172.21.15.44:0/3219145845 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d100ce240 0x7f8d100d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:11.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.545+0000 7f8d0ffff640 1 --2- 172.21.15.44:0/3219145845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d100cde60 0x7f8d1015d560 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f8d000097a0 tx=0x7f8d0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1028ab51fb6ccdee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.545+0000 7f8d0effd640 1 -- 172.21.15.44:0/3219145845 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00031830 con 0x7f8d100cde60 2023-11-04T01:41:11.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.545+0000 7f8d0effd640 1 -- 172.21.15.44:0/3219145845 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d00031990 con 0x7f8d100cde60 2023-11-04T01:41:11.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.545+0000 7f8d0effd640 1 -- 172.21.15.44:0/3219145845 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00031d20 con 0x7f8d100cde60 2023-11-04T01:41:11.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.545+0000 7f8d1634c640 1 -- 172.21.15.44:0/3219145845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d100cde60 msgr2=0x7f8d1015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.545+0000 7f8d1634c640 1 --2- 172.21.15.44:0/3219145845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d100cde60 0x7f8d1015d560 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f8d000097a0 tx=0x7f8d0002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.545+0000 7f8d1634c640 1 -- 172.21.15.44:0/3219145845 shutdown_connections 2023-11-04T01:41:11.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.545+0000 7f8d1634c640 1 --2- 172.21.15.44:0/3219145845 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d100ce240 0x7f8d100d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.545+0000 7f8d1634c640 1 --2- 172.21.15.44:0/3219145845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d100cde60 0x7f8d1015d560 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.545+0000 7f8d1634c640 1 -- 172.21.15.44:0/3219145845 >> 172.21.15.44:0/3219145845 conn(0x7f8d10071f30 msgr2=0x7f8d100cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:11.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.545+0000 7f8d1634c640 1 -- 172.21.15.44:0/3219145845 shutdown_connections 2023-11-04T01:41:11.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.545+0000 7f8d1634c640 1 -- 172.21.15.44:0/3219145845 wait complete. 2023-11-04T01:41:11.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.547+0000 7f8d1634c640 1 Processor -- start 2023-11-04T01:41:11.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.547+0000 7f8d1634c640 1 -- start start 2023-11-04T01:41:11.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.547+0000 7f8d1634c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d100cde60 0x7f8d1015ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.547+0000 7f8d1634c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d100ce240 0x7f8d1014d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.547+0000 7f8d1634c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d1015daa0 0x7f8d10157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d1634c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d101584f0 con 0x7f8d100ce240 2023-11-04T01:41:11.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d1634c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d101587d0 con 0x7f8d1015daa0 2023-11-04T01:41:11.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d1634c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d10158ab0 con 0x7f8d100cde60 2023-11-04T01:41:11.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d0f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d100ce240 0x7f8d1014d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d0f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d100ce240 0x7f8d1014d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55382/0 (socket says 172.21.15.44:55382) 2023-11-04T01:41:11.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d0f7fe640 1 -- 172.21.15.44:0/150211465 learned_addr learned my addr 172.21.15.44:0/150211465 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:11.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d148e9640 1 --2- 172.21.15.44:0/150211465 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d1015daa0 0x7f8d10157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d0f7fe640 1 -- 172.21.15.44:0/150211465 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d100cde60 msgr2=0x7f8d1015ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d0f7fe640 1 --2- 172.21.15.44:0/150211465 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d100cde60 0x7f8d1015ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d0f7fe640 1 -- 172.21.15.44:0/150211465 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d1015daa0 msgr2=0x7f8d10157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d0f7fe640 1 --2- 172.21.15.44:0/150211465 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d1015daa0 0x7f8d10157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d0f7fe640 1 -- 172.21.15.44:0/150211465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d00009400 con 0x7f8d100ce240 2023-11-04T01:41:11.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d148e9640 1 --2- 172.21.15.44:0/150211465 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d1015daa0 0x7f8d10157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:11.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d0f7fe640 1 --2- 172.21.15.44:0/150211465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d100ce240 0x7f8d1014d340 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400c410 tx=0x7f8d0400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d0cff9640 1 -- 172.21.15.44:0/150211465 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d040074e0 con 0x7f8d100ce240 2023-11-04T01:41:11.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d0cff9640 1 -- 172.21.15.44:0/150211465 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d04007660 con 0x7f8d100ce240 2023-11-04T01:41:11.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d1634c640 1 -- 172.21.15.44:0/150211465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d10158d90 con 0x7f8d100ce240 2023-11-04T01:41:11.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d0cff9640 1 -- 172.21.15.44:0/150211465 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04004a20 con 0x7f8d100ce240 2023-11-04T01:41:11.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.548+0000 7f8d1634c640 1 -- 172.21.15.44:0/150211465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d10158200 con 0x7f8d100ce240 2023-11-04T01:41:11.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.549+0000 7f8d1634c640 1 -- 172.21.15.44:0/150211465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d101592b0 con 0x7f8d100ce240 2023-11-04T01:41:11.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.550+0000 7f8d0cff9640 1 -- 172.21.15.44:0/150211465 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d04004b80 con 0x7f8d100ce240 2023-11-04T01:41:11.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.550+0000 7f8d0cff9640 1 --2- 172.21.15.44:0/150211465 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8cfc06ae70 0x7f8cfc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.550+0000 7f8d0cff9640 1 -- 172.21.15.44:0/150211465 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7f8d04089a80 con 0x7f8d100ce240 2023-11-04T01:41:11.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.551+0000 7f8d0ffff640 1 --2- 172.21.15.44:0/150211465 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8cfc06ae70 0x7f8cfc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.551+0000 7f8d0ffff640 1 --2- 172.21.15.44:0/150211465 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8cfc06ae70 0x7f8cfc06d330 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8d00036000 tx=0x7f8d00030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.555+0000 7f8d0cff9640 1 -- 172.21.15.44:0/150211465 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d101592b0 con 0x7f8d100ce240 2023-11-04T01:41:11.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.767+0000 7f8d1634c640 1 -- 172.21.15.44:0/150211465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d101592b0 con 0x7f8d100ce240 2023-11-04T01:41:11.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.767+0000 7f8d0cff9640 1 -- 172.21.15.44:0/150211465 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f8d101592b0 con 0x7f8d100ce240 2023-11-04T01:41:11.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:11.769 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":75,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:08.717313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7797,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7797":{"gid":7797,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":11,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:11.770 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 75 2023-11-04T01:41:11.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.769+0000 7f8d1634c640 1 -- 172.21.15.44:0/150211465 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8cfc06ae70 msgr2=0x7f8cfc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.769+0000 7f8d1634c640 1 --2- 172.21.15.44:0/150211465 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8cfc06ae70 0x7f8cfc06d330 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8d00036000 tx=0x7f8d00030000 comp rx=0 tx=0).stop 2023-11-04T01:41:11.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.769+0000 7f8d1634c640 1 -- 172.21.15.44:0/150211465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d100ce240 msgr2=0x7f8d1014d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.769+0000 7f8d1634c640 1 --2- 172.21.15.44:0/150211465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d100ce240 0x7f8d1014d340 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400c410 tx=0x7f8d0400c8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.769+0000 7f8d1634c640 1 -- 172.21.15.44:0/150211465 shutdown_connections 2023-11-04T01:41:11.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.769+0000 7f8d1634c640 1 --2- 172.21.15.44:0/150211465 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8cfc06ae70 0x7f8cfc06d330 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.769+0000 7f8d1634c640 1 --2- 172.21.15.44:0/150211465 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d1015daa0 0x7f8d10157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.769+0000 7f8d1634c640 1 --2- 172.21.15.44:0/150211465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d100ce240 0x7f8d1014d340 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.769+0000 7f8d1634c640 1 --2- 172.21.15.44:0/150211465 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d100cde60 0x7f8d1015ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.769+0000 7f8d1634c640 1 -- 172.21.15.44:0/150211465 >> 172.21.15.44:0/150211465 conn(0x7f8d10071f30 msgr2=0x7f8d100b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:11.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.769+0000 7f8d1634c640 1 -- 172.21.15.44:0/150211465 shutdown_connections 2023-11-04T01:41:11.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:11.769+0000 7f8d1634c640 1 -- 172.21.15.44:0/150211465 wait complete. 2023-11-04T01:41:12.185 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:29.920595+0000', 'modified': '2023-11-04T01:41:08.717313+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7797, 'mds_1': 7344}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7344': {'gid': 7344, 'name': 'c', 'rank': 1, 'incarnation': 49, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.44:6834/2069525699', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 2069525699}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 2069525699}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7797': {'gid': 7797, 'name': 'a', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.44:6835/1627866359', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 1627866359}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 1627866359}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:41:12.185 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:41:12.185 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:41:12.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.294+0000 7f46e06c9640 1 Processor -- start 2023-11-04T01:41:12.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.294+0000 7f46e06c9640 1 -- start start 2023-11-04T01:41:12.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.295+0000 7f46e06c9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f46d8153e60 0x7f46d815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.295+0000 7f46e06c9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f46d80cd6d0 0x7f46d8161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.295+0000 7f46e06c9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d80cde60 con 0x7f46d80b4880 2023-11-04T01:41:12.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.295+0000 7f46e06c9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d8160f90 con 0x7f46d8153e60 2023-11-04T01:41:12.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.295+0000 7f46e06c9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d815e400 con 0x7f46d80cd6d0 2023-11-04T01:41:12.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.296+0000 7f46de465640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f46d8153e60 0x7f46d815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.296+0000 7f46de465640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f46d8153e60 0x7f46d815dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55390/0 (socket says 172.21.15.44:55390) 2023-11-04T01:41:12.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.296+0000 7f46de465640 1 -- 172.21.15.44:0/1436835123 learned_addr learned my addr 172.21.15.44:0/1436835123 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:12.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.296+0000 7f46ddc64640 1 --2- 172.21.15.44:0/1436835123 >> v2:172.21.15.204:3300/0 conn(0x7f46d80cd6d0 0x7f46d8161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.296+0000 7f46de465640 1 -- 172.21.15.44:0/1436835123 >> v2:172.21.15.204:3300/0 conn(0x7f46d80cd6d0 msgr2=0x7f46d8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.296+0000 7f46de465640 1 --2- 172.21.15.44:0/1436835123 >> v2:172.21.15.204:3300/0 conn(0x7f46d80cd6d0 0x7f46d8161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.296+0000 7f46de465640 1 -- 172.21.15.44:0/1436835123 >> v1:172.21.15.204:6789/0 conn(0x7f46d80b4880 legacy=0x7f46d806b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.296+0000 7f46de465640 1 -- 172.21.15.44:0/1436835123 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d8161960 con 0x7f46d8153e60 2023-11-04T01:41:12.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.297+0000 7f46de465640 1 --2- 172.21.15.44:0/1436835123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46d8153e60 0x7f46d815dec0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f46d80c9e80 tx=0x7f46d402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa1958ab43c71d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.297+0000 7f46dd463640 1 -- 172.21.15.44:0/1436835123 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4031870 con 0x7f46d8153e60 2023-11-04T01:41:12.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.297+0000 7f46dd463640 1 -- 172.21.15.44:0/1436835123 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d40319d0 con 0x7f46d8153e60 2023-11-04T01:41:12.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.297+0000 7f46dd463640 1 -- 172.21.15.44:0/1436835123 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4031d60 con 0x7f46d8153e60 2023-11-04T01:41:12.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.297+0000 7f46e06c9640 1 -- 172.21.15.44:0/1436835123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46d8153e60 msgr2=0x7f46d815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.297+0000 7f46e06c9640 1 --2- 172.21.15.44:0/1436835123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46d8153e60 0x7f46d815dec0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f46d80c9e80 tx=0x7f46d402b910 comp rx=0 tx=0).stop 2023-11-04T01:41:12.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.297+0000 7f46e06c9640 1 -- 172.21.15.44:0/1436835123 shutdown_connections 2023-11-04T01:41:12.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.298+0000 7f46e06c9640 1 --2- 172.21.15.44:0/1436835123 >> v2:172.21.15.204:3300/0 conn(0x7f46d80cd6d0 0x7f46d8161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.298+0000 7f46e06c9640 1 --2- 172.21.15.44:0/1436835123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46d8153e60 0x7f46d815dec0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.298+0000 7f46e06c9640 1 -- 172.21.15.44:0/1436835123 >> 172.21.15.44:0/1436835123 conn(0x7f46d80cf880 msgr2=0x7f46d80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.298+0000 7f46e06c9640 1 -- 172.21.15.44:0/1436835123 shutdown_connections 2023-11-04T01:41:12.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.298+0000 7f46e06c9640 1 -- 172.21.15.44:0/1436835123 wait complete. 2023-11-04T01:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.299+0000 7f46e06c9640 1 Processor -- start 2023-11-04T01:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.299+0000 7f46e06c9640 1 -- start start 2023-11-04T01:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.299+0000 7f46e06c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46d80b4880 0x7f46d80b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.299+0000 7f46e06c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46d80cd6d0 0x7f46d80cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.299+0000 7f46e06c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46d8153e60 0x7f46d815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.299+0000 7f46e06c9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d80cc290 con 0x7f46d8153e60 2023-11-04T01:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.299+0000 7f46e06c9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d8154240 con 0x7f46d80cd6d0 2023-11-04T01:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.299+0000 7f46e06c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d8154520 con 0x7f46d80b4880 2023-11-04T01:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46dec66640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46d8153e60 0x7f46d815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46dec66640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46d8153e60 0x7f46d815ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55392/0 (socket says 172.21.15.44:55392) 2023-11-04T01:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46dec66640 1 -- 172.21.15.44:0/3696840208 learned_addr learned my addr 172.21.15.44:0/3696840208 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46ddc64640 1 --2- 172.21.15.44:0/3696840208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46d80cd6d0 0x7f46d80cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46de465640 1 --2- 172.21.15.44:0/3696840208 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46d80b4880 0x7f46d80b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46dec66640 1 -- 172.21.15.44:0/3696840208 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46d80b4880 msgr2=0x7f46d80b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46dec66640 1 --2- 172.21.15.44:0/3696840208 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46d80b4880 0x7f46d80b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46dec66640 1 -- 172.21.15.44:0/3696840208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46d80cd6d0 msgr2=0x7f46d80cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46dec66640 1 --2- 172.21.15.44:0/3696840208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46d80cd6d0 0x7f46d80cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46dec66640 1 -- 172.21.15.44:0/3696840208 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d40094d0 con 0x7f46d8153e60 2023-11-04T01:41:12.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46dec66640 1 --2- 172.21.15.44:0/3696840208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46d8153e60 0x7f46d815ba70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f46d000c780 tx=0x7f46d000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46ceffd640 1 -- 172.21.15.44:0/3696840208 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0004b60 con 0x7f46d8153e60 2023-11-04T01:41:12.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46ceffd640 1 -- 172.21.15.44:0/3696840208 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d000ce90 con 0x7f46d8153e60 2023-11-04T01:41:12.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46e06c9640 1 -- 172.21.15.44:0/3696840208 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d8154800 con 0x7f46d8153e60 2023-11-04T01:41:12.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46ceffd640 1 -- 172.21.15.44:0/3696840208 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000a850 con 0x7f46d8153e60 2023-11-04T01:41:12.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.300+0000 7f46e06c9640 1 -- 172.21.15.44:0/3696840208 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d80b77d0 con 0x7f46d8153e60 2023-11-04T01:41:12.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.302+0000 7f46ceffd640 1 -- 172.21.15.44:0/3696840208 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f46d000a9b0 con 0x7f46d8153e60 2023-11-04T01:41:12.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.302+0000 7f46ceffd640 1 --2- 172.21.15.44:0/3696840208 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f46bc06aea0 0x7f46bc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.302+0000 7f46ceffd640 1 -- 172.21.15.44:0/3696840208 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7f46d0089d90 con 0x7f46d8153e60 2023-11-04T01:41:12.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.302+0000 7f46de465640 1 --2- 172.21.15.44:0/3696840208 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f46bc06aea0 0x7f46bc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.303+0000 7f46de465640 1 --2- 172.21.15.44:0/3696840208 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f46bc06aea0 0x7f46bc06d360 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f46d4036000 tx=0x7f46d403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.303+0000 7f46e325a740 1 Processor -- start 2023-11-04T01:41:12.306 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.303+0000 7f46e325a740 1 -- start start 2023-11-04T01:41:12.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.304+0000 7f46e325a740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcae850 0x556a6fc81750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.304+0000 7f46e325a740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcaec30 0x556a6fcb15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.304+0000 7f46e325a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fc81c90 0x556a6fcb1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.304+0000 7f46e325a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a6fb92740 con 0x556a6fc81c90 2023-11-04T01:41:12.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.304+0000 7f46e325a740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a6fbf48d0 con 0x556a6fcae850 2023-11-04T01:41:12.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.304+0000 7f46e325a740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a6fbf1fc0 con 0x556a6fcaec30 2023-11-04T01:41:12.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.304+0000 7f46dec66640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fc81c90 0x556a6fcb1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.304+0000 7f46dec66640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fc81c90 0x556a6fcb1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55394/0 (socket says 172.21.15.44:55394) 2023-11-04T01:41:12.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.304+0000 7f46dec66640 1 -- 172.21.15.44:0/2881407305 learned_addr learned my addr 172.21.15.44:0/2881407305 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:12.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.304+0000 7f46ddc64640 1 --2- 172.21.15.44:0/2881407305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcaec30 0x556a6fcb15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.304+0000 7f46de465640 1 --2- 172.21.15.44:0/2881407305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcae850 0x556a6fc81750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.304+0000 7f46dec66640 1 -- 172.21.15.44:0/2881407305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcaec30 msgr2=0x556a6fcb15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.304+0000 7f46dec66640 1 --2- 172.21.15.44:0/2881407305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcaec30 0x556a6fcb15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.304+0000 7f46dec66640 1 -- 172.21.15.44:0/2881407305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcae850 msgr2=0x556a6fc81750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.305+0000 7f46dec66640 1 --2- 172.21.15.44:0/2881407305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcae850 0x556a6fc81750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.305+0000 7f46dec66640 1 -- 172.21.15.44:0/2881407305 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a6fbb0ca0 con 0x556a6fc81c90 2023-11-04T01:41:12.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.305+0000 7f46dec66640 1 --2- 172.21.15.44:0/2881407305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fc81c90 0x556a6fcb1b20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f46d00549f0 tx=0x7f46d0058bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c089a20f15b9db52 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.305+0000 7f46bbfff640 1 -- 172.21.15.44:0/2881407305 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0085070 con 0x556a6fc81c90 2023-11-04T01:41:12.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.305+0000 7f46bbfff640 1 -- 172.21.15.44:0/2881407305 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d00607f0 con 0x556a6fc81c90 2023-11-04T01:41:12.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.305+0000 7f46bbfff640 1 -- 172.21.15.44:0/2881407305 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0056890 con 0x556a6fc81c90 2023-11-04T01:41:12.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.305+0000 7f46e325a740 1 -- 172.21.15.44:0/2881407305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fc81c90 msgr2=0x556a6fcb1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.305+0000 7f46e325a740 1 --2- 172.21.15.44:0/2881407305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fc81c90 0x556a6fcb1b20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f46d00549f0 tx=0x7f46d0058bf0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.305+0000 7f46e325a740 1 -- 172.21.15.44:0/2881407305 shutdown_connections 2023-11-04T01:41:12.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.305+0000 7f46e325a740 1 --2- 172.21.15.44:0/2881407305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fc81c90 0x556a6fcb1b20 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.305+0000 7f46e325a740 1 --2- 172.21.15.44:0/2881407305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcaec30 0x556a6fcb15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.305+0000 7f46e325a740 1 --2- 172.21.15.44:0/2881407305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcae850 0x556a6fc81750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.305+0000 7f46e325a740 1 -- 172.21.15.44:0/2881407305 >> 172.21.15.44:0/2881407305 conn(0x556a6fc83a60 msgr2=0x556a6fccc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.306+0000 7f46e325a740 1 -- 172.21.15.44:0/2881407305 shutdown_connections 2023-11-04T01:41:12.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.306+0000 7f46e325a740 1 -- 172.21.15.44:0/2881407305 wait complete. 2023-11-04T01:41:12.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.306+0000 7f46e325a740 1 -- start start 2023-11-04T01:41:12.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.306+0000 7f46e325a740 1 Processor -- start 2023-11-04T01:41:12.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.307+0000 7f46e325a740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcae850 0x556a6fcabdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.307+0000 7f46e325a740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcaec30 0x556a6fcb4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.307+0000 7f46e325a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcc4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.307+0000 7f46e325a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a6fbed8b0 con 0x556a6fcb5270 2023-11-04T01:41:12.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.307+0000 7f46e325a740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a6fba7c80 con 0x556a6fcaec30 2023-11-04T01:41:12.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.307+0000 7f46e325a740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a6fba7920 con 0x556a6fcae850 2023-11-04T01:41:12.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.307+0000 7f46e325a740 10 client.0 _ll_register_callbacks cb 0x556a6f8ffac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:12.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.307+0000 7f46dec66640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcc4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.307+0000 7f46dec66640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcc4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55408/0 (socket says 172.21.15.44:55408) 2023-11-04T01:41:12.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.307+0000 7f46dec66640 1 -- 172.21.15.44:0/3202269349 learned_addr learned my addr 172.21.15.44:0/3202269349 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:12.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.307+0000 7f46de465640 1 --2- 172.21.15.44:0/3202269349 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcae850 0x556a6fcabdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.307+0000 7f46ddc64640 1 --2- 172.21.15.44:0/3202269349 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcaec30 0x556a6fcb4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46dec66640 1 -- 172.21.15.44:0/3202269349 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcae850 msgr2=0x556a6fcabdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46dec66640 1 --2- 172.21.15.44:0/3202269349 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcae850 0x556a6fcabdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46dec66640 1 -- 172.21.15.44:0/3202269349 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcaec30 msgr2=0x556a6fcb4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46dec66640 1 --2- 172.21.15.44:0/3202269349 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcaec30 0x556a6fcb4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46dec66640 1 -- 172.21.15.44:0/3202269349 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d80b77d0 con 0x556a6fcb5270 2023-11-04T01:41:12.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46dec66640 1 --2- 172.21.15.44:0/3202269349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcc4f20 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f46d0087d00 tx=0x7f46d0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862c129b564506f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:41:12.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46b97fa640 1 -- 172.21.15.44:0/3202269349 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0085040 con 0x556a6fcb5270 2023-11-04T01:41:12.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46b97fa640 1 -- 172.21.15.44:0/3202269349 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7f46d000ac60 con 0x556a6fcb5270 2023-11-04T01:41:12.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46e325a740 1 -- 172.21.15.44:0/3202269349 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a6fb99bf0 con 0x556a6fcb5270 2023-11-04T01:41:12.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46b97fa640 1 -- 172.21.15.44:0/3202269349 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46d000ae20 con 0x556a6fcb5270 2023-11-04T01:41:12.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46e325a740 10 client.7944 fetch_fsmap learned FSMap version 75 2023-11-04T01:41:12.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46e325a740 1 -- 172.21.15.44:0/3202269349 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x556a6fbebf30 con 0x556a6fcb5270 2023-11-04T01:41:12.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46b97fa640 1 -- 172.21.15.44:0/3202269349 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a6fb99bf0 con 0x556a6fcb5270 2023-11-04T01:41:12.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46b97fa640 1 -- 172.21.15.44:0/3202269349 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 75) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f46d0019070 con 0x556a6fcb5270 2023-11-04T01:41:12.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46e325a740 10 client.7944 fetch_fsmap finished waiting for FSMap version 75 2023-11-04T01:41:12.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46e325a740 10 client.7944 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:41:12.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46e325a740 20 client.7944 populate_metadata read hostname 'smithi044' 2023-11-04T01:41:12.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46e325a740 1 --2- 172.21.15.44:0/3202269349 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x556a6fce7b70 0x556a6fce9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46e325a740 4 client.7944 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:41:12.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.308+0000 7f46e325a740 1 -- 172.21.15.44:0/3202269349 --> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a6fbe6890 con 0x556a6fce7b70 2023-11-04T01:41:12.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.309+0000 7f46de465640 1 --2- 172.21.15.44:0/3202269349 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x556a6fce7b70 0x556a6fce9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.309+0000 7f46de465640 1 --2- 172.21.15.44:0/3202269349 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x556a6fce7b70 0x556a6fce9f60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f3449e446efb866 server_cookie=a7f623e581878a51 in_seq=0 out_seq=0 2023-11-04T01:41:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.309+0000 7f46b97fa640 10 client.7944 ms_handle_connect on v2:172.21.15.44:6832/2069525699 2023-11-04T01:41:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.309+0000 7f46b97fa640 1 -- 172.21.15.44:0/3202269349 <== mds.1 v2:172.21.15.44:6832/2069525699 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556a6fbe6890 con 0x556a6fce7b70 2023-11-04T01:41:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.309+0000 7f46b97fa640 10 client.7944 handle_command_reply: tid=0 2023-11-04T01:41:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.309+0000 7f46e325a740 1 client.7944 shutdown 2023-11-04T01:41:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.310+0000 7f46e325a740 1 -- 172.21.15.44:0/3202269349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 msgr2=0x556a6fcc4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.310+0000 7f46e325a740 1 --2- 172.21.15.44:0/3202269349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcc4f20 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f46d0087d00 tx=0x7f46d0007f50 comp rx=0 tx=0).stop 2023-11-04T01:41:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.310+0000 7f46e325a740 1 -- 172.21.15.44:0/3202269349 shutdown_connections 2023-11-04T01:41:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.310+0000 7f46e325a740 1 --2- 172.21.15.44:0/3202269349 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x556a6fce7b70 0x556a6fce9f60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.310+0000 7f46e325a740 1 --2- 172.21.15.44:0/3202269349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcc4f20 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.310+0000 7f46b97fa640 0 client.7944 ms_handle_reset on v2:172.21.15.44:6832/2069525699 2023-11-04T01:41:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.310+0000 7f46e325a740 1 --2- 172.21.15.44:0/3202269349 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcaec30 0x556a6fcb4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.310+0000 7f46e325a740 1 --2- 172.21.15.44:0/3202269349 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcae850 0x556a6fcabdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.310+0000 7f46e325a740 1 -- 172.21.15.44:0/3202269349 >> 172.21.15.44:0/3202269349 conn(0x556a6fc81c90 msgr2=0x556a6fc856d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.310+0000 7f46e325a740 1 -- 172.21.15.44:0/3202269349 shutdown_connections 2023-11-04T01:41:12.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.310+0000 7f46e325a740 1 -- 172.21.15.44:0/3202269349 wait complete. 2023-11-04T01:41:12.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.310+0000 7f46e325a740 20 client.7944 trim_cache size 0 max 16384 2023-11-04T01:41:12.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.325+0000 7f46e325a740 1 Processor -- start 2023-11-04T01:41:12.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.325+0000 7f46e325a740 1 -- start start 2023-11-04T01:41:12.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.326+0000 7f46e325a740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcae850 0x556a6fc82a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.326+0000 7f46e325a740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcaec30 0x556a6fc806e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.326+0000 7f46e325a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.326+0000 7f46e325a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a6fb6d280 con 0x556a6fcb5270 2023-11-04T01:41:12.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.326+0000 7f46e325a740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a6fccec00 con 0x556a6fcaec30 2023-11-04T01:41:12.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.326+0000 7f46e325a740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a6fcaf010 con 0x556a6fcae850 2023-11-04T01:41:12.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.326+0000 7f46dec66640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.326+0000 7f46dec66640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55424/0 (socket says 172.21.15.44:55424) 2023-11-04T01:41:12.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.326+0000 7f46dec66640 1 -- 172.21.15.44:0/4117127845 learned_addr learned my addr 172.21.15.44:0/4117127845 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:12.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46ddc64640 1 --2- 172.21.15.44:0/4117127845 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcaec30 0x556a6fc806e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46dec66640 1 -- 172.21.15.44:0/4117127845 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcae850 msgr2=0x556a6fc82a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46dec66640 1 --2- 172.21.15.44:0/4117127845 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcae850 0x556a6fc82a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46dec66640 1 -- 172.21.15.44:0/4117127845 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcaec30 msgr2=0x556a6fc806e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46dec66640 1 --2- 172.21.15.44:0/4117127845 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcaec30 0x556a6fc806e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46dec66640 1 -- 172.21.15.44:0/4117127845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a6fb89d10 con 0x556a6fcb5270 2023-11-04T01:41:12.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46dec66640 1 --2- 172.21.15.44:0/4117127845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcccb10 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f46d000afd0 tx=0x7f46d0072070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6158488e52a8f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46ccff9640 1 -- 172.21.15.44:0/4117127845 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0085070 con 0x556a6fcb5270 2023-11-04T01:41:12.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46ccff9640 1 -- 172.21.15.44:0/4117127845 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d00584f0 con 0x556a6fcb5270 2023-11-04T01:41:12.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46ccff9640 1 -- 172.21.15.44:0/4117127845 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000ac60 con 0x556a6fcb5270 2023-11-04T01:41:12.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46e325a740 1 -- 172.21.15.44:0/4117127845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 msgr2=0x556a6fcccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46e325a740 1 --2- 172.21.15.44:0/4117127845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcccb10 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f46d000afd0 tx=0x7f46d0072070 comp rx=0 tx=0).stop 2023-11-04T01:41:12.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46e325a740 1 -- 172.21.15.44:0/4117127845 shutdown_connections 2023-11-04T01:41:12.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46e325a740 1 --2- 172.21.15.44:0/4117127845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcccb10 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46e325a740 1 --2- 172.21.15.44:0/4117127845 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcaec30 0x556a6fc806e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46e325a740 1 --2- 172.21.15.44:0/4117127845 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcae850 0x556a6fc82a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46e325a740 1 -- 172.21.15.44:0/4117127845 >> 172.21.15.44:0/4117127845 conn(0x556a6fc81c90 msgr2=0x556a6fc7cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.327+0000 7f46e325a740 1 -- 172.21.15.44:0/4117127845 shutdown_connections 2023-11-04T01:41:12.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.328+0000 7f46e325a740 1 -- 172.21.15.44:0/4117127845 wait complete. 2023-11-04T01:41:12.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.328+0000 7f46e325a740 1 -- start start 2023-11-04T01:41:12.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.328+0000 7f46e325a740 1 Processor -- start 2023-11-04T01:41:12.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46e325a740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcae850 0x556a6fd38db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46e325a740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcaec30 0x556a6fcedf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46e325a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcee4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46e325a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a6fcc9a90 con 0x556a6fcb5270 2023-11-04T01:41:12.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46e325a740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a6fcc22a0 con 0x556a6fcaec30 2023-11-04T01:41:12.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46e325a740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a6fcc24f0 con 0x556a6fcae850 2023-11-04T01:41:12.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46e325a740 10 client.0 _ll_register_callbacks cb 0x7f46d00582c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:12.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46dec66640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcee4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46dec66640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcee4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55434/0 (socket says 172.21.15.44:55434) 2023-11-04T01:41:12.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46dec66640 1 -- 172.21.15.44:0/1133247052 learned_addr learned my addr 172.21.15.44:0/1133247052 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:12.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46de465640 1 --2- 172.21.15.44:0/1133247052 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcae850 0x556a6fd38db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46ddc64640 1 --2- 172.21.15.44:0/1133247052 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcaec30 0x556a6fcedf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46dec66640 1 -- 172.21.15.44:0/1133247052 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcae850 msgr2=0x556a6fd38db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46dec66640 1 --2- 172.21.15.44:0/1133247052 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcae850 0x556a6fd38db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46dec66640 1 -- 172.21.15.44:0/1133247052 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcaec30 msgr2=0x556a6fcedf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46dec66640 1 --2- 172.21.15.44:0/1133247052 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcaec30 0x556a6fcedf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.329+0000 7f46dec66640 1 -- 172.21.15.44:0/1133247052 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a6fbebf30 con 0x556a6fcb5270 2023-11-04T01:41:12.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46dec66640 1 --2- 172.21.15.44:0/1133247052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcee4c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f46d000c750 tx=0x7f46d006f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405783abe1ae1aab server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:41:12.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46b97fa640 1 -- 172.21.15.44:0/1133247052 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0081c90 con 0x556a6fcb5270 2023-11-04T01:41:12.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46b97fa640 1 -- 172.21.15.44:0/1133247052 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7f46d00579e0 con 0x556a6fcb5270 2023-11-04T01:41:12.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46e325a740 1 -- 172.21.15.44:0/1133247052 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a6fbe65b0 con 0x556a6fcb5270 2023-11-04T01:41:12.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46b97fa640 1 -- 172.21.15.44:0/1133247052 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46d0057ba0 con 0x556a6fcb5270 2023-11-04T01:41:12.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46e325a740 10 client.7950 fetch_fsmap learned FSMap version 75 2023-11-04T01:41:12.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46e325a740 1 -- 172.21.15.44:0/1133247052 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x556a6fbaf500 con 0x556a6fcb5270 2023-11-04T01:41:12.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46b97fa640 1 -- 172.21.15.44:0/1133247052 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a6fbe65b0 con 0x556a6fcb5270 2023-11-04T01:41:12.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46b97fa640 1 -- 172.21.15.44:0/1133247052 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 75) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f46d0019040 con 0x556a6fcb5270 2023-11-04T01:41:12.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46e325a740 10 client.7950 fetch_fsmap finished waiting for FSMap version 75 2023-11-04T01:41:12.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46e325a740 10 client.7950 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:41:12.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46e325a740 20 client.7950 populate_metadata read hostname 'smithi044' 2023-11-04T01:41:12.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46e325a740 1 --2- 172.21.15.44:0/1133247052 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x556a6fcda440 0x556a6fcda820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46e325a740 4 client.7950 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:41:12.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46e325a740 1 -- 172.21.15.44:0/1133247052 --> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556a6f8ee6c0 con 0x556a6fcda440 2023-11-04T01:41:12.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.330+0000 7f46de465640 1 --2- 172.21.15.44:0/1133247052 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x556a6fcda440 0x556a6fcda820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46b97fa640 10 client.7950 ms_handle_connect on v2:172.21.15.44:6832/2069525699 2023-11-04T01:41:12.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46de465640 1 --2- 172.21.15.44:0/1133247052 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x556a6fcda440 0x556a6fcda820 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=661543f963efc1ee server_cookie=7a997290f5fd16ea in_seq=0 out_seq=0 2023-11-04T01:41:12.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46b97fa640 1 -- 172.21.15.44:0/1133247052 <== mds.1 v2:172.21.15.44:6832/2069525699 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x556a6f8ee6c0 con 0x556a6fcda440 2023-11-04T01:41:12.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46b97fa640 10 client.7950 handle_command_reply: tid=0 2023-11-04T01:41:12.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46e325a740 1 client.7950 shutdown 2023-11-04T01:41:12.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46e325a740 1 -- 172.21.15.44:0/1133247052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 msgr2=0x556a6fcee4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46e325a740 1 --2- 172.21.15.44:0/1133247052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcee4c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f46d000c750 tx=0x7f46d006f000 comp rx=0 tx=0).stop 2023-11-04T01:41:12.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46e325a740 1 -- 172.21.15.44:0/1133247052 shutdown_connections 2023-11-04T01:41:12.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46e325a740 1 --2- 172.21.15.44:0/1133247052 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x556a6fcda440 0x556a6fcda820 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46e325a740 1 --2- 172.21.15.44:0/1133247052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556a6fcb5270 0x556a6fcee4c0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46e325a740 1 --2- 172.21.15.44:0/1133247052 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556a6fcaec30 0x556a6fcedf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46e325a740 1 --2- 172.21.15.44:0/1133247052 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556a6fcae850 0x556a6fd38db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46b97fa640 0 client.7950 ms_handle_reset on v2:172.21.15.44:6832/2069525699 2023-11-04T01:41:12.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46e325a740 1 -- 172.21.15.44:0/1133247052 >> 172.21.15.44:0/1133247052 conn(0x556a6fc81c90 msgr2=0x556a6fc81390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46e325a740 1 -- 172.21.15.44:0/1133247052 shutdown_connections 2023-11-04T01:41:12.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46e325a740 1 -- 172.21.15.44:0/1133247052 wait complete. 2023-11-04T01:41:12.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.331+0000 7f46e325a740 20 client.7950 trim_cache size 0 max 16384 2023-11-04T01:41:12.339 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:41:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:41:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 1, 2023-11-04T01:41:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7344, 2023-11-04T01:41:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:41:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:41:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:41:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 91.965869233999996, 2023-11-04T01:41:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 75, 2023-11-04T01:41:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 101, 2023-11-04T01:41:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 101, 2023-11-04T01:41:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 107.825208187 2023-11-04T01:41:12.340 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:41:12.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.332+0000 7f46e06c9640 1 -- 172.21.15.44:0/3696840208 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f46bc06aea0 msgr2=0x7f46bc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.332+0000 7f46e06c9640 1 --2- 172.21.15.44:0/3696840208 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f46bc06aea0 0x7f46bc06d360 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f46d4036000 tx=0x7f46d403c040 comp rx=0 tx=0).stop 2023-11-04T01:41:12.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.332+0000 7f46e06c9640 1 -- 172.21.15.44:0/3696840208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46d8153e60 msgr2=0x7f46d815ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.341 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.332+0000 7f46e06c9640 1 --2- 172.21.15.44:0/3696840208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46d8153e60 0x7f46d815ba70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f46d000c780 tx=0x7f46d000cc40 comp rx=0 tx=0).stop 2023-11-04T01:41:12.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.332+0000 7f46e06c9640 1 -- 172.21.15.44:0/3696840208 shutdown_connections 2023-11-04T01:41:12.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.332+0000 7f46e06c9640 1 --2- 172.21.15.44:0/3696840208 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f46bc06aea0 0x7f46bc06d360 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.332+0000 7f46e06c9640 1 --2- 172.21.15.44:0/3696840208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46d8153e60 0x7f46d815ba70 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.332+0000 7f46e06c9640 1 --2- 172.21.15.44:0/3696840208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46d80cd6d0 0x7f46d80cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.332+0000 7f46e06c9640 1 --2- 172.21.15.44:0/3696840208 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46d80b4880 0x7f46d80b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.332+0000 7f46e06c9640 1 -- 172.21.15.44:0/3696840208 >> 172.21.15.44:0/3696840208 conn(0x7f46d80cf880 msgr2=0x7f46d815fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.332+0000 7f46e06c9640 1 -- 172.21.15.44:0/3696840208 shutdown_connections 2023-11-04T01:41:12.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.332+0000 7f46e06c9640 1 -- 172.21.15.44:0/3696840208 wait complete. 2023-11-04T01:41:12.344 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:41:12.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.448+0000 7f2f8b701640 1 Processor -- start 2023-11-04T01:41:12.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.448+0000 7f2f8b701640 1 -- start start 2023-11-04T01:41:12.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.449+0000 7f2f8b701640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f84153e60 0x7f2f8415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.449+0000 7f2f8b701640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2f840cd6d0 0x7f2f84161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.449+0000 7f2f8b701640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f840cde60 con 0x7f2f840b4880 2023-11-04T01:41:12.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.449+0000 7f2f8b701640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f84160f90 con 0x7f2f840cd6d0 2023-11-04T01:41:12.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.449+0000 7f2f8b701640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8415e400 con 0x7f2f84153e60 2023-11-04T01:41:12.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.449+0000 7f2f88c9c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2f840cd6d0 0x7f2f84161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.449+0000 7f2f88c9c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2f840cd6d0 0x7f2f84161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55440/0 (socket says 172.21.15.44:55440) 2023-11-04T01:41:12.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.449+0000 7f2f88c9c640 1 -- 172.21.15.44:0/284428525 learned_addr learned my addr 172.21.15.44:0/284428525 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:12.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.449+0000 7f2f8949d640 1 --2- 172.21.15.44:0/284428525 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f84153e60 0x7f2f8415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.450+0000 7f2f88c9c640 1 -- 172.21.15.44:0/284428525 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f84153e60 msgr2=0x7f2f8415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.450+0000 7f2f88c9c640 1 --2- 172.21.15.44:0/284428525 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f84153e60 0x7f2f8415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.450+0000 7f2f88c9c640 1 -- 172.21.15.44:0/284428525 >> v1:172.21.15.204:6789/0 conn(0x7f2f840b4880 legacy=0x7f2f8406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.450+0000 7f2f88c9c640 1 -- 172.21.15.44:0/284428525 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f84161960 con 0x7f2f840cd6d0 2023-11-04T01:41:12.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.450+0000 7f2f88c9c640 1 --2- 172.21.15.44:0/284428525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f840cd6d0 0x7f2f84161420 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009870 tx=0x7f2f7802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca64d9991c839152 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.451+0000 7f2f83fff640 1 -- 172.21.15.44:0/284428525 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78030840 con 0x7f2f840cd6d0 2023-11-04T01:41:12.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.451+0000 7f2f83fff640 1 -- 172.21.15.44:0/284428525 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f780309a0 con 0x7f2f840cd6d0 2023-11-04T01:41:12.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.451+0000 7f2f83fff640 1 -- 172.21.15.44:0/284428525 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78030d30 con 0x7f2f840cd6d0 2023-11-04T01:41:12.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.451+0000 7f2f8b701640 1 -- 172.21.15.44:0/284428525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f840cd6d0 msgr2=0x7f2f84161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.451+0000 7f2f8b701640 1 --2- 172.21.15.44:0/284428525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f840cd6d0 0x7f2f84161420 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009870 tx=0x7f2f7802b980 comp rx=0 tx=0).stop 2023-11-04T01:41:12.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.451+0000 7f2f8b701640 1 -- 172.21.15.44:0/284428525 shutdown_connections 2023-11-04T01:41:12.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.451+0000 7f2f8b701640 1 --2- 172.21.15.44:0/284428525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f840cd6d0 0x7f2f84161420 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.451+0000 7f2f8b701640 1 --2- 172.21.15.44:0/284428525 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f84153e60 0x7f2f8415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.451+0000 7f2f8b701640 1 -- 172.21.15.44:0/284428525 >> 172.21.15.44:0/284428525 conn(0x7f2f840cf880 msgr2=0x7f2f840cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.451+0000 7f2f8b701640 1 -- 172.21.15.44:0/284428525 shutdown_connections 2023-11-04T01:41:12.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.451+0000 7f2f8b701640 1 -- 172.21.15.44:0/284428525 wait complete. 2023-11-04T01:41:12.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.452+0000 7f2f8b701640 1 Processor -- start 2023-11-04T01:41:12.456 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.453+0000 7f2f8b701640 1 -- start start 2023-11-04T01:41:12.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.453+0000 7f2f8b701640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f840b4880 0x7f2f840c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.453+0000 7f2f8b701640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f840cd6d0 0x7f2f840cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.453+0000 7f2f8b701640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f84153e60 0x7f2f841f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.453+0000 7f2f8b701640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f84157600 con 0x7f2f840b4880 2023-11-04T01:41:12.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.453+0000 7f2f8b701640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f841f38b0 con 0x7f2f840cd6d0 2023-11-04T01:41:12.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.453+0000 7f2f8b701640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840cc320 con 0x7f2f84153e60 2023-11-04T01:41:12.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.453+0000 7f2f8949d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f840b4880 0x7f2f840c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.453+0000 7f2f8949d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f840b4880 0x7f2f840c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55456/0 (socket says 172.21.15.44:55456) 2023-11-04T01:41:12.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.453+0000 7f2f8949d640 1 -- 172.21.15.44:0/301619988 learned_addr learned my addr 172.21.15.44:0/301619988 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:12.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.454+0000 7f2f88c9c640 1 --2- 172.21.15.44:0/301619988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f840cd6d0 0x7f2f840cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.454+0000 7f2f89c9e640 1 --2- 172.21.15.44:0/301619988 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f84153e60 0x7f2f841f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.454+0000 7f2f8949d640 1 -- 172.21.15.44:0/301619988 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f84153e60 msgr2=0x7f2f841f3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.454+0000 7f2f8949d640 1 --2- 172.21.15.44:0/301619988 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f84153e60 0x7f2f841f3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.454+0000 7f2f8949d640 1 -- 172.21.15.44:0/301619988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f840cd6d0 msgr2=0x7f2f840cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.454+0000 7f2f8949d640 1 --2- 172.21.15.44:0/301619988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f840cd6d0 0x7f2f840cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.454+0000 7f2f8949d640 1 -- 172.21.15.44:0/301619988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f780094d0 con 0x7f2f840b4880 2023-11-04T01:41:12.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.454+0000 7f2f8949d640 1 --2- 172.21.15.44:0/301619988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f840b4880 0x7f2f840c9310 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00e870 tx=0x7f2f7c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.454+0000 7f2f81ffb640 1 -- 172.21.15.44:0/301619988 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0094f0 con 0x7f2f840b4880 2023-11-04T01:41:12.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.454+0000 7f2f81ffb640 1 -- 172.21.15.44:0/301619988 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c00c940 con 0x7f2f840b4880 2023-11-04T01:41:12.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.454+0000 7f2f8b701640 1 -- 172.21.15.44:0/301619988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f840cc600 con 0x7f2f840b4880 2023-11-04T01:41:12.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.454+0000 7f2f81ffb640 1 -- 172.21.15.44:0/301619988 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c00ccf0 con 0x7f2f840b4880 2023-11-04T01:41:12.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.454+0000 7f2f8b701640 1 -- 172.21.15.44:0/301619988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f840ccbc0 con 0x7f2f840b4880 2023-11-04T01:41:12.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.456+0000 7f2f81ffb640 1 -- 172.21.15.44:0/301619988 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f7c013470 con 0x7f2f840b4880 2023-11-04T01:41:12.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.456+0000 7f2f81ffb640 1 --2- 172.21.15.44:0/301619988 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f7006ae70 0x7f2f7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.457+0000 7f2f81ffb640 1 -- 172.21.15.44:0/301619988 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7f2f7c089e50 con 0x7f2f840b4880 2023-11-04T01:41:12.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.457+0000 7f2f88c9c640 1 --2- 172.21.15.44:0/301619988 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f7006ae70 0x7f2f7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.457+0000 7f2f8e368740 1 Processor -- start 2023-11-04T01:41:12.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.457+0000 7f2f88c9c640 1 --2- 172.21.15.44:0/301619988 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f7006ae70 0x7f2f7006d330 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2f78036000 tx=0x7f2f78008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.457+0000 7f2f8e368740 1 -- start start 2023-11-04T01:41:12.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f8e368740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4850 0x55c7d1fc7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f8e368740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4c30 0x55c7d1ff75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f8e368740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1fc7c90 0x55c7d1ff7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f8e368740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7d1ed8740 con 0x55c7d1ff4850 2023-11-04T01:41:12.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f8e368740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7d1f3a8d0 con 0x55c7d1ff4c30 2023-11-04T01:41:12.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f8e368740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7d1f37fc0 con 0x55c7d1fc7c90 2023-11-04T01:41:12.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f8949d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4850 0x55c7d1fc7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f8949d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4850 0x55c7d1fc7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55458/0 (socket says 172.21.15.44:55458) 2023-11-04T01:41:12.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f8949d640 1 -- 172.21.15.44:0/3431419881 learned_addr learned my addr 172.21.15.44:0/3431419881 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:12.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f88c9c640 1 --2- 172.21.15.44:0/3431419881 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4c30 0x55c7d1ff75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f89c9e640 1 --2- 172.21.15.44:0/3431419881 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1fc7c90 0x55c7d1ff7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f8949d640 1 -- 172.21.15.44:0/3431419881 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1fc7c90 msgr2=0x55c7d1ff7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f8949d640 1 --2- 172.21.15.44:0/3431419881 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1fc7c90 0x55c7d1ff7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.463 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f8949d640 1 -- 172.21.15.44:0/3431419881 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4c30 msgr2=0x55c7d1ff75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f8949d640 1 --2- 172.21.15.44:0/3431419881 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4c30 0x55c7d1ff75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f8949d640 1 -- 172.21.15.44:0/3431419881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7d1ef6ca0 con 0x55c7d1ff4850 2023-11-04T01:41:12.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.458+0000 7f2f89c9e640 1 --2- 172.21.15.44:0/3431419881 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1fc7c90 0x55c7d1ff7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:12.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.459+0000 7f2f8949d640 1 --2- 172.21.15.44:0/3431419881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4850 0x55c7d1fc7750 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0549a0 tx=0x7f2f7c058110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13758a66c604b22 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.459+0000 7f2f6affd640 1 -- 172.21.15.44:0/3431419881 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0607a0 con 0x55c7d1ff4850 2023-11-04T01:41:12.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.459+0000 7f2f6affd640 1 -- 172.21.15.44:0/3431419881 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c056840 con 0x55c7d1ff4850 2023-11-04T01:41:12.465 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.459+0000 7f2f6affd640 1 -- 172.21.15.44:0/3431419881 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c05c170 con 0x55c7d1ff4850 2023-11-04T01:41:12.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.459+0000 7f2f8e368740 1 -- 172.21.15.44:0/3431419881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4850 msgr2=0x55c7d1fc7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.459+0000 7f2f8e368740 1 --2- 172.21.15.44:0/3431419881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4850 0x55c7d1fc7750 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0549a0 tx=0x7f2f7c058110 comp rx=0 tx=0).stop 2023-11-04T01:41:12.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.459+0000 7f2f8e368740 1 -- 172.21.15.44:0/3431419881 shutdown_connections 2023-11-04T01:41:12.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.459+0000 7f2f8e368740 1 --2- 172.21.15.44:0/3431419881 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1fc7c90 0x55c7d1ff7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.459+0000 7f2f8e368740 1 --2- 172.21.15.44:0/3431419881 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4c30 0x55c7d1ff75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.459+0000 7f2f8e368740 1 --2- 172.21.15.44:0/3431419881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4850 0x55c7d1fc7750 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.459+0000 7f2f8e368740 1 -- 172.21.15.44:0/3431419881 >> 172.21.15.44:0/3431419881 conn(0x55c7d1fc9a60 msgr2=0x55c7d20125e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.459+0000 7f2f8e368740 1 -- 172.21.15.44:0/3431419881 shutdown_connections 2023-11-04T01:41:12.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.459+0000 7f2f8e368740 1 -- 172.21.15.44:0/3431419881 wait complete. 2023-11-04T01:41:12.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.460+0000 7f2f8e368740 1 -- start start 2023-11-04T01:41:12.466 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.460+0000 7f2f8e368740 1 Processor -- start 2023-11-04T01:41:12.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f8e368740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4850 0x55c7d200fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f8e368740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4c30 0x55c7d1ff9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f8e368740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff9e90 0x55c7d20126c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f8e368740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7d1f338b0 con 0x55c7d1ff4c30 2023-11-04T01:41:12.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f8e368740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7d1eedc80 con 0x55c7d1ff4850 2023-11-04T01:41:12.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f8e368740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7d1eed920 con 0x55c7d1ff9e90 2023-11-04T01:41:12.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f8e368740 10 client.0 _ll_register_callbacks cb 0x55c7d1c45ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:12.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f88c9c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4c30 0x55c7d1ff9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f88c9c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4c30 0x55c7d1ff9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55462/0 (socket says 172.21.15.44:55462) 2023-11-04T01:41:12.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f88c9c640 1 -- 172.21.15.44:0/2557595191 learned_addr learned my addr 172.21.15.44:0/2557595191 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:12.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f8949d640 1 --2- 172.21.15.44:0/2557595191 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4850 0x55c7d200fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f89c9e640 1 --2- 172.21.15.44:0/2557595191 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff9e90 0x55c7d20126c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f88c9c640 1 -- 172.21.15.44:0/2557595191 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff9e90 msgr2=0x55c7d20126c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f88c9c640 1 --2- 172.21.15.44:0/2557595191 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff9e90 0x55c7d20126c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f88c9c640 1 -- 172.21.15.44:0/2557595191 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4850 msgr2=0x55c7d200fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f88c9c640 1 --2- 172.21.15.44:0/2557595191 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4850 0x55c7d200fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.461+0000 7f2f88c9c640 1 -- 172.21.15.44:0/2557595191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f840ccbc0 con 0x55c7d1ff4c30 2023-11-04T01:41:12.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f88c9c640 1 --2- 172.21.15.44:0/2557595191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4c30 0x55c7d1ff9950 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009990 tx=0x7f2f7802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacf3ebbed0512be server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f63fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:41:12.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f63fff640 1 -- 172.21.15.44:0/2557595191 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7804a040 con 0x55c7d1ff4c30 2023-11-04T01:41:12.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f63fff640 1 -- 172.21.15.44:0/2557595191 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7f2f7803e040 con 0x55c7d1ff4c30 2023-11-04T01:41:12.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f8e368740 1 -- 172.21.15.44:0/2557595191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7d1edfbf0 con 0x55c7d1ff4c30 2023-11-04T01:41:12.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f63fff640 1 -- 172.21.15.44:0/2557595191 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f78039e70 con 0x55c7d1ff4c30 2023-11-04T01:41:12.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f8e368740 10 client.7962 fetch_fsmap learned FSMap version 75 2023-11-04T01:41:12.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f8e368740 1 -- 172.21.15.44:0/2557595191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55c7d1f31f30 con 0x55c7d1ff4c30 2023-11-04T01:41:12.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f63fff640 1 -- 172.21.15.44:0/2557595191 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c7d1edfbf0 con 0x55c7d1ff4c30 2023-11-04T01:41:12.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f63fff640 1 -- 172.21.15.44:0/2557595191 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 75) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f2f78042050 con 0x55c7d1ff4c30 2023-11-04T01:41:12.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f8e368740 10 client.7962 fetch_fsmap finished waiting for FSMap version 75 2023-11-04T01:41:12.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f8e368740 10 client.7962 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:41:12.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f8e368740 20 client.7962 populate_metadata read hostname 'smithi044' 2023-11-04T01:41:12.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f8e368740 1 --2- 172.21.15.44:0/2557595191 >> [v2:172.21.15.44:6833/1627866359,v1:172.21.15.44:6835/1627866359] conn(0x55c7d200dfd0 0x55c7d200e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f8e368740 4 client.7962 mds_command: new command op to 7797 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:41:12.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f8e368740 1 -- 172.21.15.44:0/2557595191 --> [v2:172.21.15.44:6833/1627866359,v1:172.21.15.44:6835/1627866359] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7d1f2c890 con 0x55c7d200dfd0 2023-11-04T01:41:12.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.462+0000 7f2f8949d640 1 --2- 172.21.15.44:0/2557595191 >> [v2:172.21.15.44:6833/1627866359,v1:172.21.15.44:6835/1627866359] conn(0x55c7d200dfd0 0x55c7d200e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.463+0000 7f2f63fff640 10 client.7962 ms_handle_connect on v2:172.21.15.44:6833/1627866359 2023-11-04T01:41:12.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.463+0000 7f2f8949d640 1 --2- 172.21.15.44:0/2557595191 >> [v2:172.21.15.44:6833/1627866359,v1:172.21.15.44:6835/1627866359] conn(0x55c7d200dfd0 0x55c7d200e3b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=344293212c892371 server_cookie=e48c952780fa107d in_seq=0 out_seq=0 2023-11-04T01:41:12.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.463+0000 7f2f63fff640 1 -- 172.21.15.44:0/2557595191 <== mds.0 v2:172.21.15.44:6833/1627866359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c7d1f2c890 con 0x55c7d200dfd0 2023-11-04T01:41:12.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.463+0000 7f2f63fff640 10 client.7962 handle_command_reply: tid=0 2023-11-04T01:41:12.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.463+0000 7f2f8e368740 1 client.7962 shutdown 2023-11-04T01:41:12.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.463+0000 7f2f8e368740 1 -- 172.21.15.44:0/2557595191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4c30 msgr2=0x55c7d1ff9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.463+0000 7f2f8e368740 1 --2- 172.21.15.44:0/2557595191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4c30 0x55c7d1ff9950 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009990 tx=0x7f2f7802e000 comp rx=0 tx=0).stop 2023-11-04T01:41:12.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.463+0000 7f2f8e368740 1 -- 172.21.15.44:0/2557595191 shutdown_connections 2023-11-04T01:41:12.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.463+0000 7f2f8e368740 1 --2- 172.21.15.44:0/2557595191 >> [v2:172.21.15.44:6833/1627866359,v1:172.21.15.44:6835/1627866359] conn(0x55c7d200dfd0 0x55c7d200e3b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.463+0000 7f2f8e368740 1 --2- 172.21.15.44:0/2557595191 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff9e90 0x55c7d20126c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.463+0000 7f2f63fff640 0 client.7962 ms_handle_reset on v2:172.21.15.44:6833/1627866359 2023-11-04T01:41:12.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.463+0000 7f2f8e368740 1 --2- 172.21.15.44:0/2557595191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4c30 0x55c7d1ff9950 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.463+0000 7f2f8e368740 1 --2- 172.21.15.44:0/2557595191 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4850 0x55c7d200fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.463+0000 7f2f8e368740 1 -- 172.21.15.44:0/2557595191 >> 172.21.15.44:0/2557595191 conn(0x55c7d1fc7c90 msgr2=0x55c7d1fcb600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.464+0000 7f2f8e368740 1 -- 172.21.15.44:0/2557595191 shutdown_connections 2023-11-04T01:41:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.464+0000 7f2f8e368740 1 -- 172.21.15.44:0/2557595191 wait complete. 2023-11-04T01:41:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.464+0000 7f2f8e368740 20 client.7962 trim_cache size 0 max 16384 2023-11-04T01:41:12.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.479+0000 7f2f8e368740 1 Processor -- start 2023-11-04T01:41:12.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.479+0000 7f2f8e368740 1 -- start start 2023-11-04T01:41:12.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.480+0000 7f2f8e368740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4850 0x55c7d1fcb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.480+0000 7f2f8e368740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4c30 0x55c7d1fcb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.480+0000 7f2f8e368740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff9e90 0x55c7d1fc7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.480+0000 7f2f8e368740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7d1eb3280 con 0x55c7d1ff4850 2023-11-04T01:41:12.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.480+0000 7f2f8e368740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7d1fcdca0 con 0x55c7d1ff4c30 2023-11-04T01:41:12.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.480+0000 7f2f8e368740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7d200c090 con 0x55c7d1ff9e90 2023-11-04T01:41:12.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.480+0000 7f2f8949d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4850 0x55c7d1fcb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.480+0000 7f2f8949d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4850 0x55c7d1fcb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55464/0 (socket says 172.21.15.44:55464) 2023-11-04T01:41:12.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.480+0000 7f2f8949d640 1 -- 172.21.15.44:0/60911231 learned_addr learned my addr 172.21.15.44:0/60911231 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:12.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.480+0000 7f2f88c9c640 1 --2- 172.21.15.44:0/60911231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4c30 0x55c7d1fcb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.484 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f89c9e640 1 --2- 172.21.15.44:0/60911231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff9e90 0x55c7d1fc7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f8949d640 1 -- 172.21.15.44:0/60911231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff9e90 msgr2=0x55c7d1fc7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f8949d640 1 --2- 172.21.15.44:0/60911231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff9e90 0x55c7d1fc7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f8949d640 1 -- 172.21.15.44:0/60911231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4c30 msgr2=0x55c7d1fcb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f8949d640 1 --2- 172.21.15.44:0/60911231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4c30 0x55c7d1fcb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f8949d640 1 -- 172.21.15.44:0/60911231 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7d1ecfd10 con 0x55c7d1ff4850 2023-11-04T01:41:12.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f88c9c640 1 --2- 172.21.15.44:0/60911231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4c30 0x55c7d1fcb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:12.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f89c9e640 1 --2- 172.21.15.44:0/60911231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff9e90 0x55c7d1fc7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:12.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f8949d640 1 --2- 172.21.15.44:0/60911231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4850 0x55c7d1fcb350 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c05c7b0 tx=0x7f2f7c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8b4329f9a3bc4c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f6b7fe640 1 -- 172.21.15.44:0/60911231 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c060820 con 0x55c7d1ff4850 2023-11-04T01:41:12.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f6b7fe640 1 -- 172.21.15.44:0/60911231 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c054bb0 con 0x55c7d1ff4850 2023-11-04T01:41:12.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f6b7fe640 1 -- 172.21.15.44:0/60911231 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c05c370 con 0x55c7d1ff4850 2023-11-04T01:41:12.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f8e368740 1 -- 172.21.15.44:0/60911231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4850 msgr2=0x55c7d1fcb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f8e368740 1 --2- 172.21.15.44:0/60911231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4850 0x55c7d1fcb350 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c05c7b0 tx=0x7f2f7c01e000 comp rx=0 tx=0).stop 2023-11-04T01:41:12.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f8e368740 1 -- 172.21.15.44:0/60911231 shutdown_connections 2023-11-04T01:41:12.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f8e368740 1 --2- 172.21.15.44:0/60911231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff9e90 0x55c7d1fc7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f8e368740 1 --2- 172.21.15.44:0/60911231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4c30 0x55c7d1fcb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f8e368740 1 --2- 172.21.15.44:0/60911231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff4850 0x55c7d1fcb350 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f8e368740 1 -- 172.21.15.44:0/60911231 >> 172.21.15.44:0/60911231 conn(0x55c7d1fc7c90 msgr2=0x55c7d2012f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f8e368740 1 -- 172.21.15.44:0/60911231 shutdown_connections 2023-11-04T01:41:12.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.481+0000 7f2f8e368740 1 -- 172.21.15.44:0/60911231 wait complete. 2023-11-04T01:41:12.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.482+0000 7f2f8e368740 1 -- start start 2023-11-04T01:41:12.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.482+0000 7f2f8e368740 1 Processor -- start 2023-11-04T01:41:12.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f8e368740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4850 0x55c7d1fc6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f8e368740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff4c30 0x55c7d1fcb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f8e368740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff9e90 0x55c7d1fcb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f8e368740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7d200e4d0 con 0x55c7d1ff9e90 2023-11-04T01:41:12.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f8e368740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7d200fe50 con 0x55c7d1ff4850 2023-11-04T01:41:12.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f8e368740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7d2022680 con 0x55c7d1ff4c30 2023-11-04T01:41:12.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f8e368740 10 client.0 _ll_register_callbacks cb 0x7f2f7c0547e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:12.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f89c9e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff9e90 0x55c7d1fcb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f89c9e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff9e90 0x55c7d1fcb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55476/0 (socket says 172.21.15.44:55476) 2023-11-04T01:41:12.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f89c9e640 1 -- 172.21.15.44:0/3370359141 learned_addr learned my addr 172.21.15.44:0/3370359141 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:12.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f8949d640 1 --2- 172.21.15.44:0/3370359141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4850 0x55c7d1fc6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f88c9c640 1 --2- 172.21.15.44:0/3370359141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff4c30 0x55c7d1fcb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f89c9e640 1 -- 172.21.15.44:0/3370359141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff4c30 msgr2=0x55c7d1fcb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f89c9e640 1 --2- 172.21.15.44:0/3370359141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff4c30 0x55c7d1fcb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f89c9e640 1 -- 172.21.15.44:0/3370359141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4850 msgr2=0x55c7d1fc6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f89c9e640 1 --2- 172.21.15.44:0/3370359141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4850 0x55c7d1fc6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f89c9e640 1 -- 172.21.15.44:0/3370359141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7d1ef6ca0 con 0x55c7d1ff9e90 2023-11-04T01:41:12.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f8949d640 1 --2- 172.21.15.44:0/3370359141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4850 0x55c7d1fc6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:12.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f89c9e640 1 --2- 172.21.15.44:0/3370359141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff9e90 0x55c7d1fcb890 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f2f84154880 tx=0x7f2f74011760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14efca3941cc3840 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.483+0000 7f2f63fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:41:12.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.484+0000 7f2f63fff640 1 -- 172.21.15.44:0/3370359141 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74003b80 con 0x55c7d1ff9e90 2023-11-04T01:41:12.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.484+0000 7f2f63fff640 1 -- 172.21.15.44:0/3370359141 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7f2f74003ce0 con 0x55c7d1ff9e90 2023-11-04T01:41:12.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.484+0000 7f2f8e368740 1 -- 172.21.15.44:0/3370359141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f7c056840 con 0x55c7d1ff9e90 2023-11-04T01:41:12.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.484+0000 7f2f63fff640 1 -- 172.21.15.44:0/3370359141 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f74001680 con 0x55c7d1ff9e90 2023-11-04T01:41:12.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.484+0000 7f2f8e368740 10 client.7968 fetch_fsmap learned FSMap version 75 2023-11-04T01:41:12.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.484+0000 7f2f8e368740 1 -- 172.21.15.44:0/3370359141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55c7d1ef5500 con 0x55c7d1ff9e90 2023-11-04T01:41:12.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.484+0000 7f2f63fff640 1 -- 172.21.15.44:0/3370359141 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c056840 con 0x55c7d1ff9e90 2023-11-04T01:41:12.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.484+0000 7f2f63fff640 1 -- 172.21.15.44:0/3370359141 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 75) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f2f740050d0 con 0x55c7d1ff9e90 2023-11-04T01:41:12.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.484+0000 7f2f8e368740 10 client.7968 fetch_fsmap finished waiting for FSMap version 75 2023-11-04T01:41:12.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.484+0000 7f2f8e368740 10 client.7968 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:41:12.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.484+0000 7f2f8e368740 20 client.7968 populate_metadata read hostname 'smithi044' 2023-11-04T01:41:12.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.484+0000 7f2f8e368740 1 --2- 172.21.15.44:0/3370359141 >> [v2:172.21.15.44:6833/1627866359,v1:172.21.15.44:6835/1627866359] conn(0x55c7d2013f50 0x55c7d2021340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.484+0000 7f2f8e368740 4 client.7968 mds_command: new command op to 7797 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:41:12.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.484+0000 7f2f8e368740 1 -- 172.21.15.44:0/3370359141 --> [v2:172.21.15.44:6833/1627866359,v1:172.21.15.44:6835/1627866359] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c7d1f2c5b0 con 0x55c7d2013f50 2023-11-04T01:41:12.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.484+0000 7f2f8949d640 1 --2- 172.21.15.44:0/3370359141 >> [v2:172.21.15.44:6833/1627866359,v1:172.21.15.44:6835/1627866359] conn(0x55c7d2013f50 0x55c7d2021340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f63fff640 10 client.7968 ms_handle_connect on v2:172.21.15.44:6833/1627866359 2023-11-04T01:41:12.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f8949d640 1 --2- 172.21.15.44:0/3370359141 >> [v2:172.21.15.44:6833/1627866359,v1:172.21.15.44:6835/1627866359] conn(0x55c7d2013f50 0x55c7d2021340 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f35c46b0910386e server_cookie=9f4114a0d660c870 in_seq=0 out_seq=0 2023-11-04T01:41:12.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f63fff640 1 -- 172.21.15.44:0/3370359141 <== mds.0 v2:172.21.15.44:6833/1627866359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55c7d1f2c5b0 con 0x55c7d2013f50 2023-11-04T01:41:12.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f63fff640 10 client.7968 handle_command_reply: tid=0 2023-11-04T01:41:12.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f8e368740 1 client.7968 shutdown 2023-11-04T01:41:12.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f8e368740 1 -- 172.21.15.44:0/3370359141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff9e90 msgr2=0x55c7d1fcb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f8e368740 1 --2- 172.21.15.44:0/3370359141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff9e90 0x55c7d1fcb890 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f2f84154880 tx=0x7f2f74011760 comp rx=0 tx=0).stop 2023-11-04T01:41:12.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f8e368740 1 -- 172.21.15.44:0/3370359141 shutdown_connections 2023-11-04T01:41:12.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f8e368740 1 --2- 172.21.15.44:0/3370359141 >> [v2:172.21.15.44:6833/1627866359,v1:172.21.15.44:6835/1627866359] conn(0x55c7d2013f50 0x55c7d2021340 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f8e368740 1 --2- 172.21.15.44:0/3370359141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c7d1ff9e90 0x55c7d1fcb890 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f8e368740 1 --2- 172.21.15.44:0/3370359141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c7d1ff4c30 0x55c7d1fcb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f63fff640 0 client.7968 ms_handle_reset on v2:172.21.15.44:6833/1627866359 2023-11-04T01:41:12.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f8e368740 1 --2- 172.21.15.44:0/3370359141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c7d1ff4850 0x55c7d1fc6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f8e368740 1 -- 172.21.15.44:0/3370359141 >> 172.21.15.44:0/3370359141 conn(0x55c7d1fc7c90 msgr2=0x55c7d1ffb530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f8e368740 1 -- 172.21.15.44:0/3370359141 shutdown_connections 2023-11-04T01:41:12.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f8e368740 1 -- 172.21.15.44:0/3370359141 wait complete. 2023-11-04T01:41:12.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.485+0000 7f2f8e368740 20 client.7968 trim_cache size 0 max 16384 2023-11-04T01:41:12.494 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:41:12.494 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:41:12.494 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2023-11-04T01:41:12.494 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7797, 2023-11-04T01:41:12.494 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:41:12.495 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:41:12.495 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:41:12.495 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 6.7823835260000003, 2023-11-04T01:41:12.495 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 75, 2023-11-04T01:41:12.495 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 101, 2023-11-04T01:41:12.495 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 101, 2023-11-04T01:41:12.495 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 31.973482489999999 2023-11-04T01:41:12.495 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:41:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.486+0000 7f2f8b701640 1 -- 172.21.15.44:0/301619988 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f7006ae70 msgr2=0x7f2f7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.486+0000 7f2f8b701640 1 --2- 172.21.15.44:0/301619988 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f7006ae70 0x7f2f7006d330 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2f78036000 tx=0x7f2f78008030 comp rx=0 tx=0).stop 2023-11-04T01:41:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.486+0000 7f2f8b701640 1 -- 172.21.15.44:0/301619988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f840b4880 msgr2=0x7f2f840c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.486+0000 7f2f8b701640 1 --2- 172.21.15.44:0/301619988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f840b4880 0x7f2f840c9310 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00e870 tx=0x7f2f7c00ed30 comp rx=0 tx=0).stop 2023-11-04T01:41:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.486+0000 7f2f8b701640 1 -- 172.21.15.44:0/301619988 shutdown_connections 2023-11-04T01:41:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.486+0000 7f2f8b701640 1 --2- 172.21.15.44:0/301619988 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f7006ae70 0x7f2f7006d330 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.486+0000 7f2f8b701640 1 --2- 172.21.15.44:0/301619988 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f84153e60 0x7f2f841f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.486+0000 7f2f8b701640 1 --2- 172.21.15.44:0/301619988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f840cd6d0 0x7f2f840cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.486+0000 7f2f8b701640 1 --2- 172.21.15.44:0/301619988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f840b4880 0x7f2f840c9310 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.486+0000 7f2f8b701640 1 -- 172.21.15.44:0/301619988 >> 172.21.15.44:0/301619988 conn(0x7f2f840cf880 msgr2=0x7f2f8415faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.486+0000 7f2f8b701640 1 -- 172.21.15.44:0/301619988 shutdown_connections 2023-11-04T01:41:12.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.486+0000 7f2f8b701640 1 -- 172.21.15.44:0/301619988 wait complete. 2023-11-04T01:41:12.498 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:12.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.602+0000 7fe526bf5640 1 Processor -- start 2023-11-04T01:41:12.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.602+0000 7fe526bf5640 1 -- start start 2023-11-04T01:41:12.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.603+0000 7fe526bf5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe520159c70 0x7fe5200ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.603+0000 7fe526bf5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe52006db20 0x7fe5200b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.603+0000 7fe526bf5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5200b4110 con 0x7fe5200b0910 2023-11-04T01:41:12.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.603+0000 7fe526bf5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5200b49b0 con 0x7fe520159c70 2023-11-04T01:41:12.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.603+0000 7fe526bf5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200b0da0 con 0x7fe52006db20 2023-11-04T01:41:12.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.603+0000 7fe524991640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe520159c70 0x7fe5200ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.603+0000 7fe525192640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe5200b0910 0x7fe52015d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58680/0 (socket says 172.21.15.44:58680) 2023-11-04T01:41:12.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.603+0000 7fe525192640 1 -- 172.21.15.44:0/903166611 learned_addr learned my addr 172.21.15.44:0/903166611 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:12.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.603+0000 7fe51ffff640 1 --2- 172.21.15.44:0/903166611 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe52006db20 0x7fe5200b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.603+0000 7fe524991640 1 -- 172.21.15.44:0/903166611 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe52006db20 msgr2=0x7fe5200b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.603+0000 7fe524991640 1 --2- 172.21.15.44:0/903166611 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe52006db20 0x7fe5200b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.603+0000 7fe524991640 1 -- 172.21.15.44:0/903166611 >> v1:172.21.15.44:6789/0 conn(0x7fe5200b0910 legacy=0x7fe52015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.603+0000 7fe51f7fe640 1 -- 172.21.15.44:0/903166611 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261121773 0 0) 0x7fe5200b4110 con 0x7fe5200b0910 2023-11-04T01:41:12.606 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.603+0000 7fe524991640 1 -- 172.21.15.44:0/903166611 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5200b43f0 con 0x7fe520159c70 2023-11-04T01:41:12.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.604+0000 7fe524991640 1 --2- 172.21.15.44:0/903166611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe520159c70 0x7fe5200ce370 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fe5140097a0 tx=0x7fe51402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a0b5f109919fb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.604+0000 7fe51f7fe640 1 -- 172.21.15.44:0/903166611 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe514031830 con 0x7fe520159c70 2023-11-04T01:41:12.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.604+0000 7fe51f7fe640 1 -- 172.21.15.44:0/903166611 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe514031990 con 0x7fe520159c70 2023-11-04T01:41:12.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.604+0000 7fe51f7fe640 1 -- 172.21.15.44:0/903166611 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe514031d20 con 0x7fe520159c70 2023-11-04T01:41:12.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.604+0000 7fe526bf5640 1 -- 172.21.15.44:0/903166611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe520159c70 msgr2=0x7fe5200ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.604+0000 7fe526bf5640 1 --2- 172.21.15.44:0/903166611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe520159c70 0x7fe5200ce370 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fe5140097a0 tx=0x7fe51402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.605+0000 7fe526bf5640 1 -- 172.21.15.44:0/903166611 shutdown_connections 2023-11-04T01:41:12.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.605+0000 7fe526bf5640 1 --2- 172.21.15.44:0/903166611 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe52006db20 0x7fe5200b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.605+0000 7fe526bf5640 1 --2- 172.21.15.44:0/903166611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe520159c70 0x7fe5200ce370 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.605+0000 7fe526bf5640 1 -- 172.21.15.44:0/903166611 >> 172.21.15.44:0/903166611 conn(0x7fe5200ce950 msgr2=0x7fe5200ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.605+0000 7fe526bf5640 1 -- 172.21.15.44:0/903166611 shutdown_connections 2023-11-04T01:41:12.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.605+0000 7fe526bf5640 1 -- 172.21.15.44:0/903166611 wait complete. 2023-11-04T01:41:12.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.606+0000 7fe526bf5640 1 Processor -- start 2023-11-04T01:41:12.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.606+0000 7fe526bf5640 1 -- start start 2023-11-04T01:41:12.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe526bf5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe52006db20 0x7fe520154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe526bf5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5200b0910 0x7fe5201f7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe526bf5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe520159c70 0x7fe520153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe526bf5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe520153a00 con 0x7fe5200b0910 2023-11-04T01:41:12.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe526bf5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5201f7540 con 0x7fe52006db20 2023-11-04T01:41:12.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe526bf5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe520152d80 con 0x7fe520159c70 2023-11-04T01:41:12.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe51ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5200b0910 0x7fe5201f7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe51ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5200b0910 0x7fe5201f7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56654/0 (socket says 172.21.15.44:56654) 2023-11-04T01:41:12.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe51ffff640 1 -- 172.21.15.44:0/1265384559 learned_addr learned my addr 172.21.15.44:0/1265384559 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:12.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe51ffff640 1 -- 172.21.15.44:0/1265384559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe520159c70 msgr2=0x7fe520153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe51ffff640 1 --2- 172.21.15.44:0/1265384559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe520159c70 0x7fe520153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe51ffff640 1 -- 172.21.15.44:0/1265384559 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe52006db20 msgr2=0x7fe520154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe51ffff640 1 --2- 172.21.15.44:0/1265384559 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe52006db20 0x7fe520154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe51ffff640 1 -- 172.21.15.44:0/1265384559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe514009400 con 0x7fe5200b0910 2023-11-04T01:41:12.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe51ffff640 1 --2- 172.21.15.44:0/1265384559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5200b0910 0x7fe5201f7000 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00d620 tx=0x7fe50c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe51d7fa640 1 -- 172.21.15.44:0/1265384559 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c00b620 con 0x7fe5200b0910 2023-11-04T01:41:12.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe51d7fa640 1 -- 172.21.15.44:0/1265384559 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c00b780 con 0x7fe5200b0910 2023-11-04T01:41:12.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe51d7fa640 1 -- 172.21.15.44:0/1265384559 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c00bb30 con 0x7fe5200b0910 2023-11-04T01:41:12.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe526bf5640 1 -- 172.21.15.44:0/1265384559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe520153060 con 0x7fe5200b0910 2023-11-04T01:41:12.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.607+0000 7fe526bf5640 1 -- 172.21.15.44:0/1265384559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe520153620 con 0x7fe5200b0910 2023-11-04T01:41:12.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.608+0000 7fe526bf5640 1 -- 172.21.15.44:0/1265384559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe520074290 con 0x7fe5200b0910 2023-11-04T01:41:12.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.609+0000 7fe51d7fa640 1 -- 172.21.15.44:0/1265384559 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe50c00bc90 con 0x7fe5200b0910 2023-11-04T01:41:12.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.609+0000 7fe51d7fa640 1 --2- 172.21.15.44:0/1265384559 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe50406ae70 0x7fe50406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.609+0000 7fe51d7fa640 1 -- 172.21.15.44:0/1265384559 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7fe50c08a0d0 con 0x7fe5200b0910 2023-11-04T01:41:12.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.609+0000 7fe524991640 1 --2- 172.21.15.44:0/1265384559 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe50406ae70 0x7fe50406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.610+0000 7fe524991640 1 --2- 172.21.15.44:0/1265384559 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe50406ae70 0x7fe50406d330 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe514036000 tx=0x7fe514030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.614+0000 7fe51d7fa640 1 -- 172.21.15.44:0/1265384559 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe50c054b70 con 0x7fe5200b0910 2023-11-04T01:41:12.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.824+0000 7fe526bf5640 1 -- 172.21.15.44:0/1265384559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe52006d3f0 con 0x7fe5200b0910 2023-11-04T01:41:12.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.825+0000 7fe51d7fa640 1 -- 172.21.15.44:0/1265384559 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fe50c058190 con 0x7fe5200b0910 2023-11-04T01:41:12.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:12.827 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":75,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:08.717313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7797,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7797":{"gid":7797,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":11,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:12.827 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 75 2023-11-04T01:41:12.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.826+0000 7fe526bf5640 1 -- 172.21.15.44:0/1265384559 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe50406ae70 msgr2=0x7fe50406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.826+0000 7fe526bf5640 1 --2- 172.21.15.44:0/1265384559 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe50406ae70 0x7fe50406d330 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe514036000 tx=0x7fe514030000 comp rx=0 tx=0).stop 2023-11-04T01:41:12.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.827+0000 7fe526bf5640 1 -- 172.21.15.44:0/1265384559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5200b0910 msgr2=0x7fe5201f7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.827+0000 7fe526bf5640 1 --2- 172.21.15.44:0/1265384559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5200b0910 0x7fe5201f7000 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00d620 tx=0x7fe50c00dae0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.827+0000 7fe526bf5640 1 -- 172.21.15.44:0/1265384559 shutdown_connections 2023-11-04T01:41:12.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.827+0000 7fe526bf5640 1 --2- 172.21.15.44:0/1265384559 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe50406ae70 0x7fe50406d330 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.827+0000 7fe526bf5640 1 --2- 172.21.15.44:0/1265384559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe520159c70 0x7fe520153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.827+0000 7fe526bf5640 1 --2- 172.21.15.44:0/1265384559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5200b0910 0x7fe5201f7000 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.827+0000 7fe526bf5640 1 --2- 172.21.15.44:0/1265384559 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe52006db20 0x7fe520154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.827+0000 7fe526bf5640 1 -- 172.21.15.44:0/1265384559 >> 172.21.15.44:0/1265384559 conn(0x7fe5200ce950 msgr2=0x7fe5200b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.827+0000 7fe526bf5640 1 -- 172.21.15.44:0/1265384559 shutdown_connections 2023-11-04T01:41:12.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:12.827+0000 7fe526bf5640 1 -- 172.21.15.44:0/1265384559 wait complete. 2023-11-04T01:41:12.839 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:41:12.958 INFO:teuthology.orchestra.run.smithi044.stdout:{"last_snap":4,"last_created":4,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:39:52.563500+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:40:23.215578+0000","name":"s12","metadata":{}},{"snapid":4,"ino":1099511627777,"stamp":"2023-11-04T01:40:48.607516+0000","name":"s15","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:41:12.959 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 4, "last_destroyed": 1, "last_snap": 4, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:39:52.563500+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:40:23.215578+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s15", "snapid": 4, "stamp": "2023-11-04T01:40:48.607516+0000" } ] } 2023-11-04T01:41:12.959 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:41:12.959 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=6 2023-11-04T01:41:12.959 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:13.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.063+0000 7f5ae1034640 1 Processor -- start 2023-11-04T01:41:13.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.063+0000 7f5ae1034640 1 -- start start 2023-11-04T01:41:13.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.064+0000 7f5ae1034640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5adc15ad80 0x7f5adc06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.064+0000 7f5ae1034640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5adc0b42c0 0x7f5adc0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.064+0000 7f5ae1034640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc06cd00 con 0x7f5adc0c9c40 2023-11-04T01:41:13.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.064+0000 7f5ae1034640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc0ca020 con 0x7f5adc0b42c0 2023-11-04T01:41:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.064+0000 7f5ae1034640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc06cfa0 con 0x7f5adc15ad80 2023-11-04T01:41:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.064+0000 7f5ada59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5adc0b42c0 0x7f5adc0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.064+0000 7f5ada59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5adc0b42c0 0x7f5adc0c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56664/0 (socket says 172.21.15.44:56664) 2023-11-04T01:41:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.064+0000 7f5ada59c640 1 -- 172.21.15.44:0/300798106 learned_addr learned my addr 172.21.15.44:0/300798106 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.064+0000 7f5ada59c640 1 -- 172.21.15.44:0/300798106 >> v2:172.21.15.204:3300/0 conn(0x7f5adc15ad80 msgr2=0x7f5adc06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.064+0000 7f5ada59c640 1 --2- 172.21.15.44:0/300798106 >> v2:172.21.15.204:3300/0 conn(0x7f5adc15ad80 0x7f5adc06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.064+0000 7f5ada59c640 1 -- 172.21.15.44:0/300798106 >> v1:172.21.15.204:6789/0 conn(0x7f5adc0c9c40 legacy=0x7f5adc070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:13.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.064+0000 7f5ada59c640 1 -- 172.21.15.44:0/300798106 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc06d280 con 0x7f5adc0b42c0 2023-11-04T01:41:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.065+0000 7f5ada59c640 1 --2- 172.21.15.44:0/300798106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5adc0b42c0 0x7f5adc0c9700 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0c8e50 tx=0x7f5ad002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12dfc8f8f887d7fd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.065+0000 7f5ad9d9b640 1 -- 172.21.15.44:0/300798106 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0030840 con 0x7f5adc0b42c0 2023-11-04T01:41:13.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.065+0000 7f5ad9d9b640 1 -- 172.21.15.44:0/300798106 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad00309a0 con 0x7f5adc0b42c0 2023-11-04T01:41:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.065+0000 7f5ad9d9b640 1 -- 172.21.15.44:0/300798106 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0030d30 con 0x7f5adc0b42c0 2023-11-04T01:41:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.066+0000 7f5ae1034640 1 -- 172.21.15.44:0/300798106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5adc0b42c0 msgr2=0x7f5adc0c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.066+0000 7f5ae1034640 1 --2- 172.21.15.44:0/300798106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5adc0b42c0 0x7f5adc0c9700 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0c8e50 tx=0x7f5ad002b980 comp rx=0 tx=0).stop 2023-11-04T01:41:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.066+0000 7f5ae1034640 1 -- 172.21.15.44:0/300798106 shutdown_connections 2023-11-04T01:41:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.066+0000 7f5ae1034640 1 --2- 172.21.15.44:0/300798106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5adc0b42c0 0x7f5adc0c9700 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.066+0000 7f5ae1034640 1 --2- 172.21.15.44:0/300798106 >> v2:172.21.15.204:3300/0 conn(0x7f5adc15ad80 0x7f5adc06c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.066+0000 7f5ae1034640 1 -- 172.21.15.44:0/300798106 >> 172.21.15.44:0/300798106 conn(0x7f5adc0ce950 msgr2=0x7f5adc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.066+0000 7f5ae1034640 1 -- 172.21.15.44:0/300798106 shutdown_connections 2023-11-04T01:41:13.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.066+0000 7f5ae1034640 1 -- 172.21.15.44:0/300798106 wait complete. 2023-11-04T01:41:13.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.067+0000 7f5ae1034640 1 Processor -- start 2023-11-04T01:41:13.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.067+0000 7f5ae1034640 1 -- start start 2023-11-04T01:41:13.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.068+0000 7f5ae1034640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5adc0b42c0 0x7f5adc144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.068+0000 7f5ae1034640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5adc0c9c40 0x7f5adc0c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.068+0000 7f5ae1034640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5adc15ad80 0x7f5adc0c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.068+0000 7f5ae1034640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0c8280 con 0x7f5adc0b42c0 2023-11-04T01:41:13.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.068+0000 7f5ae1034640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0c7cc0 con 0x7f5adc15ad80 2023-11-04T01:41:13.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.068+0000 7f5ae1034640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0c7fa0 con 0x7f5adc0c9c40 2023-11-04T01:41:13.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.068+0000 7f5adad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5adc0b42c0 0x7f5adc144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.068+0000 7f5adad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5adc0b42c0 0x7f5adc144c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56674/0 (socket says 172.21.15.44:56674) 2023-11-04T01:41:13.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.068+0000 7f5adad9d640 1 -- 172.21.15.44:0/4293545370 learned_addr learned my addr 172.21.15.44:0/4293545370 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:13.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.069+0000 7f5adb59e640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5adc15ad80 0x7f5adc0c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.069+0000 7f5ada59c640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5adc0c9c40 0x7f5adc0c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.069+0000 7f5adad9d640 1 -- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5adc0c9c40 msgr2=0x7f5adc0c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.069+0000 7f5adad9d640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5adc0c9c40 0x7f5adc0c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.069+0000 7f5adad9d640 1 -- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5adc15ad80 msgr2=0x7f5adc0c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.069+0000 7f5adad9d640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5adc15ad80 0x7f5adc0c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.069+0000 7f5adad9d640 1 -- 172.21.15.44:0/4293545370 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad00094d0 con 0x7f5adc0b42c0 2023-11-04T01:41:13.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.069+0000 7f5adb59e640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5adc15ad80 0x7f5adc0c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:13.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.069+0000 7f5ada59c640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5adc0c9c40 0x7f5adc0c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:13.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.069+0000 7f5adad9d640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5adc0b42c0 0x7f5adc144c20 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00b410 tx=0x7f5acc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.069+0000 7f5ac37fe640 1 -- 172.21.15.44:0/4293545370 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc011830 con 0x7f5adc0b42c0 2023-11-04T01:41:13.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.069+0000 7f5ac37fe640 1 -- 172.21.15.44:0/4293545370 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc0119b0 con 0x7f5adc0b42c0 2023-11-04T01:41:13.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.069+0000 7f5ae1034640 1 -- 172.21.15.44:0/4293545370 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc15b200 con 0x7f5adc0b42c0 2023-11-04T01:41:13.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.069+0000 7f5ac37fe640 1 -- 172.21.15.44:0/4293545370 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc011d60 con 0x7f5adc0b42c0 2023-11-04T01:41:13.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.069+0000 7f5ae1034640 1 -- 172.21.15.44:0/4293545370 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc145160 con 0x7f5adc0b42c0 2023-11-04T01:41:13.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.070+0000 7f5ae1034640 1 -- 172.21.15.44:0/4293545370 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc15b720 con 0x7f5adc0b42c0 2023-11-04T01:41:13.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.070+0000 7f5ac37fe640 1 -- 172.21.15.44:0/4293545370 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5acc01a400 con 0x7f5adc0b42c0 2023-11-04T01:41:13.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.071+0000 7f5ac37fe640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5ac806ae70 0x7f5ac806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.071+0000 7f5ac37fe640 1 -- 172.21.15.44:0/4293545370 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7f5acc089e30 con 0x7f5adc0b42c0 2023-11-04T01:41:13.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.071+0000 7f5ada59c640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5ac806ae70 0x7f5ac806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.072+0000 7f5ada59c640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5ac806ae70 0x7f5ac806d330 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0036000 tx=0x7f5ad003b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.075+0000 7f5ac37fe640 1 -- 172.21.15.44:0/4293545370 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5adc15b720 con 0x7f5adc0b42c0 2023-11-04T01:41:13.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.286+0000 7f5ae1034640 1 -- 172.21.15.44:0/4293545370 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5adc15b720 con 0x7f5adc0b42c0 2023-11-04T01:41:13.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.287+0000 7f5ac37fe640 1 -- 172.21.15.44:0/4293545370 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f5adc15b720 con 0x7f5adc0b42c0 2023-11-04T01:41:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:13.290 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":75,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:08.717313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7797,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7797":{"gid":7797,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":11,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:13.291 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 75 2023-11-04T01:41:13.291 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.289+0000 7f5ae1034640 1 -- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5ac806ae70 msgr2=0x7f5ac806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.289+0000 7f5ae1034640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5ac806ae70 0x7f5ac806d330 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0036000 tx=0x7f5ad003b040 comp rx=0 tx=0).stop 2023-11-04T01:41:13.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.289+0000 7f5ae1034640 1 -- 172.21.15.44:0/4293545370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5adc0b42c0 msgr2=0x7f5adc144c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.289+0000 7f5ae1034640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5adc0b42c0 0x7f5adc144c20 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00b410 tx=0x7f5acc00b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.289+0000 7f5ae1034640 1 -- 172.21.15.44:0/4293545370 shutdown_connections 2023-11-04T01:41:13.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.289+0000 7f5ae1034640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5ac806ae70 0x7f5ac806d330 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.289+0000 7f5ae1034640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5adc15ad80 0x7f5adc0c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.289+0000 7f5ae1034640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5adc0c9c40 0x7f5adc0c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.289+0000 7f5ae1034640 1 --2- 172.21.15.44:0/4293545370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5adc0b42c0 0x7f5adc144c20 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.289+0000 7f5ae1034640 1 -- 172.21.15.44:0/4293545370 >> 172.21.15.44:0/4293545370 conn(0x7f5adc0ce950 msgr2=0x7f5adc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:13.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.289+0000 7f5ae1034640 1 -- 172.21.15.44:0/4293545370 shutdown_connections 2023-11-04T01:41:13.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.289+0000 7f5ae1034640 1 -- 172.21.15.44:0/4293545370 wait complete. 2023-11-04T01:41:13.302 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:41:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.408+0000 7ff36fa90640 1 Processor -- start 2023-11-04T01:41:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.408+0000 7ff36fa90640 1 -- start start 2023-11-04T01:41:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.409+0000 7ff36fa90640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff3680b1a40 0x7ff3680ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.409+0000 7ff36fa90640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff36806a830 0x7ff3680cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.409+0000 7ff36fa90640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff368160990 con 0x7ff3681605b0 2023-11-04T01:41:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.409+0000 7ff36fa90640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3680cc7c0 con 0x7ff3680b1a40 2023-11-04T01:41:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.409+0000 7ff36fa90640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680cd750 con 0x7ff36806a830 2023-11-04T01:41:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.409+0000 7ff36e02d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff36806a830 0x7ff3680cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.409+0000 7ff36e02d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff36806a830 0x7ff3680cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:36868/0 (socket says 172.21.15.44:36868) 2023-11-04T01:41:13.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.409+0000 7ff36d82c640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7ff3681605b0 0x7ff36806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:46726/0 (socket says 172.21.15.44:46726) 2023-11-04T01:41:13.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.409+0000 7ff36e02d640 1 -- 172.21.15.44:0/3085787371 learned_addr learned my addr 172.21.15.44:0/3085787371 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:13.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.409+0000 7ff36d02b640 1 --2- 172.21.15.44:0/3085787371 >> v2:172.21.15.204:3300/0 conn(0x7ff3680b1a40 0x7ff3680ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.410+0000 7ff36e02d640 1 -- 172.21.15.44:0/3085787371 >> v2:172.21.15.204:3300/0 conn(0x7ff3680b1a40 msgr2=0x7ff3680ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:13.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.410+0000 7ff36e02d640 1 --2- 172.21.15.44:0/3085787371 >> v2:172.21.15.204:3300/0 conn(0x7ff3680b1a40 0x7ff3680ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.410+0000 7ff36e02d640 1 -- 172.21.15.44:0/3085787371 >> v1:172.21.15.204:6789/0 conn(0x7ff3681605b0 legacy=0x7ff36806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.410+0000 7ff36e02d640 1 -- 172.21.15.44:0/3085787371 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3680cc4e0 con 0x7ff36806a830 2023-11-04T01:41:13.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.411+0000 7ff36e02d640 1 --2- 172.21.15.44:0/3085787371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff36806a830 0x7ff3680cf9f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff358009e50 tx=0x7ff35802be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32e9c70c586fa6a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.411+0000 7ff36c82a640 1 -- 172.21.15.44:0/3085787371 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35802c9e0 con 0x7ff36806a830 2023-11-04T01:41:13.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.411+0000 7ff36c82a640 1 -- 172.21.15.44:0/3085787371 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35802cb40 con 0x7ff36806a830 2023-11-04T01:41:13.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.411+0000 7ff36c82a640 1 -- 172.21.15.44:0/3085787371 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3580343f0 con 0x7ff36806a830 2023-11-04T01:41:13.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.411+0000 7ff36fa90640 1 -- 172.21.15.44:0/3085787371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff36806a830 msgr2=0x7ff3680cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.411+0000 7ff36fa90640 1 --2- 172.21.15.44:0/3085787371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff36806a830 0x7ff3680cf9f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff358009e50 tx=0x7ff35802be40 comp rx=0 tx=0).stop 2023-11-04T01:41:13.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.411+0000 7ff36fa90640 1 -- 172.21.15.44:0/3085787371 shutdown_connections 2023-11-04T01:41:13.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.411+0000 7ff36fa90640 1 --2- 172.21.15.44:0/3085787371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff36806a830 0x7ff3680cf9f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.411+0000 7ff36fa90640 1 --2- 172.21.15.44:0/3085787371 >> v2:172.21.15.204:3300/0 conn(0x7ff3680b1a40 0x7ff3680ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.411+0000 7ff36fa90640 1 -- 172.21.15.44:0/3085787371 >> 172.21.15.44:0/3085787371 conn(0x7ff368071820 msgr2=0x7ff368071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:13.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.411+0000 7ff36fa90640 1 -- 172.21.15.44:0/3085787371 shutdown_connections 2023-11-04T01:41:13.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.411+0000 7ff36fa90640 1 -- 172.21.15.44:0/3085787371 wait complete. 2023-11-04T01:41:13.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.413+0000 7ff36fa90640 1 Processor -- start 2023-11-04T01:41:13.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.413+0000 7ff36fa90640 1 -- start start 2023-11-04T01:41:13.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.413+0000 7ff36fa90640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff36806a830 0x7ff3680b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.413+0000 7ff36fa90640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3681605b0 0x7ff3680b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.413+0000 7ff36fa90640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3681f5ea0 0x7ff3681f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.413+0000 7ff36fa90640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680b5500 con 0x7ff3681f5ea0 2023-11-04T01:41:13.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.413+0000 7ff36fa90640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680b3080 con 0x7ff3681605b0 2023-11-04T01:41:13.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.413+0000 7ff36fa90640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680b32d0 con 0x7ff36806a830 2023-11-04T01:41:13.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff36e02d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3681f5ea0 0x7ff3681f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff36e02d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3681f5ea0 0x7ff3681f1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56680/0 (socket says 172.21.15.44:56680) 2023-11-04T01:41:13.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff36e02d640 1 -- 172.21.15.44:0/859046408 learned_addr learned my addr 172.21.15.44:0/859046408 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:13.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff36d02b640 1 --2- 172.21.15.44:0/859046408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3681605b0 0x7ff3680b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff36d82c640 1 --2- 172.21.15.44:0/859046408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff36806a830 0x7ff3680b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff36e02d640 1 -- 172.21.15.44:0/859046408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff36806a830 msgr2=0x7ff3680b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff36e02d640 1 --2- 172.21.15.44:0/859046408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff36806a830 0x7ff3680b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff36e02d640 1 -- 172.21.15.44:0/859046408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3681605b0 msgr2=0x7ff3680b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff36e02d640 1 --2- 172.21.15.44:0/859046408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3681605b0 0x7ff3680b4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff36e02d640 1 -- 172.21.15.44:0/859046408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff358009b30 con 0x7ff3681f5ea0 2023-11-04T01:41:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff36e02d640 1 --2- 172.21.15.44:0/859046408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3681f5ea0 0x7ff3681f1920 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7ff358009e50 tx=0x7ff358004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff3667fc640 1 -- 172.21.15.44:0/859046408 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358009510 con 0x7ff3681f5ea0 2023-11-04T01:41:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff3667fc640 1 -- 172.21.15.44:0/859046408 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35803e450 con 0x7ff3681f5ea0 2023-11-04T01:41:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff36fa90640 1 -- 172.21.15.44:0/859046408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3680b35b0 con 0x7ff3681f5ea0 2023-11-04T01:41:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff3667fc640 1 -- 172.21.15.44:0/859046408 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35803e800 con 0x7ff3681f5ea0 2023-11-04T01:41:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.414+0000 7ff36fa90640 1 -- 172.21.15.44:0/859046408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3680b3b70 con 0x7ff3681f5ea0 2023-11-04T01:41:13.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.415+0000 7ff36fa90640 1 -- 172.21.15.44:0/859046408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3680672a0 con 0x7ff3681f5ea0 2023-11-04T01:41:13.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.416+0000 7ff3667fc640 1 -- 172.21.15.44:0/859046408 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff35803e960 con 0x7ff3681f5ea0 2023-11-04T01:41:13.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.416+0000 7ff3667fc640 1 --2- 172.21.15.44:0/859046408 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff35406ae70 0x7ff35406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.416+0000 7ff3667fc640 1 -- 172.21.15.44:0/859046408 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7ff3580ac900 con 0x7ff3681f5ea0 2023-11-04T01:41:13.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.416+0000 7ff36d82c640 1 --2- 172.21.15.44:0/859046408 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff35406ae70 0x7ff35406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.417+0000 7ff36d82c640 1 --2- 172.21.15.44:0/859046408 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff35406ae70 0x7ff35406d330 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff360000f60 tx=0x7ff360007c80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.421+0000 7ff3667fc640 1 -- 172.21.15.44:0/859046408 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff358077320 con 0x7ff3681f5ea0 2023-11-04T01:41:13.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.672+0000 7ff36fa90640 1 -- 172.21.15.44:0/859046408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7ff3680b3d90 con 0x7ff3681f5ea0 2023-11-04T01:41:13.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.739+0000 7ff3667fc640 1 -- 172.21.15.44:0/859046408 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7797 v76) v1 ==== 112+0+0 (secure 0 0 0) 0x7ff35807a940 con 0x7ff3681f5ea0 2023-11-04T01:41:13.741 INFO:teuthology.orchestra.run.smithi044.stderr:freezing mds.7797 2023-11-04T01:41:13.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.742+0000 7ff36fa90640 1 -- 172.21.15.44:0/859046408 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff35406ae70 msgr2=0x7ff35406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.742+0000 7ff36fa90640 1 --2- 172.21.15.44:0/859046408 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff35406ae70 0x7ff35406d330 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff360000f60 tx=0x7ff360007c80 comp rx=0 tx=0).stop 2023-11-04T01:41:13.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.742+0000 7ff36fa90640 1 -- 172.21.15.44:0/859046408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3681f5ea0 msgr2=0x7ff3681f1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.742+0000 7ff36fa90640 1 --2- 172.21.15.44:0/859046408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3681f5ea0 0x7ff3681f1920 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7ff358009e50 tx=0x7ff358004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:13.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.742+0000 7ff36fa90640 1 -- 172.21.15.44:0/859046408 shutdown_connections 2023-11-04T01:41:13.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.742+0000 7ff36fa90640 1 --2- 172.21.15.44:0/859046408 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff35406ae70 0x7ff35406d330 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.742+0000 7ff36fa90640 1 --2- 172.21.15.44:0/859046408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3681f5ea0 0x7ff3681f1920 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.742+0000 7ff36fa90640 1 --2- 172.21.15.44:0/859046408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3681605b0 0x7ff3680b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.742+0000 7ff36fa90640 1 --2- 172.21.15.44:0/859046408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff36806a830 0x7ff3680b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.742+0000 7ff36fa90640 1 -- 172.21.15.44:0/859046408 >> 172.21.15.44:0/859046408 conn(0x7ff368071820 msgr2=0x7ff3680cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:13.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.742+0000 7ff36fa90640 1 -- 172.21.15.44:0/859046408 shutdown_connections 2023-11-04T01:41:13.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:13.742+0000 7ff36fa90640 1 -- 172.21.15.44:0/859046408 wait complete. 2023-11-04T01:41:13.755 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_kill_mdstable_at 6 2023-11-04T01:41:13.873 INFO:teuthology.orchestra.run.smithi044.stdout:{"success":"mds_kill_mdstable_at = '6' (not observed, change may require restart) "} 2023-11-04T01:41:13.873 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '6' (not observed, change may require restart) " } 2023-11-04T01:41:13.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:13.874 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s16) 2023-11-04T01:41:13.876 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:41:14.007 INFO:teuthology.orchestra.run.smithi044.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:41:14.007 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:41:14.008 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda9e133640 1 Processor -- start 2023-11-04T01:41:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda9e133640 1 -- start start 2023-11-04T01:41:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda9e133640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fda980af060 0x7fda980b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda9e133640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fda9806ef40 0x7fda980cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda9e133640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda980b1590 con 0x7fda980aec80 2023-11-04T01:41:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda9e133640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda98155a40 con 0x7fda980af060 2023-11-04T01:41:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda9e133640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9806a8e0 con 0x7fda9806ef40 2023-11-04T01:41:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda96ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fda980af060 0x7fda980b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda977fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fda980aec80 0x7fda9806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58684/0 (socket says 172.21.15.44:58684) 2023-11-04T01:41:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda977fe640 1 -- 172.21.15.44:0/3919079418 learned_addr learned my addr 172.21.15.44:0/3919079418 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda97fff640 1 --2- 172.21.15.44:0/3919079418 >> v2:172.21.15.204:3300/0 conn(0x7fda9806ef40 0x7fda980cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda96ffd640 1 -- 172.21.15.44:0/3919079418 >> v2:172.21.15.204:3300/0 conn(0x7fda9806ef40 msgr2=0x7fda980cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:14.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda96ffd640 1 --2- 172.21.15.44:0/3919079418 >> v2:172.21.15.204:3300/0 conn(0x7fda9806ef40 0x7fda980cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda967fc640 1 -- 172.21.15.44:0/3919079418 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531268168 0 0) 0x7fda980b1590 con 0x7fda980aec80 2023-11-04T01:41:14.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda96ffd640 1 -- 172.21.15.44:0/3919079418 >> v1:172.21.15.44:6789/0 conn(0x7fda980aec80 legacy=0x7fda9806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.113+0000 7fda96ffd640 1 -- 172.21.15.44:0/3919079418 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda980b1800 con 0x7fda980af060 2023-11-04T01:41:14.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.114+0000 7fda96ffd640 1 --2- 172.21.15.44:0/3919079418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda980af060 0x7fda980b1fe0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fda9815b4c0 tx=0x7fda8c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba10d07063c1cdb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.114+0000 7fda967fc640 1 -- 172.21.15.44:0/3919079418 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c031830 con 0x7fda980af060 2023-11-04T01:41:14.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.114+0000 7fda967fc640 1 -- 172.21.15.44:0/3919079418 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c031990 con 0x7fda980af060 2023-11-04T01:41:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.114+0000 7fda967fc640 1 -- 172.21.15.44:0/3919079418 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c031d20 con 0x7fda980af060 2023-11-04T01:41:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.114+0000 7fda9e133640 1 -- 172.21.15.44:0/3919079418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda980af060 msgr2=0x7fda980b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.114+0000 7fda9e133640 1 --2- 172.21.15.44:0/3919079418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda980af060 0x7fda980b1fe0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fda9815b4c0 tx=0x7fda8c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.114+0000 7fda9e133640 1 -- 172.21.15.44:0/3919079418 shutdown_connections 2023-11-04T01:41:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.114+0000 7fda9e133640 1 --2- 172.21.15.44:0/3919079418 >> v2:172.21.15.204:3300/0 conn(0x7fda9806ef40 0x7fda980cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.114+0000 7fda9e133640 1 --2- 172.21.15.44:0/3919079418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda980af060 0x7fda980b1fe0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.114+0000 7fda9e133640 1 -- 172.21.15.44:0/3919079418 >> 172.21.15.44:0/3919079418 conn(0x7fda98098d40 msgr2=0x7fda980cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.114+0000 7fda9e133640 1 -- 172.21.15.44:0/3919079418 shutdown_connections 2023-11-04T01:41:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.115+0000 7fda9e133640 1 -- 172.21.15.44:0/3919079418 wait complete. 2023-11-04T01:41:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.116+0000 7fda9e133640 1 Processor -- start 2023-11-04T01:41:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.116+0000 7fda9e133640 1 -- start start 2023-11-04T01:41:14.120 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.116+0000 7fda9e133640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9806ef40 0x7fda9815f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.116+0000 7fda9e133640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda980aec80 0x7fda9814d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda9e133640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda980af060 0x7fda980c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda9e133640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda980c8e40 con 0x7fda980aec80 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda9e133640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda980c8230 con 0x7fda980af060 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda9e133640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda980c8510 con 0x7fda9806ef40 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda96ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda980aec80 0x7fda9814d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda96ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda980aec80 0x7fda9814d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56708/0 (socket says 172.21.15.44:56708) 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda96ffd640 1 -- 172.21.15.44:0/2582297939 learned_addr learned my addr 172.21.15.44:0/2582297939 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda97fff640 1 --2- 172.21.15.44:0/2582297939 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda980af060 0x7fda980c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda977fe640 1 --2- 172.21.15.44:0/2582297939 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9806ef40 0x7fda9815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda96ffd640 1 -- 172.21.15.44:0/2582297939 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9806ef40 msgr2=0x7fda9815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda96ffd640 1 --2- 172.21.15.44:0/2582297939 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9806ef40 0x7fda9815f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda96ffd640 1 -- 172.21.15.44:0/2582297939 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda980af060 msgr2=0x7fda980c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda96ffd640 1 --2- 172.21.15.44:0/2582297939 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda980af060 0x7fda980c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda96ffd640 1 -- 172.21.15.44:0/2582297939 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c0093a0 con 0x7fda980aec80 2023-11-04T01:41:14.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda96ffd640 1 --2- 172.21.15.44:0/2582297939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda980aec80 0x7fda9814d070 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fda8c000c00 tx=0x7fda8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda7ffff640 1 -- 172.21.15.44:0/2582297939 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c004220 con 0x7fda980aec80 2023-11-04T01:41:14.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda7ffff640 1 -- 172.21.15.44:0/2582297939 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c0043a0 con 0x7fda980aec80 2023-11-04T01:41:14.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda9e133640 1 -- 172.21.15.44:0/2582297939 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda980c87f0 con 0x7fda980aec80 2023-11-04T01:41:14.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda7ffff640 1 -- 172.21.15.44:0/2582297939 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c005bd0 con 0x7fda980aec80 2023-11-04T01:41:14.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.117+0000 7fda9e133640 1 -- 172.21.15.44:0/2582297939 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda980c9810 con 0x7fda980aec80 2023-11-04T01:41:14.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.118+0000 7fda9e133640 1 -- 172.21.15.44:0/2582297939 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda98074290 con 0x7fda980aec80 2023-11-04T01:41:14.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.119+0000 7fda7ffff640 1 -- 172.21.15.44:0/2582297939 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda8c005d30 con 0x7fda980aec80 2023-11-04T01:41:14.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.119+0000 7fda7ffff640 1 --2- 172.21.15.44:0/2582297939 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fda8406ae70 0x7fda8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.119+0000 7fda7ffff640 1 -- 172.21.15.44:0/2582297939 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7fda8c0abcf0 con 0x7fda980aec80 2023-11-04T01:41:14.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.119+0000 7fda977fe640 1 --2- 172.21.15.44:0/2582297939 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fda8406ae70 0x7fda8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.120+0000 7fda977fe640 1 --2- 172.21.15.44:0/2582297939 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fda8406ae70 0x7fda8406d330 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fda980b5880 tx=0x7fda88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.124+0000 7fda7ffff640 1 -- 172.21.15.44:0/2582297939 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fda8c0b0070 con 0x7fda980aec80 2023-11-04T01:41:14.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.334+0000 7fda9e133640 1 -- 172.21.15.44:0/2582297939 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda980b1080 con 0x7fda980aec80 2023-11-04T01:41:14.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.334+0000 7fda7ffff640 1 -- 172.21.15.44:0/2582297939 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fda8c035090 con 0x7fda980aec80 2023-11-04T01:41:14.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:14.336 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:13.673859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7797,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7797":{"gid":7797,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":11,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:14.337 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 76 2023-11-04T01:41:14.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.336+0000 7fda9e133640 1 -- 172.21.15.44:0/2582297939 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fda8406ae70 msgr2=0x7fda8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.336+0000 7fda9e133640 1 --2- 172.21.15.44:0/2582297939 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fda8406ae70 0x7fda8406d330 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fda980b5880 tx=0x7fda88009040 comp rx=0 tx=0).stop 2023-11-04T01:41:14.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.336+0000 7fda9e133640 1 -- 172.21.15.44:0/2582297939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda980aec80 msgr2=0x7fda9814d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.336+0000 7fda9e133640 1 --2- 172.21.15.44:0/2582297939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda980aec80 0x7fda9814d070 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fda8c000c00 tx=0x7fda8c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.336+0000 7fda9e133640 1 -- 172.21.15.44:0/2582297939 shutdown_connections 2023-11-04T01:41:14.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.336+0000 7fda9e133640 1 --2- 172.21.15.44:0/2582297939 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fda8406ae70 0x7fda8406d330 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.336+0000 7fda9e133640 1 --2- 172.21.15.44:0/2582297939 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda980af060 0x7fda980c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.336+0000 7fda9e133640 1 --2- 172.21.15.44:0/2582297939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda980aec80 0x7fda9814d070 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.336+0000 7fda9e133640 1 --2- 172.21.15.44:0/2582297939 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda9806ef40 0x7fda9815f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.336+0000 7fda9e133640 1 -- 172.21.15.44:0/2582297939 >> 172.21.15.44:0/2582297939 conn(0x7fda98098d40 msgr2=0x7fda9806a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:14.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.336+0000 7fda9e133640 1 -- 172.21.15.44:0/2582297939 shutdown_connections 2023-11-04T01:41:14.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:14.336+0000 7fda9e133640 1 -- 172.21.15.44:0/2582297939 wait complete. 2023-11-04T01:41:14.348 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:14.515 INFO:tasks.ceph.mds.a.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f2af79ac640 time 2023-11-04T01:41:14.514268+0000 2023-11-04T01:41:14.515 INFO:tasks.ceph.mds.a.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:41:14.515 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:14.515 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2b0356efaf] 2023-11-04T01:41:14.515 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f2b0356f16d] 2023-11-04T01:41:14.515 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55986612e21b] 2023-11-04T01:41:14.516 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55986615dbcc] 2023-11-04T01:41:14.516 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x559866166b0c] 2023-11-04T01:41:14.516 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x559866166c63] 2023-11-04T01:41:14.516 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f2b036164a5] 2023-11-04T01:41:14.516 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f2b02c9f802] 2023-11-04T01:41:14.516 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f2b02c3f450] 2023-11-04T01:41:14.516 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:41:14.513+0000 7f2af79ac640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f2af79ac640 time 2023-11-04T01:41:14.514268+0000 2023-11-04T01:41:14.516 INFO:tasks.ceph.mds.a.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:41:14.516 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:41:14.516 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:14.516 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2b0356efaf] 2023-11-04T01:41:14.516 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f2b0356f16d] 2023-11-04T01:41:14.516 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55986612e21b] 2023-11-04T01:41:14.516 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55986615dbcc] 2023-11-04T01:41:14.517 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x559866166b0c] 2023-11-04T01:41:14.517 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x559866166c63] 2023-11-04T01:41:14.517 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f2b036164a5] 2023-11-04T01:41:14.517 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f2b02c9f802] 2023-11-04T01:41:14.517 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f2b02c3f450] 2023-11-04T01:41:14.517 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:41:14.517 INFO:tasks.ceph.mds.a.smithi044.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:41:14.517 INFO:tasks.ceph.mds.a.smithi044.stderr: in thread 7f2af79ac640 thread_name:MR_Finisher 2023-11-04T01:41:14.517 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:14.518 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f2b02c54db0] 2023-11-04T01:41:14.518 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f2b02ca154c] 2023-11-04T01:41:14.518 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: raise() 2023-11-04T01:41:14.518 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: abort() 2023-11-04T01:41:14.518 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2b0356f009] 2023-11-04T01:41:14.518 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f2b0356f16d] 2023-11-04T01:41:14.518 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55986612e21b] 2023-11-04T01:41:14.518 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55986615dbcc] 2023-11-04T01:41:14.518 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x559866166b0c] 2023-11-04T01:41:14.518 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x559866166c63] 2023-11-04T01:41:14.518 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f2b036164a5] 2023-11-04T01:41:14.519 INFO:tasks.ceph.mds.a.smithi044.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f2b02c9f802] 2023-11-04T01:41:14.519 INFO:tasks.ceph.mds.a.smithi044.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f2b02c3f450] 2023-11-04T01:41:14.519 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:41:14.514+0000 7f2af79ac640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:14.519 INFO:tasks.ceph.mds.a.smithi044.stderr: in thread 7f2af79ac640 thread_name:MR_Finisher 2023-11-04T01:41:14.519 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:41:14.519 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:14.519 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f2b02c54db0] 2023-11-04T01:41:14.519 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f2b02ca154c] 2023-11-04T01:41:14.519 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: raise() 2023-11-04T01:41:14.519 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: abort() 2023-11-04T01:41:14.519 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2b0356f009] 2023-11-04T01:41:14.519 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f2b0356f16d] 2023-11-04T01:41:14.519 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55986612e21b] 2023-11-04T01:41:14.520 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55986615dbcc] 2023-11-04T01:41:14.520 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x559866166b0c] 2023-11-04T01:41:14.520 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x559866166c63] 2023-11-04T01:41:14.520 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f2b036164a5] 2023-11-04T01:41:14.520 INFO:tasks.ceph.mds.a.smithi044.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f2b02c9f802] 2023-11-04T01:41:14.520 INFO:tasks.ceph.mds.a.smithi044.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f2b02c3f450] 2023-11-04T01:41:14.520 INFO:tasks.ceph.mds.a.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:14.520 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:41:14.521 INFO:tasks.ceph.mds.a.smithi044.stderr: -304> 2023-11-04T01:41:11.427+0000 7f2afb1b3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:14.521 INFO:tasks.ceph.mds.a.smithi044.stderr: -302> 2023-11-04T01:41:11.427+0000 7f2afb1b3640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:14.521 INFO:tasks.ceph.mds.a.smithi044.stderr: -1> 2023-11-04T01:41:14.513+0000 7f2af79ac640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f2af79ac640 time 2023-11-04T01:41:14.514268+0000 2023-11-04T01:41:14.521 INFO:tasks.ceph.mds.a.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:41:14.521 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:41:14.521 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:14.521 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2b0356efaf] 2023-11-04T01:41:14.521 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f2b0356f16d] 2023-11-04T01:41:14.521 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55986612e21b] 2023-11-04T01:41:14.521 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55986615dbcc] 2023-11-04T01:41:14.521 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x559866166b0c] 2023-11-04T01:41:14.521 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x559866166c63] 2023-11-04T01:41:14.522 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f2b036164a5] 2023-11-04T01:41:14.522 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f2b02c9f802] 2023-11-04T01:41:14.522 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f2b02c3f450] 2023-11-04T01:41:14.522 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:41:14.522 INFO:tasks.ceph.mds.a.smithi044.stderr: 0> 2023-11-04T01:41:14.514+0000 7f2af79ac640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:14.522 INFO:tasks.ceph.mds.a.smithi044.stderr: in thread 7f2af79ac640 thread_name:MR_Finisher 2023-11-04T01:41:14.522 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:41:14.522 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:14.522 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f2b02c54db0] 2023-11-04T01:41:14.522 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f2b02ca154c] 2023-11-04T01:41:14.522 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: raise() 2023-11-04T01:41:14.522 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: abort() 2023-11-04T01:41:14.522 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2b0356f009] 2023-11-04T01:41:14.522 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f2b0356f16d] 2023-11-04T01:41:14.523 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55986612e21b] 2023-11-04T01:41:14.523 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55986615dbcc] 2023-11-04T01:41:14.523 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x559866166b0c] 2023-11-04T01:41:14.523 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x559866166c63] 2023-11-04T01:41:14.523 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f2b036164a5] 2023-11-04T01:41:14.523 INFO:tasks.ceph.mds.a.smithi044.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f2b02c9f802] 2023-11-04T01:41:14.523 INFO:tasks.ceph.mds.a.smithi044.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f2b02c3f450] 2023-11-04T01:41:14.523 INFO:tasks.ceph.mds.a.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:14.523 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:41:14.523 INFO:tasks.ceph.mds.a.smithi044.stderr: -307> 2023-11-04T01:41:11.427+0000 7f2afb1b3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:14.524 INFO:tasks.ceph.mds.a.smithi044.stderr: -305> 2023-11-04T01:41:11.427+0000 7f2afb1b3640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:14.524 INFO:tasks.ceph.mds.a.smithi044.stderr: -4> 2023-11-04T01:41:14.513+0000 7f2af79ac640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f2af79ac640 time 2023-11-04T01:41:14.514268+0000 2023-11-04T01:41:14.524 INFO:tasks.ceph.mds.a.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:41:14.524 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:41:14.524 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:14.524 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2b0356efaf] 2023-11-04T01:41:14.524 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f2b0356f16d] 2023-11-04T01:41:14.524 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55986612e21b] 2023-11-04T01:41:14.524 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55986615dbcc] 2023-11-04T01:41:14.525 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x559866166b0c] 2023-11-04T01:41:14.525 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x559866166c63] 2023-11-04T01:41:14.525 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f2b036164a5] 2023-11-04T01:41:14.525 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f2b02c9f802] 2023-11-04T01:41:14.525 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f2b02c3f450] 2023-11-04T01:41:14.525 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:41:14.525 INFO:tasks.ceph.mds.a.smithi044.stderr: -3> 2023-11-04T01:41:14.514+0000 7f2af79ac640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:14.525 INFO:tasks.ceph.mds.a.smithi044.stderr: in thread 7f2af79ac640 thread_name:MR_Finisher 2023-11-04T01:41:14.525 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:41:14.525 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:14.525 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f2b02c54db0] 2023-11-04T01:41:14.525 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f2b02ca154c] 2023-11-04T01:41:14.525 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: raise() 2023-11-04T01:41:14.526 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: abort() 2023-11-04T01:41:14.526 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2b0356f009] 2023-11-04T01:41:14.526 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f2b0356f16d] 2023-11-04T01:41:14.526 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55986612e21b] 2023-11-04T01:41:14.526 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55986615dbcc] 2023-11-04T01:41:14.526 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x559866166b0c] 2023-11-04T01:41:14.526 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x559866166c63] 2023-11-04T01:41:14.526 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f2b036164a5] 2023-11-04T01:41:14.526 INFO:tasks.ceph.mds.a.smithi044.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f2b02c9f802] 2023-11-04T01:41:14.526 INFO:tasks.ceph.mds.a.smithi044.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f2b02c3f450] 2023-11-04T01:41:14.526 INFO:tasks.ceph.mds.a.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:14.526 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:41:14.738 INFO:tasks.ceph.mds.a.smithi044.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:41:19.349 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.467+0000 7fcaee475640 1 Processor -- start 2023-11-04T01:41:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.467+0000 7fcaee475640 1 -- start start 2023-11-04T01:41:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.468+0000 7fcaee475640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcae80aec80 0x7fcae80b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.468+0000 7fcaee475640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcae806ef40 0x7fcae80cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.468+0000 7fcaee475640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae80b1590 con 0x7fcae80af060 2023-11-04T01:41:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.468+0000 7fcaee475640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae8155a40 con 0x7fcae806ef40 2023-11-04T01:41:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.468+0000 7fcaee475640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae806a8e0 con 0x7fcae80aec80 2023-11-04T01:41:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.468+0000 7fcae77fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcae80af060 0x7fcae806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58690/0 (socket says 172.21.15.44:58690) 2023-11-04T01:41:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.468+0000 7fcae77fe640 1 -- 172.21.15.44:0/736137655 learned_addr learned my addr 172.21.15.44:0/736137655 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.468+0000 7fcaeca12640 1 --2- 172.21.15.44:0/736137655 >> v2:172.21.15.204:3300/0 conn(0x7fcae806ef40 0x7fcae80cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.468+0000 7fcae7fff640 1 --2- 172.21.15.44:0/736137655 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcae80aec80 0x7fcae80b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.468+0000 7fcae6ffd640 1 -- 172.21.15.44:0/736137655 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565703014 0 0) 0x7fcae80b1590 con 0x7fcae80af060 2023-11-04T01:41:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.468+0000 7fcae6ffd640 1 -- 172.21.15.44:0/736137655 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad0003520 con 0x7fcae80af060 2023-11-04T01:41:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.469+0000 7fcaeca12640 1 -- 172.21.15.44:0/736137655 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcae80aec80 msgr2=0x7fcae80b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.469+0000 7fcaeca12640 1 --2- 172.21.15.44:0/736137655 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcae80aec80 0x7fcae80b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.469+0000 7fcaeca12640 1 -- 172.21.15.44:0/736137655 >> v1:172.21.15.44:6789/0 conn(0x7fcae80af060 legacy=0x7fcae806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.469+0000 7fcaeca12640 1 -- 172.21.15.44:0/736137655 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae80b1800 con 0x7fcae806ef40 2023-11-04T01:41:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.469+0000 7fcae7fff640 1 --2- 172.21.15.44:0/736137655 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcae80aec80 0x7fcae80b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:19.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.469+0000 7fcaeca12640 1 --2- 172.21.15.44:0/736137655 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcae806ef40 0x7fcae80cb7a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcae0009d90 tx=0x7fcae002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a1a88887f8baa29 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.470+0000 7fcae6ffd640 1 -- 172.21.15.44:0/736137655 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae002cc50 con 0x7fcae806ef40 2023-11-04T01:41:19.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.470+0000 7fcae6ffd640 1 -- 172.21.15.44:0/736137655 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae002cdb0 con 0x7fcae806ef40 2023-11-04T01:41:19.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.470+0000 7fcae6ffd640 1 -- 172.21.15.44:0/736137655 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0034660 con 0x7fcae806ef40 2023-11-04T01:41:19.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.470+0000 7fcaee475640 1 -- 172.21.15.44:0/736137655 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcae806ef40 msgr2=0x7fcae80cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.470+0000 7fcaee475640 1 --2- 172.21.15.44:0/736137655 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcae806ef40 0x7fcae80cb7a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcae0009d90 tx=0x7fcae002bea0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.470+0000 7fcaee475640 1 -- 172.21.15.44:0/736137655 shutdown_connections 2023-11-04T01:41:19.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.470+0000 7fcaee475640 1 --2- 172.21.15.44:0/736137655 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcae806ef40 0x7fcae80cb7a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.470+0000 7fcaee475640 1 --2- 172.21.15.44:0/736137655 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcae80aec80 0x7fcae80b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.470+0000 7fcaee475640 1 -- 172.21.15.44:0/736137655 >> 172.21.15.44:0/736137655 conn(0x7fcae8098d40 msgr2=0x7fcae80cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.470+0000 7fcaee475640 1 -- 172.21.15.44:0/736137655 shutdown_connections 2023-11-04T01:41:19.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.470+0000 7fcaee475640 1 -- 172.21.15.44:0/736137655 wait complete. 2023-11-04T01:41:19.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.471+0000 7fcaee475640 1 Processor -- start 2023-11-04T01:41:19.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.472+0000 7fcaee475640 1 -- start start 2023-11-04T01:41:19.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.472+0000 7fcaee475640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcae806ef40 0x7fcae80b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.472+0000 7fcaee475640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcae80aec80 0x7fcae815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.472+0000 7fcaee475640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcae80af060 0x7fcae80c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.472+0000 7fcaee475640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae80b5760 con 0x7fcae80aec80 2023-11-04T01:41:19.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.472+0000 7fcaee475640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae80b46c0 con 0x7fcae80af060 2023-11-04T01:41:19.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.472+0000 7fcaee475640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae80b49a0 con 0x7fcae806ef40 2023-11-04T01:41:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcae77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcae80aec80 0x7fcae815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcae77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcae80aec80 0x7fcae815ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56720/0 (socket says 172.21.15.44:56720) 2023-11-04T01:41:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcae77fe640 1 -- 172.21.15.44:0/3023005649 learned_addr learned my addr 172.21.15.44:0/3023005649 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcaeca12640 1 --2- 172.21.15.44:0/3023005649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcae80af060 0x7fcae80c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcae7fff640 1 --2- 172.21.15.44:0/3023005649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcae806ef40 0x7fcae80b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcae77fe640 1 -- 172.21.15.44:0/3023005649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcae806ef40 msgr2=0x7fcae80b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcae77fe640 1 --2- 172.21.15.44:0/3023005649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcae806ef40 0x7fcae80b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcae77fe640 1 -- 172.21.15.44:0/3023005649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcae80af060 msgr2=0x7fcae80c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcae77fe640 1 --2- 172.21.15.44:0/3023005649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcae80af060 0x7fcae80c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcae77fe640 1 -- 172.21.15.44:0/3023005649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0093a0 con 0x7fcae80aec80 2023-11-04T01:41:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcae77fe640 1 --2- 172.21.15.44:0/3023005649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcae80aec80 0x7fcae815ee90 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fcad8001eb0 tx=0x7fcad800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcae4ff9640 1 -- 172.21.15.44:0/3023005649 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80074e0 con 0x7fcae80aec80 2023-11-04T01:41:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcae4ff9640 1 -- 172.21.15.44:0/3023005649 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad8007640 con 0x7fcae80aec80 2023-11-04T01:41:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcaee475640 1 -- 172.21.15.44:0/3023005649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae0009a70 con 0x7fcae80aec80 2023-11-04T01:41:19.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcae4ff9640 1 -- 172.21.15.44:0/3023005649 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80059c0 con 0x7fcae80aec80 2023-11-04T01:41:19.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.473+0000 7fcaee475640 1 -- 172.21.15.44:0/3023005649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae80b4f60 con 0x7fcae80aec80 2023-11-04T01:41:19.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.474+0000 7fcaee475640 1 -- 172.21.15.44:0/3023005649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae8074290 con 0x7fcae80aec80 2023-11-04T01:41:19.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.475+0000 7fcae4ff9640 1 -- 172.21.15.44:0/3023005649 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcad8005b20 con 0x7fcae80aec80 2023-11-04T01:41:19.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.475+0000 7fcae4ff9640 1 --2- 172.21.15.44:0/3023005649 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcad406ae70 0x7fcad406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.475+0000 7fcae4ff9640 1 -- 172.21.15.44:0/3023005649 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7fcad8089230 con 0x7fcae80aec80 2023-11-04T01:41:19.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.476+0000 7fcae7fff640 1 --2- 172.21.15.44:0/3023005649 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcad406ae70 0x7fcad406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.476+0000 7fcae7fff640 1 --2- 172.21.15.44:0/3023005649 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcad406ae70 0x7fcad406d330 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009cc0 tx=0x7fcadc009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.480+0000 7fcae4ff9640 1 -- 172.21.15.44:0/3023005649 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcad8053cf0 con 0x7fcae80aec80 2023-11-04T01:41:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.694+0000 7fcaee475640 1 -- 172.21.15.44:0/3023005649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcae806e100 con 0x7fcae80aec80 2023-11-04T01:41:19.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.695+0000 7fcae4ff9640 1 -- 172.21.15.44:0/3023005649 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fcad8057310 con 0x7fcae80aec80 2023-11-04T01:41:19.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:19.696 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:13.673859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7797,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7797":{"gid":7797,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":11,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:19.696 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 76 2023-11-04T01:41:19.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.697+0000 7fcaee475640 1 -- 172.21.15.44:0/3023005649 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcad406ae70 msgr2=0x7fcad406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.697+0000 7fcaee475640 1 --2- 172.21.15.44:0/3023005649 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcad406ae70 0x7fcad406d330 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009cc0 tx=0x7fcadc009110 comp rx=0 tx=0).stop 2023-11-04T01:41:19.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.697+0000 7fcaee475640 1 -- 172.21.15.44:0/3023005649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcae80aec80 msgr2=0x7fcae815ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.697+0000 7fcaee475640 1 --2- 172.21.15.44:0/3023005649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcae80aec80 0x7fcae815ee90 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fcad8001eb0 tx=0x7fcad800c890 comp rx=0 tx=0).stop 2023-11-04T01:41:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.697+0000 7fcaee475640 1 -- 172.21.15.44:0/3023005649 shutdown_connections 2023-11-04T01:41:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.697+0000 7fcaee475640 1 --2- 172.21.15.44:0/3023005649 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcad406ae70 0x7fcad406d330 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.697+0000 7fcaee475640 1 --2- 172.21.15.44:0/3023005649 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcae80af060 0x7fcae80c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.697+0000 7fcaee475640 1 --2- 172.21.15.44:0/3023005649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcae80aec80 0x7fcae815ee90 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.697+0000 7fcaee475640 1 --2- 172.21.15.44:0/3023005649 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcae806ef40 0x7fcae80b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.697+0000 7fcaee475640 1 -- 172.21.15.44:0/3023005649 >> 172.21.15.44:0/3023005649 conn(0x7fcae8098d40 msgr2=0x7fcae80ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.697+0000 7fcaee475640 1 -- 172.21.15.44:0/3023005649 shutdown_connections 2023-11-04T01:41:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:19.697+0000 7fcaee475640 1 -- 172.21.15.44:0/3023005649 wait complete. 2023-11-04T01:41:19.709 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:20.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:41:24.710 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:24.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.828+0000 7f4288890640 1 Processor -- start 2023-11-04T01:41:24.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.828+0000 7f4288890640 1 -- start start 2023-11-04T01:41:24.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.829+0000 7f4288890640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f428415ce70 0x7f428406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.829+0000 7f4288890640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f428415d250 0x7f42840c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.829+0000 7f4288890640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428406a120 con 0x7f42840c9d70 2023-11-04T01:41:24.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.829+0000 7f4288890640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42840cdc10 con 0x7f428415d250 2023-11-04T01:41:24.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.829+0000 7f4288890640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428406def0 con 0x7f428415ce70 2023-11-04T01:41:24.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.829+0000 7f4281d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f428415d250 0x7f42840c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.829+0000 7f4281d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f428415d250 0x7f42840c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56738/0 (socket says 172.21.15.44:56738) 2023-11-04T01:41:24.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.829+0000 7f4281d9b640 1 -- 172.21.15.44:0/3706047451 learned_addr learned my addr 172.21.15.44:0/3706047451 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:24.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.829+0000 7f428259c640 1 --2- 172.21.15.44:0/3706047451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f428415ce70 0x7f428406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.829+0000 7f4281d9b640 1 -- 172.21.15.44:0/3706047451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f428415ce70 msgr2=0x7f428406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:24.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.829+0000 7f4281d9b640 1 --2- 172.21.15.44:0/3706047451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f428415ce70 0x7f428406d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.829+0000 7f4281d9b640 1 -- 172.21.15.44:0/3706047451 >> v1:172.21.15.204:6789/0 conn(0x7f42840c9d70 legacy=0x7f42840ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:24.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.829+0000 7f4281d9b640 1 -- 172.21.15.44:0/3706047451 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428406a370 con 0x7f428415d250 2023-11-04T01:41:24.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.829+0000 7f428259c640 1 --2- 172.21.15.44:0/3706047451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f428415ce70 0x7f428406d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:24.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.830+0000 7f4281d9b640 1 --2- 172.21.15.44:0/3706047451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428415d250 0x7f42840c9830 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f4278009870 tx=0x7f427802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a390a988ce948fec server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.830+0000 7f428159a640 1 -- 172.21.15.44:0/3706047451 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278031640 con 0x7f428415d250 2023-11-04T01:41:24.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.830+0000 7f428159a640 1 -- 172.21.15.44:0/3706047451 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42780317a0 con 0x7f428415d250 2023-11-04T01:41:24.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.830+0000 7f428159a640 1 -- 172.21.15.44:0/3706047451 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278031b30 con 0x7f428415d250 2023-11-04T01:41:24.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.831+0000 7f4288890640 1 -- 172.21.15.44:0/3706047451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428415d250 msgr2=0x7f42840c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.831+0000 7f4288890640 1 --2- 172.21.15.44:0/3706047451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428415d250 0x7f42840c9830 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f4278009870 tx=0x7f427802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.831+0000 7f4288890640 1 -- 172.21.15.44:0/3706047451 shutdown_connections 2023-11-04T01:41:24.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.831+0000 7f4288890640 1 --2- 172.21.15.44:0/3706047451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428415d250 0x7f42840c9830 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.831+0000 7f4288890640 1 --2- 172.21.15.44:0/3706047451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f428415ce70 0x7f428406d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.831+0000 7f4288890640 1 -- 172.21.15.44:0/3706047451 >> 172.21.15.44:0/3706047451 conn(0x7f42840b0cd0 msgr2=0x7f42840b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:24.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.831+0000 7f4288890640 1 -- 172.21.15.44:0/3706047451 shutdown_connections 2023-11-04T01:41:24.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.831+0000 7f4288890640 1 -- 172.21.15.44:0/3706047451 wait complete. 2023-11-04T01:41:24.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.832+0000 7f4288890640 1 Processor -- start 2023-11-04T01:41:24.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.832+0000 7f4288890640 1 -- start start 2023-11-04T01:41:24.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.833+0000 7f4288890640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428415ce70 0x7f42841e6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.833+0000 7f4288890640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f428415d250 0x7f428415b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.833+0000 7f4288890640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42841e3fc0 0x7f42841e4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.833+0000 7f4288890640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42841e2360 con 0x7f428415ce70 2023-11-04T01:41:24.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.833+0000 7f4288890640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42841e4a10 con 0x7f428415d250 2023-11-04T01:41:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.833+0000 7f4288890640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42841e2600 con 0x7f42841e3fc0 2023-11-04T01:41:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.833+0000 7f428259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428415ce70 0x7f42841e6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.833+0000 7f428259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428415ce70 0x7f42841e6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56744/0 (socket says 172.21.15.44:56744) 2023-11-04T01:41:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.833+0000 7f428259c640 1 -- 172.21.15.44:0/415004354 learned_addr learned my addr 172.21.15.44:0/415004354 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.833+0000 7f4281d9b640 1 --2- 172.21.15.44:0/415004354 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f428415d250 0x7f428415b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.833+0000 7f4282d9d640 1 --2- 172.21.15.44:0/415004354 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42841e3fc0 0x7f42841e4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.834+0000 7f428259c640 1 -- 172.21.15.44:0/415004354 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42841e3fc0 msgr2=0x7f42841e4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.834+0000 7f428259c640 1 --2- 172.21.15.44:0/415004354 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42841e3fc0 0x7f42841e4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.834+0000 7f428259c640 1 -- 172.21.15.44:0/415004354 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f428415d250 msgr2=0x7f428415b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.834+0000 7f428259c640 1 --2- 172.21.15.44:0/415004354 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f428415d250 0x7f428415b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.834+0000 7f428259c640 1 -- 172.21.15.44:0/415004354 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42780094d0 con 0x7f428415ce70 2023-11-04T01:41:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.834+0000 7f428259c640 1 --2- 172.21.15.44:0/415004354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428415ce70 0x7f42841e6050 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f427400c7f0 tx=0x7f427400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.834+0000 7f4272ffd640 1 -- 172.21.15.44:0/415004354 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274007a30 con 0x7f428415ce70 2023-11-04T01:41:24.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.834+0000 7f4272ffd640 1 -- 172.21.15.44:0/415004354 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4274007b90 con 0x7f428415ce70 2023-11-04T01:41:24.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.834+0000 7f4288890640 1 -- 172.21.15.44:0/415004354 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42841e28e0 con 0x7f428415ce70 2023-11-04T01:41:24.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.834+0000 7f4272ffd640 1 -- 172.21.15.44:0/415004354 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427400ce40 con 0x7f428415ce70 2023-11-04T01:41:24.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.834+0000 7f4288890640 1 -- 172.21.15.44:0/415004354 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42841e6590 con 0x7f428415ce70 2023-11-04T01:41:24.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.835+0000 7f4288890640 1 -- 172.21.15.44:0/415004354 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42841e2e00 con 0x7f428415ce70 2023-11-04T01:41:24.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.836+0000 7f4272ffd640 1 -- 172.21.15.44:0/415004354 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42740113f0 con 0x7f428415ce70 2023-11-04T01:41:24.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.836+0000 7f4272ffd640 1 --2- 172.21.15.44:0/415004354 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f426406aea0 0x7f426406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.836+0000 7f4272ffd640 1 -- 172.21.15.44:0/415004354 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7f4274089d50 con 0x7f428415ce70 2023-11-04T01:41:24.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.836+0000 7f4281d9b640 1 --2- 172.21.15.44:0/415004354 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f426406aea0 0x7f426406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.839 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.837+0000 7f4281d9b640 1 --2- 172.21.15.44:0/415004354 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f426406aea0 0x7f426406d360 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4278036000 tx=0x7f427803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:24.841+0000 7f4272ffd640 1 -- 172.21.15.44:0/415004354 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42841e2e00 con 0x7f428415ce70 2023-11-04T01:41:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:25.054+0000 7f4288890640 1 -- 172.21.15.44:0/415004354 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42841e2e00 con 0x7f428415ce70 2023-11-04T01:41:25.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:25.055+0000 7f4272ffd640 1 -- 172.21.15.44:0/415004354 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f42841e2e00 con 0x7f428415ce70 2023-11-04T01:41:25.056 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:25.056 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:13.673859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7797,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7797":{"gid":7797,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":11,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:25.056 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 76 2023-11-04T01:41:25.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:25.057+0000 7f4288890640 1 -- 172.21.15.44:0/415004354 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f426406aea0 msgr2=0x7f426406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:25.057+0000 7f4288890640 1 --2- 172.21.15.44:0/415004354 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f426406aea0 0x7f426406d360 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4278036000 tx=0x7f427803c040 comp rx=0 tx=0).stop 2023-11-04T01:41:25.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:25.057+0000 7f4288890640 1 -- 172.21.15.44:0/415004354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428415ce70 msgr2=0x7f42841e6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:25.057+0000 7f4288890640 1 --2- 172.21.15.44:0/415004354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428415ce70 0x7f42841e6050 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f427400c7f0 tx=0x7f427400cbf0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:25.057+0000 7f4288890640 1 -- 172.21.15.44:0/415004354 shutdown_connections 2023-11-04T01:41:25.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:25.057+0000 7f4288890640 1 --2- 172.21.15.44:0/415004354 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f426406aea0 0x7f426406d360 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:25.057+0000 7f4288890640 1 --2- 172.21.15.44:0/415004354 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42841e3fc0 0x7f42841e4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:25.057+0000 7f4288890640 1 --2- 172.21.15.44:0/415004354 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f428415d250 0x7f428415b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:25.057+0000 7f4288890640 1 --2- 172.21.15.44:0/415004354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428415ce70 0x7f42841e6050 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:25.057+0000 7f4288890640 1 -- 172.21.15.44:0/415004354 >> 172.21.15.44:0/415004354 conn(0x7f42840b0cd0 msgr2=0x7f42840ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:25.057+0000 7f4288890640 1 -- 172.21.15.44:0/415004354 shutdown_connections 2023-11-04T01:41:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:25.057+0000 7f4288890640 1 -- 172.21.15.44:0/415004354 wait complete. 2023-11-04T01:41:25.068 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:26.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-04T01:41:28.947 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:28.951 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:30.070 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:30.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.186+0000 7f58b978a640 1 Processor -- start 2023-11-04T01:41:30.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.186+0000 7f58b978a640 1 -- start start 2023-11-04T01:41:30.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.187+0000 7f58b978a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f58b415ae40 0x7f58b415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.187+0000 7f58b978a640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b40cc450 con 0x7f58b40cbc00 2023-11-04T01:41:30.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.187+0000 7f58b978a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b415f400 con 0x7f58b40cda30 2023-11-04T01:41:30.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.187+0000 7f58b978a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b415b220 con 0x7f58b415ae40 2023-11-04T01:41:30.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.187+0000 7f58b2ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f58b415ae40 0x7f58b415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.187+0000 7f58b27fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f58b40cbc00 0x7f58b40cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51860/0 (socket says 172.21.15.44:51860) 2023-11-04T01:41:30.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.187+0000 7f58b27fc640 1 -- 172.21.15.44:0/2627138310 learned_addr learned my addr 172.21.15.44:0/2627138310 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:30.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.187+0000 7f58b2ffd640 1 -- 172.21.15.44:0/2627138310 >> v1:172.21.15.204:6789/0 conn(0x7f58b40cda30 legacy=0x7f58b40ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.187+0000 7f58b2ffd640 1 -- 172.21.15.44:0/2627138310 >> v1:172.21.15.44:6789/0 conn(0x7f58b40cbc00 legacy=0x7f58b40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.187+0000 7f58b1ffb640 1 -- 172.21.15.44:0/2627138310 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365795237 0 0) 0x7f58a8001110 con 0x7f58b40cbc00 2023-11-04T01:41:30.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.188+0000 7f58b2ffd640 1 -- 172.21.15.44:0/2627138310 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b415f890 con 0x7f58b415ae40 2023-11-04T01:41:30.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.188+0000 7f58b2ffd640 1 --2- 172.21.15.44:0/2627138310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58b415ae40 0x7f58b415bfb0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f58a40097a0 tx=0x7f58a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a0d3d938e641a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.188+0000 7f58b1ffb640 1 -- 172.21.15.44:0/2627138310 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4031830 con 0x7f58b415ae40 2023-11-04T01:41:30.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.188+0000 7f58b1ffb640 1 -- 172.21.15.44:0/2627138310 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4031990 con 0x7f58b415ae40 2023-11-04T01:41:30.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.188+0000 7f58b1ffb640 1 -- 172.21.15.44:0/2627138310 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4031d20 con 0x7f58b415ae40 2023-11-04T01:41:30.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.189+0000 7f58b978a640 1 -- 172.21.15.44:0/2627138310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58b415ae40 msgr2=0x7f58b415bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.189+0000 7f58b978a640 1 --2- 172.21.15.44:0/2627138310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58b415ae40 0x7f58b415bfb0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f58a40097a0 tx=0x7f58a402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.189+0000 7f58b978a640 1 -- 172.21.15.44:0/2627138310 shutdown_connections 2023-11-04T01:41:30.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.189+0000 7f58b978a640 1 --2- 172.21.15.44:0/2627138310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58b415ae40 0x7f58b415bfb0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.189+0000 7f58b978a640 1 -- 172.21.15.44:0/2627138310 >> 172.21.15.44:0/2627138310 conn(0x7f58b406ea90 msgr2=0x7f58b406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.189+0000 7f58b978a640 1 -- 172.21.15.44:0/2627138310 shutdown_connections 2023-11-04T01:41:30.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.189+0000 7f58b978a640 1 -- 172.21.15.44:0/2627138310 wait complete. 2023-11-04T01:41:30.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.190+0000 7f58b978a640 1 Processor -- start 2023-11-04T01:41:30.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.191+0000 7f58b978a640 1 -- start start 2023-11-04T01:41:30.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.191+0000 7f58b978a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58b40cbc00 0x7f58b406c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.191+0000 7f58b978a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58b40cda30 0x7f58b41eca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.191+0000 7f58b978a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58b415ae40 0x7f58b40c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.191+0000 7f58b978a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b414fb20 con 0x7f58b40cda30 2023-11-04T01:41:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.191+0000 7f58b978a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b40c7f80 con 0x7f58b415ae40 2023-11-04T01:41:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.191+0000 7f58b978a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b41ecfc0 con 0x7f58b40cbc00 2023-11-04T01:41:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.191+0000 7f58b27fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58b40cda30 0x7f58b41eca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.191+0000 7f58b27fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58b40cda30 0x7f58b41eca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56770/0 (socket says 172.21.15.44:56770) 2023-11-04T01:41:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.192+0000 7f58b27fc640 1 -- 172.21.15.44:0/2123870695 learned_addr learned my addr 172.21.15.44:0/2123870695 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.192+0000 7f58b37fe640 1 --2- 172.21.15.44:0/2123870695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58b415ae40 0x7f58b40c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.192+0000 7f58b2ffd640 1 --2- 172.21.15.44:0/2123870695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58b40cbc00 0x7f58b406c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.192+0000 7f58b27fc640 1 -- 172.21.15.44:0/2123870695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58b40cbc00 msgr2=0x7f58b406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.192+0000 7f58b27fc640 1 --2- 172.21.15.44:0/2123870695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58b40cbc00 0x7f58b406c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.192+0000 7f58b27fc640 1 -- 172.21.15.44:0/2123870695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58b415ae40 msgr2=0x7f58b40c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.192+0000 7f58b27fc640 1 --2- 172.21.15.44:0/2123870695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58b415ae40 0x7f58b40c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.192+0000 7f58b27fc640 1 -- 172.21.15.44:0/2123870695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a4009400 con 0x7f58b40cda30 2023-11-04T01:41:30.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.192+0000 7f58b2ffd640 1 --2- 172.21.15.44:0/2123870695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58b40cbc00 0x7f58b406c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:30.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.192+0000 7f58b27fc640 1 --2- 172.21.15.44:0/2123870695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58b40cda30 0x7f58b41eca80 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f58a800c460 tx=0x7f58a800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.192+0000 7f589b7fe640 1 -- 172.21.15.44:0/2123870695 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a80074e0 con 0x7f58b40cda30 2023-11-04T01:41:30.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.192+0000 7f589b7fe640 1 -- 172.21.15.44:0/2123870695 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a8007660 con 0x7f58b40cda30 2023-11-04T01:41:30.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.192+0000 7f589b7fe640 1 -- 172.21.15.44:0/2123870695 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a8004a20 con 0x7f58b40cda30 2023-11-04T01:41:30.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.192+0000 7f58b978a640 1 -- 172.21.15.44:0/2123870695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b406b6c0 con 0x7f58b40cda30 2023-11-04T01:41:30.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.192+0000 7f58b978a640 1 -- 172.21.15.44:0/2123870695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b406ba50 con 0x7f58b40cda30 2023-11-04T01:41:30.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.193+0000 7f58b978a640 1 -- 172.21.15.44:0/2123870695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b40ce2d0 con 0x7f58b40cda30 2023-11-04T01:41:30.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.194+0000 7f589b7fe640 1 -- 172.21.15.44:0/2123870695 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f58a8004b80 con 0x7f58b40cda30 2023-11-04T01:41:30.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.194+0000 7f589b7fe640 1 --2- 172.21.15.44:0/2123870695 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f58a006ae70 0x7f58a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.194+0000 7f589b7fe640 1 -- 172.21.15.44:0/2123870695 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7f58a8088c50 con 0x7f58b40cda30 2023-11-04T01:41:30.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.194+0000 7f58b2ffd640 1 --2- 172.21.15.44:0/2123870695 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f58a006ae70 0x7f58a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.199 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.195+0000 7f58b2ffd640 1 --2- 172.21.15.44:0/2123870695 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f58a006ae70 0x7f58a006d330 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f58a4036000 tx=0x7f58a403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.198+0000 7f589b7fe640 1 -- 172.21.15.44:0/2123870695 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f58a808e020 con 0x7f58b40cda30 2023-11-04T01:41:30.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.411+0000 7f58b978a640 1 -- 172.21.15.44:0/2123870695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58b40cc450 con 0x7f58b40cda30 2023-11-04T01:41:30.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.411+0000 7f589b7fe640 1 -- 172.21.15.44:0/2123870695 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4983 (secure 0 0 0) 0x7f58b40cc450 con 0x7f58b40cda30 2023-11-04T01:41:30.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:30.414 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":77,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:29.222603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7797,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7797":{"gid":7797,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":11,"addr":"172.21.15.44:6835/1627866359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1627866359},{"type":"v1","addr":"172.21.15.44:6835","nonce":1627866359}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:41:29.222603+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:30.414 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 77 2023-11-04T01:41:30.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.413+0000 7f58b978a640 1 -- 172.21.15.44:0/2123870695 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f58a006ae70 msgr2=0x7f58a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.413+0000 7f58b978a640 1 --2- 172.21.15.44:0/2123870695 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f58a006ae70 0x7f58a006d330 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f58a4036000 tx=0x7f58a403c040 comp rx=0 tx=0).stop 2023-11-04T01:41:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.413+0000 7f58b978a640 1 -- 172.21.15.44:0/2123870695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58b40cda30 msgr2=0x7f58b41eca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.413+0000 7f58b978a640 1 --2- 172.21.15.44:0/2123870695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58b40cda30 0x7f58b41eca80 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f58a800c460 tx=0x7f58a800c920 comp rx=0 tx=0).stop 2023-11-04T01:41:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.413+0000 7f58b978a640 1 -- 172.21.15.44:0/2123870695 shutdown_connections 2023-11-04T01:41:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.413+0000 7f58b978a640 1 --2- 172.21.15.44:0/2123870695 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f58a006ae70 0x7f58a006d330 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.413+0000 7f58b978a640 1 --2- 172.21.15.44:0/2123870695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58b415ae40 0x7f58b40c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.413+0000 7f58b978a640 1 --2- 172.21.15.44:0/2123870695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58b40cda30 0x7f58b41eca80 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.413+0000 7f58b978a640 1 --2- 172.21.15.44:0/2123870695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58b40cbc00 0x7f58b406c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.413+0000 7f58b978a640 1 -- 172.21.15.44:0/2123870695 >> 172.21.15.44:0/2123870695 conn(0x7f58b406ea90 msgr2=0x7f58b40b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.413+0000 7f58b978a640 1 -- 172.21.15.44:0/2123870695 shutdown_connections 2023-11-04T01:41:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.413+0000 7f58b978a640 1 -- 172.21.15.44:0/2123870695 wait complete. 2023-11-04T01:41:30.426 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:41:30.426 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:41:30.455 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:41:30.456 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:41:30.457 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:41:30.530 INFO:teuthology.orchestra.run.smithi044.stdout:1699062074.119552.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:41:30.532 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062074.119552.core'] 2023-11-04T01:41:30.532 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062074.119552.core, deleting it 2023-11-04T01:41:30.532 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062074.119552.core 2023-11-04T01:41:30.606 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:41:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.751+0000 7f9c9dd25640 1 Processor -- start 2023-11-04T01:41:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.751+0000 7f9c9dd25640 1 -- start start 2023-11-04T01:41:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.752+0000 7f9c9dd25640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9c980d0710 0x7f9c980cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.752+0000 7f9c9dd25640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9c980cda50 0x7f9c980b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.752+0000 7f9c9dd25640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c980d0280 con 0x7f9c9815e430 2023-11-04T01:41:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.752+0000 7f9c9dd25640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c980cf670 con 0x7f9c980d0710 2023-11-04T01:41:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.752+0000 7f9c9dd25640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c980cf950 con 0x7f9c980cda50 2023-11-04T01:41:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.752+0000 7f9c96ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9c980d0710 0x7f9c980cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.752+0000 7f9c977fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9c9815e430 0x7f9c980cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51868/0 (socket says 172.21.15.44:51868) 2023-11-04T01:41:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.752+0000 7f9c977fe640 1 -- 172.21.15.44:0/898960838 learned_addr learned my addr 172.21.15.44:0/898960838 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.752+0000 7f9c97fff640 1 --2- 172.21.15.44:0/898960838 >> v2:172.21.15.204:3300/0 conn(0x7f9c980cda50 0x7f9c980b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.752+0000 7f9c96ffd640 1 -- 172.21.15.44:0/898960838 >> v2:172.21.15.204:3300/0 conn(0x7f9c980cda50 msgr2=0x7f9c980b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.752+0000 7f9c96ffd640 1 --2- 172.21.15.44:0/898960838 >> v2:172.21.15.204:3300/0 conn(0x7f9c980cda50 0x7f9c980b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.752+0000 7f9c96ffd640 1 -- 172.21.15.44:0/898960838 >> v1:172.21.15.44:6789/0 conn(0x7f9c9815e430 legacy=0x7f9c980cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.752+0000 7f9c96ffd640 1 -- 172.21.15.44:0/898960838 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c980cfc30 con 0x7f9c980d0710 2023-11-04T01:41:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.752+0000 7f9c967fc640 1 -- 172.21.15.44:0/898960838 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778997797 0 0) 0x7f9c980d0280 con 0x7f9c9815e430 2023-11-04T01:41:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.753+0000 7f9c96ffd640 1 --2- 172.21.15.44:0/898960838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c980d0710 0x7f9c980cd510 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f9c980b6250 tx=0x7f9c8c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820e099ac6fc2dc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.753+0000 7f9c967fc640 1 -- 172.21.15.44:0/898960838 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c031830 con 0x7f9c980d0710 2023-11-04T01:41:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.753+0000 7f9c967fc640 1 -- 172.21.15.44:0/898960838 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c031990 con 0x7f9c980d0710 2023-11-04T01:41:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.753+0000 7f9c967fc640 1 -- 172.21.15.44:0/898960838 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c031d20 con 0x7f9c980d0710 2023-11-04T01:41:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.753+0000 7f9c9dd25640 1 -- 172.21.15.44:0/898960838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c980d0710 msgr2=0x7f9c980cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.753+0000 7f9c9dd25640 1 --2- 172.21.15.44:0/898960838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c980d0710 0x7f9c980cd510 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f9c980b6250 tx=0x7f9c8c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.754+0000 7f9c9dd25640 1 -- 172.21.15.44:0/898960838 shutdown_connections 2023-11-04T01:41:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.754+0000 7f9c9dd25640 1 --2- 172.21.15.44:0/898960838 >> v2:172.21.15.204:3300/0 conn(0x7f9c980cda50 0x7f9c980b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.754+0000 7f9c9dd25640 1 --2- 172.21.15.44:0/898960838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c980d0710 0x7f9c980cd510 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.754+0000 7f9c9dd25640 1 -- 172.21.15.44:0/898960838 >> 172.21.15.44:0/898960838 conn(0x7f9c9806ea20 msgr2=0x7f9c9806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.754+0000 7f9c9dd25640 1 -- 172.21.15.44:0/898960838 shutdown_connections 2023-11-04T01:41:30.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.754+0000 7f9c9dd25640 1 -- 172.21.15.44:0/898960838 wait complete. 2023-11-04T01:41:30.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.755+0000 7f9c9dd25640 1 Processor -- start 2023-11-04T01:41:30.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.755+0000 7f9c9dd25640 1 -- start start 2023-11-04T01:41:30.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c9dd25640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c980cda50 0x7f9c9815a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c9dd25640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c980d0710 0x7f9c9806b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c9dd25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c9815e430 0x7f9c980c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c9dd25640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980b1580 con 0x7f9c9815e430 2023-11-04T01:41:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c9dd25640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980b0c50 con 0x7f9c980cda50 2023-11-04T01:41:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c9dd25640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980b0f30 con 0x7f9c980d0710 2023-11-04T01:41:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c97fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c9815e430 0x7f9c980c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c97fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c9815e430 0x7f9c980c9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56788/0 (socket says 172.21.15.44:56788) 2023-11-04T01:41:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c97fff640 1 -- 172.21.15.44:0/3745742496 learned_addr learned my addr 172.21.15.44:0/3745742496 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c977fe640 1 --2- 172.21.15.44:0/3745742496 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c980cda50 0x7f9c9815a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c96ffd640 1 --2- 172.21.15.44:0/3745742496 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c980d0710 0x7f9c9806b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c97fff640 1 -- 172.21.15.44:0/3745742496 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c980d0710 msgr2=0x7f9c9806b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c97fff640 1 --2- 172.21.15.44:0/3745742496 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c980d0710 0x7f9c9806b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c97fff640 1 -- 172.21.15.44:0/3745742496 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c980cda50 msgr2=0x7f9c9815a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c97fff640 1 --2- 172.21.15.44:0/3745742496 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c980cda50 0x7f9c9815a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c97fff640 1 -- 172.21.15.44:0/3745742496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c009400 con 0x7f9c9815e430 2023-11-04T01:41:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.756+0000 7f9c97fff640 1 --2- 172.21.15.44:0/3745742496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c9815e430 0x7f9c980c9970 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f9c90007e60 tx=0x7f9c9000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.757+0000 7f9c7ffff640 1 -- 172.21.15.44:0/3745742496 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90014420 con 0x7f9c9815e430 2023-11-04T01:41:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.757+0000 7f9c7ffff640 1 -- 172.21.15.44:0/3745742496 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c900145a0 con 0x7f9c9815e430 2023-11-04T01:41:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.757+0000 7f9c7ffff640 1 -- 172.21.15.44:0/3745742496 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90014950 con 0x7f9c9815e430 2023-11-04T01:41:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.757+0000 7f9c9dd25640 1 -- 172.21.15.44:0/3745742496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c980b1210 con 0x7f9c9815e430 2023-11-04T01:41:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.757+0000 7f9c9dd25640 1 -- 172.21.15.44:0/3745742496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c980b55d0 con 0x7f9c9815e430 2023-11-04T01:41:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.758+0000 7f9c9dd25640 1 -- 172.21.15.44:0/3745742496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c980b16f0 con 0x7f9c9815e430 2023-11-04T01:41:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.758+0000 7f9c7ffff640 1 -- 172.21.15.44:0/3745742496 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c90014ab0 con 0x7f9c9815e430 2023-11-04T01:41:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.758+0000 7f9c7ffff640 1 --2- 172.21.15.44:0/3745742496 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c8406ae70 0x7f9c8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.759+0000 7f9c7ffff640 1 -- 172.21.15.44:0/3745742496 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7408+0+0 (secure 0 0 0) 0x7f9c9008a510 con 0x7f9c9815e430 2023-11-04T01:41:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.759+0000 7f9c977fe640 1 --2- 172.21.15.44:0/3745742496 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c8406ae70 0x7f9c8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.759+0000 7f9c977fe640 1 --2- 172.21.15.44:0/3745742496 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c8406ae70 0x7f9c8406d330 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9c88000f60 tx=0x7f9c88007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:30.763+0000 7f9c7ffff640 1 -- 172.21.15.44:0/3745742496 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c90054f50 con 0x7f9c9815e430 2023-11-04T01:41:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.009+0000 7f9c9dd25640 1 -- 172.21.15.44:0/3745742496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f9c98074290 con 0x7f9c9815e430 2023-11-04T01:41:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.011+0000 7f9c7ffff640 1 -- 172.21.15.44:0/3745742496 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7797 v78) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9c90058570 con 0x7f9c9815e430 2023-11-04T01:41:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:failed mds gid 7797 2023-11-04T01:41:31.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.014+0000 7f9c9dd25640 1 -- 172.21.15.44:0/3745742496 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c8406ae70 msgr2=0x7f9c8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.014+0000 7f9c9dd25640 1 --2- 172.21.15.44:0/3745742496 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c8406ae70 0x7f9c8406d330 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9c88000f60 tx=0x7f9c88007d50 comp rx=0 tx=0).stop 2023-11-04T01:41:31.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.014+0000 7f9c9dd25640 1 -- 172.21.15.44:0/3745742496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c9815e430 msgr2=0x7f9c980c9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.016 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.014+0000 7f9c9dd25640 1 --2- 172.21.15.44:0/3745742496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c9815e430 0x7f9c980c9970 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f9c90007e60 tx=0x7f9c9000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.014+0000 7f9c9dd25640 1 -- 172.21.15.44:0/3745742496 shutdown_connections 2023-11-04T01:41:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.014+0000 7f9c9dd25640 1 --2- 172.21.15.44:0/3745742496 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f9c8406ae70 0x7f9c8406d330 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.014+0000 7f9c9dd25640 1 --2- 172.21.15.44:0/3745742496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c9815e430 0x7f9c980c9970 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.014+0000 7f9c9dd25640 1 --2- 172.21.15.44:0/3745742496 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c980d0710 0x7f9c9806b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.014+0000 7f9c9dd25640 1 --2- 172.21.15.44:0/3745742496 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c980cda50 0x7f9c9815a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.014+0000 7f9c9dd25640 1 -- 172.21.15.44:0/3745742496 >> 172.21.15.44:0/3745742496 conn(0x7f9c9806ea20 msgr2=0x7f9c9815c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.014+0000 7f9c9dd25640 1 -- 172.21.15.44:0/3745742496 shutdown_connections 2023-11-04T01:41:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.014+0000 7f9c9dd25640 1 -- 172.21.15.44:0/3745742496 wait complete. 2023-11-04T01:41:31.029 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:41:31.029 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:41:31.029 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:41:31.029 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:31.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:31.030 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:41:31.030 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:41:31.030 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:41:31.033 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:41:31.033 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:31.114 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2023-11-04T01:41:31.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.137+0000 7f29a513c640 1 Processor -- start 2023-11-04T01:41:31.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.137+0000 7f29a513c640 1 -- start start 2023-11-04T01:41:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.138+0000 7f29a513c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29a00cde60 0x7f29a015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.138+0000 7f29a513c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f29a015daa0 0x7f29a0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.138+0000 7f29a513c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f29a00ce240 0x7f29a0157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.138+0000 7f29a513c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a015e5c0 con 0x7f29a015daa0 2023-11-04T01:41:31.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.138+0000 7f29a513c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a0157a80 con 0x7f29a00ce240 2023-11-04T01:41:31.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.138+0000 7f29a513c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a015e000 con 0x7f29a00cde60 2023-11-04T01:41:31.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.138+0000 7f299e59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f29a015daa0 0x7f29a0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.138+0000 7f299e59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f29a015daa0 0x7f29a0157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56804/0 (socket says 172.21.15.44:56804) 2023-11-04T01:41:31.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.138+0000 7f299e59c640 1 -- 172.21.15.44:0/857482864 learned_addr learned my addr 172.21.15.44:0/857482864 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:31.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.139+0000 7f299f59e640 1 --2- 172.21.15.44:0/857482864 >> v2:172.21.15.204:3300/0 conn(0x7f29a00ce240 0x7f29a0157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.139+0000 7f299ed9d640 1 --2- 172.21.15.44:0/857482864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29a00cde60 0x7f29a015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.139+0000 7f299e59c640 1 -- 172.21.15.44:0/857482864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29a00cde60 msgr2=0x7f29a015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:31.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.139+0000 7f299e59c640 1 --2- 172.21.15.44:0/857482864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29a00cde60 0x7f29a015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.139+0000 7f299e59c640 1 -- 172.21.15.44:0/857482864 >> v2:172.21.15.204:3300/0 conn(0x7f29a00ce240 msgr2=0x7f29a0157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:31.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.139+0000 7f299e59c640 1 --2- 172.21.15.44:0/857482864 >> v2:172.21.15.204:3300/0 conn(0x7f29a00ce240 0x7f29a0157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.139+0000 7f299e59c640 1 -- 172.21.15.44:0/857482864 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a015e2e0 con 0x7f29a015daa0 2023-11-04T01:41:31.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.139+0000 7f299f59e640 1 --2- 172.21.15.44:0/857482864 >> v2:172.21.15.204:3300/0 conn(0x7f29a00ce240 0x7f29a0157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:31.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.139+0000 7f299e59c640 1 --2- 172.21.15.44:0/857482864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a015daa0 0x7f29a0157000 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f29a015df30 tx=0x7f298802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6d6447fbf241d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:31.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.140+0000 7f299dd9b640 1 -- 172.21.15.44:0/857482864 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988031870 con 0x7f29a015daa0 2023-11-04T01:41:31.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.140+0000 7f299dd9b640 1 -- 172.21.15.44:0/857482864 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29880319d0 con 0x7f29a015daa0 2023-11-04T01:41:31.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.140+0000 7f299dd9b640 1 -- 172.21.15.44:0/857482864 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988031d60 con 0x7f29a015daa0 2023-11-04T01:41:31.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.140+0000 7f29a513c640 1 -- 172.21.15.44:0/857482864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a015daa0 msgr2=0x7f29a0157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.140+0000 7f29a513c640 1 --2- 172.21.15.44:0/857482864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a015daa0 0x7f29a0157000 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f29a015df30 tx=0x7f298802b910 comp rx=0 tx=0).stop 2023-11-04T01:41:31.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.140+0000 7f29a513c640 1 -- 172.21.15.44:0/857482864 shutdown_connections 2023-11-04T01:41:31.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.140+0000 7f29a513c640 1 --2- 172.21.15.44:0/857482864 >> v2:172.21.15.204:3300/0 conn(0x7f29a00ce240 0x7f29a0157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.140+0000 7f29a513c640 1 --2- 172.21.15.44:0/857482864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a015daa0 0x7f29a0157000 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.140+0000 7f29a513c640 1 --2- 172.21.15.44:0/857482864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29a00cde60 0x7f29a015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.140+0000 7f29a513c640 1 -- 172.21.15.44:0/857482864 >> 172.21.15.44:0/857482864 conn(0x7f29a0071f30 msgr2=0x7f29a00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:31.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.140+0000 7f29a513c640 1 -- 172.21.15.44:0/857482864 shutdown_connections 2023-11-04T01:41:31.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.140+0000 7f29a513c640 1 -- 172.21.15.44:0/857482864 wait complete. 2023-11-04T01:41:31.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.142+0000 7f29a513c640 1 Processor -- start 2023-11-04T01:41:31.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.142+0000 7f29a513c640 1 -- start start 2023-11-04T01:41:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.142+0000 7f29a513c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a00cde60 0x7f29a01f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.142+0000 7f29a513c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29a00ce240 0x7f29a01f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.142+0000 7f29a513c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29a015daa0 0x7f29a0159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.142+0000 7f29a513c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a014cce0 con 0x7f29a00cde60 2023-11-04T01:41:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.142+0000 7f29a513c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a01f3530 con 0x7f29a015daa0 2023-11-04T01:41:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.142+0000 7f29a513c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a00c97b0 con 0x7f29a00ce240 2023-11-04T01:41:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.142+0000 7f299ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a00cde60 0x7f29a01f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f299ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a00cde60 0x7f29a01f27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56806/0 (socket says 172.21.15.44:56806) 2023-11-04T01:41:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f299ed9d640 1 -- 172.21.15.44:0/4142478702 learned_addr learned my addr 172.21.15.44:0/4142478702 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f299f59e640 1 --2- 172.21.15.44:0/4142478702 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29a015daa0 0x7f29a0159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f299e59c640 1 --2- 172.21.15.44:0/4142478702 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29a00ce240 0x7f29a01f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f299ed9d640 1 -- 172.21.15.44:0/4142478702 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29a00ce240 msgr2=0x7f29a01f39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f299ed9d640 1 --2- 172.21.15.44:0/4142478702 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29a00ce240 0x7f29a01f39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f299ed9d640 1 -- 172.21.15.44:0/4142478702 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29a015daa0 msgr2=0x7f29a0159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f299ed9d640 1 --2- 172.21.15.44:0/4142478702 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29a015daa0 0x7f29a0159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f299ed9d640 1 -- 172.21.15.44:0/4142478702 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29880094d0 con 0x7f29a00cde60 2023-11-04T01:41:31.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f299e59c640 1 --2- 172.21.15.44:0/4142478702 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29a00ce240 0x7f29a01f39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:31.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f299ed9d640 1 --2- 172.21.15.44:0/4142478702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a00cde60 0x7f29a01f27f0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f299800d800 tx=0x7f299800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:31.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f29977fe640 1 -- 172.21.15.44:0/4142478702 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29980096a0 con 0x7f29a00cde60 2023-11-04T01:41:31.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f29977fe640 1 -- 172.21.15.44:0/4142478702 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2998009800 con 0x7f29a00cde60 2023-11-04T01:41:31.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f29a513c640 1 -- 172.21.15.44:0/4142478702 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a01f6f60 con 0x7f29a00cde60 2023-11-04T01:41:31.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f29977fe640 1 -- 172.21.15.44:0/4142478702 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998009b90 con 0x7f29a00cde60 2023-11-04T01:41:31.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.143+0000 7f29a513c640 1 -- 172.21.15.44:0/4142478702 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a01f31c0 con 0x7f29a00cde60 2023-11-04T01:41:31.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.144+0000 7f29a513c640 1 -- 172.21.15.44:0/4142478702 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a00cd930 con 0x7f29a00cde60 2023-11-04T01:41:31.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.145+0000 7f29977fe640 1 -- 172.21.15.44:0/4142478702 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2998009cf0 con 0x7f29a00cde60 2023-11-04T01:41:31.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.145+0000 7f29977fe640 1 --2- 172.21.15.44:0/4142478702 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f298006ae70 0x7f298006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.145+0000 7f29977fe640 1 -- 172.21.15.44:0/4142478702 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7494+0+0 (secure 0 0 0) 0x7f299808a030 con 0x7f29a00cde60 2023-11-04T01:41:31.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.145+0000 7f299e59c640 1 --2- 172.21.15.44:0/4142478702 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f298006ae70 0x7f298006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.146+0000 7f299e59c640 1 --2- 172.21.15.44:0/4142478702 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f298006ae70 0x7f298006d330 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2988036000 tx=0x7f298803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:31.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.149+0000 7f29977fe640 1 -- 172.21.15.44:0/4142478702 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2998054a70 con 0x7f29a00cde60 2023-11-04T01:41:31.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.364+0000 7f29a513c640 1 -- 172.21.15.44:0/4142478702 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29a015cf90 con 0x7f29a00cde60 2023-11-04T01:41:31.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.365+0000 7f29977fe640 1 -- 172.21.15.44:0/4142478702 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4143 (secure 0 0 0) 0x7f299800b440 con 0x7f29a00cde60 2023-11-04T01:41:31.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":79,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:31.015413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6347,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6347":{"gid":6347,"name":"d","rank":0,"incarnation":79,"state":"up:replay","state_seq":1,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:31.367 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 79 2023-11-04T01:41:31.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.367+0000 7f29a513c640 1 -- 172.21.15.44:0/4142478702 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f298006ae70 msgr2=0x7f298006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.367+0000 7f29a513c640 1 --2- 172.21.15.44:0/4142478702 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f298006ae70 0x7f298006d330 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2988036000 tx=0x7f298803c040 comp rx=0 tx=0).stop 2023-11-04T01:41:31.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.367+0000 7f29a513c640 1 -- 172.21.15.44:0/4142478702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a00cde60 msgr2=0x7f29a01f27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.367+0000 7f29a513c640 1 --2- 172.21.15.44:0/4142478702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a00cde60 0x7f29a01f27f0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f299800d800 tx=0x7f299800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.367+0000 7f29a513c640 1 -- 172.21.15.44:0/4142478702 shutdown_connections 2023-11-04T01:41:31.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.367+0000 7f29a513c640 1 --2- 172.21.15.44:0/4142478702 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f298006ae70 0x7f298006d330 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.367+0000 7f29a513c640 1 --2- 172.21.15.44:0/4142478702 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29a015daa0 0x7f29a0159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.367+0000 7f29a513c640 1 --2- 172.21.15.44:0/4142478702 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29a00ce240 0x7f29a01f39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.367+0000 7f29a513c640 1 --2- 172.21.15.44:0/4142478702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a00cde60 0x7f29a01f27f0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.367+0000 7f29a513c640 1 -- 172.21.15.44:0/4142478702 >> 172.21.15.44:0/4142478702 conn(0x7f29a0071f30 msgr2=0x7f29a00b7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:31.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.367+0000 7f29a513c640 1 -- 172.21.15.44:0/4142478702 shutdown_connections 2023-11-04T01:41:31.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:31.367+0000 7f29a513c640 1 -- 172.21.15.44:0/4142478702 wait complete. 2023-11-04T01:41:31.379 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:41:33.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:41:36.380 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.498+0000 7fc31cce1640 1 Processor -- start 2023-11-04T01:41:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.498+0000 7fc31cce1640 1 -- start start 2023-11-04T01:41:36.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.498+0000 7fc31cce1640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc318157710 0x7fc318167b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.498+0000 7fc31cce1640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31815e000 con 0x7fc3180ce240 2023-11-04T01:41:36.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.498+0000 7fc31cce1640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31815e2e0 con 0x7fc3180cde60 2023-11-04T01:41:36.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.498+0000 7fc31cce1640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31815e5c0 con 0x7fc318157710 2023-11-04T01:41:36.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.499+0000 7fc316d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc318157710 0x7fc318167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.499+0000 7fc30ffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc3180ce240 0x7fc318157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46936/0 (socket says 172.21.15.44:46936) 2023-11-04T01:41:36.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.499+0000 7fc30ffff640 1 -- 172.21.15.44:0/864863896 learned_addr learned my addr 172.21.15.44:0/864863896 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:36.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.499+0000 7fc316d9d640 1 -- 172.21.15.44:0/864863896 >> v1:172.21.15.204:6789/0 conn(0x7fc3180cde60 legacy=0x7fc31815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.499+0000 7fc316d9d640 1 -- 172.21.15.44:0/864863896 >> v1:172.21.15.44:6789/0 conn(0x7fc3180ce240 legacy=0x7fc318157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.499+0000 7fc315d9b640 1 -- 172.21.15.44:0/864863896 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943151494 0 0) 0x7fc31815e000 con 0x7fc3180ce240 2023-11-04T01:41:36.502 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.499+0000 7fc316d9d640 1 -- 172.21.15.44:0/864863896 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3180d1120 con 0x7fc318157710 2023-11-04T01:41:36.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.500+0000 7fc316d9d640 1 --2- 172.21.15.44:0/864863896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc318157710 0x7fc318167b90 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc310009d90 tx=0x7fc31002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c029fd3908c1e14 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.500+0000 7fc315d9b640 1 -- 172.21.15.44:0/864863896 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31002cc60 con 0x7fc318157710 2023-11-04T01:41:36.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.500+0000 7fc315d9b640 1 -- 172.21.15.44:0/864863896 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31002cdc0 con 0x7fc318157710 2023-11-04T01:41:36.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.500+0000 7fc315d9b640 1 -- 172.21.15.44:0/864863896 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310034660 con 0x7fc318157710 2023-11-04T01:41:36.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.500+0000 7fc31cce1640 1 -- 172.21.15.44:0/864863896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc318157710 msgr2=0x7fc318167b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.500+0000 7fc31cce1640 1 --2- 172.21.15.44:0/864863896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc318157710 0x7fc318167b90 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc310009d90 tx=0x7fc31002beb0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.500+0000 7fc31cce1640 1 -- 172.21.15.44:0/864863896 shutdown_connections 2023-11-04T01:41:36.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.500+0000 7fc31cce1640 1 --2- 172.21.15.44:0/864863896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc318157710 0x7fc318167b90 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.501+0000 7fc31cce1640 1 -- 172.21.15.44:0/864863896 >> 172.21.15.44:0/864863896 conn(0x7fc318071f30 msgr2=0x7fc3180cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.503 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.501+0000 7fc31cce1640 1 -- 172.21.15.44:0/864863896 shutdown_connections 2023-11-04T01:41:36.504 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.501+0000 7fc31cce1640 1 -- 172.21.15.44:0/864863896 wait complete. 2023-11-04T01:41:36.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.502+0000 7fc31cce1640 1 Processor -- start 2023-11-04T01:41:36.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.502+0000 7fc31cce1640 1 -- start start 2023-11-04T01:41:36.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc31cce1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3180cde60 0x7fc3180b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc31cce1640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3180ce240 0x7fc318158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc31cce1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc318157710 0x7fc3180cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc31cce1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3180cbf20 con 0x7fc3180cde60 2023-11-04T01:41:36.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc31cce1640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3181591e0 con 0x7fc3180ce240 2023-11-04T01:41:36.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc31cce1640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3181594c0 con 0x7fc318157710 2023-11-04T01:41:36.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc31659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3180cde60 0x7fc3180b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc31659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3180cde60 0x7fc3180b3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35006/0 (socket says 172.21.15.44:35006) 2023-11-04T01:41:36.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc31659c640 1 -- 172.21.15.44:0/602843898 learned_addr learned my addr 172.21.15.44:0/602843898 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:36.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc30ffff640 1 --2- 172.21.15.44:0/602843898 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3180ce240 0x7fc318158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc316d9d640 1 --2- 172.21.15.44:0/602843898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc318157710 0x7fc3180cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc31659c640 1 -- 172.21.15.44:0/602843898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc318157710 msgr2=0x7fc3180cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc31659c640 1 --2- 172.21.15.44:0/602843898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc318157710 0x7fc3180cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc31659c640 1 -- 172.21.15.44:0/602843898 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3180ce240 msgr2=0x7fc318158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc31659c640 1 --2- 172.21.15.44:0/602843898 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3180ce240 0x7fc318158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc31659c640 1 -- 172.21.15.44:0/602843898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc310009a70 con 0x7fc3180cde60 2023-11-04T01:41:36.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc316d9d640 1 --2- 172.21.15.44:0/602843898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc318157710 0x7fc3180cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:36.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.503+0000 7fc31659c640 1 --2- 172.21.15.44:0/602843898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3180cde60 0x7fc3180b3fb0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fc30800c430 tx=0x7fc30800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.504+0000 7fc30effd640 1 -- 172.21.15.44:0/602843898 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308011790 con 0x7fc3180cde60 2023-11-04T01:41:36.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.504+0000 7fc30effd640 1 -- 172.21.15.44:0/602843898 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3080118f0 con 0x7fc3180cde60 2023-11-04T01:41:36.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.504+0000 7fc31cce1640 1 -- 172.21.15.44:0/602843898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3181597a0 con 0x7fc3180cde60 2023-11-04T01:41:36.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.504+0000 7fc30effd640 1 -- 172.21.15.44:0/602843898 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308011ce0 con 0x7fc3180cde60 2023-11-04T01:41:36.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.504+0000 7fc31cce1640 1 -- 172.21.15.44:0/602843898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc318159d60 con 0x7fc3180cde60 2023-11-04T01:41:36.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.505+0000 7fc31cce1640 1 -- 172.21.15.44:0/602843898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc318074290 con 0x7fc3180cde60 2023-11-04T01:41:36.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.505+0000 7fc30effd640 1 -- 172.21.15.44:0/602843898 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc30801c460 con 0x7fc3180cde60 2023-11-04T01:41:36.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.506+0000 7fc30effd640 1 --2- 172.21.15.44:0/602843898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc2f806ae70 0x7fc2f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.506+0000 7fc30effd640 1 -- 172.21.15.44:0/602843898 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7494+0+0 (secure 0 0 0) 0x7fc308089ce0 con 0x7fc3180cde60 2023-11-04T01:41:36.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.506+0000 7fc30ffff640 1 --2- 172.21.15.44:0/602843898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc2f806ae70 0x7fc2f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.506+0000 7fc30ffff640 1 --2- 172.21.15.44:0/602843898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc2f806ae70 0x7fc2f806d330 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc3180cca60 tx=0x7fc300007b50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.510+0000 7fc30effd640 1 -- 172.21.15.44:0/602843898 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc308054610 con 0x7fc3180cde60 2023-11-04T01:41:36.713 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:41:36.712+0000 7fc86cc3c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:36.713 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:41:36.712+0000 7fc86cc3c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.724+0000 7fc31cce1640 1 -- 172.21.15.44:0/602843898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3180ceae0 con 0x7fc3180cde60 2023-11-04T01:41:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.725+0000 7fc30effd640 1 -- 172.21.15.44:0/602843898 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fc308057c30 con 0x7fc3180cde60 2023-11-04T01:41:36.727 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:36.727 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:34.033251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6347,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6347":{"gid":6347,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 83 2023-11-04T01:41:36.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.727+0000 7fc31cce1640 1 -- 172.21.15.44:0/602843898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc2f806ae70 msgr2=0x7fc2f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.727+0000 7fc31cce1640 1 --2- 172.21.15.44:0/602843898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc2f806ae70 0x7fc2f806d330 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc3180cca60 tx=0x7fc300007b50 comp rx=0 tx=0).stop 2023-11-04T01:41:36.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.727+0000 7fc31cce1640 1 -- 172.21.15.44:0/602843898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3180cde60 msgr2=0x7fc3180b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.727+0000 7fc31cce1640 1 --2- 172.21.15.44:0/602843898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3180cde60 0x7fc3180b3fb0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fc30800c430 tx=0x7fc30800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.727+0000 7fc31cce1640 1 -- 172.21.15.44:0/602843898 shutdown_connections 2023-11-04T01:41:36.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.727+0000 7fc31cce1640 1 --2- 172.21.15.44:0/602843898 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc2f806ae70 0x7fc2f806d330 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.727+0000 7fc31cce1640 1 --2- 172.21.15.44:0/602843898 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc318157710 0x7fc3180cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.727+0000 7fc31cce1640 1 --2- 172.21.15.44:0/602843898 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3180ce240 0x7fc318158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.727+0000 7fc31cce1640 1 --2- 172.21.15.44:0/602843898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3180cde60 0x7fc3180b3fb0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.727+0000 7fc31cce1640 1 -- 172.21.15.44:0/602843898 >> 172.21.15.44:0/602843898 conn(0x7fc318071f30 msgr2=0x7fc3180b76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.727+0000 7fc31cce1640 1 -- 172.21.15.44:0/602843898 shutdown_connections 2023-11-04T01:41:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.727+0000 7fc31cce1640 1 -- 172.21.15.44:0/602843898 wait complete. 2023-11-04T01:41:36.739 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:41:36.740 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:36.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.844+0000 7fe73f4af640 1 Processor -- start 2023-11-04T01:41:36.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.844+0000 7fe73f4af640 1 -- start start 2023-11-04T01:41:36.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.845+0000 7fe73f4af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe73806a830 0x7fe7380cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.845+0000 7fe73f4af640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe73806eba0 0x7fe7380ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.845+0000 7fe73f4af640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73806d310 con 0x7fe73815ab70 2023-11-04T01:41:36.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.845+0000 7fe73f4af640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7380cba70 con 0x7fe73806eba0 2023-11-04T01:41:36.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.845+0000 7fe73f4af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe738161c50 con 0x7fe73806a830 2023-11-04T01:41:36.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.845+0000 7fe73d24b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe73815ab70 0x7fe73806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46940/0 (socket says 172.21.15.44:46940) 2023-11-04T01:41:36.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.845+0000 7fe73d24b640 1 -- 172.21.15.44:0/3738848706 learned_addr learned my addr 172.21.15.44:0/3738848706 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:36.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.845+0000 7fe73ca4a640 1 --2- 172.21.15.44:0/3738848706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe73806a830 0x7fe7380cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.845+0000 7fe73da4c640 1 --2- 172.21.15.44:0/3738848706 >> v2:172.21.15.204:3300/0 conn(0x7fe73806eba0 0x7fe7380ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.845+0000 7fe72ffff640 1 -- 172.21.15.44:0/3738848706 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974906828 0 0) 0x7fe73806d310 con 0x7fe73815ab70 2023-11-04T01:41:36.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.845+0000 7fe72ffff640 1 -- 172.21.15.44:0/3738848706 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe724003520 con 0x7fe73815ab70 2023-11-04T01:41:36.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe72ffff640 1 -- 172.21.15.44:0/3738848706 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 212413456 0 0) 0x7fe724003520 con 0x7fe73815ab70 2023-11-04T01:41:36.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe72ffff640 1 -- 172.21.15.44:0/3738848706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe73806a830 msgr2=0x7fe7380cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe72ffff640 1 --2- 172.21.15.44:0/3738848706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe73806a830 0x7fe7380cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe72ffff640 1 -- 172.21.15.44:0/3738848706 >> v2:172.21.15.204:3300/0 conn(0x7fe73806eba0 msgr2=0x7fe7380ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe72ffff640 1 --2- 172.21.15.44:0/3738848706 >> v2:172.21.15.204:3300/0 conn(0x7fe73806eba0 0x7fe7380ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe72ffff640 1 -- 172.21.15.44:0/3738848706 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73815d860 con 0x7fe73815ab70 2023-11-04T01:41:36.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe72ffff640 1 -- 172.21.15.44:0/3738848706 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fe7340017f0 con 0x7fe73815ab70 2023-11-04T01:41:36.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe72ffff640 1 -- 172.21.15.44:0/3738848706 >> v1:172.21.15.44:6789/0 conn(0x7fe73815ab70 legacy=0x7fe73806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe72ffff640 1 --2- 172.21.15.44:0/3738848706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe724003970 0x7fe724003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe72ffff640 1 --2- 172.21.15.44:0/3738848706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7240047c0 0x7fe724004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe72ffff640 1 --2- 172.21.15.44:0/3738848706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe73806a830 0x7fe724005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe72ffff640 1 -- 172.21.15.44:0/3738848706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7380cba70 con 0x7fe724003970 2023-11-04T01:41:36.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe72ffff640 1 -- 172.21.15.44:0/3738848706 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe738161c50 con 0x7fe7240047c0 2023-11-04T01:41:36.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe72ffff640 1 -- 172.21.15.44:0/3738848706 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72400b980 con 0x7fe73806a830 2023-11-04T01:41:36.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe73d24b640 1 --2- 172.21.15.44:0/3738848706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe724003970 0x7fe724003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe73ca4a640 1 --2- 172.21.15.44:0/3738848706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7240047c0 0x7fe724004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe73da4c640 1 --2- 172.21.15.44:0/3738848706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe73806a830 0x7fe724005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe73d24b640 1 -- 172.21.15.44:0/3738848706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe73806a830 msgr2=0x7fe724005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe73d24b640 1 --2- 172.21.15.44:0/3738848706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe73806a830 0x7fe724005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe73d24b640 1 -- 172.21.15.44:0/3738848706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7240047c0 msgr2=0x7fe724004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe73d24b640 1 --2- 172.21.15.44:0/3738848706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7240047c0 0x7fe724004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.846+0000 7fe73d24b640 1 -- 172.21.15.44:0/3738848706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe724003520 con 0x7fe724003970 2023-11-04T01:41:36.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.847+0000 7fe73d24b640 1 --2- 172.21.15.44:0/3738848706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe724003970 0x7fe724003d90 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fe73400c1f0 tx=0x7fe7240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e16eeaf8eeb73d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.847+0000 7fe72ffff640 1 -- 172.21.15.44:0/3738848706 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73402cad0 con 0x7fe724003970 2023-11-04T01:41:36.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.847+0000 7fe72ffff640 1 -- 172.21.15.44:0/3738848706 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73402cc30 con 0x7fe724003970 2023-11-04T01:41:36.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.847+0000 7fe72ffff640 1 -- 172.21.15.44:0/3738848706 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe734007070 con 0x7fe724003970 2023-11-04T01:41:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.848+0000 7fe73f4af640 1 -- 172.21.15.44:0/3738848706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe724003970 msgr2=0x7fe724003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.848+0000 7fe73f4af640 1 --2- 172.21.15.44:0/3738848706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe724003970 0x7fe724003d90 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fe73400c1f0 tx=0x7fe7240057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.848+0000 7fe73da4c640 1 -- 172.21.15.44:0/3738848706 reap_dead start 2023-11-04T01:41:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.848+0000 7fe73f4af640 1 -- 172.21.15.44:0/3738848706 shutdown_connections 2023-11-04T01:41:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.848+0000 7fe73f4af640 1 -- 172.21.15.44:0/3738848706 >> 172.21.15.44:0/3738848706 conn(0x7fe738098d40 msgr2=0x7fe7380cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.848+0000 7fe73f4af640 1 -- 172.21.15.44:0/3738848706 shutdown_connections 2023-11-04T01:41:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.848+0000 7fe73f4af640 1 -- 172.21.15.44:0/3738848706 wait complete. 2023-11-04T01:41:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.849+0000 7fe73f4af640 1 Processor -- start 2023-11-04T01:41:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.849+0000 7fe73f4af640 1 -- start start 2023-11-04T01:41:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73f4af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe724003970 0x7fe738148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73f4af640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7381f60f0 0x7fe7381f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73f4af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7380b4670 0x7fe7380b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73f4af640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe738148f50 con 0x7fe7380b4670 2023-11-04T01:41:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73f4af640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7380b5030 con 0x7fe7381f60f0 2023-11-04T01:41:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73f4af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7381f6bb0 con 0x7fe724003970 2023-11-04T01:41:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73da4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7380b4670 0x7fe7380b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73da4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7380b4670 0x7fe7380b4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35026/0 (socket says 172.21.15.44:35026) 2023-11-04T01:41:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73da4c640 1 -- 172.21.15.44:0/243077485 learned_addr learned my addr 172.21.15.44:0/243077485 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73d24b640 1 --2- 172.21.15.44:0/243077485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe724003970 0x7fe738148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73ca4a640 1 --2- 172.21.15.44:0/243077485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7381f60f0 0x7fe7381f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73da4c640 1 -- 172.21.15.44:0/243077485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe724003970 msgr2=0x7fe738148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73da4c640 1 --2- 172.21.15.44:0/243077485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe724003970 0x7fe738148670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73da4c640 1 -- 172.21.15.44:0/243077485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7381f60f0 msgr2=0x7fe7381f6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73da4c640 1 --2- 172.21.15.44:0/243077485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7381f60f0 0x7fe7381f6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73da4c640 1 -- 172.21.15.44:0/243077485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7381f6e90 con 0x7fe7380b4670 2023-11-04T01:41:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73d24b640 1 --2- 172.21.15.44:0/243077485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe724003970 0x7fe738148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73da4c640 1 --2- 172.21.15.44:0/243077485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7380b4670 0x7fe7380b4af0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fe7380cec90 tx=0x7fe73000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe72dffb640 1 -- 172.21.15.44:0/243077485 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73000e040 con 0x7fe7380b4670 2023-11-04T01:41:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe72dffb640 1 -- 172.21.15.44:0/243077485 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73000f040 con 0x7fe7380b4670 2023-11-04T01:41:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe73f4af640 1 -- 172.21.15.44:0/243077485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe738149160 con 0x7fe7380b4670 2023-11-04T01:41:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.850+0000 7fe72dffb640 1 -- 172.21.15.44:0/243077485 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730015430 con 0x7fe7380b4670 2023-11-04T01:41:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.851+0000 7fe73f4af640 1 -- 172.21.15.44:0/243077485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe738148bb0 con 0x7fe7380b4670 2023-11-04T01:41:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.852+0000 7fe73f4af640 1 -- 172.21.15.44:0/243077485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe738074290 con 0x7fe7380b4670 2023-11-04T01:41:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.852+0000 7fe72dffb640 1 -- 172.21.15.44:0/243077485 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe730015590 con 0x7fe7380b4670 2023-11-04T01:41:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.853+0000 7fe72dffb640 1 --2- 172.21.15.44:0/243077485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe71c06ae70 0x7fe71c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.853+0000 7fe72dffb640 1 -- 172.21.15.44:0/243077485 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7494+0+0 (secure 0 0 0) 0x7fe73008a390 con 0x7fe7380b4670 2023-11-04T01:41:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.853+0000 7fe73d24b640 1 --2- 172.21.15.44:0/243077485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe71c06ae70 0x7fe71c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.853+0000 7fe73d24b640 1 --2- 172.21.15.44:0/243077485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe71c06ae70 0x7fe71c06d330 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe734034000 tx=0x7fe734037040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:36.857+0000 7fe72dffb640 1 -- 172.21.15.44:0/243077485 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe730054d40 con 0x7fe7380b4670 2023-11-04T01:41:37.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.068+0000 7fe73f4af640 1 -- 172.21.15.44:0/243077485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe73815e0f0 con 0x7fe7380b4670 2023-11-04T01:41:37.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.068+0000 7fe72dffb640 1 -- 172.21.15.44:0/243077485 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fe730058360 con 0x7fe7380b4670 2023-11-04T01:41:37.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:37.071 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:34.033251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6347,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6347":{"gid":6347,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:37.071 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 83 2023-11-04T01:41:37.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.070+0000 7fe73f4af640 1 -- 172.21.15.44:0/243077485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe71c06ae70 msgr2=0x7fe71c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.070+0000 7fe73f4af640 1 --2- 172.21.15.44:0/243077485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe71c06ae70 0x7fe71c06d330 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe734034000 tx=0x7fe734037040 comp rx=0 tx=0).stop 2023-11-04T01:41:37.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.070+0000 7fe73f4af640 1 -- 172.21.15.44:0/243077485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7380b4670 msgr2=0x7fe7380b4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.070+0000 7fe73f4af640 1 --2- 172.21.15.44:0/243077485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7380b4670 0x7fe7380b4af0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fe7380cec90 tx=0x7fe73000f580 comp rx=0 tx=0).stop 2023-11-04T01:41:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.070+0000 7fe73f4af640 1 -- 172.21.15.44:0/243077485 shutdown_connections 2023-11-04T01:41:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.070+0000 7fe73f4af640 1 --2- 172.21.15.44:0/243077485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe71c06ae70 0x7fe71c06d330 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.070+0000 7fe73f4af640 1 --2- 172.21.15.44:0/243077485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7380b4670 0x7fe7380b4af0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.070+0000 7fe73f4af640 1 --2- 172.21.15.44:0/243077485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe7381f60f0 0x7fe7381f6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.070+0000 7fe73f4af640 1 --2- 172.21.15.44:0/243077485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe724003970 0x7fe738148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.070+0000 7fe73f4af640 1 -- 172.21.15.44:0/243077485 >> 172.21.15.44:0/243077485 conn(0x7fe738098d40 msgr2=0x7fe7380b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.070+0000 7fe73f4af640 1 -- 172.21.15.44:0/243077485 shutdown_connections 2023-11-04T01:41:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.070+0000 7fe73f4af640 1 -- 172.21.15.44:0/243077485 wait complete. 2023-11-04T01:41:37.485 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:29.920595+0000', 'modified': '2023-11-04T01:41:34.033251+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6347, 'mds_1': 7344}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6347': {'gid': 6347, 'name': 'd', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.204:6836/3287638895', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6834', 'nonce': 3287638895}, {'type': 'v1', 'addr': '172.21.15.204:6836', 'nonce': 3287638895}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7344': {'gid': 7344, 'name': 'c', 'rank': 1, 'incarnation': 49, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.44:6834/2069525699', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 2069525699}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 2069525699}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:41:37.485 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:41:37.485 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:41:37.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.596+0000 7ff8f0ac9640 1 Processor -- start 2023-11-04T01:41:37.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.596+0000 7ff8f0ac9640 1 -- start start 2023-11-04T01:41:37.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.597+0000 7ff8f0ac9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff8ec0b2d30 0x7ff8ec06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.597+0000 7ff8f0ac9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ec06ca40 con 0x7ff8ec160430 2023-11-04T01:41:37.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.597+0000 7ff8f0ac9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ec06cd20 con 0x7ff8ec06c1d0 2023-11-04T01:41:37.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.597+0000 7ff8f0ac9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ec0cb580 con 0x7ff8ec0b2d30 2023-11-04T01:41:37.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.597+0000 7ff8e9d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff8ec0b2d30 0x7ff8ec06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.597+0000 7ff8ea59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff8ec160430 0x7ff8ec0b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46948/0 (socket says 172.21.15.44:46948) 2023-11-04T01:41:37.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.597+0000 7ff8ea59c640 1 -- 172.21.15.44:0/3585977641 learned_addr learned my addr 172.21.15.44:0/3585977641 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:37.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.597+0000 7ff8e9d9b640 1 -- 172.21.15.44:0/3585977641 >> v1:172.21.15.204:6789/0 conn(0x7ff8ec06c1d0 legacy=0x7ff8ec0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.597+0000 7ff8e9d9b640 1 -- 172.21.15.44:0/3585977641 >> v1:172.21.15.44:6789/0 conn(0x7ff8ec160430 legacy=0x7ff8ec0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.597+0000 7ff8e9d9b640 1 -- 172.21.15.44:0/3585977641 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec06d000 con 0x7ff8ec0b2d30 2023-11-04T01:41:37.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.598+0000 7ff8e9d9b640 1 --2- 172.21.15.44:0/3585977641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec0b2d30 0x7ff8ec06bc90 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40097d0 tx=0x7ff8d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c691438b3b910359 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.598+0000 7ff8e959a640 1 -- 172.21.15.44:0/3585977641 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4031830 con 0x7ff8ec0b2d30 2023-11-04T01:41:37.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.598+0000 7ff8e959a640 1 -- 172.21.15.44:0/3585977641 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d4031990 con 0x7ff8ec0b2d30 2023-11-04T01:41:37.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.598+0000 7ff8e959a640 1 -- 172.21.15.44:0/3585977641 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4031d20 con 0x7ff8ec0b2d30 2023-11-04T01:41:37.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.599+0000 7ff8f0ac9640 1 -- 172.21.15.44:0/3585977641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec0b2d30 msgr2=0x7ff8ec06bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.599+0000 7ff8f0ac9640 1 --2- 172.21.15.44:0/3585977641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec0b2d30 0x7ff8ec06bc90 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40097d0 tx=0x7ff8d402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.599+0000 7ff8f0ac9640 1 -- 172.21.15.44:0/3585977641 shutdown_connections 2023-11-04T01:41:37.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.599+0000 7ff8f0ac9640 1 --2- 172.21.15.44:0/3585977641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec0b2d30 0x7ff8ec06bc90 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.599+0000 7ff8f0ac9640 1 -- 172.21.15.44:0/3585977641 >> 172.21.15.44:0/3585977641 conn(0x7ff8ec06ea20 msgr2=0x7ff8ec06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.599+0000 7ff8f0ac9640 1 -- 172.21.15.44:0/3585977641 shutdown_connections 2023-11-04T01:41:37.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.599+0000 7ff8f0ac9640 1 -- 172.21.15.44:0/3585977641 wait complete. 2023-11-04T01:41:37.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.600+0000 7ff8f0ac9640 1 Processor -- start 2023-11-04T01:41:37.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.600+0000 7ff8f0ac9640 1 -- start start 2023-11-04T01:41:37.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.601+0000 7ff8f0ac9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec06c1d0 0x7ff8ec1f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.601+0000 7ff8f0ac9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8ec0b2d30 0x7ff8ec0b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.601+0000 7ff8f0ac9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8ec160430 0x7ff8ec0c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.601+0000 7ff8f0ac9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec0c7c70 con 0x7ff8ec06c1d0 2023-11-04T01:41:37.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.601+0000 7ff8f0ac9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec1f68c0 con 0x7ff8ec0b2d30 2023-11-04T01:41:37.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.601+0000 7ff8f0ac9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec1f6ba0 con 0x7ff8ec160430 2023-11-04T01:41:37.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.601+0000 7ff8ea59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec06c1d0 0x7ff8ec1f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.601+0000 7ff8ea59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec06c1d0 0x7ff8ec1f6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35050/0 (socket says 172.21.15.44:35050) 2023-11-04T01:41:37.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.601+0000 7ff8ea59c640 1 -- 172.21.15.44:0/1695586315 learned_addr learned my addr 172.21.15.44:0/1695586315 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:37.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.601+0000 7ff8ea59c640 1 -- 172.21.15.44:0/1695586315 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8ec160430 msgr2=0x7ff8ec0c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.601+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/1695586315 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8ec160430 0x7ff8ec0c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.601+0000 7ff8ea59c640 1 -- 172.21.15.44:0/1695586315 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8ec0b2d30 msgr2=0x7ff8ec0b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.601+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/1695586315 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8ec0b2d30 0x7ff8ec0b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.601+0000 7ff8ea59c640 1 -- 172.21.15.44:0/1695586315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d4009400 con 0x7ff8ec06c1d0 2023-11-04T01:41:37.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.601+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/1695586315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec06c1d0 0x7ff8ec1f6070 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400c480 tx=0x7ff8e400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.602+0000 7ff8e2ffd640 1 -- 172.21.15.44:0/1695586315 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4005ce0 con 0x7ff8ec06c1d0 2023-11-04T01:41:37.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.602+0000 7ff8e2ffd640 1 -- 172.21.15.44:0/1695586315 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4005e40 con 0x7ff8ec06c1d0 2023-11-04T01:41:37.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.602+0000 7ff8f0ac9640 1 -- 172.21.15.44:0/1695586315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ec1f6e80 con 0x7ff8ec06c1d0 2023-11-04T01:41:37.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.602+0000 7ff8e2ffd640 1 -- 172.21.15.44:0/1695586315 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e40072f0 con 0x7ff8ec06c1d0 2023-11-04T01:41:37.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.602+0000 7ff8f0ac9640 1 -- 172.21.15.44:0/1695586315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ec1f65b0 con 0x7ff8ec06c1d0 2023-11-04T01:41:37.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.603+0000 7ff8e2ffd640 1 -- 172.21.15.44:0/1695586315 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8e4007450 con 0x7ff8ec06c1d0 2023-11-04T01:41:37.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.604+0000 7ff8e2ffd640 1 --2- 172.21.15.44:0/1695586315 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff8cc06aea0 0x7ff8cc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.604+0000 7ff8e2ffd640 1 -- 172.21.15.44:0/1695586315 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7494+0+0 (secure 0 0 0) 0x7ff8e4089110 con 0x7ff8ec06c1d0 2023-11-04T01:41:37.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.604+0000 7ff8e9d9b640 1 --2- 172.21.15.44:0/1695586315 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff8cc06aea0 0x7ff8cc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.604+0000 7ff8e9d9b640 1 --2- 172.21.15.44:0/1695586315 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff8cc06aea0 0x7ff8cc06d360 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4036000 tx=0x7ff8d4030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.605+0000 7ff8f3656740 1 Processor -- start 2023-11-04T01:41:37.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.605+0000 7ff8f3656740 1 -- start start 2023-11-04T01:41:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8f3656740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6850 0x55ef96e89750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8f3656740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6c30 0x55ef96eb95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8f3656740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96e89c90 0x55ef96eb9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8f3656740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef96d9a740 con 0x55ef96eb6850 2023-11-04T01:41:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8f3656740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef96dfc8d0 con 0x55ef96eb6c30 2023-11-04T01:41:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8f3656740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef96df9fc0 con 0x55ef96e89c90 2023-11-04T01:41:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8ea59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6850 0x55ef96e89750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8ea59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6850 0x55ef96e89750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35052/0 (socket says 172.21.15.44:35052) 2023-11-04T01:41:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8ea59c640 1 -- 172.21.15.44:0/1023750087 learned_addr learned my addr 172.21.15.44:0/1023750087 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8e9d9b640 1 --2- 172.21.15.44:0/1023750087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6c30 0x55ef96eb95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8ead9d640 1 --2- 172.21.15.44:0/1023750087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96e89c90 0x55ef96eb9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8ea59c640 1 -- 172.21.15.44:0/1023750087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96e89c90 msgr2=0x55ef96eb9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/1023750087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96e89c90 0x55ef96eb9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8ea59c640 1 -- 172.21.15.44:0/1023750087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6c30 msgr2=0x55ef96eb95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/1023750087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6c30 0x55ef96eb95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8ea59c640 1 -- 172.21.15.44:0/1023750087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef96db8ca0 con 0x55ef96eb6850 2023-11-04T01:41:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8e9d9b640 1 --2- 172.21.15.44:0/1023750087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6c30 0x55ef96eb95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8ead9d640 1 --2- 172.21.15.44:0/1023750087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96e89c90 0x55ef96eb9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/1023750087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6850 0x55ef96e89750 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4086f70 tx=0x7ff8e4057a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546cc5ec90ba990f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8cbfff640 1 -- 172.21.15.44:0/1023750087 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4055c60 con 0x55ef96eb6850 2023-11-04T01:41:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8cbfff640 1 -- 172.21.15.44:0/1023750087 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4053fd0 con 0x55ef96eb6850 2023-11-04T01:41:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.606+0000 7ff8cbfff640 1 -- 172.21.15.44:0/1023750087 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4056ff0 con 0x55ef96eb6850 2023-11-04T01:41:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.607+0000 7ff8f3656740 1 -- 172.21.15.44:0/1023750087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6850 msgr2=0x55ef96e89750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.607+0000 7ff8f3656740 1 --2- 172.21.15.44:0/1023750087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6850 0x55ef96e89750 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4086f70 tx=0x7ff8e4057a40 comp rx=0 tx=0).stop 2023-11-04T01:41:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.607+0000 7ff8f3656740 1 -- 172.21.15.44:0/1023750087 shutdown_connections 2023-11-04T01:41:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.607+0000 7ff8f3656740 1 --2- 172.21.15.44:0/1023750087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96e89c90 0x55ef96eb9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.607+0000 7ff8f3656740 1 --2- 172.21.15.44:0/1023750087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6c30 0x55ef96eb95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.607+0000 7ff8f3656740 1 --2- 172.21.15.44:0/1023750087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6850 0x55ef96e89750 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.607+0000 7ff8f3656740 1 -- 172.21.15.44:0/1023750087 >> 172.21.15.44:0/1023750087 conn(0x55ef96e8ba60 msgr2=0x55ef96ed45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.607+0000 7ff8f3656740 1 -- 172.21.15.44:0/1023750087 shutdown_connections 2023-11-04T01:41:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.607+0000 7ff8f3656740 1 -- 172.21.15.44:0/1023750087 wait complete. 2023-11-04T01:41:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.608+0000 7ff8f3656740 1 -- start start 2023-11-04T01:41:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.608+0000 7ff8f3656740 1 Processor -- start 2023-11-04T01:41:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8f3656740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6850 0x55ef96ece0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8f3656740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6c30 0x55ef96ecc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8f3656740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96ecf0f0 0x55ef96ea7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8f3656740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef96df58b0 con 0x55ef96eb6c30 2023-11-04T01:41:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8f3656740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef96dafc80 con 0x55ef96eb6850 2023-11-04T01:41:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8f3656740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef96daf920 con 0x55ef96ecf0f0 2023-11-04T01:41:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8f3656740 10 client.0 _ll_register_callbacks cb 0x55ef96b07ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8e9d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6c30 0x55ef96ecc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8e9d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6c30 0x55ef96ecc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35066/0 (socket says 172.21.15.44:35066) 2023-11-04T01:41:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8e9d9b640 1 -- 172.21.15.44:0/3771741038 learned_addr learned my addr 172.21.15.44:0/3771741038 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/3771741038 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6850 0x55ef96ece0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8ead9d640 1 --2- 172.21.15.44:0/3771741038 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96ecf0f0 0x55ef96ea7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8e9d9b640 1 -- 172.21.15.44:0/3771741038 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96ecf0f0 msgr2=0x55ef96ea7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8e9d9b640 1 --2- 172.21.15.44:0/3771741038 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96ecf0f0 0x55ef96ea7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8e9d9b640 1 -- 172.21.15.44:0/3771741038 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6850 msgr2=0x55ef96ece0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8e9d9b640 1 --2- 172.21.15.44:0/3771741038 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6850 0x55ef96ece0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8e9d9b640 1 -- 172.21.15.44:0/3771741038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ec1f65b0 con 0x55ef96eb6c30 2023-11-04T01:41:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/3771741038 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6850 0x55ef96ece0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8e9d9b640 1 --2- 172.21.15.44:0/3771741038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6c30 0x55ef96ecc6e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7ff8d402bee0 tx=0x7ff8d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15dfd17bdae559ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:41:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8c97fa640 1 -- 172.21.15.44:0/3771741038 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4050430 con 0x55ef96eb6c30 2023-11-04T01:41:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8c97fa640 1 -- 172.21.15.44:0/3771741038 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7494+0+0 (secure 0 0 0) 0x7ff8d4047410 con 0x55ef96eb6c30 2023-11-04T01:41:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.609+0000 7ff8f3656740 1 -- 172.21.15.44:0/3771741038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef96da1bf0 con 0x55ef96eb6c30 2023-11-04T01:41:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.610+0000 7ff8c97fa640 1 -- 172.21.15.44:0/3771741038 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8d40475d0 con 0x55ef96eb6c30 2023-11-04T01:41:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.610+0000 7ff8f3656740 10 client.8070 fetch_fsmap learned FSMap version 83 2023-11-04T01:41:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.610+0000 7ff8f3656740 1 -- 172.21.15.44:0/3771741038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x55ef96df3f30 con 0x55ef96eb6c30 2023-11-04T01:41:37.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.610+0000 7ff8c97fa640 1 -- 172.21.15.44:0/3771741038 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d4058030 con 0x55ef96eb6c30 2023-11-04T01:41:37.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.610+0000 7ff8c97fa640 1 -- 172.21.15.44:0/3771741038 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 83) v1 ==== 3306+0+0 (secure 0 0 0) 0x7ff8d4047730 con 0x55ef96eb6c30 2023-11-04T01:41:37.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.610+0000 7ff8f3656740 10 client.8070 fetch_fsmap finished waiting for FSMap version 83 2023-11-04T01:41:37.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.610+0000 7ff8f3656740 10 client.8070 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:41:37.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.610+0000 7ff8f3656740 20 client.8070 populate_metadata read hostname 'smithi044' 2023-11-04T01:41:37.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.610+0000 7ff8f3656740 1 --2- 172.21.15.44:0/3771741038 >> [v2:172.21.15.204:6834/3287638895,v1:172.21.15.204:6836/3287638895] conn(0x55ef96ef0040 0x55ef96ef2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.610+0000 7ff8f3656740 4 client.8070 mds_command: new command op to 6347 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:41:37.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.610+0000 7ff8f3656740 1 -- 172.21.15.44:0/3771741038 --> [v2:172.21.15.204:6834/3287638895,v1:172.21.15.204:6836/3287638895] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef96dee890 con 0x55ef96ef0040 2023-11-04T01:41:37.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.610+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/3771741038 >> [v2:172.21.15.204:6834/3287638895,v1:172.21.15.204:6836/3287638895] conn(0x55ef96ef0040 0x55ef96ef2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.611+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/3771741038 >> [v2:172.21.15.204:6834/3287638895,v1:172.21.15.204:6836/3287638895] conn(0x55ef96ef0040 0x55ef96ef2430 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12783f215f10b8c8 server_cookie=a2d08a63471b5dd0 in_seq=0 out_seq=0 2023-11-04T01:41:37.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.611+0000 7ff8c97fa640 10 client.8070 ms_handle_connect on v2:172.21.15.204:6834/3287638895 2023-11-04T01:41:37.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.611+0000 7ff8c97fa640 1 -- 172.21.15.44:0/3771741038 <== mds.0 v2:172.21.15.204:6834/3287638895 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ef96dee890 con 0x55ef96ef0040 2023-11-04T01:41:37.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.611+0000 7ff8c97fa640 10 client.8070 handle_command_reply: tid=0 2023-11-04T01:41:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.611+0000 7ff8f3656740 1 client.8070 shutdown 2023-11-04T01:41:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.611+0000 7ff8f3656740 1 -- 172.21.15.44:0/3771741038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6c30 msgr2=0x55ef96ecc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.611+0000 7ff8f3656740 1 --2- 172.21.15.44:0/3771741038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6c30 0x55ef96ecc6e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7ff8d402bee0 tx=0x7ff8d4004730 comp rx=0 tx=0).stop 2023-11-04T01:41:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.612+0000 7ff8f3656740 1 -- 172.21.15.44:0/3771741038 shutdown_connections 2023-11-04T01:41:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.612+0000 7ff8f3656740 1 --2- 172.21.15.44:0/3771741038 >> [v2:172.21.15.204:6834/3287638895,v1:172.21.15.204:6836/3287638895] conn(0x55ef96ef0040 0x55ef96ef2430 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.612+0000 7ff8f3656740 1 --2- 172.21.15.44:0/3771741038 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96ecf0f0 0x55ef96ea7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.612+0000 7ff8c97fa640 0 client.8070 ms_handle_reset on v2:172.21.15.204:6834/3287638895 2023-11-04T01:41:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.612+0000 7ff8f3656740 1 --2- 172.21.15.44:0/3771741038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6c30 0x55ef96ecc6e0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.612+0000 7ff8f3656740 1 --2- 172.21.15.44:0/3771741038 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6850 0x55ef96ece0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.612+0000 7ff8f3656740 1 -- 172.21.15.44:0/3771741038 >> 172.21.15.44:0/3771741038 conn(0x55ef96e89c90 msgr2=0x55ef96e8d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.612+0000 7ff8f3656740 1 -- 172.21.15.44:0/3771741038 shutdown_connections 2023-11-04T01:41:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.612+0000 7ff8f3656740 1 -- 172.21.15.44:0/3771741038 wait complete. 2023-11-04T01:41:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.612+0000 7ff8f3656740 20 client.8070 trim_cache size 0 max 16384 2023-11-04T01:41:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.627+0000 7ff8f3656740 1 Processor -- start 2023-11-04T01:41:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.627+0000 7ff8f3656740 1 -- start start 2023-11-04T01:41:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8f3656740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96e89c90 0x55ef96ed84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8f3656740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6850 0x55ef96f39c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8f3656740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96eb6c30 0x55ef96e8d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8f3656740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef96d75280 con 0x55ef96e89c90 2023-11-04T01:41:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8f3656740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef96eb57f0 con 0x55ef96eb6850 2023-11-04T01:41:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8f3656740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef96e84200 con 0x55ef96eb6c30 2023-11-04T01:41:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8ea59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96e89c90 0x55ef96ed84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8ea59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96e89c90 0x55ef96ed84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35078/0 (socket says 172.21.15.44:35078) 2023-11-04T01:41:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8ea59c640 1 -- 172.21.15.44:0/4267915660 learned_addr learned my addr 172.21.15.44:0/4267915660 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8ead9d640 1 --2- 172.21.15.44:0/4267915660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96eb6c30 0x55ef96e8d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8e9d9b640 1 --2- 172.21.15.44:0/4267915660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6850 0x55ef96f39c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8ea59c640 1 -- 172.21.15.44:0/4267915660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96eb6c30 msgr2=0x55ef96e8d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/4267915660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96eb6c30 0x55ef96e8d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8ea59c640 1 -- 172.21.15.44:0/4267915660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6850 msgr2=0x55ef96f39c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/4267915660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6850 0x55ef96f39c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.628+0000 7ff8ea59c640 1 -- 172.21.15.44:0/4267915660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef96d91d10 con 0x55ef96e89c90 2023-11-04T01:41:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.629+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/4267915660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96e89c90 0x55ef96ed84e0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4000f60 tx=0x7ff8e405bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7aacb51fd897f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.629+0000 7ff8e0ff9640 1 -- 172.21.15.44:0/4267915660 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4086040 con 0x55ef96e89c90 2023-11-04T01:41:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.629+0000 7ff8e0ff9640 1 -- 172.21.15.44:0/4267915660 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4055c60 con 0x55ef96e89c90 2023-11-04T01:41:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.629+0000 7ff8e0ff9640 1 -- 172.21.15.44:0/4267915660 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4056db0 con 0x55ef96e89c90 2023-11-04T01:41:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.629+0000 7ff8f3656740 1 -- 172.21.15.44:0/4267915660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96e89c90 msgr2=0x55ef96ed84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.629+0000 7ff8f3656740 1 --2- 172.21.15.44:0/4267915660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96e89c90 0x55ef96ed84e0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4000f60 tx=0x7ff8e405bae0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.629+0000 7ff8f3656740 1 -- 172.21.15.44:0/4267915660 shutdown_connections 2023-11-04T01:41:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.629+0000 7ff8f3656740 1 --2- 172.21.15.44:0/4267915660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96eb6c30 0x55ef96e8d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.629+0000 7ff8f3656740 1 --2- 172.21.15.44:0/4267915660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96eb6850 0x55ef96f39c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.629+0000 7ff8f3656740 1 --2- 172.21.15.44:0/4267915660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96e89c90 0x55ef96ed84e0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.629+0000 7ff8f3656740 1 -- 172.21.15.44:0/4267915660 >> 172.21.15.44:0/4267915660 conn(0x55ef96ed5000 msgr2=0x55ef96eb5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.629+0000 7ff8f3656740 1 -- 172.21.15.44:0/4267915660 shutdown_connections 2023-11-04T01:41:37.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.629+0000 7ff8f3656740 1 -- 172.21.15.44:0/4267915660 wait complete. 2023-11-04T01:41:37.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.630+0000 7ff8f3656740 1 -- start start 2023-11-04T01:41:37.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.630+0000 7ff8f3656740 1 Processor -- start 2023-11-04T01:41:37.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8f3656740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96e89c90 0x55ef96ece570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8f3656740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6850 0x55ef96ea6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8f3656740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96eb6c30 0x55ef96e8e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8f3656740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef96ef2030 con 0x55ef96eb6850 2023-11-04T01:41:37.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8f3656740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef96ecaca0 con 0x55ef96e89c90 2023-11-04T01:41:37.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8f3656740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef96ea7200 con 0x55ef96eb6c30 2023-11-04T01:41:37.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8f3656740 10 client.0 _ll_register_callbacks cb 0x7ff8e4057710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:37.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8e9d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6850 0x55ef96ea6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8e9d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6850 0x55ef96ea6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35092/0 (socket says 172.21.15.44:35092) 2023-11-04T01:41:37.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8e9d9b640 1 -- 172.21.15.44:0/2284642021 learned_addr learned my addr 172.21.15.44:0/2284642021 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:37.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/2284642021 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96e89c90 0x55ef96ece570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8ead9d640 1 --2- 172.21.15.44:0/2284642021 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96eb6c30 0x55ef96e8e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8e9d9b640 1 -- 172.21.15.44:0/2284642021 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96eb6c30 msgr2=0x55ef96e8e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8e9d9b640 1 --2- 172.21.15.44:0/2284642021 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96eb6c30 0x55ef96e8e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8e9d9b640 1 -- 172.21.15.44:0/2284642021 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96e89c90 msgr2=0x55ef96ece570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8e9d9b640 1 --2- 172.21.15.44:0/2284642021 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96e89c90 0x55ef96ece570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8e9d9b640 1 -- 172.21.15.44:0/2284642021 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef96db8ca0 con 0x55ef96eb6850 2023-11-04T01:41:37.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/2284642021 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96e89c90 0x55ef96ece570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:37.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.631+0000 7ff8ead9d640 1 --2- 172.21.15.44:0/2284642021 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96eb6c30 0x55ef96e8e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:37.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8e9d9b640 1 --2- 172.21.15.44:0/2284642021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6850 0x55ef96ea6cc0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40318a0 tx=0x7ff8d403d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a73ee3b5894209 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:41:37.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8c97fa640 1 -- 172.21.15.44:0/2284642021 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4062070 con 0x55ef96eb6850 2023-11-04T01:41:37.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8c97fa640 1 -- 172.21.15.44:0/2284642021 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7494+0+0 (secure 0 0 0) 0x7ff8d4047410 con 0x55ef96eb6850 2023-11-04T01:41:37.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8f3656740 1 -- 172.21.15.44:0/2284642021 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff8e4053fd0 con 0x55ef96eb6850 2023-11-04T01:41:37.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8c97fa640 1 -- 172.21.15.44:0/2284642021 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8d403bd50 con 0x55ef96eb6850 2023-11-04T01:41:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8f3656740 10 client.8076 fetch_fsmap learned FSMap version 83 2023-11-04T01:41:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8f3656740 1 -- 172.21.15.44:0/2284642021 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x55ef96db7500 con 0x55ef96eb6850 2023-11-04T01:41:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8c97fa640 1 -- 172.21.15.44:0/2284642021 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4053fd0 con 0x55ef96eb6850 2023-11-04T01:41:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8c97fa640 1 -- 172.21.15.44:0/2284642021 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 83) v1 ==== 3306+0+0 (secure 0 0 0) 0x7ff8d4065020 con 0x55ef96eb6850 2023-11-04T01:41:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8f3656740 10 client.8076 fetch_fsmap finished waiting for FSMap version 83 2023-11-04T01:41:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8f3656740 10 client.8076 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:41:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8f3656740 20 client.8076 populate_metadata read hostname 'smithi044' 2023-11-04T01:41:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8f3656740 1 --2- 172.21.15.44:0/2284642021 >> [v2:172.21.15.204:6834/3287638895,v1:172.21.15.204:6836/3287638895] conn(0x55ef96ecf0f0 0x55ef96ecbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8f3656740 4 client.8076 mds_command: new command op to 6347 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:41:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8f3656740 1 -- 172.21.15.44:0/2284642021 --> [v2:172.21.15.204:6834/3287638895,v1:172.21.15.204:6836/3287638895] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ef96dee5b0 con 0x55ef96ecf0f0 2023-11-04T01:41:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.632+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/2284642021 >> [v2:172.21.15.204:6834/3287638895,v1:172.21.15.204:6836/3287638895] conn(0x55ef96ecf0f0 0x55ef96ecbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8c97fa640 10 client.8076 ms_handle_connect on v2:172.21.15.204:6834/3287638895 2023-11-04T01:41:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8ea59c640 1 --2- 172.21.15.44:0/2284642021 >> [v2:172.21.15.204:6834/3287638895,v1:172.21.15.204:6836/3287638895] conn(0x55ef96ecf0f0 0x55ef96ecbc30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12e2f70a1a05dbea server_cookie=f265c135234bc318 in_seq=0 out_seq=0 2023-11-04T01:41:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8c97fa640 1 -- 172.21.15.44:0/2284642021 <== mds.0 v2:172.21.15.204:6834/3287638895 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55ef96dee5b0 con 0x55ef96ecf0f0 2023-11-04T01:41:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8c97fa640 10 client.8076 handle_command_reply: tid=0 2023-11-04T01:41:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8f3656740 1 client.8076 shutdown 2023-11-04T01:41:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8f3656740 1 -- 172.21.15.44:0/2284642021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6850 msgr2=0x55ef96ea6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8f3656740 1 --2- 172.21.15.44:0/2284642021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6850 0x55ef96ea6cc0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40318a0 tx=0x7ff8d403d040 comp rx=0 tx=0).stop 2023-11-04T01:41:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8f3656740 1 -- 172.21.15.44:0/2284642021 shutdown_connections 2023-11-04T01:41:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8f3656740 1 --2- 172.21.15.44:0/2284642021 >> [v2:172.21.15.204:6834/3287638895,v1:172.21.15.204:6836/3287638895] conn(0x55ef96ecf0f0 0x55ef96ecbc30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8f3656740 1 --2- 172.21.15.44:0/2284642021 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ef96eb6c30 0x55ef96e8e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8c97fa640 0 client.8076 ms_handle_reset on v2:172.21.15.204:6834/3287638895 2023-11-04T01:41:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8f3656740 1 --2- 172.21.15.44:0/2284642021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef96eb6850 0x55ef96ea6cc0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8f3656740 1 --2- 172.21.15.44:0/2284642021 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ef96e89c90 0x55ef96ece570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8f3656740 1 -- 172.21.15.44:0/2284642021 >> 172.21.15.44:0/2284642021 conn(0x55ef96ed5000 msgr2=0x55ef96e884f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8f3656740 1 -- 172.21.15.44:0/2284642021 shutdown_connections 2023-11-04T01:41:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.633+0000 7ff8f3656740 1 -- 172.21.15.44:0/2284642021 wait complete. 2023-11-04T01:41:37.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.634+0000 7ff8f3656740 20 client.8076 trim_cache size 0 max 16384 2023-11-04T01:41:37.642 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:41:37.642 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:41:37.642 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2023-11-04T01:41:37.642 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6347, 2023-11-04T01:41:37.642 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:41:37.642 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:41:37.642 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:41:37.642 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 6.6139320890000004, 2023-11-04T01:41:37.643 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 83, 2023-11-04T01:41:37.643 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 102, 2023-11-04T01:41:37.643 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 102, 2023-11-04T01:41:37.643 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 31.837578709999999 2023-11-04T01:41:37.643 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:41:37.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.634+0000 7ff8f0ac9640 1 -- 172.21.15.44:0/1695586315 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff8cc06aea0 msgr2=0x7ff8cc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.634+0000 7ff8f0ac9640 1 --2- 172.21.15.44:0/1695586315 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff8cc06aea0 0x7ff8cc06d360 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4036000 tx=0x7ff8d4030000 comp rx=0 tx=0).stop 2023-11-04T01:41:37.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.634+0000 7ff8f0ac9640 1 -- 172.21.15.44:0/1695586315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec06c1d0 msgr2=0x7ff8ec1f6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.634+0000 7ff8f0ac9640 1 --2- 172.21.15.44:0/1695586315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec06c1d0 0x7ff8ec1f6070 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400c480 tx=0x7ff8e400c940 comp rx=0 tx=0).stop 2023-11-04T01:41:37.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.634+0000 7ff8f0ac9640 1 -- 172.21.15.44:0/1695586315 shutdown_connections 2023-11-04T01:41:37.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.634+0000 7ff8f0ac9640 1 --2- 172.21.15.44:0/1695586315 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff8cc06aea0 0x7ff8cc06d360 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.634+0000 7ff8f0ac9640 1 --2- 172.21.15.44:0/1695586315 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8ec160430 0x7ff8ec0c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.634+0000 7ff8f0ac9640 1 --2- 172.21.15.44:0/1695586315 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8ec0b2d30 0x7ff8ec0b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.634+0000 7ff8f0ac9640 1 --2- 172.21.15.44:0/1695586315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec06c1d0 0x7ff8ec1f6070 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.634+0000 7ff8f0ac9640 1 -- 172.21.15.44:0/1695586315 >> 172.21.15.44:0/1695586315 conn(0x7ff8ec06ea20 msgr2=0x7ff8ec0cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.634+0000 7ff8f0ac9640 1 -- 172.21.15.44:0/1695586315 shutdown_connections 2023-11-04T01:41:37.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.634+0000 7ff8f0ac9640 1 -- 172.21.15.44:0/1695586315 wait complete. 2023-11-04T01:41:37.646 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:41:37.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.751+0000 7f101004b640 1 Processor -- start 2023-11-04T01:41:37.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.751+0000 7f101004b640 1 -- start start 2023-11-04T01:41:37.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.752+0000 7f101004b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1008160430 0x7f10080b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.752+0000 7f101004b640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10080b2fc0 con 0x7f100806c3a0 2023-11-04T01:41:37.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.752+0000 7f101004b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100806c810 con 0x7f10080b2b60 2023-11-04T01:41:37.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.752+0000 7f101004b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10080cb580 con 0x7f1008160430 2023-11-04T01:41:37.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.752+0000 7f100e5e8640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f100806c3a0 0x7f10080cbcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46954/0 (socket says 172.21.15.44:46954) 2023-11-04T01:41:37.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.752+0000 7f100e5e8640 1 -- 172.21.15.44:0/645916321 learned_addr learned my addr 172.21.15.44:0/645916321 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:37.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.752+0000 7f100dde7640 1 --2- 172.21.15.44:0/645916321 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1008160430 0x7f10080b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.752+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021624783 0 0) 0x7f10080b2fc0 con 0x7f100806c3a0 2023-11-04T01:41:37.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.752+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ff0003520 con 0x7f100806c3a0 2023-11-04T01:41:37.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758242415 0 0) 0x7f100806c810 con 0x7f10080b2b60 2023-11-04T01:41:37.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10080b2fc0 con 0x7f10080b2b60 2023-11-04T01:41:37.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3394238039 0 0) 0x7f0ff0003520 con 0x7f100806c3a0 2023-11-04T01:41:37.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1008160430 msgr2=0x7f10080b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100cde5640 1 --2- 172.21.15.44:0/645916321 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1008160430 0x7f10080b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 >> v1:172.21.15.204:6789/0 conn(0x7f10080b2b60 legacy=0x7f100806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100806ca40 con 0x7f100806c3a0 2023-11-04T01:41:37.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f1000001670 con 0x7f100806c3a0 2023-11-04T01:41:37.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 >> v1:172.21.15.44:6789/0 conn(0x7f100806c3a0 legacy=0x7f10080cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100cde5640 1 --2- 172.21.15.44:0/645916321 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1008160430 0x7f0ff0003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100cde5640 1 --2- 172.21.15.44:0/645916321 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ff0004090 0x7f0ff00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100cde5640 1 --2- 172.21.15.44:0/645916321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ff0004d00 0x7f0ff0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10080cb580 con 0x7f0ff0004d00 2023-11-04T01:41:37.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff000ba60 con 0x7f0ff0004090 2023-11-04T01:41:37.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff000bc20 con 0x7f1008160430 2023-11-04T01:41:37.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100e5e8640 1 --2- 172.21.15.44:0/645916321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ff0004d00 0x7f0ff0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100dde7640 1 --2- 172.21.15.44:0/645916321 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1008160430 0x7f0ff0003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100d5e6640 1 --2- 172.21.15.44:0/645916321 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ff0004090 0x7f0ff00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100e5e8640 1 -- 172.21.15.44:0/645916321 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1008160430 msgr2=0x7f0ff0003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100e5e8640 1 --2- 172.21.15.44:0/645916321 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1008160430 0x7f0ff0003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100e5e8640 1 -- 172.21.15.44:0/645916321 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ff0004090 msgr2=0x7f0ff00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100e5e8640 1 --2- 172.21.15.44:0/645916321 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ff0004090 0x7f0ff00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100e5e8640 1 -- 172.21.15.44:0/645916321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff0003520 con 0x7f0ff0004d00 2023-11-04T01:41:37.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.753+0000 7f100d5e6640 1 --2- 172.21.15.44:0/645916321 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ff0004090 0x7f0ff00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:37.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.754+0000 7f100e5e8640 1 --2- 172.21.15.44:0/645916321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ff0004d00 0x7f0ff0005180 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f1000007fd0 tx=0x7f0ff00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624d6a1e87aff565 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.754+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000005ad0 con 0x7f0ff0004d00 2023-11-04T01:41:37.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.754+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1000005c50 con 0x7f0ff0004d00 2023-11-04T01:41:37.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.754+0000 7f100cde5640 1 -- 172.21.15.44:0/645916321 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100002c830 con 0x7f0ff0004d00 2023-11-04T01:41:37.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.755+0000 7f101004b640 1 -- 172.21.15.44:0/645916321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ff0004d00 msgr2=0x7f0ff0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.755+0000 7f101004b640 1 --2- 172.21.15.44:0/645916321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ff0004d00 0x7f0ff0005180 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f1000007fd0 tx=0x7f0ff00057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.755+0000 7f100e5e8640 1 -- 172.21.15.44:0/645916321 reap_dead start 2023-11-04T01:41:37.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.755+0000 7f101004b640 1 -- 172.21.15.44:0/645916321 shutdown_connections 2023-11-04T01:41:37.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.755+0000 7f101004b640 1 -- 172.21.15.44:0/645916321 >> 172.21.15.44:0/645916321 conn(0x7f100806ea20 msgr2=0x7f100806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.755+0000 7f101004b640 1 -- 172.21.15.44:0/645916321 shutdown_connections 2023-11-04T01:41:37.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.755+0000 7f101004b640 1 -- 172.21.15.44:0/645916321 wait complete. 2023-11-04T01:41:37.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.756+0000 7f101004b640 1 Processor -- start 2023-11-04T01:41:37.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.756+0000 7f101004b640 1 -- start start 2023-11-04T01:41:37.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f101004b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ff0004d00 0x7f1008159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f101004b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1008159b40 0x7f10081f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f101004b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10081f33c0 0x7f10081f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f101004b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1008155e90 con 0x7f0ff0004d00 2023-11-04T01:41:37.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f101004b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1008159fa0 con 0x7f1008159b40 2023-11-04T01:41:37.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f101004b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1008155210 con 0x7f10081f33c0 2023-11-04T01:41:37.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f100dde7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ff0004d00 0x7f1008159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f100dde7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ff0004d00 0x7f1008159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35116/0 (socket says 172.21.15.44:35116) 2023-11-04T01:41:37.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f100dde7640 1 -- 172.21.15.44:0/1086961041 learned_addr learned my addr 172.21.15.44:0/1086961041 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:37.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f100d5e6640 1 --2- 172.21.15.44:0/1086961041 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1008159b40 0x7f10081f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f100e5e8640 1 --2- 172.21.15.44:0/1086961041 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10081f33c0 0x7f10081f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f100dde7640 1 -- 172.21.15.44:0/1086961041 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10081f33c0 msgr2=0x7f10081f6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f100dde7640 1 --2- 172.21.15.44:0/1086961041 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10081f33c0 0x7f10081f6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f100dde7640 1 -- 172.21.15.44:0/1086961041 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1008159b40 msgr2=0x7f10081f2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f100dde7640 1 --2- 172.21.15.44:0/1086961041 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1008159b40 0x7f10081f2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f100dde7640 1 -- 172.21.15.44:0/1086961041 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10081554f0 con 0x7f0ff0004d00 2023-11-04T01:41:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f100e5e8640 1 --2- 172.21.15.44:0/1086961041 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10081f33c0 0x7f10081f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.757+0000 7f100dde7640 1 --2- 172.21.15.44:0/1086961041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ff0004d00 0x7f1008159600 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8011e60 tx=0x7f0ff800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.758+0000 7f10067fc640 1 -- 172.21.15.44:0/1086961041 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff800e040 con 0x7f0ff0004d00 2023-11-04T01:41:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.758+0000 7f10067fc640 1 -- 172.21.15.44:0/1086961041 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff800f040 con 0x7f0ff0004d00 2023-11-04T01:41:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.758+0000 7f10067fc640 1 -- 172.21.15.44:0/1086961041 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8015850 con 0x7f0ff0004d00 2023-11-04T01:41:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.758+0000 7f101004b640 1 -- 172.21.15.44:0/1086961041 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10081557d0 con 0x7f0ff0004d00 2023-11-04T01:41:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.758+0000 7f101004b640 1 -- 172.21.15.44:0/1086961041 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1008154f00 con 0x7f0ff0004d00 2023-11-04T01:41:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.759+0000 7f10067fc640 1 -- 172.21.15.44:0/1086961041 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ff80159b0 con 0x7f0ff0004d00 2023-11-04T01:41:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.759+0000 7f10067fc640 1 --2- 172.21.15.44:0/1086961041 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ff406aea0 0x7f0ff406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.759+0000 7f10067fc640 1 -- 172.21.15.44:0/1086961041 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7494+0+0 (secure 0 0 0) 0x7f0ff808aa30 con 0x7f0ff0004d00 2023-11-04T01:41:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.760+0000 7f100d5e6640 1 --2- 172.21.15.44:0/1086961041 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ff406aea0 0x7f0ff406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.760+0000 7f100d5e6640 1 --2- 172.21.15.44:0/1086961041 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ff406aea0 0x7f0ff406d360 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc007fd0 tx=0x7f0ffc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.760+0000 7f1012bd6740 1 Processor -- start 2023-11-04T01:41:37.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.761+0000 7f1012bd6740 1 -- start start 2023-11-04T01:41:37.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.761+0000 7f1012bd6740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553850 0x557913526750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.761+0000 7f1012bd6740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557913553c30 0x5579135565e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.761+0000 7f1012bd6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913526c90 0x557913556b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.761+0000 7f1012bd6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557913437740 con 0x557913526c90 2023-11-04T01:41:37.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.761+0000 7f1012bd6740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579134998d0 con 0x557913553850 2023-11-04T01:41:37.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.761+0000 7f1012bd6740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x557913496fc0 con 0x557913553c30 2023-11-04T01:41:37.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.761+0000 7f100e5e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913526c90 0x557913556b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.761+0000 7f100e5e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913526c90 0x557913556b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35120/0 (socket says 172.21.15.44:35120) 2023-11-04T01:41:37.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.761+0000 7f100e5e8640 1 -- 172.21.15.44:0/4102380766 learned_addr learned my addr 172.21.15.44:0/4102380766 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:37.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.762+0000 7f100dde7640 1 --2- 172.21.15.44:0/4102380766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553850 0x557913526750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.762+0000 7f100d5e6640 1 --2- 172.21.15.44:0/4102380766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557913553c30 0x5579135565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.762+0000 7f100e5e8640 1 -- 172.21.15.44:0/4102380766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557913553c30 msgr2=0x5579135565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.762+0000 7f100e5e8640 1 --2- 172.21.15.44:0/4102380766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557913553c30 0x5579135565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.762+0000 7f100e5e8640 1 -- 172.21.15.44:0/4102380766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553850 msgr2=0x557913526750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.762+0000 7f100e5e8640 1 --2- 172.21.15.44:0/4102380766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553850 0x557913526750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.762+0000 7f100e5e8640 1 -- 172.21.15.44:0/4102380766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557913455ca0 con 0x557913526c90 2023-11-04T01:41:37.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.762+0000 7f100e5e8640 1 --2- 172.21.15.44:0/4102380766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913526c90 0x557913556b20 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f100000c250 tx=0x7f100002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272736a4e24ca482 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.762+0000 7f0fef7fe640 1 -- 172.21.15.44:0/4102380766 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000001670 con 0x557913526c90 2023-11-04T01:41:37.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.762+0000 7f0fef7fe640 1 -- 172.21.15.44:0/4102380766 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100002c830 con 0x557913526c90 2023-11-04T01:41:37.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.762+0000 7f0fef7fe640 1 -- 172.21.15.44:0/4102380766 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100002cba0 con 0x557913526c90 2023-11-04T01:41:37.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.763+0000 7f1012bd6740 1 -- 172.21.15.44:0/4102380766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913526c90 msgr2=0x557913556b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.763+0000 7f1012bd6740 1 --2- 172.21.15.44:0/4102380766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913526c90 0x557913556b20 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f100000c250 tx=0x7f100002e000 comp rx=0 tx=0).stop 2023-11-04T01:41:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.763+0000 7f1012bd6740 1 -- 172.21.15.44:0/4102380766 shutdown_connections 2023-11-04T01:41:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.763+0000 7f1012bd6740 1 --2- 172.21.15.44:0/4102380766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913526c90 0x557913556b20 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.763+0000 7f1012bd6740 1 --2- 172.21.15.44:0/4102380766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557913553c30 0x5579135565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.763+0000 7f1012bd6740 1 --2- 172.21.15.44:0/4102380766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553850 0x557913526750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.763+0000 7f1012bd6740 1 -- 172.21.15.44:0/4102380766 >> 172.21.15.44:0/4102380766 conn(0x557913528a60 msgr2=0x5579135715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.763+0000 7f1012bd6740 1 -- 172.21.15.44:0/4102380766 shutdown_connections 2023-11-04T01:41:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.763+0000 7f1012bd6740 1 -- 172.21.15.44:0/4102380766 wait complete. 2023-11-04T01:41:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.763+0000 7f1012bd6740 1 -- start start 2023-11-04T01:41:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.763+0000 7f1012bd6740 1 Processor -- start 2023-11-04T01:41:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.764+0000 7f1012bd6740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553850 0x557913559c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.764+0000 7f1012bd6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553c30 0x55791356bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.764+0000 7f1012bd6740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55791356b350 0x557913558620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.764+0000 7f1012bd6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579134928b0 con 0x557913553c30 2023-11-04T01:41:37.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.764+0000 7f1012bd6740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55791344cc80 con 0x557913553850 2023-11-04T01:41:37.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.764+0000 7f1012bd6740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55791344c920 con 0x55791356b350 2023-11-04T01:41:37.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.764+0000 7f1012bd6740 10 client.0 _ll_register_callbacks cb 0x5579131a4ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:37.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.764+0000 7f100d5e6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553c30 0x55791356bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.764+0000 7f100d5e6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553c30 0x55791356bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35128/0 (socket says 172.21.15.44:35128) 2023-11-04T01:41:37.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.764+0000 7f100d5e6640 1 -- 172.21.15.44:0/939987790 learned_addr learned my addr 172.21.15.44:0/939987790 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:37.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f100dde7640 1 --2- 172.21.15.44:0/939987790 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553850 0x557913559c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f100e5e8640 1 --2- 172.21.15.44:0/939987790 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55791356b350 0x557913558620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f100d5e6640 1 -- 172.21.15.44:0/939987790 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55791356b350 msgr2=0x557913558620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f100d5e6640 1 --2- 172.21.15.44:0/939987790 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55791356b350 0x557913558620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f100d5e6640 1 -- 172.21.15.44:0/939987790 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553850 msgr2=0x557913559c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f100d5e6640 1 --2- 172.21.15.44:0/939987790 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553850 0x557913559c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f100d5e6640 1 -- 172.21.15.44:0/939987790 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff0003520 con 0x557913553c30 2023-11-04T01:41:37.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f100e5e8640 1 --2- 172.21.15.44:0/939987790 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55791356b350 0x557913558620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:37.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f100dde7640 1 --2- 172.21.15.44:0/939987790 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553850 0x557913559c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:37.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f100d5e6640 1 --2- 172.21.15.44:0/939987790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553c30 0x55791356bc10 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0156c0 tx=0x7f0ffc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34439ffc366b2d66 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f0fecff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:41:37.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f0fecff9640 1 -- 172.21.15.44:0/939987790 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc014720 con 0x557913553c30 2023-11-04T01:41:37.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f0fecff9640 1 -- 172.21.15.44:0/939987790 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7494+0+0 (secure 0 0 0) 0x7f0ffc01a040 con 0x557913553c30 2023-11-04T01:41:37.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f1012bd6740 1 -- 172.21.15.44:0/939987790 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55791343ebf0 con 0x557913553c30 2023-11-04T01:41:37.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f0fecff9640 1 -- 172.21.15.44:0/939987790 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ffc014880 con 0x557913553c30 2023-11-04T01:41:37.777 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f1012bd6740 10 client.8088 fetch_fsmap learned FSMap version 83 2023-11-04T01:41:37.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f1012bd6740 1 -- 172.21.15.44:0/939987790 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x557913490f30 con 0x557913553c30 2023-11-04T01:41:37.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f0fecff9640 1 -- 172.21.15.44:0/939987790 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55791343ebf0 con 0x557913553c30 2023-11-04T01:41:37.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.765+0000 7f0fecff9640 1 -- 172.21.15.44:0/939987790 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 83) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f0ffc020040 con 0x557913553c30 2023-11-04T01:41:37.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.766+0000 7f1012bd6740 10 client.8088 fetch_fsmap finished waiting for FSMap version 83 2023-11-04T01:41:37.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.766+0000 7f1012bd6740 10 client.8088 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:41:37.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.766+0000 7f1012bd6740 20 client.8088 populate_metadata read hostname 'smithi044' 2023-11-04T01:41:37.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.766+0000 7f1012bd6740 1 --2- 172.21.15.44:0/939987790 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x55791356a3a0 0x55791358ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.766+0000 7f1012bd6740 4 client.8088 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:41:37.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.766+0000 7f1012bd6740 1 -- 172.21.15.44:0/939987790 --> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55791348b890 con 0x55791356a3a0 2023-11-04T01:41:37.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.766+0000 7f100dde7640 1 --2- 172.21.15.44:0/939987790 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x55791356a3a0 0x55791358ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.766+0000 7f100dde7640 1 --2- 172.21.15.44:0/939987790 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x55791356a3a0 0x55791358ef70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4625d122a0f46a06 server_cookie=86ac819e3433a75b in_seq=0 out_seq=0 2023-11-04T01:41:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.766+0000 7f0fecff9640 10 client.8088 ms_handle_connect on v2:172.21.15.44:6832/2069525699 2023-11-04T01:41:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.766+0000 7f0fecff9640 1 -- 172.21.15.44:0/939987790 <== mds.1 v2:172.21.15.44:6832/2069525699 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55791348b890 con 0x55791356a3a0 2023-11-04T01:41:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.766+0000 7f0fecff9640 10 client.8088 handle_command_reply: tid=0 2023-11-04T01:41:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.767+0000 7f1012bd6740 1 client.8088 shutdown 2023-11-04T01:41:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.767+0000 7f1012bd6740 1 -- 172.21.15.44:0/939987790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553c30 msgr2=0x55791356bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.767+0000 7f1012bd6740 1 --2- 172.21.15.44:0/939987790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553c30 0x55791356bc10 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0156c0 tx=0x7f0ffc000ed0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.767+0000 7f1012bd6740 1 -- 172.21.15.44:0/939987790 shutdown_connections 2023-11-04T01:41:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.767+0000 7f1012bd6740 1 --2- 172.21.15.44:0/939987790 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x55791356a3a0 0x55791358ef70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.767+0000 7f1012bd6740 1 --2- 172.21.15.44:0/939987790 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55791356b350 0x557913558620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.767+0000 7f1012bd6740 1 --2- 172.21.15.44:0/939987790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553c30 0x55791356bc10 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.767+0000 7f0fecff9640 0 client.8088 ms_handle_reset on v2:172.21.15.44:6832/2069525699 2023-11-04T01:41:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.767+0000 7f1012bd6740 1 --2- 172.21.15.44:0/939987790 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553850 0x557913559c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.767+0000 7f1012bd6740 1 -- 172.21.15.44:0/939987790 >> 172.21.15.44:0/939987790 conn(0x557913526c90 msgr2=0x55791352a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.767+0000 7f1012bd6740 1 -- 172.21.15.44:0/939987790 shutdown_connections 2023-11-04T01:41:37.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.767+0000 7f1012bd6740 1 -- 172.21.15.44:0/939987790 wait complete. 2023-11-04T01:41:37.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.767+0000 7f1012bd6740 20 client.8088 trim_cache size 0 max 16384 2023-11-04T01:41:37.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.783+0000 7f1012bd6740 1 Processor -- start 2023-11-04T01:41:37.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.783+0000 7f1012bd6740 1 -- start start 2023-11-04T01:41:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.783+0000 7f1012bd6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553850 0x557913526630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.783+0000 7f1012bd6740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553c30 0x557913558fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.783+0000 7f1012bd6740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55791356b350 0x55791352a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.783+0000 7f1012bd6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557913412280 con 0x557913553850 2023-11-04T01:41:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.783+0000 7f1012bd6740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x557913559520 con 0x557913553c30 2023-11-04T01:41:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.783+0000 7f1012bd6740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x557913568190 con 0x55791356b350 2023-11-04T01:41:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.783+0000 7f100dde7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553850 0x557913526630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.783+0000 7f100dde7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553850 0x557913526630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35140/0 (socket says 172.21.15.44:35140) 2023-11-04T01:41:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.783+0000 7f100dde7640 1 -- 172.21.15.44:0/3620054274 learned_addr learned my addr 172.21.15.44:0/3620054274 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.783+0000 7f100d5e6640 1 --2- 172.21.15.44:0/3620054274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553c30 0x557913558fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f100e5e8640 1 --2- 172.21.15.44:0/3620054274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55791356b350 0x55791352a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f100dde7640 1 -- 172.21.15.44:0/3620054274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55791356b350 msgr2=0x55791352a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f100dde7640 1 --2- 172.21.15.44:0/3620054274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55791356b350 0x55791352a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f100dde7640 1 -- 172.21.15.44:0/3620054274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553c30 msgr2=0x557913558fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f100dde7640 1 --2- 172.21.15.44:0/3620054274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553c30 0x557913558fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f100dde7640 1 -- 172.21.15.44:0/3620054274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55791342ed10 con 0x557913553850 2023-11-04T01:41:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f100e5e8640 1 --2- 172.21.15.44:0/3620054274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55791356b350 0x55791352a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f100d5e6640 1 --2- 172.21.15.44:0/3620054274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553c30 0x557913558fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f100dde7640 1 --2- 172.21.15.44:0/3620054274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553850 0x557913526630 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800fa80 tx=0x7f0ff8088730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35db80ee646e0afc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f0feffff640 1 -- 172.21.15.44:0/3620054274 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80613a0 con 0x557913553850 2023-11-04T01:41:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f0feffff640 1 -- 172.21.15.44:0/3620054274 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff80571e0 con 0x557913553850 2023-11-04T01:41:37.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f0feffff640 1 -- 172.21.15.44:0/3620054274 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80557b0 con 0x557913553850 2023-11-04T01:41:37.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f1012bd6740 1 -- 172.21.15.44:0/3620054274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553850 msgr2=0x557913526630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f1012bd6740 1 --2- 172.21.15.44:0/3620054274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553850 0x557913526630 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800fa80 tx=0x7f0ff8088730 comp rx=0 tx=0).stop 2023-11-04T01:41:37.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f1012bd6740 1 -- 172.21.15.44:0/3620054274 shutdown_connections 2023-11-04T01:41:37.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f1012bd6740 1 --2- 172.21.15.44:0/3620054274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55791356b350 0x55791352a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f1012bd6740 1 --2- 172.21.15.44:0/3620054274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557913553c30 0x557913558fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f1012bd6740 1 --2- 172.21.15.44:0/3620054274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553850 0x557913526630 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.784+0000 7f1012bd6740 1 -- 172.21.15.44:0/3620054274 >> 172.21.15.44:0/3620054274 conn(0x557913526c90 msgr2=0x557913521c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.785+0000 7f1012bd6740 1 -- 172.21.15.44:0/3620054274 shutdown_connections 2023-11-04T01:41:37.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.785+0000 7f1012bd6740 1 -- 172.21.15.44:0/3620054274 wait complete. 2023-11-04T01:41:37.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.785+0000 7f1012bd6740 1 -- start start 2023-11-04T01:41:37.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.785+0000 7f1012bd6740 1 Processor -- start 2023-11-04T01:41:37.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f1012bd6740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557913553850 0x557913571280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f1012bd6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553c30 0x5579135840d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f1012bd6740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55791356b350 0x5579135dfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f1012bd6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55791356cf90 con 0x557913553c30 2023-11-04T01:41:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f1012bd6740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55791352ad40 con 0x55791356b350 2023-11-04T01:41:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f1012bd6740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579135e0a20 con 0x557913553850 2023-11-04T01:41:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f1012bd6740 10 client.0 _ll_register_callbacks cb 0x7f0ff00036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f100d5e6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553c30 0x5579135840d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f100d5e6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553c30 0x5579135840d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35148/0 (socket says 172.21.15.44:35148) 2023-11-04T01:41:37.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f100d5e6640 1 -- 172.21.15.44:0/3822606456 learned_addr learned my addr 172.21.15.44:0/3822606456 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:37.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f100e5e8640 1 --2- 172.21.15.44:0/3822606456 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55791356b350 0x5579135dfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f100d5e6640 1 -- 172.21.15.44:0/3822606456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557913553850 msgr2=0x557913571280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f100dde7640 1 --2- 172.21.15.44:0/3822606456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557913553850 0x557913571280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f100d5e6640 1 --2- 172.21.15.44:0/3822606456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557913553850 0x557913571280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f100d5e6640 1 -- 172.21.15.44:0/3822606456 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55791356b350 msgr2=0x5579135dfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f100d5e6640 1 --2- 172.21.15.44:0/3822606456 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55791356b350 0x5579135dfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f100d5e6640 1 -- 172.21.15.44:0/3822606456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1008154f00 con 0x557913553c30 2023-11-04T01:41:37.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f100e5e8640 1 --2- 172.21.15.44:0/3822606456 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55791356b350 0x5579135dfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:37.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.786+0000 7f100dde7640 1 --2- 172.21.15.44:0/3822606456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557913553850 0x557913571280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:37.800 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f100d5e6640 1 --2- 172.21.15.44:0/3822606456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553c30 0x5579135840d0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x557913525c20 tx=0x7f0ffc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07574849c974496 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f0fecff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:41:37.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f0fecff9640 1 -- 172.21.15.44:0/3822606456 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc007840 con 0x557913553c30 2023-11-04T01:41:37.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f0fecff9640 1 -- 172.21.15.44:0/3822606456 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7494+0+0 (secure 0 0 0) 0x7f0ffc01a070 con 0x557913553c30 2023-11-04T01:41:37.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f1012bd6740 1 -- 172.21.15.44:0/3822606456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f100002c830 con 0x557913553c30 2023-11-04T01:41:37.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f0fecff9640 1 -- 172.21.15.44:0/3822606456 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ffc022430 con 0x557913553c30 2023-11-04T01:41:37.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f1012bd6740 10 client.8094 fetch_fsmap learned FSMap version 83 2023-11-04T01:41:37.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f1012bd6740 1 -- 172.21.15.44:0/3822606456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x557913454500 con 0x557913553c30 2023-11-04T01:41:37.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f0fecff9640 1 -- 172.21.15.44:0/3822606456 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100002c830 con 0x557913553c30 2023-11-04T01:41:37.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f0fecff9640 1 -- 172.21.15.44:0/3822606456 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 83) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f0ffc022590 con 0x557913553c30 2023-11-04T01:41:37.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f1012bd6740 10 client.8094 fetch_fsmap finished waiting for FSMap version 83 2023-11-04T01:41:37.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f1012bd6740 10 client.8094 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:41:37.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f1012bd6740 20 client.8094 populate_metadata read hostname 'smithi044' 2023-11-04T01:41:37.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f1012bd6740 1 --2- 172.21.15.44:0/3822606456 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x5579135d97a0 0x5579135d9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f1012bd6740 4 client.8094 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:41:37.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f1012bd6740 1 -- 172.21.15.44:0/3822606456 --> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55791348b5b0 con 0x5579135d97a0 2023-11-04T01:41:37.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.787+0000 7f100dde7640 1 --2- 172.21.15.44:0/3822606456 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x5579135d97a0 0x5579135d9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f0fecff9640 10 client.8094 ms_handle_connect on v2:172.21.15.44:6832/2069525699 2023-11-04T01:41:37.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f100dde7640 1 --2- 172.21.15.44:0/3822606456 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x5579135d97a0 0x5579135d9b80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ab2bb5d6d8b251eb server_cookie=af878597968be588 in_seq=0 out_seq=0 2023-11-04T01:41:37.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f0fecff9640 1 -- 172.21.15.44:0/3822606456 <== mds.1 v2:172.21.15.44:6832/2069525699 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55791348b5b0 con 0x5579135d97a0 2023-11-04T01:41:37.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f0fecff9640 10 client.8094 handle_command_reply: tid=0 2023-11-04T01:41:37.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f1012bd6740 1 client.8094 shutdown 2023-11-04T01:41:37.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f1012bd6740 1 -- 172.21.15.44:0/3822606456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553c30 msgr2=0x5579135840d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f1012bd6740 1 --2- 172.21.15.44:0/3822606456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553c30 0x5579135840d0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x557913525c20 tx=0x7f0ffc017000 comp rx=0 tx=0).stop 2023-11-04T01:41:37.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f1012bd6740 1 -- 172.21.15.44:0/3822606456 shutdown_connections 2023-11-04T01:41:37.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f1012bd6740 1 --2- 172.21.15.44:0/3822606456 >> [v2:172.21.15.44:6832/2069525699,v1:172.21.15.44:6834/2069525699] conn(0x5579135d97a0 0x5579135d9b80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f1012bd6740 1 --2- 172.21.15.44:0/3822606456 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55791356b350 0x5579135dfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f0fecff9640 0 client.8094 ms_handle_reset on v2:172.21.15.44:6832/2069525699 2023-11-04T01:41:37.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f1012bd6740 1 --2- 172.21.15.44:0/3822606456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557913553c30 0x5579135840d0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f1012bd6740 1 --2- 172.21.15.44:0/3822606456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557913553850 0x557913571280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f1012bd6740 1 -- 172.21.15.44:0/3822606456 >> 172.21.15.44:0/3822606456 conn(0x557913526c90 msgr2=0x5579135264d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f1012bd6740 1 -- 172.21.15.44:0/3822606456 shutdown_connections 2023-11-04T01:41:37.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f1012bd6740 1 -- 172.21.15.44:0/3822606456 wait complete. 2023-11-04T01:41:37.806 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.788+0000 7f1012bd6740 20 client.8094 trim_cache size 0 max 16384 2023-11-04T01:41:37.806 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:41:37.807 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "2b7a45c6-da06-445f-a890-41d4c08fab63", 2023-11-04T01:41:37.807 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 1, 2023-11-04T01:41:37.807 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7344, 2023-11-04T01:41:37.807 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2023-11-04T01:41:37.807 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2023-11-04T01:41:37.807 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2023-11-04T01:41:37.808 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 117.42286683899999, 2023-11-04T01:41:37.808 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 83, 2023-11-04T01:41:37.808 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 102, 2023-11-04T01:41:37.808 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 102, 2023-11-04T01:41:37.808 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 133.28220672800001 2023-11-04T01:41:37.808 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:41:37.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.789+0000 7f101004b640 1 -- 172.21.15.44:0/1086961041 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ff406aea0 msgr2=0x7f0ff406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.789+0000 7f101004b640 1 --2- 172.21.15.44:0/1086961041 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ff406aea0 0x7f0ff406d360 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc007fd0 tx=0x7f0ffc009040 comp rx=0 tx=0).stop 2023-11-04T01:41:37.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.789+0000 7f101004b640 1 -- 172.21.15.44:0/1086961041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ff0004d00 msgr2=0x7f1008159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.789+0000 7f101004b640 1 --2- 172.21.15.44:0/1086961041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ff0004d00 0x7f1008159600 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8011e60 tx=0x7f0ff800f580 comp rx=0 tx=0).stop 2023-11-04T01:41:37.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.789+0000 7f101004b640 1 -- 172.21.15.44:0/1086961041 shutdown_connections 2023-11-04T01:41:37.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.789+0000 7f101004b640 1 --2- 172.21.15.44:0/1086961041 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0ff406aea0 0x7f0ff406d360 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.789+0000 7f101004b640 1 --2- 172.21.15.44:0/1086961041 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10081f33c0 0x7f10081f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.789+0000 7f101004b640 1 --2- 172.21.15.44:0/1086961041 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1008159b40 0x7f10081f2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.789+0000 7f101004b640 1 --2- 172.21.15.44:0/1086961041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ff0004d00 0x7f1008159600 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.789+0000 7f101004b640 1 -- 172.21.15.44:0/1086961041 >> 172.21.15.44:0/1086961041 conn(0x7f100806ea20 msgr2=0x7f1008160810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.789+0000 7f101004b640 1 -- 172.21.15.44:0/1086961041 shutdown_connections 2023-11-04T01:41:37.812 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.789+0000 7f101004b640 1 -- 172.21.15.44:0/1086961041 wait complete. 2023-11-04T01:41:37.813 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:37.920 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.918+0000 7fca82316640 1 Processor -- start 2023-11-04T01:41:37.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.918+0000 7fca82316640 1 -- start start 2023-11-04T01:41:37.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.919+0000 7fca82316640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fca7c15ce70 0x7fca7c06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.919+0000 7fca82316640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca7c0cb5c0 0x7fca7c0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.919+0000 7fca82316640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c06a120 con 0x7fca7c15d250 2023-11-04T01:41:37.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.919+0000 7fca82316640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7c0cdc10 con 0x7fca7c15ce70 2023-11-04T01:41:37.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.919+0000 7fca82316640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c06def0 con 0x7fca7c0cb5c0 2023-11-04T01:41:37.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.919+0000 7fca7bfff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fca7c15ce70 0x7fca7c06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.919+0000 7fca808b3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca7c0cb5c0 0x7fca7c0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.919+0000 7fca7b7fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fca7c15d250 0x7fca7c0c9830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:48286/0 (socket says 172.21.15.44:48286) 2023-11-04T01:41:37.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.919+0000 7fca7b7fe640 1 -- 172.21.15.44:0/979460210 learned_addr learned my addr 172.21.15.44:0/979460210 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:37.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.920+0000 7fca7bfff640 1 -- 172.21.15.44:0/979460210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca7c0cb5c0 msgr2=0x7fca7c0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.920+0000 7fca7bfff640 1 --2- 172.21.15.44:0/979460210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca7c0cb5c0 0x7fca7c0ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.920+0000 7fca7bfff640 1 -- 172.21.15.44:0/979460210 >> v1:172.21.15.204:6789/0 conn(0x7fca7c15d250 legacy=0x7fca7c0c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.920+0000 7fca7bfff640 1 -- 172.21.15.44:0/979460210 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c0c9f40 con 0x7fca7c15ce70 2023-11-04T01:41:37.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.920+0000 7fca808b3640 1 --2- 172.21.15.44:0/979460210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca7c0cb5c0 0x7fca7c0ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:37.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.921+0000 7fca7bfff640 1 --2- 172.21.15.44:0/979460210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca7c15ce70 0x7fca7c06d9b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0cdd50 tx=0x7fca7002b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9889e39ca7578a65 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.921+0000 7fca7affd640 1 -- 172.21.15.44:0/979460210 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70031800 con 0x7fca7c15ce70 2023-11-04T01:41:37.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.921+0000 7fca7affd640 1 -- 172.21.15.44:0/979460210 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca70031960 con 0x7fca7c15ce70 2023-11-04T01:41:37.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.921+0000 7fca7affd640 1 -- 172.21.15.44:0/979460210 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70031cf0 con 0x7fca7c15ce70 2023-11-04T01:41:37.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.921+0000 7fca82316640 1 -- 172.21.15.44:0/979460210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca7c15ce70 msgr2=0x7fca7c06d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.921+0000 7fca82316640 1 --2- 172.21.15.44:0/979460210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca7c15ce70 0x7fca7c06d9b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0cdd50 tx=0x7fca7002b8a0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.921+0000 7fca82316640 1 -- 172.21.15.44:0/979460210 shutdown_connections 2023-11-04T01:41:37.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.921+0000 7fca82316640 1 --2- 172.21.15.44:0/979460210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca7c0cb5c0 0x7fca7c0ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.921+0000 7fca82316640 1 --2- 172.21.15.44:0/979460210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca7c15ce70 0x7fca7c06d9b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.921+0000 7fca82316640 1 -- 172.21.15.44:0/979460210 >> 172.21.15.44:0/979460210 conn(0x7fca7c0b0cd0 msgr2=0x7fca7c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.921+0000 7fca82316640 1 -- 172.21.15.44:0/979460210 shutdown_connections 2023-11-04T01:41:37.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.921+0000 7fca82316640 1 -- 172.21.15.44:0/979460210 wait complete. 2023-11-04T01:41:37.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.923+0000 7fca82316640 1 Processor -- start 2023-11-04T01:41:37.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.923+0000 7fca82316640 1 -- start start 2023-11-04T01:41:37.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.923+0000 7fca82316640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca7c0cb5c0 0x7fca7c0c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.923+0000 7fca82316640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca7c15ce70 0x7fca7c1e2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.923+0000 7fca82316640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca7c15d250 0x7fca7c1e3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca82316640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c159130 con 0x7fca7c15ce70 2023-11-04T01:41:37.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca82316640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c158520 con 0x7fca7c0cb5c0 2023-11-04T01:41:37.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca82316640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c158800 con 0x7fca7c15d250 2023-11-04T01:41:37.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca7b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca7c15ce70 0x7fca7c1e2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca7b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca7c15ce70 0x7fca7c1e2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35154/0 (socket says 172.21.15.44:35154) 2023-11-04T01:41:37.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca7b7fe640 1 -- 172.21.15.44:0/3766293356 learned_addr learned my addr 172.21.15.44:0/3766293356 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:37.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca7bfff640 1 --2- 172.21.15.44:0/3766293356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca7c0cb5c0 0x7fca7c0c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca808b3640 1 --2- 172.21.15.44:0/3766293356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca7c15d250 0x7fca7c1e3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca7b7fe640 1 -- 172.21.15.44:0/3766293356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca7c15d250 msgr2=0x7fca7c1e3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca7b7fe640 1 --2- 172.21.15.44:0/3766293356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca7c15d250 0x7fca7c1e3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca7b7fe640 1 -- 172.21.15.44:0/3766293356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca7c0cb5c0 msgr2=0x7fca7c0c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca7b7fe640 1 --2- 172.21.15.44:0/3766293356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca7c0cb5c0 0x7fca7c0c5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca7b7fe640 1 -- 172.21.15.44:0/3766293356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca74009a70 con 0x7fca7c15ce70 2023-11-04T01:41:37.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca7b7fe640 1 --2- 172.21.15.44:0/3766293356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca7c15ce70 0x7fca7c1e2be0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00c440 tx=0x7fca6c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca78ff9640 1 -- 172.21.15.44:0/3766293356 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c005ce0 con 0x7fca7c15ce70 2023-11-04T01:41:37.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca78ff9640 1 -- 172.21.15.44:0/3766293356 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c005e40 con 0x7fca7c15ce70 2023-11-04T01:41:37.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca82316640 1 -- 172.21.15.44:0/3766293356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca70009400 con 0x7fca7c15ce70 2023-11-04T01:41:37.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca78ff9640 1 -- 172.21.15.44:0/3766293356 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0072f0 con 0x7fca7c15ce70 2023-11-04T01:41:37.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.924+0000 7fca82316640 1 -- 172.21.15.44:0/3766293356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7c158dc0 con 0x7fca7c15ce70 2023-11-04T01:41:37.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.925+0000 7fca82316640 1 -- 172.21.15.44:0/3766293356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7c1592a0 con 0x7fca7c15ce70 2023-11-04T01:41:37.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.926+0000 7fca78ff9640 1 -- 172.21.15.44:0/3766293356 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca6c007510 con 0x7fca7c15ce70 2023-11-04T01:41:37.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.926+0000 7fca78ff9640 1 --2- 172.21.15.44:0/3766293356 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fca6806ae70 0x7fca6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.926+0000 7fca78ff9640 1 -- 172.21.15.44:0/3766293356 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7494+0+0 (secure 0 0 0) 0x7fca6c089140 con 0x7fca7c15ce70 2023-11-04T01:41:37.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.926+0000 7fca7bfff640 1 --2- 172.21.15.44:0/3766293356 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fca6806ae70 0x7fca6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.927+0000 7fca7bfff640 1 --2- 172.21.15.44:0/3766293356 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fca6806ae70 0x7fca6806d330 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fca70036000 tx=0x7fca7003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.933 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:37.930+0000 7fca78ff9640 1 -- 172.21.15.44:0/3766293356 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fca6c053b80 con 0x7fca7c15ce70 2023-11-04T01:41:38.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.144+0000 7fca82316640 1 -- 172.21.15.44:0/3766293356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca7c074290 con 0x7fca7c15ce70 2023-11-04T01:41:38.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.145+0000 7fca78ff9640 1 -- 172.21.15.44:0/3766293356 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fca6c017090 con 0x7fca7c15ce70 2023-11-04T01:41:38.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.147 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:34.033251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6347,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6347":{"gid":6347,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:38.147 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 83 2023-11-04T01:41:38.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.147+0000 7fca82316640 1 -- 172.21.15.44:0/3766293356 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fca6806ae70 msgr2=0x7fca6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.147+0000 7fca82316640 1 --2- 172.21.15.44:0/3766293356 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fca6806ae70 0x7fca6806d330 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fca70036000 tx=0x7fca7003c040 comp rx=0 tx=0).stop 2023-11-04T01:41:38.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.147+0000 7fca82316640 1 -- 172.21.15.44:0/3766293356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca7c15ce70 msgr2=0x7fca7c1e2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.147+0000 7fca82316640 1 --2- 172.21.15.44:0/3766293356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca7c15ce70 0x7fca7c1e2be0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00c440 tx=0x7fca6c00c840 comp rx=0 tx=0).stop 2023-11-04T01:41:38.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.147+0000 7fca82316640 1 -- 172.21.15.44:0/3766293356 shutdown_connections 2023-11-04T01:41:38.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.147+0000 7fca82316640 1 --2- 172.21.15.44:0/3766293356 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fca6806ae70 0x7fca6806d330 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.147+0000 7fca82316640 1 --2- 172.21.15.44:0/3766293356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca7c15d250 0x7fca7c1e3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.147+0000 7fca82316640 1 --2- 172.21.15.44:0/3766293356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca7c15ce70 0x7fca7c1e2be0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.147+0000 7fca82316640 1 --2- 172.21.15.44:0/3766293356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca7c0cb5c0 0x7fca7c0c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.147+0000 7fca82316640 1 -- 172.21.15.44:0/3766293356 >> 172.21.15.44:0/3766293356 conn(0x7fca7c0b0cd0 msgr2=0x7fca7c0c9810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:38.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.147+0000 7fca82316640 1 -- 172.21.15.44:0/3766293356 shutdown_connections 2023-11-04T01:41:38.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.147+0000 7fca82316640 1 -- 172.21.15.44:0/3766293356 wait complete. 2023-11-04T01:41:38.160 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:41:38.285 INFO:teuthology.orchestra.run.smithi204.stdout:{"last_snap":5,"last_created":5,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:39:52.563500+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:40:23.215578+0000","name":"s12","metadata":{}},{"snapid":4,"ino":1099511627777,"stamp":"2023-11-04T01:40:48.607516+0000","name":"s15","metadata":{}},{"snapid":5,"ino":1099511627777,"stamp":"2023-11-04T01:41:13.892029+0000","name":"s16","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:41:38.285 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 1, "last_snap": 5, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:39:52.563500+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:40:23.215578+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s15", "snapid": 4, "stamp": "2023-11-04T01:40:48.607516+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s16", "snapid": 5, "stamp": "2023-11-04T01:41:13.892029+0000" } ] } 2023-11-04T01:41:38.286 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:41:38.287 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:41:38.289 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:41:38.340 INFO:teuthology.orchestra.run.smithi204.stdout:[global] 2023-11-04T01:41:38.340 INFO:teuthology.orchestra.run.smithi204.stdout: chdir = "" 2023-11-04T01:41:38.340 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:41:38.340 INFO:teuthology.orchestra.run.smithi204.stdout: auth supported = cephx 2023-11-04T01:41:38.340 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.341 INFO:teuthology.orchestra.run.smithi204.stdout: filestore xattr use omap = true 2023-11-04T01:41:38.341 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.341 INFO:teuthology.orchestra.run.smithi204.stdout: mon clock drift allowed = 1.000 2023-11-04T01:41:38.341 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.341 INFO:teuthology.orchestra.run.smithi204.stdout: osd crush chooseleaf type = 0 2023-11-04T01:41:38.341 INFO:teuthology.orchestra.run.smithi204.stdout: auth debug = true 2023-11-04T01:41:38.342 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.342 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on old message = true 2023-11-04T01:41:38.342 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on bug = true 2023-11-04T01:41:38.342 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.342 INFO:teuthology.orchestra.run.smithi204.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:41:38.342 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn max object skew = 0 2023-11-04T01:41:38.343 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.343 INFO:teuthology.orchestra.run.smithi204.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:41:38.343 INFO:teuthology.orchestra.run.smithi204.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:41:38.343 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.343 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default size = 2 2023-11-04T01:41:38.343 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.343 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow primary affinity = true 2023-11-04T01:41:38.344 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow pg remap = true 2023-11-04T01:41:38.344 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:41:38.344 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:41:38.344 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on no sortbitwise = false 2023-11-04T01:41:38.344 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:41:38.344 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on too few osds = false 2023-11-04T01:41:38.345 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:41:38.345 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:41:38.345 INFO:teuthology.orchestra.run.smithi204.stdout: mon_allow_pool_size_one = true 2023-11-04T01:41:38.345 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.345 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:41:38.345 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.345 INFO:teuthology.orchestra.run.smithi204.stdout: osd default data pool replay window = 5 2023-11-04T01:41:38.345 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.345 INFO:teuthology.orchestra.run.smithi204.stdout: mon allow pool delete = true 2023-11-04T01:41:38.346 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.346 INFO:teuthology.orchestra.run.smithi204.stdout: mon cluster log file level = debug 2023-11-04T01:41:38.346 INFO:teuthology.orchestra.run.smithi204.stdout: debug asserts on shutdown = true 2023-11-04T01:41:38.346 INFO:teuthology.orchestra.run.smithi204.stdout: mon health detail to clog = false 2023-11-04T01:41:38.346 INFO:teuthology.orchestra.run.smithi204.stdout: mon host = "172.21.15.44,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]" 2023-11-04T01:41:38.346 INFO:teuthology.orchestra.run.smithi204.stdout: fsid = 2b7a45c6-da06-445f-a890-41d4c08fab63 2023-11-04T01:41:38.346 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.346 INFO:teuthology.orchestra.run.smithi204.stdout:[osd] 2023-11-04T01:41:38.346 INFO:teuthology.orchestra.run.smithi204.stdout: osd journal size = 100 2023-11-04T01:41:38.346 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.346 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub load threshold = 5.0 2023-11-04T01:41:38.346 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub max interval = 600 2023-11-04T01:41:38.346 INFO:teuthology.orchestra.run.smithi204.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:41:38.347 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.347 INFO:teuthology.orchestra.run.smithi204.stdout: osd recover clone overlap = true 2023-11-04T01:41:38.347 INFO:teuthology.orchestra.run.smithi204.stdout: osd recovery max chunk = 1048576 2023-11-04T01:41:38.347 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.347 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug shutdown = true 2023-11-04T01:41:38.347 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug op order = true 2023-11-04T01:41:38.347 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify stray on activate = true 2023-11-04T01:41:38.347 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug trim objects = true 2023-11-04T01:41:38.347 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.347 INFO:teuthology.orchestra.run.smithi204.stdout: osd open classes on start = true 2023-11-04T01:41:38.347 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug pg log writeout = true 2023-11-04T01:41:38.347 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.347 INFO:teuthology.orchestra.run.smithi204.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:41:38.347 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.348 INFO:teuthology.orchestra.run.smithi204.stdout: osd map max advance = 10 2023-11-04T01:41:38.348 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.348 INFO:teuthology.orchestra.run.smithi204.stdout: journal zero on create = true 2023-11-04T01:41:38.348 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.348 INFO:teuthology.orchestra.run.smithi204.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:41:38.348 INFO:teuthology.orchestra.run.smithi204.stdout: filestore apply finisher threads = 3 2023-11-04T01:41:38.348 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.348 INFO:teuthology.orchestra.run.smithi204.stdout: bdev debug aio = true 2023-11-04T01:41:38.348 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug misdirected ops = true 2023-11-04T01:41:38.348 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore block size = 96636764160 2023-11-04T01:41:38.348 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore fsck on mount = True 2023-11-04T01:41:38.348 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluefs = 20 2023-11-04T01:41:38.348 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluestore = 20 2023-11-04T01:41:38.348 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi204.stdout: debug osd = 20 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi204.stdout: debug rocksdb = 10 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd full ratio = 0.9 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi204.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi204.stdout: osd objectstore = bluestore 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr] 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi204.stdout: debug mgr = 20 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi204.stdout: mgr/telemetry/nag = false 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi204.stdout:[mon] 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi204.stdout: debug paxos = 20 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi204.stdout: mon data avail warn = 5 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi204.stdout: mon mgr mkfs grace = 240 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd reporter subtree level = osd 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd prime pg temp = true 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi204.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi204.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi204.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi204.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.352 INFO:teuthology.orchestra.run.smithi204.stdout: # 1m isn't quite enough 2023-11-04T01:41:38.352 INFO:teuthology.orchestra.run.smithi204.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:41:38.352 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.352 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:41:38.352 INFO:teuthology.orchestra.run.smithi204.stdout: mon op complaint time = 120 2023-11-04T01:41:38.352 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-04T01:41:38.352 INFO:teuthology.orchestra.run.smithi204.stdout:[client] 2023-11-04T01:41:38.352 INFO:teuthology.orchestra.run.smithi204.stdout: rgw cache enabled = true 2023-11-04T01:41:38.352 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable ops log = true 2023-11-04T01:41:38.352 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable usage log = true 2023-11-04T01:41:38.353 INFO:teuthology.orchestra.run.smithi204.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:41:38.353 INFO:teuthology.orchestra.run.smithi204.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:41:38.353 INFO:teuthology.orchestra.run.smithi204.stdout: client mount timeout = 600 2023-11-04T01:41:38.353 INFO:teuthology.orchestra.run.smithi204.stdout: debug client = 20 2023-11-04T01:41:38.353 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2023-11-04T01:41:38.353 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = "" 2023-11-04T01:41:38.353 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2023-11-04T01:41:38.353 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2023-11-04T01:41:38.353 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.a] 2023-11-04T01:41:38.353 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.b] 2023-11-04T01:41:38.353 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.c] 2023-11-04T01:41:38.354 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2023-11-04T01:41:38.354 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2023-11-04T01:41:38.354 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2023-11-04T01:41:38.354 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.d] 2023-11-04T01:41:38.354 INFO:teuthology.orchestra.run.smithi204.stdout:[mds] 2023-11-04T01:41:38.354 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds = 20 2023-11-04T01:41:38.354 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds balancer = 20 2023-11-04T01:41:38.354 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2023-11-04T01:41:38.354 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug frag = True 2023-11-04T01:41:38.354 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug scatterstat = True 2023-11-04T01:41:38.354 INFO:teuthology.orchestra.run.smithi204.stdout: mds op complaint time = 180 2023-11-04T01:41:38.354 INFO:teuthology.orchestra.run.smithi204.stdout: mds verify scatter = True 2023-11-04T01:41:38.354 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2023-11-04T01:41:38.355 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2023-11-04T01:41:38.355 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2023-11-04T01:41:38.355 INFO:teuthology.orchestra.run.smithi204.stdout: mds_reconnect_timeout = 5 2023-11-04T01:41:38.356 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2023-11-04T01:41:38.356 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2023-11-04T01:41:38.356 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:41:38.356 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2023-11-04T01:41:38.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.356 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2023-11-04T01:41:38.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.356 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2023-11-04T01:41:38.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.356 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2023-11-04T01:41:38.357 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2023-11-04T01:41:38.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.357 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2023-11-04T01:41:38.357 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2023-11-04T01:41:38.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.357 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:41:38.357 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2023-11-04T01:41:38.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.357 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:41:38.357 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:41:38.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.357 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2023-11-04T01:41:38.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.358 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2023-11-04T01:41:38.358 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2023-11-04T01:41:38.358 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:41:38.358 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:41:38.358 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2023-11-04T01:41:38.358 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:41:38.358 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2023-11-04T01:41:38.358 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:41:38.358 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:41:38.358 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2023-11-04T01:41:38.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.358 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:41:38.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.359 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2023-11-04T01:41:38.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.359 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2023-11-04T01:41:38.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.359 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2023-11-04T01:41:38.359 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2023-11-04T01:41:38.359 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2023-11-04T01:41:38.359 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.44,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]" 2023-11-04T01:41:38.359 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 2b7a45c6-da06-445f-a890-41d4c08fab63 2023-11-04T01:41:38.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.359 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2023-11-04T01:41:38.359 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2023-11-04T01:41:38.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.359 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2023-11-04T01:41:38.360 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2023-11-04T01:41:38.360 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:41:38.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.360 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2023-11-04T01:41:38.360 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2023-11-04T01:41:38.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.360 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2023-11-04T01:41:38.360 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2023-11-04T01:41:38.360 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2023-11-04T01:41:38.360 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug trim objects = true 2023-11-04T01:41:38.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.360 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2023-11-04T01:41:38.360 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2023-11-04T01:41:38.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.361 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:41:38.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.361 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2023-11-04T01:41:38.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.361 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2023-11-04T01:41:38.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.361 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:41:38.361 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2023-11-04T01:41:38.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.361 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2023-11-04T01:41:38.361 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2023-11-04T01:41:38.361 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2023-11-04T01:41:38.361 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2023-11-04T01:41:38.361 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 20 2023-11-04T01:41:38.362 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 20 2023-11-04T01:41:38.362 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-11-04T01:41:38.362 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2023-11-04T01:41:38.362 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 10 2023-11-04T01:41:38.362 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:41:38.362 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2023-11-04T01:41:38.362 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:41:38.362 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:41:38.362 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2023-11-04T01:41:38.362 INFO:teuthology.orchestra.run.smithi044.stdout: osd op complaint time = 180 2023-11-04T01:41:38.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.363 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2023-11-04T01:41:38.363 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-11-04T01:41:38.363 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2023-11-04T01:41:38.363 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2023-11-04T01:41:38.363 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2023-11-04T01:41:38.363 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:38.363 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:38.363 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2023-11-04T01:41:38.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.364 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2023-11-04T01:41:38.364 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-11-04T01:41:38.364 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2023-11-04T01:41:38.364 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2023-11-04T01:41:38.364 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2023-11-04T01:41:38.364 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2023-11-04T01:41:38.364 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2023-11-04T01:41:38.364 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:38.364 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2023-11-04T01:41:38.364 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2023-11-04T01:41:38.364 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:38.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.364 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:41:38.365 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:41:38.365 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:41:38.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.365 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:41:38.365 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:41:38.365 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:41:38.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.365 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2023-11-04T01:41:38.365 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:41:38.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.365 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:41:38.365 INFO:teuthology.orchestra.run.smithi044.stdout: mon op complaint time = 120 2023-11-04T01:41:38.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.365 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2023-11-04T01:41:38.366 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2023-11-04T01:41:38.366 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2023-11-04T01:41:38.366 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2023-11-04T01:41:38.366 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:41:38.366 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:41:38.366 INFO:teuthology.orchestra.run.smithi044.stdout: client mount timeout = 600 2023-11-04T01:41:38.366 INFO:teuthology.orchestra.run.smithi044.stdout: debug client = 20 2023-11-04T01:41:38.367 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-11-04T01:41:38.367 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = "" 2023-11-04T01:41:38.367 INFO:teuthology.orchestra.run.smithi044.stdout: rados mon op timeout = 900 2023-11-04T01:41:38.367 INFO:teuthology.orchestra.run.smithi044.stdout: rados osd op timeout = 900 2023-11-04T01:41:38.367 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2023-11-04T01:41:38.367 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2023-11-04T01:41:38.367 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2023-11-04T01:41:38.367 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2023-11-04T01:41:38.367 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2023-11-04T01:41:38.367 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2023-11-04T01:41:38.367 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2023-11-04T01:41:38.367 INFO:teuthology.orchestra.run.smithi044.stdout:[mds] 2023-11-04T01:41:38.368 INFO:teuthology.orchestra.run.smithi044.stdout: debug mds = 20 2023-11-04T01:41:38.368 INFO:teuthology.orchestra.run.smithi044.stdout: debug mds balancer = 20 2023-11-04T01:41:38.368 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-11-04T01:41:38.368 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug frag = True 2023-11-04T01:41:38.368 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug scatterstat = True 2023-11-04T01:41:38.368 INFO:teuthology.orchestra.run.smithi044.stdout: mds op complaint time = 180 2023-11-04T01:41:38.368 INFO:teuthology.orchestra.run.smithi044.stdout: mds verify scatter = True 2023-11-04T01:41:38.368 INFO:teuthology.orchestra.run.smithi044.stdout: osd op complaint time = 180 2023-11-04T01:41:38.368 INFO:teuthology.orchestra.run.smithi044.stdout: rados mon op timeout = 900 2023-11-04T01:41:38.368 INFO:teuthology.orchestra.run.smithi044.stdout: rados osd op timeout = 900 2023-11-04T01:41:38.369 INFO:teuthology.orchestra.run.smithi044.stdout: mds_reconnect_timeout = 5 2023-11-04T01:41:38.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:38.371 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d1/dir/.snap/*) 2023-11-04T01:41:38.414 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=2, also kill snapclient 2023-11-04T01:41:38.415 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:38.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.559+0000 7f2d9da26640 1 Processor -- start 2023-11-04T01:41:38.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.559+0000 7f2d9da26640 1 -- start start 2023-11-04T01:41:38.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.560+0000 7f2d9da26640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2d9815d4e0 0x7f2d980ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.560+0000 7f2d9da26640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d980b25a0 con 0x7f2d980ca8b0 2023-11-04T01:41:38.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.560+0000 7f2d9da26640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d980b2300 con 0x7f2d980ced90 2023-11-04T01:41:38.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.560+0000 7f2d9da26640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9815d8c0 con 0x7f2d9815d4e0 2023-11-04T01:41:38.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.560+0000 7f2d977fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2d980ca8b0 0x7f2d9806a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46956/0 (socket says 172.21.15.44:46956) 2023-11-04T01:41:38.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.560+0000 7f2d977fe640 1 -- 172.21.15.44:0/1781410815 learned_addr learned my addr 172.21.15.44:0/1781410815 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:38.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d95ffb640 1 -- 172.21.15.44:0/1781410815 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501648824 0 0) 0x7f2d980b25a0 con 0x7f2d980ca8b0 2023-11-04T01:41:38.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d96ffd640 1 --2- 172.21.15.44:0/1781410815 >> v2:172.21.15.204:3300/0 conn(0x7f2d9815d4e0 0x7f2d980ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d95ffb640 1 -- 172.21.15.44:0/1781410815 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d84003520 con 0x7f2d980ca8b0 2023-11-04T01:41:38.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d95ffb640 1 -- 172.21.15.44:0/1781410815 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 63051717 0 0) 0x7f2d84003520 con 0x7f2d980ca8b0 2023-11-04T01:41:38.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d95ffb640 1 -- 172.21.15.44:0/1781410815 >> v2:172.21.15.204:3300/0 conn(0x7f2d9815d4e0 msgr2=0x7f2d980ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:38.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d95ffb640 1 --2- 172.21.15.44:0/1781410815 >> v2:172.21.15.204:3300/0 conn(0x7f2d9815d4e0 0x7f2d980ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d95ffb640 1 -- 172.21.15.44:0/1781410815 >> v1:172.21.15.204:6789/0 conn(0x7f2d980ced90 legacy=0x7f2d980ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:38.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d95ffb640 1 -- 172.21.15.44:0/1781410815 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9815e5f0 con 0x7f2d980ca8b0 2023-11-04T01:41:38.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d95ffb640 1 -- 172.21.15.44:0/1781410815 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f2d880019f0 con 0x7f2d980ca8b0 2023-11-04T01:41:38.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d95ffb640 1 -- 172.21.15.44:0/1781410815 >> v1:172.21.15.44:6789/0 conn(0x7f2d980ca8b0 legacy=0x7f2d9806a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d95ffb640 1 --2- 172.21.15.44:0/1781410815 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d84003970 0x7f2d84003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d95ffb640 1 --2- 172.21.15.44:0/1781410815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d840047c0 0x7f2d84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d95ffb640 1 --2- 172.21.15.44:0/1781410815 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d84005180 0x7f2d8400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d95ffb640 1 -- 172.21.15.44:0/1781410815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9815d8c0 con 0x7f2d840047c0 2023-11-04T01:41:38.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d95ffb640 1 -- 172.21.15.44:0/1781410815 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8400c0b0 con 0x7f2d84003970 2023-11-04T01:41:38.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d95ffb640 1 -- 172.21.15.44:0/1781410815 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8400c270 con 0x7f2d84005180 2023-11-04T01:41:38.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d967fc640 1 --2- 172.21.15.44:0/1781410815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d840047c0 0x7f2d84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d96ffd640 1 --2- 172.21.15.44:0/1781410815 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d84003970 0x7f2d84003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d977fe640 1 --2- 172.21.15.44:0/1781410815 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d84005180 0x7f2d8400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d967fc640 1 -- 172.21.15.44:0/1781410815 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d84005180 msgr2=0x7f2d8400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:38.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d967fc640 1 --2- 172.21.15.44:0/1781410815 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d84005180 0x7f2d8400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d967fc640 1 -- 172.21.15.44:0/1781410815 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d84003970 msgr2=0x7f2d84003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:38.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d967fc640 1 --2- 172.21.15.44:0/1781410815 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d84003970 0x7f2d84003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d967fc640 1 -- 172.21.15.44:0/1781410815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d84003520 con 0x7f2d840047c0 2023-11-04T01:41:38.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.561+0000 7f2d977fe640 1 -- 172.21.15.44:0/1781410815 reap_dead start 2023-11-04T01:41:38.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.562+0000 7f2d967fc640 1 --2- 172.21.15.44:0/1781410815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d840047c0 0x7f2d84004c40 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f2d80003d80 tx=0x7f2d840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3979a2a5df068e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:38.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.562+0000 7f2d95ffb640 1 -- 172.21.15.44:0/1781410815 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80032600 con 0x7f2d840047c0 2023-11-04T01:41:38.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.562+0000 7f2d95ffb640 1 -- 172.21.15.44:0/1781410815 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8002e050 con 0x7f2d840047c0 2023-11-04T01:41:38.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.562+0000 7f2d95ffb640 1 -- 172.21.15.44:0/1781410815 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d800329e0 con 0x7f2d840047c0 2023-11-04T01:41:38.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.563+0000 7f2d9da26640 1 -- 172.21.15.44:0/1781410815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d840047c0 msgr2=0x7f2d84004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.563+0000 7f2d9da26640 1 --2- 172.21.15.44:0/1781410815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d840047c0 0x7f2d84004c40 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f2d80003d80 tx=0x7f2d840057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.563+0000 7f2d9da26640 1 -- 172.21.15.44:0/1781410815 shutdown_connections 2023-11-04T01:41:38.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.563+0000 7f2d9da26640 1 --2- 172.21.15.44:0/1781410815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d840047c0 0x7f2d84004c40 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.563+0000 7f2d9da26640 1 -- 172.21.15.44:0/1781410815 >> 172.21.15.44:0/1781410815 conn(0x7f2d980b1640 msgr2=0x7f2d980b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:38.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.563+0000 7f2d9da26640 1 -- 172.21.15.44:0/1781410815 shutdown_connections 2023-11-04T01:41:38.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.563+0000 7f2d9da26640 1 -- 172.21.15.44:0/1781410815 wait complete. 2023-11-04T01:41:38.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.564+0000 7f2d9da26640 1 Processor -- start 2023-11-04T01:41:38.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.564+0000 7f2d9da26640 1 -- start start 2023-11-04T01:41:38.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d9da26640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d840047c0 0x7f2d980c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d9da26640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d98147c70 0x7f2d98157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d9da26640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d981580b0 0x7f2d98146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d9da26640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980c91f0 con 0x7f2d840047c0 2023-11-04T01:41:38.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d9da26640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980c95f0 con 0x7f2d98147c70 2023-11-04T01:41:38.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d9da26640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980c8570 con 0x7f2d981580b0 2023-11-04T01:41:38.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d96ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d840047c0 0x7f2d980c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d96ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d840047c0 0x7f2d980c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35174/0 (socket says 172.21.15.44:35174) 2023-11-04T01:41:38.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d96ffd640 1 -- 172.21.15.44:0/2162349706 learned_addr learned my addr 172.21.15.44:0/2162349706 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:38.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d967fc640 1 --2- 172.21.15.44:0/2162349706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d98147c70 0x7f2d98157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d977fe640 1 --2- 172.21.15.44:0/2162349706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d981580b0 0x7f2d98146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d96ffd640 1 -- 172.21.15.44:0/2162349706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d981580b0 msgr2=0x7f2d98146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d96ffd640 1 --2- 172.21.15.44:0/2162349706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d981580b0 0x7f2d98146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d96ffd640 1 -- 172.21.15.44:0/2162349706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d98147c70 msgr2=0x7f2d98157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d96ffd640 1 --2- 172.21.15.44:0/2162349706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d98147c70 0x7f2d98157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d96ffd640 1 -- 172.21.15.44:0/2162349706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d980c8850 con 0x7f2d840047c0 2023-11-04T01:41:38.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.565+0000 7f2d977fe640 1 --2- 172.21.15.44:0/2162349706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d981580b0 0x7f2d98146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:38.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.566+0000 7f2d96ffd640 1 --2- 172.21.15.44:0/2162349706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d840047c0 0x7f2d980c7c70 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000b7f0 tx=0x7f2d9000bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:38.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.566+0000 7f2d8ffff640 1 -- 172.21.15.44:0/2162349706 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90010830 con 0x7f2d840047c0 2023-11-04T01:41:38.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.566+0000 7f2d8ffff640 1 -- 172.21.15.44:0/2162349706 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d90010990 con 0x7f2d840047c0 2023-11-04T01:41:38.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.566+0000 7f2d8ffff640 1 -- 172.21.15.44:0/2162349706 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90010d20 con 0x7f2d840047c0 2023-11-04T01:41:38.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.566+0000 7f2d9da26640 1 -- 172.21.15.44:0/2162349706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d980c8b30 con 0x7f2d840047c0 2023-11-04T01:41:38.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.566+0000 7f2d9da26640 1 -- 172.21.15.44:0/2162349706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d980c81b0 con 0x7f2d840047c0 2023-11-04T01:41:38.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.567+0000 7f2d9da26640 1 -- 172.21.15.44:0/2162349706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d980c9460 con 0x7f2d840047c0 2023-11-04T01:41:38.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.567+0000 7f2d8ffff640 1 -- 172.21.15.44:0/2162349706 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d90014430 con 0x7f2d840047c0 2023-11-04T01:41:38.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.567+0000 7f2d8ffff640 1 --2- 172.21.15.44:0/2162349706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2d7806ae70 0x7f2d7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.568+0000 7f2d8ffff640 1 -- 172.21.15.44:0/2162349706 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7494+0+0 (secure 0 0 0) 0x7f2d9008a600 con 0x7f2d840047c0 2023-11-04T01:41:38.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.568+0000 7f2d967fc640 1 --2- 172.21.15.44:0/2162349706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2d7806ae70 0x7f2d7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.568+0000 7f2d967fc640 1 --2- 172.21.15.44:0/2162349706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2d7806ae70 0x7f2d7806d330 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2d80034000 tx=0x7f2d80009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:38.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.572+0000 7f2d8ffff640 1 -- 172.21.15.44:0/2162349706 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d90054fa0 con 0x7f2d840047c0 2023-11-04T01:41:38.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.785+0000 7f2d9da26640 1 -- 172.21.15.44:0/2162349706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d980684b0 con 0x7f2d840047c0 2023-11-04T01:41:38.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.785+0000 7f2d8ffff640 1 -- 172.21.15.44:0/2162349706 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f2d900585c0 con 0x7f2d840047c0 2023-11-04T01:41:38.788 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:38.788 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:34.033251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6347,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6347":{"gid":6347,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:38.788 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 83 2023-11-04T01:41:38.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.787+0000 7f2d9da26640 1 -- 172.21.15.44:0/2162349706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2d7806ae70 msgr2=0x7f2d7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.787+0000 7f2d9da26640 1 --2- 172.21.15.44:0/2162349706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2d7806ae70 0x7f2d7806d330 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2d80034000 tx=0x7f2d80009030 comp rx=0 tx=0).stop 2023-11-04T01:41:38.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.787+0000 7f2d9da26640 1 -- 172.21.15.44:0/2162349706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d840047c0 msgr2=0x7f2d980c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.787+0000 7f2d9da26640 1 --2- 172.21.15.44:0/2162349706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d840047c0 0x7f2d980c7c70 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000b7f0 tx=0x7f2d9000bcb0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.787+0000 7f2d9da26640 1 -- 172.21.15.44:0/2162349706 shutdown_connections 2023-11-04T01:41:38.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.787+0000 7f2d9da26640 1 --2- 172.21.15.44:0/2162349706 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2d7806ae70 0x7f2d7806d330 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.787+0000 7f2d9da26640 1 --2- 172.21.15.44:0/2162349706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d981580b0 0x7f2d98146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.787+0000 7f2d9da26640 1 --2- 172.21.15.44:0/2162349706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d98147c70 0x7f2d98157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.787+0000 7f2d9da26640 1 --2- 172.21.15.44:0/2162349706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d840047c0 0x7f2d980c7c70 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.787+0000 7f2d9da26640 1 -- 172.21.15.44:0/2162349706 >> 172.21.15.44:0/2162349706 conn(0x7f2d980b1640 msgr2=0x7f2d9806de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:38.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.787+0000 7f2d9da26640 1 -- 172.21.15.44:0/2162349706 shutdown_connections 2023-11-04T01:41:38.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:38.787+0000 7f2d9da26640 1 -- 172.21.15.44:0/2162349706 wait complete. 2023-11-04T01:41:38.800 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:41:38.914 INFO:teuthology.orchestra.run.smithi204.stdout:{"last_snap":9,"last_created":5,"last_destroyed":8,"pending_noop":[],"snaps":[{"snapid":5,"ino":1099511627777,"stamp":"2023-11-04T01:41:13.892029+0000","name":"s16","metadata":{}}],"need_to_purge":{"17":[2,3,4,6,7,8]},"pending_update":[],"pending_destroy":[{"version":16,"removed_snap":5,"seq":9}]} 2023-11-04T01:41:38.914 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 8, "last_snap": 9, "need_to_purge": { "17": [ 2, 3, 4, 6, 7, 8 ] }, "pending_destroy": [ { "removed_snap": 5, "seq": 9, "version": 16 } ], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s16", "snapid": 5, "stamp": "2023-11-04T01:41:13.892029+0000" } ] } 2023-11-04T01:41:38.915 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:41:39.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.021+0000 7fb7e534c640 1 Processor -- start 2023-11-04T01:41:39.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.021+0000 7fb7e534c640 1 -- start start 2023-11-04T01:41:39.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.022+0000 7fb7e534c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7e00ceda0 0x7fb7e015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.022+0000 7fb7e534c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb7e00b2210 0x7fb7e015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.022+0000 7fb7e534c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e015d9a0 con 0x7fb7e00cf180 2023-11-04T01:41:39.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.022+0000 7fb7e534c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e00b1df0 con 0x7fb7e00ceda0 2023-11-04T01:41:39.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.022+0000 7fb7e534c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e00cfd00 con 0x7fb7e00b2210 2023-11-04T01:41:39.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.022+0000 7fb7deffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7e00ceda0 0x7fb7e015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.022+0000 7fb7df7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb7e00cf180 0x7fb7e00cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46962/0 (socket says 172.21.15.44:46962) 2023-11-04T01:41:39.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.022+0000 7fb7df7fe640 1 -- 172.21.15.44:0/4241003228 learned_addr learned my addr 172.21.15.44:0/4241003228 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:39.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.022+0000 7fb7de7fc640 1 --2- 172.21.15.44:0/4241003228 >> v2:172.21.15.204:3300/0 conn(0x7fb7e00b2210 0x7fb7e015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.023+0000 7fb7deffd640 1 -- 172.21.15.44:0/4241003228 >> v2:172.21.15.204:3300/0 conn(0x7fb7e00b2210 msgr2=0x7fb7e015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:39.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.023+0000 7fb7deffd640 1 --2- 172.21.15.44:0/4241003228 >> v2:172.21.15.204:3300/0 conn(0x7fb7e00b2210 0x7fb7e015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.023+0000 7fb7deffd640 1 -- 172.21.15.44:0/4241003228 >> v1:172.21.15.44:6789/0 conn(0x7fb7e00cf180 legacy=0x7fb7e00cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.023+0000 7fb7ddffb640 1 -- 172.21.15.44:0/4241003228 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288692634 0 0) 0x7fb7e015d9a0 con 0x7fb7e00cf180 2023-11-04T01:41:39.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.023+0000 7fb7deffd640 1 -- 172.21.15.44:0/4241003228 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e00b0150 con 0x7fb7e00ceda0 2023-11-04T01:41:39.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.023+0000 7fb7deffd640 1 --2- 172.21.15.44:0/4241003228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e00ceda0 0x7fb7e015cf20 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fb7e00b3770 tx=0x7fb7d802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0376be14c42bee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:39.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.024+0000 7fb7ddffb640 1 -- 172.21.15.44:0/4241003228 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d802e070 con 0x7fb7e00ceda0 2023-11-04T01:41:39.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.024+0000 7fb7ddffb640 1 -- 172.21.15.44:0/4241003228 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d80315a0 con 0x7fb7e00ceda0 2023-11-04T01:41:39.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.024+0000 7fb7ddffb640 1 -- 172.21.15.44:0/4241003228 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8031930 con 0x7fb7e00ceda0 2023-11-04T01:41:39.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.024+0000 7fb7e534c640 1 -- 172.21.15.44:0/4241003228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e00ceda0 msgr2=0x7fb7e015cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.024+0000 7fb7e534c640 1 --2- 172.21.15.44:0/4241003228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e00ceda0 0x7fb7e015cf20 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fb7e00b3770 tx=0x7fb7d802b840 comp rx=0 tx=0).stop 2023-11-04T01:41:39.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.024+0000 7fb7e534c640 1 -- 172.21.15.44:0/4241003228 shutdown_connections 2023-11-04T01:41:39.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.024+0000 7fb7e534c640 1 --2- 172.21.15.44:0/4241003228 >> v2:172.21.15.204:3300/0 conn(0x7fb7e00b2210 0x7fb7e015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.024+0000 7fb7e534c640 1 --2- 172.21.15.44:0/4241003228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e00ceda0 0x7fb7e015cf20 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.024+0000 7fb7e534c640 1 -- 172.21.15.44:0/4241003228 >> 172.21.15.44:0/4241003228 conn(0x7fb7e00d0c30 msgr2=0x7fb7e00d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.024+0000 7fb7e534c640 1 -- 172.21.15.44:0/4241003228 shutdown_connections 2023-11-04T01:41:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.024+0000 7fb7e534c640 1 -- 172.21.15.44:0/4241003228 wait complete. 2023-11-04T01:41:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.025+0000 7fb7e534c640 1 Processor -- start 2023-11-04T01:41:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.025+0000 7fb7e534c640 1 -- start start 2023-11-04T01:41:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.026+0000 7fb7e534c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e00b2210 0x7fb7e015a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.026+0000 7fb7e534c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7e00ceda0 0x7fb7e00b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.026+0000 7fb7e534c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7e00cf180 0x7fb7e00b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.026+0000 7fb7e534c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00b4f50 con 0x7fb7e00b2210 2023-11-04T01:41:39.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.026+0000 7fb7e534c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00b43d0 con 0x7fb7e00ceda0 2023-11-04T01:41:39.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.026+0000 7fb7e534c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00b46b0 con 0x7fb7e00cf180 2023-11-04T01:41:39.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.026+0000 7fb7deffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e00b2210 0x7fb7e015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.026+0000 7fb7deffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e00b2210 0x7fb7e015a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35192/0 (socket says 172.21.15.44:35192) 2023-11-04T01:41:39.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.026+0000 7fb7deffd640 1 -- 172.21.15.44:0/3535066185 learned_addr learned my addr 172.21.15.44:0/3535066185 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:39.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.026+0000 7fb7de7fc640 1 --2- 172.21.15.44:0/3535066185 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7e00ceda0 0x7fb7e00b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.026+0000 7fb7df7fe640 1 --2- 172.21.15.44:0/3535066185 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7e00cf180 0x7fb7e00b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.027+0000 7fb7deffd640 1 -- 172.21.15.44:0/3535066185 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7e00cf180 msgr2=0x7fb7e00b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.027+0000 7fb7deffd640 1 --2- 172.21.15.44:0/3535066185 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7e00cf180 0x7fb7e00b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.027+0000 7fb7deffd640 1 -- 172.21.15.44:0/3535066185 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7e00ceda0 msgr2=0x7fb7e00b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.027+0000 7fb7deffd640 1 --2- 172.21.15.44:0/3535066185 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7e00ceda0 0x7fb7e00b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.027+0000 7fb7deffd640 1 -- 172.21.15.44:0/3535066185 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d80093a0 con 0x7fb7e00b2210 2023-11-04T01:41:39.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.027+0000 7fb7deffd640 1 --2- 172.21.15.44:0/3535066185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e00b2210 0x7fb7e015a580 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8000c00 tx=0x7fb7d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:39.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.027+0000 7fb7d77fe640 1 -- 172.21.15.44:0/3535066185 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8032840 con 0x7fb7e00b2210 2023-11-04T01:41:39.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.027+0000 7fb7d77fe640 1 -- 172.21.15.44:0/3535066185 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d80329a0 con 0x7fb7e00b2210 2023-11-04T01:41:39.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.027+0000 7fb7e534c640 1 -- 172.21.15.44:0/3535066185 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e00b4990 con 0x7fb7e00b2210 2023-11-04T01:41:39.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.027+0000 7fb7d77fe640 1 -- 172.21.15.44:0/3535066185 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8032d50 con 0x7fb7e00b2210 2023-11-04T01:41:39.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.027+0000 7fb7e534c640 1 -- 172.21.15.44:0/3535066185 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e015aac0 con 0x7fb7e00b2210 2023-11-04T01:41:39.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.028+0000 7fb7e534c640 1 -- 172.21.15.44:0/3535066185 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e00d13b0 con 0x7fb7e00b2210 2023-11-04T01:41:39.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.029+0000 7fb7d77fe640 1 -- 172.21.15.44:0/3535066185 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb7d804d3f0 con 0x7fb7e00b2210 2023-11-04T01:41:39.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.029+0000 7fb7d77fe640 1 --2- 172.21.15.44:0/3535066185 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb7c006ae70 0x7fb7c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.029+0000 7fb7d77fe640 1 -- 172.21.15.44:0/3535066185 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7494+0+0 (secure 0 0 0) 0x7fb7d80ab6d0 con 0x7fb7e00b2210 2023-11-04T01:41:39.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.029+0000 7fb7de7fc640 1 --2- 172.21.15.44:0/3535066185 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb7c006ae70 0x7fb7c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.030+0000 7fb7de7fc640 1 --2- 172.21.15.44:0/3535066185 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb7c006ae70 0x7fb7c006d330 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb7e00b3120 tx=0x7fb7c8009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:39.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.033+0000 7fb7d77fe640 1 -- 172.21.15.44:0/3535066185 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb7d8076190 con 0x7fb7e00b2210 2023-11-04T01:41:39.281 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:39.279+0000 7fb7e534c640 1 -- 172.21.15.44:0/3535066185 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7fb7e00684b0 con 0x7fb7e00b2210 2023-11-04T01:41:40.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.230+0000 7fb7d77fe640 1 -- 172.21.15.44:0/3535066185 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.6347 v84) v1 ==== 112+0+0 (secure 0 0 0) 0x7fb7d80797b0 con 0x7fb7e00b2210 2023-11-04T01:41:40.232 INFO:teuthology.orchestra.run.smithi044.stderr:freezing mds.6347 2023-11-04T01:41:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.232+0000 7fb7e534c640 1 -- 172.21.15.44:0/3535066185 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb7c006ae70 msgr2=0x7fb7c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.233+0000 7fb7e534c640 1 --2- 172.21.15.44:0/3535066185 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb7c006ae70 0x7fb7c006d330 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb7e00b3120 tx=0x7fb7c8009190 comp rx=0 tx=0).stop 2023-11-04T01:41:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.233+0000 7fb7e534c640 1 -- 172.21.15.44:0/3535066185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e00b2210 msgr2=0x7fb7e015a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.233+0000 7fb7e534c640 1 --2- 172.21.15.44:0/3535066185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e00b2210 0x7fb7e015a580 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8000c00 tx=0x7fb7d80046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.233+0000 7fb7e534c640 1 -- 172.21.15.44:0/3535066185 shutdown_connections 2023-11-04T01:41:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.233+0000 7fb7e534c640 1 --2- 172.21.15.44:0/3535066185 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb7c006ae70 0x7fb7c006d330 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.233+0000 7fb7e534c640 1 --2- 172.21.15.44:0/3535066185 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7e00cf180 0x7fb7e00b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.233+0000 7fb7e534c640 1 --2- 172.21.15.44:0/3535066185 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7e00ceda0 0x7fb7e00b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.233+0000 7fb7e534c640 1 --2- 172.21.15.44:0/3535066185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e00b2210 0x7fb7e015a580 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.233+0000 7fb7e534c640 1 -- 172.21.15.44:0/3535066185 >> 172.21.15.44:0/3535066185 conn(0x7fb7e00d0c30 msgr2=0x7fb7e00c8050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.233+0000 7fb7e534c640 1 -- 172.21.15.44:0/3535066185 shutdown_connections 2023-11-04T01:41:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.233+0000 7fb7e534c640 1 -- 172.21.15.44:0/3535066185 wait complete. 2023-11-04T01:41:40.248 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:41:40.362 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.360+0000 7faefb9b6640 1 Processor -- start 2023-11-04T01:41:40.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.360+0000 7faefb9b6640 1 -- start start 2023-11-04T01:41:40.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.361+0000 7faefb9b6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faef415d630 0x7faef40cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.361+0000 7faefb9b6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef40b0150 con 0x7faef40ceda0 2023-11-04T01:41:40.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.361+0000 7faefb9b6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef40b1170 con 0x7faef40b2210 2023-11-04T01:41:40.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.361+0000 7faefb9b6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef40b1df0 con 0x7faef415d630 2023-11-04T01:41:40.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.361+0000 7faef9f53640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faef415d630 0x7faef40cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.361+0000 7faef9752640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7faef40ceda0 0x7faef415cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46970/0 (socket says 172.21.15.44:46970) 2023-11-04T01:41:40.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.361+0000 7faef9752640 1 -- 172.21.15.44:0/1602974054 learned_addr learned my addr 172.21.15.44:0/1602974054 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:40.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.362+0000 7faef9f53640 1 -- 172.21.15.44:0/1602974054 >> v1:172.21.15.204:6789/0 conn(0x7faef40b2210 legacy=0x7faef40cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.362+0000 7faef9f53640 1 -- 172.21.15.44:0/1602974054 >> v1:172.21.15.44:6789/0 conn(0x7faef40ceda0 legacy=0x7faef415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.362+0000 7faef9f53640 1 -- 172.21.15.44:0/1602974054 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef40b1450 con 0x7faef415d630 2023-11-04T01:41:40.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.362+0000 7faef3fff640 1 -- 172.21.15.44:0/1602974054 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719375066 0 0) 0x7faef40b0150 con 0x7faef40ceda0 2023-11-04T01:41:40.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.362+0000 7faef9f53640 1 --2- 172.21.15.44:0/1602974054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faef415d630 0x7faef40cf890 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7faee4009d90 tx=0x7faee402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92cb112858b05b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.363+0000 7faef3fff640 1 -- 172.21.15.44:0/1602974054 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee402cbd0 con 0x7faef415d630 2023-11-04T01:41:40.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.363+0000 7faef3fff640 1 -- 172.21.15.44:0/1602974054 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee402cd30 con 0x7faef415d630 2023-11-04T01:41:40.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.363+0000 7faef3fff640 1 -- 172.21.15.44:0/1602974054 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee402cea0 con 0x7faef415d630 2023-11-04T01:41:40.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.363+0000 7faefb9b6640 1 -- 172.21.15.44:0/1602974054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faef415d630 msgr2=0x7faef40cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.363+0000 7faefb9b6640 1 --2- 172.21.15.44:0/1602974054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faef415d630 0x7faef40cf890 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7faee4009d90 tx=0x7faee402be20 comp rx=0 tx=0).stop 2023-11-04T01:41:40.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.363+0000 7faefb9b6640 1 -- 172.21.15.44:0/1602974054 shutdown_connections 2023-11-04T01:41:40.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.363+0000 7faefb9b6640 1 --2- 172.21.15.44:0/1602974054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faef415d630 0x7faef40cf890 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.363+0000 7faefb9b6640 1 -- 172.21.15.44:0/1602974054 >> 172.21.15.44:0/1602974054 conn(0x7faef40d0c30 msgr2=0x7faef40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:40.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.363+0000 7faefb9b6640 1 -- 172.21.15.44:0/1602974054 shutdown_connections 2023-11-04T01:41:40.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.363+0000 7faefb9b6640 1 -- 172.21.15.44:0/1602974054 wait complete. 2023-11-04T01:41:40.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.364+0000 7faefb9b6640 1 Processor -- start 2023-11-04T01:41:40.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.365+0000 7faefb9b6640 1 -- start start 2023-11-04T01:41:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.365+0000 7faefb9b6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faef40b2210 0x7faef41e53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.365+0000 7faefb9b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faef40ceda0 0x7faef4150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.365+0000 7faefb9b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faef415d630 0x7faef40cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.365+0000 7faefb9b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef41e5930 con 0x7faef40ceda0 2023-11-04T01:41:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.365+0000 7faefb9b6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef41509b0 con 0x7faef40b2210 2023-11-04T01:41:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.365+0000 7faefb9b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef40ce0a0 con 0x7faef415d630 2023-11-04T01:41:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.365+0000 7faef8f51640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faef40ceda0 0x7faef4150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.365+0000 7faef8f51640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faef40ceda0 0x7faef4150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35210/0 (socket says 172.21.15.44:35210) 2023-11-04T01:41:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.365+0000 7faef8f51640 1 -- 172.21.15.44:0/68156735 learned_addr learned my addr 172.21.15.44:0/68156735 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.366+0000 7faef9752640 1 --2- 172.21.15.44:0/68156735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faef40b2210 0x7faef41e53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.366+0000 7faef9f53640 1 --2- 172.21.15.44:0/68156735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faef415d630 0x7faef40cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.366+0000 7faef8f51640 1 -- 172.21.15.44:0/68156735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faef415d630 msgr2=0x7faef40cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.366+0000 7faef8f51640 1 --2- 172.21.15.44:0/68156735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faef415d630 0x7faef40cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.366+0000 7faef8f51640 1 -- 172.21.15.44:0/68156735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faef40b2210 msgr2=0x7faef41e53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.366+0000 7faef8f51640 1 --2- 172.21.15.44:0/68156735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faef40b2210 0x7faef41e53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.366+0000 7faef8f51640 1 -- 172.21.15.44:0/68156735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee4009a70 con 0x7faef40ceda0 2023-11-04T01:41:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.366+0000 7faef8f51640 1 --2- 172.21.15.44:0/68156735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faef40ceda0 0x7faef4150470 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7faee800c430 tx=0x7faee800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.366+0000 7faef1ffb640 1 -- 172.21.15.44:0/68156735 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80052d0 con 0x7faef40ceda0 2023-11-04T01:41:40.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.366+0000 7faef1ffb640 1 -- 172.21.15.44:0/68156735 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee8005430 con 0x7faef40ceda0 2023-11-04T01:41:40.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.366+0000 7faefb9b6640 1 -- 172.21.15.44:0/68156735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef40c98c0 con 0x7faef40ceda0 2023-11-04T01:41:40.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.366+0000 7faef1ffb640 1 -- 172.21.15.44:0/68156735 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee8003830 con 0x7faef40ceda0 2023-11-04T01:41:40.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.366+0000 7faefb9b6640 1 -- 172.21.15.44:0/68156735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef40c9e80 con 0x7faef40ceda0 2023-11-04T01:41:40.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.367+0000 7faefb9b6640 1 -- 172.21.15.44:0/68156735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef41576b0 con 0x7faef40ceda0 2023-11-04T01:41:40.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.368+0000 7faef1ffb640 1 -- 172.21.15.44:0/68156735 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faee8003990 con 0x7faef40ceda0 2023-11-04T01:41:40.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.368+0000 7faef1ffb640 1 --2- 172.21.15.44:0/68156735 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faee006ae70 0x7faee006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.368+0000 7faef1ffb640 1 -- 172.21.15.44:0/68156735 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7494+0+0 (secure 0 0 0) 0x7faee80891e0 con 0x7faef40ceda0 2023-11-04T01:41:40.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.368+0000 7faef9752640 1 --2- 172.21.15.44:0/68156735 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faee006ae70 0x7faee006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.369+0000 7faef9752640 1 --2- 172.21.15.44:0/68156735 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faee006ae70 0x7faee006d330 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7faeec007a60 tx=0x7faeec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.372+0000 7faef1ffb640 1 -- 172.21.15.44:0/68156735 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faee8053c20 con 0x7faef40ceda0 2023-11-04T01:41:40.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:40.619+0000 7faefb9b6640 1 -- 172.21.15.44:0/68156735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7faef40684b0 con 0x7faef40ceda0 2023-11-04T01:41:41.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.235+0000 7faef1ffb640 1 -- 172.21.15.44:0/68156735 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.7344 v85) v1 ==== 112+0+0 (secure 0 0 0) 0x7faee8057240 con 0x7faef40ceda0 2023-11-04T01:41:41.238 INFO:teuthology.orchestra.run.smithi044.stderr:freezing mds.7344 2023-11-04T01:41:41.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.239+0000 7faefb9b6640 1 -- 172.21.15.44:0/68156735 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faee006ae70 msgr2=0x7faee006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.239+0000 7faefb9b6640 1 --2- 172.21.15.44:0/68156735 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faee006ae70 0x7faee006d330 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7faeec007a60 tx=0x7faeec009040 comp rx=0 tx=0).stop 2023-11-04T01:41:41.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.239+0000 7faefb9b6640 1 -- 172.21.15.44:0/68156735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faef40ceda0 msgr2=0x7faef4150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.239+0000 7faefb9b6640 1 --2- 172.21.15.44:0/68156735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faef40ceda0 0x7faef4150470 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7faee800c430 tx=0x7faee800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.239+0000 7faefb9b6640 1 -- 172.21.15.44:0/68156735 shutdown_connections 2023-11-04T01:41:41.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.239+0000 7faefb9b6640 1 --2- 172.21.15.44:0/68156735 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faee006ae70 0x7faee006d330 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.239+0000 7faefb9b6640 1 --2- 172.21.15.44:0/68156735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faef415d630 0x7faef40cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.239+0000 7faefb9b6640 1 --2- 172.21.15.44:0/68156735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faef40ceda0 0x7faef4150470 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.239+0000 7faefb9b6640 1 --2- 172.21.15.44:0/68156735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faef40b2210 0x7faef41e53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.242 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.240+0000 7faefb9b6640 1 -- 172.21.15.44:0/68156735 >> 172.21.15.44:0/68156735 conn(0x7faef40d0c30 msgr2=0x7faef406b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:41.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.240+0000 7faefb9b6640 1 -- 172.21.15.44:0/68156735 shutdown_connections 2023-11-04T01:41:41.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.240+0000 7faefb9b6640 1 -- 172.21.15.44:0/68156735 wait complete. 2023-11-04T01:41:41.258 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json config set mds_kill_mdstable_at 2 2023-11-04T01:41:41.378 INFO:teuthology.orchestra.run.smithi204.stdout:{"success":"mds_kill_mdstable_at = '2' (not observed, change may require restart) "} 2023-11-04T01:41:41.379 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '2' (not observed, change may require restart) " } 2023-11-04T01:41:41.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:41.379 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s22) 2023-11-04T01:41:41.382 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:41:41.400 INFO:tasks.ceph.mds.d.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fc869435640 time 2023-11-04T01:41:41.400104+0000 2023-11-04T01:41:41.400 INFO:tasks.ceph.mds.d.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:41:41.401 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:41.401 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc874f6efaf] 2023-11-04T01:41:41.401 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fc874f6f16d] 2023-11-04T01:41:41.401 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55bb49bf89ce] 2023-11-04T01:41:41.402 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55bb49c28bcc] 2023-11-04T01:41:41.402 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55bb49c31b0c] 2023-11-04T01:41:41.402 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55bb49c31c63] 2023-11-04T01:41:41.402 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fc8750164a5] 2023-11-04T01:41:41.402 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fc87469f802] 2023-11-04T01:41:41.402 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fc87463f450] 2023-11-04T01:41:41.402 INFO:tasks.ceph.mds.d.smithi204.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:41:41.402 INFO:tasks.ceph.mds.d.smithi204.stderr: in thread 7fc869435640 thread_name:MR_Finisher 2023-11-04T01:41:41.402 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:41:41.399+0000 7fc869435640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fc869435640 time 2023-11-04T01:41:41.400104+0000 2023-11-04T01:41:41.402 INFO:tasks.ceph.mds.d.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:41:41.402 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:41:41.403 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:41.403 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc874f6efaf] 2023-11-04T01:41:41.403 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fc874f6f16d] 2023-11-04T01:41:41.403 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55bb49bf89ce] 2023-11-04T01:41:41.403 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55bb49c28bcc] 2023-11-04T01:41:41.403 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55bb49c31b0c] 2023-11-04T01:41:41.403 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55bb49c31c63] 2023-11-04T01:41:41.403 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fc8750164a5] 2023-11-04T01:41:41.403 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fc87469f802] 2023-11-04T01:41:41.403 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fc87463f450] 2023-11-04T01:41:41.403 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:41:41.403 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:41.403 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc874654db0] 2023-11-04T01:41:41.404 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc8746a154c] 2023-11-04T01:41:41.404 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: raise() 2023-11-04T01:41:41.404 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: abort() 2023-11-04T01:41:41.404 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc874f6f009] 2023-11-04T01:41:41.404 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fc874f6f16d] 2023-11-04T01:41:41.404 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55bb49bf89ce] 2023-11-04T01:41:41.404 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55bb49c28bcc] 2023-11-04T01:41:41.404 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55bb49c31b0c] 2023-11-04T01:41:41.404 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55bb49c31c63] 2023-11-04T01:41:41.405 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fc8750164a5] 2023-11-04T01:41:41.405 INFO:tasks.ceph.mds.d.smithi204.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fc87469f802] 2023-11-04T01:41:41.405 INFO:tasks.ceph.mds.d.smithi204.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fc87463f450] 2023-11-04T01:41:41.405 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:41:41.400+0000 7fc869435640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:41.405 INFO:tasks.ceph.mds.d.smithi204.stderr: in thread 7fc869435640 thread_name:MR_Finisher 2023-11-04T01:41:41.405 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:41:41.405 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:41.405 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc874654db0] 2023-11-04T01:41:41.405 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc8746a154c] 2023-11-04T01:41:41.405 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: raise() 2023-11-04T01:41:41.406 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: abort() 2023-11-04T01:41:41.406 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc874f6f009] 2023-11-04T01:41:41.406 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fc874f6f16d] 2023-11-04T01:41:41.406 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55bb49bf89ce] 2023-11-04T01:41:41.406 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55bb49c28bcc] 2023-11-04T01:41:41.406 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55bb49c31b0c] 2023-11-04T01:41:41.406 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55bb49c31c63] 2023-11-04T01:41:41.406 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fc8750164a5] 2023-11-04T01:41:41.406 INFO:tasks.ceph.mds.d.smithi204.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fc87469f802] 2023-11-04T01:41:41.406 INFO:tasks.ceph.mds.d.smithi204.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fc87463f450] 2023-11-04T01:41:41.407 INFO:tasks.ceph.mds.d.smithi204.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:41.407 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:41:41.407 INFO:tasks.ceph.mds.d.smithi204.stderr: -577> 2023-11-04T01:41:36.712+0000 7fc86cc3c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:41.408 INFO:tasks.ceph.mds.d.smithi204.stderr: -575> 2023-11-04T01:41:36.712+0000 7fc86cc3c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:41.408 INFO:tasks.ceph.mds.d.smithi204.stderr: -1> 2023-11-04T01:41:41.399+0000 7fc869435640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fc869435640 time 2023-11-04T01:41:41.400104+0000 2023-11-04T01:41:41.408 INFO:tasks.ceph.mds.d.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:41:41.408 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:41:41.408 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:41.408 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc874f6efaf] 2023-11-04T01:41:41.408 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fc874f6f16d] 2023-11-04T01:41:41.408 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55bb49bf89ce] 2023-11-04T01:41:41.408 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55bb49c28bcc] 2023-11-04T01:41:41.408 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55bb49c31b0c] 2023-11-04T01:41:41.408 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55bb49c31c63] 2023-11-04T01:41:41.408 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fc8750164a5] 2023-11-04T01:41:41.409 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fc87469f802] 2023-11-04T01:41:41.409 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fc87463f450] 2023-11-04T01:41:41.409 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:41:41.409 INFO:tasks.ceph.mds.d.smithi204.stderr: 0> 2023-11-04T01:41:41.400+0000 7fc869435640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:41.409 INFO:tasks.ceph.mds.d.smithi204.stderr: in thread 7fc869435640 thread_name:MR_Finisher 2023-11-04T01:41:41.409 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:41:41.409 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:41.409 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc874654db0] 2023-11-04T01:41:41.409 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc8746a154c] 2023-11-04T01:41:41.409 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: raise() 2023-11-04T01:41:41.409 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: abort() 2023-11-04T01:41:41.409 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc874f6f009] 2023-11-04T01:41:41.409 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fc874f6f16d] 2023-11-04T01:41:41.410 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55bb49bf89ce] 2023-11-04T01:41:41.410 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55bb49c28bcc] 2023-11-04T01:41:41.410 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55bb49c31b0c] 2023-11-04T01:41:41.410 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55bb49c31c63] 2023-11-04T01:41:41.410 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fc8750164a5] 2023-11-04T01:41:41.410 INFO:tasks.ceph.mds.d.smithi204.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fc87469f802] 2023-11-04T01:41:41.410 INFO:tasks.ceph.mds.d.smithi204.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fc87463f450] 2023-11-04T01:41:41.410 INFO:tasks.ceph.mds.d.smithi204.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:41.410 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:41:41.411 INFO:tasks.ceph.mds.d.smithi204.stderr: -577> 2023-11-04T01:41:36.712+0000 7fc86cc3c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:41.411 INFO:tasks.ceph.mds.d.smithi204.stderr: -575> 2023-11-04T01:41:36.712+0000 7fc86cc3c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:41.411 INFO:tasks.ceph.mds.d.smithi204.stderr: -1> 2023-11-04T01:41:41.399+0000 7fc869435640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fc869435640 time 2023-11-04T01:41:41.400104+0000 2023-11-04T01:41:41.411 INFO:tasks.ceph.mds.d.smithi204.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:41:41.411 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:41:41.411 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:41.411 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc874f6efaf] 2023-11-04T01:41:41.411 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fc874f6f16d] 2023-11-04T01:41:41.411 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55bb49bf89ce] 2023-11-04T01:41:41.411 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55bb49c28bcc] 2023-11-04T01:41:41.412 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55bb49c31b0c] 2023-11-04T01:41:41.412 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55bb49c31c63] 2023-11-04T01:41:41.412 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fc8750164a5] 2023-11-04T01:41:41.412 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fc87469f802] 2023-11-04T01:41:41.412 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fc87463f450] 2023-11-04T01:41:41.412 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:41:41.412 INFO:tasks.ceph.mds.d.smithi204.stderr: 0> 2023-11-04T01:41:41.400+0000 7fc869435640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:41.412 INFO:tasks.ceph.mds.d.smithi204.stderr: in thread 7fc869435640 thread_name:MR_Finisher 2023-11-04T01:41:41.412 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:41:41.412 INFO:tasks.ceph.mds.d.smithi204.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:41.412 INFO:tasks.ceph.mds.d.smithi204.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc874654db0] 2023-11-04T01:41:41.412 INFO:tasks.ceph.mds.d.smithi204.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc8746a154c] 2023-11-04T01:41:41.412 INFO:tasks.ceph.mds.d.smithi204.stderr: 3: raise() 2023-11-04T01:41:41.413 INFO:tasks.ceph.mds.d.smithi204.stderr: 4: abort() 2023-11-04T01:41:41.413 INFO:tasks.ceph.mds.d.smithi204.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc874f6f009] 2023-11-04T01:41:41.413 INFO:tasks.ceph.mds.d.smithi204.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fc874f6f16d] 2023-11-04T01:41:41.413 INFO:tasks.ceph.mds.d.smithi204.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55bb49bf89ce] 2023-11-04T01:41:41.413 INFO:tasks.ceph.mds.d.smithi204.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55bb49c28bcc] 2023-11-04T01:41:41.413 INFO:tasks.ceph.mds.d.smithi204.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55bb49c31b0c] 2023-11-04T01:41:41.413 INFO:tasks.ceph.mds.d.smithi204.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55bb49c31c63] 2023-11-04T01:41:41.413 INFO:tasks.ceph.mds.d.smithi204.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fc8750164a5] 2023-11-04T01:41:41.413 INFO:tasks.ceph.mds.d.smithi204.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fc87469f802] 2023-11-04T01:41:41.413 INFO:tasks.ceph.mds.d.smithi204.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fc87463f450] 2023-11-04T01:41:41.413 INFO:tasks.ceph.mds.d.smithi204.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:41.413 INFO:tasks.ceph.mds.d.smithi204.stderr: 2023-11-04T01:41:41.537 INFO:teuthology.orchestra.run.smithi044.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:41:41.538 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:41:41.538 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:41.626 INFO:tasks.ceph.mds.d.smithi204.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:41:41.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.642+0000 7f36b1e75640 1 Processor -- start 2023-11-04T01:41:41.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.642+0000 7f36b1e75640 1 -- start start 2023-11-04T01:41:41.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.643+0000 7f36b1e75640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f36ac15d100 0x7f36ac0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.643+0000 7f36b1e75640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac0b32b0 con 0x7f36ac15d4e0 2023-11-04T01:41:41.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.643+0000 7f36b1e75640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac0cee10 con 0x7f36ac0d1be0 2023-11-04T01:41:41.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.643+0000 7f36b1e75640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac0b2980 con 0x7f36ac15d100 2023-11-04T01:41:41.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.643+0000 7f36ab7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f36ac15d100 0x7f36ac0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.643+0000 7f36aaffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f36ac15d4e0 0x7f36ac0d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46986/0 (socket says 172.21.15.44:46986) 2023-11-04T01:41:41.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.643+0000 7f36aaffd640 1 -- 172.21.15.44:0/1731948856 learned_addr learned my addr 172.21.15.44:0/1731948856 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:41.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.644+0000 7f36ab7fe640 1 -- 172.21.15.44:0/1731948856 >> v1:172.21.15.204:6789/0 conn(0x7f36ac0d1be0 legacy=0x7f36ac0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.644+0000 7f36ab7fe640 1 -- 172.21.15.44:0/1731948856 >> v1:172.21.15.44:6789/0 conn(0x7f36ac15d4e0 legacy=0x7f36ac0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.644+0000 7f36aa7fc640 1 -- 172.21.15.44:0/1731948856 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465559531 0 0) 0x7f36ac0b32b0 con 0x7f36ac15d4e0 2023-11-04T01:41:41.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.644+0000 7f36ab7fe640 1 -- 172.21.15.44:0/1731948856 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac0b2c60 con 0x7f36ac15d100 2023-11-04T01:41:41.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.644+0000 7f36ab7fe640 1 --2- 172.21.15.44:0/1731948856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac15d100 0x7f36ac0ce510 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f369c009790 tx=0x7f369c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c012d1012678b2f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.645+0000 7f36aa7fc640 1 -- 172.21.15.44:0/1731948856 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c030610 con 0x7f36ac15d100 2023-11-04T01:41:41.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.645+0000 7f36aa7fc640 1 -- 172.21.15.44:0/1731948856 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c030770 con 0x7f36ac15d100 2023-11-04T01:41:41.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.645+0000 7f36aa7fc640 1 -- 172.21.15.44:0/1731948856 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c030b00 con 0x7f36ac15d100 2023-11-04T01:41:41.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.645+0000 7f36b1e75640 1 -- 172.21.15.44:0/1731948856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac15d100 msgr2=0x7f36ac0ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.645+0000 7f36b1e75640 1 --2- 172.21.15.44:0/1731948856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac15d100 0x7f36ac0ce510 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f369c009790 tx=0x7f369c02b960 comp rx=0 tx=0).stop 2023-11-04T01:41:41.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.645+0000 7f36b1e75640 1 -- 172.21.15.44:0/1731948856 shutdown_connections 2023-11-04T01:41:41.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.645+0000 7f36b1e75640 1 --2- 172.21.15.44:0/1731948856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac15d100 0x7f36ac0ce510 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.645+0000 7f36b1e75640 1 -- 172.21.15.44:0/1731948856 >> 172.21.15.44:0/1731948856 conn(0x7f36ac0d2ef0 msgr2=0x7f36ac0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:41.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.645+0000 7f36b1e75640 1 -- 172.21.15.44:0/1731948856 shutdown_connections 2023-11-04T01:41:41.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.645+0000 7f36b1e75640 1 -- 172.21.15.44:0/1731948856 wait complete. 2023-11-04T01:41:41.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.646+0000 7f36b1e75640 1 Processor -- start 2023-11-04T01:41:41.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.647+0000 7f36b1e75640 1 -- start start 2023-11-04T01:41:41.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.647+0000 7f36b1e75640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36ac0d1be0 0x7f36ac15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.647+0000 7f36b1e75640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac15d100 0x7f36ac06bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.647+0000 7f36b1e75640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36ac15d4e0 0x7f36ac153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.647+0000 7f36b1e75640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac06b910 con 0x7f36ac15d100 2023-11-04T01:41:41.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.647+0000 7f36b1e75640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac15a700 con 0x7f36ac15d4e0 2023-11-04T01:41:41.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.647+0000 7f36b1e75640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac06c270 con 0x7f36ac0d1be0 2023-11-04T01:41:41.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f36aaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac15d100 0x7f36ac06bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f36aaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac15d100 0x7f36ac06bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35224/0 (socket says 172.21.15.44:35224) 2023-11-04T01:41:41.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f36ab7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36ac0d1be0 0x7f36ac15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.651 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f36abfff640 1 --2- 172.21.15.44:0/110682744 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36ac15d4e0 0x7f36ac153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f36aaffd640 1 -- 172.21.15.44:0/110682744 learned_addr learned my addr 172.21.15.44:0/110682744 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:41.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f36aaffd640 1 -- 172.21.15.44:0/110682744 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36ac0d1be0 msgr2=0x7f36ac15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f36aaffd640 1 --2- 172.21.15.44:0/110682744 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36ac0d1be0 0x7f36ac15a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f36aaffd640 1 -- 172.21.15.44:0/110682744 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36ac15d4e0 msgr2=0x7f36ac153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f36aaffd640 1 --2- 172.21.15.44:0/110682744 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36ac15d4e0 0x7f36ac153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f36aaffd640 1 -- 172.21.15.44:0/110682744 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c0093a0 con 0x7f36ac15d100 2023-11-04T01:41:41.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f36aaffd640 1 --2- 172.21.15.44:0/110682744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac15d100 0x7f36ac06bd30 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c3f0 tx=0x7f36a000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f3693fff640 1 -- 172.21.15.44:0/110682744 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a00074e0 con 0x7f36ac15d100 2023-11-04T01:41:41.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f3693fff640 1 -- 172.21.15.44:0/110682744 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a0007660 con 0x7f36ac15d100 2023-11-04T01:41:41.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f36b1e75640 1 -- 172.21.15.44:0/110682744 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac154140 con 0x7f36ac15d100 2023-11-04T01:41:41.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f3693fff640 1 -- 172.21.15.44:0/110682744 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0004a20 con 0x7f36ac15d100 2023-11-04T01:41:41.652 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.648+0000 7f36b1e75640 1 -- 172.21.15.44:0/110682744 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac06af70 con 0x7f36ac15d100 2023-11-04T01:41:41.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.649+0000 7f36b1e75640 1 -- 172.21.15.44:0/110682744 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac06ba50 con 0x7f36ac15d100 2023-11-04T01:41:41.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.650+0000 7f3693fff640 1 -- 172.21.15.44:0/110682744 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36a0004b80 con 0x7f36ac15d100 2023-11-04T01:41:41.653 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.650+0000 7f3693fff640 1 --2- 172.21.15.44:0/110682744 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f369806ae70 0x7f369806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.650+0000 7f3693fff640 1 -- 172.21.15.44:0/110682744 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7582+0+0 (secure 0 0 0) 0x7f36a0089930 con 0x7f36ac15d100 2023-11-04T01:41:41.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.650+0000 7f36ab7fe640 1 --2- 172.21.15.44:0/110682744 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f369806ae70 0x7f369806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.654 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.651+0000 7f36ab7fe640 1 --2- 172.21.15.44:0/110682744 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f369806ae70 0x7f369806d330 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f369c036000 tx=0x7f369c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.654+0000 7f3693fff640 1 -- 172.21.15.44:0/110682744 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36ac06ba50 con 0x7f36ac15d100 2023-11-04T01:41:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.874+0000 7f36b1e75640 1 -- 172.21.15.44:0/110682744 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36ac06ba50 con 0x7f36ac15d100 2023-11-04T01:41:41.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.875+0000 7f3693fff640 1 -- 172.21.15.44:0/110682744 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f36ac06ba50 con 0x7f36ac15d100 2023-11-04T01:41:41.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:41.877 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:40.621054+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6347,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6347":{"gid":6347,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:41.877 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 85 2023-11-04T01:41:41.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.877+0000 7f36b1e75640 1 -- 172.21.15.44:0/110682744 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f369806ae70 msgr2=0x7f369806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.877+0000 7f36b1e75640 1 --2- 172.21.15.44:0/110682744 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f369806ae70 0x7f369806d330 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f369c036000 tx=0x7f369c008030 comp rx=0 tx=0).stop 2023-11-04T01:41:41.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.877+0000 7f36b1e75640 1 -- 172.21.15.44:0/110682744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac15d100 msgr2=0x7f36ac06bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.877+0000 7f36b1e75640 1 --2- 172.21.15.44:0/110682744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac15d100 0x7f36ac06bd30 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c3f0 tx=0x7f36a000c8b0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.877+0000 7f36b1e75640 1 -- 172.21.15.44:0/110682744 shutdown_connections 2023-11-04T01:41:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.877+0000 7f36b1e75640 1 --2- 172.21.15.44:0/110682744 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f369806ae70 0x7f369806d330 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.877+0000 7f36b1e75640 1 --2- 172.21.15.44:0/110682744 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36ac15d4e0 0x7f36ac153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.877+0000 7f36b1e75640 1 --2- 172.21.15.44:0/110682744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac15d100 0x7f36ac06bd30 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.877+0000 7f36b1e75640 1 --2- 172.21.15.44:0/110682744 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36ac0d1be0 0x7f36ac15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.877+0000 7f36b1e75640 1 -- 172.21.15.44:0/110682744 >> 172.21.15.44:0/110682744 conn(0x7f36ac0d2ef0 msgr2=0x7f36ac0d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.877+0000 7f36b1e75640 1 -- 172.21.15.44:0/110682744 shutdown_connections 2023-11-04T01:41:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:41.877+0000 7f36b1e75640 1 -- 172.21.15.44:0/110682744 wait complete. 2023-11-04T01:41:41.889 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:46.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-04T01:41:46.890 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.007+0000 7f044759e640 1 Processor -- start 2023-11-04T01:41:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.007+0000 7f044759e640 1 -- start start 2023-11-04T01:41:47.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.008+0000 7f044759e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04480cd820 0x7f04480cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.008+0000 7f044759e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04480b84e0 0x7f04480d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.008+0000 7f044759e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04480ce140 con 0x7f044815cf60 2023-11-04T01:41:47.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.008+0000 7f044759e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0448160fd0 con 0x7f04480b84e0 2023-11-04T01:41:47.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.008+0000 7f044759e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04481611c0 con 0x7f04480cd820 2023-11-04T01:41:47.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.008+0000 7f0446d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04480b84e0 0x7f04480d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.008+0000 7f043ffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f044815cf60 0x7f04481608c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38862/0 (socket says 172.21.15.44:38862) 2023-11-04T01:41:47.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.008+0000 7f043ffff640 1 -- 172.21.15.44:0/1271947494 learned_addr learned my addr 172.21.15.44:0/1271947494 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:47.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.008+0000 7f044659c640 1 --2- 172.21.15.44:0/1271947494 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04480cd820 0x7f04480cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.008+0000 7f0446d9d640 1 -- 172.21.15.44:0/1271947494 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04480cd820 msgr2=0x7f04480cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:47.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.008+0000 7f0446d9d640 1 --2- 172.21.15.44:0/1271947494 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04480cd820 0x7f04480cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.008+0000 7f0446d9d640 1 -- 172.21.15.44:0/1271947494 >> v1:172.21.15.44:6789/0 conn(0x7f044815cf60 legacy=0x7f04481608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.008+0000 7f0446d9d640 1 -- 172.21.15.44:0/1271947494 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04481614a0 con 0x7f04480b84e0 2023-11-04T01:41:47.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.008+0000 7f0445d9b640 1 -- 172.21.15.44:0/1271947494 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289947705 0 0) 0x7f04480ce140 con 0x7f044815cf60 2023-11-04T01:41:47.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.008+0000 7f044659c640 1 --2- 172.21.15.44:0/1271947494 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04480cd820 0x7f04480cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:47.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.009+0000 7f0446d9d640 1 --2- 172.21.15.44:0/1271947494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04480b84e0 0x7f04480d14e0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f0440009d90 tx=0x7f044002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a09a693d711287 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:47.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.009+0000 7f0445d9b640 1 -- 172.21.15.44:0/1271947494 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044002cc50 con 0x7f04480b84e0 2023-11-04T01:41:47.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.009+0000 7f0445d9b640 1 -- 172.21.15.44:0/1271947494 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044002cdb0 con 0x7f04480b84e0 2023-11-04T01:41:47.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.009+0000 7f0445d9b640 1 -- 172.21.15.44:0/1271947494 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0440034660 con 0x7f04480b84e0 2023-11-04T01:41:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.010+0000 7f044759e640 1 -- 172.21.15.44:0/1271947494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04480b84e0 msgr2=0x7f04480d14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.010+0000 7f044759e640 1 --2- 172.21.15.44:0/1271947494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04480b84e0 0x7f04480d14e0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f0440009d90 tx=0x7f044002bea0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.010+0000 7f044759e640 1 -- 172.21.15.44:0/1271947494 shutdown_connections 2023-11-04T01:41:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.010+0000 7f044759e640 1 --2- 172.21.15.44:0/1271947494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04480b84e0 0x7f04480d14e0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.010+0000 7f044759e640 1 --2- 172.21.15.44:0/1271947494 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04480cd820 0x7f04480cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.010+0000 7f044759e640 1 -- 172.21.15.44:0/1271947494 >> 172.21.15.44:0/1271947494 conn(0x7f044806a5e0 msgr2=0x7f044806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:47.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.010+0000 7f044759e640 1 -- 172.21.15.44:0/1271947494 shutdown_connections 2023-11-04T01:41:47.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.010+0000 7f044759e640 1 -- 172.21.15.44:0/1271947494 wait complete. 2023-11-04T01:41:47.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.011+0000 7f044759e640 1 Processor -- start 2023-11-04T01:41:47.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.011+0000 7f044759e640 1 -- start start 2023-11-04T01:41:47.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f044759e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04480b84e0 0x7f04481f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f044759e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04480cd820 0x7f04480c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f044759e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f044815cf60 0x7f04480cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f044759e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04480ca160 con 0x7f04480b84e0 2023-11-04T01:41:47.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f044759e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04480ca400 con 0x7f044815cf60 2023-11-04T01:41:47.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f044759e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04480ca6e0 con 0x7f04480cd820 2023-11-04T01:41:47.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f044659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04480b84e0 0x7f04481f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f044659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04480b84e0 0x7f04481f3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60662/0 (socket says 172.21.15.44:60662) 2023-11-04T01:41:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f044659c640 1 -- 172.21.15.44:0/946096654 learned_addr learned my addr 172.21.15.44:0/946096654 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f043ffff640 1 --2- 172.21.15.44:0/946096654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04480cd820 0x7f04480c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f0446d9d640 1 --2- 172.21.15.44:0/946096654 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f044815cf60 0x7f04480cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f044659c640 1 -- 172.21.15.44:0/946096654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04480cd820 msgr2=0x7f04480c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f044659c640 1 --2- 172.21.15.44:0/946096654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04480cd820 0x7f04480c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f044659c640 1 -- 172.21.15.44:0/946096654 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f044815cf60 msgr2=0x7f04480cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f044659c640 1 --2- 172.21.15.44:0/946096654 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f044815cf60 0x7f04480cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.012+0000 7f044659c640 1 -- 172.21.15.44:0/946096654 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0440009a70 con 0x7f04480b84e0 2023-11-04T01:41:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.013+0000 7f044659c640 1 --2- 172.21.15.44:0/946096654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04480b84e0 0x7f04481f3270 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f043800d7d0 tx=0x7f043800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.013+0000 7f043effd640 1 -- 172.21.15.44:0/946096654 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438004030 con 0x7f04480b84e0 2023-11-04T01:41:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.013+0000 7f043effd640 1 -- 172.21.15.44:0/946096654 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0438004190 con 0x7f04480b84e0 2023-11-04T01:41:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.013+0000 7f044759e640 1 -- 172.21.15.44:0/946096654 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04480ca9c0 con 0x7f04480b84e0 2023-11-04T01:41:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.013+0000 7f043effd640 1 -- 172.21.15.44:0/946096654 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438004520 con 0x7f04480b84e0 2023-11-04T01:41:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.013+0000 7f044759e640 1 -- 172.21.15.44:0/946096654 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04480caf80 con 0x7f04480b84e0 2023-11-04T01:41:47.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.014+0000 7f044759e640 1 -- 172.21.15.44:0/946096654 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04480742c0 con 0x7f04480b84e0 2023-11-04T01:41:47.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.014+0000 7f043effd640 1 -- 172.21.15.44:0/946096654 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f043800b6c0 con 0x7f04480b84e0 2023-11-04T01:41:47.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.015+0000 7f043effd640 1 --2- 172.21.15.44:0/946096654 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f042806ae70 0x7f042806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.015+0000 7f043effd640 1 -- 172.21.15.44:0/946096654 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7566+0+0 (secure 0 0 0) 0x7f0438089f40 con 0x7f04480b84e0 2023-11-04T01:41:47.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.015+0000 7f043ffff640 1 --2- 172.21.15.44:0/946096654 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f042806ae70 0x7f042806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.015+0000 7f043ffff640 1 --2- 172.21.15.44:0/946096654 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f042806ae70 0x7f042806d330 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f04480ce1c0 tx=0x7f0430007c00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:47.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.019+0000 7f043effd640 1 -- 172.21.15.44:0/946096654 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0438054810 con 0x7f04480b84e0 2023-11-04T01:41:47.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.233+0000 7f044759e640 1 -- 172.21.15.44:0/946096654 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04480b2290 con 0x7f04480b84e0 2023-11-04T01:41:47.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.234+0000 7f043effd640 1 -- 172.21.15.44:0/946096654 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f0438057e30 con 0x7f04480b84e0 2023-11-04T01:41:47.236 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:47.236 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:40.621054+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6347,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6347":{"gid":6347,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:47.236 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 85 2023-11-04T01:41:47.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.236+0000 7f044759e640 1 -- 172.21.15.44:0/946096654 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f042806ae70 msgr2=0x7f042806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.236+0000 7f044759e640 1 --2- 172.21.15.44:0/946096654 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f042806ae70 0x7f042806d330 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f04480ce1c0 tx=0x7f0430007c00 comp rx=0 tx=0).stop 2023-11-04T01:41:47.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.236+0000 7f044759e640 1 -- 172.21.15.44:0/946096654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04480b84e0 msgr2=0x7f04481f3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.236+0000 7f044759e640 1 --2- 172.21.15.44:0/946096654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04480b84e0 0x7f04481f3270 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f043800d7d0 tx=0x7f043800dc90 comp rx=0 tx=0).stop 2023-11-04T01:41:47.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.236+0000 7f044759e640 1 -- 172.21.15.44:0/946096654 shutdown_connections 2023-11-04T01:41:47.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.236+0000 7f044759e640 1 --2- 172.21.15.44:0/946096654 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f042806ae70 0x7f042806d330 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.236+0000 7f044759e640 1 --2- 172.21.15.44:0/946096654 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f044815cf60 0x7f04480cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.236+0000 7f044759e640 1 --2- 172.21.15.44:0/946096654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04480cd820 0x7f04480c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.236+0000 7f044759e640 1 --2- 172.21.15.44:0/946096654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04480b84e0 0x7f04481f3270 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.236+0000 7f044759e640 1 -- 172.21.15.44:0/946096654 >> 172.21.15.44:0/946096654 conn(0x7f044806a5e0 msgr2=0x7f04480b7580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:47.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.236+0000 7f044759e640 1 -- 172.21.15.44:0/946096654 shutdown_connections 2023-11-04T01:41:47.239 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:47.236+0000 7f044759e640 1 -- 172.21.15.44:0/946096654 wait complete. 2023-11-04T01:41:47.248 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:52.249 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.366+0000 7f223e34c640 1 Processor -- start 2023-11-04T01:41:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.366+0000 7f223e34c640 1 -- start start 2023-11-04T01:41:52.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.367+0000 7f223e34c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f22380b2160 0x7f223806ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.367+0000 7f223e34c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f223806ca60 0x7f223806ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.367+0000 7f223e34c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223806d3f0 con 0x7f223815b330 2023-11-04T01:41:52.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.367+0000 7f223e34c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22380cb5d0 con 0x7f223806ca60 2023-11-04T01:41:52.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.367+0000 7f223e34c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223806f3f0 con 0x7f22380b2160 2023-11-04T01:41:52.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.367+0000 7f2237fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f223815b330 0x7f22380cba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38878/0 (socket says 172.21.15.44:38878) 2023-11-04T01:41:52.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.367+0000 7f2237fff640 1 -- 172.21.15.44:0/3389712434 learned_addr learned my addr 172.21.15.44:0/3389712434 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:52.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.367+0000 7f223c8e9640 1 --2- 172.21.15.44:0/3389712434 >> v2:172.21.15.44:3300/0 conn(0x7f223806ca60 0x7f223806ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.367+0000 7f22377fe640 1 --2- 172.21.15.44:0/3389712434 >> v2:172.21.15.204:3300/0 conn(0x7f22380b2160 0x7f223806ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.367+0000 7f2236ffd640 1 -- 172.21.15.44:0/3389712434 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356473235 0 0) 0x7f222c001110 con 0x7f223815b330 2023-11-04T01:41:52.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.368+0000 7f2236ffd640 1 -- 172.21.15.44:0/3389712434 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2220003520 con 0x7f223815b330 2023-11-04T01:41:52.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.368+0000 7f223c8e9640 1 -- 172.21.15.44:0/3389712434 >> v2:172.21.15.204:3300/0 conn(0x7f22380b2160 msgr2=0x7f223806ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:52.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.368+0000 7f223c8e9640 1 --2- 172.21.15.44:0/3389712434 >> v2:172.21.15.204:3300/0 conn(0x7f22380b2160 0x7f223806ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.368+0000 7f223c8e9640 1 -- 172.21.15.44:0/3389712434 >> v1:172.21.15.44:6789/0 conn(0x7f223815b330 legacy=0x7f22380cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.368+0000 7f223c8e9640 1 -- 172.21.15.44:0/3389712434 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22380c3490 con 0x7f223806ca60 2023-11-04T01:41:52.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.368+0000 7f22377fe640 1 --2- 172.21.15.44:0/3389712434 >> v2:172.21.15.204:3300/0 conn(0x7f22380b2160 0x7f223806ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:52.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.368+0000 7f223c8e9640 1 --2- 172.21.15.44:0/3389712434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f223806ca60 0x7f223806ceb0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f22380703d0 tx=0x7f223002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518f75967ca55b43 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.369+0000 7f2236ffd640 1 -- 172.21.15.44:0/3389712434 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223002cc80 con 0x7f223806ca60 2023-11-04T01:41:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.369+0000 7f2236ffd640 1 -- 172.21.15.44:0/3389712434 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223002cde0 con 0x7f223806ca60 2023-11-04T01:41:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.369+0000 7f2236ffd640 1 -- 172.21.15.44:0/3389712434 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230034660 con 0x7f223806ca60 2023-11-04T01:41:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.369+0000 7f223e34c640 1 -- 172.21.15.44:0/3389712434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f223806ca60 msgr2=0x7f223806ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.369+0000 7f223e34c640 1 --2- 172.21.15.44:0/3389712434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f223806ca60 0x7f223806ceb0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f22380703d0 tx=0x7f223002bed0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.369+0000 7f223e34c640 1 -- 172.21.15.44:0/3389712434 shutdown_connections 2023-11-04T01:41:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.369+0000 7f223e34c640 1 --2- 172.21.15.44:0/3389712434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f223806ca60 0x7f223806ceb0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.369+0000 7f223e34c640 1 --2- 172.21.15.44:0/3389712434 >> v2:172.21.15.204:3300/0 conn(0x7f22380b2160 0x7f223806ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.369+0000 7f223e34c640 1 -- 172.21.15.44:0/3389712434 >> 172.21.15.44:0/3389712434 conn(0x7f22380b1640 msgr2=0x7f22380b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.369+0000 7f223e34c640 1 -- 172.21.15.44:0/3389712434 shutdown_connections 2023-11-04T01:41:52.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.369+0000 7f223e34c640 1 -- 172.21.15.44:0/3389712434 wait complete. 2023-11-04T01:41:52.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.370+0000 7f223e34c640 1 Processor -- start 2023-11-04T01:41:52.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.371+0000 7f223e34c640 1 -- start start 2023-11-04T01:41:52.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.371+0000 7f223e34c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f223806ca60 0x7f2238145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.371+0000 7f223e34c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22380b2160 0x7f22380c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.371+0000 7f223e34c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f223815b330 0x7f22380b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.371+0000 7f223e34c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2238148620 con 0x7f22380b2160 2023-11-04T01:41:52.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.371+0000 7f223e34c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22380c5940 con 0x7f223815b330 2023-11-04T01:41:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.371+0000 7f223e34c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22380c5c20 con 0x7f223806ca60 2023-11-04T01:41:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f22377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22380b2160 0x7f22380c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f22377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22380b2160 0x7f22380c6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60674/0 (socket says 172.21.15.44:60674) 2023-11-04T01:41:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f22377fe640 1 -- 172.21.15.44:0/1780977757 learned_addr learned my addr 172.21.15.44:0/1780977757 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f223c8e9640 1 --2- 172.21.15.44:0/1780977757 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f223815b330 0x7f22380b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f2237fff640 1 --2- 172.21.15.44:0/1780977757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f223806ca60 0x7f2238145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f22377fe640 1 -- 172.21.15.44:0/1780977757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f223806ca60 msgr2=0x7f2238145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f22377fe640 1 --2- 172.21.15.44:0/1780977757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f223806ca60 0x7f2238145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f22377fe640 1 -- 172.21.15.44:0/1780977757 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f223815b330 msgr2=0x7f22380b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f22377fe640 1 --2- 172.21.15.44:0/1780977757 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f223815b330 0x7f22380b2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f22377fe640 1 -- 172.21.15.44:0/1780977757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2230009a70 con 0x7f22380b2160 2023-11-04T01:41:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f2237fff640 1 --2- 172.21.15.44:0/1780977757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f223806ca60 0x7f2238145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f22377fe640 1 --2- 172.21.15.44:0/1780977757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22380b2160 0x7f22380c6420 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f222800e7e0 tx=0x7f222800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:52.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f2234ff9640 1 -- 172.21.15.44:0/1780977757 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228004030 con 0x7f22380b2160 2023-11-04T01:41:52.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f2234ff9640 1 -- 172.21.15.44:0/1780977757 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2228004190 con 0x7f22380b2160 2023-11-04T01:41:52.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f223e34c640 1 -- 172.21.15.44:0/1780977757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22380c5f00 con 0x7f22380b2160 2023-11-04T01:41:52.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f2234ff9640 1 -- 172.21.15.44:0/1780977757 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228004520 con 0x7f22380b2160 2023-11-04T01:41:52.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.372+0000 7f223e34c640 1 -- 172.21.15.44:0/1780977757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22380c55c0 con 0x7f22380b2160 2023-11-04T01:41:52.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.373+0000 7f223e34c640 1 -- 172.21.15.44:0/1780977757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223806da20 con 0x7f22380b2160 2023-11-04T01:41:52.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.374+0000 7f2234ff9640 1 -- 172.21.15.44:0/1780977757 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f222800c6d0 con 0x7f22380b2160 2023-11-04T01:41:52.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.374+0000 7f2234ff9640 1 --2- 172.21.15.44:0/1780977757 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f222406aea0 0x7f222406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.374+0000 7f2234ff9640 1 -- 172.21.15.44:0/1780977757 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f2228089910 con 0x7f22380b2160 2023-11-04T01:41:52.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.374+0000 7f2237fff640 1 --2- 172.21.15.44:0/1780977757 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f222406aea0 0x7f222406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.375+0000 7f2237fff640 1 --2- 172.21.15.44:0/1780977757 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f222406aea0 0x7f222406d360 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f222c001270 tx=0x7f222c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:52.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.379+0000 7f2234ff9640 1 -- 172.21.15.44:0/1780977757 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2228054350 con 0x7f22380b2160 2023-11-04T01:41:52.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.591+0000 7f223e34c640 1 -- 172.21.15.44:0/1780977757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f223806f100 con 0x7f22380b2160 2023-11-04T01:41:52.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.591+0000 7f2234ff9640 1 -- 172.21.15.44:0/1780977757 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f2228057970 con 0x7f22380b2160 2023-11-04T01:41:52.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:52.594 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:40.621054+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6347,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6347":{"gid":6347,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:52.594 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 85 2023-11-04T01:41:52.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.593+0000 7f223e34c640 1 -- 172.21.15.44:0/1780977757 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f222406aea0 msgr2=0x7f222406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.593+0000 7f223e34c640 1 --2- 172.21.15.44:0/1780977757 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f222406aea0 0x7f222406d360 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f222c001270 tx=0x7f222c009040 comp rx=0 tx=0).stop 2023-11-04T01:41:52.595 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.593+0000 7f223e34c640 1 -- 172.21.15.44:0/1780977757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22380b2160 msgr2=0x7f22380c6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.593+0000 7f223e34c640 1 --2- 172.21.15.44:0/1780977757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22380b2160 0x7f22380c6420 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f222800e7e0 tx=0x7f222800eca0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.593+0000 7f223e34c640 1 -- 172.21.15.44:0/1780977757 shutdown_connections 2023-11-04T01:41:52.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.593+0000 7f223e34c640 1 --2- 172.21.15.44:0/1780977757 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f222406aea0 0x7f222406d360 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.593+0000 7f223e34c640 1 --2- 172.21.15.44:0/1780977757 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f223815b330 0x7f22380b2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.593+0000 7f223e34c640 1 --2- 172.21.15.44:0/1780977757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22380b2160 0x7f22380c6420 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.593+0000 7f223e34c640 1 --2- 172.21.15.44:0/1780977757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f223806ca60 0x7f2238145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.593+0000 7f223e34c640 1 -- 172.21.15.44:0/1780977757 >> 172.21.15.44:0/1780977757 conn(0x7f22380b1640 msgr2=0x7f22381591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:52.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.593+0000 7f223e34c640 1 -- 172.21.15.44:0/1780977757 shutdown_connections 2023-11-04T01:41:52.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:52.593+0000 7f223e34c640 1 -- 172.21.15.44:0/1780977757 wait complete. 2023-11-04T01:41:52.607 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:53.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-11-04T01:41:57.608 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:57.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.725+0000 7f243df5e640 1 Processor -- start 2023-11-04T01:41:57.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.725+0000 7f243df5e640 1 -- start start 2023-11-04T01:41:57.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.725+0000 7f243df5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2438160630 0x7f24380cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.725+0000 7f243df5e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f243806e1d0 0x7f24380cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.725+0000 7f243df5e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f24380ca0e0 0x7f243806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.726+0000 7f243df5e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243806e660 con 0x7f24380ca0e0 2023-11-04T01:41:57.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.726+0000 7f243df5e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243806d0e0 con 0x7f243806e1d0 2023-11-04T01:41:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.726+0000 7f243df5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243806d3c0 con 0x7f2438160630 2023-11-04T01:41:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.726+0000 7f2437fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f24380ca0e0 0x7f243806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.726+0000 7f2437fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f24380ca0e0 0x7f243806bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55196/0 (socket says 172.21.15.44:55196) 2023-11-04T01:41:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.726+0000 7f2437fff640 1 -- 172.21.15.44:0/641054886 learned_addr learned my addr 172.21.15.44:0/641054886 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.726+0000 7f2436ffd640 1 --2- 172.21.15.44:0/641054886 >> v2:172.21.15.204:3300/0 conn(0x7f243806e1d0 0x7f24380cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.726+0000 7f24377fe640 1 --2- 172.21.15.44:0/641054886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2438160630 0x7f24380cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.726+0000 7f2437fff640 1 -- 172.21.15.44:0/641054886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2438160630 msgr2=0x7f24380cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.726+0000 7f2437fff640 1 --2- 172.21.15.44:0/641054886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2438160630 0x7f24380cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.726+0000 7f2437fff640 1 -- 172.21.15.44:0/641054886 >> v2:172.21.15.204:3300/0 conn(0x7f243806e1d0 msgr2=0x7f24380cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.726+0000 7f2437fff640 1 --2- 172.21.15.44:0/641054886 >> v2:172.21.15.204:3300/0 conn(0x7f243806e1d0 0x7f24380cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.726+0000 7f2437fff640 1 -- 172.21.15.44:0/641054886 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243806d6a0 con 0x7f24380ca0e0 2023-11-04T01:41:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.726+0000 7f24377fe640 1 --2- 172.21.15.44:0/641054886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2438160630 0x7f24380cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:57.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.727+0000 7f2437fff640 1 --2- 172.21.15.44:0/641054886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24380ca0e0 0x7f243806bfa0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f2438067280 tx=0x7f243002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5355d1f50402a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.727+0000 7f24367fc640 1 -- 172.21.15.44:0/641054886 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243002c9e0 con 0x7f24380ca0e0 2023-11-04T01:41:57.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.727+0000 7f24367fc640 1 -- 172.21.15.44:0/641054886 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243002cb40 con 0x7f24380ca0e0 2023-11-04T01:41:57.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.727+0000 7f24367fc640 1 -- 172.21.15.44:0/641054886 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24300343f0 con 0x7f24380ca0e0 2023-11-04T01:41:57.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.727+0000 7f243df5e640 1 -- 172.21.15.44:0/641054886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24380ca0e0 msgr2=0x7f243806bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.727+0000 7f243df5e640 1 --2- 172.21.15.44:0/641054886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24380ca0e0 0x7f243806bfa0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f2438067280 tx=0x7f243002be40 comp rx=0 tx=0).stop 2023-11-04T01:41:57.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.728+0000 7f243df5e640 1 -- 172.21.15.44:0/641054886 shutdown_connections 2023-11-04T01:41:57.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.728+0000 7f243df5e640 1 --2- 172.21.15.44:0/641054886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24380ca0e0 0x7f243806bfa0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.728+0000 7f243df5e640 1 --2- 172.21.15.44:0/641054886 >> v2:172.21.15.204:3300/0 conn(0x7f243806e1d0 0x7f24380cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.728+0000 7f243df5e640 1 --2- 172.21.15.44:0/641054886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2438160630 0x7f24380cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.728+0000 7f243df5e640 1 -- 172.21.15.44:0/641054886 >> 172.21.15.44:0/641054886 conn(0x7f24380cb8e0 msgr2=0x7f24380cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.728+0000 7f243df5e640 1 -- 172.21.15.44:0/641054886 shutdown_connections 2023-11-04T01:41:57.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.728+0000 7f243df5e640 1 -- 172.21.15.44:0/641054886 wait complete. 2023-11-04T01:41:57.732 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.729+0000 7f243df5e640 1 Processor -- start 2023-11-04T01:41:57.733 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.729+0000 7f243df5e640 1 -- start start 2023-11-04T01:41:57.735 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f243df5e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f24380ca0e0 0x7f24380c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f243df5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2438160630 0x7f24380c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f243df5e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2438153f40 0x7f24381543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f243df5e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243815c080 con 0x7f2438153f40 2023-11-04T01:41:57.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f243df5e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243815cbc0 con 0x7f24380ca0e0 2023-11-04T01:41:57.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f243df5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2438154930 con 0x7f2438160630 2023-11-04T01:41:57.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f2437fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2438153f40 0x7f24381543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f2437fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2438153f40 0x7f24381543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55200/0 (socket says 172.21.15.44:55200) 2023-11-04T01:41:57.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f2437fff640 1 -- 172.21.15.44:0/219592634 learned_addr learned my addr 172.21.15.44:0/219592634 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:57.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f24377fe640 1 --2- 172.21.15.44:0/219592634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f24380ca0e0 0x7f24380c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.736 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f2436ffd640 1 --2- 172.21.15.44:0/219592634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2438160630 0x7f24380c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f2437fff640 1 -- 172.21.15.44:0/219592634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2438160630 msgr2=0x7f24380c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f2437fff640 1 --2- 172.21.15.44:0/219592634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2438160630 0x7f24380c6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f2437fff640 1 -- 172.21.15.44:0/219592634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f24380ca0e0 msgr2=0x7f24380c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f2437fff640 1 --2- 172.21.15.44:0/219592634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f24380ca0e0 0x7f24380c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f2437fff640 1 -- 172.21.15.44:0/219592634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2430009b30 con 0x7f2438153f40 2023-11-04T01:41:57.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.730+0000 7f2437fff640 1 --2- 172.21.15.44:0/219592634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2438153f40 0x7f24381543f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2430009f40 tx=0x7f2430004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.731+0000 7f241ffff640 1 -- 172.21.15.44:0/219592634 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430009510 con 0x7f2438153f40 2023-11-04T01:41:57.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.731+0000 7f241ffff640 1 -- 172.21.15.44:0/219592634 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243003e450 con 0x7f2438153f40 2023-11-04T01:41:57.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.731+0000 7f243df5e640 1 -- 172.21.15.44:0/219592634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243815c290 con 0x7f2438153f40 2023-11-04T01:41:57.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.731+0000 7f241ffff640 1 -- 172.21.15.44:0/219592634 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243003e800 con 0x7f2438153f40 2023-11-04T01:41:57.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.731+0000 7f243df5e640 1 -- 172.21.15.44:0/219592634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243815c850 con 0x7f2438153f40 2023-11-04T01:41:57.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.732+0000 7f243df5e640 1 -- 172.21.15.44:0/219592634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24380cabd0 con 0x7f2438153f40 2023-11-04T01:41:57.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.732+0000 7f241ffff640 1 -- 172.21.15.44:0/219592634 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f243003e960 con 0x7f2438153f40 2023-11-04T01:41:57.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.733+0000 7f241ffff640 1 --2- 172.21.15.44:0/219592634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f242406ae70 0x7f242406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.733+0000 7f241ffff640 1 -- 172.21.15.44:0/219592634 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f24300acd70 con 0x7f2438153f40 2023-11-04T01:41:57.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.733+0000 7f24377fe640 1 --2- 172.21.15.44:0/219592634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f242406ae70 0x7f242406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.733+0000 7f24377fe640 1 --2- 172.21.15.44:0/219592634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f242406ae70 0x7f242406d330 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f24380c1c90 tx=0x7f2428008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.737+0000 7f241ffff640 1 -- 172.21.15.44:0/219592634 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2430077790 con 0x7f2438153f40 2023-11-04T01:41:57.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.953+0000 7f243df5e640 1 -- 172.21.15.44:0/219592634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2438073600 con 0x7f2438153f40 2023-11-04T01:41:57.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.954+0000 7f241ffff640 1 -- 172.21.15.44:0/219592634 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4983 (secure 0 0 0) 0x7f243007adb0 con 0x7f2438153f40 2023-11-04T01:41:57.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:57.956 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:54.229079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6347,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6347":{"gid":6347,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:41:54.229079+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:57.956 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 86 2023-11-04T01:41:57.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.956+0000 7f243df5e640 1 -- 172.21.15.44:0/219592634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f242406ae70 msgr2=0x7f242406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.956+0000 7f243df5e640 1 --2- 172.21.15.44:0/219592634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f242406ae70 0x7f242406d330 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f24380c1c90 tx=0x7f2428008040 comp rx=0 tx=0).stop 2023-11-04T01:41:57.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.956+0000 7f243df5e640 1 -- 172.21.15.44:0/219592634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2438153f40 msgr2=0x7f24381543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.956+0000 7f243df5e640 1 --2- 172.21.15.44:0/219592634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2438153f40 0x7f24381543f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2430009f40 tx=0x7f2430004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:57.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.956+0000 7f243df5e640 1 -- 172.21.15.44:0/219592634 shutdown_connections 2023-11-04T01:41:57.958 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.956+0000 7f243df5e640 1 --2- 172.21.15.44:0/219592634 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f242406ae70 0x7f242406d330 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.956+0000 7f243df5e640 1 --2- 172.21.15.44:0/219592634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2438153f40 0x7f24381543f0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.956+0000 7f243df5e640 1 --2- 172.21.15.44:0/219592634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2438160630 0x7f24380c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.956+0000 7f243df5e640 1 --2- 172.21.15.44:0/219592634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f24380ca0e0 0x7f24380c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.956+0000 7f243df5e640 1 -- 172.21.15.44:0/219592634 >> 172.21.15.44:0/219592634 conn(0x7f24380cb8e0 msgr2=0x7f24380cbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.956+0000 7f243df5e640 1 -- 172.21.15.44:0/219592634 shutdown_connections 2023-11-04T01:41:57.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:57.956+0000 7f243df5e640 1 -- 172.21.15.44:0/219592634 wait complete. 2023-11-04T01:41:57.969 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:41:57.969 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:41:57.999 INFO:teuthology.orchestra.run.smithi204.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:41:58.001 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:41:58.001 DEBUG:teuthology.orchestra.run.smithi204:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:41:58.076 INFO:teuthology.orchestra.run.smithi204.stdout:1699062101.126838.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i d', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:41:58.077 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062101.126838.core'] 2023-11-04T01:41:58.077 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062101.126838.core, deleting it 2023-11-04T01:41:58.078 DEBUG:teuthology.orchestra.run.smithi204:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062101.126838.core 2023-11-04T01:41:58.151 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:58.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.257+0000 7f8187694640 1 Processor -- start 2023-11-04T01:41:58.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.257+0000 7f8187694640 1 -- start start 2023-11-04T01:41:58.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.257+0000 7f8187694640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f81800afda0 0x7f81800cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8187694640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81800cd7f0 0x7f81800ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8187694640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81800cf240 con 0x7f818015b200 2023-11-04T01:41:58.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8187694640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81800cdc20 con 0x7f81800afda0 2023-11-04T01:41:58.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8187694640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81800cde80 con 0x7f81800cd7f0 2023-11-04T01:41:58.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8184c2f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f81800afda0 0x7f81800cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8185c31640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81800cd7f0 0x7f81800ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8184c2f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f81800afda0 0x7f81800cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:54964/0 (socket says 172.21.15.44:54964) 2023-11-04T01:41:58.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8185430640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f818015b200 0x7f81800ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:43522/0 (socket says 172.21.15.44:43522) 2023-11-04T01:41:58.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8185c31640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81800cd7f0 0x7f81800ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:39136/0 (socket says 172.21.15.44:39136) 2023-11-04T01:41:58.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8184c2f640 1 -- 172.21.15.44:0/760939095 learned_addr learned my addr 172.21.15.44:0/760939095 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:58.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8185c31640 1 -- 172.21.15.44:0/760939095 >> v2:172.21.15.204:3300/0 conn(0x7f81800afda0 msgr2=0x7f81800cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:58.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8185c31640 1 --2- 172.21.15.44:0/760939095 >> v2:172.21.15.204:3300/0 conn(0x7f81800afda0 0x7f81800cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8185c31640 1 -- 172.21.15.44:0/760939095 >> v1:172.21.15.204:6789/0 conn(0x7f818015b200 legacy=0x7f81800ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8177fff640 1 -- 172.21.15.44:0/760939095 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657386227 0 0) 0x7f817c001160 con 0x7f818015b200 2023-11-04T01:41:58.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8185c31640 1 -- 172.21.15.44:0/760939095 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81800cf670 con 0x7f81800cd7f0 2023-11-04T01:41:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.258+0000 7f8184c2f640 1 --2- 172.21.15.44:0/760939095 >> v2:172.21.15.204:3300/0 conn(0x7f81800afda0 0x7f81800cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.259+0000 7f8185c31640 1 --2- 172.21.15.44:0/760939095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81800cd7f0 0x7f81800ae2b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8178009d90 tx=0x7f817802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c69c1455478cd63 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.259+0000 7f8177fff640 1 -- 172.21.15.44:0/760939095 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817802cbc0 con 0x7f81800cd7f0 2023-11-04T01:41:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.259+0000 7f8177fff640 1 -- 172.21.15.44:0/760939095 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817802cd20 con 0x7f81800cd7f0 2023-11-04T01:41:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.259+0000 7f8177fff640 1 -- 172.21.15.44:0/760939095 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178034660 con 0x7f81800cd7f0 2023-11-04T01:41:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.260+0000 7f8187694640 1 -- 172.21.15.44:0/760939095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81800cd7f0 msgr2=0x7f81800ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.260+0000 7f8187694640 1 --2- 172.21.15.44:0/760939095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81800cd7f0 0x7f81800ae2b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8178009d90 tx=0x7f817802be10 comp rx=0 tx=0).stop 2023-11-04T01:41:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.260+0000 7f8187694640 1 -- 172.21.15.44:0/760939095 shutdown_connections 2023-11-04T01:41:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.260+0000 7f8187694640 1 --2- 172.21.15.44:0/760939095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81800cd7f0 0x7f81800ae2b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.260+0000 7f8187694640 1 --2- 172.21.15.44:0/760939095 >> v2:172.21.15.204:3300/0 conn(0x7f81800afda0 0x7f81800cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.260+0000 7f8187694640 1 -- 172.21.15.44:0/760939095 >> 172.21.15.44:0/760939095 conn(0x7f81800d0c30 msgr2=0x7f81800d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.260+0000 7f8187694640 1 -- 172.21.15.44:0/760939095 shutdown_connections 2023-11-04T01:41:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.260+0000 7f8187694640 1 -- 172.21.15.44:0/760939095 wait complete. 2023-11-04T01:41:58.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.261+0000 7f8187694640 1 Processor -- start 2023-11-04T01:41:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.261+0000 7f8187694640 1 -- start start 2023-11-04T01:41:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.262+0000 7f8187694640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81800afda0 0x7f81801468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.262+0000 7f8187694640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81800cd7f0 0x7f81800c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.262+0000 7f8187694640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818015b200 0x7f818006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.262+0000 7f8187694640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81801448c0 con 0x7f818015b200 2023-11-04T01:41:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.262+0000 7f8187694640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8180146e90 con 0x7f81800cd7f0 2023-11-04T01:41:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.262+0000 7f8187694640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8180147170 con 0x7f81800afda0 2023-11-04T01:41:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.262+0000 7f8185c31640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818015b200 0x7f818006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.262+0000 7f8185c31640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818015b200 0x7f818006eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55202/0 (socket says 172.21.15.44:55202) 2023-11-04T01:41:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.262+0000 7f8185c31640 1 -- 172.21.15.44:0/3041978707 learned_addr learned my addr 172.21.15.44:0/3041978707 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.262+0000 7f8185430640 1 --2- 172.21.15.44:0/3041978707 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81800afda0 0x7f81801468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.262+0000 7f8184c2f640 1 --2- 172.21.15.44:0/3041978707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81800cd7f0 0x7f81800c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.263+0000 7f8185c31640 1 -- 172.21.15.44:0/3041978707 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81800afda0 msgr2=0x7f81801468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.263+0000 7f8185c31640 1 --2- 172.21.15.44:0/3041978707 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81800afda0 0x7f81801468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.263+0000 7f8185c31640 1 -- 172.21.15.44:0/3041978707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81800cd7f0 msgr2=0x7f81800c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.263+0000 7f8185c31640 1 --2- 172.21.15.44:0/3041978707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81800cd7f0 0x7f81800c4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.263+0000 7f8185c31640 1 -- 172.21.15.44:0/3041978707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81700094d0 con 0x7f818015b200 2023-11-04T01:41:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.263+0000 7f8185c31640 1 --2- 172.21.15.44:0/3041978707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818015b200 0x7f818006eb50 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f8178009d90 tx=0x7f8178004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.263+0000 7f8175ffb640 1 -- 172.21.15.44:0/3041978707 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178040650 con 0x7f818015b200 2023-11-04T01:41:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.263+0000 7f8175ffb640 1 -- 172.21.15.44:0/3041978707 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817802ce90 con 0x7f818015b200 2023-11-04T01:41:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.263+0000 7f8187694640 1 -- 172.21.15.44:0/3041978707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8178009a70 con 0x7f818015b200 2023-11-04T01:41:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.263+0000 7f8175ffb640 1 -- 172.21.15.44:0/3041978707 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81780409f0 con 0x7f818015b200 2023-11-04T01:41:58.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.263+0000 7f8187694640 1 -- 172.21.15.44:0/3041978707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81800c5070 con 0x7f818015b200 2023-11-04T01:41:58.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.264+0000 7f8187694640 1 -- 172.21.15.44:0/3041978707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8180144a90 con 0x7f818015b200 2023-11-04T01:41:58.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.265+0000 7f8175ffb640 1 -- 172.21.15.44:0/3041978707 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8178040b50 con 0x7f818015b200 2023-11-04T01:41:58.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.265+0000 7f8175ffb640 1 --2- 172.21.15.44:0/3041978707 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f816406ae70 0x7f816406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.265+0000 7f8175ffb640 1 -- 172.21.15.44:0/3041978707 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f81780ac7b0 con 0x7f818015b200 2023-11-04T01:41:58.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.265+0000 7f8185430640 1 --2- 172.21.15.44:0/3041978707 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f816406ae70 0x7f816406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.266+0000 7f8185430640 1 --2- 172.21.15.44:0/3041978707 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f816406ae70 0x7f816406d330 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f817c000fb0 tx=0x7f817c007ba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:58.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.269+0000 7f8175ffb640 1 -- 172.21.15.44:0/3041978707 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8178077200 con 0x7f818015b200 2023-11-04T01:41:58.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.481+0000 7f8187694640 1 -- 172.21.15.44:0/3041978707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81800684b0 con 0x7f818015b200 2023-11-04T01:41:58.483 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.481+0000 7f8175ffb640 1 -- 172.21.15.44:0/3041978707 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4983 (secure 0 0 0) 0x7f8178009450 con 0x7f818015b200 2023-11-04T01:41:58.484 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:58.484 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:54.229079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6347,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6347":{"gid":6347,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.204:6836/3287638895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3287638895},{"type":"v1","addr":"172.21.15.204:6836","nonce":3287638895}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:41:54.229079+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:58.484 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 86 2023-11-04T01:41:58.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.483+0000 7f8187694640 1 -- 172.21.15.44:0/3041978707 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f816406ae70 msgr2=0x7f816406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.483+0000 7f8187694640 1 --2- 172.21.15.44:0/3041978707 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f816406ae70 0x7f816406d330 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f817c000fb0 tx=0x7f817c007ba0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.483+0000 7f8187694640 1 -- 172.21.15.44:0/3041978707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818015b200 msgr2=0x7f818006eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.483+0000 7f8187694640 1 --2- 172.21.15.44:0/3041978707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818015b200 0x7f818006eb50 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f8178009d90 tx=0x7f8178004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:58.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.483+0000 7f8187694640 1 -- 172.21.15.44:0/3041978707 shutdown_connections 2023-11-04T01:41:58.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.483+0000 7f8187694640 1 --2- 172.21.15.44:0/3041978707 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f816406ae70 0x7f816406d330 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.483+0000 7f8187694640 1 --2- 172.21.15.44:0/3041978707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818015b200 0x7f818006eb50 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.483+0000 7f8187694640 1 --2- 172.21.15.44:0/3041978707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81800cd7f0 0x7f81800c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.483+0000 7f8187694640 1 --2- 172.21.15.44:0/3041978707 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81800afda0 0x7f81801468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.483+0000 7f8187694640 1 -- 172.21.15.44:0/3041978707 >> 172.21.15.44:0/3041978707 conn(0x7f81800d0c30 msgr2=0x7f81800b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:58.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.483+0000 7f8187694640 1 -- 172.21.15.44:0/3041978707 shutdown_connections 2023-11-04T01:41:58.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.483+0000 7f8187694640 1 -- 172.21.15.44:0/3041978707 wait complete. 2023-11-04T01:41:58.496 INFO:tasks.ceph.mds.c:Sent signal 9 2023-11-04T01:41:58.496 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:41:58.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:58.497 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 down 2023-11-04T01:41:58.528 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:41:58.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.678+0000 7f73e0333640 1 Processor -- start 2023-11-04T01:41:58.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.678+0000 7f73e0333640 1 -- start start 2023-11-04T01:41:58.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73e0333640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f73d815d100 0x7f73d80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73e0333640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d80b32b0 con 0x7f73d815d4e0 2023-11-04T01:41:58.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73e0333640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d80cee10 con 0x7f73d80d1be0 2023-11-04T01:41:58.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73e0333640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d80b2980 con 0x7f73d815d100 2023-11-04T01:41:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd8ce640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f73d815d4e0 0x7f73d80d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46702/0 (socket says 172.21.15.44:46702) 2023-11-04T01:41:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd8ce640 1 -- 172.21.15.44:0/3771641521 learned_addr learned my addr 172.21.15.44:0/3771641521 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:41:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73de0cf640 1 --2- 172.21.15.44:0/3771641521 >> v2:172.21.15.204:3300/0 conn(0x7f73d815d100 0x7f73d80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd0cd640 1 -- 172.21.15.44:0/3771641521 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186499878 0 0) 0x7f73d80b32b0 con 0x7f73d815d4e0 2023-11-04T01:41:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd0cd640 1 -- 172.21.15.44:0/3771641521 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73c4003520 con 0x7f73d815d4e0 2023-11-04T01:41:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd0cd640 1 -- 172.21.15.44:0/3771641521 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1294842413 0 0) 0x7f73c4003520 con 0x7f73d815d4e0 2023-11-04T01:41:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd0cd640 1 -- 172.21.15.44:0/3771641521 >> v2:172.21.15.204:3300/0 conn(0x7f73d815d100 msgr2=0x7f73d80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd0cd640 1 --2- 172.21.15.44:0/3771641521 >> v2:172.21.15.204:3300/0 conn(0x7f73d815d100 0x7f73d80ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd0cd640 1 -- 172.21.15.44:0/3771641521 >> v1:172.21.15.204:6789/0 conn(0x7f73d80d1be0 legacy=0x7f73d80b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd0cd640 1 -- 172.21.15.44:0/3771641521 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d80b2c60 con 0x7f73d815d4e0 2023-11-04T01:41:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd0cd640 1 -- 172.21.15.44:0/3771641521 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f73c8001670 con 0x7f73d815d4e0 2023-11-04T01:41:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd0cd640 1 -- 172.21.15.44:0/3771641521 >> v1:172.21.15.44:6789/0 conn(0x7f73d815d4e0 legacy=0x7f73d80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd0cd640 1 --2- 172.21.15.44:0/3771641521 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73c4003970 0x7f73c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd0cd640 1 --2- 172.21.15.44:0/3771641521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73c40047c0 0x7f73c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd0cd640 1 --2- 172.21.15.44:0/3771641521 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73c4005180 0x7f73c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd0cd640 1 -- 172.21.15.44:0/3771641521 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80b2980 con 0x7f73c40047c0 2023-11-04T01:41:58.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd0cd640 1 -- 172.21.15.44:0/3771641521 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c400c020 con 0x7f73c4003970 2023-11-04T01:41:58.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd0cd640 1 -- 172.21.15.44:0/3771641521 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c400c1e0 con 0x7f73c4005180 2023-11-04T01:41:58.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.679+0000 7f73dd8ce640 1 --2- 172.21.15.44:0/3771641521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73c40047c0 0x7f73c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.680+0000 7f73de0cf640 1 --2- 172.21.15.44:0/3771641521 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73c4003970 0x7f73c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.680+0000 7f73de8d0640 1 --2- 172.21.15.44:0/3771641521 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73c4005180 0x7f73c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.680+0000 7f73dd8ce640 1 -- 172.21.15.44:0/3771641521 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73c4005180 msgr2=0x7f73c400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:58.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.680+0000 7f73dd8ce640 1 --2- 172.21.15.44:0/3771641521 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73c4005180 0x7f73c400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.680+0000 7f73dd8ce640 1 -- 172.21.15.44:0/3771641521 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73c4003970 msgr2=0x7f73c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:58.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.680+0000 7f73dd8ce640 1 --2- 172.21.15.44:0/3771641521 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73c4003970 0x7f73c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.680+0000 7f73dd8ce640 1 -- 172.21.15.44:0/3771641521 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c4003520 con 0x7f73c40047c0 2023-11-04T01:41:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.680+0000 7f73de8d0640 1 -- 172.21.15.44:0/3771641521 reap_dead start 2023-11-04T01:41:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.681+0000 7f73dd8ce640 1 --2- 172.21.15.44:0/3771641521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73c40047c0 0x7f73c4004c40 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f73c800c210 tx=0x7f73c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287a5302cbd6f30a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.681+0000 7f73dd0cd640 1 -- 172.21.15.44:0/3771641521 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8005ad0 con 0x7f73c40047c0 2023-11-04T01:41:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.681+0000 7f73dd0cd640 1 -- 172.21.15.44:0/3771641521 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c8005c30 con 0x7f73c40047c0 2023-11-04T01:41:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.681+0000 7f73dd0cd640 1 -- 172.21.15.44:0/3771641521 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c802cad0 con 0x7f73c40047c0 2023-11-04T01:41:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.681+0000 7f73e0333640 1 -- 172.21.15.44:0/3771641521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73c40047c0 msgr2=0x7f73c4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.681+0000 7f73e0333640 1 --2- 172.21.15.44:0/3771641521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73c40047c0 0x7f73c4004c40 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f73c800c210 tx=0x7f73c40057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.681+0000 7f73e0333640 1 -- 172.21.15.44:0/3771641521 shutdown_connections 2023-11-04T01:41:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.681+0000 7f73e0333640 1 --2- 172.21.15.44:0/3771641521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73c40047c0 0x7f73c4004c40 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.681+0000 7f73e0333640 1 -- 172.21.15.44:0/3771641521 >> 172.21.15.44:0/3771641521 conn(0x7f73d80d2ef0 msgr2=0x7f73d80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.681+0000 7f73e0333640 1 -- 172.21.15.44:0/3771641521 shutdown_connections 2023-11-04T01:41:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.681+0000 7f73e0333640 1 -- 172.21.15.44:0/3771641521 wait complete. 2023-11-04T01:41:58.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.683+0000 7f73e0333640 1 Processor -- start 2023-11-04T01:41:58.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.683+0000 7f73e0333640 1 -- start start 2023-11-04T01:41:58.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.683+0000 7f73e0333640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73c40047c0 0x7f73d80b8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.683+0000 7f73e0333640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73d815aae0 0x7f73d80cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.683+0000 7f73e0333640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73d80cc1c0 0x7f73d806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.683+0000 7f73e0333640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80ccf80 con 0x7f73d80cc1c0 2023-11-04T01:41:58.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.683+0000 7f73e0333640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80b8940 con 0x7f73d815aae0 2023-11-04T01:41:58.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.683+0000 7f73e0333640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80cb120 con 0x7f73c40047c0 2023-11-04T01:41:58.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.683+0000 7f73de8d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73d80cc1c0 0x7f73d806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.683+0000 7f73de8d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73d80cc1c0 0x7f73d806a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55234/0 (socket says 172.21.15.44:55234) 2023-11-04T01:41:58.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.683+0000 7f73de8d0640 1 -- 172.21.15.44:0/3413822609 learned_addr learned my addr 172.21.15.44:0/3413822609 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:58.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.684+0000 7f73dd8ce640 1 --2- 172.21.15.44:0/3413822609 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73d815aae0 0x7f73d80cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.684+0000 7f73de0cf640 1 --2- 172.21.15.44:0/3413822609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73c40047c0 0x7f73d80b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.684+0000 7f73de8d0640 1 -- 172.21.15.44:0/3413822609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73c40047c0 msgr2=0x7f73d80b8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.684+0000 7f73de8d0640 1 --2- 172.21.15.44:0/3413822609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73c40047c0 0x7f73d80b8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.684+0000 7f73de8d0640 1 -- 172.21.15.44:0/3413822609 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73d815aae0 msgr2=0x7f73d80cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.684+0000 7f73de8d0640 1 --2- 172.21.15.44:0/3413822609 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73d815aae0 0x7f73d80cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.684+0000 7f73de8d0640 1 -- 172.21.15.44:0/3413822609 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d80b8660 con 0x7f73d80cc1c0 2023-11-04T01:41:58.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.684+0000 7f73de0cf640 1 --2- 172.21.15.44:0/3413822609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73c40047c0 0x7f73d80b8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:58.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.684+0000 7f73de8d0640 1 --2- 172.21.15.44:0/3413822609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73d80cc1c0 0x7f73d806a8d0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f73d808c710 tx=0x7f73d000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:58.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.684+0000 7f73ceffd640 1 -- 172.21.15.44:0/3413822609 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d000eed0 con 0x7f73d80cc1c0 2023-11-04T01:41:58.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.684+0000 7f73ceffd640 1 -- 172.21.15.44:0/3413822609 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d0003970 con 0x7f73d80cc1c0 2023-11-04T01:41:58.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.684+0000 7f73ceffd640 1 -- 172.21.15.44:0/3413822609 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d0003d40 con 0x7f73d80cc1c0 2023-11-04T01:41:58.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.684+0000 7f73e0333640 1 -- 172.21.15.44:0/3413822609 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d80b6490 con 0x7f73d80cc1c0 2023-11-04T01:41:58.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.684+0000 7f73e0333640 1 -- 172.21.15.44:0/3413822609 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d80b6a50 con 0x7f73d80cc1c0 2023-11-04T01:41:58.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.685+0000 7f73e0333640 1 -- 172.21.15.44:0/3413822609 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d80cbf80 con 0x7f73d80cc1c0 2023-11-04T01:41:58.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.685+0000 7f73ceffd640 1 -- 172.21.15.44:0/3413822609 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73d00050d0 con 0x7f73d80cc1c0 2023-11-04T01:41:58.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.686+0000 7f73ceffd640 1 --2- 172.21.15.44:0/3413822609 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f73bc06ae70 0x7f73bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.686+0000 7f73ceffd640 1 -- 172.21.15.44:0/3413822609 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f73d0089810 con 0x7f73d80cc1c0 2023-11-04T01:41:58.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.686+0000 7f73de0cf640 1 --2- 172.21.15.44:0/3413822609 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f73bc06ae70 0x7f73bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.687+0000 7f73de0cf640 1 --2- 172.21.15.44:0/3413822609 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f73bc06ae70 0x7f73bc06d330 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009c30 tx=0x7f73d4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:58.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.690+0000 7f73ceffd640 1 -- 172.21.15.44:0/3413822609 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73d0054230 con 0x7f73d80cc1c0 2023-11-04T01:41:58.697 INFO:tasks.ceph.mds.c.smithi044.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:41:58.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.940+0000 7f73e0333640 1 -- 172.21.15.44:0/3413822609 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f73d80684b0 con 0x7f73d80cc1c0 2023-11-04T01:41:58.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.942+0000 7f73ceffd640 1 -- 172.21.15.44:0/3413822609 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 6347 v87) v1 ==== 97+0+0 (secure 0 0 0) 0x7f73d0057850 con 0x7f73d80cc1c0 2023-11-04T01:41:58.944 INFO:teuthology.orchestra.run.smithi044.stderr:failed mds gid 6347 2023-11-04T01:41:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.946+0000 7f73e0333640 1 -- 172.21.15.44:0/3413822609 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f73bc06ae70 msgr2=0x7f73bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.946+0000 7f73e0333640 1 --2- 172.21.15.44:0/3413822609 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f73bc06ae70 0x7f73bc06d330 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009c30 tx=0x7f73d4008040 comp rx=0 tx=0).stop 2023-11-04T01:41:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.946+0000 7f73e0333640 1 -- 172.21.15.44:0/3413822609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73d80cc1c0 msgr2=0x7f73d806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.946+0000 7f73e0333640 1 --2- 172.21.15.44:0/3413822609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73d80cc1c0 0x7f73d806a8d0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f73d808c710 tx=0x7f73d000eb90 comp rx=0 tx=0).stop 2023-11-04T01:41:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.946+0000 7f73e0333640 1 -- 172.21.15.44:0/3413822609 shutdown_connections 2023-11-04T01:41:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.946+0000 7f73e0333640 1 --2- 172.21.15.44:0/3413822609 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f73bc06ae70 0x7f73bc06d330 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.946+0000 7f73e0333640 1 --2- 172.21.15.44:0/3413822609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73d80cc1c0 0x7f73d806a8d0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.946+0000 7f73e0333640 1 --2- 172.21.15.44:0/3413822609 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73d815aae0 0x7f73d80cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.946+0000 7f73e0333640 1 --2- 172.21.15.44:0/3413822609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73c40047c0 0x7f73d80b8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.946+0000 7f73e0333640 1 -- 172.21.15.44:0/3413822609 >> 172.21.15.44:0/3413822609 conn(0x7f73d80d2ef0 msgr2=0x7f73d815f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:58.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.946+0000 7f73e0333640 1 -- 172.21.15.44:0/3413822609 shutdown_connections 2023-11-04T01:41:58.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:58.946+0000 7f73e0333640 1 -- 172.21.15.44:0/3413822609 wait complete. 2023-11-04T01:41:58.962 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:41:58.962 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:41:58.962 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:41:58.962 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:58.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:58.962 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi204 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-11-04T01:41:58.963 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:41:58.963 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:41:58.965 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:41:58.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:59.047 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2023-11-04T01:41:59.063 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:59.066 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:59.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.070+0000 7fb4fb8a2640 1 Processor -- start 2023-11-04T01:41:59.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.070+0000 7fb4fb8a2640 1 -- start start 2023-11-04T01:41:59.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.071+0000 7fb4fb8a2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb4f40cb680 0x7fb4f40cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.071+0000 7fb4fb8a2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb4f41597a0 0x7fb4f4159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.071+0000 7fb4fb8a2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f415ea20 con 0x7fb4f415afb0 2023-11-04T01:41:59.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.071+0000 7fb4fb8a2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f415b520 con 0x7fb4f40cb680 2023-11-04T01:41:59.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.071+0000 7fb4fb8a2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f415dc60 con 0x7fb4f41597a0 2023-11-04T01:41:59.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.071+0000 7fb4f963e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb4f40cb680 0x7fb4f40cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.071+0000 7fb4f963e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb4f40cb680 0x7fb4f40cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55242/0 (socket says 172.21.15.44:55242) 2023-11-04T01:41:59.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.071+0000 7fb4f963e640 1 -- 172.21.15.44:0/128618346 learned_addr learned my addr 172.21.15.44:0/128618346 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:59.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.071+0000 7fb4f9e3f640 1 --2- 172.21.15.44:0/128618346 >> v2:172.21.15.204:3300/0 conn(0x7fb4f41597a0 0x7fb4f4159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.071+0000 7fb4f963e640 1 -- 172.21.15.44:0/128618346 >> v2:172.21.15.204:3300/0 conn(0x7fb4f41597a0 msgr2=0x7fb4f4159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:59.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.071+0000 7fb4f963e640 1 --2- 172.21.15.44:0/128618346 >> v2:172.21.15.204:3300/0 conn(0x7fb4f41597a0 0x7fb4f4159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.071+0000 7fb4f963e640 1 -- 172.21.15.44:0/128618346 >> v1:172.21.15.44:6789/0 conn(0x7fb4f415afb0 legacy=0x7fb4f40cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.071+0000 7fb4f963e640 1 -- 172.21.15.44:0/128618346 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f415df40 con 0x7fb4f40cb680 2023-11-04T01:41:59.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.072+0000 7fb4f963e640 1 --2- 172.21.15.44:0/128618346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f40cb680 0x7fb4f40cf470 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fb4f406bf20 tx=0x7fb4f002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bfade62b67492b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:59.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.072+0000 7fb4ebfff640 1 -- 172.21.15.44:0/128618346 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f002ee90 con 0x7fb4f40cb680 2023-11-04T01:41:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.072+0000 7fb4ebfff640 1 -- 172.21.15.44:0/128618346 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f0036440 con 0x7fb4f40cb680 2023-11-04T01:41:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.072+0000 7fb4ebfff640 1 -- 172.21.15.44:0/128618346 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00367d0 con 0x7fb4f40cb680 2023-11-04T01:41:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.073+0000 7fb4fb8a2640 1 -- 172.21.15.44:0/128618346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f40cb680 msgr2=0x7fb4f40cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.073+0000 7fb4fb8a2640 1 --2- 172.21.15.44:0/128618346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f40cb680 0x7fb4f40cf470 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fb4f406bf20 tx=0x7fb4f002e0e0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.073+0000 7fb4fb8a2640 1 -- 172.21.15.44:0/128618346 shutdown_connections 2023-11-04T01:41:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.073+0000 7fb4fb8a2640 1 --2- 172.21.15.44:0/128618346 >> v2:172.21.15.204:3300/0 conn(0x7fb4f41597a0 0x7fb4f4159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.073+0000 7fb4fb8a2640 1 --2- 172.21.15.44:0/128618346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f40cb680 0x7fb4f40cf470 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.073+0000 7fb4fb8a2640 1 -- 172.21.15.44:0/128618346 >> 172.21.15.44:0/128618346 conn(0x7fb4f40b1640 msgr2=0x7fb4f40b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.073+0000 7fb4fb8a2640 1 -- 172.21.15.44:0/128618346 shutdown_connections 2023-11-04T01:41:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.073+0000 7fb4fb8a2640 1 -- 172.21.15.44:0/128618346 wait complete. 2023-11-04T01:41:59.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.074+0000 7fb4fb8a2640 1 Processor -- start 2023-11-04T01:41:59.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.074+0000 7fb4fb8a2640 1 -- start start 2023-11-04T01:41:59.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4fb8a2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb4f40cb680 0x7fb4f40b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4fb8a2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb4f41597a0 0x7fb4f40af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4fb8a2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f415afb0 0x7fb4f41545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4fb8a2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40b2740 con 0x7fb4f415afb0 2023-11-04T01:41:59.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4fb8a2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40af670 con 0x7fb4f41597a0 2023-11-04T01:41:59.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4fb8a2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40b01d0 con 0x7fb4f40cb680 2023-11-04T01:41:59.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4f9e3f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f415afb0 0x7fb4f41545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4f9e3f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f415afb0 0x7fb4f41545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55258/0 (socket says 172.21.15.44:55258) 2023-11-04T01:41:59.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4f9e3f640 1 -- 172.21.15.44:0/554719979 learned_addr learned my addr 172.21.15.44:0/554719979 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:41:59.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4f8e3d640 1 --2- 172.21.15.44:0/554719979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb4f41597a0 0x7fb4f40af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4f963e640 1 --2- 172.21.15.44:0/554719979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb4f40cb680 0x7fb4f40b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4f9e3f640 1 -- 172.21.15.44:0/554719979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb4f40cb680 msgr2=0x7fb4f40b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4f9e3f640 1 --2- 172.21.15.44:0/554719979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb4f40cb680 0x7fb4f40b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4f9e3f640 1 -- 172.21.15.44:0/554719979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb4f41597a0 msgr2=0x7fb4f40af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4f9e3f640 1 --2- 172.21.15.44:0/554719979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb4f41597a0 0x7fb4f40af130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.075+0000 7fb4f9e3f640 1 -- 172.21.15.44:0/554719979 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f000b770 con 0x7fb4f415afb0 2023-11-04T01:41:59.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.076+0000 7fb4f9e3f640 1 --2- 172.21.15.44:0/554719979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f415afb0 0x7fb4f41545a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00efc0 tx=0x7fb4ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:59.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.076+0000 7fb4e9ffb640 1 -- 172.21.15.44:0/554719979 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec009ba0 con 0x7fb4f415afb0 2023-11-04T01:41:59.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.076+0000 7fb4e9ffb640 1 -- 172.21.15.44:0/554719979 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ec00f040 con 0x7fb4f415afb0 2023-11-04T01:41:59.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.076+0000 7fb4fb8a2640 1 -- 172.21.15.44:0/554719979 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f40af8a0 con 0x7fb4f415afb0 2023-11-04T01:41:59.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.076+0000 7fb4e9ffb640 1 -- 172.21.15.44:0/554719979 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0146c0 con 0x7fb4f415afb0 2023-11-04T01:41:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.076+0000 7fb4fb8a2640 1 -- 172.21.15.44:0/554719979 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f40afe60 con 0x7fb4f415afb0 2023-11-04T01:41:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.077+0000 7fb4fb8a2640 1 -- 172.21.15.44:0/554719979 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f40c5080 con 0x7fb4f415afb0 2023-11-04T01:41:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.077+0000 7fb4e9ffb640 1 -- 172.21.15.44:0/554719979 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4ec014820 con 0x7fb4f415afb0 2023-11-04T01:41:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.078+0000 7fb4e9ffb640 1 --2- 172.21.15.44:0/554719979 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb4d806aea0 0x7fb4d806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.078+0000 7fb4e9ffb640 1 -- 172.21.15.44:0/554719979 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7580+0+0 (secure 0 0 0) 0x7fb4ec08aa00 con 0x7fb4f415afb0 2023-11-04T01:41:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.078+0000 7fb4f963e640 1 --2- 172.21.15.44:0/554719979 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb4d806aea0 0x7fb4d806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.079+0000 7fb4f963e640 1 --2- 172.21.15.44:0/554719979 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb4d806aea0 0x7fb4d806d360 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0038000 tx=0x7fb4f0032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:59.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.082+0000 7fb4e9ffb640 1 -- 172.21.15.44:0/554719979 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4ec055410 con 0x7fb4f415afb0 2023-11-04T01:41:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.295+0000 7fb4fb8a2640 1 -- 172.21.15.44:0/554719979 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4f40684b0 con 0x7fb4f415afb0 2023-11-04T01:41:59.298 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.296+0000 7fb4e9ffb640 1 -- 172.21.15.44:0/554719979 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4140 (secure 0 0 0) 0x7fb4ec058a30 con 0x7fb4f415afb0 2023-11-04T01:41:59.298 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:41:59.298 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":88,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:58.947065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:replay","state_seq":1,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 88 2023-11-04T01:41:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.298+0000 7fb4fb8a2640 1 -- 172.21.15.44:0/554719979 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb4d806aea0 msgr2=0x7fb4d806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.298+0000 7fb4fb8a2640 1 --2- 172.21.15.44:0/554719979 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb4d806aea0 0x7fb4d806d360 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0038000 tx=0x7fb4f0032000 comp rx=0 tx=0).stop 2023-11-04T01:41:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.298+0000 7fb4fb8a2640 1 -- 172.21.15.44:0/554719979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f415afb0 msgr2=0x7fb4f41545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.298+0000 7fb4fb8a2640 1 --2- 172.21.15.44:0/554719979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f415afb0 0x7fb4f41545a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00efc0 tx=0x7fb4ec00c490 comp rx=0 tx=0).stop 2023-11-04T01:41:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.298+0000 7fb4fb8a2640 1 -- 172.21.15.44:0/554719979 shutdown_connections 2023-11-04T01:41:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.298+0000 7fb4fb8a2640 1 --2- 172.21.15.44:0/554719979 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb4d806aea0 0x7fb4d806d360 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.298+0000 7fb4fb8a2640 1 --2- 172.21.15.44:0/554719979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f415afb0 0x7fb4f41545a0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.298+0000 7fb4fb8a2640 1 --2- 172.21.15.44:0/554719979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb4f41597a0 0x7fb4f40af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.298+0000 7fb4fb8a2640 1 --2- 172.21.15.44:0/554719979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb4f40cb680 0x7fb4f40b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.298+0000 7fb4fb8a2640 1 -- 172.21.15.44:0/554719979 >> 172.21.15.44:0/554719979 conn(0x7fb4f40b1640 msgr2=0x7fb4f406db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:59.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.298+0000 7fb4fb8a2640 1 -- 172.21.15.44:0/554719979 shutdown_connections 2023-11-04T01:41:59.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:41:59.298+0000 7fb4fb8a2640 1 -- 172.21.15.44:0/554719979 wait complete. 2023-11-04T01:41:59.311 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:42:00.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:42:00.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-04T01:42:04.312 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:04.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.429+0000 7f4e4f5ee640 1 Processor -- start 2023-11-04T01:42:04.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.430+0000 7f4e4f5ee640 1 -- start start 2023-11-04T01:42:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.430+0000 7f4e4f5ee640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4e4815d1b0 0x7f4e480b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.430+0000 7f4e4f5ee640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e480b1440 0x7f4e4806a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.430+0000 7f4e4f5ee640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e480b2310 con 0x7f4e4806c240 2023-11-04T01:42:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.430+0000 7f4e4f5ee640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4806cbe0 con 0x7f4e4815d1b0 2023-11-04T01:42:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.430+0000 7f4e4f5ee640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480b2100 con 0x7f4e480b1440 2023-11-04T01:42:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.431+0000 7f4e4cb89640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4e4806c240 0x7f4e480b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55222/0 (socket says 172.21.15.44:55222) 2023-11-04T01:42:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.431+0000 7f4e4cb89640 1 -- 172.21.15.44:0/4058287512 learned_addr learned my addr 172.21.15.44:0/4058287512 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.431+0000 7f4e4db8b640 1 --2- 172.21.15.44:0/4058287512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e480b1440 0x7f4e4806a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.431+0000 7f4e4d38a640 1 --2- 172.21.15.44:0/4058287512 >> v2:172.21.15.204:3300/0 conn(0x7f4e4815d1b0 0x7f4e480b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.431+0000 7f4e3ffff640 1 -- 172.21.15.44:0/4058287512 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729799660 0 0) 0x7f4e480b2310 con 0x7f4e4806c240 2023-11-04T01:42:04.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.431+0000 7f4e3ffff640 1 -- 172.21.15.44:0/4058287512 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e34003520 con 0x7f4e4806c240 2023-11-04T01:42:04.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.431+0000 7f4e4db8b640 1 -- 172.21.15.44:0/4058287512 >> v2:172.21.15.204:3300/0 conn(0x7f4e4815d1b0 msgr2=0x7f4e480b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:04.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.431+0000 7f4e4db8b640 1 --2- 172.21.15.44:0/4058287512 >> v2:172.21.15.204:3300/0 conn(0x7f4e4815d1b0 0x7f4e480b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.431+0000 7f4e4db8b640 1 -- 172.21.15.44:0/4058287512 >> v1:172.21.15.44:6789/0 conn(0x7f4e4806c240 legacy=0x7f4e480b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.431+0000 7f4e4db8b640 1 -- 172.21.15.44:0/4058287512 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e480b25f0 con 0x7f4e480b1440 2023-11-04T01:42:04.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.432+0000 7f4e4db8b640 1 --2- 172.21.15.44:0/4058287512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e480b1440 0x7f4e4806a0d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009d90 tx=0x7f4e4002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d92f1655e02707b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:04.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.432+0000 7f4e3ffff640 1 -- 172.21.15.44:0/4058287512 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4002cce0 con 0x7f4e480b1440 2023-11-04T01:42:04.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.432+0000 7f4e3ffff640 1 -- 172.21.15.44:0/4058287512 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4002ce40 con 0x7f4e480b1440 2023-11-04T01:42:04.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.432+0000 7f4e3ffff640 1 -- 172.21.15.44:0/4058287512 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40034660 con 0x7f4e480b1440 2023-11-04T01:42:04.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.433+0000 7f4e4f5ee640 1 -- 172.21.15.44:0/4058287512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e480b1440 msgr2=0x7f4e4806a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.433+0000 7f4e4f5ee640 1 --2- 172.21.15.44:0/4058287512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e480b1440 0x7f4e4806a0d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009d90 tx=0x7f4e4002bf30 comp rx=0 tx=0).stop 2023-11-04T01:42:04.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.433+0000 7f4e4f5ee640 1 -- 172.21.15.44:0/4058287512 shutdown_connections 2023-11-04T01:42:04.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.433+0000 7f4e4f5ee640 1 --2- 172.21.15.44:0/4058287512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e480b1440 0x7f4e4806a0d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.433+0000 7f4e4f5ee640 1 --2- 172.21.15.44:0/4058287512 >> v2:172.21.15.204:3300/0 conn(0x7f4e4815d1b0 0x7f4e480b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.433+0000 7f4e4f5ee640 1 -- 172.21.15.44:0/4058287512 >> 172.21.15.44:0/4058287512 conn(0x7f4e480cbd30 msgr2=0x7f4e480cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:04.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.433+0000 7f4e4f5ee640 1 -- 172.21.15.44:0/4058287512 shutdown_connections 2023-11-04T01:42:04.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.433+0000 7f4e4f5ee640 1 -- 172.21.15.44:0/4058287512 wait complete. 2023-11-04T01:42:04.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.434+0000 7f4e4f5ee640 1 Processor -- start 2023-11-04T01:42:04.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.434+0000 7f4e4f5ee640 1 -- start start 2023-11-04T01:42:04.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.435+0000 7f4e4f5ee640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4806c240 0x7f4e48159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.435+0000 7f4e4f5ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e480b1440 0x7f4e480c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.435+0000 7f4e4f5ee640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4815d1b0 0x7f4e480c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.435+0000 7f4e4f5ee640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480c9250 con 0x7f4e480b1440 2023-11-04T01:42:04.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.435+0000 7f4e4f5ee640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480cdd70 con 0x7f4e4815d1b0 2023-11-04T01:42:04.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.435+0000 7f4e4f5ee640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480c72d0 con 0x7f4e4806c240 2023-11-04T01:42:04.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.435+0000 7f4e4cb89640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e480b1440 0x7f4e480c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.435+0000 7f4e4cb89640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e480b1440 0x7f4e480c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49280/0 (socket says 172.21.15.44:49280) 2023-11-04T01:42:04.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.435+0000 7f4e4cb89640 1 -- 172.21.15.44:0/3571640879 learned_addr learned my addr 172.21.15.44:0/3571640879 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:04.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.435+0000 7f4e4d38a640 1 --2- 172.21.15.44:0/3571640879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4806c240 0x7f4e48159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.435+0000 7f4e4db8b640 1 --2- 172.21.15.44:0/3571640879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4815d1b0 0x7f4e480c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.436+0000 7f4e4cb89640 1 -- 172.21.15.44:0/3571640879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4806c240 msgr2=0x7f4e48159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.436+0000 7f4e4cb89640 1 --2- 172.21.15.44:0/3571640879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4806c240 0x7f4e48159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.436+0000 7f4e4cb89640 1 -- 172.21.15.44:0/3571640879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4815d1b0 msgr2=0x7f4e480c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.436+0000 7f4e4cb89640 1 --2- 172.21.15.44:0/3571640879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4815d1b0 0x7f4e480c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.436+0000 7f4e4cb89640 1 -- 172.21.15.44:0/3571640879 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e40009a70 con 0x7f4e480b1440 2023-11-04T01:42:04.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.436+0000 7f4e4db8b640 1 --2- 172.21.15.44:0/3571640879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4815d1b0 0x7f4e480c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:04.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.436+0000 7f4e4cb89640 1 --2- 172.21.15.44:0/3571640879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e480b1440 0x7f4e480c8d10 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800c410 tx=0x7f4e3800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:04.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.436+0000 7f4e3dffb640 1 -- 172.21.15.44:0/3571640879 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e38005ce0 con 0x7f4e480b1440 2023-11-04T01:42:04.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.436+0000 7f4e3dffb640 1 -- 172.21.15.44:0/3571640879 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e38005e40 con 0x7f4e480b1440 2023-11-04T01:42:04.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.436+0000 7f4e4f5ee640 1 -- 172.21.15.44:0/3571640879 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e480c8080 con 0x7f4e480b1440 2023-11-04T01:42:04.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.436+0000 7f4e3dffb640 1 -- 172.21.15.44:0/3571640879 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e380072f0 con 0x7f4e480b1440 2023-11-04T01:42:04.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.436+0000 7f4e4f5ee640 1 -- 172.21.15.44:0/3571640879 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e480c77e0 con 0x7f4e480b1440 2023-11-04T01:42:04.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.437+0000 7f4e4f5ee640 1 -- 172.21.15.44:0/3571640879 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e48066600 con 0x7f4e480b1440 2023-11-04T01:42:04.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.438+0000 7f4e3dffb640 1 -- 172.21.15.44:0/3571640879 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e38007450 con 0x7f4e480b1440 2023-11-04T01:42:04.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.438+0000 7f4e3dffb640 1 --2- 172.21.15.44:0/3571640879 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e2c06ae70 0x7f4e2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.438+0000 7f4e3dffb640 1 -- 172.21.15.44:0/3571640879 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7580+0+0 (secure 0 0 0) 0x7f4e380893a0 con 0x7f4e480b1440 2023-11-04T01:42:04.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.438+0000 7f4e4d38a640 1 --2- 172.21.15.44:0/3571640879 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e2c06ae70 0x7f4e2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.439+0000 7f4e4d38a640 1 --2- 172.21.15.44:0/3571640879 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e2c06ae70 0x7f4e2c06d330 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009ac0 tx=0x7f4e44008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:04.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.442+0000 7f4e3dffb640 1 -- 172.21.15.44:0/3571640879 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e38057850 con 0x7f4e480b1440 2023-11-04T01:42:04.655 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.653+0000 7f4e4f5ee640 1 -- 172.21.15.44:0/3571640879 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e480684b0 con 0x7f4e480b1440 2023-11-04T01:42:04.656 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.654+0000 7f4e3dffb640 1 -- 172.21.15.44:0/3571640879 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f4e380573e0 con 0x7f4e480b1440 2023-11-04T01:42:04.656 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:04.656 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":89,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7156,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:58.962227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:resolve","state_seq":8,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:04.656 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 89 2023-11-04T01:42:04.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.656+0000 7f4e4f5ee640 1 -- 172.21.15.44:0/3571640879 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e2c06ae70 msgr2=0x7f4e2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.656+0000 7f4e4f5ee640 1 --2- 172.21.15.44:0/3571640879 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e2c06ae70 0x7f4e2c06d330 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009ac0 tx=0x7f4e44008040 comp rx=0 tx=0).stop 2023-11-04T01:42:04.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.656+0000 7f4e4f5ee640 1 -- 172.21.15.44:0/3571640879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e480b1440 msgr2=0x7f4e480c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.656+0000 7f4e4f5ee640 1 --2- 172.21.15.44:0/3571640879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e480b1440 0x7f4e480c8d10 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800c410 tx=0x7f4e3800c8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.656+0000 7f4e4f5ee640 1 -- 172.21.15.44:0/3571640879 shutdown_connections 2023-11-04T01:42:04.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.656+0000 7f4e4f5ee640 1 --2- 172.21.15.44:0/3571640879 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e2c06ae70 0x7f4e2c06d330 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.658 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.656+0000 7f4e4f5ee640 1 --2- 172.21.15.44:0/3571640879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e4815d1b0 0x7f4e480c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.656+0000 7f4e4f5ee640 1 --2- 172.21.15.44:0/3571640879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e480b1440 0x7f4e480c8d10 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.656+0000 7f4e4f5ee640 1 --2- 172.21.15.44:0/3571640879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e4806c240 0x7f4e48159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.656+0000 7f4e4f5ee640 1 -- 172.21.15.44:0/3571640879 >> 172.21.15.44:0/3571640879 conn(0x7f4e480cbd30 msgr2=0x7f4e480cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:04.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.656+0000 7f4e4f5ee640 1 -- 172.21.15.44:0/3571640879 shutdown_connections 2023-11-04T01:42:04.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.656+0000 7f4e4f5ee640 1 -- 172.21.15.44:0/3571640879 wait complete. 2023-11-04T01:42:04.668 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:42:04.669 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:04.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.773+0000 7f3f9f47c640 1 Processor -- start 2023-11-04T01:42:04.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.773+0000 7f3f9f47c640 1 -- start start 2023-11-04T01:42:04.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.774+0000 7f3f9f47c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f980ceda0 0x7f3f9815cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.774+0000 7f3f9f47c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f980b0150 con 0x7f3f980cf890 2023-11-04T01:42:04.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.774+0000 7f3f9f47c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f980b1170 con 0x7f3f980b2210 2023-11-04T01:42:04.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.774+0000 7f3f9f47c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980b1df0 con 0x7f3f980ceda0 2023-11-04T01:42:04.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.774+0000 7f3f9da19640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3f980cf890 0x7f3f9806b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55224/0 (socket says 172.21.15.44:55224) 2023-11-04T01:42:04.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.774+0000 7f3f9da19640 1 -- 172.21.15.44:0/2311751371 learned_addr learned my addr 172.21.15.44:0/2311751371 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:04.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.774+0000 7f3f9d218640 1 --2- 172.21.15.44:0/2311751371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f980ceda0 0x7f3f9815cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296518282 0 0) 0x7f3f980b0150 con 0x7f3f980cf890 2023-11-04T01:42:04.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f80003520 con 0x7f3f980cf890 2023-11-04T01:42:04.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499573546 0 0) 0x7f3f980b1170 con 0x7f3f980b2210 2023-11-04T01:42:04.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f980b0150 con 0x7f3f980b2210 2023-11-04T01:42:04.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2342450176 0 0) 0x7f3f80003520 con 0x7f3f980cf890 2023-11-04T01:42:04.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f980ceda0 msgr2=0x7f3f9815cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:04.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 --2- 172.21.15.44:0/2311751371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f980ceda0 0x7f3f9815cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 >> v1:172.21.15.204:6789/0 conn(0x7f3f980b2210 legacy=0x7f3f980cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980b1450 con 0x7f3f980cf890 2023-11-04T01:42:04.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f3f880019f0 con 0x7f3f980cf890 2023-11-04T01:42:04.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 >> v1:172.21.15.44:6789/0 conn(0x7f3f980cf890 legacy=0x7f3f9806b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 --2- 172.21.15.44:0/2311751371 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f80003b30 0x7f3f80003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 --2- 172.21.15.44:0/2311751371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f980ceda0 0x7f3f800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 --2- 172.21.15.44:0/2311751371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f80004d00 0x7f3f80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980b1df0 con 0x7f3f80004d00 2023-11-04T01:42:04.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8000bb10 con 0x7f3f80003b30 2023-11-04T01:42:04.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8000bca0 con 0x7f3f980ceda0 2023-11-04T01:42:04.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f9da19640 1 --2- 172.21.15.44:0/2311751371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f80004d00 0x7f3f80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f9d218640 1 --2- 172.21.15.44:0/2311751371 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f80003b30 0x7f3f80003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f9ca17640 1 --2- 172.21.15.44:0/2311751371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f980ceda0 0x7f3f800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f9da19640 1 -- 172.21.15.44:0/2311751371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f980ceda0 msgr2=0x7f3f800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:04.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f9da19640 1 --2- 172.21.15.44:0/2311751371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f980ceda0 0x7f3f800047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f9da19640 1 -- 172.21.15.44:0/2311751371 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f80003b30 msgr2=0x7f3f80003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:04.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f9da19640 1 --2- 172.21.15.44:0/2311751371 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f80003b30 0x7f3f80003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.775+0000 7f3f9da19640 1 -- 172.21.15.44:0/2311751371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f80003520 con 0x7f3f80004d00 2023-11-04T01:42:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.776+0000 7f3f9da19640 1 --2- 172.21.15.44:0/2311751371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f80004d00 0x7f3f80005180 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800a730 tx=0x7f3f800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c847e6d6b00efd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.776+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88034630 con 0x7f3f80004d00 2023-11-04T01:42:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.776+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8802f070 con 0x7f3f80004d00 2023-11-04T01:42:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.776+0000 7f3f97fff640 1 -- 172.21.15.44:0/2311751371 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f880349f0 con 0x7f3f80004d00 2023-11-04T01:42:04.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.777+0000 7f3f9f47c640 1 -- 172.21.15.44:0/2311751371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f80004d00 msgr2=0x7f3f80005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.777+0000 7f3f9f47c640 1 --2- 172.21.15.44:0/2311751371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f80004d00 0x7f3f80005180 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800a730 tx=0x7f3f800057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.777+0000 7f3f9da19640 1 -- 172.21.15.44:0/2311751371 reap_dead start 2023-11-04T01:42:04.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.777+0000 7f3f9f47c640 1 -- 172.21.15.44:0/2311751371 shutdown_connections 2023-11-04T01:42:04.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.777+0000 7f3f9f47c640 1 -- 172.21.15.44:0/2311751371 >> 172.21.15.44:0/2311751371 conn(0x7f3f980d0c30 msgr2=0x7f3f980d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:04.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.777+0000 7f3f9f47c640 1 -- 172.21.15.44:0/2311751371 shutdown_connections 2023-11-04T01:42:04.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.777+0000 7f3f9f47c640 1 -- 172.21.15.44:0/2311751371 wait complete. 2023-11-04T01:42:04.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.778+0000 7f3f9f47c640 1 Processor -- start 2023-11-04T01:42:04.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.778+0000 7f3f9f47c640 1 -- start start 2023-11-04T01:42:04.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9f47c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f80004d00 0x7f3f9814d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9f47c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f980c9780 0x7f3f980c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9f47c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f9815a160 0x7f3f9815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9f47c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980cfd20 con 0x7f3f980c9780 2023-11-04T01:42:04.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9f47c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980c8a20 con 0x7f3f80004d00 2023-11-04T01:42:04.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9f47c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9814d860 con 0x7f3f9815a160 2023-11-04T01:42:04.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9ca17640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f980c9780 0x7f3f980c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9ca17640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f980c9780 0x7f3f980c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49300/0 (socket says 172.21.15.44:49300) 2023-11-04T01:42:04.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9ca17640 1 -- 172.21.15.44:0/2164779812 learned_addr learned my addr 172.21.15.44:0/2164779812 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:04.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9d218640 1 --2- 172.21.15.44:0/2164779812 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f80004d00 0x7f3f9814d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9da19640 1 --2- 172.21.15.44:0/2164779812 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f9815a160 0x7f3f9815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9ca17640 1 -- 172.21.15.44:0/2164779812 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f9815a160 msgr2=0x7f3f9815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9ca17640 1 --2- 172.21.15.44:0/2164779812 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f9815a160 0x7f3f9815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9ca17640 1 -- 172.21.15.44:0/2164779812 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f80004d00 msgr2=0x7f3f9814d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9ca17640 1 --2- 172.21.15.44:0/2164779812 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f80004d00 0x7f3f9814d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9ca17640 1 -- 172.21.15.44:0/2164779812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980c7da0 con 0x7f3f980c9780 2023-11-04T01:42:04.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9d218640 1 --2- 172.21.15.44:0/2164779812 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f80004d00 0x7f3f9814d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:04.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.779+0000 7f3f9ca17640 1 --2- 172.21.15.44:0/2164779812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f980c9780 0x7f3f980c9c00 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00e7b0 tx=0x7f3f8c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:04.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.780+0000 7f3f95ffb640 1 -- 172.21.15.44:0/2164779812 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c017070 con 0x7f3f980c9780 2023-11-04T01:42:04.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.780+0000 7f3f95ffb640 1 -- 172.21.15.44:0/2164779812 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c0050d0 con 0x7f3f980c9780 2023-11-04T01:42:04.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.780+0000 7f3f9f47c640 1 -- 172.21.15.44:0/2164779812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f980c8080 con 0x7f3f980c9780 2023-11-04T01:42:04.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.780+0000 7f3f95ffb640 1 -- 172.21.15.44:0/2164779812 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c005260 con 0x7f3f980c9780 2023-11-04T01:42:04.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.780+0000 7f3f9f47c640 1 -- 172.21.15.44:0/2164779812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f980c8640 con 0x7f3f980c9780 2023-11-04T01:42:04.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.781+0000 7f3f9f47c640 1 -- 172.21.15.44:0/2164779812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f980c8800 con 0x7f3f980c9780 2023-11-04T01:42:04.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.781+0000 7f3f95ffb640 1 -- 172.21.15.44:0/2164779812 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3f8c00c6c0 con 0x7f3f980c9780 2023-11-04T01:42:04.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.781+0000 7f3f95ffb640 1 --2- 172.21.15.44:0/2164779812 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f8406ae70 0x7f3f8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.782+0000 7f3f95ffb640 1 -- 172.21.15.44:0/2164779812 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7580+0+0 (secure 0 0 0) 0x7f3f8c089420 con 0x7f3f980c9780 2023-11-04T01:42:04.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.782+0000 7f3f9d218640 1 --2- 172.21.15.44:0/2164779812 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f8406ae70 0x7f3f8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.782+0000 7f3f9d218640 1 --2- 172.21.15.44:0/2164779812 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f8406ae70 0x7f3f8406d330 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009ac0 tx=0x7f3f90008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:04.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:04.786+0000 7f3f95ffb640 1 -- 172.21.15.44:0/2164779812 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3f8c057810 con 0x7f3f980c9780 2023-11-04T01:42:05.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.000+0000 7f3f9f47c640 1 -- 172.21.15.44:0/2164779812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f980684b0 con 0x7f3f980c9780 2023-11-04T01:42:05.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.000+0000 7f3f95ffb640 1 -- 172.21.15.44:0/2164779812 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f3f8c0573a0 con 0x7f3f980c9780 2023-11-04T01:42:05.003 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:05.003 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":89,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7156,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:58.962227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:resolve","state_seq":8,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:05.003 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 89 2023-11-04T01:42:05.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.002+0000 7f3f9f47c640 1 -- 172.21.15.44:0/2164779812 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f8406ae70 msgr2=0x7f3f8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.002+0000 7f3f9f47c640 1 --2- 172.21.15.44:0/2164779812 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f8406ae70 0x7f3f8406d330 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009ac0 tx=0x7f3f90008040 comp rx=0 tx=0).stop 2023-11-04T01:42:05.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.002+0000 7f3f9f47c640 1 -- 172.21.15.44:0/2164779812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f980c9780 msgr2=0x7f3f980c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.002+0000 7f3f9f47c640 1 --2- 172.21.15.44:0/2164779812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f980c9780 0x7f3f980c9c00 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00e7b0 tx=0x7f3f8c00ec70 comp rx=0 tx=0).stop 2023-11-04T01:42:05.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.002+0000 7f3f9f47c640 1 -- 172.21.15.44:0/2164779812 shutdown_connections 2023-11-04T01:42:05.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.002+0000 7f3f9f47c640 1 --2- 172.21.15.44:0/2164779812 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3f8406ae70 0x7f3f8406d330 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.002+0000 7f3f9f47c640 1 --2- 172.21.15.44:0/2164779812 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f9815a160 0x7f3f9815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.002+0000 7f3f9f47c640 1 --2- 172.21.15.44:0/2164779812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f980c9780 0x7f3f980c9c00 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.002+0000 7f3f9f47c640 1 --2- 172.21.15.44:0/2164779812 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f80004d00 0x7f3f9814d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.002+0000 7f3f9f47c640 1 -- 172.21.15.44:0/2164779812 >> 172.21.15.44:0/2164779812 conn(0x7f3f980d0c30 msgr2=0x7f3f9815b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:05.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.002+0000 7f3f9f47c640 1 -- 172.21.15.44:0/2164779812 shutdown_connections 2023-11-04T01:42:05.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.002+0000 7f3f9f47c640 1 -- 172.21.15.44:0/2164779812 wait complete. 2023-11-04T01:42:05.015 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:42:05.015 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.346510648727417s 2023-11-04T01:42:05.015 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:05.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.120+0000 7f7b9ab0f640 1 Processor -- start 2023-11-04T01:42:05.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.120+0000 7f7b9ab0f640 1 -- start start 2023-11-04T01:42:05.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.121+0000 7f7b9ab0f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b940afda0 0x7f7b940cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.121+0000 7f7b9ab0f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7b940cd7f0 0x7f7b940ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.121+0000 7f7b9ab0f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b940cf240 con 0x7f7b9415b200 2023-11-04T01:42:05.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.121+0000 7f7b9ab0f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b940cdc40 con 0x7f7b940cd7f0 2023-11-04T01:42:05.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.121+0000 7f7b9ab0f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940cde80 con 0x7f7b940afda0 2023-11-04T01:42:05.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.121+0000 7f7b990ac640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7b940cd7f0 0x7f7b940ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.121+0000 7f7b990ac640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7b940cd7f0 0x7f7b940ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49310/0 (socket says 172.21.15.44:49310) 2023-11-04T01:42:05.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.121+0000 7f7b990ac640 1 -- 172.21.15.44:0/1240348671 learned_addr learned my addr 172.21.15.44:0/1240348671 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:05.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.121+0000 7f7b93fff640 1 --2- 172.21.15.44:0/1240348671 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b940afda0 0x7f7b940cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.121+0000 7f7b990ac640 1 -- 172.21.15.44:0/1240348671 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b940afda0 msgr2=0x7f7b940cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:05.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.121+0000 7f7b990ac640 1 --2- 172.21.15.44:0/1240348671 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b940afda0 0x7f7b940cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.121+0000 7f7b990ac640 1 -- 172.21.15.44:0/1240348671 >> v1:172.21.15.204:6789/0 conn(0x7f7b9415b200 legacy=0x7f7b940ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.121+0000 7f7b990ac640 1 -- 172.21.15.44:0/1240348671 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940cf670 con 0x7f7b940cd7f0 2023-11-04T01:42:05.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.122+0000 7f7b990ac640 1 --2- 172.21.15.44:0/1240348671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b940cd7f0 0x7f7b940ae2b0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c009e50 tx=0x7f7b8c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54a07344919c06b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.122+0000 7f7b937fe640 1 -- 172.21.15.44:0/1240348671 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c02ca70 con 0x7f7b940cd7f0 2023-11-04T01:42:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.122+0000 7f7b937fe640 1 -- 172.21.15.44:0/1240348671 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c02cbd0 con 0x7f7b940cd7f0 2023-11-04T01:42:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.122+0000 7f7b937fe640 1 -- 172.21.15.44:0/1240348671 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c0343f0 con 0x7f7b940cd7f0 2023-11-04T01:42:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.123+0000 7f7b9ab0f640 1 -- 172.21.15.44:0/1240348671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b940cd7f0 msgr2=0x7f7b940ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.123+0000 7f7b9ab0f640 1 --2- 172.21.15.44:0/1240348671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b940cd7f0 0x7f7b940ae2b0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c009e50 tx=0x7f7b8c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.123+0000 7f7b9ab0f640 1 -- 172.21.15.44:0/1240348671 shutdown_connections 2023-11-04T01:42:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.123+0000 7f7b9ab0f640 1 --2- 172.21.15.44:0/1240348671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b940cd7f0 0x7f7b940ae2b0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.123+0000 7f7b9ab0f640 1 --2- 172.21.15.44:0/1240348671 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b940afda0 0x7f7b940cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.123+0000 7f7b9ab0f640 1 -- 172.21.15.44:0/1240348671 >> 172.21.15.44:0/1240348671 conn(0x7f7b940d0c30 msgr2=0x7f7b940d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.123+0000 7f7b9ab0f640 1 -- 172.21.15.44:0/1240348671 shutdown_connections 2023-11-04T01:42:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.123+0000 7f7b9ab0f640 1 -- 172.21.15.44:0/1240348671 wait complete. 2023-11-04T01:42:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.124+0000 7f7b9ab0f640 1 Processor -- start 2023-11-04T01:42:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.124+0000 7f7b9ab0f640 1 -- start start 2023-11-04T01:42:05.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b9ab0f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b940afda0 0x7f7b941580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b9ab0f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b940cd7f0 0x7f7b940b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b9ab0f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b9415b200 0x7f7b940b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b9ab0f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940c7d00 con 0x7f7b940afda0 2023-11-04T01:42:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b9ab0f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b941585f0 con 0x7f7b9415b200 2023-11-04T01:42:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b9ab0f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b941f4c00 con 0x7f7b940cd7f0 2023-11-04T01:42:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b988ab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b940afda0 0x7f7b941580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b988ab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b940afda0 0x7f7b941580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49318/0 (socket says 172.21.15.44:49318) 2023-11-04T01:42:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b988ab640 1 -- 172.21.15.44:0/1827629784 learned_addr learned my addr 172.21.15.44:0/1827629784 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b93fff640 1 --2- 172.21.15.44:0/1827629784 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b940cd7f0 0x7f7b940b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b988ab640 1 -- 172.21.15.44:0/1827629784 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b940cd7f0 msgr2=0x7f7b940b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b990ac640 1 --2- 172.21.15.44:0/1827629784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b9415b200 0x7f7b940b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b988ab640 1 --2- 172.21.15.44:0/1827629784 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b940cd7f0 0x7f7b940b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b988ab640 1 -- 172.21.15.44:0/1827629784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b9415b200 msgr2=0x7f7b940b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b988ab640 1 --2- 172.21.15.44:0/1827629784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b9415b200 0x7f7b940b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b988ab640 1 -- 172.21.15.44:0/1827629784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c009b30 con 0x7f7b940afda0 2023-11-04T01:42:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.125+0000 7f7b988ab640 1 --2- 172.21.15.44:0/1827629784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b940afda0 0x7f7b941580b0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400c3a0 tx=0x7f7b8400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.126+0000 7f7b917fa640 1 -- 172.21.15.44:0/1827629784 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b840052d0 con 0x7f7b940afda0 2023-11-04T01:42:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.126+0000 7f7b917fa640 1 -- 172.21.15.44:0/1827629784 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b84005450 con 0x7f7b940afda0 2023-11-04T01:42:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.126+0000 7f7b9ab0f640 1 -- 172.21.15.44:0/1827629784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b940c7f10 con 0x7f7b940afda0 2023-11-04T01:42:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.126+0000 7f7b917fa640 1 -- 172.21.15.44:0/1827629784 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84003880 con 0x7f7b940afda0 2023-11-04T01:42:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.126+0000 7f7b9ab0f640 1 -- 172.21.15.44:0/1827629784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b940c84d0 con 0x7f7b940afda0 2023-11-04T01:42:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.127+0000 7f7b9ab0f640 1 -- 172.21.15.44:0/1827629784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b940684b0 con 0x7f7b940afda0 2023-11-04T01:42:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.127+0000 7f7b917fa640 1 -- 172.21.15.44:0/1827629784 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b840039e0 con 0x7f7b940afda0 2023-11-04T01:42:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.127+0000 7f7b917fa640 1 --2- 172.21.15.44:0/1827629784 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7b7406aea0 0x7f7b7406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.128+0000 7f7b917fa640 1 -- 172.21.15.44:0/1827629784 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7580+0+0 (secure 0 0 0) 0x7f7b84089160 con 0x7f7b940afda0 2023-11-04T01:42:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.128+0000 7f7b93fff640 1 --2- 172.21.15.44:0/1827629784 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7b7406aea0 0x7f7b7406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.128+0000 7f7b93fff640 1 --2- 172.21.15.44:0/1827629784 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7b7406aea0 0x7f7b7406d360 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7b940aee70 tx=0x7f7b7c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.132+0000 7f7b917fa640 1 -- 172.21.15.44:0/1827629784 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b84053ac0 con 0x7f7b940afda0 2023-11-04T01:42:05.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.346+0000 7f7b9ab0f640 1 -- 172.21.15.44:0/1827629784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b940cf240 con 0x7f7b940afda0 2023-11-04T01:42:05.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.346+0000 7f7b917fa640 1 -- 172.21.15.44:0/1827629784 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f7b940cf240 con 0x7f7b940afda0 2023-11-04T01:42:05.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:05.349 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":89,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7156,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:41:58.962227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6834/2069525699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2069525699},{"type":"v1","addr":"172.21.15.44:6834","nonce":2069525699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:resolve","state_seq":8,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:05.349 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 89 2023-11-04T01:42:05.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.348+0000 7f7b9ab0f640 1 -- 172.21.15.44:0/1827629784 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7b7406aea0 msgr2=0x7f7b7406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.348+0000 7f7b9ab0f640 1 --2- 172.21.15.44:0/1827629784 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7b7406aea0 0x7f7b7406d360 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7b940aee70 tx=0x7f7b7c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.348+0000 7f7b9ab0f640 1 -- 172.21.15.44:0/1827629784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b940afda0 msgr2=0x7f7b941580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.348+0000 7f7b9ab0f640 1 --2- 172.21.15.44:0/1827629784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b940afda0 0x7f7b941580b0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400c3a0 tx=0x7f7b8400c860 comp rx=0 tx=0).stop 2023-11-04T01:42:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.348+0000 7f7b9ab0f640 1 -- 172.21.15.44:0/1827629784 shutdown_connections 2023-11-04T01:42:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.348+0000 7f7b9ab0f640 1 --2- 172.21.15.44:0/1827629784 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f7b7406aea0 0x7f7b7406d360 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.348+0000 7f7b9ab0f640 1 --2- 172.21.15.44:0/1827629784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b9415b200 0x7f7b940b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.348+0000 7f7b9ab0f640 1 --2- 172.21.15.44:0/1827629784 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b940cd7f0 0x7f7b940b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.348+0000 7f7b9ab0f640 1 --2- 172.21.15.44:0/1827629784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b940afda0 0x7f7b941580b0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.348+0000 7f7b9ab0f640 1 -- 172.21.15.44:0/1827629784 >> 172.21.15.44:0/1827629784 conn(0x7f7b940d0c30 msgr2=0x7f7b940af3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.348+0000 7f7b9ab0f640 1 -- 172.21.15.44:0/1827629784 shutdown_connections 2023-11-04T01:42:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.348+0000 7f7b9ab0f640 1 -- 172.21.15.44:0/1827629784 wait complete. 2023-11-04T01:42:05.361 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:42:05.481 INFO:teuthology.orchestra.run.smithi044.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"17":[2,3,4,5,6,7,8,9]},"pending_update":[{"version":18,"snapinfo":{"snapid":10,"ino":1099511627777,"stamp":"2023-11-04T01:41:41.398085+0000","name":"s22","metadata":{}}}],"pending_destroy":[]} 2023-11-04T01:42:05.482 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": { "17": [ 2, 3, 4, 5, 6, 7, 8, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [ { "snapInfinityo": { "ino": 1099511627777, "metadata": {}, "name": "s22", "snapid": 10, "stamp": "2023-11-04T01:41:41.398085+0000" }, "version": 18 } ], "snaps": [] } 2023-11-04T01:42:05.482 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:42:05.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.588+0000 7faf95939640 1 Processor -- start 2023-11-04T01:42:05.590 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.588+0000 7faf95939640 1 -- start start 2023-11-04T01:42:05.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.589+0000 7faf95939640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf900addd0 0x7faf900cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.589+0000 7faf95939640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7faf9006c220 0x7faf900ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.589+0000 7faf95939640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf900cd720 con 0x7faf900cc680 2023-11-04T01:42:05.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.589+0000 7faf95939640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf900ae1b0 con 0x7faf9006c220 2023-11-04T01:42:05.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.589+0000 7faf95939640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf900ccb10 con 0x7faf900addd0 2023-11-04T01:42:05.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.589+0000 7faf8f7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7faf9006c220 0x7faf900ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.589+0000 7faf8effd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf900addd0 0x7faf900cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.589+0000 7faf8effd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf900addd0 0x7faf900cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:50588/0 (socket says 172.21.15.44:50588) 2023-11-04T01:42:05.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.589+0000 7faf8effd640 1 -- 172.21.15.44:0/2481265565 learned_addr learned my addr 172.21.15.44:0/2481265565 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:05.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.589+0000 7faf8f7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7faf9006c220 0x7faf900ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:53076/0 (socket says 172.21.15.44:53076) 2023-11-04T01:42:05.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.590+0000 7faf8effd640 1 -- 172.21.15.44:0/2481265565 >> v2:172.21.15.204:3300/0 conn(0x7faf9006c220 msgr2=0x7faf900ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:05.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.590+0000 7faf8effd640 1 --2- 172.21.15.44:0/2481265565 >> v2:172.21.15.204:3300/0 conn(0x7faf9006c220 0x7faf900ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.590+0000 7faf8effd640 1 -- 172.21.15.44:0/2481265565 >> v1:172.21.15.204:6789/0 conn(0x7faf900cc680 legacy=0x7faf9006bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.590+0000 7faf8effd640 1 -- 172.21.15.44:0/2481265565 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf900ccdf0 con 0x7faf900addd0 2023-11-04T01:42:05.593 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.590+0000 7faf8f7fe640 1 --2- 172.21.15.44:0/2481265565 >> v2:172.21.15.204:3300/0 conn(0x7faf9006c220 0x7faf900ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:05.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.590+0000 7faf8effd640 1 --2- 172.21.15.44:0/2481265565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf900addd0 0x7faf900cdbb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faf8000aa10 tx=0x7faf8002ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=604eb6c61e49d244 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.591+0000 7faf8e7fc640 1 -- 172.21.15.44:0/2481265565 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8002dc10 con 0x7faf900addd0 2023-11-04T01:42:05.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.591+0000 7faf8e7fc640 1 -- 172.21.15.44:0/2481265565 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8002dd70 con 0x7faf900addd0 2023-11-04T01:42:05.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.591+0000 7faf8e7fc640 1 -- 172.21.15.44:0/2481265565 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80035660 con 0x7faf900addd0 2023-11-04T01:42:05.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.591+0000 7faf95939640 1 -- 172.21.15.44:0/2481265565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf900addd0 msgr2=0x7faf900cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.591+0000 7faf95939640 1 --2- 172.21.15.44:0/2481265565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf900addd0 0x7faf900cdbb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faf8000aa10 tx=0x7faf8002ce60 comp rx=0 tx=0).stop 2023-11-04T01:42:05.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.591+0000 7faf95939640 1 -- 172.21.15.44:0/2481265565 shutdown_connections 2023-11-04T01:42:05.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.591+0000 7faf95939640 1 --2- 172.21.15.44:0/2481265565 >> v2:172.21.15.204:3300/0 conn(0x7faf9006c220 0x7faf900ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.591+0000 7faf95939640 1 --2- 172.21.15.44:0/2481265565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf900addd0 0x7faf900cdbb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.591+0000 7faf95939640 1 -- 172.21.15.44:0/2481265565 >> 172.21.15.44:0/2481265565 conn(0x7faf900cb530 msgr2=0x7faf900cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:05.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.591+0000 7faf95939640 1 -- 172.21.15.44:0/2481265565 shutdown_connections 2023-11-04T01:42:05.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.591+0000 7faf95939640 1 -- 172.21.15.44:0/2481265565 wait complete. 2023-11-04T01:42:05.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.592+0000 7faf95939640 1 Processor -- start 2023-11-04T01:42:05.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.593+0000 7faf95939640 1 -- start start 2023-11-04T01:42:05.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.593+0000 7faf95939640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9006c220 0x7faf900b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.596 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.593+0000 7faf95939640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf900addd0 0x7faf90149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.593+0000 7faf95939640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf9015b990 0x7faf900ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.593+0000 7faf95939640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf90149dc0 con 0x7faf9015b990 2023-11-04T01:42:05.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.593+0000 7faf95939640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9014cb80 con 0x7faf900addd0 2023-11-04T01:42:05.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.593+0000 7faf95939640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf900b1cd0 con 0x7faf9006c220 2023-11-04T01:42:05.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.593+0000 7faf8f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf9015b990 0x7faf900ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.593+0000 7faf8effd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9006c220 0x7faf900b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.594+0000 7faf8effd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9006c220 0x7faf900b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:50590/0 (socket says 172.21.15.44:50590) 2023-11-04T01:42:05.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.594+0000 7faf87fff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf900addd0 0x7faf90149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.594+0000 7faf8effd640 1 -- 172.21.15.44:0/1392479050 learned_addr learned my addr 172.21.15.44:0/1392479050 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:05.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.594+0000 7faf8f7fe640 1 -- 172.21.15.44:0/1392479050 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9006c220 msgr2=0x7faf900b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.594+0000 7faf8f7fe640 1 --2- 172.21.15.44:0/1392479050 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9006c220 0x7faf900b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.594+0000 7faf8f7fe640 1 -- 172.21.15.44:0/1392479050 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf900addd0 msgr2=0x7faf90149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.597 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.594+0000 7faf8f7fe640 1 --2- 172.21.15.44:0/1392479050 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf900addd0 0x7faf90149880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.594+0000 7faf8f7fe640 1 -- 172.21.15.44:0/1392479050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf88009a70 con 0x7faf9015b990 2023-11-04T01:42:05.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.594+0000 7faf8f7fe640 1 --2- 172.21.15.44:0/1392479050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf9015b990 0x7faf900ac8d0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7faf900c90b0 tx=0x7faf8800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.594+0000 7faf8cff9640 1 -- 172.21.15.44:0/1392479050 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8800ce60 con 0x7faf9015b990 2023-11-04T01:42:05.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.594+0000 7faf8cff9640 1 -- 172.21.15.44:0/1392479050 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8800f040 con 0x7faf9015b990 2023-11-04T01:42:05.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.594+0000 7faf8cff9640 1 -- 172.21.15.44:0/1392479050 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf880146a0 con 0x7faf9015b990 2023-11-04T01:42:05.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.594+0000 7faf95939640 1 -- 172.21.15.44:0/1392479050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8000a670 con 0x7faf9015b990 2023-11-04T01:42:05.598 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.594+0000 7faf95939640 1 -- 172.21.15.44:0/1392479050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9014c250 con 0x7faf9015b990 2023-11-04T01:42:05.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.595+0000 7faf95939640 1 -- 172.21.15.44:0/1392479050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf900c95e0 con 0x7faf9015b990 2023-11-04T01:42:05.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.596+0000 7faf8cff9640 1 -- 172.21.15.44:0/1392479050 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf88014800 con 0x7faf9015b990 2023-11-04T01:42:05.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.596+0000 7faf8cff9640 1 --2- 172.21.15.44:0/1392479050 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faf7006aea0 0x7faf7006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.596+0000 7faf8cff9640 1 -- 172.21.15.44:0/1392479050 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7580+0+0 (secure 0 0 0) 0x7faf8808a980 con 0x7faf9015b990 2023-11-04T01:42:05.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.596+0000 7faf8effd640 1 --2- 172.21.15.44:0/1392479050 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faf7006aea0 0x7faf7006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.599 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.597+0000 7faf8effd640 1 --2- 172.21.15.44:0/1392479050 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faf7006aea0 0x7faf7006d360 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7faf80038040 tx=0x7faf80008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.602 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.600+0000 7faf8cff9640 1 -- 172.21.15.44:0/1392479050 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf88055390 con 0x7faf9015b990 2023-11-04T01:42:05.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.848+0000 7faf95939640 1 -- 172.21.15.44:0/1392479050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7faf900684b0 con 0x7faf9015b990 2023-11-04T01:42:05.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.850+0000 7faf8cff9640 1 -- 172.21.15.44:0/1392479050 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 7344 v90) v1 ==== 97+0+0 (secure 0 0 0) 0x7faf880589b0 con 0x7faf9015b990 2023-11-04T01:42:05.852 INFO:teuthology.orchestra.run.smithi044.stderr:failed mds gid 7344 2023-11-04T01:42:05.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.852+0000 7faf95939640 1 -- 172.21.15.44:0/1392479050 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faf7006aea0 msgr2=0x7faf7006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.852+0000 7faf95939640 1 --2- 172.21.15.44:0/1392479050 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faf7006aea0 0x7faf7006d360 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7faf80038040 tx=0x7faf80008040 comp rx=0 tx=0).stop 2023-11-04T01:42:05.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.852+0000 7faf95939640 1 -- 172.21.15.44:0/1392479050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf9015b990 msgr2=0x7faf900ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.852+0000 7faf95939640 1 --2- 172.21.15.44:0/1392479050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf9015b990 0x7faf900ac8d0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7faf900c90b0 tx=0x7faf8800ef90 comp rx=0 tx=0).stop 2023-11-04T01:42:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.853+0000 7faf95939640 1 -- 172.21.15.44:0/1392479050 shutdown_connections 2023-11-04T01:42:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.853+0000 7faf95939640 1 --2- 172.21.15.44:0/1392479050 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7faf7006aea0 0x7faf7006d360 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.853+0000 7faf95939640 1 --2- 172.21.15.44:0/1392479050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf9015b990 0x7faf900ac8d0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.853+0000 7faf95939640 1 --2- 172.21.15.44:0/1392479050 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf900addd0 0x7faf90149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.853+0000 7faf95939640 1 --2- 172.21.15.44:0/1392479050 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf9006c220 0x7faf900b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.853+0000 7faf95939640 1 -- 172.21.15.44:0/1392479050 >> 172.21.15.44:0/1392479050 conn(0x7faf900cb530 msgr2=0x7faf900ae9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.853+0000 7faf95939640 1 -- 172.21.15.44:0/1392479050 shutdown_connections 2023-11-04T01:42:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.853+0000 7faf95939640 1 -- 172.21.15.44:0/1392479050 wait complete. 2023-11-04T01:42:05.869 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:42:05.869 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:42:05.870 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:42:05.870 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:05.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:05.870 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:42:05.870 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:42:05.870 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:42:05.872 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:42:05.873 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:05.952 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2023-11-04T01:42:05.980 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.978+0000 7f4af4316640 1 Processor -- start 2023-11-04T01:42:05.980 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.978+0000 7f4af4316640 1 -- start start 2023-11-04T01:42:05.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.979+0000 7f4af4316640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4aec0ceda0 0x7f4aec15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.979+0000 7f4af4316640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4aec0cf890 0x7f4aec15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.979+0000 7f4af4316640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aec15d9a0 con 0x7f4aec0b2210 2023-11-04T01:42:05.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.979+0000 7f4af4316640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aec0b1df0 con 0x7f4aec0cf890 2023-11-04T01:42:05.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.979+0000 7f4af4316640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec0cfd20 con 0x7f4aec0ceda0 2023-11-04T01:42:05.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.979+0000 7f4af28b3640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4aec0cf890 0x7f4aec15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.979+0000 7f4af18b1640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4aec0b2210 0x7f4aec0cf180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55242/0 (socket says 172.21.15.44:55242) 2023-11-04T01:42:05.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.979+0000 7f4af18b1640 1 -- 172.21.15.44:0/2058035597 learned_addr learned my addr 172.21.15.44:0/2058035597 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:05.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.979+0000 7f4af28b3640 1 -- 172.21.15.44:0/2058035597 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4aec0ceda0 msgr2=0x7f4aec15cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:05.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.979+0000 7f4af28b3640 1 --2- 172.21.15.44:0/2058035597 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4aec0ceda0 0x7f4aec15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.979+0000 7f4af28b3640 1 -- 172.21.15.44:0/2058035597 >> v1:172.21.15.44:6789/0 conn(0x7f4aec0b2210 legacy=0x7f4aec0cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.979+0000 7f4af28b3640 1 -- 172.21.15.44:0/2058035597 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec0b0150 con 0x7f4aec0cf890 2023-11-04T01:42:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.980+0000 7f4af28b3640 1 --2- 172.21.15.44:0/2058035597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aec0cf890 0x7f4aec15d460 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40097a0 tx=0x7f4ae402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676f1700bee399fc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.980+0000 7f4af10b0640 1 -- 172.21.15.44:0/2058035597 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae402e070 con 0x7f4aec0cf890 2023-11-04T01:42:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.980+0000 7f4af10b0640 1 -- 172.21.15.44:0/2058035597 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae40315a0 con 0x7f4aec0cf890 2023-11-04T01:42:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.980+0000 7f4af10b0640 1 -- 172.21.15.44:0/2058035597 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4031930 con 0x7f4aec0cf890 2023-11-04T01:42:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.981+0000 7f4af4316640 1 -- 172.21.15.44:0/2058035597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aec0cf890 msgr2=0x7f4aec15d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.981+0000 7f4af4316640 1 --2- 172.21.15.44:0/2058035597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aec0cf890 0x7f4aec15d460 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40097a0 tx=0x7f4ae402b840 comp rx=0 tx=0).stop 2023-11-04T01:42:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.981+0000 7f4af4316640 1 -- 172.21.15.44:0/2058035597 shutdown_connections 2023-11-04T01:42:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.981+0000 7f4af4316640 1 --2- 172.21.15.44:0/2058035597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aec0cf890 0x7f4aec15d460 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.981+0000 7f4af4316640 1 --2- 172.21.15.44:0/2058035597 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4aec0ceda0 0x7f4aec15cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.981+0000 7f4af4316640 1 -- 172.21.15.44:0/2058035597 >> 172.21.15.44:0/2058035597 conn(0x7f4aec0d0c30 msgr2=0x7f4aec0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.981+0000 7f4af4316640 1 -- 172.21.15.44:0/2058035597 shutdown_connections 2023-11-04T01:42:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.981+0000 7f4af4316640 1 -- 172.21.15.44:0/2058035597 wait complete. 2023-11-04T01:42:05.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.982+0000 7f4af4316640 1 Processor -- start 2023-11-04T01:42:05.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.982+0000 7f4af4316640 1 -- start start 2023-11-04T01:42:05.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af4316640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4aec0b2210 0x7f4aec0cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af4316640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aec0ceda0 0x7f4aec14feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af4316640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4aec0cf890 0x7f4aec0c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af4316640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec1503f0 con 0x7f4aec0ceda0 2023-11-04T01:42:05.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af4316640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec151730 con 0x7f4aec0cf890 2023-11-04T01:42:05.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af4316640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec150690 con 0x7f4aec0b2210 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af18b1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aec0ceda0 0x7f4aec14feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af18b1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aec0ceda0 0x7f4aec14feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49362/0 (socket says 172.21.15.44:49362) 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af18b1640 1 -- 172.21.15.44:0/1678383129 learned_addr learned my addr 172.21.15.44:0/1678383129 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af20b2640 1 --2- 172.21.15.44:0/1678383129 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4aec0b2210 0x7f4aec0cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af28b3640 1 --2- 172.21.15.44:0/1678383129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4aec0cf890 0x7f4aec0c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af18b1640 1 -- 172.21.15.44:0/1678383129 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4aec0b2210 msgr2=0x7f4aec0cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af18b1640 1 --2- 172.21.15.44:0/1678383129 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4aec0b2210 0x7f4aec0cab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af18b1640 1 -- 172.21.15.44:0/1678383129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4aec0cf890 msgr2=0x7f4aec0c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af18b1640 1 --2- 172.21.15.44:0/1678383129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4aec0cf890 0x7f4aec0c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af18b1640 1 -- 172.21.15.44:0/1678383129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae4009400 con 0x7f4aec0ceda0 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.983+0000 7f4af18b1640 1 --2- 172.21.15.44:0/1678383129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aec0ceda0 0x7f4aec14feb0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000c4a0 tx=0x7f4ae000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.984+0000 7f4aeaffd640 1 -- 172.21.15.44:0/1678383129 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0005ce0 con 0x7f4aec0ceda0 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.984+0000 7f4aeaffd640 1 -- 172.21.15.44:0/1678383129 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae0005e40 con 0x7f4aec0ceda0 2023-11-04T01:42:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.984+0000 7f4af4316640 1 -- 172.21.15.44:0/1678383129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec150970 con 0x7f4aec0ceda0 2023-11-04T01:42:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.984+0000 7f4aeaffd640 1 -- 172.21.15.44:0/1678383129 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0007270 con 0x7f4aec0ceda0 2023-11-04T01:42:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.984+0000 7f4af4316640 1 -- 172.21.15.44:0/1678383129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec150f30 con 0x7f4aec0ceda0 2023-11-04T01:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.985+0000 7f4af4316640 1 -- 172.21.15.44:0/1678383129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aec0684b0 con 0x7f4aec0ceda0 2023-11-04T01:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.985+0000 7f4aeaffd640 1 -- 172.21.15.44:0/1678383129 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ae0007490 con 0x7f4aec0ceda0 2023-11-04T01:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.985+0000 7f4aeaffd640 1 --2- 172.21.15.44:0/1678383129 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ad806ae70 0x7f4ad806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.986+0000 7f4aeaffd640 1 -- 172.21.15.44:0/1678383129 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7666+0+0 (secure 0 0 0) 0x7f4ae0089310 con 0x7f4aec0ceda0 2023-11-04T01:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.986+0000 7f4af20b2640 1 --2- 172.21.15.44:0/1678383129 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ad806ae70 0x7f4ad806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.986+0000 7f4af20b2640 1 --2- 172.21.15.44:0/1678383129 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ad806ae70 0x7f4ad806d330 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009f20 tx=0x7f4adc0094f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.992 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:05.990+0000 7f4aeaffd640 1 -- 172.21.15.44:0/1678383129 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ae0053c30 con 0x7f4aec0ceda0 2023-11-04T01:42:06.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:06.200+0000 7f4af4316640 1 -- 172.21.15.44:0/1678383129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4aec06c330 con 0x7f4aec0ceda0 2023-11-04T01:42:06.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:06.201+0000 7f4aeaffd640 1 -- 172.21.15.44:0/1678383129 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4144 (secure 0 0 0) 0x7f4ae0017090 con 0x7f4aec0ceda0 2023-11-04T01:42:06.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:06.203 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":91,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:05.854388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:replay","state_seq":1,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:resolve","state_seq":8,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:06.203 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 91 2023-11-04T01:42:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:06.202+0000 7f4af4316640 1 -- 172.21.15.44:0/1678383129 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ad806ae70 msgr2=0x7f4ad806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:06.202+0000 7f4af4316640 1 --2- 172.21.15.44:0/1678383129 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ad806ae70 0x7f4ad806d330 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009f20 tx=0x7f4adc0094f0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:06.202+0000 7f4af4316640 1 -- 172.21.15.44:0/1678383129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aec0ceda0 msgr2=0x7f4aec14feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:06.202+0000 7f4af4316640 1 --2- 172.21.15.44:0/1678383129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aec0ceda0 0x7f4aec14feb0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000c4a0 tx=0x7f4ae000c960 comp rx=0 tx=0).stop 2023-11-04T01:42:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:06.202+0000 7f4af4316640 1 -- 172.21.15.44:0/1678383129 shutdown_connections 2023-11-04T01:42:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:06.202+0000 7f4af4316640 1 --2- 172.21.15.44:0/1678383129 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4ad806ae70 0x7f4ad806d330 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:06.202+0000 7f4af4316640 1 --2- 172.21.15.44:0/1678383129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4aec0cf890 0x7f4aec0c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:06.202+0000 7f4af4316640 1 --2- 172.21.15.44:0/1678383129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aec0ceda0 0x7f4aec14feb0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:06.202+0000 7f4af4316640 1 --2- 172.21.15.44:0/1678383129 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4aec0b2210 0x7f4aec0cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:06.202+0000 7f4af4316640 1 -- 172.21.15.44:0/1678383129 >> 172.21.15.44:0/1678383129 conn(0x7f4aec0d0c30 msgr2=0x7f4aec0cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:06.203+0000 7f4af4316640 1 -- 172.21.15.44:0/1678383129 shutdown_connections 2023-11-04T01:42:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:06.203+0000 7f4af4316640 1 -- 172.21.15.44:0/1678383129 wait complete. 2023-11-04T01:42:06.215 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:42:06.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:42:11.216 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:11.334 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.332+0000 7f0270da9640 1 Processor -- start 2023-11-04T01:42:11.335 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.332+0000 7f0270da9640 1 -- start start 2023-11-04T01:42:11.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.333+0000 7f0270da9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f026c15d100 0x7f026c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.333+0000 7f0270da9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f026c0d1be0 0x7f026c0b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.333+0000 7f0270da9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c0b32b0 con 0x7f026c15d4e0 2023-11-04T01:42:11.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.333+0000 7f0270da9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026c0cee10 con 0x7f026c0d1be0 2023-11-04T01:42:11.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.333+0000 7f0270da9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0b2980 con 0x7f026c15d100 2023-11-04T01:42:11.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.334+0000 7f0269d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f026c15d4e0 0x7f026c0d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55254/0 (socket says 172.21.15.44:55254) 2023-11-04T01:42:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.334+0000 7f0269d9b640 1 -- 172.21.15.44:0/3672007458 learned_addr learned my addr 172.21.15.44:0/3672007458 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.334+0000 7f026ad9d640 1 --2- 172.21.15.44:0/3672007458 >> v2:172.21.15.44:3300/0 conn(0x7f026c0d1be0 0x7f026c0b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.334+0000 7f026a59c640 1 --2- 172.21.15.44:0/3672007458 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f026c15d100 0x7f026c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.334+0000 7f026959a640 1 -- 172.21.15.44:0/3672007458 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64877204 0 0) 0x7f026c0b32b0 con 0x7f026c15d4e0 2023-11-04T01:42:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.334+0000 7f026959a640 1 -- 172.21.15.44:0/3672007458 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0258003520 con 0x7f026c15d4e0 2023-11-04T01:42:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.334+0000 7f026ad9d640 1 -- 172.21.15.44:0/3672007458 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f026c15d100 msgr2=0x7f026c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.334+0000 7f026ad9d640 1 --2- 172.21.15.44:0/3672007458 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f026c15d100 0x7f026c0ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.334+0000 7f026ad9d640 1 -- 172.21.15.44:0/3672007458 >> v1:172.21.15.44:6789/0 conn(0x7f026c15d4e0 legacy=0x7f026c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.334+0000 7f026ad9d640 1 -- 172.21.15.44:0/3672007458 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c0b2c60 con 0x7f026c0d1be0 2023-11-04T01:42:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.334+0000 7f026a59c640 1 --2- 172.21.15.44:0/3672007458 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f026c15d100 0x7f026c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.335+0000 7f026ad9d640 1 --2- 172.21.15.44:0/3672007458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f026c0d1be0 0x7f026c0b3740 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f025c009dc0 tx=0x7f025c02be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4d6e27f9c42272 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.335+0000 7f026959a640 1 -- 172.21.15.44:0/3672007458 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c02cc40 con 0x7f026c0d1be0 2023-11-04T01:42:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.335+0000 7f026959a640 1 -- 172.21.15.44:0/3672007458 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c02cda0 con 0x7f026c0d1be0 2023-11-04T01:42:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.335+0000 7f026959a640 1 -- 172.21.15.44:0/3672007458 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c034660 con 0x7f026c0d1be0 2023-11-04T01:42:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.335+0000 7f0270da9640 1 -- 172.21.15.44:0/3672007458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f026c0d1be0 msgr2=0x7f026c0b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.335+0000 7f0270da9640 1 --2- 172.21.15.44:0/3672007458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f026c0d1be0 0x7f026c0b3740 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f025c009dc0 tx=0x7f025c02be90 comp rx=0 tx=0).stop 2023-11-04T01:42:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.336+0000 7f0270da9640 1 -- 172.21.15.44:0/3672007458 shutdown_connections 2023-11-04T01:42:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.336+0000 7f0270da9640 1 --2- 172.21.15.44:0/3672007458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f026c0d1be0 0x7f026c0b3740 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.336+0000 7f0270da9640 1 --2- 172.21.15.44:0/3672007458 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f026c15d100 0x7f026c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.336+0000 7f0270da9640 1 -- 172.21.15.44:0/3672007458 >> 172.21.15.44:0/3672007458 conn(0x7f026c0d2ef0 msgr2=0x7f026c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:11.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.336+0000 7f0270da9640 1 -- 172.21.15.44:0/3672007458 shutdown_connections 2023-11-04T01:42:11.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.336+0000 7f0270da9640 1 -- 172.21.15.44:0/3672007458 wait complete. 2023-11-04T01:42:11.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.337+0000 7f0270da9640 1 Processor -- start 2023-11-04T01:42:11.340 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.337+0000 7f0270da9640 1 -- start start 2023-11-04T01:42:11.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f0270da9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f026c0d1be0 0x7f026c06bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f0270da9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f026c15d100 0x7f026c0b6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f0270da9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f026c15d4e0 0x7f026c150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f0270da9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0c9fc0 con 0x7f026c15d100 2023-11-04T01:42:11.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f0270da9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0b6dd0 con 0x7f026c0d1be0 2023-11-04T01:42:11.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f0270da9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0ca210 con 0x7f026c15d4e0 2023-11-04T01:42:11.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f0269d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f026c15d100 0x7f026c0b6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f0269d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f026c15d100 0x7f026c0b6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49386/0 (socket says 172.21.15.44:49386) 2023-11-04T01:42:11.342 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f0269d9b640 1 -- 172.21.15.44:0/247857599 learned_addr learned my addr 172.21.15.44:0/247857599 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:11.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f0269d9b640 1 -- 172.21.15.44:0/247857599 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f026c15d4e0 msgr2=0x7f026c150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f0269d9b640 1 --2- 172.21.15.44:0/247857599 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f026c15d4e0 0x7f026c150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f0269d9b640 1 -- 172.21.15.44:0/247857599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f026c0d1be0 msgr2=0x7f026c06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f026a59c640 1 --2- 172.21.15.44:0/247857599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f026c0d1be0 0x7f026c06bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f0269d9b640 1 --2- 172.21.15.44:0/247857599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f026c0d1be0 0x7f026c06bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f0269d9b640 1 -- 172.21.15.44:0/247857599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c009a70 con 0x7f026c15d100 2023-11-04T01:42:11.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.338+0000 7f0269d9b640 1 --2- 172.21.15.44:0/247857599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f026c15d100 0x7f026c0b6380 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f025400c410 tx=0x7f025400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:11.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.339+0000 7f0262ffd640 1 -- 172.21.15.44:0/247857599 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254005ce0 con 0x7f026c15d100 2023-11-04T01:42:11.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.339+0000 7f0262ffd640 1 -- 172.21.15.44:0/247857599 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0254005e40 con 0x7f026c15d100 2023-11-04T01:42:11.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.339+0000 7f0262ffd640 1 -- 172.21.15.44:0/247857599 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02540072f0 con 0x7f026c15d100 2023-11-04T01:42:11.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.339+0000 7f0270da9640 1 -- 172.21.15.44:0/247857599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026c0ca4f0 con 0x7f026c15d100 2023-11-04T01:42:11.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.339+0000 7f0270da9640 1 -- 172.21.15.44:0/247857599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026c0cacf0 con 0x7f026c15d100 2023-11-04T01:42:11.343 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.340+0000 7f0270da9640 1 -- 172.21.15.44:0/247857599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026c0caa10 con 0x7f026c15d100 2023-11-04T01:42:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.340+0000 7f0262ffd640 1 -- 172.21.15.44:0/247857599 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0254007510 con 0x7f026c15d100 2023-11-04T01:42:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.341+0000 7f0262ffd640 1 --2- 172.21.15.44:0/247857599 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f024c06ae70 0x7f024c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.341+0000 7f0262ffd640 1 -- 172.21.15.44:0/247857599 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7666+0+0 (secure 0 0 0) 0x7f02540893e0 con 0x7f026c15d100 2023-11-04T01:42:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.341+0000 7f026a59c640 1 --2- 172.21.15.44:0/247857599 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f024c06ae70 0x7f024c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.341+0000 7f026a59c640 1 --2- 172.21.15.44:0/247857599 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f024c06ae70 0x7f024c06d330 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f026c0d2b20 tx=0x7f0264008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:11.347 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.345+0000 7f0262ffd640 1 -- 172.21.15.44:0/247857599 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f026c0caa10 con 0x7f026c15d100 2023-11-04T01:42:11.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.555+0000 7f0270da9640 1 -- 172.21.15.44:0/247857599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f026c0caa10 con 0x7f026c15d100 2023-11-04T01:42:11.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.555+0000 7f0262ffd640 1 -- 172.21.15.44:0/247857599 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f026c0caa10 con 0x7f026c15d100 2023-11-04T01:42:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:11.557 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:06.864552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:11.558 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 93 2023-11-04T01:42:11.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.557+0000 7f0270da9640 1 -- 172.21.15.44:0/247857599 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f024c06ae70 msgr2=0x7f024c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.557+0000 7f0270da9640 1 --2- 172.21.15.44:0/247857599 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f024c06ae70 0x7f024c06d330 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f026c0d2b20 tx=0x7f0264008040 comp rx=0 tx=0).stop 2023-11-04T01:42:11.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.557+0000 7f0270da9640 1 -- 172.21.15.44:0/247857599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f026c15d100 msgr2=0x7f026c0b6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.557+0000 7f0270da9640 1 --2- 172.21.15.44:0/247857599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f026c15d100 0x7f026c0b6380 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f025400c410 tx=0x7f025400c8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.557+0000 7f0270da9640 1 -- 172.21.15.44:0/247857599 shutdown_connections 2023-11-04T01:42:11.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.557+0000 7f0270da9640 1 --2- 172.21.15.44:0/247857599 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f024c06ae70 0x7f024c06d330 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.557+0000 7f0270da9640 1 --2- 172.21.15.44:0/247857599 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f026c15d4e0 0x7f026c150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.557+0000 7f0270da9640 1 --2- 172.21.15.44:0/247857599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f026c15d100 0x7f026c0b6380 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.557+0000 7f0270da9640 1 --2- 172.21.15.44:0/247857599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f026c0d1be0 0x7f026c06bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.557+0000 7f0270da9640 1 -- 172.21.15.44:0/247857599 >> 172.21.15.44:0/247857599 conn(0x7f026c0d2ef0 msgr2=0x7f026c0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:11.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.557+0000 7f0270da9640 1 -- 172.21.15.44:0/247857599 shutdown_connections 2023-11-04T01:42:11.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.557+0000 7f0270da9640 1 -- 172.21.15.44:0/247857599 wait complete. 2023-11-04T01:42:11.570 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:42:11.570 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:11.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.674+0000 7f1275518640 1 Processor -- start 2023-11-04T01:42:11.676 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.674+0000 7f1275518640 1 -- start start 2023-11-04T01:42:11.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.675+0000 7f1275518640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f12700ceda0 0x7f127015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.675+0000 7f1275518640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12700cf890 0x7f127015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.675+0000 7f1275518640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127015d9a0 con 0x7f12700b2210 2023-11-04T01:42:11.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.675+0000 7f1275518640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12700b1df0 con 0x7f12700ceda0 2023-11-04T01:42:11.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.675+0000 7f1275518640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12700cfd20 con 0x7f12700cf890 2023-11-04T01:42:11.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.676+0000 7f126effd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f12700ceda0 0x7f127015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.676+0000 7f126f7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12700cf890 0x7f127015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.676+0000 7f126e7fc640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f12700b2210 0x7f12700cf180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:40374/0 (socket says 172.21.15.44:40374) 2023-11-04T01:42:11.678 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.676+0000 7f126e7fc640 1 -- 172.21.15.44:0/1482731929 learned_addr learned my addr 172.21.15.44:0/1482731929 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.676+0000 7f126effd640 1 -- 172.21.15.44:0/1482731929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12700cf890 msgr2=0x7f127015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.676+0000 7f126effd640 1 --2- 172.21.15.44:0/1482731929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12700cf890 0x7f127015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.676+0000 7f126effd640 1 -- 172.21.15.44:0/1482731929 >> v1:172.21.15.204:6789/0 conn(0x7f12700b2210 legacy=0x7f12700cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.676+0000 7f126effd640 1 -- 172.21.15.44:0/1482731929 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12700b0150 con 0x7f12700ceda0 2023-11-04T01:42:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.676+0000 7f126dffb640 1 -- 172.21.15.44:0/1482731929 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110547644 0 0) 0x7f127015d9a0 con 0x7f12700b2210 2023-11-04T01:42:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.676+0000 7f126f7fe640 1 --2- 172.21.15.44:0/1482731929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12700cf890 0x7f127015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:11.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.677+0000 7f126effd640 1 --2- 172.21.15.44:0/1482731929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f12700ceda0 0x7f127015cf20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1268009790 tx=0x7f126802b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a709153a6e7fcaf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:11.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.677+0000 7f126dffb640 1 -- 172.21.15.44:0/1482731929 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268031770 con 0x7f12700ceda0 2023-11-04T01:42:11.680 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.677+0000 7f126dffb640 1 -- 172.21.15.44:0/1482731929 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12680318d0 con 0x7f12700ceda0 2023-11-04T01:42:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.677+0000 7f126dffb640 1 -- 172.21.15.44:0/1482731929 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268031c60 con 0x7f12700ceda0 2023-11-04T01:42:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.678+0000 7f1275518640 1 -- 172.21.15.44:0/1482731929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f12700ceda0 msgr2=0x7f127015cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.678+0000 7f1275518640 1 --2- 172.21.15.44:0/1482731929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f12700ceda0 0x7f127015cf20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1268009790 tx=0x7f126802b810 comp rx=0 tx=0).stop 2023-11-04T01:42:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.678+0000 7f1275518640 1 -- 172.21.15.44:0/1482731929 shutdown_connections 2023-11-04T01:42:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.678+0000 7f1275518640 1 --2- 172.21.15.44:0/1482731929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12700cf890 0x7f127015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.678+0000 7f1275518640 1 --2- 172.21.15.44:0/1482731929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f12700ceda0 0x7f127015cf20 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.678+0000 7f1275518640 1 -- 172.21.15.44:0/1482731929 >> 172.21.15.44:0/1482731929 conn(0x7f12700d0c30 msgr2=0x7f12700d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.678+0000 7f1275518640 1 -- 172.21.15.44:0/1482731929 shutdown_connections 2023-11-04T01:42:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.678+0000 7f1275518640 1 -- 172.21.15.44:0/1482731929 wait complete. 2023-11-04T01:42:11.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.679+0000 7f1275518640 1 Processor -- start 2023-11-04T01:42:11.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.679+0000 7f1275518640 1 -- start start 2023-11-04T01:42:11.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f1275518640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12700b2210 0x7f12700ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f1275518640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12700ceda0 0x7f12700b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f1275518640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f12700cf890 0x7f12701f6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f1275518640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12700cd0f0 con 0x7f12700ceda0 2023-11-04T01:42:11.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f1275518640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12700cd340 con 0x7f12700cf890 2023-11-04T01:42:11.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f1275518640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12700cd620 con 0x7f12700b2210 2023-11-04T01:42:11.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f126e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12700ceda0 0x7f12700b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f126e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12700ceda0 0x7f12700b2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49394/0 (socket says 172.21.15.44:49394) 2023-11-04T01:42:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f126e7fc640 1 -- 172.21.15.44:0/778320283 learned_addr learned my addr 172.21.15.44:0/778320283 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f126effd640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12700b2210 0x7f12700ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f126f7fe640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f12700cf890 0x7f12701f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f126e7fc640 1 -- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12700b2210 msgr2=0x7f12700ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f126e7fc640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12700b2210 0x7f12700ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f126e7fc640 1 -- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f12700cf890 msgr2=0x7f12701f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f126e7fc640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f12700cf890 0x7f12701f6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f126e7fc640 1 -- 172.21.15.44:0/778320283 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1260009a70 con 0x7f12700ceda0 2023-11-04T01:42:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f126effd640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12700b2210 0x7f12700ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f126f7fe640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f12700cf890 0x7f12701f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f126e7fc640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12700ceda0 0x7f12700b2920 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f125800c4d0 tx=0x7f125800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:11.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f12677fe640 1 -- 172.21.15.44:0/778320283 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12580074e0 con 0x7f12700ceda0 2023-11-04T01:42:11.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.680+0000 7f12677fe640 1 -- 172.21.15.44:0/778320283 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1258007660 con 0x7f12700ceda0 2023-11-04T01:42:11.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.681+0000 7f12677fe640 1 -- 172.21.15.44:0/778320283 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258004a20 con 0x7f12700ceda0 2023-11-04T01:42:11.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.681+0000 7f1275518640 1 -- 172.21.15.44:0/778320283 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12680093a0 con 0x7f12700ceda0 2023-11-04T01:42:11.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.681+0000 7f1275518640 1 -- 172.21.15.44:0/778320283 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12700cdbe0 con 0x7f12700ceda0 2023-11-04T01:42:11.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.682+0000 7f1275518640 1 -- 172.21.15.44:0/778320283 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12700cde00 con 0x7f12700ceda0 2023-11-04T01:42:11.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.682+0000 7f12677fe640 1 -- 172.21.15.44:0/778320283 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1258004b80 con 0x7f12700ceda0 2023-11-04T01:42:11.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.683+0000 7f12677fe640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f125006ae70 0x7f125006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.683+0000 7f12677fe640 1 -- 172.21.15.44:0/778320283 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7666+0+0 (secure 0 0 0) 0x7f1258088fc0 con 0x7f12700ceda0 2023-11-04T01:42:11.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.683+0000 7f126effd640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f125006ae70 0x7f125006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.683+0000 7f126effd640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f125006ae70 0x7f125006d330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1268036000 tx=0x7f126803d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:11.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.687+0000 7f12677fe640 1 -- 172.21.15.44:0/778320283 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f12580538b0 con 0x7f12700ceda0 2023-11-04T01:42:11.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.901+0000 7f1275518640 1 -- 172.21.15.44:0/778320283 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12700684b0 con 0x7f12700ceda0 2023-11-04T01:42:11.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.901+0000 7f12677fe640 1 -- 172.21.15.44:0/778320283 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f1258018020 con 0x7f12700ceda0 2023-11-04T01:42:11.903 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:11.903 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:06.864552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:11.904 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 93 2023-11-04T01:42:11.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.903+0000 7f1275518640 1 -- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f125006ae70 msgr2=0x7f125006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.903+0000 7f1275518640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f125006ae70 0x7f125006d330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1268036000 tx=0x7f126803d040 comp rx=0 tx=0).stop 2023-11-04T01:42:11.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.903+0000 7f1275518640 1 -- 172.21.15.44:0/778320283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12700ceda0 msgr2=0x7f12700b2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.903+0000 7f1275518640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12700ceda0 0x7f12700b2920 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f125800c4d0 tx=0x7f125800c990 comp rx=0 tx=0).stop 2023-11-04T01:42:11.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.903+0000 7f1275518640 1 -- 172.21.15.44:0/778320283 shutdown_connections 2023-11-04T01:42:11.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.903+0000 7f1275518640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f125006ae70 0x7f125006d330 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.903+0000 7f1275518640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f12700cf890 0x7f12701f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.903+0000 7f1275518640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12700ceda0 0x7f12700b2920 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.903+0000 7f1275518640 1 --2- 172.21.15.44:0/778320283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12700b2210 0x7f12700ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.903+0000 7f1275518640 1 -- 172.21.15.44:0/778320283 >> 172.21.15.44:0/778320283 conn(0x7f12700d0c30 msgr2=0x7f1270156360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:11.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.904+0000 7f1275518640 1 -- 172.21.15.44:0/778320283 shutdown_connections 2023-11-04T01:42:11.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:11.904+0000 7f1275518640 1 -- 172.21.15.44:0/778320283 wait complete. 2023-11-04T01:42:11.916 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:42:12.917 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:13.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.035+0000 7f1d0d634640 1 Processor -- start 2023-11-04T01:42:13.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.035+0000 7f1d0d634640 1 -- start start 2023-11-04T01:42:13.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.036+0000 7f1d0d634640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1d080ceda0 0x7f1d0815cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.036+0000 7f1d0d634640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1d080cf890 0x7f1d0815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.036+0000 7f1d0d634640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d0815d9a0 con 0x7f1d080b2210 2023-11-04T01:42:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.036+0000 7f1d0d634640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d080b1df0 con 0x7f1d080cf890 2023-11-04T01:42:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.036+0000 7f1d0d634640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080cfd20 con 0x7f1d080ceda0 2023-11-04T01:42:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.036+0000 7f1d077fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1d080cf890 0x7f1d0815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.036+0000 7f1d067fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1d080b2210 0x7f1d080cf180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51382/0 (socket says 172.21.15.44:51382) 2023-11-04T01:42:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.036+0000 7f1d067fc640 1 -- 172.21.15.44:0/3801771774 learned_addr learned my addr 172.21.15.44:0/3801771774 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.036+0000 7f1d06ffd640 1 --2- 172.21.15.44:0/3801771774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1d080ceda0 0x7f1d0815cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.036+0000 7f1d077fe640 1 -- 172.21.15.44:0/3801771774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1d080ceda0 msgr2=0x7f1d0815cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.036+0000 7f1d077fe640 1 --2- 172.21.15.44:0/3801771774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1d080ceda0 0x7f1d0815cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.036+0000 7f1d077fe640 1 -- 172.21.15.44:0/3801771774 >> v1:172.21.15.44:6789/0 conn(0x7f1d080b2210 legacy=0x7f1d080cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.036+0000 7f1d077fe640 1 -- 172.21.15.44:0/3801771774 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d080b0150 con 0x7f1d080cf890 2023-11-04T01:42:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.036+0000 7f1d05ffb640 1 -- 172.21.15.44:0/3801771774 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108530205 0 0) 0x7f1d0815d9a0 con 0x7f1d080b2210 2023-11-04T01:42:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.037+0000 7f1d077fe640 1 --2- 172.21.15.44:0/3801771774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d080cf890 0x7f1d0815d460 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009d90 tx=0x7f1cf802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296ee6fb3a41e35a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.037+0000 7f1d05ffb640 1 -- 172.21.15.44:0/3801771774 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf802cbc0 con 0x7f1d080cf890 2023-11-04T01:42:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.037+0000 7f1d05ffb640 1 -- 172.21.15.44:0/3801771774 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf802cd20 con 0x7f1d080cf890 2023-11-04T01:42:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.037+0000 7f1d05ffb640 1 -- 172.21.15.44:0/3801771774 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8034660 con 0x7f1d080cf890 2023-11-04T01:42:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.038+0000 7f1d0d634640 1 -- 172.21.15.44:0/3801771774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d080cf890 msgr2=0x7f1d0815d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.038+0000 7f1d0d634640 1 --2- 172.21.15.44:0/3801771774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d080cf890 0x7f1d0815d460 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009d90 tx=0x7f1cf802be10 comp rx=0 tx=0).stop 2023-11-04T01:42:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.038+0000 7f1d0d634640 1 -- 172.21.15.44:0/3801771774 shutdown_connections 2023-11-04T01:42:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.038+0000 7f1d0d634640 1 --2- 172.21.15.44:0/3801771774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d080cf890 0x7f1d0815d460 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.038+0000 7f1d0d634640 1 --2- 172.21.15.44:0/3801771774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1d080ceda0 0x7f1d0815cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.038+0000 7f1d0d634640 1 -- 172.21.15.44:0/3801771774 >> 172.21.15.44:0/3801771774 conn(0x7f1d080d0c30 msgr2=0x7f1d080d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.038+0000 7f1d0d634640 1 -- 172.21.15.44:0/3801771774 shutdown_connections 2023-11-04T01:42:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.038+0000 7f1d0d634640 1 -- 172.21.15.44:0/3801771774 wait complete. 2023-11-04T01:42:13.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.039+0000 7f1d0d634640 1 Processor -- start 2023-11-04T01:42:13.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.039+0000 7f1d0d634640 1 -- start start 2023-11-04T01:42:13.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.040+0000 7f1d0d634640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1d080b2210 0x7f1d0815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.040+0000 7f1d0d634640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d080ceda0 0x7f1d080c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.040+0000 7f1d0d634640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1d080cf890 0x7f1d08155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.040+0000 7f1d0d634640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080c9580 con 0x7f1d080ceda0 2023-11-04T01:42:13.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.040+0000 7f1d0d634640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080c9860 con 0x7f1d080b2210 2023-11-04T01:42:13.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.040+0000 7f1d0d634640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080c9b40 con 0x7f1d080cf890 2023-11-04T01:42:13.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.040+0000 7f1d067fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d080ceda0 0x7f1d080c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.040+0000 7f1d067fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d080ceda0 0x7f1d080c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45766/0 (socket says 172.21.15.44:45766) 2023-11-04T01:42:13.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.040+0000 7f1d067fc640 1 -- 172.21.15.44:0/2540111862 learned_addr learned my addr 172.21.15.44:0/2540111862 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:13.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.040+0000 7f1d077fe640 1 --2- 172.21.15.44:0/2540111862 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1d080cf890 0x7f1d08155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.040+0000 7f1d06ffd640 1 --2- 172.21.15.44:0/2540111862 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1d080b2210 0x7f1d0815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.041+0000 7f1d067fc640 1 -- 172.21.15.44:0/2540111862 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1d080cf890 msgr2=0x7f1d08155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.041+0000 7f1d067fc640 1 --2- 172.21.15.44:0/2540111862 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1d080cf890 0x7f1d08155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.041+0000 7f1d067fc640 1 -- 172.21.15.44:0/2540111862 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1d080b2210 msgr2=0x7f1d0815a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.041+0000 7f1d067fc640 1 --2- 172.21.15.44:0/2540111862 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1d080b2210 0x7f1d0815a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.041+0000 7f1d067fc640 1 -- 172.21.15.44:0/2540111862 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf8009a70 con 0x7f1d080ceda0 2023-11-04T01:42:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.041+0000 7f1d067fc640 1 --2- 172.21.15.44:0/2540111862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d080ceda0 0x7f1d080c8d50 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000c4d0 tx=0x7f1cf000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.041+0000 7f1cff7fe640 1 -- 172.21.15.44:0/2540111862 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00074e0 con 0x7f1d080ceda0 2023-11-04T01:42:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.041+0000 7f1cff7fe640 1 -- 172.21.15.44:0/2540111862 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf0007660 con 0x7f1d080ceda0 2023-11-04T01:42:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.041+0000 7f1d0d634640 1 -- 172.21.15.44:0/2540111862 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d080c9e20 con 0x7f1d080ceda0 2023-11-04T01:42:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.041+0000 7f1cff7fe640 1 -- 172.21.15.44:0/2540111862 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0004a20 con 0x7f1d080ceda0 2023-11-04T01:42:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.041+0000 7f1d0d634640 1 -- 172.21.15.44:0/2540111862 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d080c9290 con 0x7f1d080ceda0 2023-11-04T01:42:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.042+0000 7f1d0d634640 1 -- 172.21.15.44:0/2540111862 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d080ca340 con 0x7f1d080ceda0 2023-11-04T01:42:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.043+0000 7f1cff7fe640 1 -- 172.21.15.44:0/2540111862 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1cf0004b80 con 0x7f1d080ceda0 2023-11-04T01:42:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.043+0000 7f1cff7fe640 1 --2- 172.21.15.44:0/2540111862 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1ce806aea0 0x7f1ce806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.043+0000 7f1cff7fe640 1 -- 172.21.15.44:0/2540111862 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7666+0+0 (secure 0 0 0) 0x7f1cf0089160 con 0x7f1d080ceda0 2023-11-04T01:42:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.043+0000 7f1d06ffd640 1 --2- 172.21.15.44:0/2540111862 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1ce806aea0 0x7f1ce806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.044+0000 7f1d06ffd640 1 --2- 172.21.15.44:0/2540111862 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1ce806aea0 0x7f1ce806d360 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1d00006fd0 tx=0x7f1d00008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:13.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.047+0000 7f1cff7fe640 1 -- 172.21.15.44:0/2540111862 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d080ca340 con 0x7f1d080ceda0 2023-11-04T01:42:13.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.265+0000 7f1d0d634640 1 -- 172.21.15.44:0/2540111862 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d080ca340 con 0x7f1d080ceda0 2023-11-04T01:42:13.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.266+0000 7f1cff7fe640 1 -- 172.21.15.44:0/2540111862 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f1d080ca340 con 0x7f1d080ceda0 2023-11-04T01:42:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:13.268 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:06.864552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:13.268 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 93 2023-11-04T01:42:13.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.268+0000 7f1d0d634640 1 -- 172.21.15.44:0/2540111862 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1ce806aea0 msgr2=0x7f1ce806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.268+0000 7f1d0d634640 1 --2- 172.21.15.44:0/2540111862 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1ce806aea0 0x7f1ce806d360 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1d00006fd0 tx=0x7f1d00008040 comp rx=0 tx=0).stop 2023-11-04T01:42:13.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.268+0000 7f1d0d634640 1 -- 172.21.15.44:0/2540111862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d080ceda0 msgr2=0x7f1d080c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.268+0000 7f1d0d634640 1 --2- 172.21.15.44:0/2540111862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d080ceda0 0x7f1d080c8d50 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000c4d0 tx=0x7f1cf000c990 comp rx=0 tx=0).stop 2023-11-04T01:42:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.268+0000 7f1d0d634640 1 -- 172.21.15.44:0/2540111862 shutdown_connections 2023-11-04T01:42:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.268+0000 7f1d0d634640 1 --2- 172.21.15.44:0/2540111862 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1ce806aea0 0x7f1ce806d360 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.268+0000 7f1d0d634640 1 --2- 172.21.15.44:0/2540111862 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1d080cf890 0x7f1d08155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.268+0000 7f1d0d634640 1 --2- 172.21.15.44:0/2540111862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d080ceda0 0x7f1d080c8d50 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.268+0000 7f1d0d634640 1 --2- 172.21.15.44:0/2540111862 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1d080b2210 0x7f1d0815a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.268+0000 7f1d0d634640 1 -- 172.21.15.44:0/2540111862 >> 172.21.15.44:0/2540111862 conn(0x7f1d080d0c30 msgr2=0x7f1d0815c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.268+0000 7f1d0d634640 1 -- 172.21.15.44:0/2540111862 shutdown_connections 2023-11-04T01:42:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:13.268+0000 7f1d0d634640 1 -- 172.21.15.44:0/2540111862 wait complete. 2023-11-04T01:42:13.281 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:42:14.282 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:14.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.396+0000 7f85eed05640 1 Processor -- start 2023-11-04T01:42:14.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.396+0000 7f85eed05640 1 -- start start 2023-11-04T01:42:14.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.397+0000 7f85eed05640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f85e815d4e0 0x7f85e80ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.397+0000 7f85eed05640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e80b25a0 con 0x7f85e80ced90 2023-11-04T01:42:14.399 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.397+0000 7f85eed05640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e80b2300 con 0x7f85e80ca8b0 2023-11-04T01:42:14.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.397+0000 7f85eed05640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e815d8c0 con 0x7f85e815d4e0 2023-11-04T01:42:14.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.397+0000 7f85ecaa1640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f85e815d4e0 0x7f85e80ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.397+0000 7f85e7fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f85e80ced90 0x7f85e80ca1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51384/0 (socket says 172.21.15.44:51384) 2023-11-04T01:42:14.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.397+0000 7f85e7fff640 1 -- 172.21.15.44:0/3733653178 learned_addr learned my addr 172.21.15.44:0/3733653178 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:14.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.397+0000 7f85ecaa1640 1 -- 172.21.15.44:0/3733653178 >> v1:172.21.15.204:6789/0 conn(0x7f85e80ca8b0 legacy=0x7f85e806a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.397+0000 7f85ecaa1640 1 -- 172.21.15.44:0/3733653178 >> v1:172.21.15.44:6789/0 conn(0x7f85e80ced90 legacy=0x7f85e80ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.397+0000 7f85e77fe640 1 -- 172.21.15.44:0/3733653178 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997389221 0 0) 0x7f85e80b25a0 con 0x7f85e80ced90 2023-11-04T01:42:14.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.397+0000 7f85ecaa1640 1 -- 172.21.15.44:0/3733653178 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e815e5f0 con 0x7f85e815d4e0 2023-11-04T01:42:14.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.398+0000 7f85ecaa1640 1 --2- 172.21.15.44:0/3733653178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85e815d4e0 0x7f85e80ce850 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f85d80097d0 tx=0x7f85d802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dabb8d9f33b5d1a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:14.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.398+0000 7f85e77fe640 1 -- 172.21.15.44:0/3733653178 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8030610 con 0x7f85e815d4e0 2023-11-04T01:42:14.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.398+0000 7f85e77fe640 1 -- 172.21.15.44:0/3733653178 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d8030770 con 0x7f85e815d4e0 2023-11-04T01:42:14.401 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.398+0000 7f85e77fe640 1 -- 172.21.15.44:0/3733653178 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8030b00 con 0x7f85e815d4e0 2023-11-04T01:42:14.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.399+0000 7f85eed05640 1 -- 172.21.15.44:0/3733653178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85e815d4e0 msgr2=0x7f85e80ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.399+0000 7f85eed05640 1 --2- 172.21.15.44:0/3733653178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85e815d4e0 0x7f85e80ce850 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f85d80097d0 tx=0x7f85d802b960 comp rx=0 tx=0).stop 2023-11-04T01:42:14.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.399+0000 7f85eed05640 1 -- 172.21.15.44:0/3733653178 shutdown_connections 2023-11-04T01:42:14.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.399+0000 7f85eed05640 1 --2- 172.21.15.44:0/3733653178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85e815d4e0 0x7f85e80ce850 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.399+0000 7f85eed05640 1 -- 172.21.15.44:0/3733653178 >> 172.21.15.44:0/3733653178 conn(0x7f85e80b1640 msgr2=0x7f85e80b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:14.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.399+0000 7f85eed05640 1 -- 172.21.15.44:0/3733653178 shutdown_connections 2023-11-04T01:42:14.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.399+0000 7f85eed05640 1 -- 172.21.15.44:0/3733653178 wait complete. 2023-11-04T01:42:14.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.400+0000 7f85eed05640 1 Processor -- start 2023-11-04T01:42:14.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.400+0000 7f85eed05640 1 -- start start 2023-11-04T01:42:14.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.401+0000 7f85eed05640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85e80ca8b0 0x7f85e80c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.401+0000 7f85eed05640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85e80ced90 0x7f85e80c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.401+0000 7f85eed05640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85e815d4e0 0x7f85e80c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.401+0000 7f85eed05640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80b32b0 con 0x7f85e80ca8b0 2023-11-04T01:42:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.401+0000 7f85eed05640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80b5650 con 0x7f85e815d4e0 2023-11-04T01:42:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.401+0000 7f85eed05640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80c73b0 con 0x7f85e80ced90 2023-11-04T01:42:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.401+0000 7f85ecaa1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85e80ca8b0 0x7f85e80c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.401+0000 7f85ecaa1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85e80ca8b0 0x7f85e80c46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45770/0 (socket says 172.21.15.44:45770) 2023-11-04T01:42:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.401+0000 7f85ecaa1640 1 -- 172.21.15.44:0/559169912 learned_addr learned my addr 172.21.15.44:0/559169912 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.402+0000 7f85e7fff640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85e80ced90 0x7f85e80c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.402+0000 7f85ed2a2640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85e815d4e0 0x7f85e80c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.402+0000 7f85ecaa1640 1 -- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85e80ced90 msgr2=0x7f85e80c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.402+0000 7f85ecaa1640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85e80ced90 0x7f85e80c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.402+0000 7f85ecaa1640 1 -- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85e815d4e0 msgr2=0x7f85e80c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.402+0000 7f85ecaa1640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85e815d4e0 0x7f85e80c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.402+0000 7f85ecaa1640 1 -- 172.21.15.44:0/559169912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d8009400 con 0x7f85e80ca8b0 2023-11-04T01:42:14.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.402+0000 7f85e7fff640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85e80ced90 0x7f85e80c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:14.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.402+0000 7f85ed2a2640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85e815d4e0 0x7f85e80c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:14.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.402+0000 7f85ecaa1640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85e80ca8b0 0x7f85e80c46d0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f85d802bf70 tx=0x7f85d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:14.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.402+0000 7f85e57fa640 1 -- 172.21.15.44:0/559169912 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d803e070 con 0x7f85e80ca8b0 2023-11-04T01:42:14.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.402+0000 7f85e57fa640 1 -- 172.21.15.44:0/559169912 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d8039990 con 0x7f85e80ca8b0 2023-11-04T01:42:14.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.402+0000 7f85eed05640 1 -- 172.21.15.44:0/559169912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e80c7690 con 0x7f85e80ca8b0 2023-11-04T01:42:14.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.402+0000 7f85e57fa640 1 -- 172.21.15.44:0/559169912 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8039d40 con 0x7f85e80ca8b0 2023-11-04T01:42:14.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.402+0000 7f85eed05640 1 -- 172.21.15.44:0/559169912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e8158710 con 0x7f85e80ca8b0 2023-11-04T01:42:14.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.403+0000 7f85eed05640 1 -- 172.21.15.44:0/559169912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e80b3460 con 0x7f85e80ca8b0 2023-11-04T01:42:14.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.404+0000 7f85e57fa640 1 -- 172.21.15.44:0/559169912 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f85d804b400 con 0x7f85e80ca8b0 2023-11-04T01:42:14.407 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.404+0000 7f85e57fa640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85d406ae70 0x7f85d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.404+0000 7f85e57fa640 1 -- 172.21.15.44:0/559169912 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f85d80ac230 con 0x7f85e80ca8b0 2023-11-04T01:42:14.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.404+0000 7f85e7fff640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85d406ae70 0x7f85d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.408 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.405+0000 7f85e7fff640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85d406ae70 0x7f85d406d330 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f85e815dd70 tx=0x7f85dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:14.410 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.409+0000 7f85e57fa640 1 -- 172.21.15.44:0/559169912 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f85e80b3460 con 0x7f85e80ca8b0 2023-11-04T01:42:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.623+0000 7f85eed05640 1 -- 172.21.15.44:0/559169912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85e80c7bb0 con 0x7f85e80ca8b0 2023-11-04T01:42:14.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.624+0000 7f85e57fa640 1 -- 172.21.15.44:0/559169912 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f85d8034090 con 0x7f85e80ca8b0 2023-11-04T01:42:14.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:14.626 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:06.864552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:14.626 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 93 2023-11-04T01:42:14.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.626+0000 7f85eed05640 1 -- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85d406ae70 msgr2=0x7f85d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.626+0000 7f85eed05640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85d406ae70 0x7f85d406d330 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f85e815dd70 tx=0x7f85dc009040 comp rx=0 tx=0).stop 2023-11-04T01:42:14.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.626+0000 7f85eed05640 1 -- 172.21.15.44:0/559169912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85e80ca8b0 msgr2=0x7f85e80c46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.626+0000 7f85eed05640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85e80ca8b0 0x7f85e80c46d0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f85d802bf70 tx=0x7f85d80046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.626+0000 7f85eed05640 1 -- 172.21.15.44:0/559169912 shutdown_connections 2023-11-04T01:42:14.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.626+0000 7f85eed05640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f85d406ae70 0x7f85d406d330 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.626+0000 7f85eed05640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85e815d4e0 0x7f85e80c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.626+0000 7f85eed05640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85e80ced90 0x7f85e80c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.626+0000 7f85eed05640 1 --2- 172.21.15.44:0/559169912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85e80ca8b0 0x7f85e80c46d0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.626+0000 7f85eed05640 1 -- 172.21.15.44:0/559169912 >> 172.21.15.44:0/559169912 conn(0x7f85e80b1640 msgr2=0x7f85e806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:14.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.626+0000 7f85eed05640 1 -- 172.21.15.44:0/559169912 shutdown_connections 2023-11-04T01:42:14.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:14.626+0000 7f85eed05640 1 -- 172.21.15.44:0/559169912 wait complete. 2023-11-04T01:42:14.638 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:42:15.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.757+0000 7f8e58a6f640 1 Processor -- start 2023-11-04T01:42:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.757+0000 7f8e58a6f640 1 -- start start 2023-11-04T01:42:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.758+0000 7f8e58a6f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8e5415d630 0x7f8e540cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.758+0000 7f8e58a6f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e540b0150 con 0x7f8e540ceda0 2023-11-04T01:42:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.758+0000 7f8e58a6f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e540b1170 con 0x7f8e540b2210 2023-11-04T01:42:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.758+0000 7f8e58a6f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e540b1df0 con 0x7f8e5415d630 2023-11-04T01:42:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.758+0000 7f8e5259c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8e540ceda0 0x7f8e5415cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51400/0 (socket says 172.21.15.44:51400) 2023-11-04T01:42:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.758+0000 7f8e5259c640 1 -- 172.21.15.44:0/1229957636 learned_addr learned my addr 172.21.15.44:0/1229957636 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.758+0000 7f8e52d9d640 1 --2- 172.21.15.44:0/1229957636 >> v2:172.21.15.204:3300/0 conn(0x7f8e5415d630 0x7f8e540cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.758+0000 7f8e5159a640 1 -- 172.21.15.44:0/1229957636 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592532593 0 0) 0x7f8e540b0150 con 0x7f8e540ceda0 2023-11-04T01:42:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5159a640 1 -- 172.21.15.44:0/1229957636 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e3c003520 con 0x7f8e540ceda0 2023-11-04T01:42:15.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5159a640 1 -- 172.21.15.44:0/1229957636 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3166437138 0 0) 0x7f8e3c003520 con 0x7f8e540ceda0 2023-11-04T01:42:15.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5159a640 1 -- 172.21.15.44:0/1229957636 >> v2:172.21.15.204:3300/0 conn(0x7f8e5415d630 msgr2=0x7f8e540cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5159a640 1 --2- 172.21.15.44:0/1229957636 >> v2:172.21.15.204:3300/0 conn(0x7f8e5415d630 0x7f8e540cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5159a640 1 -- 172.21.15.44:0/1229957636 >> v1:172.21.15.204:6789/0 conn(0x7f8e540b2210 legacy=0x7f8e540cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5159a640 1 -- 172.21.15.44:0/1229957636 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e540b1450 con 0x7f8e540ceda0 2023-11-04T01:42:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5159a640 1 -- 172.21.15.44:0/1229957636 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f8e44001810 con 0x7f8e540ceda0 2023-11-04T01:42:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5159a640 1 -- 172.21.15.44:0/1229957636 >> v1:172.21.15.44:6789/0 conn(0x7f8e540ceda0 legacy=0x7f8e5415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5159a640 1 --2- 172.21.15.44:0/1229957636 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3c003970 0x7f8e3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5159a640 1 --2- 172.21.15.44:0/1229957636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e3c0047c0 0x7f8e3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5159a640 1 --2- 172.21.15.44:0/1229957636 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e3c0052a0 0x7f8e3c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5159a640 1 -- 172.21.15.44:0/1229957636 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e540b1df0 con 0x7f8e3c0047c0 2023-11-04T01:42:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5159a640 1 -- 172.21.15.44:0/1229957636 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c00c170 con 0x7f8e3c0052a0 2023-11-04T01:42:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5159a640 1 -- 172.21.15.44:0/1229957636 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c00c330 con 0x7f8e3c003970 2023-11-04T01:42:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e51d9b640 1 --2- 172.21.15.44:0/1229957636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e3c0047c0 0x7f8e3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e52d9d640 1 --2- 172.21.15.44:0/1229957636 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e3c0052a0 0x7f8e3c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5259c640 1 --2- 172.21.15.44:0/1229957636 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3c003970 0x7f8e3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e51d9b640 1 -- 172.21.15.44:0/1229957636 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3c003970 msgr2=0x7f8e3c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e51d9b640 1 --2- 172.21.15.44:0/1229957636 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3c003970 0x7f8e3c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e51d9b640 1 -- 172.21.15.44:0/1229957636 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e3c0052a0 msgr2=0x7f8e3c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e51d9b640 1 --2- 172.21.15.44:0/1229957636 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e3c0052a0 0x7f8e3c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e51d9b640 1 -- 172.21.15.44:0/1229957636 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c003520 con 0x7f8e3c0047c0 2023-11-04T01:42:15.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e52d9d640 1 -- 172.21.15.44:0/1229957636 reap_dead start 2023-11-04T01:42:15.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.759+0000 7f8e5259c640 1 --2- 172.21.15.44:0/1229957636 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3c003970 0x7f8e3c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:15.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.760+0000 7f8e51d9b640 1 --2- 172.21.15.44:0/1229957636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e3c0047c0 0x7f8e3c004c40 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f8e48001720 tx=0x7f8e3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f02416d7e60522 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.760+0000 7f8e5159a640 1 -- 172.21.15.44:0/1229957636 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480052d0 con 0x7f8e3c0047c0 2023-11-04T01:42:15.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.760+0000 7f8e5159a640 1 -- 172.21.15.44:0/1229957636 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4802e050 con 0x7f8e3c0047c0 2023-11-04T01:42:15.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.760+0000 7f8e5159a640 1 -- 172.21.15.44:0/1229957636 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48003830 con 0x7f8e3c0047c0 2023-11-04T01:42:15.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.761+0000 7f8e58a6f640 1 -- 172.21.15.44:0/1229957636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e3c0047c0 msgr2=0x7f8e3c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.761+0000 7f8e58a6f640 1 --2- 172.21.15.44:0/1229957636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e3c0047c0 0x7f8e3c004c40 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f8e48001720 tx=0x7f8e3c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.761+0000 7f8e58a6f640 1 -- 172.21.15.44:0/1229957636 shutdown_connections 2023-11-04T01:42:15.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.761+0000 7f8e58a6f640 1 --2- 172.21.15.44:0/1229957636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e3c0047c0 0x7f8e3c004c40 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.761+0000 7f8e58a6f640 1 -- 172.21.15.44:0/1229957636 >> 172.21.15.44:0/1229957636 conn(0x7f8e540d0c30 msgr2=0x7f8e540d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.761+0000 7f8e58a6f640 1 -- 172.21.15.44:0/1229957636 shutdown_connections 2023-11-04T01:42:15.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.761+0000 7f8e58a6f640 1 -- 172.21.15.44:0/1229957636 wait complete. 2023-11-04T01:42:15.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.762+0000 7f8e58a6f640 1 Processor -- start 2023-11-04T01:42:15.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.762+0000 7f8e58a6f640 1 -- start start 2023-11-04T01:42:15.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.763+0000 7f8e58a6f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3c0047c0 0x7f8e54159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.763+0000 7f8e58a6f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e540c7de0 0x7f8e54158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.763+0000 7f8e58a6f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e540ca550 0x7f8e540cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.763+0000 7f8e58a6f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5415a8f0 con 0x7f8e540ca550 2023-11-04T01:42:15.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.763+0000 7f8e58a6f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e540ca0c0 con 0x7f8e540c7de0 2023-11-04T01:42:15.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.763+0000 7f8e58a6f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e540c8260 con 0x7f8e3c0047c0 2023-11-04T01:42:15.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.763+0000 7f8e52d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e540ca550 0x7f8e540cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.763+0000 7f8e52d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e540ca550 0x7f8e540cb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45792/0 (socket says 172.21.15.44:45792) 2023-11-04T01:42:15.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.763+0000 7f8e52d9d640 1 -- 172.21.15.44:0/2748710735 learned_addr learned my addr 172.21.15.44:0/2748710735 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:15.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.763+0000 7f8e5259c640 1 --2- 172.21.15.44:0/2748710735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3c0047c0 0x7f8e54159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.763+0000 7f8e51d9b640 1 --2- 172.21.15.44:0/2748710735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e540c7de0 0x7f8e54158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.764+0000 7f8e52d9d640 1 -- 172.21.15.44:0/2748710735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3c0047c0 msgr2=0x7f8e54159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.764+0000 7f8e52d9d640 1 --2- 172.21.15.44:0/2748710735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3c0047c0 0x7f8e54159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.764+0000 7f8e52d9d640 1 -- 172.21.15.44:0/2748710735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e540c7de0 msgr2=0x7f8e54158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.764+0000 7f8e52d9d640 1 --2- 172.21.15.44:0/2748710735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e540c7de0 0x7f8e54158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.764+0000 7f8e52d9d640 1 -- 172.21.15.44:0/2748710735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e540c97d0 con 0x7f8e540ca550 2023-11-04T01:42:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.764+0000 7f8e51d9b640 1 --2- 172.21.15.44:0/2748710735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e540c7de0 0x7f8e54158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.764+0000 7f8e52d9d640 1 --2- 172.21.15.44:0/2748710735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e540ca550 0x7f8e540cb450 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f8e5415daa0 tx=0x7f8e4c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.764+0000 7f8e42ffd640 1 -- 172.21.15.44:0/2748710735 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00e040 con 0x7f8e540ca550 2023-11-04T01:42:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.764+0000 7f8e42ffd640 1 -- 172.21.15.44:0/2748710735 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c00f040 con 0x7f8e540ca550 2023-11-04T01:42:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.764+0000 7f8e42ffd640 1 -- 172.21.15.44:0/2748710735 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c015430 con 0x7f8e540ca550 2023-11-04T01:42:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.764+0000 7f8e58a6f640 1 -- 172.21.15.44:0/2748710735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5415a610 con 0x7f8e540ca550 2023-11-04T01:42:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.764+0000 7f8e58a6f640 1 -- 172.21.15.44:0/2748710735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e540c9d50 con 0x7f8e540ca550 2023-11-04T01:42:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.765+0000 7f8e58a6f640 1 -- 172.21.15.44:0/2748710735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e540684b0 con 0x7f8e540ca550 2023-11-04T01:42:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.766+0000 7f8e42ffd640 1 -- 172.21.15.44:0/2748710735 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e4c015590 con 0x7f8e540ca550 2023-11-04T01:42:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.766+0000 7f8e42ffd640 1 --2- 172.21.15.44:0/2748710735 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8e3406aea0 0x7f8e3406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.766+0000 7f8e42ffd640 1 -- 172.21.15.44:0/2748710735 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f8e4c08a570 con 0x7f8e540ca550 2023-11-04T01:42:15.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.766+0000 7f8e5259c640 1 --2- 172.21.15.44:0/2748710735 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8e3406aea0 0x7f8e3406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.767+0000 7f8e5259c640 1 --2- 172.21.15.44:0/2748710735 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8e3406aea0 0x7f8e3406d360 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8e44000ef0 tx=0x7f8e44009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.771+0000 7f8e42ffd640 1 -- 172.21.15.44:0/2748710735 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8e4c054e40 con 0x7f8e540ca550 2023-11-04T01:42:15.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.985+0000 7f8e58a6f640 1 -- 172.21.15.44:0/2748710735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e540ca200 con 0x7f8e540ca550 2023-11-04T01:42:15.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.986+0000 7f8e42ffd640 1 -- 172.21.15.44:0/2748710735 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f8e4c058460 con 0x7f8e540ca550 2023-11-04T01:42:15.988 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:15.988 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:14.253217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:rejoin","state_seq":12,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:15.988 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 94 2023-11-04T01:42:15.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.988+0000 7f8e58a6f640 1 -- 172.21.15.44:0/2748710735 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8e3406aea0 msgr2=0x7f8e3406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.988+0000 7f8e58a6f640 1 --2- 172.21.15.44:0/2748710735 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8e3406aea0 0x7f8e3406d360 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8e44000ef0 tx=0x7f8e44009040 comp rx=0 tx=0).stop 2023-11-04T01:42:15.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.988+0000 7f8e58a6f640 1 -- 172.21.15.44:0/2748710735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e540ca550 msgr2=0x7f8e540cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.988+0000 7f8e58a6f640 1 --2- 172.21.15.44:0/2748710735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e540ca550 0x7f8e540cb450 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f8e5415daa0 tx=0x7f8e4c00f580 comp rx=0 tx=0).stop 2023-11-04T01:42:15.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.988+0000 7f8e58a6f640 1 -- 172.21.15.44:0/2748710735 shutdown_connections 2023-11-04T01:42:15.990 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.988+0000 7f8e58a6f640 1 --2- 172.21.15.44:0/2748710735 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8e3406aea0 0x7f8e3406d360 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.988+0000 7f8e58a6f640 1 --2- 172.21.15.44:0/2748710735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e540ca550 0x7f8e540cb450 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.988+0000 7f8e58a6f640 1 --2- 172.21.15.44:0/2748710735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e540c7de0 0x7f8e54158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.988+0000 7f8e58a6f640 1 --2- 172.21.15.44:0/2748710735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3c0047c0 0x7f8e54159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.988+0000 7f8e58a6f640 1 -- 172.21.15.44:0/2748710735 >> 172.21.15.44:0/2748710735 conn(0x7f8e540d0c30 msgr2=0x7f8e5415c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.988+0000 7f8e58a6f640 1 -- 172.21.15.44:0/2748710735 shutdown_connections 2023-11-04T01:42:15.991 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:15.988+0000 7f8e58a6f640 1 -- 172.21.15.44:0/2748710735 wait complete. 2023-11-04T01:42:16.000 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:rejoin 2023-11-04T01:42:17.002 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:17.030 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:42:17.028+0000 7f177aa7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:17.030 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:42:17.028+0000 7f177aa7c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:42:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.121+0000 7f53d1890640 1 Processor -- start 2023-11-04T01:42:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.122+0000 7f53d1890640 1 -- start start 2023-11-04T01:42:17.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.122+0000 7f53d1890640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f53cc0ceda0 0x7f53cc15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.122+0000 7f53d1890640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f53cc0b2210 0x7f53cc15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.122+0000 7f53d1890640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53cc0cf180 0x7f53cc0cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.122+0000 7f53d1890640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53cc0b1df0 con 0x7f53cc0ceda0 2023-11-04T01:42:17.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.122+0000 7f53d1890640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53cc15d9a0 con 0x7f53cc0b2210 2023-11-04T01:42:17.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.122+0000 7f53d1890640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0b0150 con 0x7f53cc0cf180 2023-11-04T01:42:17.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.122+0000 7f53caffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f53cc0ceda0 0x7f53cc15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.123+0000 7f53caffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f53cc0ceda0 0x7f53cc15cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45798/0 (socket says 172.21.15.44:45798) 2023-11-04T01:42:17.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.123+0000 7f53caffd640 1 -- 172.21.15.44:0/504883174 learned_addr learned my addr 172.21.15.44:0/504883174 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:17.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.123+0000 7f53cb7fe640 1 --2- 172.21.15.44:0/504883174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53cc0cf180 0x7f53cc0cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.123+0000 7f53ca7fc640 1 --2- 172.21.15.44:0/504883174 >> v2:172.21.15.204:3300/0 conn(0x7f53cc0b2210 0x7f53cc15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.123+0000 7f53caffd640 1 -- 172.21.15.44:0/504883174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53cc0cf180 msgr2=0x7f53cc0cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.123+0000 7f53caffd640 1 --2- 172.21.15.44:0/504883174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53cc0cf180 0x7f53cc0cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.123+0000 7f53caffd640 1 -- 172.21.15.44:0/504883174 >> v2:172.21.15.204:3300/0 conn(0x7f53cc0b2210 msgr2=0x7f53cc15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.123+0000 7f53caffd640 1 --2- 172.21.15.44:0/504883174 >> v2:172.21.15.204:3300/0 conn(0x7f53cc0b2210 0x7f53cc15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.123+0000 7f53caffd640 1 -- 172.21.15.44:0/504883174 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc0b1170 con 0x7f53cc0ceda0 2023-11-04T01:42:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.124+0000 7f53caffd640 1 --2- 172.21.15.44:0/504883174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc0ceda0 0x7f53cc15cf20 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0b3770 tx=0x7f53bc02be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79673359671d6925 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.124+0000 7f53c9ffb640 1 -- 172.21.15.44:0/504883174 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc02ca30 con 0x7f53cc0ceda0 2023-11-04T01:42:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.124+0000 7f53c9ffb640 1 -- 172.21.15.44:0/504883174 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc02cb90 con 0x7f53cc0ceda0 2023-11-04T01:42:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.124+0000 7f53c9ffb640 1 -- 172.21.15.44:0/504883174 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc0343f0 con 0x7f53cc0ceda0 2023-11-04T01:42:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.124+0000 7f53d1890640 1 -- 172.21.15.44:0/504883174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc0ceda0 msgr2=0x7f53cc15cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.124+0000 7f53d1890640 1 --2- 172.21.15.44:0/504883174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc0ceda0 0x7f53cc15cf20 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0b3770 tx=0x7f53bc02be90 comp rx=0 tx=0).stop 2023-11-04T01:42:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.124+0000 7f53d1890640 1 -- 172.21.15.44:0/504883174 shutdown_connections 2023-11-04T01:42:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.124+0000 7f53d1890640 1 --2- 172.21.15.44:0/504883174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53cc0cf180 0x7f53cc0cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.124+0000 7f53d1890640 1 --2- 172.21.15.44:0/504883174 >> v2:172.21.15.204:3300/0 conn(0x7f53cc0b2210 0x7f53cc15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.124+0000 7f53d1890640 1 --2- 172.21.15.44:0/504883174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc0ceda0 0x7f53cc15cf20 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.124+0000 7f53d1890640 1 -- 172.21.15.44:0/504883174 >> 172.21.15.44:0/504883174 conn(0x7f53cc0d0c30 msgr2=0x7f53cc0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.124+0000 7f53d1890640 1 -- 172.21.15.44:0/504883174 shutdown_connections 2023-11-04T01:42:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.124+0000 7f53d1890640 1 -- 172.21.15.44:0/504883174 wait complete. 2023-11-04T01:42:17.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.126+0000 7f53d1890640 1 Processor -- start 2023-11-04T01:42:17.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.126+0000 7f53d1890640 1 -- start start 2023-11-04T01:42:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53d1890640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53cc0b2210 0x7f53cc0adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53d1890640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53cc0ceda0 0x7f53cc159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53d1890640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc0cf180 0x7f53cc157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53d1890640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc1f6020 con 0x7f53cc0cf180 2023-11-04T01:42:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53d1890640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc1f62c0 con 0x7f53cc0b2210 2023-11-04T01:42:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53d1890640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc1f65a0 con 0x7f53cc0ceda0 2023-11-04T01:42:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53cb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc0cf180 0x7f53cc157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53cb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc0cf180 0x7f53cc157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45810/0 (socket says 172.21.15.44:45810) 2023-11-04T01:42:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53cb7fe640 1 -- 172.21.15.44:0/3876353591 learned_addr learned my addr 172.21.15.44:0/3876353591 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53caffd640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53cc0b2210 0x7f53cc0adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53ca7fc640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53cc0ceda0 0x7f53cc159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53cb7fe640 1 -- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53cc0ceda0 msgr2=0x7f53cc159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53cb7fe640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53cc0ceda0 0x7f53cc159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53cb7fe640 1 -- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53cc0b2210 msgr2=0x7f53cc0adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53cb7fe640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53cc0b2210 0x7f53cc0adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53cb7fe640 1 -- 172.21.15.44:0/3876353591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc009b30 con 0x7f53cc0cf180 2023-11-04T01:42:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53caffd640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53cc0b2210 0x7f53cc0adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53ca7fc640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53cc0ceda0 0x7f53cc159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53cb7fe640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc0cf180 0x7f53cc157da0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f53c400d800 tx=0x7f53c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53c3fff640 1 -- 172.21.15.44:0/3876353591 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c400b6c0 con 0x7f53cc0cf180 2023-11-04T01:42:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53c3fff640 1 -- 172.21.15.44:0/3876353591 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c400b840 con 0x7f53cc0cf180 2023-11-04T01:42:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53d1890640 1 -- 172.21.15.44:0/3876353591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc1f6880 con 0x7f53cc0cf180 2023-11-04T01:42:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.127+0000 7f53c3fff640 1 -- 172.21.15.44:0/3876353591 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c400bbf0 con 0x7f53cc0cf180 2023-11-04T01:42:17.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.128+0000 7f53d1890640 1 -- 172.21.15.44:0/3876353591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53cc15a720 con 0x7f53cc0cf180 2023-11-04T01:42:17.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.128+0000 7f53d1890640 1 -- 172.21.15.44:0/3876353591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53cc1f6da0 con 0x7f53cc0cf180 2023-11-04T01:42:17.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.129+0000 7f53c3fff640 1 -- 172.21.15.44:0/3876353591 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53c400bd50 con 0x7f53cc0cf180 2023-11-04T01:42:17.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.129+0000 7f53c3fff640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53ac06ae70 0x7f53ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.130+0000 7f53c3fff640 1 -- 172.21.15.44:0/3876353591 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f53c408a370 con 0x7f53cc0cf180 2023-11-04T01:42:17.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.130+0000 7f53caffd640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53ac06ae70 0x7f53ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.130+0000 7f53caffd640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53ac06ae70 0x7f53ac06d330 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f53bc035000 tx=0x7f53bc030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.134+0000 7f53c3fff640 1 -- 172.21.15.44:0/3876353591 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53cc1f6da0 con 0x7f53cc0cf180 2023-11-04T01:42:17.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.348+0000 7f53d1890640 1 -- 172.21.15.44:0/3876353591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53cc1f6da0 con 0x7f53cc0cf180 2023-11-04T01:42:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.349+0000 7f53c3fff640 1 -- 172.21.15.44:0/3876353591 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f53cc1f6da0 con 0x7f53cc0cf180 2023-11-04T01:42:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:17.351 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:15.256705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:active","state_seq":7,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 95 2023-11-04T01:42:17.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.351+0000 7f53d1890640 1 -- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53ac06ae70 msgr2=0x7f53ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.353 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.351+0000 7f53d1890640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53ac06ae70 0x7f53ac06d330 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f53bc035000 tx=0x7f53bc030000 comp rx=0 tx=0).stop 2023-11-04T01:42:17.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.351+0000 7f53d1890640 1 -- 172.21.15.44:0/3876353591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc0cf180 msgr2=0x7f53cc157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.351+0000 7f53d1890640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc0cf180 0x7f53cc157da0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f53c400d800 tx=0x7f53c400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.351+0000 7f53d1890640 1 -- 172.21.15.44:0/3876353591 shutdown_connections 2023-11-04T01:42:17.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.351+0000 7f53d1890640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f53ac06ae70 0x7f53ac06d330 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.351+0000 7f53d1890640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc0cf180 0x7f53cc157da0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.351+0000 7f53d1890640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53cc0ceda0 0x7f53cc159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.351+0000 7f53d1890640 1 --2- 172.21.15.44:0/3876353591 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53cc0b2210 0x7f53cc0adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.351+0000 7f53d1890640 1 -- 172.21.15.44:0/3876353591 >> 172.21.15.44:0/3876353591 conn(0x7f53cc0d0c30 msgr2=0x7f53cc0aea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:17.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.351+0000 7f53d1890640 1 -- 172.21.15.44:0/3876353591 shutdown_connections 2023-11-04T01:42:17.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.351+0000 7f53d1890640 1 -- 172.21.15.44:0/3876353591 wait complete. 2023-11-04T01:42:17.364 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:42:17.364 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.79390549659729s 2023-11-04T01:42:17.364 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:17.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.508+0000 7f4470f00640 1 Processor -- start 2023-11-04T01:42:17.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.509+0000 7f4470f00640 1 -- start start 2023-11-04T01:42:17.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.509+0000 7f4470f00640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f446c0cd9c0 0x7f446c165e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f4470f00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c0cf240 con 0x7f446c15b200 2023-11-04T01:42:17.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f4470f00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c0cde80 con 0x7f446c0afda0 2023-11-04T01:42:17.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f4470f00640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c0cf670 con 0x7f446c0cd9c0 2023-11-04T01:42:17.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446a59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f446c15b200 0x7f446c0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51404/0 (socket says 172.21.15.44:51404) 2023-11-04T01:42:17.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446a59c640 1 -- 172.21.15.44:0/83484819 learned_addr learned my addr 172.21.15.44:0/83484819 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:17.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446ad9d640 1 --2- 172.21.15.44:0/83484819 >> v2:172.21.15.204:3300/0 conn(0x7f446c0cd9c0 0x7f446c165e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446959a640 1 -- 172.21.15.44:0/83484819 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090920785 0 0) 0x7f4464001290 con 0x7f446c15b200 2023-11-04T01:42:17.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446959a640 1 -- 172.21.15.44:0/83484819 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4458003520 con 0x7f446c15b200 2023-11-04T01:42:17.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446959a640 1 -- 172.21.15.44:0/83484819 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2290414533 0 0) 0x7f4458003520 con 0x7f446c15b200 2023-11-04T01:42:17.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446959a640 1 -- 172.21.15.44:0/83484819 >> v2:172.21.15.204:3300/0 conn(0x7f446c0cd9c0 msgr2=0x7f446c165e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:17.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446959a640 1 --2- 172.21.15.44:0/83484819 >> v2:172.21.15.204:3300/0 conn(0x7f446c0cd9c0 0x7f446c165e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446959a640 1 -- 172.21.15.44:0/83484819 >> v1:172.21.15.204:6789/0 conn(0x7f446c0afda0 legacy=0x7f446c0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446959a640 1 -- 172.21.15.44:0/83484819 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0cf950 con 0x7f446c15b200 2023-11-04T01:42:17.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446959a640 1 -- 172.21.15.44:0/83484819 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f4464001980 con 0x7f446c15b200 2023-11-04T01:42:17.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446959a640 1 -- 172.21.15.44:0/83484819 >> v1:172.21.15.44:6789/0 conn(0x7f446c15b200 legacy=0x7f446c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446959a640 1 --2- 172.21.15.44:0/83484819 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4458003970 0x7f4458003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446959a640 1 --2- 172.21.15.44:0/83484819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44580047c0 0x7f4458004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446959a640 1 --2- 172.21.15.44:0/83484819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4458005180 0x7f445800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446959a640 1 -- 172.21.15.44:0/83484819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0cf670 con 0x7f44580047c0 2023-11-04T01:42:17.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446959a640 1 -- 172.21.15.44:0/83484819 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445800c120 con 0x7f4458003970 2023-11-04T01:42:17.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.510+0000 7f446959a640 1 -- 172.21.15.44:0/83484819 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445800c2e0 con 0x7f4458005180 2023-11-04T01:42:17.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.511+0000 7f4469d9b640 1 --2- 172.21.15.44:0/83484819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44580047c0 0x7f4458004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.511+0000 7f446a59c640 1 --2- 172.21.15.44:0/83484819 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4458003970 0x7f4458003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.511+0000 7f446ad9d640 1 --2- 172.21.15.44:0/83484819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4458005180 0x7f445800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.511+0000 7f4469d9b640 1 -- 172.21.15.44:0/83484819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4458005180 msgr2=0x7f445800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:17.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.511+0000 7f4469d9b640 1 --2- 172.21.15.44:0/83484819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4458005180 0x7f445800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.511+0000 7f4469d9b640 1 -- 172.21.15.44:0/83484819 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4458003970 msgr2=0x7f4458003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:17.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.511+0000 7f4469d9b640 1 --2- 172.21.15.44:0/83484819 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4458003970 0x7f4458003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.511+0000 7f4469d9b640 1 -- 172.21.15.44:0/83484819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4458003520 con 0x7f44580047c0 2023-11-04T01:42:17.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.511+0000 7f446ad9d640 1 --2- 172.21.15.44:0/83484819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4458005180 0x7f445800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:17.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.511+0000 7f446ad9d640 1 -- 172.21.15.44:0/83484819 reap_dead start 2023-11-04T01:42:17.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.512+0000 7f4469d9b640 1 --2- 172.21.15.44:0/83484819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44580047c0 0x7f4458004c40 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f4454001750 tx=0x7f44580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfeb85199f34b0a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.512+0000 7f446959a640 1 -- 172.21.15.44:0/83484819 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44540052d0 con 0x7f44580047c0 2023-11-04T01:42:17.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.512+0000 7f446959a640 1 -- 172.21.15.44:0/83484819 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445402e050 con 0x7f44580047c0 2023-11-04T01:42:17.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.512+0000 7f446959a640 1 -- 172.21.15.44:0/83484819 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4454003830 con 0x7f44580047c0 2023-11-04T01:42:17.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.512+0000 7f4470f00640 1 -- 172.21.15.44:0/83484819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44580047c0 msgr2=0x7f4458004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.512+0000 7f4470f00640 1 --2- 172.21.15.44:0/83484819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44580047c0 0x7f4458004c40 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f4454001750 tx=0x7f44580057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.512+0000 7f4470f00640 1 -- 172.21.15.44:0/83484819 shutdown_connections 2023-11-04T01:42:17.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.512+0000 7f4470f00640 1 --2- 172.21.15.44:0/83484819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44580047c0 0x7f4458004c40 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.512+0000 7f4470f00640 1 -- 172.21.15.44:0/83484819 >> 172.21.15.44:0/83484819 conn(0x7f446c0d0c30 msgr2=0x7f446c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:17.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.512+0000 7f4470f00640 1 -- 172.21.15.44:0/83484819 shutdown_connections 2023-11-04T01:42:17.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.512+0000 7f4470f00640 1 -- 172.21.15.44:0/83484819 wait complete. 2023-11-04T01:42:17.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.514+0000 7f4470f00640 1 Processor -- start 2023-11-04T01:42:17.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.514+0000 7f4470f00640 1 -- start start 2023-11-04T01:42:17.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.514+0000 7f4470f00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44580047c0 0x7f446c0b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.514+0000 7f4470f00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f446c1f1330 0x7f446c0b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.514+0000 7f4470f00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f446c150350 0x7f446c0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.514+0000 7f4470f00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0b3d30 con 0x7f446c150350 2023-11-04T01:42:17.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.514+0000 7f4470f00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0b4f50 con 0x7f446c1f1330 2023-11-04T01:42:17.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.514+0000 7f4470f00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c1f18a0 con 0x7f44580047c0 2023-11-04T01:42:17.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f446ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f446c150350 0x7f446c0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f446ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f446c150350 0x7f446c0b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45830/0 (socket says 172.21.15.44:45830) 2023-11-04T01:42:17.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f446ad9d640 1 -- 172.21.15.44:0/1547581503 learned_addr learned my addr 172.21.15.44:0/1547581503 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:17.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f446a59c640 1 --2- 172.21.15.44:0/1547581503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44580047c0 0x7f446c0b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f4469d9b640 1 --2- 172.21.15.44:0/1547581503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f446c1f1330 0x7f446c0b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f446ad9d640 1 -- 172.21.15.44:0/1547581503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44580047c0 msgr2=0x7f446c0b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f446ad9d640 1 --2- 172.21.15.44:0/1547581503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44580047c0 0x7f446c0b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f446ad9d640 1 -- 172.21.15.44:0/1547581503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f446c1f1330 msgr2=0x7f446c0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f446ad9d640 1 --2- 172.21.15.44:0/1547581503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f446c1f1330 0x7f446c0b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f446ad9d640 1 -- 172.21.15.44:0/1547581503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0b56d0 con 0x7f446c150350 2023-11-04T01:42:17.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f446ad9d640 1 --2- 172.21.15.44:0/1547581503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f446c150350 0x7f446c0b45d0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f446c0b25d0 tx=0x7f445c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f4462ffd640 1 -- 172.21.15.44:0/1547581503 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c00e050 con 0x7f446c150350 2023-11-04T01:42:17.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f4462ffd640 1 -- 172.21.15.44:0/1547581503 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c00f040 con 0x7f446c150350 2023-11-04T01:42:17.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f4470f00640 1 -- 172.21.15.44:0/1547581503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c0b59b0 con 0x7f446c150350 2023-11-04T01:42:17.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f4462ffd640 1 -- 172.21.15.44:0/1547581503 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c003bd0 con 0x7f446c150350 2023-11-04T01:42:17.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.515+0000 7f4470f00640 1 -- 172.21.15.44:0/1547581503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c0b5f70 con 0x7f446c150350 2023-11-04T01:42:17.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.516+0000 7f4470f00640 1 -- 172.21.15.44:0/1547581503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c0b6190 con 0x7f446c150350 2023-11-04T01:42:17.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.517+0000 7f4462ffd640 1 -- 172.21.15.44:0/1547581503 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f445c003d30 con 0x7f446c150350 2023-11-04T01:42:17.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.517+0000 7f4462ffd640 1 --2- 172.21.15.44:0/1547581503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f444c06ae70 0x7f444c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.517+0000 7f4462ffd640 1 -- 172.21.15.44:0/1547581503 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f445c08a2e0 con 0x7f446c150350 2023-11-04T01:42:17.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.518+0000 7f446a59c640 1 --2- 172.21.15.44:0/1547581503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f444c06ae70 0x7f444c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.518+0000 7f446a59c640 1 --2- 172.21.15.44:0/1547581503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f444c06ae70 0x7f444c06d330 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f44640013f0 tx=0x7f4464001340 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.522+0000 7f4462ffd640 1 -- 172.21.15.44:0/1547581503 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f445c054c60 con 0x7f446c150350 2023-11-04T01:42:17.737 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.735+0000 7f4470f00640 1 -- 172.21.15.44:0/1547581503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f446c0684b0 con 0x7f446c150350 2023-11-04T01:42:17.738 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.735+0000 7f4462ffd640 1 -- 172.21.15.44:0/1547581503 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f445c058280 con 0x7f446c150350 2023-11-04T01:42:17.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:17.738 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:15.256705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:active","state_seq":7,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:17.738 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 95 2023-11-04T01:42:17.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.737+0000 7f4470f00640 1 -- 172.21.15.44:0/1547581503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f444c06ae70 msgr2=0x7f444c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.737+0000 7f4470f00640 1 --2- 172.21.15.44:0/1547581503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f444c06ae70 0x7f444c06d330 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f44640013f0 tx=0x7f4464001340 comp rx=0 tx=0).stop 2023-11-04T01:42:17.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.737+0000 7f4470f00640 1 -- 172.21.15.44:0/1547581503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f446c150350 msgr2=0x7f446c0b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.737+0000 7f4470f00640 1 --2- 172.21.15.44:0/1547581503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f446c150350 0x7f446c0b45d0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f446c0b25d0 tx=0x7f445c010590 comp rx=0 tx=0).stop 2023-11-04T01:42:17.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.737+0000 7f4470f00640 1 -- 172.21.15.44:0/1547581503 shutdown_connections 2023-11-04T01:42:17.739 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.737+0000 7f4470f00640 1 --2- 172.21.15.44:0/1547581503 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f444c06ae70 0x7f444c06d330 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.737+0000 7f4470f00640 1 --2- 172.21.15.44:0/1547581503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f446c150350 0x7f446c0b45d0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.737+0000 7f4470f00640 1 --2- 172.21.15.44:0/1547581503 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f446c1f1330 0x7f446c0b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.737+0000 7f4470f00640 1 --2- 172.21.15.44:0/1547581503 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44580047c0 0x7f446c0b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.737+0000 7f4470f00640 1 -- 172.21.15.44:0/1547581503 >> 172.21.15.44:0/1547581503 conn(0x7f446c0d0c30 msgr2=0x7f446c0cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:17.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.737+0000 7f4470f00640 1 -- 172.21.15.44:0/1547581503 shutdown_connections 2023-11-04T01:42:17.740 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.737+0000 7f4470f00640 1 -- 172.21.15.44:0/1547581503 wait complete. 2023-11-04T01:42:17.750 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:42:17.869 INFO:teuthology.orchestra.run.smithi044.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"17":[2,3,4,5,6,7,8,9]},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:42:17.870 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": { "17": [ 2, 3, 4, 5, 6, 7, 8, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:42:17.870 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:42:17.870 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:17.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.975+0000 7f019d683640 1 Processor -- start 2023-11-04T01:42:17.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.975+0000 7f019d683640 1 -- start start 2023-11-04T01:42:17.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.975+0000 7f019d683640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f01980ade00 0x7f01980b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.975+0000 7f019d683640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f019806c5f0 0x7f01980cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.975+0000 7f019d683640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019806cc90 con 0x7f019806d9c0 2023-11-04T01:42:17.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.975+0000 7f019d683640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01980b0e60 con 0x7f01980ade00 2023-11-04T01:42:17.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.975+0000 7f019d683640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019806cee0 con 0x7f019806c5f0 2023-11-04T01:42:17.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.976+0000 7f0196ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f01980ade00 0x7f01980b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.976+0000 7f0196ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f01980ade00 0x7f01980b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:52130/0 (socket says 172.21.15.44:52130) 2023-11-04T01:42:17.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.976+0000 7f0196ffd640 1 -- 172.21.15.44:0/3716004623 learned_addr learned my addr 172.21.15.44:0/3716004623 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:17.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.976+0000 7f01977fe640 1 --2- 172.21.15.44:0/3716004623 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f019806c5f0 0x7f01980cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.976+0000 7f01967fc640 1 --1- 172.21.15.44:0/3716004623 >> v1:172.21.15.204:6789/0 conn(0x7f019806d9c0 0x7f01980710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:59500/0 (socket says 172.21.15.44:59500) 2023-11-04T01:42:17.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.976+0000 7f0196ffd640 1 -- 172.21.15.44:0/3716004623 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f019806c5f0 msgr2=0x7f01980cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:17.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.976+0000 7f0196ffd640 1 --2- 172.21.15.44:0/3716004623 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f019806c5f0 0x7f01980cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.976+0000 7f0196ffd640 1 -- 172.21.15.44:0/3716004623 >> v1:172.21.15.204:6789/0 conn(0x7f019806d9c0 legacy=0x7f01980710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.976+0000 7f0196ffd640 1 -- 172.21.15.44:0/3716004623 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019806d1c0 con 0x7f01980ade00 2023-11-04T01:42:17.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.977+0000 7f0196ffd640 1 --2- 172.21.15.44:0/3716004623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01980ade00 0x7f01980b0530 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0188009870 tx=0x7f018802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=423cd441c63429f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.977+0000 7f0195ffb640 1 -- 172.21.15.44:0/3716004623 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01880317c0 con 0x7f01980ade00 2023-11-04T01:42:17.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.977+0000 7f0195ffb640 1 -- 172.21.15.44:0/3716004623 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0188031920 con 0x7f01980ade00 2023-11-04T01:42:17.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.977+0000 7f0195ffb640 1 -- 172.21.15.44:0/3716004623 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188031cb0 con 0x7f01980ade00 2023-11-04T01:42:17.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.978+0000 7f019d683640 1 -- 172.21.15.44:0/3716004623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01980ade00 msgr2=0x7f01980b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.978+0000 7f019d683640 1 --2- 172.21.15.44:0/3716004623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01980ade00 0x7f01980b0530 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0188009870 tx=0x7f018802b860 comp rx=0 tx=0).stop 2023-11-04T01:42:17.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.978+0000 7f019d683640 1 -- 172.21.15.44:0/3716004623 shutdown_connections 2023-11-04T01:42:17.981 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.978+0000 7f019d683640 1 --2- 172.21.15.44:0/3716004623 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f019806c5f0 0x7f01980cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.978+0000 7f019d683640 1 --2- 172.21.15.44:0/3716004623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01980ade00 0x7f01980b0530 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.978+0000 7f019d683640 1 -- 172.21.15.44:0/3716004623 >> 172.21.15.44:0/3716004623 conn(0x7f01980cb530 msgr2=0x7f01980cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:17.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.978+0000 7f019d683640 1 -- 172.21.15.44:0/3716004623 shutdown_connections 2023-11-04T01:42:17.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.978+0000 7f019d683640 1 -- 172.21.15.44:0/3716004623 wait complete. 2023-11-04T01:42:17.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.979+0000 7f019d683640 1 Processor -- start 2023-11-04T01:42:17.982 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.979+0000 7f019d683640 1 -- start start 2023-11-04T01:42:17.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f019d683640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f019806c5f0 0x7f01981f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f019d683640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f019806d9c0 0x7f0198157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f019d683640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01980ade00 0x7f01981efcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f019d683640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0198157980 con 0x7f019806d9c0 2023-11-04T01:42:17.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f019d683640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01981f01f0 con 0x7f019806c5f0 2023-11-04T01:42:17.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f019d683640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0198155b10 con 0x7f01980ade00 2023-11-04T01:42:17.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f01967fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f019806d9c0 0x7f0198157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f01967fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f019806d9c0 0x7f0198157440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45836/0 (socket says 172.21.15.44:45836) 2023-11-04T01:42:17.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f01967fc640 1 -- 172.21.15.44:0/372227670 learned_addr learned my addr 172.21.15.44:0/372227670 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:17.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f0196ffd640 1 --2- 172.21.15.44:0/372227670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f019806c5f0 0x7f01981f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f01977fe640 1 --2- 172.21.15.44:0/372227670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01980ade00 0x7f01981efcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f01967fc640 1 -- 172.21.15.44:0/372227670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01980ade00 msgr2=0x7f01981efcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f01967fc640 1 --2- 172.21.15.44:0/372227670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01980ade00 0x7f01981efcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f01967fc640 1 -- 172.21.15.44:0/372227670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f019806c5f0 msgr2=0x7f01981f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f01967fc640 1 --2- 172.21.15.44:0/372227670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f019806c5f0 0x7f01981f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f01967fc640 1 -- 172.21.15.44:0/372227670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880094d0 con 0x7f019806d9c0 2023-11-04T01:42:17.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f01977fe640 1 --2- 172.21.15.44:0/372227670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01980ade00 0x7f01981efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:17.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.980+0000 7f01967fc640 1 --2- 172.21.15.44:0/372227670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f019806d9c0 0x7f0198157440 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f018c00c390 tx=0x7f018c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.981+0000 7f017f7fe640 1 -- 172.21.15.44:0/372227670 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0074e0 con 0x7f019806d9c0 2023-11-04T01:42:17.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.981+0000 7f017f7fe640 1 -- 172.21.15.44:0/372227670 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c007660 con 0x7f019806d9c0 2023-11-04T01:42:17.986 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.981+0000 7f019d683640 1 -- 172.21.15.44:0/372227670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0198155df0 con 0x7f019806d9c0 2023-11-04T01:42:17.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.981+0000 7f017f7fe640 1 -- 172.21.15.44:0/372227670 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c004a20 con 0x7f019806d9c0 2023-11-04T01:42:17.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.981+0000 7f019d683640 1 -- 172.21.15.44:0/372227670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0198158300 con 0x7f019806d9c0 2023-11-04T01:42:17.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.982+0000 7f019d683640 1 -- 172.21.15.44:0/372227670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01980684b0 con 0x7f019806d9c0 2023-11-04T01:42:17.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.982+0000 7f017f7fe640 1 -- 172.21.15.44:0/372227670 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f018c004b80 con 0x7f019806d9c0 2023-11-04T01:42:17.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.983+0000 7f017f7fe640 1 --2- 172.21.15.44:0/372227670 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f018406ae70 0x7f018406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.983+0000 7f017f7fe640 1 -- 172.21.15.44:0/372227670 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f018c0896b0 con 0x7f019806d9c0 2023-11-04T01:42:17.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.983+0000 7f0196ffd640 1 --2- 172.21.15.44:0/372227670 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f018406ae70 0x7f018406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.987 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.983+0000 7f0196ffd640 1 --2- 172.21.15.44:0/372227670 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f018406ae70 0x7f018406d330 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0188036000 tx=0x7f018803d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.989 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:17.987+0000 7f017f7fe640 1 -- 172.21.15.44:0/372227670 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f018c053f10 con 0x7f019806d9c0 2023-11-04T01:42:18.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.200+0000 7f019d683640 1 -- 172.21.15.44:0/372227670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01980cddc0 con 0x7f019806d9c0 2023-11-04T01:42:18.202 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.200+0000 7f017f7fe640 1 -- 172.21.15.44:0/372227670 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f018c057530 con 0x7f019806d9c0 2023-11-04T01:42:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:18.202 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:15.256705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:active","state_seq":7,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:18.203 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 95 2023-11-04T01:42:18.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.202+0000 7f019d683640 1 -- 172.21.15.44:0/372227670 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f018406ae70 msgr2=0x7f018406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.202+0000 7f019d683640 1 --2- 172.21.15.44:0/372227670 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f018406ae70 0x7f018406d330 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0188036000 tx=0x7f018803d040 comp rx=0 tx=0).stop 2023-11-04T01:42:18.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.202+0000 7f019d683640 1 -- 172.21.15.44:0/372227670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f019806d9c0 msgr2=0x7f0198157440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.202+0000 7f019d683640 1 --2- 172.21.15.44:0/372227670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f019806d9c0 0x7f0198157440 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f018c00c390 tx=0x7f018c00c790 comp rx=0 tx=0).stop 2023-11-04T01:42:18.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.202+0000 7f019d683640 1 -- 172.21.15.44:0/372227670 shutdown_connections 2023-11-04T01:42:18.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.202+0000 7f019d683640 1 --2- 172.21.15.44:0/372227670 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f018406ae70 0x7f018406d330 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.202+0000 7f019d683640 1 --2- 172.21.15.44:0/372227670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01980ade00 0x7f01981efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.202+0000 7f019d683640 1 --2- 172.21.15.44:0/372227670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f019806d9c0 0x7f0198157440 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.202+0000 7f019d683640 1 --2- 172.21.15.44:0/372227670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f019806c5f0 0x7f01981f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.202+0000 7f019d683640 1 -- 172.21.15.44:0/372227670 >> 172.21.15.44:0/372227670 conn(0x7f01980cb530 msgr2=0x7f019815e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:18.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.202+0000 7f019d683640 1 -- 172.21.15.44:0/372227670 shutdown_connections 2023-11-04T01:42:18.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.202+0000 7f019d683640 1 -- 172.21.15.44:0/372227670 wait complete. 2023-11-04T01:42:18.216 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:42:18.336 INFO:teuthology.orchestra.run.smithi044.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"17":[2,3,4,5,6,7,8,9]},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:42:18.336 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": { "17": [ 2, 3, 4, 5, 6, 7, 8, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:42:18.336 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:18.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:18.336 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2023-11-04T01:42:18.368 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:42:18.368 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:18.424 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.569+0000 7fcce4ad7640 1 Processor -- start 2023-11-04T01:42:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.569+0000 7fcce4ad7640 1 -- start start 2023-11-04T01:42:18.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.570+0000 7fcce4ad7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcce015b330 0x7fcce00cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.570+0000 7fcce4ad7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce00cb5d0 con 0x7fcce006ca60 2023-11-04T01:42:18.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.570+0000 7fcce4ad7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce006f3f0 con 0x7fcce00b2160 2023-11-04T01:42:18.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.570+0000 7fcce4ad7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce00c3490 con 0x7fcce015b330 2023-11-04T01:42:18.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.570+0000 7fccded9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcce006ca60 0x7fcce00b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51412/0 (socket says 172.21.15.44:51412) 2023-11-04T01:42:18.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.570+0000 7fccded9d640 1 -- 172.21.15.44:0/1870792268 learned_addr learned my addr 172.21.15.44:0/1870792268 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.570+0000 7fccde59c640 1 --2- 172.21.15.44:0/1870792268 >> v2:172.21.15.204:3300/0 conn(0x7fcce015b330 0x7fcce00cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.570+0000 7fccdd59a640 1 -- 172.21.15.44:0/1870792268 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114005412 0 0) 0x7fcce00cb5d0 con 0x7fcce006ca60 2023-11-04T01:42:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.570+0000 7fccdd59a640 1 -- 172.21.15.44:0/1870792268 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcccc003520 con 0x7fcce006ca60 2023-11-04T01:42:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.571+0000 7fccde59c640 1 -- 172.21.15.44:0/1870792268 >> v1:172.21.15.204:6789/0 conn(0x7fcce00b2160 legacy=0x7fcce006ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.571+0000 7fccde59c640 1 -- 172.21.15.44:0/1870792268 >> v1:172.21.15.44:6789/0 conn(0x7fcce006ca60 legacy=0x7fcce00b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.571+0000 7fccde59c640 1 -- 172.21.15.44:0/1870792268 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce00cbfa0 con 0x7fcce015b330 2023-11-04T01:42:18.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.572+0000 7fccde59c640 1 --2- 172.21.15.44:0/1870792268 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce015b330 0x7fcce00cba60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009d90 tx=0x7fccd002bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c9e75f53c2bcd02 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:18.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.572+0000 7fccdd59a640 1 -- 172.21.15.44:0/1870792268 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd002ccf0 con 0x7fcce015b330 2023-11-04T01:42:18.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.572+0000 7fccdd59a640 1 -- 172.21.15.44:0/1870792268 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd002ce50 con 0x7fcce015b330 2023-11-04T01:42:18.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.572+0000 7fccdd59a640 1 -- 172.21.15.44:0/1870792268 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd0034660 con 0x7fcce015b330 2023-11-04T01:42:18.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.573+0000 7fcce4ad7640 1 -- 172.21.15.44:0/1870792268 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce015b330 msgr2=0x7fcce00cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.573+0000 7fcce4ad7640 1 --2- 172.21.15.44:0/1870792268 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce015b330 0x7fcce00cba60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009d90 tx=0x7fccd002bf40 comp rx=0 tx=0).stop 2023-11-04T01:42:18.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.573+0000 7fcce4ad7640 1 -- 172.21.15.44:0/1870792268 shutdown_connections 2023-11-04T01:42:18.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.573+0000 7fcce4ad7640 1 --2- 172.21.15.44:0/1870792268 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce015b330 0x7fcce00cba60 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.573+0000 7fcce4ad7640 1 -- 172.21.15.44:0/1870792268 >> 172.21.15.44:0/1870792268 conn(0x7fcce00b1640 msgr2=0x7fcce00b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:18.575 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.573+0000 7fcce4ad7640 1 -- 172.21.15.44:0/1870792268 shutdown_connections 2023-11-04T01:42:18.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.573+0000 7fcce4ad7640 1 -- 172.21.15.44:0/1870792268 wait complete. 2023-11-04T01:42:18.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.574+0000 7fcce4ad7640 1 Processor -- start 2023-11-04T01:42:18.576 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.574+0000 7fcce4ad7640 1 -- start start 2023-11-04T01:42:18.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.575+0000 7fcce4ad7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce006ca60 0x7fcce01f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.575+0000 7fcce4ad7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce00b2160 0x7fcce00b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.575+0000 7fcce4ad7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcce015b330 0x7fcce00ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.575+0000 7fcce4ad7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00b5170 con 0x7fcce00b2160 2023-11-04T01:42:18.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.575+0000 7fcce4ad7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce015be20 con 0x7fcce006ca60 2023-11-04T01:42:18.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.575+0000 7fcce4ad7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00b4bb0 con 0x7fcce015b330 2023-11-04T01:42:18.578 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.575+0000 7fccddd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce00b2160 0x7fcce00b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.575+0000 7fccddd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce00b2160 0x7fcce00b41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45846/0 (socket says 172.21.15.44:45846) 2023-11-04T01:42:18.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.575+0000 7fccddd9b640 1 -- 172.21.15.44:0/3575637252 learned_addr learned my addr 172.21.15.44:0/3575637252 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:18.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.575+0000 7fccde59c640 1 --2- 172.21.15.44:0/3575637252 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce006ca60 0x7fcce01f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.575+0000 7fccded9d640 1 --2- 172.21.15.44:0/3575637252 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcce015b330 0x7fcce00ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.576+0000 7fccddd9b640 1 -- 172.21.15.44:0/3575637252 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcce015b330 msgr2=0x7fcce00ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.576+0000 7fccddd9b640 1 --2- 172.21.15.44:0/3575637252 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcce015b330 0x7fcce00ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.576+0000 7fccddd9b640 1 -- 172.21.15.44:0/3575637252 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce006ca60 msgr2=0x7fcce01f22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.576+0000 7fccddd9b640 1 --2- 172.21.15.44:0/3575637252 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce006ca60 0x7fcce01f22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.579 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.576+0000 7fccddd9b640 1 -- 172.21.15.44:0/3575637252 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd0009a70 con 0x7fcce00b2160 2023-11-04T01:42:18.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.576+0000 7fccddd9b640 1 --2- 172.21.15.44:0/3575637252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce00b2160 0x7fcce00b41d0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fccc800c400 tx=0x7fccc800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:18.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.576+0000 7fccd6ffd640 1 -- 172.21.15.44:0/3575637252 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc80052d0 con 0x7fcce00b2160 2023-11-04T01:42:18.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.576+0000 7fccd6ffd640 1 -- 172.21.15.44:0/3575637252 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc8005430 con 0x7fcce00b2160 2023-11-04T01:42:18.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.576+0000 7fcce4ad7640 1 -- 172.21.15.44:0/3575637252 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce00b4e90 con 0x7fcce00b2160 2023-11-04T01:42:18.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.576+0000 7fccd6ffd640 1 -- 172.21.15.44:0/3575637252 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc8003830 con 0x7fcce00b2160 2023-11-04T01:42:18.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.576+0000 7fcce4ad7640 1 -- 172.21.15.44:0/3575637252 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce00acd50 con 0x7fcce00b2160 2023-11-04T01:42:18.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.577+0000 7fcce4ad7640 1 -- 172.21.15.44:0/3575637252 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce006da20 con 0x7fcce00b2160 2023-11-04T01:42:18.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.578+0000 7fccd6ffd640 1 -- 172.21.15.44:0/3575637252 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fccc8003990 con 0x7fcce00b2160 2023-11-04T01:42:18.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.578+0000 7fccd6ffd640 1 --2- 172.21.15.44:0/3575637252 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fccc006ae70 0x7fccc006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.578+0000 7fccd6ffd640 1 -- 172.21.15.44:0/3575637252 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7fccc80892b0 con 0x7fcce00b2160 2023-11-04T01:42:18.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.578+0000 7fccde59c640 1 --2- 172.21.15.44:0/3575637252 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fccc006ae70 0x7fccc006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.579+0000 7fccde59c640 1 --2- 172.21.15.44:0/3575637252 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fccc006ae70 0x7fccc006d330 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fccd0036000 tx=0x7fccd0030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:18.584 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.583+0000 7fccd6ffd640 1 -- 172.21.15.44:0/3575637252 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fccc8053c40 con 0x7fcce00b2160 2023-11-04T01:42:18.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.759+0000 7fcce4ad7640 1 -- 172.21.15.44:0/3575637252 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcce00ac8d0 con 0x7fcce00b2160 2023-11-04T01:42:18.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.760+0000 7fccd6ffd640 1 -- 172.21.15.44:0/3575637252 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+22925 (secure 0 0 0) 0x7fcce00ac8d0 con 0x7fcce00b2160 2023-11-04T01:42:18.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:18.762 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":108,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:42:14.241045+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:28.109628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:28.871834+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":2}]},{"pgid":"17.37","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.204:6836/3065829953":"2023-11-05T01:41:05.691698+0000","172.21.15.204:6836/3287638895":"2023-11-05T01:41:58.941997+0000","172.21.15.204:6834/3065829953":"2023-11-05T01:41:05.691698+0000","172.21.15.44:6835/1627866359":"2023-11-05T01:41:31.011032+0000","172.21.15.44:6835/2252282753":"2023-11-05T01:40:40.408324+0000","192.168.0.1:0/780133444":"2023-11-04T02:42:14.050728+0000","172.21.15.44:6834/2069525699":"2023-11-05T01:42:05.849526+0000","172.21.15.204:6834/3287638895":"2023-11-05T01:41:58.941997+0000","172.21.15.44:6833/2252282753":"2023-11-05T01:40:40.408324+0000","172.21.15.44:6833/1627866359":"2023-11-05T01:41:31.011032+0000","172.21.15.204:6836/2461924520":"2023-11-05T01:40:15.032018+0000","172.21.15.44:6832/2069525699":"2023-11-05T01:42:05.849526+0000","172.21.15.204:6834/2461924520":"2023-11-05T01:40:15.032018+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.762+0000 7fcce4ad7640 1 -- 172.21.15.44:0/3575637252 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fccc006ae70 msgr2=0x7fccc006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.762+0000 7fcce4ad7640 1 --2- 172.21.15.44:0/3575637252 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fccc006ae70 0x7fccc006d330 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fccd0036000 tx=0x7fccd0030000 comp rx=0 tx=0).stop 2023-11-04T01:42:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.762+0000 7fcce4ad7640 1 -- 172.21.15.44:0/3575637252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce00b2160 msgr2=0x7fcce00b41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.762+0000 7fcce4ad7640 1 --2- 172.21.15.44:0/3575637252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce00b2160 0x7fcce00b41d0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fccc800c400 tx=0x7fccc800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.762+0000 7fcce4ad7640 1 -- 172.21.15.44:0/3575637252 shutdown_connections 2023-11-04T01:42:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.762+0000 7fcce4ad7640 1 --2- 172.21.15.44:0/3575637252 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fccc006ae70 0x7fccc006d330 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.762+0000 7fcce4ad7640 1 --2- 172.21.15.44:0/3575637252 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcce015b330 0x7fcce00ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.762+0000 7fcce4ad7640 1 --2- 172.21.15.44:0/3575637252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce00b2160 0x7fcce00b41d0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.762+0000 7fcce4ad7640 1 --2- 172.21.15.44:0/3575637252 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce006ca60 0x7fcce01f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.762+0000 7fcce4ad7640 1 -- 172.21.15.44:0/3575637252 >> 172.21.15.44:0/3575637252 conn(0x7fcce00b1640 msgr2=0x7fcce0158200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.762+0000 7fcce4ad7640 1 -- 172.21.15.44:0/3575637252 shutdown_connections 2023-11-04T01:42:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.762+0000 7fcce4ad7640 1 -- 172.21.15.44:0/3575637252 wait complete. 2023-11-04T01:42:18.775 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:34.917670+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:35.547044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:28.109628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:28.871834+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:18.775 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:18.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.882+0000 7f34e0355640 1 Processor -- start 2023-11-04T01:42:18.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.882+0000 7f34e0355640 1 -- start start 2023-11-04T01:42:18.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.883+0000 7f34e0355640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f34d80d1be0 0x7f34d8167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.883+0000 7f34e0355640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d80b32b0 con 0x7f34d815d4e0 2023-11-04T01:42:18.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.883+0000 7f34e0355640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d80cee10 con 0x7f34d815d100 2023-11-04T01:42:18.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.883+0000 7f34e0355640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d80cec20 con 0x7f34d80d1be0 2023-11-04T01:42:18.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.883+0000 7f34de8f2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f34d80d1be0 0x7f34d8167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.883+0000 7f34dd8f0640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f34d815d4e0 0x7f34d80d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51428/0 (socket says 172.21.15.44:51428) 2023-11-04T01:42:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.883+0000 7f34dd8f0640 1 -- 172.21.15.44:0/3486416247 learned_addr learned my addr 172.21.15.44:0/3486416247 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.884+0000 7f34de8f2640 1 -- 172.21.15.44:0/3486416247 >> v1:172.21.15.204:6789/0 conn(0x7f34d815d100 legacy=0x7f34d80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.884+0000 7f34de8f2640 1 -- 172.21.15.44:0/3486416247 >> v1:172.21.15.44:6789/0 conn(0x7f34d815d4e0 legacy=0x7f34d80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.884+0000 7f34de8f2640 1 -- 172.21.15.44:0/3486416247 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d80b4750 con 0x7f34d80d1be0 2023-11-04T01:42:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.884+0000 7f34de8f2640 1 --2- 172.21.15.44:0/3486416247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d80d1be0 0x7f34d8167e80 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009d90 tx=0x7f34c802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533338acc2d044f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.885+0000 7f34dd0ef640 1 -- 172.21.15.44:0/3486416247 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c802cd00 con 0x7f34d80d1be0 2023-11-04T01:42:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.885+0000 7f34dd0ef640 1 -- 172.21.15.44:0/3486416247 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c802ce60 con 0x7f34d80d1be0 2023-11-04T01:42:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.885+0000 7f34dd0ef640 1 -- 172.21.15.44:0/3486416247 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8034660 con 0x7f34d80d1be0 2023-11-04T01:42:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.885+0000 7f34e0355640 1 -- 172.21.15.44:0/3486416247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d80d1be0 msgr2=0x7f34d8167e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.885+0000 7f34e0355640 1 --2- 172.21.15.44:0/3486416247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d80d1be0 0x7f34d8167e80 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009d90 tx=0x7f34c802bf50 comp rx=0 tx=0).stop 2023-11-04T01:42:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.885+0000 7f34e0355640 1 -- 172.21.15.44:0/3486416247 shutdown_connections 2023-11-04T01:42:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.885+0000 7f34e0355640 1 --2- 172.21.15.44:0/3486416247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d80d1be0 0x7f34d8167e80 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.885+0000 7f34e0355640 1 -- 172.21.15.44:0/3486416247 >> 172.21.15.44:0/3486416247 conn(0x7f34d80d2ef0 msgr2=0x7f34d80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.885+0000 7f34e0355640 1 -- 172.21.15.44:0/3486416247 shutdown_connections 2023-11-04T01:42:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.885+0000 7f34e0355640 1 -- 172.21.15.44:0/3486416247 wait complete. 2023-11-04T01:42:18.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.886+0000 7f34e0355640 1 Processor -- start 2023-11-04T01:42:18.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.887+0000 7f34e0355640 1 -- start start 2023-11-04T01:42:18.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.887+0000 7f34e0355640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34d80d1be0 0x7f34d815fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.887+0000 7f34e0355640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34d815d100 0x7f34d80b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.887+0000 7f34e0355640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d815d4e0 0x7f34d8151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.887+0000 7f34e0355640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80c9fc0 con 0x7f34d815d4e0 2023-11-04T01:42:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.887+0000 7f34e0355640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80ca2a0 con 0x7f34d80d1be0 2023-11-04T01:42:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.887+0000 7f34e0355640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80ca580 con 0x7f34d815d100 2023-11-04T01:42:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.887+0000 7f34de8f2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d815d4e0 0x7f34d8151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.887+0000 7f34de8f2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d815d4e0 0x7f34d8151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45854/0 (socket says 172.21.15.44:45854) 2023-11-04T01:42:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.887+0000 7f34de8f2640 1 -- 172.21.15.44:0/663089273 learned_addr learned my addr 172.21.15.44:0/663089273 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.888+0000 7f34de0f1640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34d80d1be0 0x7f34d815fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.888+0000 7f34dd8f0640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34d815d100 0x7f34d80b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.888+0000 7f34de8f2640 1 -- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34d815d100 msgr2=0x7f34d80b81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.888+0000 7f34de8f2640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34d815d100 0x7f34d80b81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.888+0000 7f34de8f2640 1 -- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34d80d1be0 msgr2=0x7f34d815fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.888+0000 7f34de8f2640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34d80d1be0 0x7f34d815fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.888+0000 7f34de8f2640 1 -- 172.21.15.44:0/663089273 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c8009a70 con 0x7f34d815d4e0 2023-11-04T01:42:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.888+0000 7f34de0f1640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34d80d1be0 0x7f34d815fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.888+0000 7f34dd8f0640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34d815d100 0x7f34d80b81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.888+0000 7f34de8f2640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d815d4e0 0x7f34d8151de0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009d90 tx=0x7f34c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.888+0000 7f34d6ffd640 1 -- 172.21.15.44:0/663089273 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c803d600 con 0x7f34d815d4e0 2023-11-04T01:42:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.888+0000 7f34d6ffd640 1 -- 172.21.15.44:0/663089273 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c803d780 con 0x7f34d815d4e0 2023-11-04T01:42:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.888+0000 7f34e0355640 1 -- 172.21.15.44:0/663089273 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d80ca860 con 0x7f34d815d4e0 2023-11-04T01:42:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.888+0000 7f34d6ffd640 1 -- 172.21.15.44:0/663089273 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c803db30 con 0x7f34d815d4e0 2023-11-04T01:42:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.888+0000 7f34e0355640 1 -- 172.21.15.44:0/663089273 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d80cae20 con 0x7f34d815d4e0 2023-11-04T01:42:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.889+0000 7f34e0355640 1 -- 172.21.15.44:0/663089273 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d80684b0 con 0x7f34d815d4e0 2023-11-04T01:42:18.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.890+0000 7f34d6ffd640 1 -- 172.21.15.44:0/663089273 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34c803b040 con 0x7f34d815d4e0 2023-11-04T01:42:18.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.890+0000 7f34d6ffd640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f34c406ae70 0x7f34c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.890+0000 7f34d6ffd640 1 -- 172.21.15.44:0/663089273 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f34c80ac450 con 0x7f34d815d4e0 2023-11-04T01:42:18.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.890+0000 7f34de0f1640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f34c406ae70 0x7f34c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.891+0000 7f34de0f1640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f34c406ae70 0x7f34c406d330 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f34d0000fb0 tx=0x7f34d0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:18.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:18.894+0000 7f34d6ffd640 1 -- 172.21.15.44:0/663089273 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f34c8076dc0 con 0x7f34d815d4e0 2023-11-04T01:42:19.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.072+0000 7f34e0355640 1 -- 172.21.15.44:0/663089273 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34d80d2cd0 con 0x7f34d815d4e0 2023-11-04T01:42:19.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.072+0000 7f34d6ffd640 1 -- 172.21.15.44:0/663089273 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) v1 ==== 93+0+10 (secure 0 0 0) 0x7f34c8039020 con 0x7f34d815d4e0 2023-11-04T01:42:19.074 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:42:19.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.074+0000 7f34e0355640 1 -- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f34c406ae70 msgr2=0x7f34c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.074+0000 7f34e0355640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f34c406ae70 0x7f34c406d330 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f34d0000fb0 tx=0x7f34d0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:19.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.074+0000 7f34e0355640 1 -- 172.21.15.44:0/663089273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d815d4e0 msgr2=0x7f34d8151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.074+0000 7f34e0355640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d815d4e0 0x7f34d8151de0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009d90 tx=0x7f34c8004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:19.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.074+0000 7f34e0355640 1 -- 172.21.15.44:0/663089273 shutdown_connections 2023-11-04T01:42:19.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.074+0000 7f34e0355640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f34c406ae70 0x7f34c406d330 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.074+0000 7f34e0355640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d815d4e0 0x7f34d8151de0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.074+0000 7f34e0355640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34d815d100 0x7f34d80b81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.074+0000 7f34e0355640 1 --2- 172.21.15.44:0/663089273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34d80d1be0 0x7f34d815fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.074+0000 7f34e0355640 1 -- 172.21.15.44:0/663089273 >> 172.21.15.44:0/663089273 conn(0x7f34d80d2ef0 msgr2=0x7f34d80b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:19.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.074+0000 7f34e0355640 1 -- 172.21.15.44:0/663089273 shutdown_connections 2023-11-04T01:42:19.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.074+0000 7f34e0355640 1 -- 172.21.15.44:0/663089273 wait complete. 2023-11-04T01:42:19.087 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:19.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.194+0000 7fe500c26640 1 Processor -- start 2023-11-04T01:42:19.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.194+0000 7fe500c26640 1 -- start start 2023-11-04T01:42:19.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.194+0000 7fe500c26640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4fc0b0c40 0x7fe4fc06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.194+0000 7fe500c26640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4fc06bb60 0x7fe4fc070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.194+0000 7fe500c26640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4fc071500 con 0x7fe4fc159e40 2023-11-04T01:42:19.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.194+0000 7fe500c26640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4fc070a70 con 0x7fe4fc06bb60 2023-11-04T01:42:19.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.194+0000 7fe500c26640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc15dae0 con 0x7fe4fc0b0c40 2023-11-04T01:42:19.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.195+0000 7fe4fad9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4fc06bb60 0x7fe4fc070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.197 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.195+0000 7fe4fa59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe4fc159e40 0x7fe4fc0b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51434/0 (socket says 172.21.15.44:51434) 2023-11-04T01:42:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.195+0000 7fe4fa59c640 1 -- 172.21.15.44:0/793791339 learned_addr learned my addr 172.21.15.44:0/793791339 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.195+0000 7fe4fad9d640 1 -- 172.21.15.44:0/793791339 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4fc0b0c40 msgr2=0x7fe4fc06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.195+0000 7fe4f3fff640 1 --2- 172.21.15.44:0/793791339 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4fc0b0c40 0x7fe4fc06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.195+0000 7fe4fad9d640 1 --2- 172.21.15.44:0/793791339 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4fc0b0c40 0x7fe4fc06fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.195+0000 7fe4f9d9b640 1 -- 172.21.15.44:0/793791339 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2915076578 0 0) 0x7fe4fc071500 con 0x7fe4fc159e40 2023-11-04T01:42:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.195+0000 7fe4fad9d640 1 -- 172.21.15.44:0/793791339 >> v1:172.21.15.44:6789/0 conn(0x7fe4fc159e40 legacy=0x7fe4fc0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.195+0000 7fe4fad9d640 1 -- 172.21.15.44:0/793791339 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc070c60 con 0x7fe4fc06bb60 2023-11-04T01:42:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.195+0000 7fe4f3fff640 1 --2- 172.21.15.44:0/793791339 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4fc0b0c40 0x7fe4fc06fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:19.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.196+0000 7fe4fad9d640 1 --2- 172.21.15.44:0/793791339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4fc06bb60 0x7fe4fc070530 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009d90 tx=0x7fe4f402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b676163dab86f046 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.196+0000 7fe4f9d9b640 1 -- 172.21.15.44:0/793791339 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f402cbc0 con 0x7fe4fc06bb60 2023-11-04T01:42:19.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.196+0000 7fe4f9d9b640 1 -- 172.21.15.44:0/793791339 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f402cd20 con 0x7fe4fc06bb60 2023-11-04T01:42:19.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.196+0000 7fe4f9d9b640 1 -- 172.21.15.44:0/793791339 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4034660 con 0x7fe4fc06bb60 2023-11-04T01:42:19.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.196+0000 7fe500c26640 1 -- 172.21.15.44:0/793791339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4fc06bb60 msgr2=0x7fe4fc070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.196+0000 7fe500c26640 1 --2- 172.21.15.44:0/793791339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4fc06bb60 0x7fe4fc070530 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009d90 tx=0x7fe4f402be10 comp rx=0 tx=0).stop 2023-11-04T01:42:19.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.196+0000 7fe500c26640 1 -- 172.21.15.44:0/793791339 shutdown_connections 2023-11-04T01:42:19.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.196+0000 7fe500c26640 1 --2- 172.21.15.44:0/793791339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4fc06bb60 0x7fe4fc070530 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.200 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.196+0000 7fe500c26640 1 --2- 172.21.15.44:0/793791339 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4fc0b0c40 0x7fe4fc06fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.196+0000 7fe500c26640 1 -- 172.21.15.44:0/793791339 >> 172.21.15.44:0/793791339 conn(0x7fe4fc0cb530 msgr2=0x7fe4fc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:19.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.196+0000 7fe500c26640 1 -- 172.21.15.44:0/793791339 shutdown_connections 2023-11-04T01:42:19.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.197+0000 7fe500c26640 1 -- 172.21.15.44:0/793791339 wait complete. 2023-11-04T01:42:19.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.198+0000 7fe500c26640 1 Processor -- start 2023-11-04T01:42:19.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.198+0000 7fe500c26640 1 -- start start 2023-11-04T01:42:19.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe500c26640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4fc06bb60 0x7fe4fc147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe500c26640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4fc0b0c40 0x7fe4fc15aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe500c26640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4fc159e40 0x7fe4fc06c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe500c26640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc15aa10 con 0x7fe4fc0b0c40 2023-11-04T01:42:19.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe500c26640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc15c010 con 0x7fe4fc159e40 2023-11-04T01:42:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe500c26640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc15a3c0 con 0x7fe4fc06bb60 2023-11-04T01:42:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe4f3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4fc0b0c40 0x7fe4fc15aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe4f3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4fc0b0c40 0x7fe4fc15aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45872/0 (socket says 172.21.15.44:45872) 2023-11-04T01:42:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe4f3fff640 1 -- 172.21.15.44:0/4138394087 learned_addr learned my addr 172.21.15.44:0/4138394087 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe4fa59c640 1 --2- 172.21.15.44:0/4138394087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4fc06bb60 0x7fe4fc147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe4fad9d640 1 --2- 172.21.15.44:0/4138394087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4fc159e40 0x7fe4fc06c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe4f3fff640 1 -- 172.21.15.44:0/4138394087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4fc06bb60 msgr2=0x7fe4fc147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe4f3fff640 1 --2- 172.21.15.44:0/4138394087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4fc06bb60 0x7fe4fc147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe4f3fff640 1 -- 172.21.15.44:0/4138394087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4fc159e40 msgr2=0x7fe4fc06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe4f3fff640 1 --2- 172.21.15.44:0/4138394087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4fc159e40 0x7fe4fc06c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe4f3fff640 1 -- 172.21.15.44:0/4138394087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f4009a70 con 0x7fe4fc0b0c40 2023-11-04T01:42:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe4f3fff640 1 --2- 172.21.15.44:0/4138394087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4fc0b0c40 0x7fe4fc15aea0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400c7f0 tx=0x7fe4e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe4f2ffd640 1 -- 172.21.15.44:0/4138394087 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4007a30 con 0x7fe4fc0b0c40 2023-11-04T01:42:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe4f2ffd640 1 -- 172.21.15.44:0/4138394087 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e4007b90 con 0x7fe4fc0b0c40 2023-11-04T01:42:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe4f2ffd640 1 -- 172.21.15.44:0/4138394087 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400ce40 con 0x7fe4fc0b0c40 2023-11-04T01:42:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe500c26640 1 -- 172.21.15.44:0/4138394087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4fc15a6a0 con 0x7fe4fc0b0c40 2023-11-04T01:42:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.199+0000 7fe500c26640 1 -- 172.21.15.44:0/4138394087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4fc0af970 con 0x7fe4fc0b0c40 2023-11-04T01:42:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.200+0000 7fe500c26640 1 -- 172.21.15.44:0/4138394087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4fc15a220 con 0x7fe4fc0b0c40 2023-11-04T01:42:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.201+0000 7fe4f2ffd640 1 -- 172.21.15.44:0/4138394087 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4e40113f0 con 0x7fe4fc0b0c40 2023-11-04T01:42:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.201+0000 7fe4f2ffd640 1 --2- 172.21.15.44:0/4138394087 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe4dc06aea0 0x7fe4dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.201+0000 7fe4f2ffd640 1 -- 172.21.15.44:0/4138394087 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7fe4e4089f50 con 0x7fe4fc0b0c40 2023-11-04T01:42:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.201+0000 7fe4fa59c640 1 --2- 172.21.15.44:0/4138394087 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe4dc06aea0 0x7fe4dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.202+0000 7fe4fa59c640 1 --2- 172.21.15.44:0/4138394087 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe4dc06aea0 0x7fe4dc06d360 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec000f60 tx=0x7fe4ec007c00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.206+0000 7fe4f2ffd640 1 -- 172.21.15.44:0/4138394087 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4fc15a220 con 0x7fe4fc0b0c40 2023-11-04T01:42:19.321 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:42:19.320+0000 7f4db57fa640 -1 client.7521 mds.1 rejected us (blocklisted (blacklisted)) 2023-11-04T01:42:19.322 INFO:teuthology.orchestra.run.smithi044.stderr:mkdir: cannot create directory ‘d1/dir/.snap/s22’: Operation not permitted 2023-11-04T01:42:19.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.382+0000 7fe500c26640 1 -- 172.21.15.44:0/4138394087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fe4fc15a220 con 0x7fe4fc0b0c40 2023-11-04T01:42:19.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.382+0000 7fe4f2ffd640 1 -- 172.21.15.44:0/4138394087 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v108) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe4fc15a220 con 0x7fe4fc0b0c40 2023-11-04T01:42:19.385 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:42:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.384+0000 7fe500c26640 1 -- 172.21.15.44:0/4138394087 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe4dc06aea0 msgr2=0x7fe4dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.384+0000 7fe500c26640 1 --2- 172.21.15.44:0/4138394087 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe4dc06aea0 0x7fe4dc06d360 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec000f60 tx=0x7fe4ec007c00 comp rx=0 tx=0).stop 2023-11-04T01:42:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.384+0000 7fe500c26640 1 -- 172.21.15.44:0/4138394087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4fc0b0c40 msgr2=0x7fe4fc15aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.384+0000 7fe500c26640 1 --2- 172.21.15.44:0/4138394087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4fc0b0c40 0x7fe4fc15aea0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400c7f0 tx=0x7fe4e400cbf0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.384+0000 7fe500c26640 1 -- 172.21.15.44:0/4138394087 shutdown_connections 2023-11-04T01:42:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.384+0000 7fe500c26640 1 --2- 172.21.15.44:0/4138394087 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe4dc06aea0 0x7fe4dc06d360 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.384+0000 7fe500c26640 1 --2- 172.21.15.44:0/4138394087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4fc159e40 0x7fe4fc06c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.384+0000 7fe500c26640 1 --2- 172.21.15.44:0/4138394087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4fc0b0c40 0x7fe4fc15aea0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.384+0000 7fe500c26640 1 --2- 172.21.15.44:0/4138394087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4fc06bb60 0x7fe4fc147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.385+0000 7fe500c26640 1 -- 172.21.15.44:0/4138394087 >> 172.21.15.44:0/4138394087 conn(0x7fe4fc0cb530 msgr2=0x7fe4fc0ca2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:19.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.385+0000 7fe500c26640 1 -- 172.21.15.44:0/4138394087 shutdown_connections 2023-11-04T01:42:19.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.385+0000 7fe500c26640 1 -- 172.21.15.44:0/4138394087 wait complete. 2023-11-04T01:42:19.397 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:42:19.506 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.504+0000 7fd4a5a6f640 1 Processor -- start 2023-11-04T01:42:19.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.504+0000 7fd4a5a6f640 1 -- start start 2023-11-04T01:42:19.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.505+0000 7fd4a5a6f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4a015b200 0x7fd4a00ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.505+0000 7fd4a5a6f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd4a00cd9c0 0x7fd4a00ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.505+0000 7fd4a5a6f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a00cde80 con 0x7fd4a00afda0 2023-11-04T01:42:19.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.505+0000 7fd4a5a6f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a00cf670 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.505+0000 7fd4a5a6f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00cf950 con 0x7fd4a015b200 2023-11-04T01:42:19.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.505+0000 7fd49ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd4a00cd9c0 0x7fd4a00ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.505+0000 7fd49effd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd4a00afda0 0x7fd4a00cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51438/0 (socket says 172.21.15.44:51438) 2023-11-04T01:42:19.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.505+0000 7fd49effd640 1 -- 172.21.15.44:0/3979382252 learned_addr learned my addr 172.21.15.44:0/3979382252 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:19.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.506+0000 7fd49f7fe640 1 --2- 172.21.15.44:0/3979382252 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4a015b200 0x7fd4a00ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.506+0000 7fd49ffff640 1 -- 172.21.15.44:0/3979382252 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4a015b200 msgr2=0x7fd4a00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:19.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.506+0000 7fd49ffff640 1 --2- 172.21.15.44:0/3979382252 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4a015b200 0x7fd4a00ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.506+0000 7fd49ffff640 1 -- 172.21.15.44:0/3979382252 >> v1:172.21.15.44:6789/0 conn(0x7fd4a00afda0 legacy=0x7fd4a00cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.506+0000 7fd49e7fc640 1 -- 172.21.15.44:0/3979382252 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692474760 0 0) 0x7fd4a00cde80 con 0x7fd4a00afda0 2023-11-04T01:42:19.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.506+0000 7fd49ffff640 1 -- 172.21.15.44:0/3979382252 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a00ce120 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.506+0000 7fd49ffff640 1 --2- 172.21.15.44:0/3979382252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4a00cd9c0 0x7fd4a00ae2b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fd498009d90 tx=0x7fd49802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412a54adff92cdbd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.507+0000 7fd49e7fc640 1 -- 172.21.15.44:0/3979382252 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49802cbc0 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.507+0000 7fd49e7fc640 1 -- 172.21.15.44:0/3979382252 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49802cd20 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.507+0000 7fd49e7fc640 1 -- 172.21.15.44:0/3979382252 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498034660 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.507+0000 7fd4a5a6f640 1 -- 172.21.15.44:0/3979382252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4a00cd9c0 msgr2=0x7fd4a00ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.507+0000 7fd4a5a6f640 1 --2- 172.21.15.44:0/3979382252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4a00cd9c0 0x7fd4a00ae2b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fd498009d90 tx=0x7fd49802be10 comp rx=0 tx=0).stop 2023-11-04T01:42:19.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.507+0000 7fd4a5a6f640 1 -- 172.21.15.44:0/3979382252 shutdown_connections 2023-11-04T01:42:19.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.507+0000 7fd4a5a6f640 1 --2- 172.21.15.44:0/3979382252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4a00cd9c0 0x7fd4a00ae2b0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.507+0000 7fd4a5a6f640 1 --2- 172.21.15.44:0/3979382252 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4a015b200 0x7fd4a00ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.507+0000 7fd4a5a6f640 1 -- 172.21.15.44:0/3979382252 >> 172.21.15.44:0/3979382252 conn(0x7fd4a00d0c30 msgr2=0x7fd4a00d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:19.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.507+0000 7fd4a5a6f640 1 -- 172.21.15.44:0/3979382252 shutdown_connections 2023-11-04T01:42:19.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.507+0000 7fd4a5a6f640 1 -- 172.21.15.44:0/3979382252 wait complete. 2023-11-04T01:42:19.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.508+0000 7fd4a5a6f640 1 Processor -- start 2023-11-04T01:42:19.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.509+0000 7fd4a5a6f640 1 -- start start 2023-11-04T01:42:19.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.509+0000 7fd4a5a6f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4a00afda0 0x7fd4a00b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.509+0000 7fd4a5a6f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4a00cd9c0 0x7fd4a01e50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.509+0000 7fd4a5a6f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4a015b200 0x7fd4a01e4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.509+0000 7fd4a5a6f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00b61e0 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.509+0000 7fd4a5a6f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00c59e0 con 0x7fd4a00afda0 2023-11-04T01:42:19.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.509+0000 7fd4a5a6f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00c4dd0 con 0x7fd4a015b200 2023-11-04T01:42:19.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd49effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4a00cd9c0 0x7fd4a01e50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd49effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4a00cd9c0 0x7fd4a01e50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45884/0 (socket says 172.21.15.44:45884) 2023-11-04T01:42:19.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd49effd640 1 -- 172.21.15.44:0/1368453076 learned_addr learned my addr 172.21.15.44:0/1368453076 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:19.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd49f7fe640 1 --2- 172.21.15.44:0/1368453076 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4a00afda0 0x7fd4a00b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd49ffff640 1 --2- 172.21.15.44:0/1368453076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4a015b200 0x7fd4a01e4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd49effd640 1 -- 172.21.15.44:0/1368453076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4a015b200 msgr2=0x7fd4a01e4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd49effd640 1 --2- 172.21.15.44:0/1368453076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4a015b200 0x7fd4a01e4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd49effd640 1 -- 172.21.15.44:0/1368453076 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4a00afda0 msgr2=0x7fd4a00b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd49effd640 1 --2- 172.21.15.44:0/1368453076 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4a00afda0 0x7fd4a00b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd49effd640 1 -- 172.21.15.44:0/1368453076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd498009a70 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd49effd640 1 --2- 172.21.15.44:0/1368453076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4a00cd9c0 0x7fd4a01e50c0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fd49400c430 tx=0x7fd49400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd487fff640 1 -- 172.21.15.44:0/1368453076 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4940074e0 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd487fff640 1 -- 172.21.15.44:0/1368453076 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd494007660 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd4a5a6f640 1 -- 172.21.15.44:0/1368453076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a00c50b0 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd487fff640 1 -- 172.21.15.44:0/1368453076 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494004a20 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.510+0000 7fd4a5a6f640 1 -- 172.21.15.44:0/1368453076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a00c5670 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.511+0000 7fd4a5a6f640 1 -- 172.21.15.44:0/1368453076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a00684b0 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.512+0000 7fd487fff640 1 -- 172.21.15.44:0/1368453076 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd494004b80 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.512+0000 7fd487fff640 1 --2- 172.21.15.44:0/1368453076 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd48c06aea0 0x7fd48c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.512+0000 7fd487fff640 1 -- 172.21.15.44:0/1368453076 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7fd494089b60 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.512+0000 7fd49f7fe640 1 --2- 172.21.15.44:0/1368453076 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd48c06aea0 0x7fd48c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.513+0000 7fd49f7fe640 1 --2- 172.21.15.44:0/1368453076 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd48c06aea0 0x7fd48c06d360 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd490009b30 tx=0x7fd490009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.517+0000 7fd487fff640 1 -- 172.21.15.44:0/1368453076 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd494054450 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.690+0000 7fd4a5a6f640 1 -- 172.21.15.44:0/1368453076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fd4a006dcc0 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.691+0000 7fd487fff640 1 -- 172.21.15.44:0/1368453076 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v108) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd494057a70 con 0x7fd4a00cd9c0 2023-11-04T01:42:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:42:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.692+0000 7fd4a5a6f640 1 -- 172.21.15.44:0/1368453076 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd48c06aea0 msgr2=0x7fd48c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.692+0000 7fd4a5a6f640 1 --2- 172.21.15.44:0/1368453076 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd48c06aea0 0x7fd48c06d360 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd490009b30 tx=0x7fd490009110 comp rx=0 tx=0).stop 2023-11-04T01:42:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.692+0000 7fd4a5a6f640 1 -- 172.21.15.44:0/1368453076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4a00cd9c0 msgr2=0x7fd4a01e50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.692+0000 7fd4a5a6f640 1 --2- 172.21.15.44:0/1368453076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4a00cd9c0 0x7fd4a01e50c0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fd49400c430 tx=0x7fd49400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.693+0000 7fd4a5a6f640 1 -- 172.21.15.44:0/1368453076 shutdown_connections 2023-11-04T01:42:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.693+0000 7fd4a5a6f640 1 --2- 172.21.15.44:0/1368453076 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd48c06aea0 0x7fd48c06d360 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.693+0000 7fd4a5a6f640 1 --2- 172.21.15.44:0/1368453076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4a015b200 0x7fd4a01e4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.693+0000 7fd4a5a6f640 1 --2- 172.21.15.44:0/1368453076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4a00cd9c0 0x7fd4a01e50c0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.693+0000 7fd4a5a6f640 1 --2- 172.21.15.44:0/1368453076 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4a00afda0 0x7fd4a00b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.693+0000 7fd4a5a6f640 1 -- 172.21.15.44:0/1368453076 >> 172.21.15.44:0/1368453076 conn(0x7fd4a00d0c30 msgr2=0x7fd4a006ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.693+0000 7fd4a5a6f640 1 -- 172.21.15.44:0/1368453076 shutdown_connections 2023-11-04T01:42:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.693+0000 7fd4a5a6f640 1 -- 172.21.15.44:0/1368453076 wait complete. 2023-11-04T01:42:19.705 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:42:19.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.812+0000 7faa131a5640 1 Processor -- start 2023-11-04T01:42:19.814 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.812+0000 7faa131a5640 1 -- start start 2023-11-04T01:42:19.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa131a5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0c15b200 0x7faa0c0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa131a5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7faa0c0cd9c0 0x7faa0c0ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa131a5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c0cde80 con 0x7faa0c0afda0 2023-11-04T01:42:19.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa131a5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0c0cf670 con 0x7faa0c0cd9c0 2023-11-04T01:42:19.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa131a5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0cf950 con 0x7faa0c15b200 2023-11-04T01:42:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa0bfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7faa0c0afda0 0x7faa0c0cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51442/0 (socket says 172.21.15.44:51442) 2023-11-04T01:42:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa0bfff640 1 -- 172.21.15.44:0/116754188 learned_addr learned my addr 172.21.15.44:0/116754188 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa10f41640 1 --2- 172.21.15.44:0/116754188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0c15b200 0x7faa0c0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa11742640 1 --2- 172.21.15.44:0/116754188 >> v2:172.21.15.204:3300/0 conn(0x7faa0c0cd9c0 0x7faa0c0ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa0b7fe640 1 -- 172.21.15.44:0/116754188 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906551703 0 0) 0x7faa0c0cde80 con 0x7faa0c0afda0 2023-11-04T01:42:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa0b7fe640 1 -- 172.21.15.44:0/116754188 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9fc003520 con 0x7faa0c0afda0 2023-11-04T01:42:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa10f41640 1 -- 172.21.15.44:0/116754188 >> v2:172.21.15.204:3300/0 conn(0x7faa0c0cd9c0 msgr2=0x7faa0c0ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa10f41640 1 --2- 172.21.15.44:0/116754188 >> v2:172.21.15.204:3300/0 conn(0x7faa0c0cd9c0 0x7faa0c0ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa10f41640 1 -- 172.21.15.44:0/116754188 >> v1:172.21.15.44:6789/0 conn(0x7faa0c0afda0 legacy=0x7faa0c0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa10f41640 1 -- 172.21.15.44:0/116754188 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c0ce120 con 0x7faa0c15b200 2023-11-04T01:42:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.813+0000 7faa11742640 1 --2- 172.21.15.44:0/116754188 >> v2:172.21.15.204:3300/0 conn(0x7faa0c0cd9c0 0x7faa0c0ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.814+0000 7faa10f41640 1 --2- 172.21.15.44:0/116754188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0c15b200 0x7faa0c0ceb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa00009790 tx=0x7faa0002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63a36093e7a71395 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.814+0000 7faa0b7fe640 1 -- 172.21.15.44:0/116754188 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00031770 con 0x7faa0c15b200 2023-11-04T01:42:19.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.814+0000 7faa0b7fe640 1 -- 172.21.15.44:0/116754188 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa000318d0 con 0x7faa0c15b200 2023-11-04T01:42:19.818 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.814+0000 7faa0b7fe640 1 -- 172.21.15.44:0/116754188 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00031c40 con 0x7faa0c15b200 2023-11-04T01:42:19.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.815+0000 7faa131a5640 1 -- 172.21.15.44:0/116754188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0c15b200 msgr2=0x7faa0c0ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.815+0000 7faa131a5640 1 --2- 172.21.15.44:0/116754188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0c15b200 0x7faa0c0ceb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa00009790 tx=0x7faa0002b810 comp rx=0 tx=0).stop 2023-11-04T01:42:19.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.815+0000 7faa131a5640 1 -- 172.21.15.44:0/116754188 shutdown_connections 2023-11-04T01:42:19.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.815+0000 7faa131a5640 1 --2- 172.21.15.44:0/116754188 >> v2:172.21.15.204:3300/0 conn(0x7faa0c0cd9c0 0x7faa0c0ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.815+0000 7faa131a5640 1 --2- 172.21.15.44:0/116754188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0c15b200 0x7faa0c0ceb30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.815+0000 7faa131a5640 1 -- 172.21.15.44:0/116754188 >> 172.21.15.44:0/116754188 conn(0x7faa0c0d0c30 msgr2=0x7faa0c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:19.820 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.815+0000 7faa131a5640 1 -- 172.21.15.44:0/116754188 shutdown_connections 2023-11-04T01:42:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.815+0000 7faa131a5640 1 -- 172.21.15.44:0/116754188 wait complete. 2023-11-04T01:42:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.816+0000 7faa131a5640 1 Processor -- start 2023-11-04T01:42:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.816+0000 7faa131a5640 1 -- start start 2023-11-04T01:42:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.817+0000 7faa131a5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0c0afda0 0x7faa0c0ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.817+0000 7faa131a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa0c0cd9c0 0x7faa0c153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.817+0000 7faa131a5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa0c15b200 0x7faa0c15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.817+0000 7faa131a5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0c8750 con 0x7faa0c0cd9c0 2023-11-04T01:42:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.817+0000 7faa131a5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0c8a30 con 0x7faa0c15b200 2023-11-04T01:42:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.817+0000 7faa131a5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0c8d10 con 0x7faa0c0afda0 2023-11-04T01:42:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.817+0000 7faa0bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa0c0cd9c0 0x7faa0c153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.817+0000 7faa0bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa0c0cd9c0 0x7faa0c153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45900/0 (socket says 172.21.15.44:45900) 2023-11-04T01:42:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.817+0000 7faa0bfff640 1 -- 172.21.15.44:0/612690530 learned_addr learned my addr 172.21.15.44:0/612690530 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.817+0000 7faa10f41640 1 --2- 172.21.15.44:0/612690530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0c0afda0 0x7faa0c0ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.817+0000 7faa11742640 1 --2- 172.21.15.44:0/612690530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa0c15b200 0x7faa0c15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.818+0000 7faa0bfff640 1 -- 172.21.15.44:0/612690530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0c0afda0 msgr2=0x7faa0c0ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.818+0000 7faa0bfff640 1 --2- 172.21.15.44:0/612690530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0c0afda0 0x7faa0c0ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.818+0000 7faa0bfff640 1 -- 172.21.15.44:0/612690530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa0c15b200 msgr2=0x7faa0c15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.818+0000 7faa0bfff640 1 --2- 172.21.15.44:0/612690530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa0c15b200 0x7faa0c15dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.818+0000 7faa0bfff640 1 -- 172.21.15.44:0/612690530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa04009a70 con 0x7faa0c0cd9c0 2023-11-04T01:42:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.818+0000 7faa0bfff640 1 --2- 172.21.15.44:0/612690530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa0c0cd9c0 0x7faa0c153610 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800c430 tx=0x7fa9f800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.818+0000 7faa097fa640 1 -- 172.21.15.44:0/612690530 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8005ce0 con 0x7faa0c0cd9c0 2023-11-04T01:42:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.818+0000 7faa097fa640 1 -- 172.21.15.44:0/612690530 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f8005e40 con 0x7faa0c0cd9c0 2023-11-04T01:42:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.818+0000 7faa131a5640 1 -- 172.21.15.44:0/612690530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa000093a0 con 0x7faa0c0cd9c0 2023-11-04T01:42:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.818+0000 7faa097fa640 1 -- 172.21.15.44:0/612690530 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f80072f0 con 0x7faa0c0cd9c0 2023-11-04T01:42:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.818+0000 7faa131a5640 1 -- 172.21.15.44:0/612690530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0c0c92d0 con 0x7faa0c0cd9c0 2023-11-04T01:42:19.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.819+0000 7faa131a5640 1 -- 172.21.15.44:0/612690530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0c0684b0 con 0x7faa0c0cd9c0 2023-11-04T01:42:19.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.819+0000 7faa097fa640 1 -- 172.21.15.44:0/612690530 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa9f8007450 con 0x7faa0c0cd9c0 2023-11-04T01:42:19.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.820+0000 7faa097fa640 1 --2- 172.21.15.44:0/612690530 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa9f006aea0 0x7fa9f006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.820+0000 7faa097fa640 1 -- 172.21.15.44:0/612690530 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7fa9f8089260 con 0x7faa0c0cd9c0 2023-11-04T01:42:19.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.820+0000 7faa10f41640 1 --2- 172.21.15.44:0/612690530 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa9f006aea0 0x7fa9f006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.821+0000 7faa10f41640 1 --2- 172.21.15.44:0/612690530 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa9f006aea0 0x7fa9f006d360 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7faa00036000 tx=0x7faa00008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.824+0000 7faa097fa640 1 -- 172.21.15.44:0/612690530 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa9f8053c80 con 0x7faa0c0cd9c0 2023-11-04T01:42:20.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.997+0000 7faa131a5640 1 -- 172.21.15.44:0/612690530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7faa0c0c9490 con 0x7faa0c0cd9c0 2023-11-04T01:42:20.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:19.998+0000 7faa097fa640 1 -- 172.21.15.44:0/612690530 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v108) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa9f80170b0 con 0x7faa0c0cd9c0 2023-11-04T01:42:20.000 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:42:20.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.000+0000 7faa131a5640 1 -- 172.21.15.44:0/612690530 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa9f006aea0 msgr2=0x7fa9f006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.000+0000 7faa131a5640 1 --2- 172.21.15.44:0/612690530 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa9f006aea0 0x7fa9f006d360 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7faa00036000 tx=0x7faa00008030 comp rx=0 tx=0).stop 2023-11-04T01:42:20.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.000+0000 7faa131a5640 1 -- 172.21.15.44:0/612690530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa0c0cd9c0 msgr2=0x7faa0c153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.000+0000 7faa131a5640 1 --2- 172.21.15.44:0/612690530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa0c0cd9c0 0x7faa0c153610 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800c430 tx=0x7fa9f800c830 comp rx=0 tx=0).stop 2023-11-04T01:42:20.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.000+0000 7faa131a5640 1 -- 172.21.15.44:0/612690530 shutdown_connections 2023-11-04T01:42:20.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.000+0000 7faa131a5640 1 --2- 172.21.15.44:0/612690530 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa9f006aea0 0x7fa9f006d360 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.000+0000 7faa131a5640 1 --2- 172.21.15.44:0/612690530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa0c15b200 0x7faa0c15dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.000+0000 7faa131a5640 1 --2- 172.21.15.44:0/612690530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa0c0cd9c0 0x7faa0c153610 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.000+0000 7faa131a5640 1 --2- 172.21.15.44:0/612690530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa0c0afda0 0x7faa0c0ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.000+0000 7faa131a5640 1 -- 172.21.15.44:0/612690530 >> 172.21.15.44:0/612690530 conn(0x7faa0c0d0c30 msgr2=0x7faa0c0af320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.000+0000 7faa131a5640 1 -- 172.21.15.44:0/612690530 shutdown_connections 2023-11-04T01:42:20.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.000+0000 7faa131a5640 1 -- 172.21.15.44:0/612690530 wait complete. 2023-11-04T01:42:20.012 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:20.121 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.120+0000 7fccefada640 1 Processor -- start 2023-11-04T01:42:20.122 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.120+0000 7fccefada640 1 -- start start 2023-11-04T01:42:20.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.121+0000 7fccefada640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcce806c5f0 0x7fcce8165ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.121+0000 7fccefada640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce806cc90 con 0x7fcce806d9c0 2023-11-04T01:42:20.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.121+0000 7fccefada640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce80b0e60 con 0x7fcce80ade00 2023-11-04T01:42:20.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.121+0000 7fccefada640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce80b0c40 con 0x7fcce806c5f0 2023-11-04T01:42:20.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.121+0000 7fccee077640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcce806c5f0 0x7fcce8165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.121+0000 7fcced075640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcce806d9c0 0x7fcce80710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51454/0 (socket says 172.21.15.44:51454) 2023-11-04T01:42:20.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.121+0000 7fcced075640 1 -- 172.21.15.44:0/69217529 learned_addr learned my addr 172.21.15.44:0/69217529 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:20.123 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.121+0000 7fccee077640 1 -- 172.21.15.44:0/69217529 >> v1:172.21.15.204:6789/0 conn(0x7fcce80ade00 legacy=0x7fcce80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:20.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.121+0000 7fccee077640 1 -- 172.21.15.44:0/69217529 >> v1:172.21.15.44:6789/0 conn(0x7fcce806d9c0 legacy=0x7fcce80710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.121+0000 7fccec874640 1 -- 172.21.15.44:0/69217529 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427082326 0 0) 0x7fcce806cc90 con 0x7fcce806d9c0 2023-11-04T01:42:20.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.121+0000 7fccee077640 1 -- 172.21.15.44:0/69217529 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce806cee0 con 0x7fcce806c5f0 2023-11-04T01:42:20.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.122+0000 7fccee077640 1 --2- 172.21.15.44:0/69217529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce806c5f0 0x7fcce8165ce0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009d90 tx=0x7fcce002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a6e82d990fae91 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.122+0000 7fccec874640 1 -- 172.21.15.44:0/69217529 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce002cb60 con 0x7fcce806c5f0 2023-11-04T01:42:20.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.122+0000 7fccec874640 1 -- 172.21.15.44:0/69217529 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce002ccc0 con 0x7fcce806c5f0 2023-11-04T01:42:20.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.122+0000 7fccec874640 1 -- 172.21.15.44:0/69217529 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0034660 con 0x7fcce806c5f0 2023-11-04T01:42:20.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.123+0000 7fccefada640 1 -- 172.21.15.44:0/69217529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce806c5f0 msgr2=0x7fcce8165ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.123+0000 7fccefada640 1 --2- 172.21.15.44:0/69217529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce806c5f0 0x7fcce8165ce0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009d90 tx=0x7fcce002bdb0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.125 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.123+0000 7fccefada640 1 -- 172.21.15.44:0/69217529 shutdown_connections 2023-11-04T01:42:20.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.123+0000 7fccefada640 1 --2- 172.21.15.44:0/69217529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce806c5f0 0x7fcce8165ce0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.123+0000 7fccefada640 1 -- 172.21.15.44:0/69217529 >> 172.21.15.44:0/69217529 conn(0x7fcce80cb530 msgr2=0x7fcce80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.123+0000 7fccefada640 1 -- 172.21.15.44:0/69217529 shutdown_connections 2023-11-04T01:42:20.126 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.123+0000 7fccefada640 1 -- 172.21.15.44:0/69217529 wait complete. 2023-11-04T01:42:20.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.124+0000 7fccefada640 1 Processor -- start 2023-11-04T01:42:20.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.124+0000 7fccefada640 1 -- start start 2023-11-04T01:42:20.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.124+0000 7fccefada640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce806c5f0 0x7fcce80c3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.124+0000 7fccefada640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcce806d9c0 0x7fcce80c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fccefada640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce80ade00 0x7fcce80c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fccefada640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80c4080 con 0x7fcce806c5f0 2023-11-04T01:42:20.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fccefada640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8158ba0 con 0x7fcce80ade00 2023-11-04T01:42:20.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fccefada640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8158e40 con 0x7fcce806d9c0 2023-11-04T01:42:20.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fcced876640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce806c5f0 0x7fcce80c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fcced876640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce806c5f0 0x7fcce80c3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45922/0 (socket says 172.21.15.44:45922) 2023-11-04T01:42:20.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fcced876640 1 -- 172.21.15.44:0/2237657615 learned_addr learned my addr 172.21.15.44:0/2237657615 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:20.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fcced075640 1 --2- 172.21.15.44:0/2237657615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcce806d9c0 0x7fcce80c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fccee077640 1 --2- 172.21.15.44:0/2237657615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce80ade00 0x7fcce80c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fcced876640 1 -- 172.21.15.44:0/2237657615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcce806d9c0 msgr2=0x7fcce80c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fcced876640 1 --2- 172.21.15.44:0/2237657615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcce806d9c0 0x7fcce80c3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fcced876640 1 -- 172.21.15.44:0/2237657615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce80ade00 msgr2=0x7fcce80c2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fcced876640 1 --2- 172.21.15.44:0/2237657615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce80ade00 0x7fcce80c2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fcced876640 1 -- 172.21.15.44:0/2237657615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce0009a70 con 0x7fcce806c5f0 2023-11-04T01:42:20.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fcced876640 1 --2- 172.21.15.44:0/2237657615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce806c5f0 0x7fcce80c3600 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fcce400b3e0 tx=0x7fcce400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fccde7fc640 1 -- 172.21.15.44:0/2237657615 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4011830 con 0x7fcce806c5f0 2023-11-04T01:42:20.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fccde7fc640 1 -- 172.21.15.44:0/2237657615 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce40119b0 con 0x7fcce806c5f0 2023-11-04T01:42:20.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fccde7fc640 1 -- 172.21.15.44:0/2237657615 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4011d60 con 0x7fcce806c5f0 2023-11-04T01:42:20.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fccefada640 1 -- 172.21.15.44:0/2237657615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce8159120 con 0x7fcce806c5f0 2023-11-04T01:42:20.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.125+0000 7fccefada640 1 -- 172.21.15.44:0/2237657615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce81596e0 con 0x7fcce806c5f0 2023-11-04T01:42:20.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.126+0000 7fccefada640 1 -- 172.21.15.44:0/2237657615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce80684b0 con 0x7fcce806c5f0 2023-11-04T01:42:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.127+0000 7fccde7fc640 1 -- 172.21.15.44:0/2237657615 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcce401a400 con 0x7fcce806c5f0 2023-11-04T01:42:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.127+0000 7fccde7fc640 1 --2- 172.21.15.44:0/2237657615 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcccc06ae70 0x7fcccc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.127+0000 7fccde7fc640 1 -- 172.21.15.44:0/2237657615 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7fcce4089ed0 con 0x7fcce806c5f0 2023-11-04T01:42:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.128+0000 7fcced075640 1 --2- 172.21.15.44:0/2237657615 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcccc06ae70 0x7fcccc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.128+0000 7fcced075640 1 --2- 172.21.15.44:0/2237657615 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcccc06ae70 0x7fcccc06d330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fcce8157d60 tx=0x7fccd8007c00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.132+0000 7fccde7fc640 1 -- 172.21.15.44:0/2237657615 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcce4054840 con 0x7fcce806c5f0 2023-11-04T01:42:20.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.309+0000 7fccefada640 1 -- 172.21.15.44:0/2237657615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcce806d4a0 con 0x7fcce806c5f0 2023-11-04T01:42:20.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.309+0000 7fccde7fc640 1 -- 172.21.15.44:0/2237657615 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcce40150a0 con 0x7fcce806c5f0 2023-11-04T01:42:20.311 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:42:20.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.311+0000 7fccefada640 1 -- 172.21.15.44:0/2237657615 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcccc06ae70 msgr2=0x7fcccc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.311+0000 7fccefada640 1 --2- 172.21.15.44:0/2237657615 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcccc06ae70 0x7fcccc06d330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fcce8157d60 tx=0x7fccd8007c00 comp rx=0 tx=0).stop 2023-11-04T01:42:20.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.311+0000 7fccefada640 1 -- 172.21.15.44:0/2237657615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce806c5f0 msgr2=0x7fcce80c3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.311+0000 7fccefada640 1 --2- 172.21.15.44:0/2237657615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce806c5f0 0x7fcce80c3600 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fcce400b3e0 tx=0x7fcce400b8a0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.311+0000 7fccefada640 1 -- 172.21.15.44:0/2237657615 shutdown_connections 2023-11-04T01:42:20.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.311+0000 7fccefada640 1 --2- 172.21.15.44:0/2237657615 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fcccc06ae70 0x7fcccc06d330 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.311+0000 7fccefada640 1 --2- 172.21.15.44:0/2237657615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce80ade00 0x7fcce80c2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.311+0000 7fccefada640 1 --2- 172.21.15.44:0/2237657615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcce806d9c0 0x7fcce80c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.311+0000 7fccefada640 1 --2- 172.21.15.44:0/2237657615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcce806c5f0 0x7fcce80c3600 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.311+0000 7fccefada640 1 -- 172.21.15.44:0/2237657615 >> 172.21.15.44:0/2237657615 conn(0x7fcce80cb530 msgr2=0x7fcce80b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.311+0000 7fccefada640 1 -- 172.21.15.44:0/2237657615 shutdown_connections 2023-11-04T01:42:20.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.311+0000 7fccefada640 1 -- 172.21.15.44:0/2237657615 wait complete. 2023-11-04T01:42:20.324 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:20.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.431+0000 7f61dd4e1640 1 Processor -- start 2023-11-04T01:42:20.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.431+0000 7f61dd4e1640 1 -- start start 2023-11-04T01:42:20.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.432+0000 7f61dd4e1640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f61d8159e40 0x7f61d80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.432+0000 7f61dd4e1640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d8071500 con 0x7f61d8070700 2023-11-04T01:42:20.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.432+0000 7f61dd4e1640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d815dae0 con 0x7f61d806bb60 2023-11-04T01:42:20.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.432+0000 7f61dd4e1640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d8070c60 con 0x7f61d8159e40 2023-11-04T01:42:20.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.432+0000 7f61d77fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f61d8070700 0x7f61d80cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51468/0 (socket says 172.21.15.44:51468) 2023-11-04T01:42:20.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.432+0000 7f61d77fe640 1 -- 172.21.15.44:0/40854889 learned_addr learned my addr 172.21.15.44:0/40854889 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:20.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.432+0000 7f61d6ffd640 1 --2- 172.21.15.44:0/40854889 >> v2:172.21.15.204:3300/0 conn(0x7f61d8159e40 0x7f61d80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.432+0000 7f61d5ffb640 1 -- 172.21.15.44:0/40854889 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218902791 0 0) 0x7f61d8071500 con 0x7f61d8070700 2023-11-04T01:42:20.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.432+0000 7f61d5ffb640 1 -- 172.21.15.44:0/40854889 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c0003520 con 0x7f61d8070700 2023-11-04T01:42:20.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.433+0000 7f61d6ffd640 1 -- 172.21.15.44:0/40854889 >> v1:172.21.15.204:6789/0 conn(0x7f61d806bb60 legacy=0x7f61d806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.433+0000 7f61d6ffd640 1 -- 172.21.15.44:0/40854889 >> v1:172.21.15.44:6789/0 conn(0x7f61d8070700 legacy=0x7f61d80cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.433+0000 7f61d6ffd640 1 -- 172.21.15.44:0/40854889 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d8070f40 con 0x7f61d8159e40 2023-11-04T01:42:20.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.433+0000 7f61d6ffd640 1 --2- 172.21.15.44:0/40854889 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61d8159e40 0x7f61d80b0530 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f61d00097a0 tx=0x7f61d002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14e0b801071e0a5b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.434+0000 7f61d5ffb640 1 -- 172.21.15.44:0/40854889 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d002e070 con 0x7f61d8159e40 2023-11-04T01:42:20.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.434+0000 7f61d5ffb640 1 -- 172.21.15.44:0/40854889 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d00315a0 con 0x7f61d8159e40 2023-11-04T01:42:20.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.434+0000 7f61d5ffb640 1 -- 172.21.15.44:0/40854889 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0031930 con 0x7f61d8159e40 2023-11-04T01:42:20.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.434+0000 7f61dd4e1640 1 -- 172.21.15.44:0/40854889 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61d8159e40 msgr2=0x7f61d80b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.434+0000 7f61dd4e1640 1 --2- 172.21.15.44:0/40854889 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61d8159e40 0x7f61d80b0530 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f61d00097a0 tx=0x7f61d002b840 comp rx=0 tx=0).stop 2023-11-04T01:42:20.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.434+0000 7f61dd4e1640 1 -- 172.21.15.44:0/40854889 shutdown_connections 2023-11-04T01:42:20.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.434+0000 7f61dd4e1640 1 --2- 172.21.15.44:0/40854889 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61d8159e40 0x7f61d80b0530 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.434+0000 7f61dd4e1640 1 -- 172.21.15.44:0/40854889 >> 172.21.15.44:0/40854889 conn(0x7f61d80cb530 msgr2=0x7f61d80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.434+0000 7f61dd4e1640 1 -- 172.21.15.44:0/40854889 shutdown_connections 2023-11-04T01:42:20.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.434+0000 7f61dd4e1640 1 -- 172.21.15.44:0/40854889 wait complete. 2023-11-04T01:42:20.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.435+0000 7f61dd4e1640 1 Processor -- start 2023-11-04T01:42:20.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.436+0000 7f61dd4e1640 1 -- start start 2023-11-04T01:42:20.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.436+0000 7f61dd4e1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61d806bb60 0x7f61d80c1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.436+0000 7f61dd4e1640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61d8070700 0x7f61d8146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.436+0000 7f61dd4e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61d8159e40 0x7f61d8144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.436+0000 7f61dd4e1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80c1660 con 0x7f61d8159e40 2023-11-04T01:42:20.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.436+0000 7f61dd4e1640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d8146a60 con 0x7f61d8070700 2023-11-04T01:42:20.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.436+0000 7f61dd4e1640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d8145480 con 0x7f61d806bb60 2023-11-04T01:42:20.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.436+0000 7f61d77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61d8159e40 0x7f61d8144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.436+0000 7f61d77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61d8159e40 0x7f61d8144c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45938/0 (socket says 172.21.15.44:45938) 2023-11-04T01:42:20.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.436+0000 7f61d77fe640 1 -- 172.21.15.44:0/605110109 learned_addr learned my addr 172.21.15.44:0/605110109 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:20.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.437+0000 7f61d67fc640 1 --2- 172.21.15.44:0/605110109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61d8070700 0x7f61d8146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.437+0000 7f61d6ffd640 1 --2- 172.21.15.44:0/605110109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61d806bb60 0x7f61d80c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.437+0000 7f61d77fe640 1 -- 172.21.15.44:0/605110109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61d806bb60 msgr2=0x7f61d80c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.437+0000 7f61d77fe640 1 --2- 172.21.15.44:0/605110109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61d806bb60 0x7f61d80c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.437+0000 7f61d77fe640 1 -- 172.21.15.44:0/605110109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61d8070700 msgr2=0x7f61d8146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.437+0000 7f61d77fe640 1 --2- 172.21.15.44:0/605110109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61d8070700 0x7f61d8146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.437+0000 7f61d77fe640 1 -- 172.21.15.44:0/605110109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d0009400 con 0x7f61d8159e40 2023-11-04T01:42:20.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.437+0000 7f61d77fe640 1 --2- 172.21.15.44:0/605110109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61d8159e40 0x7f61d8144c30 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f61c800cb40 tx=0x7f61c800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.437+0000 7f61bf7fe640 1 -- 172.21.15.44:0/605110109 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c800aca0 con 0x7f61d8159e40 2023-11-04T01:42:20.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.437+0000 7f61bf7fe640 1 -- 172.21.15.44:0/605110109 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c800ae00 con 0x7f61d8159e40 2023-11-04T01:42:20.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.437+0000 7f61dd4e1640 1 -- 172.21.15.44:0/605110109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d8145760 con 0x7f61d8159e40 2023-11-04T01:42:20.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.437+0000 7f61bf7fe640 1 -- 172.21.15.44:0/605110109 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8012620 con 0x7f61d8159e40 2023-11-04T01:42:20.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.437+0000 7f61dd4e1640 1 -- 172.21.15.44:0/605110109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d8145d20 con 0x7f61d8159e40 2023-11-04T01:42:20.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.438+0000 7f61dd4e1640 1 -- 172.21.15.44:0/605110109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d80aedd0 con 0x7f61d8159e40 2023-11-04T01:42:20.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.439+0000 7f61bf7fe640 1 -- 172.21.15.44:0/605110109 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61c8007070 con 0x7f61d8159e40 2023-11-04T01:42:20.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.439+0000 7f61bf7fe640 1 --2- 172.21.15.44:0/605110109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f61c406ae70 0x7f61c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.439+0000 7f61bf7fe640 1 -- 172.21.15.44:0/605110109 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f61c8089dc0 con 0x7f61d8159e40 2023-11-04T01:42:20.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.439+0000 7f61d6ffd640 1 --2- 172.21.15.44:0/605110109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f61c406ae70 0x7f61c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.440+0000 7f61d6ffd640 1 --2- 172.21.15.44:0/605110109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f61c406ae70 0x7f61c406d330 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f61d0036000 tx=0x7f61d003d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.443+0000 7f61bf7fe640 1 -- 172.21.15.44:0/605110109 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f61c8054730 con 0x7f61d8159e40 2023-11-04T01:42:20.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.619+0000 7f61dd4e1640 1 -- 172.21.15.44:0/605110109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f61d80684b0 con 0x7f61d8159e40 2023-11-04T01:42:20.621 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.620+0000 7f61bf7fe640 1 -- 172.21.15.44:0/605110109 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) v1 ==== 100+0+11 (secure 0 0 0) 0x7f61c8057d50 con 0x7f61d8159e40 2023-11-04T01:42:20.622 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:42:20.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.622+0000 7f61dd4e1640 1 -- 172.21.15.44:0/605110109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f61c406ae70 msgr2=0x7f61c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.622+0000 7f61dd4e1640 1 --2- 172.21.15.44:0/605110109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f61c406ae70 0x7f61c406d330 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f61d0036000 tx=0x7f61d003d040 comp rx=0 tx=0).stop 2023-11-04T01:42:20.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.622+0000 7f61dd4e1640 1 -- 172.21.15.44:0/605110109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61d8159e40 msgr2=0x7f61d8144c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.622+0000 7f61dd4e1640 1 --2- 172.21.15.44:0/605110109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61d8159e40 0x7f61d8144c30 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f61c800cb40 tx=0x7f61c800a060 comp rx=0 tx=0).stop 2023-11-04T01:42:20.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.622+0000 7f61dd4e1640 1 -- 172.21.15.44:0/605110109 shutdown_connections 2023-11-04T01:42:20.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.622+0000 7f61dd4e1640 1 --2- 172.21.15.44:0/605110109 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f61c406ae70 0x7f61c406d330 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.622+0000 7f61dd4e1640 1 --2- 172.21.15.44:0/605110109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61d8159e40 0x7f61d8144c30 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.622+0000 7f61dd4e1640 1 --2- 172.21.15.44:0/605110109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61d8070700 0x7f61d8146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.622+0000 7f61dd4e1640 1 --2- 172.21.15.44:0/605110109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61d806bb60 0x7f61d80c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.622+0000 7f61dd4e1640 1 -- 172.21.15.44:0/605110109 >> 172.21.15.44:0/605110109 conn(0x7f61d80cb530 msgr2=0x7f61d80ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.622+0000 7f61dd4e1640 1 -- 172.21.15.44:0/605110109 shutdown_connections 2023-11-04T01:42:20.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.622+0000 7f61dd4e1640 1 -- 172.21.15.44:0/605110109 wait complete. 2023-11-04T01:42:20.634 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:42:20.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.739+0000 7f5755905640 1 Processor -- start 2023-11-04T01:42:20.741 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.739+0000 7f5755905640 1 -- start start 2023-11-04T01:42:20.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.740+0000 7f5755905640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f575015d100 0x7f57500ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.740+0000 7f5755905640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f575015d4e0 0x7f57500d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.740+0000 7f5755905640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f57500d3b60 0x7f57500d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.740+0000 7f5755905640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57500b32b0 con 0x7f57500d3b60 2023-11-04T01:42:20.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.740+0000 7f5755905640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57500cee10 con 0x7f575015d4e0 2023-11-04T01:42:20.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.740+0000 7f5755905640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57500b2980 con 0x7f575015d100 2023-11-04T01:42:20.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.740+0000 7f574f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f57500d3b60 0x7f57500d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.740+0000 7f574f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f57500d3b60 0x7f57500d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45944/0 (socket says 172.21.15.44:45944) 2023-11-04T01:42:20.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.740+0000 7f574f7fe640 1 -- 172.21.15.44:0/425483967 learned_addr learned my addr 172.21.15.44:0/425483967 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:20.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.741+0000 7f574e7fc640 1 --2- 172.21.15.44:0/425483967 >> v2:172.21.15.204:3300/0 conn(0x7f575015d4e0 0x7f57500d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.741+0000 7f574effd640 1 --2- 172.21.15.44:0/425483967 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f575015d100 0x7f57500ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.741+0000 7f574f7fe640 1 -- 172.21.15.44:0/425483967 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f575015d100 msgr2=0x7f57500ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:20.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.741+0000 7f574f7fe640 1 --2- 172.21.15.44:0/425483967 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f575015d100 0x7f57500ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.741+0000 7f574f7fe640 1 -- 172.21.15.44:0/425483967 >> v2:172.21.15.204:3300/0 conn(0x7f575015d4e0 msgr2=0x7f57500d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:20.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.741+0000 7f574f7fe640 1 --2- 172.21.15.44:0/425483967 >> v2:172.21.15.204:3300/0 conn(0x7f575015d4e0 0x7f57500d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.741+0000 7f574f7fe640 1 -- 172.21.15.44:0/425483967 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57500b2c60 con 0x7f57500d3b60 2023-11-04T01:42:20.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.741+0000 7f574f7fe640 1 --2- 172.21.15.44:0/425483967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57500d3b60 0x7f57500d1a10 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f575008bf20 tx=0x7f574002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd076b15aff4a992 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.742+0000 7f574dffb640 1 -- 172.21.15.44:0/425483967 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574002ca70 con 0x7f57500d3b60 2023-11-04T01:42:20.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.742+0000 7f574dffb640 1 -- 172.21.15.44:0/425483967 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574002cbd0 con 0x7f57500d3b60 2023-11-04T01:42:20.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.742+0000 7f574dffb640 1 -- 172.21.15.44:0/425483967 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57400343f0 con 0x7f57500d3b60 2023-11-04T01:42:20.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.742+0000 7f5755905640 1 -- 172.21.15.44:0/425483967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57500d3b60 msgr2=0x7f57500d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.742+0000 7f5755905640 1 --2- 172.21.15.44:0/425483967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57500d3b60 0x7f57500d1a10 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f575008bf20 tx=0x7f574002bed0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.742+0000 7f5755905640 1 -- 172.21.15.44:0/425483967 shutdown_connections 2023-11-04T01:42:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.742+0000 7f5755905640 1 --2- 172.21.15.44:0/425483967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57500d3b60 0x7f57500d1a10 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.742+0000 7f5755905640 1 --2- 172.21.15.44:0/425483967 >> v2:172.21.15.204:3300/0 conn(0x7f575015d4e0 0x7f57500d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.742+0000 7f5755905640 1 --2- 172.21.15.44:0/425483967 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f575015d100 0x7f57500ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.742+0000 7f5755905640 1 -- 172.21.15.44:0/425483967 >> 172.21.15.44:0/425483967 conn(0x7f57500d2ef0 msgr2=0x7f57500d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.742+0000 7f5755905640 1 -- 172.21.15.44:0/425483967 shutdown_connections 2023-11-04T01:42:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.742+0000 7f5755905640 1 -- 172.21.15.44:0/425483967 wait complete. 2023-11-04T01:42:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.743+0000 7f5755905640 1 Processor -- start 2023-11-04T01:42:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.744+0000 7f5755905640 1 -- start start 2023-11-04T01:42:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.744+0000 7f5755905640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57500d3b60 0x7f57501f3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.744+0000 7f5755905640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f575015d100 0x7f575015b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.744+0000 7f5755905640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f575015d4e0 0x7f575009f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.744+0000 7f5755905640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57501f35a0 con 0x7f575015d100 2023-11-04T01:42:20.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.744+0000 7f5755905640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575009da60 con 0x7f575015d4e0 2023-11-04T01:42:20.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.744+0000 7f5755905640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575009dd40 con 0x7f57500d3b60 2023-11-04T01:42:20.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.744+0000 7f574e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f575015d100 0x7f575015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.745+0000 7f574e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f575015d100 0x7f575015b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45952/0 (socket says 172.21.15.44:45952) 2023-11-04T01:42:20.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.745+0000 7f574e7fc640 1 -- 172.21.15.44:0/3141006740 learned_addr learned my addr 172.21.15.44:0/3141006740 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:20.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.745+0000 7f574effd640 1 --2- 172.21.15.44:0/3141006740 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57500d3b60 0x7f57501f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.745+0000 7f574f7fe640 1 --2- 172.21.15.44:0/3141006740 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f575015d4e0 0x7f575009f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.745+0000 7f574e7fc640 1 -- 172.21.15.44:0/3141006740 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57500d3b60 msgr2=0x7f57501f3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.745+0000 7f574e7fc640 1 --2- 172.21.15.44:0/3141006740 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57500d3b60 0x7f57501f3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.745+0000 7f574e7fc640 1 -- 172.21.15.44:0/3141006740 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f575015d4e0 msgr2=0x7f575009f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.749 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.745+0000 7f574e7fc640 1 --2- 172.21.15.44:0/3141006740 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f575015d4e0 0x7f575009f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.745+0000 7f574e7fc640 1 -- 172.21.15.44:0/3141006740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5740009b30 con 0x7f575015d100 2023-11-04T01:42:20.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.745+0000 7f574e7fc640 1 --2- 172.21.15.44:0/3141006740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f575015d100 0x7f575015b380 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f573800d800 tx=0x7f573800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.745+0000 7f5747fff640 1 -- 172.21.15.44:0/3141006740 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573800b6c0 con 0x7f575015d100 2023-11-04T01:42:20.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.745+0000 7f5747fff640 1 -- 172.21.15.44:0/3141006740 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573800b820 con 0x7f575015d100 2023-11-04T01:42:20.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.745+0000 7f5747fff640 1 -- 172.21.15.44:0/3141006740 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573800bbb0 con 0x7f575015d100 2023-11-04T01:42:20.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.745+0000 7f5755905640 1 -- 172.21.15.44:0/3141006740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575009e020 con 0x7f575015d100 2023-11-04T01:42:20.750 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.745+0000 7f5755905640 1 -- 172.21.15.44:0/3141006740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575009e5e0 con 0x7f575015d100 2023-11-04T01:42:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.746+0000 7f5755905640 1 -- 172.21.15.44:0/3141006740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57500684b0 con 0x7f575015d100 2023-11-04T01:42:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.747+0000 7f5747fff640 1 -- 172.21.15.44:0/3141006740 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f573800bd10 con 0x7f575015d100 2023-11-04T01:42:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.747+0000 7f5747fff640 1 --2- 172.21.15.44:0/3141006740 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f573006ae70 0x7f573006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.747+0000 7f5747fff640 1 -- 172.21.15.44:0/3141006740 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f573808a2f0 con 0x7f575015d100 2023-11-04T01:42:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.747+0000 7f574effd640 1 --2- 172.21.15.44:0/3141006740 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f573006ae70 0x7f573006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.748+0000 7f574effd640 1 --2- 172.21.15.44:0/3141006740 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f573006ae70 0x7f573006d330 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f57480096f0 tx=0x7f5748008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.753 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.751+0000 7f5747fff640 1 -- 172.21.15.44:0/3141006740 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5738054c60 con 0x7f575015d100 2023-11-04T01:42:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.939+0000 7f5755905640 1 -- 172.21.15.44:0/3141006740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f57500d2cd0 con 0x7f575015d100 2023-11-04T01:42:20.941 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.939+0000 7f5747fff640 1 -- 172.21.15.44:0/3141006740 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 13 entries v108) v1 ==== 81+0+794 (secure 0 0 0) 0x7f5738058280 con 0x7f575015d100 2023-11-04T01:42:20.942 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/3065829953 2023-11-05T01:41:05.691698+0000 2023-11-04T01:42:20.942 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/3287638895 2023-11-05T01:41:58.941997+0000 2023-11-04T01:42:20.942 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/3065829953 2023-11-05T01:41:05.691698+0000 2023-11-04T01:42:20.942 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/1627866359 2023-11-05T01:41:31.011032+0000 2023-11-04T01:42:20.942 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/2252282753 2023-11-05T01:40:40.408324+0000 2023-11-04T01:42:20.942 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.1:0/780133444 2023-11-04T02:42:14.050728+0000 2023-11-04T01:42:20.942 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/2069525699 2023-11-05T01:42:05.849526+0000 2023-11-04T01:42:20.942 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/3287638895 2023-11-05T01:41:58.941997+0000 2023-11-04T01:42:20.942 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/2252282753 2023-11-05T01:40:40.408324+0000 2023-11-04T01:42:20.943 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/1627866359 2023-11-05T01:41:31.011032+0000 2023-11-04T01:42:20.943 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/2461924520 2023-11-05T01:40:15.032018+0000 2023-11-04T01:42:20.943 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6832/2069525699 2023-11-05T01:42:05.849526+0000 2023-11-04T01:42:20.943 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/2461924520 2023-11-05T01:40:15.032018+0000 2023-11-04T01:42:20.944 INFO:teuthology.orchestra.run.smithi044.stderr:listed 13 entries 2023-11-04T01:42:20.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.941+0000 7f5755905640 1 -- 172.21.15.44:0/3141006740 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f573006ae70 msgr2=0x7f573006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.941+0000 7f5755905640 1 --2- 172.21.15.44:0/3141006740 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f573006ae70 0x7f573006d330 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f57480096f0 tx=0x7f5748008040 comp rx=0 tx=0).stop 2023-11-04T01:42:20.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.941+0000 7f5755905640 1 -- 172.21.15.44:0/3141006740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f575015d100 msgr2=0x7f575015b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.941+0000 7f5755905640 1 --2- 172.21.15.44:0/3141006740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f575015d100 0x7f575015b380 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f573800d800 tx=0x7f573800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.941+0000 7f5755905640 1 -- 172.21.15.44:0/3141006740 shutdown_connections 2023-11-04T01:42:20.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.941+0000 7f5755905640 1 --2- 172.21.15.44:0/3141006740 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f573006ae70 0x7f573006d330 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.941+0000 7f5755905640 1 --2- 172.21.15.44:0/3141006740 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f575015d4e0 0x7f575009f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.941+0000 7f5755905640 1 --2- 172.21.15.44:0/3141006740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f575015d100 0x7f575015b380 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.941+0000 7f5755905640 1 --2- 172.21.15.44:0/3141006740 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57500d3b60 0x7f57501f3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.941+0000 7f5755905640 1 -- 172.21.15.44:0/3141006740 >> 172.21.15.44:0/3141006740 conn(0x7f57500d2ef0 msgr2=0x7f57500d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.941+0000 7f5755905640 1 -- 172.21.15.44:0/3141006740 shutdown_connections 2023-11-04T01:42:20.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:20.941+0000 7f5755905640 1 -- 172.21.15.44:0/3141006740 wait complete. 2023-11-04T01:42:20.954 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:42:20.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:20.954 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:20.983 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[117603]: fuse finished with error 0 and tester_r 0 2023-11-04T01:42:20.985 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:42:20.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:20.986 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:42:21.041 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:42:21.041 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:21.097 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:42:21.097 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:42:21.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.243+0000 7f7392210640 1 Processor -- start 2023-11-04T01:42:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.243+0000 7f7392210640 1 -- start start 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.243+0000 7f7392210640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f738c0b0c40 0x7f738c06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.243+0000 7f7392210640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c071500 con 0x7f738c06bb60 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.243+0000 7f7392210640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c15dae0 con 0x7f738c159e40 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.243+0000 7f7392210640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c070c60 con 0x7f738c0b0c40 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.244+0000 7f738bfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f738c06bb60 0x7f738c0cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51470/0 (socket says 172.21.15.44:51470) 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.244+0000 7f738bfff640 1 -- 172.21.15.44:0/4064079043 learned_addr learned my addr 172.21.15.44:0/4064079043 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.244+0000 7f738affd640 1 --2- 172.21.15.44:0/4064079043 >> v2:172.21.15.204:3300/0 conn(0x7f738c0b0c40 0x7f738c06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.244+0000 7f738a7fc640 1 -- 172.21.15.44:0/4064079043 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802867020 0 0) 0x7f738c071500 con 0x7f738c06bb60 2023-11-04T01:42:21.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.244+0000 7f738a7fc640 1 -- 172.21.15.44:0/4064079043 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7374003520 con 0x7f738c06bb60 2023-11-04T01:42:21.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.244+0000 7f738affd640 1 -- 172.21.15.44:0/4064079043 >> v1:172.21.15.204:6789/0 conn(0x7f738c159e40 legacy=0x7f738c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.244+0000 7f738a7fc640 1 -- 172.21.15.44:0/4064079043 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 919989756 0 0) 0x7f7374003520 con 0x7f738c06bb60 2023-11-04T01:42:21.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.244+0000 7f738affd640 1 -- 172.21.15.44:0/4064079043 >> v1:172.21.15.44:6789/0 conn(0x7f738c06bb60 legacy=0x7f738c0cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.247 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.244+0000 7f738affd640 1 -- 172.21.15.44:0/4064079043 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c070f40 con 0x7f738c0b0c40 2023-11-04T01:42:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.245+0000 7f738affd640 1 --2- 172.21.15.44:0/4064079043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f738c0b0c40 0x7f738c06fff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f73800097a0 tx=0x7f738002b600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dde764378d5277d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.245+0000 7f738a7fc640 1 -- 172.21.15.44:0/4064079043 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73840019f0 con 0x7f738c0b0c40 2023-11-04T01:42:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.245+0000 7f738a7fc640 1 -- 172.21.15.44:0/4064079043 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738002e050 con 0x7f738c0b0c40 2023-11-04T01:42:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.245+0000 7f738a7fc640 1 -- 172.21.15.44:0/4064079043 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380030510 con 0x7f738c0b0c40 2023-11-04T01:42:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.246+0000 7f7392210640 1 -- 172.21.15.44:0/4064079043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f738c0b0c40 msgr2=0x7f738c06fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.246+0000 7f7392210640 1 --2- 172.21.15.44:0/4064079043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f738c0b0c40 0x7f738c06fff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f73800097a0 tx=0x7f738002b600 comp rx=0 tx=0).stop 2023-11-04T01:42:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.246+0000 7f7392210640 1 -- 172.21.15.44:0/4064079043 shutdown_connections 2023-11-04T01:42:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.246+0000 7f7392210640 1 --2- 172.21.15.44:0/4064079043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f738c0b0c40 0x7f738c06fff0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.246+0000 7f7392210640 1 -- 172.21.15.44:0/4064079043 >> 172.21.15.44:0/4064079043 conn(0x7f738c0cb530 msgr2=0x7f738c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.246+0000 7f7392210640 1 -- 172.21.15.44:0/4064079043 shutdown_connections 2023-11-04T01:42:21.249 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.246+0000 7f7392210640 1 -- 172.21.15.44:0/4064079043 wait complete. 2023-11-04T01:42:21.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.247+0000 7f7392210640 1 Processor -- start 2023-11-04T01:42:21.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.247+0000 7f7392210640 1 -- start start 2023-11-04T01:42:21.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f7392210640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f738c06bb60 0x7f738c0c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f7392210640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f738c0b0c40 0x7f738c0c3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f7392210640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f738c159e40 0x7f738c0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f7392210640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c156690 con 0x7f738c159e40 2023-11-04T01:42:21.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f7392210640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c156390 con 0x7f738c0b0c40 2023-11-04T01:42:21.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f7392210640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0c3860 con 0x7f738c06bb60 2023-11-04T01:42:21.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f738bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f738c159e40 0x7f738c0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.251 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f738bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f738c159e40 0x7f738c0cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45960/0 (socket says 172.21.15.44:45960) 2023-11-04T01:42:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f738bfff640 1 -- 172.21.15.44:0/3580402257 learned_addr learned my addr 172.21.15.44:0/3580402257 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f738affd640 1 --2- 172.21.15.44:0/3580402257 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f738c0b0c40 0x7f738c0c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f738b7fe640 1 --2- 172.21.15.44:0/3580402257 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f738c06bb60 0x7f738c0c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f738bfff640 1 -- 172.21.15.44:0/3580402257 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f738c06bb60 msgr2=0x7f738c0c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f738bfff640 1 --2- 172.21.15.44:0/3580402257 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f738c06bb60 0x7f738c0c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f738bfff640 1 -- 172.21.15.44:0/3580402257 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f738c0b0c40 msgr2=0x7f738c0c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f738bfff640 1 --2- 172.21.15.44:0/3580402257 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f738c0b0c40 0x7f738c0c3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f738bfff640 1 -- 172.21.15.44:0/3580402257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7380009400 con 0x7f738c159e40 2023-11-04T01:42:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.248+0000 7f738bfff640 1 --2- 172.21.15.44:0/3580402257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f738c159e40 0x7f738c0cf210 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f738400cb20 tx=0x7f7384002080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.249+0000 7f7373fff640 1 -- 172.21.15.44:0/3580402257 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400a700 con 0x7f738c159e40 2023-11-04T01:42:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.249+0000 7f7373fff640 1 -- 172.21.15.44:0/3580402257 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738400a880 con 0x7f738c159e40 2023-11-04T01:42:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.249+0000 7f7392210640 1 -- 172.21.15.44:0/3580402257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c0c3ae0 con 0x7f738c159e40 2023-11-04T01:42:21.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.249+0000 7f7373fff640 1 -- 172.21.15.44:0/3580402257 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400ac30 con 0x7f738c159e40 2023-11-04T01:42:21.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.249+0000 7f7392210640 1 -- 172.21.15.44:0/3580402257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c0c40a0 con 0x7f738c159e40 2023-11-04T01:42:21.253 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.250+0000 7f7392210640 1 -- 172.21.15.44:0/3580402257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c0c4290 con 0x7f738c159e40 2023-11-04T01:42:21.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.250+0000 7f7373fff640 1 -- 172.21.15.44:0/3580402257 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73840070d0 con 0x7f738c159e40 2023-11-04T01:42:21.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.250+0000 7f7373fff640 1 --2- 172.21.15.44:0/3580402257 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f737806ae70 0x7f737806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.251+0000 7f7373fff640 1 -- 172.21.15.44:0/3580402257 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f7384089820 con 0x7f738c159e40 2023-11-04T01:42:21.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.251+0000 7f738b7fe640 1 --2- 172.21.15.44:0/3580402257 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f737806ae70 0x7f737806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.254 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.251+0000 7f738b7fe640 1 --2- 172.21.15.44:0/3580402257 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f737806ae70 0x7f737806d330 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f737c000f60 tx=0x7f737c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.255+0000 7f7373fff640 1 -- 172.21.15.44:0/3580402257 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7384054060 con 0x7f738c159e40 2023-11-04T01:42:21.338 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:42:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:21.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.471+0000 7f7392210640 1 -- 172.21.15.44:0/3580402257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f738c0684b0 con 0x7f738c159e40 2023-11-04T01:42:21.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.471+0000 7f7373fff640 1 -- 172.21.15.44:0/3580402257 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v95) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7384018070 con 0x7f738c159e40 2023-11-04T01:42:21.474 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:42:21.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.473+0000 7f7392210640 1 -- 172.21.15.44:0/3580402257 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f737806ae70 msgr2=0x7f737806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.473+0000 7f7392210640 1 --2- 172.21.15.44:0/3580402257 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f737806ae70 0x7f737806d330 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f737c000f60 tx=0x7f737c009040 comp rx=0 tx=0).stop 2023-11-04T01:42:21.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.473+0000 7f7392210640 1 -- 172.21.15.44:0/3580402257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f738c159e40 msgr2=0x7f738c0cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.473+0000 7f7392210640 1 --2- 172.21.15.44:0/3580402257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f738c159e40 0x7f738c0cf210 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f738400cb20 tx=0x7f7384002080 comp rx=0 tx=0).stop 2023-11-04T01:42:21.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.474+0000 7f7392210640 1 -- 172.21.15.44:0/3580402257 shutdown_connections 2023-11-04T01:42:21.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.474+0000 7f7392210640 1 --2- 172.21.15.44:0/3580402257 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f737806ae70 0x7f737806d330 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.474+0000 7f7392210640 1 --2- 172.21.15.44:0/3580402257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f738c159e40 0x7f738c0cf210 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.474+0000 7f7392210640 1 --2- 172.21.15.44:0/3580402257 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f738c0b0c40 0x7f738c0c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.476 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.474+0000 7f7392210640 1 --2- 172.21.15.44:0/3580402257 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f738c06bb60 0x7f738c0c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.474+0000 7f7392210640 1 -- 172.21.15.44:0/3580402257 >> 172.21.15.44:0/3580402257 conn(0x7f738c0cb530 msgr2=0x7f738c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.474+0000 7f7392210640 1 -- 172.21.15.44:0/3580402257 shutdown_connections 2023-11-04T01:42:21.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:21.474+0000 7f7392210640 1 -- 172.21.15.44:0/3580402257 wait complete. 2023-11-04T01:42:21.486 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:42:21.486 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:42:21.486 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2023-11-04T01:42:21.486 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:42:21.486 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:21.486 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:42:21.486 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:42:21.486 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:42:21.486 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:21.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:21.487 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2023-11-04T01:42:21.502 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:42:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:42:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:42:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2023-11-04T01:42:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:21.503 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:42:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2023-11-04T01:42:21.503 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:42:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:21.503 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2023-11-04T01:42:21.504 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:42:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2023-11-04T01:42:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-04T01:42:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42128sec preferred_lft 42128sec 2023-11-04T01:42:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2023-11-04T01:42:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:21.504 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:42:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2023-11-04T01:42:21.504 INFO:teuthology.orchestra.run.smithi044.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:42:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:42:21.504 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::9082:77ff:fe28:4353/64 scope link 2023-11-04T01:42:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:21.505 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::e49d:e3ff:fe56:d068/64 scope link 2023-11-04T01:42:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:21.505 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether f2:23:83:31:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::f023:83ff:fe31:915/64 scope link 2023-11-04T01:42:21.505 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:21.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:21.506 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:42:21.572 INFO:teuthology.orchestra.run.smithi044.stdout:1 2023-11-04T01:42:21.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:21.574 DEBUG:teuthology.orchestra.run.smithi044:> route 2023-11-04T01:42:21.630 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2023-11-04T01:42:21.630 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:42:21.630 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-04T01:42:21.630 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-04T01:42:21.630 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:42:21.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:21.631 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:42:21.631 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:42:21.631 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:42:21.631 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:42:21.631 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:42:21.631 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:42:21.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:21.736 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2023-11-04T01:42:21.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:42:21.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:42:21.752 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:21.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:21.752 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2023-11-04T01:42:21.823 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:42:21.823 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:21.823 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:21.878 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:21.878 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:21.878 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:21.934 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:21.991 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:42:21.991 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:42:21.991 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:42:21.991 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:42:21.991 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:42:21.991 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:42:21.991 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:42:21.991 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:42:21.991 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:42:21.992 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:42:21.992 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:42:21.992 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:42:21.992 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:21.992 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:42:21.992 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:42:21.992 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:42:21.992 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:42:21.992 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:21.992 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:42:21.992 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:21.992 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:21.993 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:21.993 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:21.993 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:42:21.993 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:42:21.993 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:21.993 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:21.993 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:21.993 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:21.993 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:42:21.993 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:21.993 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:21.993 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:21.993 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:21.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:21.994 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:42:22.046 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:42:22.046 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:42:22.088 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:22.104 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:42:22.104 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:42:22.104 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:42:22.104 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:42:22.104 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:42:22.104 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:42:22.104 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:42:22.104 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:42:22.104 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:42:22.104 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:42:22.104 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:42:22.105 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:42:22.105 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:22.105 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:42:22.105 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:42:22.105 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:42:22.105 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:42:22.105 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:22.105 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:42:22.105 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:22.105 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:22.105 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:22.105 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:22.106 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:42:22.106 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:42:22.106 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:22.106 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:22.106 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:22.106 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:22.106 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:42:22.106 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:22.106 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:22.106 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:22.106 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:22.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:22.107 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:42:22.187 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:42:22.185+0000 7f10fa648480 -1 init, newargv = 0x55da1d7d8b70 newargc=15 2023-11-04T01:42:22.187 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[123203]: starting ceph client 2023-11-04T01:42:22.194 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[123203]: starting fuse 2023-11-04T01:42:23.259 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:23.279 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:42:23.279 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:42:23.279 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:42:23.279 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:42:23.279 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:42:23.280 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:42:23.280 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:42:23.280 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:42:23.280 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:42:23.280 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:42:23.280 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:42:23.280 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:42:23.280 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:23.280 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:42:23.280 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:42:23.280 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:42:23.280 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:42:23.280 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:23.281 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:42:23.281 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:23.281 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:23.281 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:23.281 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:23.281 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:42:23.281 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:42:23.281 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:23.281 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:23.281 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:23.281 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:23.281 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:42:23.281 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:23.282 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:23.282 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:23.282 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:23.282 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:23.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:23.283 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:42:23.342 INFO:teuthology.orchestra.run.smithi044.stdout:41 2023-11-04T01:42:23.342 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:42:23.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:42:23.343 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2023-11-04T01:42:23.343 DEBUG:teuthology.orchestra.run.smithi044:> import re 2023-11-04T01:42:23.343 DEBUG:teuthology.orchestra.run.smithi044:> import os 2023-11-04T01:42:23.344 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2023-11-04T01:42:23.344 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:42:23.344 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2023-11-04T01:42:23.344 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:42:23.344 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2023-11-04T01:42:23.344 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:42:23.345 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:42:23.345 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2023-11-04T01:42:23.345 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2023-11-04T01:42:23.346 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2023-11-04T01:42:23.346 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2023-11-04T01:42:23.346 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:42:23.346 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2023-11-04T01:42:23.346 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:42:23.346 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:42:23.346 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:42:23.346 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2023-11-04T01:42:23.346 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2023-11-04T01:42:23.346 DEBUG:teuthology.orchestra.run.smithi044:> return f 2023-11-04T01:42:23.346 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:42:23.346 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:42:23.347 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2023-11-04T01:42:23.347 DEBUG:teuthology.orchestra.run.smithi044:> ' 2023-11-04T01:42:23.477 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.123203.asok 2023-11-04T01:42:23.481 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:23.488 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.123203.asok 2023-11-04T01:42:23.489 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:23.489 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.123203.asok status 2023-11-04T01:42:23.594 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:23.667 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:42:23.667 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2023-11-04T01:42:23.667 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:42:23.668 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:42:23.668 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2023-11-04T01:42:23.668 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2023-11-04T01:42:23.668 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:42:23.668 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "123203", 2023-11-04T01:42:23.668 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2023-11-04T01:42:23.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:42:23.669 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2023-11-04T01:42:23.669 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2023-11-04T01:42:23.669 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 8337, 2023-11-04T01:42:23.669 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2023-11-04T01:42:23.670 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2023-11-04T01:42:23.670 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2023-11-04T01:42:23.670 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 8337 2023-11-04T01:42:23.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:42:23.670 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:42:23.670 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:42:23.671 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:23.671 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1398028154 2023-11-04T01:42:23.671 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:42:23.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:42:23.671 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:42:23.671 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:42:23.672 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:23.672 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1398028154 2023-11-04T01:42:23.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:42:23.672 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.8337 192.168.0.1:0/1398028154", 2023-11-04T01:42:23.672 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/1398028154", 2023-11-04T01:42:23.673 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2023-11-04T01:42:23.673 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 95, 2023-11-04T01:42:23.673 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 108, 2023-11-04T01:42:23.673 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:42:23.673 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2023-11-04T01:42:23.673 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2023-11-04T01:42:23.674 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:42:23.674 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:23.681 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:23.681 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:42:23.681 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:23.745 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:23.745 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2023-11-04T01:42:23.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:23.752 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:23.752 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:23.752 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:23.815 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:23.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:23.822 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:42:23.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.929+0000 7f55daf33640 1 Processor -- start 2023-11-04T01:42:23.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.929+0000 7f55daf33640 1 -- start start 2023-11-04T01:42:23.934 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.930+0000 7f55daf33640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f55d406c5f0 0x7f55d4165ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.930+0000 7f55daf33640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d406cc90 con 0x7f55d40ade00 2023-11-04T01:42:23.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.930+0000 7f55daf33640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d40b0e60 con 0x7f55d406d9c0 2023-11-04T01:42:23.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.930+0000 7f55daf33640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d40b0c40 con 0x7f55d406c5f0 2023-11-04T01:42:23.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.930+0000 7f55d8ccf640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f55d40ade00 0x7f55d40b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44912/0 (socket says 172.21.15.44:44912) 2023-11-04T01:42:23.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.930+0000 7f55d8ccf640 1 -- 172.21.15.44:0/1828490933 learned_addr learned my addr 172.21.15.44:0/1828490933 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:23.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.930+0000 7f55d37fe640 1 -- 172.21.15.44:0/1828490933 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71971134 0 0) 0x7f55d406cc90 con 0x7f55d40ade00 2023-11-04T01:42:23.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.930+0000 7f55d37fe640 1 -- 172.21.15.44:0/1828490933 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c0003520 con 0x7f55d40ade00 2023-11-04T01:42:23.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.930+0000 7f55d94d0640 1 --2- 172.21.15.44:0/1828490933 >> v2:172.21.15.204:3300/0 conn(0x7f55d406c5f0 0x7f55d4165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.930+0000 7f55d37fe640 1 -- 172.21.15.44:0/1828490933 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 78699309 0 0) 0x7f55c0003520 con 0x7f55d40ade00 2023-11-04T01:42:23.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.930+0000 7f55d37fe640 1 -- 172.21.15.44:0/1828490933 >> v2:172.21.15.204:3300/0 conn(0x7f55d406c5f0 msgr2=0x7f55d4165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:23.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.930+0000 7f55d37fe640 1 --2- 172.21.15.44:0/1828490933 >> v2:172.21.15.204:3300/0 conn(0x7f55d406c5f0 0x7f55d4165ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.930+0000 7f55d37fe640 1 -- 172.21.15.44:0/1828490933 >> v1:172.21.15.204:6789/0 conn(0x7f55d406d9c0 legacy=0x7f55d40710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:23.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.930+0000 7f55d37fe640 1 -- 172.21.15.44:0/1828490933 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d406cee0 con 0x7f55d40ade00 2023-11-04T01:42:23.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d37fe640 1 -- 172.21.15.44:0/1828490933 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f55cc0019f0 con 0x7f55d40ade00 2023-11-04T01:42:23.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d37fe640 1 -- 172.21.15.44:0/1828490933 >> v1:172.21.15.44:6789/0 conn(0x7f55d40ade00 legacy=0x7f55d40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d37fe640 1 --2- 172.21.15.44:0/1828490933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c0003970 0x7f55c0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d37fe640 1 --2- 172.21.15.44:0/1828490933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55c00047c0 0x7f55c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d37fe640 1 --2- 172.21.15.44:0/1828490933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55c00052a0 0x7f55c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d37fe640 1 -- 172.21.15.44:0/1828490933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d40b0c40 con 0x7f55c0003970 2023-11-04T01:42:23.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d37fe640 1 -- 172.21.15.44:0/1828490933 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c000c1f0 con 0x7f55c00047c0 2023-11-04T01:42:23.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d37fe640 1 -- 172.21.15.44:0/1828490933 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c000c3b0 con 0x7f55c00052a0 2023-11-04T01:42:23.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/1828490933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c0003970 0x7f55c0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d3fff640 1 --2- 172.21.15.44:0/1828490933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55c00047c0 0x7f55c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d94d0640 1 --2- 172.21.15.44:0/1828490933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55c00052a0 0x7f55c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d8ccf640 1 -- 172.21.15.44:0/1828490933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55c00052a0 msgr2=0x7f55c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/1828490933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55c00052a0 0x7f55c000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d8ccf640 1 -- 172.21.15.44:0/1828490933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55c00047c0 msgr2=0x7f55c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/1828490933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55c00047c0 0x7f55c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d8ccf640 1 -- 172.21.15.44:0/1828490933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c0003520 con 0x7f55c0003970 2023-11-04T01:42:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.931+0000 7f55d94d0640 1 -- 172.21.15.44:0/1828490933 reap_dead start 2023-11-04T01:42:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.932+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/1828490933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c0003970 0x7f55c0003d70 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f55cc002230 tx=0x7f55c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68821891482f005b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.932+0000 7f55d37fe640 1 -- 172.21.15.44:0/1828490933 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc034630 con 0x7f55c0003970 2023-11-04T01:42:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.932+0000 7f55d37fe640 1 -- 172.21.15.44:0/1828490933 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc02f070 con 0x7f55c0003970 2023-11-04T01:42:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.932+0000 7f55d37fe640 1 -- 172.21.15.44:0/1828490933 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc034a30 con 0x7f55c0003970 2023-11-04T01:42:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.932+0000 7f55daf33640 1 -- 172.21.15.44:0/1828490933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c0003970 msgr2=0x7f55c0003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.932+0000 7f55daf33640 1 --2- 172.21.15.44:0/1828490933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c0003970 0x7f55c0003d70 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f55cc002230 tx=0x7f55c00057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.932+0000 7f55daf33640 1 -- 172.21.15.44:0/1828490933 shutdown_connections 2023-11-04T01:42:23.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.932+0000 7f55daf33640 1 --2- 172.21.15.44:0/1828490933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c0003970 0x7f55c0003d70 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.932+0000 7f55daf33640 1 -- 172.21.15.44:0/1828490933 >> 172.21.15.44:0/1828490933 conn(0x7f55d40cb530 msgr2=0x7f55d40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:23.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.932+0000 7f55daf33640 1 -- 172.21.15.44:0/1828490933 shutdown_connections 2023-11-04T01:42:23.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.932+0000 7f55daf33640 1 -- 172.21.15.44:0/1828490933 wait complete. 2023-11-04T01:42:23.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.934+0000 7f55daf33640 1 Processor -- start 2023-11-04T01:42:23.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.934+0000 7f55daf33640 1 -- start start 2023-11-04T01:42:23.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.934+0000 7f55daf33640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55c0003970 0x7f55d40c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.934+0000 7f55daf33640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55d41537e0 0x7f55d4153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.934+0000 7f55daf33640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d4146bb0 0x7f55d4147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.934+0000 7f55daf33640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d41475a0 con 0x7f55d4146bb0 2023-11-04T01:42:23.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.934+0000 7f55daf33640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d40c72b0 con 0x7f55c0003970 2023-11-04T01:42:23.943 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.934+0000 7f55daf33640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d40c7590 con 0x7f55d41537e0 2023-11-04T01:42:23.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55d94d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d4146bb0 0x7f55d4147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55d94d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d4146bb0 0x7f55d4147060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56178/0 (socket says 172.21.15.44:56178) 2023-11-04T01:42:23.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55d94d0640 1 -- 172.21.15.44:0/2729289935 learned_addr learned my addr 172.21.15.44:0/2729289935 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:23.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/2729289935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55c0003970 0x7f55d40c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55d3fff640 1 --2- 172.21.15.44:0/2729289935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55d41537e0 0x7f55d4153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55d94d0640 1 -- 172.21.15.44:0/2729289935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55d41537e0 msgr2=0x7f55d4153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55d94d0640 1 --2- 172.21.15.44:0/2729289935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55d41537e0 0x7f55d4153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55d94d0640 1 -- 172.21.15.44:0/2729289935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55c0003970 msgr2=0x7f55d40c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55d94d0640 1 --2- 172.21.15.44:0/2729289935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55c0003970 0x7f55d40c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55d94d0640 1 -- 172.21.15.44:0/2729289935 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d40c7870 con 0x7f55d4146bb0 2023-11-04T01:42:23.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55d94d0640 1 --2- 172.21.15.44:0/2729289935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d4146bb0 0x7f55d4147060 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f55d415e8f0 tx=0x7f55c400f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55d17fa640 1 -- 172.21.15.44:0/2729289935 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4004440 con 0x7f55d4146bb0 2023-11-04T01:42:23.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55d17fa640 1 -- 172.21.15.44:0/2729289935 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c4003610 con 0x7f55d4146bb0 2023-11-04T01:42:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55daf33640 1 -- 172.21.15.44:0/2729289935 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d40c7b50 con 0x7f55d4146bb0 2023-11-04T01:42:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55d17fa640 1 -- 172.21.15.44:0/2729289935 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c40039c0 con 0x7f55d4146bb0 2023-11-04T01:42:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.935+0000 7f55daf33640 1 -- 172.21.15.44:0/2729289935 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d40c8350 con 0x7f55d4146bb0 2023-11-04T01:42:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.937+0000 7f55d17fa640 1 -- 172.21.15.44:0/2729289935 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f55c4003b20 con 0x7f55d4146bb0 2023-11-04T01:42:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.937+0000 7f55d17fa640 1 --2- 172.21.15.44:0/2729289935 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f55b406aea0 0x7f55b406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.937+0000 7f55d17fa640 1 -- 172.21.15.44:0/2729289935 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f55c4089970 con 0x7f55d4146bb0 2023-11-04T01:42:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.938+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/2729289935 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f55b406aea0 0x7f55b406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.938+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/2729289935 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f55b406aea0 0x7f55b406d360 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f55cc034000 tx=0x7f55cc02f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.938+0000 7f55ddb9d740 1 Processor -- start 2023-11-04T01:42:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.938+0000 7f55ddb9d740 1 -- start start 2023-11-04T01:42:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55ddb9d740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049d14c0 0x561b049d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55ddb9d740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049a16d0 0x561b049ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55ddb9d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049a5040 0x561b049cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55ddb9d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b04914d70 con 0x561b049a5040 2023-11-04T01:42:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55ddb9d740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b04912460 con 0x561b049a16d0 2023-11-04T01:42:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55ddb9d740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b0490dd50 con 0x561b049d14c0 2023-11-04T01:42:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55d94d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049a5040 0x561b049cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55d94d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049a5040 0x561b049cec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56188/0 (socket says 172.21.15.44:56188) 2023-11-04T01:42:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55d94d0640 1 -- 172.21.15.44:0/1679682225 learned_addr learned my addr 172.21.15.44:0/1679682225 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55d3fff640 1 --2- 172.21.15.44:0/1679682225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049a16d0 0x561b049ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/1679682225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049d14c0 0x561b049d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55d94d0640 1 -- 172.21.15.44:0/1679682225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049d14c0 msgr2=0x561b049d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55d94d0640 1 --2- 172.21.15.44:0/1679682225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049d14c0 0x561b049d18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55d94d0640 1 -- 172.21.15.44:0/1679682225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049a16d0 msgr2=0x561b049ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55d94d0640 1 --2- 172.21.15.44:0/1679682225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049a16d0 0x561b049ce730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55d94d0640 1 -- 172.21.15.44:0/1679682225 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b048d0e30 con 0x561b049a5040 2023-11-04T01:42:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55d3fff640 1 --2- 172.21.15.44:0/1679682225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049a16d0 0x561b049ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/1679682225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049d14c0 0x561b049d18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.939+0000 7f55d94d0640 1 --2- 172.21.15.44:0/1679682225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049a5040 0x561b049cec70 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f55c4001eb0 tx=0x7f55c4058750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530b98a9707a3947 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.940+0000 7f55ca7fc640 1 -- 172.21.15.44:0/1679682225 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4060210 con 0x561b049a5040 2023-11-04T01:42:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.940+0000 7f55ca7fc640 1 -- 172.21.15.44:0/1679682225 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c4003dd0 con 0x561b049a5040 2023-11-04T01:42:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.940+0000 7f55ca7fc640 1 -- 172.21.15.44:0/1679682225 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c40562b0 con 0x561b049a5040 2023-11-04T01:42:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.940+0000 7f55ddb9d740 1 -- 172.21.15.44:0/1679682225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049a5040 msgr2=0x561b049cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.940+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/1679682225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049a5040 0x561b049cec70 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f55c4001eb0 tx=0x7f55c4058750 comp rx=0 tx=0).stop 2023-11-04T01:42:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.940+0000 7f55ddb9d740 1 -- 172.21.15.44:0/1679682225 shutdown_connections 2023-11-04T01:42:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.940+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/1679682225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049a5040 0x561b049cec70 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.940+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/1679682225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049a16d0 0x561b049ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.940+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/1679682225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049d14c0 0x561b049d18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.940+0000 7f55ddb9d740 1 -- 172.21.15.44:0/1679682225 >> 172.21.15.44:0/1679682225 conn(0x561b049a39e0 msgr2=0x561b049ec2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:23.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.940+0000 7f55ddb9d740 1 -- 172.21.15.44:0/1679682225 shutdown_connections 2023-11-04T01:42:23.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.940+0000 7f55ddb9d740 1 -- 172.21.15.44:0/1679682225 wait complete. 2023-11-04T01:42:23.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.941+0000 7f55ddb9d740 1 -- start start 2023-11-04T01:42:23.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.941+0000 7f55ddb9d740 1 Processor -- start 2023-11-04T01:42:23.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55ddb9d740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049a5040 0x561b049d44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55ddb9d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049d14c0 0x561b049d1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55ddb9d740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049ca070 0x561b049be430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55ddb9d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b048c7ee0 con 0x561b049d14c0 2023-11-04T01:42:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55ddb9d740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b048c7b80 con 0x561b049ca070 2023-11-04T01:42:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55ddb9d740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b0488d3a0 con 0x561b049a5040 2023-11-04T01:42:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55ddb9d740 10 client.0 _ll_register_callbacks cb 0x561b048918b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55d3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049d14c0 0x561b049d1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55d3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049d14c0 0x561b049d1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56204/0 (socket says 172.21.15.44:56204) 2023-11-04T01:42:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55d3fff640 1 -- 172.21.15.44:0/633904220 learned_addr learned my addr 172.21.15.44:0/633904220 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55d94d0640 1 --2- 172.21.15.44:0/633904220 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049ca070 0x561b049be430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/633904220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049a5040 0x561b049d44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55d3fff640 1 -- 172.21.15.44:0/633904220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049a5040 msgr2=0x561b049d44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55d3fff640 1 --2- 172.21.15.44:0/633904220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049a5040 0x561b049d44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55d3fff640 1 -- 172.21.15.44:0/633904220 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049ca070 msgr2=0x561b049be430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:23.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55d3fff640 1 --2- 172.21.15.44:0/633904220 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049ca070 0x561b049be430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55d3fff640 1 -- 172.21.15.44:0/633904220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d40c8350 con 0x561b049d14c0 2023-11-04T01:42:23.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55d3fff640 1 --2- 172.21.15.44:0/633904220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049d14c0 0x561b049d1e60 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f55bc005500 tx=0x7f55bc0115c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5831388fae2d6ab0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.942+0000 7f55b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:42:23.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55b37fe640 1 -- 172.21.15.44:0/633904220 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc003cb0 con 0x561b049d14c0 2023-11-04T01:42:23.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55b37fe640 1 -- 172.21.15.44:0/633904220 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f55bc011e50 con 0x561b049d14c0 2023-11-04T01:42:23.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55ddb9d740 1 -- 172.21.15.44:0/633904220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b04906d30 con 0x561b049d14c0 2023-11-04T01:42:23.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55b37fe640 1 -- 172.21.15.44:0/633904220 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55bc003e10 con 0x561b049d14c0 2023-11-04T01:42:23.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55ddb9d740 10 client.8349 fetch_fsmap learned FSMap version 95 2023-11-04T01:42:23.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55ddb9d740 1 -- 172.21.15.44:0/633904220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x561b0490c3d0 con 0x561b049d14c0 2023-11-04T01:42:23.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55b37fe640 1 -- 172.21.15.44:0/633904220 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b04906d30 con 0x561b049d14c0 2023-11-04T01:42:23.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55b37fe640 1 -- 172.21.15.44:0/633904220 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 95) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f55bc01c060 con 0x561b049d14c0 2023-11-04T01:42:23.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55ddb9d740 10 client.8349 fetch_fsmap finished waiting for FSMap version 95 2023-11-04T01:42:23.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55ddb9d740 10 client.8349 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-04T01:42:23.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55ddb9d740 20 client.8349 populate_metadata read hostname 'smithi044' 2023-11-04T01:42:23.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/633904220 >> [v2:172.21.15.44:6833/3264332323,v1:172.21.15.44:6835/3264332323] conn(0x561b049cfad0 0x561b049b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55ddb9d740 4 client.8349 mds_command: new command op to 8034 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:42:23.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55ddb9d740 1 -- 172.21.15.44:0/633904220 --> [v2:172.21.15.44:6833/3264332323,v1:172.21.15.44:6835/3264332323] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561b04906a50 con 0x561b049cfad0 2023-11-04T01:42:23.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/633904220 >> [v2:172.21.15.44:6833/3264332323,v1:172.21.15.44:6835/3264332323] conn(0x561b049cfad0 0x561b049b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/633904220 >> [v2:172.21.15.44:6833/3264332323,v1:172.21.15.44:6835/3264332323] conn(0x561b049cfad0 0x561b049b7f10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=648ff92c3e213a1d server_cookie=4a535967a2d92141 in_seq=0 out_seq=0 2023-11-04T01:42:23.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.943+0000 7f55b37fe640 10 client.8349 ms_handle_connect on v2:172.21.15.44:6833/3264332323 2023-11-04T01:42:23.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.944+0000 7f55b37fe640 1 -- 172.21.15.44:0/633904220 <== mds.0 v2:172.21.15.44:6833/3264332323 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561b04906a50 con 0x561b049cfad0 2023-11-04T01:42:23.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.944+0000 7f55b37fe640 10 client.8349 handle_command_reply: tid=0 2023-11-04T01:42:23.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.944+0000 7f55ddb9d740 1 client.8349 shutdown 2023-11-04T01:42:23.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.944+0000 7f55ddb9d740 1 -- 172.21.15.44:0/633904220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049d14c0 msgr2=0x561b049d1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.955 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.944+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/633904220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049d14c0 0x561b049d1e60 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f55bc005500 tx=0x7f55bc0115c0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.944+0000 7f55ddb9d740 1 -- 172.21.15.44:0/633904220 shutdown_connections 2023-11-04T01:42:23.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.944+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/633904220 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049ca070 0x561b049be430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.944+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/633904220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049d14c0 0x561b049d1e60 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.944+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/633904220 >> [v2:172.21.15.44:6833/3264332323,v1:172.21.15.44:6835/3264332323] conn(0x561b049cfad0 0x561b049b7f10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.944+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/633904220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049a5040 0x561b049d44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.944+0000 7f55ddb9d740 1 -- 172.21.15.44:0/633904220 >> 172.21.15.44:0/633904220 conn(0x561b049a16d0 msgr2=0x561b049ed7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:23.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.944+0000 7f55b37fe640 0 client.8349 ms_handle_reset on v2:172.21.15.44:6833/3264332323 2023-11-04T01:42:23.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.944+0000 7f55ddb9d740 1 -- 172.21.15.44:0/633904220 shutdown_connections 2023-11-04T01:42:23.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.944+0000 7f55ddb9d740 1 -- 172.21.15.44:0/633904220 wait complete. 2023-11-04T01:42:23.956 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.944+0000 7f55ddb9d740 20 client.8349 trim_cache size 0 max 16384 2023-11-04T01:42:23.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.958+0000 7f55ddb9d740 1 Processor -- start 2023-11-04T01:42:23.959 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.958+0000 7f55ddb9d740 1 -- start start 2023-11-04T01:42:23.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.958+0000 7f55ddb9d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049a5040 0x561b049eebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.958+0000 7f55ddb9d740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049ca070 0x561b049d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.958+0000 7f55ddb9d740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049d14c0 0x561b049d5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.958+0000 7f55ddb9d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b049a2750 con 0x561b049a5040 2023-11-04T01:42:23.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.958+0000 7f55ddb9d740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b04a06ba0 con 0x561b049d14c0 2023-11-04T01:42:23.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.958+0000 7f55ddb9d740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b04a0fb90 con 0x561b049ca070 2023-11-04T01:42:23.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.959+0000 7f55d8ccf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049a5040 0x561b049eebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.959+0000 7f55d8ccf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049a5040 0x561b049eebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56210/0 (socket says 172.21.15.44:56210) 2023-11-04T01:42:23.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.959+0000 7f55d8ccf640 1 -- 172.21.15.44:0/3946727074 learned_addr learned my addr 172.21.15.44:0/3946727074 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:23.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.959+0000 7f55d94d0640 1 --2- 172.21.15.44:0/3946727074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049d14c0 0x561b049d5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.959+0000 7f55d3fff640 1 --2- 172.21.15.44:0/3946727074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049ca070 0x561b049d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.959+0000 7f55d8ccf640 1 -- 172.21.15.44:0/3946727074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049ca070 msgr2=0x561b049d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:23.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.959+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/3946727074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049ca070 0x561b049d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.959+0000 7f55d8ccf640 1 -- 172.21.15.44:0/3946727074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049d14c0 msgr2=0x561b049d5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:23.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.959+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/3946727074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049d14c0 0x561b049d5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.959+0000 7f55d8ccf640 1 -- 172.21.15.44:0/3946727074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b048a9ea0 con 0x561b049a5040 2023-11-04T01:42:23.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.959+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/3946727074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049a5040 0x561b049eebf0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f55cc004c70 tx=0x7f55cc009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0790b7553dde735 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.959+0000 7f55caffd640 1 -- 172.21.15.44:0/3946727074 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc051150 con 0x561b049a5040 2023-11-04T01:42:23.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.959+0000 7f55caffd640 1 -- 172.21.15.44:0/3946727074 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc0512b0 con 0x561b049a5040 2023-11-04T01:42:23.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.959+0000 7f55caffd640 1 -- 172.21.15.44:0/3946727074 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc051640 con 0x561b049a5040 2023-11-04T01:42:23.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.960+0000 7f55ddb9d740 1 -- 172.21.15.44:0/3946727074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049a5040 msgr2=0x561b049eebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.960+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/3946727074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049a5040 0x561b049eebf0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f55cc004c70 tx=0x7f55cc009030 comp rx=0 tx=0).stop 2023-11-04T01:42:23.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.960+0000 7f55ddb9d740 1 -- 172.21.15.44:0/3946727074 shutdown_connections 2023-11-04T01:42:23.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.960+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/3946727074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049d14c0 0x561b049d5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.960+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/3946727074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049ca070 0x561b049d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.960+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/3946727074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049a5040 0x561b049eebf0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.960+0000 7f55ddb9d740 1 -- 172.21.15.44:0/3946727074 >> 172.21.15.44:0/3946727074 conn(0x561b049a16d0 msgr2=0x561b0499ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:23.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.960+0000 7f55ddb9d740 1 -- 172.21.15.44:0/3946727074 shutdown_connections 2023-11-04T01:42:23.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.960+0000 7f55ddb9d740 1 -- 172.21.15.44:0/3946727074 wait complete. 2023-11-04T01:42:23.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.960+0000 7f55ddb9d740 1 -- start start 2023-11-04T01:42:23.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.961+0000 7f55ddb9d740 1 Processor -- start 2023-11-04T01:42:23.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.961+0000 7f55ddb9d740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049a5040 0x561b049a1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.961+0000 7f55ddb9d740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049ca070 0x561b049d4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.961+0000 7f55ddb9d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049d14c0 0x561b049d52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.961+0000 7f55ddb9d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b049cf340 con 0x561b049d14c0 2023-11-04T01:42:23.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.961+0000 7f55ddb9d740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b049ccbd0 con 0x561b049ca070 2023-11-04T01:42:23.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.961+0000 7f55ddb9d740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b049be130 con 0x561b049a5040 2023-11-04T01:42:23.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.961+0000 7f55ddb9d740 10 client.0 _ll_register_callbacks cb 0x7f55c40542d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:23.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.961+0000 7f55d94d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049d14c0 0x561b049d52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.961+0000 7f55d94d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049d14c0 0x561b049d52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56222/0 (socket says 172.21.15.44:56222) 2023-11-04T01:42:23.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55d94d0640 1 -- 172.21.15.44:0/67755071 learned_addr learned my addr 172.21.15.44:0/67755071 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:23.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55d3fff640 1 --2- 172.21.15.44:0/67755071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049ca070 0x561b049d4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/67755071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049a5040 0x561b049a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55d94d0640 1 -- 172.21.15.44:0/67755071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049a5040 msgr2=0x561b049a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:23.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55d94d0640 1 --2- 172.21.15.44:0/67755071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049a5040 0x561b049a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55d94d0640 1 -- 172.21.15.44:0/67755071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049ca070 msgr2=0x561b049d4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:23.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55d94d0640 1 --2- 172.21.15.44:0/67755071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049ca070 0x561b049d4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55d94d0640 1 -- 172.21.15.44:0/67755071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c0003520 con 0x561b049d14c0 2023-11-04T01:42:23.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55d94d0640 1 --2- 172.21.15.44:0/67755071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049d14c0 0x561b049d52f0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f55c406e040 tx=0x7f55c4015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96309a84494cf8f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:42:23.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55b37fe640 1 -- 172.21.15.44:0/67755071 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4086040 con 0x561b049d14c0 2023-11-04T01:42:23.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55b37fe640 1 -- 172.21.15.44:0/67755071 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f55c4060210 con 0x561b049d14c0 2023-11-04T01:42:23.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55ddb9d740 1 -- 172.21.15.44:0/67755071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f55c4003dd0 con 0x561b049d14c0 2023-11-04T01:42:23.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55b37fe640 1 -- 172.21.15.44:0/67755071 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55c400fea0 con 0x561b049d14c0 2023-11-04T01:42:23.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55ddb9d740 10 client.8355 fetch_fsmap learned FSMap version 95 2023-11-04T01:42:23.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55ddb9d740 1 -- 172.21.15.44:0/67755071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x561b048cf690 con 0x561b049d14c0 2023-11-04T01:42:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.962+0000 7f55b37fe640 1 -- 172.21.15.44:0/67755071 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c4003dd0 con 0x561b049d14c0 2023-11-04T01:42:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.963+0000 7f55b37fe640 1 -- 172.21.15.44:0/67755071 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 95) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f55c4054620 con 0x561b049d14c0 2023-11-04T01:42:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.963+0000 7f55ddb9d740 10 client.8355 fetch_fsmap finished waiting for FSMap version 95 2023-11-04T01:42:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.963+0000 7f55ddb9d740 10 client.8355 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-04T01:42:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.963+0000 7f55ddb9d740 20 client.8355 populate_metadata read hostname 'smithi044' 2023-11-04T01:42:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.963+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/67755071 >> [v2:172.21.15.44:6833/3264332323,v1:172.21.15.44:6835/3264332323] conn(0x561b04a16380 0x561b04a5b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.963+0000 7f55ddb9d740 4 client.8355 mds_command: new command op to 8034 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:42:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.963+0000 7f55ddb9d740 1 -- 172.21.15.44:0/67755071 --> [v2:172.21.15.44:6833/3264332323,v1:172.21.15.44:6835/3264332323] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561b0460e7e0 con 0x561b04a16380 2023-11-04T01:42:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.963+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/67755071 >> [v2:172.21.15.44:6833/3264332323,v1:172.21.15.44:6835/3264332323] conn(0x561b04a16380 0x561b04a5b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.963+0000 7f55b37fe640 10 client.8355 ms_handle_connect on v2:172.21.15.44:6833/3264332323 2023-11-04T01:42:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.963+0000 7f55d8ccf640 1 --2- 172.21.15.44:0/67755071 >> [v2:172.21.15.44:6833/3264332323,v1:172.21.15.44:6835/3264332323] conn(0x561b04a16380 0x561b04a5b720 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd782fcf4538d69d server_cookie=9e08780583dfefbc in_seq=0 out_seq=0 2023-11-04T01:42:23.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.972+0000 7f55b37fe640 1 -- 172.21.15.44:0/67755071 <== mds.0 v2:172.21.15.44:6833/3264332323 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561b0460e7e0 con 0x561b04a16380 2023-11-04T01:42:23.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.972+0000 7f55b37fe640 10 client.8355 handle_command_reply: tid=0 2023-11-04T01:42:23.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.972+0000 7f55ddb9d740 1 client.8355 shutdown 2023-11-04T01:42:23.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.972+0000 7f55ddb9d740 1 -- 172.21.15.44:0/67755071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049d14c0 msgr2=0x561b049d52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.972+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/67755071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049d14c0 0x561b049d52f0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f55c406e040 tx=0x7f55c4015040 comp rx=0 tx=0).stop 2023-11-04T01:42:23.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.972+0000 7f55ddb9d740 1 -- 172.21.15.44:0/67755071 shutdown_connections 2023-11-04T01:42:23.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.972+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/67755071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b049d14c0 0x561b049d52f0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.972+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/67755071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b049ca070 0x561b049d4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.972+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/67755071 >> [v2:172.21.15.44:6833/3264332323,v1:172.21.15.44:6835/3264332323] conn(0x561b04a16380 0x561b04a5b720 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.972+0000 7f55ddb9d740 1 --2- 172.21.15.44:0/67755071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b049a5040 0x561b049a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.972+0000 7f55ddb9d740 1 -- 172.21.15.44:0/67755071 >> 172.21.15.44:0/67755071 conn(0x561b049a16d0 msgr2=0x561b0499ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:23.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.972+0000 7f55b37fe640 0 client.8355 ms_handle_reset on v2:172.21.15.44:6833/3264332323 2023-11-04T01:42:23.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.972+0000 7f55ddb9d740 1 -- 172.21.15.44:0/67755071 shutdown_connections 2023-11-04T01:42:23.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.972+0000 7f55ddb9d740 1 -- 172.21.15.44:0/67755071 wait complete. 2023-11-04T01:42:23.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.972+0000 7f55ddb9d740 20 client.8355 trim_cache size 0 max 16384 2023-11-04T01:42:23.976 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:42:23.976 INFO:teuthology.orchestra.run.smithi044.stdout: "message": "", 2023-11-04T01:42:23.976 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0 2023-11-04T01:42:23.976 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:42:23.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.973+0000 7f55daf33640 1 -- 172.21.15.44:0/2729289935 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f55b406aea0 msgr2=0x7f55b406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.973+0000 7f55daf33640 1 --2- 172.21.15.44:0/2729289935 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f55b406aea0 0x7f55b406d360 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f55cc034000 tx=0x7f55cc02f000 comp rx=0 tx=0).stop 2023-11-04T01:42:23.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.973+0000 7f55daf33640 1 -- 172.21.15.44:0/2729289935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d4146bb0 msgr2=0x7f55d4147060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.973+0000 7f55daf33640 1 --2- 172.21.15.44:0/2729289935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d4146bb0 0x7f55d4147060 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f55d415e8f0 tx=0x7f55c400f8a0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.973+0000 7f55daf33640 1 -- 172.21.15.44:0/2729289935 shutdown_connections 2023-11-04T01:42:23.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.973+0000 7f55daf33640 1 --2- 172.21.15.44:0/2729289935 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f55b406aea0 0x7f55b406d360 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.973+0000 7f55daf33640 1 --2- 172.21.15.44:0/2729289935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d4146bb0 0x7f55d4147060 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.973+0000 7f55daf33640 1 --2- 172.21.15.44:0/2729289935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55d41537e0 0x7f55d4153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.977 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.973+0000 7f55daf33640 1 --2- 172.21.15.44:0/2729289935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55c0003970 0x7f55d40c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.973+0000 7f55daf33640 1 -- 172.21.15.44:0/2729289935 >> 172.21.15.44:0/2729289935 conn(0x7f55d40cb530 msgr2=0x7f55d4071090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:23.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.973+0000 7f55daf33640 1 -- 172.21.15.44:0/2729289935 shutdown_connections 2023-11-04T01:42:23.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:23.973+0000 7f55daf33640 1 -- 172.21.15.44:0/2729289935 wait complete. 2023-11-04T01:42:23.985 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=5, also kill snapclient 2023-11-04T01:42:23.986 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:24.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.090+0000 7fa21cf0c640 1 Processor -- start 2023-11-04T01:42:24.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.090+0000 7fa21cf0c640 1 -- start start 2023-11-04T01:42:24.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.091+0000 7fa21cf0c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2180ade00 0x7fa2180b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.091+0000 7fa21cf0c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa21806d9c0 0x7fa2180710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.091+0000 7fa21cf0c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa21806cc90 con 0x7fa21806c5f0 2023-11-04T01:42:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.091+0000 7fa21cf0c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2180b0e60 con 0x7fa21806d9c0 2023-11-04T01:42:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.091+0000 7fa21cf0c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21806cee0 con 0x7fa2180ade00 2023-11-04T01:42:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.091+0000 7fa215d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa21806d9c0 0x7fa2180710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.091+0000 7fa215d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa21806d9c0 0x7fa2180710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56224/0 (socket says 172.21.15.44:56224) 2023-11-04T01:42:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.091+0000 7fa215d9b640 1 -- 172.21.15.44:0/1594332730 learned_addr learned my addr 172.21.15.44:0/1594332730 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.091+0000 7fa21659c640 1 --2- 172.21.15.44:0/1594332730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2180ade00 0x7fa2180b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.091+0000 7fa215d9b640 1 -- 172.21.15.44:0/1594332730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2180ade00 msgr2=0x7fa2180b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.091+0000 7fa215d9b640 1 --2- 172.21.15.44:0/1594332730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2180ade00 0x7fa2180b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.091+0000 7fa215d9b640 1 -- 172.21.15.44:0/1594332730 >> v1:172.21.15.204:6789/0 conn(0x7fa21806c5f0 legacy=0x7fa21815e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.091+0000 7fa215d9b640 1 -- 172.21.15.44:0/1594332730 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21806d1c0 con 0x7fa21806d9c0 2023-11-04T01:42:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.092+0000 7fa215d9b640 1 --2- 172.21.15.44:0/1594332730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa21806d9c0 0x7fa2180710d0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fa200009870 tx=0x7fa20002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32abb1e601aad5c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.092+0000 7fa21559a640 1 -- 172.21.15.44:0/1594332730 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2000317c0 con 0x7fa21806d9c0 2023-11-04T01:42:24.095 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.092+0000 7fa21559a640 1 -- 172.21.15.44:0/1594332730 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa200031920 con 0x7fa21806d9c0 2023-11-04T01:42:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.092+0000 7fa21559a640 1 -- 172.21.15.44:0/1594332730 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200031cb0 con 0x7fa21806d9c0 2023-11-04T01:42:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.093+0000 7fa21cf0c640 1 -- 172.21.15.44:0/1594332730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa21806d9c0 msgr2=0x7fa2180710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.093+0000 7fa21cf0c640 1 --2- 172.21.15.44:0/1594332730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa21806d9c0 0x7fa2180710d0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fa200009870 tx=0x7fa20002b860 comp rx=0 tx=0).stop 2023-11-04T01:42:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.093+0000 7fa21cf0c640 1 -- 172.21.15.44:0/1594332730 shutdown_connections 2023-11-04T01:42:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.093+0000 7fa21cf0c640 1 --2- 172.21.15.44:0/1594332730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa21806d9c0 0x7fa2180710d0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.093+0000 7fa21cf0c640 1 --2- 172.21.15.44:0/1594332730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2180ade00 0x7fa2180b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.093+0000 7fa21cf0c640 1 -- 172.21.15.44:0/1594332730 >> 172.21.15.44:0/1594332730 conn(0x7fa2180cb530 msgr2=0x7fa2180cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.093+0000 7fa21cf0c640 1 -- 172.21.15.44:0/1594332730 shutdown_connections 2023-11-04T01:42:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.093+0000 7fa21cf0c640 1 -- 172.21.15.44:0/1594332730 wait complete. 2023-11-04T01:42:24.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.094+0000 7fa21cf0c640 1 Processor -- start 2023-11-04T01:42:24.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.094+0000 7fa21cf0c640 1 -- start start 2023-11-04T01:42:24.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa21cf0c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa21806c5f0 0x7fa2181f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa21cf0c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa21806d9c0 0x7fa218156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa21cf0c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2180ade00 0x7fa2181572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa21cf0c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180c70e0 con 0x7fa2180ade00 2023-11-04T01:42:24.098 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa21cf0c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa218157eb0 con 0x7fa21806d9c0 2023-11-04T01:42:24.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa21cf0c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2181f17c0 con 0x7fa21806c5f0 2023-11-04T01:42:24.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa216d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2180ade00 0x7fa2181572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa216d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2180ade00 0x7fa2181572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56236/0 (socket says 172.21.15.44:56236) 2023-11-04T01:42:24.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa216d9d640 1 -- 172.21.15.44:0/820621365 learned_addr learned my addr 172.21.15.44:0/820621365 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:24.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa21659c640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa21806c5f0 0x7fa2181f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa215d9b640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa21806d9c0 0x7fa218156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa216d9d640 1 -- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa21806c5f0 msgr2=0x7fa2181f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa216d9d640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa21806c5f0 0x7fa2181f1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa216d9d640 1 -- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa21806d9c0 msgr2=0x7fa218156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa216d9d640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa21806d9c0 0x7fa218156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa216d9d640 1 -- 172.21.15.44:0/820621365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2000094d0 con 0x7fa2180ade00 2023-11-04T01:42:24.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa21659c640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa21806c5f0 0x7fa2181f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:24.099 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.095+0000 7fa215d9b640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa21806d9c0 0x7fa218156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.096+0000 7fa216d9d640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2180ade00 0x7fa2181572e0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fa21000c3c0 tx=0x7fa21000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.096+0000 7fa20effd640 1 -- 172.21.15.44:0/820621365 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2100052d0 con 0x7fa2180ade00 2023-11-04T01:42:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.096+0000 7fa20effd640 1 -- 172.21.15.44:0/820621365 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa210005430 con 0x7fa2180ade00 2023-11-04T01:42:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.096+0000 7fa20effd640 1 -- 172.21.15.44:0/820621365 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210003810 con 0x7fa2180ade00 2023-11-04T01:42:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.096+0000 7fa21cf0c640 1 -- 172.21.15.44:0/820621365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2181578f0 con 0x7fa2180ade00 2023-11-04T01:42:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.096+0000 7fa21cf0c640 1 -- 172.21.15.44:0/820621365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2180c6d00 con 0x7fa2180ade00 2023-11-04T01:42:24.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.097+0000 7fa21cf0c640 1 -- 172.21.15.44:0/820621365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2180c7220 con 0x7fa2180ade00 2023-11-04T01:42:24.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.097+0000 7fa20effd640 1 -- 172.21.15.44:0/820621365 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa210003970 con 0x7fa2180ade00 2023-11-04T01:42:24.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.098+0000 7fa20effd640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa1f806ae70 0x7fa1f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.098+0000 7fa20effd640 1 -- 172.21.15.44:0/820621365 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7fa210089270 con 0x7fa2180ade00 2023-11-04T01:42:24.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.098+0000 7fa21659c640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa1f806ae70 0x7fa1f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.098+0000 7fa21659c640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa1f806ae70 0x7fa1f806d330 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa208009f50 tx=0x7fa20800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.103 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.102+0000 7fa20effd640 1 -- 172.21.15.44:0/820621365 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa2180c7220 con 0x7fa2180ade00 2023-11-04T01:42:24.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.313+0000 7fa21cf0c640 1 -- 172.21.15.44:0/820621365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2180c7220 con 0x7fa2180ade00 2023-11-04T01:42:24.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.313+0000 7fa20effd640 1 -- 172.21.15.44:0/820621365 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4929 (secure 0 0 0) 0x7fa2180c7220 con 0x7fa2180ade00 2023-11-04T01:42:24.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:24.316 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:15.256705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:active","state_seq":7,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:24.316 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 95 2023-11-04T01:42:24.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.315+0000 7fa21cf0c640 1 -- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa1f806ae70 msgr2=0x7fa1f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.315+0000 7fa21cf0c640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa1f806ae70 0x7fa1f806d330 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa208009f50 tx=0x7fa20800b040 comp rx=0 tx=0).stop 2023-11-04T01:42:24.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.315+0000 7fa21cf0c640 1 -- 172.21.15.44:0/820621365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2180ade00 msgr2=0x7fa2181572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.315+0000 7fa21cf0c640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2180ade00 0x7fa2181572e0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fa21000c3c0 tx=0x7fa21000c880 comp rx=0 tx=0).stop 2023-11-04T01:42:24.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.315+0000 7fa21cf0c640 1 -- 172.21.15.44:0/820621365 shutdown_connections 2023-11-04T01:42:24.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.315+0000 7fa21cf0c640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa1f806ae70 0x7fa1f806d330 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.315+0000 7fa21cf0c640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2180ade00 0x7fa2181572e0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.315+0000 7fa21cf0c640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa21806d9c0 0x7fa218156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.315+0000 7fa21cf0c640 1 --2- 172.21.15.44:0/820621365 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa21806c5f0 0x7fa2181f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.315+0000 7fa21cf0c640 1 -- 172.21.15.44:0/820621365 >> 172.21.15.44:0/820621365 conn(0x7fa2180cb530 msgr2=0x7fa2180b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:24.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.315+0000 7fa21cf0c640 1 -- 172.21.15.44:0/820621365 shutdown_connections 2023-11-04T01:42:24.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.315+0000 7fa21cf0c640 1 -- 172.21.15.44:0/820621365 wait complete. 2023-11-04T01:42:24.328 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:42:24.447 INFO:teuthology.orchestra.run.smithi044.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:42:24.447 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:42:24.447 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:42:24.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.553+0000 7f29301d7640 1 Processor -- start 2023-11-04T01:42:24.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.554+0000 7f29301d7640 1 -- start start 2023-11-04T01:42:24.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.554+0000 7f29301d7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f292815d100 0x7f29280ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.554+0000 7f29301d7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f292815d4e0 0x7f29280d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.554+0000 7f29301d7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29280b32b0 con 0x7f29280d3b60 2023-11-04T01:42:24.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.554+0000 7f29301d7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29280cee10 con 0x7f292815d4e0 2023-11-04T01:42:24.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.554+0000 7f29301d7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29280b4750 con 0x7f292815d100 2023-11-04T01:42:24.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.555+0000 7f292d772640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f292815d4e0 0x7f29280d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.555+0000 7f292e774640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f29280d3b60 0x7f29280cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44914/0 (socket says 172.21.15.44:44914) 2023-11-04T01:42:24.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.555+0000 7f292e774640 1 -- 172.21.15.44:0/3609995300 learned_addr learned my addr 172.21.15.44:0/3609995300 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:24.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.555+0000 7f292df73640 1 --2- 172.21.15.44:0/3609995300 >> v2:172.21.15.204:3300/0 conn(0x7f292815d100 0x7f29280ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.555+0000 7f292cf71640 1 -- 172.21.15.44:0/3609995300 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548128823 0 0) 0x7f29280b32b0 con 0x7f29280d3b60 2023-11-04T01:42:24.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.555+0000 7f292cf71640 1 -- 172.21.15.44:0/3609995300 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2910003520 con 0x7f29280d3b60 2023-11-04T01:42:24.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.555+0000 7f292d772640 1 -- 172.21.15.44:0/3609995300 >> v2:172.21.15.204:3300/0 conn(0x7f292815d100 msgr2=0x7f29280ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:24.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.555+0000 7f292d772640 1 --2- 172.21.15.44:0/3609995300 >> v2:172.21.15.204:3300/0 conn(0x7f292815d100 0x7f29280ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.555+0000 7f292d772640 1 -- 172.21.15.44:0/3609995300 >> v1:172.21.15.44:6789/0 conn(0x7f29280d3b60 legacy=0x7f29280cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.555+0000 7f292d772640 1 -- 172.21.15.44:0/3609995300 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29280b2980 con 0x7f292815d4e0 2023-11-04T01:42:24.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.556+0000 7f292d772640 1 --2- 172.21.15.44:0/3609995300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f292815d4e0 0x7f29280d14d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f29280d09f0 tx=0x7f291c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00133689daaab25 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.556+0000 7f292cf71640 1 -- 172.21.15.44:0/3609995300 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c031830 con 0x7f292815d4e0 2023-11-04T01:42:24.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.556+0000 7f292cf71640 1 -- 172.21.15.44:0/3609995300 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c031990 con 0x7f292815d4e0 2023-11-04T01:42:24.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.556+0000 7f292cf71640 1 -- 172.21.15.44:0/3609995300 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c031d20 con 0x7f292815d4e0 2023-11-04T01:42:24.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.556+0000 7f29301d7640 1 -- 172.21.15.44:0/3609995300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f292815d4e0 msgr2=0x7f29280d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.556+0000 7f29301d7640 1 --2- 172.21.15.44:0/3609995300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f292815d4e0 0x7f29280d14d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f29280d09f0 tx=0x7f291c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.556+0000 7f29301d7640 1 -- 172.21.15.44:0/3609995300 shutdown_connections 2023-11-04T01:42:24.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.556+0000 7f29301d7640 1 --2- 172.21.15.44:0/3609995300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f292815d4e0 0x7f29280d14d0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.556+0000 7f29301d7640 1 --2- 172.21.15.44:0/3609995300 >> v2:172.21.15.204:3300/0 conn(0x7f292815d100 0x7f29280ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.556+0000 7f29301d7640 1 -- 172.21.15.44:0/3609995300 >> 172.21.15.44:0/3609995300 conn(0x7f29280d2ef0 msgr2=0x7f29280d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:24.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.557+0000 7f29301d7640 1 -- 172.21.15.44:0/3609995300 shutdown_connections 2023-11-04T01:42:24.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.557+0000 7f29301d7640 1 -- 172.21.15.44:0/3609995300 wait complete. 2023-11-04T01:42:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.558+0000 7f29301d7640 1 Processor -- start 2023-11-04T01:42:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.558+0000 7f29301d7640 1 -- start start 2023-11-04T01:42:24.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.558+0000 7f29301d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29280d3b60 0x7f29281f6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.558+0000 7f29301d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f292815d100 0x7f29280cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f29301d7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f292815d4e0 0x7f292815aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f29301d7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29280cc4b0 con 0x7f29280d3b60 2023-11-04T01:42:24.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f29301d7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29280cbbc0 con 0x7f292815d4e0 2023-11-04T01:42:24.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f29301d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29281f6fb0 con 0x7f292815d100 2023-11-04T01:42:24.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f292df73640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29280d3b60 0x7f29281f6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f292df73640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29280d3b60 0x7f29281f6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56250/0 (socket says 172.21.15.44:56250) 2023-11-04T01:42:24.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f292df73640 1 -- 172.21.15.44:0/2722676395 learned_addr learned my addr 172.21.15.44:0/2722676395 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:24.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f292d772640 1 --2- 172.21.15.44:0/2722676395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f292815d100 0x7f29280cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f292e774640 1 --2- 172.21.15.44:0/2722676395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f292815d4e0 0x7f292815aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f292df73640 1 -- 172.21.15.44:0/2722676395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f292815d100 msgr2=0x7f29280cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f292df73640 1 --2- 172.21.15.44:0/2722676395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f292815d100 0x7f29280cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f292df73640 1 -- 172.21.15.44:0/2722676395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f292815d4e0 msgr2=0x7f292815aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f292df73640 1 --2- 172.21.15.44:0/2722676395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f292815d4e0 0x7f292815aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f292df73640 1 -- 172.21.15.44:0/2722676395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c009400 con 0x7f29280d3b60 2023-11-04T01:42:24.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f292df73640 1 --2- 172.21.15.44:0/2722676395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29280d3b60 0x7f29281f6a70 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f292000e8a0 tx=0x7f292000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f29267fc640 1 -- 172.21.15.44:0/2722676395 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29200095c0 con 0x7f29280d3b60 2023-11-04T01:42:24.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f29267fc640 1 -- 172.21.15.44:0/2722676395 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292000c940 con 0x7f29280d3b60 2023-11-04T01:42:24.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f29301d7640 1 -- 172.21.15.44:0/2722676395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29281604b0 con 0x7f29280d3b60 2023-11-04T01:42:24.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f29267fc640 1 -- 172.21.15.44:0/2722676395 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292000ccb0 con 0x7f29280d3b60 2023-11-04T01:42:24.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.559+0000 7f29301d7640 1 -- 172.21.15.44:0/2722676395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29280cc0d0 con 0x7f29280d3b60 2023-11-04T01:42:24.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.560+0000 7f29301d7640 1 -- 172.21.15.44:0/2722676395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29280cc720 con 0x7f29280d3b60 2023-11-04T01:42:24.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.561+0000 7f29267fc640 1 -- 172.21.15.44:0/2722676395 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2920013470 con 0x7f29280d3b60 2023-11-04T01:42:24.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.561+0000 7f29267fc640 1 --2- 172.21.15.44:0/2722676395 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f291406ae70 0x7f291406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.561+0000 7f29267fc640 1 -- 172.21.15.44:0/2722676395 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f292008a320 con 0x7f29280d3b60 2023-11-04T01:42:24.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.561+0000 7f292d772640 1 --2- 172.21.15.44:0/2722676395 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f291406ae70 0x7f291406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.562+0000 7f292d772640 1 --2- 172.21.15.44:0/2722676395 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f291406ae70 0x7f291406d330 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f291c036000 tx=0x7f291c03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.566+0000 7f29267fc640 1 -- 172.21.15.44:0/2722676395 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2920054c00 con 0x7f29280d3b60 2023-11-04T01:42:24.816 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:24.814+0000 7f29301d7640 1 -- 172.21.15.44:0/2722676395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f29280684b0 con 0x7f29280d3b60 2023-11-04T01:42:25.287 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.286+0000 7f29267fc640 1 -- 172.21.15.44:0/2722676395 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.8034 v96) v1 ==== 112+0+0 (secure 0 0 0) 0x7f2920058220 con 0x7f29280d3b60 2023-11-04T01:42:25.287 INFO:teuthology.orchestra.run.smithi044.stderr:freezing mds.8034 2023-11-04T01:42:25.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.287+0000 7f29301d7640 1 -- 172.21.15.44:0/2722676395 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f291406ae70 msgr2=0x7f291406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.287+0000 7f29301d7640 1 --2- 172.21.15.44:0/2722676395 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f291406ae70 0x7f291406d330 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f291c036000 tx=0x7f291c03c040 comp rx=0 tx=0).stop 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.287+0000 7f29301d7640 1 -- 172.21.15.44:0/2722676395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29280d3b60 msgr2=0x7f29281f6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.287+0000 7f29301d7640 1 --2- 172.21.15.44:0/2722676395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29280d3b60 0x7f29281f6a70 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f292000e8a0 tx=0x7f292000ed60 comp rx=0 tx=0).stop 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.287+0000 7f29301d7640 1 -- 172.21.15.44:0/2722676395 shutdown_connections 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.287+0000 7f29301d7640 1 --2- 172.21.15.44:0/2722676395 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f291406ae70 0x7f291406d330 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.287+0000 7f29301d7640 1 --2- 172.21.15.44:0/2722676395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f292815d4e0 0x7f292815aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.287+0000 7f29301d7640 1 --2- 172.21.15.44:0/2722676395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f292815d100 0x7f29280cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.287+0000 7f29301d7640 1 --2- 172.21.15.44:0/2722676395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29280d3b60 0x7f29281f6a70 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.287+0000 7f29301d7640 1 -- 172.21.15.44:0/2722676395 >> 172.21.15.44:0/2722676395 conn(0x7f29280d2ef0 msgr2=0x7f29280d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.287+0000 7f29301d7640 1 -- 172.21.15.44:0/2722676395 shutdown_connections 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.288+0000 7f29301d7640 1 -- 172.21.15.44:0/2722676395 wait complete. 2023-11-04T01:42:25.301 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:42:25.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.409+0000 7f82c0658640 1 Processor -- start 2023-11-04T01:42:25.411 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.409+0000 7f82c0658640 1 -- start start 2023-11-04T01:42:25.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.410+0000 7f82c0658640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82b815d4e0 0x7f82b80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.410+0000 7f82c0658640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f82b80d3b60 0x7f82b80d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.410+0000 7f82c0658640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b80b32b0 con 0x7f82b815d100 2023-11-04T01:42:25.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.410+0000 7f82c0658640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b80cec20 con 0x7f82b80d3b60 2023-11-04T01:42:25.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.410+0000 7f82c0658640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b80cee10 con 0x7f82b815d4e0 2023-11-04T01:42:25.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.410+0000 7f82bebf5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f82b80d3b60 0x7f82b80d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.410+0000 7f82be3f4640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f82b815d100 0x7f82b80ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44922/0 (socket says 172.21.15.44:44922) 2023-11-04T01:42:25.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.410+0000 7f82be3f4640 1 -- 172.21.15.44:0/1026683383 learned_addr learned my addr 172.21.15.44:0/1026683383 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:25.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.411+0000 7f82bdbf3640 1 --2- 172.21.15.44:0/1026683383 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82b815d4e0 0x7f82b80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.411+0000 7f82bebf5640 1 -- 172.21.15.44:0/1026683383 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82b815d4e0 msgr2=0x7f82b80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:25.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.411+0000 7f82bebf5640 1 --2- 172.21.15.44:0/1026683383 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82b815d4e0 0x7f82b80d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.411+0000 7f82bebf5640 1 -- 172.21.15.44:0/1026683383 >> v1:172.21.15.44:6789/0 conn(0x7f82b815d100 legacy=0x7f82b80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.411+0000 7f82bd3f2640 1 -- 172.21.15.44:0/1026683383 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846221965 0 0) 0x7f82b80b32b0 con 0x7f82b815d100 2023-11-04T01:42:25.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.411+0000 7f82bebf5640 1 -- 172.21.15.44:0/1026683383 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b80b4750 con 0x7f82b80d3b60 2023-11-04T01:42:25.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.412+0000 7f82bebf5640 1 --2- 172.21.15.44:0/1026683383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b80d3b60 0x7f82b80d1a10 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009d90 tx=0x7f82b002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc6c07d05f6077d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.412+0000 7f82bd3f2640 1 -- 172.21.15.44:0/1026683383 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b002cc50 con 0x7f82b80d3b60 2023-11-04T01:42:25.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.412+0000 7f82bd3f2640 1 -- 172.21.15.44:0/1026683383 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b002cdb0 con 0x7f82b80d3b60 2023-11-04T01:42:25.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.412+0000 7f82bd3f2640 1 -- 172.21.15.44:0/1026683383 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0034660 con 0x7f82b80d3b60 2023-11-04T01:42:25.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.412+0000 7f82c0658640 1 -- 172.21.15.44:0/1026683383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b80d3b60 msgr2=0x7f82b80d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.412+0000 7f82c0658640 1 --2- 172.21.15.44:0/1026683383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b80d3b60 0x7f82b80d1a10 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009d90 tx=0x7f82b002bea0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.412+0000 7f82c0658640 1 -- 172.21.15.44:0/1026683383 shutdown_connections 2023-11-04T01:42:25.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.412+0000 7f82c0658640 1 --2- 172.21.15.44:0/1026683383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b80d3b60 0x7f82b80d1a10 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.412+0000 7f82c0658640 1 --2- 172.21.15.44:0/1026683383 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82b815d4e0 0x7f82b80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.412+0000 7f82c0658640 1 -- 172.21.15.44:0/1026683383 >> 172.21.15.44:0/1026683383 conn(0x7f82b80d2ef0 msgr2=0x7f82b80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:25.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.412+0000 7f82c0658640 1 -- 172.21.15.44:0/1026683383 shutdown_connections 2023-11-04T01:42:25.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.412+0000 7f82c0658640 1 -- 172.21.15.44:0/1026683383 wait complete. 2023-11-04T01:42:25.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.414+0000 7f82c0658640 1 Processor -- start 2023-11-04T01:42:25.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.414+0000 7f82c0658640 1 -- start start 2023-11-04T01:42:25.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.414+0000 7f82c0658640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82b80d3b60 0x7f82b8142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.414+0000 7f82c0658640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82b815d100 0x7f82b80c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.414+0000 7f82c0658640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b815d4e0 0x7f82b8152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.414+0000 7f82c0658640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b815e950 con 0x7f82b815d4e0 2023-11-04T01:42:25.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.414+0000 7f82c0658640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b815f1b0 con 0x7f82b815d100 2023-11-04T01:42:25.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.414+0000 7f82c0658640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b8155ef0 con 0x7f82b80d3b60 2023-11-04T01:42:25.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.414+0000 7f82bebf5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b815d4e0 0x7f82b8152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82bebf5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b815d4e0 0x7f82b8152fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56268/0 (socket says 172.21.15.44:56268) 2023-11-04T01:42:25.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82bebf5640 1 -- 172.21.15.44:0/990605513 learned_addr learned my addr 172.21.15.44:0/990605513 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:25.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82be3f4640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82b80d3b60 0x7f82b8142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82bdbf3640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82b815d100 0x7f82b80c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82bebf5640 1 -- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82b80d3b60 msgr2=0x7f82b8142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82bebf5640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82b80d3b60 0x7f82b8142ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82bebf5640 1 -- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82b815d100 msgr2=0x7f82b80c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82bebf5640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82b815d100 0x7f82b80c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82bebf5640 1 -- 172.21.15.44:0/990605513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b0009a70 con 0x7f82b815d4e0 2023-11-04T01:42:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82be3f4640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82b80d3b60 0x7f82b8142ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82bdbf3640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82b815d100 0x7f82b80c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82bebf5640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b815d4e0 0x7f82b8152fa0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009d90 tx=0x7f82b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82aeffd640 1 -- 172.21.15.44:0/990605513 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0040650 con 0x7f82b815d4e0 2023-11-04T01:42:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82aeffd640 1 -- 172.21.15.44:0/990605513 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b00407d0 con 0x7f82b815d4e0 2023-11-04T01:42:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82aeffd640 1 -- 172.21.15.44:0/990605513 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0040b80 con 0x7f82b815d4e0 2023-11-04T01:42:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82c0658640 1 -- 172.21.15.44:0/990605513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b815eb60 con 0x7f82b815d4e0 2023-11-04T01:42:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.415+0000 7f82c0658640 1 -- 172.21.15.44:0/990605513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b80c98b0 con 0x7f82b815d4e0 2023-11-04T01:42:25.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.416+0000 7f82c0658640 1 -- 172.21.15.44:0/990605513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b815f360 con 0x7f82b815d4e0 2023-11-04T01:42:25.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.417+0000 7f82aeffd640 1 -- 172.21.15.44:0/990605513 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82b0040ce0 con 0x7f82b815d4e0 2023-11-04T01:42:25.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.417+0000 7f82aeffd640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f829c06ae70 0x7f829c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.417+0000 7f82aeffd640 1 -- 172.21.15.44:0/990605513 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f82b00acbe0 con 0x7f82b815d4e0 2023-11-04T01:42:25.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.417+0000 7f82be3f4640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f829c06ae70 0x7f829c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.418+0000 7f82be3f4640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f829c06ae70 0x7f829c06d330 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f82b4007fd0 tx=0x7f82b4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.421+0000 7f82aeffd640 1 -- 172.21.15.44:0/990605513 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82b815f360 con 0x7f82b815d4e0 2023-11-04T01:42:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:25.669+0000 7f82c0658640 1 -- 172.21.15.44:0/990605513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7f82b815f320 con 0x7f82b815d4e0 2023-11-04T01:42:26.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.291+0000 7f82aeffd640 1 -- 172.21.15.44:0/990605513 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.7156 v97) v1 ==== 112+0+0 (secure 0 0 0) 0x7f82b00774c0 con 0x7f82b815d4e0 2023-11-04T01:42:26.292 INFO:teuthology.orchestra.run.smithi044.stderr:freezing mds.7156 2023-11-04T01:42:26.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.293+0000 7f82c0658640 1 -- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f829c06ae70 msgr2=0x7f829c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.293+0000 7f82c0658640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f829c06ae70 0x7f829c06d330 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f82b4007fd0 tx=0x7f82b4009040 comp rx=0 tx=0).stop 2023-11-04T01:42:26.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.294+0000 7f82c0658640 1 -- 172.21.15.44:0/990605513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b815d4e0 msgr2=0x7f82b8152fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.294+0000 7f82c0658640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b815d4e0 0x7f82b8152fa0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009d90 tx=0x7f82b0004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:26.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.294+0000 7f82c0658640 1 -- 172.21.15.44:0/990605513 shutdown_connections 2023-11-04T01:42:26.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.294+0000 7f82c0658640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f829c06ae70 0x7f829c06d330 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.294+0000 7f82c0658640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b815d4e0 0x7f82b8152fa0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.294+0000 7f82c0658640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82b815d100 0x7f82b80c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.294+0000 7f82c0658640 1 --2- 172.21.15.44:0/990605513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82b80d3b60 0x7f82b8142ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.294+0000 7f82c0658640 1 -- 172.21.15.44:0/990605513 >> 172.21.15.44:0/990605513 conn(0x7f82b80d2ef0 msgr2=0x7f82b815c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.294+0000 7f82c0658640 1 -- 172.21.15.44:0/990605513 shutdown_connections 2023-11-04T01:42:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.294+0000 7f82c0658640 1 -- 172.21.15.44:0/990605513 wait complete. 2023-11-04T01:42:26.307 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_kill_mdstable_at 5 2023-11-04T01:42:26.434 INFO:teuthology.orchestra.run.smithi044.stdout:{"success":"mds_kill_mdstable_at = '5' (not observed, change may require restart) "} 2023-11-04T01:42:26.435 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '5' (not observed, change may require restart) " } 2023-11-04T01:42:26.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:26.435 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s25) 2023-11-04T01:42:26.438 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:42:26.460 INFO:tasks.ceph.mds.a.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f177d281640 time 2023-11-04T01:42:26.459824+0000 2023-11-04T01:42:26.460 INFO:tasks.ceph.mds.a.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:42:26.461 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:26.461 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1782d6efaf] 2023-11-04T01:42:26.461 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1782d6f16d] 2023-11-04T01:42:26.461 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a879135187] 2023-11-04T01:42:26.462 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a878ec40a9] 2023-11-04T01:42:26.462 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a878ec6b2b] 2023-11-04T01:42:26.462 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a878ec701c] 2023-11-04T01:42:26.462 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a878eb0325] 2023-11-04T01:42:26.462 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f1782f5ff9a] 2023-11-04T01:42:26.462 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1782ff1741] 2023-11-04T01:42:26.462 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f178249f802] 2023-11-04T01:42:26.462 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f178243f450] 2023-11-04T01:42:26.462 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:42:26.460+0000 7f177d281640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f177d281640 time 2023-11-04T01:42:26.459824+0000 2023-11-04T01:42:26.462 INFO:tasks.ceph.mds.a.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:42:26.462 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:42:26.463 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:26.463 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1782d6efaf] 2023-11-04T01:42:26.463 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1782d6f16d] 2023-11-04T01:42:26.463 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a879135187] 2023-11-04T01:42:26.463 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a878ec40a9] 2023-11-04T01:42:26.463 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a878ec6b2b] 2023-11-04T01:42:26.463 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a878ec701c] 2023-11-04T01:42:26.463 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a878eb0325] 2023-11-04T01:42:26.463 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f1782f5ff9a] 2023-11-04T01:42:26.463 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1782ff1741] 2023-11-04T01:42:26.463 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f178249f802] 2023-11-04T01:42:26.463 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f178243f450] 2023-11-04T01:42:26.463 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:42:26.463 INFO:tasks.ceph.mds.a.smithi044.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:42:26.463 INFO:tasks.ceph.mds.a.smithi044.stderr: in thread 7f177d281640 thread_name:ms_dispatch 2023-11-04T01:42:26.464 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:26.464 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1782454db0] 2023-11-04T01:42:26.464 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f17824a154c] 2023-11-04T01:42:26.464 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: raise() 2023-11-04T01:42:26.464 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: abort() 2023-11-04T01:42:26.465 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1782d6f009] 2023-11-04T01:42:26.465 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1782d6f16d] 2023-11-04T01:42:26.465 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a879135187] 2023-11-04T01:42:26.465 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a878ec40a9] 2023-11-04T01:42:26.465 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a878ec6b2b] 2023-11-04T01:42:26.465 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a878ec701c] 2023-11-04T01:42:26.465 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a878eb0325] 2023-11-04T01:42:26.465 INFO:tasks.ceph.mds.a.smithi044.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f1782f5ff9a] 2023-11-04T01:42:26.465 INFO:tasks.ceph.mds.a.smithi044.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1782ff1741] 2023-11-04T01:42:26.465 INFO:tasks.ceph.mds.a.smithi044.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f178249f802] 2023-11-04T01:42:26.465 INFO:tasks.ceph.mds.a.smithi044.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f178243f450] 2023-11-04T01:42:26.465 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:42:26.460+0000 7f177d281640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:42:26.465 INFO:tasks.ceph.mds.a.smithi044.stderr: in thread 7f177d281640 thread_name:ms_dispatch 2023-11-04T01:42:26.465 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:42:26.466 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:26.466 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1782454db0] 2023-11-04T01:42:26.466 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f17824a154c] 2023-11-04T01:42:26.466 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: raise() 2023-11-04T01:42:26.466 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: abort() 2023-11-04T01:42:26.466 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1782d6f009] 2023-11-04T01:42:26.466 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1782d6f16d] 2023-11-04T01:42:26.466 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a879135187] 2023-11-04T01:42:26.466 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a878ec40a9] 2023-11-04T01:42:26.466 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a878ec6b2b] 2023-11-04T01:42:26.466 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a878ec701c] 2023-11-04T01:42:26.466 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a878eb0325] 2023-11-04T01:42:26.466 INFO:tasks.ceph.mds.a.smithi044.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f1782f5ff9a] 2023-11-04T01:42:26.467 INFO:tasks.ceph.mds.a.smithi044.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1782ff1741] 2023-11-04T01:42:26.467 INFO:tasks.ceph.mds.a.smithi044.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f178249f802] 2023-11-04T01:42:26.467 INFO:tasks.ceph.mds.a.smithi044.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f178243f450] 2023-11-04T01:42:26.467 INFO:tasks.ceph.mds.a.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:42:26.467 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:42:26.467 INFO:tasks.ceph.mds.a.smithi044.stderr: -1147> 2023-11-04T01:42:17.028+0000 7f177aa7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:26.467 INFO:tasks.ceph.mds.a.smithi044.stderr: -1145> 2023-11-04T01:42:17.028+0000 7f177aa7c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:42:26.467 INFO:tasks.ceph.mds.a.smithi044.stderr: -1> 2023-11-04T01:42:26.460+0000 7f177d281640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f177d281640 time 2023-11-04T01:42:26.459824+0000 2023-11-04T01:42:26.468 INFO:tasks.ceph.mds.a.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:42:26.468 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:42:26.468 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:26.468 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1782d6efaf] 2023-11-04T01:42:26.468 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1782d6f16d] 2023-11-04T01:42:26.468 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a879135187] 2023-11-04T01:42:26.468 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a878ec40a9] 2023-11-04T01:42:26.468 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a878ec6b2b] 2023-11-04T01:42:26.468 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a878ec701c] 2023-11-04T01:42:26.468 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a878eb0325] 2023-11-04T01:42:26.468 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f1782f5ff9a] 2023-11-04T01:42:26.468 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1782ff1741] 2023-11-04T01:42:26.468 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f178249f802] 2023-11-04T01:42:26.468 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f178243f450] 2023-11-04T01:42:26.469 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:42:26.469 INFO:tasks.ceph.mds.a.smithi044.stderr: 0> 2023-11-04T01:42:26.460+0000 7f177d281640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:42:26.469 INFO:tasks.ceph.mds.a.smithi044.stderr: in thread 7f177d281640 thread_name:ms_dispatch 2023-11-04T01:42:26.469 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:42:26.469 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:26.469 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1782454db0] 2023-11-04T01:42:26.469 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f17824a154c] 2023-11-04T01:42:26.469 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: raise() 2023-11-04T01:42:26.469 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: abort() 2023-11-04T01:42:26.469 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1782d6f009] 2023-11-04T01:42:26.469 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1782d6f16d] 2023-11-04T01:42:26.469 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a879135187] 2023-11-04T01:42:26.469 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a878ec40a9] 2023-11-04T01:42:26.469 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a878ec6b2b] 2023-11-04T01:42:26.470 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a878ec701c] 2023-11-04T01:42:26.470 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a878eb0325] 2023-11-04T01:42:26.470 INFO:tasks.ceph.mds.a.smithi044.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f1782f5ff9a] 2023-11-04T01:42:26.470 INFO:tasks.ceph.mds.a.smithi044.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1782ff1741] 2023-11-04T01:42:26.470 INFO:tasks.ceph.mds.a.smithi044.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f178249f802] 2023-11-04T01:42:26.470 INFO:tasks.ceph.mds.a.smithi044.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f178243f450] 2023-11-04T01:42:26.470 INFO:tasks.ceph.mds.a.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:42:26.470 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:42:26.470 INFO:tasks.ceph.mds.a.smithi044.stderr: -1147> 2023-11-04T01:42:17.028+0000 7f177aa7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:26.471 INFO:tasks.ceph.mds.a.smithi044.stderr: -1145> 2023-11-04T01:42:17.028+0000 7f177aa7c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:42:26.471 INFO:tasks.ceph.mds.a.smithi044.stderr: -1> 2023-11-04T01:42:26.460+0000 7f177d281640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f177d281640 time 2023-11-04T01:42:26.459824+0000 2023-11-04T01:42:26.472 INFO:tasks.ceph.mds.a.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:42:26.472 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:42:26.472 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:26.472 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1782d6efaf] 2023-11-04T01:42:26.472 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1782d6f16d] 2023-11-04T01:42:26.472 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a879135187] 2023-11-04T01:42:26.472 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a878ec40a9] 2023-11-04T01:42:26.472 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a878ec6b2b] 2023-11-04T01:42:26.472 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a878ec701c] 2023-11-04T01:42:26.472 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a878eb0325] 2023-11-04T01:42:26.472 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f1782f5ff9a] 2023-11-04T01:42:26.472 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1782ff1741] 2023-11-04T01:42:26.472 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f178249f802] 2023-11-04T01:42:26.472 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f178243f450] 2023-11-04T01:42:26.473 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:42:26.473 INFO:tasks.ceph.mds.a.smithi044.stderr: 0> 2023-11-04T01:42:26.460+0000 7f177d281640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:42:26.473 INFO:tasks.ceph.mds.a.smithi044.stderr: in thread 7f177d281640 thread_name:ms_dispatch 2023-11-04T01:42:26.473 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:42:26.473 INFO:tasks.ceph.mds.a.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:26.473 INFO:tasks.ceph.mds.a.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1782454db0] 2023-11-04T01:42:26.473 INFO:tasks.ceph.mds.a.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f17824a154c] 2023-11-04T01:42:26.473 INFO:tasks.ceph.mds.a.smithi044.stderr: 3: raise() 2023-11-04T01:42:26.473 INFO:tasks.ceph.mds.a.smithi044.stderr: 4: abort() 2023-11-04T01:42:26.473 INFO:tasks.ceph.mds.a.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1782d6f009] 2023-11-04T01:42:26.473 INFO:tasks.ceph.mds.a.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1782d6f16d] 2023-11-04T01:42:26.473 INFO:tasks.ceph.mds.a.smithi044.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55a879135187] 2023-11-04T01:42:26.473 INFO:tasks.ceph.mds.a.smithi044.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55a878ec40a9] 2023-11-04T01:42:26.474 INFO:tasks.ceph.mds.a.smithi044.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55a878ec6b2b] 2023-11-04T01:42:26.474 INFO:tasks.ceph.mds.a.smithi044.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a878ec701c] 2023-11-04T01:42:26.474 INFO:tasks.ceph.mds.a.smithi044.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55a878eb0325] 2023-11-04T01:42:26.474 INFO:tasks.ceph.mds.a.smithi044.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f1782f5ff9a] 2023-11-04T01:42:26.474 INFO:tasks.ceph.mds.a.smithi044.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1782ff1741] 2023-11-04T01:42:26.474 INFO:tasks.ceph.mds.a.smithi044.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f178249f802] 2023-11-04T01:42:26.474 INFO:tasks.ceph.mds.a.smithi044.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f178243f450] 2023-11-04T01:42:26.474 INFO:tasks.ceph.mds.a.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:42:26.474 INFO:tasks.ceph.mds.a.smithi044.stderr: 2023-11-04T01:42:26.573 INFO:teuthology.orchestra.run.smithi044.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:42:26.573 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:42:26.573 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:26.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.718+0000 7f821a761640 1 Processor -- start 2023-11-04T01:42:26.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.718+0000 7f821a761640 1 -- start start 2023-11-04T01:42:26.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.719+0000 7f821a761640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f82140ceda0 0x7f821415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.719+0000 7f821a761640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f82140b2210 0x7f821415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.719+0000 7f821a761640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821415d9a0 con 0x7f82140cf180 2023-11-04T01:42:26.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.719+0000 7f821a761640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82140b1df0 con 0x7f82140b2210 2023-11-04T01:42:26.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.719+0000 7f821a761640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82140cfd00 con 0x7f82140ceda0 2023-11-04T01:42:26.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.719+0000 7f82137fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f82140b2210 0x7f821415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.719+0000 7f8218cfe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f82140cf180 0x7f82140cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44924/0 (socket says 172.21.15.44:44924) 2023-11-04T01:42:26.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.719+0000 7f8218cfe640 1 -- 172.21.15.44:0/443176821 learned_addr learned my addr 172.21.15.44:0/443176821 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:26.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.720+0000 7f82137fe640 1 -- 172.21.15.44:0/443176821 >> v2:172.21.15.204:3300/0 conn(0x7f82140ceda0 msgr2=0x7f821415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:26.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.720+0000 7f82137fe640 1 --2- 172.21.15.44:0/443176821 >> v2:172.21.15.204:3300/0 conn(0x7f82140ceda0 0x7f821415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.720+0000 7f82137fe640 1 -- 172.21.15.44:0/443176821 >> v1:172.21.15.44:6789/0 conn(0x7f82140cf180 legacy=0x7f82140cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.720+0000 7f82137fe640 1 -- 172.21.15.44:0/443176821 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82140b0150 con 0x7f82140b2210 2023-11-04T01:42:26.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.720+0000 7f82137fe640 1 --2- 172.21.15.44:0/443176821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82140b2210 0x7f821415d460 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8214070130 tx=0x7f820402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1935bf8fca906b23 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.720+0000 7f8212ffd640 1 -- 172.21.15.44:0/443176821 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820402e070 con 0x7f82140b2210 2023-11-04T01:42:26.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.721+0000 7f8212ffd640 1 -- 172.21.15.44:0/443176821 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82040315a0 con 0x7f82140b2210 2023-11-04T01:42:26.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.721+0000 7f8212ffd640 1 -- 172.21.15.44:0/443176821 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204031930 con 0x7f82140b2210 2023-11-04T01:42:26.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.721+0000 7f821a761640 1 -- 172.21.15.44:0/443176821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82140b2210 msgr2=0x7f821415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.721+0000 7f821a761640 1 --2- 172.21.15.44:0/443176821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82140b2210 0x7f821415d460 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8214070130 tx=0x7f820402b840 comp rx=0 tx=0).stop 2023-11-04T01:42:26.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.721+0000 7f821a761640 1 -- 172.21.15.44:0/443176821 shutdown_connections 2023-11-04T01:42:26.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.721+0000 7f821a761640 1 --2- 172.21.15.44:0/443176821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82140b2210 0x7f821415d460 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.721+0000 7f821a761640 1 --2- 172.21.15.44:0/443176821 >> v2:172.21.15.204:3300/0 conn(0x7f82140ceda0 0x7f821415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.721+0000 7f821a761640 1 -- 172.21.15.44:0/443176821 >> 172.21.15.44:0/443176821 conn(0x7f82140d0c30 msgr2=0x7f82140d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:26.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.721+0000 7f821a761640 1 -- 172.21.15.44:0/443176821 shutdown_connections 2023-11-04T01:42:26.723 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.721+0000 7f821a761640 1 -- 172.21.15.44:0/443176821 wait complete. 2023-11-04T01:42:26.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.722+0000 7f821a761640 1 Processor -- start 2023-11-04T01:42:26.724 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.723+0000 7f821a761640 1 -- start start 2023-11-04T01:42:26.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.723+0000 7f821a761640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82140b2210 0x7f82141e7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.723+0000 7f821a761640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82140ceda0 0x7f8214159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.723+0000 7f821a761640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82140cf180 0x7f82140cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.723+0000 7f821a761640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82140cd420 con 0x7f82140ceda0 2023-11-04T01:42:26.725 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.723+0000 7f821a761640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82141f5e50 con 0x7f82140cf180 2023-11-04T01:42:26.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.723+0000 7f821a761640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82140ccb10 con 0x7f82140b2210 2023-11-04T01:42:26.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.723+0000 7f82137fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82140ceda0 0x7f8214159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.723+0000 7f82137fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82140ceda0 0x7f8214159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56274/0 (socket says 172.21.15.44:56274) 2023-11-04T01:42:26.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.723+0000 7f82137fe640 1 -- 172.21.15.44:0/4006066853 learned_addr learned my addr 172.21.15.44:0/4006066853 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:26.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.724+0000 7f8218cfe640 1 --2- 172.21.15.44:0/4006066853 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82140cf180 0x7f82140cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.724+0000 7f82137fe640 1 -- 172.21.15.44:0/4006066853 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82140b2210 msgr2=0x7f82141e7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.724+0000 7f82137fe640 1 --2- 172.21.15.44:0/4006066853 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82140b2210 0x7f82141e7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.724+0000 7f82137fe640 1 -- 172.21.15.44:0/4006066853 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82140cf180 msgr2=0x7f82140cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.724+0000 7f82137fe640 1 --2- 172.21.15.44:0/4006066853 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82140cf180 0x7f82140cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.724+0000 7f82137fe640 1 -- 172.21.15.44:0/4006066853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8204009400 con 0x7f82140ceda0 2023-11-04T01:42:26.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.724+0000 7f82137fe640 1 --2- 172.21.15.44:0/4006066853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82140ceda0 0x7f8214159190 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f8204009890 tx=0x7f82040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.724+0000 7f8210ff9640 1 -- 172.21.15.44:0/4006066853 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204032900 con 0x7f82140ceda0 2023-11-04T01:42:26.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.724+0000 7f8210ff9640 1 -- 172.21.15.44:0/4006066853 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8204032a60 con 0x7f82140ceda0 2023-11-04T01:42:26.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.724+0000 7f821a761640 1 -- 172.21.15.44:0/4006066853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82141e7c90 con 0x7f82140ceda0 2023-11-04T01:42:26.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.724+0000 7f8210ff9640 1 -- 172.21.15.44:0/4006066853 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204032e10 con 0x7f82140ceda0 2023-11-04T01:42:26.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.724+0000 7f821a761640 1 -- 172.21.15.44:0/4006066853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82140cd040 con 0x7f82140ceda0 2023-11-04T01:42:26.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.725+0000 7f821a761640 1 -- 172.21.15.44:0/4006066853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82140cd560 con 0x7f82140ceda0 2023-11-04T01:42:26.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.726+0000 7f8210ff9640 1 -- 172.21.15.44:0/4006066853 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82040453f0 con 0x7f82140ceda0 2023-11-04T01:42:26.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.726+0000 7f8210ff9640 1 --2- 172.21.15.44:0/4006066853 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f820006ae70 0x7f820006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.726+0000 7f8210ff9640 1 -- 172.21.15.44:0/4006066853 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f82040ac0e0 con 0x7f82140ceda0 2023-11-04T01:42:26.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.726+0000 7f8213fff640 1 --2- 172.21.15.44:0/4006066853 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f820006ae70 0x7f820006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.728 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.727+0000 7f8213fff640 1 --2- 172.21.15.44:0/4006066853 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f820006ae70 0x7f820006d330 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f82140cc320 tx=0x7f8208006c80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.731 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.730+0000 7f8210ff9640 1 -- 172.21.15.44:0/4006066853 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82140cd560 con 0x7f82140ceda0 2023-11-04T01:42:26.770 INFO:tasks.ceph.mds.a.smithi044.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:42:26.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.949+0000 7f821a761640 1 -- 172.21.15.44:0/4006066853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82140cd560 con 0x7f82140ceda0 2023-11-04T01:42:26.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.950+0000 7f8210ff9640 1 -- 172.21.15.44:0/4006066853 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f82140cd560 con 0x7f82140ceda0 2023-11-04T01:42:26.951 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:26.951 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:25.669925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:active","state_seq":7,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:26.951 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 97 2023-11-04T01:42:26.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.951+0000 7f821a761640 1 -- 172.21.15.44:0/4006066853 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f820006ae70 msgr2=0x7f820006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.951+0000 7f821a761640 1 --2- 172.21.15.44:0/4006066853 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f820006ae70 0x7f820006d330 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f82140cc320 tx=0x7f8208006c80 comp rx=0 tx=0).stop 2023-11-04T01:42:26.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.951+0000 7f821a761640 1 -- 172.21.15.44:0/4006066853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82140ceda0 msgr2=0x7f8214159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.951+0000 7f821a761640 1 --2- 172.21.15.44:0/4006066853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82140ceda0 0x7f8214159190 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f8204009890 tx=0x7f82040046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.951+0000 7f821a761640 1 -- 172.21.15.44:0/4006066853 shutdown_connections 2023-11-04T01:42:26.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.951+0000 7f821a761640 1 --2- 172.21.15.44:0/4006066853 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f820006ae70 0x7f820006d330 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.951+0000 7f821a761640 1 --2- 172.21.15.44:0/4006066853 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82140cf180 0x7f82140cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.951+0000 7f821a761640 1 --2- 172.21.15.44:0/4006066853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82140ceda0 0x7f8214159190 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.951+0000 7f821a761640 1 --2- 172.21.15.44:0/4006066853 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82140b2210 0x7f82141e7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.951+0000 7f821a761640 1 -- 172.21.15.44:0/4006066853 >> 172.21.15.44:0/4006066853 conn(0x7f82140d0c30 msgr2=0x7f821415c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:26.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.951+0000 7f821a761640 1 -- 172.21.15.44:0/4006066853 shutdown_connections 2023-11-04T01:42:26.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:26.952+0000 7f821a761640 1 -- 172.21.15.44:0/4006066853 wait complete. 2023-11-04T01:42:26.963 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:42:29.126 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:29.130 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:31.964 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:32.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.081+0000 7f772a2da640 1 Processor -- start 2023-11-04T01:42:32.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.081+0000 7f772a2da640 1 -- start start 2023-11-04T01:42:32.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.082+0000 7f772a2da640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f772415b330 0x7f77240cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.082+0000 7f772a2da640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f77240b2160 0x7f772406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.082+0000 7f772a2da640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77240cb5d0 con 0x7f772406ca60 2023-11-04T01:42:32.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.082+0000 7f772a2da640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772406f3f0 con 0x7f77240b2160 2023-11-04T01:42:32.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.082+0000 7f772a2da640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77240c3490 con 0x7f772415b330 2023-11-04T01:42:32.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.082+0000 7f77237fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f77240b2160 0x7f772406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.082+0000 7f77237fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f77240b2160 0x7f772406ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56286/0 (socket says 172.21.15.44:56286) 2023-11-04T01:42:32.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.082+0000 7f77237fe640 1 -- 172.21.15.44:0/3991269340 learned_addr learned my addr 172.21.15.44:0/3991269340 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:32.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.082+0000 7f77237fe640 1 -- 172.21.15.44:0/3991269340 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f772415b330 msgr2=0x7f77240cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:32.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.082+0000 7f77237fe640 1 --2- 172.21.15.44:0/3991269340 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f772415b330 0x7f77240cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.082+0000 7f77237fe640 1 -- 172.21.15.44:0/3991269340 >> v1:172.21.15.204:6789/0 conn(0x7f772406ca60 legacy=0x7f77240b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:32.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.082+0000 7f77237fe640 1 -- 172.21.15.44:0/3991269340 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77240cbfa0 con 0x7f77240b2160 2023-11-04T01:42:32.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.083+0000 7f77237fe640 1 --2- 172.21.15.44:0/3991269340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77240b2160 0x7f772406ebf0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f7714009870 tx=0x7f771402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ec2ef1684e9134 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:32.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.083+0000 7f7722ffd640 1 -- 172.21.15.44:0/3991269340 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7714031640 con 0x7f77240b2160 2023-11-04T01:42:32.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.083+0000 7f7722ffd640 1 -- 172.21.15.44:0/3991269340 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77140317a0 con 0x7f77240b2160 2023-11-04T01:42:32.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.083+0000 7f7722ffd640 1 -- 172.21.15.44:0/3991269340 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7714031b30 con 0x7f77240b2160 2023-11-04T01:42:32.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.084+0000 7f772a2da640 1 -- 172.21.15.44:0/3991269340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77240b2160 msgr2=0x7f772406ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.084+0000 7f772a2da640 1 --2- 172.21.15.44:0/3991269340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77240b2160 0x7f772406ebf0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f7714009870 tx=0x7f771402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.085 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.084+0000 7f772a2da640 1 -- 172.21.15.44:0/3991269340 shutdown_connections 2023-11-04T01:42:32.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.084+0000 7f772a2da640 1 --2- 172.21.15.44:0/3991269340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77240b2160 0x7f772406ebf0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.084+0000 7f772a2da640 1 --2- 172.21.15.44:0/3991269340 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f772415b330 0x7f77240cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.084+0000 7f772a2da640 1 -- 172.21.15.44:0/3991269340 >> 172.21.15.44:0/3991269340 conn(0x7f77240b1640 msgr2=0x7f77240b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:32.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.084+0000 7f772a2da640 1 -- 172.21.15.44:0/3991269340 shutdown_connections 2023-11-04T01:42:32.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.084+0000 7f772a2da640 1 -- 172.21.15.44:0/3991269340 wait complete. 2023-11-04T01:42:32.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.085+0000 7f772a2da640 1 Processor -- start 2023-11-04T01:42:32.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.085+0000 7f772a2da640 1 -- start start 2023-11-04T01:42:32.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.086+0000 7f772a2da640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f772406ca60 0x7f772415df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.086+0000 7f772a2da640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77240b2160 0x7f7724157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.086+0000 7f772a2da640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f772415b330 0x7f7724158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.086+0000 7f772a2da640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77240c5850 con 0x7f772415b330 2023-11-04T01:42:32.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.086+0000 7f772a2da640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77240acb70 con 0x7f772406ca60 2023-11-04T01:42:32.088 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.086+0000 7f772a2da640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7724158990 con 0x7f77240b2160 2023-11-04T01:42:32.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.086+0000 7f7728877640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f772415b330 0x7f7724158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.086+0000 7f7728877640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f772415b330 0x7f7724158450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56302/0 (socket says 172.21.15.44:56302) 2023-11-04T01:42:32.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.086+0000 7f7728877640 1 -- 172.21.15.44:0/657557513 learned_addr learned my addr 172.21.15.44:0/657557513 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:32.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.087+0000 7f77237fe640 1 --2- 172.21.15.44:0/657557513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77240b2160 0x7f7724157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.087+0000 7f7723fff640 1 --2- 172.21.15.44:0/657557513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f772406ca60 0x7f772415df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.087+0000 7f7728877640 1 -- 172.21.15.44:0/657557513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77240b2160 msgr2=0x7f7724157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.087+0000 7f7728877640 1 --2- 172.21.15.44:0/657557513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77240b2160 0x7f7724157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.087+0000 7f7728877640 1 -- 172.21.15.44:0/657557513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f772406ca60 msgr2=0x7f772415df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.087+0000 7f7728877640 1 --2- 172.21.15.44:0/657557513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f772406ca60 0x7f772415df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.087+0000 7f7728877640 1 -- 172.21.15.44:0/657557513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77140094d0 con 0x7f772415b330 2023-11-04T01:42:32.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.087+0000 7f7728877640 1 --2- 172.21.15.44:0/657557513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f772415b330 0x7f7724158450 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f771c00b990 tx=0x7f771c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:32.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.087+0000 7f7720ff9640 1 -- 172.21.15.44:0/657557513 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c00cba0 con 0x7f772415b330 2023-11-04T01:42:32.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.087+0000 7f7720ff9640 1 -- 172.21.15.44:0/657557513 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771c00cd00 con 0x7f772415b330 2023-11-04T01:42:32.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.087+0000 7f7720ff9640 1 -- 172.21.15.44:0/657557513 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c014680 con 0x7f772415b330 2023-11-04T01:42:32.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.087+0000 7f772a2da640 1 -- 172.21.15.44:0/657557513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77240c4fb0 con 0x7f772415b330 2023-11-04T01:42:32.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.087+0000 7f772a2da640 1 -- 172.21.15.44:0/657557513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77240c5570 con 0x7f772415b330 2023-11-04T01:42:32.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.088+0000 7f772a2da640 1 -- 172.21.15.44:0/657557513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772406da20 con 0x7f772415b330 2023-11-04T01:42:32.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.089+0000 7f7720ff9640 1 -- 172.21.15.44:0/657557513 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f771c0147e0 con 0x7f772415b330 2023-11-04T01:42:32.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.089+0000 7f7720ff9640 1 --2- 172.21.15.44:0/657557513 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f770406ae70 0x7f770406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.089+0000 7f7720ff9640 1 -- 172.21.15.44:0/657557513 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f771c089d10 con 0x7f772415b330 2023-11-04T01:42:32.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.090+0000 7f7723fff640 1 --2- 172.21.15.44:0/657557513 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f770406ae70 0x7f770406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.091 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.090+0000 7f7723fff640 1 --2- 172.21.15.44:0/657557513 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f770406ae70 0x7f770406d330 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f77240c3f70 tx=0x7f770c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:32.094 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.094+0000 7f7720ff9640 1 -- 172.21.15.44:0/657557513 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f771c054600 con 0x7f772415b330 2023-11-04T01:42:32.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.309+0000 7f772a2da640 1 -- 172.21.15.44:0/657557513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77240ac8d0 con 0x7f772415b330 2023-11-04T01:42:32.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.311+0000 7f7720ff9640 1 -- 172.21.15.44:0/657557513 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f77240ac8d0 con 0x7f772415b330 2023-11-04T01:42:32.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:25.669925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:active","state_seq":7,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:32.312 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 97 2023-11-04T01:42:32.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.312+0000 7f772a2da640 1 -- 172.21.15.44:0/657557513 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f770406ae70 msgr2=0x7f770406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.312+0000 7f772a2da640 1 --2- 172.21.15.44:0/657557513 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f770406ae70 0x7f770406d330 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f77240c3f70 tx=0x7f770c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:32.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.312+0000 7f772a2da640 1 -- 172.21.15.44:0/657557513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f772415b330 msgr2=0x7f7724158450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.312+0000 7f772a2da640 1 --2- 172.21.15.44:0/657557513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f772415b330 0x7f7724158450 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f771c00b990 tx=0x7f771c00be50 comp rx=0 tx=0).stop 2023-11-04T01:42:32.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.313+0000 7f772a2da640 1 -- 172.21.15.44:0/657557513 shutdown_connections 2023-11-04T01:42:32.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.313+0000 7f772a2da640 1 --2- 172.21.15.44:0/657557513 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f770406ae70 0x7f770406d330 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.313+0000 7f772a2da640 1 --2- 172.21.15.44:0/657557513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f772415b330 0x7f7724158450 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.313+0000 7f772a2da640 1 --2- 172.21.15.44:0/657557513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77240b2160 0x7f7724157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.313+0000 7f772a2da640 1 --2- 172.21.15.44:0/657557513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f772406ca60 0x7f772415df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.313+0000 7f772a2da640 1 -- 172.21.15.44:0/657557513 >> 172.21.15.44:0/657557513 conn(0x7f77240b1640 msgr2=0x7f77240aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:32.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.313+0000 7f772a2da640 1 -- 172.21.15.44:0/657557513 shutdown_connections 2023-11-04T01:42:32.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:32.313+0000 7f772a2da640 1 -- 172.21.15.44:0/657557513 wait complete. 2023-11-04T01:42:32.324 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:42:33.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:42:37.325 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:37.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.441+0000 7fa619d16640 1 Processor -- start 2023-11-04T01:42:37.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.441+0000 7fa619d16640 1 -- start start 2023-11-04T01:42:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.442+0000 7fa619d16640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa61415d4e0 0x7fa6140d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.442+0000 7fa619d16640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa6140d3b60 0x7fa6140d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.442+0000 7fa619d16640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6140b32b0 con 0x7fa61415d100 2023-11-04T01:42:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.442+0000 7fa619d16640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6140cec20 con 0x7fa61415d4e0 2023-11-04T01:42:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.442+0000 7fa619d16640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6140cee10 con 0x7fa6140d3b60 2023-11-04T01:42:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.442+0000 7fa612ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa61415d4e0 0x7fa6140d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.442+0000 7fa6137fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa61415d100 0x7fa6140ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41892/0 (socket says 172.21.15.44:41892) 2023-11-04T01:42:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.442+0000 7fa6137fe640 1 -- 172.21.15.44:0/3115279818 learned_addr learned my addr 172.21.15.44:0/3115279818 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.443+0000 7fa612ffd640 1 -- 172.21.15.44:0/3115279818 >> v2:172.21.15.204:3300/0 conn(0x7fa6140d3b60 msgr2=0x7fa6140d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.443+0000 7fa612ffd640 1 --2- 172.21.15.44:0/3115279818 >> v2:172.21.15.204:3300/0 conn(0x7fa6140d3b60 0x7fa6140d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.443+0000 7fa612ffd640 1 -- 172.21.15.44:0/3115279818 >> v1:172.21.15.44:6789/0 conn(0x7fa61415d100 legacy=0x7fa6140ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.443+0000 7fa6127fc640 1 -- 172.21.15.44:0/3115279818 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460091900 0 0) 0x7fa6140b32b0 con 0x7fa61415d100 2023-11-04T01:42:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.443+0000 7fa612ffd640 1 -- 172.21.15.44:0/3115279818 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6140b4750 con 0x7fa61415d4e0 2023-11-04T01:42:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.444+0000 7fa612ffd640 1 --2- 172.21.15.44:0/3115279818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61415d4e0 0x7fa6140d14d0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fa61408d6a0 tx=0x7fa60802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2d20529a973938 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.444+0000 7fa6127fc640 1 -- 172.21.15.44:0/3115279818 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608031830 con 0x7fa61415d4e0 2023-11-04T01:42:37.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.444+0000 7fa6127fc640 1 -- 172.21.15.44:0/3115279818 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa608031990 con 0x7fa61415d4e0 2023-11-04T01:42:37.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.444+0000 7fa6127fc640 1 -- 172.21.15.44:0/3115279818 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608031d20 con 0x7fa61415d4e0 2023-11-04T01:42:37.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.444+0000 7fa619d16640 1 -- 172.21.15.44:0/3115279818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61415d4e0 msgr2=0x7fa6140d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.444+0000 7fa619d16640 1 --2- 172.21.15.44:0/3115279818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61415d4e0 0x7fa6140d14d0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fa61408d6a0 tx=0x7fa60802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.444+0000 7fa619d16640 1 -- 172.21.15.44:0/3115279818 shutdown_connections 2023-11-04T01:42:37.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.444+0000 7fa619d16640 1 --2- 172.21.15.44:0/3115279818 >> v2:172.21.15.204:3300/0 conn(0x7fa6140d3b60 0x7fa6140d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.444+0000 7fa619d16640 1 --2- 172.21.15.44:0/3115279818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61415d4e0 0x7fa6140d14d0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.444+0000 7fa619d16640 1 -- 172.21.15.44:0/3115279818 >> 172.21.15.44:0/3115279818 conn(0x7fa6140d2ef0 msgr2=0x7fa6140d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.444+0000 7fa619d16640 1 -- 172.21.15.44:0/3115279818 shutdown_connections 2023-11-04T01:42:37.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.444+0000 7fa619d16640 1 -- 172.21.15.44:0/3115279818 wait complete. 2023-11-04T01:42:37.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.446+0000 7fa619d16640 1 Processor -- start 2023-11-04T01:42:37.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.446+0000 7fa619d16640 1 -- start start 2023-11-04T01:42:37.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.446+0000 7fa619d16640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6140d3b60 0x7fa61415fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.446+0000 7fa619d16640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61415d100 0x7fa6140b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa619d16640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa61415d4e0 0x7fa6140b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa619d16640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa614160300 con 0x7fa61415d100 2023-11-04T01:42:37.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa619d16640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61415f930 con 0x7fa61415d4e0 2023-11-04T01:42:37.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa619d16640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61415ed20 con 0x7fa6140d3b60 2023-11-04T01:42:37.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa612ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61415d100 0x7fa6140b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa612ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61415d100 0x7fa6140b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56216/0 (socket says 172.21.15.44:56216) 2023-11-04T01:42:37.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa612ffd640 1 -- 172.21.15.44:0/2734808916 learned_addr learned my addr 172.21.15.44:0/2734808916 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:37.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa6137fe640 1 --2- 172.21.15.44:0/2734808916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6140d3b60 0x7fa61415fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa613fff640 1 --2- 172.21.15.44:0/2734808916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa61415d4e0 0x7fa6140b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa612ffd640 1 -- 172.21.15.44:0/2734808916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6140d3b60 msgr2=0x7fa61415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa612ffd640 1 --2- 172.21.15.44:0/2734808916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6140d3b60 0x7fa61415fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa612ffd640 1 -- 172.21.15.44:0/2734808916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa61415d4e0 msgr2=0x7fa6140b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa612ffd640 1 --2- 172.21.15.44:0/2734808916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa61415d4e0 0x7fa6140b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa612ffd640 1 -- 172.21.15.44:0/2734808916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa608009400 con 0x7fa61415d100 2023-11-04T01:42:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa613fff640 1 --2- 172.21.15.44:0/2734808916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa61415d4e0 0x7fa6140b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa612ffd640 1 --2- 172.21.15.44:0/2734808916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61415d100 0x7fa6140b5a70 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fa608034040 tx=0x7fa6080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa5fbfff640 1 -- 172.21.15.44:0/2734808916 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60803ba70 con 0x7fa61415d100 2023-11-04T01:42:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa5fbfff640 1 -- 172.21.15.44:0/2734808916 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60803bbd0 con 0x7fa61415d100 2023-11-04T01:42:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa619d16640 1 -- 172.21.15.44:0/2734808916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61415f000 con 0x7fa61415d100 2023-11-04T01:42:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.447+0000 7fa5fbfff640 1 -- 172.21.15.44:0/2734808916 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6080453f0 con 0x7fa61415d100 2023-11-04T01:42:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.448+0000 7fa619d16640 1 -- 172.21.15.44:0/2734808916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61415f5c0 con 0x7fa61415d100 2023-11-04T01:42:37.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.448+0000 7fa619d16640 1 -- 172.21.15.44:0/2734808916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61415fac0 con 0x7fa61415d100 2023-11-04T01:42:37.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.449+0000 7fa5fbfff640 1 -- 172.21.15.44:0/2734808916 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa608045550 con 0x7fa61415d100 2023-11-04T01:42:37.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.449+0000 7fa5fbfff640 1 --2- 172.21.15.44:0/2734808916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa60006ae70 0x7fa60006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.449+0000 7fa5fbfff640 1 -- 172.21.15.44:0/2734808916 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7fa6080ac1e0 con 0x7fa61415d100 2023-11-04T01:42:37.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.450+0000 7fa6137fe640 1 --2- 172.21.15.44:0/2734808916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa60006ae70 0x7fa60006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.450+0000 7fa6137fe640 1 --2- 172.21.15.44:0/2734808916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa60006ae70 0x7fa60006d330 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa6040010e0 tx=0x7fa604009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.454+0000 7fa5fbfff640 1 -- 172.21.15.44:0/2734808916 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa608076c00 con 0x7fa61415d100 2023-11-04T01:42:37.667 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.666+0000 7fa619d16640 1 -- 172.21.15.44:0/2734808916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6140684b0 con 0x7fa61415d100 2023-11-04T01:42:37.668 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.666+0000 7fa5fbfff640 1 -- 172.21.15.44:0/2734808916 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4929 (secure 0 0 0) 0x7fa60807a220 con 0x7fa61415d100 2023-11-04T01:42:37.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:37.669 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:25.669925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:active","state_seq":7,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:37.669 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 97 2023-11-04T01:42:37.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.668+0000 7fa619d16640 1 -- 172.21.15.44:0/2734808916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa60006ae70 msgr2=0x7fa60006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.670 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.668+0000 7fa619d16640 1 --2- 172.21.15.44:0/2734808916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa60006ae70 0x7fa60006d330 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa6040010e0 tx=0x7fa604009040 comp rx=0 tx=0).stop 2023-11-04T01:42:37.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.668+0000 7fa619d16640 1 -- 172.21.15.44:0/2734808916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61415d100 msgr2=0x7fa6140b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.668+0000 7fa619d16640 1 --2- 172.21.15.44:0/2734808916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61415d100 0x7fa6140b5a70 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fa608034040 tx=0x7fa6080046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.668+0000 7fa619d16640 1 -- 172.21.15.44:0/2734808916 shutdown_connections 2023-11-04T01:42:37.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.668+0000 7fa619d16640 1 --2- 172.21.15.44:0/2734808916 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa60006ae70 0x7fa60006d330 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.668+0000 7fa619d16640 1 --2- 172.21.15.44:0/2734808916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa61415d4e0 0x7fa6140b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.668+0000 7fa619d16640 1 --2- 172.21.15.44:0/2734808916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa61415d100 0x7fa6140b5a70 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.668+0000 7fa619d16640 1 --2- 172.21.15.44:0/2734808916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6140d3b60 0x7fa61415fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.668+0000 7fa619d16640 1 -- 172.21.15.44:0/2734808916 >> 172.21.15.44:0/2734808916 conn(0x7fa6140d2ef0 msgr2=0x7fa61406b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.668+0000 7fa619d16640 1 -- 172.21.15.44:0/2734808916 shutdown_connections 2023-11-04T01:42:37.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:37.668+0000 7fa619d16640 1 -- 172.21.15.44:0/2734808916 wait complete. 2023-11-04T01:42:37.681 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:42:40.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-04T01:42:42.682 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:42.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.799+0000 7f96fa3ee640 1 Processor -- start 2023-11-04T01:42:42.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.799+0000 7f96fa3ee640 1 -- start start 2023-11-04T01:42:42.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.800+0000 7f96fa3ee640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f96f415b190 0x7f96f409cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.800+0000 7f96fa3ee640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96f415c3c0 0x7f96f406a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.800+0000 7f96fa3ee640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f406ca10 con 0x7f96f40b0d30 2023-11-04T01:42:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.800+0000 7f96fa3ee640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f406e160 con 0x7f96f415b190 2023-11-04T01:42:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.800+0000 7f96fa3ee640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f4066520 con 0x7f96f415c3c0 2023-11-04T01:42:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.800+0000 7f96f37fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f96f415b190 0x7f96f409cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.800+0000 7f96f37fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f96f415b190 0x7f96f409cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51036/0 (socket says 172.21.15.44:51036) 2023-11-04T01:42:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.800+0000 7f96f37fe640 1 -- 172.21.15.44:0/3589289580 learned_addr learned my addr 172.21.15.44:0/3589289580 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.800+0000 7f96f898b640 1 --2- 172.21.15.44:0/3589289580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96f415c3c0 0x7f96f406a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.800+0000 7f96f37fe640 1 -- 172.21.15.44:0/3589289580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96f415c3c0 msgr2=0x7f96f406a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.800+0000 7f96f37fe640 1 --2- 172.21.15.44:0/3589289580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96f415c3c0 0x7f96f406a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.800+0000 7f96f37fe640 1 -- 172.21.15.44:0/3589289580 >> v1:172.21.15.204:6789/0 conn(0x7f96f40b0d30 legacy=0x7f96f40b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.800+0000 7f96f37fe640 1 -- 172.21.15.44:0/3589289580 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f40b3f00 con 0x7f96f415b190 2023-11-04T01:42:42.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.801+0000 7f96f37fe640 1 --2- 172.21.15.44:0/3589289580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96f415b190 0x7f96f409cd20 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009870 tx=0x7f96e402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20141cf790a3aa3f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.804 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.801+0000 7f96f2ffd640 1 -- 172.21.15.44:0/3589289580 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4031640 con 0x7f96f415b190 2023-11-04T01:42:42.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.801+0000 7f96f2ffd640 1 -- 172.21.15.44:0/3589289580 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e40317a0 con 0x7f96f415b190 2023-11-04T01:42:42.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.801+0000 7f96f2ffd640 1 -- 172.21.15.44:0/3589289580 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4031b30 con 0x7f96f415b190 2023-11-04T01:42:42.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.802+0000 7f96fa3ee640 1 -- 172.21.15.44:0/3589289580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96f415b190 msgr2=0x7f96f409cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.802+0000 7f96fa3ee640 1 --2- 172.21.15.44:0/3589289580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96f415b190 0x7f96f409cd20 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009870 tx=0x7f96e402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.802+0000 7f96fa3ee640 1 -- 172.21.15.44:0/3589289580 shutdown_connections 2023-11-04T01:42:42.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.802+0000 7f96fa3ee640 1 --2- 172.21.15.44:0/3589289580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96f415c3c0 0x7f96f406a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.802+0000 7f96fa3ee640 1 --2- 172.21.15.44:0/3589289580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96f415b190 0x7f96f409cd20 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.802+0000 7f96fa3ee640 1 -- 172.21.15.44:0/3589289580 >> 172.21.15.44:0/3589289580 conn(0x7f96f40cbd30 msgr2=0x7f96f40cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.802+0000 7f96fa3ee640 1 -- 172.21.15.44:0/3589289580 shutdown_connections 2023-11-04T01:42:42.805 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.802+0000 7f96fa3ee640 1 -- 172.21.15.44:0/3589289580 wait complete. 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.803+0000 7f96fa3ee640 1 Processor -- start 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.803+0000 7f96fa3ee640 1 -- start start 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.804+0000 7f96fa3ee640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96f40b0d30 0x7f96f409a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.804+0000 7f96fa3ee640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96f415b190 0x7f96f41e2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.804+0000 7f96fa3ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96f415c3c0 0x7f96f41f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.804+0000 7f96fa3ee640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f41f6a00 con 0x7f96f415c3c0 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.804+0000 7f96fa3ee640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f4158e30 con 0x7f96f40b0d30 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.804+0000 7f96fa3ee640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f41f6c30 con 0x7f96f415b190 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.804+0000 7f96f898b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96f415c3c0 0x7f96f41f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.804+0000 7f96f898b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96f415c3c0 0x7f96f41f64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51048/0 (socket says 172.21.15.44:51048) 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.804+0000 7f96f898b640 1 -- 172.21.15.44:0/3178086018 learned_addr learned my addr 172.21.15.44:0/3178086018 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.805+0000 7f96f37fe640 1 --2- 172.21.15.44:0/3178086018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96f415b190 0x7f96f41e2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.805+0000 7f96f3fff640 1 --2- 172.21.15.44:0/3178086018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96f40b0d30 0x7f96f409a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.805+0000 7f96f898b640 1 -- 172.21.15.44:0/3178086018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96f415b190 msgr2=0x7f96f41e2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.805+0000 7f96f898b640 1 --2- 172.21.15.44:0/3178086018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96f415b190 0x7f96f41e2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.805+0000 7f96f898b640 1 -- 172.21.15.44:0/3178086018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96f40b0d30 msgr2=0x7f96f409a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.805+0000 7f96f898b640 1 --2- 172.21.15.44:0/3178086018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96f40b0d30 0x7f96f409a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.805+0000 7f96f898b640 1 -- 172.21.15.44:0/3178086018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e40094d0 con 0x7f96f415c3c0 2023-11-04T01:42:42.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.805+0000 7f96f898b640 1 --2- 172.21.15.44:0/3178086018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96f415c3c0 0x7f96f41f64c0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f96ec007e60 tx=0x7f96ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.805+0000 7f96f0ff9640 1 -- 172.21.15.44:0/3178086018 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec014420 con 0x7f96f415c3c0 2023-11-04T01:42:42.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.805+0000 7f96f0ff9640 1 -- 172.21.15.44:0/3178086018 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec0145a0 con 0x7f96f415c3c0 2023-11-04T01:42:42.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.805+0000 7f96f0ff9640 1 -- 172.21.15.44:0/3178086018 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec014950 con 0x7f96f415c3c0 2023-11-04T01:42:42.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.805+0000 7f96fa3ee640 1 -- 172.21.15.44:0/3178086018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f41f6f10 con 0x7f96f415c3c0 2023-11-04T01:42:42.809 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.805+0000 7f96fa3ee640 1 -- 172.21.15.44:0/3178086018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f40ac6b0 con 0x7f96f415c3c0 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.806+0000 7f96fa3ee640 1 -- 172.21.15.44:0/3178086018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f41f7430 con 0x7f96f415c3c0 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.807+0000 7f96f0ff9640 1 -- 172.21.15.44:0/3178086018 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f96ec014ab0 con 0x7f96f415c3c0 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.807+0000 7f96f0ff9640 1 --2- 172.21.15.44:0/3178086018 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f96e006ae70 0x7f96e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.807+0000 7f96f0ff9640 1 -- 172.21.15.44:0/3178086018 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f96ec08a6a0 con 0x7f96f415c3c0 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.807+0000 7f96f3fff640 1 --2- 172.21.15.44:0/3178086018 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f96e006ae70 0x7f96e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.811 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.808+0000 7f96f3fff640 1 --2- 172.21.15.44:0/3178086018 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f96e006ae70 0x7f96e006d330 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f96e8004e50 tx=0x7f96e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.813 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:42.811+0000 7f96f0ff9640 1 -- 172.21.15.44:0/3178086018 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f96ec055010 con 0x7f96f415c3c0 2023-11-04T01:42:43.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.025+0000 7f96fa3ee640 1 -- 172.21.15.44:0/3178086018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96f40684b0 con 0x7f96f415c3c0 2023-11-04T01:42:43.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.025+0000 7f96f0ff9640 1 -- 172.21.15.44:0/3178086018 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4977 (secure 0 0 0) 0x7f96ec058630 con 0x7f96f415c3c0 2023-11-04T01:42:43.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:43.027 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":98,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:39.238033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:active","state_seq":7,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:42:39.238033+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 98 2023-11-04T01:42:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.027+0000 7f96fa3ee640 1 -- 172.21.15.44:0/3178086018 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f96e006ae70 msgr2=0x7f96e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.027+0000 7f96fa3ee640 1 --2- 172.21.15.44:0/3178086018 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f96e006ae70 0x7f96e006d330 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f96e8004e50 tx=0x7f96e8009040 comp rx=0 tx=0).stop 2023-11-04T01:42:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.027+0000 7f96fa3ee640 1 -- 172.21.15.44:0/3178086018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96f415c3c0 msgr2=0x7f96f41f64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.027+0000 7f96fa3ee640 1 --2- 172.21.15.44:0/3178086018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96f415c3c0 0x7f96f41f64c0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f96ec007e60 tx=0x7f96ec00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.027+0000 7f96fa3ee640 1 -- 172.21.15.44:0/3178086018 shutdown_connections 2023-11-04T01:42:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.027+0000 7f96fa3ee640 1 --2- 172.21.15.44:0/3178086018 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f96e006ae70 0x7f96e006d330 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.027+0000 7f96fa3ee640 1 --2- 172.21.15.44:0/3178086018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96f415c3c0 0x7f96f41f64c0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.027+0000 7f96fa3ee640 1 --2- 172.21.15.44:0/3178086018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96f415b190 0x7f96f41e2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.027+0000 7f96fa3ee640 1 --2- 172.21.15.44:0/3178086018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96f40b0d30 0x7f96f409a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.027+0000 7f96fa3ee640 1 -- 172.21.15.44:0/3178086018 >> 172.21.15.44:0/3178086018 conn(0x7f96f40cbd30 msgr2=0x7f96f415a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.027+0000 7f96fa3ee640 1 -- 172.21.15.44:0/3178086018 shutdown_connections 2023-11-04T01:42:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.027+0000 7f96fa3ee640 1 -- 172.21.15.44:0/3178086018 wait complete. 2023-11-04T01:42:43.040 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:42:43.040 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:42:43.069 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:42:43.070 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:42:43.070 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:42:43.144 INFO:teuthology.orchestra.run.smithi044.stdout:1699062146.121005.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:42:43.146 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062146.121005.core'] 2023-11-04T01:42:43.146 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062146.121005.core, deleting it 2023-11-04T01:42:43.146 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062146.121005.core 2023-11-04T01:42:43.220 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:43.365 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.364+0000 7f3b284a9640 1 Processor -- start 2023-11-04T01:42:43.366 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.364+0000 7f3b284a9640 1 -- start start 2023-11-04T01:42:43.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.364+0000 7f3b284a9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3b200b1440 0x7f3b2006c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.365+0000 7f3b284a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3b2006b740 0x7f3b20066010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.365+0000 7f3b284a9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b200ad6a0 con 0x7f3b2015ade0 2023-11-04T01:42:43.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.365+0000 7f3b284a9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b200acaf0 con 0x7f3b2006b740 2023-11-04T01:42:43.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.365+0000 7f3b284a9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b200acdd0 con 0x7f3b200b1440 2023-11-04T01:42:43.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.365+0000 7f3b26a46640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3b2006b740 0x7f3b20066010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.365+0000 7f3b26245640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3b2015ade0 0x7f3b200b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41936/0 (socket says 172.21.15.44:41936) 2023-11-04T01:42:43.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.365+0000 7f3b26245640 1 -- 172.21.15.44:0/345332057 learned_addr learned my addr 172.21.15.44:0/345332057 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:43.367 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.365+0000 7f3b26a46640 1 -- 172.21.15.44:0/345332057 >> v2:172.21.15.204:3300/0 conn(0x7f3b200b1440 msgr2=0x7f3b2006c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:43.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.365+0000 7f3b25a44640 1 --2- 172.21.15.44:0/345332057 >> v2:172.21.15.204:3300/0 conn(0x7f3b200b1440 0x7f3b2006c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.365+0000 7f3b25243640 1 -- 172.21.15.44:0/345332057 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628954978 0 0) 0x7f3b200ad6a0 con 0x7f3b2015ade0 2023-11-04T01:42:43.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.365+0000 7f3b26a46640 1 --2- 172.21.15.44:0/345332057 >> v2:172.21.15.204:3300/0 conn(0x7f3b200b1440 0x7f3b2006c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.365+0000 7f3b26a46640 1 -- 172.21.15.44:0/345332057 >> v1:172.21.15.44:6789/0 conn(0x7f3b2015ade0 legacy=0x7f3b200b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.365+0000 7f3b26a46640 1 -- 172.21.15.44:0/345332057 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b200ad0e0 con 0x7f3b2006b740 2023-11-04T01:42:43.368 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.365+0000 7f3b25a44640 1 --2- 172.21.15.44:0/345332057 >> v2:172.21.15.204:3300/0 conn(0x7f3b200b1440 0x7f3b2006c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.366+0000 7f3b26a46640 1 --2- 172.21.15.44:0/345332057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b2006b740 0x7f3b20066010 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f3b2006ecb0 tx=0x7f3b1002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21eda50b6a26fc47 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.366+0000 7f3b25243640 1 -- 172.21.15.44:0/345332057 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1002cbf0 con 0x7f3b2006b740 2023-11-04T01:42:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.366+0000 7f3b25243640 1 -- 172.21.15.44:0/345332057 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1002cd50 con 0x7f3b2006b740 2023-11-04T01:42:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.366+0000 7f3b25243640 1 -- 172.21.15.44:0/345332057 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b10034660 con 0x7f3b2006b740 2023-11-04T01:42:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.366+0000 7f3b284a9640 1 -- 172.21.15.44:0/345332057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b2006b740 msgr2=0x7f3b20066010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.366+0000 7f3b284a9640 1 --2- 172.21.15.44:0/345332057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b2006b740 0x7f3b20066010 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f3b2006ecb0 tx=0x7f3b1002be40 comp rx=0 tx=0).stop 2023-11-04T01:42:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.367+0000 7f3b284a9640 1 -- 172.21.15.44:0/345332057 shutdown_connections 2023-11-04T01:42:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.367+0000 7f3b284a9640 1 --2- 172.21.15.44:0/345332057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b2006b740 0x7f3b20066010 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.367+0000 7f3b284a9640 1 --2- 172.21.15.44:0/345332057 >> v2:172.21.15.204:3300/0 conn(0x7f3b200b1440 0x7f3b2006c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.367+0000 7f3b284a9640 1 -- 172.21.15.44:0/345332057 >> 172.21.15.44:0/345332057 conn(0x7f3b200cbd30 msgr2=0x7f3b200cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.367+0000 7f3b284a9640 1 -- 172.21.15.44:0/345332057 shutdown_connections 2023-11-04T01:42:43.370 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.367+0000 7f3b284a9640 1 -- 172.21.15.44:0/345332057 wait complete. 2023-11-04T01:42:43.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.368+0000 7f3b284a9640 1 Processor -- start 2023-11-04T01:42:43.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.368+0000 7f3b284a9640 1 -- start start 2023-11-04T01:42:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.368+0000 7f3b284a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b2006b740 0x7f3b20146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.368+0000 7f3b284a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b200b1440 0x7f3b200b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.368+0000 7f3b284a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b2015ade0 0x7f3b200b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.368+0000 7f3b284a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b200aec10 con 0x7f3b200b1440 2023-11-04T01:42:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b284a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b200afa70 con 0x7f3b2006b740 2023-11-04T01:42:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b284a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b200aff00 con 0x7f3b2015ade0 2023-11-04T01:42:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b25a44640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b200b1440 0x7f3b200b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b25a44640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b200b1440 0x7f3b200b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51058/0 (socket says 172.21.15.44:51058) 2023-11-04T01:42:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b25a44640 1 -- 172.21.15.44:0/4138077764 learned_addr learned my addr 172.21.15.44:0/4138077764 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b26a46640 1 --2- 172.21.15.44:0/4138077764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b2015ade0 0x7f3b200b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b26245640 1 --2- 172.21.15.44:0/4138077764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b2006b740 0x7f3b20146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b25a44640 1 -- 172.21.15.44:0/4138077764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b2015ade0 msgr2=0x7f3b200b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b25a44640 1 --2- 172.21.15.44:0/4138077764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b2015ade0 0x7f3b200b2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b25a44640 1 -- 172.21.15.44:0/4138077764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b2006b740 msgr2=0x7f3b20146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b25a44640 1 --2- 172.21.15.44:0/4138077764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b2006b740 0x7f3b20146520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b25a44640 1 -- 172.21.15.44:0/4138077764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b10009a70 con 0x7f3b200b1440 2023-11-04T01:42:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b25a44640 1 --2- 172.21.15.44:0/4138077764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b200b1440 0x7f3b200b0b80 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400c820 tx=0x7f3b1400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b1effd640 1 -- 172.21.15.44:0/4138077764 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14007a30 con 0x7f3b200b1440 2023-11-04T01:42:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b1effd640 1 -- 172.21.15.44:0/4138077764 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b14007b90 con 0x7f3b200b1440 2023-11-04T01:42:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b284a9640 1 -- 172.21.15.44:0/4138077764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b200aee60 con 0x7f3b200b1440 2023-11-04T01:42:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b1effd640 1 -- 172.21.15.44:0/4138077764 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1400ce70 con 0x7f3b200b1440 2023-11-04T01:42:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.369+0000 7f3b284a9640 1 -- 172.21.15.44:0/4138077764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b200af420 con 0x7f3b200b1440 2023-11-04T01:42:43.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.371+0000 7f3b284a9640 1 -- 172.21.15.44:0/4138077764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b20066600 con 0x7f3b200b1440 2023-11-04T01:42:43.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.371+0000 7f3b1effd640 1 -- 172.21.15.44:0/4138077764 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b140113f0 con 0x7f3b200b1440 2023-11-04T01:42:43.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.371+0000 7f3b1effd640 1 --2- 172.21.15.44:0/4138077764 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b0c06ae70 0x7f3b0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.372+0000 7f3b1effd640 1 -- 172.21.15.44:0/4138077764 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f3b1408a070 con 0x7f3b200b1440 2023-11-04T01:42:43.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.372+0000 7f3b26245640 1 --2- 172.21.15.44:0/4138077764 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b0c06ae70 0x7f3b0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.372+0000 7f3b26245640 1 --2- 172.21.15.44:0/4138077764 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b0c06ae70 0x7f3b0c06d330 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3b18001580 tx=0x7f3b18009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.376+0000 7f3b1effd640 1 -- 172.21.15.44:0/4138077764 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b140bcca0 con 0x7f3b200b1440 2023-11-04T01:42:43.588 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.586+0000 7f3b284a9640 1 -- 172.21.15.44:0/4138077764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b200684b0 con 0x7f3b200b1440 2023-11-04T01:42:43.589 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.587+0000 7f3b1effd640 1 -- 172.21.15.44:0/4138077764 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4977 (secure 0 0 0) 0x7f3b1401f090 con 0x7f3b200b1440 2023-11-04T01:42:43.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:43.589 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":98,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:39.238033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8034,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:active","state_seq":7,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8034":{"gid":8034,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.44:6835/3264332323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3264332323},{"type":"v1","addr":"172.21.15.44:6835","nonce":3264332323}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:42:39.238033+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:43.590 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 98 2023-11-04T01:42:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.589+0000 7f3b284a9640 1 -- 172.21.15.44:0/4138077764 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b0c06ae70 msgr2=0x7f3b0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.589+0000 7f3b284a9640 1 --2- 172.21.15.44:0/4138077764 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b0c06ae70 0x7f3b0c06d330 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3b18001580 tx=0x7f3b18009040 comp rx=0 tx=0).stop 2023-11-04T01:42:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.589+0000 7f3b284a9640 1 -- 172.21.15.44:0/4138077764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b200b1440 msgr2=0x7f3b200b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.589+0000 7f3b284a9640 1 --2- 172.21.15.44:0/4138077764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b200b1440 0x7f3b200b0b80 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400c820 tx=0x7f3b1400cc20 comp rx=0 tx=0).stop 2023-11-04T01:42:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.589+0000 7f3b284a9640 1 -- 172.21.15.44:0/4138077764 shutdown_connections 2023-11-04T01:42:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.589+0000 7f3b284a9640 1 --2- 172.21.15.44:0/4138077764 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3b0c06ae70 0x7f3b0c06d330 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.589+0000 7f3b284a9640 1 --2- 172.21.15.44:0/4138077764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b2015ade0 0x7f3b200b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.589+0000 7f3b284a9640 1 --2- 172.21.15.44:0/4138077764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b200b1440 0x7f3b200b0b80 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.589+0000 7f3b284a9640 1 --2- 172.21.15.44:0/4138077764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b2006b740 0x7f3b20146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.589+0000 7f3b284a9640 1 -- 172.21.15.44:0/4138077764 >> 172.21.15.44:0/4138077764 conn(0x7f3b200cbd30 msgr2=0x7f3b20156f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.589+0000 7f3b284a9640 1 -- 172.21.15.44:0/4138077764 shutdown_connections 2023-11-04T01:42:43.592 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.589+0000 7f3b284a9640 1 -- 172.21.15.44:0/4138077764 wait complete. 2023-11-04T01:42:43.602 INFO:tasks.ceph.mds.d:Sent signal 9 2023-11-04T01:42:43.602 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:43.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.602 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 down 2023-11-04T01:42:43.634 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:42:43.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.783+0000 7f09c1e90640 1 Processor -- start 2023-11-04T01:42:43.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.783+0000 7f09c1e90640 1 -- start start 2023-11-04T01:42:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.784+0000 7f09c1e90640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f09bc0ade00 0x7f09bc0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.784+0000 7f09c1e90640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09bc06d9c0 0x7f09bc0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.784+0000 7f09c1e90640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09bc06cc90 con 0x7f09bc06c5f0 2023-11-04T01:42:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.784+0000 7f09c1e90640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09bc0b0e60 con 0x7f09bc0ade00 2023-11-04T01:42:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.784+0000 7f09c1e90640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc06cee0 con 0x7f09bc06d9c0 2023-11-04T01:42:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.784+0000 7f09bb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f09bc0ade00 0x7f09bc0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.784+0000 7f09bb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f09bc0ade00 0x7f09bc0b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51068/0 (socket says 172.21.15.44:51068) 2023-11-04T01:42:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.784+0000 7f09bb7fe640 1 -- 172.21.15.44:0/4053890532 learned_addr learned my addr 172.21.15.44:0/4053890532 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:43.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.784+0000 7f09baffd640 1 --2- 172.21.15.44:0/4053890532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09bc06d9c0 0x7f09bc0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.784+0000 7f09bb7fe640 1 -- 172.21.15.44:0/4053890532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09bc06d9c0 msgr2=0x7f09bc0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:43.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.784+0000 7f09bb7fe640 1 --2- 172.21.15.44:0/4053890532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09bc06d9c0 0x7f09bc0710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.784+0000 7f09bb7fe640 1 -- 172.21.15.44:0/4053890532 >> v1:172.21.15.204:6789/0 conn(0x7f09bc06c5f0 legacy=0x7f09bc15e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.784+0000 7f09bb7fe640 1 -- 172.21.15.44:0/4053890532 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc06d1c0 con 0x7f09bc0ade00 2023-11-04T01:42:43.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.785+0000 7f09bb7fe640 1 --2- 172.21.15.44:0/4053890532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc0ade00 0x7f09bc0b0530 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009870 tx=0x7f09ac02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e98421181d3d7a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.785+0000 7f09ba7fc640 1 -- 172.21.15.44:0/4053890532 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac0317c0 con 0x7f09bc0ade00 2023-11-04T01:42:43.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.785+0000 7f09ba7fc640 1 -- 172.21.15.44:0/4053890532 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ac031920 con 0x7f09bc0ade00 2023-11-04T01:42:43.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.785+0000 7f09ba7fc640 1 -- 172.21.15.44:0/4053890532 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac031cb0 con 0x7f09bc0ade00 2023-11-04T01:42:43.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.786+0000 7f09c1e90640 1 -- 172.21.15.44:0/4053890532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc0ade00 msgr2=0x7f09bc0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.786+0000 7f09c1e90640 1 --2- 172.21.15.44:0/4053890532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc0ade00 0x7f09bc0b0530 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009870 tx=0x7f09ac02b860 comp rx=0 tx=0).stop 2023-11-04T01:42:43.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.786+0000 7f09c1e90640 1 -- 172.21.15.44:0/4053890532 shutdown_connections 2023-11-04T01:42:43.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.786+0000 7f09c1e90640 1 --2- 172.21.15.44:0/4053890532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09bc06d9c0 0x7f09bc0710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.786+0000 7f09c1e90640 1 --2- 172.21.15.44:0/4053890532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc0ade00 0x7f09bc0b0530 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.786+0000 7f09c1e90640 1 -- 172.21.15.44:0/4053890532 >> 172.21.15.44:0/4053890532 conn(0x7f09bc0cb530 msgr2=0x7f09bc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.786+0000 7f09c1e90640 1 -- 172.21.15.44:0/4053890532 shutdown_connections 2023-11-04T01:42:43.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.786+0000 7f09c1e90640 1 -- 172.21.15.44:0/4053890532 wait complete. 2023-11-04T01:42:43.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.787+0000 7f09c1e90640 1 Processor -- start 2023-11-04T01:42:43.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.787+0000 7f09c1e90640 1 -- start start 2023-11-04T01:42:43.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09c1e90640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc06c5f0 0x7f09bc0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09c1e90640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09bc06d9c0 0x7f09bc0c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09c1e90640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09bc0ade00 0x7f09bc0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09c1e90640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc0cb130 con 0x7f09bc06c5f0 2023-11-04T01:42:43.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09c1e90640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc1f2ec0 con 0x7f09bc0ade00 2023-11-04T01:42:43.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09c1e90640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc0c3b50 con 0x7f09bc06d9c0 2023-11-04T01:42:43.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09bb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc06c5f0 0x7f09bc0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09bb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc06c5f0 0x7f09bc0cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51080/0 (socket says 172.21.15.44:51080) 2023-11-04T01:42:43.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09bb7fe640 1 -- 172.21.15.44:0/566068356 learned_addr learned my addr 172.21.15.44:0/566068356 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:43.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09baffd640 1 --2- 172.21.15.44:0/566068356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09bc06d9c0 0x7f09bc0c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09bbfff640 1 --2- 172.21.15.44:0/566068356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09bc0ade00 0x7f09bc0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09bb7fe640 1 -- 172.21.15.44:0/566068356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09bc06d9c0 msgr2=0x7f09bc0c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09bb7fe640 1 --2- 172.21.15.44:0/566068356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09bc06d9c0 0x7f09bc0c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09bb7fe640 1 -- 172.21.15.44:0/566068356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09bc0ade00 msgr2=0x7f09bc0ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09bb7fe640 1 --2- 172.21.15.44:0/566068356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09bc0ade00 0x7f09bc0ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09bb7fe640 1 -- 172.21.15.44:0/566068356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac0094d0 con 0x7f09bc06c5f0 2023-11-04T01:42:43.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.788+0000 7f09bb7fe640 1 --2- 172.21.15.44:0/566068356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc06c5f0 0x7f09bc0cabf0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f09ac02b8a0 tx=0x7f09ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.789+0000 7f09a3fff640 1 -- 172.21.15.44:0/566068356 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac032860 con 0x7f09bc06c5f0 2023-11-04T01:42:43.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.789+0000 7f09a3fff640 1 -- 172.21.15.44:0/566068356 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ac032a00 con 0x7f09bc06c5f0 2023-11-04T01:42:43.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.789+0000 7f09c1e90640 1 -- 172.21.15.44:0/566068356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09bc0c3df0 con 0x7f09bc06c5f0 2023-11-04T01:42:43.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.789+0000 7f09a3fff640 1 -- 172.21.15.44:0/566068356 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac032db0 con 0x7f09bc06c5f0 2023-11-04T01:42:43.792 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.789+0000 7f09c1e90640 1 -- 172.21.15.44:0/566068356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09bc0c43b0 con 0x7f09bc06c5f0 2023-11-04T01:42:43.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.790+0000 7f09c1e90640 1 -- 172.21.15.44:0/566068356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09bc0684b0 con 0x7f09bc06c5f0 2023-11-04T01:42:43.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.790+0000 7f09a3fff640 1 -- 172.21.15.44:0/566068356 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09ac04e450 con 0x7f09bc06c5f0 2023-11-04T01:42:43.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.791+0000 7f09a3fff640 1 --2- 172.21.15.44:0/566068356 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f09a806ae70 0x7f09a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.791+0000 7f09a3fff640 1 -- 172.21.15.44:0/566068356 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f09ac0abe80 con 0x7f09bc06c5f0 2023-11-04T01:42:43.793 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.791+0000 7f09baffd640 1 --2- 172.21.15.44:0/566068356 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f09a806ae70 0x7f09a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.791+0000 7f09baffd640 1 --2- 172.21.15.44:0/566068356 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f09a806ae70 0x7f09a806d330 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f09bc15e570 tx=0x7f09b0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.797 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:43.795+0000 7f09a3fff640 1 -- 172.21.15.44:0/566068356 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f09ac076750 con 0x7f09bc06c5f0 2023-11-04T01:42:43.803 INFO:tasks.ceph.mds.d.smithi204.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:42:44.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.041+0000 7f09c1e90640 1 -- 172.21.15.44:0/566068356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f09bc0c8540 con 0x7f09bc06c5f0 2023-11-04T01:42:44.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.044+0000 7f09a3fff640 1 -- 172.21.15.44:0/566068356 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 8034 v99) v1 ==== 97+0+0 (secure 0 0 0) 0x7f09ac079d70 con 0x7f09bc06c5f0 2023-11-04T01:42:44.045 INFO:teuthology.orchestra.run.smithi044.stderr:failed mds gid 8034 2023-11-04T01:42:44.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.046+0000 7f09c1e90640 1 -- 172.21.15.44:0/566068356 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f09a806ae70 msgr2=0x7f09a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.046+0000 7f09c1e90640 1 --2- 172.21.15.44:0/566068356 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f09a806ae70 0x7f09a806d330 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f09bc15e570 tx=0x7f09b0008040 comp rx=0 tx=0).stop 2023-11-04T01:42:44.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.046+0000 7f09c1e90640 1 -- 172.21.15.44:0/566068356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc06c5f0 msgr2=0x7f09bc0cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.046+0000 7f09c1e90640 1 --2- 172.21.15.44:0/566068356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc06c5f0 0x7f09bc0cabf0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f09ac02b8a0 tx=0x7f09ac0046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.047+0000 7f09c1e90640 1 -- 172.21.15.44:0/566068356 shutdown_connections 2023-11-04T01:42:44.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.047+0000 7f09c1e90640 1 --2- 172.21.15.44:0/566068356 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f09a806ae70 0x7f09a806d330 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.047+0000 7f09c1e90640 1 --2- 172.21.15.44:0/566068356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09bc0ade00 0x7f09bc0ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.047+0000 7f09c1e90640 1 --2- 172.21.15.44:0/566068356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09bc06d9c0 0x7f09bc0c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.047+0000 7f09c1e90640 1 --2- 172.21.15.44:0/566068356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc06c5f0 0x7f09bc0cabf0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.047+0000 7f09c1e90640 1 -- 172.21.15.44:0/566068356 >> 172.21.15.44:0/566068356 conn(0x7f09bc0cb530 msgr2=0x7f09bc0b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:44.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.047+0000 7f09c1e90640 1 -- 172.21.15.44:0/566068356 shutdown_connections 2023-11-04T01:42:44.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.047+0000 7f09c1e90640 1 -- 172.21.15.44:0/566068356 wait complete. 2023-11-04T01:42:44.062 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:42:44.062 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:42:44.062 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:42:44.062 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:44.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:44.062 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:42:44.063 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:42:44.063 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:42:44.065 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:42:44.065 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:44.146 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2023-11-04T01:42:44.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.170+0000 7f2db6f7d640 1 Processor -- start 2023-11-04T01:42:44.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.170+0000 7f2db6f7d640 1 -- start start 2023-11-04T01:42:44.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2db6f7d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2db015d100 0x7f2db00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2db6f7d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2db00d1be0 0x7f2db00b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2db6f7d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db00b32b0 con 0x7f2db015d4e0 2023-11-04T01:42:44.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2db6f7d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db00cee10 con 0x7f2db015d100 2023-11-04T01:42:44.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2db6f7d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00b2980 con 0x7f2db00d1be0 2023-11-04T01:42:44.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2daffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2db015d4e0 0x7f2db00d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41942/0 (socket says 172.21.15.44:41942) 2023-11-04T01:42:44.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2daffff640 1 -- 172.21.15.44:0/960320572 learned_addr learned my addr 172.21.15.44:0/960320572 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:44.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2daf7fe640 1 -- 172.21.15.44:0/960320572 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480610069 0 0) 0x7f2db00b32b0 con 0x7f2db015d4e0 2023-11-04T01:42:44.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2db4d19640 1 --2- 172.21.15.44:0/960320572 >> v2:172.21.15.204:3300/0 conn(0x7f2db015d100 0x7f2db00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2daf7fe640 1 -- 172.21.15.44:0/960320572 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da0003520 con 0x7f2db015d4e0 2023-11-04T01:42:44.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2db551a640 1 --2- 172.21.15.44:0/960320572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2db00d1be0 0x7f2db00b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2daf7fe640 1 -- 172.21.15.44:0/960320572 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1045570091 0 0) 0x7f2da0003520 con 0x7f2db015d4e0 2023-11-04T01:42:44.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2daf7fe640 1 -- 172.21.15.44:0/960320572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2db00d1be0 msgr2=0x7f2db00b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:44.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2daf7fe640 1 --2- 172.21.15.44:0/960320572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2db00d1be0 0x7f2db00b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2daf7fe640 1 -- 172.21.15.44:0/960320572 >> v2:172.21.15.204:3300/0 conn(0x7f2db015d100 msgr2=0x7f2db00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:44.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2daf7fe640 1 --2- 172.21.15.44:0/960320572 >> v2:172.21.15.204:3300/0 conn(0x7f2db015d100 0x7f2db00ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2daf7fe640 1 -- 172.21.15.44:0/960320572 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db00b2c60 con 0x7f2db015d4e0 2023-11-04T01:42:44.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2daf7fe640 1 -- 172.21.15.44:0/960320572 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f2d9c001670 con 0x7f2db015d4e0 2023-11-04T01:42:44.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.171+0000 7f2daf7fe640 1 -- 172.21.15.44:0/960320572 >> v1:172.21.15.44:6789/0 conn(0x7f2db015d4e0 legacy=0x7f2db00d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.172+0000 7f2daf7fe640 1 --2- 172.21.15.44:0/960320572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2da0003970 0x7f2da0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.172+0000 7f2daf7fe640 1 --2- 172.21.15.44:0/960320572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2db00d1be0 0x7f2da00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.172+0000 7f2daf7fe640 1 --2- 172.21.15.44:0/960320572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2da0004d00 0x7f2da0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.172+0000 7f2daf7fe640 1 -- 172.21.15.44:0/960320572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00cee10 con 0x7f2da0004d00 2023-11-04T01:42:44.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.172+0000 7f2daf7fe640 1 -- 172.21.15.44:0/960320572 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00b2980 con 0x7f2da0003970 2023-11-04T01:42:44.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.172+0000 7f2daf7fe640 1 -- 172.21.15.44:0/960320572 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da000b9b0 con 0x7f2db00d1be0 2023-11-04T01:42:44.176 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.172+0000 7f2db551a640 1 --2- 172.21.15.44:0/960320572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2da0004d00 0x7f2da0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.172+0000 7f2db4d19640 1 --2- 172.21.15.44:0/960320572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2da0003970 0x7f2da0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.172+0000 7f2daffff640 1 --2- 172.21.15.44:0/960320572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2db00d1be0 0x7f2da00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.172+0000 7f2db551a640 1 -- 172.21.15.44:0/960320572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2db00d1be0 msgr2=0x7f2da00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:44.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.172+0000 7f2db551a640 1 --2- 172.21.15.44:0/960320572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2db00d1be0 0x7f2da00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.172+0000 7f2db551a640 1 -- 172.21.15.44:0/960320572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2da0003970 msgr2=0x7f2da0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:44.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.172+0000 7f2db551a640 1 --2- 172.21.15.44:0/960320572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2da0003970 0x7f2da0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.172+0000 7f2db551a640 1 -- 172.21.15.44:0/960320572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da0003520 con 0x7f2da0004d00 2023-11-04T01:42:44.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.173+0000 7f2db551a640 1 --2- 172.21.15.44:0/960320572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2da0004d00 0x7f2da0005180 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f2db008c730 tx=0x7f2da00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1204778b7eb1bcd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.173+0000 7f2daf7fe640 1 -- 172.21.15.44:0/960320572 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da802cc70 con 0x7f2da0004d00 2023-11-04T01:42:44.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.173+0000 7f2daf7fe640 1 -- 172.21.15.44:0/960320572 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da802cdd0 con 0x7f2da0004d00 2023-11-04T01:42:44.177 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.173+0000 7f2daf7fe640 1 -- 172.21.15.44:0/960320572 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8034660 con 0x7f2da0004d00 2023-11-04T01:42:44.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.173+0000 7f2db6f7d640 1 -- 172.21.15.44:0/960320572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2da0004d00 msgr2=0x7f2da0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.173+0000 7f2db6f7d640 1 --2- 172.21.15.44:0/960320572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2da0004d00 0x7f2da0005180 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f2db008c730 tx=0x7f2da00057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.173+0000 7f2db551a640 1 -- 172.21.15.44:0/960320572 reap_dead start 2023-11-04T01:42:44.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.173+0000 7f2db6f7d640 1 -- 172.21.15.44:0/960320572 shutdown_connections 2023-11-04T01:42:44.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.173+0000 7f2db6f7d640 1 -- 172.21.15.44:0/960320572 >> 172.21.15.44:0/960320572 conn(0x7f2db00d2ef0 msgr2=0x7f2db00d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:44.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.173+0000 7f2db6f7d640 1 -- 172.21.15.44:0/960320572 shutdown_connections 2023-11-04T01:42:44.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.173+0000 7f2db6f7d640 1 -- 172.21.15.44:0/960320572 wait complete. 2023-11-04T01:42:44.180 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.175+0000 7f2db6f7d640 1 Processor -- start 2023-11-04T01:42:44.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.175+0000 7f2db6f7d640 1 -- start start 2023-11-04T01:42:44.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.175+0000 7f2db6f7d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2da0004d00 0x7f2db00cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.175+0000 7f2db6f7d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2db0156d00 0x7f2db01566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db6f7d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2db015f3b0 0x7f2db015f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db6f7d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db015fd70 con 0x7f2da0004d00 2023-11-04T01:42:44.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db6f7d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00cbe80 con 0x7f2db0156d00 2023-11-04T01:42:44.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db6f7d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00cc160 con 0x7f2db015f3b0 2023-11-04T01:42:44.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db4d19640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2da0004d00 0x7f2db00cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db4d19640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2da0004d00 0x7f2db00cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51116/0 (socket says 172.21.15.44:51116) 2023-11-04T01:42:44.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db4d19640 1 -- 172.21.15.44:0/1370318108 learned_addr learned my addr 172.21.15.44:0/1370318108 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:44.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2daffff640 1 --2- 172.21.15.44:0/1370318108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2db0156d00 0x7f2db01566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db551a640 1 --2- 172.21.15.44:0/1370318108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2db015f3b0 0x7f2db015f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db4d19640 1 -- 172.21.15.44:0/1370318108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2db015f3b0 msgr2=0x7f2db015f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.181 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db4d19640 1 --2- 172.21.15.44:0/1370318108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2db015f3b0 0x7f2db015f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db4d19640 1 -- 172.21.15.44:0/1370318108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2db0156d00 msgr2=0x7f2db01566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db4d19640 1 --2- 172.21.15.44:0/1370318108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2db0156d00 0x7f2db01566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db4d19640 1 -- 172.21.15.44:0/1370318108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db00b5ad0 con 0x7f2da0004d00 2023-11-04T01:42:44.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db4d19640 1 --2- 172.21.15.44:0/1370318108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2da0004d00 0x7f2db00cb8a0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f2da4011950 tx=0x7f2da4011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2dad7fa640 1 -- 172.21.15.44:0/1370318108 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400fa30 con 0x7f2da0004d00 2023-11-04T01:42:44.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2dad7fa640 1 -- 172.21.15.44:0/1370318108 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da400fb90 con 0x7f2da0004d00 2023-11-04T01:42:44.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db6f7d640 1 -- 172.21.15.44:0/1370318108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db00b5db0 con 0x7f2da0004d00 2023-11-04T01:42:44.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2dad7fa640 1 -- 172.21.15.44:0/1370318108 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4014440 con 0x7f2da0004d00 2023-11-04T01:42:44.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.176+0000 7f2db6f7d640 1 -- 172.21.15.44:0/1370318108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db0157450 con 0x7f2da0004d00 2023-11-04T01:42:44.182 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.177+0000 7f2db6f7d640 1 -- 172.21.15.44:0/1370318108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db00684b0 con 0x7f2da0004d00 2023-11-04T01:42:44.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.178+0000 7f2dad7fa640 1 -- 172.21.15.44:0/1370318108 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2da40145a0 con 0x7f2da0004d00 2023-11-04T01:42:44.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.178+0000 7f2dad7fa640 1 --2- 172.21.15.44:0/1370318108 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2d9406ae70 0x7f2d9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.178+0000 7f2dad7fa640 1 -- 172.21.15.44:0/1370318108 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7795+0+0 (secure 0 0 0) 0x7f2da408a550 con 0x7f2da0004d00 2023-11-04T01:42:44.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.179+0000 7f2daffff640 1 --2- 172.21.15.44:0/1370318108 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2d9406ae70 0x7f2d9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.183 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.179+0000 7f2daffff640 1 --2- 172.21.15.44:0/1370318108 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2d9406ae70 0x7f2d9406d330 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2db01f6420 tx=0x7f2d9c0078f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.183+0000 7f2dad7fa640 1 -- 172.21.15.44:0/1370318108 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2da4054dd0 con 0x7f2da0004d00 2023-11-04T01:42:44.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.398+0000 7f2db6f7d640 1 -- 172.21.15.44:0/1370318108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2db00b8db0 con 0x7f2da0004d00 2023-11-04T01:42:44.400 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.399+0000 7f2dad7fa640 1 -- 172.21.15.44:0/1370318108 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4140 (secure 0 0 0) 0x7f2da40583f0 con 0x7f2da0004d00 2023-11-04T01:42:44.401 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:44.401 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":100,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:44.048433+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:active","state_seq":7,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:replay","state_seq":1,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:44.401 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 100 2023-11-04T01:42:44.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.401+0000 7f2db6f7d640 1 -- 172.21.15.44:0/1370318108 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2d9406ae70 msgr2=0x7f2d9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.401+0000 7f2db6f7d640 1 --2- 172.21.15.44:0/1370318108 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2d9406ae70 0x7f2d9406d330 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2db01f6420 tx=0x7f2d9c0078f0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.401+0000 7f2db6f7d640 1 -- 172.21.15.44:0/1370318108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2da0004d00 msgr2=0x7f2db00cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.401+0000 7f2db6f7d640 1 --2- 172.21.15.44:0/1370318108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2da0004d00 0x7f2db00cb8a0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f2da4011950 tx=0x7f2da4011d50 comp rx=0 tx=0).stop 2023-11-04T01:42:44.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.401+0000 7f2db6f7d640 1 -- 172.21.15.44:0/1370318108 shutdown_connections 2023-11-04T01:42:44.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.401+0000 7f2db6f7d640 1 --2- 172.21.15.44:0/1370318108 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2d9406ae70 0x7f2d9406d330 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.401+0000 7f2db6f7d640 1 --2- 172.21.15.44:0/1370318108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2db015f3b0 0x7f2db015f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.401+0000 7f2db6f7d640 1 --2- 172.21.15.44:0/1370318108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2db0156d00 0x7f2db01566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.401+0000 7f2db6f7d640 1 --2- 172.21.15.44:0/1370318108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2da0004d00 0x7f2db00cb8a0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.401+0000 7f2db6f7d640 1 -- 172.21.15.44:0/1370318108 >> 172.21.15.44:0/1370318108 conn(0x7f2db00d2ef0 msgr2=0x7f2db00b02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:44.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.401+0000 7f2db6f7d640 1 -- 172.21.15.44:0/1370318108 shutdown_connections 2023-11-04T01:42:44.404 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:44.401+0000 7f2db6f7d640 1 -- 172.21.15.44:0/1370318108 wait complete. 2023-11-04T01:42:44.413 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:42:46.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-04T01:42:46.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:42:49.414 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:49.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.531+0000 7fef86694640 1 Processor -- start 2023-11-04T01:42:49.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.531+0000 7fef86694640 1 -- start start 2023-11-04T01:42:49.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.532+0000 7fef86694640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8015d1b0 0x7fef800b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.532+0000 7fef86694640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fef8006c240 0x7fef800b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.532+0000 7fef86694640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800b2310 con 0x7fef8006c6a0 2023-11-04T01:42:49.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.532+0000 7fef86694640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8006cbe0 con 0x7fef8006c240 2023-11-04T01:42:49.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.532+0000 7fef86694640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef800b2100 con 0x7fef8015d1b0 2023-11-04T01:42:49.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.532+0000 7fef7f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fef8006c240 0x7fef800b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.532+0000 7fef84c31640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fef8006c6a0 0x7fef8006a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41946/0 (socket says 172.21.15.44:41946) 2023-11-04T01:42:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.532+0000 7fef84c31640 1 -- 172.21.15.44:0/3664483906 learned_addr learned my addr 172.21.15.44:0/3664483906 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.532+0000 7fef7ffff640 1 --2- 172.21.15.44:0/3664483906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8015d1b0 0x7fef800b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.532+0000 7fef7f7fe640 1 -- 172.21.15.44:0/3664483906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8015d1b0 msgr2=0x7fef800b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.532+0000 7fef7f7fe640 1 --2- 172.21.15.44:0/3664483906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8015d1b0 0x7fef800b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.532+0000 7fef7f7fe640 1 -- 172.21.15.44:0/3664483906 >> v1:172.21.15.44:6789/0 conn(0x7fef8006c6a0 legacy=0x7fef8006a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.532+0000 7fef7effd640 1 -- 172.21.15.44:0/3664483906 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882127715 0 0) 0x7fef800b2310 con 0x7fef8006c6a0 2023-11-04T01:42:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.532+0000 7fef7f7fe640 1 -- 172.21.15.44:0/3664483906 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef800b25f0 con 0x7fef8006c240 2023-11-04T01:42:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.532+0000 7fef7ffff640 1 --2- 172.21.15.44:0/3664483906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8015d1b0 0x7fef800b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:49.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.533+0000 7fef7f7fe640 1 --2- 172.21.15.44:0/3664483906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef8006c240 0x7fef800b0d30 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fef740097a0 tx=0x7fef7402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c77f3543c3209c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.533+0000 7fef7effd640 1 -- 172.21.15.44:0/3664483906 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74030610 con 0x7fef8006c240 2023-11-04T01:42:49.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.533+0000 7fef7effd640 1 -- 172.21.15.44:0/3664483906 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef74030770 con 0x7fef8006c240 2023-11-04T01:42:49.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.533+0000 7fef7effd640 1 -- 172.21.15.44:0/3664483906 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74030b00 con 0x7fef8006c240 2023-11-04T01:42:49.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.534+0000 7fef86694640 1 -- 172.21.15.44:0/3664483906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef8006c240 msgr2=0x7fef800b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.534+0000 7fef86694640 1 --2- 172.21.15.44:0/3664483906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef8006c240 0x7fef800b0d30 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fef740097a0 tx=0x7fef7402b960 comp rx=0 tx=0).stop 2023-11-04T01:42:49.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.534+0000 7fef86694640 1 -- 172.21.15.44:0/3664483906 shutdown_connections 2023-11-04T01:42:49.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.534+0000 7fef86694640 1 --2- 172.21.15.44:0/3664483906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef8006c240 0x7fef800b0d30 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.534+0000 7fef86694640 1 --2- 172.21.15.44:0/3664483906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8015d1b0 0x7fef800b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.534+0000 7fef86694640 1 -- 172.21.15.44:0/3664483906 >> 172.21.15.44:0/3664483906 conn(0x7fef800cbd30 msgr2=0x7fef800cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.534+0000 7fef86694640 1 -- 172.21.15.44:0/3664483906 shutdown_connections 2023-11-04T01:42:49.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.534+0000 7fef86694640 1 -- 172.21.15.44:0/3664483906 wait complete. 2023-11-04T01:42:49.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.535+0000 7fef86694640 1 Processor -- start 2023-11-04T01:42:49.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.535+0000 7fef86694640 1 -- start start 2023-11-04T01:42:49.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef86694640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef8006c240 0x7fef80155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef86694640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef8006c6a0 0x7fef800abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef86694640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8015d1b0 0x7fef800ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef86694640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8009b500 con 0x7fef8006c6a0 2023-11-04T01:42:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef86694640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8009a8f0 con 0x7fef8006c240 2023-11-04T01:42:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef86694640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8009abd0 con 0x7fef8015d1b0 2023-11-04T01:42:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef7f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef8006c6a0 0x7fef800abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef7f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef8006c6a0 0x7fef800abf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51126/0 (socket says 172.21.15.44:51126) 2023-11-04T01:42:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef7f7fe640 1 -- 172.21.15.44:0/3015883060 learned_addr learned my addr 172.21.15.44:0/3015883060 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef7ffff640 1 --2- 172.21.15.44:0/3015883060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef8006c240 0x7fef80155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef84c31640 1 --2- 172.21.15.44:0/3015883060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8015d1b0 0x7fef800ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef7f7fe640 1 -- 172.21.15.44:0/3015883060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8015d1b0 msgr2=0x7fef800ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef7f7fe640 1 --2- 172.21.15.44:0/3015883060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8015d1b0 0x7fef800ac480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef7f7fe640 1 -- 172.21.15.44:0/3015883060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef8006c240 msgr2=0x7fef80155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef7f7fe640 1 --2- 172.21.15.44:0/3015883060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef8006c240 0x7fef80155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef7f7fe640 1 -- 172.21.15.44:0/3015883060 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef74009400 con 0x7fef8006c6a0 2023-11-04T01:42:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.536+0000 7fef7ffff640 1 --2- 172.21.15.44:0/3015883060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef8006c240 0x7fef80155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.537+0000 7fef7f7fe640 1 --2- 172.21.15.44:0/3015883060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef8006c6a0 0x7fef800abf40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fef740097a0 tx=0x7fef740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.537+0000 7fef7cff9640 1 -- 172.21.15.44:0/3015883060 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7403f070 con 0x7fef8006c6a0 2023-11-04T01:42:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.537+0000 7fef7cff9640 1 -- 172.21.15.44:0/3015883060 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef74006e10 con 0x7fef8006c6a0 2023-11-04T01:42:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.537+0000 7fef86694640 1 -- 172.21.15.44:0/3015883060 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8009aeb0 con 0x7fef8006c6a0 2023-11-04T01:42:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.537+0000 7fef7cff9640 1 -- 172.21.15.44:0/3015883060 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74004270 con 0x7fef8006c6a0 2023-11-04T01:42:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.537+0000 7fef86694640 1 -- 172.21.15.44:0/3015883060 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef80155bc0 con 0x7fef8006c6a0 2023-11-04T01:42:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.538+0000 7fef86694640 1 -- 172.21.15.44:0/3015883060 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef80066600 con 0x7fef8006c6a0 2023-11-04T01:42:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.538+0000 7fef7cff9640 1 -- 172.21.15.44:0/3015883060 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef74043070 con 0x7fef8006c6a0 2023-11-04T01:42:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.539+0000 7fef7cff9640 1 --2- 172.21.15.44:0/3015883060 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fef6c06ae70 0x7fef6c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.539+0000 7fef7cff9640 1 -- 172.21.15.44:0/3015883060 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7795+0+0 (secure 0 0 0) 0x7fef740abcc0 con 0x7fef8006c6a0 2023-11-04T01:42:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.539+0000 7fef7ffff640 1 --2- 172.21.15.44:0/3015883060 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fef6c06ae70 0x7fef6c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.543 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.540+0000 7fef7ffff640 1 --2- 172.21.15.44:0/3015883060 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fef6c06ae70 0x7fef6c06d330 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fef7000aa20 tx=0x7fef70008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.544+0000 7fef7cff9640 1 -- 172.21.15.44:0/3015883060 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fef740b2080 con 0x7fef8006c6a0 2023-11-04T01:42:49.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.755+0000 7fef86694640 1 -- 172.21.15.44:0/3015883060 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef800684b0 con 0x7fef8006c6a0 2023-11-04T01:42:49.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.756+0000 7fef7cff9640 1 -- 172.21.15.44:0/3015883060 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4934 (secure 0 0 0) 0x7fef74034070 con 0x7fef8006c6a0 2023-11-04T01:42:49.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:49.758 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":101,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:44.065799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:active","state_seq":7,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:resolve","state_seq":11,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:49.758 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 101 2023-11-04T01:42:49.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.758+0000 7fef86694640 1 -- 172.21.15.44:0/3015883060 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fef6c06ae70 msgr2=0x7fef6c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.758+0000 7fef86694640 1 --2- 172.21.15.44:0/3015883060 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fef6c06ae70 0x7fef6c06d330 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fef7000aa20 tx=0x7fef70008040 comp rx=0 tx=0).stop 2023-11-04T01:42:49.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.758+0000 7fef86694640 1 -- 172.21.15.44:0/3015883060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef8006c6a0 msgr2=0x7fef800abf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.758+0000 7fef86694640 1 --2- 172.21.15.44:0/3015883060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef8006c6a0 0x7fef800abf40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fef740097a0 tx=0x7fef740046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.758+0000 7fef86694640 1 -- 172.21.15.44:0/3015883060 shutdown_connections 2023-11-04T01:42:49.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.758+0000 7fef86694640 1 --2- 172.21.15.44:0/3015883060 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fef6c06ae70 0x7fef6c06d330 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.758+0000 7fef86694640 1 --2- 172.21.15.44:0/3015883060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8015d1b0 0x7fef800ac480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.758+0000 7fef86694640 1 --2- 172.21.15.44:0/3015883060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef8006c6a0 0x7fef800abf40 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.758+0000 7fef86694640 1 --2- 172.21.15.44:0/3015883060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef8006c240 0x7fef80155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.758+0000 7fef86694640 1 -- 172.21.15.44:0/3015883060 >> 172.21.15.44:0/3015883060 conn(0x7fef800cbd30 msgr2=0x7fef8006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.758+0000 7fef86694640 1 -- 172.21.15.44:0/3015883060 shutdown_connections 2023-11-04T01:42:49.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.758+0000 7fef86694640 1 -- 172.21.15.44:0/3015883060 wait complete. 2023-11-04T01:42:49.770 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:42:49.770 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:49.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.874+0000 7fe4d27d0640 1 Processor -- start 2023-11-04T01:42:49.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.874+0000 7fe4d27d0640 1 -- start start 2023-11-04T01:42:49.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.875+0000 7fe4d27d0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4cc15d4e0 0x7fe4cc0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.875+0000 7fe4d27d0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4cc0d3b60 0x7fe4cc0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.875+0000 7fe4d27d0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4cc0b32b0 con 0x7fe4cc15d100 2023-11-04T01:42:49.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.875+0000 7fe4d27d0640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc0cec20 con 0x7fe4cc15d4e0 2023-11-04T01:42:49.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.875+0000 7fe4d27d0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0cee10 con 0x7fe4cc0d3b60 2023-11-04T01:42:49.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.875+0000 7fe4cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4cc15d4e0 0x7fe4cc0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.875+0000 7fe4cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4cc15d4e0 0x7fe4cc0d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51128/0 (socket says 172.21.15.44:51128) 2023-11-04T01:42:49.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.875+0000 7fe4cb7fe640 1 -- 172.21.15.44:0/1760095367 learned_addr learned my addr 172.21.15.44:0/1760095367 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:49.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.876+0000 7fe4d0d6d640 1 --2- 172.21.15.44:0/1760095367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4cc0d3b60 0x7fe4cc0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.876+0000 7fe4cb7fe640 1 -- 172.21.15.44:0/1760095367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4cc0d3b60 msgr2=0x7fe4cc0d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.876+0000 7fe4cb7fe640 1 --2- 172.21.15.44:0/1760095367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4cc0d3b60 0x7fe4cc0d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.876+0000 7fe4cb7fe640 1 -- 172.21.15.44:0/1760095367 >> v1:172.21.15.204:6789/0 conn(0x7fe4cc15d100 legacy=0x7fe4cc0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.876+0000 7fe4cb7fe640 1 -- 172.21.15.44:0/1760095367 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc0b4750 con 0x7fe4cc15d4e0 2023-11-04T01:42:49.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.876+0000 7fe4d0d6d640 1 --2- 172.21.15.44:0/1760095367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4cc0d3b60 0x7fe4cc0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.876+0000 7fe4cb7fe640 1 --2- 172.21.15.44:0/1760095367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4cc15d4e0 0x7fe4cc0d14d0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009870 tx=0x7fe4b402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1a314124c992a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.877+0000 7fe4caffd640 1 -- 172.21.15.44:0/1760095367 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4031640 con 0x7fe4cc15d4e0 2023-11-04T01:42:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.877+0000 7fe4caffd640 1 -- 172.21.15.44:0/1760095367 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b40317a0 con 0x7fe4cc15d4e0 2023-11-04T01:42:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.877+0000 7fe4caffd640 1 -- 172.21.15.44:0/1760095367 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4031b30 con 0x7fe4cc15d4e0 2023-11-04T01:42:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.877+0000 7fe4d27d0640 1 -- 172.21.15.44:0/1760095367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4cc15d4e0 msgr2=0x7fe4cc0d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.877+0000 7fe4d27d0640 1 --2- 172.21.15.44:0/1760095367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4cc15d4e0 0x7fe4cc0d14d0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009870 tx=0x7fe4b402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.877+0000 7fe4d27d0640 1 -- 172.21.15.44:0/1760095367 shutdown_connections 2023-11-04T01:42:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.877+0000 7fe4d27d0640 1 --2- 172.21.15.44:0/1760095367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4cc0d3b60 0x7fe4cc0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.877+0000 7fe4d27d0640 1 --2- 172.21.15.44:0/1760095367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4cc15d4e0 0x7fe4cc0d14d0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.877+0000 7fe4d27d0640 1 -- 172.21.15.44:0/1760095367 >> 172.21.15.44:0/1760095367 conn(0x7fe4cc0d2ef0 msgr2=0x7fe4cc0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.877+0000 7fe4d27d0640 1 -- 172.21.15.44:0/1760095367 shutdown_connections 2023-11-04T01:42:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.877+0000 7fe4d27d0640 1 -- 172.21.15.44:0/1760095367 wait complete. 2023-11-04T01:42:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.878+0000 7fe4d27d0640 1 Processor -- start 2023-11-04T01:42:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.879+0000 7fe4d27d0640 1 -- start start 2023-11-04T01:42:49.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.879+0000 7fe4d27d0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4cc0d3b60 0x7fe4cc0cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.879+0000 7fe4d27d0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4cc15d100 0x7fe4cc0b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.879+0000 7fe4d27d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4cc15d4e0 0x7fe4cc0b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.879+0000 7fe4d27d0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc1f3c00 con 0x7fe4cc15d4e0 2023-11-04T01:42:49.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.879+0000 7fe4d27d0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc1f3e50 con 0x7fe4cc15d100 2023-11-04T01:42:49.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.879+0000 7fe4d27d0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc1f4130 con 0x7fe4cc0d3b60 2023-11-04T01:42:49.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.879+0000 7fe4d0d6d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4cc15d4e0 0x7fe4cc0b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.879+0000 7fe4d0d6d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4cc15d4e0 0x7fe4cc0b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51130/0 (socket says 172.21.15.44:51130) 2023-11-04T01:42:49.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.879+0000 7fe4d0d6d640 1 -- 172.21.15.44:0/2930906332 learned_addr learned my addr 172.21.15.44:0/2930906332 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:49.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.880+0000 7fe4cbfff640 1 --2- 172.21.15.44:0/2930906332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4cc0d3b60 0x7fe4cc0cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.880+0000 7fe4cb7fe640 1 --2- 172.21.15.44:0/2930906332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4cc15d100 0x7fe4cc0b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.880+0000 7fe4d0d6d640 1 -- 172.21.15.44:0/2930906332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4cc0d3b60 msgr2=0x7fe4cc0cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.880+0000 7fe4d0d6d640 1 --2- 172.21.15.44:0/2930906332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4cc0d3b60 0x7fe4cc0cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.880+0000 7fe4d0d6d640 1 -- 172.21.15.44:0/2930906332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4cc15d100 msgr2=0x7fe4cc0b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.880+0000 7fe4d0d6d640 1 --2- 172.21.15.44:0/2930906332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4cc15d100 0x7fe4cc0b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.880+0000 7fe4d0d6d640 1 -- 172.21.15.44:0/2930906332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b40094d0 con 0x7fe4cc15d4e0 2023-11-04T01:42:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.880+0000 7fe4d0d6d640 1 --2- 172.21.15.44:0/2930906332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4cc15d4e0 0x7fe4cc0b0ad0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400ce80 tx=0x7fe4c400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.880+0000 7fe4c8ff9640 1 -- 172.21.15.44:0/2930906332 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c400d840 con 0x7fe4cc15d4e0 2023-11-04T01:42:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.880+0000 7fe4c8ff9640 1 -- 172.21.15.44:0/2930906332 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c400d9e0 con 0x7fe4cc15d4e0 2023-11-04T01:42:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.880+0000 7fe4d27d0640 1 -- 172.21.15.44:0/2930906332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4cc1f4410 con 0x7fe4cc15d4e0 2023-11-04T01:42:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.880+0000 7fe4c8ff9640 1 -- 172.21.15.44:0/2930906332 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c400dd90 con 0x7fe4cc15d4e0 2023-11-04T01:42:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.880+0000 7fe4d27d0640 1 -- 172.21.15.44:0/2930906332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc0ccc50 con 0x7fe4cc15d4e0 2023-11-04T01:42:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.881+0000 7fe4d27d0640 1 -- 172.21.15.44:0/2930906332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4cc1f4930 con 0x7fe4cc15d4e0 2023-11-04T01:42:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.881+0000 7fe4c8ff9640 1 -- 172.21.15.44:0/2930906332 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4c4015440 con 0x7fe4cc15d4e0 2023-11-04T01:42:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.882+0000 7fe4c8ff9640 1 --2- 172.21.15.44:0/2930906332 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe4ac06ae70 0x7fe4ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.882+0000 7fe4c8ff9640 1 -- 172.21.15.44:0/2930906332 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7795+0+0 (secure 0 0 0) 0x7fe4c408a830 con 0x7fe4cc15d4e0 2023-11-04T01:42:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.882+0000 7fe4cbfff640 1 --2- 172.21.15.44:0/2930906332 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe4ac06ae70 0x7fe4ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.883+0000 7fe4cbfff640 1 --2- 172.21.15.44:0/2930906332 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe4ac06ae70 0x7fe4ac06d330 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc004e50 tx=0x7fe4bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:49.886+0000 7fe4c8ff9640 1 -- 172.21.15.44:0/2930906332 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4cc1f4930 con 0x7fe4cc15d4e0 2023-11-04T01:42:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.100+0000 7fe4d27d0640 1 -- 172.21.15.44:0/2930906332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4cc1f4930 con 0x7fe4cc15d4e0 2023-11-04T01:42:50.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.100+0000 7fe4c8ff9640 1 -- 172.21.15.44:0/2930906332 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4934 (secure 0 0 0) 0x7fe4cc1f4930 con 0x7fe4cc15d4e0 2023-11-04T01:42:50.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:50.102 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":101,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:44.065799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:active","state_seq":7,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:resolve","state_seq":11,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:50.103 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 101 2023-11-04T01:42:50.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.102+0000 7fe4d27d0640 1 -- 172.21.15.44:0/2930906332 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe4ac06ae70 msgr2=0x7fe4ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.102+0000 7fe4d27d0640 1 --2- 172.21.15.44:0/2930906332 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe4ac06ae70 0x7fe4ac06d330 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc004e50 tx=0x7fe4bc009040 comp rx=0 tx=0).stop 2023-11-04T01:42:50.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.102+0000 7fe4d27d0640 1 -- 172.21.15.44:0/2930906332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4cc15d4e0 msgr2=0x7fe4cc0b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.102+0000 7fe4d27d0640 1 --2- 172.21.15.44:0/2930906332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4cc15d4e0 0x7fe4cc0b0ad0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400ce80 tx=0x7fe4c400a710 comp rx=0 tx=0).stop 2023-11-04T01:42:50.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.102+0000 7fe4d27d0640 1 -- 172.21.15.44:0/2930906332 shutdown_connections 2023-11-04T01:42:50.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.102+0000 7fe4d27d0640 1 --2- 172.21.15.44:0/2930906332 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe4ac06ae70 0x7fe4ac06d330 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.102+0000 7fe4d27d0640 1 --2- 172.21.15.44:0/2930906332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4cc15d4e0 0x7fe4cc0b0ad0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.102+0000 7fe4d27d0640 1 --2- 172.21.15.44:0/2930906332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe4cc15d100 0x7fe4cc0b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.102+0000 7fe4d27d0640 1 --2- 172.21.15.44:0/2930906332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe4cc0d3b60 0x7fe4cc0cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.102+0000 7fe4d27d0640 1 -- 172.21.15.44:0/2930906332 >> 172.21.15.44:0/2930906332 conn(0x7fe4cc0d2ef0 msgr2=0x7fe4cc0afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:50.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.102+0000 7fe4d27d0640 1 -- 172.21.15.44:0/2930906332 shutdown_connections 2023-11-04T01:42:50.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.102+0000 7fe4d27d0640 1 -- 172.21.15.44:0/2930906332 wait complete. 2023-11-04T01:42:50.115 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:42:50.115 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.3442988395690918s 2023-11-04T01:42:50.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:50.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.220+0000 7fe1a8834640 1 Processor -- start 2023-11-04T01:42:50.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.220+0000 7fe1a8834640 1 -- start start 2023-11-04T01:42:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.221+0000 7fe1a8834640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe1a40b1440 0x7fe1a406c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.221+0000 7fe1a8834640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe1a406b740 0x7fe1a4066010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.221+0000 7fe1a8834640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a40ad6a0 con 0x7fe1a415ade0 2023-11-04T01:42:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.221+0000 7fe1a8834640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a40acaf0 con 0x7fe1a406b740 2023-11-04T01:42:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.221+0000 7fe1a8834640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a40acdd0 con 0x7fe1a40b1440 2023-11-04T01:42:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.221+0000 7fe1a2d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe1a406b740 0x7fe1a4066010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.221+0000 7fe1a259c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe1a415ade0 0x7fe1a40b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41960/0 (socket says 172.21.15.44:41960) 2023-11-04T01:42:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.221+0000 7fe1a259c640 1 -- 172.21.15.44:0/1958544339 learned_addr learned my addr 172.21.15.44:0/1958544339 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.221+0000 7fe19bfff640 1 --2- 172.21.15.44:0/1958544339 >> v2:172.21.15.204:3300/0 conn(0x7fe1a40b1440 0x7fe1a406c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.221+0000 7fe1a1d9b640 1 -- 172.21.15.44:0/1958544339 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058482280 0 0) 0x7fe1a40ad6a0 con 0x7fe1a415ade0 2023-11-04T01:42:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.221+0000 7fe1a1d9b640 1 -- 172.21.15.44:0/1958544339 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe190003520 con 0x7fe1a415ade0 2023-11-04T01:42:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.221+0000 7fe1a2d9d640 1 -- 172.21.15.44:0/1958544339 >> v2:172.21.15.204:3300/0 conn(0x7fe1a40b1440 msgr2=0x7fe1a406c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.221+0000 7fe1a2d9d640 1 --2- 172.21.15.44:0/1958544339 >> v2:172.21.15.204:3300/0 conn(0x7fe1a40b1440 0x7fe1a406c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.221+0000 7fe1a2d9d640 1 -- 172.21.15.44:0/1958544339 >> v1:172.21.15.44:6789/0 conn(0x7fe1a415ade0 legacy=0x7fe1a40b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.221+0000 7fe1a2d9d640 1 -- 172.21.15.44:0/1958544339 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a40ad0e0 con 0x7fe1a406b740 2023-11-04T01:42:50.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.222+0000 7fe1a2d9d640 1 --2- 172.21.15.44:0/1958544339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a406b740 0x7fe1a4066010 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fe1a406ecb0 tx=0x7fe19c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e7549193285589 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:50.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.222+0000 7fe1a1d9b640 1 -- 172.21.15.44:0/1958544339 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c02cbf0 con 0x7fe1a406b740 2023-11-04T01:42:50.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.222+0000 7fe1a1d9b640 1 -- 172.21.15.44:0/1958544339 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c02cd50 con 0x7fe1a406b740 2023-11-04T01:42:50.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.222+0000 7fe1a1d9b640 1 -- 172.21.15.44:0/1958544339 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c034660 con 0x7fe1a406b740 2023-11-04T01:42:50.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.223+0000 7fe1a8834640 1 -- 172.21.15.44:0/1958544339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a406b740 msgr2=0x7fe1a4066010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.223+0000 7fe1a8834640 1 --2- 172.21.15.44:0/1958544339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a406b740 0x7fe1a4066010 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fe1a406ecb0 tx=0x7fe19c02be40 comp rx=0 tx=0).stop 2023-11-04T01:42:50.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.223+0000 7fe1a8834640 1 -- 172.21.15.44:0/1958544339 shutdown_connections 2023-11-04T01:42:50.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.223+0000 7fe1a8834640 1 --2- 172.21.15.44:0/1958544339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a406b740 0x7fe1a4066010 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.223+0000 7fe1a8834640 1 --2- 172.21.15.44:0/1958544339 >> v2:172.21.15.204:3300/0 conn(0x7fe1a40b1440 0x7fe1a406c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.223+0000 7fe1a8834640 1 -- 172.21.15.44:0/1958544339 >> 172.21.15.44:0/1958544339 conn(0x7fe1a40cbd30 msgr2=0x7fe1a40cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:50.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.223+0000 7fe1a8834640 1 -- 172.21.15.44:0/1958544339 shutdown_connections 2023-11-04T01:42:50.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.223+0000 7fe1a8834640 1 -- 172.21.15.44:0/1958544339 wait complete. 2023-11-04T01:42:50.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.224+0000 7fe1a8834640 1 Processor -- start 2023-11-04T01:42:50.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.224+0000 7fe1a8834640 1 -- start start 2023-11-04T01:42:50.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe1a8834640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a406b740 0x7fe1a40cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe1a8834640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1a40b1440 0x7fe1a4153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe1a8834640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1a415ade0 0x7fe1a40c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe1a8834640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40ccf20 con 0x7fe1a406b740 2023-11-04T01:42:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe1a8834640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40cd200 con 0x7fe1a40b1440 2023-11-04T01:42:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe1a8834640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40cd4e0 con 0x7fe1a415ade0 2023-11-04T01:42:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe1a259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a406b740 0x7fe1a40cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe1a259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a406b740 0x7fe1a40cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51148/0 (socket says 172.21.15.44:51148) 2023-11-04T01:42:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe1a259c640 1 -- 172.21.15.44:0/3704149183 learned_addr learned my addr 172.21.15.44:0/3704149183 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe1a259c640 1 -- 172.21.15.44:0/3704149183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1a415ade0 msgr2=0x7fe1a40c1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe1a259c640 1 --2- 172.21.15.44:0/3704149183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1a415ade0 0x7fe1a40c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe19bfff640 1 --2- 172.21.15.44:0/3704149183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1a40b1440 0x7fe1a4153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe1a259c640 1 -- 172.21.15.44:0/3704149183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1a40b1440 msgr2=0x7fe1a4153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe1a259c640 1 --2- 172.21.15.44:0/3704149183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1a40b1440 0x7fe1a4153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe1a259c640 1 -- 172.21.15.44:0/3704149183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c009a70 con 0x7fe1a406b740 2023-11-04T01:42:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.225+0000 7fe19bfff640 1 --2- 172.21.15.44:0/3704149183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1a40b1440 0x7fe1a4153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.226+0000 7fe1a259c640 1 --2- 172.21.15.44:0/3704149183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a406b740 0x7fe1a40cdce0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fe194001260 tx=0x7fe19400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.226+0000 7fe19affd640 1 -- 172.21.15.44:0/3704149183 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1940074e0 con 0x7fe1a406b740 2023-11-04T01:42:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.226+0000 7fe19affd640 1 -- 172.21.15.44:0/3704149183 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe194007640 con 0x7fe1a406b740 2023-11-04T01:42:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.226+0000 7fe1a8834640 1 -- 172.21.15.44:0/3704149183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a40cd7c0 con 0x7fe1a406b740 2023-11-04T01:42:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.226+0000 7fe19affd640 1 -- 172.21.15.44:0/3704149183 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1940059a0 con 0x7fe1a406b740 2023-11-04T01:42:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.226+0000 7fe1a8834640 1 -- 172.21.15.44:0/3704149183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a40cebd0 con 0x7fe1a406b740 2023-11-04T01:42:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.227+0000 7fe1a8834640 1 -- 172.21.15.44:0/3704149183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a40cda00 con 0x7fe1a406b740 2023-11-04T01:42:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.227+0000 7fe19affd640 1 -- 172.21.15.44:0/3704149183 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe194005b00 con 0x7fe1a406b740 2023-11-04T01:42:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.228+0000 7fe19affd640 1 --2- 172.21.15.44:0/3704149183 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe18406ae70 0x7fe18406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.228+0000 7fe19affd640 1 -- 172.21.15.44:0/3704149183 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7795+0+0 (secure 0 0 0) 0x7fe194089340 con 0x7fe1a406b740 2023-11-04T01:42:50.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.228+0000 7fe19bfff640 1 --2- 172.21.15.44:0/3704149183 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe18406ae70 0x7fe18406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.229+0000 7fe19bfff640 1 --2- 172.21.15.44:0/3704149183 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe18406ae70 0x7fe18406d330 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4155f10 tx=0x7fe18c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:50.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.232+0000 7fe19affd640 1 -- 172.21.15.44:0/3704149183 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe194053c70 con 0x7fe1a406b740 2023-11-04T01:42:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.445+0000 7fe1a8834640 1 -- 172.21.15.44:0/3704149183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1a40cd060 con 0x7fe1a406b740 2023-11-04T01:42:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.445+0000 7fe19affd640 1 -- 172.21.15.44:0/3704149183 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4934 (secure 0 0 0) 0x7fe1a40cd060 con 0x7fe1a406b740 2023-11-04T01:42:50.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:50.447 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":101,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:44.065799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":7156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7156":{"gid":7156,"name":"d","rank":1,"incarnation":91,"state":"up:active","state_seq":7,"addr":"172.21.15.204:6836/3267689413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":3267689413},{"type":"v1","addr":"172.21.15.204:6836","nonce":3267689413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:resolve","state_seq":11,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 101 2023-11-04T01:42:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.447+0000 7fe1a8834640 1 -- 172.21.15.44:0/3704149183 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe18406ae70 msgr2=0x7fe18406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.447+0000 7fe1a8834640 1 --2- 172.21.15.44:0/3704149183 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe18406ae70 0x7fe18406d330 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4155f10 tx=0x7fe18c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.447+0000 7fe1a8834640 1 -- 172.21.15.44:0/3704149183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a406b740 msgr2=0x7fe1a40cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.447+0000 7fe1a8834640 1 --2- 172.21.15.44:0/3704149183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a406b740 0x7fe1a40cdce0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fe194001260 tx=0x7fe19400c960 comp rx=0 tx=0).stop 2023-11-04T01:42:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.447+0000 7fe1a8834640 1 -- 172.21.15.44:0/3704149183 shutdown_connections 2023-11-04T01:42:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.447+0000 7fe1a8834640 1 --2- 172.21.15.44:0/3704149183 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe18406ae70 0x7fe18406d330 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.447+0000 7fe1a8834640 1 --2- 172.21.15.44:0/3704149183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1a415ade0 0x7fe1a40c1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.447+0000 7fe1a8834640 1 --2- 172.21.15.44:0/3704149183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1a40b1440 0x7fe1a4153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.447+0000 7fe1a8834640 1 --2- 172.21.15.44:0/3704149183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a406b740 0x7fe1a40cdce0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.447+0000 7fe1a8834640 1 -- 172.21.15.44:0/3704149183 >> 172.21.15.44:0/3704149183 conn(0x7fe1a40cbd30 msgr2=0x7fe1a41583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.447+0000 7fe1a8834640 1 -- 172.21.15.44:0/3704149183 shutdown_connections 2023-11-04T01:42:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.447+0000 7fe1a8834640 1 -- 172.21.15.44:0/3704149183 wait complete. 2023-11-04T01:42:50.460 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:42:50.580 INFO:teuthology.orchestra.run.smithi044.stdout:{"last_snap":11,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[{"version":21,"snapinfo":{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:26.455117+0000","name":"s25","metadata":{}}}],"pending_destroy":[]} 2023-11-04T01:42:50.580 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [ { "snapInfinityo": { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:26.455117+0000" }, "version": 21 } ], "snaps": [] } 2023-11-04T01:42:50.580 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:42:50.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.685+0000 7f4b95141640 1 Processor -- start 2023-11-04T01:42:50.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.685+0000 7f4b95141640 1 -- start start 2023-11-04T01:42:50.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.686+0000 7f4b95141640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4b900d1be0 0x7f4b90167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.686+0000 7f4b95141640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900b32b0 con 0x7f4b9015d4e0 2023-11-04T01:42:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.686+0000 7f4b95141640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900cee10 con 0x7f4b9015d100 2023-11-04T01:42:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.686+0000 7f4b95141640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b900cec20 con 0x7f4b900d1be0 2023-11-04T01:42:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.686+0000 7f4b8f59e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4b900d1be0 0x7f4b90167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.686+0000 7f4b8e59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4b9015d4e0 0x7f4b900d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41976/0 (socket says 172.21.15.44:41976) 2023-11-04T01:42:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.686+0000 7f4b8e59c640 1 -- 172.21.15.44:0/450482053 learned_addr learned my addr 172.21.15.44:0/450482053 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.687+0000 7f4b8f59e640 1 -- 172.21.15.44:0/450482053 >> v1:172.21.15.204:6789/0 conn(0x7f4b9015d100 legacy=0x7f4b900ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.687+0000 7f4b8f59e640 1 -- 172.21.15.44:0/450482053 >> v1:172.21.15.44:6789/0 conn(0x7f4b9015d4e0 legacy=0x7f4b900d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.687+0000 7f4b8f59e640 1 -- 172.21.15.44:0/450482053 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b900b4750 con 0x7f4b900d1be0 2023-11-04T01:42:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.687+0000 7f4b8dd9b640 1 -- 172.21.15.44:0/450482053 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569718036 0 0) 0x7f4b900b32b0 con 0x7f4b9015d4e0 2023-11-04T01:42:50.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.687+0000 7f4b8f59e640 1 --2- 172.21.15.44:0/450482053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b900d1be0 0x7f4b90167e80 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009d90 tx=0x7f4b8002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff1d37cfb207b8d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:50.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.687+0000 7f4b8dd9b640 1 -- 172.21.15.44:0/450482053 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8002cd00 con 0x7f4b900d1be0 2023-11-04T01:42:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.688+0000 7f4b8dd9b640 1 -- 172.21.15.44:0/450482053 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8002ce60 con 0x7f4b900d1be0 2023-11-04T01:42:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.688+0000 7f4b8dd9b640 1 -- 172.21.15.44:0/450482053 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80034660 con 0x7f4b900d1be0 2023-11-04T01:42:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.688+0000 7f4b95141640 1 -- 172.21.15.44:0/450482053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b900d1be0 msgr2=0x7f4b90167e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.688+0000 7f4b95141640 1 --2- 172.21.15.44:0/450482053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b900d1be0 0x7f4b90167e80 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009d90 tx=0x7f4b8002bf50 comp rx=0 tx=0).stop 2023-11-04T01:42:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.688+0000 7f4b95141640 1 -- 172.21.15.44:0/450482053 shutdown_connections 2023-11-04T01:42:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.688+0000 7f4b95141640 1 --2- 172.21.15.44:0/450482053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b900d1be0 0x7f4b90167e80 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.688+0000 7f4b95141640 1 -- 172.21.15.44:0/450482053 >> 172.21.15.44:0/450482053 conn(0x7f4b900d2ef0 msgr2=0x7f4b900d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.688+0000 7f4b95141640 1 -- 172.21.15.44:0/450482053 shutdown_connections 2023-11-04T01:42:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.688+0000 7f4b95141640 1 -- 172.21.15.44:0/450482053 wait complete. 2023-11-04T01:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.689+0000 7f4b95141640 1 Processor -- start 2023-11-04T01:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.690+0000 7f4b95141640 1 -- start start 2023-11-04T01:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.690+0000 7f4b95141640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b900d1be0 0x7f4b900b8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.690+0000 7f4b95141640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b9015d100 0x7f4b9015fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.690+0000 7f4b95141640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b9015d4e0 0x7f4b901f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.690+0000 7f4b95141640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b901f6ea0 con 0x7f4b9015d100 2023-11-04T01:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.690+0000 7f4b95141640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b901f7180 con 0x7f4b9015d4e0 2023-11-04T01:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.690+0000 7f4b95141640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900b79a0 con 0x7f4b900d1be0 2023-11-04T01:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.690+0000 7f4b8e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b9015d100 0x7f4b9015fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.690+0000 7f4b8e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b9015d100 0x7f4b9015fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51164/0 (socket says 172.21.15.44:51164) 2023-11-04T01:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.690+0000 7f4b8e59c640 1 -- 172.21.15.44:0/1750280617 learned_addr learned my addr 172.21.15.44:0/1750280617 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.691+0000 7f4b8f59e640 1 --2- 172.21.15.44:0/1750280617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b9015d4e0 0x7f4b901f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.691+0000 7f4b8ed9d640 1 --2- 172.21.15.44:0/1750280617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b900d1be0 0x7f4b900b8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.691+0000 7f4b8e59c640 1 -- 172.21.15.44:0/1750280617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b900d1be0 msgr2=0x7f4b900b8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.691+0000 7f4b8e59c640 1 --2- 172.21.15.44:0/1750280617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b900d1be0 0x7f4b900b8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.691+0000 7f4b8e59c640 1 -- 172.21.15.44:0/1750280617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b9015d4e0 msgr2=0x7f4b901f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.691+0000 7f4b8e59c640 1 --2- 172.21.15.44:0/1750280617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b9015d4e0 0x7f4b901f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.691+0000 7f4b8e59c640 1 -- 172.21.15.44:0/1750280617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b80009a70 con 0x7f4b9015d100 2023-11-04T01:42:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.691+0000 7f4b8e59c640 1 --2- 172.21.15.44:0/1750280617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b9015d100 0x7f4b9015fd80 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400c3c0 tx=0x7f4b8400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.691+0000 7f4b777fe640 1 -- 172.21.15.44:0/1750280617 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b840074e0 con 0x7f4b9015d100 2023-11-04T01:42:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.691+0000 7f4b777fe640 1 -- 172.21.15.44:0/1750280617 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b84007640 con 0x7f4b9015d100 2023-11-04T01:42:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.691+0000 7f4b95141640 1 -- 172.21.15.44:0/1750280617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b900b7c80 con 0x7f4b9015d100 2023-11-04T01:42:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.691+0000 7f4b777fe640 1 -- 172.21.15.44:0/1750280617 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b84004a20 con 0x7f4b9015d100 2023-11-04T01:42:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.691+0000 7f4b95141640 1 -- 172.21.15.44:0/1750280617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b900c98f0 con 0x7f4b9015d100 2023-11-04T01:42:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.693+0000 7f4b95141640 1 -- 172.21.15.44:0/1750280617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b900b81a0 con 0x7f4b9015d100 2023-11-04T01:42:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.693+0000 7f4b777fe640 1 -- 172.21.15.44:0/1750280617 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b84004b80 con 0x7f4b9015d100 2023-11-04T01:42:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.693+0000 7f4b777fe640 1 --2- 172.21.15.44:0/1750280617 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4b7c06aea0 0x7f4b7c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.694+0000 7f4b777fe640 1 -- 172.21.15.44:0/1750280617 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7795+0+0 (secure 0 0 0) 0x7f4b84089ac0 con 0x7f4b9015d100 2023-11-04T01:42:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.694+0000 7f4b8ed9d640 1 --2- 172.21.15.44:0/1750280617 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4b7c06aea0 0x7f4b7c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.694+0000 7f4b8ed9d640 1 --2- 172.21.15.44:0/1750280617 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4b7c06aea0 0x7f4b7c06d360 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4b88000fb0 tx=0x7f4b88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.698+0000 7f4b777fe640 1 -- 172.21.15.44:0/1750280617 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4b900b81a0 con 0x7f4b9015d100 2023-11-04T01:42:50.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.945+0000 7f4b95141640 1 -- 172.21.15.44:0/1750280617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7f4b900b81a0 con 0x7f4b9015d100 2023-11-04T01:42:50.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.947+0000 7f4b777fe640 1 -- 172.21.15.44:0/1750280617 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 7156 v102) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4b900b81a0 con 0x7f4b9015d100 2023-11-04T01:42:50.949 INFO:teuthology.orchestra.run.smithi044.stderr:failed mds gid 7156 2023-11-04T01:42:50.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.949+0000 7f4b95141640 1 -- 172.21.15.44:0/1750280617 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4b7c06aea0 msgr2=0x7f4b7c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.949+0000 7f4b95141640 1 --2- 172.21.15.44:0/1750280617 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4b7c06aea0 0x7f4b7c06d360 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4b88000fb0 tx=0x7f4b88009040 comp rx=0 tx=0).stop 2023-11-04T01:42:50.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.949+0000 7f4b95141640 1 -- 172.21.15.44:0/1750280617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b9015d100 msgr2=0x7f4b9015fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.949+0000 7f4b95141640 1 --2- 172.21.15.44:0/1750280617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b9015d100 0x7f4b9015fd80 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400c3c0 tx=0x7f4b8400c880 comp rx=0 tx=0).stop 2023-11-04T01:42:50.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.949+0000 7f4b95141640 1 -- 172.21.15.44:0/1750280617 shutdown_connections 2023-11-04T01:42:50.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.949+0000 7f4b95141640 1 --2- 172.21.15.44:0/1750280617 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4b7c06aea0 0x7f4b7c06d360 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.949+0000 7f4b95141640 1 --2- 172.21.15.44:0/1750280617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b9015d4e0 0x7f4b901f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.949+0000 7f4b95141640 1 --2- 172.21.15.44:0/1750280617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b9015d100 0x7f4b9015fd80 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.949+0000 7f4b95141640 1 --2- 172.21.15.44:0/1750280617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b900d1be0 0x7f4b900b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.949+0000 7f4b95141640 1 -- 172.21.15.44:0/1750280617 >> 172.21.15.44:0/1750280617 conn(0x7f4b900d2ef0 msgr2=0x7f4b9006c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:50.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.949+0000 7f4b95141640 1 -- 172.21.15.44:0/1750280617 shutdown_connections 2023-11-04T01:42:50.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:50.950+0000 7f4b95141640 1 -- 172.21.15.44:0/1750280617 wait complete. 2023-11-04T01:42:50.965 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:42:50.965 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:42:50.965 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:42:50.965 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:50.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:50.965 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi204 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-11-04T01:42:50.965 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:42:50.966 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:42:50.968 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:42:50.968 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:51.046 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2023-11-04T01:42:51.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.072+0000 7f4f6f407640 1 Processor -- start 2023-11-04T01:42:51.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.073+0000 7f4f6f407640 1 -- start start 2023-11-04T01:42:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.073+0000 7f4f6f407640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4f6815d100 0x7f4f680ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.073+0000 7f4f6f407640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4f6815d4e0 0x7f4f680d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.073+0000 7f4f6f407640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f680b32b0 con 0x7f4f680d3b60 2023-11-04T01:42:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.073+0000 7f4f6f407640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f680cee10 con 0x7f4f6815d4e0 2023-11-04T01:42:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.073+0000 7f4f6f407640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f680b4750 con 0x7f4f6815d100 2023-11-04T01:42:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.074+0000 7f4f6c9a2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4f6815d4e0 0x7f4f680d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.074+0000 7f4f6d9a4640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4f680d3b60 0x7f4f680cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41984/0 (socket says 172.21.15.44:41984) 2023-11-04T01:42:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.074+0000 7f4f6d9a4640 1 -- 172.21.15.44:0/686544525 learned_addr learned my addr 172.21.15.44:0/686544525 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.074+0000 7f4f6d1a3640 1 --2- 172.21.15.44:0/686544525 >> v2:172.21.15.204:3300/0 conn(0x7f4f6815d100 0x7f4f680ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.074+0000 7f4f6c9a2640 1 -- 172.21.15.44:0/686544525 >> v2:172.21.15.204:3300/0 conn(0x7f4f6815d100 msgr2=0x7f4f680ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.074+0000 7f4f6c9a2640 1 --2- 172.21.15.44:0/686544525 >> v2:172.21.15.204:3300/0 conn(0x7f4f6815d100 0x7f4f680ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.074+0000 7f4f6c9a2640 1 -- 172.21.15.44:0/686544525 >> v1:172.21.15.44:6789/0 conn(0x7f4f680d3b60 legacy=0x7f4f680cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.074+0000 7f4f67fff640 1 -- 172.21.15.44:0/686544525 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397793562 0 0) 0x7f4f680b32b0 con 0x7f4f680d3b60 2023-11-04T01:42:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.074+0000 7f4f6c9a2640 1 -- 172.21.15.44:0/686544525 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f680b2980 con 0x7f4f6815d4e0 2023-11-04T01:42:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.075+0000 7f4f6c9a2640 1 --2- 172.21.15.44:0/686544525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6815d4e0 0x7f4f680d14d0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f4f680d09f0 tx=0x7f4f5c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f02bc093d1d6ed server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.075+0000 7f4f67fff640 1 -- 172.21.15.44:0/686544525 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c031830 con 0x7f4f6815d4e0 2023-11-04T01:42:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.075+0000 7f4f67fff640 1 -- 172.21.15.44:0/686544525 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c031990 con 0x7f4f6815d4e0 2023-11-04T01:42:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.075+0000 7f4f67fff640 1 -- 172.21.15.44:0/686544525 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c031d20 con 0x7f4f6815d4e0 2023-11-04T01:42:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.075+0000 7f4f6f407640 1 -- 172.21.15.44:0/686544525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6815d4e0 msgr2=0x7f4f680d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.075+0000 7f4f6f407640 1 --2- 172.21.15.44:0/686544525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6815d4e0 0x7f4f680d14d0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f4f680d09f0 tx=0x7f4f5c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.075+0000 7f4f6f407640 1 -- 172.21.15.44:0/686544525 shutdown_connections 2023-11-04T01:42:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.075+0000 7f4f6f407640 1 --2- 172.21.15.44:0/686544525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6815d4e0 0x7f4f680d14d0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.075+0000 7f4f6f407640 1 --2- 172.21.15.44:0/686544525 >> v2:172.21.15.204:3300/0 conn(0x7f4f6815d100 0x7f4f680ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.075+0000 7f4f6f407640 1 -- 172.21.15.44:0/686544525 >> 172.21.15.44:0/686544525 conn(0x7f4f680d2ef0 msgr2=0x7f4f680d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.075+0000 7f4f6f407640 1 -- 172.21.15.44:0/686544525 shutdown_connections 2023-11-04T01:42:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.075+0000 7f4f6f407640 1 -- 172.21.15.44:0/686544525 wait complete. 2023-11-04T01:42:51.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.077+0000 7f4f6f407640 1 Processor -- start 2023-11-04T01:42:51.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.077+0000 7f4f6f407640 1 -- start start 2023-11-04T01:42:51.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.077+0000 7f4f6f407640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f680d3b60 0x7f4f68159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:51.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.077+0000 7f4f6f407640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6815d100 0x7f4f680a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:51.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.077+0000 7f4f6f407640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6815d4e0 0x7f4f680b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:51.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.077+0000 7f4f6f407640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6815f6a0 con 0x7f4f680d3b60 2023-11-04T01:42:51.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.077+0000 7f4f6f407640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6815f980 con 0x7f4f6815d100 2023-11-04T01:42:51.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.077+0000 7f4f6f407640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6815fc60 con 0x7f4f6815d4e0 2023-11-04T01:42:51.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f6d1a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f680d3b60 0x7f4f68159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:51.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f6d1a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f680d3b60 0x7f4f68159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51174/0 (socket says 172.21.15.44:51174) 2023-11-04T01:42:51.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f6d1a3640 1 -- 172.21.15.44:0/2750633989 learned_addr learned my addr 172.21.15.44:0/2750633989 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:51.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f6d9a4640 1 --2- 172.21.15.44:0/2750633989 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6815d4e0 0x7f4f680b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:51.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f6c9a2640 1 --2- 172.21.15.44:0/2750633989 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6815d100 0x7f4f680a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:51.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f6d1a3640 1 -- 172.21.15.44:0/2750633989 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6815d4e0 msgr2=0x7f4f680b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:51.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f6d1a3640 1 --2- 172.21.15.44:0/2750633989 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6815d4e0 0x7f4f680b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:51.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f6d1a3640 1 -- 172.21.15.44:0/2750633989 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6815d100 msgr2=0x7f4f680a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:51.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f6d1a3640 1 --2- 172.21.15.44:0/2750633989 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6815d100 0x7f4f680a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:51.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f6d1a3640 1 -- 172.21.15.44:0/2750633989 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c009400 con 0x7f4f680d3b60 2023-11-04T01:42:51.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f6d1a3640 1 --2- 172.21.15.44:0/2750633989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f680d3b60 0x7f4f68159010 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800efc0 tx=0x7f4f5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:51.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f65ffb640 1 -- 172.21.15.44:0/2750633989 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f58009bd0 con 0x7f4f680d3b60 2023-11-04T01:42:51.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f65ffb640 1 -- 172.21.15.44:0/2750633989 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5800f040 con 0x7f4f680d3b60 2023-11-04T01:42:51.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f6f407640 1 -- 172.21.15.44:0/2750633989 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6815ff40 con 0x7f4f680d3b60 2023-11-04T01:42:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f65ffb640 1 -- 172.21.15.44:0/2750633989 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f580146a0 con 0x7f4f680d3b60 2023-11-04T01:42:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.078+0000 7f4f6f407640 1 -- 172.21.15.44:0/2750633989 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f68159550 con 0x7f4f680d3b60 2023-11-04T01:42:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.079+0000 7f4f6f407640 1 -- 172.21.15.44:0/2750633989 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f680684b0 con 0x7f4f680d3b60 2023-11-04T01:42:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.080+0000 7f4f65ffb640 1 -- 172.21.15.44:0/2750633989 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f58014800 con 0x7f4f680d3b60 2023-11-04T01:42:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.080+0000 7f4f65ffb640 1 --2- 172.21.15.44:0/2750633989 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f5406ae70 0x7f4f5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.080+0000 7f4f65ffb640 1 -- 172.21.15.44:0/2750633989 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7881+0+0 (secure 0 0 0) 0x7f4f5808aa00 con 0x7f4f680d3b60 2023-11-04T01:42:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.081+0000 7f4f6c9a2640 1 --2- 172.21.15.44:0/2750633989 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f5406ae70 0x7f4f5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.081+0000 7f4f6c9a2640 1 --2- 172.21.15.44:0/2750633989 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f5406ae70 0x7f4f5406d330 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c036000 tx=0x7f4f5c03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:51.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.084+0000 7f4f65ffb640 1 -- 172.21.15.44:0/2750633989 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f58055240 con 0x7f4f680d3b60 2023-11-04T01:42:51.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.299+0000 7f4f6f407640 1 -- 172.21.15.44:0/2750633989 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f680d2cd0 con 0x7f4f680d3b60 2023-11-04T01:42:51.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.300+0000 7f4f65ffb640 1 -- 172.21.15.44:0/2750633989 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4140 (secure 0 0 0) 0x7f4f58058860 con 0x7f4f680d3b60 2023-11-04T01:42:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:51.302 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":103,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:50.951391+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:resolve","state_seq":11,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:replay","state_seq":1,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:51.302 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 103 2023-11-04T01:42:51.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.301+0000 7f4f6f407640 1 -- 172.21.15.44:0/2750633989 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f5406ae70 msgr2=0x7f4f5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:51.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.301+0000 7f4f6f407640 1 --2- 172.21.15.44:0/2750633989 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f5406ae70 0x7f4f5406d330 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c036000 tx=0x7f4f5c03c040 comp rx=0 tx=0).stop 2023-11-04T01:42:51.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.301+0000 7f4f6f407640 1 -- 172.21.15.44:0/2750633989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f680d3b60 msgr2=0x7f4f68159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:51.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.301+0000 7f4f6f407640 1 --2- 172.21.15.44:0/2750633989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f680d3b60 0x7f4f68159010 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800efc0 tx=0x7f4f5800c490 comp rx=0 tx=0).stop 2023-11-04T01:42:51.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.302+0000 7f4f6f407640 1 -- 172.21.15.44:0/2750633989 shutdown_connections 2023-11-04T01:42:51.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.302+0000 7f4f6f407640 1 --2- 172.21.15.44:0/2750633989 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4f5406ae70 0x7f4f5406d330 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:51.304 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.302+0000 7f4f6f407640 1 --2- 172.21.15.44:0/2750633989 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6815d4e0 0x7f4f680b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:51.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.302+0000 7f4f6f407640 1 --2- 172.21.15.44:0/2750633989 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6815d100 0x7f4f680a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:51.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.302+0000 7f4f6f407640 1 --2- 172.21.15.44:0/2750633989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f680d3b60 0x7f4f68159010 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:51.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.302+0000 7f4f6f407640 1 -- 172.21.15.44:0/2750633989 >> 172.21.15.44:0/2750633989 conn(0x7f4f680d2ef0 msgr2=0x7f4f680cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:51.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.302+0000 7f4f6f407640 1 -- 172.21.15.44:0/2750633989 shutdown_connections 2023-11-04T01:42:51.305 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:51.302+0000 7f4f6f407640 1 -- 172.21.15.44:0/2750633989 wait complete. 2023-11-04T01:42:51.314 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:42:53.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-04T01:42:56.314 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:56.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.431+0000 7f1b214fc640 1 Processor -- start 2023-11-04T01:42:56.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.431+0000 7f1b214fc640 1 -- start start 2023-11-04T01:42:56.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.432+0000 7f1b214fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b1c0b3ca0 0x7f1b1c06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.432+0000 7f1b214fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1b1c0b2100 0x7f1b1c0b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.432+0000 7f1b214fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1c0b2a90 con 0x7f1b1c15d110 2023-11-04T01:42:56.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.432+0000 7f1b214fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1c0664f0 con 0x7f1b1c0b2100 2023-11-04T01:42:56.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.432+0000 7f1b214fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c15d4f0 con 0x7f1b1c0b3ca0 2023-11-04T01:42:56.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.432+0000 7f1b1a7fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b1c0b3ca0 0x7f1b1c06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.432+0000 7f1b1b7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1b1c0b2100 0x7f1b1c0b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.432+0000 7f1b1affd640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f1b1c15d110 0x7f1b1c0ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:43892/0 (socket says 172.21.15.44:43892) 2023-11-04T01:42:56.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.432+0000 7f1b1a7fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b1c0b3ca0 0x7f1b1c06b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:57950/0 (socket says 172.21.15.44:57950) 2023-11-04T01:42:56.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.432+0000 7f1b1affd640 1 -- 172.21.15.44:0/2693489715 learned_addr learned my addr 172.21.15.44:0/2693489715 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:56.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.433+0000 7f1b1b7fe640 1 -- 172.21.15.44:0/2693489715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b1c0b3ca0 msgr2=0x7f1b1c06b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.433+0000 7f1b1b7fe640 1 --2- 172.21.15.44:0/2693489715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b1c0b3ca0 0x7f1b1c06b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.433+0000 7f1b1b7fe640 1 -- 172.21.15.44:0/2693489715 >> v1:172.21.15.204:6789/0 conn(0x7f1b1c15d110 legacy=0x7f1b1c0ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.433+0000 7f1b19ffb640 1 -- 172.21.15.44:0/2693489715 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598721988 0 0) 0x7f1b0c001160 con 0x7f1b1c15d110 2023-11-04T01:42:56.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.433+0000 7f1b1b7fe640 1 -- 172.21.15.44:0/2693489715 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c06b9f0 con 0x7f1b1c0b2100 2023-11-04T01:42:56.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.433+0000 7f1b1a7fc640 1 --2- 172.21.15.44:0/2693489715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b1c0b3ca0 0x7f1b1c06b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:56.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.434+0000 7f1b1b7fe640 1 --2- 172.21.15.44:0/2693489715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b1c0b2100 0x7f1b1c0b2550 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009d90 tx=0x7f1b1402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=868d1b4999c2d54e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.434+0000 7f1b19ffb640 1 -- 172.21.15.44:0/2693489715 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1402cc50 con 0x7f1b1c0b2100 2023-11-04T01:42:56.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.434+0000 7f1b19ffb640 1 -- 172.21.15.44:0/2693489715 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1402cdb0 con 0x7f1b1c0b2100 2023-11-04T01:42:56.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.434+0000 7f1b19ffb640 1 -- 172.21.15.44:0/2693489715 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14034660 con 0x7f1b1c0b2100 2023-11-04T01:42:56.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.434+0000 7f1b214fc640 1 -- 172.21.15.44:0/2693489715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b1c0b2100 msgr2=0x7f1b1c0b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.434+0000 7f1b214fc640 1 --2- 172.21.15.44:0/2693489715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b1c0b2100 0x7f1b1c0b2550 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009d90 tx=0x7f1b1402bea0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.434+0000 7f1b214fc640 1 -- 172.21.15.44:0/2693489715 shutdown_connections 2023-11-04T01:42:56.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.434+0000 7f1b214fc640 1 --2- 172.21.15.44:0/2693489715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b1c0b2100 0x7f1b1c0b2550 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.437 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.434+0000 7f1b214fc640 1 --2- 172.21.15.44:0/2693489715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b1c0b3ca0 0x7f1b1c06b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.434+0000 7f1b214fc640 1 -- 172.21.15.44:0/2693489715 >> 172.21.15.44:0/2693489715 conn(0x7f1b1c0cbd30 msgr2=0x7f1b1c0cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.435+0000 7f1b214fc640 1 -- 172.21.15.44:0/2693489715 shutdown_connections 2023-11-04T01:42:56.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.435+0000 7f1b214fc640 1 -- 172.21.15.44:0/2693489715 wait complete. 2023-11-04T01:42:56.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.436+0000 7f1b214fc640 1 Processor -- start 2023-11-04T01:42:56.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.436+0000 7f1b214fc640 1 -- start start 2023-11-04T01:42:56.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b214fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b1c0b2100 0x7f1b1c0c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b214fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b1c0b3ca0 0x7f1b1c1f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b214fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b1c15d110 0x7f1b1c1f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b214fc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c15b5a0 con 0x7f1b1c15d110 2023-11-04T01:42:56.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b214fc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c158080 con 0x7f1b1c0b3ca0 2023-11-04T01:42:56.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b214fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c0c68c0 con 0x7f1b1c0b2100 2023-11-04T01:42:56.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b1b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b1c15d110 0x7f1b1c1f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b1b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b1c15d110 0x7f1b1c1f2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34746/0 (socket says 172.21.15.44:34746) 2023-11-04T01:42:56.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b1b7fe640 1 -- 172.21.15.44:0/3575060459 learned_addr learned my addr 172.21.15.44:0/3575060459 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:56.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b1a7fc640 1 --2- 172.21.15.44:0/3575060459 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b1c0b3ca0 0x7f1b1c1f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b1affd640 1 --2- 172.21.15.44:0/3575060459 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b1c0b2100 0x7f1b1c0c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b1b7fe640 1 -- 172.21.15.44:0/3575060459 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b1c0b2100 msgr2=0x7f1b1c0c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b1b7fe640 1 --2- 172.21.15.44:0/3575060459 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b1c0b2100 0x7f1b1c0c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b1b7fe640 1 -- 172.21.15.44:0/3575060459 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b1c0b3ca0 msgr2=0x7f1b1c1f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b1b7fe640 1 --2- 172.21.15.44:0/3575060459 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b1c0b3ca0 0x7f1b1c1f28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b1b7fe640 1 -- 172.21.15.44:0/3575060459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b10009400 con 0x7f1b1c15d110 2023-11-04T01:42:56.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.437+0000 7f1b1a7fc640 1 --2- 172.21.15.44:0/3575060459 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b1c0b3ca0 0x7f1b1c1f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:56.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.438+0000 7f1b1b7fe640 1 --2- 172.21.15.44:0/3575060459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b1c15d110 0x7f1b1c1f2e00 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009d90 tx=0x7f1b14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.438+0000 7f1b037fe640 1 -- 172.21.15.44:0/3575060459 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14003b90 con 0x7f1b1c15d110 2023-11-04T01:42:56.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.438+0000 7f1b037fe640 1 -- 172.21.15.44:0/3575060459 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b14003d10 con 0x7f1b1c15d110 2023-11-04T01:42:56.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.438+0000 7f1b214fc640 1 -- 172.21.15.44:0/3575060459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b14009a70 con 0x7f1b1c15d110 2023-11-04T01:42:56.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.438+0000 7f1b037fe640 1 -- 172.21.15.44:0/3575060459 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14004270 con 0x7f1b1c15d110 2023-11-04T01:42:56.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.438+0000 7f1b214fc640 1 -- 172.21.15.44:0/3575060459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1c0700e0 con 0x7f1b1c15d110 2023-11-04T01:42:56.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.439+0000 7f1b214fc640 1 -- 172.21.15.44:0/3575060459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1c0c7fc0 con 0x7f1b1c15d110 2023-11-04T01:42:56.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.439+0000 7f1b037fe640 1 -- 172.21.15.44:0/3575060459 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b1403b050 con 0x7f1b1c15d110 2023-11-04T01:42:56.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.440+0000 7f1b037fe640 1 --2- 172.21.15.44:0/3575060459 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1b0806aea0 0x7f1b0806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.440+0000 7f1b037fe640 1 -- 172.21.15.44:0/3575060459 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7881+0+0 (secure 0 0 0) 0x7f1b140ac220 con 0x7f1b1c15d110 2023-11-04T01:42:56.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.440+0000 7f1b1affd640 1 --2- 172.21.15.44:0/3575060459 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1b0806aea0 0x7f1b0806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.441+0000 7f1b1affd640 1 --2- 172.21.15.44:0/3575060459 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1b0806aea0 0x7f1b0806d360 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c007fd0 tx=0x7f1b0c0079e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.444+0000 7f1b037fe640 1 -- 172.21.15.44:0/3575060459 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1b14076ae0 con 0x7f1b1c15d110 2023-11-04T01:42:56.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.657+0000 7f1b214fc640 1 -- 172.21.15.44:0/3575060459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b1c0684b0 con 0x7f1b1c15d110 2023-11-04T01:42:56.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.657+0000 7f1b037fe640 1 -- 172.21.15.44:0/3575060459 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4937 (secure 0 0 0) 0x7f1b14039090 con 0x7f1b1c15d110 2023-11-04T01:42:56.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:56.660 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":105,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:51.958250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:56.660 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 105 2023-11-04T01:42:56.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.659+0000 7f1b214fc640 1 -- 172.21.15.44:0/3575060459 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1b0806aea0 msgr2=0x7f1b0806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.659+0000 7f1b214fc640 1 --2- 172.21.15.44:0/3575060459 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1b0806aea0 0x7f1b0806d360 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c007fd0 tx=0x7f1b0c0079e0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.661 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.659+0000 7f1b214fc640 1 -- 172.21.15.44:0/3575060459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b1c15d110 msgr2=0x7f1b1c1f2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.659+0000 7f1b214fc640 1 --2- 172.21.15.44:0/3575060459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b1c15d110 0x7f1b1c1f2e00 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009d90 tx=0x7f1b14004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:56.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.659+0000 7f1b214fc640 1 -- 172.21.15.44:0/3575060459 shutdown_connections 2023-11-04T01:42:56.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.659+0000 7f1b214fc640 1 --2- 172.21.15.44:0/3575060459 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f1b0806aea0 0x7f1b0806d360 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.659+0000 7f1b214fc640 1 --2- 172.21.15.44:0/3575060459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b1c15d110 0x7f1b1c1f2e00 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.659+0000 7f1b214fc640 1 --2- 172.21.15.44:0/3575060459 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b1c0b3ca0 0x7f1b1c1f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.659+0000 7f1b214fc640 1 --2- 172.21.15.44:0/3575060459 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b1c0b2100 0x7f1b1c0c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.659+0000 7f1b214fc640 1 -- 172.21.15.44:0/3575060459 >> 172.21.15.44:0/3575060459 conn(0x7f1b1c0cbd30 msgr2=0x7f1b1c0cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.659+0000 7f1b214fc640 1 -- 172.21.15.44:0/3575060459 shutdown_connections 2023-11-04T01:42:56.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.659+0000 7f1b214fc640 1 -- 172.21.15.44:0/3575060459 wait complete. 2023-11-04T01:42:56.672 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:42:56.672 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:56.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.776+0000 7fc7d1ada640 1 Processor -- start 2023-11-04T01:42:56.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.776+0000 7fc7d1ada640 1 -- start start 2023-11-04T01:42:56.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7d1ada640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc7cc0ade00 0x7fc7cc0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7d1ada640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc06d9c0 0x7fc7cc0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7d1ada640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc7cc06c5f0 0x7fc7cc071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7d1ada640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7cc06cc90 con 0x7fc7cc0ade00 2023-11-04T01:42:56.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7d1ada640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7cc071b50 con 0x7fc7cc06c5f0 2023-11-04T01:42:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7d1ada640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0b0e60 con 0x7fc7cc06d9c0 2023-11-04T01:42:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc7cc0ade00 0x7fc7cc0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc7cc0ade00 0x7fc7cc0b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34754/0 (socket says 172.21.15.44:34754) 2023-11-04T01:42:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/4125817975 learned_addr learned my addr 172.21.15.44:0/4125817975 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7cbfff640 1 --2- 172.21.15.44:0/4125817975 >> v2:172.21.15.204:3300/0 conn(0x7fc7cc06c5f0 0x7fc7cc071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7caffd640 1 --2- 172.21.15.44:0/4125817975 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc06d9c0 0x7fc7cc0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/4125817975 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc06d9c0 msgr2=0x7fc7cc0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7cb7fe640 1 --2- 172.21.15.44:0/4125817975 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc06d9c0 0x7fc7cc0710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/4125817975 >> v2:172.21.15.204:3300/0 conn(0x7fc7cc06c5f0 msgr2=0x7fc7cc071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7cb7fe640 1 --2- 172.21.15.44:0/4125817975 >> v2:172.21.15.204:3300/0 conn(0x7fc7cc06c5f0 0x7fc7cc071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/4125817975 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc06cee0 con 0x7fc7cc0ade00 2023-11-04T01:42:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7cbfff640 1 --2- 172.21.15.44:0/4125817975 >> v2:172.21.15.204:3300/0 conn(0x7fc7cc06c5f0 0x7fc7cc071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.777+0000 7fc7caffd640 1 --2- 172.21.15.44:0/4125817975 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc06d9c0 0x7fc7cc0710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.778+0000 7fc7cb7fe640 1 --2- 172.21.15.44:0/4125817975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0ade00 0x7fc7cc0b0530 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0c5b10 tx=0x7fc7bc02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935cdd909e3b5ff8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.778+0000 7fc7ca7fc640 1 -- 172.21.15.44:0/4125817975 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc031750 con 0x7fc7cc0ade00 2023-11-04T01:42:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.778+0000 7fc7ca7fc640 1 -- 172.21.15.44:0/4125817975 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc0318b0 con 0x7fc7cc0ade00 2023-11-04T01:42:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.778+0000 7fc7ca7fc640 1 -- 172.21.15.44:0/4125817975 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc031c40 con 0x7fc7cc0ade00 2023-11-04T01:42:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.779+0000 7fc7d1ada640 1 -- 172.21.15.44:0/4125817975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0ade00 msgr2=0x7fc7cc0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.779+0000 7fc7d1ada640 1 --2- 172.21.15.44:0/4125817975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0ade00 0x7fc7cc0b0530 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0c5b10 tx=0x7fc7bc02b7f0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.779+0000 7fc7d1ada640 1 -- 172.21.15.44:0/4125817975 shutdown_connections 2023-11-04T01:42:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.779+0000 7fc7d1ada640 1 --2- 172.21.15.44:0/4125817975 >> v2:172.21.15.204:3300/0 conn(0x7fc7cc06c5f0 0x7fc7cc071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.779+0000 7fc7d1ada640 1 --2- 172.21.15.44:0/4125817975 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc06d9c0 0x7fc7cc0710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.779+0000 7fc7d1ada640 1 --2- 172.21.15.44:0/4125817975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0ade00 0x7fc7cc0b0530 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.779+0000 7fc7d1ada640 1 -- 172.21.15.44:0/4125817975 >> 172.21.15.44:0/4125817975 conn(0x7fc7cc0cb530 msgr2=0x7fc7cc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.779+0000 7fc7d1ada640 1 -- 172.21.15.44:0/4125817975 shutdown_connections 2023-11-04T01:42:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.779+0000 7fc7d1ada640 1 -- 172.21.15.44:0/4125817975 wait complete. 2023-11-04T01:42:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.780+0000 7fc7d1ada640 1 Processor -- start 2023-11-04T01:42:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.780+0000 7fc7d1ada640 1 -- start start 2023-11-04T01:42:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.781+0000 7fc7d1ada640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc06c5f0 0x7fc7cc15d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.781+0000 7fc7d1ada640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc06d9c0 0x7fc7cc0c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.781+0000 7fc7d1ada640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc0ade00 0x7fc7cc0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.781+0000 7fc7d1ada640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc1f2c00 con 0x7fc7cc06c5f0 2023-11-04T01:42:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.781+0000 7fc7d1ada640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0ca4f0 con 0x7fc7cc06d9c0 2023-11-04T01:42:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.781+0000 7fc7d1ada640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0ca7d0 con 0x7fc7cc0ade00 2023-11-04T01:42:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.781+0000 7fc7cb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc06c5f0 0x7fc7cc15d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.781+0000 7fc7cb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc06c5f0 0x7fc7cc15d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34758/0 (socket says 172.21.15.44:34758) 2023-11-04T01:42:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.781+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/538311191 learned_addr learned my addr 172.21.15.44:0/538311191 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.781+0000 7fc7cbfff640 1 --2- 172.21.15.44:0/538311191 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc0ade00 0x7fc7cc0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.781+0000 7fc7caffd640 1 --2- 172.21.15.44:0/538311191 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc06d9c0 0x7fc7cc0c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.781+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/538311191 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc0ade00 msgr2=0x7fc7cc0ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.781+0000 7fc7cb7fe640 1 --2- 172.21.15.44:0/538311191 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc0ade00 0x7fc7cc0ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.781+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/538311191 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc06d9c0 msgr2=0x7fc7cc0c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.781+0000 7fc7cb7fe640 1 --2- 172.21.15.44:0/538311191 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc06d9c0 0x7fc7cc0c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.782+0000 7fc7cb7fe640 1 -- 172.21.15.44:0/538311191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc0094d0 con 0x7fc7cc06c5f0 2023-11-04T01:42:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.782+0000 7fc7cb7fe640 1 --2- 172.21.15.44:0/538311191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc06c5f0 0x7fc7cc15d0c0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc000c00 tx=0x7fc7bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.782+0000 7fc7b3fff640 1 -- 172.21.15.44:0/538311191 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc033c80 con 0x7fc7cc06c5f0 2023-11-04T01:42:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.782+0000 7fc7b3fff640 1 -- 172.21.15.44:0/538311191 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc033de0 con 0x7fc7cc06c5f0 2023-11-04T01:42:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.782+0000 7fc7d1ada640 1 -- 172.21.15.44:0/538311191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7cc0caab0 con 0x7fc7cc06c5f0 2023-11-04T01:42:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.782+0000 7fc7b3fff640 1 -- 172.21.15.44:0/538311191 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc03c640 con 0x7fc7cc06c5f0 2023-11-04T01:42:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.782+0000 7fc7d1ada640 1 -- 172.21.15.44:0/538311191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7cc15d600 con 0x7fc7cc06c5f0 2023-11-04T01:42:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.783+0000 7fc7d1ada640 1 -- 172.21.15.44:0/538311191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7cc1f2a40 con 0x7fc7cc06c5f0 2023-11-04T01:42:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.783+0000 7fc7b3fff640 1 -- 172.21.15.44:0/538311191 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7bc03a040 con 0x7fc7cc06c5f0 2023-11-04T01:42:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.784+0000 7fc7b3fff640 1 --2- 172.21.15.44:0/538311191 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7b806aea0 0x7fc7b806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.784+0000 7fc7b3fff640 1 -- 172.21.15.44:0/538311191 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7881+0+0 (secure 0 0 0) 0x7fc7bc0abbe0 con 0x7fc7cc06c5f0 2023-11-04T01:42:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.784+0000 7fc7caffd640 1 --2- 172.21.15.44:0/538311191 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7b806aea0 0x7fc7b806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.784+0000 7fc7caffd640 1 --2- 172.21.15.44:0/538311191 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7b806aea0 0x7fc7b806d360 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0c52f0 tx=0x7fc7c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:56.788+0000 7fc7b3fff640 1 -- 172.21.15.44:0/538311191 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7cc1f2a40 con 0x7fc7cc06c5f0 2023-11-04T01:42:57.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:57.000+0000 7fc7d1ada640 1 -- 172.21.15.44:0/538311191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7cc1f2a40 con 0x7fc7cc06c5f0 2023-11-04T01:42:57.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:57.000+0000 7fc7b3fff640 1 -- 172.21.15.44:0/538311191 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4937 (secure 0 0 0) 0x7fc7cc1f2a40 con 0x7fc7cc06c5f0 2023-11-04T01:42:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:57.003 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":105,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:51.958250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:57.003 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 105 2023-11-04T01:42:57.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:57.002+0000 7fc7d1ada640 1 -- 172.21.15.44:0/538311191 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7b806aea0 msgr2=0x7fc7b806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:57.002+0000 7fc7d1ada640 1 --2- 172.21.15.44:0/538311191 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7b806aea0 0x7fc7b806d360 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0c52f0 tx=0x7fc7c0008040 comp rx=0 tx=0).stop 2023-11-04T01:42:57.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:57.002+0000 7fc7d1ada640 1 -- 172.21.15.44:0/538311191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc06c5f0 msgr2=0x7fc7cc15d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:57.002+0000 7fc7d1ada640 1 --2- 172.21.15.44:0/538311191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc06c5f0 0x7fc7cc15d0c0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc000c00 tx=0x7fc7bc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:57.002+0000 7fc7d1ada640 1 -- 172.21.15.44:0/538311191 shutdown_connections 2023-11-04T01:42:57.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:57.002+0000 7fc7d1ada640 1 --2- 172.21.15.44:0/538311191 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc7b806aea0 0x7fc7b806d360 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:57.002+0000 7fc7d1ada640 1 --2- 172.21.15.44:0/538311191 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7cc0ade00 0x7fc7cc0ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:57.002+0000 7fc7d1ada640 1 --2- 172.21.15.44:0/538311191 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7cc06d9c0 0x7fc7cc0c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:57.002+0000 7fc7d1ada640 1 --2- 172.21.15.44:0/538311191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc06c5f0 0x7fc7cc15d0c0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:57.002+0000 7fc7d1ada640 1 -- 172.21.15.44:0/538311191 >> 172.21.15.44:0/538311191 conn(0x7fc7cc0cb530 msgr2=0x7fc7cc0b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:57.002+0000 7fc7d1ada640 1 -- 172.21.15.44:0/538311191 shutdown_connections 2023-11-04T01:42:57.005 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:57.002+0000 7fc7d1ada640 1 -- 172.21.15.44:0/538311191 wait complete. 2023-11-04T01:42:57.015 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:42:58.016 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.133+0000 7fd78412c640 1 Processor -- start 2023-11-04T01:42:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.133+0000 7fd78412c640 1 -- start start 2023-11-04T01:42:58.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.134+0000 7fd78412c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd77c15b330 0x7fd77c0cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.134+0000 7fd78412c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77c0cb5d0 con 0x7fd77c0b2160 2023-11-04T01:42:58.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.134+0000 7fd78412c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77c06f3f0 con 0x7fd77c06ca60 2023-11-04T01:42:58.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.134+0000 7fd78412c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c0c3490 con 0x7fd77c15b330 2023-11-04T01:42:58.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.134+0000 7fd7816c7640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd77c0b2160 0x7fd77c06ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52028/0 (socket says 172.21.15.44:52028) 2023-11-04T01:42:58.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.134+0000 7fd7816c7640 1 -- 172.21.15.44:0/3332886369 learned_addr learned my addr 172.21.15.44:0/3332886369 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:58.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.135+0000 7fd781ec8640 1 --2- 172.21.15.44:0/3332886369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd77c15b330 0x7fd77c0cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.135+0000 7fd780ec6640 1 -- 172.21.15.44:0/3332886369 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513546851 0 0) 0x7fd77c0cb5d0 con 0x7fd77c0b2160 2023-11-04T01:42:58.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.135+0000 7fd780ec6640 1 -- 172.21.15.44:0/3332886369 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd764003520 con 0x7fd77c0b2160 2023-11-04T01:42:58.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.135+0000 7fd780ec6640 1 -- 172.21.15.44:0/3332886369 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695411982 0 0) 0x7fd77c06f3f0 con 0x7fd77c06ca60 2023-11-04T01:42:58.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.135+0000 7fd780ec6640 1 -- 172.21.15.44:0/3332886369 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd77c0cb5d0 con 0x7fd77c06ca60 2023-11-04T01:42:58.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.135+0000 7fd781ec8640 1 -- 172.21.15.44:0/3332886369 >> v1:172.21.15.204:6789/0 conn(0x7fd77c06ca60 legacy=0x7fd77c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.135+0000 7fd780ec6640 1 -- 172.21.15.44:0/3332886369 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3609794380 0 0) 0x7fd764003520 con 0x7fd77c0b2160 2023-11-04T01:42:58.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.135+0000 7fd781ec8640 1 -- 172.21.15.44:0/3332886369 >> v1:172.21.15.44:6789/0 conn(0x7fd77c0b2160 legacy=0x7fd77c06ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.135+0000 7fd781ec8640 1 -- 172.21.15.44:0/3332886369 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c0cbfa0 con 0x7fd77c15b330 2023-11-04T01:42:58.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.136+0000 7fd781ec8640 1 --2- 172.21.15.44:0/3332886369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd77c15b330 0x7fd77c0cba60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd7740097d0 tx=0x7fd77402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e6f06925c76a7c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.136+0000 7fd780ec6640 1 -- 172.21.15.44:0/3332886369 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770001670 con 0x7fd77c15b330 2023-11-04T01:42:58.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.136+0000 7fd780ec6640 1 -- 172.21.15.44:0/3332886369 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77402e050 con 0x7fd77c15b330 2023-11-04T01:42:58.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.136+0000 7fd780ec6640 1 -- 172.21.15.44:0/3332886369 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774030710 con 0x7fd77c15b330 2023-11-04T01:42:58.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.137+0000 7fd78412c640 1 -- 172.21.15.44:0/3332886369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd77c15b330 msgr2=0x7fd77c0cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.137+0000 7fd78412c640 1 --2- 172.21.15.44:0/3332886369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd77c15b330 0x7fd77c0cba60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd7740097d0 tx=0x7fd77402b800 comp rx=0 tx=0).stop 2023-11-04T01:42:58.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.137+0000 7fd78412c640 1 -- 172.21.15.44:0/3332886369 shutdown_connections 2023-11-04T01:42:58.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.137+0000 7fd78412c640 1 --2- 172.21.15.44:0/3332886369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd77c15b330 0x7fd77c0cba60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.137+0000 7fd78412c640 1 -- 172.21.15.44:0/3332886369 >> 172.21.15.44:0/3332886369 conn(0x7fd77c0b1640 msgr2=0x7fd77c0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:58.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.137+0000 7fd78412c640 1 -- 172.21.15.44:0/3332886369 shutdown_connections 2023-11-04T01:42:58.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.137+0000 7fd78412c640 1 -- 172.21.15.44:0/3332886369 wait complete. 2023-11-04T01:42:58.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.138+0000 7fd78412c640 1 Processor -- start 2023-11-04T01:42:58.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.138+0000 7fd78412c640 1 -- start start 2023-11-04T01:42:58.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd78412c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd77c06ca60 0x7fd77c0c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd78412c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd77c0b2160 0x7fd77c0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd78412c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd77c15b330 0x7fd77c0aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd78412c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c0af360 con 0x7fd77c15b330 2023-11-04T01:42:58.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd78412c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c1f4570 con 0x7fd77c0b2160 2023-11-04T01:42:58.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd78412c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c1f47c0 con 0x7fd77c06ca60 2023-11-04T01:42:58.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd7826c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd77c15b330 0x7fd77c0aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd7826c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd77c15b330 0x7fd77c0aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34764/0 (socket says 172.21.15.44:34764) 2023-11-04T01:42:58.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd7826c9640 1 -- 172.21.15.44:0/1428630923 learned_addr learned my addr 172.21.15.44:0/1428630923 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:58.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd7816c7640 1 --2- 172.21.15.44:0/1428630923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd77c0b2160 0x7fd77c0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd781ec8640 1 --2- 172.21.15.44:0/1428630923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd77c06ca60 0x7fd77c0c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd7826c9640 1 -- 172.21.15.44:0/1428630923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd77c06ca60 msgr2=0x7fd77c0c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd7826c9640 1 --2- 172.21.15.44:0/1428630923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd77c06ca60 0x7fd77c0c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd7826c9640 1 -- 172.21.15.44:0/1428630923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd77c0b2160 msgr2=0x7fd77c0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd7826c9640 1 --2- 172.21.15.44:0/1428630923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd77c0b2160 0x7fd77c0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd7826c9640 1 -- 172.21.15.44:0/1428630923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd774009400 con 0x7fd77c15b330 2023-11-04T01:42:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd781ec8640 1 --2- 172.21.15.44:0/1428630923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd77c06ca60 0x7fd77c0c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.139+0000 7fd7826c9640 1 --2- 172.21.15.44:0/1428630923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd77c15b330 0x7fd77c0aee20 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00c6e0 tx=0x7fd76c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.140+0000 7fd77a7fc640 1 -- 172.21.15.44:0/1428630923 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c003b70 con 0x7fd77c15b330 2023-11-04T01:42:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.140+0000 7fd77a7fc640 1 -- 172.21.15.44:0/1428630923 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c003cd0 con 0x7fd77c15b330 2023-11-04T01:42:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.140+0000 7fd78412c640 1 -- 172.21.15.44:0/1428630923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd77c1f4aa0 con 0x7fd77c15b330 2023-11-04T01:42:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.140+0000 7fd77a7fc640 1 -- 172.21.15.44:0/1428630923 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c0052d0 con 0x7fd77c15b330 2023-11-04T01:42:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.140+0000 7fd78412c640 1 -- 172.21.15.44:0/1428630923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77c1f5060 con 0x7fd77c15b330 2023-11-04T01:42:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.141+0000 7fd78412c640 1 -- 172.21.15.44:0/1428630923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77c06da20 con 0x7fd77c15b330 2023-11-04T01:42:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.141+0000 7fd77a7fc640 1 -- 172.21.15.44:0/1428630923 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd76c005430 con 0x7fd77c15b330 2023-11-04T01:42:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.142+0000 7fd77a7fc640 1 --2- 172.21.15.44:0/1428630923 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd76806ae70 0x7fd76806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.142+0000 7fd77a7fc640 1 -- 172.21.15.44:0/1428630923 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7881+0+0 (secure 0 0 0) 0x7fd76c089bb0 con 0x7fd77c15b330 2023-11-04T01:42:58.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.142+0000 7fd781ec8640 1 --2- 172.21.15.44:0/1428630923 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd76806ae70 0x7fd76806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.142+0000 7fd781ec8640 1 --2- 172.21.15.44:0/1428630923 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd76806ae70 0x7fd76806d330 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd774034000 tx=0x7fd774008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.146+0000 7fd77a7fc640 1 -- 172.21.15.44:0/1428630923 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd76c054470 con 0x7fd77c15b330 2023-11-04T01:42:58.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.359+0000 7fd78412c640 1 -- 172.21.15.44:0/1428630923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd77c1f5280 con 0x7fd77c15b330 2023-11-04T01:42:58.361 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.359+0000 7fd77a7fc640 1 -- 172.21.15.44:0/1428630923 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4937 (secure 0 0 0) 0x7fd76c057a90 con 0x7fd77c15b330 2023-11-04T01:42:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:58.362 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":105,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:51.958250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:58.362 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 105 2023-11-04T01:42:58.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.361+0000 7fd78412c640 1 -- 172.21.15.44:0/1428630923 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd76806ae70 msgr2=0x7fd76806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.361+0000 7fd78412c640 1 --2- 172.21.15.44:0/1428630923 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd76806ae70 0x7fd76806d330 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd774034000 tx=0x7fd774008030 comp rx=0 tx=0).stop 2023-11-04T01:42:58.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.361+0000 7fd78412c640 1 -- 172.21.15.44:0/1428630923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd77c15b330 msgr2=0x7fd77c0aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.363 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.361+0000 7fd78412c640 1 --2- 172.21.15.44:0/1428630923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd77c15b330 0x7fd77c0aee20 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00c6e0 tx=0x7fd76c00cba0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.361+0000 7fd78412c640 1 -- 172.21.15.44:0/1428630923 shutdown_connections 2023-11-04T01:42:58.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.361+0000 7fd78412c640 1 --2- 172.21.15.44:0/1428630923 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd76806ae70 0x7fd76806d330 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.361+0000 7fd78412c640 1 --2- 172.21.15.44:0/1428630923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd77c15b330 0x7fd77c0aee20 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.361+0000 7fd78412c640 1 --2- 172.21.15.44:0/1428630923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd77c0b2160 0x7fd77c0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.361+0000 7fd78412c640 1 --2- 172.21.15.44:0/1428630923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd77c06ca60 0x7fd77c0c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.361+0000 7fd78412c640 1 -- 172.21.15.44:0/1428630923 >> 172.21.15.44:0/1428630923 conn(0x7fd77c0b1640 msgr2=0x7fd77c1580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:58.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.361+0000 7fd78412c640 1 -- 172.21.15.44:0/1428630923 shutdown_connections 2023-11-04T01:42:58.364 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:58.361+0000 7fd78412c640 1 -- 172.21.15.44:0/1428630923 wait complete. 2023-11-04T01:42:58.373 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:42:59.276 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:59.279 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:59.374 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:59.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.486+0000 7f11010d4640 1 Processor -- start 2023-11-04T01:42:59.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.486+0000 7f11010d4640 1 -- start start 2023-11-04T01:42:59.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.486+0000 7f11010d4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10fc0d1be0 0x7f10fc167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.486+0000 7f11010d4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10fc0b32b0 con 0x7f10fc15d4e0 2023-11-04T01:42:59.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.486+0000 7f11010d4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10fc0cee10 con 0x7f10fc15d100 2023-11-04T01:42:59.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.486+0000 7f11010d4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc0cec20 con 0x7f10fc0d1be0 2023-11-04T01:42:59.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.486+0000 7f10f3fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f10fc15d4e0 0x7f10fc0d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52036/0 (socket says 172.21.15.44:52036) 2023-11-04T01:42:59.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10f3fff640 1 -- 172.21.15.44:0/3110867730 learned_addr learned my addr 172.21.15.44:0/3110867730 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:42:59.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fb59e640 1 --2- 172.21.15.44:0/3110867730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10fc0d1be0 0x7f10fc167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fa59c640 1 -- 172.21.15.44:0/3110867730 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623180417 0 0) 0x7f10fc0b32b0 con 0x7f10fc15d4e0 2023-11-04T01:42:59.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fa59c640 1 -- 172.21.15.44:0/3110867730 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10e8003520 con 0x7f10fc15d4e0 2023-11-04T01:42:59.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fa59c640 1 -- 172.21.15.44:0/3110867730 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3035462681 0 0) 0x7f10e8003520 con 0x7f10fc15d4e0 2023-11-04T01:42:59.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fa59c640 1 -- 172.21.15.44:0/3110867730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10fc0d1be0 msgr2=0x7f10fc167e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fa59c640 1 --2- 172.21.15.44:0/3110867730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10fc0d1be0 0x7f10fc167e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fa59c640 1 -- 172.21.15.44:0/3110867730 >> v1:172.21.15.204:6789/0 conn(0x7f10fc15d100 legacy=0x7f10fc0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fa59c640 1 -- 172.21.15.44:0/3110867730 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc0b4750 con 0x7f10fc15d4e0 2023-11-04T01:42:59.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fa59c640 1 -- 172.21.15.44:0/3110867730 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f10e4001670 con 0x7f10fc15d4e0 2023-11-04T01:42:59.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fb59e640 1 --2- 172.21.15.44:0/3110867730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10fc0d1be0 0x7f10fc167e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:59.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fa59c640 1 -- 172.21.15.44:0/3110867730 >> v1:172.21.15.44:6789/0 conn(0x7f10fc15d4e0 legacy=0x7f10fc0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fa59c640 1 --2- 172.21.15.44:0/3110867730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10e80039a0 0x7f10e8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fa59c640 1 --2- 172.21.15.44:0/3110867730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10fc0d1be0 0x7f10e80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fa59c640 1 --2- 172.21.15.44:0/3110867730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10e8004d00 0x7f10e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fa59c640 1 -- 172.21.15.44:0/3110867730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e800b980 con 0x7f10e8004d00 2023-11-04T01:42:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fa59c640 1 -- 172.21.15.44:0/3110867730 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e800bac0 con 0x7f10e80039a0 2023-11-04T01:42:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fa59c640 1 -- 172.21.15.44:0/3110867730 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e800bc80 con 0x7f10fc0d1be0 2023-11-04T01:42:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fb59e640 1 --2- 172.21.15.44:0/3110867730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10e8004d00 0x7f10e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10fad9d640 1 --2- 172.21.15.44:0/3110867730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10e80039a0 0x7f10e8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.487+0000 7f10f3fff640 1 --2- 172.21.15.44:0/3110867730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10fc0d1be0 0x7f10e80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.488+0000 7f10fb59e640 1 -- 172.21.15.44:0/3110867730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10fc0d1be0 msgr2=0x7f10e80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.488+0000 7f10fb59e640 1 --2- 172.21.15.44:0/3110867730 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10fc0d1be0 0x7f10e80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.488+0000 7f10fb59e640 1 -- 172.21.15.44:0/3110867730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10e80039a0 msgr2=0x7f10e8003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.488+0000 7f10fb59e640 1 --2- 172.21.15.44:0/3110867730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10e80039a0 0x7f10e8003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.488+0000 7f10fb59e640 1 -- 172.21.15.44:0/3110867730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f4009a70 con 0x7f10e8004d00 2023-11-04T01:42:59.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.488+0000 7f10fad9d640 1 --2- 172.21.15.44:0/3110867730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10e80039a0 0x7f10e8003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:59.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.488+0000 7f10fb59e640 1 --2- 172.21.15.44:0/3110867730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10e8004d00 0x7f10e8005180 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f10fc08c730 tx=0x7f10e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9bdedad4188f64f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.489+0000 7f10fa59c640 1 -- 172.21.15.44:0/3110867730 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f402cd30 con 0x7f10e8004d00 2023-11-04T01:42:59.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.489+0000 7f10fa59c640 1 -- 172.21.15.44:0/3110867730 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f400f040 con 0x7f10e8004d00 2023-11-04T01:42:59.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.489+0000 7f10fa59c640 1 -- 172.21.15.44:0/3110867730 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4034640 con 0x7f10e8004d00 2023-11-04T01:42:59.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.489+0000 7f11010d4640 1 -- 172.21.15.44:0/3110867730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10e8004d00 msgr2=0x7f10e8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.489+0000 7f11010d4640 1 --2- 172.21.15.44:0/3110867730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10e8004d00 0x7f10e8005180 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f10fc08c730 tx=0x7f10e80057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.489+0000 7f10fb59e640 1 -- 172.21.15.44:0/3110867730 reap_dead start 2023-11-04T01:42:59.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.489+0000 7f11010d4640 1 -- 172.21.15.44:0/3110867730 shutdown_connections 2023-11-04T01:42:59.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.489+0000 7f11010d4640 1 -- 172.21.15.44:0/3110867730 >> 172.21.15.44:0/3110867730 conn(0x7f10fc0d2ef0 msgr2=0x7f10fc0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.489+0000 7f11010d4640 1 -- 172.21.15.44:0/3110867730 shutdown_connections 2023-11-04T01:42:59.495 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.489+0000 7f11010d4640 1 -- 172.21.15.44:0/3110867730 wait complete. 2023-11-04T01:42:59.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.491+0000 7f11010d4640 1 Processor -- start 2023-11-04T01:42:59.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.491+0000 7f11010d4640 1 -- start start 2023-11-04T01:42:59.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.491+0000 7f11010d4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10e8004d00 0x7f10fc1f2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.491+0000 7f11010d4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10fc160220 0x7f10fc0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.491+0000 7f11010d4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10fc15d940 0x7f10fc15dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.491+0000 7f11010d4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc0c98a0 con 0x7f10e8004d00 2023-11-04T01:42:59.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.491+0000 7f11010d4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc15e2e0 con 0x7f10fc15d940 2023-11-04T01:42:59.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.491+0000 7f11010d4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc1e5a50 con 0x7f10fc160220 2023-11-04T01:42:59.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.491+0000 7f10fad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10e8004d00 0x7f10fc1f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.491+0000 7f10fad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10e8004d00 0x7f10fc1f2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34770/0 (socket says 172.21.15.44:34770) 2023-11-04T01:42:59.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.491+0000 7f10fad9d640 1 -- 172.21.15.44:0/260109858 learned_addr learned my addr 172.21.15.44:0/260109858 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:42:59.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.492+0000 7f10fb59e640 1 --2- 172.21.15.44:0/260109858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10fc15d940 0x7f10fc15dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.492+0000 7f10f3fff640 1 --2- 172.21.15.44:0/260109858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10fc160220 0x7f10fc0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.492+0000 7f10fad9d640 1 -- 172.21.15.44:0/260109858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10fc160220 msgr2=0x7f10fc0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.492+0000 7f10fad9d640 1 --2- 172.21.15.44:0/260109858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10fc160220 0x7f10fc0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.492+0000 7f10fad9d640 1 -- 172.21.15.44:0/260109858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10fc15d940 msgr2=0x7f10fc15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.492+0000 7f10fad9d640 1 --2- 172.21.15.44:0/260109858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10fc15d940 0x7f10fc15dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.492+0000 7f10fad9d640 1 -- 172.21.15.44:0/260109858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc1f2e60 con 0x7f10e8004d00 2023-11-04T01:42:59.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.492+0000 7f10fb59e640 1 --2- 172.21.15.44:0/260109858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10fc15d940 0x7f10fc15dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:59.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.492+0000 7f10fad9d640 1 --2- 172.21.15.44:0/260109858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10e8004d00 0x7f10fc1f2810 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00e800 tx=0x7f10ec00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.492+0000 7f10f37fe640 1 -- 172.21.15.44:0/260109858 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0050d0 con 0x7f10e8004d00 2023-11-04T01:42:59.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.492+0000 7f10f37fe640 1 -- 172.21.15.44:0/260109858 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec005230 con 0x7f10e8004d00 2023-11-04T01:42:59.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.492+0000 7f11010d4640 1 -- 172.21.15.44:0/260109858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc1f3140 con 0x7f10e8004d00 2023-11-04T01:42:59.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.492+0000 7f10f37fe640 1 -- 172.21.15.44:0/260109858 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00c6c0 con 0x7f10e8004d00 2023-11-04T01:42:59.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.492+0000 7f11010d4640 1 -- 172.21.15.44:0/260109858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc1f3700 con 0x7f10e8004d00 2023-11-04T01:42:59.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.493+0000 7f11010d4640 1 -- 172.21.15.44:0/260109858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10fc1e5c20 con 0x7f10e8004d00 2023-11-04T01:42:59.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.493+0000 7f10f37fe640 1 -- 172.21.15.44:0/260109858 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f10ec00c820 con 0x7f10e8004d00 2023-11-04T01:42:59.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.494+0000 7f10f37fe640 1 --2- 172.21.15.44:0/260109858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f10dc06aea0 0x7f10dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.494+0000 7f10f37fe640 1 -- 172.21.15.44:0/260109858 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f10ec089d00 con 0x7f10e8004d00 2023-11-04T01:42:59.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.494+0000 7f10f3fff640 1 --2- 172.21.15.44:0/260109858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f10dc06aea0 0x7f10dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.500 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.495+0000 7f10f3fff640 1 --2- 172.21.15.44:0/260109858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f10dc06aea0 0x7f10dc06d360 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f10e4001c20 tx=0x7f10e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.501 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.498+0000 7f10f37fe640 1 -- 172.21.15.44:0/260109858 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f10fc1e5c20 con 0x7f10e8004d00 2023-11-04T01:42:59.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.708+0000 7f11010d4640 1 -- 172.21.15.44:0/260109858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10fc1e5c20 con 0x7f10e8004d00 2023-11-04T01:42:59.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.709+0000 7f10f37fe640 1 -- 172.21.15.44:0/260109858 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4937 (secure 0 0 0) 0x7f10fc1e5c20 con 0x7f10e8004d00 2023-11-04T01:42:59.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:42:59.711 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":105,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:51.958250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:59.712 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 105 2023-11-04T01:42:59.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.711+0000 7f11010d4640 1 -- 172.21.15.44:0/260109858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f10dc06aea0 msgr2=0x7f10dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.711+0000 7f11010d4640 1 --2- 172.21.15.44:0/260109858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f10dc06aea0 0x7f10dc06d360 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f10e4001c20 tx=0x7f10e4009040 comp rx=0 tx=0).stop 2023-11-04T01:42:59.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.711+0000 7f11010d4640 1 -- 172.21.15.44:0/260109858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10e8004d00 msgr2=0x7f10fc1f2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.711+0000 7f11010d4640 1 --2- 172.21.15.44:0/260109858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10e8004d00 0x7f10fc1f2810 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00e800 tx=0x7f10ec00ecc0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.711+0000 7f11010d4640 1 -- 172.21.15.44:0/260109858 shutdown_connections 2023-11-04T01:42:59.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.711+0000 7f11010d4640 1 --2- 172.21.15.44:0/260109858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f10dc06aea0 0x7f10dc06d360 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.711+0000 7f11010d4640 1 --2- 172.21.15.44:0/260109858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10fc15d940 0x7f10fc15dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.711+0000 7f11010d4640 1 --2- 172.21.15.44:0/260109858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10fc160220 0x7f10fc0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.711+0000 7f11010d4640 1 --2- 172.21.15.44:0/260109858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10e8004d00 0x7f10fc1f2810 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.711+0000 7f11010d4640 1 -- 172.21.15.44:0/260109858 >> 172.21.15.44:0/260109858 conn(0x7f10fc0d2ef0 msgr2=0x7f10fc0cfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.711+0000 7f11010d4640 1 -- 172.21.15.44:0/260109858 shutdown_connections 2023-11-04T01:42:59.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:42:59.711+0000 7f11010d4640 1 -- 172.21.15.44:0/260109858 wait complete. 2023-11-04T01:42:59.724 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:43:00.725 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:00.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.841+0000 7f0bfee90640 1 Processor -- start 2023-11-04T01:43:00.843 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.841+0000 7f0bfee90640 1 -- start start 2023-11-04T01:43:00.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.842+0000 7f0bfee90640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0bf815b200 0x7f0bf80ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.844 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.842+0000 7f0bfee90640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0bf80afda0 0x7f0bf80cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.842+0000 7f0bfee90640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0bf80cd7f0 0x7f0bf80cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.842+0000 7f0bfee90640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf80cdc40 con 0x7f0bf815b200 2023-11-04T01:43:00.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.842+0000 7f0bfee90640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf80cde80 con 0x7f0bf80cd7f0 2023-11-04T01:43:00.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.842+0000 7f0bfee90640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80cf670 con 0x7f0bf80afda0 2023-11-04T01:43:00.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.842+0000 7f0bfcc2c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0bf815b200 0x7f0bf80ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.842+0000 7f0bfcc2c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0bf815b200 0x7f0bf80ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34772/0 (socket says 172.21.15.44:34772) 2023-11-04T01:43:00.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.842+0000 7f0bfcc2c640 1 -- 172.21.15.44:0/1424677152 learned_addr learned my addr 172.21.15.44:0/1424677152 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:00.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.843+0000 7f0bfd42d640 1 --2- 172.21.15.44:0/1424677152 >> v2:172.21.15.204:3300/0 conn(0x7f0bf80cd7f0 0x7f0bf80cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.843+0000 7f0bf7fff640 1 --2- 172.21.15.44:0/1424677152 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0bf80afda0 0x7f0bf80cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.843+0000 7f0bfcc2c640 1 -- 172.21.15.44:0/1424677152 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0bf80afda0 msgr2=0x7f0bf80cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:00.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.843+0000 7f0bfcc2c640 1 --2- 172.21.15.44:0/1424677152 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0bf80afda0 0x7f0bf80cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.843+0000 7f0bfcc2c640 1 -- 172.21.15.44:0/1424677152 >> v2:172.21.15.204:3300/0 conn(0x7f0bf80cd7f0 msgr2=0x7f0bf80cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:00.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.843+0000 7f0bfcc2c640 1 --2- 172.21.15.44:0/1424677152 >> v2:172.21.15.204:3300/0 conn(0x7f0bf80cd7f0 0x7f0bf80cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.843+0000 7f0bfcc2c640 1 -- 172.21.15.44:0/1424677152 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf80cf950 con 0x7f0bf815b200 2023-11-04T01:43:00.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.843+0000 7f0bfcc2c640 1 --2- 172.21.15.44:0/1424677152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf815b200 0x7f0bf80ceb30 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f0bf815ed40 tx=0x7f0be802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ddb6dd78aa3b921 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.844+0000 7f0bf77fe640 1 -- 172.21.15.44:0/1424677152 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8004230 con 0x7f0bf815b200 2023-11-04T01:43:00.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.844+0000 7f0bf77fe640 1 -- 172.21.15.44:0/1424677152 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be8004390 con 0x7f0bf815b200 2023-11-04T01:43:00.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.844+0000 7f0bf77fe640 1 -- 172.21.15.44:0/1424677152 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8003810 con 0x7f0bf815b200 2023-11-04T01:43:00.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.844+0000 7f0bfee90640 1 -- 172.21.15.44:0/1424677152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf815b200 msgr2=0x7f0bf80ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.844+0000 7f0bfee90640 1 --2- 172.21.15.44:0/1424677152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf815b200 0x7f0bf80ceb30 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f0bf815ed40 tx=0x7f0be802b860 comp rx=0 tx=0).stop 2023-11-04T01:43:00.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.844+0000 7f0bfee90640 1 -- 172.21.15.44:0/1424677152 shutdown_connections 2023-11-04T01:43:00.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.844+0000 7f0bfee90640 1 --2- 172.21.15.44:0/1424677152 >> v2:172.21.15.204:3300/0 conn(0x7f0bf80cd7f0 0x7f0bf80cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.844+0000 7f0bfee90640 1 --2- 172.21.15.44:0/1424677152 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0bf80afda0 0x7f0bf80cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.844+0000 7f0bfee90640 1 --2- 172.21.15.44:0/1424677152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf815b200 0x7f0bf80ceb30 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.844+0000 7f0bfee90640 1 -- 172.21.15.44:0/1424677152 >> 172.21.15.44:0/1424677152 conn(0x7f0bf80d0c30 msgr2=0x7f0bf80d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:00.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.844+0000 7f0bfee90640 1 -- 172.21.15.44:0/1424677152 shutdown_connections 2023-11-04T01:43:00.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.844+0000 7f0bfee90640 1 -- 172.21.15.44:0/1424677152 wait complete. 2023-11-04T01:43:00.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.845+0000 7f0bfee90640 1 Processor -- start 2023-11-04T01:43:00.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.845+0000 7f0bfee90640 1 -- start start 2023-11-04T01:43:00.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.846+0000 7f0bfee90640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0bf80afda0 0x7f0bf815e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.846+0000 7f0bfee90640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0bf80cd7f0 0x7f0bf815c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.846+0000 7f0bfee90640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf815b200 0x7f0bf80ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.846+0000 7f0bfee90640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf81f3480 con 0x7f0bf815b200 2023-11-04T01:43:00.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.846+0000 7f0bfee90640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf815bb50 con 0x7f0bf80afda0 2023-11-04T01:43:00.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.846+0000 7f0bfee90640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf81f2e30 con 0x7f0bf80cd7f0 2023-11-04T01:43:00.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.846+0000 7f0bfd42d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf815b200 0x7f0bf80ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bfd42d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf815b200 0x7f0bf80ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34774/0 (socket says 172.21.15.44:34774) 2023-11-04T01:43:00.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bfd42d640 1 -- 172.21.15.44:0/4090546418 learned_addr learned my addr 172.21.15.44:0/4090546418 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:00.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bfcc2c640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0bf80afda0 0x7f0bf815e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bf7fff640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0bf80cd7f0 0x7f0bf815c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bfd42d640 1 -- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0bf80cd7f0 msgr2=0x7f0bf815c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bfd42d640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0bf80cd7f0 0x7f0bf815c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bfd42d640 1 -- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0bf80afda0 msgr2=0x7f0bf815e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bfd42d640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0bf80afda0 0x7f0bf815e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bfd42d640 1 -- 172.21.15.44:0/4090546418 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be8009460 con 0x7f0bf815b200 2023-11-04T01:43:00.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bfcc2c640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0bf80afda0 0x7f0bf815e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:00.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bf7fff640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0bf80cd7f0 0x7f0bf815c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:00.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bfd42d640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf815b200 0x7f0bf80ae0b0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0007e40 tx=0x7f0bf000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bf57fa640 1 -- 172.21.15.44:0/4090546418 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0014620 con 0x7f0bf815b200 2023-11-04T01:43:00.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bf57fa640 1 -- 172.21.15.44:0/4090546418 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf000ee90 con 0x7f0bf815b200 2023-11-04T01:43:00.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bf57fa640 1 -- 172.21.15.44:0/4090546418 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf00149e0 con 0x7f0bf815b200 2023-11-04T01:43:00.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.847+0000 7f0bfee90640 1 -- 172.21.15.44:0/4090546418 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf81f3110 con 0x7f0bf815b200 2023-11-04T01:43:00.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.848+0000 7f0bfee90640 1 -- 172.21.15.44:0/4090546418 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf81f2a80 con 0x7f0bf815b200 2023-11-04T01:43:00.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.849+0000 7f0bfee90640 1 -- 172.21.15.44:0/4090546418 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf81f35f0 con 0x7f0bf815b200 2023-11-04T01:43:00.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.849+0000 7f0bf57fa640 1 -- 172.21.15.44:0/4090546418 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0bf0014b40 con 0x7f0bf815b200 2023-11-04T01:43:00.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.849+0000 7f0bf57fa640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0be406ae70 0x7f0be406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.850+0000 7f0bf57fa640 1 -- 172.21.15.44:0/4090546418 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f0bf008a870 con 0x7f0bf815b200 2023-11-04T01:43:00.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.850+0000 7f0bfcc2c640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0be406ae70 0x7f0be406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.850+0000 7f0bfcc2c640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0be406ae70 0x7f0be406d330 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0be8034000 tx=0x7f0be8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:00.854+0000 7f0bf57fa640 1 -- 172.21.15.44:0/4090546418 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0bf0055070 con 0x7f0bf815b200 2023-11-04T01:43:01.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:01.066+0000 7f0bfee90640 1 -- 172.21.15.44:0/4090546418 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bf80684b0 con 0x7f0bf815b200 2023-11-04T01:43:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:01.067+0000 7f0bf57fa640 1 -- 172.21.15.44:0/4090546418 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4931 (secure 0 0 0) 0x7f0bf0058690 con 0x7f0bf815b200 2023-11-04T01:43:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:01.069 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:42:59.277284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:01.070 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 106 2023-11-04T01:43:01.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:01.069+0000 7f0bfee90640 1 -- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0be406ae70 msgr2=0x7f0be406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:01.069+0000 7f0bfee90640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0be406ae70 0x7f0be406d330 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0be8034000 tx=0x7f0be8008030 comp rx=0 tx=0).stop 2023-11-04T01:43:01.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:01.069+0000 7f0bfee90640 1 -- 172.21.15.44:0/4090546418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf815b200 msgr2=0x7f0bf80ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:01.069+0000 7f0bfee90640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf815b200 0x7f0bf80ae0b0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0007e40 tx=0x7f0bf000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:01.069+0000 7f0bfee90640 1 -- 172.21.15.44:0/4090546418 shutdown_connections 2023-11-04T01:43:01.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:01.069+0000 7f0bfee90640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f0be406ae70 0x7f0be406d330 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:01.069+0000 7f0bfee90640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf815b200 0x7f0bf80ae0b0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:01.069+0000 7f0bfee90640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0bf80cd7f0 0x7f0bf815c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:01.069+0000 7f0bfee90640 1 --2- 172.21.15.44:0/4090546418 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0bf80afda0 0x7f0bf815e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:01.069+0000 7f0bfee90640 1 -- 172.21.15.44:0/4090546418 >> 172.21.15.44:0/4090546418 conn(0x7f0bf80d0c30 msgr2=0x7f0bf80b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:01.069+0000 7f0bfee90640 1 -- 172.21.15.44:0/4090546418 shutdown_connections 2023-11-04T01:43:01.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:01.069+0000 7f0bfee90640 1 -- 172.21.15.44:0/4090546418 wait complete. 2023-11-04T01:43:01.081 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:rejoin 2023-11-04T01:43:02.083 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:02.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.199+0000 7fa7b39e2640 1 Processor -- start 2023-11-04T01:43:02.201 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.199+0000 7fa7b39e2640 1 -- start start 2023-11-04T01:43:02.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.200+0000 7fa7b39e2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7ac15d630 0x7fa7ac0cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.200+0000 7fa7b39e2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ac0b0150 con 0x7fa7ac0b2210 2023-11-04T01:43:02.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.200+0000 7fa7b39e2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ac0b1170 con 0x7fa7ac0ceda0 2023-11-04T01:43:02.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.200+0000 7fa7b39e2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0b1df0 con 0x7fa7ac15d630 2023-11-04T01:43:02.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.200+0000 7fa7b0f7d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa7ac0b2210 0x7fa7ac0cf180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52040/0 (socket says 172.21.15.44:52040) 2023-11-04T01:43:02.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.200+0000 7fa7b0f7d640 1 -- 172.21.15.44:0/367383391 learned_addr learned my addr 172.21.15.44:0/367383391 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:02.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.200+0000 7fa7a3fff640 1 -- 172.21.15.44:0/367383391 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180345275 0 0) 0x7fa7ac0b0150 con 0x7fa7ac0b2210 2023-11-04T01:43:02.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.200+0000 7fa7a3fff640 1 -- 172.21.15.44:0/367383391 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa798003520 con 0x7fa7ac0b2210 2023-11-04T01:43:02.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7b1f7f640 1 --2- 172.21.15.44:0/367383391 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7ac15d630 0x7fa7ac0cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7a3fff640 1 -- 172.21.15.44:0/367383391 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2188595199 0 0) 0x7fa798003520 con 0x7fa7ac0b2210 2023-11-04T01:43:02.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7a3fff640 1 -- 172.21.15.44:0/367383391 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7ac15d630 msgr2=0x7fa7ac0cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:02.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7a3fff640 1 --2- 172.21.15.44:0/367383391 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7ac15d630 0x7fa7ac0cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7a3fff640 1 -- 172.21.15.44:0/367383391 >> v1:172.21.15.204:6789/0 conn(0x7fa7ac0ceda0 legacy=0x7fa7ac15cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7a3fff640 1 -- 172.21.15.44:0/367383391 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac0b1450 con 0x7fa7ac0b2210 2023-11-04T01:43:02.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7a3fff640 1 -- 172.21.15.44:0/367383391 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fa79c001670 con 0x7fa7ac0b2210 2023-11-04T01:43:02.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7a3fff640 1 -- 172.21.15.44:0/367383391 >> v1:172.21.15.44:6789/0 conn(0x7fa7ac0b2210 legacy=0x7fa7ac0cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7a3fff640 1 --2- 172.21.15.44:0/367383391 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7980039a0 0x7fa798003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7a3fff640 1 --2- 172.21.15.44:0/367383391 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7ac15d630 0x7fa7980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7a3fff640 1 --2- 172.21.15.44:0/367383391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa798004d50 0x7fa7980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7a3fff640 1 -- 172.21.15.44:0/367383391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0b1df0 con 0x7fa798004d50 2023-11-04T01:43:02.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7a3fff640 1 -- 172.21.15.44:0/367383391 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79800bc00 con 0x7fa7980039a0 2023-11-04T01:43:02.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7a3fff640 1 -- 172.21.15.44:0/367383391 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79800bdc0 con 0x7fa7ac15d630 2023-11-04T01:43:02.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7b1f7f640 1 --2- 172.21.15.44:0/367383391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa798004d50 0x7fa7980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7b0f7d640 1 --2- 172.21.15.44:0/367383391 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7ac15d630 0x7fa7980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7b177e640 1 --2- 172.21.15.44:0/367383391 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7980039a0 0x7fa798003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7b1f7f640 1 -- 172.21.15.44:0/367383391 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7ac15d630 msgr2=0x7fa7980047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:02.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7b1f7f640 1 --2- 172.21.15.44:0/367383391 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7ac15d630 0x7fa7980047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7b1f7f640 1 -- 172.21.15.44:0/367383391 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7980039a0 msgr2=0x7fa798003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:02.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7b1f7f640 1 --2- 172.21.15.44:0/367383391 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7980039a0 0x7fa798003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.201+0000 7fa7b1f7f640 1 -- 172.21.15.44:0/367383391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa798003520 con 0x7fa798004d50 2023-11-04T01:43:02.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.202+0000 7fa7b1f7f640 1 --2- 172.21.15.44:0/367383391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa798004d50 0x7fa7980051d0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4007330 tx=0x7fa7980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5877772fb4876538 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.202+0000 7fa7a3fff640 1 -- 172.21.15.44:0/367383391 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a402cc70 con 0x7fa798004d50 2023-11-04T01:43:02.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.202+0000 7fa7a3fff640 1 -- 172.21.15.44:0/367383391 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a402cdd0 con 0x7fa798004d50 2023-11-04T01:43:02.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.202+0000 7fa7a3fff640 1 -- 172.21.15.44:0/367383391 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4034660 con 0x7fa798004d50 2023-11-04T01:43:02.210 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.203+0000 7fa7b39e2640 1 -- 172.21.15.44:0/367383391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa798004d50 msgr2=0x7fa7980051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.203+0000 7fa7b39e2640 1 --2- 172.21.15.44:0/367383391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa798004d50 0x7fa7980051d0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4007330 tx=0x7fa7980057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.203+0000 7fa7b1f7f640 1 -- 172.21.15.44:0/367383391 reap_dead start 2023-11-04T01:43:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.203+0000 7fa7b39e2640 1 -- 172.21.15.44:0/367383391 shutdown_connections 2023-11-04T01:43:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.203+0000 7fa7b39e2640 1 -- 172.21.15.44:0/367383391 >> 172.21.15.44:0/367383391 conn(0x7fa7ac0d0c30 msgr2=0x7fa7ac0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.203+0000 7fa7b39e2640 1 -- 172.21.15.44:0/367383391 shutdown_connections 2023-11-04T01:43:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.203+0000 7fa7b39e2640 1 -- 172.21.15.44:0/367383391 wait complete. 2023-11-04T01:43:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.204+0000 7fa7b39e2640 1 Processor -- start 2023-11-04T01:43:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.204+0000 7fa7b39e2640 1 -- start start 2023-11-04T01:43:02.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b39e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa798004d50 0x7fa7ac0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b39e2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7ac1e76e0 0x7fa7ac0b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b39e2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7ac1e52c0 0x7fa7ac0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b39e2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac1e57c0 con 0x7fa798004d50 2023-11-04T01:43:02.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b39e2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac1f2c50 con 0x7fa7ac1e52c0 2023-11-04T01:43:02.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b39e2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac1f2f30 con 0x7fa7ac1e76e0 2023-11-04T01:43:02.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b177e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa798004d50 0x7fa7ac0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b177e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa798004d50 0x7fa7ac0c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34788/0 (socket says 172.21.15.44:34788) 2023-11-04T01:43:02.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b177e640 1 -- 172.21.15.44:0/2130361639 learned_addr learned my addr 172.21.15.44:0/2130361639 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:02.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b1f7f640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7ac1e52c0 0x7fa7ac0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b0f7d640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7ac1e76e0 0x7fa7ac0b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b177e640 1 -- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7ac1e76e0 msgr2=0x7fa7ac0b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b177e640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7ac1e76e0 0x7fa7ac0b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b177e640 1 -- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7ac1e52c0 msgr2=0x7fa7ac0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b177e640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7ac1e52c0 0x7fa7ac0b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b177e640 1 -- 172.21.15.44:0/2130361639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac1f3210 con 0x7fa798004d50 2023-11-04T01:43:02.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b1f7f640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7ac1e52c0 0x7fa7ac0b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:02.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.205+0000 7fa7b0f7d640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7ac1e76e0 0x7fa7ac0b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:02.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.206+0000 7fa7b177e640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa798004d50 0x7fa7ac0c9460 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800f820 tx=0x7fa7a800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.206+0000 7fa7a1ffb640 1 -- 172.21.15.44:0/2130361639 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a80050d0 con 0x7fa798004d50 2023-11-04T01:43:02.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.206+0000 7fa7a1ffb640 1 -- 172.21.15.44:0/2130361639 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a8005230 con 0x7fa798004d50 2023-11-04T01:43:02.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.206+0000 7fa7a1ffb640 1 -- 172.21.15.44:0/2130361639 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a800d730 con 0x7fa798004d50 2023-11-04T01:43:02.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.206+0000 7fa7b39e2640 1 -- 172.21.15.44:0/2130361639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ac1f34f0 con 0x7fa798004d50 2023-11-04T01:43:02.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.206+0000 7fa7b39e2640 1 -- 172.21.15.44:0/2130361639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ac1f3bf0 con 0x7fa798004d50 2023-11-04T01:43:02.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.207+0000 7fa7b39e2640 1 -- 172.21.15.44:0/2130361639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ac1f3680 con 0x7fa798004d50 2023-11-04T01:43:02.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.208+0000 7fa7a1ffb640 1 -- 172.21.15.44:0/2130361639 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa7a800d890 con 0x7fa798004d50 2023-11-04T01:43:02.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.208+0000 7fa7a1ffb640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa79006ae70 0x7fa79006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.208+0000 7fa7a1ffb640 1 -- 172.21.15.44:0/2130361639 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7fa7a8089de0 con 0x7fa798004d50 2023-11-04T01:43:02.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.208+0000 7fa7b0f7d640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa79006ae70 0x7fa79006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.209+0000 7fa7b0f7d640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa79006ae70 0x7fa79006d330 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0010e0 tx=0x7fa79c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.212+0000 7fa7a1ffb640 1 -- 172.21.15.44:0/2130361639 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7a8054670 con 0x7fa798004d50 2023-11-04T01:43:02.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.426+0000 7fa7b39e2640 1 -- 172.21.15.44:0/2130361639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7ac0684b0 con 0x7fa798004d50 2023-11-04T01:43:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.426+0000 7fa7a1ffb640 1 -- 172.21.15.44:0/2130361639 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4931 (secure 0 0 0) 0x7fa7a8057c90 con 0x7fa798004d50 2023-11-04T01:43:02.428 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:02.428 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":107,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:00.261316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:02.429 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 107 2023-11-04T01:43:02.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.428+0000 7fa7b39e2640 1 -- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa79006ae70 msgr2=0x7fa79006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.428+0000 7fa7b39e2640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa79006ae70 0x7fa79006d330 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0010e0 tx=0x7fa79c009040 comp rx=0 tx=0).stop 2023-11-04T01:43:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.428+0000 7fa7b39e2640 1 -- 172.21.15.44:0/2130361639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa798004d50 msgr2=0x7fa7ac0c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.428+0000 7fa7b39e2640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa798004d50 0x7fa7ac0c9460 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800f820 tx=0x7fa7a800fce0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.428+0000 7fa7b39e2640 1 -- 172.21.15.44:0/2130361639 shutdown_connections 2023-11-04T01:43:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.428+0000 7fa7b39e2640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa79006ae70 0x7fa79006d330 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.428+0000 7fa7b39e2640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7ac1e52c0 0x7fa7ac0b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.428+0000 7fa7b39e2640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7ac1e76e0 0x7fa7ac0b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.428+0000 7fa7b39e2640 1 --2- 172.21.15.44:0/2130361639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa798004d50 0x7fa7ac0c9460 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.428+0000 7fa7b39e2640 1 -- 172.21.15.44:0/2130361639 >> 172.21.15.44:0/2130361639 conn(0x7fa7ac0d0c30 msgr2=0x7fa7ac15c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.428+0000 7fa7b39e2640 1 -- 172.21.15.44:0/2130361639 shutdown_connections 2023-11-04T01:43:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.428+0000 7fa7b39e2640 1 -- 172.21.15.44:0/2130361639 wait complete. 2023-11-04T01:43:02.440 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:43:02.440 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.768502712249756s 2023-11-04T01:43:02.441 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:02.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.546+0000 7fe8d6b6c640 1 Processor -- start 2023-11-04T01:43:02.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.546+0000 7fe8d6b6c640 1 -- start start 2023-11-04T01:43:02.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.546+0000 7fe8d6b6c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015d1b0 0x7fe8d00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.546+0000 7fe8d6b6c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe8d006c240 0x7fe8d00b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.546+0000 7fe8d6b6c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d00b2310 con 0x7fe8d006c6a0 2023-11-04T01:43:02.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.546+0000 7fe8d6b6c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d006cbe0 con 0x7fe8d006c240 2023-11-04T01:43:02.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.546+0000 7fe8d6b6c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00b2100 con 0x7fe8d015d1b0 2023-11-04T01:43:02.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.547+0000 7fe8cffff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe8d006c240 0x7fe8d00b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.547+0000 7fe8d4908640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015d1b0 0x7fe8d00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.547+0000 7fe8cffff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe8d006c240 0x7fe8d00b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:40612/0 (socket says 172.21.15.44:40612) 2023-11-04T01:43:02.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.547+0000 7fe8cffff640 1 -- 172.21.15.44:0/324893787 learned_addr learned my addr 172.21.15.44:0/324893787 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:02.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.547+0000 7fe8cffff640 1 -- 172.21.15.44:0/324893787 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015d1b0 msgr2=0x7fe8d00b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:02.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.547+0000 7fe8cffff640 1 --2- 172.21.15.44:0/324893787 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015d1b0 0x7fe8d00b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.547+0000 7fe8cffff640 1 -- 172.21.15.44:0/324893787 >> v1:172.21.15.204:6789/0 conn(0x7fe8d006c6a0 legacy=0x7fe8d006a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.547+0000 7fe8cf7fe640 1 -- 172.21.15.44:0/324893787 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754081985 0 0) 0x7fe8d00b2310 con 0x7fe8d006c6a0 2023-11-04T01:43:02.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.547+0000 7fe8cffff640 1 -- 172.21.15.44:0/324893787 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d00b25f0 con 0x7fe8d006c240 2023-11-04T01:43:02.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.548+0000 7fe8cffff640 1 --2- 172.21.15.44:0/324893787 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8d006c240 0x7fe8d00b0d30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009870 tx=0x7fe8bc02ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fd669766bf28210 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.548+0000 7fe8cf7fe640 1 -- 172.21.15.44:0/324893787 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc02f840 con 0x7fe8d006c240 2023-11-04T01:43:02.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.548+0000 7fe8cf7fe640 1 -- 172.21.15.44:0/324893787 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8bc02f9a0 con 0x7fe8d006c240 2023-11-04T01:43:02.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.548+0000 7fe8cf7fe640 1 -- 172.21.15.44:0/324893787 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc02fd30 con 0x7fe8d006c240 2023-11-04T01:43:02.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.549+0000 7fe8d6b6c640 1 -- 172.21.15.44:0/324893787 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8d006c240 msgr2=0x7fe8d00b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.549+0000 7fe8d6b6c640 1 --2- 172.21.15.44:0/324893787 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8d006c240 0x7fe8d00b0d30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009870 tx=0x7fe8bc02ba20 comp rx=0 tx=0).stop 2023-11-04T01:43:02.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.549+0000 7fe8d6b6c640 1 -- 172.21.15.44:0/324893787 shutdown_connections 2023-11-04T01:43:02.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.549+0000 7fe8d6b6c640 1 --2- 172.21.15.44:0/324893787 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8d006c240 0x7fe8d00b0d30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.549+0000 7fe8d6b6c640 1 --2- 172.21.15.44:0/324893787 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015d1b0 0x7fe8d00b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.549+0000 7fe8d6b6c640 1 -- 172.21.15.44:0/324893787 >> 172.21.15.44:0/324893787 conn(0x7fe8d00cbd30 msgr2=0x7fe8d00cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.549+0000 7fe8d6b6c640 1 -- 172.21.15.44:0/324893787 shutdown_connections 2023-11-04T01:43:02.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.549+0000 7fe8d6b6c640 1 -- 172.21.15.44:0/324893787 wait complete. 2023-11-04T01:43:02.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.550+0000 7fe8d6b6c640 1 Processor -- start 2023-11-04T01:43:02.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.550+0000 7fe8d6b6c640 1 -- start start 2023-11-04T01:43:02.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8d6b6c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8d006c240 0x7fe8d009c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8d6b6c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8d006c6a0 0x7fe8d015b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8d6b6c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015d1b0 0x7fe8d009b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8d6b6c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d01f6320 con 0x7fe8d006c6a0 2023-11-04T01:43:02.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8d6b6c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d01f6600 con 0x7fe8d006c240 2023-11-04T01:43:02.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8d6b6c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d01f68e0 con 0x7fe8d015d1b0 2023-11-04T01:43:02.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8cffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8d006c6a0 0x7fe8d015b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8cffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8d006c6a0 0x7fe8d015b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44424/0 (socket says 172.21.15.44:44424) 2023-11-04T01:43:02.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8cffff640 1 -- 172.21.15.44:0/3972188005 learned_addr learned my addr 172.21.15.44:0/3972188005 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:02.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8d4908640 1 --2- 172.21.15.44:0/3972188005 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8d006c240 0x7fe8d009c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.555 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8d5109640 1 --2- 172.21.15.44:0/3972188005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015d1b0 0x7fe8d009b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8cffff640 1 -- 172.21.15.44:0/3972188005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015d1b0 msgr2=0x7fe8d009b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8cffff640 1 --2- 172.21.15.44:0/3972188005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015d1b0 0x7fe8d009b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8cffff640 1 -- 172.21.15.44:0/3972188005 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8d006c240 msgr2=0x7fe8d009c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8cffff640 1 --2- 172.21.15.44:0/3972188005 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8d006c240 0x7fe8d009c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8cffff640 1 -- 172.21.15.44:0/3972188005 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc0094d0 con 0x7fe8d006c6a0 2023-11-04T01:43:02.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.551+0000 7fe8d5109640 1 --2- 172.21.15.44:0/3972188005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015d1b0 0x7fe8d009b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:02.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.552+0000 7fe8cffff640 1 --2- 172.21.15.44:0/3972188005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8d006c6a0 0x7fe8d015b550 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0090b0 tx=0x7fe8bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.552+0000 7fe8cd7fa640 1 -- 172.21.15.44:0/3972188005 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc03b040 con 0x7fe8d006c6a0 2023-11-04T01:43:02.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.552+0000 7fe8cd7fa640 1 -- 172.21.15.44:0/3972188005 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8bc037c60 con 0x7fe8d006c6a0 2023-11-04T01:43:02.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.552+0000 7fe8d6b6c640 1 -- 172.21.15.44:0/3972188005 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d01f6bc0 con 0x7fe8d006c6a0 2023-11-04T01:43:02.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.552+0000 7fe8cd7fa640 1 -- 172.21.15.44:0/3972188005 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc004030 con 0x7fe8d006c6a0 2023-11-04T01:43:02.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.552+0000 7fe8d6b6c640 1 -- 172.21.15.44:0/3972188005 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d01e6350 con 0x7fe8d006c6a0 2023-11-04T01:43:02.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.553+0000 7fe8d6b6c640 1 -- 172.21.15.44:0/3972188005 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d01f70e0 con 0x7fe8d006c6a0 2023-11-04T01:43:02.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.553+0000 7fe8cd7fa640 1 -- 172.21.15.44:0/3972188005 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe8bc004190 con 0x7fe8d006c6a0 2023-11-04T01:43:02.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.554+0000 7fe8cd7fa640 1 --2- 172.21.15.44:0/3972188005 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe8b406ae70 0x7fe8b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.554+0000 7fe8cd7fa640 1 -- 172.21.15.44:0/3972188005 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7fe8bc0acd40 con 0x7fe8d006c6a0 2023-11-04T01:43:02.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.554+0000 7fe8d4908640 1 --2- 172.21.15.44:0/3972188005 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe8b406ae70 0x7fe8b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.555+0000 7fe8d4908640 1 --2- 172.21.15.44:0/3972188005 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe8b406ae70 0x7fe8b406d330 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009ac0 tx=0x7fe8c4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.558+0000 7fe8cd7fa640 1 -- 172.21.15.44:0/3972188005 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe8bc0775c0 con 0x7fe8d006c6a0 2023-11-04T01:43:02.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.770+0000 7fe8d6b6c640 1 -- 172.21.15.44:0/3972188005 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8d0066600 con 0x7fe8d006c6a0 2023-11-04T01:43:02.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.771+0000 7fe8cd7fa640 1 -- 172.21.15.44:0/3972188005 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4931 (secure 0 0 0) 0x7fe8bc07abe0 con 0x7fe8d006c6a0 2023-11-04T01:43:02.773 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:02.773 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":107,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:00.261316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:02.773 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 107 2023-11-04T01:43:02.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.773+0000 7fe8d6b6c640 1 -- 172.21.15.44:0/3972188005 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe8b406ae70 msgr2=0x7fe8b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.773+0000 7fe8d6b6c640 1 --2- 172.21.15.44:0/3972188005 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe8b406ae70 0x7fe8b406d330 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009ac0 tx=0x7fe8c4008040 comp rx=0 tx=0).stop 2023-11-04T01:43:02.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.773+0000 7fe8d6b6c640 1 -- 172.21.15.44:0/3972188005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8d006c6a0 msgr2=0x7fe8d015b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.773+0000 7fe8d6b6c640 1 --2- 172.21.15.44:0/3972188005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8d006c6a0 0x7fe8d015b550 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0090b0 tx=0x7fe8bc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.773+0000 7fe8d6b6c640 1 -- 172.21.15.44:0/3972188005 shutdown_connections 2023-11-04T01:43:02.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.773+0000 7fe8d6b6c640 1 --2- 172.21.15.44:0/3972188005 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fe8b406ae70 0x7fe8b406d330 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.773+0000 7fe8d6b6c640 1 --2- 172.21.15.44:0/3972188005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8d015d1b0 0x7fe8d009b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.773+0000 7fe8d6b6c640 1 --2- 172.21.15.44:0/3972188005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8d006c6a0 0x7fe8d015b550 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.773+0000 7fe8d6b6c640 1 --2- 172.21.15.44:0/3972188005 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8d006c240 0x7fe8d009c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.773+0000 7fe8d6b6c640 1 -- 172.21.15.44:0/3972188005 >> 172.21.15.44:0/3972188005 conn(0x7fe8d00cbd30 msgr2=0x7fe8d00abf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.773+0000 7fe8d6b6c640 1 -- 172.21.15.44:0/3972188005 shutdown_connections 2023-11-04T01:43:02.776 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:02.773+0000 7fe8d6b6c640 1 -- 172.21.15.44:0/3972188005 wait complete. 2023-11-04T01:43:02.786 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:43:02.870 INFO:tasks.ceph.mds.c.smithi044.stderr:2023-11-04T01:43:02.868+0000 7f642d095640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:02.870 INFO:tasks.ceph.mds.c.smithi044.stderr:2023-11-04T01:43:02.868+0000 7f642d095640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:43:02.907 INFO:teuthology.orchestra.run.smithi044.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:26.455117+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:43:02.907 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:26.455117+0000" } ] } 2023-11-04T01:43:02.907 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:43:02.908 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:03.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.011+0000 7f8c8b3a9640 1 Processor -- start 2023-11-04T01:43:03.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.012+0000 7f8c8b3a9640 1 -- start start 2023-11-04T01:43:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.012+0000 7f8c8b3a9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8c8415d4e0 0x7f8c840d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.012+0000 7f8c8b3a9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c840b32b0 con 0x7f8c840d3b60 2023-11-04T01:43:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.012+0000 7f8c8b3a9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c840cee10 con 0x7f8c8415d100 2023-11-04T01:43:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.012+0000 7f8c8b3a9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c840cec20 con 0x7f8c8415d4e0 2023-11-04T01:43:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c89946640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8c840d3b60 0x7f8c840b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59972/0 (socket says 172.21.15.44:59972) 2023-11-04T01:43:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c89946640 1 -- 172.21.15.44:0/261350836 learned_addr learned my addr 172.21.15.44:0/261350836 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c88944640 1 --2- 172.21.15.44:0/261350836 >> v2:172.21.15.204:3300/0 conn(0x7f8c8415d4e0 0x7f8c840d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c83fff640 1 -- 172.21.15.44:0/261350836 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423577 0 0) 0x7f8c840b32b0 con 0x7f8c840d3b60 2023-11-04T01:43:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c83fff640 1 -- 172.21.15.44:0/261350836 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c6c003520 con 0x7f8c840d3b60 2023-11-04T01:43:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c83fff640 1 -- 172.21.15.44:0/261350836 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2863755437 0 0) 0x7f8c6c003520 con 0x7f8c840d3b60 2023-11-04T01:43:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c83fff640 1 -- 172.21.15.44:0/261350836 >> v2:172.21.15.204:3300/0 conn(0x7f8c8415d4e0 msgr2=0x7f8c840d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c83fff640 1 --2- 172.21.15.44:0/261350836 >> v2:172.21.15.204:3300/0 conn(0x7f8c8415d4e0 0x7f8c840d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c83fff640 1 -- 172.21.15.44:0/261350836 >> v1:172.21.15.204:6789/0 conn(0x7f8c8415d100 legacy=0x7f8c840ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c83fff640 1 -- 172.21.15.44:0/261350836 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c840b2980 con 0x7f8c840d3b60 2023-11-04T01:43:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c83fff640 1 -- 172.21.15.44:0/261350836 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f8c740019f0 con 0x7f8c840d3b60 2023-11-04T01:43:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c83fff640 1 -- 172.21.15.44:0/261350836 >> v1:172.21.15.44:6789/0 conn(0x7f8c840d3b60 legacy=0x7f8c840b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c83fff640 1 --2- 172.21.15.44:0/261350836 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c6c003970 0x7f8c6c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c83fff640 1 --2- 172.21.15.44:0/261350836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c6c0047c0 0x7f8c6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c83fff640 1 --2- 172.21.15.44:0/261350836 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c6c005180 0x7f8c6c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c83fff640 1 -- 172.21.15.44:0/261350836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c00bff0 con 0x7f8c6c0047c0 2023-11-04T01:43:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c83fff640 1 -- 172.21.15.44:0/261350836 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c00c160 con 0x7f8c6c003970 2023-11-04T01:43:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c83fff640 1 -- 172.21.15.44:0/261350836 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c00c320 con 0x7f8c6c005180 2023-11-04T01:43:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c88944640 1 --2- 172.21.15.44:0/261350836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c6c0047c0 0x7f8c6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.013+0000 7f8c89145640 1 --2- 172.21.15.44:0/261350836 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c6c003970 0x7f8c6c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.014+0000 7f8c89946640 1 --2- 172.21.15.44:0/261350836 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c6c005180 0x7f8c6c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.014+0000 7f8c88944640 1 -- 172.21.15.44:0/261350836 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c6c005180 msgr2=0x7f8c6c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.014+0000 7f8c88944640 1 --2- 172.21.15.44:0/261350836 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c6c005180 0x7f8c6c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.014+0000 7f8c88944640 1 -- 172.21.15.44:0/261350836 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c6c003970 msgr2=0x7f8c6c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.014+0000 7f8c88944640 1 --2- 172.21.15.44:0/261350836 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c6c003970 0x7f8c6c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.014+0000 7f8c88944640 1 -- 172.21.15.44:0/261350836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c003520 con 0x7f8c6c0047c0 2023-11-04T01:43:03.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.014+0000 7f8c89946640 1 -- 172.21.15.44:0/261350836 reap_dead start 2023-11-04T01:43:03.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.014+0000 7f8c88944640 1 --2- 172.21.15.44:0/261350836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c6c0047c0 0x7f8c6c004c40 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009a90 tx=0x7f8c6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a110bb891ed00301 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.015+0000 7f8c83fff640 1 -- 172.21.15.44:0/261350836 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7802c6b0 con 0x7f8c6c0047c0 2023-11-04T01:43:03.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.015+0000 7f8c83fff640 1 -- 172.21.15.44:0/261350836 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7802c810 con 0x7f8c6c0047c0 2023-11-04T01:43:03.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.015+0000 7f8c83fff640 1 -- 172.21.15.44:0/261350836 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7802cba0 con 0x7f8c6c0047c0 2023-11-04T01:43:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.015+0000 7f8c8b3a9640 1 -- 172.21.15.44:0/261350836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c6c0047c0 msgr2=0x7f8c6c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.015+0000 7f8c8b3a9640 1 --2- 172.21.15.44:0/261350836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c6c0047c0 0x7f8c6c004c40 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009a90 tx=0x7f8c6c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.015+0000 7f8c8b3a9640 1 -- 172.21.15.44:0/261350836 shutdown_connections 2023-11-04T01:43:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.015+0000 7f8c8b3a9640 1 --2- 172.21.15.44:0/261350836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c6c0047c0 0x7f8c6c004c40 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.015+0000 7f8c8b3a9640 1 -- 172.21.15.44:0/261350836 >> 172.21.15.44:0/261350836 conn(0x7f8c840d2ef0 msgr2=0x7f8c840d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.015+0000 7f8c8b3a9640 1 -- 172.21.15.44:0/261350836 shutdown_connections 2023-11-04T01:43:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.015+0000 7f8c8b3a9640 1 -- 172.21.15.44:0/261350836 wait complete. 2023-11-04T01:43:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.016+0000 7f8c8b3a9640 1 Processor -- start 2023-11-04T01:43:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.016+0000 7f8c8b3a9640 1 -- start start 2023-11-04T01:43:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.017+0000 7f8c8b3a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c6c0047c0 0x7f8c841f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.017+0000 7f8c8b3a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c8415e320 0x7f8c840cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.017+0000 7f8c8b3a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c840cc750 0x7f8c840b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.017+0000 7f8c8b3a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8415f440 con 0x7f8c840cc750 2023-11-04T01:43:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.017+0000 7f8c8b3a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8415e830 con 0x7f8c6c0047c0 2023-11-04T01:43:03.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.017+0000 7f8c8b3a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8415eb10 con 0x7f8c8415e320 2023-11-04T01:43:03.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.017+0000 7f8c89946640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c840cc750 0x7f8c840b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.017+0000 7f8c89946640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c840cc750 0x7f8c840b6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44440/0 (socket says 172.21.15.44:44440) 2023-11-04T01:43:03.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.017+0000 7f8c89946640 1 -- 172.21.15.44:0/1806620860 learned_addr learned my addr 172.21.15.44:0/1806620860 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:03.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.017+0000 7f8c88944640 1 --2- 172.21.15.44:0/1806620860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c8415e320 0x7f8c840cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.017+0000 7f8c89145640 1 --2- 172.21.15.44:0/1806620860 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c6c0047c0 0x7f8c841f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.017+0000 7f8c89946640 1 -- 172.21.15.44:0/1806620860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c8415e320 msgr2=0x7f8c840cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.017+0000 7f8c89946640 1 --2- 172.21.15.44:0/1806620860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c8415e320 0x7f8c840cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.017+0000 7f8c89946640 1 -- 172.21.15.44:0/1806620860 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c6c0047c0 msgr2=0x7f8c841f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.017+0000 7f8c89946640 1 --2- 172.21.15.44:0/1806620860 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c6c0047c0 0x7f8c841f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.018+0000 7f8c89946640 1 -- 172.21.15.44:0/1806620860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8415edf0 con 0x7f8c840cc750 2023-11-04T01:43:03.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.018+0000 7f8c88944640 1 --2- 172.21.15.44:0/1806620860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c8415e320 0x7f8c840cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:03.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.018+0000 7f8c89946640 1 --2- 172.21.15.44:0/1806620860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c840cc750 0x7f8c840b6b90 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f8c8415d8c0 tx=0x7f8c74007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.018+0000 7f8c81ffb640 1 -- 172.21.15.44:0/1806620860 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7400eb00 con 0x7f8c840cc750 2023-11-04T01:43:03.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.018+0000 7f8c81ffb640 1 -- 172.21.15.44:0/1806620860 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7400ec80 con 0x7f8c840cc750 2023-11-04T01:43:03.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.018+0000 7f8c8b3a9640 1 -- 172.21.15.44:0/1806620860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8415f0d0 con 0x7f8c840cc750 2023-11-04T01:43:03.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.018+0000 7f8c81ffb640 1 -- 172.21.15.44:0/1806620860 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74013420 con 0x7f8c840cc750 2023-11-04T01:43:03.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.018+0000 7f8c8b3a9640 1 -- 172.21.15.44:0/1806620860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c841f6030 con 0x7f8c840cc750 2023-11-04T01:43:03.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.019+0000 7f8c8b3a9640 1 -- 172.21.15.44:0/1806620860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c840684b0 con 0x7f8c840cc750 2023-11-04T01:43:03.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.019+0000 7f8c81ffb640 1 -- 172.21.15.44:0/1806620860 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c740135a0 con 0x7f8c840cc750 2023-11-04T01:43:03.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.020+0000 7f8c81ffb640 1 --2- 172.21.15.44:0/1806620860 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8c7006aea0 0x7f8c7006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.020+0000 7f8c81ffb640 1 -- 172.21.15.44:0/1806620860 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f8c7408a2c0 con 0x7f8c840cc750 2023-11-04T01:43:03.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.020+0000 7f8c89145640 1 --2- 172.21.15.44:0/1806620860 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8c7006aea0 0x7f8c7006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.020+0000 7f8c89145640 1 --2- 172.21.15.44:0/1806620860 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8c7006aea0 0x7f8c7006d360 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c000c00 tx=0x7f8c7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.024+0000 7f8c81ffb640 1 -- 172.21.15.44:0/1806620860 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8c74054ac0 con 0x7f8c840cc750 2023-11-04T01:43:03.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.239+0000 7f8c8b3a9640 1 -- 172.21.15.44:0/1806620860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c840d2cd0 con 0x7f8c840cc750 2023-11-04T01:43:03.241 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.239+0000 7f8c81ffb640 1 -- 172.21.15.44:0/1806620860 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4931 (secure 0 0 0) 0x7f8c740580e0 con 0x7f8c840cc750 2023-11-04T01:43:03.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:03.241 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":107,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:00.261316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:03.242 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 107 2023-11-04T01:43:03.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.241+0000 7f8c8b3a9640 1 -- 172.21.15.44:0/1806620860 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8c7006aea0 msgr2=0x7f8c7006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.241+0000 7f8c8b3a9640 1 --2- 172.21.15.44:0/1806620860 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8c7006aea0 0x7f8c7006d360 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c000c00 tx=0x7f8c7c009040 comp rx=0 tx=0).stop 2023-11-04T01:43:03.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.241+0000 7f8c8b3a9640 1 -- 172.21.15.44:0/1806620860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c840cc750 msgr2=0x7f8c840b6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.241+0000 7f8c8b3a9640 1 --2- 172.21.15.44:0/1806620860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c840cc750 0x7f8c840b6b90 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f8c8415d8c0 tx=0x7f8c74007bc0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.243 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.241+0000 7f8c8b3a9640 1 -- 172.21.15.44:0/1806620860 shutdown_connections 2023-11-04T01:43:03.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.241+0000 7f8c8b3a9640 1 --2- 172.21.15.44:0/1806620860 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8c7006aea0 0x7f8c7006d360 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.241+0000 7f8c8b3a9640 1 --2- 172.21.15.44:0/1806620860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c840cc750 0x7f8c840b6b90 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.241+0000 7f8c8b3a9640 1 --2- 172.21.15.44:0/1806620860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c8415e320 0x7f8c840cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.241+0000 7f8c8b3a9640 1 --2- 172.21.15.44:0/1806620860 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c6c0047c0 0x7f8c841f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.241+0000 7f8c8b3a9640 1 -- 172.21.15.44:0/1806620860 >> 172.21.15.44:0/1806620860 conn(0x7f8c840d2ef0 msgr2=0x7f8c840d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:03.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.241+0000 7f8c8b3a9640 1 -- 172.21.15.44:0/1806620860 shutdown_connections 2023-11-04T01:43:03.244 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.241+0000 7f8c8b3a9640 1 -- 172.21.15.44:0/1806620860 wait complete. 2023-11-04T01:43:03.254 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:43:03.374 INFO:teuthology.orchestra.run.smithi044.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:26.455117+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:43:03.375 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:26.455117+0000" } ] } 2023-11-04T01:43:03.375 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:03.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:03.375 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2023-11-04T01:43:03.406 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:43:03.406 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:03.461 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:03.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.605+0000 7f75adabb640 1 Processor -- start 2023-11-04T01:43:03.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.605+0000 7f75adabb640 1 -- start start 2023-11-04T01:43:03.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.606+0000 7f75adabb640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f75a815d100 0x7f75a80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.606+0000 7f75adabb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75a815d4e0 0x7f75a80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.606+0000 7f75adabb640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f75a80d3b60 0x7f75a80d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.606+0000 7f75adabb640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a80b32b0 con 0x7f75a815d100 2023-11-04T01:43:03.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.606+0000 7f75adabb640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a80cee10 con 0x7f75a80d3b60 2023-11-04T01:43:03.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.606+0000 7f75adabb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80b2980 con 0x7f75a815d4e0 2023-11-04T01:43:03.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.606+0000 7f75a77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f75a815d100 0x7f75a80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.606+0000 7f75a77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f75a815d100 0x7f75a80ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44456/0 (socket says 172.21.15.44:44456) 2023-11-04T01:43:03.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.606+0000 7f75a77fe640 1 -- 172.21.15.44:0/2245503819 learned_addr learned my addr 172.21.15.44:0/2245503819 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:03.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.607+0000 7f75a6ffd640 1 --2- 172.21.15.44:0/2245503819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75a815d4e0 0x7f75a80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.607+0000 7f75a7fff640 1 --2- 172.21.15.44:0/2245503819 >> v2:172.21.15.204:3300/0 conn(0x7f75a80d3b60 0x7f75a80d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.607+0000 7f75a77fe640 1 -- 172.21.15.44:0/2245503819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75a815d4e0 msgr2=0x7f75a80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.607+0000 7f75a77fe640 1 --2- 172.21.15.44:0/2245503819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75a815d4e0 0x7f75a80d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.607+0000 7f75a77fe640 1 -- 172.21.15.44:0/2245503819 >> v2:172.21.15.204:3300/0 conn(0x7f75a80d3b60 msgr2=0x7f75a80d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.607+0000 7f75a77fe640 1 --2- 172.21.15.44:0/2245503819 >> v2:172.21.15.204:3300/0 conn(0x7f75a80d3b60 0x7f75a80d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.607+0000 7f75a77fe640 1 -- 172.21.15.44:0/2245503819 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a80b2c60 con 0x7f75a815d100 2023-11-04T01:43:03.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.607+0000 7f75a6ffd640 1 --2- 172.21.15.44:0/2245503819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75a815d4e0 0x7f75a80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:03.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.607+0000 7f75a7fff640 1 --2- 172.21.15.44:0/2245503819 >> v2:172.21.15.204:3300/0 conn(0x7f75a80d3b60 0x7f75a80d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:03.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.607+0000 7f75a77fe640 1 --2- 172.21.15.44:0/2245503819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75a815d100 0x7f75a80ce510 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f75a80b27a0 tx=0x7f759802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d70eaffcafff95 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.608+0000 7f75a67fc640 1 -- 172.21.15.44:0/2245503819 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598004230 con 0x7f75a815d100 2023-11-04T01:43:03.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.608+0000 7f75a67fc640 1 -- 172.21.15.44:0/2245503819 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7598004390 con 0x7f75a815d100 2023-11-04T01:43:03.611 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.608+0000 7f75a67fc640 1 -- 172.21.15.44:0/2245503819 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598003810 con 0x7f75a815d100 2023-11-04T01:43:03.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.608+0000 7f75adabb640 1 -- 172.21.15.44:0/2245503819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75a815d100 msgr2=0x7f75a80ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.608+0000 7f75adabb640 1 --2- 172.21.15.44:0/2245503819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75a815d100 0x7f75a80ce510 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f75a80b27a0 tx=0x7f759802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.608+0000 7f75adabb640 1 -- 172.21.15.44:0/2245503819 shutdown_connections 2023-11-04T01:43:03.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.608+0000 7f75adabb640 1 --2- 172.21.15.44:0/2245503819 >> v2:172.21.15.204:3300/0 conn(0x7f75a80d3b60 0x7f75a80d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.608+0000 7f75adabb640 1 --2- 172.21.15.44:0/2245503819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75a815d4e0 0x7f75a80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.608+0000 7f75adabb640 1 --2- 172.21.15.44:0/2245503819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75a815d100 0x7f75a80ce510 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.615 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.608+0000 7f75adabb640 1 -- 172.21.15.44:0/2245503819 >> 172.21.15.44:0/2245503819 conn(0x7f75a80d2ef0 msgr2=0x7f75a80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:03.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.608+0000 7f75adabb640 1 -- 172.21.15.44:0/2245503819 shutdown_connections 2023-11-04T01:43:03.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.608+0000 7f75adabb640 1 -- 172.21.15.44:0/2245503819 wait complete. 2023-11-04T01:43:03.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.609+0000 7f75adabb640 1 Processor -- start 2023-11-04T01:43:03.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.609+0000 7f75adabb640 1 -- start start 2023-11-04T01:43:03.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.610+0000 7f75adabb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75a80d3b60 0x7f75a80cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.610+0000 7f75adabb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75a815d100 0x7f75a815a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.610+0000 7f75adabb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75a815d4e0 0x7f75a815b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.610+0000 7f75adabb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80cc150 con 0x7f75a80d3b60 2023-11-04T01:43:03.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.610+0000 7f75adabb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80cb5d0 con 0x7f75a815d4e0 2023-11-04T01:43:03.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.610+0000 7f75adabb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80cb8b0 con 0x7f75a815d100 2023-11-04T01:43:03.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.610+0000 7f75a77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75a80d3b60 0x7f75a80cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.610+0000 7f75a77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75a80d3b60 0x7f75a80cce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44458/0 (socket says 172.21.15.44:44458) 2023-11-04T01:43:03.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.610+0000 7f75a77fe640 1 -- 172.21.15.44:0/240605451 learned_addr learned my addr 172.21.15.44:0/240605451 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.611+0000 7f75a7fff640 1 --2- 172.21.15.44:0/240605451 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75a815d4e0 0x7f75a815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.611+0000 7f75a6ffd640 1 --2- 172.21.15.44:0/240605451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75a815d100 0x7f75a815a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.611+0000 7f75a77fe640 1 -- 172.21.15.44:0/240605451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75a815d100 msgr2=0x7f75a815a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.611+0000 7f75a77fe640 1 --2- 172.21.15.44:0/240605451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75a815d100 0x7f75a815a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.611+0000 7f75a77fe640 1 -- 172.21.15.44:0/240605451 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75a815d4e0 msgr2=0x7f75a815b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.611+0000 7f75a77fe640 1 --2- 172.21.15.44:0/240605451 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75a815d4e0 0x7f75a815b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.611+0000 7f75a77fe640 1 -- 172.21.15.44:0/240605451 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7598009460 con 0x7f75a80d3b60 2023-11-04T01:43:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.611+0000 7f75a7fff640 1 --2- 172.21.15.44:0/240605451 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75a815d4e0 0x7f75a815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.611+0000 7f75a77fe640 1 --2- 172.21.15.44:0/240605451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75a80d3b60 0x7f75a80cce40 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f7598000c00 tx=0x7f75980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.611+0000 7f758ffff640 1 -- 172.21.15.44:0/240605451 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598003c40 con 0x7f75a80d3b60 2023-11-04T01:43:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.611+0000 7f758ffff640 1 -- 172.21.15.44:0/240605451 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759803f070 con 0x7f75a80d3b60 2023-11-04T01:43:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.611+0000 7f75adabb640 1 -- 172.21.15.44:0/240605451 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a80cbb90 con 0x7f75a80d3b60 2023-11-04T01:43:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.611+0000 7f758ffff640 1 -- 172.21.15.44:0/240605451 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598006040 con 0x7f75a80d3b60 2023-11-04T01:43:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.611+0000 7f75adabb640 1 -- 172.21.15.44:0/240605451 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a815aab0 con 0x7f75a80d3b60 2023-11-04T01:43:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.612+0000 7f75adabb640 1 -- 172.21.15.44:0/240605451 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a80684b0 con 0x7f75a80d3b60 2023-11-04T01:43:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.613+0000 7f758ffff640 1 -- 172.21.15.44:0/240605451 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7598041030 con 0x7f75a80d3b60 2023-11-04T01:43:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.613+0000 7f758ffff640 1 --2- 172.21.15.44:0/240605451 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f759406ae70 0x7f759406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.613+0000 7f758ffff640 1 -- 172.21.15.44:0/240605451 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f75980ac280 con 0x7f75a80d3b60 2023-11-04T01:43:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.613+0000 7f75a6ffd640 1 --2- 172.21.15.44:0/240605451 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f759406ae70 0x7f759406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.614+0000 7f75a6ffd640 1 --2- 172.21.15.44:0/240605451 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f759406ae70 0x7f759406d330 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f75a81f5e70 tx=0x7f759c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.617+0000 7f758ffff640 1 -- 172.21.15.44:0/240605451 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7598076a80 con 0x7f75a80d3b60 2023-11-04T01:43:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.792+0000 7f75adabb640 1 -- 172.21.15.44:0/240605451 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75a80d2cd0 con 0x7f75a80d3b60 2023-11-04T01:43:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.794+0000 7f758ffff640 1 -- 172.21.15.44:0/240605451 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+23248 (secure 0 0 0) 0x7f759807a0a0 con 0x7f75a80d3b60 2023-11-04T01:43:03.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:03.796 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":111,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:42:59.255408+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:28.109628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:28.871834+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":2}]},{"pgid":"17.37","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/1398028154":"2023-11-04T02:42:59.149511+0000","172.21.15.204:6836/3267689413":"2023-11-05T01:42:50.946757+0000","172.21.15.44:6835/3264332323":"2023-11-05T01:42:44.043453+0000","172.21.15.44:6833/3264332323":"2023-11-05T01:42:44.043453+0000","172.21.15.44:6832/2069525699":"2023-11-05T01:42:05.849526+0000","172.21.15.204:6834/3267689413":"2023-11-05T01:42:50.946757+0000","172.21.15.204:6836/2461924520":"2023-11-05T01:40:15.032018+0000","172.21.15.204:6834/3287638895":"2023-11-05T01:41:58.941997+0000","172.21.15.44:6834/2069525699":"2023-11-05T01:42:05.849526+0000","172.21.15.44:6833/2252282753":"2023-11-05T01:40:40.408324+0000","172.21.15.44:6835/2252282753":"2023-11-05T01:40:40.408324+0000","172.21.15.204:6834/2461924520":"2023-11-05T01:40:15.032018+0000","192.168.0.1:0/780133444":"2023-11-04T02:42:14.050728+0000","172.21.15.44:6835/1627866359":"2023-11-05T01:41:31.011032+0000","172.21.15.44:6833/1627866359":"2023-11-05T01:41:31.011032+0000","172.21.15.204:6834/3065829953":"2023-11-05T01:41:05.691698+0000","172.21.15.204:6836/3287638895":"2023-11-05T01:41:58.941997+0000","172.21.15.204:6836/3065829953":"2023-11-05T01:41:05.691698+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.796+0000 7f75adabb640 1 -- 172.21.15.44:0/240605451 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f759406ae70 msgr2=0x7f759406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.796+0000 7f75adabb640 1 --2- 172.21.15.44:0/240605451 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f759406ae70 0x7f759406d330 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f75a81f5e70 tx=0x7f759c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.796+0000 7f75adabb640 1 -- 172.21.15.44:0/240605451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75a80d3b60 msgr2=0x7f75a80cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.796+0000 7f75adabb640 1 --2- 172.21.15.44:0/240605451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75a80d3b60 0x7f75a80cce40 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f7598000c00 tx=0x7f75980046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.796+0000 7f75adabb640 1 -- 172.21.15.44:0/240605451 shutdown_connections 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.796+0000 7f75adabb640 1 --2- 172.21.15.44:0/240605451 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f759406ae70 0x7f759406d330 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.796+0000 7f75adabb640 1 --2- 172.21.15.44:0/240605451 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75a815d4e0 0x7f75a815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.796+0000 7f75adabb640 1 --2- 172.21.15.44:0/240605451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75a815d100 0x7f75a815a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.796+0000 7f75adabb640 1 --2- 172.21.15.44:0/240605451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75a80d3b60 0x7f75a80cce40 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.796+0000 7f75adabb640 1 -- 172.21.15.44:0/240605451 >> 172.21.15.44:0/240605451 conn(0x7f75a80d2ef0 msgr2=0x7f75a815ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.796+0000 7f75adabb640 1 -- 172.21.15.44:0/240605451 shutdown_connections 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.796+0000 7f75adabb640 1 -- 172.21.15.44:0/240605451 wait complete. 2023-11-04T01:43:03.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:34.917670+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:35.547044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:28.109628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:28.871834+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:03.809 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:03.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.917+0000 7fdfb274c640 1 Processor -- start 2023-11-04T01:43:03.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.917+0000 7fdfb274c640 1 -- start start 2023-11-04T01:43:03.921 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfb274c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdfac15b200 0x7fdfac0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfb274c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfac0cde80 con 0x7fdfac0afda0 2023-11-04T01:43:03.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfb274c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfac0cf670 con 0x7fdfac0cd9c0 2023-11-04T01:43:03.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfb274c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfac0cf950 con 0x7fdfac15b200 2023-11-04T01:43:03.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfab7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdfac0afda0 0x7fdfac0cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59982/0 (socket says 172.21.15.44:59982) 2023-11-04T01:43:03.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfab7fe640 1 -- 172.21.15.44:0/1293923214 learned_addr learned my addr 172.21.15.44:0/1293923214 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:03.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfabfff640 1 --2- 172.21.15.44:0/1293923214 >> v2:172.21.15.204:3300/0 conn(0x7fdfac15b200 0x7fdfac0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1293923214 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142450434 0 0) 0x7fdfac0cde80 con 0x7fdfac0afda0 2023-11-04T01:43:03.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1293923214 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf94003520 con 0x7fdfac0afda0 2023-11-04T01:43:03.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1293923214 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2757153861 0 0) 0x7fdf94003520 con 0x7fdfac0afda0 2023-11-04T01:43:03.922 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1293923214 >> v2:172.21.15.204:3300/0 conn(0x7fdfac15b200 msgr2=0x7fdfac0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfaaffd640 1 --2- 172.21.15.44:0/1293923214 >> v2:172.21.15.204:3300/0 conn(0x7fdfac15b200 0x7fdfac0ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1293923214 >> v1:172.21.15.204:6789/0 conn(0x7fdfac0cd9c0 legacy=0x7fdfac0ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1293923214 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac0ce120 con 0x7fdfac0afda0 2023-11-04T01:43:03.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1293923214 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fdfa0001670 con 0x7fdfac0afda0 2023-11-04T01:43:03.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1293923214 >> v1:172.21.15.44:6789/0 conn(0x7fdfac0afda0 legacy=0x7fdfac0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfaaffd640 1 --2- 172.21.15.44:0/1293923214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf94003970 0x7fdf94003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfaaffd640 1 --2- 172.21.15.44:0/1293923214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf94004370 0x7fdf94004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfaaffd640 1 --2- 172.21.15.44:0/1293923214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf940050e0 0x7fdf9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1293923214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0cf950 con 0x7fdf940050e0 2023-11-04T01:43:03.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1293923214 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9400c020 con 0x7fdf94003970 2023-11-04T01:43:03.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.918+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1293923214 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9400c1e0 con 0x7fdf94004370 2023-11-04T01:43:03.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.919+0000 7fdfb0ce9640 1 --2- 172.21.15.44:0/1293923214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf940050e0 0x7fdf9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.919+0000 7fdfabfff640 1 --2- 172.21.15.44:0/1293923214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf94003970 0x7fdf94003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.919+0000 7fdfab7fe640 1 --2- 172.21.15.44:0/1293923214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf94004370 0x7fdf94004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.919+0000 7fdfb0ce9640 1 -- 172.21.15.44:0/1293923214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf94004370 msgr2=0x7fdf94004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.919+0000 7fdfb0ce9640 1 --2- 172.21.15.44:0/1293923214 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf94004370 0x7fdf94004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.919+0000 7fdfb0ce9640 1 -- 172.21.15.44:0/1293923214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf94003970 msgr2=0x7fdf94003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.919+0000 7fdfb0ce9640 1 --2- 172.21.15.44:0/1293923214 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf94003970 0x7fdf94003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.919+0000 7fdfb0ce9640 1 -- 172.21.15.44:0/1293923214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf94003520 con 0x7fdf940050e0 2023-11-04T01:43:03.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.919+0000 7fdfb0ce9640 1 -- 172.21.15.44:0/1293923214 reap_dead start 2023-11-04T01:43:03.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.920+0000 7fdfb0ce9640 1 --2- 172.21.15.44:0/1293923214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf940050e0 0x7fdf9400b980 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4002010 tx=0x7fdf940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80ef1be3a08d47f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.920+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1293923214 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4003b70 con 0x7fdf940050e0 2023-11-04T01:43:03.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.920+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1293923214 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa4003cd0 con 0x7fdf940050e0 2023-11-04T01:43:03.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.920+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1293923214 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4005330 con 0x7fdf940050e0 2023-11-04T01:43:03.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.920+0000 7fdfb274c640 1 -- 172.21.15.44:0/1293923214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf940050e0 msgr2=0x7fdf9400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.920+0000 7fdfb274c640 1 --2- 172.21.15.44:0/1293923214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf940050e0 0x7fdf9400b980 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4002010 tx=0x7fdf940057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.920+0000 7fdfb274c640 1 -- 172.21.15.44:0/1293923214 shutdown_connections 2023-11-04T01:43:03.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.920+0000 7fdfb274c640 1 --2- 172.21.15.44:0/1293923214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf940050e0 0x7fdf9400b980 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.920+0000 7fdfb274c640 1 -- 172.21.15.44:0/1293923214 >> 172.21.15.44:0/1293923214 conn(0x7fdfac0d0c30 msgr2=0x7fdfac0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:03.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.920+0000 7fdfb274c640 1 -- 172.21.15.44:0/1293923214 shutdown_connections 2023-11-04T01:43:03.928 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.920+0000 7fdfb274c640 1 -- 172.21.15.44:0/1293923214 wait complete. 2023-11-04T01:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.921+0000 7fdfb274c640 1 Processor -- start 2023-11-04T01:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.922+0000 7fdfb274c640 1 -- start start 2023-11-04T01:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.922+0000 7fdfb274c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf940050e0 0x7fdfac14fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.922+0000 7fdfb274c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfac0c7d00 0x7fdfac15c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.922+0000 7fdfb274c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdfac15cf10 0x7fdfac157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.922+0000 7fdfb274c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac15e720 con 0x7fdfac0c7d00 2023-11-04T01:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.922+0000 7fdfb274c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac15da50 con 0x7fdfac15cf10 2023-11-04T01:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.922+0000 7fdfb274c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac15dd30 con 0x7fdf940050e0 2023-11-04T01:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.922+0000 7fdfab7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfac0c7d00 0x7fdfac15c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfab7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfac0c7d00 0x7fdfac15c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44478/0 (socket says 172.21.15.44:44478) 2023-11-04T01:43:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfab7fe640 1 -- 172.21.15.44:0/3122547981 learned_addr learned my addr 172.21.15.44:0/3122547981 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfb0ce9640 1 --2- 172.21.15.44:0/3122547981 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdfac15cf10 0x7fdfac157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfabfff640 1 --2- 172.21.15.44:0/3122547981 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf940050e0 0x7fdfac14fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfab7fe640 1 -- 172.21.15.44:0/3122547981 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf940050e0 msgr2=0x7fdfac14fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfab7fe640 1 --2- 172.21.15.44:0/3122547981 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf940050e0 0x7fdfac14fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfab7fe640 1 -- 172.21.15.44:0/3122547981 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdfac15cf10 msgr2=0x7fdfac157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfab7fe640 1 --2- 172.21.15.44:0/3122547981 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdfac15cf10 0x7fdfac157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfab7fe640 1 -- 172.21.15.44:0/3122547981 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac15e010 con 0x7fdfac0c7d00 2023-11-04T01:43:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfb0ce9640 1 --2- 172.21.15.44:0/3122547981 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdfac15cf10 0x7fdfac157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfab7fe640 1 --2- 172.21.15.44:0/3122547981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfac0c7d00 0x7fdfac15c9d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00010e0 tx=0x7fdfa0007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfa8ff9640 1 -- 172.21.15.44:0/3122547981 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa000f960 con 0x7fdfac0c7d00 2023-11-04T01:43:03.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfa8ff9640 1 -- 172.21.15.44:0/3122547981 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa000fac0 con 0x7fdfac0c7d00 2023-11-04T01:43:03.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfb274c640 1 -- 172.21.15.44:0/3122547981 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfac15c4b0 con 0x7fdfac0c7d00 2023-11-04T01:43:03.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfa8ff9640 1 -- 172.21.15.44:0/3122547981 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa000fe70 con 0x7fdfac0c7d00 2023-11-04T01:43:03.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.923+0000 7fdfb274c640 1 -- 172.21.15.44:0/3122547981 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfac1578b0 con 0x7fdfac0c7d00 2023-11-04T01:43:03.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.924+0000 7fdfb274c640 1 -- 172.21.15.44:0/3122547981 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfac15c6a0 con 0x7fdfac0c7d00 2023-11-04T01:43:03.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.925+0000 7fdfa8ff9640 1 -- 172.21.15.44:0/3122547981 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdfa001d460 con 0x7fdfac0c7d00 2023-11-04T01:43:03.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.925+0000 7fdfa8ff9640 1 --2- 172.21.15.44:0/3122547981 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdf9806aea0 0x7fdf9806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.925+0000 7fdfa8ff9640 1 -- 172.21.15.44:0/3122547981 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7fdfa0089f30 con 0x7fdfac0c7d00 2023-11-04T01:43:03.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.925+0000 7fdfabfff640 1 --2- 172.21.15.44:0/3122547981 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdf9806aea0 0x7fdf9806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.931 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.926+0000 7fdfabfff640 1 --2- 172.21.15.44:0/3122547981 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdf9806aea0 0x7fdf9806d360 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdfac1e5b90 tx=0x7fdf9c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.932 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:03.929+0000 7fdfa8ff9640 1 -- 172.21.15.44:0/3122547981 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdfa0054730 con 0x7fdfac0c7d00 2023-11-04T01:43:04.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.102+0000 7fdfb274c640 1 -- 172.21.15.44:0/3122547981 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdfac0684b0 con 0x7fdfac0c7d00 2023-11-04T01:43:04.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.103+0000 7fdfa8ff9640 1 -- 172.21.15.44:0/3122547981 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdfa0057d50 con 0x7fdfac0c7d00 2023-11-04T01:43:04.105 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:43:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.104+0000 7fdfb274c640 1 -- 172.21.15.44:0/3122547981 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdf9806aea0 msgr2=0x7fdf9806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.104+0000 7fdfb274c640 1 --2- 172.21.15.44:0/3122547981 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdf9806aea0 0x7fdf9806d360 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdfac1e5b90 tx=0x7fdf9c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.105+0000 7fdfb274c640 1 -- 172.21.15.44:0/3122547981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfac0c7d00 msgr2=0x7fdfac15c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.105+0000 7fdfb274c640 1 --2- 172.21.15.44:0/3122547981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfac0c7d00 0x7fdfac15c9d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00010e0 tx=0x7fdfa0007720 comp rx=0 tx=0).stop 2023-11-04T01:43:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.105+0000 7fdfb274c640 1 -- 172.21.15.44:0/3122547981 shutdown_connections 2023-11-04T01:43:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.105+0000 7fdfb274c640 1 --2- 172.21.15.44:0/3122547981 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdf9806aea0 0x7fdf9806d360 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.105+0000 7fdfb274c640 1 --2- 172.21.15.44:0/3122547981 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdfac15cf10 0x7fdfac157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.105+0000 7fdfb274c640 1 --2- 172.21.15.44:0/3122547981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfac0c7d00 0x7fdfac15c9d0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.105+0000 7fdfb274c640 1 --2- 172.21.15.44:0/3122547981 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf940050e0 0x7fdfac14fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.105+0000 7fdfb274c640 1 -- 172.21.15.44:0/3122547981 >> 172.21.15.44:0/3122547981 conn(0x7fdfac0d0c30 msgr2=0x7fdfac0ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.105+0000 7fdfb274c640 1 -- 172.21.15.44:0/3122547981 shutdown_connections 2023-11-04T01:43:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.105+0000 7fdfb274c640 1 -- 172.21.15.44:0/3122547981 wait complete. 2023-11-04T01:43:04.117 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:04.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.224+0000 7f8c05bb6640 1 Processor -- start 2023-11-04T01:43:04.227 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.225+0000 7f8c05bb6640 1 -- start start 2023-11-04T01:43:04.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.225+0000 7f8c05bb6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8c0015d4e0 0x7f8c000d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.225+0000 7f8c05bb6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8c000d3b60 0x7f8c000d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.225+0000 7f8c05bb6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c000b32b0 con 0x7f8c0015d100 2023-11-04T01:43:04.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.225+0000 7f8c05bb6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c000cec20 con 0x7f8c000d3b60 2023-11-04T01:43:04.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.225+0000 7f8c05bb6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c000cee10 con 0x7f8c0015d4e0 2023-11-04T01:43:04.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.225+0000 7f8bfffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8c000d3b60 0x7f8c000d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.225+0000 7f8bff7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8c0015d100 0x7f8c000ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59996/0 (socket says 172.21.15.44:59996) 2023-11-04T01:43:04.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.225+0000 7f8bff7fe640 1 -- 172.21.15.44:0/163724503 learned_addr learned my addr 172.21.15.44:0/163724503 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:04.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.226+0000 7f8bfeffd640 1 --2- 172.21.15.44:0/163724503 >> v2:172.21.15.204:3300/0 conn(0x7f8c0015d4e0 0x7f8c000d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.226+0000 7f8bfffff640 1 -- 172.21.15.44:0/163724503 >> v2:172.21.15.204:3300/0 conn(0x7f8c0015d4e0 msgr2=0x7f8c000d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:04.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.226+0000 7f8bfffff640 1 --2- 172.21.15.44:0/163724503 >> v2:172.21.15.204:3300/0 conn(0x7f8c0015d4e0 0x7f8c000d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.226+0000 7f8bfffff640 1 -- 172.21.15.44:0/163724503 >> v1:172.21.15.44:6789/0 conn(0x7f8c0015d100 legacy=0x7f8c000ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.226+0000 7f8bfffff640 1 -- 172.21.15.44:0/163724503 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c000b4750 con 0x7f8c000d3b60 2023-11-04T01:43:04.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.226+0000 7f8bfe7fc640 1 -- 172.21.15.44:0/163724503 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064137324 0 0) 0x7f8c000b32b0 con 0x7f8c0015d100 2023-11-04T01:43:04.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.227+0000 7f8bfffff640 1 --2- 172.21.15.44:0/163724503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c000d3b60 0x7f8c000d1a10 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f8c00160da0 tx=0x7f8bf802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7eb309303f6845 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.227+0000 7f8bfe7fc640 1 -- 172.21.15.44:0/163724503 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf802cc80 con 0x7f8c000d3b60 2023-11-04T01:43:04.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.227+0000 7f8bfe7fc640 1 -- 172.21.15.44:0/163724503 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf802cde0 con 0x7f8c000d3b60 2023-11-04T01:43:04.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.227+0000 7f8bfe7fc640 1 -- 172.21.15.44:0/163724503 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8034660 con 0x7f8c000d3b60 2023-11-04T01:43:04.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.227+0000 7f8c05bb6640 1 -- 172.21.15.44:0/163724503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c000d3b60 msgr2=0x7f8c000d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.227+0000 7f8c05bb6640 1 --2- 172.21.15.44:0/163724503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c000d3b60 0x7f8c000d1a10 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f8c00160da0 tx=0x7f8bf802bed0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.227+0000 7f8c05bb6640 1 -- 172.21.15.44:0/163724503 shutdown_connections 2023-11-04T01:43:04.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.227+0000 7f8c05bb6640 1 --2- 172.21.15.44:0/163724503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c000d3b60 0x7f8c000d1a10 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.227+0000 7f8c05bb6640 1 --2- 172.21.15.44:0/163724503 >> v2:172.21.15.204:3300/0 conn(0x7f8c0015d4e0 0x7f8c000d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.227+0000 7f8c05bb6640 1 -- 172.21.15.44:0/163724503 >> 172.21.15.44:0/163724503 conn(0x7f8c000d2ef0 msgr2=0x7f8c000d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.227+0000 7f8c05bb6640 1 -- 172.21.15.44:0/163724503 shutdown_connections 2023-11-04T01:43:04.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.227+0000 7f8c05bb6640 1 -- 172.21.15.44:0/163724503 wait complete. 2023-11-04T01:43:04.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.228+0000 7f8c05bb6640 1 Processor -- start 2023-11-04T01:43:04.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.229+0000 7f8c05bb6640 1 -- start start 2023-11-04T01:43:04.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.229+0000 7f8c05bb6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c000d3b60 0x7f8c0014ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.229+0000 7f8c05bb6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c0015d100 0x7f8c000b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.229+0000 7f8c05bb6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c0015d4e0 0x7f8c0014a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.229+0000 7f8c05bb6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0014d1f0 con 0x7f8c000d3b60 2023-11-04T01:43:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.229+0000 7f8c05bb6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c000b7440 con 0x7f8c0015d100 2023-11-04T01:43:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.229+0000 7f8c05bb6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c000b7720 con 0x7f8c0015d4e0 2023-11-04T01:43:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8bff7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c000d3b60 0x7f8c0014ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8bff7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c000d3b60 0x7f8c0014ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44508/0 (socket says 172.21.15.44:44508) 2023-11-04T01:43:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8bff7fe640 1 -- 172.21.15.44:0/707222298 learned_addr learned my addr 172.21.15.44:0/707222298 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8bfeffd640 1 --2- 172.21.15.44:0/707222298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c0015d100 0x7f8c000b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8bfffff640 1 --2- 172.21.15.44:0/707222298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c0015d4e0 0x7f8c0014a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8bff7fe640 1 -- 172.21.15.44:0/707222298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c0015d4e0 msgr2=0x7f8c0014a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8bff7fe640 1 --2- 172.21.15.44:0/707222298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c0015d4e0 0x7f8c0014a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8bff7fe640 1 -- 172.21.15.44:0/707222298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c0015d100 msgr2=0x7f8c000b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8bff7fe640 1 --2- 172.21.15.44:0/707222298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c0015d100 0x7f8c000b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8bff7fe640 1 -- 172.21.15.44:0/707222298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf8009a70 con 0x7f8c000d3b60 2023-11-04T01:43:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8bfffff640 1 --2- 172.21.15.44:0/707222298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c0015d4e0 0x7f8c0014a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8bff7fe640 1 --2- 172.21.15.44:0/707222298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c000d3b60 0x7f8c0014ccb0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00010e0 tx=0x7f8bf000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8be7fff640 1 -- 172.21.15.44:0/707222298 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0007480 con 0x7f8c000d3b60 2023-11-04T01:43:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8be7fff640 1 -- 172.21.15.44:0/707222298 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf00075e0 con 0x7f8c000d3b60 2023-11-04T01:43:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8c05bb6640 1 -- 172.21.15.44:0/707222298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c000b7a00 con 0x7f8c000d3b60 2023-11-04T01:43:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8be7fff640 1 -- 172.21.15.44:0/707222298 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf00059c0 con 0x7f8c000d3b60 2023-11-04T01:43:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.230+0000 7f8c05bb6640 1 -- 172.21.15.44:0/707222298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c000b7fc0 con 0x7f8c000d3b60 2023-11-04T01:43:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.231+0000 7f8c05bb6640 1 -- 172.21.15.44:0/707222298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c000b81b0 con 0x7f8c000d3b60 2023-11-04T01:43:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.232+0000 7f8be7fff640 1 -- 172.21.15.44:0/707222298 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8bf0005b20 con 0x7f8c000d3b60 2023-11-04T01:43:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.232+0000 7f8be7fff640 1 --2- 172.21.15.44:0/707222298 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8bec06aea0 0x7f8bec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.232+0000 7f8be7fff640 1 -- 172.21.15.44:0/707222298 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f8bf0089410 con 0x7f8c000d3b60 2023-11-04T01:43:04.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.232+0000 7f8bfeffd640 1 --2- 172.21.15.44:0/707222298 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8bec06aea0 0x7f8bec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.237 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.233+0000 7f8bfeffd640 1 --2- 172.21.15.44:0/707222298 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8bec06aea0 0x7f8bec06d360 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8c0006b780 tx=0x7f8bf4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.238 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.236+0000 7f8be7fff640 1 -- 172.21.15.44:0/707222298 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8bf0053c30 con 0x7f8c000d3b60 2023-11-04T01:43:04.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.411+0000 7f8c05bb6640 1 -- 172.21.15.44:0/707222298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f8c000684b0 con 0x7f8c000d3b60 2023-11-04T01:43:04.414 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.412+0000 7f8be7fff640 1 -- 172.21.15.44:0/707222298 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v111) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8bf0017030 con 0x7f8c000d3b60 2023-11-04T01:43:04.414 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:43:04.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.414+0000 7f8c05bb6640 1 -- 172.21.15.44:0/707222298 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8bec06aea0 msgr2=0x7f8bec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.414+0000 7f8c05bb6640 1 --2- 172.21.15.44:0/707222298 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8bec06aea0 0x7f8bec06d360 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8c0006b780 tx=0x7f8bf4008040 comp rx=0 tx=0).stop 2023-11-04T01:43:04.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.414+0000 7f8c05bb6640 1 -- 172.21.15.44:0/707222298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c000d3b60 msgr2=0x7f8c0014ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.414+0000 7f8c05bb6640 1 --2- 172.21.15.44:0/707222298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c000d3b60 0x7f8c0014ccb0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00010e0 tx=0x7f8bf000c9b0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.414+0000 7f8c05bb6640 1 -- 172.21.15.44:0/707222298 shutdown_connections 2023-11-04T01:43:04.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.414+0000 7f8c05bb6640 1 --2- 172.21.15.44:0/707222298 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8bec06aea0 0x7f8bec06d360 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.414+0000 7f8c05bb6640 1 --2- 172.21.15.44:0/707222298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c0015d4e0 0x7f8c0014a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.414+0000 7f8c05bb6640 1 --2- 172.21.15.44:0/707222298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c0015d100 0x7f8c000b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.414+0000 7f8c05bb6640 1 --2- 172.21.15.44:0/707222298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c000d3b60 0x7f8c0014ccb0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.414+0000 7f8c05bb6640 1 -- 172.21.15.44:0/707222298 >> 172.21.15.44:0/707222298 conn(0x7f8c000d2ef0 msgr2=0x7f8c000d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.414+0000 7f8c05bb6640 1 -- 172.21.15.44:0/707222298 shutdown_connections 2023-11-04T01:43:04.417 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.414+0000 7f8c05bb6640 1 -- 172.21.15.44:0/707222298 wait complete. 2023-11-04T01:43:04.426 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:43:04.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.535+0000 7f4873d25640 1 Processor -- start 2023-11-04T01:43:04.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.535+0000 7f4873d25640 1 -- start start 2023-11-04T01:43:04.538 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.536+0000 7f4873d25640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f486c0ceda0 0x7f486c15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.536+0000 7f4873d25640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f486c0b2210 0x7f486c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.536+0000 7f4873d25640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f486c15d9a0 con 0x7f486c0cf180 2023-11-04T01:43:04.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.536+0000 7f4873d25640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486c0b1df0 con 0x7f486c0b2210 2023-11-04T01:43:04.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.536+0000 7f4873d25640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486c0cfd00 con 0x7f486c0ceda0 2023-11-04T01:43:04.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.536+0000 7f48712c0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f486c0b2210 0x7f486c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.536+0000 7f48722c2640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f486c0cf180 0x7f486c0cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60008/0 (socket says 172.21.15.44:60008) 2023-11-04T01:43:04.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.536+0000 7f48722c2640 1 -- 172.21.15.44:0/2753014248 learned_addr learned my addr 172.21.15.44:0/2753014248 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:04.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.536+0000 7f4871ac1640 1 --2- 172.21.15.44:0/2753014248 >> v2:172.21.15.204:3300/0 conn(0x7f486c0ceda0 0x7f486c15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.536+0000 7f48712c0640 1 -- 172.21.15.44:0/2753014248 >> v2:172.21.15.204:3300/0 conn(0x7f486c0ceda0 msgr2=0x7f486c15cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:04.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.536+0000 7f48712c0640 1 --2- 172.21.15.44:0/2753014248 >> v2:172.21.15.204:3300/0 conn(0x7f486c0ceda0 0x7f486c15cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.536+0000 7f48712c0640 1 -- 172.21.15.44:0/2753014248 >> v1:172.21.15.44:6789/0 conn(0x7f486c0cf180 legacy=0x7f486c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.536+0000 7f4870abf640 1 -- 172.21.15.44:0/2753014248 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109441529 0 0) 0x7f486c15d9a0 con 0x7f486c0cf180 2023-11-04T01:43:04.539 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.536+0000 7f48712c0640 1 -- 172.21.15.44:0/2753014248 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c0b0150 con 0x7f486c0b2210 2023-11-04T01:43:04.540 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.536+0000 7f4871ac1640 1 --2- 172.21.15.44:0/2753014248 >> v2:172.21.15.204:3300/0 conn(0x7f486c0ceda0 0x7f486c15cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.537+0000 7f48712c0640 1 --2- 172.21.15.44:0/2753014248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f486c0b2210 0x7f486c15d460 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f486c070130 tx=0x7f485c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0269192a7ce8d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.537+0000 7f4870abf640 1 -- 172.21.15.44:0/2753014248 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c02e070 con 0x7f486c0b2210 2023-11-04T01:43:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.537+0000 7f4870abf640 1 -- 172.21.15.44:0/2753014248 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c0315a0 con 0x7f486c0b2210 2023-11-04T01:43:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.537+0000 7f4870abf640 1 -- 172.21.15.44:0/2753014248 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c031930 con 0x7f486c0b2210 2023-11-04T01:43:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.538+0000 7f4873d25640 1 -- 172.21.15.44:0/2753014248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f486c0b2210 msgr2=0x7f486c15d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.538+0000 7f4873d25640 1 --2- 172.21.15.44:0/2753014248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f486c0b2210 0x7f486c15d460 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f486c070130 tx=0x7f485c02b840 comp rx=0 tx=0).stop 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.538+0000 7f4873d25640 1 -- 172.21.15.44:0/2753014248 shutdown_connections 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.538+0000 7f4873d25640 1 --2- 172.21.15.44:0/2753014248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f486c0b2210 0x7f486c15d460 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.538+0000 7f4873d25640 1 --2- 172.21.15.44:0/2753014248 >> v2:172.21.15.204:3300/0 conn(0x7f486c0ceda0 0x7f486c15cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.538+0000 7f4873d25640 1 -- 172.21.15.44:0/2753014248 >> 172.21.15.44:0/2753014248 conn(0x7f486c0d0c30 msgr2=0x7f486c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.538+0000 7f4873d25640 1 -- 172.21.15.44:0/2753014248 shutdown_connections 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.538+0000 7f4873d25640 1 -- 172.21.15.44:0/2753014248 wait complete. 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.539+0000 7f4873d25640 1 Processor -- start 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.539+0000 7f4873d25640 1 -- start start 2023-11-04T01:43:04.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.540+0000 7f4873d25640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f486c0b2210 0x7f486c1582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.540+0000 7f4873d25640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f486c0ceda0 0x7f486c1f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.540+0000 7f4873d25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f486c0cf180 0x7f486c0c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.540+0000 7f4873d25640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c1587e0 con 0x7f486c0cf180 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.540+0000 7f4873d25640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c0cb400 con 0x7f486c0b2210 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.540+0000 7f4873d25640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486c0cb6e0 con 0x7f486c0ceda0 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.540+0000 7f48722c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f486c0cf180 0x7f486c0c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.540+0000 7f48722c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f486c0cf180 0x7f486c0c9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44522/0 (socket says 172.21.15.44:44522) 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.540+0000 7f48722c2640 1 -- 172.21.15.44:0/2912731864 learned_addr learned my addr 172.21.15.44:0/2912731864 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.540+0000 7f48722c2640 1 -- 172.21.15.44:0/2912731864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f486c0ceda0 msgr2=0x7f486c1f23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.540+0000 7f48722c2640 1 --2- 172.21.15.44:0/2912731864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f486c0ceda0 0x7f486c1f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.540+0000 7f48722c2640 1 -- 172.21.15.44:0/2912731864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f486c0b2210 msgr2=0x7f486c1582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.540+0000 7f4871ac1640 1 --2- 172.21.15.44:0/2912731864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f486c0b2210 0x7f486c1582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.540+0000 7f48722c2640 1 --2- 172.21.15.44:0/2912731864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f486c0b2210 0x7f486c1582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.540+0000 7f48722c2640 1 -- 172.21.15.44:0/2912731864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c009400 con 0x7f486c0cf180 2023-11-04T01:43:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.541+0000 7f48722c2640 1 --2- 172.21.15.44:0/2912731864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f486c0cf180 0x7f486c0c9130 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f486400c780 tx=0x7f486400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.541+0000 7f48627fc640 1 -- 172.21.15.44:0/2912731864 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486400ce90 con 0x7f486c0cf180 2023-11-04T01:43:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.541+0000 7f48627fc640 1 -- 172.21.15.44:0/2912731864 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486400a640 con 0x7f486c0cf180 2023-11-04T01:43:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.541+0000 7f4873d25640 1 -- 172.21.15.44:0/2912731864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486c0cb9c0 con 0x7f486c0cf180 2023-11-04T01:43:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.541+0000 7f48627fc640 1 -- 172.21.15.44:0/2912731864 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486400a9d0 con 0x7f486c0cf180 2023-11-04T01:43:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.541+0000 7f4873d25640 1 -- 172.21.15.44:0/2912731864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486c0cbf80 con 0x7f486c0cf180 2023-11-04T01:43:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.542+0000 7f4873d25640 1 -- 172.21.15.44:0/2912731864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486c06d8c0 con 0x7f486c0cf180 2023-11-04T01:43:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.542+0000 7f48627fc640 1 -- 172.21.15.44:0/2912731864 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f486400ab30 con 0x7f486c0cf180 2023-11-04T01:43:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.543+0000 7f48627fc640 1 --2- 172.21.15.44:0/2912731864 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f485006ae70 0x7f485006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.543+0000 7f48627fc640 1 -- 172.21.15.44:0/2912731864 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f4864089420 con 0x7f486c0cf180 2023-11-04T01:43:04.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.543+0000 7f4871ac1640 1 --2- 172.21.15.44:0/2912731864 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f485006ae70 0x7f485006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.547 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.544+0000 7f4871ac1640 1 --2- 172.21.15.44:0/2912731864 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f485006ae70 0x7f485006d330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f486800d8b0 tx=0x7f4868008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.547+0000 7f48627fc640 1 -- 172.21.15.44:0/2912731864 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4864053c20 con 0x7f486c0cf180 2023-11-04T01:43:04.726 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.724+0000 7f4873d25640 1 -- 172.21.15.44:0/2912731864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f486c0cc170 con 0x7f486c0cf180 2023-11-04T01:43:04.727 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.725+0000 7f48627fc640 1 -- 172.21.15.44:0/2912731864 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v111) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4864018070 con 0x7f486c0cf180 2023-11-04T01:43:04.727 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:43:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.726+0000 7f4873d25640 1 -- 172.21.15.44:0/2912731864 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f485006ae70 msgr2=0x7f485006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.726+0000 7f4873d25640 1 --2- 172.21.15.44:0/2912731864 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f485006ae70 0x7f485006d330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f486800d8b0 tx=0x7f4868008040 comp rx=0 tx=0).stop 2023-11-04T01:43:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.726+0000 7f4873d25640 1 -- 172.21.15.44:0/2912731864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f486c0cf180 msgr2=0x7f486c0c9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.726+0000 7f4873d25640 1 --2- 172.21.15.44:0/2912731864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f486c0cf180 0x7f486c0c9130 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f486400c780 tx=0x7f486400cc40 comp rx=0 tx=0).stop 2023-11-04T01:43:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.726+0000 7f4873d25640 1 -- 172.21.15.44:0/2912731864 shutdown_connections 2023-11-04T01:43:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.726+0000 7f4873d25640 1 --2- 172.21.15.44:0/2912731864 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f485006ae70 0x7f485006d330 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.726+0000 7f4873d25640 1 --2- 172.21.15.44:0/2912731864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f486c0cf180 0x7f486c0c9130 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.726+0000 7f4873d25640 1 --2- 172.21.15.44:0/2912731864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f486c0ceda0 0x7f486c1f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.726+0000 7f4873d25640 1 --2- 172.21.15.44:0/2912731864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f486c0b2210 0x7f486c1582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.726+0000 7f4873d25640 1 -- 172.21.15.44:0/2912731864 >> 172.21.15.44:0/2912731864 conn(0x7f486c0d0c30 msgr2=0x7f486c0d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.727+0000 7f4873d25640 1 -- 172.21.15.44:0/2912731864 shutdown_connections 2023-11-04T01:43:04.730 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.727+0000 7f4873d25640 1 -- 172.21.15.44:0/2912731864 wait complete. 2023-11-04T01:43:04.739 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:43:04.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.846+0000 7ffbe8c83640 1 Processor -- start 2023-11-04T01:43:04.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.846+0000 7ffbe8c83640 1 -- start start 2023-11-04T01:43:04.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.846+0000 7ffbe8c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ffbe415d100 0x7ffbe40ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.846+0000 7ffbe8c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffbe415d4e0 0x7ffbe40d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.846+0000 7ffbe8c83640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe40b32b0 con 0x7ffbe40d3b60 2023-11-04T01:43:04.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.846+0000 7ffbe8c83640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe40cee10 con 0x7ffbe415d4e0 2023-11-04T01:43:04.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.846+0000 7ffbe8c83640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe40b4750 con 0x7ffbe415d100 2023-11-04T01:43:04.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.847+0000 7ffbdbfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffbe415d4e0 0x7ffbe40d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.847+0000 7ffbe2d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ffbe40d3b60 0x7ffbe40cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60024/0 (socket says 172.21.15.44:60024) 2023-11-04T01:43:04.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.847+0000 7ffbe2d9d640 1 -- 172.21.15.44:0/455824653 learned_addr learned my addr 172.21.15.44:0/455824653 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:04.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.847+0000 7ffbe259c640 1 --2- 172.21.15.44:0/455824653 >> v2:172.21.15.204:3300/0 conn(0x7ffbe415d100 0x7ffbe40ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.847+0000 7ffbdbfff640 1 -- 172.21.15.44:0/455824653 >> v2:172.21.15.204:3300/0 conn(0x7ffbe415d100 msgr2=0x7ffbe40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:04.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.847+0000 7ffbdbfff640 1 --2- 172.21.15.44:0/455824653 >> v2:172.21.15.204:3300/0 conn(0x7ffbe415d100 0x7ffbe40ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.847+0000 7ffbdbfff640 1 -- 172.21.15.44:0/455824653 >> v1:172.21.15.44:6789/0 conn(0x7ffbe40d3b60 legacy=0x7ffbe40cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.847+0000 7ffbe1d9b640 1 -- 172.21.15.44:0/455824653 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147044031 0 0) 0x7ffbe40b32b0 con 0x7ffbe40d3b60 2023-11-04T01:43:04.850 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.847+0000 7ffbdbfff640 1 -- 172.21.15.44:0/455824653 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe40b2980 con 0x7ffbe415d4e0 2023-11-04T01:43:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.848+0000 7ffbdbfff640 1 --2- 172.21.15.44:0/455824653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbe415d4e0 0x7ffbe40d14d0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40d09f0 tx=0x7ffbcc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5aaa4b8d5db049 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.848+0000 7ffbe1d9b640 1 -- 172.21.15.44:0/455824653 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc031830 con 0x7ffbe415d4e0 2023-11-04T01:43:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.848+0000 7ffbe1d9b640 1 -- 172.21.15.44:0/455824653 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc031990 con 0x7ffbe415d4e0 2023-11-04T01:43:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.848+0000 7ffbe1d9b640 1 -- 172.21.15.44:0/455824653 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc031d20 con 0x7ffbe415d4e0 2023-11-04T01:43:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.848+0000 7ffbe8c83640 1 -- 172.21.15.44:0/455824653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbe415d4e0 msgr2=0x7ffbe40d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.848+0000 7ffbe8c83640 1 --2- 172.21.15.44:0/455824653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbe415d4e0 0x7ffbe40d14d0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40d09f0 tx=0x7ffbcc02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.848+0000 7ffbe8c83640 1 -- 172.21.15.44:0/455824653 shutdown_connections 2023-11-04T01:43:04.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.848+0000 7ffbe8c83640 1 --2- 172.21.15.44:0/455824653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbe415d4e0 0x7ffbe40d14d0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.848+0000 7ffbe8c83640 1 --2- 172.21.15.44:0/455824653 >> v2:172.21.15.204:3300/0 conn(0x7ffbe415d100 0x7ffbe40ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.848+0000 7ffbe8c83640 1 -- 172.21.15.44:0/455824653 >> 172.21.15.44:0/455824653 conn(0x7ffbe40d2ef0 msgr2=0x7ffbe40d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.848+0000 7ffbe8c83640 1 -- 172.21.15.44:0/455824653 shutdown_connections 2023-11-04T01:43:04.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.848+0000 7ffbe8c83640 1 -- 172.21.15.44:0/455824653 wait complete. 2023-11-04T01:43:04.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.850+0000 7ffbe8c83640 1 Processor -- start 2023-11-04T01:43:04.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.850+0000 7ffbe8c83640 1 -- start start 2023-11-04T01:43:04.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.850+0000 7ffbe8c83640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbe40d3b60 0x7ffbe4151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.850+0000 7ffbe8c83640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbe415d100 0x7ffbe40cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.850+0000 7ffbe8c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe415d4e0 0x7ffbe40b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.850+0000 7ffbe8c83640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe41519b0 con 0x7ffbe40d3b60 2023-11-04T01:43:04.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.850+0000 7ffbe8c83640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40cce10 con 0x7ffbe415d100 2023-11-04T01:43:04.854 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.850+0000 7ffbe8c83640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40cb5a0 con 0x7ffbe415d4e0 2023-11-04T01:43:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.851+0000 7ffbe259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbe40d3b60 0x7ffbe4151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.851+0000 7ffbe259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbe40d3b60 0x7ffbe4151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44536/0 (socket says 172.21.15.44:44536) 2023-11-04T01:43:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.851+0000 7ffbe259c640 1 -- 172.21.15.44:0/4137271626 learned_addr learned my addr 172.21.15.44:0/4137271626 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.851+0000 7ffbe259c640 1 -- 172.21.15.44:0/4137271626 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe415d4e0 msgr2=0x7ffbe40b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.851+0000 7ffbe259c640 1 --2- 172.21.15.44:0/4137271626 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe415d4e0 0x7ffbe40b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.851+0000 7ffbe259c640 1 -- 172.21.15.44:0/4137271626 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbe415d100 msgr2=0x7ffbe40cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.851+0000 7ffbe259c640 1 --2- 172.21.15.44:0/4137271626 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbe415d100 0x7ffbe40cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.851+0000 7ffbe259c640 1 -- 172.21.15.44:0/4137271626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc009400 con 0x7ffbe40d3b60 2023-11-04T01:43:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.851+0000 7ffbe259c640 1 --2- 172.21.15.44:0/4137271626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbe40d3b60 0x7ffbe4151470 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400d7d0 tx=0x7ffbd400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.851+0000 7ffbdaffd640 1 -- 172.21.15.44:0/4137271626 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4009660 con 0x7ffbe40d3b60 2023-11-04T01:43:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.851+0000 7ffbdaffd640 1 -- 172.21.15.44:0/4137271626 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd40097c0 con 0x7ffbe40d3b60 2023-11-04T01:43:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.851+0000 7ffbe8c83640 1 -- 172.21.15.44:0/4137271626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe40c9fc0 con 0x7ffbe40d3b60 2023-11-04T01:43:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.851+0000 7ffbdaffd640 1 -- 172.21.15.44:0/4137271626 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4009b70 con 0x7ffbe40d3b60 2023-11-04T01:43:04.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.851+0000 7ffbe8c83640 1 -- 172.21.15.44:0/4137271626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe40ca580 con 0x7ffbe40d3b60 2023-11-04T01:43:04.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.852+0000 7ffbe8c83640 1 -- 172.21.15.44:0/4137271626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe40684b0 con 0x7ffbe40d3b60 2023-11-04T01:43:04.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.853+0000 7ffbdaffd640 1 -- 172.21.15.44:0/4137271626 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffbd4009cd0 con 0x7ffbe40d3b60 2023-11-04T01:43:04.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.853+0000 7ffbdaffd640 1 --2- 172.21.15.44:0/4137271626 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffbc406ae70 0x7ffbc406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.856 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.853+0000 7ffbdaffd640 1 -- 172.21.15.44:0/4137271626 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7ffbd408a720 con 0x7ffbe40d3b60 2023-11-04T01:43:04.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.853+0000 7ffbdbfff640 1 --2- 172.21.15.44:0/4137271626 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffbc406ae70 0x7ffbc406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.854+0000 7ffbdbfff640 1 --2- 172.21.15.44:0/4137271626 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffbc406ae70 0x7ffbc406d330 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc036000 tx=0x7ffbcc030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.859 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:04.857+0000 7ffbdaffd640 1 -- 172.21.15.44:0/4137271626 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffbd4054ea0 con 0x7ffbe40d3b60 2023-11-04T01:43:05.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.033+0000 7ffbe8c83640 1 -- 172.21.15.44:0/4137271626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7ffbe40d2cd0 con 0x7ffbe40d3b60 2023-11-04T01:43:05.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.034+0000 7ffbdaffd640 1 -- 172.21.15.44:0/4137271626 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v111) v1 ==== 107+0+11 (secure 0 0 0) 0x7ffbd40584c0 con 0x7ffbe40d3b60 2023-11-04T01:43:05.036 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:43:05.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.036+0000 7ffbe8c83640 1 -- 172.21.15.44:0/4137271626 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffbc406ae70 msgr2=0x7ffbc406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.036+0000 7ffbe8c83640 1 --2- 172.21.15.44:0/4137271626 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffbc406ae70 0x7ffbc406d330 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc036000 tx=0x7ffbcc030000 comp rx=0 tx=0).stop 2023-11-04T01:43:05.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.036+0000 7ffbe8c83640 1 -- 172.21.15.44:0/4137271626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbe40d3b60 msgr2=0x7ffbe4151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.036+0000 7ffbe8c83640 1 --2- 172.21.15.44:0/4137271626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbe40d3b60 0x7ffbe4151470 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400d7d0 tx=0x7ffbd400dc90 comp rx=0 tx=0).stop 2023-11-04T01:43:05.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.036+0000 7ffbe8c83640 1 -- 172.21.15.44:0/4137271626 shutdown_connections 2023-11-04T01:43:05.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.036+0000 7ffbe8c83640 1 --2- 172.21.15.44:0/4137271626 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ffbc406ae70 0x7ffbc406d330 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.038 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.036+0000 7ffbe8c83640 1 --2- 172.21.15.44:0/4137271626 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe415d4e0 0x7ffbe40b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.036+0000 7ffbe8c83640 1 --2- 172.21.15.44:0/4137271626 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbe415d100 0x7ffbe40cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.036+0000 7ffbe8c83640 1 --2- 172.21.15.44:0/4137271626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbe40d3b60 0x7ffbe4151470 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.036+0000 7ffbe8c83640 1 -- 172.21.15.44:0/4137271626 >> 172.21.15.44:0/4137271626 conn(0x7ffbe40d2ef0 msgr2=0x7ffbe40d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.036+0000 7ffbe8c83640 1 -- 172.21.15.44:0/4137271626 shutdown_connections 2023-11-04T01:43:05.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.036+0000 7ffbe8c83640 1 -- 172.21.15.44:0/4137271626 wait complete. 2023-11-04T01:43:05.048 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:05.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.155+0000 7fd865b6e640 1 Processor -- start 2023-11-04T01:43:05.157 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.155+0000 7fd865b6e640 1 -- start start 2023-11-04T01:43:05.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.156+0000 7fd865b6e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd8600ceda0 0x7fd86015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.156+0000 7fd865b6e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8600b2210 0x7fd86015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.156+0000 7fd865b6e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86015d9a0 con 0x7fd8600cf180 2023-11-04T01:43:05.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.156+0000 7fd865b6e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8600b1df0 con 0x7fd8600ceda0 2023-11-04T01:43:05.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.156+0000 7fd865b6e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600cfd20 con 0x7fd8600b2210 2023-11-04T01:43:05.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.156+0000 7fd85f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd8600ceda0 0x7fd86015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.156+0000 7fd85ffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd8600cf180 0x7fd8600cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60030/0 (socket says 172.21.15.44:60030) 2023-11-04T01:43:05.159 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.156+0000 7fd85ffff640 1 -- 172.21.15.44:0/686755682 learned_addr learned my addr 172.21.15.44:0/686755682 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:05.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.157+0000 7fd85e7fc640 1 -- 172.21.15.44:0/686755682 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724642207 0 0) 0x7fd86015d9a0 con 0x7fd8600cf180 2023-11-04T01:43:05.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.157+0000 7fd85effd640 1 --2- 172.21.15.44:0/686755682 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8600b2210 0x7fd86015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.157+0000 7fd85e7fc640 1 -- 172.21.15.44:0/686755682 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd848003520 con 0x7fd8600cf180 2023-11-04T01:43:05.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.157+0000 7fd85f7fe640 1 -- 172.21.15.44:0/686755682 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8600b2210 msgr2=0x7fd86015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.157+0000 7fd85f7fe640 1 --2- 172.21.15.44:0/686755682 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8600b2210 0x7fd86015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.157+0000 7fd85f7fe640 1 -- 172.21.15.44:0/686755682 >> v1:172.21.15.44:6789/0 conn(0x7fd8600cf180 legacy=0x7fd8600cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.157+0000 7fd85f7fe640 1 -- 172.21.15.44:0/686755682 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8600b0150 con 0x7fd8600ceda0 2023-11-04T01:43:05.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.157+0000 7fd85effd640 1 --2- 172.21.15.44:0/686755682 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8600b2210 0x7fd86015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:05.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.157+0000 7fd85f7fe640 1 --2- 172.21.15.44:0/686755682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8600ceda0 0x7fd86015cf20 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fd850009790 tx=0x7fd85002b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb3c457fd7289d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.158+0000 7fd85e7fc640 1 -- 172.21.15.44:0/686755682 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850031770 con 0x7fd8600ceda0 2023-11-04T01:43:05.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.158+0000 7fd85e7fc640 1 -- 172.21.15.44:0/686755682 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8500318d0 con 0x7fd8600ceda0 2023-11-04T01:43:05.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.158+0000 7fd85e7fc640 1 -- 172.21.15.44:0/686755682 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850031c40 con 0x7fd8600ceda0 2023-11-04T01:43:05.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.158+0000 7fd865b6e640 1 -- 172.21.15.44:0/686755682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8600ceda0 msgr2=0x7fd86015cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.158+0000 7fd865b6e640 1 --2- 172.21.15.44:0/686755682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8600ceda0 0x7fd86015cf20 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fd850009790 tx=0x7fd85002b810 comp rx=0 tx=0).stop 2023-11-04T01:43:05.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.158+0000 7fd865b6e640 1 -- 172.21.15.44:0/686755682 shutdown_connections 2023-11-04T01:43:05.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.158+0000 7fd865b6e640 1 --2- 172.21.15.44:0/686755682 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8600b2210 0x7fd86015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.158+0000 7fd865b6e640 1 --2- 172.21.15.44:0/686755682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8600ceda0 0x7fd86015cf20 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.158+0000 7fd865b6e640 1 -- 172.21.15.44:0/686755682 >> 172.21.15.44:0/686755682 conn(0x7fd8600d0c30 msgr2=0x7fd8600d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.158+0000 7fd865b6e640 1 -- 172.21.15.44:0/686755682 shutdown_connections 2023-11-04T01:43:05.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.158+0000 7fd865b6e640 1 -- 172.21.15.44:0/686755682 wait complete. 2023-11-04T01:43:05.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.159+0000 7fd865b6e640 1 Processor -- start 2023-11-04T01:43:05.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.160+0000 7fd865b6e640 1 -- start start 2023-11-04T01:43:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.160+0000 7fd865b6e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8600b2210 0x7fd8600b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.160+0000 7fd865b6e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8600ceda0 0x7fd8600c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.160+0000 7fd865b6e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8600cf180 0x7fd8600cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.160+0000 7fd865b6e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600b32c0 con 0x7fd8600ceda0 2023-11-04T01:43:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.160+0000 7fd865b6e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600b26b0 con 0x7fd8600cf180 2023-11-04T01:43:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.160+0000 7fd865b6e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600b2990 con 0x7fd8600b2210 2023-11-04T01:43:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.160+0000 7fd85effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8600ceda0 0x7fd8600c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.160+0000 7fd85effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8600ceda0 0x7fd8600c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44552/0 (socket says 172.21.15.44:44552) 2023-11-04T01:43:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.160+0000 7fd85effd640 1 -- 172.21.15.44:0/1837535485 learned_addr learned my addr 172.21.15.44:0/1837535485 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.161+0000 7fd85f7fe640 1 --2- 172.21.15.44:0/1837535485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8600b2210 0x7fd8600b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.161+0000 7fd85effd640 1 -- 172.21.15.44:0/1837535485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8600b2210 msgr2=0x7fd8600b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.161+0000 7fd85effd640 1 --2- 172.21.15.44:0/1837535485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8600b2210 0x7fd8600b61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.161+0000 7fd85ffff640 1 --2- 172.21.15.44:0/1837535485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8600cf180 0x7fd8600cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.161+0000 7fd85effd640 1 -- 172.21.15.44:0/1837535485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8600cf180 msgr2=0x7fd8600cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.161+0000 7fd85effd640 1 --2- 172.21.15.44:0/1837535485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8600cf180 0x7fd8600cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.161+0000 7fd85effd640 1 -- 172.21.15.44:0/1837535485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8500093a0 con 0x7fd8600ceda0 2023-11-04T01:43:05.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.161+0000 7fd85effd640 1 --2- 172.21.15.44:0/1837535485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8600ceda0 0x7fd8600c8710 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fd85400c7f0 tx=0x7fd85400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.161+0000 7fd847fff640 1 -- 172.21.15.44:0/1837535485 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854007820 con 0x7fd8600ceda0 2023-11-04T01:43:05.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.161+0000 7fd847fff640 1 -- 172.21.15.44:0/1837535485 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd854007980 con 0x7fd8600ceda0 2023-11-04T01:43:05.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.161+0000 7fd865b6e640 1 -- 172.21.15.44:0/1837535485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8600b2c70 con 0x7fd8600ceda0 2023-11-04T01:43:05.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.161+0000 7fd847fff640 1 -- 172.21.15.44:0/1837535485 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854007cf0 con 0x7fd8600ceda0 2023-11-04T01:43:05.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.161+0000 7fd865b6e640 1 -- 172.21.15.44:0/1837535485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8600c8c50 con 0x7fd8600ceda0 2023-11-04T01:43:05.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.162+0000 7fd865b6e640 1 -- 172.21.15.44:0/1837535485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8600b3470 con 0x7fd8600ceda0 2023-11-04T01:43:05.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.163+0000 7fd847fff640 1 -- 172.21.15.44:0/1837535485 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd8540113f0 con 0x7fd8600ceda0 2023-11-04T01:43:05.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.163+0000 7fd847fff640 1 --2- 172.21.15.44:0/1837535485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd84c06ae70 0x7fd84c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.163+0000 7fd847fff640 1 -- 172.21.15.44:0/1837535485 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7fd85408a1c0 con 0x7fd8600ceda0 2023-11-04T01:43:05.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.163+0000 7fd85f7fe640 1 --2- 172.21.15.44:0/1837535485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd84c06ae70 0x7fd84c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.164+0000 7fd85f7fe640 1 --2- 172.21.15.44:0/1837535485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd84c06ae70 0x7fd84c06d330 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd850036000 tx=0x7fd850008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.167+0000 7fd847fff640 1 -- 172.21.15.44:0/1837535485 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd8600b3470 con 0x7fd8600ceda0 2023-11-04T01:43:05.195 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:43:05.194+0000 7f10df7fe640 -1 client.8337 mds.1 rejected us (blocklisted (blacklisted)) 2023-11-04T01:43:05.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.346+0000 7fd865b6e640 1 -- 172.21.15.44:0/1837535485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8600684b0 con 0x7fd8600ceda0 2023-11-04T01:43:05.348 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.346+0000 7fd847fff640 1 -- 172.21.15.44:0/1837535485 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd8540549d0 con 0x7fd8600ceda0 2023-11-04T01:43:05.348 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:43:05.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.348+0000 7fd865b6e640 1 -- 172.21.15.44:0/1837535485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd84c06ae70 msgr2=0x7fd84c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.348+0000 7fd865b6e640 1 --2- 172.21.15.44:0/1837535485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd84c06ae70 0x7fd84c06d330 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd850036000 tx=0x7fd850008030 comp rx=0 tx=0).stop 2023-11-04T01:43:05.350 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.348+0000 7fd865b6e640 1 -- 172.21.15.44:0/1837535485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8600ceda0 msgr2=0x7fd8600c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.348+0000 7fd865b6e640 1 --2- 172.21.15.44:0/1837535485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8600ceda0 0x7fd8600c8710 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fd85400c7f0 tx=0x7fd85400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.348+0000 7fd865b6e640 1 -- 172.21.15.44:0/1837535485 shutdown_connections 2023-11-04T01:43:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.348+0000 7fd865b6e640 1 --2- 172.21.15.44:0/1837535485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd84c06ae70 0x7fd84c06d330 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.348+0000 7fd865b6e640 1 --2- 172.21.15.44:0/1837535485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8600cf180 0x7fd8600cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.348+0000 7fd865b6e640 1 --2- 172.21.15.44:0/1837535485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8600ceda0 0x7fd8600c8710 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.348+0000 7fd865b6e640 1 --2- 172.21.15.44:0/1837535485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8600b2210 0x7fd8600b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.348+0000 7fd865b6e640 1 -- 172.21.15.44:0/1837535485 >> 172.21.15.44:0/1837535485 conn(0x7fd8600d0c30 msgr2=0x7fd8600af690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.348+0000 7fd865b6e640 1 -- 172.21.15.44:0/1837535485 shutdown_connections 2023-11-04T01:43:05.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.348+0000 7fd865b6e640 1 -- 172.21.15.44:0/1837535485 wait complete. 2023-11-04T01:43:05.361 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:05.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.468+0000 7f4c487d7640 1 Processor -- start 2023-11-04T01:43:05.470 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.468+0000 7f4c487d7640 1 -- start start 2023-11-04T01:43:05.471 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.469+0000 7f4c487d7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4c4015d100 0x7f4c400ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.469+0000 7f4c487d7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4c4015d4e0 0x7f4c400d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.469+0000 7f4c487d7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c400b32b0 con 0x7f4c400d3b60 2023-11-04T01:43:05.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.469+0000 7f4c487d7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c400cee10 con 0x7f4c4015d100 2023-11-04T01:43:05.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.469+0000 7f4c487d7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c400b4750 con 0x7f4c4015d4e0 2023-11-04T01:43:05.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.469+0000 7f4c46573640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4c4015d100 0x7f4c400ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.469+0000 7f4c46d74640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4c400d3b60 0x7f4c400cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60036/0 (socket says 172.21.15.44:60036) 2023-11-04T01:43:05.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.469+0000 7f4c46d74640 1 -- 172.21.15.44:0/3705166801 learned_addr learned my addr 172.21.15.44:0/3705166801 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:05.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.469+0000 7f4c45d72640 1 --2- 172.21.15.44:0/3705166801 >> v2:172.21.15.204:3300/0 conn(0x7f4c4015d4e0 0x7f4c400d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.469+0000 7f4c46573640 1 -- 172.21.15.44:0/3705166801 >> v2:172.21.15.204:3300/0 conn(0x7f4c4015d4e0 msgr2=0x7f4c400d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.469+0000 7f4c46573640 1 --2- 172.21.15.44:0/3705166801 >> v2:172.21.15.204:3300/0 conn(0x7f4c4015d4e0 0x7f4c400d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.472 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.469+0000 7f4c46573640 1 -- 172.21.15.44:0/3705166801 >> v1:172.21.15.44:6789/0 conn(0x7f4c400d3b60 legacy=0x7f4c400cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.469+0000 7f4c45571640 1 -- 172.21.15.44:0/3705166801 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176173800 0 0) 0x7f4c400b32b0 con 0x7f4c400d3b60 2023-11-04T01:43:05.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.470+0000 7f4c46573640 1 -- 172.21.15.44:0/3705166801 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c400b2980 con 0x7f4c4015d100 2023-11-04T01:43:05.473 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.470+0000 7f4c45d72640 1 --2- 172.21.15.44:0/3705166801 >> v2:172.21.15.204:3300/0 conn(0x7f4c4015d4e0 0x7f4c400d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:05.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.470+0000 7f4c46573640 1 --2- 172.21.15.44:0/3705166801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c4015d100 0x7f4c400ce510 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f4c40160da0 tx=0x7f4c3c02bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1e6a8f2f52adf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.470+0000 7f4c45571640 1 -- 172.21.15.44:0/3705166801 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c02ccb0 con 0x7f4c4015d100 2023-11-04T01:43:05.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.470+0000 7f4c45571640 1 -- 172.21.15.44:0/3705166801 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c02ce10 con 0x7f4c4015d100 2023-11-04T01:43:05.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.470+0000 7f4c45571640 1 -- 172.21.15.44:0/3705166801 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c034660 con 0x7f4c4015d100 2023-11-04T01:43:05.474 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.471+0000 7f4c487d7640 1 -- 172.21.15.44:0/3705166801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c4015d100 msgr2=0x7f4c400ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.471+0000 7f4c487d7640 1 --2- 172.21.15.44:0/3705166801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c4015d100 0x7f4c400ce510 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f4c40160da0 tx=0x7f4c3c02bf00 comp rx=0 tx=0).stop 2023-11-04T01:43:05.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.471+0000 7f4c487d7640 1 -- 172.21.15.44:0/3705166801 shutdown_connections 2023-11-04T01:43:05.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.471+0000 7f4c487d7640 1 --2- 172.21.15.44:0/3705166801 >> v2:172.21.15.204:3300/0 conn(0x7f4c4015d4e0 0x7f4c400d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.471+0000 7f4c487d7640 1 --2- 172.21.15.44:0/3705166801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c4015d100 0x7f4c400ce510 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.471+0000 7f4c487d7640 1 -- 172.21.15.44:0/3705166801 >> 172.21.15.44:0/3705166801 conn(0x7f4c400d2ef0 msgr2=0x7f4c400d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.471+0000 7f4c487d7640 1 -- 172.21.15.44:0/3705166801 shutdown_connections 2023-11-04T01:43:05.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.471+0000 7f4c487d7640 1 -- 172.21.15.44:0/3705166801 wait complete. 2023-11-04T01:43:05.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.472+0000 7f4c487d7640 1 Processor -- start 2023-11-04T01:43:05.475 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.472+0000 7f4c487d7640 1 -- start start 2023-11-04T01:43:05.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.473+0000 7f4c487d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c400d3b60 0x7f4c40160400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.473+0000 7f4c487d7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c4015d100 0x7f4c400b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.473+0000 7f4c487d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c4015d4e0 0x7f4c401523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.473+0000 7f4c487d7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4015d940 con 0x7f4c400d3b60 2023-11-04T01:43:05.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.473+0000 7f4c487d7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4015e4c0 con 0x7f4c4015d100 2023-11-04T01:43:05.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.473+0000 7f4c487d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c400b69c0 con 0x7f4c4015d4e0 2023-11-04T01:43:05.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.473+0000 7f4c46573640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c400d3b60 0x7f4c40160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.473+0000 7f4c46573640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c400d3b60 0x7f4c40160400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44560/0 (socket says 172.21.15.44:44560) 2023-11-04T01:43:05.477 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.473+0000 7f4c46573640 1 -- 172.21.15.44:0/930986290 learned_addr learned my addr 172.21.15.44:0/930986290 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:05.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.473+0000 7f4c46573640 1 -- 172.21.15.44:0/930986290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c4015d4e0 msgr2=0x7f4c401523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.473+0000 7f4c46573640 1 --2- 172.21.15.44:0/930986290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c4015d4e0 0x7f4c401523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.473+0000 7f4c46573640 1 -- 172.21.15.44:0/930986290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c4015d100 msgr2=0x7f4c400b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.473+0000 7f4c46573640 1 --2- 172.21.15.44:0/930986290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c4015d100 0x7f4c400b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.473+0000 7f4c46573640 1 -- 172.21.15.44:0/930986290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c009a70 con 0x7f4c400d3b60 2023-11-04T01:43:05.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.473+0000 7f4c46573640 1 --2- 172.21.15.44:0/930986290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c400d3b60 0x7f4c40160400 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c02c510 tx=0x7f4c3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.474+0000 7f4c36ffd640 1 -- 172.21.15.44:0/930986290 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c040650 con 0x7f4c400d3b60 2023-11-04T01:43:05.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.474+0000 7f4c36ffd640 1 -- 172.21.15.44:0/930986290 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c0407b0 con 0x7f4c400d3b60 2023-11-04T01:43:05.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.474+0000 7f4c487d7640 1 -- 172.21.15.44:0/930986290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4015db90 con 0x7f4c400d3b60 2023-11-04T01:43:05.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.474+0000 7f4c36ffd640 1 -- 172.21.15.44:0/930986290 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c040b60 con 0x7f4c400d3b60 2023-11-04T01:43:05.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.474+0000 7f4c487d7640 1 -- 172.21.15.44:0/930986290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4015e150 con 0x7f4c400d3b60 2023-11-04T01:43:05.478 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.475+0000 7f4c487d7640 1 -- 172.21.15.44:0/930986290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c400684b0 con 0x7f4c400d3b60 2023-11-04T01:43:05.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.475+0000 7f4c36ffd640 1 -- 172.21.15.44:0/930986290 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c3c040cc0 con 0x7f4c400d3b60 2023-11-04T01:43:05.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.476+0000 7f4c36ffd640 1 --2- 172.21.15.44:0/930986290 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4c2406ae70 0x7f4c2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.476+0000 7f4c36ffd640 1 -- 172.21.15.44:0/930986290 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f4c3c0acc10 con 0x7f4c400d3b60 2023-11-04T01:43:05.479 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.476+0000 7f4c45d72640 1 --2- 172.21.15.44:0/930986290 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4c2406ae70 0x7f4c2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.480 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.476+0000 7f4c45d72640 1 --2- 172.21.15.44:0/930986290 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4c2406ae70 0x7f4c2406d330 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4c30006fd0 tx=0x7f4c30008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.482 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.480+0000 7f4c36ffd640 1 -- 172.21.15.44:0/930986290 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c3c0774a0 con 0x7f4c400d3b60 2023-11-04T01:43:05.659 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.658+0000 7f4c487d7640 1 -- 172.21.15.44:0/930986290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4c400d2cd0 con 0x7f4c400d3b60 2023-11-04T01:43:05.660 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.658+0000 7f4c36ffd640 1 -- 172.21.15.44:0/930986290 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4c3c0440a0 con 0x7f4c400d3b60 2023-11-04T01:43:05.660 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:43:05.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.660+0000 7f4c487d7640 1 -- 172.21.15.44:0/930986290 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4c2406ae70 msgr2=0x7f4c2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.660+0000 7f4c487d7640 1 --2- 172.21.15.44:0/930986290 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4c2406ae70 0x7f4c2406d330 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4c30006fd0 tx=0x7f4c30008040 comp rx=0 tx=0).stop 2023-11-04T01:43:05.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.660+0000 7f4c487d7640 1 -- 172.21.15.44:0/930986290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c400d3b60 msgr2=0x7f4c40160400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.660+0000 7f4c487d7640 1 --2- 172.21.15.44:0/930986290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c400d3b60 0x7f4c40160400 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c02c510 tx=0x7f4c3c004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:05.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.660+0000 7f4c487d7640 1 -- 172.21.15.44:0/930986290 shutdown_connections 2023-11-04T01:43:05.662 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.660+0000 7f4c487d7640 1 --2- 172.21.15.44:0/930986290 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4c2406ae70 0x7f4c2406d330 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.660+0000 7f4c487d7640 1 --2- 172.21.15.44:0/930986290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c4015d4e0 0x7f4c401523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.660+0000 7f4c487d7640 1 --2- 172.21.15.44:0/930986290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c4015d100 0x7f4c400b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.660+0000 7f4c487d7640 1 --2- 172.21.15.44:0/930986290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c400d3b60 0x7f4c40160400 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.660+0000 7f4c487d7640 1 -- 172.21.15.44:0/930986290 >> 172.21.15.44:0/930986290 conn(0x7f4c400d2ef0 msgr2=0x7f4c400d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.660+0000 7f4c487d7640 1 -- 172.21.15.44:0/930986290 shutdown_connections 2023-11-04T01:43:05.663 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.660+0000 7f4c487d7640 1 -- 172.21.15.44:0/930986290 wait complete. 2023-11-04T01:43:05.672 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:05.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.777+0000 7f5a8c083640 1 Processor -- start 2023-11-04T01:43:05.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.778+0000 7f5a8c083640 1 -- start start 2023-11-04T01:43:05.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.778+0000 7f5a8c083640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5a840ca1a0 0x7f5a840ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.779+0000 7f5a8c083640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a8406a0d0 0x7f5a8406a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.779+0000 7f5a8c083640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a840b25a0 con 0x7f5a8415d4e0 2023-11-04T01:43:05.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.779+0000 7f5a8c083640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a840cab60 con 0x7f5a840ca1a0 2023-11-04T01:43:05.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.779+0000 7f5a8c083640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840b2300 con 0x7f5a8406a0d0 2023-11-04T01:43:05.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.779+0000 7f5a8961e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5a840ca1a0 0x7f5a840ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.779+0000 7f5a89e1f640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5a8415d4e0 0x7f5a840ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60044/0 (socket says 172.21.15.44:60044) 2023-11-04T01:43:05.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.779+0000 7f5a89e1f640 1 -- 172.21.15.44:0/1646923427 learned_addr learned my addr 172.21.15.44:0/1646923427 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:05.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.779+0000 7f5a8a620640 1 --2- 172.21.15.44:0/1646923427 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a8406a0d0 0x7f5a8406a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.779+0000 7f5a8961e640 1 -- 172.21.15.44:0/1646923427 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a8406a0d0 msgr2=0x7f5a8406a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.779+0000 7f5a8961e640 1 --2- 172.21.15.44:0/1646923427 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a8406a0d0 0x7f5a8406a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.779+0000 7f5a8961e640 1 -- 172.21.15.44:0/1646923427 >> v1:172.21.15.44:6789/0 conn(0x7f5a8415d4e0 legacy=0x7f5a840ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.779+0000 7f5a8961e640 1 -- 172.21.15.44:0/1646923427 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8415d8c0 con 0x7f5a840ca1a0 2023-11-04T01:43:05.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.780+0000 7f5a8961e640 1 --2- 172.21.15.44:0/1646923427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a840ca1a0 0x7f5a840ca620 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f5a740097a0 tx=0x7f5a7402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80572121af26075f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.780+0000 7f5a88e1d640 1 -- 172.21.15.44:0/1646923427 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7402e070 con 0x7f5a840ca1a0 2023-11-04T01:43:05.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.780+0000 7f5a88e1d640 1 -- 172.21.15.44:0/1646923427 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a740315a0 con 0x7f5a840ca1a0 2023-11-04T01:43:05.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.780+0000 7f5a88e1d640 1 -- 172.21.15.44:0/1646923427 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74031930 con 0x7f5a840ca1a0 2023-11-04T01:43:05.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.780+0000 7f5a8c083640 1 -- 172.21.15.44:0/1646923427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a840ca1a0 msgr2=0x7f5a840ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.783 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.780+0000 7f5a8c083640 1 --2- 172.21.15.44:0/1646923427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a840ca1a0 0x7f5a840ca620 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f5a740097a0 tx=0x7f5a7402b840 comp rx=0 tx=0).stop 2023-11-04T01:43:05.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.780+0000 7f5a8c083640 1 -- 172.21.15.44:0/1646923427 shutdown_connections 2023-11-04T01:43:05.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.780+0000 7f5a8c083640 1 --2- 172.21.15.44:0/1646923427 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a8406a0d0 0x7f5a8406a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.781+0000 7f5a8c083640 1 --2- 172.21.15.44:0/1646923427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a840ca1a0 0x7f5a840ca620 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.781+0000 7f5a8c083640 1 -- 172.21.15.44:0/1646923427 >> 172.21.15.44:0/1646923427 conn(0x7f5a840b1640 msgr2=0x7f5a840b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.781+0000 7f5a8c083640 1 -- 172.21.15.44:0/1646923427 shutdown_connections 2023-11-04T01:43:05.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.781+0000 7f5a8c083640 1 -- 172.21.15.44:0/1646923427 wait complete. 2023-11-04T01:43:05.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.782+0000 7f5a8c083640 1 Processor -- start 2023-11-04T01:43:05.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.782+0000 7f5a8c083640 1 -- start start 2023-11-04T01:43:05.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8c083640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a8406a0d0 0x7f5a84154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8c083640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a840ca1a0 0x7f5a840c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8c083640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a8415d4e0 0x7f5a840c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8c083640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840c8c00 con 0x7f5a8415d4e0 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8c083640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a841552c0 con 0x7f5a8406a0d0 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8c083640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840c7ff0 con 0x7f5a840ca1a0 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8a620640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a8415d4e0 0x7f5a840c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8a620640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a8415d4e0 0x7f5a840c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44570/0 (socket says 172.21.15.44:44570) 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8a620640 1 -- 172.21.15.44:0/3053866326 learned_addr learned my addr 172.21.15.44:0/3053866326 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8961e640 1 --2- 172.21.15.44:0/3053866326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a840ca1a0 0x7f5a840c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a89e1f640 1 --2- 172.21.15.44:0/3053866326 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a8406a0d0 0x7f5a84154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8a620640 1 -- 172.21.15.44:0/3053866326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a840ca1a0 msgr2=0x7f5a840c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8a620640 1 --2- 172.21.15.44:0/3053866326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a840ca1a0 0x7f5a840c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8a620640 1 -- 172.21.15.44:0/3053866326 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a8406a0d0 msgr2=0x7f5a84154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8a620640 1 --2- 172.21.15.44:0/3053866326 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a8406a0d0 0x7f5a84154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8a620640 1 -- 172.21.15.44:0/3053866326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a74009400 con 0x7f5a8415d4e0 2023-11-04T01:43:05.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a89e1f640 1 --2- 172.21.15.44:0/3053866326 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a8406a0d0 0x7f5a84154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:05.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8a620640 1 --2- 172.21.15.44:0/3053866326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a8415d4e0 0x7f5a840c5de0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c007e40 tx=0x7f5a7c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a7a7fc640 1 -- 172.21.15.44:0/3053866326 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c014620 con 0x7f5a8415d4e0 2023-11-04T01:43:05.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a7a7fc640 1 -- 172.21.15.44:0/3053866326 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c00ee90 con 0x7f5a8415d4e0 2023-11-04T01:43:05.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a7a7fc640 1 -- 172.21.15.44:0/3053866326 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c0149e0 con 0x7f5a8415d4e0 2023-11-04T01:43:05.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8c083640 1 -- 172.21.15.44:0/3053866326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a840c82d0 con 0x7f5a8415d4e0 2023-11-04T01:43:05.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.783+0000 7f5a8c083640 1 -- 172.21.15.44:0/3053866326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a840c8890 con 0x7f5a8415d4e0 2023-11-04T01:43:05.788 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.785+0000 7f5a8c083640 1 -- 172.21.15.44:0/3053866326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a840c8d70 con 0x7f5a8415d4e0 2023-11-04T01:43:05.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.785+0000 7f5a7a7fc640 1 -- 172.21.15.44:0/3053866326 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a7c014b40 con 0x7f5a8415d4e0 2023-11-04T01:43:05.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.785+0000 7f5a7a7fc640 1 --2- 172.21.15.44:0/3053866326 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a6806ae70 0x7f5a6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.786+0000 7f5a7a7fc640 1 -- 172.21.15.44:0/3053866326 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f5a7c08a850 con 0x7f5a8415d4e0 2023-11-04T01:43:05.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.786+0000 7f5a89e1f640 1 --2- 172.21.15.44:0/3053866326 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a6806ae70 0x7f5a6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.786+0000 7f5a89e1f640 1 --2- 172.21.15.44:0/3053866326 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a6806ae70 0x7f5a6806d330 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5a80007fd0 tx=0x7f5a80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.790+0000 7f5a7a7fc640 1 -- 172.21.15.44:0/3053866326 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a7c0550e0 con 0x7f5a8415d4e0 2023-11-04T01:43:05.980 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.978+0000 7f5a8c083640 1 -- 172.21.15.44:0/3053866326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5a840684b0 con 0x7f5a8415d4e0 2023-11-04T01:43:05.980 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.978+0000 7f5a7a7fc640 1 -- 172.21.15.44:0/3053866326 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 18 entries v111) v1 ==== 81+0+1097 (secure 0 0 0) 0x7f5a7c058700 con 0x7f5a8415d4e0 2023-11-04T01:43:05.981 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.1:0/1398028154 2023-11-04T02:42:59.149511+0000 2023-11-04T01:43:05.981 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/3267689413 2023-11-05T01:42:50.946757+0000 2023-11-04T01:43:05.981 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/3264332323 2023-11-05T01:42:44.043453+0000 2023-11-04T01:43:05.981 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/3264332323 2023-11-05T01:42:44.043453+0000 2023-11-04T01:43:05.981 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6832/2069525699 2023-11-05T01:42:05.849526+0000 2023-11-04T01:43:05.981 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/3267689413 2023-11-05T01:42:50.946757+0000 2023-11-04T01:43:05.981 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/2461924520 2023-11-05T01:40:15.032018+0000 2023-11-04T01:43:05.981 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/3287638895 2023-11-05T01:41:58.941997+0000 2023-11-04T01:43:05.981 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/2069525699 2023-11-05T01:42:05.849526+0000 2023-11-04T01:43:05.981 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/2252282753 2023-11-05T01:40:40.408324+0000 2023-11-04T01:43:05.982 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/2252282753 2023-11-05T01:40:40.408324+0000 2023-11-04T01:43:05.982 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/2461924520 2023-11-05T01:40:15.032018+0000 2023-11-04T01:43:05.982 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.1:0/780133444 2023-11-04T02:42:14.050728+0000 2023-11-04T01:43:05.982 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/1627866359 2023-11-05T01:41:31.011032+0000 2023-11-04T01:43:05.982 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/1627866359 2023-11-05T01:41:31.011032+0000 2023-11-04T01:43:05.982 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/3065829953 2023-11-05T01:41:05.691698+0000 2023-11-04T01:43:05.982 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/3287638895 2023-11-05T01:41:58.941997+0000 2023-11-04T01:43:05.982 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/3065829953 2023-11-05T01:41:05.691698+0000 2023-11-04T01:43:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:listed 18 entries 2023-11-04T01:43:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.980+0000 7f5a8c083640 1 -- 172.21.15.44:0/3053866326 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a6806ae70 msgr2=0x7f5a6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.980+0000 7f5a8c083640 1 --2- 172.21.15.44:0/3053866326 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a6806ae70 0x7f5a6806d330 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5a80007fd0 tx=0x7f5a80009040 comp rx=0 tx=0).stop 2023-11-04T01:43:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.980+0000 7f5a8c083640 1 -- 172.21.15.44:0/3053866326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a8415d4e0 msgr2=0x7f5a840c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.980+0000 7f5a8c083640 1 --2- 172.21.15.44:0/3053866326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a8415d4e0 0x7f5a840c5de0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c007e40 tx=0x7f5a7c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.980+0000 7f5a8c083640 1 -- 172.21.15.44:0/3053866326 shutdown_connections 2023-11-04T01:43:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.980+0000 7f5a8c083640 1 --2- 172.21.15.44:0/3053866326 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a6806ae70 0x7f5a6806d330 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.980+0000 7f5a8c083640 1 --2- 172.21.15.44:0/3053866326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a8415d4e0 0x7f5a840c5de0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.980+0000 7f5a8c083640 1 --2- 172.21.15.44:0/3053866326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a840ca1a0 0x7f5a840c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.980+0000 7f5a8c083640 1 --2- 172.21.15.44:0/3053866326 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a8406a0d0 0x7f5a84154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.980+0000 7f5a8c083640 1 -- 172.21.15.44:0/3053866326 >> 172.21.15.44:0/3053866326 conn(0x7f5a840b1640 msgr2=0x7f5a8415c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.981+0000 7f5a8c083640 1 -- 172.21.15.44:0/3053866326 shutdown_connections 2023-11-04T01:43:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:05.981+0000 7f5a8c083640 1 -- 172.21.15.44:0/3053866326 wait complete. 2023-11-04T01:43:05.993 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:43:05.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:05.993 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:06.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[123203]: fuse finished with error 0 and tester_r 0 2023-11-04T01:43:06.024 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:43:06.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:06.025 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:43:06.080 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:43:06.080 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:06.136 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:43:06.136 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:43:06.201 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:43:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:06.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.283+0000 7f63c181a640 1 Processor -- start 2023-11-04T01:43:06.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.284+0000 7f63c181a640 1 -- start start 2023-11-04T01:43:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.284+0000 7f63c181a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc15d100 0x7f63bc0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.284+0000 7f63c181a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f63bc0d1be0 0x7f63bc0b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.284+0000 7f63c181a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63bc0b32b0 con 0x7f63bc15d4e0 2023-11-04T01:43:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.284+0000 7f63c181a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63bc0cee10 con 0x7f63bc0d1be0 2023-11-04T01:43:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.284+0000 7f63c181a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc0b2980 con 0x7f63bc15d100 2023-11-04T01:43:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.284+0000 7f63bb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f63bc0d1be0 0x7f63bc0b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.285+0000 7f63bb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f63bc0d1be0 0x7f63bc0b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44574/0 (socket says 172.21.15.44:44574) 2023-11-04T01:43:06.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.285+0000 7f63bb7fe640 1 -- 172.21.15.44:0/3107041364 learned_addr learned my addr 172.21.15.44:0/3107041364 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:06.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.285+0000 7f63baffd640 1 --2- 172.21.15.44:0/3107041364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc15d100 0x7f63bc0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.285+0000 7f63bb7fe640 1 -- 172.21.15.44:0/3107041364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc15d100 msgr2=0x7f63bc0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:06.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.285+0000 7f63bb7fe640 1 --2- 172.21.15.44:0/3107041364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc15d100 0x7f63bc0ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.285+0000 7f63bb7fe640 1 -- 172.21.15.44:0/3107041364 >> v1:172.21.15.204:6789/0 conn(0x7f63bc15d4e0 legacy=0x7f63bc0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.285+0000 7f63bb7fe640 1 -- 172.21.15.44:0/3107041364 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc0b2c60 con 0x7f63bc0d1be0 2023-11-04T01:43:06.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.286+0000 7f63bb7fe640 1 --2- 172.21.15.44:0/3107041364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63bc0d1be0 0x7f63bc0b3740 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009e80 tx=0x7f63ac02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63449ac3cd087514 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:06.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.286+0000 7f63b9ffb640 1 -- 172.21.15.44:0/3107041364 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac02caf0 con 0x7f63bc0d1be0 2023-11-04T01:43:06.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.286+0000 7f63b9ffb640 1 -- 172.21.15.44:0/3107041364 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac02cc50 con 0x7f63bc0d1be0 2023-11-04T01:43:06.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.286+0000 7f63b9ffb640 1 -- 172.21.15.44:0/3107041364 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0343f0 con 0x7f63bc0d1be0 2023-11-04T01:43:06.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.286+0000 7f63c181a640 1 -- 172.21.15.44:0/3107041364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63bc0d1be0 msgr2=0x7f63bc0b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.289 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.286+0000 7f63c181a640 1 --2- 172.21.15.44:0/3107041364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63bc0d1be0 0x7f63bc0b3740 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009e80 tx=0x7f63ac02bf50 comp rx=0 tx=0).stop 2023-11-04T01:43:06.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.286+0000 7f63c181a640 1 -- 172.21.15.44:0/3107041364 shutdown_connections 2023-11-04T01:43:06.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.286+0000 7f63c181a640 1 --2- 172.21.15.44:0/3107041364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63bc0d1be0 0x7f63bc0b3740 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.286+0000 7f63c181a640 1 --2- 172.21.15.44:0/3107041364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc15d100 0x7f63bc0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.286+0000 7f63c181a640 1 -- 172.21.15.44:0/3107041364 >> 172.21.15.44:0/3107041364 conn(0x7f63bc0d2ef0 msgr2=0x7f63bc0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:06.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.286+0000 7f63c181a640 1 -- 172.21.15.44:0/3107041364 shutdown_connections 2023-11-04T01:43:06.290 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.286+0000 7f63c181a640 1 -- 172.21.15.44:0/3107041364 wait complete. 2023-11-04T01:43:06.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.287+0000 7f63c181a640 1 Processor -- start 2023-11-04T01:43:06.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.288+0000 7f63c181a640 1 -- start start 2023-11-04T01:43:06.292 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.288+0000 7f63c181a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63bc0d1be0 0x7f63bc0b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.288+0000 7f63c181a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc15d100 0x7f63bc0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.288+0000 7f63c181a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63bc15d4e0 0x7f63bc151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.288+0000 7f63c181a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc0b62c0 con 0x7f63bc15d4e0 2023-11-04T01:43:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.288+0000 7f63c181a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc0b65a0 con 0x7f63bc0d1be0 2023-11-04T01:43:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.288+0000 7f63c181a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc0b6880 con 0x7f63bc15d100 2023-11-04T01:43:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63bb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63bc15d4e0 0x7f63bc151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63bb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63bc15d4e0 0x7f63bc151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44586/0 (socket says 172.21.15.44:44586) 2023-11-04T01:43:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63bb7fe640 1 -- 172.21.15.44:0/3402549713 learned_addr learned my addr 172.21.15.44:0/3402549713 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63baffd640 1 --2- 172.21.15.44:0/3402549713 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63bc0d1be0 0x7f63bc0b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63ba7fc640 1 --2- 172.21.15.44:0/3402549713 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc15d100 0x7f63bc0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63bb7fe640 1 -- 172.21.15.44:0/3402549713 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc15d100 msgr2=0x7f63bc0b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63bb7fe640 1 --2- 172.21.15.44:0/3402549713 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc15d100 0x7f63bc0b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63bb7fe640 1 -- 172.21.15.44:0/3402549713 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63bc0d1be0 msgr2=0x7f63bc0b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63bb7fe640 1 --2- 172.21.15.44:0/3402549713 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63bc0d1be0 0x7f63bc0b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63bb7fe640 1 -- 172.21.15.44:0/3402549713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac009b30 con 0x7f63bc15d4e0 2023-11-04T01:43:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63bb7fe640 1 --2- 172.21.15.44:0/3402549713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63bc15d4e0 0x7f63bc151300 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f63ac036040 tx=0x7f63ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63b3fff640 1 -- 172.21.15.44:0/3402549713 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac009510 con 0x7f63bc15d4e0 2023-11-04T01:43:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63b3fff640 1 -- 172.21.15.44:0/3402549713 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac03e450 con 0x7f63bc15d4e0 2023-11-04T01:43:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63c181a640 1 -- 172.21.15.44:0/3402549713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63bc0b6b60 con 0x7f63bc15d4e0 2023-11-04T01:43:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63b3fff640 1 -- 172.21.15.44:0/3402549713 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac03e7e0 con 0x7f63bc15d4e0 2023-11-04T01:43:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.289+0000 7f63c181a640 1 -- 172.21.15.44:0/3402549713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63bc0b5fb0 con 0x7f63bc15d4e0 2023-11-04T01:43:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.290+0000 7f63c181a640 1 -- 172.21.15.44:0/3402549713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63bc0684b0 con 0x7f63bc15d4e0 2023-11-04T01:43:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.291+0000 7f63b3fff640 1 -- 172.21.15.44:0/3402549713 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f63ac03e940 con 0x7f63bc15d4e0 2023-11-04T01:43:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.291+0000 7f63b3fff640 1 --2- 172.21.15.44:0/3402549713 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f639c06ae70 0x7f639c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.291+0000 7f63b3fff640 1 -- 172.21.15.44:0/3402549713 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f63ac0aca30 con 0x7f63bc15d4e0 2023-11-04T01:43:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.291+0000 7f63baffd640 1 --2- 172.21.15.44:0/3402549713 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f639c06ae70 0x7f639c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.292+0000 7f63baffd640 1 --2- 172.21.15.44:0/3402549713 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f639c06ae70 0x7f639c06d330 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f63b4009b30 tx=0x7f63b4009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:06.297 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.295+0000 7f63b3fff640 1 -- 172.21.15.44:0/3402549713 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f63ac0772e0 con 0x7f63bc15d4e0 2023-11-04T01:43:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.508+0000 7f63c181a640 1 -- 172.21.15.44:0/3402549713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f63bc0d2cd0 con 0x7f63bc15d4e0 2023-11-04T01:43:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.508+0000 7f63b3fff640 1 -- 172.21.15.44:0/3402549713 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v107) v1 ==== 53+0+73 (secure 0 0 0) 0x7f63ac043060 con 0x7f63bc15d4e0 2023-11-04T01:43:06.510 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:43:06.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.510+0000 7f63c181a640 1 -- 172.21.15.44:0/3402549713 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f639c06ae70 msgr2=0x7f639c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.510+0000 7f63c181a640 1 --2- 172.21.15.44:0/3402549713 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f639c06ae70 0x7f639c06d330 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f63b4009b30 tx=0x7f63b4009110 comp rx=0 tx=0).stop 2023-11-04T01:43:06.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.510+0000 7f63c181a640 1 -- 172.21.15.44:0/3402549713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63bc15d4e0 msgr2=0x7f63bc151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.510+0000 7f63c181a640 1 --2- 172.21.15.44:0/3402549713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63bc15d4e0 0x7f63bc151300 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f63ac036040 tx=0x7f63ac004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:06.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.510+0000 7f63c181a640 1 -- 172.21.15.44:0/3402549713 shutdown_connections 2023-11-04T01:43:06.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.510+0000 7f63c181a640 1 --2- 172.21.15.44:0/3402549713 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f639c06ae70 0x7f639c06d330 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.510+0000 7f63c181a640 1 --2- 172.21.15.44:0/3402549713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63bc15d4e0 0x7f63bc151300 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.510+0000 7f63c181a640 1 --2- 172.21.15.44:0/3402549713 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc15d100 0x7f63bc0b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.510+0000 7f63c181a640 1 --2- 172.21.15.44:0/3402549713 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63bc0d1be0 0x7f63bc0b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.510+0000 7f63c181a640 1 -- 172.21.15.44:0/3402549713 >> 172.21.15.44:0/3402549713 conn(0x7f63bc0d2ef0 msgr2=0x7f63bc0b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:06.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.510+0000 7f63c181a640 1 -- 172.21.15.44:0/3402549713 shutdown_connections 2023-11-04T01:43:06.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:06.510+0000 7f63c181a640 1 -- 172.21.15.44:0/3402549713 wait complete. 2023-11-04T01:43:06.522 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:43:06.522 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:43:06.522 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2023-11-04T01:43:06.522 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:43:06.523 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:06.523 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:43:06.523 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:43:06.523 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:43:06.523 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:06.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:06.523 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2023-11-04T01:43:06.579 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:43:06.579 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:43:06.579 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:43:06.579 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:06.580 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2023-11-04T01:43:06.580 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:06.580 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:06.580 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:06.580 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2023-11-04T01:43:06.580 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:06.580 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:06.580 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2023-11-04T01:43:06.580 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:43:06.581 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:06.581 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2023-11-04T01:43:06.581 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-04T01:43:06.581 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42083sec preferred_lft 42083sec 2023-11-04T01:43:06.581 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2023-11-04T01:43:06.581 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:06.581 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:06.581 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:06.581 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2023-11-04T01:43:06.581 INFO:teuthology.orchestra.run.smithi044.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:43:06.581 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:06.582 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:43:06.582 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:06.582 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::9082:77ff:fe28:4353/64 scope link 2023-11-04T01:43:06.582 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:06.582 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:06.582 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:06.582 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::e49d:e3ff:fe56:d068/64 scope link 2023-11-04T01:43:06.582 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:06.583 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:06.583 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether f2:23:83:31:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:06.583 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::f023:83ff:fe31:915/64 scope link 2023-11-04T01:43:06.583 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:06.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:06.583 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:43:06.649 INFO:teuthology.orchestra.run.smithi044.stdout:1 2023-11-04T01:43:06.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:06.651 DEBUG:teuthology.orchestra.run.smithi044:> route 2023-11-04T01:43:06.707 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2023-11-04T01:43:06.707 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:43:06.707 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-04T01:43:06.707 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-04T01:43:06.708 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:43:06.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:06.708 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:43:06.708 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:43:06.708 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:43:06.708 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:43:06.708 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:43:06.708 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:43:06.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:06.814 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2023-11-04T01:43:06.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:43:06.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:43:06.830 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:06.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:06.830 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2023-11-04T01:43:06.900 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:43:06.900 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:06.900 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:06.956 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:06.956 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:06.956 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:07.012 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:07.068 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:43:07.068 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:43:07.068 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:43:07.069 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:43:07.069 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:43:07.069 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:43:07.069 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:43:07.069 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:43:07.069 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:43:07.069 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:43:07.069 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:43:07.069 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:43:07.069 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:07.069 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:43:07.069 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:43:07.070 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:43:07.070 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:43:07.070 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:07.070 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:43:07.070 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:07.070 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:07.070 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:07.070 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:07.070 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:43:07.070 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:43:07.070 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:07.070 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:07.070 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:07.071 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:07.071 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:43:07.071 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:07.071 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:07.071 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:07.071 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:07.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:07.071 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:43:07.123 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:43:07.123 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:43:07.166 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:07.181 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:43:07.182 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:43:07.182 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:43:07.182 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:43:07.182 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:43:07.182 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:43:07.182 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:43:07.182 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:43:07.182 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:43:07.182 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:43:07.182 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:43:07.182 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:43:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:43:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:43:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:43:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:43:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:43:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:43:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:43:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:07.184 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:07.184 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:07.184 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:43:07.184 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:07.184 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:07.184 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:07.184 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:07.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:07.184 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:43:07.264 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:43:07.263+0000 7f5dccc34480 -1 init, newargv = 0x563b93e26a90 newargc=15 2023-11-04T01:43:07.265 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[125389]: starting ceph client 2023-11-04T01:43:07.271 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[125389]: starting fuse 2023-11-04T01:43:08.338 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:08.358 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:43:08.358 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:43:08.358 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:08.361 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:08.361 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:43:08.361 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:08.361 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:08.361 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:08.361 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:08.361 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:08.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:08.361 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:43:08.418 INFO:teuthology.orchestra.run.smithi044.stdout:41 2023-11-04T01:43:08.418 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:43:08.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:43:08.419 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2023-11-04T01:43:08.419 DEBUG:teuthology.orchestra.run.smithi044:> import re 2023-11-04T01:43:08.419 DEBUG:teuthology.orchestra.run.smithi044:> import os 2023-11-04T01:43:08.419 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2023-11-04T01:43:08.419 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:43:08.419 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2023-11-04T01:43:08.419 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:43:08.420 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2023-11-04T01:43:08.420 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:43:08.420 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:43:08.420 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2023-11-04T01:43:08.420 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2023-11-04T01:43:08.420 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2023-11-04T01:43:08.420 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2023-11-04T01:43:08.421 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:43:08.421 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2023-11-04T01:43:08.421 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:43:08.421 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:43:08.421 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:43:08.421 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2023-11-04T01:43:08.421 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2023-11-04T01:43:08.422 DEBUG:teuthology.orchestra.run.smithi044:> return f 2023-11-04T01:43:08.422 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:43:08.422 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:43:08.422 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2023-11-04T01:43:08.422 DEBUG:teuthology.orchestra.run.smithi044:> ' 2023-11-04T01:43:08.553 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.125389.asok 2023-11-04T01:43:08.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:08.565 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.125389.asok 2023-11-04T01:43:08.566 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:08.566 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.125389.asok status 2023-11-04T01:43:08.671 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:08.744 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:43:08.744 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2023-11-04T01:43:08.744 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:43:08.744 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:43:08.744 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2023-11-04T01:43:08.744 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2023-11-04T01:43:08.744 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:43:08.745 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "125389", 2023-11-04T01:43:08.745 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2023-11-04T01:43:08.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:43:08.745 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2023-11-04T01:43:08.745 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2023-11-04T01:43:08.745 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 8604, 2023-11-04T01:43:08.745 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2023-11-04T01:43:08.745 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2023-11-04T01:43:08.745 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2023-11-04T01:43:08.745 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 8604 2023-11-04T01:43:08.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:43:08.746 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:43:08.746 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:43:08.746 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:08.746 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1480686415 2023-11-04T01:43:08.746 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:43:08.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:43:08.746 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:43:08.746 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:43:08.746 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:08.746 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1480686415 2023-11-04T01:43:08.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:43:08.747 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.8604 192.168.0.1:0/1480686415", 2023-11-04T01:43:08.747 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/1480686415", 2023-11-04T01:43:08.747 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2023-11-04T01:43:08.747 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 107, 2023-11-04T01:43:08.747 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 111, 2023-11-04T01:43:08.747 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:43:08.747 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2023-11-04T01:43:08.747 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2023-11-04T01:43:08.747 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:43:08.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:08.758 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:08.758 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:43:08.758 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:08.821 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:08.822 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2023-11-04T01:43:08.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:08.828 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:08.829 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:08.829 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:08.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:08.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:08.899 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:43:09.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.004+0000 7f9821256640 1 Processor -- start 2023-11-04T01:43:09.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.004+0000 7f9821256640 1 -- start start 2023-11-04T01:43:09.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.005+0000 7f9821256640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f981c15d4e0 0x7f981c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.005+0000 7f9821256640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981c0b32b0 con 0x7f981c15d100 2023-11-04T01:43:09.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.005+0000 7f9821256640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981c0cee10 con 0x7f981c0d3b60 2023-11-04T01:43:09.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.005+0000 7f9821256640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c0cec20 con 0x7f981c15d4e0 2023-11-04T01:43:09.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.005+0000 7f981ad9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f981c15d100 0x7f981c0ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60050/0 (socket says 172.21.15.44:60050) 2023-11-04T01:43:09.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.005+0000 7f981ad9d640 1 -- 172.21.15.44:0/3258400851 learned_addr learned my addr 172.21.15.44:0/3258400851 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:09.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.005+0000 7f981a59c640 1 --2- 172.21.15.44:0/3258400851 >> v2:172.21.15.44:3300/0 conn(0x7f981c15d4e0 0x7f981c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.006+0000 7f9819d9b640 1 -- 172.21.15.44:0/3258400851 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116772097 0 0) 0x7f981c0b32b0 con 0x7f981c15d100 2023-11-04T01:43:09.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.006+0000 7f9819d9b640 1 -- 172.21.15.44:0/3258400851 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9808003520 con 0x7f981c15d100 2023-11-04T01:43:09.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.006+0000 7f981a59c640 1 -- 172.21.15.44:0/3258400851 >> v1:172.21.15.204:6789/0 conn(0x7f981c0d3b60 legacy=0x7f981c0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.006+0000 7f981a59c640 1 -- 172.21.15.44:0/3258400851 >> v1:172.21.15.44:6789/0 conn(0x7f981c15d100 legacy=0x7f981c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.006+0000 7f981a59c640 1 -- 172.21.15.44:0/3258400851 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c0b2980 con 0x7f981c15d4e0 2023-11-04T01:43:09.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.006+0000 7f981a59c640 1 --2- 172.21.15.44:0/3258400851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f981c15d4e0 0x7f981c0d14d0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f98040097a0 tx=0x7f980402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a9041ce1f8695d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.006+0000 7f9819d9b640 1 -- 172.21.15.44:0/3258400851 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804031830 con 0x7f981c15d4e0 2023-11-04T01:43:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.007+0000 7f9819d9b640 1 -- 172.21.15.44:0/3258400851 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9804031990 con 0x7f981c15d4e0 2023-11-04T01:43:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.007+0000 7f9819d9b640 1 -- 172.21.15.44:0/3258400851 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804031d20 con 0x7f981c15d4e0 2023-11-04T01:43:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.007+0000 7f9821256640 1 -- 172.21.15.44:0/3258400851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f981c15d4e0 msgr2=0x7f981c0d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.007+0000 7f9821256640 1 --2- 172.21.15.44:0/3258400851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f981c15d4e0 0x7f981c0d14d0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f98040097a0 tx=0x7f980402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.007+0000 7f9821256640 1 -- 172.21.15.44:0/3258400851 shutdown_connections 2023-11-04T01:43:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.007+0000 7f9821256640 1 --2- 172.21.15.44:0/3258400851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f981c15d4e0 0x7f981c0d14d0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.007+0000 7f9821256640 1 -- 172.21.15.44:0/3258400851 >> 172.21.15.44:0/3258400851 conn(0x7f981c0d2ef0 msgr2=0x7f981c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.007+0000 7f9821256640 1 -- 172.21.15.44:0/3258400851 shutdown_connections 2023-11-04T01:43:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.007+0000 7f9821256640 1 -- 172.21.15.44:0/3258400851 wait complete. 2023-11-04T01:43:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.008+0000 7f9821256640 1 Processor -- start 2023-11-04T01:43:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.009+0000 7f9821256640 1 -- start start 2023-11-04T01:43:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.009+0000 7f9821256640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f981c0d3b60 0x7f981c15b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.009+0000 7f9821256640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f981c15d100 0x7f981c1f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.009+0000 7f9821256640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f981c15d4e0 0x7f981c0b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.009+0000 7f9821256640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c15e770 con 0x7f981c15d4e0 2023-11-04T01:43:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.009+0000 7f9821256640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c15eeb0 con 0x7f981c0d3b60 2023-11-04T01:43:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.009+0000 7f9821256640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981c15f190 con 0x7f981c15d100 2023-11-04T01:43:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.009+0000 7f981b59e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f981c15d4e0 0x7f981c0b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.009+0000 7f981b59e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f981c15d4e0 0x7f981c0b3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44596/0 (socket says 172.21.15.44:44596) 2023-11-04T01:43:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.009+0000 7f981b59e640 1 -- 172.21.15.44:0/3422250321 learned_addr learned my addr 172.21.15.44:0/3422250321 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.010+0000 7f981ad9d640 1 --2- 172.21.15.44:0/3422250321 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f981c0d3b60 0x7f981c15b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.010+0000 7f981a59c640 1 --2- 172.21.15.44:0/3422250321 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f981c15d100 0x7f981c1f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.010+0000 7f981b59e640 1 -- 172.21.15.44:0/3422250321 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f981c15d100 msgr2=0x7f981c1f3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.010+0000 7f981b59e640 1 --2- 172.21.15.44:0/3422250321 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f981c15d100 0x7f981c1f3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.010+0000 7f981b59e640 1 -- 172.21.15.44:0/3422250321 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f981c0d3b60 msgr2=0x7f981c15b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.010+0000 7f981b59e640 1 --2- 172.21.15.44:0/3422250321 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f981c0d3b60 0x7f981c15b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.010+0000 7f981b59e640 1 -- 172.21.15.44:0/3422250321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9804009400 con 0x7f981c15d4e0 2023-11-04T01:43:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.010+0000 7f981ad9d640 1 --2- 172.21.15.44:0/3422250321 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f981c0d3b60 0x7f981c15b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:09.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.010+0000 7f981b59e640 1 --2- 172.21.15.44:0/3422250321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f981c15d4e0 0x7f981c0b3be0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f981400c410 tx=0x7f981400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.010+0000 7f98137fe640 1 -- 172.21.15.44:0/3422250321 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814011790 con 0x7f981c15d4e0 2023-11-04T01:43:09.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.010+0000 7f98137fe640 1 -- 172.21.15.44:0/3422250321 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98140118f0 con 0x7f981c15d4e0 2023-11-04T01:43:09.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.010+0000 7f9821256640 1 -- 172.21.15.44:0/3422250321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981c15f470 con 0x7f981c15d4e0 2023-11-04T01:43:09.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.010+0000 7f98137fe640 1 -- 172.21.15.44:0/3422250321 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814011ce0 con 0x7f981c15d4e0 2023-11-04T01:43:09.014 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.010+0000 7f9821256640 1 -- 172.21.15.44:0/3422250321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981c15b800 con 0x7f981c15d4e0 2023-11-04T01:43:09.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.012+0000 7f98137fe640 1 -- 172.21.15.44:0/3422250321 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f981401c460 con 0x7f981c15d4e0 2023-11-04T01:43:09.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.012+0000 7f98137fe640 1 --2- 172.21.15.44:0/3422250321 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97fc06ae70 0x7f97fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.012+0000 7f98137fe640 1 -- 172.21.15.44:0/3422250321 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f9814089c30 con 0x7f981c15d4e0 2023-11-04T01:43:09.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.013+0000 7f981ad9d640 1 --2- 172.21.15.44:0/3422250321 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97fc06ae70 0x7f97fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.013+0000 7f9823dec740 1 Processor -- start 2023-11-04T01:43:09.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.013+0000 7f981ad9d640 1 --2- 172.21.15.44:0/3422250321 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97fc06ae70 0x7f97fc06d330 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f980c001460 tx=0x7f980c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.015 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.013+0000 7f9823dec740 1 -- start start 2023-11-04T01:43:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.014+0000 7f9823dec740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f57064c0 0x55b6f57068a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.014+0000 7f9823dec740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f56d66d0 0x55b6f5703730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.014+0000 7f9823dec740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f5703c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.014+0000 7f9823dec740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f5649d70 con 0x55b6f56da040 2023-11-04T01:43:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.014+0000 7f9823dec740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f5647460 con 0x55b6f56d66d0 2023-11-04T01:43:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.014+0000 7f9823dec740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6f5642d50 con 0x55b6f57064c0 2023-11-04T01:43:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.014+0000 7f981b59e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f5703c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.014+0000 7f981b59e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f5703c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44606/0 (socket says 172.21.15.44:44606) 2023-11-04T01:43:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.014+0000 7f981b59e640 1 -- 172.21.15.44:0/642626273 learned_addr learned my addr 172.21.15.44:0/642626273 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.014+0000 7f981a59c640 1 --2- 172.21.15.44:0/642626273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f56d66d0 0x55b6f5703730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.014+0000 7f981ad9d640 1 --2- 172.21.15.44:0/642626273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f57064c0 0x55b6f57068a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.017 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f981b59e640 1 -- 172.21.15.44:0/642626273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f57064c0 msgr2=0x55b6f57068a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f981b59e640 1 --2- 172.21.15.44:0/642626273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f57064c0 0x55b6f57068a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f981b59e640 1 -- 172.21.15.44:0/642626273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f56d66d0 msgr2=0x55b6f5703730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f981b59e640 1 --2- 172.21.15.44:0/642626273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f56d66d0 0x55b6f5703730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f981b59e640 1 -- 172.21.15.44:0/642626273 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6f5605e30 con 0x55b6f56da040 2023-11-04T01:43:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f981a59c640 1 --2- 172.21.15.44:0/642626273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f56d66d0 0x55b6f5703730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f981b59e640 1 --2- 172.21.15.44:0/642626273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f5703c70 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f981405fe20 tx=0x7f9814011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4335d7bd7af7a0d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f9810ff9640 1 -- 172.21.15.44:0/642626273 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981405c1a0 con 0x55b6f56da040 2023-11-04T01:43:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f9810ff9640 1 -- 172.21.15.44:0/642626273 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814060350 con 0x55b6f56da040 2023-11-04T01:43:09.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f9810ff9640 1 -- 172.21.15.44:0/642626273 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814054760 con 0x55b6f56da040 2023-11-04T01:43:09.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f9823dec740 1 -- 172.21.15.44:0/642626273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 msgr2=0x55b6f5703c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f9823dec740 1 --2- 172.21.15.44:0/642626273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f5703c70 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f981405fe20 tx=0x7f9814011f80 comp rx=0 tx=0).stop 2023-11-04T01:43:09.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f9823dec740 1 -- 172.21.15.44:0/642626273 shutdown_connections 2023-11-04T01:43:09.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f9823dec740 1 --2- 172.21.15.44:0/642626273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f5703c70 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f9823dec740 1 --2- 172.21.15.44:0/642626273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f56d66d0 0x55b6f5703730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.015+0000 7f9823dec740 1 --2- 172.21.15.44:0/642626273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f57064c0 0x55b6f57068a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.016+0000 7f9823dec740 1 -- 172.21.15.44:0/642626273 >> 172.21.15.44:0/642626273 conn(0x55b6f56d89e0 msgr2=0x55b6f57212d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.016+0000 7f9823dec740 1 -- 172.21.15.44:0/642626273 shutdown_connections 2023-11-04T01:43:09.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.016+0000 7f9823dec740 1 -- 172.21.15.44:0/642626273 wait complete. 2023-11-04T01:43:09.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.016+0000 7f9823dec740 1 -- start start 2023-11-04T01:43:09.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.016+0000 7f9823dec740 1 Processor -- start 2023-11-04T01:43:09.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f9823dec740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f57099d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f9823dec740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f57064c0 0x55b6f57080b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f9823dec740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f5731340 0x55b6f5720f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f9823dec740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f55fcee0 con 0x55b6f56da040 2023-11-04T01:43:09.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f9823dec740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f55fcb80 con 0x55b6f5731340 2023-11-04T01:43:09.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f9823dec740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6f55c23a0 con 0x55b6f57064c0 2023-11-04T01:43:09.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f9823dec740 10 client.0 _ll_register_callbacks cb 0x55b6f55c68b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:09.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f981ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f57099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f981ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f57099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44608/0 (socket says 172.21.15.44:44608) 2023-11-04T01:43:09.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f981ad9d640 1 -- 172.21.15.44:0/2057471985 learned_addr learned my addr 172.21.15.44:0/2057471985 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:09.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f981b59e640 1 --2- 172.21.15.44:0/2057471985 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f5731340 0x55b6f5720f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f981a59c640 1 --2- 172.21.15.44:0/2057471985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f57064c0 0x55b6f57080b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f981ad9d640 1 -- 172.21.15.44:0/2057471985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f57064c0 msgr2=0x55b6f57080b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f981ad9d640 1 --2- 172.21.15.44:0/2057471985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f57064c0 0x55b6f57080b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f981ad9d640 1 -- 172.21.15.44:0/2057471985 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f5731340 msgr2=0x55b6f5720f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f981ad9d640 1 --2- 172.21.15.44:0/2057471985 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f5731340 0x55b6f5720f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f981ad9d640 1 -- 172.21.15.44:0/2057471985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981c15b800 con 0x55b6f56da040 2023-11-04T01:43:09.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.017+0000 7f981a59c640 1 --2- 172.21.15.44:0/2057471985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f57064c0 0x55b6f57080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:09.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f981ad9d640 1 --2- 172.21.15.44:0/2057471985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f57099d0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f980c005de0 tx=0x7f980c0013d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd6f8bd416d4ff3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f97f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:43:09.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f97f9ffb640 1 -- 172.21.15.44:0/2057471985 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c013630 con 0x55b6f56da040 2023-11-04T01:43:09.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f97f9ffb640 1 -- 172.21.15.44:0/2057471985 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f980c013790 con 0x55b6f56da040 2023-11-04T01:43:09.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f9823dec740 1 -- 172.21.15.44:0/2057471985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6f563bd30 con 0x55b6f56da040 2023-11-04T01:43:09.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f97f9ffb640 1 -- 172.21.15.44:0/2057471985 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f980c013950 con 0x55b6f56da040 2023-11-04T01:43:09.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f9823dec740 10 client.8619 fetch_fsmap learned FSMap version 107 2023-11-04T01:43:09.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f9823dec740 1 -- 172.21.15.44:0/2057471985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) v3 -- 0x55b6f56413d0 con 0x55b6f56da040 2023-11-04T01:43:09.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f97f9ffb640 1 -- 172.21.15.44:0/2057471985 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b6f563bd30 con 0x55b6f56da040 2023-11-04T01:43:09.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f97f9ffb640 1 -- 172.21.15.44:0/2057471985 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 107) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f980c02d020 con 0x55b6f56da040 2023-11-04T01:43:09.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f9823dec740 10 client.8619 fetch_fsmap finished waiting for FSMap version 107 2023-11-04T01:43:09.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f9823dec740 10 client.8619 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2023-11-04T01:43:09.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f9823dec740 20 client.8619 populate_metadata read hostname 'smithi044' 2023-11-04T01:43:09.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f9823dec740 1 --2- 172.21.15.44:0/2057471985 >> [v2:172.21.15.44:6832/22987540,v1:172.21.15.44:6834/22987540] conn(0x55b6f5731720 0x55b6f571ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f9823dec740 4 client.8619 mds_command: new command op to 8205 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:43:09.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f9823dec740 1 -- 172.21.15.44:0/2057471985 --> [v2:172.21.15.44:6832/22987540,v1:172.21.15.44:6834/22987540] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6f563ba50 con 0x55b6f5731720 2023-11-04T01:43:09.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.018+0000 7f981a59c640 1 --2- 172.21.15.44:0/2057471985 >> [v2:172.21.15.44:6832/22987540,v1:172.21.15.44:6834/22987540] conn(0x55b6f5731720 0x55b6f571ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f981a59c640 1 --2- 172.21.15.44:0/2057471985 >> [v2:172.21.15.44:6832/22987540,v1:172.21.15.44:6834/22987540] conn(0x55b6f5731720 0x55b6f571ee80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2170c4dc5f94302 server_cookie=9356867cddd739cf in_seq=0 out_seq=0 2023-11-04T01:43:09.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f97f9ffb640 10 client.8619 ms_handle_connect on v2:172.21.15.44:6832/22987540 2023-11-04T01:43:09.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f97f9ffb640 1 -- 172.21.15.44:0/2057471985 <== mds.0 v2:172.21.15.44:6832/22987540 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b6f563ba50 con 0x55b6f5731720 2023-11-04T01:43:09.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f97f9ffb640 10 client.8619 handle_command_reply: tid=0 2023-11-04T01:43:09.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f9823dec740 1 client.8619 shutdown 2023-11-04T01:43:09.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f9823dec740 1 -- 172.21.15.44:0/2057471985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 msgr2=0x55b6f57099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f9823dec740 1 --2- 172.21.15.44:0/2057471985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f57099d0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f980c005de0 tx=0x7f980c0013d0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f9823dec740 1 -- 172.21.15.44:0/2057471985 shutdown_connections 2023-11-04T01:43:09.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f9823dec740 1 --2- 172.21.15.44:0/2057471985 >> [v2:172.21.15.44:6832/22987540,v1:172.21.15.44:6834/22987540] conn(0x55b6f5731720 0x55b6f571ee80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f9823dec740 1 --2- 172.21.15.44:0/2057471985 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f5731340 0x55b6f5720f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f97f9ffb640 0 client.8619 ms_handle_reset on v2:172.21.15.44:6832/22987540 2023-11-04T01:43:09.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f9823dec740 1 --2- 172.21.15.44:0/2057471985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f57064c0 0x55b6f57080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f9823dec740 1 --2- 172.21.15.44:0/2057471985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f57099d0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f9823dec740 1 -- 172.21.15.44:0/2057471985 >> 172.21.15.44:0/2057471985 conn(0x55b6f56d66d0 msgr2=0x55b6f570a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f9823dec740 1 -- 172.21.15.44:0/2057471985 shutdown_connections 2023-11-04T01:43:09.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f9823dec740 1 -- 172.21.15.44:0/2057471985 wait complete. 2023-11-04T01:43:09.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.019+0000 7f9823dec740 20 client.8619 trim_cache size 0 max 16384 2023-11-04T01:43:09.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.033+0000 7f9823dec740 1 Processor -- start 2023-11-04T01:43:09.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.033+0000 7f9823dec740 1 -- start start 2023-11-04T01:43:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.033+0000 7f9823dec740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f5708f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.033+0000 7f9823dec740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f57064c0 0x55b6f5708090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.033+0000 7f9823dec740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f5731340 0x55b6f57249d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.033+0000 7f9823dec740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f570ac70 con 0x55b6f56da040 2023-11-04T01:43:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.033+0000 7f9823dec740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f55f8010 con 0x55b6f57064c0 2023-11-04T01:43:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.033+0000 7f9823dec740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6f57094c0 con 0x55b6f5731340 2023-11-04T01:43:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.033+0000 7f981ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f5708f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.033+0000 7f981ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f5708f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44620/0 (socket says 172.21.15.44:44620) 2023-11-04T01:43:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.033+0000 7f981ad9d640 1 -- 172.21.15.44:0/3863537275 learned_addr learned my addr 172.21.15.44:0/3863537275 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f981ad9d640 1 -- 172.21.15.44:0/3863537275 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f5731340 msgr2=0x55b6f57249d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f981ad9d640 1 --2- 172.21.15.44:0/3863537275 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f5731340 0x55b6f57249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f981ad9d640 1 -- 172.21.15.44:0/3863537275 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f57064c0 msgr2=0x55b6f5708090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f981ad9d640 1 --2- 172.21.15.44:0/3863537275 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f57064c0 0x55b6f5708090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f981ad9d640 1 -- 172.21.15.44:0/3863537275 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6f55deea0 con 0x55b6f56da040 2023-11-04T01:43:09.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f981ad9d640 1 --2- 172.21.15.44:0/3863537275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f5708f50 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f980c00ecc0 tx=0x7f980c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86419b42e16c3dfa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f98117fa640 1 -- 172.21.15.44:0/3863537275 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c007930 con 0x55b6f56da040 2023-11-04T01:43:09.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f98117fa640 1 -- 172.21.15.44:0/3863537275 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c019070 con 0x55b6f56da040 2023-11-04T01:43:09.037 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f98117fa640 1 -- 172.21.15.44:0/3863537275 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c013630 con 0x55b6f56da040 2023-11-04T01:43:09.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f9823dec740 1 -- 172.21.15.44:0/3863537275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 msgr2=0x55b6f5708f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f9823dec740 1 --2- 172.21.15.44:0/3863537275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f5708f50 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f980c00ecc0 tx=0x7f980c01a000 comp rx=0 tx=0).stop 2023-11-04T01:43:09.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f9823dec740 1 -- 172.21.15.44:0/3863537275 shutdown_connections 2023-11-04T01:43:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f9823dec740 1 --2- 172.21.15.44:0/3863537275 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f5731340 0x55b6f57249d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f9823dec740 1 --2- 172.21.15.44:0/3863537275 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f57064c0 0x55b6f5708090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f9823dec740 1 --2- 172.21.15.44:0/3863537275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f56da040 0x55b6f5708f50 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.034+0000 7f9823dec740 1 -- 172.21.15.44:0/3863537275 >> 172.21.15.44:0/3863537275 conn(0x55b6f56d66d0 msgr2=0x55b6f56d1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.035+0000 7f9823dec740 1 -- 172.21.15.44:0/3863537275 shutdown_connections 2023-11-04T01:43:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.035+0000 7f9823dec740 1 -- 172.21.15.44:0/3863537275 wait complete. 2023-11-04T01:43:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.035+0000 7f9823dec740 1 -- start start 2023-11-04T01:43:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.035+0000 7f9823dec740 1 Processor -- start 2023-11-04T01:43:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f9823dec740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f56da040 0x55b6f56dc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f9823dec740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f57064c0 0x55b6f57862b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f9823dec740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f5731340 0x55b6f57405e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f9823dec740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f5720dc0 con 0x55b6f57064c0 2023-11-04T01:43:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f9823dec740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f56fd2c0 con 0x55b6f5731340 2023-11-04T01:43:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f9823dec740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6f5720f30 con 0x55b6f56da040 2023-11-04T01:43:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f9823dec740 10 client.0 _ll_register_callbacks cb 0x7f9814057e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f981a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f57064c0 0x55b6f57862b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f981a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f57064c0 0x55b6f57862b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44628/0 (socket says 172.21.15.44:44628) 2023-11-04T01:43:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f981a59c640 1 -- 172.21.15.44:0/953596814 learned_addr learned my addr 172.21.15.44:0/953596814 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f981b59e640 1 --2- 172.21.15.44:0/953596814 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f5731340 0x55b6f57405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f981ad9d640 1 --2- 172.21.15.44:0/953596814 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f56da040 0x55b6f56dc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f981a59c640 1 -- 172.21.15.44:0/953596814 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f56da040 msgr2=0x55b6f56dc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f981a59c640 1 --2- 172.21.15.44:0/953596814 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f56da040 0x55b6f56dc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f981a59c640 1 -- 172.21.15.44:0/953596814 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f5731340 msgr2=0x55b6f57405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f981a59c640 1 --2- 172.21.15.44:0/953596814 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f5731340 0x55b6f57405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f981a59c640 1 -- 172.21.15.44:0/953596814 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6f56413d0 con 0x55b6f57064c0 2023-11-04T01:43:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f981ad9d640 1 --2- 172.21.15.44:0/953596814 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f56da040 0x55b6f56dc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f981a59c640 1 --2- 172.21.15.44:0/953596814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f57064c0 0x55b6f57862b0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f98040097a0 tx=0x7f9804004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5756c30ea59c82 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.036+0000 7f97f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:43:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f97f9ffb640 1 -- 172.21.15.44:0/953596814 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804049460 con 0x55b6f57064c0 2023-11-04T01:43:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f97f9ffb640 1 -- 172.21.15.44:0/953596814 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f980403f040 con 0x55b6f57064c0 2023-11-04T01:43:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f9823dec740 1 -- 172.21.15.44:0/953596814 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9814060350 con 0x55b6f57064c0 2023-11-04T01:43:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f97f9ffb640 1 -- 172.21.15.44:0/953596814 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98040495c0 con 0x55b6f57064c0 2023-11-04T01:43:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f9823dec740 10 client.8625 fetch_fsmap learned FSMap version 107 2023-11-04T01:43:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f9823dec740 1 -- 172.21.15.44:0/953596814 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) v3 -- 0x55b6f5604690 con 0x55b6f57064c0 2023-11-04T01:43:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f97f9ffb640 1 -- 172.21.15.44:0/953596814 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980405a020 con 0x55b6f57064c0 2023-11-04T01:43:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f97f9ffb640 1 -- 172.21.15.44:0/953596814 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 107) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f9804049720 con 0x55b6f57064c0 2023-11-04T01:43:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f9823dec740 10 client.8625 fetch_fsmap finished waiting for FSMap version 107 2023-11-04T01:43:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f9823dec740 10 client.8625 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2023-11-04T01:43:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f9823dec740 20 client.8625 populate_metadata read hostname 'smithi044' 2023-11-04T01:43:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f9823dec740 1 --2- 172.21.15.44:0/953596814 >> [v2:172.21.15.44:6832/22987540,v1:172.21.15.44:6834/22987540] conn(0x55b6f5740b20 0x55b6f5742660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f9823dec740 4 client.8625 mds_command: new command op to 8205 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:43:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f9823dec740 1 -- 172.21.15.44:0/953596814 --> [v2:172.21.15.44:6832/22987540,v1:172.21.15.44:6834/22987540] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b6f53437e0 con 0x55b6f5740b20 2023-11-04T01:43:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f981ad9d640 1 --2- 172.21.15.44:0/953596814 >> [v2:172.21.15.44:6832/22987540,v1:172.21.15.44:6834/22987540] conn(0x55b6f5740b20 0x55b6f5742660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f981ad9d640 1 --2- 172.21.15.44:0/953596814 >> [v2:172.21.15.44:6832/22987540,v1:172.21.15.44:6834/22987540] conn(0x55b6f5740b20 0x55b6f5742660 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de2abeb397f4b069 server_cookie=8be62a73b843baee in_seq=0 out_seq=0 2023-11-04T01:43:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.037+0000 7f97f9ffb640 10 client.8625 ms_handle_connect on v2:172.21.15.44:6832/22987540 2023-11-04T01:43:09.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.044+0000 7f97f9ffb640 1 -- 172.21.15.44:0/953596814 <== mds.0 v2:172.21.15.44:6832/22987540 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b6f53437e0 con 0x55b6f5740b20 2023-11-04T01:43:09.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.044+0000 7f97f9ffb640 10 client.8625 handle_command_reply: tid=0 2023-11-04T01:43:09.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.044+0000 7f9823dec740 1 client.8625 shutdown 2023-11-04T01:43:09.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.044+0000 7f9823dec740 1 -- 172.21.15.44:0/953596814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f57064c0 msgr2=0x55b6f57862b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.044+0000 7f9823dec740 1 --2- 172.21.15.44:0/953596814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f57064c0 0x55b6f57862b0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f98040097a0 tx=0x7f9804004730 comp rx=0 tx=0).stop 2023-11-04T01:43:09.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.044+0000 7f9823dec740 1 -- 172.21.15.44:0/953596814 shutdown_connections 2023-11-04T01:43:09.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.044+0000 7f9823dec740 1 --2- 172.21.15.44:0/953596814 >> [v2:172.21.15.44:6832/22987540,v1:172.21.15.44:6834/22987540] conn(0x55b6f5740b20 0x55b6f5742660 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.044+0000 7f9823dec740 1 --2- 172.21.15.44:0/953596814 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b6f5731340 0x55b6f57405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.044+0000 7f9823dec740 1 --2- 172.21.15.44:0/953596814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6f57064c0 0x55b6f57862b0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.044+0000 7f97f9ffb640 0 client.8625 ms_handle_reset on v2:172.21.15.44:6832/22987540 2023-11-04T01:43:09.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.044+0000 7f9823dec740 1 --2- 172.21.15.44:0/953596814 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b6f56da040 0x55b6f56dc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.044+0000 7f9823dec740 1 -- 172.21.15.44:0/953596814 >> 172.21.15.44:0/953596814 conn(0x55b6f56d66d0 msgr2=0x55b6f57249d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.044+0000 7f9823dec740 1 -- 172.21.15.44:0/953596814 shutdown_connections 2023-11-04T01:43:09.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.044+0000 7f9823dec740 1 -- 172.21.15.44:0/953596814 wait complete. 2023-11-04T01:43:09.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.044+0000 7f9823dec740 20 client.8625 trim_cache size 0 max 16384 2023-11-04T01:43:09.048 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:43:09.048 INFO:teuthology.orchestra.run.smithi044.stdout: "message": "", 2023-11-04T01:43:09.048 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0 2023-11-04T01:43:09.048 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:43:09.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.045+0000 7f9821256640 1 -- 172.21.15.44:0/3422250321 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97fc06ae70 msgr2=0x7f97fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.045+0000 7f9821256640 1 --2- 172.21.15.44:0/3422250321 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97fc06ae70 0x7f97fc06d330 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f980c001460 tx=0x7f980c009040 comp rx=0 tx=0).stop 2023-11-04T01:43:09.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.045+0000 7f9821256640 1 -- 172.21.15.44:0/3422250321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f981c15d4e0 msgr2=0x7f981c0b3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.045+0000 7f9821256640 1 --2- 172.21.15.44:0/3422250321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f981c15d4e0 0x7f981c0b3be0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f981400c410 tx=0x7f981400c8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.045+0000 7f9821256640 1 -- 172.21.15.44:0/3422250321 shutdown_connections 2023-11-04T01:43:09.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.045+0000 7f9821256640 1 --2- 172.21.15.44:0/3422250321 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f97fc06ae70 0x7f97fc06d330 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.045+0000 7f9821256640 1 --2- 172.21.15.44:0/3422250321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f981c15d4e0 0x7f981c0b3be0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.045+0000 7f9821256640 1 --2- 172.21.15.44:0/3422250321 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f981c15d100 0x7f981c1f3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.045+0000 7f9821256640 1 --2- 172.21.15.44:0/3422250321 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f981c0d3b60 0x7f981c15b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.045+0000 7f9821256640 1 -- 172.21.15.44:0/3422250321 >> 172.21.15.44:0/3422250321 conn(0x7f981c0d2ef0 msgr2=0x7f981c0d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.045+0000 7f9821256640 1 -- 172.21.15.44:0/3422250321 shutdown_connections 2023-11-04T01:43:09.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.045+0000 7f9821256640 1 -- 172.21.15.44:0/3422250321 wait complete. 2023-11-04T01:43:09.057 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=6, also kill snapclient 2023-11-04T01:43:09.057 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:09.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.161+0000 7f17a6644640 1 Processor -- start 2023-11-04T01:43:09.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.161+0000 7f17a6644640 1 -- start start 2023-11-04T01:43:09.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.162+0000 7f17a6644640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f17a00b0c40 0x7f17a006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.162+0000 7f17a6644640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a0071500 con 0x7f17a0159e40 2023-11-04T01:43:09.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.162+0000 7f17a6644640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a015dae0 con 0x7f17a006bb60 2023-11-04T01:43:09.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.162+0000 7f17a6644640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a0070c60 con 0x7f17a00b0c40 2023-11-04T01:43:09.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.162+0000 7f179ffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f17a0159e40 0x7f17a00b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60054/0 (socket says 172.21.15.44:60054) 2023-11-04T01:43:09.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.162+0000 7f179ffff640 1 -- 172.21.15.44:0/3407599460 learned_addr learned my addr 172.21.15.44:0/3407599460 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:09.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.162+0000 7f179f7fe640 1 --2- 172.21.15.44:0/3407599460 >> v2:172.21.15.204:3300/0 conn(0x7f17a00b0c40 0x7f17a006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.163+0000 7f179effd640 1 -- 172.21.15.44:0/3407599460 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002498832 0 0) 0x7f17a0071500 con 0x7f17a0159e40 2023-11-04T01:43:09.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.163+0000 7f179effd640 1 -- 172.21.15.44:0/3407599460 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1788003520 con 0x7f17a0159e40 2023-11-04T01:43:09.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.163+0000 7f179effd640 1 -- 172.21.15.44:0/3407599460 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2865085957 0 0) 0x7f1788003520 con 0x7f17a0159e40 2023-11-04T01:43:09.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.163+0000 7f179f7fe640 1 -- 172.21.15.44:0/3407599460 >> v1:172.21.15.204:6789/0 conn(0x7f17a006bb60 legacy=0x7f17a00cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.163+0000 7f179f7fe640 1 -- 172.21.15.44:0/3407599460 >> v1:172.21.15.44:6789/0 conn(0x7f17a0159e40 legacy=0x7f17a00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.163+0000 7f179f7fe640 1 -- 172.21.15.44:0/3407599460 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a0070f40 con 0x7f17a00b0c40 2023-11-04T01:43:09.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.164+0000 7f179f7fe640 1 --2- 172.21.15.44:0/3407599460 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17a00b0c40 0x7f17a006fff0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f17940097a0 tx=0x7f179402b600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97a6e99bbfccc232 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.164+0000 7f179effd640 1 -- 172.21.15.44:0/3407599460 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1790001670 con 0x7f17a00b0c40 2023-11-04T01:43:09.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.164+0000 7f179effd640 1 -- 172.21.15.44:0/3407599460 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179402e050 con 0x7f17a00b0c40 2023-11-04T01:43:09.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.164+0000 7f179effd640 1 -- 172.21.15.44:0/3407599460 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794030510 con 0x7f17a00b0c40 2023-11-04T01:43:09.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.164+0000 7f17a6644640 1 -- 172.21.15.44:0/3407599460 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17a00b0c40 msgr2=0x7f17a006fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.164+0000 7f17a6644640 1 --2- 172.21.15.44:0/3407599460 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17a00b0c40 0x7f17a006fff0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f17940097a0 tx=0x7f179402b600 comp rx=0 tx=0).stop 2023-11-04T01:43:09.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.164+0000 7f17a6644640 1 -- 172.21.15.44:0/3407599460 shutdown_connections 2023-11-04T01:43:09.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.164+0000 7f17a6644640 1 --2- 172.21.15.44:0/3407599460 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17a00b0c40 0x7f17a006fff0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.164+0000 7f17a6644640 1 -- 172.21.15.44:0/3407599460 >> 172.21.15.44:0/3407599460 conn(0x7f17a00cb530 msgr2=0x7f17a00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.165+0000 7f17a6644640 1 -- 172.21.15.44:0/3407599460 shutdown_connections 2023-11-04T01:43:09.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.165+0000 7f17a6644640 1 -- 172.21.15.44:0/3407599460 wait complete. 2023-11-04T01:43:09.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.166+0000 7f17a6644640 1 Processor -- start 2023-11-04T01:43:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.166+0000 7f17a6644640 1 -- start start 2023-11-04T01:43:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a6644640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17a006bb60 0x7f17a01f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a6644640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17a00b0c40 0x7f17a0154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a6644640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a0159e40 0x7f17a00c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a6644640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00c3980 con 0x7f17a0159e40 2023-11-04T01:43:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a6644640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00c3c60 con 0x7f17a00b0c40 2023-11-04T01:43:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a6644640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00c3f40 con 0x7f17a006bb60 2023-11-04T01:43:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a4be1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a0159e40 0x7f17a00c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a4be1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a0159e40 0x7f17a00c4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44636/0 (socket says 172.21.15.44:44636) 2023-11-04T01:43:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a4be1640 1 -- 172.21.15.44:0/3951538840 learned_addr learned my addr 172.21.15.44:0/3951538840 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f179f7fe640 1 --2- 172.21.15.44:0/3951538840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17a00b0c40 0x7f17a0154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f179ffff640 1 --2- 172.21.15.44:0/3951538840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17a006bb60 0x7f17a01f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a4be1640 1 -- 172.21.15.44:0/3951538840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17a006bb60 msgr2=0x7f17a01f3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a4be1640 1 --2- 172.21.15.44:0/3951538840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17a006bb60 0x7f17a01f3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a4be1640 1 -- 172.21.15.44:0/3951538840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17a00b0c40 msgr2=0x7f17a0154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a4be1640 1 --2- 172.21.15.44:0/3951538840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17a00b0c40 0x7f17a0154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a4be1640 1 -- 172.21.15.44:0/3951538840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1794009400 con 0x7f17a0159e40 2023-11-04T01:43:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f179f7fe640 1 --2- 172.21.15.44:0/3951538840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17a00b0c40 0x7f17a0154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a4be1640 1 --2- 172.21.15.44:0/3951538840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a0159e40 0x7f17a00c4a20 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f179800c8e0 tx=0x7f179800cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f179cff9640 1 -- 172.21.15.44:0/3951538840 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798003da0 con 0x7f17a0159e40 2023-11-04T01:43:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f179cff9640 1 -- 172.21.15.44:0/3951538840 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1798005070 con 0x7f17a0159e40 2023-11-04T01:43:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a6644640 1 -- 172.21.15.44:0/3951538840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a00c4220 con 0x7f17a0159e40 2023-11-04T01:43:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f179cff9640 1 -- 172.21.15.44:0/3951538840 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798005440 con 0x7f17a0159e40 2023-11-04T01:43:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.167+0000 7f17a6644640 1 -- 172.21.15.44:0/3951538840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a0150cb0 con 0x7f17a0159e40 2023-11-04T01:43:09.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.168+0000 7f17a6644640 1 -- 172.21.15.44:0/3951538840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a00684b0 con 0x7f17a0159e40 2023-11-04T01:43:09.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.169+0000 7f179cff9640 1 -- 172.21.15.44:0/3951538840 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17980055a0 con 0x7f17a0159e40 2023-11-04T01:43:09.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.169+0000 7f179cff9640 1 --2- 172.21.15.44:0/3951538840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f178c06ae70 0x7f178c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.169+0000 7f179cff9640 1 -- 172.21.15.44:0/3951538840 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f17980898f0 con 0x7f17a0159e40 2023-11-04T01:43:09.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.169+0000 7f179ffff640 1 --2- 172.21.15.44:0/3951538840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f178c06ae70 0x7f178c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.170+0000 7f179ffff640 1 --2- 172.21.15.44:0/3951538840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f178c06ae70 0x7f178c06d330 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1790001eb0 tx=0x7f1790009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.175 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.173+0000 7f179cff9640 1 -- 172.21.15.44:0/3951538840 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1798054180 con 0x7f17a0159e40 2023-11-04T01:43:09.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.389+0000 7f17a6644640 1 -- 172.21.15.44:0/3951538840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17a00c9750 con 0x7f17a0159e40 2023-11-04T01:43:09.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.390+0000 7f179cff9640 1 -- 172.21.15.44:0/3951538840 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4931 (secure 0 0 0) 0x7f1798017090 con 0x7f17a0159e40 2023-11-04T01:43:09.392 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:09.392 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":107,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:00.261316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 107 2023-11-04T01:43:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.392+0000 7f17a6644640 1 -- 172.21.15.44:0/3951538840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f178c06ae70 msgr2=0x7f178c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.392+0000 7f17a6644640 1 --2- 172.21.15.44:0/3951538840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f178c06ae70 0x7f178c06d330 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1790001eb0 tx=0x7f1790009040 comp rx=0 tx=0).stop 2023-11-04T01:43:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.392+0000 7f17a6644640 1 -- 172.21.15.44:0/3951538840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a0159e40 msgr2=0x7f17a00c4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.392+0000 7f17a6644640 1 --2- 172.21.15.44:0/3951538840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a0159e40 0x7f17a00c4a20 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f179800c8e0 tx=0x7f179800cda0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.392+0000 7f17a6644640 1 -- 172.21.15.44:0/3951538840 shutdown_connections 2023-11-04T01:43:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.392+0000 7f17a6644640 1 --2- 172.21.15.44:0/3951538840 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f178c06ae70 0x7f178c06d330 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.392+0000 7f17a6644640 1 --2- 172.21.15.44:0/3951538840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a0159e40 0x7f17a00c4a20 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.392+0000 7f17a6644640 1 --2- 172.21.15.44:0/3951538840 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17a00b0c40 0x7f17a0154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.392+0000 7f17a6644640 1 --2- 172.21.15.44:0/3951538840 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17a006bb60 0x7f17a01f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.392+0000 7f17a6644640 1 -- 172.21.15.44:0/3951538840 >> 172.21.15.44:0/3951538840 conn(0x7f17a00cb530 msgr2=0x7f17a006c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.392+0000 7f17a6644640 1 -- 172.21.15.44:0/3951538840 shutdown_connections 2023-11-04T01:43:09.395 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.392+0000 7f17a6644640 1 -- 172.21.15.44:0/3951538840 wait complete. 2023-11-04T01:43:09.405 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:43:09.524 INFO:teuthology.orchestra.run.smithi044.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:26.455117+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:43:09.525 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:26.455117+0000" } ] } 2023-11-04T01:43:09.525 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:43:09.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.632+0000 7fc274b55640 1 Processor -- start 2023-11-04T01:43:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.632+0000 7fc274b55640 1 -- start start 2023-11-04T01:43:09.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.632+0000 7fc274b55640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc27015d100 0x7fc2700ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.632+0000 7fc274b55640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2700d1be0 0x7fc2700b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.632+0000 7fc274b55640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2700b32b0 con 0x7fc27015d4e0 2023-11-04T01:43:09.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.632+0000 7fc274b55640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2700cee10 con 0x7fc27015d100 2023-11-04T01:43:09.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.632+0000 7fc274b55640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700b2980 con 0x7fc2700d1be0 2023-11-04T01:43:09.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc267fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc27015d4e0 0x7fc2700d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60056/0 (socket says 172.21.15.44:60056) 2023-11-04T01:43:09.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc267fff640 1 -- 172.21.15.44:0/477220097 learned_addr learned my addr 172.21.15.44:0/477220097 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:09.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26e59c640 1 --2- 172.21.15.44:0/477220097 >> v2:172.21.15.204:3300/0 conn(0x7fc27015d100 0x7fc2700ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26ed9d640 1 --2- 172.21.15.44:0/477220097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2700d1be0 0x7fc2700b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 -- 172.21.15.44:0/477220097 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401861901 0 0) 0x7fc2700b32b0 con 0x7fc27015d4e0 2023-11-04T01:43:09.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 -- 172.21.15.44:0/477220097 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc25c003520 con 0x7fc27015d4e0 2023-11-04T01:43:09.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 -- 172.21.15.44:0/477220097 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3519639727 0 0) 0x7fc25c003520 con 0x7fc27015d4e0 2023-11-04T01:43:09.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 -- 172.21.15.44:0/477220097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2700d1be0 msgr2=0x7fc2700b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 --2- 172.21.15.44:0/477220097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2700d1be0 0x7fc2700b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 -- 172.21.15.44:0/477220097 >> v2:172.21.15.204:3300/0 conn(0x7fc27015d100 msgr2=0x7fc2700ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 --2- 172.21.15.44:0/477220097 >> v2:172.21.15.204:3300/0 conn(0x7fc27015d100 0x7fc2700ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 -- 172.21.15.44:0/477220097 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2700b2c60 con 0x7fc27015d4e0 2023-11-04T01:43:09.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 -- 172.21.15.44:0/477220097 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fc258001670 con 0x7fc27015d4e0 2023-11-04T01:43:09.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26ed9d640 1 --2- 172.21.15.44:0/477220097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2700d1be0 0x7fc2700b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:09.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 -- 172.21.15.44:0/477220097 >> v1:172.21.15.44:6789/0 conn(0x7fc27015d4e0 legacy=0x7fc2700d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 --2- 172.21.15.44:0/477220097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2700d1be0 0x7fc25c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 --2- 172.21.15.44:0/477220097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc25c003eb0 0x7fc25c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 --2- 172.21.15.44:0/477220097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25c004d00 0x7fc25c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 -- 172.21.15.44:0/477220097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700cee10 con 0x7fc25c003eb0 2023-11-04T01:43:09.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 -- 172.21.15.44:0/477220097 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700b2980 con 0x7fc25c004d00 2023-11-04T01:43:09.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26dd9b640 1 -- 172.21.15.44:0/477220097 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c00b980 con 0x7fc2700d1be0 2023-11-04T01:43:09.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc267fff640 1 --2- 172.21.15.44:0/477220097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc25c003eb0 0x7fc25c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26e59c640 1 --2- 172.21.15.44:0/477220097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2700d1be0 0x7fc25c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.633+0000 7fc26ed9d640 1 --2- 172.21.15.44:0/477220097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25c004d00 0x7fc25c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.634+0000 7fc267fff640 1 -- 172.21.15.44:0/477220097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2700d1be0 msgr2=0x7fc25c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.634+0000 7fc267fff640 1 --2- 172.21.15.44:0/477220097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2700d1be0 0x7fc25c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.634+0000 7fc267fff640 1 -- 172.21.15.44:0/477220097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25c004d00 msgr2=0x7fc25c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.634+0000 7fc267fff640 1 --2- 172.21.15.44:0/477220097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25c004d00 0x7fc25c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.634+0000 7fc267fff640 1 -- 172.21.15.44:0/477220097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc268009a70 con 0x7fc25c003eb0 2023-11-04T01:43:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.634+0000 7fc26ed9d640 1 --2- 172.21.15.44:0/477220097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25c004d00 0x7fc25c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.634+0000 7fc267fff640 1 --2- 172.21.15.44:0/477220097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc25c003eb0 0x7fc25c0047c0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fc25800c210 tx=0x7fc25c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c5b7f2f04af6b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.634+0000 7fc26dd9b640 1 -- 172.21.15.44:0/477220097 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc258005ad0 con 0x7fc25c003eb0 2023-11-04T01:43:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.635+0000 7fc26dd9b640 1 -- 172.21.15.44:0/477220097 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc258005c30 con 0x7fc25c003eb0 2023-11-04T01:43:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.635+0000 7fc26dd9b640 1 -- 172.21.15.44:0/477220097 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25802caf0 con 0x7fc25c003eb0 2023-11-04T01:43:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.635+0000 7fc274b55640 1 -- 172.21.15.44:0/477220097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc25c003eb0 msgr2=0x7fc25c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.635+0000 7fc274b55640 1 --2- 172.21.15.44:0/477220097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc25c003eb0 0x7fc25c0047c0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fc25800c210 tx=0x7fc25c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.635+0000 7fc26ed9d640 1 -- 172.21.15.44:0/477220097 reap_dead start 2023-11-04T01:43:09.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.635+0000 7fc274b55640 1 -- 172.21.15.44:0/477220097 shutdown_connections 2023-11-04T01:43:09.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.635+0000 7fc274b55640 1 -- 172.21.15.44:0/477220097 >> 172.21.15.44:0/477220097 conn(0x7fc2700d2ef0 msgr2=0x7fc2700d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.635+0000 7fc274b55640 1 -- 172.21.15.44:0/477220097 shutdown_connections 2023-11-04T01:43:09.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.635+0000 7fc274b55640 1 -- 172.21.15.44:0/477220097 wait complete. 2023-11-04T01:43:09.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.636+0000 7fc274b55640 1 Processor -- start 2023-11-04T01:43:09.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.636+0000 7fc274b55640 1 -- start start 2023-11-04T01:43:09.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.637+0000 7fc274b55640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25c003eb0 0x7fc2700b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.643 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.637+0000 7fc274b55640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2701f3440 0x7fc27015d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.637+0000 7fc274b55640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2701f38a0 0x7fc27015de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.637+0000 7fc274b55640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27015eac0 con 0x7fc2701f38a0 2023-11-04T01:43:09.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.637+0000 7fc274b55640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27015fa90 con 0x7fc25c003eb0 2023-11-04T01:43:09.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.637+0000 7fc274b55640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27015e500 con 0x7fc2701f3440 2023-11-04T01:43:09.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.637+0000 7fc26ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2701f38a0 0x7fc27015de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.637+0000 7fc26ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2701f38a0 0x7fc27015de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44646/0 (socket says 172.21.15.44:44646) 2023-11-04T01:43:09.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.637+0000 7fc26ed9d640 1 -- 172.21.15.44:0/1851974344 learned_addr learned my addr 172.21.15.44:0/1851974344 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:09.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.637+0000 7fc267fff640 1 --2- 172.21.15.44:0/1851974344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2701f3440 0x7fc27015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.637+0000 7fc26e59c640 1 --2- 172.21.15.44:0/1851974344 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25c003eb0 0x7fc2700b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.638+0000 7fc26ed9d640 1 -- 172.21.15.44:0/1851974344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2701f3440 msgr2=0x7fc27015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.638+0000 7fc26ed9d640 1 --2- 172.21.15.44:0/1851974344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2701f3440 0x7fc27015d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.638+0000 7fc26ed9d640 1 -- 172.21.15.44:0/1851974344 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25c003eb0 msgr2=0x7fc2700b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.638+0000 7fc26ed9d640 1 --2- 172.21.15.44:0/1851974344 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25c003eb0 0x7fc2700b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.638+0000 7fc26ed9d640 1 -- 172.21.15.44:0/1851974344 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27015e7e0 con 0x7fc2701f38a0 2023-11-04T01:43:09.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.638+0000 7fc267fff640 1 --2- 172.21.15.44:0/1851974344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2701f3440 0x7fc27015d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:09.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.638+0000 7fc26ed9d640 1 --2- 172.21.15.44:0/1851974344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2701f38a0 0x7fc27015de80 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fc27008c730 tx=0x7fc2680115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.638+0000 7fc266ffd640 1 -- 172.21.15.44:0/1851974344 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26800e070 con 0x7fc2701f38a0 2023-11-04T01:43:09.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.638+0000 7fc266ffd640 1 -- 172.21.15.44:0/1851974344 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc268003990 con 0x7fc2701f38a0 2023-11-04T01:43:09.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.638+0000 7fc274b55640 1 -- 172.21.15.44:0/1851974344 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2700ca160 con 0x7fc2701f38a0 2023-11-04T01:43:09.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.638+0000 7fc266ffd640 1 -- 172.21.15.44:0/1851974344 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc268003b00 con 0x7fc2701f38a0 2023-11-04T01:43:09.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.638+0000 7fc274b55640 1 -- 172.21.15.44:0/1851974344 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2700b1d60 con 0x7fc2701f38a0 2023-11-04T01:43:09.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.639+0000 7fc274b55640 1 -- 172.21.15.44:0/1851974344 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2700c9fc0 con 0x7fc2701f38a0 2023-11-04T01:43:09.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.639+0000 7fc266ffd640 1 -- 172.21.15.44:0/1851974344 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc268003c60 con 0x7fc2701f38a0 2023-11-04T01:43:09.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.640+0000 7fc266ffd640 1 --2- 172.21.15.44:0/1851974344 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc25006aea0 0x7fc25006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.640+0000 7fc266ffd640 1 -- 172.21.15.44:0/1851974344 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7fc26808a4e0 con 0x7fc2701f38a0 2023-11-04T01:43:09.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.640+0000 7fc26e59c640 1 --2- 172.21.15.44:0/1851974344 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc25006aea0 0x7fc25006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.641+0000 7fc26e59c640 1 --2- 172.21.15.44:0/1851974344 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc25006aea0 0x7fc25006d360 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc260009b70 tx=0x7fc260008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.646 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.644+0000 7fc266ffd640 1 -- 172.21.15.44:0/1851974344 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc2700c9fc0 con 0x7fc2701f38a0 2023-11-04T01:43:09.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:09.892+0000 7fc274b55640 1 -- 172.21.15.44:0/1851974344 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7fc2700ca680 con 0x7fc2701f38a0 2023-11-04T01:43:10.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.305+0000 7fc266ffd640 1 -- 172.21.15.44:0/1851974344 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.8205 v108) v1 ==== 112+0+0 (secure 0 0 0) 0x7fc2700ca680 con 0x7fc2701f38a0 2023-11-04T01:43:10.307 INFO:teuthology.orchestra.run.smithi044.stderr:freezing mds.8205 2023-11-04T01:43:10.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.307+0000 7fc274b55640 1 -- 172.21.15.44:0/1851974344 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc25006aea0 msgr2=0x7fc25006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.307+0000 7fc274b55640 1 --2- 172.21.15.44:0/1851974344 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc25006aea0 0x7fc25006d360 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc260009b70 tx=0x7fc260008040 comp rx=0 tx=0).stop 2023-11-04T01:43:10.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.307+0000 7fc274b55640 1 -- 172.21.15.44:0/1851974344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2701f38a0 msgr2=0x7fc27015de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.307+0000 7fc274b55640 1 --2- 172.21.15.44:0/1851974344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2701f38a0 0x7fc27015de80 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fc27008c730 tx=0x7fc2680115a0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.307+0000 7fc274b55640 1 -- 172.21.15.44:0/1851974344 shutdown_connections 2023-11-04T01:43:10.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.307+0000 7fc274b55640 1 --2- 172.21.15.44:0/1851974344 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc25006aea0 0x7fc25006d360 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.307+0000 7fc274b55640 1 --2- 172.21.15.44:0/1851974344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2701f38a0 0x7fc27015de80 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.307+0000 7fc274b55640 1 --2- 172.21.15.44:0/1851974344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2701f3440 0x7fc27015d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.307+0000 7fc274b55640 1 --2- 172.21.15.44:0/1851974344 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25c003eb0 0x7fc2700b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.307+0000 7fc274b55640 1 -- 172.21.15.44:0/1851974344 >> 172.21.15.44:0/1851974344 conn(0x7fc2700d2ef0 msgr2=0x7fc27006a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.308+0000 7fc274b55640 1 -- 172.21.15.44:0/1851974344 shutdown_connections 2023-11-04T01:43:10.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.308+0000 7fc274b55640 1 -- 172.21.15.44:0/1851974344 wait complete. 2023-11-04T01:43:10.322 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:43:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.432+0000 7fa52af00640 1 Processor -- start 2023-11-04T01:43:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.432+0000 7fa52af00640 1 -- start start 2023-11-04T01:43:10.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.432+0000 7fa52af00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5240d1be0 0x7fa524167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.432+0000 7fa52af00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5240b32b0 con 0x7fa52415d4e0 2023-11-04T01:43:10.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.432+0000 7fa52af00640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5240cee10 con 0x7fa52415d100 2023-11-04T01:43:10.438 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.432+0000 7fa52af00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240cec20 con 0x7fa5240d1be0 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa523fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa52415d4e0 0x7fa5240d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60062/0 (socket says 172.21.15.44:60062) 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa523fff640 1 -- 172.21.15.44:0/1886743006 learned_addr learned my addr 172.21.15.44:0/1886743006 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa52949d640 1 --2- 172.21.15.44:0/1886743006 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5240d1be0 0x7fa524167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501087963 0 0) 0x7fa5240b32b0 con 0x7fa52415d4e0 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa510003520 con 0x7fa52415d4e0 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058361125 0 0) 0x7fa5240cee10 con 0x7fa52415d100 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5240b32b0 con 0x7fa52415d100 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 767906755 0 0) 0x7fa510003520 con 0x7fa52415d4e0 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5240d1be0 msgr2=0x7fa524167e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 --2- 172.21.15.44:0/1886743006 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5240d1be0 0x7fa524167e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 >> v1:172.21.15.204:6789/0 conn(0x7fa52415d100 legacy=0x7fa5240ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5240b4750 con 0x7fa52415d4e0 2023-11-04T01:43:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fa514001670 con 0x7fa52415d4e0 2023-11-04T01:43:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 >> v1:172.21.15.44:6789/0 conn(0x7fa52415d4e0 legacy=0x7fa5240d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 --2- 172.21.15.44:0/1886743006 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5240d1be0 0x7fa510003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 --2- 172.21.15.44:0/1886743006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa510004090 0x7fa5100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 --2- 172.21.15.44:0/1886743006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa510004d00 0x7fa510005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51000ba30 con 0x7fa510004d00 2023-11-04T01:43:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51000bba0 con 0x7fa510004090 2023-11-04T01:43:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51000bd60 con 0x7fa5240d1be0 2023-11-04T01:43:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.433+0000 7fa52949d640 1 --2- 172.21.15.44:0/1886743006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa510004d00 0x7fa510005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.434+0000 7fa523fff640 1 --2- 172.21.15.44:0/1886743006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa510004090 0x7fa5100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.434+0000 7fa528c9c640 1 --2- 172.21.15.44:0/1886743006 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5240d1be0 0x7fa510003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.434+0000 7fa52949d640 1 -- 172.21.15.44:0/1886743006 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5240d1be0 msgr2=0x7fa510003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.434+0000 7fa52949d640 1 --2- 172.21.15.44:0/1886743006 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5240d1be0 0x7fa510003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.434+0000 7fa52949d640 1 -- 172.21.15.44:0/1886743006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa510004090 msgr2=0x7fa5100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.434+0000 7fa52949d640 1 --2- 172.21.15.44:0/1886743006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa510004090 0x7fa5100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.434+0000 7fa52949d640 1 -- 172.21.15.44:0/1886743006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa510003520 con 0x7fa510004d00 2023-11-04T01:43:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.434+0000 7fa52949d640 1 --2- 172.21.15.44:0/1886743006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa510004d00 0x7fa510005180 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fa52408c730 tx=0x7fa5100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d84ebed6d3ee40 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.435+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c02c660 con 0x7fa510004d00 2023-11-04T01:43:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.435+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c02c7c0 con 0x7fa510004d00 2023-11-04T01:43:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.435+0000 7fa5237fe640 1 -- 172.21.15.44:0/1886743006 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c02cb50 con 0x7fa510004d00 2023-11-04T01:43:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.435+0000 7fa52af00640 1 -- 172.21.15.44:0/1886743006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa510004d00 msgr2=0x7fa510005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.435+0000 7fa52af00640 1 --2- 172.21.15.44:0/1886743006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa510004d00 0x7fa510005180 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fa52408c730 tx=0x7fa5100057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.435+0000 7fa52949d640 1 -- 172.21.15.44:0/1886743006 reap_dead start 2023-11-04T01:43:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.435+0000 7fa52af00640 1 -- 172.21.15.44:0/1886743006 shutdown_connections 2023-11-04T01:43:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.435+0000 7fa52af00640 1 -- 172.21.15.44:0/1886743006 >> 172.21.15.44:0/1886743006 conn(0x7fa5240d2ef0 msgr2=0x7fa5240d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.435+0000 7fa52af00640 1 -- 172.21.15.44:0/1886743006 shutdown_connections 2023-11-04T01:43:10.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.435+0000 7fa52af00640 1 -- 172.21.15.44:0/1886743006 wait complete. 2023-11-04T01:43:10.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.436+0000 7fa52af00640 1 Processor -- start 2023-11-04T01:43:10.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.436+0000 7fa52af00640 1 -- start start 2023-11-04T01:43:10.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.437+0000 7fa52af00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa52415fbc0 0x7fa5240b8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.437+0000 7fa52af00640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5240b5a30 0x7fa52415adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.437+0000 7fa52af00640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa52415ffa0 0x7fa52415b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.437+0000 7fa52af00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240b6f50 con 0x7fa52415fbc0 2023-11-04T01:43:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.437+0000 7fa52af00640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240b6ac0 con 0x7fa5240b5a30 2023-11-04T01:43:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.437+0000 7fa52af00640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240b5eb0 con 0x7fa52415ffa0 2023-11-04T01:43:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.437+0000 7fa528c9c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa52415fbc0 0x7fa5240b8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.437+0000 7fa528c9c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa52415fbc0 0x7fa5240b8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44656/0 (socket says 172.21.15.44:44656) 2023-11-04T01:43:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.437+0000 7fa528c9c640 1 -- 172.21.15.44:0/3160026593 learned_addr learned my addr 172.21.15.44:0/3160026593 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.438+0000 7fa528c9c640 1 -- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa52415ffa0 msgr2=0x7fa52415b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.438+0000 7fa52949d640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa52415ffa0 0x7fa52415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.438+0000 7fa523fff640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5240b5a30 0x7fa52415adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.438+0000 7fa528c9c640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa52415ffa0 0x7fa52415b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.438+0000 7fa528c9c640 1 -- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5240b5a30 msgr2=0x7fa52415adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.438+0000 7fa528c9c640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5240b5a30 0x7fa52415adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.438+0000 7fa528c9c640 1 -- 172.21.15.44:0/3160026593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5240b6190 con 0x7fa52415fbc0 2023-11-04T01:43:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.438+0000 7fa52949d640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa52415ffa0 0x7fa52415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.438+0000 7fa523fff640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5240b5a30 0x7fa52415adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.438+0000 7fa528c9c640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa52415fbc0 0x7fa5240b8730 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00fae0 tx=0x7fa51c00d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.438+0000 7fa5217fa640 1 -- 172.21.15.44:0/3160026593 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c003bd0 con 0x7fa52415fbc0 2023-11-04T01:43:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.438+0000 7fa5217fa640 1 -- 172.21.15.44:0/3160026593 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c003d30 con 0x7fa52415fbc0 2023-11-04T01:43:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.438+0000 7fa52af00640 1 -- 172.21.15.44:0/3160026593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5240b6470 con 0x7fa52415fbc0 2023-11-04T01:43:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.438+0000 7fa5217fa640 1 -- 172.21.15.44:0/3160026593 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c003ea0 con 0x7fa52415fbc0 2023-11-04T01:43:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.438+0000 7fa52af00640 1 -- 172.21.15.44:0/3160026593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5240b7ab0 con 0x7fa52415fbc0 2023-11-04T01:43:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.439+0000 7fa52af00640 1 -- 172.21.15.44:0/3160026593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5240684b0 con 0x7fa52415fbc0 2023-11-04T01:43:10.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.440+0000 7fa5217fa640 1 -- 172.21.15.44:0/3160026593 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa51c00db60 con 0x7fa52415fbc0 2023-11-04T01:43:10.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.440+0000 7fa5217fa640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa50406ae70 0x7fa50406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.440+0000 7fa5217fa640 1 -- 172.21.15.44:0/3160026593 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7fa51c08a380 con 0x7fa52415fbc0 2023-11-04T01:43:10.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.440+0000 7fa523fff640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa50406ae70 0x7fa50406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.441+0000 7fa523fff640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa50406ae70 0x7fa50406d330 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa514004840 tx=0x7fa514009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.444+0000 7fa5217fa640 1 -- 172.21.15.44:0/3160026593 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa51c054b80 con 0x7fa52415fbc0 2023-11-04T01:43:10.697 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:10.695+0000 7fa52af00640 1 -- 172.21.15.44:0/3160026593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7fa5240b8db0 con 0x7fa52415fbc0 2023-11-04T01:43:11.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.315+0000 7fa5217fa640 1 -- 172.21.15.44:0/3160026593 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.8430 v109) v1 ==== 112+0+0 (secure 0 0 0) 0x7fa51c0581a0 con 0x7fa52415fbc0 2023-11-04T01:43:11.317 INFO:teuthology.orchestra.run.smithi044.stderr:freezing mds.8430 2023-11-04T01:43:11.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.318+0000 7fa52af00640 1 -- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa50406ae70 msgr2=0x7fa50406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.318+0000 7fa52af00640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa50406ae70 0x7fa50406d330 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa514004840 tx=0x7fa514009040 comp rx=0 tx=0).stop 2023-11-04T01:43:11.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.318+0000 7fa52af00640 1 -- 172.21.15.44:0/3160026593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa52415fbc0 msgr2=0x7fa5240b8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.318+0000 7fa52af00640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa52415fbc0 0x7fa5240b8730 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00fae0 tx=0x7fa51c00d150 comp rx=0 tx=0).stop 2023-11-04T01:43:11.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.318+0000 7fa52af00640 1 -- 172.21.15.44:0/3160026593 shutdown_connections 2023-11-04T01:43:11.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.318+0000 7fa52af00640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa50406ae70 0x7fa50406d330 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.318+0000 7fa52af00640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa52415ffa0 0x7fa52415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.318+0000 7fa52af00640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5240b5a30 0x7fa52415adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.318+0000 7fa52af00640 1 --2- 172.21.15.44:0/3160026593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa52415fbc0 0x7fa5240b8730 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.318+0000 7fa52af00640 1 -- 172.21.15.44:0/3160026593 >> 172.21.15.44:0/3160026593 conn(0x7fa5240d2ef0 msgr2=0x7fa5240cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.318+0000 7fa52af00640 1 -- 172.21.15.44:0/3160026593 shutdown_connections 2023-11-04T01:43:11.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.318+0000 7fa52af00640 1 -- 172.21.15.44:0/3160026593 wait complete. 2023-11-04T01:43:11.333 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 6 2023-11-04T01:43:11.457 INFO:teuthology.orchestra.run.smithi044.stdout:{"success":"mds_kill_mdstable_at = '6' (not observed, change may require restart) "} 2023-11-04T01:43:11.457 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '6' (not observed, change may require restart) " } 2023-11-04T01:43:11.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:11.458 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s26) 2023-11-04T01:43:11.460 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:43:11.592 INFO:teuthology.orchestra.run.smithi044.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:43:11.593 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:43:11.593 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:11.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.697+0000 7f00090af640 1 Processor -- start 2023-11-04T01:43:11.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.697+0000 7f00090af640 1 -- start start 2023-11-04T01:43:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.698+0000 7f00090af640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f000415d4e0 0x7f00040d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.698+0000 7f00090af640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f00040d3b60 0x7f00040d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.698+0000 7f00090af640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00040b32b0 con 0x7f000415d100 2023-11-04T01:43:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.698+0000 7f00090af640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00040cec20 con 0x7f000415d4e0 2023-11-04T01:43:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.698+0000 7f00090af640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00040cee10 con 0x7f00040d3b60 2023-11-04T01:43:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.698+0000 7f0002d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f000415d100 0x7f00040ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60068/0 (socket says 172.21.15.44:60068) 2023-11-04T01:43:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.698+0000 7f0002d9d640 1 -- 172.21.15.44:0/488333599 learned_addr learned my addr 172.21.15.44:0/488333599 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.698+0000 7f000259c640 1 --2- 172.21.15.44:0/488333599 >> v2:172.21.15.44:3300/0 conn(0x7f000415d4e0 0x7f00040d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.698+0000 7f0001d9b640 1 -- 172.21.15.44:0/488333599 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8419744 0 0) 0x7f00040b32b0 con 0x7f000415d100 2023-11-04T01:43:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.698+0000 7f0001d9b640 1 -- 172.21.15.44:0/488333599 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff0003520 con 0x7f000415d100 2023-11-04T01:43:11.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.698+0000 7f000359e640 1 --2- 172.21.15.44:0/488333599 >> v2:172.21.15.204:3300/0 conn(0x7f00040d3b60 0x7f00040d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.699+0000 7f000259c640 1 -- 172.21.15.44:0/488333599 >> v2:172.21.15.204:3300/0 conn(0x7f00040d3b60 msgr2=0x7f00040d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.699+0000 7f000259c640 1 --2- 172.21.15.44:0/488333599 >> v2:172.21.15.204:3300/0 conn(0x7f00040d3b60 0x7f00040d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.699+0000 7f000259c640 1 -- 172.21.15.44:0/488333599 >> v1:172.21.15.44:6789/0 conn(0x7f000415d100 legacy=0x7f00040ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.699+0000 7f000259c640 1 -- 172.21.15.44:0/488333599 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040b4750 con 0x7f000415d4e0 2023-11-04T01:43:11.702 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.699+0000 7f000359e640 1 --2- 172.21.15.44:0/488333599 >> v2:172.21.15.204:3300/0 conn(0x7f00040d3b60 0x7f00040d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:11.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.699+0000 7f000259c640 1 --2- 172.21.15.44:0/488333599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f000415d4e0 0x7f00040d14d0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f000408d6a0 tx=0x7effec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e7c5b5312b6c6c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.699+0000 7f0001d9b640 1 -- 172.21.15.44:0/488333599 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec031830 con 0x7f000415d4e0 2023-11-04T01:43:11.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.699+0000 7f0001d9b640 1 -- 172.21.15.44:0/488333599 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec031990 con 0x7f000415d4e0 2023-11-04T01:43:11.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.699+0000 7f0001d9b640 1 -- 172.21.15.44:0/488333599 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec031d00 con 0x7f000415d4e0 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.700+0000 7f00090af640 1 -- 172.21.15.44:0/488333599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f000415d4e0 msgr2=0x7f00040d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.700+0000 7f00090af640 1 --2- 172.21.15.44:0/488333599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f000415d4e0 0x7f00040d14d0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f000408d6a0 tx=0x7effec02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.700+0000 7f00090af640 1 -- 172.21.15.44:0/488333599 shutdown_connections 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.700+0000 7f00090af640 1 --2- 172.21.15.44:0/488333599 >> v2:172.21.15.204:3300/0 conn(0x7f00040d3b60 0x7f00040d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.700+0000 7f00090af640 1 --2- 172.21.15.44:0/488333599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f000415d4e0 0x7f00040d14d0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.700+0000 7f00090af640 1 -- 172.21.15.44:0/488333599 >> 172.21.15.44:0/488333599 conn(0x7f00040d2ef0 msgr2=0x7f00040d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.700+0000 7f00090af640 1 -- 172.21.15.44:0/488333599 shutdown_connections 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.700+0000 7f00090af640 1 -- 172.21.15.44:0/488333599 wait complete. 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.702+0000 7f00090af640 1 Processor -- start 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.702+0000 7f00090af640 1 -- start start 2023-11-04T01:43:11.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.702+0000 7f00090af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00040d3b60 0x7f00040caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.702+0000 7f00090af640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f000415d100 0x7f00040cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.702+0000 7f00090af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f000415d4e0 0x7f00041f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.706 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.702+0000 7f00090af640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000415b150 con 0x7f000415d4e0 2023-11-04T01:43:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.702+0000 7f00090af640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00041f3ad0 con 0x7f000415d100 2023-11-04T01:43:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.702+0000 7f00090af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00041f3d70 con 0x7f00040d3b60 2023-11-04T01:43:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.702+0000 7f000359e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f000415d4e0 0x7f00041f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.703+0000 7f000359e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f000415d4e0 0x7f00041f2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44674/0 (socket says 172.21.15.44:44674) 2023-11-04T01:43:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.703+0000 7f000359e640 1 -- 172.21.15.44:0/1836102685 learned_addr learned my addr 172.21.15.44:0/1836102685 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.703+0000 7f000259c640 1 --2- 172.21.15.44:0/1836102685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f000415d100 0x7f00040cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.703+0000 7f0002d9d640 1 --2- 172.21.15.44:0/1836102685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00040d3b60 0x7f00040caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.703+0000 7f000359e640 1 -- 172.21.15.44:0/1836102685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00040d3b60 msgr2=0x7f00040caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.703+0000 7f000359e640 1 --2- 172.21.15.44:0/1836102685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00040d3b60 0x7f00040caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.703+0000 7f000359e640 1 -- 172.21.15.44:0/1836102685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f000415d100 msgr2=0x7f00040cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.703+0000 7f000359e640 1 --2- 172.21.15.44:0/1836102685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f000415d100 0x7f00040cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.703+0000 7f000359e640 1 -- 172.21.15.44:0/1836102685 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec009400 con 0x7f000415d4e0 2023-11-04T01:43:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.703+0000 7f000359e640 1 --2- 172.21.15.44:0/1836102685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f000415d4e0 0x7f00041f2870 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7efff400cef0 tx=0x7efff400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.703+0000 7efffb7fe640 1 -- 172.21.15.44:0/1836102685 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff400d840 con 0x7f000415d4e0 2023-11-04T01:43:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.703+0000 7efffb7fe640 1 -- 172.21.15.44:0/1836102685 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff400d9c0 con 0x7f000415d4e0 2023-11-04T01:43:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.703+0000 7f00090af640 1 -- 172.21.15.44:0/1836102685 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00041f4050 con 0x7f000415d4e0 2023-11-04T01:43:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.703+0000 7efffb7fe640 1 -- 172.21.15.44:0/1836102685 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff400dd70 con 0x7f000415d4e0 2023-11-04T01:43:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.703+0000 7f00090af640 1 -- 172.21.15.44:0/1836102685 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00040cb920 con 0x7f000415d4e0 2023-11-04T01:43:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.704+0000 7f00090af640 1 -- 172.21.15.44:0/1836102685 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00041f4570 con 0x7f000415d4e0 2023-11-04T01:43:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.705+0000 7efffb7fe640 1 -- 172.21.15.44:0/1836102685 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efff401e3b0 con 0x7f000415d4e0 2023-11-04T01:43:11.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.705+0000 7efffb7fe640 1 --2- 172.21.15.44:0/1836102685 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7effe406aea0 0x7effe406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.705+0000 7efffb7fe640 1 -- 172.21.15.44:0/1836102685 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7efff408a820 con 0x7f000415d4e0 2023-11-04T01:43:11.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.705+0000 7f0002d9d640 1 --2- 172.21.15.44:0/1836102685 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7effe406aea0 0x7effe406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.706+0000 7f0002d9d640 1 --2- 172.21.15.44:0/1836102685 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7effe406aea0 0x7effe406d360 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7efffc001360 tx=0x7efffc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.709+0000 7efffb7fe640 1 -- 172.21.15.44:0/1836102685 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00041f4570 con 0x7f000415d4e0 2023-11-04T01:43:11.923 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.921+0000 7f00090af640 1 -- 172.21.15.44:0/1836102685 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00041f4570 con 0x7f000415d4e0 2023-11-04T01:43:11.924 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.922+0000 7efffb7fe640 1 -- 172.21.15.44:0/1836102685 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4931 (secure 0 0 0) 0x7f00041f4570 con 0x7f000415d4e0 2023-11-04T01:43:11.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:11.924 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":109,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:10.696885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:11.924 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 109 2023-11-04T01:43:11.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.924+0000 7f00090af640 1 -- 172.21.15.44:0/1836102685 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7effe406aea0 msgr2=0x7effe406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.924+0000 7f00090af640 1 --2- 172.21.15.44:0/1836102685 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7effe406aea0 0x7effe406d360 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7efffc001360 tx=0x7efffc009040 comp rx=0 tx=0).stop 2023-11-04T01:43:11.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.924+0000 7f00090af640 1 -- 172.21.15.44:0/1836102685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f000415d4e0 msgr2=0x7f00041f2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.924+0000 7f00090af640 1 --2- 172.21.15.44:0/1836102685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f000415d4e0 0x7f00041f2870 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7efff400cef0 tx=0x7efff400a710 comp rx=0 tx=0).stop 2023-11-04T01:43:11.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.924+0000 7f00090af640 1 -- 172.21.15.44:0/1836102685 shutdown_connections 2023-11-04T01:43:11.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.924+0000 7f00090af640 1 --2- 172.21.15.44:0/1836102685 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7effe406aea0 0x7effe406d360 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.924+0000 7f00090af640 1 --2- 172.21.15.44:0/1836102685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f000415d4e0 0x7f00041f2870 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.924+0000 7f00090af640 1 --2- 172.21.15.44:0/1836102685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f000415d100 0x7f00040cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.924+0000 7f00090af640 1 --2- 172.21.15.44:0/1836102685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00040d3b60 0x7f00040caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.924+0000 7f00090af640 1 -- 172.21.15.44:0/1836102685 >> 172.21.15.44:0/1836102685 conn(0x7f00040d2ef0 msgr2=0x7f000406c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.924+0000 7f00090af640 1 -- 172.21.15.44:0/1836102685 shutdown_connections 2023-11-04T01:43:11.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:11.924+0000 7f00090af640 1 -- 172.21.15.44:0/1836102685 wait complete. 2023-11-04T01:43:11.936 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:15.959 INFO:tasks.ceph.mds.c.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f642988e640 time 2023-11-04T01:43:15.958447+0000 2023-11-04T01:43:15.959 INFO:tasks.ceph.mds.c.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:43:15.959 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:15.959 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f643536efaf] 2023-11-04T01:43:15.960 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f643536f16d] 2023-11-04T01:43:15.960 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x556d69fb321b] 2023-11-04T01:43:15.960 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: (MDSContext::complete(int)+0x5c) [0x556d69fe2bcc] 2023-11-04T01:43:15.960 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x556d69febb0c] 2023-11-04T01:43:15.960 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x556d69febc63] 2023-11-04T01:43:15.960 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f64354164a5] 2023-11-04T01:43:15.960 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f6434a9f802] 2023-11-04T01:43:15.960 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f6434a3f450] 2023-11-04T01:43:15.960 INFO:tasks.ceph.mds.c.smithi044.stderr:2023-11-04T01:43:15.957+0000 7f642988e640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f642988e640 time 2023-11-04T01:43:15.958447+0000 2023-11-04T01:43:15.960 INFO:tasks.ceph.mds.c.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:43:15.960 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:43:15.960 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:15.961 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f643536efaf] 2023-11-04T01:43:15.961 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f643536f16d] 2023-11-04T01:43:15.961 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x556d69fb321b] 2023-11-04T01:43:15.961 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: (MDSContext::complete(int)+0x5c) [0x556d69fe2bcc] 2023-11-04T01:43:15.961 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x556d69febb0c] 2023-11-04T01:43:15.961 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x556d69febc63] 2023-11-04T01:43:15.961 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f64354164a5] 2023-11-04T01:43:15.961 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f6434a9f802] 2023-11-04T01:43:15.961 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f6434a3f450] 2023-11-04T01:43:15.961 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:43:15.961 INFO:tasks.ceph.mds.c.smithi044.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:43:15.961 INFO:tasks.ceph.mds.c.smithi044.stderr: in thread 7f642988e640 thread_name:MR_Finisher 2023-11-04T01:43:15.962 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:15.962 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f6434a54db0] 2023-11-04T01:43:15.962 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f6434aa154c] 2023-11-04T01:43:15.962 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: raise() 2023-11-04T01:43:15.962 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: abort() 2023-11-04T01:43:15.962 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f643536f009] 2023-11-04T01:43:15.962 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f643536f16d] 2023-11-04T01:43:15.962 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x556d69fb321b] 2023-11-04T01:43:15.963 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: (MDSContext::complete(int)+0x5c) [0x556d69fe2bcc] 2023-11-04T01:43:15.963 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x556d69febb0c] 2023-11-04T01:43:15.963 INFO:tasks.ceph.mds.c.smithi044.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x556d69febc63] 2023-11-04T01:43:15.963 INFO:tasks.ceph.mds.c.smithi044.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f64354164a5] 2023-11-04T01:43:15.963 INFO:tasks.ceph.mds.c.smithi044.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f6434a9f802] 2023-11-04T01:43:15.963 INFO:tasks.ceph.mds.c.smithi044.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f6434a3f450] 2023-11-04T01:43:15.963 INFO:tasks.ceph.mds.c.smithi044.stderr:2023-11-04T01:43:15.958+0000 7f642988e640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:43:15.963 INFO:tasks.ceph.mds.c.smithi044.stderr: in thread 7f642988e640 thread_name:MR_Finisher 2023-11-04T01:43:15.963 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:43:15.963 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:15.963 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f6434a54db0] 2023-11-04T01:43:15.963 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f6434aa154c] 2023-11-04T01:43:15.963 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: raise() 2023-11-04T01:43:15.963 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: abort() 2023-11-04T01:43:15.964 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f643536f009] 2023-11-04T01:43:15.964 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f643536f16d] 2023-11-04T01:43:15.964 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x556d69fb321b] 2023-11-04T01:43:15.964 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: (MDSContext::complete(int)+0x5c) [0x556d69fe2bcc] 2023-11-04T01:43:15.964 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x556d69febb0c] 2023-11-04T01:43:15.964 INFO:tasks.ceph.mds.c.smithi044.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x556d69febc63] 2023-11-04T01:43:15.964 INFO:tasks.ceph.mds.c.smithi044.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f64354164a5] 2023-11-04T01:43:15.964 INFO:tasks.ceph.mds.c.smithi044.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f6434a9f802] 2023-11-04T01:43:15.964 INFO:tasks.ceph.mds.c.smithi044.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f6434a3f450] 2023-11-04T01:43:15.964 INFO:tasks.ceph.mds.c.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:43:15.964 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:43:15.965 INFO:tasks.ceph.mds.c.smithi044.stderr: -1057> 2023-11-04T01:43:02.868+0000 7f642d095640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:15.965 INFO:tasks.ceph.mds.c.smithi044.stderr: -1055> 2023-11-04T01:43:02.868+0000 7f642d095640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:43:15.966 INFO:tasks.ceph.mds.c.smithi044.stderr: -1> 2023-11-04T01:43:15.957+0000 7f642988e640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f642988e640 time 2023-11-04T01:43:15.958447+0000 2023-11-04T01:43:15.966 INFO:tasks.ceph.mds.c.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:43:15.966 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:43:15.966 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:15.966 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f643536efaf] 2023-11-04T01:43:15.966 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f643536f16d] 2023-11-04T01:43:15.966 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x556d69fb321b] 2023-11-04T01:43:15.967 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: (MDSContext::complete(int)+0x5c) [0x556d69fe2bcc] 2023-11-04T01:43:15.967 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x556d69febb0c] 2023-11-04T01:43:15.967 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x556d69febc63] 2023-11-04T01:43:15.967 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f64354164a5] 2023-11-04T01:43:15.967 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f6434a9f802] 2023-11-04T01:43:15.967 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f6434a3f450] 2023-11-04T01:43:15.967 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:43:15.967 INFO:tasks.ceph.mds.c.smithi044.stderr: 0> 2023-11-04T01:43:15.958+0000 7f642988e640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:43:15.967 INFO:tasks.ceph.mds.c.smithi044.stderr: in thread 7f642988e640 thread_name:MR_Finisher 2023-11-04T01:43:15.967 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:43:15.967 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:15.967 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f6434a54db0] 2023-11-04T01:43:15.967 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f6434aa154c] 2023-11-04T01:43:15.967 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: raise() 2023-11-04T01:43:15.968 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: abort() 2023-11-04T01:43:15.968 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f643536f009] 2023-11-04T01:43:15.968 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f643536f16d] 2023-11-04T01:43:15.968 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x556d69fb321b] 2023-11-04T01:43:15.968 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: (MDSContext::complete(int)+0x5c) [0x556d69fe2bcc] 2023-11-04T01:43:15.968 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x556d69febb0c] 2023-11-04T01:43:15.968 INFO:tasks.ceph.mds.c.smithi044.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x556d69febc63] 2023-11-04T01:43:15.968 INFO:tasks.ceph.mds.c.smithi044.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f64354164a5] 2023-11-04T01:43:15.968 INFO:tasks.ceph.mds.c.smithi044.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f6434a9f802] 2023-11-04T01:43:15.968 INFO:tasks.ceph.mds.c.smithi044.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f6434a3f450] 2023-11-04T01:43:15.968 INFO:tasks.ceph.mds.c.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:43:15.968 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:43:15.969 INFO:tasks.ceph.mds.c.smithi044.stderr: -1060> 2023-11-04T01:43:02.868+0000 7f642d095640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:15.970 INFO:tasks.ceph.mds.c.smithi044.stderr: -1058> 2023-11-04T01:43:02.868+0000 7f642d095640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:43:15.971 INFO:tasks.ceph.mds.c.smithi044.stderr: -4> 2023-11-04T01:43:15.957+0000 7f642988e640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f642988e640 time 2023-11-04T01:43:15.958447+0000 2023-11-04T01:43:15.971 INFO:tasks.ceph.mds.c.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:43:15.971 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:43:15.971 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:15.971 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f643536efaf] 2023-11-04T01:43:15.971 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f643536f16d] 2023-11-04T01:43:15.971 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x556d69fb321b] 2023-11-04T01:43:15.971 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: (MDSContext::complete(int)+0x5c) [0x556d69fe2bcc] 2023-11-04T01:43:15.972 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x556d69febb0c] 2023-11-04T01:43:15.972 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x556d69febc63] 2023-11-04T01:43:15.972 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f64354164a5] 2023-11-04T01:43:15.972 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f6434a9f802] 2023-11-04T01:43:15.972 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f6434a3f450] 2023-11-04T01:43:15.972 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:43:15.972 INFO:tasks.ceph.mds.c.smithi044.stderr: -3> 2023-11-04T01:43:15.958+0000 7f642988e640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:43:15.972 INFO:tasks.ceph.mds.c.smithi044.stderr: in thread 7f642988e640 thread_name:MR_Finisher 2023-11-04T01:43:15.972 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:43:15.972 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:15.972 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f6434a54db0] 2023-11-04T01:43:15.972 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f6434aa154c] 2023-11-04T01:43:15.972 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: raise() 2023-11-04T01:43:15.972 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: abort() 2023-11-04T01:43:15.972 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f643536f009] 2023-11-04T01:43:15.973 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f643536f16d] 2023-11-04T01:43:15.973 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x556d69fb321b] 2023-11-04T01:43:15.973 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: (MDSContext::complete(int)+0x5c) [0x556d69fe2bcc] 2023-11-04T01:43:15.973 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x556d69febb0c] 2023-11-04T01:43:15.973 INFO:tasks.ceph.mds.c.smithi044.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x556d69febc63] 2023-11-04T01:43:15.973 INFO:tasks.ceph.mds.c.smithi044.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f64354164a5] 2023-11-04T01:43:15.973 INFO:tasks.ceph.mds.c.smithi044.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f6434a9f802] 2023-11-04T01:43:15.973 INFO:tasks.ceph.mds.c.smithi044.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f6434a3f450] 2023-11-04T01:43:15.973 INFO:tasks.ceph.mds.c.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:43:15.973 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:43:16.228 INFO:tasks.ceph.mds.c.smithi044.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:43:16.938 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:17.056 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.055+0000 7f91cde15640 1 Processor -- start 2023-11-04T01:43:17.057 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.055+0000 7f91cde15640 1 -- start start 2023-11-04T01:43:17.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.055+0000 7f91cde15640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f91c815d100 0x7f91c80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.055+0000 7f91cde15640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f91c80d1be0 0x7f91c80b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.055+0000 7f91cde15640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c80b32b0 con 0x7f91c815d4e0 2023-11-04T01:43:17.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.055+0000 7f91cde15640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c80cee10 con 0x7f91c80d1be0 2023-11-04T01:43:17.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.055+0000 7f91cde15640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c80b2980 con 0x7f91c815d100 2023-11-04T01:43:17.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.056+0000 7f91c7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f91c80d1be0 0x7f91c80b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.056+0000 7f91c7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f91c80d1be0 0x7f91c80b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50366/0 (socket says 172.21.15.44:50366) 2023-11-04T01:43:17.058 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.056+0000 7f91c7fff640 1 -- 172.21.15.44:0/4068145019 learned_addr learned my addr 172.21.15.44:0/4068145019 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:17.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.056+0000 7f91c77fe640 1 --2- 172.21.15.44:0/4068145019 >> v2:172.21.15.204:3300/0 conn(0x7f91c815d100 0x7f91c80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.056+0000 7f91c7fff640 1 -- 172.21.15.44:0/4068145019 >> v2:172.21.15.204:3300/0 conn(0x7f91c815d100 msgr2=0x7f91c80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:17.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.056+0000 7f91c7fff640 1 --2- 172.21.15.44:0/4068145019 >> v2:172.21.15.204:3300/0 conn(0x7f91c815d100 0x7f91c80ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.056+0000 7f91c7fff640 1 -- 172.21.15.44:0/4068145019 >> v1:172.21.15.204:6789/0 conn(0x7f91c815d4e0 legacy=0x7f91c80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:17.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.056+0000 7f91c7fff640 1 -- 172.21.15.44:0/4068145019 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c80b2c60 con 0x7f91c80d1be0 2023-11-04T01:43:17.059 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.056+0000 7f91c77fe640 1 --2- 172.21.15.44:0/4068145019 >> v2:172.21.15.204:3300/0 conn(0x7f91c815d100 0x7f91c80ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:17.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.057+0000 7f91c7fff640 1 --2- 172.21.15.44:0/4068145019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c80d1be0 0x7f91c80b3740 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f91c80d09f0 tx=0x7f91c002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809704b9731457eb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.057+0000 7f91c67fc640 1 -- 172.21.15.44:0/4068145019 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c002ca80 con 0x7f91c80d1be0 2023-11-04T01:43:17.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.057+0000 7f91c67fc640 1 -- 172.21.15.44:0/4068145019 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c002cbe0 con 0x7f91c80d1be0 2023-11-04T01:43:17.060 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.057+0000 7f91c67fc640 1 -- 172.21.15.44:0/4068145019 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00343f0 con 0x7f91c80d1be0 2023-11-04T01:43:17.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.057+0000 7f91cde15640 1 -- 172.21.15.44:0/4068145019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c80d1be0 msgr2=0x7f91c80b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.057+0000 7f91cde15640 1 --2- 172.21.15.44:0/4068145019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c80d1be0 0x7f91c80b3740 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f91c80d09f0 tx=0x7f91c002bee0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.058+0000 7f91cde15640 1 -- 172.21.15.44:0/4068145019 shutdown_connections 2023-11-04T01:43:17.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.058+0000 7f91cde15640 1 --2- 172.21.15.44:0/4068145019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c80d1be0 0x7f91c80b3740 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.058+0000 7f91cde15640 1 --2- 172.21.15.44:0/4068145019 >> v2:172.21.15.204:3300/0 conn(0x7f91c815d100 0x7f91c80ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.058+0000 7f91cde15640 1 -- 172.21.15.44:0/4068145019 >> 172.21.15.44:0/4068145019 conn(0x7f91c80d2ef0 msgr2=0x7f91c80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.058+0000 7f91cde15640 1 -- 172.21.15.44:0/4068145019 shutdown_connections 2023-11-04T01:43:17.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.058+0000 7f91cde15640 1 -- 172.21.15.44:0/4068145019 wait complete. 2023-11-04T01:43:17.061 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.059+0000 7f91cde15640 1 Processor -- start 2023-11-04T01:43:17.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.059+0000 7f91cde15640 1 -- start start 2023-11-04T01:43:17.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91cde15640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c80d1be0 0x7f91c80cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91cde15640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91c815d100 0x7f91c80b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91cde15640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91c815d4e0 0x7f91c80b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91cde15640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c80b6480 con 0x7f91c80d1be0 2023-11-04T01:43:17.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91cde15640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c80c9fc0 con 0x7f91c815d100 2023-11-04T01:43:17.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91cde15640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c80cc830 con 0x7f91c815d4e0 2023-11-04T01:43:17.063 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91c77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c80d1be0 0x7f91c80cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91c77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c80d1be0 0x7f91c80cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50370/0 (socket says 172.21.15.44:50370) 2023-11-04T01:43:17.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91c77fe640 1 -- 172.21.15.44:0/3710700165 learned_addr learned my addr 172.21.15.44:0/3710700165 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:17.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91c7fff640 1 --2- 172.21.15.44:0/3710700165 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91c815d4e0 0x7f91c80b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91c6ffd640 1 --2- 172.21.15.44:0/3710700165 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91c815d100 0x7f91c80b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91c77fe640 1 -- 172.21.15.44:0/3710700165 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91c815d4e0 msgr2=0x7f91c80b7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91c77fe640 1 --2- 172.21.15.44:0/3710700165 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91c815d4e0 0x7f91c80b7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91c77fe640 1 -- 172.21.15.44:0/3710700165 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91c815d100 msgr2=0x7f91c80b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91c77fe640 1 --2- 172.21.15.44:0/3710700165 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91c815d100 0x7f91c80b7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91c77fe640 1 -- 172.21.15.44:0/3710700165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c0009b30 con 0x7f91c80d1be0 2023-11-04T01:43:17.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.060+0000 7f91c77fe640 1 --2- 172.21.15.44:0/3710700165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c80d1be0 0x7f91c80cc2f0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f91b800c7f0 tx=0x7f91b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.061+0000 7f91affff640 1 -- 172.21.15.44:0/3710700165 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b8005b90 con 0x7f91c80d1be0 2023-11-04T01:43:17.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.061+0000 7f91affff640 1 -- 172.21.15.44:0/3710700165 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b8005cf0 con 0x7f91c80d1be0 2023-11-04T01:43:17.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.061+0000 7f91affff640 1 -- 172.21.15.44:0/3710700165 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b8007a30 con 0x7f91c80d1be0 2023-11-04T01:43:17.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.061+0000 7f91cde15640 1 -- 172.21.15.44:0/3710700165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c80b6690 con 0x7f91c80d1be0 2023-11-04T01:43:17.065 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.061+0000 7f91cde15640 1 -- 172.21.15.44:0/3710700165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c80ca210 con 0x7f91c80d1be0 2023-11-04T01:43:17.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.062+0000 7f91cde15640 1 -- 172.21.15.44:0/3710700165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c80684b0 con 0x7f91c80d1be0 2023-11-04T01:43:17.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.062+0000 7f91affff640 1 -- 172.21.15.44:0/3710700165 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f91b8007b90 con 0x7f91c80d1be0 2023-11-04T01:43:17.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.063+0000 7f91affff640 1 --2- 172.21.15.44:0/3710700165 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f91b406ae70 0x7f91b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.063+0000 7f91affff640 1 -- 172.21.15.44:0/3710700165 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f91b8089e80 con 0x7f91c80d1be0 2023-11-04T01:43:17.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.063+0000 7f91c6ffd640 1 --2- 172.21.15.44:0/3710700165 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f91b406ae70 0x7f91b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.063+0000 7f91c6ffd640 1 --2- 172.21.15.44:0/3710700165 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f91b406ae70 0x7f91b406d330 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f91c80b6f60 tx=0x7f91bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.067+0000 7f91affff640 1 -- 172.21.15.44:0/3710700165 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f91b8054670 con 0x7f91c80d1be0 2023-11-04T01:43:17.282 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.281+0000 7f91cde15640 1 -- 172.21.15.44:0/3710700165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91c80d2cd0 con 0x7f91c80d1be0 2023-11-04T01:43:17.283 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.281+0000 7f91affff640 1 -- 172.21.15.44:0/3710700165 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4931 (secure 0 0 0) 0x7f91b801e070 con 0x7f91c80d1be0 2023-11-04T01:43:17.283 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:17.283 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":109,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:10.696885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:17.284 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 109 2023-11-04T01:43:17.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.283+0000 7f91cde15640 1 -- 172.21.15.44:0/3710700165 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f91b406ae70 msgr2=0x7f91b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.283+0000 7f91cde15640 1 --2- 172.21.15.44:0/3710700165 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f91b406ae70 0x7f91b406d330 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f91c80b6f60 tx=0x7f91bc009040 comp rx=0 tx=0).stop 2023-11-04T01:43:17.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.283+0000 7f91cde15640 1 -- 172.21.15.44:0/3710700165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c80d1be0 msgr2=0x7f91c80cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.285 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.283+0000 7f91cde15640 1 --2- 172.21.15.44:0/3710700165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c80d1be0 0x7f91c80cc2f0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f91b800c7f0 tx=0x7f91b800cbf0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.283+0000 7f91cde15640 1 -- 172.21.15.44:0/3710700165 shutdown_connections 2023-11-04T01:43:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.283+0000 7f91cde15640 1 --2- 172.21.15.44:0/3710700165 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f91b406ae70 0x7f91b406d330 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.283+0000 7f91cde15640 1 --2- 172.21.15.44:0/3710700165 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91c815d4e0 0x7f91c80b7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.283+0000 7f91cde15640 1 --2- 172.21.15.44:0/3710700165 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91c815d100 0x7f91c80b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.283+0000 7f91cde15640 1 --2- 172.21.15.44:0/3710700165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c80d1be0 0x7f91c80cc2f0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.283+0000 7f91cde15640 1 -- 172.21.15.44:0/3710700165 >> 172.21.15.44:0/3710700165 conn(0x7f91c80d2ef0 msgr2=0x7f91c80b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.283+0000 7f91cde15640 1 -- 172.21.15.44:0/3710700165 shutdown_connections 2023-11-04T01:43:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:17.283+0000 7f91cde15640 1 -- 172.21.15.44:0/3710700165 wait complete. 2023-11-04T01:43:17.296 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:20.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:43:22.297 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:22.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.414+0000 7f049b568640 1 Processor -- start 2023-11-04T01:43:22.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.415+0000 7f049b568640 1 -- start start 2023-11-04T01:43:22.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.415+0000 7f049b568640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f049415d4e0 0x7f04940d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.415+0000 7f049b568640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04940b32b0 con 0x7f04940d3b60 2023-11-04T01:43:22.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.415+0000 7f049b568640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04940cee10 con 0x7f049415d100 2023-11-04T01:43:22.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.415+0000 7f049b568640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04940cec20 con 0x7f049415d4e0 2023-11-04T01:43:22.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.416+0000 7f0498b03640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f049415d4e0 0x7f04940d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.416+0000 7f0498b03640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f049415d4e0 0x7f04940d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50380/0 (socket says 172.21.15.44:50380) 2023-11-04T01:43:22.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.416+0000 7f0498b03640 1 -- 172.21.15.44:0/1257808747 learned_addr learned my addr 172.21.15.44:0/1257808747 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:22.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.416+0000 7f0499b05640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f04940d3b60 0x7f04940b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48298/0 (socket says 172.21.15.44:48298) 2023-11-04T01:43:22.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.416+0000 7f0498b03640 1 -- 172.21.15.44:0/1257808747 >> v1:172.21.15.204:6789/0 conn(0x7f049415d100 legacy=0x7f04940ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:22.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.416+0000 7f0498b03640 1 -- 172.21.15.44:0/1257808747 >> v1:172.21.15.44:6789/0 conn(0x7f04940d3b60 legacy=0x7f04940b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.416+0000 7f0498b03640 1 -- 172.21.15.44:0/1257808747 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04940b2980 con 0x7f049415d4e0 2023-11-04T01:43:22.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.417+0000 7f0498b03640 1 --2- 172.21.15.44:0/1257808747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f049415d4e0 0x7f04940d14d0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f0488009870 tx=0x7f048802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4ac7b0fdd10ea0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.417+0000 7f0493fff640 1 -- 172.21.15.44:0/1257808747 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488030860 con 0x7f049415d4e0 2023-11-04T01:43:22.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.417+0000 7f0493fff640 1 -- 172.21.15.44:0/1257808747 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04880309c0 con 0x7f049415d4e0 2023-11-04T01:43:22.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.417+0000 7f0493fff640 1 -- 172.21.15.44:0/1257808747 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488030d50 con 0x7f049415d4e0 2023-11-04T01:43:22.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.417+0000 7f049b568640 1 -- 172.21.15.44:0/1257808747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f049415d4e0 msgr2=0x7f04940d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.417+0000 7f049b568640 1 --2- 172.21.15.44:0/1257808747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f049415d4e0 0x7f04940d14d0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f0488009870 tx=0x7f048802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.417+0000 7f049b568640 1 -- 172.21.15.44:0/1257808747 shutdown_connections 2023-11-04T01:43:22.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.417+0000 7f049b568640 1 --2- 172.21.15.44:0/1257808747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f049415d4e0 0x7f04940d14d0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.417+0000 7f049b568640 1 -- 172.21.15.44:0/1257808747 >> 172.21.15.44:0/1257808747 conn(0x7f04940d2ef0 msgr2=0x7f04940d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:22.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.418+0000 7f049b568640 1 -- 172.21.15.44:0/1257808747 shutdown_connections 2023-11-04T01:43:22.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.418+0000 7f049b568640 1 -- 172.21.15.44:0/1257808747 wait complete. 2023-11-04T01:43:22.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.419+0000 7f049b568640 1 Processor -- start 2023-11-04T01:43:22.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.419+0000 7f049b568640 1 -- start start 2023-11-04T01:43:22.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f049b568640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04940d3b60 0x7f04941f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f049b568640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f049415d100 0x7f04940cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f049b568640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f049415d4e0 0x7f04940cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f049b568640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04940c9fc0 con 0x7f049415d100 2023-11-04T01:43:22.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f049b568640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04940cab40 con 0x7f049415d4e0 2023-11-04T01:43:22.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f049b568640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04940ca210 con 0x7f04940d3b60 2023-11-04T01:43:22.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f0498b03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f049415d100 0x7f04940cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f0498b03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f049415d100 0x7f04940cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50384/0 (socket says 172.21.15.44:50384) 2023-11-04T01:43:22.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f0498b03640 1 -- 172.21.15.44:0/2495931491 learned_addr learned my addr 172.21.15.44:0/2495931491 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:22.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f0499304640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04940d3b60 0x7f04941f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f0499b05640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f049415d4e0 0x7f04940cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f0498b03640 1 -- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04940d3b60 msgr2=0x7f04941f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f0498b03640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04940d3b60 0x7f04941f3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f0498b03640 1 -- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f049415d4e0 msgr2=0x7f04940cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f0498b03640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f049415d4e0 0x7f04940cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f0498b03640 1 -- 172.21.15.44:0/2495931491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04880094d0 con 0x7f049415d100 2023-11-04T01:43:22.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f0499304640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04940d3b60 0x7f04941f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:22.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f0499b05640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f049415d4e0 0x7f04940cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:22.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.420+0000 7f0498b03640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f049415d100 0x7f04940cafd0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f04880090b0 tx=0x7f04880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.421+0000 7f0491ffb640 1 -- 172.21.15.44:0/2495931491 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048803e070 con 0x7f049415d100 2023-11-04T01:43:22.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.421+0000 7f0491ffb640 1 -- 172.21.15.44:0/2495931491 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0488030810 con 0x7f049415d100 2023-11-04T01:43:22.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.421+0000 7f049b568640 1 -- 172.21.15.44:0/2495931491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04940ca4f0 con 0x7f049415d100 2023-11-04T01:43:22.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.421+0000 7f0491ffb640 1 -- 172.21.15.44:0/2495931491 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488039d40 con 0x7f049415d100 2023-11-04T01:43:22.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.421+0000 7f049b568640 1 -- 172.21.15.44:0/2495931491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04941f42b0 con 0x7f049415d100 2023-11-04T01:43:22.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.422+0000 7f049b568640 1 -- 172.21.15.44:0/2495931491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04941f4530 con 0x7f049415d100 2023-11-04T01:43:22.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.422+0000 7f0491ffb640 1 -- 172.21.15.44:0/2495931491 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0488042070 con 0x7f049415d100 2023-11-04T01:43:22.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.423+0000 7f0491ffb640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f048006ae70 0x7f048006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.423+0000 7f0491ffb640 1 -- 172.21.15.44:0/2495931491 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f04880abe50 con 0x7f049415d100 2023-11-04T01:43:22.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.423+0000 7f0499304640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f048006ae70 0x7f048006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.423+0000 7f0499304640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f048006ae70 0x7f048006d330 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f048c001760 tx=0x7f048c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.427+0000 7f0491ffb640 1 -- 172.21.15.44:0/2495931491 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04880765b0 con 0x7f049415d100 2023-11-04T01:43:22.644 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.642+0000 7f049b568640 1 -- 172.21.15.44:0/2495931491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04940cacb0 con 0x7f049415d100 2023-11-04T01:43:22.645 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.643+0000 7f0491ffb640 1 -- 172.21.15.44:0/2495931491 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4931 (secure 0 0 0) 0x7f0488034090 con 0x7f049415d100 2023-11-04T01:43:22.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:22.645 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":109,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:10.696885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:22.646 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 109 2023-11-04T01:43:22.647 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.645+0000 7f049b568640 1 -- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f048006ae70 msgr2=0x7f048006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.645+0000 7f049b568640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f048006ae70 0x7f048006d330 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f048c001760 tx=0x7f048c009040 comp rx=0 tx=0).stop 2023-11-04T01:43:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.645+0000 7f049b568640 1 -- 172.21.15.44:0/2495931491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f049415d100 msgr2=0x7f04940cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.645+0000 7f049b568640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f049415d100 0x7f04940cafd0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f04880090b0 tx=0x7f04880046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.645+0000 7f049b568640 1 -- 172.21.15.44:0/2495931491 shutdown_connections 2023-11-04T01:43:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.645+0000 7f049b568640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f048006ae70 0x7f048006d330 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.645+0000 7f049b568640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f049415d4e0 0x7f04940cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.645+0000 7f049b568640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f049415d100 0x7f04940cafd0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.645+0000 7f049b568640 1 --2- 172.21.15.44:0/2495931491 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04940d3b60 0x7f04941f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.645+0000 7f049b568640 1 -- 172.21.15.44:0/2495931491 >> 172.21.15.44:0/2495931491 conn(0x7f04940d2ef0 msgr2=0x7f04940b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.645+0000 7f049b568640 1 -- 172.21.15.44:0/2495931491 shutdown_connections 2023-11-04T01:43:22.649 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:22.645+0000 7f049b568640 1 -- 172.21.15.44:0/2495931491 wait complete. 2023-11-04T01:43:22.658 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:26.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:43:27.659 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:27.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.776+0000 7ff450c6f640 1 Processor -- start 2023-11-04T01:43:27.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.776+0000 7ff450c6f640 1 -- start start 2023-11-04T01:43:27.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.777+0000 7ff450c6f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff44c15d4e0 0x7ff44c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.777+0000 7ff450c6f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44c0b32b0 con 0x7ff44c0d3b60 2023-11-04T01:43:27.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.777+0000 7ff450c6f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44c0cee10 con 0x7ff44c15d100 2023-11-04T01:43:27.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.777+0000 7ff450c6f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0cec20 con 0x7ff44c15d4e0 2023-11-04T01:43:27.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.777+0000 7ff44ad9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff44c0d3b60 0x7ff44c0b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43132/0 (socket says 172.21.15.44:43132) 2023-11-04T01:43:27.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.777+0000 7ff44ad9d640 1 -- 172.21.15.44:0/4279893338 learned_addr learned my addr 172.21.15.44:0/4279893338 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:27.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.777+0000 7ff443fff640 1 --2- 172.21.15.44:0/4279893338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff44c15d4e0 0x7ff44c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.777+0000 7ff449d9b640 1 -- 172.21.15.44:0/4279893338 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749919187 0 0) 0x7ff44c0b32b0 con 0x7ff44c0d3b60 2023-11-04T01:43:27.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.777+0000 7ff449d9b640 1 -- 172.21.15.44:0/4279893338 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff438003520 con 0x7ff44c0d3b60 2023-11-04T01:43:27.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.777+0000 7ff449d9b640 1 -- 172.21.15.44:0/4279893338 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035565838 0 0) 0x7ff44c0cee10 con 0x7ff44c15d100 2023-11-04T01:43:27.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.777+0000 7ff449d9b640 1 -- 172.21.15.44:0/4279893338 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff44c0b32b0 con 0x7ff44c15d100 2023-11-04T01:43:27.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.777+0000 7ff443fff640 1 -- 172.21.15.44:0/4279893338 >> v1:172.21.15.204:6789/0 conn(0x7ff44c15d100 legacy=0x7ff44c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.777+0000 7ff443fff640 1 -- 172.21.15.44:0/4279893338 >> v1:172.21.15.44:6789/0 conn(0x7ff44c0d3b60 legacy=0x7ff44c0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.777+0000 7ff449d9b640 1 -- 172.21.15.44:0/4279893338 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 216659201 0 0) 0x7ff438003520 con 0x7ff44c0d3b60 2023-11-04T01:43:27.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.777+0000 7ff443fff640 1 -- 172.21.15.44:0/4279893338 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c0b2980 con 0x7ff44c15d4e0 2023-11-04T01:43:27.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.778+0000 7ff443fff640 1 --2- 172.21.15.44:0/4279893338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff44c15d4e0 0x7ff44c0d14d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4340097d0 tx=0x7ff43402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf82bd8b42cbfe75 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.778+0000 7ff449d9b640 1 -- 172.21.15.44:0/4279893338 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4440019f0 con 0x7ff44c15d4e0 2023-11-04T01:43:27.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.778+0000 7ff449d9b640 1 -- 172.21.15.44:0/4279893338 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43402e050 con 0x7ff44c15d4e0 2023-11-04T01:43:27.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.778+0000 7ff449d9b640 1 -- 172.21.15.44:0/4279893338 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434030730 con 0x7ff44c15d4e0 2023-11-04T01:43:27.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.779+0000 7ff450c6f640 1 -- 172.21.15.44:0/4279893338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff44c15d4e0 msgr2=0x7ff44c0d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.779+0000 7ff450c6f640 1 --2- 172.21.15.44:0/4279893338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff44c15d4e0 0x7ff44c0d14d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4340097d0 tx=0x7ff43402b800 comp rx=0 tx=0).stop 2023-11-04T01:43:27.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.779+0000 7ff450c6f640 1 -- 172.21.15.44:0/4279893338 shutdown_connections 2023-11-04T01:43:27.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.779+0000 7ff450c6f640 1 --2- 172.21.15.44:0/4279893338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff44c15d4e0 0x7ff44c0d14d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.779+0000 7ff450c6f640 1 -- 172.21.15.44:0/4279893338 >> 172.21.15.44:0/4279893338 conn(0x7ff44c0d2ef0 msgr2=0x7ff44c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:27.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.779+0000 7ff450c6f640 1 -- 172.21.15.44:0/4279893338 shutdown_connections 2023-11-04T01:43:27.782 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.779+0000 7ff450c6f640 1 -- 172.21.15.44:0/4279893338 wait complete. 2023-11-04T01:43:27.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.780+0000 7ff450c6f640 1 Processor -- start 2023-11-04T01:43:27.784 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.781+0000 7ff450c6f640 1 -- start start 2023-11-04T01:43:27.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.781+0000 7ff450c6f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff44c0d3b60 0x7ff44c1f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.781+0000 7ff450c6f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff44c15d100 0x7ff44c0d1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.781+0000 7ff450c6f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff44c15d4e0 0x7ff44c15dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.781+0000 7ff450c6f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c1f6de0 con 0x7ff44c15d4e0 2023-11-04T01:43:27.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.781+0000 7ff450c6f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c1f3850 con 0x7ff44c15d100 2023-11-04T01:43:27.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.781+0000 7ff450c6f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c1f2cd0 con 0x7ff44c0d3b60 2023-11-04T01:43:27.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.781+0000 7ff44ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff44c15d4e0 0x7ff44c15dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.781+0000 7ff44ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff44c15d4e0 0x7ff44c15dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51920/0 (socket says 172.21.15.44:51920) 2023-11-04T01:43:27.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.781+0000 7ff44ad9d640 1 -- 172.21.15.44:0/1234853933 learned_addr learned my addr 172.21.15.44:0/1234853933 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:27.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.782+0000 7ff44a59c640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff44c0d3b60 0x7ff44c1f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.782+0000 7ff443fff640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff44c15d100 0x7ff44c0d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.785 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.782+0000 7ff44ad9d640 1 -- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff44c0d3b60 msgr2=0x7ff44c1f68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.782+0000 7ff44ad9d640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff44c0d3b60 0x7ff44c1f68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.782+0000 7ff44ad9d640 1 -- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff44c15d100 msgr2=0x7ff44c0d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.782+0000 7ff44ad9d640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff44c15d100 0x7ff44c0d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.782+0000 7ff44ad9d640 1 -- 172.21.15.44:0/1234853933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff434009400 con 0x7ff44c15d4e0 2023-11-04T01:43:27.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.782+0000 7ff44a59c640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff44c0d3b60 0x7ff44c1f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:27.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.782+0000 7ff443fff640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff44c15d100 0x7ff44c0d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:27.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.782+0000 7ff44ad9d640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff44c15d4e0 0x7ff44c15dd00 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7ff444001fa0 tx=0x7ff44400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.782+0000 7ff442ffd640 1 -- 172.21.15.44:0/1234853933 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444012400 con 0x7ff44c15d4e0 2023-11-04T01:43:27.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.782+0000 7ff442ffd640 1 -- 172.21.15.44:0/1234853933 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444012560 con 0x7ff44c15d4e0 2023-11-04T01:43:27.786 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.782+0000 7ff450c6f640 1 -- 172.21.15.44:0/1234853933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44c1f2fb0 con 0x7ff44c15d4e0 2023-11-04T01:43:27.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.782+0000 7ff442ffd640 1 -- 172.21.15.44:0/1234853933 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444012910 con 0x7ff44c15d4e0 2023-11-04T01:43:27.789 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.782+0000 7ff450c6f640 1 -- 172.21.15.44:0/1234853933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44c1f3570 con 0x7ff44c15d4e0 2023-11-04T01:43:27.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.783+0000 7ff450c6f640 1 -- 172.21.15.44:0/1234853933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44c0684b0 con 0x7ff44c15d4e0 2023-11-04T01:43:27.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.784+0000 7ff442ffd640 1 -- 172.21.15.44:0/1234853933 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff444012a70 con 0x7ff44c15d4e0 2023-11-04T01:43:27.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.784+0000 7ff442ffd640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff42c06ae70 0x7ff42c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.790 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.784+0000 7ff442ffd640 1 -- 172.21.15.44:0/1234853933 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7ff44408a6e0 con 0x7ff44c15d4e0 2023-11-04T01:43:27.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.784+0000 7ff44a59c640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff42c06ae70 0x7ff42c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.785+0000 7ff44a59c640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff42c06ae70 0x7ff42c06d330 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff43c001230 tx=0x7ff43c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.791 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:27.788+0000 7ff442ffd640 1 -- 172.21.15.44:0/1234853933 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff444054f90 con 0x7ff44c15d4e0 2023-11-04T01:43:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:28.006+0000 7ff450c6f640 1 -- 172.21.15.44:0/1234853933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff44c0d2cd0 con 0x7ff44c15d4e0 2023-11-04T01:43:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:28.007+0000 7ff442ffd640 1 -- 172.21.15.44:0/1234853933 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4931 (secure 0 0 0) 0x7ff4440585b0 con 0x7ff44c15d4e0 2023-11-04T01:43:28.009 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:28.009 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":109,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:10.696885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 109 2023-11-04T01:43:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:28.009+0000 7ff450c6f640 1 -- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff42c06ae70 msgr2=0x7ff42c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:28.009+0000 7ff450c6f640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff42c06ae70 0x7ff42c06d330 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff43c001230 tx=0x7ff43c009040 comp rx=0 tx=0).stop 2023-11-04T01:43:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:28.009+0000 7ff450c6f640 1 -- 172.21.15.44:0/1234853933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff44c15d4e0 msgr2=0x7ff44c15dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:28.009+0000 7ff450c6f640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff44c15d4e0 0x7ff44c15dd00 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7ff444001fa0 tx=0x7ff44400a430 comp rx=0 tx=0).stop 2023-11-04T01:43:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:28.009+0000 7ff450c6f640 1 -- 172.21.15.44:0/1234853933 shutdown_connections 2023-11-04T01:43:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:28.009+0000 7ff450c6f640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff42c06ae70 0x7ff42c06d330 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:28.009+0000 7ff450c6f640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff44c15d4e0 0x7ff44c15dd00 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:28.009+0000 7ff450c6f640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff44c15d100 0x7ff44c0d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:28.009+0000 7ff450c6f640 1 --2- 172.21.15.44:0/1234853933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff44c0d3b60 0x7ff44c1f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:28.009+0000 7ff450c6f640 1 -- 172.21.15.44:0/1234853933 >> 172.21.15.44:0/1234853933 conn(0x7ff44c0d2ef0 msgr2=0x7ff44c0b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:28.009+0000 7ff450c6f640 1 -- 172.21.15.44:0/1234853933 shutdown_connections 2023-11-04T01:43:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:28.009+0000 7ff450c6f640 1 -- 172.21.15.44:0/1234853933 wait complete. 2023-11-04T01:43:28.023 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:29.457 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:29.460 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:33.024 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:33.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.140+0000 7f229744b640 1 Processor -- start 2023-11-04T01:43:33.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.140+0000 7f229744b640 1 -- start start 2023-11-04T01:43:33.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.141+0000 7f229744b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f229015d110 0x7f229006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.141+0000 7f229744b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f22900b2100 0x7f22900b2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.141+0000 7f229744b640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22900b2a50 con 0x7f22900b3ca0 2023-11-04T01:43:33.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.141+0000 7f229744b640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22900664f0 con 0x7f229015d110 2023-11-04T01:43:33.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.141+0000 7f229744b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f229015d4f0 con 0x7f22900b2100 2023-11-04T01:43:33.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.142+0000 7f22951e7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f229015d110 0x7f229006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.142+0000 7f22951e7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f229015d110 0x7f229006b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37336/0 (socket says 172.21.15.44:37336) 2023-11-04T01:43:33.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.142+0000 7f22951e7640 1 -- 172.21.15.44:0/2672800733 learned_addr learned my addr 172.21.15.44:0/2672800733 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:33.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.142+0000 7f22949e6640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f22900b3ca0 0x7f22900ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56364/0 (socket says 172.21.15.44:56364) 2023-11-04T01:43:33.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.142+0000 7f22959e8640 1 --2- 172.21.15.44:0/2672800733 >> v2:172.21.15.204:3300/0 conn(0x7f22900b2100 0x7f22900b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.142+0000 7f22951e7640 1 -- 172.21.15.44:0/2672800733 >> v2:172.21.15.204:3300/0 conn(0x7f22900b2100 msgr2=0x7f22900b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.142+0000 7f22951e7640 1 --2- 172.21.15.44:0/2672800733 >> v2:172.21.15.204:3300/0 conn(0x7f22900b2100 0x7f22900b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.142+0000 7f22951e7640 1 -- 172.21.15.44:0/2672800733 >> v1:172.21.15.44:6789/0 conn(0x7f22900b3ca0 legacy=0x7f22900ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.142+0000 7f2287fff640 1 -- 172.21.15.44:0/2672800733 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462755897 0 0) 0x7f22900b2a50 con 0x7f22900b3ca0 2023-11-04T01:43:33.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.142+0000 7f22951e7640 1 -- 172.21.15.44:0/2672800733 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229006b9f0 con 0x7f229015d110 2023-11-04T01:43:33.146 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.143+0000 7f22951e7640 1 --2- 172.21.15.44:0/2672800733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f229015d110 0x7f229006b2f0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f22900aecc0 tx=0x7f228802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadce581ad4efc82 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.143+0000 7f2287fff640 1 -- 172.21.15.44:0/2672800733 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2288004230 con 0x7f229015d110 2023-11-04T01:43:33.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.143+0000 7f2287fff640 1 -- 172.21.15.44:0/2672800733 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2288004390 con 0x7f229015d110 2023-11-04T01:43:33.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.143+0000 7f2287fff640 1 -- 172.21.15.44:0/2672800733 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2288030840 con 0x7f229015d110 2023-11-04T01:43:33.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.144+0000 7f229744b640 1 -- 172.21.15.44:0/2672800733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f229015d110 msgr2=0x7f229006b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.144+0000 7f229744b640 1 --2- 172.21.15.44:0/2672800733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f229015d110 0x7f229006b2f0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f22900aecc0 tx=0x7f228802b980 comp rx=0 tx=0).stop 2023-11-04T01:43:33.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.144+0000 7f229744b640 1 -- 172.21.15.44:0/2672800733 shutdown_connections 2023-11-04T01:43:33.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.144+0000 7f229744b640 1 --2- 172.21.15.44:0/2672800733 >> v2:172.21.15.204:3300/0 conn(0x7f22900b2100 0x7f22900b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.144+0000 7f229744b640 1 --2- 172.21.15.44:0/2672800733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f229015d110 0x7f229006b2f0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.144+0000 7f229744b640 1 -- 172.21.15.44:0/2672800733 >> 172.21.15.44:0/2672800733 conn(0x7f22900cbd30 msgr2=0x7f22900cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.144+0000 7f229744b640 1 -- 172.21.15.44:0/2672800733 shutdown_connections 2023-11-04T01:43:33.147 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.144+0000 7f229744b640 1 -- 172.21.15.44:0/2672800733 wait complete. 2023-11-04T01:43:33.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.145+0000 7f229744b640 1 Processor -- start 2023-11-04T01:43:33.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.145+0000 7f229744b640 1 -- start start 2023-11-04T01:43:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.146+0000 7f229744b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22900b2100 0x7f229009c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.146+0000 7f229744b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22900b3ca0 0x7f22901485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.146+0000 7f229744b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f229015d110 0x7f2290099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.146+0000 7f229744b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22901f26a0 con 0x7f229015d110 2023-11-04T01:43:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.146+0000 7f229744b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22901f34c0 con 0x7f22900b2100 2023-11-04T01:43:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.146+0000 7f229744b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22901f28b0 con 0x7f22900b3ca0 2023-11-04T01:43:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.146+0000 7f22959e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f229015d110 0x7f2290099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.146+0000 7f22959e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f229015d110 0x7f2290099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37348/0 (socket says 172.21.15.44:37348) 2023-11-04T01:43:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.146+0000 7f22959e8640 1 -- 172.21.15.44:0/2145689846 learned_addr learned my addr 172.21.15.44:0/2145689846 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.146+0000 7f22959e8640 1 -- 172.21.15.44:0/2145689846 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22900b3ca0 msgr2=0x7f22901485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.146+0000 7f22959e8640 1 --2- 172.21.15.44:0/2145689846 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22900b3ca0 0x7f22901485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.146+0000 7f22959e8640 1 -- 172.21.15.44:0/2145689846 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22900b2100 msgr2=0x7f229009c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.146+0000 7f22959e8640 1 --2- 172.21.15.44:0/2145689846 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22900b2100 0x7f229009c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.146+0000 7f22959e8640 1 -- 172.21.15.44:0/2145689846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2288009460 con 0x7f229015d110 2023-11-04T01:43:33.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.146+0000 7f22959e8640 1 --2- 172.21.15.44:0/2145689846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f229015d110 0x7f2290099a50 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f228c00efc0 tx=0x7f228c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.147+0000 7f2285ffb640 1 -- 172.21.15.44:0/2145689846 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c009ba0 con 0x7f229015d110 2023-11-04T01:43:33.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.147+0000 7f2285ffb640 1 -- 172.21.15.44:0/2145689846 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c00f040 con 0x7f229015d110 2023-11-04T01:43:33.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.147+0000 7f229744b640 1 -- 172.21.15.44:0/2145689846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22901f2b90 con 0x7f229015d110 2023-11-04T01:43:33.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.147+0000 7f2285ffb640 1 -- 172.21.15.44:0/2145689846 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c0146c0 con 0x7f229015d110 2023-11-04T01:43:33.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.147+0000 7f229744b640 1 -- 172.21.15.44:0/2145689846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22901f3150 con 0x7f229015d110 2023-11-04T01:43:33.151 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.148+0000 7f229744b640 1 -- 172.21.15.44:0/2145689846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22900684b0 con 0x7f229015d110 2023-11-04T01:43:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.148+0000 7f2285ffb640 1 -- 172.21.15.44:0/2145689846 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f228c014820 con 0x7f229015d110 2023-11-04T01:43:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.149+0000 7f2285ffb640 1 --2- 172.21.15.44:0/2145689846 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f227406aea0 0x7f227406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.149+0000 7f2285ffb640 1 -- 172.21.15.44:0/2145689846 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f228c08aca0 con 0x7f229015d110 2023-11-04T01:43:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.149+0000 7f22951e7640 1 --2- 172.21.15.44:0/2145689846 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f227406aea0 0x7f227406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.150+0000 7f22951e7640 1 --2- 172.21.15.44:0/2145689846 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f227406aea0 0x7f227406d360 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2288035000 tx=0x7f2288030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.153+0000 7f2285ffb640 1 -- 172.21.15.44:0/2145689846 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f228c055490 con 0x7f229015d110 2023-11-04T01:43:33.371 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.369+0000 7f229744b640 1 -- 172.21.15.44:0/2145689846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22901f3630 con 0x7f229015d110 2023-11-04T01:43:33.372 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.370+0000 7f2285ffb640 1 -- 172.21.15.44:0/2145689846 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4979 (secure 0 0 0) 0x7f228c018020 con 0x7f229015d110 2023-11-04T01:43:33.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:33.372 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:29.247575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:43:29.247574+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:33.372 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 110 2023-11-04T01:43:33.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.372+0000 7f229744b640 1 -- 172.21.15.44:0/2145689846 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f227406aea0 msgr2=0x7f227406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.372+0000 7f229744b640 1 --2- 172.21.15.44:0/2145689846 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f227406aea0 0x7f227406d360 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2288035000 tx=0x7f2288030000 comp rx=0 tx=0).stop 2023-11-04T01:43:33.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.372+0000 7f229744b640 1 -- 172.21.15.44:0/2145689846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f229015d110 msgr2=0x7f2290099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.372+0000 7f229744b640 1 --2- 172.21.15.44:0/2145689846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f229015d110 0x7f2290099a50 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f228c00efc0 tx=0x7f228c00c490 comp rx=0 tx=0).stop 2023-11-04T01:43:33.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.372+0000 7f229744b640 1 -- 172.21.15.44:0/2145689846 shutdown_connections 2023-11-04T01:43:33.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.372+0000 7f229744b640 1 --2- 172.21.15.44:0/2145689846 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f227406aea0 0x7f227406d360 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.372+0000 7f229744b640 1 --2- 172.21.15.44:0/2145689846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f229015d110 0x7f2290099a50 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.372+0000 7f229744b640 1 --2- 172.21.15.44:0/2145689846 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22900b3ca0 0x7f22901485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.372+0000 7f229744b640 1 --2- 172.21.15.44:0/2145689846 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22900b2100 0x7f229009c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.372+0000 7f229744b640 1 -- 172.21.15.44:0/2145689846 >> 172.21.15.44:0/2145689846 conn(0x7f22900cbd30 msgr2=0x7f229006ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.372+0000 7f229744b640 1 -- 172.21.15.44:0/2145689846 shutdown_connections 2023-11-04T01:43:33.375 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.372+0000 7f229744b640 1 -- 172.21.15.44:0/2145689846 wait complete. 2023-11-04T01:43:33.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-11-04T01:43:33.385 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-04T01:43:33.385 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:43:33.414 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:43:33.416 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:43:33.416 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:43:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:1699062195.122083.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:43:33.491 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062195.122083.core'] 2023-11-04T01:43:33.491 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062195.122083.core, deleting it 2023-11-04T01:43:33.491 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062195.122083.core 2023-11-04T01:43:33.564 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:33.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.708+0000 7f4cbc9b7640 1 Processor -- start 2023-11-04T01:43:33.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.709+0000 7f4cbc9b7640 1 -- start start 2023-11-04T01:43:33.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.709+0000 7f4cbc9b7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4cb815d100 0x7f4cb80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.709+0000 7f4cbc9b7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cb815d4e0 0x7f4cb80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.709+0000 7f4cbc9b7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4cb80d3b60 0x7f4cb80d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.709+0000 7f4cbc9b7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb80b32b0 con 0x7f4cb815d100 2023-11-04T01:43:33.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.709+0000 7f4cbc9b7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb80cee10 con 0x7f4cb80d3b60 2023-11-04T01:43:33.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.709+0000 7f4cbc9b7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb80b2980 con 0x7f4cb815d4e0 2023-11-04T01:43:33.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.709+0000 7f4cb659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4cb815d100 0x7f4cb80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.710+0000 7f4cb659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4cb815d100 0x7f4cb80ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37356/0 (socket says 172.21.15.44:37356) 2023-11-04T01:43:33.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.710+0000 7f4cb659c640 1 -- 172.21.15.44:0/3675695933 learned_addr learned my addr 172.21.15.44:0/3675695933 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:33.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.710+0000 7f4cb6d9d640 1 --2- 172.21.15.44:0/3675695933 >> v2:172.21.15.204:3300/0 conn(0x7f4cb80d3b60 0x7f4cb80d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.710+0000 7f4caffff640 1 --2- 172.21.15.44:0/3675695933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cb815d4e0 0x7f4cb80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.710+0000 7f4cb659c640 1 -- 172.21.15.44:0/3675695933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cb815d4e0 msgr2=0x7f4cb80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.710+0000 7f4cb659c640 1 --2- 172.21.15.44:0/3675695933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cb815d4e0 0x7f4cb80d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.710+0000 7f4cb659c640 1 -- 172.21.15.44:0/3675695933 >> v2:172.21.15.204:3300/0 conn(0x7f4cb80d3b60 msgr2=0x7f4cb80d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.710+0000 7f4cb659c640 1 --2- 172.21.15.44:0/3675695933 >> v2:172.21.15.204:3300/0 conn(0x7f4cb80d3b60 0x7f4cb80d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.710+0000 7f4cb659c640 1 -- 172.21.15.44:0/3675695933 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb80b2c60 con 0x7f4cb815d100 2023-11-04T01:43:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.710+0000 7f4caffff640 1 --2- 172.21.15.44:0/3675695933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cb815d4e0 0x7f4cb80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.710+0000 7f4cb6d9d640 1 --2- 172.21.15.44:0/3675695933 >> v2:172.21.15.204:3300/0 conn(0x7f4cb80d3b60 0x7f4cb80d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.711+0000 7f4cb659c640 1 --2- 172.21.15.44:0/3675695933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb815d100 0x7f4cb80ce510 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80b27a0 tx=0x7f4ca802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671428bb9cad6aad server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.711+0000 7f4cb5d9b640 1 -- 172.21.15.44:0/3675695933 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8004230 con 0x7f4cb815d100 2023-11-04T01:43:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.711+0000 7f4cb5d9b640 1 -- 172.21.15.44:0/3675695933 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca8004390 con 0x7f4cb815d100 2023-11-04T01:43:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.711+0000 7f4cb5d9b640 1 -- 172.21.15.44:0/3675695933 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8003810 con 0x7f4cb815d100 2023-11-04T01:43:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.711+0000 7f4cbc9b7640 1 -- 172.21.15.44:0/3675695933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb815d100 msgr2=0x7f4cb80ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.711+0000 7f4cbc9b7640 1 --2- 172.21.15.44:0/3675695933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb815d100 0x7f4cb80ce510 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80b27a0 tx=0x7f4ca802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.711+0000 7f4cbc9b7640 1 -- 172.21.15.44:0/3675695933 shutdown_connections 2023-11-04T01:43:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.711+0000 7f4cbc9b7640 1 --2- 172.21.15.44:0/3675695933 >> v2:172.21.15.204:3300/0 conn(0x7f4cb80d3b60 0x7f4cb80d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.711+0000 7f4cbc9b7640 1 --2- 172.21.15.44:0/3675695933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cb815d4e0 0x7f4cb80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.711+0000 7f4cbc9b7640 1 --2- 172.21.15.44:0/3675695933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb815d100 0x7f4cb80ce510 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.711+0000 7f4cbc9b7640 1 -- 172.21.15.44:0/3675695933 >> 172.21.15.44:0/3675695933 conn(0x7f4cb80d2ef0 msgr2=0x7f4cb80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.711+0000 7f4cbc9b7640 1 -- 172.21.15.44:0/3675695933 shutdown_connections 2023-11-04T01:43:33.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.711+0000 7f4cbc9b7640 1 -- 172.21.15.44:0/3675695933 wait complete. 2023-11-04T01:43:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.713+0000 7f4cbc9b7640 1 Processor -- start 2023-11-04T01:43:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.713+0000 7f4cbc9b7640 1 -- start start 2023-11-04T01:43:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.713+0000 7f4cbc9b7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cb80d3b60 0x7f4cb81513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.713+0000 7f4cbc9b7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cb815d100 0x7f4cb80afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.713+0000 7f4cbc9b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb815d4e0 0x7f4cb80b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.713+0000 7f4cbc9b7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8151900 con 0x7f4cb815d4e0 2023-11-04T01:43:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.713+0000 7f4cbc9b7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb81f6280 con 0x7f4cb815d100 2023-11-04T01:43:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4cbc9b7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb81f64d0 con 0x7f4cb80d3b60 2023-11-04T01:43:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4cb6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb815d4e0 0x7f4cb80b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4cb6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb815d4e0 0x7f4cb80b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37364/0 (socket says 172.21.15.44:37364) 2023-11-04T01:43:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4cb6d9d640 1 -- 172.21.15.44:0/3700150798 learned_addr learned my addr 172.21.15.44:0/3700150798 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4caffff640 1 --2- 172.21.15.44:0/3700150798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cb815d100 0x7f4cb80afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4cb659c640 1 --2- 172.21.15.44:0/3700150798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cb80d3b60 0x7f4cb81513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4cb6d9d640 1 -- 172.21.15.44:0/3700150798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cb80d3b60 msgr2=0x7f4cb81513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4cb6d9d640 1 --2- 172.21.15.44:0/3700150798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cb80d3b60 0x7f4cb81513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4cb6d9d640 1 -- 172.21.15.44:0/3700150798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cb815d100 msgr2=0x7f4cb80afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4cb6d9d640 1 --2- 172.21.15.44:0/3700150798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cb815d100 0x7f4cb80afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4cb6d9d640 1 -- 172.21.15.44:0/3700150798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca8009460 con 0x7f4cb815d4e0 2023-11-04T01:43:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4cb6d9d640 1 --2- 172.21.15.44:0/3700150798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb815d4e0 0x7f4cb80b0240 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0007e10 tx=0x7f4cb000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4caeffd640 1 -- 172.21.15.44:0/3700150798 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0003b90 con 0x7f4cb815d4e0 2023-11-04T01:43:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4caeffd640 1 -- 172.21.15.44:0/3700150798 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb000f040 con 0x7f4cb815d4e0 2023-11-04T01:43:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4cbc9b7640 1 -- 172.21.15.44:0/3700150798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb81f67b0 con 0x7f4cb815d4e0 2023-11-04T01:43:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4caeffd640 1 -- 172.21.15.44:0/3700150798 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb000de80 con 0x7f4cb815d4e0 2023-11-04T01:43:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.714+0000 7f4cbc9b7640 1 -- 172.21.15.44:0/3700150798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb81f6d70 con 0x7f4cb815d4e0 2023-11-04T01:43:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.715+0000 7f4cbc9b7640 1 -- 172.21.15.44:0/3700150798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb81f6f90 con 0x7f4cb815d4e0 2023-11-04T01:43:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.716+0000 7f4caeffd640 1 -- 172.21.15.44:0/3700150798 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4cb0004030 con 0x7f4cb815d4e0 2023-11-04T01:43:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.716+0000 7f4caeffd640 1 --2- 172.21.15.44:0/3700150798 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4c9806ae70 0x7f4c9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.716+0000 7f4caeffd640 1 -- 172.21.15.44:0/3700150798 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f4cb008a250 con 0x7f4cb815d4e0 2023-11-04T01:43:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.716+0000 7f4cb659c640 1 --2- 172.21.15.44:0/3700150798 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4c9806ae70 0x7f4c9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.721 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.717+0000 7f4cb659c640 1 --2- 172.21.15.44:0/3700150798 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4c9806ae70 0x7f4c9806d330 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8035000 tx=0x7f4ca8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.722 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.720+0000 7f4caeffd640 1 -- 172.21.15.44:0/3700150798 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4cb00549d0 con 0x7f4cb815d4e0 2023-11-04T01:43:33.935 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.933+0000 7f4cbc9b7640 1 -- 172.21.15.44:0/3700150798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4cb80684b0 con 0x7f4cb815d4e0 2023-11-04T01:43:33.936 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.934+0000 7f4caeffd640 1 -- 172.21.15.44:0/3700150798 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4979 (secure 0 0 0) 0x7f4cb0057ff0 con 0x7f4cb815d4e0 2023-11-04T01:43:33.936 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:33.936 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:29.247575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8205,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8205":{"gid":8205,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/22987540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":22987540},{"type":"v1","addr":"172.21.15.44:6834","nonce":22987540}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:43:29.247574+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:33.937 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 110 2023-11-04T01:43:33.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.936+0000 7f4cbc9b7640 1 -- 172.21.15.44:0/3700150798 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4c9806ae70 msgr2=0x7f4c9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.936+0000 7f4cbc9b7640 1 --2- 172.21.15.44:0/3700150798 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4c9806ae70 0x7f4c9806d330 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8035000 tx=0x7f4ca8008030 comp rx=0 tx=0).stop 2023-11-04T01:43:33.938 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.936+0000 7f4cbc9b7640 1 -- 172.21.15.44:0/3700150798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb815d4e0 msgr2=0x7f4cb80b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.936+0000 7f4cbc9b7640 1 --2- 172.21.15.44:0/3700150798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb815d4e0 0x7f4cb80b0240 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0007e10 tx=0x7f4cb000d4a0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.936+0000 7f4cbc9b7640 1 -- 172.21.15.44:0/3700150798 shutdown_connections 2023-11-04T01:43:33.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.936+0000 7f4cbc9b7640 1 --2- 172.21.15.44:0/3700150798 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4c9806ae70 0x7f4c9806d330 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.936+0000 7f4cbc9b7640 1 --2- 172.21.15.44:0/3700150798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb815d4e0 0x7f4cb80b0240 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.936+0000 7f4cbc9b7640 1 --2- 172.21.15.44:0/3700150798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cb815d100 0x7f4cb80afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.936+0000 7f4cbc9b7640 1 --2- 172.21.15.44:0/3700150798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cb80d3b60 0x7f4cb81513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.936+0000 7f4cbc9b7640 1 -- 172.21.15.44:0/3700150798 >> 172.21.15.44:0/3700150798 conn(0x7f4cb80d2ef0 msgr2=0x7f4cb80cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.939 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.936+0000 7f4cbc9b7640 1 -- 172.21.15.44:0/3700150798 shutdown_connections 2023-11-04T01:43:33.940 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:33.936+0000 7f4cbc9b7640 1 -- 172.21.15.44:0/3700150798 wait complete. 2023-11-04T01:43:33.949 INFO:tasks.ceph.mds.a:Sent signal 9 2023-11-04T01:43:33.949 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:33.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:33.950 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 down 2023-11-04T01:43:33.981 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:43:34.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.126+0000 7f2283c7c640 1 Processor -- start 2023-11-04T01:43:34.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.126+0000 7f2283c7c640 1 -- start start 2023-11-04T01:43:34.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.127+0000 7f2283c7c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c0ade00 0x7f227c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.127+0000 7f2283c7c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f227c06c5f0 0x7f227c0cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.127+0000 7f2283c7c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227c06cc90 con 0x7f227c06d9c0 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.127+0000 7f2283c7c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c0b0e60 con 0x7f227c06c5f0 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.127+0000 7f2283c7c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c06cee0 con 0x7f227c0ade00 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.127+0000 7f2282219640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f227c06c5f0 0x7f227c0cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.127+0000 7f2282219640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f227c06c5f0 0x7f227c0cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37378/0 (socket says 172.21.15.44:37378) 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.127+0000 7f2281217640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f227c06d9c0 0x7f227c0710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56374/0 (socket says 172.21.15.44:56374) 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.127+0000 7f2282219640 1 -- 172.21.15.44:0/887726045 learned_addr learned my addr 172.21.15.44:0/887726045 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.127+0000 7f2281a18640 1 --2- 172.21.15.44:0/887726045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c0ade00 0x7f227c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.128+0000 7f2282219640 1 -- 172.21.15.44:0/887726045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c0ade00 msgr2=0x7f227c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.128+0000 7f2282219640 1 --2- 172.21.15.44:0/887726045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c0ade00 0x7f227c0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.128+0000 7f2282219640 1 -- 172.21.15.44:0/887726045 >> v1:172.21.15.44:6789/0 conn(0x7f227c06d9c0 legacy=0x7f227c0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.128+0000 7f2280a16640 1 -- 172.21.15.44:0/887726045 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265448774 0 0) 0x7f227c06cc90 con 0x7f227c06d9c0 2023-11-04T01:43:34.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.128+0000 7f2282219640 1 -- 172.21.15.44:0/887726045 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c06d1c0 con 0x7f227c06c5f0 2023-11-04T01:43:34.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.128+0000 7f2282219640 1 --2- 172.21.15.44:0/887726045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c06c5f0 0x7f227c0cc680 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f226c009e50 tx=0x7f226c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829da904ef127a52 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.129+0000 7f2280a16640 1 -- 172.21.15.44:0/887726045 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c02c9e0 con 0x7f227c06c5f0 2023-11-04T01:43:34.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.129+0000 7f2280a16640 1 -- 172.21.15.44:0/887726045 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c02cb40 con 0x7f227c06c5f0 2023-11-04T01:43:34.132 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.129+0000 7f2280a16640 1 -- 172.21.15.44:0/887726045 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c0343f0 con 0x7f227c06c5f0 2023-11-04T01:43:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.129+0000 7f2283c7c640 1 -- 172.21.15.44:0/887726045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c06c5f0 msgr2=0x7f227c0cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.129+0000 7f2283c7c640 1 --2- 172.21.15.44:0/887726045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c06c5f0 0x7f227c0cc680 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f226c009e50 tx=0x7f226c02be40 comp rx=0 tx=0).stop 2023-11-04T01:43:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.129+0000 7f2283c7c640 1 -- 172.21.15.44:0/887726045 shutdown_connections 2023-11-04T01:43:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.129+0000 7f2283c7c640 1 --2- 172.21.15.44:0/887726045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c06c5f0 0x7f227c0cc680 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.129+0000 7f2283c7c640 1 --2- 172.21.15.44:0/887726045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c0ade00 0x7f227c0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.129+0000 7f2283c7c640 1 -- 172.21.15.44:0/887726045 >> 172.21.15.44:0/887726045 conn(0x7f227c0cb530 msgr2=0x7f227c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.129+0000 7f2283c7c640 1 -- 172.21.15.44:0/887726045 shutdown_connections 2023-11-04T01:43:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.129+0000 7f2283c7c640 1 -- 172.21.15.44:0/887726045 wait complete. 2023-11-04T01:43:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.130+0000 7f2283c7c640 1 Processor -- start 2023-11-04T01:43:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.130+0000 7f2283c7c640 1 -- start start 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2283c7c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c06c5f0 0x7f227c144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2283c7c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f227c06d9c0 0x7f227c0c3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2283c7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ade00 0x7f227c0c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2283c7c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c157480 con 0x7f227c0ade00 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2283c7c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c1540b0 con 0x7f227c06d9c0 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2283c7c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c157720 con 0x7f227c06c5f0 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2282219640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ade00 0x7f227c0c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2282219640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ade00 0x7f227c0c4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37386/0 (socket says 172.21.15.44:37386) 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2282219640 1 -- 172.21.15.44:0/1545148059 learned_addr learned my addr 172.21.15.44:0/1545148059 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2281a18640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c06c5f0 0x7f227c144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2281217640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f227c06d9c0 0x7f227c0c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2282219640 1 -- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c06c5f0 msgr2=0x7f227c144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2282219640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c06c5f0 0x7f227c144cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2282219640 1 -- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f227c06d9c0 msgr2=0x7f227c0c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2282219640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f227c06d9c0 0x7f227c0c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2282219640 1 -- 172.21.15.44:0/1545148059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c009b30 con 0x7f227c0ade00 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2281a18640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c06c5f0 0x7f227c144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.131+0000 7f2281217640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f227c06d9c0 0x7f227c0c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.132+0000 7f2282219640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ade00 0x7f227c0c4500 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f226c009e50 tx=0x7f226c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.132+0000 7f227a7fc640 1 -- 172.21.15.44:0/1545148059 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c009510 con 0x7f227c0ade00 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.132+0000 7f227a7fc640 1 -- 172.21.15.44:0/1545148059 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c03e450 con 0x7f227c0ade00 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.132+0000 7f2283c7c640 1 -- 172.21.15.44:0/1545148059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c157a00 con 0x7f227c0ade00 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.132+0000 7f227a7fc640 1 -- 172.21.15.44:0/1545148059 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c03e600 con 0x7f227c0ade00 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.132+0000 7f2283c7c640 1 -- 172.21.15.44:0/1545148059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c145230 con 0x7f227c0ade00 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.133+0000 7f2283c7c640 1 -- 172.21.15.44:0/1545148059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c0684b0 con 0x7f227c0ade00 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.133+0000 7f227a7fc640 1 -- 172.21.15.44:0/1545148059 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f226c03e760 con 0x7f227c0ade00 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.134+0000 7f227a7fc640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f226806ae70 0x7f226806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.134+0000 7f227a7fc640 1 -- 172.21.15.44:0/1545148059 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7924+0+0 (secure 0 0 0) 0x7f226c0ac8e0 con 0x7f227c0ade00 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.134+0000 7f2281a18640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f226806ae70 0x7f226806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.134+0000 7f2281a18640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f226806ae70 0x7f226806d330 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2274006fd0 tx=0x7f2274008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.138+0000 7f227a7fc640 1 -- 172.21.15.44:0/1545148059 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f226c0770e0 con 0x7f227c0ade00 2023-11-04T01:43:34.150 INFO:tasks.ceph.mds.a.smithi044.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:43:34.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.390+0000 7f2283c7c640 1 -- 172.21.15.44:0/1545148059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f227c06d470 con 0x7f227c0ade00 2023-11-04T01:43:34.393 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.392+0000 7f227a7fc640 1 -- 172.21.15.44:0/1545148059 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 8205 v111) v1 ==== 97+0+0 (secure 0 0 0) 0x7f226c07a700 con 0x7f227c0ade00 2023-11-04T01:43:34.393 INFO:teuthology.orchestra.run.smithi044.stderr:failed mds gid 8205 2023-11-04T01:43:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.394+0000 7f2283c7c640 1 -- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f226806ae70 msgr2=0x7f226806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.394+0000 7f2283c7c640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f226806ae70 0x7f226806d330 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2274006fd0 tx=0x7f2274008040 comp rx=0 tx=0).stop 2023-11-04T01:43:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.394+0000 7f2283c7c640 1 -- 172.21.15.44:0/1545148059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ade00 msgr2=0x7f227c0c4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.394+0000 7f2283c7c640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ade00 0x7f227c0c4500 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f226c009e50 tx=0x7f226c004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.395+0000 7f2283c7c640 1 -- 172.21.15.44:0/1545148059 shutdown_connections 2023-11-04T01:43:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.395+0000 7f2283c7c640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f226806ae70 0x7f226806d330 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.395+0000 7f2283c7c640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ade00 0x7f227c0c4500 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.395+0000 7f2283c7c640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f227c06d9c0 0x7f227c0c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.395+0000 7f2283c7c640 1 --2- 172.21.15.44:0/1545148059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c06c5f0 0x7f227c144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.395+0000 7f2283c7c640 1 -- 172.21.15.44:0/1545148059 >> 172.21.15.44:0/1545148059 conn(0x7f227c0cb530 msgr2=0x7f227c0af760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.395+0000 7f2283c7c640 1 -- 172.21.15.44:0/1545148059 shutdown_connections 2023-11-04T01:43:34.398 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.395+0000 7f2283c7c640 1 -- 172.21.15.44:0/1545148059 wait complete. 2023-11-04T01:43:34.409 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:43:34.409 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:43:34.409 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:43:34.409 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:34.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:43:34.410 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:43:34.410 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:43:34.410 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:43:34.413 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:43:34.413 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:34.492 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2023-11-04T01:43:34.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.517+0000 7fdbc0a21640 1 Processor -- start 2023-11-04T01:43:34.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.517+0000 7fdbc0a21640 1 -- start start 2023-11-04T01:43:34.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.518+0000 7fdbc0a21640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbbc15d100 0x7fdbbc0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.518+0000 7fdbc0a21640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc0b32b0 con 0x7fdbbc15d4e0 2023-11-04T01:43:34.522 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.518+0000 7fdbc0a21640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc0cee10 con 0x7fdbbc0d1be0 2023-11-04T01:43:34.523 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.518+0000 7fdbc0a21640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0b2980 con 0x7fdbbc15d100 2023-11-04T01:43:34.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.518+0000 7fdbb1d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdbbc15d4e0 0x7fdbbc0d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56396/0 (socket says 172.21.15.44:56396) 2023-11-04T01:43:34.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.518+0000 7fdbb1d9b640 1 -- 172.21.15.44:0/2638044026 learned_addr learned my addr 172.21.15.44:0/2638044026 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:34.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb9d9b640 1 -- 172.21.15.44:0/2638044026 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612894631 0 0) 0x7fdbbc0b32b0 con 0x7fdbbc15d4e0 2023-11-04T01:43:34.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbba59c640 1 --2- 172.21.15.44:0/2638044026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbbc15d100 0x7fdbbc0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb9d9b640 1 -- 172.21.15.44:0/2638044026 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdba8003520 con 0x7fdbbc15d4e0 2023-11-04T01:43:34.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb9d9b640 1 -- 172.21.15.44:0/2638044026 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4108450314 0 0) 0x7fdba8003520 con 0x7fdbbc15d4e0 2023-11-04T01:43:34.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb9d9b640 1 -- 172.21.15.44:0/2638044026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbbc15d100 msgr2=0x7fdbbc0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb9d9b640 1 --2- 172.21.15.44:0/2638044026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbbc15d100 0x7fdbbc0ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.526 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb9d9b640 1 -- 172.21.15.44:0/2638044026 >> v1:172.21.15.204:6789/0 conn(0x7fdbbc0d1be0 legacy=0x7fdbbc0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb9d9b640 1 -- 172.21.15.44:0/2638044026 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc0b2c60 con 0x7fdbbc15d4e0 2023-11-04T01:43:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb9d9b640 1 -- 172.21.15.44:0/2638044026 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fdba4001670 con 0x7fdbbc15d4e0 2023-11-04T01:43:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb9d9b640 1 -- 172.21.15.44:0/2638044026 >> v1:172.21.15.44:6789/0 conn(0x7fdbbc15d4e0 legacy=0x7fdbbc0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb9d9b640 1 --2- 172.21.15.44:0/2638044026 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdba80039a0 0x7fdba8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb9d9b640 1 --2- 172.21.15.44:0/2638044026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdba80047c0 0x7fdba8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb9d9b640 1 --2- 172.21.15.44:0/2638044026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbbc15d100 0x7fdba8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb9d9b640 1 -- 172.21.15.44:0/2638044026 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0b2980 con 0x7fdba80047c0 2023-11-04T01:43:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb9d9b640 1 -- 172.21.15.44:0/2638044026 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba800ba30 con 0x7fdba80039a0 2023-11-04T01:43:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb9d9b640 1 -- 172.21.15.44:0/2638044026 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba800bbf0 con 0x7fdbbc15d100 2023-11-04T01:43:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbb1d9b640 1 --2- 172.21.15.44:0/2638044026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdba80047c0 0x7fdba8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbba59c640 1 --2- 172.21.15.44:0/2638044026 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdba80039a0 0x7fdba8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.519+0000 7fdbbad9d640 1 --2- 172.21.15.44:0/2638044026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbbc15d100 0x7fdba8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.520+0000 7fdbb1d9b640 1 -- 172.21.15.44:0/2638044026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbbc15d100 msgr2=0x7fdba8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.520+0000 7fdbb1d9b640 1 --2- 172.21.15.44:0/2638044026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbbc15d100 0x7fdba8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.520+0000 7fdbb1d9b640 1 -- 172.21.15.44:0/2638044026 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdba80039a0 msgr2=0x7fdba8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.520+0000 7fdbb1d9b640 1 --2- 172.21.15.44:0/2638044026 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdba80039a0 0x7fdba8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.520+0000 7fdbb1d9b640 1 -- 172.21.15.44:0/2638044026 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba8003520 con 0x7fdba80047c0 2023-11-04T01:43:34.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.520+0000 7fdbb1d9b640 1 --2- 172.21.15.44:0/2638044026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdba80047c0 0x7fdba8004c40 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fdba400c210 tx=0x7fdba80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe999299ae6d05cf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.520+0000 7fdbb9d9b640 1 -- 172.21.15.44:0/2638044026 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4005ad0 con 0x7fdba80047c0 2023-11-04T01:43:34.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.520+0000 7fdbb9d9b640 1 -- 172.21.15.44:0/2638044026 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba4005c30 con 0x7fdba80047c0 2023-11-04T01:43:34.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.520+0000 7fdbb9d9b640 1 -- 172.21.15.44:0/2638044026 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba402c870 con 0x7fdba80047c0 2023-11-04T01:43:34.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.521+0000 7fdbc0a21640 1 -- 172.21.15.44:0/2638044026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdba80047c0 msgr2=0x7fdba8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.521+0000 7fdbc0a21640 1 --2- 172.21.15.44:0/2638044026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdba80047c0 0x7fdba8004c40 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fdba400c210 tx=0x7fdba80057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.521+0000 7fdbbad9d640 1 -- 172.21.15.44:0/2638044026 reap_dead start 2023-11-04T01:43:34.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.521+0000 7fdbc0a21640 1 -- 172.21.15.44:0/2638044026 shutdown_connections 2023-11-04T01:43:34.532 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.521+0000 7fdbc0a21640 1 -- 172.21.15.44:0/2638044026 >> 172.21.15.44:0/2638044026 conn(0x7fdbbc0d2ef0 msgr2=0x7fdbbc0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.521+0000 7fdbc0a21640 1 -- 172.21.15.44:0/2638044026 shutdown_connections 2023-11-04T01:43:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.521+0000 7fdbc0a21640 1 -- 172.21.15.44:0/2638044026 wait complete. 2023-11-04T01:43:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.522+0000 7fdbc0a21640 1 Processor -- start 2023-11-04T01:43:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.522+0000 7fdbc0a21640 1 -- start start 2023-11-04T01:43:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.523+0000 7fdbc0a21640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdba80047c0 0x7fdbbc160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.523+0000 7fdbc0a21640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbbc15b3f0 0x7fdbbc15e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.523+0000 7fdbc0a21640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdbbc0cbd50 0x7fdbbc0cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.523+0000 7fdbc0a21640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc160590 con 0x7fdba80047c0 2023-11-04T01:43:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.523+0000 7fdbc0a21640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0cc710 con 0x7fdbbc0cbd50 2023-11-04T01:43:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.523+0000 7fdbc0a21640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc15e7c0 con 0x7fdbbc15b3f0 2023-11-04T01:43:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.523+0000 7fdbba59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdba80047c0 0x7fdbbc160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.523+0000 7fdbba59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdba80047c0 0x7fdbbc160050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37428/0 (socket says 172.21.15.44:37428) 2023-11-04T01:43:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.523+0000 7fdbba59c640 1 -- 172.21.15.44:0/4120492995 learned_addr learned my addr 172.21.15.44:0/4120492995 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.523+0000 7fdbb1d9b640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbbc15b3f0 0x7fdbbc15e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.524+0000 7fdbbad9d640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdbbc0cbd50 0x7fdbbc0cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.524+0000 7fdbba59c640 1 -- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbbc15b3f0 msgr2=0x7fdbbc15e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.524+0000 7fdbba59c640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbbc15b3f0 0x7fdbbc15e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.524+0000 7fdbba59c640 1 -- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdbbc0cbd50 msgr2=0x7fdbbc0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.524+0000 7fdbba59c640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdbbc0cbd50 0x7fdbbc0cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.524+0000 7fdbba59c640 1 -- 172.21.15.44:0/4120492995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc1f3390 con 0x7fdba80047c0 2023-11-04T01:43:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.524+0000 7fdbb1d9b640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbbc15b3f0 0x7fdbbc15e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.524+0000 7fdbbad9d640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdbbc0cbd50 0x7fdbbc0cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.524+0000 7fdbba59c640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdba80047c0 0x7fdbbc160050 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fdbac011990 tx=0x7fdbac011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.524+0000 7fdbb37fe640 1 -- 172.21.15.44:0/4120492995 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac005ba0 con 0x7fdba80047c0 2023-11-04T01:43:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.524+0000 7fdbb37fe640 1 -- 172.21.15.44:0/4120492995 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbac005d00 con 0x7fdba80047c0 2023-11-04T01:43:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.524+0000 7fdbc0a21640 1 -- 172.21.15.44:0/4120492995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbbc15ea40 con 0x7fdba80047c0 2023-11-04T01:43:34.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.524+0000 7fdbb37fe640 1 -- 172.21.15.44:0/4120492995 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac00fae0 con 0x7fdba80047c0 2023-11-04T01:43:34.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.524+0000 7fdbc0a21640 1 -- 172.21.15.44:0/4120492995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbbc15f000 con 0x7fdba80047c0 2023-11-04T01:43:34.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.525+0000 7fdbc0a21640 1 -- 172.21.15.44:0/4120492995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbbc0684b0 con 0x7fdba80047c0 2023-11-04T01:43:34.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.525+0000 7fdbb37fe640 1 -- 172.21.15.44:0/4120492995 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdbac00fc40 con 0x7fdba80047c0 2023-11-04T01:43:34.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.526+0000 7fdbb37fe640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdb9c06aea0 0x7fdb9c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.526+0000 7fdbb37fe640 1 -- 172.21.15.44:0/4120492995 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8010+0+0 (secure 0 0 0) 0x7fdbac08a720 con 0x7fdba80047c0 2023-11-04T01:43:34.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.526+0000 7fdbb1d9b640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdb9c06aea0 0x7fdb9c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.527+0000 7fdbb1d9b640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdb9c06aea0 0x7fdb9c06d360 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdba4034000 tx=0x7fdba4009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.530+0000 7fdbb37fe640 1 -- 172.21.15.44:0/4120492995 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdbac0550d0 con 0x7fdba80047c0 2023-11-04T01:43:34.743 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.741+0000 7fdbc0a21640 1 -- 172.21.15.44:0/4120492995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbbc0d2cd0 con 0x7fdba80047c0 2023-11-04T01:43:34.744 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.742+0000 7fdbb37fe640 1 -- 172.21.15.44:0/4120492995 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4144 (secure 0 0 0) 0x7fdbac0586f0 con 0x7fdba80047c0 2023-11-04T01:43:34.744 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:34.744 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":112,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:34.396454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:replay","state_seq":1,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:34.744 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 112 2023-11-04T01:43:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.744+0000 7fdbc0a21640 1 -- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdb9c06aea0 msgr2=0x7fdb9c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.744+0000 7fdbc0a21640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdb9c06aea0 0x7fdb9c06d360 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdba4034000 tx=0x7fdba4009030 comp rx=0 tx=0).stop 2023-11-04T01:43:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.744+0000 7fdbc0a21640 1 -- 172.21.15.44:0/4120492995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdba80047c0 msgr2=0x7fdbbc160050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.744+0000 7fdbc0a21640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdba80047c0 0x7fdbbc160050 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fdbac011990 tx=0x7fdbac011e50 comp rx=0 tx=0).stop 2023-11-04T01:43:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.744+0000 7fdbc0a21640 1 -- 172.21.15.44:0/4120492995 shutdown_connections 2023-11-04T01:43:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.744+0000 7fdbc0a21640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdb9c06aea0 0x7fdb9c06d360 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.744+0000 7fdbc0a21640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdbbc0cbd50 0x7fdbbc0cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.744+0000 7fdbc0a21640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdbbc15b3f0 0x7fdbbc15e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.744+0000 7fdbc0a21640 1 --2- 172.21.15.44:0/4120492995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdba80047c0 0x7fdbbc160050 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.744+0000 7fdbc0a21640 1 -- 172.21.15.44:0/4120492995 >> 172.21.15.44:0/4120492995 conn(0x7fdbbc0d2ef0 msgr2=0x7fdbbc06a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.744+0000 7fdbc0a21640 1 -- 172.21.15.44:0/4120492995 shutdown_connections 2023-11-04T01:43:34.747 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:34.744+0000 7fdbc0a21640 1 -- 172.21.15.44:0/4120492995 wait complete. 2023-11-04T01:43:34.757 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:43:35.406 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:43:35.404+0000 7f60648e0640 -1 --2- [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] >> [v2:172.21.15.44:6833/2720398401,v1:172.21.15.44:6835/2720398401] conn(0x560367d1bc00 0x560367dc2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.44:6833/2720398401,v1:172.21.15.44:6835/2720398401] is using msgr V1 protocol 2023-11-04T01:43:35.606 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:43:35.605+0000 7f60648e0640 -1 --2- [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] >> [v2:172.21.15.44:6833/2720398401,v1:172.21.15.44:6835/2720398401] conn(0x560367d1bc00 0x560367dc2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.44:6833/2720398401,v1:172.21.15.44:6835/2720398401] is using msgr V1 protocol 2023-11-04T01:43:36.007 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:43:36.006+0000 7f60648e0640 -1 --2- [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] >> [v2:172.21.15.44:6833/2720398401,v1:172.21.15.44:6835/2720398401] conn(0x560367d1bc00 0x560367dc2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.44:6833/2720398401,v1:172.21.15.44:6835/2720398401] is using msgr V1 protocol 2023-11-04T01:43:36.809 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:43:36.807+0000 7f60648e0640 -1 --2- [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] >> [v2:172.21.15.44:6833/2720398401,v1:172.21.15.44:6835/2720398401] conn(0x560367d1bc00 0x560367dc2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.44:6833/2720398401,v1:172.21.15.44:6835/2720398401] is using msgr V1 protocol 2023-11-04T01:43:38.410 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:43:38.409+0000 7f60648e0640 -1 --2- [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] >> [v2:172.21.15.44:6833/2720398401,v1:172.21.15.44:6835/2720398401] conn(0x560367d1bc00 0x560367dc2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.44:6833/2720398401,v1:172.21.15.44:6835/2720398401] is using msgr V1 protocol 2023-11-04T01:43:39.757 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:39.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.875+0000 7f07f4e61640 1 Processor -- start 2023-11-04T01:43:39.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.876+0000 7f07f4e61640 1 -- start start 2023-11-04T01:43:39.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.876+0000 7f07f4e61640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f015d4e0 0x7f07f00d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.877+0000 7f07f4e61640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f00b32b0 con 0x7f07f015d100 2023-11-04T01:43:39.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.877+0000 7f07f4e61640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f00cee10 con 0x7f07f00d3b60 2023-11-04T01:43:39.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.877+0000 7f07f4e61640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f00cec20 con 0x7f07f015d4e0 2023-11-04T01:43:39.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.877+0000 7f07ee59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f07f015d100 0x7f07f00ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56410/0 (socket says 172.21.15.44:56410) 2023-11-04T01:43:39.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.877+0000 7f07ee59c640 1 -- 172.21.15.44:0/4194911067 learned_addr learned my addr 172.21.15.44:0/4194911067 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:39.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.877+0000 7f07edd9b640 1 --2- 172.21.15.44:0/4194911067 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f015d4e0 0x7f07f00d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.877+0000 7f07ed59a640 1 -- 172.21.15.44:0/4194911067 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501903951 0 0) 0x7f07f00b32b0 con 0x7f07f015d100 2023-11-04T01:43:39.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.877+0000 7f07ed59a640 1 -- 172.21.15.44:0/4194911067 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07dc003520 con 0x7f07f015d100 2023-11-04T01:43:39.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.877+0000 7f07ed59a640 1 -- 172.21.15.44:0/4194911067 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501825402 0 0) 0x7f07f00cee10 con 0x7f07f00d3b60 2023-11-04T01:43:39.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.877+0000 7f07ed59a640 1 -- 172.21.15.44:0/4194911067 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07f00b32b0 con 0x7f07f00d3b60 2023-11-04T01:43:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.877+0000 7f07edd9b640 1 -- 172.21.15.44:0/4194911067 >> v1:172.21.15.204:6789/0 conn(0x7f07f00d3b60 legacy=0x7f07f00b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.877+0000 7f07edd9b640 1 -- 172.21.15.44:0/4194911067 >> v1:172.21.15.44:6789/0 conn(0x7f07f015d100 legacy=0x7f07f00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.877+0000 7f07ed59a640 1 -- 172.21.15.44:0/4194911067 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1055985920 0 0) 0x7f07dc003520 con 0x7f07f015d100 2023-11-04T01:43:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.877+0000 7f07edd9b640 1 -- 172.21.15.44:0/4194911067 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f00b2980 con 0x7f07f015d4e0 2023-11-04T01:43:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.878+0000 7f07edd9b640 1 --2- 172.21.15.44:0/4194911067 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f015d4e0 0x7f07f00d14d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07d80097d0 tx=0x7f07d802b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10b3e9656470baa0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.878+0000 7f07ed59a640 1 -- 172.21.15.44:0/4194911067 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e80017f0 con 0x7f07f015d4e0 2023-11-04T01:43:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.878+0000 7f07ed59a640 1 -- 172.21.15.44:0/4194911067 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d802e050 con 0x7f07f015d4e0 2023-11-04T01:43:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.878+0000 7f07ed59a640 1 -- 172.21.15.44:0/4194911067 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8030710 con 0x7f07f015d4e0 2023-11-04T01:43:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.879+0000 7f07f4e61640 1 -- 172.21.15.44:0/4194911067 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f015d4e0 msgr2=0x7f07f00d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.879+0000 7f07f4e61640 1 --2- 172.21.15.44:0/4194911067 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f015d4e0 0x7f07f00d14d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07d80097d0 tx=0x7f07d802b800 comp rx=0 tx=0).stop 2023-11-04T01:43:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.879+0000 7f07f4e61640 1 -- 172.21.15.44:0/4194911067 shutdown_connections 2023-11-04T01:43:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.879+0000 7f07f4e61640 1 --2- 172.21.15.44:0/4194911067 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f015d4e0 0x7f07f00d14d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.879+0000 7f07f4e61640 1 -- 172.21.15.44:0/4194911067 >> 172.21.15.44:0/4194911067 conn(0x7f07f00d2ef0 msgr2=0x7f07f00d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.879+0000 7f07f4e61640 1 -- 172.21.15.44:0/4194911067 shutdown_connections 2023-11-04T01:43:39.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.879+0000 7f07f4e61640 1 -- 172.21.15.44:0/4194911067 wait complete. 2023-11-04T01:43:39.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.880+0000 7f07f4e61640 1 Processor -- start 2023-11-04T01:43:39.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.880+0000 7f07f4e61640 1 -- start start 2023-11-04T01:43:39.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.881+0000 7f07f4e61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f00d3b60 0x7f07f01525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.881+0000 7f07f4e61640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f015d100 0x7f07f0153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.881+0000 7f07f4e61640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07f015d4e0 0x7f07f015a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.881+0000 7f07f4e61640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0155230 con 0x7f07f00d3b60 2023-11-04T01:43:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.881+0000 7f07f4e61640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0154620 con 0x7f07f015d4e0 2023-11-04T01:43:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.881+0000 7f07f4e61640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0154900 con 0x7f07f015d100 2023-11-04T01:43:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.881+0000 7f07ee59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f00d3b60 0x7f07f01525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.881+0000 7f07ee59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f00d3b60 0x7f07f01525a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37442/0 (socket says 172.21.15.44:37442) 2023-11-04T01:43:39.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.881+0000 7f07ee59c640 1 -- 172.21.15.44:0/200209155 learned_addr learned my addr 172.21.15.44:0/200209155 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:39.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.882+0000 7f07eed9d640 1 --2- 172.21.15.44:0/200209155 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07f015d4e0 0x7f07f015a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.882+0000 7f07edd9b640 1 --2- 172.21.15.44:0/200209155 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f015d100 0x7f07f0153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.892 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.882+0000 7f07ee59c640 1 -- 172.21.15.44:0/200209155 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f015d100 msgr2=0x7f07f0153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.882+0000 7f07ee59c640 1 --2- 172.21.15.44:0/200209155 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f015d100 0x7f07f0153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.882+0000 7f07ee59c640 1 -- 172.21.15.44:0/200209155 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07f015d4e0 msgr2=0x7f07f015a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.882+0000 7f07ee59c640 1 --2- 172.21.15.44:0/200209155 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07f015d4e0 0x7f07f015a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.882+0000 7f07ee59c640 1 -- 172.21.15.44:0/200209155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d8009400 con 0x7f07f00d3b60 2023-11-04T01:43:39.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.882+0000 7f07eed9d640 1 --2- 172.21.15.44:0/200209155 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07f015d4e0 0x7f07f015a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:39.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.882+0000 7f07ee59c640 1 --2- 172.21.15.44:0/200209155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f00d3b60 0x7f07f01525a0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f07e800c780 tx=0x7f07e800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.882+0000 7f07e6ffd640 1 -- 172.21.15.44:0/200209155 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8007270 con 0x7f07f00d3b60 2023-11-04T01:43:39.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.882+0000 7f07e6ffd640 1 -- 172.21.15.44:0/200209155 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e80073d0 con 0x7f07f00d3b60 2023-11-04T01:43:39.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.882+0000 7f07f4e61640 1 -- 172.21.15.44:0/200209155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f0154be0 con 0x7f07f00d3b60 2023-11-04T01:43:39.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.882+0000 7f07e6ffd640 1 -- 172.21.15.44:0/200209155 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e80057a0 con 0x7f07f00d3b60 2023-11-04T01:43:39.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.882+0000 7f07f4e61640 1 -- 172.21.15.44:0/200209155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f0155ad0 con 0x7f07f00d3b60 2023-11-04T01:43:39.894 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.883+0000 7f07f4e61640 1 -- 172.21.15.44:0/200209155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f00684b0 con 0x7f07f00d3b60 2023-11-04T01:43:39.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.884+0000 7f07e6ffd640 1 -- 172.21.15.44:0/200209155 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f07e8005920 con 0x7f07f00d3b60 2023-11-04T01:43:39.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.884+0000 7f07e6ffd640 1 --2- 172.21.15.44:0/200209155 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f07d006ae70 0x7f07d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.884+0000 7f07e6ffd640 1 -- 172.21.15.44:0/200209155 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8010+0+0 (secure 0 0 0) 0x7f07e80896d0 con 0x7f07f00d3b60 2023-11-04T01:43:39.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.884+0000 7f07edd9b640 1 --2- 172.21.15.44:0/200209155 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f07d006ae70 0x7f07d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.885+0000 7f07edd9b640 1 --2- 172.21.15.44:0/200209155 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f07d006ae70 0x7f07d006d330 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f07d8034000 tx=0x7f07d8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:39.889+0000 7f07e6ffd640 1 -- 172.21.15.44:0/200209155 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07e8053f10 con 0x7f07f00d3b60 2023-11-04T01:43:39.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:43:39.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:43:40.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.101+0000 7f07f4e61640 1 -- 172.21.15.44:0/200209155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07f00ccdd0 con 0x7f07f00d3b60 2023-11-04T01:43:40.102 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.101+0000 7f07e6ffd640 1 -- 172.21.15.44:0/200209155 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4938 (secure 0 0 0) 0x7f07e8017070 con 0x7f07f00d3b60 2023-11-04T01:43:40.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:40.103 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":113,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:34.411926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:resolve","state_seq":12,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:40.104 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 113 2023-11-04T01:43:40.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.103+0000 7f07f4e61640 1 -- 172.21.15.44:0/200209155 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f07d006ae70 msgr2=0x7f07d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.103+0000 7f07f4e61640 1 --2- 172.21.15.44:0/200209155 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f07d006ae70 0x7f07d006d330 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f07d8034000 tx=0x7f07d8008030 comp rx=0 tx=0).stop 2023-11-04T01:43:40.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.103+0000 7f07f4e61640 1 -- 172.21.15.44:0/200209155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f00d3b60 msgr2=0x7f07f01525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.103+0000 7f07f4e61640 1 --2- 172.21.15.44:0/200209155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f00d3b60 0x7f07f01525a0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f07e800c780 tx=0x7f07e800cc40 comp rx=0 tx=0).stop 2023-11-04T01:43:40.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.103+0000 7f07f4e61640 1 -- 172.21.15.44:0/200209155 shutdown_connections 2023-11-04T01:43:40.104 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.103+0000 7f07f4e61640 1 --2- 172.21.15.44:0/200209155 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f07d006ae70 0x7f07d006d330 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.103+0000 7f07f4e61640 1 --2- 172.21.15.44:0/200209155 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07f015d4e0 0x7f07f015a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.103+0000 7f07f4e61640 1 --2- 172.21.15.44:0/200209155 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07f015d100 0x7f07f0153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.103+0000 7f07f4e61640 1 --2- 172.21.15.44:0/200209155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f00d3b60 0x7f07f01525a0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.103+0000 7f07f4e61640 1 -- 172.21.15.44:0/200209155 >> 172.21.15.44:0/200209155 conn(0x7f07f00d2ef0 msgr2=0x7f07f00b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:40.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.103+0000 7f07f4e61640 1 -- 172.21.15.44:0/200209155 shutdown_connections 2023-11-04T01:43:40.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.103+0000 7f07f4e61640 1 -- 172.21.15.44:0/200209155 wait complete. 2023-11-04T01:43:40.115 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:43:40.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:40.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.221+0000 7ff6fce87640 1 Processor -- start 2023-11-04T01:43:40.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.221+0000 7ff6fce87640 1 -- start start 2023-11-04T01:43:40.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.222+0000 7ff6fce87640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff6f8164a30 0x7ff6f806b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.222+0000 7ff6fce87640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff6f806d3d0 0x7ff6f80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.222+0000 7ff6fce87640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f8164e10 con 0x7ff6f80b0a70 2023-11-04T01:43:40.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.222+0000 7ff6fce87640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f8165a50 con 0x7ff6f806d3d0 2023-11-04T01:43:40.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.222+0000 7ff6fce87640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f806bf00 con 0x7ff6f8164a30 2023-11-04T01:43:40.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.222+0000 7ff6f5d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff6f806d3d0 0x7ff6f80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.222+0000 7ff6f6d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff6f80b0a70 0x7ff6f80c9100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56422/0 (socket says 172.21.15.44:56422) 2023-11-04T01:43:40.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.222+0000 7ff6f6d9d640 1 -- 172.21.15.44:0/3818769658 learned_addr learned my addr 172.21.15.44:0/3818769658 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:40.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.222+0000 7ff6f659c640 1 --2- 172.21.15.44:0/3818769658 >> v2:172.21.15.204:3300/0 conn(0x7ff6f8164a30 0x7ff6f806b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.222+0000 7ff6f5d9b640 1 -- 172.21.15.44:0/3818769658 >> v2:172.21.15.204:3300/0 conn(0x7ff6f8164a30 msgr2=0x7ff6f806b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:40.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.222+0000 7ff6f5d9b640 1 --2- 172.21.15.44:0/3818769658 >> v2:172.21.15.204:3300/0 conn(0x7ff6f8164a30 0x7ff6f806b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.222+0000 7ff6f5d9b640 1 -- 172.21.15.44:0/3818769658 >> v1:172.21.15.44:6789/0 conn(0x7ff6f80b0a70 legacy=0x7ff6f80c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.223+0000 7ff6f5d9b640 1 -- 172.21.15.44:0/3818769658 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f81650b0 con 0x7ff6f806d3d0 2023-11-04T01:43:40.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.223+0000 7ff6f5d9b640 1 --2- 172.21.15.44:0/3818769658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6f806d3d0 0x7ff6f80b0530 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80cea10 tx=0x7ff6e002b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d417fb021463fe9f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:40.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.223+0000 7ff6f559a640 1 -- 172.21.15.44:0/3818769658 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0030710 con 0x7ff6f806d3d0 2023-11-04T01:43:40.225 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.223+0000 7ff6f559a640 1 -- 172.21.15.44:0/3818769658 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e002e050 con 0x7ff6f806d3d0 2023-11-04T01:43:40.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.223+0000 7ff6f559a640 1 -- 172.21.15.44:0/3818769658 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0030a90 con 0x7ff6f806d3d0 2023-11-04T01:43:40.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.224+0000 7ff6fce87640 1 -- 172.21.15.44:0/3818769658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6f806d3d0 msgr2=0x7ff6f80b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.224+0000 7ff6fce87640 1 --2- 172.21.15.44:0/3818769658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6f806d3d0 0x7ff6f80b0530 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80cea10 tx=0x7ff6e002b680 comp rx=0 tx=0).stop 2023-11-04T01:43:40.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.224+0000 7ff6fce87640 1 -- 172.21.15.44:0/3818769658 shutdown_connections 2023-11-04T01:43:40.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.224+0000 7ff6fce87640 1 --2- 172.21.15.44:0/3818769658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6f806d3d0 0x7ff6f80b0530 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.224+0000 7ff6fce87640 1 --2- 172.21.15.44:0/3818769658 >> v2:172.21.15.204:3300/0 conn(0x7ff6f8164a30 0x7ff6f806b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.224+0000 7ff6fce87640 1 -- 172.21.15.44:0/3818769658 >> 172.21.15.44:0/3818769658 conn(0x7ff6f80cb530 msgr2=0x7ff6f80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:40.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.224+0000 7ff6fce87640 1 -- 172.21.15.44:0/3818769658 shutdown_connections 2023-11-04T01:43:40.226 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.224+0000 7ff6fce87640 1 -- 172.21.15.44:0/3818769658 wait complete. 2023-11-04T01:43:40.228 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.225+0000 7ff6fce87640 1 Processor -- start 2023-11-04T01:43:40.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.225+0000 7ff6fce87640 1 -- start start 2023-11-04T01:43:40.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.226+0000 7ff6fce87640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6f806d3d0 0x7ff6f80b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.226+0000 7ff6fce87640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6f80b0a70 0x7ff6f80c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.226+0000 7ff6fce87640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6f8164a30 0x7ff6f80c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.226+0000 7ff6fce87640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80c3dd0 con 0x7ff6f8164a30 2023-11-04T01:43:40.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.226+0000 7ff6fce87640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80c4000 con 0x7ff6f80b0a70 2023-11-04T01:43:40.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6fce87640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80c42e0 con 0x7ff6f806d3d0 2023-11-04T01:43:40.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6f6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6f8164a30 0x7ff6f80c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6f659c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6f806d3d0 0x7ff6f80b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6f659c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6f806d3d0 0x7ff6f80b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:55386/0 (socket says 172.21.15.44:55386) 2023-11-04T01:43:40.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6f659c640 1 -- 172.21.15.44:0/522337478 learned_addr learned my addr 172.21.15.44:0/522337478 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:40.229 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6f6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6f8164a30 0x7ff6f80c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37470/0 (socket says 172.21.15.44:37470) 2023-11-04T01:43:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6f5d9b640 1 --2- 172.21.15.44:0/522337478 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6f80b0a70 0x7ff6f80c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6f6d9d640 1 -- 172.21.15.44:0/522337478 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6f806d3d0 msgr2=0x7ff6f80b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6f6d9d640 1 --2- 172.21.15.44:0/522337478 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6f806d3d0 0x7ff6f80b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6f6d9d640 1 -- 172.21.15.44:0/522337478 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6f80b0a70 msgr2=0x7ff6f80c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6f6d9d640 1 --2- 172.21.15.44:0/522337478 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6f80b0a70 0x7ff6f80c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6f6d9d640 1 -- 172.21.15.44:0/522337478 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0009400 con 0x7ff6f8164a30 2023-11-04T01:43:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6f6d9d640 1 --2- 172.21.15.44:0/522337478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6f8164a30 0x7ff6f80c84c0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800c550 tx=0x7ff6e800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6eeffd640 1 -- 172.21.15.44:0/522337478 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e80074e0 con 0x7ff6f8164a30 2023-11-04T01:43:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6eeffd640 1 -- 172.21.15.44:0/522337478 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e8007640 con 0x7ff6f8164a30 2023-11-04T01:43:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6eeffd640 1 -- 172.21.15.44:0/522337478 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8004a00 con 0x7ff6f8164a30 2023-11-04T01:43:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.227+0000 7ff6fce87640 1 -- 172.21.15.44:0/522337478 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f80c45c0 con 0x7ff6f8164a30 2023-11-04T01:43:40.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.228+0000 7ff6fce87640 1 -- 172.21.15.44:0/522337478 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f80c4b80 con 0x7ff6f8164a30 2023-11-04T01:43:40.231 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.229+0000 7ff6fce87640 1 -- 172.21.15.44:0/522337478 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f80c4d70 con 0x7ff6f8164a30 2023-11-04T01:43:40.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.229+0000 7ff6eeffd640 1 -- 172.21.15.44:0/522337478 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6e8004b60 con 0x7ff6f8164a30 2023-11-04T01:43:40.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.229+0000 7ff6eeffd640 1 --2- 172.21.15.44:0/522337478 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6d806ae70 0x7ff6d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.230+0000 7ff6eeffd640 1 -- 172.21.15.44:0/522337478 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8010+0+0 (secure 0 0 0) 0x7ff6e8089110 con 0x7ff6f8164a30 2023-11-04T01:43:40.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.230+0000 7ff6f659c640 1 --2- 172.21.15.44:0/522337478 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6d806ae70 0x7ff6d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.232 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.230+0000 7ff6f659c640 1 --2- 172.21.15.44:0/522337478 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6d806ae70 0x7ff6d806d330 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009a40 tx=0x7ff6f000b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:40.234 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.234+0000 7ff6eeffd640 1 -- 172.21.15.44:0/522337478 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff6e8053970 con 0x7ff6f8164a30 2023-11-04T01:43:40.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.448+0000 7ff6fce87640 1 -- 172.21.15.44:0/522337478 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6f80684b0 con 0x7ff6f8164a30 2023-11-04T01:43:40.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.448+0000 7ff6eeffd640 1 -- 172.21.15.44:0/522337478 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4938 (secure 0 0 0) 0x7ff6e8018070 con 0x7ff6f8164a30 2023-11-04T01:43:40.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:40.449 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":113,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:34.411926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:resolve","state_seq":12,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:40.450 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 113 2023-11-04T01:43:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.450+0000 7ff6fce87640 1 -- 172.21.15.44:0/522337478 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6d806ae70 msgr2=0x7ff6d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.450+0000 7ff6fce87640 1 --2- 172.21.15.44:0/522337478 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6d806ae70 0x7ff6d806d330 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009a40 tx=0x7ff6f000b040 comp rx=0 tx=0).stop 2023-11-04T01:43:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.450+0000 7ff6fce87640 1 -- 172.21.15.44:0/522337478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6f8164a30 msgr2=0x7ff6f80c84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.450+0000 7ff6fce87640 1 --2- 172.21.15.44:0/522337478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6f8164a30 0x7ff6f80c84c0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800c550 tx=0x7ff6e800ca10 comp rx=0 tx=0).stop 2023-11-04T01:43:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.450+0000 7ff6fce87640 1 -- 172.21.15.44:0/522337478 shutdown_connections 2023-11-04T01:43:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.450+0000 7ff6fce87640 1 --2- 172.21.15.44:0/522337478 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6d806ae70 0x7ff6d806d330 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.450+0000 7ff6fce87640 1 --2- 172.21.15.44:0/522337478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6f8164a30 0x7ff6f80c84c0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.450+0000 7ff6fce87640 1 --2- 172.21.15.44:0/522337478 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6f80b0a70 0x7ff6f80c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.450+0000 7ff6fce87640 1 --2- 172.21.15.44:0/522337478 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6f806d3d0 0x7ff6f80b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.450+0000 7ff6fce87640 1 -- 172.21.15.44:0/522337478 >> 172.21.15.44:0/522337478 conn(0x7ff6f80cb530 msgr2=0x7ff6f81633d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.450+0000 7ff6fce87640 1 -- 172.21.15.44:0/522337478 shutdown_connections 2023-11-04T01:43:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.450+0000 7ff6fce87640 1 -- 172.21.15.44:0/522337478 wait complete. 2023-11-04T01:43:40.462 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:43:40.462 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.3469047546386719s 2023-11-04T01:43:40.462 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:40.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.568+0000 7efdca661640 1 Processor -- start 2023-11-04T01:43:40.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.568+0000 7efdca661640 1 -- start start 2023-11-04T01:43:40.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.569+0000 7efdca661640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdc40b2160 0x7efdc406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.569+0000 7efdca661640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efdc406ca60 0x7efdc406cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.569+0000 7efdca661640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc40cb5d0 con 0x7efdc415b330 2023-11-04T01:43:40.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.569+0000 7efdca661640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc406d430 con 0x7efdc406ca60 2023-11-04T01:43:40.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.569+0000 7efdca661640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc406f3f0 con 0x7efdc40b2160 2023-11-04T01:43:40.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.569+0000 7efdc37fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdc40b2160 0x7efdc406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.569+0000 7efdc8bfe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efdc406ca60 0x7efdc406cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.569+0000 7efdc37fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdc40b2160 0x7efdc406ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:55402/0 (socket says 172.21.15.44:55402) 2023-11-04T01:43:40.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.569+0000 7efdc37fe640 1 -- 172.21.15.44:0/3985869532 learned_addr learned my addr 172.21.15.44:0/3985869532 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:40.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.570+0000 7efdc37fe640 1 -- 172.21.15.44:0/3985869532 >> v2:172.21.15.204:3300/0 conn(0x7efdc406ca60 msgr2=0x7efdc406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:40.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.570+0000 7efdc37fe640 1 --2- 172.21.15.44:0/3985869532 >> v2:172.21.15.204:3300/0 conn(0x7efdc406ca60 0x7efdc406cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.570+0000 7efdc37fe640 1 -- 172.21.15.44:0/3985869532 >> v1:172.21.15.204:6789/0 conn(0x7efdc415b330 legacy=0x7efdc40cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.570+0000 7efdc2ffd640 1 -- 172.21.15.44:0/3985869532 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792425570 0 0) 0x7efdc40cb5d0 con 0x7efdc415b330 2023-11-04T01:43:40.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.570+0000 7efdc37fe640 1 -- 172.21.15.44:0/3985869532 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc40c3490 con 0x7efdc40b2160 2023-11-04T01:43:40.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.570+0000 7efdc8bfe640 1 --2- 172.21.15.44:0/3985869532 >> v2:172.21.15.204:3300/0 conn(0x7efdc406ca60 0x7efdc406cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:40.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.570+0000 7efdc37fe640 1 --2- 172.21.15.44:0/3985869532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdc40b2160 0x7efdc406ebf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009870 tx=0x7efdb402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0ff2dd99e3d464c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:40.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.571+0000 7efdc2ffd640 1 -- 172.21.15.44:0/3985869532 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4030840 con 0x7efdc40b2160 2023-11-04T01:43:40.573 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.571+0000 7efdc2ffd640 1 -- 172.21.15.44:0/3985869532 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb40309a0 con 0x7efdc40b2160 2023-11-04T01:43:40.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.571+0000 7efdc2ffd640 1 -- 172.21.15.44:0/3985869532 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4030d30 con 0x7efdc40b2160 2023-11-04T01:43:40.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.571+0000 7efdca661640 1 -- 172.21.15.44:0/3985869532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdc40b2160 msgr2=0x7efdc406ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.571+0000 7efdca661640 1 --2- 172.21.15.44:0/3985869532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdc40b2160 0x7efdc406ebf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009870 tx=0x7efdb402b980 comp rx=0 tx=0).stop 2023-11-04T01:43:40.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.571+0000 7efdca661640 1 -- 172.21.15.44:0/3985869532 shutdown_connections 2023-11-04T01:43:40.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.571+0000 7efdca661640 1 --2- 172.21.15.44:0/3985869532 >> v2:172.21.15.204:3300/0 conn(0x7efdc406ca60 0x7efdc406cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.571+0000 7efdca661640 1 --2- 172.21.15.44:0/3985869532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdc40b2160 0x7efdc406ebf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.571+0000 7efdca661640 1 -- 172.21.15.44:0/3985869532 >> 172.21.15.44:0/3985869532 conn(0x7efdc40b1640 msgr2=0x7efdc40b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:40.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.571+0000 7efdca661640 1 -- 172.21.15.44:0/3985869532 shutdown_connections 2023-11-04T01:43:40.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.571+0000 7efdca661640 1 -- 172.21.15.44:0/3985869532 wait complete. 2023-11-04T01:43:40.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.573+0000 7efdca661640 1 Processor -- start 2023-11-04T01:43:40.574 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.573+0000 7efdca661640 1 -- start start 2023-11-04T01:43:40.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.573+0000 7efdca661640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc406ca60 0x7efdc4150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.573+0000 7efdca661640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdc40b2160 0x7efdc4150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.573+0000 7efdca661640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdc415b330 0x7efdc40c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdca661640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc41f3ef0 con 0x7efdc406ca60 2023-11-04T01:43:40.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdca661640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc41f16a0 con 0x7efdc40b2160 2023-11-04T01:43:40.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdca661640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc41f4140 con 0x7efdc415b330 2023-11-04T01:43:40.580 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc406ca60 0x7efdc4150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc406ca60 0x7efdc4150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37484/0 (socket says 172.21.15.44:37484) 2023-11-04T01:43:40.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc3fff640 1 -- 172.21.15.44:0/3527387411 learned_addr learned my addr 172.21.15.44:0/3527387411 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:40.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc8bfe640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdc415b330 0x7efdc40c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc37fe640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdc40b2160 0x7efdc4150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc3fff640 1 -- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdc415b330 msgr2=0x7efdc40c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc3fff640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdc415b330 0x7efdc40c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc3fff640 1 -- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdc40b2160 msgr2=0x7efdc4150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc3fff640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdc40b2160 0x7efdc4150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc3fff640 1 -- 172.21.15.44:0/3527387411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc009a70 con 0x7efdc406ca60 2023-11-04T01:43:40.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc37fe640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdc40b2160 0x7efdc4150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:40.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc8bfe640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdc415b330 0x7efdc40c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:40.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc3fff640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc406ca60 0x7efdc4150710 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7efdb800c4b0 tx=0x7efdb800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:40.581 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc0ff9640 1 -- 172.21.15.44:0/3527387411 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb8005480 con 0x7efdc406ca60 2023-11-04T01:43:40.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc0ff9640 1 -- 172.21.15.44:0/3527387411 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb80035f0 con 0x7efdc406ca60 2023-11-04T01:43:40.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdc0ff9640 1 -- 172.21.15.44:0/3527387411 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb80039e0 con 0x7efdc406ca60 2023-11-04T01:43:40.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdca661640 1 -- 172.21.15.44:0/3527387411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb40094d0 con 0x7efdc406ca60 2023-11-04T01:43:40.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.574+0000 7efdca661640 1 -- 172.21.15.44:0/3527387411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc41f4700 con 0x7efdc406ca60 2023-11-04T01:43:40.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.575+0000 7efdca661640 1 -- 172.21.15.44:0/3527387411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc406da20 con 0x7efdc406ca60 2023-11-04T01:43:40.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.576+0000 7efdc0ff9640 1 -- 172.21.15.44:0/3527387411 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efdb8003b40 con 0x7efdc406ca60 2023-11-04T01:43:40.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.576+0000 7efdc0ff9640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efdb006ae70 0x7efdb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.576+0000 7efdc0ff9640 1 -- 172.21.15.44:0/3527387411 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8010+0+0 (secure 0 0 0) 0x7efdb80895a0 con 0x7efdc406ca60 2023-11-04T01:43:40.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.576+0000 7efdc37fe640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efdb006ae70 0x7efdb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.582 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.577+0000 7efdc37fe640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efdb006ae70 0x7efdb006d330 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7efdb4036000 tx=0x7efdb4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:40.583 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.580+0000 7efdc0ff9640 1 -- 172.21.15.44:0/3527387411 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efdb8053cb0 con 0x7efdc406ca60 2023-11-04T01:43:40.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.797+0000 7efdca661640 1 -- 172.21.15.44:0/3527387411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdc406f100 con 0x7efdc406ca60 2023-11-04T01:43:40.798 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.797+0000 7efdc0ff9640 1 -- 172.21.15.44:0/3527387411 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4938 (secure 0 0 0) 0x7efdb8017070 con 0x7efdc406ca60 2023-11-04T01:43:40.799 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:40.799 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":113,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:34.411926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:resolve","state_seq":12,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:40.799 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 113 2023-11-04T01:43:40.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.799+0000 7efdca661640 1 -- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efdb006ae70 msgr2=0x7efdb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.799+0000 7efdca661640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efdb006ae70 0x7efdb006d330 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7efdb4036000 tx=0x7efdb4008030 comp rx=0 tx=0).stop 2023-11-04T01:43:40.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.799+0000 7efdca661640 1 -- 172.21.15.44:0/3527387411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc406ca60 msgr2=0x7efdc4150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.799+0000 7efdca661640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc406ca60 0x7efdc4150710 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7efdb800c4b0 tx=0x7efdb800c970 comp rx=0 tx=0).stop 2023-11-04T01:43:40.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.799+0000 7efdca661640 1 -- 172.21.15.44:0/3527387411 shutdown_connections 2023-11-04T01:43:40.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.799+0000 7efdca661640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7efdb006ae70 0x7efdb006d330 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.799+0000 7efdca661640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdc415b330 0x7efdc40c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.799+0000 7efdca661640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdc40b2160 0x7efdc4150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.801 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.799+0000 7efdca661640 1 --2- 172.21.15.44:0/3527387411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc406ca60 0x7efdc4150710 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.800+0000 7efdca661640 1 -- 172.21.15.44:0/3527387411 >> 172.21.15.44:0/3527387411 conn(0x7efdc40b1640 msgr2=0x7efdc40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:40.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.800+0000 7efdca661640 1 -- 172.21.15.44:0/3527387411 shutdown_connections 2023-11-04T01:43:40.802 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:40.800+0000 7efdca661640 1 -- 172.21.15.44:0/3527387411 wait complete. 2023-11-04T01:43:40.811 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:43:40.937 INFO:teuthology.orchestra.run.smithi204.stdout:{"last_snap":12,"last_created":12,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:26.455117+0000","name":"s25","metadata":{}},{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:43:11.476475+0000","name":"s26","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:43:40.937 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 9, "last_snap": 12, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:26.455117+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:43:11.476475+0000" } ] } 2023-11-04T01:43:40.937 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:41.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.043+0000 7fbb23ec2640 1 Processor -- start 2023-11-04T01:43:41.044 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.043+0000 7fbb23ec2640 1 -- start start 2023-11-04T01:43:41.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.044+0000 7fbb23ec2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb1c0d1be0 0x7fbb1c167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.044+0000 7fbb23ec2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1c0b32b0 con 0x7fbb1c15d4e0 2023-11-04T01:43:41.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.044+0000 7fbb23ec2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1c0cee10 con 0x7fbb1c15d100 2023-11-04T01:43:41.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.044+0000 7fbb23ec2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c0cec20 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.044+0000 7fbb2145d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbb1c15d4e0 0x7fbb1c0d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56428/0 (socket says 172.21.15.44:56428) 2023-11-04T01:43:41.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.044+0000 7fbb2145d640 1 -- 172.21.15.44:0/767877865 learned_addr learned my addr 172.21.15.44:0/767877865 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:41.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.044+0000 7fbb2245f640 1 --2- 172.21.15.44:0/767877865 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb1c0d1be0 0x7fbb1c167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.044+0000 7fbb20c5c640 1 -- 172.21.15.44:0/767877865 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473061642 0 0) 0x7fbb1c0b32b0 con 0x7fbb1c15d4e0 2023-11-04T01:43:41.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.044+0000 7fbb20c5c640 1 -- 172.21.15.44:0/767877865 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb08003520 con 0x7fbb1c15d4e0 2023-11-04T01:43:41.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.044+0000 7fbb20c5c640 1 -- 172.21.15.44:0/767877865 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156756714 0 0) 0x7fbb1c0cee10 con 0x7fbb1c15d100 2023-11-04T01:43:41.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.044+0000 7fbb20c5c640 1 -- 172.21.15.44:0/767877865 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb1c0b32b0 con 0x7fbb1c15d100 2023-11-04T01:43:41.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.044+0000 7fbb2245f640 1 -- 172.21.15.44:0/767877865 >> v1:172.21.15.204:6789/0 conn(0x7fbb1c15d100 legacy=0x7fbb1c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.044+0000 7fbb2245f640 1 -- 172.21.15.44:0/767877865 >> v1:172.21.15.44:6789/0 conn(0x7fbb1c15d4e0 legacy=0x7fbb1c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.044+0000 7fbb2245f640 1 -- 172.21.15.44:0/767877865 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c0b4750 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.045+0000 7fbb2245f640 1 --2- 172.21.15.44:0/767877865 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb1c0d1be0 0x7fbb1c167e80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009dc0 tx=0x7fbb1402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=516112f932c6410c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.045+0000 7fbb20c5c640 1 -- 172.21.15.44:0/767877865 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1402ccd0 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.045+0000 7fbb20c5c640 1 -- 172.21.15.44:0/767877865 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1402ce30 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.045+0000 7fbb20c5c640 1 -- 172.21.15.44:0/767877865 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14034660 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.046+0000 7fbb23ec2640 1 -- 172.21.15.44:0/767877865 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb1c0d1be0 msgr2=0x7fbb1c167e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.046+0000 7fbb23ec2640 1 --2- 172.21.15.44:0/767877865 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb1c0d1be0 0x7fbb1c167e80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009dc0 tx=0x7fbb1402bf20 comp rx=0 tx=0).stop 2023-11-04T01:43:41.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.046+0000 7fbb23ec2640 1 -- 172.21.15.44:0/767877865 shutdown_connections 2023-11-04T01:43:41.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.046+0000 7fbb23ec2640 1 --2- 172.21.15.44:0/767877865 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb1c0d1be0 0x7fbb1c167e80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.046+0000 7fbb23ec2640 1 -- 172.21.15.44:0/767877865 >> 172.21.15.44:0/767877865 conn(0x7fbb1c0d2ef0 msgr2=0x7fbb1c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:41.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.046+0000 7fbb23ec2640 1 -- 172.21.15.44:0/767877865 shutdown_connections 2023-11-04T01:43:41.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.046+0000 7fbb23ec2640 1 -- 172.21.15.44:0/767877865 wait complete. 2023-11-04T01:43:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.047+0000 7fbb23ec2640 1 Processor -- start 2023-11-04T01:43:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.047+0000 7fbb23ec2640 1 -- start start 2023-11-04T01:43:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb23ec2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb1c0d1be0 0x7fbb1c14a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb23ec2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb1c15d100 0x7fbb1c160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb23ec2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb1c15d4e0 0x7fbb1c0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb23ec2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c0ccda0 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb23ec2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c0cc190 con 0x7fbb1c15d100 2023-11-04T01:43:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb23ec2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c0cc470 con 0x7fbb1c15d4e0 2023-11-04T01:43:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb21c5e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb1c0d1be0 0x7fbb1c14a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb21c5e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb1c0d1be0 0x7fbb1c14a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37492/0 (socket says 172.21.15.44:37492) 2023-11-04T01:43:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb21c5e640 1 -- 172.21.15.44:0/3737631191 learned_addr learned my addr 172.21.15.44:0/3737631191 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb21c5e640 1 -- 172.21.15.44:0/3737631191 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb1c15d4e0 msgr2=0x7fbb1c0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb2245f640 1 --2- 172.21.15.44:0/3737631191 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb1c15d4e0 0x7fbb1c0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb2145d640 1 --2- 172.21.15.44:0/3737631191 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb1c15d100 0x7fbb1c160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb21c5e640 1 --2- 172.21.15.44:0/3737631191 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb1c15d4e0 0x7fbb1c0cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb21c5e640 1 -- 172.21.15.44:0/3737631191 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb1c15d100 msgr2=0x7fbb1c160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb21c5e640 1 --2- 172.21.15.44:0/3737631191 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb1c15d100 0x7fbb1c160370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.048+0000 7fbb21c5e640 1 -- 172.21.15.44:0/3737631191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb14009a70 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.049+0000 7fbb21c5e640 1 --2- 172.21.15.44:0/3737631191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb1c0d1be0 0x7fbb1c14a140 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c500 tx=0x7fbb1800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.049+0000 7fbb127fc640 1 -- 172.21.15.44:0/3737631191 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180052d0 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.049+0000 7fbb127fc640 1 -- 172.21.15.44:0/3737631191 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb18005430 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.049+0000 7fbb127fc640 1 -- 172.21.15.44:0/3737631191 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18003880 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.049+0000 7fbb23ec2640 1 -- 172.21.15.44:0/3737631191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1c0cc750 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.049+0000 7fbb23ec2640 1 -- 172.21.15.44:0/3737631191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1c0cbe60 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.052 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.050+0000 7fbb23ec2640 1 -- 172.21.15.44:0/3737631191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1c0684b0 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.050+0000 7fbb127fc640 1 -- 172.21.15.44:0/3737631191 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb180039e0 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.051+0000 7fbb127fc640 1 --2- 172.21.15.44:0/3737631191 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbb0006aea0 0x7fbb0006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.051+0000 7fbb127fc640 1 -- 172.21.15.44:0/3737631191 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8010+0+0 (secure 0 0 0) 0x7fbb18089b20 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.053 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.051+0000 7fbb2145d640 1 --2- 172.21.15.44:0/3737631191 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbb0006aea0 0x7fbb0006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.054 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.051+0000 7fbb2145d640 1 --2- 172.21.15.44:0/3737631191 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbb0006aea0 0x7fbb0006d360 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0b8e30 tx=0x7fbb0c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.055 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.055+0000 7fbb127fc640 1 -- 172.21.15.44:0/3737631191 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbb18054340 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.267+0000 7fbb23ec2640 1 -- 172.21.15.44:0/3737631191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb1c0d2cd0 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.268 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.267+0000 7fbb127fc640 1 -- 172.21.15.44:0/3737631191 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4938 (secure 0 0 0) 0x7fbb18057960 con 0x7fbb1c0d1be0 2023-11-04T01:43:41.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:41.268 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":113,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:34.411926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:resolve","state_seq":12,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8430":{"gid":8430,"name":"a","rank":1,"incarnation":103,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6835/2720398401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2720398401},{"type":"v1","addr":"172.21.15.44:6835","nonce":2720398401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:41.269 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 113 2023-11-04T01:43:41.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.269+0000 7fbb23ec2640 1 -- 172.21.15.44:0/3737631191 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbb0006aea0 msgr2=0x7fbb0006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.269+0000 7fbb23ec2640 1 --2- 172.21.15.44:0/3737631191 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbb0006aea0 0x7fbb0006d360 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0b8e30 tx=0x7fbb0c009040 comp rx=0 tx=0).stop 2023-11-04T01:43:41.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.269+0000 7fbb23ec2640 1 -- 172.21.15.44:0/3737631191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb1c0d1be0 msgr2=0x7fbb1c14a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.269+0000 7fbb23ec2640 1 --2- 172.21.15.44:0/3737631191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb1c0d1be0 0x7fbb1c14a140 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c500 tx=0x7fbb1800c9c0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.269+0000 7fbb23ec2640 1 -- 172.21.15.44:0/3737631191 shutdown_connections 2023-11-04T01:43:41.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.269+0000 7fbb23ec2640 1 --2- 172.21.15.44:0/3737631191 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbb0006aea0 0x7fbb0006d360 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.269+0000 7fbb23ec2640 1 --2- 172.21.15.44:0/3737631191 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb1c15d4e0 0x7fbb1c0cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.269+0000 7fbb23ec2640 1 --2- 172.21.15.44:0/3737631191 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb1c15d100 0x7fbb1c160370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.269+0000 7fbb23ec2640 1 --2- 172.21.15.44:0/3737631191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb1c0d1be0 0x7fbb1c14a140 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.269+0000 7fbb23ec2640 1 -- 172.21.15.44:0/3737631191 >> 172.21.15.44:0/3737631191 conn(0x7fbb1c0d2ef0 msgr2=0x7fbb1c06aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:41.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.269+0000 7fbb23ec2640 1 -- 172.21.15.44:0/3737631191 shutdown_connections 2023-11-04T01:43:41.271 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.269+0000 7fbb23ec2640 1 -- 172.21.15.44:0/3737631191 wait complete. 2023-11-04T01:43:41.281 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:43:41.397 INFO:teuthology.orchestra.run.smithi204.stdout:{"last_snap":12,"last_created":12,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:26.455117+0000","name":"s25","metadata":{}},{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:43:11.476475+0000","name":"s26","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:43:41.397 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 9, "last_snap": 12, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:26.455117+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:43:11.476475+0000" } ] } 2023-11-04T01:43:41.398 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:43:41.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.506+0000 7f311c0e1640 1 Processor -- start 2023-11-04T01:43:41.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.506+0000 7f311c0e1640 1 -- start start 2023-11-04T01:43:41.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.507+0000 7f311c0e1640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f311415ade0 0x7f311406c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.508 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.507+0000 7f311c0e1640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f31140b1440 0x7f3114066010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.507+0000 7f311c0e1640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31140ad6a0 con 0x7f311406b740 2023-11-04T01:43:41.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.507+0000 7f311c0e1640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31140acaf0 con 0x7f31140b1440 2023-11-04T01:43:41.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.507+0000 7f311c0e1640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31140acdd0 con 0x7f311415ade0 2023-11-04T01:43:41.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.507+0000 7f311a67e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f31140b1440 0x7f3114066010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.507+0000 7f311a67e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f31140b1440 0x7f3114066010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37498/0 (socket says 172.21.15.44:37498) 2023-11-04T01:43:41.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.507+0000 7f311a67e640 1 -- 172.21.15.44:0/3262974100 learned_addr learned my addr 172.21.15.44:0/3262974100 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:41.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.507+0000 7f3119e7d640 1 --2- 172.21.15.44:0/3262974100 >> v2:172.21.15.204:3300/0 conn(0x7f311415ade0 0x7f311406c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.508+0000 7f311a67e640 1 -- 172.21.15.44:0/3262974100 >> v2:172.21.15.204:3300/0 conn(0x7f311415ade0 msgr2=0x7f311406c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:41.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.508+0000 7f311a67e640 1 --2- 172.21.15.44:0/3262974100 >> v2:172.21.15.204:3300/0 conn(0x7f311415ade0 0x7f311406c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.508+0000 7f311a67e640 1 -- 172.21.15.44:0/3262974100 >> v1:172.21.15.204:6789/0 conn(0x7f311406b740 legacy=0x7f31140b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:41.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.508+0000 7f311a67e640 1 -- 172.21.15.44:0/3262974100 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31140ad0e0 con 0x7f31140b1440 2023-11-04T01:43:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.508+0000 7f311a67e640 1 --2- 172.21.15.44:0/3262974100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31140b1440 0x7f3114066010 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f31140cc9e0 tx=0x7f311002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e1ddc6e5c8a45a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.508+0000 7f3118e7b640 1 -- 172.21.15.44:0/3262974100 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311002c9f0 con 0x7f31140b1440 2023-11-04T01:43:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.509+0000 7f3118e7b640 1 -- 172.21.15.44:0/3262974100 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311002cb50 con 0x7f31140b1440 2023-11-04T01:43:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.509+0000 7f3118e7b640 1 -- 172.21.15.44:0/3262974100 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31100343f0 con 0x7f31140b1440 2023-11-04T01:43:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.509+0000 7f311c0e1640 1 -- 172.21.15.44:0/3262974100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31140b1440 msgr2=0x7f3114066010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.509+0000 7f311c0e1640 1 --2- 172.21.15.44:0/3262974100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31140b1440 0x7f3114066010 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f31140cc9e0 tx=0x7f311002be50 comp rx=0 tx=0).stop 2023-11-04T01:43:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.509+0000 7f311c0e1640 1 -- 172.21.15.44:0/3262974100 shutdown_connections 2023-11-04T01:43:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.509+0000 7f311c0e1640 1 --2- 172.21.15.44:0/3262974100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31140b1440 0x7f3114066010 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.509+0000 7f311c0e1640 1 --2- 172.21.15.44:0/3262974100 >> v2:172.21.15.204:3300/0 conn(0x7f311415ade0 0x7f311406c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.509+0000 7f311c0e1640 1 -- 172.21.15.44:0/3262974100 >> 172.21.15.44:0/3262974100 conn(0x7f31140cbd30 msgr2=0x7f31140cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.509+0000 7f311c0e1640 1 -- 172.21.15.44:0/3262974100 shutdown_connections 2023-11-04T01:43:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.509+0000 7f311c0e1640 1 -- 172.21.15.44:0/3262974100 wait complete. 2023-11-04T01:43:41.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.510+0000 7f311c0e1640 1 Processor -- start 2023-11-04T01:43:41.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.510+0000 7f311c0e1640 1 -- start start 2023-11-04T01:43:41.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.511+0000 7f311c0e1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f311406b740 0x7f31140cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.511+0000 7f311c0e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31140b1440 0x7f31140714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.511+0000 7f311c0e1640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f311415ade0 0x7f311415d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.511+0000 7f311c0e1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31140cea30 con 0x7f31140b1440 2023-11-04T01:43:41.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.511+0000 7f311c0e1640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31140c4220 con 0x7f311415ade0 2023-11-04T01:43:41.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.511+0000 7f311c0e1640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31140cddb0 con 0x7f311406b740 2023-11-04T01:43:41.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.511+0000 7f311967c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31140b1440 0x7f31140714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.511+0000 7f311967c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31140b1440 0x7f31140714d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37502/0 (socket says 172.21.15.44:37502) 2023-11-04T01:43:41.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.511+0000 7f311967c640 1 -- 172.21.15.44:0/1875591272 learned_addr learned my addr 172.21.15.44:0/1875591272 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:41.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.511+0000 7f311a67e640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f311415ade0 0x7f311415d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.511+0000 7f3119e7d640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f311406b740 0x7f31140cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.511+0000 7f311967c640 1 -- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f311406b740 msgr2=0x7f31140cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.511+0000 7f311967c640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f311406b740 0x7f31140cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.512+0000 7f311967c640 1 -- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f311415ade0 msgr2=0x7f311415d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.512+0000 7f311967c640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f311415ade0 0x7f311415d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.512+0000 7f311967c640 1 -- 172.21.15.44:0/1875591272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3110009b30 con 0x7f31140b1440 2023-11-04T01:43:41.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.512+0000 7f311a67e640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f311415ade0 0x7f311415d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:41.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.512+0000 7f3119e7d640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f311406b740 0x7f31140cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:41.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.512+0000 7f311967c640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31140b1440 0x7f31140714d0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f310400c430 tx=0x7f310400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.512+0000 7f310a7fc640 1 -- 172.21.15.44:0/1875591272 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104011790 con 0x7f31140b1440 2023-11-04T01:43:41.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.512+0000 7f310a7fc640 1 -- 172.21.15.44:0/1875591272 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31040118f0 con 0x7f31140b1440 2023-11-04T01:43:41.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.512+0000 7f311c0e1640 1 -- 172.21.15.44:0/1875591272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31140ce090 con 0x7f31140b1440 2023-11-04T01:43:41.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.512+0000 7f310a7fc640 1 -- 172.21.15.44:0/1875591272 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104011ce0 con 0x7f31140b1440 2023-11-04T01:43:41.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.512+0000 7f311c0e1640 1 -- 172.21.15.44:0/1875591272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31140ce420 con 0x7f31140b1440 2023-11-04T01:43:41.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.513+0000 7f311c0e1640 1 -- 172.21.15.44:0/1875591272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31140cee90 con 0x7f31140b1440 2023-11-04T01:43:41.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.513+0000 7f310a7fc640 1 -- 172.21.15.44:0/1875591272 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f310401c460 con 0x7f31140b1440 2023-11-04T01:43:41.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.514+0000 7f310a7fc640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f30f806ae70 0x7f30f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.514+0000 7f310a7fc640 1 -- 172.21.15.44:0/1875591272 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8010+0+0 (secure 0 0 0) 0x7f3104089ee0 con 0x7f31140b1440 2023-11-04T01:43:41.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.514+0000 7f3119e7d640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f30f806ae70 0x7f30f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.514+0000 7f3119e7d640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f30f806ae70 0x7f30f806d330 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f310c005fd0 tx=0x7f310c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.518+0000 7f310a7fc640 1 -- 172.21.15.44:0/1875591272 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3104054680 con 0x7f31140b1440 2023-11-04T01:43:41.612 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:43:41.611+0000 7f60648e0640 -1 --2- [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] >> [v2:172.21.15.44:6833/2720398401,v1:172.21.15.44:6835/2720398401] conn(0x560367d1bc00 0x560367dc2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.44:6833/2720398401,v1:172.21.15.44:6835/2720398401] is using msgr V1 protocol 2023-11-04T01:43:41.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.767+0000 7f311c0e1640 1 -- 172.21.15.44:0/1875591272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7f31140ce220 con 0x7f31140b1440 2023-11-04T01:43:41.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.769+0000 7f310a7fc640 1 -- 172.21.15.44:0/1875591272 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 8430 v114) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3104057ca0 con 0x7f31140b1440 2023-11-04T01:43:41.770 INFO:teuthology.orchestra.run.smithi044.stderr:failed mds gid 8430 2023-11-04T01:43:41.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.771+0000 7f311c0e1640 1 -- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f30f806ae70 msgr2=0x7f30f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.771+0000 7f311c0e1640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f30f806ae70 0x7f30f806d330 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f310c005fd0 tx=0x7f310c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:41.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.771+0000 7f311c0e1640 1 -- 172.21.15.44:0/1875591272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31140b1440 msgr2=0x7f31140714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.771+0000 7f311c0e1640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31140b1440 0x7f31140714d0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f310400c430 tx=0x7f310400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.771+0000 7f311c0e1640 1 -- 172.21.15.44:0/1875591272 shutdown_connections 2023-11-04T01:43:41.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.771+0000 7f311c0e1640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f30f806ae70 0x7f30f806d330 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.771+0000 7f311c0e1640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f311415ade0 0x7f311415d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.771+0000 7f311c0e1640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31140b1440 0x7f31140714d0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.771+0000 7f311c0e1640 1 --2- 172.21.15.44:0/1875591272 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f311406b740 0x7f31140cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.771+0000 7f311c0e1640 1 -- 172.21.15.44:0/1875591272 >> 172.21.15.44:0/1875591272 conn(0x7f31140cbd30 msgr2=0x7f31140cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:41.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.772+0000 7f311c0e1640 1 -- 172.21.15.44:0/1875591272 shutdown_connections 2023-11-04T01:43:41.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.772+0000 7f311c0e1640 1 -- 172.21.15.44:0/1875591272 wait complete. 2023-11-04T01:43:41.786 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:43:41.786 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:43:41.786 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:43:41.786 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:41.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:43:41.787 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:43:41.787 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:43:41.787 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:43:41.789 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:43:41.790 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:41.869 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2023-11-04T01:43:41.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.896+0000 7f8baffce640 1 Processor -- start 2023-11-04T01:43:41.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.896+0000 7f8baffce640 1 -- start start 2023-11-04T01:43:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.897+0000 7f8baffce640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8ba806d9c0 0x7f8ba80710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.897+0000 7f8baffce640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba806c5f0 0x7f8ba8071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.897+0000 7f8baffce640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba806cc90 con 0x7f8ba80ade00 2023-11-04T01:43:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.897+0000 7f8baffce640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba80b0c40 con 0x7f8ba806d9c0 2023-11-04T01:43:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.897+0000 7f8baffce640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba8071b50 con 0x7f8ba806c5f0 2023-11-04T01:43:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.897+0000 7f8bad569640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8ba806d9c0 0x7f8ba80710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.897+0000 7f8bad569640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8ba806d9c0 0x7f8ba80710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37518/0 (socket says 172.21.15.44:37518) 2023-11-04T01:43:41.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.897+0000 7f8bad569640 1 -- 172.21.15.44:0/3931970180 learned_addr learned my addr 172.21.15.44:0/3931970180 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:41.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.897+0000 7f8bae56b640 1 --2- 172.21.15.44:0/3931970180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba806c5f0 0x7f8ba8071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.898+0000 7f8bad569640 1 -- 172.21.15.44:0/3931970180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba806c5f0 msgr2=0x7f8ba8071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:41.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.898+0000 7f8bad569640 1 --2- 172.21.15.44:0/3931970180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba806c5f0 0x7f8ba8071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.898+0000 7f8bad569640 1 -- 172.21.15.44:0/3931970180 >> v1:172.21.15.204:6789/0 conn(0x7f8ba80ade00 legacy=0x7f8ba80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:41.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.898+0000 7f8bad569640 1 -- 172.21.15.44:0/3931970180 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba80b0e60 con 0x7f8ba806d9c0 2023-11-04T01:43:41.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.898+0000 7f8bae56b640 1 --2- 172.21.15.44:0/3931970180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba806c5f0 0x7f8ba8071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.898+0000 7f8bad569640 1 --2- 172.21.15.44:0/3931970180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ba806d9c0 0x7f8ba80710d0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009870 tx=0x7f8b9802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2af455a9746b7f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.898+0000 7f8bacd68640 1 -- 172.21.15.44:0/3931970180 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98031740 con 0x7f8ba806d9c0 2023-11-04T01:43:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.899+0000 7f8bacd68640 1 -- 172.21.15.44:0/3931970180 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b980318a0 con 0x7f8ba806d9c0 2023-11-04T01:43:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.899+0000 7f8bacd68640 1 -- 172.21.15.44:0/3931970180 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98031c30 con 0x7f8ba806d9c0 2023-11-04T01:43:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.899+0000 7f8baffce640 1 -- 172.21.15.44:0/3931970180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ba806d9c0 msgr2=0x7f8ba80710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.899+0000 7f8baffce640 1 --2- 172.21.15.44:0/3931970180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ba806d9c0 0x7f8ba80710d0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009870 tx=0x7f8b9802b7e0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.899+0000 7f8baffce640 1 -- 172.21.15.44:0/3931970180 shutdown_connections 2023-11-04T01:43:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.899+0000 7f8baffce640 1 --2- 172.21.15.44:0/3931970180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba806c5f0 0x7f8ba8071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.899+0000 7f8baffce640 1 --2- 172.21.15.44:0/3931970180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ba806d9c0 0x7f8ba80710d0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.899+0000 7f8baffce640 1 -- 172.21.15.44:0/3931970180 >> 172.21.15.44:0/3931970180 conn(0x7f8ba80cb530 msgr2=0x7f8ba80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.899+0000 7f8baffce640 1 -- 172.21.15.44:0/3931970180 shutdown_connections 2023-11-04T01:43:41.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.899+0000 7f8baffce640 1 -- 172.21.15.44:0/3931970180 wait complete. 2023-11-04T01:43:41.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.900+0000 7f8baffce640 1 Processor -- start 2023-11-04T01:43:41.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.900+0000 7f8baffce640 1 -- start start 2023-11-04T01:43:41.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8baffce640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba806c5f0 0x7f8ba81e4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8baffce640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ba806d9c0 0x7f8ba81e5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8baffce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ba80ade00 0x7f8ba81e61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8baffce640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80c62a0 con 0x7f8ba80ade00 2023-11-04T01:43:41.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8baffce640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80c5f00 con 0x7f8ba806d9c0 2023-11-04T01:43:41.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8baffce640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba81e4b90 con 0x7f8ba806c5f0 2023-11-04T01:43:41.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8bae56b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ba80ade00 0x7f8ba81e61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8bae56b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ba80ade00 0x7f8ba81e61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37532/0 (socket says 172.21.15.44:37532) 2023-11-04T01:43:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8bae56b640 1 -- 172.21.15.44:0/3072889204 learned_addr learned my addr 172.21.15.44:0/3072889204 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8bad569640 1 --2- 172.21.15.44:0/3072889204 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ba806d9c0 0x7f8ba81e5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8badd6a640 1 --2- 172.21.15.44:0/3072889204 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba806c5f0 0x7f8ba81e4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8bae56b640 1 -- 172.21.15.44:0/3072889204 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba806c5f0 msgr2=0x7f8ba81e4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8bae56b640 1 --2- 172.21.15.44:0/3072889204 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba806c5f0 0x7f8ba81e4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8bae56b640 1 -- 172.21.15.44:0/3072889204 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ba806d9c0 msgr2=0x7f8ba81e5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8bae56b640 1 --2- 172.21.15.44:0/3072889204 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ba806d9c0 0x7f8ba81e5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.901+0000 7f8bae56b640 1 -- 172.21.15.44:0/3072889204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b980094d0 con 0x7f8ba80ade00 2023-11-04T01:43:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.902+0000 7f8badd6a640 1 --2- 172.21.15.44:0/3072889204 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba806c5f0 0x7f8ba81e4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.902+0000 7f8bae56b640 1 --2- 172.21.15.44:0/3072889204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ba80ade00 0x7f8ba81e61e0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000c7c0 tx=0x7f8ba000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.902+0000 7f8b9e7fc640 1 -- 172.21.15.44:0/3072889204 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0004230 con 0x7f8ba80ade00 2023-11-04T01:43:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.902+0000 7f8b9e7fc640 1 -- 172.21.15.44:0/3072889204 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba0004390 con 0x7f8ba80ade00 2023-11-04T01:43:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.902+0000 7f8baffce640 1 -- 172.21.15.44:0/3072889204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba81e4e70 con 0x7f8ba80ade00 2023-11-04T01:43:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.902+0000 7f8b9e7fc640 1 -- 172.21.15.44:0/3072889204 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0007860 con 0x7f8ba80ade00 2023-11-04T01:43:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.902+0000 7f8baffce640 1 -- 172.21.15.44:0/3072889204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba815d050 con 0x7f8ba80ade00 2023-11-04T01:43:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.903+0000 7f8baffce640 1 -- 172.21.15.44:0/3072889204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba80c23d0 con 0x7f8ba80ade00 2023-11-04T01:43:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.903+0000 7f8b9e7fc640 1 -- 172.21.15.44:0/3072889204 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8ba00079c0 con 0x7f8ba80ade00 2023-11-04T01:43:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.904+0000 7f8b9e7fc640 1 --2- 172.21.15.44:0/3072889204 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b8c06aea0 0x7f8b8c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.904+0000 7f8b9e7fc640 1 -- 172.21.15.44:0/3072889204 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8096+0+0 (secure 0 0 0) 0x7f8ba008a170 con 0x7f8ba80ade00 2023-11-04T01:43:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.904+0000 7f8badd6a640 1 --2- 172.21.15.44:0/3072889204 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b8c06aea0 0x7f8b8c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.904+0000 7f8badd6a640 1 --2- 172.21.15.44:0/3072889204 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b8c06aea0 0x7f8b8c06d360 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4004520 tx=0x7f8ba4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:41.908+0000 7f8b9e7fc640 1 -- 172.21.15.44:0/3072889204 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8ba0054a20 con 0x7f8ba80ade00 2023-11-04T01:43:42.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:42.122+0000 7f8baffce640 1 -- 172.21.15.44:0/3072889204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ba80c63e0 con 0x7f8ba80ade00 2023-11-04T01:43:42.124 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:42.123+0000 7f8b9e7fc640 1 -- 172.21.15.44:0/3072889204 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4146 (secure 0 0 0) 0x7f8ba80c63e0 con 0x7f8ba80ade00 2023-11-04T01:43:42.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:42.125 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":115,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:41.773061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:resolve","state_seq":12,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8703":{"gid":8703,"name":"c","rank":1,"incarnation":115,"state":"up:replay","state_seq":1,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:42.126 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 115 2023-11-04T01:43:42.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:42.124+0000 7f8baffce640 1 -- 172.21.15.44:0/3072889204 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b8c06aea0 msgr2=0x7f8b8c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:42.124+0000 7f8baffce640 1 --2- 172.21.15.44:0/3072889204 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b8c06aea0 0x7f8b8c06d360 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4004520 tx=0x7f8ba4009040 comp rx=0 tx=0).stop 2023-11-04T01:43:42.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:42.124+0000 7f8baffce640 1 -- 172.21.15.44:0/3072889204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ba80ade00 msgr2=0x7f8ba81e61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:42.124+0000 7f8baffce640 1 --2- 172.21.15.44:0/3072889204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ba80ade00 0x7f8ba81e61e0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000c7c0 tx=0x7f8ba000cc80 comp rx=0 tx=0).stop 2023-11-04T01:43:42.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:42.124+0000 7f8baffce640 1 -- 172.21.15.44:0/3072889204 shutdown_connections 2023-11-04T01:43:42.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:42.125+0000 7f8baffce640 1 --2- 172.21.15.44:0/3072889204 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8b8c06aea0 0x7f8b8c06d360 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:42.125+0000 7f8baffce640 1 --2- 172.21.15.44:0/3072889204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ba80ade00 0x7f8ba81e61e0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:42.125+0000 7f8baffce640 1 --2- 172.21.15.44:0/3072889204 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ba806d9c0 0x7f8ba81e5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:42.125+0000 7f8baffce640 1 --2- 172.21.15.44:0/3072889204 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba806c5f0 0x7f8ba81e4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:42.125+0000 7f8baffce640 1 -- 172.21.15.44:0/3072889204 >> 172.21.15.44:0/3072889204 conn(0x7f8ba80cb530 msgr2=0x7f8ba80b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:42.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:42.125+0000 7f8baffce640 1 -- 172.21.15.44:0/3072889204 shutdown_connections 2023-11-04T01:43:42.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:42.125+0000 7f8baffce640 1 -- 172.21.15.44:0/3072889204 wait complete. 2023-11-04T01:43:42.136 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:43:46.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:43:47.138 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:47.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.254+0000 7fed17941640 1 Processor -- start 2023-11-04T01:43:47.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.254+0000 7fed17941640 1 -- start start 2023-11-04T01:43:47.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.255+0000 7fed17941640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fed1015d1b0 0x7fed100b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.255+0000 7fed17941640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fed100b1440 0x7fed1006a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.255+0000 7fed17941640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed100b2310 con 0x7fed1006c240 2023-11-04T01:43:47.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.255+0000 7fed17941640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1006cbe0 con 0x7fed100b1440 2023-11-04T01:43:47.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.255+0000 7fed17941640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed100b2100 con 0x7fed1015d1b0 2023-11-04T01:43:47.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.255+0000 7fed15ede640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fed100b1440 0x7fed1006a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.256+0000 7fed14edc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fed1006c240 0x7fed100b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57504/0 (socket says 172.21.15.44:57504) 2023-11-04T01:43:47.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.256+0000 7fed14edc640 1 -- 172.21.15.44:0/1685821957 learned_addr learned my addr 172.21.15.44:0/1685821957 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:47.258 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.256+0000 7fed156dd640 1 --2- 172.21.15.44:0/1685821957 >> v2:172.21.15.204:3300/0 conn(0x7fed1015d1b0 0x7fed100b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.256+0000 7fed15ede640 1 -- 172.21.15.44:0/1685821957 >> v2:172.21.15.204:3300/0 conn(0x7fed1015d1b0 msgr2=0x7fed100b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:47.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.256+0000 7fed15ede640 1 --2- 172.21.15.44:0/1685821957 >> v2:172.21.15.204:3300/0 conn(0x7fed1015d1b0 0x7fed100b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.256+0000 7fed15ede640 1 -- 172.21.15.44:0/1685821957 >> v1:172.21.15.44:6789/0 conn(0x7fed1006c240 legacy=0x7fed100b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.256+0000 7fed15ede640 1 -- 172.21.15.44:0/1685821957 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed100b25f0 con 0x7fed100b1440 2023-11-04T01:43:47.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.256+0000 7fed0ffff640 1 -- 172.21.15.44:0/1685821957 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083399574 0 0) 0x7fed100b2310 con 0x7fed1006c240 2023-11-04T01:43:47.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.257+0000 7fed15ede640 1 --2- 172.21.15.44:0/1685821957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed100b1440 0x7fed1006a0d0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fed100b1b80 tx=0x7fed0002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be69112d4e2c1028 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.257+0000 7fed0ffff640 1 -- 172.21.15.44:0/1685821957 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0002cd00 con 0x7fed100b1440 2023-11-04T01:43:47.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.257+0000 7fed0ffff640 1 -- 172.21.15.44:0/1685821957 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0002ce60 con 0x7fed100b1440 2023-11-04T01:43:47.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.257+0000 7fed0ffff640 1 -- 172.21.15.44:0/1685821957 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed00034660 con 0x7fed100b1440 2023-11-04T01:43:47.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.257+0000 7fed17941640 1 -- 172.21.15.44:0/1685821957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed100b1440 msgr2=0x7fed1006a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.257+0000 7fed17941640 1 --2- 172.21.15.44:0/1685821957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed100b1440 0x7fed1006a0d0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fed100b1b80 tx=0x7fed0002bf50 comp rx=0 tx=0).stop 2023-11-04T01:43:47.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.257+0000 7fed17941640 1 -- 172.21.15.44:0/1685821957 shutdown_connections 2023-11-04T01:43:47.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.257+0000 7fed17941640 1 --2- 172.21.15.44:0/1685821957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed100b1440 0x7fed1006a0d0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.257+0000 7fed17941640 1 --2- 172.21.15.44:0/1685821957 >> v2:172.21.15.204:3300/0 conn(0x7fed1015d1b0 0x7fed100b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.257+0000 7fed17941640 1 -- 172.21.15.44:0/1685821957 >> 172.21.15.44:0/1685821957 conn(0x7fed100cbd30 msgr2=0x7fed100cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:47.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.258+0000 7fed17941640 1 -- 172.21.15.44:0/1685821957 shutdown_connections 2023-11-04T01:43:47.261 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.258+0000 7fed17941640 1 -- 172.21.15.44:0/1685821957 wait complete. 2023-11-04T01:43:47.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.259+0000 7fed17941640 1 Processor -- start 2023-11-04T01:43:47.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.259+0000 7fed17941640 1 -- start start 2023-11-04T01:43:47.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed17941640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed1006c240 0x7fed10099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed17941640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed100b1440 0x7fed100cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed17941640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed1015d1b0 0x7fed1014e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed17941640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1015bbe0 con 0x7fed1006c240 2023-11-04T01:43:47.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed17941640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1014eb50 con 0x7fed1015d1b0 2023-11-04T01:43:47.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed17941640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1009a0c0 con 0x7fed100b1440 2023-11-04T01:43:47.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed156dd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed1006c240 0x7fed10099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed156dd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed1006c240 0x7fed10099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46156/0 (socket says 172.21.15.44:46156) 2023-11-04T01:43:47.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed156dd640 1 -- 172.21.15.44:0/1735506456 learned_addr learned my addr 172.21.15.44:0/1735506456 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:47.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed14edc640 1 --2- 172.21.15.44:0/1735506456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed100b1440 0x7fed100cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed15ede640 1 --2- 172.21.15.44:0/1735506456 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed1015d1b0 0x7fed1014e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.263 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed156dd640 1 -- 172.21.15.44:0/1735506456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed100b1440 msgr2=0x7fed100cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed156dd640 1 --2- 172.21.15.44:0/1735506456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed100b1440 0x7fed100cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed156dd640 1 -- 172.21.15.44:0/1735506456 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed1015d1b0 msgr2=0x7fed1014e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed156dd640 1 --2- 172.21.15.44:0/1735506456 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed1015d1b0 0x7fed1014e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed156dd640 1 -- 172.21.15.44:0/1735506456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed00009a70 con 0x7fed1006c240 2023-11-04T01:43:47.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed156dd640 1 --2- 172.21.15.44:0/1735506456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed1006c240 0x7fed10099a50 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fed0800d7d0 tx=0x7fed0800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.260+0000 7fed0dffb640 1 -- 172.21.15.44:0/1735506456 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080096c0 con 0x7fed1006c240 2023-11-04T01:43:47.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.261+0000 7fed0dffb640 1 -- 172.21.15.44:0/1735506456 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed08009820 con 0x7fed1006c240 2023-11-04T01:43:47.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.261+0000 7fed17941640 1 -- 172.21.15.44:0/1735506456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1009a3a0 con 0x7fed1006c240 2023-11-04T01:43:47.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.261+0000 7fed0dffb640 1 -- 172.21.15.44:0/1735506456 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08009bd0 con 0x7fed1006c240 2023-11-04T01:43:47.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.261+0000 7fed17941640 1 -- 172.21.15.44:0/1735506456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1009a960 con 0x7fed1006c240 2023-11-04T01:43:47.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.262+0000 7fed17941640 1 -- 172.21.15.44:0/1735506456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed10066600 con 0x7fed1006c240 2023-11-04T01:43:47.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.262+0000 7fed0dffb640 1 -- 172.21.15.44:0/1735506456 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed08009d30 con 0x7fed1006c240 2023-11-04T01:43:47.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.263+0000 7fed0dffb640 1 --2- 172.21.15.44:0/1735506456 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fecfc06ae70 0x7fecfc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.263+0000 7fed0dffb640 1 -- 172.21.15.44:0/1735506456 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8096+0+0 (secure 0 0 0) 0x7fed0808a5e0 con 0x7fed1006c240 2023-11-04T01:43:47.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.263+0000 7fed14edc640 1 --2- 172.21.15.44:0/1735506456 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fecfc06ae70 0x7fecfc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.266 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.264+0000 7fed14edc640 1 --2- 172.21.15.44:0/1735506456 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fecfc06ae70 0x7fecfc06d330 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fed100cfe60 tx=0x7fed04007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.269 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.267+0000 7fed0dffb640 1 -- 172.21.15.44:0/1735506456 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fed08054e80 con 0x7fed1006c240 2023-11-04T01:43:47.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.483+0000 7fed17941640 1 -- 172.21.15.44:0/1735506456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed100684b0 con 0x7fed1006c240 2023-11-04T01:43:47.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.484+0000 7fed0dffb640 1 -- 172.21.15.44:0/1735506456 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4940 (secure 0 0 0) 0x7fed080584a0 con 0x7fed1006c240 2023-11-04T01:43:47.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:47.486 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":117,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/830347539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":830347539},{"type":"v1","addr":"172.21.15.44:6835","nonce":830347539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:42.786827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8703":{"gid":8703,"name":"c","rank":1,"incarnation":115,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:47.486 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 117 2023-11-04T01:43:47.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.486+0000 7fed17941640 1 -- 172.21.15.44:0/1735506456 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fecfc06ae70 msgr2=0x7fecfc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.486+0000 7fed17941640 1 --2- 172.21.15.44:0/1735506456 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fecfc06ae70 0x7fecfc06d330 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fed100cfe60 tx=0x7fed04007d50 comp rx=0 tx=0).stop 2023-11-04T01:43:47.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.486+0000 7fed17941640 1 -- 172.21.15.44:0/1735506456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed1006c240 msgr2=0x7fed10099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.486+0000 7fed17941640 1 --2- 172.21.15.44:0/1735506456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed1006c240 0x7fed10099a50 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fed0800d7d0 tx=0x7fed0800dc90 comp rx=0 tx=0).stop 2023-11-04T01:43:47.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.486+0000 7fed17941640 1 -- 172.21.15.44:0/1735506456 shutdown_connections 2023-11-04T01:43:47.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.486+0000 7fed17941640 1 --2- 172.21.15.44:0/1735506456 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fecfc06ae70 0x7fecfc06d330 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.486+0000 7fed17941640 1 --2- 172.21.15.44:0/1735506456 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed1015d1b0 0x7fed1014e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.486+0000 7fed17941640 1 --2- 172.21.15.44:0/1735506456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed100b1440 0x7fed100cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.486+0000 7fed17941640 1 --2- 172.21.15.44:0/1735506456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed1006c240 0x7fed10099a50 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.486+0000 7fed17941640 1 -- 172.21.15.44:0/1735506456 >> 172.21.15.44:0/1735506456 conn(0x7fed100cbd30 msgr2=0x7fed10071550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:47.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.486+0000 7fed17941640 1 -- 172.21.15.44:0/1735506456 shutdown_connections 2023-11-04T01:43:47.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.486+0000 7fed17941640 1 -- 172.21.15.44:0/1735506456 wait complete. 2023-11-04T01:43:47.499 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:43:47.499 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:47.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.602+0000 7f8fbb905640 1 Processor -- start 2023-11-04T01:43:47.604 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.603+0000 7f8fbb905640 1 -- start start 2023-11-04T01:43:47.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.603+0000 7f8fbb905640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8fb415d100 0x7f8fb40ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.603+0000 7f8fbb905640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb40d1be0 0x7f8fb40b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.603+0000 7f8fbb905640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb40b32b0 con 0x7f8fb415d4e0 2023-11-04T01:43:47.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.603+0000 7f8fbb905640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb40cee10 con 0x7f8fb415d100 2023-11-04T01:43:47.605 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.603+0000 7f8fbb905640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40b2980 con 0x7f8fb40d1be0 2023-11-04T01:43:47.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.604+0000 7f8fb96a1640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8fb415d100 0x7f8fb40ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.604+0000 7f8fb9ea2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb40d1be0 0x7f8fb40b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.604+0000 7f8fb9ea2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb40d1be0 0x7f8fb40b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:33746/0 (socket says 172.21.15.44:33746) 2023-11-04T01:43:47.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.604+0000 7f8fb96a1640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8fb415d100 0x7f8fb40ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:54492/0 (socket says 172.21.15.44:54492) 2023-11-04T01:43:47.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.604+0000 7f8fb8ea0640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f8fb415d4e0 0x7f8fb40d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:51754/0 (socket says 172.21.15.44:51754) 2023-11-04T01:43:47.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.604+0000 7f8fb9ea2640 1 -- 172.21.15.44:0/3549555418 learned_addr learned my addr 172.21.15.44:0/3549555418 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:47.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.604+0000 7f8fb9ea2640 1 -- 172.21.15.44:0/3549555418 >> v2:172.21.15.204:3300/0 conn(0x7f8fb415d100 msgr2=0x7f8fb40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:47.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.604+0000 7f8fb9ea2640 1 --2- 172.21.15.44:0/3549555418 >> v2:172.21.15.204:3300/0 conn(0x7f8fb415d100 0x7f8fb40ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.607 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.604+0000 7f8fb9ea2640 1 -- 172.21.15.44:0/3549555418 >> v1:172.21.15.204:6789/0 conn(0x7f8fb415d4e0 legacy=0x7f8fb40d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.604+0000 7f8fb9ea2640 1 -- 172.21.15.44:0/3549555418 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40b2c60 con 0x7f8fb40d1be0 2023-11-04T01:43:47.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.604+0000 7f8fb96a1640 1 --2- 172.21.15.44:0/3549555418 >> v2:172.21.15.204:3300/0 conn(0x7f8fb415d100 0x7f8fb40ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:47.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.605+0000 7f8fb9ea2640 1 --2- 172.21.15.44:0/3549555418 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb40d1be0 0x7f8fb40b3740 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8fac009e50 tx=0x7f8fac02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79bb85e6a5bbaee3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.605+0000 7f8fabfff640 1 -- 172.21.15.44:0/3549555418 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac02cb00 con 0x7f8fb40d1be0 2023-11-04T01:43:47.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.605+0000 7f8fabfff640 1 -- 172.21.15.44:0/3549555418 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac02cc60 con 0x7f8fb40d1be0 2023-11-04T01:43:47.608 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.605+0000 7f8fabfff640 1 -- 172.21.15.44:0/3549555418 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac0343f0 con 0x7f8fb40d1be0 2023-11-04T01:43:47.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.606+0000 7f8fbb905640 1 -- 172.21.15.44:0/3549555418 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb40d1be0 msgr2=0x7f8fb40b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.606+0000 7f8fbb905640 1 --2- 172.21.15.44:0/3549555418 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb40d1be0 0x7f8fb40b3740 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8fac009e50 tx=0x7f8fac02bf60 comp rx=0 tx=0).stop 2023-11-04T01:43:47.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.606+0000 7f8fbb905640 1 -- 172.21.15.44:0/3549555418 shutdown_connections 2023-11-04T01:43:47.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.606+0000 7f8fbb905640 1 --2- 172.21.15.44:0/3549555418 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb40d1be0 0x7f8fb40b3740 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.606+0000 7f8fbb905640 1 --2- 172.21.15.44:0/3549555418 >> v2:172.21.15.204:3300/0 conn(0x7f8fb415d100 0x7f8fb40ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.606+0000 7f8fbb905640 1 -- 172.21.15.44:0/3549555418 >> 172.21.15.44:0/3549555418 conn(0x7f8fb40d2ef0 msgr2=0x7f8fb40d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:47.609 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.606+0000 7f8fbb905640 1 -- 172.21.15.44:0/3549555418 shutdown_connections 2023-11-04T01:43:47.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.606+0000 7f8fbb905640 1 -- 172.21.15.44:0/3549555418 wait complete. 2023-11-04T01:43:47.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.607+0000 7f8fbb905640 1 Processor -- start 2023-11-04T01:43:47.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.607+0000 7f8fbb905640 1 -- start start 2023-11-04T01:43:47.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fbb905640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb40d1be0 0x7f8fb41565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fbb905640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb415d100 0x7f8fb415f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fbb905640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb415d4e0 0x7f8fb40cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fbb905640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb41604c0 con 0x7f8fb40d1be0 2023-11-04T01:43:47.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fbb905640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40b6980 con 0x7f8fb415d4e0 2023-11-04T01:43:47.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fbb905640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb415f840 con 0x7f8fb415d100 2023-11-04T01:43:47.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fb96a1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb40d1be0 0x7f8fb41565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fb96a1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb40d1be0 0x7f8fb41565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46172/0 (socket says 172.21.15.44:46172) 2023-11-04T01:43:47.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fb96a1640 1 -- 172.21.15.44:0/1054319660 learned_addr learned my addr 172.21.15.44:0/1054319660 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:47.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fb9ea2640 1 --2- 172.21.15.44:0/1054319660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb415d4e0 0x7f8fb40cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.612 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fb8ea0640 1 --2- 172.21.15.44:0/1054319660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb415d100 0x7f8fb415f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fb96a1640 1 -- 172.21.15.44:0/1054319660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb415d100 msgr2=0x7f8fb415f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fb96a1640 1 --2- 172.21.15.44:0/1054319660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb415d100 0x7f8fb415f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fb96a1640 1 -- 172.21.15.44:0/1054319660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb415d4e0 msgr2=0x7f8fb40cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fb96a1640 1 --2- 172.21.15.44:0/1054319660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb415d4e0 0x7f8fb40cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fb96a1640 1 -- 172.21.15.44:0/1054319660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb00093a0 con 0x7f8fb40d1be0 2023-11-04T01:43:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.608+0000 7f8fb8ea0640 1 --2- 172.21.15.44:0/1054319660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb415d100 0x7f8fb415f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.609+0000 7f8fb96a1640 1 --2- 172.21.15.44:0/1054319660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb40d1be0 0x7f8fb41565e0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000ebe0 tx=0x7f8fb000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.609+0000 7f8fa9ffb640 1 -- 172.21.15.44:0/1054319660 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0009750 con 0x7f8fb40d1be0 2023-11-04T01:43:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.609+0000 7f8fa9ffb640 1 -- 172.21.15.44:0/1054319660 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb000cc30 con 0x7f8fb40d1be0 2023-11-04T01:43:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.609+0000 7f8fbb905640 1 -- 172.21.15.44:0/1054319660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fac009b30 con 0x7f8fb40d1be0 2023-11-04T01:43:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.609+0000 7f8fa9ffb640 1 -- 172.21.15.44:0/1054319660 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb000eee0 con 0x7f8fb40d1be0 2023-11-04T01:43:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.609+0000 7f8fbb905640 1 -- 172.21.15.44:0/1054319660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb415fe00 con 0x7f8fb40d1be0 2023-11-04T01:43:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.610+0000 7f8fbb905640 1 -- 172.21.15.44:0/1054319660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb40b6c40 con 0x7f8fb40d1be0 2023-11-04T01:43:47.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.610+0000 7f8fa9ffb640 1 -- 172.21.15.44:0/1054319660 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8fb0005990 con 0x7f8fb40d1be0 2023-11-04T01:43:47.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.611+0000 7f8fa9ffb640 1 --2- 172.21.15.44:0/1054319660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f9806ae70 0x7f8f9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.611+0000 7f8fa9ffb640 1 -- 172.21.15.44:0/1054319660 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8096+0+0 (secure 0 0 0) 0x7f8fb008a3e0 con 0x7f8fb40d1be0 2023-11-04T01:43:47.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.611+0000 7f8fb8ea0640 1 --2- 172.21.15.44:0/1054319660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f9806ae70 0x7f8f9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.614 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.612+0000 7f8fb8ea0640 1 --2- 172.21.15.44:0/1054319660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f9806ae70 0x7f8f9806d330 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4007fd0 tx=0x7f8fa4007d40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.617 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.615+0000 7f8fa9ffb640 1 -- 172.21.15.44:0/1054319660 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8fb0054c00 con 0x7f8fb40d1be0 2023-11-04T01:43:47.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.826+0000 7f8fbb905640 1 -- 172.21.15.44:0/1054319660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fb40684b0 con 0x7f8fb40d1be0 2023-11-04T01:43:47.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.827+0000 7f8fa9ffb640 1 -- 172.21.15.44:0/1054319660 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4940 (secure 0 0 0) 0x7f8fb0020020 con 0x7f8fb40d1be0 2023-11-04T01:43:47.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:47.829 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":117,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/830347539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":830347539},{"type":"v1","addr":"172.21.15.44:6835","nonce":830347539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:42.786827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8703":{"gid":8703,"name":"c","rank":1,"incarnation":115,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:47.829 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 117 2023-11-04T01:43:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.828+0000 7f8fbb905640 1 -- 172.21.15.44:0/1054319660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f9806ae70 msgr2=0x7f8f9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.828+0000 7f8fbb905640 1 --2- 172.21.15.44:0/1054319660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f9806ae70 0x7f8f9806d330 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4007fd0 tx=0x7f8fa4007d40 comp rx=0 tx=0).stop 2023-11-04T01:43:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.828+0000 7f8fbb905640 1 -- 172.21.15.44:0/1054319660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb40d1be0 msgr2=0x7f8fb41565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.828+0000 7f8fbb905640 1 --2- 172.21.15.44:0/1054319660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb40d1be0 0x7f8fb41565e0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000ebe0 tx=0x7f8fb000c520 comp rx=0 tx=0).stop 2023-11-04T01:43:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.829+0000 7f8fbb905640 1 -- 172.21.15.44:0/1054319660 shutdown_connections 2023-11-04T01:43:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.829+0000 7f8fbb905640 1 --2- 172.21.15.44:0/1054319660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f9806ae70 0x7f8f9806d330 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.829+0000 7f8fbb905640 1 --2- 172.21.15.44:0/1054319660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb415d4e0 0x7f8fb40cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.829+0000 7f8fbb905640 1 --2- 172.21.15.44:0/1054319660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb415d100 0x7f8fb415f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.829+0000 7f8fbb905640 1 --2- 172.21.15.44:0/1054319660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb40d1be0 0x7f8fb41565e0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.829+0000 7f8fbb905640 1 -- 172.21.15.44:0/1054319660 >> 172.21.15.44:0/1054319660 conn(0x7f8fb40d2ef0 msgr2=0x7f8fb40d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.829+0000 7f8fbb905640 1 -- 172.21.15.44:0/1054319660 shutdown_connections 2023-11-04T01:43:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:47.829+0000 7f8fbb905640 1 -- 172.21.15.44:0/1054319660 wait complete. 2023-11-04T01:43:47.841 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:43:48.842 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:48.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.958+0000 7effacec9640 1 Processor -- start 2023-11-04T01:43:48.960 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.958+0000 7effacec9640 1 -- start start 2023-11-04T01:43:48.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.959+0000 7effacec9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7effa80d1be0 0x7effa8167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.959+0000 7effacec9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa80b32b0 con 0x7effa815d100 2023-11-04T01:43:48.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.959+0000 7effacec9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa80cee10 con 0x7effa815d4e0 2023-11-04T01:43:48.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.959+0000 7effacec9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa80cec20 con 0x7effa80d1be0 2023-11-04T01:43:48.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa659c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7effa815d100 0x7effa80ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57510/0 (socket says 172.21.15.44:57510) 2023-11-04T01:43:48.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa659c640 1 -- 172.21.15.44:0/3478774388 learned_addr learned my addr 172.21.15.44:0/3478774388 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:48.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa559a640 1 -- 172.21.15.44:0/3478774388 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245211645 0 0) 0x7effa80b32b0 con 0x7effa815d100 2023-11-04T01:43:48.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa559a640 1 -- 172.21.15.44:0/3478774388 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff90003520 con 0x7effa815d100 2023-11-04T01:43:48.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa6d9d640 1 --2- 172.21.15.44:0/3478774388 >> v2:172.21.15.204:3300/0 conn(0x7effa80d1be0 0x7effa8167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa559a640 1 -- 172.21.15.44:0/3478774388 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1838239350 0 0) 0x7eff90003520 con 0x7effa815d100 2023-11-04T01:43:48.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa559a640 1 -- 172.21.15.44:0/3478774388 >> v2:172.21.15.204:3300/0 conn(0x7effa80d1be0 msgr2=0x7effa8167e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:48.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa559a640 1 --2- 172.21.15.44:0/3478774388 >> v2:172.21.15.204:3300/0 conn(0x7effa80d1be0 0x7effa8167e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa559a640 1 -- 172.21.15.44:0/3478774388 >> v1:172.21.15.204:6789/0 conn(0x7effa815d4e0 legacy=0x7effa80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa559a640 1 -- 172.21.15.44:0/3478774388 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa80b4750 con 0x7effa815d100 2023-11-04T01:43:48.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa559a640 1 -- 172.21.15.44:0/3478774388 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7eff980017f0 con 0x7effa815d100 2023-11-04T01:43:48.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa559a640 1 -- 172.21.15.44:0/3478774388 >> v1:172.21.15.44:6789/0 conn(0x7effa815d100 legacy=0x7effa80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa559a640 1 --2- 172.21.15.44:0/3478774388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff90003970 0x7eff90003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa559a640 1 --2- 172.21.15.44:0/3478774388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff900047c0 0x7eff90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa559a640 1 --2- 172.21.15.44:0/3478774388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff90005180 0x7eff9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa559a640 1 -- 172.21.15.44:0/3478774388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9000bff0 con 0x7eff900047c0 2023-11-04T01:43:48.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa559a640 1 -- 172.21.15.44:0/3478774388 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9000c160 con 0x7eff90003970 2023-11-04T01:43:48.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.960+0000 7effa559a640 1 -- 172.21.15.44:0/3478774388 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9000c320 con 0x7eff90005180 2023-11-04T01:43:48.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.961+0000 7effa5d9b640 1 --2- 172.21.15.44:0/3478774388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff900047c0 0x7eff90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.961+0000 7effa659c640 1 --2- 172.21.15.44:0/3478774388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff90003970 0x7eff90003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.961+0000 7effa6d9d640 1 --2- 172.21.15.44:0/3478774388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff90005180 0x7eff9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.961+0000 7effa5d9b640 1 -- 172.21.15.44:0/3478774388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff90005180 msgr2=0x7eff9000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:48.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.961+0000 7effa5d9b640 1 --2- 172.21.15.44:0/3478774388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff90005180 0x7eff9000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.961+0000 7effa5d9b640 1 -- 172.21.15.44:0/3478774388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff90003970 msgr2=0x7eff90003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:48.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.961+0000 7effa5d9b640 1 --2- 172.21.15.44:0/3478774388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff90003970 0x7eff90003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.961+0000 7effa5d9b640 1 -- 172.21.15.44:0/3478774388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff90003520 con 0x7eff900047c0 2023-11-04T01:43:48.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.961+0000 7effa6d9d640 1 -- 172.21.15.44:0/3478774388 reap_dead start 2023-11-04T01:43:48.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.962+0000 7effa5d9b640 1 --2- 172.21.15.44:0/3478774388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff900047c0 0x7eff90004c40 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7eff9c001720 tx=0x7eff900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c799cada6545cfe4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:48.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.962+0000 7effa559a640 1 -- 172.21.15.44:0/3478774388 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0052d0 con 0x7eff900047c0 2023-11-04T01:43:48.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.962+0000 7effa559a640 1 -- 172.21.15.44:0/3478774388 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c02e050 con 0x7eff900047c0 2023-11-04T01:43:48.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.962+0000 7effa559a640 1 -- 172.21.15.44:0/3478774388 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c003830 con 0x7eff900047c0 2023-11-04T01:43:48.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.962+0000 7effacec9640 1 -- 172.21.15.44:0/3478774388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff900047c0 msgr2=0x7eff90004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.962+0000 7effacec9640 1 --2- 172.21.15.44:0/3478774388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff900047c0 0x7eff90004c40 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7eff9c001720 tx=0x7eff900057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.962+0000 7effacec9640 1 -- 172.21.15.44:0/3478774388 shutdown_connections 2023-11-04T01:43:48.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.962+0000 7effacec9640 1 --2- 172.21.15.44:0/3478774388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff900047c0 0x7eff90004c40 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.962+0000 7effacec9640 1 -- 172.21.15.44:0/3478774388 >> 172.21.15.44:0/3478774388 conn(0x7effa80d2ef0 msgr2=0x7effa80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:48.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.962+0000 7effacec9640 1 -- 172.21.15.44:0/3478774388 shutdown_connections 2023-11-04T01:43:48.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.962+0000 7effacec9640 1 -- 172.21.15.44:0/3478774388 wait complete. 2023-11-04T01:43:48.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.964+0000 7effacec9640 1 Processor -- start 2023-11-04T01:43:48.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.964+0000 7effacec9640 1 -- start start 2023-11-04T01:43:48.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effacec9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff900047c0 0x7effa80c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effacec9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effa81f6a00 0x7effa80b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effacec9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa80b7170 0x7effa815fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effacec9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa80b78f0 con 0x7effa80b7170 2023-11-04T01:43:48.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effacec9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa81f6570 con 0x7effa81f6a00 2023-11-04T01:43:48.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effacec9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa80b7610 con 0x7eff900047c0 2023-11-04T01:43:48.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effa6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa80b7170 0x7effa815fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effa6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa80b7170 0x7effa815fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46198/0 (socket says 172.21.15.44:46198) 2023-11-04T01:43:48.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effa6d9d640 1 -- 172.21.15.44:0/4245384025 learned_addr learned my addr 172.21.15.44:0/4245384025 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:48.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effa659c640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff900047c0 0x7effa80c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effa5d9b640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effa81f6a00 0x7effa80b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effa6d9d640 1 -- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff900047c0 msgr2=0x7effa80c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effa6d9d640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff900047c0 0x7effa80c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effa6d9d640 1 -- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effa81f6a00 msgr2=0x7effa80b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effa6d9d640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effa81f6a00 0x7effa80b6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effa6d9d640 1 -- 172.21.15.44:0/4245384025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa81f5f20 con 0x7effa80b7170 2023-11-04T01:43:48.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effa5d9b640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effa81f6a00 0x7effa80b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:48.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effa659c640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff900047c0 0x7effa80c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:48.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effa6d9d640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa80b7170 0x7effa815fb10 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7effa815d8c0 tx=0x7effa000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:48.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7eff96ffd640 1 -- 172.21.15.44:0/4245384025 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa000e040 con 0x7effa80b7170 2023-11-04T01:43:48.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7eff96ffd640 1 -- 172.21.15.44:0/4245384025 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa000f040 con 0x7effa80b7170 2023-11-04T01:43:48.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7eff96ffd640 1 -- 172.21.15.44:0/4245384025 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0015430 con 0x7effa80b7170 2023-11-04T01:43:48.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.965+0000 7effacec9640 1 -- 172.21.15.44:0/4245384025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa81f6200 con 0x7effa80b7170 2023-11-04T01:43:48.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.966+0000 7effacec9640 1 -- 172.21.15.44:0/4245384025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa80cbb70 con 0x7effa80b7170 2023-11-04T01:43:48.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.966+0000 7effacec9640 1 -- 172.21.15.44:0/4245384025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa81f5d80 con 0x7effa80b7170 2023-11-04T01:43:48.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.967+0000 7eff96ffd640 1 -- 172.21.15.44:0/4245384025 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7effa0015590 con 0x7effa80b7170 2023-11-04T01:43:48.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.967+0000 7eff96ffd640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff8806ae70 0x7eff8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.968+0000 7eff96ffd640 1 -- 172.21.15.44:0/4245384025 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8096+0+0 (secure 0 0 0) 0x7effa008a6e0 con 0x7effa80b7170 2023-11-04T01:43:48.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.968+0000 7effa659c640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff8806ae70 0x7eff8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.968+0000 7effa659c640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff8806ae70 0x7eff8806d330 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7eff98000ef0 tx=0x7eff98009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:48.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:48.972+0000 7eff96ffd640 1 -- 172.21.15.44:0/4245384025 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7effa81f5d80 con 0x7effa80b7170 2023-11-04T01:43:49.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:49.185+0000 7effacec9640 1 -- 172.21.15.44:0/4245384025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effa81f5d80 con 0x7effa80b7170 2023-11-04T01:43:49.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:49.186+0000 7eff96ffd640 1 -- 172.21.15.44:0/4245384025 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4940 (secure 0 0 0) 0x7effa81f5d80 con 0x7effa80b7170 2023-11-04T01:43:49.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:49.188 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":117,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/830347539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":830347539},{"type":"v1","addr":"172.21.15.44:6835","nonce":830347539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:42.786827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8703":{"gid":8703,"name":"c","rank":1,"incarnation":115,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:49.188 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 117 2023-11-04T01:43:49.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:49.188+0000 7effacec9640 1 -- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff8806ae70 msgr2=0x7eff8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:49.188+0000 7effacec9640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff8806ae70 0x7eff8806d330 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7eff98000ef0 tx=0x7eff98009040 comp rx=0 tx=0).stop 2023-11-04T01:43:49.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:49.188+0000 7effacec9640 1 -- 172.21.15.44:0/4245384025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa80b7170 msgr2=0x7effa815fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:49.188+0000 7effacec9640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa80b7170 0x7effa815fb10 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7effa815d8c0 tx=0x7effa000f1b0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:49.188+0000 7effacec9640 1 -- 172.21.15.44:0/4245384025 shutdown_connections 2023-11-04T01:43:49.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:49.188+0000 7effacec9640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7eff8806ae70 0x7eff8806d330 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:49.188+0000 7effacec9640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa80b7170 0x7effa815fb10 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:49.188+0000 7effacec9640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effa81f6a00 0x7effa80b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:49.188+0000 7effacec9640 1 --2- 172.21.15.44:0/4245384025 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff900047c0 0x7effa80c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:49.188+0000 7effacec9640 1 -- 172.21.15.44:0/4245384025 >> 172.21.15.44:0/4245384025 conn(0x7effa80d2ef0 msgr2=0x7effa80d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:49.188+0000 7effacec9640 1 -- 172.21.15.44:0/4245384025 shutdown_connections 2023-11-04T01:43:49.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:49.188+0000 7effacec9640 1 -- 172.21.15.44:0/4245384025 wait complete. 2023-11-04T01:43:49.200 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:43:50.201 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:50.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.322+0000 7f2f514e0640 1 Processor -- start 2023-11-04T01:43:50.324 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.322+0000 7f2f514e0640 1 -- start start 2023-11-04T01:43:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.322+0000 7f2f514e0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f4c15d100 0x7f2f4c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.322+0000 7f2f514e0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2f4c15d4e0 0x7f2f4c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.322+0000 7f2f514e0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2f4c0d3b60 0x7f2f4c0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.322+0000 7f2f514e0640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4c0b32b0 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.322+0000 7f2f514e0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4c0cee10 con 0x7f2f4c0d3b60 2023-11-04T01:43:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.322+0000 7f2f514e0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0b2980 con 0x7f2f4c15d100 2023-11-04T01:43:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.323+0000 7f2f4a7fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2f4c15d4e0 0x7f2f4c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.323+0000 7f2f4a7fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2f4c15d4e0 0x7f2f4c0d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46202/0 (socket says 172.21.15.44:46202) 2023-11-04T01:43:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.323+0000 7f2f4a7fc640 1 -- 172.21.15.44:0/4246696848 learned_addr learned my addr 172.21.15.44:0/4246696848 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.323+0000 7f2f4affd640 1 --2- 172.21.15.44:0/4246696848 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f4c15d100 0x7f2f4c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.323+0000 7f2f4b7fe640 1 --2- 172.21.15.44:0/4246696848 >> v2:172.21.15.204:3300/0 conn(0x7f2f4c0d3b60 0x7f2f4c0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.323+0000 7f2f4a7fc640 1 -- 172.21.15.44:0/4246696848 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f4c15d100 msgr2=0x7f2f4c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.323+0000 7f2f4a7fc640 1 --2- 172.21.15.44:0/4246696848 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f4c15d100 0x7f2f4c0ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.323+0000 7f2f4a7fc640 1 -- 172.21.15.44:0/4246696848 >> v2:172.21.15.204:3300/0 conn(0x7f2f4c0d3b60 msgr2=0x7f2f4c0d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.323+0000 7f2f4a7fc640 1 --2- 172.21.15.44:0/4246696848 >> v2:172.21.15.204:3300/0 conn(0x7f2f4c0d3b60 0x7f2f4c0d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.323+0000 7f2f4a7fc640 1 -- 172.21.15.44:0/4246696848 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c0b2c60 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.324+0000 7f2f4a7fc640 1 --2- 172.21.15.44:0/4246696848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f4c15d4e0 0x7f2f4c0d14d0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0b27a0 tx=0x7f2f3402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb465fe1c581cc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.324+0000 7f2f49ffb640 1 -- 172.21.15.44:0/4246696848 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34031870 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.324+0000 7f2f49ffb640 1 -- 172.21.15.44:0/4246696848 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f340319d0 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.324+0000 7f2f49ffb640 1 -- 172.21.15.44:0/4246696848 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34031d60 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.325+0000 7f2f514e0640 1 -- 172.21.15.44:0/4246696848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f4c15d4e0 msgr2=0x7f2f4c0d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.325+0000 7f2f514e0640 1 --2- 172.21.15.44:0/4246696848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f4c15d4e0 0x7f2f4c0d14d0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0b27a0 tx=0x7f2f3402b910 comp rx=0 tx=0).stop 2023-11-04T01:43:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.325+0000 7f2f514e0640 1 -- 172.21.15.44:0/4246696848 shutdown_connections 2023-11-04T01:43:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.325+0000 7f2f514e0640 1 --2- 172.21.15.44:0/4246696848 >> v2:172.21.15.204:3300/0 conn(0x7f2f4c0d3b60 0x7f2f4c0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.325+0000 7f2f514e0640 1 --2- 172.21.15.44:0/4246696848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f4c15d4e0 0x7f2f4c0d14d0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.325+0000 7f2f514e0640 1 --2- 172.21.15.44:0/4246696848 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f4c15d100 0x7f2f4c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.325+0000 7f2f514e0640 1 -- 172.21.15.44:0/4246696848 >> 172.21.15.44:0/4246696848 conn(0x7f2f4c0d2ef0 msgr2=0x7f2f4c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.325+0000 7f2f514e0640 1 -- 172.21.15.44:0/4246696848 shutdown_connections 2023-11-04T01:43:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.325+0000 7f2f514e0640 1 -- 172.21.15.44:0/4246696848 wait complete. 2023-11-04T01:43:50.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.326+0000 7f2f514e0640 1 Processor -- start 2023-11-04T01:43:50.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.326+0000 7f2f514e0640 1 -- start start 2023-11-04T01:43:50.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f514e0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f4c0d3b60 0x7f2f4c14c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f514e0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f4c15d100 0x7f2f4c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f514e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f4c15d4e0 0x7f2f4c14bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.330 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f514e0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c1f6120 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f514e0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0b3f30 con 0x7f2f4c0d3b60 2023-11-04T01:43:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f514e0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c1f6370 con 0x7f2f4c15d100 2023-11-04T01:43:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f4b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f4c15d4e0 0x7f2f4c14bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f4b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f4c15d4e0 0x7f2f4c14bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46210/0 (socket says 172.21.15.44:46210) 2023-11-04T01:43:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f4b7fe640 1 -- 172.21.15.44:0/1476950532 learned_addr learned my addr 172.21.15.44:0/1476950532 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f4b7fe640 1 -- 172.21.15.44:0/1476950532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f4c15d100 msgr2=0x7f2f4c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f4affd640 1 --2- 172.21.15.44:0/1476950532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f4c0d3b60 0x7f2f4c14c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f4a7fc640 1 --2- 172.21.15.44:0/1476950532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f4c15d100 0x7f2f4c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f4b7fe640 1 --2- 172.21.15.44:0/1476950532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f4c15d100 0x7f2f4c0b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f4b7fe640 1 -- 172.21.15.44:0/1476950532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f4c0d3b60 msgr2=0x7f2f4c14c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f4b7fe640 1 --2- 172.21.15.44:0/1476950532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f4c0d3b60 0x7f2f4c14c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f4b7fe640 1 -- 172.21.15.44:0/1476950532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340094d0 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.327+0000 7f2f4affd640 1 --2- 172.21.15.44:0/1476950532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f4c0d3b60 0x7f2f4c14c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.328+0000 7f2f4b7fe640 1 --2- 172.21.15.44:0/1476950532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f4c15d4e0 0x7f2f4c14bf60 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00e830 tx=0x7f2f3c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.328+0000 7f2f437fe640 1 -- 172.21.15.44:0/1476950532 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c009610 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.328+0000 7f2f437fe640 1 -- 172.21.15.44:0/1476950532 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c00c940 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.328+0000 7f2f514e0640 1 -- 172.21.15.44:0/1476950532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c1f6650 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.328+0000 7f2f437fe640 1 -- 172.21.15.44:0/1476950532 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c00ccf0 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.328+0000 7f2f514e0640 1 -- 172.21.15.44:0/1476950532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4c1f6c10 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.329+0000 7f2f514e0640 1 -- 172.21.15.44:0/1476950532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4c0684b0 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.329+0000 7f2f437fe640 1 -- 172.21.15.44:0/1476950532 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f3c013470 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.330+0000 7f2f437fe640 1 --2- 172.21.15.44:0/1476950532 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f2c06ae70 0x7f2f2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.330+0000 7f2f437fe640 1 -- 172.21.15.44:0/1476950532 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7f2f3c08a180 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.330+0000 7f2f4affd640 1 --2- 172.21.15.44:0/1476950532 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f2c06ae70 0x7f2f2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.331+0000 7f2f4affd640 1 --2- 172.21.15.44:0/1476950532 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f2c06ae70 0x7f2f2c06d330 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009fd0 tx=0x7f2f4400b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.336 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.334+0000 7f2f437fe640 1 -- 172.21.15.44:0/1476950532 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f3c0548b0 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.548+0000 7f2f514e0640 1 -- 172.21.15.44:0/1476950532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f4c0d2cd0 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.548+0000 7f2f437fe640 1 -- 172.21.15.44:0/1476950532 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4940 (secure 0 0 0) 0x7f2f3c017090 con 0x7f2f4c15d4e0 2023-11-04T01:43:50.550 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:50.550 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":117,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/830347539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":830347539},{"type":"v1","addr":"172.21.15.44:6835","nonce":830347539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:42.786827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8703":{"gid":8703,"name":"c","rank":1,"incarnation":115,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 117 2023-11-04T01:43:50.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.550+0000 7f2f514e0640 1 -- 172.21.15.44:0/1476950532 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f2c06ae70 msgr2=0x7f2f2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.550+0000 7f2f514e0640 1 --2- 172.21.15.44:0/1476950532 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f2c06ae70 0x7f2f2c06d330 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009fd0 tx=0x7f2f4400b040 comp rx=0 tx=0).stop 2023-11-04T01:43:50.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.550+0000 7f2f514e0640 1 -- 172.21.15.44:0/1476950532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f4c15d4e0 msgr2=0x7f2f4c14bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.550+0000 7f2f514e0640 1 --2- 172.21.15.44:0/1476950532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f4c15d4e0 0x7f2f4c14bf60 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00e830 tx=0x7f2f3c00ecf0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.550+0000 7f2f514e0640 1 -- 172.21.15.44:0/1476950532 shutdown_connections 2023-11-04T01:43:50.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.550+0000 7f2f514e0640 1 --2- 172.21.15.44:0/1476950532 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2f2c06ae70 0x7f2f2c06d330 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.550+0000 7f2f514e0640 1 --2- 172.21.15.44:0/1476950532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f4c15d4e0 0x7f2f4c14bf60 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.550+0000 7f2f514e0640 1 --2- 172.21.15.44:0/1476950532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f4c15d100 0x7f2f4c0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.550+0000 7f2f514e0640 1 --2- 172.21.15.44:0/1476950532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f4c0d3b60 0x7f2f4c14c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.550+0000 7f2f514e0640 1 -- 172.21.15.44:0/1476950532 >> 172.21.15.44:0/1476950532 conn(0x7f2f4c0d2ef0 msgr2=0x7f2f4c06a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:50.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.550+0000 7f2f514e0640 1 -- 172.21.15.44:0/1476950532 shutdown_connections 2023-11-04T01:43:50.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:50.550+0000 7f2f514e0640 1 -- 172.21.15.44:0/1476950532 wait complete. 2023-11-04T01:43:50.562 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:43:51.563 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:51.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.680+0000 7f98cc4fc640 1 Processor -- start 2023-11-04T01:43:51.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.680+0000 7f98cc4fc640 1 -- start start 2023-11-04T01:43:51.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.681+0000 7f98cc4fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98c40ceda0 0x7f98c415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.681+0000 7f98cc4fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f98c40b2210 0x7f98c415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.681+0000 7f98cc4fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c415d9a0 con 0x7f98c40cf180 2023-11-04T01:43:51.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.681+0000 7f98cc4fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c40b1df0 con 0x7f98c40b2210 2023-11-04T01:43:51.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.681+0000 7f98cc4fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40cfd20 con 0x7f98c40ceda0 2023-11-04T01:43:51.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.682+0000 7f98c9a97640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f98c40b2210 0x7f98c415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.682+0000 7f98c9a97640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f98c40b2210 0x7f98c415d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46220/0 (socket says 172.21.15.44:46220) 2023-11-04T01:43:51.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.682+0000 7f98c9a97640 1 -- 172.21.15.44:0/3744999925 learned_addr learned my addr 172.21.15.44:0/3744999925 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:51.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.682+0000 7f98ca298640 1 --2- 172.21.15.44:0/3744999925 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98c40ceda0 0x7f98c415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.682+0000 7f98c9a97640 1 -- 172.21.15.44:0/3744999925 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98c40ceda0 msgr2=0x7f98c415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:51.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.682+0000 7f98c9a97640 1 --2- 172.21.15.44:0/3744999925 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98c40ceda0 0x7f98c415cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.682+0000 7f98c9a97640 1 -- 172.21.15.44:0/3744999925 >> v1:172.21.15.204:6789/0 conn(0x7f98c40cf180 legacy=0x7f98c40cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:51.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.682+0000 7f98c9a97640 1 -- 172.21.15.44:0/3744999925 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c40b0150 con 0x7f98c40b2210 2023-11-04T01:43:51.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.683+0000 7f98c9a97640 1 --2- 172.21.15.44:0/3744999925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c40b2210 0x7f98c415d460 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f98b8009870 tx=0x7f98b802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c9b49143b56108 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.683+0000 7f98c9296640 1 -- 172.21.15.44:0/3744999925 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b80317c0 con 0x7f98c40b2210 2023-11-04T01:43:51.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.683+0000 7f98c9296640 1 -- 172.21.15.44:0/3744999925 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b8031920 con 0x7f98c40b2210 2023-11-04T01:43:51.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.683+0000 7f98c9296640 1 -- 172.21.15.44:0/3744999925 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8031cb0 con 0x7f98c40b2210 2023-11-04T01:43:51.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.683+0000 7f98cc4fc640 1 -- 172.21.15.44:0/3744999925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c40b2210 msgr2=0x7f98c415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.683+0000 7f98cc4fc640 1 --2- 172.21.15.44:0/3744999925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c40b2210 0x7f98c415d460 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f98b8009870 tx=0x7f98b802b860 comp rx=0 tx=0).stop 2023-11-04T01:43:51.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.684+0000 7f98cc4fc640 1 -- 172.21.15.44:0/3744999925 shutdown_connections 2023-11-04T01:43:51.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.684+0000 7f98cc4fc640 1 --2- 172.21.15.44:0/3744999925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c40b2210 0x7f98c415d460 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.684+0000 7f98cc4fc640 1 --2- 172.21.15.44:0/3744999925 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98c40ceda0 0x7f98c415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.684+0000 7f98cc4fc640 1 -- 172.21.15.44:0/3744999925 >> 172.21.15.44:0/3744999925 conn(0x7f98c40d0c30 msgr2=0x7f98c40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:51.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.684+0000 7f98cc4fc640 1 -- 172.21.15.44:0/3744999925 shutdown_connections 2023-11-04T01:43:51.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.684+0000 7f98cc4fc640 1 -- 172.21.15.44:0/3744999925 wait complete. 2023-11-04T01:43:51.688 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.685+0000 7f98cc4fc640 1 Processor -- start 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.685+0000 7f98cc4fc640 1 -- start start 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98cc4fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c40b2210 0x7f98c4155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98cc4fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98c40ceda0 0x7f98c40ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98cc4fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98c40cf180 0x7f98c40cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98cc4fc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40c51c0 con 0x7f98c40b2210 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98cc4fc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40c8ba0 con 0x7f98c40cf180 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98cc4fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40c8e80 con 0x7f98c40ceda0 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98ca298640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c40b2210 0x7f98c4155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98ca298640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c40b2210 0x7f98c4155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46236/0 (socket says 172.21.15.44:46236) 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98ca298640 1 -- 172.21.15.44:0/3041627858 learned_addr learned my addr 172.21.15.44:0/3041627858 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98c9a97640 1 --2- 172.21.15.44:0/3041627858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98c40ceda0 0x7f98c40ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98caa99640 1 --2- 172.21.15.44:0/3041627858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98c40cf180 0x7f98c40cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98ca298640 1 -- 172.21.15.44:0/3041627858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98c40ceda0 msgr2=0x7f98c40ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98ca298640 1 --2- 172.21.15.44:0/3041627858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98c40ceda0 0x7f98c40ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98ca298640 1 -- 172.21.15.44:0/3041627858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98c40cf180 msgr2=0x7f98c40cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98ca298640 1 --2- 172.21.15.44:0/3041627858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98c40cf180 0x7f98c40cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98ca298640 1 -- 172.21.15.44:0/3041627858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b80094d0 con 0x7f98c40b2210 2023-11-04T01:43:51.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98ca298640 1 --2- 172.21.15.44:0/3041627858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c40b2210 0x7f98c4155530 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f98bc00d800 tx=0x7f98bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98c2ffd640 1 -- 172.21.15.44:0/3041627858 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc00b6c0 con 0x7f98c40b2210 2023-11-04T01:43:51.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98c2ffd640 1 -- 172.21.15.44:0/3041627858 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc00b820 con 0x7f98c40b2210 2023-11-04T01:43:51.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98c2ffd640 1 -- 172.21.15.44:0/3041627858 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc00bbd0 con 0x7f98c40b2210 2023-11-04T01:43:51.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.686+0000 7f98cc4fc640 1 -- 172.21.15.44:0/3041627858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c40c9160 con 0x7f98c40b2210 2023-11-04T01:43:51.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.687+0000 7f98cc4fc640 1 -- 172.21.15.44:0/3041627858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c4155a70 con 0x7f98c40b2210 2023-11-04T01:43:51.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.688+0000 7f98cc4fc640 1 -- 172.21.15.44:0/3041627858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c40c9680 con 0x7f98c40b2210 2023-11-04T01:43:51.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.688+0000 7f98c2ffd640 1 -- 172.21.15.44:0/3041627858 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f98bc00bd30 con 0x7f98c40b2210 2023-11-04T01:43:51.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.688+0000 7f98c2ffd640 1 --2- 172.21.15.44:0/3041627858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f98b006aea0 0x7f98b006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.689+0000 7f98c2ffd640 1 -- 172.21.15.44:0/3041627858 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7f98bc08a5c0 con 0x7f98c40b2210 2023-11-04T01:43:51.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.689+0000 7f98c9a97640 1 --2- 172.21.15.44:0/3041627858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f98b006aea0 0x7f98b006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.689+0000 7f98c9a97640 1 --2- 172.21.15.44:0/3041627858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f98b006aea0 0x7f98b006d360 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f98b8036000 tx=0x7f98b803d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.693+0000 7f98c2ffd640 1 -- 172.21.15.44:0/3041627858 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f98bc054c50 con 0x7f98c40b2210 2023-11-04T01:43:51.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.905+0000 7f98cc4fc640 1 -- 172.21.15.44:0/3041627858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98c40c5300 con 0x7f98c40b2210 2023-11-04T01:43:51.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.906+0000 7f98c2ffd640 1 -- 172.21.15.44:0/3041627858 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+4934 (secure 0 0 0) 0x7f98bc058270 con 0x7f98c40b2210 2023-11-04T01:43:51.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:51.908 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":118,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/830347539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":830347539},{"type":"v1","addr":"172.21.15.44:6835","nonce":830347539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:50.283202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:rejoin","state_seq":17,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8703":{"gid":8703,"name":"c","rank":1,"incarnation":115,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:51.908 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 118 2023-11-04T01:43:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.907+0000 7f98cc4fc640 1 -- 172.21.15.44:0/3041627858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f98b006aea0 msgr2=0x7f98b006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.907+0000 7f98cc4fc640 1 --2- 172.21.15.44:0/3041627858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f98b006aea0 0x7f98b006d360 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f98b8036000 tx=0x7f98b803d040 comp rx=0 tx=0).stop 2023-11-04T01:43:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.907+0000 7f98cc4fc640 1 -- 172.21.15.44:0/3041627858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c40b2210 msgr2=0x7f98c4155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.907+0000 7f98cc4fc640 1 --2- 172.21.15.44:0/3041627858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c40b2210 0x7f98c4155530 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f98bc00d800 tx=0x7f98bc00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.907+0000 7f98cc4fc640 1 -- 172.21.15.44:0/3041627858 shutdown_connections 2023-11-04T01:43:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.907+0000 7f98cc4fc640 1 --2- 172.21.15.44:0/3041627858 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f98b006aea0 0x7f98b006d360 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.907+0000 7f98cc4fc640 1 --2- 172.21.15.44:0/3041627858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98c40cf180 0x7f98c40cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.907+0000 7f98cc4fc640 1 --2- 172.21.15.44:0/3041627858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98c40ceda0 0x7f98c40ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.907+0000 7f98cc4fc640 1 --2- 172.21.15.44:0/3041627858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c40b2210 0x7f98c4155530 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.907+0000 7f98cc4fc640 1 -- 172.21.15.44:0/3041627858 >> 172.21.15.44:0/3041627858 conn(0x7f98c40d0c30 msgr2=0x7f98c40ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.908+0000 7f98cc4fc640 1 -- 172.21.15.44:0/3041627858 shutdown_connections 2023-11-04T01:43:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:51.908+0000 7f98cc4fc640 1 -- 172.21.15.44:0/3041627858 wait complete. 2023-11-04T01:43:51.920 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:rejoin 2023-11-04T01:43:52.920 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.037+0000 7f14ee1f5640 1 Processor -- start 2023-11-04T01:43:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.037+0000 7f14ee1f5640 1 -- start start 2023-11-04T01:43:53.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.038+0000 7f14ee1f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f14e80ade00 0x7f14e80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.038+0000 7f14ee1f5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f14e806c5f0 0x7f14e80cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.040 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.038+0000 7f14ee1f5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e806cc90 con 0x7f14e806d9c0 2023-11-04T01:43:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.038+0000 7f14ee1f5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e80b0e60 con 0x7f14e806c5f0 2023-11-04T01:43:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.038+0000 7f14ee1f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e806cee0 con 0x7f14e80ade00 2023-11-04T01:43:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.038+0000 7f14e7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f14e806c5f0 0x7f14e80cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.038+0000 7f14e6ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f14e806d9c0 0x7f14e80710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51100/0 (socket says 172.21.15.44:51100) 2023-11-04T01:43:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.038+0000 7f14e6ffd640 1 -- 172.21.15.44:0/2321214681 learned_addr learned my addr 172.21.15.44:0/2321214681 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.038+0000 7f14e77fe640 1 --2- 172.21.15.44:0/2321214681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f14e80ade00 0x7f14e80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.038+0000 7f14e7fff640 1 -- 172.21.15.44:0/2321214681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f14e80ade00 msgr2=0x7f14e80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.038+0000 7f14e7fff640 1 --2- 172.21.15.44:0/2321214681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f14e80ade00 0x7f14e80b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.038+0000 7f14e7fff640 1 -- 172.21.15.44:0/2321214681 >> v1:172.21.15.44:6789/0 conn(0x7f14e806d9c0 legacy=0x7f14e80710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.039+0000 7f14e7fff640 1 -- 172.21.15.44:0/2321214681 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e806d1c0 con 0x7f14e806c5f0 2023-11-04T01:43:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.039+0000 7f14e67fc640 1 -- 172.21.15.44:0/2321214681 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786476631 0 0) 0x7f14e806cc90 con 0x7f14e806d9c0 2023-11-04T01:43:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.039+0000 7f14e7fff640 1 --2- 172.21.15.44:0/2321214681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14e806c5f0 0x7f14e80cc680 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f14e0009d90 tx=0x7f14e002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5700c5028c5acc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.039+0000 7f14e67fc640 1 -- 172.21.15.44:0/2321214681 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e002cb30 con 0x7f14e806c5f0 2023-11-04T01:43:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.039+0000 7f14e67fc640 1 -- 172.21.15.44:0/2321214681 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e002cc90 con 0x7f14e806c5f0 2023-11-04T01:43:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.039+0000 7f14e67fc640 1 -- 172.21.15.44:0/2321214681 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e0034440 con 0x7f14e806c5f0 2023-11-04T01:43:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.040+0000 7f14ee1f5640 1 -- 172.21.15.44:0/2321214681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14e806c5f0 msgr2=0x7f14e80cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.040+0000 7f14ee1f5640 1 --2- 172.21.15.44:0/2321214681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14e806c5f0 0x7f14e80cc680 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f14e0009d90 tx=0x7f14e002bd80 comp rx=0 tx=0).stop 2023-11-04T01:43:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.040+0000 7f14ee1f5640 1 -- 172.21.15.44:0/2321214681 shutdown_connections 2023-11-04T01:43:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.040+0000 7f14ee1f5640 1 --2- 172.21.15.44:0/2321214681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14e806c5f0 0x7f14e80cc680 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.040+0000 7f14ee1f5640 1 --2- 172.21.15.44:0/2321214681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f14e80ade00 0x7f14e80b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.040+0000 7f14ee1f5640 1 -- 172.21.15.44:0/2321214681 >> 172.21.15.44:0/2321214681 conn(0x7f14e80cb530 msgr2=0x7f14e80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.040+0000 7f14ee1f5640 1 -- 172.21.15.44:0/2321214681 shutdown_connections 2023-11-04T01:43:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.040+0000 7f14ee1f5640 1 -- 172.21.15.44:0/2321214681 wait complete. 2023-11-04T01:43:53.045 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.041+0000 7f14ee1f5640 1 Processor -- start 2023-11-04T01:43:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.041+0000 7f14ee1f5640 1 -- start start 2023-11-04T01:43:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.042+0000 7f14ee1f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14e806c5f0 0x7f14e81540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.042+0000 7f14ee1f5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f14e806d9c0 0x7f14e81573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.042+0000 7f14ee1f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f14e80ade00 0x7f14e80ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.042+0000 7f14ee1f5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e8155910 con 0x7f14e806c5f0 2023-11-04T01:43:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.042+0000 7f14ee1f5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e8154600 con 0x7f14e806d9c0 2023-11-04T01:43:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.042+0000 7f14ee1f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e8154fe0 con 0x7f14e80ade00 2023-11-04T01:43:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.042+0000 7f14e77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14e806c5f0 0x7f14e81540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.042+0000 7f14e77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14e806c5f0 0x7f14e81540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38388/0 (socket says 172.21.15.44:38388) 2023-11-04T01:43:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.042+0000 7f14e77fe640 1 -- 172.21.15.44:0/3027169471 learned_addr learned my addr 172.21.15.44:0/3027169471 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.043+0000 7f14e7fff640 1 --2- 172.21.15.44:0/3027169471 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f14e80ade00 0x7f14e80ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.043+0000 7f14e6ffd640 1 --2- 172.21.15.44:0/3027169471 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f14e806d9c0 0x7f14e81573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.043+0000 7f14e77fe640 1 -- 172.21.15.44:0/3027169471 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f14e80ade00 msgr2=0x7f14e80ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.043+0000 7f14e77fe640 1 --2- 172.21.15.44:0/3027169471 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f14e80ade00 0x7f14e80ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.043+0000 7f14e77fe640 1 -- 172.21.15.44:0/3027169471 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f14e806d9c0 msgr2=0x7f14e81573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.043+0000 7f14e77fe640 1 --2- 172.21.15.44:0/3027169471 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f14e806d9c0 0x7f14e81573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.043+0000 7f14e77fe640 1 -- 172.21.15.44:0/3027169471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e0009a70 con 0x7f14e806c5f0 2023-11-04T01:43:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.043+0000 7f14e6ffd640 1 --2- 172.21.15.44:0/3027169471 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f14e806d9c0 0x7f14e81573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.043+0000 7f14e77fe640 1 --2- 172.21.15.44:0/3027169471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14e806c5f0 0x7f14e81540c0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f14d800d800 tx=0x7f14d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.043+0000 7f14cffff640 1 -- 172.21.15.44:0/3027169471 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d800b6c0 con 0x7f14e806c5f0 2023-11-04T01:43:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.043+0000 7f14cffff640 1 -- 172.21.15.44:0/3027169471 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d800b820 con 0x7f14e806c5f0 2023-11-04T01:43:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.043+0000 7f14ee1f5640 1 -- 172.21.15.44:0/3027169471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e81552c0 con 0x7f14e806c5f0 2023-11-04T01:43:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.043+0000 7f14cffff640 1 -- 172.21.15.44:0/3027169471 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d800bbb0 con 0x7f14e806c5f0 2023-11-04T01:43:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.043+0000 7f14ee1f5640 1 -- 172.21.15.44:0/3027169471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e8155da0 con 0x7f14e806c5f0 2023-11-04T01:43:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.044+0000 7f14ee1f5640 1 -- 172.21.15.44:0/3027169471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e80684b0 con 0x7f14e806c5f0 2023-11-04T01:43:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.045+0000 7f14cffff640 1 -- 172.21.15.44:0/3027169471 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f14d800bd10 con 0x7f14e806c5f0 2023-11-04T01:43:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.045+0000 7f14cffff640 1 --2- 172.21.15.44:0/3027169471 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f14d406ae70 0x7f14d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.045+0000 7f14cffff640 1 -- 172.21.15.44:0/3027169471 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7f14d808a520 con 0x7f14e806c5f0 2023-11-04T01:43:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.045+0000 7f14e6ffd640 1 --2- 172.21.15.44:0/3027169471 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f14d406ae70 0x7f14d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.046+0000 7f14e6ffd640 1 --2- 172.21.15.44:0/3027169471 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f14d406ae70 0x7f14d406d330 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f14e80c21f0 tx=0x7f14dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:53.051 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.049+0000 7f14cffff640 1 -- 172.21.15.44:0/3027169471 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f14d8054c50 con 0x7f14e806c5f0 2023-11-04T01:43:53.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.260+0000 7f14ee1f5640 1 -- 172.21.15.44:0/3027169471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14e80c2340 con 0x7f14e806c5f0 2023-11-04T01:43:53.262 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.261+0000 7f14cffff640 1 -- 172.21.15.44:0/3027169471 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) v1 ==== 95+0+4934 (secure 0 0 0) 0x7f14d8058270 con 0x7f14e806c5f0 2023-11-04T01:43:53.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:53.263 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":119,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/830347539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":830347539},{"type":"v1","addr":"172.21.15.44:6835","nonce":830347539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:51.283197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:active","state_seq":18,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8703":{"gid":8703,"name":"c","rank":1,"incarnation":115,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:53.263 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 119 2023-11-04T01:43:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.262+0000 7f14ee1f5640 1 -- 172.21.15.44:0/3027169471 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f14d406ae70 msgr2=0x7f14d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.262+0000 7f14ee1f5640 1 --2- 172.21.15.44:0/3027169471 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f14d406ae70 0x7f14d406d330 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f14e80c21f0 tx=0x7f14dc009040 comp rx=0 tx=0).stop 2023-11-04T01:43:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.262+0000 7f14ee1f5640 1 -- 172.21.15.44:0/3027169471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14e806c5f0 msgr2=0x7f14e81540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.262+0000 7f14ee1f5640 1 --2- 172.21.15.44:0/3027169471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14e806c5f0 0x7f14e81540c0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f14d800d800 tx=0x7f14d800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.262+0000 7f14ee1f5640 1 -- 172.21.15.44:0/3027169471 shutdown_connections 2023-11-04T01:43:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.262+0000 7f14ee1f5640 1 --2- 172.21.15.44:0/3027169471 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f14d406ae70 0x7f14d406d330 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.262+0000 7f14ee1f5640 1 --2- 172.21.15.44:0/3027169471 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f14e80ade00 0x7f14e80ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.262+0000 7f14ee1f5640 1 --2- 172.21.15.44:0/3027169471 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f14e806d9c0 0x7f14e81573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.262+0000 7f14ee1f5640 1 --2- 172.21.15.44:0/3027169471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14e806c5f0 0x7f14e81540c0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.262+0000 7f14ee1f5640 1 -- 172.21.15.44:0/3027169471 >> 172.21.15.44:0/3027169471 conn(0x7f14e80cb530 msgr2=0x7f14e80b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.262+0000 7f14ee1f5640 1 -- 172.21.15.44:0/3027169471 shutdown_connections 2023-11-04T01:43:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.262+0000 7f14ee1f5640 1 -- 172.21.15.44:0/3027169471 wait complete. 2023-11-04T01:43:53.275 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:43:53.275 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.776202917098999s 2023-11-04T01:43:53.275 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:53.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:53.275 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2023-11-04T01:43:53.306 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:43:53.307 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:53.362 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:53.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.505+0000 7fdcd09e7640 1 Processor -- start 2023-11-04T01:43:53.507 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.505+0000 7fdcd09e7640 1 -- start start 2023-11-04T01:43:53.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.506+0000 7fdcd09e7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdccc06d9c0 0x7fdccc0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.506+0000 7fdcd09e7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc06c5f0 0x7fdccc071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.506+0000 7fdcd09e7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc06cc90 con 0x7fdccc0ade00 2023-11-04T01:43:53.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.506+0000 7fdcd09e7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdccc0b0c40 con 0x7fdccc06d9c0 2023-11-04T01:43:53.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.506+0000 7fdcd09e7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc071b50 con 0x7fdccc06c5f0 2023-11-04T01:43:53.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.506+0000 7fdcca59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdccc0ade00 0x7fdccc0b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51112/0 (socket says 172.21.15.44:51112) 2023-11-04T01:43:53.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.506+0000 7fdcca59c640 1 -- 172.21.15.44:0/2437305867 learned_addr learned my addr 172.21.15.44:0/2437305867 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:53.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.506+0000 7fdcc959a640 1 -- 172.21.15.44:0/2437305867 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973537399 0 0) 0x7fdccc06cc90 con 0x7fdccc0ade00 2023-11-04T01:43:53.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.506+0000 7fdcc959a640 1 -- 172.21.15.44:0/2437305867 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcb8003520 con 0x7fdccc0ade00 2023-11-04T01:43:53.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.506+0000 7fdccad9d640 1 --2- 172.21.15.44:0/2437305867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc06c5f0 0x7fdccc071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.506+0000 7fdcc9d9b640 1 --2- 172.21.15.44:0/2437305867 >> v2:172.21.15.204:3300/0 conn(0x7fdccc06d9c0 0x7fdccc0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcc959a640 1 -- 172.21.15.44:0/2437305867 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3276741034 0 0) 0x7fdcb8003520 con 0x7fdccc0ade00 2023-11-04T01:43:53.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcc959a640 1 -- 172.21.15.44:0/2437305867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc06c5f0 msgr2=0x7fdccc071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:53.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcc959a640 1 --2- 172.21.15.44:0/2437305867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc06c5f0 0x7fdccc071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcc959a640 1 -- 172.21.15.44:0/2437305867 >> v2:172.21.15.204:3300/0 conn(0x7fdccc06d9c0 msgr2=0x7fdccc0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:53.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcc959a640 1 --2- 172.21.15.44:0/2437305867 >> v2:172.21.15.204:3300/0 conn(0x7fdccc06d9c0 0x7fdccc0710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcc959a640 1 -- 172.21.15.44:0/2437305867 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0b0e60 con 0x7fdccc0ade00 2023-11-04T01:43:53.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcc959a640 1 -- 172.21.15.44:0/2437305867 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fdcc4001670 con 0x7fdccc0ade00 2023-11-04T01:43:53.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcc959a640 1 -- 172.21.15.44:0/2437305867 >> v1:172.21.15.44:6789/0 conn(0x7fdccc0ade00 legacy=0x7fdccc0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcc959a640 1 --2- 172.21.15.44:0/2437305867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcb8003970 0x7fdcb8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcc959a640 1 --2- 172.21.15.44:0/2437305867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc06c5f0 0x7fdcb80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcc959a640 1 --2- 172.21.15.44:0/2437305867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdcb8004d00 0x7fdcb8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcc959a640 1 -- 172.21.15.44:0/2437305867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b0c40 con 0x7fdcb8003970 2023-11-04T01:43:53.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcc959a640 1 -- 172.21.15.44:0/2437305867 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc071b50 con 0x7fdcb8004d00 2023-11-04T01:43:53.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcc959a640 1 -- 172.21.15.44:0/2437305867 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb800bbc0 con 0x7fdccc06c5f0 2023-11-04T01:43:53.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcca59c640 1 --2- 172.21.15.44:0/2437305867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcb8003970 0x7fdcb8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcc9d9b640 1 --2- 172.21.15.44:0/2437305867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc06c5f0 0x7fdcb80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdccad9d640 1 --2- 172.21.15.44:0/2437305867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdcb8004d00 0x7fdcb8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcca59c640 1 -- 172.21.15.44:0/2437305867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc06c5f0 msgr2=0x7fdcb80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:53.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcca59c640 1 --2- 172.21.15.44:0/2437305867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc06c5f0 0x7fdcb80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcca59c640 1 -- 172.21.15.44:0/2437305867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdcb8004d00 msgr2=0x7fdcb8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:53.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcca59c640 1 --2- 172.21.15.44:0/2437305867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdcb8004d00 0x7fdcb8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.507+0000 7fdcca59c640 1 -- 172.21.15.44:0/2437305867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb8003520 con 0x7fdcb8003970 2023-11-04T01:43:53.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.508+0000 7fdcca59c640 1 --2- 172.21.15.44:0/2437305867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcb8003970 0x7fdcb8003d90 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400c210 tx=0x7fdcb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420276f657978f6a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:53.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.508+0000 7fdcc959a640 1 -- 172.21.15.44:0/2437305867 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4005ad0 con 0x7fdcb8003970 2023-11-04T01:43:53.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.508+0000 7fdcc959a640 1 -- 172.21.15.44:0/2437305867 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc4005c30 con 0x7fdcb8003970 2023-11-04T01:43:53.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.508+0000 7fdcc959a640 1 -- 172.21.15.44:0/2437305867 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc402c8d0 con 0x7fdcb8003970 2023-11-04T01:43:53.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.508+0000 7fdcd09e7640 1 -- 172.21.15.44:0/2437305867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcb8003970 msgr2=0x7fdcb8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.508+0000 7fdcd09e7640 1 --2- 172.21.15.44:0/2437305867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcb8003970 0x7fdcb8003d90 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400c210 tx=0x7fdcb80057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.508+0000 7fdccad9d640 1 -- 172.21.15.44:0/2437305867 reap_dead start 2023-11-04T01:43:53.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.509+0000 7fdcd09e7640 1 -- 172.21.15.44:0/2437305867 shutdown_connections 2023-11-04T01:43:53.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.509+0000 7fdcd09e7640 1 -- 172.21.15.44:0/2437305867 >> 172.21.15.44:0/2437305867 conn(0x7fdccc0cb530 msgr2=0x7fdccc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:53.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.509+0000 7fdcd09e7640 1 -- 172.21.15.44:0/2437305867 shutdown_connections 2023-11-04T01:43:53.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.509+0000 7fdcd09e7640 1 -- 172.21.15.44:0/2437305867 wait complete. 2023-11-04T01:43:53.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.510+0000 7fdcd09e7640 1 Processor -- start 2023-11-04T01:43:53.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.510+0000 7fdcd09e7640 1 -- start start 2023-11-04T01:43:53.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcd09e7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcb8003970 0x7fdccc1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcd09e7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc153f90 0x7fdccc158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcd09e7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc15ca20 0x7fdccc15ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcd09e7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc15d410 con 0x7fdcb8003970 2023-11-04T01:43:53.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcd09e7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc15b160 con 0x7fdccc15ca20 2023-11-04T01:43:53.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcd09e7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0c5b80 con 0x7fdccc153f90 2023-11-04T01:43:53.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcca59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcb8003970 0x7fdccc1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcca59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcb8003970 0x7fdccc1536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38408/0 (socket says 172.21.15.44:38408) 2023-11-04T01:43:53.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcca59c640 1 -- 172.21.15.44:0/3059149437 learned_addr learned my addr 172.21.15.44:0/3059149437 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:53.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdccad9d640 1 --2- 172.21.15.44:0/3059149437 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc15ca20 0x7fdccc15ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcc9d9b640 1 --2- 172.21.15.44:0/3059149437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc153f90 0x7fdccc158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcca59c640 1 -- 172.21.15.44:0/3059149437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc153f90 msgr2=0x7fdccc158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcca59c640 1 --2- 172.21.15.44:0/3059149437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc153f90 0x7fdccc158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcca59c640 1 -- 172.21.15.44:0/3059149437 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc15ca20 msgr2=0x7fdccc15ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcca59c640 1 --2- 172.21.15.44:0/3059149437 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc15ca20 0x7fdccc15ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcca59c640 1 -- 172.21.15.44:0/3059149437 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0c5dd0 con 0x7fdcb8003970 2023-11-04T01:43:53.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcca59c640 1 --2- 172.21.15.44:0/3059149437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcb8003970 0x7fdccc1536b0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4001930 tx=0x7fdccc0ce210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:53.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcc2ffd640 1 -- 172.21.15.44:0/3059149437 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4039070 con 0x7fdcb8003970 2023-11-04T01:43:53.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcc2ffd640 1 -- 172.21.15.44:0/3059149437 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc402dd90 con 0x7fdcb8003970 2023-11-04T01:43:53.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcd09e7640 1 -- 172.21.15.44:0/3059149437 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdccc0c60b0 con 0x7fdcb8003970 2023-11-04T01:43:53.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcc2ffd640 1 -- 172.21.15.44:0/3059149437 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40072b0 con 0x7fdcb8003970 2023-11-04T01:43:53.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.511+0000 7fdcd09e7640 1 -- 172.21.15.44:0/3059149437 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc0c6670 con 0x7fdcb8003970 2023-11-04T01:43:53.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.513+0000 7fdcd09e7640 1 -- 172.21.15.44:0/3059149437 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdccc0c6800 con 0x7fdcb8003970 2023-11-04T01:43:53.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.513+0000 7fdcc2ffd640 1 -- 172.21.15.44:0/3059149437 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdcc4032070 con 0x7fdcb8003970 2023-11-04T01:43:53.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.513+0000 7fdcc2ffd640 1 --2- 172.21.15.44:0/3059149437 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdcac06aea0 0x7fdcac06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.513+0000 7fdcc2ffd640 1 -- 172.21.15.44:0/3059149437 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7fdcc403c040 con 0x7fdcb8003970 2023-11-04T01:43:53.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.513+0000 7fdcc9d9b640 1 --2- 172.21.15.44:0/3059149437 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdcac06aea0 0x7fdcac06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.514+0000 7fdcc9d9b640 1 --2- 172.21.15.44:0/3059149437 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdcac06aea0 0x7fdcac06d360 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdccc1546e0 tx=0x7fdcb4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:53.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.517+0000 7fdcc2ffd640 1 -- 172.21.15.44:0/3059149437 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdcc4075af0 con 0x7fdcb8003970 2023-11-04T01:43:53.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.697+0000 7fdcd09e7640 1 -- 172.21.15.44:0/3059149437 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdccc0684b0 con 0x7fdcb8003970 2023-11-04T01:43:53.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.699+0000 7fdcc2ffd640 1 -- 172.21.15.44:0/3059149437 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+23565 (secure 0 0 0) 0x7fdcc4045020 con 0x7fdcb8003970 2023-11-04T01:43:53.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:53.701 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":114,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:43:50.266269+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:28.109628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:28.871834+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":2}]},{"pgid":"17.37","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/2720398401":"2023-11-05T01:43:41.768312+0000","192.168.0.1:0/1398028154":"2023-11-04T02:42:59.149511+0000","172.21.15.204:6836/3267689413":"2023-11-05T01:42:50.946757+0000","172.21.15.44:6835/3264332323":"2023-11-05T01:42:44.043453+0000","172.21.15.44:6832/22987540":"2023-11-05T01:43:34.391624+0000","172.21.15.44:6833/3264332323":"2023-11-05T01:42:44.043453+0000","172.21.15.44:6832/2069525699":"2023-11-05T01:42:05.849526+0000","172.21.15.44:6834/22987540":"2023-11-05T01:43:34.391624+0000","172.21.15.204:6834/3267689413":"2023-11-05T01:42:50.946757+0000","172.21.15.204:6836/2461924520":"2023-11-05T01:40:15.032018+0000","172.21.15.204:6834/3287638895":"2023-11-05T01:41:58.941997+0000","172.21.15.44:6833/2720398401":"2023-11-05T01:43:41.768312+0000","172.21.15.44:6834/2069525699":"2023-11-05T01:42:05.849526+0000","192.168.0.1:0/1480686415":"2023-11-04T02:43:49.496043+0000","172.21.15.44:6833/2252282753":"2023-11-05T01:40:40.408324+0000","172.21.15.44:6835/2252282753":"2023-11-05T01:40:40.408324+0000","172.21.15.204:6834/2461924520":"2023-11-05T01:40:15.032018+0000","192.168.0.1:0/780133444":"2023-11-04T02:42:14.050728+0000","172.21.15.44:6835/1627866359":"2023-11-05T01:41:31.011032+0000","172.21.15.44:6833/1627866359":"2023-11-05T01:41:31.011032+0000","172.21.15.204:6834/3065829953":"2023-11-05T01:41:05.691698+0000","172.21.15.204:6836/3287638895":"2023-11-05T01:41:58.941997+0000","172.21.15.204:6836/3065829953":"2023-11-05T01:41:05.691698+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:53.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.701+0000 7fdcd09e7640 1 -- 172.21.15.44:0/3059149437 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdcac06aea0 msgr2=0x7fdcac06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.701+0000 7fdcd09e7640 1 --2- 172.21.15.44:0/3059149437 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdcac06aea0 0x7fdcac06d360 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdccc1546e0 tx=0x7fdcb4008040 comp rx=0 tx=0).stop 2023-11-04T01:43:53.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.701+0000 7fdcd09e7640 1 -- 172.21.15.44:0/3059149437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcb8003970 msgr2=0x7fdccc1536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.701+0000 7fdcd09e7640 1 --2- 172.21.15.44:0/3059149437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcb8003970 0x7fdccc1536b0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4001930 tx=0x7fdccc0ce210 comp rx=0 tx=0).stop 2023-11-04T01:43:53.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.701+0000 7fdcd09e7640 1 -- 172.21.15.44:0/3059149437 shutdown_connections 2023-11-04T01:43:53.703 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.701+0000 7fdcd09e7640 1 --2- 172.21.15.44:0/3059149437 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdcac06aea0 0x7fdcac06d360 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.701+0000 7fdcd09e7640 1 --2- 172.21.15.44:0/3059149437 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc15ca20 0x7fdccc15ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.701+0000 7fdcd09e7640 1 --2- 172.21.15.44:0/3059149437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc153f90 0x7fdccc158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.701+0000 7fdcd09e7640 1 --2- 172.21.15.44:0/3059149437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcb8003970 0x7fdccc1536b0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.701+0000 7fdcd09e7640 1 -- 172.21.15.44:0/3059149437 >> 172.21.15.44:0/3059149437 conn(0x7fdccc0cb530 msgr2=0x7fdccc0b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:53.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.701+0000 7fdcd09e7640 1 -- 172.21.15.44:0/3059149437 shutdown_connections 2023-11-04T01:43:53.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.701+0000 7fdcd09e7640 1 -- 172.21.15.44:0/3059149437 wait complete. 2023-11-04T01:43:53.713 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:34.917670+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:35.547044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:28.109628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:28.871834+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:53.714 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:53.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.821+0000 7fc74b725640 1 Processor -- start 2023-11-04T01:43:53.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.821+0000 7fc74b725640 1 -- start start 2023-11-04T01:43:53.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.822+0000 7fc74b725640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc7440ca1a0 0x7fc7440ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.822+0000 7fc74b725640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7440b25a0 con 0x7fc74415d4e0 2023-11-04T01:43:53.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.822+0000 7fc74b725640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7440b2300 con 0x7fc74406a0d0 2023-11-04T01:43:53.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.822+0000 7fc74b725640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7440cab60 con 0x7fc7440ca1a0 2023-11-04T01:43:53.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.822+0000 7fc7494c1640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc74415d4e0 0x7fc7440ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51122/0 (socket says 172.21.15.44:51122) 2023-11-04T01:43:53.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.822+0000 7fc7494c1640 1 -- 172.21.15.44:0/4026905071 learned_addr learned my addr 172.21.15.44:0/4026905071 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:53.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.822+0000 7fc73bfff640 1 -- 172.21.15.44:0/4026905071 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625403085 0 0) 0x7fc7440b25a0 con 0x7fc74415d4e0 2023-11-04T01:43:53.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.822+0000 7fc73bfff640 1 -- 172.21.15.44:0/4026905071 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc730003520 con 0x7fc74415d4e0 2023-11-04T01:43:53.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.822+0000 7fc748cc0640 1 --2- 172.21.15.44:0/4026905071 >> v2:172.21.15.204:3300/0 conn(0x7fc7440ca1a0 0x7fc7440ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.822+0000 7fc73bfff640 1 -- 172.21.15.44:0/4026905071 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1928273032 0 0) 0x7fc730003520 con 0x7fc74415d4e0 2023-11-04T01:43:53.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc73bfff640 1 -- 172.21.15.44:0/4026905071 >> v2:172.21.15.204:3300/0 conn(0x7fc7440ca1a0 msgr2=0x7fc7440ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:53.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc73bfff640 1 --2- 172.21.15.44:0/4026905071 >> v2:172.21.15.204:3300/0 conn(0x7fc7440ca1a0 0x7fc7440ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc73bfff640 1 -- 172.21.15.44:0/4026905071 >> v1:172.21.15.204:6789/0 conn(0x7fc74406a0d0 legacy=0x7fc74406a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc73bfff640 1 -- 172.21.15.44:0/4026905071 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74415d8c0 con 0x7fc74415d4e0 2023-11-04T01:43:53.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc73bfff640 1 -- 172.21.15.44:0/4026905071 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fc740001670 con 0x7fc74415d4e0 2023-11-04T01:43:53.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc73bfff640 1 -- 172.21.15.44:0/4026905071 >> v1:172.21.15.44:6789/0 conn(0x7fc74415d4e0 legacy=0x7fc7440ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc73bfff640 1 --2- 172.21.15.44:0/4026905071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc730003970 0x7fc730003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc73bfff640 1 --2- 172.21.15.44:0/4026905071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7300047c0 0x7fc730004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc73bfff640 1 --2- 172.21.15.44:0/4026905071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc730005180 0x7fc73000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc73bfff640 1 -- 172.21.15.44:0/4026905071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7440cab60 con 0x7fc7300047c0 2023-11-04T01:43:53.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc73bfff640 1 -- 172.21.15.44:0/4026905071 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73000c120 con 0x7fc730005180 2023-11-04T01:43:53.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc73bfff640 1 -- 172.21.15.44:0/4026905071 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73000c2e0 con 0x7fc730003970 2023-11-04T01:43:53.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc748cc0640 1 --2- 172.21.15.44:0/4026905071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7300047c0 0x7fc730004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc7494c1640 1 --2- 172.21.15.44:0/4026905071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc730003970 0x7fc730003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc749cc2640 1 --2- 172.21.15.44:0/4026905071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc730005180 0x7fc73000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc748cc0640 1 -- 172.21.15.44:0/4026905071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc730003970 msgr2=0x7fc730003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc748cc0640 1 --2- 172.21.15.44:0/4026905071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc730003970 0x7fc730003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc748cc0640 1 -- 172.21.15.44:0/4026905071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc730005180 msgr2=0x7fc73000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc748cc0640 1 --2- 172.21.15.44:0/4026905071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc730005180 0x7fc73000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc748cc0640 1 -- 172.21.15.44:0/4026905071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc730003520 con 0x7fc7300047c0 2023-11-04T01:43:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc7494c1640 1 --2- 172.21.15.44:0/4026905071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc730003970 0x7fc730003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc749cc2640 1 --2- 172.21.15.44:0/4026905071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc730005180 0x7fc73000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.823+0000 7fc749cc2640 1 -- 172.21.15.44:0/4026905071 reap_dead start 2023-11-04T01:43:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.824+0000 7fc748cc0640 1 --2- 172.21.15.44:0/4026905071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7300047c0 0x7fc730004c40 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fc734009ac0 tx=0x7fc7300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738f140d9ea0732e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.824+0000 7fc73bfff640 1 -- 172.21.15.44:0/4026905071 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73402c6b0 con 0x7fc7300047c0 2023-11-04T01:43:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.824+0000 7fc73bfff640 1 -- 172.21.15.44:0/4026905071 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73402c810 con 0x7fc7300047c0 2023-11-04T01:43:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.824+0000 7fc73bfff640 1 -- 172.21.15.44:0/4026905071 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73402cba0 con 0x7fc7300047c0 2023-11-04T01:43:53.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.824+0000 7fc74b725640 1 -- 172.21.15.44:0/4026905071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7300047c0 msgr2=0x7fc730004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.824+0000 7fc74b725640 1 --2- 172.21.15.44:0/4026905071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7300047c0 0x7fc730004c40 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fc734009ac0 tx=0x7fc7300057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.825+0000 7fc74b725640 1 -- 172.21.15.44:0/4026905071 shutdown_connections 2023-11-04T01:43:53.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.825+0000 7fc74b725640 1 --2- 172.21.15.44:0/4026905071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7300047c0 0x7fc730004c40 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.825+0000 7fc74b725640 1 -- 172.21.15.44:0/4026905071 >> 172.21.15.44:0/4026905071 conn(0x7fc7440b1640 msgr2=0x7fc7440b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:53.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.825+0000 7fc74b725640 1 -- 172.21.15.44:0/4026905071 shutdown_connections 2023-11-04T01:43:53.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.825+0000 7fc74b725640 1 -- 172.21.15.44:0/4026905071 wait complete. 2023-11-04T01:43:53.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.826+0000 7fc74b725640 1 Processor -- start 2023-11-04T01:43:53.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.826+0000 7fc74b725640 1 -- start start 2023-11-04T01:43:53.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.826+0000 7fc74b725640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7300047c0 0x7fc744154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.826+0000 7fc74b725640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74415c1f0 0x7fc74415c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.826+0000 7fc74b725640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7440c37a0 0x7fc7440c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc74b725640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74415cbb0 con 0x7fc74415c1f0 2023-11-04T01:43:53.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc74b725640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7441f6ae0 con 0x7fc7440c37a0 2023-11-04T01:43:53.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc74b725640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7441f6d30 con 0x7fc7300047c0 2023-11-04T01:43:53.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc748cc0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74415c1f0 0x7fc74415c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc748cc0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74415c1f0 0x7fc74415c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38420/0 (socket says 172.21.15.44:38420) 2023-11-04T01:43:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc748cc0640 1 -- 172.21.15.44:0/2442302106 learned_addr learned my addr 172.21.15.44:0/2442302106 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc749cc2640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7440c37a0 0x7fc7440c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc7494c1640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7300047c0 0x7fc744154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc748cc0640 1 -- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7300047c0 msgr2=0x7fc744154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc748cc0640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7300047c0 0x7fc744154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc748cc0640 1 -- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7440c37a0 msgr2=0x7fc7440c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc748cc0640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7440c37a0 0x7fc7440c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc748cc0640 1 -- 172.21.15.44:0/2442302106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7441f7010 con 0x7fc74415c1f0 2023-11-04T01:43:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc749cc2640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7440c37a0 0x7fc7440c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc7494c1640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7300047c0 0x7fc744154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc748cc0640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74415c1f0 0x7fc74415c670 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fc73402c250 tx=0x7fc734004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:53.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc739ffb640 1 -- 172.21.15.44:0/2442302106 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734003810 con 0x7fc74415c1f0 2023-11-04T01:43:53.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc739ffb640 1 -- 172.21.15.44:0/2442302106 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc734003970 con 0x7fc74415c1f0 2023-11-04T01:43:53.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc74b725640 1 -- 172.21.15.44:0/2442302106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7441f72f0 con 0x7fc74415c1f0 2023-11-04T01:43:53.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.827+0000 7fc739ffb640 1 -- 172.21.15.44:0/2442302106 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734003d00 con 0x7fc74415c1f0 2023-11-04T01:43:53.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.828+0000 7fc74b725640 1 -- 172.21.15.44:0/2442302106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7441f78b0 con 0x7fc74415c1f0 2023-11-04T01:43:53.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.828+0000 7fc74b725640 1 -- 172.21.15.44:0/2442302106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7440684b0 con 0x7fc74415c1f0 2023-11-04T01:43:53.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.829+0000 7fc739ffb640 1 -- 172.21.15.44:0/2442302106 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc734047450 con 0x7fc74415c1f0 2023-11-04T01:43:53.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.829+0000 7fc739ffb640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc72806ae70 0x7fc72806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.829+0000 7fc739ffb640 1 -- 172.21.15.44:0/2442302106 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7fc7340ac350 con 0x7fc74415c1f0 2023-11-04T01:43:53.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.830+0000 7fc7494c1640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc72806ae70 0x7fc72806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.830+0000 7fc7494c1640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc72806ae70 0x7fc72806d330 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc740000f60 tx=0x7fc740000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:53.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:53.834+0000 7fc739ffb640 1 -- 172.21.15.44:0/2442302106 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc734076bb0 con 0x7fc74415c1f0 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.007+0000 7fc74b725640 1 -- 172.21.15.44:0/2442302106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7440b5660 con 0x7fc74415c1f0 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.008+0000 7fc739ffb640 1 -- 172.21.15.44:0/2442302106 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v114) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc734003e60 con 0x7fc74415c1f0 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.010+0000 7fc74b725640 1 -- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc72806ae70 msgr2=0x7fc72806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.010+0000 7fc74b725640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc72806ae70 0x7fc72806d330 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc740000f60 tx=0x7fc740000ed0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.010+0000 7fc74b725640 1 -- 172.21.15.44:0/2442302106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74415c1f0 msgr2=0x7fc74415c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.010+0000 7fc74b725640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74415c1f0 0x7fc74415c670 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fc73402c250 tx=0x7fc734004730 comp rx=0 tx=0).stop 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.010+0000 7fc74b725640 1 -- 172.21.15.44:0/2442302106 shutdown_connections 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.010+0000 7fc74b725640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc72806ae70 0x7fc72806d330 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.010+0000 7fc74b725640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc7440c37a0 0x7fc7440c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.010+0000 7fc74b725640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74415c1f0 0x7fc74415c670 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.010+0000 7fc74b725640 1 --2- 172.21.15.44:0/2442302106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc7300047c0 0x7fc744154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.010+0000 7fc74b725640 1 -- 172.21.15.44:0/2442302106 >> 172.21.15.44:0/2442302106 conn(0x7fc7440b1640 msgr2=0x7fc74406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.010+0000 7fc74b725640 1 -- 172.21.15.44:0/2442302106 shutdown_connections 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.010+0000 7fc74b725640 1 -- 172.21.15.44:0/2442302106 wait complete. 2023-11-04T01:43:54.022 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.129+0000 7f0102955640 1 Processor -- start 2023-11-04T01:43:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.129+0000 7f0102955640 1 -- start start 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.130+0000 7f0102955640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f00fc0ceda0 0x7f00fc15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.130+0000 7f0102955640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc0b2210 0x7f00fc15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.130+0000 7f0102955640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00fc15d9a0 con 0x7f00fc0cf180 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.130+0000 7f0102955640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00fc0b1df0 con 0x7f00fc0ceda0 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.130+0000 7f0102955640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0cfd20 con 0x7f00fc0b2210 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.130+0000 7f0100ef2640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f00fc0cf180 0x7f00fc0cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51124/0 (socket says 172.21.15.44:51124) 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.130+0000 7f0100ef2640 1 -- 172.21.15.44:0/985600875 learned_addr learned my addr 172.21.15.44:0/985600875 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.130+0000 7f00fb7fe640 1 --2- 172.21.15.44:0/985600875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc0b2210 0x7f00fc15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.130+0000 7f00fbfff640 1 --2- 172.21.15.44:0/985600875 >> v2:172.21.15.204:3300/0 conn(0x7f00fc0ceda0 0x7f00fc15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.130+0000 7f00faffd640 1 -- 172.21.15.44:0/985600875 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378810164 0 0) 0x7f00fc15d9a0 con 0x7f00fc0cf180 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00faffd640 1 -- 172.21.15.44:0/985600875 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00e8003520 con 0x7f00fc0cf180 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00faffd640 1 -- 172.21.15.44:0/985600875 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 449224649 0 0) 0x7f00e8003520 con 0x7f00fc0cf180 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00faffd640 1 -- 172.21.15.44:0/985600875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc0b2210 msgr2=0x7f00fc15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00faffd640 1 --2- 172.21.15.44:0/985600875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc0b2210 0x7f00fc15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00faffd640 1 -- 172.21.15.44:0/985600875 >> v2:172.21.15.204:3300/0 conn(0x7f00fc0ceda0 msgr2=0x7f00fc15cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00faffd640 1 --2- 172.21.15.44:0/985600875 >> v2:172.21.15.204:3300/0 conn(0x7f00fc0ceda0 0x7f00fc15cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00faffd640 1 -- 172.21.15.44:0/985600875 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc0b0150 con 0x7f00fc0cf180 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00faffd640 1 -- 172.21.15.44:0/985600875 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f00f40019f0 con 0x7f00fc0cf180 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00faffd640 1 -- 172.21.15.44:0/985600875 >> v1:172.21.15.44:6789/0 conn(0x7f00fc0cf180 legacy=0x7f00fc0cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00faffd640 1 --2- 172.21.15.44:0/985600875 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e8003970 0x7f00e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00faffd640 1 --2- 172.21.15.44:0/985600875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e80047c0 0x7f00e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00faffd640 1 --2- 172.21.15.44:0/985600875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc0b2210 0x7f00e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00faffd640 1 -- 172.21.15.44:0/985600875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0b1df0 con 0x7f00e80047c0 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00faffd640 1 -- 172.21.15.44:0/985600875 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0cfd20 con 0x7f00e8003970 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00faffd640 1 -- 172.21.15.44:0/985600875 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e800b980 con 0x7f00fc0b2210 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00fbfff640 1 --2- 172.21.15.44:0/985600875 >> v2:172.21.15.204:3300/0 conn(0x7f00fc0ceda0 0x7f00fc15cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00fb7fe640 1 --2- 172.21.15.44:0/985600875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e80047c0 0x7f00e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f0100ef2640 1 --2- 172.21.15.44:0/985600875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc0b2210 0x7f00e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00fbfff640 1 --2- 172.21.15.44:0/985600875 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e8003970 0x7f00e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00fb7fe640 1 -- 172.21.15.44:0/985600875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc0b2210 msgr2=0x7f00e8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00fb7fe640 1 --2- 172.21.15.44:0/985600875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc0b2210 0x7f00e8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00fb7fe640 1 -- 172.21.15.44:0/985600875 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e8003970 msgr2=0x7f00e8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00fb7fe640 1 --2- 172.21.15.44:0/985600875 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e8003970 0x7f00e8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.131+0000 7f00fb7fe640 1 -- 172.21.15.44:0/985600875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e8003520 con 0x7f00e80047c0 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.132+0000 7f00fb7fe640 1 --2- 172.21.15.44:0/985600875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e80047c0 0x7f00e8004c40 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009af0 tx=0x7f00e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ac8bf0197cfec1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.132+0000 7f00faffd640 1 -- 172.21.15.44:0/985600875 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e402c6b0 con 0x7f00e80047c0 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.132+0000 7f00faffd640 1 -- 172.21.15.44:0/985600875 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e402c810 con 0x7f00e80047c0 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.132+0000 7f00faffd640 1 -- 172.21.15.44:0/985600875 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e402cba0 con 0x7f00e80047c0 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.133+0000 7f0102955640 1 -- 172.21.15.44:0/985600875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e80047c0 msgr2=0x7f00e8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.133+0000 7f0102955640 1 --2- 172.21.15.44:0/985600875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e80047c0 0x7f00e8004c40 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009af0 tx=0x7f00e80057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.133+0000 7f0100ef2640 1 -- 172.21.15.44:0/985600875 reap_dead start 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.133+0000 7f0102955640 1 -- 172.21.15.44:0/985600875 shutdown_connections 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.133+0000 7f0102955640 1 -- 172.21.15.44:0/985600875 >> 172.21.15.44:0/985600875 conn(0x7f00fc0d0c30 msgr2=0x7f00fc0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.133+0000 7f0102955640 1 -- 172.21.15.44:0/985600875 shutdown_connections 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.133+0000 7f0102955640 1 -- 172.21.15.44:0/985600875 wait complete. 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.134+0000 7f0102955640 1 Processor -- start 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.134+0000 7f0102955640 1 -- start start 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f0102955640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e80047c0 0x7f00fc1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f0102955640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00fc0cb260 0x7f00fc0af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f0102955640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc0cb6c0 0x7f00fc0af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f0102955640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0cbc40 con 0x7f00fc0cb260 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f0102955640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0cbf20 con 0x7f00e80047c0 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f0102955640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0cc200 con 0x7f00fc0cb6c0 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f00fb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00fc0cb260 0x7f00fc0af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f00fb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00fc0cb260 0x7f00fc0af010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38448/0 (socket says 172.21.15.44:38448) 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f00fb7fe640 1 -- 172.21.15.44:0/2001573011 learned_addr learned my addr 172.21.15.44:0/2001573011 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f00fbfff640 1 --2- 172.21.15.44:0/2001573011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e80047c0 0x7f00fc1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f0100ef2640 1 --2- 172.21.15.44:0/2001573011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc0cb6c0 0x7f00fc0af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f00fb7fe640 1 -- 172.21.15.44:0/2001573011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc0cb6c0 msgr2=0x7f00fc0af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f00fb7fe640 1 --2- 172.21.15.44:0/2001573011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc0cb6c0 0x7f00fc0af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f00fb7fe640 1 -- 172.21.15.44:0/2001573011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e80047c0 msgr2=0x7f00fc1551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f00fb7fe640 1 --2- 172.21.15.44:0/2001573011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e80047c0 0x7f00fc1551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f00fb7fe640 1 -- 172.21.15.44:0/2001573011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc0cc4e0 con 0x7f00fc0cb260 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.135+0000 7f0100ef2640 1 --2- 172.21.15.44:0/2001573011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc0cb6c0 0x7f00fc0af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.136+0000 7f00fb7fe640 1 --2- 172.21.15.44:0/2001573011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00fc0cb260 0x7f00fc0af010 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f00e4037040 tx=0x7f00e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.136+0000 7f00f8ff9640 1 -- 172.21.15.44:0/2001573011 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4003810 con 0x7f00fc0cb260 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.136+0000 7f00f8ff9640 1 -- 172.21.15.44:0/2001573011 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e4003970 con 0x7f00fc0cb260 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.136+0000 7f0102955640 1 -- 172.21.15.44:0/2001573011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00fc1572b0 con 0x7f00fc0cb260 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.136+0000 7f00f8ff9640 1 -- 172.21.15.44:0/2001573011 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4003ce0 con 0x7f00fc0cb260 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.136+0000 7f0102955640 1 -- 172.21.15.44:0/2001573011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00fc1556e0 con 0x7f00fc0cb260 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.137+0000 7f0102955640 1 -- 172.21.15.44:0/2001573011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00fc0684b0 con 0x7f00fc0cb260 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.137+0000 7f00f8ff9640 1 -- 172.21.15.44:0/2001573011 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f00e4034440 con 0x7f00fc0cb260 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.138+0000 7f00f8ff9640 1 --2- 172.21.15.44:0/2001573011 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00dc06ae70 0x7f00dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.138+0000 7f00f8ff9640 1 -- 172.21.15.44:0/2001573011 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7f00e40ac1a0 con 0x7f00fc0cb260 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.138+0000 7f00fbfff640 1 --2- 172.21.15.44:0/2001573011 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00dc06ae70 0x7f00dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.138+0000 7f00fbfff640 1 --2- 172.21.15.44:0/2001573011 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00dc06ae70 0x7f00dc06d330 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009db0 tx=0x7f00ec009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.142+0000 7f00f8ff9640 1 -- 172.21.15.44:0/2001573011 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00e4076980 con 0x7f00fc0cb260 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.318+0000 7f0102955640 1 -- 172.21.15.44:0/2001573011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f00fc06c730 con 0x7f00fc0cb260 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.318+0000 7f00f8ff9640 1 -- 172.21.15.44:0/2001573011 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v114) v1 ==== 103+0+11 (secure 0 0 0) 0x7f00e404c0a0 con 0x7f00fc0cb260 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.320+0000 7f0102955640 1 -- 172.21.15.44:0/2001573011 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00dc06ae70 msgr2=0x7f00dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.320+0000 7f0102955640 1 --2- 172.21.15.44:0/2001573011 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00dc06ae70 0x7f00dc06d330 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009db0 tx=0x7f00ec009110 comp rx=0 tx=0).stop 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.320+0000 7f0102955640 1 -- 172.21.15.44:0/2001573011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00fc0cb260 msgr2=0x7f00fc0af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.320+0000 7f0102955640 1 --2- 172.21.15.44:0/2001573011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00fc0cb260 0x7f00fc0af010 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f00e4037040 tx=0x7f00e4004730 comp rx=0 tx=0).stop 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.320+0000 7f0102955640 1 -- 172.21.15.44:0/2001573011 shutdown_connections 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.320+0000 7f0102955640 1 --2- 172.21.15.44:0/2001573011 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f00dc06ae70 0x7f00dc06d330 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.320+0000 7f0102955640 1 --2- 172.21.15.44:0/2001573011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc0cb6c0 0x7f00fc0af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.320+0000 7f0102955640 1 --2- 172.21.15.44:0/2001573011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00fc0cb260 0x7f00fc0af010 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.320+0000 7f0102955640 1 --2- 172.21.15.44:0/2001573011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e80047c0 0x7f00fc1551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.320+0000 7f0102955640 1 -- 172.21.15.44:0/2001573011 >> 172.21.15.44:0/2001573011 conn(0x7f00fc0d0c30 msgr2=0x7f00fc06f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.320+0000 7f0102955640 1 -- 172.21.15.44:0/2001573011 shutdown_connections 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.320+0000 7f0102955640 1 -- 172.21.15.44:0/2001573011 wait complete. 2023-11-04T01:43:54.333 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.439+0000 7f533b439640 1 Processor -- start 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.440+0000 7f533b439640 1 -- start start 2023-11-04T01:43:54.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.440+0000 7f533b439640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53340ca1a0 0x7f53340ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.440+0000 7f533b439640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f533406a0d0 0x7f533406a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.440+0000 7f533b439640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53340b25a0 con 0x7f533415d4e0 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.440+0000 7f533b439640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53340cab60 con 0x7f533406a0d0 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.440+0000 7f533b439640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53340b2300 con 0x7f53340ca1a0 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f53391d5640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f533415d4e0 0x7f53340ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51138/0 (socket says 172.21.15.44:51138) 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f53391d5640 1 -- 172.21.15.44:0/1905340864 learned_addr learned my addr 172.21.15.44:0/1905340864 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f53399d6640 1 --2- 172.21.15.44:0/1905340864 >> v2:172.21.15.204:3300/0 conn(0x7f533406a0d0 0x7f533406a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f53389d4640 1 --2- 172.21.15.44:0/1905340864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53340ca1a0 0x7f53340ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 -- 172.21.15.44:0/1905340864 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228208576 0 0) 0x7f53340b25a0 con 0x7f533415d4e0 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 -- 172.21.15.44:0/1905340864 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5320003520 con 0x7f533415d4e0 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 -- 172.21.15.44:0/1905340864 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1056402158 0 0) 0x7f5320003520 con 0x7f533415d4e0 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 -- 172.21.15.44:0/1905340864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53340ca1a0 msgr2=0x7f53340ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 --2- 172.21.15.44:0/1905340864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53340ca1a0 0x7f53340ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 -- 172.21.15.44:0/1905340864 >> v2:172.21.15.204:3300/0 conn(0x7f533406a0d0 msgr2=0x7f533406a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 --2- 172.21.15.44:0/1905340864 >> v2:172.21.15.204:3300/0 conn(0x7f533406a0d0 0x7f533406a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 -- 172.21.15.44:0/1905340864 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533415d8c0 con 0x7f533415d4e0 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 -- 172.21.15.44:0/1905340864 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f5330001670 con 0x7f533415d4e0 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 -- 172.21.15.44:0/1905340864 >> v1:172.21.15.44:6789/0 conn(0x7f533415d4e0 legacy=0x7f53340ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 --2- 172.21.15.44:0/1905340864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320003970 0x7f5320003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 --2- 172.21.15.44:0/1905340864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53200047c0 0x7f5320004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 --2- 172.21.15.44:0/1905340864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53340ca1a0 0x7f5320005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 -- 172.21.15.44:0/1905340864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53340cab60 con 0x7f5320003970 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 -- 172.21.15.44:0/1905340864 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53340b2300 con 0x7f53200047c0 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f532bfff640 1 -- 172.21.15.44:0/1905340864 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532000b980 con 0x7f53340ca1a0 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f53391d5640 1 --2- 172.21.15.44:0/1905340864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320003970 0x7f5320003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f53389d4640 1 --2- 172.21.15.44:0/1905340864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53200047c0 0x7f5320004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.441+0000 7f53399d6640 1 --2- 172.21.15.44:0/1905340864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53340ca1a0 0x7f5320005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.442+0000 7f53391d5640 1 -- 172.21.15.44:0/1905340864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53340ca1a0 msgr2=0x7f5320005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.442+0000 7f53391d5640 1 --2- 172.21.15.44:0/1905340864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53340ca1a0 0x7f5320005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.442+0000 7f53391d5640 1 -- 172.21.15.44:0/1905340864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53200047c0 msgr2=0x7f5320004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.442+0000 7f53391d5640 1 --2- 172.21.15.44:0/1905340864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53200047c0 0x7f5320004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.442+0000 7f53391d5640 1 -- 172.21.15.44:0/1905340864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5320003520 con 0x7f5320003970 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.442+0000 7f53399d6640 1 --2- 172.21.15.44:0/1905340864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53340ca1a0 0x7f5320005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.442+0000 7f53391d5640 1 --2- 172.21.15.44:0/1905340864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320003970 0x7f5320003d90 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f533000c2c0 tx=0x7f53200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f5b1d06704db10 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.442+0000 7f532bfff640 1 -- 172.21.15.44:0/1905340864 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330005ad0 con 0x7f5320003970 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.442+0000 7f532bfff640 1 -- 172.21.15.44:0/1905340864 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5330005c30 con 0x7f5320003970 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.442+0000 7f532bfff640 1 -- 172.21.15.44:0/1905340864 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533002c8b0 con 0x7f5320003970 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.443+0000 7f533b439640 1 -- 172.21.15.44:0/1905340864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320003970 msgr2=0x7f5320003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.443+0000 7f533b439640 1 --2- 172.21.15.44:0/1905340864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5320003970 0x7f5320003d90 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f533000c2c0 tx=0x7f53200057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.443+0000 7f53399d6640 1 -- 172.21.15.44:0/1905340864 reap_dead start 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.443+0000 7f533b439640 1 -- 172.21.15.44:0/1905340864 shutdown_connections 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.443+0000 7f533b439640 1 -- 172.21.15.44:0/1905340864 >> 172.21.15.44:0/1905340864 conn(0x7f53340b1640 msgr2=0x7f53340b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.443+0000 7f533b439640 1 -- 172.21.15.44:0/1905340864 shutdown_connections 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.443+0000 7f533b439640 1 -- 172.21.15.44:0/1905340864 wait complete. 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.444+0000 7f533b439640 1 Processor -- start 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.444+0000 7f533b439640 1 -- start start 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.445+0000 7f533b439640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5320003970 0x7f5334158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.445+0000 7f533b439640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53340c4090 0x7f53340c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.445+0000 7f533b439640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5334152580 0x7f5334152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.445+0000 7f533b439640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53340c6cc0 con 0x7f5334152580 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.445+0000 7f533b439640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5334152f40 con 0x7f53340c4090 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.445+0000 7f533b439640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53341533f0 con 0x7f5320003970 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.445+0000 7f53399d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5334152580 0x7f5334152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.445+0000 7f53399d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5334152580 0x7f5334152a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38460/0 (socket says 172.21.15.44:38460) 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.445+0000 7f53399d6640 1 -- 172.21.15.44:0/2410388148 learned_addr learned my addr 172.21.15.44:0/2410388148 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.445+0000 7f53399d6640 1 -- 172.21.15.44:0/2410388148 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5320003970 msgr2=0x7f5334158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.445+0000 7f53399d6640 1 --2- 172.21.15.44:0/2410388148 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5320003970 0x7f5334158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.445+0000 7f53399d6640 1 -- 172.21.15.44:0/2410388148 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53340c4090 msgr2=0x7f53340c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.445+0000 7f53399d6640 1 --2- 172.21.15.44:0/2410388148 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53340c4090 0x7f53340c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.445+0000 7f53399d6640 1 -- 172.21.15.44:0/2410388148 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53340c4c00 con 0x7f5334152580 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.446+0000 7f53399d6640 1 --2- 172.21.15.44:0/2410388148 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5334152580 0x7f5334152a00 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f533406f420 tx=0x7f532c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.446+0000 7f5329ffb640 1 -- 172.21.15.44:0/2410388148 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c01b070 con 0x7f5334152580 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.446+0000 7f5329ffb640 1 -- 172.21.15.44:0/2410388148 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c00f040 con 0x7f5334152580 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.446+0000 7f5329ffb640 1 -- 172.21.15.44:0/2410388148 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c00e050 con 0x7f5334152580 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.446+0000 7f533b439640 1 -- 172.21.15.44:0/2410388148 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53340c6f30 con 0x7f5334152580 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.446+0000 7f533b439640 1 -- 172.21.15.44:0/2410388148 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53340c4ee0 con 0x7f5334152580 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.447+0000 7f533b439640 1 -- 172.21.15.44:0/2410388148 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53340c7450 con 0x7f5334152580 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.448+0000 7f5329ffb640 1 -- 172.21.15.44:0/2410388148 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f532c015440 con 0x7f5334152580 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.448+0000 7f5329ffb640 1 --2- 172.21.15.44:0/2410388148 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f531806aea0 0x7f531806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.448+0000 7f5329ffb640 1 -- 172.21.15.44:0/2410388148 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7f532c08a490 con 0x7f5334152580 2023-11-04T01:43:54.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.448+0000 7f53391d5640 1 --2- 172.21.15.44:0/2410388148 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f531806aea0 0x7f531806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.449+0000 7f53391d5640 1 --2- 172.21.15.44:0/2410388148 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f531806aea0 0x7f531806d360 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5330034000 tx=0x7f533002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.452+0000 7f5329ffb640 1 -- 172.21.15.44:0/2410388148 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53340c7450 con 0x7f5334152580 2023-11-04T01:43:54.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.631+0000 7f533b439640 1 -- 172.21.15.44:0/2410388148 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f53340c7450 con 0x7f5334152580 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.632+0000 7f5329ffb640 1 -- 172.21.15.44:0/2410388148 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v114) v1 ==== 103+0+11 (secure 0 0 0) 0x7f53340c7450 con 0x7f5334152580 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.634+0000 7f533b439640 1 -- 172.21.15.44:0/2410388148 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f531806aea0 msgr2=0x7f531806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.634+0000 7f533b439640 1 --2- 172.21.15.44:0/2410388148 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f531806aea0 0x7f531806d360 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5330034000 tx=0x7f533002e000 comp rx=0 tx=0).stop 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.634+0000 7f533b439640 1 -- 172.21.15.44:0/2410388148 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5334152580 msgr2=0x7f5334152a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.634+0000 7f533b439640 1 --2- 172.21.15.44:0/2410388148 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5334152580 0x7f5334152a00 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f533406f420 tx=0x7f532c009f90 comp rx=0 tx=0).stop 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.634+0000 7f533b439640 1 -- 172.21.15.44:0/2410388148 shutdown_connections 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.634+0000 7f533b439640 1 --2- 172.21.15.44:0/2410388148 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f531806aea0 0x7f531806d360 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.634+0000 7f533b439640 1 --2- 172.21.15.44:0/2410388148 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5334152580 0x7f5334152a00 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.634+0000 7f533b439640 1 --2- 172.21.15.44:0/2410388148 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53340c4090 0x7f53340c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.634+0000 7f533b439640 1 --2- 172.21.15.44:0/2410388148 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5320003970 0x7f5334158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.634+0000 7f533b439640 1 -- 172.21.15.44:0/2410388148 >> 172.21.15.44:0/2410388148 conn(0x7f53340b1640 msgr2=0x7f533406ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.634+0000 7f533b439640 1 -- 172.21.15.44:0/2410388148 shutdown_connections 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.634+0000 7f533b439640 1 -- 172.21.15.44:0/2410388148 wait complete. 2023-11-04T01:43:54.646 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:43:54.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.753+0000 7fc3f6b2c640 1 Processor -- start 2023-11-04T01:43:54.756 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.754+0000 7fc3f6b2c640 1 -- start start 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.754+0000 7fc3f6b2c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc3f015d4e0 0x7fc3f00d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.754+0000 7fc3f6b2c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc3f00d3b60 0x7fc3f00d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.754+0000 7fc3f6b2c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f00b32b0 con 0x7fc3f015d100 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.754+0000 7fc3f6b2c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f00cec20 con 0x7fc3f015d4e0 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.754+0000 7fc3f6b2c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f00cee10 con 0x7fc3f00d3b60 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.755+0000 7fc3effff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc3f015d4e0 0x7fc3f00d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.755+0000 7fc3effff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc3f015d4e0 0x7fc3f00d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38474/0 (socket says 172.21.15.44:38474) 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.755+0000 7fc3f48c8640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc3f015d100 0x7fc3f00ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51144/0 (socket says 172.21.15.44:51144) 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.755+0000 7fc3effff640 1 -- 172.21.15.44:0/1476209532 learned_addr learned my addr 172.21.15.44:0/1476209532 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.755+0000 7fc3f50c9640 1 --2- 172.21.15.44:0/1476209532 >> v2:172.21.15.204:3300/0 conn(0x7fc3f00d3b60 0x7fc3f00d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.755+0000 7fc3effff640 1 -- 172.21.15.44:0/1476209532 >> v2:172.21.15.204:3300/0 conn(0x7fc3f00d3b60 msgr2=0x7fc3f00d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.755+0000 7fc3effff640 1 --2- 172.21.15.44:0/1476209532 >> v2:172.21.15.204:3300/0 conn(0x7fc3f00d3b60 0x7fc3f00d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.755+0000 7fc3effff640 1 -- 172.21.15.44:0/1476209532 >> v1:172.21.15.44:6789/0 conn(0x7fc3f015d100 legacy=0x7fc3f00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.755+0000 7fc3effff640 1 -- 172.21.15.44:0/1476209532 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f00b4750 con 0x7fc3f015d4e0 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.755+0000 7fc3ef7fe640 1 -- 172.21.15.44:0/1476209532 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478890840 0 0) 0x7fc3f00b32b0 con 0x7fc3f015d100 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.756+0000 7fc3effff640 1 --2- 172.21.15.44:0/1476209532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3f015d4e0 0x7fc3f00d14d0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fc3f008d6a0 tx=0x7fc3e002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa73bb781e66ad5f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.756+0000 7fc3ef7fe640 1 -- 172.21.15.44:0/1476209532 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0030860 con 0x7fc3f015d4e0 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.756+0000 7fc3ef7fe640 1 -- 172.21.15.44:0/1476209532 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e00309c0 con 0x7fc3f015d4e0 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.756+0000 7fc3ef7fe640 1 -- 172.21.15.44:0/1476209532 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0030d50 con 0x7fc3f015d4e0 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.756+0000 7fc3f6b2c640 1 -- 172.21.15.44:0/1476209532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3f015d4e0 msgr2=0x7fc3f00d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.756+0000 7fc3f6b2c640 1 --2- 172.21.15.44:0/1476209532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3f015d4e0 0x7fc3f00d14d0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fc3f008d6a0 tx=0x7fc3e002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.756+0000 7fc3f6b2c640 1 -- 172.21.15.44:0/1476209532 shutdown_connections 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.756+0000 7fc3f6b2c640 1 --2- 172.21.15.44:0/1476209532 >> v2:172.21.15.204:3300/0 conn(0x7fc3f00d3b60 0x7fc3f00d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.756+0000 7fc3f6b2c640 1 --2- 172.21.15.44:0/1476209532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3f015d4e0 0x7fc3f00d14d0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.756+0000 7fc3f6b2c640 1 -- 172.21.15.44:0/1476209532 >> 172.21.15.44:0/1476209532 conn(0x7fc3f00d2ef0 msgr2=0x7fc3f00d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.756+0000 7fc3f6b2c640 1 -- 172.21.15.44:0/1476209532 shutdown_connections 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.756+0000 7fc3f6b2c640 1 -- 172.21.15.44:0/1476209532 wait complete. 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.757+0000 7fc3f6b2c640 1 Processor -- start 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.758+0000 7fc3f6b2c640 1 -- start start 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.758+0000 7fc3f6b2c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3f00d3b60 0x7fc3f01f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.758+0000 7fc3f6b2c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3f015d100 0x7fc3f00cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.758+0000 7fc3f6b2c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3f015d4e0 0x7fc3f00c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.758+0000 7fc3f6b2c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f00cb520 con 0x7fc3f015d4e0 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.758+0000 7fc3f6b2c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f00ca910 con 0x7fc3f015d100 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.758+0000 7fc3f6b2c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f00cabf0 con 0x7fc3f00d3b60 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3f50c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3f015d4e0 0x7fc3f00c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3f50c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3f015d4e0 0x7fc3f00c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38484/0 (socket says 172.21.15.44:38484) 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3f50c9640 1 -- 172.21.15.44:0/3742163505 learned_addr learned my addr 172.21.15.44:0/3742163505 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3effff640 1 --2- 172.21.15.44:0/3742163505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3f015d100 0x7fc3f00cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3f48c8640 1 --2- 172.21.15.44:0/3742163505 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3f00d3b60 0x7fc3f01f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3f50c9640 1 -- 172.21.15.44:0/3742163505 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3f00d3b60 msgr2=0x7fc3f01f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3f50c9640 1 --2- 172.21.15.44:0/3742163505 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3f00d3b60 0x7fc3f01f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3f50c9640 1 -- 172.21.15.44:0/3742163505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3f015d100 msgr2=0x7fc3f00cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3f50c9640 1 --2- 172.21.15.44:0/3742163505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3f015d100 0x7fc3f00cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3f50c9640 1 -- 172.21.15.44:0/3742163505 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e00094d0 con 0x7fc3f015d4e0 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3f48c8640 1 --2- 172.21.15.44:0/3742163505 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3f00d3b60 0x7fc3f01f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3f50c9640 1 --2- 172.21.15.44:0/3742163505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3f015d4e0 0x7fc3f00c9fc0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800d800 tx=0x7fc3d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3ed7fa640 1 -- 172.21.15.44:0/3742163505 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d800b6c0 con 0x7fc3f015d4e0 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3ed7fa640 1 -- 172.21.15.44:0/3742163505 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d800b840 con 0x7fc3f015d4e0 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3f6b2c640 1 -- 172.21.15.44:0/3742163505 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f00caed0 con 0x7fc3f015d4e0 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3ed7fa640 1 -- 172.21.15.44:0/3742163505 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d800bbf0 con 0x7fc3f015d4e0 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.759+0000 7fc3f6b2c640 1 -- 172.21.15.44:0/3742163505 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f01f24e0 con 0x7fc3f015d4e0 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.760+0000 7fc3f6b2c640 1 -- 172.21.15.44:0/3742163505 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f00cb690 con 0x7fc3f015d4e0 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.761+0000 7fc3ed7fa640 1 -- 172.21.15.44:0/3742163505 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc3d800bd50 con 0x7fc3f015d4e0 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.761+0000 7fc3ed7fa640 1 --2- 172.21.15.44:0/3742163505 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc3d006aea0 0x7fc3d006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.761+0000 7fc3ed7fa640 1 -- 172.21.15.44:0/3742163505 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7fc3d808a5c0 con 0x7fc3f015d4e0 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.761+0000 7fc3f48c8640 1 --2- 172.21.15.44:0/3742163505 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc3d006aea0 0x7fc3d006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.762+0000 7fc3f48c8640 1 --2- 172.21.15.44:0/3742163505 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc3d006aea0 0x7fc3d006d360 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8001e50 tx=0x7fc3e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:54.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.765+0000 7fc3ed7fa640 1 -- 172.21.15.44:0/3742163505 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc3d8054c50 con 0x7fc3f015d4e0 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.940+0000 7fc3f6b2c640 1 -- 172.21.15.44:0/3742163505 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fc3f00684b0 con 0x7fc3f015d4e0 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.940+0000 7fc3ed7fa640 1 -- 172.21.15.44:0/3742163505 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v114) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc3d8058270 con 0x7fc3f015d4e0 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.942+0000 7fc3f6b2c640 1 -- 172.21.15.44:0/3742163505 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc3d006aea0 msgr2=0x7fc3d006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.942+0000 7fc3f6b2c640 1 --2- 172.21.15.44:0/3742163505 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc3d006aea0 0x7fc3d006d360 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8001e50 tx=0x7fc3e8009040 comp rx=0 tx=0).stop 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.942+0000 7fc3f6b2c640 1 -- 172.21.15.44:0/3742163505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3f015d4e0 msgr2=0x7fc3f00c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.942+0000 7fc3f6b2c640 1 --2- 172.21.15.44:0/3742163505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3f015d4e0 0x7fc3f00c9fc0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800d800 tx=0x7fc3d800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.942+0000 7fc3f6b2c640 1 -- 172.21.15.44:0/3742163505 shutdown_connections 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.942+0000 7fc3f6b2c640 1 --2- 172.21.15.44:0/3742163505 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc3d006aea0 0x7fc3d006d360 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.942+0000 7fc3f6b2c640 1 --2- 172.21.15.44:0/3742163505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3f015d4e0 0x7fc3f00c9fc0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.942+0000 7fc3f6b2c640 1 --2- 172.21.15.44:0/3742163505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3f015d100 0x7fc3f00cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.942+0000 7fc3f6b2c640 1 --2- 172.21.15.44:0/3742163505 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3f00d3b60 0x7fc3f01f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.942+0000 7fc3f6b2c640 1 -- 172.21.15.44:0/3742163505 >> 172.21.15.44:0/3742163505 conn(0x7fc3f00d2ef0 msgr2=0x7fc3f006be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.942+0000 7fc3f6b2c640 1 -- 172.21.15.44:0/3742163505 shutdown_connections 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:54.942+0000 7fc3f6b2c640 1 -- 172.21.15.44:0/3742163505 wait complete. 2023-11-04T01:43:54.955 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.062+0000 7f3b0b94c640 1 Processor -- start 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.063+0000 7f3b0b94c640 1 -- start start 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.063+0000 7f3b0b94c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b0415d100 0x7f3b040ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.063+0000 7f3b0b94c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3b040d1be0 0x7f3b040b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.063+0000 7f3b0b94c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b040b32b0 con 0x7f3b0415d4e0 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.063+0000 7f3b0b94c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b040cee10 con 0x7f3b040d1be0 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.063+0000 7f3b0b94c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040b2980 con 0x7f3b0415d100 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.064+0000 7f3b09ee9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3b040d1be0 0x7f3b040b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.064+0000 7f3b08ee7640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3b0415d4e0 0x7f3b040d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51156/0 (socket says 172.21.15.44:51156) 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.064+0000 7f3b08ee7640 1 -- 172.21.15.44:0/881968727 learned_addr learned my addr 172.21.15.44:0/881968727 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.064+0000 7f3b09ee9640 1 --2- 172.21.15.44:0/881968727 >> v2:172.21.15.44:3300/0 conn(0x7f3b040d1be0 0x7f3b040b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38490/0 (socket says 172.21.15.44:38490) 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.064+0000 7f3b096e8640 1 --2- 172.21.15.44:0/881968727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b0415d100 0x7f3b040ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.064+0000 7f3b09ee9640 1 -- 172.21.15.44:0/881968727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b0415d100 msgr2=0x7f3b040ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.064+0000 7f3b09ee9640 1 --2- 172.21.15.44:0/881968727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b0415d100 0x7f3b040ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.064+0000 7f3b09ee9640 1 -- 172.21.15.44:0/881968727 >> v1:172.21.15.44:6789/0 conn(0x7f3b0415d4e0 legacy=0x7f3b040d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.064+0000 7f3b09ee9640 1 -- 172.21.15.44:0/881968727 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b040b2c60 con 0x7f3b040d1be0 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.064+0000 7f3b096e8640 1 --2- 172.21.15.44:0/881968727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b0415d100 0x7f3b040ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.065+0000 7f3b09ee9640 1 --2- 172.21.15.44:0/881968727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b040d1be0 0x7f3b040b3740 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009dc0 tx=0x7f3af402be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54dc15e526d4643 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.065+0000 7f3b03fff640 1 -- 172.21.15.44:0/881968727 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af402cc40 con 0x7f3b040d1be0 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.065+0000 7f3b03fff640 1 -- 172.21.15.44:0/881968727 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af402cda0 con 0x7f3b040d1be0 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.065+0000 7f3b03fff640 1 -- 172.21.15.44:0/881968727 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4034660 con 0x7f3b040d1be0 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.065+0000 7f3b0b94c640 1 -- 172.21.15.44:0/881968727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b040d1be0 msgr2=0x7f3b040b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.065+0000 7f3b0b94c640 1 --2- 172.21.15.44:0/881968727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b040d1be0 0x7f3b040b3740 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009dc0 tx=0x7f3af402be90 comp rx=0 tx=0).stop 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.065+0000 7f3b0b94c640 1 -- 172.21.15.44:0/881968727 shutdown_connections 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.065+0000 7f3b0b94c640 1 --2- 172.21.15.44:0/881968727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b040d1be0 0x7f3b040b3740 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.065+0000 7f3b0b94c640 1 --2- 172.21.15.44:0/881968727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b0415d100 0x7f3b040ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.065+0000 7f3b0b94c640 1 -- 172.21.15.44:0/881968727 >> 172.21.15.44:0/881968727 conn(0x7f3b040d2ef0 msgr2=0x7f3b040d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.066+0000 7f3b0b94c640 1 -- 172.21.15.44:0/881968727 shutdown_connections 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.066+0000 7f3b0b94c640 1 -- 172.21.15.44:0/881968727 wait complete. 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.067+0000 7f3b0b94c640 1 Processor -- start 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.067+0000 7f3b0b94c640 1 -- start start 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.067+0000 7f3b0b94c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b040d1be0 0x7f3b0415eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.067+0000 7f3b0b94c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b0415d100 0x7f3b0414d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.067+0000 7f3b0b94c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b0415d4e0 0x7f3b040b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.067+0000 7f3b0b94c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0415de00 con 0x7f3b0415d100 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.067+0000 7f3b0b94c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0415e0e0 con 0x7f3b040d1be0 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.067+0000 7f3b0b94c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0415e3c0 con 0x7f3b0415d4e0 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b08ee7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b0415d100 0x7f3b0414d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b08ee7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b0415d100 0x7f3b0414d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38500/0 (socket says 172.21.15.44:38500) 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b08ee7640 1 -- 172.21.15.44:0/1282362073 learned_addr learned my addr 172.21.15.44:0/1282362073 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b09ee9640 1 --2- 172.21.15.44:0/1282362073 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b0415d4e0 0x7f3b040b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b096e8640 1 --2- 172.21.15.44:0/1282362073 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b040d1be0 0x7f3b0415eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b08ee7640 1 -- 172.21.15.44:0/1282362073 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b0415d4e0 msgr2=0x7f3b040b75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b08ee7640 1 --2- 172.21.15.44:0/1282362073 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b0415d4e0 0x7f3b040b75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b08ee7640 1 -- 172.21.15.44:0/1282362073 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b040d1be0 msgr2=0x7f3b0415eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b08ee7640 1 --2- 172.21.15.44:0/1282362073 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b040d1be0 0x7f3b0415eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b08ee7640 1 -- 172.21.15.44:0/1282362073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af4009a70 con 0x7f3b0415d100 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b08ee7640 1 --2- 172.21.15.44:0/1282362073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b0415d100 0x7f3b0414d2a0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f3af800c480 tx=0x7f3af800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b01ffb640 1 -- 172.21.15.44:0/1282362073 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8005ce0 con 0x7f3b0415d100 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b01ffb640 1 -- 172.21.15.44:0/1282362073 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af8005e40 con 0x7f3b0415d100 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b0b94c640 1 -- 172.21.15.44:0/1282362073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0415e6a0 con 0x7f3b0415d100 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b01ffb640 1 -- 172.21.15.44:0/1282362073 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80072f0 con 0x7f3b0415d100 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.068+0000 7f3b0b94c640 1 -- 172.21.15.44:0/1282362073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0414d7e0 con 0x7f3b0415d100 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.069+0000 7f3b0b94c640 1 -- 172.21.15.44:0/1282362073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b040684b0 con 0x7f3b0415d100 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.070+0000 7f3b01ffb640 1 -- 172.21.15.44:0/1282362073 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3af8007510 con 0x7f3b0415d100 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.070+0000 7f3b01ffb640 1 --2- 172.21.15.44:0/1282362073 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3af006ae70 0x7f3af006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.070+0000 7f3b01ffb640 1 -- 172.21.15.44:0/1282362073 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7f3af80893c0 con 0x7f3b0415d100 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.070+0000 7f3b096e8640 1 --2- 172.21.15.44:0/1282362073 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3af006ae70 0x7f3af006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.071+0000 7f3b096e8640 1 --2- 172.21.15.44:0/1282362073 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3af006ae70 0x7f3af006d330 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3b0406be30 tx=0x7f3afc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.074+0000 7f3b01ffb640 1 -- 172.21.15.44:0/1282362073 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3af8053c30 con 0x7f3b0415d100 2023-11-04T01:43:55.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.250+0000 7f3b0b94c640 1 -- 172.21.15.44:0/1282362073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b040c9a20 con 0x7f3b0415d100 2023-11-04T01:43:55.252 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.251+0000 7f3b01ffb640 1 -- 172.21.15.44:0/1282362073 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v114) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3af80170a0 con 0x7f3b0415d100 2023-11-04T01:43:55.253 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:43:55.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.252+0000 7f3b0b94c640 1 -- 172.21.15.44:0/1282362073 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3af006ae70 msgr2=0x7f3af006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.252+0000 7f3b0b94c640 1 --2- 172.21.15.44:0/1282362073 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3af006ae70 0x7f3af006d330 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3b0406be30 tx=0x7f3afc008040 comp rx=0 tx=0).stop 2023-11-04T01:43:55.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.252+0000 7f3b0b94c640 1 -- 172.21.15.44:0/1282362073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b0415d100 msgr2=0x7f3b0414d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.252+0000 7f3b0b94c640 1 --2- 172.21.15.44:0/1282362073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b0415d100 0x7f3b0414d2a0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f3af800c480 tx=0x7f3af800c940 comp rx=0 tx=0).stop 2023-11-04T01:43:55.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.253+0000 7f3b0b94c640 1 -- 172.21.15.44:0/1282362073 shutdown_connections 2023-11-04T01:43:55.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.253+0000 7f3b0b94c640 1 --2- 172.21.15.44:0/1282362073 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3af006ae70 0x7f3af006d330 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.253+0000 7f3b0b94c640 1 --2- 172.21.15.44:0/1282362073 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b0415d4e0 0x7f3b040b75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.253+0000 7f3b0b94c640 1 --2- 172.21.15.44:0/1282362073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b0415d100 0x7f3b0414d2a0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.253+0000 7f3b0b94c640 1 --2- 172.21.15.44:0/1282362073 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b040d1be0 0x7f3b0415eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.253+0000 7f3b0b94c640 1 -- 172.21.15.44:0/1282362073 >> 172.21.15.44:0/1282362073 conn(0x7f3b040d2ef0 msgr2=0x7f3b0406a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.253+0000 7f3b0b94c640 1 -- 172.21.15.44:0/1282362073 shutdown_connections 2023-11-04T01:43:55.255 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.253+0000 7f3b0b94c640 1 -- 172.21.15.44:0/1282362073 wait complete. 2023-11-04T01:43:55.265 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:55.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.372+0000 7fdfd044f640 1 Processor -- start 2023-11-04T01:43:55.374 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.373+0000 7fdfd044f640 1 -- start start 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.373+0000 7fdfd044f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdfc815d100 0x7fdfc80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.373+0000 7fdfd044f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdfc80d1be0 0x7fdfc80b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.373+0000 7fdfd044f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc80b32b0 con 0x7fdfc815d4e0 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.373+0000 7fdfd044f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc80cee10 con 0x7fdfc80d1be0 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.373+0000 7fdfd044f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc80b2980 con 0x7fdfc815d100 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.374+0000 7fdfce9ec640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdfc80d1be0 0x7fdfc80b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.374+0000 7fdfcd9ea640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdfc815d4e0 0x7fdfc80d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51164/0 (socket says 172.21.15.44:51164) 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.374+0000 7fdfcd9ea640 1 -- 172.21.15.44:0/3761860704 learned_addr learned my addr 172.21.15.44:0/3761860704 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.374+0000 7fdfce1eb640 1 --2- 172.21.15.44:0/3761860704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdfc815d100 0x7fdfc80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.374+0000 7fdfce9ec640 1 -- 172.21.15.44:0/3761860704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdfc815d100 msgr2=0x7fdfc80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.374+0000 7fdfce9ec640 1 --2- 172.21.15.44:0/3761860704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdfc815d100 0x7fdfc80ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.374+0000 7fdfce9ec640 1 -- 172.21.15.44:0/3761860704 >> v1:172.21.15.44:6789/0 conn(0x7fdfc815d4e0 legacy=0x7fdfc80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.374+0000 7fdfce9ec640 1 -- 172.21.15.44:0/3761860704 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc80b2c60 con 0x7fdfc80d1be0 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.374+0000 7fdfcd1e9640 1 -- 172.21.15.44:0/3761860704 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332150345 0 0) 0x7fdfc80b32b0 con 0x7fdfc815d4e0 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.374+0000 7fdfce1eb640 1 --2- 172.21.15.44:0/3761860704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdfc815d100 0x7fdfc80ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.375+0000 7fdfce9ec640 1 --2- 172.21.15.44:0/3761860704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfc80d1be0 0x7fdfc80b3740 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009dc0 tx=0x7fdfc002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815f4ff52b79cc11 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.375+0000 7fdfcd1e9640 1 -- 172.21.15.44:0/3761860704 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc002cc40 con 0x7fdfc80d1be0 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.375+0000 7fdfcd1e9640 1 -- 172.21.15.44:0/3761860704 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc002cda0 con 0x7fdfc80d1be0 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.375+0000 7fdfcd1e9640 1 -- 172.21.15.44:0/3761860704 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0034660 con 0x7fdfc80d1be0 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.375+0000 7fdfd044f640 1 -- 172.21.15.44:0/3761860704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfc80d1be0 msgr2=0x7fdfc80b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.375+0000 7fdfd044f640 1 --2- 172.21.15.44:0/3761860704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfc80d1be0 0x7fdfc80b3740 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009dc0 tx=0x7fdfc002be90 comp rx=0 tx=0).stop 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.376+0000 7fdfd044f640 1 -- 172.21.15.44:0/3761860704 shutdown_connections 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.376+0000 7fdfd044f640 1 --2- 172.21.15.44:0/3761860704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfc80d1be0 0x7fdfc80b3740 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.376+0000 7fdfd044f640 1 --2- 172.21.15.44:0/3761860704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdfc815d100 0x7fdfc80ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.376+0000 7fdfd044f640 1 -- 172.21.15.44:0/3761860704 >> 172.21.15.44:0/3761860704 conn(0x7fdfc80d2ef0 msgr2=0x7fdfc80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.376+0000 7fdfd044f640 1 -- 172.21.15.44:0/3761860704 shutdown_connections 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.376+0000 7fdfd044f640 1 -- 172.21.15.44:0/3761860704 wait complete. 2023-11-04T01:43:55.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.377+0000 7fdfd044f640 1 Processor -- start 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.377+0000 7fdfd044f640 1 -- start start 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfd044f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdfc80d1be0 0x7fdfc80b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfd044f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdfc815d100 0x7fdfc81f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfd044f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfc815d4e0 0x7fdfc815f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfd044f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc81f3930 con 0x7fdfc815d4e0 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfd044f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc81f3370 con 0x7fdfc80d1be0 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfd044f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc81f3650 con 0x7fdfc815d100 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfce9ec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfc815d4e0 0x7fdfc815f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfce9ec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfc815d4e0 0x7fdfc815f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38518/0 (socket says 172.21.15.44:38518) 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfce9ec640 1 -- 172.21.15.44:0/497122401 learned_addr learned my addr 172.21.15.44:0/497122401 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfcd9ea640 1 --2- 172.21.15.44:0/497122401 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdfc815d100 0x7fdfc81f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfce1eb640 1 --2- 172.21.15.44:0/497122401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdfc80d1be0 0x7fdfc80b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfce9ec640 1 -- 172.21.15.44:0/497122401 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdfc815d100 msgr2=0x7fdfc81f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfce9ec640 1 --2- 172.21.15.44:0/497122401 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdfc815d100 0x7fdfc81f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfce9ec640 1 -- 172.21.15.44:0/497122401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdfc80d1be0 msgr2=0x7fdfc80b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfce9ec640 1 --2- 172.21.15.44:0/497122401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdfc80d1be0 0x7fdfc80b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfce9ec640 1 -- 172.21.15.44:0/497122401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0009a70 con 0x7fdfc815d4e0 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfce9ec640 1 --2- 172.21.15.44:0/497122401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfc815d4e0 0x7fdfc815f450 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0037040 tx=0x7fdfc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfbeffd640 1 -- 172.21.15.44:0/497122401 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0040650 con 0x7fdfc815d4e0 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfbeffd640 1 -- 172.21.15.44:0/497122401 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc00407b0 con 0x7fdfc815d4e0 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfbeffd640 1 -- 172.21.15.44:0/497122401 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0040b60 con 0x7fdfc815d4e0 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfd044f640 1 -- 172.21.15.44:0/497122401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc80b5ba0 con 0x7fdfc815d4e0 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.378+0000 7fdfd044f640 1 -- 172.21.15.44:0/497122401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc80b68e0 con 0x7fdfc815d4e0 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.379+0000 7fdfd044f640 1 -- 172.21.15.44:0/497122401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc80b60c0 con 0x7fdfc815d4e0 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.380+0000 7fdfbeffd640 1 -- 172.21.15.44:0/497122401 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdfc0040cc0 con 0x7fdfc815d4e0 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.380+0000 7fdfbeffd640 1 --2- 172.21.15.44:0/497122401 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdfac06ae70 0x7fdfac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.380+0000 7fdfbeffd640 1 -- 172.21.15.44:0/497122401 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7fdfc00acda0 con 0x7fdfc815d4e0 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.381+0000 7fdfce1eb640 1 --2- 172.21.15.44:0/497122401 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdfac06ae70 0x7fdfac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.381+0000 7fdfce1eb640 1 --2- 172.21.15.44:0/497122401 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdfac06ae70 0x7fdfac06d330 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdfc400c8e0 tx=0x7fdfc4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.386 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.384+0000 7fdfbeffd640 1 -- 172.21.15.44:0/497122401 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdfc00774c0 con 0x7fdfc815d4e0 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.561+0000 7fdfd044f640 1 -- 172.21.15.44:0/497122401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdfc80b6a70 con 0x7fdfc815d4e0 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.561+0000 7fdfbeffd640 1 -- 172.21.15.44:0/497122401 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v114) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdfc007aae0 con 0x7fdfc815d4e0 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:43:55.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.563+0000 7fdfd044f640 1 -- 172.21.15.44:0/497122401 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdfac06ae70 msgr2=0x7fdfac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.563+0000 7fdfd044f640 1 --2- 172.21.15.44:0/497122401 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdfac06ae70 0x7fdfac06d330 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdfc400c8e0 tx=0x7fdfc4008040 comp rx=0 tx=0).stop 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.563+0000 7fdfd044f640 1 -- 172.21.15.44:0/497122401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfc815d4e0 msgr2=0x7fdfc815f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.563+0000 7fdfd044f640 1 --2- 172.21.15.44:0/497122401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfc815d4e0 0x7fdfc815f450 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0037040 tx=0x7fdfc0004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.563+0000 7fdfd044f640 1 -- 172.21.15.44:0/497122401 shutdown_connections 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.563+0000 7fdfd044f640 1 --2- 172.21.15.44:0/497122401 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fdfac06ae70 0x7fdfac06d330 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.563+0000 7fdfd044f640 1 --2- 172.21.15.44:0/497122401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfc815d4e0 0x7fdfc815f450 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.563+0000 7fdfd044f640 1 --2- 172.21.15.44:0/497122401 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdfc815d100 0x7fdfc81f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.563+0000 7fdfd044f640 1 --2- 172.21.15.44:0/497122401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdfc80d1be0 0x7fdfc80b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.563+0000 7fdfd044f640 1 -- 172.21.15.44:0/497122401 >> 172.21.15.44:0/497122401 conn(0x7fdfc80d2ef0 msgr2=0x7fdfc80ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.563+0000 7fdfd044f640 1 -- 172.21.15.44:0/497122401 shutdown_connections 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.563+0000 7fdfd044f640 1 -- 172.21.15.44:0/497122401 wait complete. 2023-11-04T01:43:55.576 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:55.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.681+0000 7f5a82ca2640 1 Processor -- start 2023-11-04T01:43:55.683 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.681+0000 7f5a82ca2640 1 -- start start 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.682+0000 7f5a82ca2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5a7c0ade00 0x7f5a7c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.682+0000 7f5a82ca2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5a7c06c5f0 0x7f5a7c0cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.682+0000 7f5a82ca2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7c06cc90 con 0x7f5a7c06d9c0 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.682+0000 7f5a82ca2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7c0b0e60 con 0x7f5a7c0ade00 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.682+0000 7f5a82ca2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7c06cee0 con 0x7f5a7c06c5f0 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.682+0000 7f5a80a3e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5a7c0ade00 0x7f5a7c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.682+0000 7f5a80a3e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5a7c0ade00 0x7f5a7c0b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38526/0 (socket says 172.21.15.44:38526) 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.682+0000 7f5a80a3e640 1 -- 172.21.15.44:0/2647888985 learned_addr learned my addr 172.21.15.44:0/2647888985 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.682+0000 7f5a80a3e640 1 -- 172.21.15.44:0/2647888985 >> v2:172.21.15.204:3300/0 conn(0x7f5a7c06c5f0 msgr2=0x7f5a7c0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.682+0000 7f5a80a3e640 1 --2- 172.21.15.44:0/2647888985 >> v2:172.21.15.204:3300/0 conn(0x7f5a7c06c5f0 0x7f5a7c0cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.682+0000 7f5a80a3e640 1 -- 172.21.15.44:0/2647888985 >> v1:172.21.15.204:6789/0 conn(0x7f5a7c06d9c0 legacy=0x7f5a7c0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.682+0000 7f5a80a3e640 1 -- 172.21.15.44:0/2647888985 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c06d1c0 con 0x7f5a7c0ade00 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.683+0000 7f5a80a3e640 1 --2- 172.21.15.44:0/2647888985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c0ade00 0x7f5a7c0b0530 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0b44f0 tx=0x7f5a6c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0caab2d7030d840 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.683+0000 7f5a7b7fe640 1 -- 172.21.15.44:0/2647888985 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c031750 con 0x7f5a7c0ade00 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.683+0000 7f5a7b7fe640 1 -- 172.21.15.44:0/2647888985 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c0318b0 con 0x7f5a7c0ade00 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.683+0000 7f5a7b7fe640 1 -- 172.21.15.44:0/2647888985 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c031c40 con 0x7f5a7c0ade00 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.684+0000 7f5a82ca2640 1 -- 172.21.15.44:0/2647888985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c0ade00 msgr2=0x7f5a7c0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.684+0000 7f5a82ca2640 1 --2- 172.21.15.44:0/2647888985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c0ade00 0x7f5a7c0b0530 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0b44f0 tx=0x7f5a6c02b7f0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.684+0000 7f5a82ca2640 1 -- 172.21.15.44:0/2647888985 shutdown_connections 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.684+0000 7f5a82ca2640 1 --2- 172.21.15.44:0/2647888985 >> v2:172.21.15.204:3300/0 conn(0x7f5a7c06c5f0 0x7f5a7c0cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.684+0000 7f5a82ca2640 1 --2- 172.21.15.44:0/2647888985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c0ade00 0x7f5a7c0b0530 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.684+0000 7f5a82ca2640 1 -- 172.21.15.44:0/2647888985 >> 172.21.15.44:0/2647888985 conn(0x7f5a7c0cb530 msgr2=0x7f5a7c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.684+0000 7f5a82ca2640 1 -- 172.21.15.44:0/2647888985 shutdown_connections 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.684+0000 7f5a82ca2640 1 -- 172.21.15.44:0/2647888985 wait complete. 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.685+0000 7f5a82ca2640 1 Processor -- start 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.685+0000 7f5a82ca2640 1 -- start start 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a82ca2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a7c06c5f0 0x7f5a7c159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a82ca2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c06d9c0 0x7f5a7c157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a82ca2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a7c0ade00 0x7f5a7c1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a82ca2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0c37b0 con 0x7f5a7c06d9c0 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a82ca2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c15a7c0 con 0x7f5a7c06c5f0 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a82ca2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c15aaa0 con 0x7f5a7c0ade00 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a7bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c06d9c0 0x7f5a7c157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a7bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c06d9c0 0x7f5a7c157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38530/0 (socket says 172.21.15.44:38530) 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a7bfff640 1 -- 172.21.15.44:0/1963360712 learned_addr learned my addr 172.21.15.44:0/1963360712 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a80a3e640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a7c06c5f0 0x7f5a7c159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a8123f640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a7c0ade00 0x7f5a7c1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a7bfff640 1 -- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a7c0ade00 msgr2=0x7f5a7c1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a7bfff640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a7c0ade00 0x7f5a7c1583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a7bfff640 1 -- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a7c06c5f0 msgr2=0x7f5a7c159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a7bfff640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a7c06c5f0 0x7f5a7c159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a7bfff640 1 -- 172.21.15.44:0/1963360712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c0094d0 con 0x7f5a7c06d9c0 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a80a3e640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a7c06c5f0 0x7f5a7c159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.686+0000 7f5a8123f640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a7c0ade00 0x7f5a7c1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.687+0000 7f5a7bfff640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c06d9c0 0x7f5a7c157ea0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000b410 tx=0x7f5a7000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.687+0000 7f5a797fa640 1 -- 172.21.15.44:0/1963360712 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70011830 con 0x7f5a7c06d9c0 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.687+0000 7f5a797fa640 1 -- 172.21.15.44:0/1963360712 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a70011990 con 0x7f5a7c06d9c0 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.687+0000 7f5a82ca2640 1 -- 172.21.15.44:0/1963360712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7c15ad80 con 0x7f5a7c06d9c0 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.687+0000 7f5a797fa640 1 -- 172.21.15.44:0/1963360712 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70011d40 con 0x7f5a7c06d9c0 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.687+0000 7f5a82ca2640 1 -- 172.21.15.44:0/1963360712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7c15a410 con 0x7f5a7c06d9c0 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.688+0000 7f5a82ca2640 1 -- 172.21.15.44:0/1963360712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7c0684b0 con 0x7f5a7c06d9c0 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.688+0000 7f5a797fa640 1 -- 172.21.15.44:0/1963360712 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a7001a400 con 0x7f5a7c06d9c0 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.689+0000 7f5a797fa640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a6806ae70 0x7f5a6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.689+0000 7f5a797fa640 1 -- 172.21.15.44:0/1963360712 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7f5a7008a000 con 0x7f5a7c06d9c0 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.689+0000 7f5a80a3e640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a6806ae70 0x7f5a6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.689+0000 7f5a80a3e640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a6806ae70 0x7f5a6806d330 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c035000 tx=0x7f5a6c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.693+0000 7f5a797fa640 1 -- 172.21.15.44:0/1963360712 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a700547c0 con 0x7f5a7c06d9c0 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.881+0000 7f5a82ca2640 1 -- 172.21.15.44:0/1963360712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5a7c0cddc0 con 0x7f5a7c06d9c0 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.881+0000 7f5a797fa640 1 -- 172.21.15.44:0/1963360712 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v114) v1 ==== 81+0+1394 (secure 0 0 0) 0x7f5a70057de0 con 0x7f5a7c06d9c0 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/2720398401 2023-11-05T01:43:41.768312+0000 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.1:0/1398028154 2023-11-04T02:42:59.149511+0000 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/3267689413 2023-11-05T01:42:50.946757+0000 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/3264332323 2023-11-05T01:42:44.043453+0000 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6832/22987540 2023-11-05T01:43:34.391624+0000 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/3264332323 2023-11-05T01:42:44.043453+0000 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6832/2069525699 2023-11-05T01:42:05.849526+0000 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/22987540 2023-11-05T01:43:34.391624+0000 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/3267689413 2023-11-05T01:42:50.946757+0000 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/2461924520 2023-11-05T01:40:15.032018+0000 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/3287638895 2023-11-05T01:41:58.941997+0000 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/2720398401 2023-11-05T01:43:41.768312+0000 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/2069525699 2023-11-05T01:42:05.849526+0000 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.1:0/1480686415 2023-11-04T02:43:49.496043+0000 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/2252282753 2023-11-05T01:40:40.408324+0000 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/2252282753 2023-11-05T01:40:40.408324+0000 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/2461924520 2023-11-05T01:40:15.032018+0000 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.1:0/780133444 2023-11-04T02:42:14.050728+0000 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/1627866359 2023-11-05T01:41:31.011032+0000 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/1627866359 2023-11-05T01:41:31.011032+0000 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/3065829953 2023-11-05T01:41:05.691698+0000 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/3287638895 2023-11-05T01:41:58.941997+0000 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/3065829953 2023-11-05T01:41:05.691698+0000 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi044.stderr:listed 23 entries 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.883+0000 7f5a82ca2640 1 -- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a6806ae70 msgr2=0x7f5a6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.883+0000 7f5a82ca2640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a6806ae70 0x7f5a6806d330 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c035000 tx=0x7f5a6c008030 comp rx=0 tx=0).stop 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.883+0000 7f5a82ca2640 1 -- 172.21.15.44:0/1963360712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c06d9c0 msgr2=0x7f5a7c157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.883+0000 7f5a82ca2640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c06d9c0 0x7f5a7c157ea0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000b410 tx=0x7f5a7000b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.883+0000 7f5a82ca2640 1 -- 172.21.15.44:0/1963360712 shutdown_connections 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.883+0000 7f5a82ca2640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f5a6806ae70 0x7f5a6806d330 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.883+0000 7f5a82ca2640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5a7c0ade00 0x7f5a7c1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.883+0000 7f5a82ca2640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c06d9c0 0x7f5a7c157ea0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.883+0000 7f5a82ca2640 1 --2- 172.21.15.44:0/1963360712 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5a7c06c5f0 0x7f5a7c159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.883+0000 7f5a82ca2640 1 -- 172.21.15.44:0/1963360712 >> 172.21.15.44:0/1963360712 conn(0x7f5a7c0cb530 msgr2=0x7f5a7c0c83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.883+0000 7f5a82ca2640 1 -- 172.21.15.44:0/1963360712 shutdown_connections 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:55.883+0000 7f5a82ca2640 1 -- 172.21.15.44:0/1963360712 wait complete. 2023-11-04T01:43:55.895 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:43:55.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:55.895 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:55.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[125389]: fuse finished with error 0 and tester_r 0 2023-11-04T01:43:55.927 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:43:55.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:55.927 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:43:55.983 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:43:55.983 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:56.039 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:43:56.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.182+0000 7fa3e032c640 1 Processor -- start 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.182+0000 7fa3e032c640 1 -- start start 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.183+0000 7fa3e032c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa3d815d4e0 0x7fa3d80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.183+0000 7fa3e032c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3d80d3b60 0x7fa3d80d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.183+0000 7fa3e032c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d80b32b0 con 0x7fa3d815d100 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.183+0000 7fa3e032c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d80cec20 con 0x7fa3d815d4e0 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.183+0000 7fa3e032c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80cee10 con 0x7fa3d80d3b60 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.183+0000 7fa3dd8c7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa3d815d4e0 0x7fa3d80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.184+0000 7fa3dd8c7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa3d815d4e0 0x7fa3d80d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38542/0 (socket says 172.21.15.44:38542) 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.184+0000 7fa3dd8c7640 1 -- 172.21.15.44:0/536501293 learned_addr learned my addr 172.21.15.44:0/536501293 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.184+0000 7fa3de8c9640 1 --2- 172.21.15.44:0/536501293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3d80d3b60 0x7fa3d80d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.184+0000 7fa3dd8c7640 1 -- 172.21.15.44:0/536501293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3d80d3b60 msgr2=0x7fa3d80d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.184+0000 7fa3dd8c7640 1 --2- 172.21.15.44:0/536501293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3d80d3b60 0x7fa3d80d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.184+0000 7fa3dd8c7640 1 -- 172.21.15.44:0/536501293 >> v1:172.21.15.204:6789/0 conn(0x7fa3d815d100 legacy=0x7fa3d80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.184+0000 7fa3dd8c7640 1 -- 172.21.15.44:0/536501293 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d80b4750 con 0x7fa3d815d4e0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.185+0000 7fa3dd8c7640 1 --2- 172.21.15.44:0/536501293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3d815d4e0 0x7fa3d80d14d0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009870 tx=0x7fa3c802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21603551611881f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.185+0000 7fa3dd0c6640 1 -- 172.21.15.44:0/536501293 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8030840 con 0x7fa3d815d4e0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.185+0000 7fa3dd0c6640 1 -- 172.21.15.44:0/536501293 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c80309a0 con 0x7fa3d815d4e0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.185+0000 7fa3dd0c6640 1 -- 172.21.15.44:0/536501293 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8030d30 con 0x7fa3d815d4e0 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.185+0000 7fa3e032c640 1 -- 172.21.15.44:0/536501293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3d815d4e0 msgr2=0x7fa3d80d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.185+0000 7fa3e032c640 1 --2- 172.21.15.44:0/536501293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3d815d4e0 0x7fa3d80d14d0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009870 tx=0x7fa3c802b980 comp rx=0 tx=0).stop 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.185+0000 7fa3e032c640 1 -- 172.21.15.44:0/536501293 shutdown_connections 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.185+0000 7fa3e032c640 1 --2- 172.21.15.44:0/536501293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3d80d3b60 0x7fa3d80d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.185+0000 7fa3e032c640 1 --2- 172.21.15.44:0/536501293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3d815d4e0 0x7fa3d80d14d0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.185+0000 7fa3e032c640 1 -- 172.21.15.44:0/536501293 >> 172.21.15.44:0/536501293 conn(0x7fa3d80d2ef0 msgr2=0x7fa3d80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.185+0000 7fa3e032c640 1 -- 172.21.15.44:0/536501293 shutdown_connections 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.185+0000 7fa3e032c640 1 -- 172.21.15.44:0/536501293 wait complete. 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.187+0000 7fa3e032c640 1 Processor -- start 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.187+0000 7fa3e032c640 1 -- start start 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.187+0000 7fa3e032c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3d80d3b60 0x7fa3d8159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.187+0000 7fa3e032c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3d815d100 0x7fa3d815a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.187+0000 7fa3e032c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3d815d4e0 0x7fa3d815edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.187+0000 7fa3e032c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d815d8f0 con 0x7fa3d80d3b60 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.187+0000 7fa3e032c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80cb1d0 con 0x7fa3d815d4e0 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.187+0000 7fa3e032c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80cb4b0 con 0x7fa3d815d100 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.187+0000 7fa3de0c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3d80d3b60 0x7fa3d8159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3de0c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3d80d3b60 0x7fa3d8159cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38556/0 (socket says 172.21.15.44:38556) 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3de0c8640 1 -- 172.21.15.44:0/1668256395 learned_addr learned my addr 172.21.15.44:0/1668256395 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3de8c9640 1 --2- 172.21.15.44:0/1668256395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3d815d4e0 0x7fa3d815edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3dd8c7640 1 --2- 172.21.15.44:0/1668256395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3d815d100 0x7fa3d815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3de0c8640 1 -- 172.21.15.44:0/1668256395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3d815d100 msgr2=0x7fa3d815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3de0c8640 1 --2- 172.21.15.44:0/1668256395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3d815d100 0x7fa3d815a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3de0c8640 1 -- 172.21.15.44:0/1668256395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3d815d4e0 msgr2=0x7fa3d815edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3de0c8640 1 --2- 172.21.15.44:0/1668256395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3d815d4e0 0x7fa3d815edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3de0c8640 1 -- 172.21.15.44:0/1668256395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c80094d0 con 0x7fa3d80d3b60 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3de8c9640 1 --2- 172.21.15.44:0/1668256395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3d815d4e0 0x7fa3d815edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3de0c8640 1 --2- 172.21.15.44:0/1668256395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3d80d3b60 0x7fa3d8159cd0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400c450 tx=0x7fa3d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3ceffd640 1 -- 172.21.15.44:0/1668256395 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40052d0 con 0x7fa3d80d3b60 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3ceffd640 1 -- 172.21.15.44:0/1668256395 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d4005450 con 0x7fa3d80d3b60 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3e032c640 1 -- 172.21.15.44:0/1668256395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d80cb790 con 0x7fa3d80d3b60 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3ceffd640 1 -- 172.21.15.44:0/1668256395 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4003880 con 0x7fa3d80d3b60 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.188+0000 7fa3e032c640 1 -- 172.21.15.44:0/1668256395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d815a210 con 0x7fa3d80d3b60 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.189+0000 7fa3e032c640 1 -- 172.21.15.44:0/1668256395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d815dd80 con 0x7fa3d80d3b60 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.190+0000 7fa3ceffd640 1 -- 172.21.15.44:0/1668256395 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa3d40039e0 con 0x7fa3d80d3b60 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.190+0000 7fa3ceffd640 1 --2- 172.21.15.44:0/1668256395 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa3bc06aea0 0x7fa3bc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.190+0000 7fa3ceffd640 1 -- 172.21.15.44:0/1668256395 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7fa3d4089b00 con 0x7fa3d80d3b60 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.190+0000 7fa3dd8c7640 1 --2- 172.21.15.44:0/1668256395 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa3bc06aea0 0x7fa3bc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.191+0000 7fa3dd8c7640 1 --2- 172.21.15.44:0/1668256395 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa3bc06aea0 0x7fa3bc06d360 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8036000 tx=0x7fa3c803b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:56.196 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.194+0000 7fa3ceffd640 1 -- 172.21.15.44:0/1668256395 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3d4054230 con 0x7fa3d80d3b60 2023-11-04T01:43:56.412 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.410+0000 7fa3e032c640 1 -- 172.21.15.44:0/1668256395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa3d80684b0 con 0x7fa3d80d3b60 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.411+0000 7fa3ceffd640 1 -- 172.21.15.44:0/1668256395 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v119) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa3d4057850 con 0x7fa3d80d3b60 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.413+0000 7fa3e032c640 1 -- 172.21.15.44:0/1668256395 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa3bc06aea0 msgr2=0x7fa3bc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.413+0000 7fa3e032c640 1 --2- 172.21.15.44:0/1668256395 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa3bc06aea0 0x7fa3bc06d360 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8036000 tx=0x7fa3c803b040 comp rx=0 tx=0).stop 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.413+0000 7fa3e032c640 1 -- 172.21.15.44:0/1668256395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3d80d3b60 msgr2=0x7fa3d8159cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.413+0000 7fa3e032c640 1 --2- 172.21.15.44:0/1668256395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3d80d3b60 0x7fa3d8159cd0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400c450 tx=0x7fa3d400c910 comp rx=0 tx=0).stop 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.413+0000 7fa3e032c640 1 -- 172.21.15.44:0/1668256395 shutdown_connections 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.413+0000 7fa3e032c640 1 --2- 172.21.15.44:0/1668256395 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fa3bc06aea0 0x7fa3bc06d360 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.413+0000 7fa3e032c640 1 --2- 172.21.15.44:0/1668256395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3d815d4e0 0x7fa3d815edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.413+0000 7fa3e032c640 1 --2- 172.21.15.44:0/1668256395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3d815d100 0x7fa3d815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.413+0000 7fa3e032c640 1 --2- 172.21.15.44:0/1668256395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3d80d3b60 0x7fa3d8159cd0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.413+0000 7fa3e032c640 1 -- 172.21.15.44:0/1668256395 >> 172.21.15.44:0/1668256395 conn(0x7fa3d80d2ef0 msgr2=0x7fa3d80d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.413+0000 7fa3e032c640 1 -- 172.21.15.44:0/1668256395 shutdown_connections 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:56.413+0000 7fa3e032c640 1 -- 172.21.15.44:0/1668256395 wait complete. 2023-11-04T01:43:56.425 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:43:56.425 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:43:56.425 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2023-11-04T01:43:56.425 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:43:56.425 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:56.426 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:43:56.426 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:43:56.426 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:43:56.426 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:56.426 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42033sec preferred_lft 42033sec 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi044.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:43:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::9082:77ff:fe28:4353/64 scope link 2023-11-04T01:43:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:56.444 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:9d:e3:56:d0:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::e49d:e3ff:fe56:d068/64 scope link 2023-11-04T01:43:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:56.444 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether f2:23:83:31:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::f023:83ff:fe31:915/64 scope link 2023-11-04T01:43:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:56.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:56.445 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:43:56.511 INFO:teuthology.orchestra.run.smithi044.stdout:1 2023-11-04T01:43:56.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:56.512 DEBUG:teuthology.orchestra.run.smithi044:> route 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:56.569 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2023-11-04T01:43:56.569 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2023-11-04T01:43:56.569 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:43:56.569 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:43:56.569 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:43:56.569 DEBUG:teuthology.orchestra.run.smithi044:> ') 2023-11-04T01:43:56.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:56.675 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2023-11-04T01:43:56.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:43:56.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:43:56.690 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:56.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:56.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2023-11-04T01:43:56.761 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:43:56.761 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:56.761 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:56.817 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:56.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:56.817 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:56.871 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:56.930 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:43:56.966 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:43:56.965+0000 7f605f0d5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:56.966 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:43:56.965+0000 7f605f0d5640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:43:56.983 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:43:56.983 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:43:57.026 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:57.027 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:43:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:57.045 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:43:57.124 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:43:57.122+0000 7f43e4a34480 -1 init, newargv = 0x557cbfdcfa60 newargc=15 2023-11-04T01:43:57.124 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[127524]: starting ceph client 2023-11-04T01:43:57.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[127524]: starting fuse 2023-11-04T01:43:58.199 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:58.218 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:58.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:58.222 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2023-11-04T01:43:58.280 INFO:teuthology.orchestra.run.smithi044.stdout:41 2023-11-04T01:43:58.280 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:43:58.281 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:43:58.281 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2023-11-04T01:43:58.281 DEBUG:teuthology.orchestra.run.smithi044:> import re 2023-11-04T01:43:58.281 DEBUG:teuthology.orchestra.run.smithi044:> import os 2023-11-04T01:43:58.281 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2023-11-04T01:43:58.281 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:43:58.281 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2023-11-04T01:43:58.281 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:43:58.281 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2023-11-04T01:43:58.281 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:43:58.281 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:43:58.282 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2023-11-04T01:43:58.282 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2023-11-04T01:43:58.282 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2023-11-04T01:43:58.282 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2023-11-04T01:43:58.282 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:43:58.282 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2023-11-04T01:43:58.282 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:43:58.282 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:43:58.282 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:43:58.282 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2023-11-04T01:43:58.282 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2023-11-04T01:43:58.282 DEBUG:teuthology.orchestra.run.smithi044:> return f 2023-11-04T01:43:58.282 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:43:58.282 DEBUG:teuthology.orchestra.run.smithi044:> 2023-11-04T01:43:58.283 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2023-11-04T01:43:58.283 DEBUG:teuthology.orchestra.run.smithi044:> ' 2023-11-04T01:43:58.415 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.127524.asok 2023-11-04T01:43:58.418 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:58.427 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.127524.asok 2023-11-04T01:43:58.427 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:58.427 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.127524.asok status 2023-11-04T01:43:58.531 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:58.603 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "127524", 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 8859, 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 8859 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 269221181 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 269221181 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.8859 192.168.0.1:0/269221181", 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/269221181", 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 119, 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 114, 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:43:58.610 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:58.618 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:58.618 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:43:58.618 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:58.681 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:58.682 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2023-11-04T01:43:58.682 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:58.689 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:58.689 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:58.689 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:58.751 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:58.752 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:58.759 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:43:58.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.865+0000 7f87ed6da640 1 Processor -- start 2023-11-04T01:43:58.867 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.865+0000 7f87ed6da640 1 -- start start 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.866+0000 7f87ed6da640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f87e80b2810 0x7f87e806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.866+0000 7f87ed6da640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e815d4f0 con 0x7f87e815d110 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.866+0000 7f87ed6da640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e806b9f0 con 0x7f87e80b3ca0 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.866+0000 7f87ed6da640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e80664f0 con 0x7f87e80b2810 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.866+0000 7f87e6ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f87e815d110 0x7f87e80ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51178/0 (socket says 172.21.15.44:51178) 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.866+0000 7f87e6ffd640 1 -- 172.21.15.44:0/768659274 learned_addr learned my addr 172.21.15.44:0/768659274 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.866+0000 7f87e77fe640 1 --2- 172.21.15.44:0/768659274 >> v2:172.21.15.204:3300/0 conn(0x7f87e80b2810 0x7f87e806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.866+0000 7f87e67fc640 1 -- 172.21.15.44:0/768659274 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667143789 0 0) 0x7f87e815d4f0 con 0x7f87e815d110 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.866+0000 7f87e67fc640 1 -- 172.21.15.44:0/768659274 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87d4003520 con 0x7f87e815d110 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.866+0000 7f87e67fc640 1 -- 172.21.15.44:0/768659274 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2959442215 0 0) 0x7f87d4003520 con 0x7f87e815d110 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.866+0000 7f87e67fc640 1 -- 172.21.15.44:0/768659274 >> v2:172.21.15.204:3300/0 conn(0x7f87e80b2810 msgr2=0x7f87e806b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.866+0000 7f87e67fc640 1 --2- 172.21.15.44:0/768659274 >> v2:172.21.15.204:3300/0 conn(0x7f87e80b2810 0x7f87e806b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e67fc640 1 -- 172.21.15.44:0/768659274 >> v1:172.21.15.204:6789/0 conn(0x7f87e80b3ca0 legacy=0x7f87e80b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e67fc640 1 -- 172.21.15.44:0/768659274 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e806c2e0 con 0x7f87e815d110 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e67fc640 1 -- 172.21.15.44:0/768659274 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f87d80017f0 con 0x7f87e815d110 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e67fc640 1 -- 172.21.15.44:0/768659274 >> v1:172.21.15.44:6789/0 conn(0x7f87e815d110 legacy=0x7f87e80ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e67fc640 1 --2- 172.21.15.44:0/768659274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87d4003970 0x7f87d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e67fc640 1 --2- 172.21.15.44:0/768659274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87d40047c0 0x7f87d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e67fc640 1 --2- 172.21.15.44:0/768659274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d4005180 0x7f87d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e67fc640 1 -- 172.21.15.44:0/768659274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80664f0 con 0x7f87d4005180 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e67fc640 1 -- 172.21.15.44:0/768659274 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d400c020 con 0x7f87d4003970 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e67fc640 1 -- 172.21.15.44:0/768659274 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d400c1e0 con 0x7f87d40047c0 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e77fe640 1 --2- 172.21.15.44:0/768659274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d4005180 0x7f87d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e6ffd640 1 --2- 172.21.15.44:0/768659274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87d4003970 0x7f87d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87dffff640 1 --2- 172.21.15.44:0/768659274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87d40047c0 0x7f87d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e77fe640 1 -- 172.21.15.44:0/768659274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87d40047c0 msgr2=0x7f87d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e77fe640 1 --2- 172.21.15.44:0/768659274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87d40047c0 0x7f87d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e77fe640 1 -- 172.21.15.44:0/768659274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87d4003970 msgr2=0x7f87d4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e77fe640 1 --2- 172.21.15.44:0/768659274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87d4003970 0x7f87d4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.867+0000 7f87e77fe640 1 -- 172.21.15.44:0/768659274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d4003520 con 0x7f87d4005180 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.868+0000 7f87e77fe640 1 -- 172.21.15.44:0/768659274 reap_dead start 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.868+0000 7f87e77fe640 1 --2- 172.21.15.44:0/768659274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d4005180 0x7f87d400b980 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009fc0 tx=0x7f87d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc455bcd2a248e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.868+0000 7f87e67fc640 1 -- 172.21.15.44:0/768659274 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e002cc60 con 0x7f87d4005180 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.868+0000 7f87e67fc640 1 -- 172.21.15.44:0/768659274 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e000f040 con 0x7f87d4005180 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.868+0000 7f87e67fc640 1 -- 172.21.15.44:0/768659274 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0003990 con 0x7f87d4005180 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.869+0000 7f87ed6da640 1 -- 172.21.15.44:0/768659274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d4005180 msgr2=0x7f87d400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.869+0000 7f87ed6da640 1 --2- 172.21.15.44:0/768659274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d4005180 0x7f87d400b980 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009fc0 tx=0x7f87d40057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.869+0000 7f87ed6da640 1 -- 172.21.15.44:0/768659274 shutdown_connections 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.869+0000 7f87ed6da640 1 --2- 172.21.15.44:0/768659274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d4005180 0x7f87d400b980 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.869+0000 7f87ed6da640 1 -- 172.21.15.44:0/768659274 >> 172.21.15.44:0/768659274 conn(0x7f87e80cbd30 msgr2=0x7f87e80cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.869+0000 7f87ed6da640 1 -- 172.21.15.44:0/768659274 shutdown_connections 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.869+0000 7f87ed6da640 1 -- 172.21.15.44:0/768659274 wait complete. 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.870+0000 7f87ed6da640 1 Processor -- start 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.870+0000 7f87ed6da640 1 -- start start 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87ed6da640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d4005180 0x7f87e81f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87ed6da640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87e80b0690 0x7f87e8157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87ed6da640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87e815a970 0x7f87e815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87ed6da640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e815b330 con 0x7f87d4005180 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87ed6da640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e81f3380 con 0x7f87e80b0690 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87ed6da640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e81f2ac0 con 0x7f87e815a970 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87e6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d4005180 0x7f87e81f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87e6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d4005180 0x7f87e81f69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38574/0 (socket says 172.21.15.44:38574) 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87e6ffd640 1 -- 172.21.15.44:0/166025791 learned_addr learned my addr 172.21.15.44:0/166025791 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87e77fe640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87e815a970 0x7f87e815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87dffff640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87e80b0690 0x7f87e8157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87e6ffd640 1 -- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87e815a970 msgr2=0x7f87e815adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87e6ffd640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87e815a970 0x7f87e815adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87e6ffd640 1 -- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87e80b0690 msgr2=0x7f87e8157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87e6ffd640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87e80b0690 0x7f87e8157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87e6ffd640 1 -- 172.21.15.44:0/166025791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80b0b10 con 0x7f87d4005180 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87dffff640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87e80b0690 0x7f87e8157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87e77fe640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87e815a970 0x7f87e815adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87e6ffd640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d4005180 0x7f87e81f69e0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f87d800f8e0 tx=0x7f87d800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.871+0000 7f87df7fe640 1 -- 172.21.15.44:0/166025791 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80073a0 con 0x7f87d4005180 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.872+0000 7f87df7fe640 1 -- 172.21.15.44:0/166025791 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d8007500 con 0x7f87d4005180 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.872+0000 7f87ed6da640 1 -- 172.21.15.44:0/166025791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e81f2d30 con 0x7f87d4005180 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.872+0000 7f87df7fe640 1 -- 172.21.15.44:0/166025791 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80059c0 con 0x7f87d4005180 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.872+0000 7f87ed6da640 1 -- 172.21.15.44:0/166025791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e81f3810 con 0x7f87d4005180 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.873+0000 7f87df7fe640 1 -- 172.21.15.44:0/166025791 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87d8005b20 con 0x7f87d4005180 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.874+0000 7f87df7fe640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87c806ae70 0x7f87c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.874+0000 7f87df7fe640 1 -- 172.21.15.44:0/166025791 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7f87d808a1d0 con 0x7f87d4005180 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.874+0000 7f87dffff640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87c806ae70 0x7f87c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.875+0000 7f87dffff640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87c806ae70 0x7f87c806d330 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f87e81607e0 tx=0x7f87d0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.875+0000 7f87f026e740 1 Processor -- start 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.875+0000 7f87f026e740 1 -- start start 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87f026e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf5704c0 0x562ddf5708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87f026e740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf5406d0 0x562ddf56d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87f026e740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf544040 0x562ddf56dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87f026e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ddf4b3d70 con 0x562ddf5704c0 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87f026e740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ddf4b1460 con 0x562ddf5406d0 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87f026e740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ddf4acd50 con 0x562ddf544040 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87e6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf5704c0 0x562ddf5708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87e6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf5704c0 0x562ddf5708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38578/0 (socket says 172.21.15.44:38578) 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87e6ffd640 1 -- 172.21.15.44:0/2121837433 learned_addr learned my addr 172.21.15.44:0/2121837433 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87dffff640 1 --2- 172.21.15.44:0/2121837433 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf5406d0 0x562ddf56d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87e77fe640 1 --2- 172.21.15.44:0/2121837433 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf544040 0x562ddf56dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87e6ffd640 1 -- 172.21.15.44:0/2121837433 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf544040 msgr2=0x562ddf56dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87e6ffd640 1 --2- 172.21.15.44:0/2121837433 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf544040 0x562ddf56dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87e6ffd640 1 -- 172.21.15.44:0/2121837433 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf5406d0 msgr2=0x562ddf56d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87e6ffd640 1 --2- 172.21.15.44:0/2121837433 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf5406d0 0x562ddf56d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87e6ffd640 1 -- 172.21.15.44:0/2121837433 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ddf46fe30 con 0x562ddf5704c0 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.876+0000 7f87e6ffd640 1 --2- 172.21.15.44:0/2121837433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf5704c0 0x562ddf5708a0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f87d8058580 tx=0x7f87d8058db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee231684cad8249 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.877+0000 7f87dcff9640 1 -- 172.21.15.44:0/2121837433 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80608f0 con 0x562ddf5704c0 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.877+0000 7f87dcff9640 1 -- 172.21.15.44:0/2121837433 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d8089040 con 0x562ddf5704c0 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.877+0000 7f87dcff9640 1 -- 172.21.15.44:0/2121837433 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8056990 con 0x562ddf5704c0 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.877+0000 7f87f026e740 1 -- 172.21.15.44:0/2121837433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf5704c0 msgr2=0x562ddf5708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.877+0000 7f87f026e740 1 --2- 172.21.15.44:0/2121837433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf5704c0 0x562ddf5708a0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f87d8058580 tx=0x7f87d8058db0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.877+0000 7f87f026e740 1 -- 172.21.15.44:0/2121837433 shutdown_connections 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.877+0000 7f87f026e740 1 --2- 172.21.15.44:0/2121837433 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf544040 0x562ddf56dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.877+0000 7f87f026e740 1 --2- 172.21.15.44:0/2121837433 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf5406d0 0x562ddf56d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.877+0000 7f87f026e740 1 --2- 172.21.15.44:0/2121837433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf5704c0 0x562ddf5708a0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.877+0000 7f87f026e740 1 -- 172.21.15.44:0/2121837433 >> 172.21.15.44:0/2121837433 conn(0x562ddf5429e0 msgr2=0x562ddf58b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.877+0000 7f87f026e740 1 -- 172.21.15.44:0/2121837433 shutdown_connections 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.877+0000 7f87f026e740 1 -- 172.21.15.44:0/2121837433 wait complete. 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.878+0000 7f87f026e740 1 -- start start 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.878+0000 7f87f026e740 1 Processor -- start 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87f026e740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf544040 0x562ddf566700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87f026e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf5704c0 0x562ddf59c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87f026e740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf58b1c0 0x562ddf58b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87f026e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ddf466ee0 con 0x562ddf5704c0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87f026e740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ddf466b80 con 0x562ddf544040 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87f026e740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ddf42c3a0 con 0x562ddf58b1c0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87f026e740 10 client.0 _ll_register_callbacks cb 0x562ddf4308b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87dffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf5704c0 0x562ddf59c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87dffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf5704c0 0x562ddf59c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38584/0 (socket says 172.21.15.44:38584) 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87dffff640 1 -- 172.21.15.44:0/3642640341 learned_addr learned my addr 172.21.15.44:0/3642640341 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87e77fe640 1 --2- 172.21.15.44:0/3642640341 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf58b1c0 0x562ddf58b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87e6ffd640 1 --2- 172.21.15.44:0/3642640341 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf544040 0x562ddf566700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87dffff640 1 -- 172.21.15.44:0/3642640341 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf58b1c0 msgr2=0x562ddf58b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87dffff640 1 --2- 172.21.15.44:0/3642640341 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf58b1c0 0x562ddf58b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87dffff640 1 -- 172.21.15.44:0/3642640341 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf544040 msgr2=0x562ddf566700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87dffff640 1 --2- 172.21.15.44:0/3642640341 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf544040 0x562ddf566700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.879+0000 7f87dffff640 1 -- 172.21.15.44:0/3642640341 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e81f3810 con 0x562ddf5704c0 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87dffff640 1 --2- 172.21.15.44:0/3642640341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf5704c0 0x562ddf59c210 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f87d0001cf0 tx=0x7f87d0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff891a30860c7d6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87c5ffb640 1 -- 172.21.15.44:0/3642640341 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0022610 con 0x562ddf5704c0 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87f026e740 1 -- 172.21.15.44:0/3642640341 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562ddf4a5d30 con 0x562ddf5704c0 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87c5ffb640 1 -- 172.21.15.44:0/3642640341 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7f87d001c070 con 0x562ddf5704c0 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87c5ffb640 1 -- 172.21.15.44:0/3642640341 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=119) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87d0022770 con 0x562ddf5704c0 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87f026e740 10 client.8871 fetch_fsmap learned FSMap version 119 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87f026e740 1 -- 172.21.15.44:0/3642640341 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=119,monmap=2+}) v3 -- 0x562ddf4ab3d0 con 0x562ddf5704c0 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87c5ffb640 1 -- 172.21.15.44:0/3642640341 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562ddf4a5d30 con 0x562ddf5704c0 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87c5ffb640 1 -- 172.21.15.44:0/3642640341 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 119) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f87d00228d0 con 0x562ddf5704c0 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87f026e740 10 client.8871 fetch_fsmap finished waiting for FSMap version 119 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87f026e740 10 client.8871 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87f026e740 20 client.8871 populate_metadata read hostname 'smithi044' 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87f026e740 1 --2- 172.21.15.44:0/3642640341 >> [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] conn(0x562ddf571dc0 0x562ddf5721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87f026e740 4 client.8871 mds_command: new command op to 7357 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87f026e740 1 -- 172.21.15.44:0/3642640341 --> [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562ddf4a5a50 con 0x562ddf571dc0 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.880+0000 7f87e6ffd640 1 --2- 172.21.15.44:0/3642640341 >> [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] conn(0x562ddf571dc0 0x562ddf5721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.881+0000 7f87e6ffd640 1 --2- 172.21.15.44:0/3642640341 >> [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] conn(0x562ddf571dc0 0x562ddf5721a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aba2da1372adc162 server_cookie=56b5b27f8ade36e5 in_seq=0 out_seq=0 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.881+0000 7f87c5ffb640 10 client.8871 ms_handle_connect on v2:172.21.15.204:6834/578267830 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.881+0000 7f87c5ffb640 1 -- 172.21.15.44:0/3642640341 <== mds.0 v2:172.21.15.204:6834/578267830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562ddf4a5a50 con 0x562ddf571dc0 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.881+0000 7f87c5ffb640 10 client.8871 handle_command_reply: tid=0 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.881+0000 7f87f026e740 1 client.8871 shutdown 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.882+0000 7f87f026e740 1 -- 172.21.15.44:0/3642640341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf5704c0 msgr2=0x562ddf59c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.882+0000 7f87f026e740 1 --2- 172.21.15.44:0/3642640341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf5704c0 0x562ddf59c210 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f87d0001cf0 tx=0x7f87d0001120 comp rx=0 tx=0).stop 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.882+0000 7f87f026e740 1 -- 172.21.15.44:0/3642640341 shutdown_connections 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.882+0000 7f87f026e740 1 --2- 172.21.15.44:0/3642640341 >> [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] conn(0x562ddf571dc0 0x562ddf5721a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.882+0000 7f87f026e740 1 --2- 172.21.15.44:0/3642640341 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf58b1c0 0x562ddf58b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.882+0000 7f87f026e740 1 --2- 172.21.15.44:0/3642640341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf5704c0 0x562ddf59c210 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.882+0000 7f87c5ffb640 0 client.8871 ms_handle_reset on v2:172.21.15.204:6834/578267830 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.882+0000 7f87f026e740 1 --2- 172.21.15.44:0/3642640341 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf544040 0x562ddf566700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.882+0000 7f87f026e740 1 -- 172.21.15.44:0/3642640341 >> 172.21.15.44:0/3642640341 conn(0x562ddf5406d0 msgr2=0x562ddf5447f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.882+0000 7f87f026e740 1 -- 172.21.15.44:0/3642640341 shutdown_connections 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.882+0000 7f87f026e740 1 -- 172.21.15.44:0/3642640341 wait complete. 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.882+0000 7f87f026e740 20 client.8871 trim_cache size 0 max 16384 2023-11-04T01:43:58.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.895+0000 7f87f026e740 1 Processor -- start 2023-11-04T01:43:58.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.895+0000 7f87f026e740 1 -- start start 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87f026e740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf544040 0x562ddf546290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87f026e740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf5704c0 0x562ddf5721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87f026e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf58b1c0 0x562ddf5726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87f026e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ddf599040 con 0x562ddf58b1c0 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87f026e740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ddf5ae960 con 0x562ddf544040 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87f026e740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ddf56b150 con 0x562ddf5704c0 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87e77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf58b1c0 0x562ddf5726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87e77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf58b1c0 0x562ddf5726e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38600/0 (socket says 172.21.15.44:38600) 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87e77fe640 1 -- 172.21.15.44:0/885290588 learned_addr learned my addr 172.21.15.44:0/885290588 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87e77fe640 1 -- 172.21.15.44:0/885290588 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf5704c0 msgr2=0x562ddf5721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87e77fe640 1 --2- 172.21.15.44:0/885290588 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf5704c0 0x562ddf5721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87e77fe640 1 -- 172.21.15.44:0/885290588 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf544040 msgr2=0x562ddf546290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87e77fe640 1 --2- 172.21.15.44:0/885290588 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf544040 0x562ddf546290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87e77fe640 1 -- 172.21.15.44:0/885290588 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ddf448ea0 con 0x562ddf58b1c0 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87e77fe640 1 --2- 172.21.15.44:0/885290588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf58b1c0 0x562ddf5726e0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f87e000e230 tx=0x7f87e002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd19de9ee6a27ab server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87dd7fa640 1 -- 172.21.15.44:0/885290588 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e002cb20 con 0x562ddf58b1c0 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87dd7fa640 1 -- 172.21.15.44:0/885290588 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0003990 con 0x562ddf58b1c0 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.896+0000 7f87dd7fa640 1 -- 172.21.15.44:0/885290588 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e002cc80 con 0x562ddf58b1c0 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.897+0000 7f87f026e740 1 -- 172.21.15.44:0/885290588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf58b1c0 msgr2=0x562ddf5726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.897+0000 7f87f026e740 1 --2- 172.21.15.44:0/885290588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf58b1c0 0x562ddf5726e0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f87e000e230 tx=0x7f87e002e070 comp rx=0 tx=0).stop 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.897+0000 7f87f026e740 1 -- 172.21.15.44:0/885290588 shutdown_connections 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.897+0000 7f87f026e740 1 --2- 172.21.15.44:0/885290588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf58b1c0 0x562ddf5726e0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.897+0000 7f87f026e740 1 --2- 172.21.15.44:0/885290588 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf5704c0 0x562ddf5721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.897+0000 7f87f026e740 1 --2- 172.21.15.44:0/885290588 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf544040 0x562ddf546290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.897+0000 7f87f026e740 1 -- 172.21.15.44:0/885290588 >> 172.21.15.44:0/885290588 conn(0x562ddf5406d0 msgr2=0x562ddf5ae250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.897+0000 7f87f026e740 1 -- 172.21.15.44:0/885290588 shutdown_connections 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.897+0000 7f87f026e740 1 -- 172.21.15.44:0/885290588 wait complete. 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.897+0000 7f87f026e740 1 -- start start 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.898+0000 7f87f026e740 1 Processor -- start 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.898+0000 7f87f026e740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf544040 0x562ddf58c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.898+0000 7f87f026e740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf5704c0 0x562ddf5f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.898+0000 7f87f026e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf58b1c0 0x562ddf5721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.898+0000 7f87f026e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ddf58cbc0 con 0x562ddf58b1c0 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.898+0000 7f87f026e740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ddf58ed00 con 0x562ddf5704c0 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.898+0000 7f87f026e740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ddf540000 con 0x562ddf544040 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.898+0000 7f87f026e740 10 client.0 _ll_register_callbacks cb 0x7f87d8054930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.898+0000 7f87e77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf58b1c0 0x562ddf5721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.898+0000 7f87e77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf58b1c0 0x562ddf5721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38608/0 (socket says 172.21.15.44:38608) 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.898+0000 7f87e77fe640 1 -- 172.21.15.44:0/3538818083 learned_addr learned my addr 172.21.15.44:0/3538818083 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87e6ffd640 1 --2- 172.21.15.44:0/3538818083 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf544040 0x562ddf58c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87dffff640 1 --2- 172.21.15.44:0/3538818083 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf5704c0 0x562ddf5f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87e77fe640 1 -- 172.21.15.44:0/3538818083 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf544040 msgr2=0x562ddf58c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87e77fe640 1 --2- 172.21.15.44:0/3538818083 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf544040 0x562ddf58c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87e77fe640 1 -- 172.21.15.44:0/3538818083 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf5704c0 msgr2=0x562ddf5f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87e77fe640 1 --2- 172.21.15.44:0/3538818083 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf5704c0 0x562ddf5f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87e77fe640 1 -- 172.21.15.44:0/3538818083 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d4003520 con 0x562ddf58b1c0 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87dffff640 1 --2- 172.21.15.44:0/3538818083 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf5704c0 0x562ddf5f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87e77fe640 1 --2- 172.21.15.44:0/3538818083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf58b1c0 0x562ddf5721a0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f87e000e230 tx=0x7f87e0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d580d18722781183 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87c5ffb640 1 -- 172.21.15.44:0/3538818083 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0034e80 con 0x562ddf58b1c0 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87f026e740 1 -- 172.21.15.44:0/3538818083 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f87d8089040 con 0x562ddf58b1c0 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87c5ffb640 1 -- 172.21.15.44:0/3538818083 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7f87e0050070 con 0x562ddf58b1c0 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87c5ffb640 1 -- 172.21.15.44:0/3538818083 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=119) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87e002cc00 con 0x562ddf58b1c0 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87f026e740 10 client.8877 fetch_fsmap learned FSMap version 119 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87f026e740 1 -- 172.21.15.44:0/3538818083 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=119,monmap=2+}) v3 -- 0x562ddf46e690 con 0x562ddf58b1c0 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87c5ffb640 1 -- 172.21.15.44:0/3538818083 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d8089040 con 0x562ddf58b1c0 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87c5ffb640 1 -- 172.21.15.44:0/3538818083 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 119) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f87e0054470 con 0x562ddf58b1c0 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87f026e740 10 client.8877 fetch_fsmap finished waiting for FSMap version 119 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87f026e740 10 client.8877 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87f026e740 20 client.8877 populate_metadata read hostname 'smithi044' 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87f026e740 1 --2- 172.21.15.44:0/3538818083 >> [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] conn(0x562ddf5733b0 0x562ddf5726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87f026e740 4 client.8877 mds_command: new command op to 7357 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.899+0000 7f87f026e740 1 -- 172.21.15.44:0/3538818083 --> [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562ddf1ad7e0 con 0x562ddf5733b0 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.900+0000 7f87e6ffd640 1 --2- 172.21.15.44:0/3538818083 >> [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] conn(0x562ddf5733b0 0x562ddf5726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.900+0000 7f87e6ffd640 1 --2- 172.21.15.44:0/3538818083 >> [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] conn(0x562ddf5733b0 0x562ddf5726e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=600f9614be4f8a34 server_cookie=c00a847d64d9989b in_seq=0 out_seq=0 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.900+0000 7f87c5ffb640 10 client.8877 ms_handle_connect on v2:172.21.15.204:6834/578267830 2023-11-04T01:43:58.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.906+0000 7f87c5ffb640 1 -- 172.21.15.44:0/3538818083 <== mds.0 v2:172.21.15.204:6834/578267830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562ddf1ad7e0 con 0x562ddf5733b0 2023-11-04T01:43:58.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.906+0000 7f87c5ffb640 10 client.8877 handle_command_reply: tid=0 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.906+0000 7f87f026e740 1 client.8877 shutdown 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.906+0000 7f87f026e740 1 -- 172.21.15.44:0/3538818083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf58b1c0 msgr2=0x562ddf5721a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.906+0000 7f87f026e740 1 --2- 172.21.15.44:0/3538818083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf58b1c0 0x562ddf5721a0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f87e000e230 tx=0x7f87e0004ab0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87f026e740 1 -- 172.21.15.44:0/3538818083 shutdown_connections 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87f026e740 1 --2- 172.21.15.44:0/3538818083 >> [v2:172.21.15.204:6834/578267830,v1:172.21.15.204:6836/578267830] conn(0x562ddf5733b0 0x562ddf5726e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87f026e740 1 --2- 172.21.15.44:0/3538818083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ddf58b1c0 0x562ddf5721a0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87c5ffb640 0 client.8877 ms_handle_reset on v2:172.21.15.204:6834/578267830 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87f026e740 1 --2- 172.21.15.44:0/3538818083 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562ddf5704c0 0x562ddf5f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87f026e740 1 --2- 172.21.15.44:0/3538818083 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562ddf544040 0x562ddf58c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87f026e740 1 -- 172.21.15.44:0/3538818083 >> 172.21.15.44:0/3538818083 conn(0x562ddf5406d0 msgr2=0x562ddf53be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87f026e740 1 -- 172.21.15.44:0/3538818083 shutdown_connections 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87f026e740 1 -- 172.21.15.44:0/3538818083 wait complete. 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87f026e740 20 client.8877 trim_cache size 0 max 16384 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi044.stdout: "message": "", 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87ed6da640 1 -- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87c806ae70 msgr2=0x7f87c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87ed6da640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87c806ae70 0x7f87c806d330 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f87e81607e0 tx=0x7f87d0009040 comp rx=0 tx=0).stop 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87ed6da640 1 -- 172.21.15.44:0/166025791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d4005180 msgr2=0x7f87e81f69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87ed6da640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d4005180 0x7f87e81f69e0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f87d800f8e0 tx=0x7f87d800fda0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87ed6da640 1 -- 172.21.15.44:0/166025791 shutdown_connections 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87ed6da640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f87c806ae70 0x7f87c806d330 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87ed6da640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f87e815a970 0x7f87e815adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87ed6da640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87e80b0690 0x7f87e8157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87ed6da640 1 --2- 172.21.15.44:0/166025791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87d4005180 0x7f87e81f69e0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87ed6da640 1 -- 172.21.15.44:0/166025791 >> 172.21.15.44:0/166025791 conn(0x7f87e80cbd30 msgr2=0x7f87e80acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87ed6da640 1 -- 172.21.15.44:0/166025791 shutdown_connections 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:58.907+0000 7f87ed6da640 1 -- 172.21.15.44:0/166025791 wait complete. 2023-11-04T01:43:58.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:58.920 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d1/dir/.snap/*) 2023-11-04T01:43:58.952 INFO:tasks.cephfs.test_snapshots:testing snapclient mds_kill_mdstable_at=3 2023-11-04T01:43:58.952 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:58.969 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:43:58.967+0000 7f5dc9e8d640 -1 --2- 192.168.0.1:0/1480686415 >> [v2:172.21.15.44:6833/2720398401,v1:172.21.15.44:6835/2720398401] conn(0x563b93e357b0 0x563b93e37ba0 unknown :-1 s=BANNER_CONNECTING pgs=15 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.44:6833/2720398401,v1:172.21.15.44:6835/2720398401] is using msgr V1 protocol 2023-11-04T01:43:59.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.072+0000 7feaf7a0e640 1 Processor -- start 2023-11-04T01:43:59.074 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.073+0000 7feaf7a0e640 1 -- start start 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.073+0000 7feaf7a0e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feaf015d4e0 0x7feaf00d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.073+0000 7feaf7a0e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7feaf00d3b60 0x7feaf00d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.073+0000 7feaf7a0e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf00b32b0 con 0x7feaf015d100 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.073+0000 7feaf7a0e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf00cec20 con 0x7feaf015d4e0 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.073+0000 7feaf7a0e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf00cee10 con 0x7feaf00d3b60 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.073+0000 7feaf4fa9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feaf015d4e0 0x7feaf00d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.074+0000 7feaf4fa9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feaf015d4e0 0x7feaf00d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38618/0 (socket says 172.21.15.44:38618) 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.074+0000 7feaf4fa9640 1 -- 172.21.15.44:0/1037180259 learned_addr learned my addr 172.21.15.44:0/1037180259 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.074+0000 7feaf5fab640 1 --2- 172.21.15.44:0/1037180259 >> v2:172.21.15.204:3300/0 conn(0x7feaf00d3b60 0x7feaf00d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.074+0000 7feaf4fa9640 1 -- 172.21.15.44:0/1037180259 >> v2:172.21.15.204:3300/0 conn(0x7feaf00d3b60 msgr2=0x7feaf00d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.074+0000 7feaf4fa9640 1 --2- 172.21.15.44:0/1037180259 >> v2:172.21.15.204:3300/0 conn(0x7feaf00d3b60 0x7feaf00d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.074+0000 7feaf4fa9640 1 -- 172.21.15.44:0/1037180259 >> v1:172.21.15.204:6789/0 conn(0x7feaf015d100 legacy=0x7feaf00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.074+0000 7feaf4fa9640 1 -- 172.21.15.44:0/1037180259 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf00b4750 con 0x7feaf015d4e0 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.074+0000 7feaf5fab640 1 --2- 172.21.15.44:0/1037180259 >> v2:172.21.15.204:3300/0 conn(0x7feaf00d3b60 0x7feaf00d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:59.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.075+0000 7feaf4fa9640 1 --2- 172.21.15.44:0/1037180259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaf015d4e0 0x7feaf00d14d0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7feaf008d6a0 tx=0x7feae402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38c68cf403b3fd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:59.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.075+0000 7feaeffff640 1 -- 172.21.15.44:0/1037180259 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4030860 con 0x7feaf015d4e0 2023-11-04T01:43:59.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.075+0000 7feaeffff640 1 -- 172.21.15.44:0/1037180259 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae40309c0 con 0x7feaf015d4e0 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.075+0000 7feaeffff640 1 -- 172.21.15.44:0/1037180259 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4030d50 con 0x7feaf015d4e0 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.075+0000 7feaf7a0e640 1 -- 172.21.15.44:0/1037180259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaf015d4e0 msgr2=0x7feaf00d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.075+0000 7feaf7a0e640 1 --2- 172.21.15.44:0/1037180259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaf015d4e0 0x7feaf00d14d0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7feaf008d6a0 tx=0x7feae402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.075+0000 7feaf7a0e640 1 -- 172.21.15.44:0/1037180259 shutdown_connections 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.075+0000 7feaf7a0e640 1 --2- 172.21.15.44:0/1037180259 >> v2:172.21.15.204:3300/0 conn(0x7feaf00d3b60 0x7feaf00d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.075+0000 7feaf7a0e640 1 --2- 172.21.15.44:0/1037180259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaf015d4e0 0x7feaf00d14d0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.075+0000 7feaf7a0e640 1 -- 172.21.15.44:0/1037180259 >> 172.21.15.44:0/1037180259 conn(0x7feaf00d2ef0 msgr2=0x7feaf00d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.075+0000 7feaf7a0e640 1 -- 172.21.15.44:0/1037180259 shutdown_connections 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.075+0000 7feaf7a0e640 1 -- 172.21.15.44:0/1037180259 wait complete. 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.077+0000 7feaf7a0e640 1 Processor -- start 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.077+0000 7feaf7a0e640 1 -- start start 2023-11-04T01:43:59.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.077+0000 7feaf7a0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feaf00d3b60 0x7feaf0154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.081 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.077+0000 7feaf7a0e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feaf015d100 0x7feaf00b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.077+0000 7feaf7a0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaf015d4e0 0x7feaf00b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.077+0000 7feaf7a0e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf01606b0 con 0x7feaf015d4e0 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.077+0000 7feaf7a0e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf015faa0 con 0x7feaf015d100 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.077+0000 7feaf7a0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf015fd80 con 0x7feaf00d3b60 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.077+0000 7feaf5fab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaf015d4e0 0x7feaf00b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.077+0000 7feaf5fab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaf015d4e0 0x7feaf00b0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38624/0 (socket says 172.21.15.44:38624) 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.077+0000 7feaf5fab640 1 -- 172.21.15.44:0/2191330307 learned_addr learned my addr 172.21.15.44:0/2191330307 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.078+0000 7feaf4fa9640 1 --2- 172.21.15.44:0/2191330307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feaf015d100 0x7feaf00b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.078+0000 7feaf57aa640 1 --2- 172.21.15.44:0/2191330307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feaf00d3b60 0x7feaf0154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.078+0000 7feaf5fab640 1 -- 172.21.15.44:0/2191330307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feaf00d3b60 msgr2=0x7feaf0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.078+0000 7feaf5fab640 1 --2- 172.21.15.44:0/2191330307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feaf00d3b60 0x7feaf0154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.078+0000 7feaf5fab640 1 -- 172.21.15.44:0/2191330307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feaf015d100 msgr2=0x7feaf00b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.078+0000 7feaf5fab640 1 --2- 172.21.15.44:0/2191330307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feaf015d100 0x7feaf00b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.078+0000 7feaf5fab640 1 -- 172.21.15.44:0/2191330307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40094d0 con 0x7feaf015d4e0 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.078+0000 7feaf4fa9640 1 --2- 172.21.15.44:0/2191330307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feaf015d100 0x7feaf00b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.078+0000 7feaf5fab640 1 --2- 172.21.15.44:0/2191330307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaf015d4e0 0x7feaf00b0920 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7feae0007ef0 tx=0x7feae000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.078+0000 7feaedffb640 1 -- 172.21.15.44:0/2191330307 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0003b90 con 0x7feaf015d4e0 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.078+0000 7feaedffb640 1 -- 172.21.15.44:0/2191330307 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae000f040 con 0x7feaf015d4e0 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.078+0000 7feaedffb640 1 -- 172.21.15.44:0/2191330307 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae000de80 con 0x7feaf015d4e0 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.078+0000 7feaf7a0e640 1 -- 172.21.15.44:0/2191330307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf0160060 con 0x7feaf015d4e0 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.078+0000 7feaf7a0e640 1 -- 172.21.15.44:0/2191330307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf00cb000 con 0x7feaf015d4e0 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.079+0000 7feaf7a0e640 1 -- 172.21.15.44:0/2191330307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf00684b0 con 0x7feaf015d4e0 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.080+0000 7feaedffb640 1 -- 172.21.15.44:0/2191330307 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feae0004030 con 0x7feaf015d4e0 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.080+0000 7feaedffb640 1 --2- 172.21.15.44:0/2191330307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feadc06ae70 0x7feadc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.080+0000 7feaedffb640 1 -- 172.21.15.44:0/2191330307 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7feae008a1d0 con 0x7feaf015d4e0 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.081+0000 7feaf57aa640 1 --2- 172.21.15.44:0/2191330307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feadc06ae70 0x7feadc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.081+0000 7feaf57aa640 1 --2- 172.21.15.44:0/2191330307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feadc06ae70 0x7feadc06d330 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7feae8000fb0 tx=0x7feae8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:59.086 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.084+0000 7feaedffb640 1 -- 172.21.15.44:0/2191330307 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feae00549a0 con 0x7feaf015d4e0 2023-11-04T01:43:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.297+0000 7feaf7a0e640 1 -- 172.21.15.44:0/2191330307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feaf00d2cd0 con 0x7feaf015d4e0 2023-11-04T01:43:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.297+0000 7feaedffb640 1 -- 172.21.15.44:0/2191330307 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) v1 ==== 95+0+4934 (secure 0 0 0) 0x7feae001a090 con 0x7feaf015d4e0 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":119,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/830347539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":830347539},{"type":"v1","addr":"172.21.15.44:6835","nonce":830347539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:51.283197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:active","state_seq":18,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8703":{"gid":8703,"name":"c","rank":1,"incarnation":115,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 119 2023-11-04T01:43:59.301 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.299+0000 7feaf7a0e640 1 -- 172.21.15.44:0/2191330307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feadc06ae70 msgr2=0x7feadc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.299+0000 7feaf7a0e640 1 --2- 172.21.15.44:0/2191330307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feadc06ae70 0x7feadc06d330 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7feae8000fb0 tx=0x7feae8009040 comp rx=0 tx=0).stop 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.299+0000 7feaf7a0e640 1 -- 172.21.15.44:0/2191330307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaf015d4e0 msgr2=0x7feaf00b0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.299+0000 7feaf7a0e640 1 --2- 172.21.15.44:0/2191330307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaf015d4e0 0x7feaf00b0920 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7feae0007ef0 tx=0x7feae000d4a0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.299+0000 7feaf7a0e640 1 -- 172.21.15.44:0/2191330307 shutdown_connections 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.299+0000 7feaf7a0e640 1 --2- 172.21.15.44:0/2191330307 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7feadc06ae70 0x7feadc06d330 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.299+0000 7feaf7a0e640 1 --2- 172.21.15.44:0/2191330307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaf015d4e0 0x7feaf00b0920 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.299+0000 7feaf7a0e640 1 --2- 172.21.15.44:0/2191330307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feaf015d100 0x7feaf00b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.299+0000 7feaf7a0e640 1 --2- 172.21.15.44:0/2191330307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feaf00d3b60 0x7feaf0154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.299+0000 7feaf7a0e640 1 -- 172.21.15.44:0/2191330307 >> 172.21.15.44:0/2191330307 conn(0x7feaf00d2ef0 msgr2=0x7feaf00b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:59.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.300+0000 7feaf7a0e640 1 -- 172.21.15.44:0/2191330307 shutdown_connections 2023-11-04T01:43:59.303 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.300+0000 7feaf7a0e640 1 -- 172.21.15.44:0/2191330307 wait complete. 2023-11-04T01:43:59.314 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:43:59.436 INFO:teuthology.orchestra.run.smithi204.stdout:{"last_snap":14,"last_created":12,"last_destroyed":13,"pending_noop":[],"snaps":[{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:43:11.476475+0000","name":"s26","metadata":{}}],"need_to_purge":{"17":[11,13]},"pending_update":[],"pending_destroy":[{"version":27,"removed_snap":12,"seq":14}]} 2023-11-04T01:43:59.437 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 13, "last_snap": 14, "need_to_purge": { "17": [ 11, 13 ] }, "pending_destroy": [ { "removed_snap": 12, "seq": 14, "version": 27 } ], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:43:11.476475+0000" } ] } 2023-11-04T01:43:59.437 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.542+0000 7f2a00a26640 1 Processor -- start 2023-11-04T01:43:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.542+0000 7f2a00a26640 1 -- start start 2023-11-04T01:43:59.545 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.543+0000 7f2a00a26640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f29fc06d9c0 0x7f29fc0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.543+0000 7f2a00a26640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29fc06c5f0 0x7f29fc071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.543+0000 7f2a00a26640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc06cc90 con 0x7f29fc0ade00 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.543+0000 7f2a00a26640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29fc0b0c40 con 0x7f29fc06d9c0 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.543+0000 7f2a00a26640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc071b50 con 0x7f29fc06c5f0 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.543+0000 7f29f9d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f29fc06d9c0 0x7f29fc0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.543+0000 7f29fa59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f29fc0ade00 0x7f29fc0b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51192/0 (socket says 172.21.15.44:51192) 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.543+0000 7f29fa59c640 1 -- 172.21.15.44:0/1257839700 learned_addr learned my addr 172.21.15.44:0/1257839700 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.543+0000 7f29fad9d640 1 --2- 172.21.15.44:0/1257839700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29fc06c5f0 0x7f29fc071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.544+0000 7f29f9d9b640 1 -- 172.21.15.44:0/1257839700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29fc06c5f0 msgr2=0x7f29fc071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.544+0000 7f29f9d9b640 1 --2- 172.21.15.44:0/1257839700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29fc06c5f0 0x7f29fc071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.544+0000 7f29f9d9b640 1 -- 172.21.15.44:0/1257839700 >> v1:172.21.15.44:6789/0 conn(0x7f29fc0ade00 legacy=0x7f29fc0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.544+0000 7f29f9d9b640 1 -- 172.21.15.44:0/1257839700 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc0b0e60 con 0x7f29fc06d9c0 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.544+0000 7f29f9d9b640 1 --2- 172.21.15.44:0/1257839700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29fc06d9c0 0x7f29fc0710d0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f29e40097a0 tx=0x7f29e402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226077594cf8c52 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.544+0000 7f29f959a640 1 -- 172.21.15.44:0/1257839700 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e402f050 con 0x7f29fc06d9c0 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.544+0000 7f29f959a640 1 -- 172.21.15.44:0/1257839700 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e4031700 con 0x7f29fc06d9c0 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.545+0000 7f29f959a640 1 -- 172.21.15.44:0/1257839700 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4031a90 con 0x7f29fc06d9c0 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.545+0000 7f2a00a26640 1 -- 172.21.15.44:0/1257839700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29fc06d9c0 msgr2=0x7f29fc0710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.545+0000 7f2a00a26640 1 --2- 172.21.15.44:0/1257839700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29fc06d9c0 0x7f29fc0710d0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f29e40097a0 tx=0x7f29e402b7a0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.545+0000 7f2a00a26640 1 -- 172.21.15.44:0/1257839700 shutdown_connections 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.545+0000 7f2a00a26640 1 --2- 172.21.15.44:0/1257839700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29fc06c5f0 0x7f29fc071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.545+0000 7f2a00a26640 1 --2- 172.21.15.44:0/1257839700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29fc06d9c0 0x7f29fc0710d0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.545+0000 7f2a00a26640 1 -- 172.21.15.44:0/1257839700 >> 172.21.15.44:0/1257839700 conn(0x7f29fc0cb530 msgr2=0x7f29fc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.545+0000 7f2a00a26640 1 -- 172.21.15.44:0/1257839700 shutdown_connections 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.545+0000 7f2a00a26640 1 -- 172.21.15.44:0/1257839700 wait complete. 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.546+0000 7f2a00a26640 1 Processor -- start 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.546+0000 7f2a00a26640 1 -- start start 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.547+0000 7f2a00a26640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29fc06c5f0 0x7f29fc15c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.547+0000 7f2a00a26640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29fc06d9c0 0x7f29fc0c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.547+0000 7f2a00a26640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29fc0ade00 0x7f29fc0c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.547+0000 7f2a00a26640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc1e4640 con 0x7f29fc06d9c0 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.547+0000 7f2a00a26640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc0c5560 con 0x7f29fc0ade00 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.547+0000 7f2a00a26640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc15cb20 con 0x7f29fc06c5f0 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.547+0000 7f29f9d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29fc06d9c0 0x7f29fc0c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.547+0000 7f29f9d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29fc06d9c0 0x7f29fc0c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38650/0 (socket says 172.21.15.44:38650) 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.547+0000 7f29f9d9b640 1 -- 172.21.15.44:0/21855641 learned_addr learned my addr 172.21.15.44:0/21855641 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.547+0000 7f29fad9d640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29fc0ade00 0x7f29fc0c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.547+0000 7f29fa59c640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29fc06c5f0 0x7f29fc15c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.548+0000 7f29f9d9b640 1 -- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29fc06c5f0 msgr2=0x7f29fc15c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.548+0000 7f29f9d9b640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29fc06c5f0 0x7f29fc15c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.548+0000 7f29f9d9b640 1 -- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29fc0ade00 msgr2=0x7f29fc0c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.548+0000 7f29f9d9b640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29fc0ade00 0x7f29fc0c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.548+0000 7f29f9d9b640 1 -- 172.21.15.44:0/21855641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4009400 con 0x7f29fc06d9c0 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.548+0000 7f29fad9d640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29fc0ade00 0x7f29fc0c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.548+0000 7f29fa59c640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29fc06c5f0 0x7f29fc15c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.548+0000 7f29f9d9b640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29fc06d9c0 0x7f29fc0c7b90 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f29e4036040 tx=0x7f29e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.548+0000 7f29f2ffd640 1 -- 172.21.15.44:0/21855641 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4033c30 con 0x7f29fc06d9c0 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.548+0000 7f29f2ffd640 1 -- 172.21.15.44:0/21855641 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e4033db0 con 0x7f29fc06d9c0 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.548+0000 7f2a00a26640 1 -- 172.21.15.44:0/21855641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29fc1e3ca0 con 0x7f29fc06d9c0 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.548+0000 7f29f2ffd640 1 -- 172.21.15.44:0/21855641 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e403c640 con 0x7f29fc06d9c0 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.548+0000 7f2a00a26640 1 -- 172.21.15.44:0/21855641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29fc1e4260 con 0x7f29fc06d9c0 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.549+0000 7f2a00a26640 1 -- 172.21.15.44:0/21855641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29fc1e4780 con 0x7f29fc06d9c0 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.550+0000 7f29f2ffd640 1 -- 172.21.15.44:0/21855641 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f29e403a040 con 0x7f29fc06d9c0 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.550+0000 7f29f2ffd640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f29dc06ae70 0x7f29dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.550+0000 7f29f2ffd640 1 -- 172.21.15.44:0/21855641 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7f29e40ab450 con 0x7f29fc06d9c0 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.550+0000 7f29fa59c640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f29dc06ae70 0x7f29dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.551+0000 7f29fa59c640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f29dc06ae70 0x7f29dc06d330 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f29f4005880 tx=0x7f29f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.554+0000 7f29f2ffd640 1 -- 172.21.15.44:0/21855641 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f29fc1e4780 con 0x7f29fc06d9c0 2023-11-04T01:43:59.587 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:59.590 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:59.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.769+0000 7f2a00a26640 1 -- 172.21.15.44:0/21855641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29fc1e4780 con 0x7f29fc06d9c0 2023-11-04T01:43:59.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.770+0000 7f29f2ffd640 1 -- 172.21.15.44:0/21855641 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) v1 ==== 95+0+4934 (secure 0 0 0) 0x7f29fc1e4780 con 0x7f29fc06d9c0 2023-11-04T01:43:59.772 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:43:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":119,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/830347539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":830347539},{"type":"v1","addr":"172.21.15.44:6835","nonce":830347539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:43:51.283197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:active","state_seq":18,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8703":{"gid":8703,"name":"c","rank":1,"incarnation":115,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 119 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.772+0000 7f2a00a26640 1 -- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f29dc06ae70 msgr2=0x7f29dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.772+0000 7f2a00a26640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f29dc06ae70 0x7f29dc06d330 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f29f4005880 tx=0x7f29f4009040 comp rx=0 tx=0).stop 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.772+0000 7f2a00a26640 1 -- 172.21.15.44:0/21855641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29fc06d9c0 msgr2=0x7f29fc0c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.772+0000 7f2a00a26640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29fc06d9c0 0x7f29fc0c7b90 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f29e4036040 tx=0x7f29e40046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.772+0000 7f2a00a26640 1 -- 172.21.15.44:0/21855641 shutdown_connections 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.772+0000 7f2a00a26640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f29dc06ae70 0x7f29dc06d330 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.772+0000 7f2a00a26640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29fc0ade00 0x7f29fc0c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.772+0000 7f2a00a26640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29fc06d9c0 0x7f29fc0c7b90 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.772+0000 7f2a00a26640 1 --2- 172.21.15.44:0/21855641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29fc06c5f0 0x7f29fc15c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.772+0000 7f2a00a26640 1 -- 172.21.15.44:0/21855641 >> 172.21.15.44:0/21855641 conn(0x7f29fc0cb530 msgr2=0x7f29fc0c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.772+0000 7f2a00a26640 1 -- 172.21.15.44:0/21855641 shutdown_connections 2023-11-04T01:43:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.772+0000 7f2a00a26640 1 -- 172.21.15.44:0/21855641 wait complete. 2023-11-04T01:43:59.784 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.891+0000 7f4e699cc640 1 Processor -- start 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.891+0000 7f4e699cc640 1 -- start start 2023-11-04T01:43:59.895 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.891+0000 7f4e699cc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e640ceda0 0x7f4e6415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.891+0000 7f4e699cc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4e640b2210 0x7f4e6415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.891+0000 7f4e699cc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6415d9a0 con 0x7f4e640cf180 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.891+0000 7f4e699cc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e640b1df0 con 0x7f4e640b2210 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.891+0000 7f4e699cc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e640cfd20 con 0x7f4e640ceda0 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.892+0000 7f4e5bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4e640b2210 0x7f4e6415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.892+0000 7f4e5bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4e640b2210 0x7f4e6415d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38664/0 (socket says 172.21.15.44:38664) 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.892+0000 7f4e5bfff640 1 -- 172.21.15.44:0/2773604436 learned_addr learned my addr 172.21.15.44:0/2773604436 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.892+0000 7f4e62ffd640 1 --2- 172.21.15.44:0/2773604436 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e640ceda0 0x7f4e6415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.892+0000 7f4e5bfff640 1 -- 172.21.15.44:0/2773604436 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e640ceda0 msgr2=0x7f4e6415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.892+0000 7f4e5bfff640 1 --2- 172.21.15.44:0/2773604436 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e640ceda0 0x7f4e6415cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.892+0000 7f4e5bfff640 1 -- 172.21.15.44:0/2773604436 >> v1:172.21.15.204:6789/0 conn(0x7f4e640cf180 legacy=0x7f4e640cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.892+0000 7f4e5bfff640 1 -- 172.21.15.44:0/2773604436 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e640b0150 con 0x7f4e640b2210 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.893+0000 7f4e5bfff640 1 --2- 172.21.15.44:0/2773604436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e640b2210 0x7f4e6415d460 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c009870 tx=0x7f4e4c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa83b1f9ce49481 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.893+0000 7f4e627fc640 1 -- 172.21.15.44:0/2773604436 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c0317c0 con 0x7f4e640b2210 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.893+0000 7f4e627fc640 1 -- 172.21.15.44:0/2773604436 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c031920 con 0x7f4e640b2210 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.893+0000 7f4e627fc640 1 -- 172.21.15.44:0/2773604436 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c031cb0 con 0x7f4e640b2210 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.893+0000 7f4e699cc640 1 -- 172.21.15.44:0/2773604436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e640b2210 msgr2=0x7f4e6415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.893+0000 7f4e699cc640 1 --2- 172.21.15.44:0/2773604436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e640b2210 0x7f4e6415d460 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c009870 tx=0x7f4e4c02b860 comp rx=0 tx=0).stop 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.893+0000 7f4e699cc640 1 -- 172.21.15.44:0/2773604436 shutdown_connections 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.893+0000 7f4e699cc640 1 --2- 172.21.15.44:0/2773604436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e640b2210 0x7f4e6415d460 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.893+0000 7f4e699cc640 1 --2- 172.21.15.44:0/2773604436 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e640ceda0 0x7f4e6415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.893+0000 7f4e699cc640 1 -- 172.21.15.44:0/2773604436 >> 172.21.15.44:0/2773604436 conn(0x7f4e640d0c30 msgr2=0x7f4e640d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:59.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.894+0000 7f4e699cc640 1 -- 172.21.15.44:0/2773604436 shutdown_connections 2023-11-04T01:43:59.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.894+0000 7f4e699cc640 1 -- 172.21.15.44:0/2773604436 wait complete. 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.895+0000 7f4e699cc640 1 Processor -- start 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.895+0000 7f4e699cc640 1 -- start start 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.895+0000 7f4e699cc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e640b2210 0x7f4e6415a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.895+0000 7f4e699cc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e640ceda0 0x7f4e641f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.895+0000 7f4e699cc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e640cf180 0x7f4e641f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.895+0000 7f4e699cc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6415acf0 con 0x7f4e640b2210 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.895+0000 7f4e699cc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6415afd0 con 0x7f4e640ceda0 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.895+0000 7f4e699cc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6415b2b0 con 0x7f4e640cf180 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.895+0000 7f4e62ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e640b2210 0x7f4e6415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.896+0000 7f4e62ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e640b2210 0x7f4e6415a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38672/0 (socket says 172.21.15.44:38672) 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.896+0000 7f4e62ffd640 1 -- 172.21.15.44:0/464105926 learned_addr learned my addr 172.21.15.44:0/464105926 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.896+0000 7f4e637fe640 1 --2- 172.21.15.44:0/464105926 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e640cf180 0x7f4e641f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.896+0000 7f4e5bfff640 1 --2- 172.21.15.44:0/464105926 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e640ceda0 0x7f4e641f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.896+0000 7f4e62ffd640 1 -- 172.21.15.44:0/464105926 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e640cf180 msgr2=0x7f4e641f6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.896+0000 7f4e62ffd640 1 --2- 172.21.15.44:0/464105926 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e640cf180 0x7f4e641f6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.896+0000 7f4e62ffd640 1 -- 172.21.15.44:0/464105926 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e640ceda0 msgr2=0x7f4e641f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.896+0000 7f4e62ffd640 1 --2- 172.21.15.44:0/464105926 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e640ceda0 0x7f4e641f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.896+0000 7f4e62ffd640 1 -- 172.21.15.44:0/464105926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c0094d0 con 0x7f4e640b2210 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.896+0000 7f4e62ffd640 1 --2- 172.21.15.44:0/464105926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e640b2210 0x7f4e6415a300 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400d800 tx=0x7f4e5400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.896+0000 7f4e60ff9640 1 -- 172.21.15.44:0/464105926 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400b6c0 con 0x7f4e640b2210 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.896+0000 7f4e60ff9640 1 -- 172.21.15.44:0/464105926 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5400b820 con 0x7f4e640b2210 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.896+0000 7f4e699cc640 1 -- 172.21.15.44:0/464105926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6415b590 con 0x7f4e640b2210 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.896+0000 7f4e60ff9640 1 -- 172.21.15.44:0/464105926 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400bbd0 con 0x7f4e640b2210 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.896+0000 7f4e699cc640 1 -- 172.21.15.44:0/464105926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6415a840 con 0x7f4e640b2210 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.897+0000 7f4e699cc640 1 -- 172.21.15.44:0/464105926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e640684b0 con 0x7f4e640b2210 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.898+0000 7f4e60ff9640 1 -- 172.21.15.44:0/464105926 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e5400bd30 con 0x7f4e640b2210 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.898+0000 7f4e60ff9640 1 --2- 172.21.15.44:0/464105926 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e4406ae70 0x7f4e4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.898+0000 7f4e60ff9640 1 -- 172.21.15.44:0/464105926 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7f4e5408a380 con 0x7f4e640b2210 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.898+0000 7f4e5bfff640 1 --2- 172.21.15.44:0/464105926 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e4406ae70 0x7f4e4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.899+0000 7f4e5bfff640 1 --2- 172.21.15.44:0/464105926 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e4406ae70 0x7f4e4406d330 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c036000 tx=0x7f4e4c03d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:59.904 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:43:59.902+0000 7f4e60ff9640 1 -- 172.21.15.44:0/464105926 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e54054b60 con 0x7f4e640b2210 2023-11-04T01:44:00.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.147+0000 7f4e699cc640 1 -- 172.21.15.44:0/464105926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7f4e6415ae30 con 0x7f4e640b2210 2023-11-04T01:44:00.274 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:44:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:00.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.312+0000 7f4e60ff9640 1 -- 172.21.15.44:0/464105926 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.8703 v120) v1 ==== 112+0+0 (secure 0 0 0) 0x7f4e6415ae30 con 0x7f4e640b2210 2023-11-04T01:44:00.314 INFO:teuthology.orchestra.run.smithi044.stderr:freezing mds.8703 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.314+0000 7f4e699cc640 1 -- 172.21.15.44:0/464105926 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e4406ae70 msgr2=0x7f4e4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.314+0000 7f4e699cc640 1 --2- 172.21.15.44:0/464105926 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e4406ae70 0x7f4e4406d330 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c036000 tx=0x7f4e4c03d040 comp rx=0 tx=0).stop 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.314+0000 7f4e699cc640 1 -- 172.21.15.44:0/464105926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e640b2210 msgr2=0x7f4e6415a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.314+0000 7f4e699cc640 1 --2- 172.21.15.44:0/464105926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e640b2210 0x7f4e6415a300 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400d800 tx=0x7f4e5400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.314+0000 7f4e699cc640 1 -- 172.21.15.44:0/464105926 shutdown_connections 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.314+0000 7f4e699cc640 1 --2- 172.21.15.44:0/464105926 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f4e4406ae70 0x7f4e4406d330 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.314+0000 7f4e699cc640 1 --2- 172.21.15.44:0/464105926 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e640cf180 0x7f4e641f6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.314+0000 7f4e699cc640 1 --2- 172.21.15.44:0/464105926 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e640ceda0 0x7f4e641f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.314+0000 7f4e699cc640 1 --2- 172.21.15.44:0/464105926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e640b2210 0x7f4e6415a300 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.314+0000 7f4e699cc640 1 -- 172.21.15.44:0/464105926 >> 172.21.15.44:0/464105926 conn(0x7f4e640d0c30 msgr2=0x7f4e640c7360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.314+0000 7f4e699cc640 1 -- 172.21.15.44:0/464105926 shutdown_connections 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.314+0000 7f4e699cc640 1 -- 172.21.15.44:0/464105926 wait complete. 2023-11-04T01:44:00.327 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 3 2023-11-04T01:44:00.487 INFO:teuthology.orchestra.run.smithi044.stdout:{"success":"mds_kill_mdstable_at = '3' (not observed, change may require restart) "} 2023-11-04T01:44:00.488 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '3' (not observed, change may require restart) " } 2023-11-04T01:44:00.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:00.488 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s33) 2023-11-04T01:44:00.491 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:44:00.507 INFO:tasks.ceph.mds.c.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7f98790ef640 time 2023-11-04T01:44:00.507192+0000 2023-11-04T01:44:00.507 INFO:tasks.ceph.mds.c.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:44:00.509 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:00.509 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f987eb6efaf] 2023-11-04T01:44:00.509 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f987eb6f16d] 2023-11-04T01:44:00.509 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55817b86d1b7] 2023-11-04T01:44:00.509 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55817b5fad15] 2023-11-04T01:44:00.509 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55817b5fcb2b] 2023-11-04T01:44:00.509 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55817b5fd01c] 2023-11-04T01:44:00.509 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55817b5e6325] 2023-11-04T01:44:00.509 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f987ed5ff9a] 2023-11-04T01:44:00.509 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f987edf1741] 2023-11-04T01:44:00.509 INFO:tasks.ceph.mds.c.smithi044.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f987e29f802] 2023-11-04T01:44:00.509 INFO:tasks.ceph.mds.c.smithi044.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f987e23f450] 2023-11-04T01:44:00.510 INFO:tasks.ceph.mds.c.smithi044.stderr:2023-11-04T01:44:00.506+0000 7f98790ef640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7f98790ef640 time 2023-11-04T01:44:00.507192+0000 2023-11-04T01:44:00.510 INFO:tasks.ceph.mds.c.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:44:00.510 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:44:00.510 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:00.510 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f987eb6efaf] 2023-11-04T01:44:00.510 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f987eb6f16d] 2023-11-04T01:44:00.510 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55817b86d1b7] 2023-11-04T01:44:00.510 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55817b5fad15] 2023-11-04T01:44:00.510 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55817b5fcb2b] 2023-11-04T01:44:00.510 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55817b5fd01c] 2023-11-04T01:44:00.510 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55817b5e6325] 2023-11-04T01:44:00.510 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f987ed5ff9a] 2023-11-04T01:44:00.511 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f987edf1741] 2023-11-04T01:44:00.511 INFO:tasks.ceph.mds.c.smithi044.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f987e29f802] 2023-11-04T01:44:00.511 INFO:tasks.ceph.mds.c.smithi044.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f987e23f450] 2023-11-04T01:44:00.511 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:44:00.511 INFO:tasks.ceph.mds.c.smithi044.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:44:00.511 INFO:tasks.ceph.mds.c.smithi044.stderr: in thread 7f98790ef640 thread_name:ms_dispatch 2023-11-04T01:44:00.511 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:00.511 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f987e254db0] 2023-11-04T01:44:00.511 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f987e2a154c] 2023-11-04T01:44:00.511 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: raise() 2023-11-04T01:44:00.511 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: abort() 2023-11-04T01:44:00.511 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f987eb6f009] 2023-11-04T01:44:00.511 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f987eb6f16d] 2023-11-04T01:44:00.512 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55817b86d1b7] 2023-11-04T01:44:00.512 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55817b5fad15] 2023-11-04T01:44:00.512 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55817b5fcb2b] 2023-11-04T01:44:00.512 INFO:tasks.ceph.mds.c.smithi044.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55817b5fd01c] 2023-11-04T01:44:00.512 INFO:tasks.ceph.mds.c.smithi044.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55817b5e6325] 2023-11-04T01:44:00.512 INFO:tasks.ceph.mds.c.smithi044.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f987ed5ff9a] 2023-11-04T01:44:00.512 INFO:tasks.ceph.mds.c.smithi044.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f987edf1741] 2023-11-04T01:44:00.512 INFO:tasks.ceph.mds.c.smithi044.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f987e29f802] 2023-11-04T01:44:00.512 INFO:tasks.ceph.mds.c.smithi044.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f987e23f450] 2023-11-04T01:44:00.512 INFO:tasks.ceph.mds.c.smithi044.stderr:2023-11-04T01:44:00.507+0000 7f98790ef640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:00.512 INFO:tasks.ceph.mds.c.smithi044.stderr: in thread 7f98790ef640 thread_name:ms_dispatch 2023-11-04T01:44:00.512 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:44:00.512 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:00.512 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f987e254db0] 2023-11-04T01:44:00.513 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f987e2a154c] 2023-11-04T01:44:00.513 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: raise() 2023-11-04T01:44:00.513 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: abort() 2023-11-04T01:44:00.513 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f987eb6f009] 2023-11-04T01:44:00.513 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f987eb6f16d] 2023-11-04T01:44:00.513 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55817b86d1b7] 2023-11-04T01:44:00.513 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55817b5fad15] 2023-11-04T01:44:00.513 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55817b5fcb2b] 2023-11-04T01:44:00.513 INFO:tasks.ceph.mds.c.smithi044.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55817b5fd01c] 2023-11-04T01:44:00.513 INFO:tasks.ceph.mds.c.smithi044.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55817b5e6325] 2023-11-04T01:44:00.513 INFO:tasks.ceph.mds.c.smithi044.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f987ed5ff9a] 2023-11-04T01:44:00.513 INFO:tasks.ceph.mds.c.smithi044.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f987edf1741] 2023-11-04T01:44:00.513 INFO:tasks.ceph.mds.c.smithi044.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f987e29f802] 2023-11-04T01:44:00.513 INFO:tasks.ceph.mds.c.smithi044.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f987e23f450] 2023-11-04T01:44:00.513 INFO:tasks.ceph.mds.c.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:00.514 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:44:00.515 INFO:tasks.ceph.mds.c.smithi044.stderr: -1> 2023-11-04T01:44:00.506+0000 7f98790ef640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7f98790ef640 time 2023-11-04T01:44:00.507192+0000 2023-11-04T01:44:00.515 INFO:tasks.ceph.mds.c.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:44:00.515 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:44:00.516 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:00.516 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f987eb6efaf] 2023-11-04T01:44:00.516 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f987eb6f16d] 2023-11-04T01:44:00.516 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55817b86d1b7] 2023-11-04T01:44:00.516 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55817b5fad15] 2023-11-04T01:44:00.516 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55817b5fcb2b] 2023-11-04T01:44:00.516 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55817b5fd01c] 2023-11-04T01:44:00.516 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55817b5e6325] 2023-11-04T01:44:00.516 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f987ed5ff9a] 2023-11-04T01:44:00.516 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f987edf1741] 2023-11-04T01:44:00.516 INFO:tasks.ceph.mds.c.smithi044.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f987e29f802] 2023-11-04T01:44:00.516 INFO:tasks.ceph.mds.c.smithi044.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f987e23f450] 2023-11-04T01:44:00.516 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:44:00.517 INFO:tasks.ceph.mds.c.smithi044.stderr: 0> 2023-11-04T01:44:00.507+0000 7f98790ef640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:00.517 INFO:tasks.ceph.mds.c.smithi044.stderr: in thread 7f98790ef640 thread_name:ms_dispatch 2023-11-04T01:44:00.517 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:44:00.517 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:00.517 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f987e254db0] 2023-11-04T01:44:00.517 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f987e2a154c] 2023-11-04T01:44:00.517 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: raise() 2023-11-04T01:44:00.517 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: abort() 2023-11-04T01:44:00.517 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f987eb6f009] 2023-11-04T01:44:00.517 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f987eb6f16d] 2023-11-04T01:44:00.517 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55817b86d1b7] 2023-11-04T01:44:00.517 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55817b5fad15] 2023-11-04T01:44:00.517 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55817b5fcb2b] 2023-11-04T01:44:00.517 INFO:tasks.ceph.mds.c.smithi044.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55817b5fd01c] 2023-11-04T01:44:00.518 INFO:tasks.ceph.mds.c.smithi044.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55817b5e6325] 2023-11-04T01:44:00.518 INFO:tasks.ceph.mds.c.smithi044.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f987ed5ff9a] 2023-11-04T01:44:00.518 INFO:tasks.ceph.mds.c.smithi044.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f987edf1741] 2023-11-04T01:44:00.518 INFO:tasks.ceph.mds.c.smithi044.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f987e29f802] 2023-11-04T01:44:00.518 INFO:tasks.ceph.mds.c.smithi044.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f987e23f450] 2023-11-04T01:44:00.518 INFO:tasks.ceph.mds.c.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:00.518 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:44:00.521 INFO:tasks.ceph.mds.c.smithi044.stderr: -1> 2023-11-04T01:44:00.506+0000 7f98790ef640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7f98790ef640 time 2023-11-04T01:44:00.507192+0000 2023-11-04T01:44:00.521 INFO:tasks.ceph.mds.c.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:44:00.521 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:44:00.521 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:00.521 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f987eb6efaf] 2023-11-04T01:44:00.521 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f987eb6f16d] 2023-11-04T01:44:00.521 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55817b86d1b7] 2023-11-04T01:44:00.521 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55817b5fad15] 2023-11-04T01:44:00.521 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55817b5fcb2b] 2023-11-04T01:44:00.522 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55817b5fd01c] 2023-11-04T01:44:00.522 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55817b5e6325] 2023-11-04T01:44:00.522 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f987ed5ff9a] 2023-11-04T01:44:00.522 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f987edf1741] 2023-11-04T01:44:00.522 INFO:tasks.ceph.mds.c.smithi044.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f987e29f802] 2023-11-04T01:44:00.522 INFO:tasks.ceph.mds.c.smithi044.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f987e23f450] 2023-11-04T01:44:00.522 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:44:00.522 INFO:tasks.ceph.mds.c.smithi044.stderr: 0> 2023-11-04T01:44:00.507+0000 7f98790ef640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:00.522 INFO:tasks.ceph.mds.c.smithi044.stderr: in thread 7f98790ef640 thread_name:ms_dispatch 2023-11-04T01:44:00.522 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:44:00.522 INFO:tasks.ceph.mds.c.smithi044.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:00.522 INFO:tasks.ceph.mds.c.smithi044.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f987e254db0] 2023-11-04T01:44:00.522 INFO:tasks.ceph.mds.c.smithi044.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f987e2a154c] 2023-11-04T01:44:00.523 INFO:tasks.ceph.mds.c.smithi044.stderr: 3: raise() 2023-11-04T01:44:00.523 INFO:tasks.ceph.mds.c.smithi044.stderr: 4: abort() 2023-11-04T01:44:00.523 INFO:tasks.ceph.mds.c.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f987eb6f009] 2023-11-04T01:44:00.523 INFO:tasks.ceph.mds.c.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f987eb6f16d] 2023-11-04T01:44:00.523 INFO:tasks.ceph.mds.c.smithi044.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55817b86d1b7] 2023-11-04T01:44:00.523 INFO:tasks.ceph.mds.c.smithi044.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55817b5fad15] 2023-11-04T01:44:00.523 INFO:tasks.ceph.mds.c.smithi044.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55817b5fcb2b] 2023-11-04T01:44:00.523 INFO:tasks.ceph.mds.c.smithi044.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55817b5fd01c] 2023-11-04T01:44:00.523 INFO:tasks.ceph.mds.c.smithi044.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55817b5e6325] 2023-11-04T01:44:00.523 INFO:tasks.ceph.mds.c.smithi044.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f987ed5ff9a] 2023-11-04T01:44:00.523 INFO:tasks.ceph.mds.c.smithi044.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f987edf1741] 2023-11-04T01:44:00.523 INFO:tasks.ceph.mds.c.smithi044.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f987e29f802] 2023-11-04T01:44:00.523 INFO:tasks.ceph.mds.c.smithi044.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f987e23f450] 2023-11-04T01:44:00.523 INFO:tasks.ceph.mds.c.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:00.524 INFO:tasks.ceph.mds.c.smithi044.stderr: 2023-11-04T01:44:00.621 INFO:teuthology.orchestra.run.smithi044.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:44:00.621 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:44:00.622 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:00.707 INFO:tasks.ceph.mds.c.smithi044.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:44:00.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.768+0000 7fd485d25640 1 Processor -- start 2023-11-04T01:44:00.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.768+0000 7fd485d25640 1 -- start start 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.769+0000 7fd485d25640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4800ceda0 0x7fd48015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.769+0000 7fd485d25640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd4800b2210 0x7fd48015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.769+0000 7fd485d25640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48015d9a0 con 0x7fd4800cf180 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.769+0000 7fd485d25640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4800b1df0 con 0x7fd4800b2210 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.769+0000 7fd485d25640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4800cfd20 con 0x7fd4800ceda0 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.769+0000 7fd47effd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd4800b2210 0x7fd48015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.769+0000 7fd47ffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd4800cf180 0x7fd4800cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51204/0 (socket says 172.21.15.44:51204) 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.769+0000 7fd47ffff640 1 -- 172.21.15.44:0/2660609699 learned_addr learned my addr 172.21.15.44:0/2660609699 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.769+0000 7fd47effd640 1 -- 172.21.15.44:0/2660609699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4800ceda0 msgr2=0x7fd48015cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.769+0000 7fd47f7fe640 1 --2- 172.21.15.44:0/2660609699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4800ceda0 0x7fd48015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.769+0000 7fd47effd640 1 --2- 172.21.15.44:0/2660609699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4800ceda0 0x7fd48015cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.769+0000 7fd47effd640 1 -- 172.21.15.44:0/2660609699 >> v1:172.21.15.44:6789/0 conn(0x7fd4800cf180 legacy=0x7fd4800cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.769+0000 7fd47effd640 1 -- 172.21.15.44:0/2660609699 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4800b0150 con 0x7fd4800b2210 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.769+0000 7fd47e7fc640 1 -- 172.21.15.44:0/2660609699 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483623187 0 0) 0x7fd48015d9a0 con 0x7fd4800cf180 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.770+0000 7fd47effd640 1 --2- 172.21.15.44:0/2660609699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800b2210 0x7fd48015d460 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fd4740097a0 tx=0x7fd47402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5857f8d18dc28246 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.770+0000 7fd47e7fc640 1 -- 172.21.15.44:0/2660609699 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47402e070 con 0x7fd4800b2210 2023-11-04T01:44:00.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.770+0000 7fd47e7fc640 1 -- 172.21.15.44:0/2660609699 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4740315a0 con 0x7fd4800b2210 2023-11-04T01:44:00.774 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.770+0000 7fd47e7fc640 1 -- 172.21.15.44:0/2660609699 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474031930 con 0x7fd4800b2210 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.771+0000 7fd485d25640 1 -- 172.21.15.44:0/2660609699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800b2210 msgr2=0x7fd48015d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.771+0000 7fd485d25640 1 --2- 172.21.15.44:0/2660609699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800b2210 0x7fd48015d460 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fd4740097a0 tx=0x7fd47402b840 comp rx=0 tx=0).stop 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.771+0000 7fd485d25640 1 -- 172.21.15.44:0/2660609699 shutdown_connections 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.771+0000 7fd485d25640 1 --2- 172.21.15.44:0/2660609699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800b2210 0x7fd48015d460 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.771+0000 7fd485d25640 1 --2- 172.21.15.44:0/2660609699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4800ceda0 0x7fd48015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.771+0000 7fd485d25640 1 -- 172.21.15.44:0/2660609699 >> 172.21.15.44:0/2660609699 conn(0x7fd4800d0c30 msgr2=0x7fd4800d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.771+0000 7fd485d25640 1 -- 172.21.15.44:0/2660609699 shutdown_connections 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.771+0000 7fd485d25640 1 -- 172.21.15.44:0/2660609699 wait complete. 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.772+0000 7fd485d25640 1 Processor -- start 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.772+0000 7fd485d25640 1 -- start start 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.773+0000 7fd485d25640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4800b2210 0x7fd4800b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.773+0000 7fd485d25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800ceda0 0x7fd4800cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.773+0000 7fd485d25640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4800cf180 0x7fd4800cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.773+0000 7fd485d25640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48009d9e0 con 0x7fd4800ceda0 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.773+0000 7fd485d25640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4800ce0c0 con 0x7fd4800cf180 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.773+0000 7fd485d25640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4800cb400 con 0x7fd4800b2210 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.773+0000 7fd47effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800ceda0 0x7fd4800cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.773+0000 7fd47effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800ceda0 0x7fd4800cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38696/0 (socket says 172.21.15.44:38696) 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.773+0000 7fd47effd640 1 -- 172.21.15.44:0/379555998 learned_addr learned my addr 172.21.15.44:0/379555998 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.773+0000 7fd47f7fe640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4800b2210 0x7fd4800b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.773+0000 7fd47effd640 1 -- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4800b2210 msgr2=0x7fd4800b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.773+0000 7fd47ffff640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4800cf180 0x7fd4800cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.773+0000 7fd47effd640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4800b2210 0x7fd4800b64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.773+0000 7fd47effd640 1 -- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4800cf180 msgr2=0x7fd4800cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.773+0000 7fd47effd640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4800cf180 0x7fd4800cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.774+0000 7fd47effd640 1 -- 172.21.15.44:0/379555998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd474009400 con 0x7fd4800ceda0 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.774+0000 7fd47f7fe640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4800b2210 0x7fd4800b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.774+0000 7fd47ffff640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4800cf180 0x7fd4800cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.774+0000 7fd47effd640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800ceda0 0x7fd4800cc4a0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fd474034040 tx=0x7fd4740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.774+0000 7fd467fff640 1 -- 172.21.15.44:0/379555998 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474032900 con 0x7fd4800ceda0 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.774+0000 7fd467fff640 1 -- 172.21.15.44:0/379555998 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd474032a60 con 0x7fd4800ceda0 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.774+0000 7fd485d25640 1 -- 172.21.15.44:0/379555998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4800cb6e0 con 0x7fd4800ceda0 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.774+0000 7fd467fff640 1 -- 172.21.15.44:0/379555998 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474032e10 con 0x7fd4800ceda0 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.774+0000 7fd485d25640 1 -- 172.21.15.44:0/379555998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4800cbca0 con 0x7fd4800ceda0 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.775+0000 7fd485d25640 1 -- 172.21.15.44:0/379555998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4800684b0 con 0x7fd4800ceda0 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.775+0000 7fd467fff640 1 -- 172.21.15.44:0/379555998 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd47404e430 con 0x7fd4800ceda0 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.776+0000 7fd467fff640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd46c06ae70 0x7fd46c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.776+0000 7fd467fff640 1 -- 172.21.15.44:0/379555998 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8139+0+0 (secure 0 0 0) 0x7fd4740ac0e0 con 0x7fd4800ceda0 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.776+0000 7fd47f7fe640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd46c06ae70 0x7fd46c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.777+0000 7fd47f7fe640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd46c06ae70 0x7fd46c06d330 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd470006fd0 tx=0x7fd470008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.781 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.780+0000 7fd467fff640 1 -- 172.21.15.44:0/379555998 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd4740768a0 con 0x7fd4800ceda0 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.991+0000 7fd485d25640 1 -- 172.21.15.44:0/379555998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4800c7760 con 0x7fd4800ceda0 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.992+0000 7fd467fff640 1 -- 172.21.15.44:0/379555998 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) v1 ==== 95+0+4934 (secure 0 0 0) 0x7fd474079ec0 con 0x7fd4800ceda0 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":120,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/830347539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":830347539},{"type":"v1","addr":"172.21.15.44:6835","nonce":830347539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:44:00.148825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:active","state_seq":18,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8703":{"gid":8703,"name":"c","rank":1,"incarnation":115,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 120 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.993+0000 7fd485d25640 1 -- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd46c06ae70 msgr2=0x7fd46c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.993+0000 7fd485d25640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd46c06ae70 0x7fd46c06d330 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd470006fd0 tx=0x7fd470008040 comp rx=0 tx=0).stop 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.993+0000 7fd485d25640 1 -- 172.21.15.44:0/379555998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800ceda0 msgr2=0x7fd4800cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.993+0000 7fd485d25640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800ceda0 0x7fd4800cc4a0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fd474034040 tx=0x7fd4740046c0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.994+0000 7fd485d25640 1 -- 172.21.15.44:0/379555998 shutdown_connections 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.994+0000 7fd485d25640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fd46c06ae70 0x7fd46c06d330 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.994+0000 7fd485d25640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4800cf180 0x7fd4800cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.994+0000 7fd485d25640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800ceda0 0x7fd4800cc4a0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.994+0000 7fd485d25640 1 --2- 172.21.15.44:0/379555998 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4800b2210 0x7fd4800b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.994+0000 7fd485d25640 1 -- 172.21.15.44:0/379555998 >> 172.21.15.44:0/379555998 conn(0x7fd4800d0c30 msgr2=0x7fd48015c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.994+0000 7fd485d25640 1 -- 172.21.15.44:0/379555998 shutdown_connections 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:00.994+0000 7fd485d25640 1 -- 172.21.15.44:0/379555998 wait complete. 2023-11-04T01:44:01.006 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:06.008 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:06.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.125+0000 7f3a201a9640 1 Processor -- start 2023-11-04T01:44:06.127 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.125+0000 7f3a201a9640 1 -- start start 2023-11-04T01:44:06.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.126+0000 7f3a201a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3a180cd9c0 0x7f3a18165e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:06.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.126+0000 7f3a201a9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a180cf240 con 0x7f3a1815b200 2023-11-04T01:44:06.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.126+0000 7f3a201a9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a180cde80 con 0x7f3a180afda0 2023-11-04T01:44:06.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.126+0000 7f3a201a9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a180cf670 con 0x7f3a180cd9c0 2023-11-04T01:44:06.128 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.126+0000 7f3a1e746640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3a180cd9c0 0x7f3a18165e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:06.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.126+0000 7f3a1e746640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3a180cd9c0 0x7f3a18165e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39608/0 (socket says 172.21.15.44:39608) 2023-11-04T01:44:06.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.126+0000 7f3a1df45640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3a1815b200 0x7f3a180ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60230/0 (socket says 172.21.15.44:60230) 2023-11-04T01:44:06.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.126+0000 7f3a1e746640 1 -- 172.21.15.44:0/3191960799 learned_addr learned my addr 172.21.15.44:0/3191960799 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:06.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.127+0000 7f3a1e746640 1 -- 172.21.15.44:0/3191960799 >> v1:172.21.15.204:6789/0 conn(0x7f3a180afda0 legacy=0x7f3a180cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:06.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.127+0000 7f3a1e746640 1 -- 172.21.15.44:0/3191960799 >> v1:172.21.15.44:6789/0 conn(0x7f3a1815b200 legacy=0x7f3a180ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:06.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.127+0000 7f3a1e746640 1 -- 172.21.15.44:0/3191960799 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a180cf950 con 0x7f3a180cd9c0 2023-11-04T01:44:06.129 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.127+0000 7f3a1cf43640 1 -- 172.21.15.44:0/3191960799 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857186821 0 0) 0x7f3a100011d0 con 0x7f3a1815b200 2023-11-04T01:44:06.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.127+0000 7f3a1e746640 1 --2- 172.21.15.44:0/3191960799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a180cd9c0 0x7f3a18165e40 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f3a08009e50 tx=0x7f3a0802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fafa7cb8ba54db8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:06.130 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.128+0000 7f3a1cf43640 1 -- 172.21.15.44:0/3191960799 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0802cb20 con 0x7f3a180cd9c0 2023-11-04T01:44:06.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.128+0000 7f3a1cf43640 1 -- 172.21.15.44:0/3191960799 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0802cc80 con 0x7f3a180cd9c0 2023-11-04T01:44:06.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.128+0000 7f3a1cf43640 1 -- 172.21.15.44:0/3191960799 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a080343f0 con 0x7f3a180cd9c0 2023-11-04T01:44:06.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.128+0000 7f3a201a9640 1 -- 172.21.15.44:0/3191960799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a180cd9c0 msgr2=0x7f3a18165e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:06.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.128+0000 7f3a201a9640 1 --2- 172.21.15.44:0/3191960799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a180cd9c0 0x7f3a18165e40 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f3a08009e50 tx=0x7f3a0802bf80 comp rx=0 tx=0).stop 2023-11-04T01:44:06.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.128+0000 7f3a201a9640 1 -- 172.21.15.44:0/3191960799 shutdown_connections 2023-11-04T01:44:06.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.128+0000 7f3a201a9640 1 --2- 172.21.15.44:0/3191960799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a180cd9c0 0x7f3a18165e40 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.128+0000 7f3a201a9640 1 -- 172.21.15.44:0/3191960799 >> 172.21.15.44:0/3191960799 conn(0x7f3a180d0c30 msgr2=0x7f3a180d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:06.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.128+0000 7f3a201a9640 1 -- 172.21.15.44:0/3191960799 shutdown_connections 2023-11-04T01:44:06.131 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.128+0000 7f3a201a9640 1 -- 172.21.15.44:0/3191960799 wait complete. 2023-11-04T01:44:06.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.129+0000 7f3a201a9640 1 Processor -- start 2023-11-04T01:44:06.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.130+0000 7f3a201a9640 1 -- start start 2023-11-04T01:44:06.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.130+0000 7f3a201a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a180afda0 0x7f3a180b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:06.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.130+0000 7f3a201a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a180cd9c0 0x7f3a180b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:06.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.130+0000 7f3a201a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1815b200 0x7f3a180ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:06.133 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.130+0000 7f3a201a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a181f5240 con 0x7f3a1815b200 2023-11-04T01:44:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.130+0000 7f3a201a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a181f4370 con 0x7f3a180cd9c0 2023-11-04T01:44:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.130+0000 7f3a201a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a181f45c0 con 0x7f3a180afda0 2023-11-04T01:44:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.130+0000 7f3a1e746640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1815b200 0x7f3a180ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.130+0000 7f3a1e746640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1815b200 0x7f3a180ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39622/0 (socket says 172.21.15.44:39622) 2023-11-04T01:44:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.130+0000 7f3a1e746640 1 -- 172.21.15.44:0/872431288 learned_addr learned my addr 172.21.15.44:0/872431288 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.131+0000 7f3a1df45640 1 --2- 172.21.15.44:0/872431288 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a180afda0 0x7f3a180b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.131+0000 7f3a1d744640 1 --2- 172.21.15.44:0/872431288 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a180cd9c0 0x7f3a180b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.131+0000 7f3a1e746640 1 -- 172.21.15.44:0/872431288 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a180afda0 msgr2=0x7f3a180b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.131+0000 7f3a1e746640 1 --2- 172.21.15.44:0/872431288 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a180afda0 0x7f3a180b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.131+0000 7f3a1e746640 1 -- 172.21.15.44:0/872431288 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a180cd9c0 msgr2=0x7f3a180b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.131+0000 7f3a1e746640 1 --2- 172.21.15.44:0/872431288 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a180cd9c0 0x7f3a180b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.131+0000 7f3a1e746640 1 -- 172.21.15.44:0/872431288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a08009b30 con 0x7f3a1815b200 2023-11-04T01:44:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.131+0000 7f3a1e746640 1 --2- 172.21.15.44:0/872431288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1815b200 0x7f3a180ae6b0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f3a08036040 tx=0x7f3a08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.131+0000 7f3a167fc640 1 -- 172.21.15.44:0/872431288 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08009510 con 0x7f3a1815b200 2023-11-04T01:44:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.131+0000 7f3a167fc640 1 -- 172.21.15.44:0/872431288 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a08007e50 con 0x7f3a1815b200 2023-11-04T01:44:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.131+0000 7f3a201a9640 1 -- 172.21.15.44:0/872431288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a181f48a0 con 0x7f3a1815b200 2023-11-04T01:44:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.131+0000 7f3a167fc640 1 -- 172.21.15.44:0/872431288 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0803e690 con 0x7f3a1815b200 2023-11-04T01:44:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.131+0000 7f3a201a9640 1 -- 172.21.15.44:0/872431288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a181f4e60 con 0x7f3a1815b200 2023-11-04T01:44:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.132+0000 7f3a201a9640 1 -- 172.21.15.44:0/872431288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a180684b0 con 0x7f3a1815b200 2023-11-04T01:44:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.133+0000 7f3a167fc640 1 -- 172.21.15.44:0/872431288 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a0803e7f0 con 0x7f3a1815b200 2023-11-04T01:44:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.133+0000 7f3a167fc640 1 --2- 172.21.15.44:0/872431288 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3a0406ae70 0x7f3a0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.133+0000 7f3a167fc640 1 -- 172.21.15.44:0/872431288 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f3a080acce0 con 0x7f3a1815b200 2023-11-04T01:44:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.133+0000 7f3a1df45640 1 --2- 172.21.15.44:0/872431288 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3a0406ae70 0x7f3a0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.134+0000 7f3a1df45640 1 --2- 172.21.15.44:0/872431288 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3a0406ae70 0x7f3a0406d330 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3a10001020 tx=0x7f3a10009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:06.139 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.137+0000 7f3a167fc640 1 -- 172.21.15.44:0/872431288 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a08077380 con 0x7f3a1815b200 2023-11-04T01:44:06.351 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.350+0000 7f3a201a9640 1 -- 172.21.15.44:0/872431288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a18071280 con 0x7f3a1815b200 2023-11-04T01:44:06.352 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.350+0000 7f3a167fc640 1 -- 172.21.15.44:0/872431288 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) v1 ==== 95+0+4934 (secure 0 0 0) 0x7f3a08043090 con 0x7f3a1815b200 2023-11-04T01:44:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:44:06.352 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":120,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/830347539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":830347539},{"type":"v1","addr":"172.21.15.44:6835","nonce":830347539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:44:00.148825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:active","state_seq":18,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8703":{"gid":8703,"name":"c","rank":1,"incarnation":115,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:06.352 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 120 2023-11-04T01:44:06.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.352+0000 7f3a201a9640 1 -- 172.21.15.44:0/872431288 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3a0406ae70 msgr2=0x7f3a0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:06.354 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.352+0000 7f3a201a9640 1 --2- 172.21.15.44:0/872431288 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3a0406ae70 0x7f3a0406d330 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3a10001020 tx=0x7f3a10009040 comp rx=0 tx=0).stop 2023-11-04T01:44:06.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.352+0000 7f3a201a9640 1 -- 172.21.15.44:0/872431288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1815b200 msgr2=0x7f3a180ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:06.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.352+0000 7f3a201a9640 1 --2- 172.21.15.44:0/872431288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1815b200 0x7f3a180ae6b0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f3a08036040 tx=0x7f3a08004a40 comp rx=0 tx=0).stop 2023-11-04T01:44:06.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.352+0000 7f3a201a9640 1 -- 172.21.15.44:0/872431288 shutdown_connections 2023-11-04T01:44:06.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.352+0000 7f3a201a9640 1 --2- 172.21.15.44:0/872431288 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3a0406ae70 0x7f3a0406d330 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.352+0000 7f3a201a9640 1 --2- 172.21.15.44:0/872431288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a1815b200 0x7f3a180ae6b0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.352+0000 7f3a201a9640 1 --2- 172.21.15.44:0/872431288 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3a180cd9c0 0x7f3a180b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.352+0000 7f3a201a9640 1 --2- 172.21.15.44:0/872431288 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3a180afda0 0x7f3a180b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.352+0000 7f3a201a9640 1 -- 172.21.15.44:0/872431288 >> 172.21.15.44:0/872431288 conn(0x7f3a180d0c30 msgr2=0x7f3a180d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:06.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.352+0000 7f3a201a9640 1 -- 172.21.15.44:0/872431288 shutdown_connections 2023-11-04T01:44:06.355 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:06.352+0000 7f3a201a9640 1 -- 172.21.15.44:0/872431288 wait complete. 2023-11-04T01:44:06.365 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:06.742 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:44:11.366 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.483+0000 7f46fcdc5640 1 Processor -- start 2023-11-04T01:44:11.485 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.483+0000 7f46fcdc5640 1 -- start start 2023-11-04T01:44:11.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.484+0000 7f46fcdc5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46f815d100 0x7f46f80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.484+0000 7f46fcdc5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f46f815d4e0 0x7f46f80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.484+0000 7f46fcdc5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f80b32b0 con 0x7f46f80d3b60 2023-11-04T01:44:11.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.484+0000 7f46fcdc5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f80cee10 con 0x7f46f815d4e0 2023-11-04T01:44:11.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.484+0000 7f46fcdc5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f80b4750 con 0x7f46f815d100 2023-11-04T01:44:11.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.484+0000 7f46effff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f46f815d4e0 0x7f46f80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.486 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.484+0000 7f46f659c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46f815d100 0x7f46f80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.484+0000 7f46effff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f46f815d4e0 0x7f46f80d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:54080/0 (socket says 172.21.15.44:54080) 2023-11-04T01:44:11.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.484+0000 7f46f659c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46f815d100 0x7f46f80ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:51184/0 (socket says 172.21.15.44:51184) 2023-11-04T01:44:11.487 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.484+0000 7f46effff640 1 -- 172.21.15.44:0/2454471860 learned_addr learned my addr 172.21.15.44:0/2454471860 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:11.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.485+0000 7f46f659c640 1 -- 172.21.15.44:0/2454471860 >> v2:172.21.15.204:3300/0 conn(0x7f46f815d4e0 msgr2=0x7f46f80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:11.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.485+0000 7f46f659c640 1 --2- 172.21.15.44:0/2454471860 >> v2:172.21.15.204:3300/0 conn(0x7f46f815d4e0 0x7f46f80d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.485+0000 7f46f659c640 1 -- 172.21.15.44:0/2454471860 >> v1:172.21.15.204:6789/0 conn(0x7f46f80d3b60 legacy=0x7f46f80cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.485+0000 7f46f659c640 1 -- 172.21.15.44:0/2454471860 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f80b2980 con 0x7f46f815d100 2023-11-04T01:44:11.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.485+0000 7f46f5d9b640 1 -- 172.21.15.44:0/2454471860 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287279209 0 0) 0x7f46f80b32b0 con 0x7f46f80d3b60 2023-11-04T01:44:11.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.485+0000 7f46effff640 1 --2- 172.21.15.44:0/2454471860 >> v2:172.21.15.204:3300/0 conn(0x7f46f815d4e0 0x7f46f80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:11.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.486+0000 7f46f659c640 1 --2- 172.21.15.44:0/2454471860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46f815d100 0x7f46f80ce510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009790 tx=0x7f46e802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9b6a5b26599ace8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.486+0000 7f46f5d9b640 1 -- 172.21.15.44:0/2454471860 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e8031800 con 0x7f46f815d100 2023-11-04T01:44:11.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.486+0000 7f46f5d9b640 1 -- 172.21.15.44:0/2454471860 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e8031960 con 0x7f46f815d100 2023-11-04T01:44:11.488 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.486+0000 7f46f5d9b640 1 -- 172.21.15.44:0/2454471860 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e8031cf0 con 0x7f46f815d100 2023-11-04T01:44:11.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.486+0000 7f46fcdc5640 1 -- 172.21.15.44:0/2454471860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46f815d100 msgr2=0x7f46f80ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.486+0000 7f46fcdc5640 1 --2- 172.21.15.44:0/2454471860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46f815d100 0x7f46f80ce510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009790 tx=0x7f46e802b8a0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.486+0000 7f46fcdc5640 1 -- 172.21.15.44:0/2454471860 shutdown_connections 2023-11-04T01:44:11.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.486+0000 7f46fcdc5640 1 --2- 172.21.15.44:0/2454471860 >> v2:172.21.15.204:3300/0 conn(0x7f46f815d4e0 0x7f46f80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.486+0000 7f46fcdc5640 1 --2- 172.21.15.44:0/2454471860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46f815d100 0x7f46f80ce510 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.489 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.486+0000 7f46fcdc5640 1 -- 172.21.15.44:0/2454471860 >> 172.21.15.44:0/2454471860 conn(0x7f46f80d2ef0 msgr2=0x7f46f80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:11.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.486+0000 7f46fcdc5640 1 -- 172.21.15.44:0/2454471860 shutdown_connections 2023-11-04T01:44:11.490 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.486+0000 7f46fcdc5640 1 -- 172.21.15.44:0/2454471860 wait complete. 2023-11-04T01:44:11.491 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.488+0000 7f46fcdc5640 1 Processor -- start 2023-11-04T01:44:11.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.488+0000 7f46fcdc5640 1 -- start start 2023-11-04T01:44:11.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46fcdc5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46f80d3b60 0x7f46f814ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46fcdc5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46f815d100 0x7f46f81f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46fcdc5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46f815d4e0 0x7f46f80b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46fcdc5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f81f7ae0 con 0x7f46f80d3b60 2023-11-04T01:44:11.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46fcdc5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f80b88d0 con 0x7f46f815d100 2023-11-04T01:44:11.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46fcdc5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f815b810 con 0x7f46f815d4e0 2023-11-04T01:44:11.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46f659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46f80d3b60 0x7f46f814ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46f659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46f80d3b60 0x7f46f814ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39638/0 (socket says 172.21.15.44:39638) 2023-11-04T01:44:11.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46f659c640 1 -- 172.21.15.44:0/2849982510 learned_addr learned my addr 172.21.15.44:0/2849982510 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:11.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46f6d9d640 1 --2- 172.21.15.44:0/2849982510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46f815d4e0 0x7f46f80b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46effff640 1 --2- 172.21.15.44:0/2849982510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46f815d100 0x7f46f81f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46f659c640 1 -- 172.21.15.44:0/2849982510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46f815d4e0 msgr2=0x7f46f80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.492 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46f659c640 1 --2- 172.21.15.44:0/2849982510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46f815d4e0 0x7f46f80b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46f659c640 1 -- 172.21.15.44:0/2849982510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46f815d100 msgr2=0x7f46f81f75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46f659c640 1 --2- 172.21.15.44:0/2849982510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46f815d100 0x7f46f81f75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46f659c640 1 -- 172.21.15.44:0/2849982510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e00094d0 con 0x7f46f80d3b60 2023-11-04T01:44:11.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46f6d9d640 1 --2- 172.21.15.44:0/2849982510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46f815d4e0 0x7f46f80b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:11.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46f659c640 1 --2- 172.21.15.44:0/2849982510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46f80d3b60 0x7f46f814ef00 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f46e8034040 tx=0x7f46e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.489+0000 7f46eeffd640 1 -- 172.21.15.44:0/2849982510 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e8005da0 con 0x7f46f80d3b60 2023-11-04T01:44:11.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.490+0000 7f46eeffd640 1 -- 172.21.15.44:0/2849982510 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e803a850 con 0x7f46f80d3b60 2023-11-04T01:44:11.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.490+0000 7f46eeffd640 1 -- 172.21.15.44:0/2849982510 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e803ac00 con 0x7f46f80d3b60 2023-11-04T01:44:11.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.490+0000 7f46fcdc5640 1 -- 172.21.15.44:0/2849982510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e80093a0 con 0x7f46f80d3b60 2023-11-04T01:44:11.493 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.490+0000 7f46fcdc5640 1 -- 172.21.15.44:0/2849982510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f815b180 con 0x7f46f80d3b60 2023-11-04T01:44:11.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.490+0000 7f46fcdc5640 1 -- 172.21.15.44:0/2849982510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f80684b0 con 0x7f46f80d3b60 2023-11-04T01:44:11.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.491+0000 7f46eeffd640 1 -- 172.21.15.44:0/2849982510 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f46e8006030 con 0x7f46f80d3b60 2023-11-04T01:44:11.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.491+0000 7f46eeffd640 1 --2- 172.21.15.44:0/2849982510 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f46d806ae70 0x7f46d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.491+0000 7f46eeffd640 1 -- 172.21.15.44:0/2849982510 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f46e802e070 con 0x7f46f80d3b60 2023-11-04T01:44:11.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.492+0000 7f46effff640 1 --2- 172.21.15.44:0/2849982510 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f46d806ae70 0x7f46d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.494 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.492+0000 7f46effff640 1 --2- 172.21.15.44:0/2849982510 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f46d806ae70 0x7f46d806d330 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f46f814f440 tx=0x7f46e0009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.497 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.496+0000 7f46eeffd640 1 -- 172.21.15.44:0/2849982510 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46e8076b80 con 0x7f46f80d3b60 2023-11-04T01:44:11.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.709+0000 7f46fcdc5640 1 -- 172.21.15.44:0/2849982510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46f80d2cd0 con 0x7f46f80d3b60 2023-11-04T01:44:11.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.710+0000 7f46eeffd640 1 -- 172.21.15.44:0/2849982510 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) v1 ==== 95+0+4934 (secure 0 0 0) 0x7f46e8035070 con 0x7f46f80d3b60 2023-11-04T01:44:11.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:44:11.712 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":120,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/830347539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":830347539},{"type":"v1","addr":"172.21.15.44:6835","nonce":830347539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:44:00.148825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:active","state_seq":18,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8703":{"gid":8703,"name":"c","rank":1,"incarnation":115,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:11.712 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 120 2023-11-04T01:44:11.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.712+0000 7f46fcdc5640 1 -- 172.21.15.44:0/2849982510 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f46d806ae70 msgr2=0x7f46d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.712+0000 7f46fcdc5640 1 --2- 172.21.15.44:0/2849982510 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f46d806ae70 0x7f46d806d330 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f46f814f440 tx=0x7f46e0009240 comp rx=0 tx=0).stop 2023-11-04T01:44:11.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.712+0000 7f46fcdc5640 1 -- 172.21.15.44:0/2849982510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46f80d3b60 msgr2=0x7f46f814ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.712+0000 7f46fcdc5640 1 --2- 172.21.15.44:0/2849982510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46f80d3b60 0x7f46f814ef00 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f46e8034040 tx=0x7f46e80046c0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.712+0000 7f46fcdc5640 1 -- 172.21.15.44:0/2849982510 shutdown_connections 2023-11-04T01:44:11.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.712+0000 7f46fcdc5640 1 --2- 172.21.15.44:0/2849982510 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f46d806ae70 0x7f46d806d330 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.712+0000 7f46fcdc5640 1 --2- 172.21.15.44:0/2849982510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46f815d4e0 0x7f46f80b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.712+0000 7f46fcdc5640 1 --2- 172.21.15.44:0/2849982510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46f815d100 0x7f46f81f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.712+0000 7f46fcdc5640 1 --2- 172.21.15.44:0/2849982510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46f80d3b60 0x7f46f814ef00 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.712+0000 7f46fcdc5640 1 -- 172.21.15.44:0/2849982510 >> 172.21.15.44:0/2849982510 conn(0x7f46f80d2ef0 msgr2=0x7f46f8152430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:11.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.712+0000 7f46fcdc5640 1 -- 172.21.15.44:0/2849982510 shutdown_connections 2023-11-04T01:44:11.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:11.712+0000 7f46fcdc5640 1 -- 172.21.15.44:0/2849982510 wait complete. 2023-11-04T01:44:11.725 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:13.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:44:16.725 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:16.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.843+0000 7f42fb41a640 1 Processor -- start 2023-11-04T01:44:16.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.843+0000 7f42fb41a640 1 -- start start 2023-11-04T01:44:16.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.844+0000 7f42fb41a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f42f415ade0 0x7f42f406c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.844+0000 7f42fb41a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f42f40b1440 0x7f42f4066010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.844+0000 7f42fb41a640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f40ad6a0 con 0x7f42f406b740 2023-11-04T01:44:16.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.844+0000 7f42fb41a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f40acaf0 con 0x7f42f40b1440 2023-11-04T01:44:16.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.844+0000 7f42fb41a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f40acdd0 con 0x7f42f415ade0 2023-11-04T01:44:16.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.844+0000 7f42f99b7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f42f40b1440 0x7f42f4066010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.844+0000 7f42f89b5640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f42f406b740 0x7f42f40b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:34984/0 (socket says 172.21.15.44:34984) 2023-11-04T01:44:16.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.844+0000 7f42f89b5640 1 -- 172.21.15.44:0/2081153525 learned_addr learned my addr 172.21.15.44:0/2081153525 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:44:16.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.844+0000 7f42f91b6640 1 --2- 172.21.15.44:0/2081153525 >> v2:172.21.15.204:3300/0 conn(0x7f42f415ade0 0x7f42f406c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.846 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.844+0000 7f42f99b7640 1 -- 172.21.15.44:0/2081153525 >> v2:172.21.15.204:3300/0 conn(0x7f42f415ade0 msgr2=0x7f42f406c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.844+0000 7f42f99b7640 1 --2- 172.21.15.44:0/2081153525 >> v2:172.21.15.204:3300/0 conn(0x7f42f415ade0 0x7f42f406c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.844+0000 7f42f99b7640 1 -- 172.21.15.44:0/2081153525 >> v1:172.21.15.44:6789/0 conn(0x7f42f406b740 legacy=0x7f42f40b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.844+0000 7f42f99b7640 1 -- 172.21.15.44:0/2081153525 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f40ad0e0 con 0x7f42f40b1440 2023-11-04T01:44:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.845+0000 7f42f99b7640 1 --2- 172.21.15.44:0/2081153525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f40b1440 0x7f42f4066010 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f42f40cc9e0 tx=0x7f42ec02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a713940250688725 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.845+0000 7f42ebfff640 1 -- 172.21.15.44:0/2081153525 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec02cbf0 con 0x7f42f40b1440 2023-11-04T01:44:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.845+0000 7f42ebfff640 1 -- 172.21.15.44:0/2081153525 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec02cd50 con 0x7f42f40b1440 2023-11-04T01:44:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.845+0000 7f42ebfff640 1 -- 172.21.15.44:0/2081153525 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec034660 con 0x7f42f40b1440 2023-11-04T01:44:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.846+0000 7f42fb41a640 1 -- 172.21.15.44:0/2081153525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f40b1440 msgr2=0x7f42f4066010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.846+0000 7f42fb41a640 1 --2- 172.21.15.44:0/2081153525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f40b1440 0x7f42f4066010 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f42f40cc9e0 tx=0x7f42ec02be40 comp rx=0 tx=0).stop 2023-11-04T01:44:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.846+0000 7f42fb41a640 1 -- 172.21.15.44:0/2081153525 shutdown_connections 2023-11-04T01:44:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.846+0000 7f42fb41a640 1 --2- 172.21.15.44:0/2081153525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f40b1440 0x7f42f4066010 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.846+0000 7f42fb41a640 1 --2- 172.21.15.44:0/2081153525 >> v2:172.21.15.204:3300/0 conn(0x7f42f415ade0 0x7f42f406c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.846+0000 7f42fb41a640 1 -- 172.21.15.44:0/2081153525 >> 172.21.15.44:0/2081153525 conn(0x7f42f40cbd30 msgr2=0x7f42f40cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.846+0000 7f42fb41a640 1 -- 172.21.15.44:0/2081153525 shutdown_connections 2023-11-04T01:44:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.846+0000 7f42fb41a640 1 -- 172.21.15.44:0/2081153525 wait complete. 2023-11-04T01:44:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.847+0000 7f42fb41a640 1 Processor -- start 2023-11-04T01:44:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.847+0000 7f42fb41a640 1 -- start start 2023-11-04T01:44:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42fb41a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f406b740 0x7f42f4145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42fb41a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42f40b1440 0x7f42f41f0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42fb41a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42f415ade0 0x7f42f4159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42fb41a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f4146520 con 0x7f42f406b740 2023-11-04T01:44:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42fb41a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f41f4550 con 0x7f42f415ade0 2023-11-04T01:44:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42fb41a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f41f4830 con 0x7f42f40b1440 2023-11-04T01:44:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42f91b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f406b740 0x7f42f4145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42f91b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f406b740 0x7f42f4145fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57978/0 (socket says 172.21.15.44:57978) 2023-11-04T01:44:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42f91b6640 1 -- 172.21.15.44:0/3281651737 learned_addr learned my addr 172.21.15.44:0/3281651737 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42f99b7640 1 --2- 172.21.15.44:0/3281651737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42f415ade0 0x7f42f4159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42f89b5640 1 --2- 172.21.15.44:0/3281651737 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42f40b1440 0x7f42f41f0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42f91b6640 1 -- 172.21.15.44:0/3281651737 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42f40b1440 msgr2=0x7f42f41f0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42f91b6640 1 --2- 172.21.15.44:0/3281651737 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42f40b1440 0x7f42f41f0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42f91b6640 1 -- 172.21.15.44:0/3281651737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42f415ade0 msgr2=0x7f42f4159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42f91b6640 1 --2- 172.21.15.44:0/3281651737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42f415ade0 0x7f42f4159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42f91b6640 1 -- 172.21.15.44:0/3281651737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec009a70 con 0x7f42f406b740 2023-11-04T01:44:16.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42f99b7640 1 --2- 172.21.15.44:0/3281651737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42f415ade0 0x7f42f4159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:16.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.848+0000 7f42f91b6640 1 --2- 172.21.15.44:0/3281651737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f406b740 0x7f42f4145fe0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f42f000d7d0 tx=0x7f42f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:16.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.849+0000 7f42e9ffb640 1 -- 172.21.15.44:0/3281651737 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f00096c0 con 0x7f42f406b740 2023-11-04T01:44:16.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.849+0000 7f42e9ffb640 1 -- 172.21.15.44:0/3281651737 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f0009820 con 0x7f42f406b740 2023-11-04T01:44:16.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.849+0000 7f42fb41a640 1 -- 172.21.15.44:0/3281651737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f41f4b10 con 0x7f42f406b740 2023-11-04T01:44:16.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.849+0000 7f42e9ffb640 1 -- 172.21.15.44:0/3281651737 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0009bd0 con 0x7f42f406b740 2023-11-04T01:44:16.852 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.849+0000 7f42fb41a640 1 -- 172.21.15.44:0/3281651737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f41f50d0 con 0x7f42f406b740 2023-11-04T01:44:16.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.850+0000 7f42fb41a640 1 -- 172.21.15.44:0/3281651737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f406b300 con 0x7f42f406b740 2023-11-04T01:44:16.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.850+0000 7f42e9ffb640 1 -- 172.21.15.44:0/3281651737 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42f0009d30 con 0x7f42f406b740 2023-11-04T01:44:16.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.851+0000 7f42e9ffb640 1 --2- 172.21.15.44:0/3281651737 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f42d806ae70 0x7f42d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.851+0000 7f42e9ffb640 1 -- 172.21.15.44:0/3281651737 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f42f008a850 con 0x7f42f406b740 2023-11-04T01:44:16.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.851+0000 7f42f89b5640 1 --2- 172.21.15.44:0/3281651737 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f42d806ae70 0x7f42d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.853 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.851+0000 7f42f89b5640 1 --2- 172.21.15.44:0/3281651737 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f42d806ae70 0x7f42d806d330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f42f4071c70 tx=0x7f42e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:16.855+0000 7f42e9ffb640 1 -- 172.21.15.44:0/3281651737 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42f0054f50 con 0x7f42f406b740 2023-11-04T01:44:17.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:17.065+0000 7f42fb41a640 1 -- 172.21.15.44:0/3281651737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42f40684b0 con 0x7f42f406b740 2023-11-04T01:44:17.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:17.066+0000 7f42e9ffb640 1 -- 172.21.15.44:0/3281651737 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) v1 ==== 95+0+4934 (secure 0 0 0) 0x7f42f0058570 con 0x7f42f406b740 2023-11-04T01:44:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:44:17.068 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":120,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/830347539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":830347539},{"type":"v1","addr":"172.21.15.44:6835","nonce":830347539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:44:00.148825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:active","state_seq":18,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8703":{"gid":8703,"name":"c","rank":1,"incarnation":115,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:17.068 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 120 2023-11-04T01:44:17.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:17.068+0000 7f42fb41a640 1 -- 172.21.15.44:0/3281651737 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f42d806ae70 msgr2=0x7f42d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:17.068+0000 7f42fb41a640 1 --2- 172.21.15.44:0/3281651737 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f42d806ae70 0x7f42d806d330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f42f4071c70 tx=0x7f42e4009040 comp rx=0 tx=0).stop 2023-11-04T01:44:17.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:17.068+0000 7f42fb41a640 1 -- 172.21.15.44:0/3281651737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f406b740 msgr2=0x7f42f4145fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:17.068+0000 7f42fb41a640 1 --2- 172.21.15.44:0/3281651737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f406b740 0x7f42f4145fe0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f42f000d7d0 tx=0x7f42f000dc90 comp rx=0 tx=0).stop 2023-11-04T01:44:17.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:17.068+0000 7f42fb41a640 1 -- 172.21.15.44:0/3281651737 shutdown_connections 2023-11-04T01:44:17.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:17.068+0000 7f42fb41a640 1 --2- 172.21.15.44:0/3281651737 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f42d806ae70 0x7f42d806d330 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:17.068+0000 7f42fb41a640 1 --2- 172.21.15.44:0/3281651737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42f415ade0 0x7f42f4159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:17.068+0000 7f42fb41a640 1 --2- 172.21.15.44:0/3281651737 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42f40b1440 0x7f42f41f0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:17.068+0000 7f42fb41a640 1 --2- 172.21.15.44:0/3281651737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f406b740 0x7f42f4145fe0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:17.068+0000 7f42fb41a640 1 -- 172.21.15.44:0/3281651737 >> 172.21.15.44:0/3281651737 conn(0x7f42f40cbd30 msgr2=0x7f42f40cc110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:17.068+0000 7f42fb41a640 1 -- 172.21.15.44:0/3281651737 shutdown_connections 2023-11-04T01:44:17.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:17.068+0000 7f42fb41a640 1 -- 172.21.15.44:0/3281651737 wait complete. 2023-11-04T01:44:17.080 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:19.964 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-11-04T01:44:22.081 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:22.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.201+0000 7f8f978d7640 1 Processor -- start 2023-11-04T01:44:22.203 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.201+0000 7f8f978d7640 1 -- start start 2023-11-04T01:44:22.204 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.202+0000 7f8f978d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f900ca1a0 0x7f8f900ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.202+0000 7f8f978d7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8f9006a0d0 0x7f8f9006a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.202+0000 7f8f978d7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f900b25a0 con 0x7f8f9015d4e0 2023-11-04T01:44:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.202+0000 7f8f978d7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f900cab60 con 0x7f8f9006a0d0 2023-11-04T01:44:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.202+0000 7f8f978d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900b2300 con 0x7f8f900ca1a0 2023-11-04T01:44:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.202+0000 7f8f95e74640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8f9006a0d0 0x7f8f9006a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.202+0000 7f8f95673640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8f9015d4e0 0x7f8f900ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:34998/0 (socket says 172.21.15.44:34998) 2023-11-04T01:44:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.202+0000 7f8f95673640 1 -- 172.21.15.44:0/1262809895 learned_addr learned my addr 172.21.15.44:0/1262809895 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:44:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.202+0000 7f8f94e72640 1 --2- 172.21.15.44:0/1262809895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f900ca1a0 0x7f8f900ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.202+0000 7f8f95e74640 1 -- 172.21.15.44:0/1262809895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f900ca1a0 msgr2=0x7f8f900ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.202+0000 7f8f95e74640 1 --2- 172.21.15.44:0/1262809895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f900ca1a0 0x7f8f900ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.202+0000 7f8f95e74640 1 -- 172.21.15.44:0/1262809895 >> v1:172.21.15.44:6789/0 conn(0x7f8f9015d4e0 legacy=0x7f8f900ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.202+0000 7f8f95e74640 1 -- 172.21.15.44:0/1262809895 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9015d8c0 con 0x7f8f9006a0d0 2023-11-04T01:44:22.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.202+0000 7f8f87fff640 1 -- 172.21.15.44:0/1262809895 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232752391 0 0) 0x7f8f900b25a0 con 0x7f8f9015d4e0 2023-11-04T01:44:22.206 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.202+0000 7f8f94e72640 1 --2- 172.21.15.44:0/1262809895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f900ca1a0 0x7f8f900ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.203+0000 7f8f95e74640 1 --2- 172.21.15.44:0/1262809895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9006a0d0 0x7f8f9006a560 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f8f880097a0 tx=0x7f8f8802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645906ab90275f40 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.203+0000 7f8f87fff640 1 -- 172.21.15.44:0/1262809895 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f88031780 con 0x7f8f9006a0d0 2023-11-04T01:44:22.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.203+0000 7f8f87fff640 1 -- 172.21.15.44:0/1262809895 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f880318e0 con 0x7f8f9006a0d0 2023-11-04T01:44:22.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.203+0000 7f8f87fff640 1 -- 172.21.15.44:0/1262809895 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f88031c70 con 0x7f8f9006a0d0 2023-11-04T01:44:22.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.204+0000 7f8f978d7640 1 -- 172.21.15.44:0/1262809895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9006a0d0 msgr2=0x7f8f9006a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.204+0000 7f8f978d7640 1 --2- 172.21.15.44:0/1262809895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9006a0d0 0x7f8f9006a560 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f8f880097a0 tx=0x7f8f8802b820 comp rx=0 tx=0).stop 2023-11-04T01:44:22.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.204+0000 7f8f978d7640 1 -- 172.21.15.44:0/1262809895 shutdown_connections 2023-11-04T01:44:22.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.204+0000 7f8f978d7640 1 --2- 172.21.15.44:0/1262809895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9006a0d0 0x7f8f9006a560 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.204+0000 7f8f978d7640 1 --2- 172.21.15.44:0/1262809895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f900ca1a0 0x7f8f900ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.204+0000 7f8f978d7640 1 -- 172.21.15.44:0/1262809895 >> 172.21.15.44:0/1262809895 conn(0x7f8f900b1640 msgr2=0x7f8f900b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:22.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.204+0000 7f8f978d7640 1 -- 172.21.15.44:0/1262809895 shutdown_connections 2023-11-04T01:44:22.208 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.204+0000 7f8f978d7640 1 -- 172.21.15.44:0/1262809895 wait complete. 2023-11-04T01:44:22.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.205+0000 7f8f978d7640 1 Processor -- start 2023-11-04T01:44:22.209 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.205+0000 7f8f978d7640 1 -- start start 2023-11-04T01:44:22.211 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.206+0000 7f8f978d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9006a0d0 0x7f8f900c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.206+0000 7f8f978d7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f900ca1a0 0x7f8f900c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.206+0000 7f8f978d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f9015d4e0 0x7f8f900c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.206+0000 7f8f978d7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9006cb20 con 0x7f8f9006a0d0 2023-11-04T01:44:22.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.206+0000 7f8f978d7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900b4510 con 0x7f8f900ca1a0 2023-11-04T01:44:22.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.206+0000 7f8f978d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900b4770 con 0x7f8f9015d4e0 2023-11-04T01:44:22.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.206+0000 7f8f95673640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9006a0d0 0x7f8f900c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.206+0000 7f8f95673640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9006a0d0 0x7f8f900c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58008/0 (socket says 172.21.15.44:58008) 2023-11-04T01:44:22.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.206+0000 7f8f95673640 1 -- 172.21.15.44:0/8754377 learned_addr learned my addr 172.21.15.44:0/8754377 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:22.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.207+0000 7f8f95e74640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f9015d4e0 0x7f8f900c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.207+0000 7f8f94e72640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f900ca1a0 0x7f8f900c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.207+0000 7f8f95673640 1 -- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f9015d4e0 msgr2=0x7f8f900c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.212 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.207+0000 7f8f95673640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f9015d4e0 0x7f8f900c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.207+0000 7f8f95673640 1 -- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f900ca1a0 msgr2=0x7f8f900c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.207+0000 7f8f95673640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f900ca1a0 0x7f8f900c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.207+0000 7f8f95673640 1 -- 172.21.15.44:0/8754377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f88009400 con 0x7f8f9006a0d0 2023-11-04T01:44:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.207+0000 7f8f95e74640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f9015d4e0 0x7f8f900c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.207+0000 7f8f94e72640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f900ca1a0 0x7f8f900c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.207+0000 7f8f95673640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9006a0d0 0x7f8f900c8650 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c7c0 tx=0x7f8f8c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.207+0000 7f8f85ffb640 1 -- 172.21.15.44:0/8754377 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c00a640 con 0x7f8f9006a0d0 2023-11-04T01:44:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.207+0000 7f8f85ffb640 1 -- 172.21.15.44:0/8754377 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c00a7c0 con 0x7f8f9006a0d0 2023-11-04T01:44:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.207+0000 7f8f978d7640 1 -- 172.21.15.44:0/8754377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f900b4a50 con 0x7f8f9006a0d0 2023-11-04T01:44:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.207+0000 7f8f85ffb640 1 -- 172.21.15.44:0/8754377 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c00ab70 con 0x7f8f9006a0d0 2023-11-04T01:44:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.207+0000 7f8f978d7640 1 -- 172.21.15.44:0/8754377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f900b5010 con 0x7f8f9006a0d0 2023-11-04T01:44:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.208+0000 7f8f978d7640 1 -- 172.21.15.44:0/8754377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f900684b0 con 0x7f8f9006a0d0 2023-11-04T01:44:22.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.209+0000 7f8f85ffb640 1 -- 172.21.15.44:0/8754377 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8f8c00acd0 con 0x7f8f9006a0d0 2023-11-04T01:44:22.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.209+0000 7f8f85ffb640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f7406ae70 0x7f8f7406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.209+0000 7f8f85ffb640 1 -- 172.21.15.44:0/8754377 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f8f8c089830 con 0x7f8f9006a0d0 2023-11-04T01:44:22.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.209+0000 7f8f94e72640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f7406ae70 0x7f8f7406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.210+0000 7f8f94e72640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f7406ae70 0x7f8f7406d330 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8f80006fd0 tx=0x7f8f80008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.213+0000 7f8f85ffb640 1 -- 172.21.15.44:0/8754377 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f8c053f30 con 0x7f8f9006a0d0 2023-11-04T01:44:22.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.427+0000 7f8f978d7640 1 -- 172.21.15.44:0/8754377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f901555b0 con 0x7f8f9006a0d0 2023-11-04T01:44:22.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.428+0000 7f8f85ffb640 1 -- 172.21.15.44:0/8754377 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4982 (secure 0 0 0) 0x7f8f8c018020 con 0x7f8f9006a0d0 2023-11-04T01:44:22.430 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:44:22.430 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":121,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/389512258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":389512258},{"type":"v1","addr":"172.21.15.204:6837","nonce":389512258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":8745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/830347539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":830347539},{"type":"v1","addr":"172.21.15.44:6835","nonce":830347539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:29.920595+0000","modified":"2023-11-04T01:44:19.258011+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7357,"mds_1":8703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7357":{"gid":7357,"name":"d","rank":0,"incarnation":112,"state":"up:active","state_seq":18,"addr":"172.21.15.204:6836/578267830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":578267830},{"type":"v1","addr":"172.21.15.204:6836","nonce":578267830}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8703":{"gid":8703,"name":"c","rank":1,"incarnation":115,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6833/3246041606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3246041606},{"type":"v1","addr":"172.21.15.44:6833","nonce":3246041606}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:44:19.258011+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:22.430 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 121 2023-11-04T01:44:22.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.429+0000 7f8f978d7640 1 -- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f7406ae70 msgr2=0x7f8f7406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.429+0000 7f8f978d7640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f7406ae70 0x7f8f7406d330 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8f80006fd0 tx=0x7f8f80008040 comp rx=0 tx=0).stop 2023-11-04T01:44:22.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.430+0000 7f8f978d7640 1 -- 172.21.15.44:0/8754377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9006a0d0 msgr2=0x7f8f900c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.430+0000 7f8f978d7640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9006a0d0 0x7f8f900c8650 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c7c0 tx=0x7f8f8c00cc80 comp rx=0 tx=0).stop 2023-11-04T01:44:22.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.430+0000 7f8f978d7640 1 -- 172.21.15.44:0/8754377 shutdown_connections 2023-11-04T01:44:22.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.430+0000 7f8f978d7640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f8f7406ae70 0x7f8f7406d330 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.430+0000 7f8f978d7640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f9015d4e0 0x7f8f900c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.430+0000 7f8f978d7640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f900ca1a0 0x7f8f900c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.430+0000 7f8f978d7640 1 --2- 172.21.15.44:0/8754377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9006a0d0 0x7f8f900c8650 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.430+0000 7f8f978d7640 1 -- 172.21.15.44:0/8754377 >> 172.21.15.44:0/8754377 conn(0x7f8f900b1640 msgr2=0x7f8f9006a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:22.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.430+0000 7f8f978d7640 1 -- 172.21.15.44:0/8754377 shutdown_connections 2023-11-04T01:44:22.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.430+0000 7f8f978d7640 1 -- 172.21.15.44:0/8754377 wait complete. 2023-11-04T01:44:22.442 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-04T01:44:22.442 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:44:22.471 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:44:22.473 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:44:22.473 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:44:22.547 INFO:teuthology.orchestra.run.smithi044.stdout:1699062240.126230.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:44:22.549 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062240.126230.core'] 2023-11-04T01:44:22.549 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062240.126230.core, deleting it 2023-11-04T01:44:22.549 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062240.126230.core 2023-11-04T01:44:22.622 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi044.front.sepia.ceph.com... 2023-11-04T01:44:22.622 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:44:22.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:22.623 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 down 2023-11-04T01:44:22.694 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:44:22.694 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:44:22.694 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:22.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:22.791 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:44:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:22.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.894+0000 7f32de60e640 1 Processor -- start 2023-11-04T01:44:22.896 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.894+0000 7f32de60e640 1 -- start start 2023-11-04T01:44:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32de60e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f32d815d630 0x7f32d80cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32de60e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d80b0150 con 0x7f32d80b2210 2023-11-04T01:44:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32de60e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d80b1170 con 0x7f32d80ceda0 2023-11-04T01:44:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32de60e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d80b1df0 con 0x7f32d815d630 2023-11-04T01:44:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32d77fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f32d80b2210 0x7f32d80cf180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39340/0 (socket says 172.21.15.44:39340) 2023-11-04T01:44:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32d77fe640 1 -- 172.21.15.44:0/828269677 learned_addr learned my addr 172.21.15.44:0/828269677 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:44:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32dcbab640 1 --2- 172.21.15.44:0/828269677 >> v2:172.21.15.204:3300/0 conn(0x7f32d815d630 0x7f32d80cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186511268 0 0) 0x7f32d80b0150 con 0x7f32d80b2210 2023-11-04T01:44:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32c0003520 con 0x7f32d80b2210 2023-11-04T01:44:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980330536 0 0) 0x7f32d80b1170 con 0x7f32d80ceda0 2023-11-04T01:44:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32d80b0150 con 0x7f32d80ceda0 2023-11-04T01:44:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2017503286 0 0) 0x7f32c0003520 con 0x7f32d80b2210 2023-11-04T01:44:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 >> v2:172.21.15.204:3300/0 conn(0x7f32d815d630 msgr2=0x7f32d80cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32d6ffd640 1 --2- 172.21.15.44:0/828269677 >> v2:172.21.15.204:3300/0 conn(0x7f32d815d630 0x7f32d80cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 >> v1:172.21.15.204:6789/0 conn(0x7f32d80ceda0 legacy=0x7f32d815cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d80b1450 con 0x7f32d80b2210 2023-11-04T01:44:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.895+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f32cc001690 con 0x7f32d80b2210 2023-11-04T01:44:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 >> v1:172.21.15.44:6789/0 conn(0x7f32d80b2210 legacy=0x7f32d80cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32d6ffd640 1 --2- 172.21.15.44:0/828269677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c0003b50 0x7f32c0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32d6ffd640 1 --2- 172.21.15.44:0/828269677 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32c00047c0 0x7f32c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32d6ffd640 1 --2- 172.21.15.44:0/828269677 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c0005240 0x7f32c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d80b1df0 con 0x7f32c0003b50 2023-11-04T01:44:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c000c180 con 0x7f32c00047c0 2023-11-04T01:44:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c000c340 con 0x7f32c0005240 2023-11-04T01:44:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32d7fff640 1 --2- 172.21.15.44:0/828269677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c0003b50 0x7f32c0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32d77fe640 1 --2- 172.21.15.44:0/828269677 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32c00047c0 0x7f32c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32dcbab640 1 --2- 172.21.15.44:0/828269677 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c0005240 0x7f32c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32d7fff640 1 -- 172.21.15.44:0/828269677 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c0005240 msgr2=0x7f32c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32d7fff640 1 --2- 172.21.15.44:0/828269677 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c0005240 0x7f32c000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32d7fff640 1 -- 172.21.15.44:0/828269677 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32c00047c0 msgr2=0x7f32c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32d7fff640 1 --2- 172.21.15.44:0/828269677 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32c00047c0 0x7f32c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32d7fff640 1 -- 172.21.15.44:0/828269677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c0003520 con 0x7f32c0003b50 2023-11-04T01:44:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32dcbab640 1 --2- 172.21.15.44:0/828269677 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c0005240 0x7f32c000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.896+0000 7f32dcbab640 1 -- 172.21.15.44:0/828269677 reap_dead start 2023-11-04T01:44:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.897+0000 7f32d7fff640 1 --2- 172.21.15.44:0/828269677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c0003b50 0x7f32c0003f50 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f32c80018f0 tx=0x7f32c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe923badead3218f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.897+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c80052d0 con 0x7f32c0003b50 2023-11-04T01:44:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.897+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c8005430 con 0x7f32c0003b50 2023-11-04T01:44:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.897+0000 7f32d6ffd640 1 -- 172.21.15.44:0/828269677 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8003860 con 0x7f32c0003b50 2023-11-04T01:44:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.897+0000 7f32de60e640 1 -- 172.21.15.44:0/828269677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c0003b50 msgr2=0x7f32c0003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.897+0000 7f32de60e640 1 --2- 172.21.15.44:0/828269677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c0003b50 0x7f32c0003f50 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f32c80018f0 tx=0x7f32c00057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.897+0000 7f32de60e640 1 -- 172.21.15.44:0/828269677 shutdown_connections 2023-11-04T01:44:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.897+0000 7f32de60e640 1 --2- 172.21.15.44:0/828269677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c0003b50 0x7f32c0003f50 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.898+0000 7f32de60e640 1 -- 172.21.15.44:0/828269677 >> 172.21.15.44:0/828269677 conn(0x7f32d80d0c30 msgr2=0x7f32d80d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.898+0000 7f32de60e640 1 -- 172.21.15.44:0/828269677 shutdown_connections 2023-11-04T01:44:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.898+0000 7f32de60e640 1 -- 172.21.15.44:0/828269677 wait complete. 2023-11-04T01:44:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.899+0000 7f32de60e640 1 Processor -- start 2023-11-04T01:44:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.899+0000 7f32de60e640 1 -- start start 2023-11-04T01:44:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32de60e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c0003b50 0x7f32d815b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32de60e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32d8160070 0x7f32d80ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32de60e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32d80c6910 0x7f32d80c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32de60e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d80c72d0 con 0x7f32c0003b50 2023-11-04T01:44:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32de60e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d815ba40 con 0x7f32d8160070 2023-11-04T01:44:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32de60e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d815efd0 con 0x7f32d80c6910 2023-11-04T01:44:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32d7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c0003b50 0x7f32d815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32d7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c0003b50 0x7f32d815b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51220/0 (socket says 172.21.15.44:51220) 2023-11-04T01:44:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32d7fff640 1 -- 172.21.15.44:0/759163827 learned_addr learned my addr 172.21.15.44:0/759163827 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32d7fff640 1 -- 172.21.15.44:0/759163827 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32d80c6910 msgr2=0x7f32d80c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32d7fff640 1 --2- 172.21.15.44:0/759163827 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32d80c6910 0x7f32d80c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32d7fff640 1 -- 172.21.15.44:0/759163827 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32d8160070 msgr2=0x7f32d80ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32d7fff640 1 --2- 172.21.15.44:0/759163827 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32d8160070 0x7f32d80ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32d7fff640 1 -- 172.21.15.44:0/759163827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d815f2b0 con 0x7f32c0003b50 2023-11-04T01:44:22.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32d7fff640 1 --2- 172.21.15.44:0/759163827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c0003b50 0x7f32d815b500 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f32c8035040 tx=0x7f32c8001320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.916 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32d4ff9640 1 -- 172.21.15.44:0/759163827 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8007250 con 0x7f32c0003b50 2023-11-04T01:44:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32d4ff9640 1 -- 172.21.15.44:0/759163827 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c80073b0 con 0x7f32c0003b50 2023-11-04T01:44:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32d4ff9640 1 -- 172.21.15.44:0/759163827 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8007720 con 0x7f32c0003b50 2023-11-04T01:44:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32de60e640 1 -- 172.21.15.44:0/759163827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d815f590 con 0x7f32c0003b50 2023-11-04T01:44:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.900+0000 7f32de60e640 1 -- 172.21.15.44:0/759163827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d815fb50 con 0x7f32c0003b50 2023-11-04T01:44:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.901+0000 7f32de60e640 1 -- 172.21.15.44:0/759163827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d80b19f0 con 0x7f32c0003b50 2023-11-04T01:44:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.902+0000 7f32d4ff9640 1 -- 172.21.15.44:0/759163827 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f32c8003640 con 0x7f32c0003b50 2023-11-04T01:44:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.902+0000 7f32d4ff9640 1 --2- 172.21.15.44:0/759163827 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f32c406aea0 0x7f32c406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.902+0000 7f32d4ff9640 1 -- 172.21.15.44:0/759163827 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f32c80abd70 con 0x7f32c0003b50 2023-11-04T01:44:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.902+0000 7f32d77fe640 1 --2- 172.21.15.44:0/759163827 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f32c406aea0 0x7f32c406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.903+0000 7f32d77fe640 1 --2- 172.21.15.44:0/759163827 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f32c406aea0 0x7f32c406d360 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f32cc001b80 tx=0x7f32cc001a50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:22.906+0000 7f32d4ff9640 1 -- 172.21.15.44:0/759163827 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32d80b19f0 con 0x7f32c0003b50 2023-11-04T01:44:23.089 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.087+0000 7f32de60e640 1 -- 172.21.15.44:0/759163827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32d80b19f0 con 0x7f32c0003b50 2023-11-04T01:44:23.090 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.088+0000 7f32d4ff9640 1 -- 172.21.15.44:0/759163827 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+23611 (secure 0 0 0) 0x7f32d80b19f0 con 0x7f32c0003b50 2023-11-04T01:44:23.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:44:23.091 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":116,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:44:09.255943+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:28.109628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:28.871834+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":14,"snap_epoch":115,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":2}]},{"pgid":"17.37","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/2720398401":"2023-11-05T01:43:41.768312+0000","192.168.0.1:0/1398028154":"2023-11-04T02:42:59.149511+0000","172.21.15.204:6836/3267689413":"2023-11-05T01:42:50.946757+0000","172.21.15.44:6835/3264332323":"2023-11-05T01:42:44.043453+0000","172.21.15.44:6832/22987540":"2023-11-05T01:43:34.391624+0000","172.21.15.44:6833/3264332323":"2023-11-05T01:42:44.043453+0000","172.21.15.44:6832/2069525699":"2023-11-05T01:42:05.849526+0000","172.21.15.44:6834/22987540":"2023-11-05T01:43:34.391624+0000","172.21.15.204:6834/3267689413":"2023-11-05T01:42:50.946757+0000","172.21.15.204:6836/2461924520":"2023-11-05T01:40:15.032018+0000","172.21.15.204:6834/3287638895":"2023-11-05T01:41:58.941997+0000","172.21.15.44:6833/2720398401":"2023-11-05T01:43:41.768312+0000","172.21.15.44:6834/2069525699":"2023-11-05T01:42:05.849526+0000","192.168.0.1:0/1480686415":"2023-11-04T02:43:49.496043+0000","172.21.15.44:6833/2252282753":"2023-11-05T01:40:40.408324+0000","172.21.15.44:6835/2252282753":"2023-11-05T01:40:40.408324+0000","172.21.15.204:6834/2461924520":"2023-11-05T01:40:15.032018+0000","192.168.0.1:0/780133444":"2023-11-04T02:42:14.050728+0000","172.21.15.44:6835/1627866359":"2023-11-05T01:41:31.011032+0000","172.21.15.44:6833/1627866359":"2023-11-05T01:41:31.011032+0000","172.21.15.204:6834/3065829953":"2023-11-05T01:41:05.691698+0000","172.21.15.204:6836/3287638895":"2023-11-05T01:41:58.941997+0000","172.21.15.204:6836/3065829953":"2023-11-05T01:41:05.691698+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":11,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:23.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.090+0000 7f32de60e640 1 -- 172.21.15.44:0/759163827 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f32c406aea0 msgr2=0x7f32c406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.092 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.090+0000 7f32de60e640 1 --2- 172.21.15.44:0/759163827 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f32c406aea0 0x7f32c406d360 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f32cc001b80 tx=0x7f32cc001a50 comp rx=0 tx=0).stop 2023-11-04T01:44:23.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.090+0000 7f32de60e640 1 -- 172.21.15.44:0/759163827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c0003b50 msgr2=0x7f32d815b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.090+0000 7f32de60e640 1 --2- 172.21.15.44:0/759163827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c0003b50 0x7f32d815b500 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f32c8035040 tx=0x7f32c8001320 comp rx=0 tx=0).stop 2023-11-04T01:44:23.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.090+0000 7f32de60e640 1 -- 172.21.15.44:0/759163827 shutdown_connections 2023-11-04T01:44:23.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.090+0000 7f32de60e640 1 --2- 172.21.15.44:0/759163827 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f32c406aea0 0x7f32c406d360 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.090+0000 7f32de60e640 1 --2- 172.21.15.44:0/759163827 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32d80c6910 0x7f32d80c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.090+0000 7f32de60e640 1 --2- 172.21.15.44:0/759163827 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32d8160070 0x7f32d80ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.090+0000 7f32de60e640 1 --2- 172.21.15.44:0/759163827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c0003b50 0x7f32d815b500 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.090+0000 7f32de60e640 1 -- 172.21.15.44:0/759163827 >> 172.21.15.44:0/759163827 conn(0x7f32d80d0c30 msgr2=0x7f32d815c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:23.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.090+0000 7f32de60e640 1 -- 172.21.15.44:0/759163827 shutdown_connections 2023-11-04T01:44:23.093 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.090+0000 7f32de60e640 1 -- 172.21.15.44:0/759163827 wait complete. 2023-11-04T01:44:23.103 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:34.917670+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:35.547044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:28.109628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:28.871834+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 115, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:44:23.104 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:44:23.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.211+0000 7fb7bbe1a640 1 Processor -- start 2023-11-04T01:44:23.213 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.211+0000 7fb7bbe1a640 1 -- start start 2023-11-04T01:44:23.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.212+0000 7fb7bbe1a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7b40b3ca0 0x7fb7b406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.212+0000 7fb7bbe1a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7b40b2100 0x7fb7b40b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.212+0000 7fb7bbe1a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b40b2a90 con 0x7fb7b415d110 2023-11-04T01:44:23.214 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.212+0000 7fb7bbe1a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b40664f0 con 0x7fb7b40b2100 2023-11-04T01:44:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.212+0000 7fb7bbe1a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b415d4f0 con 0x7fb7b40b3ca0 2023-11-04T01:44:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.212+0000 7fb7ba3b7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7b40b2100 0x7fb7b40b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.212+0000 7fb7ba3b7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7b40b2100 0x7fb7b40b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51230/0 (socket says 172.21.15.44:51230) 2023-11-04T01:44:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.212+0000 7fb7ba3b7640 1 -- 172.21.15.44:0/4283000789 learned_addr learned my addr 172.21.15.44:0/4283000789 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.212+0000 7fb7ba3b7640 1 -- 172.21.15.44:0/4283000789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7b40b3ca0 msgr2=0x7fb7b406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.212+0000 7fb7b93b5640 1 --2- 172.21.15.44:0/4283000789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7b40b3ca0 0x7fb7b406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.212+0000 7fb7ba3b7640 1 --2- 172.21.15.44:0/4283000789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7b40b3ca0 0x7fb7b406b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.212+0000 7fb7ba3b7640 1 -- 172.21.15.44:0/4283000789 >> v1:172.21.15.204:6789/0 conn(0x7fb7b415d110 legacy=0x7fb7b40ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.212+0000 7fb7ba3b7640 1 -- 172.21.15.44:0/4283000789 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b406b9f0 con 0x7fb7b40b2100 2023-11-04T01:44:23.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.213+0000 7fb7ba3b7640 1 --2- 172.21.15.44:0/4283000789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40b2100 0x7fb7b40b2550 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009e50 tx=0x7fb7ac02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545bea04eb539193 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.213+0000 7fb7b8bb4640 1 -- 172.21.15.44:0/4283000789 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac02ca70 con 0x7fb7b40b2100 2023-11-04T01:44:23.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.213+0000 7fb7b8bb4640 1 -- 172.21.15.44:0/4283000789 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac02cbd0 con 0x7fb7b40b2100 2023-11-04T01:44:23.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.213+0000 7fb7b8bb4640 1 -- 172.21.15.44:0/4283000789 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0343f0 con 0x7fb7b40b2100 2023-11-04T01:44:23.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.214+0000 7fb7bbe1a640 1 -- 172.21.15.44:0/4283000789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40b2100 msgr2=0x7fb7b40b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.214+0000 7fb7bbe1a640 1 --2- 172.21.15.44:0/4283000789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40b2100 0x7fb7b40b2550 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009e50 tx=0x7fb7ac02bed0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.214+0000 7fb7bbe1a640 1 -- 172.21.15.44:0/4283000789 shutdown_connections 2023-11-04T01:44:23.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.214+0000 7fb7bbe1a640 1 --2- 172.21.15.44:0/4283000789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40b2100 0x7fb7b40b2550 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.214+0000 7fb7bbe1a640 1 --2- 172.21.15.44:0/4283000789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7b40b3ca0 0x7fb7b406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.214+0000 7fb7bbe1a640 1 -- 172.21.15.44:0/4283000789 >> 172.21.15.44:0/4283000789 conn(0x7fb7b40cbd30 msgr2=0x7fb7b40cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:23.217 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.214+0000 7fb7bbe1a640 1 -- 172.21.15.44:0/4283000789 shutdown_connections 2023-11-04T01:44:23.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.214+0000 7fb7bbe1a640 1 -- 172.21.15.44:0/4283000789 wait complete. 2023-11-04T01:44:23.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.215+0000 7fb7bbe1a640 1 Processor -- start 2023-11-04T01:44:23.218 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.215+0000 7fb7bbe1a640 1 -- start start 2023-11-04T01:44:23.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7bbe1a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7b40b2100 0x7fb7b4157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7bbe1a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40b3ca0 0x7fb7b40cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7bbe1a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7b415d110 0x7fb7b40cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.220 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7bbe1a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b415ae50 con 0x7fb7b40b3ca0 2023-11-04T01:44:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7bbe1a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b4071e80 con 0x7fb7b415d110 2023-11-04T01:44:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7bbe1a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b415a4b0 con 0x7fb7b40b2100 2023-11-04T01:44:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7b93b5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40b3ca0 0x7fb7b40cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7b93b5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40b3ca0 0x7fb7b40cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51244/0 (socket says 172.21.15.44:51244) 2023-11-04T01:44:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7b93b5640 1 -- 172.21.15.44:0/2242491273 learned_addr learned my addr 172.21.15.44:0/2242491273 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7b93b5640 1 -- 172.21.15.44:0/2242491273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7b40b2100 msgr2=0x7fb7b4157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7ba3b7640 1 --2- 172.21.15.44:0/2242491273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7b415d110 0x7fb7b40cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7b9bb6640 1 --2- 172.21.15.44:0/2242491273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7b40b2100 0x7fb7b4157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7b93b5640 1 --2- 172.21.15.44:0/2242491273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7b40b2100 0x7fb7b4157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7b93b5640 1 -- 172.21.15.44:0/2242491273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7b415d110 msgr2=0x7fb7b40cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7b93b5640 1 --2- 172.21.15.44:0/2242491273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7b415d110 0x7fb7b40cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7b93b5640 1 -- 172.21.15.44:0/2242491273 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac009b30 con 0x7fb7b40b3ca0 2023-11-04T01:44:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7ba3b7640 1 --2- 172.21.15.44:0/2242491273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7b415d110 0x7fb7b40cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:23.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.216+0000 7fb7b93b5640 1 --2- 172.21.15.44:0/2242491273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40b3ca0 0x7fb7b40cd000 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400c7f0 tx=0x7fb7a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.217+0000 7fb7aa7fc640 1 -- 172.21.15.44:0/2242491273 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4004220 con 0x7fb7b40b3ca0 2023-11-04T01:44:23.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.217+0000 7fb7aa7fc640 1 -- 172.21.15.44:0/2242491273 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a4004380 con 0x7fb7b40b3ca0 2023-11-04T01:44:23.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.217+0000 7fb7bbe1a640 1 -- 172.21.15.44:0/2242491273 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b415a790 con 0x7fb7b40b3ca0 2023-11-04T01:44:23.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.217+0000 7fb7aa7fc640 1 -- 172.21.15.44:0/2242491273 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4007840 con 0x7fb7b40b3ca0 2023-11-04T01:44:23.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.217+0000 7fb7bbe1a640 1 -- 172.21.15.44:0/2242491273 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b4157d60 con 0x7fb7b40b3ca0 2023-11-04T01:44:23.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.218+0000 7fb7bbe1a640 1 -- 172.21.15.44:0/2242491273 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b40684b0 con 0x7fb7b40b3ca0 2023-11-04T01:44:23.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.218+0000 7fb7aa7fc640 1 -- 172.21.15.44:0/2242491273 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb7a4007bb0 con 0x7fb7b40b3ca0 2023-11-04T01:44:23.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.218+0000 7fb7aa7fc640 1 --2- 172.21.15.44:0/2242491273 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb79806aea0 0x7fb79806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.219+0000 7fb7aa7fc640 1 -- 172.21.15.44:0/2242491273 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fb7a4089da0 con 0x7fb7b40b3ca0 2023-11-04T01:44:23.222 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.219+0000 7fb7b9bb6640 1 --2- 172.21.15.44:0/2242491273 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb79806aea0 0x7fb79806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.223 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.219+0000 7fb7b9bb6640 1 --2- 172.21.15.44:0/2242491273 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb79806aea0 0x7fb79806d360 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb7b415a3d0 tx=0x7fb7b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.224 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.223+0000 7fb7aa7fc640 1 -- 172.21.15.44:0/2242491273 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb7a4054540 con 0x7fb7b40b3ca0 2023-11-04T01:44:23.402 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.401+0000 7fb7bbe1a640 1 -- 172.21.15.44:0/2242491273 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7b406dae0 con 0x7fb7b40b3ca0 2023-11-04T01:44:23.403 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.401+0000 7fb7aa7fc640 1 -- 172.21.15.44:0/2242491273 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7a401e070 con 0x7fb7b40b3ca0 2023-11-04T01:44:23.403 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:44:23.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.403+0000 7fb7bbe1a640 1 -- 172.21.15.44:0/2242491273 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb79806aea0 msgr2=0x7fb79806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.403+0000 7fb7bbe1a640 1 --2- 172.21.15.44:0/2242491273 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb79806aea0 0x7fb79806d360 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb7b415a3d0 tx=0x7fb7b0009040 comp rx=0 tx=0).stop 2023-11-04T01:44:23.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.403+0000 7fb7bbe1a640 1 -- 172.21.15.44:0/2242491273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40b3ca0 msgr2=0x7fb7b40cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.403+0000 7fb7bbe1a640 1 --2- 172.21.15.44:0/2242491273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40b3ca0 0x7fb7b40cd000 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400c7f0 tx=0x7fb7a400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.403+0000 7fb7bbe1a640 1 -- 172.21.15.44:0/2242491273 shutdown_connections 2023-11-04T01:44:23.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.403+0000 7fb7bbe1a640 1 --2- 172.21.15.44:0/2242491273 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb79806aea0 0x7fb79806d360 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.405 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.403+0000 7fb7bbe1a640 1 --2- 172.21.15.44:0/2242491273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb7b415d110 0x7fb7b40cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.403+0000 7fb7bbe1a640 1 --2- 172.21.15.44:0/2242491273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40b3ca0 0x7fb7b40cd000 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.403+0000 7fb7bbe1a640 1 --2- 172.21.15.44:0/2242491273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb7b40b2100 0x7fb7b4157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.403+0000 7fb7bbe1a640 1 -- 172.21.15.44:0/2242491273 >> 172.21.15.44:0/2242491273 conn(0x7fb7b40cbd30 msgr2=0x7fb7b40acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:23.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.403+0000 7fb7bbe1a640 1 -- 172.21.15.44:0/2242491273 shutdown_connections 2023-11-04T01:44:23.406 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.403+0000 7fb7bbe1a640 1 -- 172.21.15.44:0/2242491273 wait complete. 2023-11-04T01:44:23.416 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:44:23.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.522+0000 7ff4a2ee5640 1 Processor -- start 2023-11-04T01:44:23.524 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.523+0000 7ff4a2ee5640 1 -- start start 2023-11-04T01:44:23.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.523+0000 7ff4a2ee5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff49c15d4e0 0x7ff49c0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.523+0000 7ff4a2ee5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff49c0ced90 0x7ff49c0ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.523+0000 7ff4a2ee5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49c0b25a0 con 0x7ff49c0ca6e0 2023-11-04T01:44:23.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.523+0000 7ff4a2ee5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49c0cab70 con 0x7ff49c0ced90 2023-11-04T01:44:23.527 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.523+0000 7ff4a2ee5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0b2300 con 0x7ff49c15d4e0 2023-11-04T01:44:23.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff4a1482640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff49c0ca6e0 0x7ff49c160fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39346/0 (socket says 172.21.15.44:39346) 2023-11-04T01:44:23.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff4a1482640 1 -- 172.21.15.44:0/2216586580 learned_addr learned my addr 172.21.15.44:0/2216586580 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:44:23.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49bfff640 1 --2- 172.21.15.44:0/2216586580 >> v2:172.21.15.204:3300/0 conn(0x7ff49c0ced90 0x7ff49c0ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff4a0c81640 1 --2- 172.21.15.44:0/2216586580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff49c15d4e0 0x7ff49c0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 -- 172.21.15.44:0/2216586580 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721265677 0 0) 0x7ff49c0b25a0 con 0x7ff49c0ca6e0 2023-11-04T01:44:23.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 -- 172.21.15.44:0/2216586580 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff48c003520 con 0x7ff49c0ca6e0 2023-11-04T01:44:23.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 -- 172.21.15.44:0/2216586580 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1233147284 0 0) 0x7ff48c003520 con 0x7ff49c0ca6e0 2023-11-04T01:44:23.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 -- 172.21.15.44:0/2216586580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff49c15d4e0 msgr2=0x7ff49c0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:23.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 --2- 172.21.15.44:0/2216586580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff49c15d4e0 0x7ff49c0ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 -- 172.21.15.44:0/2216586580 >> v2:172.21.15.204:3300/0 conn(0x7ff49c0ced90 msgr2=0x7ff49c0ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:23.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 --2- 172.21.15.44:0/2216586580 >> v2:172.21.15.204:3300/0 conn(0x7ff49c0ced90 0x7ff49c0ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 -- 172.21.15.44:0/2216586580 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c15d8c0 con 0x7ff49c0ca6e0 2023-11-04T01:44:23.528 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 -- 172.21.15.44:0/2216586580 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7ff4940019f0 con 0x7ff49c0ca6e0 2023-11-04T01:44:23.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 -- 172.21.15.44:0/2216586580 >> v1:172.21.15.44:6789/0 conn(0x7ff49c0ca6e0 legacy=0x7ff49c160fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 --2- 172.21.15.44:0/2216586580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c003970 0x7ff48c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 --2- 172.21.15.44:0/2216586580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff49c15d4e0 0x7ff48c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 --2- 172.21.15.44:0/2216586580 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff48c004d00 0x7ff48c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 -- 172.21.15.44:0/2216586580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0cab70 con 0x7ff48c003970 2023-11-04T01:44:23.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 -- 172.21.15.44:0/2216586580 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0b2300 con 0x7ff48c004d00 2023-11-04T01:44:23.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49b7fe640 1 -- 172.21.15.44:0/2216586580 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c00b980 con 0x7ff49c15d4e0 2023-11-04T01:44:23.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff4a0c81640 1 --2- 172.21.15.44:0/2216586580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c003970 0x7ff48c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff4a1482640 1 --2- 172.21.15.44:0/2216586580 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff48c004d00 0x7ff48c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.524+0000 7ff49bfff640 1 --2- 172.21.15.44:0/2216586580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff49c15d4e0 0x7ff48c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.525+0000 7ff4a0c81640 1 -- 172.21.15.44:0/2216586580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff49c15d4e0 msgr2=0x7ff48c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:23.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.525+0000 7ff4a0c81640 1 --2- 172.21.15.44:0/2216586580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff49c15d4e0 0x7ff48c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.525+0000 7ff4a0c81640 1 -- 172.21.15.44:0/2216586580 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff48c004d00 msgr2=0x7ff48c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:23.529 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.525+0000 7ff4a0c81640 1 --2- 172.21.15.44:0/2216586580 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff48c004d00 0x7ff48c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.525+0000 7ff4a0c81640 1 -- 172.21.15.44:0/2216586580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c003520 con 0x7ff48c003970 2023-11-04T01:44:23.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.525+0000 7ff4a1482640 1 --2- 172.21.15.44:0/2216586580 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff48c004d00 0x7ff48c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:23.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.525+0000 7ff49bfff640 1 --2- 172.21.15.44:0/2216586580 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff49c15d4e0 0x7ff48c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:23.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.525+0000 7ff4a0c81640 1 --2- 172.21.15.44:0/2216586580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c003970 0x7ff48c003d90 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7ff490009ac0 tx=0x7ff48c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca56fdc1011a148 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.525+0000 7ff49b7fe640 1 -- 172.21.15.44:0/2216586580 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49002c6b0 con 0x7ff48c003970 2023-11-04T01:44:23.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.526+0000 7ff49b7fe640 1 -- 172.21.15.44:0/2216586580 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49002c810 con 0x7ff48c003970 2023-11-04T01:44:23.530 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.526+0000 7ff49b7fe640 1 -- 172.21.15.44:0/2216586580 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49002cba0 con 0x7ff48c003970 2023-11-04T01:44:23.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.526+0000 7ff4a2ee5640 1 -- 172.21.15.44:0/2216586580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c003970 msgr2=0x7ff48c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.526+0000 7ff4a2ee5640 1 --2- 172.21.15.44:0/2216586580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c003970 0x7ff48c003d90 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7ff490009ac0 tx=0x7ff48c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.526+0000 7ff4a1482640 1 -- 172.21.15.44:0/2216586580 reap_dead start 2023-11-04T01:44:23.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.526+0000 7ff4a2ee5640 1 -- 172.21.15.44:0/2216586580 shutdown_connections 2023-11-04T01:44:23.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.526+0000 7ff4a2ee5640 1 -- 172.21.15.44:0/2216586580 >> 172.21.15.44:0/2216586580 conn(0x7ff49c0b1640 msgr2=0x7ff49c0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:23.533 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.526+0000 7ff4a2ee5640 1 -- 172.21.15.44:0/2216586580 shutdown_connections 2023-11-04T01:44:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.526+0000 7ff4a2ee5640 1 -- 172.21.15.44:0/2216586580 wait complete. 2023-11-04T01:44:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.527+0000 7ff4a2ee5640 1 Processor -- start 2023-11-04T01:44:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.527+0000 7ff4a2ee5640 1 -- start start 2023-11-04T01:44:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.528+0000 7ff4a2ee5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff48c003970 0x7ff49c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.528+0000 7ff4a2ee5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff49c0b5310 0x7ff49c156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.528+0000 7ff4a2ee5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c157df0 0x7ff49c158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.528+0000 7ff4a2ee5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c155710 con 0x7ff49c157df0 2023-11-04T01:44:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.528+0000 7ff4a2ee5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c1587b0 con 0x7ff49c0b5310 2023-11-04T01:44:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.528+0000 7ff4a2ee5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0b3520 con 0x7ff48c003970 2023-11-04T01:44:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.528+0000 7ff4a1482640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c157df0 0x7ff49c158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.528+0000 7ff4a1482640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c157df0 0x7ff49c158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51266/0 (socket says 172.21.15.44:51266) 2023-11-04T01:44:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.528+0000 7ff4a1482640 1 -- 172.21.15.44:0/1475902878 learned_addr learned my addr 172.21.15.44:0/1475902878 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.528+0000 7ff4a0c81640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff48c003970 0x7ff49c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.528+0000 7ff49bfff640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff49c0b5310 0x7ff49c156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.529+0000 7ff4a1482640 1 -- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff48c003970 msgr2=0x7ff49c1551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.529+0000 7ff4a1482640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff48c003970 0x7ff49c1551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.529+0000 7ff4a1482640 1 -- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff49c0b5310 msgr2=0x7ff49c156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.529+0000 7ff4a1482640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff49c0b5310 0x7ff49c156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.529+0000 7ff4a1482640 1 -- 172.21.15.44:0/1475902878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c0b4e80 con 0x7ff49c157df0 2023-11-04T01:44:23.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.529+0000 7ff4a0c81640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff48c003970 0x7ff49c1551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:23.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.529+0000 7ff49bfff640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff49c0b5310 0x7ff49c156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:23.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.529+0000 7ff4a1482640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c157df0 0x7ff49c158270 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7ff49c06f1d0 tx=0x7ff49400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.529+0000 7ff4997fa640 1 -- 172.21.15.44:0/1475902878 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49400eb30 con 0x7ff49c157df0 2023-11-04T01:44:23.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.529+0000 7ff4997fa640 1 -- 172.21.15.44:0/1475902878 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49400ec90 con 0x7ff49c157df0 2023-11-04T01:44:23.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.529+0000 7ff4a2ee5640 1 -- 172.21.15.44:0/1475902878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49c0b4870 con 0x7ff49c157df0 2023-11-04T01:44:23.535 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.529+0000 7ff4997fa640 1 -- 172.21.15.44:0/1475902878 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff494014430 con 0x7ff49c157df0 2023-11-04T01:44:23.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.529+0000 7ff4a2ee5640 1 -- 172.21.15.44:0/1475902878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c0b3a50 con 0x7ff49c157df0 2023-11-04T01:44:23.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.530+0000 7ff4a2ee5640 1 -- 172.21.15.44:0/1475902878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49c0b5010 con 0x7ff49c157df0 2023-11-04T01:44:23.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.530+0000 7ff4997fa640 1 -- 172.21.15.44:0/1475902878 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff494014590 con 0x7ff49c157df0 2023-11-04T01:44:23.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.531+0000 7ff4997fa640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff48006ae70 0x7ff48006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.531+0000 7ff4997fa640 1 -- 172.21.15.44:0/1475902878 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7ff494089c40 con 0x7ff49c157df0 2023-11-04T01:44:23.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.531+0000 7ff4a0c81640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff48006ae70 0x7ff48006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.536 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.532+0000 7ff4a0c81640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff48006ae70 0x7ff48006d330 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff490036000 tx=0x7ff490030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.537 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.535+0000 7ff4997fa640 1 -- 172.21.15.44:0/1475902878 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff494054350 con 0x7ff49c157df0 2023-11-04T01:44:23.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.708+0000 7ff4a2ee5640 1 -- 172.21.15.44:0/1475902878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7ff49c0684b0 con 0x7ff49c157df0 2023-11-04T01:44:23.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.709+0000 7ff4997fa640 1 -- 172.21.15.44:0/1475902878 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v116) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff494057970 con 0x7ff49c157df0 2023-11-04T01:44:23.711 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:44:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.710+0000 7ff4a2ee5640 1 -- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff48006ae70 msgr2=0x7ff48006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.710+0000 7ff4a2ee5640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff48006ae70 0x7ff48006d330 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff490036000 tx=0x7ff490030000 comp rx=0 tx=0).stop 2023-11-04T01:44:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.710+0000 7ff4a2ee5640 1 -- 172.21.15.44:0/1475902878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c157df0 msgr2=0x7ff49c158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.710+0000 7ff4a2ee5640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c157df0 0x7ff49c158270 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7ff49c06f1d0 tx=0x7ff49400e530 comp rx=0 tx=0).stop 2023-11-04T01:44:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.711+0000 7ff4a2ee5640 1 -- 172.21.15.44:0/1475902878 shutdown_connections 2023-11-04T01:44:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.711+0000 7ff4a2ee5640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff48006ae70 0x7ff48006d330 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.711+0000 7ff4a2ee5640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff49c157df0 0x7ff49c158270 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.711+0000 7ff4a2ee5640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff49c0b5310 0x7ff49c156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.711+0000 7ff4a2ee5640 1 --2- 172.21.15.44:0/1475902878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff48c003970 0x7ff49c1551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.711+0000 7ff4a2ee5640 1 -- 172.21.15.44:0/1475902878 >> 172.21.15.44:0/1475902878 conn(0x7ff49c0b1640 msgr2=0x7ff49c0af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.711+0000 7ff4a2ee5640 1 -- 172.21.15.44:0/1475902878 shutdown_connections 2023-11-04T01:44:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.711+0000 7ff4a2ee5640 1 -- 172.21.15.44:0/1475902878 wait complete. 2023-11-04T01:44:23.723 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:44:23.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.831+0000 7fc60de1a640 1 Processor -- start 2023-11-04T01:44:23.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.831+0000 7fc60de1a640 1 -- start start 2023-11-04T01:44:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.832+0000 7fc60de1a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc608159e40 0x7fc6080b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.832+0000 7fc60de1a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc60806bb60 0x7fc6080b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.832+0000 7fc60de1a640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc608071500 con 0x7fc60806fff0 2023-11-04T01:44:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.832+0000 7fc60de1a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60815dae0 con 0x7fc60806bb60 2023-11-04T01:44:23.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.832+0000 7fc60de1a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc608070c60 con 0x7fc608159e40 2023-11-04T01:44:23.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.832+0000 7fc606ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc60806bb60 0x7fc6080b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.832+0000 7fc607fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc60806fff0 0x7fc608070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39350/0 (socket says 172.21.15.44:39350) 2023-11-04T01:44:23.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.832+0000 7fc607fff640 1 -- 172.21.15.44:0/3411820212 learned_addr learned my addr 172.21.15.44:0/3411820212 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:44:23.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.832+0000 7fc6077fe640 1 --2- 172.21.15.44:0/3411820212 >> v2:172.21.15.204:3300/0 conn(0x7fc608159e40 0x7fc6080b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.832+0000 7fc606ffd640 1 -- 172.21.15.44:0/3411820212 >> v2:172.21.15.204:3300/0 conn(0x7fc608159e40 msgr2=0x7fc6080b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:23.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.832+0000 7fc606ffd640 1 --2- 172.21.15.44:0/3411820212 >> v2:172.21.15.204:3300/0 conn(0x7fc608159e40 0x7fc6080b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.832+0000 7fc606ffd640 1 -- 172.21.15.44:0/3411820212 >> v1:172.21.15.44:6789/0 conn(0x7fc60806fff0 legacy=0x7fc608070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.832+0000 7fc606ffd640 1 -- 172.21.15.44:0/3411820212 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc608070f40 con 0x7fc60806bb60 2023-11-04T01:44:23.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.832+0000 7fc6067fc640 1 -- 172.21.15.44:0/3411820212 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430125498 0 0) 0x7fc608071500 con 0x7fc60806fff0 2023-11-04T01:44:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.833+0000 7fc606ffd640 1 --2- 172.21.15.44:0/3411820212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc60806bb60 0x7fc6080b0a70 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fc6080ce7f0 tx=0x7fc5fc02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc779835ad931b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.833+0000 7fc6067fc640 1 -- 172.21.15.44:0/3411820212 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc031710 con 0x7fc60806bb60 2023-11-04T01:44:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.833+0000 7fc6067fc640 1 -- 172.21.15.44:0/3411820212 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc02f050 con 0x7fc60806bb60 2023-11-04T01:44:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.833+0000 7fc6067fc640 1 -- 172.21.15.44:0/3411820212 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc031a90 con 0x7fc60806bb60 2023-11-04T01:44:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.834+0000 7fc60de1a640 1 -- 172.21.15.44:0/3411820212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc60806bb60 msgr2=0x7fc6080b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.834+0000 7fc60de1a640 1 --2- 172.21.15.44:0/3411820212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc60806bb60 0x7fc6080b0a70 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fc6080ce7f0 tx=0x7fc5fc02b7b0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.834+0000 7fc60de1a640 1 -- 172.21.15.44:0/3411820212 shutdown_connections 2023-11-04T01:44:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.834+0000 7fc60de1a640 1 --2- 172.21.15.44:0/3411820212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc60806bb60 0x7fc6080b0a70 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.834+0000 7fc60de1a640 1 --2- 172.21.15.44:0/3411820212 >> v2:172.21.15.204:3300/0 conn(0x7fc608159e40 0x7fc6080b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.834+0000 7fc60de1a640 1 -- 172.21.15.44:0/3411820212 >> 172.21.15.44:0/3411820212 conn(0x7fc6080cb530 msgr2=0x7fc6080cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.834+0000 7fc60de1a640 1 -- 172.21.15.44:0/3411820212 shutdown_connections 2023-11-04T01:44:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.834+0000 7fc60de1a640 1 -- 172.21.15.44:0/3411820212 wait complete. 2023-11-04T01:44:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.835+0000 7fc60de1a640 1 Processor -- start 2023-11-04T01:44:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.835+0000 7fc60de1a640 1 -- start start 2023-11-04T01:44:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc60de1a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc60806bb60 0x7fc608148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc60de1a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc60806fff0 0x7fc60815c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc60de1a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc608159e40 0x7fc60815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc60de1a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60814aa10 con 0x7fc608159e40 2023-11-04T01:44:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc60de1a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc608149d90 con 0x7fc60806fff0 2023-11-04T01:44:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc60de1a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60814a070 con 0x7fc60806bb60 2023-11-04T01:44:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc607fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc608159e40 0x7fc60815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc607fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc608159e40 0x7fc60815cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51284/0 (socket says 172.21.15.44:51284) 2023-11-04T01:44:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc607fff640 1 -- 172.21.15.44:0/718159281 learned_addr learned my addr 172.21.15.44:0/718159281 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc607fff640 1 -- 172.21.15.44:0/718159281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc60806bb60 msgr2=0x7fc608148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc606ffd640 1 --2- 172.21.15.44:0/718159281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc60806fff0 0x7fc60815c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc6077fe640 1 --2- 172.21.15.44:0/718159281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc60806bb60 0x7fc608148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc607fff640 1 --2- 172.21.15.44:0/718159281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc60806bb60 0x7fc608148600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc607fff640 1 -- 172.21.15.44:0/718159281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc60806fff0 msgr2=0x7fc60815c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc607fff640 1 --2- 172.21.15.44:0/718159281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc60806fff0 0x7fc60815c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc607fff640 1 -- 172.21.15.44:0/718159281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc009400 con 0x7fc608159e40 2023-11-04T01:44:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.836+0000 7fc607fff640 1 --2- 172.21.15.44:0/718159281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc608159e40 0x7fc60815cae0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c7e0 tx=0x7fc60000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.837+0000 7fc5effff640 1 -- 172.21.15.44:0/718159281 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60000a640 con 0x7fc608159e40 2023-11-04T01:44:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.837+0000 7fc5effff640 1 -- 172.21.15.44:0/718159281 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60000a7c0 con 0x7fc608159e40 2023-11-04T01:44:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.837+0000 7fc60de1a640 1 -- 172.21.15.44:0/718159281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60814a350 con 0x7fc608159e40 2023-11-04T01:44:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.837+0000 7fc5effff640 1 -- 172.21.15.44:0/718159281 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60000ab70 con 0x7fc608159e40 2023-11-04T01:44:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.837+0000 7fc60de1a640 1 -- 172.21.15.44:0/718159281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc608148b40 con 0x7fc608159e40 2023-11-04T01:44:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.838+0000 7fc60de1a640 1 -- 172.21.15.44:0/718159281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60814ab50 con 0x7fc608159e40 2023-11-04T01:44:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.838+0000 7fc5effff640 1 -- 172.21.15.44:0/718159281 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc60000acd0 con 0x7fc608159e40 2023-11-04T01:44:23.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.838+0000 7fc5effff640 1 --2- 172.21.15.44:0/718159281 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc5f406ae70 0x7fc5f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.838+0000 7fc5effff640 1 -- 172.21.15.44:0/718159281 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fc6000894f0 con 0x7fc608159e40 2023-11-04T01:44:23.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.839+0000 7fc6077fe640 1 --2- 172.21.15.44:0/718159281 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc5f406ae70 0x7fc5f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.842 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.839+0000 7fc6077fe640 1 --2- 172.21.15.44:0/718159281 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc5f406ae70 0x7fc5f406d330 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800b7c0 tx=0x7fc5f8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.845 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:23.843+0000 7fc5effff640 1 -- 172.21.15.44:0/718159281 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc60814ab50 con 0x7fc608159e40 2023-11-04T01:44:24.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.016+0000 7fc60de1a640 1 -- 172.21.15.44:0/718159281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fc60814ad30 con 0x7fc608159e40 2023-11-04T01:44:24.018 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.017+0000 7fc5effff640 1 -- 172.21.15.44:0/718159281 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v116) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc60814ad30 con 0x7fc608159e40 2023-11-04T01:44:24.019 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:44:24.020 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.018+0000 7fc60de1a640 1 -- 172.21.15.44:0/718159281 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc5f406ae70 msgr2=0x7fc5f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.018+0000 7fc60de1a640 1 --2- 172.21.15.44:0/718159281 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc5f406ae70 0x7fc5f406d330 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800b7c0 tx=0x7fc5f8008040 comp rx=0 tx=0).stop 2023-11-04T01:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.018+0000 7fc60de1a640 1 -- 172.21.15.44:0/718159281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc608159e40 msgr2=0x7fc60815cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.018+0000 7fc60de1a640 1 --2- 172.21.15.44:0/718159281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc608159e40 0x7fc60815cae0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c7e0 tx=0x7fc60000cca0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.018+0000 7fc60de1a640 1 -- 172.21.15.44:0/718159281 shutdown_connections 2023-11-04T01:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.018+0000 7fc60de1a640 1 --2- 172.21.15.44:0/718159281 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fc5f406ae70 0x7fc5f406d330 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.018+0000 7fc60de1a640 1 --2- 172.21.15.44:0/718159281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc608159e40 0x7fc60815cae0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.018+0000 7fc60de1a640 1 --2- 172.21.15.44:0/718159281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc60806fff0 0x7fc60815c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.018+0000 7fc60de1a640 1 --2- 172.21.15.44:0/718159281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc60806bb60 0x7fc608148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.018+0000 7fc60de1a640 1 -- 172.21.15.44:0/718159281 >> 172.21.15.44:0/718159281 conn(0x7fc6080cb530 msgr2=0x7fc608070420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.019+0000 7fc60de1a640 1 -- 172.21.15.44:0/718159281 shutdown_connections 2023-11-04T01:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.019+0000 7fc60de1a640 1 -- 172.21.15.44:0/718159281 wait complete. 2023-11-04T01:44:24.031 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:44:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.138+0000 7fb10b525640 1 Processor -- start 2023-11-04T01:44:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.139+0000 7fb10b525640 1 -- start start 2023-11-04T01:44:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.139+0000 7fb10b525640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb10415d100 0x7fb1040ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.139+0000 7fb10b525640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb10415d4e0 0x7fb1040d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.139+0000 7fb10b525640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1040b32b0 con 0x7fb1040d3b60 2023-11-04T01:44:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.139+0000 7fb10b525640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1040cee10 con 0x7fb10415d4e0 2023-11-04T01:44:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.139+0000 7fb10b525640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1040b4750 con 0x7fb10415d100 2023-11-04T01:44:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.139+0000 7fb108ac0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb10415d4e0 0x7fb1040d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.139+0000 7fb109ac2640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb1040d3b60 0x7fb1040cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39362/0 (socket says 172.21.15.44:39362) 2023-11-04T01:44:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.139+0000 7fb109ac2640 1 -- 172.21.15.44:0/3067898359 learned_addr learned my addr 172.21.15.44:0/3067898359 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:44:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.140+0000 7fb1092c1640 1 --2- 172.21.15.44:0/3067898359 >> v2:172.21.15.204:3300/0 conn(0x7fb10415d100 0x7fb1040ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.140+0000 7fb108ac0640 1 -- 172.21.15.44:0/3067898359 >> v2:172.21.15.204:3300/0 conn(0x7fb10415d100 msgr2=0x7fb1040ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.140+0000 7fb108ac0640 1 --2- 172.21.15.44:0/3067898359 >> v2:172.21.15.204:3300/0 conn(0x7fb10415d100 0x7fb1040ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.140+0000 7fb108ac0640 1 -- 172.21.15.44:0/3067898359 >> v1:172.21.15.44:6789/0 conn(0x7fb1040d3b60 legacy=0x7fb1040cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.140+0000 7fb108ac0640 1 -- 172.21.15.44:0/3067898359 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1040b2980 con 0x7fb10415d4e0 2023-11-04T01:44:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.140+0000 7fb0fbfff640 1 -- 172.21.15.44:0/3067898359 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084570099 0 0) 0x7fb1040b32b0 con 0x7fb1040d3b60 2023-11-04T01:44:24.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.141+0000 7fb108ac0640 1 --2- 172.21.15.44:0/3067898359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10415d4e0 0x7fb1040d14d0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fb1040d09f0 tx=0x7fb0f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2654915e5ad5c9c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:24.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.141+0000 7fb0fbfff640 1 -- 172.21.15.44:0/3067898359 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4031830 con 0x7fb10415d4e0 2023-11-04T01:44:24.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.141+0000 7fb0fbfff640 1 -- 172.21.15.44:0/3067898359 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f4031990 con 0x7fb10415d4e0 2023-11-04T01:44:24.144 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.141+0000 7fb0fbfff640 1 -- 172.21.15.44:0/3067898359 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4031d20 con 0x7fb10415d4e0 2023-11-04T01:44:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.141+0000 7fb10b525640 1 -- 172.21.15.44:0/3067898359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10415d4e0 msgr2=0x7fb1040d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.141+0000 7fb10b525640 1 --2- 172.21.15.44:0/3067898359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10415d4e0 0x7fb1040d14d0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fb1040d09f0 tx=0x7fb0f402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.141+0000 7fb10b525640 1 -- 172.21.15.44:0/3067898359 shutdown_connections 2023-11-04T01:44:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.141+0000 7fb10b525640 1 --2- 172.21.15.44:0/3067898359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10415d4e0 0x7fb1040d14d0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.141+0000 7fb10b525640 1 --2- 172.21.15.44:0/3067898359 >> v2:172.21.15.204:3300/0 conn(0x7fb10415d100 0x7fb1040ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.141+0000 7fb10b525640 1 -- 172.21.15.44:0/3067898359 >> 172.21.15.44:0/3067898359 conn(0x7fb1040d2ef0 msgr2=0x7fb1040d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.141+0000 7fb10b525640 1 -- 172.21.15.44:0/3067898359 shutdown_connections 2023-11-04T01:44:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.141+0000 7fb10b525640 1 -- 172.21.15.44:0/3067898359 wait complete. 2023-11-04T01:44:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.143+0000 7fb10b525640 1 Processor -- start 2023-11-04T01:44:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.143+0000 7fb10b525640 1 -- start start 2023-11-04T01:44:24.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.143+0000 7fb10b525640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1040d3b60 0x7fb1040cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.143+0000 7fb10b525640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb10415d100 0x7fb1041f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.143+0000 7fb10b525640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10415d4e0 0x7fb1041f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.143+0000 7fb10b525640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1040b7850 con 0x7fb10415d4e0 2023-11-04T01:44:24.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.143+0000 7fb10b525640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1040b7290 con 0x7fb1040d3b60 2023-11-04T01:44:24.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.143+0000 7fb10b525640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1040b7570 con 0x7fb10415d100 2023-11-04T01:44:24.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb109ac2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10415d4e0 0x7fb1041f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb109ac2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10415d4e0 0x7fb1041f6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51298/0 (socket says 172.21.15.44:51298) 2023-11-04T01:44:24.148 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb109ac2640 1 -- 172.21.15.44:0/3226804796 learned_addr learned my addr 172.21.15.44:0/3226804796 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:24.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb1092c1640 1 --2- 172.21.15.44:0/3226804796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1040d3b60 0x7fb1040cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb108ac0640 1 --2- 172.21.15.44:0/3226804796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb10415d100 0x7fb1041f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb109ac2640 1 -- 172.21.15.44:0/3226804796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb10415d100 msgr2=0x7fb1041f5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb109ac2640 1 --2- 172.21.15.44:0/3226804796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb10415d100 0x7fb1041f5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb109ac2640 1 -- 172.21.15.44:0/3226804796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1040d3b60 msgr2=0x7fb1040cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb109ac2640 1 --2- 172.21.15.44:0/3226804796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1040d3b60 0x7fb1040cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb109ac2640 1 -- 172.21.15.44:0/3226804796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4009400 con 0x7fb10415d4e0 2023-11-04T01:44:24.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb108ac0640 1 --2- 172.21.15.44:0/3226804796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb10415d100 0x7fb1041f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:24.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb109ac2640 1 --2- 172.21.15.44:0/3226804796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10415d4e0 0x7fb1041f6310 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00c780 tx=0x7fb0fc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:24.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb0f9ffb640 1 -- 172.21.15.44:0/3226804796 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc00ce90 con 0x7fb10415d4e0 2023-11-04T01:44:24.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb0f9ffb640 1 -- 172.21.15.44:0/3226804796 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc00a640 con 0x7fb10415d4e0 2023-11-04T01:44:24.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb10b525640 1 -- 172.21.15.44:0/3226804796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb104150060 con 0x7fb10415d4e0 2023-11-04T01:44:24.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb0f9ffb640 1 -- 172.21.15.44:0/3226804796 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc00a9d0 con 0x7fb10415d4e0 2023-11-04T01:44:24.149 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.144+0000 7fb10b525640 1 -- 172.21.15.44:0/3226804796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1040cce70 con 0x7fb10415d4e0 2023-11-04T01:44:24.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.145+0000 7fb10b525640 1 -- 172.21.15.44:0/3226804796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10414fec0 con 0x7fb10415d4e0 2023-11-04T01:44:24.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.146+0000 7fb0f9ffb640 1 -- 172.21.15.44:0/3226804796 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0fc00ab30 con 0x7fb10415d4e0 2023-11-04T01:44:24.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.146+0000 7fb0f9ffb640 1 --2- 172.21.15.44:0/3226804796 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb0e806ae70 0x7fb0e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.146+0000 7fb0f9ffb640 1 -- 172.21.15.44:0/3226804796 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fb0fc0896e0 con 0x7fb10415d4e0 2023-11-04T01:44:24.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.146+0000 7fb1092c1640 1 --2- 172.21.15.44:0/3226804796 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb0e806ae70 0x7fb0e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.150 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.147+0000 7fb1092c1640 1 --2- 172.21.15.44:0/3226804796 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb0e806ae70 0x7fb0e806d330 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb100006fd0 tx=0x7fb100008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:24.152 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.150+0000 7fb0f9ffb640 1 -- 172.21.15.44:0/3226804796 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb10414fec0 con 0x7fb10415d4e0 2023-11-04T01:44:24.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.327+0000 7fb10b525640 1 -- 172.21.15.44:0/3226804796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fb104150580 con 0x7fb10415d4e0 2023-11-04T01:44:24.329 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.327+0000 7fb0f9ffb640 1 -- 172.21.15.44:0/3226804796 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v116) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb104150580 con 0x7fb10415d4e0 2023-11-04T01:44:24.329 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:44:24.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.329+0000 7fb10b525640 1 -- 172.21.15.44:0/3226804796 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb0e806ae70 msgr2=0x7fb0e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.329+0000 7fb10b525640 1 --2- 172.21.15.44:0/3226804796 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb0e806ae70 0x7fb0e806d330 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb100006fd0 tx=0x7fb100008040 comp rx=0 tx=0).stop 2023-11-04T01:44:24.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.329+0000 7fb10b525640 1 -- 172.21.15.44:0/3226804796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10415d4e0 msgr2=0x7fb1041f6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.329+0000 7fb10b525640 1 --2- 172.21.15.44:0/3226804796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10415d4e0 0x7fb1041f6310 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00c780 tx=0x7fb0fc00cc40 comp rx=0 tx=0).stop 2023-11-04T01:44:24.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.329+0000 7fb10b525640 1 -- 172.21.15.44:0/3226804796 shutdown_connections 2023-11-04T01:44:24.331 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.329+0000 7fb10b525640 1 --2- 172.21.15.44:0/3226804796 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fb0e806ae70 0x7fb0e806d330 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.329+0000 7fb10b525640 1 --2- 172.21.15.44:0/3226804796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10415d4e0 0x7fb1041f6310 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.329+0000 7fb10b525640 1 --2- 172.21.15.44:0/3226804796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb10415d100 0x7fb1041f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.329+0000 7fb10b525640 1 --2- 172.21.15.44:0/3226804796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1040d3b60 0x7fb1040cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.329+0000 7fb10b525640 1 -- 172.21.15.44:0/3226804796 >> 172.21.15.44:0/3226804796 conn(0x7fb1040d2ef0 msgr2=0x7fb10406ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:24.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.329+0000 7fb10b525640 1 -- 172.21.15.44:0/3226804796 shutdown_connections 2023-11-04T01:44:24.332 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.329+0000 7fb10b525640 1 -- 172.21.15.44:0/3226804796 wait complete. 2023-11-04T01:44:24.342 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:44:24.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.448+0000 7f15affb6640 1 Processor -- start 2023-11-04T01:44:24.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.449+0000 7f15affb6640 1 -- start start 2023-11-04T01:44:24.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.449+0000 7f15affb6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a815d100 0x7f15a80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.449+0000 7f15affb6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f15a80d1be0 0x7f15a80b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.449+0000 7f15affb6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a80b32b0 con 0x7f15a815d4e0 2023-11-04T01:44:24.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.449+0000 7f15affb6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a80cee10 con 0x7f15a80d1be0 2023-11-04T01:44:24.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.449+0000 7f15affb6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a80b2980 con 0x7f15a815d100 2023-11-04T01:44:24.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.450+0000 7f15add52640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a815d100 0x7f15a80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.450+0000 7f15ae553640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f15a80d1be0 0x7f15a80b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.452 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.450+0000 7f15add52640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a815d100 0x7f15a80ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.44:50420/0 (socket says 172.21.15.44:50420) 2023-11-04T01:44:24.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.450+0000 7f15ad551640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f15a815d4e0 0x7f15a80d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:49030/0 (socket says 172.21.15.44:49030) 2023-11-04T01:44:24.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.450+0000 7f15ae553640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f15a80d1be0 0x7f15a80b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:49950/0 (socket says 172.21.15.44:49950) 2023-11-04T01:44:24.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.450+0000 7f15add52640 1 -- 172.21.15.44:0/2074247821 learned_addr learned my addr 172.21.15.44:0/2074247821 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:24.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.450+0000 7f15add52640 1 -- 172.21.15.44:0/2074247821 >> v2:172.21.15.204:3300/0 conn(0x7f15a80d1be0 msgr2=0x7f15a80b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:24.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.450+0000 7f15add52640 1 --2- 172.21.15.44:0/2074247821 >> v2:172.21.15.204:3300/0 conn(0x7f15a80d1be0 0x7f15a80b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.450+0000 7f15add52640 1 -- 172.21.15.44:0/2074247821 >> v1:172.21.15.204:6789/0 conn(0x7f15a815d4e0 legacy=0x7f15a80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.450+0000 7f15add52640 1 -- 172.21.15.44:0/2074247821 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a80b2c60 con 0x7f15a815d100 2023-11-04T01:44:24.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.450+0000 7f15ae553640 1 --2- 172.21.15.44:0/2074247821 >> v2:172.21.15.204:3300/0 conn(0x7f15a80d1be0 0x7f15a80b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:24.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.451+0000 7f15add52640 1 --2- 172.21.15.44:0/2074247821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a815d100 0x7f15a80ce510 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009880 tx=0x7f15a402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d941bd717101542 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:24.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.451+0000 7f15acd50640 1 -- 172.21.15.44:0/2074247821 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4004230 con 0x7f15a815d100 2023-11-04T01:44:24.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.451+0000 7f15acd50640 1 -- 172.21.15.44:0/2074247821 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a4004390 con 0x7f15a815d100 2023-11-04T01:44:24.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.451+0000 7f15acd50640 1 -- 172.21.15.44:0/2074247821 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4003810 con 0x7f15a815d100 2023-11-04T01:44:24.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.452+0000 7f15affb6640 1 -- 172.21.15.44:0/2074247821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a815d100 msgr2=0x7f15a80ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.454 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.452+0000 7f15affb6640 1 --2- 172.21.15.44:0/2074247821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a815d100 0x7f15a80ce510 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009880 tx=0x7f15a402b960 comp rx=0 tx=0).stop 2023-11-04T01:44:24.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.452+0000 7f15affb6640 1 -- 172.21.15.44:0/2074247821 shutdown_connections 2023-11-04T01:44:24.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.452+0000 7f15affb6640 1 --2- 172.21.15.44:0/2074247821 >> v2:172.21.15.204:3300/0 conn(0x7f15a80d1be0 0x7f15a80b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.452+0000 7f15affb6640 1 --2- 172.21.15.44:0/2074247821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a815d100 0x7f15a80ce510 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.452+0000 7f15affb6640 1 -- 172.21.15.44:0/2074247821 >> 172.21.15.44:0/2074247821 conn(0x7f15a80d2ef0 msgr2=0x7f15a80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:24.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.452+0000 7f15affb6640 1 -- 172.21.15.44:0/2074247821 shutdown_connections 2023-11-04T01:44:24.455 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.452+0000 7f15affb6640 1 -- 172.21.15.44:0/2074247821 wait complete. 2023-11-04T01:44:24.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.453+0000 7f15affb6640 1 Processor -- start 2023-11-04T01:44:24.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.453+0000 7f15affb6640 1 -- start start 2023-11-04T01:44:24.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15affb6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a80d1be0 0x7f15a80b83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15affb6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a815d100 0x7f15a81f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15affb6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15a815d4e0 0x7f15a81f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15affb6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a80b71a0 con 0x7f15a80d1be0 2023-11-04T01:44:24.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15affb6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a80b88e0 con 0x7f15a815d4e0 2023-11-04T01:44:24.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15affb6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a80b6520 con 0x7f15a815d100 2023-11-04T01:44:24.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15add52640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a80d1be0 0x7f15a80b83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15add52640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a80d1be0 0x7f15a80b83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51312/0 (socket says 172.21.15.44:51312) 2023-11-04T01:44:24.457 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15add52640 1 -- 172.21.15.44:0/1117928660 learned_addr learned my addr 172.21.15.44:0/1117928660 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:24.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15ad551640 1 --2- 172.21.15.44:0/1117928660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a815d100 0x7f15a81f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15ae553640 1 --2- 172.21.15.44:0/1117928660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15a815d4e0 0x7f15a81f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15add52640 1 -- 172.21.15.44:0/1117928660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a815d100 msgr2=0x7f15a81f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15add52640 1 --2- 172.21.15.44:0/1117928660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a815d100 0x7f15a81f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15add52640 1 -- 172.21.15.44:0/1117928660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15a815d4e0 msgr2=0x7f15a81f2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15add52640 1 --2- 172.21.15.44:0/1117928660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15a815d4e0 0x7f15a81f2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15add52640 1 -- 172.21.15.44:0/1117928660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a0009a70 con 0x7f15a80d1be0 2023-11-04T01:44:24.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.454+0000 7f15ad551640 1 --2- 172.21.15.44:0/1117928660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a815d100 0x7f15a81f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:24.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.455+0000 7f15add52640 1 --2- 172.21.15.44:0/1117928660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a80d1be0 0x7f15a80b83a0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f15a40099a0 tx=0x7f15a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:24.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.455+0000 7f159e7fc640 1 -- 172.21.15.44:0/1117928660 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a403e070 con 0x7f15a80d1be0 2023-11-04T01:44:24.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.455+0000 7f159e7fc640 1 -- 172.21.15.44:0/1117928660 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a4004500 con 0x7f15a80d1be0 2023-11-04T01:44:24.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.455+0000 7f15affb6640 1 -- 172.21.15.44:0/1117928660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a4009460 con 0x7f15a80d1be0 2023-11-04T01:44:24.458 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.455+0000 7f159e7fc640 1 -- 172.21.15.44:0/1117928660 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4005ea0 con 0x7f15a80d1be0 2023-11-04T01:44:24.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.455+0000 7f15affb6640 1 -- 172.21.15.44:0/1117928660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a80b6ae0 con 0x7f15a80d1be0 2023-11-04T01:44:24.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.456+0000 7f15affb6640 1 -- 172.21.15.44:0/1117928660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a80684b0 con 0x7f15a80d1be0 2023-11-04T01:44:24.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.456+0000 7f159e7fc640 1 -- 172.21.15.44:0/1117928660 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15a4006040 con 0x7f15a80d1be0 2023-11-04T01:44:24.459 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.457+0000 7f159e7fc640 1 --2- 172.21.15.44:0/1117928660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f158c06ae70 0x7f158c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.457+0000 7f159e7fc640 1 -- 172.21.15.44:0/1117928660 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f15a40abdc0 con 0x7f15a80d1be0 2023-11-04T01:44:24.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.457+0000 7f15ad551640 1 --2- 172.21.15.44:0/1117928660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f158c06ae70 0x7f158c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.460 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.458+0000 7f15ad551640 1 --2- 172.21.15.44:0/1117928660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f158c06ae70 0x7f158c06d330 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1598007fd0 tx=0x7f1598007d40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:24.462 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.461+0000 7f159e7fc640 1 -- 172.21.15.44:0/1117928660 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f15a4076680 con 0x7f15a80d1be0 2023-11-04T01:44:24.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.636+0000 7f15affb6640 1 -- 172.21.15.44:0/1117928660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15a80d2cd0 con 0x7f15a80d1be0 2023-11-04T01:44:24.639 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.637+0000 7f159e7fc640 1 -- 172.21.15.44:0/1117928660 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15a4048020 con 0x7f15a80d1be0 2023-11-04T01:44:24.639 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:44:24.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.639+0000 7f15affb6640 1 -- 172.21.15.44:0/1117928660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f158c06ae70 msgr2=0x7f158c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.639+0000 7f15affb6640 1 --2- 172.21.15.44:0/1117928660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f158c06ae70 0x7f158c06d330 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1598007fd0 tx=0x7f1598007d40 comp rx=0 tx=0).stop 2023-11-04T01:44:24.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.639+0000 7f15affb6640 1 -- 172.21.15.44:0/1117928660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a80d1be0 msgr2=0x7f15a80b83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.639+0000 7f15affb6640 1 --2- 172.21.15.44:0/1117928660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a80d1be0 0x7f15a80b83a0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f15a40099a0 tx=0x7f15a40046c0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.639+0000 7f15affb6640 1 -- 172.21.15.44:0/1117928660 shutdown_connections 2023-11-04T01:44:24.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.639+0000 7f15affb6640 1 --2- 172.21.15.44:0/1117928660 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f158c06ae70 0x7f158c06d330 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.639+0000 7f15affb6640 1 --2- 172.21.15.44:0/1117928660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15a815d4e0 0x7f15a81f2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.639+0000 7f15affb6640 1 --2- 172.21.15.44:0/1117928660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15a815d100 0x7f15a81f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.639+0000 7f15affb6640 1 --2- 172.21.15.44:0/1117928660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a80d1be0 0x7f15a80b83a0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.641 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.639+0000 7f15affb6640 1 -- 172.21.15.44:0/1117928660 >> 172.21.15.44:0/1117928660 conn(0x7f15a80d2ef0 msgr2=0x7f15a80cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:24.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.639+0000 7f15affb6640 1 -- 172.21.15.44:0/1117928660 shutdown_connections 2023-11-04T01:44:24.642 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.639+0000 7f15affb6640 1 -- 172.21.15.44:0/1117928660 wait complete. 2023-11-04T01:44:24.651 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:44:24.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.758+0000 7f2edc9b0640 1 Processor -- start 2023-11-04T01:44:24.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.758+0000 7f2edc9b0640 1 -- start start 2023-11-04T01:44:24.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.759+0000 7f2edc9b0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2ed815d100 0x7f2ed80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.759+0000 7f2edc9b0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ed80d1be0 0x7f2ed80b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.759+0000 7f2edc9b0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed80b32b0 con 0x7f2ed815d4e0 2023-11-04T01:44:24.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.759+0000 7f2edc9b0640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed80cee10 con 0x7f2ed815d100 2023-11-04T01:44:24.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.759+0000 7f2edc9b0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80b2980 con 0x7f2ed80d1be0 2023-11-04T01:44:24.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.759+0000 7f2ed659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2ed815d100 0x7f2ed80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.759+0000 7f2ed659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2ed815d100 0x7f2ed80ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51318/0 (socket says 172.21.15.44:51318) 2023-11-04T01:44:24.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.759+0000 7f2ed659c640 1 -- 172.21.15.44:0/2605811583 learned_addr learned my addr 172.21.15.44:0/2605811583 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:24.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.759+0000 7f2ed659c640 1 -- 172.21.15.44:0/2605811583 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ed80d1be0 msgr2=0x7f2ed80b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:24.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.759+0000 7f2ed6d9d640 1 --2- 172.21.15.44:0/2605811583 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ed80d1be0 0x7f2ed80b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.760+0000 7f2ed659c640 1 --2- 172.21.15.44:0/2605811583 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ed80d1be0 0x7f2ed80b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.760+0000 7f2ed659c640 1 -- 172.21.15.44:0/2605811583 >> v1:172.21.15.204:6789/0 conn(0x7f2ed815d4e0 legacy=0x7f2ed80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:24.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.760+0000 7f2ed659c640 1 -- 172.21.15.44:0/2605811583 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed80b2c60 con 0x7f2ed815d100 2023-11-04T01:44:24.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.760+0000 7f2ed6d9d640 1 --2- 172.21.15.44:0/2605811583 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ed80d1be0 0x7f2ed80b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:24.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.760+0000 7f2ed659c640 1 --2- 172.21.15.44:0/2605811583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ed815d100 0x7f2ed80ce510 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0009850 tx=0x7f2ed002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a710b0ffd72717 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:24.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.760+0000 7f2ed559a640 1 -- 172.21.15.44:0/2605811583 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0004230 con 0x7f2ed815d100 2023-11-04T01:44:24.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.760+0000 7f2ed559a640 1 -- 172.21.15.44:0/2605811583 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed0004390 con 0x7f2ed815d100 2023-11-04T01:44:24.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.761+0000 7f2ed559a640 1 -- 172.21.15.44:0/2605811583 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0031830 con 0x7f2ed815d100 2023-11-04T01:44:24.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.761+0000 7f2edc9b0640 1 -- 172.21.15.44:0/2605811583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ed815d100 msgr2=0x7f2ed80ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.761+0000 7f2edc9b0640 1 --2- 172.21.15.44:0/2605811583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ed815d100 0x7f2ed80ce510 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0009850 tx=0x7f2ed002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.761+0000 7f2edc9b0640 1 -- 172.21.15.44:0/2605811583 shutdown_connections 2023-11-04T01:44:24.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.761+0000 7f2edc9b0640 1 --2- 172.21.15.44:0/2605811583 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ed80d1be0 0x7f2ed80b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.761+0000 7f2edc9b0640 1 --2- 172.21.15.44:0/2605811583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ed815d100 0x7f2ed80ce510 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.761+0000 7f2edc9b0640 1 -- 172.21.15.44:0/2605811583 >> 172.21.15.44:0/2605811583 conn(0x7f2ed80d2ef0 msgr2=0x7f2ed80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:24.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.761+0000 7f2edc9b0640 1 -- 172.21.15.44:0/2605811583 shutdown_connections 2023-11-04T01:44:24.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.761+0000 7f2edc9b0640 1 -- 172.21.15.44:0/2605811583 wait complete. 2023-11-04T01:44:24.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.762+0000 7f2edc9b0640 1 Processor -- start 2023-11-04T01:44:24.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.763+0000 7f2edc9b0640 1 -- start start 2023-11-04T01:44:24.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.763+0000 7f2edc9b0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ed80d1be0 0x7f2ed8158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.763+0000 7f2edc9b0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ed815d100 0x7f2ed80b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.763+0000 7f2edc9b0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ed815d4e0 0x7f2ed81549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.763+0000 7f2edc9b0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8154f10 con 0x7f2ed80d1be0 2023-11-04T01:44:24.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.763+0000 7f2edc9b0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8159880 con 0x7f2ed815d100 2023-11-04T01:44:24.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.763+0000 7f2edc9b0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8158c70 con 0x7f2ed815d4e0 2023-11-04T01:44:24.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.763+0000 7f2ed659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ed80d1be0 0x7f2ed8158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.763+0000 7f2ed659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ed80d1be0 0x7f2ed8158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51332/0 (socket says 172.21.15.44:51332) 2023-11-04T01:44:24.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.763+0000 7f2ed659c640 1 -- 172.21.15.44:0/2568844308 learned_addr learned my addr 172.21.15.44:0/2568844308 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:24.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.764+0000 7f2ed6d9d640 1 --2- 172.21.15.44:0/2568844308 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ed815d4e0 0x7f2ed81549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.764+0000 7f2ed5d9b640 1 --2- 172.21.15.44:0/2568844308 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ed815d100 0x7f2ed80b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.764+0000 7f2ed659c640 1 -- 172.21.15.44:0/2568844308 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ed815d4e0 msgr2=0x7f2ed81549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.764+0000 7f2ed659c640 1 --2- 172.21.15.44:0/2568844308 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ed815d4e0 0x7f2ed81549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.764+0000 7f2ed659c640 1 -- 172.21.15.44:0/2568844308 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ed815d100 msgr2=0x7f2ed80b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.764+0000 7f2ed659c640 1 --2- 172.21.15.44:0/2568844308 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ed815d100 0x7f2ed80b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.764+0000 7f2ed659c640 1 -- 172.21.15.44:0/2568844308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed0009460 con 0x7f2ed80d1be0 2023-11-04T01:44:24.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.764+0000 7f2ed659c640 1 --2- 172.21.15.44:0/2568844308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ed80d1be0 0x7f2ed8158600 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00090b0 tx=0x7f2ed00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:24.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.764+0000 7f2eceffd640 1 -- 172.21.15.44:0/2568844308 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0031830 con 0x7f2ed80d1be0 2023-11-04T01:44:24.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.764+0000 7f2eceffd640 1 -- 172.21.15.44:0/2568844308 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed003f070 con 0x7f2ed80d1be0 2023-11-04T01:44:24.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.764+0000 7f2eceffd640 1 -- 172.21.15.44:0/2568844308 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0031b90 con 0x7f2ed80d1be0 2023-11-04T01:44:24.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.764+0000 7f2edc9b0640 1 -- 172.21.15.44:0/2568844308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed8158f50 con 0x7f2ed80d1be0 2023-11-04T01:44:24.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.764+0000 7f2edc9b0640 1 -- 172.21.15.44:0/2568844308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed8159510 con 0x7f2ed80d1be0 2023-11-04T01:44:24.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.765+0000 7f2edc9b0640 1 -- 172.21.15.44:0/2568844308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed81596a0 con 0x7f2ed80d1be0 2023-11-04T01:44:24.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.766+0000 7f2eceffd640 1 -- 172.21.15.44:0/2568844308 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ed0041030 con 0x7f2ed80d1be0 2023-11-04T01:44:24.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.766+0000 7f2eceffd640 1 --2- 172.21.15.44:0/2568844308 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2eb806ae70 0x7f2eb806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.766+0000 7f2eceffd640 1 -- 172.21.15.44:0/2568844308 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f2ed00ac260 con 0x7f2ed80d1be0 2023-11-04T01:44:24.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.766+0000 7f2ed5d9b640 1 --2- 172.21.15.44:0/2568844308 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2eb806ae70 0x7f2eb806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.767+0000 7f2ed5d9b640 1 --2- 172.21.15.44:0/2568844308 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2eb806ae70 0x7f2eb806d330 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0006fd0 tx=0x7f2ec0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:24.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.770+0000 7f2eceffd640 1 -- 172.21.15.44:0/2568844308 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ed0076a00 con 0x7f2ed80d1be0 2023-11-04T01:44:24.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.946+0000 7f2edc9b0640 1 -- 172.21.15.44:0/2568844308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ed81596a0 con 0x7f2ed80d1be0 2023-11-04T01:44:24.948 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.946+0000 7f2eceffd640 1 -- 172.21.15.44:0/2568844308 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ed007a020 con 0x7f2ed80d1be0 2023-11-04T01:44:24.948 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:44:24.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.948+0000 7f2edc9b0640 1 -- 172.21.15.44:0/2568844308 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2eb806ae70 msgr2=0x7f2eb806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.948+0000 7f2edc9b0640 1 --2- 172.21.15.44:0/2568844308 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2eb806ae70 0x7f2eb806d330 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0006fd0 tx=0x7f2ec0008040 comp rx=0 tx=0).stop 2023-11-04T01:44:24.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.948+0000 7f2edc9b0640 1 -- 172.21.15.44:0/2568844308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ed80d1be0 msgr2=0x7f2ed8158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.948+0000 7f2edc9b0640 1 --2- 172.21.15.44:0/2568844308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ed80d1be0 0x7f2ed8158600 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00090b0 tx=0x7f2ed00046c0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.948+0000 7f2edc9b0640 1 -- 172.21.15.44:0/2568844308 shutdown_connections 2023-11-04T01:44:24.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.948+0000 7f2edc9b0640 1 --2- 172.21.15.44:0/2568844308 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f2eb806ae70 0x7f2eb806d330 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.948+0000 7f2edc9b0640 1 --2- 172.21.15.44:0/2568844308 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ed815d4e0 0x7f2ed81549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.948+0000 7f2edc9b0640 1 --2- 172.21.15.44:0/2568844308 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ed815d100 0x7f2ed80b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.948+0000 7f2edc9b0640 1 --2- 172.21.15.44:0/2568844308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ed80d1be0 0x7f2ed8158600 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.948+0000 7f2edc9b0640 1 -- 172.21.15.44:0/2568844308 >> 172.21.15.44:0/2568844308 conn(0x7f2ed80d2ef0 msgr2=0x7f2ed80b4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:24.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.948+0000 7f2edc9b0640 1 -- 172.21.15.44:0/2568844308 shutdown_connections 2023-11-04T01:44:24.951 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:24.948+0000 7f2edc9b0640 1 -- 172.21.15.44:0/2568844308 wait complete. 2023-11-04T01:44:24.961 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:44:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.065+0000 7ff6baac2640 1 Processor -- start 2023-11-04T01:44:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.065+0000 7ff6baac2640 1 -- start start 2023-11-04T01:44:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.066+0000 7ff6baac2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff6b415b200 0x7ff6b40ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.066+0000 7ff6baac2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6b40cd9c0 0x7ff6b40ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.066+0000 7ff6baac2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b40cde80 con 0x7ff6b40afda0 2023-11-04T01:44:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.066+0000 7ff6baac2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b40cf670 con 0x7ff6b415b200 2023-11-04T01:44:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.066+0000 7ff6baac2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40cf950 con 0x7ff6b40cd9c0 2023-11-04T01:44:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.066+0000 7ff6b3fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff6b40afda0 0x7ff6b40cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39364/0 (socket says 172.21.15.44:39364) 2023-11-04T01:44:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.066+0000 7ff6b3fff640 1 -- 172.21.15.44:0/1878181231 learned_addr learned my addr 172.21.15.44:0/1878181231 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:44:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.067+0000 7ff6b885e640 1 --2- 172.21.15.44:0/1878181231 >> v2:172.21.15.204:3300/0 conn(0x7ff6b415b200 0x7ff6b40ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.067+0000 7ff6b905f640 1 --2- 172.21.15.44:0/1878181231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6b40cd9c0 0x7ff6b40ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.067+0000 7ff6b37fe640 1 -- 172.21.15.44:0/1878181231 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671059033 0 0) 0x7ff6b40cde80 con 0x7ff6b40afda0 2023-11-04T01:44:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.067+0000 7ff6b37fe640 1 -- 172.21.15.44:0/1878181231 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff69c003520 con 0x7ff6b40afda0 2023-11-04T01:44:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.067+0000 7ff6b885e640 1 -- 172.21.15.44:0/1878181231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6b40cd9c0 msgr2=0x7ff6b40ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.067+0000 7ff6b37fe640 1 -- 172.21.15.44:0/1878181231 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1259923779 0 0) 0x7ff69c003520 con 0x7ff6b40afda0 2023-11-04T01:44:25.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.067+0000 7ff6b885e640 1 --2- 172.21.15.44:0/1878181231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6b40cd9c0 0x7ff6b40ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.067+0000 7ff6b885e640 1 -- 172.21.15.44:0/1878181231 >> v1:172.21.15.44:6789/0 conn(0x7ff6b40afda0 legacy=0x7ff6b40cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.067+0000 7ff6b885e640 1 -- 172.21.15.44:0/1878181231 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40ce120 con 0x7ff6b415b200 2023-11-04T01:44:25.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.067+0000 7ff6b905f640 1 --2- 172.21.15.44:0/1878181231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6b40cd9c0 0x7ff6b40ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:25.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.068+0000 7ff6b885e640 1 --2- 172.21.15.44:0/1878181231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6b415b200 0x7ff6b40ceb30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009790 tx=0x7ff6a402b6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5ce55912371bd2f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.068+0000 7ff6b37fe640 1 -- 172.21.15.44:0/1878181231 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8001670 con 0x7ff6b415b200 2023-11-04T01:44:25.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.068+0000 7ff6b37fe640 1 -- 172.21.15.44:0/1878181231 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a402e050 con 0x7ff6b415b200 2023-11-04T01:44:25.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.068+0000 7ff6b37fe640 1 -- 172.21.15.44:0/1878181231 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4030730 con 0x7ff6b415b200 2023-11-04T01:44:25.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.068+0000 7ff6baac2640 1 -- 172.21.15.44:0/1878181231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6b415b200 msgr2=0x7ff6b40ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.068+0000 7ff6baac2640 1 --2- 172.21.15.44:0/1878181231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6b415b200 0x7ff6b40ceb30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009790 tx=0x7ff6a402b6e0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.069+0000 7ff6baac2640 1 -- 172.21.15.44:0/1878181231 shutdown_connections 2023-11-04T01:44:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.069+0000 7ff6baac2640 1 --2- 172.21.15.44:0/1878181231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6b40cd9c0 0x7ff6b40ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.069+0000 7ff6baac2640 1 --2- 172.21.15.44:0/1878181231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6b415b200 0x7ff6b40ceb30 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.069+0000 7ff6baac2640 1 -- 172.21.15.44:0/1878181231 >> 172.21.15.44:0/1878181231 conn(0x7ff6b40d0c30 msgr2=0x7ff6b40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.069+0000 7ff6baac2640 1 -- 172.21.15.44:0/1878181231 shutdown_connections 2023-11-04T01:44:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.069+0000 7ff6baac2640 1 -- 172.21.15.44:0/1878181231 wait complete. 2023-11-04T01:44:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.070+0000 7ff6baac2640 1 Processor -- start 2023-11-04T01:44:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.070+0000 7ff6baac2640 1 -- start start 2023-11-04T01:44:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6baac2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6b40afda0 0x7ff6b4155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6baac2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6b40cd9c0 0x7ff6b415b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6baac2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6b415b200 0x7ff6b4155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6baac2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40c8c80 con 0x7ff6b40afda0 2023-11-04T01:44:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6baac2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b415be40 con 0x7ff6b415b200 2023-11-04T01:44:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6baac2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40c73b0 con 0x7ff6b40cd9c0 2023-11-04T01:44:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6b885e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6b40afda0 0x7ff6b4155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6b885e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6b40afda0 0x7ff6b4155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51342/0 (socket says 172.21.15.44:51342) 2023-11-04T01:44:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6b885e640 1 -- 172.21.15.44:0/4082756998 learned_addr learned my addr 172.21.15.44:0/4082756998 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6b3fff640 1 --2- 172.21.15.44:0/4082756998 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6b40cd9c0 0x7ff6b415b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6b905f640 1 --2- 172.21.15.44:0/4082756998 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6b415b200 0x7ff6b4155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6b885e640 1 -- 172.21.15.44:0/4082756998 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6b40cd9c0 msgr2=0x7ff6b415b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6b885e640 1 --2- 172.21.15.44:0/4082756998 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6b40cd9c0 0x7ff6b415b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6b885e640 1 -- 172.21.15.44:0/4082756998 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6b415b200 msgr2=0x7ff6b4155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6b885e640 1 --2- 172.21.15.44:0/4082756998 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6b415b200 0x7ff6b4155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6b885e640 1 -- 172.21.15.44:0/4082756998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac009a70 con 0x7ff6b40afda0 2023-11-04T01:44:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6b905f640 1 --2- 172.21.15.44:0/4082756998 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6b415b200 0x7ff6b4155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6b885e640 1 --2- 172.21.15.44:0/4082756998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6b40afda0 0x7ff6b4155c30 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40098b0 tx=0x7ff6a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6b17fa640 1 -- 172.21.15.44:0/4082756998 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a403b810 con 0x7ff6b40afda0 2023-11-04T01:44:25.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6b17fa640 1 -- 172.21.15.44:0/4082756998 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a403b990 con 0x7ff6b40afda0 2023-11-04T01:44:25.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6baac2640 1 -- 172.21.15.44:0/4082756998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a40093a0 con 0x7ff6b40afda0 2023-11-04T01:44:25.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.071+0000 7ff6b17fa640 1 -- 172.21.15.44:0/4082756998 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a403bd40 con 0x7ff6b40afda0 2023-11-04T01:44:25.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.072+0000 7ff6baac2640 1 -- 172.21.15.44:0/4082756998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b40c7080 con 0x7ff6b40afda0 2023-11-04T01:44:25.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.072+0000 7ff6baac2640 1 -- 172.21.15.44:0/4082756998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b40684b0 con 0x7ff6b40afda0 2023-11-04T01:44:25.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.073+0000 7ff6b17fa640 1 -- 172.21.15.44:0/4082756998 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6a4039040 con 0x7ff6b40afda0 2023-11-04T01:44:25.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.073+0000 7ff6b17fa640 1 --2- 172.21.15.44:0/4082756998 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6a006ae70 0x7ff6a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.073+0000 7ff6b17fa640 1 -- 172.21.15.44:0/4082756998 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7ff6a40ab5f0 con 0x7ff6b40afda0 2023-11-04T01:44:25.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.074+0000 7ff6b3fff640 1 --2- 172.21.15.44:0/4082756998 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6a006ae70 0x7ff6a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.074+0000 7ff6b3fff640 1 --2- 172.21.15.44:0/4082756998 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6a006ae70 0x7ff6a006d330 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8001b90 tx=0x7ff6a8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.079 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.077+0000 7ff6b17fa640 1 -- 172.21.15.44:0/4082756998 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff6a4075cf0 con 0x7ff6b40afda0 2023-11-04T01:44:25.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.265+0000 7ff6baac2640 1 -- 172.21.15.44:0/4082756998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff6b40ae5a0 con 0x7ff6b40afda0 2023-11-04T01:44:25.267 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.265+0000 7ff6b17fa640 1 -- 172.21.15.44:0/4082756998 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v116) v1 ==== 81+0+1394 (secure 0 0 0) 0x7ff6a4037080 con 0x7ff6b40afda0 2023-11-04T01:44:25.267 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/2720398401 2023-11-05T01:43:41.768312+0000 2023-11-04T01:44:25.267 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.1:0/1398028154 2023-11-04T02:42:59.149511+0000 2023-11-04T01:44:25.267 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/3267689413 2023-11-05T01:42:50.946757+0000 2023-11-04T01:44:25.267 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/3264332323 2023-11-05T01:42:44.043453+0000 2023-11-04T01:44:25.267 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6832/22987540 2023-11-05T01:43:34.391624+0000 2023-11-04T01:44:25.268 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/3264332323 2023-11-05T01:42:44.043453+0000 2023-11-04T01:44:25.268 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6832/2069525699 2023-11-05T01:42:05.849526+0000 2023-11-04T01:44:25.268 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/22987540 2023-11-05T01:43:34.391624+0000 2023-11-04T01:44:25.268 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/3267689413 2023-11-05T01:42:50.946757+0000 2023-11-04T01:44:25.268 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/2461924520 2023-11-05T01:40:15.032018+0000 2023-11-04T01:44:25.268 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/3287638895 2023-11-05T01:41:58.941997+0000 2023-11-04T01:44:25.268 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/2720398401 2023-11-05T01:43:41.768312+0000 2023-11-04T01:44:25.268 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/2069525699 2023-11-05T01:42:05.849526+0000 2023-11-04T01:44:25.268 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.1:0/1480686415 2023-11-04T02:43:49.496043+0000 2023-11-04T01:44:25.268 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/2252282753 2023-11-05T01:40:40.408324+0000 2023-11-04T01:44:25.268 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/2252282753 2023-11-05T01:40:40.408324+0000 2023-11-04T01:44:25.268 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/2461924520 2023-11-05T01:40:15.032018+0000 2023-11-04T01:44:25.268 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.1:0/780133444 2023-11-04T02:42:14.050728+0000 2023-11-04T01:44:25.268 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/1627866359 2023-11-05T01:41:31.011032+0000 2023-11-04T01:44:25.269 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/1627866359 2023-11-05T01:41:31.011032+0000 2023-11-04T01:44:25.269 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/3065829953 2023-11-05T01:41:05.691698+0000 2023-11-04T01:44:25.269 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/3287638895 2023-11-05T01:41:58.941997+0000 2023-11-04T01:44:25.269 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/3065829953 2023-11-05T01:41:05.691698+0000 2023-11-04T01:44:25.269 INFO:teuthology.orchestra.run.smithi044.stderr:listed 23 entries 2023-11-04T01:44:25.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.267+0000 7ff6baac2640 1 -- 172.21.15.44:0/4082756998 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6a006ae70 msgr2=0x7ff6a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.267+0000 7ff6baac2640 1 --2- 172.21.15.44:0/4082756998 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6a006ae70 0x7ff6a006d330 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8001b90 tx=0x7ff6a8009040 comp rx=0 tx=0).stop 2023-11-04T01:44:25.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.267+0000 7ff6baac2640 1 -- 172.21.15.44:0/4082756998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6b40afda0 msgr2=0x7ff6b4155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.267+0000 7ff6baac2640 1 --2- 172.21.15.44:0/4082756998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6b40afda0 0x7ff6b4155c30 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40098b0 tx=0x7ff6a40046c0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.267+0000 7ff6baac2640 1 -- 172.21.15.44:0/4082756998 shutdown_connections 2023-11-04T01:44:25.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.267+0000 7ff6baac2640 1 --2- 172.21.15.44:0/4082756998 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff6a006ae70 0x7ff6a006d330 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.267+0000 7ff6baac2640 1 --2- 172.21.15.44:0/4082756998 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6b415b200 0x7ff6b4155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.267+0000 7ff6baac2640 1 --2- 172.21.15.44:0/4082756998 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6b40cd9c0 0x7ff6b415b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.267+0000 7ff6baac2640 1 --2- 172.21.15.44:0/4082756998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6b40afda0 0x7ff6b4155c30 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.267+0000 7ff6baac2640 1 -- 172.21.15.44:0/4082756998 >> 172.21.15.44:0/4082756998 conn(0x7ff6b40d0c30 msgr2=0x7ff6b40d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.267+0000 7ff6baac2640 1 -- 172.21.15.44:0/4082756998 shutdown_connections 2023-11-04T01:44:25.270 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.267+0000 7ff6baac2640 1 -- 172.21.15.44:0/4082756998 wait complete. 2023-11-04T01:44:25.280 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:44:25.280 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:25.296 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:25.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.440+0000 7f9165e0e640 1 Processor -- start 2023-11-04T01:44:25.442 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.440+0000 7f9165e0e640 1 -- start start 2023-11-04T01:44:25.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.441+0000 7f9165e0e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f91600ceda0 0x7f916015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.441+0000 7f9165e0e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f91600b2210 0x7f916015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.443 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.441+0000 7f9165e0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91600cf180 0x7f91600cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.441+0000 7f9165e0e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91600b1df0 con 0x7f91600b2210 2023-11-04T01:44:25.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.441+0000 7f9165e0e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916015d9a0 con 0x7f91600ceda0 2023-11-04T01:44:25.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.441+0000 7f9165e0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91600b0150 con 0x7f91600cf180 2023-11-04T01:44:25.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.441+0000 7f915effd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f91600b2210 0x7f916015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.441+0000 7f915effd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f91600b2210 0x7f916015d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51358/0 (socket says 172.21.15.44:51358) 2023-11-04T01:44:25.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.441+0000 7f915effd640 1 -- 172.21.15.44:0/3835946021 learned_addr learned my addr 172.21.15.44:0/3835946021 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:25.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.441+0000 7f915f7fe640 1 --2- 172.21.15.44:0/3835946021 >> v2:172.21.15.204:3300/0 conn(0x7f91600ceda0 0x7f916015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.441+0000 7f915ffff640 1 --2- 172.21.15.44:0/3835946021 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91600cf180 0x7f91600cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.442+0000 7f915effd640 1 -- 172.21.15.44:0/3835946021 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91600cf180 msgr2=0x7f91600cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.442+0000 7f915effd640 1 --2- 172.21.15.44:0/3835946021 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91600cf180 0x7f91600cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.442+0000 7f915effd640 1 -- 172.21.15.44:0/3835946021 >> v2:172.21.15.204:3300/0 conn(0x7f91600ceda0 msgr2=0x7f916015cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.442+0000 7f915effd640 1 --2- 172.21.15.44:0/3835946021 >> v2:172.21.15.204:3300/0 conn(0x7f91600ceda0 0x7f916015cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.444 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.442+0000 7f915effd640 1 -- 172.21.15.44:0/3835946021 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91600b1170 con 0x7f91600b2210 2023-11-04T01:44:25.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.442+0000 7f915effd640 1 --2- 172.21.15.44:0/3835946021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600b2210 0x7f916015d460 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f9160070130 tx=0x7f915402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce1ae807589ea93 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.445 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.442+0000 7f915e7fc640 1 -- 172.21.15.44:0/3835946021 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91540317e0 con 0x7f91600b2210 2023-11-04T01:44:25.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.443+0000 7f915e7fc640 1 -- 172.21.15.44:0/3835946021 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9154031940 con 0x7f91600b2210 2023-11-04T01:44:25.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.443+0000 7f915e7fc640 1 -- 172.21.15.44:0/3835946021 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9154031cd0 con 0x7f91600b2210 2023-11-04T01:44:25.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.443+0000 7f9165e0e640 1 -- 172.21.15.44:0/3835946021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600b2210 msgr2=0x7f916015d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.443+0000 7f9165e0e640 1 --2- 172.21.15.44:0/3835946021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600b2210 0x7f916015d460 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f9160070130 tx=0x7f915402b880 comp rx=0 tx=0).stop 2023-11-04T01:44:25.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.443+0000 7f9165e0e640 1 -- 172.21.15.44:0/3835946021 shutdown_connections 2023-11-04T01:44:25.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.443+0000 7f9165e0e640 1 --2- 172.21.15.44:0/3835946021 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91600cf180 0x7f91600cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.443+0000 7f9165e0e640 1 --2- 172.21.15.44:0/3835946021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600b2210 0x7f916015d460 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.443+0000 7f9165e0e640 1 --2- 172.21.15.44:0/3835946021 >> v2:172.21.15.204:3300/0 conn(0x7f91600ceda0 0x7f916015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.443+0000 7f9165e0e640 1 -- 172.21.15.44:0/3835946021 >> 172.21.15.44:0/3835946021 conn(0x7f91600d0c30 msgr2=0x7f91600d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.443+0000 7f9165e0e640 1 -- 172.21.15.44:0/3835946021 shutdown_connections 2023-11-04T01:44:25.446 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.443+0000 7f9165e0e640 1 -- 172.21.15.44:0/3835946021 wait complete. 2023-11-04T01:44:25.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.444+0000 7f9165e0e640 1 Processor -- start 2023-11-04T01:44:25.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.444+0000 7f9165e0e640 1 -- start start 2023-11-04T01:44:25.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.445+0000 7f9165e0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91600b2210 0x7f91600cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.445+0000 7f9165e0e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91600ceda0 0x7f9160157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.445+0000 7f9165e0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600cf180 0x7f91601582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.448 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.445+0000 7f9165e0e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91600ce250 con 0x7f91600cf180 2023-11-04T01:44:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.445+0000 7f9165e0e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91600c8a70 con 0x7f91600ceda0 2023-11-04T01:44:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.445+0000 7f9165e0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91600cb400 con 0x7f91600b2210 2023-11-04T01:44:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.445+0000 7f915ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600cf180 0x7f91601582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.445+0000 7f915ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600cf180 0x7f91601582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51362/0 (socket says 172.21.15.44:51362) 2023-11-04T01:44:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.445+0000 7f915ffff640 1 -- 172.21.15.44:0/162388682 learned_addr learned my addr 172.21.15.44:0/162388682 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.445+0000 7f915effd640 1 --2- 172.21.15.44:0/162388682 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91600ceda0 0x7f9160157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.445+0000 7f915f7fe640 1 --2- 172.21.15.44:0/162388682 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91600b2210 0x7f91600cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.446+0000 7f915ffff640 1 -- 172.21.15.44:0/162388682 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91600b2210 msgr2=0x7f91600cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.446+0000 7f915ffff640 1 --2- 172.21.15.44:0/162388682 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91600b2210 0x7f91600cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.446+0000 7f915ffff640 1 -- 172.21.15.44:0/162388682 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91600ceda0 msgr2=0x7f9160157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.446+0000 7f915ffff640 1 --2- 172.21.15.44:0/162388682 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91600ceda0 0x7f9160157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.446+0000 7f915ffff640 1 -- 172.21.15.44:0/162388682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91540094d0 con 0x7f91600cf180 2023-11-04T01:44:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.446+0000 7f915ffff640 1 --2- 172.21.15.44:0/162388682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600cf180 0x7f91601582c0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f9158007e60 tx=0x7f915800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.446+0000 7f9147fff640 1 -- 172.21.15.44:0/162388682 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158014420 con 0x7f91600cf180 2023-11-04T01:44:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.446+0000 7f9147fff640 1 -- 172.21.15.44:0/162388682 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91580145a0 con 0x7f91600cf180 2023-11-04T01:44:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.446+0000 7f9165e0e640 1 -- 172.21.15.44:0/162388682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91600cb6e0 con 0x7f91600cf180 2023-11-04T01:44:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.446+0000 7f9147fff640 1 -- 172.21.15.44:0/162388682 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158014950 con 0x7f91600cf180 2023-11-04T01:44:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.446+0000 7f9165e0e640 1 -- 172.21.15.44:0/162388682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91600cbca0 con 0x7f91600cf180 2023-11-04T01:44:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.447+0000 7f9165e0e640 1 -- 172.21.15.44:0/162388682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91600adc80 con 0x7f91600cf180 2023-11-04T01:44:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.447+0000 7f9147fff640 1 -- 172.21.15.44:0/162388682 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9158014ab0 con 0x7f91600cf180 2023-11-04T01:44:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.448+0000 7f9147fff640 1 --2- 172.21.15.44:0/162388682 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f914c06ae70 0x7f914c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.448+0000 7f9147fff640 1 -- 172.21.15.44:0/162388682 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f915808a9a0 con 0x7f91600cf180 2023-11-04T01:44:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.448+0000 7f915f7fe640 1 --2- 172.21.15.44:0/162388682 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f914c06ae70 0x7f914c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.448+0000 7f915f7fe640 1 --2- 172.21.15.44:0/162388682 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f914c06ae70 0x7f914c06d330 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f91500096f0 tx=0x7f9150008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.453 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.452+0000 7f9147fff640 1 -- 172.21.15.44:0/162388682 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9158055010 con 0x7f91600cf180 2023-11-04T01:44:25.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.631+0000 7f9165e0e640 1 -- 172.21.15.44:0/162388682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91600684b0 con 0x7f91600cf180 2023-11-04T01:44:25.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.633+0000 7f9147fff640 1 -- 172.21.15.44:0/162388682 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+23611 (secure 0 0 0) 0x7f9158058630 con 0x7f91600cf180 2023-11-04T01:44:25.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-04T01:44:25.635 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":116,"fsid":"2b7a45c6-da06-445f-a890-41d4c08fab63","created":"2023-11-04T01:35:34.412775+0000","modified":"2023-11-04T01:44:09.255943+0000","last_up_change":"2023-11-04T01:35:45.611922+0000","last_in_change":"2023-11-04T01:35:36.632212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:46.628752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:34.090138+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:34.917670+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:35.547044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:28.109628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:28.871834+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":14,"snap_epoch":115,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7c4ed99-d914-4974-ab13-976c53a2abac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6809","nonce":1954602164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6811","nonce":1954602164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6818","nonce":1954602164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1954602164},{"type":"v1","addr":"172.21.15.44:6814","nonce":1954602164}]},"public_addr":"172.21.15.44:6809/1954602164","cluster_addr":"172.21.15.44:6811/1954602164","heartbeat_back_addr":"172.21.15.44:6818/1954602164","heartbeat_front_addr":"172.21.15.44:6814/1954602164","state":["exists","up"]},{"osd":1,"uuid":"96f60c83-df87-430c-b3e8-d66930e4226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6815","nonce":552281303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6819","nonce":552281303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6826","nonce":552281303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":552281303},{"type":"v1","addr":"172.21.15.44:6822","nonce":552281303}]},"public_addr":"172.21.15.44:6815/552281303","cluster_addr":"172.21.15.44:6819/552281303","heartbeat_back_addr":"172.21.15.44:6826/552281303","heartbeat_front_addr":"172.21.15.44:6822/552281303","state":["exists","up"]},{"osd":2,"uuid":"987bc08b-dd93-41d4-8312-c9e84b85601a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6801","nonce":1729035934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6803","nonce":1729035934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6807","nonce":1729035934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1729035934},{"type":"v1","addr":"172.21.15.44:6805","nonce":1729035934}]},"public_addr":"172.21.15.44:6801/1729035934","cluster_addr":"172.21.15.44:6803/1729035934","heartbeat_back_addr":"172.21.15.44:6807/1729035934","heartbeat_front_addr":"172.21.15.44:6805/1729035934","state":["exists","up"]},{"osd":3,"uuid":"8462d2a1-5469-43ca-bb61-91f1b8bab927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6823","nonce":1819620447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6825","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6827","nonce":1819620447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6831","nonce":1819620447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1819620447},{"type":"v1","addr":"172.21.15.44:6829","nonce":1819620447}]},"public_addr":"172.21.15.44:6823/1819620447","cluster_addr":"172.21.15.44:6827/1819620447","heartbeat_back_addr":"172.21.15.44:6831/1819620447","heartbeat_front_addr":"172.21.15.44:6829/1819620447","state":["exists","up"]},{"osd":4,"uuid":"a07eebf6-3f57-423f-9c66-8ba81f589518","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6809","nonce":3863721351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6811","nonce":3863721351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6815","nonce":3863721351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3863721351},{"type":"v1","addr":"172.21.15.204:6813","nonce":3863721351}]},"public_addr":"172.21.15.204:6809/3863721351","cluster_addr":"172.21.15.204:6811/3863721351","heartbeat_back_addr":"172.21.15.204:6815/3863721351","heartbeat_front_addr":"172.21.15.204:6813/3863721351","state":["exists","up"]},{"osd":5,"uuid":"7a765025-8353-458f-8701-7586a08cda40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6820","nonce":2748716086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6824","nonce":2748716086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6831","nonce":2748716086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2748716086},{"type":"v1","addr":"172.21.15.204:6828","nonce":2748716086}]},"public_addr":"172.21.15.204:6820/2748716086","cluster_addr":"172.21.15.204:6824/2748716086","heartbeat_back_addr":"172.21.15.204:6831/2748716086","heartbeat_front_addr":"172.21.15.204:6828/2748716086","state":["exists","up"]},{"osd":6,"uuid":"362f45a3-c13d-4841-99a0-53061c1f6f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6801","nonce":1041839871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6803","nonce":1041839871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6807","nonce":1041839871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1041839871},{"type":"v1","addr":"172.21.15.204:6805","nonce":1041839871}]},"public_addr":"172.21.15.204:6801/1041839871","cluster_addr":"172.21.15.204:6803/1041839871","heartbeat_back_addr":"172.21.15.204:6807/1041839871","heartbeat_front_addr":"172.21.15.204:6805/1041839871","state":["exists","up"]},{"osd":7,"uuid":"92b3dafa-ee64-4400-a716-a8818f4b1da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6817","nonce":1835235423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6821","nonce":1835235423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6829","nonce":1835235423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":1835235423},{"type":"v1","addr":"172.21.15.204:6825","nonce":1835235423}]},"public_addr":"172.21.15.204:6817/1835235423","cluster_addr":"172.21.15.204:6821/1835235423","heartbeat_back_addr":"172.21.15.204:6829/1835235423","heartbeat_front_addr":"172.21.15.204:6825/1835235423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.764359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.776504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.800733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.838525+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.814542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.817339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.730615+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:41.798640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":2}]},{"pgid":"17.37","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/2720398401":"2023-11-05T01:43:41.768312+0000","192.168.0.1:0/1398028154":"2023-11-04T02:42:59.149511+0000","172.21.15.204:6836/3267689413":"2023-11-05T01:42:50.946757+0000","172.21.15.44:6835/3264332323":"2023-11-05T01:42:44.043453+0000","172.21.15.44:6832/22987540":"2023-11-05T01:43:34.391624+0000","172.21.15.44:6833/3264332323":"2023-11-05T01:42:44.043453+0000","172.21.15.44:6832/2069525699":"2023-11-05T01:42:05.849526+0000","172.21.15.44:6834/22987540":"2023-11-05T01:43:34.391624+0000","172.21.15.204:6834/3267689413":"2023-11-05T01:42:50.946757+0000","172.21.15.204:6836/2461924520":"2023-11-05T01:40:15.032018+0000","172.21.15.204:6834/3287638895":"2023-11-05T01:41:58.941997+0000","172.21.15.44:6833/2720398401":"2023-11-05T01:43:41.768312+0000","172.21.15.44:6834/2069525699":"2023-11-05T01:42:05.849526+0000","192.168.0.1:0/1480686415":"2023-11-04T02:43:49.496043+0000","172.21.15.44:6833/2252282753":"2023-11-05T01:40:40.408324+0000","172.21.15.44:6835/2252282753":"2023-11-05T01:40:40.408324+0000","172.21.15.204:6834/2461924520":"2023-11-05T01:40:15.032018+0000","192.168.0.1:0/780133444":"2023-11-04T02:42:14.050728+0000","172.21.15.44:6835/1627866359":"2023-11-05T01:41:31.011032+0000","172.21.15.44:6833/1627866359":"2023-11-05T01:41:31.011032+0000","172.21.15.204:6834/3065829953":"2023-11-05T01:41:05.691698+0000","172.21.15.204:6836/3287638895":"2023-11-05T01:41:58.941997+0000","172.21.15.204:6836/3065829953":"2023-11-05T01:41:05.691698+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":11,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:25.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.635+0000 7f9165e0e640 1 -- 172.21.15.44:0/162388682 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f914c06ae70 msgr2=0x7f914c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.635+0000 7f9165e0e640 1 --2- 172.21.15.44:0/162388682 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f914c06ae70 0x7f914c06d330 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f91500096f0 tx=0x7f9150008040 comp rx=0 tx=0).stop 2023-11-04T01:44:25.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.635+0000 7f9165e0e640 1 -- 172.21.15.44:0/162388682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600cf180 msgr2=0x7f91601582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.635+0000 7f9165e0e640 1 --2- 172.21.15.44:0/162388682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600cf180 0x7f91601582c0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f9158007e60 tx=0x7f915800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.635+0000 7f9165e0e640 1 -- 172.21.15.44:0/162388682 shutdown_connections 2023-11-04T01:44:25.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.635+0000 7f9165e0e640 1 --2- 172.21.15.44:0/162388682 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f914c06ae70 0x7f914c06d330 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.635+0000 7f9165e0e640 1 --2- 172.21.15.44:0/162388682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600cf180 0x7f91601582c0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.635+0000 7f9165e0e640 1 --2- 172.21.15.44:0/162388682 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91600ceda0 0x7f9160157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.637 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.635+0000 7f9165e0e640 1 --2- 172.21.15.44:0/162388682 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91600b2210 0x7f91600cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.635+0000 7f9165e0e640 1 -- 172.21.15.44:0/162388682 >> 172.21.15.44:0/162388682 conn(0x7f91600d0c30 msgr2=0x7f916015c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.635+0000 7f9165e0e640 1 -- 172.21.15.44:0/162388682 shutdown_connections 2023-11-04T01:44:25.638 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.635+0000 7f9165e0e640 1 -- 172.21.15.44:0/162388682 wait complete. 2023-11-04T01:44:25.648 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:46.628752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:34.090138+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:34.917670+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:35.547044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:28.109628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:28.871834+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 115, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:44:25.648 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:44:25.757 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.756+0000 7f47d114c640 1 Processor -- start 2023-11-04T01:44:25.758 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.756+0000 7f47d114c640 1 -- start start 2023-11-04T01:44:25.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47d114c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47cc0addd0 0x7f47cc0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47d114c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f47cc0cc680 0x7f47cc0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47d114c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc0cd720 con 0x7f47cc06bb10 2023-11-04T01:44:25.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47d114c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47cc0ae1b0 con 0x7f47cc0cc680 2023-11-04T01:44:25.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47d114c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0ccb10 con 0x7f47cc0addd0 2023-11-04T01:44:25.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47cb59e640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f47cc06bb10 0x7f47cc06f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39370/0 (socket says 172.21.15.44:39370) 2023-11-04T01:44:25.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47cb59e640 1 -- 172.21.15.44:0/1256978108 learned_addr learned my addr 172.21.15.44:0/1256978108 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:44:25.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47cad9d640 1 --2- 172.21.15.44:0/1256978108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47cc0addd0 0x7f47cc0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47c259c640 1 --2- 172.21.15.44:0/1256978108 >> v2:172.21.15.204:3300/0 conn(0x7f47cc0cc680 0x7f47cc0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 -- 172.21.15.44:0/1256978108 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589136760 0 0) 0x7f47cc0cd720 con 0x7f47cc06bb10 2023-11-04T01:44:25.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 -- 172.21.15.44:0/1256978108 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47ac003520 con 0x7f47cc06bb10 2023-11-04T01:44:25.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 -- 172.21.15.44:0/1256978108 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2333166550 0 0) 0x7f47ac003520 con 0x7f47cc06bb10 2023-11-04T01:44:25.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 -- 172.21.15.44:0/1256978108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47cc0addd0 msgr2=0x7f47cc0cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 --2- 172.21.15.44:0/1256978108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47cc0addd0 0x7f47cc0cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 -- 172.21.15.44:0/1256978108 >> v2:172.21.15.204:3300/0 conn(0x7f47cc0cc680 msgr2=0x7f47cc0ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 --2- 172.21.15.44:0/1256978108 >> v2:172.21.15.204:3300/0 conn(0x7f47cc0cc680 0x7f47cc0ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 -- 172.21.15.44:0/1256978108 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc0ccdf0 con 0x7f47cc06bb10 2023-11-04T01:44:25.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 -- 172.21.15.44:0/1256978108 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f47c40019f0 con 0x7f47cc06bb10 2023-11-04T01:44:25.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 -- 172.21.15.44:0/1256978108 >> v1:172.21.15.44:6789/0 conn(0x7f47cc06bb10 legacy=0x7f47cc06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 --2- 172.21.15.44:0/1256978108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47cc0addd0 0x7f47ac003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 --2- 172.21.15.44:0/1256978108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47ac003ef0 0x7f47ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 --2- 172.21.15.44:0/1256978108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47ac004d00 0x7f47ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 -- 172.21.15.44:0/1256978108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0ae1b0 con 0x7f47ac003ef0 2023-11-04T01:44:25.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 -- 172.21.15.44:0/1256978108 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0ccb10 con 0x7f47ac004d00 2023-11-04T01:44:25.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.757+0000 7f47ca59c640 1 -- 172.21.15.44:0/1256978108 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac00b980 con 0x7f47cc0addd0 2023-11-04T01:44:25.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.758+0000 7f47c259c640 1 --2- 172.21.15.44:0/1256978108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47ac003ef0 0x7f47ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.758+0000 7f47cad9d640 1 --2- 172.21.15.44:0/1256978108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47cc0addd0 0x7f47ac003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.758+0000 7f47cb59e640 1 --2- 172.21.15.44:0/1256978108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47ac004d00 0x7f47ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.758+0000 7f47c259c640 1 -- 172.21.15.44:0/1256978108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47cc0addd0 msgr2=0x7f47ac003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.758+0000 7f47c259c640 1 --2- 172.21.15.44:0/1256978108 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47cc0addd0 0x7f47ac003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.758+0000 7f47c259c640 1 -- 172.21.15.44:0/1256978108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47ac004d00 msgr2=0x7f47ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.758+0000 7f47c259c640 1 --2- 172.21.15.44:0/1256978108 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47ac004d00 0x7f47ac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.758+0000 7f47c259c640 1 -- 172.21.15.44:0/1256978108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ac003520 con 0x7f47ac003ef0 2023-11-04T01:44:25.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.759+0000 7f47c259c640 1 --2- 172.21.15.44:0/1256978108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47ac003ef0 0x7f47ac0047c0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f47b400aa40 tx=0x7f47ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a695ad66bf051d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.759+0000 7f47ca59c640 1 -- 172.21.15.44:0/1256978108 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b402cbe0 con 0x7f47ac003ef0 2023-11-04T01:44:25.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.759+0000 7f47ca59c640 1 -- 172.21.15.44:0/1256978108 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b402cd40 con 0x7f47ac003ef0 2023-11-04T01:44:25.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.759+0000 7f47ca59c640 1 -- 172.21.15.44:0/1256978108 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4034660 con 0x7f47ac003ef0 2023-11-04T01:44:25.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.759+0000 7f47d114c640 1 -- 172.21.15.44:0/1256978108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47ac003ef0 msgr2=0x7f47ac0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.759+0000 7f47d114c640 1 --2- 172.21.15.44:0/1256978108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47ac003ef0 0x7f47ac0047c0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f47b400aa40 tx=0x7f47ac0057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.759+0000 7f47cb59e640 1 -- 172.21.15.44:0/1256978108 reap_dead start 2023-11-04T01:44:25.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.759+0000 7f47d114c640 1 -- 172.21.15.44:0/1256978108 shutdown_connections 2023-11-04T01:44:25.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.759+0000 7f47d114c640 1 -- 172.21.15.44:0/1256978108 >> 172.21.15.44:0/1256978108 conn(0x7f47cc0cb530 msgr2=0x7f47cc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.759+0000 7f47d114c640 1 -- 172.21.15.44:0/1256978108 shutdown_connections 2023-11-04T01:44:25.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.759+0000 7f47d114c640 1 -- 172.21.15.44:0/1256978108 wait complete. 2023-11-04T01:44:25.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.761+0000 7f47d114c640 1 Processor -- start 2023-11-04T01:44:25.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.761+0000 7f47d114c640 1 -- start start 2023-11-04T01:44:25.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47d114c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47ac003ef0 0x7f47cc1f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47d114c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47cc0b4190 0x7f47cc1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47d114c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47cc1f2d80 0x7f47cc0ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47d114c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc156600 con 0x7f47ac003ef0 2023-11-04T01:44:25.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47d114c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0c6ef0 con 0x7f47cc0b4190 2023-11-04T01:44:25.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47d114c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc1f3ee0 con 0x7f47cc1f2d80 2023-11-04T01:44:25.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47cad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47ac003ef0 0x7f47cc1f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47cad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47ac003ef0 0x7f47cc1f4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51382/0 (socket says 172.21.15.44:51382) 2023-11-04T01:44:25.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47cad9d640 1 -- 172.21.15.44:0/3777558842 learned_addr learned my addr 172.21.15.44:0/3777558842 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:25.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47cb59e640 1 --2- 172.21.15.44:0/3777558842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47cc1f2d80 0x7f47cc0ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47c259c640 1 --2- 172.21.15.44:0/3777558842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47cc0b4190 0x7f47cc1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47cad9d640 1 -- 172.21.15.44:0/3777558842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47cc1f2d80 msgr2=0x7f47cc0ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47cad9d640 1 --2- 172.21.15.44:0/3777558842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47cc1f2d80 0x7f47cc0ac900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47cad9d640 1 -- 172.21.15.44:0/3777558842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47cc0b4190 msgr2=0x7f47cc1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47cad9d640 1 --2- 172.21.15.44:0/3777558842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47cc0b4190 0x7f47cc1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47cad9d640 1 -- 172.21.15.44:0/3777558842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc1f3640 con 0x7f47ac003ef0 2023-11-04T01:44:25.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47cad9d640 1 --2- 172.21.15.44:0/3777558842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47ac003ef0 0x7f47cc1f4210 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0119d0 tx=0x7f47bc011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47c3fff640 1 -- 172.21.15.44:0/3777558842 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc00fb50 con 0x7f47ac003ef0 2023-11-04T01:44:25.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47c3fff640 1 -- 172.21.15.44:0/3777558842 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc00fcb0 con 0x7f47ac003ef0 2023-11-04T01:44:25.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47d114c640 1 -- 172.21.15.44:0/3777558842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc1f3920 con 0x7f47ac003ef0 2023-11-04T01:44:25.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47c3fff640 1 -- 172.21.15.44:0/3777558842 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc014440 con 0x7f47ac003ef0 2023-11-04T01:44:25.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.762+0000 7f47d114c640 1 -- 172.21.15.44:0/3777558842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc1f3200 con 0x7f47ac003ef0 2023-11-04T01:44:25.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.763+0000 7f47d114c640 1 -- 172.21.15.44:0/3777558842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc0c6cc0 con 0x7f47ac003ef0 2023-11-04T01:44:25.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.764+0000 7f47c3fff640 1 -- 172.21.15.44:0/3777558842 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47bc01d400 con 0x7f47ac003ef0 2023-11-04T01:44:25.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.764+0000 7f47c3fff640 1 --2- 172.21.15.44:0/3777558842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f47b006ae70 0x7f47b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.764+0000 7f47c3fff640 1 -- 172.21.15.44:0/3777558842 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f47bc08a770 con 0x7f47ac003ef0 2023-11-04T01:44:25.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.765+0000 7f47c259c640 1 --2- 172.21.15.44:0/3777558842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f47b006ae70 0x7f47b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.765+0000 7f47c259c640 1 --2- 172.21.15.44:0/3777558842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f47b006ae70 0x7f47b006d330 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f47b4036000 tx=0x7f47b4030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.768+0000 7f47c3fff640 1 -- 172.21.15.44:0/3777558842 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47cc0c6cc0 con 0x7f47ac003ef0 2023-11-04T01:44:25.946 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.945+0000 7f47d114c640 1 -- 172.21.15.44:0/3777558842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47cc0c6cc0 con 0x7f47ac003ef0 2023-11-04T01:44:25.947 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.945+0000 7f47c3fff640 1 -- 172.21.15.44:0/3777558842 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7f47cc0c6cc0 con 0x7f47ac003ef0 2023-11-04T01:44:25.947 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2023-11-04T01:44:25.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.947+0000 7f47d114c640 1 -- 172.21.15.44:0/3777558842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f47b006ae70 msgr2=0x7f47b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.947+0000 7f47d114c640 1 --2- 172.21.15.44:0/3777558842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f47b006ae70 0x7f47b006d330 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f47b4036000 tx=0x7f47b4030000 comp rx=0 tx=0).stop 2023-11-04T01:44:25.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.947+0000 7f47d114c640 1 -- 172.21.15.44:0/3777558842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47ac003ef0 msgr2=0x7f47cc1f4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.947+0000 7f47d114c640 1 --2- 172.21.15.44:0/3777558842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47ac003ef0 0x7f47cc1f4210 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0119d0 tx=0x7f47bc011e90 comp rx=0 tx=0).stop 2023-11-04T01:44:25.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.947+0000 7f47d114c640 1 -- 172.21.15.44:0/3777558842 shutdown_connections 2023-11-04T01:44:25.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.947+0000 7f47d114c640 1 --2- 172.21.15.44:0/3777558842 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f47b006ae70 0x7f47b006d330 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.947+0000 7f47d114c640 1 --2- 172.21.15.44:0/3777558842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47cc1f2d80 0x7f47cc0ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.949 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.947+0000 7f47d114c640 1 --2- 172.21.15.44:0/3777558842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47cc0b4190 0x7f47cc1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.947+0000 7f47d114c640 1 --2- 172.21.15.44:0/3777558842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47ac003ef0 0x7f47cc1f4210 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.947+0000 7f47d114c640 1 -- 172.21.15.44:0/3777558842 >> 172.21.15.44:0/3777558842 conn(0x7f47cc0cb530 msgr2=0x7f47cc070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.947+0000 7f47d114c640 1 -- 172.21.15.44:0/3777558842 shutdown_connections 2023-11-04T01:44:25.950 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:25.947+0000 7f47d114c640 1 -- 172.21.15.44:0/3777558842 wait complete. 2023-11-04T01:44:25.959 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:44:26.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.066+0000 7f3c5a2c2640 1 Processor -- start 2023-11-04T01:44:26.068 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.066+0000 7f3c5a2c2640 1 -- start start 2023-11-04T01:44:26.069 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.067+0000 7f3c5a2c2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3c540ceda0 0x7f3c5415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.067+0000 7f3c5a2c2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c540b0150 con 0x7f3c540b2210 2023-11-04T01:44:26.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.067+0000 7f3c5a2c2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c540b1170 con 0x7f3c540cf890 2023-11-04T01:44:26.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.067+0000 7f3c5a2c2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c540b1df0 con 0x7f3c540ceda0 2023-11-04T01:44:26.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.067+0000 7f3c537fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3c540b2210 0x7f3c540cf180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39382/0 (socket says 172.21.15.44:39382) 2023-11-04T01:44:26.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.067+0000 7f3c537fe640 1 -- 172.21.15.44:0/3957092007 learned_addr learned my addr 172.21.15.44:0/3957092007 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:44:26.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.067+0000 7f3c53fff640 1 --2- 172.21.15.44:0/3957092007 >> v2:172.21.15.204:3300/0 conn(0x7f3c540ceda0 0x7f3c5415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.067+0000 7f3c52ffd640 1 -- 172.21.15.44:0/3957092007 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350886997 0 0) 0x7f3c540b0150 con 0x7f3c540b2210 2023-11-04T01:44:26.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.068+0000 7f3c52ffd640 1 -- 172.21.15.44:0/3957092007 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c3c003520 con 0x7f3c540b2210 2023-11-04T01:44:26.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.068+0000 7f3c53fff640 1 -- 172.21.15.44:0/3957092007 >> v1:172.21.15.204:6789/0 conn(0x7f3c540cf890 legacy=0x7f3c5406b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.068+0000 7f3c53fff640 1 -- 172.21.15.44:0/3957092007 >> v1:172.21.15.44:6789/0 conn(0x7f3c540b2210 legacy=0x7f3c540cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.070 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.068+0000 7f3c52ffd640 1 -- 172.21.15.44:0/3957092007 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1038101543 0 0) 0x7f3c3c003520 con 0x7f3c540b2210 2023-11-04T01:44:26.071 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.068+0000 7f3c53fff640 1 -- 172.21.15.44:0/3957092007 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c540b1450 con 0x7f3c540ceda0 2023-11-04T01:44:26.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.069+0000 7f3c53fff640 1 --2- 172.21.15.44:0/3957092007 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c540ceda0 0x7f3c5415cf20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009790 tx=0x7f3c4802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2496c2e3b95134b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.069+0000 7f3c52ffd640 1 -- 172.21.15.44:0/3957092007 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44001670 con 0x7f3c540ceda0 2023-11-04T01:44:26.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.069+0000 7f3c52ffd640 1 -- 172.21.15.44:0/3957092007 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4802e050 con 0x7f3c540ceda0 2023-11-04T01:44:26.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.069+0000 7f3c52ffd640 1 -- 172.21.15.44:0/3957092007 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48030710 con 0x7f3c540ceda0 2023-11-04T01:44:26.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.069+0000 7f3c5a2c2640 1 -- 172.21.15.44:0/3957092007 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c540ceda0 msgr2=0x7f3c5415cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.069+0000 7f3c5a2c2640 1 --2- 172.21.15.44:0/3957092007 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c540ceda0 0x7f3c5415cf20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009790 tx=0x7f3c4802b790 comp rx=0 tx=0).stop 2023-11-04T01:44:26.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.069+0000 7f3c5a2c2640 1 -- 172.21.15.44:0/3957092007 shutdown_connections 2023-11-04T01:44:26.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.069+0000 7f3c5a2c2640 1 --2- 172.21.15.44:0/3957092007 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c540ceda0 0x7f3c5415cf20 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.069+0000 7f3c5a2c2640 1 -- 172.21.15.44:0/3957092007 >> 172.21.15.44:0/3957092007 conn(0x7f3c540d0c30 msgr2=0x7f3c540d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:26.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.069+0000 7f3c5a2c2640 1 -- 172.21.15.44:0/3957092007 shutdown_connections 2023-11-04T01:44:26.072 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.069+0000 7f3c5a2c2640 1 -- 172.21.15.44:0/3957092007 wait complete. 2023-11-04T01:44:26.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.070+0000 7f3c5a2c2640 1 Processor -- start 2023-11-04T01:44:26.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.071+0000 7f3c5a2c2640 1 -- start start 2023-11-04T01:44:26.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.071+0000 7f3c5a2c2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c540b2210 0x7f3c540c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.071+0000 7f3c5a2c2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c540ceda0 0x7f3c540cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.071+0000 7f3c5a2c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c540cf890 0x7f3c54153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.071+0000 7f3c5a2c2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540c8d20 con 0x7f3c540cf890 2023-11-04T01:44:26.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.071+0000 7f3c5a2c2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540cc060 con 0x7f3c540ceda0 2023-11-04T01:44:26.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.071+0000 7f3c5a2c2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c541f39c0 con 0x7f3c540b2210 2023-11-04T01:44:26.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.071+0000 7f3c5885f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c540cf890 0x7f3c54153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.072+0000 7f3c5885f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c540cf890 0x7f3c54153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51394/0 (socket says 172.21.15.44:51394) 2023-11-04T01:44:26.075 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.072+0000 7f3c5885f640 1 -- 172.21.15.44:0/3897555097 learned_addr learned my addr 172.21.15.44:0/3897555097 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:26.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.072+0000 7f3c537fe640 1 --2- 172.21.15.44:0/3897555097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c540ceda0 0x7f3c540cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.072+0000 7f3c53fff640 1 --2- 172.21.15.44:0/3897555097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c540b2210 0x7f3c540c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.072+0000 7f3c5885f640 1 -- 172.21.15.44:0/3897555097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c540b2210 msgr2=0x7f3c540c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.072+0000 7f3c5885f640 1 --2- 172.21.15.44:0/3897555097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c540b2210 0x7f3c540c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.072+0000 7f3c5885f640 1 -- 172.21.15.44:0/3897555097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c540ceda0 msgr2=0x7f3c540cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.072+0000 7f3c5885f640 1 --2- 172.21.15.44:0/3897555097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c540ceda0 0x7f3c540cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.072+0000 7f3c5885f640 1 -- 172.21.15.44:0/3897555097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c480093a0 con 0x7f3c540cf890 2023-11-04T01:44:26.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.072+0000 7f3c5885f640 1 --2- 172.21.15.44:0/3897555097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c540cf890 0x7f3c54153a70 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00c7a0 tx=0x7f3c4c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.072+0000 7f3c50ff9640 1 -- 172.21.15.44:0/3897555097 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c003b70 con 0x7f3c540cf890 2023-11-04T01:44:26.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.072+0000 7f3c50ff9640 1 -- 172.21.15.44:0/3897555097 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c003cf0 con 0x7f3c540cf890 2023-11-04T01:44:26.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.072+0000 7f3c50ff9640 1 -- 172.21.15.44:0/3897555097 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c003ea0 con 0x7f3c540cf890 2023-11-04T01:44:26.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.072+0000 7f3c5a2c2640 1 -- 172.21.15.44:0/3897555097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c541f3ca0 con 0x7f3c540cf890 2023-11-04T01:44:26.076 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.072+0000 7f3c5a2c2640 1 -- 172.21.15.44:0/3897555097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c540c82c0 con 0x7f3c540cf890 2023-11-04T01:44:26.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.073+0000 7f3c5a2c2640 1 -- 172.21.15.44:0/3897555097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c540d03a0 con 0x7f3c540cf890 2023-11-04T01:44:26.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.074+0000 7f3c50ff9640 1 -- 172.21.15.44:0/3897555097 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c4c00aa90 con 0x7f3c540cf890 2023-11-04T01:44:26.077 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.074+0000 7f3c50ff9640 1 --2- 172.21.15.44:0/3897555097 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3c4006ae70 0x7f3c4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.074+0000 7f3c50ff9640 1 -- 172.21.15.44:0/3897555097 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f3c4c089c00 con 0x7f3c540cf890 2023-11-04T01:44:26.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.074+0000 7f3c53fff640 1 --2- 172.21.15.44:0/3897555097 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3c4006ae70 0x7f3c4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.078 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.075+0000 7f3c53fff640 1 --2- 172.21.15.44:0/3897555097 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3c4006ae70 0x7f3c4006d330 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3c48034000 tx=0x7f3c4802f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.080 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.078+0000 7f3c50ff9640 1 -- 172.21.15.44:0/3897555097 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c4c090080 con 0x7f3c540cf890 2023-11-04T01:44:26.256 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.255+0000 7f3c5a2c2640 1 -- 172.21.15.44:0/3897555097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f3c540684b0 con 0x7f3c540cf890 2023-11-04T01:44:26.257 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.255+0000 7f3c50ff9640 1 -- 172.21.15.44:0/3897555097 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v116) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3c4c054450 con 0x7f3c540cf890 2023-11-04T01:44:26.257 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:44:26.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.257+0000 7f3c5a2c2640 1 -- 172.21.15.44:0/3897555097 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3c4006ae70 msgr2=0x7f3c4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.257+0000 7f3c5a2c2640 1 --2- 172.21.15.44:0/3897555097 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3c4006ae70 0x7f3c4006d330 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3c48034000 tx=0x7f3c4802f000 comp rx=0 tx=0).stop 2023-11-04T01:44:26.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.257+0000 7f3c5a2c2640 1 -- 172.21.15.44:0/3897555097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c540cf890 msgr2=0x7f3c54153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.257+0000 7f3c5a2c2640 1 --2- 172.21.15.44:0/3897555097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c540cf890 0x7f3c54153a70 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00c7a0 tx=0x7f3c4c00cc60 comp rx=0 tx=0).stop 2023-11-04T01:44:26.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.257+0000 7f3c5a2c2640 1 -- 172.21.15.44:0/3897555097 shutdown_connections 2023-11-04T01:44:26.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.257+0000 7f3c5a2c2640 1 --2- 172.21.15.44:0/3897555097 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f3c4006ae70 0x7f3c4006d330 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.259 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.257+0000 7f3c5a2c2640 1 --2- 172.21.15.44:0/3897555097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c540cf890 0x7f3c54153a70 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.257+0000 7f3c5a2c2640 1 --2- 172.21.15.44:0/3897555097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c540ceda0 0x7f3c540cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.257+0000 7f3c5a2c2640 1 --2- 172.21.15.44:0/3897555097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c540b2210 0x7f3c540c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.257+0000 7f3c5a2c2640 1 -- 172.21.15.44:0/3897555097 >> 172.21.15.44:0/3897555097 conn(0x7f3c540d0c30 msgr2=0x7f3c5406dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:26.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.257+0000 7f3c5a2c2640 1 -- 172.21.15.44:0/3897555097 shutdown_connections 2023-11-04T01:44:26.260 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.257+0000 7f3c5a2c2640 1 -- 172.21.15.44:0/3897555097 wait complete. 2023-11-04T01:44:26.270 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:44:26.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.377+0000 7f239bef2640 1 Processor -- start 2023-11-04T01:44:26.379 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.377+0000 7f239bef2640 1 -- start start 2023-11-04T01:44:26.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.378+0000 7f239bef2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23940b0c40 0x7f239406fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.378+0000 7f239bef2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2394071500 con 0x7f239406bb60 2023-11-04T01:44:26.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.378+0000 7f239bef2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239415dae0 con 0x7f2394159e40 2023-11-04T01:44:26.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.378+0000 7f239bef2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2394070c60 con 0x7f23940b0c40 2023-11-04T01:44:26.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.378+0000 7f239a48f640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f239406bb60 0x7f23940cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39386/0 (socket says 172.21.15.44:39386) 2023-11-04T01:44:26.380 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.378+0000 7f239a48f640 1 -- 172.21.15.44:0/588233610 learned_addr learned my addr 172.21.15.44:0/588233610 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:44:26.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.378+0000 7f2398c8c640 1 -- 172.21.15.44:0/588233610 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536302888 0 0) 0x7f2394071500 con 0x7f239406bb60 2023-11-04T01:44:26.382 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.378+0000 7f239948d640 1 --2- 172.21.15.44:0/588233610 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23940b0c40 0x7f239406fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.378+0000 7f2398c8c640 1 -- 172.21.15.44:0/588233610 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f237c003520 con 0x7f239406bb60 2023-11-04T01:44:26.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f2398c8c640 1 -- 172.21.15.44:0/588233610 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 613418237 0 0) 0x7f237c003520 con 0x7f239406bb60 2023-11-04T01:44:26.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f2398c8c640 1 -- 172.21.15.44:0/588233610 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23940b0c40 msgr2=0x7f239406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:26.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f2398c8c640 1 --2- 172.21.15.44:0/588233610 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23940b0c40 0x7f239406fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f2398c8c640 1 -- 172.21.15.44:0/588233610 >> v1:172.21.15.204:6789/0 conn(0x7f2394159e40 legacy=0x7f23940b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f2398c8c640 1 -- 172.21.15.44:0/588233610 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2394070f40 con 0x7f239406bb60 2023-11-04T01:44:26.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f2398c8c640 1 -- 172.21.15.44:0/588233610 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7f23840019f0 con 0x7f239406bb60 2023-11-04T01:44:26.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f2398c8c640 1 -- 172.21.15.44:0/588233610 >> v1:172.21.15.44:6789/0 conn(0x7f239406bb60 legacy=0x7f23940cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f2398c8c640 1 --2- 172.21.15.44:0/588233610 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f237c0039a0 0x7f237c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f2398c8c640 1 --2- 172.21.15.44:0/588233610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c0047c0 0x7f237c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f2398c8c640 1 --2- 172.21.15.44:0/588233610 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23940b0c40 0x7f237c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f2398c8c640 1 -- 172.21.15.44:0/588233610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2394070c60 con 0x7f237c0047c0 2023-11-04T01:44:26.383 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f2398c8c640 1 -- 172.21.15.44:0/588233610 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c00bab0 con 0x7f237c0039a0 2023-11-04T01:44:26.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f2398c8c640 1 -- 172.21.15.44:0/588233610 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c00bc70 con 0x7f23940b0c40 2023-11-04T01:44:26.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f239948d640 1 --2- 172.21.15.44:0/588233610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c0047c0 0x7f237c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f2399c8e640 1 --2- 172.21.15.44:0/588233610 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f237c0039a0 0x7f237c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f239a48f640 1 --2- 172.21.15.44:0/588233610 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23940b0c40 0x7f237c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f239948d640 1 -- 172.21.15.44:0/588233610 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23940b0c40 msgr2=0x7f237c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:26.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f239948d640 1 --2- 172.21.15.44:0/588233610 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23940b0c40 0x7f237c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f239948d640 1 -- 172.21.15.44:0/588233610 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f237c0039a0 msgr2=0x7f237c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:26.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f239948d640 1 --2- 172.21.15.44:0/588233610 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f237c0039a0 0x7f237c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f239948d640 1 -- 172.21.15.44:0/588233610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c003520 con 0x7f237c0047c0 2023-11-04T01:44:26.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.379+0000 7f2399c8e640 1 --2- 172.21.15.44:0/588233610 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f237c0039a0 0x7f237c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:26.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.380+0000 7f239948d640 1 --2- 172.21.15.44:0/588233610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c0047c0 0x7f237c004c40 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f2388009ac0 tx=0x7f237c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a706fd745bba580c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.384 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.380+0000 7f2398c8c640 1 -- 172.21.15.44:0/588233610 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238802c6b0 con 0x7f237c0047c0 2023-11-04T01:44:26.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.380+0000 7f2398c8c640 1 -- 172.21.15.44:0/588233610 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238802c810 con 0x7f237c0047c0 2023-11-04T01:44:26.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.380+0000 7f2398c8c640 1 -- 172.21.15.44:0/588233610 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238802cba0 con 0x7f237c0047c0 2023-11-04T01:44:26.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.381+0000 7f239bef2640 1 -- 172.21.15.44:0/588233610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c0047c0 msgr2=0x7f237c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.381+0000 7f239bef2640 1 --2- 172.21.15.44:0/588233610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c0047c0 0x7f237c004c40 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f2388009ac0 tx=0x7f237c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.381+0000 7f239a48f640 1 -- 172.21.15.44:0/588233610 reap_dead start 2023-11-04T01:44:26.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.381+0000 7f239bef2640 1 -- 172.21.15.44:0/588233610 shutdown_connections 2023-11-04T01:44:26.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.381+0000 7f239bef2640 1 -- 172.21.15.44:0/588233610 >> 172.21.15.44:0/588233610 conn(0x7f23940cb530 msgr2=0x7f23940cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:26.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.381+0000 7f239bef2640 1 -- 172.21.15.44:0/588233610 shutdown_connections 2023-11-04T01:44:26.385 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.381+0000 7f239bef2640 1 -- 172.21.15.44:0/588233610 wait complete. 2023-11-04T01:44:26.387 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.382+0000 7f239bef2640 1 Processor -- start 2023-11-04T01:44:26.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.382+0000 7f239bef2640 1 -- start start 2023-11-04T01:44:26.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f239bef2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c0047c0 0x7f23940c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f239bef2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f239414c090 0x7f23940c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f239bef2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23940c1a30 0x7f239406ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f239bef2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23940c6e20 con 0x7f237c0047c0 2023-11-04T01:44:26.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f239bef2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23940c6210 con 0x7f23940c1a30 2023-11-04T01:44:26.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f239bef2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23940c64f0 con 0x7f239414c090 2023-11-04T01:44:26.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f2399c8e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c0047c0 0x7f23940c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f2399c8e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c0047c0 0x7f23940c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51418/0 (socket says 172.21.15.44:51418) 2023-11-04T01:44:26.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f2399c8e640 1 -- 172.21.15.44:0/3981315068 learned_addr learned my addr 172.21.15.44:0/3981315068 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:26.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f239948d640 1 --2- 172.21.15.44:0/3981315068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f239414c090 0x7f23940c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f239a48f640 1 --2- 172.21.15.44:0/3981315068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23940c1a30 0x7f239406ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.388 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f2399c8e640 1 -- 172.21.15.44:0/3981315068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f239414c090 msgr2=0x7f23940c14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f2399c8e640 1 --2- 172.21.15.44:0/3981315068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f239414c090 0x7f23940c14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f2399c8e640 1 -- 172.21.15.44:0/3981315068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23940c1a30 msgr2=0x7f239406ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f2399c8e640 1 --2- 172.21.15.44:0/3981315068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23940c1a30 0x7f239406ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f2399c8e640 1 -- 172.21.15.44:0/3981315068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23940c67d0 con 0x7f237c0047c0 2023-11-04T01:44:26.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f239948d640 1 --2- 172.21.15.44:0/3981315068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f239414c090 0x7f23940c14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:26.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f2399c8e640 1 --2- 172.21.15.44:0/3981315068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c0047c0 0x7f23940c5b80 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f238c00e600 tx=0x7f238c00eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f23927fc640 1 -- 172.21.15.44:0/3981315068 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c0052e0 con 0x7f237c0047c0 2023-11-04T01:44:26.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f23927fc640 1 -- 172.21.15.44:0/3981315068 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c005440 con 0x7f237c0047c0 2023-11-04T01:44:26.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f23927fc640 1 -- 172.21.15.44:0/3981315068 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c0037f0 con 0x7f237c0047c0 2023-11-04T01:44:26.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.383+0000 7f239bef2640 1 -- 172.21.15.44:0/3981315068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23940c6ab0 con 0x7f237c0047c0 2023-11-04T01:44:26.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.384+0000 7f239bef2640 1 -- 172.21.15.44:0/3981315068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23940704f0 con 0x7f237c0047c0 2023-11-04T01:44:26.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.384+0000 7f239bef2640 1 -- 172.21.15.44:0/3981315068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23940684b0 con 0x7f237c0047c0 2023-11-04T01:44:26.389 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.385+0000 7f23927fc640 1 -- 172.21.15.44:0/3981315068 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f238c003950 con 0x7f237c0047c0 2023-11-04T01:44:26.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.385+0000 7f23927fc640 1 --2- 172.21.15.44:0/3981315068 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f238006ae70 0x7f238006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.385+0000 7f23927fc640 1 -- 172.21.15.44:0/3981315068 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f238c089db0 con 0x7f237c0047c0 2023-11-04T01:44:26.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.385+0000 7f239948d640 1 --2- 172.21.15.44:0/3981315068 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f238006ae70 0x7f238006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.390 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.386+0000 7f239948d640 1 --2- 172.21.15.44:0/3981315068 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f238006ae70 0x7f238006d330 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2388036000 tx=0x7f2388030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.391 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.389+0000 7f23927fc640 1 -- 172.21.15.44:0/3981315068 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f238c054550 con 0x7f237c0047c0 2023-11-04T01:44:26.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.566+0000 7f239bef2640 1 -- 172.21.15.44:0/3981315068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f23940c9750 con 0x7f237c0047c0 2023-11-04T01:44:26.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.567+0000 7f23927fc640 1 -- 172.21.15.44:0/3981315068 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v116) v1 ==== 103+0+11 (secure 0 0 0) 0x7f238c057b70 con 0x7f237c0047c0 2023-11-04T01:44:26.569 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:44:26.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.569+0000 7f239bef2640 1 -- 172.21.15.44:0/3981315068 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f238006ae70 msgr2=0x7f238006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.569+0000 7f239bef2640 1 --2- 172.21.15.44:0/3981315068 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f238006ae70 0x7f238006d330 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2388036000 tx=0x7f2388030000 comp rx=0 tx=0).stop 2023-11-04T01:44:26.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.569+0000 7f239bef2640 1 -- 172.21.15.44:0/3981315068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c0047c0 msgr2=0x7f23940c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.569+0000 7f239bef2640 1 --2- 172.21.15.44:0/3981315068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c0047c0 0x7f23940c5b80 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f238c00e600 tx=0x7f238c00eac0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.569+0000 7f239bef2640 1 -- 172.21.15.44:0/3981315068 shutdown_connections 2023-11-04T01:44:26.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.569+0000 7f239bef2640 1 --2- 172.21.15.44:0/3981315068 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f238006ae70 0x7f238006d330 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.569+0000 7f239bef2640 1 --2- 172.21.15.44:0/3981315068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23940c1a30 0x7f239406ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.569+0000 7f239bef2640 1 --2- 172.21.15.44:0/3981315068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f239414c090 0x7f23940c14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.569+0000 7f239bef2640 1 --2- 172.21.15.44:0/3981315068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c0047c0 0x7f23940c5b80 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.569+0000 7f239bef2640 1 -- 172.21.15.44:0/3981315068 >> 172.21.15.44:0/3981315068 conn(0x7f23940cb530 msgr2=0x7f239406c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.569+0000 7f239bef2640 1 -- 172.21.15.44:0/3981315068 shutdown_connections 2023-11-04T01:44:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.569+0000 7f239bef2640 1 -- 172.21.15.44:0/3981315068 wait complete. 2023-11-04T01:44:26.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2023-11-04T01:44:26.582 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:44:26.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.690+0000 7f7558ca9640 1 Processor -- start 2023-11-04T01:44:26.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.690+0000 7f7558ca9640 1 -- start start 2023-11-04T01:44:26.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.691+0000 7f7558ca9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f755406d9c0 0x7f75540710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.691+0000 7f7558ca9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f755406c5f0 0x7f7554071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.691+0000 7f7558ca9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755406cc90 con 0x7f75540ade00 2023-11-04T01:44:26.692 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.691+0000 7f7558ca9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75540b0c40 con 0x7f755406c5f0 2023-11-04T01:44:26.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.691+0000 7f7558ca9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7554071b50 con 0x7f755406d9c0 2023-11-04T01:44:26.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.691+0000 7f7552d9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f755406c5f0 0x7f7554071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.691+0000 7f7552d9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f755406c5f0 0x7f7554071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.44:50096/0 (socket says 172.21.15.44:50096) 2023-11-04T01:44:26.693 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.691+0000 7f7552d9d640 1 -- 172.21.15.44:0/1262333258 learned_addr learned my addr 172.21.15.44:0/1262333258 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:26.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.691+0000 7f754bfff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f755406d9c0 0x7f75540710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.691+0000 7f755259c640 1 --1- 172.21.15.44:0/1262333258 >> v1:172.21.15.204:6789/0 conn(0x7f75540ade00 0x7f75540b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.44:49084/0 (socket says 172.21.15.44:49084) 2023-11-04T01:44:26.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.691+0000 7f754bfff640 1 -- 172.21.15.44:0/1262333258 >> v2:172.21.15.204:3300/0 conn(0x7f755406c5f0 msgr2=0x7f7554071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:26.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.691+0000 7f754bfff640 1 --2- 172.21.15.44:0/1262333258 >> v2:172.21.15.204:3300/0 conn(0x7f755406c5f0 0x7f7554071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.691+0000 7f754bfff640 1 -- 172.21.15.44:0/1262333258 >> v1:172.21.15.204:6789/0 conn(0x7f75540ade00 legacy=0x7f75540b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.691+0000 7f754bfff640 1 -- 172.21.15.44:0/1262333258 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75540b0e60 con 0x7f755406d9c0 2023-11-04T01:44:26.694 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.691+0000 7f7552d9d640 1 --2- 172.21.15.44:0/1262333258 >> v2:172.21.15.204:3300/0 conn(0x7f755406c5f0 0x7f7554071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:26.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.692+0000 7f754bfff640 1 --2- 172.21.15.44:0/1262333258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f755406d9c0 0x7f75540710d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f753c0097a0 tx=0x7f753c02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=937c030b176aaa0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.692+0000 7f7551d9b640 1 -- 172.21.15.44:0/1262333258 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c02f050 con 0x7f755406d9c0 2023-11-04T01:44:26.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.693+0000 7f7551d9b640 1 -- 172.21.15.44:0/1262333258 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c031700 con 0x7f755406d9c0 2023-11-04T01:44:26.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.693+0000 7f7551d9b640 1 -- 172.21.15.44:0/1262333258 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c031a90 con 0x7f755406d9c0 2023-11-04T01:44:26.695 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.693+0000 7f7558ca9640 1 -- 172.21.15.44:0/1262333258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f755406d9c0 msgr2=0x7f75540710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.693+0000 7f7558ca9640 1 --2- 172.21.15.44:0/1262333258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f755406d9c0 0x7f75540710d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f753c0097a0 tx=0x7f753c02b7a0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.693+0000 7f7558ca9640 1 -- 172.21.15.44:0/1262333258 shutdown_connections 2023-11-04T01:44:26.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.693+0000 7f7558ca9640 1 --2- 172.21.15.44:0/1262333258 >> v2:172.21.15.204:3300/0 conn(0x7f755406c5f0 0x7f7554071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.693+0000 7f7558ca9640 1 --2- 172.21.15.44:0/1262333258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f755406d9c0 0x7f75540710d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.693+0000 7f7558ca9640 1 -- 172.21.15.44:0/1262333258 >> 172.21.15.44:0/1262333258 conn(0x7f75540cb530 msgr2=0x7f75540cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:26.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.693+0000 7f7558ca9640 1 -- 172.21.15.44:0/1262333258 shutdown_connections 2023-11-04T01:44:26.696 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.693+0000 7f7558ca9640 1 -- 172.21.15.44:0/1262333258 wait complete. 2023-11-04T01:44:26.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.694+0000 7f7558ca9640 1 Processor -- start 2023-11-04T01:44:26.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.694+0000 7f7558ca9640 1 -- start start 2023-11-04T01:44:26.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.695+0000 7f7558ca9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f755406c5f0 0x7f7554158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.695+0000 7f7558ca9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f755406d9c0 0x7f7554158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.695+0000 7f7558ca9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75540ade00 0x7f75540c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.695+0000 7f7558ca9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75540c65e0 con 0x7f75540ade00 2023-11-04T01:44:26.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.695+0000 7f7558ca9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7554158590 con 0x7f755406d9c0 2023-11-04T01:44:26.698 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.695+0000 7f7558ca9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7554158e20 con 0x7f755406c5f0 2023-11-04T01:44:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.695+0000 7f7552d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75540ade00 0x7f75540c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.695+0000 7f7552d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75540ade00 0x7f75540c3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51422/0 (socket says 172.21.15.44:51422) 2023-11-04T01:44:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.695+0000 7f7552d9d640 1 -- 172.21.15.44:0/3377009914 learned_addr learned my addr 172.21.15.44:0/3377009914 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.695+0000 7f755259c640 1 --2- 172.21.15.44:0/3377009914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f755406c5f0 0x7f7554158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.695+0000 7f754bfff640 1 --2- 172.21.15.44:0/3377009914 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f755406d9c0 0x7f7554158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.696+0000 7f7552d9d640 1 -- 172.21.15.44:0/3377009914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f755406c5f0 msgr2=0x7f7554158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.696+0000 7f7552d9d640 1 --2- 172.21.15.44:0/3377009914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f755406c5f0 0x7f7554158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.696+0000 7f7552d9d640 1 -- 172.21.15.44:0/3377009914 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f755406d9c0 msgr2=0x7f7554158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.696+0000 7f7552d9d640 1 --2- 172.21.15.44:0/3377009914 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f755406d9c0 0x7f7554158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.696+0000 7f7552d9d640 1 -- 172.21.15.44:0/3377009914 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c009b30 con 0x7f75540ade00 2023-11-04T01:44:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.696+0000 7f754bfff640 1 --2- 172.21.15.44:0/3377009914 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f755406d9c0 0x7f7554158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.696+0000 7f7552d9d640 1 --2- 172.21.15.44:0/3377009914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75540ade00 0x7f75540c3bb0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f754c009e70 tx=0x7f754c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.696+0000 7f754affd640 1 -- 172.21.15.44:0/3377009914 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c018070 con 0x7f75540ade00 2023-11-04T01:44:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.696+0000 7f754affd640 1 -- 172.21.15.44:0/3377009914 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c00f040 con 0x7f75540ade00 2023-11-04T01:44:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.696+0000 7f7558ca9640 1 -- 172.21.15.44:0/3377009914 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753c009400 con 0x7f75540ade00 2023-11-04T01:44:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.696+0000 7f754affd640 1 -- 172.21.15.44:0/3377009914 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00ce00 con 0x7f75540ade00 2023-11-04T01:44:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.696+0000 7f7558ca9640 1 -- 172.21.15.44:0/3377009914 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75540c5cb0 con 0x7f75540ade00 2023-11-04T01:44:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.697+0000 7f7558ca9640 1 -- 172.21.15.44:0/3377009914 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75540c6750 con 0x7f75540ade00 2023-11-04T01:44:26.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.697+0000 7f754affd640 1 -- 172.21.15.44:0/3377009914 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f754c014480 con 0x7f75540ade00 2023-11-04T01:44:26.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.698+0000 7f754affd640 1 --2- 172.21.15.44:0/3377009914 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f753406ae70 0x7f753406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.698+0000 7f754affd640 1 -- 172.21.15.44:0/3377009914 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f754c08a210 con 0x7f75540ade00 2023-11-04T01:44:26.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.698+0000 7f755259c640 1 --2- 172.21.15.44:0/3377009914 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f753406ae70 0x7f753406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.701 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.699+0000 7f755259c640 1 --2- 172.21.15.44:0/3377009914 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f753406ae70 0x7f753406d330 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f7544000f60 tx=0x7f7544007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.704 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.702+0000 7f754affd640 1 -- 172.21.15.44:0/3377009914 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f754c0549b0 con 0x7f75540ade00 2023-11-04T01:44:26.878 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.876+0000 7f7558ca9640 1 -- 172.21.15.44:0/3377009914 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f75540684b0 con 0x7f75540ade00 2023-11-04T01:44:26.879 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.877+0000 7f754affd640 1 -- 172.21.15.44:0/3377009914 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v116) v1 ==== 107+0+11 (secure 0 0 0) 0x7f754c057fd0 con 0x7f75540ade00 2023-11-04T01:44:26.879 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:44:26.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.878+0000 7f7558ca9640 1 -- 172.21.15.44:0/3377009914 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f753406ae70 msgr2=0x7f753406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.878+0000 7f7558ca9640 1 --2- 172.21.15.44:0/3377009914 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f753406ae70 0x7f753406d330 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f7544000f60 tx=0x7f7544007cc0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.878+0000 7f7558ca9640 1 -- 172.21.15.44:0/3377009914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75540ade00 msgr2=0x7f75540c3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.878+0000 7f7558ca9640 1 --2- 172.21.15.44:0/3377009914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75540ade00 0x7f75540c3bb0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f754c009e70 tx=0x7f754c00c490 comp rx=0 tx=0).stop 2023-11-04T01:44:26.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.879+0000 7f7558ca9640 1 -- 172.21.15.44:0/3377009914 shutdown_connections 2023-11-04T01:44:26.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.879+0000 7f7558ca9640 1 --2- 172.21.15.44:0/3377009914 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f753406ae70 0x7f753406d330 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.879+0000 7f7558ca9640 1 --2- 172.21.15.44:0/3377009914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75540ade00 0x7f75540c3bb0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.879+0000 7f7558ca9640 1 --2- 172.21.15.44:0/3377009914 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f755406d9c0 0x7f7554158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.879+0000 7f7558ca9640 1 --2- 172.21.15.44:0/3377009914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f755406c5f0 0x7f7554158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.881 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.879+0000 7f7558ca9640 1 -- 172.21.15.44:0/3377009914 >> 172.21.15.44:0/3377009914 conn(0x7f75540cb530 msgr2=0x7f75540cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:26.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.879+0000 7f7558ca9640 1 -- 172.21.15.44:0/3377009914 shutdown_connections 2023-11-04T01:44:26.882 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.879+0000 7f7558ca9640 1 -- 172.21.15.44:0/3377009914 wait complete. 2023-11-04T01:44:26.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:44:27.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.998+0000 7ff87c858640 1 Processor -- start 2023-11-04T01:44:27.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.998+0000 7ff87c858640 1 -- start start 2023-11-04T01:44:27.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.999+0000 7ff87c858640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff87815d100 0x7ff8780ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.999+0000 7ff87c858640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff8780d1be0 0x7ff8780b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.001 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.999+0000 7ff87c858640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8780b32b0 con 0x7ff87815d4e0 2023-11-04T01:44:27.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.999+0000 7ff87c858640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8780cee10 con 0x7ff8780d1be0 2023-11-04T01:44:27.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.999+0000 7ff87c858640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780b2980 con 0x7ff87815d100 2023-11-04T01:44:27.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.999+0000 7ff876d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff8780d1be0 0x7ff8780b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.999+0000 7ff876d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff8780d1be0 0x7ff8780b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51430/0 (socket says 172.21.15.44:51430) 2023-11-04T01:44:27.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:26.999+0000 7ff876d9d640 1 -- 172.21.15.44:0/673051838 learned_addr learned my addr 172.21.15.44:0/673051838 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:27.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.000+0000 7ff87659c640 1 --2- 172.21.15.44:0/673051838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff87815d100 0x7ff8780ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.000+0000 7ff876d9d640 1 -- 172.21.15.44:0/673051838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff87815d100 msgr2=0x7ff8780ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:27.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.000+0000 7ff876d9d640 1 --2- 172.21.15.44:0/673051838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff87815d100 0x7ff8780ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.000+0000 7ff876d9d640 1 -- 172.21.15.44:0/673051838 >> v1:172.21.15.204:6789/0 conn(0x7ff87815d4e0 legacy=0x7ff8780d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:27.002 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.000+0000 7ff876d9d640 1 -- 172.21.15.44:0/673051838 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8780b2c60 con 0x7ff8780d1be0 2023-11-04T01:44:27.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.000+0000 7ff876d9d640 1 --2- 172.21.15.44:0/673051838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8780d1be0 0x7ff8780b3740 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7ff8700098a0 tx=0x7ff87002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c572c67ecec37716 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.003 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.001+0000 7ff87559a640 1 -- 172.21.15.44:0/673051838 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870031640 con 0x7ff8780d1be0 2023-11-04T01:44:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.001+0000 7ff87559a640 1 -- 172.21.15.44:0/673051838 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8700317a0 con 0x7ff8780d1be0 2023-11-04T01:44:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.001+0000 7ff87559a640 1 -- 172.21.15.44:0/673051838 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870031b30 con 0x7ff8780d1be0 2023-11-04T01:44:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.001+0000 7ff87c858640 1 -- 172.21.15.44:0/673051838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8780d1be0 msgr2=0x7ff8780b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.001+0000 7ff87c858640 1 --2- 172.21.15.44:0/673051838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8780d1be0 0x7ff8780b3740 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7ff8700098a0 tx=0x7ff87002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.001+0000 7ff87c858640 1 -- 172.21.15.44:0/673051838 shutdown_connections 2023-11-04T01:44:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.001+0000 7ff87c858640 1 --2- 172.21.15.44:0/673051838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8780d1be0 0x7ff8780b3740 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.001+0000 7ff87c858640 1 --2- 172.21.15.44:0/673051838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff87815d100 0x7ff8780ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.001+0000 7ff87c858640 1 -- 172.21.15.44:0/673051838 >> 172.21.15.44:0/673051838 conn(0x7ff8780d2ef0 msgr2=0x7ff8780d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.001+0000 7ff87c858640 1 -- 172.21.15.44:0/673051838 shutdown_connections 2023-11-04T01:44:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.001+0000 7ff87c858640 1 -- 172.21.15.44:0/673051838 wait complete. 2023-11-04T01:44:27.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.002+0000 7ff87c858640 1 Processor -- start 2023-11-04T01:44:27.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.003+0000 7ff87c858640 1 -- start start 2023-11-04T01:44:27.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.003+0000 7ff87c858640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8780d1be0 0x7ff8780ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.003+0000 7ff87c858640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff87815d100 0x7ff87814e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.003+0000 7ff87c858640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff87815d4e0 0x7ff8780cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.003+0000 7ff87c858640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780b66f0 con 0x7ff87815d100 2023-11-04T01:44:27.006 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.003+0000 7ff87c858640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87814e880 con 0x7ff87815d4e0 2023-11-04T01:44:27.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.003+0000 7ff87c858640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780b5a70 con 0x7ff8780d1be0 2023-11-04T01:44:27.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.003+0000 7ff875d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff87815d100 0x7ff87814e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.003+0000 7ff875d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff87815d100 0x7ff87814e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51446/0 (socket says 172.21.15.44:51446) 2023-11-04T01:44:27.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.003+0000 7ff875d9b640 1 -- 172.21.15.44:0/945899485 learned_addr learned my addr 172.21.15.44:0/945899485 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:27.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.003+0000 7ff876d9d640 1 --2- 172.21.15.44:0/945899485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff87815d4e0 0x7ff8780cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.004+0000 7ff87659c640 1 --2- 172.21.15.44:0/945899485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8780d1be0 0x7ff8780ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.004+0000 7ff875d9b640 1 -- 172.21.15.44:0/945899485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8780d1be0 msgr2=0x7ff8780ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.004+0000 7ff875d9b640 1 --2- 172.21.15.44:0/945899485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8780d1be0 0x7ff8780ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.004+0000 7ff875d9b640 1 -- 172.21.15.44:0/945899485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff87815d4e0 msgr2=0x7ff8780cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.004+0000 7ff875d9b640 1 --2- 172.21.15.44:0/945899485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff87815d4e0 0x7ff8780cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.004+0000 7ff875d9b640 1 -- 172.21.15.44:0/945899485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8700094d0 con 0x7ff87815d100 2023-11-04T01:44:27.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.004+0000 7ff876d9d640 1 --2- 172.21.15.44:0/945899485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff87815d4e0 0x7ff8780cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:27.007 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.004+0000 7ff875d9b640 1 --2- 172.21.15.44:0/945899485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff87815d100 0x7ff87814e340 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7ff86000c430 tx=0x7ff86000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.004+0000 7ff86effd640 1 -- 172.21.15.44:0/945899485 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff860011790 con 0x7ff87815d100 2023-11-04T01:44:27.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.004+0000 7ff86effd640 1 -- 172.21.15.44:0/945899485 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8600118f0 con 0x7ff87815d100 2023-11-04T01:44:27.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.004+0000 7ff87c858640 1 -- 172.21.15.44:0/945899485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8780b5d50 con 0x7ff87815d100 2023-11-04T01:44:27.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.004+0000 7ff86effd640 1 -- 172.21.15.44:0/945899485 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff860011ce0 con 0x7ff87815d100 2023-11-04T01:44:27.008 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.004+0000 7ff87c858640 1 -- 172.21.15.44:0/945899485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8780b6310 con 0x7ff87815d100 2023-11-04T01:44:27.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.005+0000 7ff87c858640 1 -- 172.21.15.44:0/945899485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8780b6830 con 0x7ff87815d100 2023-11-04T01:44:27.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.005+0000 7ff86effd640 1 -- 172.21.15.44:0/945899485 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff86001c460 con 0x7ff87815d100 2023-11-04T01:44:27.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.006+0000 7ff86effd640 1 --2- 172.21.15.44:0/945899485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff85806ae70 0x7ff85806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.006+0000 7ff86effd640 1 -- 172.21.15.44:0/945899485 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7ff860089e90 con 0x7ff87815d100 2023-11-04T01:44:27.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.006+0000 7ff87659c640 1 --2- 172.21.15.44:0/945899485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff85806ae70 0x7ff85806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.009 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.007+0000 7ff87659c640 1 --2- 172.21.15.44:0/945899485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff85806ae70 0x7ff85806d330 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff87806b570 tx=0x7ff8680039b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.012 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.010+0000 7ff86effd640 1 -- 172.21.15.44:0/945899485 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8780b6830 con 0x7ff87815d100 2023-11-04T01:44:27.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.185+0000 7ff87c858640 1 -- 172.21.15.44:0/945899485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8780b6830 con 0x7ff87815d100 2023-11-04T01:44:27.187 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.185+0000 7ff86effd640 1 -- 172.21.15.44:0/945899485 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff8780b6830 con 0x7ff87815d100 2023-11-04T01:44:27.187 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2023-11-04T01:44:27.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.187+0000 7ff87c858640 1 -- 172.21.15.44:0/945899485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff85806ae70 msgr2=0x7ff85806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.187+0000 7ff87c858640 1 --2- 172.21.15.44:0/945899485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff85806ae70 0x7ff85806d330 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff87806b570 tx=0x7ff8680039b0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.187+0000 7ff87c858640 1 -- 172.21.15.44:0/945899485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff87815d100 msgr2=0x7ff87814e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.187+0000 7ff87c858640 1 --2- 172.21.15.44:0/945899485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff87815d100 0x7ff87814e340 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7ff86000c430 tx=0x7ff86000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.187+0000 7ff87c858640 1 -- 172.21.15.44:0/945899485 shutdown_connections 2023-11-04T01:44:27.189 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.187+0000 7ff87c858640 1 --2- 172.21.15.44:0/945899485 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7ff85806ae70 0x7ff85806d330 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.187+0000 7ff87c858640 1 --2- 172.21.15.44:0/945899485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff87815d4e0 0x7ff8780cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.187+0000 7ff87c858640 1 --2- 172.21.15.44:0/945899485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff87815d100 0x7ff87814e340 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.187+0000 7ff87c858640 1 --2- 172.21.15.44:0/945899485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8780d1be0 0x7ff8780ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.187+0000 7ff87c858640 1 -- 172.21.15.44:0/945899485 >> 172.21.15.44:0/945899485 conn(0x7ff8780d2ef0 msgr2=0x7ff8780b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:27.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.187+0000 7ff87c858640 1 -- 172.21.15.44:0/945899485 shutdown_connections 2023-11-04T01:44:27.190 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.187+0000 7ff87c858640 1 -- 172.21.15.44:0/945899485 wait complete. 2023-11-04T01:44:27.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:44:27.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.307+0000 7f950fcd4640 1 Processor -- start 2023-11-04T01:44:27.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.308+0000 7f950fcd4640 1 -- start start 2023-11-04T01:44:27.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.308+0000 7f950fcd4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f950815d100 0x7f95080ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.308+0000 7f950fcd4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f95080d1be0 0x7f95080b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.308+0000 7f950fcd4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95080b32b0 con 0x7f950815d4e0 2023-11-04T01:44:27.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.308+0000 7f950fcd4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95080cee10 con 0x7f950815d100 2023-11-04T01:44:27.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.308+0000 7f950fcd4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95080b2980 con 0x7f95080d1be0 2023-11-04T01:44:27.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.309+0000 7f950da70640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f950815d100 0x7f95080ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.309+0000 7f950d26f640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f950815d4e0 0x7f95080d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39390/0 (socket says 172.21.15.44:39390) 2023-11-04T01:44:27.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.309+0000 7f950d26f640 1 -- 172.21.15.44:0/3664200500 learned_addr learned my addr 172.21.15.44:0/3664200500 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:44:27.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.309+0000 7f950da70640 1 -- 172.21.15.44:0/3664200500 >> v2:172.21.15.204:3300/0 conn(0x7f95080d1be0 msgr2=0x7f95080b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:27.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.309+0000 7f950da70640 1 --2- 172.21.15.44:0/3664200500 >> v2:172.21.15.204:3300/0 conn(0x7f95080d1be0 0x7f95080b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.309+0000 7f950da70640 1 -- 172.21.15.44:0/3664200500 >> v1:172.21.15.44:6789/0 conn(0x7f950815d4e0 legacy=0x7f95080d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.309+0000 7f950da70640 1 -- 172.21.15.44:0/3664200500 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95080b2c60 con 0x7f950815d100 2023-11-04T01:44:27.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.309+0000 7f950ca6e640 1 -- 172.21.15.44:0/3664200500 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035680797 0 0) 0x7f95080b32b0 con 0x7f950815d4e0 2023-11-04T01:44:27.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.310+0000 7f950da70640 1 --2- 172.21.15.44:0/3664200500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f950815d100 0x7f95080ce510 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f950808d6a0 tx=0x7f950002bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356a66a8e34ae1f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.310+0000 7f950ca6e640 1 -- 172.21.15.44:0/3664200500 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950002ccb0 con 0x7f950815d100 2023-11-04T01:44:27.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.310+0000 7f950ca6e640 1 -- 172.21.15.44:0/3664200500 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950002ce10 con 0x7f950815d100 2023-11-04T01:44:27.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.310+0000 7f950ca6e640 1 -- 172.21.15.44:0/3664200500 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500034660 con 0x7f950815d100 2023-11-04T01:44:27.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.310+0000 7f950fcd4640 1 -- 172.21.15.44:0/3664200500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f950815d100 msgr2=0x7f95080ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.310+0000 7f950fcd4640 1 --2- 172.21.15.44:0/3664200500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f950815d100 0x7f95080ce510 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f950808d6a0 tx=0x7f950002bf00 comp rx=0 tx=0).stop 2023-11-04T01:44:27.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.310+0000 7f950fcd4640 1 -- 172.21.15.44:0/3664200500 shutdown_connections 2023-11-04T01:44:27.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.310+0000 7f950fcd4640 1 --2- 172.21.15.44:0/3664200500 >> v2:172.21.15.204:3300/0 conn(0x7f95080d1be0 0x7f95080b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.310+0000 7f950fcd4640 1 --2- 172.21.15.44:0/3664200500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f950815d100 0x7f95080ce510 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.310+0000 7f950fcd4640 1 -- 172.21.15.44:0/3664200500 >> 172.21.15.44:0/3664200500 conn(0x7f95080d2ef0 msgr2=0x7f95080d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:27.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.310+0000 7f950fcd4640 1 -- 172.21.15.44:0/3664200500 shutdown_connections 2023-11-04T01:44:27.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.311+0000 7f950fcd4640 1 -- 172.21.15.44:0/3664200500 wait complete. 2023-11-04T01:44:27.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.312+0000 7f950fcd4640 1 Processor -- start 2023-11-04T01:44:27.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.312+0000 7f950fcd4640 1 -- start start 2023-11-04T01:44:27.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.312+0000 7f950fcd4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95080d1be0 0x7f950815fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.312+0000 7f950fcd4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f950815d100 0x7f95080cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.312+0000 7f950fcd4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f950815d4e0 0x7f950814c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.312+0000 7f950fcd4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95080c9550 con 0x7f95080d1be0 2023-11-04T01:44:27.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.312+0000 7f950fcd4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95080ccf40 con 0x7f950815d4e0 2023-11-04T01:44:27.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.312+0000 7f950fcd4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950815ee00 con 0x7f950815d100 2023-11-04T01:44:27.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f950da70640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95080d1be0 0x7f950815fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f950da70640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95080d1be0 0x7f950815fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51472/0 (socket says 172.21.15.44:51472) 2023-11-04T01:44:27.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f950da70640 1 -- 172.21.15.44:0/2936212654 learned_addr learned my addr 172.21.15.44:0/2936212654 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:27.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f950d26f640 1 --2- 172.21.15.44:0/2936212654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f950815d100 0x7f95080cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f950e271640 1 --2- 172.21.15.44:0/2936212654 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f950815d4e0 0x7f950814c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f950da70640 1 -- 172.21.15.44:0/2936212654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f950815d100 msgr2=0x7f95080cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f950da70640 1 --2- 172.21.15.44:0/2936212654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f950815d100 0x7f95080cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f950da70640 1 -- 172.21.15.44:0/2936212654 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f950815d4e0 msgr2=0x7f950814c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f950da70640 1 --2- 172.21.15.44:0/2936212654 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f950815d4e0 0x7f950814c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f950da70640 1 -- 172.21.15.44:0/2936212654 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9500009a70 con 0x7f95080d1be0 2023-11-04T01:44:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f950e271640 1 --2- 172.21.15.44:0/2936212654 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f950815d4e0 0x7f950814c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f950da70640 1 --2- 172.21.15.44:0/2936212654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95080d1be0 0x7f950815fea0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f9500009ed0 tx=0x7f9500004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f95067fc640 1 -- 172.21.15.44:0/2936212654 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500003990 con 0x7f95080d1be0 2023-11-04T01:44:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f95067fc640 1 -- 172.21.15.44:0/2936212654 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9500003af0 con 0x7f95080d1be0 2023-11-04T01:44:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f950fcd4640 1 -- 172.21.15.44:0/2936212654 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950815f0e0 con 0x7f95080d1be0 2023-11-04T01:44:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f95067fc640 1 -- 172.21.15.44:0/2936212654 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500003e80 con 0x7f95080d1be0 2023-11-04T01:44:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.313+0000 7f950fcd4640 1 -- 172.21.15.44:0/2936212654 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950815f6a0 con 0x7f95080d1be0 2023-11-04T01:44:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.314+0000 7f950fcd4640 1 -- 172.21.15.44:0/2936212654 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95080684b0 con 0x7f95080d1be0 2023-11-04T01:44:27.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.315+0000 7f95067fc640 1 -- 172.21.15.44:0/2936212654 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9500003fe0 con 0x7f95080d1be0 2023-11-04T01:44:27.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.315+0000 7f95067fc640 1 --2- 172.21.15.44:0/2936212654 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f94f406ae70 0x7f94f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.315+0000 7f95067fc640 1 -- 172.21.15.44:0/2936212654 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f95000acc60 con 0x7f95080d1be0 2023-11-04T01:44:27.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.315+0000 7f950d26f640 1 --2- 172.21.15.44:0/2936212654 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f94f406ae70 0x7f94f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.316+0000 7f950d26f640 1 --2- 172.21.15.44:0/2936212654 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f94f406ae70 0x7f94f406d330 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f950814a1f0 tx=0x7f94fc007b50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.321 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.319+0000 7f95067fc640 1 -- 172.21.15.44:0/2936212654 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9500077400 con 0x7f95080d1be0 2023-11-04T01:44:27.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.494+0000 7f950fcd4640 1 -- 172.21.15.44:0/2936212654 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f95080d2cd0 con 0x7f95080d1be0 2023-11-04T01:44:27.496 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.495+0000 7f95067fc640 1 -- 172.21.15.44:0/2936212654 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7f95000390a0 con 0x7f95080d1be0 2023-11-04T01:44:27.497 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2023-11-04T01:44:27.498 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.496+0000 7f950fcd4640 1 -- 172.21.15.44:0/2936212654 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f94f406ae70 msgr2=0x7f94f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.496+0000 7f950fcd4640 1 --2- 172.21.15.44:0/2936212654 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f94f406ae70 0x7f94f406d330 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f950814a1f0 tx=0x7f94fc007b50 comp rx=0 tx=0).stop 2023-11-04T01:44:27.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.496+0000 7f950fcd4640 1 -- 172.21.15.44:0/2936212654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95080d1be0 msgr2=0x7f950815fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.496+0000 7f950fcd4640 1 --2- 172.21.15.44:0/2936212654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95080d1be0 0x7f950815fea0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f9500009ed0 tx=0x7f9500004a40 comp rx=0 tx=0).stop 2023-11-04T01:44:27.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.496+0000 7f950fcd4640 1 -- 172.21.15.44:0/2936212654 shutdown_connections 2023-11-04T01:44:27.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.496+0000 7f950fcd4640 1 --2- 172.21.15.44:0/2936212654 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7f94f406ae70 0x7f94f406d330 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.496+0000 7f950fcd4640 1 --2- 172.21.15.44:0/2936212654 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f950815d4e0 0x7f950814c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.496+0000 7f950fcd4640 1 --2- 172.21.15.44:0/2936212654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f950815d100 0x7f95080cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.496+0000 7f950fcd4640 1 --2- 172.21.15.44:0/2936212654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95080d1be0 0x7f950815fea0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.496+0000 7f950fcd4640 1 -- 172.21.15.44:0/2936212654 >> 172.21.15.44:0/2936212654 conn(0x7f95080d2ef0 msgr2=0x7f95080b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:27.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.497+0000 7f950fcd4640 1 -- 172.21.15.44:0/2936212654 shutdown_connections 2023-11-04T01:44:27.499 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.497+0000 7f950fcd4640 1 -- 172.21.15.44:0/2936212654 wait complete. 2023-11-04T01:44:27.509 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:44:27.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.614+0000 7fbf38a10640 1 Processor -- start 2023-11-04T01:44:27.616 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.614+0000 7fbf38a10640 1 -- start start 2023-11-04T01:44:27.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.615+0000 7fbf38a10640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf3415d630 0x7fbf340cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.615+0000 7fbf38a10640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf340b0150 con 0x7fbf340b2210 2023-11-04T01:44:27.618 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.615+0000 7fbf38a10640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf340b1170 con 0x7fbf340ceda0 2023-11-04T01:44:27.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.615+0000 7fbf38a10640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340b1df0 con 0x7fbf3415d630 2023-11-04T01:44:27.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.615+0000 7fbf31d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbf340b2210 0x7fbf340cf180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39392/0 (socket says 172.21.15.44:39392) 2023-11-04T01:44:27.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.615+0000 7fbf31d9b640 1 -- 172.21.15.44:0/3416051668 learned_addr learned my addr 172.21.15.44:0/3416051668 (peer_addr_for_me v1:172.21.15.44:0/0) 2023-11-04T01:44:27.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf32d9d640 1 --2- 172.21.15.44:0/3416051668 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf3415d630 0x7fbf340cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3159a640 1 -- 172.21.15.44:0/3416051668 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226230296 0 0) 0x7fbf340b0150 con 0x7fbf340b2210 2023-11-04T01:44:27.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3159a640 1 -- 172.21.15.44:0/3416051668 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf1c003520 con 0x7fbf340b2210 2023-11-04T01:44:27.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3159a640 1 -- 172.21.15.44:0/3416051668 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 497008009 0 0) 0x7fbf1c003520 con 0x7fbf340b2210 2023-11-04T01:44:27.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3159a640 1 -- 172.21.15.44:0/3416051668 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf3415d630 msgr2=0x7fbf340cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:27.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3159a640 1 --2- 172.21.15.44:0/3416051668 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf3415d630 0x7fbf340cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3159a640 1 -- 172.21.15.44:0/3416051668 >> v1:172.21.15.204:6789/0 conn(0x7fbf340ceda0 legacy=0x7fbf3415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3159a640 1 -- 172.21.15.44:0/3416051668 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf340b1450 con 0x7fbf340b2210 2023-11-04T01:44:27.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3159a640 1 -- 172.21.15.44:0/3416051668 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 833546074 0 0) 0x7fbf28001670 con 0x7fbf340b2210 2023-11-04T01:44:27.619 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3159a640 1 -- 172.21.15.44:0/3416051668 >> v1:172.21.15.44:6789/0 conn(0x7fbf340b2210 legacy=0x7fbf340cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3159a640 1 --2- 172.21.15.44:0/3416051668 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf1c0039a0 0x7fbf1c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3159a640 1 --2- 172.21.15.44:0/3416051668 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf3415d630 0x7fbf1c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3159a640 1 --2- 172.21.15.44:0/3416051668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1c004d00 0x7fbf1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3159a640 1 -- 172.21.15.44:0/3416051668 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340b1df0 con 0x7fbf1c004d00 2023-11-04T01:44:27.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3159a640 1 -- 172.21.15.44:0/3416051668 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c00bb40 con 0x7fbf1c0039a0 2023-11-04T01:44:27.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3159a640 1 -- 172.21.15.44:0/3416051668 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c00bd00 con 0x7fbf3415d630 2023-11-04T01:44:27.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf32d9d640 1 --2- 172.21.15.44:0/3416051668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1c004d00 0x7fbf1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf3259c640 1 --2- 172.21.15.44:0/3416051668 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf1c0039a0 0x7fbf1c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf31d9b640 1 --2- 172.21.15.44:0/3416051668 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf3415d630 0x7fbf1c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf32d9d640 1 -- 172.21.15.44:0/3416051668 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf3415d630 msgr2=0x7fbf1c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:27.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf32d9d640 1 --2- 172.21.15.44:0/3416051668 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf3415d630 0x7fbf1c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf32d9d640 1 -- 172.21.15.44:0/3416051668 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf1c0039a0 msgr2=0x7fbf1c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:27.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf32d9d640 1 --2- 172.21.15.44:0/3416051668 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf1c0039a0 0x7fbf1c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.620 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.616+0000 7fbf32d9d640 1 -- 172.21.15.44:0/3416051668 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c003520 con 0x7fbf1c004d00 2023-11-04T01:44:27.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.617+0000 7fbf32d9d640 1 --2- 172.21.15.44:0/3416051668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1c004d00 0x7fbf1c005180 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fbf24009fc0 tx=0x7fbf1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1407e0c9d2c671 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.617+0000 7fbf3159a640 1 -- 172.21.15.44:0/3416051668 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2402cc20 con 0x7fbf1c004d00 2023-11-04T01:44:27.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.617+0000 7fbf3159a640 1 -- 172.21.15.44:0/3416051668 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2400f040 con 0x7fbf1c004d00 2023-11-04T01:44:27.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.617+0000 7fbf3159a640 1 -- 172.21.15.44:0/3416051668 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf24034440 con 0x7fbf1c004d00 2023-11-04T01:44:27.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.618+0000 7fbf38a10640 1 -- 172.21.15.44:0/3416051668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1c004d00 msgr2=0x7fbf1c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.618+0000 7fbf38a10640 1 --2- 172.21.15.44:0/3416051668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1c004d00 0x7fbf1c005180 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fbf24009fc0 tx=0x7fbf1c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.618+0000 7fbf32d9d640 1 -- 172.21.15.44:0/3416051668 reap_dead start 2023-11-04T01:44:27.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.618+0000 7fbf38a10640 1 -- 172.21.15.44:0/3416051668 shutdown_connections 2023-11-04T01:44:27.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.618+0000 7fbf38a10640 1 -- 172.21.15.44:0/3416051668 >> 172.21.15.44:0/3416051668 conn(0x7fbf340d0c30 msgr2=0x7fbf340d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.618+0000 7fbf38a10640 1 -- 172.21.15.44:0/3416051668 shutdown_connections 2023-11-04T01:44:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.618+0000 7fbf38a10640 1 -- 172.21.15.44:0/3416051668 wait complete. 2023-11-04T01:44:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.619+0000 7fbf38a10640 1 Processor -- start 2023-11-04T01:44:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.619+0000 7fbf38a10640 1 -- start start 2023-11-04T01:44:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf38a10640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1c004d00 0x7fbf341e5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf38a10640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf34158360 0x7fbf341e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf38a10640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf340cd280 0x7fbf34158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf38a10640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf341e5d80 con 0x7fbf1c004d00 2023-11-04T01:44:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf38a10640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340cc200 con 0x7fbf34158360 2023-11-04T01:44:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf38a10640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340cc4c0 con 0x7fbf340cd280 2023-11-04T01:44:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf3259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1c004d00 0x7fbf341e5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf3259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1c004d00 0x7fbf341e5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51486/0 (socket says 172.21.15.44:51486) 2023-11-04T01:44:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf3259c640 1 -- 172.21.15.44:0/1059389924 learned_addr learned my addr 172.21.15.44:0/1059389924 (peer_addr_for_me v2:172.21.15.44:0/0) 2023-11-04T01:44:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf31d9b640 1 --2- 172.21.15.44:0/1059389924 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf34158360 0x7fbf341e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf32d9d640 1 --2- 172.21.15.44:0/1059389924 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf340cd280 0x7fbf34158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf3259c640 1 -- 172.21.15.44:0/1059389924 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf340cd280 msgr2=0x7fbf34158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf3259c640 1 --2- 172.21.15.44:0/1059389924 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf340cd280 0x7fbf34158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf3259c640 1 -- 172.21.15.44:0/1059389924 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf34158360 msgr2=0x7fbf341e71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf3259c640 1 --2- 172.21.15.44:0/1059389924 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf34158360 0x7fbf341e71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf3259c640 1 -- 172.21.15.44:0/1059389924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf340cc7a0 con 0x7fbf1c004d00 2023-11-04T01:44:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.620+0000 7fbf31d9b640 1 --2- 172.21.15.44:0/1059389924 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf34158360 0x7fbf341e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.621+0000 7fbf3259c640 1 --2- 172.21.15.44:0/1059389924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1c004d00 0x7fbf341e5840 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00f820 tx=0x7fbf2c00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.621+0000 7fbf22ffd640 1 -- 172.21.15.44:0/1059389924 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c0050d0 con 0x7fbf1c004d00 2023-11-04T01:44:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.621+0000 7fbf22ffd640 1 -- 172.21.15.44:0/1059389924 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c005230 con 0x7fbf1c004d00 2023-11-04T01:44:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.621+0000 7fbf38a10640 1 -- 172.21.15.44:0/1059389924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf340cca80 con 0x7fbf1c004d00 2023-11-04T01:44:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.621+0000 7fbf22ffd640 1 -- 172.21.15.44:0/1059389924 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c00d6d0 con 0x7fbf1c004d00 2023-11-04T01:44:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.621+0000 7fbf38a10640 1 -- 172.21.15.44:0/1059389924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf341e7700 con 0x7fbf1c004d00 2023-11-04T01:44:27.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.622+0000 7fbf38a10640 1 -- 172.21.15.44:0/1059389924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf340684b0 con 0x7fbf1c004d00 2023-11-04T01:44:27.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.622+0000 7fbf22ffd640 1 -- 172.21.15.44:0/1059389924 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf2c00d830 con 0x7fbf1c004d00 2023-11-04T01:44:27.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.623+0000 7fbf22ffd640 1 --2- 172.21.15.44:0/1059389924 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf1406ae40 0x7fbf1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.623+0000 7fbf22ffd640 1 -- 172.21.15.44:0/1059389924 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fbf2c089ea0 con 0x7fbf1c004d00 2023-11-04T01:44:27.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.623+0000 7fbf31d9b640 1 --2- 172.21.15.44:0/1059389924 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf1406ae40 0x7fbf1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.624+0000 7fbf31d9b640 1 --2- 172.21.15.44:0/1059389924 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf1406ae40 0x7fbf1406d300 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbf280010e0 tx=0x7fbf28001d40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.627+0000 7fbf22ffd640 1 -- 172.21.15.44:0/1059389924 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbf2c054640 con 0x7fbf1c004d00 2023-11-04T01:44:27.822 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.820+0000 7fbf38a10640 1 -- 172.21.15.44:0/1059389924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbf340af5a0 con 0x7fbf1c004d00 2023-11-04T01:44:27.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.821+0000 7fbf22ffd640 1 -- 172.21.15.44:0/1059389924 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v116) v1 ==== 81+0+1394 (secure 0 0 0) 0x7fbf2c057c60 con 0x7fbf1c004d00 2023-11-04T01:44:27.823 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/2720398401 2023-11-05T01:43:41.768312+0000 2023-11-04T01:44:27.823 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.1:0/1398028154 2023-11-04T02:42:59.149511+0000 2023-11-04T01:44:27.823 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/3267689413 2023-11-05T01:42:50.946757+0000 2023-11-04T01:44:27.823 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/3264332323 2023-11-05T01:42:44.043453+0000 2023-11-04T01:44:27.823 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6832/22987540 2023-11-05T01:43:34.391624+0000 2023-11-04T01:44:27.823 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/3264332323 2023-11-05T01:42:44.043453+0000 2023-11-04T01:44:27.823 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6832/2069525699 2023-11-05T01:42:05.849526+0000 2023-11-04T01:44:27.823 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/22987540 2023-11-05T01:43:34.391624+0000 2023-11-04T01:44:27.823 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/3267689413 2023-11-05T01:42:50.946757+0000 2023-11-04T01:44:27.824 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/2461924520 2023-11-05T01:40:15.032018+0000 2023-11-04T01:44:27.824 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/3287638895 2023-11-05T01:41:58.941997+0000 2023-11-04T01:44:27.824 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/2720398401 2023-11-05T01:43:41.768312+0000 2023-11-04T01:44:27.824 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/2069525699 2023-11-05T01:42:05.849526+0000 2023-11-04T01:44:27.824 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.1:0/1480686415 2023-11-04T02:43:49.496043+0000 2023-11-04T01:44:27.824 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/2252282753 2023-11-05T01:40:40.408324+0000 2023-11-04T01:44:27.824 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/2252282753 2023-11-05T01:40:40.408324+0000 2023-11-04T01:44:27.824 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/2461924520 2023-11-05T01:40:15.032018+0000 2023-11-04T01:44:27.824 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.1:0/780133444 2023-11-04T02:42:14.050728+0000 2023-11-04T01:44:27.824 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/1627866359 2023-11-05T01:41:31.011032+0000 2023-11-04T01:44:27.824 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/1627866359 2023-11-05T01:41:31.011032+0000 2023-11-04T01:44:27.824 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6834/3065829953 2023-11-05T01:41:05.691698+0000 2023-11-04T01:44:27.824 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/3287638895 2023-11-05T01:41:58.941997+0000 2023-11-04T01:44:27.824 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.204:6836/3065829953 2023-11-05T01:41:05.691698+0000 2023-11-04T01:44:27.825 INFO:teuthology.orchestra.run.smithi044.stderr:listed 23 entries 2023-11-04T01:44:27.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.823+0000 7fbf38a10640 1 -- 172.21.15.44:0/1059389924 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf1406ae40 msgr2=0x7fbf1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.823+0000 7fbf38a10640 1 --2- 172.21.15.44:0/1059389924 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf1406ae40 0x7fbf1406d300 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbf280010e0 tx=0x7fbf28001d40 comp rx=0 tx=0).stop 2023-11-04T01:44:27.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.823+0000 7fbf38a10640 1 -- 172.21.15.44:0/1059389924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1c004d00 msgr2=0x7fbf341e5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.823+0000 7fbf38a10640 1 --2- 172.21.15.44:0/1059389924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1c004d00 0x7fbf341e5840 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00f820 tx=0x7fbf2c00fce0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.823+0000 7fbf38a10640 1 -- 172.21.15.44:0/1059389924 shutdown_connections 2023-11-04T01:44:27.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.823+0000 7fbf38a10640 1 --2- 172.21.15.44:0/1059389924 >> [v2:172.21.15.204:6832/2251630012,v1:172.21.15.204:6833/2251630012] conn(0x7fbf1406ae40 0x7fbf1406d300 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.823+0000 7fbf38a10640 1 --2- 172.21.15.44:0/1059389924 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbf340cd280 0x7fbf34158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.823+0000 7fbf38a10640 1 --2- 172.21.15.44:0/1059389924 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbf34158360 0x7fbf341e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.823+0000 7fbf38a10640 1 --2- 172.21.15.44:0/1059389924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1c004d00 0x7fbf341e5840 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.823+0000 7fbf38a10640 1 -- 172.21.15.44:0/1059389924 >> 172.21.15.44:0/1059389924 conn(0x7fbf340d0c30 msgr2=0x7fbf340afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:27.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.823+0000 7fbf38a10640 1 -- 172.21.15.44:0/1059389924 shutdown_connections 2023-11-04T01:44:27.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27.823+0000 7fbf38a10640 1 -- 172.21.15.44:0/1059389924 wait complete. 2023-11-04T01:44:27.836 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2023-11-04T01:44:27.836 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:44:27.836 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:27.899 INFO:teuthology.orchestra.run.smithi044.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.0: Device or resource busy 2023-11-04T01:44:27.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:27.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:27 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2023-11-04T01:44:27.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:27.906 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi044.front.sepia.ceph.com, aborting... 2023-11-04T01:44:27.906 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:44:27.906 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer --timeout=300 -- env PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-11-04T01:44:28.847 INFO:teuthology.orchestra.run.smithi044.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-11-04T01:44:28.847 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.848 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.848 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-04T01:44:28.848 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 596532 1143 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:44:28.848 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.848 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.848 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.848 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.848 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.848 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.848 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:44:28.848 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.848 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:28.849 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.849 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.849 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.849 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.849 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.849 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:28.849 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.849 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:44:28.849 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:28.849 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.849 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:44:28.849 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.849 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.850 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-04T01:44:28.850 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:44:28.850 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:28.850 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:28.850 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:44:28.850 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.850 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 21219 1665 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:44:28.850 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.850 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:28.850 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.850 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.850 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.850 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 3w CHR 1,11 0t0 10 /dev/kmsg 2023-11-04T01:44:28.851 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 4u a_inode 0,14 0 1081 [eventpoll:5,6,8,11,16,17,18,19,44,45,49,50,51,60,66,76,77,81,83,84,102,103,109,111,112,113,119,125,126,127,129,130...] 2023-11-04T01:44:28.851 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 5u a_inode 0,14 0 1081 [signalfd] 2023-11-04T01:44:28.851 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 6r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.851 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 7r DIR 0,25 0 1 /sys/fs/cgroup 2023-11-04T01:44:28.851 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 8u a_inode 0,14 0 1081 [timerfd] 2023-11-04T01:44:28.851 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 9u a_inode 0,14 0 1081 [eventpoll:10,13] 2023-11-04T01:44:28.851 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 10r REG 0,20 0 17 /proc/1/mountinfo 2023-11-04T01:44:28.851 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 11r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.851 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 12u netlink 0t0 15788 AUDIT 2023-11-04T01:44:28.851 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 13r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.851 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 14r REG 0,20 0 4026532076 /proc/swaps 2023-11-04T01:44:28.851 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 15u netlink 0t0 15780 KOBJECT_UEVENT 2023-11-04T01:44:28.851 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 16u unix 0xffff982f4414e1c0 0t0 15782 /run/systemd/private type=STREAM (LISTEN) 2023-11-04T01:44:28.851 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 17r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.852 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 18u a_inode 0,14 0 1081 [timerfd] 2023-11-04T01:44:28.852 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 19r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.852 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 20u a_inode 0,14 0 1081 bpf-prog 2023-11-04T01:44:28.852 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 21u a_inode 0,14 0 1081 bpf-prog 2023-11-04T01:44:28.852 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 22u a_inode 0,14 0 1081 bpf-prog 2023-11-04T01:44:28.852 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 23u a_inode 0,14 0 1081 bpf-prog 2023-11-04T01:44:28.852 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 24u a_inode 0,14 0 1081 bpf-prog 2023-11-04T01:44:28.852 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 25u unix 0xffff982f4842bb80 0t0 1022 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.852 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 26u a_inode 0,14 0 1081 bpf-prog 2023-11-04T01:44:28.852 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 27r CHR 10,235 0t0 111 /dev/autofs 2023-11-04T01:44:28.852 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 28u a_inode 0,14 0 1081 bpf-prog 2023-11-04T01:44:28.852 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 29u a_inode 0,14 0 1081 bpf-prog 2023-11-04T01:44:28.852 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 30u a_inode 0,14 0 1081 bpf-prog 2023-11-04T01:44:28.853 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 31u a_inode 0,14 0 1081 bpf-prog 2023-11-04T01:44:28.853 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 44u unix 0xffff982f485c2a80 0t0 25 /run/systemd/io.system.ManagedOOM type=STREAM (LISTEN) 2023-11-04T01:44:28.853 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 45u unix 0xffff982f485c4c80 0t0 24 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM (LISTEN) 2023-11-04T01:44:28.853 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 49u unix 0xffff982f4842aec0 0t0 19 /run/systemd/notify type=DGRAM (CONNECTED) 2023-11-04T01:44:28.853 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 50u unix 0xffff982f4842ea40 0t0 20 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.853 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 51u a_inode 0,14 0 1081 [timerfd] 2023-11-04T01:44:28.853 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 54u unix 0xffff982f48428440 0t0 21 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.853 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 60u unix 0xffff982f48d53fc0 0t0 2480 type=STREAM (CONNECTED) 2023-11-04T01:44:28.853 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 66u unix 0xffff982f485c5d80 0t0 972 /run/lvm/lvmpolld.socket type=STREAM (LISTEN) 2023-11-04T01:44:28.853 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 71u unix 0xffff982f48d55d80 0t0 2472 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-04T01:44:28.853 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 75u netlink 0t0 988 KOBJECT_UEVENT 2023-11-04T01:44:28.853 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 76u CHR 10,242 0t0 165 /dev/rfkill 2023-11-04T01:44:28.853 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 77r FIFO 0,13 0t0 15792 pipe 2023-11-04T01:44:28.853 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 78u unix 0xffff982f4842a640 0t0 34 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-11-04T01:44:28.854 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 79u unix 0xffff982f485c6e80 0t0 36 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-11-04T01:44:28.854 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 81u unix 0xffff982f4842e1c0 0t0 984 /run/systemd/coredump type=SEQPACKET (LISTEN) 2023-11-04T01:44:28.854 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 83u FIFO 0,24 0t0 441 /run/dmeventd-server 2023-11-04T01:44:28.854 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 84u FIFO 0,24 0t0 442 /run/dmeventd-client 2023-11-04T01:44:28.854 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 88u unix 0xffff982f4842fb40 0t0 32 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-11-04T01:44:28.854 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 89u unix 0xffff982f485c1980 0t0 974 /run/rpcbind.sock type=STREAM (LISTEN) 2023-11-04T01:44:28.854 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 92u IPv4 18640 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:44:28.854 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 93u IPv4 18646 0t0 UDP *:sunrpc 2023-11-04T01:44:28.854 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 94u IPv6 16783 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:44:28.854 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 95u IPv6 19836 0t0 UDP *:sunrpc 2023-11-04T01:44:28.854 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 102u FIFO 0,24 0t0 447 /run/initctl 2023-11-04T01:44:28.854 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 103u unix 0xffff982f48d51dc0 0t0 2474 /run/.heim_org.h5l.kcm-socket type=STREAM (LISTEN) 2023-11-04T01:44:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 108u unix 0xffff982f48f772c0 0t0 162735 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 109u unix 0xffff982f48699100 0t0 21995 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 110u unix 0xffff982f48f70440 0t0 20026 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 111u unix 0xffff982f48d55940 0t0 17111 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 112u unix 0xffff982f48c1fb40 0t0 17110 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 113u unix 0xffff982f48d52640 0t0 17109 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 114u unix 0xffff982f4414c840 0t0 22863 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 118u unix 0xffff982f4869bb80 0t0 22859 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 119u unix 0xffff982f487b0000 0t0 15892 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 125u unix 0xffff982f41e15500 0t0 15891 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 126u unix 0xffff982f41e13b80 0t0 15882 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 127u unix 0xffff982f485c6600 0t0 15881 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 129u unix 0xffff982f48d50440 0t0 20603 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.856 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 130u unix 0xffff982f48698cc0 0t0 17757 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.856 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1 root 134u unix 0xffff982f4842bfc0 0t0 986 /run/udev/control type=SEQPACKET (LISTEN) 2023-11-04T01:44:28.856 INFO:teuthology.orchestra.run.smithi044.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.856 INFO:teuthology.orchestra.run.smithi044.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.856 INFO:teuthology.orchestra.run.smithi044.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-11-04T01:44:28.856 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.856 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.856 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-11-04T01:44:28.856 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.856 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.856 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-11-04T01:44:28.856 INFO:teuthology.orchestra.run.smithi044.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.856 INFO:teuthology.orchestra.run.smithi044.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.857 INFO:teuthology.orchestra.run.smithi044.stdout:slub_flus 5 root txt unknown /proc/5/exe 2023-11-04T01:44:28.857 INFO:teuthology.orchestra.run.smithi044.stdout:netns 6 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.857 INFO:teuthology.orchestra.run.smithi044.stdout:netns 6 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.857 INFO:teuthology.orchestra.run.smithi044.stdout:netns 6 root txt unknown /proc/6/exe 2023-11-04T01:44:28.857 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.857 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.857 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/0 8 root txt unknown /proc/8/exe 2023-11-04T01:44:28.857 INFO:teuthology.orchestra.run.smithi044.stdout:mm_percpu 11 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.857 INFO:teuthology.orchestra.run.smithi044.stdout:mm_percpu 11 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.857 INFO:teuthology.orchestra.run.smithi044.stdout:mm_percpu 11 root txt unknown /proc/11/exe 2023-11-04T01:44:28.857 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_tasks 13 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.857 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_tasks 13 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.858 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_tasks 13 root txt unknown /proc/13/exe 2023-11-04T01:44:28.858 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_tasks 14 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.858 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_tasks 14 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.858 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_tasks 14 root txt unknown /proc/14/exe 2023-11-04T01:44:28.858 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_tasks 15 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.858 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_tasks 15 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.858 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_tasks 15 root txt unknown /proc/15/exe 2023-11-04T01:44:28.858 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 16 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.858 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 16 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.858 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 16 root txt unknown /proc/16/exe 2023-11-04T01:44:28.858 INFO:teuthology.orchestra.run.smithi044.stdout:pr/ttyS1 17 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.858 INFO:teuthology.orchestra.run.smithi044.stdout:pr/ttyS1 17 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.858 INFO:teuthology.orchestra.run.smithi044.stdout:pr/ttyS1 17 root txt unknown /proc/17/exe 2023-11-04T01:44:28.858 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_preem 18 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.859 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_preem 18 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.859 INFO:teuthology.orchestra.run.smithi044.stdout:rcu_preem 18 root txt unknown /proc/18/exe 2023-11-04T01:44:28.859 INFO:teuthology.orchestra.run.smithi044.stdout:migration 19 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.859 INFO:teuthology.orchestra.run.smithi044.stdout:migration 19 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.859 INFO:teuthology.orchestra.run.smithi044.stdout:migration 19 root txt unknown /proc/19/exe 2023-11-04T01:44:28.859 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 20 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.859 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 20 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.859 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 20 root txt unknown /proc/20/exe 2023-11-04T01:44:28.859 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/0 21 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.859 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/0 21 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.859 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/0 21 root txt unknown /proc/21/exe 2023-11-04T01:44:28.859 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/1 22 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.859 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/1 22 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.860 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/1 22 root txt unknown /proc/22/exe 2023-11-04T01:44:28.860 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 23 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.860 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 23 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.860 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 23 root txt unknown /proc/23/exe 2023-11-04T01:44:28.860 INFO:teuthology.orchestra.run.smithi044.stdout:migration 24 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.860 INFO:teuthology.orchestra.run.smithi044.stdout:migration 24 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.860 INFO:teuthology.orchestra.run.smithi044.stdout:migration 24 root txt unknown /proc/24/exe 2023-11-04T01:44:28.860 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 25 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.860 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 25 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.860 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 25 root txt unknown /proc/25/exe 2023-11-04T01:44:28.860 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/1 27 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.860 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/1 27 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.860 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/1 27 root txt unknown /proc/27/exe 2023-11-04T01:44:28.861 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/2 28 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.861 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/2 28 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.861 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/2 28 root txt unknown /proc/28/exe 2023-11-04T01:44:28.861 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 29 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.861 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 29 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.861 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 29 root txt unknown /proc/29/exe 2023-11-04T01:44:28.861 INFO:teuthology.orchestra.run.smithi044.stdout:migration 30 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.861 INFO:teuthology.orchestra.run.smithi044.stdout:migration 30 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.861 INFO:teuthology.orchestra.run.smithi044.stdout:migration 30 root txt unknown /proc/30/exe 2023-11-04T01:44:28.861 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 31 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.861 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 31 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.861 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 31 root txt unknown /proc/31/exe 2023-11-04T01:44:28.861 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/2 33 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.861 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/2 33 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.862 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/2 33 root txt unknown /proc/33/exe 2023-11-04T01:44:28.862 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/3 34 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.862 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/3 34 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.862 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/3 34 root txt unknown /proc/34/exe 2023-11-04T01:44:28.862 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 35 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.862 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 35 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.862 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 35 root txt unknown /proc/35/exe 2023-11-04T01:44:28.862 INFO:teuthology.orchestra.run.smithi044.stdout:migration 36 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.862 INFO:teuthology.orchestra.run.smithi044.stdout:migration 36 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.862 INFO:teuthology.orchestra.run.smithi044.stdout:migration 36 root txt unknown /proc/36/exe 2023-11-04T01:44:28.862 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 37 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.862 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 37 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.862 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 37 root txt unknown /proc/37/exe 2023-11-04T01:44:28.863 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/3 39 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.863 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/3 39 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.863 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/3 39 root txt unknown /proc/39/exe 2023-11-04T01:44:28.863 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/4 40 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.863 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/4 40 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.863 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/4 40 root txt unknown /proc/40/exe 2023-11-04T01:44:28.863 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 41 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.863 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 41 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.863 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 41 root txt unknown /proc/41/exe 2023-11-04T01:44:28.863 INFO:teuthology.orchestra.run.smithi044.stdout:migration 42 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.863 INFO:teuthology.orchestra.run.smithi044.stdout:migration 42 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.863 INFO:teuthology.orchestra.run.smithi044.stdout:migration 42 root txt unknown /proc/42/exe 2023-11-04T01:44:28.863 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 43 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.863 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 43 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.864 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 43 root txt unknown /proc/43/exe 2023-11-04T01:44:28.864 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/4 45 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.864 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/4 45 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.864 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/4 45 root txt unknown /proc/45/exe 2023-11-04T01:44:28.864 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/5 46 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.864 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/5 46 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.864 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/5 46 root txt unknown /proc/46/exe 2023-11-04T01:44:28.864 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 47 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.864 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 47 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.864 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 47 root txt unknown /proc/47/exe 2023-11-04T01:44:28.864 INFO:teuthology.orchestra.run.smithi044.stdout:migration 48 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.864 INFO:teuthology.orchestra.run.smithi044.stdout:migration 48 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.864 INFO:teuthology.orchestra.run.smithi044.stdout:migration 48 root txt unknown /proc/48/exe 2023-11-04T01:44:28.864 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 49 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.865 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 49 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.865 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 49 root txt unknown /proc/49/exe 2023-11-04T01:44:28.865 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/5 51 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.865 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/5 51 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.865 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/5 51 root txt unknown /proc/51/exe 2023-11-04T01:44:28.865 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/6 52 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.865 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/6 52 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.865 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/6 52 root txt unknown /proc/52/exe 2023-11-04T01:44:28.865 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 53 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.865 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 53 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.865 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 53 root txt unknown /proc/53/exe 2023-11-04T01:44:28.865 INFO:teuthology.orchestra.run.smithi044.stdout:migration 54 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.866 INFO:teuthology.orchestra.run.smithi044.stdout:migration 54 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.866 INFO:teuthology.orchestra.run.smithi044.stdout:migration 54 root txt unknown /proc/54/exe 2023-11-04T01:44:28.866 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 55 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.866 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 55 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.866 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 55 root txt unknown /proc/55/exe 2023-11-04T01:44:28.866 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 57 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.866 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 57 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.866 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 57 root txt unknown /proc/57/exe 2023-11-04T01:44:28.866 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/7 58 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.866 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/7 58 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.866 INFO:teuthology.orchestra.run.smithi044.stdout:cpuhp/7 58 root txt unknown /proc/58/exe 2023-11-04T01:44:28.866 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 59 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.866 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 59 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.867 INFO:teuthology.orchestra.run.smithi044.stdout:idle_inje 59 root txt unknown /proc/59/exe 2023-11-04T01:44:28.867 INFO:teuthology.orchestra.run.smithi044.stdout:migration 60 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.867 INFO:teuthology.orchestra.run.smithi044.stdout:migration 60 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.867 INFO:teuthology.orchestra.run.smithi044.stdout:migration 60 root txt unknown /proc/60/exe 2023-11-04T01:44:28.867 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 61 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.867 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 61 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.867 INFO:teuthology.orchestra.run.smithi044.stdout:ksoftirqd 61 root txt unknown /proc/61/exe 2023-11-04T01:44:28.867 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/7 63 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.867 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/7 63 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.867 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/7 63 root txt unknown /proc/63/exe 2023-11-04T01:44:28.867 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 69 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.867 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 69 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.867 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 69 root txt unknown /proc/69/exe 2023-11-04T01:44:28.867 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 70 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 70 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 70 root txt unknown /proc/70/exe 2023-11-04T01:44:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:kdevtmpfs 71 root cwd DIR 0,5 3500 1 / 2023-11-04T01:44:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:kdevtmpfs 71 root rtd DIR 0,5 3500 1 / 2023-11-04T01:44:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:kdevtmpfs 71 root txt unknown /proc/71/exe 2023-11-04T01:44:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:inet_frag 72 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:inet_frag 72 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:inet_frag 72 root txt unknown /proc/72/exe 2023-11-04T01:44:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:kauditd 73 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:kauditd 73 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:kauditd 73 root txt unknown /proc/73/exe 2023-11-04T01:44:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:khungtask 75 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:khungtask 75 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:khungtask 75 root txt unknown /proc/75/exe 2023-11-04T01:44:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:oom_reape 76 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:oom_reape 76 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:oom_reape 76 root txt unknown /proc/76/exe 2023-11-04T01:44:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:writeback 77 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:writeback 77 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:writeback 77 root txt unknown /proc/77/exe 2023-11-04T01:44:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:kcompactd 78 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:kcompactd 78 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:kcompactd 78 root txt unknown /proc/78/exe 2023-11-04T01:44:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:ksmd 79 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:ksmd 79 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:ksmd 79 root txt unknown /proc/79/exe 2023-11-04T01:44:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:khugepage 81 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:khugepage 81 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:khugepage 81 root txt unknown /proc/81/exe 2023-11-04T01:44:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:cryptd 82 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:cryptd 82 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:cryptd 82 root txt unknown /proc/82/exe 2023-11-04T01:44:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:kintegrit 83 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:kintegrit 83 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:kintegrit 83 root txt unknown /proc/83/exe 2023-11-04T01:44:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:kblockd 84 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:kblockd 84 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:kblockd 84 root txt unknown /proc/84/exe 2023-11-04T01:44:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:blkcg_pun 85 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:blkcg_pun 85 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:blkcg_pun 85 root txt unknown /proc/85/exe 2023-11-04T01:44:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:tpm_dev_w 86 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:tpm_dev_w 86 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:tpm_dev_w 86 root txt unknown /proc/86/exe 2023-11-04T01:44:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:md 87 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:md 87 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:md 87 root txt unknown /proc/87/exe 2023-11-04T01:44:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:md_bitmap 88 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:md_bitmap 88 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:md_bitmap 88 root txt unknown /proc/88/exe 2023-11-04T01:44:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:edac-poll 89 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:edac-poll 89 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:edac-poll 89 root txt unknown /proc/89/exe 2023-11-04T01:44:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:watchdogd 90 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:watchdogd 90 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:watchdogd 90 root txt unknown /proc/90/exe 2023-11-04T01:44:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/1 93 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/1 93 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/1 93 root txt unknown /proc/93/exe 2023-11-04T01:44:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:kswapd0 95 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:kswapd0 95 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:kswapd0 95 root txt unknown /proc/95/exe 2023-11-04T01:44:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:kthrotld 100 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:kthrotld 100 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:kthrotld 100 root txt unknown /proc/100/exe 2023-11-04T01:44:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/5 101 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.873 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/5 101 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.873 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/5 101 root txt unknown /proc/101/exe 2023-11-04T01:44:28.873 INFO:teuthology.orchestra.run.smithi044.stdout:acpi_ther 109 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.873 INFO:teuthology.orchestra.run.smithi044.stdout:acpi_ther 109 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.873 INFO:teuthology.orchestra.run.smithi044.stdout:acpi_ther 109 root txt unknown /proc/109/exe 2023-11-04T01:44:28.873 INFO:teuthology.orchestra.run.smithi044.stdout:kmpath_rd 110 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.873 INFO:teuthology.orchestra.run.smithi044.stdout:kmpath_rd 110 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.873 INFO:teuthology.orchestra.run.smithi044.stdout:kmpath_rd 110 root txt unknown /proc/110/exe 2023-11-04T01:44:28.873 INFO:teuthology.orchestra.run.smithi044.stdout:kaluad 111 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.873 INFO:teuthology.orchestra.run.smithi044.stdout:kaluad 111 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.873 INFO:teuthology.orchestra.run.smithi044.stdout:kaluad 111 root txt unknown /proc/111/exe 2023-11-04T01:44:28.873 INFO:teuthology.orchestra.run.smithi044.stdout:mld 113 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.873 INFO:teuthology.orchestra.run.smithi044.stdout:mld 113 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.874 INFO:teuthology.orchestra.run.smithi044.stdout:mld 113 root txt unknown /proc/113/exe 2023-11-04T01:44:28.874 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/5 114 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.874 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/5 114 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.874 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/5 114 root txt unknown /proc/114/exe 2023-11-04T01:44:28.874 INFO:teuthology.orchestra.run.smithi044.stdout:ipv6_addr 115 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.874 INFO:teuthology.orchestra.run.smithi044.stdout:ipv6_addr 115 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.874 INFO:teuthology.orchestra.run.smithi044.stdout:ipv6_addr 115 root txt unknown /proc/115/exe 2023-11-04T01:44:28.874 INFO:teuthology.orchestra.run.smithi044.stdout:kstrp 124 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.874 INFO:teuthology.orchestra.run.smithi044.stdout:kstrp 124 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.874 INFO:teuthology.orchestra.run.smithi044.stdout:kstrp 124 root txt unknown /proc/124/exe 2023-11-04T01:44:28.874 INFO:teuthology.orchestra.run.smithi044.stdout:zswap-shr 130 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.875 INFO:teuthology.orchestra.run.smithi044.stdout:zswap-shr 130 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.875 INFO:teuthology.orchestra.run.smithi044.stdout:zswap-shr 130 root txt unknown /proc/130/exe 2023-11-04T01:44:28.875 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 237 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.875 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 237 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.875 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 237 root txt unknown /proc/237/exe 2023-11-04T01:44:28.875 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/0 276 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.875 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/0 276 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.875 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/0 276 root txt unknown /proc/276/exe 2023-11-04T01:44:28.875 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/4 288 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.875 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/4 288 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.875 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/4 288 root txt unknown /proc/288/exe 2023-11-04T01:44:28.875 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/2 292 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.876 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/2 292 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.876 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/2 292 root txt unknown /proc/292/exe 2023-11-04T01:44:28.876 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/7 324 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.876 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/7 324 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.876 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/7 324 root txt unknown /proc/324/exe 2023-11-04T01:44:28.876 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/3 356 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.876 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/3 356 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.876 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/3 356 root txt unknown /proc/356/exe 2023-11-04T01:44:28.876 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 408 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.877 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 408 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.877 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 408 root txt unknown /proc/408/exe 2023-11-04T01:44:28.877 INFO:teuthology.orchestra.run.smithi044.stdout:nvme-wq 427 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.877 INFO:teuthology.orchestra.run.smithi044.stdout:nvme-wq 427 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.877 INFO:teuthology.orchestra.run.smithi044.stdout:nvme-wq 427 root txt unknown /proc/427/exe 2023-11-04T01:44:28.877 INFO:teuthology.orchestra.run.smithi044.stdout:nvme-rese 430 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.877 INFO:teuthology.orchestra.run.smithi044.stdout:nvme-rese 430 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.877 INFO:teuthology.orchestra.run.smithi044.stdout:nvme-rese 430 root txt unknown /proc/430/exe 2023-11-04T01:44:28.877 INFO:teuthology.orchestra.run.smithi044.stdout:nvme-dele 431 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.877 INFO:teuthology.orchestra.run.smithi044.stdout:nvme-dele 431 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.877 INFO:teuthology.orchestra.run.smithi044.stdout:nvme-dele 431 root txt unknown /proc/431/exe 2023-11-04T01:44:28.877 INFO:teuthology.orchestra.run.smithi044.stdout:nvme-auth 432 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.877 INFO:teuthology.orchestra.run.smithi044.stdout:nvme-auth 432 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.877 INFO:teuthology.orchestra.run.smithi044.stdout:nvme-auth 432 root txt unknown /proc/432/exe 2023-11-04T01:44:28.878 INFO:teuthology.orchestra.run.smithi044.stdout:ata_sff 438 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.878 INFO:teuthology.orchestra.run.smithi044.stdout:ata_sff 438 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.878 INFO:teuthology.orchestra.run.smithi044.stdout:ata_sff 438 root txt unknown /proc/438/exe 2023-11-04T01:44:28.878 INFO:teuthology.orchestra.run.smithi044.stdout:ixgbe 448 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.878 INFO:teuthology.orchestra.run.smithi044.stdout:ixgbe 448 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.878 INFO:teuthology.orchestra.run.smithi044.stdout:ixgbe 448 root txt unknown /proc/448/exe 2023-11-04T01:44:28.878 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_0 449 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.878 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_0 449 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.878 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_0 449 root txt unknown /proc/449/exe 2023-11-04T01:44:28.878 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 450 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.878 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 450 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.878 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 450 root txt unknown /proc/450/exe 2023-11-04T01:44:28.879 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_1 451 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.879 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_1 451 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.879 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_1 451 root txt unknown /proc/451/exe 2023-11-04T01:44:28.879 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 452 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.879 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 452 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.879 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 452 root txt unknown /proc/452/exe 2023-11-04T01:44:28.879 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_2 453 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.879 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_2 453 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.879 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_2 453 root txt unknown /proc/453/exe 2023-11-04T01:44:28.879 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 454 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.879 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 454 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.879 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 454 root txt unknown /proc/454/exe 2023-11-04T01:44:28.879 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_3 455 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.879 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_3 455 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.880 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_3 455 root txt unknown /proc/455/exe 2023-11-04T01:44:28.880 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 456 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.880 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 456 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.880 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 456 root txt unknown /proc/456/exe 2023-11-04T01:44:28.880 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_4 457 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.880 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_4 457 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.880 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_4 457 root txt unknown /proc/457/exe 2023-11-04T01:44:28.880 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 458 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.880 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 458 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.880 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 458 root txt unknown /proc/458/exe 2023-11-04T01:44:28.880 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_5 459 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.880 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_5 459 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.881 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_5 459 root txt unknown /proc/459/exe 2023-11-04T01:44:28.881 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 460 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.881 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 460 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.881 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 460 root txt unknown /proc/460/exe 2023-11-04T01:44:28.881 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_6 461 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.881 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_6 461 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.881 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_6 461 root txt unknown /proc/461/exe 2023-11-04T01:44:28.881 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 462 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.881 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 462 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.881 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 462 root txt unknown /proc/462/exe 2023-11-04T01:44:28.881 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_7 463 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.881 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_7 463 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.882 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_7 463 root txt unknown /proc/463/exe 2023-11-04T01:44:28.882 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 464 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.882 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 464 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.882 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 464 root txt unknown /proc/464/exe 2023-11-04T01:44:28.882 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_8 465 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.882 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_8 465 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.882 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_8 465 root txt unknown /proc/465/exe 2023-11-04T01:44:28.882 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 466 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.882 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 466 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.882 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 466 root txt unknown /proc/466/exe 2023-11-04T01:44:28.882 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_9 467 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.882 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_9 467 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.882 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_eh_9 467 root txt unknown /proc/467/exe 2023-11-04T01:44:28.883 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 468 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.883 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 468 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.883 INFO:teuthology.orchestra.run.smithi044.stdout:scsi_tmf_ 468 root txt unknown /proc/468/exe 2023-11-04T01:44:28.883 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 470 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.883 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 470 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.883 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 470 root txt unknown /proc/470/exe 2023-11-04T01:44:28.883 INFO:teuthology.orchestra.run.smithi044.stdout:jbd2/sda1 492 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.883 INFO:teuthology.orchestra.run.smithi044.stdout:jbd2/sda1 492 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.883 INFO:teuthology.orchestra.run.smithi044.stdout:jbd2/sda1 492 root txt unknown /proc/492/exe 2023-11-04T01:44:28.883 INFO:teuthology.orchestra.run.smithi044.stdout:ext4-rsv- 493 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.883 INFO:teuthology.orchestra.run.smithi044.stdout:ext4-rsv- 493 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.883 INFO:teuthology.orchestra.run.smithi044.stdout:ext4-rsv- 493 root txt unknown /proc/493/exe 2023-11-04T01:44:28.883 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.884 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.884 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root txt REG 8,1 185496 20360 /usr/lib/systemd/systemd-journald 2023-11-04T01:44:28.884 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:28.884 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:28.884 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.884 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.884 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.884 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.884 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.884 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:28.884 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.884 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.884 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.884 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:44:28.885 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:28.885 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.885 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.885 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.885 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.885 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.885 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:28.885 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:44:28.885 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:44:28.885 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:28.885 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:44:28.885 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.885 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.885 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:44:28.886 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.886 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.886 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.886 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root mem REG 0,24 8 55 /run/systemd/journal/kernel-seqnum 2023-11-04T01:44:28.886 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.886 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.886 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.886 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 3u unix 0xffff982f4842fb40 0t0 32 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-11-04T01:44:28.886 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 4u unix 0xffff982f4842a640 0t0 34 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-11-04T01:44:28.886 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 5u unix 0xffff982f485c6e80 0t0 36 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-11-04T01:44:28.886 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 6w CHR 1,11 0t0 10 /dev/kmsg 2023-11-04T01:44:28.886 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 7u a_inode 0,14 0 1081 [eventpoll:3,4,5,8,9,10,11,12,13,15,17,18,19,20,21,23,24,25,27,28,29,30,32,33] 2023-11-04T01:44:28.887 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 8u CHR 1,11 0t0 10 /dev/kmsg 2023-11-04T01:44:28.887 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 9u unix 0xffff982f48d52200 0t0 2369 /run/systemd/journal/io.systemd.journal type=STREAM (LISTEN) 2023-11-04T01:44:28.887 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 10r REG 0,20 0 18515 /proc/sys/kernel/hostname 2023-11-04T01:44:28.887 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 11u a_inode 0,14 0 1081 [signalfd] 2023-11-04T01:44:28.887 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 12u a_inode 0,14 0 1081 [signalfd] 2023-11-04T01:44:28.887 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 13u a_inode 0,14 0 1081 [signalfd] 2023-11-04T01:44:28.887 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 14u unix 0xffff982f48d5ea40 0t0 2370 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.887 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 15u a_inode 0,14 0 1081 [timerfd] 2023-11-04T01:44:28.887 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 16u REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:28.887 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 17u unix 0xffff982f48698cc0 0t0 17757 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.887 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 18u unix 0xffff982f485c6600 0t0 15881 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.887 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 19u unix 0xffff982f41e13b80 0t0 15882 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.887 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 20u unix 0xffff982f48d50440 0t0 20603 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.888 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 21u unix 0xffff982f48f772c0 0t0 162735 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.888 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 23u unix 0xffff982f41e15500 0t0 15891 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.888 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 24u unix 0xffff982f487b0000 0t0 15892 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.888 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 25u unix 0xffff982f4869bb80 0t0 22859 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.888 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 27u unix 0xffff982f48d52640 0t0 17109 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.888 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 28u unix 0xffff982f4414c840 0t0 22863 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.888 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 29u unix 0xffff982f48c1fb40 0t0 17110 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.888 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 30u unix 0xffff982f48d55940 0t0 17111 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.888 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 32u unix 0xffff982f48f70440 0t0 20026 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.888 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-j 568 root 33u unix 0xffff982f48699100 0t0 21995 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:28.888 INFO:teuthology.orchestra.run.smithi044.stdout:ext4lazyi 574 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.888 INFO:teuthology.orchestra.run.smithi044.stdout:ext4lazyi 574 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.889 INFO:teuthology.orchestra.run.smithi044.stdout:ext4lazyi 574 root txt unknown /proc/574/exe 2023-11-04T01:44:28.889 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.889 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.889 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root txt REG 8,1 597744 11595 /usr/bin/udevadm 2023-11-04T01:44:28.889 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-11-04T01:44:28.889 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 596532 1143 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:44:28.889 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 566315 265239 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.symbols.bin 2023-11-04T01:44:28.889 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 821166 265236 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.alias.bin 2023-11-04T01:44:28.889 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 383471 265245 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.dep.bin 2023-11-04T01:44:28.889 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.889 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.889 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.889 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.889 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 21219 1665 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:44:28.890 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.890 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:28.890 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:28.890 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.890 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:28.890 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.890 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.890 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.890 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.890 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.890 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:44:28.890 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.891 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:44:28.891 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:44:28.891 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:28.891 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.891 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.891 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:28.891 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.891 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:44:28.891 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.891 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.891 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:44:28.891 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 11812 265240 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.builtin.bin 2023-11-04T01:44:28.891 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.892 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:28.892 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.892 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root 1u unix 0xffff982f4869e600 0t0 18666 type=STREAM (CONNECTED) 2023-11-04T01:44:28.892 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root 2u unix 0xffff982f4869e600 0t0 18666 type=STREAM (CONNECTED) 2023-11-04T01:44:28.892 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root 3u unix 0xffff982f4842bfc0 0t0 986 /run/udev/control type=SEQPACKET (LISTEN) 2023-11-04T01:44:28.892 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root 4u netlink 0t0 988 KOBJECT_UEVENT 2023-11-04T01:44:28.892 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root 5u unix 0xffff982f48d2f2c0 0t0 18678 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.892 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root 6u unix 0xffff982f48d2e600 0t0 18682 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.892 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root 7u unix 0xffff982f48d2e1c0 0t0 18683 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.892 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root 8r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.892 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root 9u a_inode 0,14 0 1081 [eventpoll:3,4,6,8,10,11,14] 2023-11-04T01:44:28.892 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root 10u a_inode 0,14 0 1081 [signalfd] 2023-11-04T01:44:28.892 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root 11u a_inode 0,14 0 1081 [timerfd] 2023-11-04T01:44:28.892 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root 12r REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-11-04T01:44:28.893 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-u 583 root 14u a_inode 0,14 0 1081 [timerfd] 2023-11-04T01:44:28.893 INFO:teuthology.orchestra.run.smithi044.stdout:ipmi-msgh 638 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.893 INFO:teuthology.orchestra.run.smithi044.stdout:ipmi-msgh 638 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.893 INFO:teuthology.orchestra.run.smithi044.stdout:ipmi-msgh 638 root txt unknown /proc/638/exe 2023-11-04T01:44:28.893 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.893 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.893 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc txt REG 8,1 61200 14999 /usr/bin/rpcbind 2023-11-04T01:44:28.893 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.893 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.893 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.893 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.893 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.893 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:28.893 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:28.894 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.894 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.894 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:28.894 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.894 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:28.894 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.894 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.894 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.894 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.894 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:28.894 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:28.894 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:28.895 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.895 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-04T01:44:28.895 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.895 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.895 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc 1u unix 0xffff982f48d54840 0t0 2435 type=STREAM (CONNECTED) 2023-11-04T01:44:28.895 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc 2u unix 0xffff982f48d54840 0t0 2435 type=STREAM (CONNECTED) 2023-11-04T01:44:28.895 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc 3u unix 0xffff982f485c1980 0t0 974 /run/rpcbind.sock type=STREAM (LISTEN) 2023-11-04T01:44:28.895 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc 4u IPv4 18640 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:44:28.895 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc 5u IPv4 18646 0t0 UDP *:sunrpc 2023-11-04T01:44:28.895 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc 6u IPv6 16783 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:44:28.895 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc 7u IPv6 19836 0t0 UDP *:sunrpc 2023-11-04T01:44:28.895 INFO:teuthology.orchestra.run.smithi044.stdout:rpcbind 653 rpc 8rW REG 0,24 0 1203 /run/rpcbind/rpcbind.lock 2023-11-04T01:44:28.895 INFO:teuthology.orchestra.run.smithi044.stdout:kipmi0 657 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.895 INFO:teuthology.orchestra.run.smithi044.stdout:kipmi0 657 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.896 INFO:teuthology.orchestra.run.smithi044.stdout:kipmi0 657 root txt unknown /proc/657/exe 2023-11-04T01:44:28.896 INFO:teuthology.orchestra.run.smithi044.stdout:rpciod 659 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.896 INFO:teuthology.orchestra.run.smithi044.stdout:rpciod 659 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.896 INFO:teuthology.orchestra.run.smithi044.stdout:rpciod 659 root txt unknown /proc/659/exe 2023-11-04T01:44:28.896 INFO:teuthology.orchestra.run.smithi044.stdout:xprtiod 660 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.896 INFO:teuthology.orchestra.run.smithi044.stdout:xprtiod 660 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.896 INFO:teuthology.orchestra.run.smithi044.stdout:xprtiod 660 root txt unknown /proc/660/exe 2023-11-04T01:44:28.896 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.896 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.896 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-04T01:44:28.896 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.896 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.896 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.897 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.897 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.897 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:28.897 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:28.897 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:28.897 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:28.897 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:28.897 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.897 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:28.897 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:28.897 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:44:28.897 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:28.897 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.898 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.898 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.898 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.898 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root 3u netlink 0t0 2442 AUDIT 2023-11-04T01:44:28.898 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root 4w REG 8,1 7997809 64145 /var/log/audit/audit.log 2023-11-04T01:44:28.898 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root 6u unix 0xffff982f487d5500 0t0 19958 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.898 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root 7u unix 0xffff982f487b3300 0t0 19957 type=STREAM (CONNECTED) 2023-11-04T01:44:28.898 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root 8u unix 0xffff982f487b50c0 0t0 19959 type=STREAM (CONNECTED) 2023-11-04T01:44:28.898 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root 9u unix 0xffff982f487b5500 0t0 19960 type=STREAM (CONNECTED) 2023-11-04T01:44:28.898 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 root 10u a_inode 0,14 0 1081 [eventfd:0] 2023-11-04T01:44:28.898 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.898 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.899 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-04T01:44:28.899 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.899 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.899 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.899 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.899 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.899 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:28.899 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:28.899 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:28.899 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:28.899 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:28.899 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.899 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:28.900 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:28.900 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:44:28.900 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:28.900 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.900 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.900 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.900 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.900 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root 3u netlink 0t0 2442 AUDIT 2023-11-04T01:44:28.900 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root 4w REG 8,1 7997809 64145 /var/log/audit/audit.log 2023-11-04T01:44:28.900 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root 6u unix 0xffff982f487d5500 0t0 19958 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.900 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root 7u unix 0xffff982f487b3300 0t0 19957 type=STREAM (CONNECTED) 2023-11-04T01:44:28.900 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root 8u unix 0xffff982f487b50c0 0t0 19959 type=STREAM (CONNECTED) 2023-11-04T01:44:28.900 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root 9u unix 0xffff982f487b5500 0t0 19960 type=STREAM (CONNECTED) 2023-11-04T01:44:28.901 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 662 auditd root 10u a_inode 0,14 0 1081 [eventfd:0] 2023-11-04T01:44:28.901 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.901 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.901 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-04T01:44:28.901 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.901 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.901 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.901 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.901 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.901 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:28.901 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:28.901 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:28.901 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:28.902 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:28.902 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.902 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:28.902 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:28.902 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:44:28.902 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:28.902 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.902 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.902 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.902 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.902 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root 3u netlink 0t0 2442 AUDIT 2023-11-04T01:44:28.902 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root 4w REG 8,1 7997809 64145 /var/log/audit/audit.log 2023-11-04T01:44:28.902 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root 6u unix 0xffff982f487d5500 0t0 19958 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.903 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root 7u unix 0xffff982f487b3300 0t0 19957 type=STREAM (CONNECTED) 2023-11-04T01:44:28.903 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root 8u unix 0xffff982f487b50c0 0t0 19959 type=STREAM (CONNECTED) 2023-11-04T01:44:28.903 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root 9u unix 0xffff982f487b5500 0t0 19960 type=STREAM (CONNECTED) 2023-11-04T01:44:28.903 INFO:teuthology.orchestra.run.smithi044.stdout:auditd 661 664 auditd root 10u a_inode 0,14 0 1081 [eventfd:0] 2023-11-04T01:44:28.903 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.903 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.903 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root txt REG 8,1 19624 11914 /usr/sbin/sedispatch 2023-11-04T01:44:28.903 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.903 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.903 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.903 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.903 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.903 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.904 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.904 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.904 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.904 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:28.904 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.904 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.904 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:44:28.904 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:44:28.904 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.904 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.904 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root 0u unix 0xffff982f487b1980 0t0 19956 type=STREAM (CONNECTED) 2023-11-04T01:44:28.904 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.904 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.905 INFO:teuthology.orchestra.run.smithi044.stdout:sedispatc 663 root 3u unix 0xffff982f48d55500 0t0 23809 type=STREAM (CONNECTED) 2023-11-04T01:44:28.905 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.905 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.905 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus txt REG 8,1 131896 11213 /usr/bin/dbus-broker-launch 2023-11-04T01:44:28.905 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus DEL REG 0,1 2 /memfd:dbus-broker-log 2023-11-04T01:44:28.905 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.905 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.905 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.905 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.905 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.905 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.905 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.905 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.906 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.906 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.906 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.906 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.906 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:28.906 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.906 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:28.906 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.906 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.906 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus 1u unix 0xffff982f485c0cc0 0t0 21525 type=STREAM (CONNECTED) 2023-11-04T01:44:28.906 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus 2u unix 0xffff982f485c0cc0 0t0 21525 type=STREAM (CONNECTED) 2023-11-04T01:44:28.906 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus 3u unix 0xffff982f48d55d80 0t0 2472 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-04T01:44:28.906 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus 4u unix 0xffff982f48428cc0 0t0 21535 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.907 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus 5u a_inode 0,14 0 1081 [eventpoll:6,7,8,9,10,11] 2023-11-04T01:44:28.907 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus 6u a_inode 0,14 0 1081 [signalfd] 2023-11-04T01:44:28.907 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus 7r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.907 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus 8u unix 0xffff982f485c4840 0t0 21537 type=STREAM (CONNECTED) 2023-11-04T01:44:28.907 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus 9u unix 0xffff982f485c0000 0t0 21539 type=STREAM (CONNECTED) 2023-11-04T01:44:28.907 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus 10u a_inode 0,14 0 1081 [pidfd:705] 2023-11-04T01:44:28.907 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus 11u a_inode 0,14 0 1081 [timerfd] 2023-11-04T01:44:28.907 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 704 dbus 12u REG 0,1 2097152 2 /memfd:dbus-broker-log (deleted) 2023-11-04T01:44:28.907 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.907 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.907 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus txt REG 8,1 236336 11212 /usr/bin/dbus-broker 2023-11-04T01:44:28.907 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.907 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.907 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.908 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.908 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.908 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:28.908 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.908 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.908 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:28.908 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.908 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 1u unix 0xffff982f485c0cc0 0t0 21525 type=STREAM (CONNECTED) 2023-11-04T01:44:28.908 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 2u unix 0xffff982f485c0cc0 0t0 21525 type=STREAM (CONNECTED) 2023-11-04T01:44:28.908 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 3u sock 0,8 0t0 19975 protocol: NETLINK 2023-11-04T01:44:28.908 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 4u unix 0xffff982f48428cc0 0t0 21535 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.908 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 5u a_inode 0,14 0 1081 [eventpoll:6,7,8,9,10,11,12,13,15,17,18,19] 2023-11-04T01:44:28.908 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 6u a_inode 0,14 0 1081 [signalfd] 2023-11-04T01:44:28.909 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 7u unix 0xffff982f48d55d80 0t0 2472 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-04T01:44:28.909 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 8u unix 0xffff982f48d57700 0t0 19976 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:28.909 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 9u unix 0xffff982f485c0880 0t0 21538 type=STREAM (CONNECTED) 2023-11-04T01:44:28.909 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 10u unix 0xffff982f485c0440 0t0 19978 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:28.909 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 11u unix 0xffff982f44148000 0t0 19986 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:28.909 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 12u unix 0xffff982f4869b740 0t0 19989 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:28.909 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 13u unix 0xffff982f48f70880 0t0 19991 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:28.909 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 15u unix 0xffff982f41e12200 0t0 21568 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:28.909 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 17u unix 0xffff982f48d550c0 0t0 23498 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:28.909 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 18u unix 0xffff982f41e11100 0t0 22950 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:28.909 INFO:teuthology.orchestra.run.smithi044.stdout:dbus-brok 705 dbus 19u unix 0xffff982f4869ee80 0t0 20207 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:28.909 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.909 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.909 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager (deleted) 2023-11-04T01:44:28.910 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:28.910 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root DEL REG 8,1 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-04T01:44:28.910 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:44:28.910 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-04T01:44:28.910 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-04T01:44:28.910 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root DEL REG 8,1 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-04T01:44:28.910 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:28.910 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:28.910 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:28.910 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.910 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:28.910 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.910 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:28.911 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:28.911 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:28.911 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:28.911 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:28.911 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:28.911 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.911 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.911 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.911 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.911 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.911 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.911 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:28.911 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:28.911 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:28.912 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:28.912 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:28.912 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:28.912 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:28.912 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:28.912 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:28.912 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:28.912 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:28.912 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.912 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.912 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.912 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.913 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.913 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:44:28.913 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:28.913 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:28.913 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:28.913 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.913 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.913 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:44:28.913 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:28.913 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.913 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.913 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.913 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:44:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-04T01:44:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:28.915 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:28.915 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:28.915 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:28.915 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.915 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:28.915 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.915 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 1u unix 0xffff982f41e13740 0t0 13607 type=STREAM (CONNECTED) 2023-11-04T01:44:28.915 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 2u unix 0xffff982f41e13740 0t0 13607 type=STREAM (CONNECTED) 2023-11-04T01:44:28.915 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 3u a_inode 0,14 0 1081 [eventfd:6] 2023-11-04T01:44:28.915 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 4u a_inode 0,14 0 1081 [eventfd:7] 2023-11-04T01:44:28.915 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 5u unix 0xffff982f48f81980 0t0 17014 type=DGRAM (UNCONNECTED) 2023-11-04T01:44:28.915 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 6u unix 0xffff982f48f77b40 0t0 17015 type=STREAM (CONNECTED) 2023-11-04T01:44:28.915 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 7u a_inode 0,14 0 1081 [eventfd:8] 2023-11-04T01:44:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 8r REG 0,4 0 4026531840 net 2023-11-04T01:44:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 9r REG 0,4 0 4026532495 mnt 2023-11-04T01:44:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 10u netlink 0t0 17019 KOBJECT_UEVENT 2023-11-04T01:44:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 11u netlink 0t0 17020 GENERIC 2023-11-04T01:44:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 12u netlink 0t0 17021 GENERIC 2023-11-04T01:44:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 13u netlink 0t0 17022 ROUTE 2023-11-04T01:44:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 14r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 15r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 16u netlink 0t0 2596 KOBJECT_UEVENT 2023-11-04T01:44:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 17u a_inode 0,14 0 1081 [eventpoll] 2023-11-04T01:44:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 18u unix 0xffff982f41e14840 0t0 13644 type=STREAM (CONNECTED) 2023-11-04T01:44:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 19u a_inode 0,14 0 1081 [eventpoll:21,27] 2023-11-04T01:44:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 20w FIFO 0,24 0t0 1297 /run/systemd/inhibit/1.ref 2023-11-04T01:44:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 21u a_inode 0,14 0 1081 [timerfd] 2023-11-04T01:44:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 23u raw6 0t0 13685 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-11-04T01:44:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 root 27u IPv4 13693 0t0 UDP smithi044.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-04T01:44:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager (deleted) 2023-11-04T01:44:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root DEL REG 8,1 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-04T01:44:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:44:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-04T01:44:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-04T01:44:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root DEL REG 8,1 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-04T01:44:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:28.918 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.918 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:28.918 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:28.918 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:28.918 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:28.918 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:28.918 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:28.918 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.918 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.918 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.918 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.918 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.919 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.919 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:28.919 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:28.919 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:28.919 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:28.919 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:28.919 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:28.919 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:28.919 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:28.919 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:28.919 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:28.919 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:28.919 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.920 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.920 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.920 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.920 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.920 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:44:28.920 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:28.920 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:28.920 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:28.920 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.920 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.920 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:44:28.920 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:28.920 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.920 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.921 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.921 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.921 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:28.921 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:28.921 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.921 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.921 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:28.921 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:44:28.921 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:28.921 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.921 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.921 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-04T01:44:28.921 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:28.922 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:28.922 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:28.922 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:28.922 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:28.922 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:28.922 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.922 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:28.922 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.922 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 1u unix 0xffff982f41e13740 0t0 13607 type=STREAM (CONNECTED) 2023-11-04T01:44:28.922 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 2u unix 0xffff982f41e13740 0t0 13607 type=STREAM (CONNECTED) 2023-11-04T01:44:28.922 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 3u a_inode 0,14 0 1081 [eventfd:6] 2023-11-04T01:44:28.922 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 4u a_inode 0,14 0 1081 [eventfd:7] 2023-11-04T01:44:28.922 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 5u unix 0xffff982f48f81980 0t0 17014 type=DGRAM (UNCONNECTED) 2023-11-04T01:44:28.923 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 6u unix 0xffff982f48f77b40 0t0 17015 type=STREAM (CONNECTED) 2023-11-04T01:44:28.923 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 7u a_inode 0,14 0 1081 [eventfd:8] 2023-11-04T01:44:28.923 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 8r REG 0,4 0 4026531840 net 2023-11-04T01:44:28.923 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 9r REG 0,4 0 4026532495 mnt 2023-11-04T01:44:28.923 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 10u netlink 0t0 17019 KOBJECT_UEVENT 2023-11-04T01:44:28.923 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 11u netlink 0t0 17020 GENERIC 2023-11-04T01:44:28.923 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 12u netlink 0t0 17021 GENERIC 2023-11-04T01:44:28.923 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 13u netlink 0t0 17022 ROUTE 2023-11-04T01:44:28.923 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 14r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.923 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 15r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.923 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 16u netlink 0t0 2596 KOBJECT_UEVENT 2023-11-04T01:44:28.923 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 17u a_inode 0,14 0 1081 [eventpoll] 2023-11-04T01:44:28.923 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 18u unix 0xffff982f41e14840 0t0 13644 type=STREAM (CONNECTED) 2023-11-04T01:44:28.924 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 19u a_inode 0,14 0 1081 [eventpoll:21,27] 2023-11-04T01:44:28.924 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 20w FIFO 0,24 0t0 1297 /run/systemd/inhibit/1.ref 2023-11-04T01:44:28.924 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 21u a_inode 0,14 0 1081 [timerfd] 2023-11-04T01:44:28.924 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 23u raw6 0t0 13685 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-11-04T01:44:28.924 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 734 gmain root 27u IPv4 13693 0t0 UDP smithi044.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-04T01:44:28.924 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.924 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.924 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager (deleted) 2023-11-04T01:44:28.924 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:28.924 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root DEL REG 8,1 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-04T01:44:28.924 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:44:28.924 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-04T01:44:28.924 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-04T01:44:28.925 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root DEL REG 8,1 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-04T01:44:28.925 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:28.925 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:28.925 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:28.925 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.925 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:28.925 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.925 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:28.925 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:28.925 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:28.925 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:28.925 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:28.925 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:28.926 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.926 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.926 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.926 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.926 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.926 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.926 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:28.926 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:28.926 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:28.926 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:28.926 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:28.926 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:28.926 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:28.927 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:28.927 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:28.927 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:28.927 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:28.927 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.927 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.927 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.927 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.927 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.927 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:44:28.927 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:28.927 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:28.927 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:28.928 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.928 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.928 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:44:28.928 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:28.928 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.928 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.928 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.928 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.928 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:28.928 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:28.928 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.928 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.928 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:28.928 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:44:28.929 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:28.929 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.929 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.929 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-04T01:44:28.929 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:28.929 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:28.929 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:28.929 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:28.929 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:28.929 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:28.929 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.929 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:28.929 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.929 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 1u unix 0xffff982f41e13740 0t0 13607 type=STREAM (CONNECTED) 2023-11-04T01:44:28.929 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 2u unix 0xffff982f41e13740 0t0 13607 type=STREAM (CONNECTED) 2023-11-04T01:44:28.930 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 3u a_inode 0,14 0 1081 [eventfd:6] 2023-11-04T01:44:28.930 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 4u a_inode 0,14 0 1081 [eventfd:7] 2023-11-04T01:44:28.930 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 5u unix 0xffff982f48f81980 0t0 17014 type=DGRAM (UNCONNECTED) 2023-11-04T01:44:28.930 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 6u unix 0xffff982f48f77b40 0t0 17015 type=STREAM (CONNECTED) 2023-11-04T01:44:28.930 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 7u a_inode 0,14 0 1081 [eventfd:8] 2023-11-04T01:44:28.930 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 8r REG 0,4 0 4026531840 net 2023-11-04T01:44:28.930 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 9r REG 0,4 0 4026532495 mnt 2023-11-04T01:44:28.930 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 10u netlink 0t0 17019 KOBJECT_UEVENT 2023-11-04T01:44:28.930 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 11u netlink 0t0 17020 GENERIC 2023-11-04T01:44:28.930 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 12u netlink 0t0 17021 GENERIC 2023-11-04T01:44:28.930 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 13u netlink 0t0 17022 ROUTE 2023-11-04T01:44:28.930 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 14r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.931 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 15r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.931 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 16u netlink 0t0 2596 KOBJECT_UEVENT 2023-11-04T01:44:28.931 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 17u a_inode 0,14 0 1081 [eventpoll] 2023-11-04T01:44:28.931 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 18u unix 0xffff982f41e14840 0t0 13644 type=STREAM (CONNECTED) 2023-11-04T01:44:28.931 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 19u a_inode 0,14 0 1081 [eventpoll:21,27] 2023-11-04T01:44:28.931 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 20w FIFO 0,24 0t0 1297 /run/systemd/inhibit/1.ref 2023-11-04T01:44:28.931 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 21u a_inode 0,14 0 1081 [timerfd] 2023-11-04T01:44:28.931 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 23u raw6 0t0 13685 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-11-04T01:44:28.931 INFO:teuthology.orchestra.run.smithi044.stdout:NetworkMa 706 735 gdbus root 27u IPv4 13693 0t0 UDP smithi044.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-04T01:44:28.931 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.931 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.931 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-11-04T01:44:28.931 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.931 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.932 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.932 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:28.932 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.932 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.932 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.932 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.932 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root 1u unix 0xffff982f41e150c0 0t0 13616 type=STREAM (CONNECTED) 2023-11-04T01:44:28.932 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root 2u unix 0xffff982f41e150c0 0t0 13616 type=STREAM (CONNECTED) 2023-11-04T01:44:28.932 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root 3u a_inode 0,14 0 1081 [eventfd:1] 2023-11-04T01:44:28.932 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root 4u a_inode 0,14 0 1081 [eventfd:2] 2023-11-04T01:44:28.932 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root 5u unix 0xffff982f41e10440 0t0 13628 /run/irqbalance/irqbalance709.sock type=STREAM (LISTEN) 2023-11-04T01:44:28.932 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 root 6u unix 0xffff982f48edaec0 0t0 13845 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.932 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.933 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.933 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-11-04T01:44:28.933 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.933 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.933 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.933 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:28.933 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.933 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.933 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.933 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.933 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root 1u unix 0xffff982f41e150c0 0t0 13616 type=STREAM (CONNECTED) 2023-11-04T01:44:28.933 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root 2u unix 0xffff982f41e150c0 0t0 13616 type=STREAM (CONNECTED) 2023-11-04T01:44:28.933 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root 3u a_inode 0,14 0 1081 [eventfd:1] 2023-11-04T01:44:28.934 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root 4u a_inode 0,14 0 1081 [eventfd:2] 2023-11-04T01:44:28.934 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root 5u unix 0xffff982f41e10440 0t0 13628 /run/irqbalance/irqbalance709.sock type=STREAM (LISTEN) 2023-11-04T01:44:28.934 INFO:teuthology.orchestra.run.smithi044.stdout:irqbalanc 709 716 gmain root 6u unix 0xffff982f48edaec0 0t0 13845 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.934 INFO:teuthology.orchestra.run.smithi044.stdout:lsmd 710 libstoragemgmt cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.934 INFO:teuthology.orchestra.run.smithi044.stdout:lsmd 710 libstoragemgmt rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.934 INFO:teuthology.orchestra.run.smithi044.stdout:lsmd 710 libstoragemgmt txt REG 8,1 32280 11292 /usr/bin/lsmd 2023-11-04T01:44:28.934 INFO:teuthology.orchestra.run.smithi044.stdout:lsmd 710 libstoragemgmt mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.934 INFO:teuthology.orchestra.run.smithi044.stdout:lsmd 710 libstoragemgmt mem REG 8,1 56912 10811 /usr/lib64/libconfig.so.11.0.2 2023-11-04T01:44:28.934 INFO:teuthology.orchestra.run.smithi044.stdout:lsmd 710 libstoragemgmt mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.934 INFO:teuthology.orchestra.run.smithi044.stdout:lsmd 710 libstoragemgmt 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.934 INFO:teuthology.orchestra.run.smithi044.stdout:lsmd 710 libstoragemgmt 1u unix 0xffff982f487b2200 0t0 19983 type=STREAM (CONNECTED) 2023-11-04T01:44:28.934 INFO:teuthology.orchestra.run.smithi044.stdout:lsmd 710 libstoragemgmt 2u unix 0xffff982f487b2200 0t0 19983 type=STREAM (CONNECTED) 2023-11-04T01:44:28.934 INFO:teuthology.orchestra.run.smithi044.stdout:lsmd 710 libstoragemgmt 3uW REG 0,24 0 1270 /run/lsm/ipc/.lsmd-ipc-lock 2023-11-04T01:44:28.934 INFO:teuthology.orchestra.run.smithi044.stdout:lsmd 710 libstoragemgmt 5u unix 0xffff982f4869c840 0t0 18795 /var/run/lsm/ipc/simc type=STREAM (LISTEN) 2023-11-04T01:44:28.935 INFO:teuthology.orchestra.run.smithi044.stdout:lsmd 710 libstoragemgmt 6u unix 0xffff982f4869a200 0t0 18796 /var/run/lsm/ipc/sim type=STREAM (LISTEN) 2023-11-04T01:44:28.935 INFO:teuthology.orchestra.run.smithi044.stdout:mcelog 711 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.935 INFO:teuthology.orchestra.run.smithi044.stdout:mcelog 711 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.935 INFO:teuthology.orchestra.run.smithi044.stdout:mcelog 711 root txt REG 8,1 194568 12461 /usr/sbin/mcelog 2023-11-04T01:44:28.935 INFO:teuthology.orchestra.run.smithi044.stdout:mcelog 711 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.935 INFO:teuthology.orchestra.run.smithi044.stdout:mcelog 711 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.935 INFO:teuthology.orchestra.run.smithi044.stdout:mcelog 711 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.935 INFO:teuthology.orchestra.run.smithi044.stdout:mcelog 711 root 1u unix 0xffff982f4869dd80 0t0 18783 type=STREAM (CONNECTED) 2023-11-04T01:44:28.935 INFO:teuthology.orchestra.run.smithi044.stdout:mcelog 711 root 2u unix 0xffff982f4869dd80 0t0 18783 type=STREAM (CONNECTED) 2023-11-04T01:44:28.935 INFO:teuthology.orchestra.run.smithi044.stdout:mcelog 711 root 3r CHR 10,227 0t0 142 /dev/mcelog 2023-11-04T01:44:28.935 INFO:teuthology.orchestra.run.smithi044.stdout:mcelog 711 root 4u unix 0xffff982f48698440 0t0 18794 /var/run/mcelog-client type=STREAM (LISTEN) 2023-11-04T01:44:28.935 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.935 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.936 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:28.936 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.936 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.936 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.936 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.936 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.936 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:28.936 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.936 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.936 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.936 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.936 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:28.936 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.936 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.937 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.937 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.937 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.937 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.937 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.937 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.937 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.937 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:28.937 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.937 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.937 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.937 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.937 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:28.937 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.938 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.938 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.938 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.938 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd 3r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.938 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd 4u a_inode 0,14 0 1081 [eventfd:3] 2023-11-04T01:44:28.938 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd 5u a_inode 0,14 0 1081 [eventfd:4] 2023-11-04T01:44:28.938 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd 6u unix 0xffff982f4869d500 0t0 18813 type=STREAM (CONNECTED) 2023-11-04T01:44:28.938 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd 7u a_inode 0,14 0 1081 [eventfd:5] 2023-11-04T01:44:28.938 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd 8r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.938 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd 9u a_inode 0,14 0 1081 [eventfd:10] 2023-11-04T01:44:28.938 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 polkitd 10u unix 0xffff982f48d2cc80 0t0 18814 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.939 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.939 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.939 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:28.939 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.939 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.939 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.939 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.939 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.939 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:28.939 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.939 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.939 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.940 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.940 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:28.940 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.940 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.940 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.940 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.940 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.940 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.940 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.940 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.940 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.940 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:28.940 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.940 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.940 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.941 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.941 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:28.941 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.941 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.941 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.941 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.941 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd 3r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.941 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd 4u a_inode 0,14 0 1081 [eventfd:3] 2023-11-04T01:44:28.941 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd 5u a_inode 0,14 0 1081 [eventfd:4] 2023-11-04T01:44:28.941 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd 6u unix 0xffff982f4869d500 0t0 18813 type=STREAM (CONNECTED) 2023-11-04T01:44:28.941 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd 7u a_inode 0,14 0 1081 [eventfd:5] 2023-11-04T01:44:28.941 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd 8r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.941 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd 9u a_inode 0,14 0 1081 [eventfd:10] 2023-11-04T01:44:28.942 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 724 gmain polkitd 10u unix 0xffff982f48d2cc80 0t0 18814 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.942 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.942 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.942 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:28.942 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.942 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.942 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.942 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.942 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.942 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:28.942 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.942 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.942 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.943 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.943 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:28.943 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.943 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.943 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.943 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.943 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.943 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.943 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.943 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.943 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.943 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:28.943 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.943 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.944 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.944 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.944 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:28.944 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.944 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.944 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.944 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.944 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd 3r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.944 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd 4u a_inode 0,14 0 1081 [eventfd:3] 2023-11-04T01:44:28.944 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd 5u a_inode 0,14 0 1081 [eventfd:4] 2023-11-04T01:44:28.944 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd 6u unix 0xffff982f4869d500 0t0 18813 type=STREAM (CONNECTED) 2023-11-04T01:44:28.944 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd 7u a_inode 0,14 0 1081 [eventfd:5] 2023-11-04T01:44:28.944 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd 8r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.945 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd 9u a_inode 0,14 0 1081 [eventfd:10] 2023-11-04T01:44:28.945 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 725 gdbus polkitd 10u unix 0xffff982f48d2cc80 0t0 18814 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.945 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.945 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.945 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:28.945 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.945 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.945 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.945 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.945 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.945 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:28.945 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.945 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.945 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.946 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.946 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:28.946 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.946 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.946 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.946 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.946 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.946 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.946 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.946 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.946 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.946 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:28.946 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.947 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.947 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.947 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.947 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:28.947 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.947 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.947 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.947 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.947 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd 3r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.947 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd 4u a_inode 0,14 0 1081 [eventfd:3] 2023-11-04T01:44:28.947 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd 5u a_inode 0,14 0 1081 [eventfd:4] 2023-11-04T01:44:28.947 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd 6u unix 0xffff982f4869d500 0t0 18813 type=STREAM (CONNECTED) 2023-11-04T01:44:28.947 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd 7u a_inode 0,14 0 1081 [eventfd:5] 2023-11-04T01:44:28.948 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd 8r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.948 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd 9u a_inode 0,14 0 1081 [eventfd:10] 2023-11-04T01:44:28.948 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 726 JS\x20Hel polkitd 10u unix 0xffff982f48d2cc80 0t0 18814 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.948 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.948 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.948 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:28.948 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.948 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.948 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.948 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.948 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.948 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:28.948 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.949 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.949 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.949 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.949 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:28.949 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.949 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.949 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.949 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.949 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.949 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.949 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.949 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.949 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.949 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:28.950 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.950 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.950 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.950 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.950 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:28.950 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.950 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.950 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.950 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.950 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd 3r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.950 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd 4u a_inode 0,14 0 1081 [eventfd:3] 2023-11-04T01:44:28.950 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd 5u a_inode 0,14 0 1081 [eventfd:4] 2023-11-04T01:44:28.951 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd 6u unix 0xffff982f4869d500 0t0 18813 type=STREAM (CONNECTED) 2023-11-04T01:44:28.951 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd 7u a_inode 0,14 0 1081 [eventfd:5] 2023-11-04T01:44:28.951 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd 8r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.951 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd 9u a_inode 0,14 0 1081 [eventfd:10] 2023-11-04T01:44:28.951 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 727 JS\x20Hel polkitd 10u unix 0xffff982f48d2cc80 0t0 18814 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.951 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.951 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.951 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:28.951 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.951 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.951 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.951 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.951 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.952 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:28.952 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.953 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.953 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.953 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.953 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:28.953 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.953 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.953 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.953 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.953 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.953 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.953 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.954 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.954 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.954 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:28.954 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.954 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.954 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.954 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.954 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:28.954 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.954 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.954 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.954 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.955 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd 3r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.955 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd 4u a_inode 0,14 0 1081 [eventfd:3] 2023-11-04T01:44:28.955 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd 5u a_inode 0,14 0 1081 [eventfd:4] 2023-11-04T01:44:28.955 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd 6u unix 0xffff982f4869d500 0t0 18813 type=STREAM (CONNECTED) 2023-11-04T01:44:28.955 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd 7u a_inode 0,14 0 1081 [eventfd:5] 2023-11-04T01:44:28.955 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd 8r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.955 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd 9u a_inode 0,14 0 1081 [eventfd:10] 2023-11-04T01:44:28.955 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 728 JS\x20Hel polkitd 10u unix 0xffff982f48d2cc80 0t0 18814 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.955 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.955 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.955 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:28.955 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.955 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.955 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.956 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.956 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.956 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:28.956 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.956 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.956 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.956 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.956 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:28.956 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.956 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.956 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.956 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.956 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.957 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.957 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.957 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.957 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.957 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:28.957 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.957 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.957 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.957 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.957 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:28.957 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.957 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.957 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.958 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.958 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd 3r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.958 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd 4u a_inode 0,14 0 1081 [eventfd:3] 2023-11-04T01:44:28.958 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd 5u a_inode 0,14 0 1081 [eventfd:4] 2023-11-04T01:44:28.958 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd 6u unix 0xffff982f4869d500 0t0 18813 type=STREAM (CONNECTED) 2023-11-04T01:44:28.958 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd 7u a_inode 0,14 0 1081 [eventfd:5] 2023-11-04T01:44:28.958 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd 8r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.958 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd 9u a_inode 0,14 0 1081 [eventfd:10] 2023-11-04T01:44:28.958 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 729 JS\x20Hel polkitd 10u unix 0xffff982f48d2cc80 0t0 18814 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.958 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.958 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.958 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:28.958 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.960 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.960 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.960 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.960 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.960 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.960 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.960 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:28.960 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.960 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.960 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.960 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.960 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:28.960 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.960 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.961 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.961 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.961 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd 3r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.961 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd 4u a_inode 0,14 0 1081 [eventfd:3] 2023-11-04T01:44:28.961 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd 5u a_inode 0,14 0 1081 [eventfd:4] 2023-11-04T01:44:28.961 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd 6u unix 0xffff982f4869d500 0t0 18813 type=STREAM (CONNECTED) 2023-11-04T01:44:28.961 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd 7u a_inode 0,14 0 1081 [eventfd:5] 2023-11-04T01:44:28.961 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd 8r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.961 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd 9u a_inode 0,14 0 1081 [eventfd:10] 2023-11-04T01:44:28.961 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 730 JS\x20Hel polkitd 10u unix 0xffff982f48d2cc80 0t0 18814 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.961 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.961 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.961 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:28.962 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.962 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.962 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.962 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.962 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.962 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:28.962 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.962 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.962 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.962 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.962 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:28.962 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.962 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.963 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.963 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.963 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.963 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.963 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.963 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.963 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.963 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:28.963 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.963 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.963 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.963 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.963 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:28.964 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.964 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.964 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.964 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.964 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd 3r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.964 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd 4u a_inode 0,14 0 1081 [eventfd:3] 2023-11-04T01:44:28.964 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd 5u a_inode 0,14 0 1081 [eventfd:4] 2023-11-04T01:44:28.964 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd 6u unix 0xffff982f4869d500 0t0 18813 type=STREAM (CONNECTED) 2023-11-04T01:44:28.964 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd 7u a_inode 0,14 0 1081 [eventfd:5] 2023-11-04T01:44:28.964 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd 8r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.964 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd 9u a_inode 0,14 0 1081 [eventfd:10] 2023-11-04T01:44:28.964 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 731 JS\x20Hel polkitd 10u unix 0xffff982f48d2cc80 0t0 18814 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.964 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.965 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.965 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:28.965 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.965 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.965 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.965 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.965 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.965 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:28.965 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.965 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.965 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.965 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.965 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:28.965 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.966 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.966 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.966 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.966 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.966 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.966 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.966 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.966 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.966 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:28.966 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.966 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.966 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.967 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.967 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:28.967 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.967 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.967 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.967 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.967 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd 3r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.967 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd 4u a_inode 0,14 0 1081 [eventfd:3] 2023-11-04T01:44:28.967 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd 5u a_inode 0,14 0 1081 [eventfd:4] 2023-11-04T01:44:28.967 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd 6u unix 0xffff982f4869d500 0t0 18813 type=STREAM (CONNECTED) 2023-11-04T01:44:28.967 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd 7u a_inode 0,14 0 1081 [eventfd:5] 2023-11-04T01:44:28.967 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd 8r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.967 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd 9u a_inode 0,14 0 1081 [eventfd:10] 2023-11-04T01:44:28.968 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 732 JS\x20Hel polkitd 10u unix 0xffff982f48d2cc80 0t0 18814 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.968 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.968 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.968 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:28.968 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.968 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.968 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.968 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.968 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.968 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:28.968 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.968 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.968 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.969 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.969 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:28.969 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.969 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.969 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.969 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.969 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.969 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.969 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.969 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.969 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.969 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:28.969 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.970 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.970 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.970 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.970 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:28.970 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.970 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.970 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.970 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.970 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd 3r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.970 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd 4u a_inode 0,14 0 1081 [eventfd:3] 2023-11-04T01:44:28.970 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd 5u a_inode 0,14 0 1081 [eventfd:4] 2023-11-04T01:44:28.970 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd 6u unix 0xffff982f4869d500 0t0 18813 type=STREAM (CONNECTED) 2023-11-04T01:44:28.971 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd 7u a_inode 0,14 0 1081 [eventfd:5] 2023-11-04T01:44:28.971 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd 8r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.971 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd 9u a_inode 0,14 0 1081 [eventfd:10] 2023-11-04T01:44:28.971 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 733 JS\x20Hel polkitd 10u unix 0xffff982f48d2cc80 0t0 18814 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.971 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.971 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.971 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:28.971 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.972 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.972 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.972 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.972 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.972 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:28.972 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.972 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.972 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.972 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.972 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:28.972 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.972 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.972 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.972 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.973 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.973 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.973 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.973 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.973 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.973 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:28.973 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.973 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.973 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.973 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.973 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:28.973 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.973 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.973 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd 3r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd 4u a_inode 0,14 0 1081 [eventfd:3] 2023-11-04T01:44:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd 5u a_inode 0,14 0 1081 [eventfd:4] 2023-11-04T01:44:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd 6u unix 0xffff982f4869d500 0t0 18813 type=STREAM (CONNECTED) 2023-11-04T01:44:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd 7u a_inode 0,14 0 1081 [eventfd:5] 2023-11-04T01:44:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd 8r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd 9u a_inode 0,14 0 1081 [eventfd:10] 2023-11-04T01:44:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:polkitd 712 738 polkitd polkitd 10u unix 0xffff982f48d2cc80 0t0 18814 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root txt REG 8,1 622048 12498 /usr/sbin/smartd 2023-11-04T01:44:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.975 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.975 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.975 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.975 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:28.975 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.975 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.975 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.975 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.975 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.975 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.975 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.975 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.975 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.975 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.976 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.976 INFO:teuthology.orchestra.run.smithi044.stdout:smartd 713 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.976 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.976 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.976 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root txt REG 8,1 306896 20362 /usr/lib/systemd/systemd-logind 2023-11-04T01:44:28.976 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root DEL REG 8,1 1027 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:44:28.976 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:28.976 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.976 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.976 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.976 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.976 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root DEL REG 8,1 1168 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:44:28.976 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.977 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:28.977 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:28.977 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.977 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.977 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:28.977 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.977 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.977 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.977 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:44:28.977 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.977 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.977 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:44:28.977 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.977 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:44:28.977 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:44:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:44:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 1u unix 0xffff982f4414a200 0t0 15893 type=STREAM (CONNECTED) 2023-11-04T01:44:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 2u unix 0xffff982f4414a200 0t0 15893 type=STREAM (CONNECTED) 2023-11-04T01:44:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 3u unix 0xffff982f44153fc0 0t0 15918 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 4u a_inode 0,14 0 1081 [eventpoll:5,6,7,8,9,10,11,12,13,14,15,16,17,18,20] 2023-11-04T01:44:28.979 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 5u a_inode 0,14 0 1081 [signalfd] 2023-11-04T01:44:28.979 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 6u a_inode 0,14 0 1081 [timerfd] 2023-11-04T01:44:28.979 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 7r REG 0,21 4096 22210 /sys/devices/virtual/tty/tty0/active 2023-11-04T01:44:28.979 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 8u netlink 0t0 15929 KOBJECT_UEVENT 2023-11-04T01:44:28.979 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 9r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:28.979 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 10r FIFO 0,24 0t0 1297 /run/systemd/inhibit/1.ref 2023-11-04T01:44:28.979 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 11u netlink 0t0 15930 KOBJECT_UEVENT 2023-11-04T01:44:28.979 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 12u netlink 0t0 15931 KOBJECT_UEVENT 2023-11-04T01:44:28.979 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 13u netlink 0t0 15932 KOBJECT_UEVENT 2023-11-04T01:44:28.979 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 14u unix 0xffff982f44148440 0t0 15933 type=STREAM (CONNECTED) 2023-11-04T01:44:28.979 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 15u a_inode 0,14 0 1081 [timerfd] 2023-11-04T01:44:28.979 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 16u CHR 13,65 0t0 138 /dev/input/event1 2023-11-04T01:44:28.979 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 17u CHR 13,64 0t0 137 /dev/input/event0 2023-11-04T01:44:28.979 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 18u CHR 13,66 0t0 148 /dev/input/event2 2023-11-04T01:44:28.980 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 19u CHR 4,6 0t0 25 /dev/tty6 2023-11-04T01:44:28.980 INFO:teuthology.orchestra.run.smithi044.stdout:systemd-l 715 root 20r FIFO 0,24 0t0 1769 /run/systemd/sessions/4.ref 2023-11-04T01:44:28.980 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.980 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.980 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-04T01:44:28.980 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.980 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.980 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.980 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.980 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.980 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:28.980 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:28.980 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:28.980 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.981 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:28.982 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:28.982 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.982 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.982 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root 1u unix 0xffff982f48c19100 0t0 22925 type=STREAM (CONNECTED) 2023-11-04T01:44:28.982 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root 2u unix 0xffff982f48c19100 0t0 22925 type=STREAM (CONNECTED) 2023-11-04T01:44:28.982 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root 3u IPv4 22945 0t0 TCP *:ssh (LISTEN) 2023-11-04T01:44:28.982 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 758 root 4u IPv6 22947 0t0 TCP *:ssh (LISTEN) 2023-11-04T01:44:28.982 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.982 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.982 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:28.982 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:28.982 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.982 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.982 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-11-04T01:44:28.982 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-11-04T01:44:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-11-04T01:44:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.984 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.984 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.984 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.984 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.984 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.984 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.984 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:44:28.984 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-11-04T01:44:28.984 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.984 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.984 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.984 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:28.984 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.984 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.985 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.985 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.985 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.985 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.985 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.985 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.985 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.985 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.985 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.985 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.985 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.985 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.985 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.985 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.986 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.986 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.986 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:28.986 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.986 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.986 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.986 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:28.986 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.986 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.986 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.986 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root 1u unix 0xffff982f48d56a40 0t0 2603 type=STREAM (CONNECTED) 2023-11-04T01:44:28.986 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root 2u unix 0xffff982f48d56a40 0t0 2603 type=STREAM (CONNECTED) 2023-11-04T01:44:28.986 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2023-11-04T01:44:28.986 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root 4u sock 0,8 0t0 13660 protocol: NETLINK 2023-11-04T01:44:28.986 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root 5u unix 0xffff982f41e17b40 0t0 13681 type=STREAM (CONNECTED) 2023-11-04T01:44:28.987 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root 6u a_inode 0,14 0 1081 [eventfd:17] 2023-11-04T01:44:28.987 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root 7u unix 0xffff982f48f72200 0t0 17136 type=STREAM (CONNECTED) 2023-11-04T01:44:28.987 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 root 8u unix 0xffff982f48f70000 0t0 17137 type=STREAM (CONNECTED) 2023-11-04T01:44:28.987 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.987 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.987 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:28.987 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:28.987 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.987 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.987 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-11-04T01:44:28.987 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.987 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:28.987 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.987 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:28.987 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:28.988 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:28.988 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:28.988 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:28.988 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-11-04T01:44:28.988 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.988 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:28.988 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:28.988 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-11-04T01:44:28.988 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:28.988 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.988 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:28.988 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:28.988 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:28.988 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:28.989 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:28.989 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:28.989 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:28.989 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:44:28.989 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-11-04T01:44:28.989 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.989 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:28.989 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.989 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:28.989 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.989 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.989 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.989 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.989 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.990 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.990 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.990 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.990 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.990 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.990 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.990 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.990 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.990 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.990 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.990 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.990 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.990 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.990 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:28.991 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.991 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.991 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.991 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:28.991 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:28.991 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.991 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.991 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root 1u unix 0xffff982f48d56a40 0t0 2603 type=STREAM (CONNECTED) 2023-11-04T01:44:28.991 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root 2u unix 0xffff982f48d56a40 0t0 2603 type=STREAM (CONNECTED) 2023-11-04T01:44:28.991 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2023-11-04T01:44:28.991 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root 4u sock 0,8 0t0 13660 protocol: NETLINK 2023-11-04T01:44:28.991 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root 5u unix 0xffff982f41e17b40 0t0 13681 type=STREAM (CONNECTED) 2023-11-04T01:44:28.991 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root 6u a_inode 0,14 0 1081 [eventfd:17] 2023-11-04T01:44:28.991 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root 7u unix 0xffff982f48f72200 0t0 17136 type=STREAM (CONNECTED) 2023-11-04T01:44:28.991 INFO:teuthology.orchestra.run.smithi044.stdout:tuned 759 854 tuned root 8u unix 0xffff982f48f70000 0t0 17137 type=STREAM (CONNECTED) 2023-11-04T01:44:28.992 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.992 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.992 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:44:28.992 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:28.992 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.992 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.992 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:28.992 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.992 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:44:28.992 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:44:28.992 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:28.992 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:28.992 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:28.992 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:44:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:44:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:44:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:44:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:44:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:44:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:44:28.994 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:28.994 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:28.994 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:44:28.994 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:28.994 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:28.994 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:28.994 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:28.994 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:28.994 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:28.994 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.994 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:28.994 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.994 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root 1u unix 0xffff982f48d54c80 0t0 2599 type=STREAM (CONNECTED) 2023-11-04T01:44:28.994 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root 2u unix 0xffff982f48d54c80 0t0 2599 type=STREAM (CONNECTED) 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root 3u unix 0xffff982f487d2a80 0t0 20016 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root 4r FIFO 0,13 0t0 20021 pipe 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root 5u a_inode 0,14 0 1081 [eventpoll:4,6,7,8] 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root 6u a_inode 0,14 0 1081 [eventfd:16] 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root 7u unix 0xffff982f487b0880 0t0 20017 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root 8u unix 0xffff982f487b7b40 0t0 20018 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 root 9w FIFO 0,13 0t0 20021 pipe 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:44:28.996 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:44:28.996 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:28.996 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:28.996 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:28.996 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.996 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.996 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:28.996 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:44:28.996 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:44:28.996 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:44:28.996 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:28.996 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:28.996 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:28.996 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:28.997 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:28.997 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:44:28.997 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:28.997 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:44:28.997 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:44:28.997 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:44:28.997 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:28.997 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:28.997 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:44:28.997 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:28.997 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:28.997 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:28.997 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:28.997 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:28.997 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:28.998 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:28.998 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:28.998 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:28.998 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root 1u unix 0xffff982f48d54c80 0t0 2599 type=STREAM (CONNECTED) 2023-11-04T01:44:28.998 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root 2u unix 0xffff982f48d54c80 0t0 2599 type=STREAM (CONNECTED) 2023-11-04T01:44:28.998 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root 3u unix 0xffff982f487d2a80 0t0 20016 type=DGRAM (CONNECTED) 2023-11-04T01:44:28.998 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root 4r FIFO 0,13 0t0 20021 pipe 2023-11-04T01:44:28.998 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root 5u a_inode 0,14 0 1081 [eventpoll:4,6,7,8] 2023-11-04T01:44:28.998 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root 6u a_inode 0,14 0 1081 [eventfd:16] 2023-11-04T01:44:28.998 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root 7u unix 0xffff982f487b0880 0t0 20017 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:44:28.998 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root 8u unix 0xffff982f487b7b40 0t0 20018 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:44:28.998 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 774 gssproxy root 9w FIFO 0,13 0t0 20021 pipe 2023-11-04T01:44:28.998 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:28.998 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:28.999 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:44:28.999 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:28.999 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:28.999 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:28.999 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:28.999 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:28.999 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:44:28.999 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:44:28.999 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:28.999 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:28.999 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:28.999 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:28.999 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:28.999 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.000 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:44:29.000 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:44:29.000 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:44:29.000 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.000 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.000 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.000 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.000 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.000 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:44:29.000 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.000 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:44:29.000 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:44:29.000 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:44:29.000 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.000 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.001 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:44:29.001 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:29.001 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:29.001 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:29.001 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:29.001 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:29.001 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:29.001 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.001 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:29.001 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.001 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root 1u unix 0xffff982f48d54c80 0t0 2599 type=STREAM (CONNECTED) 2023-11-04T01:44:29.001 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root 2u unix 0xffff982f48d54c80 0t0 2599 type=STREAM (CONNECTED) 2023-11-04T01:44:29.001 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root 3u unix 0xffff982f487d2a80 0t0 20016 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.001 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root 4r FIFO 0,13 0t0 20021 pipe 2023-11-04T01:44:29.001 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root 5u a_inode 0,14 0 1081 [eventpoll:4,6,7,8] 2023-11-04T01:44:29.002 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root 6u a_inode 0,14 0 1081 [eventfd:16] 2023-11-04T01:44:29.002 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root 7u unix 0xffff982f487b0880 0t0 20017 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:44:29.002 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root 8u unix 0xffff982f487b7b40 0t0 20018 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:44:29.002 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 775 gssproxy root 9w FIFO 0,13 0t0 20021 pipe 2023-11-04T01:44:29.002 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.002 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.002 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:44:29.002 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:29.002 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.002 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.002 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.002 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.002 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:44:29.002 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:44:29.002 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:29.003 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:29.003 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:29.003 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.003 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.003 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.003 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:44:29.003 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:44:29.003 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:44:29.003 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.003 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.003 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.003 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.003 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.003 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:44:29.003 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.004 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:44:29.004 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:44:29.004 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:44:29.004 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.004 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.004 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:44:29.004 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:29.004 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:29.004 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:29.004 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:29.004 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:29.004 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:29.004 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.004 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root 1u unix 0xffff982f48d54c80 0t0 2599 type=STREAM (CONNECTED) 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root 2u unix 0xffff982f48d54c80 0t0 2599 type=STREAM (CONNECTED) 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root 3u unix 0xffff982f487d2a80 0t0 20016 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root 4r FIFO 0,13 0t0 20021 pipe 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root 5u a_inode 0,14 0 1081 [eventpoll:4,6,7,8] 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root 6u a_inode 0,14 0 1081 [eventfd:16] 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root 7u unix 0xffff982f487b0880 0t0 20017 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root 8u unix 0xffff982f487b7b40 0t0 20018 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 776 gssproxy root 9w FIFO 0,13 0t0 20021 pipe 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.005 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.006 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.006 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.006 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:44:29.006 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:44:29.006 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:29.006 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:29.006 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:29.006 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.006 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.006 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.006 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:44:29.006 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:44:29.006 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:44:29.006 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.007 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.007 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.007 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.007 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.007 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:44:29.007 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.007 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:44:29.007 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:44:29.007 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:44:29.007 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.007 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.007 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:44:29.007 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:29.007 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:29.007 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root 1u unix 0xffff982f48d54c80 0t0 2599 type=STREAM (CONNECTED) 2023-11-04T01:44:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root 2u unix 0xffff982f48d54c80 0t0 2599 type=STREAM (CONNECTED) 2023-11-04T01:44:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root 3u unix 0xffff982f487d2a80 0t0 20016 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root 4r FIFO 0,13 0t0 20021 pipe 2023-11-04T01:44:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root 5u a_inode 0,14 0 1081 [eventpoll:4,6,7,8] 2023-11-04T01:44:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root 6u a_inode 0,14 0 1081 [eventfd:16] 2023-11-04T01:44:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root 7u unix 0xffff982f487b0880 0t0 20017 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:44:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root 8u unix 0xffff982f487b7b40 0t0 20018 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:44:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 777 gssproxy root 9w FIFO 0,13 0t0 20021 pipe 2023-11-04T01:44:29.009 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.009 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.009 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:44:29.009 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:29.009 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.009 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.009 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.009 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.009 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:44:29.009 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:44:29.009 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:29.009 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:29.009 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:29.009 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.009 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:44:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:44:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:44:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:44:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:44:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:44:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:44:29.010 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:44:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root 1u unix 0xffff982f48d54c80 0t0 2599 type=STREAM (CONNECTED) 2023-11-04T01:44:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root 2u unix 0xffff982f48d54c80 0t0 2599 type=STREAM (CONNECTED) 2023-11-04T01:44:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root 3u unix 0xffff982f487d2a80 0t0 20016 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.011 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root 4r FIFO 0,13 0t0 20021 pipe 2023-11-04T01:44:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root 5u a_inode 0,14 0 1081 [eventpoll:4,6,7,8] 2023-11-04T01:44:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root 6u a_inode 0,14 0 1081 [eventfd:16] 2023-11-04T01:44:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root 7u unix 0xffff982f487b0880 0t0 20017 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:44:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root 8u unix 0xffff982f487b7b40 0t0 20018 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:44:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:gssproxy 773 778 gssproxy root 9w FIFO 0,13 0t0 20021 pipe 2023-11-04T01:44:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root cwd DIR 8,1 4096 1657 /var/spool/at 2023-11-04T01:44:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root txt REG 8,1 32680 12473 /usr/sbin/atd 2023-11-04T01:44:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:29.012 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:atd 780 root 3uW REG 0,24 4 1321 /run/atd.pid 2023-11-04T01:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root txt REG 8,1 74552 11234 /usr/sbin/crond 2023-11-04T01:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:29.014 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:29.014 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:29.014 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.014 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:29.014 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:29.014 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:29.014 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:29.014 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.014 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:29.014 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:29.014 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:29.014 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:29.014 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:29.014 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:29.015 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.015 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:29.015 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.015 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root 1u unix 0xffff982f48f74840 0t0 17126 type=STREAM (CONNECTED) 2023-11-04T01:44:29.015 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root 2u unix 0xffff982f48f74840 0t0 17126 type=STREAM (CONNECTED) 2023-11-04T01:44:29.015 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root 3uW REG 0,24 4 1319 /run/crond.pid 2023-11-04T01:44:29.015 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root 4u unix 0xffff982f48f84c80 0t0 17129 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.015 INFO:teuthology.orchestra.run.smithi044.stdout:crond 781 root 5r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:29.015 INFO:teuthology.orchestra.run.smithi044.stdout:nrpe 879 nrpe cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.015 INFO:teuthology.orchestra.run.smithi044.stdout:nrpe 879 nrpe rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.015 INFO:teuthology.orchestra.run.smithi044.stdout:nrpe 879 nrpe txt REG 8,1 80984 12959 /usr/sbin/nrpe 2023-11-04T01:44:29.015 INFO:teuthology.orchestra.run.smithi044.stdout:nrpe 879 nrpe mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.015 INFO:teuthology.orchestra.run.smithi044.stdout:nrpe 879 nrpe mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.015 INFO:teuthology.orchestra.run.smithi044.stdout:nrpe 879 nrpe mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.015 INFO:teuthology.orchestra.run.smithi044.stdout:nrpe 879 nrpe mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.016 INFO:teuthology.orchestra.run.smithi044.stdout:nrpe 879 nrpe mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.016 INFO:teuthology.orchestra.run.smithi044.stdout:nrpe 879 nrpe 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.016 INFO:teuthology.orchestra.run.smithi044.stdout:nrpe 879 nrpe 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.016 INFO:teuthology.orchestra.run.smithi044.stdout:nrpe 879 nrpe 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.016 INFO:teuthology.orchestra.run.smithi044.stdout:nrpe 879 nrpe 3u IPv4 17176 0t0 TCP *:nrpe (LISTEN) 2023-11-04T01:44:29.016 INFO:teuthology.orchestra.run.smithi044.stdout:nrpe 879 nrpe 4u unix 0xffff982f48f85940 0t0 17168 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.016 INFO:teuthology.orchestra.run.smithi044.stdout:nrpe 879 nrpe 5u IPv6 17177 0t0 TCP *:nrpe (LISTEN) 2023-11-04T01:44:29.016 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1284 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.016 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1284 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.016 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1284 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2023-11-04T01:44:29.016 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1284 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.016 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1284 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.016 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1284 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.016 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1284 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.016 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1284 root 0u CHR 4,1 0t0 20 /dev/tty1 2023-11-04T01:44:29.017 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1284 root 1u CHR 4,1 0t0 20 /dev/tty1 2023-11-04T01:44:29.017 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1284 root 2u CHR 4,1 0t0 20 /dev/tty1 2023-11-04T01:44:29.017 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1284 root 4r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:29.017 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.017 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.017 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2023-11-04T01:44:29.017 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:29.017 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.017 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.017 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:29.017 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:29.017 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:29.017 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.017 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:29.017 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root 0u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-04T01:44:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root 1u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-04T01:44:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root 2u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-04T01:44:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:agetty 1286 root 4r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-04T01:44:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.019 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.019 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:29.019 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.019 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu DEL REG 8,1 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:44:29.019 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:29.019 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.019 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.019 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:29.019 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.019 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.019 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:29.019 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:44:29.019 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:44:29.019 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:29.020 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:29.020 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.020 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.020 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-04T01:44:29.020 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.020 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.020 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:44:29.020 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:29.020 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.020 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:44:29.020 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:29.020 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:29.020 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:44:29.020 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.020 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu DEL REG 8,1 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:44:29.021 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.021 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:29.021 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.021 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 1u unix 0xffff982f4869fb40 0t0 18985 type=STREAM (CONNECTED) 2023-11-04T01:44:29.021 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 2u unix 0xffff982f4869fb40 0t0 18985 type=STREAM (CONNECTED) 2023-11-04T01:44:29.021 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 3u unix 0xffff982f4842ee80 0t0 22007 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.021 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 4u a_inode 0,14 0 1081 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2023-11-04T01:44:29.021 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 5u a_inode 0,14 0 1081 [signalfd] 2023-11-04T01:44:29.021 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 6r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:29.021 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 7r DIR 0,25 0 3391 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2023-11-04T01:44:29.021 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 8u a_inode 0,14 0 1081 [timerfd] 2023-11-04T01:44:29.021 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 9u a_inode 0,14 0 1081 [eventpoll:10,13] 2023-11-04T01:44:29.021 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 10r REG 0,20 0 16099 /proc/1646/mountinfo 2023-11-04T01:44:29.021 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 11r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:29.021 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 12u unix 0xffff982f48f72ec0 0t0 17297 /run/user/1000/bus type=STREAM (LISTEN) 2023-11-04T01:44:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 13r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 14r REG 0,20 0 4026532076 /proc/swaps 2023-11-04T01:44:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 15u netlink 0t0 18995 KOBJECT_UEVENT 2023-11-04T01:44:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 16u unix 0xffff982f48d2d940 0t0 19000 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2023-11-04T01:44:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 17u unix 0xffff982f48d2ee80 0t0 19001 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 18u unix 0xffff982f48d29540 0t0 19002 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 19u unix 0xffff982f4869f2c0 0t0 19003 /run/user/1000/systemd/private type=STREAM (LISTEN) 2023-11-04T01:44:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 20u unix 0xffff982f4869c400 0t0 19005 type=STREAM (CONNECTED) 2023-11-04T01:44:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:systemd 1646 ubuntu 21u a_inode 0,14 0 1081 [timerfd] 2023-11-04T01:44:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-04T01:44:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:29.023 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:29.023 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:29.023 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:29.023 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-04T01:44:29.023 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu DEL REG 8,1 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:44:29.023 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.023 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.023 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:29.023 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.023 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-04T01:44:29.023 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:29.023 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-04T01:44:29.023 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-04T01:44:29.023 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:29.023 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:44:29.024 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:29.025 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.025 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-04T01:44:29.025 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:44:29.025 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:29.025 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:29.025 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:44:29.025 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.025 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu DEL REG 8,1 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:44:29.025 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.025 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:29.025 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.025 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu 1u unix 0xffff982f4869fb40 0t0 18985 type=STREAM (CONNECTED) 2023-11-04T01:44:29.025 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu 2u unix 0xffff982f4869fb40 0t0 18985 type=STREAM (CONNECTED) 2023-11-04T01:44:29.025 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu 3u a_inode 0,14 0 1081 [eventfd:13] 2023-11-04T01:44:29.026 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu 4u a_inode 0,14 0 1081 [eventfd:14] 2023-11-04T01:44:29.026 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu 6w FIFO 0,13 0t0 18989 pipe 2023-11-04T01:44:29.026 INFO:teuthology.orchestra.run.smithi044.stdout:(sd-pam) 1674 ubuntu 7u unix 0xffff982f44155940 0t0 16102 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.026 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.026 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.026 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-04T01:44:29.026 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:29.026 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:29.026 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:29.026 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.026 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-04T01:44:29.026 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-04T01:44:29.026 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-04T01:44:29.026 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:29.027 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.027 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.027 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.027 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.027 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:29.027 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.027 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:29.027 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-04T01:44:29.027 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-04T01:44:29.027 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.027 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.027 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.027 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.027 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.027 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-04T01:44:29.028 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root 4u unix 0xffff982f48d5f2c0 0t0 23808 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.028 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root 5r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:29.028 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root 7w REG 8,1 1468180 1641 /var/log/messages 2023-11-04T01:44:29.028 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root 8w REG 8,1 1077893 1642 /var/log/secure 2023-11-04T01:44:29.028 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:29.028 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.028 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.028 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-04T01:44:29.028 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:29.028 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:29.028 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:29.028 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.028 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-04T01:44:29.028 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-04T01:44:29.028 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-04T01:44:29.029 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:29.029 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.029 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.029 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.029 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.029 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:29.029 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.029 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:29.029 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-04T01:44:29.029 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-04T01:44:29.029 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.029 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.029 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.029 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.029 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.030 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-04T01:44:29.030 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root 4u unix 0xffff982f48d5f2c0 0t0 23808 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.030 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root 5r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:29.030 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root 7w REG 8,1 1468180 1641 /var/log/messages 2023-11-04T01:44:29.030 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root 8w REG 8,1 1077893 1642 /var/log/secure 2023-11-04T01:44:29.030 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3729 in:imjour root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:29.030 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.030 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.030 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-04T01:44:29.030 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:29.030 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:29.030 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:29.030 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.030 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-04T01:44:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-04T01:44:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-04T01:44:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-04T01:44:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-04T01:44:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.032 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.032 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.032 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-04T01:44:29.032 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root 4u unix 0xffff982f48d5f2c0 0t0 23808 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.032 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root 5r a_inode 0,14 0 1081 inotify 2023-11-04T01:44:29.032 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root 7w REG 8,1 1468180 1641 /var/log/messages 2023-11-04T01:44:29.032 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root 8w REG 8,1 1077893 1642 /var/log/secure 2023-11-04T01:44:29.032 INFO:teuthology.orchestra.run.smithi044.stdout:rsyslogd 3723 3730 rs:main root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:29.032 INFO:teuthology.orchestra.run.smithi044.stdout:tls-strp 61031 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.032 INFO:teuthology.orchestra.run.smithi044.stdout:tls-strp 61031 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.032 INFO:teuthology.orchestra.run.smithi044.stdout:tls-strp 61031 root txt unknown /proc/61031/exe 2023-11-04T01:44:29.032 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 62231 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.032 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 62231 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.032 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 62231 root txt unknown /proc/62231/exe 2023-11-04T01:44:29.032 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 62232 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.033 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 62232 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.033 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 62232 root txt unknown /proc/62232/exe 2023-11-04T01:44:29.033 INFO:teuthology.orchestra.run.smithi044.stdout:kdmflush/ 70351 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.033 INFO:teuthology.orchestra.run.smithi044.stdout:kdmflush/ 70351 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.033 INFO:teuthology.orchestra.run.smithi044.stdout:kdmflush/ 70351 root txt unknown /proc/70351/exe 2023-11-04T01:44:29.033 INFO:teuthology.orchestra.run.smithi044.stdout:kdmflush/ 70472 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.033 INFO:teuthology.orchestra.run.smithi044.stdout:kdmflush/ 70472 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.033 INFO:teuthology.orchestra.run.smithi044.stdout:kdmflush/ 70472 root txt unknown /proc/70472/exe 2023-11-04T01:44:29.033 INFO:teuthology.orchestra.run.smithi044.stdout:kdmflush/ 70592 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.033 INFO:teuthology.orchestra.run.smithi044.stdout:kdmflush/ 70592 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.033 INFO:teuthology.orchestra.run.smithi044.stdout:kdmflush/ 70592 root txt unknown /proc/70592/exe 2023-11-04T01:44:29.033 INFO:teuthology.orchestra.run.smithi044.stdout:kdmflush/ 70712 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.033 INFO:teuthology.orchestra.run.smithi044.stdout:kdmflush/ 70712 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.033 INFO:teuthology.orchestra.run.smithi044.stdout:kdmflush/ 70712 root txt unknown /proc/70712/exe 2023-11-04T01:44:29.033 INFO:teuthology.orchestra.run.smithi044.stdout:kdmflush/ 70832 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.034 INFO:teuthology.orchestra.run.smithi044.stdout:kdmflush/ 70832 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.034 INFO:teuthology.orchestra.run.smithi044.stdout:kdmflush/ 70832 root txt unknown /proc/70832/exe 2023-11-04T01:44:29.034 INFO:teuthology.orchestra.run.smithi044.stdout:xfsalloc 71725 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.034 INFO:teuthology.orchestra.run.smithi044.stdout:xfsalloc 71725 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.034 INFO:teuthology.orchestra.run.smithi044.stdout:xfsalloc 71725 root txt unknown /proc/71725/exe 2023-11-04T01:44:29.034 INFO:teuthology.orchestra.run.smithi044.stdout:xfs_mru_c 71726 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.034 INFO:teuthology.orchestra.run.smithi044.stdout:xfs_mru_c 71726 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.034 INFO:teuthology.orchestra.run.smithi044.stdout:xfs_mru_c 71726 root txt unknown /proc/71726/exe 2023-11-04T01:44:29.034 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-buf/d 71727 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.034 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-buf/d 71727 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.034 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-buf/d 71727 root txt unknown /proc/71727/exe 2023-11-04T01:44:29.034 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-conv/ 71728 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.034 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-conv/ 71728 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.035 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-conv/ 71728 root txt unknown /proc/71728/exe 2023-11-04T01:44:29.035 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-recla 71729 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.035 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-recla 71729 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.035 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-recla 71729 root txt unknown /proc/71729/exe 2023-11-04T01:44:29.035 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-block 71730 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.035 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-block 71730 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.035 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-block 71730 root txt unknown /proc/71730/exe 2023-11-04T01:44:29.035 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-inode 71731 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.035 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-inode 71731 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.035 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-inode 71731 root txt unknown /proc/71731/exe 2023-11-04T01:44:29.035 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-log/d 71732 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.035 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-log/d 71732 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.035 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-log/d 71732 root txt unknown /proc/71732/exe 2023-11-04T01:44:29.035 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-cil/d 71733 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.036 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-cil/d 71733 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.036 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-cil/d 71733 root txt unknown /proc/71733/exe 2023-11-04T01:44:29.036 INFO:teuthology.orchestra.run.smithi044.stdout:xfsaild/d 71734 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.036 INFO:teuthology.orchestra.run.smithi044.stdout:xfsaild/d 71734 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.036 INFO:teuthology.orchestra.run.smithi044.stdout:xfsaild/d 71734 root txt unknown /proc/71734/exe 2023-11-04T01:44:29.036 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.036 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.036 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-04T01:44:29.036 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:29.036 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-11-04T01:44:29.036 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-04T01:44:29.036 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.036 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:29.036 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-11-04T01:44:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-04T01:44:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-04T01:44:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-04T01:44:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:29.038 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-11-04T01:44:29.038 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-11-04T01:44:29.038 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:29.038 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:29.038 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:29.038 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:29.038 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.038 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.038 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.038 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.038 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.038 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.038 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.039 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.039 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:29.039 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:29.039 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.039 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.039 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.039 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.039 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.039 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.039 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.039 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.039 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:29.039 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:29.039 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:29.040 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:29.040 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.040 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:29.040 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.040 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.040 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.040 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root 3u unix 0xffff982f48d2c400 0t0 162247 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.040 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root 4u IPv4 155221 0t0 TCP smithi044.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:39738 (ESTABLISHED) 2023-11-04T01:44:29.040 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root 6u unix 0xffff982f4869b300 0t0 162222 type=STREAM (CONNECTED) 2023-11-04T01:44:29.040 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root 7w FIFO 0,24 0t0 1769 /run/systemd/sessions/4.ref 2023-11-04T01:44:29.040 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74756 root 8u unix 0xffff982f4869d940 0t0 162251 type=STREAM (CONNECTED) 2023-11-04T01:44:29.040 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.040 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.040 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-04T01:44:29.040 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-11-04T01:44:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-04T01:44:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-11-04T01:44:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-04T01:44:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-04T01:44:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:29.042 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.042 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:29.042 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:29.042 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.042 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-04T01:44:29.042 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:29.042 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-11-04T01:44:29.042 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-11-04T01:44:29.042 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:29.042 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:29.042 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:29.042 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:29.042 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.042 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.043 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.043 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.043 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.043 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.043 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.043 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.043 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:29.043 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:29.043 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.043 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.043 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.043 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.043 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 3u unix 0xffff982f48d2c400 0t0 162247 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 4u IPv4 155221 0t0 TCP smithi044.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:39738 (ESTABLISHED) 2023-11-04T01:44:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 5u unix 0xffff982f48699540 0t0 162250 type=STREAM (CONNECTED) 2023-11-04T01:44:29.045 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 6u unix 0xffff982f4869b300 0t0 162222 type=STREAM (CONNECTED) 2023-11-04T01:44:29.045 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 7w FIFO 0,24 0t0 1769 /run/systemd/sessions/4.ref 2023-11-04T01:44:29.045 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 11w FIFO 0,13 0t0 173988 pipe 2023-11-04T01:44:29.045 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 12r FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.045 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 13w FIFO 0,13 0t0 173992 pipe 2023-11-04T01:44:29.045 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 14r FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.045 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 15r FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.045 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 16w FIFO 0,13 0t0 177800 pipe 2023-11-04T01:44:29.045 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 17r FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.045 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 18r FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:29.045 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 19w FIFO 0,13 0t0 177808 pipe 2023-11-04T01:44:29.045 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 20r FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:29.046 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 21r FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.046 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 22w FIFO 0,13 0t0 176929 pipe 2023-11-04T01:44:29.046 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 23r FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.046 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 24r FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:29.046 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 25w FIFO 0,13 0t0 174066 pipe 2023-11-04T01:44:29.046 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 26r FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:29.046 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 27r FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:29.046 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 28w FIFO 0,13 0t0 260523 pipe 2023-11-04T01:44:29.046 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 29r FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:29.046 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 30r FIFO 0,13 0t0 260524 pipe 2023-11-04T01:44:29.046 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 31w FIFO 0,13 0t0 254513 pipe 2023-11-04T01:44:29.046 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 33r FIFO 0,13 0t0 260525 pipe 2023-11-04T01:44:29.046 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 34r FIFO 0,13 0t0 262146 pipe 2023-11-04T01:44:29.046 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 35r FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:29.047 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 37r FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:29.047 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 39r FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:29.047 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 40r FIFO 0,13 0t0 262147 pipe 2023-11-04T01:44:29.047 INFO:teuthology.orchestra.run.smithi044.stdout:sshd 74759 ubuntu 41r FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:29.047 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.047 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.047 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony txt REG 8,1 353408 12490 /usr/sbin/chronyd 2023-11-04T01:44:29.047 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.047 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.047 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:44:29.047 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:29.047 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:44:29.047 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony 3u unix 0xffff982f48d2b740 0t0 162276 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony 5u IPv4 162281 0t0 UDP localhost:323 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony 6u IPv6 162282 0t0 UDP localhost:323 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi044.stdout:chronyd 74819 chrony 7u unix 0xffff982f48d2aec0 0t0 162283 /run/chrony/chronyd.sock type=DGRAM (CONNECTED) 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph 1u unix 0xffff982f48f71980 0t0 165309 type=STREAM (CONNECTED) 2023-11-04T01:44:29.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-cras 75060 ceph 2u unix 0xffff982f48f71980 0t0 165309 type=STREAM (CONNECTED) 2023-11-04T01:44:29.050 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/1 76253 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.050 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/1 76253 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.050 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/1 76253 root txt unknown /proc/76253/exe 2023-11-04T01:44:29.051 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/1 76254 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.051 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/1 76254 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.051 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/1 76254 root txt unknown /proc/76254/exe 2023-11-04T01:44:29.051 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/3 76853 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.051 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/3 76853 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.051 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/3 76853 root txt unknown /proc/76853/exe 2023-11-04T01:44:29.051 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/3 77080 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.051 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/3 77080 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.051 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/3 77080 root txt unknown /proc/77080/exe 2023-11-04T01:44:29.051 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-buf/d 82246 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.051 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-buf/d 82246 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.051 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-buf/d 82246 root txt unknown /proc/82246/exe 2023-11-04T01:44:29.051 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-conv/ 82247 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.051 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-conv/ 82247 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.051 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-conv/ 82247 root txt unknown /proc/82247/exe 2023-11-04T01:44:29.052 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-recla 82248 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.052 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-recla 82248 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.052 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-recla 82248 root txt unknown /proc/82248/exe 2023-11-04T01:44:29.052 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-block 82249 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.052 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-block 82249 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.052 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-block 82249 root txt unknown /proc/82249/exe 2023-11-04T01:44:29.052 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-inode 82250 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.052 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-inode 82250 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.052 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-inode 82250 root txt unknown /proc/82250/exe 2023-11-04T01:44:29.052 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-log/d 82251 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.052 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-log/d 82251 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.052 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-log/d 82251 root txt unknown /proc/82251/exe 2023-11-04T01:44:29.052 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-cil/d 82252 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.052 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-cil/d 82252 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.052 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-cil/d 82252 root txt unknown /proc/82252/exe 2023-11-04T01:44:29.053 INFO:teuthology.orchestra.run.smithi044.stdout:xfsaild/d 82253 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.053 INFO:teuthology.orchestra.run.smithi044.stdout:xfsaild/d 82253 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.053 INFO:teuthology.orchestra.run.smithi044.stdout:xfsaild/d 82253 root txt unknown /proc/82253/exe 2023-11-04T01:44:29.053 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-buf/d 82330 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.053 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-buf/d 82330 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.053 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-buf/d 82330 root txt unknown /proc/82330/exe 2023-11-04T01:44:29.053 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-conv/ 82331 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.053 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-conv/ 82331 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.053 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-conv/ 82331 root txt unknown /proc/82331/exe 2023-11-04T01:44:29.053 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-recla 82332 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.053 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-recla 82332 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.053 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-recla 82332 root txt unknown /proc/82332/exe 2023-11-04T01:44:29.053 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-block 82333 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.053 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-block 82333 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.053 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-block 82333 root txt unknown /proc/82333/exe 2023-11-04T01:44:29.054 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-inode 82334 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.054 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-inode 82334 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.054 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-inode 82334 root txt unknown /proc/82334/exe 2023-11-04T01:44:29.054 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-log/d 82335 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.054 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-log/d 82335 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.054 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-log/d 82335 root txt unknown /proc/82335/exe 2023-11-04T01:44:29.054 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-cil/d 82336 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.054 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-cil/d 82336 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.054 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-cil/d 82336 root txt unknown /proc/82336/exe 2023-11-04T01:44:29.054 INFO:teuthology.orchestra.run.smithi044.stdout:xfsaild/d 82337 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.054 INFO:teuthology.orchestra.run.smithi044.stdout:xfsaild/d 82337 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.054 INFO:teuthology.orchestra.run.smithi044.stdout:xfsaild/d 82337 root txt unknown /proc/82337/exe 2023-11-04T01:44:29.054 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-buf/d 82414 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.054 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-buf/d 82414 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.054 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-buf/d 82414 root txt unknown /proc/82414/exe 2023-11-04T01:44:29.055 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-conv/ 82415 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.055 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-conv/ 82415 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.055 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-conv/ 82415 root txt unknown /proc/82415/exe 2023-11-04T01:44:29.055 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-recla 82416 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.055 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-recla 82416 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.055 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-recla 82416 root txt unknown /proc/82416/exe 2023-11-04T01:44:29.055 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-block 82417 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.055 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-block 82417 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.055 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-block 82417 root txt unknown /proc/82417/exe 2023-11-04T01:44:29.055 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-inode 82418 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.055 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-inode 82418 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.055 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-inode 82418 root txt unknown /proc/82418/exe 2023-11-04T01:44:29.055 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-log/d 82419 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.055 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-log/d 82419 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.055 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-log/d 82419 root txt unknown /proc/82419/exe 2023-11-04T01:44:29.056 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-cil/d 82420 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.056 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-cil/d 82420 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.056 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-cil/d 82420 root txt unknown /proc/82420/exe 2023-11-04T01:44:29.056 INFO:teuthology.orchestra.run.smithi044.stdout:xfsaild/d 82421 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.056 INFO:teuthology.orchestra.run.smithi044.stdout:xfsaild/d 82421 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.056 INFO:teuthology.orchestra.run.smithi044.stdout:xfsaild/d 82421 root txt unknown /proc/82421/exe 2023-11-04T01:44:29.056 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-buf/d 82498 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.056 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-buf/d 82498 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.056 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-buf/d 82498 root txt unknown /proc/82498/exe 2023-11-04T01:44:29.056 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-conv/ 82499 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.056 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-conv/ 82499 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.056 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-conv/ 82499 root txt unknown /proc/82499/exe 2023-11-04T01:44:29.056 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-recla 82500 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.056 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-recla 82500 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.056 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-recla 82500 root txt unknown /proc/82500/exe 2023-11-04T01:44:29.057 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-block 82501 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.057 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-block 82501 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.057 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-block 82501 root txt unknown /proc/82501/exe 2023-11-04T01:44:29.057 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-inode 82502 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.057 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-inode 82502 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.057 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-inode 82502 root txt unknown /proc/82502/exe 2023-11-04T01:44:29.057 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-log/d 82503 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.057 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-log/d 82503 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.057 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-log/d 82503 root txt unknown /proc/82503/exe 2023-11-04T01:44:29.057 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-cil/d 82504 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.057 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-cil/d 82504 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.057 INFO:teuthology.orchestra.run.smithi044.stdout:xfs-cil/d 82504 root txt unknown /proc/82504/exe 2023-11-04T01:44:29.057 INFO:teuthology.orchestra.run.smithi044.stdout:xfsaild/d 82505 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.057 INFO:teuthology.orchestra.run.smithi044.stdout:xfsaild/d 82505 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.057 INFO:teuthology.orchestra.run.smithi044.stdout:xfsaild/d 82505 root txt unknown /proc/82505/exe 2023-11-04T01:44:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:dio/dm-0 82551 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:dio/dm-0 82551 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:dio/dm-0 82551 root txt unknown /proc/82551/exe 2023-11-04T01:44:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:dio/dm-1 83725 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:dio/dm-1 83725 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:dio/dm-1 83725 root txt unknown /proc/83725/exe 2023-11-04T01:44:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:dio/dm-2 84887 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:dio/dm-2 84887 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:dio/dm-2 84887 root txt unknown /proc/84887/exe 2023-11-04T01:44:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:dio/dm-3 86049 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:dio/dm-3 86049 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:dio/dm-3 86049 root txt unknown /proc/86049/exe 2023-11-04T01:44:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.059 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:29.059 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:29.059 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.059 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.059 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:29.059 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.059 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:29.059 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:29.059 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:29.059 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:29.059 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:29.059 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:29.059 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:29.059 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:29.060 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:29.060 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:29.060 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:29.060 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.060 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.060 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.060 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.060 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.060 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.060 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.060 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:29.060 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.060 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.060 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.060 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.061 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.061 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.061 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:29.061 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.061 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.061 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:29.061 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.061 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.061 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:29.061 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:29.061 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.061 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:29.061 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:29.061 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:29.061 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:29.062 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:29.062 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:29.062 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:29.062 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:29.062 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:29.062 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.062 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:29.062 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:29.062 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.062 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:29.062 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.062 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.062 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:29.062 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root 0r FIFO 0,13 0t0 173988 pipe 2023-11-04T01:44:29.063 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.063 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.063 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root 3r FIFO 0,13 0t0 179629 pipe 2023-11-04T01:44:29.063 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root 4w FIFO 0,13 0t0 179629 pipe 2023-11-04T01:44:29.063 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root 5u netlink 0t0 179634 AUDIT 2023-11-04T01:44:29.063 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87848 root 6u unix 0xffff982f4842aa80 0t0 179635 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.063 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.063 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.063 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:29.063 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.063 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.063 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.063 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.063 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.063 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root 0r FIFO 0,13 0t0 173988 pipe 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87865 root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.065 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.065 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.065 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:29.065 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:29.065 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.065 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.065 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:29.065 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.065 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:29.065 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:29.065 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:29.065 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:29.065 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:29.065 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:29.066 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:29.066 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:29.066 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:29.066 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.066 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.066 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:29.066 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:29.066 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.066 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.066 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.066 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.066 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.066 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.066 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.066 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:29.069 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root 0r FIFO 0,13 0t0 173992 pipe 2023-11-04T01:44:29.069 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.069 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.069 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root 3r FIFO 0,13 0t0 175751 pipe 2023-11-04T01:44:29.069 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root 4w FIFO 0,13 0t0 175751 pipe 2023-11-04T01:44:29.069 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root 5u netlink 0t0 177718 AUDIT 2023-11-04T01:44:29.069 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 87867 root 6u unix 0xffff982f46a96a40 0t0 177719 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87905 log root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87906 service root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87907 admin_soc root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87908 signal_ha root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87909 rocksdb:l root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87910 rocksdb:h root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87926 ceph-mon root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87927 fn_monsto root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87928 msgr-work root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87929 msgr-work root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87930 msgr-work root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87931 OpHistory root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87932 fin root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87933 safe_time root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87934 cpu_tp root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87935 cpu_tp root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87936 cpu_tp root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87937 cpu_tp root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87938 ms_dispat root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87939 ms_local root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87940 safe_time root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87941 ms_dispat root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 87942 ms_local root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:29.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 1w FIFO 0,13 0t0 173989 pipe 2023-11-04T01:44:29.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 2w FIFO 0,13 0t0 173990 pipe 2023-11-04T01:44:29.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 3r FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 4w FIFO 0,13 0t0 181696 pipe 2023-11-04T01:44:29.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 5w REG 8,1 57391265 265308 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:29.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 6uW REG 0,24 6 1894 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:29.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 7r FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 8w FIFO 0,13 0t0 181698 pipe 2023-11-04T01:44:29.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 9u unix 0xffff982f4414d500 0t0 181699 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 10r FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 11w FIFO 0,13 0t0 181700 pipe 2023-11-04T01:44:29.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 15r REG 253,4 4656017 33816724 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:44:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 16w REG 253,4 106784 33816715 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:44:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 17w REG 253,4 898 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 18u a_inode 0,14 0 1081 [eventpoll:19,27,28,37,41,46] 2023-11-04T01:44:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 19r FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 20w FIFO 0,13 0t0 181706 pipe 2023-11-04T01:44:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 21u a_inode 0,14 0 1081 [eventpoll:22,30,42,45] 2023-11-04T01:44:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 22r FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 23w FIFO 0,13 0t0 181707 pipe 2023-11-04T01:44:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 24u a_inode 0,14 0 1081 [eventpoll:25,29,40,43] 2023-11-04T01:44:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 25r FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 26w FIFO 0,13 0t0 181708 pipe 2023-11-04T01:44:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 27u IPv4 176906 0t0 TCP smithi044.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:29.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 28u IPv4 176907 0t0 TCP smithi044.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:29.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 29u IPv4 181713 0t0 TCP smithi044.front.sepia.ceph.com:37910->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 30u IPv4 179660 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:46972 (ESTABLISHED) 2023-11-04T01:44:29.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 31r FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 32w FIFO 0,13 0t0 181709 pipe 2023-11-04T01:44:29.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 33r FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 34w FIFO 0,13 0t0 181710 pipe 2023-11-04T01:44:29.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 35r FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 36w FIFO 0,13 0t0 181711 pipe 2023-11-04T01:44:29.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 37u IPv4 179108 0t0 TCP smithi044.front.sepia.ceph.com:57284->smithi204.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:29.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 38w REG 8,1 104269 265309 /var/log/ceph/ceph.log 2023-11-04T01:44:29.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 39w REG 8,1 190140 265311 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:29.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 40u IPv4 183387 0t0 TCP smithi044.front.sepia.ceph.com:34070->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 41u IPv4 182543 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47062 (ESTABLISHED) 2023-11-04T01:44:29.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 42u IPv4 182547 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47072 (ESTABLISHED) 2023-11-04T01:44:29.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 43u IPv4 177990 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:47088 (ESTABLISHED) 2023-11-04T01:44:29.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 45u IPv4 253654 0t0 TCP smithi044.front.sepia.ceph.com:3300->smithi044.front.sepia.ceph.com:37506 (ESTABLISHED) 2023-11-04T01:44:29.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mon 87898 121598 rstore_co root 46u IPv4 256376 0t0 TCP smithi044.front.sepia.ceph.com:3300->192.168.0.1:47984 (ESTABLISHED) 2023-11-04T01:44:29.264 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.264 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.264 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:29.264 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.264 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.264 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.264 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.264 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.264 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.265 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.265 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.265 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.265 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.265 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.265 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.265 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.265 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.265 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.265 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.265 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.265 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.265 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.265 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root 0r FIFO 0,13 0t0 173992 pipe 2023-11-04T01:44:29.266 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.266 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 87902 root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87944 log root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87946 msgr-work root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87947 msgr-work root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87948 msgr-work root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87963 service root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87966 admin_soc root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87967 ceph_time root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87968 fn_anonym root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87970 signal_ha root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87971 mgrsb-fin root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87972 ms_dispat root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87973 ms_local root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87974 io_contex root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87975 io_contex root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87976 safe_time root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87977 safe_time root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87983 safe_time root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87984 fn_anonym root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87985 flusher root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:29.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:29.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 65240 274075 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 783584 273410 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 60264 273415 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 87608 273413 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 96304 273411 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 331936 273388 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 237384 273390 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 177920 273416 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 654400 273421 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:29.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 70784 273412 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 7042240 272779 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:29.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 155704 273298 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 132136 272828 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:29.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 73976 273196 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:29.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 40328 272777 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:29.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 382824 272780 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:29.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:29.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:29.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 3784896 272829 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 20504 273299 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:29.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:29.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:29.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:29.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:29.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:29.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:29.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 721976 270242 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:29.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 2154416 270244 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:29.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 16192 265937 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 49328 270781 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:29.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:29.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:29.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:29.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 1w FIFO 0,13 0t0 173993 pipe 2023-11-04T01:44:29.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 2w FIFO 0,13 0t0 173994 pipe 2023-11-04T01:44:29.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 3r FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 4w FIFO 0,13 0t0 179654 pipe 2023-11-04T01:44:29.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6] 2023-11-04T01:44:29.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 6r FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 7w FIFO 0,13 0t0 179656 pipe 2023-11-04T01:44:29.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,23] 2023-11-04T01:44:29.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 9r FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 10w FIFO 0,13 0t0 179657 pipe 2023-11-04T01:44:29.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,24] 2023-11-04T01:44:29.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 12r FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 13w FIFO 0,13 0t0 179658 pipe 2023-11-04T01:44:29.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 14w REG 8,1 677897 265310 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:29.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 15uW REG 0,24 6 1896 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:29.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 16r FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 17w FIFO 0,13 0t0 176912 pipe 2023-11-04T01:44:29.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 18u unix 0xffff982f41e15940 0t0 176913 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 19r FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 20w FIFO 0,13 0t0 176917 pipe 2023-11-04T01:44:29.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 21r FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 22w FIFO 0,13 0t0 176918 pipe 2023-11-04T01:44:29.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 23u IPv4 181715 0t0 TCP smithi044.front.sepia.ceph.com:46972->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mgr 87943 87986 safe_time root 24u IPv4 181157 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.503 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.503 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.503 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:29.503 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:29.503 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.503 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.503 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:29.503 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:29.503 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.503 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.503 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:29.503 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:29.504 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:29.504 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:29.504 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:29.504 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:29.504 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:29.504 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:29.504 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:29.504 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.504 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.504 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.504 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.504 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.504 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.504 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.504 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.505 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:29.505 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:29.505 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.505 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.505 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.505 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.505 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:29.505 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.505 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:29.505 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.505 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.505 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.505 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.505 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:29.505 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:29.506 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:29.506 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:29.506 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:29.506 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:29.506 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:29.506 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:29.506 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:29.506 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:29.506 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:29.506 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.506 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:29.506 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:29.506 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.507 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:29.507 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.507 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.507 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:29.507 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root 0r FIFO 0,13 0t0 177800 pipe 2023-11-04T01:44:29.507 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:29.507 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:29.507 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root 3r FIFO 0,13 0t0 175807 pipe 2023-11-04T01:44:29.507 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root 4w FIFO 0,13 0t0 175807 pipe 2023-11-04T01:44:29.507 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root 5u netlink 0t0 180853 AUDIT 2023-11-04T01:44:29.507 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88063 root 6u unix 0xffff982f48d5ee80 0t0 180854 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.507 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.507 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.507 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:29.507 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:29.508 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.508 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.508 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:29.508 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.508 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:29.508 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:29.508 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:29.508 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:29.508 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:29.508 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:29.508 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.508 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:29.508 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:29.508 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:29.508 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:29.509 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.509 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.509 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.509 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.509 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.509 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.509 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.509 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.509 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.509 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.509 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:29.509 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.509 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.509 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:29.509 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.510 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.510 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.510 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:29.510 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:29.510 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.510 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.510 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:29.510 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:29.510 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:29.510 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:29.510 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:29.510 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:29.510 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:29.511 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:29.511 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:29.511 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:29.511 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:29.511 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.511 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:29.511 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:29.511 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.511 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:29.511 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.511 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.511 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:29.511 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root 0r FIFO 0,13 0t0 177808 pipe 2023-11-04T01:44:29.511 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.511 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.512 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root 3r FIFO 0,13 0t0 177826 pipe 2023-11-04T01:44:29.512 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root 4w FIFO 0,13 0t0 177826 pipe 2023-11-04T01:44:29.512 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root 5u netlink 0t0 177831 AUDIT 2023-11-04T01:44:29.512 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88077 root 6u unix 0xffff982f46a97b40 0t0 177832 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.512 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.512 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.512 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:29.512 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:29.512 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.512 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.512 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:29.512 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.512 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:29.512 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:29.512 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:29.513 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:29.513 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:29.513 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:29.513 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.513 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.513 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:29.513 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:29.513 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:29.513 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.513 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.513 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.513 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.513 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.513 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.513 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:29.514 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:29.514 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:29.514 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.514 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.514 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.514 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.514 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.514 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.514 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.514 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:29.514 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.514 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.514 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:29.514 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.516 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:29.516 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.516 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.516 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:29.516 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root 0r FIFO 0,13 0t0 176929 pipe 2023-11-04T01:44:29.516 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:29.516 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:29.516 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root 3r FIFO 0,13 0t0 175816 pipe 2023-11-04T01:44:29.516 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root 4w FIFO 0,13 0t0 175816 pipe 2023-11-04T01:44:29.516 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root 5u netlink 0t0 175822 AUDIT 2023-11-04T01:44:29.516 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88083 root 6u unix 0xffff982f487d3fc0 0t0 175823 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.516 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.516 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.516 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:29.517 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:29.517 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:29.517 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.517 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:29.517 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.517 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:29.517 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:29.517 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:29.517 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:29.517 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:29.517 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:29.517 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:29.517 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:29.517 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:29.517 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:29.518 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:29.518 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.518 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.518 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.518 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.518 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.518 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.518 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.518 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.518 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:29.518 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.518 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.518 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.518 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.518 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.519 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:29.519 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.519 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:29.519 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.519 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.519 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.519 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:29.519 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:29.519 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.519 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:29.519 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:29.521 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root 0r FIFO 0,13 0t0 174066 pipe 2023-11-04T01:44:29.521 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:29.521 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:29.521 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root 3r FIFO 0,13 0t0 183298 pipe 2023-11-04T01:44:29.521 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root 4w FIFO 0,13 0t0 183298 pipe 2023-11-04T01:44:29.521 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root 5u netlink 0t0 177848 AUDIT 2023-11-04T01:44:29.521 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 88092 root 6u unix 0xffff982f46a972c0 0t0 177849 type=DGRAM (CONNECTED) 2023-11-04T01:44:29.521 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.521 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.521 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:29.521 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.521 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.521 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.521 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.521 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.522 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.522 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.522 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.522 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.522 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.522 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.522 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.522 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.522 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.522 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.522 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.522 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.522 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.522 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.523 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root 0r FIFO 0,13 0t0 177800 pipe 2023-11-04T01:44:29.523 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:29.523 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88127 root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:29.523 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.523 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.523 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:29.523 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.523 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.523 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.523 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.523 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.523 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.523 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.523 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.524 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.524 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.524 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.524 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.524 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.524 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.524 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.524 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.524 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.524 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.524 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.524 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root 0r FIFO 0,13 0t0 177808 pipe 2023-11-04T01:44:29.524 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.525 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88133 root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.525 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.525 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.525 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:29.525 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.525 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.525 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.525 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.525 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.525 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.525 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.525 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.525 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.525 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.526 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.526 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.526 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.526 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.526 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.526 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.526 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.526 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.526 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.526 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root 0r FIFO 0,13 0t0 176929 pipe 2023-11-04T01:44:29.526 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:29.526 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88135 root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:29.526 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.527 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.527 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:29.527 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:29.527 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:29.527 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.527 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.527 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.527 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.527 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.527 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.527 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.527 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.527 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root 0r FIFO 0,13 0t0 174066 pipe 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 88137 root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 14w REG 8,1 130872438 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 14w REG 8,1 130832503 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88169 log root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 14w REG 8,1 130832503 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88172 msgr-work root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 14w REG 8,1 130832503 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88173 msgr-work root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 14w REG 8,1 130832503 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88174 msgr-work root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 14w REG 8,1 130832503 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88193 service root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 14w REG 8,1 130832503 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88197 admin_soc root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 14w REG 8,1 130832503 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88240 signal_ha root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 14w REG 8,1 130832503 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88241 io_contex root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 14w REG 8,1 130832503 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88242 io_contex root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 14w REG 8,1 130832503 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88258 OpHistory root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 14w REG 8,1 130832503 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88259 ceph_time root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 14w REG 8,1 130832503 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88302 ceph-osd root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 14w REG 8,1 130832503 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88321 ceph-osd root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 14w REG 8,1 130832503 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88329 ceph-osd root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88336 ceph-osd root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88347 ceph-osd root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88355 ceph-osd root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88363 ceph-osd root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88377 ceph-osd root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88378 ceph-osd root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88380 safe_time root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88381 safe_time root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88383 safe_time root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88384 safe_time root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88387 fn_anonym root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88500 rocksdb:l root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88506 rocksdb:l root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88509 rocksdb:l root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 88512 rocksdb:h root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 89869 bstore_ai root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 90596 bstore_ai root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91320 ceph-osd root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91326 cfin root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91327 bstore_kv root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:29.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:29.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:29.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:29.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:29.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:29.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:29.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:29.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:29.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:29.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:29.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:29.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:29.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:29.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:29.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:29.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:29.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:29.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:29.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:29.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:29.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:29.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:29.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:29.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:29.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:29.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:29.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:29.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:29.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:29.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:29.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:29.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:29.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:29.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:29.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91328 bstore_kv root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:29.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:29.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:29.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:29.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:29.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:29.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:29.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:29.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:29.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:29.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:29.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:29.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:29.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:29.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:29.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:29.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:29.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:29.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:29.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:29.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:29.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:29.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:29.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:29.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:29.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:29.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:29.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:29.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:29.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:29.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:29.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:29.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:29.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:29.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:29.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:29.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:29.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:29.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:29.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:29.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:29.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:29.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:29.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:29.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:29.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:29.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:29.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:29.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:29.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:29.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:29.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:29.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:29.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:29.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:29.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:29.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:29.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:29.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:29.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:29.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:29.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:29.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:29.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:29.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:29.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:29.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:29.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:29.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:29.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:29.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:29.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:29.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:29.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:29.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:29.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:29.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:29.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:29.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:29.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:29.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:29.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:29.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:29.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:29.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:29.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:29.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:29.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:29.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:29.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:29.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:29.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:29.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91329 bstore_me root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 14w REG 8,1 130832786 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91339 ms_dispat root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.027 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:30.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91340 ms_local root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91341 safe_time root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91342 safe_time root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91351 ms_dispat root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91353 ms_local root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91356 ms_dispat root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91357 ms_local root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91359 ms_dispat root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91360 ms_local root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91364 ms_dispat root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91366 ms_local root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91370 ms_dispat root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91372 ms_local root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91376 ms_dispat root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91378 ms_local root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91379 fn_anonym root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91381 finisher root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91383 safe_time root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91385 safe_time root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91387 ceph-osd root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 14w REG 8,1 130833069 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91389 osd_srv_a root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 14w REG 8,1 130838534 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91392 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 14w REG 8,1 130838534 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91394 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 14w REG 8,1 130859481 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91397 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 14w REG 8,1 130872438 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91400 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 14w REG 8,1 130872438 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91403 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 14w REG 8,1 130872438 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91405 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 14w REG 8,1 130872438 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91406 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 14w REG 8,1 130872438 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91407 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 14w REG 8,1 130872438 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91408 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 14w REG 8,1 130872438 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91409 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 14w REG 8,1 130872438 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91410 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 14w REG 8,1 130872438 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91411 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 14w REG 8,1 130872438 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91412 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 14w REG 8,1 130872438 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91413 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 14w REG 8,1 130872438 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91414 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 14w REG 8,1 130872438 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91415 tp_osd_tp root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root DEL REG 0,17 182541 /[aio] 2023-11-04T01:44:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root DEL REG 0,17 175968 /[aio] 2023-11-04T01:44:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 1w FIFO 0,13 0t0 177809 pipe 2023-11-04T01:44:30.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 2w FIFO 0,13 0t0 177810 pipe 2023-11-04T01:44:30.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 3r FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 4w FIFO 0,13 0t0 182331 pipe 2023-11-04T01:44:30.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,69,75,76,79,82,85,88,93,96,98,102] 2023-11-04T01:44:30.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 6r FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 7w FIFO 0,13 0t0 182336 pipe 2023-11-04T01:44:30.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,72,77,80,83,86,89,91,95,99] 2023-11-04T01:44:30.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 9r FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 10w FIFO 0,13 0t0 182337 pipe 2023-11-04T01:44:30.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,70,73,74,78,81,84,87,90,92,94,100] 2023-11-04T01:44:30.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 12r FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 13w FIFO 0,13 0t0 182338 pipe 2023-11-04T01:44:30.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 14w REG 8,1 130872438 265305 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:30.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 15uW REG 0,24 6 1901 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:30.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 16r FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 17w FIFO 0,13 0t0 182343 pipe 2023-11-04T01:44:30.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 18u unix 0xffff982f4869ea40 0t0 182344 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 19u IPv4 182360 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:30.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 20u IPv4 182376 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:30.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 21u IPv4 182394 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:30.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 22u IPv4 182414 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:30.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 23u IPv4 182435 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:30.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 24u IPv4 182458 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:30.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 25u IPv4 182483 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:30.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 26u IPv4 182510 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:30.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 27r FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 28w FIFO 0,13 0t0 180992 pipe 2023-11-04T01:44:30.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 29r FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 30w FIFO 0,13 0t0 180993 pipe 2023-11-04T01:44:30.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 31u sock 0,8 0t0 184362 protocol: UDPv6 2023-11-04T01:44:30.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:30.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:30.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 58u IPv4 182546 0t0 TCP smithi044.front.sepia.ceph.com:47072->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 59r FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 60w FIFO 0,13 0t0 184370 pipe 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 61u IPv4 181178 0t0 TCP smithi044.front.sepia.ceph.com:39640->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 62r FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 63w FIFO 0,13 0t0 184371 pipe 2023-11-04T01:44:30.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 64u IPv4 184379 0t0 TCP smithi044.front.sepia.ceph.com:50510->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 65u IPv4 179691 0t0 TCP smithi044.front.sepia.ceph.com:43858->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 66u IPv4 181179 0t0 TCP smithi044.front.sepia.ceph.com:42568->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 67u IPv4 184380 0t0 TCP smithi044.front.sepia.ceph.com:33494->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 68u IPv4 179692 0t0 TCP smithi044.front.sepia.ceph.com:56776->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 69u IPv4 184381 0t0 TCP smithi044.front.sepia.ceph.com:55514->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 70u IPv4 181180 0t0 TCP smithi044.front.sepia.ceph.com:47916->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 71u IPv4 179693 0t0 TCP smithi044.front.sepia.ceph.com:z-wave-s->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 72u IPv4 179694 0t0 TCP smithi044.front.sepia.ceph.com:54700->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 73u IPv4 181181 0t0 TCP smithi044.front.sepia.ceph.com:58008->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 74u IPv4 181182 0t0 TCP smithi044.front.sepia.ceph.com:45488->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 75u IPv4 184382 0t0 TCP smithi044.front.sepia.ceph.com:34060->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 76u IPv4 184383 0t0 TCP smithi044.front.sepia.ceph.com:60368->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 77u IPv4 184386 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58682 (ESTABLISHED) 2023-11-04T01:44:30.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 78u IPv4 184389 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60640 (ESTABLISHED) 2023-11-04T01:44:30.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 79u IPv4 184392 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40600 (ESTABLISHED) 2023-11-04T01:44:30.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 80u IPv4 184395 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49570 (ESTABLISHED) 2023-11-04T01:44:30.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 81u IPv4 184398 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40616 (ESTABLISHED) 2023-11-04T01:44:30.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 82u IPv4 184401 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49576 (ESTABLISHED) 2023-11-04T01:44:30.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 83u IPv4 182573 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:30.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 84u IPv4 182574 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40624 (ESTABLISHED) 2023-11-04T01:44:30.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 85u IPv4 182577 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60650 (ESTABLISHED) 2023-11-04T01:44:30.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 86u IPv4 181795 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi044.front.sepia.ceph.com:60660 (ESTABLISHED) 2023-11-04T01:44:30.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 87u IPv4 181798 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi044.front.sepia.ceph.com:58712 (ESTABLISHED) 2023-11-04T01:44:30.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 88u IPv4 176005 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49584 (ESTABLISHED) 2023-11-04T01:44:30.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 89u IPv4 176008 0t0 TCP smithi044.front.sepia.ceph.com:6824->smithi204.front.sepia.ceph.com:40632 (ESTABLISHED) 2023-11-04T01:44:30.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 90u IPv4 176011 0t0 TCP smithi044.front.sepia.ceph.com:6820->smithi204.front.sepia.ceph.com:49588 (ESTABLISHED) 2023-11-04T01:44:30.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 91u IPv4 184420 0t0 TCP smithi044.front.sepia.ceph.com:33246->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 92u IPv4 176015 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46694 (ESTABLISHED) 2023-11-04T01:44:30.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 93u IPv4 176016 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46708 (ESTABLISHED) 2023-11-04T01:44:30.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 94u IPv4 176044 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:53688 (ESTABLISHED) 2023-11-04T01:44:30.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 95u IPv4 176017 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi044.front.sepia.ceph.com:46710 (ESTABLISHED) 2023-11-04T01:44:30.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 96u IPv4 256114 0t0 TCP smithi044.front.sepia.ceph.com:6813->smithi204.front.sepia.ceph.com:35052 (ESTABLISHED) 2023-11-04T01:44:30.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 98u IPv4 176021 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39314 (ESTABLISHED) 2023-11-04T01:44:30.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 99u IPv4 176022 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39328 (ESTABLISHED) 2023-11-04T01:44:30.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 100u IPv4 176023 0t0 TCP smithi044.front.sepia.ceph.com:pentbox-sim->smithi204.front.sepia.ceph.com:39344 (ESTABLISHED) 2023-11-04T01:44:30.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88150 91416 osd_srv_h root 102u IPv4 176026 0t0 TCP smithi044.front.sepia.ceph.com:39946->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 14w REG 8,1 125778039 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 14w REG 8,1 125776907 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88160 log root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88162 msgr-work root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88163 msgr-work root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88164 msgr-work root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88178 service root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88179 admin_soc root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88233 signal_ha root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88234 io_contex root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88235 io_contex root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88249 OpHistory root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88250 ceph_time root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88292 ceph-osd root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88319 ceph-osd root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88327 ceph-osd root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88339 ceph-osd root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88344 ceph-osd root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88351 ceph-osd root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88361 ceph-osd root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88376 ceph-osd root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88379 ceph-osd root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88382 safe_time root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88385 safe_time root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88386 safe_time root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 14w REG 8,1 125777190 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88388 safe_time root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88389 fn_anonym root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88492 rocksdb:l root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88496 rocksdb:l root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88499 rocksdb:l root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 88501 rocksdb:h root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 89871 bstore_ai root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 90597 bstore_ai root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91325 ceph-osd root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:30.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:30.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:30.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:30.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:30.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:30.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:30.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:30.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:30.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:30.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:30.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:30.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91330 cfin root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:30.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:30.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:30.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:30.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:30.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:30.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:30.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:30.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:30.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:30.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:30.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:30.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:30.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:30.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:30.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:30.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:30.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:30.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:30.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:30.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:30.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:30.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:30.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:30.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:30.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:30.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:30.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:30.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:30.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:30.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:30.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:30.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:30.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:30.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:30.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:30.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:30.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:30.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:30.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:30.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:30.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:30.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:30.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:30.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:30.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:30.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:30.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:30.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:30.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:30.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:30.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:30.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:30.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:30.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:30.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:30.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:30.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:30.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:30.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:30.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:30.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:30.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:30.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:30.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:30.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:30.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:30.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:30.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:30.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:30.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:30.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:30.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:30.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:30.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:30.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:30.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:30.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:30.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:30.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:30.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:30.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:30.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:30.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:30.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:30.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:30.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:30.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:30.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:30.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:30.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:30.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:30.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:30.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:30.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:30.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:30.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:30.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:30.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:30.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:30.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:30.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:30.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:30.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:30.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:30.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:30.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:30.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:30.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:30.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:30.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:30.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:30.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:30.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:30.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:30.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:30.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:30.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:30.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:30.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:30.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91331 bstore_kv root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91332 bstore_kv root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91333 bstore_me root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.074 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91417 ms_dispat root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.075 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.076 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.077 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.078 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.079 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.080 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.081 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.082 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.083 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.084 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.085 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.086 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.087 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.088 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91418 ms_local root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.089 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.090 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.091 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.092 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.093 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.094 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91419 safe_time root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91420 safe_time root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91421 ms_dispat root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91422 ms_local root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91423 ms_dispat root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91424 ms_local root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91425 ms_dispat root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91426 ms_local root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 14w REG 8,1 125777473 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91427 ms_dispat root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91428 ms_local root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91429 ms_dispat root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91430 ms_local root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91431 ms_dispat root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91432 ms_local root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91433 fn_anonym root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91434 finisher root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91435 safe_time root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91436 safe_time root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91437 ceph-osd root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91438 osd_srv_a root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91439 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91440 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91441 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91442 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91443 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91444 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91445 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91446 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91447 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91448 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91449 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 14w REG 8,1 125777756 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91450 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 14w REG 8,1 125778039 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91451 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 14w REG 8,1 125778039 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91452 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 14w REG 8,1 125778039 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91453 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 14w REG 8,1 125778039 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91454 tp_osd_tp root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root DEL REG 0,17 184367 /[aio] 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root DEL REG 0,17 179685 /[aio] 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 1w FIFO 0,13 0t0 176930 pipe 2023-11-04T01:44:31.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 2w FIFO 0,13 0t0 176931 pipe 2023-11-04T01:44:31.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 3r FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 4w FIFO 0,13 0t0 183344 pipe 2023-11-04T01:44:31.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,75,80,81,82,87,91,94,97,100] 2023-11-04T01:44:31.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 6r FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 7w FIFO 0,13 0t0 183346 pipe 2023-11-04T01:44:31.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 8u a_inode 0,14 0 1081 [eventpoll:9,58,65,68,71,74,76,78,84,86,89,92,95,101] 2023-11-04T01:44:31.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 9r FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 10w FIFO 0,13 0t0 183347 pipe 2023-11-04T01:44:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 11u a_inode 0,14 0 1081 [eventpoll:12,61,66,69,72,77,79,83,85,88,90,93,96,99] 2023-11-04T01:44:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 12r FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 13w FIFO 0,13 0t0 183348 pipe 2023-11-04T01:44:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 14w REG 8,1 125778039 265306 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:44:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 15uW REG 0,24 6 1899 /run/ceph/ceph-osd.2.pid 2023-11-04T01:44:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 16r FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 17w FIFO 0,13 0t0 180873 pipe 2023-11-04T01:44:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 18u unix 0xffff982f48d56600 0t0 180874 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 19u IPv4 177894 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 20u IPv4 177896 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 21u IPv4 177899 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 22u IPv4 177903 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 23u IPv4 177908 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:31.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 24u IPv4 177914 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:31.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 25u IPv4 177921 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:31.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 26u IPv4 177929 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:31.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 27r FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 28w FIFO 0,13 0t0 180883 pipe 2023-11-04T01:44:31.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 29r FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 30w FIFO 0,13 0t0 180884 pipe 2023-11-04T01:44:31.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 31u sock 0,8 0t0 181753 protocol: UDPv6 2023-11-04T01:44:31.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:44:31.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:44:31.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:44:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 58u IPv4 181766 0t0 TCP smithi044.front.sepia.ceph.com:37992->smithi204.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 59r FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 60w FIFO 0,13 0t0 183418 pipe 2023-11-04T01:44:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 61u IPv4 181183 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43846 (ESTABLISHED) 2023-11-04T01:44:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 62r FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 63w FIFO 0,13 0t0 183419 pipe 2023-11-04T01:44:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 64u IPv4 181184 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43858 (ESTABLISHED) 2023-11-04T01:44:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 65u IPv4 181187 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42568 (ESTABLISHED) 2023-11-04T01:44:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 66u IPv4 181188 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42582 (ESTABLISHED) 2023-11-04T01:44:31.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 67u IPv4 181191 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37828 (ESTABLISHED) 2023-11-04T01:44:31.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 68u IPv4 181194 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50130 (ESTABLISHED) 2023-11-04T01:44:31.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 69u IPv4 181197 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:31.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 70u IPv4 181200 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50134 (ESTABLISHED) 2023-11-04T01:44:31.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 71u IPv4 181785 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi044.front.sepia.ceph.com:43860 (ESTABLISHED) 2023-11-04T01:44:31.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 72u IPv4 181788 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi044.front.sepia.ceph.com:42596 (ESTABLISHED) 2023-11-04T01:44:31.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 73u IPv4 182580 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50146 (ESTABLISHED) 2023-11-04T01:44:31.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 74u IPv4 183433 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37846 (ESTABLISHED) 2023-11-04T01:44:31.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 75u IPv4 181794 0t0 TCP smithi044.front.sepia.ceph.com:60660->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 76u IPv4 181204 0t0 TCP smithi044.front.sepia.ceph.com:47924->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 77u IPv4 178012 0t0 TCP smithi044.front.sepia.ceph.com:58712->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 78u IPv4 181205 0t0 TCP smithi044.front.sepia.ceph.com:58026->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 79u IPv4 178013 0t0 TCP smithi044.front.sepia.ceph.com:55532->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 80u IPv4 181801 0t0 TCP smithi044.front.sepia.ceph.com:41256->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 81u IPv4 181802 0t0 TCP smithi044.front.sepia.ceph.com:56794->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 82u IPv4 181803 0t0 TCP smithi044.front.sepia.ceph.com:45502->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 83u IPv4 178014 0t0 TCP smithi044.front.sepia.ceph.com:33528->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 84u IPv4 184409 0t0 TCP smithi044.front.sepia.ceph.com:34092->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 85u IPv4 178015 0t0 TCP smithi044.front.sepia.ceph.com:54732->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 86u IPv4 184410 0t0 TCP smithi044.front.sepia.ceph.com:60384->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 87u IPv4 181804 0t0 TCP smithi044.front.sepia.ceph.com:50536->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 88u IPv4 178016 0t0 TCP smithi044.front.sepia.ceph.com:39660->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:31.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 89u IPv4 181217 0t0 TCP smithi044.front.sepia.ceph.com:6804->smithi204.front.sepia.ceph.com:50156 (ESTABLISHED) 2023-11-04T01:44:31.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 90u IPv4 181220 0t0 TCP smithi044.front.sepia.ceph.com:6806->smithi204.front.sepia.ceph.com:37850 (ESTABLISHED) 2023-11-04T01:44:31.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 91u IPv4 181223 0t0 TCP smithi044.front.sepia.ceph.com:46708->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 92u IPv4 181231 0t0 TCP smithi044.front.sepia.ceph.com:41174->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:31.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 93u IPv4 182588 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59822 (ESTABLISHED) 2023-11-04T01:44:31.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 94u IPv4 181232 0t0 TCP smithi044.front.sepia.ceph.com:33262->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 95u IPv4 176047 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:37480 (ESTABLISHED) 2023-11-04T01:44:31.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 96u IPv4 176030 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi044.front.sepia.ceph.com:59150 (ESTABLISHED) 2023-11-04T01:44:31.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 97u IPv4 257084 0t0 TCP smithi044.front.sepia.ceph.com:6800->smithi204.front.sepia.ceph.com:49050 (ESTABLISHED) 2023-11-04T01:44:31.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 99u IPv4 181233 0t0 TCP smithi044.front.sepia.ceph.com:39978->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 100u IPv4 176034 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59838 (ESTABLISHED) 2023-11-04T01:44:31.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88151 91455 osd_srv_h root 101u IPv4 176035 0t0 TCP smithi044.front.sepia.ceph.com:6802->smithi204.front.sepia.ceph.com:59854 (ESTABLISHED) 2023-11-04T01:44:31.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 14w REG 8,1 145834439 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88188 log root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88194 msgr-work root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88195 msgr-work root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88196 msgr-work root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88206 service root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88208 admin_soc root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88237 signal_ha root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88238 io_contex root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88239 io_contex root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88252 OpHistory root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88254 ceph_time root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88308 ceph-osd root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88325 ceph-osd root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88332 ceph-osd root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88335 ceph-osd root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88343 ceph-osd root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 14w REG 8,1 145832760 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88352 ceph-osd root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88359 ceph-osd root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88367 ceph-osd root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88368 ceph-osd root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88369 safe_time root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88370 safe_time root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88371 safe_time root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88372 safe_time root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88373 fn_anonym root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88394 rocksdb:l root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88395 rocksdb:l root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88396 rocksdb:l root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 88397 rocksdb:h root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 89867 bstore_ai root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.965 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:31.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 90595 bstore_ai root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91319 ceph-osd root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:31.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:31.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:31.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:31.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:31.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:31.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:31.987 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:31.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:31.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:31.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:31.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:31.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:31.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:31.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:31.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:31.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:31.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:31.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:31.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:31.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:31.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:31.988 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:31.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:31.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:31.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:31.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:31.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:31.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:31.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:31.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:31.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:31.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:31.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:31.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:31.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:31.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:31.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:31.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:31.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:31.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:31.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:31.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:31.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:31.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:31.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:31.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:31.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:31.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:31.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:31.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:31.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:31.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:31.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:31.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:31.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:31.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:31.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:31.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:31.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:31.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:31.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:31.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:31.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:31.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:31.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:31.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:31.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:31.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:31.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:31.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91321 cfin root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91322 bstore_kv root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91323 bstore_kv root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91324 bstore_me root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91343 ms_dispat root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91344 ms_local root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 14w REG 8,1 145833043 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.069 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.070 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.072 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91345 safe_time root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91346 safe_time root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91347 ms_dispat root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91348 ms_local root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91349 ms_dispat root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91350 ms_local root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91352 ms_dispat root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91354 ms_local root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91355 ms_dispat root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91358 ms_local root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91361 ms_dispat root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91362 ms_local root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91363 ms_dispat root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91365 ms_local root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91367 fn_anonym root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91368 finisher root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91369 safe_time root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91371 safe_time root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 14w REG 8,1 145833326 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91373 ceph-osd root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 14w REG 8,1 145834156 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91374 osd_srv_a root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 14w REG 8,1 145834156 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91375 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 14w REG 8,1 145834156 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91377 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 14w REG 8,1 145834156 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91380 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 14w REG 8,1 145834156 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91382 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 14w REG 8,1 145834439 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91384 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 14w REG 8,1 145834439 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91386 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 14w REG 8,1 145834439 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91388 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 14w REG 8,1 145834439 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91390 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 14w REG 8,1 145834439 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91391 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 14w REG 8,1 145834439 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91393 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 14w REG 8,1 145834439 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91395 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 14w REG 8,1 145834439 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91396 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 14w REG 8,1 145834439 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91398 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 14w REG 8,1 145834439 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91399 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 14w REG 8,1 145834439 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91401 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 14w REG 8,1 145834439 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91402 tp_osd_tp root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root DEL REG 0,17 181158 /[aio] 2023-11-04T01:44:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root DEL REG 0,17 183405 /[aio] 2023-11-04T01:44:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 1w FIFO 0,13 0t0 177801 pipe 2023-11-04T01:44:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 2w FIFO 0,13 0t0 177802 pipe 2023-11-04T01:44:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 3r FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 4w FIFO 0,13 0t0 175837 pipe 2023-11-04T01:44:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,72,76,78,81,83,88,91,95,97,98] 2023-11-04T01:44:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 6r FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 7w FIFO 0,13 0t0 175839 pipe 2023-11-04T01:44:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 8u a_inode 0,14 0 1081 [eventpoll:9,61,65,68,71,79,82,84,85,86,89,92,100,101] 2023-11-04T01:44:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 9r FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 10w FIFO 0,13 0t0 175840 pipe 2023-11-04T01:44:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 11u a_inode 0,14 0 1081 [eventpoll:12,64,66,69,73,74,75,77,80,87,90,93,94,96] 2023-11-04T01:44:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 12r FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 13w FIFO 0,13 0t0 175841 pipe 2023-11-04T01:44:32.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 14w REG 8,1 145834439 265304 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:32.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 15uW REG 0,24 6 1905 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:32.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 16r FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 17w FIFO 0,13 0t0 175843 pipe 2023-11-04T01:44:32.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 18u unix 0xffff982f487b3740 0t0 175844 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 19u IPv4 180894 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:32.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 20u IPv4 180904 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:32.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 21u IPv4 180915 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:32.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 22u IPv4 180927 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:32.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 23u IPv4 180940 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:32.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 24u IPv4 180955 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:32.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 25u IPv4 180972 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:32.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 26u IPv4 180991 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:32.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 27r FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 28w FIFO 0,13 0t0 183363 pipe 2023-11-04T01:44:32.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 29r FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 30w FIFO 0,13 0t0 183364 pipe 2023-11-04T01:44:32.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 31u sock 0,8 0t0 183393 protocol: UDPv6 2023-11-04T01:44:32.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:32.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:32.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:32.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 58r FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 59w FIFO 0,13 0t0 184372 pipe 2023-11-04T01:44:32.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 60u IPv4 182542 0t0 TCP smithi044.front.sepia.ceph.com:47062->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 61u IPv4 175988 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39640 (ESTABLISHED) 2023-11-04T01:44:32.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 62r FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 63w FIFO 0,13 0t0 184373 pipe 2023-11-04T01:44:32.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 64u IPv4 175991 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50510 (ESTABLISHED) 2023-11-04T01:44:32.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 65u IPv4 175994 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50520 (ESTABLISHED) 2023-11-04T01:44:32.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 66u IPv4 175997 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39652 (ESTABLISHED) 2023-11-04T01:44:32.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 67u IPv4 179700 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38820 (ESTABLISHED) 2023-11-04T01:44:32.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 68u IPv4 179703 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59976 (ESTABLISHED) 2023-11-04T01:44:32.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 69u IPv4 179706 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38822 (ESTABLISHED) 2023-11-04T01:44:32.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 70u IPv4 179709 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:59990 (ESTABLISHED) 2023-11-04T01:44:32.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 71u IPv4 179712 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60004 (ESTABLISHED) 2023-11-04T01:44:32.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 72u IPv4 179715 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38830 (ESTABLISHED) 2023-11-04T01:44:32.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 73u IPv4 181775 0t0 TCP smithi044.front.sepia.ceph.com:34084->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 74u IPv4 181774 0t0 TCP smithi044.front.sepia.ceph.com:58696->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 75u IPv4 181776 0t0 TCP smithi044.front.sepia.ceph.com:60382->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 76u IPv4 179718 0t0 TCP smithi044.front.sepia.ceph.com:54716->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 77u IPv4 181777 0t0 TCP smithi044.front.sepia.ceph.com:47918->smithi044.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 78u IPv4 179719 0t0 TCP smithi044.front.sepia.ceph.com:43860->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 79u IPv4 184404 0t0 TCP smithi044.front.sepia.ceph.com:60650->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 80u IPv4 181778 0t0 TCP smithi044.front.sepia.ceph.com:58018->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 81u IPv4 179720 0t0 TCP smithi044.front.sepia.ceph.com:55522->smithi044.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:32.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 82u IPv4 184405 0t0 TCP smithi044.front.sepia.ceph.com:45498->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 83u IPv4 179721 0t0 TCP smithi044.front.sepia.ceph.com:33518->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 84u IPv4 184406 0t0 TCP smithi044.front.sepia.ceph.com:42596->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 85u IPv4 184407 0t0 TCP smithi044.front.sepia.ceph.com:41242->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 86u IPv4 184408 0t0 TCP smithi044.front.sepia.ceph.com:56786->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 87u IPv4 176002 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi044.front.sepia.ceph.com:50536 (ESTABLISHED) 2023-11-04T01:44:32.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 88u IPv4 181208 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi044.front.sepia.ceph.com:39660 (ESTABLISHED) 2023-11-04T01:44:32.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 89u IPv4 182581 0t0 TCP smithi044.front.sepia.ceph.com:6816->smithi204.front.sepia.ceph.com:60020 (ESTABLISHED) 2023-11-04T01:44:32.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 90u IPv4 182584 0t0 TCP smithi044.front.sepia.ceph.com:6812->smithi204.front.sepia.ceph.com:38838 (ESTABLISHED) 2023-11-04T01:44:32.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 91u IPv4 179726 0t0 TCP smithi044.front.sepia.ceph.com:46694->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 92u IPv4 179734 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41174 (ESTABLISHED) 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 93u IPv4 179731 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41164 (ESTABLISHED) 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 94u IPv4 179735 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi044.front.sepia.ceph.com:41184 (ESTABLISHED) 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 95u IPv4 176029 0t0 TCP smithi044.front.sepia.ceph.com:33274->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 96u IPv4 178019 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:35256 (ESTABLISHED) 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 97u IPv4 252850 0t0 TCP smithi044.front.sepia.ceph.com:6808->smithi204.front.sepia.ceph.com:58826 (ESTABLISHED) 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 98u IPv4 179740 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41176 (ESTABLISHED) 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 100u IPv4 179741 0t0 TCP smithi044.front.sepia.ceph.com:6810->smithi204.front.sepia.ceph.com:41188 (ESTABLISHED) 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88157 91404 osd_srv_h root 101u IPv4 181807 0t0 TCP smithi044.front.sepia.ceph.com:39962->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.603 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.609 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 14w REG 8,1 135558084 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88183 log root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 14w REG 8,1 135558084 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88185 msgr-work root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 14w REG 8,1 135558084 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.647 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88186 msgr-work root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 14w REG 8,1 135558084 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88187 msgr-work root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 14w REG 8,1 135558084 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88203 service root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 14w REG 8,1 135558084 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88204 admin_soc root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 14w REG 8,1 135558084 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88244 signal_ha root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.707 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.708 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 14w REG 8,1 135558084 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.709 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.710 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.712 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.713 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.714 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88245 io_contex root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.715 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.717 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.718 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.719 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 14w REG 8,1 135558084 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88246 io_contex root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 14w REG 8,1 135558084 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88253 OpHistory root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 14w REG 8,1 135558084 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88255 ceph_time root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 14w REG 8,1 135558084 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88303 ceph-osd root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 14w REG 8,1 135558084 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88322 ceph-osd root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 14w REG 8,1 135558084 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88331 ceph-osd root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88341 ceph-osd root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88349 ceph-osd root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88357 ceph-osd root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88365 ceph-osd root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88398 ceph-osd root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88399 ceph-osd root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.868 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.869 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.870 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.871 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.872 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.873 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.874 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.876 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.878 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.879 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.880 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88400 safe_time root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.881 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.882 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.883 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.884 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.885 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.886 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.887 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.888 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.889 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.890 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.891 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.892 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88401 safe_time root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.893 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.894 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.897 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.898 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.899 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.900 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.901 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.903 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.904 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88402 safe_time root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.905 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.906 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.907 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.908 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.909 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.910 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.911 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.912 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.913 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.914 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88403 safe_time root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.918 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.919 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.920 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.921 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.922 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.923 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.924 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.927 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.928 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.929 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88404 fn_anonym root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.932 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.933 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.934 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.935 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.937 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.940 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.941 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.942 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.943 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88790 rocksdb:l root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.944 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.945 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.946 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.947 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.949 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.951 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.952 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.953 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.954 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.955 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.956 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88794 rocksdb:l root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.957 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.958 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.959 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.960 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.961 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.962 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.965 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.966 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.967 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.968 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.969 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88801 rocksdb:l root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.970 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.971 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.973 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.974 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.977 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.978 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.979 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.980 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.981 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.983 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 88805 rocksdb:h root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:32.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:32.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:32.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:32.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:32.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:32.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:32.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:32.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:32.984 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:32.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:32.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:32.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:32.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:32.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:32.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:32.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:32.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:32.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:32.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:32.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:32.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:32.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:32.985 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:32.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:32.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:32.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:32.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:32.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:32.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:32.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:32.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:32.986 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:32.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:32.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:32.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:32.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:32.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:32.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:32.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:32.989 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:32.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:32.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:32.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:32.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:32.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:32.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:32.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:32.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:32.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:32.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:32.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:32.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:32.990 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:32.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:32.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:32.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:32.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:32.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:32.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:32.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:32.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:32.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:32.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:32.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:32.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:32.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:32.992 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:32.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:32.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:32.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:32.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:32.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:32.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:32.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:32.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:32.993 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:32.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:32.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:32.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:32.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:32.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:32.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:32.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:32.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:32.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:32.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:32.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:32.994 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:32.996 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:32.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:32.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:32.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:32.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:32.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:32.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:32.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:32.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:32.997 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:32.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:32.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:32.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:32.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:32.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:32.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:32.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:32.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:32.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:32.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:32.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:32.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:32.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:32.998 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:32.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:32.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:32.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:32.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:32.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:32.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:32.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:32.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:32.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:32.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:32.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:32.999 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90141 bstore_ai root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.000 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.001 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.002 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.006 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.009 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.010 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 90640 bstore_ai root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.013 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.014 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.016 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.017 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.019 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.020 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.021 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.022 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.023 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91334 ceph-osd root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.025 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.026 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.028 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.029 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.030 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.031 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.032 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.033 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.034 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.035 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91335 cfin root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.037 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.038 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.039 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.041 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.042 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.044 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.045 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.047 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.048 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91336 bstore_kv root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.050 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.051 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.054 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.055 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.056 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.058 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.059 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.060 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91337 bstore_kv root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.062 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.063 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.064 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.065 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.066 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.067 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.068 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.095 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.096 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.097 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.098 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.099 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.100 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91338 bstore_me root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.101 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.102 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.103 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.106 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.107 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 14w REG 8,1 135558367 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.108 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.109 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.110 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.111 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.113 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91456 ms_dispat root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.114 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.115 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.116 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.117 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.118 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.119 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.120 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.121 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.126 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91457 ms_local root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.127 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.129 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.130 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.131 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.132 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.133 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.134 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.135 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.137 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.139 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91458 safe_time root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.141 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.142 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.143 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.144 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.145 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.146 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.147 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.148 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.149 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.150 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.151 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91459 safe_time root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.152 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.153 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.154 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.155 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.156 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.157 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.158 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.159 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.160 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.161 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.162 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.163 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.164 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91460 ms_dispat root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.168 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.169 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.170 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.171 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.172 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.174 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.175 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.176 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.177 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91461 ms_local root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.178 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.179 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.180 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.181 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.182 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.183 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.184 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.185 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.186 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.188 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.189 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91462 ms_dispat root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.190 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.191 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.193 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.195 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.196 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.197 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.198 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.200 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.201 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.202 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91463 ms_local root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.203 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.204 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.205 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.207 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.208 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.209 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.210 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.211 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.213 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.214 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.215 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91464 ms_dispat root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.216 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.217 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.218 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.221 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.222 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.225 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.226 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.227 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91465 ms_local root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.228 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.229 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.230 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.232 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.233 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.234 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.235 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.236 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.237 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.238 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.239 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.240 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91466 ms_dispat root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.242 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.243 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.244 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.245 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.246 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.247 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.248 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.251 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.252 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.253 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91467 ms_local root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.254 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.255 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.256 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.257 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.258 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.259 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.260 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.262 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.263 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.264 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.265 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.266 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91468 ms_dispat root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.268 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.269 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.270 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.273 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.274 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.275 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.277 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.278 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.279 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.280 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91469 ms_local root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.281 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.282 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.283 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.285 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.286 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.287 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.288 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.289 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.290 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.291 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.292 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91470 ms_dispat root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.293 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.294 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.296 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.297 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.298 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.299 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.301 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.302 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.303 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.304 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.305 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91471 ms_local root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.306 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.307 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.308 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.312 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.313 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.314 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.315 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.316 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.317 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.318 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91472 fn_anonym root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.320 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.322 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.323 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.324 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.328 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.329 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.330 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.331 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91473 finisher root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.332 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.333 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.334 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.335 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.336 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.337 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.339 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.340 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.341 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.342 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.343 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91474 safe_time root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.345 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.346 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.347 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.348 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.349 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.351 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.352 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.353 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.354 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.356 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91475 safe_time root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.358 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.359 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.360 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.361 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.362 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.363 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.364 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.366 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.368 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.369 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91476 ceph-osd root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.370 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.371 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.372 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.373 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.374 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.376 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.377 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.378 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.380 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.381 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91477 osd_srv_a root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.382 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.383 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.384 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.386 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.387 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.388 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.390 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.392 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.394 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91478 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.396 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.397 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.399 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.400 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.401 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 14w REG 8,1 135558650 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.402 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.404 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.405 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.407 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91479 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.409 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.410 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.411 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.413 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.414 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.417 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.418 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.419 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91480 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.422 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.423 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.424 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.425 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.427 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.428 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.429 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.430 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.431 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.432 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91481 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.434 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.435 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.436 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.439 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.440 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.441 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.442 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.443 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.444 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.445 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.446 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.447 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91482 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.448 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.450 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.451 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.452 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.453 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.454 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.456 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.458 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.459 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.460 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91483 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.461 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.462 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.463 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.464 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.465 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.466 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.468 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.469 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.471 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.473 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91484 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.474 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.475 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.477 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.478 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.479 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.480 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.481 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.482 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.483 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.484 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.485 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.486 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91485 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.487 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.488 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.492 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.493 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.494 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.495 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.496 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.497 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91486 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.499 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.500 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.503 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.504 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.506 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.508 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.509 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.510 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91487 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.511 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.512 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.513 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.514 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.515 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.516 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.517 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.519 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.520 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.522 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.523 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91488 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.525 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.526 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.527 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.528 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.529 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.530 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.531 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.532 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.533 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.536 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91489 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.540 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.541 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.542 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.543 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.544 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.547 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.548 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91490 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.549 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.550 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.551 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.552 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.553 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.554 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.555 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.556 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.557 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.558 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.559 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.560 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.561 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91491 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.562 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.564 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.565 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.566 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.567 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.568 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.571 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.572 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.573 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91492 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.574 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.578 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.579 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.580 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.582 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.583 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.584 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.585 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.586 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91493 tp_osd_tp root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root txt REG 8,1 25615776 1705 /usr/bin/ceph-osd 2023-11-04T01:44:33.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 74496 276160 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:33.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 116440 276187 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:33.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 128888 276139 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:33.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 91248 276175 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:33.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 83008 276157 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:33.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 49424 276163 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:33.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 1350912 276184 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:33.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 224600 276151 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:33.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 864280 276181 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:33.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 45176 276196 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:33.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 65968 276199 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:33.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 74936 276142 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:33.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 41168 276145 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:33.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 36976 276202 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:33.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 70536 276148 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:33.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:33.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 70424 276172 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:33.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 409304 276178 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:33.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 37064 276154 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:33.588 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 32512 276169 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:33.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 32664 276110 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:33.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root DEL REG 0,17 181159 /[aio] 2023-11-04T01:44:33.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root DEL REG 0,17 184365 /[aio] 2023-11-04T01:44:33.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 1469128 276129 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:33.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 353384 276125 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:33.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 74672 276135 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:33.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.589 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.590 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.591 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 1w FIFO 0,13 0t0 174067 pipe 2023-11-04T01:44:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 2w FIFO 0,13 0t0 174068 pipe 2023-11-04T01:44:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 3r FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 4w FIFO 0,13 0t0 176955 pipe 2023-11-04T01:44:33.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,21,22,23,24,25,26,60,68,71,73,76,79,82,85,88,91,94,97,100] 2023-11-04T01:44:33.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 6r FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 7w FIFO 0,13 0t0 176957 pipe 2023-11-04T01:44:33.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 8u a_inode 0,14 0 1081 [eventpoll:9,63,64,65,66,72,77,80,83,86,89,92,95,98] 2023-11-04T01:44:33.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 9r FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 10w FIFO 0,13 0t0 176958 pipe 2023-11-04T01:44:33.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 11u a_inode 0,14 0 1081 [eventpoll:12,67,69,70,74,75,78,81,84,87,90,93,96,99] 2023-11-04T01:44:33.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 12r FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 13w FIFO 0,13 0t0 176959 pipe 2023-11-04T01:44:33.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 14w REG 8,1 135558933 265307 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:33.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 15uW REG 0,24 6 1903 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:33.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 16r FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.593 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 17w FIFO 0,13 0t0 176970 pipe 2023-11-04T01:44:33.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 18u unix 0xffff982f41e16a40 0t0 176971 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 19u IPv4 175873 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:33.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 20u IPv4 175897 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:33.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 21u IPv4 175923 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:33.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 22u IPv4 175951 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:33.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 23u IPv4 177025 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:33.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 24u IPv4 177055 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:33.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 25u IPv4 177086 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:33.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 26u IPv4 177118 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:33.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 27r FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 28w FIFO 0,13 0t0 177933 pipe 2023-11-04T01:44:33.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 29r FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.594 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 30w FIFO 0,13 0t0 177934 pipe 2023-11-04T01:44:33.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 31u sock 0,8 0t0 182526 protocol: UDPv6 2023-11-04T01:44:33.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:33.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:33.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:33.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 58r FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 59w FIFO 0,13 0t0 182553 pipe 2023-11-04T01:44:33.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 60u IPv4 175972 0t0 TCP smithi044.front.sepia.ceph.com:47088->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 61r FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 62w FIFO 0,13 0t0 182554 pipe 2023-11-04T01:44:33.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 63u IPv4 183420 0t0 TCP smithi044.front.sepia.ceph.com:43846->smithi044.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 64u IPv4 183421 0t0 TCP smithi044.front.sepia.ceph.com:41218->smithi204.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:33.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 65u IPv4 183422 0t0 TCP smithi044.front.sepia.ceph.com:54686->smithi204.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 66u IPv4 183423 0t0 TCP smithi044.front.sepia.ceph.com:45472->smithi204.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:44:33.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 67u IPv4 183424 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55514 (ESTABLISHED) 2023-11-04T01:44:33.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 68u IPv4 183427 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47916 (ESTABLISHED) 2023-11-04T01:44:33.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 69u IPv4 179695 0t0 TCP smithi044.front.sepia.ceph.com:42582->smithi044.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:33.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 70u IPv4 179696 0t0 TCP smithi044.front.sepia.ceph.com:58012->smithi204.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 71u IPv4 183430 0t0 TCP smithi044.front.sepia.ceph.com:34068->smithi204.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:33.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 72u IPv4 184384 0t0 TCP smithi044.front.sepia.ceph.com:50520->smithi044.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:33.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 73u IPv4 183431 0t0 TCP smithi044.front.sepia.ceph.com:56782->smithi204.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:33.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 74u IPv4 179697 0t0 TCP smithi044.front.sepia.ceph.com:33508->smithi204.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:33.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 75u IPv4 179698 0t0 TCP smithi044.front.sepia.ceph.com:60378->smithi204.front.sepia.ceph.com:6823 (ESTABLISHED) 2023-11-04T01:44:33.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 76u IPv4 183432 0t0 TCP smithi044.front.sepia.ceph.com:39652->smithi044.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:33.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 77u IPv4 184385 0t0 TCP smithi044.front.sepia.ceph.com:58682->smithi044.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:33.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 78u IPv4 179699 0t0 TCP smithi044.front.sepia.ceph.com:60640->smithi044.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:33.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 79u IPv4 182561 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50566 (ESTABLISHED) 2023-11-04T01:44:33.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 80u IPv4 182564 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50572 (ESTABLISHED) 2023-11-04T01:44:33.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 81u IPv4 182567 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43488 (ESTABLISHED) 2023-11-04T01:44:33.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 82u IPv4 182570 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43498 (ESTABLISHED) 2023-11-04T01:44:33.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 83u IPv4 178009 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50584 (ESTABLISHED) 2023-11-04T01:44:33.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 84u IPv4 181779 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47918 (ESTABLISHED) 2023-11-04T01:44:33.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 85u IPv4 181782 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55522 (ESTABLISHED) 2023-11-04T01:44:33.598 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 86u IPv4 181791 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:44:33.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 87u IPv4 179722 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi044.front.sepia.ceph.com:47924 (ESTABLISHED) 2023-11-04T01:44:33.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 88u IPv4 179725 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi044.front.sepia.ceph.com:55532 (ESTABLISHED) 2023-11-04T01:44:33.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 89u IPv4 181211 0t0 TCP smithi044.front.sepia.ceph.com:6828->smithi204.front.sepia.ceph.com:50598 (ESTABLISHED) 2023-11-04T01:44:33.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 90u IPv4 181214 0t0 TCP smithi044.front.sepia.ceph.com:6830->smithi204.front.sepia.ceph.com:43510 (ESTABLISHED) 2023-11-04T01:44:33.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 91u IPv4 179727 0t0 TCP smithi044.front.sepia.ceph.com:46710->smithi044.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2023-11-04T01:44:33.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 92u IPv4 182587 0t0 TCP smithi044.front.sepia.ceph.com:49482->smithi204.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 93u IPv4 178017 0t0 TCP smithi044.front.sepia.ceph.com:41184->smithi044.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:33.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 94u IPv4 184421 0t0 TCP smithi044.front.sepia.ceph.com:33284->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 95u IPv4 178018 0t0 TCP smithi044.front.sepia.ceph.com:59150->smithi044.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 96u IPv4 184471 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:45660 (ESTABLISHED) 2023-11-04T01:44:33.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 97u IPv4 181824 0t0 TCP smithi044.front.sepia.ceph.com:39994->smithi204.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:33.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 98u IPv4 179819 0t0 TCP smithi044.front.sepia.ceph.com:45520->smithi204.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:44:33.599 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 99u IPv4 181828 0t0 TCP smithi044.front.sepia.ceph.com:6825->smithi204.front.sepia.ceph.com:40374 (ESTABLISHED) 2023-11-04T01:44:33.600 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-osd 88158 91494 osd_srv_h root 100u IPv4 254426 0t0 TCP smithi044.front.sepia.ceph.com:6821->smithi204.front.sepia.ceph.com:49628 (ESTABLISHED) 2023-11-04T01:44:33.600 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/0 91547 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.600 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/0 91547 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.600 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/0 91547 root txt unknown /proc/91547/exe 2023-11-04T01:44:33.600 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 91841 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.600 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 91841 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.600 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 91841 root txt unknown /proc/91841/exe 2023-11-04T01:44:33.600 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 91858 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.600 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 91858 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.600 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 91858 root txt unknown /proc/91858/exe 2023-11-04T01:44:33.600 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/5 91960 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.600 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/5 91960 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.600 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/5 91960 root txt unknown /proc/91960/exe 2023-11-04T01:44:33.600 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/2 92297 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.600 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/2 92297 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.601 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/2 92297 root txt unknown /proc/92297/exe 2023-11-04T01:44:33.601 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/7 92402 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.601 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/7 92402 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.601 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/7 92402 root txt unknown /proc/92402/exe 2023-11-04T01:44:33.601 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/7 92407 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.601 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/7 92407 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.601 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/7 92407 root txt unknown /proc/92407/exe 2023-11-04T01:44:33.601 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/7 92408 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.601 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/7 92408 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.601 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/7 92408 root txt unknown /proc/92408/exe 2023-11-04T01:44:33.601 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 92506 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.601 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 92506 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.601 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 92506 root txt unknown /proc/92506/exe 2023-11-04T01:44:33.602 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/2 92875 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.602 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/2 92875 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.602 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/2 92875 root txt unknown /proc/92875/exe 2023-11-04T01:44:33.602 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/0 92886 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.602 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/0 92886 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.602 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/0 92886 root txt unknown /proc/92886/exe 2023-11-04T01:44:33.602 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/4 93120 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.602 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/4 93120 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.602 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/4 93120 root txt unknown /proc/93120/exe 2023-11-04T01:44:33.602 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/4 93132 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.602 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/4 93132 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.602 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/4 93132 root txt unknown /proc/93132/exe 2023-11-04T01:44:33.602 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 119637 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.603 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 119637 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.603 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/u 119637 root txt unknown /proc/119637/exe 2023-11-04T01:44:33.603 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 121743 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.603 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 121743 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.603 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 121743 root txt unknown /proc/121743/exe 2023-11-04T01:44:33.603 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 126148 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.603 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 126148 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.603 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/6 126148 root txt unknown /proc/126148/exe 2023-11-04T01:44:33.603 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.603 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.603 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:33.603 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:33.603 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:33.603 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.604 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:33.604 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.604 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:33.604 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:33.604 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:33.604 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:33.604 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:33.604 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:33.604 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:33.604 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:33.604 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:33.604 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:33.604 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.604 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.605 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.605 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.605 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.605 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.605 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.605 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.605 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.605 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.605 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.605 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.605 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.605 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.605 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:33.606 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:33.606 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:33.606 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.606 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:33.606 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.606 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.606 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.606 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:33.606 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:33.606 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:33.606 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:33.606 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:33.606 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:33.606 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:33.607 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:33.607 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:33.607 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:33.607 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:33.607 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:33.607 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:33.607 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:33.607 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.607 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:33.607 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:33.607 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.607 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:33.607 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root 0r FIFO 0,13 0t0 254513 pipe 2023-11-04T01:44:33.608 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.608 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.608 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root 3r FIFO 0,13 0t0 253637 pipe 2023-11-04T01:44:33.608 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root 4w FIFO 0,13 0t0 253637 pipe 2023-11-04T01:44:33.608 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root 5u netlink 0t0 253642 AUDIT 2023-11-04T01:44:33.608 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 126491 root 6u unix 0xffff982f48f80000 0t0 253643 type=DGRAM (CONNECTED) 2023-11-04T01:44:33.608 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.608 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.608 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:33.608 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:33.608 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:33.608 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.608 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.608 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.610 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root 0r FIFO 0,13 0t0 254513 pipe 2023-11-04T01:44:33.610 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.610 INFO:teuthology.orchestra.run.smithi044.stdout:daemon-he 126526 root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.610 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.612 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.614 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.615 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.616 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.617 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.618 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.619 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126532 log root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.621 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.622 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.623 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126534 msgr-work root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.627 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.628 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.629 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.630 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.631 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.632 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126535 msgr-work root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.634 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.635 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.637 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.638 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126536 msgr-work root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.639 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.640 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.641 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.642 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.643 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126540 service root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.644 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.645 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.646 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.649 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.650 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126541 admin_soc root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.652 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.653 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.654 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126542 signal_ha root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.658 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.659 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.660 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.661 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.662 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.663 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126543 io_contex root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.664 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.665 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.667 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.668 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.669 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126544 io_contex root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.670 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.671 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.672 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.673 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.674 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.675 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126545 ms_dispat root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.676 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.677 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.681 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126546 ms_local root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.682 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.683 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.684 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.685 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.686 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.687 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126547 safe_time root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.689 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.690 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.691 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.692 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126548 safe_time root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.694 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.695 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.696 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.697 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.698 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.699 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126549 ceph-mds root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:44:33.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.700 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.701 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.702 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:33.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:33.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:33.703 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:33.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 1w FIFO 0,13 0t0 254514 pipe 2023-11-04T01:44:33.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 2w FIFO 0,13 0t0 254515 pipe 2023-11-04T01:44:33.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 3r FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 4w FIFO 0,13 0t0 258067 pipe 2023-11-04T01:44:33.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 5u a_inode 0,14 0 1081 [eventpoll:6,19,20,27] 2023-11-04T01:44:33.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 6r FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 7w FIFO 0,13 0t0 258069 pipe 2023-11-04T01:44:33.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 8u a_inode 0,14 0 1081 [eventpoll:9,30] 2023-11-04T01:44:33.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 9r FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 10w FIFO 0,13 0t0 258070 pipe 2023-11-04T01:44:33.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 11u a_inode 0,14 0 1081 [eventpoll:12] 2023-11-04T01:44:33.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 12r FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.704 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 13w FIFO 0,13 0t0 258071 pipe 2023-11-04T01:44:33.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 14w REG 8,1 6091119 265316 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:33.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 15uW REG 0,24 7 2590 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:33.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 16r FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 17w FIFO 0,13 0t0 256208 pipe 2023-11-04T01:44:33.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 18u unix 0xffff982f44149dc0 0t0 256209 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:33.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 19u IPv4 257325 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:33.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 20u IPv4 257361 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:33.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 21r FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 22w FIFO 0,13 0t0 256211 pipe 2023-11-04T01:44:33.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 23r FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 24w FIFO 0,13 0t0 256212 pipe 2023-11-04T01:44:33.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 25r FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.705 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 26w FIFO 0,13 0t0 255446 pipe 2023-11-04T01:44:33.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 27u IPv4 257362 0t0 TCP smithi044.front.sepia.ceph.com:37506->smithi044.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:33.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 28r FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 29w FIFO 0,13 0t0 255447 pipe 2023-11-04T01:44:33.706 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-mds 126531 126572 safe_time root 30u IPv4 255453 0t0 TCP smithi044.front.sepia.ceph.com:38776->smithi204.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:33.706 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.706 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.706 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-11-04T01:44:33.706 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:33.706 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.706 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:33.706 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:33.706 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:33.707 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:33.707 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:33.707 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:33.707 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:33.707 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:33.707 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:33.707 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:33.707 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-11-04T01:44:33.707 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:33.707 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.707 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:33.707 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu 0r FIFO 0,13 0t0 256342 pipe 2023-11-04T01:44:33.707 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127468 ubuntu 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:33.708 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:33.709 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:33.709 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:33.709 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:33.709 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:33.709 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:33.709 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:33.709 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.709 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.709 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.709 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.709 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.709 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.709 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.709 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.710 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.710 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.710 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.710 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.710 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:33.710 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.710 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.710 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:33.710 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:33.710 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:33.710 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.710 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.710 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.711 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.711 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:33.711 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:33.711 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:33.711 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:33.711 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:33.711 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:33.711 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:33.711 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:33.711 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:33.711 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:33.711 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:33.711 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:33.712 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:33.712 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.712 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:33.712 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:33.712 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.712 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:33.712 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root 0r FIFO 0,13 0t0 256342 pipe 2023-11-04T01:44:33.712 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.712 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.712 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root 3r FIFO 0,13 0t0 255765 pipe 2023-11-04T01:44:33.712 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root 4w FIFO 0,13 0t0 255765 pipe 2023-11-04T01:44:33.712 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root 5u netlink 0t0 255771 AUDIT 2023-11-04T01:44:33.712 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127498 root 6u unix 0xffff982f48edf2c0 0t0 255772 type=DGRAM (CONNECTED) 2023-11-04T01:44:33.713 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.713 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.713 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:33.713 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:33.713 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:33.713 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.713 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:33.713 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.713 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:33.713 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:33.713 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.713 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.713 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:33.713 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:33.714 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:33.714 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:33.714 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:33.714 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:33.714 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:33.714 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:33.714 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:33.714 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.714 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.714 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.714 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.714 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.714 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.715 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.715 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.715 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.715 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.715 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.715 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:33.715 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.715 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.715 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.715 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:33.715 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:33.715 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:33.715 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:33.716 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:33.716 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:33.716 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:33.716 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:33.716 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:33.716 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:33.716 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:33.716 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:33.716 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.716 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.716 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:33.716 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:33.716 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:33.717 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:33.717 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.717 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:33.717 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:33.717 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.717 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:33.717 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root 0r FIFO 0,13 0t0 256342 pipe 2023-11-04T01:44:33.717 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.717 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.717 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root 3r FIFO 0,13 0t0 251860 pipe 2023-11-04T01:44:33.717 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root 4w FIFO 0,13 0t0 251860 pipe 2023-11-04T01:44:33.717 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root 5u sock 0,8 0t0 251866 protocol: NETLINK 2023-11-04T01:44:33.717 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 127504 root 6u sock 0,8 0t0 251867 protocol: UNIX 2023-11-04T01:44:33.717 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.718 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.718 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:33.718 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:33.718 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.718 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:33.718 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.718 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.718 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.718 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.718 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.718 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.718 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:33.718 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.719 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.719 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.719 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.719 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.719 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.719 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:33.719 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:33.719 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.719 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root 0r FIFO 0,13 0t0 256342 pipe 2023-11-04T01:44:33.719 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.719 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.719 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root 3r FIFO 0,13 0t0 257570 pipe 2023-11-04T01:44:33.720 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 127506 root 4w FIFO 0,13 0t0 257570 pipe 2023-11-04T01:44:33.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.720 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.721 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.722 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.723 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.724 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.725 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.726 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.727 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.728 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.730 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127525 log root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.731 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.732 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.733 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.734 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.735 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127527 msgr-work root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.736 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.737 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.738 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.739 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.740 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.741 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127528 msgr-work root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.742 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.743 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.744 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.745 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.746 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.747 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127529 msgr-work root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.748 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.749 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.750 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.751 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.752 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127533 service root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.756 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.757 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.758 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127534 admin_soc root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.759 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.760 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.761 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.762 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.763 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127535 signal_ha root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.764 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.765 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.767 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.768 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.769 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127536 io_contex root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.770 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.771 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.772 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.774 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.775 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127537 io_contex root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.777 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.778 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.779 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.780 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.781 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127538 ceph_time root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.782 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.783 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.784 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.785 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.786 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127539 fn_anonym root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.787 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.788 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.789 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.790 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.792 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127540 fn_anonym root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.793 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.794 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.795 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.796 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.797 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.798 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127541 fn_anonym root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.799 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.800 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.801 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.802 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.803 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127542 fn_anonym root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.804 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.805 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.808 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.809 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127543 fn_anonym root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.810 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.811 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.812 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.813 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.814 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127544 safe_time root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.816 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.817 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.818 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.819 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.820 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127545 fn_anonym root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.821 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.822 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.823 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.824 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.825 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127546 flusher root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.827 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.828 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.829 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.830 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.831 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127547 ms_dispat root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.832 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.833 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.834 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.835 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.836 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127548 ms_local root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.838 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.839 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.840 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.841 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.842 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127549 safe_time root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.844 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.845 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.846 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.847 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.848 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.849 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127550 ceph-fuse root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.850 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.851 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.852 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.853 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.854 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.855 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127552 ceph-fuse root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.856 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.857 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.858 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.859 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.860 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127554 ceph-fuse root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root cwd DIR 8,1 4096 265531 /home/ubuntu/cephtest 2023-11-04T01:44:33.861 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:44:33.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:33.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:33.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:33.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:33.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:33.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:33.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:33.862 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:33.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:33.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:33.863 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:33.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:33.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:33.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:33.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:33.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:33.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:33.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:33.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:33.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:33.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 9894040 265475 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:33.864 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 0r FIFO 0,13 0t0 257571 pipe 2023-11-04T01:44:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 1w FIFO 0,13 0t0 256343 pipe 2023-11-04T01:44:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 2w FIFO 0,13 0t0 256344 pipe 2023-11-04T01:44:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 3w REG 8,1 304077 267517 /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:44:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 4u a_inode 0,14 0 1081 [eventpoll:5,22] 2023-11-04T01:44:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 5r FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 6w FIFO 0,13 0t0 256370 pipe 2023-11-04T01:44:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 7u a_inode 0,14 0 1081 [eventpoll:8] 2023-11-04T01:44:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 8r FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 9w FIFO 0,13 0t0 256371 pipe 2023-11-04T01:44:33.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 10u a_inode 0,14 0 1081 [eventpoll:11,21] 2023-11-04T01:44:33.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 11r FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 12w FIFO 0,13 0t0 256372 pipe 2023-11-04T01:44:33.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 13r FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 14w FIFO 0,13 0t0 257573 pipe 2023-11-04T01:44:33.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 15u sock 0,8 0t0 257574 protocol: UNIX-STREAM 2023-11-04T01:44:33.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 16r FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 17w FIFO 0,13 0t0 257575 pipe 2023-11-04T01:44:33.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 18r FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 19w FIFO 0,13 0t0 257576 pipe 2023-11-04T01:44:33.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 21u sock 0,8 0t0 251880 protocol: TCP 2023-11-04T01:44:33.866 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 22u sock 0,8 0t0 254814 protocol: TCP 2023-11-04T01:44:33.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:33.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 24r FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 25w FIFO 0,13 0t0 256379 pipe 2023-11-04T01:44:33.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 26r FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 27w FIFO 0,13 0t0 258428 pipe 2023-11-04T01:44:33.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 28r FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.867 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-fuse 127524 127749 ceph-fuse root 29w FIFO 0,13 0t0 254900 pipe 2023-11-04T01:44:33.867 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.867 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.867 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-11-04T01:44:33.867 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:33.867 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.867 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:33.867 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:33.868 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:33.868 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:33.868 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:33.868 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:33.868 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:33.870 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:33.870 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:33.870 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:33.870 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:33.870 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-11-04T01:44:33.870 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:33.870 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.870 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:33.870 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu 0r FIFO 0,13 0t0 262145 pipe 2023-11-04T01:44:33.870 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu 1w FIFO 0,13 0t0 262146 pipe 2023-11-04T01:44:33.870 INFO:teuthology.orchestra.run.smithi044.stdout:bash 127914 ubuntu 2w FIFO 0,13 0t0 262147 pipe 2023-11-04T01:44:33.871 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu cwd DIR 0,41 0 1 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:33.871 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.871 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu txt REG 8,1 69752 10054 /usr/bin/mkdir 2023-11-04T01:44:33.871 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:33.871 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.871 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:33.871 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:33.871 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:33.871 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:33.871 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:33.871 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:33.871 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:33.871 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:33.871 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:33.871 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:33.872 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.872 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.872 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:33.872 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.872 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:33.872 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu 0r FIFO 0,13 0t0 262145 pipe 2023-11-04T01:44:33.872 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu 1w FIFO 0,13 0t0 262146 pipe 2023-11-04T01:44:33.872 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir 127930 ubuntu 2w FIFO 0,13 0t0 262147 pipe 2023-11-04T01:44:33.872 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/3 128238 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.872 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/3 128238 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.872 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/3 128238 root txt unknown /proc/128238/exe 2023-11-04T01:44:33.872 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/2 128239 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:33.872 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/2 128239 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.872 INFO:teuthology.orchestra.run.smithi044.stdout:kworker/2 128239 root txt unknown /proc/128239/exe 2023-11-04T01:44:33.873 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.873 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.873 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-11-04T01:44:33.873 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:33.873 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.873 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:33.873 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:33.873 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:33.873 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:33.873 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:33.873 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:33.873 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:33.873 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:33.874 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:33.874 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:33.874 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-11-04T01:44:33.874 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:33.874 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.874 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:33.874 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu 0r FIFO 0,13 0t0 260523 pipe 2023-11-04T01:44:33.874 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu 1w FIFO 0,13 0t0 260524 pipe 2023-11-04T01:44:33.874 INFO:teuthology.orchestra.run.smithi044.stdout:bash 128963 ubuntu 2w FIFO 0,13 0t0 260525 pipe 2023-11-04T01:44:33.874 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.874 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.874 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:33.875 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:33.875 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:33.875 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:33.875 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:33.875 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:33.875 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:33.875 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:33.875 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:33.875 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:33.875 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:33.875 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:33.875 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.875 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.875 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:33.876 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:33.876 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:33.876 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.876 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.876 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.876 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:33.876 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:33.876 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:33.876 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:33.876 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:33.876 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:33.876 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.876 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:33.876 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.877 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:33.877 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.877 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.877 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.877 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:33.877 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.877 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:33.877 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:33.877 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:33.877 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:33.877 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:33.877 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:33.877 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:33.877 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:33.878 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:33.878 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:33.878 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:33.878 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:33.878 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:33.878 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:33.878 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.878 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:33.878 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:33.878 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.878 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:33.878 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:33.878 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.879 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:33.879 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root 0r FIFO 0,13 0t0 260523 pipe 2023-11-04T01:44:33.879 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root 1w FIFO 0,13 0t0 260524 pipe 2023-11-04T01:44:33.879 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root 2w FIFO 0,13 0t0 260525 pipe 2023-11-04T01:44:33.879 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root 3r FIFO 0,13 0t0 258046 pipe 2023-11-04T01:44:33.879 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root 4w FIFO 0,13 0t0 258046 pipe 2023-11-04T01:44:33.879 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root 5u netlink 0t0 264196 AUDIT 2023-11-04T01:44:33.879 INFO:teuthology.orchestra.run.smithi044.stdout:sudo 128979 root 6u unix 0xffff982f48d2b300 0t0 264197 type=DGRAM (CONNECTED) 2023-11-04T01:44:33.879 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.879 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.879 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:33.879 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:33.879 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.880 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:33.880 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.880 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.880 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.880 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.880 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.880 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.880 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.880 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.880 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.880 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.880 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:33.880 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:33.881 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:33.881 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:33.881 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:33.881 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.881 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root 0r FIFO 0,13 0t0 260523 pipe 2023-11-04T01:44:33.881 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root 1w FIFO 0,13 0t0 260524 pipe 2023-11-04T01:44:33.881 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root 2w FIFO 0,13 0t0 260525 pipe 2023-11-04T01:44:33.881 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root 3r FIFO 0,13 0t0 258774 pipe 2023-11-04T01:44:33.881 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root 4w FIFO 0,13 0t0 258774 pipe 2023-11-04T01:44:33.881 INFO:teuthology.orchestra.run.smithi044.stdout:stdin-kil 128981 root 6w FIFO 0,13 0t0 258775 pipe 2023-11-04T01:44:33.881 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.881 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.881 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-11-04T01:44:33.881 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.882 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:33.882 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.882 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.882 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.882 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.882 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.882 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.882 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.882 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.882 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.882 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.882 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-04T01:44:33.882 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.883 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:33.883 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.883 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root 0r FIFO 0,13 0t0 258775 pipe 2023-11-04T01:44:33.883 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root 1w FIFO 0,13 0t0 260524 pipe 2023-11-04T01:44:33.883 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root 2w FIFO 0,13 0t0 260525 pipe 2023-11-04T01:44:33.883 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root 3r DIR 0,20 0 1 /proc 2023-11-04T01:44:33.883 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root 4r DIR 0,20 0 263457 /proc/128982/fd 2023-11-04T01:44:33.883 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root 5w FIFO 0,13 0t0 263469 pipe 2023-11-04T01:44:33.883 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128982 root 6r FIFO 0,13 0t0 263470 pipe 2023-11-04T01:44:33.883 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:33.883 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:33.883 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-11-04T01:44:33.883 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:33.884 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:33.884 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:33.884 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:33.884 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:33.884 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:33.884 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:33.884 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:33.884 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:33.884 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:33.884 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:33.884 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:33.884 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-04T01:44:33.884 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:33.885 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:33.885 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:33.885 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root 4r FIFO 0,13 0t0 263469 pipe 2023-11-04T01:44:33.885 INFO:teuthology.orchestra.run.smithi044.stdout:lsof 128983 root 7w FIFO 0,13 0t0 263470 pipe 2023-11-04T01:44:33.885 INFO:teuthology.orchestra.run.smithi044.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-11-04T01:44:33.885 INFO:teuthology.orchestra.run.smithi044.stdout:root 2 0.0 0.0 0 0 ? S 01:24 0:00 [kthreadd] 2023-11-04T01:44:33.885 INFO:teuthology.orchestra.run.smithi044.stdout:root 3 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [rcu_gp] 2023-11-04T01:44:33.885 INFO:teuthology.orchestra.run.smithi044.stdout:root 4 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [rcu_par_gp] 2023-11-04T01:44:33.885 INFO:teuthology.orchestra.run.smithi044.stdout:root 5 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [slub_flushwq] 2023-11-04T01:44:33.885 INFO:teuthology.orchestra.run.smithi044.stdout:root 6 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [netns] 2023-11-04T01:44:33.885 INFO:teuthology.orchestra.run.smithi044.stdout:root 8 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/0:0H-events_highpri] 2023-11-04T01:44:33.885 INFO:teuthology.orchestra.run.smithi044.stdout:root 11 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [mm_percpu_wq] 2023-11-04T01:44:33.885 INFO:teuthology.orchestra.run.smithi044.stdout:root 13 0.0 0.0 0 0 ? I 01:24 0:00 \_ [rcu_tasks_kthre] 2023-11-04T01:44:33.885 INFO:teuthology.orchestra.run.smithi044.stdout:root 14 0.0 0.0 0 0 ? I 01:24 0:00 \_ [rcu_tasks_rude_] 2023-11-04T01:44:33.886 INFO:teuthology.orchestra.run.smithi044.stdout:root 15 0.0 0.0 0 0 ? I 01:24 0:00 \_ [rcu_tasks_trace] 2023-11-04T01:44:33.886 INFO:teuthology.orchestra.run.smithi044.stdout:root 16 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/0] 2023-11-04T01:44:33.886 INFO:teuthology.orchestra.run.smithi044.stdout:root 17 0.4 0.0 0 0 ? S 01:24 0:05 \_ [pr/ttyS1] 2023-11-04T01:44:33.886 INFO:teuthology.orchestra.run.smithi044.stdout:root 18 0.0 0.0 0 0 ? I 01:24 0:00 \_ [rcu_preempt] 2023-11-04T01:44:33.886 INFO:teuthology.orchestra.run.smithi044.stdout:root 19 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/0] 2023-11-04T01:44:33.886 INFO:teuthology.orchestra.run.smithi044.stdout:root 20 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/0] 2023-11-04T01:44:33.886 INFO:teuthology.orchestra.run.smithi044.stdout:root 21 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/0] 2023-11-04T01:44:33.886 INFO:teuthology.orchestra.run.smithi044.stdout:root 22 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/1] 2023-11-04T01:44:33.886 INFO:teuthology.orchestra.run.smithi044.stdout:root 23 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/1] 2023-11-04T01:44:33.886 INFO:teuthology.orchestra.run.smithi044.stdout:root 24 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/1] 2023-11-04T01:44:33.886 INFO:teuthology.orchestra.run.smithi044.stdout:root 25 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/1] 2023-11-04T01:44:33.886 INFO:teuthology.orchestra.run.smithi044.stdout:root 27 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/1:0H-events_highpri] 2023-11-04T01:44:33.886 INFO:teuthology.orchestra.run.smithi044.stdout:root 28 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/2] 2023-11-04T01:44:33.887 INFO:teuthology.orchestra.run.smithi044.stdout:root 29 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/2] 2023-11-04T01:44:33.887 INFO:teuthology.orchestra.run.smithi044.stdout:root 30 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/2] 2023-11-04T01:44:33.887 INFO:teuthology.orchestra.run.smithi044.stdout:root 31 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/2] 2023-11-04T01:44:33.887 INFO:teuthology.orchestra.run.smithi044.stdout:root 33 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/2:0H-events_highpri] 2023-11-04T01:44:33.887 INFO:teuthology.orchestra.run.smithi044.stdout:root 34 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/3] 2023-11-04T01:44:33.887 INFO:teuthology.orchestra.run.smithi044.stdout:root 35 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/3] 2023-11-04T01:44:33.887 INFO:teuthology.orchestra.run.smithi044.stdout:root 36 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/3] 2023-11-04T01:44:33.887 INFO:teuthology.orchestra.run.smithi044.stdout:root 37 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/3] 2023-11-04T01:44:33.887 INFO:teuthology.orchestra.run.smithi044.stdout:root 39 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/3:0H-events_highpri] 2023-11-04T01:44:33.887 INFO:teuthology.orchestra.run.smithi044.stdout:root 40 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/4] 2023-11-04T01:44:33.887 INFO:teuthology.orchestra.run.smithi044.stdout:root 41 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/4] 2023-11-04T01:44:33.887 INFO:teuthology.orchestra.run.smithi044.stdout:root 42 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/4] 2023-11-04T01:44:33.887 INFO:teuthology.orchestra.run.smithi044.stdout:root 43 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/4] 2023-11-04T01:44:33.887 INFO:teuthology.orchestra.run.smithi044.stdout:root 45 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/4:0H-events_highpri] 2023-11-04T01:44:33.887 INFO:teuthology.orchestra.run.smithi044.stdout:root 46 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/5] 2023-11-04T01:44:33.888 INFO:teuthology.orchestra.run.smithi044.stdout:root 47 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/5] 2023-11-04T01:44:33.888 INFO:teuthology.orchestra.run.smithi044.stdout:root 48 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/5] 2023-11-04T01:44:33.888 INFO:teuthology.orchestra.run.smithi044.stdout:root 49 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/5] 2023-11-04T01:44:33.888 INFO:teuthology.orchestra.run.smithi044.stdout:root 51 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/5:0H-events_highpri] 2023-11-04T01:44:33.888 INFO:teuthology.orchestra.run.smithi044.stdout:root 52 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/6] 2023-11-04T01:44:33.888 INFO:teuthology.orchestra.run.smithi044.stdout:root 53 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/6] 2023-11-04T01:44:33.888 INFO:teuthology.orchestra.run.smithi044.stdout:root 54 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/6] 2023-11-04T01:44:33.888 INFO:teuthology.orchestra.run.smithi044.stdout:root 55 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/6] 2023-11-04T01:44:33.888 INFO:teuthology.orchestra.run.smithi044.stdout:root 57 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/6:0H-events_highpri] 2023-11-04T01:44:33.888 INFO:teuthology.orchestra.run.smithi044.stdout:root 58 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/7] 2023-11-04T01:44:33.888 INFO:teuthology.orchestra.run.smithi044.stdout:root 59 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/7] 2023-11-04T01:44:33.888 INFO:teuthology.orchestra.run.smithi044.stdout:root 60 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/7] 2023-11-04T01:44:33.888 INFO:teuthology.orchestra.run.smithi044.stdout:root 61 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/7] 2023-11-04T01:44:33.888 INFO:teuthology.orchestra.run.smithi044.stdout:root 63 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/7:0H-events_highpri] 2023-11-04T01:44:33.889 INFO:teuthology.orchestra.run.smithi044.stdout:root 69 0.0 0.0 0 0 ? I 01:24 0:00 \_ [kworker/u16:6-events_unbound] 2023-11-04T01:44:33.889 INFO:teuthology.orchestra.run.smithi044.stdout:root 70 0.0 0.0 0 0 ? I 01:24 0:00 \_ [kworker/u16:7-events_unbound] 2023-11-04T01:44:33.889 INFO:teuthology.orchestra.run.smithi044.stdout:root 71 0.0 0.0 0 0 ? S 01:24 0:00 \_ [kdevtmpfs] 2023-11-04T01:44:33.889 INFO:teuthology.orchestra.run.smithi044.stdout:root 72 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [inet_frag_wq] 2023-11-04T01:44:33.889 INFO:teuthology.orchestra.run.smithi044.stdout:root 73 0.0 0.0 0 0 ? S 01:24 0:00 \_ [kauditd] 2023-11-04T01:44:33.889 INFO:teuthology.orchestra.run.smithi044.stdout:root 75 0.0 0.0 0 0 ? S 01:24 0:00 \_ [khungtaskd] 2023-11-04T01:44:33.889 INFO:teuthology.orchestra.run.smithi044.stdout:root 76 0.0 0.0 0 0 ? S 01:24 0:00 \_ [oom_reaper] 2023-11-04T01:44:33.889 INFO:teuthology.orchestra.run.smithi044.stdout:root 77 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [writeback] 2023-11-04T01:44:33.889 INFO:teuthology.orchestra.run.smithi044.stdout:root 78 0.0 0.0 0 0 ? S 01:24 0:00 \_ [kcompactd0] 2023-11-04T01:44:33.889 INFO:teuthology.orchestra.run.smithi044.stdout:root 79 0.0 0.0 0 0 ? SN 01:24 0:00 \_ [ksmd] 2023-11-04T01:44:33.889 INFO:teuthology.orchestra.run.smithi044.stdout:root 81 0.0 0.0 0 0 ? SN 01:24 0:00 \_ [khugepaged] 2023-11-04T01:44:33.889 INFO:teuthology.orchestra.run.smithi044.stdout:root 82 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [cryptd] 2023-11-04T01:44:33.889 INFO:teuthology.orchestra.run.smithi044.stdout:root 83 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kintegrityd] 2023-11-04T01:44:33.890 INFO:teuthology.orchestra.run.smithi044.stdout:root 84 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kblockd] 2023-11-04T01:44:33.890 INFO:teuthology.orchestra.run.smithi044.stdout:root 85 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [blkcg_punt_bio] 2023-11-04T01:44:33.890 INFO:teuthology.orchestra.run.smithi044.stdout:root 86 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [tpm_dev_wq] 2023-11-04T01:44:33.890 INFO:teuthology.orchestra.run.smithi044.stdout:root 87 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [md] 2023-11-04T01:44:33.890 INFO:teuthology.orchestra.run.smithi044.stdout:root 88 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [md_bitmap] 2023-11-04T01:44:33.890 INFO:teuthology.orchestra.run.smithi044.stdout:root 89 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [edac-poller] 2023-11-04T01:44:33.890 INFO:teuthology.orchestra.run.smithi044.stdout:root 90 0.0 0.0 0 0 ? S 01:24 0:00 \_ [watchdogd] 2023-11-04T01:44:33.890 INFO:teuthology.orchestra.run.smithi044.stdout:root 93 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/1:1H-xfs-log/dm-4] 2023-11-04T01:44:33.890 INFO:teuthology.orchestra.run.smithi044.stdout:root 95 0.0 0.0 0 0 ? S 01:24 0:00 \_ [kswapd0] 2023-11-04T01:44:33.890 INFO:teuthology.orchestra.run.smithi044.stdout:root 100 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kthrotld] 2023-11-04T01:44:33.890 INFO:teuthology.orchestra.run.smithi044.stdout:root 101 0.0 0.0 0 0 ? I 01:24 0:00 \_ [kworker/5:2-rcu_gp] 2023-11-04T01:44:33.890 INFO:teuthology.orchestra.run.smithi044.stdout:root 109 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [acpi_thermal_pm] 2023-11-04T01:44:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:root 110 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kmpath_rdacd] 2023-11-04T01:44:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:root 111 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kaluad] 2023-11-04T01:44:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:root 113 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [mld] 2023-11-04T01:44:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:root 114 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/5:1H-kblockd] 2023-11-04T01:44:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:root 115 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ipv6_addrconf] 2023-11-04T01:44:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:root 124 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kstrp] 2023-11-04T01:44:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:root 130 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [zswap-shrink] 2023-11-04T01:44:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:root 237 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/u17:0] 2023-11-04T01:44:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:root 276 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/0:1H-xfs-log/dm-0] 2023-11-04T01:44:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:root 288 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/4:1H-kblockd] 2023-11-04T01:44:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:root 292 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/2:1H-xfs-log/dm-4] 2023-11-04T01:44:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:root 324 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/7:1H-kblockd] 2023-11-04T01:44:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:root 356 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/3:1H-kblockd] 2023-11-04T01:44:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:root 408 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/6:1H-kblockd] 2023-11-04T01:44:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:root 427 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [nvme-wq] 2023-11-04T01:44:33.892 INFO:teuthology.orchestra.run.smithi044.stdout:root 430 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [nvme-reset-wq] 2023-11-04T01:44:33.892 INFO:teuthology.orchestra.run.smithi044.stdout:root 431 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [nvme-delete-wq] 2023-11-04T01:44:33.892 INFO:teuthology.orchestra.run.smithi044.stdout:root 432 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [nvme-auth-wq] 2023-11-04T01:44:33.892 INFO:teuthology.orchestra.run.smithi044.stdout:root 438 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ata_sff] 2023-11-04T01:44:33.892 INFO:teuthology.orchestra.run.smithi044.stdout:root 448 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ixgbe] 2023-11-04T01:44:33.892 INFO:teuthology.orchestra.run.smithi044.stdout:root 449 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_0] 2023-11-04T01:44:33.892 INFO:teuthology.orchestra.run.smithi044.stdout:root 450 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_0] 2023-11-04T01:44:33.892 INFO:teuthology.orchestra.run.smithi044.stdout:root 451 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_1] 2023-11-04T01:44:33.892 INFO:teuthology.orchestra.run.smithi044.stdout:root 452 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_1] 2023-11-04T01:44:33.892 INFO:teuthology.orchestra.run.smithi044.stdout:root 453 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_2] 2023-11-04T01:44:33.892 INFO:teuthology.orchestra.run.smithi044.stdout:root 454 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_2] 2023-11-04T01:44:33.892 INFO:teuthology.orchestra.run.smithi044.stdout:root 455 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_3] 2023-11-04T01:44:33.892 INFO:teuthology.orchestra.run.smithi044.stdout:root 456 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_3] 2023-11-04T01:44:33.892 INFO:teuthology.orchestra.run.smithi044.stdout:root 457 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_4] 2023-11-04T01:44:33.892 INFO:teuthology.orchestra.run.smithi044.stdout:root 458 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_4] 2023-11-04T01:44:33.893 INFO:teuthology.orchestra.run.smithi044.stdout:root 459 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_5] 2023-11-04T01:44:33.893 INFO:teuthology.orchestra.run.smithi044.stdout:root 460 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_5] 2023-11-04T01:44:33.893 INFO:teuthology.orchestra.run.smithi044.stdout:root 461 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_6] 2023-11-04T01:44:33.893 INFO:teuthology.orchestra.run.smithi044.stdout:root 462 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_6] 2023-11-04T01:44:33.893 INFO:teuthology.orchestra.run.smithi044.stdout:root 463 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_7] 2023-11-04T01:44:33.893 INFO:teuthology.orchestra.run.smithi044.stdout:root 464 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_7] 2023-11-04T01:44:33.893 INFO:teuthology.orchestra.run.smithi044.stdout:root 465 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_8] 2023-11-04T01:44:33.893 INFO:teuthology.orchestra.run.smithi044.stdout:root 466 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_8] 2023-11-04T01:44:33.893 INFO:teuthology.orchestra.run.smithi044.stdout:root 467 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_9] 2023-11-04T01:44:33.893 INFO:teuthology.orchestra.run.smithi044.stdout:root 468 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_9] 2023-11-04T01:44:33.893 INFO:teuthology.orchestra.run.smithi044.stdout:root 470 0.0 0.0 0 0 ? I 01:24 0:00 \_ [kworker/u16:9-ext4-rsv-conversion] 2023-11-04T01:44:33.893 INFO:teuthology.orchestra.run.smithi044.stdout:root 492 0.0 0.0 0 0 ? S 01:24 0:00 \_ [jbd2/sda1-8] 2023-11-04T01:44:33.893 INFO:teuthology.orchestra.run.smithi044.stdout:root 493 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ext4-rsv-conver] 2023-11-04T01:44:33.893 INFO:teuthology.orchestra.run.smithi044.stdout:root 574 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ext4lazyinit] 2023-11-04T01:44:33.894 INFO:teuthology.orchestra.run.smithi044.stdout:root 638 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ipmi-msghandler] 2023-11-04T01:44:33.894 INFO:teuthology.orchestra.run.smithi044.stdout:root 657 0.0 0.0 0 0 ? SN 01:24 0:00 \_ [kipmi0] 2023-11-04T01:44:33.894 INFO:teuthology.orchestra.run.smithi044.stdout:root 659 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [rpciod] 2023-11-04T01:44:33.894 INFO:teuthology.orchestra.run.smithi044.stdout:root 660 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [xprtiod] 2023-11-04T01:44:33.894 INFO:teuthology.orchestra.run.smithi044.stdout:root 61031 0.0 0.0 0 0 ? I< 01:29 0:00 \_ [tls-strp] 2023-11-04T01:44:33.894 INFO:teuthology.orchestra.run.smithi044.stdout:root 62231 0.0 0.0 0 0 ? I 01:30 0:00 \_ [kworker/u16:2-flush-253:1] 2023-11-04T01:44:33.894 INFO:teuthology.orchestra.run.smithi044.stdout:root 62232 0.0 0.0 0 0 ? I 01:30 0:00 \_ [kworker/u16:3-events_unbound] 2023-11-04T01:44:33.894 INFO:teuthology.orchestra.run.smithi044.stdout:root 70351 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush/253:0] 2023-11-04T01:44:33.894 INFO:teuthology.orchestra.run.smithi044.stdout:root 70472 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush/253:1] 2023-11-04T01:44:33.894 INFO:teuthology.orchestra.run.smithi044.stdout:root 70592 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush/253:2] 2023-11-04T01:44:33.894 INFO:teuthology.orchestra.run.smithi044.stdout:root 70712 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush/253:3] 2023-11-04T01:44:33.894 INFO:teuthology.orchestra.run.smithi044.stdout:root 70832 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush/253:4] 2023-11-04T01:44:33.894 INFO:teuthology.orchestra.run.smithi044.stdout:root 71725 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfsalloc] 2023-11-04T01:44:33.894 INFO:teuthology.orchestra.run.smithi044.stdout:root 71726 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs_mru_cache] 2023-11-04T01:44:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:root 71727 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-buf/dm-4] 2023-11-04T01:44:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:root 71728 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-conv/dm-4] 2023-11-04T01:44:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:root 71729 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:44:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:root 71730 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:44:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:root 71731 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:44:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:root 71732 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-log/dm-4] 2023-11-04T01:44:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:root 71733 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-cil/dm-4] 2023-11-04T01:44:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:root 71734 0.0 0.0 0 0 ? S 01:32 0:00 \_ [xfsaild/dm-4] 2023-11-04T01:44:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:root 76253 0.0 0.0 0 0 ? I 01:34 0:00 \_ [kworker/1:94-mm_percpu_wq] 2023-11-04T01:44:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:root 76254 0.0 0.0 0 0 ? I 01:34 0:00 \_ [kworker/1:95-cgroup_destroy] 2023-11-04T01:44:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:root 76853 0.0 0.0 0 0 ? I 01:34 0:00 \_ [kworker/3:47-events] 2023-11-04T01:44:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:root 77080 0.0 0.0 0 0 ? I 01:34 0:00 \_ [kworker/3:211-rcu_gp] 2023-11-04T01:44:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:root 82246 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-buf/dm-0] 2023-11-04T01:44:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:root 82247 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-conv/dm-0] 2023-11-04T01:44:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:root 82248 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:44:33.896 INFO:teuthology.orchestra.run.smithi044.stdout:root 82249 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:44:33.896 INFO:teuthology.orchestra.run.smithi044.stdout:root 82250 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:44:33.896 INFO:teuthology.orchestra.run.smithi044.stdout:root 82251 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-log/dm-0] 2023-11-04T01:44:33.896 INFO:teuthology.orchestra.run.smithi044.stdout:root 82252 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-cil/dm-0] 2023-11-04T01:44:33.896 INFO:teuthology.orchestra.run.smithi044.stdout:root 82253 0.0 0.0 0 0 ? S 01:35 0:00 \_ [xfsaild/dm-0] 2023-11-04T01:44:33.896 INFO:teuthology.orchestra.run.smithi044.stdout:root 82330 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-buf/dm-1] 2023-11-04T01:44:33.896 INFO:teuthology.orchestra.run.smithi044.stdout:root 82331 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-conv/dm-1] 2023-11-04T01:44:33.896 INFO:teuthology.orchestra.run.smithi044.stdout:root 82332 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:44:33.896 INFO:teuthology.orchestra.run.smithi044.stdout:root 82333 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:44:33.896 INFO:teuthology.orchestra.run.smithi044.stdout:root 82334 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:44:33.896 INFO:teuthology.orchestra.run.smithi044.stdout:root 82335 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-log/dm-1] 2023-11-04T01:44:33.896 INFO:teuthology.orchestra.run.smithi044.stdout:root 82336 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-cil/dm-1] 2023-11-04T01:44:33.896 INFO:teuthology.orchestra.run.smithi044.stdout:root 82337 0.0 0.0 0 0 ? S 01:35 0:00 \_ [xfsaild/dm-1] 2023-11-04T01:44:33.896 INFO:teuthology.orchestra.run.smithi044.stdout:root 82414 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-buf/dm-2] 2023-11-04T01:44:33.897 INFO:teuthology.orchestra.run.smithi044.stdout:root 82415 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-conv/dm-2] 2023-11-04T01:44:33.897 INFO:teuthology.orchestra.run.smithi044.stdout:root 82416 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:44:33.897 INFO:teuthology.orchestra.run.smithi044.stdout:root 82417 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:44:33.897 INFO:teuthology.orchestra.run.smithi044.stdout:root 82418 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:44:33.897 INFO:teuthology.orchestra.run.smithi044.stdout:root 82419 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-log/dm-2] 2023-11-04T01:44:33.897 INFO:teuthology.orchestra.run.smithi044.stdout:root 82420 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-cil/dm-2] 2023-11-04T01:44:33.897 INFO:teuthology.orchestra.run.smithi044.stdout:root 82421 0.0 0.0 0 0 ? S 01:35 0:00 \_ [xfsaild/dm-2] 2023-11-04T01:44:33.897 INFO:teuthology.orchestra.run.smithi044.stdout:root 82498 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-buf/dm-3] 2023-11-04T01:44:33.897 INFO:teuthology.orchestra.run.smithi044.stdout:root 82499 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-conv/dm-3] 2023-11-04T01:44:33.897 INFO:teuthology.orchestra.run.smithi044.stdout:root 82500 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:44:33.897 INFO:teuthology.orchestra.run.smithi044.stdout:root 82501 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:44:33.897 INFO:teuthology.orchestra.run.smithi044.stdout:root 82502 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:44:33.897 INFO:teuthology.orchestra.run.smithi044.stdout:root 82503 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-log/dm-3] 2023-11-04T01:44:33.897 INFO:teuthology.orchestra.run.smithi044.stdout:root 82504 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-cil/dm-3] 2023-11-04T01:44:33.898 INFO:teuthology.orchestra.run.smithi044.stdout:root 82505 0.0 0.0 0 0 ? S 01:35 0:00 \_ [xfsaild/dm-3] 2023-11-04T01:44:33.898 INFO:teuthology.orchestra.run.smithi044.stdout:root 82551 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [dio/dm-0] 2023-11-04T01:44:33.898 INFO:teuthology.orchestra.run.smithi044.stdout:root 83725 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [dio/dm-1] 2023-11-04T01:44:33.898 INFO:teuthology.orchestra.run.smithi044.stdout:root 84887 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [dio/dm-2] 2023-11-04T01:44:33.898 INFO:teuthology.orchestra.run.smithi044.stdout:root 86049 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [dio/dm-3] 2023-11-04T01:44:33.898 INFO:teuthology.orchestra.run.smithi044.stdout:root 91547 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/0:36-events] 2023-11-04T01:44:33.898 INFO:teuthology.orchestra.run.smithi044.stdout:root 91841 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/6:104-events] 2023-11-04T01:44:33.898 INFO:teuthology.orchestra.run.smithi044.stdout:root 91858 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/6:115-rcu_gp] 2023-11-04T01:44:33.898 INFO:teuthology.orchestra.run.smithi044.stdout:root 91960 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/5:72-mm_percpu_wq] 2023-11-04T01:44:33.898 INFO:teuthology.orchestra.run.smithi044.stdout:root 92297 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/2:233-events] 2023-11-04T01:44:33.898 INFO:teuthology.orchestra.run.smithi044.stdout:root 92402 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/7:211-mm_percpu_wq] 2023-11-04T01:44:33.898 INFO:teuthology.orchestra.run.smithi044.stdout:root 92407 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/7:216-cgroup_destroy] 2023-11-04T01:44:33.898 INFO:teuthology.orchestra.run.smithi044.stdout:root 92506 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/6:202-events] 2023-11-04T01:44:33.899 INFO:teuthology.orchestra.run.smithi044.stdout:root 92875 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/2:255-events] 2023-11-04T01:44:33.899 INFO:teuthology.orchestra.run.smithi044.stdout:root 92886 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/0:93-mm_percpu_wq] 2023-11-04T01:44:33.899 INFO:teuthology.orchestra.run.smithi044.stdout:root 93120 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/4:229-cgroup_destroy] 2023-11-04T01:44:33.899 INFO:teuthology.orchestra.run.smithi044.stdout:root 93132 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/4:241-mm_percpu_wq] 2023-11-04T01:44:33.899 INFO:teuthology.orchestra.run.smithi044.stdout:root 119637 0.0 0.0 0 0 ? I 01:40 0:00 \_ [kworker/u16:0-flush-253:0] 2023-11-04T01:44:33.899 INFO:teuthology.orchestra.run.smithi044.stdout:root 121743 0.0 0.0 0 0 ? I 01:41 0:00 \_ [kworker/6:0-events_long] 2023-11-04T01:44:33.899 INFO:teuthology.orchestra.run.smithi044.stdout:root 126148 0.0 0.0 0 0 ? I 01:43 0:00 \_ [kworker/6:1] 2023-11-04T01:44:33.899 INFO:teuthology.orchestra.run.smithi044.stdout:root 128238 0.0 0.0 0 0 ? I 01:44 0:00 \_ [kworker/3:0-mm_percpu_wq] 2023-11-04T01:44:33.899 INFO:teuthology.orchestra.run.smithi044.stdout:root 128239 0.0 0.0 0 0 ? I 01:44 0:00 \_ [kworker/2:0-events] 2023-11-04T01:44:33.899 INFO:teuthology.orchestra.run.smithi044.stdout:root 1 0.2 0.0 175180 19472 ? Ss 01:24 0:02 /usr/lib/systemd/systemd --switched-root --system --deserialize 31 2023-11-04T01:44:33.899 INFO:teuthology.orchestra.run.smithi044.stdout:root 568 0.1 0.0 26804 17080 ? Ss 01:24 0:01 /usr/lib/systemd/systemd-journald 2023-11-04T01:44:33.899 INFO:teuthology.orchestra.run.smithi044.stdout:root 583 0.0 0.0 37620 15764 ? Ss 01:24 0:00 /usr/lib/systemd/systemd-udevd 2023-11-04T01:44:33.899 INFO:teuthology.orchestra.run.smithi044.stdout:rpc 653 0.0 0.0 13244 5612 ? Ss 01:24 0:00 /usr/bin/rpcbind -w -f 2023-11-04T01:44:33.899 INFO:teuthology.orchestra.run.smithi044.stdout:root 661 0.1 0.0 91912 4580 ? S stdin-killer -- python3 -c ' 2023-11-04T01:44:33.904 DEBUG:teuthology.orchestra.run.smithi044:> import os 2023-11-04T01:44:33.904 DEBUG:teuthology.orchestra.run.smithi044:> path = "/sys/fs/fuse/connections/41/abort" 2023-11-04T01:44:33.905 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists(path): 2023-11-04T01:44:33.905 DEBUG:teuthology.orchestra.run.smithi044:> open(path, "w").write("1") 2023-11-04T01:44:33.905 DEBUG:teuthology.orchestra.run.smithi044:> ' 2023-11-04T01:44:33.985 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:44:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:33.991 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:44:33.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:33.991 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:34.065 INFO:teuthology.orchestra.run.smithi044.stderr:mkdir: cannot create directory ‘d1/dir/.snap/s33’: Software caused connection abort 2023-11-04T01:44:34.067 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:35.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~27s 2023-11-04T01:44:41.823 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~35s 2023-11-04T01:44:48.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~42s 2023-11-04T01:44:55.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~48s 2023-11-04T01:45:01.655 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~55s 2023-11-04T01:45:02.100 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:02.104 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:08.266 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~62s 2023-11-04T01:45:14.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~68s 2023-11-04T01:45:21.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~75s 2023-11-04T01:45:28.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~81s 2023-11-04T01:45:32.170 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:32.173 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:34.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~88s 2023-11-04T01:45:41.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~95s 2023-11-04T01:45:47.930 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~101s 2023-11-04T01:45:54.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~108s 2023-11-04T01:46:01.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~114s 2023-11-04T01:46:02.312 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:02.315 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:07.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~121s 2023-11-04T01:46:14.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~128s 2023-11-04T01:46:20.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~134s 2023-11-04T01:46:27.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~141s 2023-11-04T01:46:32.376 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:32.380 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:34.211 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~147s 2023-11-04T01:46:40.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~154s 2023-11-04T01:46:47.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~161s 2023-11-04T01:46:54.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~167s 2023-11-04T01:47:00.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~174s 2023-11-04T01:47:02.516 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:02.520 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:07.267 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~181s 2023-11-04T01:47:13.879 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~187s 2023-11-04T01:47:20.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~194s 2023-11-04T01:47:27.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~200s 2023-11-04T01:47:32.581 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:32.585 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:33.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~207s 2023-11-04T01:47:40.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~214s 2023-11-04T01:47:46.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~220s 2023-11-04T01:47:53.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~227s 2023-11-04T01:48:00.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~233s 2023-11-04T01:48:02.671 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:02.674 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:06.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~240s 2023-11-04T01:48:13.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~247s 2023-11-04T01:48:19.989 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~253s 2023-11-04T01:48:26.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~260s 2023-11-04T01:48:32.740 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:32.743 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:33.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~266s 2023-11-04T01:48:39.823 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~273s 2023-11-04T01:48:46.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~280s 2023-11-04T01:48:53.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~286s 2023-11-04T01:48:59.657 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~293s 2023-11-04T01:49:02.874 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:02.877 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:06.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~300s 2023-11-04T01:49:12.880 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~306s 2023-11-04T01:49:12.880 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-11-04T01:49:12.881 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:49:12.881 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:49:12.900 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:49:12.901 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi044.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-11-04T01:49:12.901 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:49:12.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:12.901 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:49:12.959 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:49:12.960 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:49:13.018 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:49:13.019 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi044.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-11-04T01:49:13.019 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:49:13.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:13.019 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:49:13.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:49:13.077 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:49:13.077 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:49:13.077 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:49:13.094 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:49:13.095 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi204.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-11-04T01:49:13.095 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:49:13.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:13.095 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:49:13.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:49:13.151 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:49:13.151 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:49:13.151 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:49:13.207 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:49:13.208 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi204.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-11-04T01:49:13.208 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:49:13.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:13.208 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:49:13.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:49:13.264 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:49:14.873 INFO:tasks.ceph.osd.0:Sent signal 15 2023-11-04T01:49:14.873 INFO:tasks.ceph.osd.1:Sent signal 15 2023-11-04T01:49:14.874 INFO:tasks.ceph.osd.2:Sent signal 15 2023-11-04T01:49:14.874 INFO:tasks.ceph.osd.3:Sent signal 15 2023-11-04T01:49:14.874 INFO:tasks.ceph.osd.4:Sent signal 15 2023-11-04T01:49:14.874 INFO:tasks.ceph.osd.5:Sent signal 15 2023-11-04T01:49:14.875 INFO:tasks.ceph.osd.6:Sent signal 15 2023-11-04T01:49:14.875 INFO:tasks.ceph.osd.7:Sent signal 15 2023-11-04T01:49:14.875 INFO:tasks.ceph.mds.a:Sent signal 15 2023-11-04T01:49:14.875 INFO:tasks.ceph.mds.b:Sent signal 15 2023-11-04T01:49:14.876 INFO:tasks.ceph.mds.d:Sent signal 15 2023-11-04T01:49:14.876 INFO:tasks.ceph.mon.a:Sent signal 15 2023-11-04T01:49:14.876 INFO:tasks.ceph.mon.b:Sent signal 15 2023-11-04T01:49:14.876 INFO:tasks.ceph.mon.c:Sent signal 15 2023-11-04T01:49:14.877 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-11-04T01:49:14.877 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-11-04T01:49:14.877 INFO:tasks.ceph.osd.4.smithi204.stderr:2023-11-04T01:49:14.874+0000 7f76e13f3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 118823) UID: 0 2023-11-04T01:49:14.878 INFO:tasks.ceph.osd.4.smithi204.stderr:2023-11-04T01:49:14.874+0000 7f76e13f3640 -1 osd.4 116 *** Got signal Terminated *** 2023-11-04T01:49:14.878 INFO:tasks.ceph.osd.4.smithi204.stderr:2023-11-04T01:49:14.874+0000 7f76e13f3640 -1 osd.4 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:14.878 INFO:tasks.ceph.osd.5.smithi204.stderr:2023-11-04T01:49:14.874+0000 7f4b54357640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 118827) UID: 0 2023-11-04T01:49:14.878 INFO:tasks.ceph.osd.5.smithi204.stderr:2023-11-04T01:49:14.874+0000 7f4b54357640 -1 osd.5 116 *** Got signal Terminated *** 2023-11-04T01:49:14.878 INFO:tasks.ceph.osd.5.smithi204.stderr:2023-11-04T01:49:14.874+0000 7f4b54357640 -1 osd.5 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:14.879 INFO:tasks.ceph.osd.6.smithi204.stderr:2023-11-04T01:49:14.874+0000 7fd2fbdbe640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 118829) UID: 0 2023-11-04T01:49:14.879 INFO:tasks.ceph.osd.6.smithi204.stderr:2023-11-04T01:49:14.874+0000 7fd2fbdbe640 -1 osd.6 116 *** Got signal Terminated *** 2023-11-04T01:49:14.879 INFO:tasks.ceph.osd.6.smithi204.stderr:2023-11-04T01:49:14.874+0000 7fd2fbdbe640 -1 osd.6 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:14.879 INFO:tasks.ceph.osd.7.smithi204.stderr:2023-11-04T01:49:14.874+0000 7f2b28f39640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 118832) UID: 0 2023-11-04T01:49:14.879 INFO:tasks.ceph.osd.7.smithi204.stderr:2023-11-04T01:49:14.874+0000 7f2b28f39640 -1 osd.7 116 *** Got signal Terminated *** 2023-11-04T01:49:14.879 INFO:tasks.ceph.osd.7.smithi204.stderr:2023-11-04T01:49:14.874+0000 7f2b28f39640 -1 osd.7 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:14.880 INFO:tasks.ceph.mds.b.smithi204.stderr:2023-11-04T01:49:14.875+0000 7f895bedd640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 126444) UID: 0 2023-11-04T01:49:14.880 INFO:tasks.ceph.mds.b.smithi204.stderr:2023-11-04T01:49:14.875+0000 7f895bedd640 -1 mds.b *** got signal Terminated *** 2023-11-04T01:49:14.880 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:49:14.875+0000 7f60630dd640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 127141) UID: 0 2023-11-04T01:49:14.880 INFO:tasks.ceph.mds.d.smithi204.stderr:2023-11-04T01:49:14.875+0000 7f60630dd640 -1 mds.d *** got signal Terminated *** 2023-11-04T01:49:14.881 INFO:tasks.ceph.mon.b.smithi204.stderr:2023-11-04T01:49:14.875+0000 7f962c540640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 118256) UID: 0 2023-11-04T01:49:14.881 INFO:tasks.ceph.mon.b.smithi204.stderr:2023-11-04T01:49:14.875+0000 7f962c540640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-11-04T01:49:14.881 INFO:tasks.ceph.mon.c.smithi204.stderr:2023-11-04T01:49:14.876+0000 7f7ba9e17640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 118258) UID: 0 2023-11-04T01:49:14.881 INFO:tasks.ceph.mon.c.smithi204.stderr:2023-11-04T01:49:14.876+0000 7f7ba9e17640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-11-04T01:49:14.881 INFO:tasks.ceph.osd.0.smithi044.stderr:2023-11-04T01:49:14.873+0000 7f8b6ebaa640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 88127) UID: 0 2023-11-04T01:49:14.881 INFO:tasks.ceph.osd.0.smithi044.stderr:2023-11-04T01:49:14.873+0000 7f8b6ebaa640 -1 osd.0 116 *** Got signal Terminated *** 2023-11-04T01:49:14.882 INFO:tasks.ceph.osd.0.smithi044.stderr:2023-11-04T01:49:14.873+0000 7f8b6ebaa640 -1 osd.0 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:14.882 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-11-04T01:49:14.873+0000 7fc5c1621640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 88133) UID: 0 2023-11-04T01:49:14.882 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-11-04T01:49:14.873+0000 7fc5c1621640 -1 osd.1 116 *** Got signal Terminated *** 2023-11-04T01:49:14.882 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-11-04T01:49:14.873+0000 7fc5c1621640 -1 osd.1 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:14.882 INFO:tasks.ceph.osd.2.smithi044.stderr:2023-11-04T01:49:14.873+0000 7f7607d49640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 88135) UID: 0 2023-11-04T01:49:14.882 INFO:tasks.ceph.osd.2.smithi044.stderr:2023-11-04T01:49:14.873+0000 7f7607d49640 -1 osd.2 116 *** Got signal Terminated *** 2023-11-04T01:49:14.883 INFO:tasks.ceph.osd.2.smithi044.stderr:2023-11-04T01:49:14.873+0000 7f7607d49640 -1 osd.2 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:14.883 INFO:tasks.ceph.osd.3.smithi044.stderr:2023-11-04T01:49:14.873+0000 7fd9e3068640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 88137) UID: 0 2023-11-04T01:49:14.883 INFO:tasks.ceph.osd.3.smithi044.stderr:2023-11-04T01:49:14.873+0000 7fd9e3068640 -1 osd.3 116 *** Got signal Terminated *** 2023-11-04T01:49:14.883 INFO:tasks.ceph.osd.3.smithi044.stderr:2023-11-04T01:49:14.873+0000 7fd9e3068640 -1 osd.3 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:14.883 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:49:14.874+0000 7fb1f6f0f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 126526) UID: 0 2023-11-04T01:49:14.884 INFO:tasks.ceph.mds.a.smithi044.stderr:2023-11-04T01:49:14.874+0000 7fb1f6f0f640 -1 mds.a *** got signal Terminated *** 2023-11-04T01:49:14.884 INFO:tasks.ceph.mon.a.smithi044.stderr:2023-11-04T01:49:14.875+0000 7fd857d9f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 87865) UID: 0 2023-11-04T01:49:14.884 INFO:tasks.ceph.mon.a.smithi044.stderr:2023-11-04T01:49:14.875+0000 7fd857d9f640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-04T01:49:15.078 INFO:tasks.ceph.mgr.y.smithi044.stderr:daemon-helper: command crashed with signal 15 2023-11-04T01:49:22.890 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2023-11-04T01:49:22 stdin-killer ERROR: timeout expired: sending signal 9 to command and myself 2023-11-04T01:49:22.894 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:bash: line 1: 127498 Killed ( cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 ) 2023-11-04T01:49:26.928 DEBUG:teuthology.orchestra.run:got remote process result: 137 2023-11-04T01:49:26.928 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:49:26.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:26.928 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:49:26.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:49:26.947 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-04T01:49:26.948 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:27.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.104+0000 7f5036ee7640 1 Processor -- start 2023-11-04T01:49:27.105 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.104+0000 7f5036ee7640 1 -- start start 2023-11-04T01:49:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.105+0000 7f5036ee7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 0x7f50300b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:27.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.105+0000 7f5036ee7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006cc90 con 0x7f503006d9c0 2023-11-04T01:49:27.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.105+0000 7f5036ee7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50300b0e60 con 0x7f503006c5f0 2023-11-04T01:49:27.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.105+0000 7f5036ee7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f50300ade00 2023-11-04T01:49:27.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.105+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f503006d9c0 legacy=0x7f50300710d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:27.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.105+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f503006c5f0 legacy=0x7f50300cc680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:27.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.105+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 msgr2=0x7f50300b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:27.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.105+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 0x7f50300b0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:27.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.306+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f503006d9c0 legacy=0x7f50300710d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:27.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.306+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f503006c5f0 legacy=0x7f50300cc680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:27.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.306+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 msgr2=0x7f50300b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:27.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.306+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 0x7f50300b0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:27.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.707+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f503006d9c0 legacy=0x7f50300710d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:27.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.707+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 msgr2=0x7f50300b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:27.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.707+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f503006c5f0 legacy=0x7f50300cc680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:27.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:27.707+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 0x7f50300b0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:28.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:28.508+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f503006d9c0 legacy=0x7f50300710d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:28.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:28.508+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 msgr2=0x7f50300b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:28.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:28.508+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f503006c5f0 legacy=0x7f50300cc680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:28.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:28.508+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 0x7f50300b0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:30.106 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.105+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 msgr2=0x7f50300b0530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.105+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 0x7f50300b0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.105+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f503006c5f0 legacy=0x7f50300cc680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.105+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f503006d9c0 legacy=0x7f50300710d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.105+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0036a0 0x7f501c005af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.105+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0061d0 0x7f501c008690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.105+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c0061d0 2023-11-04T01:49:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.105+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c0036a0 2023-11-04T01:49:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.105+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0061d0 msgr2=0x7f501c008690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.105+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0061d0 0x7f501c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.105+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0036a0 msgr2=0x7f501c005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.105+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0036a0 0x7f501c005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:30.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.306+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0061d0 msgr2=0x7f501c008690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:30.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.306+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0061d0 0x7f501c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:30.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.306+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0036a0 msgr2=0x7f501c005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:30.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.306+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0036a0 0x7f501c005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.707+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0061d0 msgr2=0x7f501c008690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.707+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0061d0 0x7f501c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.707+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0036a0 msgr2=0x7f501c005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:30.707+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0036a0 0x7f501c005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:31.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:31.507+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0061d0 msgr2=0x7f501c008690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:31.509 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:31.507+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0061d0 0x7f501c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:31.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:31.507+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0036a0 msgr2=0x7f501c005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:31.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:31.507+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0036a0 0x7f501c005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:33.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:33.042 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:33.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.104+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0036a0 msgr2=0x7f501c005af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:33.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.104+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0036a0 0x7f501c005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:33.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.104+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0061d0 msgr2=0x7f501c008690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:33.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.104+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0061d0 0x7f501c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:33.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.104+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:49:33.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.104+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 0x7f501c00afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:33.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.104+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:33.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.105+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c003ae0 2023-11-04T01:49:33.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.105+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f50300ade00 2023-11-04T01:49:33.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.105+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c007d40 2023-11-04T01:49:33.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.105+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c003ae0 legacy=0x7f501c006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:33.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.105+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 msgr2=0x7f501c00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:33.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.105+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:33.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.105+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:33.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.105+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 0x7f501c00afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.306+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c003ae0 legacy=0x7f501c006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.306+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.306+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 msgr2=0x7f501c00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.306+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.306+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 0x7f501c00afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.707+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c003ae0 legacy=0x7f501c006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.707+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.707+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.707+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 msgr2=0x7f501c00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:33.707+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 0x7f501c00afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:34.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:34.508+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c003ae0 legacy=0x7f501c006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:34.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:34.508+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:34.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:34.508+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 msgr2=0x7f501c00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:34.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:34.508+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:34.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:34.508+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 0x7f501c00afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.105+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.105+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.105+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 msgr2=0x7f501c00afe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.105+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50300ade00 0x7f501c00afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:36.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.105+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c003ae0 legacy=0x7f501c006620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:36.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.105+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:36.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.105+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006cc90 con 0x7f501c00ff50 2023-11-04T01:49:36.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.105+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c00d530 2023-11-04T01:49:36.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.105+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:36.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.105+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00ff50 legacy=0x7f501c012370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:36.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.105+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:36.307 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.306+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00ff50 legacy=0x7f501c012370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:36.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.306+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:36.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.306+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.707+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00ff50 legacy=0x7f501c012370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.707+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:36.707+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:37.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:37.508+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:37.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:37.508+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00ff50 legacy=0x7f501c012370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:37.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:37.508+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:39.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.105+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:39.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.105+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:39.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.105+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00ff50 legacy=0x7f501c012370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:39.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.105+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:49:39.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.105+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:39.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.105+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:39.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.105+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c003ae0 2023-11-04T01:49:39.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.105+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c00d530 2023-11-04T01:49:39.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.105+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c007d40 2023-11-04T01:49:39.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.105+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:39.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.105+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:39.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.105+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c003ae0 legacy=0x7f501c013bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:39.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.105+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:39.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.105+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:39.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.306+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:39.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.306+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:39.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.306+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:39.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.306+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c003ae0 legacy=0x7f501c013bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:39.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.306+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:39.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.707+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:39.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.707+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:39.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.707+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c003ae0 legacy=0x7f501c013bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:39.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.707+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:39.709 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:39.707+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:40.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:40.508+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:40.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:40.508+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:40.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:40.508+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:40.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:40.508+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c003ae0 legacy=0x7f501c013bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:40.510 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:40.508+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:42.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.106+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:42.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.106+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:42.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.106+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:42.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.106+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:42.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.106+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c003ae0 legacy=0x7f501c013bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:42.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.106+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007610 0x7f501c00afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:42.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.106+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006cc90 con 0x7f501c0142d0 2023-11-04T01:49:42.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.106+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c007610 2023-11-04T01:49:42.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.106+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0142d0 legacy=0x7f501c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:42.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.106+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c007610 msgr2=0x7f501c00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:42.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.106+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007610 0x7f501c00afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:42.308 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.307+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0142d0 legacy=0x7f501c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:42.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.307+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c007610 msgr2=0x7f501c00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:42.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.307+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007610 0x7f501c00afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:42.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.708+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0142d0 legacy=0x7f501c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:42.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.708+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c007610 msgr2=0x7f501c00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:42.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:42.708+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007610 0x7f501c00afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:43.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:43.509+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0142d0 legacy=0x7f501c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:43.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:43.509+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c007610 msgr2=0x7f501c00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:43.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:43.509+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007610 0x7f501c00afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:45.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.106+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c007610 msgr2=0x7f501c00afe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:45.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.106+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007610 0x7f501c00afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.106+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0142d0 legacy=0x7f501c012340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:45.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.106+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.106+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.106+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:49:45.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.106+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c003aa0 2023-11-04T01:49:45.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.106+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c00d530 2023-11-04T01:49:45.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.106+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c007d40 2023-11-04T01:49:45.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.106+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:45.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.106+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:45.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.106+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c003aa0 legacy=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:45.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.106+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:45.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.106+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:45.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.307+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c003aa0 legacy=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:45.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.307+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:45.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.307+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:45.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.307+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:45.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.307+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:45.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.708+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c003aa0 legacy=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:45.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.708+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:45.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.708+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:45.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.708+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:45.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:45.708+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:46.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:46.509+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c003aa0 legacy=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:46.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:46.509+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:46.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:46.509+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:46.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:46.509+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:46.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:46.509+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:48.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.106+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:48.108 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.106+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.106+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.106+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.106+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c003aa0 legacy=0x7f501c006600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.106+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c00afe0 0x7f501c006d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.106+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006cc90 con 0x7f501c0146b0 2023-11-04T01:49:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.106+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c00afe0 2023-11-04T01:49:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.106+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c00afe0 msgr2=0x7f501c006d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.106+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.106+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c00afe0 0x7f501c006d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.307+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c00afe0 msgr2=0x7f501c006d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.307+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.307+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c00afe0 0x7f501c006d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:48.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.708+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:48.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.708+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c00afe0 msgr2=0x7f501c006d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:48.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:48.708+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c00afe0 0x7f501c006d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:49.509+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c00afe0 msgr2=0x7f501c006d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:49.509+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:49.509+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c00afe0 0x7f501c006d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:51.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.107+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c00afe0 msgr2=0x7f501c006d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:51.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.107+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c00afe0 0x7f501c006d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.107+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:51.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.107+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.107+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:49:51.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.107+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.107+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c0146b0 2023-11-04T01:49:51.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.107+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c00d530 2023-11-04T01:49:51.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.107+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c007d40 2023-11-04T01:49:51.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.107+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:51.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.107+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:51.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.107+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:51.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.107+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:51.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.107+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.308+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.308+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.308+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.308+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.308+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:51.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.709+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:51.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.709+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:51.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.709+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:51.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.709+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:51.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:51.709+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:52.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:52.510+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:52.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:52.510+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:52.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:52.510+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:49:52.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:52.510+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:52.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:52.510+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.107+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.107+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.107+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 msgr2=0x7f501c00f920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.107+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00d530 0x7f501c00f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.107+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.107+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 0x7f501c006d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:54.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.107+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006cc90 con 0x7f501c00afe0 2023-11-04T01:49:54.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.107+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c003aa0 2023-11-04T01:49:54.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.107+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00afe0 legacy=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:54.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.107+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c006d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:54.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.107+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 0x7f501c006d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:54.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.308+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00afe0 legacy=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:54.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.308+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c006d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:54.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.308+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 0x7f501c006d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:54.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.709+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00afe0 legacy=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:54.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.709+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c006d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:54.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:54.709+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 0x7f501c006d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:55.510+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00afe0 legacy=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:49:55.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:55.510+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c006d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:55.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:55.510+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 0x7f501c006d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:57.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.107+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c006d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:57.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.107+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 0x7f501c006d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:57.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.107+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00afe0 legacy=0x7f501c006600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:57.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.107+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:49:57.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.107+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:57.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.107+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 0x7f501c006600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:57.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.107+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c0146b0 2023-11-04T01:49:57.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.107+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c003aa0 2023-11-04T01:49:57.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.107+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c007d40 2023-11-04T01:49:57.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.107+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:57.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.107+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:57.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.107+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c007290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:57.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.107+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:57.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.107+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 0x7f501c006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:57.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.308+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:57.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.308+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:57.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.308+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c007290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:57.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.308+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:57.310 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.308+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 0x7f501c006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:57.710 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.709+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:57.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.709+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:57.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.709+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:57.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.709+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c007290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:57.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:57.709+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 0x7f501c006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:58.511 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:58.510+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:49:58.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:58.510+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:58.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:58.510+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:49:58.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:58.510+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c007290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:49:58.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:49:58.510+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 0x7f501c006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:00.109 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.108+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c006600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.108+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 0x7f501c006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.108+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.108+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.108+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c007290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.108+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.108+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006cc90 con 0x7f501c013350 2023-11-04T01:50:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.108+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c00afe0 2023-11-04T01:50:00.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.108+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c013350 legacy=0x7f501c00f510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:00.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.108+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 msgr2=0x7f501c006b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:00.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.108+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:00.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.309+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c013350 legacy=0x7f501c00f510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:00.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.309+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 msgr2=0x7f501c006b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:00.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.309+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:00.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.710+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c013350 legacy=0x7f501c00f510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:00.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.710+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 msgr2=0x7f501c006b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:00.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:00.710+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:01.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:01.511+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c013350 legacy=0x7f501c00f510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:01.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:01.511+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 msgr2=0x7f501c006b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:01.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:01.511+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:03.100 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:03.103 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:03.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.107+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 msgr2=0x7f501c006b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:03.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.107+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.107+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c013350 legacy=0x7f501c00f510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:03.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.107+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:50:03.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.107+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 0x7f501c006600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.107+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.107+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c013350 2023-11-04T01:50:03.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.107+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c003aa0 2023-11-04T01:50:03.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.108+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c007d40 2023-11-04T01:50:03.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.108+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:03.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.108+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:03.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.108+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 0x7f501c006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:03.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.108+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:03.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.108+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c013350 legacy=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:03.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.309+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:03.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.309+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:03.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.309+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c013350 legacy=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:03.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.309+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:03.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.309+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 0x7f501c006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:03.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.710+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:03.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.710+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:03.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.710+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:03.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.710+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c013350 legacy=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:03.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:03.710+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 0x7f501c006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:04.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:04.511+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:04.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:04.511+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:04.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:04.511+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c013350 legacy=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:04.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:04.511+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:04.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:04.511+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 0x7f501c006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:06.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.108+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c006600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.108+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c007d40 0x7f501c006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.108+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.108+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.108+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c013350 legacy=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.108+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.108+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006cc90 con 0x7f501c0146b0 2023-11-04T01:50:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.108+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c00afe0 2023-11-04T01:50:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.108+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.108+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 msgr2=0x7f501c006b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:06.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.108+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:06.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.309+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:06.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.309+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 msgr2=0x7f501c006b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:06.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.309+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:06.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.710+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:06.711 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.710+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 msgr2=0x7f501c006b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:06.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:06.710+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:07.512 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:07.511+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:07.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:07.511+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 msgr2=0x7f501c006b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:07.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:07.511+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:09.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.109+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 msgr2=0x7f501c006b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:09.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.109+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.109+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:09.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.109+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:50:09.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.109+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.109+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.109+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c0146b0 2023-11-04T01:50:09.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.109+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c003aa0 2023-11-04T01:50:09.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.109+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c00afe0 2023-11-04T01:50:09.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.109+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:09.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.109+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:09.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.109+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 msgr2=0x7f501c006b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:09.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.109+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:09.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.109+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:09.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.310+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:09.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.310+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:09.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.310+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 msgr2=0x7f501c006b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:09.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.310+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:09.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.310+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:09.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.711+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:09.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.711+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:09.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.711+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 msgr2=0x7f501c006b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:09.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.711+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:09.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:09.711+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:10.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:10.512+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:10.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:10.512+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:10.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:10.512+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 msgr2=0x7f501c006b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:10.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:10.512+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:10.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:10.512+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:12.110 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.109+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 msgr2=0x7f501c006b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:12.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.109+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c00afe0 0x7f501c006b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:12.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.109+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 msgr2=0x7f501c0081f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:12.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.109+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003aa0 0x7f501c0081f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:12.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.109+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c013730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:12.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.109+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 0x7f501c0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:12.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.109+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006cc90 con 0x7f501c0071d0 2023-11-04T01:50:12.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.109+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c007d40 2023-11-04T01:50:12.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.109+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:12.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.109+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 0x7f501c0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:12.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.109+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:12.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.310+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:12.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.310+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 0x7f501c0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:12.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.310+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:12.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.711+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:12.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.711+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 0x7f501c0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:12.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:12.711+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:13.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:13.512+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:13.513 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:13.512+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 0x7f501c0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:13.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:13.512+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.109+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.109+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 0x7f501c0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.109+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c012340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.109+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:50:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.109+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 0x7f501c0081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.109+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c003aa0 2023-11-04T01:50:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.109+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006cc90 con 0x7f501c007d40 2023-11-04T01:50:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.109+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c0071d0 2023-11-04T01:50:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.109+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.109+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c003aa0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.109+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.109+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c007d40 legacy=0x7f501c009fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:15.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.310+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:15.311 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.310+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c003aa0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.310+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.310+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c007d40 legacy=0x7f501c009fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:15.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.711+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c003aa0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:15.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.711+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:15.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.711+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:15.712 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:15.711+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c007d40 legacy=0x7f501c009fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:16.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:16.512+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c003aa0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:16.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:16.512+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:16.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:16.512+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:16.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:16.512+0000 7f5035484640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c007d40 legacy=0x7f501c009fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:18.111 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.110+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.110+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.110+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c007d40 legacy=0x7f501c009fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.110+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c003aa0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.110+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c00f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.110+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c00fa10 0x7f501c013350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.110+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c00fa10 2023-11-04T01:50:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.110+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c0146b0 2023-11-04T01:50:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.110+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 msgr2=0x7f501c00f4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.110+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c00fa10 msgr2=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.110+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c00f4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.110+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c00fa10 0x7f501c013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.311+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c00fa10 msgr2=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.311+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c00fa10 0x7f501c013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.311+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 msgr2=0x7f501c00f4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.311+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c00f4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:18.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.712+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 msgr2=0x7f501c00f4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:18.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.712+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c00fa10 msgr2=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:18.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.712+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c00f4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:18.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:18.712+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c00fa10 0x7f501c013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:19.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:19.513+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c00fa10 msgr2=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:19.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:19.513+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 msgr2=0x7f501c00f4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:19.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:19.513+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c00fa10 0x7f501c013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:19.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:19.513+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c00f4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.110+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 msgr2=0x7f501c00f4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.110+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c00f4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.110+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c00fa10 msgr2=0x7f501c013350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.110+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c00fa10 0x7f501c013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.110+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:50:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.110+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 0x7f501c0081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.110+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c005a90 0x7f501c0071d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:21.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.110+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50300b0e60 con 0x7f501c00afe0 2023-11-04T01:50:21.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.110+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c007d40 2023-11-04T01:50:21.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.110+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c005a90 2023-11-04T01:50:21.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.110+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:21.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.110+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00afe0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:21.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.110+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:21.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.110+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c005a90 msgr2=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:21.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.110+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c005a90 0x7f501c0071d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:21.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.311+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:21.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.311+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00afe0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:21.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.311+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:21.312 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.311+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c005a90 msgr2=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:21.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.311+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c005a90 0x7f501c0071d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:21.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.712+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:21.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.712+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00afe0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:21.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.712+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:21.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.712+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c005a90 msgr2=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:21.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:21.712+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c005a90 0x7f501c0071d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:22.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:22.513+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00afe0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:22.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:22.513+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:22.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:22.513+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:22.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:22.513+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c005a90 msgr2=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:22.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:22.513+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c005a90 0x7f501c0071d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:24.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.110+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c005a90 msgr2=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.110+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c005a90 0x7f501c0071d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.110+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.110+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c007d40 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.110+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00afe0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.110+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c013a60 0x7f501c00e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.110+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c006cc0 2023-11-04T01:50:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.110+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c013a60 2023-11-04T01:50:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.110+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c006cc0 legacy=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.110+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c013a60 msgr2=0x7f501c00e4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.110+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c013a60 0x7f501c00e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:24.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.311+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c006cc0 legacy=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:24.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.311+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c013a60 msgr2=0x7f501c00e4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:24.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.311+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c013a60 0x7f501c00e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:24.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.712+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c013a60 msgr2=0x7f501c00e4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:24.713 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.712+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c006cc0 legacy=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:24.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:24.712+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c013a60 0x7f501c00e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:25.514 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:25.513+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c006cc0 legacy=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:25.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:25.513+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c013a60 msgr2=0x7f501c00e4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:25.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:25.513+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c013a60 0x7f501c00e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:27.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.111+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c013a60 msgr2=0x7f501c00e4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:27.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.111+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c013a60 0x7f501c00e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:27.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.111+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c006cc0 legacy=0x7f501c013350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:27.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.111+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:50:27.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.111+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c00e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:27.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.111+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 0x7f501c0071d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:27.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.111+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50300b0e60 con 0x7f501c00afe0 2023-11-04T01:50:27.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.111+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c006cc0 2023-11-04T01:50:27.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.111+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c0146b0 2023-11-04T01:50:27.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.111+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00afe0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:27.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.111+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 msgr2=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:27.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.111+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 0x7f501c0071d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:27.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.111+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 msgr2=0x7f501c00e9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:27.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.111+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c00e9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:27.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.312+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00afe0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:27.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.312+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 msgr2=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:27.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.312+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 0x7f501c0071d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:27.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.312+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 msgr2=0x7f501c00e9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:27.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.312+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c00e9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:27.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.713+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 msgr2=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:27.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.713+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00afe0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:27.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.713+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 0x7f501c0071d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:27.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.713+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 msgr2=0x7f501c00e9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:27.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:27.713+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c00e9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:28.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:28.514+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 msgr2=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:28.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:28.514+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00afe0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:28.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:28.514+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 0x7f501c0071d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:28.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:28.514+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 msgr2=0x7f501c00e9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:28.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:28.514+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c00e9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:30.112 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.111+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 msgr2=0x7f501c00e9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.111+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c00e9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.111+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 msgr2=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.111+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 0x7f501c0071d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.111+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c00afe0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.111+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.111+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c005a90 2023-11-04T01:50:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.111+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c007d40 2023-11-04T01:50:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.111+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c005a90 legacy=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.111+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.111+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:30.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.312+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:30.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.312+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c005a90 legacy=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:30.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.312+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.713+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c005a90 legacy=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.713+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:30.713+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:31.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:31.514+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c005a90 legacy=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:31.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:31.514+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:31.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:31.514+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:33.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.111+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:33.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.111+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c007d40 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.111+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c005a90 legacy=0x7f501c013350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:33.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.111+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:50:33.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.111+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c0081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.111+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 0x7f501c0071d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.111+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50300b0e60 con 0x7f501c005a90 2023-11-04T01:50:33.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.111+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c0146b0 2023-11-04T01:50:33.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.111+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c006cc0 2023-11-04T01:50:33.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.111+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c005a90 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:33.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.112+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 msgr2=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:33.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.112+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:33.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.112+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 0x7f501c0071d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:33.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.112+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:33.168 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:33.171 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:33.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.313+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c005a90 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:33.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.313+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 msgr2=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:33.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.313+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:33.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.313+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 0x7f501c0071d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:33.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.313+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.714+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c005a90 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.714+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 msgr2=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.714+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.714+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 0x7f501c0071d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:33.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:33.714+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:34.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:34.515+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c005a90 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:34.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:34.515+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 msgr2=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:34.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:34.515+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:34.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:34.515+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 0x7f501c0071d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:34.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:34.515+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:36.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.112+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 msgr2=0x7f501c0071d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:36.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.112+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 0x7f501c0071d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.112+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:36.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.112+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.112+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c005a90 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:36.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.112+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00afe0 0x7f501c013350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.112+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c00d490 2023-11-04T01:50:36.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.112+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c00afe0 2023-11-04T01:50:36.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.112+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00afe0 msgr2=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:36.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.112+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00afe0 0x7f501c013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:36.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.112+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c00d490 legacy=0x7f501c019050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:36.313 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.313+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00afe0 msgr2=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:36.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.313+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00afe0 0x7f501c013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:36.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.313+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c00d490 legacy=0x7f501c019050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:36.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.714+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00afe0 msgr2=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:36.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.714+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00afe0 0x7f501c013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:36.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:36.714+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c00d490 legacy=0x7f501c019050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:37.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:37.515+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00afe0 msgr2=0x7f501c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:37.515+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00afe0 0x7f501c013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:37.515+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c00d490 legacy=0x7f501c019050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:39.113 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.111+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c00afe0 msgr2=0x7f501c013350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:39.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.111+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c00afe0 0x7f501c013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:39.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.111+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c00d490 legacy=0x7f501c019050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:39.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.111+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:50:39.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.111+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 0x7f501c0081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:39.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.111+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 0x7f501c004a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:39.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.111+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50300b0e60 con 0x7f501c0146b0 2023-11-04T01:50:39.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.111+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c006cc0 2023-11-04T01:50:39.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.111+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c0071d0 2023-11-04T01:50:39.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.111+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:39.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.111+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:39.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.111+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 msgr2=0x7f501c004a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:39.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.111+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 0x7f501c004a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:39.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.111+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.312+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.312+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.312+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 msgr2=0x7f501c004a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.312+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.312+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 0x7f501c004a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.713+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.713+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.713+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 msgr2=0x7f501c004a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.713+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:39.713+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 0x7f501c004a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:40.514+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:40.514+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:40.514+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 msgr2=0x7f501c004a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:40.514+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:40.514+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 0x7f501c004a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.111+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 msgr2=0x7f501c004a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.111+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 0x7f501c004a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.111+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 msgr2=0x7f501c0081d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.111+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c006cc0 0x7f501c0081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.111+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.111+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c004fd0 0x7f501c0053e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.111+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c005920 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.111+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c004fd0 2023-11-04T01:50:42.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.111+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c005920 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:42.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.112+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c004fd0 msgr2=0x7f501c0053e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:42.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.112+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c004fd0 0x7f501c0053e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:42.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.312+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c005920 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:42.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.313+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c004fd0 msgr2=0x7f501c0053e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:42.314 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.313+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c004fd0 0x7f501c0053e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:42.714 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.713+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c005920 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:42.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.714+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c004fd0 msgr2=0x7f501c0053e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:42.715 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:42.714+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c004fd0 0x7f501c0053e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:43.515 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:43.514+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c005920 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:43.516 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:43.515+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c004fd0 msgr2=0x7f501c0053e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:43.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:43.515+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c004fd0 0x7f501c0053e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.112+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c004fd0 msgr2=0x7f501c0053e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.112+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c004fd0 0x7f501c0053e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.112+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c005920 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.112+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.112+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 0x7f501c008190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.112+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 0x7f501c004a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.112+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50300b0e60 con 0x7f501c0146b0 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.112+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c0071d0 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.112+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c006cc0 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.112+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c004a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.112+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 0x7f501c004a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.112+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.112+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.112+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:45.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.313+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c004a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:45.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.313+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 0x7f501c004a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:45.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.313+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:45.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.313+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:45.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.313+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:45.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.714+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c004a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:45.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.714+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 0x7f501c004a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:45.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.714+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:45.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.714+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:45.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:45.714+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:46.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:46.515+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c004a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:46.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:46.515+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 0x7f501c004a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:46.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:46.515+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:46.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:46.515+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:46.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:46.515+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:48.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.112+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:48.114 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.112+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c006cc0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:48.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.112+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c004a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:48.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.112+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0071d0 0x7f501c004a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:48.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.112+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:48.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.112+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c013350 0x7f501c00f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:48.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.112+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c004fd0 2023-11-04T01:50:48.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.112+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c013350 2023-11-04T01:50:48.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.112+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c004fd0 legacy=0x7f501c0053e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:48.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.112+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c013350 msgr2=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:48.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.112+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c013350 0x7f501c00f4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:48.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.313+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c004fd0 legacy=0x7f501c0053e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:48.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.313+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c013350 msgr2=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:48.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.313+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c013350 0x7f501c00f4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:48.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.714+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c004fd0 legacy=0x7f501c0053e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:48.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.714+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c013350 msgr2=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:48.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:48.714+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c013350 0x7f501c00f4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:49.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:49.515+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c004fd0 legacy=0x7f501c0053e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:49.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:49.515+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c013350 msgr2=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:49.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:49.515+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c013350 0x7f501c00f4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:51.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.112+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c013350 msgr2=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:51.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.112+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c013350 0x7f501c00f4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:51.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.112+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c004fd0 legacy=0x7f501c0053e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:51.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.112+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:50:51.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.112+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 0x7f501c008190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:51.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.112+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 0x7f501c0065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.112+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50300b0e60 con 0x7f501c0146b0 2023-11-04T01:50:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.112+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c013350 2023-11-04T01:50:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.112+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c0071d0 2023-11-04T01:50:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.112+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.112+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 msgr2=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.112+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 0x7f501c0065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.112+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.112+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:51.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.313+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:51.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.313+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 msgr2=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:51.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.313+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 0x7f501c0065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:51.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.313+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:51.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.313+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:51.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.714+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 msgr2=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:51.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.714+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:51.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.714+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 0x7f501c0065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:51.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.714+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:51.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:51.714+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:52.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:52.515+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:52.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:52.515+0000 7f5035484640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 msgr2=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:50:52.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:52.515+0000 7f5035484640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 0x7f501c0065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:52.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:52.515+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:52.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:52.515+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:54.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.113+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:54.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.113+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0071d0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:54.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.113+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 msgr2=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:54.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.113+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 0x7f501c0065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:54.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.113+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:54.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.113+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c004a90 0x7f501c006af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:54.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.113+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c0075b0 2023-11-04T01:50:54.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.113+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c004a90 2023-11-04T01:50:54.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.113+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c004a90 msgr2=0x7f501c006af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:54.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.113+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c004a90 0x7f501c006af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:54.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.113+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0075b0 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:54.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.314+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c004a90 msgr2=0x7f501c006af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:54.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.314+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0075b0 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:54.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.314+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c004a90 0x7f501c006af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:54.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.715+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0075b0 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:54.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.715+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c004a90 msgr2=0x7f501c006af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:54.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:54.715+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c004a90 0x7f501c006af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:55.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:55.516+0000 7f5034c83640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0075b0 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:55.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:55.516+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c004a90 msgr2=0x7f501c006af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:50:55.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:55.516+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c004a90 0x7f501c006af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.113+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c004a90 msgr2=0x7f501c006af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.113+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c004a90 0x7f501c006af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.113+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0075b0 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.113+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:50:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.113+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004a90 0x7f501c008190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.113+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50300b0e60 con 0x7f501c0146b0 2023-11-04T01:50:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.113+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c0071d0 2023-11-04T01:50:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.113+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c004a90 2023-11-04T01:50:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.113+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.113+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.113+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004a90 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.113+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004a90 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.314+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.314+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004a90 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.314+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.314+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004a90 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:57.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.715+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:57.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.715+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:57.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.715+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004a90 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:57.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:57.715+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004a90 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:58.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:58.516+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:50:58.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:58.516+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:50:58.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:58.516+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004a90 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:50:58.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:50:58.516+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004a90 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.113+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004a90 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.113+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004a90 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.113+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.113+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.113+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 0x7f501c00f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.113+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c005ac0 0x7f501c00f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.113+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c013350 2023-11-04T01:51:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.113+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c005ac0 2023-11-04T01:51:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.113+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 msgr2=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:00.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.113+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 0x7f501c00f4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:00.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.113+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c005ac0 msgr2=0x7f501c00f9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:00.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.113+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c005ac0 0x7f501c00f9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:00.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.314+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 msgr2=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:00.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.314+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 0x7f501c00f4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:00.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.314+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c005ac0 msgr2=0x7f501c00f9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:00.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.314+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c005ac0 0x7f501c00f9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:00.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.715+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 msgr2=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:00.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.715+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 0x7f501c00f4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:00.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.715+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c005ac0 msgr2=0x7f501c00f9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:00.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:00.715+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c005ac0 0x7f501c00f9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:01.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:01.516+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 msgr2=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:01.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:01.516+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 0x7f501c00f4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:01.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:01.516+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c005ac0 msgr2=0x7f501c00f9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:01.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:01.516+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c005ac0 0x7f501c00f9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:03.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.113+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c005ac0 msgr2=0x7f501c00f9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:03.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.113+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c005ac0 0x7f501c00f9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:03.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.113+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 msgr2=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:03.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.113+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c013350 0x7f501c00f4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:03.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.113+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:51:03.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.113+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 0x7f501c008190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:03.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.113+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006cc90 con 0x7f501c0065b0 2023-11-04T01:51:03.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.113+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50300b0e60 con 0x7f501c0146b0 2023-11-04T01:51:03.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.113+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c0071d0 2023-11-04T01:51:03.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.113+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0065b0 legacy=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:03.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.114+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:03.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.114+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:03.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.114+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:03.306 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:03.310 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:03.315 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.314+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0065b0 legacy=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:03.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.315+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:03.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.315+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:03.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.315+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:03.716 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.715+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0065b0 legacy=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:03.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.716+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:03.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.716+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:03.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:03.716+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:04.517 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:04.516+0000 7f5035484640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0065b0 legacy=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:04.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:04.517+0000 7f5034c83640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:04.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:04.517+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:04.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:04.517+0000 7f5034c83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:06.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.114+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:06.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.114+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:06.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.114+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0146b0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:06.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.114+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0065b0 legacy=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:06.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.114+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004190 0x7f501c004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:06.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.114+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c004ab0 0x7f501c00e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:06.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.114+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c004ab0 2023-11-04T01:51:06.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.114+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c004190 2023-11-04T01:51:06.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.114+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c004ab0 msgr2=0x7f501c00e4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:06.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.114+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c004ab0 0x7f501c00e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:06.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.114+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004190 msgr2=0x7f501c004570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:06.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.114+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004190 0x7f501c004570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.315+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c004ab0 msgr2=0x7f501c00e4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:06.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.315+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c004ab0 0x7f501c00e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:06.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.315+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004190 msgr2=0x7f501c004570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:06.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.315+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004190 0x7f501c004570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:06.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.716+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c004ab0 msgr2=0x7f501c00e4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:06.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.716+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c004ab0 0x7f501c00e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:06.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.716+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004190 msgr2=0x7f501c004570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:06.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:06.716+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004190 0x7f501c004570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:07.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:07.517+0000 7f5027fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c004ab0 msgr2=0x7f501c00e4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:07.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:07.517+0000 7f5027fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c004ab0 0x7f501c00e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:07.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:07.517+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004190 msgr2=0x7f501c004570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:07.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:07.517+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004190 0x7f501c004570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:09.116 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.114+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004190 msgr2=0x7f501c004570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.114+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c004190 0x7f501c004570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.114+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c004ab0 msgr2=0x7f501c00e4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.114+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c004ab0 0x7f501c00e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.114+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:51:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.114+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0065b0 0x7f501c008190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.114+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c003a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.114+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c0071d0 2023-11-04T01:51:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.114+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c0065b0 2023-11-04T01:51:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.114+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c0146b0 2023-11-04T01:51:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.114+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0065b0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.114+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0065b0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.114+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 msgr2=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:09.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.114+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:09.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.114+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c003a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:09.316 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.315+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0065b0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:09.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.315+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0065b0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:09.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.315+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:09.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.315+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 msgr2=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:09.317 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.315+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c003a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:09.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.716+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0065b0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:09.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.716+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0065b0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:09.717 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.716+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 msgr2=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:09.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.716+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:09.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:09.716+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c003a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:10.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:10.517+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0065b0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:10.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:10.517+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0065b0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:10.518 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:10.517+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 msgr2=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:10.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:10.517+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:10.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:10.517+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c003a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:12.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.115+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 msgr2=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:12.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.115+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0146b0 0x7f501c003a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:12.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.115+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0065b0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:12.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.115+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0065b0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:12.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.115+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:12.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.115+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0043e0 0x7f501c0047f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:12.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.115+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006cc90 con 0x7f501c003fc0 2023-11-04T01:51:12.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.115+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c0043e0 2023-11-04T01:51:12.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.115+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c003fc0 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:12.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.115+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0043e0 msgr2=0x7f501c0047f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:12.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.115+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0043e0 0x7f501c0047f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:12.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.316+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c003fc0 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:12.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.316+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0043e0 msgr2=0x7f501c0047f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:12.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.316+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0043e0 0x7f501c0047f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.717+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c003fc0 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:12.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.717+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0043e0 msgr2=0x7f501c0047f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:12.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:12.717+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0043e0 0x7f501c0047f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:13.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:13.518+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c003fc0 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:13.519 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:13.518+0000 7f5027fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0043e0 msgr2=0x7f501c0047f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:13.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:13.518+0000 7f5027fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0043e0 0x7f501c0047f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:15.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.115+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0043e0 msgr2=0x7f501c0047f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.115+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0043e0 0x7f501c0047f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.115+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c003fc0 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.115+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:51:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.115+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c008190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.115+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c0043e0 2023-11-04T01:51:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.115+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006cc90 con 0x7f501c0071d0 2023-11-04T01:51:15.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.115+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c0146b0 2023-11-04T01:51:15.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.115+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0043e0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:15.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.115+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:15.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.115+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:15.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.115+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.316+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0043e0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.316+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.316+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.316+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:15.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.717+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0043e0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:15.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.717+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:15.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.717+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:15.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:15.717+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:16.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:16.518+0000 7f5034c83640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0043e0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:16.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:16.518+0000 7f5035484640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:16.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:16.518+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:16.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:16.518+0000 7f5035484640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:18.117 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.116+0000 7f50267fc640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.116+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.116+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0071d0 legacy=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.116+0000 7f50267fc640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c0043e0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.116+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0047c0 0x7f501c003a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.116+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003fc0 0x7f501c00e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.116+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c0047c0 2023-11-04T01:51:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.116+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c003fc0 2023-11-04T01:51:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.116+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0047c0 msgr2=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.116+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0047c0 0x7f501c003a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:18.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.116+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c003fc0 msgr2=0x7f501c00e4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:18.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.116+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003fc0 0x7f501c00e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:18.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.317+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0047c0 msgr2=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:18.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.317+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0047c0 0x7f501c003a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:18.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.317+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c003fc0 msgr2=0x7f501c00e4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:18.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.317+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003fc0 0x7f501c00e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:18.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.718+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0047c0 msgr2=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:18.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.718+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0047c0 0x7f501c003a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:18.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.718+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c003fc0 msgr2=0x7f501c00e4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:18.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:18.718+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003fc0 0x7f501c00e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:19.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:19.519+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0047c0 msgr2=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:19.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:19.519+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0047c0 0x7f501c003a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:19.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:19.519+0000 7f5027fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c003fc0 msgr2=0x7f501c00e4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:19.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:19.519+0000 7f5027fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003fc0 0x7f501c00e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:21.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.116+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c003fc0 msgr2=0x7f501c00e4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:21.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.116+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c003fc0 0x7f501c00e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:21.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.116+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c0047c0 msgr2=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:21.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.116+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c0047c0 0x7f501c003a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:21.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.116+0000 7f5035484640 1 -- reap_dead start 2023-11-04T01:51:21.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.116+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003fc0 0x7f501c008190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:21.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.116+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 0x7f501c003a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:21.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.116+0000 7f50267fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50300b0e60 con 0x7f501c0043e0 2023-11-04T01:51:21.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.116+0000 7f50267fc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c003fc0 2023-11-04T01:51:21.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.116+0000 7f50267fc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c008d50 con 0x7f501c0071d0 2023-11-04T01:51:21.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.116+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c003fc0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:21.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.116+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003fc0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:21.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.116+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0043e0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:21.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.116+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:21.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.116+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 0x7f501c003a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:21.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.317+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c003fc0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:21.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.317+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003fc0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:21.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.317+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:21.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.317+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0043e0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:21.319 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.317+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 0x7f501c003a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:21.719 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.718+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c003fc0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:21.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.718+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003fc0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:21.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.718+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0043e0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:21.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.718+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:21.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:21.718+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 0x7f501c003a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:22.520 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:22.519+0000 7f5034c83640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c003fc0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:22.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:22.519+0000 7f5034c83640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003fc0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:22.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:22.519+0000 7f5035484640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:22.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:22.519+0000 7f5027fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0043e0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:22.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:22.519+0000 7f5035484640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 0x7f501c003a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:24.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.116+0000 7f50267fc640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 msgr2=0x7f501c003a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:24.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.116+0000 7f50267fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f501c0071d0 0x7f501c003a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:24.118 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.116+0000 7f50267fc640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f501c003fc0 msgr2=0x7f501c008190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:24.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.116+0000 7f50267fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f501c003fc0 0x7f501c008190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:24.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.116+0000 7f50267fc640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f501c0043e0 legacy=0x7f501c0053b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:24.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.116+0000 7f50267fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c0065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:24.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.116+0000 7f50267fc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503006d1c0 con 0x7f501c006af0 2023-11-04T01:51:24.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.116+0000 7f50267fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503006cee0 con 0x7f501c0146b0 2023-11-04T01:51:24.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.116+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c006af0 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:24.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.116+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 msgr2=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:24.119 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.116+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c0065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:24.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.317+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c006af0 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:24.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.317+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 msgr2=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:24.318 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.317+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c0065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:24.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.718+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c006af0 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:24.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.718+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 msgr2=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:24.720 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:24.718+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c0065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:25.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:25.519+0000 7f5027fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f501c006af0 legacy=0x7f501c00f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:25.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:25.519+0000 7f5034c83640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 msgr2=0x7f501c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:25.521 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:25.519+0000 7f5034c83640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f501c0146b0 0x7f501c0065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:27.028 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:51:27.029 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:51:27.029 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:51:27.085 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:51:27.132 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:51:27.133 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:51:27.133 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:51:27.151 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:51:27.151 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:51:27.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:51:27.151 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:51:27.208 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-04T01:51:27.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:51:27.209 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:51:27.209 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:51:27.227 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:51:27.228 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:51:27.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:51:27.228 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:51:27.284 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:51:27.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:51:27.286 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:51:27.286 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:51:27.304 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:51:27.305 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:51:27.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:51:27.305 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:51:27.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:51:27.363 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:51:27.363 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:51:27.364 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:51:27.381 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:51:27.382 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:51:27.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:51:27.382 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:51:27.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:51:27.438 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:51:27.439 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:51:27.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.555+0000 7fc5dc1c0640 1 Processor -- start 2023-11-04T01:51:27.557 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.555+0000 7fc5dc1c0640 1 -- start start 2023-11-04T01:51:27.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.556+0000 7fc5dc1c0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d4159e40 0x7fc5d40b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:27.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.556+0000 7fc5dc1c0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5d4070700 0x7fc5d40b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:27.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.556+0000 7fc5dc1c0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4071500 con 0x7fc5d406bb60 2023-11-04T01:51:27.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.556+0000 7fc5dc1c0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5d4070700 2023-11-04T01:51:27.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.556+0000 7fc5dc1c0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5d4159e40 2023-11-04T01:51:27.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.556+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d4159e40 msgr2=0x7fc5d40b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:27.558 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.556+0000 7fc5da75d640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5d4070700 msgr2=0x7fc5d40b0a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:27.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.556+0000 7fc5da75d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5d4070700 0x7fc5d40b0a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:27.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.556+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5d406bb60 legacy=0x7fc5d406fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:27.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.556+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d4159e40 0x7fc5d40b0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:27.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.757+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5d406bb60 legacy=0x7fc5d406fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:27.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.757+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d4159e40 msgr2=0x7fc5d40b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:27.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.757+0000 7fc5da75d640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5d4070700 msgr2=0x7fc5d40b0a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:27.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.757+0000 7fc5da75d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5d4070700 0x7fc5d40b0a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:27.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:27.757+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d4159e40 0x7fc5d40b0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:28.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:28.158+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5d406bb60 legacy=0x7fc5d406fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:28.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:28.158+0000 7fc5da75d640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5d4070700 msgr2=0x7fc5d40b0a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:28.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:28.158+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d4159e40 msgr2=0x7fc5d40b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:28.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:28.158+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d4159e40 0x7fc5d40b0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:28.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:28.158+0000 7fc5da75d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5d4070700 0x7fc5d40b0a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:28.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:28.959+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5d406bb60 legacy=0x7fc5d406fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:28.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:28.959+0000 7fc5da75d640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5d4070700 msgr2=0x7fc5d40b0a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:28.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:28.959+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d4159e40 msgr2=0x7fc5d40b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:28.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:28.959+0000 7fc5da75d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5d4070700 0x7fc5d40b0a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:28.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:28.959+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d4159e40 0x7fc5d40b0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:30.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:30.557+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d4159e40 msgr2=0x7fc5d40b0530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:30.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:30.557+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5d4159e40 0x7fc5d40b0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:30.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:30.557+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5d4070700 msgr2=0x7fc5d40b0a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:30.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:30.557+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5d4070700 0x7fc5d40b0a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:30.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:30.557+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5d406bb60 legacy=0x7fc5d406fff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:30.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:30.557+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8009580 0x7fc5b800ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:30.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:30.557+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4070f40 con 0x7fc5b80058d0 2023-11-04T01:51:30.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:30.557+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8009580 2023-11-04T01:51:30.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:30.557+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b80058d0 legacy=0x7fc5b8007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:30.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:30.557+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8009580 msgr2=0x7fc5b800ba40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:30.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:30.557+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8009580 0x7fc5b800ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:30.758+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8009580 msgr2=0x7fc5b800ba40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:30.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:30.758+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b80058d0 legacy=0x7fc5b8007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:30.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:30.758+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8009580 0x7fc5b800ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:31.159+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8009580 msgr2=0x7fc5b800ba40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:31.159+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b80058d0 legacy=0x7fc5b8007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:31.159+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8009580 0x7fc5b800ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:31.960+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8009580 msgr2=0x7fc5b800ba40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:31.960+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b80058d0 legacy=0x7fc5b8007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:31.960+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8009580 0x7fc5b800ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:33.370 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:33.373 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:33.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.557+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8009580 msgr2=0x7fc5b800ba40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:33.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.557+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8009580 0x7fc5b800ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:33.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.557+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b80058d0 legacy=0x7fc5b8007d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:33.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.557+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:51:33.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.557+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800bae0 0x7fc5b8008b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:33.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.557+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4071500 con 0x7fc5b800c110 2023-11-04T01:51:33.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.557+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c110 legacy=0x7fc5b800c4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:33.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.557+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4070f40 con 0x7fc5b800ccd0 2023-11-04T01:51:33.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.557+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b800bae0 2023-11-04T01:51:33.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.557+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800bae0 msgr2=0x7fc5b8008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:33.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.557+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b800ccd0 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:33.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.557+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800bae0 0x7fc5b8008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:33.759 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.758+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c110 legacy=0x7fc5b800c4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:33.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.758+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b800ccd0 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:33.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.758+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800bae0 msgr2=0x7fc5b8008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:33.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:33.758+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800bae0 0x7fc5b8008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:34.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:34.159+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c110 legacy=0x7fc5b800c4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:34.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:34.159+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b800ccd0 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:34.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:34.159+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800bae0 msgr2=0x7fc5b8008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:34.160 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:34.159+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800bae0 0x7fc5b8008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:34.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:34.960+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c110 legacy=0x7fc5b800c4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:34.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:34.960+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b800ccd0 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:34.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:34.960+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800bae0 msgr2=0x7fc5b8008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:34.961 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:34.960+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800bae0 0x7fc5b8008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:36.559 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.558+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800bae0 msgr2=0x7fc5b8008b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:36.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.558+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800bae0 0x7fc5b8008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:36.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.558+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b800ccd0 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:36.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.558+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c110 legacy=0x7fc5b800c4f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:36.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.558+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007fc0 0x7fc5b8006d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:36.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.558+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 0x7fc5b8007790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:36.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.558+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8007fc0 2023-11-04T01:51:36.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.558+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b8007380 2023-11-04T01:51:36.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.558+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007fc0 msgr2=0x7fc5b8006d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:36.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.558+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007fc0 0x7fc5b8006d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:36.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.558+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 msgr2=0x7fc5b8007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:36.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.558+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 0x7fc5b8007790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:36.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.759+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007fc0 msgr2=0x7fc5b8006d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:36.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.759+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007fc0 0x7fc5b8006d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:36.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.759+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 msgr2=0x7fc5b8007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:36.760 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:36.759+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 0x7fc5b8007790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:37.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:37.160+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007fc0 msgr2=0x7fc5b8006d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:37.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:37.160+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007fc0 0x7fc5b8006d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:37.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:37.160+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 msgr2=0x7fc5b8007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:37.161 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:37.160+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 0x7fc5b8007790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:37.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:37.961+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007fc0 msgr2=0x7fc5b8006d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:37.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:37.961+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007fc0 0x7fc5b8006d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:37.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:37.961+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 msgr2=0x7fc5b8007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:37.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:37.961+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 0x7fc5b8007790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:39.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.558+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 msgr2=0x7fc5b8007790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:39.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.558+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 0x7fc5b8007790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:39.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.558+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007fc0 msgr2=0x7fc5b8006d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:39.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.558+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007fc0 0x7fc5b8006d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:39.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.558+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:51:39.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.558+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007380 0x7fc5b8008b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:39.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.558+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:39.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.558+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8007d60 con 0x7fc5b800ccd0 2023-11-04T01:51:39.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.558+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8006d50 2023-11-04T01:51:39.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.558+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b8007380 2023-11-04T01:51:39.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.559+0000 7fc5da75d640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 msgr2=0x7fc5b8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:39.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.559+0000 7fc5da75d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:39.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.559+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b800ccd0 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:39.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.559+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007380 msgr2=0x7fc5b8008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:39.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.559+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007380 0x7fc5b8008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.760+0000 7fc5da75d640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 msgr2=0x7fc5b8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.760+0000 7fc5da75d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.760+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007380 msgr2=0x7fc5b8008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.760+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007380 0x7fc5b8008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:39.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:39.760+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b800ccd0 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:40.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:40.161+0000 7fc5da75d640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 msgr2=0x7fc5b8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:40.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:40.161+0000 7fc5da75d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:40.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:40.161+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007380 msgr2=0x7fc5b8008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:40.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:40.161+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b800ccd0 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:40.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:40.161+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007380 0x7fc5b8008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:40.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:40.962+0000 7fc5da75d640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 msgr2=0x7fc5b8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:40.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:40.962+0000 7fc5da75d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:40.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:40.962+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007380 msgr2=0x7fc5b8008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:40.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:40.962+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b800ccd0 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:40.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:40.962+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007380 0x7fc5b8008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:42.560 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:42.559+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007380 msgr2=0x7fc5b8008b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:42.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:42.559+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007380 0x7fc5b8008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:42.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:42.559+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 msgr2=0x7fc5b8007760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:42.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:42.559+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:42.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:42.559+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b800ccd0 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:42.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:42.559+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80149c0 0x7fc5b8014dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:42.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:42.559+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4071500 con 0x7fc5b800c4f0 2023-11-04T01:51:42.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:42.559+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b80149c0 2023-11-04T01:51:42.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:42.559+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b80132a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:42.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:42.559+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80149c0 msgr2=0x7fc5b8014dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:42.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:42.559+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80149c0 0x7fc5b8014dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:42.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:42.760+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b80132a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:42.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:42.760+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80149c0 msgr2=0x7fc5b8014dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:42.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:42.760+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80149c0 0x7fc5b8014dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:43.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:43.161+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b80132a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:43.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:43.161+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80149c0 msgr2=0x7fc5b8014dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:43.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:43.161+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80149c0 0x7fc5b8014dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:43.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:43.962+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b80132a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:43.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:43.962+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80149c0 msgr2=0x7fc5b8014dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:43.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:43.962+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80149c0 0x7fc5b8014dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:45.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.559+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80149c0 msgr2=0x7fc5b8014dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:45.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.559+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80149c0 0x7fc5b8014dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:45.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.559+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b80132a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:45.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.559+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:51:45.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.559+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:45.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.559+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 0x7fc5b800ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:45.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.559+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8008480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:45.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.559+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8006d50 2023-11-04T01:51:45.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.559+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b8007380 2023-11-04T01:51:45.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.559+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b800cfd0 con 0x7fc5b800c4f0 2023-11-04T01:51:45.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.559+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 msgr2=0x7fc5b8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:45.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.559+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:45.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.559+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 msgr2=0x7fc5b800ca90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:45.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.559+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:45.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.559+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 0x7fc5b800ca90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:45.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.560+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8008480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:45.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.759+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 msgr2=0x7fc5b8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:45.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.759+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:45.761 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.760+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:45.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.760+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 msgr2=0x7fc5b800ca90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:45.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.760+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8008480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:45.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:45.760+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 0x7fc5b800ca90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:46.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:46.160+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 msgr2=0x7fc5b8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:46.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:46.160+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:46.162 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:46.161+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:46.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:46.161+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 msgr2=0x7fc5b800ca90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:46.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:46.161+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8008480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:46.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:46.161+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 0x7fc5b800ca90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:46.962 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:46.961+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 msgr2=0x7fc5b8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:46.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:46.961+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:46.963 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:46.962+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:46.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:46.962+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 msgr2=0x7fc5b800ca90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:46.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:46.962+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8008480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:46.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:46.962+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 0x7fc5b800ca90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:48.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:48.559+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:48.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:48.559+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8008480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:48.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:48.559+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 msgr2=0x7fc5b800ca90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:48.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:48.559+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8007380 0x7fc5b800ca90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:48.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:48.559+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 msgr2=0x7fc5b8007760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:48.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:48.559+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:48.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:48.559+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8007d60 con 0x7fc5b80089c0 2023-11-04T01:51:48.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:48.559+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4071500 con 0x7fc5b8006450 2023-11-04T01:51:48.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:48.559+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b80089c0 legacy=0x7fc5b8005d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:48.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:48.559+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006450 legacy=0x7fc5b80162c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:48.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:48.760+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b80089c0 legacy=0x7fc5b8005d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:48.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:48.760+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006450 legacy=0x7fc5b80162c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:49.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:49.161+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b80089c0 legacy=0x7fc5b8005d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:49.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:49.161+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006450 legacy=0x7fc5b80162c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:49.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:49.962+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b80089c0 legacy=0x7fc5b8005d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:49.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:49.962+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006450 legacy=0x7fc5b80162c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:51.561 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.559+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006450 legacy=0x7fc5b80162c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:51.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.559+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b80089c0 legacy=0x7fc5b8005d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:51.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.559+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:51.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.559+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:51:51.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.559+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:51.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.559+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4070f40 con 0x7fc5b8007380 2023-11-04T01:51:51.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.559+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8006d50 2023-11-04T01:51:51.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.559+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b800c4f0 2023-11-04T01:51:51.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.559+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 msgr2=0x7fc5b8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:51.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.559+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8007380 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:51.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.559+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:51.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.559+0000 7fc5da75d640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:51.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.559+0000 7fc5da75d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:51.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.760+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 msgr2=0x7fc5b8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:51.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.760+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8007380 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:51.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.760+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:51.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.760+0000 7fc5da75d640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:51.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:51.760+0000 7fc5da75d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:52.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:52.161+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8007380 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:52.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:52.161+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 msgr2=0x7fc5b8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:52.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:52.161+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:52.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:52.161+0000 7fc5da75d640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:52.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:52.161+0000 7fc5da75d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:52.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:52.962+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8007380 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:51:52.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:52.962+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 msgr2=0x7fc5b8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:52.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:52.962+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:52.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:52.962+0000 7fc5da75d640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:51:52.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:52.962+0000 7fc5da75d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:54.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:54.559+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:54.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:54.559+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:54.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:54.559+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 msgr2=0x7fc5b8007760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:54.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:54.559+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006d50 0x7fc5b8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:54.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:54.559+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8007380 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:54.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:54.559+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8011290 0x7fc5b8013680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:54.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:54.559+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8007d60 con 0x7fc5b8013bc0 2023-11-04T01:51:54.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:54.559+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8011290 2023-11-04T01:51:54.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:54.559+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8013bc0 legacy=0x7fc5b8015fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:54.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:54.559+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8011290 msgr2=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:54.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:54.559+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8011290 0x7fc5b8013680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:54.760+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8011290 msgr2=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:54.760+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8013bc0 legacy=0x7fc5b8015fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:54.760+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8011290 0x7fc5b8013680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:55.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:55.161+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8013bc0 legacy=0x7fc5b8015fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:55.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:55.161+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8011290 msgr2=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:55.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:55.161+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8011290 0x7fc5b8013680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:55.962+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8013bc0 legacy=0x7fc5b8015fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:55.962+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8011290 msgr2=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:55.962+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8011290 0x7fc5b8013680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:57.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.560+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8011290 msgr2=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:57.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.560+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8011290 0x7fc5b8013680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:57.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.560+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8013bc0 legacy=0x7fc5b8015fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:57.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.560+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:51:57.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.560+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 0x7fc5b8011670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:57.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.560+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:57.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.560+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4070f40 con 0x7fc5b8008480 2023-11-04T01:51:57.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.560+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b800c4f0 2023-11-04T01:51:57.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.560+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b80176d0 2023-11-04T01:51:57.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.560+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:57.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.560+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:57.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.560+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 msgr2=0x7fc5b8011670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:57.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.560+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 0x7fc5b8011670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:57.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.560+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8008480 legacy=0x7fc5b8007350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.761+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.761+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.761+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 msgr2=0x7fc5b8011670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.761+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8008480 legacy=0x7fc5b8007350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:57.761+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 0x7fc5b8011670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:58.162+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:58.162+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:58.162+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8008480 legacy=0x7fc5b8007350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:58.162+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 msgr2=0x7fc5b8011670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:58.162+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 0x7fc5b8011670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:58.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:58.963+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:51:58.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:58.963+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:58.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:58.963+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8008480 legacy=0x7fc5b8007350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:51:58.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:58.963+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 msgr2=0x7fc5b8011670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:51:58.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:51:58.963+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 0x7fc5b8011670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:00.562 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:00.560+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 msgr2=0x7fc5b8011670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:00.560+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 0x7fc5b8011670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:00.560+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:00.560+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:00.560+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8008480 legacy=0x7fc5b8007350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:00.560+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006d30 0x7fc5b8011bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:00.560+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8007d60 con 0x7fc5b80120f0 2023-11-04T01:52:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:00.560+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8006d30 2023-11-04T01:52:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:00.560+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b80120f0 legacy=0x7fc5b80144e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:00.560+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006d30 msgr2=0x7fc5b8011bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:00.560+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006d30 0x7fc5b8011bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:00.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:00.761+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b80120f0 legacy=0x7fc5b80144e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:00.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:00.761+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006d30 msgr2=0x7fc5b8011bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:00.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:00.761+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006d30 0x7fc5b8011bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:01.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:01.162+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b80120f0 legacy=0x7fc5b80144e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:01.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:01.162+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006d30 msgr2=0x7fc5b8011bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:01.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:01.162+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006d30 0x7fc5b8011bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:01.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:01.963+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b80120f0 legacy=0x7fc5b80144e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:01.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:01.963+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006d30 msgr2=0x7fc5b8011bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:01.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:01.963+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006d30 0x7fc5b8011bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:03.433 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:03.436 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:03.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.560+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006d30 msgr2=0x7fc5b8011bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:03.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.560+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006d30 0x7fc5b8011bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:03.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.560+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b80120f0 legacy=0x7fc5b80144e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:03.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.560+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:52:03.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.560+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 0x7fc5b8011670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:03.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.560+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:03.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.560+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4070f40 con 0x7fc5b8007320 2023-11-04T01:52:03.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.560+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b800c4f0 2023-11-04T01:52:03.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.560+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b80176d0 2023-11-04T01:52:03.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.560+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:03.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.560+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8007320 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:03.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.560+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:03.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.561+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 msgr2=0x7fc5b8011670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:03.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.561+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 0x7fc5b8011670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:03.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.761+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:03.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.761+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8007320 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:03.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.761+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:03.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.762+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 msgr2=0x7fc5b8011670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:03.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:03.762+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 0x7fc5b8011670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:04.163 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:04.162+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:04.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:04.162+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8007320 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:04.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:04.162+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:04.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:04.163+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 msgr2=0x7fc5b8011670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:04.164 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:04.163+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 0x7fc5b8011670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:04.964 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:04.963+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:04.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:04.963+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8007320 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:04.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:04.963+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:04.965 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:04.964+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 msgr2=0x7fc5b8011670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:04.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:04.964+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 0x7fc5b8011670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:06.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:06.561+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 msgr2=0x7fc5b8011670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:06.561+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80176d0 0x7fc5b8011670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:06.561+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:06.561+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:06.561+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8007320 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:06.561+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80132d0 0x7fc5b80156f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:06.561+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8007d60 con 0x7fc5b8006d10 2023-11-04T01:52:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:06.561+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b80132d0 2023-11-04T01:52:06.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:06.561+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006d10 legacy=0x7fc5b8011bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:06.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:06.561+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80132d0 msgr2=0x7fc5b80156f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:06.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:06.561+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80132d0 0x7fc5b80156f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:06.762+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80132d0 msgr2=0x7fc5b80156f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:06.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:06.762+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006d10 legacy=0x7fc5b8011bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:06.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:06.762+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80132d0 0x7fc5b80156f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:07.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:07.163+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80132d0 msgr2=0x7fc5b80156f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:07.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:07.163+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006d10 legacy=0x7fc5b8011bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:07.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:07.163+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80132d0 0x7fc5b80156f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:07.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:07.964+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006d10 legacy=0x7fc5b8011bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:07.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:07.964+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80132d0 msgr2=0x7fc5b80156f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:07.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:07.964+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80132d0 0x7fc5b80156f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:09.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.561+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80132d0 msgr2=0x7fc5b80156f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:09.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.561+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b80132d0 0x7fc5b80156f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:09.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.561+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006d10 legacy=0x7fc5b8011bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:09.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.561+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:52:09.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.561+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:09.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.561+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8008480 0x7fc5b8007320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:09.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.561+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4070f40 con 0x7fc5b8015c30 2023-11-04T01:52:09.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.561+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b800c4f0 2023-11-04T01:52:09.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.561+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b8008480 2023-11-04T01:52:09.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.561+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8015c30 legacy=0x7fc5b8016010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:09.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.561+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:09.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.561+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8008480 msgr2=0x7fc5b8007320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:09.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.561+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8008480 0x7fc5b8007320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:09.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.561+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:09.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.762+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:09.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.762+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8015c30 legacy=0x7fc5b8016010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:09.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.762+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8008480 msgr2=0x7fc5b8007320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:09.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.762+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:09.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:09.762+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8008480 0x7fc5b8007320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:10.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:10.163+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:10.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:10.163+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8015c30 legacy=0x7fc5b8016010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:10.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:10.163+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8008480 msgr2=0x7fc5b8007320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:10.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:10.163+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:10.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:10.163+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8008480 0x7fc5b8007320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:10.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:10.964+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:10.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:10.964+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8008480 msgr2=0x7fc5b8007320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:10.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:10.964+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8015c30 legacy=0x7fc5b8016010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:10.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:10.964+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:10.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:10.964+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8008480 0x7fc5b8007320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:12.563 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:12.562+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8008480 msgr2=0x7fc5b8007320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:12.562+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8008480 0x7fc5b8007320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:12.562+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:12.562+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:12.562+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8015c30 legacy=0x7fc5b8016010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:12.562+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005d00 0x7fc5b80156f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:12.562+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8007d60 con 0x7fc5b8006140 2023-11-04T01:52:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:12.562+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8005d00 2023-11-04T01:52:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:12.562+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005d00 msgr2=0x7fc5b80156f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:12.562+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:12.562+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005d00 0x7fc5b80156f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:12.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:12.763+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005d00 msgr2=0x7fc5b80156f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:12.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:12.763+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:12.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:12.763+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005d00 0x7fc5b80156f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:13.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:13.164+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:13.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:13.164+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005d00 msgr2=0x7fc5b80156f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:13.165 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:13.164+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005d00 0x7fc5b80156f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:13.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:13.965+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:13.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:13.965+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005d00 msgr2=0x7fc5b80156f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:13.966 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:13.965+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005d00 0x7fc5b80156f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:15.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.562+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005d00 msgr2=0x7fc5b80156f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:15.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.562+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005d00 0x7fc5b80156f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:15.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.562+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:15.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.562+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:52:15.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.562+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8003470 0x7fc5b8003850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:15.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.562+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b800ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:15.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.562+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4070f40 con 0x7fc5b8006140 2023-11-04T01:52:15.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.562+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8003470 2023-11-04T01:52:15.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.562+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b800c4f0 2023-11-04T01:52:15.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.562+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8003470 msgr2=0x7fc5b8003850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:15.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.562+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8003470 0x7fc5b8003850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:15.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.562+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:15.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.562+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:15.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.562+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b800ca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.763+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8003470 msgr2=0x7fc5b8003850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.763+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8003470 0x7fc5b8003850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.763+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.763+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:15.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:15.763+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b800ca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:16.164+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8003470 msgr2=0x7fc5b8003850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:16.164+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8003470 0x7fc5b8003850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:16.164+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:16.164+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:16.164+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b800ca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:16.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:16.965+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8003470 msgr2=0x7fc5b8003850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:16.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:16.965+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8003470 0x7fc5b8003850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:16.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:16.965+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:16.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:16.965+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:16.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:16.965+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b800ca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:18.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:18.562+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:18.564 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:18.562+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b800ca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:18.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:18.562+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8003470 msgr2=0x7fc5b8003850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:18.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:18.562+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8003470 0x7fc5b8003850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:18.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:18.562+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:18.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:18.562+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8004da0 0x7fc5b80166a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:18.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:18.562+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8007d60 con 0x7fc5b8007280 2023-11-04T01:52:18.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:18.562+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8004da0 2023-11-04T01:52:18.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:18.562+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8007280 legacy=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:18.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:18.562+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8004da0 msgr2=0x7fc5b80166a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:18.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:18.562+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8004da0 0x7fc5b80166a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:18.763+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8007280 legacy=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:18.763+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8004da0 msgr2=0x7fc5b80166a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:18.763+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8004da0 0x7fc5b80166a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:19.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:19.164+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8007280 legacy=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:19.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:19.164+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8004da0 msgr2=0x7fc5b80166a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:19.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:19.164+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8004da0 0x7fc5b80166a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:19.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:19.965+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8007280 legacy=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:19.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:19.965+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8004da0 msgr2=0x7fc5b80166a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:19.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:19.965+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8004da0 0x7fc5b80166a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:21.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8004da0 msgr2=0x7fc5b80166a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:21.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8004da0 0x7fc5b80166a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:21.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8007280 legacy=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:21.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8005250 0x7fc5b8018bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:21.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:52:21.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b800ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:21.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007280 0x7fc5b8008480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:21.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8007280 2023-11-04T01:52:21.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b8005250 2023-11-04T01:52:21.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b800cfd0 con 0x7fc5b800c4f0 2023-11-04T01:52:21.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5da75d640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007280 msgr2=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:21.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5da75d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007280 0x7fc5b8008480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:21.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:21.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b800ca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:21.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8005250 msgr2=0x7fc5b8018bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:21.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.563+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8005250 0x7fc5b8018bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:21.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.764+0000 7fc5da75d640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007280 msgr2=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:21.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.764+0000 7fc5da75d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007280 0x7fc5b8008480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:21.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.764+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:21.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.764+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8005250 msgr2=0x7fc5b8018bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:21.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.764+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8005250 0x7fc5b8018bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:21.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:21.764+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b800ca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:22.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:22.165+0000 7fc5da75d640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007280 msgr2=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:22.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:22.165+0000 7fc5da75d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007280 0x7fc5b8008480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:22.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:22.165+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:22.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:22.165+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8005250 msgr2=0x7fc5b8018bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:22.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:22.165+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b800ca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:22.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:22.165+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8005250 0x7fc5b8018bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:22.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:22.966+0000 7fc5da75d640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007280 msgr2=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:22.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:22.966+0000 7fc5da75d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007280 0x7fc5b8008480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:22.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:22.966+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8005250 msgr2=0x7fc5b8018bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:22.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:22.966+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:22.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:22.966+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8005250 0x7fc5b8018bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:22.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:22.966+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b800ca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:24.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:24.563+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:24.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:24.563+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b800ca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:24.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:24.563+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8005250 msgr2=0x7fc5b8018bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:24.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:24.563+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8005250 0x7fc5b8018bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:24.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:24.563+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007280 msgr2=0x7fc5b8008480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:24.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:24.563+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8007280 0x7fc5b8008480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:24.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:24.563+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4070f40 con 0x7fc5b8004480 2023-11-04T01:52:24.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:24.563+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8007d60 con 0x7fc5b8006140 2023-11-04T01:52:24.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:24.563+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004480 legacy=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:24.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:24.563+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:24.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:24.764+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004480 legacy=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:24.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:24.764+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:25.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:25.165+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004480 legacy=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:25.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:25.165+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:25.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:25.966+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004480 legacy=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:25.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:25.966+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:27.565 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:27.563+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:27.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:27.563+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004480 legacy=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:27.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:27.563+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:52:27.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:27.563+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 0x7fc5b800ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:27.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:27.563+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4071500 con 0x7fc5b800c4f0 2023-11-04T01:52:27.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:27.563+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4070f40 con 0x7fc5b8005250 2023-11-04T01:52:27.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:27.563+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8007280 2023-11-04T01:52:27.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:27.563+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:27.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:27.563+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:27.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:27.563+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:27.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:27.563+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:27.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:27.764+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:27.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:27.764+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:27.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:27.764+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:27.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:27.764+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:28.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:28.165+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:28.166 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:28.165+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:28.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:28.165+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:28.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:28.165+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:28.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:28.966+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:28.967 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:28.966+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:28.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:28.966+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:28.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:28.966+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:30.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.564+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:30.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.564+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:30.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.564+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:30.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.564+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:30.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.564+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 0x7fc5b80065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:30.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.564+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014690 0x7fc5b8016a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:30.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.564+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8006140 2023-11-04T01:52:30.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.564+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b8014690 2023-11-04T01:52:30.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.564+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b80065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:30.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.564+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 0x7fc5b80065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:30.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.564+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014690 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:30.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.564+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014690 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:30.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.765+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b80065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:30.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.765+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 0x7fc5b80065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:30.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.765+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014690 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:30.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:30.765+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014690 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:31.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:31.166+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b80065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:31.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:31.166+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 0x7fc5b80065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:31.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:31.166+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014690 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:31.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:31.166+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014690 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:31.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:31.967+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b80065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:31.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:31.967+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 0x7fc5b80065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:31.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:31.967+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014690 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:31.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:31.967+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014690 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:33.496 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:33.500 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:33.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.563+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014690 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:33.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.563+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014690 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:33.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.563+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b80065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:33.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.563+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 0x7fc5b80065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:33.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.563+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8016e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:33.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.563+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:52:33.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.563+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005250 0x7fc5b800ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:33.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.563+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8007d60 con 0x7fc5b800c4f0 2023-11-04T01:52:33.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.563+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8005250 2023-11-04T01:52:33.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.563+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b8014a70 2023-11-04T01:52:33.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.564+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:33.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.564+0000 7fc5da75d640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005250 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:33.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.564+0000 7fc5da75d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005250 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:33.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.564+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 msgr2=0x7fc5b8016e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:33.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.564+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8016e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:33.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.765+0000 7fc5da75d640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005250 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:33.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.765+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:33.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.765+0000 7fc5da75d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005250 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:33.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.765+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 msgr2=0x7fc5b8016e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:33.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:33.765+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8016e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:34.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:34.166+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:34.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:34.166+0000 7fc5da75d640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005250 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:34.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:34.166+0000 7fc5da75d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005250 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:34.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:34.166+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 msgr2=0x7fc5b8016e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:34.168 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:34.166+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8016e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:34.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:34.967+0000 7fc5da75d640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005250 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:34.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:34.967+0000 7fc5da75d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005250 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:34.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:34.967+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:34.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:34.967+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 msgr2=0x7fc5b8016e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:34.967+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8016e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:36.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:36.564+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 msgr2=0x7fc5b8016e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:36.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:36.564+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8016e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:36.566 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:36.564+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005250 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:36.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:36.564+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8005250 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:36.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:36.564+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:36.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:36.564+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 0x7fc5b8006550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:36.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:36.564+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4071500 con 0x7fc5b8006140 2023-11-04T01:52:36.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:36.564+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8007280 2023-11-04T01:52:36.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:36.564+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:36.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:36.564+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:36.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:36.564+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:36.766 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:36.765+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:36.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:36.765+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:36.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:36.765+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:37.166+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:37.166+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:37.166+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:37.968 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:37.967+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:37.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:37.967+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:37.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:37.967+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.565+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.565+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8007280 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.565+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.565+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80173a0 0x7fc5b8019790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.565+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:52:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.565+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8006550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.565+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8007d60 con 0x7fc5b800c4f0 2023-11-04T01:52:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.565+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8014a70 2023-11-04T01:52:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.565+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b80173a0 2023-11-04T01:52:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.565+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.565+0000 7fc5da75d640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.565+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80173a0 msgr2=0x7fc5b8019790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.565+0000 7fc5da75d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.565+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80173a0 0x7fc5b8019790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:39.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.766+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:39.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.766+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80173a0 msgr2=0x7fc5b8019790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:39.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.766+0000 7fc5da75d640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:39.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.766+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80173a0 0x7fc5b8019790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:39.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:39.766+0000 7fc5da75d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:40.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:40.167+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:40.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:40.167+0000 7fc5da75d640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:40.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:40.167+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80173a0 msgr2=0x7fc5b8019790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:40.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:40.167+0000 7fc5da75d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:40.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:40.167+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80173a0 0x7fc5b8019790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:40.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:40.968+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:40.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:40.968+0000 7fc5da75d640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:40.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:40.968+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80173a0 msgr2=0x7fc5b8019790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:40.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:40.968+0000 7fc5da75d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:40.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:40.968+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80173a0 0x7fc5b8019790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:42.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:42.565+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80173a0 msgr2=0x7fc5b8019790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:42.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:42.565+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b80173a0 0x7fc5b8019790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:42.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:42.565+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:42.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:42.565+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:42.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:42.565+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b800c4f0 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:42.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:42.565+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:42.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:42.565+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4071500 con 0x7fc5b8005250 2023-11-04T01:52:42.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:42.565+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8006140 2023-11-04T01:52:42.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:42.565+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:42.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:42.565+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:42.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:42.565+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:42.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:42.766+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:42.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:42.766+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:42.767 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:42.766+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:43.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:43.167+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:43.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:43.167+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:43.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:43.167+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:43.969+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:43.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:43.969+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:43.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:43.969+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:45.567 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.566+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:45.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.566+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:45.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.566+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:45.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.566+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:52:45.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.566+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8006550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:45.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.566+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8007d60 con 0x7fc5b8006140 2023-11-04T01:52:45.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.566+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4071500 con 0x7fc5b8005250 2023-11-04T01:52:45.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.566+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8014a70 2023-11-04T01:52:45.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.566+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:45.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.566+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:45.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.566+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:45.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.566+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:45.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.767+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:45.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.767+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:45.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.767+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:45.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:45.767+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:46.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:46.168+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:46.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:46.168+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:46.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:46.168+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:46.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:46.168+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:46.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:46.969+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:46.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:46.969+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:46.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:46.969+0000 7fc5d975b640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:46.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:46.969+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:48.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.566+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:48.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.566+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8014a70 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:48.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.566+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:48.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.566+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8006140 legacy=0x7fc5b8004480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:48.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.566+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:48.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.566+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8014e50 0x7fc5b8017240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:48.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.566+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b800c4f0 2023-11-04T01:52:48.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.566+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b8014e50 2023-11-04T01:52:48.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.566+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:48.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.566+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:48.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.566+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8014e50 msgr2=0x7fc5b8017240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:48.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.566+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8014e50 0x7fc5b8017240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:48.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.767+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:48.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.767+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:48.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.767+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8014e50 msgr2=0x7fc5b8017240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:48.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:48.767+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8014e50 0x7fc5b8017240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:49.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:49.168+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:49.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:49.168+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:49.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:49.168+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8014e50 msgr2=0x7fc5b8017240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:49.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:49.168+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8014e50 0x7fc5b8017240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:49.969+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:49.969+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:49.969+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8014e50 msgr2=0x7fc5b8017240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:49.969+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8014e50 0x7fc5b8017240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:51.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.566+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8014e50 msgr2=0x7fc5b8017240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:51.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.566+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b8014e50 0x7fc5b8017240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:51.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.566+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:51.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.566+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:51.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.566+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:52:51.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.566+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:51.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.566+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8006550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:51.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.567+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4070f40 con 0x7fc5b8005250 2023-11-04T01:52:51.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.567+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8006140 2023-11-04T01:52:51.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.567+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b800c4f0 2023-11-04T01:52:51.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.567+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:51.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.567+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:51.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.567+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:51.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.567+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:51.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.567+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:51.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.768+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:51.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.768+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:51.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.768+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:51.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.768+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:51.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:51.768+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:52.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:52.169+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:52.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:52.169+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:52.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:52.169+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:52.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:52.169+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:52.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:52.169+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:52.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:52.970+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:52.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:52.970+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:52.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:52.970+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:52.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:52.970+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:52.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:52.970+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:54.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:54.566+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:54.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:54.566+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:54.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:54.566+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:54.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:54.566+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:54.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:54.566+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:54.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:54.566+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004890 0x7fc5b8013d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:54.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:54.566+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8007d60 con 0x7fc5b8004480 2023-11-04T01:52:54.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:54.566+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8004890 2023-11-04T01:52:54.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:54.566+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004480 legacy=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:54.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:54.566+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004890 msgr2=0x7fc5b8013d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:54.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:54.566+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004890 0x7fc5b8013d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:54.768 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:54.767+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004480 legacy=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:54.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:54.767+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004890 msgr2=0x7fc5b8013d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:54.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:54.767+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004890 0x7fc5b8013d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:55.169 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:55.168+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004480 legacy=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:55.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:55.168+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004890 msgr2=0x7fc5b8013d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:55.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:55.168+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004890 0x7fc5b8013d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:55.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:55.969+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004480 legacy=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:52:55.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:55.969+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004890 msgr2=0x7fc5b8013d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:52:55.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:55.969+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004890 0x7fc5b8013d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:57.568 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.566+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004890 msgr2=0x7fc5b8013d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:57.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.566+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004890 0x7fc5b8013d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:57.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.566+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004480 legacy=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:57.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.566+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8006550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:57.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.566+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:57.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.566+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:52:57.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.566+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4070f40 con 0x7fc5b8005250 2023-11-04T01:52:57.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.566+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8006140 2023-11-04T01:52:57.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.566+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b800c4f0 2023-11-04T01:52:57.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.566+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:57.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.566+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:57.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.566+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:57.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.566+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:57.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.566+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:57.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.767+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:57.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.767+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:57.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.767+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:57.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.767+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:57.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:57.767+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:58.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:58.168+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:58.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:58.168+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:58.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:58.168+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:58.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:58.168+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:58.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:58.168+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:58.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:58.969+0000 7fc5d975b640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:52:58.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:58.969+0000 7fc5d9f5c640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:52:58.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:58.969+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:52:58.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:58.969+0000 7fc5d9f5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:58.971 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:52:58.969+0000 7fc5d975b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:00.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:00.566+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:00.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:00.566+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8006550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:00.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:00.566+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:00.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:00.566+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:00.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:00.566+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:00.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:00.566+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004480 0x7fc5b8013680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:00.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:00.566+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8007d60 con 0x7fc5b8004890 2023-11-04T01:53:00.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:00.566+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8004480 2023-11-04T01:53:00.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:00.567+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004480 msgr2=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:00.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:00.567+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8013bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:00.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:00.567+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004480 0x7fc5b8013680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:00.769 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:00.768+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004480 msgr2=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:00.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:00.768+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8013bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:00.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:00.768+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004480 0x7fc5b8013680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:01.170 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:01.169+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004480 msgr2=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:01.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:01.169+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8013bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:01.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:01.169+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004480 0x7fc5b8013680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:01.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:01.970+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8013bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:01.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:01.970+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004480 msgr2=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:01.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:01.970+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004480 0x7fc5b8013680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:03.569 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.567+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004480 msgr2=0x7fc5b8013680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:03.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.567+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8004480 0x7fc5b8013680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:03.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.567+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8013bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:03.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.567+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8017a90 0x7fc5b8019e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:03.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.567+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:53:03.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.567+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4070f40 con 0x7fc5b8004890 2023-11-04T01:53:03.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.567+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8007d60 con 0x7fc5b8005250 2023-11-04T01:53:03.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.567+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8017a90 2023-11-04T01:53:03.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.567+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8017a90 msgr2=0x7fc5b8019e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:03.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.567+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:03.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.567+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8017a90 0x7fc5b8019e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:03.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.567+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:03.618 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:03.621 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:03.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.768+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:03.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.768+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8017a90 msgr2=0x7fc5b8019e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:03.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.768+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8017a90 0x7fc5b8019e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:03.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:03.768+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:04.169+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:04.169+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8017a90 msgr2=0x7fc5b8019e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:04.169+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8017a90 0x7fc5b8019e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:04.169+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:04.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:04.970+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:04.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:04.970+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8017a90 msgr2=0x7fc5b8019e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:04.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:04.970+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8017a90 0x7fc5b8019e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:04.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:04.970+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:06.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.567+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8017a90 msgr2=0x7fc5b8019e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:06.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.567+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8017a90 0x7fc5b8019e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:06.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.567+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:06.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.567+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:06.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.567+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:06.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.567+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:06.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.567+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8006140 2023-11-04T01:53:06.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.567+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b800c4f0 2023-11-04T01:53:06.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.567+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:06.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.567+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:06.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.567+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:06.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.567+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:06.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.768+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:06.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.768+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:06.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.768+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:06.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:06.768+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:07.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:07.169+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:07.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:07.169+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:07.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:07.169+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:07.171 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:07.169+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:07.972 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:07.970+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:07.999 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:07.970+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:08.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:07.970+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:08.000 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:07.970+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:09.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.568+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:09.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.568+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:09.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.568+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 msgr2=0x7fc5b800ca10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:09.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.568+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8006140 0x7fc5b800ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:09.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.568+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:53:09.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.568+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8016fc0 0x7fc5b80173c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:09.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.568+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:09.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.568+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4071500 con 0x7fc5b8004890 2023-11-04T01:53:09.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.568+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8016fc0 2023-11-04T01:53:09.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.568+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b800c4f0 2023-11-04T01:53:09.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.568+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:09.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.568+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8016fc0 msgr2=0x7fc5b80173c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:09.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.568+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:09.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.568+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8016fc0 0x7fc5b80173c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:09.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.568+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:09.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.769+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:09.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.769+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:09.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.769+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8016fc0 msgr2=0x7fc5b80173c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:09.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.769+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8016fc0 0x7fc5b80173c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:09.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:09.769+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:10.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:10.170+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:10.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:10.170+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:10.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:10.170+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8016fc0 msgr2=0x7fc5b80173c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:10.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:10.170+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8016fc0 0x7fc5b80173c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:10.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:10.170+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:10.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:10.971+0000 7fc5d975b640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:10.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:10.971+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8016fc0 msgr2=0x7fc5b80173c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:10.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:10.971+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8016fc0 0x7fc5b80173c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:10.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:10.971+0000 7fc5da75d640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:10.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:10.971+0000 7fc5da75d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:12.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:12.568+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:12.570 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:12.568+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:12.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:12.568+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8016fc0 msgr2=0x7fc5b80173c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:12.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:12.568+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b8016fc0 0x7fc5b80173c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:12.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:12.568+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:12.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:12.568+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800ca10 0x7fc5b8017900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:12.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:12.568+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4070f40 con 0x7fc5b8005250 2023-11-04T01:53:12.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:12.568+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b800ca10 2023-11-04T01:53:12.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:12.568+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800ca10 msgr2=0x7fc5b8017900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:12.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:12.568+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800ca10 0x7fc5b8017900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:12.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:12.568+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:12.769+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800ca10 msgr2=0x7fc5b8017900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:12.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:12.769+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800ca10 0x7fc5b8017900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:12.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:12.769+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:13.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:13.170+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800ca10 msgr2=0x7fc5b8017900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:13.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:13.170+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800ca10 0x7fc5b8017900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:13.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:13.170+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:13.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:13.971+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800ca10 msgr2=0x7fc5b8017900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:13.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:13.971+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800ca10 0x7fc5b8017900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:13.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:13.971+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.568+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800ca10 msgr2=0x7fc5b8017900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.568+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800ca10 0x7fc5b8017900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.568+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8005250 legacy=0x7fc5b8006550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.568+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:53:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.568+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.568+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4071500 con 0x7fc5b8004890 2023-11-04T01:53:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.568+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4070f40 con 0x7fc5b8017e40 2023-11-04T01:53:15.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.568+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b800c4f0 2023-11-04T01:53:15.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.568+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:15.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.568+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8017e40 legacy=0x7fc5b801a230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:15.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.568+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:15.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.568+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:15.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.769+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:15.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.769+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8017e40 legacy=0x7fc5b801a230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:15.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.769+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:15.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:15.769+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:16.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:16.170+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:16.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:16.170+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:16.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:16.170+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8017e40 legacy=0x7fc5b801a230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:16.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:16.170+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:16.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:16.971+0000 7fc5da75d640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:16.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:16.971+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:16.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:16.971+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8017e40 legacy=0x7fc5b801a230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:16.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:16.971+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.569+0000 7fc5cb7fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 msgr2=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.569+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800c4f0 0x7fc5b8016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.569+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b8017e40 legacy=0x7fc5b801a230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.569+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.569+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800ca10 0x7fc5b8006520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.569+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8016fc0 0x7fc5b80173c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:18.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.569+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b8016fc0 2023-11-04T01:53:18.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.569+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b800ca10 2023-11-04T01:53:18.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.569+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8016fc0 msgr2=0x7fc5b80173c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:18.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.569+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8016fc0 0x7fc5b80173c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:18.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.569+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800ca10 msgr2=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:18.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.569+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800ca10 0x7fc5b8006520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:18.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.770+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8016fc0 msgr2=0x7fc5b80173c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:18.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.770+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8016fc0 0x7fc5b80173c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:18.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.770+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800ca10 msgr2=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:18.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:18.770+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800ca10 0x7fc5b8006520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:19.172 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:19.171+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8016fc0 msgr2=0x7fc5b80173c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:19.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:19.171+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8016fc0 0x7fc5b80173c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:19.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:19.171+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800ca10 msgr2=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:19.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:19.171+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800ca10 0x7fc5b8006520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:19.972+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8016fc0 msgr2=0x7fc5b80173c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:19.972+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8016fc0 0x7fc5b80173c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:19.972+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800ca10 msgr2=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:19.972+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800ca10 0x7fc5b8006520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:21.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.569+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800ca10 msgr2=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:21.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.569+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800ca10 0x7fc5b8006520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:21.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.569+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8016fc0 msgr2=0x7fc5b80173c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:21.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.569+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b8016fc0 0x7fc5b80173c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:21.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.569+0000 7fc5da75d640 1 -- reap_dead start 2023-11-04T01:53:21.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.569+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b8006520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:21.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.569+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8007d60 con 0x7fc5b8004890 2023-11-04T01:53:21.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.569+0000 7fc5cb7fe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d4071500 con 0x7fc5b800ca10 2023-11-04T01:53:21.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.569+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b800c4f0 2023-11-04T01:53:21.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.569+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:21.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.569+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:21.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.569+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b8006520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:21.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.569+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b800ca10 legacy=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:21.771 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.770+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:21.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.770+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:21.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.770+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b8006520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:21.772 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:21.770+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b800ca10 legacy=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:22.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:22.171+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:22.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:22.171+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:22.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:22.171+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b8006520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:22.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:22.171+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b800ca10 legacy=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:22.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:22.972+0000 7fc5d975b640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:22.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:22.972+0000 7fc5d9f5c640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:22.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:22.972+0000 7fc5d975b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b8006520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:22.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:22.972+0000 7fc5da75d640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b800ca10 legacy=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:24.571 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.570+0000 7fc5cb7fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 msgr2=0x7fc5b8006520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:24.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.570+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5b800c4f0 0x7fc5b8006520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:24.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.570+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7fc5b800ca10 legacy=0x7fc5b8016a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:24.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.570+0000 7fc5cb7fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7fc5b8004890 legacy=0x7fc5b8008460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:24.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.570+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800d1d0 0x7fc5b800f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:24.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.570+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800fb30 0x7fc5b800ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:24.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.570+0000 7fc5cb7fe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d415dae0 con 0x7fc5b800d1d0 2023-11-04T01:53:24.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.570+0000 7fc5cb7fe640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4070c60 con 0x7fc5b800fb30 2023-11-04T01:53:24.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.570+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800d1d0 msgr2=0x7fc5b800f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:24.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.570+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800fb30 msgr2=0x7fc5b800ff40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:24.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.570+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800fb30 0x7fc5b800ff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:24.572 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.570+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800d1d0 0x7fc5b800f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:24.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.771+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800fb30 msgr2=0x7fc5b800ff40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:24.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.771+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800d1d0 msgr2=0x7fc5b800f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:24.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.771+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800fb30 0x7fc5b800ff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:24.773 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:24.771+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800d1d0 0x7fc5b800f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:25.173 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:25.172+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800d1d0 msgr2=0x7fc5b800f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:25.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:25.172+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800fb30 msgr2=0x7fc5b800ff40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:25.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:25.172+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800d1d0 0x7fc5b800f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:25.174 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:25.172+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800fb30 0x7fc5b800ff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:25.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:25.973+0000 7fc5d9f5c640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800d1d0 msgr2=0x7fc5b800f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:25.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:25.973+0000 7fc5d975b640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800fb30 msgr2=0x7fc5b800ff40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:25.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:25.973+0000 7fc5d975b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc5b800fb30 0x7fc5b800ff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:25.975 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:25.973+0000 7fc5d9f5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc5b800d1d0 0x7fc5b800f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:27.480 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:53:27.482 INFO:tasks.cephfs_test_runner:check snaptable transcation ... ERROR 2023-11-04T01:53:27.483 INFO:tasks.cephfs_test_runner:ERROR 2023-11-04T01:53:27.483 INFO:tasks.cephfs_test_runner: 2023-11-04T01:53:27.483 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:53:27.483 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:53:27.483 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 174, in test_kill_mdstable 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner: self.assertEqual(len(self._get_pending_snap_update(rank=0)), 1) 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 38, in _get_pending_snap_update 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner: return self._get_snapserver_dump(rank,status=status)["pending_update"] 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 29, in _get_snapserver_dump 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner: return self.fs.rank_asok(["dump", "snaps", "--server"], rank=rank, status=status) 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1295, in rank_asok 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner: info = self.get_rank(rank=rank, status=status) 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1101, in get_rank 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner: status = self.getinfo() 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 565, in getinfo 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner: status = self.status() 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:53:27.484 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:53:27.485 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:53:27.486 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:53:27.486 INFO:tasks.cephfs_test_runner: 2023-11-04T01:53:27.486 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:53:27.486 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:53:27.486 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:53:27.486 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:53:27.486 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:53:27.486 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/cephfs_test_case.py", line 208, in tearDown 2023-11-04T01:53:27.486 INFO:tasks.cephfs_test_runner: self.mds_cluster.delete_all_filesystems() 2023-11-04T01:53:27.486 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 493, in delete_all_filesystems 2023-11-04T01:53:27.486 INFO:tasks.cephfs_test_runner: for fs in self.status().get_filesystems(): 2023-11-04T01:53:27.486 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:53:27.486 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:53:27.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:53:27.487 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:53:27.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:53:27.487 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:53:27.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:53:27.487 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:53:27.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:53:27.487 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:53:27.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:53:27.487 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:53:27.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:53:27.487 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:53:27.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:53:27.487 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:53:27.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:53:27.488 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:53:27.488 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:53:27.488 INFO:tasks.cephfs_test_runner: 2023-11-04T01:53:27.488 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:53:27.488 INFO:tasks.cephfs_test_runner:Ran 5 tests in 1000.703s 2023-11-04T01:53:27.488 INFO:tasks.cephfs_test_runner: 2023-11-04T01:53:27.488 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2023-11-04T01:53:27.488 INFO:tasks.cephfs_test_runner: 2023-11-04T01:53:27.488 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:53:27.488 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:53:27.488 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:53:27.488 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:53:27.488 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:53:27.488 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 174, in test_kill_mdstable 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: self.assertEqual(len(self._get_pending_snap_update(rank=0)), 1) 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 38, in _get_pending_snap_update 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: return self._get_snapserver_dump(rank,status=status)["pending_update"] 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 29, in _get_snapserver_dump 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: return self.fs.rank_asok(["dump", "snaps", "--server"], rank=rank, status=status) 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1295, in rank_asok 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: info = self.get_rank(rank=rank, status=status) 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1101, in get_rank 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: status = self.getinfo() 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 565, in getinfo 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: status = self.status() 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:53:27.489 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:53:27.490 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:53:27.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:53:27.490 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:53:27.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:53:27.490 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:53:27.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:53:27.490 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:53:27.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:53:27.490 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:53:27.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:53:27.490 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:53:27.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:53:27.490 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:53:27.490 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:53:27.490 INFO:tasks.cephfs_test_runner: 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/cephfs_test_case.py", line 208, in tearDown 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner: self.mds_cluster.delete_all_filesystems() 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 493, in delete_all_filesystems 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner: for fs in self.status().get_filesystems(): 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:53:27.491 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:53:27.492 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:53:27.492 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:53:27.492 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:53:27.492 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:53:27.492 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:53:27.492 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:53:27.492 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:53:27.492 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:53:27.492 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:53:27.492 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:53:27.492 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:53:27.492 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:53:27.492 INFO:tasks.cephfs_test_runner: 2023-11-04T01:53:27.493 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:53:27.585 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9fc1f005409a4e548fad5810523519a4 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:53:27.587 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-04T01:53:27.597 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-04T01:53:27.616 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-04T01:53:27.616 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:53:27.616 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:53:27.638 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:53:27.638 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-04T01:53:27.638 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:53:27.695 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15792 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:53:27.696 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:53:27.696 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:53:27.714 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:53:27.714 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-04T01:53:27.714 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:53:27.773 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16486 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:53:27.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:27.774 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2023-11-04T01:53:27.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:53:27.791 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:53:27.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:27.791 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:53:27.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:27.865 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:53:27.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:27.940 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2023-11-04T01:53:28.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:28.041 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2023-11-04T01:53:28.059 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-04T01:53:28.059 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-04T01:53:28.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:28.059 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:53:28.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:28.131 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:53:28.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:28.201 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link delete ceph-brx 2023-11-04T01:53:28.297 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-04T01:53:28.306 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-04T01:53:28.306 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:53:28.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.418+0000 7f79bddfb640 1 Processor -- start 2023-11-04T01:53:28.420 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.418+0000 7f79bddfb640 1 -- start start 2023-11-04T01:53:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.418+0000 7f79bddfb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79b815d4e0 0x7f79b80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.418+0000 7f79bddfb640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79b80d3b60 0x7f79b80d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.418+0000 7f79bddfb640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79b815d100 2023-11-04T01:53:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.418+0000 7f79bddfb640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cec20 con 0x7f79b80d3b60 2023-11-04T01:53:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.418+0000 7f79bddfb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79b815d4e0 2023-11-04T01:53:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.418+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79b80d3b60 msgr2=0x7f79b80d1a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:28.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.418+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79b815d100 legacy=0x7f79b80ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:28.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.419+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79b80d3b60 0x7f79b80d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:28.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.419+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79b815d4e0 msgr2=0x7f79b80d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:28.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.419+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79b815d4e0 0x7f79b80d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:28.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.620+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79b815d100 legacy=0x7f79b80ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:28.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.620+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79b80d3b60 msgr2=0x7f79b80d1a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:28.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.620+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79b80d3b60 0x7f79b80d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:28.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.620+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79b815d4e0 msgr2=0x7f79b80d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:28.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:28.620+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79b815d4e0 0x7f79b80d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:29.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:29.021+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79b815d100 legacy=0x7f79b80ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:29.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:29.021+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79b80d3b60 msgr2=0x7f79b80d1a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:29.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:29.021+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79b80d3b60 0x7f79b80d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:29.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:29.021+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79b815d4e0 msgr2=0x7f79b80d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:29.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:29.021+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79b815d4e0 0x7f79b80d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:29.823 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:29.822+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79b80d3b60 msgr2=0x7f79b80d1a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:29.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:29.822+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79b815d100 legacy=0x7f79b80ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:29.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:29.822+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79b80d3b60 0x7f79b80d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:29.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:29.822+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79b815d4e0 msgr2=0x7f79b80d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:29.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:29.822+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79b815d4e0 0x7f79b80d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:31.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:31.419+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79b815d4e0 msgr2=0x7f79b80d14d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:31.421 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:31.419+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79b815d4e0 0x7f79b80d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:31.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:31.419+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79b80d3b60 msgr2=0x7f79b80d1a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:31.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:31.419+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79b80d3b60 0x7f79b80d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:31.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:31.419+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79b815d100 legacy=0x7f79b80ce510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:31.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:31.419+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4007370 0x7f79a4009830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:31.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:31.419+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b4750 con 0x7f79a40036c0 2023-11-04T01:53:31.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:31.419+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a4007370 2023-11-04T01:53:31.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:31.419+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a40036c0 legacy=0x7f79a4005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:31.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:31.419+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4007370 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:31.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:31.419+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4007370 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:31.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:31.620+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a40036c0 legacy=0x7f79a4005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:31.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:31.620+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4007370 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:31.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:31.620+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4007370 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:32.022 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:32.021+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4007370 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:32.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:32.021+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a40036c0 legacy=0x7f79a4005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:32.023 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:32.021+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4007370 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:32.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:32.822+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a40036c0 legacy=0x7f79a4005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:32.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:32.822+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4007370 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:32.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:32.822+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4007370 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:34.008 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:34.011 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:34.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.420+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4007370 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:34.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.420+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4007370 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:34.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.420+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a40036c0 legacy=0x7f79a4005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:34.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.420+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:53:34.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.420+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4009830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:34.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.420+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c90 0x7f79a400d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:34.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.420+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a4009f20 2023-11-04T01:53:34.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.420+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400aab0 2023-11-04T01:53:34.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.420+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a4005c90 2023-11-04T01:53:34.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.420+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a4009f20 legacy=0x7f79a400a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:34.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.420+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c90 msgr2=0x7f79a400d0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:34.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.420+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:34.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.420+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:34.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.420+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c90 0x7f79a400d0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:34.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.621+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a4009f20 legacy=0x7f79a400a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:34.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.621+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:34.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.621+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c90 msgr2=0x7f79a400d0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:34.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.621+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:34.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:34.621+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c90 0x7f79a400d0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:35.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:35.022+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a4009f20 legacy=0x7f79a400a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:35.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:35.022+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:35.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:35.022+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c90 msgr2=0x7f79a400d0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:35.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:35.022+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:35.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:35.022+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c90 0x7f79a400d0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:35.824 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:35.823+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a4009f20 legacy=0x7f79a400a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:35.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:35.823+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:35.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:35.823+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c90 msgr2=0x7f79a400d0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:35.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:35.823+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c90 0x7f79a400d0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:35.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:35.823+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:37.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:37.420+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c90 msgr2=0x7f79a400d0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:37.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:37.420+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c90 0x7f79a400d0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:37.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:37.420+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:37.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:37.420+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:37.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:37.420+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a4009f20 legacy=0x7f79a400a300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:37.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:37.420+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d720 0x7f79a400db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:37.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:37.420+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b4750 con 0x7f79a400e200 2023-11-04T01:53:37.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:37.420+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400d720 2023-11-04T01:53:37.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:37.420+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d720 msgr2=0x7f79a400db30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:37.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:37.420+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d720 0x7f79a400db30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:37.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:37.420+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400e200 legacy=0x7f79a40128f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:37.621+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d720 msgr2=0x7f79a400db30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:37.621+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d720 0x7f79a400db30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:37.621+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400e200 legacy=0x7f79a40128f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:38.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:38.022+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d720 msgr2=0x7f79a400db30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:38.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:38.022+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d720 0x7f79a400db30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:38.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:38.022+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400e200 legacy=0x7f79a40128f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:38.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:38.823+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d720 msgr2=0x7f79a400db30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:38.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:38.823+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d720 0x7f79a400db30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:38.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:38.823+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400e200 legacy=0x7f79a40128f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:40.422 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.421+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d720 msgr2=0x7f79a400db30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:40.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.421+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d720 0x7f79a400db30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:40.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.421+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400e200 legacy=0x7f79a40128f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:40.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.421+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:53:40.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.421+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4009830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:40.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.421+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c60 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:40.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.421+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a400a060 2023-11-04T01:53:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.421+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400aab0 2023-11-04T01:53:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.421+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a4005c60 2023-11-04T01:53:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.421+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a060 legacy=0x7f79a40140d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.421+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c60 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.421+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.421+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c60 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.421+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:40.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.622+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a060 legacy=0x7f79a40140d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:40.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.622+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:40.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.622+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c60 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:40.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.622+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c60 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:40.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:40.622+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:41.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:41.023+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a060 legacy=0x7f79a40140d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:41.023+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c60 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:41.023+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:41.023+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c60 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:41.023+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:41.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:41.824+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a060 legacy=0x7f79a40140d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:41.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:41.824+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:41.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:41.824+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c60 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:41.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:41.824+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c60 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:41.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:41.824+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:43.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:43.421+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c60 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:43.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:43.421+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4005c60 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:43.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:43.421+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:43.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:43.421+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:43.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:43.421+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a060 legacy=0x7f79a40140d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:43.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:43.421+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a400a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:43.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:43.421+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b4750 con 0x7f79a4014810 2023-11-04T01:53:43.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:43.421+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400d1f0 2023-11-04T01:53:43.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:43.421+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a400a440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:43.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:43.421+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a400a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:43.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:43.421+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4014810 legacy=0x7f79a40128f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:43.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:43.622+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a400a440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:43.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:43.622+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a400a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:43.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:43.622+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4014810 legacy=0x7f79a40128f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:44.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:44.023+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a400a440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:44.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:44.023+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a400a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:44.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:44.023+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4014810 legacy=0x7f79a40128f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:44.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:44.824+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a400a440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:44.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:44.824+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a400a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:44.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:44.824+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4014810 legacy=0x7f79a40128f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:46.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.421+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a400a440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:46.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.421+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a400a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:46.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.421+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4014810 legacy=0x7f79a40128f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:46.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.421+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:53:46.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.421+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:46.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.421+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a400aab0 2023-11-04T01:53:46.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.421+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b4750 con 0x7f79a4015100 2023-11-04T01:53:46.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.421+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400d1f0 2023-11-04T01:53:46.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.421+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a40140d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:46.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.421+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:46.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.421+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4015100 legacy=0x7f79a40174f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:46.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.421+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:46.623 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.622+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a40140d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:46.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.622+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:46.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.622+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4015100 legacy=0x7f79a40174f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:46.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:46.622+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:47.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:47.023+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a40140d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:47.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:47.023+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:47.024 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:47.023+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4015100 legacy=0x7f79a40174f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:47.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:47.023+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:47.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:47.824+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a40140d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:47.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:47.824+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:47.825 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:47.824+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4015100 legacy=0x7f79a40174f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:47.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:47.824+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:49.423 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.422+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.422+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.422+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4015100 legacy=0x7f79a40174f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.422+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a40140d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.422+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4005c60 0x7f79a4009830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.422+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a170 0x7f79a40108e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.422+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400a170 2023-11-04T01:53:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.422+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a4005c60 2023-11-04T01:53:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.422+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a170 msgr2=0x7f79a40108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:49.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.422+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4005c60 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:49.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.422+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a170 0x7f79a40108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:49.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.422+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4005c60 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:49.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.623+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a170 msgr2=0x7f79a40108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:49.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.623+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a170 0x7f79a40108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:49.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.623+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4005c60 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:49.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:49.623+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4005c60 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:50.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:50.024+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a170 msgr2=0x7f79a40108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:50.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:50.024+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a170 0x7f79a40108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:50.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:50.024+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4005c60 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:50.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:50.024+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4005c60 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:50.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:50.825+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a170 msgr2=0x7f79a40108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:50.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:50.825+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a170 0x7f79a40108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:50.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:50.825+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4005c60 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:50.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:50.825+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4005c60 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:52.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.422+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4005c60 msgr2=0x7f79a4009830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:52.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.422+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4005c60 0x7f79a4009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:52.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.422+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a170 msgr2=0x7f79a40108e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:52.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.422+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a170 0x7f79a40108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:52.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.422+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 0x7f79a4013210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:52.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.422+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:53:52.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.422+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:52.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.422+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a4014ec0 con 0x7f79a400aab0 2023-11-04T01:53:52.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.422+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a4010e20 2023-11-04T01:53:52.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.422+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a400a170 2023-11-04T01:53:52.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.422+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:52.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.422+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:52.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.422+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.422+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 msgr2=0x7f79a4013210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.422+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 0x7f79a4013210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.623+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.623+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.623+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 msgr2=0x7f79a4013210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.623+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:52.623+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 0x7f79a4013210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:53.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:53.024+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:53.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:53.024+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:53.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:53.024+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 msgr2=0x7f79a4013210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:53.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:53.024+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:53.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:53.024+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 0x7f79a4013210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:53.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:53.825+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:53:53.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:53.825+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:53:53.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:53.825+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 msgr2=0x7f79a4013210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:53.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:53.825+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:53.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:53.825+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 0x7f79a4013210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:55.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:55.422+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:55.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:55.422+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:55.424 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:55.422+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 msgr2=0x7f79a4013210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:55.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:55.422+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 0x7f79a4013210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:55.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:55.422+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:55.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:55.423+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a40108e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:55.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:55.423+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a4006980 2023-11-04T01:53:55.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:55.423+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400d1f0 2023-11-04T01:53:55.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:55.423+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a40108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:55.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:55.423+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a40108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:55.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:55.423+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4006980 legacy=0x7f79a4015100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:55.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:55.624+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a40108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:55.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:55.624+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a40108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:55.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:55.624+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4006980 legacy=0x7f79a4015100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:56.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:56.025+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a40108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:56.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:56.025+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a40108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:56.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:56.025+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4006980 legacy=0x7f79a4015100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:56.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:56.826+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a40108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:56.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:56.826+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a40108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:56.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:56.826+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4006980 legacy=0x7f79a4015100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:58.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.423+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a40108e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:58.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.423+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a40108e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:58.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.423+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4006980 legacy=0x7f79a4015100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:58.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.423+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:53:58.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.423+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 0x7f79a4013210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:58.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.423+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:58.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.423+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a4014ec0 con 0x7f79a400a170 2023-11-04T01:53:58.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.423+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400aab0 2023-11-04T01:53:58.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.423+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a4010e20 2023-11-04T01:53:58.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.423+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:58.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.423+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:58.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.423+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a170 legacy=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:58.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.423+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 msgr2=0x7f79a4013210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:58.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.423+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 0x7f79a4013210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:58.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.624+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:58.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.624+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:58.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.624+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 msgr2=0x7f79a4013210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:58.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.624+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 0x7f79a4013210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:58.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:58.624+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a170 legacy=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:59.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:59.025+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:59.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:59.025+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:59.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:59.025+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a170 legacy=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:59.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:59.025+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 msgr2=0x7f79a4013210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:59.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:59.025+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 0x7f79a4013210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:59.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:59.826+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:53:59.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:59.826+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:59.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:59.826+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 msgr2=0x7f79a4013210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:53:59.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:59.826+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a170 legacy=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:53:59.827 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:53:59.826+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 0x7f79a4013210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:01.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:01.422+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 msgr2=0x7f79a4013210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:01.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:01.422+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4010e20 0x7f79a4013210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:01.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:01.422+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:01.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:01.422+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:01.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:01.422+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a170 legacy=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:01.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:01.422+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4009830 0x7f79a400f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:01.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:01.422+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a400d1f0 2023-11-04T01:54:01.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:01.422+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a4009830 2023-11-04T01:54:01.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:01.422+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400d1f0 legacy=0x7f79a4006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:01.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:01.423+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4009830 msgr2=0x7f79a400f8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:01.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:01.423+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4009830 0x7f79a400f8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:01.624 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:01.623+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400d1f0 legacy=0x7f79a4006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:01.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:01.624+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4009830 msgr2=0x7f79a400f8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:01.625 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:01.624+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4009830 0x7f79a400f8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:02.025 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:02.024+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400d1f0 legacy=0x7f79a4006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:02.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:02.025+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4009830 msgr2=0x7f79a400f8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:02.025+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4009830 0x7f79a400f8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:02.826 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:02.825+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400d1f0 legacy=0x7f79a4006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:02.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:02.826+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4009830 msgr2=0x7f79a400f8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:02.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:02.826+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4009830 0x7f79a400f8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:04.071 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:04.074 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:04.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4009830 msgr2=0x7f79a400f8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:04.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4009830 0x7f79a400f8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:04.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400d1f0 legacy=0x7f79a4006980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:04.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:54:04.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:04.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 0x7f79a4006270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:04.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1f0 0x7f79a40067b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:04.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400aab0 2023-11-04T01:54:04.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a400d1f0 2023-11-04T01:54:04.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a400a7f0 con 0x7f79a400a170 2023-11-04T01:54:04.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:04.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:04.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a40067b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:04.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1f0 0x7f79a40067b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:04.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 msgr2=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:04.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.423+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 0x7f79a4006270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:04.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.624+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:04.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.624+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:04.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.624+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a40067b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:04.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.624+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 msgr2=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:04.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.624+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1f0 0x7f79a40067b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:04.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:04.624+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 0x7f79a4006270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:05.025+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:05.025+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:05.025+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a40067b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:05.025+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1f0 0x7f79a40067b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:05.025+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 msgr2=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:05.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:05.025+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 0x7f79a4006270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:05.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:05.826+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:05.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:05.826+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:05.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:05.826+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a40067b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:05.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:05.826+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 msgr2=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:05.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:05.826+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1f0 0x7f79a40067b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:05.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:05.826+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 0x7f79a4006270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:07.425 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:07.423+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 msgr2=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:07.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:07.423+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a170 0x7f79a4006270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:07.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:07.423+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a40067b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:07.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:07.423+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1f0 0x7f79a40067b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:07.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:07.423+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:07.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:07.423+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:07.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:07.423+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a4014ec0 con 0x7f79a4006cf0 2023-11-04T01:54:07.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:07.423+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a4009830 2023-11-04T01:54:07.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:07.423+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a4006cf0 legacy=0x7f79a4014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:07.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:07.423+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4009830 legacy=0x7f79a40108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:07.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:07.624+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a4006cf0 legacy=0x7f79a4014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:07.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:07.624+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4009830 legacy=0x7f79a40108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:08.026 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:08.025+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a4006cf0 legacy=0x7f79a4014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:08.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:08.025+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4009830 legacy=0x7f79a40108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:08.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:08.826+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a4006cf0 legacy=0x7f79a4014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:08.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:08.826+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4009830 legacy=0x7f79a40108e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:10.423+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4009830 legacy=0x7f79a40108e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:10.423+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a4006cf0 legacy=0x7f79a4014010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:10.423+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:54:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:10.423+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:10.423+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b4750 con 0x7f79a400e8b0 2023-11-04T01:54:10.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:10.423+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a4014ec0 con 0x7f79a40160d0 2023-11-04T01:54:10.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:10.423+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400aab0 2023-11-04T01:54:10.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:10.423+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400e8b0 legacy=0x7f79a4010ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:10.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:10.423+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:10.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:10.423+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a40160d0 legacy=0x7f79a40184c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:10.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:10.423+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:10.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:10.624+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400e8b0 legacy=0x7f79a4010ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:10.626 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:10.624+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a40160d0 legacy=0x7f79a40184c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:10.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:10.624+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:10.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:10.624+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:11.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:11.025+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400e8b0 legacy=0x7f79a4010ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:11.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:11.025+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a40160d0 legacy=0x7f79a40184c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:11.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:11.025+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:11.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:11.025+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:11.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:11.826+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400e8b0 legacy=0x7f79a4010ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:11.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:11.826+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a40160d0 legacy=0x7f79a40184c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:11.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:11.826+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:11.828 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:11.826+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:13.426 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.424+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:13.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.424+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:13.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.424+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a40160d0 legacy=0x7f79a40184c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:13.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.424+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400e8b0 legacy=0x7f79a4010ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:13.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.424+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a4006270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:13.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.424+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 0x7f79a40067b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:13.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.424+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400d1f0 2023-11-04T01:54:13.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.424+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a400a1b0 2023-11-04T01:54:13.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.424+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:13.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.424+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a4006270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:13.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.424+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 msgr2=0x7f79a40067b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:13.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.424+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 0x7f79a40067b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:13.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.625+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:13.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.625+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a4006270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:13.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.625+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 msgr2=0x7f79a40067b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:13.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:13.625+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 0x7f79a40067b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:14.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:14.026+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:14.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:14.026+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a4006270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:14.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:14.026+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 msgr2=0x7f79a40067b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:14.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:14.026+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 0x7f79a40067b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:14.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:14.827+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:14.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:14.827+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a4006270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:14.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:14.827+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 msgr2=0x7f79a40067b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:14.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:14.827+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 0x7f79a40067b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.424+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 msgr2=0x7f79a40067b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.424+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 0x7f79a40067b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.424+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 msgr2=0x7f79a4006270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.424+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400d1f0 0x7f79a4006270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.424+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:54:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.424+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:16.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.424+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a400aab0 2023-11-04T01:54:16.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.424+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b4750 con 0x7f79a40160d0 2023-11-04T01:54:16.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.424+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400d1f0 2023-11-04T01:54:16.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.424+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4015930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:16.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.424+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a40160d0 legacy=0x7f79a4015220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:16.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.424+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:16.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.424+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:16.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.625+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4015930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:16.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.625+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:16.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.625+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a40160d0 legacy=0x7f79a4015220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:16.627 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:16.625+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:17.027 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:17.026+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4015930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:17.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:17.026+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:17.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:17.026+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a40160d0 legacy=0x7f79a4015220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:17.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:17.026+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:17.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:17.827+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4015930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:17.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:17.827+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:17.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:17.827+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a40160d0 legacy=0x7f79a4015220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:17.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:17.827+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:19.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.425+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:19.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.425+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:19.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.425+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a40160d0 legacy=0x7f79a4015220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:19.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.425+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4015930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:19.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.425+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a1b0 0x7f79a4006250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:19.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.425+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a40108c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:19.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.425+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400a1b0 2023-11-04T01:54:19.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.425+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a4006790 2023-11-04T01:54:19.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.425+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:19.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.425+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a1b0 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:19.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.425+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 msgr2=0x7f79a40108c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:19.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.425+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a40108c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:19.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.626+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:19.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.626+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a1b0 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:19.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.626+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 msgr2=0x7f79a40108c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:19.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:19.626+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a40108c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:20.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:20.027+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:20.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:20.027+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a1b0 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:20.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:20.027+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 msgr2=0x7f79a40108c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:20.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:20.027+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a40108c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:20.828+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:20.828+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a1b0 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:20.828+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 msgr2=0x7f79a40108c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:20.828+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a40108c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:22.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.425+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 msgr2=0x7f79a40108c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:22.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.425+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a40108c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:22.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.425+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:22.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.425+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400a1b0 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:22.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.425+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:54:22.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.425+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a40108c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:22.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.425+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a4006250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:22.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.425+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a4014ec0 con 0x7f79a400a1b0 2023-11-04T01:54:22.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.425+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400aab0 2023-11-04T01:54:22.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.425+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a4006790 2023-11-04T01:54:22.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.425+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:22.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.425+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:22.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.425+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 msgr2=0x7f79a40108c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:22.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.425+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a40151f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:22.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.425+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a40108c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:22.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.626+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:22.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.626+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:22.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.626+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a40151f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:22.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.626+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 msgr2=0x7f79a40108c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:22.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:22.626+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a40108c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:23.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:23.027+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:23.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:23.027+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:23.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:23.027+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a40151f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:23.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:23.027+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 msgr2=0x7f79a40108c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:23.027+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a40108c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:23.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:23.828+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:23.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:23.828+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:23.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:23.828+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a40151f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:23.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:23.828+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 msgr2=0x7f79a40108c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:23.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:23.828+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a40108c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:25.427 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:25.425+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 msgr2=0x7f79a40108c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:25.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:25.425+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a40108c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:25.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:25.425+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:25.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:25.425+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aab0 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:25.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:25.425+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a40151f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:25.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:25.425+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:25.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:25.425+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a4015900 2023-11-04T01:54:25.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:25.425+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400d1f0 2023-11-04T01:54:25.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:25.425+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a4015900 legacy=0x7f79a4015d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:25.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:25.425+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:25.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:25.425+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:25.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:25.626+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a4015900 legacy=0x7f79a4015d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:25.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:25.626+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:25.628 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:25.626+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:26.028 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:26.027+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a4015900 legacy=0x7f79a4015d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:26.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:26.027+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:26.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:26.027+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:26.829 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:26.828+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a4015900 legacy=0x7f79a4015d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:26.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:26.828+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:26.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:26.828+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.425+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.425+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1f0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.425+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a4015900 legacy=0x7f79a4015d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.425+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:54:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.425+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a4010860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.425+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 0x7f79a4006250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.425+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a4014ec0 con 0x7f79a400aab0 2023-11-04T01:54:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.425+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a4006790 2023-11-04T01:54:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.425+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a400a1b0 2023-11-04T01:54:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.426+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a40151f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.426+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.426+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 msgr2=0x7f79a4010860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.426+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.426+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a4010860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:28.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.627+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a40151f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:28.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.627+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:28.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.627+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 msgr2=0x7f79a4010860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:28.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.627+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:28.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:28.627+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a4010860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:29.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:29.028+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a40151f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:29.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:29.028+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:29.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:29.028+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 msgr2=0x7f79a4010860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:29.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:29.028+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:29.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:29.028+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a4010860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:29.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:29.829+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a40151f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:29.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:29.829+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:29.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:29.829+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 msgr2=0x7f79a4010860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:29.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:29.829+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a4010860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:29.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:29.829+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:31.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:31.426+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:31.428 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:31.426+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400a1b0 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:31.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:31.426+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 msgr2=0x7f79a4010860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:31.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:31.426+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a4006790 0x7f79a4010860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:31.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:31.426+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a40151f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:31.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:31.426+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:31.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:31.426+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a400d1f0 2023-11-04T01:54:31.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:31.426+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a4016010 2023-11-04T01:54:31.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:31.426+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:31.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:31.426+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:31.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:31.426+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400d1f0 legacy=0x7f79a4015900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:31.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:31.627+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:31.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:31.627+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:31.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:31.627+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400d1f0 legacy=0x7f79a4015900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:32.029 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:32.028+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:32.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:32.028+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:32.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:32.028+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400d1f0 legacy=0x7f79a4015900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:32.830 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:32.829+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:32.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:32.829+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:32.831 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:32.829+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400d1f0 legacy=0x7f79a4015900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:34.137 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:34.140 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:34.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.427+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:34.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.427+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:34.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.427+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400d1f0 legacy=0x7f79a4015900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:34.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.427+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:54:34.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.427+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:34.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.427+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4013dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:34.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.427+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a4014ec0 con 0x7f79a400a1b0 2023-11-04T01:54:34.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.427+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a4016010 2023-11-04T01:54:34.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.427+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a400aab0 2023-11-04T01:54:34.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.427+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:34.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.427+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:34.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.427+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4013dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:34.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.427+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:34.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.427+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4013dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:34.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.628+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:34.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.628+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:34.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.628+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4013dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:34.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.628+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:34.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:34.628+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4013dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:35.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:35.029+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:35.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:35.029+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:35.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:35.029+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:35.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:35.029+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4013dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:35.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:35.029+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4013dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:35.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:35.830+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:35.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:35.830+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:35.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:35.830+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:35.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:35.830+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4013dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:35.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:35.830+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4013dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:37.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:37.427+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a4013dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:37.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:37.427+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a4013dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:37.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:37.427+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:37.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:37.427+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:37.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:37.427+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:37.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:37.427+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4014300 0x7f79a40157b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:37.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:37.427+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a400d1d0 2023-11-04T01:54:37.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:37.427+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a4014300 2023-11-04T01:54:37.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:37.427+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400d1d0 legacy=0x7f79a40150a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:37.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:37.427+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4014300 msgr2=0x7f79a40157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:37.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:37.427+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4014300 0x7f79a40157b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:37.628+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400d1d0 legacy=0x7f79a40150a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:37.628+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4014300 msgr2=0x7f79a40157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:37.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:37.628+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4014300 0x7f79a40157b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:38.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:38.029+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400d1d0 legacy=0x7f79a40150a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:38.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:38.029+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4014300 msgr2=0x7f79a40157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:38.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:38.029+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4014300 0x7f79a40157b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:38.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:38.830+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400d1d0 legacy=0x7f79a40150a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:38.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:38.830+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4014300 msgr2=0x7f79a40157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:38.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:38.830+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4014300 0x7f79a40157b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:40.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.427+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4014300 msgr2=0x7f79a40157b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.427+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a4014300 0x7f79a40157b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.427+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400d1d0 legacy=0x7f79a40150a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.427+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.427+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:54:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.427+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a4014ec0 con 0x7f79a400aab0 2023-11-04T01:54:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.427+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a400a1b0 2023-11-04T01:54:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.427+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a4016010 2023-11-04T01:54:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.427+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.427+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4013dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.427+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.427+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:40.629 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.628+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4013dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:40.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.628+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:40.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.628+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:40.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:40.628+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:41.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:41.029+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4013dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:41.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:41.029+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:41.030 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:41.029+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:41.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:41.029+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:41.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:41.830+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4013dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:41.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:41.830+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:41.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:41.830+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:41.832 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:41.830+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:43.429 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.428+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:43.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.428+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4016010 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:43.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.428+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:43.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.428+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4013dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:43.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.428+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1d0 0x7f79a40150a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:43.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.428+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a40155e0 0x7f79a40159f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:43.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.428+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400d1d0 2023-11-04T01:54:43.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.428+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a40155e0 2023-11-04T01:54:43.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.428+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a40155e0 msgr2=0x7f79a40159f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:43.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.428+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1d0 msgr2=0x7f79a40150a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:43.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.428+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a40155e0 0x7f79a40159f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:43.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.428+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1d0 0x7f79a40150a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.629+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a40155e0 msgr2=0x7f79a40159f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.629+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1d0 msgr2=0x7f79a40150a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.629+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1d0 0x7f79a40150a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:43.629+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a40155e0 0x7f79a40159f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:44.031 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:44.030+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1d0 msgr2=0x7f79a40150a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:44.030+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a40155e0 msgr2=0x7f79a40159f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:44.030+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1d0 0x7f79a40150a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:44.030+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a40155e0 0x7f79a40159f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:44.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:44.831+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1d0 msgr2=0x7f79a40150a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:44.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:44.831+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a40155e0 msgr2=0x7f79a40159f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:44.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:44.831+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1d0 0x7f79a40150a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:44.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:44.831+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a40155e0 0x7f79a40159f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:46.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.428+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a40155e0 msgr2=0x7f79a40159f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:46.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.428+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a40155e0 0x7f79a40159f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:46.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.428+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1d0 msgr2=0x7f79a40150a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:46.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.428+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1d0 0x7f79a40150a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:46.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.428+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:54:46.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.428+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:46.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.428+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b4750 con 0x7f79a400a1b0 2023-11-04T01:54:46.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.428+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a4014ec0 con 0x7f79a400aab0 2023-11-04T01:54:46.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.428+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400d1d0 2023-11-04T01:54:46.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.428+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:46.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.428+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a400c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:46.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.428+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:46.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.428+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:46.630 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.629+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.629+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a400c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.629+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:46.629+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:47.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:47.030+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:47.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:47.030+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:47.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:47.030+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a400c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:47.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:47.030+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:47.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:47.831+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:47.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:47.831+0000 7f79b7fff640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:47.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:47.831+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a400c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:47.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:47.831+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:49.430 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.429+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:49.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.429+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:49.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.429+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a400c020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:49.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.429+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:49.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.429+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4013840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:49.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.429+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400cba0 0x7f79a4013d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:49.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.429+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400c730 2023-11-04T01:54:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.429+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a400cba0 2023-11-04T01:54:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.429+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 msgr2=0x7f79a4013840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.429+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4013840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.429+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400cba0 msgr2=0x7f79a4013d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.429+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400cba0 0x7f79a4013d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:49.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.630+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 msgr2=0x7f79a4013840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:49.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.630+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4013840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:49.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.630+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400cba0 msgr2=0x7f79a4013d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:49.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:49.630+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400cba0 0x7f79a4013d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:50.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:50.031+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 msgr2=0x7f79a4013840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:50.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:50.031+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4013840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:50.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:50.031+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400cba0 msgr2=0x7f79a4013d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:50.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:50.031+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400cba0 0x7f79a4013d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:50.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:50.832+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 msgr2=0x7f79a4013840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:50.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:50.832+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4013840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:50.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:50.832+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400cba0 msgr2=0x7f79a4013d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:50.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:50.832+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400cba0 0x7f79a4013d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:52.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.429+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400cba0 msgr2=0x7f79a4013d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:52.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.429+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400cba0 0x7f79a4013d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:52.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.429+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 msgr2=0x7f79a4013840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:52.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.429+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4013840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.429+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:54:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.429+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.429+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4006250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.429+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a400aab0 2023-11-04T01:54:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.429+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400c730 2023-11-04T01:54:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.429+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a400a1b0 2023-11-04T01:54:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.429+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:52.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.429+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:52.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.429+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:52.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.429+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a400c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:52.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.429+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:52.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.630+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:52.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.630+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:52.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.630+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:52.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.630+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a400c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:52.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:52.630+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:53.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:53.031+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:53.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:53.031+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:53.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:53.031+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a400c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:53.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:53.031+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:53.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:53.031+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:53.832+0000 7f79b7fff640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:53.832+0000 7f79b7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:53.832+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a400c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:54:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:53.832+0000 7f79b6ffd640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:53.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:53.832+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:55.429+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:55.429+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:55.429+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:55.429+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:55.429+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a400c020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:55.429+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 0x7f79a4013840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:55.429+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b4750 con 0x7f79a400cb10 2023-11-04T01:54:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:55.429+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400d1d0 2023-11-04T01:54:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:55.429+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400cb10 legacy=0x7f79a4013d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:55.429+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 msgr2=0x7f79a4013840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:55.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:55.429+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 0x7f79a4013840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:55.630+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400cb10 legacy=0x7f79a4013d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:55.630+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 msgr2=0x7f79a4013840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:55.632 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:55.630+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 0x7f79a4013840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:56.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:56.031+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400cb10 legacy=0x7f79a4013d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:56.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:56.031+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 msgr2=0x7f79a4013840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:56.032 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:56.031+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 0x7f79a4013840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:56.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:56.832+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400cb10 legacy=0x7f79a4013d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:56.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:56.832+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 msgr2=0x7f79a4013840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:54:56.833 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:56.832+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 0x7f79a4013840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:58.431 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.430+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 msgr2=0x7f79a4013840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:58.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.430+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1d0 0x7f79a4013840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:58.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.430+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400cb10 legacy=0x7f79a4013d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:58.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.430+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:54:58.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.430+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4006250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:58.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.430+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:58.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.430+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a400a1b0 2023-11-04T01:54:58.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.430+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400c730 2023-11-04T01:54:58.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.430+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a400aab0 2023-11-04T01:54:58.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.430+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:58.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.430+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:58.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.430+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a400e810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:58.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.430+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:58.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.430+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:58.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.631+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:58.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.631+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a400e810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:58.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.631+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:58.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.631+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:58.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:58.631+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:59.032+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:59.032+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a400e810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:59.032+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:59.032+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:59.032+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:59.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:59.833+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a400e810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:54:59.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:59.833+0000 7f79b77fe640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:54:59.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:59.833+0000 7f79b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:59.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:59.834+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:54:59.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:54:59.834+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:01.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:01.430+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:01.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:01.430+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400aab0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:01.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:01.430+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 msgr2=0x7f79a4006250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:01.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:01.430+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c730 0x7f79a4006250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:01.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:01.430+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a400e810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:01.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:01.430+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400cb10 0x7f79a400c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:01.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:01.430+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b4750 con 0x7f79a400d1a0 2023-11-04T01:55:01.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:01.430+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400cb10 2023-11-04T01:55:01.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:01.431+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400cb10 msgr2=0x7f79a400c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:01.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:01.431+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400cb10 0x7f79a400c020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:01.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:01.431+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400d1a0 legacy=0x7f79a400ef20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:01.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:01.632+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400d1a0 legacy=0x7f79a400ef20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:01.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:01.632+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400cb10 msgr2=0x7f79a400c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:01.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:01.632+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400cb10 0x7f79a400c020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:02.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:02.033+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400cb10 msgr2=0x7f79a400c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:02.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:02.033+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400d1a0 legacy=0x7f79a400ef20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:02.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:02.033+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400cb10 0x7f79a400c020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:02.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:02.834+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400d1a0 legacy=0x7f79a400ef20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:02.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:02.834+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400cb10 msgr2=0x7f79a400c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:02.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:02.834+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400cb10 0x7f79a400c020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:04.274 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:04.277 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:04.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.431+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400cb10 msgr2=0x7f79a400c020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.431+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400cb10 0x7f79a400c020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.431+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400d1a0 legacy=0x7f79a400ef20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.431+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:55:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.431+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1a0 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.431+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a400a1b0 2023-11-04T01:55:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.431+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b4750 con 0x7f79a400aab0 2023-11-04T01:55:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.431+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400d1a0 2023-11-04T01:55:04.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.431+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a400e810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:04.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.431+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4006230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:04.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.431+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1a0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:04.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.431+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1a0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:04.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.632+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a400e810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:04.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.632+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4006230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:04.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.632+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1a0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:04.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:04.632+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1a0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:05.033+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a400e810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:05.033+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4006230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:05.033+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1a0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:05.033+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1a0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:05.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:05.834+0000 7f79b77fe640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a400e810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:05.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:05.834+0000 7f79b7fff640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1a0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:05.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:05.834+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4006230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:05.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:05.834+0000 7f79b7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1a0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:07.432 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.431+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1a0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:07.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.431+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400d1a0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:07.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.431+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400aab0 legacy=0x7f79a4006230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:07.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.431+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400a1b0 legacy=0x7f79a400e810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:07.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.431+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c020 0x7f79a4013f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:07.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.431+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c460 0x7f79a400c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:07.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.431+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400c460 2023-11-04T01:55:07.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.431+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a400c020 2023-11-04T01:55:07.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.431+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c460 msgr2=0x7f79a400c870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:07.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.431+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c460 0x7f79a400c870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:07.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.431+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c020 msgr2=0x7f79a4013f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:07.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.431+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c020 0x7f79a4013f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:07.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.632+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c460 msgr2=0x7f79a400c870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:07.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.632+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c460 0x7f79a400c870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:07.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.632+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c020 msgr2=0x7f79a4013f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:07.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:07.632+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c020 0x7f79a4013f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:08.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:08.033+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c460 msgr2=0x7f79a400c870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:08.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:08.033+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c460 0x7f79a400c870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:08.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:08.033+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c020 msgr2=0x7f79a4013f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:08.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:08.033+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c020 0x7f79a4013f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:08.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:08.834+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c460 msgr2=0x7f79a400c870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:08.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:08.834+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c460 0x7f79a400c870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:08.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:08.834+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c020 msgr2=0x7f79a4013f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:08.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:08.834+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c020 0x7f79a4013f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:10.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.430+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c020 msgr2=0x7f79a4013f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:10.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.430+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c020 0x7f79a4013f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:10.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.430+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c460 msgr2=0x7f79a400c870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:10.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.430+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400c460 0x7f79a400c870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.430+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:55:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.430+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.430+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1a0 0x7f79a400c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.430+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a4014ec0 con 0x7f79a400aa60 2023-11-04T01:55:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.430+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400a1b0 2023-11-04T01:55:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.430+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a400d1a0 2023-11-04T01:55:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.430+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aa60 legacy=0x7f79a4006210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.431+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.431+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1a0 msgr2=0x7f79a400c840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.431+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.431+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1a0 0x7f79a400c840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:10.633 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.631+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aa60 legacy=0x7f79a4006210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:10.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.632+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1a0 msgr2=0x7f79a400c840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:10.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.632+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:10.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.632+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1a0 0x7f79a400c840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:10.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:10.632+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:11.033 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:11.032+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aa60 legacy=0x7f79a4006210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:11.034 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:11.033+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:11.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:11.033+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1a0 msgr2=0x7f79a400c840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:11.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:11.033+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:11.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:11.033+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1a0 0x7f79a400c840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:11.834 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:11.833+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aa60 legacy=0x7f79a4006210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:11.834+0000 7f79b6ffd640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1a0 msgr2=0x7f79a400c840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:11.834+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:11.834+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:11.834+0000 7f79b6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1a0 0x7f79a400c840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:13.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:13.431+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1a0 msgr2=0x7f79a400c840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:13.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:13.431+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400d1a0 0x7f79a400c840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:13.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:13.431+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:13.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:13.431+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:13.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:13.431+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aa60 legacy=0x7f79a4006210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:13.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:13.431+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4015050 0x7f79a4017440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:13.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:13.431+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a4010820 2023-11-04T01:55:13.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:13.431+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a4015050 2023-11-04T01:55:13.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:13.431+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4015050 msgr2=0x7f79a4017440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:13.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:13.431+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4015050 0x7f79a4017440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:13.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:13.431+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4010820 legacy=0x7f79a4012c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:13.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:13.632+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4015050 msgr2=0x7f79a4017440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:13.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:13.632+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4015050 0x7f79a4017440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:13.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:13.632+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4010820 legacy=0x7f79a4012c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:14.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:14.033+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4015050 msgr2=0x7f79a4017440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:14.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:14.033+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4015050 0x7f79a4017440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:14.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:14.033+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4010820 legacy=0x7f79a4012c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:14.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:14.834+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4015050 msgr2=0x7f79a4017440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:14.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:14.834+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4015050 0x7f79a4017440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:14.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:14.834+0000 7f79b77fe640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4010820 legacy=0x7f79a4012c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:16.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.431+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4015050 msgr2=0x7f79a4017440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:16.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.431+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4015050 0x7f79a4017440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:16.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.431+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a4010820 legacy=0x7f79a4012c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:16.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.431+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:55:16.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.431+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:16.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.431+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a4014ec0 con 0x7f79a400aa60 2023-11-04T01:55:16.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.431+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b32b0 con 0x7f79a400d1a0 2023-11-04T01:55:16.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.431+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400a1b0 2023-11-04T01:55:16.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.431+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aa60 legacy=0x7f79a40061e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:16.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.431+0000 7f79b7fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400d1a0 legacy=0x7f79a4003aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:16.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.431+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:16.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.431+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:16.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.632+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aa60 legacy=0x7f79a40061e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:16.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.632+0000 7f79b7fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400d1a0 legacy=0x7f79a4003aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:16.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.632+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:16.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:16.632+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:17.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:17.033+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aa60 legacy=0x7f79a40061e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:17.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:17.033+0000 7f79b7fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400d1a0 legacy=0x7f79a4003aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:17.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:17.033+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:17.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:17.033+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:17.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:17.834+0000 7f79b6ffd640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aa60 legacy=0x7f79a40061e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:17.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:17.834+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:17.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:17.834+0000 7f79b7fff640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400d1a0 legacy=0x7f79a4003aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:17.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:17.834+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:19.433 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.431+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:19.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.431+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:19.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.431+0000 7f79b57fa640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400d1a0 legacy=0x7f79a4003aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:19.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.431+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400aa60 legacy=0x7f79a40061e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:19.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.431+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c840 0x7f79a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:19.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.431+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4005700 0x7f79a4012c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:19.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.431+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a4005700 2023-11-04T01:55:19.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.431+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a400c840 2023-11-04T01:55:19.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.431+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4005700 msgr2=0x7f79a4012c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:19.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.431+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4005700 0x7f79a4012c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:19.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.431+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c840 msgr2=0x7f79a40051c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:19.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.431+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c840 0x7f79a40051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:19.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.632+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4005700 msgr2=0x7f79a4012c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:19.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.632+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4005700 0x7f79a4012c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:19.634 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.632+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c840 msgr2=0x7f79a40051c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:19.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:19.632+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c840 0x7f79a40051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:20.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:20.033+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4005700 msgr2=0x7f79a4012c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:20.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:20.033+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4005700 0x7f79a4012c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:20.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:20.033+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c840 msgr2=0x7f79a40051c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:20.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:20.033+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c840 0x7f79a40051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:20.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:20.834+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4005700 msgr2=0x7f79a4012c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:20.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:20.834+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4005700 0x7f79a4012c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:20.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:20.834+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c840 msgr2=0x7f79a40051c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:20.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:20.834+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c840 0x7f79a40051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:22.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.432+0000 7f79b57fa640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c840 msgr2=0x7f79a40051c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:22.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.432+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400c840 0x7f79a40051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:22.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.432+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a4005700 msgr2=0x7f79a4012c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:22.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.432+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a4005700 0x7f79a4012c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:22.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.432+0000 7f79b7fff640 1 -- reap_dead start 2023-11-04T01:55:22.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.432+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:22.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.432+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aa60 0x7f79a40061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:22.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.432+0000 7f79b57fa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80b4750 con 0x7f79a400d1a0 2023-11-04T01:55:22.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.432+0000 7f79b57fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400aa60 2023-11-04T01:55:22.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.432+0000 7f79b57fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a400e6a0 con 0x7f79a400a1b0 2023-11-04T01:55:22.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.432+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400d1a0 legacy=0x7f79a400b010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:22.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.432+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aa60 msgr2=0x7f79a40061e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:22.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.432+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aa60 0x7f79a40061e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:22.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.432+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:22.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.432+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:22.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.633+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400d1a0 legacy=0x7f79a400b010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:22.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.633+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aa60 msgr2=0x7f79a40061e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:22.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.633+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aa60 0x7f79a40061e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:22.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.633+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:22.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:22.633+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:23.034+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400d1a0 legacy=0x7f79a400b010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:23.034+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aa60 msgr2=0x7f79a40061e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:23.034+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aa60 0x7f79a40061e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:23.034+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:23.034+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:23.835+0000 7f79b7fff640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400d1a0 legacy=0x7f79a400b010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.44:6789/0 2023-11-04T01:55:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:23.835+0000 7f79b6ffd640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aa60 msgr2=0x7f79a40061e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.44:3300/0 2023-11-04T01:55:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:23.835+0000 7f79b6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aa60 0x7f79a40061e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:23.835+0000 7f79b77fe640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3300/0 2023-11-04T01:55:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:23.835+0000 7f79b77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:25.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:25.432+0000 7f79b57fa640 1 -- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 msgr2=0x7f79a400db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:25.434 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:25.432+0000 7f79b57fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79a400a1b0 0x7f79a400db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:25.432+0000 7f79b57fa640 1 -- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aa60 msgr2=0x7f79a40061e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:25.432+0000 7f79b57fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f79a400aa60 0x7f79a40061e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:25.432+0000 7f79b57fa640 1 -- >> v1:172.21.15.44:6789/0 conn(0x7f79a400d1a0 legacy=0x7f79a400b010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:25.432+0000 7f79b57fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400b720 0x7f79a4013c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:25.432+0000 7f79b57fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a4014ec0 con 0x7f79a400bb00 2023-11-04T01:55:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:25.432+0000 7f79b57fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80cee10 con 0x7f79a400b720 2023-11-04T01:55:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:25.432+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400b720 msgr2=0x7f79a4013c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:25.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:25.432+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400bb00 legacy=0x7f79a4003aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:25.436 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:25.432+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400b720 0x7f79a4013c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:25.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:25.633+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400bb00 legacy=0x7f79a4003aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:25.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:25.633+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400b720 msgr2=0x7f79a4013c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:25.635 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:25.633+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400b720 0x7f79a4013c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:26.035 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:26.034+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400bb00 legacy=0x7f79a4003aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:26.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:26.034+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400b720 msgr2=0x7f79a4013c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:26.036 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:26.034+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400b720 0x7f79a4013c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:26.836 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:26.835+0000 7f79b6ffd640 1 -- >> v1:172.21.15.204:6789/0 conn(0x7f79a400bb00 legacy=0x7f79a4003aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.204:6789/0 2023-11-04T01:55:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:26.835+0000 7f79b77fe640 1 -- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400b720 msgr2=0x7f79a4013c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.204:3301/0 2023-11-04T01:55:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-04T01:55:26.835+0000 7f79b77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79a400b720 0x7f79a4013c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:28.346 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:55:28.347 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:55:28.358 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-04T01:55:28.358 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:55:28.358 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.361 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:55:28.361 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:55:28.361 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:28.361 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:55:28.373 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:55:28.373 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:55:28.373 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.373 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:55:28.374 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:55:28.374 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.374 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:55:28.374 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-04T01:55:28.374 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-04T01:55:28.374 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.375 INFO:tasks.ceph.osd.0:Stopped 2023-11-04T01:55:28.375 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-04T01:55:28.375 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.375 INFO:tasks.ceph.osd.1:Stopped 2023-11-04T01:55:28.375 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-04T01:55:28.375 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.376 INFO:tasks.ceph.osd.2:Stopped 2023-11-04T01:55:28.376 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-04T01:55:28.376 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.376 INFO:tasks.ceph.osd.3:Stopped 2023-11-04T01:55:28.376 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-04T01:55:28.376 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.376 INFO:tasks.ceph.osd.4:Stopped 2023-11-04T01:55:28.377 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-04T01:55:28.377 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.377 INFO:tasks.ceph.osd.5:Stopped 2023-11-04T01:55:28.377 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-04T01:55:28.377 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.378 INFO:tasks.ceph.osd.6:Stopped 2023-11-04T01:55:28.378 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-04T01:55:28.378 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.378 INFO:tasks.ceph.osd.7:Stopped 2023-11-04T01:55:28.379 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-04T01:55:28.379 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-04T01:55:28.379 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:28.379 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2023-11-04T01:55:28.392 INFO:tasks.ceph.mgr.y:Stopped 2023-11-04T01:55:28.392 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-04T01:55:28.392 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.393 INFO:tasks.ceph.mgr.x:Stopped 2023-11-04T01:55:28.393 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-04T01:55:28.393 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-04T01:55:28.393 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.393 INFO:tasks.ceph.mon.a:Stopped 2023-11-04T01:55:28.394 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-04T01:55:28.394 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.394 INFO:tasks.ceph.mon.b:Stopped 2023-11-04T01:55:28.394 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-04T01:55:28.394 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:28.394 INFO:tasks.ceph.mon.c:Stopped 2023-11-04T01:55:28.395 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-04T01:55:28.395 DEBUG:teuthology.orchestra.run.smithi044:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v RECENT_CRASH | head -n 1 2023-11-04T01:55:28.440 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:55:28.441 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-04T01:55:28.555 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:55:28.555 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-04T01:55:28.650 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:55:28.651 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-04T01:55:28.712 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:55:28.712 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-04T01:55:28.769 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:55:28.769 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-04T01:55:28.824 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:55:28.825 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-04T01:55:28.891 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:55:28.891 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-04T01:55:28.967 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:55:28.967 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-04T01:55:29.025 INFO:tasks.ceph:Archiving mon data... 2023-11-04T01:55:29.027 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916/data/mon.a.tgz 2023-11-04T01:55:29.027 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2023-11-04T01:55:29.043 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.UjorjwptCT 2023-11-04T01:55:29.043 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.UjorjwptCT 2023-11-04T01:55:29.204 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.UjorjwptCT 2023-11-04T01:55:29.293 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.UjorjwptCT is 381KB 2023-11-04T01:55:29.361 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.UjorjwptCT 2023-11-04T01:55:29.376 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916/data/mon.b.tgz 2023-11-04T01:55:29.377 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2023-11-04T01:55:29.394 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.LfhEiP6lD3 2023-11-04T01:55:29.395 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.LfhEiP6lD3 2023-11-04T01:55:29.553 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.LfhEiP6lD3 2023-11-04T01:55:29.638 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.LfhEiP6lD3 is 386KB 2023-11-04T01:55:29.735 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.LfhEiP6lD3 2023-11-04T01:55:29.750 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916/data/mon.c.tgz 2023-11-04T01:55:29.750 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2023-11-04T01:55:29.804 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.ttISAifBMl 2023-11-04T01:55:29.804 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ttISAifBMl 2023-11-04T01:55:29.946 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.ttISAifBMl 2023-11-04T01:55:30.032 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.ttISAifBMl is 386KB 2023-11-04T01:55:30.131 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.ttISAifBMl 2023-11-04T01:55:30.146 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-04T01:55:30.146 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-04T01:55:30.149 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-04T01:55:30.211 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-04T01:55:30.212 DEBUG:teuthology.orchestra.run.smithi044:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-04T01:55:30.223 DEBUG:teuthology.orchestra.run.smithi204:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-04T01:55:30.255 INFO:teuthology.orchestra.run.smithi044.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-04T01:55:30.280 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-04T01:55:30.284 INFO:tasks.ceph:Archiving crash dumps... 2023-11-04T01:55:30.285 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916/remote/smithi044/crash 2023-11-04T01:55:30.286 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-04T01:55:30.409 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916/remote/smithi204/crash 2023-11-04T01:55:30.410 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-04T01:55:30.484 INFO:tasks.ceph:Shutting down logrotate 2023-11-04T01:55:30.485 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:30.488 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:30.552 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:30.583 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:30.612 INFO:tasks.ceph:Compressing logs... 2023-11-04T01:55:30.612 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-04T01:55:30.625 DEBUG:teuthology.orchestra.run.smithi204:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-04T01:55:30.698 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-04T01:55:30.698 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.124612.log 2023-11-04T01:55:30.698 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118735.log 2023-11-04T01:55:30.698 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.1.124612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118535.log 2023-11-04T01:55:30.698 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.118735.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-04T01:55:30.698 INFO:teuthology.orchestra.run.smithi204.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118735.log.gz 2023-11-04T01:55:30.699 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-04T01:55:30.699 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.118535.log: /var/log/ceph/ceph.audit.log: gzip -5 91.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.1.124612.log.gz /var/log/ceph/ceph-client.admin.118575.log 2023-11-04T01:55:30.699 INFO:teuthology.orchestra.run.smithi204.stderr: 2023-11-04T01:55:30.699 INFO:teuthology.orchestra.run.smithi204.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118535.log.gz 2023-11-04T01:55:30.699 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-04T01:55:30.699 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.118575.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-04T01:55:30.699 INFO:teuthology.orchestra.run.smithi204.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118575.log.gz 2023-11-04T01:55:30.699 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-04T01:55:30.699 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118615.log 2023-11-04T01:55:30.700 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118655.log 2023-11-04T01:55:30.700 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.118615.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.118615.log.gz 2023-11-04T01:55:30.700 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.118655.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-04T01:55:30.700 INFO:teuthology.orchestra.run.smithi204.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118655.log.gz 2023-11-04T01:55:30.700 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.125064.log 2023-11-04T01:55:30.700 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118494.log 2023-11-04T01:55:30.700 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.3.125064.log: 93.5% 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-04T01:55:30.700 INFO:teuthology.orchestra.run.smithi204.stderr: -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-04T01:55:30.700 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118454.log 2023-11-04T01:55:30.701 INFO:teuthology.orchestra.run.smithi204.stderr: 91.4%/var/log/ceph/ceph-client.admin.118494.log: -- replaced with /var/log/ceph/ceph-client.3.125064.log.gz 2023-11-04T01:55:30.701 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-04T01:55:30.701 INFO:teuthology.orchestra.run.smithi204.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118494.log.gz 2023-11-04T01:55:30.701 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-04T01:55:30.701 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.118454.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-04T01:55:30.701 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mon.b.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.118454.log.gz 2023-11-04T01:55:30.701 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118695.log 2023-11-04T01:55:30.701 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mds.d.log: 93.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-04T01:55:30.702 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-04T01:55:30.702 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.118695.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.118695.log.gz 2023-11-04T01:55:30.770 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mon.c.log: 91.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-04T01:55:30.855 INFO:teuthology.orchestra.run.smithi204.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-04T01:55:30.889 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128443.log 2023-11-04T01:55:30.889 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107225.log 2023-11-04T01:55:30.889 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103531.log 2023-11-04T01:55:30.889 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.107225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105699.log 2023-11-04T01:55:30.889 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128443.log.gz 2023-11-04T01:55:30.889 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103531.log: gzip -5 88.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.107225.log.gz 2023-11-04T01:55:30.890 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.104445.log 2023-11-04T01:55:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105699.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103531.log.gz 2023-11-04T01:55:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88261.log 2023-11-04T01:55:30.890 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105699.log.gz 2023-11-04T01:55:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120428.log 2023-11-04T01:55:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.88261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127811.log 2023-11-04T01:55:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.120428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97457.log 2023-11-04T01:55:30.890 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88261.log.gz 2023-11-04T01:55:30.891 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.104445.log.gz 2023-11-04T01:55:30.891 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.127811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95735.log 2023-11-04T01:55:30.891 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97457.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127811.log.gz 2023-11-04T01:55:30.891 INFO:teuthology.orchestra.run.smithi044.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.120428.log.gz 2023-11-04T01:55:30.891 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129523.log 2023-11-04T01:55:30.891 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97457.log.gz 2023-11-04T01:55:30.891 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106011.log 2023-11-04T01:55:30.891 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.129523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103787.log 2023-11-04T01:55:30.892 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95735.log.gz 2023-11-04T01:55:30.892 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100853.log 2023-11-04T01:55:30.892 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106011.log.gz 2023-11-04T01:55:30.892 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109042.log 2023-11-04T01:55:30.892 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105089.log 2023-11-04T01:55:30.892 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103787.log.gz 2023-11-04T01:55:30.892 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109042.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100853.log.gz 2023-11-04T01:55:30.892 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-04T01:55:30.892 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109042.log.gz 2023-11-04T01:55:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101273.log 2023-11-04T01:55:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95609.log 2023-11-04T01:55:30.893 INFO:teuthology.orchestra.run.smithi044.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.105089.log.gz 2023-11-04T01:55:30.893 INFO:teuthology.orchestra.run.smithi044.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.129523.log.gz 2023-11-04T01:55:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117346.log 2023-11-04T01:55:30.893 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101273.log.gz 2023-11-04T01:55:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102132.log 2023-11-04T01:55:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.117346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102468.log 2023-11-04T01:55:30.893 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95609.log.gz 2023-11-04T01:55:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102132.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117346.log.gz 2023-11-04T01:55:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106773.log 2023-11-04T01:55:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102468.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102132.log.gz 2023-11-04T01:55:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95987.log 2023-11-04T01:55:30.894 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102468.log.gz 2023-11-04T01:55:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106138.log 2023-11-04T01:55:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108435.log 2023-11-04T01:55:30.894 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106773.log.gz 2023-11-04T01:55:30.895 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95987.log.gz 2023-11-04T01:55:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121815.log 2023-11-04T01:55:30.895 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106138.log.gz 2023-11-04T01:55:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96833.log 2023-11-04T01:55:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102678.log 2023-11-04T01:55:30.895 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108435.log.gz 2023-11-04T01:55:30.895 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121815.log.gz 2023-11-04T01:55:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108645.log 2023-11-04T01:55:30.896 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96833.log.gz 2023-11-04T01:55:30.896 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119489.log 2023-11-04T01:55:30.896 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109941.log 2023-11-04T01:55:30.896 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102678.log.gz 2023-11-04T01:55:30.896 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119489.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108645.log.gz 2023-11-04T01:55:30.896 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120138.log 2023-11-04T01:55:30.896 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119489.log.gz 2023-11-04T01:55:30.896 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122460.log 2023-11-04T01:55:30.896 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.120138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121370.log 2023-11-04T01:55:30.897 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.109941.log.gz 2023-11-04T01:55:30.897 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120138.log.gz 2023-11-04T01:55:30.897 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122810.log 2023-11-04T01:55:30.897 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122460.log.gz 2023-11-04T01:55:30.897 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117920.log 2023-11-04T01:55:30.897 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111524.log 2023-11-04T01:55:30.897 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.121370.log.gz 2023-11-04T01:55:30.897 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.122810.log.gz 2023-11-04T01:55:30.897 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.117920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97541.log 2023-11-04T01:55:30.898 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117920.log.gz 2023-11-04T01:55:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128012.log 2023-11-04T01:55:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93711.log 2023-11-04T01:55:30.898 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.111524.log.gz 2023-11-04T01:55:30.898 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97541.log.gz 2023-11-04T01:55:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110321.log 2023-11-04T01:55:30.898 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128012.log.gz 2023-11-04T01:55:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113666.log 2023-11-04T01:55:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118498.log 2023-11-04T01:55:30.899 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93711.log.gz 2023-11-04T01:55:30.899 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110321.log.gz 2023-11-04T01:55:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109431.log 2023-11-04T01:55:30.899 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113666.log.gz 2023-11-04T01:55:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114283.log 2023-11-04T01:55:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102762.log 2023-11-04T01:55:30.899 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118498.log.gz 2023-11-04T01:55:30.899 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109431.log.gz 2023-11-04T01:55:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.114283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115290.log 2023-11-04T01:55:30.900 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108897.log 2023-11-04T01:55:30.900 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102762.log.gz 2023-11-04T01:55:30.900 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125862.log 2023-11-04T01:55:30.900 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115290.log.gz 2023-11-04T01:55:30.900 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105909.log 2023-11-04T01:55:30.900 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108897.log.gz 2023-11-04T01:55:30.900 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95404.log 2023-11-04T01:55:30.900 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.125862.log: /var/log/ceph/ceph-client.admin.105909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127970.log 2023-11-04T01:55:30.901 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125862.log.gz 2023-11-04T01:55:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95404.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.105909.log.gz 2023-11-04T01:55:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111440.log 2023-11-04T01:55:30.901 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95404.log.gz 2023-11-04T01:55:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.127970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106222.log 2023-11-04T01:55:30.901 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127970.log.gz 2023-11-04T01:55:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119657.log 2023-11-04T01:55:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111440.log: /var/log/ceph/ceph-client.admin.106222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124354.log 2023-11-04T01:55:30.901 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111440.log.gz 2023-11-04T01:55:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119657.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.106222.log.gz 2023-11-04T01:55:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125038.log 2023-11-04T01:55:30.902 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119657.log.gz 2023-11-04T01:55:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110615.log 2023-11-04T01:55:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124354.log: 92.5% -- replaced with /var/log/ceph/ceph-client.0.114283.log.gz 2023-11-04T01:55:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.125038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93669.log 2023-11-04T01:55:30.902 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.124354.log.gz 2023-11-04T01:55:30.902 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3%/var/log/ceph/ceph-client.admin.110615.log: -- replaced with /var/log/ceph/ceph-client.admin.125038.log.gz 2023-11-04T01:55:30.903 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102888.log 2023-11-04T01:55:30.903 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93669.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110615.log.gz 2023-11-04T01:55:30.903 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.127524.log 2023-11-04T01:55:30.903 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93669.log.gz 2023-11-04T01:55:30.903 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124270.log 2023-11-04T01:55:30.903 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.127524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126803.log 2023-11-04T01:55:30.903 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102888.log.gz 2023-11-04T01:55:30.903 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120036.log 2023-11-04T01:55:30.903 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124270.log.gz 2023-11-04T01:55:30.904 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124743.log 2023-11-04T01:55:30.904 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128711.log 2023-11-04T01:55:30.904 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.120036.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126803.log.gz 2023-11-04T01:55:30.904 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109084.log 2023-11-04T01:55:30.904 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120036.log.gz 2023-11-04T01:55:30.904 INFO:teuthology.orchestra.run.smithi044.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.124743.log.gz 2023-11-04T01:55:30.904 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95320.log 2023-11-04T01:55:30.904 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128711.log: /var/log/ceph/ceph-client.admin.109084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127769.log 2023-11-04T01:55:30.904 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.128711.log.gz 2023-11-04T01:55:30.905 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95320.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.109084.log.gz 2023-11-04T01:55:30.905 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128485.log 2023-11-04T01:55:30.905 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95320.log.gz 2023-11-04T01:55:30.905 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.127769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113918.log 2023-11-04T01:55:30.905 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105335.log 2023-11-04T01:55:30.905 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128485.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127769.log.gz 2023-11-04T01:55:30.905 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106390.log 2023-11-04T01:55:30.905 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128485.log.gz 2023-11-04T01:55:30.905 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113918.log.gz 2023-11-04T01:55:30.906 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99055.log 2023-11-04T01:55:30.906 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105335.log: /var/log/ceph/ceph-client.admin.106390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115951.log 2023-11-04T01:55:30.906 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105335.log.gz 2023-11-04T01:55:30.906 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101575.log 2023-11-04T01:55:30.906 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106390.log.gz 2023-11-04T01:55:30.906 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99055.log.gz 2023-11-04T01:55:30.906 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95278.log 2023-11-04T01:55:30.906 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115951.log.gz 2023-11-04T01:55:30.907 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124543.log 2023-11-04T01:55:30.907 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101575.log: /var/log/ceph/ceph-client.admin.95278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127131.log 2023-11-04T01:55:30.907 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101575.log.gz 2023-11-04T01:55:30.907 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95278.log.gz 2023-11-04T01:55:30.907 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97079.log 2023-11-04T01:55:30.907 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101021.log 2023-11-04T01:55:30.907 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124543.log.gz 2023-11-04T01:55:30.907 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.127131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121004.log 2023-11-04T01:55:30.907 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97079.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127131.log.gz 2023-11-04T01:55:30.908 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101021.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97079.log.gz 2023-11-04T01:55:30.908 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101105.log 2023-11-04T01:55:30.908 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101021.log.gz 2023-11-04T01:55:30.908 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103699.log 2023-11-04T01:55:30.908 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107351.log 2023-11-04T01:55:30.908 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.121004.log.gz 2023-11-04T01:55:30.908 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103699.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101105.log.gz 2023-11-04T01:55:30.908 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125720.log 2023-11-04T01:55:30.908 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.107351.log: -- /var/log/ceph/ceph-client.admin.108323.log 2023-11-04T01:55:30.909 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103699.log.gz 2023-11-04T01:55:30.909 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.125720.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107351.log.gz 2023-11-04T01:55:30.909 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112495.log 2023-11-04T01:55:30.909 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103657.log 2023-11-04T01:55:30.909 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108323.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125720.log.gz 2023-11-04T01:55:30.909 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121763.log 2023-11-04T01:55:30.909 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108323.log.gz 2023-11-04T01:55:30.909 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96488.log 2023-11-04T01:55:30.910 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112495.log.gz 2023-11-04T01:55:30.910 INFO:teuthology.orchestra.run.smithi044.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.0.127524.log.gz 2023-11-04T01:55:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121763.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103657.log.gz 2023-11-04T01:55:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124218.log 2023-11-04T01:55:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96488.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.121763.log.gz 2023-11-04T01:55:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115993.log 2023-11-04T01:55:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111846.log 2023-11-04T01:55:30.910 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96488.log.gz 2023-11-04T01:55:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115993.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124218.log.gz 2023-11-04T01:55:30.911 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96158.log 2023-11-04T01:55:30.911 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115993.log.gz 2023-11-04T01:55:30.911 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109294.log 2023-11-04T01:55:30.911 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111846.log: /var/log/ceph/ceph-client.admin.96158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107037.log 2023-11-04T01:55:30.911 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.111846.log.gz 2023-11-04T01:55:30.911 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109294.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96158.log.gz -5 2023-11-04T01:55:30.911 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.126921.log 2023-11-04T01:55:30.911 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109294.log.gz 2023-11-04T01:55:30.912 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.107037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115374.log 2023-11-04T01:55:30.912 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102300.log 2023-11-04T01:55:30.912 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107037.log.gz 2023-11-04T01:55:30.912 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116544.log 2023-11-04T01:55:30.912 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126921.log.gz 2023-11-04T01:55:30.912 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115374.log.gz 2023-11-04T01:55:30.912 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125820.log 2023-11-04T01:55:30.912 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122082.log 2023-11-04T01:55:30.912 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102300.log.gz 2023-11-04T01:55:30.913 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.116544.log.gz 2023-11-04T01:55:30.913 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.125820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115626.log 2023-11-04T01:55:30.913 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110025.log 2023-11-04T01:55:30.913 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125820.log.gz 2023-11-04T01:55:30.913 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122082.log.gz 2023-11-04T01:55:30.913 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128527.log 2023-11-04T01:55:30.913 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115626.log.gz 2023-11-04T01:55:30.913 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106054.log 2023-11-04T01:55:30.913 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128527.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.114716.log 2023-11-04T01:55:30.914 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.110025.log.gz 2023-11-04T01:55:30.914 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128527.log.gz 2023-11-04T01:55:30.914 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97583.log 2023-11-04T01:55:30.914 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106054.log.gz 2023-11-04T01:55:30.914 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.114716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97163.log 2023-11-04T01:55:30.914 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114926.log 2023-11-04T01:55:30.914 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114716.log.gz 2023-11-04T01:55:30.914 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97583.log.gz 2023-11-04T01:55:30.914 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103117.log 2023-11-04T01:55:30.915 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110872.log 2023-11-04T01:55:30.915 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.114926.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.97163.log.gz 2023-11-04T01:55:30.915 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112266.log 2023-11-04T01:55:30.915 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.114926.log.gz 2023-11-04T01:55:30.915 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.110872.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103117.log.gz 2023-11-04T01:55:30.915 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105783.log 2023-11-04T01:55:30.915 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108855.log 2023-11-04T01:55:30.915 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112266.log.gz 2023-11-04T01:55:30.915 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102426.log 2023-11-04T01:55:30.916 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.0.110872.log.gz 2023-11-04T01:55:30.916 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103197.log 2023-11-04T01:55:30.916 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108855.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105783.log.gz 2023-11-04T01:55:30.916 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107309.log 2023-11-04T01:55:30.916 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108855.log.gz 2023-11-04T01:55:30.916 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103197.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102426.log.gz 2023-11-04T01:55:30.916 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94081.log 2023-11-04T01:55:30.916 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.107309.log: gzip 87.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.103197.log.gz -- 2023-11-04T01:55:30.917 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.105167.log 2023-11-04T01:55:30.917 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107309.log.gz 2023-11-04T01:55:30.917 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124647.log 2023-11-04T01:55:30.917 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94081.log.gz 2023-11-04T01:55:30.917 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97205.log 2023-11-04T01:55:30.917 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105167.log.gz 2023-11-04T01:55:30.917 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128569.log 2023-11-04T01:55:30.917 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8%/var/log/ceph/ceph-client.admin.97205.log: -- replaced with /var/log/ceph/ceph-client.admin.124647.log.gzgzip 2023-11-04T01:55:30.917 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.99727.log 2023-11-04T01:55:30.918 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99685.log 2023-11-04T01:55:30.918 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97205.log.gz 2023-11-04T01:55:30.918 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117070.log 2023-11-04T01:55:30.918 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128569.log.gz 2023-11-04T01:55:30.918 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99685.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.99727.log.gz 2023-11-04T01:55:30.918 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96167.log 2023-11-04T01:55:30.918 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99685.log.gz 2023-11-04T01:55:30.918 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.117070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94399.log 2023-11-04T01:55:30.918 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96167.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117070.log.gz 2023-11-04T01:55:30.919 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99307.log 2023-11-04T01:55:30.919 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93627.log 2023-11-04T01:55:30.919 INFO:teuthology.orchestra.run.smithi044.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.96167.log.gz 2023-11-04T01:55:30.919 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99307.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94399.log.gz 2023-11-04T01:55:30.919 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97897.log 2023-11-04T01:55:30.919 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99307.log.gz 2023-11-04T01:55:30.919 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98404.log 2023-11-04T01:55:30.919 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97897.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93627.log.gz 2023-11-04T01:55:30.919 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111181.log 2023-11-04T01:55:30.920 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97897.log.gz 2023-11-04T01:55:30.920 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.98404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108519.log 2023-11-04T01:55:30.920 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126417.log 2023-11-04T01:55:30.920 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98404.log.gz 2023-11-04T01:55:30.920 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108519.log: gzip 90.0% -- replaced with /var/log/ceph/ceph-client.admin.111181.log.gz -5 2023-11-04T01:55:30.920 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.106995.log 2023-11-04T01:55:30.920 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108519.log.gz 2023-11-04T01:55:30.920 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119346.log 2023-11-04T01:55:30.921 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123778.log 2023-11-04T01:55:30.921 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.126417.log.gz 2023-11-04T01:55:30.921 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106995.log.gz 2023-11-04T01:55:30.921 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114542.log 2023-11-04T01:55:30.921 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119346.log.gz 2023-11-04T01:55:30.921 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.123778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128879.log 2023-11-04T01:55:30.921 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.114542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101315.log 2023-11-04T01:55:30.921 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123778.log.gz 2023-11-04T01:55:30.921 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114542.log.gz 2023-11-04T01:55:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106348.log 2023-11-04T01:55:30.922 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128879.log.gz 2023-11-04T01:55:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102090.log 2023-11-04T01:55:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116035.log 2023-11-04T01:55:30.922 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101315.log.gz 2023-11-04T01:55:30.922 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106348.log.gz 2023-11-04T01:55:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99937.log 2023-11-04T01:55:30.922 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102090.log.gz 2023-11-04T01:55:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110195.log 2023-11-04T01:55:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99937.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116035.log.gz 2023-11-04T01:55:30.923 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99937.log.gz 2023-11-04T01:55:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96168.log 2023-11-04T01:55:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109983.log 2023-11-04T01:55:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113834.log 2023-11-04T01:55:30.923 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110195.log.gz 2023-11-04T01:55:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109983.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.114673.log 2023-11-04T01:55:30.923 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96168.log.gz 2023-11-04T01:55:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127089.log 2023-11-04T01:55:30.924 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109983.log.gz 2023-11-04T01:55:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.114673.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113834.log.gz 2023-11-04T01:55:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97667.log 2023-11-04T01:55:30.924 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114673.log.gz 2023-11-04T01:55:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.127089.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.111482.log 2023-11-04T01:55:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109252.log 2023-11-04T01:55:30.924 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127089.log.gz 2023-11-04T01:55:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111482.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97667.log.gz 2023-11-04T01:55:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110111.log 2023-11-04T01:55:30.925 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111482.log.gz 2023-11-04T01:55:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103743.log 2023-11-04T01:55:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101717.log 2023-11-04T01:55:30.925 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109252.log.gz 2023-11-04T01:55:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103743.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110111.log.gz 2023-11-04T01:55:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93951.log 2023-11-04T01:55:30.925 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103743.log.gz 2023-11-04T01:55:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94333.log 2023-11-04T01:55:30.926 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99643.log 2023-11-04T01:55:30.926 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101717.log.gz 2023-11-04T01:55:30.926 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94333.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93951.log.gz 2023-11-04T01:55:30.926 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.111398.log 2023-11-04T01:55:30.926 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103879.log 2023-11-04T01:55:30.926 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.94333.log.gz 2023-11-04T01:55:30.926 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111398.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99643.log.gz 2023-11-04T01:55:30.926 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117196.log 2023-11-04T01:55:30.926 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110237.log 2023-11-04T01:55:30.927 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103879.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111398.log.gz 2023-11-04T01:55:30.927 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.117196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118867.log 2023-11-04T01:55:30.927 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103879.log.gz 2023-11-04T01:55:30.927 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128401.log 2023-11-04T01:55:30.927 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117196.log.gz 2023-11-04T01:55:30.927 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110237.log.gz 2023-11-04T01:55:30.927 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118540.log 2023-11-04T01:55:30.927 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118867.log: /var/log/ceph/ceph-client.admin.128401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94249.log 2023-11-04T01:55:30.928 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118867.log.gz 2023-11-04T01:55:30.928 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118540.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128401.log.gz 2023-11-04T01:55:30.928 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88180.log 2023-11-04T01:55:30.928 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94249.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118540.log.gz 2023-11-04T01:55:30.928 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124396.log 2023-11-04T01:55:30.928 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94249.log.gz 2023-11-04T01:55:30.928 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.88180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116712.log 2023-11-04T01:55:30.928 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124396.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88180.log.gz 2023-11-04T01:55:30.928 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121702.log 2023-11-04T01:55:30.929 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116712.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124396.log.gz 2023-11-04T01:55:30.929 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100690.log 2023-11-04T01:55:30.929 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116712.log.gz 2023-11-04T01:55:30.929 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112098.log 2023-11-04T01:55:30.929 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99181.log 2023-11-04T01:55:30.929 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.121702.log.gz 2023-11-04T01:55:30.929 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100690.log.gz 2023-11-04T01:55:30.929 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96504.log 2023-11-04T01:55:30.929 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.112098.log.gz 2023-11-04T01:55:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121109.log 2023-11-04T01:55:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119915.log 2023-11-04T01:55:30.930 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99181.log.gz 2023-11-04T01:55:30.930 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96504.log.gz 2023-11-04T01:55:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105741.log 2023-11-04T01:55:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.125389.log 2023-11-04T01:55:30.930 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121109.log.gz 2023-11-04T01:55:30.930 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119915.log.gz 2023-11-04T01:55:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120096.log 2023-11-04T01:55:30.931 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105741.log.gz 2023-11-04T01:55:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.125389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111237.log 2023-11-04T01:55:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.120096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104403.log 2023-11-04T01:55:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111237.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120096.log.gz 2023-11-04T01:55:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126592.log 2023-11-04T01:55:30.931 INFO:teuthology.orchestra.run.smithi044.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.111237.log.gz 2023-11-04T01:55:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123879.log 2023-11-04T01:55:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104403.log: /var/log/ceph/ceph-client.admin.126592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121217.log 2023-11-04T01:55:30.932 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104403.log.gz 2023-11-04T01:55:30.932 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.123879.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126592.log.gz 2023-11-04T01:55:30.932 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119831.log 2023-11-04T01:55:30.932 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127047.log 2023-11-04T01:55:30.932 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121217.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123879.log.gz 2023-11-04T01:55:30.932 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96836.log 2023-11-04T01:55:30.932 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119831.log.gz 2023-11-04T01:55:30.932 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.127047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125132.log 2023-11-04T01:55:30.933 INFO:teuthology.orchestra.run.smithi044.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.121217.log.gz 2023-11-04T01:55:30.933 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113538.log 2023-11-04T01:55:30.933 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96836.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127047.log.gz 2023-11-04T01:55:30.933 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.125132.log: 92.8% -- replaced with /var/log/ceph/ceph-client.0.125389.log.gz 2023-11-04T01:55:30.933 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111930.log 2023-11-04T01:55:30.933 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96836.log.gz 2023-11-04T01:55:30.933 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.125132.log.gz 2023-11-04T01:55:30.933 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95488.log 2023-11-04T01:55:30.934 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113538.log: /var/log/ceph/ceph-client.admin.111930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105573.log 2023-11-04T01:55:30.934 INFO:teuthology.orchestra.run.smithi044.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.113538.log.gz 2023-11-04T01:55:30.934 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126760.log 2023-11-04T01:55:30.934 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111930.log.gz 2023-11-04T01:55:30.934 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96503.log 2023-11-04T01:55:30.934 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95488.log.gz 2023-11-04T01:55:30.934 INFO:teuthology.orchestra.run.smithi044.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.105573.log.gz 2023-11-04T01:55:30.934 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120556.log 2023-11-04T01:55:30.934 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126760.log.gz 2023-11-04T01:55:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116986.log 2023-11-04T01:55:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.120556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97625.log 2023-11-04T01:55:30.935 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96503.log.gz 2023-11-04T01:55:30.935 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120556.log.gz 2023-11-04T01:55:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119244.log 2023-11-04T01:55:30.935 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116986.log.gz/var/log/ceph/ceph-client.admin.97625.log: 2023-11-04T01:55:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95693.log 2023-11-04T01:55:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111762.log 2023-11-04T01:55:30.935 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97625.log.gz 2023-11-04T01:55:30.936 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119244.log.gz 2023-11-04T01:55:30.936 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100338.log 2023-11-04T01:55:30.936 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95693.log.gz 2023-11-04T01:55:30.936 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115729.log 2023-11-04T01:55:30.936 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99349.log 2023-11-04T01:55:30.936 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111762.log.gz 2023-11-04T01:55:30.936 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100338.log.gz 2023-11-04T01:55:30.936 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111356.log 2023-11-04T01:55:30.936 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115729.log.gz 2023-11-04T01:55:30.937 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115206.log 2023-11-04T01:55:30.937 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126634.log 2023-11-04T01:55:30.937 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99349.log.gz 2023-11-04T01:55:30.937 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111356.log.gz 2023-11-04T01:55:30.937 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117028.log 2023-11-04T01:55:30.937 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119145.log 2023-11-04T01:55:30.937 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126634.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115206.log.gz 2023-11-04T01:55:30.937 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.117028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128359.log 2023-11-04T01:55:30.938 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.126634.log.gz 2023-11-04T01:55:30.938 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111278.log 2023-11-04T01:55:30.938 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119145.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117028.log.gz 2023-11-04T01:55:30.938 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93584.log 2023-11-04T01:55:30.938 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119145.log.gz 2023-11-04T01:55:30.938 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121533.log 2023-11-04T01:55:30.938 INFO:teuthology.orchestra.run.smithi044.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.128359.log.gz 2023-11-04T01:55:30.938 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93584.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.111278.log.gz 2023-11-04T01:55:30.938 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112537.log 2023-11-04T01:55:30.939 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2%/var/log/ceph/ceph-client.admin.121533.log: -- replaced with /var/log/ceph/ceph-client.admin.93584.log.gz 2023-11-04T01:55:30.939 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109634.log 2023-11-04T01:55:30.939 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.121533.log.gz 2023-11-04T01:55:30.939 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100201.log 2023-11-04T01:55:30.939 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109634.log: gzip -5 --verbose 88.3% -- -- replaced with /var/log/ceph/ceph-client.admin.112537.log.gz /var/log/ceph/ceph-client.admin.96164.log 2023-11-04T01:55:30.939 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-11-04T01:55:30.939 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100201.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109634.log.gz 2023-11-04T01:55:30.939 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126963.log 2023-11-04T01:55:30.939 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100201.log.gz 2023-11-04T01:55:30.940 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96164.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-04T01:55:30.940 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120494.log 2023-11-04T01:55:30.940 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96164.log.gz 2023-11-04T01:55:30.940 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.126963.log.gz 2023-11-04T01:55:30.940 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112308.log 2023-11-04T01:55:30.940 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.120494.log: /var/log/ceph/ceph-client.admin.110549.log 2023-11-04T01:55:30.940 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112308.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120494.log.gz 2023-11-04T01:55:30.940 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125946.log 2023-11-04T01:55:30.941 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112308.log.gz 2023-11-04T01:55:30.941 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101759.log 2023-11-04T01:55:30.941 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110549.log: /var/log/ceph/ceph-client.admin.125946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115164.log 2023-11-04T01:55:30.941 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101759.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125946.log.gz 2023-11-04T01:55:30.941 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108603.log 2023-11-04T01:55:30.941 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100380.log 2023-11-04T01:55:30.941 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.110549.log.gz 2023-11-04T01:55:30.941 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115164.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101759.log.gz 2023-11-04T01:55:30.941 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108603.log: gzip -5 --verbose -- 89.3% /var/log/ceph/ceph-client.admin.97709.log 2023-11-04T01:55:30.942 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.115164.log.gz 2023-11-04T01:55:30.942 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108603.log.gz 2023-11-04T01:55:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122852.log 2023-11-04T01:55:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100380.log: /var/log/ceph/ceph-client.admin.97709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100732.log 2023-11-04T01:55:30.942 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100380.log.gz 2023-11-04T01:55:30.942 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97709.log.gz 2023-11-04T01:55:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122852.log: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-04T01:55:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116256.log 2023-11-04T01:55:30.943 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3%/var/log/ceph/ceph-client.admin.100732.log: -- replaced with /var/log/ceph/ceph-client.admin.122852.log.gz 2023-11-04T01:55:30.943 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113214.log 2023-11-04T01:55:30.943 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3%/var/log/ceph/ceph-client.admin.116256.log: -- replaced with /var/log/ceph/ceph-client.admin.100732.log.gz 2023-11-04T01:55:30.943 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105209.log 2023-11-04T01:55:30.943 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106485.log 2023-11-04T01:55:30.943 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116256.log.gz 2023-11-04T01:55:30.943 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105209.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113214.log.gz 2023-11-04T01:55:30.943 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99475.log 2023-11-04T01:55:30.944 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105209.log.gz 2023-11-04T01:55:30.944 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100774.log 2023-11-04T01:55:30.944 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119873.log 2023-11-04T01:55:30.944 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106485.log.gz 2023-11-04T01:55:30.944 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100774.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99475.log.gz 2023-11-04T01:55:30.944 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106730.log 2023-11-04T01:55:30.944 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100774.log.gz 2023-11-04T01:55:30.944 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119614.log 2023-11-04T01:55:30.944 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119873.log: /var/log/ceph/ceph-client.admin.106730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126229.log 2023-11-04T01:55:30.945 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.119873.log.gz 2023-11-04T01:55:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119614.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106730.log.gz 2023-11-04T01:55:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100150.log 2023-11-04T01:55:30.945 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119614.log.gz 2023-11-04T01:55:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112926.log 2023-11-04T01:55:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109803.log 2023-11-04T01:55:30.945 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.126229.log.gz 2023-11-04T01:55:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112926.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100150.log.gz 2023-11-04T01:55:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102510.log 2023-11-04T01:55:30.946 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112926.log.gz 2023-11-04T01:55:30.946 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94123.log 2023-11-04T01:55:30.946 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.102510.log: -- /var/log/ceph/ceph-client.admin.116628.log 2023-11-04T01:55:30.946 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109803.log.gz 2023-11-04T01:55:30.946 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101801.log 87.7% 2023-11-04T01:55:30.946 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102510.log.gz 2023-11-04T01:55:30.946 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94123.log.gz 2023-11-04T01:55:30.946 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.98281.log 2023-11-04T01:55:30.946 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116628.log.gz 2023-11-04T01:55:30.947 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124010.log/var/log/ceph/ceph-client.admin.101801.log: 2023-11-04T01:55:30.947 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.98281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107183.log 2023-11-04T01:55:30.947 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101801.log.gz 2023-11-04T01:55:30.947 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100606.log 2023-11-04T01:55:30.947 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.107183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118419.log 2023-11-04T01:55:30.947 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124010.log.gz 2023-11-04T01:55:30.947 INFO:teuthology.orchestra.run.smithi044.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.98281.log.gz 2023-11-04T01:55:30.947 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107183.log.gz 2023-11-04T01:55:30.947 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124585.log 2023-11-04T01:55:30.948 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100606.log.gz 2023-11-04T01:55:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120598.log 2023-11-04T01:55:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.119994.log -- replaced with /var/log/ceph/ceph-client.admin.118419.log.gz 2023-11-04T01:55:30.948 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-11-04T01:55:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124585.log: /var/log/ceph/ceph-client.admin.120598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116944.log 2023-11-04T01:55:30.948 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.124585.log.gz 2023-11-04T01:55:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119994.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120598.log.gz 2023-11-04T01:55:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105251.log 2023-11-04T01:55:30.948 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119994.log.gz 2023-11-04T01:55:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106096.log 2023-11-04T01:55:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116944.log: /var/log/ceph/ceph-client.admin.105251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106646.log 2023-11-04T01:55:30.949 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116944.log.gz 2023-11-04T01:55:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106096.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105251.log.gz 2023-11-04T01:55:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124953.log 2023-11-04T01:55:30.949 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106096.log.gz 2023-11-04T01:55:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.106646.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.123634.log 2023-11-04T01:55:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95178.log 2023-11-04T01:55:30.950 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106646.log.gz 2023-11-04T01:55:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.123634.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124953.log.gz 2023-11-04T01:55:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100564.log 2023-11-04T01:55:30.950 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123634.log.gz 2023-11-04T01:55:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.95178.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.127685.log 2023-11-04T01:55:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112579.log 2023-11-04T01:55:30.950 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95178.log.gz 2023-11-04T01:55:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.127685.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100564.log.gz 2023-11-04T01:55:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108281.log 2023-11-04T01:55:30.951 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.112579.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96840.log 2023-11-04T01:55:30.951 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.127685.log.gz 2023-11-04T01:55:30.951 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108281.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.112579.log.gz 2023-11-04T01:55:30.951 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118377.log 2023-11-04T01:55:30.951 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101675.log 2023-11-04T01:55:30.951 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96840.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108281.log.gz 2023-11-04T01:55:30.951 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110363.log 2023-11-04T01:55:30.951 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96840.log.gz 2023-11-04T01:55:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101675.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118377.log.gz 2023-11-04T01:55:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126459.log 2023-11-04T01:55:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110363.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101675.log.gz 2023-11-04T01:55:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113580.log 2023-11-04T01:55:30.952 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110363.log.gz 2023-11-04T01:55:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96500.log 2023-11-04T01:55:30.952 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126459.log.gz 2023-11-04T01:55:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114968.log 2023-11-04T01:55:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113580.log: /var/log/ceph/ceph-client.admin.96500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120942.log 2023-11-04T01:55:30.953 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113580.log.gz 2023-11-04T01:55:30.953 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.114968.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96500.log.gz 2023-11-04T01:55:30.953 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95052.log 2023-11-04T01:55:30.953 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.114968.log.gz 2023-11-04T01:55:30.953 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121875.log 2023-11-04T01:55:30.953 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.120942.log: /var/log/ceph/ceph-client.admin.95052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96166.log 2023-11-04T01:55:30.953 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120942.log.gz 2023-11-04T01:55:30.953 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121875.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95052.log.gz 2023-11-04T01:55:30.954 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122768.log 2023-11-04T01:55:30.954 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.121875.log.gz 2023-11-04T01:55:30.954 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100464.log/var/log/ceph/ceph-client.admin.96166.log: 2023-11-04T01:55:30.954 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96494.log 2023-11-04T01:55:30.954 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96166.log.gz 2023-11-04T01:55:30.954 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100464.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.122768.log.gz 2023-11-04T01:55:30.954 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118191.log 2023-11-04T01:55:30.954 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.100464.log.gz 2023-11-04T01:55:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113130.log 2023-11-04T01:55:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105033.log 2023-11-04T01:55:30.955 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96494.log.gz 2023-11-04T01:55:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128138.log 2023-11-04T01:55:30.955 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118191.log.gz 2023-11-04T01:55:30.955 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113130.log.gz 2023-11-04T01:55:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101231.log 2023-11-04T01:55:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105293.log 2023-11-04T01:55:30.955 INFO:teuthology.orchestra.run.smithi044.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.105033.log.gz 2023-11-04T01:55:30.956 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101231.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128138.log.gz 2023-11-04T01:55:30.956 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104319.log 2023-11-04T01:55:30.956 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101231.log.gz 2023-11-04T01:55:30.956 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110465.log 2023-11-04T01:55:30.956 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101533.log 2023-11-04T01:55:30.956 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105293.log.gz 2023-11-04T01:55:30.956 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122684.log 2023-11-04T01:55:30.956 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104319.log.gz 2023-11-04T01:55:30.957 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110465.log.gz 2023-11-04T01:55:30.957 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105377.log 2023-11-04T01:55:30.957 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101533.log.gz 2023-11-04T01:55:30.957 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96839.log 2023-11-04T01:55:30.957 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122684.log: /var/log/ceph/ceph-client.admin.105377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106945.log 2023-11-04T01:55:30.957 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122684.log.gz 2023-11-04T01:55:30.957 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105377.log.gz 2023-11-04T01:55:30.957 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114842.log 2023-11-04T01:55:30.957 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96839.log.gz 2023-11-04T01:55:30.958 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97331.log 2023-11-04T01:55:30.958 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106945.log: /var/log/ceph/ceph-client.admin.114842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111103.log 2023-11-04T01:55:30.958 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106945.log.gz 2023-11-04T01:55:30.958 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.114842.log.gz 2023-11-04T01:55:30.958 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97751.log 2023-11-04T01:55:30.958 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97331.log.gz 2023-11-04T01:55:30.958 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113876.log 2023-11-04T01:55:30.958 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114884.log 2023-11-04T01:55:30.958 INFO:teuthology.orchestra.run.smithi044.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.111103.log.gz 2023-11-04T01:55:30.959 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95861.log 2023-11-04T01:55:30.959 INFO:teuthology.orchestra.run.smithi044.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.97751.log.gz 2023-11-04T01:55:30.959 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.114884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103573.log 2023-11-04T01:55:30.959 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113876.log.gz 2023-11-04T01:55:30.959 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.95861.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.109719.log 2023-11-04T01:55:30.959 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114884.log.gz 2023-11-04T01:55:30.959 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103573.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95861.log.gz 2023-11-04T01:55:30.959 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109592.log 2023-11-04T01:55:30.960 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103573.log.gz 2023-11-04T01:55:30.960 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5/var/log/ceph/ceph-client.admin.109719.log: --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-04T01:55:30.960 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126333.log 2023-11-04T01:55:30.960 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109719.log.gz 2023-11-04T01:55:30.960 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.1.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109592.log.gz 2023-11-04T01:55:30.960 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116161.log 2023-11-04T01:55:30.960 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.126333.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.112831.log 2023-11-04T01:55:30.960 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116161.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.126333.log.gz 2023-11-04T01:55:30.960 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117827.log 2023-11-04T01:55:30.961 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93461.log 2023-11-04T01:55:30.961 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112831.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116161.log.gz 2023-11-04T01:55:30.961 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.117827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107501.log 2023-11-04T01:55:30.961 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112831.log.gz 2023-11-04T01:55:30.961 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117827.log.gz 2023-11-04T01:55:30.961 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115686.log 2023-11-04T01:55:30.961 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93461.log: /var/log/ceph/ceph-client.admin.107501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115332.log 2023-11-04T01:55:30.961 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.93461.log.gz 2023-11-04T01:55:30.961 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115686.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107501.log.gz 2023-11-04T01:55:30.961 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117238.log 2023-11-04T01:55:30.962 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115686.log.gz/var/log/ceph/ceph-client.admin.115332.log: 2023-11-04T01:55:30.962 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102720.log 2023-11-04T01:55:30.962 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115332.log.gz 2023-11-04T01:55:30.962 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103075.log 2023-11-04T01:55:30.962 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.117238.log: /var/log/ceph/ceph-client.admin.102720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93995.log 2023-11-04T01:55:30.962 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117238.log.gz 2023-11-04T01:55:30.962 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103075.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102720.log.gz 2023-11-04T01:55:30.962 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102216.log 2023-11-04T01:55:30.963 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98897.log 2023-11-04T01:55:30.963 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93995.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103075.log.gz 2023-11-04T01:55:30.963 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129317.log 2023-11-04T01:55:30.963 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93995.log.gz 2023-11-04T01:55:30.963 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102216.log.gz 2023-11-04T01:55:30.963 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99097.log 2023-11-04T01:55:30.963 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.98897.log: /var/log/ceph/ceph-client.admin.129317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115500.log 2023-11-04T01:55:30.963 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98897.log.gz 2023-11-04T01:55:30.963 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96162.log 2023-11-04T01:55:30.964 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115500.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99097.log.gz 2023-11-04T01:55:30.964 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122270.log 2023-11-04T01:55:30.964 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107901.log 2023-11-04T01:55:30.964 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4%/var/log/ceph/ceph-client.admin.96162.log: -- replaced with /var/log/ceph/ceph-client.admin.115500.log.gz 2023-11-04T01:55:30.964 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94165.log 2023-11-04T01:55:30.964 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96162.log.gz 2023-11-04T01:55:30.964 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122270.log.gz/var/log/ceph/ceph-client.admin.107901.log: 2023-11-04T01:55:30.964 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128795.log 2023-11-04T01:55:30.965 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116077.log 2023-11-04T01:55:30.965 INFO:teuthology.orchestra.run.smithi044.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.107901.log.gz 2023-11-04T01:55:30.965 INFO:teuthology.orchestra.run.smithi044.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.129317.log.gz 2023-11-04T01:55:30.965 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94165.log.gz 2023-11-04T01:55:30.965 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118780.log 2023-11-04T01:55:30.965 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.116077.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.123534.log 2023-11-04T01:55:30.965 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.128795.log.gz 2023-11-04T01:55:30.965 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99223.log 2023-11-04T01:55:30.965 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116077.log.gz 2023-11-04T01:55:30.966 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.123534.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118780.log.gz 2023-11-04T01:55:30.966 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104049.log 2023-11-04T01:55:30.966 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123534.log.gz 2023-11-04T01:55:30.966 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94207.log 2023-11-04T01:55:30.966 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99265.log 2023-11-04T01:55:30.966 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99223.log.gz 2023-11-04T01:55:30.966 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104049.log: /var/log/ceph/ceph-client.admin.94207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124869.log 2023-11-04T01:55:30.966 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104049.log.gz 2023-11-04T01:55:30.967 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94207.log.gz 2023-11-04T01:55:30.967 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126718.log 2023-11-04T01:55:30.967 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109891.log 2023-11-04T01:55:30.967 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124869.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99265.log.gz 2023-11-04T01:55:30.967 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108561.log 2023-11-04T01:55:30.967 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124869.log.gz 2023-11-04T01:55:30.967 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126718.log.gz 2023-11-04T01:55:30.967 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128096.log 2023-11-04T01:55:30.967 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109891.log: /var/log/ceph/ceph-client.admin.108561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113792.log 2023-11-04T01:55:30.968 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109891.log.gz 2023-11-04T01:55:30.968 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115122.log 2023-11-04T01:55:30.968 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108561.log.gz 2023-11-04T01:55:30.968 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128096.log.gz 2023-11-04T01:55:30.968 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109000.log 2023-11-04T01:55:30.968 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113792.log.gz 2023-11-04T01:55:30.968 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104007.log 2023-11-04T01:55:30.968 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115122.log: /var/log/ceph/ceph-client.admin.109000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107994.log 2023-11-04T01:55:30.969 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115122.log.gz 2023-11-04T01:55:30.969 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109000.log.gz 2023-11-04T01:55:30.969 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120320.log 2023-11-04T01:55:30.969 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121412.log 2023-11-04T01:55:30.969 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.107994.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104007.log.gz 2023-11-04T01:55:30.969 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.120320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106264.log 2023-11-04T01:55:30.969 INFO:teuthology.orchestra.run.smithi044.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.107994.log.gz 2023-11-04T01:55:30.969 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120320.log.gz 2023-11-04T01:55:30.969 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112411.log 2023-11-04T01:55:30.970 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121412.log: /var/log/ceph/ceph-client.admin.106264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114800.log 2023-11-04T01:55:30.970 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121412.log.gz 2023-11-04T01:55:30.970 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128275.log 2023-11-04T01:55:30.970 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106264.log.gz 2023-11-04T01:55:30.970 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112411.log.gz 2023-11-04T01:55:30.970 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.114800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99139.log 2023-11-04T01:55:30.970 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114800.log.gz 2023-11-04T01:55:30.970 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96169.log 2023-11-04T01:55:30.971 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128275.log: /var/log/ceph/ceph-client.admin.99139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115416.log 2023-11-04T01:55:30.971 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128275.log.gz 2023-11-04T01:55:30.971 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99139.log.gz 2023-11-04T01:55:30.971 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113006.log 2023-11-04T01:55:30.971 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100021.log 2023-11-04T01:55:30.971 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115416.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96169.log.gz 2023-11-04T01:55:30.971 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112368.log 2023-11-04T01:55:30.971 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115416.log.gz 2023-11-04T01:55:30.971 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113006.log.gz 2023-11-04T01:55:30.972 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.98774.log 2023-11-04T01:55:30.972 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100021.log: /var/log/ceph/ceph-client.admin.112368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105531.log 2023-11-04T01:55:30.972 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100021.log.gz 2023-11-04T01:55:30.972 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.2.98774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125678.log 2023-11-04T01:55:30.972 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112368.log.gz 2023-11-04T01:55:30.972 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121575.log 2023-11-04T01:55:30.972 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.125678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119304.log 2023-11-04T01:55:30.972 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105531.log.gz 2023-11-04T01:55:30.973 INFO:teuthology.orchestra.run.smithi044.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.2.98774.log.gz 2023-11-04T01:55:30.973 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104175.log 2023-11-04T01:55:30.973 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.125678.log.gz 2023-11-04T01:55:30.973 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 88.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.121575.log.gz -- 2023-11-04T01:55:30.973 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.97373.log 2023-11-04T01:55:30.973 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119304.log: /var/log/ceph/ceph-client.admin.104175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117112.log 2023-11-04T01:55:30.973 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119304.log.gz 2023-11-04T01:55:30.973 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97373.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104175.log.gz 2023-11-04T01:55:30.973 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126676.log 2023-11-04T01:55:30.974 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.117112.log: /var/log/ceph/ceph-client.admin.97037.log 2023-11-04T01:55:30.974 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.97373.log.gz 2023-11-04T01:55:30.974 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96838.log 2023-11-04T01:55:30.974 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117112.log.gz 2023-11-04T01:55:30.974 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97037.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.126676.log.gz 2023-11-04T01:55:30.974 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108729.log 2023-11-04T01:55:30.974 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97037.log.gz 2023-11-04T01:55:30.974 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103615.log 2023-11-04T01:55:30.975 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.108729.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.113444.log 2023-11-04T01:55:30.975 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96838.log.gz 2023-11-04T01:55:30.975 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103615.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108729.log.gz 2023-11-04T01:55:30.975 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112663.log 2023-11-04T01:55:30.975 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103615.log.gz 2023-11-04T01:55:30.975 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117785.log 2023-11-04T01:55:30.975 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111159.log 2023-11-04T01:55:30.975 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113444.log.gz 2023-11-04T01:55:30.975 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.117785.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112663.log.gz 2023-11-04T01:55:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94291.log 2023-11-04T01:55:30.976 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117785.log.gz 2023-11-04T01:55:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122398.log 2023-11-04T01:55:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93542.log 2023-11-04T01:55:30.976 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111159.log.gz 2023-11-04T01:55:30.976 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94291.log.gz 2023-11-04T01:55:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111650.log 2023-11-04T01:55:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96499.log 2023-11-04T01:55:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93542.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122398.log.gz 2023-11-04T01:55:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120781.log 2023-11-04T01:55:30.977 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93542.log.gz 2023-11-04T01:55:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.96499.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.124114.log 2023-11-04T01:55:30.977 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111650.log.gz 2023-11-04T01:55:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.120781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120180.log 2023-11-04T01:55:30.977 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96499.log.gz 2023-11-04T01:55:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124114.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120781.log.gz 2023-11-04T01:55:30.977 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124456.log 2023-11-04T01:55:30.977 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7%/var/log/ceph/ceph-client.admin.120180.log: -- replaced with /var/log/ceph/ceph-client.admin.124114.log.gz 2023-11-04T01:55:30.978 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-04T01:55:30.978 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120180.log.gz 2023-11-04T01:55:30.978 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106565.log 2023-11-04T01:55:30.978 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124456.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93839.log 2023-11-04T01:55:30.978 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124456.log.gz 2023-11-04T01:55:30.978 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95945.log 2023-11-04T01:55:30.978 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111608.log 2023-11-04T01:55:30.978 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106565.log.gz 2023-11-04T01:55:30.979 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116902.log 2023-11-04T01:55:30.979 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93839.log.gz 2023-11-04T01:55:30.979 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105489.log 2023-11-04T01:55:30.979 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95945.log.gz 2023-11-04T01:55:30.979 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128627.log 2023-11-04T01:55:30.979 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111608.log.gz 2023-11-04T01:55:30.979 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115782.log 2023-11-04T01:55:30.979 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105489.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116902.log.gz 2023-11-04T01:55:30.979 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102342.log 2023-11-04T01:55:30.980 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105489.log.gz 2023-11-04T01:55:30.980 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99517.log 2023-11-04T01:55:30.980 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115782.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.128627.log.gz 2023-11-04T01:55:30.980 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103321.log 2023-11-04T01:55:30.980 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115782.log.gz 2023-11-04T01:55:30.980 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102342.log.gz 2023-11-04T01:55:30.980 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100895.log 2023-11-04T01:55:30.980 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102006.log 2023-11-04T01:55:30.980 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99517.log.gz 2023-11-04T01:55:30.981 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103321.log.gz 2023-11-04T01:55:30.981 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102048.log 2023-11-04T01:55:30.981 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.81877.log 2023-11-04T01:55:30.981 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102006.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100895.log.gz 2023-11-04T01:55:30.981 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93795.log 2023-11-04T01:55:30.981 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102006.log.gz 2023-11-04T01:55:30.981 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6%/var/log/ceph/ceph.tmp-client.admin.81877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121959.log 2023-11-04T01:55:30.981 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102048.log.gz 2023-11-04T01:55:30.981 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.81877.log.gz 2023-11-04T01:55:30.982 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123694.log 2023-11-04T01:55:30.982 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93795.log.gz 2023-11-04T01:55:30.982 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104133.log 2023-11-04T01:55:30.982 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127267.log 2023-11-04T01:55:30.982 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.123694.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121959.log.gz 2023-11-04T01:55:30.982 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99391.log 2023-11-04T01:55:30.982 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.123694.log.gz 2023-11-04T01:55:30.982 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.127267.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.104133.log.gz --verbose 2023-11-04T01:55:30.982 INFO:teuthology.orchestra.run.smithi044.stderr: -- /var/log/ceph/ceph-client.admin.95567.log 2023-11-04T01:55:30.983 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99391.log: gzip -5 88.9% -- replaced with /var/log/ceph/ceph-client.admin.127267.log.gz 2023-11-04T01:55:30.983 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.108113.log 2023-11-04T01:55:30.983 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99391.log.gz 2023-11-04T01:55:30.983 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102552.log 2023-11-04T01:55:30.983 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95567.log.gz 2023-11-04T01:55:30.983 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110069.log 2023-11-04T01:55:30.983 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121454.log 2023-11-04T01:55:30.983 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108113.log.gz 2023-11-04T01:55:30.984 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122640.log 2023-11-04T01:55:30.984 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102552.log.gz 2023-11-04T01:55:30.984 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.121454.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.119765.log 2023-11-04T01:55:30.984 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110069.log.gz 2023-11-04T01:55:30.984 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101964.log 2023-11-04T01:55:30.984 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.121454.log.gz 2023-11-04T01:55:30.984 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119765.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.122640.log.gz -5 2023-11-04T01:55:30.984 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.112056.log 2023-11-04T01:55:30.984 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100063.log 2023-11-04T01:55:30.985 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101964.log.gz 2023-11-04T01:55:30.985 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112056.log: gzip -5 90.9% -- replaced with /var/log/ceph/ceph-client.admin.119765.log.gz 2023-11-04T01:55:30.985 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.103965.log 2023-11-04T01:55:30.985 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100063.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112056.log.gz 2023-11-04T01:55:30.985 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113382.log 2023-11-04T01:55:30.985 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100063.log.gz 2023-11-04T01:55:30.985 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101063.log 2023-11-04T01:55:30.985 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107079.log 2023-11-04T01:55:30.985 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103965.log.gz 2023-11-04T01:55:30.985 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113382.log.gz 2023-11-04T01:55:30.986 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5/var/log/ceph/ceph-client.admin.101063.log: --verbose -- /var/log/ceph/ceph-client.admin.109168.log 2023-11-04T01:55:30.986 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95136.log 2023-11-04T01:55:30.986 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.107079.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101063.log.gz 2023-11-04T01:55:30.986 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99853.log 2023-11-04T01:55:30.986 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107079.log.gz 2023-11-04T01:55:30.986 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95903.log 2023-11-04T01:55:30.986 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109168.log.gz 2023-11-04T01:55:30.986 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100296.log 2023-11-04T01:55:30.987 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95136.log.gz 2023-11-04T01:55:30.987 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120233.log 2023-11-04T01:55:30.987 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99853.log.gz 2023-11-04T01:55:30.987 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108155.log 2023-11-04T01:55:30.987 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100296.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95903.log.gz 2023-11-04T01:55:30.987 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.120233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113750.log 2023-11-04T01:55:30.987 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100296.log.gz 2023-11-04T01:55:30.987 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109676.log 2023-11-04T01:55:30.987 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120233.log.gz 2023-11-04T01:55:30.988 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103489.log 2023-11-04T01:55:30.988 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108155.log.gz 2023-11-04T01:55:30.988 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97289.log 2023-11-04T01:55:30.988 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113750.log.gz 2023-11-04T01:55:30.988 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109676.log.gz 2023-11-04T01:55:30.988 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105657.log 2023-11-04T01:55:30.988 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121917.log 2023-11-04T01:55:30.988 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97289.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103489.log.gz 2023-11-04T01:55:30.988 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126006.log 2023-11-04T01:55:30.989 INFO:teuthology.orchestra.run.smithi044.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.97289.log.gz 2023-11-04T01:55:30.989 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105657.log.gz 2023-11-04T01:55:30.989 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111566.log 2023-11-04T01:55:30.989 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5/var/log/ceph/ceph-client.admin.126006.log: --verbose -- /var/log/ceph/ceph-client.admin.116336.log 2023-11-04T01:55:30.989 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.121917.log.gz 2023-11-04T01:55:30.989 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111566.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.126006.log.gz 2023-11-04T01:55:30.989 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101147.log 2023-11-04T01:55:30.989 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111566.log.gz 2023-11-04T01:55:30.990 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116119.log 2023-11-04T01:55:30.990 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115584.log 2023-11-04T01:55:30.990 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101147.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116336.log.gz 2023-11-04T01:55:30.990 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116860.log 2023-11-04T01:55:30.990 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101147.log.gz 2023-11-04T01:55:30.990 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.115584.log: -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116119.log.gz 2023-11-04T01:55:30.990 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.109336.log 2023-11-04T01:55:30.990 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116860.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115584.log.gz 2023-11-04T01:55:30.990 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117154.log 2023-11-04T01:55:30.991 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109336.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116860.log.gz 2023-11-04T01:55:30.991 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108771.log 2023-11-04T01:55:30.991 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109336.log.gz 2023-11-04T01:55:30.991 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.117154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110423.log 2023-11-04T01:55:30.991 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110153.log 2023-11-04T01:55:30.991 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117154.log.gz 2023-11-04T01:55:30.991 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128921.log 2023-11-04T01:55:30.991 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108771.log.gz 2023-11-04T01:55:30.993 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110423.log.gz 2023-11-04T01:55:30.993 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95651.log 2023-11-04T01:55:30.993 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113708.log 2023-11-04T01:55:30.993 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128921.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110153.log.gz 2023-11-04T01:55:30.993 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106857.log 2023-11-04T01:55:30.993 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128921.log.gz 2023-11-04T01:55:30.994 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122144.log 2023-11-04T01:55:30.994 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95651.log.gz 2023-11-04T01:55:30.994 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113708.log: /var/log/ceph/ceph-client.admin.106857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123492.log 2023-11-04T01:55:30.994 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100106.log 2023-11-04T01:55:30.994 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113708.log.gz 2023-11-04T01:55:30.994 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106857.log.gz 2023-11-04T01:55:30.994 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99433.log 2023-11-04T01:55:30.994 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.123492.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122144.log.gz 2023-11-04T01:55:30.995 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100106.log: gzip -5 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123492.log.gz 2023-11-04T01:55:30.995 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.120841.log 2023-11-04T01:55:30.995 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99433.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100106.log.gz 2023-11-04T01:55:30.995 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107267.log 2023-11-04T01:55:30.995 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99433.log.gz 2023-11-04T01:55:30.995 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.120841.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.121618.log 2023-11-04T01:55:30.995 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.107267.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120841.log.gz 2023-11-04T01:55:30.995 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108197.log 2023-11-04T01:55:30.995 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.107267.log.gz 2023-11-04T01:55:30.996 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107123.log 2023-11-04T01:55:30.996 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.121618.log.gzgzip 2023-11-04T01:55:30.996 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.101843.log 2023-11-04T01:55:30.996 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108197.log: /var/log/ceph/ceph-client.admin.107123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99811.log 2023-11-04T01:55:30.996 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108197.log.gz 2023-11-04T01:55:30.996 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107123.log.gz 2023-11-04T01:55:30.996 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118028.log 2023-11-04T01:55:30.996 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100979.log 2023-11-04T01:55:30.996 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101843.log.gz 2023-11-04T01:55:30.997 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122726.log 2023-11-04T01:55:30.997 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99811.log.gz 2023-11-04T01:55:30.997 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99895.log 2023-11-04T01:55:30.997 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111804.log 2023-11-04T01:55:30.997 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100979.log.gz 2023-11-04T01:55:30.997 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.118028.log.gz 2023-11-04T01:55:30.997 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112705.log 2023-11-04T01:55:30.997 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122726.log.gz 2023-11-04T01:55:30.997 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93284.log 2023-11-04T01:55:30.998 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99895.log.gz 2023-11-04T01:55:30.998 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:55:30.998 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112705.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111804.log.gz 2023-11-04T01:55:30.998 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115825.log 2023-11-04T01:55:30.998 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112705.log.gz 2023-11-04T01:55:30.998 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95362.log 2023-11-04T01:55:30.998 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93284.log.gz 2023-11-04T01:55:30.998 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100648.log 2023-11-04T01:55:30.999 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95220.log 2023-11-04T01:55:30.999 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.115825.log.gz 2023-11-04T01:55:30.999 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95362.log: /var/log/ceph/ceph-client.admin.100648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118601.log 2023-11-04T01:55:30.999 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115458.log 2023-11-04T01:55:30.999 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100648.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95362.log.gz 2023-11-04T01:55:30.999 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-11-04T01:55:30.999 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118601.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95220.log.gz 2023-11-04T01:55:30.999 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102804.log 2023-11-04T01:55:30.999 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118601.log.gz 2023-11-04T01:55:31.000 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.115458.log: -- /var/log/ceph/ceph-client.admin.104259.log 2023-11-04T01:55:31.000 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102804.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115458.log.gz 2023-11-04T01:55:31.000 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95446.log 88.3% 2023-11-04T01:55:31.000 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102804.log.gz 2023-11-04T01:55:31.000 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94813.log 2023-11-04T01:55:31.000 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104259.log.gz 2023-11-04T01:55:31.000 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114758.log 2023-11-04T01:55:31.000 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123430.log 2023-11-04T01:55:31.001 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95446.log.gz 2023-11-04T01:55:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.114758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118315.log 2023-11-04T01:55:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120739.log 2023-11-04T01:55:31.001 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114758.log.gz/var/log/ceph/ceph-client.admin.123430.log: 2023-11-04T01:55:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106180.log 2023-11-04T01:55:31.001 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123430.log.gz 2023-11-04T01:55:31.001 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118315.log.gz/var/log/ceph/ceph-client.admin.120739.log: 2023-11-04T01:55:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112140.log 2023-11-04T01:55:31.001 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120739.log.gz 2023-11-04T01:55:31.002 INFO:teuthology.orchestra.run.smithi044.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.94813.log.gz 2023-11-04T01:55:31.002 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117280.log 2023-11-04T01:55:31.002 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106180.log: /var/log/ceph/ceph-client.admin.112140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105825.log 2023-11-04T01:55:31.002 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.117280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105011.log 2023-11-04T01:55:31.002 INFO:teuthology.orchestra.run.smithi044.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.112140.log.gz 2023-11-04T01:55:31.002 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106180.log.gz 2023-11-04T01:55:31.002 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126530.log 2023-11-04T01:55:31.002 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124827.log 2023-11-04T01:55:31.003 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105825.log.gz 2023-11-04T01:55:31.003 INFO:teuthology.orchestra.run.smithi044.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.117280.log.gz 2023-11-04T01:55:31.003 INFO:teuthology.orchestra.run.smithi044.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.105011.log.gz 2023-11-04T01:55:31.003 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119041.log 2023-11-04T01:55:31.003 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126530.log.gz 2023-11-04T01:55:31.003 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116459.log 2023-11-04T01:55:31.003 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119041.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124827.log.gz 2023-11-04T01:55:31.003 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108239.log 2023-11-04T01:55:31.003 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119041.log.gz 2023-11-04T01:55:31.004 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103033.log 2023-11-04T01:55:31.004 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.116459.log.gz 2023-11-04T01:55:31.004 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125616.log 2023-11-04T01:55:31.004 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108687.log 2023-11-04T01:55:31.004 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108239.log.gz 2023-11-04T01:55:31.004 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111078.log 2023-11-04T01:55:31.004 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.125616.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103033.log.gz 2023-11-04T01:55:31.004 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117877.log 2023-11-04T01:55:31.005 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125616.log.gz 2023-11-04T01:55:31.005 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108687.log: /var/log/ceph/ceph-client.admin.111078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119103.log 2023-11-04T01:55:31.005 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.117877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103363.log 2023-11-04T01:55:31.005 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108687.log.gz 2023-11-04T01:55:31.005 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.111078.log.gz 2023-11-04T01:55:31.005 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119103.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117877.log.gz 2023-11-04T01:55:31.005 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122228.log 2023-11-04T01:55:31.005 INFO:teuthology.orchestra.run.smithi044.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-04T01:55:31.006 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.119103.log.gz 2023-11-04T01:55:31.006 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.115542.log 2023-11-04T01:55:31.006 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103363.log: /var/log/ceph/ceph-client.admin.122228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126107.log 2023-11-04T01:55:31.006 INFO:teuthology.orchestra.run.smithi044.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.103363.log.gz 2023-11-04T01:55:31.006 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119699.log 2023-11-04T01:55:31.006 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122228.log.gz 2023-11-04T01:55:31.006 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99559.log 2023-11-04T01:55:31.006 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115542.log.gz 2023-11-04T01:55:31.006 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.119699.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.107938.log 2023-11-04T01:55:31.007 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.126107.log.gz 2023-11-04T01:55:31.007 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108813.log 2023-11-04T01:55:31.007 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8%/var/log/ceph/ceph-client.admin.107938.log: -- replaced with /var/log/ceph/ceph-client.admin.99559.log.gz 2023-11-04T01:55:31.007 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103837.log 2023-11-04T01:55:31.007 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.119699.log.gz 2023-11-04T01:55:31.007 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109511.log 2023-11-04T01:55:31.007 INFO:teuthology.orchestra.run.smithi044.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.107938.log.gz 2023-11-04T01:55:31.007 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102174.log 2023-11-04T01:55:31.008 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108813.log.gz 2023-11-04T01:55:31.008 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103837.log: gzip -5/var/log/ceph/ceph-client.admin.109511.log: --verbose -- /var/log/ceph/ceph-client.admin.101491.log 2023-11-04T01:55:31.008 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103837.log.gz 2023-11-04T01:55:31.008 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102174.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109511.log.gz 2023-11-04T01:55:31.008 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110507.log 2023-11-04T01:55:31.008 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.101491.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.102384.log 2023-11-04T01:55:31.008 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102174.log.gz 2023-11-04T01:55:31.008 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112789.log 2023-11-04T01:55:31.009 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101491.log.gz 2023-11-04T01:55:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124312.log 2023-11-04T01:55:31.009 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110507.log.gz 2023-11-04T01:55:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112789.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.102594.log 2023-11-04T01:55:31.009 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102384.log.gz 2023-11-04T01:55:31.009 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112789.log.gz 2023-11-04T01:55:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123364.log 2023-11-04T01:55:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108957.log 2023-11-04T01:55:31.009 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102594.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.124312.log.gz 2023-11-04T01:55:31.010 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.123364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103921.log 2023-11-04T01:55:31.010 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102594.log.gz 2023-11-04T01:55:31.010 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96163.log 2023-11-04T01:55:31.010 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.103921.log: -5 --verbose 88.7% -- /var/log/ceph/ceph-client.admin.115867.log 2023-11-04T01:55:31.010 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108957.log.gz 2023-11-04T01:55:31.010 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.123364.log.gz 2023-11-04T01:55:31.010 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96163.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103921.log.gz 2023-11-04T01:55:31.010 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95819.log 2023-11-04T01:55:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121067.log 2023-11-04T01:55:31.011 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96163.log.gz 2023-11-04T01:55:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126879.log 2023-11-04T01:55:31.011 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115867.log.gz 2023-11-04T01:55:31.011 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95819.log.gz 2023-11-04T01:55:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116670.log 2023-11-04T01:55:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128753.log 2023-11-04T01:55:31.011 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5%/var/log/ceph/ceph-client.admin.126879.log: -- replaced with /var/log/ceph/ceph-client.admin.121067.log.gz 2023-11-04T01:55:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122021.log 2023-11-04T01:55:31.012 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126879.log.gz 2023-11-04T01:55:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128753.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116670.log.gz 2023-11-04T01:55:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.117603.log 2023-11-04T01:55:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122186.log 2023-11-04T01:55:31.012 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128753.log.gz 2023-11-04T01:55:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.117603.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122021.log.gz 2023-11-04T01:55:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116417.log 2023-11-04T01:55:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107758.log 2023-11-04T01:55:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116417.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122186.log.gz 2023-11-04T01:55:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.104768.log 2023-11-04T01:55:31.013 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116417.log.gz 2023-11-04T01:55:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.107758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122556.log 2023-11-04T01:55:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.104768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119388.log 2023-11-04T01:55:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122556.log: 88.6% -- replaced with /var/log/ceph/ceph-client.0.107758.log.gz 2023-11-04T01:55:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122356.log 2023-11-04T01:55:31.013 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.0.104768.log.gz 2023-11-04T01:55:31.013 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.122556.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.109210.log 2023-11-04T01:55:31.014 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-11-04T01:55:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125550.log 2023-11-04T01:55:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122356.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119388.log.gz 2023-11-04T01:55:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113172.log 2023-11-04T01:55:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.125550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120278.log 2023-11-04T01:55:31.014 INFO:teuthology.orchestra.run.smithi044.stderr: 89.5% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.122356.log.gz 2023-11-04T01:55:31.014 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.109210.log.gz 2023-11-04T01:55:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99769.log 2023-11-04T01:55:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.120278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96502.log 2023-11-04T01:55:31.015 INFO:teuthology.orchestra.run.smithi044.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.125550.log.gz 2023-11-04T01:55:31.015 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113172.log.gz/var/log/ceph/ceph-client.admin.99769.log: 2023-11-04T01:55:31.015 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120278.log.gz 2023-11-04T01:55:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99769.log.gz 2023-11-04T01:55:31.015 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-osd.0.log 2023-11-04T01:55:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102258.log 2023-11-04T01:55:31.015 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96502.log.gz 2023-11-04T01:55:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125904.log 2023-11-04T01:55:31.016 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.102258.log: /var/log/ceph/ceph-client.admin.97121.log 2023-11-04T01:55:31.016 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114482.log 2023-11-04T01:55:31.016 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102258.log.gz 2023-11-04T01:55:31.016 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.125904.log: /var/log/ceph/ceph-client.admin.97121.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125904.log.gz 2023-11-04T01:55:31.016 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.97121.log.gz 2023-11-04T01:55:31.016 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96834.log 2023-11-04T01:55:31.016 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.114482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116501.log 2023-11-04T01:55:31.016 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114482.log.gz/var/log/ceph/ceph-client.admin.96834.log: 2023-11-04T01:55:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99601.log 2023-11-04T01:55:31.017 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96834.log.gz 2023-11-04T01:55:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126168.log 2023-11-04T01:55:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116501.log: /var/log/ceph/ceph-client.admin.99601.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116501.log.gz 2023-11-04T01:55:31.017 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99601.log.gz 2023-11-04T01:55:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97499.log 2023-11-04T01:55:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104091.log 2023-11-04T01:55:31.017 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95777.log 2023-11-04T01:55:31.017 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.126168.log.gz 2023-11-04T01:55:31.018 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104091.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97499.log.gz 2023-11-04T01:55:31.018 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127871.log 2023-11-04T01:55:31.018 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4%/var/log/ceph/ceph-client.admin.95777.log: -- replaced with /var/log/ceph/ceph-client.admin.104091.log.gz 2023-11-04T01:55:31.018 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127005.log 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95777.log.gz 2023-11-04T01:55:31.018 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-11-04T01:55:31.018 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.127871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122946.log 2023-11-04T01:55:31.018 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127871.log.gz 2023-11-04T01:55:31.018 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.127005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100422.log 2023-11-04T01:55:31.018 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122946.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127005.log.gz 2023-11-04T01:55:31.019 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116818.log 2023-11-04T01:55:31.019 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122946.log.gz 2023-11-04T01:55:31.019 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87904.log 2023-11-04T01:55:31.019 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100422.log: /var/log/ceph/ceph-client.admin.116818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115909.log 2023-11-04T01:55:31.019 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.87904.log: 88.5% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116818.log.gz 2023-11-04T01:55:31.019 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100422.log.gz 2023-11-04T01:55:31.019 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111034.log 2023-11-04T01:55:31.019 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87904.log.gz 2023-11-04T01:55:31.020 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121283.log 2023-11-04T01:55:31.020 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119551.log 2023-11-04T01:55:31.020 INFO:teuthology.orchestra.run.smithi044.stderr: 93.0% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115909.log.gz 2023-11-04T01:55:31.020 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.0.117603.log.gz 2023-11-04T01:55:31.020 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111034.log: /var/log/ceph/ceph-client.admin.121283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109761.log 2023-11-04T01:55:31.020 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111034.log.gz 2023-11-04T01:55:31.020 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119551.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.121283.log.gz 2023-11-04T01:55:31.020 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119551.log.gz 2023-11-04T01:55:31.020 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.0.123203.log 2023-11-04T01:55:31.020 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127173.log 2023-11-04T01:55:31.021 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109761.log.gz 2023-11-04T01:55:31.021 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.123203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115248.log 2023-11-04T01:55:31.021 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.127173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102990.log 2023-11-04T01:55:31.021 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105615.log 2023-11-04T01:55:31.021 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127173.log.gz 2023-11-04T01:55:31.021 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102990.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115248.log.gz 2023-11-04T01:55:31.021 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102990.log.gz 2023-11-04T01:55:31.021 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104361.log 2023-11-04T01:55:31.021 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105615.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-04T01:55:31.022 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100937.log 2023-11-04T01:55:31.022 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105615.log.gz 2023-11-04T01:55:31.022 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104361.log.gz 2023-11-04T01:55:31.022 INFO:teuthology.orchestra.run.smithi044.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.123203.log.gz 2023-11-04T01:55:31.022 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95010.log 2023-11-04T01:55:31.022 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93753.log 2023-11-04T01:55:31.022 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95010.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100937.log.gz 2023-11-04T01:55:31.022 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108035.log 2023-11-04T01:55:31.023 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95010.log.gz 2023-11-04T01:55:31.023 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122312.log 2023-11-04T01:55:31.023 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93753.log: /var/log/ceph/ceph-client.admin.108035.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93753.log.gz 2023-11-04T01:55:31.023 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108035.log.gz 2023-11-04T01:55:31.023 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113960.log 2023-11-04T01:55:31.023 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122312.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106306.log 2023-11-04T01:55:31.023 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2023-11-04T01:55:31.023 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118685.log 2023-11-04T01:55:31.023 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.122312.log.gz 2023-11-04T01:55:31.024 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97247.log 2023-11-04T01:55:31.024 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112014.log 2023-11-04T01:55:31.024 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106306.log.gz 2023-11-04T01:55:31.024 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9%/var/log/ceph/ceph-client.admin.118685.log: -- replaced with /var/log/ceph/ceph-client.admin.113960.log.gz 2023-11-04T01:55:31.024 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97247.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118685.log.gz 2023-11-04T01:55:31.024 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107393.log 2023-11-04T01:55:31.024 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.97247.log.gz 2023-11-04T01:55:31.024 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93365.log 2023-11-04T01:55:31.024 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112014.log: /var/log/ceph/ceph-client.admin.107393.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-04T01:55:31.025 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112014.log.gz 2023-11-04T01:55:31.025 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5/var/log/ceph/ceph-client.admin.93365.log: --verbose -- /var/log/ceph/ceph-client.admin.105867.log 2023-11-04T01:55:31.025 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107393.log.gz 2023-11-04T01:55:31.025 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118825.log 2023-11-04T01:55:31.025 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93365.log.gz 2023-11-04T01:55:31.025 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.105867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109126.log 2023-11-04T01:55:31.025 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102930.log 2023-11-04T01:55:31.025 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105867.log.gz 2023-11-04T01:55:31.025 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109126.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-04T01:55:31.026 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118825.log.gz 2023-11-04T01:55:31.026 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102930.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109126.log.gz 2023-11-04T01:55:31.026 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123736.log 2023-11-04T01:55:31.026 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102930.log.gz 2023-11-04T01:55:31.026 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101407.log 2023-11-04T01:55:31.026 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.123736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101449.log 2023-11-04T01:55:31.026 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101407.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123736.log.gz 2023-11-04T01:55:31.026 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101407.log.gz 2023-11-04T01:55:31.027 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99979.log 2023-11-04T01:55:31.027 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103447.log 2023-11-04T01:55:31.027 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99979.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101449.log.gz 2023-11-04T01:55:31.027 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99979.log.gz 2023-11-04T01:55:31.027 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118975.log 2023-11-04T01:55:31.027 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104217.log 2023-11-04T01:55:31.027 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118975.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103447.log.gz 2023-11-04T01:55:31.027 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106815.log 2023-11-04T01:55:31.028 INFO:teuthology.orchestra.run.smithi044.stderr: 91.2%/var/log/ceph/ceph-client.admin.104217.log: -- replaced with /var/log/ceph/ceph-client.admin.118975.log.gz 2023-11-04T01:55:31.028 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104217.log.gz 2023-11-04T01:55:31.028 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114026.log 2023-11-04T01:55:31.028 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109847.log 2023-11-04T01:55:31.028 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.114026.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106815.log.gz 2023-11-04T01:55:31.028 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114026.log.gz 2023-11-04T01:55:31.028 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124156.log 2023-11-04T01:55:31.028 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109847.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109847.log.gz 2023-11-04T01:55:31.028 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122598.log 2023-11-04T01:55:31.029 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118909.log 2023-11-04T01:55:31.029 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122598.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124156.log.gz 2023-11-04T01:55:31.029 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122598.log.gz 2023-11-04T01:55:31.029 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120362.log 2023-11-04T01:55:31.029 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123939.log 2023-11-04T01:55:31.029 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.120362.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.118909.log.gz 2023-11-04T01:55:31.029 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.120362.log.gz 2023-11-04T01:55:31.029 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112182.log 2023-11-04T01:55:31.029 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.123939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128317.log 2023-11-04T01:55:31.030 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112182.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123939.log.gz 2023-11-04T01:55:31.030 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112182.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124911.log 2023-11-04T01:55:31.030 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-11-04T01:55:31.030 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128317.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.128317.log.gz 2023-11-04T01:55:31.030 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96701.log 2023-11-04T01:55:31.030 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117962.log 2023-11-04T01:55:31.030 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96701.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124911.log.gz 2023-11-04T01:55:31.030 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96701.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121660.log 2023-11-04T01:55:31.031 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-11-04T01:55:31.031 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.117962.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.117962.log.gz 2023-11-04T01:55:31.031 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115080.log 2023-11-04T01:55:31.031 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111972.log 2023-11-04T01:55:31.031 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115080.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.121660.log.gz 2023-11-04T01:55:31.031 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115080.log.gz 2023-11-04T01:55:31.031 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112224.log 2023-11-04T01:55:31.031 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.111972.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111972.log.gz 2023-11-04T01:55:31.031 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128054.log 2023-11-04T01:55:31.032 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94039.log 2023-11-04T01:55:31.032 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128054.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112224.log.gz 2023-11-04T01:55:31.032 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128054.log.gz 2023-11-04T01:55:31.032 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116586.log 2023-11-04T01:55:31.032 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94039.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94039.log.gz 2023-11-04T01:55:31.032 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105951.log 2023-11-04T01:55:31.032 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116586.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116586.log.gz 2023-11-04T01:55:31.032 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100506.log 2023-11-04T01:55:31.032 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124498.log 2023-11-04T01:55:31.033 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100506.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105951.log.gz 2023-11-04T01:55:31.033 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100506.log.gz 2023-11-04T01:55:31.033 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124785.log 2023-11-04T01:55:31.033 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124498.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.124498.log.gz 2023-11-04T01:55:31.033 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113256.log 2023-11-04T01:55:31.033 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101617.log 2023-11-04T01:55:31.033 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124785.log.gz/var/log/ceph/ceph-client.admin.113256.log: 2023-11-04T01:55:31.033 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113622.log 2023-11-04T01:55:31.034 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101617.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.113256.log.gz 2023-11-04T01:55:31.034 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101617.log.gz 2023-11-04T01:55:31.034 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112621.log 2023-11-04T01:55:31.034 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96505.log 2023-11-04T01:55:31.034 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113622.log.gz 2023-11-04T01:55:31.034 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110279.log 2023-11-04T01:55:31.034 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96505.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112621.log.gz 2023-11-04T01:55:31.034 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96505.log.gz 2023-11-04T01:55:31.034 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103279.log 2023-11-04T01:55:31.035 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126291.log 2023-11-04T01:55:31.035 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110279.log.gz 2023-11-04T01:55:31.035 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126375.log 2023-11-04T01:55:31.035 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126291.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103279.log.gz 2023-11-04T01:55:31.035 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.126291.log.gz 2023-11-04T01:55:31.035 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104930.log 2023-11-04T01:55:31.035 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118643.log 2023-11-04T01:55:31.035 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126375.log.gz 2023-11-04T01:55:31.036 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124996.log 2023-11-04T01:55:31.036 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118643.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104930.log.gz 2023-11-04T01:55:31.036 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118643.log.gz 2023-11-04T01:55:31.036 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102846.log 2023-11-04T01:55:31.036 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95094.log 2023-11-04T01:55:31.036 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124996.log.gz 2023-11-04T01:55:31.036 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102636.log 2023-11-04T01:55:31.036 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95094.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102846.log.gz 2023-11-04T01:55:31.036 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95094.log.gz 2023-11-04T01:55:31.037 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113488.log 2023-11-04T01:55:31.037 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113088.log 2023-11-04T01:55:31.037 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102636.log.gz 2023-11-04T01:55:31.037 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101885.log 2023-11-04T01:55:31.037 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113088.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113488.log.gz 2023-11-04T01:55:31.037 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113088.log.gz 2023-11-04T01:55:31.037 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118253.log 2023-11-04T01:55:31.037 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106688.log 2023-11-04T01:55:31.037 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101885.log.gz 2023-11-04T01:55:31.038 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124072.log 2023-11-04T01:55:31.038 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118253.log.gz 2023-11-04T01:55:31.038 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106688.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106688.log.gz 2023-11-04T01:55:31.038 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111888.log 2023-11-04T01:55:31.038 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128669.log 2023-11-04T01:55:31.038 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124072.log.gz/var/log/ceph/ceph-client.admin.111888.log: 2023-11-04T01:55:31.038 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.111888.log.gz 2023-11-04T01:55:31.039 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103405.log 2023-11-04T01:55:31.039 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118727.log 2023-11-04T01:55:31.039 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128669.log.gz 2023-11-04T01:55:31.039 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113340.log 2023-11-04T01:55:31.039 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5%/var/log/ceph/ceph-client.admin.118727.log: -- replaced with /var/log/ceph/ceph-client.admin.103405.log.gz 2023-11-04T01:55:31.039 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118727.log.gz 2023-11-04T01:55:31.039 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113298.log 2023-11-04T01:55:31.039 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101189.log 2023-11-04T01:55:31.039 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113340.log.gz 2023-11-04T01:55:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.113298.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112453.log 2023-11-04T01:55:31.040 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.113298.log.gz 2023-11-04T01:55:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101189.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101189.log.gz 2023-11-04T01:55:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107435.log 2023-11-04T01:55:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96841.log 2023-11-04T01:55:31.040 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112453.log.gz 2023-11-04T01:55:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.107435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104511.log 2023-11-04T01:55:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96841.log: 90.8% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96841.log.gz 2023-11-04T01:55:31.040 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107435.log.gz 2023-11-04T01:55:31.041 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93901.log 2023-11-04T01:55:31.041 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120697.log 2023-11-04T01:55:31.041 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104511.log.gz/var/log/ceph/ceph-client.admin.93901.log: 2023-11-04T01:55:31.041 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104955.log 2023-11-04T01:55:31.041 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.120697.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93901.log.gz 2023-11-04T01:55:31.041 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120697.log.gz 2023-11-04T01:55:31.041 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128837.log 2023-11-04T01:55:31.041 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121151.log 2023-11-04T01:55:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128837.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.104955.log.gz 2023-11-04T01:55:31.042 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128837.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-04T01:55:31.042 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-11-04T01:55:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121151.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.121151.log.gz 2023-11-04T01:55:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112747.log 2023-11-04T01:55:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108477.log 2023-11-04T01:55:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112747.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112747.log.gz 2023-11-04T01:55:31.048 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129738.log 2023-11-04T01:55:31.048 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.108477.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108477.log.gz 2023-11-04T01:55:31.048 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118129.log 2023-11-04T01:55:31.048 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.129738.log: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.129738.log.gz 2023-11-04T01:55:31.048 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116774.log 2023-11-04T01:55:31.048 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118129.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118129.log.gz 2023-11-04T01:55:31.049 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106901.log 2023-11-04T01:55:31.049 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116774.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116774.log.gz 2023-11-04T01:55:31.049 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97415.log 2023-11-04T01:55:31.049 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106901.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106901.log.gz 2023-11-04T01:55:31.049 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98939.log 2023-11-04T01:55:31.049 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97415.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97415.log.gz 2023-11-04T01:55:31.049 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.98939.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98939.log.gz 2023-11-04T01:55:31.049 INFO:teuthology.orchestra.run.smithi044.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-04T01:55:31.050 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-04T01:55:31.052 INFO:teuthology.orchestra.run.smithi204.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-04T01:55:31.104 INFO:teuthology.orchestra.run.smithi204.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-04T01:55:31.681 INFO:teuthology.orchestra.run.smithi044.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-04T01:55:31.848 INFO:teuthology.orchestra.run.smithi204.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-04T01:55:31.972 INFO:teuthology.orchestra.run.smithi204.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-04T01:55:32.035 INFO:teuthology.orchestra.run.smithi044.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-04T01:55:32.049 INFO:teuthology.orchestra.run.smithi204.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-04T01:55:32.056 INFO:teuthology.orchestra.run.smithi204.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-04T01:55:32.058 INFO:teuthology.orchestra.run.smithi204.stderr: 2023-11-04T01:55:32.058 INFO:teuthology.orchestra.run.smithi204.stderr:real 0m1.392s 2023-11-04T01:55:32.058 INFO:teuthology.orchestra.run.smithi204.stderr:user 0m6.074s 2023-11-04T01:55:32.058 INFO:teuthology.orchestra.run.smithi204.stderr:sys 0m0.209s 2023-11-04T01:55:32.100 INFO:teuthology.orchestra.run.smithi044.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-04T01:55:32.133 INFO:teuthology.orchestra.run.smithi044.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-04T01:55:32.512 INFO:teuthology.orchestra.run.smithi044.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-04T01:55:32.513 INFO:teuthology.orchestra.run.smithi044.stderr: 2023-11-04T01:55:32.513 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m1.877s 2023-11-04T01:55:32.514 INFO:teuthology.orchestra.run.smithi044.stderr:user 0m7.014s 2023-11-04T01:55:32.514 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m0.586s 2023-11-04T01:55:32.514 INFO:tasks.ceph:Archiving logs... 2023-11-04T01:55:32.514 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916/remote/smithi044/log 2023-11-04T01:55:32.515 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-04T01:55:33.978 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916/remote/smithi204/log 2023-11-04T01:55:33.979 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-04T01:55:34.805 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:55:34.815 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-04T01:55:34.824 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:55:34.828 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-04T01:55:34.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-04T01:55:34.833 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-04T01:55:34.918 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-04T01:55:34.927 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-04T01:55:34.927 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:55:34.930 DEBUG:teuthology.orchestra.run.smithi204:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:55:34.944 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:55:34.946 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:55:34.950 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:55:34.951 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2023-11-04T01:55:34.951 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 41 +1832us[+1832us] +/- 82ms 2023-11-04T01:55:34.951 INFO:teuthology.orchestra.run.smithi044.stdout:^* hv02.front.sepia.ceph.com 3 6 377 42 -226us[ -401us] +/- 78ms 2023-11-04T01:55:34.951 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 -1279us[-1453us] +/- 61ms 2023-11-04T01:55:34.951 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:55:34.952 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:55:34.952 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2023-11-04T01:55:34.952 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 43 +1660us[+1663us] +/- 82ms 2023-11-04T01:55:34.952 INFO:teuthology.orchestra.run.smithi204.stdout:^* hv02.front.sepia.ceph.com 3 6 377 40 -403us[ -401us] +/- 78ms 2023-11-04T01:55:34.952 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 -1467us[-1467us] +/- 61ms 2023-11-04T01:55:34.953 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:55:34.953 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-04T01:55:34.962 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-04T01:55:34.962 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-04T01:55:34.970 DEBUG:teuthology.orchestra.run.smithi044:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-04T01:55:35.124 DEBUG:teuthology.orchestra.run.smithi204:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-04T01:55:35.227 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:55:35.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:35.265 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:55:35.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:35.299 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-04T01:55:35.309 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-04T01:55:35.318 INFO:teuthology.task.internal:Duration was 1860.206842 seconds 2023-11-04T01:55:35.318 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-04T01:55:35.335 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-04T01:55:35.335 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-04T01:55:35.338 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-04T01:55:35.383 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:55:35.386 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:55:35.644 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-04T01:55:35.644 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2023-11-04T01:55:35.645 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-04T01:55:35.664 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi204.front.sepia.ceph.com 2023-11-04T01:55:35.664 DEBUG:teuthology.orchestra.run.smithi204:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-04T01:55:35.684 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-04T01:55:35.684 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T01:55:35.707 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T01:55:35.752 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-04T01:55:35.752 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-04T01:55:35.779 DEBUG:teuthology.orchestra.run.smithi204:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-04T01:55:35.914 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-04T01:55:35.924 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-04T01:55:35.925 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-04T01:55:35.955 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-04T01:55:35.981 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-04T01:55:35.991 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:55:35.998 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:55:36.025 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2023-11-04T01:55:36.046 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = core 2023-11-04T01:55:36.062 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:55:36.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:36.098 DEBUG:teuthology.orchestra.run.smithi204:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:55:36.116 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:36.116 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-04T01:55:36.127 INFO:teuthology.task.internal:Transferring archived files... 2023-11-04T01:55:36.127 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916/remote/smithi044 2023-11-04T01:55:36.128 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-04T01:55:36.178 DEBUG:teuthology.misc:Transferring archived files from smithi204:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916/remote/smithi204 2023-11-04T01:55:36.179 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-04T01:55:36.213 INFO:teuthology.task.internal:Removing archive directory... 2023-11-04T01:55:36.214 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-04T01:55:36.216 DEBUG:teuthology.orchestra.run.smithi204:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-04T01:55:36.263 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-04T01:55:36.275 INFO:teuthology.task.internal:Not uploading archives. 2023-11-04T01:55:36.275 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-04T01:55:36.284 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-04T01:55:36.285 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-04T01:55:36.287 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-04T01:55:36.300 INFO:teuthology.orchestra.run.smithi044.stdout: 265531 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 4 01:55 /home/ubuntu/cephtest 2023-11-04T01:55:36.318 INFO:teuthology.orchestra.run.smithi204.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 4 01:55 /home/ubuntu/cephtest 2023-11-04T01:55:36.319 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-04T01:55:36.328 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-04T01:55:36.340 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi044 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:55:36.341 INFO:teuthology.nuke:Checking targets against current locks 2023-11-04T01:55:36.363 DEBUG:teuthology.nuke:shortname: smithi044 2023-11-04T01:55:36.364 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:55:36.385 DEBUG:teuthology.nuke:shortname: smithi204 2023-11-04T01:55:36.386 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:55:36.389 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:34.676279', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEP33QRKjqYt3rrNPaSn8R1Cq5DyKr+PhsocEzo4pZCAFLmg81RuMKOIgR7Q8+Ly7GV2/8n/Jo8rX3wsPso1O5I='} 2023-11-04T01:55:36.410 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445916', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:34.677984', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHbhy4KKYMDYVBb7sgkkvLdo1Ohw4vrv9EjCqGxg3XekYNRc70VsELiS7DRbS8pG7vm7tnfJQ5TqKesrAH4rWUM='} 2023-11-04T01:55:36.435 INFO:teuthology.orchestra.console.smithi044:Power off 2023-11-04T01:55:36.436 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:55:36.461 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2023-11-04T01:55:36.461 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:55:36.485 INFO:teuthology.orchestra.console.smithi204:Power off 2023-11-04T01:55:36.486 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:55:36.508 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2023-11-04T01:55:36.516 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2023-11-04T01:55:36.516 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:55:36.556 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-11-04T01:55:40.509 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:55:40.558 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:55:40.619 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2023-11-04T01:55:40.667 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-11-04T01:55:44.622 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:55:44.669 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:55:44.732 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2023-11-04T01:55:44.778 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-11-04T01:55:44.879 INFO:teuthology.orchestra.console.smithi204:Power off completed 2023-11-04T01:55:48.734 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:55:48.844 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2023-11-04T01:55:48.945 INFO:teuthology.orchestra.console.smithi044:Power off completed 2023-11-04T01:55:49.051 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} duration: 1860.2068424224854 failure_reason: 'Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9fc1f005409a4e548fad5810523519a4 status: fail success: false 2023-11-04T01:55:49.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:55:49.129 INFO:teuthology.run:FAIL